2025-10-02T08:07:12.608842Z :BasicWriteSession INFO: Random seed for debugging is 1759392432608835
2025-10-02T08:07:12.728971Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556532957661300960:2080];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:12.728991Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T08:07:12.732789Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:12.733401Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556532958863989622:2087];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:12.735626Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/wsi0/0028af/r3tmp/tmpv646Ug/pdisk_1.dat
2025-10-02T08:07:12.737090Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:12.771685Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:12.783844Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T08:07:12.783901Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 61844, node 1
2025-10-02T08:07:12.801073Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/wsi0/0028af/r3tmp/yandexclVXXa.tmp
2025-10-02T08:07:12.801087Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/wsi0/0028af/r3tmp/yandexclVXXa.tmp
2025-10-02T08:07:12.804562Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/wsi0/0028af/r3tmp/yandexclVXXa.tmp
2025-10-02T08:07:12.804631Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T08:07:12.804827Z INFO: TTestServer started on Port 21283 GrpcPort 61844
TClient is connected to server localhost:21283
PQClient connected to localhost:61844
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: 2025-10-02T08:07:12.830412Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:12.830443Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:12.835106Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:12.835133Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T08:07:12.837714Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T08:07:12.838576Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-02T08:07:12.842396Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T08:07:12.842450Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-02T08:07:12.967060Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:13.048282Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:13.087215Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556532963158957206:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.087233Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556532963158957217:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.087237Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.088490Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T08:07:13.092442Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556532963158957220:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-02T08:07:13.135352Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556532961956269242:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:13.135457Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=YmQxMDg1NDEtNDNjMjkyYjItYjMwMGNjOWYtYjQ4NjdjNTU=, ActorId: [1:7556532961956269200:2322], ActorState: ExecuteState, TraceId: 01k6hzc0y88kmkfdygnmvk8kzf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:13.135884Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:13.135983Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:13.151134Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556532963158957308:2165] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T08:07:13.155971Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556532963158957323:2308], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:13.156044Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ZWMyOTA1NTEtNWZmYjliMzctYjI5MjU5MTQtYjA2ZDcwZGY=, ActorId: [2:7556532963158957204:2295], ActorState: ExecuteState, TraceId: 01k6hzc0xy707vrxq3b6s2n3v5, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:13.156173Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:13.161949Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:13.187364Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:61844", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T08:07:13.223816Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6hzc11k7t60za92kf83vrry, Database: , SessionId: ydb://session/3?node_id=1&id=Y2YxODMwNzgtMmQ3NjFiOTYtZGM1N2YzNmMtY2UxYTY2Y2Y=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556532961956269627:2936] 
2025-10-02T08:07:13.730931Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:13.735041Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:17.731208Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556532957661300960:2080];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:17.731256Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T08:07:17.733246Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556532958863989622:2087];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:17.733286Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T08:07:18.410227Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:61844
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:18.444297Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:61844
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T08:07:18.474354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:18.475766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:18.475843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T08:07:18.475854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:18.475866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T08:07:18.475987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532983431106648:2442], now have 1 active actors on pipe
2025-10-02T08:07:18.475996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532983431106620:3245], now have 1 active actors on pipe
2025-10-02T08:07:18.476327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.473284Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556532983431106621:3246] connected; active server actors: 1
2025-10-02T08:07:18.473347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T08:07:18.473698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T08:07:18.474995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T08:07:18.476136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T08:07:18.477418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.479219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532983431106675:3287], now have 1 active actors on pipe
2025-10-02T08:07:18.479403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.489723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.489972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:18.490004Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:18.490095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:18.490185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556532984633794301:2401]
2025-10-02T08:07:18.490843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:18.490847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:18.490852Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556532984633794301:2401]
2025-10-02T08:07:18.490858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:18.491145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T08:07:18.491152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.491183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.491185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:18.491189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:18.491190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.491192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.491194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:18.491199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:18.491277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.491315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.498379Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6hzc66dbzmj6w291prsc8qm, Database: , SessionId: ydb://session/3?node_id=1&id=ZTBmN2U5MjktNDk0MmIwMzItMzUzY2I0MjQtYmVhZTBmZDM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T08:07:18.499572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.499651Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392438524, TxId 281474976720677
2025-10-02T08:07:18.499658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.499661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.499699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.499750Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:18.501707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:18.501802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:18.501814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.501816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.501819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.501831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.501954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T08:07:18.501978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:18.502043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.504473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.504511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.505493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759392438524
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759392438524
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:61844
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:18.514541Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-02T08:07:18.592415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.592439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.592441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.692865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.692885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.692888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.796868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.796886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.796889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.899729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.899746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.899749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.002929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.002953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.002956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:61844
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:19.017846Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:19.105314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.105331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.105341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.217133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.217157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.217160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.316938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.316960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.316964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.420278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.420291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.420295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:61844
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:19.520481Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T08:07:19.522076Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T08:07:19.522289Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T08:07:19.522294Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:61844
2025-10-02T08:07:19.524388Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:19.524974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.524992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.524995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.529720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:19.529733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T08:07:19.529941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:19.529987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:55888
2025-10-02T08:07:19.529998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55888 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:19.530004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:19.530808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T08:07:19.530858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:19.530860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:19.530862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:19.530867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532987726074155:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:19.531413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532987726074155:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:19.565219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556532987726074155:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:19.565686Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987726074187:2481] connected; active server actors: 1
2025-10-02T08:07:19.565776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556532987726074155:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T08:07:19.565794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532987726074155:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:19.570172Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987726074187:2481] disconnected; active server actors: 1
2025-10-02T08:07:19.570179Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987726074187:2481] disconnected no session
2025-10-02T08:07:19.609581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532987726074155:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:19.609599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532987726074155:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T08:07:19.609603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532987726074155:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:19.609613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:19.610502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T08:07:19.612878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532987726074209:2481], now have 1 active actors on pipe
2025-10-02T08:07:19.612929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.612939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.612985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|cf38470d-d8535e64-6277125c-f24d069d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T08:07:19.613000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.613007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.613010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:19.613027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.613047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:19.613062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.613498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.613507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.613526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.613693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|cf38470d-d8535e64-6277125c-f24d069d_0
2025-10-02T08:07:19.614061Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392439614 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.614104Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|cf38470d-d8535e64-6277125c-f24d069d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:19.614231Z :INFO: [] MessageGroupId [src] SessionId [src|cf38470d-d8535e64-6277125c-f24d069d_0] Write session: close. Timeout = 0 ms
2025-10-02T08:07:19.614236Z :INFO: [] MessageGroupId [src] SessionId [src|cf38470d-d8535e64-6277125c-f24d069d_0] Write session will now close
2025-10-02T08:07:19.614244Z :DEBUG: [] MessageGroupId [src] SessionId [src|cf38470d-d8535e64-6277125c-f24d069d_0] Write session: aborting
2025-10-02T08:07:19.614358Z :INFO: [] MessageGroupId [src] SessionId [src|cf38470d-d8535e64-6277125c-f24d069d_0] Write session: gracefully shut down, all writes complete
2025-10-02T08:07:19.614363Z :DEBUG: [] MessageGroupId [src] SessionId [src|cf38470d-d8535e64-6277125c-f24d069d_0] Write session: destroy
2025-10-02T08:07:19.616988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|cf38470d-d8535e64-6277125c-f24d069d_0 grpc read done: success: 0 data: 
2025-10-02T08:07:19.617001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|cf38470d-d8535e64-6277125c-f24d069d_0 grpc read failed
2025-10-02T08:07:19.617006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|cf38470d-d8535e64-6277125c-f24d069d_0 grpc closed
2025-10-02T08:07:19.617014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|cf38470d-d8535e64-6277125c-f24d069d_0 is DEAD
2025-10-02T08:07:19.617229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T08:07:19.617595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532987726074209:2481] destroyed
2025-10-02T08:07:19.617615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T08:07:19.617623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.617626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.617628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.625303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.625319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.625324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
Got new write session event: ReadyToAcceptEvent
Got new write session event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-02T08:07:19.690500Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:61844" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:61844" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:61844" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-02T08:07:19.701067Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T08:07:19.701308Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T08:07:19.730816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.730835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.730838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.764964Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T08:07:19.766949Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:19.767153Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T08:07:19.768922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:19.768938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T08:07:19.769168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:19.769207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:35410
2025-10-02T08:07:19.769212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:35410 proto=topic  topic=test-topic durationSec=0
2025-10-02T08:07:19.769217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:19.769799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T08:07:19.769828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:19.769830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:19.769832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:19.769838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532987726074225:2495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:19.770396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532987726074225:2495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:19.779614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556532987726074225:2495] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:19.780024Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987726074244:2495] connected; active server actors: 1
2025-10-02T08:07:19.780102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556532987726074225:2495] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-02T08:07:19.780111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532987726074225:2495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:19.780440Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987726074244:2495] disconnected; active server actors: 1
2025-10-02T08:07:19.780445Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987726074244:2495] disconnected no session
2025-10-02T08:07:19.785925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532987726074225:2495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:19.785946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532987726074225:2495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T08:07:19.785951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532987726074225:2495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:19.785961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:19.786884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532987726074260:2495], now have 1 active actors on pipe
2025-10-02T08:07:19.787031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T08:07:19.787174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.787186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.787217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:19.787229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.787235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.787238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:19.787254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.787269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:19.787291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.787561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.787568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.787583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.788336Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T08:07:19.788355Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392439788 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.788393Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-02T08:07:19.788476Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-02T08:07:19.787766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0
2025-10-02T08:07:19.788780Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-02T08:07:19.788797Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-02T08:07:19.789142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.789252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.792379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.792397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.792434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:19.792610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T08:07:19.792837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.792844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.792965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 96 offset: -1
2025-10-02T08:07:19.792974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.792991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.792999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.793001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:19.793033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T08:07:19.793093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 170 count 1 nextOffset 1 batches 1
2025-10-02T08:07:19.793099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.793166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 158 WTime 1759392439788
2025-10-02T08:07:19.793190Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.793202Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 158
2025-10-02T08:07:19.794508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 158 actorID [2:7556532984633794284:2401]
2025-10-02T08:07:19.794528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.794612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 158
2025-10-02T08:07:19.800974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-02T08:07:19.801018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 103 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.801030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.801047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-02T08:07:19.801094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:19.801102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:19.801107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.801112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.801116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.801129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-02T08:07:19.801133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 158 bytes (158)
2025-10-02T08:07:19.801138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 158 (8388608)
2025-10-02T08:07:19.801157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T08:07:19.801202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T08:07:19.801218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 158 count 1 last offset 0, current partition end offset: 1
2025-10-02T08:07:19.801223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:19.801234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 158 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.801242Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-02T08:07:19.801261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.801278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 138 from pos 0 cbcount 1
2025-10-02T08:07:19.801298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439788 queuesize 0 startOffset 0
2025-10-02T08:07:19.801764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-02T08:07:19.801967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-02T08:07:19.802427Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-02T08:07:19.802617Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 8000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-02T08:07:19.802626Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-02T08:07:19.802635Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session: acknoledged message 1
Got new write session event: AcksEvent: { seqNo : 1, State : EES_WRITTEN, offset : 0, partitionId : 0 } write stat: Write time 0.008000s minimal time in partition queue 0.000000s maximal time in partition queue 0.000000s partition quoted time 0.000000s topic quoted time 0.000000s
2025-10-02T08:07:19.806900Z :INFO: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-02T08:07:19.806906Z :INFO: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session will now close
2025-10-02T08:07:19.806926Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session: aborting
2025-10-02T08:07:19.807108Z :INFO: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-02T08:07:19.807945Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0]  MessageGroupId [src_id] Write session: destroy
2025-10-02T08:07:19.813522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0 grpc read done: success: 0 data: 
2025-10-02T08:07:19.813536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0 grpc read failed
2025-10-02T08:07:19.813546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0 grpc closed
2025-10-02T08:07:19.813553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|7dc5860b-75724a8a-522cd4e3-388e6f7a_0 is DEAD
2025-10-02T08:07:19.813757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T08:07:19.814117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532987726074260:2495] destroyed
2025-10-02T08:07:19.814141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T08:07:19.814151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.814154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.814157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.833151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.833169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.833172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.941340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.941362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.941365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.459514Z :CloseWriteSessionImmediately INFO: Random seed for debugging is 1759392440459506
2025-10-02T08:07:20.549782Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556532993063604552:2086];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:20.549809Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T08:07:20.553467Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/wsi0/0028af/r3tmp/tmpVfIw0g/pdisk_1.dat
2025-10-02T08:07:20.557007Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:20.564537Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:20.572702Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:20.572752Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-02T08:07:20.576442Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T08:07:20.581731Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:20.581750Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:20.583170Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T08:07:20.583560Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 4899, node 3
2025-10-02T08:07:20.591627Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/wsi0/0028af/r3tmp/yandex5qA4b9.tmp
2025-10-02T08:07:20.591638Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/wsi0/0028af/r3tmp/yandex5qA4b9.tmp
2025-10-02T08:07:20.591701Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/wsi0/0028af/r3tmp/yandex5qA4b9.tmp
2025-10-02T08:07:20.591744Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T08:07:20.600615Z INFO: TTestServer started on Port 1861 GrpcPort 4899
TClient is connected to server localhost:1861
PQClient connected to localhost:4899
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T08:07:20.657084Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:20.657116Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:20.661903Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T08:07:20.662385Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-02T08:07:20.669107Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720657, at schemeshard: 72057594046644480
waiting...
waiting...
waiting...
2025-10-02T08:07:20.709536Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720660, at schemeshard: 72057594046644480
2025-10-02T08:07:20.722707Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:20.741471Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:21.016904Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556532997358572758:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.016996Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.025921Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556532997358572780:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.025943Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556532997358572784:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.025996Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.028758Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T08:07:21.029339Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:21.040000Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556532997358572805:2335], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.040181Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.068886Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556532997358572803:2333], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-02T08:07:21.101602Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:21.158678Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556532997358573077:2834] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T08:07:21.164433Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556532997358573102:2348], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:21.165672Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=Yjk5MjQ1ODktMWQ1Yjk5M2ItZGMyYjY0MWMtNjYzYTEyMGI=, ActorId: [3:7556532997358572754:2322], ActorState: ExecuteState, TraceId: 01k6hzc8njc5zpzv3czbvs54jm, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:21.165929Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:21.178337Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556532995879616266:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:21.179201Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=NjM1OGIxMDAtMWQ3YWQzZWQtZDI2ZTM1OGEtNWU1MzllOA==, ActorId: [4:7556532995879616224:2298], ActorState: ExecuteState, TraceId: 01k6hzc8te9sh4rfexd5fetv35, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:21.179363Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:21.177922Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:4899", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T08:07:21.268730Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6hzc8wy5eadkc71eh2v75hs, Database: , SessionId: ydb://session/3?node_id=3&id=NTBmNzBhZmYtNmU4MGQ3OGItZDFkMDEwNDYtZjRhNDY4Y2Y=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556532997358573301:2983] 
2025-10-02T08:07:21.552240Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:21.556929Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:25.552530Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556532993063604552:2086];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:25.552570Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T08:07:26.570279Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:4899
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:26.602890Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:4899
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T08:07:26.611678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:26.612075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:26.612117Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T08:07:26.612123Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:26.612143Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T08:07:26.612173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533018833410356:3311], now have 1 active actors on pipe
2025-10-02T08:07:26.612377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.613229Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:26.621771Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556533018833410358:3312] connected; active server actors: 1
2025-10-02T08:07:26.622244Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T08:07:26.622452Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T08:07:26.622868Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-02T08:07:26.622874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556533017354453113:2380], now have 1 active actors on pipe
2025-10-02T08:07:26.624148Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T08:07:26.626276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533018833410430:3368], now have 1 active actors on pipe
2025-10-02T08:07:26.626376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.627499Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:26.627690Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:26.627707Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:26.627761Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:26.627807Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556533018833410441:2471]
2025-10-02T08:07:26.628509Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:26.628517Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:26.628521Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556533018833410441:2471]
2025-10-02T08:07:26.628527Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:26.628779Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T08:07:26.628791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.628823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.628826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:26.628830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:26.628834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.628836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.628837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:26.628843Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:26.628918Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.628951Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:26.629967Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:26.630005Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392446672, TxId 281474976720679
2025-10-02T08:07:26.630014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.630016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.630040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.630086Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:26.630584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:26.630641Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:26.630652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.630654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.630656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.630662Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:26.630774Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T08:07:26.630799Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:26.630853Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.632280Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:26.632329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.632569Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6hzce4ja7gc6zge0eb3g0nd, Database: , SessionId: ydb://session/3?node_id=3&id=MTE3ZjViYWQtNmQzZmU4YmQtN2ZkMWE3YzktODZlNDk1MTA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T08:07:26.633249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759392446672
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759392446672
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:4899
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:26.650595Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:26.728547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.728566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.728569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.830508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.830524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.830527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.935064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.935087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.935091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.041638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.041655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.041659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.144888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.144910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.144913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:4899
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:27.153182Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:27.243638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.243655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.243658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.343975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.344007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.344010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.449645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.449661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.449663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.553325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.553339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.553342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:4899
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:27.656943Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.656960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.656964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T08:07:27.660145Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-02T08:07:27.666749Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T08:07:27.667021Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T08:07:27.667028Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:4899
2025-10-02T08:07:27.668981Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:27.669391Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:27.669409Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T08:07:27.669720Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:27.669753Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:41732
2025-10-02T08:07:27.669759Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41732 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:27.669763Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:27.670420Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T08:07:27.670451Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:27.670454Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:27.670456Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:27.670461Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556533023128377946:2509] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:27.671084Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556533023128377946:2509] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:27.700593Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556533023128377946:2509] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:27.701624Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556533023128377946:2509] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T08:07:27.701633Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556533023128377946:2509] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:27.701329Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533023128377976:2509] connected; active server actors: 1
2025-10-02T08:07:27.703473Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533023128377976:2509] disconnected; active server actors: 1
2025-10-02T08:07:27.703479Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533023128377976:2509] disconnected no session
2025-10-02T08:07:27.725462Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556533023128377946:2509] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:27.725480Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556533023128377946:2509] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T08:07:27.725484Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556533023128377946:2509] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:27.725494Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:27.725928Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T08:07:27.725944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533023128377996:2509], now have 1 active actors on pipe
2025-10-02T08:07:27.725952Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.725958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.725996Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|f5393319-e149187c-72bc68b7-72edfdf5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T08:07:27.726009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.726017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.726020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:27.726035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.726059Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:27.726076Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.726121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.726124Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.726625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.726673Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|f5393319-e149187c-72bc68b7-72edfdf5_0
2025-10-02T08:07:27.727148Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392447727 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:27.727213Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|f5393319-e149187c-72bc68b7-72edfdf5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:27.727350Z :INFO: [] MessageGroupId [src] SessionId [src|f5393319-e149187c-72bc68b7-72edfdf5_0] Write session: close. Timeout = 0 ms
2025-10-02T08:07:27.727356Z :INFO: [] MessageGroupId [src] SessionId [src|f5393319-e149187c-72bc68b7-72edfdf5_0] Write session will now close
2025-10-02T08:07:27.727361Z :DEBUG: [] MessageGroupId [src] SessionId [src|f5393319-e149187c-72bc68b7-72edfdf5_0] Write session: aborting
2025-10-02T08:07:27.727606Z :INFO: [] MessageGroupId [src] SessionId [src|f5393319-e149187c-72bc68b7-72edfdf5_0] Write session: gracefully shut down, all writes complete
2025-10-02T08:07:27.727624Z :DEBUG: [] MessageGroupId [src] SessionId [src|f5393319-e149187c-72bc68b7-72edfdf5_0] Write session is aborting and will not restart
2025-10-02T08:07:27.727646Z :DEBUG: [] MessageGroupId [src] SessionId [src|f5393319-e149187c-72bc68b7-72edfdf5_0] Write session: destroy
2025-10-02T08:07:27.729074Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|f5393319-e149187c-72bc68b7-72edfdf5_0 grpc closed
2025-10-02T08:07:27.729083Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|f5393319-e149187c-72bc68b7-72edfdf5_0 is DEAD
2025-10-02T08:07:27.729277Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T08:07:27.737354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556533023128377996:2509] destroyed
2025-10-02T08:07:27.737381Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T08:07:27.737392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.737395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.737397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-02T08:07:27.760385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.760400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.760402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.860554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.860571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.860575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.960965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.960982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.960986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:12.082785Z :FallbackToSingleDb INFO: Random seed for debugging is 1759392432082777
2025-10-02T08:07:12.225904Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556532956996436441:2263];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:12.225968Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T08:07:12.228153Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556532956428241067:2079];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:12.228322Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/wsi0/0028e5/r3tmp/tmpkuBtyF/pdisk_1.dat
2025-10-02T08:07:12.229560Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:12.230687Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:12.270354Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:12.272848Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:12.295472Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 3301, node 1
2025-10-02T08:07:12.310847Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/wsi0/0028e5/r3tmp/yandexYZVamu.tmp
2025-10-02T08:07:12.310864Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/wsi0/0028e5/r3tmp/yandexYZVamu.tmp
2025-10-02T08:07:12.312793Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/wsi0/0028e5/r3tmp/yandexYZVamu.tmp
2025-10-02T08:07:12.312896Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T08:07:12.317532Z INFO: TTestServer started on Port 15670 GrpcPort 3301
2025-10-02T08:07:12.322726Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:12.322761Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:12.325632Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T08:07:12.330635Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:12.330663Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:12.331986Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T08:07:12.332339Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient is connected to server localhost:15670
PQClient connected to localhost:3301
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T08:07:12.346497Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-02T08:07:12.405027Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720660, at schemeshard: 72057594046644480
2025-10-02T08:07:12.527766Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:12.564715Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:12.659025Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556532956428241373:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.659066Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556532956428241366:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.659098Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.661167Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T08:07:12.662394Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556532956428241407:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.662423Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.662465Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556532956428241409:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.662485Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.668619Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556532956428241380:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-02T08:07:12.729910Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556532956996437234:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:12.729957Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:12.730929Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=OGUyM2NhYzEtZDcxYjQ0N2UtMmE5NTIyNS0yOTZhZDdhOQ==, ActorId: [1:7556532956996437192:2322], ActorState: ExecuteState, TraceId: 01k6hzc0h54hb27bbxp62yshys, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:12.731379Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:12.738475Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556532956428241412:2135] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T08:07:12.744623Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556532956428241444:2307], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:12.745306Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=YWFlZWI1OGEtNmQ0YjhlOTctMzIzNWQ5OTgtYWJhMjdiZWQ=, ActorId: [2:7556532956428241364:2295], ActorState: ExecuteState, TraceId: 01k6hzc0gj1d5ymgex302asmbv, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:12.745441Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:12.773705Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:12.798387Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3301", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T08:07:12.845778Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6hzc0np1x8gf73000vdrzfd, Database: , SessionId: ydb://session/3?node_id=1&id=YmNiZmRlYTEtOWZhOWI0MGUtOTEwNjllZTUtODM3MDBhZjc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556532956996437623:2942] 
2025-10-02T08:07:13.225249Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:13.229821Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:17.226015Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556532956996436441:2263];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:17.226060Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T08:07:17.228569Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556532956428241067:2079];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:17.228607Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T08:07:17.999762Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3301
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:18.034038Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3301
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T08:07:18.047452Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556532982766241919:3254] connected; active server actors: 1
2025-10-02T08:07:18.047690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T08:07:18.048169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T08:07:18.048422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T08:07:18.058047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:18.061491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:18.061591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T08:07:18.061605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:18.061619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T08:07:18.061783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532982766241918:3253], now have 1 active actors on pipe
2025-10-02T08:07:18.061792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532982766241936:2442], now have 1 active actors on pipe
2025-10-02T08:07:18.062253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.066656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.065558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T08:07:18.072370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532982766241976:3298], now have 1 active actors on pipe
2025-10-02T08:07:18.072587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.073755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.074056Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6hzc5s6dpb23ft79gbht8ak, Database: , SessionId: ydb://session/3?node_id=1&id=OTY3OTk3OTItZTYzOWRmMDctNmNkODgzZTgtZmJkZjBkYTA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T08:07:18.073991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:18.074027Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:18.074106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:18.074181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556532982198045747:2401]
2025-10-02T08:07:18.074875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:18.074881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:18.074887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556532982198045747:2401]
2025-10-02T08:07:18.074895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:18.075187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T08:07:18.075197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.075227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.075230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:18.075234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:18.075237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.075239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.075241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:18.075249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:18.075337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.075384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.079922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.079996Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392438118, TxId 281474976720677
2025-10-02T08:07:18.080004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.080006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.080045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.080103Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:18.082335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:18.082427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:18.082438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.082441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.082444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.082455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.082588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T08:07:18.082614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:18.082680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.085755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.085808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.086794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759392438118
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759392438118
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3301
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:18.098631Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:18.176887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.176905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.176909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.276792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.276823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.276825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.380875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.380892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.380896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.480002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.480019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.480023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.580860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.580880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.580883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3301
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:18.600086Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:18.681758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.681779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.681781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.782016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.782038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.782044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.882747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.882770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.882772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.983761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.983777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.983779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.085018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.085035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.085038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3301
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:19.102859Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T08:07:19.109024Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T08:07:19.109297Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T08:07:19.109305Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3301
2025-10-02T08:07:19.112042Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:19.112571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:19.112589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T08:07:19.117126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:19.117194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:36776
2025-10-02T08:07:19.117201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:36776 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:19.117207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:19.117890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T08:07:19.117936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:19.117938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:19.117940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:19.117947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532987061209445:2480] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:19.118569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532987061209445:2480] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:19.157200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556532987061209445:2480] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:19.157653Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987061209481:2480] connected; active server actors: 1
2025-10-02T08:07:19.157698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556532987061209445:2480] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T08:07:19.157708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532987061209445:2480] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:19.158176Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987061209481:2480] disconnected; active server actors: 1
2025-10-02T08:07:19.158191Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987061209481:2480] disconnected no session
2025-10-02T08:07:19.176709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532987061209445:2480] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:19.176722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532987061209445:2480] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T08:07:19.176725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532987061209445:2480] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:19.176731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:19.177109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T08:07:19.177601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532987061209503:2480], now have 1 active actors on pipe
2025-10-02T08:07:19.177635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.177642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.177682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T08:07:19.177694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.177698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.177701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:19.177714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.177730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:19.177749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.178085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.178094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.178114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.178214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0
2025-10-02T08:07:19.179623Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392439179 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.179660Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:19.179801Z :INFO: [] MessageGroupId [src] SessionId [src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0] Write session: close. Timeout = 0 ms
2025-10-02T08:07:19.179818Z :INFO: [] MessageGroupId [src] SessionId [src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0] Write session will now close
2025-10-02T08:07:19.179825Z :DEBUG: [] MessageGroupId [src] SessionId [src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0] Write session: aborting
2025-10-02T08:07:19.180038Z :INFO: [] MessageGroupId [src] SessionId [src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0] Write session: gracefully shut down, all writes complete
2025-10-02T08:07:19.180044Z :DEBUG: [] MessageGroupId [src] SessionId [src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0] Write session: destroy
2025-10-02T08:07:19.180701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0 grpc read done: success: 0 data: 
2025-10-02T08:07:19.180723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0 grpc read failed
2025-10-02T08:07:19.180733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0 grpc closed
2025-10-02T08:07:19.180740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|f6e8170e-3bf3d0fc-6116657-5ef1d6ce_0 is DEAD
2025-10-02T08:07:19.180973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T08:07:19.181130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532987061209503:2480] destroyed
2025-10-02T08:07:19.181149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T08:07:19.181166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.181169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.181171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.185508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.185521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.185524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-02T08:07:19.200868Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-02T08:07:19.200908Z :INFO: [/Root] [] [1871addd-85410c47-5b22f28d-ba701c9c] Open read subsessions to databases: { name: , endpoint: localhost:3301, path: /Root }
2025-10-02T08:07:19.201007Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Starting read session
2025-10-02T08:07:19.201026Z :DEBUG: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Starting single session
2025-10-02T08:07:19.201365Z :DEBUG: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.201374Z :DEBUG: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.201380Z :DEBUG: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T08:07:19.209202Z :DEBUG: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] [] Successfully connected. Initializing session
2025-10-02T08:07:19.213055Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:07:19.213069Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-02T08:07:19.215027Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:19.215121Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 read init: from# ipv6:[::1]:50164, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:19.215224Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 auth for : user
2025-10-02T08:07:19.215492Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 Handle describe topics response
2025-10-02T08:07:19.215518Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 auth is DEAD
2025-10-02T08:07:19.215537Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:07:19.215960Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:07:19.216258Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] [] Got InitResponse. ReadSessionId: shared/user_1_1_13271116266475740334_v1
2025-10-02T08:07:19.216272Z :DEBUG: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.216364Z :DEBUG: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.216510Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987061209513:2494] connected; active server actors: 1
2025-10-02T08:07:19.216520Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556532987061209513:2494] session shared/user_1_1_13271116266475740334_v1
2025-10-02T08:07:19.216530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:07:19.216539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:07:19.216546Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_13271116266475740334_v1" (Sender=[1:7556532987061209510:2494], Pipe=[1:7556532987061209513:2494], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:19.216550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:07:19.216560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:07:19.216568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_13271116266475740334_v1" (Sender=[1:7556532987061209510:2494], Pipe=[1:7556532987061209513:2494], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:19.216579Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_13271116266475740334_v1" sender [1:7556532987061209510:2494] lock partition 0 for ReadingSession "shared/user_1_1_13271116266475740334_v1" (Sender=[1:7556532987061209510:2494], Pipe=[1:7556532987061209513:2494], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-02T08:07:19.216589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:07:19.216594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000030s
2025-10-02T08:07:19.216847Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_13271116266475740334_v1" ClientId: "user" PipeClient { RawX1: 7556532987061209513 RawX2: 4503603922340286 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:19.216874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:07:19.216980Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:07:19.217015Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 got read request: guid# cef7fb08-c5267e2a-d3244e1a-c8f03c9
2025-10-02T08:07:19.217521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532987061209516:2497], now have 1 active actors on pipe
2025-10-02T08:07:19.217679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532987061209516:2497]
2025-10-02T08:07:19.217807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.217820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.217838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_13271116266475740334_v1 on pipe: [1:7556532987061209516:2497]
2025-10-02T08:07:19.217865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.217876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.217879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:19.217924Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_13271116266475740334_v1
2025-10-02T08:07:19.217932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.217965Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.218172Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_13271116266475740334_v1:1 with generation 1
2025-10-02T08:07:19.225862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.225906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.225914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.225917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.225918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.225924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:19.225940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:19.226158Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759392439185 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:07:19.226178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T08:07:19.226212Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name:  Database path: /Root Database id:  CommittedOffset: 0 EndOffset: 0 }
2025-10-02T08:07:19.232989Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-02T08:07:19.233137Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Closing read session. Close timeout: 0.010000s
2025-10-02T08:07:19.233152Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-02T08:07:19.233165Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 32 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.233310Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Closing read session. Close timeout: 0.000000s
2025-10-02T08:07:19.233314Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-02T08:07:19.233317Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 32 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.233323Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Closing read session. Close timeout: 0.000000s
2025-10-02T08:07:19.233325Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-02T08:07:19.233328Z :INFO: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 32 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.233342Z :NOTICE: [/Root] [/Root] [476a4a7b-7973ba61-c0b8c20d-188d6ab8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T08:07:19.236973Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-02T08:07:19.237036Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 grpc closed
2025-10-02T08:07:19.237056Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_13271116266475740334_v1 is DEAD
2025-10-02T08:07:19.237411Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987061209513:2494] disconnected; active server actors: 1
2025-10-02T08:07:19.237420Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987061209513:2494] client user disconnected session shared/user_1_1_13271116266475740334_v1
2025-10-02T08:07:19.241103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_13271116266475740334_v1
2025-10-02T08:07:19.241128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532987061209516:2497] destroyed
2025-10-02T08:07:19.241150Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_13271116266475740334_v1
2025-10-02T08:07:19.288961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.288975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.288978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.393050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.393065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.393068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.123694Z :FallbackToSingleDbAfterBadRequest INFO: Random seed for debugging is 1759392440123685
2025-10-02T08:07:20.239383Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556532993602836481:2262];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:20.239508Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/wsi0/0028e5/r3tmp/tmpFFb360/pdisk_1.dat
2025-10-02T08:07:20.273456Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:20.273615Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:20.273291Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-02T08:07:20.273456Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:20.273530Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556532991895846466:2269];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:20.273659Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T08:07:20.325237Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T08:07:20.343652Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:20.343684Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:20.344119Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:20.344131Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:20.348018Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T08:07:20.348072Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 20389, node 3
2025-10-02T08:07:20.355686Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/wsi0/0028e5/r3tmp/yandexx6NCpS.tmp
2025-10-02T08:07:20.355697Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/wsi0/0028e5/r3tmp/yandexx6NCpS.tmp
2025-10-02T08:07:20.355760Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/wsi0/0028e5/r3tmp/yandexx6NCpS.tmp
2025-10-02T08:07:20.355809Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T08:07:20.357424Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T08:07:20.357983Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:20.360732Z INFO: TTestServer started on Port 30277 GrpcPort 20389
TClient is connected to server localhost:30277
PQClient connected to localhost:20389
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T08:07:20.400745Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-02T08:07:20.425328Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715658, at schemeshard: 72057594046644480
waiting...
waiting...
2025-10-02T08:07:20.465716Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715660, at schemeshard: 72057594046644480
2025-10-02T08:07:20.474596Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:20.702300Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556532991895846557:2294], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:20.702319Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556532991895846591:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:20.702334Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:20.703133Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556532991895846597:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:20.703155Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:20.704327Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T08:07:20.709535Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720657, at schemeshard: 72057594046644480
2025-10-02T08:07:20.709683Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556532991895846596:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-10-02T08:07:20.736858Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:20.736944Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556532993602837316:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:20.737019Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=YmYxNjVmNTYtMTA1MmI5MTYtYzhlZTVlYzgtN2FhYTY1MjQ=, ActorId: [3:7556532993602837290:2323], ActorState: ExecuteState, TraceId: 01k6hzc8csdsbxwyy2r86qsser, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:20.737168Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:20.773029Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:20.774299Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556532991895846626:2134] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T08:07:20.778917Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556532991895846641:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:20.779064Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=YjZkZjYxM2ItOGNiYTdlMGMtYjk3OTYwYTEtODQzZTcxNjY=, ActorId: [4:7556532991895846555:2293], ActorState: ExecuteState, TraceId: 01k6hzc8bs3n4qc80k5z3a0pd9, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:20.779179Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:20.794767Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:20389", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T08:07:20.836032Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k6hzc8fe30v12gvxj3gje2ss, Database: , SessionId: ydb://session/3?node_id=3&id=MzhkOWFmNjItNDkxMTFkZGYtZDEzMWViODgtNTNhNTdkMjY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556532993602837758:2973] 
2025-10-02T08:07:21.234494Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:21.270050Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:25.239296Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556532993602836481:2262];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:25.239340Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T08:07:25.271599Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556532991895846466:2269];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:25.271647Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T08:07:26.062877Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:20389
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:26.080347Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:20389
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T08:07:26.087346Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:26.088163Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556533019372642106:3303] connected; active server actors: 1
2025-10-02T08:07:26.088381Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T08:07:26.088503Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T08:07:26.093239Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T08:07:26.093260Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:26.093368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T08:07:26.093384Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:26.093394Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T08:07:26.093432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533019372642105:3302], now have 1 active actors on pipe
2025-10-02T08:07:26.093444Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556533017665650847:2385], now have 1 active actors on pipe
2025-10-02T08:07:26.093516Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-02T08:07:26.093545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.094343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:26.095401Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533019372642172:3355], now have 1 active actors on pipe
2025-10-02T08:07:26.095468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.096059Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:26.096218Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:26.096231Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:26.096267Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:26.096310Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556533019372642184:2462]
2025-10-02T08:07:26.096936Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:26.096943Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:26.096948Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556533019372642184:2462]
2025-10-02T08:07:26.096952Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:26.097185Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T08:07:26.097195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.097211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.097218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:26.097222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:26.097223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.097224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.097225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:26.097230Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:26.097278Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.097298Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:26.097858Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k6hzcdm5acm5m08d7wb338d9, Database: , SessionId: ydb://session/3?node_id=3&id=ZjdhMTI4Ny03YTNlZmQ3OC03YWM0MGU0NC02MDU4ZDhmNQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T08:07:26.098221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:26.098267Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392446140, TxId 281474976715677
2025-10-02T08:07:26.098271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.098272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.098295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.098333Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:26.098692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:26.098747Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:26.098760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.098762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.098763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.098769Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:26.098868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T08:07:26.098894Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:26.098933Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.099847Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:26.099873Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:26.100294Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1759392446140
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1759392446140
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:20389
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:26.104052Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:26.197292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.197311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.197315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.300885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.300904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.300908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.401094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.401117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.401121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.501984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.502002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.502006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.602924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.602942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.602946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:20389
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:26.609726Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:26.703134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.703151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.703153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.805021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.805038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.805042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.905397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.905411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.905414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.006262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.006278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.006282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.106586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.106602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.106605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:20389
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:27.114241Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T08:07:27.117901Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T08:07:27.118171Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T08:07:27.118177Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:20389
2025-10-02T08:07:27.118615Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:27.129697Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:27.129719Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T08:07:27.130251Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:27.130285Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:37100
2025-10-02T08:07:27.130292Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37100 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:27.130296Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:27.131780Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T08:07:27.131837Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:27.131847Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:27.131850Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:27.131869Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556533023667609679:2498] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:27.132585Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556533023667609679:2498] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:27.167780Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556533023667609679:2498] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:27.168419Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533023667609718:2498] connected; active server actors: 1
2025-10-02T08:07:27.168754Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556533023667609679:2498] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T08:07:27.168767Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556533023667609679:2498] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:27.171668Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533023667609718:2498] disconnected; active server actors: 1
2025-10-02T08:07:27.171683Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533023667609718:2498] disconnected no session
2025-10-02T08:07:27.198088Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556533023667609679:2498] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:27.198109Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556533023667609679:2498] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T08:07:27.198113Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556533023667609679:2498] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:27.198134Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:27.198297Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-02T08:07:27.198318Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533023667609738:2498], now have 1 active actors on pipe
2025-10-02T08:07:27.198328Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.198336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.198372Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|8185c447-d6b5b320-b68b7c20-1f24afa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T08:07:27.198385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.198391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.198394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:27.198411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.198430Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:27.198447Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.198498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.198507Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.198521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.198552Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|8185c447-d6b5b320-b68b7c20-1f24afa6_0
2025-10-02T08:07:27.200550Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392447200 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:27.200601Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|8185c447-d6b5b320-b68b7c20-1f24afa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:27.200772Z :INFO: [] MessageGroupId [src] SessionId [src|8185c447-d6b5b320-b68b7c20-1f24afa6_0] Write session: close. Timeout = 0 ms
2025-10-02T08:07:27.200785Z :INFO: [] MessageGroupId [src] SessionId [src|8185c447-d6b5b320-b68b7c20-1f24afa6_0] Write session will now close
2025-10-02T08:07:27.200795Z :DEBUG: [] MessageGroupId [src] SessionId [src|8185c447-d6b5b320-b68b7c20-1f24afa6_0] Write session: aborting
2025-10-02T08:07:27.200989Z :INFO: [] MessageGroupId [src] SessionId [src|8185c447-d6b5b320-b68b7c20-1f24afa6_0] Write session: gracefully shut down, all writes complete
2025-10-02T08:07:27.200997Z :DEBUG: [] MessageGroupId [src] SessionId [src|8185c447-d6b5b320-b68b7c20-1f24afa6_0] Write session: destroy
2025-10-02T08:07:27.201214Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|8185c447-d6b5b320-b68b7c20-1f24afa6_0 grpc read done: success: 0 data: 
2025-10-02T08:07:27.201229Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|8185c447-d6b5b320-b68b7c20-1f24afa6_0 grpc read failed
2025-10-02T08:07:27.201238Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|8185c447-d6b5b320-b68b7c20-1f24afa6_0 grpc closed
2025-10-02T08:07:27.201244Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|8185c447-d6b5b320-b68b7c20-1f24afa6_0 is DEAD
2025-10-02T08:07:27.201581Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T08:07:27.201646Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556533023667609738:2498] destroyed
2025-10-02T08:07:27.201664Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T08:07:27.201677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.201684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.201687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
PORTS 20389 6736
Session was created
2025-10-02T08:07:27.206977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.206994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.206998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.307324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.307343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.307346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.412015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.412031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.412033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.511584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.511602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.511605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.612698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.612725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.612728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.712934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.712961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.712964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.816961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.816976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.816980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.916592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.916609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.916612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.017395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.017423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.017426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.119623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.119643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.119646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T08:07:28.206550Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-02T08:07:28.206576Z :INFO: [/Root] [] [d1c05df6-4dde475-118cfb7e-da63f7bc] Open read subsessions to databases: { name: , endpoint: localhost:6736, path: /Root }
2025-10-02T08:07:28.206629Z :INFO: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Starting read session
2025-10-02T08:07:28.206635Z :DEBUG: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Starting single session
2025-10-02T08:07:28.206880Z :DEBUG: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:28.206884Z :DEBUG: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:28.206888Z :DEBUG: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T08:07:28.206931Z :ERROR: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] [] Got error. Status: CLIENT_CALL_UNIMPLEMENTED. Description: <main>: Error: GRpc error: (12):  <main>: Error: Grpc error response on endpoint localhost:6736 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:6736. 
2025-10-02T08:07:28.206938Z :DEBUG: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:28.206940Z :DEBUG: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:28.206968Z :INFO: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] [] Closing session to cluster: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:6736" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:6736     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:6736. " }
2025-10-02T08:07:28.207515Z :NOTICE: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T08:07:28.207530Z :DEBUG: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] [] Abort session to cluster
Got new read session event: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:6736" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:6736     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:6736. " }
2025-10-02T08:07:28.207556Z :INFO: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Closing read session. Close timeout: 0.010000s
2025-10-02T08:07:28.207564Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T08:07:28.207571Z :INFO: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:28.207577Z :INFO: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Closing read session. Close timeout: 0.000000s
2025-10-02T08:07:28.207579Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T08:07:28.207585Z :INFO: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:28.207590Z :INFO: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Closing read session. Close timeout: 0.000000s
2025-10-02T08:07:28.207592Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-02T08:07:28.207594Z :INFO: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:28.207599Z :NOTICE: [/Root] [/Root] [862a347b-494ca19b-ea1beec3-c34b12d3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T08:07:28.220195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.220213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.220216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.320571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.320590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.320593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.420901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.420917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.420920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:12.632292Z :GetAllStartPartitionSessions INFO: Random seed for debugging is 1759392432632285
2025-10-02T08:07:12.765175Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556532959144661302:2157];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:12.765210Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T08:07:12.768150Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:12.768660Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556532957752376254:2151];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:12.768707Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/wsi0/0028b4/r3tmp/tmpwc3gB8/pdisk_1.dat
2025-10-02T08:07:12.770743Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:12.799337Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:12.798796Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:12.810042Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 20000, node 1
2025-10-02T08:07:12.823851Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/wsi0/0028b4/r3tmp/yandex8m1ObJ.tmp
2025-10-02T08:07:12.823863Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/wsi0/0028b4/r3tmp/yandex8m1ObJ.tmp
2025-10-02T08:07:12.823911Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/wsi0/0028b4/r3tmp/yandex8m1ObJ.tmp
2025-10-02T08:07:12.823964Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T08:07:12.826803Z INFO: TTestServer started on Port 21521 GrpcPort 20000
TClient is connected to server localhost:21521
PQClient connected to localhost:20000
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T08:07:12.867815Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:12.867857Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:12.869383Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T08:07:12.873131Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:12.873157Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:12.873965Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-02T08:07:12.874118Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T08:07:12.874356Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-02T08:07:13.031260Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:13.069298Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:13.106559Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556532963439629430:2326], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.106580Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556532963439629438:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.106587Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.106729Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556532963439629445:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.106743Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.106869Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556532963439629449:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.106887Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:13.107334Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T08:07:13.111682Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556532963439629444:2330], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-02T08:07:13.151407Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:13.151868Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556532962047343795:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:13.151953Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=OGNkYWJkZDYtODRhNmZmY2QtYjUzNjg1ZTQtM2QxN2JlMWU=, ActorId: [2:7556532962047343754:2294], ActorState: ExecuteState, TraceId: 01k6hzc0z57gwfq3yps6h9vn5n, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:13.152508Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:13.180081Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:13.196485Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:13.205328Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556532963439629825:2883] txid# 281474976715665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:20000", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T08:07:13.228044Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6hzc11w2nc1kbfggajfq4d6, Database: , SessionId: ydb://session/3?node_id=1&id=ZTk3MWM3ZTItNTI4NDJjMzEtZGY2ODVmZTAtNTQ4MGFiNGE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556532963439629920:2943] 
2025-10-02T08:07:13.766713Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:13.769767Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:17.765428Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556532959144661302:2157];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:17.765460Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T08:07:17.769804Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556532957752376254:2151];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:17.769956Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T08:07:18.459062Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 5 partitions
CallPersQueueGRPC request to localhost:20000
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:18.492495Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:20000
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 5
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T08:07:18.518048Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556532984914466957:3265] connected; active server actors: 1
2025-10-02T08:07:18.518138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [1, 2, 3, 4, 0]
2025-10-02T08:07:18.518986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T08:07:18.519439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) (1, 72075186224037892) (2, 72075186224037892) (3, 72075186224037892) (4, 72075186224037892) 
2025-10-02T08:07:18.535520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-02T08:07:18.535611Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715683. Ctx: { TraceId: 01k6hzc6772eh8vfdn102mdjnq, Database: , SessionId: ydb://session/3?node_id=1&id=YmI1ZThmNzktYjViNmI3NjgtNjIzOWYxYmEtYWJlODY4MTE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T08:07:18.534252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:18.535188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:18.535253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T08:07:18.535261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:18.535274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T08:07:18.535700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532984914466988:2460], now have 1 active actors on pipe
2025-10-02T08:07:18.535706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532984914466956:3264], now have 1 active actors on pipe
2025-10-02T08:07:18.535993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.538412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-02T08:07:18.553653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532984914467045:3322], now have 1 active actors on pipe
2025-10-02T08:07:18.553803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.557346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.558070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:18.558088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:18.558091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:18.558094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:18.558097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:18.558119Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:18.558123Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][2][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:18.558126Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][3][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:18.558129Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:18.558132Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][4][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:18.558286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:18.558357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [2:7556532983522180844:2396]
2025-10-02T08:07:18.559042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:18.559046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:1:Initializer] Initializing completed.
2025-10-02T08:07:18.559052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 1 generation 1 [2:7556532983522180844:2396]
2025-10-02T08:07:18.559062Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:18.559410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-10-02T08:07:18.559417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.559453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.559455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-02T08:07:18.559462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-02T08:07:18.559464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.559466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.559467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-02T08:07:18.559475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:18.559514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:18.559556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][2][StateInit] bootstrapping 2 [2:7556532983522180845:2396]
2025-10-02T08:07:18.560029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:18.560031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:2:Initializer] Initializing completed.
2025-10-02T08:07:18.560034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][2][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 2 generation 1 [2:7556532983522180845:2396]
2025-10-02T08:07:18.560037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][2][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 2 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:18.560245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][2][StateIdle] Process pending events. Count 1
2025-10-02T08:07:18.560248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.560264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.560265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-02T08:07:18.560268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-02T08:07:18.560270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.560272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.560273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-02T08:07:18.560276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:18.560309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:18.560349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][3][StateInit] bootstrapping 3 [2:7556532983522180846:2396]
2025-10-02T08:07:18.560676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:18.560678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:3:Initializer] Initializing completed.
2025-10-02T08:07:18.560679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][3][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 3 generation 1 [2:7556532983522180846:2396]
2025-10-02T08:07:18.560681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][3][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 3 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:18.561136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][3][StateIdle] Process pending events. Count 1
2025-10-02T08:07:18.561145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.561155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.561156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-02T08:07:18.561158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-02T08:07:18.561160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.561161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.561162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-02T08:07:18.561165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:18.561199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:18.561222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][4][StateInit] bootstrapping 4 [2:7556532983522180847:2396]
2025-10-02T08:07:18.561571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:18.561576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:4:Initializer] Initializing completed.
2025-10-02T08:07:18.561578Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][4][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 4 generation 1 [2:7556532983522180847:2396]
2025-10-02T08:07:18.561583Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][4][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 4 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:18.561803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][4][StateIdle] Process pending events. Count 1
2025-10-02T08:07:18.561811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.561823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.561829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-02T08:07:18.561832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-02T08:07:18.561834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.561836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.561838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-02T08:07:18.561843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:18.561875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:18.561910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556532983522180848:2396]
2025-10-02T08:07:18.562222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:18.562229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:18.562231Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556532983522180848:2396]
2025-10-02T08:07:18.562235Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:18.562404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T08:07:18.562412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.562427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.562428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:18.562430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:18.562431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.562432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.562433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:18.562435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:18.562598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.562651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.562689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.562727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.562777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.562797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.564515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.564558Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392438594, TxId 281474976715682
2025-10-02T08:07:18.564563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.564622Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392438594, TxId 281474976715682
2025-10-02T08:07:18.564629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:18.564652Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][2][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392438594, TxId 281474976715682
2025-10-02T08:07:18.564657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:18.564689Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][3][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392438594, TxId 281474976715682
2025-10-02T08:07:18.564694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:18.564716Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][4][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392438594, TxId 281474976715682
2025-10-02T08:07:18.564721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.564731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:18.564744Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:18.564754Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:18.564757Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:18.564759Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:18.564761Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:18.566016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:18.566070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:18.566077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.566078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.566079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.566085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.566175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:18.566218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:18.566220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.566221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.566223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:18.566226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.566229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:18.566251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:18.566252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.566253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.566254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:18.566255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.566257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:18.566278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:18.566279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.566280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.566281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:18.566282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.566284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:18.566302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:18.566303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.566304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.566305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:18.566308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.566431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 5 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 2 PartitionIds: 3 PartitionIds: 4 PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T08:07:18.566449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:18.566492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.568136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.568162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.569046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.664870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.664895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.664898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:18.664922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.664925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.664927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:18.664936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.664938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.664939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:18.664947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.664949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.664951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:18.664958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.664960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.664962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.768864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.768880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.768882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:18.768906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.768907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.768910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:18.768916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.768918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.768920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:18.768926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.768929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.768931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:18.768937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.768939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.768941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.869700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.869724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.869727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:18.869753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.869755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.869757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:18.869765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.869768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.869774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:18.869787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.869790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.869792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:18.869801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.869803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.869804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.969668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.969680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.969683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:18.969703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.969705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.969707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:18.969714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.969716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.969718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:18.969725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.969727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.969729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:18.969736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.969738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.969740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715682
    CreateStep: 1759392438594
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715682
    CreateStep: 1759392438594
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 2
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 3
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 4
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 5
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 5
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:20000
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:19.056861Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:19.072873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.072889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.072895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.072916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.072918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.072920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.072929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.072932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.072934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.072941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.072943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.072948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.072957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.072960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.072962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.173028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.173041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.173044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.173062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.173064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.173066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.173072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.173074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.173076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.173090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.173093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.173107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.173114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.173116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.173117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.273348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.273361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.273362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.273379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.273380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.273381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.273387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.273388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.273389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.273394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.273395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.273397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.273403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.273404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.273405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.376866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.376883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.376887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.376909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.376910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.376911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.376918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.376920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.376921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.376929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.376931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.376932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.376938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.376940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.376945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.480879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.480894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.480897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.480918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.480920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.480922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.480930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.480932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.480933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.480940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.480941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.480943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.480949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.480951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.480952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:20000
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:19.566992Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 5
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T08:07:19.577350Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T08:07:19.577586Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T08:07:19.577593Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:20000
2025-10-02T08:07:19.579769Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:19.580391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:19.580407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T08:07:19.577392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.577414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.577417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.577434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.577436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.577439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.577445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.577447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.577449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.577455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.577457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.577458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.577464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.577467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.577468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.581058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:19.581095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60564
2025-10-02T08:07:19.581100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60564 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:19.581104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:19.581587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T08:07:19.581630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:19.581631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:19.581633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:19.581638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532989209434491:2495] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:19.582127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532989209434491:2495] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:19.655860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556532989209434491:2495] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:19.656355Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532989209434526:2495] connected; active server actors: 1
2025-10-02T08:07:19.656448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556532989209434491:2495] (SourceId=src, PreferedPartition=(NULL)) Received partition 4 from PQRB for SourceId=src
2025-10-02T08:07:19.656453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532989209434491:2495] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:19.660086Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532989209434526:2495] disconnected; active server actors: 1
2025-10-02T08:07:19.660090Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532989209434526:2495] disconnected no session
2025-10-02T08:07:19.680927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.680940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.680942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.680963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.680965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.680966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.680973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.680975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.680976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.680982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.680984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.680986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.680992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.680993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.680994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.683544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532989209434491:2495] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:19.683558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532989209434491:2495] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=4, SeqNo=(NULL)
2025-10-02T08:07:19.683563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532989209434491:2495] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:19.683572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 4 expectedGeneration: (NULL)
2025-10-02T08:07:19.688773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532989209434549:2495], now have 1 active actors on pipe
2025-10-02T08:07:19.688935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=4) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-02T08:07:19.689852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 4 MaxSeqNo: 0 sessionId: src|499c7a1b-c7149bf9-814433f2-21a5d588_0
2025-10-02T08:07:19.689238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.689258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-02T08:07:19.689311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|499c7a1b-c7149bf9-814433f2-21a5d588_0 generated for partition 4 topic 'rt3.dc1--test-topic' owner src
2025-10-02T08:07:19.689326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.689334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.689338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-02T08:07:19.689356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.689376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][4][StateIdle] TPartition::ReplyOwnerOk. Partition: 4
2025-10-02T08:07:19.689398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.689699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.689703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-02T08:07:19.689720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.696901Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392439696 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.696950Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|499c7a1b-c7149bf9-814433f2-21a5d588_0" topic: "test-topic" cluster: "dc1" partition_id: 4 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:19.697186Z :INFO: [] MessageGroupId [src] SessionId [src|499c7a1b-c7149bf9-814433f2-21a5d588_0] Write session: close. Timeout = 0 ms
2025-10-02T08:07:19.697192Z :INFO: [] MessageGroupId [src] SessionId [src|499c7a1b-c7149bf9-814433f2-21a5d588_0] Write session will now close
2025-10-02T08:07:19.697197Z :DEBUG: [] MessageGroupId [src] SessionId [src|499c7a1b-c7149bf9-814433f2-21a5d588_0] Write session: aborting
2025-10-02T08:07:19.697313Z :INFO: [] MessageGroupId [src] SessionId [src|499c7a1b-c7149bf9-814433f2-21a5d588_0] Write session: gracefully shut down, all writes complete
2025-10-02T08:07:19.697318Z :DEBUG: [] MessageGroupId [src] SessionId [src|499c7a1b-c7149bf9-814433f2-21a5d588_0] Write session: destroy
2025-10-02T08:07:19.697555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|499c7a1b-c7149bf9-814433f2-21a5d588_0 grpc read done: success: 0 data: 
2025-10-02T08:07:19.697569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|499c7a1b-c7149bf9-814433f2-21a5d588_0 grpc read failed
2025-10-02T08:07:19.697578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|499c7a1b-c7149bf9-814433f2-21a5d588_0 grpc closed
2025-10-02T08:07:19.697583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|499c7a1b-c7149bf9-814433f2-21a5d588_0 is DEAD
2025-10-02T08:07:19.697791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=4) Received event: NActors::TEvents::TEvPoison
2025-10-02T08:07:19.699916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532989209434549:2495] destroyed
2025-10-02T08:07:19.699954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][4][StateIdle] TPartition::DropOwner.
2025-10-02T08:07:19.699965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.699969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.699972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
Session was created
2025-10-02T08:07:19.784891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.784906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.784909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.784931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.784933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.784934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.784941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.784943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.784945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.784953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.784954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.784955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.784961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.784963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.784965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.888905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.888917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.888920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.888944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.888945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.888947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.888954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.888956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.888957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.888966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.888968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.888969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.888976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.888977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.888978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.992865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.992882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.992885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:19.992907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.992909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.992911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:19.992918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.992919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.992921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:19.992928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.992929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.992930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:19.992937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.992939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.992940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.093971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.093985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.093987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.094011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.094013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.094014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.094020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.094022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.094023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.094030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.094032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.094033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.094040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.094041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.094043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.193868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.193885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.193888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.193913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.193915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.193917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.193927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.193928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.193930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.193937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.193939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.193940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.193949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.193951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.193953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.296893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.296905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.296909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.296939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.296941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.296943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.296952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.296953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.296955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.296961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.296963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.296965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.296972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.296974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.296976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.397306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.397330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.397332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.397354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.397355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.397357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.397365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.397366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.397368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.397375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.397376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.397378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.397384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.397388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.397390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.500493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.500508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.500511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.500531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.500533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.500534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.500540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.500541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.500543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.500549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.500550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.500552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.500558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.500560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.500561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.600955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.600968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.600971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.600991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.600993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.600995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.601001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.601003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.601005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.601012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.601013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.601015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.601021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.601023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.601025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.704404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.704416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.704418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.704435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.704436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.704438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.704443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.704445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.704446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.704453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.704454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.704455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.704461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.704462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.704464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-02T08:07:20.726188Z :INFO: [/Root] [] [7297c339-ff0452b2-d3185394-25d4b58c] Open read subsessions to databases: { name: dc1, endpoint: localhost:20000, path: /Root }, { name: dc2, endpoint: localhost:20000, path: /Root }
2025-10-02T08:07:20.733463Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Starting read session
2025-10-02T08:07:20.733487Z :DEBUG: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Starting single session
2025-10-02T08:07:20.733700Z :DEBUG: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:20.733705Z :DEBUG: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:20.733709Z :DEBUG: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T08:07:20.734371Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Starting read session
2025-10-02T08:07:20.734377Z :DEBUG: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Starting single session
2025-10-02T08:07:20.734396Z :DEBUG: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:20.734399Z :DEBUG: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:20.734402Z :DEBUG: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T08:07:20.805210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.805237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.805241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.805266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.805268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.805270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.805277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.805280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.805281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.805291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.805294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.805295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.805303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.805305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.805307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.829838Z :DEBUG: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] Successfully connected. Initializing session
2025-10-02T08:07:20.829994Z :DEBUG: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] Successfully connected. Initializing session
2025-10-02T08:07:20.830021Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:07:20.830038Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-02T08:07:20.830085Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:07:20.830086Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-02T08:07:20.831975Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:20.832050Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 read init: from# ipv6:[::1]:56574, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:20.832125Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 auth for : user
2025-10-02T08:07:20.832274Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 Handle describe topics response
2025-10-02T08:07:20.832294Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 auth is DEAD
2025-10-02T08:07:20.832310Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:07:20.832594Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:07:20.832669Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532993504401928:2519] connected; active server actors: 1
2025-10-02T08:07:20.832679Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556532993504401928:2519] session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.832687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:07:20.832695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:07:20.832697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 1
2025-10-02T08:07:20.832700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-10-02T08:07:20.832703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 2
2025-10-02T08:07:20.832707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=3 (Status=Free, Partitions=[2])
2025-10-02T08:07:20.832709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 3
2025-10-02T08:07:20.832712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=4 (Status=Free, Partitions=[3])
2025-10-02T08:07:20.832714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 4
2025-10-02T08:07:20.832717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=5 (Status=Free, Partitions=[4])
2025-10-02T08:07:20.832721Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:20.832725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:07:20.832736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=5, UnradableFamilies=5 [5 (4), 4 (3), 3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-02T08:07:20.832742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=5 (Status=Free, Partitions=[4]) for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:20.832751Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 5 status Active partitions [4] session "shared/user_1_1_6993188857329407840_v1" sender [1:7556532993504401924:2519] lock partition 4 for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-02T08:07:20.832759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=1)
2025-10-02T08:07:20.832763Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_1_6993188857329407840_v1" sender [1:7556532993504401924:2519] lock partition 3 for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=2) generation 1 step 2
2025-10-02T08:07:20.832767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=2)
2025-10-02T08:07:20.832772Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_1_6993188857329407840_v1" sender [1:7556532993504401924:2519] lock partition 2 for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=3) generation 1 step 3
2025-10-02T08:07:20.832776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=3)
2025-10-02T08:07:20.832781Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_6993188857329407840_v1" sender [1:7556532993504401924:2519] lock partition 1 for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=4) generation 1 step 4
2025-10-02T08:07:20.832787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=4)
2025-10-02T08:07:20.832791Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_6993188857329407840_v1" sender [1:7556532993504401924:2519] lock partition 0 for ReadingSession "shared/user_1_1_6993188857329407840_v1" (Sender=[1:7556532993504401924:2519], Pipe=[1:7556532993504401928:2519], Partitions=[], ActiveFamilyCount=5) generation 1 step 5
2025-10-02T08:07:20.832795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=1, desiredFamilyCount=5, allowPlusOne=0
2025-10-02T08:07:20.832799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000061s
2025-10-02T08:07:20.832998Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 assign: record# { Partition: 4 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_6993188857329407840_v1" ClientId: "user" PipeClient { RawX1: 7556532993504401928 RawX2: 4503603922340311 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:20.833015Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 assign: record# { Partition: 3 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_1_6993188857329407840_v1" ClientId: "user" PipeClient { RawX1: 7556532993504401928 RawX2: 4503603922340311 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:20.833030Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_1_6993188857329407840_v1" ClientId: "user" PipeClient { RawX1: 7556532993504401928 RawX2: 4503603922340311 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:20.833044Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_1_6993188857329407840_v1" ClientId: "user" PipeClient { RawX1: 7556532993504401928 RawX2: 4503603922340311 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:20.833058Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_1_6993188857329407840_v1" ClientId: "user" PipeClient { RawX1: 7556532993504401928 RawX2: 4503603922340311 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:20.833070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1)
2025-10-02T08:07:20.833092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2)
2025-10-02T08:07:20.833098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-02T08:07:20.833109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-02T08:07:20.833118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-02T08:07:20.833185Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:20.833217Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 read init: from# ipv6:[::1]:56574, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:20.833278Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 auth for : user
2025-10-02T08:07:20.833391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532993504401935:2523]
2025-10-02T08:07:20.833403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532993504401936:2524]
2025-10-02T08:07:20.833405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532993504401937:2525]
2025-10-02T08:07:20.833414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532993504401938:2526]
2025-10-02T08:07:20.833421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532993504401939:2527]
2025-10-02T08:07:20.833463Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 Handle describe topics response
2025-10-02T08:07:20.833482Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 auth is DEAD
2025-10-02T08:07:20.833491Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:07:20.833732Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:07:20.833778Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] Got InitResponse. ReadSessionId: shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.833788Z :DEBUG: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:20.833809Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532993504401942:2520] connected; active server actors: 1
2025-10-02T08:07:20.833819Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556532993504401942:2520] session shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.833826Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_14980541009814086042_v1" (Sender=[1:7556532993504401925:2520], Pipe=[1:7556532993504401942:2520], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:20.833829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:07:20.833834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-02T08:07:20.833840Z :DEBUG: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:20.833838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-02T08:07:20.833847Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_6993188857329407840_v1" sender [1:7556532993504401924:2519]  release partitions [0]. Target status Free
2025-10-02T08:07:20.833855Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_6993188857329407840_v1" sender [1:7556532993504401924:2519]  release partitions [1]. Target status Free
2025-10-02T08:07:20.833859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-02T08:07:20.833864Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 gone release: partition# 0
2025-10-02T08:07:20.833869Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-02T08:07:20.833874Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-02T08:07:20.833878Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-02T08:07:20.833886Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 gone release: partition# 1
2025-10-02T08:07:20.833892Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-02T08:07:20.833895Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-02T08:07:20.833898Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-02T08:07:20.833936Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7556532993504401928:2519] session shared/user_1_1_6993188857329407840_v1 partition 0
2025-10-02T08:07:20.833943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:07:20.833947Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7556532993504401928:2519] session shared/user_1_1_6993188857329407840_v1 partition 1
2025-10-02T08:07:20.833952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=2 [2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-02T08:07:20.833957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_2_14980541009814086042_v1" (Sender=[1:7556532993504401925:2520], Pipe=[1:7556532993504401942:2520], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:20.833995Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] Got InitResponse. ReadSessionId: shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.833963Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_2_14980541009814086042_v1" sender [1:7556532993504401925:2520] lock partition 1 for ReadingSession "shared/user_1_2_14980541009814086042_v1" (Sender=[1:7556532993504401925:2520], Pipe=[1:7556532993504401942:2520], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-02T08:07:20.833968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_14980541009814086042_v1" (Sender=[1:7556532993504401925:2520], Pipe=[1:7556532993504401942:2520], Partitions=[], ActiveFamilyCount=1)
2025-10-02T08:07:20.834005Z :DEBUG: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:20.833973Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_14980541009814086042_v1" sender [1:7556532993504401925:2520] lock partition 0 for ReadingSession "shared/user_1_2_14980541009814086042_v1" (Sender=[1:7556532993504401925:2520], Pipe=[1:7556532993504401942:2520], Partitions=[], ActiveFamilyCount=2) generation 1 step 7
2025-10-02T08:07:20.833976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-02T08:07:20.833979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000025s
2025-10-02T08:07:20.834073Z :DEBUG: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:20.834128Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_2_14980541009814086042_v1" ClientId: "user" PipeClient { RawX1: 7556532993504401942 RawX2: 4503603922340312 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:20.834155Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_2_14980541009814086042_v1" ClientId: "user" PipeClient { RawX1: 7556532993504401942 RawX2: 4503603922340312 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:20.834169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:1)
2025-10-02T08:07:20.834208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532993504401935:2523], now have 1 active actors on pipe
2025-10-02T08:07:20.834233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532993504401936:2524], now have 1 active actors on pipe
2025-10-02T08:07:20.834237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532993504401937:2525], now have 1 active actors on pipe
2025-10-02T08:07:20.834242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532993504401938:2526], now have 1 active actors on pipe
2025-10-02T08:07:20.834247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532993504401939:2527], now have 1 active actors on pipe
2025-10-02T08:07:20.834272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.834280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-02T08:07:20.834296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_6993188857329407840_v1 on pipe: [1:7556532993504401935:2523]
2025-10-02T08:07:20.834319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.834321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-10-02T08:07:20.834325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_6993188857329407840_v1 on pipe: [1:7556532993504401937:2525]
2025-10-02T08:07:20.834333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.834335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-10-02T08:07:20.834338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_6993188857329407840_v1 on pipe: [1:7556532993504401936:2524]
2025-10-02T08:07:20.834345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.834347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.834350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_6993188857329407840_v1 on pipe: [1:7556532993504401939:2527]
2025-10-02T08:07:20.834355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.834358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-02T08:07:20.834361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_6993188857329407840_v1 on pipe: [1:7556532993504401938:2526]
2025-10-02T08:07:20.834367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.834372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532993504401938:2526] destroyed
2025-10-02T08:07:20.834377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.834379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532993504401939:2527] destroyed
2025-10-02T08:07:20.834182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-02T08:07:20.834280Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:07:20.834323Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 got read request: guid# 9f5149f5-6f28765d-aa176d6d-2d41b58a
2025-10-02T08:07:20.834332Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:07:20.834337Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 got read request: guid# 6a20161e-892d26f0-75696398-20a15cd1
2025-10-02T08:07:20.834383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532993504401947:2531]
2025-10-02T08:07:20.834393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532993504401946:2530]
2025-10-02T08:07:20.834383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532993504401947:2531], now have 1 active actors on pipe
2025-10-02T08:07:20.834394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532993504401946:2530], now have 1 active actors on pipe
2025-10-02T08:07:20.834409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.834416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.834418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-02T08:07:20.834458Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user session is set to 0 (startOffset 0) session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.834461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.834502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.834505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.834507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-02T08:07:20.834519Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user session is set to 0 (startOffset 0) session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.834521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.834533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.834536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.834537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-02T08:07:20.834545Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user session is set to 0 (startOffset 0) session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.834547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.834560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.834562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.834564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:20.834570Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.834572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.834584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.834586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.834588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-02T08:07:20.834596Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.834598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.834622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.834624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.834628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_14980541009814086042_v1 on pipe: [1:7556532993504401947:2531]
2025-10-02T08:07:20.834640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.834642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-02T08:07:20.834645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_14980541009814086042_v1 on pipe: [1:7556532993504401946:2530]
2025-10-02T08:07:20.834651Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:20.834661Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:20.834664Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:20.834668Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:20.834671Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:20.834675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:20.834676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][1][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:20.835014Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_6993188857329407840_v1:1 with generation 1
2025-10-02T08:07:20.835025Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_6993188857329407840_v1:3 with generation 1
2025-10-02T08:07:20.835028Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_6993188857329407840_v1:2 with generation 1
2025-10-02T08:07:20.835030Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_6993188857329407840_v1:5 with generation 1
2025-10-02T08:07:20.835033Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_6993188857329407840_v1:4 with generation 1
2025-10-02T08:07:20.835038Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.835040Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.835042Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_14980541009814086042_v1:2 with generation 1
2025-10-02T08:07:20.835044Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_14980541009814086042_v1:1 with generation 1
2025-10-02T08:07:20.841558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:20.841605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:20.841618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.841620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.841623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.841636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-02T08:07:20.841642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:20.841664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:20.841668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.841669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.841672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.841677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-02T08:07:20.841681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:20.841701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:20.841703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.841705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.841707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.841709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-02T08:07:20.841713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:20.841729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:20.841732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.841738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.841741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:20.841760Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.841762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.841781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:20.841784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:20.841799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:20.841801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.841804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.841807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-02T08:07:20.841812Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.841813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.841819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-02T08:07:20.841831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:20.841849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:20.841856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:20.841861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:20.841867Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:20.841878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:20.841882Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 4 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T08:07:20.842528Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 4. Read offset: (NULL)
2025-10-02T08:07:20.842891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:20.842912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:20.842917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.842919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.842921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.842925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:20.842929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:20.842939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:20.842941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.842943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.842945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.842948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-02T08:07:20.842957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:20.842968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:20.842018Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759392440805 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:07:20.842040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T08:07:20.842058Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759392440805 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:07:20.842062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T08:07:20.842072Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759392440805 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:07:20.842075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T08:07:20.842098Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 sending to client partition status
2025-10-02T08:07:20.842241Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 sending to client partition status
2025-10-02T08:07:20.842247Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 sending to client partition status
2025-10-02T08:07:20.843097Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759392440834 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:07:20.843106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T08:07:20.843120Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759392440834 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:07:20.843123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T08:07:20.843138Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 sending to client partition status
2025-10-02T08:07:20.843216Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T08:07:20.845422Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 2 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T08:07:20.845491Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 2. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 1 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T08:07:20.845526Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 1. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 3 Topic: "test-topic" Partition: 3 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T08:07:20.845541Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] [] Confirm partition stream create. Partition stream id: 3. Cluster: "-". Topic: "test-topic". Partition: 3. Read offset: (NULL)
2025-10-02T08:07:20.845549Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Closing read session. Close timeout: 0.010000s
2025-10-02T08:07:20.845569Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:3:0:0 -:test-topic:2:2:0:0 -:test-topic:4:1:0:0
2025-10-02T08:07:20.845580Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 112 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:20.845719Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Closing read session. Close timeout: 0.010000s
2025-10-02T08:07:20.845727Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:1:2:0:0 -:test-topic:0:1:0:0
2025-10-02T08:07:20.845731Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Counters: { Errors: 0 CurrentSessionLifetimeMs: 111 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:20.845804Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Closing read session. Close timeout: 0.000000s
2025-10-02T08:07:20.845809Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:3:0:0 -:test-topic:2:2:0:0 -:test-topic:4:1:0:0
2025-10-02T08:07:20.845813Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 112 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:20.845817Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Closing read session. Close timeout: 0.000000s
2025-10-02T08:07:20.845820Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:1:2:0:0 -:test-topic:0:1:0:0
2025-10-02T08:07:20.845822Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Counters: { Errors: 0 CurrentSessionLifetimeMs: 111 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:20.845827Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Closing read session. Close timeout: 0.000000s
2025-10-02T08:07:20.845830Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:1:2:0:0 -:test-topic:0:1:0:0
2025-10-02T08:07:20.845832Z :INFO: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Counters: { Errors: 0 CurrentSessionLifetimeMs: 111 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:20.845854Z :NOTICE: [/Root] [/Root] [9636025f-26c189e4-cc0b5a43-c7950ae2] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T08:07:20.845876Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Closing read session. Close timeout: 0.000000s
2025-10-02T08:07:20.845880Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:3:0:0 -:test-topic:2:2:0:0 -:test-topic:4:1:0:0
2025-10-02T08:07:20.845882Z :INFO: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 112 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:20.845888Z :NOTICE: [/Root] [/Root] [e1112eab-f82bc20a-c6efe8af-b455db2d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T08:07:20.845218Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-02T08:07:20.845292Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T08:07:20.845305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T08:07:20.845310Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-02T08:07:20.849197Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-10-02T08:07:20.849221Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 grpc closed
2025-10-02T08:07:20.849232Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_14980541009814086042_v1 is DEAD
2025-10-02T08:07:20.849421Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 3 } }
2025-10-02T08:07:20.849429Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 grpc closed
2025-10-02T08:07:20.849436Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_6993188857329407840_v1 is DEAD
2025-10-02T08:07:20.849917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.849948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532993504401947:2531] destroyed
2025-10-02T08:07:20.849956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.849959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532993504401946:2530] destroyed
2025-10-02T08:07:20.849962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.849964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532993504401937:2525] destroyed
2025-10-02T08:07:20.849967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.849970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532993504401936:2524] destroyed
2025-10-02T08:07:20.850017Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532993504401942:2520] disconnected; active server actors: 1
2025-10-02T08:07:20.849973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.849975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532993504401935:2523] destroyed
2025-10-02T08:07:20.849991Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.849993Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.849995Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.849997Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.850024Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532993504401942:2520] client user disconnected session shared/user_1_2_14980541009814086042_v1
2025-10-02T08:07:20.849999Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.850041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:07:20.850050Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532993504401928:2519] disconnected; active server actors: 1
2025-10-02T08:07:20.850052Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532993504401928:2519] client user disconnected session shared/user_1_1_6993188857329407840_v1
2025-10-02T08:07:20.908876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.908894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.908897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-02T08:07:20.908921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.908923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.908925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-02T08:07:20.908932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.908933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.908934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-02T08:07:20.908941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.908942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.908944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-02T08:07:20.908951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.908952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.908953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.437025Z :PreferredDatabaseNoFallback INFO: Random seed for debugging is 1759392441437015
2025-10-02T08:07:21.538190Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556532996477149869:2088];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:21.538215Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T08:07:21.541441Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:21.543100Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:21.549564Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-02T08:07:21.549717Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:21.549895Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556532996092186536:2272];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:21.549905Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/wsi0/0028b4/r3tmp/tmpLWU6aJ/pdisk_1.dat
2025-10-02T08:07:21.619272Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:21.634146Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:21.634170Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:21.636430Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T08:07:21.639451Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:21.639473Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:21.641476Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-02T08:07:21.641916Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-02T08:07:21.642157Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 10217, node 3
2025-10-02T08:07:21.657092Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/wsi0/0028b4/r3tmp/yandexvRi8Xw.tmp
2025-10-02T08:07:21.657110Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/wsi0/0028b4/r3tmp/yandexvRi8Xw.tmp
2025-10-02T08:07:21.657175Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/wsi0/0028b4/r3tmp/yandexvRi8Xw.tmp
2025-10-02T08:07:21.657222Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T08:07:21.659993Z INFO: TTestServer started on Port 12310 GrpcPort 10217
TClient is connected to server localhost:12310
PQClient connected to localhost:10217
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T08:07:21.682162Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-02T08:07:21.768850Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:21.880862Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:21.964072Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556532996477150786:2323], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.964103Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.964298Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556532996477150823:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:21.965409Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T08:07:21.985298Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:21.988345Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7556532996092186657:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:21.988923Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=ZDc3NGZlMWEtYTUyNDZiODEtYTU1YmM5MzQtOTNhNTFiMA==, ActorId: [4:7556532996092186609:2295], ActorState: ExecuteState, TraceId: 01k6hzc9kh1tha0sxtqxsx82fp, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:21.989080Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:21.994581Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556532996477150825:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-02T08:07:22.043495Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:22.068178Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556533000772118377:2788] txid# 281474976715664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T08:07:22.074260Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556533000772118390:2346], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:22.074949Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=YzBlNWM5NzktZTQxYThmMTktOWYzYmE3NzgtNTlmZGFmZTA=, ActorId: [3:7556532996477150783:2321], ActorState: ExecuteState, TraceId: 01k6hzc9kab9cer628ecs33np1, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:22.075083Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:22.105958Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:10217", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T08:07:22.205246Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6hzc9sg5gct9xpyaasytcj6, Database: , SessionId: ydb://session/3?node_id=3&id=YjE1NmJlNzItYjkwNjJlNmUtNDQ5NzRkNzgtYmZhODgxNWM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556533000772118600:2940] 
2025-10-02T08:07:22.540382Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:22.544226Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:26.541385Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556532996477149869:2088];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:26.541429Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T08:07:26.548892Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556532996092186536:2272];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:26.548939Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T08:07:27.365113Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:10217
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:27.430601Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:10217
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T08:07:27.472463Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:27.475667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:27.475780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T08:07:27.475796Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:27.475809Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T08:07:27.475978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533022246955603:3249], now have 1 active actors on pipe
2025-10-02T08:07:27.476715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:27.475073Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556533022246955604:3250] connected; active server actors: 1
2025-10-02T08:07:27.475145Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T08:07:27.476547Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T08:07:27.480296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533022246955634:2457], now have 1 active actors on pipe
2025-10-02T08:07:27.480693Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:27.478700Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T08:07:27.480506Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-02T08:07:27.492748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533022246955653:3291], now have 1 active actors on pipe
2025-10-02T08:07:27.493399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:27.494821Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:27.495062Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:27.495077Z node 4 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:27.495156Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:27.495206Z node 4 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7556533021861990999:2397]
2025-10-02T08:07:27.495769Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:27.495772Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:27.495777Z node 4 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7556533021861990999:2397]
2025-10-02T08:07:27.495783Z node 4 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:27.496044Z node 4 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T08:07:27.496054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.496076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.496079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:27.496084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:27.496086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.496087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.496090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:27.496099Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:27.496189Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:27.496229Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:27.499335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:27.499395Z node 4 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392447540, TxId 281474976715679
2025-10-02T08:07:27.499403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.499406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.499440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.499489Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:27.500498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:27.500570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:27.500580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.500582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.500585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.500595Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:27.500720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T08:07:27.500745Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:27.500818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:27.504026Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k6hzceyr4f9twfmhdebbqs8q, Database: , SessionId: ydb://session/3?node_id=3&id=NDRkMjFlODEtNGI3ZThhOTctN2U5ZmJkNzgtNTM1YzliMzQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T08:07:27.505792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:27.505831Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:27.507192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759392447540
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759392447540
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:10217
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:27.520583Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:27.596406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.596426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.596429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.697204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.697229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.697233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.804894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.804918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.804922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.905092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.905110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.905113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.005755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.005777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.005780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:10217
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:28.029025Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:28.105852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.105871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.105874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.206215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.206232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.206235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.306520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.306560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.306563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.407317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.407341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.407344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.510437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.510458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.510462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:10217
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:28.534328Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T08:07:28.543671Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T08:07:28.543936Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T08:07:28.543944Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:10217
2025-10-02T08:07:28.544508Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:28.545989Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:28.546010Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T08:07:28.546784Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:28.546824Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:52374
2025-10-02T08:07:28.546831Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:52374 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:28.546836Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:28.547648Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T08:07:28.547688Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:28.547690Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:28.547691Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:28.547696Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556533026541923124:2486] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:28.548242Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556533026541923124:2486] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:28.591562Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556533026541923124:2486] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:28.591654Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533026541923164:2486] connected; active server actors: 1
2025-10-02T08:07:28.591672Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556533026541923124:2486] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T08:07:28.591675Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556533026541923124:2486] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:28.595166Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533026541923164:2486] disconnected; active server actors: 1
2025-10-02T08:07:28.595178Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556533026541923164:2486] disconnected no session
2025-10-02T08:07:28.610651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.610670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.610674Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.610829Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556533026541923124:2486] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:28.610846Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556533026541923124:2486] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T08:07:28.610849Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556533026541923124:2486] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:28.610857Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:28.611677Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-02T08:07:28.611494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556533026541923188:2486], now have 1 active actors on pipe
2025-10-02T08:07:28.612509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.612525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.612558Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|7ce71260-82f1fb64-655a3a62-7bbed158_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T08:07:28.612572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.612576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.612579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:28.612592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.612609Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:28.612631Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.613205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.613218Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.613244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.613447Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|7ce71260-82f1fb64-655a3a62-7bbed158_0
2025-10-02T08:07:28.613869Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392448613 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:28.613905Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|7ce71260-82f1fb64-655a3a62-7bbed158_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:28.613987Z :INFO: [] MessageGroupId [src] SessionId [src|7ce71260-82f1fb64-655a3a62-7bbed158_0] Write session: close. Timeout = 0 ms
2025-10-02T08:07:28.613992Z :INFO: [] MessageGroupId [src] SessionId [src|7ce71260-82f1fb64-655a3a62-7bbed158_0] Write session will now close
2025-10-02T08:07:28.613996Z :DEBUG: [] MessageGroupId [src] SessionId [src|7ce71260-82f1fb64-655a3a62-7bbed158_0] Write session: aborting
2025-10-02T08:07:28.614083Z :INFO: [] MessageGroupId [src] SessionId [src|7ce71260-82f1fb64-655a3a62-7bbed158_0] Write session: gracefully shut down, all writes complete
2025-10-02T08:07:28.614087Z :DEBUG: [] MessageGroupId [src] SessionId [src|7ce71260-82f1fb64-655a3a62-7bbed158_0] Write session: destroy
2025-10-02T08:07:28.614306Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|7ce71260-82f1fb64-655a3a62-7bbed158_0 grpc read done: success: 0 data: 
2025-10-02T08:07:28.614316Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|7ce71260-82f1fb64-655a3a62-7bbed158_0 grpc read failed
2025-10-02T08:07:28.614322Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|7ce71260-82f1fb64-655a3a62-7bbed158_0 grpc closed
2025-10-02T08:07:28.614328Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|7ce71260-82f1fb64-655a3a62-7bbed158_0 is DEAD
2025-10-02T08:07:28.614506Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T08:07:28.615257Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556533026541923188:2486] destroyed
2025-10-02T08:07:28.615269Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T08:07:28.615277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.615279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.615281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
=== Session was created, waiting for retries
>>> Ready to answer: ok
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-10-02T08:07:28.677515Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:28.711174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.711194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.711197Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.812350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.812368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.812371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.912733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.912760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.912762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.013069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.013086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.013090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.116075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.116093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.116097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.216328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.216346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.216349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.316872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.316889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.316893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.417068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.417090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.417093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.517396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.517418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.517422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.618591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.618614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.618618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.721590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.721609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.721612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.826404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.826424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.826428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.925997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.926016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.926019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.026949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.026967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.026971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.127234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.127252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.127255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.227731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.227753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.227755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.327911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.327929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.327932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.428881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.428905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.428909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.529092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.529109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.529112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.630052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.630072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.630076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:30.678204Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:30.732401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.732424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.732427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.840780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.840799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.840810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.940205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.940221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.940224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.040881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.040902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.040905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.142164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.142187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.142190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.242331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.242353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.242356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.342688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.342715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.342718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.443097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.443113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.443115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.543357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.543373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.543375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.644392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.644413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.644417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.744579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.744598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.744601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.847459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.847484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.847488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.947822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.947840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.947844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.048196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.048217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.048220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.148555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.148575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.148578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.248881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.248898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.248901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.349294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.349318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.349322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.449593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.449620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.449623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 08:07:32.482067993  552160 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:62829: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T08:07:32.496298Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:32.549956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.549974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.549977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.650320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.650337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.650339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
=== In the next federation discovery response dc2 will be available
2025-10-02T08:07:32.679018Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:32.750666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.750684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.750688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.851035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.851054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.851057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.952117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.952136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.952139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.056892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.056916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.056919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.160945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.160965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.160969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.261450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.261467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.261470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.363744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.363765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.363768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.463872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.463892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.463895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.564223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.564242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.564245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.664604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.664623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.664626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.764947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.764966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.764968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.865306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.865326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.865330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.965655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.965676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.965679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.065982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.065997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.066000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.166950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.166968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.166971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.267194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.267212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.267215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.368938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.368957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.368961Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.469436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.469456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.469458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.569778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.569796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.569799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.670145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.670164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.670166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:34.681143Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:34.770515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.770533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.770536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.870842Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.870856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.870859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.971196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.971210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.971213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.073152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.073170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.073173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.175453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.175467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.175470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.292035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.292056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.292060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.396717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.396742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.396745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.497012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.497030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.497033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.597379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.597396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.597398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.697702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.697728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.697731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.798087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.798105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.798109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.898418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.898433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.898436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.998763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.998779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.998781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.099135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.099157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.099161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.199489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.199504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.199506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.299855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.299874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.299877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.400191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.400210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.400213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.500531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.500548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.500552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.603544Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-02T08:07:36.603568Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T08:07:36.604900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.604916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.604919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:36.684901Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:36.705368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.705387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.705391Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.808049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.808071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.808074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.907690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.907708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.907711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.007954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.007973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.007976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.108328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.108350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.108353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.208585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.208600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.208603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.308989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.309005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.309009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.409358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.409372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.409375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.496726Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:37.509998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.510012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.510014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.610552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.610565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.610567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.710919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.710940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.710943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.811286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.811301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.811303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.911649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.911664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.911666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.011960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.011979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.011982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.112349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.112373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.112376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.212666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.212686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.212688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.313045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.313065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.313068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.413391Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.413412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.413416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.513744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.513762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.513766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.614085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.614102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.614105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 08:07:38.631101978  544977 chttp2_transport.cc:1143]             ipv4:127.0.0.1:62829: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
Test retry state: get retry delay
2025-10-02T08:07:38.685924Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:38.714442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.714457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.714459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.814804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.814830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.814833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.915155Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.915171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.915174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.015494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.015511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.015514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.115830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.115847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.115850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.216201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.216231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.216233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.316551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.316568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.316571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.416886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.416902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.416905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.517201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.517219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.517222Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.617643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.617684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.617688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.717963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.717984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.717988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.818316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.818336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.818339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.918683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.918709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.918712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.019020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.019038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.019041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.119389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.119407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.119411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.219741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.219759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.219762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.320097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.320119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.320122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.420469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.420491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.420506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.520829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.520853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.520856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.621987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.622012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.622016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:40.687046Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:40.722005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.722022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.722026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.822343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.822366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.822370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.922730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.922751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.922755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.023001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.023018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.023021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.123401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.123420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.123423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.223767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.223789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.223792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.324075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.324099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.324102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.424461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.424482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.424485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.524826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.524848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.524851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.625174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.625191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.625193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.725514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.725535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.725537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.825870Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.825891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.825895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.926230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.926250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.926261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.026577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.026597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.026600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.126938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.126968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.126972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.227295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.227313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.227315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.327628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.327657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.327660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.427981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.428003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.428006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.497193Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:42.528312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.528331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.528334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.628679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.628695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.628698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:42.687952Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:42.729015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.729030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.729032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.829348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.829374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.829377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.929730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.929746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.929750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.030082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.030103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.030106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.130491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.130514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.130518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.230787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.230807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.230809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.331153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.331172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.331174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.431508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.431525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.431527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.531865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.531884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.531887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.632213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.632230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.632233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.732572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.732594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.732598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.832887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.832908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.832912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.933255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.933277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.933282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.033593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.033607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.033608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.133968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.134002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.134005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.234261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.234283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.234285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.334722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.334766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.334781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.435035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.435066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.435074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.535349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.535378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.535381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.635660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.635675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.635677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:44.688927Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:44.736063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.736084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.736092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.836420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.836438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.836440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.936766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.936783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.936785Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.037127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.037144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.037147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.137465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.137485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.137489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.237832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.237846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.237848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.338193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.338210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.338213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.438553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.438572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.438575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.538893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.538922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.538925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.639192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.639210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.639213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.739585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.739601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.739604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.839941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.839955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.839958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.940316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.940338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.940341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.040663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.040679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.040681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.140994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.141015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.141018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.241365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.241382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.241385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.341701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.341723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.341727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.442057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.442076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.442079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.542412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.542432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.542435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.642758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.642777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.642780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:46.689956Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:46.743123Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.743142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.743145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.843453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.843470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.843473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.943812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.943830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.943833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.044156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.044181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.044183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.144525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.144542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.144544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.244885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.244907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.244909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.345230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.345246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.345250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.445585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.445599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.445602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.497321Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:47.545924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.545939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.545943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.646287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.646302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.646304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.746614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.746629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.746631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.846966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.846984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.846987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.947351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.947369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.947372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.047691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.047711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.047713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.148068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.148091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.148095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.248398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.248418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.248420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.348774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.348795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.348814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.449128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.449150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.449153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.553769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.553795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.553799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.653913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.653933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.653936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:48.690953Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:48.754254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.754275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.754278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.854644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.854667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.854670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.955004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.955028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.955032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.055313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.055334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.055337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.155661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.155680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.155682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.256009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.256028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.256031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.356354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.356371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.356372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.456720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.456739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.456742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.557038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.557055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.557057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.657412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.657433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.657436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.757737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.757760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.757761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.858130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.858149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.858153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.960890Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.960910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.960914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.061363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.061381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.061384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.161739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.161763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.161766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.264872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.264895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.264899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.362420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.362434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.362437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.462899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.462916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.462919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.564535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.564554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.564557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.665028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.665046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.665049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:50.692963Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:50.765443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.765464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.765467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.865735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.865754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.865757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.966086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.966102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.966105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.066396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.066426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.066429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.166805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.166824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.166826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.267147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.267172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.267174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.368869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.368890Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.368893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.468880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.468898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.468900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.569235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.569257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.569261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.669602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.669624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.669629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.769931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.769952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.769956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.870260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.870276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.870278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.970615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.970632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.970638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.070976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.070997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.071000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.171347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.171368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.171371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.272082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.272106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.272110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.372570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.372592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.372595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.473478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.473500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.473503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.502072Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:52.574566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.574590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.574594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.676867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.676891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.676895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:52.697008Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:52.776962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.776987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.776989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.877367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.877385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.877388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.977717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.977735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.977737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.078074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.078094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.078097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.178436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.178453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.178456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.278793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.278810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.278813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.379119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.379134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.379136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.479488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.479503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.479506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.579831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.579848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.579851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1002 08:07:53.628560116  544791 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:62829: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T08:07:53.680207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.680224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.680226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.780551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.780571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.780574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.880880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.880900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.880903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.981234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.981254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.981257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.081618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.081641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.081643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.181955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.181975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.181978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.282337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.282359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.282362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.382654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.382677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.382680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.483020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.483040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.483043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.583348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.583372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.583375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.683741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.683763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.683766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:54.697979Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:54.784070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.784087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.784090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.884421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.884439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.884442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.984779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.984827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.984831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.085122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.085142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.085144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.185462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.185479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.185482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.285851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.285876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.285879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.386156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.386169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.386171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.486529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.486548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.486551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.586867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.586882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.586884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.687216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.687233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.687235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.787583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.787601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.787604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.887945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.887966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.887969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.988283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.988302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.988304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.088686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.088714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.088717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.188990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.189012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.189015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.289341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.289359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.289362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.389731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.389759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.389764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.490362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.490378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.490380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.590399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.590415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.590417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.690761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.690783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.690786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:56.698968Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-02T08:07:56.791104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.791119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.791121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.891405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.891422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.891425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.991808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.991825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.991828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.092191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.092212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.092215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.192517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.192538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.192541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.292879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.292900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.292904Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.393270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.393292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.393296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.477235Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:07:57.477265Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T08:07:57.477720Z node 4 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:07:57.478114Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-02T08:07:57.478338Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:07:57.478672Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-02T08:07:57.493610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.493634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.493636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.501834Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:57.594008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.594034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.594038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.694324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.694345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.694349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.794676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.794702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.794707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.894986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.895007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.895010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.995699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.995718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.995721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.095681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.095701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.095703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.196052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.196074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.196078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.296837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.296857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.296860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.397359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.397381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.397384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.497716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.497736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.497739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.597933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.597980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.597982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.698286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.698303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.698306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-02T08:07:58.699984Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
=== Waiting for repair
>>> Ready to answer: ok
2025-10-02T08:07:58.798665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.798692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.798696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.899018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.899042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.899045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.999340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.999355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.999358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.099726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.099746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.099749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.200077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.200097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.200100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.300400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.300415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.300417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.400768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.400787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.400790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.504922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.504941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.504944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.608894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.608914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.608917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.708984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.709001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.709004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.809341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.809360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.809362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.909698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.909716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.909720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.010039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.010061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.010064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.110405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.110427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.110430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.210757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.210777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.210779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.311108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.311128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.311131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.411473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.411494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.411497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.511760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.511775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.511777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.612162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.612178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.612180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
=== Closing the session
2025-10-02T08:08:00.701044Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:10217" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:10217" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:10217" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-02T08:08:00.706464Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-02T08:08:00.706703Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-02T08:08:00.707994Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-02T08:08:00.708121Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.708227Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-02T08:08:00.708322Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-02T08:08:00.708337Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session will now close
2025-10-02T08:08:00.708355Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: aborting
2025-10-02T08:08:00.708302Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:00.708329Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T08:08:00.708479Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.708519Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:44980
2025-10-02T08:08:00.708530Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:44980 proto=topic  topic=test-topic durationSec=0
2025-10-02T08:08:00.708534Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:00.708601Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-02T08:08:00.709214Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: CANCELLED, Details: , InternalError: 0
2025-10-02T08:08:00.709226Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392480709 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:08:00.709206Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T08:08:00.709230Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session is aborting and will not restart
2025-10-02T08:08:00.709236Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId:  grpc closed
2025-10-02T08:08:00.709239Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId:  is DEAD
2025-10-02T08:08:00.709274Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: destroy
2025-10-02T08:08:00.709458Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:00.709467Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:00.709468Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:00.709474Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556533163980878588:2841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:00.712530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.712549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.712551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.830202Z node 3 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1005: ActorId: [3:7556533163980878604:2844] TxId: 281474976715749. Ctx: { TraceId: 01k6hzdfgc5s7wkywg0yn4hpc3, Database: /Root, SessionId: ydb://session/3?node_id=3&id=OWE4NjRmMjItMmI3YTg3OWMtY2FiYWNlMjUtNTU0MjdkNDg=, PoolId: default}. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 4
2025-10-02T08:08:00.830521Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7556533163980878610:2844], TxId: 281474976715749, task: 3. Ctx: { TraceId : 01k6hzdfgc5s7wkywg0yn4hpc3.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : default.  SessionId : ydb://session/3?node_id=3&id=OWE4NjRmMjItMmI3YTg3OWMtY2FiYWNlMjUtNTU0MjdkNDg=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7556533163980878604:2844], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-02T08:07:12.152339Z :PropagateSessionClosed INFO: Random seed for debugging is 1759392432152332
2025-10-02T08:07:12.272160Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556532957668144062:2089];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:12.272185Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T08:07:12.279030Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-02T08:07:12.279148Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/wsi0/0028ba/r3tmp/tmpngCQMN/pdisk_1.dat
2025-10-02T08:07:12.277994Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556532958128618549:2086];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:12.278014Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-02T08:07:12.284975Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-02T08:07:12.318868Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-02T08:07:12.329193Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T08:07:12.330295Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:12.330309Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:12.333839Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-02T08:07:12.334082Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 18220, node 1
2025-10-02T08:07:12.355358Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:12.363832Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/wsi0/0028ba/r3tmp/yandexXy7YWT.tmp
2025-10-02T08:07:12.363842Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/wsi0/0028ba/r3tmp/yandexXy7YWT.tmp
2025-10-02T08:07:12.363905Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/wsi0/0028ba/r3tmp/yandexXy7YWT.tmp
2025-10-02T08:07:12.363949Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-02T08:07:12.367435Z INFO: TTestServer started on Port 13138 GrpcPort 18220
2025-10-02T08:07:12.373285Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-02T08:07:12.373310Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-02T08:07:12.376122Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient is connected to server localhost:13138
PQClient connected to localhost:18220
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-02T08:07:12.396764Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-02T08:07:12.520173Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-02T08:07:12.682519Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556532957668144959:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.682542Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.682554Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556532957668144985:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.683327Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-02T08:07:12.683736Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556532957668145017:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.683775Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.683879Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556532957668145022:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.683890Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-02T08:07:12.688166Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556532957668144988:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-02T08:07:12.728500Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:12.766316Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556532958128618861:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:12.767164Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ODYzN2E2MmUtNTczMDljN2ItNjU4M2ZhZmUtZTMwOTM0NzM=, ActorId: [2:7556532958128618834:2293], ActorState: ExecuteState, TraceId: 01k6hzc0k5101att1xegqj4ran, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:12.767632Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:12.769420Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-02T08:07:12.771947Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556532957668145254:2810] txid# 281474976715664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-02T08:07:12.776881Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556532957668145277:2348], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-02T08:07:12.777558Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=MTY4YzQzMTItOTViMmI3NGMtN2JlNjU3YWItZTMzNjJhOGY=, ActorId: [1:7556532957668144955:2322], ActorState: ExecuteState, TraceId: 01k6hzc0h7cz1k2xsksnqhycbn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-02T08:07:12.777696Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-02T08:07:12.822578Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:18220", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-02T08:07:12.874373Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6hzc0ppavra5qc81mhshqnv, Database: , SessionId: ydb://session/3?node_id=1&id=MWJiMjdjOTAtYzU4ZWY4MjYtNGZkMjVjOGMtZjVlZDYyYWI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556532957668145522:3002] 
2025-10-02T08:07:13.273180Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:13.284466Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-02T08:07:17.273103Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556532957668144062:2089];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:17.273159Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-02T08:07:17.280855Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556532958128618549:2086];send_to=[0:7307199536658146131:7762515];
2025-10-02T08:07:17.280897Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-02T08:07:18.040545Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:18220
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:18.091873Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:18220
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-02T08:07:18.115429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:18.117020Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556532983437949851:3312] connected; active server actors: 1
2025-10-02T08:07:18.117368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-02T08:07:18.117775Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-02T08:07:18.118359Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-02T08:07:18.118361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:18.118459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-02T08:07:18.118468Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:18.118477Z node 1 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-02T08:07:18.118727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532983437949850:3311], now have 1 active actors on pipe
2025-10-02T08:07:18.118889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.118898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556532983898423075:2378], now have 1 active actors on pipe
2025-10-02T08:07:18.119106Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1
2025-10-02T08:07:18.119279Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k6hzc5tkds3bdje3s9zp4t9t, Database: , SessionId: ydb://session/3?node_id=1&id=N2VlNmY4NS0xZmNlYjFhNC1jM2MxNDc3Mi1mMDhhZGNiMQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-02T08:07:18.120587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-02T08:07:18.125661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532983437949948:3377], now have 1 active actors on pipe
2025-10-02T08:07:18.125757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.126777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.127017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:18.127051Z node 1 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-02T08:07:18.127121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:18.127204Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556532983437949958:2471]
2025-10-02T08:07:18.128017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:18.128023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:18.128029Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [1:7556532983437949958:2471]
2025-10-02T08:07:18.128038Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-02T08:07:18.128365Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-02T08:07:18.128381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.128413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.128415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:18.128419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:18.128422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.128423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.128425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-02T08:07:18.128432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:18.128517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.128561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.129741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.129786Z node 1 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759392438174, TxId 281474976715679
2025-10-02T08:07:18.129791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.129792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.129817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.129860Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:18.130403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:18.130460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:18.130471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.130472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.130474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.130480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:18.130593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-02T08:07:18.130615Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:18.130666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.132407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.132433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-02T08:07:18.132953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-02T08:07:18.224753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.224768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.224771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.325182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.325200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.325203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.425417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.425435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.425438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.526066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.526083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.526085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.626678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.626696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.626698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759392438174
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759392438174
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:18220
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:18.638393Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-02T08:07:18.729162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.729176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.729178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.830642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.830662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.830665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:18.930906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:18.930925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:18.930929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.031365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.031382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.031384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.131602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.131616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.131619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:18220
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-02T08:07:19.145608Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-02T08:07:19.147224Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-02T08:07:19.147460Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-02T08:07:19.147467Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:19.149484Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:19.149980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:19.149992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-02T08:07:19.150372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-02T08:07:19.150399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:36658
2025-10-02T08:07:19.150405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:36658 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:19.150408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:19.150866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-02T08:07:19.150907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:19.150909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:19.150910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:19.150916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532987732917432:2507] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:19.151419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532987732917432:2507] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:19.177371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556532987732917432:2507] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:19.178147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556532987732917432:2507] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-02T08:07:19.178155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532987732917432:2507] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:19.177854Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917464:2507] connected; active server actors: 1
2025-10-02T08:07:19.178591Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917464:2507] disconnected; active server actors: 1
2025-10-02T08:07:19.178594Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917464:2507] disconnected no session
2025-10-02T08:07:19.209234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532987732917432:2507] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:19.209249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532987732917432:2507] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T08:07:19.209252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532987732917432:2507] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:19.209260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:19.210232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-10-02T08:07:19.210251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532987732917484:2507], now have 1 active actors on pipe
2025-10-02T08:07:19.210308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.210316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.210357Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-02T08:07:19.210368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.210373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.210375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:19.210387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.210403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:19.210427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.210581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.210583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.210597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.210626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0
2025-10-02T08:07:19.216926Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392439216 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.216992Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:19.220856Z :INFO: [] MessageGroupId [src] SessionId [src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0] Write session: close. Timeout = 0 ms
2025-10-02T08:07:19.220871Z :INFO: [] MessageGroupId [src] SessionId [src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0] Write session will now close
2025-10-02T08:07:19.220878Z :DEBUG: [] MessageGroupId [src] SessionId [src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0] Write session: aborting
2025-10-02T08:07:19.221064Z :INFO: [] MessageGroupId [src] SessionId [src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0] Write session: gracefully shut down, all writes complete
2025-10-02T08:07:19.221070Z :DEBUG: [] MessageGroupId [src] SessionId [src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0] Write session: destroy
2025-10-02T08:07:19.226145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0 grpc read done: success: 0 data: 
2025-10-02T08:07:19.226158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0 grpc read failed
2025-10-02T08:07:19.226171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0 grpc closed
2025-10-02T08:07:19.226178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|64a013b6-8afebfa7-586ccfe9-8edcf9e3_0 is DEAD
2025-10-02T08:07:19.226466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-02T08:07:19.226854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556532987732917484:2507] destroyed
2025-10-02T08:07:19.226871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-02T08:07:19.226879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.226882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.226883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.231816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.231828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.231830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-02T08:07:19.292927Z :INFO: [/Root] [] [543ef7c5-9c4feb22-dc8c7297-348415e0] Open read subsessions to databases: { name: dc1, endpoint: localhost:18220, path: /Root }, { name: dc2, endpoint: localhost:18220, path: /Invalid }
2025-10-02T08:07:19.297794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-02T08:07:19.297912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-02T08:07:19.297934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:19.305062Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Starting read session
2025-10-02T08:07:19.305086Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Starting single session
2025-10-02T08:07:19.305333Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.305339Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.305345Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T08:07:19.336882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.336907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.336910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.366397Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:07:19.367279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:19.367297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-02T08:07:19.367371Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:07:19.367378Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-02T08:07:19.368944Z :INFO: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Starting read session
2025-10-02T08:07:19.368959Z :DEBUG: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Starting single session
2025-10-02T08:07:19.369000Z :DEBUG: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.369004Z :DEBUG: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.369010Z :DEBUG: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] [] Reconnecting session to cluster  in 0.000000s
2025-10-02T08:07:19.369037Z :ERROR: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. 
2025-10-02T08:07:19.369049Z :DEBUG: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.369052Z :DEBUG: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.369079Z :INFO: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.369483Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:19.369578Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:19.369680Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 auth for : user
2025-10-02T08:07:19.369959Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Handle describe topics response
2025-10-02T08:07:19.369988Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 auth is DEAD
2025-10-02T08:07:19.370003Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:07:19.370295Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:07:19.370652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:19.370782Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_1_11670534616535065925_v1
2025-10-02T08:07:19.370796Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:19.370910Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.370827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:19.370865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:19.370870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:19.370875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:19.371054Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:07:19.371090Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got read request: guid# 328233ec-cb995e91-cfc95ca8-2539a775
2025-10-02T08:07:19.371357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-02T08:07:19.371380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:19.371382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:19.371383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:19.371390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532987732917517:2528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:19.371955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532987732917517:2528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:19.372395Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917515:2529] connected; active server actors: 1
2025-10-02T08:07:19.377228Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556532987732917515:2529] session shared/user_1_1_11670534616535065925_v1
2025-10-02T08:07:19.377252Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:07:19.377265Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:07:19.377273Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_11670534616535065925_v1" (Sender=[1:7556532987732917512:2529], Pipe=[1:7556532987732917515:2529], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:19.377278Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:07:19.377293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:07:19.377302Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_11670534616535065925_v1" (Sender=[1:7556532987732917512:2529], Pipe=[1:7556532987732917515:2529], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:19.377315Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_11670534616535065925_v1" sender [1:7556532987732917512:2529] lock partition 0 for ReadingSession "shared/user_1_1_11670534616535065925_v1" (Sender=[1:7556532987732917512:2529], Pipe=[1:7556532987732917515:2529], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-02T08:07:19.377328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:07:19.377333Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-02T08:07:19.377789Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_11670534616535065925_v1" ClientId: "user" PipeClient { RawX1: 7556532987732917515 RawX2: 4503603922340321 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:19.377819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:07:19.378061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556532987732917524:2534]
2025-10-02T08:07:19.378079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532987732917524:2534], now have 1 active actors on pipe
2025-10-02T08:07:19.378148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.378158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.378174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_11670534616535065925_v1 on pipe: [1:7556532987732917524:2534]
2025-10-02T08:07:19.378195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.378202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.378204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:19.378241Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_11670534616535065925_v1
2025-10-02T08:07:19.378244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.378281Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.378459Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_11670534616535065925_v1:1 with generation 1
2025-10-02T08:07:19.384207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.384250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.384264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.384267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.384270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.384281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-02T08:07:19.384299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:19.384374Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759392439334 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:07:19.384385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-02T08:07:19.384410Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 sending to client partition status
2025-10-02T08:07:19.387671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556532987732917517:2528] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-02T08:07:19.388273Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917543:2528] connected; active server actors: 1
2025-10-02T08:07:19.388629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556532987732917517:2528] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-02T08:07:19.388637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532987732917517:2528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:19.389076Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917543:2528] disconnected; active server actors: 1
2025-10-02T08:07:19.389083Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917543:2528] disconnected no session
2025-10-02T08:07:19.397752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532987732917517:2528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:19.397769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532987732917517:2528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-02T08:07:19.397774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532987732917517:2528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:19.397786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:19.398632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-10-02T08:07:19.398653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532987732917556:2528], now have 1 active actors on pipe
2025-10-02T08:07:19.398728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.398739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.398770Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:19.398781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.398786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.398788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:19.398803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.398818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:19.398836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.399012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.399015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.399029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.399056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0
2025-10-02T08:07:19.401060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759392439401 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:19.401105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:19.403549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 1 to 1
2025-10-02T08:07:19.405452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.405468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-02T08:07:19.414315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.416315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.416507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.416521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.416558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:19.416578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.416722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.416727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.416940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:19.417153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:19.417217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:19.417275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:19.417433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-02T08:07:19.417439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-02T08:07:19.417467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.417493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.417503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.417506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T08:07:19.417547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T08:07:19.417563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-02T08:07:19.417567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-02T08:07:19.417571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-02T08:07:19.417575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-02T08:07:19.418053Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-02T08:07:19.424531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 2 to 2
2025-10-02T08:07:19.425198Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-02T08:07:19.425265Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-02T08:07:19.425282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-02T08:07:19.425290Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-02T08:07:19.426669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-02T08:07:19.426706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.426860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1759392439426
2025-10-02T08:07:19.428927Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.428946Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-02T08:07:19.429617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.429633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-02T08:07:19.432853Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-02T08:07:19.432870Z :DEBUG: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.437869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.438680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.440533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.441126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.441142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.441187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-02T08:07:19.441278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.441406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.441410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.441507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-02T08:07:19.441639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-02T08:07:19.441765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-02T08:07:19.442174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-02T08:07:19.442242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-02T08:07:19.442249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-02T08:07:19.442358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.442384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.442400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.442420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.442440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.442447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.442458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-02T08:07:19.442463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.442469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-02T08:07:19.442470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.442475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-02T08:07:19.442476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.442481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-02T08:07:19.442488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.442493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-02T08:07:19.442545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:19.442553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:19.442557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.442567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.442569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T08:07:19.442598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-02T08:07:19.442610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-02T08:07:19.442614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-02T08:07:19.442617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-02T08:07:19.442621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-02T08:07:19.443770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-02T08:07:19.443787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.443904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1759392439440
2025-10-02T08:07:19.445293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.445402Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-02T08:07:19.445409Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-02T08:07:19.445433Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-02T08:07:19.445435Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 1
2025-10-02T08:07:19.445451Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# d575adb5-9265719f-d4581f91-61b630f0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:19.445490Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid d575adb5-9265719f-d4581f91-61b630f0
2025-10-02T08:07:19.446585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T08:07:19.446596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2253219 bytes (2253219)
2025-10-02T08:07:19.446600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2253219 (8388608)
2025-10-02T08:07:19.446640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-02T08:07:19.446678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.446684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.446703Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.446715Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-02T08:07:19.446792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T08:07:19.446805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-02T08:07:19.446809Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:19.446844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.446851Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-02T08:07:19.446862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-02T08:07:19.446871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-02T08:07:19.446874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-02T08:07:19.446882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.447130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:19.447276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.447420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.447584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.447786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T08:07:19.447816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.447822Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-02T08:07:19.447834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:19.448078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.448248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:19.448412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.448559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.448707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.449751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 23 }
2025-10-02T08:07:19.449765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 1
2025-10-02T08:07:19.448976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.449324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.449334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.451245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 3 to 3
2025-10-02T08:07:19.451534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.451547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-02T08:07:19.451860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T08:07:19.451944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:19.456239Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439416 CreateTimestampMS: 1759392439401 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-02T08:07:19.459051Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.462811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.462841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.462863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.462872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.462887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-02T08:07:19.462892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.462897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-02T08:07:19.462899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.462904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-02T08:07:19.462906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.462913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-02T08:07:19.462920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.462924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-02T08:07:19.462967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.462970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.462973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.462987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T08:07:19.462989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T08:07:19.462992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 4506438 bytes (4506438)
2025-10-02T08:07:19.462997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 4506438 (8388608)
2025-10-02T08:07:19.463017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-02T08:07:19.463030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.463048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.465207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.465413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.465653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 19 }
2025-10-02T08:07:19.465664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 2
2025-10-02T08:07:19.465837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.465850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.465890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-02T08:07:19.465912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.466025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.466030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.466126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-02T08:07:19.466193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-02T08:07:19.466262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-02T08:07:19.466327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-02T08:07:19.466375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-02T08:07:19.466379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-02T08:07:19.466403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.466427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.466437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.466439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T08:07:19.466482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-02T08:07:19.466498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-02T08:07:19.466501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-02T08:07:19.466505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-02T08:07:19.466508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-02T08:07:19.466984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-02T08:07:19.467000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.467112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1759392439465
2025-10-02T08:07:19.467439Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.467452Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-10-02T08:07:19.470066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 4 to 4
2025-10-02T08:07:19.470367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.470381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-02T08:07:19.472276Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-02T08:07:19.472301Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid d575adb5-9265719f-d4581f91-61b630f0 has messages 1
2025-10-02T08:07:19.472380Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read done: guid# d575adb5-9265719f-d4581f91-61b630f0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-02T08:07:19.472389Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 response to read: guid# d575adb5-9265719f-d4581f91-61b630f0
2025-10-02T08:07:19.474347Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Process answer. Aval parts: 0
2025-10-02T08:07:19.477221Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-02T08:07:19.477339Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-02T08:07:19.477347Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 2252976 to budget
2025-10-02T08:07:19.477427Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-02T08:07:19.477438Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-02T08:07:19.477449Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1759392439416, sizeLag# 2253219
2025-10-02T08:07:19.477452Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 1
2025-10-02T08:07:19.479758Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-02T08:07:19.479779Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.479790Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-02T08:07:19.479863Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.479872Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-02T08:07:19.401000Z WriteTime: 2025-10-02T08:07:19.416000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:56310", "logtype": "unknown", "_ip": "ipv6:[::1]:56310" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.482270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.482295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.482315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.482323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.482336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-02T08:07:19.482341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.482345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-02T08:07:19.482348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.482351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-02T08:07:19.482354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.482358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-02T08:07:19.482366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.482371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-02T08:07:19.482419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.482422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.482425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.482437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T08:07:19.482439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T08:07:19.482441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-02T08:07:19.482445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 6759657 bytes (6759657)
2025-10-02T08:07:19.482450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 6759657 (8388608)
2025-10-02T08:07:19.482471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-02T08:07:19.482494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.482821Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.483762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 16 }
2025-10-02T08:07:19.483775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 3
2025-10-02T08:07:19.484414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.484680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.484731Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-02T08:07:19.484785Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got read request: guid# 5a0d1c72-3647784e-25115814-515f43ad
2025-10-02T08:07:19.484833Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# 7508a051-4269510e-f7c87389-3c8f59c4, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:19.484854Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 7508a051-4269510e-f7c87389-3c8f59c4
2025-10-02T08:07:19.485030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.485042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.485067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.485069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.485112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-02T08:07:19.485128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 3 max time lag 0ms effective offset 1
2025-10-02T08:07:19.485153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 3
2025-10-02T08:07:19.485156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-02T08:07:19.485170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.485180Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-02T08:07:19.485198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.485391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:19.485559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.485753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.485903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.485985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T08:07:19.486025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:19.487176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.487292Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439440 CreateTimestampMS: 1759392439422 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 1 }
2025-10-02T08:07:19.487613Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-02T08:07:19.487624Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 2 ReadGuid 7508a051-4269510e-f7c87389-3c8f59c4 has messages 1
2025-10-02T08:07:19.487648Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1759392439440, sizeLag# 2253329
2025-10-02T08:07:19.487651Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 0
2025-10-02T08:07:19.487661Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read done: guid# 7508a051-4269510e-f7c87389-3c8f59c4, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T08:07:19.487669Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 response to read: guid# 7508a051-4269510e-f7c87389-3c8f59c4
2025-10-02T08:07:19.488897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.490862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.490880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.490982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-02T08:07:19.491043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-02T08:07:19.491455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-02T08:07:19.491525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-02T08:07:19.491568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-02T08:07:19.491572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-02T08:07:19.491599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.491625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.491634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.491637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T08:07:19.491677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-02T08:07:19.491691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-02T08:07:19.491694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-02T08:07:19.491698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-02T08:07:19.491701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-02T08:07:19.492131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-02T08:07:19.492147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.492866Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T08:07:19.492276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00004? size 2253219 WTime 1759392439488
2025-10-02T08:07:19.492863Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Process answer. Aval parts: 1
2025-10-02T08:07:19.492898Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.492910Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 2253219
2025-10-02T08:07:19.495675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 5 to 5
2025-10-02T08:07:19.497805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.497823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-02T08:07:19.499612Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.500856Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-02T08:07:19.500880Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T08:07:19.503776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 6 to 6
2025-10-02T08:07:19.504082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.504095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-02T08:07:19.505897Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-02T08:07:19.505938Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.505950Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T08:07:19.506035Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.506045Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-02T08:07:19.422000Z WriteTime: 2025-10-02T08:07:19.440000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:56310", "_ip": "ipv6:[::1]:56310" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.507075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.507401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.507574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.507586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.507633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-02T08:07:19.507660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.507743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.507749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.507893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-02T08:07:19.507965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-02T08:07:19.508033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-02T08:07:19.508104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-02T08:07:19.508158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-02T08:07:19.508166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-02T08:07:19.508271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.508296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.508312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 2253219 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.508349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.508371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.508378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.508381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.508390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-02T08:07:19.508395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.508399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-02T08:07:19.508401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.508407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-02T08:07:19.508409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.508413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-02T08:07:19.508420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.508424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-02T08:07:19.508468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.508479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.508481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T08:07:19.508512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-02T08:07:19.508532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-02T08:07:19.508535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-02T08:07:19.508538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-02T08:07:19.508542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-02T08:07:19.509152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.510932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-02T08:07:19.510963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.511129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00004? size 2253219 WTime 1759392439508
2025-10-02T08:07:19.511154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.511223Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T08:07:19.511262Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got read request: guid# 34af855-ef395409-9271ee83-43604d7f
2025-10-02T08:07:19.511408Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# 6f99a578-bc0e761d-d8ac18af-26a6d03f, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:19.511432Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 6f99a578-bc0e761d-d8ac18af-26a6d03f
2025-10-02T08:07:19.512015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 7 to 7
2025-10-02T08:07:19.512956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T08:07:19.512966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T08:07:19.512969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-02T08:07:19.512972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-02T08:07:19.512976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 9012876 bytes (9012876)
2025-10-02T08:07:19.512979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 4 blobs
2025-10-02T08:07:19.513022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-02T08:07:19.513037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.513043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.513069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.513075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.513088Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.513101Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 2253219
2025-10-02T08:07:19.513110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-02T08:07:19.513113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T08:07:19.513752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.513122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T08:07:19.513134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-02T08:07:19.513149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-02T08:07:19.513765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-02T08:07:19.513159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-02T08:07:19.513229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.513232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.513236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.513239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.513255Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-02T08:07:19.513275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-02T08:07:19.513338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.513342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.513346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.513350Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.516016Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.516888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.516906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.517683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:19.517695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-02T08:07:19.517699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:19.517910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-02T08:07:19.518109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-02T08:07:19.518255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-02T08:07:19.519337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 8 to 8
2025-10-02T08:07:19.519639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.519650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-02T08:07:19.519691Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.518431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-02T08:07:19.518573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-02T08:07:19.519325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-02T08:07:19.519339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-02T08:07:19.519341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:19.519493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-02T08:07:19.519514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.519658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-02T08:07:19.519915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-02T08:07:19.520091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-02T08:07:19.520261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-02T08:07:19.528199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-02T08:07:19.528235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-02T08:07:19.528239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:19.528434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-02T08:07:19.528608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-02T08:07:19.528812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-02T08:07:19.528983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-02T08:07:19.529046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.529060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-02T08:07:19.533808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 9 to 9
2025-10-02T08:07:19.534077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.534089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-02T08:07:19.534388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-02T08:07:19.534421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-02T08:07:19.534423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:19.534569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-02T08:07:19.535945Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.536033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-02T08:07:19.536550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-02T08:07:19.536918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 19 }
2025-10-02T08:07:19.536936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 4
2025-10-02T08:07:19.537162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-02T08:07:19.544893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 10 to 10
2025-10-02T08:07:19.545183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.545198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-02T08:07:19.545257Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.545989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-02T08:07:19.546251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-02T08:07:19.546266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1759392439544
2025-10-02T08:07:19.546405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-02T08:07:19.546507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 0 endOffset 0 curOffset 4 d0000000000_00000000000000000003_00003_0000000001_00001| size 717134 WTime 1759392439544
2025-10-02T08:07:19.546793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 4 max time lag 0ms effective offset 2
2025-10-02T08:07:19.546811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 4
2025-10-02T08:07:19.546816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-02T08:07:19.546839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.546847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.546938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-02T08:07:19.547009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-02T08:07:19.547079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-02T08:07:19.547143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-02T08:07:19.547181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-02T08:07:19.547185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-02T08:07:19.547210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.547213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.547254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.547261Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.547279Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-02T08:07:19.547285Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 1 size 717134
2025-10-02T08:07:19.547303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.547323Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-02T08:07:19.547334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.547357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.547576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.547773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:19.548053Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.548756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.548939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.549102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.549225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T08:07:19.549272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-02T08:07:19.549324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-02T08:07:19.549538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.552426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 11 to 11
2025-10-02T08:07:19.552065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.552469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.554850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.554863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.554965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-02T08:07:19.555023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-02T08:07:19.555087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-02T08:07:19.555149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-02T08:07:19.555186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-02T08:07:19.555193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-02T08:07:19.555291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.555294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.555306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.555328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.555345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 2253219 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.555362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.555380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.555387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.555397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-02T08:07:19.555403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.555407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-02T08:07:19.555409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.555413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-02T08:07:19.555415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.555423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-02T08:07:19.555428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.555431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-02T08:07:19.555471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.555482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.555484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-02T08:07:19.555512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-02T08:07:19.555523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-02T08:07:19.555527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-02T08:07:19.555529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-02T08:07:19.555532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-02T08:07:19.555703Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439465 CreateTimestampMS: 1759392439450 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 2 }
2025-10-02T08:07:19.555880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.556177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.556190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-02T08:07:19.557962Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.561184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 12 to 12
2025-10-02T08:07:19.556460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-02T08:07:19.556489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-02T08:07:19.556496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-02T08:07:19.556500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-02T08:07:19.556503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-02T08:07:19.556508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-02T08:07:19.557064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 4506426 count 2 nextOffset 7 batches 9
2025-10-02T08:07:19.557077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.557180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 5,2 HeadOffset 5 endOffset 5 curOffset 7 d0000000000_00000000000000000005_00000_0000000002_00008? size 4506416 WTime 1759392439554
2025-10-02T08:07:19.559967Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-02T08:07:19.559983Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 3 ReadGuid 6f99a578-bc0e761d-d8ac18af-26a6d03f has messages 1
2025-10-02T08:07:19.560025Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1759392439465, sizeLag# 2253329
2025-10-02T08:07:19.560029Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 0
2025-10-02T08:07:19.560043Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read done: guid# 6f99a578-bc0e761d-d8ac18af-26a6d03f, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T08:07:19.560051Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 response to read: guid# 6f99a578-bc0e761d-d8ac18af-26a6d03f
2025-10-02T08:07:19.561449Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Process answer. Aval parts: 1
2025-10-02T08:07:19.566222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:07:19.569421Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T08:07:19.569561Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-02T08:07:19.569573Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T08:07:19.570126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.570144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-02T08:07:19.570455Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-02T08:07:19.570473Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.570481Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T08:07:19.570584Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.570593Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-02T08:07:19.450000Z WriteTime: 2025-10-02T08:07:19.465000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:56310", "server": "ipv6:[::1]:56310" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.573130Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T08:07:19.573228Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got read request: guid# 6148b17-1ec3ca83-f2d79f8c-b8f1ad5f
2025-10-02T08:07:19.573249Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# 412113c1-44ae4756-855c77b4-a7685df3, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:19.573274Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 412113c1-44ae4756-855c77b4-a7685df3
2025-10-02T08:07:19.577519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-02T08:07:19.577575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-02T08:07:19.577599Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.577630Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 2 size 4506416
2025-10-02T08:07:19.577672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.577681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.577825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 524288 endOffset 5 max time lag 0ms effective offset 3
2025-10-02T08:07:19.577851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 2253219 count 1 last offset 3, current partition end offset: 5
2025-10-02T08:07:19.577855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-02T08:07:19.577869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.577881Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-02T08:07:19.577900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.577931Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.578246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:19.578421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.578549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.579015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.579207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.579211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T08:07:19.579225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.579255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-02T08:07:19.580290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.582220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.582628Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439488 CreateTimestampMS: 1759392439469 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 3 }
2025-10-02T08:07:19.584595Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-10-02T08:07:19.584609Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 4 ReadGuid 412113c1-44ae4756-855c77b4-a7685df3 has messages 1
2025-10-02T08:07:19.584638Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1759392439488, sizeLag# 2253329
2025-10-02T08:07:19.584642Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 0
2025-10-02T08:07:19.584653Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read done: guid# 412113c1-44ae4756-855c77b4-a7685df3, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T08:07:19.584661Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 response to read: guid# 412113c1-44ae4756-855c77b4-a7685df3
2025-10-02T08:07:19.587944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 13 to 13
2025-10-02T08:07:19.588263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.588275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-02T08:07:19.588358Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.586375Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Process answer. Aval parts: 1
2025-10-02T08:07:19.586421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.586431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.586525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-02T08:07:19.586587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-02T08:07:19.586653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-02T08:07:19.586718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-02T08:07:19.586762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-02T08:07:19.586767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-02T08:07:19.586792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.586797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.586815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.586846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.586863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-02T08:07:19.586889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.588599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.588612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.588702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-02T08:07:19.588764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-02T08:07:19.588852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-02T08:07:19.588920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-02T08:07:19.588966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-02T08:07:19.588970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-02T08:07:19.589010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.589035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.589046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.589366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.590719Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T08:07:19.590801Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-02T08:07:19.590810Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T08:07:19.591200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 45 }
2025-10-02T08:07:19.591216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 5
2025-10-02T08:07:19.591664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 14 to 14
2025-10-02T08:07:19.591950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.591967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.592007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-02T08:07:19.592032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.592613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.592624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.593007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-02T08:07:19.593551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.593566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-02T08:07:19.593262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-02T08:07:19.593333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-02T08:07:19.593443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-02T08:07:19.593491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-02T08:07:19.593496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-02T08:07:19.593520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.593548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.593883Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-02T08:07:19.593902Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.593914Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T08:07:19.593995Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.594003Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-02T08:07:19.469000Z WriteTime: 2025-10-02T08:07:19.488000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:56310", "logtype": "unknown", "server": "ipv6:[::1]:56310" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.599112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 15 to 15
2025-10-02T08:07:19.599393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.599406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-02T08:07:19.599414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Estimated memory usage 22528015[B] reached maximum (20971520[B])
2025-10-02T08:07:19.599455Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.599293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.601146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.602412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.602430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.602471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-02T08:07:19.602497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.605842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.605862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.606286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-02T08:07:19.606684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-02T08:07:19.607084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-02T08:07:19.607485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-02T08:07:19.607531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-02T08:07:19.607538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-02T08:07:19.607594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.607621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.607793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.608957Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T08:07:19.609008Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got read request: guid# bc836d98-761ded08-aff85fd7-eac5ff44
2025-10-02T08:07:19.609029Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# c1f335e5-79b893eb-4eef75e5-330bccc4, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:19.609057Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid c1f335e5-79b893eb-4eef75e5-330bccc4
2025-10-02T08:07:19.609849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.611423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.611436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.611457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.611460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.611515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-02T08:07:19.611549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 1 size 524288 endOffset 5 max time lag 0ms effective offset 4
2025-10-02T08:07:19.611581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 2253219 count 1 last offset 4, current partition end offset: 5
2025-10-02T08:07:19.611587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-02T08:07:19.611606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.611620Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-02T08:07:19.611648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.611909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:19.612074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.612236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.612429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.612567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T08:07:19.612611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-02T08:07:19.613006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.613763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.615925Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439508 CreateTimestampMS: 1759392439493 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-10-02T08:07:19.616391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.618398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.618445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.618454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.618574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-02T08:07:19.618673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-02T08:07:19.618759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-02T08:07:19.618834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-02T08:07:19.618886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-02T08:07:19.618891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-02T08:07:19.619020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.619045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.619061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.619067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 717134 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.619163Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 5
2025-10-02T08:07:19.619175Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid c1f335e5-79b893eb-4eef75e5-330bccc4 has messages 1
2025-10-02T08:07:19.619221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.619222Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read done: guid# c1f335e5-79b893eb-4eef75e5-330bccc4, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-02T08:07:19.619225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-02T08:07:19.619230Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 response to read: guid# c1f335e5-79b893eb-4eef75e5-330bccc4
2025-10-02T08:07:19.619422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.619429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00004?
2025-10-02T08:07:19.619434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2253219 bytes (2253219)
2025-10-02T08:07:19.619440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2253219 (8388608)
2025-10-02T08:07:19.619718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:19.619728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-02T08:07:19.620106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.620116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.620155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-02T08:07:19.620173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.621184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.621197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.621308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-02T08:07:19.621841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-02T08:07:19.622027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-02T08:07:19.622051Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Process answer. Aval parts: 0
2025-10-02T08:07:19.622090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.622210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-02T08:07:19.622265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-02T08:07:19.622270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-02T08:07:19.622297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.622323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.622442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.622540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.622548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.622569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-02T08:07:19.622583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.622662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.622665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.622871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-02T08:07:19.622996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-02T08:07:19.623372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-02T08:07:19.623460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-02T08:07:19.623506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-02T08:07:19.623511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-02T08:07:19.623605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.623624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.623640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 2 size 4506416 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.623658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.623682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.623690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-02T08:07:19.623709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-02T08:07:19.623726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-02T08:07:19.623735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-02T08:07:19.623750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-02T08:07:19.623759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-02T08:07:19.623768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-02T08:07:19.623775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-02T08:07:19.623781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-02T08:07:19.623791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.623800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-02T08:07:19.623879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.623921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.623924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (35)
2025-10-02T08:07:19.623968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-02T08:07:19.623989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-02T08:07:19.623995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-02T08:07:19.624002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-02T08:07:19.624009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-02T08:07:19.625181Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-02T08:07:19.624489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-02T08:07:19.624540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 2253229 count 1 nextOffset 8 batches 5
2025-10-02T08:07:19.624586Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-02T08:07:19.624592Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 7
2025-10-02T08:07:19.624606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.625741Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-02T08:07:19.625761Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 2252978 to budget
2025-10-02T08:07:19.625387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-02T08:07:19.625402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-02T08:07:19.625407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-02T08:07:19.625411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-02T08:07:19.625415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-02T08:07:19.626155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 4506426 count 2 nextOffset 9 batches 9
2025-10-02T08:07:19.626172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-02T08:07:19.626180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-02T08:07:19.626184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-02T08:07:19.626188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-02T08:07:19.626192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-02T08:07:19.626999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 6759623 count 3 nextOffset 10 batches 13
2025-10-02T08:07:19.627014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-02T08:07:19.627020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-02T08:07:19.627024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-02T08:07:19.627027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-02T08:07:19.627290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.627336Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 7, WTime# 1759392439508, sizeLag# 4506416
2025-10-02T08:07:19.627339Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 1
2025-10-02T08:07:19.637206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 11 partNo 3 result is x0000000000_00000000000000000007_00000_0000000003_00015? size 8295635
2025-10-02T08:07:19.637249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-02T08:07:19.637270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00000_0000000003_00015? new key d0000000000_00000000000000000007_00000_0000000003_00015? size 8295635 WTime 1759392439636
2025-10-02T08:07:19.637411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 3 PackedSize 717145 count 1 nextOffset 11 batches 2
2025-10-02T08:07:19.637425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-02T08:07:19.637433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-02T08:07:19.637437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-02T08:07:19.637442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-02T08:07:19.637445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-02T08:07:19.638656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 3 PackedSize 2970343 count 2 nextOffset 12 batches 6
2025-10-02T08:07:19.638679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-02T08:07:19.638689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-02T08:07:19.638693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-02T08:07:19.638699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-02T08:07:19.638703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-02T08:07:19.639528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 3 PackedSize 5223541 count 3 nextOffset 13 batches 10
2025-10-02T08:07:19.639548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-02T08:07:19.639558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-02T08:07:19.639562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-02T08:07:19.639566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-02T08:07:19.639570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-02T08:07:19.640197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 3 PackedSize 7476739 count 4 nextOffset 14 batches 14
2025-10-02T08:07:19.640213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.640347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,4 HeadOffset 7 endOffset 7 curOffset 14 d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729 WTime 1759392439636
2025-10-02T08:07:19.648744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00004?
2025-10-02T08:07:19.648764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-02T08:07:19.648768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 6759635 bytes (6759635)
2025-10-02T08:07:19.648774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 6759635 (8388608)
2025-10-02T08:07:19.648875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-02T08:07:19.649761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 66 queued_in_partition_duration_ms: 9 }
2025-10-02T08:07:19.649780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 6
2025-10-02T08:07:19.649787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Estimated memory usage got back to normal 20275214[B]
2025-10-02T08:07:19.649900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 66 }
2025-10-02T08:07:19.649905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 7
2025-10-02T08:07:19.648904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-02T08:07:19.648915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.648994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.649004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.649032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.649037Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.649055Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 3 size 8295635
2025-10-02T08:07:19.649063Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 3 count 4 size 7476729
2025-10-02T08:07:19.649070Z node 1 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-02T08:07:19.649073Z node 1 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-02T08:07:19.649075Z node 1 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-10-02T08:07:19.649077Z node 1 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00004?(+) to d0000000000_00000000000000000003_00000_0000000001_00004?(+)
2025-10-02T08:07:19.649138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.649160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-02T08:07:19.649164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.649496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.649501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.649596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-02T08:07:19.649658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-02T08:07:19.649720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-02T08:07:19.649782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-02T08:07:19.649848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-02T08:07:19.649852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-02T08:07:19.649877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.649915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.650242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 16 to 16
2025-10-02T08:07:19.650514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.650526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-02T08:07:19.652197Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-02T08:07:19.652218Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.652232Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-02T08:07:19.652307Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.652319Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-02T08:07:19.493000Z WriteTime: 2025-10-02T08:07:19.508000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:56310", "_ip": "ipv6:[::1]:56310", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.658030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.658324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.658388Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-02T08:07:19.658423Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got read request: guid# 1a1ee6ac-b1e18178-69363055-f63a1d4e
2025-10-02T08:07:19.658443Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# aa24e0ec-99b5224c-3bdc4f87-99065f4b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:19.658462Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid aa24e0ec-99b5224c-3bdc4f87-99065f4b
2025-10-02T08:07:19.658639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.658648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.658676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.658679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.658723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-02T08:07:19.658757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 5 count 2 size 524288 endOffset 7 max time lag 0ms effective offset 5
2025-10-02T08:07:19.658783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 4506416 count 2 last offset 5, current partition end offset: 7
2025-10-02T08:07:19.658787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-02T08:07:19.658803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.658813Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-02T08:07:19.658837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.659175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:19.659425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.659595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.659746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.659978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:19.660146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.660293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.660352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.660462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.660535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 2 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T08:07:19.660596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-10-02T08:07:19.660642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63'
2025-10-02T08:07:19.662140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.662151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.662240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-02T08:07:19.662298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-02T08:07:19.662363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-02T08:07:19.662427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-02T08:07:19.662469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-02T08:07:19.662476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-02T08:07:19.662500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.662530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.662634Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439554 CreateTimestampMS: 1759392439503 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439554 CreateTimestampMS: 1759392439510 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 198 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 5 }
2025-10-02T08:07:19.677137Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 7
2025-10-02T08:07:19.677170Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid aa24e0ec-99b5224c-3bdc4f87-99065f4b has messages 1
2025-10-02T08:07:19.677249Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read done: guid# aa24e0ec-99b5224c-3bdc4f87-99065f4b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505820
2025-10-02T08:07:19.677263Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 response to read: guid# aa24e0ec-99b5224c-3bdc4f87-99065f4b
2025-10-02T08:07:19.680151Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Process answer. Aval parts: 0
2025-10-02T08:07:19.684194Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got ReadResponse, serverBytesSize = 4505820, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981532
2025-10-02T08:07:19.684296Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-02T08:07:19.684305Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 4505820 to budget
2025-10-02T08:07:19.688070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 17 to 17
2025-10-02T08:07:19.688394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.688410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-02T08:07:19.689668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Estimated memory usage 22528017[B] reached maximum (20971520[B])
2025-10-02T08:07:19.689725Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.694001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.694316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.694467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.694485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.694527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-02T08:07:19.694547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.694633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.694638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.694737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-02T08:07:19.694806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-02T08:07:19.694883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-02T08:07:19.694957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-02T08:07:19.695005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-02T08:07:19.695019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-02T08:07:19.695045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.695072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.705641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.705659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.705664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.705668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.705675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295635 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.705680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.705710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.705734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 15770374 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.705743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-02T08:07:19.705762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-02T08:07:19.705768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-02T08:07:19.705774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-02T08:07:19.705785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-02T08:07:19.705790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-02T08:07:19.705796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-02T08:07:19.705801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-02T08:07:19.705809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-02T08:07:19.705814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-02T08:07:19.705822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-02T08:07:19.705828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-02T08:07:19.705833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-02T08:07:19.705839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-02T08:07:19.705844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-02T08:07:19.705866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-02T08:07:19.705876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-02T08:07:19.705884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-02T08:07:19.705889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-02T08:07:19.705897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-02T08:07:19.705904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-02T08:07:19.705909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-02T08:07:19.705915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-02T08:07:19.705920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-02T08:07:19.705926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-02T08:07:19.705931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-02T08:07:19.705936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-02T08:07:19.705940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-02T08:07:19.705945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-02T08:07:19.705951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-02T08:07:19.705956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-02T08:07:19.705964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-02T08:07:19.705973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-02T08:07:19.705978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-02T08:07:19.705984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.705989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-02T08:07:19.706068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.706087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.706089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-02T08:07:19.706122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-02T08:07:19.706136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-02T08:07:19.706140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-02T08:07:19.706143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-02T08:07:19.706146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-02T08:07:19.706821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 2253230 count 1 nextOffset 15 batches 5
2025-10-02T08:07:19.706844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-02T08:07:19.706854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-02T08:07:19.706858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-02T08:07:19.706861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-02T08:07:19.706865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-02T08:07:19.707381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 4506428 count 2 nextOffset 16 batches 9
2025-10-02T08:07:19.707407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-02T08:07:19.707413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-02T08:07:19.707420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-02T08:07:19.707423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-02T08:07:19.707428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-02T08:07:19.707957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 6759626 count 3 nextOffset 17 batches 13
2025-10-02T08:07:19.707971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.708079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,3 HeadOffset 14 endOffset 14 curOffset 17 d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616 WTime 1759392439705
2025-10-02T08:07:19.708982Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 14 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-02T08:07:19.708994Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 14
2025-10-02T08:07:19.709016Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 14, WTime# 1759392439554, sizeLag# 16591270
2025-10-02T08:07:19.709019Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 1
2025-10-02T08:07:19.709107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.709119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.709126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.709131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.709140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 15 suffix '63' size 8295635
2025-10-02T08:07:19.709145Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:19.711364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00004?
2025-10-02T08:07:19.711368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-02T08:07:19.711371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-02T08:07:19.711375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 15055270 bytes (15055270)
2025-10-02T08:07:19.711378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-02T08:07:19.711447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-02T08:07:19.711485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-02T08:07:19.711500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-02T08:07:19.711519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-02T08:07:19.711533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-02T08:07:19.711549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-02T08:07:19.711565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-02T08:07:19.711696Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.711710Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 3 size 6759616
2025-10-02T08:07:19.711720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-02T08:07:19.711723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00004?
2025-10-02T08:07:19.711732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-02T08:07:19.711741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-02T08:07:19.711755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-02T08:07:19.711811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.711814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 1 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.711818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 3 parts_count 15 source 1 size 8295635 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.711829Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-02T08:07:19.711877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:19.711882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000004_00000_0000000001_00004?
2025-10-02T08:07:19.711883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:19.712047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-02T08:07:19.712198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-02T08:07:19.712365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-02T08:07:19.712611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-02T08:07:19.712691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-02T08:07:19.712868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.712884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.712889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.712893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.712897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.712902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.712907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.713297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 4 suffix '63'
2025-10-02T08:07:19.713302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63'
2025-10-02T08:07:19.713305Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 15 suffix '63'
2025-10-02T08:07:19.714356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 84 queued_in_partition_duration_ms: 35 }
2025-10-02T08:07:19.714371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 8
2025-10-02T08:07:19.714378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Estimated memory usage got back to normal 20275216[B]
2025-10-02T08:07:19.714451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 80 queued_in_partition_duration_ms: 36 }
2025-10-02T08:07:19.714455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 9
2025-10-02T08:07:19.714480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 80 queued_in_partition_duration_ms: 32 }
2025-10-02T08:07:19.714483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 10
2025-10-02T08:07:19.714502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 80 queued_in_partition_duration_ms: 20 }
2025-10-02T08:07:19.714505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 11
2025-10-02T08:07:19.714523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 68 queued_in_partition_duration_ms: 22 }
2025-10-02T08:07:19.714529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 12
2025-10-02T08:07:19.714548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 68 queued_in_partition_duration_ms: 15 }
2025-10-02T08:07:19.714551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 13
2025-10-02T08:07:19.714570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 68 queued_in_partition_duration_ms: 15 }
2025-10-02T08:07:19.714573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 14
2025-10-02T08:07:19.714932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 18 to 18
2025-10-02T08:07:19.715258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.715273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:19.716941Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-10-02T08:07:19.716964Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.720877Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-02T08:07:19.720900Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
2025-10-02T08:07:19.721555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-02T08:07:19.721597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-02T08:07:19.721599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:19.721830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-02T08:07:19.722036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-02T08:07:19.722266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-02T08:07:19.722430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-02T08:07:19.722682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-02T08:07:19.723314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.723642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-02T08:07:19.723657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-02T08:07:19.723766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.723820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-02T08:07:19.723971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-02T08:07:19.503000Z WriteTime: 2025-10-02T08:07:19.554000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:56310", "server": "ipv6:[::1]:56310", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.727834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 19 to 19
2025-10-02T08:07:19.728164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.728180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-02T08:07:19.724125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-02T08:07:19.724183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-02T08:07:19.724724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6759623 count 3 nextOffset 7 batches 13
2025-10-02T08:07:19.724735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-02T08:07:19.724738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:19.738423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-02T08:07:19.738609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-02T08:07:19.742861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-02T08:07:19.743022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-02T08:07:19.743179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-02T08:07:19.743384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-02T08:07:19.743410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1759392439743
2025-10-02T08:07:19.743778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-02T08:07:19.743794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-02T08:07:19.743952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-02T08:07:19.744100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-02T08:07:19.744251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-02T08:07:19.744477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-02T08:07:19.745182Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.750052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-10-02T08:07:19.750086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-02T08:07:19.750237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-02T08:07:19.750390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-02T08:07:19.750551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-02T08:07:19.750618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-02T08:07:19.751142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 6247592 count 3 nextOffset 10 batches 12
2025-10-02T08:07:19.751707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-02T08:07:19.751715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-02T08:07:19.751718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-02T08:07:19.751828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 3 endOffset 4 curOffset 10 d0000000000_00000000000000000007_00001_0000000003_00011| size 6247582 WTime 1759392439751
2025-10-02T08:07:19.754143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 20 to 20
2025-10-02T08:07:19.754451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.754467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-02T08:07:19.755176Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (6-6)
2025-10-02T08:07:19.755199Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.755212Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505820, ReadSizeServerDelta = -3981532
2025-10-02T08:07:19.755251Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.755262Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-02T08:07:19.510000Z WriteTime: 2025-10-02T08:07:19.554000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:56310", "server": "ipv6:[::1]:56310", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.761071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.761095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.761133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.761167Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.761185Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-02T08:07:19.761193Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 6247582
2025-10-02T08:07:19.761442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-02T08:07:19.761510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.765007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.765023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.765121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-02T08:07:19.765179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-02T08:07:19.765246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-02T08:07:19.765309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-02T08:07:19.765356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-02T08:07:19.765362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-02T08:07:19.765477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.765504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.765521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.765545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.765567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:19.765576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-02T08:07:19.765592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-02T08:07:19.765598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-02T08:07:19.765606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-02T08:07:19.765619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-02T08:07:19.765624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-02T08:07:19.765631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-02T08:07:19.765636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-02T08:07:19.765643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-02T08:07:19.765650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-02T08:07:19.765657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-02T08:07:19.765663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-02T08:07:19.765670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-02T08:07:19.765677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-02T08:07:19.765687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-02T08:07:19.765693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-02T08:07:19.765743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:19.765753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:19.765755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-02T08:07:19.765785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:19.765796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:19.765800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:19.765803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:19.765806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:19.766234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:19.766248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:19.766388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 17,1 HeadOffset 17 endOffset 17 curOffset 18 d0000000000_00000000000000000017_00000_0000000001_00004? size 2253220 WTime 1759392439766
2025-10-02T08:07:19.766746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:07:19.766787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-02T08:07:19.766805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-02T08:07:19.766817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-02T08:07:19.766825Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:19.766837Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 1 size 2253220
2025-10-02T08:07:19.766926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.766946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.766952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.766955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.767424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.767798Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:19.767807Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:19.771553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 6
2025-10-02T08:07:19.771569Z node 1 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T08:07:19.771594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.771602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.771648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-02T08:07:19.771677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.771782Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505820 } }
2025-10-02T08:07:19.771798Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got read request: guid# e1abf5de-c9d2ee67-ed6f1686-faa5db4f
2025-10-02T08:07:19.771818Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# e7b7e7ba-f087ef05-4b7b405d-fa7763b2, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:19.771834Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 14 ClientCommitOffset 0 committedOffset 0 Guid e7b7e7ba-f087ef05-4b7b405d-fa7763b2
2025-10-02T08:07:19.772586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.772881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.772914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.772922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.773093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-02T08:07:19.773155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-02T08:07:19.773215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-02T08:07:19.773275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-02T08:07:19.773326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-02T08:07:19.773330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-02T08:07:19.773367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.773371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.773388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.773413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.773445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 7 count 8 size 524288 endOffset 17 max time lag 0ms effective offset 7
2025-10-02T08:07:19.773477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 8295635 count 3 last offset 7, current partition end offset: 17
2025-10-02T08:07:19.773481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-02T08:07:19.773497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 3 parts_count 15 source 1 size 8295635 accessed 1 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.773517Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-02T08:07:19.773544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:19.773762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:19.773915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.774065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.774218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.774439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:19.774605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.774769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.774928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.775667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 15 suffix '63'
2025-10-02T08:07:19.775952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:19.777624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 21 to 21
2025-10-02T08:07:19.777965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.777982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-02T08:07:19.782776Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.784916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 58 queued_in_partition_duration_ms: 56 }
2025-10-02T08:07:19.784935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 15
2025-10-02T08:07:19.785072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 58 queued_in_partition_duration_ms: 44 }
2025-10-02T08:07:19.785075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 16
2025-10-02T08:07:19.785098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 58 queued_in_partition_duration_ms: 10 }
2025-10-02T08:07:19.785101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: acknoledged message 17
2025-10-02T08:07:19.787275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.787679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.788196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:19.788284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-02T08:07:19.788760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 1536000 from pos 0 cbcount 3
2025-10-02T08:07:19.788878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.788887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.788932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-10-02T08:07:19.797749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 22 to 22
2025-10-02T08:07:19.798078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.798094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-02T08:07:19.799614Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.799111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-02T08:07:19.799275Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 17 Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439620 CreateTimestampMS: 1759392439519 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439624 CreateTimestampMS: 1759392439533 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759392439624 CreateTimestampMS: 1759392439542 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 15772653 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 17 StartOffset: 0 } Cookie: 7 }
2025-10-02T08:07:19.801228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.801682Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 17
2025-10-02T08:07:19.801707Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 ReadOffset 10 ReadGuid e7b7e7ba-f087ef05-4b7b405d-fa7763b2 has messages 1
2025-10-02T08:07:19.801751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.801764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.801930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-02T08:07:19.802073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-02T08:07:19.802208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-02T08:07:19.802281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-02T08:07:19.802350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-02T08:07:19.802355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-02T08:07:19.802393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.802423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.802443Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 17, WTime# 1759392439624, sizeLag# 15772653
2025-10-02T08:07:19.802446Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 0
2025-10-02T08:07:19.802465Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read done: guid# e7b7e7ba-f087ef05-4b7b405d-fa7763b2, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6758782
2025-10-02T08:07:19.802476Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 response to read: guid# e7b7e7ba-f087ef05-4b7b405d-fa7763b2
2025-10-02T08:07:19.803168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.803588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.803782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.803793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.803826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-02T08:07:19.803838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.805558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.805568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.805672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-02T08:07:19.805734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-02T08:07:19.805799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-02T08:07:19.805860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-02T08:07:19.805901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-02T08:07:19.805906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-02T08:07:19.805927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.805950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.805960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.806231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.807567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.807578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.807608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-02T08:07:19.807626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:19.807845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:19.807849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:19.807947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-02T08:07:19.808045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-02T08:07:19.808140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-02T08:07:19.808201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-02T08:07:19.808243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-02T08:07:19.808248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-02T08:07:19.808269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:19.808291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.812362Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Process answer. Aval parts: 1
2025-10-02T08:07:19.820798Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got ReadResponse, serverBytesSize = 6758782, now ReadSizeBudget = 0, ReadSizeServerDelta = -6234494
2025-10-02T08:07:19.816652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.816667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6247582 actorID [1:7556532983437949881:2471]
2025-10-02T08:07:19.816691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:19.816695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-02T08:07:19.817720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:19.817730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:19.817733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:19.817739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:19.817742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:19.817756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:19.817759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:19.817775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:19.817788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:19.817804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 3 count 4 parts_count 13 source 1 size 7476729 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.817808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-02T08:07:19.000000Z
2025-10-02T08:07:19.820916Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-02T08:07:19.817816Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-02T08:07:19.817851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:19.820924Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 6758782 to budget
2025-10-02T08:07:19.817857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:19.817859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:19.818010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-02T08:07:19.818380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-02T08:07:19.819014Z node 1 :GLOBAL ERROR: log.cpp:875: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
2025-10-02T08:07:19.821014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-02T08:07:19.821025Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:19.821031Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-02T08:07:19.821036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-02T08:07:19.821040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-02T08:07:19.821043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-02T08:07:19.821058Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:203: PQ Cache (L2). Miss in touch. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63'
2025-10-02T08:07:19.821061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63'
2025-10-02T08:07:19.826486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 23 to 23
2025-10-02T08:07:19.826810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.826829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-02T08:07:19.829498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:19.829791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:19.836655Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (7-7)
2025-10-02T08:07:19.836688Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.836891Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-02T08:07:19.836903Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-02T08:07:19.519000Z WriteTime: 2025-10-02T08:07:19.620000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:56310", "_ip": "ipv6:[::1]:56310", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.849108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 24 to 24
2025-10-02T08:07:19.849443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.849459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-02T08:07:19.850917Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.866673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 25 to 25
2025-10-02T08:07:19.867032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.867047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-02T08:07:19.868757Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (8-8)
2025-10-02T08:07:19.868780Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.871157Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-02T08:07:19.871179Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-02T08:07:19.533000Z WriteTime: 2025-10-02T08:07:19.624000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:56310", "server": "ipv6:[::1]:56310" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.890498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 26 to 26
2025-10-02T08:07:19.890828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.890844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-02T08:07:19.892227Z :NOTICE: [/Invalid] [/Invalid] [93e503ae-1e2b9e7a-50e5a892-cc638e38] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:18220" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:18220. " }
2025-10-02T08:07:19.899465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write 1 messages with Id from 27 to 27
2025-10-02T08:07:19.899811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: try to update token
2025-10-02T08:07:19.899830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-02T08:07:19.909555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-02T08:07:19.909929Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (9-9)
2025-10-02T08:07:19.909952Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-02T08:07:19.909964Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 6758782, ReadSizeServerDelta = -6234494
2025-10-02T08:07:19.910099Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:19.910112Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-02T08:07:19.542000Z WriteTime: 2025-10-02T08:07:19.624000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:56310", "server": "ipv6:[::1]:56310" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-02T08:07:19.914263Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 grpc read done: success# 1, data# { read_request { bytes_size: 6758782 } }
2025-10-02T08:07:19.914399Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 got read request: guid# d4f6513e-6b326772-83767f3a-5700fc31
2025-10-02T08:07:19.914422Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# b01f9ae6-27b0c9a3-47c0cf11-db396bc1, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:19.914447Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 17 ClientCommitOffset 0 committedOffset 0 Guid b01f9ae6-27b0c9a3-47c0cf11-db396bc1
2025-10-02T08:07:20.206308Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::CreateFormedBlob(unsigned int, bool)+2949 (0x240F8095)
NKikimr::NPQ::TPartitionedBlob::Add(NKikimr::NPQ::TClientBlob&&)+213 (0x240F87F5)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+3079 (0x241E0957)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+981 (0x241E5D65)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:20.207121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 5 size 4506416 cause it's been evicted from L2. Actual L1 size: 7
2025-10-02T08:07:20.207136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 717134 cause it's been evicted from L2. Actual L1 size: 6
2025-10-02T08:07:20.207139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 4 size 2253219 cause it's been evicted from L2. Actual L1 size: 5
2025-10-02T08:07:20.207149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7476729 cause it's been evicted from L2. Actual L1 size: 4
2025-10-02T08:07:20.207166Z node 1 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-02T08:07:20.207243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.207255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.207294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.207296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.208691Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:20.210172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_11670534616535065925_v1
2025-10-02T08:07:20.210189Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.210195Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.210198Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.210203Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.210206Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.210210Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.210213Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.210645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:20.210707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: status is not ok: tablet will be restarted right now sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0
2025-10-02T08:07:20.211403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0 is DEAD
2025-10-02T08:07:20.211663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556532987732917524:2534]
2025-10-02T08:07:20.211698Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_11670534616535065925_v1
2025-10-02T08:07:20.212710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:20.212724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session will restart in 0.005709s
2025-10-02T08:07:20.212768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: Do CDS request
2025-10-02T08:07:20.212776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:20.229469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:20.229938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:20.229953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-02T08:07:20.230113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:20.230142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:20.230148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:20.230152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:20.230691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-02T08:07:20.230731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:20.230733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:20.230735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:20.230741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532992027885019:2546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:20.250096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532992027885019:2546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:20.260339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:20.262804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:20.263125Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:20.263131Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:20.263149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:20.263233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:20.263291Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556532992027885056:2545]
2025-10-02T08:07:20.264015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:20.264899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:20.264957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:20.265344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:20.265437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.265440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000001_00001|
2025-10-02T08:07:20.265446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.265447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.265448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000004_00000_0000000001_00004?
2025-10-02T08:07:20.265450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-02T08:07:20.265450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-02T08:07:20.265451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.265452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.265460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.265471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000001_00001|
2025-10-02T08:07:20.265475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:573: replace key d0000000000_00000000000000000003_00003_0000000001_00001| to d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.265479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.265483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:602: ignore key d0000000000_00000000000000000004_00000_0000000001_00004?
2025-10-02T08:07:20.265487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:602: ignore key d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-02T08:07:20.265491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:592: ignore key d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-02T08:07:20.265494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.265498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.265505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.265514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.265520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000001_00001|
2025-10-02T08:07:20.265526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000003_00003_0000000001_00001| will be deleted
2025-10-02T08:07:20.265529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.265534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.265539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000004_00000_0000000001_00004?
2025-10-02T08:07:20.265544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000004_00000_0000000001_00004? will be deleted
2025-10-02T08:07:20.265546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-02T08:07:20.265551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000005_00000_0000000002_00008? will be deleted
2025-10-02T08:07:20.265553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-02T08:07:20.265557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000007_00000_0000000003_00015? will be deleted
2025-10-02T08:07:20.265559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.265564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.265568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.265574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.265582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.265587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.265610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:20.266875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532992027885019:2546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:20.290019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532992027885019:2546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:20.290049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532992027885019:2546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:20.290052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532992027885019:2546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:20.290063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:20.309334Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:9:0
2025-10-02T08:07:20.309364Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1004 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:07:20.307676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:20.311548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:20.311560Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:20.311563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:20.311568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:20.311579Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [1:7556532992027885056:2545]
2025-10-02T08:07:20.311594Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:20.311620Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:20.311623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.311626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.311629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.311675Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:20.311681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:20.311689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:20.311764Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:20.311774Z node 1 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000003_00015?(+) to d0000000000_00000000000000000007_00000_0000000003_00015?(+)
2025-10-02T08:07:20.311776Z node 1 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000002_00008?(+) to d0000000000_00000000000000000005_00000_0000000002_00008?(+)
2025-10-02T08:07:20.311778Z node 1 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00004?(+) to d0000000000_00000000000000000004_00000_0000000001_00004?(+)
2025-10-02T08:07:20.311781Z node 1 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000001_00001|(+) to d0000000000_00000000000000000003_00003_0000000001_00001|(+)
2025-10-02T08:07:20.311820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.311822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.311826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:20.311829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:20.311962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:20.311966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.311979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.311994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:20.312029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532992027885039:2545]
2025-10-02T08:07:20.312031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532992027885039:2545]
2025-10-02T08:07:20.312047Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:20.312063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:20.312079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:20.312083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:20.312217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:20.312224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:20.312257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556532992027885039:2545]
2025-10-02T08:07:20.312260Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:20.312305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2
2025-10-02T08:07:20.312317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532992027885105:2546], now have 1 active actors on pipe
2025-10-02T08:07:20.312347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:20.312926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.312938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.312958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556532992488357807:2378], now have 1 active actors on pipe
2025-10-02T08:07:20.312978Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:20.312990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:07:20.313273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 1 ReadOffset 10 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556532992027885126:2534]
2025-10-02T08:07:20.313348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 10 Count: 8 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532987732917524 RawX2: 4503603922340326 } Cookie: 10 } }
2025-10-02T08:07:20.313783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7556532992027885126:2534]
2025-10-02T08:07:20.313800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532992027885126:2534], now have 1 active actors on pipe
2025-10-02T08:07:20.313875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.313881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.313915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 8 size 524288 endOffset 17 max time lag 0ms effective offset 10
2025-10-02T08:07:20.313921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 0 blobs, size 0 count 0 last offset 10, current partition end offset: 17
2025-10-02T08:07:20.314054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. All data is from uncompacted head.
2025-10-02T08:07:20.314060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-02T08:07:20.314090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-02T08:07:20.314147Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 17 SizeLag: 14953458 RealReadOffset: 10 WaitQuotaTimeMs: 0 ReadFromTimestampMs: 0 SizeEstimate: 23 LastOffset: 9 EndOffset: 17 StartOffset: 0 } Cookie: 10 }
2025-10-02T08:07:20.314159Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 11 endOffset 17
2025-10-02T08:07:20.314167Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 ReadOffset 11 ReadGuid b01f9ae6-27b0c9a3-47c0cf11-db396bc1 has messages 0
2025-10-02T08:07:20.314183Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 11, endOffset# 17, WTime# 1759392439624, sizeLag# 14953458
2025-10-02T08:07:20.314186Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1TEvPartitionReady. Aval parts: 0
2025-10-02T08:07:20.314195Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 read done: guid# b01f9ae6-27b0c9a3-47c0cf11-db396bc1, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 10
2025-10-02T08:07:20.314203Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2108: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 empty read result, start new reading: guid# b01f9ae6-27b0c9a3-47c0cf11-db396bc1
2025-10-02T08:07:20.314208Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 Process answer. Aval parts: 1
2025-10-02T08:07:20.314220Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 performing read request: guid# a7136e1c-23dc2924-9c0f07c4-5a9679a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-02T08:07:20.314234Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 11 EndOffset 17 ClientCommitOffset 0 committedOffset 0 Guid a7136e1c-23dc2924-9c0f07c4-5a9679a
2025-10-02T08:07:20.314587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.314594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.314707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:20.314723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:20.314734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.314740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.314743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:20.314756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.314772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:20.314781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:07:20.314788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 11 count 7 size 524288 endOffset 17 max time lag 0ms effective offset 11
2025-10-02T08:07:20.314817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 2 blobs, size 6759616 count 6 last offset 14, current partition end offset: 17
2025-10-02T08:07:20.314820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-02T08:07:20.314829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:20.314840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532992027885039:2545]
2025-10-02T08:07:20.314842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532992027885039:2545]
2025-10-02T08:07:20.314847Z node 1 :PERSQUEUE DEBUG: read.h:68: [72075186224037892][PQCacheProxy]Read request is blocked. Partition 0 offset 10
2025-10-02T08:07:20.314851Z node 1 :PERSQUEUE DEBUG: read.h:137: [72075186224037892][PQCacheProxy]Reading cookie 5. There's another reading of the same blob. Waiting
2025-10-02T08:07:20.314979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:20.314984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:20.315670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|459e1b5-309d16fd-8d9414d0-bc4434d0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:20.313203Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2
2025-10-02T08:07:20.315141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.315148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.315163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:20.315195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 17 sessionId: src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0
2025-10-02T08:07:20.349495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0] Write session: try to update token
2025-10-02T08:07:20.349521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:20.394012Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:20.394030Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:20.394033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:20.394043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556532992027885039:2545]
2025-10-02T08:07:20.394049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556532992027885039:2545]
2025-10-02T08:07:20.394066Z node 1 :PERSQUEUE DEBUG: read.h:87: [72075186224037892][PQCacheProxy]Read requests are unblocked. Partition 0 offset 10 num unblocked 1
2025-10-02T08:07:20.394107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 3 count 4 parts_count 13 source 0 size 7476729 accessed 0 times before, last time 2025-10-02T08:07:20.000000Z
2025-10-02T08:07:20.394111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 3 parts_count 12 source 0 size 6759616 accessed 0 times before, last time 2025-10-02T08:07:20.000000Z
2025-10-02T08:07:20.394116Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 2 blobs are from cache.
2025-10-02T08:07:20.394135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:20.394142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.394145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:20.394509Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:20.395902Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 15 suffix '63' size 8295635
2025-10-02T08:07:20.395910Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:20.395916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:20.395932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63'
2025-10-02T08:07:20.395936Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63'
2025-10-02T08:07:20.411717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:20.434684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:20.583922Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:20.585168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.585186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.585509Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:20.585722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556532992027885126:2534]
2025-10-02T08:07:20.585750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:20.585753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:20.585809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: error at write: Disconnected sessionId: src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0
2025-10-02T08:07:20.585989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0 is DEAD
2025-10-02T08:07:20.586014Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.586020Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.589036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:20.589051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0] Write session will restart in 0.005087s
2025-10-02T08:07:20.589080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0] Write session: Do CDS request
2025-10-02T08:07:20.589088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:20.597298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:20.597652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:20.597668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-02T08:07:20.597808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:20.597851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:20.597860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:20.597864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:20.598363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-02T08:07:20.598399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:20.598405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:20.598406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:20.598412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532992027885181:2560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:20.598989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532992027885181:2560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:20.602872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532992027885181:2560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:20.606905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:20.613735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:20.614097Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:20.614103Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:20.614121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:20.614210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:20.614283Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556532992027885233:2559]
2025-10-02T08:07:20.614944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:20.615685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532992027885181:2560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:20.615696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532992027885181:2560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:20.615700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532992027885181:2560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:20.615710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:20.616062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:20.616109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:20.617089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:20.617170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.617171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.617172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.617173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.617175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.617182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.617193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.617197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.617201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.617206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.617213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.617221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.617228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.617234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.617239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.617245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.617249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.617253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.617258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.617263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.617284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:20.636042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:20.638566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:20.638585Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:20.638588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:20.638593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:20.638602Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3 [1:7556532992027885233:2559]
2025-10-02T08:07:20.638622Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:20.638647Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:20.638651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.638656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.638658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.638682Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:20.638691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:20.638702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:20.638798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.638801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.638808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:20.638812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:20.638899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:20.638902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.638921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.638933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:20.638958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532992027885225:2559]
2025-10-02T08:07:20.638960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532992027885225:2559]
2025-10-02T08:07:20.638975Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:20.638992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:20.639010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:20.639013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:20.639061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556532992027885225:2559]
2025-10-02T08:07:20.639067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:20.639933Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 3
2025-10-02T08:07:20.639333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:20.639338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:20.639347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:20.640135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 3
2025-10-02T08:07:20.640154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532992027885242:2560], now have 1 active actors on pipe
2025-10-02T08:07:20.640161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556532992488357826:2378], now have 1 active actors on pipe
2025-10-02T08:07:20.640524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.640535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.640576Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:20.640588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.640595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.640598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:20.640615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.640632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:20.640655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:20.640790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.640819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.640837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:20.640873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 17 sessionId: src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0
2025-10-02T08:07:20.645153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccce5437-3946c2cd-2c2a8c0b-d9a533b5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:20.648054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0] Write session: try to update token
2025-10-02T08:07:20.648076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:20.680897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:20.684450Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:20.684467Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:20.684470Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:20.684483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556532992027885225:2559]
2025-10-02T08:07:20.684487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556532992027885225:2559]
2025-10-02T08:07:20.684539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:20.684546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.684549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:20.684833Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:20.685267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:20.685281Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:20.693384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556532992027885264:2534]
2025-10-02T08:07:20.693465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:20.693509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:20.693608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3, pipe: [1:7556532992027885264:2534]
2025-10-02T08:07:20.839690Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:20.840011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.840025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.840047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532992027885264:2534], now have 1 active actors on pipe
2025-10-02T08:07:20.840058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.840064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.840254Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.840263Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:20.840531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:20.840583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:20.840585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556532992027885264:2534]
2025-10-02T08:07:20.840592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0
2025-10-02T08:07:20.840796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0 is DEAD
2025-10-02T08:07:20.841016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:20.841028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0] Write session will restart in 0.009353s
2025-10-02T08:07:20.841051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0] Write session: Do CDS request
2025-10-02T08:07:20.841059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:20.851635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:20.851864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:20.851878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-02T08:07:20.852289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:20.852343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:20.852349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:20.852354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:20.852837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-02T08:07:20.852872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:20.852874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:20.852876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:20.852882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532992027885307:2567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:20.853485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532992027885307:2567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:20.854951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:20.855467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:20.855650Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:20.855655Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:20.855665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:20.855712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:20.855750Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556532992027885334:2566]
2025-10-02T08:07:20.856441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:20.856854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:20.856896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:20.857236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:20.857270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.857271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.857272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.857274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.857276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.857282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.857294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.857298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.857302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.857306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.857312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.857320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:20.857328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.857333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:20.857337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.857342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:20.857348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.857354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.857358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.857363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.857380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:20.858405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532992027885307:2567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:20.867396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532992027885307:2567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:20.867414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532992027885307:2567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:20.867418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532992027885307:2567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:20.867428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:20.872187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:20.874116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:20.874126Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:20.874130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:20.874136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:20.874147Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 4 [1:7556532992027885334:2566]
2025-10-02T08:07:20.874165Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:20.874197Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:20.874201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.874205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.874207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.874229Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:20.874237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:20.874246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:20.874324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.874327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.874331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:20.874334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:20.874437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:20.874441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.874458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:20.874471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:20.874495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532992027885374:2567], now have 1 active actors on pipe
2025-10-02T08:07:20.874504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532992027885328:2566]
2025-10-02T08:07:20.874506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532992027885328:2566]
2025-10-02T08:07:20.874516Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:20.874532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:20.874548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:20.874551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:20.874557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556532992488357835:2378], now have 1 active actors on pipe
2025-10-02T08:07:20.874601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556532992027885328:2566]
2025-10-02T08:07:20.874603Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:20.874649Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:20.874652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:20.874655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 4
2025-10-02T08:07:20.874660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:20.874886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.874897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.874929Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:20.874938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:20.874942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:20.874945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:20.874958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:20.874971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:20.874987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:20.875108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:20.875112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:20.875126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:20.875159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 17 sessionId: src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0
2025-10-02T08:07:20.875377Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 4
2025-10-02T08:07:20.880672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb1e1-48a52c8d-d6362560-7d3260c0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:20.883971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0] Write session: try to update token
2025-10-02T08:07:20.883997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:20.905861Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:20.905883Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:20.905887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:20.905899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556532992027885328:2566]
2025-10-02T08:07:20.905904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556532992027885328:2566]
2025-10-02T08:07:20.905968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:20.905975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:20.905978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:20.906135Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:20.907136Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:20.907144Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:20.925136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:20.928084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:20.936954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556532992027885389:2534]
2025-10-02T08:07:20.937045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:20.937185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 4, pipe: [1:7556532992027885389:2534]
2025-10-02T08:07:21.219996Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:21.220537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.220557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.220612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532992027885389:2534], now have 1 active actors on pipe
2025-10-02T08:07:21.220636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.220639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.221120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:21.221133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:21.221210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: error at write: Disconnected sessionId: src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0
2025-10-02T08:07:21.221214Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:21.221224Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:21.221476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0 is DEAD
2025-10-02T08:07:21.221651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556532992027885389:2534]
2025-10-02T08:07:21.222909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:21.225121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:21.225135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0] Write session will restart in 0.005099s
2025-10-02T08:07:21.225161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0] Write session: Do CDS request
2025-10-02T08:07:21.225169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:21.232119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:21.232677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:21.232920Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:21.232933Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:21.232947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:21.233009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:21.233066Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556532996322852764:2573]
2025-10-02T08:07:21.233475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:21.233798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:21.233816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-02T08:07:21.233925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:21.233955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:21.233966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:21.233970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:21.234005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:21.234551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:21.234607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:21.234993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:21.235052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.235059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.235060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.235061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.235063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.235069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.235081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.235085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.235089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.235094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.235100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.235109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.235117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.235124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.235134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.235140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.235150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.235156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.235167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.235173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.235200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:21.235551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-02T08:07:21.235585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:21.235592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:21.235593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:21.235600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532996322852778:2575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:21.236213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532996322852778:2575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:21.241966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532996322852778:2575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:21.254739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:21.256622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:21.256631Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:21.256635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:21.256640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:21.256649Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 5 [1:7556532996322852764:2573]
2025-10-02T08:07:21.256664Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:21.256691Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:21.256695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:21.256699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:21.256704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.256722Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:21.256729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:21.256737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:21.257031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.257036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.257040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:21.257044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:21.257127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:21.257130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.257148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.257162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:21.257183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532996322852757:2573]
2025-10-02T08:07:21.257185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532996322852757:2573]
2025-10-02T08:07:21.257193Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:21.257210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:21.257227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:21.257231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:21.257265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532996322852778:2575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:21.257273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556532996322852757:2573]
2025-10-02T08:07:21.257274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532996322852778:2575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:21.257276Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:21.257278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532996322852778:2575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:21.257289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:21.257535Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:21.257538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:21.257545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:21.258127Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 5
2025-10-02T08:07:21.258303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556532996783325152:2378], now have 1 active actors on pipe
2025-10-02T08:07:21.258419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 5
2025-10-02T08:07:21.258425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532996322852813:2575], now have 1 active actors on pipe
2025-10-02T08:07:21.258491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.258499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.258531Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:21.258541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:21.258546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:21.258548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:21.258563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.258580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:21.258597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:21.259241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3645ade-2f3cfd4d-d5b05a28-b6f32c03_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:21.258704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.258708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.258722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:21.258751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 17 sessionId: src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0
2025-10-02T08:07:21.262263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0] Write session: try to update token
2025-10-02T08:07:21.262279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:21.284588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:21.287610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:21.289879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.289904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.289960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:21.289997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:21.293026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.293042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.293388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.293465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.293583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.293658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.293709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.293715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.293796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.293981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.294047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.294117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.294238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.294241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.294313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.294374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.294439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.294503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.294643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.294647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.294742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.294814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.294891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.294959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.295009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.295012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.295080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.295138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.295203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.295266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.295309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.295314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.295387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.295448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.295532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.295601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.295721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.295724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.295798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.295863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.295930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.295997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.296044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.296047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.296122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.296188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.296266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.296356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.296503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.296506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.296580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.296711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.296778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.301347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.301406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.301411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.301537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.301597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.301663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.301822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.301941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.301944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.302013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:21.302088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:21.302115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:21.302118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:21.302160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:21.302177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:21.302181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:21.302184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:21.302188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:21.302727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:21.302747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:21.302753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:21.302756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:21.302759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:21.302762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:21.303405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:21.303422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:21.303428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:21.303431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:21.303435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:21.303439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:21.303988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:21.304001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:21.304010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:21.304015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:21.304018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:21.307565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:21.307589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:21.307604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392441307
2025-10-02T08:07:21.307737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:21.307749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:21.307754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:21.307757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:21.307762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:21.307766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:21.308384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:21.308400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:21.308406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:21.308410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:21.308414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:21.308418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:21.311232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:21.311259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:21.311267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:21.311273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:21.311276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:21.311280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:21.311827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:21.311840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:21.311845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:21.320282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:21.320328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:21.320339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:21.320343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:21.320356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392441320
2025-10-02T08:07:21.320998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:21.321045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:21.321055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:21.321062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:21.321066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:21.321069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:21.321690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:21.321719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:21.321725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:21.321730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:21.321733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:21.321737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:21.322206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:21.322218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.322360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392441322
2025-10-02T08:07:21.324492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556532996322852844:2534]
2025-10-02T08:07:21.324655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:21.324713Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:21.324722Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:21.324727Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:21.324731Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:21.329939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 5, pipe: [1:7556532996322852844:2534]
2025-10-02T08:07:21.330277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532996322852844:2534], now have 1 active actors on pipe
2025-10-02T08:07:21.330306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.330314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.330341Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:21.330343Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:21.330345Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:21.330354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556532996322852757:2573]
2025-10-02T08:07:21.330363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556532996322852757:2573]
2025-10-02T08:07:21.330444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:21.330450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.330455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:21.330615Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:21.332420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:21.332428Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:21.519133Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:21.522541Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:21.522584Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:21.522597Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:21.522952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:21.522979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0
2025-10-02T08:07:21.523205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0 is DEAD
2025-10-02T08:07:21.523363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556532996322852844:2534]
2025-10-02T08:07:21.525108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:21.525122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0] Write session will restart in 0.006392s
2025-10-02T08:07:21.525147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0] Write session: Do CDS request
2025-10-02T08:07:21.525155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:21.532510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:21.532944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:21.532961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-02T08:07:21.533100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:21.533127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:21.533134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:21.533140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:21.534195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-02T08:07:21.534239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:21.534241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:21.534243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:21.534249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532996322852895:2592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:21.534844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532996322852895:2592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:21.541605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532996322852895:2592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:21.550763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:21.550982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:21.551154Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:21.551157Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:21.551168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:21.551219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:21.551265Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556532996322852974:2593]
2025-10-02T08:07:21.552008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:21.554524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:21.554622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:21.554688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532996322852895:2592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:21.554696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532996322852895:2592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:21.554700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532996322852895:2592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:21.554710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:21.555264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:21.555324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.555326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.555327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.555329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.555330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.555339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.555352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.555357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.555362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.555367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.555375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.555385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.555392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.555398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.555405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.555410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.555417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.555423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.555430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.555436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.555460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:21.612140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:21.614163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:21.614172Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:21.614176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:21.614181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:21.614190Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 6 [1:7556532996322852974:2593]
2025-10-02T08:07:21.614206Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:21.614227Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:21.614231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:21.614234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:21.614236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.614255Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:21.614261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:21.614268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:21.614349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.614351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.614354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:21.614357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:21.614448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:21.614451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.614466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.614478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:21.614495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532996322852966:2593]
2025-10-02T08:07:21.614497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532996322852966:2593]
2025-10-02T08:07:21.614510Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:21.614524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:21.614539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:21.614543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:21.614583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556532996322852966:2593]
2025-10-02T08:07:21.614585Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:21.615352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 6
2025-10-02T08:07:21.614834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:21.614841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:21.614847Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:21.615451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 6
2025-10-02T08:07:21.615467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532996322852985:2592], now have 1 active actors on pipe
2025-10-02T08:07:21.615472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556532996783325182:2378], now have 1 active actors on pipe
2025-10-02T08:07:21.615780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.615788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.615825Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:21.615835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:21.615841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:21.615844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:21.615856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.615871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:21.615890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:21.621421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.621435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.621480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:21.621529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0
2025-10-02T08:07:21.625206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fff46232-77b948b4-e7e4eb4-468c89c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:21.625194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556532996322853003:2534]
2025-10-02T08:07:21.625273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:21.626086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 6, pipe: [1:7556532996322853003:2534]
2025-10-02T08:07:21.626104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532996322853003:2534], now have 1 active actors on pipe
2025-10-02T08:07:21.626205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.626213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.626258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 11 count 7 size 524288 endOffset 17 max time lag 0ms effective offset 11
2025-10-02T08:07:21.626303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 6759616 count 6 last offset 14, current partition end offset: 17
2025-10-02T08:07:21.626307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-02T08:07:21.626318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532996322852966:2593]
2025-10-02T08:07:21.626320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532996322852966:2593]
2025-10-02T08:07:21.626332Z node 1 :PERSQUEUE DEBUG: read.h:68: [72075186224037892][PQCacheProxy]Read request is blocked. Partition 0 offset 10
2025-10-02T08:07:21.626337Z node 1 :PERSQUEUE DEBUG: read.h:137: [72075186224037892][PQCacheProxy]Reading cookie 4. There's another reading of the same blob. Waiting
2025-10-02T08:07:21.626438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:21.626443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:21.628021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0] Write session: try to update token
2025-10-02T08:07:21.628090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:21.664925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:21.672876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:21.673150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.673182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.673219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:21.673250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:21.673434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.673440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.673724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.673816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.673900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.673996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.674063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.674068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.674171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.674249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.674344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.674431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.674491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.674495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.674578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.674670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.674749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.674829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.674885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.674904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.674986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.675060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.675127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.675304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.675360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.675371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.675457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.675544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.675621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.675702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.675757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.675760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.675836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.675906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.675980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.676050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.676106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.676108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.676187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.676250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.676359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.676427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.681221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.681239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.681339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.681411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.681489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.681583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.681649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.681653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.681756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.681841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.681950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.682029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.682089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.682092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.682368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:21.682455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:21.682542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:21.682630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:21.683075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:21.683081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:21.683147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:21.683301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:21.683323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:21.683326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:21.683363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:21.683389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:21.683393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:21.683396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:21.683400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:21.683901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:21.683923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:21.683930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:21.683934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:21.683937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:21.683941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:21.684557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:21.684573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:21.684580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:21.684584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:21.684587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:21.684591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:21.686339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:21.686373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:21.686380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:21.686386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:21.686390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:21.688227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:21.688239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:21.688252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392441687
2025-10-02T08:07:21.688410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:21.688423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:21.688429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:21.688432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:21.688436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:21.688439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:21.697988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:21.698035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:21.698049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:21.698052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:21.698056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:21.698061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:21.698697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:21.698719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:21.698728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:21.698732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:21.698739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:21.698742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:21.699380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:21.699399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:21.699406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:21.701162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:21.701183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:21.701190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:21.701194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:21.701206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392441700
2025-10-02T08:07:21.701774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:21.701794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:21.701802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:21.701806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:21.701810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:21.701814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:21.702677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:21.702704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:21.702711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:21.702715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:21.702718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:21.702722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:21.703346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:21.703359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.703477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392441703
2025-10-02T08:07:21.704566Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:21.704586Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:21.704593Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:21.704601Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:21.708447Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:21.708451Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:21.708453Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:21.708463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556532996322852966:2593]
2025-10-02T08:07:21.708468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556532996322852966:2593]
2025-10-02T08:07:21.708493Z node 1 :PERSQUEUE DEBUG: read.h:87: [72075186224037892][PQCacheProxy]Read requests are unblocked. Partition 0 offset 10 num unblocked 1
2025-10-02T08:07:21.708530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 3 count 4 parts_count 13 source 0 size 7476729 accessed 0 times before, last time 2025-10-02T08:07:21.000000Z
2025-10-02T08:07:21.708534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 3 parts_count 12 source 0 size 6759616 accessed 0 times before, last time 2025-10-02T08:07:21.000000Z
2025-10-02T08:07:21.708539Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-10-02T08:07:21.708576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:21.708581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.708584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:21.708766Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:21.709031Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:21.709039Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:21.709051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63'
2025-10-02T08:07:21.709054Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63'
2025-10-02T08:07:21.881578Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:21.882734Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:21.882745Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:21.883123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556532996322853003:2534]
2025-10-02T08:07:21.883143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:21.883169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 7 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0
2025-10-02T08:07:21.883390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0 is DEAD
2025-10-02T08:07:21.883871Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:21.885345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:21.885356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0] Write session will restart in 0.008802s
2025-10-02T08:07:21.885381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0] Write session: Do CDS request
2025-10-02T08:07:21.885389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:21.897928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:21.898254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:21.898387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:21.898391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-02T08:07:21.898686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:21.898713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:21.898717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:21.898719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:21.899206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:21.899474Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:21.899480Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:21.899494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:21.899570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:21.899628Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556532996322853084:2599]
2025-10-02T08:07:21.900401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:21.900790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-02T08:07:21.900839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:21.900841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:21.900842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:21.900848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556532996322853089:2601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:21.901429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556532996322853089:2601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:21.902378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:21.902444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:21.902834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:21.902886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.902895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.902897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.902899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.902900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.902910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.902920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.902924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.902927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.902932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.902938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.902946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:21.902956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.902964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:21.902971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.902981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:21.902985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.902990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.902999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.903004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.903022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:21.909896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556532996322853089:2601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:21.919044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:21.921561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:21.921585Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:21.921588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:21.921593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:21.921602Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 7 [1:7556532996322853084:2599]
2025-10-02T08:07:21.921619Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:21.921640Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:21.921644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:21.921648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:21.921650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.921670Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:21.921676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:21.921683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:21.921787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.921790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.921795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:21.921797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:21.921886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:21.921889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:21.921908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:21.921920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:21.921939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532996322853076:2599]
2025-10-02T08:07:21.921941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532996322853076:2599]
2025-10-02T08:07:21.921949Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:21.921967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:21.921984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:21.921988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:21.922027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556532996322853076:2599]
2025-10-02T08:07:21.922030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:21.922180Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:21.922182Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:21.922187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:21.926061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 7
2025-10-02T08:07:21.927127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556532996783325194:2378], now have 1 active actors on pipe
2025-10-02T08:07:21.929098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556532996322853089:2601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:21.929119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556532996322853089:2601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:21.929122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556532996322853089:2601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:21.929132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:21.930468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 7
2025-10-02T08:07:21.930494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532996322853138:2601], now have 1 active actors on pipe
2025-10-02T08:07:21.930727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.930741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.930772Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:21.930787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:21.930795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:21.930798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:21.930811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:21.930831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:21.930869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:21.930950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.930959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.930972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:21.931007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0
2025-10-02T08:07:21.932913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8a092d-d971f04c-c27bb3e2-71ca2ac6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:21.936242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0] Write session: try to update token
2025-10-02T08:07:21.936258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:21.984219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556532996322853156:2534]
2025-10-02T08:07:21.984300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:21.984685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 7, pipe: [1:7556532996322853156:2534]
2025-10-02T08:07:21.984718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556532996322853156:2534], now have 1 active actors on pipe
2025-10-02T08:07:21.984824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:21.984834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:21.984890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 11 count 7 size 524288 endOffset 17 max time lag 0ms effective offset 11
2025-10-02T08:07:21.984931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 6759616 count 6 last offset 14, current partition end offset: 17
2025-10-02T08:07:21.984935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-02T08:07:21.984945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556532996322853076:2599]
2025-10-02T08:07:21.984948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556532996322853076:2599]
2025-10-02T08:07:21.984962Z node 1 :PERSQUEUE DEBUG: read.h:68: [72075186224037892][PQCacheProxy]Read request is blocked. Partition 0 offset 10
2025-10-02T08:07:21.984967Z node 1 :PERSQUEUE DEBUG: read.h:137: [72075186224037892][PQCacheProxy]Reading cookie 4. There's another reading of the same blob. Waiting
2025-10-02T08:07:21.985003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:21.985006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:21.998918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:22.000274Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:22.000290Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:22.000294Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:22.000303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556532996322853076:2599]
2025-10-02T08:07:22.000321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556532996322853076:2599]
2025-10-02T08:07:22.000339Z node 1 :PERSQUEUE DEBUG: read.h:87: [72075186224037892][PQCacheProxy]Read requests are unblocked. Partition 0 offset 10 num unblocked 1
2025-10-02T08:07:22.000377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 3 count 4 parts_count 13 source 0 size 7476729 accessed 0 times before, last time 2025-10-02T08:07:22.000000Z
2025-10-02T08:07:22.000382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 3 parts_count 12 source 0 size 6759616 accessed 0 times before, last time 2025-10-02T08:07:22.000000Z
2025-10-02T08:07:22.000386Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-10-02T08:07:22.000405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:22.000411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.000413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:22.000759Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:22.000873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:22.000882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:22.000895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63'
2025-10-02T08:07:22.000900Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63'
2025-10-02T08:07:22.017426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:22.253174Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:22.253513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.253522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.257602Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:22.257130Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:22.257144Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:22.257416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556532996322853156:2534]
2025-10-02T08:07:22.257433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:22.257484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 8 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0
2025-10-02T08:07:22.257630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0 is DEAD
2025-10-02T08:07:22.257967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:22.257985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0] Write session will restart in 0.005955s
2025-10-02T08:07:22.258016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0] Write session: Do CDS request
2025-10-02T08:07:22.258023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:22.265486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:22.265971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:22.266008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:22.266015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-02T08:07:22.266460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:22.266491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:22.266495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:22.266499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:22.266565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:22.266745Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:22.266748Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:22.266755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:22.266789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:22.266833Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533000617820525:2606]
2025-10-02T08:07:22.267334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:22.267656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:22.267686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:22.267924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:22.267950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.267951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.267952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.267953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.267953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.267957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.267964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.267967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.267969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.267971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.267975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.267982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.267987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.267990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.267992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.267995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.267997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.268000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.268003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.268005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.268017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:22.268245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-02T08:07:22.268263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:22.268264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:22.268265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:22.268269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533000617820537:2608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:22.268681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533000617820537:2608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:22.272615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533000617820537:2608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:22.295884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533000617820537:2608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:22.295899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533000617820537:2608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:22.295903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533000617820537:2608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:22.295913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:22.297103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:22.299286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:22.299293Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:22.299295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:22.299299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:22.299308Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 8 [1:7556533000617820525:2606]
2025-10-02T08:07:22.299324Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:22.299350Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:22.299354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.299357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.299359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.299381Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:22.299387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:22.299393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:22.299479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.299482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.299484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:22.299489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:22.300547Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 8
2025-10-02T08:07:22.299564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:22.299580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.299611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.299623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:22.299644Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533000617820517:2606]
2025-10-02T08:07:22.299646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533000617820517:2606]
2025-10-02T08:07:22.299654Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:22.299670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:22.299685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:22.299689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:22.299730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533000617820517:2606]
2025-10-02T08:07:22.299732Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:22.299986Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:22.299990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:22.300284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:22.300772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533001078292509:2378], now have 1 active actors on pipe
2025-10-02T08:07:22.300889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 8
2025-10-02T08:07:22.300905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533000617820581:2608], now have 1 active actors on pipe
2025-10-02T08:07:22.301018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.301024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.301052Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:22.301061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.301066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.301068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:22.301081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.301094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:22.301111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:22.301184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.301186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.301209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:22.301242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 17 sessionId: src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0
2025-10-02T08:07:22.302388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9925b25-619f4c51-afe1efdc-6aab72e8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:22.305394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0] Write session: try to update token
2025-10-02T08:07:22.305420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:22.323069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:22.326414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:22.331398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.331420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.331466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:22.331502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:22.331726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.331735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.331941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.332018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.332100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.332175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.332227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.332231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.332304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.332409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.332613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.332856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.332915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.332922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.333017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.333094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.333178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.333263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.333321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.333325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.333575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.333658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.333741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.333825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.333891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.333895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.333996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.334074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.334152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.334232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.334289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.334292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.334392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.334473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.334554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.334712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.334768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.334771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.334871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.334949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.335033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.335116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.335177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.335180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.335279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.335369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.335455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.335536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.335595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.335598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.335735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.335814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.335891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.335976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.336041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.336044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.336137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.336206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.336276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.336366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.336466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.336468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.336532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:22.336600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.336619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.336622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:22.336662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:22.336681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:22.336685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:22.336688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:22.336690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:22.341502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:22.341575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:22.341592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:22.341598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:22.341602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:22.341609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:22.342257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:22.342273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:22.342281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:22.342285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:22.342289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:22.342292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:22.342959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:22.342979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:22.342985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:22.342990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:22.342994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:22.345056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:22.345078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:22.345092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392442343
2025-10-02T08:07:22.345241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:22.345252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:22.345258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:22.345261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:22.345266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:22.345270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:22.345887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:22.345901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:22.345906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:22.345911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:22.345915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:22.345920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:22.346545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:22.346558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:22.346565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:22.346571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:22.346575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:22.346581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:22.347346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:22.347359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:22.347365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:22.349534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:22.349557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:22.349565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:22.349570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:22.349583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392442349
2025-10-02T08:07:22.350123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:22.350141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:22.350149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:22.350153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:22.350157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:22.350162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:22.350955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:22.350971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:22.350978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:22.350983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:22.350986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:22.350990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:22.351643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:22.351654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.351789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392442349
2025-10-02T08:07:22.354213Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:22.354236Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:22.354243Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:22.354250Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:22.356776Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:22.356780Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:22.356782Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:22.356792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533000617820517:2606]
2025-10-02T08:07:22.356796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533000617820517:2606]
2025-10-02T08:07:22.356901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:22.356909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.356912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:22.357105Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:22.360931Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:22.360940Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:22.453376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533000617820624:2534]
2025-10-02T08:07:22.453457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:22.453637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 8, pipe: [1:7556533000617820624:2534]
2025-10-02T08:07:22.513045Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:22.513456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533000617820624:2534], now have 1 active actors on pipe
2025-10-02T08:07:22.513485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.513490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.513771Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:22.513781Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:22.514117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:22.514155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 9 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0
2025-10-02T08:07:22.514381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0 is DEAD
2025-10-02T08:07:22.514544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533000617820624:2534]
2025-10-02T08:07:22.514787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:22.514800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0] Write session will restart in 0.006153s
2025-10-02T08:07:22.514817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0] Write session: Do CDS request
2025-10-02T08:07:22.514822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:22.515274Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:22.522387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:22.523039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:22.523055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-02T08:07:22.523243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:22.523278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:22.523284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:22.523288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:22.523825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-02T08:07:22.523883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:22.523893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:22.523895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:22.523902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533000617820704:2626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:22.524485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533000617820704:2626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:22.525224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:22.525684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:22.525890Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:22.525901Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:22.525926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:22.525987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:22.526037Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533000617820735:2625]
2025-10-02T08:07:22.526678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:22.526930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533000617820704:2626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:22.526998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:22.527055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:22.527395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:22.527453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.527460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.527461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.527462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.527464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.527470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.527479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.527483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.527487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.527491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.527496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.527504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.527515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.527520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.527536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.527545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.527549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.527554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.527564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.527569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.527592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:22.531985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533000617820704:2626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:22.532001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533000617820704:2626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:22.532004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533000617820704:2626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:22.532014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:22.537507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:22.539119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:22.539137Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:22.539141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:22.539146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:22.539155Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 9 [1:7556533000617820735:2625]
2025-10-02T08:07:22.539172Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:22.539200Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:22.539208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.539212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.539214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.539236Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:22.539246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:22.539259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:22.539336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.539344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.539348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:22.539351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:22.539430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:22.539437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.539453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.539468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:22.539497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533000617820723:2625]
2025-10-02T08:07:22.539503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533000617820723:2625]
2025-10-02T08:07:22.539513Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:22.539533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:22.539537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:22.539540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:22.539545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 9
2025-10-02T08:07:22.539552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:22.539561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:22.539575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533000617820765:2626], now have 1 active actors on pipe
2025-10-02T08:07:22.539582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533001078292541:2378], now have 1 active actors on pipe
2025-10-02T08:07:22.539624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.539632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.539648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533000617820723:2625]
2025-10-02T08:07:22.539659Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:22.539669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:22.539694Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:22.539706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.539714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.539716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:22.539728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.539737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:22.539760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:22.540375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21daa94f-4adbfd88-becf3805-db6d78ca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:22.539829Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 9
2025-10-02T08:07:22.539840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.539848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.539861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:22.539896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 17 sessionId: src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0
2025-10-02T08:07:22.543412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0] Write session: try to update token
2025-10-02T08:07:22.543429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:22.568213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:22.568615Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:22.568618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:22.568620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:22.568630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533000617820723:2625]
2025-10-02T08:07:22.568634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533000617820723:2625]
2025-10-02T08:07:22.568679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:22.568685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.568687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:22.568833Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:22.568839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:22.568858Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:22.571028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:22.611556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533000617820778:2534]
2025-10-02T08:07:22.611660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:22.611835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 9, pipe: [1:7556533000617820778:2534]
2025-10-02T08:07:22.720703Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:22.721004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.721018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.721058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533000617820778:2534], now have 1 active actors on pipe
2025-10-02T08:07:22.721078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.721085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.721194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533000617820778:2534]
2025-10-02T08:07:22.721214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:22.721217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:22.721298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 10 reason: error at write: Disconnected sessionId: src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0
2025-10-02T08:07:22.721344Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:22.721348Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:22.721373Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:22.721518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0 is DEAD
2025-10-02T08:07:22.721697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:22.721707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0] Write session will restart in 0.009623s
2025-10-02T08:07:22.721732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0] Write session: Do CDS request
2025-10-02T08:07:22.721740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:22.726746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:22.728328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:22.728538Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:22.728547Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:22.728557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:22.728604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:22.728649Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533000617820854:2632]
2025-10-02T08:07:22.729359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:22.729885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:22.729969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:22.730365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:22.730443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.730451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.730455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.730456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.730458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.730463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.730474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.730478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.730482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.730485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.730490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.730498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.730505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.730510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.730523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.730531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.730542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.730549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.730555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.730564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.730586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:22.732972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:22.733266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:22.733284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 11
2025-10-02T08:07:22.733506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:22.733559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 11 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:22.733572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=11 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:22.733582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:22.734075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 11 sessionId:  describe result for acl check
2025-10-02T08:07:22.734115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:22.734122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:22.734124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:22.734129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533000617820870:2634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:22.734653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533000617820870:2634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:22.737110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533000617820870:2634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:22.740349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:22.740640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533000617820870:2634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:22.740653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533000617820870:2634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:22.740657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533000617820870:2634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:22.740666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 11 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:22.742310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:22.742325Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:22.742327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:22.742331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:22.742339Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 10 [1:7556533000617820854:2632]
2025-10-02T08:07:22.742352Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:22.742372Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:22.742376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.742380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.742387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.742405Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:22.742414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:22.742421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:22.742493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.742495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.742503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:22.742505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:22.742604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:22.742607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.742621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.742625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 10
2025-10-02T08:07:22.742632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:22.742652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533000617820901:2634], now have 1 active actors on pipe
2025-10-02T08:07:22.742655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533001078292549:2378], now have 1 active actors on pipe
2025-10-02T08:07:22.742660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.742665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.742685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533000617820848:2632]
2025-10-02T08:07:22.742687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533000617820848:2632]
2025-10-02T08:07:22.742702Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:22.742715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:22.742728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:22.742731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:22.742731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:22.742735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:22.742751Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:22.742758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.742763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.742765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:22.742774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.742789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:22.742826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533000617820848:2632]
2025-10-02T08:07:22.742840Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:22.742852Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:22.742856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:22.742902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.742905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.742919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:22.742956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 11 partition: 0 MaxSeqNo: 17 sessionId: src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0
2025-10-02T08:07:22.744047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed6e69-2d7bc3d-11ee7be4-6bb02c2a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:22.744894Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 10
2025-10-02T08:07:22.752279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0] Write session: try to update token
2025-10-02T08:07:22.752323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:22.768453Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:22.768474Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:22.768484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533000617820848:2632]
2025-10-02T08:07:22.768539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:22.768841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:22.768921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-02T08:07:22.768929Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:22.769067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:22.769306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:22.769521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:22.771133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:22.771186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:22.792447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId: src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:22.795693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:22.799944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.799970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.802105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:22.802154Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:22.802157Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:22.802159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:22.802173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533000617820848:2632]
2025-10-02T08:07:22.802178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533000617820848:2632]
2025-10-02T08:07:22.802243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:22.802245Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:22.802251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.802253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:22.802254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:22.802433Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:22.802437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:22.821470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533000617820920:2534]
2025-10-02T08:07:22.821544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:22.821698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 10, pipe: [1:7556533000617820920:2534]
2025-10-02T08:07:22.948949Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:22.949221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.949234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.949417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.949503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.949583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.949657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.949717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.949722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.949818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.949904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.949981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.950063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.950121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.950124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.950227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.950309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.950408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.950491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.950552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.950559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.950651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.950729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.950819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.950904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.950968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.950971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.951076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.951161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.951250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.951335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.951400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.951406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.951546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.951673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.951787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.951903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.951959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.951961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.952054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.952126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.952203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.952284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.952350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.952353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.952446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.952522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.952597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.952671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.952734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.952738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.953105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.953194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.954578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:22.954594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0] Write session will restart in 0.005868s
2025-10-02T08:07:22.954623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0] Write session: Do CDS request
2025-10-02T08:07:22.954630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:22.953284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.953371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.953430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.953434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.953526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:22.953598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:22.953677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:22.953762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:22.953821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:22.953824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:22.953882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533000617820920:2534], now have 1 active actors on pipe
2025-10-02T08:07:22.953901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.953906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.954026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533000617820920:2534]
2025-10-02T08:07:22.954048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:22.954050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:22.954076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 11 reason: error at write: Disconnected sessionId: src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0
2025-10-02T08:07:22.954240Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:22.954245Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:22.954274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 11 sessionId: src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0 is DEAD
2025-10-02T08:07:22.954895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:22.960420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:22.961578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:22.961209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:22.961425Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:22.961430Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:22.961438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:22.961483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:22.961526Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533000617821011:2640]
2025-10-02T08:07:22.962226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:22.962475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:22.962520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:22.962835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:22.962877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.962880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.962881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.962882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.962883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.962889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.962899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.962902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.962905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.962908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.962914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.962920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:22.962926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.962930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:22.962934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.962938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:22.962942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.962946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.962951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.962955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.962971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:22.965180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:22.965198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 12
2025-10-02T08:07:22.965414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:22.965448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 12 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:22.965455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=12 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:22.965462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:22.965929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 12 sessionId:  describe result for acl check
2025-10-02T08:07:22.965975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:22.965977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:22.965979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:22.965985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533000617821027:2642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:22.966558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533000617821027:2642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:22.969111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533000617821027:2642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:22.974051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533000617821027:2642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:22.974071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533000617821027:2642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:22.974075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533000617821027:2642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:22.974087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 12 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:22.977062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:22.978872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:22.978893Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:22.978897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:22.978901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:22.978910Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 11 [1:7556533000617821011:2640]
2025-10-02T08:07:22.978926Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:22.978951Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:22.978954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.978959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.978961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.978984Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:22.978990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:22.978997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:22.979075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.979077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.979081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:22.979084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:22.979167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:22.979170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:22.979187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:22.979199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:22.979219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533001078292570:2378], now have 1 active actors on pipe
2025-10-02T08:07:22.979226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533000617821004:2640]
2025-10-02T08:07:22.979227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533000617821004:2640]
2025-10-02T08:07:22.979235Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:22.979248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:22.979263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:22.979266Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:22.979267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:22.979269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:22.979308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533000617821055:2642], now have 1 active actors on pipe
2025-10-02T08:07:22.979310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533000617821004:2640]
2025-10-02T08:07:22.979313Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:22.979356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 11
2025-10-02T08:07:22.979437Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:22.979565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.979575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.979603Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:22.979610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:22.979614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:22.979616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:22.979626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:22.979636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:22.979655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:22.979898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 11
2025-10-02T08:07:22.980716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d563ced2-7bab527-b35e4d6f-f5debb3c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:22.984242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0] Write session: try to update token
2025-10-02T08:07:22.984261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:22.980123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:22.980134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:22.980161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:22.980200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 12 partition: 0 MaxSeqNo: 17 sessionId: src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0
2025-10-02T08:07:23.005774Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:23.005797Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:23.005800Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:23.005810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533000617821004:2640]
2025-10-02T08:07:23.005814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533000617821004:2640]
2025-10-02T08:07:23.005865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:23.005877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.005879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:23.006072Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:23.016988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:23.017009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:23.026667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId: src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:23.029674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1002 08:07:23.053015351  541003 chttp2_transport.cc:1143]             ipv4:127.0.0.1:25313: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T08:07:23.057090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533004912788365:2534]
2025-10-02T08:07:23.057186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:23.060921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 11, pipe: [1:7556533004912788365:2534]
2025-10-02T08:07:23.170044Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:23.170396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.170407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.170452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533004912788365:2534], now have 1 active actors on pipe
2025-10-02T08:07:23.170466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.170468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.173108Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:23.173027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:23.173038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:23.173118Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:23.173126Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:23.173150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 12 reason: error at write: Disconnected sessionId: src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0
2025-10-02T08:07:23.173394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 12 sessionId: src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0 is DEAD
2025-10-02T08:07:23.173508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533004912788365:2534]
2025-10-02T08:07:23.177174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:23.177187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0] Write session will restart in 0.008073s
2025-10-02T08:07:23.177211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0] Write session: Do CDS request
2025-10-02T08:07:23.177219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:23.179578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:23.179896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:23.180059Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:23.180063Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:23.180073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:23.180111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:23.180147Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533004912788442:2646]
2025-10-02T08:07:23.180854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:23.181072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:23.181122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:23.181444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:23.181495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.181496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.181497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.181498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.181499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.181504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.181510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.181512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.181514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.181516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.181521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.181526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.181530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.181533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.181538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.181543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.181548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.181588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.181593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.181599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.181611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:23.190521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:23.190474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:23.192834Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 12
2025-10-02T08:07:23.192420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:23.192427Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:23.192430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:23.192434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:23.192442Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 12 [1:7556533004912788442:2646]
2025-10-02T08:07:23.192456Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:23.192478Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:23.192481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:23.192484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:23.192487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:23.192501Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:23.192507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:23.192513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:23.192585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.192587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.192591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:23.192593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:23.192673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:23.192676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.192689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.192700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:23.192719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533005373259873:2378], now have 1 active actors on pipe
2025-10-02T08:07:23.192726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533004912788436:2646]
2025-10-02T08:07:23.192728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533004912788436:2646]
2025-10-02T08:07:23.192740Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:23.192753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:23.192756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:23.192766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:23.192769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:23.192769Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:23.192821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533004912788436:2646]
2025-10-02T08:07:23.192824Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:23.192847Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:23.192958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:23.192962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 13
2025-10-02T08:07:23.194049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:23.194093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 13 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:23.194098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=13 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:23.194101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:23.194487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 13 sessionId:  describe result for acl check
2025-10-02T08:07:23.194513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:23.194515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:23.194517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:23.194522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533004912788467:2648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:23.195072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533004912788467:2648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:23.198416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533004912788467:2648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:23.203889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533004912788467:2648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:23.203908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533004912788467:2648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:23.203912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533004912788467:2648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:23.203922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 13 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:23.204443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 12
2025-10-02T08:07:23.204529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533004912788500:2648], now have 1 active actors on pipe
2025-10-02T08:07:23.204537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.204544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.204563Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:23.204565Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:23.204572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533004912788436:2646]
2025-10-02T08:07:23.204606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:23.204622Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:23.204632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:23.204637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:23.204640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:23.204651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:23.204666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:23.204680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:23.204884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:23.206107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151fb3b9-c7f20939-6eb461e8-cf8ce189_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:23.205035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:23.205195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:23.205348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:23.205562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:23.205598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:23.205623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:23.205660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.205663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.205678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:23.205709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 13 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0
2025-10-02T08:07:23.209360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0] Write session: try to update token
2025-10-02T08:07:23.209379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:23.222653Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:23.222669Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:23.222672Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:23.222681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533004912788436:2646]
2025-10-02T08:07:23.222686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533004912788436:2646]
2025-10-02T08:07:23.222738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:23.222741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:23.222749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.222749Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:23.222751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:23.222941Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:23.251208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId: src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:23.254231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:23.273561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533004912788504:2534]
2025-10-02T08:07:23.273679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:23.273799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 12, pipe: [1:7556533004912788504:2534]
2025-10-02T08:07:23.375738Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:23.376123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.376138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.376166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533004912788504:2534], now have 1 active actors on pipe
2025-10-02T08:07:23.376184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.376196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.376845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:23.376459Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:23.376460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533004912788504:2534]
2025-10-02T08:07:23.376470Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:23.376488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:23.376569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 13 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0
2025-10-02T08:07:23.376826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 13 sessionId: src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0 is DEAD
2025-10-02T08:07:23.377254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:23.377264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0] Write session will restart in 0.009711s
2025-10-02T08:07:23.377286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0] Write session: Do CDS request
2025-10-02T08:07:23.377293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:23.389425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:23.389777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:23.389795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 14
2025-10-02T08:07:23.390235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:23.390480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:23.390520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 14 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:23.390527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=14 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:23.390530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:23.390668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:23.390882Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:23.390887Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:23.390899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:23.390949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:23.390992Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533004912788597:2653]
2025-10-02T08:07:23.391725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:23.392074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 14 sessionId:  describe result for acl check
2025-10-02T08:07:23.392102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:23.392104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:23.392106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:23.392111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533004912788605:2655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:23.392152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:23.392190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:23.392559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:23.392604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.392605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.392607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.392608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.392609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.392616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.392630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.392634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.392638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.392642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.392648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.392657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.392664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.392671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.392675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.392681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.392686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.392692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.392698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.392704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.392724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:23.393372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533004912788605:2655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:23.406714Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 13
2025-10-02T08:07:23.403828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:23.404097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533004912788605:2655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:23.406338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:23.406345Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:23.406348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:23.406353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:23.406361Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 13 [1:7556533004912788597:2653]
2025-10-02T08:07:23.406376Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:23.406396Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:23.406401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:23.406405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:23.406407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:23.406429Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:23.406437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:23.406446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:23.406535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.406537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.406540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:23.406543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:23.406634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:23.406637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.406653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.406667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:23.406694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533005373259882:2378], now have 1 active actors on pipe
2025-10-02T08:07:23.406703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533004912788591:2653]
2025-10-02T08:07:23.406705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533004912788591:2653]
2025-10-02T08:07:23.406715Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:23.406729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:23.406743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:23.406746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:23.406749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:23.406756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:23.406792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533004912788591:2653]
2025-10-02T08:07:23.406803Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:23.406826Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:23.408524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533004912788605:2655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:23.408540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533004912788605:2655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:23.408544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533004912788605:2655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:23.408559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 14 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:23.409258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 13
2025-10-02T08:07:23.409276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533004912788651:2655], now have 1 active actors on pipe
2025-10-02T08:07:23.409283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.409290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.409335Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31df146a-edaf0c95-32ece78e-24bc442f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:23.409348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:23.409353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:23.409356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:23.409376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:23.409396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:23.409414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:23.409928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.409937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.409959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:23.409999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 14 partition: 0 MaxSeqNo: 17 sessionId: src_id|31df146a-edaf0c95-32ece78e-24bc442f_0
2025-10-02T08:07:23.413224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6edfc0-92fc3f0d-5d7aa9ec-361d1742_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|31df146a-edaf0c95-32ece78e-24bc442f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:23.416692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31df146a-edaf0c95-32ece78e-24bc442f_0] Write session: try to update token
2025-10-02T08:07:23.416715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31df146a-edaf0c95-32ece78e-24bc442f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:23.429578Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:23.429596Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:23.429598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:23.429605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533004912788591:2653]
2025-10-02T08:07:23.429610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533004912788591:2653]
2025-10-02T08:07:23.429651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:23.429657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.429658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:23.429825Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:23.429833Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:23.430474Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:23.448958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId: src_id|31df146a-edaf0c95-32ece78e-24bc442f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:23.451843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:23.499763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533004912788671:2534]
2025-10-02T08:07:23.499849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:23.502927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 13, pipe: [1:7556533004912788671:2534]
2025-10-02T08:07:23.598453Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:23.598885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.598903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.598929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533004912788671:2534], now have 1 active actors on pipe
2025-10-02T08:07:23.598945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.598947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.599713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:23.599724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:23.599795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 14 reason: error at write: Disconnected sessionId: src_id|31df146a-edaf0c95-32ece78e-24bc442f_0
2025-10-02T08:07:23.600041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 14 sessionId: src_id|31df146a-edaf0c95-32ece78e-24bc442f_0 is DEAD
2025-10-02T08:07:23.600320Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:23.600333Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:23.600629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533004912788671:2534]
2025-10-02T08:07:23.600896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31df146a-edaf0c95-32ece78e-24bc442f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:23.600910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31df146a-edaf0c95-32ece78e-24bc442f_0] Write session will restart in 0.005257s
2025-10-02T08:07:23.600933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31df146a-edaf0c95-32ece78e-24bc442f_0] Write session: Do CDS request
2025-10-02T08:07:23.600941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31df146a-edaf0c95-32ece78e-24bc442f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:23.600905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:23.609193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:23.609211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 15
2025-10-02T08:07:23.609748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31df146a-edaf0c95-32ece78e-24bc442f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:23.613192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:23.613248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 15 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:23.613255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=15 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:23.613261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:23.617281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 15 sessionId:  describe result for acl check
2025-10-02T08:07:23.617330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:23.617331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:23.617333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:23.617340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533004912788770:2672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:23.618022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:23.618170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533004912788770:2672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:23.621642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:23.621927Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:23.621932Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:23.621945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:23.622014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:23.622058Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533004912788787:2671]
2025-10-02T08:07:23.622750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:23.623294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:23.623380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:23.623758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:23.623812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.623813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.623814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.623815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.623817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.623822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.623832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.623835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.623839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.623842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.623849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.623856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.623862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.623867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.623871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.623876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.623880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.623884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.623889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.623893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.623911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:23.625073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533004912788770:2672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:23.638781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:23.640566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:23.640576Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:23.640580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:23.640585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:23.640596Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 14 [1:7556533004912788787:2671]
2025-10-02T08:07:23.640615Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:23.640639Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:23.640642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:23.640647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:23.640649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:23.640672Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:23.640678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:23.640688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:23.640776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.640780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.640784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:23.640787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:23.641028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533004912788770:2672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:23.641047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533004912788770:2672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:23.641051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533004912788770:2672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:23.641062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 15 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:23.645265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:23.645277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.645300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.645312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:23.645340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533004912788772:2671]
2025-10-02T08:07:23.645342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533004912788772:2671]
2025-10-02T08:07:23.645352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:23.645376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:23.645393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:23.645397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:23.645453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533004912788772:2671]
2025-10-02T08:07:23.645455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:23.645548Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:23.645551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:23.645557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:23.647509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 14
2025-10-02T08:07:23.647540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533004912788822:2672], now have 1 active actors on pipe
2025-10-02T08:07:23.647548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533005373259912:2378], now have 1 active actors on pipe
2025-10-02T08:07:23.647863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 14
2025-10-02T08:07:23.647784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.647795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.647838Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f736441-e9e590e6-a4159853-aa04595e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:23.647853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:23.647859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:23.647862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:23.647880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:23.647900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:23.647925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:23.648642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31df146a-edaf0c95-32ece78e-24bc442f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6f736441-e9e590e6-a4159853-aa04595e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:23.648077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.648082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.648106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:23.648140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 15 partition: 0 MaxSeqNo: 17 sessionId: src_id|6f736441-e9e590e6-a4159853-aa04595e_0
2025-10-02T08:07:23.652046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f736441-e9e590e6-a4159853-aa04595e_0] Write session: try to update token
2025-10-02T08:07:23.652064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f736441-e9e590e6-a4159853-aa04595e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:23.671271Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:23.671288Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:23.671300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533004912788772:2671]
2025-10-02T08:07:23.671348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:23.671518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:23.671655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:23.671818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:23.671966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:23.672159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:23.672195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:23.672462Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:23.703683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533004912788840:2534]
2025-10-02T08:07:23.703775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:23.705120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 14, pipe: [1:7556533004912788840:2534]
2025-10-02T08:07:23.705149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533004912788840:2534], now have 1 active actors on pipe
2025-10-02T08:07:23.705256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.705266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.705327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 11 count 7 size 524288 endOffset 17 max time lag 0ms effective offset 11
2025-10-02T08:07:23.705371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 6759616 count 6 last offset 14, current partition end offset: 17
2025-10-02T08:07:23.705375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-02T08:07:23.705389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533004912788772:2671]
2025-10-02T08:07:23.705391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533004912788772:2671]
2025-10-02T08:07:23.705403Z node 1 :PERSQUEUE DEBUG: read.h:68: [72075186224037892][PQCacheProxy]Read request is blocked. Partition 0 offset 10
2025-10-02T08:07:23.705409Z node 1 :PERSQUEUE DEBUG: read.h:137: [72075186224037892][PQCacheProxy]Reading cookie 4. There's another reading of the same blob. Waiting
2025-10-02T08:07:23.705501Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:23.705506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:23.710732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId: src_id|6f736441-e9e590e6-a4159853-aa04595e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:23.713769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:23.716033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.716049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.733492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:23.733527Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:23.733530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:23.733534Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:23.733547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533004912788772:2671]
2025-10-02T08:07:23.733551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533004912788772:2671]
2025-10-02T08:07:23.733569Z node 1 :PERSQUEUE DEBUG: read.h:87: [72075186224037892][PQCacheProxy]Read requests are unblocked. Partition 0 offset 10 num unblocked 1
2025-10-02T08:07:23.733615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 3 count 4 parts_count 13 source 0 size 7476729 accessed 0 times before, last time 2025-10-02T08:07:23.000000Z
2025-10-02T08:07:23.733619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 3 parts_count 12 source 0 size 6759616 accessed 0 times before, last time 2025-10-02T08:07:23.000000Z
2025-10-02T08:07:23.733625Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 2 blobs are from cache.
2025-10-02T08:07:23.733647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:23.733657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.733660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:23.733827Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:23.736868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:23.737164Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:23.737174Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:23.737188Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63'
2025-10-02T08:07:23.737191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63'
2025-10-02T08:07:23.961415Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:23.962750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:23.962767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:23.962968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.963031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.963102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.963166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.963211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.963217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.963286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.963344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.963404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.963468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.963511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.963515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.963583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.963644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.963705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.963766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.963810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.963814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.963881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.963940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.963999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.964060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.964103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.964106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.964185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.964250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.964334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.964403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.964470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.964473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.964545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.964608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.964680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.964747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.964793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.964796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.964892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.964954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.965021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.965090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.965137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.965140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.965219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.965277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.965342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.965413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.965461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.965464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.965540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.965601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.965668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.965734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.965782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.965785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.965870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:23.965935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:23.966001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:23.966068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:23.966136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:23.966139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:23.966455Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:23.969075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f736441-e9e590e6-a4159853-aa04595e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:23.969088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f736441-e9e590e6-a4159853-aa04595e_0] Write session will restart in 0.009936s
2025-10-02T08:07:23.969112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f736441-e9e590e6-a4159853-aa04595e_0] Write session: Do CDS request
2025-10-02T08:07:23.969119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f736441-e9e590e6-a4159853-aa04595e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:23.967699Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:23.967710Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:23.968136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533004912788840:2534]
2025-10-02T08:07:23.968162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:23.968184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 15 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f736441-e9e590e6-a4159853-aa04595e_0
2025-10-02T08:07:23.968449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 15 sessionId: src_id|6f736441-e9e590e6-a4159853-aa04595e_0 is DEAD
2025-10-02T08:07:23.979112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:23.980232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:23.980492Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:23.980497Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:23.980507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:23.980568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:23.980607Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533004912788939:2679]
2025-10-02T08:07:23.981370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f736441-e9e590e6-a4159853-aa04595e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:23.981491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:23.981722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:23.981736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 16
2025-10-02T08:07:23.981746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:23.981786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:23.981896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:23.981926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 16 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:23.981932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=16 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:23.981935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:23.982111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:23.982171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.982178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.982179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.982181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.982182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.982187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.982197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.982201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.982205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.982208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.982214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.982222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:23.982227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.982233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:23.982237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.982243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:23.982248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.982253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:23.982257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.982262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:23.982281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:23.982441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 16 sessionId:  describe result for acl check
2025-10-02T08:07:23.982471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:23.982473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:23.982475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:23.982480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533004912788953:2681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:23.983056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533004912788953:2681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:23.995128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533004912788953:2681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:23.999495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:24.001165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:24.001184Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:24.001188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:24.001194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:24.001203Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 15 [1:7556533004912788939:2679]
2025-10-02T08:07:24.001218Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:24.001243Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:24.001246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.001250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.001252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.001275Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:24.001283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:24.001300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:24.001377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.001380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.001387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:24.001390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:24.001474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:24.001477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.001496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.001510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:24.001531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533004912788932:2679]
2025-10-02T08:07:24.001534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533004912788932:2679]
2025-10-02T08:07:24.001543Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:24.001558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:24.001574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:24.001578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:24.001590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533005373259934:2378], now have 1 active actors on pipe
2025-10-02T08:07:24.001630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533004912788932:2679]
2025-10-02T08:07:24.001632Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:24.001723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:24.001726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:24.001734Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:24.001854Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 15
2025-10-02T08:07:24.004479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533004912788953:2681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:24.004496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533004912788953:2681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:24.004500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533004912788953:2681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:24.004513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 16 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:24.008484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 15
2025-10-02T08:07:24.008511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533009207756288:2681], now have 1 active actors on pipe
2025-10-02T08:07:24.008636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.008648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.008689Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5af03843-fee831b3-769e7a53-66c719d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:24.008705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.008711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.008713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:24.008730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.008750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:24.008779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:24.008947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.008952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.008968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:24.009003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 16 partition: 0 MaxSeqNo: 17 sessionId: src_id|5af03843-fee831b3-769e7a53-66c719d9_0
2025-10-02T08:07:24.009614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f736441-e9e590e6-a4159853-aa04595e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5af03843-fee831b3-769e7a53-66c719d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:24.012514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af03843-fee831b3-769e7a53-66c719d9_0] Write session: try to update token
2025-10-02T08:07:24.012533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af03843-fee831b3-769e7a53-66c719d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:24.040721Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:24.040742Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:24.040745Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:24.040760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533004912788932:2679]
2025-10-02T08:07:24.040764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533004912788932:2679]
2025-10-02T08:07:24.040837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:24.040846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.040852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:24.041038Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:24.045134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:24.045147Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:24.047610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId: src_id|5af03843-fee831b3-769e7a53-66c719d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:24.050452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:24.066176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533009207756295:2534]
2025-10-02T08:07:24.066278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:24.074351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 15, pipe: [1:7556533009207756295:2534]
2025-10-02T08:07:24.311854Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:24.312164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.312180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.312206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533009207756295:2534], now have 1 active actors on pipe
2025-10-02T08:07:24.312247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.312250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.313317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533009207756295:2534]
2025-10-02T08:07:24.313504Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:24.313511Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:24.313847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:24.314013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 16 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5af03843-fee831b3-769e7a53-66c719d9_0
2025-10-02T08:07:24.314108Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:24.314652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af03843-fee831b3-769e7a53-66c719d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:24.314664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af03843-fee831b3-769e7a53-66c719d9_0] Write session will restart in 0.007185s
2025-10-02T08:07:24.314682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af03843-fee831b3-769e7a53-66c719d9_0] Write session: Do CDS request
2025-10-02T08:07:24.314687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af03843-fee831b3-769e7a53-66c719d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:24.314283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 16 sessionId: src_id|5af03843-fee831b3-769e7a53-66c719d9_0 is DEAD
2025-10-02T08:07:24.323942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af03843-fee831b3-769e7a53-66c719d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:24.326084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:24.326102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 17
2025-10-02T08:07:24.327098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:24.327171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 17 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:24.327178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=17 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:24.327183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:24.328393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 17 sessionId:  describe result for acl check
2025-10-02T08:07:24.328433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:24.328436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:24.328437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:24.328443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533009207756361:2687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:24.329278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533009207756361:2687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:24.330847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:24.331560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:24.331795Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:24.331806Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:24.331819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:24.331881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:24.331933Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533009207756405:2686]
2025-10-02T08:07:24.332677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:24.332983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:24.333039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:24.333117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533009207756361:2687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:24.333393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:24.333442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.333443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.333445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.333446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.333447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.333455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.333465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.333469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.333472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.333476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.333481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.333490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.333495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.333499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.333505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.333510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.333514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.333519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.333524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.333529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.333549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:24.344691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:24.346659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:24.346677Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:24.346681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:24.346685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:24.346694Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 16 [1:7556533009207756405:2686]
2025-10-02T08:07:24.346710Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:24.346734Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:24.346737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.346742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.346744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.346767Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:24.346773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:24.346780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:24.347482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533009207756361:2687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:24.347503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533009207756361:2687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:24.347506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533009207756361:2687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:24.347517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 17 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:24.347650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.347655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.347659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:24.347662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:24.347746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:24.347749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.347763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.347771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:24.347790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533009207756390:2686]
2025-10-02T08:07:24.347792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533009207756390:2686]
2025-10-02T08:07:24.347799Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:24.347816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:24.347826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:24.347828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:24.347837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:24.347841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:24.347871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533009668227240:2378], now have 1 active actors on pipe
2025-10-02T08:07:24.347874Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533009207756390:2686]
2025-10-02T08:07:24.347877Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:24.348024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:24.348171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 16
2025-10-02T08:07:24.348187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533009207756436:2687], now have 1 active actors on pipe
2025-10-02T08:07:24.348195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.348201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.348232Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:24.348242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.348248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.348251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:24.348262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.348277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:24.348295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:24.348340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.348342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.348356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:24.348381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 17 partition: 0 MaxSeqNo: 17 sessionId: src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0
2025-10-02T08:07:24.348911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af03843-fee831b3-769e7a53-66c719d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:24.351848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0] Write session: try to update token
2025-10-02T08:07:24.351874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:24.350011Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 16
2025-10-02T08:07:24.381861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId: src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:24.384862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:24.386070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.386098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.386157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:24.386198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:24.386975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.387016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.387250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.387345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.387525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.387678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.387758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.387765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.387904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.388380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.388561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.388741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.388833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.388838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.388986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.389158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.389320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.389498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.389583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.389587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.389777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.389957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.390128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.390289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.390375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.390379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.390521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.390688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.390798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.390877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.390923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.390926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.391009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.391075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.391143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.391210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.391257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.391260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.391354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.391413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.391476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.391547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.391590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.391593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.391671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.391734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.391805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.391889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.391977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.391981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.392105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.392213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.392335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.392405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.392451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.392454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.392530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:24.392596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:24.392661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:24.392728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:24.392790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:24.392797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:24.393245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:24.393331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.393352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.393355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:24.393403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:24.393419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:24.393422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:24.393425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:24.393428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:24.393897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:24.393919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:24.393927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:24.393931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:24.393934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:24.393937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:24.394534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:24.394551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:24.394559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:24.394563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:24.394566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:24.394570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:24.395153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:24.395181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:24.395187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:24.395191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:24.395194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:24.396585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:24.396606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:24.396621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392444393
2025-10-02T08:07:24.396738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:24.396754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:24.396760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:24.396764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:24.396773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:24.396776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:24.397283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:24.397306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:24.397312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:24.397315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:24.397319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:24.397325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:24.397874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:24.397888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:24.397896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:24.397899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:24.397904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:24.397907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:24.398433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:24.398455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:24.398461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:24.399654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:24.399662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:24.399668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:24.399672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:24.399683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392444398
2025-10-02T08:07:24.400030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:24.400042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:24.400049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:24.400053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:24.400057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:24.400062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:24.400638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:24.400655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:24.400664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:24.400668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:24.400671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:24.400677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:24.401539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:24.401563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.401692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392444398
2025-10-02T08:07:24.404278Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:24.404312Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:24.404319Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:24.404326Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:24.404339Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:24.404342Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:24.404345Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:24.404354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533009207756390:2686]
2025-10-02T08:07:24.404358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533009207756390:2686]
2025-10-02T08:07:24.404439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:24.404439Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:24.404444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:24.404443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.404446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:24.404586Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:24.416889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533009207756457:2534]
2025-10-02T08:07:24.416987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:24.417275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 16, pipe: [1:7556533009207756457:2534]
2025-10-02T08:07:24.582364Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:24.582664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533009207756457:2534], now have 1 active actors on pipe
2025-10-02T08:07:24.582688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.582696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.583001Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:24.583010Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:24.583292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:24.583316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 17 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0
2025-10-02T08:07:24.583519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 17 sessionId: src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0 is DEAD
2025-10-02T08:07:24.583649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533009207756457:2534]
2025-10-02T08:07:24.583703Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:24.584059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:24.584075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0] Write session will restart in 0.009874s
2025-10-02T08:07:24.584106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0] Write session: Do CDS request
2025-10-02T08:07:24.584112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:24.593329Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:16:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:24.593427Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [1d5b66c3e041809e] Result# TEvPutResult {Id# [72075186224037892:16:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:24.593648Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [b1b193c93293ab18] Result# TEvPutResult {Id# [72075186224037892:16:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:24.593699Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:16:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:24.594066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:24.595833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:24.596073Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:24.596083Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:24.596096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:24.597575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:24.598224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:24.598237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 18
2025-10-02T08:07:24.598467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:24.598500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 18 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:24.598507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=18 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:24.598525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:24.599053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 18 sessionId:  describe result for acl check
2025-10-02T08:07:24.599064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:24.599092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:24.599094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:24.599097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:24.599103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533009207756593:2708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:24.599121Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533009207756589:2704]
2025-10-02T08:07:24.599698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533009207756593:2708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:24.599904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:24.600278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:24.600367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:24.600743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:24.600836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.600844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.600845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.600846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.600847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.600854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.600864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.600867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.600871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.600875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.600883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.600891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.600897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.600902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.600906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.600910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.600914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.600919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.600924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.600929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.600947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:24.606691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533009207756593:2708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:24.613555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533009207756593:2708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:24.613571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533009207756593:2708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:24.613575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533009207756593:2708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:24.613594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 18 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:24.614160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:24.615893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:24.615911Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:24.615915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:24.615919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:24.615928Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 17 [1:7556533009207756589:2704]
2025-10-02T08:07:24.615943Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:24.615967Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:24.615970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.615974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.615984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.616003Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:24.616015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:24.616024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:24.616106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.616116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.616119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:24.616123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:24.616198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:24.616201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.616214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.616221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:24.616239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533009207756583:2704]
2025-10-02T08:07:24.616240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533009207756583:2704]
2025-10-02T08:07:24.616251Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:24.616263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:24.616277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:24.616286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:24.616340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533009207756583:2704]
2025-10-02T08:07:24.616348Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:24.616368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:24.616372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:24.616379Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:24.616539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533009668227261:2378], now have 1 active actors on pipe
2025-10-02T08:07:24.616542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533009207756633:2708], now have 1 active actors on pipe
2025-10-02T08:07:24.616558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 17
2025-10-02T08:07:24.616776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.616779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.616820Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:24.616828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.616832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.616834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:24.616844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.616852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:24.616866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:24.616990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.616996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.617019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:24.617056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 18 partition: 0 MaxSeqNo: 17 sessionId: src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0
2025-10-02T08:07:24.620934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a567bb-3b84f9fc-86e8b669-f952da93_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:24.618164Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 17
2025-10-02T08:07:24.624233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0] Write session: try to update token
2025-10-02T08:07:24.624254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:24.641224Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:24.641242Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:24.641245Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:24.641257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533009207756583:2704]
2025-10-02T08:07:24.641263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533009207756583:2704]
2025-10-02T08:07:24.641312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:24.641321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.641323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:24.641478Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:24.644868Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:24.644891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:24.649056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId: src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:24.651721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:24.683685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533009207756649:2534]
2025-10-02T08:07:24.683774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:24.684254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 17, pipe: [1:7556533009207756649:2534]
2025-10-02T08:07:24.809720Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:24.810052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.810064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.810089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533009207756649:2534], now have 1 active actors on pipe
2025-10-02T08:07:24.810105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.810107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.810892Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:24.811143Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:24.811158Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:24.811491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533009207756649:2534]
2025-10-02T08:07:24.811513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:24.811567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 18 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0
2025-10-02T08:07:24.811754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 18 sessionId: src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0 is DEAD
2025-10-02T08:07:24.814741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:24.814755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0] Write session will restart in 0.006861s
2025-10-02T08:07:24.814779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0] Write session: Do CDS request
2025-10-02T08:07:24.814786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:24.823954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:24.824049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:24.824067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 19
2025-10-02T08:07:24.824197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:24.824230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 19 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:24.824240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=19 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:24.824247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:24.824690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 19 sessionId:  describe result for acl check
2025-10-02T08:07:24.824723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:24.824730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:24.824731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:24.824738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533009207756721:2714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:24.825335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533009207756721:2714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:24.830827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:24.831408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:24.831605Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:24.831617Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:24.831629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:24.831677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:24.831716Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533009207756759:2713]
2025-10-02T08:07:24.832372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:24.832766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:24.832854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:24.832936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533009207756721:2714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:24.833270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:24.833325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.833331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.833335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.833335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.833336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.833341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.833348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.833351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.833353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.833355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.833360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.833365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:24.833369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.833373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:24.833376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.833379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:24.833382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.833385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.833388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.833392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.833404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:24.840348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533009207756721:2714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:24.840375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533009207756721:2714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:24.840380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533009207756721:2714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:24.840397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 19 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:24.844216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:24.845782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:24.845801Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:24.845804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:24.845809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:24.845817Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 18 [1:7556533009207756759:2713]
2025-10-02T08:07:24.845833Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:24.845855Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:24.845859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.845866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.845868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.845890Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:24.845897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:24.845905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:24.845975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.845983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.845986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:24.845989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:24.846071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:24.846079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.846093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:24.846106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:24.846128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533009207756748:2713]
2025-10-02T08:07:24.846130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533009207756748:2713]
2025-10-02T08:07:24.846138Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:24.846146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 18
2025-10-02T08:07:24.846154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533009207756786:2714], now have 1 active actors on pipe
2025-10-02T08:07:24.846161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533009668227278:2378], now have 1 active actors on pipe
2025-10-02T08:07:24.846165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:24.846167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:24.846169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:24.846182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:24.846186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:24.846203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.846212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.846217Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 18
2025-10-02T08:07:24.846277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533009207756748:2713]
2025-10-02T08:07:24.846285Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:24.846301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:24.846303Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:24.846311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:24.846315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:24.846317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:24.846328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:24.846342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:24.846390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:24.846493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:24.846500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:24.846514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:24.846551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 19 partition: 0 MaxSeqNo: 17 sessionId: src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0
2025-10-02T08:07:24.849061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d49b243e-c060c54a-7793ad65-8ff8447c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:24.852010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0] Write session: try to update token
2025-10-02T08:07:24.852027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:24.868169Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:24.868190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:24.868192Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:24.868202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533009207756748:2713]
2025-10-02T08:07:24.868207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533009207756748:2713]
2025-10-02T08:07:24.868258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:24.868260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:24.868265Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:24.868265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:24.868268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:24.868414Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:24.875758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId: src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:24.878379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:24.912987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533009207756800:2534]
2025-10-02T08:07:24.913086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:24.913216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 18, pipe: [1:7556533009207756800:2534]
2025-10-02T08:07:25.027993Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:25.028388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.028401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.028432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533009207756800:2534], now have 1 active actors on pipe
2025-10-02T08:07:25.028451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.028453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.029216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533009207756800:2534]
2025-10-02T08:07:25.029247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:25.029249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:25.029293Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.029303Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.029333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 19 reason: error at write: Disconnected sessionId: src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0
2025-10-02T08:07:25.029603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 19 sessionId: src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0 is DEAD
2025-10-02T08:07:25.031371Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:25.033067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:25.033080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0] Write session will restart in 0.009141s
2025-10-02T08:07:25.033105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0] Write session: Do CDS request
2025-10-02T08:07:25.033113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:25.045294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.045673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:25.045691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 20
2025-10-02T08:07:25.048947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.049001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 20 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:25.049008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=20 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:25.049012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:25.049643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 20 sessionId:  describe result for acl check
2025-10-02T08:07:25.049677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:25.049686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:25.049688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:25.049694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533013502724187:2721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:25.050211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533013502724187:2721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:25.051969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:25.052755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:25.053005Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:25.053019Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:25.053030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:25.053080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:25.053122Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533013502724214:2720]
2025-10-02T08:07:25.053819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:25.054140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:25.054217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:25.054501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533013502724187:2721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:25.054617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:25.054676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.054677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.054679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.054680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.054681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.054688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.054697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.054701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.054704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.054708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.054714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.054722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.054728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.054733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.054737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.054742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.054746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.054751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.054755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.054760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.054780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:25.061099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533013502724187:2721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:25.061119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533013502724187:2721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:25.061123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533013502724187:2721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:25.061142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 20 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:25.064432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:25.066303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:25.066321Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:25.066323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:25.066327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:25.066335Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 19 [1:7556533013502724214:2720]
2025-10-02T08:07:25.066350Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:25.066369Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:25.066371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.066374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.066376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.066391Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:25.066395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:25.066401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:25.066457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.066463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.066466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:25.066467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:25.066529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:25.066535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.066545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.066552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:25.066567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533013502724202:2720]
2025-10-02T08:07:25.066572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533013502724202:2720]
2025-10-02T08:07:25.066577Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:25.066588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:25.066600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:25.066602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:25.066608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:25.066611Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:25.066628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 19
2025-10-02T08:07:25.066638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724245:2721], now have 1 active actors on pipe
2025-10-02T08:07:25.066642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533013963194593:2378], now have 1 active actors on pipe
2025-10-02T08:07:25.066644Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533013502724202:2720]
2025-10-02T08:07:25.066649Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:25.066655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.066655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:25.066662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.066697Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:25.066709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.066713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.066715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:25.066724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.066732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:25.066751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.066712Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 19
2025-10-02T08:07:25.066794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.066800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.066810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.066867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 20 partition: 0 MaxSeqNo: 17 sessionId: src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0
2025-10-02T08:07:25.068994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad9e931-14dd38ae-d7386f29-8777c58c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:25.071698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0] Write session: try to update token
2025-10-02T08:07:25.071721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:25.086120Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:25.086140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:25.086143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:25.086152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533013502724202:2720]
2025-10-02T08:07:25.086157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533013502724202:2720]
2025-10-02T08:07:25.086204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:25.086209Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:25.086215Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:25.086218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.086220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:25.086379Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:25.089878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId: src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:25.093065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:25.129044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533013502724259:2534]
2025-10-02T08:07:25.129144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:25.129284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 19, pipe: [1:7556533013502724259:2534]
2025-10-02T08:07:25.231574Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:25.231882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.231901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.231954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724259:2534], now have 1 active actors on pipe
2025-10-02T08:07:25.231975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.231977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.232145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533013502724259:2534]
2025-10-02T08:07:25.232187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:25.232190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:25.232207Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.232221Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.232256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:25.232290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 20 reason: error at write: Disconnected sessionId: src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0
2025-10-02T08:07:25.232489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 20 sessionId: src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0 is DEAD
2025-10-02T08:07:25.232741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:25.232752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0] Write session will restart in 0.008450s
2025-10-02T08:07:25.232773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0] Write session: Do CDS request
2025-10-02T08:07:25.232779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:25.237651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:25.237951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:25.238271Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:25.238288Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:25.238315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:25.238464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:25.238522Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533013502724352:2726]
2025-10-02T08:07:25.239168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:25.239390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:25.239429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:25.239653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:25.239686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.239689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.239690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.239691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.239692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.239696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.239703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.239706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.239708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.239710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.239714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.239719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.239724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.239728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.239732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.239737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.239741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.239746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.239751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.239756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.239770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:25.242451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.242575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:25.242586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 21
2025-10-02T08:07:25.242788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.242819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 21 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:25.242825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=21 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:25.242829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:25.243248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 21 sessionId:  describe result for acl check
2025-10-02T08:07:25.243282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:25.243288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:25.243289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:25.243295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533013502724368:2728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:25.243848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533013502724368:2728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:25.246364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533013502724368:2728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:25.248371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:25.249407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533013502724368:2728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:25.249420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533013502724368:2728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:25.249423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533013502724368:2728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:25.249429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 21 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:25.250104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:25.250124Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:25.250126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:25.250130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:25.250135Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 20 [1:7556533013502724352:2726]
2025-10-02T08:07:25.250144Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:25.250160Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:25.250162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.250167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.250169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.250182Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:25.250185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:25.250191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:25.250239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.250246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.250248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:25.250250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:25.250339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:25.250350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.250353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 20
2025-10-02T08:07:25.250362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.250373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:25.250398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724399:2728], now have 1 active actors on pipe
2025-10-02T08:07:25.250406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533013963194600:2378], now have 1 active actors on pipe
2025-10-02T08:07:25.250411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.250415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.250432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533013502724346:2726]
2025-10-02T08:07:25.250440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533013502724346:2726]
2025-10-02T08:07:25.250455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:25.250447Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 20
2025-10-02T08:07:25.250472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:25.250487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:25.250490Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:25.250491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:25.250495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:25.250510Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:25.250519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.250522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.250524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:25.250534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.250543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:25.250578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533013502724346:2726]
2025-10-02T08:07:25.250593Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:25.250608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:25.250621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.250680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.250689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.250703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.250745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 21 partition: 0 MaxSeqNo: 17 sessionId: src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0
2025-10-02T08:07:25.251152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6963e2d7-baf37e8f-e7ae4cf3-1d937394_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:25.254261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0] Write session: try to update token
2025-10-02T08:07:25.254280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:25.268916Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:25.268929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:25.268931Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:25.268937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533013502724346:2726]
2025-10-02T08:07:25.268940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533013502724346:2726]
2025-10-02T08:07:25.268990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:25.268995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.268994Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:25.268996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:25.269011Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:25.269139Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:25.270886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId: src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:25.273870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:25.332323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533013502724419:2534]
2025-10-02T08:07:25.332421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:25.332527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 20, pipe: [1:7556533013502724419:2534]
2025-10-02T08:07:25.416893Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:25.417212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.417227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.417278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724419:2534], now have 1 active actors on pipe
2025-10-02T08:07:25.417444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.417450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.417712Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.417726Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.418024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:25.418095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 21 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0
2025-10-02T08:07:25.418295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 21 sessionId: src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0 is DEAD
2025-10-02T08:07:25.418495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533013502724419:2534]
2025-10-02T08:07:25.418843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:25.418855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0] Write session will restart in 0.009719s
2025-10-02T08:07:25.418878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0] Write session: Do CDS request
2025-10-02T08:07:25.418885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:25.418224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:25.426140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:25.426836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:25.427040Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:25.427044Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:25.427053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:25.427101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:25.427153Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533013502724517:2733]
2025-10-02T08:07:25.427855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:25.428068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:25.428106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:25.428467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:25.428517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.428518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.428519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.428520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.428521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.428526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.428534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.428537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.428541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.428544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.428549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.428556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.428562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.428566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.428571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.428575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.428579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.428584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.428588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.428596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.428613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:25.430033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.430440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:25.430454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 22
2025-10-02T08:07:25.430622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.430651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 22 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:25.430658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=22 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:25.430661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:25.431083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 22 sessionId:  describe result for acl check
2025-10-02T08:07:25.431115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:25.431117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:25.431120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:25.431126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533013502724533:2735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:25.431685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533013502724533:2735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:25.434213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533013502724533:2735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:25.438123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533013502724533:2735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:25.438128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:25.438141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533013502724533:2735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:25.438145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533013502724533:2735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:25.438160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 22 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:25.439713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:25.439736Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:25.439739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:25.439745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:25.439753Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 21 [1:7556533013502724517:2733]
2025-10-02T08:07:25.439768Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:25.440165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 21
2025-10-02T08:07:25.439789Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:25.439802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.439807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.439809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.439830Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:25.439837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:25.439845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:25.439921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.439924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.439928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:25.439931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:25.440024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:25.440027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.440044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.440058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:25.440079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 21
2025-10-02T08:07:25.440085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724564:2735], now have 1 active actors on pipe
2025-10-02T08:07:25.440089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533013963194609:2378], now have 1 active actors on pipe
2025-10-02T08:07:25.440098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533013502724511:2733]
2025-10-02T08:07:25.440100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533013502724511:2733]
2025-10-02T08:07:25.440117Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:25.440133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:25.440136Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:25.440141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:25.440149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:25.440152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:25.440160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.440165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.440219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533013502724511:2733]
2025-10-02T08:07:25.440223Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:25.440234Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:25.440241Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2690263-db41a17e-b63d4573-9be97b12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:25.440249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.440254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.440256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:25.440269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.440280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:25.440349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.440570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.440577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.440594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.440631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 22 partition: 0 MaxSeqNo: 17 sessionId: src_id|d2690263-db41a17e-b63d4573-9be97b12_0
2025-10-02T08:07:25.441417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ffbc85-f4485bb5-49447f3-d0b0f912_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d2690263-db41a17e-b63d4573-9be97b12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:25.444212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2690263-db41a17e-b63d4573-9be97b12_0] Write session: try to update token
2025-10-02T08:07:25.444231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2690263-db41a17e-b63d4573-9be97b12_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:25.451438Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:25.451455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:25.451466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533013502724511:2733]
2025-10-02T08:07:25.451516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:25.451512Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:25.451717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:25.451938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:25.452107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:25.452268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:25.452500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:25.452532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:25.468322Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:25.468336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:25.468338Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:25.468346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533013502724511:2733]
2025-10-02T08:07:25.468348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533013502724511:2733]
2025-10-02T08:07:25.468389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:25.468398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.468400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:25.468402Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:25.468408Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:25.468544Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:25.468722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId: src_id|d2690263-db41a17e-b63d4573-9be97b12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:25.471485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:25.518684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533013502724580:2534]
2025-10-02T08:07:25.518773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:25.518925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 21, pipe: [1:7556533013502724580:2534]
2025-10-02T08:07:25.629850Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:25.630143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.630159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.630185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724580:2534], now have 1 active actors on pipe
2025-10-02T08:07:25.630209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.630212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.630510Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.630526Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.630821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:25.630891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 22 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d2690263-db41a17e-b63d4573-9be97b12_0
2025-10-02T08:07:25.631106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 22 sessionId: src_id|d2690263-db41a17e-b63d4573-9be97b12_0 is DEAD
2025-10-02T08:07:25.631269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533013502724580:2534]
2025-10-02T08:07:25.632896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2690263-db41a17e-b63d4573-9be97b12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:25.632911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2690263-db41a17e-b63d4573-9be97b12_0] Write session will restart in 0.009769s
2025-10-02T08:07:25.632933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2690263-db41a17e-b63d4573-9be97b12_0] Write session: Do CDS request
2025-10-02T08:07:25.632940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2690263-db41a17e-b63d4573-9be97b12_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:25.632900Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:25.648543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2690263-db41a17e-b63d4573-9be97b12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.650476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:25.650496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 23
2025-10-02T08:07:25.652139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:25.652218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.652267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 23 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:25.652276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=23 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:25.652280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:25.652726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 23 sessionId:  describe result for acl check
2025-10-02T08:07:25.652760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:25.652762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:25.652763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:25.652769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533013502724717:2753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:25.653310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533013502724717:2753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:25.653781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:25.654034Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:25.654046Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:25.654060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:25.654134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:25.654185Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533013502724724:2746]
2025-10-02T08:07:25.654860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:25.655112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:25.655175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:25.655551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:25.655634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.655641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.655642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.655643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.655644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.655651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.655662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.655665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.655668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.655671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.655677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.655685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.655692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.655696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.655700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.655705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.655710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.655714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.655719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.655724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.655745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:25.659838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533013502724717:2753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:25.666838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533013502724717:2753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:25.666857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533013502724717:2753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:25.666861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533013502724717:2753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:25.666871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 23 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:25.667325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:25.668913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:25.668934Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:25.668937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:25.668943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:25.668951Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 22 [1:7556533013502724724:2746]
2025-10-02T08:07:25.668966Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:25.668990Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:25.668994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.668997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.668999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.669019Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:25.669025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:25.669034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:25.669109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.669112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.669116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:25.669118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:25.669209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:25.669212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.669229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.669242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:25.669266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724760:2753], now have 1 active actors on pipe
2025-10-02T08:07:25.669274Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533013502724709:2746]
2025-10-02T08:07:25.669278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533013502724709:2746]
2025-10-02T08:07:25.669288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:25.669302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:25.669317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:25.669320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:25.669331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533013963194628:2378], now have 1 active actors on pipe
2025-10-02T08:07:25.669372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533013502724709:2746]
2025-10-02T08:07:25.669374Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:25.669393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:25.669396Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:25.669402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:25.669434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 22
2025-10-02T08:07:25.669443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.669448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.669477Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:25.669484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.669488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.669490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:25.669502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.669514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:25.669532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.669614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.669637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.669676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.669722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 23 partition: 0 MaxSeqNo: 17 sessionId: src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0
2025-10-02T08:07:25.669785Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 22
2025-10-02T08:07:25.670084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2690263-db41a17e-b63d4573-9be97b12_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:25.673517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0] Write session: try to update token
2025-10-02T08:07:25.673540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:25.701820Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:25.701841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:25.701843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:25.701852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533013502724709:2746]
2025-10-02T08:07:25.701857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533013502724709:2746]
2025-10-02T08:07:25.701911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:25.701920Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:25.701923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.701926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:25.701927Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:25.702087Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:25.712860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId: src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:25.715629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:25.733033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533013502724777:2534]
2025-10-02T08:07:25.733157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:25.737019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 22, pipe: [1:7556533013502724777:2534]
2025-10-02T08:07:25.844948Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:25.845948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.845965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.846003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724777:2534], now have 1 active actors on pipe
2025-10-02T08:07:25.846020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.846023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.846540Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:25.846338Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.846355Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:25.846619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533013502724777:2534]
2025-10-02T08:07:25.846657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:25.846726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 23 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0
2025-10-02T08:07:25.846962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 23 sessionId: src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0 is DEAD
2025-10-02T08:07:25.847140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:25.847152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0] Write session will restart in 0.008966s
2025-10-02T08:07:25.847179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0] Write session: Do CDS request
2025-10-02T08:07:25.847187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:25.861404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.861796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:25.861815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 24
2025-10-02T08:07:25.861982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:25.862017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 24 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:25.862025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=24 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:25.862030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:25.862686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 24 sessionId:  describe result for acl check
2025-10-02T08:07:25.862730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:25.862737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:25.862739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:25.862745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533013502724850:2759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:25.863400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533013502724850:2759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:25.865750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:25.866295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:25.866488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533013502724850:2759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:25.866522Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:25.866535Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:25.866550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:25.866625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:25.866697Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533013502724898:2758]
2025-10-02T08:07:25.867319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:25.867574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:25.867625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:25.868008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:25.868052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.868057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.868058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.868059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.868060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.868066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.868076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.868085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.868089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.868093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.868099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.868113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:25.868124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.868134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:25.868139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.868146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:25.868155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.868160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.868165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.868170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.868189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:25.872013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533013502724850:2759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:25.872031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533013502724850:2759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:25.872035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533013502724850:2759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:25.872045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 24 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:25.878108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:25.879711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:25.879731Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:25.879735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:25.879740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:25.879750Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 23 [1:7556533013502724898:2758]
2025-10-02T08:07:25.879765Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:25.879793Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:25.879797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.879801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.879803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.879823Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:25.879830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:25.879840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:25.879922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.879925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.879928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:25.879931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:25.880025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:25.880029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.880046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:25.880059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:25.880081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533013502724892:2758]
2025-10-02T08:07:25.880083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533013502724892:2758]
2025-10-02T08:07:25.880093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:25.880115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533013963194646:2378], now have 1 active actors on pipe
2025-10-02T08:07:25.880116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:25.880120Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:25.880127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:25.880144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:25.880148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:25.880155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724924:2759], now have 1 active actors on pipe
2025-10-02T08:07:25.880205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533013502724892:2758]
2025-10-02T08:07:25.880209Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:25.880260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:25.880263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 23
2025-10-02T08:07:25.880513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.880523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.880555Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|374f239a-839f30ec-1c88423c-7b114d8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:25.880565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:25.880576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:25.880579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:25.880592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:25.880608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:25.880626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.880670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:25.880673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:25.880687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:25.880719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 24 partition: 0 MaxSeqNo: 17 sessionId: src_id|374f239a-839f30ec-1c88423c-7b114d8d_0
2025-10-02T08:07:25.881258Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 23
2025-10-02T08:07:25.889023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac67e3-4c5c8754-2dd95286-1566d66d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|374f239a-839f30ec-1c88423c-7b114d8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:25.892122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|374f239a-839f30ec-1c88423c-7b114d8d_0] Write session: try to update token
2025-10-02T08:07:25.892148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|374f239a-839f30ec-1c88423c-7b114d8d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:25.901975Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:25.901993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:25.902005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533013502724892:2758]
2025-10-02T08:07:25.902060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:25.902070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:25.902444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:25.902673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:25.902825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:25.902980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:25.903197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:25.903245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:25.916048Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:25.916086Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:25.916089Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:25.916100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533013502724892:2758]
2025-10-02T08:07:25.916106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533013502724892:2758]
2025-10-02T08:07:25.916162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:25.916170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:25.916173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:25.916177Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:25.916187Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:25.916354Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:25.933276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId: src_id|374f239a-839f30ec-1c88423c-7b114d8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:25.936655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:25.946717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533013502724938:2534]
2025-10-02T08:07:25.946796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:25.946929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 23, pipe: [1:7556533013502724938:2534]
2025-10-02T08:07:26.103793Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:26.104080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.104097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.104121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533013502724938:2534], now have 1 active actors on pipe
2025-10-02T08:07:26.104135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.104142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.104257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533013502724938:2534]
2025-10-02T08:07:26.104276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:26.104281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:26.104359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 24 reason: error at write: Disconnected sessionId: src_id|374f239a-839f30ec-1c88423c-7b114d8d_0
2025-10-02T08:07:26.104408Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:26.104423Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:26.104438Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:26.104498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 24 sessionId: src_id|374f239a-839f30ec-1c88423c-7b114d8d_0 is DEAD
2025-10-02T08:07:26.104696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|374f239a-839f30ec-1c88423c-7b114d8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:26.104707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|374f239a-839f30ec-1c88423c-7b114d8d_0] Write session will restart in 0.009040s
2025-10-02T08:07:26.104731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|374f239a-839f30ec-1c88423c-7b114d8d_0] Write session: Do CDS request
2025-10-02T08:07:26.104741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|374f239a-839f30ec-1c88423c-7b114d8d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:26.110917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:26.111453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:26.111626Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:26.111635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:26.111649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:26.111700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:26.111745Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533017797692347:2765]
2025-10-02T08:07:26.112378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:26.112609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:26.112653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:26.112970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:26.113022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.113031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.113033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.113033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.113034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.113039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.113048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.113052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.113054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.113058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.113063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.113071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.113077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.113081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.113086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.113090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.113093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.113099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.113105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.113115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.113137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:26.115377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|374f239a-839f30ec-1c88423c-7b114d8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:26.115543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:26.115558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 25
2025-10-02T08:07:26.115718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:26.115749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 25 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:26.115759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=25 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:26.115767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:26.116190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 25 sessionId:  describe result for acl check
2025-10-02T08:07:26.116229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:26.116236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:26.116237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:26.116242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533017797692363:2767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:26.116813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533017797692363:2767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:26.118768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533017797692363:2767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:26.121556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:26.121847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533017797692363:2767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:26.121861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533017797692363:2767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:26.121865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533017797692363:2767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:26.121875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 25 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:26.123029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:26.123047Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:26.123049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:26.123053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:26.123060Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 24 [1:7556533017797692347:2765]
2025-10-02T08:07:26.123072Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:26.123089Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:26.123096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.123103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.123109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.123125Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:26.123135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:26.123143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:26.123213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.123220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.123223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:26.123226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:26.123296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:26.123304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.123318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.123332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:26.123356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533017797692341:2765]
2025-10-02T08:07:26.123362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533017797692341:2765]
2025-10-02T08:07:26.123370Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:26.123380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 24
2025-10-02T08:07:26.123381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:26.123384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:26.123384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533017797692395:2767], now have 1 active actors on pipe
2025-10-02T08:07:26.123388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533018258161962:2378], now have 1 active actors on pipe
2025-10-02T08:07:26.123397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:26.123411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:26.123414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:26.123422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.123430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.123427Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 24
2025-10-02T08:07:26.123476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533017797692341:2765]
2025-10-02T08:07:26.123483Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:26.123493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:26.123501Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e502e678-1aaa5add-d99aae7-2c753db7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:26.123508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.123512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.123514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:26.123524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.123534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:26.123576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:26.123615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.123621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.123633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:26.123666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 25 partition: 0 MaxSeqNo: 17 sessionId: src_id|e502e678-1aaa5add-d99aae7-2c753db7_0
2025-10-02T08:07:26.124061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|374f239a-839f30ec-1c88423c-7b114d8d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e502e678-1aaa5add-d99aae7-2c753db7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:26.126614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e502e678-1aaa5add-d99aae7-2c753db7_0] Write session: try to update token
2025-10-02T08:07:26.126633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e502e678-1aaa5add-d99aae7-2c753db7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:26.134533Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:26.134555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:26.134567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533017797692341:2765]
2025-10-02T08:07:26.134621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:26.134624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:26.134815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:26.134981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:26.135151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:26.135301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:26.135512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:26.135568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:26.143942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId: src_id|e502e678-1aaa5add-d99aae7-2c753db7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:26.147932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:26.148026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.148038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.148084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:26.148116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:26.152349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.152383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.152760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.152949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.153040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.153211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.153274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.153284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.153485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.153582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.153779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.153914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.153995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.153999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.154095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.154162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.154235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.154306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.154351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.154355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.154732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.154815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.154973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.155066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.155131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.155135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.155217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.155286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.155353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.155428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.155621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.155631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.155718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.155787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.155863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.155936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.155983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.155988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.156073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.156141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.156220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.156317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.156366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.156369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.156452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.156518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.156591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.156670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.156723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.156727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.156831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.156901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.156968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.157043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.157090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.157093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.157173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.157243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.157317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.157387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.157435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.157443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.157549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:26.157635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.157657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.157660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:26.157704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:26.157732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:26.157739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:26.157747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:26.157751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:26.158259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:26.158288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:26.158303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:26.158308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:26.158314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:26.158318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:26.159210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:26.159231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:26.159242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:26.159247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:26.159254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:26.159260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:26.160004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:26.160024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:26.160034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:26.160042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:26.160047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:26.162407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:26.162431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:26.162447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392446162
2025-10-02T08:07:26.162665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:26.162685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:26.162697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:26.162705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:26.162724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:26.162730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:26.163998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:26.164026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:26.164039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:26.164045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:26.164049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:26.164053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:26.165168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:26.165341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:26.165356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:26.165362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:26.165368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:26.165372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:26.166111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:26.166124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:26.166132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:26.167454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:26.167463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:26.167474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:26.167479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:26.167489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392446167
2025-10-02T08:07:26.167829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:26.167843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:26.167850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:26.167854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:26.167859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:26.167864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:26.168434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:26.168450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:26.168457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:26.168461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:26.168466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:26.168470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:26.177656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:26.177719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.177835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392446177
2025-10-02T08:07:26.192260Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:26.192320Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:26.192329Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:26.192338Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:26.192356Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:26.192359Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:26.192362Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:26.192372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533017797692341:2765]
2025-10-02T08:07:26.192377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533017797692341:2765]
2025-10-02T08:07:26.192479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:26.192487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.192489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:26.192645Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:26.192872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:26.192879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:26.204258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533017797692412:2534]
2025-10-02T08:07:26.204373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:26.204554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 24, pipe: [1:7556533017797692412:2534]
2025-10-02T08:07:26.344068Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:26.344500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533017797692412:2534], now have 1 active actors on pipe
2025-10-02T08:07:26.344531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.344539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.345411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:26.344829Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:26.345563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e502e678-1aaa5add-d99aae7-2c753db7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:26.345595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e502e678-1aaa5add-d99aae7-2c753db7_0] Write session will restart in 0.007928s
2025-10-02T08:07:26.345618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e502e678-1aaa5add-d99aae7-2c753db7_0] Write session: Do CDS request
2025-10-02T08:07:26.345626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e502e678-1aaa5add-d99aae7-2c753db7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:26.344843Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:26.345139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533017797692412:2534]
2025-10-02T08:07:26.345169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:26.345192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 25 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e502e678-1aaa5add-d99aae7-2c753db7_0
2025-10-02T08:07:26.345408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 25 sessionId: src_id|e502e678-1aaa5add-d99aae7-2c753db7_0 is DEAD
2025-10-02T08:07:26.349522Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [66f9aa199ace6dcb] Result# TEvPutResult {Id# [72075186224037892:24:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:26.349588Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:24:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:26.349660Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:24:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:26.354470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e502e678-1aaa5add-d99aae7-2c753db7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:26.354604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:26.354622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 26
2025-10-02T08:07:26.355246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:26.355293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 26 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:26.355305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=26 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:26.355309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:26.355847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 26 sessionId:  describe result for acl check
2025-10-02T08:07:26.355890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:26.355892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:26.355894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:26.355901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533017797692520:2774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:26.356021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:26.356451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533017797692520:2774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:26.357283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:26.357522Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:26.357535Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:26.357548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:26.357613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:26.357662Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533017797692534:2772]
2025-10-02T08:07:26.358387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:26.358602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:26.358644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:26.359013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:26.359058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.359059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.359060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.359061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.359062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.359068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.359080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.359084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.359088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.359092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.359097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.359105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.359112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.359118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.359122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.359127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.359134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.359138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.359143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.359148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.359169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:26.359738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533017797692520:2774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:26.378187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:26.380768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:26.380777Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:26.380781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:26.380787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:26.380796Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 25 [1:7556533017797692534:2772]
2025-10-02T08:07:26.380830Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:26.380851Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:26.380855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.380860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.380862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.380888Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:26.380896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:26.380905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:26.382611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 25
2025-10-02T08:07:26.380993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.381005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.381009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:26.381012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:26.381066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533017797692520:2774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:26.381073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533017797692520:2774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:26.381077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533017797692520:2774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:26.381088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 26 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:26.381105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:26.381109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.381128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.381142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:26.381168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533017797692521:2772]
2025-10-02T08:07:26.381171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533017797692521:2772]
2025-10-02T08:07:26.381180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:26.381197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:26.381215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:26.381219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:26.381265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533017797692521:2772]
2025-10-02T08:07:26.381268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:26.381723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:26.381727Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:26.381734Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:26.384150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533018258161971:2378], now have 1 active actors on pipe
2025-10-02T08:07:26.384175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533017797692575:2774], now have 1 active actors on pipe
2025-10-02T08:07:26.384200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 25
2025-10-02T08:07:26.384209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.384215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.384248Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:26.384260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.384266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.384269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:26.384300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.384320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:26.384341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:26.384834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.384847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.384871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:26.384909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 26 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0
2025-10-02T08:07:26.389125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e502e678-1aaa5add-d99aae7-2c753db7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:26.391984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0] Write session: try to update token
2025-10-02T08:07:26.392004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:26.428701Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:26.428720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:26.428723Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:26.428732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533017797692521:2772]
2025-10-02T08:07:26.428741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533017797692521:2772]
2025-10-02T08:07:26.428789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:26.428822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.428825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:26.428975Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:26.429293Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:26.429299Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:26.429977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId: src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:26.432625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:26.445403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533017797692589:2534]
2025-10-02T08:07:26.445484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:26.445621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 25, pipe: [1:7556533017797692589:2534]
2025-10-02T08:07:26.574207Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:26.574525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.574536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.574589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533017797692589:2534], now have 1 active actors on pipe
2025-10-02T08:07:26.574603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.574605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.574940Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:26.574943Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:26.574953Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:26.575247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:26.575275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533017797692589:2534]
2025-10-02T08:07:26.575328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 26 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0
2025-10-02T08:07:26.575533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 26 sessionId: src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0 is DEAD
2025-10-02T08:07:26.575700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:26.575712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0] Write session will restart in 0.006701s
2025-10-02T08:07:26.575750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0] Write session: Do CDS request
2025-10-02T08:07:26.575758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:26.583989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:26.585530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:26.585559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 27
2025-10-02T08:07:26.585807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:26.585838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 27 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:26.585847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=27 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:26.585852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:26.586513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 27 sessionId:  describe result for acl check
2025-10-02T08:07:26.586556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:26.586558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:26.586560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:26.586566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533017797692689:2780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:26.586848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:26.587554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:26.587739Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:26.587750Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:26.587760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:26.587808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:26.587846Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533017797692698:2778]
2025-10-02T08:07:26.588464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:26.588521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533017797692689:2780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:26.588742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:26.588790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:26.589135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:26.589184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.589191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.589192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.589193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.589194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.589202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.589211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.589215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.589219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.589222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.589227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.589234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.589239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.589243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.589247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.589251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.589255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.589260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.589264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.589268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.589287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:26.596780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533017797692689:2780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:26.600056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:26.602184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:26.602200Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:26.602204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:26.602209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:26.602217Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 26 [1:7556533017797692698:2778]
2025-10-02T08:07:26.602232Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:26.602253Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:26.602257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.602265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.602268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.602288Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:26.602300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:26.602309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:26.602380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.602388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.602392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:26.602395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:26.602480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:26.602487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.602504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.602522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:26.602548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533017797692691:2778]
2025-10-02T08:07:26.602548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533017797692689:2780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:26.602552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533017797692691:2778]
2025-10-02T08:07:26.602555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533017797692689:2780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:26.602559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533017797692689:2780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:26.602561Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:26.602570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 27 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:26.602576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533018258161978:2378], now have 1 active actors on pipe
2025-10-02T08:07:26.602586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:26.602604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:26.602613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:26.602686Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:26.602697Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:26.602711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533017797692691:2778]
2025-10-02T08:07:26.602714Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:26.602723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:26.602987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 26
2025-10-02T08:07:26.602988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533017797692742:2780], now have 1 active actors on pipe
2025-10-02T08:07:26.603075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.603085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.603115Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:26.603123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.603128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.603130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:26.603141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.603151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:26.603167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:26.603326Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 26
2025-10-02T08:07:26.603301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.603305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.603319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:26.603343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 27 partition: 0 MaxSeqNo: 17 sessionId: src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0
2025-10-02T08:07:26.603694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e94b52c-368ed0ea-9260918a-d58d61fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:26.606633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0] Write session: try to update token
2025-10-02T08:07:26.606651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:26.626902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId: src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:26.630079Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:26.630103Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:26.630106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:26.630119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533017797692691:2778]
2025-10-02T08:07:26.630125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533017797692691:2778]
2025-10-02T08:07:26.630186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:26.630195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.630198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:26.630428Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:26.630904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:26.631054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:26.631059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:26.701772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533017797692769:2534]
2025-10-02T08:07:26.701855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:26.704231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 26, pipe: [1:7556533017797692769:2534]
2025-10-02T08:07:26.824236Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:26.824623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.824645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.824708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533017797692769:2534], now have 1 active actors on pipe
2025-10-02T08:07:26.824733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.824739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.824992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:26.825002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:26.825063Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:26.825073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 27 reason: error at write: Disconnected sessionId: src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0
2025-10-02T08:07:26.825077Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:26.825287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:26.825532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:26.825544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0] Write session will restart in 0.006984s
2025-10-02T08:07:26.825572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0] Write session: Do CDS request
2025-10-02T08:07:26.825578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:26.825269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 27 sessionId: src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0 is DEAD
2025-10-02T08:07:26.825425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533017797692769:2534]
2025-10-02T08:07:26.833390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:26.833902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:26.833921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 28
2025-10-02T08:07:26.834075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:26.834108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 28 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:26.834116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=28 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:26.834119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:26.834582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 28 sessionId:  describe result for acl check
2025-10-02T08:07:26.834613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:26.834616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:26.834618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:26.834625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533017797692897:2799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:26.835194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533017797692897:2799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:26.835395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:26.836681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:26.836964Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:26.836974Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:26.836996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:26.837056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:26.837098Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533017797692916:2797]
2025-10-02T08:07:26.837707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:26.837944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:26.838009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:26.838395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:26.838468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.838474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.838475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.838476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.838478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.838483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.838492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.838496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.838499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.838502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.838508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.838516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:26.838526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.838530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:26.838534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.838539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:26.838543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.838547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.838551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.838555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.838574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:26.842416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533017797692897:2799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:26.850639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:26.852393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:26.852416Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:26.852420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:26.852424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:26.852433Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 27 [1:7556533017797692916:2797]
2025-10-02T08:07:26.852448Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:26.852474Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:26.852478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.852482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.852484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.852506Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:26.852513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:26.852523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:26.852604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.852607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.852610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:26.852614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:26.852697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:26.852701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.852719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:26.852731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:26.852752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533017797692900:2797]
2025-10-02T08:07:26.852754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533017797692900:2797]
2025-10-02T08:07:26.852765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:26.852780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:26.852785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:26.852792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:26.852794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:26.852797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:26.852829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533018258162010:2378], now have 1 active actors on pipe
2025-10-02T08:07:26.852873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533017797692900:2797]
2025-10-02T08:07:26.852883Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:26.852903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:26.853295Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 27
2025-10-02T08:07:26.861355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533017797692897:2799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:26.861389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533017797692897:2799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:26.861392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533017797692897:2799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:26.861404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 28 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:26.862252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 27
2025-10-02T08:07:26.862279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533017797692957:2799], now have 1 active actors on pipe
2025-10-02T08:07:26.862416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.862428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.862468Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:26.862479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.862485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.862489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:26.862504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.862522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:26.862538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:26.863083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81977dd-6e993b63-3cf9036c-f14b339b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:26.865807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0] Write session: try to update token
2025-10-02T08:07:26.865826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:26.862660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.862664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.862677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:26.862700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 28 partition: 0 MaxSeqNo: 17 sessionId: src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0
2025-10-02T08:07:26.883414Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:26.883434Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:26.883446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533017797692900:2797]
2025-10-02T08:07:26.883503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:26.883682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:26.883852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:26.883993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:26.884147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:26.884360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:26.884407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:26.884713Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:26.894239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId: src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:26.897200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:26.898752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.898772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.898814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:26.898845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:26.898922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:26.898935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:26.899139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.899216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.899285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.899366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.899422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.899433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.899514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.899588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.899661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.899750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.899796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.899804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.899886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.899955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.900018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.900092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.900144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.900152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.900226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.900350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.900432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.900502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.900547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.900550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.900622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.900693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.900763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.900846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.900897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.900900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.900973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.901044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.901117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.901184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.901228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.901231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.901300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.901363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.901429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.901496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.901557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.901561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.901634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.901699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.901764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.901829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.901891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.901895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.901969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.902031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.902097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.902164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.902219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.902223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.902294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:26.902357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:26.902430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:26.902502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:26.902558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:26.902565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:26.902626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:26.902711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:26.902734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:26.902737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:26.902781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:26.902795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:26.902799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:26.902802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:26.902805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:26.903248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:26.903274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:26.903280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:26.903283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:26.903289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:26.903292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:26.903781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:26.903793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:26.903799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:26.903802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:26.903805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:26.903808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:26.905089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:26.905112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:26.905118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:26.905122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:26.905125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:26.907220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:26.907236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:26.907250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392446903
2025-10-02T08:07:26.907891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:26.907901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:26.907906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:26.907910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:26.907916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:26.907919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:26.908525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:26.908540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:26.908549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:26.908553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:26.908556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:26.908561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:26.909092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:26.909108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:26.909116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:26.909120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:26.909124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:26.909129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:26.909662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:26.909676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:26.909683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:26.910927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:26.910935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:26.910941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:26.910946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:26.910958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392446908
2025-10-02T08:07:26.915070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:26.915107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:26.915130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:26.915140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:26.915149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:26.915153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:26.916005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:26.916033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:26.916042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:26.916046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:26.916050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:26.916055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:26.916612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:26.916637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:26.916950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392446916
2025-10-02T08:07:26.917853Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:26.917873Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:26.917880Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:26.917887Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:26.919706Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:26.919723Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:26.919725Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:26.919735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533017797692900:2797]
2025-10-02T08:07:26.919739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533017797692900:2797]
2025-10-02T08:07:26.919821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:26.919834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:26.919841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:26.920013Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:26.920315Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:26.920336Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:26.928656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533017797692969:2534]
2025-10-02T08:07:26.928751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:26.930572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 27, pipe: [1:7556533017797692969:2534]
2025-10-02T08:07:27.136745Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:27.151848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533017797692969:2534], now have 1 active actors on pipe
2025-10-02T08:07:27.151886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.151895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.152295Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:27.152728Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:27.152744Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:27.152868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:27.152903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 28 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0
2025-10-02T08:07:27.153074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 28 sessionId: src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0 is DEAD
2025-10-02T08:07:27.153137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533017797692969:2534]
2025-10-02T08:07:27.153433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:27.153445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0] Write session will restart in 0.006943s
2025-10-02T08:07:27.153463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0] Write session: Do CDS request
2025-10-02T08:07:27.153469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:27.161562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:27.161252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:27.161763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:27.161770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 29
2025-10-02T08:07:27.162118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:27.162344Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:27.162348Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:27.162359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:27.162409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:27.162447Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533022092660389:2804]
2025-10-02T08:07:27.163179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:27.163249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:27.163279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 29 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:27.163284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=29 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:27.163287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:27.163681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 29 sessionId:  describe result for acl check
2025-10-02T08:07:27.163705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:27.163706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:27.163709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:27.163714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533022092660397:2806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:27.163758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:27.163798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:27.164061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:27.164091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.164092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.164093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.164094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.164095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.164098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.164105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.164107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.164110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.164112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.164116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.164121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.164125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.164128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.164131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.164134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.164137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.164139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.164142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.164145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.164156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:27.164568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533022092660397:2806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:27.173593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533022092660397:2806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:27.176870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:27.177363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533022092660397:2806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:27.177383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533022092660397:2806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:27.177388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533022092660397:2806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:27.177401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 29 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:27.178634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:27.178660Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:27.178663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:27.178669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:27.178678Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 28 [1:7556533022092660389:2804]
2025-10-02T08:07:27.178694Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:27.178716Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:27.178722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.178725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.178728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.178748Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:27.178763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:27.178772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:27.178853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.178865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.178868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:27.178871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:27.178954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:27.178966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.178983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.178998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:27.179028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533022092660436:2806], now have 1 active actors on pipe
2025-10-02T08:07:27.179040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533022553129327:2378], now have 1 active actors on pipe
2025-10-02T08:07:27.179049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533022092660382:2804]
2025-10-02T08:07:27.179052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533022092660382:2804]
2025-10-02T08:07:27.179065Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:27.179081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:27.179102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:27.179112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:27.179111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:27.179116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:27.179110Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 28
2025-10-02T08:07:27.179162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533022092660382:2804]
2025-10-02T08:07:27.179179Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:27.179194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:27.179242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 28
2025-10-02T08:07:27.179301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.179313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.179342Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa0901c6-9553d960-915b73f0-ffe37119_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:27.179357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.179362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.179364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:27.179376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.179388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:27.179407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.179437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.179445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.179458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.179491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 29 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa0901c6-9553d960-915b73f0-ffe37119_0
2025-10-02T08:07:27.179938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db506c71-c408fc1c-aefbaab2-f33043f9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa0901c6-9553d960-915b73f0-ffe37119_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:27.182890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0901c6-9553d960-915b73f0-ffe37119_0] Write session: try to update token
2025-10-02T08:07:27.182913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0901c6-9553d960-915b73f0-ffe37119_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:27.192965Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:27.192985Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:27.192998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533022092660382:2804]
2025-10-02T08:07:27.193049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:27.193069Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:27.193227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:27.193377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:27.193518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:27.193671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:27.193864Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:27.193924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:27.207770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId: src_id|fa0901c6-9553d960-915b73f0-ffe37119_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:27.216790Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:27.216838Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:27.216841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:27.216854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533022092660382:2804]
2025-10-02T08:07:27.216860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533022092660382:2804]
2025-10-02T08:07:27.216919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:27.216931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.216934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:27.217080Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:27.217505Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:27.217525Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:27.218782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:27.253334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533022092660451:2534]
2025-10-02T08:07:27.253443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:27.255771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 28, pipe: [1:7556533022092660451:2534]
2025-10-02T08:07:27.301438Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-02T08:07:27.301454Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-02T08:07:27.390039Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:27.390390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.390401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.390431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533022092660451:2534], now have 1 active actors on pipe
2025-10-02T08:07:27.390448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.390450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.391002Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:27.391012Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:27.391346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533022092660451:2534]
2025-10-02T08:07:27.391371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:27.391430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 29 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa0901c6-9553d960-915b73f0-ffe37119_0
2025-10-02T08:07:27.391662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 29 sessionId: src_id|fa0901c6-9553d960-915b73f0-ffe37119_0 is DEAD
2025-10-02T08:07:27.392904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0901c6-9553d960-915b73f0-ffe37119_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:27.392920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0901c6-9553d960-915b73f0-ffe37119_0] Write session will restart in 0.005442s
2025-10-02T08:07:27.392947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0901c6-9553d960-915b73f0-ffe37119_0] Write session: Do CDS request
2025-10-02T08:07:27.392955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0901c6-9553d960-915b73f0-ffe37119_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:27.390981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:27.401355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0901c6-9553d960-915b73f0-ffe37119_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:27.402371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:27.403021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:27.403223Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:27.403227Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:27.403239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:27.403287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:27.403331Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533022092660573:2811]
2025-10-02T08:07:27.404036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:27.404365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:27.404403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:27.404748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:27.404788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.404789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.404790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.404791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.404792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.404798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.404825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.404829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.404833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.404836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.404842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.404850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.404856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.404861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.404865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.404869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.404874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.404879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.404885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.404890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.404911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:27.404961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:27.404966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 30
2025-10-02T08:07:27.405240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:27.405273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 30 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:27.405281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=30 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:27.405285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:27.406282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 30 sessionId:  describe result for acl check
2025-10-02T08:07:27.406323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:27.406326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:27.406327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:27.406333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533022092660589:2813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:27.406905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533022092660589:2813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:27.418025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533022092660589:2813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:27.420145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:27.423382Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 29
2025-10-02T08:07:27.422307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:27.422325Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:27.422328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:27.422333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:27.422342Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 29 [1:7556533022092660573:2811]
2025-10-02T08:07:27.422360Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:27.422381Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:27.422385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.422390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.422392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.422415Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:27.422425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:27.422433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:27.422512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.422516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.422520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:27.422524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:27.422608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:27.422611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.422627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.422640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:27.422664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533022092660566:2811]
2025-10-02T08:07:27.422666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533022092660566:2811]
2025-10-02T08:07:27.422675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:27.422692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:27.422710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:27.422713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:27.422757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533022092660566:2811]
2025-10-02T08:07:27.422760Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:27.422871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:27.422873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:27.422880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:27.423109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533022553129336:2378], now have 1 active actors on pipe
2025-10-02T08:07:27.448337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533022092660589:2813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:27.448360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533022092660589:2813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:27.448364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533022092660589:2813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:27.448375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 30 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:27.449320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 29
2025-10-02T08:07:27.449344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533022092660629:2813], now have 1 active actors on pipe
2025-10-02T08:07:27.449403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.449413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.449451Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:27.449465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.449472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.449480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:27.449499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.449519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:27.449539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.449633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.449636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.449650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.449678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 30 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0
2025-10-02T08:07:27.453115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0901c6-9553d960-915b73f0-ffe37119_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:27.456026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0] Write session: try to update token
2025-10-02T08:07:27.456047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:27.455672Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:27.455698Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:27.455700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:27.455714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533022092660566:2811]
2025-10-02T08:07:27.455720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533022092660566:2811]
2025-10-02T08:07:27.455780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:27.455788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.455790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:27.455980Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:27.457309Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:27.457324Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:27.489819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId: src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:27.494981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:27.495060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533022092660635:2534]
2025-10-02T08:07:27.495140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:27.497181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 29, pipe: [1:7556533022092660635:2534]
2025-10-02T08:07:27.629700Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:27.631057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.631076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.631102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533022092660635:2534], now have 1 active actors on pipe
2025-10-02T08:07:27.631117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.631119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.631569Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:27.631492Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:27.631508Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:27.631812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:27.631889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 30 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0
2025-10-02T08:07:27.632073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 30 sessionId: src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0 is DEAD
2025-10-02T08:07:27.632156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533022092660635:2534]
2025-10-02T08:07:27.632239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:27.632254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0] Write session will restart in 0.008183s
2025-10-02T08:07:27.632288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0] Write session: Do CDS request
2025-10-02T08:07:27.632295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:27.645385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:27.646302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:27.646321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 31
2025-10-02T08:07:27.647506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:27.647544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 31 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:27.647552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=31 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:27.647557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:27.648035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 31 sessionId:  describe result for acl check
2025-10-02T08:07:27.648089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:27.648097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:27.648100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:27.648107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533022092660739:2818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:27.648689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533022092660739:2818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:27.650632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:27.651303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:27.651496Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:27.651500Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:27.651512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:27.651558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:27.651604Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533022092660754:2817]
2025-10-02T08:07:27.652405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:27.652871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:27.652921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:27.653291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:27.653326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.653328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.653329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.653331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.653332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.653339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.653351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.653355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.653359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.653363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.653369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.653378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.653386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.653391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.653396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.653402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.653407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.653413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.653418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.653424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.653445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:27.667130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:27.668769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:27.668776Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:27.668779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:27.668784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:27.668793Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 30 [1:7556533022092660754:2817]
2025-10-02T08:07:27.668828Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:27.668850Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:27.668854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.668858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.668860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.668881Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:27.668888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:27.668897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:27.668981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.668983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.668987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:27.668991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:27.669070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:27.669073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.669089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.669103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:27.669126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533022092660747:2817]
2025-10-02T08:07:27.669128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533022092660747:2817]
2025-10-02T08:07:27.669136Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:27.669151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:27.669178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:27.669182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:27.669225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533022092660747:2817]
2025-10-02T08:07:27.669229Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:27.669598Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:27.669607Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:27.669613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:27.670655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 30
2025-10-02T08:07:27.670177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533022553129344:2378], now have 1 active actors on pipe
2025-10-02T08:07:27.674382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533022092660739:2818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:27.688085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533022092660739:2818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:27.688106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533022092660739:2818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:27.688110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533022092660739:2818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:27.688121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 31 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:27.689119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 30
2025-10-02T08:07:27.689143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533022092660801:2818], now have 1 active actors on pipe
2025-10-02T08:07:27.689229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.689239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.689289Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:27.689302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.689309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.689313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:27.689330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.689350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:27.689370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.689497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.689502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.689516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.689545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 31 partition: 0 MaxSeqNo: 17 sessionId: src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0
2025-10-02T08:07:27.692168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a45c53d-61a5de1e-d9f5a973-fbff9fa5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:27.695099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0] Write session: try to update token
2025-10-02T08:07:27.695119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:27.720629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId: src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:27.723610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:27.723762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.723775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.723823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:27.723840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:27.723912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.723915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.724111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.724174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.724242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.724325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.724372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.724379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.724458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.724525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.724595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.724666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.724719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.724722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.724816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.724877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.724942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.725012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.725056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.725059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.725146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.725219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.725291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.725364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.725533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.725537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.725615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.725679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.725745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.725824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.725879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.725885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.725964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.726030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.726099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.726165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.726208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.726211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.726298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.726369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.726450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.726529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.726581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.726584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.726661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.726727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.726800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.726867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.726907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.726911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.727006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.727077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.727152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.727380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.727433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.727436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.727512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:27.727572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:27.727633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:27.727699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:27.727748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:27.727752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:27.727856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:27.727924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.727945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.727947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:27.727985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:27.728001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:27.728004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:27.728007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:27.728010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:27.728553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:27.728580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:27.728587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:27.728590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:27.728593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:27.728596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:27.729103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:27.729118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:27.729124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:27.729127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:27.729130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:27.729134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:27.729614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:27.729628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:27.729634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:27.729637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:27.729640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:27.730996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:27.731007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:27.731019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392447730
2025-10-02T08:07:27.731133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:27.731143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:27.731148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:27.731154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:27.731159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:27.731162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:27.731644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:27.731657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:27.731662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:27.731666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:27.731669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:27.731673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:27.732182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:27.732197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:27.732204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:27.732208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:27.732211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:27.732215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:27.732740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:27.732755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:27.732762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:27.735683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:27.735713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:27.735720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:27.735725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:27.735742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392447735
2025-10-02T08:07:27.736227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:27.736249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:27.736257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:27.736261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:27.736266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:27.736270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:27.737246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:27.737275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:27.737282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:27.737287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:27.737292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:27.737296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:27.737797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:27.737813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.737931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392447737
2025-10-02T08:07:27.740492Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:27.740510Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:27.740519Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:27.740528Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:27.740543Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:27.740549Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:27.740551Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:27.740560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533022092660747:2817]
2025-10-02T08:07:27.740564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533022092660747:2817]
2025-10-02T08:07:27.740648Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:27.740656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:27.740672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:27.740677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.740679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:27.744344Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:27.820240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533022092660827:2534]
2025-10-02T08:07:27.820340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:27.821205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 30, pipe: [1:7556533022092660827:2534]
2025-10-02T08:07:27.917445Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:27.917836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533022092660827:2534], now have 1 active actors on pipe
2025-10-02T08:07:27.917864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.917871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.918022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533022092660827:2534]
2025-10-02T08:07:27.918171Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:27.918180Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:27.918341Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:27.918468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:27.918494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 31 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0
2025-10-02T08:07:27.918720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 31 sessionId: src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0 is DEAD
2025-10-02T08:07:27.920938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:27.920955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0] Write session will restart in 0.007224s
2025-10-02T08:07:27.920981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0] Write session: Do CDS request
2025-10-02T08:07:27.920989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:27.925652Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [9928d5162bb16cea] Result# TEvPutResult {Id# [72075186224037892:30:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:27.925690Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:30:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:27.925746Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [47fd2ff13ffe4774] Result# TEvPutResult {Id# [72075186224037892:30:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:27.925786Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:30:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:27.929574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:27.930082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:27.930729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:27.931018Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:27.931037Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:27.931069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:27.931214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:27.931267Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533022092660975:2837]
2025-10-02T08:07:27.931798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:27.932030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:27.932089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:27.932390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:27.932433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.932441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.932442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.932442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.932443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.932449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.932457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.932460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.932462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.932465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.932470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.932475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:27.932480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.932484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:27.932487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.932491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:27.932493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.932497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.932500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.932504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.932518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:27.937101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:27.937118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 32
2025-10-02T08:07:27.937286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:27.937316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 32 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:27.937321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=32 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:27.937325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:27.937765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 32 sessionId:  describe result for acl check
2025-10-02T08:07:27.937791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:27.937793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:27.937794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:27.937800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533022092660992:2839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:27.938306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533022092660992:2839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:27.940914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533022092660992:2839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:27.942022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:27.943943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:27.943965Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:27.943968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:27.943972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:27.943980Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 31 [1:7556533022092660975:2837]
2025-10-02T08:07:27.943994Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:27.944014Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:27.944019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.944027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.944029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.944047Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:27.944053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:27.944064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:27.944139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.944146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.944149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:27.944152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:27.944224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:27.944231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.944244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:27.944260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:27.944294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533022092660968:2837]
2025-10-02T08:07:27.944300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533022092660968:2837]
2025-10-02T08:07:27.944308Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:27.944322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:27.944339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:27.944345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:27.944382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533022092660968:2837]
2025-10-02T08:07:27.944388Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:27.944714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:27.944724Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:27.944731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:27.945394Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 31
2025-10-02T08:07:27.944958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533022553129377:2378], now have 1 active actors on pipe
2025-10-02T08:07:27.952158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533022092660992:2839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:27.952178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533022092660992:2839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:27.952182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533022092660992:2839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:27.952193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 32 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:27.952430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 31
2025-10-02T08:07:27.952438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533022092661032:2839], now have 1 active actors on pipe
2025-10-02T08:07:27.952447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.952452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.952479Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39e847b9-5595c360-ee98870a-9693cfe1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:27.952490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:27.952493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:27.952496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:27.952508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:27.952523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:27.952541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.952588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:27.952599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:27.952624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:27.952664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 32 partition: 0 MaxSeqNo: 17 sessionId: src_id|39e847b9-5595c360-ee98870a-9693cfe1_0
2025-10-02T08:07:27.953091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf83146-27b7a7bb-300495e4-9f32f8cc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|39e847b9-5595c360-ee98870a-9693cfe1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:27.956257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39e847b9-5595c360-ee98870a-9693cfe1_0] Write session: try to update token
2025-10-02T08:07:27.956294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39e847b9-5595c360-ee98870a-9693cfe1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:27.967920Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:27.967938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:27.967940Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:27.967948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533022092660968:2837]
2025-10-02T08:07:27.967955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533022092660968:2837]
2025-10-02T08:07:27.968003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:27.968011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:27.968013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:27.968242Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:27.969040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:27.969051Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:27.980499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: src_id|39e847b9-5595c360-ee98870a-9693cfe1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:27.983315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:28.018270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533026387628347:2534]
2025-10-02T08:07:28.018357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:28.018511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 31, pipe: [1:7556533026387628347:2534]
2025-10-02T08:07:28.140494Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:28.140846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.140863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.140890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387628347:2534], now have 1 active actors on pipe
2025-10-02T08:07:28.140910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.140916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.141151Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:28.141160Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:28.141254Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:28.141396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:28.141478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533026387628347:2534]
2025-10-02T08:07:28.141512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 32 reason: status is not ok: tablet will be restarted right now sessionId: src_id|39e847b9-5595c360-ee98870a-9693cfe1_0
2025-10-02T08:07:28.141703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 32 sessionId: src_id|39e847b9-5595c360-ee98870a-9693cfe1_0 is DEAD
2025-10-02T08:07:28.141842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e847b9-5595c360-ee98870a-9693cfe1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:28.141854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e847b9-5595c360-ee98870a-9693cfe1_0] Write session will restart in 0.008813s
2025-10-02T08:07:28.141880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e847b9-5595c360-ee98870a-9693cfe1_0] Write session: Do CDS request
2025-10-02T08:07:28.141887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e847b9-5595c360-ee98870a-9693cfe1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:28.149103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:28.149568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:28.149776Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:28.149786Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:28.149799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:28.149842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:28.149898Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533026387628463:2844]
2025-10-02T08:07:28.150610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:28.150891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:28.150929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:28.151282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:28.151324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.151329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.151330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.151331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.151332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.151338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.151349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.151353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.151357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.151361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.151367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.151376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.151382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.151387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.151391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.151396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.151401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.151406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.151411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.151416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.151435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:28.152404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39e847b9-5595c360-ee98870a-9693cfe1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:28.152869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:28.152883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 33
2025-10-02T08:07:28.153431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:28.153475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 33 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:28.153486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=33 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:28.153490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:28.154145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 33 sessionId:  describe result for acl check
2025-10-02T08:07:28.154199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:28.154208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:28.154210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:28.154218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533026387628480:2846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:28.154798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533026387628480:2846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:28.158295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533026387628480:2846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:28.161030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:28.161618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533026387628480:2846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:28.161633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533026387628480:2846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:28.161637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533026387628480:2846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:28.161657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 33 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:28.162609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:28.162631Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:28.162633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:28.162637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:28.162644Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 32 [1:7556533026387628463:2844]
2025-10-02T08:07:28.162655Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:28.162672Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:28.162675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.162678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.162679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.162696Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:28.162701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:28.162707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:28.162766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.162774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.162778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:28.162780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:28.162858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:28.162870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.162881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.162889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:28.162893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 32
2025-10-02T08:07:28.162908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387628512:2846], now have 1 active actors on pipe
2025-10-02T08:07:28.162912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533026848096694:2378], now have 1 active actors on pipe
2025-10-02T08:07:28.162917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.162921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.162940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533026387628457:2844]
2025-10-02T08:07:28.162968Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 32
2025-10-02T08:07:28.162948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533026387628457:2844]
2025-10-02T08:07:28.162962Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:28.162974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:28.162986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:28.162988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:28.162991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:28.162994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:28.163004Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:28.163010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.163013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.163015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:28.163025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.163034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:28.163068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533026387628457:2844]
2025-10-02T08:07:28.163075Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:28.163096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.163106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:28.163158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.163168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.163180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.163214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 33 partition: 0 MaxSeqNo: 17 sessionId: src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0
2025-10-02T08:07:28.163585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e847b9-5595c360-ee98870a-9693cfe1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:28.169137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0] Write session: try to update token
2025-10-02T08:07:28.169164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:28.177439Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:28.177463Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:28.177475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533026387628457:2844]
2025-10-02T08:07:28.177530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:28.177528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:28.177726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:28.177887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:28.178129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:28.178283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:28.178496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:28.178546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:28.189275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId: src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:28.192362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:28.192491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.192517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.192558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:28.192593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:28.192765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.192774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.192978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.193054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.193138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.193222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.193286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.193296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.193384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.193466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.193555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.193646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.193716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.193724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.193808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.193881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.193957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.194032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.194091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.194100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.194190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.194267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.194349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.194431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.194494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.194502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.194582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.194655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.194733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.194812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.194878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.194885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.194969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.195042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.195121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.195200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.195260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.195268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.195359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.195438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.195523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.195605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.195769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.195794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.195885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.195961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.196051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.196128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.196327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.196338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.196428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.196493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.196561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.196634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.196702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.196714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.196792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:28.196875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:28.196946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:28.197016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:28.197069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:28.197075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:28.197172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:28.197235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.197253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.197255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:28.197293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:28.197309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:28.197318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:28.197321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:28.197324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:28.197760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:28.197791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:28.197798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:28.197801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:28.197806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:28.197810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:28.198355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:28.198384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:28.198392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:28.198395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:28.198399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:28.198403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:28.199045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:28.199072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:28.199080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:28.199085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:28.199088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:28.200532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:28.200557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:28.200571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392448198
2025-10-02T08:07:28.200701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:28.200721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:28.200729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:28.200736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:28.200740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:28.200743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:28.202193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:28.202223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:28.202230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:28.202235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:28.202239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:28.202243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:28.202747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:28.202772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:28.202780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:28.202784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:28.202789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:28.202793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:28.203827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:28.203852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:28.203858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:28.205101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:28.205123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:28.205129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:28.205133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:28.205143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392448198
2025-10-02T08:07:28.205477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:28.205491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:28.205498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:28.205502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:28.205506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:28.205510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:28.206044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:28.206062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:28.206068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:28.206072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:28.206075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:28.206078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:28.206618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:28.206636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.206747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392448206
2025-10-02T08:07:28.209711Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:28.209738Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:28.209745Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:28.209753Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:28.209766Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:28.209768Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:28.209772Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:28.209781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533026387628457:2844]
2025-10-02T08:07:28.209785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533026387628457:2844]
2025-10-02T08:07:28.209869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:28.209874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.209876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:28.210037Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:28.212957Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:28.212974Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:28.244884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533026387628528:2534]
2025-10-02T08:07:28.244982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:28.247064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 32, pipe: [1:7556533026387628528:2534]
2025-10-02T08:07:28.367540Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:28.368209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387628528:2534], now have 1 active actors on pipe
2025-10-02T08:07:28.368232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.368240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.368972Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:28.370419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:28.370431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0] Write session will restart in 0.005853s
2025-10-02T08:07:28.370457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0] Write session: Do CDS request
2025-10-02T08:07:28.370465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:28.369464Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:28.369476Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:28.370015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533026387628528:2534]
2025-10-02T08:07:28.370038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:28.370061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 33 reason: status is not ok: tablet will be restarted right now sessionId: src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0
2025-10-02T08:07:28.370273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 33 sessionId: src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0 is DEAD
2025-10-02T08:07:28.378663Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [cdbf50fef6380f6f] Result# TEvPutResult {Id# [72075186224037892:32:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:28.378721Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:32:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:28.378864Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:32:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:28.378965Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [005da1a1aed2488b] Result# TEvPutResult {Id# [72075186224037892:32:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:28.381412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:28.381753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:28.381768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 34
2025-10-02T08:07:28.384135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:28.384524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:28.384748Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:28.384753Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:28.384766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:28.384845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:28.384887Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533026387628661:2851]
2025-10-02T08:07:28.385569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:28.385783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:28.385838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:28.386193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:28.386247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.386256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.386258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.386259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.386260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.386266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.386276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.386280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.386285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.386289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.386294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.386302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.386310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.386315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.386320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.386325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.386330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.386347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.386355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.386360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.386381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:28.388968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:28.389040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 34 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:28.389047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=34 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:28.389052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:28.392572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 34 sessionId:  describe result for acl check
2025-10-02T08:07:28.392624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:28.392627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:28.392629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:28.392643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533026387628676:2852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:28.393191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533026387628676:2852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:28.395915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:28.396287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533026387628676:2852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:28.398027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 33
2025-10-02T08:07:28.397554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:28.397576Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:28.397579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:28.397584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:28.397591Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 33 [1:7556533026387628661:2851]
2025-10-02T08:07:28.397608Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:28.397631Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:28.397635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.397639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.397641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.397663Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:28.397670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:28.397678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:28.397753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.397756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.397759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:28.397763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:28.397852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:28.397855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.397873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.397886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:28.397914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533026848096703:2378], now have 1 active actors on pipe
2025-10-02T08:07:28.397923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533026387628654:2851]
2025-10-02T08:07:28.397927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533026387628654:2851]
2025-10-02T08:07:28.397945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:28.397964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:28.397980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:28.397979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:28.397984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:28.397984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:28.398029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533026387628654:2851]
2025-10-02T08:07:28.398045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:28.398048Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:28.408622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533026387628676:2852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:28.408639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533026387628676:2852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:28.408643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533026387628676:2852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:28.408664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 34 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:28.409053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 33
2025-10-02T08:07:28.409070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387628715:2852], now have 1 active actors on pipe
2025-10-02T08:07:28.409082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.409090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.409128Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|641becf4-49867640-1de59baf-c89c8897_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:28.409138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.409144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.409147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:28.409161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.409176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:28.409196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.410035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.410054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.410086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.410129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 34 partition: 0 MaxSeqNo: 17 sessionId: src_id|641becf4-49867640-1de59baf-c89c8897_0
2025-10-02T08:07:28.410758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86d96a7c-cb6ee7c3-83992036-e96e7a25_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|641becf4-49867640-1de59baf-c89c8897_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:28.413767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641becf4-49867640-1de59baf-c89c8897_0] Write session: try to update token
2025-10-02T08:07:28.413791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641becf4-49867640-1de59baf-c89c8897_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:28.414824Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:28.414845Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:28.414857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533026387628654:2851]
2025-10-02T08:07:28.414909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:28.415092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:28.415246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:28.415393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:28.415539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:28.415754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:28.415794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:28.415948Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:28.434095Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:28.434119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:28.434122Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:28.434134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533026387628654:2851]
2025-10-02T08:07:28.434139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533026387628654:2851]
2025-10-02T08:07:28.434191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:28.434199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.434202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:28.434363Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:28.434378Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:28.434384Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:28.448162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId: src_id|641becf4-49867640-1de59baf-c89c8897_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:28.450969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:28.470384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533026387628721:2534]
2025-10-02T08:07:28.470480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:28.470941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 33, pipe: [1:7556533026387628721:2534]
2025-10-02T08:07:28.601425Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:28.601755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.601770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.601792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387628721:2534], now have 1 active actors on pipe
2025-10-02T08:07:28.601806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.601808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.602759Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:28.602773Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:28.602902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533026387628721:2534]
2025-10-02T08:07:28.602919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:28.603429Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:28.602981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 34 reason: status is not ok: tablet will be restarted right now sessionId: src_id|641becf4-49867640-1de59baf-c89c8897_0
2025-10-02T08:07:28.603134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 34 sessionId: src_id|641becf4-49867640-1de59baf-c89c8897_0 is DEAD
2025-10-02T08:07:28.604922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641becf4-49867640-1de59baf-c89c8897_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:28.604936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641becf4-49867640-1de59baf-c89c8897_0] Write session will restart in 0.008977s
2025-10-02T08:07:28.604961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641becf4-49867640-1de59baf-c89c8897_0] Write session: Do CDS request
2025-10-02T08:07:28.604969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641becf4-49867640-1de59baf-c89c8897_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:28.616303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:28.619623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641becf4-49867640-1de59baf-c89c8897_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:28.621174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:28.621191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 35
2025-10-02T08:07:28.621530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:28.621777Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:28.621789Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:28.621800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:28.621861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:28.621909Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533026387628846:2857]
2025-10-02T08:07:28.622667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:28.622892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:28.622946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:28.623297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:28.623350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.623351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.623352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.623354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.623355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.623361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.623373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.623377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.623381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.623385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.623392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.623400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.623407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.623413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.623417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.623423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.623428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.623433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.623439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.623444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.623464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:28.624964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:28.625031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 35 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:28.625044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=35 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:28.625050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:28.625589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 35 sessionId:  describe result for acl check
2025-10-02T08:07:28.625633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:28.625638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:28.625641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:28.625646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533026387628861:2859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:28.626176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533026387628861:2859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:28.631564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533026387628861:2859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:28.641393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533026387628861:2859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:28.641418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533026387628861:2859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:28.641424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533026387628861:2859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:28.641435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 35 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:28.642002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:28.643611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:28.643634Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:28.643637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:28.643642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:28.643651Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 34 [1:7556533026387628846:2857]
2025-10-02T08:07:28.643668Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:28.643687Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:28.643692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.643696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.643700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.643720Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:28.643732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:28.643740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:28.643824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.643835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.643839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:28.643842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:28.643923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:28.643932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.643949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.643963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:28.643990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387628892:2859], now have 1 active actors on pipe
2025-10-02T08:07:28.644002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533026387628838:2857]
2025-10-02T08:07:28.644004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533026387628838:2857]
2025-10-02T08:07:28.644013Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:28.644029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533026848096711:2378], now have 1 active actors on pipe
2025-10-02T08:07:28.644035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 34
2025-10-02T08:07:28.644042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:28.644057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:28.644063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:28.644087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:28.644090Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:28.644105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533026387628838:2857]
2025-10-02T08:07:28.644108Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:28.644110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:28.644115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.644120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.644176Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:28.644188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.644193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.644195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:28.644206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.644221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:28.644248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.644293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 34
2025-10-02T08:07:28.644451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.644462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.644498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.644545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 35 partition: 0 MaxSeqNo: 17 sessionId: src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0
2025-10-02T08:07:28.645082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641becf4-49867640-1de59baf-c89c8897_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:28.647854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0] Write session: try to update token
2025-10-02T08:07:28.647875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:28.667880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId: src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:28.668500Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:28.668528Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:28.668531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:28.668545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533026387628838:2857]
2025-10-02T08:07:28.668549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533026387628838:2857]
2025-10-02T08:07:28.668605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:28.668617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.668619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:28.668824Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:28.668913Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:28.668920Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:28.671083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:28.703324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533026387628908:2534]
2025-10-02T08:07:28.703413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:28.703579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 34, pipe: [1:7556533026387628908:2534]
2025-10-02T08:07:28.823687Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:28.822985Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:28.823311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.823325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.823383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387628908:2534], now have 1 active actors on pipe
2025-10-02T08:07:28.823401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.823402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.823694Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:28.823705Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:28.824037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:28.824096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 35 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0
2025-10-02T08:07:28.826247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:28.826260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0] Write session will restart in 0.008881s
2025-10-02T08:07:28.826283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0] Write session: Do CDS request
2025-10-02T08:07:28.826294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:28.824943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533026387628908:2534]
2025-10-02T08:07:28.825922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 35 sessionId: src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0 is DEAD
2025-10-02T08:07:28.836744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:28.836926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:28.837116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:28.837302Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:28.837313Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:28.837324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:28.837368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:28.837414Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533026387629043:2864]
2025-10-02T08:07:28.838208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:28.838379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:28.838383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 36
2025-10-02T08:07:28.838599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:28.838646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 36 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:28.838651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=36 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:28.838655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:28.838797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:28.838858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:28.839310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:28.839401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.839403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.839404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.839405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.839406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.839414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.839424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.839428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.839431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.839434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.839442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.839451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:28.839458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.839462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:28.839466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.839471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:28.839475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.839479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.839484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.839488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.839507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:28.839781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 36 sessionId:  describe result for acl check
2025-10-02T08:07:28.839811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:28.839812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:28.839814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:28.839820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533026387629059:2872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:28.840421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533026387629059:2872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:28.847403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533026387629059:2872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:28.854866Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 35
2025-10-02T08:07:28.852059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:28.854079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:28.854088Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:28.854092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:28.854096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:28.854104Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 35 [1:7556533026387629043:2864]
2025-10-02T08:07:28.854117Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:28.854137Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:28.854140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.854143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.854146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.854163Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:28.854174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:28.854181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:28.854263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.854265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.854268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:28.854271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:28.854364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:28.854367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.854382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:28.854394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:28.854411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533026387629040:2864]
2025-10-02T08:07:28.854413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533026387629040:2864]
2025-10-02T08:07:28.854420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:28.854436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:28.854451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:28.854454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:28.854491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533026387629040:2864]
2025-10-02T08:07:28.854493Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:28.854556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:28.854559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:28.854565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:28.855197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533026387629059:2872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:28.855207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533026387629059:2872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:28.855209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533026387629059:2872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:28.855217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 36 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:28.855334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533026848096720:2378], now have 1 active actors on pipe
2025-10-02T08:07:28.855835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 35
2025-10-02T08:07:28.855841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387629102:2872], now have 1 active actors on pipe
2025-10-02T08:07:28.855847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.855850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.855866Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|699e985c-35712ee4-83ee13db-4d09a26f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:28.855873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:28.855875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:28.855877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:28.855885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:28.855894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:28.855908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.855932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:28.855934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:28.855944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:28.855965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 36 partition: 0 MaxSeqNo: 17 sessionId: src_id|699e985c-35712ee4-83ee13db-4d09a26f_0
2025-10-02T08:07:28.856461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f221442c-bdd25aa3-eec5f91d-25dc747b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|699e985c-35712ee4-83ee13db-4d09a26f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:28.859665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|699e985c-35712ee4-83ee13db-4d09a26f_0] Write session: try to update token
2025-10-02T08:07:28.859681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|699e985c-35712ee4-83ee13db-4d09a26f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:28.878533Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:28.878562Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:28.878565Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:28.878577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533026387629040:2864]
2025-10-02T08:07:28.878582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533026387629040:2864]
2025-10-02T08:07:28.878638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:28.878647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:28.878650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:28.878828Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:28.880861Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:28.880870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:28.881512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId: src_id|699e985c-35712ee4-83ee13db-4d09a26f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:28.884470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:28.924896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533026387629131:2534]
2025-10-02T08:07:28.924993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:28.925230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 35, pipe: [1:7556533026387629131:2534]
2025-10-02T08:07:29.041855Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:29.042142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.042156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.042199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533026387629131:2534], now have 1 active actors on pipe
2025-10-02T08:07:29.042217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.042223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.042601Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:29.042624Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:29.042670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:29.042788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 36 reason: status is not ok: tablet will be restarted right now sessionId: src_id|699e985c-35712ee4-83ee13db-4d09a26f_0
2025-10-02T08:07:29.042902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533026387629131:2534]
2025-10-02T08:07:29.042976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 36 sessionId: src_id|699e985c-35712ee4-83ee13db-4d09a26f_0 is DEAD
2025-10-02T08:07:29.043221Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:29.045252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699e985c-35712ee4-83ee13db-4d09a26f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:29.045269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699e985c-35712ee4-83ee13db-4d09a26f_0] Write session will restart in 0.006591s
2025-10-02T08:07:29.045295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699e985c-35712ee4-83ee13db-4d09a26f_0] Write session: Do CDS request
2025-10-02T08:07:29.045304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699e985c-35712ee4-83ee13db-4d09a26f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:29.057349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|699e985c-35712ee4-83ee13db-4d09a26f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:29.057737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:29.057753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 37
2025-10-02T08:07:29.060341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:29.060711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:29.060946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:29.060959Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:29.060963Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:29.060975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:29.060987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 37 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:29.060991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=37 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:29.060995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:29.061034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:29.061076Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533030682596564:2883]
2025-10-02T08:07:29.061385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 37 sessionId:  describe result for acl check
2025-10-02T08:07:29.061408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:29.061409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:29.061411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:29.061415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533030682596568:2884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:29.061803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:29.061827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533030682596568:2884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:29.062038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:29.062089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:29.062400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:29.062450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.062451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.062452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.062453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.062454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.062460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.062469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.062473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.062476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.062479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.062484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.062490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.062497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.062502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.062506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.062510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.062515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.062519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.062525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.062528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.062549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:29.068846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533030682596568:2884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:29.071551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:29.073116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:29.073126Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:29.073129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:29.073134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:29.073142Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 36 [1:7556533030682596564:2883]
2025-10-02T08:07:29.073155Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:29.073172Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:29.073174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.073177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.073178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.073193Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:29.073198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:29.073205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:29.073265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.073267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.073271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:29.073274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:29.073322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533030682596568:2884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:29.073332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533030682596568:2884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:29.073336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533030682596568:2884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:29.073344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:29.073346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.073348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 37 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:29.073356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.073364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:29.073382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533031143064056:2378], now have 1 active actors on pipe
2025-10-02T08:07:29.073389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533030682596557:2883]
2025-10-02T08:07:29.073391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533030682596557:2883]
2025-10-02T08:07:29.073399Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:29.073410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:29.073418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:29.073421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:29.073453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533030682596557:2883]
2025-10-02T08:07:29.073455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:29.073512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:29.073516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:29.073524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:29.073761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 36
2025-10-02T08:07:29.073766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533030682596611:2884], now have 1 active actors on pipe
2025-10-02T08:07:29.073771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.073774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.073796Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:29.073802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.073805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.073806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:29.073815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.073824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:29.073836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:29.074146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.074166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.074198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:29.074238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 37 partition: 0 MaxSeqNo: 17 sessionId: src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0
2025-10-02T08:07:29.074244Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 36
2025-10-02T08:07:29.077086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699e985c-35712ee4-83ee13db-4d09a26f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:29.080178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0] Write session: try to update token
2025-10-02T08:07:29.080204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:29.094172Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:29.094189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:29.094198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533030682596557:2883]
2025-10-02T08:07:29.094241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:29.094413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:29.094561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:29.094705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:29.094927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:29.095740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:29.095801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:29.095815Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:29.117903Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:29.117918Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:29.117920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:29.117930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533030682596557:2883]
2025-10-02T08:07:29.117934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533030682596557:2883]
2025-10-02T08:07:29.117977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:29.117983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.117986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:29.118159Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:29.119155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:29.119171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:29.125290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId: src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:29.128468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:29.143119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533030682596624:2534]
2025-10-02T08:07:29.143203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:29.143454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 36, pipe: [1:7556533030682596624:2534]
E1002 08:07:29.245542883  540992 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:25313: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-02T08:07:29.295771Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:29.296058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.296070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.296096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533030682596624:2534], now have 1 active actors on pipe
2025-10-02T08:07:29.296111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.296113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.296554Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:29.296420Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:29.296430Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:29.296738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533030682596624:2534]
2025-10-02T08:07:29.296767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:29.296840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 37 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0
2025-10-02T08:07:29.297034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 37 sessionId: src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0 is DEAD
2025-10-02T08:07:29.297530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:29.297543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0] Write session will restart in 0.007201s
2025-10-02T08:07:29.297566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0] Write session: Do CDS request
2025-10-02T08:07:29.297573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:29.306380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:29.307036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:29.307587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:29.307854Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:29.307869Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:29.307896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:29.308060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:29.308112Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533030682596760:2889]
2025-10-02T08:07:29.308851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:29.309318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:29.309385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:29.309720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:29.309784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.309785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.309787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.309788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.309789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.309796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.309807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.309810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.309813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.309816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.309823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.309831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.309836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.309842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.309847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.309851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.309855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.309860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.309864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.309869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.309889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:29.310955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:29.310965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 38
2025-10-02T08:07:29.311177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:29.311220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 38 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:29.311230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=38 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:29.311234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:29.311704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 38 sessionId:  describe result for acl check
2025-10-02T08:07:29.311740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:29.311747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:29.311749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:29.311755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533030682596777:2892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:29.312314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533030682596777:2892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:29.316245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533030682596777:2892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:29.323882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533030682596777:2892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:29.323904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533030682596777:2892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:29.323908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533030682596777:2892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:29.323919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 38 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:29.325073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:29.326573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:29.326592Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:29.326595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:29.326600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:29.326609Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 37 [1:7556533030682596760:2889]
2025-10-02T08:07:29.326625Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:29.326646Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:29.326650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.326653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.326656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.326674Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:29.326680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:29.326689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:29.326760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.326763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.326766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:29.326770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:29.326872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:29.326876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.326892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.326905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:29.326927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533030682596754:2889]
2025-10-02T08:07:29.326929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533030682596754:2889]
2025-10-02T08:07:29.326939Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:29.326955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533030682596808:2892], now have 1 active actors on pipe
2025-10-02T08:07:29.326959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:29.326964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:29.326966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:29.326979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:29.326983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:29.326990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533031143064066:2378], now have 1 active actors on pipe
2025-10-02T08:07:29.327027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533030682596754:2889]
2025-10-02T08:07:29.327031Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:29.327092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 37
2025-10-02T08:07:29.327120Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:29.327721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.327742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.327775Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:29.327792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.327802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.327806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:29.327819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.327841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:29.327879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:29.328181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.328202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.328228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:29.328293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 38 partition: 0 MaxSeqNo: 17 sessionId: src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0
2025-10-02T08:07:29.328820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2361eb-3c5a417b-5020c72d-80b9eecf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:29.328058Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 37
2025-10-02T08:07:29.331372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0] Write session: try to update token
2025-10-02T08:07:29.331393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:29.352848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId: src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:29.356016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:29.357234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.357251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.357296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:29.357323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:29.357407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.357410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.357690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.357760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.357829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.357895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.358041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.358058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.358133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.358196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.358277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.358351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.358409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.358418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.358507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.358589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.358671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.358742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.358792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.358800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.358885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.358962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.359034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.359112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.359268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.359274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.359352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.359414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.359476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.359543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.359592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.359595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.359682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.359750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.359818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.359891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.359942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.359945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.360020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.360085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.360160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.360227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.360398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.360402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.360478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.360543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.360612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.360683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.360728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.360730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.360960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.361033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.361097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.361162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.361209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.361212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.361283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.361348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.361416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.361489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.361544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.361547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.361645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:29.361718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.361741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.361744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:29.361787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:29.361804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:29.361807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:29.361811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:29.361814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:29.362272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:29.362292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:29.362299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:29.362302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:29.362305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:29.362309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:29.362880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:29.362895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:29.362902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:29.362906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:29.362909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:29.362912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:29.363446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:29.363463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:29.363469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:29.363474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:29.363481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:29.364901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:29.364912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:29.364926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392449364
2025-10-02T08:07:29.365072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:29.365092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:29.365102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:29.365110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:29.365116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:29.365123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:29.365678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:29.365710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:29.365717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:29.365720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:29.365725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:29.365731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:29.366237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:29.366259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:29.366264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:29.366267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:29.366271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:29.366275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:29.366784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:29.366812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:29.366819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:29.368116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:29.368139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:29.368146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:29.368150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:29.368160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392449367
2025-10-02T08:07:29.368503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:29.368745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:29.368757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:29.368761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:29.368765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:29.368768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:29.370241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:29.370262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:29.370270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:29.370276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:29.370281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:29.370286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:29.370854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:29.370868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.370987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392449370
2025-10-02T08:07:29.374038Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:29.374060Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:29.374068Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:29.374076Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:29.374090Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:29.374092Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:29.374095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:29.374104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533030682596754:2889]
2025-10-02T08:07:29.374109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533030682596754:2889]
2025-10-02T08:07:29.374184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:29.374192Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:29.375379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:29.375387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.375390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:29.375565Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:29.397091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533030682596831:2534]
2025-10-02T08:07:29.397190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:29.397389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 37, pipe: [1:7556533030682596831:2534]
2025-10-02T08:07:29.529002Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:29.529654Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:29.529657Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:29.529669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533030682596754:2889]
2025-10-02T08:07:29.529733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:29.529752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533030682596831:2534], now have 1 active actors on pipe
2025-10-02T08:07:29.529769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.529775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.530186Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:29.529922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533030682596831:2534]
2025-10-02T08:07:29.529945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:29.529947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:29.529972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 38 reason: error at write: Disconnected sessionId: src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0
2025-10-02T08:07:29.530183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 38 sessionId: src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0 is DEAD
2025-10-02T08:07:29.530420Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:29.530427Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:29.533021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:29.533032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0] Write session will restart in 0.009734s
2025-10-02T08:07:29.533058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0] Write session: Do CDS request
2025-10-02T08:07:29.533066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:29.544521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:29.544567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:29.544586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 39
2025-10-02T08:07:29.544796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:29.544851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 39 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:29.544862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=39 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:29.544868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:29.545400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 39 sessionId:  describe result for acl check
2025-10-02T08:07:29.545440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:29.545448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:29.545450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:29.545456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533030682596852:2899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:29.545903Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [995b15963325a786] Result# TEvPutResult {Id# [72075186224037892:37:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:29.545960Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:37:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:29.546074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533030682596852:2899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:29.546136Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:37:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:29.548496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533030682596852:2899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:29.551216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:29.551595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:29.551753Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:29.551761Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:29.551770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:29.551804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:29.551835Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533030682596996:2898]
2025-10-02T08:07:29.552306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:29.552540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:29.552589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:29.552896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:29.552963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.552969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.552970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.552971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.552972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.552977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.552988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.552991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.552995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.552998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.553004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.553013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.553020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.553025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.553030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.553034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.553038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.553044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.553049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.553060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.553082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:29.554017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533030682596852:2899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:29.554031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533030682596852:2899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:29.554035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533030682596852:2899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:29.554045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 39 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:29.561971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:29.563587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:29.563606Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:29.563609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:29.563613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:29.563620Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 38 [1:7556533030682596996:2898]
2025-10-02T08:07:29.563634Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:29.563660Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:29.563668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.563672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.563675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.563696Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:29.563708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:29.563722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:29.563805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.563814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.563818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:29.563821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:29.563907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:29.563916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.563933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.563950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:29.563978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533030682596990:2898]
2025-10-02T08:07:29.563985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533030682596990:2898]
2025-10-02T08:07:29.563999Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:29.564021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:29.564043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:29.564049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:29.564093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533030682596990:2898]
2025-10-02T08:07:29.564100Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:29.564221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:29.564232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:29.564238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:29.564411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 38
2025-10-02T08:07:29.564433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533030682597013:2899], now have 1 active actors on pipe
2025-10-02T08:07:29.564442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533031143064073:2378], now have 1 active actors on pipe
2025-10-02T08:07:29.564450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.564457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.564503Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:29.564514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.564519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.564521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:29.564535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.564548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:29.564565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:29.564658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.564664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.564690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:29.564744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 39 partition: 0 MaxSeqNo: 17 sessionId: src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0
2025-10-02T08:07:29.564729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 38
2025-10-02T08:07:29.565157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed3493cc-37a57da7-e17d8a65-38471a30_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:29.567686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0] Write session: try to update token
2025-10-02T08:07:29.567702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:29.586365Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:29.586390Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:29.586392Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:29.586404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533030682596990:2898]
2025-10-02T08:07:29.586410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533030682596990:2898]
2025-10-02T08:07:29.586461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:29.586467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.586470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:29.586632Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:29.589043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:29.589057Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:29.589526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId: src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:29.592323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:29.632928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533030682597026:2534]
2025-10-02T08:07:29.633047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:29.633328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 38, pipe: [1:7556533030682597026:2534]
2025-10-02T08:07:29.775619Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:29.775912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.775923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.775976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533030682597026:2534], now have 1 active actors on pipe
2025-10-02T08:07:29.775992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.775994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.776701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533030682597026:2534]
2025-10-02T08:07:29.776725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:29.776728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:29.776738Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:29.776743Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:29.776816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 39 reason: error at write: Disconnected sessionId: src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0
2025-10-02T08:07:29.777039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 39 sessionId: src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0 is DEAD
2025-10-02T08:07:29.776617Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:29.778635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:29.778649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0] Write session will restart in 0.006057s
2025-10-02T08:07:29.778677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0] Write session: Do CDS request
2025-10-02T08:07:29.778684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:29.786401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:29.786709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:29.786726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 40
2025-10-02T08:07:29.787100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:29.787148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 40 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:29.787157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=40 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:29.787162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:29.787580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 40 sessionId:  describe result for acl check
2025-10-02T08:07:29.787615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:29.787617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:29.787619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:29.787625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533030682597068:2906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:29.788299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533030682597068:2906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:29.792649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533030682597068:2906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:29.793490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:29.794355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:29.794563Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:29.794573Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:29.794586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:29.794656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:29.794700Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533030682597191:2905]
2025-10-02T08:07:29.795318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:29.795819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:29.795866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:29.796204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:29.796257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.796258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.796259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.796260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.796261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.796278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.796287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.796291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.796294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.796298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.796304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.796313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:29.796319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.796324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:29.796329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.796333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:29.796337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.796342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.796345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.796350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.796372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:29.803047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533030682597068:2906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:29.803067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533030682597068:2906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:29.803072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533030682597068:2906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:29.803082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 40 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:29.806392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:29.807929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:29.807948Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:29.807952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:29.807956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:29.807965Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 39 [1:7556533030682597191:2905]
2025-10-02T08:07:29.807981Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:29.808002Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:29.808006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.808009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.808012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.809624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 39
2025-10-02T08:07:29.808033Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:29.808047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:29.808056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:29.808135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.808138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.808141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:29.808145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:29.808226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:29.808229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.808248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:29.808260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:29.808297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533030682597181:2905]
2025-10-02T08:07:29.808299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533030682597181:2905]
2025-10-02T08:07:29.808316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:29.808333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:29.808349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:29.808353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:29.808397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533030682597181:2905]
2025-10-02T08:07:29.808400Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:29.808722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:29.808725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:29.808732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:29.808965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 39
2025-10-02T08:07:29.808982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533030682597208:2906], now have 1 active actors on pipe
2025-10-02T08:07:29.809004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.809012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.809029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533031143064083:2378], now have 1 active actors on pipe
2025-10-02T08:07:29.809050Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:29.809061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.809066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.809068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:29.809081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.809095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:29.809114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:29.809263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.809267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.809283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:29.809314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 40 partition: 0 MaxSeqNo: 17 sessionId: src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0
2025-10-02T08:07:29.810294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74b6b89-bbf7dc54-a0783064-a2867e7b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:29.812995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0] Write session: try to update token
2025-10-02T08:07:29.813019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:29.838747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId: src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:29.841949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:29.842102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.842121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.842160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:29.842185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:29.842316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:29.842327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:29.842520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.842599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.842681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.842762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.842832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.842847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.842932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.843000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.843074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.843154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.843237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.843247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.843329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.843410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.843492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.843578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.843636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.843639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.843719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.843796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.843875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.843949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.844004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.844007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.844102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.844184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.844287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.844373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.844434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.844443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.844538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.844621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.844711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.844797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.844900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.844910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.845003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.845092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.845187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.845273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.845341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.845344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.845439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.845523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.845614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.845695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.845764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.845768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.845862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.845941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.846024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.846115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.846175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.846179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.846278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:29.846359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:29.846443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:29.846529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:29.846594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:29.846597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:29.846691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:29.846762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:29.846786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:29.846789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:29.846826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:29.846841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:29.846845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:29.846848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:29.846852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:29.847327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:29.847347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:29.847353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:29.847360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:29.847366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:29.847370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:29.847975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:29.847991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:29.847997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:29.848000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:29.848004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:29.848007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:29.848651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:29.848669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:29.848676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:29.848680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:29.848683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:29.858650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:29.858689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:29.858711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392449857
2025-10-02T08:07:29.858864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:29.858890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:29.858901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:29.858905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:29.858911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:29.858916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:29.859525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:29.859544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:29.859553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:29.859559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:29.859563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:29.859568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:29.860149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:29.860166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:29.860179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:29.860183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:29.860187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:29.860191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:29.860989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:29.861013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:29.861021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:29.862578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:29.862590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:29.862598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:29.862602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:29.862616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392449861
2025-10-02T08:07:29.863314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:29.863335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:29.863343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:29.863346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:29.863351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:29.863355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:29.863936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:29.863955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:29.863963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:29.863968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:29.863975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:29.863979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:29.864639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:29.864654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:29.864790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392449864
2025-10-02T08:07:29.868105Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:29.868137Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:29.868145Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:29.868153Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:29.868166Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:29.868169Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:29.868171Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:29.868179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533030682597181:2905]
2025-10-02T08:07:29.868183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533030682597181:2905]
2025-10-02T08:07:29.868288Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:29.868299Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:29.868303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:29.868309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:29.868311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:29.868496Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:29.876914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533030682597224:2534]
2025-10-02T08:07:29.877001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:29.883919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 39, pipe: [1:7556533030682597224:2534]
2025-10-02T08:07:30.060247Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:30.060739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533030682597224:2534], now have 1 active actors on pipe
2025-10-02T08:07:30.060768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.060776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.061774Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:30.061963Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:30.061977Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:30.062329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:30.062358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 40 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0
2025-10-02T08:07:30.062586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 40 sessionId: src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0 is DEAD
2025-10-02T08:07:30.062751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533030682597224:2534]
2025-10-02T08:07:30.064929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:30.064945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0] Write session will restart in 0.009848s
2025-10-02T08:07:30.064994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0] Write session: Do CDS request
2025-10-02T08:07:30.065002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:30.069875Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2e94b4afa4b1e351] Result# TEvPutResult {Id# [72075186224037892:39:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:30.069933Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:39:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:30.070001Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:39:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:30.075285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:30.076403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:30.076036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:30.076249Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:30.076253Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:30.076279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:30.076338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:30.076379Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533034977564707:2924]
2025-10-02T08:07:30.076930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:30.076943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 41
2025-10-02T08:07:30.077068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:30.077265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:30.077303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 41 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:30.077313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=41 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:30.077316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:30.077362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:30.077410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:30.077705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:30.077746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.077747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.077748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.077749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.077751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.077757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.077768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.077772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.077776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.077780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.077785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.077793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.077800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.077805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.077810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.077815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.077820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.077825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.077829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.077834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.077846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:30.077891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 41 sessionId:  describe result for acl check
2025-10-02T08:07:30.077922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:30.077924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:30.077926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:30.077932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533034977564721:2926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:30.078497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533034977564721:2926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:30.082663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533034977564721:2926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:30.087474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533034977564721:2926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:30.087494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533034977564721:2926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:30.087498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533034977564721:2926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:30.087508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 41 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:30.088404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:30.090197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:30.090222Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:30.090226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:30.090231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:30.090239Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 40 [1:7556533034977564707:2924]
2025-10-02T08:07:30.090254Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:30.090276Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:30.090279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.090282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.090284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.090302Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:30.090308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:30.090320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:30.090404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.090418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.090422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:30.090426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:30.090507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:30.090515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.090536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.090552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:30.090583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533034977564755:2926], now have 1 active actors on pipe
2025-10-02T08:07:30.090589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 40
2025-10-02T08:07:30.090591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533035438031420:2378], now have 1 active actors on pipe
2025-10-02T08:07:30.090600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533034977564701:2924]
2025-10-02T08:07:30.090602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533034977564701:2924]
2025-10-02T08:07:30.090611Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:30.090628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:30.090631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:30.090634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:30.090642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:30.090646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:30.090862Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 40
2025-10-02T08:07:30.090653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.090663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.090709Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533034977564701:2924]
2025-10-02T08:07:30.090715Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:30.090731Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91e94256-cd59bed-7de82637-3c933979_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:30.090737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.090740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.090742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:30.090750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.090760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:30.090792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:30.090862Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:30.093145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.093164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.093212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:30.093265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 41 partition: 0 MaxSeqNo: 17 sessionId: src_id|91e94256-cd59bed-7de82637-3c933979_0
2025-10-02T08:07:30.096680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8376b58f-d24bac80-d3da0e19-eb3da3c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|91e94256-cd59bed-7de82637-3c933979_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:30.099761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91e94256-cd59bed-7de82637-3c933979_0] Write session: try to update token
2025-10-02T08:07:30.099786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91e94256-cd59bed-7de82637-3c933979_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:30.131099Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:30.131123Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:30.131126Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:30.131140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533034977564701:2924]
2025-10-02T08:07:30.131145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533034977564701:2924]
2025-10-02T08:07:30.131197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:30.131205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.131208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:30.131367Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:30.132332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId: src_id|91e94256-cd59bed-7de82637-3c933979_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:30.133767Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:30.133780Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:30.135204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:30.163658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533034977564769:2534]
2025-10-02T08:07:30.163763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:30.164100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 40, pipe: [1:7556533034977564769:2534]
2025-10-02T08:07:30.292309Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:30.292664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.292682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.292733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533034977564769:2534], now have 1 active actors on pipe
2025-10-02T08:07:30.292751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.292758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.292904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533034977564769:2534]
2025-10-02T08:07:30.292932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:30.292934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:30.292969Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:30.292974Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:30.293018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 41 reason: error at write: Disconnected sessionId: src_id|91e94256-cd59bed-7de82637-3c933979_0
2025-10-02T08:07:30.293202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 41 sessionId: src_id|91e94256-cd59bed-7de82637-3c933979_0 is DEAD
2025-10-02T08:07:30.293623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e94256-cd59bed-7de82637-3c933979_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:30.293635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e94256-cd59bed-7de82637-3c933979_0] Write session will restart in 0.007077s
2025-10-02T08:07:30.293659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e94256-cd59bed-7de82637-3c933979_0] Write session: Do CDS request
2025-10-02T08:07:30.293666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e94256-cd59bed-7de82637-3c933979_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:30.293926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:30.302386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91e94256-cd59bed-7de82637-3c933979_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:30.302787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:30.302998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:30.303011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 42
2025-10-02T08:07:30.303170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:30.303205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 42 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:30.303211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=42 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:30.303215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:30.303669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 42 sessionId:  describe result for acl check
2025-10-02T08:07:30.303707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:30.303708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:30.303710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:30.303716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533034977564911:2933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:30.303790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:30.303979Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:30.303983Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:30.303995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:30.304052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:30.304097Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533034977564913:2930]
2025-10-02T08:07:30.304856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:30.305444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533034977564911:2933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:30.306017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:30.306092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:30.306455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:30.306514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.306515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.306517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.306518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.306520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.306527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.306537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.306542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.306546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.306550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.306556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.306565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.306572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.306577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.306583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.306589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.306593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.306599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.306604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.306610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.306630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:30.308892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533034977564911:2933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:30.318361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:30.319113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533034977564911:2933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:30.319129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533034977564911:2933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:30.319132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533034977564911:2933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:30.319143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 42 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:30.319926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:30.319947Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:30.319950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:30.319955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:30.319963Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 41 [1:7556533034977564913:2930]
2025-10-02T08:07:30.319981Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:30.320001Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:30.320010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.320014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.320017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.320035Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:30.320047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:30.320056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:30.320137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.320144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.320148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:30.320151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:30.320232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:30.320240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.320256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.320290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:30.320296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 41
2025-10-02T08:07:30.320315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533034977564957:2933], now have 1 active actors on pipe
2025-10-02T08:07:30.320324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533035438031428:2378], now have 1 active actors on pipe
2025-10-02T08:07:30.320332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533034977564902:2930]
2025-10-02T08:07:30.320340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533034977564902:2930]
2025-10-02T08:07:30.320351Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:30.320362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.320367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.320384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:30.320394Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:30.320395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:30.320412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:30.320420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:30.320444Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 41
2025-10-02T08:07:30.320474Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:30.320487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.320491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.320493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:30.320504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.320514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:30.320526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533034977564902:2930]
2025-10-02T08:07:30.320540Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:30.320550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:30.320572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:30.320680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.320692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.320720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:30.320759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 42 partition: 0 MaxSeqNo: 17 sessionId: src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0
2025-10-02T08:07:30.321691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91e94256-cd59bed-7de82637-3c933979_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:30.324403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0] Write session: try to update token
2025-10-02T08:07:30.324428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:30.342572Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:30.342595Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:30.342598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:30.342614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533034977564902:2930]
2025-10-02T08:07:30.342619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533034977564902:2930]
2025-10-02T08:07:30.342675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:30.342680Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:30.342687Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:30.342687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.342690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:30.342868Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:30.343507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId: src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:30.354411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:30.392946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533034977564976:2534]
2025-10-02T08:07:30.393026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:30.393225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 41, pipe: [1:7556533034977564976:2534]
2025-10-02T08:07:30.496934Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:30.497265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.497276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.497301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533034977564976:2534], now have 1 active actors on pipe
2025-10-02T08:07:30.497316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.497318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.498098Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:30.498108Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:30.498341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533034977564976:2534]
2025-10-02T08:07:30.498356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:30.498402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 42 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0
2025-10-02T08:07:30.498595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 42 sessionId: src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0 is DEAD
2025-10-02T08:07:30.500986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:30.501002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0] Write session will restart in 0.006881s
2025-10-02T08:07:30.501026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0] Write session: Do CDS request
2025-10-02T08:07:30.501046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:30.501348Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:30.510791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:30.511140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:30.511158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 43
2025-10-02T08:07:30.512535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:30.512571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 43 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:30.512576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=43 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:30.512580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:30.513967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 43 sessionId:  describe result for acl check
2025-10-02T08:07:30.514006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:30.514008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:30.514010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:30.514016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533034977565104:2938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:30.515125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533034977565104:2938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:30.515306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:30.517382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:30.517667Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:30.517672Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:30.517685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:30.517744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:30.517783Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533034977565118:2937]
2025-10-02T08:07:30.518536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:30.518947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:30.519003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:30.519373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:30.519424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.519425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.519427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.519428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.519429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.519435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.519446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.519450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.519453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.519457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.519463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.519471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.519477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.519482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.519487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.519491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.519495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.519500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.519504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.519508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.519531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:30.530363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533034977565104:2938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:30.544180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:30.545956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:30.545978Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:30.545982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:30.545988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:30.545997Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 42 [1:7556533034977565118:2937]
2025-10-02T08:07:30.546013Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:30.546037Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:30.546041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.546045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.546048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.546075Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:30.546082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:30.546091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:30.546186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.546189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.546193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:30.546196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:30.546283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:30.546292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.546309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.546323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:30.546347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533034977565108:2937]
2025-10-02T08:07:30.546349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533034977565108:2937]
2025-10-02T08:07:30.546373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:30.546391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:30.546409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:30.546412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:30.546431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:30.546435Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:30.546458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533034977565108:2937]
2025-10-02T08:07:30.546462Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:30.546516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:30.546861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533034977565104:2938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:30.546868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533034977565104:2938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:30.546872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533034977565104:2938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:30.546883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 43 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:30.547102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533035438031436:2378], now have 1 active actors on pipe
2025-10-02T08:07:30.547285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 42
2025-10-02T08:07:30.547291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533034977565165:2938], now have 1 active actors on pipe
2025-10-02T08:07:30.547352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.547360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.547394Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:30.547405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.547410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.547412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:30.547425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.547440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:30.547458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:30.547827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.547833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.547856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:30.547888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 43 partition: 0 MaxSeqNo: 17 sessionId: src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0
2025-10-02T08:07:30.548416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a62b83b-d20c4d59-9e27e629-953dba1e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:30.549183Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 42
2025-10-02T08:07:30.584065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0] Write session: try to update token
2025-10-02T08:07:30.584088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:30.586319Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:30.586339Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:30.586342Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:30.586353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533034977565108:2937]
2025-10-02T08:07:30.586359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533034977565108:2937]
2025-10-02T08:07:30.586414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:30.586424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.586427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:30.586583Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:30.586924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:30.586931Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:30.604894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533034977565173:2534]
2025-10-02T08:07:30.604991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:30.605288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 42, pipe: [1:7556533034977565173:2534]
2025-10-02T08:07:30.608496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId: src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:30.619502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:30.756114Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:30.756438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533034977565173:2534], now have 1 active actors on pipe
2025-10-02T08:07:30.756465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.756475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.756500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.756501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.758385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:30.758399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0] Write session will restart in 0.005211s
2025-10-02T08:07:30.758422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0] Write session: Do CDS request
2025-10-02T08:07:30.758430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:30.757093Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:30.757107Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:30.757401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:30.757456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 43 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0
2025-10-02T08:07:30.757656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 43 sessionId: src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0 is DEAD
2025-10-02T08:07:30.757658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533034977565173:2534]
2025-10-02T08:07:30.761048Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:30.766252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:30.766867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:30.766885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 44
2025-10-02T08:07:30.767057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:30.767092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 44 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:30.767099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=44 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:30.767103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:30.767601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 44 sessionId:  describe result for acl check
2025-10-02T08:07:30.767638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:30.767645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:30.767647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:30.767654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533034977565185:2944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:30.768247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533034977565185:2944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:30.776320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533034977565185:2944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:30.784340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:30.786012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533034977565185:2944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:30.786029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533034977565185:2944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:30.786032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533034977565185:2944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:30.786042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 44 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:30.790353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:30.790648Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:30.790653Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:30.790666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:30.790732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:30.790775Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533034977565350:2947]
2025-10-02T08:07:30.791503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:30.791791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:30.791848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:30.792133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:30.792169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.792170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.792170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.792171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.792172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.792178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.792198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.792202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.792205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.792209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.792216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.792225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:30.792232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.792238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:30.792242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.792245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:30.792248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.792251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.792254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.792259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.792288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:30.801987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:30.803684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:30.803707Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:30.803712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:30.803716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:30.803725Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 43 [1:7556533034977565350:2947]
2025-10-02T08:07:30.803742Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:30.803762Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:30.803765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.803769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.803772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.803797Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:30.803804Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:30.803813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:30.803886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.803896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.803900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:30.803903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:30.803977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:30.803985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.804000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:30.804015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:30.804041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533034977565346:2944], now have 1 active actors on pipe
2025-10-02T08:07:30.804040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 43
2025-10-02T08:07:30.804054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533034977565336:2947]
2025-10-02T08:07:30.804057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533034977565336:2947]
2025-10-02T08:07:30.804071Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:30.804091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:30.804107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:30.804110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:30.804117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533035438031441:2378], now have 1 active actors on pipe
2025-10-02T08:07:30.804122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.804127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.804185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533034977565336:2947]
2025-10-02T08:07:30.804192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:30.804211Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:30.804217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:30.804220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:30.804224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.804226Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:30.804228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.804230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:30.804245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.804255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:30.804316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:30.804357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.804365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.804378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:30.804412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 44 partition: 0 MaxSeqNo: 17 sessionId: src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0
2025-10-02T08:07:30.804849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5cedd8-429c2124-999dcb1-2ebfd5ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:30.805039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 43
2025-10-02T08:07:30.807906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0] Write session: try to update token
2025-10-02T08:07:30.807927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:30.833829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId: src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:30.837523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:30.837870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.837890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.837937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:30.837966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:30.840907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.840933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.841175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.841443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.841508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.841723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.841853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.841859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.842109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.842366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.842623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.842881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.843021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.843025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.843249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.843473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.843936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.844193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.844356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.844360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.844622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.845106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.845187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.845263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.845411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.845426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.845500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.845557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.845630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.845692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.845735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.845745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.845817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.845877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.845938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.846003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.846050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.846056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.846888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.847743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.847817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.847882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.848006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.848010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.848082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.848145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.848377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.848598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.848719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.848722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.849221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.849477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.849725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.849940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.850057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.850061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.850236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:30.850417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:30.850608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:30.850779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:30.850893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:30.850896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:30.850989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:30.851063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:30.851079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:30.851082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:30.851120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:30.851133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:30.851137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:30.851140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:30.851142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:30.852697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:30.852724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:30.852733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:30.852737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:30.852741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:30.852745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:30.854857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:30.854892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:30.854900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:30.854903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:30.854905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:30.854909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:30.855415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:30.855424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:30.855429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:30.855432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:30.855435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:30.857249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533034977565374:2534]
2025-10-02T08:07:30.857336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:30.857459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 43, pipe: [1:7556533034977565374:2534]
2025-10-02T08:07:30.861245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:30.861287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:30.861306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392450860
2025-10-02T08:07:30.861448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:30.861473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:30.861482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:30.861486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:30.861490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:30.861495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:30.862793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:30.862817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:30.862825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:30.862830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:30.862833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:30.862843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:30.863360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:30.863376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:30.863387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:30.863392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:30.863396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:30.863403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:30.864351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:30.864370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:30.864377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:30.865844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:30.865871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:30.865880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:30.865883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:30.865895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392450865
2025-10-02T08:07:30.866236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:30.866252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:30.866258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:30.866262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:30.866266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:30.866270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:30.867060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:30.867077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:30.867083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:30.867087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:30.867090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:30.867094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:30.867647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:30.867659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:30.867792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392450867
2025-10-02T08:07:30.876277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533034977565374:2534], now have 1 active actors on pipe
2025-10-02T08:07:30.876320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:30.876329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:30.876379Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:30.876402Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:30.876413Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:30.876422Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:30.876437Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:30.876442Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:30.876449Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:30.876456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533034977565336:2947]
2025-10-02T08:07:30.876461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533034977565336:2947]
2025-10-02T08:07:30.876537Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:30.876546Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:30.880113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:30.880131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:30.880133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:30.880326Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:31.034782Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:31.035178Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:31.035182Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:31.035195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533034977565336:2947]
2025-10-02T08:07:31.035393Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:31.036061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:31.036249Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.036278Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.036614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533034977565374:2534]
2025-10-02T08:07:31.037106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:31.037117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0] Write session will restart in 0.009681s
2025-10-02T08:07:31.036637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:31.036662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 44 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0
2025-10-02T08:07:31.036910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 44 sessionId: src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0 is DEAD
2025-10-02T08:07:31.037141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0] Write session: Do CDS request
2025-10-02T08:07:31.037169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:31.042134Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [ad40f1ae8f077692] Result# TEvPutResult {Id# [72075186224037892:43:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:31.042252Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:43:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:31.042357Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:43:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:31.048570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.048654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:31.048675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 45
2025-10-02T08:07:31.048873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.048919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 45 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:31.048926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=45 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:31.048932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:31.049437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 45 sessionId:  describe result for acl check
2025-10-02T08:07:31.049493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:31.049495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:31.049497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:31.049504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533039272532768:2964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:31.050115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533039272532768:2964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:31.055021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:31.056040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533039272532768:2964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:31.056457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:31.056708Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:31.056721Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:31.056732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:31.056786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:31.056851Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533039272532891:2963]
2025-10-02T08:07:31.057536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:31.057786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:31.057835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:31.058147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:31.058195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.058202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.058202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.058203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.058204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.058208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.058214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.058217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.058220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.058222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.058226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.058231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.058234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.058238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.058241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.058244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.058247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.058250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.058252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.058256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.058267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:31.068352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533039272532768:2964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:31.068404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533039272532768:2964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:31.068410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533039272532768:2964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:31.068434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 45 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:31.072476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:31.075298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:31.075323Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:31.075328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:31.075333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:31.075340Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 44 [1:7556533039272532891:2963]
2025-10-02T08:07:31.075356Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:31.075377Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:31.075382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.075387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.075390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.075409Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:31.075415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:31.075421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:31.075505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.075518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.075521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:31.075525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:31.075608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:31.075616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.075632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.075644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:31.075663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533039272532883:2963]
2025-10-02T08:07:31.075670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533039272532883:2963]
2025-10-02T08:07:31.075679Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:31.075698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272532916:2964], now have 1 active actors on pipe
2025-10-02T08:07:31.075697Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:31.075697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 44
2025-10-02T08:07:31.075701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:31.075708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:31.075722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:31.075729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:31.075737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533039732998781:2378], now have 1 active actors on pipe
2025-10-02T08:07:31.075774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.075783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.075797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533039272532883:2963]
2025-10-02T08:07:31.075810Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:31.075834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:31.075841Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:31.075800Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 44
2025-10-02T08:07:31.075846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.075849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.075851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:31.075858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.075865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:31.075888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.075979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.075987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.076000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.076038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 45 partition: 0 MaxSeqNo: 17 sessionId: src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0
2025-10-02T08:07:31.076720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc6dd8f-60076bb6-9978dd60-eeb56fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:31.087278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0] Write session: try to update token
2025-10-02T08:07:31.087307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:31.096518Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:31.096537Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:31.096539Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:31.096548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533039272532883:2963]
2025-10-02T08:07:31.096553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533039272532883:2963]
2025-10-02T08:07:31.096604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:31.096604Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:31.096610Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:31.096613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.096615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:31.097019Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:31.125072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId: src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:31.128307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:31.136891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533039272532930:2534]
2025-10-02T08:07:31.136985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:31.137250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 44, pipe: [1:7556533039272532930:2534]
2025-10-02T08:07:31.253520Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:31.254985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.255007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.255036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272532930:2534], now have 1 active actors on pipe
2025-10-02T08:07:31.255051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.255053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.255176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:31.255182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:31.255232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 45 reason: error at write: Disconnected sessionId: src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0
2025-10-02T08:07:31.255350Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.255370Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.255395Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:31.255448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 45 sessionId: src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0 is DEAD
2025-10-02T08:07:31.255616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:31.255630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0] Write session will restart in 0.006563s
2025-10-02T08:07:31.255617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533039272532930:2534]
2025-10-02T08:07:31.255652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0] Write session: Do CDS request
2025-10-02T08:07:31.255659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:31.263469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.263518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:31.263547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 46
2025-10-02T08:07:31.263758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.263792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 46 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:31.263803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=46 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:31.263806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:31.264431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 46 sessionId:  describe result for acl check
2025-10-02T08:07:31.264466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:31.264468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:31.264470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:31.264475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533039272533067:2970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:31.264934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533039272533067:2970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:31.265318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:31.266557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:31.266779Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:31.266792Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:31.266801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:31.266874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:31.266916Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533039272533090:2969]
2025-10-02T08:07:31.267601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:31.268004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:31.268054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:31.268413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:31.268477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.268484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.268485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.268486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.268487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.268493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.268502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.268505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.268508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.268512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.268518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.268526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.268531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.268536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.268540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.268545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.268550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.268555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.268559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.268565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.268584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:31.269800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533039272533067:2970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:31.276867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533039272533067:2970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:31.276885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533039272533067:2970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:31.276889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533039272533067:2970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:31.276907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 46 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:31.280212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:31.281793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:31.281813Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:31.281815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:31.281820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:31.281826Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 45 [1:7556533039272533090:2969]
2025-10-02T08:07:31.281838Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:31.281861Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:31.281864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.281868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.281871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.281894Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:31.281899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:31.281912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:31.281982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.281990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.281995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:31.281998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:31.282069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:31.282076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.282088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.282101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:31.282120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272533121:2970], now have 1 active actors on pipe
2025-10-02T08:07:31.282132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533039272533073:2969]
2025-10-02T08:07:31.282132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 45
2025-10-02T08:07:31.282134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533039272533073:2969]
2025-10-02T08:07:31.282142Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:31.282151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533039732998788:2378], now have 1 active actors on pipe
2025-10-02T08:07:31.282154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:31.282157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:31.282163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:31.282173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:31.282174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:31.282182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.282189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.282234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533039272533073:2969]
2025-10-02T08:07:31.282249Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:31.282269Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:31.282257Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 45
2025-10-02T08:07:31.282281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.282282Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:31.282285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.282286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:31.282294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.282302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:31.282331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.282415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.282422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.282434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.282472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 46 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0
2025-10-02T08:07:31.282884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45609e9-940a7480-edc6e3c2-ca80672e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:31.285455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0] Write session: try to update token
2025-10-02T08:07:31.285483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:31.301255Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:31.301273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:31.301275Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:31.301284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533039272533073:2969]
2025-10-02T08:07:31.301289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533039272533073:2969]
2025-10-02T08:07:31.301340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:31.301354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.301356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:31.301530Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:31.301546Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:31.301553Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:31.302691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId: src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:31.305948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:31.357990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533039272533139:2534]
2025-10-02T08:07:31.358081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:31.358410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 45, pipe: [1:7556533039272533139:2534]
2025-10-02T08:07:31.469611Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:31.470324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.470356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.470437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272533139:2534], now have 1 active actors on pipe
2025-10-02T08:07:31.470479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.470487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.470662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533039272533139:2534]
2025-10-02T08:07:31.470708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:31.470713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:31.470822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 46 reason: error at write: Disconnected sessionId: src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0
2025-10-02T08:07:31.471025Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:31.471079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 46 sessionId: src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0 is DEAD
2025-10-02T08:07:31.471335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:31.471352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0] Write session will restart in 0.008668s
2025-10-02T08:07:31.471437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0] Write session: Do CDS request
2025-10-02T08:07:31.471445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:31.471967Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.471992Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.478875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:31.479316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:31.479627Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:31.479638Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:31.479652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:31.479699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:31.479754Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533039272533288:2976]
2025-10-02T08:07:31.480532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:31.480782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:31.480856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:31.481272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:31.481326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.481331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.481333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.481334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.481336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.481342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.481352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.481356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.481359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.481363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.481369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.481377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.481384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.481389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.481396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.481401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.481405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.481409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.481419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.481425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.481448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:31.481460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.481549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:31.481557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 47
2025-10-02T08:07:31.481685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.481714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 47 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:31.481725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=47 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:31.481729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:31.482191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 47 sessionId:  describe result for acl check
2025-10-02T08:07:31.482222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:31.482228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:31.482230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:31.482236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533039272533304:2978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:31.482808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533039272533304:2978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:31.485419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533039272533304:2978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:31.491626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533039272533304:2978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:31.491647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533039272533304:2978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:31.491652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533039272533304:2978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:31.491680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 47 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:31.492234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:31.495322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:31.495341Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:31.495344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:31.495349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:31.495357Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 46 [1:7556533039272533288:2976]
2025-10-02T08:07:31.495370Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:31.495392Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:31.495398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.495402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.495405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.495425Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:31.495431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:31.495437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:31.495519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.495529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.495534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:31.495537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:31.495612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:31.495624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.495639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.495649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:31.495670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272533335:2978], now have 1 active actors on pipe
2025-10-02T08:07:31.495679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533039732998797:2378], now have 1 active actors on pipe
2025-10-02T08:07:31.495684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 46
2025-10-02T08:07:31.495686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533039272533282:2976]
2025-10-02T08:07:31.495688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533039272533282:2976]
2025-10-02T08:07:31.495700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:31.495712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:31.495716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:31.495725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:31.495729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:31.495736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.495738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:31.495741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.495755Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 46
2025-10-02T08:07:31.495781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533039272533282:2976]
2025-10-02T08:07:31.495792Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:31.495800Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:31.495811Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16690e11-8187898a-20ff8d25-2fee92e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:31.495817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.495821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.495823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:31.495833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.495847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:31.495917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.496033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.496047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.496073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.496128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 47 partition: 0 MaxSeqNo: 17 sessionId: src_id|16690e11-8187898a-20ff8d25-2fee92e5_0
2025-10-02T08:07:31.496582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5b7d45-16789794-b1e99af-4bc492e7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|16690e11-8187898a-20ff8d25-2fee92e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:31.501645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16690e11-8187898a-20ff8d25-2fee92e5_0] Write session: try to update token
2025-10-02T08:07:31.501669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16690e11-8187898a-20ff8d25-2fee92e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:31.519887Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:31.519904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:31.519907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:31.519917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533039272533282:2976]
2025-10-02T08:07:31.519922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533039272533282:2976]
2025-10-02T08:07:31.519969Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:31.519973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:31.519978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:31.519980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.519983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:31.520325Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:31.523915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId: src_id|16690e11-8187898a-20ff8d25-2fee92e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:31.526626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:31.573082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533039272533351:2534]
2025-10-02T08:07:31.573275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:31.575812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 46, pipe: [1:7556533039272533351:2534]
2025-10-02T08:07:31.671026Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:31.671347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.671365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.671406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272533351:2534], now have 1 active actors on pipe
2025-10-02T08:07:31.671422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.671424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.672194Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.672210Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.672206Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:31.672319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:31.672412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 47 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16690e11-8187898a-20ff8d25-2fee92e5_0
2025-10-02T08:07:31.672541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533039272533351:2534]
2025-10-02T08:07:31.672642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 47 sessionId: src_id|16690e11-8187898a-20ff8d25-2fee92e5_0 is DEAD
2025-10-02T08:07:31.672836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16690e11-8187898a-20ff8d25-2fee92e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:31.672849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16690e11-8187898a-20ff8d25-2fee92e5_0] Write session will restart in 0.006638s
2025-10-02T08:07:31.672910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16690e11-8187898a-20ff8d25-2fee92e5_0] Write session: Do CDS request
2025-10-02T08:07:31.672919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16690e11-8187898a-20ff8d25-2fee92e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:31.680391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16690e11-8187898a-20ff8d25-2fee92e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.680534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:31.680550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 48
2025-10-02T08:07:31.680749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.680815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 48 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:31.680829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=48 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:31.680834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:31.681329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 48 sessionId:  describe result for acl check
2025-10-02T08:07:31.681363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:31.681369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:31.681371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:31.681378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533039272533488:2984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:31.681977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533039272533488:2984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:31.682401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:31.683435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:31.683885Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:31.683897Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:31.683911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:31.683980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:31.684029Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533039272533515:2982]
2025-10-02T08:07:31.684730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:31.684928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533039272533488:2984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:31.684992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:31.685048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:31.685415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:31.685490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.685497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.685498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.685499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.685501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.685507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.685518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.685523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.685526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.685535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.685541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.685549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.685561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.685566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.685577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.685583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.685588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.685594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.685603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.685608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.685627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:31.689232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533039272533488:2984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:31.689250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533039272533488:2984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:31.689254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533039272533488:2984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:31.689263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 48 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:31.698067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:31.701437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:31.701458Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:31.701462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:31.701467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:31.701476Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 47 [1:7556533039272533515:2982]
2025-10-02T08:07:31.701492Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:31.701514Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:31.701518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.701521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.701524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.701540Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:31.701545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:31.701552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:31.701634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.701645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.701649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:31.701651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:31.701746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:31.701756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.701771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.701783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 47
2025-10-02T08:07:31.701791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:31.701811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272533543:2984], now have 1 active actors on pipe
2025-10-02T08:07:31.701839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.701850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.701867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533039732998803:2378], now have 1 active actors on pipe
2025-10-02T08:07:31.701881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533039272533494:2982]
2025-10-02T08:07:31.701884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533039272533494:2982]
2025-10-02T08:07:31.701898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:31.701914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:31.701919Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:31.701923Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:31.701936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:31.701940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:31.701958Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:31.701971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.701976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.701979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:31.701988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.702004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:31.702049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533039272533494:2982]
2025-10-02T08:07:31.702061Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:31.702076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.702087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:31.702029Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 47
2025-10-02T08:07:31.702183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.702192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.702206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.702240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 48 partition: 0 MaxSeqNo: 17 sessionId: src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0
2025-10-02T08:07:31.702706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16690e11-8187898a-20ff8d25-2fee92e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:31.705546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0] Write session: try to update token
2025-10-02T08:07:31.705569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:31.724953Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:31.724974Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:31.724977Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:31.724991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533039272533494:2982]
2025-10-02T08:07:31.724996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533039272533494:2982]
2025-10-02T08:07:31.725046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:31.725061Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:31.725063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.725066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:31.725076Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:31.725255Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:31.725535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId: src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:31.728447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:31.772795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533039272533560:2534]
2025-10-02T08:07:31.772901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:31.773077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 47, pipe: [1:7556533039272533560:2534]
2025-10-02T08:07:31.866867Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:31.867182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.867202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.867253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272533560:2534], now have 1 active actors on pipe
2025-10-02T08:07:31.867273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.867279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.869421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533039272533560:2534]
2025-10-02T08:07:31.869453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:31.869456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:31.869521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 48 reason: error at write: Disconnected sessionId: src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0
2025-10-02T08:07:31.869710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 48 sessionId: src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0 is DEAD
2025-10-02T08:07:31.870981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:31.870993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0] Write session will restart in 0.008600s
2025-10-02T08:07:31.871031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0] Write session: Do CDS request
2025-10-02T08:07:31.871038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:31.872899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:31.876641Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.876677Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:31.881707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.881811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:31.881833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 49
2025-10-02T08:07:31.881999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:31.882049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 49 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:31.882063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=49 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:31.882068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:31.882747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 49 sessionId:  describe result for acl check
2025-10-02T08:07:31.882787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:31.882793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:31.882795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:31.882801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533039272533654:2990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:31.883854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533039272533654:2990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:31.886710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:31.887118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533039272533654:2990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:31.887163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:31.887381Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:31.887386Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:31.887399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:31.887454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:31.887491Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533039272533733:2989]
2025-10-02T08:07:31.888162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:31.888406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:31.888442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:31.888765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:31.888828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.888835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.888836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.888837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.888838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.888843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.888854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.888858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.888863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.888866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.888872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.888880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:31.888887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.888892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:31.888897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.888902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:31.888907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.888913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.888918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.888923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.888944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:31.900034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533039272533654:2990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:31.900056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533039272533654:2990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:31.900061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533039272533654:2990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:31.900073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 49 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:31.902151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:31.904235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:31.904241Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:31.904245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:31.904250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:31.904270Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 48 [1:7556533039272533733:2989]
2025-10-02T08:07:31.904287Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:31.904311Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:31.904315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.904319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.904321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.904342Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:31.904347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:31.904355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:31.904439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.904445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.904449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:31.904452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:31.904536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:31.904539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.904552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:31.904564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:31.904584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533039272533725:2989]
2025-10-02T08:07:31.904586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533039272533725:2989]
2025-10-02T08:07:31.904618Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:31.904633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:31.904648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:31.904651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:31.904680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:31.904684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:31.904697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533039272533725:2989]
2025-10-02T08:07:31.904700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:31.904799Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:31.904903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 48
2025-10-02T08:07:31.904920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272533758:2990], now have 1 active actors on pipe
2025-10-02T08:07:31.904939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533039732998812:2378], now have 1 active actors on pipe
2025-10-02T08:07:31.905002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.905010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.905043Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28a598a8-a07035cc-3d18b443-595fa658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:31.905056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:31.905061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:31.905063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:31.905076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:31.905089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:31.905107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.905203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:31.905206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:31.905222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:31.905253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 49 partition: 0 MaxSeqNo: 17 sessionId: src_id|28a598a8-a07035cc-3d18b443-595fa658_0
2025-10-02T08:07:31.905813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0178b64-8044a24d-7dff6697-bb08c05e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|28a598a8-a07035cc-3d18b443-595fa658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:31.908482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28a598a8-a07035cc-3d18b443-595fa658_0] Write session: try to update token
2025-10-02T08:07:31.908501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28a598a8-a07035cc-3d18b443-595fa658_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:31.905570Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 48
2025-10-02T08:07:31.928279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId: src_id|28a598a8-a07035cc-3d18b443-595fa658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:31.930476Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:31.930496Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:31.930499Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:31.930510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533039272533725:2989]
2025-10-02T08:07:31.930515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533039272533725:2989]
2025-10-02T08:07:31.930570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:31.930577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:31.930584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:31.930774Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:31.932861Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:31.932880Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:31.933254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:31.968854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533039272533771:2534]
2025-10-02T08:07:31.968945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:31.969110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 48, pipe: [1:7556533039272533771:2534]
2025-10-02T08:07:32.088949Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:32.089526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.089542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.089594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533039272533771:2534], now have 1 active actors on pipe
2025-10-02T08:07:32.089616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.089622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.090828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533039272533771:2534]
2025-10-02T08:07:32.090929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:32.090867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:32.090870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:32.090944Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.090952Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.090952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 49 reason: error at write: Disconnected sessionId: src_id|28a598a8-a07035cc-3d18b443-595fa658_0
2025-10-02T08:07:32.091152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 49 sessionId: src_id|28a598a8-a07035cc-3d18b443-595fa658_0 is DEAD
2025-10-02T08:07:32.092928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a598a8-a07035cc-3d18b443-595fa658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:32.092942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a598a8-a07035cc-3d18b443-595fa658_0] Write session will restart in 0.008991s
2025-10-02T08:07:32.092969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a598a8-a07035cc-3d18b443-595fa658_0] Write session: Do CDS request
2025-10-02T08:07:32.092976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a598a8-a07035cc-3d18b443-595fa658_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:32.099504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:32.100117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:32.100345Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:32.100354Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:32.100365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:32.100410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:32.103454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28a598a8-a07035cc-3d18b443-595fa658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.100449Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533043567501268:3008]
2025-10-02T08:07:32.101211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:32.101401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:32.101444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:32.101779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:32.101818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.101819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.101821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.101822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.101823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.101828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.101838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.101842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.101846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.101849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.101854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.101862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.101867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.101873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.101877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.101882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.101887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.101891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.101895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.101900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.101917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:32.103919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:32.103924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 50
2025-10-02T08:07:32.104096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.104121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 50 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:32.104126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=50 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:32.104129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:32.104529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 50 sessionId:  describe result for acl check
2025-10-02T08:07:32.104555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:32.104565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:32.104567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:32.104574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533043567501285:3010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:32.105086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533043567501285:3010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:32.107328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533043567501285:3010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:32.115918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533043567501285:3010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:32.115934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533043567501285:3010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:32.115937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533043567501285:3010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:32.115946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 50 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:32.117056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:32.119031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:32.119059Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:32.119063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:32.119070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:32.119080Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 49 [1:7556533043567501268:3008]
2025-10-02T08:07:32.119098Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:32.119124Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:32.119129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.119134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.119136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.119160Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:32.119167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:32.119176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:32.119265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.119268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.119272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:32.119275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:32.119369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:32.119373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.119392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.119407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:32.119430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533043567501262:3008]
2025-10-02T08:07:32.119433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533043567501262:3008]
2025-10-02T08:07:32.119453Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:32.119471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:32.119488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:32.119492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:32.119536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533043567501262:3008]
2025-10-02T08:07:32.119539Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:32.120117Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 49
2025-10-02T08:07:32.119789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:32.119797Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:32.119804Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:32.120548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 49
2025-10-02T08:07:32.120564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567501313:3010], now have 1 active actors on pipe
2025-10-02T08:07:32.120568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533044027966150:2378], now have 1 active actors on pipe
2025-10-02T08:07:32.120703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.120712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.120744Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:32.120755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.120759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.120761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:32.120774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.120787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:32.120823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.120934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.120939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.120959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.120993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 50 partition: 0 MaxSeqNo: 17 sessionId: src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0
2025-10-02T08:07:32.121504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a598a8-a07035cc-3d18b443-595fa658_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:32.124176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0] Write session: try to update token
2025-10-02T08:07:32.124193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:32.147660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId: src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:32.150330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:32.150480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.150502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.150546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:32.150580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:32.150655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.150662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.150848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.151024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.151123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.151190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.151338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.151348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.151459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.151568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.151636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.151704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.151846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.151855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.151935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.152049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.152162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.152294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.152350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.152360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.152435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.152516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.152597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.152672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.152730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.152740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.152836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.152902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.152972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.153042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.153208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.153223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.153311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.153397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.153478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.153550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.153626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.153636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.153725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.153801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.153878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.153953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.154026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.154033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.154112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.154196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.154265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.154339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.154422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.154429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.154501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.154562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.154643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.154721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.154785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.154795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.154907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:32.154971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:32.155039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:32.155110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:32.155171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:32.155185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:32.155258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:32.155328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.155352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.155355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:32.155389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:32.155407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:32.155412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:32.155415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:32.155418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:32.155844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:32.155876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:32.155888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:32.155892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:32.155901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:32.155905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:32.157972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:32.158002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:32.158010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:32.158013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:32.158016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:32.158020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:32.158614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:32.158635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:32.158640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:32.158643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:32.158645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:32.160209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:32.160222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:32.160233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392452159
2025-10-02T08:07:32.160358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:32.160371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:32.160374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:32.160378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:32.160381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:32.160384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:32.162650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:32.162685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:32.162694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:32.162698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:32.162703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:32.162707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:32.163285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:32.163299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:32.163308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:32.163311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:32.163315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:32.163320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:32.163949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:32.163963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:32.163968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:32.165419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:32.165441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:32.165445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:32.165448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:32.165456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392452165
2025-10-02T08:07:32.166101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:32.166121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:32.166130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:32.166135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:32.166138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:32.166141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:32.166612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:32.166633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:32.166638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:32.166642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:32.166645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:32.166649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:32.167439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:32.167460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.167574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392452167
2025-10-02T08:07:32.170483Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:32.170509Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:32.170516Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:32.170522Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:32.170535Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:32.170538Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:32.170541Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:32.170546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533043567501262:3008]
2025-10-02T08:07:32.170549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533043567501262:3008]
2025-10-02T08:07:32.170604Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:32.170617Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:32.173696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:32.173715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.173717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:32.173913Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:32.191073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533043567501328:2534]
2025-10-02T08:07:32.191146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:32.191302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 49, pipe: [1:7556533043567501328:2534]
2025-10-02T08:07:32.318369Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:32.318783Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:32.318795Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:32.318809Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533043567501262:3008]
2025-10-02T08:07:32.318885Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:32.318904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567501328:2534], now have 1 active actors on pipe
2025-10-02T08:07:32.318922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.318936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.319154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:32.319165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:32.319197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 50 reason: error at write: Disconnected sessionId: src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0
2025-10-02T08:07:32.319238Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.319249Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.319266Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:32.319416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 50 sessionId: src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0 is DEAD
2025-10-02T08:07:32.319549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:32.319559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0] Write session will restart in 0.008329s
2025-10-02T08:07:32.319530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533043567501328:2534]
2025-10-02T08:07:32.319580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0] Write session: Do CDS request
2025-10-02T08:07:32.319587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:32.325449Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [9f3ce15a5a7e4ae7] Result# TEvPutResult {Id# [72075186224037892:49:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:32.325503Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:49:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:32.325572Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:49:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:32.329504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.329666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:32.329683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 51
2025-10-02T08:07:32.329941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.329997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 51 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:32.330008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=51 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:32.330011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:32.330220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:32.330448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 51 sessionId:  describe result for acl check
2025-10-02T08:07:32.330491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:32.330492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:32.330494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:32.330499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533043567501494:3017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:32.330796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:32.330986Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:32.330996Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:32.331005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:32.331053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:32.331112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533043567501494:3017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:32.331260Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533043567501497:3015]
2025-10-02T08:07:32.332212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:32.332529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:32.332588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:32.332960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:32.333017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.333026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.333028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.333029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.333030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.333036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.333046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.333051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.333055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.333059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.333064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.333070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.333076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.333081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.333086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.333091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.333095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.333100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.333105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.333110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.333131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:32.333828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533043567501494:3017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:32.341809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:32.342096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533043567501494:3017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:32.342107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533043567501494:3017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:32.342110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533043567501494:3017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:32.342120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 51 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:32.343551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:32.343573Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:32.343576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:32.343580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:32.343588Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 50 [1:7556533043567501497:3015]
2025-10-02T08:07:32.343599Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:32.343617Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:32.343620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.343623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.343626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.343643Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:32.343649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:32.343655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:32.343720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.343723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.343726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:32.343728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:32.343803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:32.343806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.343810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 50
2025-10-02T08:07:32.343818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.343830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:32.343850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567501542:3017], now have 1 active actors on pipe
2025-10-02T08:07:32.343855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.343859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.343875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533043567501489:3015]
2025-10-02T08:07:32.343878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533043567501489:3015]
2025-10-02T08:07:32.343885Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:32.343896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:32.343910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:32.343913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:32.343928Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2feadb17-f86e7dab-519f818d-92d9d628_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:32.343935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.343938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.343940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:32.343949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.343957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:32.343974Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:32.343977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:32.343994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533043567501489:3015]
2025-10-02T08:07:32.343999Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:32.344000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:32.344010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.344027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533044027966161:2378], now have 1 active actors on pipe
2025-10-02T08:07:32.344153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.344171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.344197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.344243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 51 partition: 0 MaxSeqNo: 17 sessionId: src_id|2feadb17-f86e7dab-519f818d-92d9d628_0
2025-10-02T08:07:32.344682Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 50
2025-10-02T08:07:32.345156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37939715-b4c797c4-5f8cbeb3-b097180b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2feadb17-f86e7dab-519f818d-92d9d628_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:32.348225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2feadb17-f86e7dab-519f818d-92d9d628_0] Write session: try to update token
2025-10-02T08:07:32.348249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2feadb17-f86e7dab-519f818d-92d9d628_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:32.365317Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:32.365346Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:32.365349Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:32.365358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533043567501489:3015]
2025-10-02T08:07:32.365367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533043567501489:3015]
2025-10-02T08:07:32.365411Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:32.365417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:32.365417Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:32.365423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.365427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:32.365598Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:32.367163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId: src_id|2feadb17-f86e7dab-519f818d-92d9d628_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:32.370273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:32.419942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533043567501562:2534]
2025-10-02T08:07:32.420046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:32.420236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 50, pipe: [1:7556533043567501562:2534]
2025-10-02T08:07:32.524374Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:32.524849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.524869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.524913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567501562:2534], now have 1 active actors on pipe
2025-10-02T08:07:32.524932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.524939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.525476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:32.525687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feadb17-f86e7dab-519f818d-92d9d628_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:32.525697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feadb17-f86e7dab-519f818d-92d9d628_0] Write session will restart in 0.005373s
2025-10-02T08:07:32.525721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feadb17-f86e7dab-519f818d-92d9d628_0] Write session: Do CDS request
2025-10-02T08:07:32.525727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feadb17-f86e7dab-519f818d-92d9d628_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:32.525135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:32.525149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:32.525193Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.525198Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.525251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 51 reason: error at write: Disconnected sessionId: src_id|2feadb17-f86e7dab-519f818d-92d9d628_0
2025-10-02T08:07:32.525465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 51 sessionId: src_id|2feadb17-f86e7dab-519f818d-92d9d628_0 is DEAD
2025-10-02T08:07:32.525521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533043567501562:2534]
2025-10-02T08:07:32.532492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2feadb17-f86e7dab-519f818d-92d9d628_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.532561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:32.532581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 52
2025-10-02T08:07:32.532766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.532841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 52 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:32.532853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=52 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:32.532867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:32.533419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 52 sessionId:  describe result for acl check
2025-10-02T08:07:32.533460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:32.533468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:32.533470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:32.533473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533043567501678:3022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:32.534041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533043567501678:3022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:32.535982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:32.536656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:32.536745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533043567501678:3022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:32.537028Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:32.537041Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:32.537055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:32.537133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:32.537175Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533043567501738:3021]
2025-10-02T08:07:32.537798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:32.538068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:32.538127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:32.538490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:32.538527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.538533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.538534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.538534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.538535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.538540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.538547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.538549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.538552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.538554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.538558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.538563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.538566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.538570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.538572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.538575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.538577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.538580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.538583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.538586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.538597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:32.545391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533043567501678:3022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:32.545417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533043567501678:3022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:32.545421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533043567501678:3022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:32.545429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 52 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:32.549773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:32.551219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:32.551238Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:32.551242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:32.551246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:32.551253Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 51 [1:7556533043567501738:3021]
2025-10-02T08:07:32.551269Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:32.551291Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:32.551300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.551303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.551305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.551319Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:32.551326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:32.551334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:32.551391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.551398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.551402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:32.551404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:32.551464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:32.551477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.551487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.551495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:32.551511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533043567501731:3021]
2025-10-02T08:07:32.551513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533043567501731:3021]
2025-10-02T08:07:32.551519Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:32.551529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:32.551538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:32.551540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:32.551550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567501766:3022], now have 1 active actors on pipe
2025-10-02T08:07:32.551553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533044027966168:2378], now have 1 active actors on pipe
2025-10-02T08:07:32.551552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 51
2025-10-02T08:07:32.551585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533043567501731:3021]
2025-10-02T08:07:32.551592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:32.551632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:32.551650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:32.551660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:32.551693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.551705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.551729Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:32.551743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.551747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.551730Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 51
2025-10-02T08:07:32.551749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:32.551759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.551767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:32.551781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.551825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.551839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.551870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.551929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 52 partition: 0 MaxSeqNo: 17 sessionId: src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0
2025-10-02T08:07:32.552314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feadb17-f86e7dab-519f818d-92d9d628_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:32.562139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0] Write session: try to update token
2025-10-02T08:07:32.562166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:32.563447Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:32.563465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:32.563476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533043567501731:3021]
2025-10-02T08:07:32.563528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:32.563529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:32.563711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:32.563866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:32.564029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:32.564177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:32.564387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:32.564430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:32.577625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId: src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:32.589528Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:32.589555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:32.589558Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:32.589571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533043567501731:3021]
2025-10-02T08:07:32.589576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533043567501731:3021]
2025-10-02T08:07:32.589636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:32.589650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.589650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:32.589658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:32.589658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:32.589806Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:32.596821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:32.625758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533043567501779:2534]
2025-10-02T08:07:32.625855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:32.626027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 51, pipe: [1:7556533043567501779:2534]
2025-10-02T08:07:32.734344Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:32.734800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.734820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.734848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567501779:2534], now have 1 active actors on pipe
2025-10-02T08:07:32.734869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.734871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.735018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533043567501779:2534]
2025-10-02T08:07:32.735048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:32.735050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:32.735103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 52 reason: error at write: Disconnected sessionId: src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0
2025-10-02T08:07:32.735194Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.735216Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.735223Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:32.735420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 52 sessionId: src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0 is DEAD
2025-10-02T08:07:32.735502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:32.735511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0] Write session will restart in 0.008077s
2025-10-02T08:07:32.735532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0] Write session: Do CDS request
2025-10-02T08:07:32.735539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:32.744388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.744648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:32.744672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 53
2025-10-02T08:07:32.744875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.744928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 53 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:32.744940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=53 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:32.744945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:32.745505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 53 sessionId:  describe result for acl check
2025-10-02T08:07:32.745513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:32.745560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:32.745569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:32.745572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:32.745577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533043567501937:3030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:32.746101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533043567501937:3030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:32.746111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:32.746345Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:32.746355Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:32.746368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:32.746432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:32.746483Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533043567501945:3028]
2025-10-02T08:07:32.747032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:32.747287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:32.747330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:32.747595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:32.747644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.747649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.747652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.747653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.747654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.747660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.747671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.747679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.747684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.747687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.747695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.747703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.747713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.747719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.747722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.747728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.747731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.747736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.747741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.747746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.747768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:32.748353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533043567501937:3030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:32.758498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533043567501937:3030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:32.758520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533043567501937:3030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:32.758524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533043567501937:3030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:32.758536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 53 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:32.758992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:32.760724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:32.760745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:32.760748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:32.760752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:32.760760Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 52 [1:7556533043567501945:3028]
2025-10-02T08:07:32.760776Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:32.760794Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:32.760796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.760799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.760819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.760839Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:32.760845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:32.760857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:32.760923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.760932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.760935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:32.760938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:32.761003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:32.761017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.761031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.761044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:32.761065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567501986:3030], now have 1 active actors on pipe
2025-10-02T08:07:32.761071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533043567501935:3028]
2025-10-02T08:07:32.761074Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533043567501935:3028]
2025-10-02T08:07:32.761089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:32.761098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533044027966175:2378], now have 1 active actors on pipe
2025-10-02T08:07:32.761103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 52
2025-10-02T08:07:32.761106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:32.761118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:32.761121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:32.761125Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:32.761129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:32.761157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533043567501935:3028]
2025-10-02T08:07:32.761173Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:32.761180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.761181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:32.761186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.761240Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:32.761254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.761258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.761261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:32.761269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.761230Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 52
2025-10-02T08:07:32.761278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:32.761309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.761363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.761372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.761384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.761427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 53 partition: 0 MaxSeqNo: 17 sessionId: src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0
2025-10-02T08:07:32.762698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5a1793-e1d1c453-8aac2922-b6958b18_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:32.765535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0] Write session: try to update token
2025-10-02T08:07:32.765553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:32.782600Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:32.782622Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:32.782625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:32.782634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533043567501935:3028]
2025-10-02T08:07:32.782639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533043567501935:3028]
2025-10-02T08:07:32.782675Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:32.782681Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:32.782682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:32.782689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.782691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:32.782792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId: src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:32.782846Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:32.785632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:32.835157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533043567502002:2534]
2025-10-02T08:07:32.835243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:32.835387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 52, pipe: [1:7556533043567502002:2534]
2025-10-02T08:07:32.932060Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:32.932461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.932483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.932529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567502002:2534], now have 1 active actors on pipe
2025-10-02T08:07:32.932553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.932556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.932793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533043567502002:2534]
2025-10-02T08:07:32.932861Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.932862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:32.932865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:32.932866Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:32.933547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:32.933558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0] Write session will restart in 0.008204s
2025-10-02T08:07:32.933585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0] Write session: Do CDS request
2025-10-02T08:07:32.933593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:32.932955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 53 reason: error at write: Disconnected sessionId: src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0
2025-10-02T08:07:32.933198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 53 sessionId: src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0 is DEAD
2025-10-02T08:07:32.932984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:32.943400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.943589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:32.943608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 54
2025-10-02T08:07:32.944219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:32.944269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 54 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:32.944281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=54 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:32.944286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:32.944771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 54 sessionId:  describe result for acl check
2025-10-02T08:07:32.944829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:32.944831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:32.944833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:32.944839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533043567502155:3036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:32.945204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:32.945437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533043567502155:3036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:32.951775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533043567502155:3036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:32.952491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:32.952725Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:32.952729Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:32.952742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:32.952818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:32.952857Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533043567502189:3034]
2025-10-02T08:07:32.954474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:32.955225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:32.955280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:32.955725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:32.955763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.955764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.955766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.955767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.955768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.955774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.955786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.955791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.955795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.955799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.955805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.955814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:32.955821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.955826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:32.955832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.955837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:32.955841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.955847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.955851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.955856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.955880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:32.971605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533043567502155:3036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:32.971625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533043567502155:3036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:32.971629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533043567502155:3036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:32.971638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 54 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:32.973551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:32.975312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:32.975331Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:32.975335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:32.975338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:32.975346Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 53 [1:7556533043567502189:3034]
2025-10-02T08:07:32.975359Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:32.975378Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:32.975381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.975385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.975399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.975417Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:32.975423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:32.975430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:32.975514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.975524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.975528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:32.975531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:32.975606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:32.975616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:32.975645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:32.975665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:32.975690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533043567502209:3036], now have 1 active actors on pipe
2025-10-02T08:07:32.975708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533044027966183:2378], now have 1 active actors on pipe
2025-10-02T08:07:32.975716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533043567502157:3034]
2025-10-02T08:07:32.975725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533043567502157:3034]
2025-10-02T08:07:32.975733Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:32.975745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:32.975766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:32.975776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:32.975810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533043567502157:3034]
2025-10-02T08:07:32.975821Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:32.975831Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:32.975835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:32.975842Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:32.975871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 53
2025-10-02T08:07:32.975961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.975969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.975992Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a79098c-27403e11-13110f2b-68919cb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:32.976004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:32.976012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:32.976014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:32.976022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:32.976031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:32.976052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.976081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:32.976088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:32.976108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:32.976139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 54 partition: 0 MaxSeqNo: 17 sessionId: src_id|5a79098c-27403e11-13110f2b-68919cb6_0
2025-10-02T08:07:32.976616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ba260a-98f1fc20-ba6b0a8c-ffc5198e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5a79098c-27403e11-13110f2b-68919cb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:32.977004Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 53
2025-10-02T08:07:32.985596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a79098c-27403e11-13110f2b-68919cb6_0] Write session: try to update token
2025-10-02T08:07:32.985624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a79098c-27403e11-13110f2b-68919cb6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:33.008554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId: src_id|5a79098c-27403e11-13110f2b-68919cb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:33.011930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:33.023690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.023725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.023784Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:33.023795Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:33.023798Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:33.023810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533043567502157:3034]
2025-10-02T08:07:33.023815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533043567502157:3034]
2025-10-02T08:07:33.024119Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:33.024138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:33.025122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:33.025147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.025150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:33.025635Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:33.034325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533047862469528:2534]
2025-10-02T08:07:33.034411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:33.035192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 53, pipe: [1:7556533047862469528:2534]
2025-10-02T08:07:33.202197Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:33.202684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:33.202725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:33.202728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:33.202739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533043567502157:3034]
2025-10-02T08:07:33.202785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862469528:2534], now have 1 active actors on pipe
2025-10-02T08:07:33.202804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.202809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.202851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:33.202881Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:33.203110Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:33.203452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:33.203454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:33.203471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 54 reason: error at write: Disconnected sessionId: src_id|5a79098c-27403e11-13110f2b-68919cb6_0
2025-10-02T08:07:33.203663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 54 sessionId: src_id|5a79098c-27403e11-13110f2b-68919cb6_0 is DEAD
2025-10-02T08:07:33.203853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533047862469528:2534]
2025-10-02T08:07:33.204143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a79098c-27403e11-13110f2b-68919cb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:33.204157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a79098c-27403e11-13110f2b-68919cb6_0] Write session will restart in 0.005796s
2025-10-02T08:07:33.204184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a79098c-27403e11-13110f2b-68919cb6_0] Write session: Do CDS request
2025-10-02T08:07:33.204192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a79098c-27403e11-13110f2b-68919cb6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:33.205599Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:33.213407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a79098c-27403e11-13110f2b-68919cb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:33.213488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:33.213506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 55
2025-10-02T08:07:33.214040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:33.214086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 55 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:33.214097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=55 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:33.214102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:33.216480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 55 sessionId:  describe result for acl check
2025-10-02T08:07:33.216539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:33.216545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:33.216547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:33.216553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533047862469718:3054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:33.217204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533047862469718:3054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:33.219233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:33.221097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533047862469718:3054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:33.227029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:33.227285Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:33.227299Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:33.227309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:33.227378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:33.227426Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533047862469762:3053]
2025-10-02T08:07:33.228129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:33.228243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533047862469718:3054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:33.228267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533047862469718:3054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:33.228270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533047862469718:3054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:33.228279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 55 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:33.228449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:33.228506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:33.229003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:33.229091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.229096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.229097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.229098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.229100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.229104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.229115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.229119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.229122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.229126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.229133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.229140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.229147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.229152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.229157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.229162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.229165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.229171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.229176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.229181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.229201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:33.249855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:33.251671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:33.251678Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:33.251681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:33.251686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:33.251694Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 54 [1:7556533047862469762:3053]
2025-10-02T08:07:33.251709Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:33.251730Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:33.251734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.251737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.251740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.251762Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:33.251768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:33.251775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:33.251842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.251844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.251847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:33.251850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:33.251934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:33.251937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.251950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.251961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:33.251978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533047862469734:3053]
2025-10-02T08:07:33.251980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533047862469734:3053]
2025-10-02T08:07:33.251993Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:33.252006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:33.252020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:33.252023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:33.252061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533047862469734:3053]
2025-10-02T08:07:33.252063Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:33.252438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:33.252455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:33.252465Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:33.252818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 54
2025-10-02T08:07:33.252741Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 54
2025-10-02T08:07:33.252832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862469772:3054], now have 1 active actors on pipe
2025-10-02T08:07:33.252837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533048322933522:2378], now have 1 active actors on pipe
2025-10-02T08:07:33.252843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.252849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.252878Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:33.252886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.252891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.252893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:33.252908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.252921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:33.252946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:33.253064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.253076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.253100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:33.253146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 55 partition: 0 MaxSeqNo: 17 sessionId: src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0
2025-10-02T08:07:33.254285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a79098c-27403e11-13110f2b-68919cb6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:33.257237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0] Write session: try to update token
2025-10-02T08:07:33.257259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:33.269517Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:33.269538Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:33.269553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533047862469734:3053]
2025-10-02T08:07:33.269595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:33.269605Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:33.269761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:33.269907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:33.270084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:33.270348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:33.270597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:33.270648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:33.284900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId: src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:33.287959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:33.288040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.288054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.288085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:33.288107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:33.288157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.288171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.288366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.288677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.288783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.288904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.289471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.289479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.289558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.289625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.289689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.289760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.289808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.289812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.289891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.289952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.290014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.290081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.290132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.290135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.290214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.290287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.290362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.290428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.290472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.290476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.290586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.290676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.290766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.290889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.291042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.291056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.291153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.291225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.291298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.291373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.291427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.291437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.291513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.291619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.291816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.291894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.291940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.291944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.292092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.292156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.292225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.292359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.292417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.292420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.292501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.292569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.292640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.292714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.292766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.292770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.292985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.293101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.293184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.293264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.293318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.293322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.293412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:33.293484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.293507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.293510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:33.293555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:33.293573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:33.293576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:33.293579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:33.293584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:33.294066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:33.294088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:33.294095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:33.294098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:33.294100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:33.294105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:33.294713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:33.294726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:33.294732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:33.294735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:33.294739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:33.294742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:33.295499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:33.295515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:33.295521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:33.295525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:33.295528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:33.297137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:33.297156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:33.297170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392453296
2025-10-02T08:07:33.297304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:33.297315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:33.297320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:33.297324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:33.297328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:33.297332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:33.298044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:33.298060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:33.298071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:33.298074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:33.298080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:33.298083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:33.298648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:33.298663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:33.298670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:33.298674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:33.298677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:33.298681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:33.299272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:33.299288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:33.299295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:33.300563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:33.300578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:33.300585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:33.300588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:33.300599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392453299
2025-10-02T08:07:33.301175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:33.301206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:33.301213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:33.301216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:33.301219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:33.301223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:33.301783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:33.301800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:33.301807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:33.301810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:33.301814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:33.301818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:33.302385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:33.302399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.302548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392453302
2025-10-02T08:07:33.304293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533047862469796:2534]
2025-10-02T08:07:33.304394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:33.304625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 54, pipe: [1:7556533047862469796:2534]
2025-10-02T08:07:33.305491Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:33.305530Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:33.305539Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:33.305548Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:33.305569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862469796:2534], now have 1 active actors on pipe
2025-10-02T08:07:33.305592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.305599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.305624Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:33.305627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:33.305631Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:33.305639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533047862469734:3053]
2025-10-02T08:07:33.305642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533047862469734:3053]
2025-10-02T08:07:33.305752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:33.305756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.305759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:33.305771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:33.305778Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:33.305903Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:33.461530Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:33.462136Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:33.462153Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:33.462171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:33.462198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 55 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0
2025-10-02T08:07:33.462384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 55 sessionId: src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0 is DEAD
2025-10-02T08:07:33.462503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533047862469796:2534]
2025-10-02T08:07:33.462585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:33.462596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0] Write session will restart in 0.007392s
2025-10-02T08:07:33.462619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0] Write session: Do CDS request
2025-10-02T08:07:33.462627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:33.462610Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:33.466887Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [92121f1b85523e1f] Result# TEvPutResult {Id# [72075186224037892:54:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:33.466974Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:54:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:33.467023Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:54:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:33.471397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:33.471517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:33.471538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 56
2025-10-02T08:07:33.471683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:33.471723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 56 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:33.471736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=56 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:33.471740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:33.472237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 56 sessionId:  describe result for acl check
2025-10-02T08:07:33.472288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:33.472294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:33.472296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:33.472300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533047862469963:3061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:33.472586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:33.472831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533047862469963:3061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:33.473121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:33.473318Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:33.473330Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:33.473344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:33.473396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:33.473446Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533047862469977:3060]
2025-10-02T08:07:33.474342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:33.474532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:33.474598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:33.474944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:33.475004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.475011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.475012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.475014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.475014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.475020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.475029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.475033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.475035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.475037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.475041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.475046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.475050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.475053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.475055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.475058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.475060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.475063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.475065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.475068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.475083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:33.475367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533047862469963:3061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:33.481252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533047862469963:3061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:33.481271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533047862469963:3061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:33.481275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533047862469963:3061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:33.481284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 56 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:33.483510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:33.485472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:33.485487Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:33.485489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:33.485492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:33.485498Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 55 [1:7556533047862469977:3060]
2025-10-02T08:07:33.485511Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:33.485531Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:33.485540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.485543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.485546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.485562Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:33.485568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:33.485574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:33.485642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.485650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.485654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:33.485657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:33.485729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:33.485737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.485751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.485766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:33.485790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862470017:3061], now have 1 active actors on pipe
2025-10-02T08:07:33.485790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 55
2025-10-02T08:07:33.485798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533048322933530:2378], now have 1 active actors on pipe
2025-10-02T08:07:33.485804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533047862469966:3060]
2025-10-02T08:07:33.485806Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533047862469966:3060]
2025-10-02T08:07:33.485818Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:33.485828Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:33.485830Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:33.485832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.485837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.485853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:33.485868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:33.485876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:33.485878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 55
2025-10-02T08:07:33.485920Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:33.485930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.485934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.485936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:33.485945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.485954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:33.485962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533047862469966:3060]
2025-10-02T08:07:33.485969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:33.485975Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:33.486002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:33.486085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.486094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.486109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:33.486146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 56 partition: 0 MaxSeqNo: 17 sessionId: src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0
2025-10-02T08:07:33.486566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0274aba-7377ca82-bd5d929f-7253b49d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:33.489334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0] Write session: try to update token
2025-10-02T08:07:33.489352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:33.503586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId: src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:33.505015Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:33.505028Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:33.505030Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:33.505036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533047862469966:3060]
2025-10-02T08:07:33.505040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533047862469966:3060]
2025-10-02T08:07:33.505082Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:33.505084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:33.505087Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:33.505091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.505093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:33.505335Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:33.506649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:33.562729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533047862470032:2534]
2025-10-02T08:07:33.562835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:33.562986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 55, pipe: [1:7556533047862470032:2534]
2025-10-02T08:07:33.653898Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:33.654334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.654351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.654395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862470032:2534], now have 1 active actors on pipe
2025-10-02T08:07:33.654414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.654420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.654522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:33.654534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:33.654601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 56 reason: error at write: Disconnected sessionId: src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0
2025-10-02T08:07:33.654649Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:33.655002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:33.655013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0] Write session will restart in 0.005169s
2025-10-02T08:07:33.655049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0] Write session: Do CDS request
2025-10-02T08:07:33.655056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:33.654880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 56 sessionId: src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0 is DEAD
2025-10-02T08:07:33.654883Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:33.654889Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:33.655097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533047862470032:2534]
2025-10-02T08:07:33.661356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:33.661453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:33.661468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 57
2025-10-02T08:07:33.661575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:33.661607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 57 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:33.661617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=57 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:33.661626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:33.661979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 57 sessionId:  describe result for acl check
2025-10-02T08:07:33.662005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:33.662010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:33.662011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:33.662015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533047862470190:3067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:33.662467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:33.662494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533047862470190:3067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:33.662878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:33.663042Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:33.663053Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:33.663063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:33.663104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:33.663148Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533047862470206:3066]
2025-10-02T08:07:33.663786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:33.663929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:33.663969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:33.664274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:33.664321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.664332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.664333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.664334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.664335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.664340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.664350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.664353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.664357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.664360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.664365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.664371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.664376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.664381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.664385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.664389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.664393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.664398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.664405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.664409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.664431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:33.664669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533047862470190:3067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:33.670290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533047862470190:3067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:33.670310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533047862470190:3067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:33.670314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533047862470190:3067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:33.670323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 57 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:33.672388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:33.674115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:33.674132Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:33.674135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:33.674138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:33.674144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 56 [1:7556533047862470206:3066]
2025-10-02T08:07:33.674157Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:33.674174Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:33.674177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.674180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.674189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.674205Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:33.674214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:33.674225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:33.674294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.674301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.674304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:33.674307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:33.674377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:33.674387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.674399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.674409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:33.674412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 56
2025-10-02T08:07:33.674430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862470245:3067], now have 1 active actors on pipe
2025-10-02T08:07:33.674438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533048322933537:2378], now have 1 active actors on pipe
2025-10-02T08:07:33.674443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.674452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.674469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533047862470194:3066]
2025-10-02T08:07:33.674478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533047862470194:3066]
2025-10-02T08:07:33.674490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:33.674501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:33.674522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:33.674489Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 56
2025-10-02T08:07:33.674525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:33.674530Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:33.674532Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:33.674539Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:33.674545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.674549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.674551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:33.674560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.674569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:33.674602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533047862470194:3066]
2025-10-02T08:07:33.674611Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:33.674616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:33.674628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:33.674678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.674684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.674699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:33.674737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 57 partition: 0 MaxSeqNo: 17 sessionId: src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0
2025-10-02T08:07:33.675111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51c9b4e0-216420c7-12f8c11a-d429f2f8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:33.677585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0] Write session: try to update token
2025-10-02T08:07:33.677606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:33.684746Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:33.684764Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:33.684773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533047862470194:3066]
2025-10-02T08:07:33.684827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:33.684832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:33.685016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:33.685182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:33.685341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:33.685499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:33.685699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:33.685743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:33.691958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId: src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:33.695175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:33.695252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.695265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.695299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:33.695321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:33.695390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.695397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.695575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.695650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.695736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.695822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.695883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.695891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.695979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.696094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.696172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.696263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.696324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.696332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.696411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.696488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.696661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.696848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.696911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.696919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.697002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.697079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.697152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.697221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.697277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.697285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.697353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.697425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.697500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.697579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.697644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.697651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.697731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.697807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.697889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.697967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.698089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.698097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.698175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.698252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.698334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.698413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.698487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.698495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.698572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.698651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.698723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.698790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.698842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.698849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.698918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.698981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.699048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.699125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.699180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.699187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.699263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:33.699333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:33.699405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:33.699478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:33.699582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:33.699590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:33.699652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:33.699720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.699743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.699751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:33.699780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:33.699798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:33.699805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:33.699808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:33.699811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:33.700274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:33.700304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:33.700317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:33.700321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:33.700326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:33.700329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:33.700945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:33.700970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:33.700976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:33.700980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:33.700983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:33.700986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:33.701533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:33.701559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:33.701564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:33.701568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:33.701571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:33.703010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:33.703030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:33.703043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392453702
2025-10-02T08:07:33.703326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:33.703342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:33.703351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:33.703355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:33.703362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:33.703366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:33.703890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:33.703914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:33.703929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:33.703933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:33.703936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:33.703944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:33.704523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:33.704548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:33.704556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:33.704559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:33.704563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:33.704567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:33.705223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:33.705250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:33.705254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:33.706523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:33.706541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:33.706546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:33.706549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:33.706559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392453706
2025-10-02T08:07:33.706964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:33.706994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:33.707004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:33.707013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:33.707017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:33.707021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:33.707638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:33.707662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:33.707672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:33.707682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:33.707685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:33.707689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:33.708498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:33.708523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.708626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392453708
2025-10-02T08:07:33.711387Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:33.711419Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:33.711425Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:33.711432Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:33.711443Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:33.711445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:33.711447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:33.711455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533047862470194:3066]
2025-10-02T08:07:33.711459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533047862470194:3066]
2025-10-02T08:07:33.711513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:33.711528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:33.711534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:33.711538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.711540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:33.711690Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:33.755200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533047862470263:2534]
2025-10-02T08:07:33.755269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:33.755357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 56, pipe: [1:7556533047862470263:2534]
2025-10-02T08:07:33.859711Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:33.860076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862470263:2534], now have 1 active actors on pipe
2025-10-02T08:07:33.860098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.860109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.860337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533047862470263:2534]
2025-10-02T08:07:33.860367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:33.860369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:33.860393Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:33.860395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 57 reason: error at write: Disconnected sessionId: src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0
2025-10-02T08:07:33.860402Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:33.860520Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:33.860701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 57 sessionId: src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0 is DEAD
2025-10-02T08:07:33.860999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:33.861013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0] Write session will restart in 0.009039s
2025-10-02T08:07:33.861036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0] Write session: Do CDS request
2025-10-02T08:07:33.861044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:33.863877Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:56:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:33.863878Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [5c10c32be108b649] Result# TEvPutResult {Id# [72075186224037892:56:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:33.863930Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:56:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:33.868518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:33.868843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:33.868984Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:33.868992Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:33.869000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:33.869032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:33.869060Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533047862470432:3073]
2025-10-02T08:07:33.869511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:33.869670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:33.869701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:33.869930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:33.869965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.869966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.869966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.869967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.869967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.869970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.869975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.869978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.869979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.869981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.869986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.869990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:33.869993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.869996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:33.869999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.870001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:33.870004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.870006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.870009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.870012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.870023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:33.871503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:33.871623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:33.871633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 58
2025-10-02T08:07:33.871791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:33.871811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 58 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:33.871818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=58 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:33.871820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:33.872281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 58 sessionId:  describe result for acl check
2025-10-02T08:07:33.872345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:33.872353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:33.872356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:33.872363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533047862470449:3075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:33.873034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533047862470449:3075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:33.875742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533047862470449:3075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:33.879274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533047862470449:3075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:33.879298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533047862470449:3075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:33.879302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533047862470449:3075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:33.879332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 58 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:33.883315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:33.885001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:33.885024Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:33.885027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:33.885033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:33.885042Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 57 [1:7556533047862470432:3073]
2025-10-02T08:07:33.885057Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:33.885082Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:33.885090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.885094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.885096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.885118Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:33.885133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:33.885148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:33.885951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.885962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.885966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:33.885969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:33.886058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:33.886065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.886084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:33.886095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 57
2025-10-02T08:07:33.886104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:33.886134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862470481:3075], now have 1 active actors on pipe
2025-10-02T08:07:33.886143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533048322933545:2378], now have 1 active actors on pipe
2025-10-02T08:07:33.886149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.886154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.886178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533047862470426:3073]
2025-10-02T08:07:33.886186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533047862470426:3073]
2025-10-02T08:07:33.886204Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:33.886224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:33.886223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:33.886227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:33.886197Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 57
2025-10-02T08:07:33.886240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:33.886248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:33.886268Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:33.886281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:33.886286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:33.886290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:33.886302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:33.886319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:33.886377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533047862470426:3073]
2025-10-02T08:07:33.886392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:33.886406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:33.886413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:33.886457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:33.886468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:33.886483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:33.886520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 58 partition: 0 MaxSeqNo: 17 sessionId: src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0
2025-10-02T08:07:33.886862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b07faf-e7a778c8-7d5f2a55-66417f03_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:33.889575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0] Write session: try to update token
2025-10-02T08:07:33.889595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:33.904130Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:33.904154Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:33.904156Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:33.904165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533047862470426:3073]
2025-10-02T08:07:33.904170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533047862470426:3073]
2025-10-02T08:07:33.904210Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:33.904216Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:33.904217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:33.904223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:33.904225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:33.904561Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:33.906657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId: src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:33.909537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:33.960557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533047862470496:2534]
2025-10-02T08:07:33.960647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:33.960821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 57, pipe: [1:7556533047862470496:2534]
2025-10-02T08:07:34.042746Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:34.042976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.042987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.043018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533047862470496:2534], now have 1 active actors on pipe
2025-10-02T08:07:34.043034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.043035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.043114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533047862470496:2534]
2025-10-02T08:07:34.043129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:34.043134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:34.043179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 58 reason: error at write: Disconnected sessionId: src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0
2025-10-02T08:07:34.043287Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.043249Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:34.043304Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.043355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 58 sessionId: src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0 is DEAD
2025-10-02T08:07:34.043587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:34.043597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0] Write session will restart in 0.007602s
2025-10-02T08:07:34.043619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0] Write session: Do CDS request
2025-10-02T08:07:34.043626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:34.052446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.052479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:34.052496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 59
2025-10-02T08:07:34.052742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.052822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 59 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:34.052834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=59 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:34.052840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:34.053276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 59 sessionId:  describe result for acl check
2025-10-02T08:07:34.053325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:34.053332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:34.053333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:34.053340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533052157437950:3080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:34.053870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533052157437950:3080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:34.053921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:34.054483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:34.054685Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:34.054695Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:34.054707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:34.054756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:34.054791Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533052157437969:3079]
2025-10-02T08:07:34.055403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:34.055607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:34.055658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:34.056010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:34.056061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.056063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.056064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.056065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.056066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.056072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.056086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.056090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.056094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.056098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.056104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.056112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.056118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.056122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.056126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.056131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.056136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.056142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.056148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.056152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.056175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:34.056210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533052157437950:3080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:34.063143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533052157437950:3080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:34.063165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533052157437950:3080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:34.063169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533052157437950:3080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:34.063178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 59 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:34.066306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:34.067970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:34.067994Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:34.067997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:34.068001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:34.068007Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 58 [1:7556533052157437969:3079]
2025-10-02T08:07:34.068020Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:34.068040Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:34.068042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.068045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.068049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.068063Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:34.068068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:34.068079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:34.068147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.068155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.068158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:34.068161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:34.068236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:34.068255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.068267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.068279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:34.068299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157438009:3080], now have 1 active actors on pipe
2025-10-02T08:07:34.068301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 58
2025-10-02T08:07:34.068306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533052157437958:3079]
2025-10-02T08:07:34.068308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533052157437958:3079]
2025-10-02T08:07:34.068318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:34.068331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:34.068335Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:34.068337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:34.068351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:34.068358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:34.068365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533052617900860:2378], now have 1 active actors on pipe
2025-10-02T08:07:34.068370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.068375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.068396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 58
2025-10-02T08:07:34.068419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533052157437958:3079]
2025-10-02T08:07:34.068430Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:34.068435Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:34.068447Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:34.068457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.068468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.068475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:34.068484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.068499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:34.068543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.068632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.068639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.068653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.068693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 59 partition: 0 MaxSeqNo: 17 sessionId: src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0
2025-10-02T08:07:34.073129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a8dafb-517cae26-da8d22f0-d70e0156_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:34.076128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0] Write session: try to update token
2025-10-02T08:07:34.076153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:34.081312Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:34.081326Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:34.081334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533052157437958:3079]
2025-10-02T08:07:34.081373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:34.081376Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:34.081747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:34.081894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:34.082043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:34.082215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:34.082431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:34.082465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:34.097277Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:34.097297Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:34.097299Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:34.097309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533052157437958:3079]
2025-10-02T08:07:34.097313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533052157437958:3079]
2025-10-02T08:07:34.097358Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:34.097361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:34.097367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.097369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:34.097371Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:34.097538Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:34.130489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId: src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:34.141500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:34.143395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533052157438062:2534]
2025-10-02T08:07:34.143475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:34.144993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 58, pipe: [1:7556533052157438062:2534]
2025-10-02T08:07:34.248395Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:34.248774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.248793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.248829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157438062:2534], now have 1 active actors on pipe
2025-10-02T08:07:34.248842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.248845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.249111Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.249124Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.249447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:34.249511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 59 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0
2025-10-02T08:07:34.249626Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:34.249723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 59 sessionId: src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0 is DEAD
2025-10-02T08:07:34.249871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533052157438062:2534]
2025-10-02T08:07:34.249962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:34.249974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0] Write session will restart in 0.008604s
2025-10-02T08:07:34.250001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0] Write session: Do CDS request
2025-10-02T08:07:34.250008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:34.259459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.261170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:34.261190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 60
2025-10-02T08:07:34.261385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.261441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 60 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:34.261451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=60 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:34.261455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:34.262013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 60 sessionId:  describe result for acl check
2025-10-02T08:07:34.262055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:34.262063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:34.262065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:34.262070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533052157438238:3100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:34.262521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533052157438238:3100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:34.262559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:34.263251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:34.263484Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:34.263503Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:34.263519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:34.263593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:34.263657Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533052157438257:3098]
2025-10-02T08:07:34.264283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:34.264505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:34.264557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:34.264639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533052157438238:3100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:34.264887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:34.264948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.264949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.264950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.264951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.264952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.264958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.264969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.264972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.264975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.264978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.264985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.264993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.264998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.265003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.265007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.265011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.265015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.265020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.265024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.265028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.265046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:34.275706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533052157438238:3100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:34.275729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533052157438238:3100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:34.275733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533052157438238:3100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:34.275755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 60 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:34.276712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:34.278907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:34.278935Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:34.278939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:34.278944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:34.278953Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 59 [1:7556533052157438257:3098]
2025-10-02T08:07:34.278968Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:34.278992Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:34.278996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.278999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.279001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.279021Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:34.279027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:34.279035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:34.279115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.279117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.279120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:34.279122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:34.279202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:34.279205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.279220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.279234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:34.279255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157438289:3100], now have 1 active actors on pipe
2025-10-02T08:07:34.279263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533052157438241:3098]
2025-10-02T08:07:34.279265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533052157438241:3098]
2025-10-02T08:07:34.279274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:34.279288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:34.279289Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:34.279293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:34.279302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:34.279305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:34.279312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533052617900889:2378], now have 1 active actors on pipe
2025-10-02T08:07:34.279347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533052157438241:3098]
2025-10-02T08:07:34.279360Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:34.279411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 59
2025-10-02T08:07:34.279447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.279451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.279453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:34.279475Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:34.279482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.279485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.279487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:34.279497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.279507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:34.279522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.279503Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 59
2025-10-02T08:07:34.279563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.279572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.279585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.279616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 60 partition: 0 MaxSeqNo: 17 sessionId: src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0
2025-10-02T08:07:34.281130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aefa058-a736ea7f-f7454eb9-734b69f9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:34.284019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0] Write session: try to update token
2025-10-02T08:07:34.284040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:34.312584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId: src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:34.315808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:34.316724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.316737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.316791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:34.316838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:34.317070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.317074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.317295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.317381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.317567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.317646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.317699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.317704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.317823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.317904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.317980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.318062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.318119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.318123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.318211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.318321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.318439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.318533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.318588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.318591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.318686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.318771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.318850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.318925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.319077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.319081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.319227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.319300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.319364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.319430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.319591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.319595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.319674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.319748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.319825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.319905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.319959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.319962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.320042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.320113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.320190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.320300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.320349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.320352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.320432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.320502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.320577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.320648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.320708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.320711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.320788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.320875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.320955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.321041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.321233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.321237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.321344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.321414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.321489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.321560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.321747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.321751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.321842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:34.321924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.321943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.321946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:34.321986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:34.322004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:34.322007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:34.322011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:34.322013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:34.322508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:34.322532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:34.322540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:34.322544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:34.322547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:34.322552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:34.323233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:34.323271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:34.323279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:34.323282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:34.323285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:34.323289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:34.324119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:34.324138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:34.324145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:34.324149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:34.324153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:34.329119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:34.329162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:34.329179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392454329
2025-10-02T08:07:34.329324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:34.329336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:34.329345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:34.329348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:34.329353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:34.329358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:34.330009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:34.330029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:34.330037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:34.330043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:34.330047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:34.330051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:34.330741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:34.330761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:34.330779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:34.330783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:34.330788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:34.330791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:34.331539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:34.331556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:34.331563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:34.333436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:34.333464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:34.333471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:34.333480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:34.333491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392454333
2025-10-02T08:07:34.333859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:34.333875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:34.333882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:34.333885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:34.333894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:34.333898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:34.334597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:34.334612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:34.334619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:34.334623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:34.334627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:34.334632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:34.335242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:34.335257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.335371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392454335
2025-10-02T08:07:34.342549Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:34.342591Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:34.342599Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:34.342608Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:34.342626Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:34.342629Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:34.342633Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:34.342645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533052157438241:3098]
2025-10-02T08:07:34.342651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533052157438241:3098]
2025-10-02T08:07:34.342726Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:34.342747Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:34.347665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:34.347686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.347689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:34.347862Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:34.350417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533052157438309:2534]
2025-10-02T08:07:34.350501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:34.350770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 59, pipe: [1:7556533052157438309:2534]
2025-10-02T08:07:34.520698Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:34.521348Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:34.521367Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:34.521381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533052157438241:3098]
2025-10-02T08:07:34.521453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:34.521484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157438309:2534], now have 1 active actors on pipe
2025-10-02T08:07:34.521512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.521527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.522727Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.522744Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.522746Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:34.523374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533052157438309:2534]
2025-10-02T08:07:34.523412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:34.523444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 60 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0
2025-10-02T08:07:34.523658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 60 sessionId: src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0 is DEAD
2025-10-02T08:07:34.523930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:34.523941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0] Write session will restart in 0.006752s
2025-10-02T08:07:34.523959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0] Write session: Do CDS request
2025-10-02T08:07:34.523965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:34.533341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.534032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:34.534055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 61
2025-10-02T08:07:34.534251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.534282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 61 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:34.534289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=61 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:34.534294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:34.534537Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:59:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:34.534568Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [fe3786b442587b2d] Result# TEvPutResult {Id# [72075186224037892:59:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:34.534599Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:59:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:34.534676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 61 sessionId:  describe result for acl check
2025-10-02T08:07:34.534707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:34.534709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:34.534711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:34.534723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533052157438356:3108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:34.535340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533052157438356:3108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:34.539663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533052157438356:3108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:34.540998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:34.542058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:34.542310Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:34.542315Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:34.542327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:34.542403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:34.542448Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533052157438526:3107]
2025-10-02T08:07:34.543197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:34.543714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:34.543762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:34.544115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:34.544156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.544157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.544159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.544160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.544161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.544167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.544179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.544184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.544188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.544192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.544200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.544208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.544215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.544221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.544226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.544232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.544236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.544255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.544261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.544266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.544291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:34.545213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533052157438356:3108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:34.545225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533052157438356:3108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:34.545231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533052157438356:3108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:34.545241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 61 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:34.556299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:34.560990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:34.561018Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:34.561023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:34.561027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:34.561035Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 60 [1:7556533052157438526:3107]
2025-10-02T08:07:34.561053Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:34.561074Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:34.561077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.561081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.561084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.561103Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:34.561108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:34.561115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:34.561202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.561216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.561219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:34.561222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:34.561684Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 60
2025-10-02T08:07:34.561309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:34.561319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.561336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.561348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:34.561366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533052157438519:3107]
2025-10-02T08:07:34.561368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533052157438519:3107]
2025-10-02T08:07:34.561377Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:34.561391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:34.561406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:34.561409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:34.561419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157438542:3108], now have 1 active actors on pipe
2025-10-02T08:07:34.561422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:34.561425Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:34.561481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533052157438519:3107]
2025-10-02T08:07:34.561489Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:34.561495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533052617900898:2378], now have 1 active actors on pipe
2025-10-02T08:07:34.561543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 60
2025-10-02T08:07:34.561606Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:34.561758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.561762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.561788Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:34.561795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.561800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.561803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:34.561814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.561825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:34.561848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.561926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.561929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.561943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.561975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 61 partition: 0 MaxSeqNo: 17 sessionId: src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0
2025-10-02T08:07:34.563465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf97cf5-8449b8a3-f1bd9042-8b821e29_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:34.566248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0] Write session: try to update token
2025-10-02T08:07:34.566269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:34.587324Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:34.587347Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:34.587350Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:34.587362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533052157438519:3107]
2025-10-02T08:07:34.587367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533052157438519:3107]
2025-10-02T08:07:34.587421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:34.587430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.587433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:34.587433Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:34.587440Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:34.592860Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:34.596104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId: src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:34.598904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:34.623712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533052157438557:2534]
2025-10-02T08:07:34.623801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:34.624022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 60, pipe: [1:7556533052157438557:2534]
2025-10-02T08:07:34.752171Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:34.752598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.752612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.752633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157438557:2534], now have 1 active actors on pipe
2025-10-02T08:07:34.752651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.752658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.752779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:34.752792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:34.752872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 61 reason: error at write: Disconnected sessionId: src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0
2025-10-02T08:07:34.752907Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.752917Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.752881Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:34.753049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 61 sessionId: src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0 is DEAD
2025-10-02T08:07:34.753199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533052157438557:2534]
2025-10-02T08:07:34.753219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:34.753232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0] Write session will restart in 0.006736s
2025-10-02T08:07:34.753258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0] Write session: Do CDS request
2025-10-02T08:07:34.753266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:34.761443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.761535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:34.761566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 62
2025-10-02T08:07:34.761772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.761821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 62 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:34.761832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=62 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:34.761837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:34.761874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:34.762324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 62 sessionId:  describe result for acl check
2025-10-02T08:07:34.762363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:34.762365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:34.762367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:34.762373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533052157438736:3116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:34.762512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:34.762709Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:34.762718Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:34.762730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:34.762785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:34.762853Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533052157438738:3114]
2025-10-02T08:07:34.762931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533052157438736:3116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:34.763420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:34.763680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:34.763715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:34.763944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:34.763981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.763985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.763986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.763987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.763988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.763992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.763998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.764001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.764003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.764006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.764009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.764014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.764018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.764021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.764023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.764027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.764032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.764037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.764041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.764045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.764066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:34.767678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533052157438736:3116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:34.771940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533052157438736:3116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:34.771960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533052157438736:3116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:34.771963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533052157438736:3116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:34.771976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 62 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:34.772602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:34.774325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:34.774346Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:34.774349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:34.774353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:34.774361Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 61 [1:7556533052157438738:3114]
2025-10-02T08:07:34.774376Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:34.774396Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:34.774399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.774403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.774406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.774425Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:34.774436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:34.774450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:34.774522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.774529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.774532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:34.774535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:34.774615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:34.774625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.774642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.774654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:34.774666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 61
2025-10-02T08:07:34.774676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157438782:3116], now have 1 active actors on pipe
2025-10-02T08:07:34.774684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533052617900906:2378], now have 1 active actors on pipe
2025-10-02T08:07:34.774689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.774694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.774714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533052157438730:3114]
2025-10-02T08:07:34.774724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533052157438730:3114]
2025-10-02T08:07:34.774738Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:34.774754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:34.774753Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:34.774757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:34.774770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:34.774777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:34.774795Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:34.774739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 61
2025-10-02T08:07:34.774806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.774810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.774813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:34.774823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.774833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:34.774873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533052157438730:3114]
2025-10-02T08:07:34.774885Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:34.774899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:34.774902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.775111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.775123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.775149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.775206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 62 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0
2025-10-02T08:07:34.775609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a57767-62cc0781-72d9a2d9-5c438db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:34.778331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0] Write session: try to update token
2025-10-02T08:07:34.778350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:34.787513Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:34.787533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:34.787544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533052157438730:3114]
2025-10-02T08:07:34.787594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:34.787597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:34.787793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:34.787952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:34.788114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:34.788298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:34.788501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:34.788553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:34.792935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:34.795730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:34.795810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.795828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.795869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:34.795896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:34.795958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.795985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.796152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.796224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.796298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.796370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.796653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.796664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.796748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.796852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.796943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.797037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.797203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.797213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.797292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.797359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.797430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.797511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.797575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.797588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.797690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.797847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.797936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.798007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.798130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.798140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.798219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.798287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.798355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.798417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.798477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.798483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.798558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.798714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.798836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.798896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.798937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.798943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.799003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.799055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.799112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.799187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.799307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.799313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.799370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.799426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.799508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.799563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.799607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.799615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.799684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.799748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.799814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.799879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.799927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.799932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.800003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:34.800068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:34.800137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:34.800217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:34.800279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:34.800285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:34.800327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:34.800399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.800418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.800425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:34.800470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:34.800491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:34.800500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:34.800504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:34.800506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:34.800936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:34.800968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:34.800981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:34.800985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:34.800988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:34.800992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:34.801697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:34.801723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:34.801728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:34.801731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:34.801734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:34.801737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:34.802198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:34.802225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:34.802230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:34.802234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:34.802238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:34.803642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:34.803659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:34.803672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392454803
2025-10-02T08:07:34.803786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:34.803799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:34.803804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:34.803808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:34.803812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:34.803816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:34.804256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:34.804279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:34.804285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:34.804294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:34.804297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:34.804299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:34.804846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:34.804863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:34.804867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:34.804869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:34.804873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:34.804875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:34.805318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:34.805337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:34.805341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:34.806409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:34.806426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:34.806430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:34.806434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:34.806443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392454806
2025-10-02T08:07:34.806691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:34.806708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:34.806712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:34.806717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:34.806720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:34.806722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:34.807138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:34.807156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:34.807160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:34.807163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:34.807166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:34.807168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:34.807647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:34.807664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.807762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392454807
2025-10-02T08:07:34.808497Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:34.808514Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:34.808518Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:34.808522Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:34.810182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:34.810195Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:34.810197Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:34.810204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533052157438730:3114]
2025-10-02T08:07:34.810208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533052157438730:3114]
2025-10-02T08:07:34.810271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:34.810275Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:34.810280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.810282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:34.810286Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:34.810408Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:34.853470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533052157438804:2534]
2025-10-02T08:07:34.853572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:34.853710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 61, pipe: [1:7556533052157438804:2534]
2025-10-02T08:07:34.956034Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:34.956412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157438804:2534], now have 1 active actors on pipe
2025-10-02T08:07:34.956441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.956742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:34.957005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:34.957026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0] Write session will restart in 0.008954s
2025-10-02T08:07:34.957049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0] Write session: Do CDS request
2025-10-02T08:07:34.957056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:34.956453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.956615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:34.956617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:34.956653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 62 reason: error at write: Disconnected sessionId: src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0
2025-10-02T08:07:34.956694Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.956701Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:34.956861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 62 sessionId: src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0 is DEAD
2025-10-02T08:07:34.957038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533052157438804:2534]
2025-10-02T08:07:34.965361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:34.965830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:34.966026Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:34.966035Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:34.966043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:34.966082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:34.966114Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533052157438985:3120]
2025-10-02T08:07:34.966603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:34.966794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:34.966855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:34.967193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:34.967258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.967264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.967266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.967267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.967268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.967274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.967284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.967288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.967292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.967300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.967305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.967312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:34.967317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.967326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:34.967330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.967340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:34.967344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.967354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.967359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.967368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.967391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:34.967454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.967456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:34.967466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 63
2025-10-02T08:07:34.967703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:34.967731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 63 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:34.967740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=63 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:34.967743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:34.968130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 63 sessionId:  describe result for acl check
2025-10-02T08:07:34.968161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:34.968163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:34.968164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:34.968170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533052157439001:3122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:34.968684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533052157439001:3122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:34.970697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533052157439001:3122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:34.974600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533052157439001:3122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:34.974612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533052157439001:3122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:34.974615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533052157439001:3122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:34.974694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 63 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:34.975119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:34.976712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:34.976727Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:34.976730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:34.976734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:34.976739Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 62 [1:7556533052157438985:3120]
2025-10-02T08:07:34.976752Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:34.976768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:34.976775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.976778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.976781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.976796Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:34.976826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:34.976833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:34.976899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.976906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.976910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:34.976912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:34.976984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:34.976990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:34.977003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:34.977020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:34.977038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533052157438979:3120]
2025-10-02T08:07:34.977044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533052157438979:3120]
2025-10-02T08:07:34.977053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:34.977062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 62
2025-10-02T08:07:34.977070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533052157439029:3122], now have 1 active actors on pipe
2025-10-02T08:07:34.977071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:34.977074Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:34.977079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:34.977092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:34.977100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:34.977105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533052617900914:2378], now have 1 active actors on pipe
2025-10-02T08:07:34.977114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.977119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.977161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533052157438979:3120]
2025-10-02T08:07:34.977169Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:34.977184Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:34.977194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:34.977203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:34.977205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:34.977215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:34.977226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:34.977260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.977329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:34.977428Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 62
2025-10-02T08:07:34.977455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:34.977466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:34.977481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:34.977520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 63 partition: 0 MaxSeqNo: 17 sessionId: src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0
2025-10-02T08:07:34.977984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c838696-af04ff16-6eefddda-f53f7e0b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:34.980763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0] Write session: try to update token
2025-10-02T08:07:34.980783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:35.003242Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:35.003267Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:35.003269Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:35.003280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533052157438979:3120]
2025-10-02T08:07:35.003284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533052157438979:3120]
2025-10-02T08:07:35.003338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:35.003344Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:35.003346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.003349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:35.003350Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:35.003530Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:35.009976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId: src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:35.012999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:35.060881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533056452406340:2534]
2025-10-02T08:07:35.060982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:35.061242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 62, pipe: [1:7556533056452406340:2534]
2025-10-02T08:07:35.196197Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:35.196767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.196778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.196895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452406340:2534], now have 1 active actors on pipe
2025-10-02T08:07:35.196917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.196928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.199026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:35.199039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0] Write session will restart in 0.008641s
2025-10-02T08:07:35.199065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0] Write session: Do CDS request
2025-10-02T08:07:35.199073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:35.199877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:35.198085Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:35.198098Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:35.198417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:35.198470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 63 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0
2025-10-02T08:07:35.198689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 63 sessionId: src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0 is DEAD
2025-10-02T08:07:35.198863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533056452406340:2534]
2025-10-02T08:07:35.213312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:35.213725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:35.213745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 64
2025-10-02T08:07:35.213904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:35.213946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 64 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:35.213954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=64 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:35.213958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:35.214399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 64 sessionId:  describe result for acl check
2025-10-02T08:07:35.214430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:35.214431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:35.214433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:35.214437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533056452406549:3138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:35.215053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533056452406549:3138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:35.216214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:35.217584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:35.217907Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:35.217913Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:35.217927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:35.217987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:35.218029Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533056452406582:3134]
2025-10-02T08:07:35.218755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:35.219111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:35.219161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:35.219704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:35.219872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.219873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.219875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.219876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.219877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.219885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.219895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.219899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.219903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.219907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.219914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.219922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.219928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.219933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.219938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.219944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.219950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.219955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.219960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.219965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.219986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:35.220201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533056452406549:3138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:35.240390Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 63
2025-10-02T08:07:35.236901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:35.239481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:35.239491Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:35.239494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:35.239499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:35.239507Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 63 [1:7556533056452406582:3134]
2025-10-02T08:07:35.239522Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:35.239543Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:35.239547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.239551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.239553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.239575Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:35.239582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:35.239591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:35.239679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.239681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.239685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:35.239688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:35.239781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:35.239784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.239801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.239814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:35.239837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533056452406564:3134]
2025-10-02T08:07:35.239838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533056452406564:3134]
2025-10-02T08:07:35.239897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:35.239899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:35.240826Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:35.240857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:35.240876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:35.240879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:35.240894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533056912868236:2378], now have 1 active actors on pipe
2025-10-02T08:07:35.240951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533056452406564:3134]
2025-10-02T08:07:35.240958Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:35.241070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:35.241303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533056452406549:3138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:35.241314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533056452406549:3138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:35.241319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533056452406549:3138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:35.241334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 64 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:35.243921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 63
2025-10-02T08:07:35.243941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452406616:3138], now have 1 active actors on pipe
2025-10-02T08:07:35.243957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.243965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.244003Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|635ebe10-1053e081-f4b830bb-1818803c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:35.244016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.244021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.244024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:35.244041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.244063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:35.244082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:35.244179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.244193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.244207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:35.244254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 64 partition: 0 MaxSeqNo: 17 sessionId: src_id|635ebe10-1053e081-f4b830bb-1818803c_0
2025-10-02T08:07:35.244927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c2f3c9-761040b5-eda847b7-4e0d18af_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|635ebe10-1053e081-f4b830bb-1818803c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:35.247729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635ebe10-1053e081-f4b830bb-1818803c_0] Write session: try to update token
2025-10-02T08:07:35.247767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635ebe10-1053e081-f4b830bb-1818803c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:35.273563Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:35.273587Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:35.273589Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:35.273598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533056452406564:3134]
2025-10-02T08:07:35.273601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533056452406564:3134]
2025-10-02T08:07:35.273646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:35.273653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.273655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:35.274027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:35.274035Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:35.274038Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:35.288701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId: src_id|635ebe10-1053e081-f4b830bb-1818803c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:35.291806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:35.293279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533056452406633:2534]
2025-10-02T08:07:35.293365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:35.294270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 63, pipe: [1:7556533056452406633:2534]
2025-10-02T08:07:35.424222Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:35.425066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.425085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.425107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452406633:2534], now have 1 active actors on pipe
2025-10-02T08:07:35.425127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.425130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.425269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:35.425281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:35.425351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 64 reason: error at write: Disconnected sessionId: src_id|635ebe10-1053e081-f4b830bb-1818803c_0
2025-10-02T08:07:35.425423Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:35.425436Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:35.425575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 64 sessionId: src_id|635ebe10-1053e081-f4b830bb-1818803c_0 is DEAD
2025-10-02T08:07:35.425783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533056452406633:2534]
2025-10-02T08:07:35.425959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635ebe10-1053e081-f4b830bb-1818803c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:35.425977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635ebe10-1053e081-f4b830bb-1818803c_0] Write session will restart in 0.005045s
2025-10-02T08:07:35.426004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635ebe10-1053e081-f4b830bb-1818803c_0] Write session: Do CDS request
2025-10-02T08:07:35.426011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635ebe10-1053e081-f4b830bb-1818803c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:35.425433Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:35.432393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635ebe10-1053e081-f4b830bb-1818803c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:35.432464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:35.432480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 65
2025-10-02T08:07:35.432659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:35.432731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 65 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:35.432742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=65 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:35.432748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:35.433193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 65 sessionId:  describe result for acl check
2025-10-02T08:07:35.433221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:35.433222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:35.433224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:35.433228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533056452406812:3147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:35.433711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533056452406812:3147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:35.434232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:35.434967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:35.435207Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:35.435211Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:35.435220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:35.435278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:35.435315Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533056452406841:3146]
2025-10-02T08:07:35.435971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:35.436481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:35.436543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:35.436623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533056452406812:3147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:35.436920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:35.436980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.436982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.436983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.436984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.436985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.436991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.437004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.437008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.437011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.437015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.437020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.437028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.437035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.437040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.437044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.437049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.437053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.437057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.437062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.437066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.437091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:35.445308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533056452406812:3147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:35.445328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533056452406812:3147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:35.445333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533056452406812:3147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:35.445344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 65 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:35.447105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:35.450677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:35.450699Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:35.450701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:35.450706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:35.450716Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 64 [1:7556533056452406841:3146]
2025-10-02T08:07:35.450732Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:35.450753Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:35.450757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.450761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.450763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.450785Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:35.450791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:35.450800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:35.450882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.450884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.450888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:35.450891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:35.450981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:35.450984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.451001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.451013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:35.451034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533056452406826:3146]
2025-10-02T08:07:35.451037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533056452406826:3146]
2025-10-02T08:07:35.451046Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:35.451063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:35.451081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:35.451092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:35.451135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 64
2025-10-02T08:07:35.451143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:35.451146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452406871:3147], now have 1 active actors on pipe
2025-10-02T08:07:35.451147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:35.451150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533056452406826:3146]
2025-10-02T08:07:35.451154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:35.451165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:35.451179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533056912868259:2378], now have 1 active actors on pipe
2025-10-02T08:07:35.451185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.451191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.451227Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:35.451235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.451240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.451242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:35.451256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.451267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:35.451282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:35.451727Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 64
2025-10-02T08:07:35.451903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.451915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.451943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:35.451983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 65 partition: 0 MaxSeqNo: 17 sessionId: src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0
2025-10-02T08:07:35.452414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635ebe10-1053e081-f4b830bb-1818803c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:35.459401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0] Write session: try to update token
2025-10-02T08:07:35.459423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:35.470247Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:35.470270Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:35.470273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:35.470283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533056452406826:3146]
2025-10-02T08:07:35.470287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533056452406826:3146]
2025-10-02T08:07:35.470338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:35.470337Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:35.470345Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:35.470347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.470349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:35.470651Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:35.479656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId: src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:35.482439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:35.525743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533056452406885:2534]
2025-10-02T08:07:35.525856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:35.526098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 64, pipe: [1:7556533056452406885:2534]
2025-10-02T08:07:35.622024Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:35.622596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.622619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.622673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452406885:2534], now have 1 active actors on pipe
2025-10-02T08:07:35.622700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.622703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.622839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:35.622849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:35.622910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 65 reason: error at write: Disconnected sessionId: src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0
2025-10-02T08:07:35.622988Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:35.623007Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:35.622975Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:35.623116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 65 sessionId: src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0 is DEAD
2025-10-02T08:07:35.623334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:35.623351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0] Write session will restart in 0.005141s
2025-10-02T08:07:35.623341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533056452406885:2534]
2025-10-02T08:07:35.623376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0] Write session: Do CDS request
2025-10-02T08:07:35.623384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:35.629459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:35.629492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:35.629516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 66
2025-10-02T08:07:35.629710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:35.629753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 66 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:35.629759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=66 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:35.629763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:35.630210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 66 sessionId:  describe result for acl check
2025-10-02T08:07:35.630260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:35.630268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:35.630270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:35.630276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533056452407048:3153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:35.630843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533056452407048:3153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:35.631654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:35.632202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:35.632492Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:35.632500Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:35.632510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:35.632570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:35.632606Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533056452407088:3152]
2025-10-02T08:07:35.633141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:35.633370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:35.633428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:35.633773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:35.633785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533056452407048:3153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:35.633817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.633818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.633819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.633820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.633821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.633826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.633835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.633839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.633843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.633847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.633852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.633860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.633865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.633870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.633875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.633880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.633884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.633889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.633893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.633898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.633916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:35.639940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533056452407048:3153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:35.639957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533056452407048:3153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:35.639962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533056452407048:3153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:35.639971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 66 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:35.642068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:35.643743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:35.643759Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:35.643761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:35.643764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:35.643769Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 65 [1:7556533056452407088:3152]
2025-10-02T08:07:35.643778Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:35.643792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:35.643793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.643796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.643797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.643810Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:35.643814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:35.643820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:35.643867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.643873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.643878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:35.643880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:35.643934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:35.643939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.643948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.643955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:35.643971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533056452407070:3152]
2025-10-02T08:07:35.643976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533056452407070:3152]
2025-10-02T08:07:35.643982Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:35.643990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:35.643994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:35.643997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:35.644001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:35.644003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:35.644009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 65
2025-10-02T08:07:35.644011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452407117:3153], now have 1 active actors on pipe
2025-10-02T08:07:35.644041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533056912868265:2378], now have 1 active actors on pipe
2025-10-02T08:07:35.644050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.644055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.644072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533056452407070:3152]
2025-10-02T08:07:35.644083Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:35.644100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:35.644107Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:35.644120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.644124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.644126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:35.644135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.644145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:35.644091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 65
2025-10-02T08:07:35.644169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:35.644211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.644212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.644223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:35.644264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 66 partition: 0 MaxSeqNo: 17 sessionId: src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0
2025-10-02T08:07:35.644624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e9d75-2c5b78d-275d9237-855c7c5b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:35.647347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0] Write session: try to update token
2025-10-02T08:07:35.647370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:35.662782Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:35.662805Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:35.662808Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:35.662818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533056452407070:3152]
2025-10-02T08:07:35.662823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533056452407070:3152]
2025-10-02T08:07:35.662875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:35.662884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.662884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:35.662892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:35.662894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:35.663078Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:35.663652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId: src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:35.666791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:35.723364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533056452407133:2534]
2025-10-02T08:07:35.723481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:35.723671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 65, pipe: [1:7556533056452407133:2534]
2025-10-02T08:07:35.808799Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:35.809093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.809111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.809155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452407133:2534], now have 1 active actors on pipe
2025-10-02T08:07:35.809171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.809176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.809417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533056452407133:2534]
2025-10-02T08:07:35.809438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:35.809440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:35.809491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 66 reason: error at write: Disconnected sessionId: src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0
2025-10-02T08:07:35.809519Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:35.809542Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:35.809545Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:35.809701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 66 sessionId: src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0 is DEAD
2025-10-02T08:07:35.809961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:35.809975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0] Write session will restart in 0.008689s
2025-10-02T08:07:35.809998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0] Write session: Do CDS request
2025-10-02T08:07:35.810004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:35.819166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:35.819639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:35.820472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:35.819850Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:35.819864Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:35.819874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:35.819920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:35.819963Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533056452407318:3159]
2025-10-02T08:07:35.820533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:35.820539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 67
2025-10-02T08:07:35.820653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:35.820736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:35.820776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 67 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:35.820780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=67 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:35.820784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:35.820975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:35.821054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:35.821468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:35.821532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.821534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.821536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.821537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.821538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.821545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.821557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.821561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.821566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.821570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.821578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.821587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:35.821594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.821600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:35.821606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.821612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:35.821617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.821623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.821628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.821633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.821658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:35.825342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 67 sessionId:  describe result for acl check
2025-10-02T08:07:35.825405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:35.825407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:35.825409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:35.825416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533056452407334:3161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:35.826063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533056452407334:3161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:35.828402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533056452407334:3161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:35.831650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:35.832052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533056452407334:3161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:35.832071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533056452407334:3161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:35.832075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533056452407334:3161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:35.832083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 67 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:35.833577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:35.833601Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:35.833604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:35.833608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:35.833615Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 66 [1:7556533056452407318:3159]
2025-10-02T08:07:35.833629Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:35.833650Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:35.833659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.833663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.833665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.833685Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:35.833691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:35.833704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:35.833775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.833783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.833786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:35.833790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:35.833996Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 66
2025-10-02T08:07:35.833865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:35.833876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.833891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:35.833905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:35.833927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452407365:3161], now have 1 active actors on pipe
2025-10-02T08:07:35.833930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 66
2025-10-02T08:07:35.833937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533056452407312:3159]
2025-10-02T08:07:35.833939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533056452407312:3159]
2025-10-02T08:07:35.833956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:35.833968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533056912868274:2378], now have 1 active actors on pipe
2025-10-02T08:07:35.833977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:35.833979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:35.833984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:35.833991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:35.833993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:35.834001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.834005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.834054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533056452407312:3159]
2025-10-02T08:07:35.834056Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:35.834065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:35.834072Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:35.834077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:35.834080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:35.834081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:35.834090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:35.834098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:35.834135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:35.834235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:35.834251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:35.834277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:35.834329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 67 partition: 0 MaxSeqNo: 17 sessionId: src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0
2025-10-02T08:07:35.834737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed3552-11b48d9c-ff8f8676-fdb3b4db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:35.841200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0] Write session: try to update token
2025-10-02T08:07:35.841226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:35.849371Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:35.849395Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:35.849408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533056452407312:3159]
2025-10-02T08:07:35.849474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:35.849747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:35.849934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:35.850112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:35.850282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:35.850582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:35.850640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:35.852873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:35.865022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId: src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:35.867054Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:35.867094Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:35.867103Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:35.867133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533056452407312:3159]
2025-10-02T08:07:35.867145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533056452407312:3159]
2025-10-02T08:07:35.867223Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:35.867244Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:35.867254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:35.867281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:35.867294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:35.867482Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:35.868284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:35.909782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533056452407380:2534]
2025-10-02T08:07:35.909975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:35.910160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 66, pipe: [1:7556533056452407380:2534]
2025-10-02T08:07:36.012691Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:36.014339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.014369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.014393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533056452407380:2534], now have 1 active actors on pipe
2025-10-02T08:07:36.014411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.014414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.014976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:36.015169Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.015185Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.017252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533056452407380:2534]
2025-10-02T08:07:36.017292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:36.017381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 67 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0
2025-10-02T08:07:36.017659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 67 sessionId: src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0 is DEAD
2025-10-02T08:07:36.017995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:36.018011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0] Write session will restart in 0.008799s
2025-10-02T08:07:36.018046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0] Write session: Do CDS request
2025-10-02T08:07:36.018054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:36.027123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:36.027527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:36.027848Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:36.027859Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:36.027869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:36.027915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:36.027981Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533060747374865:3165]
2025-10-02T08:07:36.028536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.028649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:36.028662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 68
2025-10-02T08:07:36.028862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.028895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 68 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:36.028915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=68 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:36.028924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:36.029087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:36.029328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:36.029368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:36.029405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 68 sessionId:  describe result for acl check
2025-10-02T08:07:36.029440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:36.029446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:36.029448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:36.029463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533060747374876:3167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:36.029793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:36.029850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.029856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.029858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.029859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.029860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.029866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.029877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.029881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.029891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.029895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.029900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.029909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.029915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.029925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.029931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.029937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.029942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.029949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.029958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.029965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.029986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:36.030068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533060747374876:3167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:36.033466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533060747374876:3167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:36.039885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533060747374876:3167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:36.039920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533060747374876:3167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:36.039925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533060747374876:3167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:36.039935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 68 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:36.043976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:36.047834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:36.047857Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:36.047860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:36.047864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:36.047873Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 67 [1:7556533060747374865:3165]
2025-10-02T08:07:36.047886Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:36.047907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:36.047911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.047914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.047917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.047934Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:36.047944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:36.047950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:36.048029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.048040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.048044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:36.048047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:36.048125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:36.048133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.048146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.048164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:36.048180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533060747374859:3165]
2025-10-02T08:07:36.048182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533060747374859:3165]
2025-10-02T08:07:36.048191Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:36.048209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:36.048220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:36.048225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:36.048226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:36.048228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 67
2025-10-02T08:07:36.048230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:36.048250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747374909:3167], now have 1 active actors on pipe
2025-10-02T08:07:36.048254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533061207835588:2378], now have 1 active actors on pipe
2025-10-02T08:07:36.048287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533060747374859:3165]
2025-10-02T08:07:36.048301Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:36.048308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.048312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:36.048317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.048366Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:36.048377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.048380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.048382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:36.048362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 67
2025-10-02T08:07:36.048392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.048405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:36.048432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.048469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.048475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.048488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.048526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 68 partition: 0 MaxSeqNo: 17 sessionId: src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0
2025-10-02T08:07:36.049112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d88e60a8-e1bedb26-f9256cdf-bb742186_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:36.054377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0] Write session: try to update token
2025-10-02T08:07:36.054398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:36.068963Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:36.068988Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:36.068990Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:36.068998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533060747374859:3165]
2025-10-02T08:07:36.069002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533060747374859:3165]
2025-10-02T08:07:36.069047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:36.069054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.069055Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:36.069056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:36.069061Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:36.069312Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:36.073174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId: src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:36.075858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:36.117623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533060747374937:2534]
2025-10-02T08:07:36.117715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:36.117819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 67, pipe: [1:7556533060747374937:2534]
2025-10-02T08:07:36.200696Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:36.201027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.201041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.201072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747374937:2534], now have 1 active actors on pipe
2025-10-02T08:07:36.201090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.201092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.201227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533060747374937:2534]
2025-10-02T08:07:36.201251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:36.201255Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.201256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:36.201257Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.201334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 68 reason: error at write: Disconnected sessionId: src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0
2025-10-02T08:07:36.201319Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:36.201498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 68 sessionId: src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0 is DEAD
2025-10-02T08:07:36.201711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:36.201723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0] Write session will restart in 0.008631s
2025-10-02T08:07:36.201751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0] Write session: Do CDS request
2025-10-02T08:07:36.201758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:36.208972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:36.209354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:36.209564Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:36.209574Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:36.209584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:36.209632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:36.209680Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533060747375138:3172]
2025-10-02T08:07:36.210310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:36.210479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:36.210521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:36.210821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:36.210870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.210876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.210878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.210879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.210879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.210884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.210893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.210897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.210901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.210905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.210910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.210916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.210922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.210926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.210931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.210936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.210945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.210949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.210954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.210958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.210980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:36.211352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.211473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:36.211484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 69
2025-10-02T08:07:36.211660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.211693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 69 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:36.211698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=69 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:36.211701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:36.212023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 69 sessionId:  describe result for acl check
2025-10-02T08:07:36.212052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:36.212053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:36.212055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:36.212059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533060747375155:3180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:36.212534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533060747375155:3180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:36.214637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533060747375155:3180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:36.218610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:36.220471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:36.220487Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:36.220489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:36.220493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:36.220498Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 68 [1:7556533060747375138:3172]
2025-10-02T08:07:36.220510Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:36.220526Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:36.220534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.220537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.220539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.220554Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:36.220563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:36.220570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:36.220631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.220640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.220644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:36.220645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:36.220722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:36.220731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.220743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.220759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:36.220782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533061207835594:2378], now have 1 active actors on pipe
2025-10-02T08:07:36.220793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533060747375132:3172]
2025-10-02T08:07:36.220796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533060747375132:3172]
2025-10-02T08:07:36.220823Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:36.220793Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 68
2025-10-02T08:07:36.220840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:36.220851Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:36.220855Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:36.220860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:36.220863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:36.220899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533060747375132:3172]
2025-10-02T08:07:36.220911Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:36.220927Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:36.221193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533060747375155:3180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:36.221205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533060747375155:3180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:36.221208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533060747375155:3180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:36.221215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 69 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:36.221559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 68
2025-10-02T08:07:36.221572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747375192:3180], now have 1 active actors on pipe
2025-10-02T08:07:36.221577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.221581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.221602Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:36.221614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.221617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.221619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:36.221629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.221644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:36.221662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.221693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.221699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.221710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.221736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 69 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0
2025-10-02T08:07:36.222155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ea49f7-7c6f164e-2772962c-e8dd9fd4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:36.224942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0] Write session: try to update token
2025-10-02T08:07:36.224968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:36.240106Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:36.240127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:36.240129Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:36.240136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533060747375132:3172]
2025-10-02T08:07:36.240140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533060747375132:3172]
2025-10-02T08:07:36.240183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:36.240185Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:36.240190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.240192Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:36.240192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:36.240685Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:36.244197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId: src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:36.247439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:36.301377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533060747375220:2534]
2025-10-02T08:07:36.301450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:36.301588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 68, pipe: [1:7556533060747375220:2534]
2025-10-02T08:07:36.374155Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:36.374515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.374526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.374561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747375220:2534], now have 1 active actors on pipe
2025-10-02T08:07:36.374575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.374580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.374713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:36.374727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:36.374810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 69 reason: error at write: Disconnected sessionId: src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0
2025-10-02T08:07:36.374839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:36.374999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 69 sessionId: src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0 is DEAD
2025-10-02T08:07:36.375038Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.375046Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.375184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:36.375200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0] Write session will restart in 0.007667s
2025-10-02T08:07:36.375226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0] Write session: Do CDS request
2025-10-02T08:07:36.375200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533060747375220:2534]
2025-10-02T08:07:36.375234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:36.384411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.384512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:36.384534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 70
2025-10-02T08:07:36.384652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.384686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 70 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:36.384695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=70 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:36.384699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:36.385240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 70 sessionId:  describe result for acl check
2025-10-02T08:07:36.385298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:36.385306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:36.385309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:36.385316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533060747375415:3193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:36.385987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533060747375415:3193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:36.389258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:36.389861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533060747375415:3193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:36.389930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:36.390161Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:36.390172Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:36.390188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:36.390258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:36.390318Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533060747375445:3191]
2025-10-02T08:07:36.391019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:36.391342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:36.391426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:36.391840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:36.391900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.391910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.391911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.391913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.391914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.391921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.391931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.391935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.391939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.391944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.391951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.391959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.391968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.391976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.391982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.391998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.392010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.392015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.392021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.392027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.392047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:36.396821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533060747375415:3193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:36.396844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533060747375415:3193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:36.396848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533060747375415:3193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:36.396858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 70 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:36.407040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:36.408918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:36.408936Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:36.408941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:36.408945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:36.408955Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 69 [1:7556533060747375445:3191]
2025-10-02T08:07:36.408972Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:36.408996Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:36.409001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.409005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.409008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.409028Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:36.409035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:36.409044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:36.409134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.409144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.409149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:36.409152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:36.409235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:36.409244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.409260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.409273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:36.409301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533060747375438:3191]
2025-10-02T08:07:36.409315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533060747375438:3191]
2025-10-02T08:07:36.409330Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:36.409346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:36.409362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:36.409366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:36.409410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533060747375438:3191]
2025-10-02T08:07:36.409420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:36.409452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533061207835624:2378], now have 1 active actors on pipe
2025-10-02T08:07:36.409499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:36.409514Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:36.409561Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 69
2025-10-02T08:07:36.409534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:36.409806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747375471:3193], now have 1 active actors on pipe
2025-10-02T08:07:36.409827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 69
2025-10-02T08:07:36.409841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.409863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.409906Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af749e27-fefb0a4a-61118804-9cdbceae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:36.409924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.409929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.409931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:36.409943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.409956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:36.409979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.410094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.410106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.410129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.410170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 70 partition: 0 MaxSeqNo: 17 sessionId: src_id|af749e27-fefb0a4a-61118804-9cdbceae_0
2025-10-02T08:07:36.410710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e09f2d2-bfc97ba2-bb4d3c4d-a9bef994_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|af749e27-fefb0a4a-61118804-9cdbceae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:36.413421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af749e27-fefb0a4a-61118804-9cdbceae_0] Write session: try to update token
2025-10-02T08:07:36.413436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af749e27-fefb0a4a-61118804-9cdbceae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:36.429622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId: src_id|af749e27-fefb0a4a-61118804-9cdbceae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:36.432603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:36.432728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.432749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.432817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:36.432850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:36.432921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.432939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.433180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.433402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.433508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.433588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.433758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.433771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.433861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.433938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.434017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.434145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.434209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.434218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.434302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.434412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.434486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.434564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.434640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.434644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.434756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.434877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.435000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.435079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.435134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.435137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.435217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.435511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.435813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.435880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.435946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.435949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.436022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.436097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.436177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.436261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.436331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.436334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.436419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.436490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.436565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.436640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.436791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.436794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.437051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.437131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.437206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.437275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.437423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.437426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.437507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.437566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.437628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.437698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.437747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.437750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.437823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:36.437909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:36.437977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:36.438056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:36.438195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:36.438198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:36.438277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:36.438336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.438353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.438355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:36.438384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:36.438395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:36.438397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:36.438399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:36.438401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:36.438802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:36.438820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:36.438828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:36.438832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:36.438836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:36.438839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:36.439744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:36.439765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:36.439773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:36.439776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:36.439780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:36.439783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:36.440552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:36.440571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:36.440578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:36.440584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:36.440588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:36.446325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:36.446354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:36.446372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392456446
2025-10-02T08:07:36.446581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:36.446601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:36.446611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:36.446619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:36.446624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:36.446627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:36.447246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:36.447270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:36.447277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:36.447282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:36.447285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:36.447290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:36.447849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:36.447874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:36.447882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:36.447885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:36.447889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:36.447892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:36.448463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:36.448487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:36.448495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:36.449853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:36.449871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:36.449877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:36.449883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:36.449894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392456449
2025-10-02T08:07:36.450215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:36.450236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:36.450242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:36.450245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:36.450248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:36.450252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:36.450771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:36.450794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:36.450799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:36.450803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:36.450806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:36.450810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:36.451351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:36.451371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.451483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392456451
2025-10-02T08:07:36.456225Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:36.456268Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:36.456275Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:36.456283Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:36.456297Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:36.456309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:36.456312Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:36.456319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533060747375438:3191]
2025-10-02T08:07:36.456325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533060747375438:3191]
2025-10-02T08:07:36.456389Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:36.456397Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:36.460776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:36.460797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.460812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:36.460992Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:36.475483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533060747375486:2534]
2025-10-02T08:07:36.475570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:36.475810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 69, pipe: [1:7556533060747375486:2534]
2025-10-02T08:07:36.623502Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:36.624004Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:36.624009Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:36.624024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533060747375438:3191]
2025-10-02T08:07:36.624129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747375486:2534], now have 1 active actors on pipe
2025-10-02T08:07:36.624151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.624160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.626660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af749e27-fefb0a4a-61118804-9cdbceae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:36.626678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af749e27-fefb0a4a-61118804-9cdbceae_0] Write session will restart in 0.005737s
2025-10-02T08:07:36.626705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af749e27-fefb0a4a-61118804-9cdbceae_0] Write session: Do CDS request
2025-10-02T08:07:36.626712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af749e27-fefb0a4a-61118804-9cdbceae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:36.624890Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:36.625573Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.625581Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.625982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533060747375486:2534]
2025-10-02T08:07:36.626006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:36.626033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 70 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af749e27-fefb0a4a-61118804-9cdbceae_0
2025-10-02T08:07:36.626235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 70 sessionId: src_id|af749e27-fefb0a4a-61118804-9cdbceae_0 is DEAD
2025-10-02T08:07:36.629212Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:36.633881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af749e27-fefb0a4a-61118804-9cdbceae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.634267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:36.634287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 71
2025-10-02T08:07:36.634679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.634716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 71 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:36.634723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=71 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:36.634727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:36.635235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 71 sessionId:  describe result for acl check
2025-10-02T08:07:36.635271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:36.635365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:36.635370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:36.635376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533060747375525:3198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:36.635967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533060747375525:3198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:36.639055Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:69:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:36.639116Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [ba5fc69165f6bd0d] Result# TEvPutResult {Id# [72075186224037892:69:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:36.642944Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:69:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:36.644265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533060747375525:3198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:36.658392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:36.659250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533060747375525:3198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:36.659271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533060747375525:3198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:36.659275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533060747375525:3198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:36.659284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 71 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:36.661763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:36.662020Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:36.662027Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:36.662040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:36.662096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:36.662142Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533060747375719:3197]
2025-10-02T08:07:36.662664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:36.662925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:36.662964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:36.663325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:36.663358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.663359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.663360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.663361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.663362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.663365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.663372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.663375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.663377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.663379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.663384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.663388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.663392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.663396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.663399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.663402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.663405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.663408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.663411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.663415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.663428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:36.679645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:36.681558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:36.681576Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:36.681579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:36.681583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:36.681591Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 70 [1:7556533060747375719:3197]
2025-10-02T08:07:36.681603Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:36.681622Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:36.681625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.681628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.681631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.681649Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:36.681654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:36.681661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:36.681733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.681735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.681739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:36.681742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:36.681835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:36.681838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.681851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.681862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:36.681879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533060747375706:3197]
2025-10-02T08:07:36.681883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533060747375706:3197]
2025-10-02T08:07:36.681896Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:36.681908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:36.681922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:36.681925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:36.681961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533060747375706:3197]
2025-10-02T08:07:36.681963Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:36.682162Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:36.682168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:36.682173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:36.682716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 70
2025-10-02T08:07:36.682731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747375714:3198], now have 1 active actors on pipe
2025-10-02T08:07:36.682735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533061207835633:2378], now have 1 active actors on pipe
2025-10-02T08:07:36.682792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.682797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.682823Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:36.682831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.682835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.682837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:36.682847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.682856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:36.682871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.682926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 70
2025-10-02T08:07:36.682935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.682943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.682968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.683003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 71 partition: 0 MaxSeqNo: 17 sessionId: src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0
2025-10-02T08:07:36.683541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af749e27-fefb0a4a-61118804-9cdbceae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:36.686243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0] Write session: try to update token
2025-10-02T08:07:36.686258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:36.721097Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:36.721115Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:36.721118Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:36.721128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533060747375706:3197]
2025-10-02T08:07:36.721132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533060747375706:3197]
2025-10-02T08:07:36.721178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:36.721181Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:36.721185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.721187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:36.721188Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:36.721364Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:36.724864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533060747375746:2534]
2025-10-02T08:07:36.724952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:36.725053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 70, pipe: [1:7556533060747375746:2534]
2025-10-02T08:07:36.736380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId: src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:36.739165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:36.870731Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:36.870985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747375746:2534], now have 1 active actors on pipe
2025-10-02T08:07:36.871004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.871009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.871041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.871042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.872270Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:36.871376Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.871396Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:36.871775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:36.871837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 71 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0
2025-10-02T08:07:36.872014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 71 sessionId: src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0 is DEAD
2025-10-02T08:07:36.872181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533060747375746:2534]
2025-10-02T08:07:36.873166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:36.873177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0] Write session will restart in 0.007874s
2025-10-02T08:07:36.873201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0] Write session: Do CDS request
2025-10-02T08:07:36.873208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:36.880972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:36.881513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:36.881683Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:36.881691Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:36.881698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:36.881729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:36.881763Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533060747375943:3204]
2025-10-02T08:07:36.882349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.882354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:36.882566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:36.882609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:36.882707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:36.882720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 72
2025-10-02T08:07:36.882914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:36.882972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.882979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.882980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.882981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.882982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.882987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.882997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.883001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.883005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.883009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.883015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.883027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:36.883036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.883042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:36.883046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.883052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:36.883061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.883067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.883075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.883080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.883101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:36.883343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:36.883379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 72 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:36.883388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=72 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:36.883392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:36.883819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 72 sessionId:  describe result for acl check
2025-10-02T08:07:36.883858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:36.883868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:36.883870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:36.883875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533060747375959:3206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:36.884434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533060747375959:3206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:36.886762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533060747375959:3206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:36.890933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533060747375959:3206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:36.890951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533060747375959:3206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:36.890956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533060747375959:3206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:36.890965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 72 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:36.891723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:36.895778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:36.895797Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:36.895800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:36.895804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:36.895810Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 71 [1:7556533060747375943:3204]
2025-10-02T08:07:36.895822Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:36.895839Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:36.895842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.895844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.895847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.895863Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:36.895873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:36.895880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:36.895956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.895962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.895964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:36.895966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:36.896016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:36.896021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.896031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:36.896038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:36.896054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533060747375937:3204]
2025-10-02T08:07:36.896059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533060747375937:3204]
2025-10-02T08:07:36.896065Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:36.896075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747375990:3206], now have 1 active actors on pipe
2025-10-02T08:07:36.896079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 71
2025-10-02T08:07:36.896080Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:36.896083Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:36.896084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:36.896092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:36.896094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:36.896098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533061207835641:2378], now have 1 active actors on pipe
2025-10-02T08:07:36.896102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.896104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.896138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533060747375937:3204]
2025-10-02T08:07:36.896149Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:36.896163Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4da91f9-2d868474-d44945cd-acfd0843_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:36.896176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:36.896184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:36.896185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:36.896187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:36.896195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:36.896203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:36.896247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 71
2025-10-02T08:07:36.896261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.896316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:36.896330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:36.896355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:36.896398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 72 partition: 0 MaxSeqNo: 17 sessionId: src_id|a4da91f9-2d868474-d44945cd-acfd0843_0
2025-10-02T08:07:36.896817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c09c313-9611f8e2-883662c8-4b65f54b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a4da91f9-2d868474-d44945cd-acfd0843_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:36.899985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4da91f9-2d868474-d44945cd-acfd0843_0] Write session: try to update token
2025-10-02T08:07:36.900004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4da91f9-2d868474-d44945cd-acfd0843_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:36.914343Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:36.914362Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:36.914365Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:36.914374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533060747375937:3204]
2025-10-02T08:07:36.914379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533060747375937:3204]
2025-10-02T08:07:36.914423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:36.914428Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:36.914434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:36.914437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:36.914442Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:36.914593Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:36.920633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId: src_id|a4da91f9-2d868474-d44945cd-acfd0843_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:36.923700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:36.972151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533060747376005:2534]
2025-10-02T08:07:36.972248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:36.972382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 71, pipe: [1:7556533060747376005:2534]
2025-10-02T08:07:37.056464Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:37.056888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.056901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.056922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533060747376005:2534], now have 1 active actors on pipe
2025-10-02T08:07:37.056941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.056947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.057056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:37.057068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:37.057134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 72 reason: error at write: Disconnected sessionId: src_id|a4da91f9-2d868474-d44945cd-acfd0843_0
2025-10-02T08:07:37.057169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:37.057336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 72 sessionId: src_id|a4da91f9-2d868474-d44945cd-acfd0843_0 is DEAD
2025-10-02T08:07:37.057527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533060747376005:2534]
2025-10-02T08:07:37.057587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4da91f9-2d868474-d44945cd-acfd0843_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:37.057615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4da91f9-2d868474-d44945cd-acfd0843_0] Write session will restart in 0.005740s
2025-10-02T08:07:37.057656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4da91f9-2d868474-d44945cd-acfd0843_0] Write session: Do CDS request
2025-10-02T08:07:37.057666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4da91f9-2d868474-d44945cd-acfd0843_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:37.057684Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.057697Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.064390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4da91f9-2d868474-d44945cd-acfd0843_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.064462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:37.064477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 73
2025-10-02T08:07:37.064610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.064639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 73 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:37.064649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=73 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:37.064652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:37.064996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 73 sessionId:  describe result for acl check
2025-10-02T08:07:37.065030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:37.065032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:37.065033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:37.065038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533065042343492:3211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:37.065137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:37.065467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533065042343492:3211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:37.065584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:37.065749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:37.065757Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:37.065765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:37.065810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:37.065848Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533065042343505:3210]
2025-10-02T08:07:37.066355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:37.066498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:37.066532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:37.066787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:37.066821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.066827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.066828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.066829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.066830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.066834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.066841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.066844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.066847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.066850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.066854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.066860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.066864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.066868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.066871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.066875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.066878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.066882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.066885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.066892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.066908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:37.066940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533065042343492:3211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:37.072526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533065042343492:3211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:37.072545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533065042343492:3211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:37.072548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533065042343492:3211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:37.072560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 73 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:37.074805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:37.076528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:37.076542Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:37.076544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:37.076547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:37.076552Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 72 [1:7556533065042343505:3210]
2025-10-02T08:07:37.076560Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:37.076573Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:37.076575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.076577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.076578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.076589Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:37.076592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:37.076597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:37.076644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.076651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.076655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:37.076657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:37.076725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:37.076732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.076740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.076752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:37.076769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042343546:3211], now have 1 active actors on pipe
2025-10-02T08:07:37.076779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533065042343494:3210]
2025-10-02T08:07:37.076779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 72
2025-10-02T08:07:37.076781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533065042343494:3210]
2025-10-02T08:07:37.076788Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:37.076795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533065502802955:2378], now have 1 active actors on pipe
2025-10-02T08:07:37.076809Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:37.076812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:37.076819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:37.076831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:37.076834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:37.076841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.076850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.076890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533065042343494:3210]
2025-10-02T08:07:37.076898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:37.076893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 72
2025-10-02T08:07:37.076911Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa208036-171bb0d1-a20ca2bc-897514be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:37.076913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:37.076924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.076927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.076929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:37.076937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.076946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:37.076990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.077035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.077042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.077056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.077096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 73 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa208036-171bb0d1-a20ca2bc-897514be_0
2025-10-02T08:07:37.077538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4da91f9-2d868474-d44945cd-acfd0843_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa208036-171bb0d1-a20ca2bc-897514be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:37.080439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa208036-171bb0d1-a20ca2bc-897514be_0] Write session: try to update token
2025-10-02T08:07:37.080459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa208036-171bb0d1-a20ca2bc-897514be_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:37.102014Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:37.102034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:37.102037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:37.102045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533065042343494:3210]
2025-10-02T08:07:37.102051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533065042343494:3210]
2025-10-02T08:07:37.102093Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:37.102096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:37.102099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:37.102102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.102106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:37.102310Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:37.109646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId: src_id|fa208036-171bb0d1-a20ca2bc-897514be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:37.112605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:37.157441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533065042343572:2534]
2025-10-02T08:07:37.157526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:37.157662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 72, pipe: [1:7556533065042343572:2534]
2025-10-02T08:07:37.245080Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:37.245529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.245553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.245573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042343572:2534], now have 1 active actors on pipe
2025-10-02T08:07:37.245598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.245606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.246082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533065042343572:2534]
2025-10-02T08:07:37.246226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:37.246237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:37.246306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 73 reason: error at write: Disconnected sessionId: src_id|fa208036-171bb0d1-a20ca2bc-897514be_0
2025-10-02T08:07:37.246423Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.246431Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.246505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 73 sessionId: src_id|fa208036-171bb0d1-a20ca2bc-897514be_0 is DEAD
2025-10-02T08:07:37.246986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa208036-171bb0d1-a20ca2bc-897514be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:37.247001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa208036-171bb0d1-a20ca2bc-897514be_0] Write session will restart in 0.009226s
2025-10-02T08:07:37.247025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa208036-171bb0d1-a20ca2bc-897514be_0] Write session: Do CDS request
2025-10-02T08:07:37.247032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa208036-171bb0d1-a20ca2bc-897514be_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:37.247485Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:37.257414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa208036-171bb0d1-a20ca2bc-897514be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.257482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:37.257500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 74
2025-10-02T08:07:37.257711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.257744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 74 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:37.257754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=74 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:37.257758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:37.258253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 74 sessionId:  describe result for acl check
2025-10-02T08:07:37.258283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:37.258285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:37.258286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:37.258291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533065042343733:3224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:37.258939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533065042343733:3224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:37.264871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:37.266071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533065042343733:3224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:37.271468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:37.271709Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:37.271713Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:37.271724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:37.271778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:37.271814Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533065042343816:3217]
2025-10-02T08:07:37.272520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:37.272780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:37.272861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:37.273250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:37.273315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.273317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.273318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.273319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.273320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.273326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.273335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.273339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.273343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.273347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.273353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.273360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.273366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.273371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.273375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.273381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.273386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.273391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.273395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.273400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.273420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:37.273728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533065042343733:3224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:37.273735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533065042343733:3224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:37.273738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533065042343733:3224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:37.273747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 74 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:37.285160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:37.287142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:37.287167Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:37.287171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:37.287175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:37.287182Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 73 [1:7556533065042343816:3217]
2025-10-02T08:07:37.287196Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:37.287213Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:37.287216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.287219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.287222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.287240Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:37.287245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:37.287253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:37.287332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.287335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.287338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:37.287341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:37.287411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:37.287422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.287435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.287447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:37.287467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042343832:3224], now have 1 active actors on pipe
2025-10-02T08:07:37.287482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533065042343798:3217]
2025-10-02T08:07:37.287485Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533065042343798:3217]
2025-10-02T08:07:37.287505Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:37.287516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:37.287520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:37.287521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533065502802962:2378], now have 1 active actors on pipe
2025-10-02T08:07:37.287530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:37.287544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:37.287547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:37.287584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533065042343798:3217]
2025-10-02T08:07:37.287597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:37.287603Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:37.287645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 73
2025-10-02T08:07:37.287626Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 73
2025-10-02T08:07:37.287725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.287749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.287790Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:37.287803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.287807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.287809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:37.287819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.287836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:37.287871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.287922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.287943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.287961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.287998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 74 partition: 0 MaxSeqNo: 17 sessionId: src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0
2025-10-02T08:07:37.288436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa208036-171bb0d1-a20ca2bc-897514be_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:37.291279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0] Write session: try to update token
2025-10-02T08:07:37.291300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:37.309405Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:37.309428Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:37.309430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:37.309438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533065042343798:3217]
2025-10-02T08:07:37.309443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533065042343798:3217]
2025-10-02T08:07:37.309487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:37.309493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.309495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:37.309594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId: src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:37.309710Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:37.312438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:37.312531Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:37.312545Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:37.346921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533065042343867:2534]
2025-10-02T08:07:37.347006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:37.347092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 73, pipe: [1:7556533065042343867:2534]
2025-10-02T08:07:37.474384Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:37.475409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.475418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.475455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042343867:2534], now have 1 active actors on pipe
2025-10-02T08:07:37.475468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.475470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.477129Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.477144Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.477871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533065042343867:2534]
2025-10-02T08:07:37.477900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:37.477947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 74 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0
2025-10-02T08:07:37.478111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 74 sessionId: src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0 is DEAD
2025-10-02T08:07:37.478410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:37.478422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0] Write session will restart in 0.008397s
2025-10-02T08:07:37.478445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0] Write session: Do CDS request
2025-10-02T08:07:37.478452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:37.477229Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:37.488890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.492784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:37.492959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:37.492963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 75
2025-10-02T08:07:37.493568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:37.493758Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:37.493761Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:37.493771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:37.493818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:37.493859Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533065042344082:3236]
2025-10-02T08:07:37.494540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:37.494727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:37.494771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:37.495085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:37.495120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.495121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.495122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.495123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.495124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.495129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.495140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.495144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.495148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.495153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.495158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.495166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.495171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.495177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.495184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.495190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.495193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.495199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.495204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.495209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.495229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:37.496968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.497044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 75 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:37.497050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=75 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:37.497055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:37.497689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 75 sessionId:  describe result for acl check
2025-10-02T08:07:37.497721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:37.497723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:37.497724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:37.497729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533065042344097:3238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:37.498225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533065042344097:3238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:37.505951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533065042344097:3238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:37.506300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:37.508547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:37.508658Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:37.508664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:37.508669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:37.508675Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 74 [1:7556533065042344082:3236]
2025-10-02T08:07:37.508685Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:37.508703Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:37.508705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.508708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.508709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.508726Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:37.508730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:37.508736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:37.508832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.508834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.508837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:37.508839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:37.508904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:37.508906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.508919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.508929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:37.508955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533065042344074:3236]
2025-10-02T08:07:37.508957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533065042344074:3236]
2025-10-02T08:07:37.508964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:37.508976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:37.508988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:37.508990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:37.509033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533065042344074:3236]
2025-10-02T08:07:37.509035Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:37.509259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:37.509269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:37.509274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:37.509485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533065502802993:2378], now have 1 active actors on pipe
2025-10-02T08:07:37.510525Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 74
2025-10-02T08:07:37.519745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533065042344097:3238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:37.519765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533065042344097:3238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:37.519769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533065042344097:3238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:37.519778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 75 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:37.520981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 74
2025-10-02T08:07:37.521001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042344133:3238], now have 1 active actors on pipe
2025-10-02T08:07:37.521008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.521014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.521041Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59da3c-80de940a-dde7f54b-b706c0fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:37.521050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.521054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.521056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:37.521069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.521083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:37.521102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.521138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.521140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.521152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.521181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 75 partition: 0 MaxSeqNo: 17 sessionId: src_id|59da3c-80de940a-dde7f54b-b706c0fb_0
2025-10-02T08:07:37.521756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fae8aed-31d0136-8bf1e01-1ca74472_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59da3c-80de940a-dde7f54b-b706c0fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:37.524558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59da3c-80de940a-dde7f54b-b706c0fb_0] Write session: try to update token
2025-10-02T08:07:37.524578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59da3c-80de940a-dde7f54b-b706c0fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:37.540181Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:37.540203Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:37.540206Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:37.540216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533065042344074:3236]
2025-10-02T08:07:37.540221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533065042344074:3236]
2025-10-02T08:07:37.540283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:37.540289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.540292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:37.540506Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:37.541420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:37.541426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:37.544881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId: src_id|59da3c-80de940a-dde7f54b-b706c0fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:37.586257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:37.586418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533065042344140:2534]
2025-10-02T08:07:37.586487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:37.586552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 74, pipe: [1:7556533065042344140:2534]
2025-10-02T08:07:37.712828Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:37.713227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.713247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.713267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042344140:2534], now have 1 active actors on pipe
2025-10-02T08:07:37.713282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.713290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.713422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533065042344140:2534]
2025-10-02T08:07:37.713452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:37.713459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:37.713521Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.713532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 75 reason: error at write: Disconnected sessionId: src_id|59da3c-80de940a-dde7f54b-b706c0fb_0
2025-10-02T08:07:37.713535Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.713511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:37.713731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 75 sessionId: src_id|59da3c-80de940a-dde7f54b-b706c0fb_0 is DEAD
2025-10-02T08:07:37.713975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59da3c-80de940a-dde7f54b-b706c0fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:37.713987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59da3c-80de940a-dde7f54b-b706c0fb_0] Write session will restart in 0.006384s
2025-10-02T08:07:37.714020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59da3c-80de940a-dde7f54b-b706c0fb_0] Write session: Do CDS request
2025-10-02T08:07:37.714027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59da3c-80de940a-dde7f54b-b706c0fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:37.721451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59da3c-80de940a-dde7f54b-b706c0fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.721908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:37.721939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 76
2025-10-02T08:07:37.722133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.722170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 76 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:37.722186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=76 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:37.722190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:37.723534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 76 sessionId:  describe result for acl check
2025-10-02T08:07:37.723584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:37.723586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:37.723587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:37.723593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533065042344339:3244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:37.724362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533065042344339:3244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:37.724941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:37.725557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:37.725781Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:37.725792Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:37.725803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:37.725856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:37.725906Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533065042344361:3242]
2025-10-02T08:07:37.726586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:37.726844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:37.726915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:37.727110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533065042344339:3244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:37.727277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:37.727340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.727346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.727348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.727349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.727350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.727356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.727368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.727377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.727381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.727385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.727391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.727401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.727411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.727417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.727424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.727430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.727436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.727442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.727452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.727457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.727479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:37.734275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533065042344339:3244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:37.734291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533065042344339:3244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:37.734295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533065042344339:3244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:37.734304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 76 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:37.739299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:37.741420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:37.741443Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:37.741446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:37.741450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:37.741457Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 75 [1:7556533065042344361:3242]
2025-10-02T08:07:37.741470Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:37.741490Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:37.741500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.741502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.741505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.741521Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:37.741531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:37.741538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:37.741606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.741613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.741616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:37.741618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:37.741689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:37.741698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.741712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.741729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:37.741738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 75
2025-10-02T08:07:37.741753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042344393:3244], now have 1 active actors on pipe
2025-10-02T08:07:37.741761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533065502803000:2378], now have 1 active actors on pipe
2025-10-02T08:07:37.741766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.741770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.741787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533065042344346:3242]
2025-10-02T08:07:37.741794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533065042344346:3242]
2025-10-02T08:07:37.741806Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:37.741821Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:37.741826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:37.741840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:37.741842Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:37.741845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:37.741858Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39562184-900c48f9-98ca30b7-914bdbb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:37.741865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.741824Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 75
2025-10-02T08:07:37.741869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.741871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:37.741878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.741887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:37.741923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533065042344346:3242]
2025-10-02T08:07:37.741931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:37.741943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:37.741958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.742013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.742023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.742038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.742080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 76 partition: 0 MaxSeqNo: 17 sessionId: src_id|39562184-900c48f9-98ca30b7-914bdbb2_0
2025-10-02T08:07:37.742578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59da3c-80de940a-dde7f54b-b706c0fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|39562184-900c48f9-98ca30b7-914bdbb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:37.750079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39562184-900c48f9-98ca30b7-914bdbb2_0] Write session: try to update token
2025-10-02T08:07:37.750105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39562184-900c48f9-98ca30b7-914bdbb2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:37.757421Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:37.757440Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:37.757448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533065042344346:3242]
2025-10-02T08:07:37.757495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:37.757507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:37.757891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:37.758045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:37.758271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:37.758434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:37.758675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:37.758719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:37.766564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId: src_id|39562184-900c48f9-98ca30b7-914bdbb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:37.769550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:37.769661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.769678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.769721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:37.769746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:37.769817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.769839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.770032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.770105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.770179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.770432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.770499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.770504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.770585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.770690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.770805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.770914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.771019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.771027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.771099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.771176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.771248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.771313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.771377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.771384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.771459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.771566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.771665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.771733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.771807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.771815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.771884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.771951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.772057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.772127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.772193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.772200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.772298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.772376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.772453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.772527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.772589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.772596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.772676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.772744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.772837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.772911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.772965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.772972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.773048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.773122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.773197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.773273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.773357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.773365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.773438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.773501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.773564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.773635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.773704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.773711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.773781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:37.773852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:37.773915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:37.774170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:37.774224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:37.774234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:37.774285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:37.774359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.774383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.774393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:37.774426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:37.774440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:37.774444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:37.774447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:37.774450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:37.775041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:37.775066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:37.775074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:37.775077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:37.775079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:37.775081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:37.775632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:37.775654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:37.775659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:37.775661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:37.775663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:37.775666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:37.776331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:37.776349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:37.776354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:37.776359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:37.776361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:37.777663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:37.777680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:37.777690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392457777
2025-10-02T08:07:37.777801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:37.777813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:37.777817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:37.777820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:37.777823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:37.777825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:37.778373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:37.778392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:37.778397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:37.778399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:37.778403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:37.778408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:37.778915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:37.778936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:37.778941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:37.778944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:37.778946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:37.778949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:37.779820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:37.779839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:37.779843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:37.781422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:37.781438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:37.781447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:37.781451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:37.781461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392457781
2025-10-02T08:07:37.781792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:37.781812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:37.781816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:37.781821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:37.781824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:37.781826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:37.782316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:37.782336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:37.782340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:37.782342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:37.782345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:37.782347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:37.782845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:37.782865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.782986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392457782
2025-10-02T08:07:37.783865Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:37.783881Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:37.783887Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:37.783894Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:37.786645Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:37.786658Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:37.786660Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:37.786669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533065042344346:3242]
2025-10-02T08:07:37.786673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533065042344346:3242]
2025-10-02T08:07:37.786743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:37.786755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.786757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:37.786819Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:37.786831Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:37.786889Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:37.813861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533065042344415:2534]
2025-10-02T08:07:37.813938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:37.814044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 75, pipe: [1:7556533065042344415:2534]
2025-10-02T08:07:37.914944Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:37.915238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042344415:2534], now have 1 active actors on pipe
2025-10-02T08:07:37.915260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.915266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.915379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:37.915392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:37.915422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 76 reason: error at write: Disconnected sessionId: src_id|39562184-900c48f9-98ca30b7-914bdbb2_0
2025-10-02T08:07:37.915460Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.915472Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:37.915515Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:37.915630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 76 sessionId: src_id|39562184-900c48f9-98ca30b7-914bdbb2_0 is DEAD
2025-10-02T08:07:37.915755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39562184-900c48f9-98ca30b7-914bdbb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:37.915762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39562184-900c48f9-98ca30b7-914bdbb2_0] Write session will restart in 0.009192s
2025-10-02T08:07:37.915785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39562184-900c48f9-98ca30b7-914bdbb2_0] Write session: Do CDS request
2025-10-02T08:07:37.915780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533065042344415:2534]
2025-10-02T08:07:37.915795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39562184-900c48f9-98ca30b7-914bdbb2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:37.922450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:37.922831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:37.923043Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:37.923053Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:37.923063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:37.923108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:37.923144Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533065042344620:3249]
2025-10-02T08:07:37.923611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:37.923755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:37.923778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:37.923965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:37.923995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.924001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.924002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.924003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.924004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.924008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.924017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.924020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.924023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.924026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.924030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.924040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:37.924046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.924051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:37.924054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.924057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:37.924059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.924061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.924064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.924066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.924075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:37.926519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39562184-900c48f9-98ca30b7-914bdbb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.926609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:37.926632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 77
2025-10-02T08:07:37.926780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:37.926813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 77 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:37.926825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=77 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:37.926830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:37.927356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 77 sessionId:  describe result for acl check
2025-10-02T08:07:37.927398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:37.927404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:37.927405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:37.927412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533065042344637:3251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:37.928075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533065042344637:3251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:37.930954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533065042344637:3251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:37.932665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:37.934714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:37.934729Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:37.934730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:37.934734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:37.934740Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 76 [1:7556533065042344620:3249]
2025-10-02T08:07:37.934751Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:37.934767Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:37.934770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.934773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.934775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.934792Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:37.934796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:37.934803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:37.934864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.934871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.934874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:37.934876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:37.934942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:37.934952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.934963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:37.934973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:37.934989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533065042344614:3249]
2025-10-02T08:07:37.934991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533065042344614:3249]
2025-10-02T08:07:37.934997Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:37.935009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:37.935012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:37.935015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533065502803009:2378], now have 1 active actors on pipe
2025-10-02T08:07:37.935020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:37.935033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:37.935042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:37.935075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533065042344614:3249]
2025-10-02T08:07:37.935083Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:37.935071Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 76
2025-10-02T08:07:37.935135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:37.935871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533065042344637:3251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:37.935885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533065042344637:3251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:37.935889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533065042344637:3251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:37.935897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 77 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:37.936236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 76
2025-10-02T08:07:37.936250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533065042344676:3251], now have 1 active actors on pipe
2025-10-02T08:07:37.936256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.936265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.936287Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|498136be-9e475591-c1bd2c5-c3f975b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:37.936298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:37.936303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:37.936308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:37.936315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:37.936330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:37.936349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.936395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:37.936402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:37.936415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:37.936445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 77 partition: 0 MaxSeqNo: 17 sessionId: src_id|498136be-9e475591-c1bd2c5-c3f975b7_0
2025-10-02T08:07:37.936852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39562184-900c48f9-98ca30b7-914bdbb2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|498136be-9e475591-c1bd2c5-c3f975b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:37.939839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498136be-9e475591-c1bd2c5-c3f975b7_0] Write session: try to update token
2025-10-02T08:07:37.939855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498136be-9e475591-c1bd2c5-c3f975b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:37.954346Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:37.954368Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:37.954371Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:37.954381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533065042344614:3249]
2025-10-02T08:07:37.954385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533065042344614:3249]
2025-10-02T08:07:37.954432Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:37.954434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:37.954440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:37.954443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:37.954448Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:37.954602Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:37.963509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId: src_id|498136be-9e475591-c1bd2c5-c3f975b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:37.966229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:38.016079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533069337311978:2534]
2025-10-02T08:07:38.016169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:38.016354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 76, pipe: [1:7556533069337311978:2534]
2025-10-02T08:07:38.092415Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:38.092747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.092764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.092783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337311978:2534], now have 1 active actors on pipe
2025-10-02T08:07:38.092797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.092821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.092904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533069337311978:2534]
2025-10-02T08:07:38.092937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:38.092939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:38.093010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 77 reason: error at write: Disconnected sessionId: src_id|498136be-9e475591-c1bd2c5-c3f975b7_0
2025-10-02T08:07:38.093074Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:38.093163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 77 sessionId: src_id|498136be-9e475591-c1bd2c5-c3f975b7_0 is DEAD
2025-10-02T08:07:38.093308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498136be-9e475591-c1bd2c5-c3f975b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:38.093322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498136be-9e475591-c1bd2c5-c3f975b7_0] Write session will restart in 0.009605s
2025-10-02T08:07:38.093345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498136be-9e475591-c1bd2c5-c3f975b7_0] Write session: Do CDS request
2025-10-02T08:07:38.093352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498136be-9e475591-c1bd2c5-c3f975b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:38.093379Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.093393Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.101566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:38.102082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:38.102315Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:38.102332Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:38.102346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:38.102419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:38.102473Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533069337312197:3256]
2025-10-02T08:07:38.103108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:38.103345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:38.103406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:38.103767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:38.103850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.103859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.103861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.103862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.103863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.103869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.103879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.103882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.103885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.103888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.103894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.103901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.103907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.103913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.103924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.103930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.103941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.103946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.103956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.103966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.103984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:38.104425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498136be-9e475591-c1bd2c5-c3f975b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.104537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:38.104550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 78
2025-10-02T08:07:38.104727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.104759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 78 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:38.104764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=78 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:38.104766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:38.105202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 78 sessionId:  describe result for acl check
2025-10-02T08:07:38.105238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:38.105245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:38.105246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:38.105252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533069337312214:3258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:38.105744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533069337312214:3258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:38.107814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533069337312214:3258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:38.111521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533069337312214:3258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:38.111538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533069337312214:3258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:38.111542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533069337312214:3258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:38.111550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 78 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:38.112127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:38.114104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:38.114122Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:38.114124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:38.114128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:38.114135Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 77 [1:7556533069337312197:3256]
2025-10-02T08:07:38.114145Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:38.114163Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:38.114171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.114174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.114176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.114192Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:38.114201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:38.114212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:38.114276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.114282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.114285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:38.114288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:38.114359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:38.114364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.114374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 77
2025-10-02T08:07:38.114376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.114387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:38.114405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337312245:3258], now have 1 active actors on pipe
2025-10-02T08:07:38.114415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.114419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.114438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533069797770324:2378], now have 1 active actors on pipe
2025-10-02T08:07:38.114448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533069337312191:3256]
2025-10-02T08:07:38.114450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533069337312191:3256]
2025-10-02T08:07:38.114461Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:38.114477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:38.114481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:38.114484Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:38.114495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:38.114501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:38.114474Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 77
2025-10-02T08:07:38.114516Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e11035d8-aa4c1d48-3812654b-a413810d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:38.114525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.114529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.114532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:38.114541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.114551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:38.114584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533069337312191:3256]
2025-10-02T08:07:38.114598Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:38.114617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.114625Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:38.114652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.114659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.114674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.114708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 78 partition: 0 MaxSeqNo: 17 sessionId: src_id|e11035d8-aa4c1d48-3812654b-a413810d_0
2025-10-02T08:07:38.115082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498136be-9e475591-c1bd2c5-c3f975b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e11035d8-aa4c1d48-3812654b-a413810d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:38.118177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11035d8-aa4c1d48-3812654b-a413810d_0] Write session: try to update token
2025-10-02T08:07:38.118194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11035d8-aa4c1d48-3812654b-a413810d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:38.125548Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:38.125569Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:38.125578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533069337312191:3256]
2025-10-02T08:07:38.125622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:38.125634Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:38.125806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:38.125950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.126098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.126243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.126431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:38.126470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:38.135151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId: src_id|e11035d8-aa4c1d48-3812654b-a413810d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:38.137853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:38.137919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.137931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.137960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:38.137984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:38.138023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.138035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.138182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.138248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.138335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.138413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.138466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.138476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.138562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.138619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.138682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.138758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.138817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.138823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.138892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.138948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.139014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.139070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.139112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.139117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.139177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.139242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.139308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.139370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.139431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.139436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.139505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.139566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.139628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.139692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.139745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.139751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.139822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.139881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.139951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.140010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.140061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.140065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.140123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.140174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.140248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.140308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.140350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.140355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.140422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.140479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.140540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.140597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.140639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.140643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.140706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.140761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.140837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.140892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.140935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.140939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.140997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.141044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.141098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.141146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.141189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.141193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.141236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:38.141290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.141311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.141316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:38.141340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:38.141353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:38.141358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:38.141360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:38.141362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:38.141687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:38.141705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:38.141713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:38.141718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:38.141720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:38.141723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:38.142183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:38.142200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:38.142207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:38.142209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:38.142210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:38.142212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:38.142762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:38.142781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:38.142788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:38.142790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:38.142792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:38.143964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:38.143979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:38.143987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392458143
2025-10-02T08:07:38.144123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:38.144132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:38.144136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:38.144138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:38.144139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:38.144141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:38.144637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:38.144656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:38.144659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:38.144662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:38.144664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:38.144666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:38.145145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:38.145159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:38.145163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:38.145165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:38.145170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:38.145172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:38.145598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:38.145615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:38.145618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:38.146670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:38.146685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:38.146689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:38.146693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:38.146698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392458146
2025-10-02T08:07:38.146971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:38.146986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:38.146990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:38.146993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:38.146995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:38.146997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:38.147628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:38.147645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:38.147649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:38.147653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:38.147655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:38.147658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:38.148083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:38.148099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.148174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392458148
2025-10-02T08:07:38.150317Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:38.150337Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:38.150341Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:38.150345Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:38.150357Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:38.150358Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:38.150360Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:38.150365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533069337312191:3256]
2025-10-02T08:07:38.150368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533069337312191:3256]
2025-10-02T08:07:38.150400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:38.150411Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:38.150418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:38.150420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.150421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:38.150555Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:38.193250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533069337312260:2534]
2025-10-02T08:07:38.193325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:38.193434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 77, pipe: [1:7556533069337312260:2534]
2025-10-02T08:07:38.282995Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:38.283308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337312260:2534], now have 1 active actors on pipe
2025-10-02T08:07:38.283327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.283337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.283545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:38.283555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:38.283574Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.283584Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.283586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 78 reason: error at write: Disconnected sessionId: src_id|e11035d8-aa4c1d48-3812654b-a413810d_0
2025-10-02T08:07:38.283752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:38.283810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 78 sessionId: src_id|e11035d8-aa4c1d48-3812654b-a413810d_0 is DEAD
2025-10-02T08:07:38.283924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11035d8-aa4c1d48-3812654b-a413810d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:38.283922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533069337312260:2534]
2025-10-02T08:07:38.283934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11035d8-aa4c1d48-3812654b-a413810d_0] Write session will restart in 0.006445s
2025-10-02T08:07:38.283968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11035d8-aa4c1d48-3812654b-a413810d_0] Write session: Do CDS request
2025-10-02T08:07:38.283975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11035d8-aa4c1d48-3812654b-a413810d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:38.288089Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f6db74ff06377fa8] Result# TEvPutResult {Id# [72075186224037892:77:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:38.288144Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:77:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:38.288208Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:77:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:38.291471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11035d8-aa4c1d48-3812654b-a413810d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.291578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:38.291592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 79
2025-10-02T08:07:38.291786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.291818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 79 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:38.291823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=79 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:38.291826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:38.292300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 79 sessionId:  describe result for acl check
2025-10-02T08:07:38.292329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:38.292331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:38.292333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:38.292337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533069337312417:3263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:38.292896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533069337312417:3263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:38.294609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:38.295072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:38.295245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533069337312417:3263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:38.295367Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:38.295378Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:38.295390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:38.295454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:38.295491Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533069337312498:3262]
2025-10-02T08:07:38.296088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:38.296264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:38.296300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:38.296543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:38.296578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.296585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.296586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.296586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.296587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.296591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.296598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.296600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.296603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.296605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.296608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.296614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.296618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.296623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.296627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.296632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.296636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.296640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.296645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.296650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.296661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:38.301896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533069337312417:3263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:38.301911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533069337312417:3263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:38.301914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533069337312417:3263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:38.301923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 79 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:38.305297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:38.307042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:38.307059Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:38.307061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:38.307065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:38.307072Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 78 [1:7556533069337312498:3262]
2025-10-02T08:07:38.307083Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:38.307101Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:38.307104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.307108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.307111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.307126Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:38.307137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:38.307143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:38.307218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.307227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.307230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:38.307233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:38.307305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:38.307312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.307326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.307343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:38.307477Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 78
2025-10-02T08:07:38.307367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337312529:3263], now have 1 active actors on pipe
2025-10-02T08:07:38.307379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533069797770331:2378], now have 1 active actors on pipe
2025-10-02T08:07:38.307385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533069337312489:3262]
2025-10-02T08:07:38.307388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533069337312489:3262]
2025-10-02T08:07:38.307403Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:38.307417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:38.307429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:38.307431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:38.307433Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:38.307433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:38.307466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533069337312489:3262]
2025-10-02T08:07:38.307475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:38.307480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:38.307518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 78
2025-10-02T08:07:38.307543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.307547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.307577Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4016947d-3602adc5-44524435-f2a3f488_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:38.307585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.307588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.307590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:38.307602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.307611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:38.307628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.307661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.307663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.307675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.307705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 79 partition: 0 MaxSeqNo: 17 sessionId: src_id|4016947d-3602adc5-44524435-f2a3f488_0
2025-10-02T08:07:38.308101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11035d8-aa4c1d48-3812654b-a413810d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4016947d-3602adc5-44524435-f2a3f488_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:38.311475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4016947d-3602adc5-44524435-f2a3f488_0] Write session: try to update token
2025-10-02T08:07:38.311496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4016947d-3602adc5-44524435-f2a3f488_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:38.326259Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:38.326277Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:38.326283Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:38.326290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533069337312489:3262]
2025-10-02T08:07:38.326294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533069337312489:3262]
2025-10-02T08:07:38.326336Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:38.326340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:38.326341Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:38.326346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.326348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:38.326499Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:38.338525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId: src_id|4016947d-3602adc5-44524435-f2a3f488_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:38.341552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:38.384229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533069337312572:2534]
2025-10-02T08:07:38.384306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:38.384400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 78, pipe: [1:7556533069337312572:2534]
2025-10-02T08:07:38.462281Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:38.462652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.462666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.462687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337312572:2534], now have 1 active actors on pipe
2025-10-02T08:07:38.462699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.462705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.462805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:38.462816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:38.462889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 79 reason: error at write: Disconnected sessionId: src_id|4016947d-3602adc5-44524435-f2a3f488_0
2025-10-02T08:07:38.463078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 79 sessionId: src_id|4016947d-3602adc5-44524435-f2a3f488_0 is DEAD
2025-10-02T08:07:38.463088Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.463092Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.463210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4016947d-3602adc5-44524435-f2a3f488_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:38.463220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4016947d-3602adc5-44524435-f2a3f488_0] Write session will restart in 0.006488s
2025-10-02T08:07:38.463272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533069337312572:2534]
2025-10-02T08:07:38.463329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4016947d-3602adc5-44524435-f2a3f488_0] Write session: Do CDS request
2025-10-02T08:07:38.463346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4016947d-3602adc5-44524435-f2a3f488_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:38.463522Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:38.471352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4016947d-3602adc5-44524435-f2a3f488_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.471524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:38.471540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 80
2025-10-02T08:07:38.471687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.471718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 80 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:38.471727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=80 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:38.471731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:38.472060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 80 sessionId:  describe result for acl check
2025-10-02T08:07:38.472085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:38.472089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:38.472091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:38.472094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533069337312790:3282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:38.472482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:38.472557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533069337312790:3282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:38.472976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:38.473186Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:38.473194Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:38.473205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:38.473239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:38.473279Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533069337312804:3281]
2025-10-02T08:07:38.473773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:38.473946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:38.473986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:38.474265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:38.474313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.474318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.474320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.474321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.474322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.474326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.474334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.474338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.474342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.474345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.474349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.474360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.474372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.474380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.474384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.474389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.474397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.474402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.474406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.474411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.474431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:38.474602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533069337312790:3282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:38.481764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533069337312790:3282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:38.481781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533069337312790:3282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:38.481785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533069337312790:3282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:38.481793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 80 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:38.482911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:38.484952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:38.484965Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:38.484968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:38.484972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:38.484980Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 79 [1:7556533069337312804:3281]
2025-10-02T08:07:38.484993Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:38.485012Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:38.485021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.485025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.485027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.485042Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:38.485048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:38.485055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:38.485118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.485125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.485129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:38.485131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:38.485200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:38.485208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.485221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.485235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:38.485235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 79
2025-10-02T08:07:38.485254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337312841:3282], now have 1 active actors on pipe
2025-10-02T08:07:38.485264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533069797770362:2378], now have 1 active actors on pipe
2025-10-02T08:07:38.485270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.485274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.485292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533069337312793:3281]
2025-10-02T08:07:38.485295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533069337312793:3281]
2025-10-02T08:07:38.485308Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:38.485319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:38.485329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:38.485333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:38.485334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:38.485336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:38.485352Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:38.485363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.485335Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 79
2025-10-02T08:07:38.485367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.485369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:38.485377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.485386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:38.485419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533069337312793:3281]
2025-10-02T08:07:38.485427Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:38.485443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.485444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:38.485491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.485497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.485508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.485538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 80 partition: 0 MaxSeqNo: 17 sessionId: src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0
2025-10-02T08:07:38.485988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4016947d-3602adc5-44524435-f2a3f488_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:38.488459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0] Write session: try to update token
2025-10-02T08:07:38.488477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:38.496339Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:38.496352Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:38.496361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533069337312793:3281]
2025-10-02T08:07:38.496400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:38.496404Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:38.496581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:38.496729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.496893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.497043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.497267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:38.497309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:38.506450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId: src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:38.509466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:38.509564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.509579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.509611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:38.509637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:38.509688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.509701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.509899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.509971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.510043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.510138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.510304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.510312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.510389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.510456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.510530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.510605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.510662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.510669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.510747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.510817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.510886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.510948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.510993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.510998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.511059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.511129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.511210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.511274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.511324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.511329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.511397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.511460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.511528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.511601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.511680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.511688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.511845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.511910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.511981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.512048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.512156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.512164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.512247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.512313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.512379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.512447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.512655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.512664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.512734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.512818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.512889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.512950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.512996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.513001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.513060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.513118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.513181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.513247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.513299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.513308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.513370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:38.513431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:38.513484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:38.513548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:38.513596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:38.513601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:38.513666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:38.513730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.513752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.513758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:38.513787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:38.513805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:38.513812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:38.513815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:38.513818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:38.514200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:38.514223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:38.514231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:38.514234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:38.514239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:38.514243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:38.514910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:38.514933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:38.514943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:38.514951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:38.514954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:38.514957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:38.515580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:38.515599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:38.515608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:38.515611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:38.515614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:38.517055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:38.517071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:38.517082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392458516
2025-10-02T08:07:38.517229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:38.517238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:38.517242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:38.517245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:38.517247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:38.517249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:38.517787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:38.517805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:38.517811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:38.517814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:38.517815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:38.517817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:38.518308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:38.518323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:38.518329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:38.518331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:38.518333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:38.518335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:38.518877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:38.518897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:38.518902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:38.520162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:38.520180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:38.520185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:38.520189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:38.520198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392458519
2025-10-02T08:07:38.520538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:38.520562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:38.520568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:38.520572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:38.520575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:38.520579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:38.521082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:38.521100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:38.521104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:38.521106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:38.521109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:38.521113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:38.521630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:38.521648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.521754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392458521
2025-10-02T08:07:38.524173Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:38.524200Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:38.524208Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:38.524215Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:38.524237Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:38.524239Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:38.524241Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:38.524247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533069337312793:3281]
2025-10-02T08:07:38.524249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533069337312793:3281]
2025-10-02T08:07:38.524294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:38.524304Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:38.524316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:38.524324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.524325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:38.524461Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:38.563428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533069337312855:2534]
2025-10-02T08:07:38.563527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:38.563632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 79, pipe: [1:7556533069337312855:2534]
2025-10-02T08:07:38.667237Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:38.667685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337312855:2534], now have 1 active actors on pipe
2025-10-02T08:07:38.667715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.667726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.667916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:38.667926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:38.667955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 80 reason: error at write: Disconnected sessionId: src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0
2025-10-02T08:07:38.668036Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.668048Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.668127Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:38.668201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 80 sessionId: src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0 is DEAD
2025-10-02T08:07:38.668414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533069337312855:2534]
2025-10-02T08:07:38.668897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:38.668910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0] Write session will restart in 0.008905s
2025-10-02T08:07:38.668935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0] Write session: Do CDS request
2025-10-02T08:07:38.668942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:38.671960Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [96663e3aa87ee2cd] Result# TEvPutResult {Id# [72075186224037892:79:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:38.671994Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:79:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:38.672047Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:79:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:38.678094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:38.678605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:38.678807Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:38.678815Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:38.678826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:38.678893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:38.678932Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533069337313073:3287]
2025-10-02T08:07:38.679550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:38.679748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:38.679786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:38.680081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:38.680142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.680147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.680148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.680149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.680150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.680155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.680176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.680184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.680188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.680192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.680197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.680203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.680209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.680213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.680217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.680237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.680241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.680246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.680254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.680258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.680276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:38.684685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.684840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:38.684858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 81
2025-10-02T08:07:38.685042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.685076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 81 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:38.685081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=81 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:38.685084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:38.685540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 81 sessionId:  describe result for acl check
2025-10-02T08:07:38.685580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:38.685586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:38.685587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:38.685593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533069337313089:3289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:38.686133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533069337313089:3289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:38.688538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:38.688906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533069337313089:3289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:38.690252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:38.690269Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:38.690272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:38.690275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:38.690282Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 80 [1:7556533069337313073:3287]
2025-10-02T08:07:38.690293Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:38.690308Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:38.690315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.690319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.690321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.690337Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:38.690346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:38.690356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:38.690417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.690424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.690429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:38.690432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:38.690495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:38.690505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.690518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.690529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:38.690547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533069797770368:2378], now have 1 active actors on pipe
2025-10-02T08:07:38.690553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533069337313067:3287]
2025-10-02T08:07:38.690556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533069337313067:3287]
2025-10-02T08:07:38.690567Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:38.690574Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 80
2025-10-02T08:07:38.690582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:38.690587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:38.690589Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:38.690601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:38.690604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:38.690642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533069337313067:3287]
2025-10-02T08:07:38.690655Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:38.690671Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:38.695446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533069337313089:3289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:38.695460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533069337313089:3289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:38.695463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533069337313089:3289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:38.695472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 81 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:38.695672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 80
2025-10-02T08:07:38.695677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337313129:3289], now have 1 active actors on pipe
2025-10-02T08:07:38.695685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.695698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.695726Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56029c1f-916743dd-88897d22-bba3abd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:38.695738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.695746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.695748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:38.695759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.695777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:38.695796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.695833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.695843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.695865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.695900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 81 partition: 0 MaxSeqNo: 17 sessionId: src_id|56029c1f-916743dd-88897d22-bba3abd8_0
2025-10-02T08:07:38.696312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35234b3e-5bdf4588-c59d9819-b3a2942d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|56029c1f-916743dd-88897d22-bba3abd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:38.698804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56029c1f-916743dd-88897d22-bba3abd8_0] Write session: try to update token
2025-10-02T08:07:38.698824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56029c1f-916743dd-88897d22-bba3abd8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:38.701259Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:38.701273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:38.701280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533069337313067:3287]
2025-10-02T08:07:38.701313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:38.701317Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:38.701497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:38.701635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.701777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.701921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:38.702255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:38.702289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:38.713918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId: src_id|56029c1f-916743dd-88897d22-bba3abd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:38.722463Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:38.722484Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:38.722487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:38.722497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533069337313067:3287]
2025-10-02T08:07:38.722501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533069337313067:3287]
2025-10-02T08:07:38.722552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:38.722559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.722561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:38.722565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:38.722572Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:38.722717Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:38.725482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:38.768702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533069337313138:2534]
2025-10-02T08:07:38.768790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:38.768936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 80, pipe: [1:7556533069337313138:2534]
2025-10-02T08:07:38.855488Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:38.855716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.855730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.855746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337313138:2534], now have 1 active actors on pipe
2025-10-02T08:07:38.855756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.855758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.855879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533069337313138:2534]
2025-10-02T08:07:38.855900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:38.855902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:38.855949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 81 reason: error at write: Disconnected sessionId: src_id|56029c1f-916743dd-88897d22-bba3abd8_0
2025-10-02T08:07:38.855985Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.855962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:38.855998Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:38.856126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 81 sessionId: src_id|56029c1f-916743dd-88897d22-bba3abd8_0 is DEAD
2025-10-02T08:07:38.856432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56029c1f-916743dd-88897d22-bba3abd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:38.856444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56029c1f-916743dd-88897d22-bba3abd8_0] Write session will restart in 0.009613s
2025-10-02T08:07:38.856468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56029c1f-916743dd-88897d22-bba3abd8_0] Write session: Do CDS request
2025-10-02T08:07:38.856475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56029c1f-916743dd-88897d22-bba3abd8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:38.864145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:38.864575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:38.864708Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:38.864715Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:38.864722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:38.864751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:38.864778Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533069337313352:3294]
2025-10-02T08:07:38.865300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:38.865475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:38.865510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:38.865782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:38.865820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.865825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.865826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.865828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.865829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.865833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.865844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.865846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.865848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.865850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.865853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.865857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:38.865860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.865863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:38.865865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.865868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:38.865870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.865873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.865875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.865878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.865888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:38.867402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56029c1f-916743dd-88897d22-bba3abd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.867610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:38.867630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 82
2025-10-02T08:07:38.867820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:38.867857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 82 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:38.867866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=82 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:38.867870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:38.868332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 82 sessionId:  describe result for acl check
2025-10-02T08:07:38.868366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:38.868371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:38.868372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:38.868378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533069337313368:3296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:38.868919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533069337313368:3296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:38.871226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533069337313368:3296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:38.874251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533069337313368:3296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:38.874267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533069337313368:3296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:38.874271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533069337313368:3296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:38.874282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 82 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:38.874388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:38.876032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:38.876048Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:38.876050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:38.876053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:38.876059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 81 [1:7556533069337313352:3294]
2025-10-02T08:07:38.876070Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:38.876084Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:38.876087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.876090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.876092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.876107Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:38.876112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:38.876118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:38.876184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.876190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.876192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:38.876194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:38.876273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:38.876279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.876291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:38.876306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:38.876314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 81
2025-10-02T08:07:38.876328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337313399:3296], now have 1 active actors on pipe
2025-10-02T08:07:38.876338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533069337313346:3294]
2025-10-02T08:07:38.876340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533069337313346:3294]
2025-10-02T08:07:38.876351Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:38.876362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533069797770376:2378], now have 1 active actors on pipe
2025-10-02T08:07:38.876372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.876377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.876387Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:38.876389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:38.876398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:38.876414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:38.876416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:38.876405Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 81
2025-10-02T08:07:38.876457Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:38.876467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:38.876470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:38.876472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:38.876481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:38.876489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:38.876496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533069337313346:3294]
2025-10-02T08:07:38.876505Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:38.876519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:38.876533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.876567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:38.876569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:38.876581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:38.876613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 82 partition: 0 MaxSeqNo: 17 sessionId: src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0
2025-10-02T08:07:38.877027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56029c1f-916743dd-88897d22-bba3abd8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:38.879633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0] Write session: try to update token
2025-10-02T08:07:38.879650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:38.893930Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:38.893946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:38.893948Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:38.893956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533069337313346:3294]
2025-10-02T08:07:38.893960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533069337313346:3294]
2025-10-02T08:07:38.894004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:38.894012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:38.894011Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:38.894017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:38.894022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:38.894194Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:38.895230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId: src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:38.898085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:38.956105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533069337313415:2534]
2025-10-02T08:07:38.956186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:38.956347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 81, pipe: [1:7556533069337313415:2534]
2025-10-02T08:07:39.042765Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:39.043093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.043111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.043152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533069337313415:2534], now have 1 active actors on pipe
2025-10-02T08:07:39.043171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.043179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.043311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533069337313415:2534]
2025-10-02T08:07:39.043340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:39.043349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:39.043427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 82 reason: error at write: Disconnected sessionId: src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0
2025-10-02T08:07:39.043635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 82 sessionId: src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0 is DEAD
2025-10-02T08:07:39.043721Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.043732Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.043819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:39.043826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0] Write session will restart in 0.005827s
2025-10-02T08:07:39.043845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0] Write session: Do CDS request
2025-10-02T08:07:39.043852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:39.043894Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:39.053466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:39.053731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.053850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:39.053861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 83
2025-10-02T08:07:39.054076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.054112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 83 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:39.054121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=83 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:39.054124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:39.054221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:39.054399Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:39.054403Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:39.054412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:39.054458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:39.054500Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533073632280929:3300]
2025-10-02T08:07:39.054533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 83 sessionId:  describe result for acl check
2025-10-02T08:07:39.054562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:39.054564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:39.054566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:39.054570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533073632280932:3302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:39.055013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533073632280932:3302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:39.055145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:39.055365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:39.055417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:39.055737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:39.055804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.055811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.055812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.055813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.055814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.055820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.055828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.055832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.055835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.055839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.055845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.055853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.055863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.055868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.055872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.055877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.055881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.055886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.055890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.055900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.055920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:39.056896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533073632280932:3302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:39.063200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533073632280932:3302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:39.063229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533073632280932:3302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:39.063233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533073632280932:3302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:39.063244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 83 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:39.064484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:39.066276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:39.066290Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:39.066293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:39.066296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:39.066302Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 82 [1:7556533073632280929:3300]
2025-10-02T08:07:39.066315Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:39.066331Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:39.066333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.066336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.066338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.066352Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:39.066357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:39.066368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:39.066429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.066436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.066438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:39.066441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:39.066557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 82
2025-10-02T08:07:39.066575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:39.066578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.066592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.066610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:39.066629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632280975:3302], now have 1 active actors on pipe
2025-10-02T08:07:39.066638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533074092737690:2378], now have 1 active actors on pipe
2025-10-02T08:07:39.066642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.066647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.066667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533073632280921:3300]
2025-10-02T08:07:39.066670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533073632280921:3300]
2025-10-02T08:07:39.066677Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:39.066635Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 82
2025-10-02T08:07:39.066689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:39.066689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:39.066692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:39.066708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:39.066710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:39.066725Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:39.066734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.066738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.066739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:39.066748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.066761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:39.066801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533073632280921:3300]
2025-10-02T08:07:39.066811Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:39.066818Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:39.066821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.066933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.066946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.066985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.067033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 83 partition: 0 MaxSeqNo: 17 sessionId: src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0
2025-10-02T08:07:39.067527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb2b43-ca612576-2df96c42-5ca4fa80_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:39.070268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0] Write session: try to update token
2025-10-02T08:07:39.070290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:39.084511Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:39.084525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:39.084527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:39.084535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533073632280921:3300]
2025-10-02T08:07:39.084542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533073632280921:3300]
2025-10-02T08:07:39.084587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:39.084593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.084596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:39.084595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:39.084602Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:39.084757Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:39.090826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId: src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:39.093800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:39.143513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533073632281002:2534]
2025-10-02T08:07:39.143590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:39.143720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 82, pipe: [1:7556533073632281002:2534]
2025-10-02T08:07:39.231851Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:39.232236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.232254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.232281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632281002:2534], now have 1 active actors on pipe
2025-10-02T08:07:39.232303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.232312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.232451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533073632281002:2534]
2025-10-02T08:07:39.232480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:39.232482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:39.232536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 83 reason: error at write: Disconnected sessionId: src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0
2025-10-02T08:07:39.232590Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.232607Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.232589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:39.232739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 83 sessionId: src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0 is DEAD
2025-10-02T08:07:39.232973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:39.232984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0] Write session will restart in 0.007743s
2025-10-02T08:07:39.233006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0] Write session: Do CDS request
2025-10-02T08:07:39.233013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:39.242337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.242331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:39.242462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:39.242480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 84
2025-10-02T08:07:39.242703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.242778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 84 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:39.242792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=84 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:39.242799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:39.242951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:39.243138Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:39.243149Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:39.243159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:39.243209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:39.243251Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533073632281221:3307]
2025-10-02T08:07:39.243396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 84 sessionId:  describe result for acl check
2025-10-02T08:07:39.243452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:39.243463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:39.243465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:39.243471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533073632281224:3309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:39.243881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:39.244096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533073632281224:3309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:39.244104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:39.244150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:39.244483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:39.244539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.244546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.244547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.244548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.244549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.244554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.244563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.244567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.244570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.244573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.244579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.244586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.244591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.244595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.244600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.244604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.244609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.244614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.244619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.244623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.244641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:39.246505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533073632281224:3309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:39.252224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533073632281224:3309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:39.252241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533073632281224:3309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:39.252244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533073632281224:3309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:39.252267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 84 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:39.252879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:39.255026Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 83
2025-10-02T08:07:39.254731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:39.254745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:39.254748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:39.254751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:39.254757Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 83 [1:7556533073632281221:3307]
2025-10-02T08:07:39.254770Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:39.254786Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:39.254788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.254791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.254793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.254809Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:39.254814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:39.254820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:39.254882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.254885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.254889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:39.254892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:39.254956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:39.254959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.254969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.254980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:39.255002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632281267:3309], now have 1 active actors on pipe
2025-10-02T08:07:39.255005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533074092737696:2378], now have 1 active actors on pipe
2025-10-02T08:07:39.255010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 83
2025-10-02T08:07:39.255011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533073632281213:3307]
2025-10-02T08:07:39.255014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533073632281213:3307]
2025-10-02T08:07:39.255025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:39.255037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:39.255041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:39.255044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:39.255050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:39.255053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:39.255059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.255063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.255105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533073632281213:3307]
2025-10-02T08:07:39.255108Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:39.255116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:39.255125Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:39.255131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.255135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.255137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:39.255146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.255155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:39.255195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.255254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.255258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.255272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.255305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 84 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0
2025-10-02T08:07:39.256045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a545ec5b-8bbeb13d-1b0ccfef-73addb68_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:39.258516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0] Write session: try to update token
2025-10-02T08:07:39.258534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:39.272778Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:39.272797Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:39.272815Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:39.272824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533073632281213:3307]
2025-10-02T08:07:39.272829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533073632281213:3307]
2025-10-02T08:07:39.272880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:39.272894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.272897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:39.272897Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:39.272903Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:39.273046Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:39.276177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId: src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:39.279048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:39.332434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533073632281288:2534]
2025-10-02T08:07:39.332522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:39.332650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 83, pipe: [1:7556533073632281288:2534]
2025-10-02T08:07:39.416526Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:39.416909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.416925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.416976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632281288:2534], now have 1 active actors on pipe
2025-10-02T08:07:39.416997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.416999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.417145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533073632281288:2534]
2025-10-02T08:07:39.417198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:39.417207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:39.417302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 84 reason: error at write: Disconnected sessionId: src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0
2025-10-02T08:07:39.417315Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:39.417507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 84 sessionId: src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0 is DEAD
2025-10-02T08:07:39.417594Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.417604Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.417690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:39.417702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0] Write session will restart in 0.008010s
2025-10-02T08:07:39.417723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0] Write session: Do CDS request
2025-10-02T08:07:39.417729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:39.427430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.427505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:39.427526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 85
2025-10-02T08:07:39.427671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.427706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 85 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:39.427713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=85 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:39.427716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:39.427893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:39.428084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 85 sessionId:  describe result for acl check
2025-10-02T08:07:39.428119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:39.428126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:39.428128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:39.428133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533073632281545:3328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:39.428642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533073632281545:3328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:39.428661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:39.428785Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:39.428796Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:39.428825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:39.428865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:39.428943Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533073632281551:3326]
2025-10-02T08:07:39.429377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:39.429525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:39.429557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:39.429761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:39.429801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.429809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.429810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.429811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.429812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.429816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.429825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.429828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.429831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.429835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.429840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.429846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.429853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.429857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.429868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.429872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.429875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.429877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.429880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.429882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.429898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:39.430646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533073632281545:3328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:39.437113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533073632281545:3328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:39.437129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533073632281545:3328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:39.437132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533073632281545:3328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:39.437141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 85 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:39.438279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:39.440051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:39.440066Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:39.440069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:39.440072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:39.440078Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 84 [1:7556533073632281551:3326]
2025-10-02T08:07:39.440090Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:39.440106Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:39.440109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.440112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.440114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.440127Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:39.440132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:39.440139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:39.440199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.440209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.440213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:39.440228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:39.440292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:39.440301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.440313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.440325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:39.440348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632281592:3328], now have 1 active actors on pipe
2025-10-02T08:07:39.440349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 84
2025-10-02T08:07:39.440360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533073632281541:3326]
2025-10-02T08:07:39.440363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533073632281541:3326]
2025-10-02T08:07:39.440377Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:39.440389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:39.440391Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:39.440394Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:39.440409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:39.440412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:39.440418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.440422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.440437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533074092737705:2378], now have 1 active actors on pipe
2025-10-02T08:07:39.440464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533073632281541:3326]
2025-10-02T08:07:39.440474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:39.440487Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:39.440489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:39.440500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.440504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.440506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:39.440463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 84
2025-10-02T08:07:39.440515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.440523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:39.440587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.440637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.440645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.440657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.440688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 85 partition: 0 MaxSeqNo: 17 sessionId: src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0
2025-10-02T08:07:39.441102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0e3fc7-2c34e33e-cded64c8-2c048dc6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:39.443731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0] Write session: try to update token
2025-10-02T08:07:39.443751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:39.458086Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:39.458106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:39.458109Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:39.458117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533073632281541:3326]
2025-10-02T08:07:39.458121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533073632281541:3326]
2025-10-02T08:07:39.458170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:39.458179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.458181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:39.458191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:39.458197Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:39.458340Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:39.464329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId: src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:39.467095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:39.517276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533073632281612:2534]
2025-10-02T08:07:39.517367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:39.517486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 84, pipe: [1:7556533073632281612:2534]
2025-10-02T08:07:39.603616Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:39.604016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.604027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.604065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632281612:2534], now have 1 active actors on pipe
2025-10-02T08:07:39.604078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.604085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.604184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:39.604194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:39.604271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 85 reason: error at write: Disconnected sessionId: src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0
2025-10-02T08:07:39.604316Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.604325Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.604328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:39.604474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 85 sessionId: src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0 is DEAD
2025-10-02T08:07:39.604607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533073632281612:2534]
2025-10-02T08:07:39.604653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:39.604668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0] Write session will restart in 0.006886s
2025-10-02T08:07:39.604693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0] Write session: Do CDS request
2025-10-02T08:07:39.604700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:39.612447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.612499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:39.612511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 86
2025-10-02T08:07:39.612738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.612766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 86 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:39.612775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=86 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:39.612778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:39.613158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 86 sessionId:  describe result for acl check
2025-10-02T08:07:39.613188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:39.613190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:39.613192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:39.613196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533073632281828:3335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:39.613678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533073632281828:3335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:39.615962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533073632281828:3335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:39.617646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:39.618390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:39.618560Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:39.618571Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:39.618581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:39.618624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:39.618662Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533073632281867:3334]
2025-10-02T08:07:39.618968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533073632281828:3335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:39.618981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533073632281828:3335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:39.618984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533073632281828:3335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:39.618993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 86 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:39.619326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:39.619504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:39.619543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:39.619843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:39.619890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.619896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.619898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.619899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.619900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.619905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.619916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.619920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.619925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.619929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.619934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.619946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.619956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.619961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.619970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.619976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.619981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.619986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.619993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.620003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.620026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:39.628319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:39.630350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:39.630363Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:39.630364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:39.630367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:39.630372Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 85 [1:7556533073632281867:3334]
2025-10-02T08:07:39.630382Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:39.630398Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:39.630399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.630401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.630402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.630415Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:39.630418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:39.630423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:39.630481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.630488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.630491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:39.630493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:39.630563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:39.630572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.630585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.630598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:39.630616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533073632281861:3334]
2025-10-02T08:07:39.630621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533073632281861:3334]
2025-10-02T08:07:39.630627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:39.630640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632281872:3335], now have 1 active actors on pipe
2025-10-02T08:07:39.630640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 85
2025-10-02T08:07:39.630651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:39.630654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:39.630657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:39.630664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:39.630666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:39.630701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533074092737735:2378], now have 1 active actors on pipe
2025-10-02T08:07:39.630714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.630718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.630730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533073632281861:3334]
2025-10-02T08:07:39.630740Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:39.630765Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:39.630747Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 85
2025-10-02T08:07:39.630767Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:39.630775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.630780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.630782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:39.630793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.630802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:39.630827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.630942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.630950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.630963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.631003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 86 partition: 0 MaxSeqNo: 17 sessionId: src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0
2025-10-02T08:07:39.631391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7bb7ed-dbb308a7-d0aff8df-fb39005c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:39.633967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0] Write session: try to update token
2025-10-02T08:07:39.633990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:39.648151Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:39.648169Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:39.648171Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:39.648180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533073632281861:3334]
2025-10-02T08:07:39.648186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533073632281861:3334]
2025-10-02T08:07:39.648240Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:39.648243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:39.648247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:39.648250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.648252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:39.648417Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:39.652710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId: src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:39.655808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:39.704656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533073632281897:2534]
2025-10-02T08:07:39.704725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:39.704871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 85, pipe: [1:7556533073632281897:2534]
2025-10-02T08:07:39.786173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:39.786518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.786539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.786591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632281897:2534], now have 1 active actors on pipe
2025-10-02T08:07:39.786610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.786616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.786774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:39.786785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:39.786846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 86 reason: error at write: Disconnected sessionId: src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0
2025-10-02T08:07:39.786856Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.786859Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.786849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:39.787030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 86 sessionId: src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0 is DEAD
2025-10-02T08:07:39.787153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533073632281897:2534]
2025-10-02T08:07:39.787221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:39.787232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0] Write session will restart in 0.006665s
2025-10-02T08:07:39.787267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0] Write session: Do CDS request
2025-10-02T08:07:39.787273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:39.795412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.795469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:39.795484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 87
2025-10-02T08:07:39.795658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.795689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 87 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:39.795699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=87 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:39.795702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:39.795999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:39.796061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 87 sessionId:  describe result for acl check
2025-10-02T08:07:39.796091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:39.796098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:39.796099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:39.796104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533073632282125:3343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:39.796360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:39.796539Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:39.796548Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:39.796560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:39.796578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533073632282125:3343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:39.796612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:39.796660Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533073632282128:3341]
2025-10-02T08:07:39.797374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:39.797666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:39.797725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:39.798052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:39.798113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.798119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.798120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.798122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.798123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.798137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.798148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.798155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.798159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.798162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.798168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.798176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.798187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.798192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.798198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.798203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.798211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.798225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.798233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.798238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.798257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:39.798951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533073632282125:3343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:39.805088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533073632282125:3343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:39.805108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533073632282125:3343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:39.805112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533073632282125:3343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:39.805120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 87 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:39.806202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:39.808010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:39.808023Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:39.808025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:39.808028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:39.808033Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 86 [1:7556533073632282128:3341]
2025-10-02T08:07:39.808042Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:39.808057Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:39.808060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.808063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.808066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.808079Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:39.808082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:39.808087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:39.808135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.808143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.808145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:39.808146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:39.808194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:39.808202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.808211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.808230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:39.808247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533073632282120:3341]
2025-10-02T08:07:39.808253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533073632282120:3341]
2025-10-02T08:07:39.808262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:39.808274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:39.808274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:39.808277Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:39.808292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:39.808294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:39.808299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 86
2025-10-02T08:07:39.808302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632282173:3343], now have 1 active actors on pipe
2025-10-02T08:07:39.808305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533074092737744:2378], now have 1 active actors on pipe
2025-10-02T08:07:39.808331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.808341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.808356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533073632282120:3341]
2025-10-02T08:07:39.808364Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:39.808381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:39.808385Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:39.808357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 86
2025-10-02T08:07:39.808389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.808391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.808393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:39.808401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.808407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:39.808427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.808492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.808499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.808510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.808542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 87 partition: 0 MaxSeqNo: 17 sessionId: src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0
2025-10-02T08:07:39.808915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881a6c21-e0cef834-318ab58a-c3e9db49_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:39.811340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0] Write session: try to update token
2025-10-02T08:07:39.811359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:39.825035Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:39.825045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId: src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:39.825053Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:39.825056Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:39.825064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533073632282120:3341]
2025-10-02T08:07:39.825068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533073632282120:3341]
2025-10-02T08:07:39.825112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:39.825116Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:39.825119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.825121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:39.825123Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:39.825271Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:39.827689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:39.887433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533073632282186:2534]
2025-10-02T08:07:39.887509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:39.887598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 86, pipe: [1:7556533073632282186:2534]
2025-10-02T08:07:39.953520Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:39.953823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.953839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.953875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632282186:2534], now have 1 active actors on pipe
2025-10-02T08:07:39.953894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.953902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.954033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533073632282186:2534]
2025-10-02T08:07:39.954062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:39.954065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:39.954114Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.954124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 87 reason: error at write: Disconnected sessionId: src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0
2025-10-02T08:07:39.954124Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:39.954107Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:39.954291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 87 sessionId: src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0 is DEAD
2025-10-02T08:07:39.954509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:39.954520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0] Write session will restart in 0.007900s
2025-10-02T08:07:39.954543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0] Write session: Do CDS request
2025-10-02T08:07:39.954550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:39.963170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:39.963339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.963499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:39.963509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 88
2025-10-02T08:07:39.963653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:39.963690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 88 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:39.963700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=88 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:39.963703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:39.963827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:39.963974Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:39.963983Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:39.963990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:39.964021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:39.964050Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533073632282417:3347]
2025-10-02T08:07:39.964106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 88 sessionId:  describe result for acl check
2025-10-02T08:07:39.964141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:39.964148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:39.964150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:39.964155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533073632282420:3349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:39.964593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:39.964711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533073632282420:3349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:39.964787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:39.964857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:39.965268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:39.965335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.965343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.965344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.965346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.965347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.965354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.965363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.965367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.965371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.965375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.965382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.965390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:39.965395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.965401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:39.965405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.965410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:39.965414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.965419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.965423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.965427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.965445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:39.966592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533073632282420:3349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:39.972258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533073632282420:3349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:39.972281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533073632282420:3349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:39.972285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533073632282420:3349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:39.972296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 88 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:39.973447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:39.975143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:39.975159Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:39.975161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:39.975164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:39.975169Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 87 [1:7556533073632282417:3347]
2025-10-02T08:07:39.975178Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:39.975191Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:39.975193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.975195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.975196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.975208Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:39.975211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:39.975216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:39.975274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.975282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.975285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:39.975288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:39.975350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:39.975357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.975369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:39.975386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:39.975399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 87
2025-10-02T08:07:39.975409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533073632282461:3349], now have 1 active actors on pipe
2025-10-02T08:07:39.975411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533074092737750:2378], now have 1 active actors on pipe
2025-10-02T08:07:39.975416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533073632282409:3347]
2025-10-02T08:07:39.975417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533073632282409:3347]
2025-10-02T08:07:39.975429Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:39.975438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.975441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.975454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:39.975454Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:39.975458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:39.975462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:39.975464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:39.975457Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 87
2025-10-02T08:07:39.975504Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b90b353-e4b90713-4f14602-415fb2e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:39.975514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:39.975518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:39.975519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:39.975527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:39.975538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:39.975545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533073632282409:3347]
2025-10-02T08:07:39.975552Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:39.975578Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:39.975580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.975679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:39.975687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:39.975700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:39.975742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 88 partition: 0 MaxSeqNo: 17 sessionId: src_id|5b90b353-e4b90713-4f14602-415fb2e0_0
2025-10-02T08:07:39.976121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc74737-eecbc21c-f03d1d05-2f2ee300_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5b90b353-e4b90713-4f14602-415fb2e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:39.979070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b90b353-e4b90713-4f14602-415fb2e0_0] Write session: try to update token
2025-10-02T08:07:39.979092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b90b353-e4b90713-4f14602-415fb2e0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:39.993603Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:39.993621Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:39.993623Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:39.993633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533073632282409:3347]
2025-10-02T08:07:39.993637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533073632282409:3347]
2025-10-02T08:07:39.993677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:39.993680Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:39.993684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:39.993686Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:39.993686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:39.993837Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:39.995385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId: src_id|5b90b353-e4b90713-4f14602-415fb2e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:39.998418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:40.054350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533077927249770:2534]
2025-10-02T08:07:40.054435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:40.054568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 87, pipe: [1:7556533077927249770:2534]
2025-10-02T08:07:40.128916Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:40.129266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.129279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.129315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927249770:2534], now have 1 active actors on pipe
2025-10-02T08:07:40.129332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.129337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.129445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533077927249770:2534]
2025-10-02T08:07:40.129483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:40.129489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:40.129564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 88 reason: error at write: Disconnected sessionId: src_id|5b90b353-e4b90713-4f14602-415fb2e0_0
2025-10-02T08:07:40.129593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:40.129753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 88 sessionId: src_id|5b90b353-e4b90713-4f14602-415fb2e0_0 is DEAD
2025-10-02T08:07:40.129897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b90b353-e4b90713-4f14602-415fb2e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:40.129909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b90b353-e4b90713-4f14602-415fb2e0_0] Write session will restart in 0.005599s
2025-10-02T08:07:40.129934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b90b353-e4b90713-4f14602-415fb2e0_0] Write session: Do CDS request
2025-10-02T08:07:40.129941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b90b353-e4b90713-4f14602-415fb2e0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:40.130458Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.130471Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.136396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b90b353-e4b90713-4f14602-415fb2e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.136480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:40.136495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 89
2025-10-02T08:07:40.136659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.136699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 89 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:40.136708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=89 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:40.136712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:40.137167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 89 sessionId:  describe result for acl check
2025-10-02T08:07:40.137203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:40.137205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:40.137207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:40.137211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533077927249996:3355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:40.137690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533077927249996:3355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:40.138302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:40.138856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:40.139036Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:40.139047Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:40.139057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:40.139108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:40.139156Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533077927250032:3354]
2025-10-02T08:07:40.139611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533077927249996:3355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:40.139791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:40.139996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:40.140044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:40.140366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:40.140404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.140410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.140412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.140412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.140414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.140419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.140429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.140433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.140437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.140441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.140446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.140454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.140460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.140466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.140471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.140476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.140480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.140485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.140490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.140495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.140520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:40.151619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533077927249996:3355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:40.151634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533077927249996:3355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:40.151638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533077927249996:3355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:40.151647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 89 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:40.155302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:40.157161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:40.157180Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:40.157183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:40.157186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:40.157193Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 88 [1:7556533077927250032:3354]
2025-10-02T08:07:40.157207Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:40.157225Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:40.157228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.157231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.157234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.157253Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:40.157258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:40.157269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:40.157341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.157348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.157351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:40.157354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:40.157422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:40.157428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.157444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.157461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:40.157474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 88
2025-10-02T08:07:40.157483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927250059:3355], now have 1 active actors on pipe
2025-10-02T08:07:40.157486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533078387705065:2378], now have 1 active actors on pipe
2025-10-02T08:07:40.157494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533077927250013:3354]
2025-10-02T08:07:40.157500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533077927250013:3354]
2025-10-02T08:07:40.157514Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:40.157526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.157537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.157555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:40.157572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:40.157579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:40.157582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:40.157591Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:40.157577Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 88
2025-10-02T08:07:40.157621Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:40.157635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.157639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.157645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:40.157655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.157667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:40.157677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533077927250013:3354]
2025-10-02T08:07:40.157688Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:40.157720Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:40.157725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.157799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.157805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.157826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.157869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 89 partition: 0 MaxSeqNo: 17 sessionId: src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0
2025-10-02T08:07:40.158253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b90b353-e4b90713-4f14602-415fb2e0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:40.161409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0] Write session: try to update token
2025-10-02T08:07:40.161436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:40.182923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId: src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:40.185966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:40.190345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.190385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.190450Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:40.190458Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.190477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533077927250013:3354]
2025-10-02T08:07:40.190539Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:40.192665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:40.193029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:40.193257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.193549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.193820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.194471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:40.194519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:40.194548Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:40.194555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.194558Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:40.194566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533077927250013:3354]
2025-10-02T08:07:40.194570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533077927250013:3354]
2025-10-02T08:07:40.194580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:40.194611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:40.194631Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:40.194637Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:40.194646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:40.194657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.194659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:40.194802Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:40.229447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533077927250073:2534]
2025-10-02T08:07:40.229545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:40.229703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 88, pipe: [1:7556533077927250073:2534]
2025-10-02T08:07:40.337062Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:40.337538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.337557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.337718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.337776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.338325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.338392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.338614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.338621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.339258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.339337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.339398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.340388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.340435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.340441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.341066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.341129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.341202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.341276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.341498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.341504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.341568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.341641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.341699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.341864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.342133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.342139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.342238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.342519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.342706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.342844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.342891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.342897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.343069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.343272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.343346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.343447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.343531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.343536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.343603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.343664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.344330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.344977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.345031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.345037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.345106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.345167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.345236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.345305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.345355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.345362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.345589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.345649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.345709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.345870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.345917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.345923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.345987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.346040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.346100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.346165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.346342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.346348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.346394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927250073:2534], now have 1 active actors on pipe
2025-10-02T08:07:40.346426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.346432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.346572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:40.346581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:40.346606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 89 reason: error at write: Disconnected sessionId: src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0
2025-10-02T08:07:40.346698Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:40.346807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 89 sessionId: src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0 is DEAD
2025-10-02T08:07:40.346925Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.346936Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.346998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533077927250073:2534]
2025-10-02T08:07:40.347043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:40.347055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0] Write session will restart in 0.009785s
2025-10-02T08:07:40.347077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0] Write session: Do CDS request
2025-10-02T08:07:40.347085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:40.356496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:40.357029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:40.357242Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:40.357248Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:40.357256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:40.357293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:40.357349Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533077927250309:3361]
2025-10-02T08:07:40.357765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:40.357920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:40.357947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:40.358153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:40.358184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.358188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.358189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.358190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.358190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.358193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.358200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.358202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.358204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.358206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.358210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.358214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.358218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.358221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.358227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.358230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.358233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.358235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.358238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.358241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.358252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:40.358366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.358475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:40.358482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 90
2025-10-02T08:07:40.358647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.358670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 90 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:40.358679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=90 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:40.358682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:40.359037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 90 sessionId:  describe result for acl check
2025-10-02T08:07:40.359064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:40.359066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:40.359066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:40.359070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533077927250326:3363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:40.359462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533077927250326:3363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:40.361537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533077927250326:3363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:40.366138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533077927250326:3363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:40.366157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533077927250326:3363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:40.366160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533077927250326:3363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:40.366174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 90 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:40.366718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:40.368386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:40.368399Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:40.368401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:40.368405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:40.368413Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 89 [1:7556533077927250309:3361]
2025-10-02T08:07:40.368425Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:40.368441Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:40.368448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.368451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.368454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.368468Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:40.368473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:40.368480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:40.368546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.368553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.368556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:40.368559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:40.368622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:40.368628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.368640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.368655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:40.368677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 89
2025-10-02T08:07:40.368680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533078387705074:2378], now have 1 active actors on pipe
2025-10-02T08:07:40.368683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927250357:3363], now have 1 active actors on pipe
2025-10-02T08:07:40.368688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533077927250303:3361]
2025-10-02T08:07:40.368690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533077927250303:3361]
2025-10-02T08:07:40.368697Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:40.368707Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:40.368709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:40.368710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:40.368722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:40.368725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:40.368732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.368736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.368776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533077927250303:3361]
2025-10-02T08:07:40.368787Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:40.368735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 89
2025-10-02T08:07:40.368797Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:40.368818Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:40.368825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.368829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.368831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:40.368840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.368849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:40.368891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.368963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.368973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.368997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.369032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 90 partition: 0 MaxSeqNo: 17 sessionId: src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0
2025-10-02T08:07:40.369421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18d8be7-6e4e04f2-f74db7ca-853889cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:40.376693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0] Write session: try to update token
2025-10-02T08:07:40.376714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:40.385949Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:40.385965Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.385968Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:40.385977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533077927250303:3361]
2025-10-02T08:07:40.385982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533077927250303:3361]
2025-10-02T08:07:40.386022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:40.386029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:40.386040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:40.386054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.386057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:40.386201Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:40.392922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId: src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:40.395902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:40.447052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533077927250405:2534]
2025-10-02T08:07:40.447126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:40.447233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 89, pipe: [1:7556533077927250405:2534]
2025-10-02T08:07:40.525969Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:40.526265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.526279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.526297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927250405:2534], now have 1 active actors on pipe
2025-10-02T08:07:40.526308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.526314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.526521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:40.526679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:40.526691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:40.526745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 90 reason: error at write: Disconnected sessionId: src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0
2025-10-02T08:07:40.526888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 90 sessionId: src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0 is DEAD
2025-10-02T08:07:40.527042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:40.527052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0] Write session will restart in 0.005764s
2025-10-02T08:07:40.527057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533077927250405:2534]
2025-10-02T08:07:40.527069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0] Write session: Do CDS request
2025-10-02T08:07:40.527089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:40.527420Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.527436Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.534352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.534448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:40.534459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 91
2025-10-02T08:07:40.534611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.534646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 91 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:40.534655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=91 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:40.534658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:40.534987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 91 sessionId:  describe result for acl check
2025-10-02T08:07:40.535011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:40.535015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:40.535016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:40.535019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533077927250639:3380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:40.535409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:40.535412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533077927250639:3380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:40.535902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:40.536099Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:40.536111Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:40.536123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:40.536180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:40.536310Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533077927250653:3379]
2025-10-02T08:07:40.536924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:40.537101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:40.537148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:40.537407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533077927250639:3380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:40.537444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:40.537497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.537503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.537504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.537505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.537506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.537512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.537520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.537524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.537528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.537531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.537536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.537542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.537551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.537557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.537560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.537565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.537568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.537571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.537574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.537578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.537593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:40.543326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533077927250639:3380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:40.543340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533077927250639:3380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:40.543352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533077927250639:3380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:40.543361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 91 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:40.545370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:40.547315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:40.547339Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:40.547342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:40.547346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:40.547354Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 90 [1:7556533077927250653:3379]
2025-10-02T08:07:40.547365Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:40.547383Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:40.547386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.547388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.547390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.547406Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:40.547412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:40.547418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:40.547484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.547494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.547497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:40.547500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:40.547585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:40.547593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.547608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.547621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:40.547642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533077927250642:3379]
2025-10-02T08:07:40.547645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533077927250642:3379]
2025-10-02T08:07:40.547654Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:40.547663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:40.547666Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:40.547667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927250691:3380], now have 1 active actors on pipe
2025-10-02T08:07:40.547667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 90
2025-10-02T08:07:40.547676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:40.547689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:40.547696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:40.547701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533078387705102:2378], now have 1 active actors on pipe
2025-10-02T08:07:40.547705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.547713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.547754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533077927250642:3379]
2025-10-02T08:07:40.547762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:40.547771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:40.547756Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 90
2025-10-02T08:07:40.547778Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:40.547784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.547787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.547789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:40.547798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.547806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:40.547859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.547950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.547958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.547972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.548010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 91 partition: 0 MaxSeqNo: 17 sessionId: src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0
2025-10-02T08:07:40.548439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54692bfa-f60634d9-d7127a84-5a3d9db2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:40.551097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0] Write session: try to update token
2025-10-02T08:07:40.551120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:40.561827Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:40.561845Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.561853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533077927250642:3379]
2025-10-02T08:07:40.561897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:40.561901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:40.562085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:40.562242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.562387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.562535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.562941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:40.562980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:40.567142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId: src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:40.569948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:40.570023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.570036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.570067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:40.570104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:40.570170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.570194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.570424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.570505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.570602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.570686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.570966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.570978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.571067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.571144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.571236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.571423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.571490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.571497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.571584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.571660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.571903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.571976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.572032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.572040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.572107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.572191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.572286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.572375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.572693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.572705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.572790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.572881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.572957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.573036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.573164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.573173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.573254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.573357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.573438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.574349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.574415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.574423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.575375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.576791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.576915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.577025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.577164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.577179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.577784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.577895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.578004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.578203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.578329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.578342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.578447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.578533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.578611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.578894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.579026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.579037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.579288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.579566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.579673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.579777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.579843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.579851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.579943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:40.580020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.580046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.580054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:40.580092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:40.580114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:40.580124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:40.580129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:40.580135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:40.580948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:40.580988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:40.581003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:40.581010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:40.581014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:40.581019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:40.582238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:40.582272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:40.582281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:40.582286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:40.582291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:40.582294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:40.583718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:40.583751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:40.583760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:40.583768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:40.583771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:40.586229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:40.586251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:40.586264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392460586
2025-10-02T08:07:40.586395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:40.586412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:40.586422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:40.586429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:40.586434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:40.586438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:40.586996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:40.587017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:40.587024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:40.587028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:40.587031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:40.587034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:40.587570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:40.587596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:40.587614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:40.587617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:40.587621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:40.587625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:40.588170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:40.588193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:40.588200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:40.589389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:40.589404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:40.589411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:40.589413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:40.589421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392460589
2025-10-02T08:07:40.589721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:40.589741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:40.589747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:40.589750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:40.589754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:40.589757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:40.590354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:40.590382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:40.590389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:40.590393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:40.590396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:40.590400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:40.590987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:40.591012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.591126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392460590
2025-10-02T08:07:40.597735Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:40.597772Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:40.597779Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:40.597785Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:40.597798Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:40.597800Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.597803Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:40.597810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533077927250642:3379]
2025-10-02T08:07:40.597814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533077927250642:3379]
2025-10-02T08:07:40.597872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:40.597886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:40.597889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:40.597891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.597893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:40.598046Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:40.627281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533077927250707:2534]
2025-10-02T08:07:40.627370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:40.627484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 90, pipe: [1:7556533077927250707:2534]
2025-10-02T08:07:40.739442Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:40.739854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927250707:2534], now have 1 active actors on pipe
2025-10-02T08:07:40.739877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.739886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.740031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533077927250707:2534]
2025-10-02T08:07:40.740066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:40.740077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:40.740106Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.740107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 91 reason: error at write: Disconnected sessionId: src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0
2025-10-02T08:07:40.740111Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.740144Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:40.740285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 91 sessionId: src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0 is DEAD
2025-10-02T08:07:40.740424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:40.740436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0] Write session will restart in 0.007749s
2025-10-02T08:07:40.740459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0] Write session: Do CDS request
2025-10-02T08:07:40.740464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:40.744063Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [1537ec40bc12ec02] Result# TEvPutResult {Id# [72075186224037892:90:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:40.744101Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:90:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:40.744158Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:90:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:40.749400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.749445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:40.749456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 92
2025-10-02T08:07:40.749705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.749727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 92 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:40.749733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=92 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:40.749735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:40.750051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 92 sessionId:  describe result for acl check
2025-10-02T08:07:40.750075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:40.750076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:40.750077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:40.750080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533077927250929:3387] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:40.750457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533077927250929:3387] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:40.751286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:40.751872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:40.752118Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:40.752137Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:40.752153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:40.752258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:40.752326Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533077927250967:3386]
2025-10-02T08:07:40.752591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533077927250929:3387] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:40.753129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:40.753323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:40.753366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:40.753576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:40.753618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.753623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.753624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.753624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.753626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.753629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.753636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.753638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.753640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.753642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.753646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.753650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.753655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.753658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.753660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.753663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.753665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.753668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.753672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.753676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.753694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:40.758751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533077927250929:3387] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:40.758768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533077927250929:3387] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:40.758771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533077927250929:3387] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:40.758795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 92 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:40.762103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:40.763822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:40.763838Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:40.763840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:40.763844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:40.763851Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 91 [1:7556533077927250967:3386]
2025-10-02T08:07:40.763858Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:40.763872Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:40.763874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.763876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.763877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.763892Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:40.763896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:40.763900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:40.763967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.763974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.763977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:40.763980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:40.764026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:40.764034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.764045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.764057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:40.764077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927250995:3387], now have 1 active actors on pipe
2025-10-02T08:07:40.764085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533078387705110:2378], now have 1 active actors on pipe
2025-10-02T08:07:40.764091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533077927250950:3386]
2025-10-02T08:07:40.764093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533077927250950:3386]
2025-10-02T08:07:40.764101Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:40.764103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 91
2025-10-02T08:07:40.764112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:40.764112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:40.764115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:40.764130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:40.764133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:40.764140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.764143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.764150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 91
2025-10-02T08:07:40.764185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533077927250950:3386]
2025-10-02T08:07:40.764192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:40.764195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:40.764217Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2443cc80-103218e0-5f8fd376-564a72d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:40.764225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.764228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.764230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:40.764239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.764250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:40.764295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.764372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.764378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.764391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.764426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 92 partition: 0 MaxSeqNo: 17 sessionId: src_id|2443cc80-103218e0-5f8fd376-564a72d8_0
2025-10-02T08:07:40.764849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed87b6-f00e301e-d0fcb2ee-4ff40050_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2443cc80-103218e0-5f8fd376-564a72d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:40.767463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2443cc80-103218e0-5f8fd376-564a72d8_0] Write session: try to update token
2025-10-02T08:07:40.767482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2443cc80-103218e0-5f8fd376-564a72d8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:40.775255Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:40.775273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.775281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533077927250950:3386]
2025-10-02T08:07:40.775318Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:40.775324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:40.775494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:40.775764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.775905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.776056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.776281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:40.776318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:40.791272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId: src_id|2443cc80-103218e0-5f8fd376-564a72d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:40.792071Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:40.792085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.792088Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:40.792097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533077927250950:3386]
2025-10-02T08:07:40.792101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533077927250950:3386]
2025-10-02T08:07:40.792148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:40.792151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:40.792157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:40.792159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.792162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:40.792535Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:40.794142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:40.840295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533077927251010:2534]
2025-10-02T08:07:40.840398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:40.840533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 91, pipe: [1:7556533077927251010:2534]
2025-10-02T08:07:40.931358Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:40.931616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.931627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.931648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927251010:2534], now have 1 active actors on pipe
2025-10-02T08:07:40.931665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.931670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.931769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533077927251010:2534]
2025-10-02T08:07:40.931786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:40.931791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:40.931844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 92 reason: error at write: Disconnected sessionId: src_id|2443cc80-103218e0-5f8fd376-564a72d8_0
2025-10-02T08:07:40.931920Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.931932Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:40.931909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:40.932006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 92 sessionId: src_id|2443cc80-103218e0-5f8fd376-564a72d8_0 is DEAD
2025-10-02T08:07:40.932270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2443cc80-103218e0-5f8fd376-564a72d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:40.932283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2443cc80-103218e0-5f8fd376-564a72d8_0] Write session will restart in 0.009938s
2025-10-02T08:07:40.932309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2443cc80-103218e0-5f8fd376-564a72d8_0] Write session: Do CDS request
2025-10-02T08:07:40.932317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2443cc80-103218e0-5f8fd376-564a72d8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:40.941284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:40.941761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:40.941927Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:40.941938Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:40.941948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:40.942000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:40.942045Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533077927251247:3392]
2025-10-02T08:07:40.942648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:40.942885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:40.942937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:40.943247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:40.943288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.943293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.943294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.943295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.943296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.943300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.943310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.943314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.943317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.943320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.943325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.943331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:40.943336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.943340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:40.943343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.943347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:40.943355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.943360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.943370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.943373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.943393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:40.943404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2443cc80-103218e0-5f8fd376-564a72d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.943475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:40.943484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 93
2025-10-02T08:07:40.943664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:40.943691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 93 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:40.943699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=93 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:40.943702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:40.944085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 93 sessionId:  describe result for acl check
2025-10-02T08:07:40.944119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:40.944124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:40.944126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:40.944130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533077927251264:3394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:40.944594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533077927251264:3394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:40.946674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533077927251264:3394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:40.951386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533077927251264:3394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:40.951399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533077927251264:3394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:40.951402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533077927251264:3394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:40.951411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 93 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:40.951642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:40.953743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:40.953761Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:40.953764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:40.953768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:40.953774Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 92 [1:7556533077927251247:3392]
2025-10-02T08:07:40.953787Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:40.953804Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:40.953807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.953812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.953814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.953845Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:40.953855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:40.953861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:40.953933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.953940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.953943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:40.953946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:40.954011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:40.954019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.954029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 92
2025-10-02T08:07:40.954033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:40.954045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:40.954065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533077927251295:3394], now have 1 active actors on pipe
2025-10-02T08:07:40.954070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.954079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.954092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533078387705120:2378], now have 1 active actors on pipe
2025-10-02T08:07:40.954101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533077927251241:3392]
2025-10-02T08:07:40.954104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533077927251241:3392]
2025-10-02T08:07:40.954115Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:40.954126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:40.954130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:40.954134Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:40.954144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:40.954147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:40.954131Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 92
2025-10-02T08:07:40.954161Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:40.954171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.954175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.954176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:40.954185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.954198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:40.954233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533077927251241:3392]
2025-10-02T08:07:40.954244Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:40.954249Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:40.954260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.954309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.954318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.954341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:40.954388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 93 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0
2025-10-02T08:07:40.954806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2443cc80-103218e0-5f8fd376-564a72d8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:40.957458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0] Write session: try to update token
2025-10-02T08:07:40.957480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:40.964555Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:40.964569Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.964576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533077927251241:3392]
2025-10-02T08:07:40.964610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:40.964617Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:40.964765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:40.968167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.968397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.968598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:40.968837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:40.968913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:40.976791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId: src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:40.979487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:40.979556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.979579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.979622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:40.979650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:40.979811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:40.979827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:40.980105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.980224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.980312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.980415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.980481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.980491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.980610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.980719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.980795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.980886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.981037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.981050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.981121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.981235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.981348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.981404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.981510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.981520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.981592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.981662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.981727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.981791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.981915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.981923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.981984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.982059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.982140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.982205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.982260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.982272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.982352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.982422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.982493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.982570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.982642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.982650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.982913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.983168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.983285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.983529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.983621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.983633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.983890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.983969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.984041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.984110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.984182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.984191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.984274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.984337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.984402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.984477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.984539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.984547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.984619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:40.984685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:40.984752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:40.984881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:40.985000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:40.985009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:40.985093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:40.985190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:40.985215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:40.985224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:40.985270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:40.985301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:40.985311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:40.985316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:40.985320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:40.985768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:40.985799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:40.985806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:40.985812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:40.985815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:40.985818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:40.986421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:40.986442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:40.986447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:40.986449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:40.986451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:40.986455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:40.987072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:40.987090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:40.987094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:40.987096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:40.987098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:40.988331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:40.988345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:40.988358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392460988
2025-10-02T08:07:40.988458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:40.988469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:40.988472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:40.988475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:40.988480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:40.988483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:40.989055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:40.989079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:40.989085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:40.989088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:40.989092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:40.989095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:40.989762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:40.989783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:40.989790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:40.989793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:40.989796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:40.989798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:40.990316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:40.990339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:40.990344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:40.991517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:40.991542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:40.991547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:40.991551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:40.991559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392460991
2025-10-02T08:07:40.991887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:40.991908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:40.991913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:40.991917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:40.991920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:40.991925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:40.992450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:40.992471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:40.992476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:40.992481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:40.992484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:40.992488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:40.993033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:40.993054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:40.993153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392460992
2025-10-02T08:07:40.995758Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:40.995796Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:40.995803Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:40.995811Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:40.995831Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:40.995839Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:40.995841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:40.995852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533077927251241:3392]
2025-10-02T08:07:40.995860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533077927251241:3392]
2025-10-02T08:07:40.995922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:40.995935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:40.995959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:40.995965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:40.995967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:40.996122Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:41.031746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533082222218606:2534]
2025-10-02T08:07:41.031851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:41.031973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 92, pipe: [1:7556533082222218606:2534]
2025-10-02T08:07:41.141603Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:41.142556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222218606:2534], now have 1 active actors on pipe
2025-10-02T08:07:41.142583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.142595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.142787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:41.142802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:41.142840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 93 reason: error at write: Disconnected sessionId: src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0
2025-10-02T08:07:41.142938Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.142951Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.142984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:41.143024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 93 sessionId: src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0 is DEAD
2025-10-02T08:07:41.143290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:41.143305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0] Write session will restart in 0.007097s
2025-10-02T08:07:41.143354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0] Write session: Do CDS request
2025-10-02T08:07:41.143362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:41.143354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533082222218606:2534]
2025-10-02T08:07:41.151268Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [bf8fcf987de58dbe] Result# TEvPutResult {Id# [72075186224037892:92:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:41.151373Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:92:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:41.151443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.151582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:41.151593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 94
2025-10-02T08:07:41.151757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.151807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 94 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:41.151819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=94 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:41.151824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:41.151918Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:92:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:41.152441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 94 sessionId:  describe result for acl check
2025-10-02T08:07:41.152475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:41.152481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:41.152483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:41.152489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533082222218774:3400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:41.152991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533082222218774:3400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:41.156029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533082222218774:3400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:41.156278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:41.156876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:41.157159Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:41.157169Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:41.157180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:41.157228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:41.157280Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533082222218893:3399]
2025-10-02T08:07:41.157998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:41.158175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:41.158227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:41.158596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:41.158651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.158657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.158658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.158659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.158660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.158665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.158674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.158678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.158682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.158686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.158691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.158699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.158704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.158709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.158713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.158719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.158723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.158728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.158733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.158737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.158755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:41.159000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533082222218774:3400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:41.159022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533082222218774:3400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:41.159025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533082222218774:3400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:41.159032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 94 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:41.168961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:41.171192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:41.171215Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:41.171218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:41.171222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:41.171229Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 93 [1:7556533082222218893:3399]
2025-10-02T08:07:41.171241Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:41.171261Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:41.171264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.171266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.171268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.171285Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:41.171291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:41.171304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:41.171389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.171395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.171398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:41.171400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:41.171474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:41.171480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.171494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.171506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:41.171524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533082222218878:3399]
2025-10-02T08:07:41.171526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533082222218878:3399]
2025-10-02T08:07:41.171534Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:41.171549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222218910:3400], now have 1 active actors on pipe
2025-10-02T08:07:41.171551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:41.171556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:41.171560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:41.171564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 93
2025-10-02T08:07:41.171570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:41.171572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:41.171577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533082682672435:2378], now have 1 active actors on pipe
2025-10-02T08:07:41.171614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.171620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.171634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533082222218878:3399]
2025-10-02T08:07:41.171646Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:41.171672Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64bb459b-52344ca3-2104ca1-89dad856_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:41.171684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.171688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.171672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 93
2025-10-02T08:07:41.171694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:41.171705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.171713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:41.171718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:41.171733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.171807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.171812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.171830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.171864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 94 partition: 0 MaxSeqNo: 17 sessionId: src_id|64bb459b-52344ca3-2104ca1-89dad856_0
2025-10-02T08:07:41.172203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d61b3db-10ac0c11-f3aaba21-f2c7264a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|64bb459b-52344ca3-2104ca1-89dad856_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:41.176489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bb459b-52344ca3-2104ca1-89dad856_0] Write session: try to update token
2025-10-02T08:07:41.176504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bb459b-52344ca3-2104ca1-89dad856_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:41.191001Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:41.191016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:41.191019Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:41.191027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533082222218878:3399]
2025-10-02T08:07:41.191031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533082222218878:3399]
2025-10-02T08:07:41.191073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:41.191080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.191092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:41.191133Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:41.191148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:41.191319Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:41.191363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId: src_id|64bb459b-52344ca3-2104ca1-89dad856_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:41.193982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:41.243709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533082222218923:2534]
2025-10-02T08:07:41.243777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:41.243907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 93, pipe: [1:7556533082222218923:2534]
2025-10-02T08:07:41.332371Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:41.332854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.332869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.332919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222218923:2534], now have 1 active actors on pipe
2025-10-02T08:07:41.332938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.332948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.333077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533082222218923:2534]
2025-10-02T08:07:41.333241Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.333251Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.333225Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:41.333423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:41.333490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 94 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64bb459b-52344ca3-2104ca1-89dad856_0
2025-10-02T08:07:41.333667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 94 sessionId: src_id|64bb459b-52344ca3-2104ca1-89dad856_0 is DEAD
2025-10-02T08:07:41.333828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bb459b-52344ca3-2104ca1-89dad856_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:41.333847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bb459b-52344ca3-2104ca1-89dad856_0] Write session will restart in 0.006045s
2025-10-02T08:07:41.333901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bb459b-52344ca3-2104ca1-89dad856_0] Write session: Do CDS request
2025-10-02T08:07:41.333908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bb459b-52344ca3-2104ca1-89dad856_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:41.341318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bb459b-52344ca3-2104ca1-89dad856_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.341379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:41.341391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 95
2025-10-02T08:07:41.341498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.341522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 95 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:41.341530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=95 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:41.341533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:41.341837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 95 sessionId:  describe result for acl check
2025-10-02T08:07:41.341860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:41.341864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:41.341866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:41.341870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533082222219167:3407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:41.342390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:41.342556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533082222219167:3407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:41.342938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:41.343097Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:41.343109Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:41.343119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:41.343172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:41.343212Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533082222219184:3406]
2025-10-02T08:07:41.343825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:41.344006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:41.344059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:41.344394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533082222219167:3407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:41.344409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:41.344454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.344459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.344460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.344462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.344463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.344468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.344477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.344481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.344489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.344493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.344502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.344513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.344518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.344523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.344531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.344536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.344543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.344548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.344556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.344561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.344578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:41.350211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533082222219167:3407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:41.350225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533082222219167:3407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:41.350228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533082222219167:3407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:41.350237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 95 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:41.352387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:41.354070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:41.354084Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:41.354087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:41.354091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:41.354098Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 94 [1:7556533082222219184:3406]
2025-10-02T08:07:41.354109Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:41.354127Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:41.354131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.354133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.354140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.354157Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:41.354166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:41.354175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:41.354244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.354250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.354253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:41.354256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:41.354391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 94
2025-10-02T08:07:41.354430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:41.354439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.354452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.354469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:41.354491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222219222:3407], now have 1 active actors on pipe
2025-10-02T08:07:41.354499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.354503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.354519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533082682672444:2378], now have 1 active actors on pipe
2025-10-02T08:07:41.354492Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 94
2025-10-02T08:07:41.354527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533082222219171:3406]
2025-10-02T08:07:41.354531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533082222219171:3406]
2025-10-02T08:07:41.354538Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:41.354549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:41.354553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:41.354559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:41.354566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:41.354569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:41.354584Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:41.354597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.354600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.354603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:41.354611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.354623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:41.354661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533082222219171:3406]
2025-10-02T08:07:41.354670Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:41.354683Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:41.354686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.354735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.354741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.354755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.354789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 95 partition: 0 MaxSeqNo: 17 sessionId: src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0
2025-10-02T08:07:41.355124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bb459b-52344ca3-2104ca1-89dad856_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:41.357721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0] Write session: try to update token
2025-10-02T08:07:41.357739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:41.365649Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:41.365668Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:41.365677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533082222219171:3406]
2025-10-02T08:07:41.365719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:41.365745Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:41.365971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:41.366168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:41.366326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:41.366476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:41.366707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:41.366753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:41.371721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId: src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:41.374674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:41.374757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.374768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.374802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:41.374827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:41.375100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.375117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.375284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.375385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.375490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.375563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.375625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.375634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.375844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.375914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.375990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.376062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.376180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.376191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.376284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.376358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.376430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.376493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.376541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.376548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.376614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.376847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.377503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.377583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.377638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.377645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.377711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.377778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.377845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.377912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.377959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.377971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.378051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.378120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.378189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.378257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.378309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.378318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.378393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.378461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.378531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.378614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.378663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.378670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.378743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.378814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.378887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.378956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.379008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.379016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.379082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.379309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.379372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.379434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.379504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.379512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.379576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:41.379638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:41.379706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:41.379771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:41.379823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:41.379831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:41.379882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:41.379946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.379968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.379975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:41.380004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:41.380021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:41.380030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:41.380033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:41.380037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:41.380462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:41.380489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:41.380499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:41.380508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:41.380512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:41.380517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:41.381396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:41.381421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:41.381428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:41.381431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:41.381434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:41.381438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:41.382197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:41.382221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:41.382227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:41.382231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:41.382235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:41.383464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:41.383484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:41.383493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392461383
2025-10-02T08:07:41.383697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:41.383708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:41.383712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:41.383715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:41.383718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:41.383720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:41.384137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:41.384158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:41.384162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:41.384165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:41.384166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:41.384169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:41.384656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:41.384674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:41.384684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:41.384686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:41.384688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:41.384692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:41.385172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:41.385191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:41.385195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:41.386272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:41.386286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:41.386291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:41.386293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:41.386300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392461386
2025-10-02T08:07:41.386603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:41.386622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:41.386625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:41.386627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:41.386634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:41.386636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:41.387082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:41.387099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:41.387102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:41.387105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:41.387107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:41.387110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:41.387561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:41.387580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.387672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392461387
2025-10-02T08:07:41.388463Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:41.388481Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:41.388488Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:41.388498Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:41.390129Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:41.390141Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:41.390142Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:41.390152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533082222219171:3406]
2025-10-02T08:07:41.390156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533082222219171:3406]
2025-10-02T08:07:41.390201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:41.390206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.390206Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:41.390208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:41.390212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:41.390344Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:41.433191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533082222219246:2534]
2025-10-02T08:07:41.433277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:41.433339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 94, pipe: [1:7556533082222219246:2534]
2025-10-02T08:07:41.529655Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:41.530027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222219246:2534], now have 1 active actors on pipe
2025-10-02T08:07:41.530048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.530053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.530178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533082222219246:2534]
2025-10-02T08:07:41.530206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:41.530208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:41.530232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 95 reason: error at write: Disconnected sessionId: src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0
2025-10-02T08:07:41.530241Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.530245Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.530308Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:41.530426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 95 sessionId: src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0 is DEAD
2025-10-02T08:07:41.530557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:41.530584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0] Write session will restart in 0.008406s
2025-10-02T08:07:41.530607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0] Write session: Do CDS request
2025-10-02T08:07:41.530612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:41.538744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:41.539254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:41.539455Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:41.539465Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:41.539475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:41.539524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:41.539567Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533082222219522:3422]
2025-10-02T08:07:41.540172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:41.540372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:41.540383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.540420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:41.540470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:41.540486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 96
2025-10-02T08:07:41.540612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.540640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 96 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:41.540665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=96 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:41.540670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:41.540740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:41.540792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.540798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.540799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.540817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.540818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.540823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.540833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.540837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.540846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.540850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.540856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.540864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.540874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.540880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.540888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.540894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.540902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.540908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.540913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.540919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.540939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:41.541076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 96 sessionId:  describe result for acl check
2025-10-02T08:07:41.541114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:41.541117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:41.541118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:41.541125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533082222219536:3424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:41.541672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533082222219536:3424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:41.543877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533082222219536:3424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:41.549619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533082222219536:3424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:41.549637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533082222219536:3424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:41.549641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533082222219536:3424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:41.549649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 96 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:41.550155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:41.552153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:41.552171Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:41.552173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:41.552176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:41.552182Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 95 [1:7556533082222219522:3422]
2025-10-02T08:07:41.552193Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:41.552222Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:41.552227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.552230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.552232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.552246Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:41.552256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:41.552262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:41.552322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.552329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.552332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:41.552334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:41.552397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:41.552404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.552415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.552432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:41.552452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533082222219516:3422]
2025-10-02T08:07:41.552461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533082222219516:3422]
2025-10-02T08:07:41.552469Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:41.552473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 95
2025-10-02T08:07:41.552477Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:41.552479Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:41.552482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222219566:3424], now have 1 active actors on pipe
2025-10-02T08:07:41.552490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:41.552503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:41.552513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:41.552518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533082682672455:2378], now have 1 active actors on pipe
2025-10-02T08:07:41.552522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.552526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.552560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533082222219516:3422]
2025-10-02T08:07:41.552571Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:41.552583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:41.552585Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a109e49d-49aba9bd-11887b7a-914307cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:41.552591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.552595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.552597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:41.552606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.552615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:41.552658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.552556Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 95
2025-10-02T08:07:41.552741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.552749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.552763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.552795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 96 partition: 0 MaxSeqNo: 17 sessionId: src_id|a109e49d-49aba9bd-11887b7a-914307cb_0
2025-10-02T08:07:41.553208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6ec4a-2740904f-392b041e-6cd5f067_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a109e49d-49aba9bd-11887b7a-914307cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:41.555882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a109e49d-49aba9bd-11887b7a-914307cb_0] Write session: try to update token
2025-10-02T08:07:41.555898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a109e49d-49aba9bd-11887b7a-914307cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:41.570024Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:41.570041Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:41.570043Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:41.570051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533082222219516:3422]
2025-10-02T08:07:41.570055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533082222219516:3422]
2025-10-02T08:07:41.570098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:41.570099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:41.570105Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:41.570111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.570113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:41.570270Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:41.571147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId: src_id|a109e49d-49aba9bd-11887b7a-914307cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:41.574400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:41.630324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533082222219589:2534]
2025-10-02T08:07:41.630425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:41.630586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 95, pipe: [1:7556533082222219589:2534]
2025-10-02T08:07:41.700483Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:41.701051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.701068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.701103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222219589:2534], now have 1 active actors on pipe
2025-10-02T08:07:41.701120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.701126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.701285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:41.701298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:41.701360Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.701365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 96 reason: error at write: Disconnected sessionId: src_id|a109e49d-49aba9bd-11887b7a-914307cb_0
2025-10-02T08:07:41.701371Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.701435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:41.701543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 96 sessionId: src_id|a109e49d-49aba9bd-11887b7a-914307cb_0 is DEAD
2025-10-02T08:07:41.701609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533082222219589:2534]
2025-10-02T08:07:41.701710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a109e49d-49aba9bd-11887b7a-914307cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:41.701722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a109e49d-49aba9bd-11887b7a-914307cb_0] Write session will restart in 0.005704s
2025-10-02T08:07:41.701741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a109e49d-49aba9bd-11887b7a-914307cb_0] Write session: Do CDS request
2025-10-02T08:07:41.701745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a109e49d-49aba9bd-11887b7a-914307cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:41.708380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a109e49d-49aba9bd-11887b7a-914307cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.708532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:41.708546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 97
2025-10-02T08:07:41.708711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.708742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 97 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:41.708751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=97 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:41.708754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:41.709099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 97 sessionId:  describe result for acl check
2025-10-02T08:07:41.709144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:41.709149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:41.709150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:41.709153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533082222219826:3431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:41.709427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:41.709574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533082222219826:3431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:41.709890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:41.710064Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:41.710073Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:41.710080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:41.710120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:41.710166Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533082222219840:3430]
2025-10-02T08:07:41.710701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:41.710864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:41.710908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:41.711217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:41.711253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.711254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.711255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.711255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.711256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.711261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.711270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.711273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.711276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.711279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.711292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.711299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.711303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.711308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.711311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.711318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.711321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.711326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.711329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.711334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.711350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:41.711391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533082222219826:3431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:41.717233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533082222219826:3431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:41.717251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533082222219826:3431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:41.717254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533082222219826:3431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:41.717262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 97 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:41.719335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:41.721092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:41.721108Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:41.721110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:41.721113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:41.721119Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 96 [1:7556533082222219840:3430]
2025-10-02T08:07:41.721130Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:41.721145Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:41.721147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.721150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.721152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.721165Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:41.721169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:41.721176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:41.721228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.721235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.721238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:41.721240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:41.721301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:41.721311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.721324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.721335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:41.721356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533082222219829:3430]
2025-10-02T08:07:41.721365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533082222219829:3430]
2025-10-02T08:07:41.721372Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:41.721383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:41.721397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:41.721405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:41.721414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222219881:3431], now have 1 active actors on pipe
2025-10-02T08:07:41.721414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 96
2025-10-02T08:07:41.721418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:41.721420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:41.721442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533082682672479:2378], now have 1 active actors on pipe
2025-10-02T08:07:41.721448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533082222219829:3430]
2025-10-02T08:07:41.721455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:41.721460Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:41.721461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.721465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.721504Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0fbb79d-1546b302-20475c21-320442bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:41.721513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.721516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.721518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:41.721526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.721538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:41.721523Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 96
2025-10-02T08:07:41.721557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.721595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.721601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.721613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.721648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 97 partition: 0 MaxSeqNo: 17 sessionId: src_id|b0fbb79d-1546b302-20475c21-320442bf_0
2025-10-02T08:07:41.722014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a109e49d-49aba9bd-11887b7a-914307cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b0fbb79d-1546b302-20475c21-320442bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:41.724378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb79d-1546b302-20475c21-320442bf_0] Write session: try to update token
2025-10-02T08:07:41.724396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb79d-1546b302-20475c21-320442bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:41.737764Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:41.737786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:41.737789Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:41.737797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533082222219829:3430]
2025-10-02T08:07:41.737801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533082222219829:3430]
2025-10-02T08:07:41.737841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:41.737843Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:41.737847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.737849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:41.737857Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:41.737992Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:41.738726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId: src_id|b0fbb79d-1546b302-20475c21-320442bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:41.741695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:41.801811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533082222219898:2534]
2025-10-02T08:07:41.801892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:41.802002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 96, pipe: [1:7556533082222219898:2534]
2025-10-02T08:07:41.883498Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:41.883775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.883788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.883825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222219898:2534], now have 1 active actors on pipe
2025-10-02T08:07:41.883842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.883848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.883934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:41.883945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:41.883996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 97 reason: error at write: Disconnected sessionId: src_id|b0fbb79d-1546b302-20475c21-320442bf_0
2025-10-02T08:07:41.884090Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.884101Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:41.884103Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:41.884199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 97 sessionId: src_id|b0fbb79d-1546b302-20475c21-320442bf_0 is DEAD
2025-10-02T08:07:41.884374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb79d-1546b302-20475c21-320442bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:41.884386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb79d-1546b302-20475c21-320442bf_0] Write session will restart in 0.009484s
2025-10-02T08:07:41.884376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533082222219898:2534]
2025-10-02T08:07:41.884404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb79d-1546b302-20475c21-320442bf_0] Write session: Do CDS request
2025-10-02T08:07:41.884409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb79d-1546b302-20475c21-320442bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:41.892893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:41.893338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:41.893498Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:41.893507Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:41.893515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:41.893556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:41.893591Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533082222220144:3437]
2025-10-02T08:07:41.894237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:41.894422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:41.894464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:41.894764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:41.894802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.894807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.894808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.894809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.894810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.894814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.894824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.894828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.894832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.894835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.894841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.894848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:41.894853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.894859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:41.894862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.894867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:41.894872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.894881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.894885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.894890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.894912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:41.895413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb79d-1546b302-20475c21-320442bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.895502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:41.895514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 98
2025-10-02T08:07:41.895699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:41.895734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 98 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:41.895744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=98 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:41.895748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:41.896126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 98 sessionId:  describe result for acl check
2025-10-02T08:07:41.896153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:41.896154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:41.896155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:41.896160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533082222220160:3439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:41.896629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533082222220160:3439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:41.899071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533082222220160:3439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:41.902014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533082222220160:3439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:41.902028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533082222220160:3439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:41.902031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533082222220160:3439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:41.902045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 98 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:41.903433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:41.905224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:41.905241Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:41.905244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:41.905247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:41.905253Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 97 [1:7556533082222220144:3437]
2025-10-02T08:07:41.905264Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:41.905280Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:41.905282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.905285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.905287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.905301Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:41.905310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:41.905316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:41.905373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.905381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.905384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:41.905387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:41.905449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:41.905456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.905469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:41.905486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:41.905505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 97
2025-10-02T08:07:41.905506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222220191:3439], now have 1 active actors on pipe
2025-10-02T08:07:41.905512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533082222220138:3437]
2025-10-02T08:07:41.905514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533082222220138:3437]
2025-10-02T08:07:41.905525Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:41.905532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533082682672488:2378], now have 1 active actors on pipe
2025-10-02T08:07:41.905536Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:41.905537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.905538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:41.905542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.905559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:41.905576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:41.905583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:41.905583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 97
2025-10-02T08:07:41.905620Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48da3d64-5c2090d0-24124410-c4f4f979_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:41.905631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:41.905635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:41.905638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:41.905646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:41.905656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:41.905667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533082222220138:3437]
2025-10-02T08:07:41.905675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:41.905693Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:41.905706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.905758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:41.905766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:41.905778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:41.905812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 98 partition: 0 MaxSeqNo: 17 sessionId: src_id|48da3d64-5c2090d0-24124410-c4f4f979_0
2025-10-02T08:07:41.906193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0fbb79d-1546b302-20475c21-320442bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|48da3d64-5c2090d0-24124410-c4f4f979_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:41.908858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48da3d64-5c2090d0-24124410-c4f4f979_0] Write session: try to update token
2025-10-02T08:07:41.908878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48da3d64-5c2090d0-24124410-c4f4f979_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:41.923383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId: src_id|48da3d64-5c2090d0-24124410-c4f4f979_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:41.923561Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:41.923576Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:41.923578Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:41.923586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533082222220138:3437]
2025-10-02T08:07:41.923591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533082222220138:3437]
2025-10-02T08:07:41.923639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:41.923653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:41.923655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:41.923666Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:41.923670Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:41.923820Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:41.926303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:41.984583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533082222220207:2534]
2025-10-02T08:07:41.984644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:41.984731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 97, pipe: [1:7556533082222220207:2534]
2025-10-02T08:07:42.071449Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:42.071867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.071879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.071917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533082222220207:2534], now have 1 active actors on pipe
2025-10-02T08:07:42.071934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.071936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.072041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:42.072047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:42.072101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 98 reason: error at write: Disconnected sessionId: src_id|48da3d64-5c2090d0-24124410-c4f4f979_0
2025-10-02T08:07:42.072250Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.072267Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.072276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 98 sessionId: src_id|48da3d64-5c2090d0-24124410-c4f4f979_0 is DEAD
2025-10-02T08:07:42.072421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48da3d64-5c2090d0-24124410-c4f4f979_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:42.072427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48da3d64-5c2090d0-24124410-c4f4f979_0] Write session will restart in 0.005902s
2025-10-02T08:07:42.072449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48da3d64-5c2090d0-24124410-c4f4f979_0] Write session: Do CDS request
2025-10-02T08:07:42.072454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48da3d64-5c2090d0-24124410-c4f4f979_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:42.072438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533082222220207:2534]
2025-10-02T08:07:42.072494Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:42.079303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48da3d64-5c2090d0-24124410-c4f4f979_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.079359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:42.079382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 99
2025-10-02T08:07:42.079571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.079606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 99 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:42.079615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=99 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:42.079618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:42.080017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 99 sessionId:  describe result for acl check
2025-10-02T08:07:42.080052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:42.080058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:42.080059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:42.080064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533086517187722:3444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:42.080573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533086517187722:3444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:42.081833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:42.082474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:42.082645Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:42.082656Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:42.082666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:42.082716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:42.082756Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533086517187772:3443]
2025-10-02T08:07:42.083112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533086517187722:3444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:42.083417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:42.083622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:42.083674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:42.084006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:42.084064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.084070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.084071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.084073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.084074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.084079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.084087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.084091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.084094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.084098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.084103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.084111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.084121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.084126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.084135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.084140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.084149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.084154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.084159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.084163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.084181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:42.089492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533086517187722:3444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:42.089509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533086517187722:3444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:42.089512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533086517187722:3444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:42.089520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 99 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:42.092594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:42.094391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:42.094410Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:42.094414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:42.094418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:42.094424Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 98 [1:7556533086517187772:3443]
2025-10-02T08:07:42.094438Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:42.094458Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:42.094461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.094464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.094466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.094482Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:42.094488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:42.094494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:42.094556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.094565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.094568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:42.094570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:42.094662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:42.094685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 98
2025-10-02T08:07:42.094757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 98
2025-10-02T08:07:42.094829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.094852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.094873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:42.094902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517187799:3444], now have 1 active actors on pipe
2025-10-02T08:07:42.094912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533086977639802:2378], now have 1 active actors on pipe
2025-10-02T08:07:42.094917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.094921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.094945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533086517187758:3443]
2025-10-02T08:07:42.094951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533086517187758:3443]
2025-10-02T08:07:42.094965Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:42.094981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:42.094983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:42.094988Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:42.094999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:42.095002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:42.095017Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d82b948f-80515f3e-bea595d9-d429d723_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:42.095029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.095033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.095036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:42.095046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.095061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:42.095098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533086517187758:3443]
2025-10-02T08:07:42.095110Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:42.095114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:42.095129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.095188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.095195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.095214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.095250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 99 partition: 0 MaxSeqNo: 17 sessionId: src_id|d82b948f-80515f3e-bea595d9-d429d723_0
2025-10-02T08:07:42.095627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48da3d64-5c2090d0-24124410-c4f4f979_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d82b948f-80515f3e-bea595d9-d429d723_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:42.098337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82b948f-80515f3e-bea595d9-d429d723_0] Write session: try to update token
2025-10-02T08:07:42.098357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82b948f-80515f3e-bea595d9-d429d723_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:42.112402Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:42.112422Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:42.112425Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:42.112434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533086517187758:3443]
2025-10-02T08:07:42.112439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533086517187758:3443]
2025-10-02T08:07:42.112469Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:42.112477Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:42.112484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:42.112497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.112503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:42.112661Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:42.113760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId: src_id|d82b948f-80515f3e-bea595d9-d429d723_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:42.116395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:42.172507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533086517187826:2534]
2025-10-02T08:07:42.172605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:42.172704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 98, pipe: [1:7556533086517187826:2534]
2025-10-02T08:07:42.248285Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:42.248504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.248516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.248554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517187826:2534], now have 1 active actors on pipe
2025-10-02T08:07:42.248568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.248572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.248686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533086517187826:2534]
2025-10-02T08:07:42.248716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:42.248718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:42.248734Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.248742Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.248792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 99 reason: error at write: Disconnected sessionId: src_id|d82b948f-80515f3e-bea595d9-d429d723_0
2025-10-02T08:07:42.248819Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:42.248959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 99 sessionId: src_id|d82b948f-80515f3e-bea595d9-d429d723_0 is DEAD
2025-10-02T08:07:42.249135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82b948f-80515f3e-bea595d9-d429d723_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:42.249149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82b948f-80515f3e-bea595d9-d429d723_0] Write session will restart in 0.008307s
2025-10-02T08:07:42.249174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82b948f-80515f3e-bea595d9-d429d723_0] Write session: Do CDS request
2025-10-02T08:07:42.249181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82b948f-80515f3e-bea595d9-d429d723_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:42.257796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:42.258287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:42.258322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82b948f-80515f3e-bea595d9-d429d723_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.258441Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:42.258451Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:42.258454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:42.258458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 100
2025-10-02T08:07:42.258460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:42.258509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:42.258554Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533086517188076:3450]
2025-10-02T08:07:42.258566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.258581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:42.258590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:42.258593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:42.258929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 100 sessionId:  describe result for acl check
2025-10-02T08:07:42.258958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:42.258964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:42.258966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:42.258971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533086517188081:3452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:42.259201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:42.259334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:42.259366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:42.259412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533086517188081:3452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:42.259641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:42.259682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.259686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.259687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.259688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.259689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.259693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.259703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.259707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.259712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.259715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.259720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.259725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.259731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.259736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.259740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.259745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.259749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.259756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.259763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.259767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.259788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:42.261459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533086517188081:3452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:42.266963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533086517188081:3452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:42.266978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533086517188081:3452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:42.266982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533086517188081:3452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:42.266990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:42.267396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:42.269160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:42.269172Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:42.269175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:42.269178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:42.269184Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 99 [1:7556533086517188076:3450]
2025-10-02T08:07:42.269197Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:42.269213Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:42.269217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.269219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.269222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.269236Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:42.269241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:42.269247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:42.269305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.269312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.269315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:42.269317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:42.269375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:42.269383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.269396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.269408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:42.269415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 99
2025-10-02T08:07:42.269425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517188124:3452], now have 1 active actors on pipe
2025-10-02T08:07:42.269428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533086977639808:2378], now have 1 active actors on pipe
2025-10-02T08:07:42.269432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.269436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.269451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533086517188070:3450]
2025-10-02T08:07:42.269457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533086517188070:3450]
2025-10-02T08:07:42.269471Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:42.269486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:42.269491Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:42.269494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:42.269502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:42.269504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:42.269518Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:42.269524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.269527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.269529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:42.269537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.269487Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 99
2025-10-02T08:07:42.269546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:42.269580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533086517188070:3450]
2025-10-02T08:07:42.269591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:42.269602Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:42.269606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.269650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.269656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.269667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.269699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 100 partition: 0 MaxSeqNo: 17 sessionId: src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0
2025-10-02T08:07:42.270097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82b948f-80515f3e-bea595d9-d429d723_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:42.273152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0] Write session: try to update token
2025-10-02T08:07:42.273172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:42.285173Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:42.285191Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:42.285200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533086517188070:3450]
2025-10-02T08:07:42.285241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:42.285241Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:42.285419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:42.285578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:42.285747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:42.285891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:42.286084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:42.286147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:42.290925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId: src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:42.293657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:42.293730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.293744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.293783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:42.293809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:42.294016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.294030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.294421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.294489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.294550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.294607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.294660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.294669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.294766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.294828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.294891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.294958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.295008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.295014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.295076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.295138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.295199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.295255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.295301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.295307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.295371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.295436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.295503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.295567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.295665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.295672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.295740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.295800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.295866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.295928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.296028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.296035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.296101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.296168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.296246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.296315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.296368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.296374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.296450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.296516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.296612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.296688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.296779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.296786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.296880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.296951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.297028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.297099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.297153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.297160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.297231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.297289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.297350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.297417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.297468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.297475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.297538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.297597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.297659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.297729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.297775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.297781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.297839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:42.297893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.297916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.297918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:42.297948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:42.297964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:42.297972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:42.297975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:42.297978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:42.298401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:42.298429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:42.298440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:42.298443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:42.298446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:42.298449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:42.299076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:42.299095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:42.299099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:42.299105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:42.299107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:42.299110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:42.299649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:42.299668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:42.299672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:42.299678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:42.299681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:42.301729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:42.301747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:42.301761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392462301
2025-10-02T08:07:42.301901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:42.301914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:42.301918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:42.301926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:42.301930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:42.301933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:42.302453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:42.302473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:42.302477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:42.302480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:42.302482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:42.302485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:42.302980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:42.303001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:42.303010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:42.303016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:42.303020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:42.303024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:42.303620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:42.303649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:42.303662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:42.305344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:42.305367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:42.305373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:42.305377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:42.305389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392462305
2025-10-02T08:07:42.305860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:42.305888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:42.305901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:42.305912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:42.305918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:42.305927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:42.306616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:42.306634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:42.306639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:42.306643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:42.306645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:42.306648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:42.307089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:42.307109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.307208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392462307
2025-10-02T08:07:42.309781Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:42.309810Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:42.309818Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:42.309825Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:42.309836Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:42.309844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:42.309846Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:42.309854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533086517188070:3450]
2025-10-02T08:07:42.309863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533086517188070:3450]
2025-10-02T08:07:42.309902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:42.309912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:42.309938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:42.309943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.309945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:42.310091Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:42.348608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533086517188151:2534]
2025-10-02T08:07:42.348696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:42.348814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 99, pipe: [1:7556533086517188151:2534]
2025-10-02T08:07:42.444125Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:42.444529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517188151:2534], now have 1 active actors on pipe
2025-10-02T08:07:42.444551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.444562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.444689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:42.444698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:42.444725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 100 reason: error at write: Disconnected sessionId: src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0
2025-10-02T08:07:42.444819Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.444833Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.444912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 100 sessionId: src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0 is DEAD
2025-10-02T08:07:42.444870Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:42.445035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:42.445046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0] Write session will restart in 0.005178s
2025-10-02T08:07:42.445068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0] Write session: Do CDS request
2025-10-02T08:07:42.445076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:42.445083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533086517188151:2534]
2025-10-02T08:07:42.448180Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2a360dd8bb1ac267] Result# TEvPutResult {Id# [72075186224037892:99:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:42.448231Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:99:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:42.448299Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:99:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:42.451374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.451512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:42.451526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 101
2025-10-02T08:07:42.451709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.451744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:42.451754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:42.451758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:42.452144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 101 sessionId:  describe result for acl check
2025-10-02T08:07:42.452175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:42.452182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:42.452185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:42.452191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533086517188313:3458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:42.452734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533086517188313:3458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:42.456171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533086517188313:3458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:42.456488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:42.457070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:42.457246Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:42.457256Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:42.457264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:42.457304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:42.457340Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533086517188444:3457]
2025-10-02T08:07:42.457950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:42.458161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:42.458210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:42.458535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:42.458588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.458589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.458590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.458590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.458591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.458597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.458605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.458608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.458612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.458615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.458620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.458627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.458633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.458638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.458642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.458647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.458651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.458656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.458660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.458664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.458679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:42.459105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533086517188313:3458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:42.459118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533086517188313:3458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:42.459120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533086517188313:3458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:42.459132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:42.466909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:42.468578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:42.468596Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:42.468598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:42.468602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:42.468606Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 100 [1:7556533086517188444:3457]
2025-10-02T08:07:42.468615Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:42.468629Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:42.468632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.468634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.468635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.468648Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:42.468652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:42.468657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:42.468706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.468712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.468715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:42.468716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:42.468763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:42.468768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.468777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.468786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:42.468819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533086517188428:3457]
2025-10-02T08:07:42.468826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533086517188428:3457]
2025-10-02T08:07:42.468834Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:42.468846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:42.468854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:42.468856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:42.468860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 100
2025-10-02T08:07:42.468862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517188461:3458], now have 1 active actors on pipe
2025-10-02T08:07:42.468889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533086517188428:3457]
2025-10-02T08:07:42.468896Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:42.468900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533086977639819:2378], now have 1 active actors on pipe
2025-10-02T08:07:42.468914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.468923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.468954Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:42.468962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.468964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.468966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:42.468974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.468982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:42.469002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:42.469004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.469012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:42.469017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:42.469040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.469047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.469019Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 100
2025-10-02T08:07:42.469063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.469092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 101 partition: 0 MaxSeqNo: 17 sessionId: src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0
2025-10-02T08:07:42.469442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6324d3ed-ebb56398-6d797f6b-4b5c040a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:42.472462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0] Write session: try to update token
2025-10-02T08:07:42.472481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:42.486467Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:42.486489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:42.486490Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:42.486498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533086517188428:3457]
2025-10-02T08:07:42.486502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533086517188428:3457]
2025-10-02T08:07:42.486544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:42.486548Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:42.486554Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:42.486555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.486557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:42.486713Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:42.508337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId: src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:42.510968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:42.545241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533086517188503:2534]
2025-10-02T08:07:42.545317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:42.545429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 100, pipe: [1:7556533086517188503:2534]
2025-10-02T08:07:42.622720Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:42.623134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.623146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.623165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517188503:2534], now have 1 active actors on pipe
2025-10-02T08:07:42.623178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.623180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.623243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:42.623250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:42.623298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 101 reason: error at write: Disconnected sessionId: src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0
2025-10-02T08:07:42.623357Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.623370Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.623381Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:42.623480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 101 sessionId: src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0 is DEAD
2025-10-02T08:07:42.623614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:42.623626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0] Write session will restart in 0.006303s
2025-10-02T08:07:42.623643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0] Write session: Do CDS request
2025-10-02T08:07:42.623634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7556533086517188503:2534]
2025-10-02T08:07:42.623648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:42.631376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.631390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:42.631472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:42.631483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 102
2025-10-02T08:07:42.631642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.631677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:42.631682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:42.631685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:42.631881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:42.632052Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:42.632062Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:42.632070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 102 sessionId:  describe result for acl check
2025-10-02T08:07:42.632073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:42.632092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:42.632099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:42.632100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:42.632105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533086517188771:3477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:42.632120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:42.632155Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533086517188770:3475]
2025-10-02T08:07:42.632564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533086517188771:3477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:42.632773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:42.632963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:42.633002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:42.633303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:42.633375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.633382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.633383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.633383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.633384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.633389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.633398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.633402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.633405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.633408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.633413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.633423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.633434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.633438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.633442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.633447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.633450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.633454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.633458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.633463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.633480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:42.634574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533086517188771:3477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:42.640487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533086517188771:3477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:42.640501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533086517188771:3477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:42.640504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533086517188771:3477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:42.640512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:42.641171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:42.642707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:42.642718Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:42.642719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:42.642722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:42.642726Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 101 [1:7556533086517188770:3475]
2025-10-02T08:07:42.642732Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:42.642747Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:42.642750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.642752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.642755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.642766Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:42.642769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:42.642774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:42.642815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.642820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.642822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:42.642824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:42.642870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:42.642875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.642883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.642889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:42.642903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517188812:3477], now have 1 active actors on pipe
2025-10-02T08:07:42.642911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533086517188762:3475]
2025-10-02T08:07:42.642912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533086517188762:3475]
2025-10-02T08:07:42.642915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 101
2025-10-02T08:07:42.642917Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:42.642921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533086977639848:2378], now have 1 active actors on pipe
2025-10-02T08:07:42.642926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:42.642928Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:42.642931Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:42.642933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:42.642935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:42.642939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.642942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.642970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533086517188762:3475]
2025-10-02T08:07:42.642977Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:42.642987Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46531867-b8e82a9b-453823bb-f4c71617_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:42.642993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:42.642995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.642998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.642999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:42.643005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.643010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:42.642994Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 101
2025-10-02T08:07:42.643039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.643085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.643097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.643117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.643150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 102 partition: 0 MaxSeqNo: 17 sessionId: src_id|46531867-b8e82a9b-453823bb-f4c71617_0
2025-10-02T08:07:42.643502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a0ab4cb-ebdca055-79f5651f-4318108f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|46531867-b8e82a9b-453823bb-f4c71617_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:42.646076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46531867-b8e82a9b-453823bb-f4c71617_0] Write session: try to update token
2025-10-02T08:07:42.646096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46531867-b8e82a9b-453823bb-f4c71617_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:42.653318Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:42.653336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:42.653344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533086517188762:3475]
2025-10-02T08:07:42.653387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:42.653420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:42.653553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:42.653691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:42.653826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:42.653999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:42.654594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:42.654642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:42.661061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId: src_id|46531867-b8e82a9b-453823bb-f4c71617_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:42.663804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:42.663862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.663874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.663911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:42.663936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:42.663995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.664009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.664187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.664283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.664357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.664434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.664489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.664498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.664580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.664641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.664708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.664772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.664898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.664906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.664972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.665035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.665098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.665165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.665212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.665219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.665289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.665359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.665422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.665483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.665528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.665536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.665608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.665668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.665729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.665800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.665853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.665859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.665930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.665995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.666068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.666132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.666180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.666187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.666257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.666320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.666385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.666458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.666532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.666538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.666610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.666674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.666733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.666792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.666833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.666839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.666899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.666956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.667007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.667069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.667165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.667170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.667231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:42.667291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:42.667350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:42.667403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:42.667445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:42.667450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:42.667483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:42.667537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.667558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.667563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:42.667584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:42.667596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:42.667601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:42.667603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:42.667604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:42.668005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:42.668029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:42.668033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:42.668036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:42.668038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:42.668043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:42.668629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:42.668644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:42.668648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:42.668650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:42.668652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:42.668654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:42.669141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:42.669157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:42.669161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:42.669165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:42.669167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:42.673745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:42.673760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:42.673770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392462673
2025-10-02T08:07:42.673953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:42.673964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:42.673969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:42.673971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:42.673975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:42.673977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:42.674399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:42.674418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:42.674443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:42.674450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:42.674453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:42.674455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:42.674871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:42.674887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:42.674893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:42.674895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:42.674899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:42.674903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:42.675374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:42.675391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:42.675396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:42.676492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:42.676508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:42.676513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:42.676516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:42.676524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392462676
2025-10-02T08:07:42.676814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:42.676833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:42.676837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:42.676843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:42.676845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:42.676847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:42.677312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:42.677328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:42.677333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:42.677339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:42.677341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:42.677345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:42.677786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:42.677803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.677915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392462677
2025-10-02T08:07:42.678721Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:42.678737Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:42.678741Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:42.678745Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:42.680398Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:42.680408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:42.680409Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:42.680416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533086517188762:3475]
2025-10-02T08:07:42.680419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533086517188762:3475]
2025-10-02T08:07:42.680465Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:42.680471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:42.680474Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:42.680475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.680476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:42.680616Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:42.723904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 1 ReadOffset 11 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533086517188834:2534]
2025-10-02T08:07:42.723991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_11670534616535065925_v1" Offset: 11 Count: 7 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7556532992027885126 RawX2: 4503603922340326 } Cookie: 11 } }
2025-10-02T08:07:42.724070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 101, pipe: [1:7556533086517188834:2534]
2025-10-02T08:07:42.809257Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:42.809657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517188834:2534], now have 1 active actors on pipe
2025-10-02T08:07:42.809685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.809691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.809818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533086517188834:2534]
2025-10-02T08:07:42.809839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:42.809842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:42.809864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 102 reason: error at write: Disconnected sessionId: src_id|46531867-b8e82a9b-453823bb-f4c71617_0
2025-10-02T08:07:42.809881Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.809891Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.809888Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:42.810039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 102 sessionId: src_id|46531867-b8e82a9b-453823bb-f4c71617_0 is DEAD
2025-10-02T08:07:42.810190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46531867-b8e82a9b-453823bb-f4c71617_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:42.810206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46531867-b8e82a9b-453823bb-f4c71617_0] Write session will restart in 0.005212s
2025-10-02T08:07:42.810226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46531867-b8e82a9b-453823bb-f4c71617_0] Write session: Do CDS request
2025-10-02T08:07:42.810231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46531867-b8e82a9b-453823bb-f4c71617_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:42.810237Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:07:42.810362Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_11670534616535065925_v1 is DEAD
2025-10-02T08:07:42.810559Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917515:2529] disconnected; active server actors: 1
2025-10-02T08:07:42.810579Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556532987732917515:2529] client user disconnected session shared/user_1_1_11670534616535065925_v1
2025-10-02T08:07:42.810600Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:07:42.810743Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:42.810750Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:42.810779Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.005890s
2025-10-02T08:07:42.816163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46531867-b8e82a9b-453823bb-f4c71617_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.816285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:42.816298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 103
2025-10-02T08:07:42.816420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.816451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:42.816458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:42.816461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:42.816901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 103 sessionId:  describe result for acl check
2025-10-02T08:07:42.816931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:42.816938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:42.816940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:42.816945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533086517189063:3483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:42.817012Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:07:42.817414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533086517189063:3483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:42.817539Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:07:42.817546Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-02T08:07:42.817780Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:42.817820Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:07:42.817869Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 auth for : user
2025-10-02T08:07:42.817941Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 Handle describe topics response
2025-10-02T08:07:42.817969Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 auth is DEAD
2025-10-02T08:07:42.817974Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:07:42.818148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:42.818165Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:07:42.818297Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_2_6452961545075842050_v1
2025-10-02T08:07:42.818306Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:07:42.818353Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:07:42.818422Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:07:42.818462Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533086517189101:3486] connected; active server actors: 1
2025-10-02T08:07:42.818495Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533086517189101:3486] session shared/user_1_2_6452961545075842050_v1
2025-10-02T08:07:42.818494Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 got read request: guid# 2b37f23e-8a437abf-41df8d8a-f7446a57
2025-10-02T08:07:42.818503Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:07:42.818518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:07:42.818523Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_6452961545075842050_v1" (Sender=[1:7556533086517189084:3486], Pipe=[1:7556533086517189101:3486], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:42.818525Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:07:42.818532Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:07:42.818536Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_6452961545075842050_v1" (Sender=[1:7556533086517189084:3486], Pipe=[1:7556533086517189101:3486], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:07:42.818544Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_6452961545075842050_v1" sender [1:7556533086517189084:3486] lock partition 0 for ReadingSession "shared/user_1_2_6452961545075842050_v1" (Sender=[1:7556533086517189084:3486], Pipe=[1:7556533086517189101:3486], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-02T08:07:42.818556Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:07:42.818562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000028s
2025-10-02T08:07:42.818781Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_6452961545075842050_v1" ClientId: "user" PipeClient { RawX1: 7556533086517189101 RawX2: 4503603922341278 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:07:42.818867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:42.818956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:07:42.819019Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:42.819028Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:42.819037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:42.819083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:42.819122Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533086517189122:3482]
2025-10-02T08:07:42.819545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:42.819596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533086517189063:3483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:42.819750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:42.819805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:42.820214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:42.820263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.820270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.820271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.820272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.820272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.820279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.820286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.820288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.820291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.820293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.820297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.820302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.820307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.820310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.820313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.820317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.820319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.820322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.820324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.820327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.820341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:42.824772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533086517189063:3483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:42.824788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533086517189063:3483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:42.824791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533086517189063:3483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:42.824797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:42.827962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:42.829506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:42.829519Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:42.829521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:42.829524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:42.829528Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 102 [1:7556533086517189122:3482]
2025-10-02T08:07:42.829535Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:42.829547Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:42.829549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.829551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.829552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.829562Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:42.829566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:42.829571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:42.829612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.829618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.829620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:42.829622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:42.829669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:42.829676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.829685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.829691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:42.829704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517189153:3483], now have 1 active actors on pipe
2025-10-02T08:07:42.829709Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533086517189099:3482]
2025-10-02T08:07:42.829710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533086517189099:3482]
2025-10-02T08:07:42.829715Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:42.829722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517189120:3491], now have 1 active actors on pipe
2025-10-02T08:07:42.829727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:42.829732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:42.829734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:42.829735Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:42.829736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:42.829741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 102
2025-10-02T08:07:42.829745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533086977639858:2378], now have 1 active actors on pipe
2025-10-02T08:07:42.829764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 102, pipe: [1:7556533086517189120:3491]
2025-10-02T08:07:42.829769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.829771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.829782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533086517189099:3482]
2025-10-02T08:07:42.829793Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:42.829798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.829802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.829806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_6452961545075842050_v1 on pipe: [1:7556533086517189120:3491]
2025-10-02T08:07:42.829809Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:42.829798Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 102
2025-10-02T08:07:42.829829Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_6452961545075842050_v1:1 with generation 102
2025-10-02T08:07:42.829844Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4b60fe1-16a05593-f344a2e-de61b328_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:42.829849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.829851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.829852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:42.829857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.829863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:42.829878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.829884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.829885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:42.829894Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_6452961545075842050_v1
2025-10-02T08:07:42.829895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.829921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.829944Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:42.830028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.830032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.830042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.830085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 103 partition: 0 MaxSeqNo: 17 sessionId: src_id|a4b60fe1-16a05593-f344a2e-de61b328_0
2025-10-02T08:07:42.830415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46531867-b8e82a9b-453823bb-f4c71617_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a4b60fe1-16a05593-f344a2e-de61b328_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:42.832664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b60fe1-16a05593-f344a2e-de61b328_0] Write session: try to update token
2025-10-02T08:07:42.832675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b60fe1-16a05593-f344a2e-de61b328_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:42.834013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:07:42.834044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:07:42.834052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.834055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.834056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.834063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:07:42.834075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:07:42.834150Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392462829 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:07:42.834164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:07:42.834203Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 sending to client partition status
2025-10-02T08:07:42.845840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId: src_id|a4b60fe1-16a05593-f344a2e-de61b328_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:42.846606Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:42.846622Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:42.846624Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:42.846632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533086517189099:3482]
2025-10-02T08:07:42.846639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533086517189099:3482]
2025-10-02T08:07:42.846672Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:42.846680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:42.846682Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:42.846686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.846688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:42.846994Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:42.848492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:42.971207Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:42.971477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.971489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.971564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:42.971569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:42.971613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 103 reason: error at write: Disconnected sessionId: src_id|a4b60fe1-16a05593-f344a2e-de61b328_0
2025-10-02T08:07:42.971681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_6452961545075842050_v1
2025-10-02T08:07:42.971699Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:42.971702Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:42.971767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 103 sessionId: src_id|a4b60fe1-16a05593-f344a2e-de61b328_0 is DEAD
2025-10-02T08:07:42.971887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533086517189120:3491]
2025-10-02T08:07:42.971902Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_6452961545075842050_v1
2025-10-02T08:07:42.971967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b60fe1-16a05593-f344a2e-de61b328_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:42.971981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b60fe1-16a05593-f344a2e-de61b328_0] Write session will restart in 0.005054s
2025-10-02T08:07:42.972009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b60fe1-16a05593-f344a2e-de61b328_0] Write session: Do CDS request
2025-10-02T08:07:42.972016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b60fe1-16a05593-f344a2e-de61b328_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:42.978297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b60fe1-16a05593-f344a2e-de61b328_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.978423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:42.978440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 104
2025-10-02T08:07:42.978621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:42.978653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:42.978661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:42.978665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:42.979076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 104 sessionId:  describe result for acl check
2025-10-02T08:07:42.979106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:42.979108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:42.979110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:42.979115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533086517189404:3493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:42.979600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533086517189404:3493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:42.980483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:42.981175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:42.981354Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:42.981367Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:42.981379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:42.981424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:42.981478Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533086517189448:3492]
2025-10-02T08:07:42.981728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533086517189404:3493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:42.982062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:42.982236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:42.982275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:42.982573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:42.982625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.982630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.982631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.982632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.982633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.982638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.982647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.982650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.982654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.982661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.982667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.982676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:42.982681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.982687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:42.982695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.982701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:42.982706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.982716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.982720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.982725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.982747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:42.987314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533086517189404:3493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:42.987342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533086517189404:3493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:42.987345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533086517189404:3493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:42.987352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:42.990275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:42.991935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:42.991950Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:42.991951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:42.991954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:42.991958Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 103 [1:7556533086517189448:3492]
2025-10-02T08:07:42.991971Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:42.991987Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:42.991989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.991992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.991994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.992007Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:42.992010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:42.992015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:42.992060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.992066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.992068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:42.992070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:42.992115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:42.992121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:42.992129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:42.992141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:42.992153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533086517189432:3492]
2025-10-02T08:07:42.992154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533086517189432:3492]
2025-10-02T08:07:42.992159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:42.992169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:42.992178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:42.992179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:42.992184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:42.992186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533086977639866:2378], now have 1 active actors on pipe
2025-10-02T08:07:42.992187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:42.992189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533086517189475:3493], now have 1 active actors on pipe
2025-10-02T08:07:42.992190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 103
2025-10-02T08:07:42.992224Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533086517189432:3492]
2025-10-02T08:07:42.992234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:42.992238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.992241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:42.992241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.992271Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:42.992279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:42.992282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:42.992283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:42.992289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:42.992299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:42.992273Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 103
2025-10-02T08:07:42.992314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.992381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:42.992388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:42.992399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:42.992431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 104 partition: 0 MaxSeqNo: 17 sessionId: src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0
2025-10-02T08:07:42.994453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b60fe1-16a05593-f344a2e-de61b328_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:42.996889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0] Write session: try to update token
2025-10-02T08:07:42.996904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:43.009220Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:43.009237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:43.009239Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:43.009245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533086517189432:3492]
2025-10-02T08:07:43.009249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533086517189432:3492]
2025-10-02T08:07:43.009286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:43.009293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.009295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:43.009331Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:43.009344Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:43.009432Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:43.011428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId: src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:43.013892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:43.072067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533090812156786:3491]
2025-10-02T08:07:43.072153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 103, pipe: [1:7556533090812156786:3491]
2025-10-02T08:07:43.139437Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:43.139713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.139731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.139764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812156786:3491], now have 1 active actors on pipe
2025-10-02T08:07:43.139995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533090812156786:3491]
2025-10-02T08:07:43.140085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:43.140094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:43.140471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 104 reason: error at write: Disconnected sessionId: src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0
2025-10-02T08:07:43.140558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:43.140772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 104 sessionId: src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0 is DEAD
2025-10-02T08:07:43.141097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:43.141112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0] Write session will restart in 0.008216s
2025-10-02T08:07:43.141133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0] Write session: Do CDS request
2025-10-02T08:07:43.141158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:43.141319Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:43.150360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.150401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:43.150413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 105
2025-10-02T08:07:43.150613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.150670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:43.150678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:43.150681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:43.150861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:43.151222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 105 sessionId:  describe result for acl check
2025-10-02T08:07:43.151261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:43.151268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:43.151269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:43.151273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533090812157057:3501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:43.151405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:43.151555Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:43.151561Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:43.151569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:43.151609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:43.151635Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533090812157059:3499]
2025-10-02T08:07:43.151851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533090812157057:3501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:43.152107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:43.152248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:43.152276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:43.152469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:43.152499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.152503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.152504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.152504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.152505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.152508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.152514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.152516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.152519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.152520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.152524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.152528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.152532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.152535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.152537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.152540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.152542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.152544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.152546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.152549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.152559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:43.153635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533090812157057:3501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:43.160029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533090812157057:3501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:43.160044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533090812157057:3501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:43.160047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533090812157057:3501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:43.160056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:43.160518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:43.162030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:43.162042Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:43.162044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:43.162047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:43.162052Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 104 [1:7556533090812157059:3499]
2025-10-02T08:07:43.162062Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:43.162077Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:43.162084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.162087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.162089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.162104Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:43.162108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:43.162118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:43.162164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.162169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.162171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:43.162173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:43.162216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:43.162222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.162232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.162246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:43.162265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 104
2025-10-02T08:07:43.162267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812157105:3501], now have 1 active actors on pipe
2025-10-02T08:07:43.162273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533090812157051:3499]
2025-10-02T08:07:43.162276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533090812157051:3499]
2025-10-02T08:07:43.162294Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:43.162305Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:43.162308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:43.162308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533091272607180:2378], now have 1 active actors on pipe
2025-10-02T08:07:43.162315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:43.162327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:43.162330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:43.162336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.162340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.162319Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 104
2025-10-02T08:07:43.162371Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533090812157051:3499]
2025-10-02T08:07:43.162381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:43.162399Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c928a06c-fa58fa64-b9ec124-1325330c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:43.162402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:43.162406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.162409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.162413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:43.162418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.162425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:43.162451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.162494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.162503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.162522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.162552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 105 partition: 0 MaxSeqNo: 17 sessionId: src_id|c928a06c-fa58fa64-b9ec124-1325330c_0
2025-10-02T08:07:43.162896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490925b-af5fcdf4-6a91a563-c707cf8e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c928a06c-fa58fa64-b9ec124-1325330c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:43.165174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c928a06c-fa58fa64-b9ec124-1325330c_0] Write session: try to update token
2025-10-02T08:07:43.165188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c928a06c-fa58fa64-b9ec124-1325330c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:43.177927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId: src_id|c928a06c-fa58fa64-b9ec124-1325330c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:43.180106Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:43.180123Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:43.180126Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:43.180133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533090812157051:3499]
2025-10-02T08:07:43.180138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533090812157051:3499]
2025-10-02T08:07:43.180178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:43.180178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:43.180184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:43.180188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.180205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:43.180349Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:43.180550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:43.239992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533090812157120:3491]
2025-10-02T08:07:43.240068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 104, pipe: [1:7556533090812157120:3491]
2025-10-02T08:07:43.303683Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:43.303981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.303995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.304025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812157120:3491], now have 1 active actors on pipe
2025-10-02T08:07:43.304095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533090812157120:3491]
2025-10-02T08:07:43.304125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:43.304131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:43.304140Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:43.304186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 105 reason: error at write: Disconnected sessionId: src_id|c928a06c-fa58fa64-b9ec124-1325330c_0
2025-10-02T08:07:43.304202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:43.304420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 105 sessionId: src_id|c928a06c-fa58fa64-b9ec124-1325330c_0 is DEAD
2025-10-02T08:07:43.304520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c928a06c-fa58fa64-b9ec124-1325330c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:43.304528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c928a06c-fa58fa64-b9ec124-1325330c_0] Write session will restart in 0.007375s
2025-10-02T08:07:43.304548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c928a06c-fa58fa64-b9ec124-1325330c_0] Write session: Do CDS request
2025-10-02T08:07:43.304553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c928a06c-fa58fa64-b9ec124-1325330c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:43.311508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:43.311897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:43.312031Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:43.312040Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:43.312048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:43.312083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:43.312113Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533090812157384:3505]
2025-10-02T08:07:43.312751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:43.312894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:43.312937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:43.313244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:43.313285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c928a06c-fa58fa64-b9ec124-1325330c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.313295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.313302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.313303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.313304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.313305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.313309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.313316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:43.313317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.313321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 106
2025-10-02T08:07:43.313320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.313324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.313327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.313332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.313339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.313345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.313349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.313353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.313357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.313361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.313365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.313368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.313373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.313390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:43.313492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.313524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:43.313533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:43.313537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:43.313994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 106 sessionId:  describe result for acl check
2025-10-02T08:07:43.314036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:43.314043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:43.314045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:43.314049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533090812157400:3508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:43.314556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533090812157400:3508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:43.316264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533090812157400:3508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:43.321823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533090812157400:3508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:43.321836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533090812157400:3508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:43.321838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533090812157400:3508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:43.321844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:43.322253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:43.323790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:43.323807Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:43.323810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:43.323814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:43.323819Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 105 [1:7556533090812157384:3505]
2025-10-02T08:07:43.323829Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:43.323841Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:43.323844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.323845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.323846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.323858Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:43.323861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:43.323866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:43.323927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.323936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.323938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:43.323940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:43.323981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:43.323982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.323989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.323996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:43.324006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 105
2025-10-02T08:07:43.324008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812157432:3508], now have 1 active actors on pipe
2025-10-02T08:07:43.324013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533090812157378:3505]
2025-10-02T08:07:43.324014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533090812157378:3505]
2025-10-02T08:07:43.324019Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:43.324024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533091272607187:2378], now have 1 active actors on pipe
2025-10-02T08:07:43.324025Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:43.324027Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:43.324029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.324033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.324047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:43.324059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:43.324068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:43.324102Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:43.324111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.324113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.324115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:43.324082Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 105
2025-10-02T08:07:43.324121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.324127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:43.324138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533090812157378:3505]
2025-10-02T08:07:43.324144Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:43.324148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:43.324166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.324213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.324224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.324241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.324270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 106 partition: 0 MaxSeqNo: 17 sessionId: src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0
2025-10-02T08:07:43.324605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c928a06c-fa58fa64-b9ec124-1325330c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:43.326923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0] Write session: try to update token
2025-10-02T08:07:43.326940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:43.340642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId: src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:43.343184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:43.343956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.343976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.343993Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:43.344000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:43.344001Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:43.344007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533090812157378:3505]
2025-10-02T08:07:43.344010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533090812157378:3505]
2025-10-02T08:07:43.344039Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:43.344045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:43.344049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.344051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:43.344051Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:43.344179Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:43.404362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533090812157451:3491]
2025-10-02T08:07:43.404452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 105, pipe: [1:7556533090812157451:3491]
2025-10-02T08:07:43.467361Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:43.467614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:43.467652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:43.467659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812157451:3491], now have 1 active actors on pipe
2025-10-02T08:07:43.467726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:43.467735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:43.467749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 106 reason: error at write: Disconnected sessionId: src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0
2025-10-02T08:07:43.467822Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:43.467873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 106 sessionId: src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0 is DEAD
2025-10-02T08:07:43.468002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533090812157451:3491]
2025-10-02T08:07:43.468040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:43.468051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0] Write session will restart in 0.006317s
2025-10-02T08:07:43.468076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0] Write session: Do CDS request
2025-10-02T08:07:43.468082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:43.475237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.475347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:43.475360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 107
2025-10-02T08:07:43.475368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:43.475508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.475540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:43.475548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:43.475550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:43.475763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:43.475858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 107 sessionId:  describe result for acl check
2025-10-02T08:07:43.475882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:43.475888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:43.475890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:43.475892Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:43.475894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533090812157715:3514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:43.475894Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:43.475900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:43.475928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:43.475978Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533090812157714:3512]
2025-10-02T08:07:43.476255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533090812157715:3514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:43.476384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:43.476483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:43.476507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:43.476687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:43.476713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.476718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.476719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.476719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.476720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.476723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.476729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.476731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.476733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.476734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.476738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.476742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.476745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.476749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.476751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.476754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.476756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.476759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.476761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.476764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.476774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:43.477687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533090812157715:3514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:43.483238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533090812157715:3514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:43.483257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533090812157715:3514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:43.483260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533090812157715:3514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:43.483267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:43.485755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:43.487407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:43.487423Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:43.487425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:43.487429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:43.487434Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 106 [1:7556533090812157714:3512]
2025-10-02T08:07:43.487444Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:43.487458Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:43.487460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.487463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.487464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.487477Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:43.487486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:43.487492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:43.487550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.487557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.487559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:43.487561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:43.487640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:43.487647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.487651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 106
2025-10-02T08:07:43.487656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.487666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:43.487685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812157761:3514], now have 1 active actors on pipe
2025-10-02T08:07:43.487692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533091272607196:2378], now have 1 active actors on pipe
2025-10-02T08:07:43.487696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.487703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.487717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533090812157706:3512]
2025-10-02T08:07:43.487723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533090812157706:3512]
2025-10-02T08:07:43.487730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:43.487738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:43.487740Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:43.487744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:43.487703Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 106
2025-10-02T08:07:43.487758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:43.487765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:43.487777Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:43.487785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.487788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.487789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:43.487796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.487804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:43.487842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533090812157706:3512]
2025-10-02T08:07:43.487852Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:43.487862Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:43.487865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.487944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.487951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.487963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.487995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 107 partition: 0 MaxSeqNo: 17 sessionId: src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0
2025-10-02T08:07:43.488397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc0a3ad-4a453e37-3f68a3cd-9787a756_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:43.490722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0] Write session: try to update token
2025-10-02T08:07:43.490742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:43.499228Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:43.499250Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:43.499260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533090812157706:3512]
2025-10-02T08:07:43.499295Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:43.499310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:43.499533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:43.499775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:43.499962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:43.500187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:43.500379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:43.500427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:43.503555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId: src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:43.506406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:43.506467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.506479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.506505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:43.506525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:43.506574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.506585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.506725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.506783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.506839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.506988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.507039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.507046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.507104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.507157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.507209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.507301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.507344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.507350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.507404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.507455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.507530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.507695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.507779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.507788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.507844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.507896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.507947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.507995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.508250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.508257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.508323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.508373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.508425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.508480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.508522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.508527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.508588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.508651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.508711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.508771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.508896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.508907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.508980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.509049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.509195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.509812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.509863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.509868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.509932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.509989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.510060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.510130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.510181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.510187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.510257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.510313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.510371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.510427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.510525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.510532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.510609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:43.510669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:43.510737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:43.510830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:43.510927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:43.510934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:43.510978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:43.511024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.511044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.511051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:43.511074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:43.511088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:43.511090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:43.511092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:43.511094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:43.511463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:43.511483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:43.511491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:43.511493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:43.511495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:43.511497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:43.512135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:43.512157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:43.512164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:43.512173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:43.512178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:43.512181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:43.512626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:43.512645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:43.512649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:43.512651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:43.512656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:43.513770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:43.513784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:43.513793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392463513
2025-10-02T08:07:43.513966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:43.513976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:43.513980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:43.513982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:43.513985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:43.513990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:43.514474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:43.514491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:43.514498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:43.514503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:43.514508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:43.514510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:43.514921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:43.514944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:43.514950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:43.514953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:43.514957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:43.514959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:43.515363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:43.515379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:43.515386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:43.516429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:43.516439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:43.516443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:43.516445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:43.516452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392463516
2025-10-02T08:07:43.516702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:43.516717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:43.516725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:43.516730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:43.516732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:43.516733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:43.517218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:43.517235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:43.517239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:43.517244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:43.517247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:43.517251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:43.517722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:43.517738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.517821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392463517
2025-10-02T08:07:43.518521Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:43.518541Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:43.518552Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:43.518559Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:43.520075Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:43.520084Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:43.520085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:43.520099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533090812157706:3512]
2025-10-02T08:07:43.520102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533090812157706:3512]
2025-10-02T08:07:43.520128Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:43.520136Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:43.520145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:43.520152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.520154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:43.520277Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:43.568217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533090812157816:3491]
2025-10-02T08:07:43.568330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 106, pipe: [1:7556533090812157816:3491]
2025-10-02T08:07:43.652316Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:43.652619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812157816:3491], now have 1 active actors on pipe
2025-10-02T08:07:43.652718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533090812157816:3491]
2025-10-02T08:07:43.652748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:43.652754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:43.652777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 107 reason: error at write: Disconnected sessionId: src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0
2025-10-02T08:07:43.652844Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:43.652817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:43.652986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 107 sessionId: src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0 is DEAD
2025-10-02T08:07:43.653114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:43.653125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0] Write session will restart in 0.007001s
2025-10-02T08:07:43.653145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0] Write session: Do CDS request
2025-10-02T08:07:43.653151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:43.661236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.661346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:43.661360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 108
2025-10-02T08:07:43.661493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:43.661503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.661529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:43.661539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:43.661543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:43.661788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:43.661912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 108 sessionId:  describe result for acl check
2025-10-02T08:07:43.661946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:43.661952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:43.661953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:43.661958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533090812158202:3532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:43.661972Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:43.661976Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:43.661983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:43.662022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:43.662048Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533090812158203:3530]
2025-10-02T08:07:43.662381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533090812158202:3532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:43.662465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:43.662645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:43.662674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:43.662868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:43.662896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.662900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.662901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.662901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.662902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.662905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.662911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.662913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.662915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.662916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.662920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.662924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.662932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.662940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.662947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.662951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.662954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.662959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.662965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.662969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.662984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:43.664117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533090812158202:3532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:43.670103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533090812158202:3532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:43.670119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533090812158202:3532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:43.670122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533090812158202:3532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:43.670130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:43.670490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:43.672140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:43.672153Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:43.672155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:43.672158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:43.672163Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 107 [1:7556533090812158203:3530]
2025-10-02T08:07:43.672171Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:43.672183Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:43.672185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.672187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.672199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.672211Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:43.672215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:43.672219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:43.672264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.672270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.672272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:43.672274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:43.672317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:43.672323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.672331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.672338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:43.672353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812158245:3532], now have 1 active actors on pipe
2025-10-02T08:07:43.672360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533090812158194:3530]
2025-10-02T08:07:43.672362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533090812158194:3530]
2025-10-02T08:07:43.672368Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:43.672373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 107
2025-10-02T08:07:43.672378Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:43.672379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:43.672381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:43.672387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:43.672389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:43.672393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533091272607225:2378], now have 1 active actors on pipe
2025-10-02T08:07:43.672396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.672399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.672429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533090812158194:3530]
2025-10-02T08:07:43.672435Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:43.672445Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:43.672449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.672451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:43.672451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.672452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:43.672458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.672464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:43.672430Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 107
2025-10-02T08:07:43.672488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.672551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.672563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.672586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.672633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 108 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0
2025-10-02T08:07:43.672980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afa7758b-5d3f6fc6-f1484e56-ec964cad_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:43.675322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0] Write session: try to update token
2025-10-02T08:07:43.675337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:43.688263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId: src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:43.688712Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:43.688726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:43.688728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:43.688734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533090812158194:3530]
2025-10-02T08:07:43.688737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533090812158194:3530]
2025-10-02T08:07:43.688768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:43.688777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.688778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:43.688778Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:43.688783Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:43.688927Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:43.690601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:43.753029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533090812158262:3491]
2025-10-02T08:07:43.753182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 107, pipe: [1:7556533090812158262:3491]
2025-10-02T08:07:43.828115Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:43.828640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.828657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.828694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812158262:3491], now have 1 active actors on pipe
2025-10-02T08:07:43.828844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533090812158262:3491]
2025-10-02T08:07:43.828882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:43.828885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:43.828967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 108 reason: error at write: Disconnected sessionId: src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0
2025-10-02T08:07:43.829060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:43.829531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 108 sessionId: src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0 is DEAD
2025-10-02T08:07:43.829692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:43.829704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0] Write session will restart in 0.009626s
2025-10-02T08:07:43.829723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0] Write session: Do CDS request
2025-10-02T08:07:43.829733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:43.829917Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:43.839539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:43.839886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:43.840028Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:43.840037Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:43.840046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:43.840086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:43.840117Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533090812158638:3537]
2025-10-02T08:07:43.840233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.840365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:43.840376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 109
2025-10-02T08:07:43.840530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:43.840563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:43.840572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:43.840574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:43.840629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:43.840791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:43.840850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:43.840931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 109 sessionId:  describe result for acl check
2025-10-02T08:07:43.840953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:43.840954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:43.840955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:43.840960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533090812158649:3539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:43.841067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:43.841098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.841099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.841100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.841101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.841102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.841107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.841114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.841116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.841118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.841120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.841124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.841128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:43.841131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.841136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:43.841140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.841144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:43.841148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.841154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.841158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.841163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.841181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:43.841438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533090812158649:3539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:43.843761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533090812158649:3539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:43.848543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533090812158649:3539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:43.848559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533090812158649:3539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:43.848563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533090812158649:3539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:43.848572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:43.849168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:43.850721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:43.850733Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:43.850734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:43.850737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:43.850742Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 108 [1:7556533090812158638:3537]
2025-10-02T08:07:43.850750Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:43.850764Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:43.850766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.850768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.850770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.850782Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:43.850785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:43.850790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:43.850847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.850852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.850854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:43.850855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:43.850902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:43.850907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.850916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:43.850931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:43.850954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812158685:3539], now have 1 active actors on pipe
2025-10-02T08:07:43.850963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533090812158631:3537]
2025-10-02T08:07:43.850964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533090812158631:3537]
2025-10-02T08:07:43.850970Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:43.850978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533091272607234:2378], now have 1 active actors on pipe
2025-10-02T08:07:43.850979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 108
2025-10-02T08:07:43.850985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:43.850997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:43.851002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:43.851004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:43.851005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:43.851010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.851013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.851023Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 108
2025-10-02T08:07:43.851042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533090812158631:3537]
2025-10-02T08:07:43.851050Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:43.851051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:43.851060Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:43.851063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:43.851065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:43.851066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:43.851072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:43.851078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:43.851115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.851179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:43.851191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:43.851214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:43.851248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 109 partition: 0 MaxSeqNo: 17 sessionId: src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0
2025-10-02T08:07:43.851591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6957e8e-5b6dcf2e-db9e848b-e660abbc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:43.861879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0] Write session: try to update token
2025-10-02T08:07:43.861903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:43.878699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId: src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:43.879089Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:43.879104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:43.879107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:43.879114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533090812158631:3537]
2025-10-02T08:07:43.879122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533090812158631:3537]
2025-10-02T08:07:43.879173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:43.879188Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:43.880162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:43.880181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:43.880183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:43.880343Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:43.883334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:43.929147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533090812158699:3491]
2025-10-02T08:07:43.929212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 108, pipe: [1:7556533090812158699:3491]
2025-10-02T08:07:44.017099Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:44.017606Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:44.017616Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:44.017626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533090812158631:3537]
2025-10-02T08:07:44.017672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.017670Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:44.017680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.017695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533090812158699:3491], now have 1 active actors on pipe
2025-10-02T08:07:44.017786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:44.017800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:44.017858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 109 reason: error at write: Disconnected sessionId: src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0
2025-10-02T08:07:44.017866Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:44.017910Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:44.018037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 109 sessionId: src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0 is DEAD
2025-10-02T08:07:44.018130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533090812158699:3491]
2025-10-02T08:07:44.018454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:44.018467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0] Write session will restart in 0.007339s
2025-10-02T08:07:44.018486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0] Write session: Do CDS request
2025-10-02T08:07:44.018492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:44.027356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.027465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:44.027480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 110
2025-10-02T08:07:44.027631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.027661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:44.027666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:44.027669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:44.028066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 110 sessionId:  describe result for acl check
2025-10-02T08:07:44.028078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:44.028100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:44.028106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:44.028107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:44.028111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533095107126370:3545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:44.028450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:44.028556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533095107126370:3545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:44.028626Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:44.028635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:44.028644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:44.028689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:44.028722Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533095107126376:3543]
2025-10-02T08:07:44.029368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:44.029508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:44.029542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:44.029828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:44.029865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.029871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.029872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.029873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.029874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.029878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.029887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.029891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.029894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.029897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.029902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.029909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.029919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.029934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.029942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.029947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.029952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.029956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.029960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.029965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.029987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:44.030366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533095107126370:3545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:44.035291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533095107126370:3545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:44.035304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533095107126370:3545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:44.035306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533095107126370:3545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:44.035312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:44.037392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:44.039008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:44.039024Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:44.039026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:44.039029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:44.039035Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 109 [1:7556533095107126376:3543]
2025-10-02T08:07:44.039045Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:44.039059Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:44.039066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.039068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.039070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.039080Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:44.039085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:44.039090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:44.039142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.039149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.039152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:44.039155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:44.039213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:44.039220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.039233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.039250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:44.039270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533095107126368:3543]
2025-10-02T08:07:44.039276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533095107126368:3543]
2025-10-02T08:07:44.039284Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:44.039293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:44.039300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533095567574536:2378], now have 1 active actors on pipe
2025-10-02T08:07:44.039300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 109
2025-10-02T08:07:44.039302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:44.039303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107126421:3545], now have 1 active actors on pipe
2025-10-02T08:07:44.039310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:44.039323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:44.039325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:44.039356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.039352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 109
2025-10-02T08:07:44.039366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.039378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533095107126368:3543]
2025-10-02T08:07:44.039381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:44.039389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:44.039403Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79233490-709e34a4-90249641-6c8257ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:44.039413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.039416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.039418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:44.039433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.039447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:44.039472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.039524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.039531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.039543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.039572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 110 partition: 0 MaxSeqNo: 17 sessionId: src_id|79233490-709e34a4-90249641-6c8257ea_0
2025-10-02T08:07:44.039937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b5e9d5-fbcc23a-5451de74-4aa12048_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79233490-709e34a4-90249641-6c8257ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:44.042377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79233490-709e34a4-90249641-6c8257ea_0] Write session: try to update token
2025-10-02T08:07:44.042392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79233490-709e34a4-90249641-6c8257ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:44.055951Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:44.055969Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:44.055972Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:44.055980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533095107126368:3543]
2025-10-02T08:07:44.055988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533095107126368:3543]
2025-10-02T08:07:44.056031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:44.056041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.056043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:44.056044Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:44.056051Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:44.056201Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:44.056446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId: src_id|79233490-709e34a4-90249641-6c8257ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:44.059287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:44.118095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533095107126446:3491]
2025-10-02T08:07:44.118176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 109, pipe: [1:7556533095107126446:3491]
2025-10-02T08:07:44.187399Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:44.187647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.187657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.187688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107126446:3491], now have 1 active actors on pipe
2025-10-02T08:07:44.187800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533095107126446:3491]
2025-10-02T08:07:44.187829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:44.187831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:44.187843Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:44.187897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 110 reason: error at write: Disconnected sessionId: src_id|79233490-709e34a4-90249641-6c8257ea_0
2025-10-02T08:07:44.187892Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:44.188115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 110 sessionId: src_id|79233490-709e34a4-90249641-6c8257ea_0 is DEAD
2025-10-02T08:07:44.188511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79233490-709e34a4-90249641-6c8257ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:44.188526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79233490-709e34a4-90249641-6c8257ea_0] Write session will restart in 0.006901s
2025-10-02T08:07:44.188551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79233490-709e34a4-90249641-6c8257ea_0] Write session: Do CDS request
2025-10-02T08:07:44.188558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79233490-709e34a4-90249641-6c8257ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:44.196168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:44.196435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79233490-709e34a4-90249641-6c8257ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.196532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:44.196544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 111
2025-10-02T08:07:44.196595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:44.196731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.196741Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:44.196744Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:44.196752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:44.196759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:44.196764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:44.196767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:44.196794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:44.196847Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533095107126826:3550]
2025-10-02T08:07:44.197157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 111 sessionId:  describe result for acl check
2025-10-02T08:07:44.197185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:44.197191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:44.197193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:44.197198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533095107126830:3552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:44.197471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:44.197605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:44.197607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533095107126830:3552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:44.197638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:44.197925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:44.197965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.197970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.197971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.197972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.197974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.197978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.197987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.197991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.197995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.197998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.198003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.198009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.198019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.198023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.198028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.198032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.198041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.198046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.198050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.198055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.198078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:44.198975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533095107126830:3552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:44.204018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533095107126830:3552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:44.204032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533095107126830:3552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:44.204035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533095107126830:3552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:44.204044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:44.207772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:44.209420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:44.209432Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:44.209433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:44.209436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:44.209440Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 110 [1:7556533095107126826:3550]
2025-10-02T08:07:44.209448Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:44.209460Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:44.209461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.209464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.209465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.209476Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:44.209479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:44.209483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:44.209523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.209529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.209531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:44.209533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:44.209584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:44.209592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.209603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.209616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:44.209638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107126874:3552], now have 1 active actors on pipe
2025-10-02T08:07:44.209638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 110
2025-10-02T08:07:44.209645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533095567574555:2378], now have 1 active actors on pipe
2025-10-02T08:07:44.209651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533095107126819:3550]
2025-10-02T08:07:44.209652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533095107126819:3550]
2025-10-02T08:07:44.209661Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:44.209671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.209673Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:44.209675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:44.209678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.209694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:44.209710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:44.209714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:44.209708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 110
2025-10-02T08:07:44.209752Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:44.209763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.209766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.209768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:44.209775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.209791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:44.209800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533095107126819:3550]
2025-10-02T08:07:44.209807Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:44.209817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:44.209829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.209873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.209880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.209894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.209931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 111 partition: 0 MaxSeqNo: 17 sessionId: src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0
2025-10-02T08:07:44.210300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79233490-709e34a4-90249641-6c8257ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:44.212848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0] Write session: try to update token
2025-10-02T08:07:44.212868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:44.227467Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:44.227486Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:44.227488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:44.227495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533095107126819:3550]
2025-10-02T08:07:44.227501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533095107126819:3550]
2025-10-02T08:07:44.227535Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:44.227539Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:44.227540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:44.227548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.227550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:44.227692Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:44.230475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId: src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:44.233139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:44.288074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533095107126887:3491]
2025-10-02T08:07:44.288154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 110, pipe: [1:7556533095107126887:3491]
2025-10-02T08:07:44.352706Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:44.352952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.352962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.352994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107126887:3491], now have 1 active actors on pipe
2025-10-02T08:07:44.353095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:44.353105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:44.353178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 111 reason: error at write: Disconnected sessionId: src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0
2025-10-02T08:07:44.353182Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:44.353208Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:44.353345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 111 sessionId: src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0 is DEAD
2025-10-02T08:07:44.353410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533095107126887:3491]
2025-10-02T08:07:44.353543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:44.353558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0] Write session will restart in 0.009996s
2025-10-02T08:07:44.353588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0] Write session: Do CDS request
2025-10-02T08:07:44.353596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:44.361985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:44.362419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:44.362546Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:44.362553Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:44.362559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:44.362587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:44.362612Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533095107127274:3557]
2025-10-02T08:07:44.363042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:44.363209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:44.363232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:44.363438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:44.363469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.363470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.363471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.363471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.363472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.363474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.363480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.363482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.363484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.363486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.363490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.363494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.363497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.363499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.363501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.363504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.363506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.363508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.363510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.363513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.363522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:44.364385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.364475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:44.364495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 112
2025-10-02T08:07:44.364617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.364646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:44.364651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:44.364655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:44.365151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 112 sessionId:  describe result for acl check
2025-10-02T08:07:44.365208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:44.365218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:44.365220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:44.365228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533095107127291:3559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:44.365863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533095107127291:3559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:44.368090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533095107127291:3559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:44.370858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533095107127291:3559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:44.370872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533095107127291:3559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:44.370875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533095107127291:3559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:44.370884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:44.371130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:44.372971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:44.372984Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:44.372986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:44.372989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:44.372997Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 111 [1:7556533095107127274:3557]
2025-10-02T08:07:44.373006Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:44.373019Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:44.373021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.373023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.373024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.373040Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:44.373044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:44.373050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:44.373101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.373108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.373111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:44.373113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:44.373177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:44.373186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.373199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.373210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:44.373232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107127323:3559], now have 1 active actors on pipe
2025-10-02T08:07:44.373233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 111
2025-10-02T08:07:44.373246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533095107127268:3557]
2025-10-02T08:07:44.373247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533095107127268:3557]
2025-10-02T08:07:44.373263Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:44.373278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533095567574564:2378], now have 1 active actors on pipe
2025-10-02T08:07:44.373280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:44.373284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:44.373290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:44.373304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:44.373310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:44.373318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.373326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.373372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533095107127268:3557]
2025-10-02T08:07:44.373379Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:44.373392Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:44.373396Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b475452-89806742-10978bd1-4b2ac69e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:44.373404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.373409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.373411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:44.373420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.373434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:44.373473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.373538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.373545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.373521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 111
2025-10-02T08:07:44.373567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.373603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 112 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b475452-89806742-10978bd1-4b2ac69e_0
2025-10-02T08:07:44.373958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5934ccbe-f11bcc1e-a4deeeff-5f046f6e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b475452-89806742-10978bd1-4b2ac69e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:44.376412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b475452-89806742-10978bd1-4b2ac69e_0] Write session: try to update token
2025-10-02T08:07:44.376428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b475452-89806742-10978bd1-4b2ac69e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:44.389888Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:44.389909Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:44.389912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:44.389922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533095107127268:3557]
2025-10-02T08:07:44.389931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533095107127268:3557]
2025-10-02T08:07:44.389978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:44.389985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:44.389992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.389995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:44.389997Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:44.390139Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:44.391056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId: src_id|6b475452-89806742-10978bd1-4b2ac69e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:44.393766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:44.453457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533095107127343:3491]
2025-10-02T08:07:44.453550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 111, pipe: [1:7556533095107127343:3491]
2025-10-02T08:07:44.522920Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:44.523198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.523213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.523256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107127343:3491], now have 1 active actors on pipe
2025-10-02T08:07:44.523327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533095107127343:3491]
2025-10-02T08:07:44.523345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:44.523350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:44.523392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 112 reason: error at write: Disconnected sessionId: src_id|6b475452-89806742-10978bd1-4b2ac69e_0
2025-10-02T08:07:44.523461Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:44.523549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 112 sessionId: src_id|6b475452-89806742-10978bd1-4b2ac69e_0 is DEAD
2025-10-02T08:07:44.523515Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:44.523694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b475452-89806742-10978bd1-4b2ac69e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:44.523701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b475452-89806742-10978bd1-4b2ac69e_0] Write session will restart in 0.007487s
2025-10-02T08:07:44.523721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b475452-89806742-10978bd1-4b2ac69e_0] Write session: Do CDS request
2025-10-02T08:07:44.523726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b475452-89806742-10978bd1-4b2ac69e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:44.531888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:44.532311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:44.532367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b475452-89806742-10978bd1-4b2ac69e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.532441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:44.532454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 113
2025-10-02T08:07:44.532470Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:44.532481Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:44.532489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:44.532524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:44.532559Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533095107127726:3565]
2025-10-02T08:07:44.532618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.532643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:44.532646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:44.532649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:44.532962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 113 sessionId:  describe result for acl check
2025-10-02T08:07:44.532987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:44.532988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:44.532989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:44.532993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533095107127731:3567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:44.533045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:44.533187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:44.533228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:44.533393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533095107127731:3567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:44.533456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:44.533488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.533493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.533494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.533495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.533495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.533498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.533504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.533507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.533509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.533511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.533514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.533519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.533524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.533527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.533529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.533532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.533534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.533536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.533539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.533541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.533550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:44.534968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533095107127731:3567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:44.540534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533095107127731:3567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:44.540549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533095107127731:3567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:44.540552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533095107127731:3567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:44.540564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:44.540943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:44.542657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:44.542676Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:44.542678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:44.542681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:44.542687Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 112 [1:7556533095107127726:3565]
2025-10-02T08:07:44.542696Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:44.542711Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:44.542713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.542716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.542718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.542731Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:44.542734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:44.542739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:44.542783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.542790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.542792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:44.542794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:44.542878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:44.542886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.542895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.542901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:44.542901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 112
2025-10-02T08:07:44.542915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107127774:3567], now have 1 active actors on pipe
2025-10-02T08:07:44.542923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533095567574571:2378], now have 1 active actors on pipe
2025-10-02T08:07:44.542927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.542931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.542962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 112
2025-10-02T08:07:44.543490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b475452-89806742-10978bd1-4b2ac69e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:44.542944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533095107127720:3565]
2025-10-02T08:07:44.542951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533095107127720:3565]
2025-10-02T08:07:44.542960Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:44.542969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:44.542974Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:44.542976Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:44.542977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:44.542979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:44.542990Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:44.542995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.542997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.542999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:44.543005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.543012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:44.543045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533095107127720:3565]
2025-10-02T08:07:44.543053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:44.543064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:44.543066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.543108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.543110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.543120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.543152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 113 partition: 0 MaxSeqNo: 17 sessionId: src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0
2025-10-02T08:07:44.545978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0] Write session: try to update token
2025-10-02T08:07:44.545993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:44.552886Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:44.552903Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:44.552913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533095107127720:3565]
2025-10-02T08:07:44.552955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:44.552962Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:44.553138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:44.553340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:44.553492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:44.553639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:44.553841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:44.553877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:44.561026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId: src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:44.563901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:44.563999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.564017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.564052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:44.564067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:44.564132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.564139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.564318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.564423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.564493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.564559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.564820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.564833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.564910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.565007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.565072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.565136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.565189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.565196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.565270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.565332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.565400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.565461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.565512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.565519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.565582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.565643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.565705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.565765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.565806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.565813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.565871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.565929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.565992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.566061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.566172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.566180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.566247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.566311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.566382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.566451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.566505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.566512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.566578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.566640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.566707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.566769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.566822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.566829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.566895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.566957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.567019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.567079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.567125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.567134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.567196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.567256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.567324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.567389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.567436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.567442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.567506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:44.567571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:44.567634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:44.567699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:44.567798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:44.567805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:44.567860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:44.567917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.567938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.567944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:44.567972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:44.567987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:44.567993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:44.567996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:44.567999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:44.568428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:44.568459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:44.568469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:44.568472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:44.568475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:44.568478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:44.569136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:44.569165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:44.569171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:44.569178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:44.569186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:44.569189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:44.569680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:44.569701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:44.569706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:44.569712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:44.569715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:44.571617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:44.571632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:44.571653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392464571
2025-10-02T08:07:44.571746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:44.571755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:44.571758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:44.571760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:44.571762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:44.571764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:44.572206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:44.572225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:44.572232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:44.572236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:44.572238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:44.572242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:44.572655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:44.572671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:44.572676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:44.572678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:44.572680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:44.572684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:44.573183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:44.573201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:44.573205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:44.574217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:44.574232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:44.574235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:44.574238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:44.574243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392464574
2025-10-02T08:07:44.574500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:44.574514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:44.574518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:44.574520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:44.574522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:44.574525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:44.574899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:44.574917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:44.574920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:44.574923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:44.574926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:44.574927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:44.575333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:44.575347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.575427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392464575
2025-10-02T08:07:44.578776Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:44.578799Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:44.578803Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:44.578808Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:44.578817Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:44.578823Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:44.578824Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:44.578831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533095107127720:3565]
2025-10-02T08:07:44.578833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533095107127720:3565]
2025-10-02T08:07:44.578883Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:44.578891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:44.578894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.578895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:44.578897Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:44.579005Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:44.623436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533095107127818:3491]
2025-10-02T08:07:44.623523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 112, pipe: [1:7556533095107127818:3491]
2025-10-02T08:07:44.703287Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:44.703601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107127818:3491], now have 1 active actors on pipe
2025-10-02T08:07:44.703709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533095107127818:3491]
2025-10-02T08:07:44.703725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:44.703729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:44.703750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 113 reason: error at write: Disconnected sessionId: src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0
2025-10-02T08:07:44.703816Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:44.703915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 113 sessionId: src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0 is DEAD
2025-10-02T08:07:44.703884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:44.704082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:44.704093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0] Write session will restart in 0.008945s
2025-10-02T08:07:44.704113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0] Write session: Do CDS request
2025-10-02T08:07:44.704117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:44.707047Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [62b3af72fee7ed35] Result# TEvPutResult {Id# [72075186224037892:112:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:44.707097Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:112:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:44.707158Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:112:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:44.713263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:44.713639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:44.713765Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:44.713772Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:44.713779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:44.713809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:44.713836Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533095107128216:3583]
2025-10-02T08:07:44.714243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:44.714332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.714389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:44.714419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:44.714418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:44.714424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 114
2025-10-02T08:07:44.714596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.714624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:44.714633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:44.714636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:44.714636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:44.714661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.714666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.714667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.714668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.714668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.714672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.714678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.714680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.714682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.714684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.714688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.714692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.714697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.714701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.714705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.714709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.714713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.714717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.714725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.714729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.714750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:44.714951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 114 sessionId:  describe result for acl check
2025-10-02T08:07:44.714976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:44.714980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:44.714981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:44.714984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533095107128232:3585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:44.715305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533095107128232:3585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:44.717240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533095107128232:3585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:44.721564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533095107128232:3585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:44.721579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533095107128232:3585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:44.721582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533095107128232:3585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:44.721590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:44.722118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:44.723537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:44.723551Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:44.723553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:44.723555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:44.723560Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 113 [1:7556533095107128216:3583]
2025-10-02T08:07:44.723568Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:44.723580Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:44.723582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.723584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.723585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.723597Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:44.723600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:44.723604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:44.723649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.723655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.723657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:44.723659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:44.723701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:44.723706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.723714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.723721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:44.723733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107128261:3585], now have 1 active actors on pipe
2025-10-02T08:07:44.723741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533095107128210:3583]
2025-10-02T08:07:44.723743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533095107128210:3583]
2025-10-02T08:07:44.723748Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:44.723756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533095567574599:2378], now have 1 active actors on pipe
2025-10-02T08:07:44.723759Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:44.723762Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:44.723761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 113
2025-10-02T08:07:44.723765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:44.723772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:44.723774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:44.723778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.723781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.723811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533095107128210:3583]
2025-10-02T08:07:44.723820Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:44.723837Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:44.723841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:44.723846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.723849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.723851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:44.723858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.723822Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 113
2025-10-02T08:07:44.723870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:44.723908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.723947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.723953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.723965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.723998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 114 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0
2025-10-02T08:07:44.724352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b4b2aec-a8f72544-88cad208-cdaa0dcc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:44.726744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0] Write session: try to update token
2025-10-02T08:07:44.726761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:44.740790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId: src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:44.740955Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:44.740973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:44.740975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:44.740985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533095107128210:3583]
2025-10-02T08:07:44.740989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533095107128210:3583]
2025-10-02T08:07:44.741032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:44.741036Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:44.741042Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:44.741042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.741044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:44.741292Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:44.743317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:44.803658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533095107128277:3491]
2025-10-02T08:07:44.803792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 113, pipe: [1:7556533095107128277:3491]
2025-10-02T08:07:44.866833Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:44.867271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.867281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.867314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107128277:3491], now have 1 active actors on pipe
2025-10-02T08:07:44.867424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533095107128277:3491]
2025-10-02T08:07:44.867445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:44.867447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:44.867494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 114 reason: error at write: Disconnected sessionId: src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0
2025-10-02T08:07:44.867519Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:44.867555Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:44.867651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 114 sessionId: src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0 is DEAD
2025-10-02T08:07:44.867791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:44.867802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0] Write session will restart in 0.008735s
2025-10-02T08:07:44.867824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0] Write session: Do CDS request
2025-10-02T08:07:44.867830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:44.877223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.877396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:44.877411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 115
2025-10-02T08:07:44.877551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:44.877580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:44.877591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:44.877594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:44.877943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 115 sessionId:  describe result for acl check
2025-10-02T08:07:44.877970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:44.877976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:44.877978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:44.877983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533095107128652:3591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:44.878344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533095107128652:3591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:44.878518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:44.878861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:44.878973Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:44.878980Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:44.878987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:44.879013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:44.879040Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533095107128675:3590]
2025-10-02T08:07:44.879493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:44.879614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:44.879647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:44.879875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:44.879913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.879919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.879920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.879921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.879922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.879926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.879935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.879939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.879942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.879946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.879950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.879956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:44.879961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.879966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:44.879969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.879971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533095107128652:3591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:44.879974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:44.879978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.879982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.879986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.879991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.880007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:44.885281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533095107128652:3591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:44.885294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533095107128652:3591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:44.885297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533095107128652:3591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:44.885303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:44.887434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:44.888890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:44.888901Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:44.888902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:44.888906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:44.888910Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 114 [1:7556533095107128675:3590]
2025-10-02T08:07:44.888918Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:44.888931Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:44.888932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.888934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.888936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.888946Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:44.888949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:44.888954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:44.888996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.889003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.889005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:44.889007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:44.889067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:44.889074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.889086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:44.889098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:44.889105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 114
2025-10-02T08:07:44.889117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107128713:3591], now have 1 active actors on pipe
2025-10-02T08:07:44.889124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533095567574608:2378], now have 1 active actors on pipe
2025-10-02T08:07:44.889128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.889132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.889147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533095107128664:3590]
2025-10-02T08:07:44.889152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533095107128664:3590]
2025-10-02T08:07:44.889161Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:44.889175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:44.889181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:44.889184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:44.889186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:44.889188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:44.889198Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:44.889182Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 114
2025-10-02T08:07:44.889203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:44.889209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:44.889211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:44.889217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:44.889223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:44.889246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533095107128664:3590]
2025-10-02T08:07:44.889254Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:44.889266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.889271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:44.889438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:44.889446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:44.889461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:44.889491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 115 partition: 0 MaxSeqNo: 17 sessionId: src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0
2025-10-02T08:07:44.889809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c63e524-a884713e-97f03de9-ef61ebf2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:44.892634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0] Write session: try to update token
2025-10-02T08:07:44.892646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:44.906093Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:44.906115Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:44.906117Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:44.906126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533095107128664:3590]
2025-10-02T08:07:44.906130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533095107128664:3590]
2025-10-02T08:07:44.906171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:44.906174Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:44.906177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:44.906179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:44.906179Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:44.906329Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:44.907406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId: src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:44.910248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:44.967499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533095107128726:3491]
2025-10-02T08:07:44.967640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 114, pipe: [1:7556533095107128726:3491]
2025-10-02T08:07:45.034267Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:45.034541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.034552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.034583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533095107128726:3491], now have 1 active actors on pipe
2025-10-02T08:07:45.034724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:45.034729Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:45.034733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:45.034790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 115 reason: error at write: Disconnected sessionId: src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0
2025-10-02T08:07:45.034912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533095107128726:3491]
2025-10-02T08:07:45.034918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 115 sessionId: src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0 is DEAD
2025-10-02T08:07:45.034985Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:45.035041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:45.035050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0] Write session will restart in 0.008596s
2025-10-02T08:07:45.035069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0] Write session: Do CDS request
2025-10-02T08:07:45.035074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:45.043581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:45.043923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:45.044052Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:45.044061Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:45.044070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:45.044109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:45.044143Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533099402096411:3596]
2025-10-02T08:07:45.044334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.044369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:45.044379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 116
2025-10-02T08:07:45.044538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.044559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:45.044566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:45.044577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:45.044622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:45.044738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:45.044770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:45.044901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 116 sessionId:  describe result for acl check
2025-10-02T08:07:45.044927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:45.044932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:45.044934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:45.044938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533099402096422:3598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:45.044994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:45.045024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.045029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.045029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.045030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.045030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.045033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.045039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.045041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.045043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.045045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.045049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.045053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.045060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.045063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.045065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.045072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.045074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.045076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.045079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.045081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.045091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:45.045294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533099402096422:3598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:45.047197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533099402096422:3598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:45.052235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533099402096422:3598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:45.052254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533099402096422:3598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:45.052258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533099402096422:3598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:45.052266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:45.052745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:45.054467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:45.054477Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:45.054479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:45.054482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:45.054486Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 115 [1:7556533099402096411:3596]
2025-10-02T08:07:45.054497Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:45.054509Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:45.054510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.054512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.054514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.054525Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:45.054528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:45.054532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:45.054576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.054584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.054586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:45.054588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:45.054634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:45.054642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.054653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.054663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:45.054681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402096459:3598], now have 1 active actors on pipe
2025-10-02T08:07:45.054693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533099402096405:3596]
2025-10-02T08:07:45.054695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533099402096405:3596]
2025-10-02T08:07:45.054697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 115
2025-10-02T08:07:45.054703Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:45.054712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533099862541922:2378], now have 1 active actors on pipe
2025-10-02T08:07:45.054712Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:45.054714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:45.054718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:45.054734Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 115
2025-10-02T08:07:45.054731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:45.054760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:45.054766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.054770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.054814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533099402096405:3596]
2025-10-02T08:07:45.054824Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:45.054833Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:45.054839Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:45.054846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.054849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.054851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:45.054859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.054872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:45.054909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.054972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.054983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.055007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.055045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 116 partition: 0 MaxSeqNo: 17 sessionId: src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0
2025-10-02T08:07:45.055407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6238d55b-853a83dc-5ac1f3be-1e696a1b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:45.058370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0] Write session: try to update token
2025-10-02T08:07:45.058393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:45.065372Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:45.065391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:45.065400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533099402096405:3596]
2025-10-02T08:07:45.065449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:45.065454Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:45.065633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:45.065790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:45.065988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:45.066139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:45.066653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:45.066695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:45.077043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId: src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:45.080440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:45.080510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.080524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.080566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:45.080591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:45.080681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.080700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.080939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.081030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.081117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.081215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.081278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.081289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.081380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.081465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.081545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.081629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.081688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.081697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.081781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.081895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.081981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.082063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.082130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.082139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.082333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.082448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.082536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.082620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.082684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.082695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.082780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.082864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.082950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.083027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.083087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.083096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.083179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.083257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.083341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.083432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.083493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.083502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.083591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.083688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.083777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.083854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.083910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.083919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.084012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.084087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.084170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.084264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.084319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.084328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.084411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.084492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.084575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.084654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.084781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.084789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.084879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.084959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.085037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.085116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.085173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.085180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.085256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:45.085331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.085356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.085364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:45.085397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:45.085422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:45.085430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:45.085433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:45.085436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:45.086053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:45.086086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:45.086093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:45.086097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:45.086100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:45.086104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:45.086873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:45.086901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:45.086910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:45.086913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:45.086917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:45.086921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:45.087626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:45.087653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:45.087661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:45.087666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:45.087671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:45.090565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:45.090592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:45.090606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392465090
2025-10-02T08:07:45.090821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:45.090839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:45.090847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:45.090857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:45.090865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:45.090871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:45.091711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:45.091737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:45.091745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:45.091748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:45.091752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:45.091757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:45.092395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:45.092422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:45.092438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:45.092442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:45.092449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:45.092455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:45.093105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:45.093131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:45.093137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:45.094613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:45.094634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:45.094641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:45.094648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:45.094661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392465094
2025-10-02T08:07:45.095111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:45.095133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:45.095140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:45.095144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:45.095148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:45.095152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:45.095758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:45.095784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:45.095790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:45.095799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:45.095802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:45.095807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:45.096415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:45.096437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.096559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392465096
2025-10-02T08:07:45.099874Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:45.099915Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:45.099924Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:45.099933Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:45.099957Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:45.099965Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:45.099968Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:45.099980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533099402096405:3596]
2025-10-02T08:07:45.099991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533099402096405:3596]
2025-10-02T08:07:45.100057Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:45.100070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:45.100083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:45.100089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.100100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:45.100295Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:45.134907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533099402096486:3491]
2025-10-02T08:07:45.135005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 115, pipe: [1:7556533099402096486:3491]
2025-10-02T08:07:45.232434Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:45.232749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402096486:3491], now have 1 active actors on pipe
2025-10-02T08:07:45.232895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533099402096486:3491]
2025-10-02T08:07:45.232925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:45.232931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:45.232957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 116 reason: error at write: Disconnected sessionId: src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0
2025-10-02T08:07:45.232997Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:45.233035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:45.233168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 116 sessionId: src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0 is DEAD
2025-10-02T08:07:45.233271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:45.233280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0] Write session will restart in 0.006044s
2025-10-02T08:07:45.233303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0] Write session: Do CDS request
2025-10-02T08:07:45.233310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:45.237233Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [9c7435a3bdf55771] Result# TEvPutResult {Id# [72075186224037892:115:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:45.237252Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:115:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:45.237334Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:115:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:45.240422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.240448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:45.240462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 117
2025-10-02T08:07:45.240677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.240714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:45.240723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:45.240726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:45.241147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 117 sessionId:  describe result for acl check
2025-10-02T08:07:45.241186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:45.241192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:45.241193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:45.241198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533099402096696:3604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:45.241722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533099402096696:3604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:45.244250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533099402096696:3604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:45.246546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:45.246694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533099402096696:3604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:45.246711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533099402096696:3604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:45.246714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533099402096696:3604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:45.246721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:45.247068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:45.247199Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:45.247207Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:45.247217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:45.247246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:45.247273Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533099402096919:3603]
2025-10-02T08:07:45.247684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:45.247816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:45.247847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:45.248051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:45.248079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.248083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.248084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.248084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.248085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.248088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.248094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.248096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.248098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.248100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.248104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.248108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.248111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.248118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.248120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.248122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.248125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.248128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.248130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.248132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.248142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:45.256089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:45.257822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:45.257845Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:45.257848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:45.257851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:45.257858Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 116 [1:7556533099402096919:3603]
2025-10-02T08:07:45.257870Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:45.257888Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:45.257891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.257894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.257896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.257911Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:45.257917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:45.257923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:45.257988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.257998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.258001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:45.258003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:45.258124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:45.258132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.258142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 116
2025-10-02T08:07:45.258145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.258154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:45.258178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402096915:3604], now have 1 active actors on pipe
2025-10-02T08:07:45.258185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533099862541928:2378], now have 1 active actors on pipe
2025-10-02T08:07:45.258190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.258194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.258213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533099402096907:3603]
2025-10-02T08:07:45.258219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533099402096907:3603]
2025-10-02T08:07:45.258234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:45.258239Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:45.258241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:45.258250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:45.258263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:45.258270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:45.258254Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 116
2025-10-02T08:07:45.258285Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:45.258299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.258302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.258304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:45.258313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.258322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:45.258359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533099402096907:3603]
2025-10-02T08:07:45.258374Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:45.258388Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:45.258396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.258452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.258459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.258472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.258509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 117 partition: 0 MaxSeqNo: 17 sessionId: src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0
2025-10-02T08:07:45.258853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cb9ad44-8814c748-7ff53d20-16f7e0d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:45.261489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0] Write session: try to update token
2025-10-02T08:07:45.261512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:45.274487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId: src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:45.275595Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:45.275614Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:45.275616Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:45.275626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533099402096907:3603]
2025-10-02T08:07:45.275633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533099402096907:3603]
2025-10-02T08:07:45.275667Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:45.275676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:45.275680Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:45.275682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.275685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:45.275846Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:45.277272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:45.333079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533099402096949:3491]
2025-10-02T08:07:45.333186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 116, pipe: [1:7556533099402096949:3491]
2025-10-02T08:07:45.408787Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:45.409244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.409258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.409297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402096949:3491], now have 1 active actors on pipe
2025-10-02T08:07:45.409421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:45.409432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:45.409512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 117 reason: error at write: Disconnected sessionId: src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0
2025-10-02T08:07:45.409682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 117 sessionId: src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0 is DEAD
2025-10-02T08:07:45.409699Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:45.409875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533099402096949:3491]
2025-10-02T08:07:45.410051Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:45.410106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:45.410120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0] Write session will restart in 0.008960s
2025-10-02T08:07:45.410146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0] Write session: Do CDS request
2025-10-02T08:07:45.410154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:45.420396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.420404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:45.420495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:45.420505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 118
2025-10-02T08:07:45.420676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.420709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:45.420718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:45.420721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:45.420892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:45.421046Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:45.421054Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:45.421060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:45.421072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 118 sessionId:  describe result for acl check
2025-10-02T08:07:45.421098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:45.421101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:45.421102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:45.421103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:45.421108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533099402097349:3612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:45.421124Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533099402097347:3610]
2025-10-02T08:07:45.421496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533099402097349:3612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:45.421522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:45.421699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:45.421728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:45.421921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:45.421947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.421951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.421952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.421952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.421953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.421957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.421962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.421964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.421966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.421968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.421971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.421975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.421978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.421984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.421986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.421989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.421992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.421999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.422001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.422004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.422013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:45.423192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533099402097349:3612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:45.427916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533099402097349:3612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:45.427930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533099402097349:3612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:45.427934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533099402097349:3612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:45.427943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:45.429462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:45.431121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:45.431133Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:45.431135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:45.431137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:45.431142Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 117 [1:7556533099402097347:3610]
2025-10-02T08:07:45.431150Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:45.431161Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:45.431162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.431165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.431166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.431177Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:45.431183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:45.431189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:45.431233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.431238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.431240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:45.431241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:45.431290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:45.431297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.431305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.431311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:45.431324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402097393:3612], now have 1 active actors on pipe
2025-10-02T08:07:45.431326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533099862541937:2378], now have 1 active actors on pipe
2025-10-02T08:07:45.431330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533099402097339:3610]
2025-10-02T08:07:45.431337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533099402097339:3610]
2025-10-02T08:07:45.431348Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:45.431363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:45.431367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:45.431367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:45.431371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 117
2025-10-02T08:07:45.431376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:45.431378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:45.431404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.431410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.431378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 117
2025-10-02T08:07:45.431419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533099402097339:3610]
2025-10-02T08:07:45.431425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:45.431434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:45.431443Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:45.431448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.431450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.431452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:45.431457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.431464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:45.431483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.431524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.431529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.431538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.431566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 118 partition: 0 MaxSeqNo: 17 sessionId: src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0
2025-10-02T08:07:45.431915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1266f47b-d2bc75c4-5a05faab-db333cb7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:45.434361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0] Write session: try to update token
2025-10-02T08:07:45.434378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:45.447803Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:45.447821Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:45.447823Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:45.447830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533099402097339:3610]
2025-10-02T08:07:45.447834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533099402097339:3610]
2025-10-02T08:07:45.447866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:45.447877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.447878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:45.447892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:45.447908Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:45.448014Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:45.448476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId: src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:45.451440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:45.510208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533099402097408:3491]
2025-10-02T08:07:45.510320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 117, pipe: [1:7556533099402097408:3491]
2025-10-02T08:07:45.580313Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:45.580585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.580598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.580636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402097408:3491], now have 1 active actors on pipe
2025-10-02T08:07:45.580758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533099402097408:3491]
2025-10-02T08:07:45.580782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:45.580784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:45.580856Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:45.580859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 118 reason: error at write: Disconnected sessionId: src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0
2025-10-02T08:07:45.580872Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:45.581028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 118 sessionId: src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0 is DEAD
2025-10-02T08:07:45.581155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:45.581162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0] Write session will restart in 0.005216s
2025-10-02T08:07:45.581182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0] Write session: Do CDS request
2025-10-02T08:07:45.581186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:45.587425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:45.587456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.587440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 119
2025-10-02T08:07:45.587685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.587718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:45.587727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:45.587730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:45.588088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 119 sessionId:  describe result for acl check
2025-10-02T08:07:45.588121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:45.588127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:45.588129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:45.588134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533099402097686:3617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:45.588605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533099402097686:3617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:45.590842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533099402097686:3617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:45.591587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:45.592083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:45.592263Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:45.592274Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:45.592285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:45.592347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:45.592385Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533099402097836:3616]
2025-10-02T08:07:45.592967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:45.593130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:45.593163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:45.593355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:45.593381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.593385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.593386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.593386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.593387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.593390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.593396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.593399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.593403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.593406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.593410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.593416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.593421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.593426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.593432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.593438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.593442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.593446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.593449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.593458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.593474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:45.593883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533099402097686:3617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:45.593896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533099402097686:3617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:45.593899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533099402097686:3617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:45.593907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:45.604036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:45.605595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:45.605611Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:45.605614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:45.605617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:45.605623Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 118 [1:7556533099402097836:3616]
2025-10-02T08:07:45.605634Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:45.605648Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:45.605655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.605659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.605660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.605674Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:45.605683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:45.605692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:45.605777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.605785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.605787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:45.605790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:45.605943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:45.605951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.605956Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 118
2025-10-02T08:07:45.605962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.605982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:45.605998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402097853:3617], now have 1 active actors on pipe
2025-10-02T08:07:45.606001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533099862541943:2378], now have 1 active actors on pipe
2025-10-02T08:07:45.606007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533099402097824:3616]
2025-10-02T08:07:45.606009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533099402097824:3616]
2025-10-02T08:07:45.606019Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:45.606032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:45.606035Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:45.606038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:45.606051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:45.606058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:45.606087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533099402097824:3616]
2025-10-02T08:07:45.606097Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:45.606108Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:45.606148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 118
2025-10-02T08:07:45.606158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.606164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.606185Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6c27946-8946934f-2200e75b-936c81b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:45.606196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.606200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.606202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:45.606210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.606222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:45.606240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.606272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.606276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.606284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.606311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 119 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6c27946-8946934f-2200e75b-936c81b7_0
2025-10-02T08:07:45.606662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b1c19cd-3090ea9c-432bbb8-41897caa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6c27946-8946934f-2200e75b-936c81b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:45.609625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c27946-8946934f-2200e75b-936c81b7_0] Write session: try to update token
2025-10-02T08:07:45.609644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c27946-8946934f-2200e75b-936c81b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:45.616357Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:45.616376Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:45.616383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533099402097824:3616]
2025-10-02T08:07:45.616419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:45.616427Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:45.616585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:45.616727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:45.616886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:45.617065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:45.617240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:45.617274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:45.624915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId: src_id|e6c27946-8946934f-2200e75b-936c81b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:45.627314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:45.627362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.627371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.627396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:45.627416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:45.627456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.627474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.627623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.627682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.627799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.627872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.627919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.627927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.627986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.628045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.628106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.628164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.628220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.628227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.628290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.628349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.628412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.628474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.628521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.628528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.628690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.628761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.628925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.628989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.629038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.629045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.629199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.629267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.629332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.629400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.629457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.629468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.629545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.629608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.629675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.629745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.629791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.629798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.629860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.629920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.629984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.630044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.630089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.630096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.630167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.630231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.630292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.630352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.630401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.630411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.630473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.630539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.630603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.630666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.630751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.630759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.630827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:45.630886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:45.630946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:45.631008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:45.631058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:45.631066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:45.631121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:45.631186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.631208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.631215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:45.631243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:45.631258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:45.631265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:45.631268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:45.631270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:45.631652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:45.631685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:45.631696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:45.631699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:45.631702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:45.631706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:45.632295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:45.632324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:45.632335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:45.632338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:45.632341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:45.632344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:45.632990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:45.633015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:45.633021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:45.633026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:45.633029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:45.634228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:45.634252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:45.634263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392465634
2025-10-02T08:07:45.634385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:45.634400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:45.634405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:45.634408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:45.634416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:45.634419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:45.634965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:45.635004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:45.635015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:45.635018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:45.635022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:45.635025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:45.635537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:45.635566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:45.635578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:45.635581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:45.635584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:45.635587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:45.636091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:45.636121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:45.636126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:45.637296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:45.637319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:45.637326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:45.637330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:45.637339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392465637
2025-10-02T08:07:45.637673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:45.637704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:45.637715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:45.637719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:45.637723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:45.637731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:45.638255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:45.638276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:45.638282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:45.638285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:45.638288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:45.638291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:45.638838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:45.638866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.638978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392465638
2025-10-02T08:07:45.641835Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:45.641867Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:45.641873Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:45.641880Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:45.641895Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:45.641902Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:45.641904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:45.641913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533099402097824:3616]
2025-10-02T08:07:45.641916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533099402097824:3616]
2025-10-02T08:07:45.641965Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:45.641977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:45.641990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:45.642000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.642002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:45.642147Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:45.680714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533099402097895:3491]
2025-10-02T08:07:45.680825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 118, pipe: [1:7556533099402097895:3491]
2025-10-02T08:07:45.783872Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:45.784352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402097895:3491], now have 1 active actors on pipe
2025-10-02T08:07:45.784549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:45.784550Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:45.784560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:45.784593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 119 reason: error at write: Disconnected sessionId: src_id|e6c27946-8946934f-2200e75b-936c81b7_0
2025-10-02T08:07:45.784623Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:45.784820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 119 sessionId: src_id|e6c27946-8946934f-2200e75b-936c81b7_0 is DEAD
2025-10-02T08:07:45.784945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c27946-8946934f-2200e75b-936c81b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:45.784952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c27946-8946934f-2200e75b-936c81b7_0] Write session will restart in 0.009906s
2025-10-02T08:07:45.784969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c27946-8946934f-2200e75b-936c81b7_0] Write session: Do CDS request
2025-10-02T08:07:45.784974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c27946-8946934f-2200e75b-936c81b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:45.784996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533099402097895:3491]
2025-10-02T08:07:45.787169Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [83699551bd500274] Result# TEvPutResult {Id# [72075186224037892:118:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:45.787178Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:118:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:45.787212Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:118:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:45.795665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:45.796147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:45.796317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c27946-8946934f-2200e75b-936c81b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.796345Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:45.796357Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:45.796369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:45.796431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:45.796477Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533099402098305:3635]
2025-10-02T08:07:45.796529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:45.796543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 120
2025-10-02T08:07:45.796678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.796705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:45.796713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:45.796716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:45.797079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 120 sessionId:  describe result for acl check
2025-10-02T08:07:45.797106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:45.797108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:45.797112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:45.797114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:45.797118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533099402098311:3637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:45.797266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:45.797308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:45.797519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533099402098311:3637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:45.797597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:45.797668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.797675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.797676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.797677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.797678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.797683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.797691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.797695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.797699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.797702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.797707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.797714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.797718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.797722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.797726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.797730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.797733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.797737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.797741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.797746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.797764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:45.799329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533099402098311:3637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:45.806829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533099402098311:3637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:45.806849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533099402098311:3637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:45.806853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533099402098311:3637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:45.806863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:45.807587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:45.809144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:45.809160Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:45.809162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:45.809166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:45.809174Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 119 [1:7556533099402098305:3635]
2025-10-02T08:07:45.809185Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:45.809202Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:45.809210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.809213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.809215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.809244Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:45.809252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:45.809259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:45.809322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.809330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.809333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:45.809335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:45.809410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:45.809417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.809429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.809440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:45.809448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 119
2025-10-02T08:07:45.809463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402098350:3637], now have 1 active actors on pipe
2025-10-02T08:07:45.809470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533099862541975:2378], now have 1 active actors on pipe
2025-10-02T08:07:45.809475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533099402098299:3635]
2025-10-02T08:07:45.809477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533099402098299:3635]
2025-10-02T08:07:45.809489Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:45.809501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.809509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.809510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:45.809514Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:45.809526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:45.809542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:45.809548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:45.809534Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 119
2025-10-02T08:07:45.809588Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:45.809597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.809601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.809607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:45.809614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.809622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:45.809632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533099402098299:3635]
2025-10-02T08:07:45.809642Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:45.809655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:45.809676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.809765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.809779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.809802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.809843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 120 partition: 0 MaxSeqNo: 17 sessionId: src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0
2025-10-02T08:07:45.810186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c27946-8946934f-2200e75b-936c81b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:45.813054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0] Write session: try to update token
2025-10-02T08:07:45.813072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:45.827224Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:45.827246Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:45.827248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:45.827257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533099402098299:3635]
2025-10-02T08:07:45.827262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533099402098299:3635]
2025-10-02T08:07:45.827306Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:45.827311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:45.827313Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:45.827317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.827319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:45.827478Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:45.831116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId: src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:45.834055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:45.885008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533099402098366:3491]
2025-10-02T08:07:45.885152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 119, pipe: [1:7556533099402098366:3491]
2025-10-02T08:07:45.964675Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:45.965194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.965214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.965258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402098366:3491], now have 1 active actors on pipe
2025-10-02T08:07:45.965500Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:45.965760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:45.965781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0] Write session will restart in 0.009629s
2025-10-02T08:07:45.965807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0] Write session: Do CDS request
2025-10-02T08:07:45.965815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:45.965366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:45.965375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:45.965433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 120 reason: error at write: Disconnected sessionId: src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0
2025-10-02T08:07:45.965510Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:45.965624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 120 sessionId: src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0 is DEAD
2025-10-02T08:07:45.965813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533099402098366:3491]
2025-10-02T08:07:45.976321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.976628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:45.976647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 121
2025-10-02T08:07:45.976738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:45.976778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:45.976787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:45.976790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:45.977116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 121 sessionId:  describe result for acl check
2025-10-02T08:07:45.977148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:45.977150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:45.977151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:45.977156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533099402098761:3642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:45.977564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533099402098761:3642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:45.977569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:45.978074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:45.978208Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:45.978216Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:45.978224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:45.978256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:45.978284Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533099402098776:3641]
2025-10-02T08:07:45.978729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:45.978876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:45.978903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:45.979181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:45.979232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.979237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.979238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.979239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.979239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.979242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.979249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.979251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.979253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.979255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.979259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.979264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:45.979267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.979272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:45.979274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.979277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:45.979279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.979282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.979285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.979288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.979299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:45.979752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533099402098761:3642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:45.985285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533099402098761:3642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:45.985303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533099402098761:3642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:45.985306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533099402098761:3642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:45.985314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:45.987667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:45.989609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:45.989631Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:45.989633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:45.989636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:45.989642Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 120 [1:7556533099402098776:3641]
2025-10-02T08:07:45.989654Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:45.989670Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:45.989673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.989676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.989678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.989694Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:45.989699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:45.989707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:45.989778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.989791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.989794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:45.989797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:45.989861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:45.989869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:45.989886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:45.989907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:45.989926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533099402098812:3642], now have 1 active actors on pipe
2025-10-02T08:07:45.989934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533099862541982:2378], now have 1 active actors on pipe
2025-10-02T08:07:45.989940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533099402098764:3641]
2025-10-02T08:07:45.989941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 120
2025-10-02T08:07:45.989942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533099402098764:3641]
2025-10-02T08:07:45.989949Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:45.989960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:45.989962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:45.989971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:45.989977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:45.989981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:45.989989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.989993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.990039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533099402098764:3641]
2025-10-02T08:07:45.990048Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:45.990057Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:45.990063Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:45.990070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:45.990073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:45.990075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:45.990083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:45.990092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:45.990130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.990111Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 120
2025-10-02T08:07:45.990202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:45.990206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:45.990219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:45.990252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 121 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0
2025-10-02T08:07:45.990601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c9ea9b4-22d0415b-f04a7a63-cb218fb4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:45.993881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0] Write session: try to update token
2025-10-02T08:07:45.993902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:46.008722Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:46.008744Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:46.008746Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:46.008755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533099402098764:3641]
2025-10-02T08:07:46.008759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533099402098764:3641]
2025-10-02T08:07:46.008823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:46.008824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:46.008830Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:46.008834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.008837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:46.009007Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:46.011714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId: src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:46.014883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:46.065736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533103697066123:3491]
2025-10-02T08:07:46.065883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 120, pipe: [1:7556533103697066123:3491]
2025-10-02T08:07:46.145981Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:46.146361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.146378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.146417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697066123:3491], now have 1 active actors on pipe
2025-10-02T08:07:46.146521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:46.146533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:46.146616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 121 reason: error at write: Disconnected sessionId: src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0
2025-10-02T08:07:46.146660Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:46.146656Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:46.146815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 121 sessionId: src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0 is DEAD
2025-10-02T08:07:46.147008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533103697066123:3491]
2025-10-02T08:07:46.147340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:46.147355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0] Write session will restart in 0.005850s
2025-10-02T08:07:46.147382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0] Write session: Do CDS request
2025-10-02T08:07:46.147389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:46.154469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.154516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:46.154533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 122
2025-10-02T08:07:46.154763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.154850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:46.154859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:46.154863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:46.155386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 122 sessionId:  describe result for acl check
2025-10-02T08:07:46.155417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:46.155423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:46.155424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:46.155430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533103697066453:3649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:46.155918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533103697066453:3649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:46.158277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533103697066453:3649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:46.158553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:46.159135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:46.159372Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:46.159383Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:46.159392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:46.159458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:46.159497Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533103697066566:3648]
2025-10-02T08:07:46.160155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:46.160351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:46.160406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:46.160721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:46.160763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.160769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.160770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.160771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.160773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.160778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.160788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.160791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.160795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.160799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.160822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.160829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.160835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.160840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.160844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.160848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.160852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.160858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.160862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.160866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.160885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:46.161280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533103697066453:3649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:46.161292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533103697066453:3649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:46.161295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533103697066453:3649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:46.161302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:46.168884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:46.170762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:46.170788Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:46.170790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:46.170795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:46.170802Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 121 [1:7556533103697066566:3648]
2025-10-02T08:07:46.170820Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:46.170840Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:46.170844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.170847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.170849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.170865Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:46.170879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:46.170886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:46.170964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.170973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.170976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:46.170978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:46.171046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:46.171054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.171069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.171084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:46.171107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697066584:3649], now have 1 active actors on pipe
2025-10-02T08:07:46.171118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533103697066552:3648]
2025-10-02T08:07:46.171122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 121
2025-10-02T08:07:46.171125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533103697066552:3648]
2025-10-02T08:07:46.171136Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:46.171148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533104157509296:2378], now have 1 active actors on pipe
2025-10-02T08:07:46.171150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:46.171153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:46.171157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:46.171170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:46.171173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:46.171181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.171185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.171216Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 121
2025-10-02T08:07:46.171227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533103697066552:3648]
2025-10-02T08:07:46.171243Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:46.171244Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:46.171259Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7522c8f-a0185646-19785d1b-d4701bab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:46.171266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.171269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.171272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:46.171281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.171291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:46.171344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.171423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.171431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.171445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.171490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 122 partition: 0 MaxSeqNo: 17 sessionId: src_id|f7522c8f-a0185646-19785d1b-d4701bab_0
2025-10-02T08:07:46.171868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a17cb49-4c76562f-ee14dc8c-942519bc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f7522c8f-a0185646-19785d1b-d4701bab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:46.174888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7522c8f-a0185646-19785d1b-d4701bab_0] Write session: try to update token
2025-10-02T08:07:46.174905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7522c8f-a0185646-19785d1b-d4701bab_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:46.189819Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:46.189841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:46.189843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:46.189851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533103697066552:3648]
2025-10-02T08:07:46.189854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533103697066552:3648]
2025-10-02T08:07:46.189899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:46.189904Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:46.189906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.189908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:46.189920Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:46.190062Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:46.191542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId: src_id|f7522c8f-a0185646-19785d1b-d4701bab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:46.194166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:46.247005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533103697066598:3491]
2025-10-02T08:07:46.249165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 121, pipe: [1:7556533103697066598:3491]
2025-10-02T08:07:46.331523Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:46.331880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.331895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.331934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697066598:3491], now have 1 active actors on pipe
2025-10-02T08:07:46.332067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533103697066598:3491]
2025-10-02T08:07:46.332108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:46.332111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:46.332165Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:46.332141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:46.332187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 122 reason: error at write: Disconnected sessionId: src_id|f7522c8f-a0185646-19785d1b-d4701bab_0
2025-10-02T08:07:46.332368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 122 sessionId: src_id|f7522c8f-a0185646-19785d1b-d4701bab_0 is DEAD
2025-10-02T08:07:46.332506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7522c8f-a0185646-19785d1b-d4701bab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:46.332517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7522c8f-a0185646-19785d1b-d4701bab_0] Write session will restart in 0.006164s
2025-10-02T08:07:46.332543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7522c8f-a0185646-19785d1b-d4701bab_0] Write session: Do CDS request
2025-10-02T08:07:46.332550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7522c8f-a0185646-19785d1b-d4701bab_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:46.340480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7522c8f-a0185646-19785d1b-d4701bab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.340468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:46.340487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 123
2025-10-02T08:07:46.340707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.340741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:46.340750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:46.340753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:46.341192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 123 sessionId:  describe result for acl check
2025-10-02T08:07:46.341237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:46.341246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:46.341248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:46.341253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533103697066937:3656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:46.341757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533103697066937:3656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:46.344221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533103697066937:3656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:46.344225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:46.344677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:46.344896Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:46.344907Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:46.344917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:46.344971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:46.345006Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533103697067038:3655]
2025-10-02T08:07:46.345621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:46.345867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:46.345927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:46.346282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:46.346350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.346358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.346358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.346359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.346360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.346367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.346376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.346380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.346384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.346393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.346398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.346405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.346415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.346420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.346425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.346434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.346437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.346442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.346447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.346457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.346474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:46.347194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533103697066937:3656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:46.347207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533103697066937:3656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:46.347211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533103697066937:3656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:46.347219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:46.354751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:46.356826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:46.356847Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:46.356850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:46.356853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:46.356859Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 122 [1:7556533103697067038:3655]
2025-10-02T08:07:46.356873Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:46.356891Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:46.356894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.356896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.356898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.356917Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:46.356922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:46.356929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:46.356995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.357005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.357009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:46.357011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:46.357082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:46.357089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.357103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.357118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:46.357128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 122
2025-10-02T08:07:46.357142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697067055:3656], now have 1 active actors on pipe
2025-10-02T08:07:46.357145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533104157509305:2378], now have 1 active actors on pipe
2025-10-02T08:07:46.357151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533103697067022:3655]
2025-10-02T08:07:46.357153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533103697067022:3655]
2025-10-02T08:07:46.357166Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:46.357176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:46.357178Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:46.357181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.357186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.357210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:46.357229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:46.357237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:46.357281Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:46.357291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.357299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.357301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:46.357312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.357325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:46.357340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533103697067022:3655]
2025-10-02T08:07:46.357351Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:46.357381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.357403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:46.357428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.357435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.357456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.357366Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 122
2025-10-02T08:07:46.357497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 123 partition: 0 MaxSeqNo: 17 sessionId: src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0
2025-10-02T08:07:46.357884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7522c8f-a0185646-19785d1b-d4701bab_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:46.360452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0] Write session: try to update token
2025-10-02T08:07:46.360467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:46.374471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId: src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:46.375073Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:46.375099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:46.375101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:46.375110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533103697067022:3655]
2025-10-02T08:07:46.375115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533103697067022:3655]
2025-10-02T08:07:46.375154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:46.375166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.375167Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:46.375169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:46.375173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:46.375336Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:46.377028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:46.432338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533103697067071:3491]
2025-10-02T08:07:46.432438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 122, pipe: [1:7556533103697067071:3491]
2025-10-02T08:07:46.522490Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:46.522814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.522829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.522867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697067071:3491], now have 1 active actors on pipe
2025-10-02T08:07:46.522981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533103697067071:3491]
2025-10-02T08:07:46.523001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:46.523008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:46.523059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 123 reason: error at write: Disconnected sessionId: src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0
2025-10-02T08:07:46.523115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:46.523138Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:46.523245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 123 sessionId: src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0 is DEAD
2025-10-02T08:07:46.523392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:46.523400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0] Write session will restart in 0.009201s
2025-10-02T08:07:46.523439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0] Write session: Do CDS request
2025-10-02T08:07:46.523447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:46.533407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.533477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:46.533500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 124
2025-10-02T08:07:46.533737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.533785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:46.533796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:46.533800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:46.534009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:46.534179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 124 sessionId:  describe result for acl check
2025-10-02T08:07:46.534217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:46.534225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:46.534227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:46.534232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533103697067477:3663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:46.534535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:46.534681Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:46.534690Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:46.534699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:46.534732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533103697067477:3663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:46.534747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:46.534787Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533103697067479:3661]
2025-10-02T08:07:46.535329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:46.535549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:46.535607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:46.535940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:46.535998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.536007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.536008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.536010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.536011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.536016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.536025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.536029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.536033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.536037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.536043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.536050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.536056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.536061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.536065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.536076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.536080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.536085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.536090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.536095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.536115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:46.536549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533103697067477:3663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:46.542035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533103697067477:3663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:46.542055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533103697067477:3663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:46.542059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533103697067477:3663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:46.542073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:46.544406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:46.546200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:46.546214Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:46.546216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:46.546220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:46.546226Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 123 [1:7556533103697067479:3661]
2025-10-02T08:07:46.546241Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:46.546268Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:46.546270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.546272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.546274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.546285Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:46.546288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:46.546294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:46.546338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.546345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.546348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:46.546349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:46.546404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:46.546412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.546424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.546441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:46.546464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697067525:3663], now have 1 active actors on pipe
2025-10-02T08:07:46.546471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 123
2025-10-02T08:07:46.546473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533104157509312:2378], now have 1 active actors on pipe
2025-10-02T08:07:46.546478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533103697067471:3661]
2025-10-02T08:07:46.546480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533103697067471:3661]
2025-10-02T08:07:46.546492Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:46.546503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.546507Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:46.546510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:46.546512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.546526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:46.546539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:46.546550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:46.546586Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:46.546591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.546593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.546595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:46.546566Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 123
2025-10-02T08:07:46.546601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.546608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:46.546612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533103697067471:3661]
2025-10-02T08:07:46.546615Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:46.546621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:46.546638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.546689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.546697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.546706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.546734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 124 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0
2025-10-02T08:07:46.547098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe956e1-58da2d46-5d30dd3f-70a83ae1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:46.549869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0] Write session: try to update token
2025-10-02T08:07:46.549888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:46.563157Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:46.563179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:46.563182Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:46.563191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533103697067471:3661]
2025-10-02T08:07:46.563196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533103697067471:3661]
2025-10-02T08:07:46.563236Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:46.563239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:46.563246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.563248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:46.563252Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:46.563390Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:46.563513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId: src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:46.566607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:46.625938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533103697067544:3491]
2025-10-02T08:07:46.626027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 123, pipe: [1:7556533103697067544:3491]
2025-10-02T08:07:46.712455Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:46.712832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.712854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.712894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697067544:3491], now have 1 active actors on pipe
2025-10-02T08:07:46.713046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:46.713064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:46.713082Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:46.713144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 124 reason: error at write: Disconnected sessionId: src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0
2025-10-02T08:07:46.713342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 124 sessionId: src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0 is DEAD
2025-10-02T08:07:46.713455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:46.713471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0] Write session will restart in 0.005356s
2025-10-02T08:07:46.713434Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:46.713494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0] Write session: Do CDS request
2025-10-02T08:07:46.713501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:46.713537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533103697067544:3491]
2025-10-02T08:07:46.720345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.720470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:46.720489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 125
2025-10-02T08:07:46.720641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.720677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:46.720688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:46.720692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:46.721271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 125 sessionId:  describe result for acl check
2025-10-02T08:07:46.721313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:46.721320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:46.721322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:46.721327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533103697067887:3678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:46.721840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533103697067887:3678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:46.723883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:46.723940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533103697067887:3678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:46.724514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:46.724646Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:46.724655Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:46.724662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:46.724692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:46.724743Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533103697068004:3677]
2025-10-02T08:07:46.725244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:46.725453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:46.725511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:46.725845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:46.725910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.725918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.725919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.725920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.725922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.725928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.725938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.725942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.725946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.725951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.725956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.725964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.725977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.725983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.725990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.726002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.726007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.726018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.726023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.726035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.726069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:46.726597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533103697067887:3678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:46.726611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533103697067887:3678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:46.726614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533103697067887:3678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:46.726622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:46.734290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:46.735976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:46.736000Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:46.736003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:46.736006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:46.736013Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 124 [1:7556533103697068004:3677]
2025-10-02T08:07:46.736025Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:46.736043Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:46.736046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.736049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.736051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.736070Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:46.736074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:46.736080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:46.736219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.736231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.736234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:46.736237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:46.736318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:46.736327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.736337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 124
2025-10-02T08:07:46.736343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.736356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:46.736382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697068022:3678], now have 1 active actors on pipe
2025-10-02T08:07:46.736392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533104157509319:2378], now have 1 active actors on pipe
2025-10-02T08:07:46.736397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.736401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.736418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533103697067988:3677]
2025-10-02T08:07:46.736426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533103697067988:3677]
2025-10-02T08:07:46.736433Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:46.736440Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:46.736443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:46.736447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:46.736462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:46.736465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:46.736448Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 124
2025-10-02T08:07:46.736480Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:46.736495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.736499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.736501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:46.736511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.736525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:46.736566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533103697067988:3677]
2025-10-02T08:07:46.736583Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:46.736594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:46.736608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.736716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.736726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.736746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.736791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 125 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0
2025-10-02T08:07:46.737097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5d4a53-35de9d12-84f45296-1da3a3de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:46.739928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0] Write session: try to update token
2025-10-02T08:07:46.739942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:46.753340Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:46.753366Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:46.753374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533103697067988:3677]
2025-10-02T08:07:46.753419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:46.753420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:46.753606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:46.753774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:46.753932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:46.754082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:46.754294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:46.754341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:46.756527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId: src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:46.759400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:46.759474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.759487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.759517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:46.759543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:46.759595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.759612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.759767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.759857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.759923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.760009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.760352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.760363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.760422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.760490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.760544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.760605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.760648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.760654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.760716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.760774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.760861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.760935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.760984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.760991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.761056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.761113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.761171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.761236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.761283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.761290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.761357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.761417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.761484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.761553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.761602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.761609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.761683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.761750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.761816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.761888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.761937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.761944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.762010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.762071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.762133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.762193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.762301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.762309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.762372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.762429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.762483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.762547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.762585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.762591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.762647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.762702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.762766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.762828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.762876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.762883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.762945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:46.763005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:46.763071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:46.763138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:46.763243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:46.763251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:46.763313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:46.763372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.763392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.763398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:46.763426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:46.763443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:46.763450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:46.763453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:46.763456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:46.763849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:46.763873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:46.763881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:46.763883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:46.763885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:46.763888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:46.764488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:46.764509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:46.764513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:46.764515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:46.764517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:46.764519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:46.765082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:46.765105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:46.765110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:46.765112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:46.765115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:46.767240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:46.767256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:46.767269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392466767
2025-10-02T08:07:46.767389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:46.767401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:46.767406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:46.767412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:46.767416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:46.767419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:46.767893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:46.767911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:46.767915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:46.767917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:46.767919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:46.767922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:46.768420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:46.768440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:46.768450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:46.768455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:46.768458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:46.768462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:46.768976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:46.768997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:46.769002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:46.770161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:46.770183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:46.770188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:46.770193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:46.770201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392466770
2025-10-02T08:07:46.770508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:46.770530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:46.770541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:46.770545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:46.770548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:46.770551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:46.771034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:46.771059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:46.771078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:46.771085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:46.771089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:46.771092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:46.771606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:46.771628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.771739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392466771
2025-10-02T08:07:46.774274Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:46.774304Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:46.774312Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:46.774320Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:46.774331Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:46.774335Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:46.774337Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:46.774345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533103697067988:3677]
2025-10-02T08:07:46.774349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533103697067988:3677]
2025-10-02T08:07:46.774389Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:46.774400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:46.774423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:46.774433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.774435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:46.774565Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:46.813771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533103697068045:3491]
2025-10-02T08:07:46.813888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 124, pipe: [1:7556533103697068045:3491]
2025-10-02T08:07:46.900652Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:46.900984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697068045:3491], now have 1 active actors on pipe
2025-10-02T08:07:46.901122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533103697068045:3491]
2025-10-02T08:07:46.901138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:46.901140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:46.901162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 125 reason: error at write: Disconnected sessionId: src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0
2025-10-02T08:07:46.901204Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:46.901258Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:46.901337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 125 sessionId: src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0 is DEAD
2025-10-02T08:07:46.901498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:46.901507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0] Write session will restart in 0.009598s
2025-10-02T08:07:46.901529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0] Write session: Do CDS request
2025-10-02T08:07:46.901536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:46.904684Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [12faca567bb9c321] Result# TEvPutResult {Id# [72075186224037892:124:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:46.904705Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:124:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:46.904767Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:124:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:46.912334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.912417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:46.912433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 126
2025-10-02T08:07:46.912533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:46.912554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:46.912561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:46.912564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:46.912868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 126 sessionId:  describe result for acl check
2025-10-02T08:07:46.912891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:46.912895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:46.912896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:46.912899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533103697068444:3687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:46.913262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533103697068444:3687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:46.913693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:46.914184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:46.914322Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:46.914329Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:46.914336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:46.914372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:46.914403Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533103697068476:3686]
2025-10-02T08:07:46.914816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:46.914956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:46.914984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:46.915201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:46.915231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.915235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.915236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.915236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.915237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.915240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.915245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.915247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.915249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.915251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.915254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.915258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:46.915261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.915264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:46.915267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.915270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:46.915272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.915274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.915276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.915279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.915288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:46.915348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533103697068444:3687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:46.920941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533103697068444:3687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:46.920959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533103697068444:3687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:46.920962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533103697068444:3687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:46.920971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:46.925930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:46.927428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:46.927446Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:46.927449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:46.927453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:46.927462Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 125 [1:7556533103697068476:3686]
2025-10-02T08:07:46.927534Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:46.927557Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:46.927565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.927570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.927572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.927589Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:46.927594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:46.927600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:46.927667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.927675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.927677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:46.927680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:46.927740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:46.927748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.927761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:46.927776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:46.927797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533103697068462:3686]
2025-10-02T08:07:46.927803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533103697068462:3686]
2025-10-02T08:07:46.927809Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:46.927818Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:46.927822Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:46.927824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 125
2025-10-02T08:07:46.927826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533104157509350:2378], now have 1 active actors on pipe
2025-10-02T08:07:46.927832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533103697068508:3687], now have 1 active actors on pipe
2025-10-02T08:07:46.927837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:46.927848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:46.927856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:46.927862Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 125
2025-10-02T08:07:46.927890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.927898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.927910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533103697068462:3686]
2025-10-02T08:07:46.927926Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:46.927935Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:46.927958Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:46.927970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:46.927976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:46.927978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:46.927986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:46.928001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:46.928029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.928078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:46.928084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:46.928095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:46.928130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 126 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0
2025-10-02T08:07:46.928466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6bf2c5e-13103120-4988a70f-a1635fcb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:46.931256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0] Write session: try to update token
2025-10-02T08:07:46.931271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:46.944701Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:46.944720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:46.944722Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:46.944729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533103697068462:3686]
2025-10-02T08:07:46.944732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533103697068462:3686]
2025-10-02T08:07:46.944765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:46.944770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:46.944771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:46.944782Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:46.944788Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:46.944929Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:46.946797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId: src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:46.949389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:47.001148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533107992035818:3491]
2025-10-02T08:07:47.001213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 125, pipe: [1:7556533107992035818:3491]
2025-10-02T08:07:47.076352Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:47.076622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.076632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.076664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992035818:3491], now have 1 active actors on pipe
2025-10-02T08:07:47.076768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533107992035818:3491]
2025-10-02T08:07:47.076783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:47.076787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:47.076849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 126 reason: error at write: Disconnected sessionId: src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0
2025-10-02T08:07:47.076885Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:47.076942Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:47.076996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 126 sessionId: src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0 is DEAD
2025-10-02T08:07:47.077149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:47.077163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0] Write session will restart in 0.008500s
2025-10-02T08:07:47.077190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0] Write session: Do CDS request
2025-10-02T08:07:47.077197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:47.086359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:47.086750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:47.086910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:47.086920Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:47.086929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:47.086965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:47.087003Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533107992036228:3692]
2025-10-02T08:07:47.087399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.087463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:47.087487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:47.087493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 127
2025-10-02T08:07:47.087594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:47.087620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:47.087674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.087706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:47.087715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:47.087718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:47.087848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:47.087880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.087884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.087885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.087886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.087886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.087889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.087896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.087898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.087900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.087902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.087905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.087910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.087914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.087917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.087920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.087922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.087924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.087928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.087930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.087933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.087944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:47.088068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 127 sessionId:  describe result for acl check
2025-10-02T08:07:47.088101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:47.088106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:47.088108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:47.088112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533107992036244:3694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:47.088628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533107992036244:3694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:47.091005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533107992036244:3694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:47.095200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533107992036244:3694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:47.095216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533107992036244:3694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:47.095219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533107992036244:3694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:47.095267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:47.095934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:47.097974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:47.097990Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:47.097992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:47.097996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:47.098003Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 126 [1:7556533107992036228:3692]
2025-10-02T08:07:47.098015Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:47.098031Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:47.098040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.098043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.098045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.098063Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:47.098068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:47.098074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:47.098131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.098139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.098142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:47.098145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:47.098205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:47.098213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.098226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.098239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:47.098262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992036276:3694], now have 1 active actors on pipe
2025-10-02T08:07:47.098261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 126
2025-10-02T08:07:47.098272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533107992036222:3692]
2025-10-02T08:07:47.098274Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533107992036222:3692]
2025-10-02T08:07:47.098287Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:47.098301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533108452476665:2378], now have 1 active actors on pipe
2025-10-02T08:07:47.098310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.098308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:47.098312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:47.098314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.098332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:47.098350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:47.098358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:47.098309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 126
2025-10-02T08:07:47.098398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:47.098409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.098414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.098416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:47.098424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.098432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:47.098449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533107992036222:3692]
2025-10-02T08:07:47.098461Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:47.098487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:47.098489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.098559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.098572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.098595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.098634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 127 partition: 0 MaxSeqNo: 17 sessionId: src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0
2025-10-02T08:07:47.099005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec493ed0-a22edae8-b2d67377-6a56f7a7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:47.101884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0] Write session: try to update token
2025-10-02T08:07:47.101904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:47.108737Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:47.108758Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:47.108765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533107992036222:3692]
2025-10-02T08:07:47.108818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:47.108840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:47.108988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:47.109139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:47.109284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:47.109440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:47.109657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:47.109697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:47.117097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId: src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:47.119943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:47.120027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.120041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.120079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:47.120099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:47.120157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.120179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.120360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.120443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.120538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.120622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.120680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.120690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.120761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.120841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.120900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.120965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.121008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.121015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.121079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.121142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.121209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.121275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.121327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.121335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.121400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.121466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.121528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.121588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.121634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.121640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.121704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.121762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.121824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.121893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.121940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.121947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.122021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.122083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.122147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.122214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.122257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.122264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.122327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.122386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.122450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.122514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.122560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.122567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.122631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.122692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.122753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.122817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.122869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.122875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.122942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.123002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.123063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.123126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.123168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.123175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.123245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:47.123306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:47.123371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:47.123426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:47.123542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:47.123551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:47.123604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:47.123661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.123682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.123689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:47.123720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:47.123737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:47.123744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:47.123747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:47.123751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:47.124164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:47.124197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:47.124206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:47.124214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:47.124217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:47.124220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:47.124710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:47.124734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:47.124743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:47.124746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:47.124749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:47.124752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:47.125345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:47.125369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:47.125375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:47.125385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:47.125388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:47.127491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:47.127511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:47.127522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392467127
2025-10-02T08:07:47.127661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:47.127676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:47.127681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:47.127685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:47.127688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:47.127691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:47.128150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:47.128179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:47.128188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:47.128193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:47.128197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:47.128201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:47.128742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:47.128771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:47.128778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:47.128781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:47.128785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:47.128788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:47.129261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:47.129285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:47.129291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:47.130415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:47.130434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:47.130441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:47.130444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:47.130455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392467130
2025-10-02T08:07:47.130773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:47.130792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:47.130798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:47.130805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:47.130809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:47.130813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:47.131331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:47.131352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:47.131358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:47.131362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:47.131365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:47.131368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:47.131868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:47.131891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.132018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392467131
2025-10-02T08:07:47.134869Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:47.134898Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:47.134905Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:47.134912Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:47.134927Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:47.134934Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:47.134936Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:47.134943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533107992036222:3692]
2025-10-02T08:07:47.134947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533107992036222:3692]
2025-10-02T08:07:47.134999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:47.135015Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:47.135027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:47.135032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.135034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:47.135179Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:47.176777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533107992036304:3491]
2025-10-02T08:07:47.176913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 126, pipe: [1:7556533107992036304:3491]
2025-10-02T08:07:47.270453Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:47.270807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992036304:3491], now have 1 active actors on pipe
2025-10-02T08:07:47.270944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:47.270955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:47.270978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 127 reason: error at write: Disconnected sessionId: src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0
2025-10-02T08:07:47.270992Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:47.271108Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:47.271171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 127 sessionId: src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0 is DEAD
2025-10-02T08:07:47.271291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:47.271298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0] Write session will restart in 0.008087s
2025-10-02T08:07:47.271314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0] Write session: Do CDS request
2025-10-02T08:07:47.271319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:47.271360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533107992036304:3491]
2025-10-02T08:07:47.274352Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [4d7a047f04fd8136] Result# TEvPutResult {Id# [72075186224037892:126:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:47.274368Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:126:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:47.274414Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:126:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:47.280434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.280489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:47.280505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 128
2025-10-02T08:07:47.280671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.280698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:47.280706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:47.280709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:47.281139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 128 sessionId:  describe result for acl check
2025-10-02T08:07:47.281165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:47.281171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:47.281172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:47.281178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533107992036655:3700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:47.281658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533107992036655:3700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:47.283716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:47.284106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533107992036655:3700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:47.284223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:47.284370Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:47.284378Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:47.284387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:47.284421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:47.284450Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533107992036744:3699]
2025-10-02T08:07:47.284934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:47.285125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:47.285167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:47.285450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:47.285486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.285492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.285493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.285494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.285495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.285500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.285508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.285512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.285516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.285519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.285524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.285531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.285536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.285541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.285545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.285550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.285553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.285557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.285561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.285566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.285582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:47.290191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533107992036655:3700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:47.290209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533107992036655:3700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:47.290213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533107992036655:3700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:47.290221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:47.293276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:47.294864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:47.294878Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:47.294880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:47.294882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:47.294887Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 127 [1:7556533107992036744:3699]
2025-10-02T08:07:47.294895Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:47.294907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:47.294909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.294912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.294913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.294923Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:47.294926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:47.294935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:47.294980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.294985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.294989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:47.294990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:47.295044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:47.295050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.295057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.295064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:47.295080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533107992036736:3699]
2025-10-02T08:07:47.295085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533107992036736:3699]
2025-10-02T08:07:47.295089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:47.295101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:47.295104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 127
2025-10-02T08:07:47.295112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:47.295113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:47.295114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:47.295116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:47.295121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992036769:3700], now have 1 active actors on pipe
2025-10-02T08:07:47.295146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533108452476673:2378], now have 1 active actors on pipe
2025-10-02T08:07:47.295151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533107992036736:3699]
2025-10-02T08:07:47.295156Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:47.295160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.295166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.295172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:47.295200Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:47.295210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.295218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.295219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:47.295200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 127
2025-10-02T08:07:47.295227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.295239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:47.295265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.295302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.295307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.295316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.295343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 128 partition: 0 MaxSeqNo: 17 sessionId: src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0
2025-10-02T08:07:47.295700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9599ab8-f989e95-f79f92b1-e80dd4b1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:47.298424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0] Write session: try to update token
2025-10-02T08:07:47.298448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:47.311974Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:47.311991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:47.311994Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:47.312005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533107992036736:3699]
2025-10-02T08:07:47.312009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533107992036736:3699]
2025-10-02T08:07:47.312049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:47.312055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.312062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:47.312072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:47.312094Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:47.312230Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:47.314697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId: src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:47.317562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:47.371370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533107992036791:3491]
2025-10-02T08:07:47.371519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 127, pipe: [1:7556533107992036791:3491]
2025-10-02T08:07:47.445204Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:47.445662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.445674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.445715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992036791:3491], now have 1 active actors on pipe
2025-10-02T08:07:47.445859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533107992036791:3491]
2025-10-02T08:07:47.445889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:47.445895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:47.445951Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:47.445963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 128 reason: error at write: Disconnected sessionId: src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0
2025-10-02T08:07:47.445993Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:47.446273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 128 sessionId: src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0 is DEAD
2025-10-02T08:07:47.446376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:47.446390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0] Write session will restart in 0.005895s
2025-10-02T08:07:47.446419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0] Write session: Do CDS request
2025-10-02T08:07:47.446425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:47.453371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.453472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:47.453488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 129
2025-10-02T08:07:47.453637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.453696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:47.453709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:47.453714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:47.454142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 129 sessionId:  describe result for acl check
2025-10-02T08:07:47.454179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:47.454185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:47.454187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:47.454192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533107992037124:3707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:47.454691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533107992037124:3707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:47.456653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:47.457079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533107992037124:3707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:47.457174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:47.457416Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:47.457423Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:47.457432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:47.457488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:47.457517Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533107992037235:3706]
2025-10-02T08:07:47.457943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:47.458075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:47.458102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:47.458291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:47.458321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.458322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.458322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.458323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.458324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.458326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.458331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.458333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.458336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.458338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.458341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.458345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.458349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.458352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.458354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.458356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.458358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.458361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.458363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.458366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.458376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:47.462898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533107992037124:3707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:47.462917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533107992037124:3707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:47.462920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533107992037124:3707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:47.462928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:47.466240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:47.468005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:47.468025Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:47.468028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:47.468031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:47.468037Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 128 [1:7556533107992037235:3706]
2025-10-02T08:07:47.468049Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:47.468064Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:47.468066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.468069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.468072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.468087Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:47.468098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:47.468110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:47.468192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.468199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.468202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:47.468204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:47.468272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:47.468280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.468295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.468314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:47.468332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 128
2025-10-02T08:07:47.468334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992037256:3707], now have 1 active actors on pipe
2025-10-02T08:07:47.468341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533107992037223:3706]
2025-10-02T08:07:47.468343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533107992037223:3706]
2025-10-02T08:07:47.468356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:47.468370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533108452476682:2378], now have 1 active actors on pipe
2025-10-02T08:07:47.468377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.468379Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:47.468383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:47.468386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.468403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:47.468425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:47.468433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:47.468411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 128
2025-10-02T08:07:47.468472Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:47.468484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.468487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.468489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:47.468499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.468509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:47.468524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533107992037223:3706]
2025-10-02T08:07:47.468537Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:47.468554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:47.468573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.468686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.468696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.468712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.468769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 129 partition: 0 MaxSeqNo: 17 sessionId: src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0
2025-10-02T08:07:47.469146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c985b98c-5ffd3342-3fc96bcc-d0b7bea9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:47.471654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0] Write session: try to update token
2025-10-02T08:07:47.471673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:47.486297Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:47.486324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:47.486326Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:47.486336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533107992037223:3706]
2025-10-02T08:07:47.486340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533107992037223:3706]
2025-10-02T08:07:47.486384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:47.486387Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:47.486393Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:47.486396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.486398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:47.486555Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:47.487098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId: src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:47.489843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:47.545982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533107992037271:3491]
2025-10-02T08:07:47.546178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 128, pipe: [1:7556533107992037271:3491]
2025-10-02T08:07:47.625018Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:47.625358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.625376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.625413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992037271:3491], now have 1 active actors on pipe
2025-10-02T08:07:47.625522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533107992037271:3491]
2025-10-02T08:07:47.625547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:47.625549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:47.625599Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:47.625608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 129 reason: error at write: Disconnected sessionId: src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0
2025-10-02T08:07:47.625652Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:47.625787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 129 sessionId: src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0 is DEAD
2025-10-02T08:07:47.625923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:47.625934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0] Write session will restart in 0.007560s
2025-10-02T08:07:47.625953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0] Write session: Do CDS request
2025-10-02T08:07:47.625958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:47.634332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.634400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:47.634417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 130
2025-10-02T08:07:47.634575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.634618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:47.634629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:47.634632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:47.635027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 130 sessionId:  describe result for acl check
2025-10-02T08:07:47.635061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:47.635066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:47.635068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:47.635073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533107992037672:3713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:47.635568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533107992037672:3713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:47.636590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:47.637321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:47.637468Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:47.637477Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:47.637486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:47.637528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:47.637567Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533107992037708:3712]
2025-10-02T08:07:47.637580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533107992037672:3713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:47.638123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:47.638304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:47.638358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:47.638645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:47.638693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.638698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.638699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.638700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.638701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.638705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.638714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.638718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.638721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.638725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.638729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.638736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.638740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.638746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.638750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.638754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.638758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.638762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.638766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.638771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.638788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:47.643454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533107992037672:3713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:47.643471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533107992037672:3713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:47.643474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533107992037672:3713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:47.643483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:47.646535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:47.648159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:47.648192Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:47.648195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:47.648199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:47.648207Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 129 [1:7556533107992037708:3712]
2025-10-02T08:07:47.648218Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:47.648238Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:47.648245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.648248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.648249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.648262Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:47.648271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:47.648278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:47.648339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.648346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.648349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:47.648351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:47.648414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:47.648422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.648435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.648446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:47.648468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992037735:3713], now have 1 active actors on pipe
2025-10-02T08:07:47.648476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533108452476688:2378], now have 1 active actors on pipe
2025-10-02T08:07:47.648484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533107992037698:3712]
2025-10-02T08:07:47.648486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 129
2025-10-02T08:07:47.648491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533107992037698:3712]
2025-10-02T08:07:47.648506Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:47.648523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:47.648524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:47.648528Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:47.648541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:47.648548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:47.648555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.648563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.648538Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 129
2025-10-02T08:07:47.648600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533107992037698:3712]
2025-10-02T08:07:47.648616Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:47.648631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:47.648637Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:47.648642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.648646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.648647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:47.648657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.648665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:47.648743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.648794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.648818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.648834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.648876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 130 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0
2025-10-02T08:07:47.649299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74fbdeb8-8decdf7c-65c1dce2-fb60534a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:47.651621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0] Write session: try to update token
2025-10-02T08:07:47.651636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:47.666780Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:47.666796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:47.666797Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:47.666802Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533107992037698:3712]
2025-10-02T08:07:47.666805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533107992037698:3712]
2025-10-02T08:07:47.666841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:47.666847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.666849Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:47.666850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:47.666853Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:47.666985Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:47.692860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId: src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:47.695645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:47.725671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533107992037779:3491]
2025-10-02T08:07:47.725800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 129, pipe: [1:7556533107992037779:3491]
2025-10-02T08:07:47.803139Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:47.803471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.803483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.803500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992037779:3491], now have 1 active actors on pipe
2025-10-02T08:07:47.803580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533107992037779:3491]
2025-10-02T08:07:47.803610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:47.803612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:47.803645Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:47.803672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 130 reason: error at write: Disconnected sessionId: src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0
2025-10-02T08:07:47.803752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:47.803853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 130 sessionId: src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0 is DEAD
2025-10-02T08:07:47.804028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:47.804041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0] Write session will restart in 0.008118s
2025-10-02T08:07:47.804065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0] Write session: Do CDS request
2025-10-02T08:07:47.804071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:47.813352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.813434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:47.813452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 131
2025-10-02T08:07:47.813614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.813645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:47.813653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:47.813656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:47.814022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 131 sessionId:  describe result for acl check
2025-10-02T08:07:47.814051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:47.814058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:47.814059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:47.814064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533107992038194:3732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:47.814578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533107992038194:3732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:47.814954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:47.815514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:47.815692Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:47.815704Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:47.815713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:47.815758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:47.815793Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533107992038225:3729]
2025-10-02T08:07:47.816357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533107992038194:3732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:47.816458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:47.816626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:47.816667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:47.816981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:47.817028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.817034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.817036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.817037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.817038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.817043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.817053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.817057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.817061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.817065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.817071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.817078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.817083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.817089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.817098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.817107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.817116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.817134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.817143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.817155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.817175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:47.821727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533107992038194:3732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:47.821743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533107992038194:3732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:47.821746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533107992038194:3732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:47.821753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:47.824948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:47.826629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:47.826648Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:47.826650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:47.826652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:47.826656Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 130 [1:7556533107992038225:3729]
2025-10-02T08:07:47.826665Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:47.826678Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:47.826679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.826681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.826683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.826694Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:47.826701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:47.826706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:47.826750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.826756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.826758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:47.826760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:47.826807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:47.826812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.826821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.826831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:47.826846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533107992038208:3729]
2025-10-02T08:07:47.826852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533107992038208:3729]
2025-10-02T08:07:47.826858Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:47.826869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:47.826874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:47.826877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:47.826881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 130
2025-10-02T08:07:47.826886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:47.826888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:47.826896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992038254:3732], now have 1 active actors on pipe
2025-10-02T08:07:47.826903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533108452476709:2378], now have 1 active actors on pipe
2025-10-02T08:07:47.826928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.826936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.826945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533107992038208:3729]
2025-10-02T08:07:47.826956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:47.826979Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:47.826986Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:47.826986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.826989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.826965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 130
2025-10-02T08:07:47.826991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:47.826996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.827003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:47.827023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.827114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.827132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.827156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.827192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 131 partition: 0 MaxSeqNo: 17 sessionId: src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0
2025-10-02T08:07:47.827595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf49bd5c-9f9673fe-1d979f58-659a15fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:47.830485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0] Write session: try to update token
2025-10-02T08:07:47.830509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:47.843885Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:47.843903Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:47.843905Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:47.843912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533107992038208:3729]
2025-10-02T08:07:47.843915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533107992038208:3729]
2025-10-02T08:07:47.843947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:47.843952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.843954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:47.843961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:47.843967Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:47.844088Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:47.847511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId: src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:47.850109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:47.903837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533107992038269:3491]
2025-10-02T08:07:47.903975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 130, pipe: [1:7556533107992038269:3491]
2025-10-02T08:07:47.975966Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:47.976384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.976396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.976434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992038269:3491], now have 1 active actors on pipe
2025-10-02T08:07:47.976577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:47.976587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:47.976641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 131 reason: error at write: Disconnected sessionId: src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0
2025-10-02T08:07:47.976721Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:47.976764Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:47.976843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 131 sessionId: src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0 is DEAD
2025-10-02T08:07:47.976980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:47.976991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0] Write session will restart in 0.008546s
2025-10-02T08:07:47.977015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0] Write session: Do CDS request
2025-10-02T08:07:47.977023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:47.977077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533107992038269:3491]
2025-10-02T08:07:47.986239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.986303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:47.986320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 132
2025-10-02T08:07:47.986430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:47.986460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:47.986471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:47.986475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:47.986966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 132 sessionId:  describe result for acl check
2025-10-02T08:07:47.987004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:47.987008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:47.987009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:47.987012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533107992038676:3738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:47.987407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533107992038676:3738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:47.987749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:47.988251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:47.988369Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:47.988377Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:47.988383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:47.988420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:47.988457Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533107992038709:3737]
2025-10-02T08:07:47.988875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:47.989018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:47.989025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533107992038676:3738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:47.989053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:47.989267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:47.989295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.989299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.989300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.989300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.989301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.989304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.989310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.989312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.989314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.989317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.989320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.989324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:47.989327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.989329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:47.989331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.989334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:47.989336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.989339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.989341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.989343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.989353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:47.994702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533107992038676:3738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:47.994717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533107992038676:3738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:47.994720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533107992038676:3738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:47.994726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:47.996730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:47.998443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:47.998461Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:47.998463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:47.998466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:47.998471Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 131 [1:7556533107992038709:3737]
2025-10-02T08:07:47.998481Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:47.998496Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:47.998498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.998501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.998503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.998517Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:47.998522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:47.998528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:47.998586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.998596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.998600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:47.998602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:47.998667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:47.998674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:47.998687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:47.998702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:47.998713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 131
2025-10-02T08:07:47.998722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533107992038736:3738], now have 1 active actors on pipe
2025-10-02T08:07:47.998728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533107992038692:3737]
2025-10-02T08:07:47.998730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533107992038692:3737]
2025-10-02T08:07:47.998737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:47.998747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:47.998749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:47.998751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:47.998760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:47.998763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:47.998768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533108452476724:2378], now have 1 active actors on pipe
2025-10-02T08:07:47.998773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.998777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.998814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533107992038692:3737]
2025-10-02T08:07:47.998830Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:47.998843Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:47.998844Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e49d3752-3f747408-90a21a06-db2f6126_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:47.998849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:47.998853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:47.998855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:47.998865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:47.998873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:47.998846Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 131
2025-10-02T08:07:47.998917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.998964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:47.998970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:47.998982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:47.999021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 132 partition: 0 MaxSeqNo: 17 sessionId: src_id|e49d3752-3f747408-90a21a06-db2f6126_0
2025-10-02T08:07:47.999353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2856cbd9-9ad93e40-2bb324eb-8f2e17c3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e49d3752-3f747408-90a21a06-db2f6126_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:48.002434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e49d3752-3f747408-90a21a06-db2f6126_0] Write session: try to update token
2025-10-02T08:07:48.002450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e49d3752-3f747408-90a21a06-db2f6126_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:48.016713Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:48.016735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:48.016738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:48.016747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533107992038692:3737]
2025-10-02T08:07:48.016752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533107992038692:3737]
2025-10-02T08:07:48.016792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:48.016820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.016821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:48.016827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:48.016827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:48.016981Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:48.017759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId: src_id|e49d3752-3f747408-90a21a06-db2f6126_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:48.020459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:48.077402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533112287006048:3491]
2025-10-02T08:07:48.077542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 131, pipe: [1:7556533112287006048:3491]
2025-10-02T08:07:48.118325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:07:48.118351Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T08:07:48.154125Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:48.154474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.154486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.154522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287006048:3491], now have 1 active actors on pipe
2025-10-02T08:07:48.154645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533112287006048:3491]
2025-10-02T08:07:48.154662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:48.154667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:48.154717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 132 reason: error at write: Disconnected sessionId: src_id|e49d3752-3f747408-90a21a06-db2f6126_0
2025-10-02T08:07:48.154770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:48.154805Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:48.154825Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-02T08:07:48.154917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 132 sessionId: src_id|e49d3752-3f747408-90a21a06-db2f6126_0 is DEAD
2025-10-02T08:07:48.155065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49d3752-3f747408-90a21a06-db2f6126_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:48.155075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49d3752-3f747408-90a21a06-db2f6126_0] Write session will restart in 0.006207s
2025-10-02T08:07:48.155097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49d3752-3f747408-90a21a06-db2f6126_0] Write session: Do CDS request
2025-10-02T08:07:48.155104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49d3752-3f747408-90a21a06-db2f6126_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:48.162252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e49d3752-3f747408-90a21a06-db2f6126_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.162306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:48.162320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 133
2025-10-02T08:07:48.162445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.162472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:48.162480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:48.162483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:48.162868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 133 sessionId:  describe result for acl check
2025-10-02T08:07:48.162895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:48.162901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:48.162902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:48.162906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533112287006350:3746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:48.163373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533112287006350:3746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:48.165612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533112287006350:3746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:48.166802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:48.167275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:48.167422Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:48.167431Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:48.167439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:48.167474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:48.167507Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533112287006515:3745]
2025-10-02T08:07:48.168063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:48.168140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533112287006350:3746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:48.168153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533112287006350:3746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:48.168156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533112287006350:3746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:48.168163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:48.168213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:48.168248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:48.168503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:48.168539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.168544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.168545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.168546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.168546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.168550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.168559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.168562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.168565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.168569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.168573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.168579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.168589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.168595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.168603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.168607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.168611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.168620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.168625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.168629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.168646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:48.176135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:48.177819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:48.177834Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:48.177836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:48.177838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:48.177843Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 132 [1:7556533112287006515:3745]
2025-10-02T08:07:48.177854Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:48.177870Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:48.177874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.177876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.177878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.177889Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:48.177892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:48.177897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:48.177938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.177944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.177946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:48.177948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:48.177991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:48.177997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.178004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.178011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:48.178022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533112287006509:3745]
2025-10-02T08:07:48.178024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533112287006509:3745]
2025-10-02T08:07:48.178028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:48.178035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287006525:3746], now have 1 active actors on pipe
2025-10-02T08:07:48.178040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:48.178046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 132
2025-10-02T08:07:48.178047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:48.178049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:48.178050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:48.178050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:48.178074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533112747444039:2378], now have 1 active actors on pipe
2025-10-02T08:07:48.178078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.178086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.178098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533112287006509:3745]
2025-10-02T08:07:48.178108Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:48.178116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:48.178129Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:48.178138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.178140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.178141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:48.178148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.178154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:48.178131Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 132
2025-10-02T08:07:48.178170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.178297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.178305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.178351Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:07:48.178380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.178414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 133 partition: 0 MaxSeqNo: 17 sessionId: src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0
2025-10-02T08:07:48.178558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:07:48.178663Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:07:48.178794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49d3752-3f747408-90a21a06-db2f6126_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:48.178865Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-02T08:07:48.181394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0] Write session: try to update token
2025-10-02T08:07:48.181406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:48.197789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId: src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:48.198982Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:48.198998Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:48.199000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:48.199010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533112287006509:3745]
2025-10-02T08:07:48.199014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533112287006509:3745]
2025-10-02T08:07:48.199053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:48.199070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.199072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:48.199123Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:48.199138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:48.199218Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:48.200851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:48.255061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533112287006553:3491]
2025-10-02T08:07:48.255239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 132, pipe: [1:7556533112287006553:3491]
2025-10-02T08:07:48.334592Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:48.334870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.334887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.334932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287006553:3491], now have 1 active actors on pipe
2025-10-02T08:07:48.335064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:48.335081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:48.335138Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:48.335178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 133 reason: error at write: Disconnected sessionId: src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0
2025-10-02T08:07:48.335208Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:48.335374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 133 sessionId: src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0 is DEAD
2025-10-02T08:07:48.335443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533112287006553:3491]
2025-10-02T08:07:48.335541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:48.335552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0] Write session will restart in 0.007925s
2025-10-02T08:07:48.335578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0] Write session: Do CDS request
2025-10-02T08:07:48.335585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:48.344340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.344544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:48.344567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 134
2025-10-02T08:07:48.344688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.344719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:48.344728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:48.344732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:48.345292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 134 sessionId:  describe result for acl check
2025-10-02T08:07:48.345333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:48.345338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:48.345340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:48.345345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533112287006951:3754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:48.345847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533112287006951:3754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:48.347329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:48.348028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:48.348162Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:48.348185Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:48.348194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:48.348235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:48.348263Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533112287007008:3753]
2025-10-02T08:07:48.348461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533112287006951:3754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:48.348709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:48.348911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:48.348977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:48.349329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:48.349392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.349400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.349401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.349402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.349405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.349411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.349420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.349424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.349427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.349429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.349433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.349438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.349442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.349445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.349447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.349450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.349452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.349455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.349457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.349460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.349470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:48.354325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533112287006951:3754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:48.354347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533112287006951:3754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:48.354350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533112287006951:3754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:48.354360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:48.357381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:48.359285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:48.359306Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:48.359309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:48.359313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:48.359321Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 133 [1:7556533112287007008:3753]
2025-10-02T08:07:48.359335Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:48.359353Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:48.359359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.359362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.359365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.359379Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:48.359390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:48.359397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:48.359473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.359481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.359485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:48.359488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:48.359562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:48.359569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.359584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.359601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:48.359628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533112747444051:2378], now have 1 active actors on pipe
2025-10-02T08:07:48.359642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533112287006997:3753]
2025-10-02T08:07:48.359644Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533112287006997:3753]
2025-10-02T08:07:48.359659Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:48.359669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287007035:3754], now have 1 active actors on pipe
2025-10-02T08:07:48.359680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:48.359682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:48.359683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 133
2025-10-02T08:07:48.359696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:48.359676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 133
2025-10-02T08:07:48.359696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:48.359700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:48.359741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533112287006997:3753]
2025-10-02T08:07:48.359754Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:48.359761Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:48.359767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.359772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.359832Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:48.359843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.359847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.359849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:48.359863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.359876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:48.359903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.359943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.359949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.359963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.360000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 134 partition: 0 MaxSeqNo: 17 sessionId: src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0
2025-10-02T08:07:48.360381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86ef047-b61dafa0-968fe6f6-32550daf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:48.363518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0] Write session: try to update token
2025-10-02T08:07:48.363536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:48.377848Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:48.377869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:48.377871Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:48.377880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533112287006997:3753]
2025-10-02T08:07:48.377884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533112287006997:3753]
2025-10-02T08:07:48.377927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:48.377932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.377935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:48.377943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:48.377950Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:48.378079Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:48.379752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId: src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:48.382332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:48.435787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533112287007052:3491]
2025-10-02T08:07:48.435891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 133, pipe: [1:7556533112287007052:3491]
2025-10-02T08:07:48.512629Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:48.513044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.513061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.513102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287007052:3491], now have 1 active actors on pipe
2025-10-02T08:07:48.513211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533112287007052:3491]
2025-10-02T08:07:48.513327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:48.513286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:48.513297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:48.513350Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:48.513356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 134 reason: error at write: Disconnected sessionId: src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0
2025-10-02T08:07:48.513522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 134 sessionId: src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0 is DEAD
2025-10-02T08:07:48.513742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:48.513759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0] Write session will restart in 0.009715s
2025-10-02T08:07:48.513786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0] Write session: Do CDS request
2025-10-02T08:07:48.513792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:48.524396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.524489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:48.524509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 135
2025-10-02T08:07:48.524700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.524735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:48.524744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:48.524748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:48.524751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:48.525121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 135 sessionId:  describe result for acl check
2025-10-02T08:07:48.525160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:48.525166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:48.525167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:48.525173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533112287007480:3761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:48.525507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:48.525655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533112287007480:3761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:48.525712Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:48.525723Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:48.525736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:48.525803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:48.525843Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533112287007483:3759]
2025-10-02T08:07:48.526474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:48.526737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:48.526793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:48.527105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:48.527176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.527182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.527183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.527184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.527185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.527190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.527199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.527203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.527207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.527211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.527216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.527223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.527229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.527239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.527243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.527247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.527251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.527259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.527264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.527273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.527295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:48.527706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533112287007480:3761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:48.534207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533112287007480:3761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:48.534229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533112287007480:3761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:48.534233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533112287007480:3761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:48.534242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:48.535227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:48.537677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 134
2025-10-02T08:07:48.537264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:48.537284Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:48.537287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:48.537291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:48.537299Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 134 [1:7556533112287007483:3759]
2025-10-02T08:07:48.537313Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:48.537330Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:48.537333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.537336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.537338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.537356Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:48.537361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:48.537369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:48.537439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.537441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.537443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:48.537445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:48.537648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:48.537651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.537665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.537675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:48.537695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287007528:3761], now have 1 active actors on pipe
2025-10-02T08:07:48.537699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533112747444057:2378], now have 1 active actors on pipe
2025-10-02T08:07:48.537705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533112287007474:3759]
2025-10-02T08:07:48.537707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533112287007474:3759]
2025-10-02T08:07:48.537714Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:48.537723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:48.537726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:48.537729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:48.537742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:48.537745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:48.537787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533112287007474:3759]
2025-10-02T08:07:48.537798Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:48.537840Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:48.537846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 134
2025-10-02T08:07:48.538011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.538026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.538049Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f0d1011-b01b7285-4251e30d-9385711_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:48.538056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.538060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.538061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:48.538070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.538079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:48.538102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.538155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.538163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.538176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.538210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 135 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f0d1011-b01b7285-4251e30d-9385711_0
2025-10-02T08:07:48.538675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb5885e-59a801e1-fbf0b537-dfafe12d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f0d1011-b01b7285-4251e30d-9385711_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:48.541797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d1011-b01b7285-4251e30d-9385711_0] Write session: try to update token
2025-10-02T08:07:48.541822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d1011-b01b7285-4251e30d-9385711_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:48.557698Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:48.557721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:48.557724Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:48.557734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533112287007474:3759]
2025-10-02T08:07:48.557742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533112287007474:3759]
2025-10-02T08:07:48.557791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:48.557790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:48.557797Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:48.557802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.557804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:48.557958Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:48.559679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId: src_id|1f0d1011-b01b7285-4251e30d-9385711_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:48.562856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:48.613496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533112287007541:3491]
2025-10-02T08:07:48.613631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 134, pipe: [1:7556533112287007541:3491]
2025-10-02T08:07:48.707299Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:48.707492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.707504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.707540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287007541:3491], now have 1 active actors on pipe
2025-10-02T08:07:48.707665Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:48.707746Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:48.707967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:48.708024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 135 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f0d1011-b01b7285-4251e30d-9385711_0
2025-10-02T08:07:48.708229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 135 sessionId: src_id|1f0d1011-b01b7285-4251e30d-9385711_0 is DEAD
2025-10-02T08:07:48.708340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533112287007541:3491]
2025-10-02T08:07:48.708507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d1011-b01b7285-4251e30d-9385711_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:48.708520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d1011-b01b7285-4251e30d-9385711_0] Write session will restart in 0.007291s
2025-10-02T08:07:48.708542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d1011-b01b7285-4251e30d-9385711_0] Write session: Do CDS request
2025-10-02T08:07:48.708548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d1011-b01b7285-4251e30d-9385711_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:48.717433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d1011-b01b7285-4251e30d-9385711_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.717491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:48.717511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 136
2025-10-02T08:07:48.717655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.717685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:48.717694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:48.717697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:48.718276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 136 sessionId:  describe result for acl check
2025-10-02T08:07:48.718308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:48.718313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:48.718315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:48.718318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533112287007968:3772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:48.719567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:48.719654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533112287007968:3772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:48.720332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:48.720499Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:48.720508Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:48.720517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:48.720562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:48.720609Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533112287008001:3771]
2025-10-02T08:07:48.721252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:48.721535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:48.721580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:48.721904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:48.721969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.721976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.721977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.721978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.721979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.721984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.721993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.721997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.722002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.722006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.722011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.722018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.722028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.722034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.722042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.722047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.722051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.722056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.722064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.722069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.722088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:48.723087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533112287007968:3772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:48.728838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533112287007968:3772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:48.728858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533112287007968:3772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:48.728861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533112287007968:3772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:48.728871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:48.729869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:48.731540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:48.731559Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:48.731562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:48.731566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:48.731571Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 135 [1:7556533112287008001:3771]
2025-10-02T08:07:48.731582Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:48.731597Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:48.731600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.731603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.731604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.731619Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:48.731629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:48.731635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:48.731697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.731704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.731707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:48.731710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:48.731770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:48.731778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.731793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.731809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:48.731831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533112747444063:2378], now have 1 active actors on pipe
2025-10-02T08:07:48.731841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533112287007981:3771]
2025-10-02T08:07:48.731843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533112287007981:3771]
2025-10-02T08:07:48.731859Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:48.731875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:48.731895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:48.731902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:48.731902Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 135
2025-10-02T08:07:48.731934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533112287007981:3771]
2025-10-02T08:07:48.731941Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:48.731946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:48.731949Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:48.731957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:48.732192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 135
2025-10-02T08:07:48.732204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287008031:3772], now have 1 active actors on pipe
2025-10-02T08:07:48.732265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.732279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.732305Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:48.732333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.732342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.732344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:48.732354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.732367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:48.732385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.732437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.732443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.732454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.732492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 136 partition: 0 MaxSeqNo: 17 sessionId: src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0
2025-10-02T08:07:48.732896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d1011-b01b7285-4251e30d-9385711_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:48.735399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0] Write session: try to update token
2025-10-02T08:07:48.735417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:48.748009Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:48.748029Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:48.748037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533112287007981:3771]
2025-10-02T08:07:48.748088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:48.748091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:48.748294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:48.748469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:48.748622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:48.748774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:48.748999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:48.749038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:48.751198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId: src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:48.754118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:48.754187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.754199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.754238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:48.754272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:48.754481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.754492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.754700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.754770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.754837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.754902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.754970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.754975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.755055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.755121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.755193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.755267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.755322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.755325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.755421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.755503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.755576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.755647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.755698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.755701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.755783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.755850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.755925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.756371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.756504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.756518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.756623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.756682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.756741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.756822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.756878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.756889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.756988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.757075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.757142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.757204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.757259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.757266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.757337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.757402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.757483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.757584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.757645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.757648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.757716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.757776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.757841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.757910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.757967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.757978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.758079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.758163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.758228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.758293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.758360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.758369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.758444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:48.758511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:48.758582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:48.758649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:48.758726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:48.758736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:48.758801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:48.758865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.758892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.758900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:48.758932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:48.758950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:48.758960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:48.758964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:48.758967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:48.759406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:48.759438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:48.759445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:48.759449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:48.759453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:48.759456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:48.760145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:48.760185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:48.760192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:48.760197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:48.760200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:48.760204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:48.760672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:48.760697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:48.760703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:48.760707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:48.760710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:48.763022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:48.763041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:48.763057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392468762
2025-10-02T08:07:48.763185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:48.763202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:48.763208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:48.763212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:48.763217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:48.763221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:48.763942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:48.763972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:48.763980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:48.763985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:48.763989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:48.763993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:48.764510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:48.764539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:48.764548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:48.764551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:48.764556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:48.764559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:48.765382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:48.765411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:48.765417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:48.766641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:48.766649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:48.766655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:48.766660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:48.766673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392468766
2025-10-02T08:07:48.767014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:48.767026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:48.767033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:48.767037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:48.767042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:48.767046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:48.767551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:48.767566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:48.767572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:48.767576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:48.767580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:48.767584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:48.768120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:48.768133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.768262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392468768
2025-10-02T08:07:48.770898Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:48.770941Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:48.770952Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:48.770961Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:48.770977Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:48.770979Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:48.770982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:48.770990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533112287007981:3771]
2025-10-02T08:07:48.770994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533112287007981:3771]
2025-10-02T08:07:48.771047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:48.771065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:48.771076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:48.771080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.771082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:48.771225Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:48.808587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533112287008064:3491]
2025-10-02T08:07:48.808735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 135, pipe: [1:7556533112287008064:3491]
2025-10-02T08:07:48.929541Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:48.930077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287008064:3491], now have 1 active actors on pipe
2025-10-02T08:07:48.930497Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:48.930518Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:48.931249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:48.931260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0] Write session will restart in 0.008338s
2025-10-02T08:07:48.931286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0] Write session: Do CDS request
2025-10-02T08:07:48.931293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:48.930850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:48.930893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533112287008064:3491]
2025-10-02T08:07:48.930903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 136 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0
2025-10-02T08:07:48.931111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 136 sessionId: src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0 is DEAD
2025-10-02T08:07:48.934620Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [149eee72a6675a9e] Result# TEvPutResult {Id# [72075186224037892:135:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:48.934637Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:135:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:48.934711Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:135:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:48.940511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.940932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:48.940958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 137
2025-10-02T08:07:48.941121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:48.941157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:48.941169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:48.941174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:48.941631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 137 sessionId:  describe result for acl check
2025-10-02T08:07:48.941671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:48.941681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:48.941682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:48.941687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533112287008386:3785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:48.942221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533112287008386:3785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:48.945265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533112287008386:3785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:48.946631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:48.947319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:48.947455Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:48.947465Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:48.947471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:48.947502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:48.947529Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533112287008537:3784]
2025-10-02T08:07:48.947999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:48.948148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:48.948186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:48.948398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:48.948432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.948438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.948439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.948440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.948440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.948443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.948450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.948452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.948453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.948456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.948459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.948463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:48.948467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.948470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:48.948472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.948476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:48.948479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.948481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.948483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.948486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.948498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:48.949140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533112287008386:3785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:48.949150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533112287008386:3785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:48.949152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533112287008386:3785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:48.949158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:48.961919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:48.964710Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 136
2025-10-02T08:07:48.963834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:48.963858Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:48.963861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:48.963865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:48.963874Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 136 [1:7556533112287008537:3784]
2025-10-02T08:07:48.963888Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:48.963910Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:48.963912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.963914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.963916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.963931Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:48.963939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:48.963948Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:48.964016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.964018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.964020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:48.964023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:48.964087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:48.964089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.964100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:48.964108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:48.964130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533112287008525:3784]
2025-10-02T08:07:48.964132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533112287008525:3784]
2025-10-02T08:07:48.964141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:48.964156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:48.964240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:48.964242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:48.964243Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:48.964244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 136
2025-10-02T08:07:48.964247Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:48.964286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533112287008553:3785], now have 1 active actors on pipe
2025-10-02T08:07:48.964289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533112287008525:3784]
2025-10-02T08:07:48.964291Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:48.964295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533112747444095:2378], now have 1 active actors on pipe
2025-10-02T08:07:48.964299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.964302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.964344Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39dbd821-9037a57b-bb79c60f-f472db15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:48.964352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:48.964356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:48.964358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:48.964369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:48.964380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:48.964393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.964609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:48.964688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:48.964691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:48.964705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:48.964741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 137 partition: 0 MaxSeqNo: 17 sessionId: src_id|39dbd821-9037a57b-bb79c60f-f472db15_0
2025-10-02T08:07:48.965595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6473cf7-cb097c50-547fd6ee-9259573d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|39dbd821-9037a57b-bb79c60f-f472db15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:48.968131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39dbd821-9037a57b-bb79c60f-f472db15_0] Write session: try to update token
2025-10-02T08:07:48.968153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39dbd821-9037a57b-bb79c60f-f472db15_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:48.983355Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:48.983387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:48.983390Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:48.983405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533112287008525:3784]
2025-10-02T08:07:48.983410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533112287008525:3784]
2025-10-02T08:07:48.983462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:48.983472Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:48.983474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:48.983477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:48.983478Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:48.983628Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:48.986620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId: src_id|39dbd821-9037a57b-bb79c60f-f472db15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:48.989741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:49.031343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533116581975865:3491]
2025-10-02T08:07:49.031454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 136, pipe: [1:7556533116581975865:3491]
2025-10-02T08:07:49.130441Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:49.130759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.130779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.130820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581975865:3491], now have 1 active actors on pipe
2025-10-02T08:07:49.130949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:49.130966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:49.131032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 137 reason: error at write: Disconnected sessionId: src_id|39dbd821-9037a57b-bb79c60f-f472db15_0
2025-10-02T08:07:49.131044Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:49.131060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:49.131302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 137 sessionId: src_id|39dbd821-9037a57b-bb79c60f-f472db15_0 is DEAD
2025-10-02T08:07:49.131328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533116581975865:3491]
2025-10-02T08:07:49.131394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39dbd821-9037a57b-bb79c60f-f472db15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:49.131403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39dbd821-9037a57b-bb79c60f-f472db15_0] Write session will restart in 0.005278s
2025-10-02T08:07:49.131431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39dbd821-9037a57b-bb79c60f-f472db15_0] Write session: Do CDS request
2025-10-02T08:07:49.131440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39dbd821-9037a57b-bb79c60f-f472db15_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:49.138368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39dbd821-9037a57b-bb79c60f-f472db15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.138442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:49.138462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 138
2025-10-02T08:07:49.138578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.138601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:49.138608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:49.138612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:49.139011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 138 sessionId:  describe result for acl check
2025-10-02T08:07:49.139051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:49.139052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:49.139053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:49.139057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533116581976133:3792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:49.139607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533116581976133:3792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:49.142110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533116581976133:3792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:49.144625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:49.145160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:49.145351Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:49.145364Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:49.145375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:49.145422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:49.145478Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533116581976340:3791]
2025-10-02T08:07:49.145811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533116581976133:3792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:49.145826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533116581976133:3792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:49.145830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533116581976133:3792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:49.145839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:49.146106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:49.146317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:49.146365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:49.146690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:49.146745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.146751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.146752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.146754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.146755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.146760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.146770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.146774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.146778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.146781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.146787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.146795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.146802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.146806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.146811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.146816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.146820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.146825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.146831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.146836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.146857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:49.156141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:49.157771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:49.157799Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:49.157802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:49.157807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:49.157814Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 137 [1:7556533116581976340:3791]
2025-10-02T08:07:49.157824Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:49.157843Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:49.157846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.157848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.157850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.157863Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:49.157867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:49.157873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:49.157949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.157959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.157962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:49.157965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:49.158022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:49.158032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.158048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.158061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:49.158088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581976345:3792], now have 1 active actors on pipe
2025-10-02T08:07:49.158100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533116581976334:3791]
2025-10-02T08:07:49.158102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 137
2025-10-02T08:07:49.158102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533116581976334:3791]
2025-10-02T08:07:49.158111Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:49.158122Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:49.158123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:49.158132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:49.158133Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:49.158135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:49.158139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533117042411410:2378], now have 1 active actors on pipe
2025-10-02T08:07:49.158143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.158146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.158185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533116581976334:3791]
2025-10-02T08:07:49.158201Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:49.158212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:49.158222Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:49.158233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.158237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.158239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:49.158247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.158255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:49.158237Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 137
2025-10-02T08:07:49.158301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.158359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.158367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.158379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.158421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 138 partition: 0 MaxSeqNo: 17 sessionId: src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0
2025-10-02T08:07:49.158755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39dbd821-9037a57b-bb79c60f-f472db15_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:49.161107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0] Write session: try to update token
2025-10-02T08:07:49.161122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:49.177255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId: src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:49.178383Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:49.178407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:49.178410Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:49.178419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533116581976334:3791]
2025-10-02T08:07:49.178423Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533116581976334:3791]
2025-10-02T08:07:49.178467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:49.178468Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:49.178478Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:49.178480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.178482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:49.178650Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:49.179949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:49.231424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533116581976372:3491]
2025-10-02T08:07:49.231533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 137, pipe: [1:7556533116581976372:3491]
E1002 08:07:49.240118723  540992 chttp2_transport.cc:1143]             ipv4:127.0.0.1:25313: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T08:07:49.317575Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:49.317871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.317886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.317928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581976372:3491], now have 1 active actors on pipe
2025-10-02T08:07:49.318019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:49.318039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:49.318112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 138 reason: error at write: Disconnected sessionId: src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0
2025-10-02T08:07:49.318167Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:49.318298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 138 sessionId: src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0 is DEAD
2025-10-02T08:07:49.318455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533116581976372:3491]
2025-10-02T08:07:49.318475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:49.318485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0] Write session will restart in 0.007189s
2025-10-02T08:07:49.318506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0] Write session: Do CDS request
2025-10-02T08:07:49.318515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:49.318963Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:49.327324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.327422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:49.327443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 139
2025-10-02T08:07:49.327558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.327589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:49.327599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:49.327602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:49.328011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 139 sessionId:  describe result for acl check
2025-10-02T08:07:49.328035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:49.328037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:49.328038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:49.328042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533116581976731:3799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:49.328494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533116581976731:3799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:49.331447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533116581976731:3799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:49.331662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:49.332230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:49.332453Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:49.332464Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:49.332472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:49.332509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:49.332536Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533116581976843:3798]
2025-10-02T08:07:49.332985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:49.333234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:49.333304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:49.333682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:49.333729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.333736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.333738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.333739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.333740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.333746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.333757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.333761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.333765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.333769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.333776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.333785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.333792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.333798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.333803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.333808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.333812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.333818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.333823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.333828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.333850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:49.334238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533116581976731:3799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:49.334250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533116581976731:3799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:49.334253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533116581976731:3799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:49.334262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:49.342108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:49.343922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:49.343942Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:49.343944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:49.343947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:49.343953Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 138 [1:7556533116581976843:3798]
2025-10-02T08:07:49.343963Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:49.343979Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:49.343981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.343983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.343986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.344001Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:49.344005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:49.344012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:49.344079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.344086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.344089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:49.344091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:49.344152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:49.344172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.344184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.344195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:49.344215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533116581976827:3798]
2025-10-02T08:07:49.344220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533116581976827:3798]
2025-10-02T08:07:49.344228Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:49.344239Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:49.344243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533117042411419:2378], now have 1 active actors on pipe
2025-10-02T08:07:49.344251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:49.344256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:49.344258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 138
2025-10-02T08:07:49.344259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:49.344261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:49.344266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581976860:3799], now have 1 active actors on pipe
2025-10-02T08:07:49.344299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.344302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.344314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533116581976827:3798]
2025-10-02T08:07:49.344322Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:49.344331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:49.344348Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:49.344356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.344337Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 138
2025-10-02T08:07:49.344368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.344369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:49.344377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.344384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:49.344406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.344473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.344478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.344489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.344525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 139 partition: 0 MaxSeqNo: 17 sessionId: src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0
2025-10-02T08:07:49.344880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df751717-4b61dbe4-2a008a8b-bf39441c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:49.347232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0] Write session: try to update token
2025-10-02T08:07:49.347248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:49.361777Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:49.361800Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:49.361803Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:49.361813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533116581976827:3798]
2025-10-02T08:07:49.361822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533116581976827:3798]
2025-10-02T08:07:49.361871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:49.361873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:49.361879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.361883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:49.361884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:49.362038Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:49.362205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId: src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:49.364758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:49.418833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533116581976880:3491]
2025-10-02T08:07:49.418973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 138, pipe: [1:7556533116581976880:3491]
2025-10-02T08:07:49.490052Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:49.490447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.490466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.490506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581976880:3491], now have 1 active actors on pipe
2025-10-02T08:07:49.490651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:49.490663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:49.490710Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:49.490721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 139 reason: error at write: Disconnected sessionId: src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0
2025-10-02T08:07:49.490770Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:49.490872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 139 sessionId: src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0 is DEAD
2025-10-02T08:07:49.491019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:49.491028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0] Write session will restart in 0.009183s
2025-10-02T08:07:49.491009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533116581976880:3491]
2025-10-02T08:07:49.491052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0] Write session: Do CDS request
2025-10-02T08:07:49.491070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:49.501333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.501386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:49.501411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 140
2025-10-02T08:07:49.501571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.501606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:49.501616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:49.501621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:49.502034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 140 sessionId:  describe result for acl check
2025-10-02T08:07:49.502074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:49.502080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:49.502082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:49.502087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533116581977280:3807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:49.502644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533116581977280:3807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:49.504196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:49.504876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533116581977280:3807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:49.505020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:49.505186Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:49.505200Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:49.505210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:49.505262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:49.505318Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533116581977342:3806]
2025-10-02T08:07:49.506046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:49.506240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:49.506286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:49.506530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:49.506567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.506575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.506576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.506577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.506578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.506583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.506594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.506598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.506601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.506603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.506607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.506612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.506616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.506619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.506621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.506624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.506626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.506630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.506632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.506635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.506658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:49.507095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533116581977280:3807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:49.507110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533116581977280:3807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:49.507113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533116581977280:3807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:49.507121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:49.514788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:49.516352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:49.516367Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:49.516369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:49.516373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:49.516379Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 139 [1:7556533116581977342:3806]
2025-10-02T08:07:49.516389Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:49.516401Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:49.516403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.516405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.516406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.516419Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:49.516425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:49.516431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:49.516476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.516481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.516484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:49.516485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:49.516532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:49.516537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.516546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.516553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:49.516565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533116581977331:3806]
2025-10-02T08:07:49.516569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533116581977331:3806]
2025-10-02T08:07:49.516575Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:49.516584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:49.516594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:49.516595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:49.516621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533116581977331:3806]
2025-10-02T08:07:49.516626Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:49.516632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581977365:3807], now have 1 active actors on pipe
2025-10-02T08:07:49.516638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:49.516642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533117042411425:2378], now have 1 active actors on pipe
2025-10-02T08:07:49.516650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.516652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.516658Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:49.516667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:49.516672Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:49.516675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.516678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.516680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:49.516686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.516691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:49.516702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.516788Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 139
2025-10-02T08:07:49.517270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cfcf06-c42dea61-cb348114-c1a77ac2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:49.516795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 139
2025-10-02T08:07:49.516889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.516891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.516901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.516935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 140 partition: 0 MaxSeqNo: 17 sessionId: src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0
2025-10-02T08:07:49.519790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0] Write session: try to update token
2025-10-02T08:07:49.519807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:49.534713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId: src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:49.535082Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:49.535104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:49.535106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:49.535113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533116581977331:3806]
2025-10-02T08:07:49.535117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533116581977331:3806]
2025-10-02T08:07:49.535154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:49.535169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.535172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:49.535178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:49.535184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:49.535299Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:49.537328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:49.591408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533116581977379:3491]
2025-10-02T08:07:49.591489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 139, pipe: [1:7556533116581977379:3491]
2025-10-02T08:07:49.670076Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:49.670357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.670372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.670413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581977379:3491], now have 1 active actors on pipe
2025-10-02T08:07:49.670564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:49.670575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:49.670634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 140 reason: error at write: Disconnected sessionId: src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0
2025-10-02T08:07:49.670676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:49.670812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 140 sessionId: src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0 is DEAD
2025-10-02T08:07:49.670937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:49.670947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0] Write session will restart in 0.009864s
2025-10-02T08:07:49.670973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0] Write session: Do CDS request
2025-10-02T08:07:49.670979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:49.670975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533116581977379:3491]
2025-10-02T08:07:49.671055Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:49.682297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.682387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:49.682407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 141
2025-10-02T08:07:49.682587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.682613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:49.682621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:49.682625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:49.682798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:49.682962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 141 sessionId:  describe result for acl check
2025-10-02T08:07:49.683006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:49.683008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:49.683011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:49.683017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533116581977818:3814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:49.683449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533116581977818:3814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:49.683701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:49.683934Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:49.683943Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:49.683953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:49.683995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:49.684045Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533116581977826:3812]
2025-10-02T08:07:49.684503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:49.684684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:49.684735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:49.685094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:49.685142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.685151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.685152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.685152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.685153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.685158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.685164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.685166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.685168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.685170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.685174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.685179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.685183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.685186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.685189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.685192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.685194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.685198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.685201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.685204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.685216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:49.685624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533116581977818:3814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:49.692154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533116581977818:3814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:49.692186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533116581977818:3814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:49.692189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533116581977818:3814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:49.692195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:49.693127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:49.695039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:49.695055Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:49.695058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:49.695061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:49.695070Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 140 [1:7556533116581977826:3812]
2025-10-02T08:07:49.695084Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:49.695104Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:49.695110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.695113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.695116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.695135Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:49.695147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:49.695155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:49.695219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.695225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.695228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:49.695231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:49.695303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:49.695310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.695325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.695342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:49.695367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581977866:3814], now have 1 active actors on pipe
2025-10-02T08:07:49.695378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533116581977811:3812]
2025-10-02T08:07:49.695381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533116581977811:3812]
2025-10-02T08:07:49.695383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 140
2025-10-02T08:07:49.695390Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:49.695403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:49.695404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:49.695407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:49.695423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:49.695430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:49.695436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533117042411431:2378], now have 1 active actors on pipe
2025-10-02T08:07:49.695444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.695452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.695471Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 140
2025-10-02T08:07:49.695499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533116581977811:3812]
2025-10-02T08:07:49.695506Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:49.695514Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:49.695524Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de3e3347-f92cc547-d087a8ce-26079c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:49.695535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.695542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.695549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:49.695560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.695574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:49.695614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.695643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.695649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.695662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.695700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 141 partition: 0 MaxSeqNo: 17 sessionId: src_id|de3e3347-f92cc547-d087a8ce-26079c4_0
2025-10-02T08:07:49.696078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c0364d-8c1d98f0-54c54040-5bac32ee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de3e3347-f92cc547-d087a8ce-26079c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:49.698595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3e3347-f92cc547-d087a8ce-26079c4_0] Write session: try to update token
2025-10-02T08:07:49.698610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3e3347-f92cc547-d087a8ce-26079c4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:49.707332Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:49.707363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:49.707373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533116581977811:3812]
2025-10-02T08:07:49.707418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:49.707441Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:49.707643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:49.707799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:49.707948Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:49.708110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:49.708416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:49.708457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:49.713172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId: src_id|de3e3347-f92cc547-d087a8ce-26079c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:49.715816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:49.715892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.715908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.715941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:49.715968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:49.716017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.716034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.716210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.716281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.716357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.716426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.716542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.716552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.716637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.716711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.716785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.716892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.716953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.716961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.717179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.717260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.717322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.717392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.717439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.717448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.717519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.717585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.717644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.717710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.717759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.717766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.717824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.717882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.717938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.718002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.718056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.718066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.718138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.718200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.718269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.718338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.718392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.718400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.718465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.718521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.718595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.718655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.718700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.718706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.718766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.718820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.718878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.718938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.718986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.718993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.719054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.719117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.719181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.719246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.719295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.719301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.719361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:49.719419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:49.719476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:49.719537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:49.719593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:49.719602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:49.719647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:49.719705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.719722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.719729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:49.719757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:49.719772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:49.719781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:49.719783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:49.719787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:49.720176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:49.720202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:49.720207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:49.720210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:49.720212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:49.720214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:49.720896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:49.720920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:49.720926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:49.720928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:49.720930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:49.720933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:49.721384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:49.721404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:49.721408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:49.721410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:49.721412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:49.723423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:49.723450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:49.723459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392469723
2025-10-02T08:07:49.723603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:49.723615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:49.723620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:49.723623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:49.723625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:49.723627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:49.724090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:49.724112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:49.724116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:49.724119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:49.724121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:49.724125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:49.724612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:49.724634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:49.724639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:49.724642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:49.724644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:49.724647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:49.725211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:49.725240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:49.725247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:49.726398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:49.726419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:49.726423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:49.726427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:49.726433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392469725
2025-10-02T08:07:49.726689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:49.726711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:49.726716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:49.726719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:49.726723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:49.726726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:49.727153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:49.727171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:49.727175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:49.727177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:49.727180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:49.727182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:49.727598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:49.727613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.727691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392469727
2025-10-02T08:07:49.730912Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:49.730948Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:49.730952Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:49.730956Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:49.732674Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:49.732692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:49.732695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:49.732703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533116581977811:3812]
2025-10-02T08:07:49.732706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533116581977811:3812]
2025-10-02T08:07:49.732754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:49.732763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.732764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:49.732924Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:49.732988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:49.732996Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:49.775630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533116581977902:3491]
2025-10-02T08:07:49.777955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 140, pipe: [1:7556533116581977902:3491]
2025-10-02T08:07:49.865619Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:49.866016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581977902:3491], now have 1 active actors on pipe
2025-10-02T08:07:49.866105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533116581977902:3491]
2025-10-02T08:07:49.866123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:49.866129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:49.866150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 141 reason: error at write: Disconnected sessionId: src_id|de3e3347-f92cc547-d087a8ce-26079c4_0
2025-10-02T08:07:49.866225Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:49.866279Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:49.866355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 141 sessionId: src_id|de3e3347-f92cc547-d087a8ce-26079c4_0 is DEAD
2025-10-02T08:07:49.866536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3e3347-f92cc547-d087a8ce-26079c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:49.866549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3e3347-f92cc547-d087a8ce-26079c4_0] Write session will restart in 0.007832s
2025-10-02T08:07:49.866575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3e3347-f92cc547-d087a8ce-26079c4_0] Write session: Do CDS request
2025-10-02T08:07:49.866583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3e3347-f92cc547-d087a8ce-26079c4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:49.875318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3e3347-f92cc547-d087a8ce-26079c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.875412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:49.875436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 142
2025-10-02T08:07:49.875600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:49.875630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:49.875639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:49.875643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:49.876072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 142 sessionId:  describe result for acl check
2025-10-02T08:07:49.876112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:49.876120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:49.876122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:49.876128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533116581978246:3830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:49.876659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533116581978246:3830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:49.879708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533116581978246:3830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:49.880591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:49.881173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:49.881373Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:49.881385Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:49.881407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:49.881453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:49.881500Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533116581978391:3829]
2025-10-02T08:07:49.882106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:49.882301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:49.882344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:49.882539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533116581978246:3830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:49.882552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533116581978246:3830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:49.882556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533116581978246:3830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:49.882565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:49.882665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:49.882706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.882711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.882711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.882712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.882713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.882716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.882723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.882725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.882727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.882729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.882733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.882738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:49.882742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.882746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:49.882748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.882751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:49.882753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.882756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.882759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.882762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.882772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:49.890934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:49.892919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:49.892937Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:49.892939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:49.892943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:49.892949Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 141 [1:7556533116581978391:3829]
2025-10-02T08:07:49.892962Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:49.892980Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:49.892983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.892986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.892988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.893004Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:49.893008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:49.893014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:49.893096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.893104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.893107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:49.893111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:49.893181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:49.893190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.893203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:49.893219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:49.893246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581978402:3830], now have 1 active actors on pipe
2025-10-02T08:07:49.893246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 141
2025-10-02T08:07:49.893258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533116581978384:3829]
2025-10-02T08:07:49.893260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533116581978384:3829]
2025-10-02T08:07:49.893272Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:49.893285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533117042411453:2378], now have 1 active actors on pipe
2025-10-02T08:07:49.893293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.893295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:49.893296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.893298Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:49.893314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:49.893327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:49.893330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:49.893338Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 141
2025-10-02T08:07:49.893373Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:49.893389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:49.893393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:49.893395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:49.893407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:49.893417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:49.893425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533116581978384:3829]
2025-10-02T08:07:49.893435Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:49.893451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:49.893469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.893529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:49.893536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:49.893550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:49.893620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 142 partition: 0 MaxSeqNo: 17 sessionId: src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0
2025-10-02T08:07:49.894041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3e3347-f92cc547-d087a8ce-26079c4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:49.896749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0] Write session: try to update token
2025-10-02T08:07:49.896769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:49.911129Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:49.911155Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:49.911158Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:49.911166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533116581978384:3829]
2025-10-02T08:07:49.911172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533116581978384:3829]
2025-10-02T08:07:49.911213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:49.911213Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:49.911218Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:49.911220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:49.911223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:49.911361Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:49.911437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId: src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:49.914212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:49.966919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533116581978428:3491]
2025-10-02T08:07:49.967129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 141, pipe: [1:7556533116581978428:3491]
2025-10-02T08:07:50.075947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:50.075963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0] Write session will restart in 0.006220s
2025-10-02T08:07:50.075988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0] Write session: Do CDS request
2025-10-02T08:07:50.075994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:50.071841Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:50.072910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.072924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.072980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533116581978428:3491], now have 1 active actors on pipe
2025-10-02T08:07:50.075071Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:50.075486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533116581978428:3491]
2025-10-02T08:07:50.075510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:50.075563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 142 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0
2025-10-02T08:07:50.076212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 142 sessionId: src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0 is DEAD
2025-10-02T08:07:50.073593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:50.085319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:50.085689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:50.085716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 143
2025-10-02T08:07:50.085878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:50.085913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:50.085924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:50.085928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:50.086754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 143 sessionId:  describe result for acl check
2025-10-02T08:07:50.086799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:50.086806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:50.086808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:50.086814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533120876945937:3838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:50.087622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533120876945937:3838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:50.096289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533120876945937:3838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:50.107501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533120876945937:3838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:50.107524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533120876945937:3838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:50.107527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533120876945937:3838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:50.107538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:50.112117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:50.113738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:50.114051Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:50.114057Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:50.114074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:50.114173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:50.114221Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533120876946207:3837]
2025-10-02T08:07:50.114992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:50.115742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:50.115793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:50.116137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:50.116203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.116204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.116206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.116208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.116210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.116218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.116230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.116235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.116239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.116243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.116251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.116259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.116266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.116273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.116278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.116284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.116289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.116296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.116301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.116307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.116347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:50.127552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:50.129891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:50.129900Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:50.129904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:50.129909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:50.129919Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 142 [1:7556533120876946207:3837]
2025-10-02T08:07:50.129935Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:50.129962Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:50.129967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.129972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.129975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.129999Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:50.130006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:50.130016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:50.130112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.130116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.130121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:50.130649Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 142
2025-10-02T08:07:50.130125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:50.130366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 142
2025-10-02T08:07:50.131067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:50.131079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.131096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.131111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:50.131120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533120876946184:3838], now have 1 active actors on pipe
2025-10-02T08:07:50.131125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533121337378778:2378], now have 1 active actors on pipe
2025-10-02T08:07:50.131131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.131136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.131176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533120876946196:3837]
2025-10-02T08:07:50.131179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533120876946196:3837]
2025-10-02T08:07:50.131197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:50.131219Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:50.131227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.131227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:50.131231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.131234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:50.131242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:50.131246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.131258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:50.131272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:50.131299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:50.131303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:50.131350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:50.131372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533120876946196:3837]
2025-10-02T08:07:50.131382Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:50.131553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:50.131958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.131965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.131985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:50.132030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 143 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0
2025-10-02T08:07:50.136959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ae970c-6420ce2e-6a154bfa-b00ea7cf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:50.140335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0] Write session: try to update token
2025-10-02T08:07:50.140361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:50.155539Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:50.155564Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:50.155566Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:50.155576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533120876946196:3837]
2025-10-02T08:07:50.155581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533120876946196:3837]
2025-10-02T08:07:50.155625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:50.155633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.155636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:50.155792Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:50.155966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:50.155978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:50.180938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533120876946240:3491]
2025-10-02T08:07:50.183933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 142, pipe: [1:7556533120876946240:3491]
2025-10-02T08:07:50.184260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId: src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:50.187559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:50.341621Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:50.341970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533120876946240:3491], now have 1 active actors on pipe
2025-10-02T08:07:50.341988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.341995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.342338Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:50.342125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:50.342139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:50.342222Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:50.342223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 143 reason: error at write: Disconnected sessionId: src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0
2025-10-02T08:07:50.342418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 143 sessionId: src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0 is DEAD
2025-10-02T08:07:50.342540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533120876946240:3491]
2025-10-02T08:07:50.346228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:50.346246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0] Write session will restart in 0.008260s
2025-10-02T08:07:50.346277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0] Write session: Do CDS request
2025-10-02T08:07:50.346284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:50.358300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:50.358722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:50.358743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 144
2025-10-02T08:07:50.359904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:50.359948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:50.359958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:50.359962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:50.360789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 144 sessionId:  describe result for acl check
2025-10-02T08:07:50.360834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:50.360841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:50.360842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:50.360847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533120876946529:3846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:50.361404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533120876946529:3846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:50.376052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:50.376274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533120876946529:3846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:50.377348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:50.377533Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:50.377544Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:50.377554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:50.377602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:50.377640Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533120876946725:3845]
2025-10-02T08:07:50.378120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:50.378312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:50.378345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:50.378570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:50.378613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.378614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.378615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.378617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.378618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.378623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.378632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.378635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.378639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.378642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.378647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.378653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.378658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.378663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.378666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.378671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.378675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.378680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.378683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.378686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.378702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:50.379585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533120876946529:3846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:50.379602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533120876946529:3846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:50.379605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533120876946529:3846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:50.379615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:50.388078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:50.390081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:50.390097Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:50.390099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:50.390101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:50.390105Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 143 [1:7556533120876946725:3845]
2025-10-02T08:07:50.390114Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:50.390126Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:50.390128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.390130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.390131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.390143Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:50.390147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:50.390152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:50.390197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.390199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.390201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:50.390202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:50.390265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:50.390267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.390278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.390287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:50.390303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533120876946708:3845]
2025-10-02T08:07:50.390305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533120876946708:3845]
2025-10-02T08:07:50.390311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:50.390323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:50.390335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:50.390338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:50.390341Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:50.390344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:50.390347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533120876946741:3846], now have 1 active actors on pipe
2025-10-02T08:07:50.390381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533120876946708:3845]
2025-10-02T08:07:50.390383Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:50.390386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 143
2025-10-02T08:07:50.390388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533121337378787:2378], now have 1 active actors on pipe
2025-10-02T08:07:50.390391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.390393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:50.390396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.390435Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:50.390441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.390446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.390448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:50.390456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.390464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:50.390484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:50.390531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.390534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.390546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:50.390575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 144 partition: 0 MaxSeqNo: 17 sessionId: src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0
2025-10-02T08:07:50.390849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 143
2025-10-02T08:07:50.391260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6051d4e-f1946aca-2f07dcf7-59869ad6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:50.393986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0] Write session: try to update token
2025-10-02T08:07:50.394012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:50.409853Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:50.409878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:50.409880Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:50.409889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533120876946708:3845]
2025-10-02T08:07:50.409895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533120876946708:3845]
2025-10-02T08:07:50.409938Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:50.409941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:50.409948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.409950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:50.409951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:50.410779Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:50.418700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId: src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:50.421770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:50.442888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533120876946758:3491]
2025-10-02T08:07:50.443332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 143, pipe: [1:7556533120876946758:3491]
2025-10-02T08:07:50.579028Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:50.579355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.579374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.579421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533120876946758:3491], now have 1 active actors on pipe
2025-10-02T08:07:50.581145Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:50.581519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:50.581598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 144 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0
2025-10-02T08:07:50.581860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 144 sessionId: src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0 is DEAD
2025-10-02T08:07:50.582069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533120876946758:3491]
2025-10-02T08:07:50.582061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:50.582163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:50.582179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0] Write session will restart in 0.005527s
2025-10-02T08:07:50.582210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0] Write session: Do CDS request
2025-10-02T08:07:50.582218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:50.589501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:50.589860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:50.589876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 145
2025-10-02T08:07:50.590055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:50.590088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:50.590098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:50.590101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:50.590730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 145 sessionId:  describe result for acl check
2025-10-02T08:07:50.590774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:50.590776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:50.590778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:50.590784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533120876946962:3852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:50.591375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533120876946962:3852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:50.601646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533120876946962:3852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:50.610424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:50.611315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:50.611485Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:50.611493Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:50.611503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:50.611561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:50.611600Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533120876947237:3851]
2025-10-02T08:07:50.612194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:50.612402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:50.612440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:50.612674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:50.612717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.612722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.612723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.612724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.612725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.612729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.612739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.612742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.612747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.612750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.612755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.612762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.612768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.612772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.612780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.612784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.612789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.612793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.612798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.612818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.612837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:50.613082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533120876946962:3852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:50.613108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533120876946962:3852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:50.613112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533120876946962:3852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:50.613123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:50.624754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:50.626944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:50.626972Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:50.626975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:50.626979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:50.626989Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 144 [1:7556533120876947237:3851]
2025-10-02T08:07:50.627007Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:50.627035Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:50.627046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.627049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.627052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.627074Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:50.627086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:50.627096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:50.627177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.627186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.627190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:50.627194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:50.627289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:50.627300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.627318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.627337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:50.627359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533120876947231:3851]
2025-10-02T08:07:50.627367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533120876947231:3851]
2025-10-02T08:07:50.627378Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:50.627394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:50.627396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 144
2025-10-02T08:07:50.627416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:50.627425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:50.627438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533120876947254:3852], now have 1 active actors on pipe
2025-10-02T08:07:50.627484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533120876947231:3851]
2025-10-02T08:07:50.627493Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:50.627516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:50.627520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533121337378795:2378], now have 1 active actors on pipe
2025-10-02T08:07:50.627526Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:50.627534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:50.627549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.627558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.627591Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:50.627607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.627612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.627614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:50.627625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.627637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:50.627652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:50.630071Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 144
2025-10-02T08:07:50.630022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.630043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.630078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:50.630122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 145 partition: 0 MaxSeqNo: 17 sessionId: src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0
2025-10-02T08:07:50.630870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df71fc4-6fc83f60-ae60bc23-7eea38ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:50.633555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0] Write session: try to update token
2025-10-02T08:07:50.633574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:50.661055Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:50.661073Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:50.661076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:50.661084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533120876947231:3851]
2025-10-02T08:07:50.661088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533120876947231:3851]
2025-10-02T08:07:50.661125Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:50.661131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:50.661138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:50.661145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.661148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:50.661987Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:50.674692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId: src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:50.677619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:50.684902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533120876947268:3491]
2025-10-02T08:07:50.685031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 144, pipe: [1:7556533120876947268:3491]
2025-10-02T08:07:50.814744Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:50.815068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.815077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.815099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533120876947268:3491], now have 1 active actors on pipe
2025-10-02T08:07:50.815383Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:50.815710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533120876947268:3491]
2025-10-02T08:07:50.815722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:50.815765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 145 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0
2025-10-02T08:07:50.815943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 145 sessionId: src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0 is DEAD
2025-10-02T08:07:50.816198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:50.816215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0] Write session will restart in 0.005024s
2025-10-02T08:07:50.816242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0] Write session: Do CDS request
2025-10-02T08:07:50.816253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:50.816221Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:50.822769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:50.823388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:50.823401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 146
2025-10-02T08:07:50.823549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:50.823581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:50.823584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:50.823588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:50.824065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 146 sessionId:  describe result for acl check
2025-10-02T08:07:50.824085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:50.824086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:50.824087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:50.824091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533120876947338:3869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:50.824487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533120876947338:3869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:50.828994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533120876947338:3869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:50.833198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533120876947338:3869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:50.833222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533120876947338:3869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:50.833226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533120876947338:3869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:50.833236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:50.852833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:50.853732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:50.853930Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:50.853934Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:50.853945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:50.853987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:50.854029Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533120876947786:3868]
2025-10-02T08:07:50.854765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:50.854991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:50.855027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:50.855341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:50.855384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.855390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.855391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.855392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.855392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.855398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.855409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.855413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.855426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.855430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.855436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.855444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:50.855450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.855455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:50.855459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.855470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:50.855474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.855479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.855484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.855489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.855507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:50.869312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:50.871600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:50.871621Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:50.871624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:50.871629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:50.871637Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 145 [1:7556533120876947786:3868]
2025-10-02T08:07:50.871654Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:50.871679Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:50.871689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.871693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.871695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.871713Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:50.871726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:50.871734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:50.871827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.871834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.871838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:50.871841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:50.871941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:50.871949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.871967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:50.871984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:50.871988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 145
2025-10-02T08:07:50.872014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533120876947689:3869], now have 1 active actors on pipe
2025-10-02T08:07:50.872027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533120876947780:3868]
2025-10-02T08:07:50.872030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533120876947780:3868]
2025-10-02T08:07:50.872045Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:50.872061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.872061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:50.872065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:50.872074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.872098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533121337378803:2378], now have 1 active actors on pipe
2025-10-02T08:07:50.872119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:50.872141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:50.872171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:50.872163Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 145
2025-10-02T08:07:50.872239Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:50.872251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.872255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.872258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:50.872268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.872284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:50.872298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533120876947780:3868]
2025-10-02T08:07:50.872316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:50.872341Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:50.872362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:50.872411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.872419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.872434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:50.872479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 146 partition: 0 MaxSeqNo: 17 sessionId: src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0
2025-10-02T08:07:50.872931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79997fc0-7cf29acc-f34d9691-93a45a92_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:50.875474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0] Write session: try to update token
2025-10-02T08:07:50.875494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:50.890302Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:50.890318Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:50.890325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533120876947780:3868]
2025-10-02T08:07:50.890365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:50.890376Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:50.890567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:50.890717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:50.890859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:50.891003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:50.891221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:50.891265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:50.894297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId: src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:50.897212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:50.897272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.897279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.897304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:50.897324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:50.897360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:50.897376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:50.897559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.897641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.897710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.897791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.897928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.897932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.897998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.898069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.898137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.898208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.898257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.898265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.898331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.898397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.898458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.898527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.898582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.898591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.898660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.898732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.898805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.898875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.898927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.898938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.899006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.899067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.899132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.899199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.899249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.899256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.899324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.899387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.899461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.899537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.899965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.899974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.900044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.900108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.900187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.900253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.900305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.900312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.900384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.900453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.900516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.900586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.900633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.900640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.900710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.900774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.900857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.900934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.900979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.900989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.901060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:50.901123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:50.901187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:50.901250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:50.901296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:50.901305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:50.901351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:50.901417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:50.901439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:50.901441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:50.901472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:50.901486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:50.901493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:50.901496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:50.901499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:50.901920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:50.901946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:50.901956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:50.901959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:50.901962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:50.901964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:50.902476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:50.902498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:50.902503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:50.902510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:50.902513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:50.902521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:50.903091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:50.903110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:50.903114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:50.903117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:50.903119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:50.905265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:50.905279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:50.905289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392470905
2025-10-02T08:07:50.905435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:50.905449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:50.905463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:50.905470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:50.905474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:50.905478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:50.905944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:50.905968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:50.905979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:50.905982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:50.905985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:50.905990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:50.906427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:50.906445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:50.906451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:50.906455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:50.906459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:50.906462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:50.906900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:50.906919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:50.906923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:50.908040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:50.908052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:50.908057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:50.908059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:50.908065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392470907
2025-10-02T08:07:50.908380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:50.908399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:50.908409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:50.908411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:50.908416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:50.908423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:50.908895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:50.908916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:50.908922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:50.908926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:50.908928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:50.908930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:50.909375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:50.909392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:50.909489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392470909
2025-10-02T08:07:50.910273Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:50.910287Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:50.910294Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:50.910300Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:50.911926Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:50.911938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:50.911939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:50.911944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533120876947780:3868]
2025-10-02T08:07:50.911951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533120876947780:3868]
2025-10-02T08:07:50.912009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:50.912016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:50.912017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:50.912160Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:50.912884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:50.912923Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:50.915908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533120876947816:3491]
2025-10-02T08:07:50.916010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 145, pipe: [1:7556533120876947816:3491]
2025-10-02T08:07:51.053880Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:51.054287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533120876947816:3491], now have 1 active actors on pipe
2025-10-02T08:07:51.054412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533120876947816:3491]
2025-10-02T08:07:51.054428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:51.054436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:51.054459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 146 reason: error at write: Disconnected sessionId: src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0
2025-10-02T08:07:51.054557Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:51.054575Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:51.054651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 146 sessionId: src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0 is DEAD
2025-10-02T08:07:51.055045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:51.055056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0] Write session will restart in 0.005957s
2025-10-02T08:07:51.055080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0] Write session: Do CDS request
2025-10-02T08:07:51.055086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:51.062403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.062797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:51.062812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 147
2025-10-02T08:07:51.062985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.063019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:51.063024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:51.063027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:51.063450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 147 sessionId:  describe result for acl check
2025-10-02T08:07:51.063502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:51.063508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:51.063510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:51.063516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533125171915353:3877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:51.064050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533125171915353:3877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:51.066595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533125171915353:3877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:51.070182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533125171915353:3877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:51.070197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533125171915353:3877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:51.070200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533125171915353:3877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:51.070208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:51.070595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:51.071783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:51.071978Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:51.071986Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:51.071995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:51.072057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:51.072093Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533125171915609:3876]
2025-10-02T08:07:51.072797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:51.073017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:51.073060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:51.073370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:51.073410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.073415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.073416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.073418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.073419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.073424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.073434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.073438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.073443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.073447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.073453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.073460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.073465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.073471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.073476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.073482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.073487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.073497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.073502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.073513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.073533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:51.085757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:51.087708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:51.087841Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:51.087845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:51.087848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:51.087855Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 146 [1:7556533125171915609:3876]
2025-10-02T08:07:51.087865Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:51.087884Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:51.087886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.087888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.087889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.087905Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:51.087909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:51.087917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:51.087982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.087985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.087988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:51.087990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:51.088052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:51.088055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.088065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.088072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:51.088088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533125171915603:3876]
2025-10-02T08:07:51.088089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533125171915603:3876]
2025-10-02T08:07:51.088100Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:51.088111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:51.088125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:51.088128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:51.088180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533125171915603:3876]
2025-10-02T08:07:51.088182Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:51.088700Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 146
2025-10-02T08:07:51.088352Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:51.088357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:51.088361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:51.088532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 146
2025-10-02T08:07:51.088547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171915598:3877], now have 1 active actors on pipe
2025-10-02T08:07:51.088569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.088577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.088603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533125632346140:2378], now have 1 active actors on pipe
2025-10-02T08:07:51.088620Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:51.088627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.088631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.088633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:51.088642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.088655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:51.088670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.088724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.088725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.088736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.088771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 147 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0
2025-10-02T08:07:51.089158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b177a11-c8cb0ec6-479328e1-c6c1e711_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:51.092501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0] Write session: try to update token
2025-10-02T08:07:51.092519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:51.112112Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:51.112129Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:51.112131Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:51.112141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533125171915603:3876]
2025-10-02T08:07:51.112145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533125171915603:3876]
2025-10-02T08:07:51.112200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:51.112205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.112207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:51.112216Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:51.112221Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:51.112353Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:51.114645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId: src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:51.117776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:51.154538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533125171915646:3491]
2025-10-02T08:07:51.154830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 146, pipe: [1:7556533125171915646:3491]
2025-10-02T08:07:51.259493Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:51.259885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.259900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.259934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171915646:3491], now have 1 active actors on pipe
2025-10-02T08:07:51.260134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533125171915646:3491]
2025-10-02T08:07:51.260270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:51.260280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:51.260369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 147 reason: error at write: Disconnected sessionId: src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0
2025-10-02T08:07:51.260408Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:51.260568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 147 sessionId: src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0 is DEAD
2025-10-02T08:07:51.260748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:51.260759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0] Write session will restart in 0.005723s
2025-10-02T08:07:51.260778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0] Write session: Do CDS request
2025-10-02T08:07:51.260786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:51.261294Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:51.267406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.267459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:51.267474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 148
2025-10-02T08:07:51.267656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.267691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:51.267695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:51.267699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:51.268175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 148 sessionId:  describe result for acl check
2025-10-02T08:07:51.268207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:51.268214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:51.268215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:51.268220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533125171915850:3884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:51.268713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533125171915850:3884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:51.272481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533125171915850:3884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:51.276577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533125171915850:3884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:51.276597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533125171915850:3884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:51.276601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533125171915850:3884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:51.276610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:51.286512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:51.286741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:51.286932Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:51.286942Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:51.286953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:51.287002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:51.287053Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533125171916136:3883]
2025-10-02T08:07:51.287739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:51.287949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:51.288004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:51.288356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:51.288431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.288439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.288441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.288442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.288443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.288450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.288462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.288466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.288470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.288478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.288485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.288493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.288500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.288505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.288510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.288516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.288522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.288527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.288532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.288541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.288561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:51.297377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:51.299500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:51.299520Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:51.299522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:51.299526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:51.299534Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 147 [1:7556533125171916136:3883]
2025-10-02T08:07:51.299552Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:51.299573Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:51.299577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.299581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.299583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.299602Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:51.299609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:51.299623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:51.299698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.299706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.299709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:51.299712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:51.299793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:51.299803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.299819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.299832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:51.299859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171916121:3884], now have 1 active actors on pipe
2025-10-02T08:07:51.299872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533125171916130:3883]
2025-10-02T08:07:51.299875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533125171916130:3883]
2025-10-02T08:07:51.299884Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:51.299894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533125632346147:2378], now have 1 active actors on pipe
2025-10-02T08:07:51.299900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 147
2025-10-02T08:07:51.299907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:51.299921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:51.299923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:51.299927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:51.299930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:51.299974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.299985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.300001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533125171916130:3883]
2025-10-02T08:07:51.300013Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:51.300019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:51.300048Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:51.300062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.300067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.300070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:51.300081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.300098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:51.300135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.300136Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 147
2025-10-02T08:07:51.300203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.300211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.300228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.300262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 148 partition: 0 MaxSeqNo: 17 sessionId: src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0
2025-10-02T08:07:51.300658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8174b6-8e52a70a-296cba79-465e51a6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:51.303766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0] Write session: try to update token
2025-10-02T08:07:51.303784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:51.320547Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:51.320565Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:51.320567Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:51.320575Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533125171916130:3883]
2025-10-02T08:07:51.320579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533125171916130:3883]
2025-10-02T08:07:51.320622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:51.320628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.320630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:51.320638Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:51.320646Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:51.320780Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:51.320859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId: src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:51.323526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:51.360349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533125171916166:3491]
2025-10-02T08:07:51.360503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 147, pipe: [1:7556533125171916166:3491]
2025-10-02T08:07:51.462839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:51.462852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0] Write session will restart in 0.007028s
2025-10-02T08:07:51.462881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0] Write session: Do CDS request
2025-10-02T08:07:51.462888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:51.461582Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:51.462203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.462215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.462263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171916166:3491], now have 1 active actors on pipe
2025-10-02T08:07:51.462398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:51.462401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:51.462461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 148 reason: error at write: Disconnected sessionId: src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0
2025-10-02T08:07:51.462513Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:51.462691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 148 sessionId: src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0 is DEAD
2025-10-02T08:07:51.462840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533125171916166:3491]
2025-10-02T08:07:51.468906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:51.471368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.472952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:51.472969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 149
2025-10-02T08:07:51.477026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.477096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:51.477102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:51.477107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:51.477716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 149 sessionId:  describe result for acl check
2025-10-02T08:07:51.477752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:51.477754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:51.477755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:51.477761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533125171916460:3891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:51.478297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533125171916460:3891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:51.481242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533125171916460:3891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:51.486426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533125171916460:3891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:51.486459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533125171916460:3891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:51.486464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533125171916460:3891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:51.486479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:51.488130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:51.489747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:51.489996Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:51.490000Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:51.490012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:51.490079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:51.490116Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533125171916661:3890]
2025-10-02T08:07:51.490836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:51.491178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:51.491261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:51.491804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:51.491867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.491872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.491874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.491875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.491877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.491885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.491896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.491904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.491909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.491913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.491926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.491937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.491944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.491950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.491955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.491961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.491969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.491975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.491981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.491988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.492010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:51.509515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:51.511508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:51.511530Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:51.511532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:51.511537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:51.511546Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 148 [1:7556533125171916661:3890]
2025-10-02T08:07:51.511562Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:51.511585Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:51.511592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.511596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.511598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.511621Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:51.511631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:51.511640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:51.511737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.511745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.511748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:51.511751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:51.511838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:51.511845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.511862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.511879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:51.511906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171916649:3891], now have 1 active actors on pipe
2025-10-02T08:07:51.511917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533125171916655:3890]
2025-10-02T08:07:51.511920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533125171916655:3890]
2025-10-02T08:07:51.511930Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:51.511950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:51.511973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:51.511977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:51.511984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533125632346155:2378], now have 1 active actors on pipe
2025-10-02T08:07:51.512029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533125171916655:3890]
2025-10-02T08:07:51.512041Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:51.512073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:51.512076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:51.512081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:51.512092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 148
2025-10-02T08:07:51.512180Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 148
2025-10-02T08:07:51.512229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.512242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.512281Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:51.512293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.512301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.512303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:51.512313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.512334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:51.512352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.512396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.512401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.512412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.512447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 149 partition: 0 MaxSeqNo: 17 sessionId: src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0
2025-10-02T08:07:51.512887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435ea32b-e6af7d86-9099e818-7fc9f6ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:51.516135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0] Write session: try to update token
2025-10-02T08:07:51.516173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:51.526993Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:51.527011Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:51.527022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533125171916655:3890]
2025-10-02T08:07:51.527071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:51.527081Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:51.527260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:51.527403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:51.527544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:51.527678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:51.527917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:51.527958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:51.535919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId: src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:51.538961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:51.539081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.539093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.539150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:51.539175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:51.539234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.539247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.539437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.539521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.539586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.539668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.539850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.539855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.539942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.540019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.540084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.540171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.540227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.540231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.540311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.540372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.540438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.540507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.540566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.540570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.540647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.540714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.540785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.540878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.540925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.540928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.541003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.541067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.541133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.541200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.541257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.541260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.541343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.541423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.541516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.541603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.541661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.541665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.541738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.541802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.541878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.541940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.541987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.541990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.542061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.542121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.542185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.542253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.542296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.542300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.542375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.542438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.542508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.542573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.542619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.542622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.542698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:51.542761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:51.542830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:51.542898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:51.542941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:51.542944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:51.543039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:51.543101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.543120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.543123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:51.543155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:51.543170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:51.543173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:51.543177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:51.543180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:51.543606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:51.543625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:51.543632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:51.543635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:51.543638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:51.543641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:51.544393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:51.544410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:51.544416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:51.544420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:51.544424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:51.544427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:51.545505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:51.545540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:51.545547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:51.545551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:51.545554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:51.546942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:51.546969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:51.546981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392471546
2025-10-02T08:07:51.547188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:51.547211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:51.547217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:51.547221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:51.547227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:51.547230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:51.547771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:51.547800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:51.547806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:51.547809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:51.547812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:51.547816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:51.548357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:51.548387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:51.548399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:51.548402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:51.548407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:51.548410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:51.550235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:51.550263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:51.550270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:51.551506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:51.551530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:51.551536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:51.551540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:51.551556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392471551
2025-10-02T08:07:51.551946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:51.551971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:51.551978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:51.551986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:51.551991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:51.551995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:51.552537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:51.552566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:51.552572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:51.552576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:51.552579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:51.552583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:51.553126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:51.553139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.553242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392471552
2025-10-02T08:07:51.555982Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:51.556003Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:51.556014Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:51.556022Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:51.556034Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:51.556039Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:51.556041Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:51.556052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533125171916655:3890]
2025-10-02T08:07:51.556056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533125171916655:3890]
2025-10-02T08:07:51.556106Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:51.556112Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:51.556140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:51.556145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.556162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:51.556313Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:51.563083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533125171916688:3491]
2025-10-02T08:07:51.563169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 148, pipe: [1:7556533125171916688:3491]
2025-10-02T08:07:51.695174Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:51.695576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171916688:3491], now have 1 active actors on pipe
2025-10-02T08:07:51.695714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:51.695725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:51.695748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 149 reason: error at write: Disconnected sessionId: src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0
2025-10-02T08:07:51.695761Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:51.695788Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:51.695948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 149 sessionId: src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0 is DEAD
2025-10-02T08:07:51.696093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:51.696104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0] Write session will restart in 0.006477s
2025-10-02T08:07:51.696108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533125171916688:3491]
2025-10-02T08:07:51.696127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0] Write session: Do CDS request
2025-10-02T08:07:51.696134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:51.699539Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [769b4021b6a53a93] Result# TEvPutResult {Id# [72075186224037892:148:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:51.699553Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:148:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:51.699681Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:148:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:51.703283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.703351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:51.703370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 150
2025-10-02T08:07:51.703505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.703537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:51.703541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:51.703550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:51.703957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 150 sessionId:  describe result for acl check
2025-10-02T08:07:51.703985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:51.703992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:51.703993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:51.703998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533125171916915:3897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:51.704438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533125171916915:3897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:51.706605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533125171916915:3897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:51.709356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533125171916915:3897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:51.709368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533125171916915:3897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:51.709370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533125171916915:3897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:51.709377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:51.711035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:51.711785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:51.711964Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:51.711972Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:51.711982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:51.712027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:51.712060Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533125171917187:3896]
2025-10-02T08:07:51.712670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:51.712898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:51.712938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:51.713226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:51.713264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.713268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.713269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.713270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.713271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.713277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.713286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.713290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.713296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.713300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.713305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.713316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.713325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.713333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.713337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.713343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.713346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.713351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.713355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.713360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.713379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:51.721352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:51.723049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:51.723067Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:51.723069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:51.723073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:51.723080Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 149 [1:7556533125171917187:3896]
2025-10-02T08:07:51.723091Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:51.723107Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:51.723109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.723112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.723114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.723129Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:51.723135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:51.723145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:51.723204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.723211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.723216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:51.723219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:51.723291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:51.723299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.723310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.723326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:51.723342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171917155:3897], now have 1 active actors on pipe
2025-10-02T08:07:51.723341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 149
2025-10-02T08:07:51.723344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533125632346161:2378], now have 1 active actors on pipe
2025-10-02T08:07:51.723350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533125171917181:3896]
2025-10-02T08:07:51.723352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533125171917181:3896]
2025-10-02T08:07:51.723365Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:51.723375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.723383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.723400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:51.723416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:51.723422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:51.723442Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:51.723451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:51.723463Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:51.723473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.723477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.723478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:51.723419Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 149
2025-10-02T08:07:51.723486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.723498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:51.723509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533125171917181:3896]
2025-10-02T08:07:51.723516Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:51.723522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:51.723541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.723592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.723598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.723613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.723655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 150 partition: 0 MaxSeqNo: 17 sessionId: src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0
2025-10-02T08:07:51.724042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6fcdbf-c224ee3c-c3c6267b-cd5eae5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:51.727043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0] Write session: try to update token
2025-10-02T08:07:51.727062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:51.741017Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:51.741036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:51.741039Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:51.741048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533125171917181:3896]
2025-10-02T08:07:51.741057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533125171917181:3896]
2025-10-02T08:07:51.741104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:51.741103Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:51.741108Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:51.741116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.741118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:51.741287Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:51.743701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId: src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:51.746629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:51.796574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533125171917214:3491]
2025-10-02T08:07:51.796694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 149, pipe: [1:7556533125171917214:3491]
2025-10-02T08:07:51.874493Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:51.874917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.874930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.874962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171917214:3491], now have 1 active actors on pipe
2025-10-02T08:07:51.875050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533125171917214:3491]
2025-10-02T08:07:51.875068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:51.875074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:51.875104Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:51.875131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 150 reason: error at write: Disconnected sessionId: src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0
2025-10-02T08:07:51.875165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:51.875312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 150 sessionId: src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0 is DEAD
2025-10-02T08:07:51.875439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:51.875448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0] Write session will restart in 0.008520s
2025-10-02T08:07:51.875467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0] Write session: Do CDS request
2025-10-02T08:07:51.875472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:51.885266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.885393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:51.885408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 151
2025-10-02T08:07:51.885537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:51.885566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:51.885574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:51.885581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:51.885950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 151 sessionId:  describe result for acl check
2025-10-02T08:07:51.885977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:51.885983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:51.885984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:51.885989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533125171917694:3914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:51.886445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533125171917694:3914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:51.886471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:51.887031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:51.887185Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:51.887196Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:51.887204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:51.887251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:51.887289Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533125171917713:3913]
2025-10-02T08:07:51.887866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:51.888040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:51.888079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:51.888443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:51.888608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533125171917694:3914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:51.888671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.888684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.888685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.888687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.888688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.888696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.888707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.888717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.888722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.888726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.888733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.888741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:51.888748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.888753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:51.888767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.888779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:51.888784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.888790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.888821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.888836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.888856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:51.897086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533125171917694:3914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:51.897106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533125171917694:3914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:51.897109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533125171917694:3914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:51.897118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:51.897401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:51.899329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:51.899347Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:51.899349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:51.899352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:51.899357Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 150 [1:7556533125171917713:3913]
2025-10-02T08:07:51.899364Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:51.899378Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:51.899380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.899382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.899384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.899396Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:51.899399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:51.899403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:51.899461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.899463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.899468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:51.899470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:51.899523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:51.899530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.899539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:51.899546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:51.899561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171917749:3914], now have 1 active actors on pipe
2025-10-02T08:07:51.899572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533125171917702:3913]
2025-10-02T08:07:51.899573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533125171917702:3913]
2025-10-02T08:07:51.899580Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:51.899592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:51.899592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:51.899593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 150
2025-10-02T08:07:51.899595Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:51.899612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:51.899615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:51.899621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533125632346170:2378], now have 1 active actors on pipe
2025-10-02T08:07:51.899625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.899628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.899669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533125171917702:3913]
2025-10-02T08:07:51.899680Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:51.899690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:51.899668Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 150
2025-10-02T08:07:51.899693Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:51.899699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:51.899702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:51.899704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:51.899714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:51.899722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:51.899762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.899802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:51.899810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:51.899820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:51.899846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 151 partition: 0 MaxSeqNo: 17 sessionId: src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0
2025-10-02T08:07:51.900182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada9fd5-c95c9b2c-806603af-e4dd476c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:51.903110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0] Write session: try to update token
2025-10-02T08:07:51.903125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:51.917156Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:51.917183Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:51.917187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:51.917197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533125171917702:3913]
2025-10-02T08:07:51.917203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533125171917702:3913]
2025-10-02T08:07:51.917232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:51.917237Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:51.917249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:51.917255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:51.917258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:51.917436Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:51.918701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId: src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:51.921767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:51.975250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533125171917763:3491]
2025-10-02T08:07:51.975396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 150, pipe: [1:7556533125171917763:3491]
2025-10-02T08:07:52.063304Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:52.063809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.063828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.063873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533125171917763:3491], now have 1 active actors on pipe
2025-10-02T08:07:52.064071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533125171917763:3491]
2025-10-02T08:07:52.064109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:52.064112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:52.064126Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:52.064193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 151 reason: error at write: Disconnected sessionId: src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0
2025-10-02T08:07:52.064567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 151 sessionId: src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0 is DEAD
2025-10-02T08:07:52.064613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:52.064628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0] Write session will restart in 0.008207s
2025-10-02T08:07:52.064653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0] Write session: Do CDS request
2025-10-02T08:07:52.064664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:52.064876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:52.074371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.074473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:52.074489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 152
2025-10-02T08:07:52.074588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.074618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:52.074628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:52.074631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:52.075090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 152 sessionId:  describe result for acl check
2025-10-02T08:07:52.075130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:52.075136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:52.075138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:52.075144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533129466885419:3922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:52.075698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533129466885419:3922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:52.078333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533129466885419:3922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:52.081467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:52.082396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:52.082651Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:52.082661Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:52.082671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:52.082724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:52.082781Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533129466885558:3921]
2025-10-02T08:07:52.083142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533129466885419:3922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:52.083157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533129466885419:3922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:52.083161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533129466885419:3922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:52.083171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:52.083467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:52.083635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:52.083673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:52.083980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:52.084026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.084032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.084033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.084034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.084035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.084040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.084050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.084054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.084057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.084061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.084066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.084073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.084079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.084084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.084088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.084093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.084097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.084102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.084106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.084111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.084129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:52.092687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:52.094283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:52.094298Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:52.094300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:52.094304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:52.094310Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 151 [1:7556533129466885558:3921]
2025-10-02T08:07:52.094321Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:52.094334Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:52.094336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.094338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.094339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.094352Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:52.094356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:52.094361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:52.094413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.094420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.094423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:52.094425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:52.094478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:52.094485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.094501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.094516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:52.094540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533129466885552:3921]
2025-10-02T08:07:52.094546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533129466885552:3921]
2025-10-02T08:07:52.094555Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:52.094563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 151
2025-10-02T08:07:52.094567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:52.094570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533129466885563:3922], now have 1 active actors on pipe
2025-10-02T08:07:52.094570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:52.094579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:52.094591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:52.094593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:52.094599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533129927313506:2378], now have 1 active actors on pipe
2025-10-02T08:07:52.094608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.094619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.094664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533129466885552:3921]
2025-10-02T08:07:52.094671Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:52.094681Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:52.094685Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:52.094690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.094662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 151
2025-10-02T08:07:52.094694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.094695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:52.094703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.094710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:52.094744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:52.094830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.094838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.094849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:52.094900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 152 partition: 0 MaxSeqNo: 17 sessionId: src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0
2025-10-02T08:07:52.095307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98bfb936-8ec7827e-38ed98c3-9181fcca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:52.098377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0] Write session: try to update token
2025-10-02T08:07:52.098398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:52.120843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId: src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:52.121721Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:52.121726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:52.121730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:52.121743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533129466885552:3921]
2025-10-02T08:07:52.121748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533129466885552:3921]
2025-10-02T08:07:52.121804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:52.121811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.121813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:52.121995Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:52.124102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:52.124949Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:52.124961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:52.164194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533129466885600:3491]
2025-10-02T08:07:52.164470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 151, pipe: [1:7556533129466885600:3491]
2025-10-02T08:07:52.286933Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:52.287339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.287347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.287387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533129466885600:3491], now have 1 active actors on pipe
2025-10-02T08:07:52.289668Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:52.289050Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:52.289425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:52.289490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0
2025-10-02T08:07:52.289697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 152 sessionId: src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0 is DEAD
2025-10-02T08:07:52.289843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533129466885600:3491]
2025-10-02T08:07:52.293104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:52.293117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0] Write session will restart in 0.008880s
2025-10-02T08:07:52.293152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0] Write session: Do CDS request
2025-10-02T08:07:52.293161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:52.306459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.307046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:52.307058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 153
2025-10-02T08:07:52.313595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.313652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:52.313660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:52.313666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:52.315346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 153 sessionId:  describe result for acl check
2025-10-02T08:07:52.315383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:52.315385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:52.315387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:52.315393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533129466886005:3929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:52.315937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533129466886005:3929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:52.326273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:52.328090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:52.328314Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:52.328318Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:52.328327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:52.328374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:52.328417Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533129466886091:3928]
2025-10-02T08:07:52.329168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:52.329575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:52.329618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:52.329962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:52.329999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.330000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.330002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.330003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.330004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.330010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.330021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.330026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.330030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.330034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.330040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.330048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.330054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.330060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.330064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.330070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.330075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.330080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.330085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.330090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.330113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:52.337426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533129466886005:3929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:52.347075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:52.348930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:52.348938Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:52.348941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:52.348946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:52.348953Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 152 [1:7556533129466886091:3928]
2025-10-02T08:07:52.348970Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:52.348993Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:52.348996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.349003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.349005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.349023Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:52.349029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:52.349037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:52.349111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.349113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.349117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:52.349119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:52.349195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:52.349198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.349214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.349228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:52.349245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533129466886079:3928]
2025-10-02T08:07:52.349248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533129466886079:3928]
2025-10-02T08:07:52.349259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:52.349273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:52.349288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:52.349291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:52.349329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533129466886079:3928]
2025-10-02T08:07:52.349332Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:52.349790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533129466886005:3929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:52.349797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533129466886005:3929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:52.349800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533129466886005:3929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:52.349811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:52.350312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:52.350316Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:52.350322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:52.353082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533129927313514:2378], now have 1 active actors on pipe
2025-10-02T08:07:52.353687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 152
2025-10-02T08:07:52.353696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533129466886120:3929], now have 1 active actors on pipe
2025-10-02T08:07:52.353760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.353772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.353801Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:52.353813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.353817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.353821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:52.353835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.353852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:52.353876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:52.353900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.353902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.353914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:52.353948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 153 partition: 0 MaxSeqNo: 17 sessionId: src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0
2025-10-02T08:07:52.351224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 152
2025-10-02T08:07:52.357153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5a3e328-8cf748df-6306aed0-5afa4e36_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:52.360336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0] Write session: try to update token
2025-10-02T08:07:52.360355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:52.379361Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:52.379379Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:52.379383Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:52.379391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533129466886079:3928]
2025-10-02T08:07:52.379396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533129466886079:3928]
2025-10-02T08:07:52.379443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:52.379451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.379454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:52.379631Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:52.381124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:52.381134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:52.388952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533129466886135:3491]
2025-10-02T08:07:52.389255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 152, pipe: [1:7556533129466886135:3491]
2025-10-02T08:07:52.405114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId: src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:52.408287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:52.579547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:52.579574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0] Write session will restart in 0.007341s
2025-10-02T08:07:52.579601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0] Write session: Do CDS request
2025-10-02T08:07:52.579608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:52.578937Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:52.577395Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:52.577849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533129466886135:3491], now have 1 active actors on pipe
2025-10-02T08:07:52.577863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.577871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.578769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:52.578773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:52.578841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 153 reason: error at write: Disconnected sessionId: src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0
2025-10-02T08:07:52.578897Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:52.579073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 153 sessionId: src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0 is DEAD
2025-10-02T08:07:52.579259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533129466886135:3491]
2025-10-02T08:07:52.589311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.590775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:52.590791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 154
2025-10-02T08:07:52.591130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.591163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:52.591168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:52.591172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:52.593538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 154 sessionId:  describe result for acl check
2025-10-02T08:07:52.593580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:52.593582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:52.593584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:52.593590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533129466886333:3936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:52.594402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533129466886333:3936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:52.599176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533129466886333:3936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:52.608305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533129466886333:3936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:52.608325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533129466886333:3936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:52.608329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533129466886333:3936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:52.608338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:52.613504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:52.614450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:52.614731Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:52.614735Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:52.614745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:52.614793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:52.614828Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533129466886641:3935]
2025-10-02T08:07:52.615594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:52.615788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:52.615823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:52.616164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:52.616212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.616213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.616214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.616215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.616216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.616223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.616233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.616237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.616240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.616244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.616250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.616259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.616266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.616271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.616275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.616280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.616287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.616291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.616296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.616301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.616320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:52.625331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:52.627205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:52.627222Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:52.627225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:52.627229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:52.627236Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 153 [1:7556533129466886641:3935]
2025-10-02T08:07:52.627250Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:52.627270Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:52.627273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.627277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.627279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.627296Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:52.627302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:52.627310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:52.627381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.627383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.627386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:52.627389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:52.627466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:52.627469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.627483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.627495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:52.627514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533129466886573:3936], now have 1 active actors on pipe
2025-10-02T08:07:52.627521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533129466886635:3935]
2025-10-02T08:07:52.627524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533129466886635:3935]
2025-10-02T08:07:52.627535Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:52.627548Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:52.627551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:52.627552Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:52.627567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:52.627570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:52.627576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533129927313522:2378], now have 1 active actors on pipe
2025-10-02T08:07:52.627612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533129466886635:3935]
2025-10-02T08:07:52.627625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:52.627672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 153
2025-10-02T08:07:52.627680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:52.627870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.627883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.627917Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:52.627930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.627935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.627937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:52.627949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.627960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:52.627979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:52.628011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.628017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.628029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:52.628061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 154 partition: 0 MaxSeqNo: 17 sessionId: src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0
2025-10-02T08:07:52.628574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105a0ebe-10b31c19-96fb34f-c46e40a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:52.627733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 153
2025-10-02T08:07:52.631535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0] Write session: try to update token
2025-10-02T08:07:52.631561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:52.649903Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:52.649920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:52.649924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:52.649933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533129466886635:3935]
2025-10-02T08:07:52.649938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533129466886635:3935]
2025-10-02T08:07:52.649989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:52.649997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.650000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:52.650010Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:52.650017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:52.650184Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:52.665527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId: src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:52.668538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:52.679614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533129466886665:3491]
2025-10-02T08:07:52.679953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 153, pipe: [1:7556533129466886665:3491]
2025-10-02T08:07:52.797221Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:52.797588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.797597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.797615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533129466886665:3491], now have 1 active actors on pipe
2025-10-02T08:07:52.797715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:52.797728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:52.797789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 154 reason: error at write: Disconnected sessionId: src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0
2025-10-02T08:07:52.797819Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:52.797993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 154 sessionId: src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0 is DEAD
2025-10-02T08:07:52.798100Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:52.798160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:52.798172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0] Write session will restart in 0.005703s
2025-10-02T08:07:52.798175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533129466886665:3491]
2025-10-02T08:07:52.798197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0] Write session: Do CDS request
2025-10-02T08:07:52.798204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:52.805293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.805343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:52.805356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 155
2025-10-02T08:07:52.805508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.805536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:52.805542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:52.805545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:52.805928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 155 sessionId:  describe result for acl check
2025-10-02T08:07:52.805960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:52.805961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:52.805963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:52.805967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533129466886991:3943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:52.806415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533129466886991:3943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:52.809234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533129466886991:3943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:52.810494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:52.811261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:52.811381Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:52.811388Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:52.811395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:52.811424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:52.811447Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533129466887166:3942]
2025-10-02T08:07:52.811938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:52.812083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:52.812105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533129466886991:3943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:52.812115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533129466886991:3943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:52.812117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:52.812117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533129466886991:3943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:52.812123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:52.812401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:52.812437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.812441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.812441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.812442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.812443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.812446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.812452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.812454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.812456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.812458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.812462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.812468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:52.812474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.812478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:52.812481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.812486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:52.812489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.812493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.812497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.812501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.812519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:52.823254Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 154
2025-10-02T08:07:52.823800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9277cc-59304b01-cfd799c7-3ad35740_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:52.820791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:52.822865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:52.822874Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:52.822877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:52.822884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:52.822892Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 154 [1:7556533129466887166:3942]
2025-10-02T08:07:52.822905Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:52.822924Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:52.822926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.822929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.822932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.822947Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:52.822952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:52.822960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:52.823021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.823023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.823026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:52.823028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:52.823100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:52.823102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.823114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:52.823125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:52.823142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533129466887160:3942]
2025-10-02T08:07:52.823143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533129466887160:3942]
2025-10-02T08:07:52.823149Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:52.823162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533129927313531:2378], now have 1 active actors on pipe
2025-10-02T08:07:52.823164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:52.823169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:52.823169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:52.823175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 154
2025-10-02T08:07:52.823182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:52.823188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:52.823193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533129466887177:3943], now have 1 active actors on pipe
2025-10-02T08:07:52.823227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.823233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.823245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533129466887160:3942]
2025-10-02T08:07:52.823247Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:52.823273Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:52.823279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:52.823283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:52.823285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:52.823286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:52.823294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:52.823302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:52.823327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:52.823400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.823402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.823416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:52.823453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 155 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0
2025-10-02T08:07:52.826993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0] Write session: try to update token
2025-10-02T08:07:52.827010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:52.840693Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:52.840709Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:52.840712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:52.840720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533129466887160:3942]
2025-10-02T08:07:52.840724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533129466887160:3942]
2025-10-02T08:07:52.840753Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:52.840757Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:52.840764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:52.840771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:52.840773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:52.840937Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:52.843812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId: src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:52.846621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:52.909205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533129466887210:3491]
2025-10-02T08:07:52.911632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 154, pipe: [1:7556533129466887210:3491]
2025-10-02T08:07:52.985374Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:52.985765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:52.985786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:52.985825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533129466887210:3491], now have 1 active actors on pipe
2025-10-02T08:07:52.985963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:52.985973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:52.986018Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:52.986036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 155 reason: error at write: Disconnected sessionId: src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0
2025-10-02T08:07:52.986122Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:52.986225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 155 sessionId: src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0 is DEAD
2025-10-02T08:07:52.986400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533129466887210:3491]
2025-10-02T08:07:52.986421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:52.986432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0] Write session will restart in 0.007669s
2025-10-02T08:07:52.986459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0] Write session: Do CDS request
2025-10-02T08:07:52.986467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:52.995388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.995434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:52.995448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 156
2025-10-02T08:07:52.995590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:52.995619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:52.995638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:52.995642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:52.996105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 156 sessionId:  describe result for acl check
2025-10-02T08:07:52.996151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:52.996156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:52.996158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:52.996164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533129466887423:3959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:52.996666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533129466887423:3959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:52.999210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533129466887423:3959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:53.002252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533129466887423:3959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:53.002267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533129466887423:3959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:53.002271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533129466887423:3959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:53.002280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:53.005006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:53.005642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:53.005813Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:53.005821Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:53.005841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:53.005885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:53.005918Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533133761855027:3958]
2025-10-02T08:07:53.006550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:53.006723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:53.006765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:53.006987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:53.007020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.007026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.007027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.007027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.007028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.007031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.007038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.007040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.007042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.007044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.007048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.007052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.007055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.007059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.007061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.007064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.007066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.007068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.007070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.007073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.007086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:53.015541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:53.017264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:53.017280Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:53.017284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:53.017287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:53.017294Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 155 [1:7556533133761855027:3958]
2025-10-02T08:07:53.017307Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:53.017324Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:53.017327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.017330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.017331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.017347Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:53.017351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:53.017358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:53.017422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.017429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.017435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:53.017437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:53.017502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:53.017509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.017522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.017532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:53.017544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 155
2025-10-02T08:07:53.017550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761854952:3959], now have 1 active actors on pipe
2025-10-02T08:07:53.017561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533133761855021:3958]
2025-10-02T08:07:53.017563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533133761855021:3958]
2025-10-02T08:07:53.017574Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:53.017586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533129927313537:2378], now have 1 active actors on pipe
2025-10-02T08:07:53.017589Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:53.017592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.017596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.017599Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:53.017614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:53.017630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:53.017637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:53.017681Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:53.017691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.017694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.017696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:53.017703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.017712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:53.017724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533133761855021:3958]
2025-10-02T08:07:53.017730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:53.017741Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:53.017765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.017817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.017826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.017839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.017894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 156 partition: 0 MaxSeqNo: 17 sessionId: src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0
2025-10-02T08:07:53.017659Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 155
2025-10-02T08:07:53.018262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a254ef2-5426c65f-ba17cb24-5b7411a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:53.021234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0] Write session: try to update token
2025-10-02T08:07:53.021251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:53.035620Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:53.035641Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:53.035644Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:53.035653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533133761855021:3958]
2025-10-02T08:07:53.035657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533133761855021:3958]
2025-10-02T08:07:53.035706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:53.035723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.035726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:53.035734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:53.035743Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:53.035893Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:53.040921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId: src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:53.043844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:53.086307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533133761855060:3491]
2025-10-02T08:07:53.086450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 155, pipe: [1:7556533133761855060:3491]
2025-10-02T08:07:53.177544Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:53.177995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.178003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.178023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761855060:3491], now have 1 active actors on pipe
2025-10-02T08:07:53.178662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:53.178772Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:53.178931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:53.179009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 156 reason: status is not ok: tablet will be restarted right now sessionId: src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0
2025-10-02T08:07:53.179212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 156 sessionId: src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0 is DEAD
2025-10-02T08:07:53.179383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:53.179395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0] Write session will restart in 0.006837s
2025-10-02T08:07:53.179396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533133761855060:3491]
2025-10-02T08:07:53.179421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0] Write session: Do CDS request
2025-10-02T08:07:53.179428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:53.187353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.187841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:53.187863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 157
2025-10-02T08:07:53.188273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.188327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:53.188332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:53.188336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:53.188890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 157 sessionId:  describe result for acl check
2025-10-02T08:07:53.188927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:53.188928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:53.188930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:53.188934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533133761855399:3968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:53.189527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533133761855399:3968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:53.195085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533133761855399:3968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:53.195405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:53.196331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:53.196587Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:53.196601Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:53.196611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:53.196659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:53.196698Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533133761855573:3967]
2025-10-02T08:07:53.197361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:53.197574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:53.197613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:53.197935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:53.197969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.197970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.197972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.197972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.197974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.197978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.197988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.197992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.197996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.198000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.198006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.198013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.198019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.198025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.198029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.198035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.198038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.198044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.198051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.198056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.198075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:53.205445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533133761855399:3968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:53.205462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533133761855399:3968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:53.205465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533133761855399:3968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:53.205492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:53.206818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:53.208544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:53.208560Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:53.208562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:53.208564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:53.208568Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 156 [1:7556533133761855573:3967]
2025-10-02T08:07:53.208577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:53.208592Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:53.208594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.208596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.208597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.208608Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:53.208611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:53.208617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:53.208662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.208668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.208671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:53.208673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:53.208722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:53.208728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.208737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.208744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:53.208756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533133761855559:3967]
2025-10-02T08:07:53.208758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533133761855559:3967]
2025-10-02T08:07:53.208763Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:53.208775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:53.208784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:53.208785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:53.208837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:53.208850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 156
2025-10-02T08:07:53.208855Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:53.208873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533133761855559:3967]
2025-10-02T08:07:53.208879Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:53.208882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:53.208890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761855590:3968], now have 1 active actors on pipe
2025-10-02T08:07:53.208894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533134222280874:2378], now have 1 active actors on pipe
2025-10-02T08:07:53.208899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.208903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.208958Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:53.208971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.208942Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 156
2025-10-02T08:07:53.208975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.208977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:53.208987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.208996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:53.209015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.209095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.209103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.209117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.209163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 157 partition: 0 MaxSeqNo: 17 sessionId: src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0
2025-10-02T08:07:53.209536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85394dac-79092ea3-edf6e0e4-d4f3c19c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:53.212279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0] Write session: try to update token
2025-10-02T08:07:53.212297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:53.229179Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:53.229198Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:53.229201Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:53.229212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533133761855559:3967]
2025-10-02T08:07:53.229221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533133761855559:3967]
2025-10-02T08:07:53.229271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:53.229270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:53.229276Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:53.229279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.229281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:53.229282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId: src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:53.229446Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:53.231843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:53.279297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533133761855605:3491]
2025-10-02T08:07:53.279412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 156, pipe: [1:7556533133761855605:3491]
2025-10-02T08:07:53.368693Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:53.369111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.369127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.369163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761855605:3491], now have 1 active actors on pipe
2025-10-02T08:07:53.371081Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:53.371188Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:53.371414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:53.371459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 157 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0
2025-10-02T08:07:53.371620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 157 sessionId: src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0 is DEAD
2025-10-02T08:07:53.371739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533133761855605:3491]
2025-10-02T08:07:53.371841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:53.371849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0] Write session will restart in 0.005297s
2025-10-02T08:07:53.371874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0] Write session: Do CDS request
2025-10-02T08:07:53.371879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:53.378353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.378431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:53.378446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 158
2025-10-02T08:07:53.378565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.378595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:53.378603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:53.378606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:53.378927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 158 sessionId:  describe result for acl check
2025-10-02T08:07:53.378953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:53.378958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:53.378961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:53.378964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533133761855969:3975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:53.379353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533133761855969:3975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:53.382350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533133761855969:3975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:53.382382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:53.383265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:53.383478Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:53.383486Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:53.383495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:53.383535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:53.383563Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533133761856116:3974]
2025-10-02T08:07:53.383985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:53.384163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:53.384191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:53.384389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:53.384419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.384424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.384425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.384426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.384427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.384431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.384441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.384444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.384447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.384450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.384454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.384461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.384466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.384470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.384474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.384484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.384488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.384493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.384497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.384501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.384517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:53.384997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533133761855969:3975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:53.385010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533133761855969:3975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:53.385014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533133761855969:3975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:53.385021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:53.392368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:53.394130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:53.394148Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:53.394150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:53.394153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:53.394159Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 157 [1:7556533133761856116:3974]
2025-10-02T08:07:53.394171Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:53.394187Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:53.394190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.394193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.394195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.394211Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:53.394219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:53.394225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:53.394292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.394301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.394305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:53.394308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:53.394366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:53.394373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.394387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.394403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:53.394429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761856133:3975], now have 1 active actors on pipe
2025-10-02T08:07:53.394436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533133761856099:3974]
2025-10-02T08:07:53.394442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 157
2025-10-02T08:07:53.394443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533133761856099:3974]
2025-10-02T08:07:53.394450Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:53.394459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533134222280883:2378], now have 1 active actors on pipe
2025-10-02T08:07:53.394460Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:53.394463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:53.394465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:53.394479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:53.394490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:53.394496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.394500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.394516Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 157
2025-10-02T08:07:53.394538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533133761856099:3974]
2025-10-02T08:07:53.394546Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:53.394555Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:53.394559Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:53.394565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.394569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.394571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:53.394579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.394587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:53.394633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.394680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.394687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.394700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.394738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 158 partition: 0 MaxSeqNo: 17 sessionId: src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0
2025-10-02T08:07:53.395037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b0387c-63ce0130-ff7bf172-4d58da0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:53.397845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0] Write session: try to update token
2025-10-02T08:07:53.397857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:53.412178Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:53.412194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:53.412197Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:53.412205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533133761856099:3974]
2025-10-02T08:07:53.412212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533133761856099:3974]
2025-10-02T08:07:53.412253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:53.412264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.412271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:53.412271Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:53.412277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:53.412421Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:53.413588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId: src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:53.416452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:53.471824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533133761856150:3491]
2025-10-02T08:07:53.471936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 157, pipe: [1:7556533133761856150:3491]
2025-10-02T08:07:53.545190Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:53.545487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.545498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.545537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761856150:3491], now have 1 active actors on pipe
2025-10-02T08:07:53.545675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533133761856150:3491]
2025-10-02T08:07:53.545701Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:53.545703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:53.545704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:53.545761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 158 reason: error at write: Disconnected sessionId: src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0
2025-10-02T08:07:53.545775Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:53.545938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 158 sessionId: src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0 is DEAD
2025-10-02T08:07:53.546086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:53.546094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0] Write session will restart in 0.007480s
2025-10-02T08:07:53.546118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0] Write session: Do CDS request
2025-10-02T08:07:53.546124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:53.554280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.554342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:53.554357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 159
2025-10-02T08:07:53.554469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.554497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:53.554502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:53.554511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:53.554903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 159 sessionId:  describe result for acl check
2025-10-02T08:07:53.554941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:53.554947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:53.554949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:53.554954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533133761856555:3981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:53.555467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533133761856555:3981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:53.557980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533133761856555:3981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:53.557985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:53.558800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:53.558979Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:53.558993Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:53.559004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:53.559055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:53.559094Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533133761856660:3980]
2025-10-02T08:07:53.559734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:53.559949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:53.560001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:53.560330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:53.560389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.560394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.560395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.560395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.560396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.560401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.560410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.560413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.560416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.560419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.560424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.560431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.560440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.560444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.560448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.560452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.560455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.560459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.560467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.560471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.560487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:53.560826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533133761856555:3981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:53.560842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533133761856555:3981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:53.560845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533133761856555:3981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:53.560853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:53.568789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:53.570782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:53.570800Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:53.570803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:53.570808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:53.570813Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 158 [1:7556533133761856660:3980]
2025-10-02T08:07:53.570826Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:53.570845Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:53.570848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.570851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.570854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.570869Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:53.570874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:53.570881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:53.570951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.570961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.570963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:53.570966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:53.571029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:53.571037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.571051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.571061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:53.571083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761856677:3981], now have 1 active actors on pipe
2025-10-02T08:07:53.571096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533133761856644:3980]
2025-10-02T08:07:53.571096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 158
2025-10-02T08:07:53.571098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533133761856644:3980]
2025-10-02T08:07:53.571110Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:53.571126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533134222280889:2378], now have 1 active actors on pipe
2025-10-02T08:07:53.571131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:53.571134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:53.571134Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:53.571148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:53.571151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:53.571159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.571163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.571204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533133761856644:3980]
2025-10-02T08:07:53.571212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:53.571214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:53.571178Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 158
2025-10-02T08:07:53.571228Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:53.571238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.571242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.571247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:53.571256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.571265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:53.571312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.571359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.571368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.571381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.571414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 159 partition: 0 MaxSeqNo: 17 sessionId: src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0
2025-10-02T08:07:53.571743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53379d79-50ce8a2c-2a755ce7-fb285707_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:53.576151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0] Write session: try to update token
2025-10-02T08:07:53.576171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:53.593295Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:53.593314Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:53.593317Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:53.593328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533133761856644:3980]
2025-10-02T08:07:53.593332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533133761856644:3980]
2025-10-02T08:07:53.593378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:53.593385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.593384Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:53.593387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:53.593390Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:53.593538Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:53.593971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId: src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:53.596791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:53.645925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533133761856696:3491]
2025-10-02T08:07:53.646043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 158, pipe: [1:7556533133761856696:3491]
2025-10-02T08:07:53.727834Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:53.728094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.728103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.728142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761856696:3491], now have 1 active actors on pipe
2025-10-02T08:07:53.728231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533133761856696:3491]
2025-10-02T08:07:53.728246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:53.728247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:53.728296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 159 reason: error at write: Disconnected sessionId: src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0
2025-10-02T08:07:53.728345Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:53.728399Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:53.728481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 159 sessionId: src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0 is DEAD
2025-10-02T08:07:53.728612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:53.728623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0] Write session will restart in 0.006764s
2025-10-02T08:07:53.728657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0] Write session: Do CDS request
2025-10-02T08:07:53.728664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:53.736337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.736400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:53.736412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 160
2025-10-02T08:07:53.736544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.736566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:53.736572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:53.736574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:53.737019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 160 sessionId:  describe result for acl check
2025-10-02T08:07:53.737052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:53.737054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:53.737055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:53.737059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533133761857003:3988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:53.737490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533133761857003:3988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:53.739499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533133761857003:3988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:53.742867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:53.743067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533133761857003:3988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:53.743078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533133761857003:3988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:53.743080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533133761857003:3988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:53.743087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:53.743726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:53.743913Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:53.743921Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:53.743931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:53.743977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:53.744010Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533133761857212:3986]
2025-10-02T08:07:53.744705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:53.744912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:53.744955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:53.745273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:53.745308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.745317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.745318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.745319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.745320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.745325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.745334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.745338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.745341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.745345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.745350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.745356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.745372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.745378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.745383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.745388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.745392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.745397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.745401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.745406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.745423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:53.753682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:53.755649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:53.755666Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:53.755669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:53.755672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:53.755679Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 159 [1:7556533133761857212:3986]
2025-10-02T08:07:53.755691Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:53.755708Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:53.755711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.755713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.755715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.755730Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:53.755740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:53.755746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:53.755815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.755822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.755825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:53.755827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:53.755895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:53.755902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.755914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.755933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:53.755950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533134222280895:2378], now have 1 active actors on pipe
2025-10-02T08:07:53.755957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761857208:3988], now have 1 active actors on pipe
2025-10-02T08:07:53.755963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533133761857200:3986]
2025-10-02T08:07:53.755965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533133761857200:3986]
2025-10-02T08:07:53.755973Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:53.755982Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:53.755984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 159
2025-10-02T08:07:53.755984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:53.755990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:53.756003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:53.756009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:53.756016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.756021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.756021Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 159
2025-10-02T08:07:53.756063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533133761857200:3986]
2025-10-02T08:07:53.756074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:53.756078Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:53.756089Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:53.756098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.756102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.756103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:53.756112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.756124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:53.756179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.756244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.756252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.756264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.756302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 160 partition: 0 MaxSeqNo: 17 sessionId: src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0
2025-10-02T08:07:53.756688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6176f4d1-1d58b30d-3e3132b7-b0930cc8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:53.759543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0] Write session: try to update token
2025-10-02T08:07:53.759561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:53.774266Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:53.774287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:53.774290Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:53.774298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533133761857200:3986]
2025-10-02T08:07:53.774302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533133761857200:3986]
2025-10-02T08:07:53.774343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:53.774348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:53.774349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.774352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:53.774354Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:53.774498Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:53.774708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId: src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:53.777480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:53.828192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533133761857237:3491]
2025-10-02T08:07:53.828318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 159, pipe: [1:7556533133761857237:3491]
2025-10-02T08:07:53.921189Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:53.921542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.921553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.921582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761857237:3491], now have 1 active actors on pipe
2025-10-02T08:07:53.921664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:53.921669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:53.921711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 160 reason: error at write: Disconnected sessionId: src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0
2025-10-02T08:07:53.921834Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:53.921854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 160 sessionId: src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0 is DEAD
2025-10-02T08:07:53.922040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:53.922052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0] Write session will restart in 0.005319s
2025-10-02T08:07:53.922079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0] Write session: Do CDS request
2025-10-02T08:07:53.922086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:53.922143Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:53.922432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533133761857237:3491]
2025-10-02T08:07:53.928393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.928444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:53.928461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 161
2025-10-02T08:07:53.928691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:53.928734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:53.928744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:53.928748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:53.929143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 161 sessionId:  describe result for acl check
2025-10-02T08:07:53.929175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:53.929181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:53.929183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:53.929187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533133761857526:4000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:53.929825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533133761857526:4000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:53.932361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533133761857526:4000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:53.935530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:53.935955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533133761857526:4000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:53.935969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533133761857526:4000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:53.935973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533133761857526:4000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:53.935981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:53.936550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:53.936706Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:53.936716Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:53.936723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:53.936755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:53.936785Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533133761857767:3999]
2025-10-02T08:07:53.937425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:53.937623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:53.937668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:53.937978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:53.938024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.938033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.938034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.938035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.938036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.938041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.938050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.938054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.938058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.938062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.938067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.938074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:53.938079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.938084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:53.938088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.938093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:53.938097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.938101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.938106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.938111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.938128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:53.946177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:53.947812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:53.947827Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:53.947829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:53.947831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:53.947836Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 160 [1:7556533133761857767:3999]
2025-10-02T08:07:53.947843Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:53.947859Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:53.947861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.947863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.947864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.947875Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:53.947878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:53.947883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:53.947931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.947939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.947941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:53.947943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:53.947988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:53.947996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.948004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:53.948011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:53.948023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533133761857754:3999]
2025-10-02T08:07:53.948032Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533133761857754:3999]
2025-10-02T08:07:53.948038Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:53.948047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533133761857762:4000], now have 1 active actors on pipe
2025-10-02T08:07:53.948049Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:53.948053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:53.948053Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:53.948061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:53.948062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:53.948066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533134222280904:2378], now have 1 active actors on pipe
2025-10-02T08:07:53.948094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533133761857754:3999]
2025-10-02T08:07:53.948111Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:53.948155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:53.948162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 160
2025-10-02T08:07:53.948179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.948182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.948145Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 160
2025-10-02T08:07:53.948200Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f26a360-b208126-84a0004a-6963e17a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:53.948210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.948212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.948213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:53.948220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.948226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:53.948248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.948276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.948284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.948295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:53.948329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 161 partition: 0 MaxSeqNo: 17 sessionId: src_id|6f26a360-b208126-84a0004a-6963e17a_0
2025-10-02T08:07:53.948678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bab3208-330b9cbc-c66c4d55-1f7aae3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6f26a360-b208126-84a0004a-6963e17a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:53.951430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f26a360-b208126-84a0004a-6963e17a_0] Write session: try to update token
2025-10-02T08:07:53.951445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f26a360-b208126-84a0004a-6963e17a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:53.959713Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:53.959731Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:53.959739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533133761857754:3999]
2025-10-02T08:07:53.959776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:53.959793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:53.959933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:53.960102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:53.960263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:53.960392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:53.960582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:53.960630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:53.967847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId: src_id|6f26a360-b208126-84a0004a-6963e17a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:53.970718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:53.970810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.970823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.970862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:53.970890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:53.970932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:53.970948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:53.971151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.971226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.971302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.971381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.971854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.971870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.971953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.972020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.972091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.972180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.972233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.972241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.972312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.972382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.972453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.972521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.972572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.972581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.972657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.972729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.972820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.972890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.972944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.972957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.973028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.973090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.973156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.973231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.973288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.973295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.973391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.973457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.973522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.973587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.973698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.973709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.973789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.973856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.973926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.973996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.974048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.974058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.974132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.974199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.974277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.974350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.974405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.974413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.974491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.974561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.974636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.974714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.974772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.974780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.974856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:53.974923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:53.975005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:53.975085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:53.975146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:53.975154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:53.975219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:53.975292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:53.975318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:53.975326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:53.975361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:53.975379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:53.975392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:53.975395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:53.975398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:53.975831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:53.975862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:53.975869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:53.975872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:53.975875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:53.975878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:53.976691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:53.976718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:53.976724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:53.976728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:53.976732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:53.976735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:53.977422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:53.977448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:53.977454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:53.977457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:53.977460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:53.979839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:53.979864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:53.979881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392473979
2025-10-02T08:07:53.980088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:53.980109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:53.980116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:53.980120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:53.980124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:53.980128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:53.980620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:53.980649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:53.980655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:53.980658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:53.980665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:53.980668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:53.981221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:53.981247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:53.981255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:53.981261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:53.981264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:53.981268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:53.981817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:53.981840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:53.981847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:53.982984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:53.983005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:53.983012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:53.983016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:53.983025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392473982
2025-10-02T08:07:53.983335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:53.983360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:53.983365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:53.983376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:53.983380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:53.983383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:53.983911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:53.983940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:53.983945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:53.983949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:53.983952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:53.983957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:53.984485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:53.984509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:53.984612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392473984
2025-10-02T08:07:53.987091Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:53.987119Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:53.987126Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:53.987133Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:53.987148Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:53.987156Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:53.987159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:53.987168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533133761857754:3999]
2025-10-02T08:07:53.987172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533133761857754:3999]
2025-10-02T08:07:53.987245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:53.987253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:53.987255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:53.987284Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:53.987298Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:53.987384Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:54.022748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533138056825104:3491]
2025-10-02T08:07:54.022912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 160, pipe: [1:7556533138056825104:3491]
2025-10-02T08:07:54.132613Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:54.134668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f26a360-b208126-84a0004a-6963e17a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:54.134680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f26a360-b208126-84a0004a-6963e17a_0] Write session will restart in 0.006801s
2025-10-02T08:07:54.134703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f26a360-b208126-84a0004a-6963e17a_0] Write session: Do CDS request
2025-10-02T08:07:54.134709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f26a360-b208126-84a0004a-6963e17a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:54.135803Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:54.133078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056825104:3491], now have 1 active actors on pipe
2025-10-02T08:07:54.133453Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:54.134082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533138056825104:3491]
2025-10-02T08:07:54.134101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:54.134128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 161 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f26a360-b208126-84a0004a-6963e17a_0
2025-10-02T08:07:54.134329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 161 sessionId: src_id|6f26a360-b208126-84a0004a-6963e17a_0 is DEAD
2025-10-02T08:07:54.138818Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [082778102d51b43c] Result# TEvPutResult {Id# [72075186224037892:160:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:54.138882Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:160:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:54.138916Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:160:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:54.142916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f26a360-b208126-84a0004a-6963e17a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.143788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:54.143807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 162
2025-10-02T08:07:54.145033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.145078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:54.145090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:54.145096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:54.146897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 162 sessionId:  describe result for acl check
2025-10-02T08:07:54.146944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:54.146946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:54.146948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:54.146953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533138056825330:4013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:54.147532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533138056825330:4013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:54.151645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533138056825330:4013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:54.156767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533138056825330:4013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:54.156787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533138056825330:4013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:54.156791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533138056825330:4013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:54.156819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:54.168336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:54.169816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:54.170021Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:54.170024Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:54.170036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:54.170097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:54.170140Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533138056825646:4012]
2025-10-02T08:07:54.170788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:54.171002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:54.171045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:54.171380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:54.171450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.171457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.171458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.171459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.171460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.171466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.171477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.171482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.171486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.171490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.171496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.171504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.171510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.171515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.171520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.171526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.171531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.171537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.171542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.171547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.171571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:54.181901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:54.183522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:54.183541Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:54.183544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:54.183548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:54.183556Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 161 [1:7556533138056825646:4012]
2025-10-02T08:07:54.183569Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:54.183588Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:54.183592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.183595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.183603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.183621Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:54.183629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:54.183636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:54.183696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.183703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.183708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:54.183711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:54.183782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:54.183790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.183803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.183814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:54.183832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056825528:4013], now have 1 active actors on pipe
2025-10-02T08:07:54.183838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533138056825640:4012]
2025-10-02T08:07:54.183840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533138056825640:4012]
2025-10-02T08:07:54.183847Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:54.183858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533138517248241:2378], now have 1 active actors on pipe
2025-10-02T08:07:54.183865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:54.183865Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:54.183871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:54.183877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:54.183880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:54.183917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533138056825640:4012]
2025-10-02T08:07:54.183928Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:54.183943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:54.183969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.183970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 161
2025-10-02T08:07:54.183973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.184003Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:54.184009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.184014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.184017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:54.184025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.184033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:54.184048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.184074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.184077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.184090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.184123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 162 partition: 0 MaxSeqNo: 17 sessionId: src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0
2025-10-02T08:07:54.184532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f26a360-b208126-84a0004a-6963e17a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:54.185649Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 161
2025-10-02T08:07:54.187634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0] Write session: try to update token
2025-10-02T08:07:54.187649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:54.211013Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:54.211039Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:54.211042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:54.211051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533138056825640:4012]
2025-10-02T08:07:54.211056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533138056825640:4012]
2025-10-02T08:07:54.211107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:54.211115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.211118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:54.211155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:54.211178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:54.211295Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:54.212683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId: src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:54.215717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:54.236885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533138056825671:3491]
2025-10-02T08:07:54.240506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 161, pipe: [1:7556533138056825671:3491]
2025-10-02T08:07:54.352647Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:54.353052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.353067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.353101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056825671:3491], now have 1 active actors on pipe
2025-10-02T08:07:54.353189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533138056825671:3491]
2025-10-02T08:07:54.353205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:54.353210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:54.353266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 162 reason: error at write: Disconnected sessionId: src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0
2025-10-02T08:07:54.353303Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:54.353419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 162 sessionId: src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0 is DEAD
2025-10-02T08:07:54.353595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:54.353552Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:54.353607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0] Write session will restart in 0.007125s
2025-10-02T08:07:54.353650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0] Write session: Do CDS request
2025-10-02T08:07:54.353658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:54.362358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.362398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:54.362413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 163
2025-10-02T08:07:54.362556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.362584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:54.362592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:54.362596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:54.362993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 163 sessionId:  describe result for acl check
2025-10-02T08:07:54.363022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:54.363028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:54.363029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:54.363033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533138056825956:4020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:54.363517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533138056825956:4020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:54.365620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533138056825956:4020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:54.368634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533138056825956:4020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:54.368651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533138056825956:4020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:54.368655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533138056825956:4020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:54.368663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:54.369094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:54.369710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:54.369891Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:54.369899Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:54.369906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:54.369943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:54.369970Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533138056826196:4019]
2025-10-02T08:07:54.370403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:54.370548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:54.370583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:54.370778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:54.370806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.370810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.370811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.370812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.370812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.370816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.370822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.370824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.370826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.370828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.370832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.370836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.370839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.370841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.370843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.370846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.370848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.370853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.370857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.370862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.370877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:54.379177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:54.381109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:54.381126Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:54.381129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:54.381132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:54.381139Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 162 [1:7556533138056826196:4019]
2025-10-02T08:07:54.381150Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:54.381171Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:54.381179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.381182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.381189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.381204Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:54.381214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:54.381225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:54.381290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.381298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.381302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:54.381304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:54.381367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:54.381375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.381388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.381404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:54.381410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 162
2025-10-02T08:07:54.381425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056826186:4020], now have 1 active actors on pipe
2025-10-02T08:07:54.381432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533138517248250:2378], now have 1 active actors on pipe
2025-10-02T08:07:54.381439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533138056826189:4019]
2025-10-02T08:07:54.381446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533138056826189:4019]
2025-10-02T08:07:54.381458Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:54.381472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:54.381472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.381477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.381480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:54.381496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:54.381514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:54.381521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:54.381560Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d386c32e-1520014e-a82255da-94e5684b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:54.381505Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 162
2025-10-02T08:07:54.381571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.381579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.381581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:54.381589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.381601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:54.381620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533138056826189:4019]
2025-10-02T08:07:54.381628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:54.381638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:54.381647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.381701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.381708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.381723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.381761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 163 partition: 0 MaxSeqNo: 17 sessionId: src_id|d386c32e-1520014e-a82255da-94e5684b_0
2025-10-02T08:07:54.381991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cefd9c49-1f694ff8-4bdb8972-4ad77474_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d386c32e-1520014e-a82255da-94e5684b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:54.384997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d386c32e-1520014e-a82255da-94e5684b_0] Write session: try to update token
2025-10-02T08:07:54.385012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d386c32e-1520014e-a82255da-94e5684b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:54.398494Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:54.398511Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:54.398513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:54.398520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533138056826189:4019]
2025-10-02T08:07:54.398524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533138056826189:4019]
2025-10-02T08:07:54.398563Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:54.398568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:54.398572Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:54.398574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.398577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:54.398755Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:54.402603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId: src_id|d386c32e-1520014e-a82255da-94e5684b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:54.405470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:54.453316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533138056826228:3491]
2025-10-02T08:07:54.453411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 162, pipe: [1:7556533138056826228:3491]
2025-10-02T08:07:54.536061Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:54.536514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.536531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.536577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056826228:3491], now have 1 active actors on pipe
2025-10-02T08:07:54.536710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533138056826228:3491]
2025-10-02T08:07:54.536732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:54.536737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:54.536794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 163 reason: error at write: Disconnected sessionId: src_id|d386c32e-1520014e-a82255da-94e5684b_0
2025-10-02T08:07:54.536812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:54.536843Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:54.536963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 163 sessionId: src_id|d386c32e-1520014e-a82255da-94e5684b_0 is DEAD
2025-10-02T08:07:54.537099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d386c32e-1520014e-a82255da-94e5684b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:54.537104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d386c32e-1520014e-a82255da-94e5684b_0] Write session will restart in 0.009745s
2025-10-02T08:07:54.537124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d386c32e-1520014e-a82255da-94e5684b_0] Write session: Do CDS request
2025-10-02T08:07:54.537129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d386c32e-1520014e-a82255da-94e5684b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:54.548483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d386c32e-1520014e-a82255da-94e5684b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.548492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:54.548506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 164
2025-10-02T08:07:54.548742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.548772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:54.548788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:54.548791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:54.549166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 164 sessionId:  describe result for acl check
2025-10-02T08:07:54.549199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:54.549201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:54.549201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:54.549205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533138056826697:4028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:54.549612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533138056826697:4028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:54.550385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:54.551387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:54.551521Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:54.551528Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:54.551534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:54.551565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:54.551565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533138056826697:4028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:54.551601Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533138056826734:4027]
2025-10-02T08:07:54.552016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:54.552164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:54.552190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:54.552389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:54.552418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.552419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.552419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.552420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.552421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.552424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.552430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.552432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.552434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.552435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.552438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.552442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.552445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.552448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.552450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.552453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.552455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.552458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.552460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.552462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.552473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:54.557238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533138056826697:4028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:54.557251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533138056826697:4028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:54.557254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533138056826697:4028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:54.557260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:54.560399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:54.561961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:54.561977Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:54.561979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:54.561982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:54.561988Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 163 [1:7556533138056826734:4027]
2025-10-02T08:07:54.561998Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:54.562014Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:54.562016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.562018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.562020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.562032Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:54.562040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:54.562046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:54.562096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.562101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.562103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:54.562105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:54.562163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:54.562171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.562182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.562195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:54.562217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056826761:4028], now have 1 active actors on pipe
2025-10-02T08:07:54.562228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533138056826717:4027]
2025-10-02T08:07:54.562231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533138056826717:4027]
2025-10-02T08:07:54.562231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 163
2025-10-02T08:07:54.562238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:54.562244Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:54.562246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533138517248257:2378], now have 1 active actors on pipe
2025-10-02T08:07:54.562246Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:54.562253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:54.562265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:54.562267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:54.562274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.562278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.562317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533138056826717:4027]
2025-10-02T08:07:54.562320Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:54.562293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 163
2025-10-02T08:07:54.562330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:54.562338Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:54.562344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.562348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.562355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:54.562364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.562377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:54.562416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.562479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.562486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.562499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.562533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 164 partition: 0 MaxSeqNo: 17 sessionId: src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0
2025-10-02T08:07:54.562915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d386c32e-1520014e-a82255da-94e5684b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:54.565993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0] Write session: try to update token
2025-10-02T08:07:54.566015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:54.578834Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:54.578849Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:54.578850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:54.578857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533138056826717:4027]
2025-10-02T08:07:54.578860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533138056826717:4027]
2025-10-02T08:07:54.578897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:54.578902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.578904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:54.578911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:54.578925Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:54.579042Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:54.584189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId: src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:54.586882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:54.637137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533138056826775:3491]
2025-10-02T08:07:54.637254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 163, pipe: [1:7556533138056826775:3491]
2025-10-02T08:07:54.714246Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:54.714631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.714644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.714680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056826775:3491], now have 1 active actors on pipe
2025-10-02T08:07:54.714784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:54.714792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:54.714846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 164 reason: error at write: Disconnected sessionId: src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0
2025-10-02T08:07:54.714856Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:54.714907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:54.715033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 164 sessionId: src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0 is DEAD
2025-10-02T08:07:54.715178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533138056826775:3491]
2025-10-02T08:07:54.715217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:54.715232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0] Write session will restart in 0.008733s
2025-10-02T08:07:54.715258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0] Write session: Do CDS request
2025-10-02T08:07:54.715266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:54.725378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.725433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:54.725449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 165
2025-10-02T08:07:54.725667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.725698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:54.725707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:54.725711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:54.726121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 165 sessionId:  describe result for acl check
2025-10-02T08:07:54.726160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:54.726167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:54.726169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:54.726174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533138056827193:4034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:54.726737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533138056827193:4034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:54.729338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:54.729586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533138056827193:4034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:54.730250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:54.730447Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:54.730457Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:54.730466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:54.730522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:54.730556Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533138056827294:4033]
2025-10-02T08:07:54.731216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:54.731434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:54.731493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:54.731839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:54.731882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.731887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.731887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.731888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.731889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.731893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.731900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.731903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.731905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.731907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.731911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.731917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.731921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.731924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.731927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.731929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.731932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.731935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.731938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.731941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.731959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:54.732256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533138056827193:4034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:54.732268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533138056827193:4034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:54.732271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533138056827193:4034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:54.732280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:54.740266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:54.742168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:54.742188Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:54.742190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:54.742195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:54.742202Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 164 [1:7556533138056827294:4033]
2025-10-02T08:07:54.742214Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:54.742232Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:54.742235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.742238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.742241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.742257Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:54.742268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:54.742275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:54.742344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.742351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.742354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:54.742356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:54.742422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:54.742428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.742443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.742459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:54.742481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056827311:4034], now have 1 active actors on pipe
2025-10-02T08:07:54.742492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533138056827278:4033]
2025-10-02T08:07:54.742494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533138056827278:4033]
2025-10-02T08:07:54.742501Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:54.742503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 164
2025-10-02T08:07:54.742512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:54.742514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533138517248264:2378], now have 1 active actors on pipe
2025-10-02T08:07:54.742515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:54.742523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:54.742537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:54.742545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:54.742552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.742560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.742601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533138056827278:4033]
2025-10-02T08:07:54.742609Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:54.742618Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:54.742626Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:54.742632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.742636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.742638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:54.742602Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 164
2025-10-02T08:07:54.742649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.742661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:54.742707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.742778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.742784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.742798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.742837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 165 partition: 0 MaxSeqNo: 17 sessionId: src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0
2025-10-02T08:07:54.743216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd17c1ff-189b170e-af79b2d8-be81ca26_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:54.746023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0] Write session: try to update token
2025-10-02T08:07:54.746048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:54.760079Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:54.760095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:54.760097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:54.760109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533138056827278:4033]
2025-10-02T08:07:54.760111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533138056827278:4033]
2025-10-02T08:07:54.760162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:54.760161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:54.760167Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:54.760168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.760170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:54.760314Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:54.766035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId: src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:54.769134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:54.815291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533138056827327:3491]
2025-10-02T08:07:54.816414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 164, pipe: [1:7556533138056827327:3491]
2025-10-02T08:07:54.899663Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:54.899983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.899998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.900038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056827327:3491], now have 1 active actors on pipe
2025-10-02T08:07:54.900270Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:54.900335Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:54.900311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:54.900412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 165 reason: status is not ok: tablet will be restarted right now sessionId: src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0
2025-10-02T08:07:54.900583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533138056827327:3491]
2025-10-02T08:07:54.900615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 165 sessionId: src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0 is DEAD
2025-10-02T08:07:54.901071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:54.901088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0] Write session will restart in 0.007257s
2025-10-02T08:07:54.901118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0] Write session: Do CDS request
2025-10-02T08:07:54.901125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:54.909638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.911826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:54.911843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 166
2025-10-02T08:07:54.912022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:54.912051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:54.912058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:54.912061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:54.912580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 166 sessionId:  describe result for acl check
2025-10-02T08:07:54.912605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:54.912607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:54.912609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:54.912614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533138056827730:4041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:54.913200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533138056827730:4041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:54.916329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533138056827730:4041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:54.917109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:54.917867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:54.918054Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:54.918058Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:54.918070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:54.918117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:54.918150Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533138056827848:4040]
2025-10-02T08:07:54.918780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:54.919067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:54.919130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:54.919480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:54.919550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.919558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.919559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.919561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.919562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.919568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.919578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.919582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.919586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.919590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.919597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.919605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:54.919616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.919621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:54.919626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.919632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:54.919642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.919648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.919653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.919659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.919685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:54.924636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533138056827730:4041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:54.924654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533138056827730:4041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:54.924658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533138056827730:4041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:54.924667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:54.927901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:54.929659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:54.929672Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:54.929674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:54.929677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:54.929681Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 165 [1:7556533138056827848:4040]
2025-10-02T08:07:54.929690Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:54.929703Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:54.929706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.929708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.929709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.929721Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:54.929724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:54.929728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:54.929789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.929796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.929800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:54.929802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:54.929914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 165
2025-10-02T08:07:54.929957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:54.929961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.929973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:54.929987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:54.930008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533138056827865:4041], now have 1 active actors on pipe
2025-10-02T08:07:54.930016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533138517248272:2378], now have 1 active actors on pipe
2025-10-02T08:07:54.930021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.930025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.930011Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 165
2025-10-02T08:07:54.930042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533138056827834:4040]
2025-10-02T08:07:54.930047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533138056827834:4040]
2025-10-02T08:07:54.930055Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:54.930061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:54.930063Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:54.930066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:54.930080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:54.930086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:54.930102Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:54.930116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:54.930118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:54.930120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:54.930128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:54.930137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:54.930175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533138056827834:4040]
2025-10-02T08:07:54.930187Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:54.930192Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:54.930197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.930243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:54.930249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:54.930261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:54.930299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 166 partition: 0 MaxSeqNo: 17 sessionId: src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0
2025-10-02T08:07:54.930643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|361480a7-af4e8fef-a2ea3e-63ab9396_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:54.933133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0] Write session: try to update token
2025-10-02T08:07:54.933151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:54.941158Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:54.941182Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:54.941194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533138056827834:4040]
2025-10-02T08:07:54.941256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:54.941455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:54.941617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:54.941760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:54.941910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:54.941987Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:54.942113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:54.942161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:54.954960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId: src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:54.963286Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:54.963307Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:54.963310Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:54.963320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533138056827834:4040]
2025-10-02T08:07:54.963325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533138056827834:4040]
2025-10-02T08:07:54.963378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:54.963385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:54.963387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:54.963423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:54.963433Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:54.963536Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:54.963876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:55.003744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533142351795187:3491]
2025-10-02T08:07:55.006256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 165, pipe: [1:7556533142351795187:3491]
2025-10-02T08:07:55.110664Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:55.111218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.111235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.111256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351795187:3491], now have 1 active actors on pipe
2025-10-02T08:07:55.111464Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:55.111419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533142351795187:3491]
2025-10-02T08:07:55.111446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:55.111448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:55.111483Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:55.111508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 166 reason: error at write: Disconnected sessionId: src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0
2025-10-02T08:07:55.111679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 166 sessionId: src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0 is DEAD
2025-10-02T08:07:55.117805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:55.117822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0] Write session will restart in 0.006921s
2025-10-02T08:07:55.117850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0] Write session: Do CDS request
2025-10-02T08:07:55.117857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:55.127297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.127462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:55.127487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 167
2025-10-02T08:07:55.129800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.129870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:55.129884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:55.129891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:55.130422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 167 sessionId:  describe result for acl check
2025-10-02T08:07:55.130472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:55.130475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:55.130477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:55.130483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533142351795691:4057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:55.130768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:55.131047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533142351795691:4057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:55.131368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:55.131563Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:55.131572Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:55.131584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:55.131635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:55.131684Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533142351795703:4056]
2025-10-02T08:07:55.132351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:55.133034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:55.133113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:55.133625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:55.133685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.133687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.133688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.133689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.133691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.133697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.133707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.133710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.133714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.133718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.133724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.133731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.133737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.133742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.133746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.133752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.133756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.133761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.133765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.133771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.133790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:55.134616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533142351795691:4057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:55.144148Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 166
2025-10-02T08:07:55.141451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533142351795691:4057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:55.141469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533142351795691:4057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:55.141472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533142351795691:4057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:55.141480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:55.142091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:55.143788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:55.143793Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:55.143796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:55.143801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:55.143808Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 166 [1:7556533142351795703:4056]
2025-10-02T08:07:55.143820Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:55.143839Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:55.143842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.143846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.143847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.143864Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:55.143869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:55.143876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:55.143939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.143942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.143944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:55.143947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:55.144051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 166
2025-10-02T08:07:55.144247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:55.144250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.144264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.144278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:55.144299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351795754:4057], now have 1 active actors on pipe
2025-10-02T08:07:55.144302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533142812215588:2378], now have 1 active actors on pipe
2025-10-02T08:07:55.144307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.144311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.144333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533142351795692:4056]
2025-10-02T08:07:55.144335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533142351795692:4056]
2025-10-02T08:07:55.144352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:55.144366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:55.144372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:55.144375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:55.144380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:55.144383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:55.144400Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5769dbd9-3348666d-2471260-c54f3391_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:55.144406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.144409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.144411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:55.144420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.144429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:55.144464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533142351795692:4056]
2025-10-02T08:07:55.144473Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:55.144487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.144493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:55.144539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.144541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.144557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.144590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 167 partition: 0 MaxSeqNo: 17 sessionId: src_id|5769dbd9-3348666d-2471260-c54f3391_0
2025-10-02T08:07:55.149079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43d5b300-fcfb2c21-1dce751d-aa7c026_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5769dbd9-3348666d-2471260-c54f3391_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:55.151672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5769dbd9-3348666d-2471260-c54f3391_0] Write session: try to update token
2025-10-02T08:07:55.151688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5769dbd9-3348666d-2471260-c54f3391_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:55.155975Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:55.155997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:55.156006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533142351795692:4056]
2025-10-02T08:07:55.156040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:55.156050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:55.156257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:55.156426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:55.156580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:55.156748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:55.157013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:55.157057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:55.170431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId: src_id|5769dbd9-3348666d-2471260-c54f3391_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:55.172780Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:55.172837Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:55.172840Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:55.172849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533142351795692:4056]
2025-10-02T08:07:55.172857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533142351795692:4056]
2025-10-02T08:07:55.172911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:55.172919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:55.172925Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:55.172927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.172929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:55.173080Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:55.173626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:55.211601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533142351795775:3491]
2025-10-02T08:07:55.211712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 166, pipe: [1:7556533142351795775:3491]
2025-10-02T08:07:55.324236Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:55.324759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.324774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.324794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351795775:3491], now have 1 active actors on pipe
2025-10-02T08:07:55.324957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533142351795775:3491]
2025-10-02T08:07:55.324982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:55.324984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:55.324992Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:55.325025Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:55.325042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 167 reason: error at write: Disconnected sessionId: src_id|5769dbd9-3348666d-2471260-c54f3391_0
2025-10-02T08:07:55.325245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 167 sessionId: src_id|5769dbd9-3348666d-2471260-c54f3391_0 is DEAD
2025-10-02T08:07:55.325405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769dbd9-3348666d-2471260-c54f3391_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:55.325415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769dbd9-3348666d-2471260-c54f3391_0] Write session will restart in 0.005453s
2025-10-02T08:07:55.325442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769dbd9-3348666d-2471260-c54f3391_0] Write session: Do CDS request
2025-10-02T08:07:55.325458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769dbd9-3348666d-2471260-c54f3391_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:55.332422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5769dbd9-3348666d-2471260-c54f3391_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.332505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:55.332518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 168
2025-10-02T08:07:55.332679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.332707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:55.332714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:55.332718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:55.333186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 168 sessionId:  describe result for acl check
2025-10-02T08:07:55.333226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:55.333232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:55.333233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:55.333239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533142351796023:4067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:55.333772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533142351796023:4067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:55.336537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533142351796023:4067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:55.340548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533142351796023:4067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:55.340563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533142351796023:4067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:55.340567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533142351796023:4067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:55.340579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:55.355309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:55.356355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:55.356540Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:55.356548Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:55.356554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:55.356597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:55.356626Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533142351796311:4066]
2025-10-02T08:07:55.357155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:55.357360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:55.357400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:55.357677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:55.357718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.357722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.357723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.357724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.357726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.357731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.357740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.357747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.357751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.357755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.357762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.357769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.357778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.357784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.357802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.357812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.357816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.357822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.357826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.357831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.357849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:55.365699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:55.367398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:55.367415Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:55.367417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:55.367419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:55.367425Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 167 [1:7556533142351796311:4066]
2025-10-02T08:07:55.367432Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:55.367446Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:55.367449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.367451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.367453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.367465Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:55.367468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:55.367473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:55.367533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.367543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.367545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:55.367547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:55.367598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:55.367603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.367611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.367618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:55.367630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533142351796305:4066]
2025-10-02T08:07:55.367634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533142351796305:4066]
2025-10-02T08:07:55.367640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:55.367650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:55.367655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:55.367659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:55.367660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:55.367662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:55.367690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533142351796305:4066]
2025-10-02T08:07:55.367697Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:55.367706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351796131:4067], now have 1 active actors on pipe
2025-10-02T08:07:55.367714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:55.367717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 167
2025-10-02T08:07:55.367722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533142812215618:2378], now have 1 active actors on pipe
2025-10-02T08:07:55.367728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.367731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.367749Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:55.367753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.367755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.367756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:55.367763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.367768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:55.367779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.367807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.367812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.367821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.367846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 168 partition: 0 MaxSeqNo: 17 sessionId: src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0
2025-10-02T08:07:55.367841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 167
2025-10-02T08:07:55.368226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769dbd9-3348666d-2471260-c54f3391_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:55.370828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0] Write session: try to update token
2025-10-02T08:07:55.370853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:55.383868Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:55.383884Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:55.383886Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:55.383892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533142351796305:4066]
2025-10-02T08:07:55.383895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533142351796305:4066]
2025-10-02T08:07:55.383925Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:55.383927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:55.383929Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:55.383932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.383933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:55.384064Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:55.391433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId: src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:55.394284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:55.425106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533142351796340:3491]
2025-10-02T08:07:55.425195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 167, pipe: [1:7556533142351796340:3491]
2025-10-02T08:07:55.517623Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:55.518276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.518290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.518312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351796340:3491], now have 1 active actors on pipe
2025-10-02T08:07:55.518406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:55.518413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:55.518464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 168 reason: error at write: Disconnected sessionId: src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0
2025-10-02T08:07:55.518513Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:55.518563Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:55.518668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 168 sessionId: src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0 is DEAD
2025-10-02T08:07:55.518791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533142351796340:3491]
2025-10-02T08:07:55.518846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:55.518862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0] Write session will restart in 0.006989s
2025-10-02T08:07:55.518890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0] Write session: Do CDS request
2025-10-02T08:07:55.518897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:55.527421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.527522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:55.527536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 169
2025-10-02T08:07:55.527664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.527686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:55.527693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:55.527695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:55.528024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 169 sessionId:  describe result for acl check
2025-10-02T08:07:55.528046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:55.528051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:55.528052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:55.528055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533142351796732:4073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:55.528416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533142351796732:4073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:55.531512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533142351796732:4073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:55.532378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:55.533188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:55.533360Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:55.533368Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:55.533377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:55.533419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:55.533460Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533142351796865:4072]
2025-10-02T08:07:55.534093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:55.534270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:55.534320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:55.534444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533142351796732:4073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:55.534453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533142351796732:4073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:55.534456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533142351796732:4073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:55.534466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:55.534664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:55.534711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.534717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.534718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.534719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.534720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.534725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.534734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.534738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.534742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.534745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.534750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.534757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.534762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.534768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.534771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.534776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.534781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.534785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.534789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.534799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.534819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:55.542383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:55.544282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:55.544301Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:55.544304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:55.544307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:55.544314Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 168 [1:7556533142351796865:4072]
2025-10-02T08:07:55.544327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:55.544346Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:55.544354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.544358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.544360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.544375Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:55.544385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:55.544395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:55.544465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.544473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.544476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:55.544479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:55.544543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:55.544551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.544564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.544580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:55.544584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 168
2025-10-02T08:07:55.544604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351796876:4073], now have 1 active actors on pipe
2025-10-02T08:07:55.544614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533142812215624:2378], now have 1 active actors on pipe
2025-10-02T08:07:55.544619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.544623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.544640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533142351796859:4072]
2025-10-02T08:07:55.544642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533142351796859:4072]
2025-10-02T08:07:55.544654Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:55.544666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:55.544673Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:55.544677Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:55.544680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:55.544683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:55.544669Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 168
2025-10-02T08:07:55.544699Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:55.544710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.544714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.544716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:55.544724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.544734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:55.544772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533142351796859:4072]
2025-10-02T08:07:55.544787Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:55.544796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:55.544832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.544882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.544892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.544909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.544943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 169 partition: 0 MaxSeqNo: 17 sessionId: src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0
2025-10-02T08:07:55.545399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c906cbfa-39dbd57a-51d0fa42-c81e8716_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:55.547727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0] Write session: try to update token
2025-10-02T08:07:55.547746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:55.555002Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:55.555023Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:55.555030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533142351796859:4072]
2025-10-02T08:07:55.555067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:55.555071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:55.555232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:55.555372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:55.555514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:55.555669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:55.555895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:55.555939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:55.562999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId: src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:55.565751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:55.565820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.565837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.565869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:55.565897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:55.565943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.565961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.566140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.566209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.566282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.566356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.566648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.566659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.566740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.566811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.566880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.566952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.567007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.567013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.567080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.567141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.567202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.567266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.567314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.567321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.567386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.567453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.567517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.567579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.567625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.567636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.567702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.567759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.567819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.567881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.567930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.567936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.568002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.568067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.568155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.568222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.568268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.568275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.568341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.568405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.568475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.568540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.568586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.568593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.568664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.568744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.568842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.568909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.568956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.568962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.569030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.569095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.569159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.569223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.569274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.569281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.569347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:55.569413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:55.569477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:55.569539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:55.569652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:55.569659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:55.569721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:55.569788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.569814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.569821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:55.569852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:55.569868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:55.569876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:55.569878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:55.569885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:55.570276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:55.570303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:55.570314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:55.570318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:55.570325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:55.570328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:55.571062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:55.571088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:55.571098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:55.571105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:55.571108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:55.571112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:55.571584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:55.571604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:55.571616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:55.571625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:55.571628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:55.579346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:55.579376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:55.579391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392475579
2025-10-02T08:07:55.579597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:55.579618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:55.579632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:55.579640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:55.579645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:55.579648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:55.580142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:55.580165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:55.580175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:55.580178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:55.580182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:55.580192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:55.580710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:55.580731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:55.580736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:55.580740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:55.580744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:55.580749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:55.581260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:55.581281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:55.581287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:55.582420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:55.582441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:55.582445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:55.582449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:55.582457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392475582
2025-10-02T08:07:55.582784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:55.582804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:55.582810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:55.582818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:55.582822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:55.582826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:55.583275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:55.583298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:55.583305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:55.583309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:55.583312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:55.583317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:55.583778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:55.583798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.583904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392475583
2025-10-02T08:07:55.586598Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:55.586626Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:55.586632Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:55.586638Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:55.586648Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:55.586652Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:55.586654Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:55.586661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533142351796859:4072]
2025-10-02T08:07:55.586666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533142351796859:4072]
2025-10-02T08:07:55.586699Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:55.586709Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:55.586737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:55.586745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.586746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:55.586890Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:55.619123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533142351796898:3491]
2025-10-02T08:07:55.619241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 168, pipe: [1:7556533142351796898:3491]
2025-10-02T08:07:55.725745Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:55.726094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351796898:3491], now have 1 active actors on pipe
2025-10-02T08:07:55.726238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:55.726248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:55.726261Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:55.726284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 169 reason: error at write: Disconnected sessionId: src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0
2025-10-02T08:07:55.726472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 169 sessionId: src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0 is DEAD
2025-10-02T08:07:55.726524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533142351796898:3491]
2025-10-02T08:07:55.726680Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:55.728923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:55.728940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0] Write session will restart in 0.008428s
2025-10-02T08:07:55.728969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0] Write session: Do CDS request
2025-10-02T08:07:55.728977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:55.730296Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [932ee0a1c6295a62] Result# TEvPutResult {Id# [72075186224037892:168:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:55.730308Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:168:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:55.730367Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:168:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:55.738391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.738573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:55.738592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 170
2025-10-02T08:07:55.738700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.738738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:55.738744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:55.738752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:55.739226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 170 sessionId:  describe result for acl check
2025-10-02T08:07:55.739269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:55.739270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:55.739272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:55.739278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533142351797290:4080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:55.739823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533142351797290:4080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:55.742289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533142351797290:4080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:55.744078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:55.744898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:55.745037Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:55.745047Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:55.745053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:55.745095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:55.745177Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533142351797432:4078]
2025-10-02T08:07:55.745447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533142351797290:4080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:55.745463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533142351797290:4080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:55.745467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533142351797290:4080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:55.745475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:55.745605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:55.745720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:55.745756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:55.745960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:55.745991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.745997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.745999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.746000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.746001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.746005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.746013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.746016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.746020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.746023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.746028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.746034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.746039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.746044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.746047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.746051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.746055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.746059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.746062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.746066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.746082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:55.754183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:55.755935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:55.755954Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:55.755958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:55.755961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:55.755968Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 169 [1:7556533142351797432:4078]
2025-10-02T08:07:55.755980Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:55.755998Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:55.756001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.756004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.756006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.756022Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:55.756027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:55.756035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:55.756103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.756112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.756115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:55.756118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:55.756192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:55.756204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.756215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.756225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:55.756242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351797437:4080], now have 1 active actors on pipe
2025-10-02T08:07:55.756249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533142351797426:4078]
2025-10-02T08:07:55.756251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533142351797426:4078]
2025-10-02T08:07:55.756257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 169
2025-10-02T08:07:55.756259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:55.756270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533142812215630:2378], now have 1 active actors on pipe
2025-10-02T08:07:55.756270Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:55.756274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:55.756275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:55.756286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:55.756289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:55.756295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.756299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.756335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533142351797426:4078]
2025-10-02T08:07:55.756351Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:55.756357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:55.756365Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:55.756371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.756375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.756377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:55.756385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.756393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:55.756370Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 169
2025-10-02T08:07:55.756423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.756493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.756501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.756513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.756548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 170 partition: 0 MaxSeqNo: 17 sessionId: src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0
2025-10-02T08:07:55.756987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8f1fc7-df6d67fd-54682d36-96cfc992_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:55.759816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0] Write session: try to update token
2025-10-02T08:07:55.759836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:55.776049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId: src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:55.777157Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:55.777176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:55.777179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:55.777188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533142351797426:4078]
2025-10-02T08:07:55.777194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533142351797426:4078]
2025-10-02T08:07:55.777238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:55.777241Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:55.777248Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:55.777252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.777255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:55.777415Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:55.779110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:55.826507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533142351797463:3491]
2025-10-02T08:07:55.826661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 169, pipe: [1:7556533142351797463:3491]
2025-10-02T08:07:55.914896Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:55.915274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.915287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.915321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351797463:3491], now have 1 active actors on pipe
2025-10-02T08:07:55.915448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:55.915460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:55.915529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 170 reason: error at write: Disconnected sessionId: src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0
2025-10-02T08:07:55.915650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:55.915696Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:55.915712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 170 sessionId: src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0 is DEAD
2025-10-02T08:07:55.915874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:55.915887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0] Write session will restart in 0.009290s
2025-10-02T08:07:55.915907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0] Write session: Do CDS request
2025-10-02T08:07:55.915912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:55.915974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533142351797463:3491]
2025-10-02T08:07:55.926310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.926389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:55.926405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 171
2025-10-02T08:07:55.926560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:55.926595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:55.926604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:55.926608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:55.927000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 171 sessionId:  describe result for acl check
2025-10-02T08:07:55.927027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:55.927033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:55.927035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:55.927039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533142351797893:4086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:55.927499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533142351797893:4086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:55.930085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533142351797893:4086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:55.930341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:55.931165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:55.931330Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:55.931340Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:55.931347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:55.931385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:55.931471Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533142351797994:4085]
2025-10-02T08:07:55.932074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:55.932265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:55.932303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:55.932565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:55.932607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.932612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.932614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.932615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.932616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.932621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.932630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.932634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.932636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.932639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.932644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.932650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:55.932661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.932665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:55.932669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.932678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:55.932682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.932687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.932691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.932695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.932717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:55.933021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533142351797893:4086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:55.933036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533142351797893:4086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:55.933040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533142351797893:4086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:55.933048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:55.943631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:55.945401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:55.945418Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:55.945420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:55.945424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:55.945431Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 170 [1:7556533142351797994:4085]
2025-10-02T08:07:55.945446Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:55.945463Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:55.945465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.945467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.945468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.945481Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:55.945491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:55.945498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:55.945571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.945579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.945582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:55.945585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:55.945640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:55.945647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.945657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:55.945664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:55.945682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533142351797979:4085]
2025-10-02T08:07:55.945688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533142351797979:4085]
2025-10-02T08:07:55.945696Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:55.945708Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:55.945714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:55.945717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 170
2025-10-02T08:07:55.945718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:55.945728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:55.945735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:55.945745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533142351798011:4086], now have 1 active actors on pipe
2025-10-02T08:07:55.945753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533142812215639:2378], now have 1 active actors on pipe
2025-10-02T08:07:55.945787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.945795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.945808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533142351797979:4085]
2025-10-02T08:07:55.945819Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:55.945829Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:55.945840Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:55.945848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:55.945851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:55.945855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:55.945862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:55.945868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:55.945889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.945857Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 170
2025-10-02T08:07:55.945930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:55.945935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:55.945947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:55.945993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 171 partition: 0 MaxSeqNo: 17 sessionId: src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0
2025-10-02T08:07:55.946362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8c4745-6c1f9bed-b99b8c8b-7cfd9070_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:55.948871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0] Write session: try to update token
2025-10-02T08:07:55.948886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:55.963393Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:55.963418Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:55.963420Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:55.963427Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533142351797979:4085]
2025-10-02T08:07:55.963431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533142351797979:4085]
2025-10-02T08:07:55.963473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:55.963483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:55.963485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:55.963484Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:55.963491Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:55.963625Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:55.963776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId: src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:55.967119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:56.054422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533146646765333:3491]
2025-10-02T08:07:56.054624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 170, pipe: [1:7556533146646765333:3491]
2025-10-02T08:07:56.096389Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:56.096761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.096773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.096825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646765333:3491], now have 1 active actors on pipe
2025-10-02T08:07:56.096964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533146646765333:3491]
2025-10-02T08:07:56.097000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:56.097007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:56.097037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:56.097085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 171 reason: error at write: Disconnected sessionId: src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0
2025-10-02T08:07:56.097188Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:56.097291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 171 sessionId: src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0 is DEAD
2025-10-02T08:07:56.097448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:56.097458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0] Write session will restart in 0.009796s
2025-10-02T08:07:56.097493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0] Write session: Do CDS request
2025-10-02T08:07:56.097499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:56.108414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.108510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:56.108532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 172
2025-10-02T08:07:56.108715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.108756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:56.108765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:56.108769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:56.108988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:56.109187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 172 sessionId:  describe result for acl check
2025-10-02T08:07:56.109222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:56.109228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:56.109230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:56.109236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533146646765853:4103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:56.109750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533146646765853:4103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:56.109841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:56.110010Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:56.110018Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:56.110027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:56.110069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:56.110152Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533146646765859:4101]
2025-10-02T08:07:56.110730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:56.110883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:56.110919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:56.111201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:56.111240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.111245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.111246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.111247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.111248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.111252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.111262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.111265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.111269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.111272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.111277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.111283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.111289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.111294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.111298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.111302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.111306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.111310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.111313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.111318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.111335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:56.111455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533146646765853:4103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:56.117422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533146646765853:4103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:56.117441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533146646765853:4103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:56.117444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533146646765853:4103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:56.117452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:56.119287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:56.121229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:56.121243Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:56.121246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:56.121249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:56.121256Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 171 [1:7556533146646765859:4101]
2025-10-02T08:07:56.121269Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:56.121285Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:56.121289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.121291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.121294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.121308Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:56.121313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:56.121318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:56.121383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.121390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.121394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:56.121396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:56.121452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:56.121460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.121471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.121482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:56.121488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 171
2025-10-02T08:07:56.121503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646765898:4103], now have 1 active actors on pipe
2025-10-02T08:07:56.121510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533147107182954:2378], now have 1 active actors on pipe
2025-10-02T08:07:56.121515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.121521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.121540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533146646765847:4101]
2025-10-02T08:07:56.121546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533146646765847:4101]
2025-10-02T08:07:56.121556Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:56.121574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:56.121577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:56.121579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:56.121591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:56.121593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:56.121564Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 171
2025-10-02T08:07:56.121607Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:56.121616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.121620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.121634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:56.121642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.121650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:56.121684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533146646765847:4101]
2025-10-02T08:07:56.121698Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:56.121714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:56.121717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:56.121769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.121778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.121790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:56.121826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 172 partition: 0 MaxSeqNo: 17 sessionId: src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0
2025-10-02T08:07:56.122222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|122fd93-a2e88385-3b570cf8-3e9f39c2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:56.124832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0] Write session: try to update token
2025-10-02T08:07:56.124855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:56.131925Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:56.131945Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:56.131956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533146646765847:4101]
2025-10-02T08:07:56.131985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:56.131994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:56.132214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:56.132346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:56.132479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:56.132622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:56.132862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:56.132905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:56.140482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId: src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:56.143242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:56.143307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.143319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.143346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:56.143364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:56.143634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.143646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.143804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.144226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.144299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.144373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.144637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.144646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.144709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.144768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.144842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.144905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.144955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.144962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.145028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.145093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.145156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.145219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.145273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.145281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.145344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.145404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.145470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.145534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.145587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.145595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.145664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.145722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.145787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.145857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.145905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.145912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.145988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.146055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.146118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.146175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.146220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.146227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.146293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.146348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.146417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.146483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.146526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.146532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.146609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.146667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.146723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.146784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.146829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.146834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.146893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.146949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.147009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.147061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.147110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.147116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.147181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.147232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.147288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.147349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.147389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.147394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.147444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:56.147499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.147514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.147519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:56.147543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:56.147557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:56.147562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:56.147564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:56.147566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:56.147990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:56.148018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:56.148025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:56.148033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:56.148036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:56.148040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:56.148617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:56.148635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:56.148643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:56.148645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:56.148648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:56.148651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:56.149251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:56.149279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:56.149285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:56.149288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:56.149294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:56.156708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:56.156734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:56.156751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392476156
2025-10-02T08:07:56.156899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:56.156917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:56.156926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:56.156930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:56.156935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:56.156940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:56.157444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:56.157468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:56.157475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:56.157481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:56.157485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:56.157489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:56.157969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:56.157990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:56.157999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:56.158002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:56.158006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:56.158010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:56.158476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:56.158498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:56.158506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:56.159589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:56.159606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:56.159611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:56.159614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:56.159621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392476159
2025-10-02T08:07:56.159900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:56.159916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:56.159921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:56.159924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:56.159926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:56.159930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:56.160421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:56.160445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:56.160451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:56.160457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:56.160460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:56.160464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:56.160953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:56.160975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.161080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392476160
2025-10-02T08:07:56.167248Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:56.167278Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:56.167283Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:56.167288Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:56.167298Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:56.167300Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:56.167302Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:56.167307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533146646765847:4101]
2025-10-02T08:07:56.167310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533146646765847:4101]
2025-10-02T08:07:56.167344Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:56.167353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:56.167373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:56.167380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.167382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:56.167512Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:56.197200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533146646765924:3491]
2025-10-02T08:07:56.197315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 171, pipe: [1:7556533146646765924:3491]
2025-10-02T08:07:56.307448Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:56.308025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646765924:3491], now have 1 active actors on pipe
2025-10-02T08:07:56.308376Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:56.309034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:56.309050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0] Write session will restart in 0.008104s
2025-10-02T08:07:56.309078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0] Write session: Do CDS request
2025-10-02T08:07:56.309085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:56.308534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:56.308543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:56.308576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 172 reason: error at write: Disconnected sessionId: src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0
2025-10-02T08:07:56.308601Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:56.308829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 172 sessionId: src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0 is DEAD
2025-10-02T08:07:56.308987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533146646765924:3491]
2025-10-02T08:07:56.317655Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [efb61a420e7a7930] Result# TEvPutResult {Id# [72075186224037892:171:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:56.317727Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:171:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:56.317820Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:171:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:56.322020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.323346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:56.323372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 173
2025-10-02T08:07:56.323640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.323684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:56.323697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:56.323702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:56.324297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 173 sessionId:  describe result for acl check
2025-10-02T08:07:56.324339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:56.324349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:56.324351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:56.324357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533146646766264:4112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:56.325050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533146646766264:4112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:56.339361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533146646766264:4112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:56.342161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:56.343641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:56.343890Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:56.343901Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:56.343912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:56.343962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:56.344010Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533146646766479:4110]
2025-10-02T08:07:56.344781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:56.345228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533146646766264:4112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:56.345245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533146646766264:4112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:56.345249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533146646766264:4112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:56.345259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:56.346050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:56.346107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:56.346494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:56.346548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.346554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.346556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.346557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.346558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.346564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.346575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.346579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.346583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.346586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.346592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.346602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.346609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.346613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.346618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.346623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.346627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.346632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.346637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.346650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.346677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:56.357720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:56.359324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:56.359347Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:56.359351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:56.359355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:56.359364Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 172 [1:7556533146646766479:4110]
2025-10-02T08:07:56.359379Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:56.359396Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:56.359398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.359401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.359403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.359421Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:56.359424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:56.359429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:56.359501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.359510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.359512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:56.359514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:56.359667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:56.359676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.359686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.359699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:56.359722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533146646766472:4110]
2025-10-02T08:07:56.359730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533146646766472:4110]
2025-10-02T08:07:56.359743Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:56.359756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:56.359777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:56.359780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:56.359814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533146646766472:4110]
2025-10-02T08:07:56.359821Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:56.359934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:56.359943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:56.359948Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:56.360156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 172
2025-10-02T08:07:56.360189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646766485:4112], now have 1 active actors on pipe
2025-10-02T08:07:56.360313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533147107182984:2378], now have 1 active actors on pipe
2025-10-02T08:07:56.360327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.360336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.360381Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:56.360398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.360409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.360412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:56.360427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.360450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:56.360476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:56.360564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.360577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.360602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:56.360649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 173 partition: 0 MaxSeqNo: 17 sessionId: src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0
2025-10-02T08:07:56.360623Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 172
2025-10-02T08:07:56.361037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29672a63-a1162701-1b7c1971-a4af2fe6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:56.364234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0] Write session: try to update token
2025-10-02T08:07:56.364252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:56.389405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId: src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:56.389797Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:56.389815Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:56.389817Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:56.389828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533146646766472:4110]
2025-10-02T08:07:56.389833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533146646766472:4110]
2025-10-02T08:07:56.389882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:56.389894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.389897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:56.390050Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:56.392290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:56.392390Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:56.392396Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:56.408435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533146646766513:3491]
2025-10-02T08:07:56.408728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 172, pipe: [1:7556533146646766513:3491]
2025-10-02T08:07:56.549377Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:56.549804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.549824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.549846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646766513:3491], now have 1 active actors on pipe
2025-10-02T08:07:56.550115Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:56.550529Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:56.550378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533146646766513:3491]
2025-10-02T08:07:56.550400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:56.550447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 173 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0
2025-10-02T08:07:56.550605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 173 sessionId: src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0 is DEAD
2025-10-02T08:07:56.550800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:56.550811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0] Write session will restart in 0.005957s
2025-10-02T08:07:56.550839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0] Write session: Do CDS request
2025-10-02T08:07:56.550846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:56.558357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.558452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:56.558470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 174
2025-10-02T08:07:56.561062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.561112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:56.561122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:56.561127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:56.561644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 174 sessionId:  describe result for acl check
2025-10-02T08:07:56.561692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:56.561698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:56.561700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:56.561706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533146646766743:4118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:56.562238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533146646766743:4118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:56.566716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533146646766743:4118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:56.571715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533146646766743:4118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:56.571739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533146646766743:4118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:56.571743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533146646766743:4118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:56.571753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:56.585445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:56.587035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:56.587256Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:56.587266Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:56.587278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:56.587324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:56.587376Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533146646767056:4117]
2025-10-02T08:07:56.588087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:56.588355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:56.588390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:56.588708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:56.588747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.588748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.588750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.588751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.588752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.588757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.588768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.588772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.588776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.588779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.588785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.588793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.588823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.588828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.588833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.588838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.588841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.588848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.588853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.588857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.588878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:56.600905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:56.603128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:56.603152Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:56.603155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:56.603158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:56.603165Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 173 [1:7556533146646767056:4117]
2025-10-02T08:07:56.603177Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:56.603196Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:56.603199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.603202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.603204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.603221Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:56.603227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:56.603233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:56.603305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.603317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.603321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:56.603323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:56.603848Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 173
2025-10-02T08:07:56.603399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:56.603409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.603425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.603437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:56.603457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646766919:4118], now have 1 active actors on pipe
2025-10-02T08:07:56.603464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533146646767050:4117]
2025-10-02T08:07:56.603466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533146646767050:4117]
2025-10-02T08:07:56.603474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:56.603485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533147107182993:2378], now have 1 active actors on pipe
2025-10-02T08:07:56.603485Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:56.603488Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:56.604156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0d67e-52d2e89b-33137c16-e1157f8a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:56.603491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:56.603508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:56.603511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:56.603548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533146646767050:4117]
2025-10-02T08:07:56.603557Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:56.603561Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:56.603604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 173
2025-10-02T08:07:56.603612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.603616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.603641Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:56.603649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.603653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.603656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:56.603666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.603677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:56.603693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:56.603714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.603717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.603729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:56.603760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 174 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0
2025-10-02T08:07:56.607158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0] Write session: try to update token
2025-10-02T08:07:56.607176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:56.621956Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:56.621982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:56.621985Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:56.621996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533146646767050:4117]
2025-10-02T08:07:56.622004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533146646767050:4117]
2025-10-02T08:07:56.622057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:56.622060Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:56.622064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.622066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:56.622067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:56.622240Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:56.624441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId: src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:56.627277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:56.650317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533146646767081:3491]
2025-10-02T08:07:56.650467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 173, pipe: [1:7556533146646767081:3491]
2025-10-02T08:07:56.763898Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:56.764282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.764300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.764337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646767081:3491], now have 1 active actors on pipe
2025-10-02T08:07:56.764452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533146646767081:3491]
2025-10-02T08:07:56.764479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:56.764481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:56.764524Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:56.764546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 174 reason: error at write: Disconnected sessionId: src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0
2025-10-02T08:07:56.764580Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:56.764736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 174 sessionId: src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0 is DEAD
2025-10-02T08:07:56.765887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:56.765899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0] Write session will restart in 0.005610s
2025-10-02T08:07:56.765920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0] Write session: Do CDS request
2025-10-02T08:07:56.765926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:56.772383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.772661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:56.772679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 175
2025-10-02T08:07:56.772780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.772823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:56.772832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:56.772836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:56.773366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 175 sessionId:  describe result for acl check
2025-10-02T08:07:56.773397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:56.773399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:56.773400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:56.773405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533146646767327:4125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:56.773895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533146646767327:4125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:56.777491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533146646767327:4125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:56.785387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:56.785938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533146646767327:4125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:56.785950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533146646767327:4125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:56.785953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533146646767327:4125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:56.785959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:56.786798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:56.787041Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:56.787049Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:56.787059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:56.787107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:56.787383Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533146646767629:4124]
2025-10-02T08:07:56.787932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:56.788154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:56.788187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:56.788385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:56.788419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.788423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.788424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.788424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.788425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.788428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.788435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.788437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.788439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.788441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.788444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.788448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:56.788452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.788455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:56.788457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.788460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:56.788463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.788466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.788471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.788474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.788483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:56.797161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:56.799184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:56.799203Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:56.799206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:56.799211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:56.799219Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 174 [1:7556533146646767629:4124]
2025-10-02T08:07:56.799230Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:56.799247Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:56.799249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.799252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.799254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.799269Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:56.799276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:56.799284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:56.799349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.799358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.799361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:56.799364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:56.799443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:56.799451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.799464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:56.799481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:56.799508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533146646767617:4124]
2025-10-02T08:07:56.799521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533146646767617:4124]
2025-10-02T08:07:56.799531Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:56.799538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 174
2025-10-02T08:07:56.799542Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:56.799545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:56.799551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646767624:4125], now have 1 active actors on pipe
2025-10-02T08:07:56.799561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:56.799574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:56.799577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:56.799583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533147107183000:2378], now have 1 active actors on pipe
2025-10-02T08:07:56.799588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.799592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.799641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533146646767617:4124]
2025-10-02T08:07:56.799654Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:56.799668Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:56.799675Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:56.799683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.799692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.799696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:56.799674Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 174
2025-10-02T08:07:56.799706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.799720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:56.799769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:56.799811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.799817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.799830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:56.799868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 175 partition: 0 MaxSeqNo: 17 sessionId: src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0
2025-10-02T08:07:56.800270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb177d16-a4290368-76f65ff8-cab48e9a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:56.803071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0] Write session: try to update token
2025-10-02T08:07:56.803091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:56.810640Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:56.810662Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:56.810672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533146646767617:4124]
2025-10-02T08:07:56.810723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:56.810782Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:56.810925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:56.811092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:56.811271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:56.811422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:56.811647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:56.811687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:56.818853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId: src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:56.821694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:56.821791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.821806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.821847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:56.821870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:56.821919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:56.821938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:56.822124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.822189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.822262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.822351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.822734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.822747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.822814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.822879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.822957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.823038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.823090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.823098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.823177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.823248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.823325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.823406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.823466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.823473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.823551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.823626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.823706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.823781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.823841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.823849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.823925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.823994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.824063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.824150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.824199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.824206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.824284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.824351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.824413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.824479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.824553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.824561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.824636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.824707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.824785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.824880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.824939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.824947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.825028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.825097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.825172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.825249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.825303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.825310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.825409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.825480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.825555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.825627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.825684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.825693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.825770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:56.825839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:56.825908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:56.825982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:56.826035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:56.826048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:56.826114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:56.826191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:56.826219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:56.826222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:56.826260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:56.826285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:56.826293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:56.826296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:56.826299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:56.826705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:56.826731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:56.826737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:56.826741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:56.826744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:56.826748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:56.827218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:56.827238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:56.827244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:56.827248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:56.827251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:56.827255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:56.828016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:56.828039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:56.828044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:56.828049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:56.828054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:56.829498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:56.829520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:56.829534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392476829
2025-10-02T08:07:56.829712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:56.829730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:56.829740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:56.829743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:56.829748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:56.829754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:56.830221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:56.830246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:56.830251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:56.830255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:56.830259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:56.830262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:56.830775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:56.830795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:56.830805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:56.830808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:56.830812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:56.830816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:56.831307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:56.831324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:56.831330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:56.832597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:56.832617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:56.832622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:56.832625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:56.832637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392476832
2025-10-02T08:07:56.832981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:56.833002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:56.833009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:56.833012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:56.833018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:56.833026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:56.833570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:56.833598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:56.833605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:56.833608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:56.833611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:56.833615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:56.834127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:56.834152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:56.834276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392476834
2025-10-02T08:07:56.836937Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:56.836969Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:56.836976Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:56.836988Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:56.837002Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:56.837004Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:56.837007Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:56.837018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533146646767617:4124]
2025-10-02T08:07:56.837021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533146646767617:4124]
2025-10-02T08:07:56.837094Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:56.837117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:56.837117Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:56.837123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:56.837126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:56.837281Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:56.864865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533146646767654:3491]
2025-10-02T08:07:56.865047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 174, pipe: [1:7556533146646767654:3491]
2025-10-02T08:07:56.989180Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:56.989643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533146646767654:3491], now have 1 active actors on pipe
2025-10-02T08:07:56.989795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533146646767654:3491]
2025-10-02T08:07:56.989815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:56.989821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:56.989847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 175 reason: error at write: Disconnected sessionId: src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0
2025-10-02T08:07:56.989896Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:56.989936Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:56.990057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 175 sessionId: src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0 is DEAD
2025-10-02T08:07:56.990238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:56.990248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0] Write session will restart in 0.006128s
2025-10-02T08:07:56.990273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0] Write session: Do CDS request
2025-10-02T08:07:56.990280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:56.994172Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [af488783b665d69d] Result# TEvPutResult {Id# [72075186224037892:174:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:56.994217Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:174:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:56.994258Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:174:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:56.997358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.997415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:56.997432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 176
2025-10-02T08:07:56.997716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:56.997754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:56.997765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:56.997774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:56.998190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 176 sessionId:  describe result for acl check
2025-10-02T08:07:56.998229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:56.998231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:56.998232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:56.998237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533146646767885:4131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:56.998685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533146646767885:4131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:57.000771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533146646767885:4131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:57.003779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533146646767885:4131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:57.003794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533146646767885:4131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:57.003797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533146646767885:4131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:57.003804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:57.007637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:57.008571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:57.008735Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:57.008744Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:57.008753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:57.008819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:57.008970Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533150941735501:4130]
2025-10-02T08:07:57.009474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:57.009684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:57.009727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:57.009982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:57.010020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.010026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.010027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.010028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.010029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.010034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.010044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.010048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.010051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.010055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.010061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.010068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.010073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.010078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.010083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.010087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.010091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.010100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.010104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.010109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.010128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:57.018356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:57.019793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:57.019810Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:57.019813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:57.019816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:57.019822Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 175 [1:7556533150941735501:4130]
2025-10-02T08:07:57.019831Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:57.019848Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:57.019854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.019857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.019858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.019871Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:57.019881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:57.019886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:57.019944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.019950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.019953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:57.019955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:57.020007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:57.020012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.020020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.020027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:57.020043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533150941735495:4130]
2025-10-02T08:07:57.020048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533150941735495:4130]
2025-10-02T08:07:57.020054Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:57.020064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:57.020075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:57.020080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:57.020085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:57.020089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:57.020109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941735405:4131], now have 1 active actors on pipe
2025-10-02T08:07:57.020110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 175
2025-10-02T08:07:57.020126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533150941735495:4130]
2025-10-02T08:07:57.020131Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:57.020137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:57.020140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533147107183010:2378], now have 1 active actors on pipe
2025-10-02T08:07:57.020144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.020152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.020192Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d370be17-295cf20d-71909400-7d3b00fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:57.020200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.020203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.020204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:57.020211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.020219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:57.020239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:57.020248Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 175
2025-10-02T08:07:57.020278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.020287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.020297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:57.020325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 176 partition: 0 MaxSeqNo: 17 sessionId: src_id|d370be17-295cf20d-71909400-7d3b00fe_0
2025-10-02T08:07:57.020786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdad1f4-1dc28068-50e4307b-e058b6eb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d370be17-295cf20d-71909400-7d3b00fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:57.023956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d370be17-295cf20d-71909400-7d3b00fe_0] Write session: try to update token
2025-10-02T08:07:57.023979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d370be17-295cf20d-71909400-7d3b00fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:57.037731Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:57.037750Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:57.037752Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:57.037759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533150941735495:4130]
2025-10-02T08:07:57.037763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533150941735495:4130]
2025-10-02T08:07:57.037796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:57.037801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.037802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:57.037818Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:57.037824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:57.037949Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:57.041917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId: src_id|d370be17-295cf20d-71909400-7d3b00fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:57.044942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:57.100114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533150941735539:3491]
2025-10-02T08:07:57.100315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 175, pipe: [1:7556533150941735539:3491]
2025-10-02T08:07:57.242796Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:57.243372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.243389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.243429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941735539:3491], now have 1 active actors on pipe
2025-10-02T08:07:57.243781Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:57.244146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:57.244214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 176 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d370be17-295cf20d-71909400-7d3b00fe_0
2025-10-02T08:07:57.244409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 176 sessionId: src_id|d370be17-295cf20d-71909400-7d3b00fe_0 is DEAD
2025-10-02T08:07:57.244426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533150941735539:3491]
2025-10-02T08:07:57.244897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d370be17-295cf20d-71909400-7d3b00fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:57.244911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d370be17-295cf20d-71909400-7d3b00fe_0] Write session will restart in 0.005961s
2025-10-02T08:07:57.244937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d370be17-295cf20d-71909400-7d3b00fe_0] Write session: Do CDS request
2025-10-02T08:07:57.244948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d370be17-295cf20d-71909400-7d3b00fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:57.245523Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:57.253254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d370be17-295cf20d-71909400-7d3b00fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:57.255389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:57.255412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 177
2025-10-02T08:07:57.255566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:57.255593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:57.255598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:57.255604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:57.256127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 177 sessionId:  describe result for acl check
2025-10-02T08:07:57.256157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:57.256159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:57.256160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:57.256166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533150941735610:4148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:57.256752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533150941735610:4148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:57.266207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533150941735610:4148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:57.272396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533150941735610:4148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:57.272416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533150941735610:4148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:57.272420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533150941735610:4148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:57.272449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:57.290852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:57.292477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:57.292676Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:57.292687Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:57.292700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:57.292755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:57.292793Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533150941736126:4147]
2025-10-02T08:07:57.293404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:57.296609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:57.296673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:57.297015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:57.297057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.297062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.297062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.297063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.297064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.297068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.297076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.297079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.297082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.297084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.297089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.297099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.297104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.297112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.297114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.297117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.297120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.297123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.297127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.297130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.297145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:57.310241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:57.312709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:57.312719Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:57.312722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:57.312727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:57.312734Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 176 [1:7556533150941736126:4147]
2025-10-02T08:07:57.312750Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:57.312771Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:57.312775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.312777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.312779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.312793Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:57.313124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:57.313136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:57.313232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.313246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.313250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:57.313253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:57.313346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:57.313349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.313367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.313379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:57.313401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533150941736120:4147]
2025-10-02T08:07:57.313403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533150941736120:4147]
2025-10-02T08:07:57.313417Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:57.313434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:57.313449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:57.313453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:57.313498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533150941736120:4147]
2025-10-02T08:07:57.313500Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:57.313680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:57.313687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:57.313694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:57.314325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 176
2025-10-02T08:07:57.314368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 176
2025-10-02T08:07:57.314387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941735950:4148], now have 1 active actors on pipe
2025-10-02T08:07:57.314392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533151402150338:2378], now have 1 active actors on pipe
2025-10-02T08:07:57.314521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.314529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.314567Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5eea647-5c472005-40238108-56f52260_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:57.314579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.314583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.314585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:57.314599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.314613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:57.314630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:57.314757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.314763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.314777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:57.314812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 177 partition: 0 MaxSeqNo: 17 sessionId: src_id|d5eea647-5c472005-40238108-56f52260_0
2025-10-02T08:07:57.316997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d370be17-295cf20d-71909400-7d3b00fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d5eea647-5c472005-40238108-56f52260_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:57.320444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eea647-5c472005-40238108-56f52260_0] Write session: try to update token
2025-10-02T08:07:57.320466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eea647-5c472005-40238108-56f52260_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:57.345376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533150941736153:3491]
2025-10-02T08:07:57.346709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId: src_id|d5eea647-5c472005-40238108-56f52260_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:57.347941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941736153:3491], now have 1 active actors on pipe
2025-10-02T08:07:57.349876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:57.349952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 176, pipe: [1:7556533150941736153:3491]
2025-10-02T08:07:57.350029Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:57.350047Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:57.350050Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:57.350059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533150941736120:4147]
2025-10-02T08:07:57.350064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533150941736120:4147]
2025-10-02T08:07:57.350104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:57.350118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.350120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:57.350283Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:57.351958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:57.351976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:57.510037Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:57.510552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.510562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.511407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533150941736153:3491]
2025-10-02T08:07:57.511431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:57.511434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:57.511493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 177 reason: error at write: Disconnected sessionId: src_id|d5eea647-5c472005-40238108-56f52260_0
2025-10-02T08:07:57.511702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 177 sessionId: src_id|d5eea647-5c472005-40238108-56f52260_0 is DEAD
2025-10-02T08:07:57.512014Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:57.513014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eea647-5c472005-40238108-56f52260_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:57.513034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eea647-5c472005-40238108-56f52260_0] Write session will restart in 0.006757s
2025-10-02T08:07:57.513062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eea647-5c472005-40238108-56f52260_0] Write session: Do CDS request
2025-10-02T08:07:57.513069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eea647-5c472005-40238108-56f52260_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:57.511239Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:57.525277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eea647-5c472005-40238108-56f52260_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:57.525623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:57.525642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 178
2025-10-02T08:07:57.525789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:57.525819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:57.525825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:57.525828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:57.527733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 178 sessionId:  describe result for acl check
2025-10-02T08:07:57.527774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:57.527776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:57.527778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:57.527784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533150941736197:4157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:57.528317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533150941736197:4157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:57.541396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533150941736197:4157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:57.550101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533150941736197:4157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:57.550121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533150941736197:4157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:57.550124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533150941736197:4157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:57.550133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:57.571194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:57.572649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:57.572872Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:57.572875Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:57.572886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:57.572946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:57.572986Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533150941736710:4156]
2025-10-02T08:07:57.573690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:57.574078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:57.574123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:57.574443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:57.574495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.574509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.574511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.574512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.574513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.574519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.574529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.574533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.574537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.574540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.574546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.574555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.574561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.574566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.574571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.574577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.574581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.574587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.574592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.574597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.574619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:57.587707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:57.589436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:57.589441Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:57.589444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:57.589453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:57.589463Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 177 [1:7556533150941736710:4156]
2025-10-02T08:07:57.589474Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:57.589499Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:57.589501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.589504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.589505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.589524Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:57.589527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:57.589534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:57.589589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.589591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.589593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:57.589595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:57.589651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:57.589653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.589664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.589671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:57.589682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533150941736704:4156]
2025-10-02T08:07:57.589684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533150941736704:4156]
2025-10-02T08:07:57.589693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:57.589702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:57.589711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:57.589713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:57.589744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533150941736704:4156]
2025-10-02T08:07:57.589745Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:57.590055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:57.590061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:57.590065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:57.590388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 177
2025-10-02T08:07:57.590400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941736445:4157], now have 1 active actors on pipe
2025-10-02T08:07:57.590709Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 177
2025-10-02T08:07:57.590402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533151402150356:2378], now have 1 active actors on pipe
2025-10-02T08:07:57.590406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.590409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.590430Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:57.590436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.590439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.590441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:57.590450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.590458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:57.590472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:57.590894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.590897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.590912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:57.590938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 178 partition: 0 MaxSeqNo: 17 sessionId: src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0
2025-10-02T08:07:57.591293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eea647-5c472005-40238108-56f52260_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:57.594770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0] Write session: try to update token
2025-10-02T08:07:57.594791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:57.608420Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:57.608452Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:57.608455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:57.608464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533150941736704:4156]
2025-10-02T08:07:57.608468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533150941736704:4156]
2025-10-02T08:07:57.608512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:57.608517Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:57.608519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.608521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:57.608522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:57.608669Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:57.611659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533150941736735:3491]
2025-10-02T08:07:57.611789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 177, pipe: [1:7556533150941736735:3491]
2025-10-02T08:07:57.614045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId: src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:57.617076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:57.749562Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:57.750429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941736735:3491], now have 1 active actors on pipe
2025-10-02T08:07:57.750447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.750456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.750603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533150941736735:3491]
2025-10-02T08:07:57.750631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:57.750638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:57.750700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 178 reason: error at write: Disconnected sessionId: src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0
2025-10-02T08:07:57.750702Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:57.750888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 178 sessionId: src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0 is DEAD
2025-10-02T08:07:57.750725Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:57.751240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:57.751253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0] Write session will restart in 0.007207s
2025-10-02T08:07:57.751287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0] Write session: Do CDS request
2025-10-02T08:07:57.751296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:57.759379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:57.759609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:57.759630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 179
2025-10-02T08:07:57.759823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:57.759876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:57.759882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:57.759893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:57.760563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 179 sessionId:  describe result for acl check
2025-10-02T08:07:57.760603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:57.760606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:57.760608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:57.760614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533150941737039:4164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:57.761266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533150941737039:4164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:57.764374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533150941737039:4164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:57.769431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533150941737039:4164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:57.769456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533150941737039:4164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:57.769461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533150941737039:4164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:57.769473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:57.770509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:57.771747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:57.771941Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:57.771954Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:57.771964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:57.772012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:57.772069Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533150941737290:4163]
2025-10-02T08:07:57.772782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:57.773012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:57.773060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:57.773377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:57.773424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.773432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.773434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.773435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.773436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.773441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.773452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.773457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.773461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.773465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.773471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.773479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:57.773486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.773491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:57.773497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.773503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:57.773508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.773514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.773519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.773525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.773549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:57.782151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:57.784026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:57.784056Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:57.784060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:57.784064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:57.784071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 178 [1:7556533150941737290:4163]
2025-10-02T08:07:57.784087Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:57.784106Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:57.784124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.784128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.784130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.784148Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:57.784154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:57.784169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:57.784241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.784251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.784255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:57.784258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:57.784396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:57.784406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.784405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 178
2025-10-02T08:07:57.784423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:57.784442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:57.784469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941737269:4164], now have 1 active actors on pipe
2025-10-02T08:07:57.784485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533151402150363:2378], now have 1 active actors on pipe
2025-10-02T08:07:57.784491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.784495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.784515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533150941737284:4163]
2025-10-02T08:07:57.784518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533150941737284:4163]
2025-10-02T08:07:57.784526Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:57.784511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 178
2025-10-02T08:07:57.784540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:57.784561Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:57.784562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:57.784564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:57.784566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:57.784583Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:57.784590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.784594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.784597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:57.784606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.784616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:57.784664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533150941737284:4163]
2025-10-02T08:07:57.784687Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:57.784702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:57.784709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:57.785805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.785825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.785854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:57.785902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 179 partition: 0 MaxSeqNo: 17 sessionId: src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0
2025-10-02T08:07:57.786311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3336f4b4-453a005d-84ef2a06-78960ca2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:57.789594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0] Write session: try to update token
2025-10-02T08:07:57.789619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:57.801535Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:57.801562Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:57.801572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533150941737284:4163]
2025-10-02T08:07:57.801632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:57.801650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:57.801833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:57.802001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:57.802164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:57.802314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:57.802520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:57.802564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:57.806124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId: src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:57.809182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:57.809282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.809299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.809343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:57.809373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:57.809430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:57.809460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:57.809657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.809747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.809831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.809913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.810406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.810424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.810510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.810576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.810642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.810713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.810768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.810775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.810853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.810918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.810986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.811055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.811107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.811114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.811185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.811254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.811333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.811398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.811446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.811454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.811522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.811589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.811657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.811723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.811793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.811800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.811885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.811957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.812027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.812099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.812161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.812170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.812243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.812314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.812379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.812443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.812488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.812495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.812570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.812633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.812699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.812766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.812832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.812839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.812911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.812974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.813040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.813106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.813151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.813157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.813231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:57.813304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:57.813368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:57.813436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:57.813482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:57.813489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:57.813564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:57.813633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:57.813656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:57.813664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:57.813702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:57.813723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:57.813730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:57.813734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:57.813737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:57.814146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:57.814182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:57.814189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:57.814193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:57.814198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:57.814201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:57.814741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:57.814765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:57.814771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:57.814780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:57.814782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:57.814784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:57.815421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:57.815443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:57.815448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:57.815450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:57.815452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:57.816912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:57.816931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:57.816944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392477816
2025-10-02T08:07:57.817157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:57.817172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:57.817178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:57.817181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:57.817185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:57.817193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:57.817720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:57.817747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:57.817754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:57.817758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:57.817764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:57.817768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:57.818245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:57.818273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:57.818286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:57.818292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:57.818298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:57.818306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:57.818830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:57.818853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:57.818860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:57.820140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:57.820188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:57.820200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:57.820209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:57.820219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392477820
2025-10-02T08:07:57.820528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:57.820550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:57.820557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:57.820566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:57.820569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:57.820573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:57.821121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:57.821144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:57.821151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:57.821155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:57.821159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:57.821163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:57.821709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:57.821733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:57.821834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392477821
2025-10-02T08:07:57.824586Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:57.824619Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:57.824627Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:57.824635Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:57.824648Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:57.824654Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:57.824662Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:57.824670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533150941737284:4163]
2025-10-02T08:07:57.824674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533150941737284:4163]
2025-10-02T08:07:57.824728Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:57.824742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:57.824753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:57.824759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:57.824764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:57.830303Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:57.851020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533150941737322:3491]
2025-10-02T08:07:57.851169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 178, pipe: [1:7556533150941737322:3491]
2025-10-02T08:07:57.974597Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:57.975684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941737322:3491], now have 1 active actors on pipe
2025-10-02T08:07:57.975886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533150941737322:3491]
2025-10-02T08:07:57.975935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:57.975937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:57.975974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 179 reason: error at write: Disconnected sessionId: src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0
2025-10-02T08:07:57.976156Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:57.976092Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:57.976217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 179 sessionId: src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0 is DEAD
2025-10-02T08:07:57.976524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:57.976536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0] Write session will restart in 0.006891s
2025-10-02T08:07:57.976580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0] Write session: Do CDS request
2025-10-02T08:07:57.976590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:57.980936Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0f16c0d808781e28] Result# TEvPutResult {Id# [72075186224037892:178:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:57.980946Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:178:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:57.981016Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:178:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:57.984880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:57.989214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:57.989232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 180
2025-10-02T08:07:57.990159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:57.990222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:57.990237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:57.990243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:57.990662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 180 sessionId:  describe result for acl check
2025-10-02T08:07:57.990704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:57.990711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:57.990712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:57.990719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533150941737592:4170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:57.991255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533150941737592:4170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:57.993639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533150941737592:4170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:57.997494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533150941737592:4170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:57.997510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533150941737592:4170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:57.997514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533150941737592:4170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:57.997523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:57.999406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:58.000317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:58.000539Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:58.000547Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:58.000554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:58.000603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:58.000633Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533155236705176:4169]
2025-10-02T08:07:58.001140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:58.001346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:58.001391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:58.001723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:58.001774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.001780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.001781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.001782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.001783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.001787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.001798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.001802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.001805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.001809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.001815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.001821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.001827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.001832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.001836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.001841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.001846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.001850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.001855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.001859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.001877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:58.016487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:58.020988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:58.021007Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:58.021010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:58.021014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:58.021021Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 179 [1:7556533155236705176:4169]
2025-10-02T08:07:58.021032Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:58.021051Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:58.021054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.021056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.021058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.021072Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:58.021076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:58.021081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:58.021152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.021158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.021161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:58.021163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:58.021239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:58.021245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.021255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.021261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:58.021278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533150941737874:4169]
2025-10-02T08:07:58.021283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533150941737874:4169]
2025-10-02T08:07:58.021289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:58.021298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:58.021304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:58.021307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:58.021307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 179
2025-10-02T08:07:58.021312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:58.021314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:58.021323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533150941737843:4170], now have 1 active actors on pipe
2025-10-02T08:07:58.021326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533151402150374:2378], now have 1 active actors on pipe
2025-10-02T08:07:58.021352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533150941737874:4169]
2025-10-02T08:07:58.021364Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:58.021370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.021371Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:58.021373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.021407Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:58.021413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.021417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.021419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:58.021429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.021437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:58.021456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.021558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.021568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.021583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.021619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 180 partition: 0 MaxSeqNo: 17 sessionId: src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0
2025-10-02T08:07:58.021402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 179
2025-10-02T08:07:58.022113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2504d34f-967a38f9-ee159aa1-e0dfcb19_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:58.030537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0] Write session: try to update token
2025-10-02T08:07:58.030566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:58.038878Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:58.038905Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:58.038908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:58.038920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533150941737874:4169]
2025-10-02T08:07:58.038926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533150941737874:4169]
2025-10-02T08:07:58.038988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:58.038996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.038999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:58.039016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:58.039025Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:58.039499Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:58.077883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533155236705201:3491]
2025-10-02T08:07:58.077945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId: src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:58.081292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:58.081535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 179, pipe: [1:7556533155236705201:3491]
2025-10-02T08:07:58.195301Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:58.196062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.196072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.196094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236705201:3491], now have 1 active actors on pipe
2025-10-02T08:07:58.197001Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:58.196453Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:58.196870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:58.196941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 180 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0
2025-10-02T08:07:58.197160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 180 sessionId: src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0 is DEAD
2025-10-02T08:07:58.197319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:07:58.197340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0] Write session will restart in 0.006736s
2025-10-02T08:07:58.197364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0] Write session: Do CDS request
2025-10-02T08:07:58.197370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:58.197341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533155236705201:3491]
2025-10-02T08:07:58.205408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:58.205472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:58.205491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 181
2025-10-02T08:07:58.205698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:58.205729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:58.205735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:58.205738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:58.206199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 181 sessionId:  describe result for acl check
2025-10-02T08:07:58.206230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:58.206232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:58.206233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:58.206239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533155236705503:4187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:58.206791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533155236705503:4187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:58.209821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533155236705503:4187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:58.213422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533155236705503:4187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:58.213446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533155236705503:4187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:58.213450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533155236705503:4187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:58.213459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:58.219328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:58.220673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:58.220914Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:58.220927Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:58.220940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:58.220997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:58.221045Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533155236705801:4186]
2025-10-02T08:07:58.221854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:58.222289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:58.222342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:58.222688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:58.222737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.222750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.222751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.222753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.222754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.222759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.222770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.222774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.222778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.222782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.222789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.222798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.222806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.222811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.222816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.222822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.222826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.222831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.222836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.222842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.222863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:58.234730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:58.236582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:58.236603Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:58.236605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:58.236609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:58.236615Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 180 [1:7556533155236705801:4186]
2025-10-02T08:07:58.236626Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:58.236644Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:58.236647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.236651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.236653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.236670Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:58.236676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:58.236683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:58.236754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.236764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.236767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:58.236770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:58.236902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:58.236916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.236928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.236938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:58.236956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533155697117689:2378], now have 1 active actors on pipe
2025-10-02T08:07:58.236960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236705703:4187], now have 1 active actors on pipe
2025-10-02T08:07:58.236966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533155236705795:4186]
2025-10-02T08:07:58.236968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533155236705795:4186]
2025-10-02T08:07:58.236975Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:58.236979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 180
2025-10-02T08:07:58.236990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:58.237002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:58.237002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:58.237005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:58.237007Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:58.237013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.237016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.237060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533155236705795:4186]
2025-10-02T08:07:58.237074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:58.237088Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:58.237095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.237099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.237101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:58.237109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.237110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:58.237125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:58.237171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.239270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.239287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.239317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.239369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 181 partition: 0 MaxSeqNo: 17 sessionId: src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0
2025-10-02T08:07:58.239810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6676929f-e6f6e299-11e7ab0e-4fa35add_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:58.239950Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 180
2025-10-02T08:07:58.242434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0] Write session: try to update token
2025-10-02T08:07:58.242454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:58.256362Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:58.256387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:58.256390Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:58.256398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533155236705795:4186]
2025-10-02T08:07:58.256403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533155236705795:4186]
2025-10-02T08:07:58.256451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:58.256457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.256459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:58.256471Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:58.256480Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:58.256617Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:58.266141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId: src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:58.269525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:58.298204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533155236705825:3491]
2025-10-02T08:07:58.298597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 180, pipe: [1:7556533155236705825:3491]
2025-10-02T08:07:58.407001Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:58.407716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.407724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.407745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236705825:3491], now have 1 active actors on pipe
2025-10-02T08:07:58.407888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533155236705825:3491]
2025-10-02T08:07:58.407912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:58.407915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:58.407931Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:58.407980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 181 reason: error at write: Disconnected sessionId: src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0
2025-10-02T08:07:58.408182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 181 sessionId: src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0 is DEAD
2025-10-02T08:07:58.408631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:58.408642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0] Write session will restart in 0.009788s
2025-10-02T08:07:58.408730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0] Write session: Do CDS request
2025-10-02T08:07:58.408767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:58.408894Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:58.421377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:58.421897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:58.421922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 182
2025-10-02T08:07:58.422219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:58.422256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:58.422262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:58.422266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:58.422772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 182 sessionId:  describe result for acl check
2025-10-02T08:07:58.422801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:58.422802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:58.422804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:58.422808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533155236706127:4196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:58.423285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533155236706127:4196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:58.426279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533155236706127:4196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:58.434260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533155236706127:4196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:58.434288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533155236706127:4196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:58.434292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533155236706127:4196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:58.434302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:58.463544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:58.464843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:58.465040Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:58.465048Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:58.465057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:58.465099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:58.465196Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533155236706398:4195]
2025-10-02T08:07:58.465963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:58.466222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:58.466267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:58.466613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:58.466663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.466669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.466671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.466672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.466673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.466678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.466688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.466693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.466696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.466700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.466706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.466718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.466724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.466733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.466738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.466747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.466752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.466759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.466769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.466775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.466796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:58.476366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:58.478851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:58.478867Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:58.478871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:58.478874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:58.478880Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 181 [1:7556533155236706398:4195]
2025-10-02T08:07:58.478892Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:58.478910Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:58.478913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.478916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.478918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.478935Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:58.478940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:58.478946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:58.479011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.479013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.479017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:58.479019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:58.479094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:58.479096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.479112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.479124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:58.479142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533155236706392:4195]
2025-10-02T08:07:58.479144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533155236706392:4195]
2025-10-02T08:07:58.479151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:58.479164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:58.479170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236706208:4196], now have 1 active actors on pipe
2025-10-02T08:07:58.479175Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:58.479178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:58.479191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:58.479200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:58.479205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533155697117719:2378], now have 1 active actors on pipe
2025-10-02T08:07:58.479237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533155236706392:4195]
2025-10-02T08:07:58.479245Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:58.479287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 181
2025-10-02T08:07:58.479297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.479300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.479303Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:58.479326Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:58.479333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.479336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.479338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:58.479349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.479359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:58.479375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.479449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.479461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.479488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.479530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 182 partition: 0 MaxSeqNo: 17 sessionId: src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0
2025-10-02T08:07:58.479926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a1d3fd-dd03728d-b69b71bc-e1c64f82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:58.482548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0] Write session: try to update token
2025-10-02T08:07:58.482572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:58.479451Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 181
2025-10-02T08:07:58.501671Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:58.501694Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:58.501696Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:58.501705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533155236706392:4195]
2025-10-02T08:07:58.501710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533155236706392:4195]
2025-10-02T08:07:58.501754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:58.501758Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:58.501762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.501764Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:58.501765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:58.501969Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:58.502566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId: src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:58.505583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:58.507905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533155236706424:3491]
2025-10-02T08:07:58.508013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 181, pipe: [1:7556533155236706424:3491]
2025-10-02T08:07:58.643473Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:58.643912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.643930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.643949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236706424:3491], now have 1 active actors on pipe
2025-10-02T08:07:58.644101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:58.644123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:58.644181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 182 reason: error at write: Disconnected sessionId: src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0
2025-10-02T08:07:58.644213Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:58.644230Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:58.644349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 182 sessionId: src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0 is DEAD
2025-10-02T08:07:58.644516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:58.644540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0] Write session will restart in 0.006611s
2025-10-02T08:07:58.644567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0] Write session: Do CDS request
2025-10-02T08:07:58.644575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:58.644567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533155236706424:3491]
2025-10-02T08:07:58.652429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:58.652463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:58.652482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 183
2025-10-02T08:07:58.652653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:58.652681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:58.652685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:58.652688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:58.653353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 183 sessionId:  describe result for acl check
2025-10-02T08:07:58.653411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:58.653419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:58.653420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:58.653426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533155236706693:4202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:58.653999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533155236706693:4202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:58.657243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533155236706693:4202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:58.660865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533155236706693:4202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:58.660882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533155236706693:4202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:58.660885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533155236706693:4202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:58.660892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:58.663139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:58.664140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:58.664292Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:58.664300Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:58.664307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:58.664339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:58.664388Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533155236706985:4201]
2025-10-02T08:07:58.664943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:58.665196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:58.665267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:58.665574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:58.665621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.665629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.665630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.665631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.665632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.665636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.665646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.665649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.665652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.665655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.665661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.665668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.665673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.665683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.665687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.665691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.665695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.665699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.665703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.665707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.665724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:58.674431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:58.676256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:58.676275Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:58.676277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:58.676280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:58.676285Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 182 [1:7556533155236706985:4201]
2025-10-02T08:07:58.676294Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:58.676309Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:58.676311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.676314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.676316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.676330Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:58.676336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:58.676343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:58.676422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.676430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.676433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:58.676436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:58.676542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:58.676550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.676563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.676580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:58.676600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236706944:4202], now have 1 active actors on pipe
2025-10-02T08:07:58.676611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533155236706979:4201]
2025-10-02T08:07:58.676611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 182
2025-10-02T08:07:58.676613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533155236706979:4201]
2025-10-02T08:07:58.676619Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:58.676627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533155697117727:2378], now have 1 active actors on pipe
2025-10-02T08:07:58.676634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:58.676637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:58.676637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:58.676651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:58.676654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:58.676667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.676671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.676712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533155236706979:4201]
2025-10-02T08:07:58.676721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:58.676702Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 182
2025-10-02T08:07:58.676735Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d391d09d-18a5437b-3916297c-17861164_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:58.676744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.676745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:58.676748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.676750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:58.676758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.676765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:58.676832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.676909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.676916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.676929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.676967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 183 partition: 0 MaxSeqNo: 17 sessionId: src_id|d391d09d-18a5437b-3916297c-17861164_0
2025-10-02T08:07:58.677359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b62515e9-d11c5780-1148717f-b8bab1bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d391d09d-18a5437b-3916297c-17861164_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:58.679689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d391d09d-18a5437b-3916297c-17861164_0] Write session: try to update token
2025-10-02T08:07:58.679706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d391d09d-18a5437b-3916297c-17861164_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:58.695635Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:58.695654Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:58.695656Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:58.695665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533155236706979:4201]
2025-10-02T08:07:58.695670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533155236706979:4201]
2025-10-02T08:07:58.695706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:58.695710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:58.695712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:58.695719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.695721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:58.695866Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:58.697471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId: src_id|d391d09d-18a5437b-3916297c-17861164_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:58.700306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:58.744902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533155236707012:3491]
2025-10-02T08:07:58.745058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 182, pipe: [1:7556533155236707012:3491]
2025-10-02T08:07:58.832895Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:58.833340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.833351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.833383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236707012:3491], now have 1 active actors on pipe
2025-10-02T08:07:58.833520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:58.833533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:58.833547Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:58.833603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 183 reason: error at write: Disconnected sessionId: src_id|d391d09d-18a5437b-3916297c-17861164_0
2025-10-02T08:07:58.833792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533155236707012:3491]
2025-10-02T08:07:58.833809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 183 sessionId: src_id|d391d09d-18a5437b-3916297c-17861164_0 is DEAD
2025-10-02T08:07:58.833949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d391d09d-18a5437b-3916297c-17861164_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:58.833961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d391d09d-18a5437b-3916297c-17861164_0] Write session will restart in 0.008286s
2025-10-02T08:07:58.833985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d391d09d-18a5437b-3916297c-17861164_0] Write session: Do CDS request
2025-10-02T08:07:58.833994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d391d09d-18a5437b-3916297c-17861164_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:58.836891Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:58.843516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d391d09d-18a5437b-3916297c-17861164_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:58.843717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:58.843735Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 184
2025-10-02T08:07:58.843885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:58.843918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:58.843928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:58.843931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:58.844359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 184 sessionId:  describe result for acl check
2025-10-02T08:07:58.844393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:58.844399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:58.844401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:58.844406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533155236707397:4209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:58.844927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533155236707397:4209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:58.848052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533155236707397:4209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:58.850764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:58.851334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533155236707397:4209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:58.851350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533155236707397:4209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:58.851353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533155236707397:4209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:58.851362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:58.851933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:58.852239Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:58.852252Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:58.852264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:58.852326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:58.852370Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533155236707575:4208]
2025-10-02T08:07:58.853005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:58.853237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:58.853286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:58.853622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:58.853678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.853685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.853686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.853687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.853688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.853694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.853704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.853708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.853711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.853714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.853720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.853733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:58.853744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.853749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:58.853753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.853757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:58.853766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.853771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.853775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.853779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.853802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:58.867005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:58.868718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:58.868740Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:58.868743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:58.868748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:58.868756Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 183 [1:7556533155236707575:4208]
2025-10-02T08:07:58.868770Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:58.868790Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:58.868794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.868797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.868814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.868834Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:58.868840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:58.868846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:58.868921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.868932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.868935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:58.868937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:58.869009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:58.869017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.869031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:58.869042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:58.869068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236707571:4209], now have 1 active actors on pipe
2025-10-02T08:07:58.869068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 183
2025-10-02T08:07:58.869079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533155236707563:4208]
2025-10-02T08:07:58.869082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533155236707563:4208]
2025-10-02T08:07:58.869090Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:58.869100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:58.869105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:58.869108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:58.869121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:58.869142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:58.869152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533155697117736:2378], now have 1 active actors on pipe
2025-10-02T08:07:58.869157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.869166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.869204Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 183
2025-10-02T08:07:58.869456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533155236707563:4208]
2025-10-02T08:07:58.869475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:58.869490Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:58.869496Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fde14671-cfa0796e-8ab26301-bea705c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:58.869503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:58.869507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:58.869509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:58.869517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:58.869530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:58.869586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.869660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:58.869667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:58.869681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:58.869718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 184 partition: 0 MaxSeqNo: 17 sessionId: src_id|fde14671-cfa0796e-8ab26301-bea705c3_0
2025-10-02T08:07:58.870169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d391d09d-18a5437b-3916297c-17861164_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fde14671-cfa0796e-8ab26301-bea705c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:58.872790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde14671-cfa0796e-8ab26301-bea705c3_0] Write session: try to update token
2025-10-02T08:07:58.872852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde14671-cfa0796e-8ab26301-bea705c3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:58.893973Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:58.893997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:58.894007Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:58.894024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533155236707563:4208]
2025-10-02T08:07:58.894037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533155236707563:4208]
2025-10-02T08:07:58.894104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:58.894117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:58.894124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:58.894130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:58.894139Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:58.894314Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:58.894820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId: src_id|fde14671-cfa0796e-8ab26301-bea705c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:58.897944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:58.933911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533155236707599:3491]
2025-10-02T08:07:58.934065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 183, pipe: [1:7556533155236707599:3491]
2025-10-02T08:07:59.045055Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:59.046310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.046343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.046389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533155236707599:3491], now have 1 active actors on pipe
2025-10-02T08:07:59.046590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:59.046609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:59.046692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 184 reason: error at write: Disconnected sessionId: src_id|fde14671-cfa0796e-8ab26301-bea705c3_0
2025-10-02T08:07:59.046893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:59.046925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 184 sessionId: src_id|fde14671-cfa0796e-8ab26301-bea705c3_0 is DEAD
2025-10-02T08:07:59.047244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde14671-cfa0796e-8ab26301-bea705c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:59.047236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533155236707599:3491]
2025-10-02T08:07:59.047237Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:59.047258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde14671-cfa0796e-8ab26301-bea705c3_0] Write session will restart in 0.007617s
2025-10-02T08:07:59.047310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde14671-cfa0796e-8ab26301-bea705c3_0] Write session: Do CDS request
2025-10-02T08:07:59.047317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde14671-cfa0796e-8ab26301-bea705c3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:59.056421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde14671-cfa0796e-8ab26301-bea705c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.056519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:59.056538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 185
2025-10-02T08:07:59.056709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.056742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:59.056758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:59.056761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:59.057215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 185 sessionId:  describe result for acl check
2025-10-02T08:07:59.057247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:59.057255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:59.057257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:59.057261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533159531675232:4215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:59.057802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533159531675232:4215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:59.061212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533159531675232:4215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:59.064698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533159531675232:4215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:59.064717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533159531675232:4215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:59.064720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533159531675232:4215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:59.064729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:59.064969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:59.065897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:59.066136Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:59.066145Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:59.066155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:59.066199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:59.066234Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533159531675460:4214]
2025-10-02T08:07:59.066807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:59.066975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:59.067009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:59.067289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:59.067322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.067327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.067328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.067329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.067329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.067332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.067341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.067345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.067348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.067351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.067355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.067362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.067367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.067371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.067375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.067379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.067383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.067387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.067392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.067395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.067407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:59.077731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:59.081869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:59.081888Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:59.081892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:59.081896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:59.081903Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 184 [1:7556533159531675460:4214]
2025-10-02T08:07:59.081918Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:59.081940Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:59.081943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.081946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.081948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.081967Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:59.081980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:59.081988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:59.082062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.082079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.082083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:59.082085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:59.082159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:59.082169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.082184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.082202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:59.082226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531675451:4215], now have 1 active actors on pipe
2025-10-02T08:07:59.082228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 184
2025-10-02T08:07:59.082239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533159531675453:4214]
2025-10-02T08:07:59.082241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533159531675453:4214]
2025-10-02T08:07:59.082254Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:59.082264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533159992085037:2378], now have 1 active actors on pipe
2025-10-02T08:07:59.082268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:59.082272Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:59.082278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.082282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.082297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:59.082311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:59.082313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:59.082325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 184
2025-10-02T08:07:59.082350Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:59.082359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.082362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.082363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:59.082369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.082376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:59.082382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533159531675453:4214]
2025-10-02T08:07:59.082389Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:59.082405Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:59.082413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.082444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.082450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.082460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.082488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 185 partition: 0 MaxSeqNo: 17 sessionId: src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0
2025-10-02T08:07:59.082926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde14671-cfa0796e-8ab26301-bea705c3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:59.087899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0] Write session: try to update token
2025-10-02T08:07:59.087921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:59.094639Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:59.094662Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:59.094673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533159531675453:4214]
2025-10-02T08:07:59.094721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:59.094727Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:59.094910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:59.095077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:59.095260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:59.095467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:59.095674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:59.095715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:59.106856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId: src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:59.109647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:59.109740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.109748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.109778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:59.109803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:59.109864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.109882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.110053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.110127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.110210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.110309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.111043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.111063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.111136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.111209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.111272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.111366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.111490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.111500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.111569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.111629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.111695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.111766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.111841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.111849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.111919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.111987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.112045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.112121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.112234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.112241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.112306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.112366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.112432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.112498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.112847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.112859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.112930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.112992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.113066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.113143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.113218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.113225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.113289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.113355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.113460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.113532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.113862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.113872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.113943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.114007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.114068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.114125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.114366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.114376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.114458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.114524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.114588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.114653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.114896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.114908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.114979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.115043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.115112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.115183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.115244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.115252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.115311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:59.115372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.115394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.115400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:59.115433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:59.115449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:59.115457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:59.115460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:59.115466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:59.115902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:59.115934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:59.115946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:59.115953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:59.115961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:59.115964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:59.117135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:59.117167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:59.117175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:59.117178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:59.117182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:59.117185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:59.117727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:59.117769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:59.117780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:59.117784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:59.117787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:59.119170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:59.119193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:59.119205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392479119
2025-10-02T08:07:59.119325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:59.119344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:59.119350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:59.119353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:59.119357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:59.119360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:59.119904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:59.119931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:59.119936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:59.119940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:59.119944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:59.119952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:59.120523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:59.120553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:59.120567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:59.120576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:59.120580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:59.120584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:59.121170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:59.121197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:59.121202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:59.122522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:59.122543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:59.122553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:59.122557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:59.122566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392479122
2025-10-02T08:07:59.122896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:59.122921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:59.122931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:59.122934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:59.122938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:59.122946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:59.123459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:59.123487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:59.123497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:59.123502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:59.123506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:59.123510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:59.124072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:59.124096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.124222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392479123
2025-10-02T08:07:59.126864Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:59.126904Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:59.126912Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:59.126921Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:59.126941Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:59.126949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:59.126951Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:59.126962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533159531675453:4214]
2025-10-02T08:07:59.126968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533159531675453:4214]
2025-10-02T08:07:59.127020Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:59.127035Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:59.127052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:59.127059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.127061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:59.127210Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:59.147488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533159531675485:3491]
2025-10-02T08:07:59.147611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 184, pipe: [1:7556533159531675485:3491]
2025-10-02T08:07:59.264872Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:59.265290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531675485:3491], now have 1 active actors on pipe
2025-10-02T08:07:59.265429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533159531675485:3491]
2025-10-02T08:07:59.265455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:59.265458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:59.265484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 185 reason: error at write: Disconnected sessionId: src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0
2025-10-02T08:07:59.265507Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:59.265600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:59.265705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 185 sessionId: src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0 is DEAD
2025-10-02T08:07:59.265837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:59.265864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0] Write session will restart in 0.006555s
2025-10-02T08:07:59.265890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0] Write session: Do CDS request
2025-10-02T08:07:59.265896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:59.269580Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [bc7d946c7b89ad47] Result# TEvPutResult {Id# [72075186224037892:184:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:07:59.269587Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:184:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:59.269643Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:184:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:07:59.273412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.273556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:59.273574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 186
2025-10-02T08:07:59.273755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.273797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:59.273806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:59.273810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:59.274430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 186 sessionId:  describe result for acl check
2025-10-02T08:07:59.274467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:59.274473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:59.274475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:59.274481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533159531675799:4232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:59.274957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533159531675799:4232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:59.277197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533159531675799:4232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:59.280794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533159531675799:4232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:59.280824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533159531675799:4232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:59.280827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533159531675799:4232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:59.280835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:59.282609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:59.283586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:59.283769Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:59.283776Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:59.283785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:59.283886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:59.283920Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533159531676096:4231]
2025-10-02T08:07:59.284570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:59.284786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:59.284863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:59.285183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:59.285225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.285230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.285231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.285233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.285234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.285238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.285248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.285251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.285255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.285258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.285263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.285270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.285279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.285285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.285291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.285296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.285300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.285305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.285309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.285327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.285345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:59.294051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:59.295545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:59.295560Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:59.295563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:59.295566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:59.295573Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 185 [1:7556533159531676096:4231]
2025-10-02T08:07:59.295585Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:59.295600Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:59.295602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.295605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.295608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.295624Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:59.295629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:59.295635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:59.295694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.295700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.295702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:59.295703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:59.295831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 185
2025-10-02T08:07:59.295917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 185
2025-10-02T08:07:59.296074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:59.296084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.296097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.296121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:59.296145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531676064:4232], now have 1 active actors on pipe
2025-10-02T08:07:59.296148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533159992085055:2378], now have 1 active actors on pipe
2025-10-02T08:07:59.296152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.296156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.296177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533159531676090:4231]
2025-10-02T08:07:59.296184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533159531676090:4231]
2025-10-02T08:07:59.296194Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:59.296205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:59.296208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:59.296213Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:59.296220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:59.296223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:59.296235Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:59.296240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.296245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.296247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:59.296256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.296267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:59.296305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533159531676090:4231]
2025-10-02T08:07:59.296315Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:59.296320Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:59.296328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.296375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.296382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.296396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.296431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 186 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0
2025-10-02T08:07:59.296741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fac548b-e222ae9-a2f15aed-d618a0b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:59.299115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0] Write session: try to update token
2025-10-02T08:07:59.299137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:59.308866Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:07:59.308884Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:59.308892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533159531676090:4231]
2025-10-02T08:07:59.308926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:07:59.308931Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:07:59.309082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:07:59.309224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:59.309380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:59.309516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:07:59.309714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:07:59.309748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:07:59.313708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId: src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:59.316399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:59.316469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.316482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.316513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:07:59.316537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:07:59.316617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.316629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.316780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.316854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.316925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.316984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.317033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.317039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.317103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.317165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.317221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.317284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.317328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.317335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.317397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.317457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.317550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.317609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.317650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.317656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.317738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.317855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.317945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.318026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.318080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.318085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.318151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.318205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.318257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.318314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.318360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.318365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.318423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.318742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.318860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.318966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.319011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.319016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.319119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.319180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.319240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.319305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.319576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.319585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.319651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.319709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.319767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.319834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.320116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.320124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.320189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.320251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.320313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.320377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.320689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.320698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.320762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:07:59.320842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:07:59.320911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:07:59.320987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:07:59.321040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:07:59.321047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:07:59.321089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:07:59.321156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.321178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.321185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:07:59.321214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:07:59.321230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:07:59.321237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:07:59.321240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:07:59.321243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:07:59.321697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:07:59.321726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:07:59.321732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:07:59.321735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:07:59.321738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:07:59.321742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:07:59.322580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:07:59.322604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:07:59.322610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:07:59.322614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:07:59.322617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:07:59.322622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:07:59.323094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:07:59.323114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:07:59.323120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:07:59.323122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:07:59.323124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:07:59.324405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:07:59.324423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:07:59.324433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392479324
2025-10-02T08:07:59.324591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:07:59.324605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:07:59.324611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:07:59.324614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:07:59.324617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:07:59.324620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:07:59.325135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:07:59.325158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:07:59.325164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:07:59.325168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:07:59.325173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:07:59.325181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:07:59.325681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:07:59.325706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:07:59.325715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:07:59.325723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:07:59.325726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:07:59.325733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:07:59.326263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:07:59.326290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:07:59.326301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:07:59.327510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:07:59.327528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:07:59.327532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:07:59.327536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:07:59.327545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392479327
2025-10-02T08:07:59.327873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:07:59.327891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:07:59.327895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:07:59.327898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:07:59.327900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:07:59.327902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:07:59.328385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:07:59.328402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:07:59.328406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:07:59.328408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:07:59.328411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:07:59.328413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:07:59.328907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:07:59.328927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.329034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392479328
2025-10-02T08:07:59.329932Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:07:59.329953Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:07:59.329959Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:07:59.329966Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:07:59.331785Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:59.331800Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:59.331802Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:59.331811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533159531676090:4231]
2025-10-02T08:07:59.331815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533159531676090:4231]
2025-10-02T08:07:59.331859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:59.331872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:59.331873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:59.331877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.331879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:59.332025Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:59.365470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533159531676149:3491]
2025-10-02T08:07:59.365559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 185, pipe: [1:7556533159531676149:3491]
2025-10-02T08:07:59.472033Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:59.472453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531676149:3491], now have 1 active actors on pipe
2025-10-02T08:07:59.472623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533159531676149:3491]
2025-10-02T08:07:59.472639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:59.472641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:59.472665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 186 reason: error at write: Disconnected sessionId: src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0
2025-10-02T08:07:59.472693Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:59.473528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:59.473542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0] Write session will restart in 0.006343s
2025-10-02T08:07:59.473571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0] Write session: Do CDS request
2025-10-02T08:07:59.473579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:59.474324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 186 sessionId: src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0 is DEAD
2025-10-02T08:07:59.473217Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:59.481496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.484978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:59.485000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 187
2025-10-02T08:07:59.485274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.485353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:59.485366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:59.485371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:59.486181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 187 sessionId:  describe result for acl check
2025-10-02T08:07:59.486232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:59.486234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:59.486236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:59.486242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533159531676190:4243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:59.486903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533159531676190:4243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:59.492383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533159531676190:4243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:59.496395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533159531676190:4243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:59.496412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533159531676190:4243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:59.496416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533159531676190:4243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:59.496423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:59.509333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:59.510614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:59.510821Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:59.510831Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:59.510841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:59.510893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:59.510933Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533159531676722:4242]
2025-10-02T08:07:59.511588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:59.511772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:59.511804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:59.512163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:59.512217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.512224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.512225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.512226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.512227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.512231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.512241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.512245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.512249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.512253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.512258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.512265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.512270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.512276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.512280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.512285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.512290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.512295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.512304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.512309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.512331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:59.520989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:59.522972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:59.522996Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:59.522999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:59.523005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:59.523014Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 186 [1:7556533159531676722:4242]
2025-10-02T08:07:59.523026Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:59.523045Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:59.523047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.523050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.523052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.523070Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:59.523075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:59.523082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:59.523144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.523151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.523155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:59.523157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:59.523225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:59.523232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.523244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.523256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:59.523275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531676542:4243], now have 1 active actors on pipe
2025-10-02T08:07:59.523287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533159531676716:4242]
2025-10-02T08:07:59.523295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533159531676716:4242]
2025-10-02T08:07:59.523300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 186
2025-10-02T08:07:59.523305Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:59.523320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:59.523321Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:59.523325Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:59.523336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:59.523341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:59.523346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533159992085087:2378], now have 1 active actors on pipe
2025-10-02T08:07:59.523351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.523360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.523462Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 186
2025-10-02T08:07:59.523413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533159531676716:4242]
2025-10-02T08:07:59.523429Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:59.523447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:59.523449Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:59.523457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.523462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.523464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:59.523475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.523485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:59.523522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.523627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.523651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.523696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.523755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 187 partition: 0 MaxSeqNo: 17 sessionId: src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0
2025-10-02T08:07:59.524171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f8af0e0-fa0a2241-afd244e0-a4f48ed2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:59.526811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0] Write session: try to update token
2025-10-02T08:07:59.526837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:59.541905Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:59.541927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:59.541929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:59.541939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533159531676716:4242]
2025-10-02T08:07:59.541944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533159531676716:4242]
2025-10-02T08:07:59.541990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:59.541992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:59.541999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.542002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:59.542014Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:59.542165Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:59.550551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId: src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:59.553487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:59.572849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533159531676747:3491]
2025-10-02T08:07:59.573051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 186, pipe: [1:7556533159531676747:3491]
2025-10-02T08:07:59.684697Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:59.685353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.685366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.685384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531676747:3491], now have 1 active actors on pipe
2025-10-02T08:07:59.685528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:59.685561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:59.685638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 187 reason: error at write: Disconnected sessionId: src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0
2025-10-02T08:07:59.685739Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:59.685831Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:59.685905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 187 sessionId: src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0 is DEAD
2025-10-02T08:07:59.685980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533159531676747:3491]
2025-10-02T08:07:59.686066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:59.686075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0] Write session will restart in 0.009885s
2025-10-02T08:07:59.686103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0] Write session: Do CDS request
2025-10-02T08:07:59.686110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:59.697321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.697428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:59.697444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 188
2025-10-02T08:07:59.697606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.697663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:59.697676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:59.697681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:59.698130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 188 sessionId:  describe result for acl check
2025-10-02T08:07:59.698181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:59.698190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:59.698191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:59.698197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533159531677261:4249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:59.698789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533159531677261:4249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:59.699326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:59.700262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:59.700538Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:59.700550Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:59.700576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:59.700654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:59.700693Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533159531677302:4248]
2025-10-02T08:07:59.701178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:59.701333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:59.701371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:59.701472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533159531677261:4249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:59.701613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:59.701646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.701647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.701648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.701649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.701649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.701653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.701659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.701661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.701664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.701666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.701669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.701674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.701678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.701680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.701683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.701685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.701687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.701691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.701693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.701695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.701706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:59.708062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533159531677261:4249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:59.708079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533159531677261:4249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:59.708083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533159531677261:4249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:59.708095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:59.710320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:59.712167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:59.712182Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:59.712183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:59.712187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:59.712193Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 187 [1:7556533159531677302:4248]
2025-10-02T08:07:59.712206Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:59.712220Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:59.712223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.712225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.712227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.712241Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:59.712246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:59.712253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:59.712315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.712323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.712326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:59.712328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:59.712390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:59.712397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.712409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.712414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 187
2025-10-02T08:07:59.712425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:59.712443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531677329:4249], now have 1 active actors on pipe
2025-10-02T08:07:59.712452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.712456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.712468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533159992085094:2378], now have 1 active actors on pipe
2025-10-02T08:07:59.712477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533159531677283:4248]
2025-10-02T08:07:59.712479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533159531677283:4248]
2025-10-02T08:07:59.712490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:59.712499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:59.712502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:59.712506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:59.712518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:59.712524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:59.712539Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:59.712549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.712519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 187
2025-10-02T08:07:59.712553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.712560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:59.712568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.712578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:59.712611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533159531677283:4248]
2025-10-02T08:07:59.712627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:59.712638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:59.712646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.712776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.712785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.712823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.712864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 188 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0
2025-10-02T08:07:59.713386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221d9278-bf19bd23-d7faff0f-f3eb0fef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:59.715609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0] Write session: try to update token
2025-10-02T08:07:59.715621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:59.730527Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:59.730548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:59.730550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:59.730560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533159531677283:4248]
2025-10-02T08:07:59.730564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533159531677283:4248]
2025-10-02T08:07:59.730604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:59.730609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.730609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:59.730611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:59.730614Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:59.730783Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:59.731310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId: src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:59.734633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:59.786292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533159531677344:3491]
2025-10-02T08:07:59.786436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 187, pipe: [1:7556533159531677344:3491]
2025-10-02T08:07:59.872010Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:07:59.872369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.872389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.872442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531677344:3491], now have 1 active actors on pipe
2025-10-02T08:07:59.872562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533159531677344:3491]
2025-10-02T08:07:59.872584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:07:59.872587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:07:59.872641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 188 reason: error at write: Disconnected sessionId: src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0
2025-10-02T08:07:59.872665Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:07:59.872672Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:07:59.872836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 188 sessionId: src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0 is DEAD
2025-10-02T08:07:59.873012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:07:59.873027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0] Write session will restart in 0.008326s
2025-10-02T08:07:59.873067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0] Write session: Do CDS request
2025-10-02T08:07:59.873076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:07:59.882407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.882788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:07:59.882803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 189
2025-10-02T08:07:59.882975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:07:59.883005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:07:59.883013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:07:59.883016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:07:59.883450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 189 sessionId:  describe result for acl check
2025-10-02T08:07:59.883486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:07:59.883492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:07:59.883494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:07:59.883499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533159531677740:4256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:07:59.883995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533159531677740:4256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:07:59.887003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533159531677740:4256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:07:59.889224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:07:59.890561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:07:59.890769Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:07:59.890779Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:07:59.890790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:07:59.890822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533159531677740:4256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:07:59.890836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533159531677740:4256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:07:59.890839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533159531677740:4256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:07:59.890847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:07:59.890850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:07:59.890920Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533159531677911:4255]
2025-10-02T08:07:59.891515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:07:59.891707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:07:59.891751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:07:59.892094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:07:59.892172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.892179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.892181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.892181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.892182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.892187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.892197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.892200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.892203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.892206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.892212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.892218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:07:59.892222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.892227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:07:59.892231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.892235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:07:59.892239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.892243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.892247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.892252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.892269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:07:59.900939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:07:59.902949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:07:59.902970Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:07:59.902973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:07:59.902976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:07:59.902983Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 188 [1:7556533159531677911:4255]
2025-10-02T08:07:59.902996Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:07:59.903014Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:07:59.903017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.903020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.903022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.903039Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:07:59.903045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:07:59.903056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:07:59.903123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.903131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.903134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:07:59.903136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:07:59.903210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:07:59.903218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.903231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:07:59.903247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:07:59.903267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531677916:4256], now have 1 active actors on pipe
2025-10-02T08:07:59.903271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 188
2025-10-02T08:07:59.903277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533159992085102:2378], now have 1 active actors on pipe
2025-10-02T08:07:59.903283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533159531677905:4255]
2025-10-02T08:07:59.903286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533159531677905:4255]
2025-10-02T08:07:59.903298Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:07:59.903310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.903314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.903316Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:07:59.903320Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:07:59.903329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:07:59.903345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:07:59.903347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:07:59.903351Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 188
2025-10-02T08:07:59.903389Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|209d7198-c15b567d-5097a93d-1ac97764_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:07:59.903400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:07:59.903404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:07:59.903406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:07:59.903415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:07:59.903427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:07:59.903438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533159531677905:4255]
2025-10-02T08:07:59.903451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:07:59.903467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:07:59.903491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.903576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:07:59.903584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:07:59.903600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:07:59.903643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 189 partition: 0 MaxSeqNo: 17 sessionId: src_id|209d7198-c15b567d-5097a93d-1ac97764_0
2025-10-02T08:07:59.904121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6275a7-303b288b-4e9fd5a2-debfa5c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|209d7198-c15b567d-5097a93d-1ac97764_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:07:59.906976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209d7198-c15b567d-5097a93d-1ac97764_0] Write session: try to update token
2025-10-02T08:07:59.907002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209d7198-c15b567d-5097a93d-1ac97764_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:07:59.922761Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:07:59.922784Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:07:59.922786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:07:59.922796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533159531677905:4255]
2025-10-02T08:07:59.922801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533159531677905:4255]
2025-10-02T08:07:59.922849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:07:59.922855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:07:59.922856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:07:59.922858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:07:59.922862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:07:59.923067Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:07:59.926192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId: src_id|209d7198-c15b567d-5097a93d-1ac97764_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:07:59.928993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:07:59.972709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533159531677941:3491]
2025-10-02T08:07:59.972827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 188, pipe: [1:7556533159531677941:3491]
2025-10-02T08:08:00.071202Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:00.071527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.071542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.071581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533159531677941:3491], now have 1 active actors on pipe
2025-10-02T08:08:00.071696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533159531677941:3491]
2025-10-02T08:08:00.071717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:00.071723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:00.071774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 189 reason: error at write: Disconnected sessionId: src_id|209d7198-c15b567d-5097a93d-1ac97764_0
2025-10-02T08:08:00.071814Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:00.071826Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:00.071967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 189 sessionId: src_id|209d7198-c15b567d-5097a93d-1ac97764_0 is DEAD
2025-10-02T08:08:00.072108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209d7198-c15b567d-5097a93d-1ac97764_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:00.072117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209d7198-c15b567d-5097a93d-1ac97764_0] Write session will restart in 0.005470s
2025-10-02T08:08:00.072142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209d7198-c15b567d-5097a93d-1ac97764_0] Write session: Do CDS request
2025-10-02T08:08:00.072148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209d7198-c15b567d-5097a93d-1ac97764_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:00.078378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209d7198-c15b567d-5097a93d-1ac97764_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.078430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:00.078445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 190
2025-10-02T08:08:00.078586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.078623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:00.078631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:00.078635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:00.078965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 190 sessionId:  describe result for acl check
2025-10-02T08:08:00.078997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:00.079003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:00.079004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:00.079009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533163826645574:4262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:00.079399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533163826645574:4262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:00.085655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533163826645574:4262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:00.086408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:00.087432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:00.087703Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:00.087716Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:00.087729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:00.087789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:00.087826Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533163826645806:4261]
2025-10-02T08:08:00.088463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:00.088643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:00.088672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533163826645574:4262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:00.088684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533163826645574:4262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:00.088688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533163826645574:4262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:00.088689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:00.088701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:00.088993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:00.089049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.089057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.089058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.089059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.089060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.089065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.089073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.089077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.089080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.089083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.089089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.089095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.089101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.089106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.089110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.089115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.089119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.089124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.089128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.089133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.089155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:00.097564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:00.099807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:00.099833Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:00.099836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:00.099841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:00.099849Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 189 [1:7556533163826645806:4261]
2025-10-02T08:08:00.099863Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:00.099885Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:00.099889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.099893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.099895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.099911Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:00.099916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:00.099923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:00.099996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.100007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.100012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:00.100015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:00.100093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:00.100114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.100131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.100152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:00.100173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826645817:4262], now have 1 active actors on pipe
2025-10-02T08:08:00.100184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533164287052404:2378], now have 1 active actors on pipe
2025-10-02T08:08:00.100184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 189
2025-10-02T08:08:00.100192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533163826645796:4261]
2025-10-02T08:08:00.100194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533163826645796:4261]
2025-10-02T08:08:00.100209Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:00.100223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:00.100225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:00.100229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:00.100240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:00.100243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:00.100252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.100256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.100300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533163826645796:4261]
2025-10-02T08:08:00.100310Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:00.100313Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:00.100326Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:00.100339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.100344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.100351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:00.100361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.100331Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 189
2025-10-02T08:08:00.100374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:00.100427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.100509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.100519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.100534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.100576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 190 partition: 0 MaxSeqNo: 17 sessionId: src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0
2025-10-02T08:08:00.101059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209d7198-c15b567d-5097a93d-1ac97764_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:00.103941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0] Write session: try to update token
2025-10-02T08:08:00.103964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:00.111661Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:00.111679Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:00.111688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533163826645796:4261]
2025-10-02T08:08:00.111729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:00.111730Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:00.111923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:00.112127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:00.112338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:00.112496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:00.112695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:00.112739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:00.119923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId: src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:00.122802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:00.122866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.122879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.122911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:00.122935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:00.122970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.122988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.123163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.123244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.123310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.123376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.123612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.123623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.123733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.123842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.123907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.123975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.124021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.124030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.124113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.124174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.124237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.124328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.124395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.124404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.124490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.124551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.124612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.124678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.124747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.124755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.124835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.124896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.124957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.125024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.125071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.125079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.125148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.125214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.125287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.125359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.125420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.125431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.125494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.125556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.125623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.125686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.125736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.125743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.125808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.125872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.125978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.126043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.126173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.126181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.126246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.126307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.126369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.126437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.126485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.126497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.126560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:00.126624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:00.126692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:00.126759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:00.126807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:00.126814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:00.126876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:00.126938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.126962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.126971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:00.127001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:00.127016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:00.127024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:00.127028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:00.127036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:00.127433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:00.127458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:00.127469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:00.127477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:00.127480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:00.127484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:00.128138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:00.128159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:00.128170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:00.128178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:00.128182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:00.128186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:00.128866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:00.128890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:00.128901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:00.128909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:00.128916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:00.131165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:00.131184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:00.131200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392480130
2025-10-02T08:08:00.131320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:00.131334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:00.131340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:00.131348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:00.131353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:00.131356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:00.131876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:00.131899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:00.131904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:00.131913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:00.131917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:00.131920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:00.132413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:00.132435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:00.132445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:00.132454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:00.132458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:00.132462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:00.132954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:00.132975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:00.132986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:00.134166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:00.134191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:00.134199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:00.134205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:00.134215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392480133
2025-10-02T08:08:00.134545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:00.134570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:00.134581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:00.134585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:00.134588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:00.134591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:00.135103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:00.135130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:00.135136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:00.135139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:00.135142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:00.135146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:00.135667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:00.135695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.135799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392480135
2025-10-02T08:08:00.138596Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:00.138634Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:00.138641Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:00.138650Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:00.138664Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:00.138675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:00.138677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:00.138688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533163826645796:4261]
2025-10-02T08:08:00.138695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533163826645796:4261]
2025-10-02T08:08:00.138796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:00.138806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.138809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:00.138826Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:00.138842Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:00.138970Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:00.171879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533163826645850:3491]
2025-10-02T08:08:00.172027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 189, pipe: [1:7556533163826645850:3491]
2025-10-02T08:08:00.292881Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:00.293253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826645850:3491], now have 1 active actors on pipe
2025-10-02T08:08:00.293478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533163826645850:3491]
2025-10-02T08:08:00.293504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:00.293506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:00.293532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 190 reason: error at write: Disconnected sessionId: src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0
2025-10-02T08:08:00.293536Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:00.293748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 190 sessionId: src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0 is DEAD
2025-10-02T08:08:00.293991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:00.294006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0] Write session will restart in 0.006823s
2025-10-02T08:08:00.294036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0] Write session: Do CDS request
2025-10-02T08:08:00.294044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:00.294573Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:00.297477Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [77618b289eca59d3] Result# TEvPutResult {Id# [72075186224037892:189:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:00.297510Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:189:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:00.297594Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:189:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:00.302422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.302630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:00.302645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 191
2025-10-02T08:08:00.302801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.302829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:00.302838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:00.302840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:00.303311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 191 sessionId:  describe result for acl check
2025-10-02T08:08:00.303349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:00.303356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:00.303357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:00.303363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533163826646176:4279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:00.303894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533163826646176:4279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:00.306729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533163826646176:4279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:00.310526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533163826646176:4279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:00.310541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533163826646176:4279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:00.310544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533163826646176:4279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:00.310552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:00.311978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:00.313045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:00.313211Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:00.313219Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:00.313228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:00.313267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:00.313302Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533163826646461:4278]
2025-10-02T08:08:00.313969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:00.314186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:00.314230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:00.314558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:00.314595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.314601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.314602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.314602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.314603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.314608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.314617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.314621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.314624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.314640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.314644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.314650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.314656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.314661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.314665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.314670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.314674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.314678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.314687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.314692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.314709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:00.326513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:00.328024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:00.328044Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:00.328046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:00.328051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:00.328058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 190 [1:7556533163826646461:4278]
2025-10-02T08:08:00.328072Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:00.328091Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:00.328094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.328108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.328111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.328128Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:00.328139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:00.328146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:00.328219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.328225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.328229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:00.328232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:00.328344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 190
2025-10-02T08:08:00.328439Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 190
2025-10-02T08:08:00.328711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:00.328721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.328736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.328750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:00.328778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826646437:4279], now have 1 active actors on pipe
2025-10-02T08:08:00.328787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533164287052423:2378], now have 1 active actors on pipe
2025-10-02T08:08:00.328791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.328795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.328837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533163826646455:4278]
2025-10-02T08:08:00.328844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533163826646455:4278]
2025-10-02T08:08:00.328856Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:00.328871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:00.328873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:00.328881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:00.328887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:00.328890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:00.328906Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:00.328917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.328920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.328926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:00.328936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.328947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:00.328987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533163826646455:4278]
2025-10-02T08:08:00.328998Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:00.329011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.329014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:00.329088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.329096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.329109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.329144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 191 partition: 0 MaxSeqNo: 17 sessionId: src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0
2025-10-02T08:08:00.329539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c264f377-5b34bc5-f4bf400b-aba93e0c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:00.332022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0] Write session: try to update token
2025-10-02T08:08:00.332045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:00.346994Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:00.347014Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:00.347017Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:00.347025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533163826646455:4278]
2025-10-02T08:08:00.347030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533163826646455:4278]
2025-10-02T08:08:00.347069Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:00.347073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:00.347079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.347081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:00.347082Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:00.347249Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:00.349605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId: src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:00.352291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:00.393548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533163826646489:3491]
2025-10-02T08:08:00.393661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 190, pipe: [1:7556533163826646489:3491]
2025-10-02T08:08:00.485295Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:00.485809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.485825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.485867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826646489:3491], now have 1 active actors on pipe
2025-10-02T08:08:00.486044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:00.486058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:00.486083Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:00.486126Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:00.486239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 191 reason: error at write: Disconnected sessionId: src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0
2025-10-02T08:08:00.486402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533163826646489:3491]
2025-10-02T08:08:00.486456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 191 sessionId: src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0 is DEAD
2025-10-02T08:08:00.486699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:00.486715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0] Write session will restart in 0.005838s
2025-10-02T08:08:00.486743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0] Write session: Do CDS request
2025-10-02T08:08:00.486751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:00.493803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.493883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:00.493901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 192
2025-10-02T08:08:00.494111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.494153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:00.494163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:00.494168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:00.494564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 192 sessionId:  describe result for acl check
2025-10-02T08:08:00.494601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:00.494607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:00.494609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:00.494614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533163826646770:4288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:00.495144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533163826646770:4288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:00.497695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533163826646770:4288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:00.502223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533163826646770:4288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:00.502242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533163826646770:4288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:00.502245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533163826646770:4288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:00.502254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:00.511148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:00.512275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:00.512439Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:00.512447Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:00.512457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:00.512501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:00.512532Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533163826647076:4287]
2025-10-02T08:08:00.513009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:00.513188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:00.513215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:00.513414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:00.513448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.513453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.513453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.513454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.513455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.513460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.513471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.513475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.513478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.513482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.513487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.513493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.513502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.513505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.513508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.513511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.513513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.513517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.513520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.513523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.513535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:00.522411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:00.524093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:00.524130Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:00.524133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:00.524137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:00.524144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 191 [1:7556533163826647076:4287]
2025-10-02T08:08:00.524157Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:00.524177Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:00.524185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.524189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.524191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.524208Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:00.524216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:00.524224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:00.524301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.524309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.524313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:00.524316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:00.524387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:00.524394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.524410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.524428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:00.524452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826646909:4288], now have 1 active actors on pipe
2025-10-02T08:08:00.524464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533163826647070:4287]
2025-10-02T08:08:00.524466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533163826647070:4287]
2025-10-02T08:08:00.524470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 191
2025-10-02T08:08:00.524474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:00.524484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533164287052453:2378], now have 1 active actors on pipe
2025-10-02T08:08:00.524486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:00.524489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:00.524492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:00.524507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:00.524515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:00.524522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.524531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.524573Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 191
2025-10-02T08:08:00.524577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533163826647070:4287]
2025-10-02T08:08:00.524589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:00.524606Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:00.524606Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:00.524611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.524615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.524617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:00.524626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.524634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:00.524687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.524774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.524782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.524820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.524861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 192 partition: 0 MaxSeqNo: 17 sessionId: src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0
2025-10-02T08:08:00.525304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9cc82-2ebb7901-f65d61ba-49d2dd2a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:00.528688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0] Write session: try to update token
2025-10-02T08:08:00.528713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:00.543311Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:00.543330Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:00.543332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:00.543339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533163826647070:4287]
2025-10-02T08:08:00.543341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533163826647070:4287]
2025-10-02T08:08:00.543378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:00.543382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.543383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:00.543385Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:00.543391Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:00.543539Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:00.545247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId: src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:00.548159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:00.586577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533163826647102:3491]
2025-10-02T08:08:00.586683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 191, pipe: [1:7556533163826647102:3491]
2025-10-02T08:08:00.675790Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:00.676159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.676170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.676200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826647102:3491], now have 1 active actors on pipe
2025-10-02T08:08:00.676305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533163826647102:3491]
2025-10-02T08:08:00.676329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:00.676331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:00.676339Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:00.676388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 192 reason: error at write: Disconnected sessionId: src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0
2025-10-02T08:08:00.676391Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:00.676546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 192 sessionId: src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0 is DEAD
2025-10-02T08:08:00.676677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:00.676685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0] Write session will restart in 0.005788s
2025-10-02T08:08:00.676774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0] Write session: Do CDS request
2025-10-02T08:08:00.676793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:00.684419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.684552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:00.684569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 193
2025-10-02T08:08:00.684763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.684792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:00.684798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:00.684808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:00.685164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 193 sessionId:  describe result for acl check
2025-10-02T08:08:00.685203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:00.685208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:00.685210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:00.685214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533163826647435:4294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:00.685690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533163826647435:4294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:00.688549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533163826647435:4294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:00.692265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:00.692714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533163826647435:4294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:00.692728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533163826647435:4294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:00.692731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533163826647435:4294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:00.692740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:00.697192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:00.697490Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:00.697502Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:00.697514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:00.697584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:00.697635Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533163826647681:4293]
2025-10-02T08:08:00.698330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:00.700327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:00.700402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:00.701034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:00.701102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.701109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.701111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.701112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.701113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.701119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.701129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.701134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.701138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.701142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.701148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.701155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.701163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.701168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.701173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.701178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.701183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.701188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.701192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.701197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.701220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:00.710132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:00.712087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:00.712118Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:00.712120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:00.712124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:00.712131Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 192 [1:7556533163826647681:4293]
2025-10-02T08:08:00.712146Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:00.712166Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:00.712168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.712172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.712174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.712192Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:00.712203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:00.712211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:00.712295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.712302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.712305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:00.712308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:00.712384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:00.712392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.712407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.712423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:00.712446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826647677:4294], now have 1 active actors on pipe
2025-10-02T08:08:00.712449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 192
2025-10-02T08:08:00.712454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533164287052459:2378], now have 1 active actors on pipe
2025-10-02T08:08:00.712461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533163826647669:4293]
2025-10-02T08:08:00.712463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533163826647669:4293]
2025-10-02T08:08:00.712475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:00.712489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.712491Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:00.712493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.712495Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:00.712512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:00.712529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:00.712535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:00.712571Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1223229d-13c560c5-5b8a9579-f8f83484_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:00.712579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.712582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.712583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:00.712590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.712598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:00.712608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533163826647669:4293]
2025-10-02T08:08:00.712611Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:00.712622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:00.712629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.712716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.712728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.712742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.712782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 193 partition: 0 MaxSeqNo: 17 sessionId: src_id|1223229d-13c560c5-5b8a9579-f8f83484_0
2025-10-02T08:08:00.712552Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 192
2025-10-02T08:08:00.713139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4029975-b0aac081-d32dc2cc-c54f7b85_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1223229d-13c560c5-5b8a9579-f8f83484_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:00.716193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1223229d-13c560c5-5b8a9579-f8f83484_0] Write session: try to update token
2025-10-02T08:08:00.716216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1223229d-13c560c5-5b8a9579-f8f83484_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:00.723889Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:00.723911Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:00.723922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533163826647669:4293]
2025-10-02T08:08:00.723958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:00.723966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:00.724181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:00.724348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:00.724515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:00.724674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:00.724934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:00.724982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:00.736216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId: src_id|1223229d-13c560c5-5b8a9579-f8f83484_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:00.739227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:00.740568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.740591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.740612Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:00.740615Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:00.740617Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:00.740627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533163826647669:4293]
2025-10-02T08:08:00.740632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533163826647669:4293]
2025-10-02T08:08:00.740684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:00.740684Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:00.740690Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:00.740695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.740697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:00.740875Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:00.776468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533163826647708:3491]
2025-10-02T08:08:00.776553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 192, pipe: [1:7556533163826647708:3491]
2025-10-02T08:08:00.885002Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:00.885582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:00.885620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826647708:3491], now have 1 active actors on pipe
2025-10-02T08:08:00.885640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:00.885754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:00.885761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:00.885792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 193 reason: error at write: Disconnected sessionId: src_id|1223229d-13c560c5-5b8a9579-f8f83484_0
2025-10-02T08:08:00.885905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:00.885997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 193 sessionId: src_id|1223229d-13c560c5-5b8a9579-f8f83484_0 is DEAD
2025-10-02T08:08:00.886164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1223229d-13c560c5-5b8a9579-f8f83484_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:00.886180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1223229d-13c560c5-5b8a9579-f8f83484_0] Write session will restart in 0.006780s
2025-10-02T08:08:00.886180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533163826647708:3491]
2025-10-02T08:08:00.886219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1223229d-13c560c5-5b8a9579-f8f83484_0] Write session: Do CDS request
2025-10-02T08:08:00.886230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1223229d-13c560c5-5b8a9579-f8f83484_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:00.894466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1223229d-13c560c5-5b8a9579-f8f83484_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.894628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:00.894645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 194
2025-10-02T08:08:00.894826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:00.894855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:00.894864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:00.894868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:00.895365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 194 sessionId:  describe result for acl check
2025-10-02T08:08:00.895399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:00.895407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:00.895409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:00.895415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533163826647984:4301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:00.895900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533163826647984:4301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:00.898698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533163826647984:4301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:00.901810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533163826647984:4301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:00.901828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533163826647984:4301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:00.901832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533163826647984:4301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:00.901841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:00.904201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:00.905166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:00.905302Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:00.905313Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:00.905322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:00.905359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:00.905385Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533163826648291:4300]
2025-10-02T08:08:00.905783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:00.905946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:00.905976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:00.906164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:00.906190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.906195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.906195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.906196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.906196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.906199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.906205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.906207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.906210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.906211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.906215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.906219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:00.906223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.906225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:00.906227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.906230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:00.906232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.906235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.906237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.906239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.906249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:00.914177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:00.916091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:00.916123Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:00.916125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:00.916129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:00.916135Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 193 [1:7556533163826648291:4300]
2025-10-02T08:08:00.916147Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:00.916162Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:00.916169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.916172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.916174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.916190Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:00.916200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:00.916206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:00.916273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.916280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.916285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:00.916287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:00.916350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:00.916360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.916374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:00.916386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:00.916390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 193
2025-10-02T08:08:00.916404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826648233:4301], now have 1 active actors on pipe
2025-10-02T08:08:00.916407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533164287052468:2378], now have 1 active actors on pipe
2025-10-02T08:08:00.916413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533163826648285:4300]
2025-10-02T08:08:00.916415Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533163826648285:4300]
2025-10-02T08:08:00.916422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:00.916430Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:00.916431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.916435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.916440Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:00.916498Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 193
2025-10-02T08:08:00.916452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:00.916472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:00.916475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:00.916515Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:00.916520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:00.916523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:00.916525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:00.916532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:00.916539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:00.916546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533163826648285:4300]
2025-10-02T08:08:00.916555Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:00.916577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:00.916587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.916617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:00.916624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:00.916637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:00.916673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 194 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0
2025-10-02T08:08:00.917099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1223229d-13c560c5-5b8a9579-f8f83484_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:00.919901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0] Write session: try to update token
2025-10-02T08:08:00.919925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:00.933601Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:00.933621Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:00.933623Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:00.933632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533163826648285:4300]
2025-10-02T08:08:00.933636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533163826648285:4300]
2025-10-02T08:08:00.933676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:00.933676Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:00.933682Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:00.933689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:00.933691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:00.933850Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:00.934725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId: src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:00.937480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:00.986463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533163826648315:3491]
2025-10-02T08:08:00.986602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 193, pipe: [1:7556533163826648315:3491]
2025-10-02T08:08:01.073158Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:01.073391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.073403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.073435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533163826648315:3491], now have 1 active actors on pipe
2025-10-02T08:08:01.073566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533163826648315:3491]
2025-10-02T08:08:01.073688Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:01.073603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:01.073611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:01.073675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 194 reason: error at write: Disconnected sessionId: src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0
2025-10-02T08:08:01.074017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:01.074042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0] Write session will restart in 0.007481s
2025-10-02T08:08:01.073687Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:01.073849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 194 sessionId: src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0 is DEAD
2025-10-02T08:08:01.074075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0] Write session: Do CDS request
2025-10-02T08:08:01.074083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:01.082480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.082580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:01.082599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 195
2025-10-02T08:08:01.082772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.082810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:01.082819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:01.082823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:01.083182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 195 sessionId:  describe result for acl check
2025-10-02T08:08:01.083212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:01.083214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:01.083216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:01.083220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533168121615967:4307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:01.083680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533168121615967:4307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:01.086147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533168121615967:4307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:01.089160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:01.089306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533168121615967:4307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:01.089325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533168121615967:4307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:01.089328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533168121615967:4307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:01.089337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:01.090386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:01.090559Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:01.090569Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:01.090579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:01.090622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:01.090656Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533168121616196:4306]
2025-10-02T08:08:01.091303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:01.091509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:01.091548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:01.091853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:01.091896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.091902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.091904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.091905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.091906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.091911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.091922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.091926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.091930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.091933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.091938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.091946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.091951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.091957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.091965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.091970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.091973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.091978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.091983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.091992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.092008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:01.100782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:01.102583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:01.102607Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:01.102610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:01.102614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:01.102622Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 194 [1:7556533168121616196:4306]
2025-10-02T08:08:01.102636Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:01.102656Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:01.102664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.102668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.102670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.102687Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:01.102696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:01.102704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:01.102780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.102791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.102796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:01.102798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:01.102880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:01.102890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.102905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.102922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:01.102946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121616192:4307], now have 1 active actors on pipe
2025-10-02T08:08:01.102954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533168582019770:2378], now have 1 active actors on pipe
2025-10-02T08:08:01.102957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 194
2025-10-02T08:08:01.102962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533168121616184:4306]
2025-10-02T08:08:01.102964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533168121616184:4306]
2025-10-02T08:08:01.102974Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:01.102986Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:01.102989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:01.102996Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:01.103005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:01.103008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:01.103015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.103024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.103007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 194
2025-10-02T08:08:01.103067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533168121616184:4306]
2025-10-02T08:08:01.103079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:01.103089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:01.103100Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:01.103111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.103116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.103122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:01.103133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.103142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:01.103191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.103258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.103266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.103283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.103328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 195 partition: 0 MaxSeqNo: 17 sessionId: src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0
2025-10-02T08:08:01.103689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e29754f-54e344ce-bd58b084-1c85c74f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:01.106712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0] Write session: try to update token
2025-10-02T08:08:01.106730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:01.122997Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:01.123024Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:01.123027Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:01.123035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533168121616184:4306]
2025-10-02T08:08:01.123041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533168121616184:4306]
2025-10-02T08:08:01.123087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:01.123089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:01.123096Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:01.123098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.123100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:01.123257Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:01.124363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId: src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:01.127523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:01.173862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533168121616233:3491]
2025-10-02T08:08:01.173998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 194, pipe: [1:7556533168121616233:3491]
2025-10-02T08:08:01.262215Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:01.262623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.262640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.262675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121616233:3491], now have 1 active actors on pipe
2025-10-02T08:08:01.262779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533168121616233:3491]
2025-10-02T08:08:01.262894Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:01.262917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:01.263227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:01.263279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 195 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0
2025-10-02T08:08:01.263469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 195 sessionId: src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0 is DEAD
2025-10-02T08:08:01.263707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:01.263733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0] Write session will restart in 0.008000s
2025-10-02T08:08:01.263759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0] Write session: Do CDS request
2025-10-02T08:08:01.263765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:01.273404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.273448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:01.273466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 196
2025-10-02T08:08:01.273672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.273706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:01.273714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:01.273717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:01.274171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 196 sessionId:  describe result for acl check
2025-10-02T08:08:01.274205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:01.274211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:01.274213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:01.274218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533168121616515:4320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:01.274808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533168121616515:4320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:01.277933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533168121616515:4320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:01.281605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533168121616515:4320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:01.281621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533168121616515:4320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:01.281623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533168121616515:4320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:01.281631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:01.284021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:01.285381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:01.285537Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:01.285544Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:01.285551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:01.285585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:01.285611Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533168121616848:4319]
2025-10-02T08:08:01.286031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:01.286209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:01.286248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:01.286443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:01.286470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.286474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.286474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.286475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.286476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.286479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.286485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.286487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.286489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.286491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.286494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.286498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.286502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.286504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.286507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.286509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.286511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.286514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.286516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.286518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.286527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:01.295091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:01.297315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:01.297338Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:01.297340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:01.297344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:01.297351Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 195 [1:7556533168121616848:4319]
2025-10-02T08:08:01.297364Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:01.297382Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:01.297385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.297390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.297392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.297409Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:01.297417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:01.297429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:01.297507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.297515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.297519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:01.297521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:01.297588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:01.297598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.297613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.297624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:01.297645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121616777:4320], now have 1 active actors on pipe
2025-10-02T08:08:01.297651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533168121616841:4319]
2025-10-02T08:08:01.297652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 195
2025-10-02T08:08:01.297653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533168121616841:4319]
2025-10-02T08:08:01.297768Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 195
2025-10-02T08:08:01.297660Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:01.297667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533168582019788:2378], now have 1 active actors on pipe
2025-10-02T08:08:01.297674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:01.297684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:01.297686Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:01.297688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:01.297691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:01.297697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.297701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.297743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533168121616841:4319]
2025-10-02T08:08:01.297752Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:01.297768Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24cbd709-8de38484-d510bc84-5663d3a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:01.297777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.297778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:01.297781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.297782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:01.297790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.297798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:01.297838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.297878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.297880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.297892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.297929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 196 partition: 0 MaxSeqNo: 17 sessionId: src_id|24cbd709-8de38484-d510bc84-5663d3a8_0
2025-10-02T08:08:01.298329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83888b4-e0afc398-7f9c5366-b75aa4a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|24cbd709-8de38484-d510bc84-5663d3a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:01.301530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24cbd709-8de38484-d510bc84-5663d3a8_0] Write session: try to update token
2025-10-02T08:08:01.301559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24cbd709-8de38484-d510bc84-5663d3a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:01.317260Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:01.317282Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:01.317292Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:01.317302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533168121616841:4319]
2025-10-02T08:08:01.317307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533168121616841:4319]
2025-10-02T08:08:01.317362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:01.317364Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:01.317371Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:01.317375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.317377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:01.317587Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:01.318194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId: src_id|24cbd709-8de38484-d510bc84-5663d3a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:01.321385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:01.363834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533168121616878:3491]
2025-10-02T08:08:01.364188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 195, pipe: [1:7556533168121616878:3491]
2025-10-02T08:08:01.464045Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:01.464620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.464632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.464666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121616878:3491], now have 1 active actors on pipe
2025-10-02T08:08:01.464845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:01.464861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:01.464887Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:01.464938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 196 reason: error at write: Disconnected sessionId: src_id|24cbd709-8de38484-d510bc84-5663d3a8_0
2025-10-02T08:08:01.465109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 196 sessionId: src_id|24cbd709-8de38484-d510bc84-5663d3a8_0 is DEAD
2025-10-02T08:08:01.465112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533168121616878:3491]
2025-10-02T08:08:01.465287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cbd709-8de38484-d510bc84-5663d3a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:01.465305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cbd709-8de38484-d510bc84-5663d3a8_0] Write session will restart in 0.007550s
2025-10-02T08:08:01.465331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cbd709-8de38484-d510bc84-5663d3a8_0] Write session: Do CDS request
2025-10-02T08:08:01.465341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cbd709-8de38484-d510bc84-5663d3a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:01.465316Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:01.474381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24cbd709-8de38484-d510bc84-5663d3a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.474484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:01.474502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 197
2025-10-02T08:08:01.474668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.474693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:01.474701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:01.474703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:01.475525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 197 sessionId:  describe result for acl check
2025-10-02T08:08:01.475574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:01.475584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:01.475585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:01.475592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533168121617189:4333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:01.476121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533168121617189:4333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:01.479167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533168121617189:4333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:01.483406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533168121617189:4333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:01.483427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533168121617189:4333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:01.483431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533168121617189:4333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:01.483440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:01.486288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:01.487735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:01.487959Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:01.487974Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:01.487988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:01.488054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:01.488129Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533168121617475:4332]
2025-10-02T08:08:01.488858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:01.489157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:01.489216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:01.489552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:01.489619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.489624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.489626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.489627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.489628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.489633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.489644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.489648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.489651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.489655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.489662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.489669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.489675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.489681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.489686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.489691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.489696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.489702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.489707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.489712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.489734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:01.498185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:01.499913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:01.499931Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:01.499933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:01.499936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:01.499941Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 196 [1:7556533168121617475:4332]
2025-10-02T08:08:01.499951Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:01.499969Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:01.499972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.499975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.499977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.499993Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:01.499998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:01.500004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:01.500059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.500067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.500072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:01.500074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:01.500144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:01.500156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.500167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.500179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:01.500197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533168121617469:4332]
2025-10-02T08:08:01.500204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533168121617469:4332]
2025-10-02T08:08:01.500212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:01.500226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121617421:4333], now have 1 active actors on pipe
2025-10-02T08:08:01.500233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 196
2025-10-02T08:08:01.500239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:01.500241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:01.500245Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:01.500253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:01.500261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:01.500266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533168582019820:2378], now have 1 active actors on pipe
2025-10-02T08:08:01.500299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.500309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.500323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533168121617469:4332]
2025-10-02T08:08:01.500337Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:01.500344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:01.500343Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 196
2025-10-02T08:08:01.500369Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:01.500380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.500383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.500385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:01.500393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.500401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:01.500430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.500478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.500485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.500495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.500530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 197 partition: 0 MaxSeqNo: 17 sessionId: src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0
2025-10-02T08:08:01.500875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cbd709-8de38484-d510bc84-5663d3a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:01.503370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0] Write session: try to update token
2025-10-02T08:08:01.503387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:01.519101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId: src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:01.522030Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:01.522053Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:01.522056Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:01.522067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533168121617469:4332]
2025-10-02T08:08:01.522072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533168121617469:4332]
2025-10-02T08:08:01.522131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:01.522143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:01.522147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.522150Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:01.522151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:01.522164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:01.522324Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:01.565534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533168121617501:3491]
2025-10-02T08:08:01.565673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 196, pipe: [1:7556533168121617501:3491]
2025-10-02T08:08:01.657247Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:01.657823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.657837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.657881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121617501:3491], now have 1 active actors on pipe
2025-10-02T08:08:01.658017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533168121617501:3491]
2025-10-02T08:08:01.658035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:01.658037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:01.658099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 197 reason: error at write: Disconnected sessionId: src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0
2025-10-02T08:08:01.658152Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:01.658165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:01.658286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 197 sessionId: src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0 is DEAD
2025-10-02T08:08:01.658461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:01.658468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0] Write session will restart in 0.006164s
2025-10-02T08:08:01.658488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0] Write session: Do CDS request
2025-10-02T08:08:01.658494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:01.665217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.665353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:01.665370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 198
2025-10-02T08:08:01.665502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.665537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:01.665549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:01.665553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:01.665984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 198 sessionId:  describe result for acl check
2025-10-02T08:08:01.666017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:01.666023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:01.666024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:01.666030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533168121617779:4339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:01.666630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533168121617779:4339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:01.669840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533168121617779:4339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:01.673910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533168121617779:4339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:01.673929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533168121617779:4339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:01.673933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533168121617779:4339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:01.673941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:01.676537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:01.678122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:01.678411Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:01.678424Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:01.678436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:01.678497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:01.678544Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533168121618091:4338]
2025-10-02T08:08:01.679268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:01.679521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:01.679577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:01.679938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:01.680001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.680003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.680004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.680005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.680006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.680012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.680022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.680026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.680030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.680034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.680040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.680054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.680061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.680075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.680080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.680100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.680105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.680111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.680120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.680126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.680149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:01.692159Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 197
2025-10-02T08:08:01.689356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:01.691667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:01.691675Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:01.691678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:01.691682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:01.691690Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 197 [1:7556533168121618091:4338]
2025-10-02T08:08:01.691703Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:01.691724Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:01.691727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.691730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.691732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.691747Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:01.691753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:01.691760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:01.691833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.691836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.691839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:01.691841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:01.691923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:01.691926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.691941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.691954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:01.691976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121618049:4339], now have 1 active actors on pipe
2025-10-02T08:08:01.691984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533168121618085:4338]
2025-10-02T08:08:01.691986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533168121618085:4338]
2025-10-02T08:08:01.691996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:01.691997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 197
2025-10-02T08:08:01.692007Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:01.692010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:01.692013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:01.692026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:01.692030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:01.692037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533168582019827:2378], now have 1 active actors on pipe
2025-10-02T08:08:01.692042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.692046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.692083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533168121618085:4338]
2025-10-02T08:08:01.692114Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:01.692132Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:01.692138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.692142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.692144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:01.692154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.692164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:01.692186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:01.692194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.692299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.692306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.692327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.692366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 198 partition: 0 MaxSeqNo: 17 sessionId: src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0
2025-10-02T08:08:01.692698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1a13e0-1e4d946c-53b4f96a-ac7ca9ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:01.695714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0] Write session: try to update token
2025-10-02T08:08:01.695737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:01.716469Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:01.716494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:01.716498Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:01.716510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533168121618085:4338]
2025-10-02T08:08:01.716515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533168121618085:4338]
2025-10-02T08:08:01.716541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId: src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:01.716562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:01.716570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.716573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:01.716732Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:01.719734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:01.719826Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:01.719840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:01.758041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533168121618118:3491]
2025-10-02T08:08:01.758188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 197, pipe: [1:7556533168121618118:3491]
2025-10-02T08:08:01.856215Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:01.856558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.856571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.856608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121618118:3491], now have 1 active actors on pipe
2025-10-02T08:08:01.856760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:01.856771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:01.856839Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:01.856910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 198 reason: error at write: Disconnected sessionId: src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0
2025-10-02T08:08:01.856958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:01.857101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533168121618118:3491]
2025-10-02T08:08:01.857119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 198 sessionId: src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0 is DEAD
2025-10-02T08:08:01.857308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:01.857321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0] Write session will restart in 0.005549s
2025-10-02T08:08:01.857344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0] Write session: Do CDS request
2025-10-02T08:08:01.857350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:01.864443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.864549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:01.864564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 199
2025-10-02T08:08:01.864716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:01.864739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:01.864746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:01.864748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:01.865127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 199 sessionId:  describe result for acl check
2025-10-02T08:08:01.865150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:01.865154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:01.865155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:01.865159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533168121618434:4346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:01.865568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533168121618434:4346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:01.867938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533168121618434:4346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:01.871360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533168121618434:4346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:01.871374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533168121618434:4346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:01.871376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533168121618434:4346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:01.871382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:01.872702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:01.873767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:01.873902Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:01.873909Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:01.873916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:01.873946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:01.873977Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533168121618711:4345]
2025-10-02T08:08:01.874415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:01.874542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:01.874570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:01.874763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:01.874805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.874810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.874811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.874812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.874813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.874817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.874827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.874835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.874837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.874839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.874843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.874847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:01.874851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.874853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:01.874855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.874858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:01.874860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.874869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.874877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.874887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.874903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:01.882940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:01.884917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:01.884931Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:01.884932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:01.884935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:01.884943Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 198 [1:7556533168121618711:4345]
2025-10-02T08:08:01.884954Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:01.884971Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:01.884974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.884977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.884979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.884993Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:01.884998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:01.885004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:01.885060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.885066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.885069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:01.885070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:01.885138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:01.885146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.885158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:01.885171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:01.885193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121618685:4346], now have 1 active actors on pipe
2025-10-02T08:08:01.885203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533168121618705:4345]
2025-10-02T08:08:01.885205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533168121618705:4345]
2025-10-02T08:08:01.885212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:01.885224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533168582019836:2378], now have 1 active actors on pipe
2025-10-02T08:08:01.885228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 198
2025-10-02T08:08:01.885229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:01.885230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:01.885232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:01.885243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:01.885246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:01.885254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.885257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.885293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533168121618705:4345]
2025-10-02T08:08:01.885304Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:01.885310Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:01.885318Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:01.885323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:01.885326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:01.885329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:01.885335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:01.885344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:01.885315Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 198
2025-10-02T08:08:01.885385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.885430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:01.885436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:01.885446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:01.885473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 199 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0
2025-10-02T08:08:01.885844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886887bb-8a1b038c-10d44f55-c2c59ab2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:01.888347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0] Write session: try to update token
2025-10-02T08:08:01.888369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:01.902047Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:01.902072Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:01.902076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:01.902085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533168121618705:4345]
2025-10-02T08:08:01.902090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533168121618705:4345]
2025-10-02T08:08:01.902133Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:01.902140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:01.902145Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:01.902145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:01.902147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:01.902291Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:01.903954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId: src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:01.906898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:01.957182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533168121618736:3491]
2025-10-02T08:08:01.957291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 198, pipe: [1:7556533168121618736:3491]
2025-10-02T08:08:02.039780Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:02.040042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.040052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.040083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533168121618736:3491], now have 1 active actors on pipe
2025-10-02T08:08:02.040198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:02.040213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:02.040256Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:02.040281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 199 reason: error at write: Disconnected sessionId: src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0
2025-10-02T08:08:02.040357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:02.040463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533168121618736:3491]
2025-10-02T08:08:02.040485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 199 sessionId: src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0 is DEAD
2025-10-02T08:08:02.040694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:02.040705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0] Write session will restart in 0.008875s
2025-10-02T08:08:02.040727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0] Write session: Do CDS request
2025-10-02T08:08:02.040733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:02.050413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.050476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:02.050495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 200
2025-10-02T08:08:02.050646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.050682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:02.050691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:02.050694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:02.051084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 200 sessionId:  describe result for acl check
2025-10-02T08:08:02.051113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:02.051119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:02.051121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:02.051127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533172416586454:4352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:02.051543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533172416586454:4352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:02.054823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533172416586454:4352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:02.056313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:02.057292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:02.057461Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:02.057471Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:02.057480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:02.057517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:02.057650Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533172416586621:4351]
2025-10-02T08:08:02.057867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533172416586454:4352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:02.057879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533172416586454:4352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:02.057881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533172416586454:4352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:02.057897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:02.058361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:02.058507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:02.058542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:02.058846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:02.058886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.058892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.058893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.058894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.058895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.058900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.058909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.058917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.058920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.058928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.058933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.058939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.058948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.058953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.058962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.058970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.058974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.058979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.058988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.058997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.059021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:02.071066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:02.072621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:02.072641Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:02.072644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:02.072648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:02.072655Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 199 [1:7556533172416586621:4351]
2025-10-02T08:08:02.072668Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:02.072688Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:02.072690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.072693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.072695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.072712Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:02.072717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:02.072723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:02.072790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.072814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.072818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:02.072820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:02.072888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:02.072896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.072909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.072925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:02.072948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416586626:4352], now have 1 active actors on pipe
2025-10-02T08:08:02.072959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533172416586615:4351]
2025-10-02T08:08:02.072962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533172416586615:4351]
2025-10-02T08:08:02.072969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:02.072970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 199
2025-10-02T08:08:02.072978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533172876987139:2378], now have 1 active actors on pipe
2025-10-02T08:08:02.072979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:02.072982Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:02.072985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:02.072999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:02.073006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:02.073013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.073017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.073055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533172416586615:4351]
2025-10-02T08:08:02.073067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:02.073078Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:02.073084Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:02.073089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.073093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.073095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:02.073104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.073111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:02.073147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.073109Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 199
2025-10-02T08:08:02.073220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.073227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.073239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.073273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 200 partition: 0 MaxSeqNo: 17 sessionId: src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0
2025-10-02T08:08:02.073667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc277a40-d5145b87-6f4fb018-52d35eb6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:02.076075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0] Write session: try to update token
2025-10-02T08:08:02.076103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:02.089336Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:02.089360Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:02.089369Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533172416586615:4351]
2025-10-02T08:08:02.089414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:02.089430Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:02.089610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:02.089774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:02.089929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:02.090091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:02.090318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:02.090370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:02.092679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId: src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:02.096131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:02.096198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.096208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.096236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:02.096256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:02.096426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.096442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.096605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.096682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.096748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.096826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.096978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.096990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.097055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.097122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.097183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.097244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.097290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.097295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.097359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.097418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.097483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.097543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.097590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.097597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.097660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.097718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.097782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.097841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.097883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.097888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.097954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.098013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.098072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.098134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.098248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.098254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.098315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.098370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.098434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.098511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.098563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.098569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.098640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.098710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.098774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.098830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.098872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.098877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.098937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.098993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.099060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.099132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.099188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.099196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.099255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.099309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.099373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.099433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.099477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.099483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.099543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:02.099597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:02.099654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:02.099712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:02.099769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:02.099775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:02.099828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:02.099879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.099895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.099900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:02.099926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:02.099939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:02.099944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:02.099946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:02.099951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:02.100317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:02.100336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:02.100345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:02.100351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:02.100354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:02.100357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:02.100950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:02.100971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:02.100979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:02.100985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:02.100987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:02.100989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:02.101428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:02.101445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:02.101449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:02.101455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:02.101458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:02.103564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:02.103583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:02.103592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392482103
2025-10-02T08:08:02.103700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:02.103712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:02.103715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:02.103719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:02.103721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:02.103723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:02.104231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:02.104255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:02.104260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:02.104267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:02.104270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:02.104274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:02.104778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:02.104837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:02.104852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:02.104860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:02.104863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:02.104873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:02.105328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:02.105351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:02.105356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:02.106483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:02.106499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:02.106502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:02.106505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:02.106511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392482106
2025-10-02T08:08:02.106787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:02.106805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:02.106809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:02.106810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:02.106814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:02.106816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:02.107328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:02.107347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:02.107352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:02.107356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:02.107361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:02.107370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:02.107849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:02.107870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.107966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392482107
2025-10-02T08:08:02.110675Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:02.110705Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:02.110713Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:02.110722Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:02.110733Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:02.110736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:02.110738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:02.110748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533172416586615:4351]
2025-10-02T08:08:02.110754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533172416586615:4351]
2025-10-02T08:08:02.110808Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:02.110822Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:02.110831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:02.110836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.110838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:02.110984Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:02.140504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533172416586652:3491]
2025-10-02T08:08:02.140617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 199, pipe: [1:7556533172416586652:3491]
2025-10-02T08:08:02.252557Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:02.252949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416586652:3491], now have 1 active actors on pipe
2025-10-02T08:08:02.253175Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:02.253231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:02.253277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 200 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0
2025-10-02T08:08:02.253228Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:02.253516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 200 sessionId: src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0 is DEAD
2025-10-02T08:08:02.253538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533172416586652:3491]
2025-10-02T08:08:02.253621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:02.253631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0] Write session will restart in 0.005226s
2025-10-02T08:08:02.253735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0] Write session: Do CDS request
2025-10-02T08:08:02.253753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:02.258025Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [dcfdc468e1fb6c2e] Result# TEvPutResult {Id# [72075186224037892:199:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:02.258074Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:199:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:02.258124Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:199:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:02.260454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.260531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:02.260545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 201
2025-10-02T08:08:02.260723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.260764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:02.260776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:02.260779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:02.261459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 201 sessionId:  describe result for acl check
2025-10-02T08:08:02.261493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:02.261495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:02.261497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:02.261502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533172416586899:4359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:02.261960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533172416586899:4359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:02.264134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533172416586899:4359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:02.267482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533172416586899:4359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:02.267496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533172416586899:4359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:02.267499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533172416586899:4359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:02.267506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:02.273553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:02.274735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:02.275001Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:02.275016Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:02.275028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:02.275090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:02.275133Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533172416587266:4358]
2025-10-02T08:08:02.275783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:02.276016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:02.276064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:02.276390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:02.276454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.276462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.276463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.276464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.276465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.276471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.276482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.276485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.276490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.276493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.276500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.276511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.276517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.276528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.276537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.276546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.276555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.276565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.276574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.276583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.276608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:02.288214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:02.290072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:02.290097Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:02.290100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:02.290103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:02.290109Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 200 [1:7556533172416587266:4358]
2025-10-02T08:08:02.290121Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:02.290137Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:02.290140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.290142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.290144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.290159Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:02.290164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:02.290170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:02.290252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.290261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.290264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:02.290266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:02.290332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:02.290342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.290357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.290369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:02.290394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416587121:4359], now have 1 active actors on pipe
2025-10-02T08:08:02.290407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533172416587260:4358]
2025-10-02T08:08:02.290413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533172416587260:4358]
2025-10-02T08:08:02.290424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:02.290440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533172876987158:2378], now have 1 active actors on pipe
2025-10-02T08:08:02.290443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:02.290446Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:02.290449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:02.290463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:02.290470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:02.290501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533172416587260:4358]
2025-10-02T08:08:02.290508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:02.290527Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:02.290556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 200
2025-10-02T08:08:02.290502Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 200
2025-10-02T08:08:02.290610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.290619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.290644Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|271de839-ac7bc3fc-e213a297-33142e25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:02.290655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.290663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.290665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:02.290674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.290688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:02.290709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.290739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.290746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.290759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.290793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 201 partition: 0 MaxSeqNo: 17 sessionId: src_id|271de839-ac7bc3fc-e213a297-33142e25_0
2025-10-02T08:08:02.291208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01a554c-3d09336d-c4b722d2-78c5f2ff_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|271de839-ac7bc3fc-e213a297-33142e25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:02.293913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271de839-ac7bc3fc-e213a297-33142e25_0] Write session: try to update token
2025-10-02T08:08:02.293935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271de839-ac7bc3fc-e213a297-33142e25_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:02.307707Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:02.307730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:02.307733Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:02.307742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533172416587260:4358]
2025-10-02T08:08:02.307746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533172416587260:4358]
2025-10-02T08:08:02.307780Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:02.307789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:02.307791Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:02.307796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.307798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:02.307954Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:02.314380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId: src_id|271de839-ac7bc3fc-e213a297-33142e25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:02.317154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:02.353482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533172416587330:3491]
2025-10-02T08:08:02.353605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 200, pipe: [1:7556533172416587330:3491]
2025-10-02T08:08:02.442527Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:02.442939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.442948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.442964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416587330:3491], now have 1 active actors on pipe
2025-10-02T08:08:02.443129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:02.443142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:02.443145Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:02.443236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 201 reason: error at write: Disconnected sessionId: src_id|271de839-ac7bc3fc-e213a297-33142e25_0
2025-10-02T08:08:02.443170Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:02.443364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533172416587330:3491]
2025-10-02T08:08:02.443481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 201 sessionId: src_id|271de839-ac7bc3fc-e213a297-33142e25_0 is DEAD
2025-10-02T08:08:02.443763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271de839-ac7bc3fc-e213a297-33142e25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:02.443780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271de839-ac7bc3fc-e213a297-33142e25_0] Write session will restart in 0.006309s
2025-10-02T08:08:02.443811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271de839-ac7bc3fc-e213a297-33142e25_0] Write session: Do CDS request
2025-10-02T08:08:02.443822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271de839-ac7bc3fc-e213a297-33142e25_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:02.451403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271de839-ac7bc3fc-e213a297-33142e25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.451519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:02.451547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 202
2025-10-02T08:08:02.451767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.451802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:02.451813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:02.451817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:02.452252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 202 sessionId:  describe result for acl check
2025-10-02T08:08:02.452282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:02.452288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:02.452290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:02.452295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533172416587685:4376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:02.452865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533172416587685:4376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:02.455126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533172416587685:4376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:02.458593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533172416587685:4376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:02.458612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533172416587685:4376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:02.458615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533172416587685:4376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:02.458624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:02.463786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:02.464792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:02.465004Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:02.465017Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:02.465027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:02.465082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:02.465205Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533172416587932:4375]
2025-10-02T08:08:02.465935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:02.466157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:02.466212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:02.466545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:02.466607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.466614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.466615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.466616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.466617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.466622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.466633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.466637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.466642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.466646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.466651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.466662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.466667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.466672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.466681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.466686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.466691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.466695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.466700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.466712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.466734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:02.477107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:02.478850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:02.478871Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:02.478873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:02.478877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:02.478884Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 201 [1:7556533172416587932:4375]
2025-10-02T08:08:02.478896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:02.478915Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:02.478918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.478922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.478924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.478940Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:02.478945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:02.478952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:02.479015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.479026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.479029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:02.479031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:02.479103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:02.479113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.479126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.479138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:02.479162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416587791:4376], now have 1 active actors on pipe
2025-10-02T08:08:02.479168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 201
2025-10-02T08:08:02.479173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533172416587926:4375]
2025-10-02T08:08:02.479176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533172416587926:4375]
2025-10-02T08:08:02.479194Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:02.479207Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:02.479208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533172876987168:2378], now have 1 active actors on pipe
2025-10-02T08:08:02.479210Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:02.479215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.479221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.479237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:02.479258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:02.479266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:02.479312Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:02.479323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.479326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.479328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:02.479337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.479347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:02.479316Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 201
2025-10-02T08:08:02.479360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533172416587926:4375]
2025-10-02T08:08:02.479373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:02.479385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:02.479409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.479457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.479464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.479479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.479520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 202 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0
2025-10-02T08:08:02.479969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271de839-ac7bc3fc-e213a297-33142e25_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:02.482764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0] Write session: try to update token
2025-10-02T08:08:02.482787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:02.500081Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:02.500119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:02.500120Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:02.500126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533172416587926:4375]
2025-10-02T08:08:02.500129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533172416587926:4375]
2025-10-02T08:08:02.500161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:02.500166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.500167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:02.500167Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:02.500172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:02.500333Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:02.501506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId: src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:02.504330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:02.543444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533172416587965:3491]
2025-10-02T08:08:02.543574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 201, pipe: [1:7556533172416587965:3491]
2025-10-02T08:08:02.644753Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:02.645482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.645499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.645539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416587965:3491], now have 1 active actors on pipe
2025-10-02T08:08:02.645675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:02.645689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:02.645759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 202 reason: error at write: Disconnected sessionId: src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0
2025-10-02T08:08:02.645790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:02.645969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 202 sessionId: src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0 is DEAD
2025-10-02T08:08:02.646122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533172416587965:3491]
2025-10-02T08:08:02.646152Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:08:02.646199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:02.646218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0] Write session will restart in 0.006276s
2025-10-02T08:08:02.646249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0] Write session: Do CDS request
2025-10-02T08:08:02.646257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:02.646428Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_6452961545075842050_v1 is DEAD
2025-10-02T08:08:02.646689Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:08:02.646706Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:02.646822Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533086517189101:3486] disconnected; active server actors: 1
2025-10-02T08:08:02.646835Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533086517189101:3486] client user disconnected session shared/user_1_2_6452961545075842050_v1
2025-10-02T08:08:02.647036Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:08:02.647041Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:08:02.647067Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.007931s
2025-10-02T08:08:02.654100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.654227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:02.654248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 203
2025-10-02T08:08:02.654429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.654460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:02.654469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:02.654472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:02.655266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 203 sessionId:  describe result for acl check
2025-10-02T08:08:02.655307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:02.655309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:02.655311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:02.655317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533172416588203:4384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:02.655882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533172416588203:4384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:02.656564Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:08:02.657224Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:08:02.657237Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-02T08:08:02.657470Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:08:02.657534Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:08:02.657637Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 auth for : user
2025-10-02T08:08:02.657863Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 Handle describe topics response
2025-10-02T08:08:02.657896Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 auth is DEAD
2025-10-02T08:08:02.657916Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:08:02.658208Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:08:02.659063Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_3_13583134836188586276_v1
2025-10-02T08:08:02.659073Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:08:02.659087Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533172416588236:4387] connected; active server actors: 1
2025-10-02T08:08:02.659255Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:08:02.659311Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533172416588236:4387] session shared/user_1_3_13583134836188586276_v1
2025-10-02T08:08:02.659326Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:08:02.659335Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:08:02.659345Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_3_13583134836188586276_v1" (Sender=[1:7556533172416588228:4387], Pipe=[1:7556533172416588236:4387], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:08:02.659349Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:08:02.659358Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:08:02.659370Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_13583134836188586276_v1" (Sender=[1:7556533172416588228:4387], Pipe=[1:7556533172416588236:4387], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:08:02.659384Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_3_13583134836188586276_v1" sender [1:7556533172416588228:4387] lock partition 0 for ReadingSession "shared/user_1_3_13583134836188586276_v1" (Sender=[1:7556533172416588228:4387], Pipe=[1:7556533172416588236:4387], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-02T08:08:02.659376Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:08:02.659396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:08:02.659399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000035s
2025-10-02T08:08:02.659449Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 got read request: guid# 73c36f9d-f478825a-133b3a81-aca3bec4
2025-10-02T08:08:02.659934Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_3_13583134836188586276_v1" ClientId: "user" PipeClient { RawX1: 7556533172416588236 RawX2: 4503603922342179 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:08:02.660082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:08:02.660429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533172416588203:4384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:02.664431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533172416588203:4384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:02.664449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533172416588203:4384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:02.664452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533172416588203:4384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:02.664461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:02.673342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:02.674580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:02.674788Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:02.674792Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:02.674802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:02.674855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:02.674889Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533172416588572:4383]
2025-10-02T08:08:02.675541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:02.675779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:02.675825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:02.676153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:02.676199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.676201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.676202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.676203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.676204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.676209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.676221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.676225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.676229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.676233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.676239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.676246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.676252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.676257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.676262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.676267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.676274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.676279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.676284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.676290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.676324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:02.685686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:02.687746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:02.687775Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:02.687777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:02.687780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:02.687785Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 202 [1:7556533172416588572:4383]
2025-10-02T08:08:02.687795Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:02.687811Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:02.687813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.687815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.687817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.687830Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:02.687834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:02.687839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:02.687905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.687913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.687916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:02.687918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:02.687986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:02.687996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.688010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.688022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:02.688040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416588257:4391], now have 1 active actors on pipe
2025-10-02T08:08:02.688040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 202, pipe: [1:7556533172416588257:4391]
2025-10-02T08:08:02.688052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.688055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 202
2025-10-02T08:08:02.688056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.688066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_3_13583134836188586276_v1 on pipe: [1:7556533172416588257:4391]
2025-10-02T08:08:02.688095Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_13583134836188586276_v1:1 with generation 202
2025-10-02T08:08:02.688096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533172416588566:4383]
2025-10-02T08:08:02.688098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533172416588566:4383]
2025-10-02T08:08:02.688111Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:02.688120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416588354:4384], now have 1 active actors on pipe
2025-10-02T08:08:02.688126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533172876987197:2378], now have 1 active actors on pipe
2025-10-02T08:08:02.688132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:02.688145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:02.688136Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 202
2025-10-02T08:08:02.688150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:02.688155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.688158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.688170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.688176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.688178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:02.688190Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:02.688193Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:02.688197Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_3_13583134836188586276_v1
2025-10-02T08:08:02.688199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.688257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533172416588566:4383]
2025-10-02T08:08:02.688271Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:02.688280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:02.688288Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9121374e-110edd7a-e375229-d744e3c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:02.688293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:08:02.688296Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:02.689610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:08:02.689654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:08:02.689665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.689670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.689677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:02.689688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.689702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:02.689712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:08:02.689724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:08:02.689746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.689820Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392482687 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:08:02.689845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:08:02.689888Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 sending to client partition status
2025-10-02T08:08:02.690106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.690120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.690138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.690181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 203 partition: 0 MaxSeqNo: 17 sessionId: src_id|9121374e-110edd7a-e375229-d744e3c0_0
2025-10-02T08:08:02.692941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82c1af-b4edb585-96a6e2e5-20922f71_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9121374e-110edd7a-e375229-d744e3c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:02.696643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9121374e-110edd7a-e375229-d744e3c0_0] Write session: try to update token
2025-10-02T08:08:02.696672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9121374e-110edd7a-e375229-d744e3c0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:02.701943Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:02.701969Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:02.701979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533172416588566:4383]
2025-10-02T08:08:02.702024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:02.702024Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:02.702224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:02.702401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:02.702571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:02.702747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:02.702984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:02.703024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:02.727805Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:02.727845Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:02.727848Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:02.727858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533172416588566:4383]
2025-10-02T08:08:02.727863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533172416588566:4383]
2025-10-02T08:08:02.727907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:02.727915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.727917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:02.728066Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:02.728590Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:02.728607Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:02.733655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId: src_id|9121374e-110edd7a-e375229-d744e3c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:02.736932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:02.871586Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:02.872015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.872034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.872158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533172416588257:4391]
2025-10-02T08:08:02.872312Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:02.872773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9121374e-110edd7a-e375229-d744e3c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:02.872787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9121374e-110edd7a-e375229-d744e3c0_0] Write session will restart in 0.009761s
2025-10-02T08:08:02.872248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:02.872257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:02.872292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_13583134836188586276_v1
2025-10-02T08:08:02.872303Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:02.872317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 203 reason: error at write: Disconnected sessionId: src_id|9121374e-110edd7a-e375229-d744e3c0_0
2025-10-02T08:08:02.872530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 203 sessionId: src_id|9121374e-110edd7a-e375229-d744e3c0_0 is DEAD
2025-10-02T08:08:02.872644Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_13583134836188586276_v1
2025-10-02T08:08:02.872828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9121374e-110edd7a-e375229-d744e3c0_0] Write session: Do CDS request
2025-10-02T08:08:02.872856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9121374e-110edd7a-e375229-d744e3c0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:02.883435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9121374e-110edd7a-e375229-d744e3c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.883521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:02.883540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 204
2025-10-02T08:08:02.883747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:02.883777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:02.883786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:02.883789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:02.884213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 204 sessionId:  describe result for acl check
2025-10-02T08:08:02.884245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:02.884251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:02.884252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:02.884258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533172416589002:4395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:02.884702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533172416589002:4395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:02.887571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533172416589002:4395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:02.891437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533172416589002:4395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:02.891456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533172416589002:4395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:02.891459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533172416589002:4395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:02.891469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:02.891696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:02.892740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:02.892948Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:02.892957Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:02.892967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:02.893012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:02.893053Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533172416589204:4394]
2025-10-02T08:08:02.893678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:02.894047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:02.894091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:02.894415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:02.894464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.894470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.894471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.894472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.894473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.894478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.894488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.894492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.894496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.894500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.894509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.894521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:02.894530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.894533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:02.894536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.894539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:02.894541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.894544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.894551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.894554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.894565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:02.904127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:02.906119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:02.906143Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:02.906147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:02.906151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:02.906158Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 203 [1:7556533172416589204:4394]
2025-10-02T08:08:02.906172Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:02.906192Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:02.906195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.906198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.906200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.906220Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:02.906225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:02.906231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:02.906299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.906306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.906309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:02.906312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:02.906397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:02.906406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.906422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:02.906439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:02.906462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416589193:4395], now have 1 active actors on pipe
2025-10-02T08:08:02.906471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533172416589197:4394]
2025-10-02T08:08:02.906473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533172416589197:4394]
2025-10-02T08:08:02.906474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 203
2025-10-02T08:08:02.906481Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:02.906488Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:02.906490Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:02.906491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533172876987207:2378], now have 1 active actors on pipe
2025-10-02T08:08:02.906497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:02.906510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:02.906517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:02.906525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.906534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.906577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533172416589197:4394]
2025-10-02T08:08:02.906590Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:02.906605Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:02.906612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:02.906621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:02.906623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:02.906623Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:02.906635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:02.906648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:02.906654Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 203
2025-10-02T08:08:02.906691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.906774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:02.906781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:02.906794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:02.906834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 204 partition: 0 MaxSeqNo: 17 sessionId: src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0
2025-10-02T08:08:02.907245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9121374e-110edd7a-e375229-d744e3c0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:02.910592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0] Write session: try to update token
2025-10-02T08:08:02.910612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:02.927848Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:02.927873Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:02.927875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:02.927884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533172416589197:4394]
2025-10-02T08:08:02.927889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533172416589197:4394]
2025-10-02T08:08:02.927939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:02.927943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:02.927946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:02.927948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:02.927949Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:02.928135Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:02.932089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId: src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:02.935324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:02.972531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533172416589228:4391]
2025-10-02T08:08:02.972650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 203, pipe: [1:7556533172416589228:4391]
2025-10-02T08:08:03.069531Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:03.070102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.070123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.070160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533172416589228:4391], now have 1 active actors on pipe
2025-10-02T08:08:03.070283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:03.070299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:03.070362Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:03.070370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 204 reason: error at write: Disconnected sessionId: src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0
2025-10-02T08:08:03.070472Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:03.070570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 204 sessionId: src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0 is DEAD
2025-10-02T08:08:03.070667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533172416589228:4391]
2025-10-02T08:08:03.070754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:03.070767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0] Write session will restart in 0.005449s
2025-10-02T08:08:03.070795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0] Write session: Do CDS request
2025-10-02T08:08:03.070802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:03.077339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.077466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:03.077481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 205
2025-10-02T08:08:03.077634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.077660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:03.077663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:03.077666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:03.078095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 205 sessionId:  describe result for acl check
2025-10-02T08:08:03.078138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:03.078145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:03.078147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:03.078161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533176711556784:4401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:03.078680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533176711556784:4401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:03.081033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533176711556784:4401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:03.084229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533176711556784:4401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:03.084244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533176711556784:4401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:03.084246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533176711556784:4401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:03.084251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:03.089244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:03.090356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:03.090570Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:03.090578Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:03.090586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:03.090639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:03.090680Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533176711557130:4400]
2025-10-02T08:08:03.091267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:03.091434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:03.091466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:03.091686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:03.091729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.091733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.091734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.091735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.091735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.091739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.091746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.091748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.091750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.091751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.091755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.091759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.091763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.091765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.091771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.091773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.091776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.091778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.091781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.091785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.091796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:03.099772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:03.101882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:03.101902Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:03.101904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:03.101908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:03.101914Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 204 [1:7556533176711557130:4400]
2025-10-02T08:08:03.101925Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:03.101955Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:03.101961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.101964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.101966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.101982Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:03.101991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:03.102002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:03.102077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.102084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.102087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:03.102089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:03.102147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:03.102153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.102163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.102170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:03.102187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711557008:4401], now have 1 active actors on pipe
2025-10-02T08:08:03.102189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 204
2025-10-02T08:08:03.102195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533176711557124:4400]
2025-10-02T08:08:03.102196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533176711557124:4400]
2025-10-02T08:08:03.102201Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:03.102211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:03.102213Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:03.102216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:03.102222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:03.102224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:03.102230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533177171954510:2378], now have 1 active actors on pipe
2025-10-02T08:08:03.102233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.102236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.102271Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533176711557124:4400]
2025-10-02T08:08:03.102280Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:03.102291Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:03.102296Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:03.102301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.102304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.102306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:03.102316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.102330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:03.102314Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 204
2025-10-02T08:08:03.102371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.102435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.102439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.102450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.102479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 205 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0
2025-10-02T08:08:03.102870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fa2600-9a01cdb3-c6f8a2e1-3473086b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:03.105802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0] Write session: try to update token
2025-10-02T08:08:03.105824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:03.120700Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:03.120723Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:03.120726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:03.120735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533176711557124:4400]
2025-10-02T08:08:03.120740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533176711557124:4400]
2025-10-02T08:08:03.120784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:03.120789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:03.120791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.120793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:03.120794Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:03.121045Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:03.121899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId: src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:03.124722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:03.170620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533176711557167:4391]
2025-10-02T08:08:03.170717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 204, pipe: [1:7556533176711557167:4391]
2025-10-02T08:08:03.249823Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:03.250052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.250065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.250097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711557167:4391], now have 1 active actors on pipe
2025-10-02T08:08:03.250188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:03.250199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:03.250253Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:03.250284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 205 reason: error at write: Disconnected sessionId: src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0
2025-10-02T08:08:03.250462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 205 sessionId: src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0 is DEAD
2025-10-02T08:08:03.250495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533176711557167:4391]
2025-10-02T08:08:03.250556Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:03.250632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:03.250643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0] Write session will restart in 0.008883s
2025-10-02T08:08:03.250668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0] Write session: Do CDS request
2025-10-02T08:08:03.250675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:03.260529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.260534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:03.260550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 206
2025-10-02T08:08:03.260889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.260924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:03.260934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:03.260938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:03.261326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 206 sessionId:  describe result for acl check
2025-10-02T08:08:03.261378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:03.261388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:03.261389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:03.261394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533176711557612:4408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:03.261970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533176711557612:4408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:03.264974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533176711557612:4408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:03.266918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:03.268049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:03.268223Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:03.268230Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:03.268237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:03.268268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533176711557612:4408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:03.268270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:03.268281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533176711557612:4408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:03.268285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533176711557612:4408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:03.268293Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533176711557767:4407]
2025-10-02T08:08:03.268294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:03.268771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:03.268954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:03.269000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:03.269271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:03.269311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.269315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.269316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.269317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.269318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.269321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.269329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.269331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.269333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.269335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.269338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.269342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.269346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.269349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.269352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.269355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.269357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.269360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.269367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.269370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.269384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:03.277877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:03.279651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:03.279679Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:03.279683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:03.279688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:03.279696Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 205 [1:7556533176711557767:4407]
2025-10-02T08:08:03.279710Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:03.279730Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:03.279739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.279743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.279751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.279769Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:03.279780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:03.279790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:03.279865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.279874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.279877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:03.279880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:03.279951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:03.279962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.279976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.279988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:03.280007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711557772:4408], now have 1 active actors on pipe
2025-10-02T08:08:03.280017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533176711557761:4407]
2025-10-02T08:08:03.280019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533176711557761:4407]
2025-10-02T08:08:03.280025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:03.280028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 205
2025-10-02T08:08:03.280035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533177171954530:2378], now have 1 active actors on pipe
2025-10-02T08:08:03.280037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:03.280039Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:03.280041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:03.280049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:03.280051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:03.280057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.280060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.280108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533176711557761:4407]
2025-10-02T08:08:03.280120Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:03.280131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:03.280132Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d114775e-18459368-3b31b43-a61adc1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:03.280136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.280139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.280140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:03.280148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.280155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:03.280126Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 205
2025-10-02T08:08:03.280185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.280262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.280268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.280278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.280309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 206 partition: 0 MaxSeqNo: 17 sessionId: src_id|d114775e-18459368-3b31b43-a61adc1f_0
2025-10-02T08:08:03.280686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1098d1-bea7eefe-adbafbb3-bf6f8f2b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d114775e-18459368-3b31b43-a61adc1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:03.283323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d114775e-18459368-3b31b43-a61adc1f_0] Write session: try to update token
2025-10-02T08:08:03.283347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d114775e-18459368-3b31b43-a61adc1f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:03.298713Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:03.298735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:03.298738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:03.298747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533176711557761:4407]
2025-10-02T08:08:03.298752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533176711557761:4407]
2025-10-02T08:08:03.298795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:03.298799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:03.298803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.298804Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:03.298806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:03.298972Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:03.300712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId: src_id|d114775e-18459368-3b31b43-a61adc1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:03.303789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:03.356424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533176711557813:4391]
2025-10-02T08:08:03.358713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 205, pipe: [1:7556533176711557813:4391]
2025-10-02T08:08:03.436513Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:03.436816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.436831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.436865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711557813:4391], now have 1 active actors on pipe
2025-10-02T08:08:03.436971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:03.436988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:03.437062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 206 reason: error at write: Disconnected sessionId: src_id|d114775e-18459368-3b31b43-a61adc1f_0
2025-10-02T08:08:03.437120Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:03.437274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 206 sessionId: src_id|d114775e-18459368-3b31b43-a61adc1f_0 is DEAD
2025-10-02T08:08:03.437365Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:03.437437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d114775e-18459368-3b31b43-a61adc1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:03.437452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d114775e-18459368-3b31b43-a61adc1f_0] Write session will restart in 0.005745s
2025-10-02T08:08:03.437481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d114775e-18459368-3b31b43-a61adc1f_0] Write session: Do CDS request
2025-10-02T08:08:03.437470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533176711557813:4391]
2025-10-02T08:08:03.437488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d114775e-18459368-3b31b43-a61adc1f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:03.444398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d114775e-18459368-3b31b43-a61adc1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.444605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:03.444621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 207
2025-10-02T08:08:03.444797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.444858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:03.444867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:03.444871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:03.445286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 207 sessionId:  describe result for acl check
2025-10-02T08:08:03.445318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:03.445324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:03.445325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:03.445331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533176711558181:4425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:03.445849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533176711558181:4425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:03.448254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533176711558181:4425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:03.451972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533176711558181:4425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:03.451989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533176711558181:4425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:03.451993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533176711558181:4425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:03.452000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:03.452961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:03.454281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:03.454468Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:03.454476Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:03.454485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:03.454521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:03.454572Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533176711558443:4424]
2025-10-02T08:08:03.455017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:03.455152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:03.455190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:03.455394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:03.455425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.455429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.455430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.455430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.455431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.455435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.455444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.455448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.455451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.455455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.455459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.455467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.455472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.455475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.455477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.455480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.455482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.455485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.455487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.455490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.455501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:03.463357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:03.465237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:03.465254Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:03.465256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:03.465259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:03.465265Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 206 [1:7556533176711558443:4424]
2025-10-02T08:08:03.465277Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:03.465293Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:03.465295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.465299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.465301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.465315Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:03.465319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:03.465325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:03.465385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.465392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.465395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:03.465397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:03.465458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:03.465471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.465483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.465493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:03.465510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711558422:4425], now have 1 active actors on pipe
2025-10-02T08:08:03.465516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533177171954538:2378], now have 1 active actors on pipe
2025-10-02T08:08:03.465516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 206
2025-10-02T08:08:03.465522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533176711558437:4424]
2025-10-02T08:08:03.465524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533176711558437:4424]
2025-10-02T08:08:03.465534Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:03.465544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:03.465549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.465551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:03.465554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.465569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:03.465588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:03.465596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:03.465594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 206
2025-10-02T08:08:03.465638Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32ded536-3bbfa190-dbede934-dc7860ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:03.465651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.465654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.465656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:03.465666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.465675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:03.465682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533176711558437:4424]
2025-10-02T08:08:03.465692Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:03.465698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:03.465718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.465765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.465771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.465784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.465822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 207 partition: 0 MaxSeqNo: 17 sessionId: src_id|32ded536-3bbfa190-dbede934-dc7860ef_0
2025-10-02T08:08:03.466198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d114775e-18459368-3b31b43-a61adc1f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32ded536-3bbfa190-dbede934-dc7860ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:03.468664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ded536-3bbfa190-dbede934-dc7860ef_0] Write session: try to update token
2025-10-02T08:08:03.468681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ded536-3bbfa190-dbede934-dc7860ef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:03.482423Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:03.482442Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:03.482445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:03.482454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533176711558437:4424]
2025-10-02T08:08:03.482459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533176711558437:4424]
2025-10-02T08:08:03.482500Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:03.482503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:03.482509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.482511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:03.482515Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:03.482661Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:03.483078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId: src_id|32ded536-3bbfa190-dbede934-dc7860ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:03.486340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:03.537730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533176711558475:4391]
2025-10-02T08:08:03.537825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 206, pipe: [1:7556533176711558475:4391]
2025-10-02T08:08:03.614959Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:03.615350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.615361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.615392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711558475:4391], now have 1 active actors on pipe
2025-10-02T08:08:03.615450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:03.615455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:03.615494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 207 reason: error at write: Disconnected sessionId: src_id|32ded536-3bbfa190-dbede934-dc7860ef_0
2025-10-02T08:08:03.615591Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:03.615616Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:03.615668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 207 sessionId: src_id|32ded536-3bbfa190-dbede934-dc7860ef_0 is DEAD
2025-10-02T08:08:03.615762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533176711558475:4391]
2025-10-02T08:08:03.615905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ded536-3bbfa190-dbede934-dc7860ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:03.615921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ded536-3bbfa190-dbede934-dc7860ef_0] Write session will restart in 0.008608s
2025-10-02T08:08:03.615950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ded536-3bbfa190-dbede934-dc7860ef_0] Write session: Do CDS request
2025-10-02T08:08:03.615958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ded536-3bbfa190-dbede934-dc7860ef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:03.625263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ded536-3bbfa190-dbede934-dc7860ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.625465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:03.625481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 208
2025-10-02T08:08:03.625664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.625699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:03.625709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:03.625717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:03.626100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 208 sessionId:  describe result for acl check
2025-10-02T08:08:03.626133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:03.626142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:03.626144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:03.626149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533176711558900:4433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:03.626672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533176711558900:4433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:03.629481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533176711558900:4433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:03.631466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:03.632299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:03.632461Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:03.632470Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:03.632478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:03.632517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533176711558900:4433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:03.632522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:03.632530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533176711558900:4433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:03.632533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533176711558900:4433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:03.632540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:03.632549Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533176711559079:4432]
2025-10-02T08:08:03.633125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:03.633274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:03.633313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:03.633581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:03.633617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.633622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.633623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.633624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.633625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.633629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.633639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.633646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.633650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.633657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.633662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.633672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.633681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.633685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.633693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.633698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.633705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.633710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.633717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.633723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.633744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:03.641897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:03.643696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:03.643715Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:03.643718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:03.643721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:03.643728Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 207 [1:7556533176711559079:4432]
2025-10-02T08:08:03.643741Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:03.643762Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:03.643765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.643767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.643769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.643786Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:03.643790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:03.643796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:03.643867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.643875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.643878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:03.643881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:03.643949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:03.643956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.643969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.643981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:03.644003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711559084:4433], now have 1 active actors on pipe
2025-10-02T08:08:03.644014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533176711559073:4432]
2025-10-02T08:08:03.644021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533176711559073:4432]
2025-10-02T08:08:03.644030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:03.644037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 207
2025-10-02T08:08:03.644040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:03.644043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:03.644045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:03.644058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:03.644065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:03.644071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533177171954567:2378], now have 1 active actors on pipe
2025-10-02T08:08:03.644075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.644087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.644128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533176711559073:4432]
2025-10-02T08:08:03.644135Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:03.644141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:03.644121Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 207
2025-10-02T08:08:03.644155Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:03.644165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.644168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.644175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:03.644183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.644196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:03.644241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.644308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.644314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.644326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.644362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 208 partition: 0 MaxSeqNo: 17 sessionId: src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0
2025-10-02T08:08:03.644776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ded536-3bbfa190-dbede934-dc7860ef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:03.647434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0] Write session: try to update token
2025-10-02T08:08:03.647460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:03.661966Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:03.661994Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:03.661997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:03.662006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533176711559073:4432]
2025-10-02T08:08:03.662011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533176711559073:4432]
2025-10-02T08:08:03.662053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:03.662055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:03.662064Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:03.662065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.662067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:03.662224Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:03.662691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId: src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:03.665713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:03.716004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533176711559111:4391]
2025-10-02T08:08:03.716169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 207, pipe: [1:7556533176711559111:4391]
2025-10-02T08:08:03.816754Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:03.817295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.817312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.817357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711559111:4391], now have 1 active actors on pipe
2025-10-02T08:08:03.817552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533176711559111:4391]
2025-10-02T08:08:03.817581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:03.817584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:03.817616Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:03.817681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 208 reason: error at write: Disconnected sessionId: src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0
2025-10-02T08:08:03.817901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 208 sessionId: src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0 is DEAD
2025-10-02T08:08:03.818118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:03.818131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0] Write session will restart in 0.008227s
2025-10-02T08:08:03.818156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0] Write session: Do CDS request
2025-10-02T08:08:03.818166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:03.820899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:03.827513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.827613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:03.827630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 209
2025-10-02T08:08:03.827875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:03.827907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:03.827917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:03.827920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:03.828361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 209 sessionId:  describe result for acl check
2025-10-02T08:08:03.828393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:03.828399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:03.828401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:03.828407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533176711559486:4440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:03.829053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533176711559486:4440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:03.831958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533176711559486:4440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:03.836507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533176711559486:4440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:03.836522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533176711559486:4440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:03.836525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533176711559486:4440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:03.836531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:03.837333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:03.838580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:03.838836Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:03.838844Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:03.838854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:03.838906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:03.838941Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533176711559724:4439]
2025-10-02T08:08:03.839547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:03.839751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:03.839793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:03.840057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:03.840106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.840112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.840113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.840114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.840115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.840120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.840130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.840132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.840134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.840136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.840140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.840144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:03.840148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.840151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:03.840154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.840156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:03.840158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.840161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.840165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.840168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.840180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:03.848185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:03.850279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:03.850298Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:03.850301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:03.850304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:03.850310Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 208 [1:7556533176711559724:4439]
2025-10-02T08:08:03.850321Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:03.850339Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:03.850342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.850345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.850347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.850361Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:03.850366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:03.850371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:03.850435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.850445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.850448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:03.850450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:03.850519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:03.850527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.850540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:03.850556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:03.850568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 208
2025-10-02T08:08:03.850578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711559705:4440], now have 1 active actors on pipe
2025-10-02T08:08:03.850583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533176711559718:4439]
2025-10-02T08:08:03.850586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533176711559718:4439]
2025-10-02T08:08:03.850592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:03.850602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533177171954576:2378], now have 1 active actors on pipe
2025-10-02T08:08:03.850608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:03.850611Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:03.850611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.850615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.850632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:03.850649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:03.850656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:03.850694Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df543fed-aecc4279-3a29c0df-a7412965_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:03.850704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:03.850707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:03.850709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:03.850719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:03.850732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:03.850743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533176711559718:4439]
2025-10-02T08:08:03.850693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 208
2025-10-02T08:08:03.850754Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:03.850770Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:03.850787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.850864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:03.850871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:03.850887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:03.850926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 209 partition: 0 MaxSeqNo: 17 sessionId: src_id|df543fed-aecc4279-3a29c0df-a7412965_0
2025-10-02T08:08:03.851318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe98b6f1-4eaeef92-a70fe9a9-7423b324_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df543fed-aecc4279-3a29c0df-a7412965_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:03.864454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df543fed-aecc4279-3a29c0df-a7412965_0] Write session: try to update token
2025-10-02T08:08:03.864477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df543fed-aecc4279-3a29c0df-a7412965_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:03.876214Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:03.876235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:03.876237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:03.876246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533176711559718:4439]
2025-10-02T08:08:03.876250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533176711559718:4439]
2025-10-02T08:08:03.876293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:03.876299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:03.876302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:03.876308Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:03.876328Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:03.876445Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:03.880266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId: src_id|df543fed-aecc4279-3a29c0df-a7412965_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:03.893015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:03.917632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533176711559750:4391]
2025-10-02T08:08:03.917769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 208, pipe: [1:7556533176711559750:4391]
2025-10-02T08:08:04.014170Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:04.014631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.014646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.014666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533176711559750:4391], now have 1 active actors on pipe
2025-10-02T08:08:04.014775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:04.014797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:04.014855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 209 reason: error at write: Disconnected sessionId: src_id|df543fed-aecc4279-3a29c0df-a7412965_0
2025-10-02T08:08:04.014886Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:04.014861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:04.015033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 209 sessionId: src_id|df543fed-aecc4279-3a29c0df-a7412965_0 is DEAD
2025-10-02T08:08:04.015159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533176711559750:4391]
2025-10-02T08:08:04.015187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df543fed-aecc4279-3a29c0df-a7412965_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:04.015201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df543fed-aecc4279-3a29c0df-a7412965_0] Write session will restart in 0.009650s
2025-10-02T08:08:04.015228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df543fed-aecc4279-3a29c0df-a7412965_0] Write session: Do CDS request
2025-10-02T08:08:04.015235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df543fed-aecc4279-3a29c0df-a7412965_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:04.026440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df543fed-aecc4279-3a29c0df-a7412965_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.026527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:04.026543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 210
2025-10-02T08:08:04.026786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.026831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:04.026840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:04.026844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:04.027262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 210 sessionId:  describe result for acl check
2025-10-02T08:08:04.027292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:04.027297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:04.027298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:04.027303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533181006527528:4446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:04.027820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533181006527528:4446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:04.031420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533181006527528:4446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:04.032877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:04.034761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:04.035004Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:04.035014Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:04.035018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533181006527528:4446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:04.035023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:04.035027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533181006527528:4446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:04.035030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533181006527528:4446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:04.035038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:04.035072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:04.035120Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533181006527654:4445]
2025-10-02T08:08:04.035721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:04.035901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:04.035940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:04.036245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:04.036300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.036316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.036317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.036318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.036319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.036324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.036333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.036346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.036349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.036352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.036357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.036364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.036370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.036374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.036378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.036382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.036386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.036391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.036396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.036400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.036416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:04.045300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:04.046976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:04.046994Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:04.046997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:04.047000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:04.047005Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 209 [1:7556533181006527654:4445]
2025-10-02T08:08:04.047015Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:04.047028Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:04.047030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.047033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.047034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.047045Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:04.047049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:04.047055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:04.047102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.047108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.047111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:04.047112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:04.047167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:04.047173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.047181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.047189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:04.047204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533181006527648:4445]
2025-10-02T08:08:04.047210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533181006527648:4445]
2025-10-02T08:08:04.047217Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:04.047222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 209
2025-10-02T08:08:04.047224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:04.047226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006527659:4446], now have 1 active actors on pipe
2025-10-02T08:08:04.047227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:04.047233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:04.047245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:04.047248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:04.047255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533181466921877:2378], now have 1 active actors on pipe
2025-10-02T08:08:04.047259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.047268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.047307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533181006527648:4445]
2025-10-02T08:08:04.047316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:04.047318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:04.047329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4131e30d-956059ff-d16916ca-6bee099b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:04.047292Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 209
2025-10-02T08:08:04.047336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.047339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.047341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:04.047349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.047355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:04.047390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.047868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.047879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.047895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.047931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 210 partition: 0 MaxSeqNo: 17 sessionId: src_id|4131e30d-956059ff-d16916ca-6bee099b_0
2025-10-02T08:08:04.048421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df543fed-aecc4279-3a29c0df-a7412965_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4131e30d-956059ff-d16916ca-6bee099b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:04.050946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4131e30d-956059ff-d16916ca-6bee099b_0] Write session: try to update token
2025-10-02T08:08:04.050968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4131e30d-956059ff-d16916ca-6bee099b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:04.065497Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:04.065519Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:04.065522Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:04.065531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533181006527648:4445]
2025-10-02T08:08:04.065535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533181006527648:4445]
2025-10-02T08:08:04.065580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:04.065582Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:04.065586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.065589Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:04.065589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:04.065743Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:04.068490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId: src_id|4131e30d-956059ff-d16916ca-6bee099b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:04.071326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:04.115300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533181006527685:4391]
2025-10-02T08:08:04.115531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 209, pipe: [1:7556533181006527685:4391]
2025-10-02T08:08:04.211517Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:04.212019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.212039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.212088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006527685:4391], now have 1 active actors on pipe
2025-10-02T08:08:04.212237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:04.212250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:04.212299Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:04.212332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 210 reason: error at write: Disconnected sessionId: src_id|4131e30d-956059ff-d16916ca-6bee099b_0
2025-10-02T08:08:04.212529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 210 sessionId: src_id|4131e30d-956059ff-d16916ca-6bee099b_0 is DEAD
2025-10-02T08:08:04.212599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533181006527685:4391]
2025-10-02T08:08:04.212716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4131e30d-956059ff-d16916ca-6bee099b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:04.212732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4131e30d-956059ff-d16916ca-6bee099b_0] Write session will restart in 0.005058s
2025-10-02T08:08:04.212761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4131e30d-956059ff-d16916ca-6bee099b_0] Write session: Do CDS request
2025-10-02T08:08:04.212771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4131e30d-956059ff-d16916ca-6bee099b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:04.212921Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:04.219355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4131e30d-956059ff-d16916ca-6bee099b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.219828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:04.219848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 211
2025-10-02T08:08:04.220003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.220046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:04.220056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:04.220059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:04.220455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 211 sessionId:  describe result for acl check
2025-10-02T08:08:04.220486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:04.220492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:04.220493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:04.220499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533181006527735:4453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:04.221037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533181006527735:4453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:04.233567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533181006527735:4453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:04.239777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533181006527735:4453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:04.239796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533181006527735:4453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:04.239799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533181006527735:4453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:04.239808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:04.252945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:04.262805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:04.263063Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:04.263076Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:04.263087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:04.263151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:04.263192Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533181006528314:4452]
2025-10-02T08:08:04.263780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:04.264120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:04.264175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:04.264516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:04.264582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.264590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.264591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.264593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.264594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.264600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.264612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.264616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.264620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.264625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.264631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.264640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.264646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.264652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.264657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.264662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.264667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.264673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.264677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.264683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.264703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:04.274727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:04.276294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:04.276315Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:04.276318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:04.276322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:04.276329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 210 [1:7556533181006528314:4452]
2025-10-02T08:08:04.276343Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:04.276362Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:04.276375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.276378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.276381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.276396Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:04.276400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:04.276407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:04.276471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.276473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.276476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:04.276479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:04.276785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:04.276787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.276829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.276843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:04.276861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533181006528308:4452]
2025-10-02T08:08:04.276863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533181006528308:4452]
2025-10-02T08:08:04.276880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:04.276895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:04.276910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:04.276913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:04.276937Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:04.276941Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:04.276959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533181006528308:4452]
2025-10-02T08:08:04.276962Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:04.277006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 210
2025-10-02T08:08:04.277017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006528007:4453], now have 1 active actors on pipe
2025-10-02T08:08:04.277025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.277029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:04.277029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.277051Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:04.277057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.277060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.277061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:04.277069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.277078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:04.277085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533181466921896:2378], now have 1 active actors on pipe
2025-10-02T08:08:04.277094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.277126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.277128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.277137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.277161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 211 partition: 0 MaxSeqNo: 17 sessionId: src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0
2025-10-02T08:08:04.277736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4131e30d-956059ff-d16916ca-6bee099b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:04.280661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0] Write session: try to update token
2025-10-02T08:08:04.280685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:04.280981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 210
2025-10-02T08:08:04.294962Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:04.294984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:04.294987Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:04.294996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533181006528308:4452]
2025-10-02T08:08:04.295000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533181006528308:4452]
2025-10-02T08:08:04.295047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:04.295058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.295061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:04.295212Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:04.295773Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:04.295786Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:04.303682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId: src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:04.306506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:04.311363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533181006528338:4391]
2025-10-02T08:08:04.311438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 210, pipe: [1:7556533181006528338:4391]
2025-10-02T08:08:04.432170Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:04.432637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.432652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.432688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006528338:4391], now have 1 active actors on pipe
2025-10-02T08:08:04.432797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533181006528338:4391]
2025-10-02T08:08:04.432836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:04.432837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:04.432874Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:04.432890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 211 reason: error at write: Disconnected sessionId: src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0
2025-10-02T08:08:04.432927Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:04.433037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 211 sessionId: src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0 is DEAD
2025-10-02T08:08:04.433231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:04.433240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0] Write session will restart in 0.005779s
2025-10-02T08:08:04.433269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0] Write session: Do CDS request
2025-10-02T08:08:04.433277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:04.440460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.440594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:04.440610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 212
2025-10-02T08:08:04.440782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.440824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:04.440832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:04.440835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:04.441278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 212 sessionId:  describe result for acl check
2025-10-02T08:08:04.441309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:04.441311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:04.441312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:04.441317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533181006528686:4472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:04.441777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533181006528686:4472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:04.443838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533181006528686:4472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:04.446899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533181006528686:4472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:04.446915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533181006528686:4472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:04.446918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533181006528686:4472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:04.446925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:04.455821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:04.457116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:04.457310Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:04.457318Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:04.457327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:04.457372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:04.457410Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533181006528997:4471]
2025-10-02T08:08:04.458037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:04.458228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:04.458268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:04.458568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:04.458612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.458618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.458619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.458620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.458622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.458627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.458637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.458641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.458645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.458649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.458660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.458666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.458672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.458681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.458685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.458693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.458697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.458703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.458712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.458717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.458739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:04.466579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:04.468571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:04.468588Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:04.468591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:04.468594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:04.468601Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 211 [1:7556533181006528997:4471]
2025-10-02T08:08:04.468613Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:04.468629Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:04.468632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.468634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.468636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.468650Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:04.468655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:04.468663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:04.468725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.468732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.468735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:04.468737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:04.468820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:04.468828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.468842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.468855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:04.468874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006528763:4472], now have 1 active actors on pipe
2025-10-02T08:08:04.468883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533181466921905:2378], now have 1 active actors on pipe
2025-10-02T08:08:04.468888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533181006528991:4471]
2025-10-02T08:08:04.468891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533181006528991:4471]
2025-10-02T08:08:04.468904Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:04.468920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.468927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.468944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:04.468963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:04.468966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:04.468991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:04.469004Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:04.468969Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 211
2025-10-02T08:08:04.469009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.469013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.469015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:04.469018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:04.469023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.469030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:04.469038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533181006528991:4471]
2025-10-02T08:08:04.469041Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:04.469045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:04.469065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.469144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 211
2025-10-02T08:08:04.469195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.469209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.469236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.469292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 212 partition: 0 MaxSeqNo: 17 sessionId: src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0
2025-10-02T08:08:04.469743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3bbb25c-52ac16fa-a217202b-4033ab15_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:04.472616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0] Write session: try to update token
2025-10-02T08:08:04.472638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:04.487648Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:04.487668Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:04.487678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533181006528991:4471]
2025-10-02T08:08:04.487723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:04.487733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:04.487903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:04.488051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.488213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.488345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.488522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:04.488560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:04.490097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId: src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:04.493022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:04.493103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.493116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.493151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:04.493177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:04.493211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.493221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.493393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.493455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.493517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.493576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.493635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.493643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.493705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.493757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.493812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.493874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.493913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.493918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.493978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.494031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.494086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.494141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.494183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.494189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.494244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.494330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.494390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.494459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.494498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.494504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.494558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.494615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.494673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.494731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.494788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.494793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.494849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.494901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.494953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.495006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.495126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.495132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.495191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.495244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.495301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.495352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.495413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.495419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.495475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.495525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.495581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.495638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.495681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.495689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.495753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.495820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.495876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.495930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.495973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.495977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.496032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.496113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.496168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.496225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.496281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.496286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.496330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:04.496374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.496389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.496391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:04.496412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:04.496425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:04.496430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:04.496432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:04.496433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:04.496867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:04.496891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:04.496898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:04.496905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:04.496908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:04.496911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:04.497502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:04.497521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:04.497528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:04.497533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:04.497536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:04.497538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:04.498038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:04.498057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:04.498064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:04.498067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:04.498072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:04.500063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:04.500089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:04.500099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392484499
2025-10-02T08:08:04.500256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:04.500268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:04.500272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:04.500276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:04.500280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:04.500282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:04.500678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:04.500697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:04.500707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:04.500710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:04.500717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:04.500719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:04.501218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:04.501240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:04.501250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:04.501257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:04.501259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:04.501263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:04.501745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:04.501764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:04.501770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:04.502778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:04.502794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:04.502799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:04.502802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:04.502811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392484502
2025-10-02T08:08:04.503095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:04.503113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:04.503119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:04.503121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:04.503123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:04.503127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:04.503602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:04.503622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:04.503626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:04.503628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:04.503631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:04.503633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:04.504070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:04.504098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.504171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392484503
2025-10-02T08:08:04.506536Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:04.506557Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:04.506561Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:04.506566Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:04.506574Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:04.506575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:04.506577Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:04.506583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533181006528991:4471]
2025-10-02T08:08:04.506593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533181006528991:4471]
2025-10-02T08:08:04.506637Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:04.506649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:04.506651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:04.506652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.506653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:04.506774Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:04.533081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533181006529023:4391]
2025-10-02T08:08:04.533181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 211, pipe: [1:7556533181006529023:4391]
2025-10-02T08:08:04.657132Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:04.657574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006529023:4391], now have 1 active actors on pipe
2025-10-02T08:08:04.657789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:04.657801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:04.657828Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:04.657832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 212 reason: error at write: Disconnected sessionId: src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0
2025-10-02T08:08:04.658047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 212 sessionId: src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0 is DEAD
2025-10-02T08:08:04.658205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533181006529023:4391]
2025-10-02T08:08:04.658446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:04.658458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0] Write session will restart in 0.009693s
2025-10-02T08:08:04.658498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0] Write session: Do CDS request
2025-10-02T08:08:04.658506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:04.660923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:04.662668Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [4a1bd1396074fe18] Result# TEvPutResult {Id# [72075186224037892:211:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:04.662747Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:211:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:04.662900Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:211:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:04.673376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.673811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:04.673830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 213
2025-10-02T08:08:04.676969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.677034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:04.677040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:04.677044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:04.677457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 213 sessionId:  describe result for acl check
2025-10-02T08:08:04.677484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:04.677485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:04.677487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:04.677492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533181006529396:4480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:04.678007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533181006529396:4480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:04.689346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533181006529396:4480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:04.690913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:04.693669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:04.694071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533181006529396:4480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:04.694075Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:04.694078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533181006529396:4480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:04.694079Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:04.694081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533181006529396:4480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:04.694089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:04.694091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:04.694148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:04.694181Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533181006529648:4479]
2025-10-02T08:08:04.694840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:04.695085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:04.695134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:04.695441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:04.695506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.695513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.695515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.695516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.695517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.695522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.695533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.695537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.695541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.695545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.695551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.695558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.695564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.695569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.695574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.695579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.695584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.695589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.695602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.695607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.695627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:04.714091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:04.715770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:04.715794Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:04.715797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:04.715802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:04.715810Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 212 [1:7556533181006529648:4479]
2025-10-02T08:08:04.715825Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:04.715848Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:04.715852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.715855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.715858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.715875Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:04.715888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:04.715895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:04.715977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.716415Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 212
2025-10-02T08:08:04.716060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.716068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:04.716083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:04.716161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:04.716165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.716179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.716191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:04.716209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533181006529642:4479]
2025-10-02T08:08:04.716211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533181006529642:4479]
2025-10-02T08:08:04.716219Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:04.716230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 212
2025-10-02T08:08:04.716232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:04.716235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006529653:4480], now have 1 active actors on pipe
2025-10-02T08:08:04.716236Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:04.716243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533181466921933:2378], now have 1 active actors on pipe
2025-10-02T08:08:04.716249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:04.716267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:04.716271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:04.716279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.716284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.716330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533181006529642:4479]
2025-10-02T08:08:04.716344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:04.716364Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:04.716370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.716374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.716376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:04.716386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.716388Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:04.716396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:04.716766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.716992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.717003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.717020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.717058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 213 partition: 0 MaxSeqNo: 17 sessionId: src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0
2025-10-02T08:08:04.717506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48750666-8aaaa8f2-f81ef7b4-7dc0cd99_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:04.720703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0] Write session: try to update token
2025-10-02T08:08:04.720721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:04.731196Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:04.731219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:04.731229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533181006529642:4479]
2025-10-02T08:08:04.731282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:04.731290Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:04.731475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:04.731626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.731766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.731907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.732232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:04.732276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:04.739939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId: src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:04.743210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:04.743628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.743644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.743678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:04.743708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:04.743772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.743774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.743947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.744016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.744098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.744160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.744277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.744282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.744350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.744409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.744484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.744546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.744590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.744594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.744663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.744722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.744787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.744871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.744919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.744922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.744991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.745057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.745125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.745189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.745265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.745268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.745337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.745401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.745468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.745533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.745575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.745578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.745647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.745711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.745774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.745838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.745904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.745907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.745975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.746037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.746109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.746177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.746230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.746232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.746304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.746361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.746422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.746487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.746535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.746538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.746606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.746665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.746731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.746792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.746838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.746843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.746913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:04.746979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:04.747046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:04.747111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:04.747154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:04.747156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:04.747200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:04.747260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.747279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.747282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:04.747314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:04.747328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:04.747331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:04.747337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:04.747339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:04.747777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:04.747795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:04.747801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:04.747805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:04.747808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:04.747811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:04.748489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:04.748507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:04.748514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:04.748518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:04.748521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:04.748525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:04.749976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:04.750006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:04.750013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:04.750018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:04.750022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:04.751341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:04.751351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:04.751366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392484750
2025-10-02T08:08:04.751522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:04.751532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:04.751538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:04.751541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:04.751545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:04.751548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:04.752097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:04.752113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:04.752118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:04.752122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:04.752125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:04.752128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:04.752722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:04.752736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:04.752746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:04.752750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:04.752754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:04.752757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:04.753521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:04.753550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:04.753556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:04.754782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:04.754789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:04.754796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:04.754801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:04.754811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392484753
2025-10-02T08:08:04.755136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:04.755149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:04.755155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:04.755157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:04.755161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:04.755166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:04.755676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:04.755691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:04.755696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:04.755701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:04.755704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:04.755708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:04.756272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:04.756286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.756396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392484755
2025-10-02T08:08:04.757347Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:04.757372Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:04.757379Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:04.757386Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:04.759096Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:04.759099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:04.759100Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:04.759111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533181006529642:4479]
2025-10-02T08:08:04.759116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533181006529642:4479]
2025-10-02T08:08:04.759182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:04.759186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.759188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:04.759319Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:04.759994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533181006529684:4391]
2025-10-02T08:08:04.760132Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:04.760142Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:04.761355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 212, pipe: [1:7556533181006529684:4391]
2025-10-02T08:08:04.931587Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:04.932000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006529684:4391], now have 1 active actors on pipe
2025-10-02T08:08:04.932296Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:04.933109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:04.933128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0] Write session will restart in 0.009851s
2025-10-02T08:08:04.933159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0] Write session: Do CDS request
2025-10-02T08:08:04.933172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:04.932302Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:04.932338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533181006529684:4391]
2025-10-02T08:08:04.932357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:04.932405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0
2025-10-02T08:08:04.932635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 213 sessionId: src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0 is DEAD
2025-10-02T08:08:04.949341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.949518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:04.949546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 214
2025-10-02T08:08:04.949988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:04.950036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:04.950048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:04.950052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:04.951464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 214 sessionId:  describe result for acl check
2025-10-02T08:08:04.951511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:04.951513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:04.951515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:04.951521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533181006530176:4487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:04.952173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533181006530176:4487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:04.956791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533181006530176:4487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:04.958589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:04.959338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:04.959508Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:04.959518Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:04.959538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:04.959586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:04.959623Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533181006530307:4486]
2025-10-02T08:08:04.960262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:04.960403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533181006530176:4487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:04.960420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533181006530176:4487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:04.960424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533181006530176:4487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:04.960433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:04.960498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:04.960570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:04.960914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:04.960970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.960976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.960977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.960978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.960979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.960985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.960995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.960999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.961002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.961006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.961012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.961021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:04.961032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.961037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:04.961046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.961051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:04.961055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.961060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.961064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.961069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.961087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:04.969816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:04.971633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:04.971653Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:04.971656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:04.971659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:04.971665Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 213 [1:7556533181006530307:4486]
2025-10-02T08:08:04.971678Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:04.971698Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:04.971704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.971707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.971710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.971725Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:04.971736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:04.971747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:04.971815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.971822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.971825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:04.971828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:04.971901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:04.971907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:04.971921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:04.971937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:04.971959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533181006530316:4487], now have 1 active actors on pipe
2025-10-02T08:08:04.971961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 213
2025-10-02T08:08:04.971966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533181466921941:2378], now have 1 active actors on pipe
2025-10-02T08:08:04.971972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533181006530299:4486]
2025-10-02T08:08:04.971974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533181006530299:4486]
2025-10-02T08:08:04.971986Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:04.972002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:04.972003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.972005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:04.972008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.972026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:04.972039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:04.972042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:04.972047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 213
2025-10-02T08:08:04.972099Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:04.972110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:04.972114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:04.972115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:04.972125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:04.972133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:04.972141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533181006530299:4486]
2025-10-02T08:08:04.972146Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:04.972160Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:04.972181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.972268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:04.972276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:04.972291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:04.972347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 214 partition: 0 MaxSeqNo: 17 sessionId: src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0
2025-10-02T08:08:04.973153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748f2259-4dc9f550-6e76bed1-a01f1ee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:04.976297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0] Write session: try to update token
2025-10-02T08:08:04.976322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:04.988972Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:04.988997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:04.989007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533181006530299:4486]
2025-10-02T08:08:04.989053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:04.989076Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:04.989234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:04.989387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.989540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.989696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:04.989901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:04.989950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:04.998103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId: src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:05.001327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:05.001591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.001608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.001646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:05.001674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:05.001725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.001745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.001931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.002031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.002101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.002178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.002231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.002238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.002305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.002372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.002437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.002504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.002551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.002558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.002627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.002706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.002777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.002846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.002891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.002898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.002964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.003028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.003093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.003161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.003213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.003220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.003289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.003352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.003417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.003480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.003523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.003529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.003594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.003654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.003714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.003774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.003818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.003824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.003887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.003944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.004008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.004081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.004129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.004135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.004203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.004275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.004343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.004409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.004459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.004466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.004533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.004590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.004657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.004733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.004783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.004786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.005072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:05.005137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:05.005207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:05.005290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:05.005355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:05.005361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:05.005416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:05.005482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.005504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.005507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:05.005539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:05.005551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:05.005554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:05.005557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:05.005561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:05.005998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:05.006024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:05.006031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:05.006035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:05.006038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:05.006041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:05.006681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:05.006707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:05.006713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:05.006716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:05.006720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:05.006723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:05.007440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:05.007462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:05.007468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:05.007471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:05.007473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:05.012383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:05.012414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:05.012428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392485011
2025-10-02T08:08:05.012566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:05.012579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:05.012586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:05.012589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:05.012593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:05.012596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:05.013359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:05.013392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:05.013398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:05.013406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:05.013410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:05.013413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:05.013886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:05.013907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:05.013915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:05.013922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:05.013925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:05.013928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:05.014469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:05.014490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:05.014494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:05.015739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:05.015762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:05.015767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:05.015771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:05.015779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392485015
2025-10-02T08:08:05.016153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:05.016178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:05.016184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:05.016190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:05.016193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:05.016196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:05.016737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:05.016752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:05.016757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:05.016761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:05.016765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:05.016768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:05.018611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:05.018642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.018758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392485018
2025-10-02T08:08:05.019679Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:05.019706Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:05.019714Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:05.019721Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:05.021472Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:05.021489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:05.021495Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:05.021502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533181006530299:4486]
2025-10-02T08:08:05.021509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533181006530299:4486]
2025-10-02T08:08:05.021572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:05.021577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.021579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:05.021717Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:05.022569Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:05.022575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:05.032561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533185301497641:4391]
2025-10-02T08:08:05.032688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 213, pipe: [1:7556533185301497641:4391]
2025-10-02T08:08:05.178738Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:05.179137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301497641:4391], now have 1 active actors on pipe
2025-10-02T08:08:05.179269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533185301497641:4391]
2025-10-02T08:08:05.179297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:05.179299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:05.179370Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:05.179303Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:05.179326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 214 reason: error at write: Disconnected sessionId: src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0
2025-10-02T08:08:05.179514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 214 sessionId: src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0 is DEAD
2025-10-02T08:08:05.179693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:05.179710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0] Write session will restart in 0.008168s
2025-10-02T08:08:05.179731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0] Write session: Do CDS request
2025-10-02T08:08:05.179737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:05.189297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.189376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:05.189395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 215
2025-10-02T08:08:05.189556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.189587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:05.189595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:05.189598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:05.189977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 215 sessionId:  describe result for acl check
2025-10-02T08:08:05.190007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:05.190013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:05.190014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:05.190019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533185301498104:4494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:05.190462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533185301498104:4494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:05.193288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533185301498104:4494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:05.194927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:05.195951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:05.196138Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:05.196147Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:05.196154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:05.196206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:05.196367Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533185301498272:4493]
2025-10-02T08:08:05.196393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533185301498104:4494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:05.196407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533185301498104:4494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:05.196411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533185301498104:4494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:05.196419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:05.196796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:05.196935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:05.196963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:05.197201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:05.197234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.197239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.197239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.197240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.197241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.197244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.197250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.197253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.197255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.197257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.197260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.197265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.197268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.197271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.197273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.197276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.197278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.197281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.197283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.197286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.197296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:05.206050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:05.207810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:05.207833Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:05.207837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:05.207841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:05.207849Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 214 [1:7556533185301498272:4493]
2025-10-02T08:08:05.207862Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:05.207882Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:05.207890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.207892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.207895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.207912Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:05.207922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:05.207930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:05.208010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.208019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.208023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:05.208025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:05.208112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:05.208119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.208134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.208150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:05.208173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301498277:4494], now have 1 active actors on pipe
2025-10-02T08:08:05.208183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 214
2025-10-02T08:08:05.208185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533185301498266:4493]
2025-10-02T08:08:05.208187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533185301498266:4493]
2025-10-02T08:08:05.208195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:05.208205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:05.208208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:05.208208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533185761889256:2378], now have 1 active actors on pipe
2025-10-02T08:08:05.208215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:05.208228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:05.208231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:05.208238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.208242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.208224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 214
2025-10-02T08:08:05.208283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533185301498266:4493]
2025-10-02T08:08:05.208292Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:05.208299Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:05.208311Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:05.208321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.208331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.208333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:05.208342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.208356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:05.208395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.208485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.208493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.208507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.208547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 215 partition: 0 MaxSeqNo: 17 sessionId: src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0
2025-10-02T08:08:05.208913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9a2fe9-c32a6d03-847bf4ab-add47300_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:05.212051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0] Write session: try to update token
2025-10-02T08:08:05.212082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:05.231556Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:05.231579Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:05.231582Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:05.231592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533185301498266:4493]
2025-10-02T08:08:05.231596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533185301498266:4493]
2025-10-02T08:08:05.231644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:05.231646Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:05.231651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:05.231662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.231665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:05.231821Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:05.236050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId: src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:05.238954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:05.279532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533185301498304:4391]
2025-10-02T08:08:05.279643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 214, pipe: [1:7556533185301498304:4391]
2025-10-02T08:08:05.380395Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:05.380889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.380906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.380944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301498304:4391], now have 1 active actors on pipe
2025-10-02T08:08:05.381045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:05.381055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:05.381127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 215 reason: error at write: Disconnected sessionId: src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0
2025-10-02T08:08:05.381220Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:05.381311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 215 sessionId: src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0 is DEAD
2025-10-02T08:08:05.381492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533185301498304:4391]
2025-10-02T08:08:05.381539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:05.381570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0] Write session will restart in 0.006682s
2025-10-02T08:08:05.381599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0] Write session: Do CDS request
2025-10-02T08:08:05.381610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:05.381673Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:05.389451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.389488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:05.389506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 216
2025-10-02T08:08:05.389719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.389753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:05.389763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:05.389766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:05.390303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 216 sessionId:  describe result for acl check
2025-10-02T08:08:05.390346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:05.390350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:05.390352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:05.390359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533185301498650:4501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:05.390903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533185301498650:4501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:05.393737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533185301498650:4501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:05.399080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:05.400197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:05.400333Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:05.400341Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:05.400347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:05.400378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:05.400404Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533185301498933:4500]
2025-10-02T08:08:05.400638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533185301498650:4501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:05.400650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533185301498650:4501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:05.400653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533185301498650:4501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:05.400659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:05.400857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:05.401040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:05.401083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:05.401299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:05.401329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.401334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.401335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.401336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.401337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.401341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.401351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.401356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.401359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.401362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.401366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.401370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.401373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.401376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.401378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.401381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.401384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.401387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.401390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.401392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.401403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:05.409518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:05.411217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:05.411238Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:05.411240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:05.411244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:05.411250Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 215 [1:7556533185301498933:4500]
2025-10-02T08:08:05.411262Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:05.411278Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:05.411282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.411285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.411287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.411301Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:05.411308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:05.411313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:05.411396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.411405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.411408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:05.411410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:05.411476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:05.411484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.411497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.411509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:05.411524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533185301498927:4500]
2025-10-02T08:08:05.411531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533185301498927:4500]
2025-10-02T08:08:05.411543Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:05.411559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:05.411577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:05.411584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:05.411592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:05.411604Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:05.411616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533185301498927:4500]
2025-10-02T08:08:05.411624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:05.411669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:05.411886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301498938:4501], now have 1 active actors on pipe
2025-10-02T08:08:05.411900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533185761889265:2378], now have 1 active actors on pipe
2025-10-02T08:08:05.411919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 215
2025-10-02T08:08:05.411923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 215
2025-10-02T08:08:05.411987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.412001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.412035Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:05.412052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.412055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.412058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:05.412067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.412087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:05.412113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.412158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.412164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.412177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.412208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 216 partition: 0 MaxSeqNo: 17 sessionId: src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0
2025-10-02T08:08:05.412670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7108589b-4d5139c2-b1056db0-ecdffacc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:05.415581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0] Write session: try to update token
2025-10-02T08:08:05.415602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:05.429865Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:05.429888Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:05.429891Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:05.429900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533185301498927:4500]
2025-10-02T08:08:05.429919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533185301498927:4500]
2025-10-02T08:08:05.429968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:05.429967Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:05.429973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:05.429979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.429982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:05.430142Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:05.458181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId: src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:05.461047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:05.481844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533185301498996:4391]
2025-10-02T08:08:05.481990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 215, pipe: [1:7556533185301498996:4391]
2025-10-02T08:08:05.561988Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:05.562433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.562452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.562470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301498996:4391], now have 1 active actors on pipe
2025-10-02T08:08:05.562594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:05.562611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:05.562660Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:05.562686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 216 reason: error at write: Disconnected sessionId: src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0
2025-10-02T08:08:05.562715Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:05.562876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 216 sessionId: src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0 is DEAD
2025-10-02T08:08:05.562962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533185301498996:4391]
2025-10-02T08:08:05.563034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:05.563048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0] Write session will restart in 0.005206s
2025-10-02T08:08:05.563076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0] Write session: Do CDS request
2025-10-02T08:08:05.563098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:05.569405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.569509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:05.569525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 217
2025-10-02T08:08:05.569706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.569738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:05.569749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:05.569754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:05.570831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 217 sessionId:  describe result for acl check
2025-10-02T08:08:05.570868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:05.570874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:05.570876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:05.570881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533185301499256:4517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:05.571364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533185301499256:4517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:05.573574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533185301499256:4517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:05.576563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533185301499256:4517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:05.576574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533185301499256:4517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:05.576577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533185301499256:4517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:05.576582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:05.582015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:05.582998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:05.583173Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:05.583182Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:05.583189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:05.583221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:05.583251Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533185301499625:4516]
2025-10-02T08:08:05.583719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:05.583891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:05.583938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:05.584154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:05.584183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.584188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.584189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.584189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.584190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.584193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.584201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.584203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.584205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.584207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.584211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.584215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.584219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.584222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.584224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.584227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.584229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.584232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.584235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.584237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.584248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:05.591952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:05.593656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:05.593674Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:05.593675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:05.593677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:05.593682Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 216 [1:7556533185301499625:4516]
2025-10-02T08:08:05.593689Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:05.593700Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:05.593702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.593704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.593705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.593715Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:05.593719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:05.593723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:05.593770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.593777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.593779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:05.593780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:05.593828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:05.593834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.593843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.593849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:05.593865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533185301499619:4516]
2025-10-02T08:08:05.593869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533185301499619:4516]
2025-10-02T08:08:05.593875Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:05.593883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:05.593890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:05.593895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:05.593899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 216
2025-10-02T08:08:05.593902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301499462:4517], now have 1 active actors on pipe
2025-10-02T08:08:05.593905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533185761889271:2378], now have 1 active actors on pipe
2025-10-02T08:08:05.593913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:05.593915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:05.593928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533185301499619:4516]
2025-10-02T08:08:05.593930Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:05.593932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:05.593937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.593941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.593986Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eeef5c83-4868d633-5650e321-16c263b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:05.593996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.593999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.594000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:05.594006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.594013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:05.594031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.594002Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 216
2025-10-02T08:08:05.594070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.594077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.594088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.594119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 217 partition: 0 MaxSeqNo: 17 sessionId: src_id|eeef5c83-4868d633-5650e321-16c263b_0
2025-10-02T08:08:05.594473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e5c8d15-9ad7dce-a8999e1a-fa5c2386_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eeef5c83-4868d633-5650e321-16c263b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:05.597092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef5c83-4868d633-5650e321-16c263b_0] Write session: try to update token
2025-10-02T08:08:05.597113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef5c83-4868d633-5650e321-16c263b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:05.611096Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:05.611121Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:05.611124Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:05.611131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533185301499619:4516]
2025-10-02T08:08:05.611134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533185301499619:4516]
2025-10-02T08:08:05.611170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:05.611179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.611181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:05.611180Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:05.611186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:05.611330Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:05.613212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId: src_id|eeef5c83-4868d633-5650e321-16c263b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:05.616038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:05.663059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533185301499656:4391]
2025-10-02T08:08:05.663184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 216, pipe: [1:7556533185301499656:4391]
2025-10-02T08:08:05.749191Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:05.749621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.749642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.749680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301499656:4391], now have 1 active actors on pipe
2025-10-02T08:08:05.749797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533185301499656:4391]
2025-10-02T08:08:05.749826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:05.749828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:05.749896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 217 reason: error at write: Disconnected sessionId: src_id|eeef5c83-4868d633-5650e321-16c263b_0
2025-10-02T08:08:05.750082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 217 sessionId: src_id|eeef5c83-4868d633-5650e321-16c263b_0 is DEAD
2025-10-02T08:08:05.750085Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:05.751922Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:05.758041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef5c83-4868d633-5650e321-16c263b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:05.758059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef5c83-4868d633-5650e321-16c263b_0] Write session will restart in 0.007966s
2025-10-02T08:08:05.758089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef5c83-4868d633-5650e321-16c263b_0] Write session: Do CDS request
2025-10-02T08:08:05.758097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef5c83-4868d633-5650e321-16c263b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:05.768157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef5c83-4868d633-5650e321-16c263b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.768562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:05.768579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 218
2025-10-02T08:08:05.768867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.768911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:05.768921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:05.768925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:05.769540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 218 sessionId:  describe result for acl check
2025-10-02T08:08:05.769604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:05.769617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:05.769618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:05.769627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533185301500198:4526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:05.770143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533185301500198:4526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:05.772533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:05.773399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533185301500198:4526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:05.774065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:05.774232Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:05.774236Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:05.774244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:05.774285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:05.774316Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533185301500281:4525]
2025-10-02T08:08:05.774911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:05.775321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:05.775418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:05.775870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:05.775974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.775983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.775984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.775985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.775986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.775994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.776006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.776010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.776015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.776019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.776026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.776041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.776049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.776060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.776077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.776089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.776094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.776104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.776110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.776121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.776146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:05.779218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533185301500198:4526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:05.779249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533185301500198:4526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:05.779252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533185301500198:4526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:05.779260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:05.784736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:05.786801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:05.786822Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:05.786824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:05.786829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:05.786837Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 217 [1:7556533185301500281:4525]
2025-10-02T08:08:05.786851Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:05.786872Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:05.786875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.786878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.786880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.786899Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:05.786913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:05.786921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:05.786994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.787000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.787004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:05.787007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:05.787080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:05.787091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.787105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.787117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:05.787137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301500300:4526], now have 1 active actors on pipe
2025-10-02T08:08:05.787145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533185301500267:4525]
2025-10-02T08:08:05.787147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533185301500267:4525]
2025-10-02T08:08:05.787156Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:05.787169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:05.787171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:05.787177Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:05.787186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:05.787189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:05.787227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533185301500267:4525]
2025-10-02T08:08:05.787229Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:05.787272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 217
2025-10-02T08:08:05.787405Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:05.787409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533185761889301:2378], now have 1 active actors on pipe
2025-10-02T08:08:05.787576Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 217
2025-10-02T08:08:05.787470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.787477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.787504Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:05.787512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.787516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.787518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:05.787529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.787538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:05.787557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.787586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.787588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.787608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.787638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 218 partition: 0 MaxSeqNo: 17 sessionId: src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0
2025-10-02T08:08:05.788448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef5c83-4868d633-5650e321-16c263b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:05.791250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0] Write session: try to update token
2025-10-02T08:08:05.791273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:05.804730Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:05.804763Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:05.804766Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:05.804775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533185301500267:4525]
2025-10-02T08:08:05.804778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533185301500267:4525]
2025-10-02T08:08:05.804844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:05.804846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:05.804851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.804853Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:05.804853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:05.805011Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:05.807841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId: src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:05.811372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:05.849943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533185301500313:4391]
2025-10-02T08:08:05.850113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 217, pipe: [1:7556533185301500313:4391]
2025-10-02T08:08:05.952036Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:05.952602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.952624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.952662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301500313:4391], now have 1 active actors on pipe
2025-10-02T08:08:05.952737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533185301500313:4391]
2025-10-02T08:08:05.952759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:05.952762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:05.952832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 218 reason: error at write: Disconnected sessionId: src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0
2025-10-02T08:08:05.952944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:05.952880Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:05.952998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 218 sessionId: src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0 is DEAD
2025-10-02T08:08:05.953246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:05.953262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0] Write session will restart in 0.007934s
2025-10-02T08:08:05.953291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0] Write session: Do CDS request
2025-10-02T08:08:05.953298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:05.962429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.962469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:05.962486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 219
2025-10-02T08:08:05.962676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:05.962726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:05.962737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:05.962741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:05.963380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 219 sessionId:  describe result for acl check
2025-10-02T08:08:05.963423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:05.963429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:05.963432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:05.963437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533185301500685:4532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:05.963949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533185301500685:4532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:05.966881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533185301500685:4532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:05.970151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533185301500685:4532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:05.970170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533185301500685:4532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:05.970174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533185301500685:4532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:05.970184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:05.970613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:05.971441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:05.971576Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:05.971585Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:05.971594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:05.971625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:05.971731Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533185301500946:4531]
2025-10-02T08:08:05.972221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:05.972348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:05.972373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:05.972578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:05.972622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.972628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.972629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.972630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.972631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.972636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.972645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.972649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.972653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.972656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.972662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.972667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:05.972674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.972677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:05.972680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.972682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:05.972685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.972688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.972690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.972693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.972702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:05.980329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:05.982141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:05.982164Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:05.982166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:05.982171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:05.982177Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 218 [1:7556533185301500946:4531]
2025-10-02T08:08:05.982188Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:05.982206Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:05.982208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.982211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.982213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.982229Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:05.982234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:05.982240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:05.982307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.982317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.982320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:05.982323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:05.982395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:05.982403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:05.982418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:05.982435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:05.982458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533185301500935:4532], now have 1 active actors on pipe
2025-10-02T08:08:05.982465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533185761889308:2378], now have 1 active actors on pipe
2025-10-02T08:08:05.982471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533185301500940:4531]
2025-10-02T08:08:05.982470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 218
2025-10-02T08:08:05.982475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533185301500940:4531]
2025-10-02T08:08:05.982486Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:05.982496Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:05.982500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:05.982501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.982506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.982509Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 218
2025-10-02T08:08:05.982526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:05.982547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:05.982550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:05.982591Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:05.982601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:05.982603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:05.982605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:05.982614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:05.982627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:05.982648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533185301500940:4531]
2025-10-02T08:08:05.982661Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:05.982691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.982696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:05.982736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:05.982744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:05.982757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:05.982798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 219 partition: 0 MaxSeqNo: 17 sessionId: src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0
2025-10-02T08:08:05.983163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b78292-18d0d7c5-e5c96523-1fb30c19_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:05.985896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0] Write session: try to update token
2025-10-02T08:08:05.985919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:06.000521Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:06.000542Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:06.000544Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:06.000553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533185301500940:4531]
2025-10-02T08:08:06.000556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533185301500940:4531]
2025-10-02T08:08:06.000598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:06.000613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.000613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:06.000615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:06.000618Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:06.000752Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:06.003104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId: src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:06.006064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:06.052700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533189596468267:4391]
2025-10-02T08:08:06.052906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 218, pipe: [1:7556533189596468267:4391]
2025-10-02T08:08:06.150282Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:06.150627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.150641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.150681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596468267:4391], now have 1 active actors on pipe
2025-10-02T08:08:06.150815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533189596468267:4391]
2025-10-02T08:08:06.150847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:06.150854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:06.150899Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:06.150918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 219 reason: error at write: Disconnected sessionId: src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0
2025-10-02T08:08:06.150938Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:06.151122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 219 sessionId: src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0 is DEAD
2025-10-02T08:08:06.151320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:06.151339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0] Write session will restart in 0.005058s
2025-10-02T08:08:06.151367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0] Write session: Do CDS request
2025-10-02T08:08:06.151374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:06.157443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:06.157592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:06.157610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 220
2025-10-02T08:08:06.157806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:06.157840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:06.157849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:06.157853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:06.158488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 220 sessionId:  describe result for acl check
2025-10-02T08:08:06.158533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:06.158540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:06.158542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:06.158548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533189596468526:4538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:06.159078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533189596468526:4538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:06.161954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533189596468526:4538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:06.165786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533189596468526:4538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:06.165802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533189596468526:4538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:06.165805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533189596468526:4538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:06.165814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:06.169947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:06.171097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:06.171263Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:06.171273Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:06.171282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:06.171323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:06.171362Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533189596468913:4537]
2025-10-02T08:08:06.171935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:06.172113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:06.172151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:06.172434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:06.172472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.172477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.172479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.172480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.172481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.172485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.172494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.172498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.172501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.172505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.172509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.172516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.172526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.172531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.172535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.172540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.172543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.172548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.172556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.172561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.172579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:06.180437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:06.182007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:06.182026Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:06.182029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:06.182032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:06.182039Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 219 [1:7556533189596468913:4537]
2025-10-02T08:08:06.182050Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:06.182065Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:06.182068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:06.182070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:06.182072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:06.182087Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:06.182093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:06.182098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:06.182152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.182161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.182164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:06.182166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:06.182227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:06.182234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.182246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.182261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:06.182282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596468798:4538], now have 1 active actors on pipe
2025-10-02T08:08:06.182289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533190056856623:2378], now have 1 active actors on pipe
2025-10-02T08:08:06.182295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533189596468907:4537]
2025-10-02T08:08:06.182297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533189596468907:4537]
2025-10-02T08:08:06.182297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 219
2025-10-02T08:08:06.182304Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:06.182315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:06.182325Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:06.182332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:06.182335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:06.182337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:06.182342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.182346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.182385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533189596468907:4537]
2025-10-02T08:08:06.182392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:06.182365Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 219
2025-10-02T08:08:06.182401Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:06.182407Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:06.182412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:06.182416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:06.182418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:06.182425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:06.182438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:06.182478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:06.182525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.182532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.182544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:06.182579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 220 partition: 0 MaxSeqNo: 17 sessionId: src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0
2025-10-02T08:08:06.183049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffeca96-2b8bd97f-93c99fce-7f020a37_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:06.185843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0] Write session: try to update token
2025-10-02T08:08:06.185868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:06.200366Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:06.200391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:06.200394Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:06.200403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533189596468907:4537]
2025-10-02T08:08:06.200407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533189596468907:4537]
2025-10-02T08:08:06.200458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:06.200465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.200473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:06.200658Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:06.204902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:06.204924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:06.209771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId: src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:06.213314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:06.250827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533189596468939:4391]
2025-10-02T08:08:06.250924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 219, pipe: [1:7556533189596468939:4391]
2025-10-02T08:08:06.347146Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:06.347461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.347469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.347491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596468939:4391], now have 1 active actors on pipe
2025-10-02T08:08:06.348947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:06.348966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0] Write session will restart in 0.007792s
2025-10-02T08:08:06.348993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0] Write session: Do CDS request
2025-10-02T08:08:06.349000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:06.349034Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:06.347752Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:06.348292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533189596468939:4391]
2025-10-02T08:08:06.348310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:06.348359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 220 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0
2025-10-02T08:08:06.348564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 220 sessionId: src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0 is DEAD
2025-10-02T08:08:06.361329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:06.361703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:06.361719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 221
2025-10-02T08:08:06.361893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:06.361920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:06.361925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:06.361929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:06.362440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 221 sessionId:  describe result for acl check
2025-10-02T08:08:06.362471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:06.362472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:06.362473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:06.362478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533189596469204:4546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:06.363115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533189596469204:4546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:06.365472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533189596469204:4546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:06.372373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533189596469204:4546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:06.372392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533189596469204:4546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:06.372395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533189596469204:4546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:06.372403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:06.386595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:06.387885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:06.388091Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:06.388099Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:06.388109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:06.388155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:06.388194Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533189596469578:4544]
2025-10-02T08:08:06.388702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:06.389147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:06.389192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:06.389490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:06.389528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.389529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.389530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.389531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.389532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.389536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.389546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.389550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.389554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.389557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.389563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.389569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.389575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.389579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.389586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.389591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.389595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.389599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.389603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.389608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.389627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:06.397880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:06.399388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:06.399395Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:06.399398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:06.399402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:06.399410Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 220 [1:7556533189596469578:4544]
2025-10-02T08:08:06.399423Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:06.399441Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:06.399444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:06.399448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:06.399450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:06.399465Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:06.399469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:06.399476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:06.399550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.399551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.399554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:06.399557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:06.399682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:06.399684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.399698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.399709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:06.399727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596469308:4546], now have 1 active actors on pipe
2025-10-02T08:08:06.399731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533190056856632:2378], now have 1 active actors on pipe
2025-10-02T08:08:06.399737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533189596469572:4544]
2025-10-02T08:08:06.399740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533189596469572:4544]
2025-10-02T08:08:06.399747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:06.399760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:06.399773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:06.399775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:06.399804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533189596469572:4544]
2025-10-02T08:08:06.399806Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:06.399840Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:06.399843Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:06.399850Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:06.399850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 220
2025-10-02T08:08:06.400030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.400043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.400079Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:06.400085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:06.400088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:06.400090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:06.400099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:06.400107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:06.400121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:06.400280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 220
2025-10-02T08:08:06.400329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.400336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.400350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:06.400379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 221 partition: 0 MaxSeqNo: 17 sessionId: src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0
2025-10-02T08:08:06.400872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5030e0e9-558cd686-8125ef0b-aae45e3e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:06.403948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0] Write session: try to update token
2025-10-02T08:08:06.403970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:06.419862Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:06.419886Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:06.419889Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:06.419898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533189596469572:4544]
2025-10-02T08:08:06.419902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533189596469572:4544]
2025-10-02T08:08:06.419951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:06.419953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:06.419957Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:06.419960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.419962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:06.420138Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:06.437263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId: src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:06.440015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:06.448462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533189596469606:4391]
2025-10-02T08:08:06.448600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 220, pipe: [1:7556533189596469606:4391]
2025-10-02T08:08:06.567938Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:06.568558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.568577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.568599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596469606:4391], now have 1 active actors on pipe
2025-10-02T08:08:06.568824Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:06.568864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:06.569418Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:06.568930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 221 reason: status is not ok: tablet will be restarted right now sessionId: src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0
2025-10-02T08:08:06.569128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 221 sessionId: src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0 is DEAD
2025-10-02T08:08:06.569177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533189596469606:4391]
2025-10-02T08:08:06.573066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:06.573083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0] Write session will restart in 0.005494s
2025-10-02T08:08:06.573113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0] Write session: Do CDS request
2025-10-02T08:08:06.573121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:06.580955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:06.581029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:06.581047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 222
2025-10-02T08:08:06.581271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:06.581316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:06.581325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:06.581329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:06.581699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 222 sessionId:  describe result for acl check
2025-10-02T08:08:06.581744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:06.581752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:06.581754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:06.581759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533189596470036:4562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:06.582279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533189596470036:4562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:06.585492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533189596470036:4562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:06.591284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533189596470036:4562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:06.591304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533189596470036:4562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:06.591308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533189596470036:4562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:06.591317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:06.594776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:06.596302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:06.596491Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:06.596501Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:06.596510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:06.596554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:06.596594Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533189596470273:4561]
2025-10-02T08:08:06.597334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:06.597535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:06.597581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:06.597895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:06.597936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.597941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.597942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.597943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.597944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.597949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.597959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.597963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.597967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.597970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.597976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.597983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.597989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.597994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.597998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.598003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.598007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.598012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.598017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.598022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.598040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:06.606647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:06.608895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:06.608918Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:06.608920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:06.608924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:06.608933Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 221 [1:7556533189596470273:4561]
2025-10-02T08:08:06.608945Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:06.608963Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:06.608967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:06.608970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:06.608972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:06.608989Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:06.608995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:06.609003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:06.609079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.609090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.609093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:06.609096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:06.609151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:06.609158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.609172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.609183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:06.609200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533189596470267:4561]
2025-10-02T08:08:06.609206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533189596470267:4561]
2025-10-02T08:08:06.609213Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:06.609225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 221
2025-10-02T08:08:06.609226Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:06.609228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596470262:4562], now have 1 active actors on pipe
2025-10-02T08:08:06.609229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:06.609236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:06.609249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:06.609251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:06.609258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.609262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.609303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533190056856640:2378], now have 1 active actors on pipe
2025-10-02T08:08:06.609305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533189596470267:4561]
2025-10-02T08:08:06.609315Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 221
2025-10-02T08:08:06.609314Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:06.609322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:06.609328Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:06.609336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:06.609339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:06.609341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:06.609351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:06.609361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:06.609394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:06.609431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.609438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.609452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:06.609490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 222 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0
2025-10-02T08:08:06.609969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679f075-e1ddfe8b-ad9e637f-588088ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:06.612938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0] Write session: try to update token
2025-10-02T08:08:06.612962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:06.627836Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:06.627855Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:06.627857Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:06.627866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533189596470267:4561]
2025-10-02T08:08:06.627870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533189596470267:4561]
2025-10-02T08:08:06.627912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:06.627916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:06.627921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.627922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:06.627930Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:06.628082Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:06.636861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId: src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:06.639940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:06.669153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533189596470297:4391]
2025-10-02T08:08:06.669297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 221, pipe: [1:7556533189596470297:4391]
2025-10-02T08:08:06.771909Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:06.772198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.772208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.772225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596470297:4391], now have 1 active actors on pipe
2025-10-02T08:08:06.772366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:06.772372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:06.772415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 222 reason: error at write: Disconnected sessionId: src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0
2025-10-02T08:08:06.772470Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:06.772483Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:06.772556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 222 sessionId: src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0 is DEAD
2025-10-02T08:08:06.772744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:06.772763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0] Write session will restart in 0.006559s
2025-10-02T08:08:06.772789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0] Write session: Do CDS request
2025-10-02T08:08:06.772815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:06.772842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533189596470297:4391]
2025-10-02T08:08:06.780626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:06.780858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:06.780874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 223
2025-10-02T08:08:06.781090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:06.781120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:06.781124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:06.781127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:06.781532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 223 sessionId:  describe result for acl check
2025-10-02T08:08:06.781562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:06.781567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:06.781568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:06.781573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533189596470651:4571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:06.781956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533189596470651:4571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:06.784003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533189596470651:4571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:06.786832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533189596470651:4571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:06.786848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533189596470651:4571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:06.786852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533189596470651:4571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:06.786860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:06.809618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:06.811035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:06.811249Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:06.811252Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:06.811263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:06.811328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:06.811431Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533189596470946:4570]
2025-10-02T08:08:06.812058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:06.812266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:06.812307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:06.812593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:06.812634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.812635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.812636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.812637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.812639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.812644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.812654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.812658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.812662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.812665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.812671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.812677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:06.812682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.812688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:06.812692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.812697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:06.812702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.812707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.812711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.812716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.812733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:06.821505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:06.823367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:06.823394Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:06.823398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:06.823402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:06.823410Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 222 [1:7556533189596470946:4570]
2025-10-02T08:08:06.823425Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:06.823445Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:06.823448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:06.823452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:06.823454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:06.823472Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:06.823482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:06.823489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:06.823567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.823573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.823576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:06.823578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:06.823646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:06.823653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.823668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:06.823684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:06.823707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596470681:4571], now have 1 active actors on pipe
2025-10-02T08:08:06.823712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 222
2025-10-02T08:08:06.823719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533189596470940:4570]
2025-10-02T08:08:06.823721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533189596470940:4570]
2025-10-02T08:08:06.823732Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:06.823742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533190056856669:2378], now have 1 active actors on pipe
2025-10-02T08:08:06.823757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.823757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:06.823760Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:06.823766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.823783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:06.823803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:06.823810Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:06.823856Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:06.823866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:06.823870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:06.823877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:06.823886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:06.823895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:06.823903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533189596470940:4570]
2025-10-02T08:08:06.823916Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:06.823923Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:06.823939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:06.823987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.823994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.824009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:06.824045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 223 partition: 0 MaxSeqNo: 17 sessionId: src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0
2025-10-02T08:08:06.824955Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 222
2025-10-02T08:08:06.825144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1345fd-3fe648a8-342557ec-ffe1bdc3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:06.827890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0] Write session: try to update token
2025-10-02T08:08:06.827917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:06.844529Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:06.844552Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:06.844554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:06.844564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533189596470940:4570]
2025-10-02T08:08:06.844568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533189596470940:4570]
2025-10-02T08:08:06.844613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:06.844621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:06.844623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:06.844654Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:06.844657Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:06.844873Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:06.856177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId: src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:06.859309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:06.873069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533189596470972:4391]
2025-10-02T08:08:06.873230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 222, pipe: [1:7556533189596470972:4391]
2025-10-02T08:08:06.991639Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:06.992153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:06.992166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:06.992187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533189596470972:4391], now have 1 active actors on pipe
2025-10-02T08:08:06.992284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533189596470972:4391]
2025-10-02T08:08:06.992320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:06.992322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:06.992367Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:06.992382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 223 reason: error at write: Disconnected sessionId: src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0
2025-10-02T08:08:06.992405Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:06.992559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 223 sessionId: src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0 is DEAD
2025-10-02T08:08:06.992822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:06.992838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0] Write session will restart in 0.009968s
2025-10-02T08:08:06.992859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0] Write session: Do CDS request
2025-10-02T08:08:06.992865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:07.004428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.004536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:07.004556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 224
2025-10-02T08:08:07.004771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.004820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:07.004831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:07.004835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:07.005242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 224 sessionId:  describe result for acl check
2025-10-02T08:08:07.005278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:07.005285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:07.005287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:07.005292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533193891438643:4577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:07.005791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533193891438643:4577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:07.008206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533193891438643:4577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:07.011479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533193891438643:4577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:07.011498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533193891438643:4577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:07.011502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533193891438643:4577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:07.011510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:07.014649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:07.016032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:07.016249Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:07.016260Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:07.016270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:07.016323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:07.016360Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533193891438910:4576]
2025-10-02T08:08:07.016977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:07.017179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:07.017226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:07.017605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:07.017724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.017731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.017732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.017733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.017734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.017738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.017748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.017752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.017757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.017760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.017766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.017777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.017782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.017787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.017795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.017799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.017808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.017814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.017822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.017827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.017848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:07.025976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:07.028001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:07.028037Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:07.028039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:07.028043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:07.028049Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 223 [1:7556533193891438910:4576]
2025-10-02T08:08:07.028075Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:07.028094Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:07.028097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.028100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.028103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.028120Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:07.028125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:07.028132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:07.028200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.028208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.028211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:07.028213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:07.028278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:07.028284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.028299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.028308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:07.028328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533193891438904:4576]
2025-10-02T08:08:07.028333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533193891438904:4576]
2025-10-02T08:08:07.028341Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:07.028354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891438833:4577], now have 1 active actors on pipe
2025-10-02T08:08:07.028353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:07.028356Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:07.028357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 223
2025-10-02T08:08:07.028364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:07.028376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:07.028378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:07.028383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533190056856678:2378], now have 1 active actors on pipe
2025-10-02T08:08:07.028413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.028422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.028434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533193891438904:4576]
2025-10-02T08:08:07.028442Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:07.028443Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 223
2025-10-02T08:08:07.028475Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:07.028485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.028489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.028491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:07.028499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.028507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:07.028537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.028541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:07.028656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.028664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.028680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.028717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 224 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0
2025-10-02T08:08:07.029183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168067a-9594973e-7ffd1bc-bddb3da4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:07.031843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0] Write session: try to update token
2025-10-02T08:08:07.031880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:07.045394Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:07.045413Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:07.045415Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:07.045426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533193891438904:4576]
2025-10-02T08:08:07.045430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533193891438904:4576]
2025-10-02T08:08:07.045481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:07.045485Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:07.045492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:07.045492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.045494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:07.045646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:07.050303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId: src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:07.053060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:07.092621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533193891438936:4391]
2025-10-02T08:08:07.092714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 223, pipe: [1:7556533193891438936:4391]
2025-10-02T08:08:07.177984Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:07.178400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.178410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.178427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891438936:4391], now have 1 active actors on pipe
2025-10-02T08:08:07.178531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533193891438936:4391]
2025-10-02T08:08:07.178556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:07.178558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:07.178614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 224 reason: error at write: Disconnected sessionId: src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0
2025-10-02T08:08:07.178646Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:07.178790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 224 sessionId: src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0 is DEAD
2025-10-02T08:08:07.178951Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:07.178999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:07.179016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0] Write session will restart in 0.005320s
2025-10-02T08:08:07.179044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0] Write session: Do CDS request
2025-10-02T08:08:07.179051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:07.185338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.185458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:07.185574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 225
2025-10-02T08:08:07.185767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.185796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:07.185800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:07.185804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:07.186195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 225 sessionId:  describe result for acl check
2025-10-02T08:08:07.186223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:07.186224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:07.186226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:07.186230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533193891439239:4584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:07.186730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533193891439239:4584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:07.189018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533193891439239:4584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:07.192142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533193891439239:4584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:07.192156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533193891439239:4584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:07.192159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533193891439239:4584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:07.192166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:07.197407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:07.198947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:07.199186Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:07.199194Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:07.199206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:07.199253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:07.199286Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533193891439591:4583]
2025-10-02T08:08:07.199752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:07.199951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:07.199996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:07.200297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:07.200364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.200370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.200371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.200372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.200373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.200379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.200390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.200394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.200398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.200402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.200408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.200415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.200426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.200430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.200436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.200445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.200449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.200453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.200458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.200466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.200484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:07.208497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:07.210418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:07.210428Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:07.210430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:07.210432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:07.210436Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 224 [1:7556533193891439591:4583]
2025-10-02T08:08:07.210445Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:07.210458Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:07.210460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.210462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.210463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.210476Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:07.210479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:07.210484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:07.210537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.210539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.210542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:07.210545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:07.210601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:07.210608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.210618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.210625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:07.210638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533193891439585:4583]
2025-10-02T08:08:07.210639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533193891439585:4583]
2025-10-02T08:08:07.210645Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:07.210653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:07.210661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:07.210662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:07.210683Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:07.210689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891439457:4584], now have 1 active actors on pipe
2025-10-02T08:08:07.210691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533193891439585:4583]
2025-10-02T08:08:07.210693Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:07.210693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:07.210699Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:07.210703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533194351823993:2378], now have 1 active actors on pipe
2025-10-02T08:08:07.210705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 224
2025-10-02T08:08:07.210707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.210709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.210732Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:07.210736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.210744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.210745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:07.210751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.210757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:07.210771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.210812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 224
2025-10-02T08:08:07.210837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.210842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.210856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.210888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 225 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0
2025-10-02T08:08:07.211230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5973bfc-984862bd-89e31f26-5e20d15e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:07.214416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0] Write session: try to update token
2025-10-02T08:08:07.214432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:07.228310Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:07.228328Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:07.228330Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:07.228337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533193891439585:4583]
2025-10-02T08:08:07.228341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533193891439585:4583]
2025-10-02T08:08:07.228383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:07.228388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.228389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:07.228395Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:07.228402Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:07.228544Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:07.237491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId: src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:07.240232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:07.278902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533193891439617:4391]
2025-10-02T08:08:07.279071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 224, pipe: [1:7556533193891439617:4391]
2025-10-02T08:08:07.360437Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:07.360706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.360717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.360741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891439617:4391], now have 1 active actors on pipe
2025-10-02T08:08:07.360999Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:07.361041Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:07.361316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533193891439617:4391]
2025-10-02T08:08:07.361368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:07.361435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 225 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0
2025-10-02T08:08:07.361675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 225 sessionId: src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0 is DEAD
2025-10-02T08:08:07.361834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:07.361849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0] Write session will restart in 0.008212s
2025-10-02T08:08:07.361871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0] Write session: Do CDS request
2025-10-02T08:08:07.361877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:07.371489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.371527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:07.371539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 226
2025-10-02T08:08:07.371704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.371739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:07.371749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:07.371751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:07.372199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 226 sessionId:  describe result for acl check
2025-10-02T08:08:07.372238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:07.372242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:07.372244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:07.372249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533193891440012:4591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:07.372822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533193891440012:4591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:07.375029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533193891440012:4591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:07.378749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533193891440012:4591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:07.378765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533193891440012:4591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:07.378769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533193891440012:4591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:07.378777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:07.381541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:07.382933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:07.383221Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:07.383228Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:07.383237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:07.383283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:07.383317Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533193891440268:4590]
2025-10-02T08:08:07.383786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:07.383967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:07.383998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:07.384247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:07.384278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.384281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.384282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.384283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.384283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.384287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.384293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.384296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.384298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.384299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.384303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.384307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.384311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.384315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.384319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.384325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.384327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.384329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.384332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.384334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.384344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:07.392032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:07.393900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:07.393918Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:07.393920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:07.393923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:07.393930Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 225 [1:7556533193891440268:4590]
2025-10-02T08:08:07.393940Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:07.393958Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:07.393961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.393964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.393965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.393983Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:07.393993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:07.393999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:07.394069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.394077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.394081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:07.394084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:07.394150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:07.394153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.394166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.394183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:07.394200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533193891440262:4590]
2025-10-02T08:08:07.394206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533193891440262:4590]
2025-10-02T08:08:07.394213Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:07.394228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891440214:4591], now have 1 active actors on pipe
2025-10-02T08:08:07.394236Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:07.394238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:07.394240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:07.394247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 225
2025-10-02T08:08:07.394252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:07.394255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:07.394260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533194351824002:2378], now have 1 active actors on pipe
2025-10-02T08:08:07.394293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.394300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.394313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533193891440262:4590]
2025-10-02T08:08:07.394325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:07.394333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:07.394330Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 225
2025-10-02T08:08:07.394354Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:07.394364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.394368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.394370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:07.394378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.394386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:07.394411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.394467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.394473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.394486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.394513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 226 partition: 0 MaxSeqNo: 17 sessionId: src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0
2025-10-02T08:08:07.394958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b7a0b57-4b4108c3-aee14f18-790f93e7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:07.397866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0] Write session: try to update token
2025-10-02T08:08:07.397889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:07.411571Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:07.411588Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:07.411591Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:07.411598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533193891440262:4590]
2025-10-02T08:08:07.411602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533193891440262:4590]
2025-10-02T08:08:07.411645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:07.411649Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:07.411651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.411653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:07.411655Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:07.411803Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:07.412518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId: src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:07.415429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:07.461705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533193891440296:4391]
2025-10-02T08:08:07.461796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 225, pipe: [1:7556533193891440296:4391]
2025-10-02T08:08:07.544053Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:07.544258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.544269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.544299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891440296:4391], now have 1 active actors on pipe
2025-10-02T08:08:07.544446Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:07.544558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:07.544740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533193891440296:4391]
2025-10-02T08:08:07.544758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:07.544826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 226 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0
2025-10-02T08:08:07.545019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 226 sessionId: src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0 is DEAD
2025-10-02T08:08:07.545211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:07.545221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0] Write session will restart in 0.009661s
2025-10-02T08:08:07.545250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0] Write session: Do CDS request
2025-10-02T08:08:07.545272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:07.556435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.556512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:07.556530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 227
2025-10-02T08:08:07.556749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.556772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:07.556779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:07.556781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:07.557218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 227 sessionId:  describe result for acl check
2025-10-02T08:08:07.557258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:07.557260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:07.557261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:07.557267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533193891440753:4607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:07.557829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533193891440753:4607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:07.559906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533193891440753:4607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:07.563379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533193891440753:4607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:07.563396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533193891440753:4607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:07.563399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533193891440753:4607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:07.563407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:07.565681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:07.566855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:07.567060Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:07.567067Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:07.567074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:07.567107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:07.567134Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533193891440973:4602]
2025-10-02T08:08:07.567624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:07.567800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:07.567842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:07.568166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:07.568230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.568236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.568238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.568239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.568240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.568245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.568255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.568259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.568262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.568267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.568273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.568282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.568288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.568293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.568298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.568303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.568308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.568313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.568321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.568326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.568349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:07.576183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:07.578275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:07.578290Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:07.578292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:07.578295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:07.578299Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 226 [1:7556533193891440973:4602]
2025-10-02T08:08:07.578308Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:07.578322Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:07.578324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.578326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.578328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.578340Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:07.578343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:07.578348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:07.578399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.578404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.578407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:07.578408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:07.578459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:07.578464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.578473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.578479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:07.578491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533193891440967:4602]
2025-10-02T08:08:07.578496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533193891440967:4602]
2025-10-02T08:08:07.578502Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:07.578510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:07.578518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:07.578520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:07.578521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:07.578525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:07.578527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 226
2025-10-02T08:08:07.578528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891440919:4607], now have 1 active actors on pipe
2025-10-02T08:08:07.578550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533193891440967:4602]
2025-10-02T08:08:07.578555Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:07.578560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.578563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.578570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:07.578574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533194351824009:2378], now have 1 active actors on pipe
2025-10-02T08:08:07.578602Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca2083-34307c0c-edc492ef-5152274d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:07.578611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.578614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.578616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:07.578626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.578637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:07.578658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.578662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 226
2025-10-02T08:08:07.578736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.578742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.578753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.578781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 227 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca2083-34307c0c-edc492ef-5152274d_0
2025-10-02T08:08:07.579156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc756107-a42cc8c9-4eb570bd-28fa4176_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca2083-34307c0c-edc492ef-5152274d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:07.582398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2083-34307c0c-edc492ef-5152274d_0] Write session: try to update token
2025-10-02T08:08:07.582413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2083-34307c0c-edc492ef-5152274d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:07.595847Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:07.595862Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:07.595863Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:07.595870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533193891440967:4602]
2025-10-02T08:08:07.595873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533193891440967:4602]
2025-10-02T08:08:07.595909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:07.595914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.595915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:07.595917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:07.595924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:07.596071Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:07.598719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId: src_id|ca2083-34307c0c-edc492ef-5152274d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:07.601601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:07.645008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533193891440998:4391]
2025-10-02T08:08:07.645120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 226, pipe: [1:7556533193891440998:4391]
2025-10-02T08:08:07.729755Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:07.730321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.730339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.730380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891440998:4391], now have 1 active actors on pipe
2025-10-02T08:08:07.730514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533193891440998:4391]
2025-10-02T08:08:07.730539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:07.730544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:07.730593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 227 reason: error at write: Disconnected sessionId: src_id|ca2083-34307c0c-edc492ef-5152274d_0
2025-10-02T08:08:07.730600Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:07.730635Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:07.730788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 227 sessionId: src_id|ca2083-34307c0c-edc492ef-5152274d_0 is DEAD
2025-10-02T08:08:07.730985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2083-34307c0c-edc492ef-5152274d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:07.731000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2083-34307c0c-edc492ef-5152274d_0] Write session will restart in 0.009439s
2025-10-02T08:08:07.731025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2083-34307c0c-edc492ef-5152274d_0] Write session: Do CDS request
2025-10-02T08:08:07.731033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2083-34307c0c-edc492ef-5152274d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:07.741485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2083-34307c0c-edc492ef-5152274d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.741616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:07.741630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 228
2025-10-02T08:08:07.741791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.741821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:07.741830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:07.741833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:07.742518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 228 sessionId:  describe result for acl check
2025-10-02T08:08:07.742549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:07.742551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:07.742552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:07.742557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533193891441443:4615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:07.743029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533193891441443:4615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:07.746125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533193891441443:4615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:07.749287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533193891441443:4615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:07.749299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533193891441443:4615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:07.749302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533193891441443:4615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:07.749307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:07.749823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:07.751027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:07.751192Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:07.751199Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:07.751207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:07.751251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:07.751373Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533193891441657:4614]
2025-10-02T08:08:07.751967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:07.752121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:07.752158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:07.752369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:07.752402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.752407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.752408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.752409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.752410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.752415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.752426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.752430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.752438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.752441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.752446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.752454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.752460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.752468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.752474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.752479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.752483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.752487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.752491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.752495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.752513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:07.760498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:07.762300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:07.762317Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:07.762319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:07.762322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:07.762328Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 227 [1:7556533193891441657:4614]
2025-10-02T08:08:07.762341Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:07.762357Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:07.762359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.762362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.762364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.762379Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:07.762388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:07.762396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:07.762455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.762460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.762463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:07.762466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:07.762529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:07.762535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.762548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.762560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:07.762579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891441644:4615], now have 1 active actors on pipe
2025-10-02T08:08:07.762585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 227
2025-10-02T08:08:07.762589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533193891441651:4614]
2025-10-02T08:08:07.762591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533193891441651:4614]
2025-10-02T08:08:07.762599Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:07.762610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:07.762614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:07.762619Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:07.762628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:07.762631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:07.762638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.762642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.762655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533194351824037:2378], now have 1 active actors on pipe
2025-10-02T08:08:07.762687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533193891441651:4614]
2025-10-02T08:08:07.762693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:07.762700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:07.762709Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:07.762672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 227
2025-10-02T08:08:07.762716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.762723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.762725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:07.762735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.762746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:07.762789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.762866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.762871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.762885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.762924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 228 partition: 0 MaxSeqNo: 17 sessionId: src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0
2025-10-02T08:08:07.763291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2083-34307c0c-edc492ef-5152274d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:07.765886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0] Write session: try to update token
2025-10-02T08:08:07.765901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:07.779621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId: src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:07.779762Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:07.779775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:07.779777Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:07.779784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533193891441651:4614]
2025-10-02T08:08:07.779787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533193891441651:4614]
2025-10-02T08:08:07.779819Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:07.779820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:07.779823Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:07.779826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.779827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:07.779977Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:07.782390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:07.830859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533193891441681:4391]
2025-10-02T08:08:07.830998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 227, pipe: [1:7556533193891441681:4391]
2025-10-02T08:08:07.928022Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:07.928490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.928505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.928546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891441681:4391], now have 1 active actors on pipe
2025-10-02T08:08:07.928696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:07.928707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:07.928755Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:07.928770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 228 reason: error at write: Disconnected sessionId: src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0
2025-10-02T08:08:07.928842Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:07.929019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 228 sessionId: src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0 is DEAD
2025-10-02T08:08:07.929156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533193891441681:4391]
2025-10-02T08:08:07.929303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:07.929319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0] Write session will restart in 0.005053s
2025-10-02T08:08:07.929349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0] Write session: Do CDS request
2025-10-02T08:08:07.929356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:07.936688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.936835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:07.936852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 229
2025-10-02T08:08:07.937078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:07.937132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:07.937145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:07.937150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:07.937605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 229 sessionId:  describe result for acl check
2025-10-02T08:08:07.937643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:07.937649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:07.937651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:07.937658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533193891441950:4622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:07.938216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533193891441950:4622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:07.941611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533193891441950:4622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:07.944971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533193891441950:4622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:07.944985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533193891441950:4622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:07.944989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533193891441950:4622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:07.945010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:07.951377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:07.952796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:07.953052Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:07.953064Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:07.953076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:07.953126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:07.953166Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533193891442334:4621]
2025-10-02T08:08:07.953722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:07.953913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:07.953951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:07.954246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:07.954290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.954296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.954297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.954298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.954299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.954304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.954314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.954318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.954322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.954326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.954331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.954342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:07.954350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.954355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:07.954359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.954364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:07.954368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.954373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.954378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.954388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.954407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:07.962945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:07.965041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:07.965055Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:07.965057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:07.965061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:07.965067Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 228 [1:7556533193891442334:4621]
2025-10-02T08:08:07.965079Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:07.965097Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:07.965099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.965102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.965104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.965118Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:07.965124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:07.965133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:07.965200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.965208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.965212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:07.965215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:07.965284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:07.965294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.965305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:07.965315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:07.965333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533194351824047:2378], now have 1 active actors on pipe
2025-10-02T08:08:07.965340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533193891442328:4621]
2025-10-02T08:08:07.965342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533193891442328:4621]
2025-10-02T08:08:07.965349Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:07.965358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533193891442197:4622], now have 1 active actors on pipe
2025-10-02T08:08:07.965363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:07.965366Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:07.965370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:07.965383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:07.965386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:07.965416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533193891442328:4621]
2025-10-02T08:08:07.965420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 228
2025-10-02T08:08:07.965424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:07.965446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.965450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.965417Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 228
2025-10-02T08:08:07.965461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:07.965476Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:07.965487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:07.965491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:07.965493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:07.965501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:07.965509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:07.965532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.965565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:07.965571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:07.965582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:07.965621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 229 partition: 0 MaxSeqNo: 17 sessionId: src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0
2025-10-02T08:08:07.966097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf01d5b-435ce902-47fcb504-b1dcbd0e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:07.968879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0] Write session: try to update token
2025-10-02T08:08:07.968901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:07.986192Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:07.986207Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:07.986209Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:07.986218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533193891442328:4621]
2025-10-02T08:08:07.986223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533193891442328:4621]
2025-10-02T08:08:07.986266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:07.986278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:07.986280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:07.986346Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:07.986358Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:07.986430Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:07.986514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId: src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:07.989452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:08.029534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533198186409654:4391]
2025-10-02T08:08:08.029907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 228, pipe: [1:7556533198186409654:4391]
2025-10-02T08:08:08.131157Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:08.131460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.131475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.131518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186409654:4391], now have 1 active actors on pipe
2025-10-02T08:08:08.131637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533198186409654:4391]
2025-10-02T08:08:08.131699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:08.131706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:08.131724Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:08.131783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 229 reason: error at write: Disconnected sessionId: src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0
2025-10-02T08:08:08.132002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 229 sessionId: src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0 is DEAD
2025-10-02T08:08:08.132933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:08.132951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0] Write session will restart in 0.007308s
2025-10-02T08:08:08.132980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0] Write session: Do CDS request
2025-10-02T08:08:08.132989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:08.133286Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:08.141596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.142194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:08.142209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 230
2025-10-02T08:08:08.142385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.142417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:08.142427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:08.142431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:08.142822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 230 sessionId:  describe result for acl check
2025-10-02T08:08:08.142856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:08.142864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:08.142866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:08.142872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533198186409697:4628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:08.143384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533198186409697:4628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:08.148074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533198186409697:4628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:08.156039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533198186409697:4628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:08.156065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533198186409697:4628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:08.156068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533198186409697:4628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:08.156076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:08.170189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:08.171921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:08.172498Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:08.172510Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:08.172528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:08.172605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:08.172665Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533198186410309:4627]
2025-10-02T08:08:08.173354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:08.174437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:08.174514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:08.175050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:08.175127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.175128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.175130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.175131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.175132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.175139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.175149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.175153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.175157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.175160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.175166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.175173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.175180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.175186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.175190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.175195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.175200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.175205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.175210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.175214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.175234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:08.184172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:08.185904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:08.185925Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:08.185928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:08.185933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:08.185941Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 229 [1:7556533198186410309:4627]
2025-10-02T08:08:08.185954Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:08.185975Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:08.185982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.185986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.185988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.186005Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:08.186011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:08.186022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:08.186097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.186103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.186106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:08.186109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:08.186188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:08.186195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.186210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.186226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:08.186258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533198186410303:4627]
2025-10-02T08:08:08.186264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533198186410303:4627]
2025-10-02T08:08:08.186272Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:08.186289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:08.186304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:08.186307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:08.186321Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:08.186332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:08.186343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533198186410303:4627]
2025-10-02T08:08:08.186351Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:08.186374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186410084:4628], now have 1 active actors on pipe
2025-10-02T08:08:08.186375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:08.186388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533198646791362:2378], now have 1 active actors on pipe
2025-10-02T08:08:08.186421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 229
2025-10-02T08:08:08.186529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.186544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.186574Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8a3026-a22d8df6-70b04488-6e35541e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:08.186585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.186595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.186597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:08.186607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.186622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:08.186652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:08.186690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.186697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.186709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:08.186737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 230 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8a3026-a22d8df6-70b04488-6e35541e_0
2025-10-02T08:08:08.187161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aafdea-5c31c1c6-678ef95f-3d8494d0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8a3026-a22d8df6-70b04488-6e35541e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:08.186698Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 229
2025-10-02T08:08:08.193201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a3026-a22d8df6-70b04488-6e35541e_0] Write session: try to update token
2025-10-02T08:08:08.193227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a3026-a22d8df6-70b04488-6e35541e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:08.208798Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:08.208842Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:08.208845Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:08.208853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533198186410303:4627]
2025-10-02T08:08:08.208858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533198186410303:4627]
2025-10-02T08:08:08.208908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:08.208916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:08.208919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.208922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:08.208922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:08.209082Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:08.228752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId: src_id|d8a3026-a22d8df6-70b04488-6e35541e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:08.232068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:08.232139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533198186410346:4391]
2025-10-02T08:08:08.232241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 229, pipe: [1:7556533198186410346:4391]
2025-10-02T08:08:08.344270Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:08.344820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.344834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.344857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186410346:4391], now have 1 active actors on pipe
2025-10-02T08:08:08.345082Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:08.345493Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:08.345821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:08.345877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 230 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8a3026-a22d8df6-70b04488-6e35541e_0
2025-10-02T08:08:08.346085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 230 sessionId: src_id|d8a3026-a22d8df6-70b04488-6e35541e_0 is DEAD
2025-10-02T08:08:08.346228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a3026-a22d8df6-70b04488-6e35541e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:08.346238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a3026-a22d8df6-70b04488-6e35541e_0] Write session will restart in 0.005557s
2025-10-02T08:08:08.346260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a3026-a22d8df6-70b04488-6e35541e_0] Write session: Do CDS request
2025-10-02T08:08:08.346266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a3026-a22d8df6-70b04488-6e35541e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:08.346257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533198186410346:4391]
2025-10-02T08:08:08.353413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a3026-a22d8df6-70b04488-6e35541e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.354075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:08.354088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 231
2025-10-02T08:08:08.354281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.354325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:08.354335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:08.354338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:08.354782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 231 sessionId:  describe result for acl check
2025-10-02T08:08:08.354831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:08.354838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:08.354840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:08.354846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533198186410639:4635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:08.355368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533198186410639:4635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:08.358060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533198186410639:4635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:08.361371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533198186410639:4635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:08.361386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533198186410639:4635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:08.361388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533198186410639:4635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:08.361403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:08.366843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:08.367912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:08.368133Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:08.368141Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:08.368148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:08.368187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:08.368218Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533198186411009:4634]
2025-10-02T08:08:08.368700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:08.368906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:08.368948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:08.369239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:08.369287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.369294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.369295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.369297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.369298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.369303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.369314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.369318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.369321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.369325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.369330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.369338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.369348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.369353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.369358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.369367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.369372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.369377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.369382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.369386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.369411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:08.377765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:08.379530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:08.379551Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:08.379554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:08.379558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:08.379565Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 230 [1:7556533198186411009:4634]
2025-10-02T08:08:08.379579Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:08.379598Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:08.379601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.379604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.379607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.379624Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:08.379635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:08.379642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:08.379722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.379730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.379733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:08.379736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:08.379802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:08.379810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.379812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 230
2025-10-02T08:08:08.379824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.379836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:08.379862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186410867:4635], now have 1 active actors on pipe
2025-10-02T08:08:08.379870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533198646791369:2378], now have 1 active actors on pipe
2025-10-02T08:08:08.379875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.379880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.379905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533198186411003:4634]
2025-10-02T08:08:08.379912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533198186411003:4634]
2025-10-02T08:08:08.379925Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:08.379934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:08.379937Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:08.379941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:08.379955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:08.379963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:08.379979Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:08.379990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.379996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.379998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:08.380006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.379950Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 230
2025-10-02T08:08:08.380021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:08.380081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533198186411003:4634]
2025-10-02T08:08:08.380093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:08.380102Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:08.380106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:08.380154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.380162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.380175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:08.380218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 231 partition: 0 MaxSeqNo: 17 sessionId: src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0
2025-10-02T08:08:08.380641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a3026-a22d8df6-70b04488-6e35541e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:08.383245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0] Write session: try to update token
2025-10-02T08:08:08.383266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:08.390789Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:08.390807Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:08.390817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533198186411003:4634]
2025-10-02T08:08:08.390857Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:08.390859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:08.391031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:08.391186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:08.391324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:08.391470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:08.391688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:08.391727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:08.400760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId: src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:08.403309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:08.403394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.403407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.403439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:08.403461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:08.403512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.403524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.403678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.403740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.403792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.403844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.403982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.403989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.404047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.404113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.404166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.404222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.404267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.404271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.404339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.404393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.404453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.404513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.404564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.404572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.404641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.404696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.404761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.404835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.404889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.404895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.404968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.405033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.405103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.405169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.405216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.405223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.405290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.405350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.405414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.405487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.405537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.405544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.405614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.405684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.405757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.405822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.405870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.405877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.405942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.406010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.406077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.406148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.406212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.406219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.406287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.406358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.406426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.406496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.406545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.406551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.406620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:08.406689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:08.406763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:08.406826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:08.406877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:08.406885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:08.406945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:08.407009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.407030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.407036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:08.407067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:08.407084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:08.407092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:08.407096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:08.407099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:08.407517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:08.407545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:08.407555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:08.407559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:08.407561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:08.407564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:08.408196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:08.408232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:08.408242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:08.408245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:08.408248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:08.408251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:08.408856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:08.408876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:08.408886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:08.408889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:08.408895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:08.410983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:08.410998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:08.411007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392488410
2025-10-02T08:08:08.411131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:08.411141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:08.411145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:08.411147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:08.411149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:08.411151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:08.411601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:08.411621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:08.411626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:08.411629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:08.411632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:08.411636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:08.412137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:08.412154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:08.412162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:08.412164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:08.412167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:08.412169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:08.412653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:08.412673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:08.412680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:08.413892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:08.413910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:08.413918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:08.413922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:08.413930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392488413
2025-10-02T08:08:08.414287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:08.414313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:08.414318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:08.414322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:08.414325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:08.414328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:08.414873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:08.414895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:08.414900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:08.414904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:08.414908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:08.414911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:08.415451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:08.415475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.415578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392488415
2025-10-02T08:08:08.421801Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:08.421844Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:08.421852Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:08.421860Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:08.421872Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:08.421875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:08.421878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:08.421889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533198186411003:4634]
2025-10-02T08:08:08.421901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533198186411003:4634]
2025-10-02T08:08:08.421958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:08.421970Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:08.421988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:08.421993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.421996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:08.422169Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:08.446319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533198186411039:4391]
2025-10-02T08:08:08.446455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 230, pipe: [1:7556533198186411039:4391]
2025-10-02T08:08:08.560641Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:08.561080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186411039:4391], now have 1 active actors on pipe
2025-10-02T08:08:08.561299Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:08.561630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:08.561665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 231 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0
2025-10-02T08:08:08.561882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 231 sessionId: src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0 is DEAD
2025-10-02T08:08:08.562042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533198186411039:4391]
2025-10-02T08:08:08.562107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:08.562127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0] Write session will restart in 0.008936s
2025-10-02T08:08:08.562158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0] Write session: Do CDS request
2025-10-02T08:08:08.562165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:08.564882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:08.568925Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [abec93d91d9c081b] Result# TEvPutResult {Id# [72075186224037892:230:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:08.568935Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:230:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:08.572531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.572590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:08.572603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 232
2025-10-02T08:08:08.572879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.572917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:08.572922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:08.572926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:08.573412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 232 sessionId:  describe result for acl check
2025-10-02T08:08:08.573443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:08.573445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:08.573446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:08.573451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533198186411373:4648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:08.574046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533198186411373:4648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:08.577300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533198186411373:4648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:08.580435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533198186411373:4648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:08.580453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533198186411373:4648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:08.580457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533198186411373:4648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:08.580465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:08.594048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:08.595614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:08.595772Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:08.595782Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:08.595791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:08.595835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:08.595861Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533198186411733:4647]
2025-10-02T08:08:08.596303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:08.596464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:08.596490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:08.596693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:08.596725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.596730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.596730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.596731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.596731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.596735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.596741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.596743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.596745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.596747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.596750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.596755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.596758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.596761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.596763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.596765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.596768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.596770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.596772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.596775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.596784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:08.605187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:08.606745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:08.606764Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:08.606766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:08.606770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:08.606776Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 231 [1:7556533198186411733:4647]
2025-10-02T08:08:08.606791Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:08.606809Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:08.606818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.606821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.606823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.606840Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:08.606845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:08.606851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:08.607384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.607395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.607399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:08.607401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:08.607482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:08.607488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.607502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.607513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:08.607531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186411502:4648], now have 1 active actors on pipe
2025-10-02T08:08:08.607538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533198646791376:2378], now have 1 active actors on pipe
2025-10-02T08:08:08.607548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 231
2025-10-02T08:08:08.607554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533198186411716:4647]
2025-10-02T08:08:08.607556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533198186411716:4647]
2025-10-02T08:08:08.607567Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:08.607582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:08.607585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:08.607590Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:08.607599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:08.607602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:08.607609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.607612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.607651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533198186411716:4647]
2025-10-02T08:08:08.607657Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:08.607637Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 231
2025-10-02T08:08:08.607664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:08.607671Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:08.607678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.607682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.607684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:08.607693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.607700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:08.607742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:08.607790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.607796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.607806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:08.607841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 232 partition: 0 MaxSeqNo: 17 sessionId: src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0
2025-10-02T08:08:08.608244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5431b1b0-b907a5ad-82bbc9d3-a540d46f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:08.611438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0] Write session: try to update token
2025-10-02T08:08:08.611455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:08.627006Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:08.627026Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:08.627029Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:08.627039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533198186411716:4647]
2025-10-02T08:08:08.627044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533198186411716:4647]
2025-10-02T08:08:08.627090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:08.627095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.627094Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:08.627097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:08.627101Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:08.627259Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:08.635427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId: src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:08.637989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:08.661851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533198186411757:4391]
2025-10-02T08:08:08.662040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 231, pipe: [1:7556533198186411757:4391]
2025-10-02T08:08:08.774884Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:08.775454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.775468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.775488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186411757:4391], now have 1 active actors on pipe
2025-10-02T08:08:08.775664Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:08.775948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:08.776003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 232 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0
2025-10-02T08:08:08.776083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533198186411757:4391]
2025-10-02T08:08:08.776085Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:08.776206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 232 sessionId: src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0 is DEAD
2025-10-02T08:08:08.776341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:08.776351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0] Write session will restart in 0.008660s
2025-10-02T08:08:08.776377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0] Write session: Do CDS request
2025-10-02T08:08:08.776384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:08.793312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.797017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:08.797031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 233
2025-10-02T08:08:08.800426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.800462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:08.800467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:08.800471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:08.800865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 233 sessionId:  describe result for acl check
2025-10-02T08:08:08.800890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:08.800901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:08.800902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:08.800908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533198186412378:4661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:08.801393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533198186412378:4661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:08.803237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:08.803933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:08.804177Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:08.804186Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:08.804195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:08.804241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:08.804294Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533198186412411:4660]
2025-10-02T08:08:08.804692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533198186412378:4661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:08.804908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:08.805140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:08.805198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:08.805521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:08.805560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.805565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.805566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.805568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.805569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.805574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.805581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.805585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.805588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.805591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.805597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.805604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:08.805610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.805615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:08.805621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.805626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:08.805631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.805635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.805640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.805644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.805662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:08.811904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533198186412378:4661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:08.811921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533198186412378:4661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:08.811924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533198186412378:4661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:08.811933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:08.813906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:08.815918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:08.815925Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:08.815928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:08.815931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:08.815937Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 232 [1:7556533198186412411:4660]
2025-10-02T08:08:08.815949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:08.815968Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:08.815971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.815974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.815976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.815993Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:08.815998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:08.816004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:08.816086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.816088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.816090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:08.816093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:08.816165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:08.816167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.816182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:08.816193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:08.816210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533198186412397:4660]
2025-10-02T08:08:08.816212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533198186412397:4660]
2025-10-02T08:08:08.816219Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:08.816231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:08.816244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:08.816247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:08.816276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:08.816280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:08.816522Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 232
2025-10-02T08:08:08.816283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 232
2025-10-02T08:08:08.816286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186412438:4661], now have 1 active actors on pipe
2025-10-02T08:08:08.816290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533198186412397:4660]
2025-10-02T08:08:08.816292Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:08.816307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533198646791405:2378], now have 1 active actors on pipe
2025-10-02T08:08:08.816311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.816315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.816345Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71d56861-32997d45-eee81e0b-491062ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:08.816351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:08.816355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:08.816356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:08.816366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:08.816373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:08.816390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:08.816454Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:08.816568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.816575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.816607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:08.816653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 233 partition: 0 MaxSeqNo: 17 sessionId: src_id|71d56861-32997d45-eee81e0b-491062ac_0
2025-10-02T08:08:08.820929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28ddab7-4cfa9536-d649d989-85bb48ac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|71d56861-32997d45-eee81e0b-491062ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:08.824575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d56861-32997d45-eee81e0b-491062ac_0] Write session: try to update token
2025-10-02T08:08:08.824599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d56861-32997d45-eee81e0b-491062ac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:08.836198Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:08.836219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:08.836221Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:08.836230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533198186412397:4660]
2025-10-02T08:08:08.836234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533198186412397:4660]
2025-10-02T08:08:08.836281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:08.836288Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:08.836293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:08.836295Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:08.836296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:08.836472Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:08.842535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId: src_id|71d56861-32997d45-eee81e0b-491062ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:08.845475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:08.876860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533198186412451:4391]
2025-10-02T08:08:08.876943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 232, pipe: [1:7556533198186412451:4391]
2025-10-02T08:08:08.976017Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:08.976469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:08.976479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:08.976494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186412451:4391], now have 1 active actors on pipe
2025-10-02T08:08:08.976625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:08.976634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:08.976705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 233 reason: error at write: Disconnected sessionId: src_id|71d56861-32997d45-eee81e0b-491062ac_0
2025-10-02T08:08:08.976744Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:08.976918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 233 sessionId: src_id|71d56861-32997d45-eee81e0b-491062ac_0 is DEAD
2025-10-02T08:08:08.977094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d56861-32997d45-eee81e0b-491062ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:08.977101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d56861-32997d45-eee81e0b-491062ac_0] Write session will restart in 0.006165s
2025-10-02T08:08:08.977119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d56861-32997d45-eee81e0b-491062ac_0] Write session: Do CDS request
2025-10-02T08:08:08.977125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d56861-32997d45-eee81e0b-491062ac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:08.977227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533198186412451:4391]
2025-10-02T08:08:08.977259Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:08.984360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d56861-32997d45-eee81e0b-491062ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.984419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:08.984433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 234
2025-10-02T08:08:08.984575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:08.984607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:08.984614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:08.984617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:08.984985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 234 sessionId:  describe result for acl check
2025-10-02T08:08:08.985015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:08.985017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:08.985019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:08.985022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533198186412744:4667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:08.985405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533198186412744:4667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:08.988602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533198186412744:4667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:08.992945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533198186412744:4667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:08.992973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533198186412744:4667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:08.992977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533198186412744:4667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:08.992987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:08.999635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:09.001352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:09.001627Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:09.001637Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:09.001648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:09.001703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:09.001742Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533202481380410:4666]
2025-10-02T08:08:09.002424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:09.002646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:09.002686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:09.002991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:09.003033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.003039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.003040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.003041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.003042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.003048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.003060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.003064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.003069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.003073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.003079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.003088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.003095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.003101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.003105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.003111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.003116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.003125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.003130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.003136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.003161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:09.012082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:09.013920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:09.013938Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:09.013940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:09.013943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:09.013949Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 233 [1:7556533202481380410:4666]
2025-10-02T08:08:09.013962Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:09.013979Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:09.013982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.013985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.013986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.013999Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:09.014004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:09.014010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:09.014074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.014082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.014085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:09.014087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:09.014148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:09.014157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.014170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.014187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:09.014207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533198186413108:4666]
2025-10-02T08:08:09.014213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533198186413108:4666]
2025-10-02T08:08:09.014221Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:09.014221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 233
2025-10-02T08:08:09.014233Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:09.014235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533198186412982:4667], now have 1 active actors on pipe
2025-10-02T08:08:09.014237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:09.014242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:09.014255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:09.014262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:09.014267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533198646791414:2378], now have 1 active actors on pipe
2025-10-02T08:08:09.014271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.014275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.014312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533198186413108:4666]
2025-10-02T08:08:09.014323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:09.014330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:09.014337Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cc1db33-b728ba60-b47d464-dca55f38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:09.014342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.014345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.014347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:09.014356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.014367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:09.014410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.014405Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 233
2025-10-02T08:08:09.014506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.014512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.014528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.014570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 234 partition: 0 MaxSeqNo: 17 sessionId: src_id|2cc1db33-b728ba60-b47d464-dca55f38_0
2025-10-02T08:08:09.014942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d56861-32997d45-eee81e0b-491062ac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2cc1db33-b728ba60-b47d464-dca55f38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:09.017920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cc1db33-b728ba60-b47d464-dca55f38_0] Write session: try to update token
2025-10-02T08:08:09.017936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cc1db33-b728ba60-b47d464-dca55f38_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:09.032955Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:09.032973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:09.032975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:09.032984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533198186413108:4666]
2025-10-02T08:08:09.032989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533198186413108:4666]
2025-10-02T08:08:09.033039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:09.033046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.033049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:09.033205Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:09.033261Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:09.033275Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:09.038437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId: src_id|2cc1db33-b728ba60-b47d464-dca55f38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:09.041093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:09.077722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533202481380435:4391]
2025-10-02T08:08:09.077840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 233, pipe: [1:7556533202481380435:4391]
2025-10-02T08:08:09.169950Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:09.170465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.170478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.170517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533202481380435:4391], now have 1 active actors on pipe
2025-10-02T08:08:09.170628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:09.170639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:09.170709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 234 reason: error at write: Disconnected sessionId: src_id|2cc1db33-b728ba60-b47d464-dca55f38_0
2025-10-02T08:08:09.170821Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:09.170929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 234 sessionId: src_id|2cc1db33-b728ba60-b47d464-dca55f38_0 is DEAD
2025-10-02T08:08:09.171178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cc1db33-b728ba60-b47d464-dca55f38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:09.171191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cc1db33-b728ba60-b47d464-dca55f38_0] Write session will restart in 0.008947s
2025-10-02T08:08:09.171178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533202481380435:4391]
2025-10-02T08:08:09.171223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cc1db33-b728ba60-b47d464-dca55f38_0] Write session: Do CDS request
2025-10-02T08:08:09.171234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cc1db33-b728ba60-b47d464-dca55f38_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:09.171471Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:09.181389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cc1db33-b728ba60-b47d464-dca55f38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:09.181450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:09.181467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 235
2025-10-02T08:08:09.181617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:09.181668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:09.181675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:09.181679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:09.182180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 235 sessionId:  describe result for acl check
2025-10-02T08:08:09.182234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:09.182243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:09.182245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:09.182250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533202481380833:4674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:09.182772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533202481380833:4674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:09.185719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533202481380833:4674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:09.189273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533202481380833:4674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:09.189291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533202481380833:4674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:09.189295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533202481380833:4674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:09.189305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:09.193675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:09.195029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:09.195311Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:09.195328Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:09.195352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:09.195492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:09.195529Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533202481381111:4672]
2025-10-02T08:08:09.196089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:09.196275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:09.196317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:09.196584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:09.196622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.196624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.196625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.196626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.196628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.196634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.196644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.196648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.196652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.196655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.196661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.196669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.196674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.196680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.196685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.196689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.196693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.196699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.196703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.196709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.196728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:09.206049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:09.208490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:09.208513Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:09.208516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:09.208520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:09.208529Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 234 [1:7556533202481381111:4672]
2025-10-02T08:08:09.208544Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:09.208567Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:09.208571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.208575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.208577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.208599Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:09.208606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:09.208619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:09.208708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.208718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.208721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:09.208724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:09.208831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:09.208842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.208859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.208872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:09.208902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533202481381029:4674], now have 1 active actors on pipe
2025-10-02T08:08:09.208915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533202481381105:4672]
2025-10-02T08:08:09.208922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533202481381105:4672]
2025-10-02T08:08:09.208938Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:09.208953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533202941758729:2378], now have 1 active actors on pipe
2025-10-02T08:08:09.208961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:09.208965Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:09.208969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:09.208985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:09.208993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:09.209044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533202481381105:4672]
2025-10-02T08:08:09.209052Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:09.209066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:09.209109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 234
2025-10-02T08:08:09.209123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.209129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.209165Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:09.209179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.209189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.209191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:09.209204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.209221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:09.209240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.209292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.209300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.209313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.209349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 235 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0
2025-10-02T08:08:09.211446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cc1db33-b728ba60-b47d464-dca55f38_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:09.211699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 234
2025-10-02T08:08:09.214681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0] Write session: try to update token
2025-10-02T08:08:09.214702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:09.224961Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:09.224982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:09.224996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533202481381105:4672]
2025-10-02T08:08:09.225053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:09.225068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:09.225249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:09.225412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:09.225599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:09.225775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:09.226032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:09.226080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:09.233071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId: src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:09.235955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:09.236224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.236241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.236282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:09.236311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:09.236434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.236443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.236636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.236702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.236780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.236884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.236939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.236950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.237027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.237098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.237169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.237253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.237315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.237328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.237413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.237507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.237580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.237657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.237712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.237714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.237791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.237861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.237934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.238009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.238057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.238060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.238137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.238231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.238309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.238389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.238447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.238456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.238535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.238612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.238685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.238753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.238808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.238815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.238892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.238965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.239040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.239114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.239276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.239286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.239364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.239436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.239513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.239584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.239640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.239647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.239727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.239802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.239886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.239967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.240025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.240032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.240124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.240195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.240272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.240354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.240502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.240510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.240557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:09.240636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.240663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.240670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:09.240708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:09.240728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:09.240736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:09.240740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:09.240742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:09.241269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:09.241301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:09.241312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:09.241321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:09.241329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:09.241333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:09.241841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:09.241866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:09.241880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:09.241884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:09.241887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:09.241892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:09.242651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:09.242676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:09.242686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:09.242694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:09.242702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:09.245417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:09.245439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:09.245452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392489244
2025-10-02T08:08:09.245584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:09.245599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:09.245610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:09.245618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:09.245623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:09.245631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:09.246254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:09.246278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:09.246289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:09.246292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:09.246299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:09.246307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:09.246967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:09.246990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:09.247000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:09.247008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:09.247011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:09.247019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:09.247485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:09.247508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:09.247518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:09.248814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:09.248830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:09.248838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:09.248843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:09.248856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392489248
2025-10-02T08:08:09.249149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:09.249171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:09.249177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:09.249181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:09.249190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:09.249194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:09.249719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:09.249740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:09.249750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:09.249754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:09.249758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:09.249768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:09.250292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:09.250313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.250432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392489250
2025-10-02T08:08:09.254536Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:09.254564Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:09.254572Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:09.254585Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:09.256332Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:09.256347Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:09.256350Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:09.256362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533202481381105:4672]
2025-10-02T08:08:09.256366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533202481381105:4672]
2025-10-02T08:08:09.256414Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:09.256426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:09.256435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:09.256441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.256444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:09.256592Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:09.271113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533202481381145:4391]
2025-10-02T08:08:09.271280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 234, pipe: [1:7556533202481381145:4391]
2025-10-02T08:08:09.412059Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:09.412505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533202481381145:4391], now have 1 active actors on pipe
2025-10-02T08:08:09.412657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533202481381145:4391]
2025-10-02T08:08:09.412856Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:09.412874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:09.412879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:09.412914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 235 reason: error at write: Disconnected sessionId: src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0
2025-10-02T08:08:09.413122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 235 sessionId: src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0 is DEAD
2025-10-02T08:08:09.413718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:09.413730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0] Write session will restart in 0.007174s
2025-10-02T08:08:09.413754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0] Write session: Do CDS request
2025-10-02T08:08:09.413761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:09.420747Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:09.424641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:09.424782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:09.424815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 236
2025-10-02T08:08:09.430206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:09.430280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:09.430286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:09.430292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:09.430951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 236 sessionId:  describe result for acl check
2025-10-02T08:08:09.430991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:09.430998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:09.431000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:09.431007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533202481381449:4683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:09.431563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533202481381449:4683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:09.437736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533202481381449:4683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:09.446650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533202481381449:4683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:09.446671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533202481381449:4683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:09.446675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533202481381449:4683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:09.446685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:09.455961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:09.457132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:09.457291Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:09.457294Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:09.457302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:09.457334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:09.457367Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533202481381823:4682]
2025-10-02T08:08:09.457854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:09.458064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:09.458102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:09.458605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:09.458741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.458749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.458750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.458751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.458752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.458756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.458763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.458766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.458768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.458770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.458777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.458782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.458786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.458790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.458796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.458799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.458802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.458805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.458809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.458812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.458823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:09.469303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:09.471446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:09.471454Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:09.471456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:09.471459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:09.471465Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 235 [1:7556533202481381823:4682]
2025-10-02T08:08:09.471475Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:09.471492Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:09.471494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.471496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.471498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.471514Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:09.471518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:09.471525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:09.471590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.471592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.471595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:09.471597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:09.471677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:09.471679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.471696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.471706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:09.471729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533202481381817:4682]
2025-10-02T08:08:09.471730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533202481381817:4682]
2025-10-02T08:08:09.471742Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:09.471758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:09.471771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:09.471775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:09.471785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:09.471787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533202481381661:4683], now have 1 active actors on pipe
2025-10-02T08:08:09.471788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:09.471828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533202481381817:4682]
2025-10-02T08:08:09.471831Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:09.471836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533202941758738:2378], now have 1 active actors on pipe
2025-10-02T08:08:09.471896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 235
2025-10-02T08:08:09.472064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:09.473187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 235
2025-10-02T08:08:09.476945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.476969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.477024Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:09.477040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.477046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.477049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:09.477065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.477084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:09.477103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.480173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.480194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.480241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.480299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 236 partition: 0 MaxSeqNo: 17 sessionId: src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0
2025-10-02T08:08:09.480939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f99992-f77c9ad8-d917415f-ce70f792_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:09.484001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0] Write session: try to update token
2025-10-02T08:08:09.484019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:09.508627Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:09.508650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:09.508655Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:09.508668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533202481381817:4682]
2025-10-02T08:08:09.508677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533202481381817:4682]
2025-10-02T08:08:09.508752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:09.508761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.508764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:09.508979Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:09.511826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533202481381847:4391]
2025-10-02T08:08:09.511912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:09.511916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:09.512073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 235, pipe: [1:7556533202481381847:4391]
2025-10-02T08:08:09.515075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId: src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:09.518030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:09.665170Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:09.665644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533202481381847:4391], now have 1 active actors on pipe
2025-10-02T08:08:09.665658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.665665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.665926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:09.666039Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:09.666355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533202481381847:4391]
2025-10-02T08:08:09.666379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:09.666441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 236 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0
2025-10-02T08:08:09.666604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 236 sessionId: src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0 is DEAD
2025-10-02T08:08:09.666826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:09.666841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0] Write session will restart in 0.006085s
2025-10-02T08:08:09.666871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0] Write session: Do CDS request
2025-10-02T08:08:09.666878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:09.674377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:09.674472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:09.674489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 237
2025-10-02T08:08:09.674597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:09.674630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:09.674635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:09.674639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:09.675181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 237 sessionId:  describe result for acl check
2025-10-02T08:08:09.675228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:09.675237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:09.675239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:09.675246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533202481382141:4699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:09.675849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533202481382141:4699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:09.678737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533202481382141:4699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:09.682837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533202481382141:4699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:09.682855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533202481382141:4699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:09.682859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533202481382141:4699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:09.682870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:09.702403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:09.704078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:09.704299Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:09.704308Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:09.704320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:09.704371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:09.704406Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533202481382545:4698]
2025-10-02T08:08:09.705016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:09.705256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:09.705312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:09.705666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:09.705714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.705721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.705723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.705724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.705725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.705731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.705743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.705748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.705752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.705756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.705763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.705773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.705788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.705799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.705804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.705811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.705816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.705826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.705835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.705848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.705874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:09.716363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:09.718459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:09.718480Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:09.718482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:09.718487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:09.718495Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 236 [1:7556533202481382545:4698]
2025-10-02T08:08:09.718512Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:09.718533Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:09.718537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.718540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.718542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.718563Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:09.718579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:09.718588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:09.718671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.718682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.718686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:09.718689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:09.718775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:09.718782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.718801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.718821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:09.718848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533202481382539:4698]
2025-10-02T08:08:09.718854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533202481382539:4698]
2025-10-02T08:08:09.718864Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:09.718878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:09.718881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533202481382292:4699], now have 1 active actors on pipe
2025-10-02T08:08:09.718882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:09.718892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:09.718909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:09.718912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:09.718922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533202941758744:2378], now have 1 active actors on pipe
2025-10-02T08:08:09.718964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533202481382539:4698]
2025-10-02T08:08:09.718979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:09.719016Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:09.719046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 236
2025-10-02T08:08:09.719269Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 236
2025-10-02T08:08:09.719069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.719082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.719111Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:09.719119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.719124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.719126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:09.719137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.719149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:09.719165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.719399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.719406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.719428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.719459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 237 partition: 0 MaxSeqNo: 17 sessionId: src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0
2025-10-02T08:08:09.719917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3a62a4-b23fb630-3cc497b-13a5cc61_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:09.722675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0] Write session: try to update token
2025-10-02T08:08:09.722692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:09.732413Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:09.732433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:09.732445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533202481382539:4698]
2025-10-02T08:08:09.732494Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:09.732501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:09.732888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:09.733052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:09.733202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:09.733375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:09.733633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:09.733684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:09.739661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId: src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:09.742703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:09.742810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.742831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.742872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:09.742904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:09.742972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.742991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.743184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.743268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.743354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.743423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.743475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.743490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.743560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.743625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.743689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.743756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.743808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.743816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.743886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.743956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.744028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.744111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.744166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.744173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.744245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.744313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.744381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.744452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.744521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.744529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.744604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.744675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.744740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.744826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.744878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.744885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.744955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.745018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.745080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.745149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.745196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.745203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.745273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.745340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.745415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.745493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.745551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.745558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.745634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.745697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.745766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.745834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.745885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.745892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.745961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.746025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.746097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.746167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.746218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.746226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.746298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:09.746364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:09.746432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:09.746501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:09.746567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:09.746578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:09.746618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:09.746675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.746701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.746704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:09.746735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:09.746753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:09.746760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:09.746763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:09.746765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:09.747186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:09.747219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:09.747230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:09.747233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:09.747238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:09.747240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:09.747852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:09.747880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:09.747887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:09.747890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:09.747893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:09.747896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:09.748536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:09.748561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:09.748567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:09.748575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:09.748578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:09.750037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:09.750056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:09.750067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392489749
2025-10-02T08:08:09.750197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:09.750217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:09.750223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:09.750227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:09.750231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:09.750234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:09.750939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:09.750967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:09.750973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:09.750976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:09.750979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:09.750982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:09.751500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:09.751526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:09.751542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:09.751545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:09.751549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:09.751552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:09.752111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:09.752138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:09.752151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:09.753425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:09.753450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:09.753455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:09.753459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:09.753467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392489753
2025-10-02T08:08:09.753802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:09.753828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:09.753834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:09.753837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:09.753841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:09.753845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:09.754400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:09.754428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:09.754438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:09.754441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:09.754445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:09.754448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:09.755003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:09.755029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.755131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392489754
2025-10-02T08:08:09.756029Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:09.756061Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:09.756068Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:09.756080Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:09.757815Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:09.757831Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:09.757833Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:09.757841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533202481382539:4698]
2025-10-02T08:08:09.757845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533202481382539:4698]
2025-10-02T08:08:09.757891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:09.757902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:09.757910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:09.757917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.757920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:09.758064Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:09.766717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533202481382579:4391]
2025-10-02T08:08:09.766773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 236, pipe: [1:7556533202481382579:4391]
2025-10-02T08:08:09.898730Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:09.899335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533202481382579:4391], now have 1 active actors on pipe
2025-10-02T08:08:09.899473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533202481382579:4391]
2025-10-02T08:08:09.899500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:09.899506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:09.899532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 237 reason: error at write: Disconnected sessionId: src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0
2025-10-02T08:08:09.899589Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:09.899693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 237 sessionId: src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0 is DEAD
2025-10-02T08:08:09.899879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:09.900697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:09.900708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0] Write session will restart in 0.007087s
2025-10-02T08:08:09.900733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0] Write session: Do CDS request
2025-10-02T08:08:09.900740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:09.909398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:09.912954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:09.912968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 238
2025-10-02T08:08:09.916972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:09.917032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:09.917036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:09.917040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:09.917564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 238 sessionId:  describe result for acl check
2025-10-02T08:08:09.917618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:09.917620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:09.917622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:09.917627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533202481383026:4708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:09.918248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533202481383026:4708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:09.920622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533202481383026:4708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:09.925024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533202481383026:4708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:09.925043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533202481383026:4708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:09.925047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533202481383026:4708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:09.925055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:09.928763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:09.930283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:09.930838Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:09.930851Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:09.930861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:09.930919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:09.930958Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533202481383271:4707]
2025-10-02T08:08:09.931655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:09.931881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:09.931924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:09.932257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:09.932311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.932317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.932318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.932319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.932320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.932325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.932336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.932341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.932350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.932354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.932360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.932367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:09.932377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.932383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:09.932393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.932398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:09.932402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.932406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.932411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.932416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.932438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:09.941671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:09.943994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:09.944013Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:09.944016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:09.944020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:09.944026Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 237 [1:7556533202481383271:4707]
2025-10-02T08:08:09.944038Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:09.944065Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:09.944069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.944072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.944075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.944090Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:09.944095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:09.944101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:09.944172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.944180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.944183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:09.944185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:09.944249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:09.944257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.944271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:09.944283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:09.944300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533202481383253:4707]
2025-10-02T08:08:09.944306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533202481383253:4707]
2025-10-02T08:08:09.944313Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:09.944326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533202481383182:4708], now have 1 active actors on pipe
2025-10-02T08:08:09.944326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:09.944329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:09.944334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 237
2025-10-02T08:08:09.944338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:09.944351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:09.944354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:09.944360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533202941758775:2378], now have 1 active actors on pipe
2025-10-02T08:08:09.944403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.944422Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 237
2025-10-02T08:08:09.944415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.944428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533202481383253:4707]
2025-10-02T08:08:09.944431Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:09.944445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:09.944457Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ee81449-5964795a-98fa1083-fc1178e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:09.944463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:09.944467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:09.944469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:09.944477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:09.944486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:09.944513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.944552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:09.944554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:09.944566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:09.944610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 238 partition: 0 MaxSeqNo: 17 sessionId: src_id|7ee81449-5964795a-98fa1083-fc1178e1_0
2025-10-02T08:08:09.944973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd5ddf0-743a19dd-9b3fd4c1-be3f1de0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7ee81449-5964795a-98fa1083-fc1178e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:09.948126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ee81449-5964795a-98fa1083-fc1178e1_0] Write session: try to update token
2025-10-02T08:08:09.948141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ee81449-5964795a-98fa1083-fc1178e1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:09.962952Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:09.962971Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:09.962973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:09.962985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533202481383253:4707]
2025-10-02T08:08:09.962989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533202481383253:4707]
2025-10-02T08:08:09.963036Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:09.963042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:09.963050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:09.963050Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:09.963052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:09.963197Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:09.968000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId: src_id|7ee81449-5964795a-98fa1083-fc1178e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:09.970785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:10.000861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533206776350595:4391]
2025-10-02T08:08:10.001113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 237, pipe: [1:7556533206776350595:4391]
2025-10-02T08:08:10.107439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ee81449-5964795a-98fa1083-fc1178e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:10.107455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ee81449-5964795a-98fa1083-fc1178e1_0] Write session will restart in 0.009362s
2025-10-02T08:08:10.107482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ee81449-5964795a-98fa1083-fc1178e1_0] Write session: Do CDS request
2025-10-02T08:08:10.107489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ee81449-5964795a-98fa1083-fc1178e1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:10.107539Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:10.106334Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:10.106565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.106572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.106605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776350595:4391], now have 1 active actors on pipe
2025-10-02T08:08:10.106871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533206776350595:4391]
2025-10-02T08:08:10.106874Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:10.106886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:10.106888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:10.106947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 238 reason: error at write: Disconnected sessionId: src_id|7ee81449-5964795a-98fa1083-fc1178e1_0
2025-10-02T08:08:10.107107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 238 sessionId: src_id|7ee81449-5964795a-98fa1083-fc1178e1_0 is DEAD
2025-10-02T08:08:10.121425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ee81449-5964795a-98fa1083-fc1178e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.121843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:10.121861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 239
2025-10-02T08:08:10.121876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:10.123444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:10.123652Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:10.123660Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:10.123671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:10.123719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:10.123770Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533206776350656:4713]
2025-10-02T08:08:10.124357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:10.124540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:10.124577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:10.124834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:10.124866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.124870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.124871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.124871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.124872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.124875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.124882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.124884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.124886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.124888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.124892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.124899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.124904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.124909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.124913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.124917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.124921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.124925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.124930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.124934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.124950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:10.128066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.128119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:10.128129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:10.128133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:10.128578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 239 sessionId:  describe result for acl check
2025-10-02T08:08:10.128613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:10.128619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:10.128621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:10.128627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533206776350671:4715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:10.129143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533206776350671:4715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:10.131317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533206776350671:4715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:10.133684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:10.135895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:10.135911Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:10.135913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:10.135917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:10.135923Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 238 [1:7556533206776350656:4713]
2025-10-02T08:08:10.135935Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:10.135955Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:10.135958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.135961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.135963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.135980Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:10.135986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:10.135986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533206776350671:4715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:10.135992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:10.135995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533206776350671:4715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:10.135998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533206776350671:4715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:10.136006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:10.136072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.136081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.136083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:10.136086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:10.136148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:10.136154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.136167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.136182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:10.136206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533207236726091:2378], now have 1 active actors on pipe
2025-10-02T08:08:10.136217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533206776350648:4713]
2025-10-02T08:08:10.136219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533206776350648:4713]
2025-10-02T08:08:10.136225Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:10.136235Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:10.136238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:10.136242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:10.136253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:10.136256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:10.136250Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 238
2025-10-02T08:08:10.136287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533206776350648:4713]
2025-10-02T08:08:10.136296Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:10.136297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:10.136307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776350702:4715], now have 1 active actors on pipe
2025-10-02T08:08:10.136351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 238
2025-10-02T08:08:10.136404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.136410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.136433Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:10.136444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.136451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.136453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:10.136461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.136469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:10.136483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.136518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.136527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.136539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.136566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 239 partition: 0 MaxSeqNo: 17 sessionId: src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0
2025-10-02T08:08:10.136891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ee81449-5964795a-98fa1083-fc1178e1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:10.140197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0] Write session: try to update token
2025-10-02T08:08:10.140213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:10.149930Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:10.149950Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:10.149959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533206776350648:4713]
2025-10-02T08:08:10.150001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:10.150197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:10.150367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:10.150518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:10.150672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:10.150896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:10.150930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:10.151055Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:10.160726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId: src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:10.163620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:10.163732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.163747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.163785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:10.163813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:10.163865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.163877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.164056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.164114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.164197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.164259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.164306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.164316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.164383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.164440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.164508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.164579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.164619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.164626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.164692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.164756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.164851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.164916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.164968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.164978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.165053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.165122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.165190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.165256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.165305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.165312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.165383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.165444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.165510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.165578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.165623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.165630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.165700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.165756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.165816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.165881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.165927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.165933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.166001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.166067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.166138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.166207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.166260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.166269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.166336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.166400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.166465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.166529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.166578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.166587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.166657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.166728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.166800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.166871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.166920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.166927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.167002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:10.167070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:10.167146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:10.167217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:10.167270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:10.167277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:10.167339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:10.167401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.167423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.167426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:10.167459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:10.167475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:10.167482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:10.167485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:10.167488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:10.167916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:10.167943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:10.167951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:10.167955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:10.167958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:10.167961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:10.168566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:10.168587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:10.168593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:10.168596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:10.168599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:10.168603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:10.172668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:10.172709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:10.172720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:10.172724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:10.172727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:10.174247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:10.174276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:10.174291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392490174
2025-10-02T08:08:10.174424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:10.174437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:10.174447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:10.174450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:10.174454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:10.174457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:10.175063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:10.175079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:10.175086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:10.175093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:10.175096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:10.175099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:10.175893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:10.175910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:10.175922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:10.175926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:10.175931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:10.175936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:10.176556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:10.176569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:10.176574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:10.177927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:10.177951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:10.177957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:10.177961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:10.177973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392490177
2025-10-02T08:08:10.178314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:10.178339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:10.178345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:10.178348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:10.178352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:10.178356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:10.178842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:10.178863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:10.178868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:10.178872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:10.178875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:10.178878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:10.179423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:10.179445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.179545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392490179
2025-10-02T08:08:10.182354Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:10.182383Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:10.182390Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:10.182400Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:10.182410Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:10.182417Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:10.182419Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:10.182428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533206776350648:4713]
2025-10-02T08:08:10.182431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533206776350648:4713]
2025-10-02T08:08:10.182470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:10.182485Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:10.182500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:10.182509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.182511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:10.182670Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:10.205016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533206776350729:4391]
2025-10-02T08:08:10.205144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 238, pipe: [1:7556533206776350729:4391]
2025-10-02T08:08:10.327434Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:10.327746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776350729:4391], now have 1 active actors on pipe
2025-10-02T08:08:10.327850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533206776350729:4391]
2025-10-02T08:08:10.327867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:10.327873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:10.327900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 239 reason: error at write: Disconnected sessionId: src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0
2025-10-02T08:08:10.327956Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:10.328111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 239 sessionId: src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0 is DEAD
2025-10-02T08:08:10.328299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:10.328310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0] Write session will restart in 0.005832s
2025-10-02T08:08:10.328279Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:10.328335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0] Write session: Do CDS request
2025-10-02T08:08:10.328343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:10.332328Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [48f7f458fde4e506] Result# TEvPutResult {Id# [72075186224037892:238:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:10.332350Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:238:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:10.332440Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:238:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:10.335394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.335491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:10.335503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 240
2025-10-02T08:08:10.335619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.335646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:10.335655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:10.335659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:10.336083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 240 sessionId:  describe result for acl check
2025-10-02T08:08:10.336111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:10.336116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:10.336118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:10.336125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533206776350784:4721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:10.336591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533206776350784:4721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:10.337073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:10.338286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:10.338473Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:10.338485Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:10.338497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:10.338558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:10.338577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533206776350784:4721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:10.338602Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533206776350816:4720]
2025-10-02T08:08:10.339181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:10.339389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:10.339441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:10.339732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:10.339804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.339814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.339815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.339816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.339817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.339822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.339831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.339836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.339840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.339844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.339849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.339856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.339861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.339866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.339871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.339876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.339880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.339885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.339889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.339894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.339914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:10.344932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533206776350784:4721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:10.344949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533206776350784:4721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:10.344953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533206776350784:4721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:10.344963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:10.348219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:10.349952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:10.349970Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:10.349973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:10.349976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:10.349984Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 239 [1:7556533206776350816:4720]
2025-10-02T08:08:10.349995Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:10.350012Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:10.350014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.350017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.350021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.350035Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:10.350041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:10.350047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:10.350108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.350116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.350119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:10.350121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:10.350183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:10.350191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.350204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.350216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:10.350237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533207236726098:2378], now have 1 active actors on pipe
2025-10-02T08:08:10.350245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776350844:4721], now have 1 active actors on pipe
2025-10-02T08:08:10.350245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 239
2025-10-02T08:08:10.350254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533206776350795:4720]
2025-10-02T08:08:10.350260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533206776350795:4720]
2025-10-02T08:08:10.350274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:10.350292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:10.350297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:10.350301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:10.350308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:10.350314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:10.350322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.350326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.350367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533206776350795:4720]
2025-10-02T08:08:10.350377Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:10.350390Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:10.350394Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:10.350401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.350406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.350412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:10.350420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.350432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:10.350471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.350556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.350565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.350581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.350627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 240 partition: 0 MaxSeqNo: 17 sessionId: src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0
2025-10-02T08:08:10.351133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90eb873e-cb0a4163-67240d33-74d38fdf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:10.354362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 239
2025-10-02T08:08:10.354711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0] Write session: try to update token
2025-10-02T08:08:10.354730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:10.372392Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:10.372408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:10.372411Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:10.372419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533206776350795:4720]
2025-10-02T08:08:10.372422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533206776350795:4720]
2025-10-02T08:08:10.372468Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:10.372472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:10.372475Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:10.372480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.372481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:10.372632Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:10.374783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId: src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:10.377584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:10.428262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533206776350864:4391]
2025-10-02T08:08:10.428409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 239, pipe: [1:7556533206776350864:4391]
2025-10-02T08:08:10.517123Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:10.517447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.517467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.517507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776350864:4391], now have 1 active actors on pipe
2025-10-02T08:08:10.517619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:10.517633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:10.517687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 240 reason: error at write: Disconnected sessionId: src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0
2025-10-02T08:08:10.517745Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:10.517758Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:10.517838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 240 sessionId: src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0 is DEAD
2025-10-02T08:08:10.517961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:10.517968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0] Write session will restart in 0.009934s
2025-10-02T08:08:10.517991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0] Write session: Do CDS request
2025-10-02T08:08:10.517997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:10.518001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533206776350864:4391]
2025-10-02T08:08:10.523721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:10.525133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:10.525334Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:10.525346Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:10.525356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:10.525420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:10.525460Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533206776350923:4727]
2025-10-02T08:08:10.526066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:10.526251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:10.526302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:10.526638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:10.526700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.526705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.526706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.526707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.526708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.526713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.526722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.526727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.526731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.526734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.526738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.526743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.526747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.526750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.526752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.526755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.526757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.526761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.526773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.526778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.526798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:10.529375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.529737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:10.529748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 241
2025-10-02T08:08:10.529881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.529910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:10.529919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:10.529923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:10.530323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 241 sessionId:  describe result for acl check
2025-10-02T08:08:10.530381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:10.530389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:10.530391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:10.530396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533206776350940:4729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:10.530887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533206776350940:4729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:10.533495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533206776350940:4729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:10.534962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:10.536726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:10.536740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533206776350940:4729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:10.536746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533206776350940:4729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:10.536748Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:10.536750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:10.536751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533206776350940:4729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:10.536754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:10.536760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:10.536760Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 240 [1:7556533206776350923:4727]
2025-10-02T08:08:10.536771Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:10.536787Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:10.536790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.536794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.536796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.536827Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:10.536832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:10.536837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:10.536892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.536902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.536904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:10.536906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:10.536960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:10.536969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.536982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.536993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:10.537009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533207236726107:2378], now have 1 active actors on pipe
2025-10-02T08:08:10.537019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533206776350917:4727]
2025-10-02T08:08:10.537021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533206776350917:4727]
2025-10-02T08:08:10.537027Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:10.537042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:10.537045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:10.537026Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 240
2025-10-02T08:08:10.537048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:10.537058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:10.537061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:10.537086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 240
2025-10-02T08:08:10.537091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533206776350917:4727]
2025-10-02T08:08:10.537094Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:10.537103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:10.537105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776350971:4729], now have 1 active actors on pipe
2025-10-02T08:08:10.537109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.537113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.537160Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e68429f-8340b064-fd197f19-15b0cf29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:10.537170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.537173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.537175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:10.537182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.537191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:10.537214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.537286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.537300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.537326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.537366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 241 partition: 0 MaxSeqNo: 17 sessionId: src_id|e68429f-8340b064-fd197f19-15b0cf29_0
2025-10-02T08:08:10.537736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c1c3ad-e7bd96f5-64b5a9e3-3f0c049_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e68429f-8340b064-fd197f19-15b0cf29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:10.540792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68429f-8340b064-fd197f19-15b0cf29_0] Write session: try to update token
2025-10-02T08:08:10.541379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68429f-8340b064-fd197f19-15b0cf29_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:10.556996Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:10.557016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:10.557019Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:10.557029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533206776350917:4727]
2025-10-02T08:08:10.557034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533206776350917:4727]
2025-10-02T08:08:10.557080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:10.557087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.557096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:10.557267Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:10.560621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId: src_id|e68429f-8340b064-fd197f19-15b0cf29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:10.560873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:10.560893Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:10.563635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:10.618250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533206776350987:4391]
2025-10-02T08:08:10.619734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 240, pipe: [1:7556533206776350987:4391]
2025-10-02T08:08:10.698083Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:10.698560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.698576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.698614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776350987:4391], now have 1 active actors on pipe
2025-10-02T08:08:10.698799Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:10.698849Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:10.699068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533206776350987:4391]
2025-10-02T08:08:10.699091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:10.699144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e68429f-8340b064-fd197f19-15b0cf29_0
2025-10-02T08:08:10.699313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 241 sessionId: src_id|e68429f-8340b064-fd197f19-15b0cf29_0 is DEAD
2025-10-02T08:08:10.699493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68429f-8340b064-fd197f19-15b0cf29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:10.699508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68429f-8340b064-fd197f19-15b0cf29_0] Write session will restart in 0.008417s
2025-10-02T08:08:10.699538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68429f-8340b064-fd197f19-15b0cf29_0] Write session: Do CDS request
2025-10-02T08:08:10.699545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68429f-8340b064-fd197f19-15b0cf29_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:10.705344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:10.706856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:10.707049Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:10.707058Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:10.707067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:10.707117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:10.707157Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533206776351080:4743]
2025-10-02T08:08:10.707793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:10.708061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:10.708128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:10.708455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:10.708500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.708507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.708508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.708509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.708511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.708517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.708527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.708535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.708539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.708543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.708552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.708560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.708566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.708571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.708576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.708582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.708586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.708593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.708598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.708603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.708630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:10.709992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68429f-8340b064-fd197f19-15b0cf29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.710409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:10.710422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 242
2025-10-02T08:08:10.710615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.710653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:10.710661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:10.710664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:10.711087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 242 sessionId:  describe result for acl check
2025-10-02T08:08:10.711121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:10.711122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:10.711124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:10.711130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533206776351096:4745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:10.711648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533206776351096:4745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:10.719900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533206776351096:4745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:10.722093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:10.724324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:10.724342Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:10.724345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:10.724348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:10.724355Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 241 [1:7556533206776351080:4743]
2025-10-02T08:08:10.724366Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:10.724381Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:10.724384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.724387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.724389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.724404Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:10.724409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:10.724416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:10.724473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533206776351096:4745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:10.724479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.724482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.724485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:10.724486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533206776351096:4745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:10.724487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:10.724490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533206776351096:4745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:10.724499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:10.724555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:10.724563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.724577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.724592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:10.724614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533206776351074:4743]
2025-10-02T08:08:10.724622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533206776351074:4743]
2025-10-02T08:08:10.724631Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:10.724643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533207236726114:2378], now have 1 active actors on pipe
2025-10-02T08:08:10.724650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:10.724663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:10.724666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:10.724700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533206776351074:4743]
2025-10-02T08:08:10.724708Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:10.724766Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:10.724774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:10.724780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:10.724840Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 241
2025-10-02T08:08:10.725512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68429f-8340b064-fd197f19-15b0cf29_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:10.724969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776351125:4745], now have 1 active actors on pipe
2025-10-02T08:08:10.724991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 241
2025-10-02T08:08:10.724997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.725002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.725027Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:10.725034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.725038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.725042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:10.725052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.725061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:10.725077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.725098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.725100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.725112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.725138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 242 partition: 0 MaxSeqNo: 17 sessionId: src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0
2025-10-02T08:08:10.729037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0] Write session: try to update token
2025-10-02T08:08:10.729050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:10.740796Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:10.740831Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:10.740840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533206776351074:4743]
2025-10-02T08:08:10.740885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:10.740886Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:10.741074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:10.741229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:10.741402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:10.741573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:10.742006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:10.742052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:10.753730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId: src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:10.758727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:10.759495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.759514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.759533Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:10.759539Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:10.759542Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:10.759550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533206776351074:4743]
2025-10-02T08:08:10.759553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533206776351074:4743]
2025-10-02T08:08:10.759587Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:10.759598Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:10.759607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:10.759614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.759616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:10.759761Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:10.798946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533206776351142:4391]
2025-10-02T08:08:10.800607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 241, pipe: [1:7556533206776351142:4391]
2025-10-02T08:08:10.898791Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:10.899281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:10.899506Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:10.900160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:10.900175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0] Write session will restart in 0.006351s
2025-10-02T08:08:10.899311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776351142:4391], now have 1 active actors on pipe
2025-10-02T08:08:10.899339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:10.900209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0] Write session: Do CDS request
2025-10-02T08:08:10.899787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:10.899790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:10.900218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:10.899808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 242 reason: error at write: Disconnected sessionId: src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0
2025-10-02T08:08:10.899943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 242 sessionId: src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0 is DEAD
2025-10-02T08:08:10.900123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533206776351142:4391]
2025-10-02T08:08:10.905281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:10.906446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:10.906654Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:10.906664Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:10.906675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:10.906743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:10.906783Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533206776351216:4752]
2025-10-02T08:08:10.907360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:10.907413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.907505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:10.907517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 243
2025-10-02T08:08:10.907576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:10.907615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:10.907712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:10.907755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:10.907764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:10.907768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:10.907895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:10.907940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.907945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.907956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.907960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.907960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.907964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.907970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.907972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.907974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.907976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.907982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.907986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:10.907990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.907993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:10.907996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.907999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:10.908001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.908003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.908006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.908009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.908027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:10.908146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 243 sessionId:  describe result for acl check
2025-10-02T08:08:10.908201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:10.908203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:10.908204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:10.908209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533206776351230:4754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:10.908705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533206776351230:4754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:10.910955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533206776351230:4754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:10.915999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533206776351230:4754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:10.916017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533206776351230:4754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:10.916021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533206776351230:4754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:10.916031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:10.916629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:10.918306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:10.918322Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:10.918325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:10.918330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:10.918335Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 242 [1:7556533206776351216:4752]
2025-10-02T08:08:10.918345Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:10.918362Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:10.918369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.918373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.918375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.918387Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:10.918395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:10.918403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:10.918470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.918476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.918479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:10.918481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:10.918540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:10.918546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.918560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:10.918575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:10.918596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533206776351260:4754], now have 1 active actors on pipe
2025-10-02T08:08:10.918603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533207236726144:2378], now have 1 active actors on pipe
2025-10-02T08:08:10.918605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 242
2025-10-02T08:08:10.918608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533206776351210:4752]
2025-10-02T08:08:10.918610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533206776351210:4752]
2025-10-02T08:08:10.918617Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:10.918629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:10.918628Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:10.918631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:10.918645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:10.918648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:10.918655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.918663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.918674Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 242
2025-10-02T08:08:10.918700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533206776351210:4752]
2025-10-02T08:08:10.918705Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:10.918709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:10.918718Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:10.918725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:10.918728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:10.918730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:10.918738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:10.918752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:10.918794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.918850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:10.918858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:10.918871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:10.918902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 243 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0
2025-10-02T08:08:10.919302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429c7a75-f8b124a4-251f83c5-90517f1e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:10.922332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0] Write session: try to update token
2025-10-02T08:08:10.922355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:10.936195Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:10.936210Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:10.936212Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:10.936219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533206776351210:4752]
2025-10-02T08:08:10.936222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533206776351210:4752]
2025-10-02T08:08:10.936263Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:10.936266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:10.936267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:10.936272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:10.936274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:10.936434Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:10.944872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId: src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:10.947652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:11.000148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533211071318571:4391]
2025-10-02T08:08:11.000245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 242, pipe: [1:7556533211071318571:4391]
2025-10-02T08:08:11.077390Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:11.077717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.077735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.077754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071318571:4391], now have 1 active actors on pipe
2025-10-02T08:08:11.077843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:11.077850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:11.077901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 243 reason: error at write: Disconnected sessionId: src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0
2025-10-02T08:08:11.077984Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:11.078004Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:11.078068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 243 sessionId: src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0 is DEAD
2025-10-02T08:08:11.078240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:11.078250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0] Write session will restart in 0.007705s
2025-10-02T08:08:11.078235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533211071318571:4391]
2025-10-02T08:08:11.078285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0] Write session: Do CDS request
2025-10-02T08:08:11.078292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:11.084058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:11.085302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:11.085483Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:11.085492Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:11.085501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:11.085560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:11.085608Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533211071318637:4758]
2025-10-02T08:08:11.086225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:11.086423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:11.086463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:11.086762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:11.086807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.086812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.086813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.086815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.086816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.086821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.086832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.086837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.086841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.086844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.086850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.086857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.086866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.086871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.086877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.086887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.086893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.086903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.086907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.086917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.086935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:11.087343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.087440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:11.087452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 244
2025-10-02T08:08:11.087589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.087617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:11.087625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:11.087628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:11.087959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 244 sessionId:  describe result for acl check
2025-10-02T08:08:11.087988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:11.087995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:11.087997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:11.088001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533211071318654:4760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:11.088439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533211071318654:4760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:11.090654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533211071318654:4760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:11.094928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533211071318654:4760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:11.094948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533211071318654:4760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:11.094951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533211071318654:4760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:11.094962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:11.095443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:11.096987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:11.097001Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:11.097003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:11.097006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:11.097011Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 243 [1:7556533211071318637:4758]
2025-10-02T08:08:11.097023Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:11.097039Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:11.097042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.097045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.097047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.097062Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:11.097071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:11.097075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:11.097118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.097123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.097125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:11.097127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:11.097187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:11.097196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.097208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.097219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:11.097241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071318686:4760], now have 1 active actors on pipe
2025-10-02T08:08:11.097249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 243
2025-10-02T08:08:11.097251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533211071318631:4758]
2025-10-02T08:08:11.097252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533211071318631:4758]
2025-10-02T08:08:11.097259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:11.097266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533211531693446:2378], now have 1 active actors on pipe
2025-10-02T08:08:11.097271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:11.097274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:11.097274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:11.097284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:11.097292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:11.097298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.097302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.097346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533211071318631:4758]
2025-10-02T08:08:11.097353Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:11.097328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 243
2025-10-02T08:08:11.097366Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:11.097367Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:11.097372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.097376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.097378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:11.097385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.097393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:11.097433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.097495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.097501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.097513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.097550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 244 partition: 0 MaxSeqNo: 17 sessionId: src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0
2025-10-02T08:08:11.097854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d891a9-34e103f4-cc7ef36b-bd8197a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:11.100853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0] Write session: try to update token
2025-10-02T08:08:11.100871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:11.116650Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:11.116669Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:11.116671Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:11.116677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533211071318631:4758]
2025-10-02T08:08:11.116683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533211071318631:4758]
2025-10-02T08:08:11.116724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:11.116729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.116737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:11.116737Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:11.116744Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:11.116902Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:11.119871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId: src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:11.122879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:11.178330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533211071318700:4391]
2025-10-02T08:08:11.178524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 243, pipe: [1:7556533211071318700:4391]
2025-10-02T08:08:11.255757Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:11.256120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.256135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.256166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071318700:4391], now have 1 active actors on pipe
2025-10-02T08:08:11.256245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:11.256254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:11.256298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 244 reason: error at write: Disconnected sessionId: src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0
2025-10-02T08:08:11.256357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:11.256388Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:11.256455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 244 sessionId: src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0 is DEAD
2025-10-02T08:08:11.256569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533211071318700:4391]
2025-10-02T08:08:11.256613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:11.256624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0] Write session will restart in 0.006250s
2025-10-02T08:08:11.256649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0] Write session: Do CDS request
2025-10-02T08:08:11.256655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:11.261671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:11.263245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:11.263428Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:11.263438Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:11.263457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:11.263508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:11.263550Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533211071318781:4765]
2025-10-02T08:08:11.264241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:11.264316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.264411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:11.264420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 245
2025-10-02T08:08:11.264473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:11.264545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.264549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:11.264573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:11.264582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:11.264585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:11.264902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:11.264941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 245 sessionId:  describe result for acl check
2025-10-02T08:08:11.264956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.264957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.264958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.264959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.264960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.264966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.264974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:11.264976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:11.264975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.264977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:11.264980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.264982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533211071318793:4767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:11.264984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.264987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.264993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.264999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.265005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.265010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.265014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.265018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.265022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.265037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.265041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.265046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.265061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:11.265477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533211071318793:4767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:11.267292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533211071318793:4767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:11.272735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533211071318793:4767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:11.272755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533211071318793:4767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:11.272758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533211071318793:4767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:11.272767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:11.273516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:11.275208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:11.275223Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:11.275226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:11.275230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:11.275237Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 244 [1:7556533211071318781:4765]
2025-10-02T08:08:11.275247Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:11.275265Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:11.275272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.275275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.275277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.275294Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:11.275299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:11.275304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:11.275369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.275376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.275378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:11.275381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:11.275443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:11.275450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.275462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.275480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:11.275487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 244
2025-10-02T08:08:11.275498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071318829:4767], now have 1 active actors on pipe
2025-10-02T08:08:11.275506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533211531693465:2378], now have 1 active actors on pipe
2025-10-02T08:08:11.275512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533211071318775:4765]
2025-10-02T08:08:11.275514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533211071318775:4765]
2025-10-02T08:08:11.275525Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:11.275535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.275539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.275539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:11.275542Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:11.275558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:11.275575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:11.275578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:11.275577Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 244
2025-10-02T08:08:11.275616Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|254f2367-e7664427-cc7a4695-63a53ddf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:11.275626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.275629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.275631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:11.275638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.275650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:11.275657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533211071318775:4765]
2025-10-02T08:08:11.275667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:11.275681Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:11.275696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.275781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.275795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.275810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.275852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 245 partition: 0 MaxSeqNo: 17 sessionId: src_id|254f2367-e7664427-cc7a4695-63a53ddf_0
2025-10-02T08:08:11.276224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|febb2723-4bf0e344-be841a91-e8bf44c7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|254f2367-e7664427-cc7a4695-63a53ddf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:11.279665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|254f2367-e7664427-cc7a4695-63a53ddf_0] Write session: try to update token
2025-10-02T08:08:11.279688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|254f2367-e7664427-cc7a4695-63a53ddf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:11.292932Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:11.292947Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:11.292949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:11.292959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533211071318775:4765]
2025-10-02T08:08:11.292963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533211071318775:4765]
2025-10-02T08:08:11.293002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:11.293010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.293011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:11.293017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:11.293023Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:11.293171Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:11.309167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId: src_id|254f2367-e7664427-cc7a4695-63a53ddf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:11.311941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:11.356485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533211071318850:4391]
2025-10-02T08:08:11.356587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 244, pipe: [1:7556533211071318850:4391]
2025-10-02T08:08:11.436404Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:11.436790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.436816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.436835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071318850:4391], now have 1 active actors on pipe
2025-10-02T08:08:11.436926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533211071318850:4391]
2025-10-02T08:08:11.436945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:11.436952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:11.437007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 245 reason: error at write: Disconnected sessionId: src_id|254f2367-e7664427-cc7a4695-63a53ddf_0
2025-10-02T08:08:11.437094Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:11.437071Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:11.437174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 245 sessionId: src_id|254f2367-e7664427-cc7a4695-63a53ddf_0 is DEAD
2025-10-02T08:08:11.437515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|254f2367-e7664427-cc7a4695-63a53ddf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:11.437529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|254f2367-e7664427-cc7a4695-63a53ddf_0] Write session will restart in 0.008560s
2025-10-02T08:08:11.437560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|254f2367-e7664427-cc7a4695-63a53ddf_0] Write session: Do CDS request
2025-10-02T08:08:11.437568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|254f2367-e7664427-cc7a4695-63a53ddf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:11.443555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:11.447472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|254f2367-e7664427-cc7a4695-63a53ddf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.447606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:11.447850Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:11.447854Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:11.447864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:11.447932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:11.447968Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533211071318928:4772]
2025-10-02T08:08:11.448640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:11.448711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:11.448715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 246
2025-10-02T08:08:11.448872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:11.448916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:11.449036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.449075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:11.449081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:11.449084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:11.449215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:11.449275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.449283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.449284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.449286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.449287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.449292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.449303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.449307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.449311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.449315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.449320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.449327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.449333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.449339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.449344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.449350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.449359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.449364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.449369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.449378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.449396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:11.449498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 246 sessionId:  describe result for acl check
2025-10-02T08:08:11.449529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:11.449534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:11.449537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:11.449543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533211071318942:4774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:11.450059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533211071318942:4774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:11.453125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533211071318942:4774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:11.458175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533211071318942:4774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:11.458191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533211071318942:4774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:11.458194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533211071318942:4774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:11.458203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:11.458834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:11.460533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:11.460557Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:11.460559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:11.460563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:11.460570Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 245 [1:7556533211071318928:4772]
2025-10-02T08:08:11.460582Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:11.460601Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:11.460604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.460608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.460610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.460628Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:11.460633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:11.460639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:11.460702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.460712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.460715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:11.460717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:11.460785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:11.460788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.460817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.460829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:11.460849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071318975:4774], now have 1 active actors on pipe
2025-10-02T08:08:11.460852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533211531693475:2378], now have 1 active actors on pipe
2025-10-02T08:08:11.460858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533211071318922:4772]
2025-10-02T08:08:11.460860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533211071318922:4772]
2025-10-02T08:08:11.460867Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:11.460879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:11.460890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:11.460893Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:11.460893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:11.460896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:11.460928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533211071318922:4772]
2025-10-02T08:08:11.460937Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:11.460967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:11.460979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 245
2025-10-02T08:08:11.461183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.461198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.461236Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:11.461244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.461248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.461251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:11.461261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.461272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:11.461289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.461411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.461432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.461446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.461479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 246 partition: 0 MaxSeqNo: 17 sessionId: src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0
2025-10-02T08:08:11.461953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|254f2367-e7664427-cc7a4695-63a53ddf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:11.462974Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 245
2025-10-02T08:08:11.465157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0] Write session: try to update token
2025-10-02T08:08:11.465179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:11.483226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId: src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:11.484126Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:11.484130Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:11.484132Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:11.484141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533211071318922:4772]
2025-10-02T08:08:11.484144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533211071318922:4772]
2025-10-02T08:08:11.484184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:11.484188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.484188Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:11.484190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:11.484193Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:11.484375Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:11.486025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:11.540907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533211071318989:4391]
2025-10-02T08:08:11.541222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 245, pipe: [1:7556533211071318989:4391]
2025-10-02T08:08:11.646081Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:11.646404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.646418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.646457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071318989:4391], now have 1 active actors on pipe
2025-10-02T08:08:11.646568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533211071318989:4391]
2025-10-02T08:08:11.646657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:11.646661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:11.646701Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:11.646747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 246 reason: error at write: Disconnected sessionId: src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0
2025-10-02T08:08:11.646939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 246 sessionId: src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0 is DEAD
2025-10-02T08:08:11.647191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:11.647207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0] Write session will restart in 0.005395s
2025-10-02T08:08:11.647235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0] Write session: Do CDS request
2025-10-02T08:08:11.647245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:11.647321Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:11.652719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:11.654097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:11.654410Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:11.654431Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:11.654459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:11.654548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:11.654623Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533211071319063:4778]
2025-10-02T08:08:11.655463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:11.655735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:11.655802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:11.656176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:11.656259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.656265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.656266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.656267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.656268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.656274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.656285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.656291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.656296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.656299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.656305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.656313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.656323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.656328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.656333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.656337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.656347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.656352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.656357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.656361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.656384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:11.657814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.657859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:11.657881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 247
2025-10-02T08:08:11.658057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.658111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:11.658124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:11.658129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:11.658622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 247 sessionId:  describe result for acl check
2025-10-02T08:08:11.658662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:11.658672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:11.658675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:11.658681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533211071319079:4780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:11.659273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533211071319079:4780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:11.662377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533211071319079:4780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:11.665436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:11.667315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:11.667322Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:11.667325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:11.667328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:11.667334Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 246 [1:7556533211071319063:4778]
2025-10-02T08:08:11.667345Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:11.667365Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:11.667368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.667371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.667373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.667391Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:11.667396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:11.667403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:11.667470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.667472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.667475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:11.667477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:11.667547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:11.667549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.667564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.667573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:11.667589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533211071319057:4778]
2025-10-02T08:08:11.667591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533211071319057:4778]
2025-10-02T08:08:11.667678Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:11.667679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:11.668053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:11.668068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:11.668088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:11.668090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:11.668098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533211531693481:2378], now have 1 active actors on pipe
2025-10-02T08:08:11.668128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533211071319057:4778]
2025-10-02T08:08:11.668137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:11.668179Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:11.668493Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 246
2025-10-02T08:08:11.669002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533211071319079:4780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:11.669015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533211071319079:4780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:11.669018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533211071319079:4780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:11.669026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:11.669511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 246
2025-10-02T08:08:11.669526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071319117:4780], now have 1 active actors on pipe
2025-10-02T08:08:11.669550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.669559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.669582Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:11.669596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.669609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.669611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:11.669620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.669635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:11.669655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.669751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.669764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.669788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.669835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 247 partition: 0 MaxSeqNo: 17 sessionId: src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0
2025-10-02T08:08:11.670336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dd2f1c-a7ace940-a9531cfd-26be9960_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:11.673556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0] Write session: try to update token
2025-10-02T08:08:11.673581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:11.691000Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:11.691020Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:11.691022Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:11.691031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533211071319057:4778]
2025-10-02T08:08:11.691036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533211071319057:4778]
2025-10-02T08:08:11.691086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:11.691092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.691094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:11.691269Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:11.692907Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:11.692920Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:11.765556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId: src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:11.768399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:11.770840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533211071319140:4391]
2025-10-02T08:08:11.771033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 246, pipe: [1:7556533211071319140:4391]
2025-10-02T08:08:11.865376Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:11.865840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.865848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.865866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071319140:4391], now have 1 active actors on pipe
2025-10-02T08:08:11.865996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:11.866006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:11.866058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 247 reason: error at write: Disconnected sessionId: src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0
2025-10-02T08:08:11.866066Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:11.866113Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:11.866220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 247 sessionId: src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0 is DEAD
2025-10-02T08:08:11.866313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533211071319140:4391]
2025-10-02T08:08:11.866342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:11.866350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0] Write session will restart in 0.008832s
2025-10-02T08:08:11.866375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0] Write session: Do CDS request
2025-10-02T08:08:11.866381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:11.873498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:11.873927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:11.874072Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:11.874080Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:11.874087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:11.874130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:11.874170Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533211071319230:4795]
2025-10-02T08:08:11.874733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:11.874978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:11.875059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:11.875392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:11.875466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.875473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.875476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.875477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.875478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.875484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.875504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.875508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.875512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.875517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.875527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.875535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:11.875545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.875551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:11.875555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.875560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:11.875569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.875574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.875583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.875588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.875613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:11.876327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.876385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:11.876397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 248
2025-10-02T08:08:11.876539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:11.876575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:11.876583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:11.876587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:11.876992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 248 sessionId:  describe result for acl check
2025-10-02T08:08:11.877022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:11.877028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:11.877030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:11.877035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533211071319246:4797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:11.877496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533211071319246:4797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:11.879621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533211071319246:4797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:11.882911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533211071319246:4797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:11.882928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533211071319246:4797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:11.882931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533211071319246:4797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:11.882938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:11.883652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:11.885692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:11.885713Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:11.885715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:11.885718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:11.885724Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 247 [1:7556533211071319230:4795]
2025-10-02T08:08:11.885734Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:11.885751Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:11.885753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.885756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.885758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.885773Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:11.885778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:11.885784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:11.885856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.885863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.885866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:11.885868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:11.885927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:11.885936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.885949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:11.885960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:11.885976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 247
2025-10-02T08:08:11.885978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071319278:4797], now have 1 active actors on pipe
2025-10-02T08:08:11.885981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533211531693503:2378], now have 1 active actors on pipe
2025-10-02T08:08:11.885987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533211071319224:4795]
2025-10-02T08:08:11.885990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533211071319224:4795]
2025-10-02T08:08:11.886001Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:11.886011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.886015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.886026Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:11.886028Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:11.886033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:11.886046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:11.886048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:11.886088Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:11.886103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:11.886106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:11.886108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:11.886115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:11.886123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:11.886092Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 247
2025-10-02T08:08:11.886130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533211071319224:4795]
2025-10-02T08:08:11.886133Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:11.886145Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:11.886155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.886255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:11.886286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:11.886312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:11.886359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 248 partition: 0 MaxSeqNo: 17 sessionId: src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0
2025-10-02T08:08:11.886692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cf7e23-817377f7-de0e49c5-a1ef9f22_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:11.889885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0] Write session: try to update token
2025-10-02T08:08:11.889904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:11.901706Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:11.901721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:11.901729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533211071319224:4795]
2025-10-02T08:08:11.901770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:11.901795Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:11.901951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:11.902087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:11.902215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:11.902351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:11.902535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:11.902565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:11.911740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId: src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:11.912739Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:11.912759Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:11.912762Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:11.912770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533211071319224:4795]
2025-10-02T08:08:11.912774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533211071319224:4795]
2025-10-02T08:08:11.912832Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:11.912839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:11.912845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:11.912845Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:11.912847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:11.912996Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:11.914786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:11.966254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533211071319301:4391]
2025-10-02T08:08:11.966370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 247, pipe: [1:7556533211071319301:4391]
2025-10-02T08:08:12.058885Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:12.059240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.059253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.059272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533211071319301:4391], now have 1 active actors on pipe
2025-10-02T08:08:12.059383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533211071319301:4391]
2025-10-02T08:08:12.059401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:12.059408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:12.059459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 248 reason: error at write: Disconnected sessionId: src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0
2025-10-02T08:08:12.059502Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:12.059620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 248 sessionId: src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0 is DEAD
2025-10-02T08:08:12.059944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:12.059954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0] Write session will restart in 0.005230s
2025-10-02T08:08:12.059979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0] Write session: Do CDS request
2025-10-02T08:08:12.059989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:12.060980Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:12.066294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.066628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:12.066642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 249
2025-10-02T08:08:12.066896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:12.068109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.068148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:12.068154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:12.068157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:12.068410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:12.068562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 249 sessionId:  describe result for acl check
2025-10-02T08:08:12.068591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:12.068597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:12.068599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:12.068604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533215366286675:4805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:12.068617Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:12.068621Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:12.068632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:12.068699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:12.068739Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533215366286676:4803]
2025-10-02T08:08:12.069099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533215366286675:4805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:12.069379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:12.069925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:12.069992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:12.070340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:12.070388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.070395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.070396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.070397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.070398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.070404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.070414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.070418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.070422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.070426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.070432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.070440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.070446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.070450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.070454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.070458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.070463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.070468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.070473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.070477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.070497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:12.071865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533215366286675:4805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:12.082266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533215366286675:4805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:12.082286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533215366286675:4805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:12.082289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533215366286675:4805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:12.082297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:12.082829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:12.084540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:12.084552Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:12.084554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:12.084558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:12.084564Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 248 [1:7556533215366286676:4803]
2025-10-02T08:08:12.084575Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:12.084591Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:12.084595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.084598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.084600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.084616Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:12.084620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:12.084626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:12.084680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.084691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.084694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:12.084696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:12.084758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:12.084767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.084779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.084796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:12.084837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533215366286666:4803]
2025-10-02T08:08:12.084843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533215366286666:4803]
2025-10-02T08:08:12.084850Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:12.084863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366286720:4805], now have 1 active actors on pipe
2025-10-02T08:08:12.084864Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:12.084867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:12.084875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:12.084888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:12.084891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:12.084896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533215826660815:2378], now have 1 active actors on pipe
2025-10-02T08:08:12.084926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533215366286666:4803]
2025-10-02T08:08:12.084933Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:12.084954Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:12.084970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 248
2025-10-02T08:08:12.084984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.084993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.085024Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:12.085035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.085039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.085040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:12.085048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.085057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:12.085071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.085098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.085104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.085117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.085147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 249 partition: 0 MaxSeqNo: 17 sessionId: src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0
2025-10-02T08:08:12.084935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 248
2025-10-02T08:08:12.085540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b7af26-539e0173-7b7eab50-c0cbf803_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:12.088486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0] Write session: try to update token
2025-10-02T08:08:12.088509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:12.097672Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:12.097692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:12.097705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533215366286666:4803]
2025-10-02T08:08:12.097747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:12.097747Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:12.097927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:12.098075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:12.098228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:12.098363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:12.098563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:12.098599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:12.114141Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:12.114158Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:12.114160Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:12.114169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533215366286666:4803]
2025-10-02T08:08:12.114173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533215366286666:4803]
2025-10-02T08:08:12.114221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:12.114233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.114235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:12.114398Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:12.114827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:12.114834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:12.117509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId: src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:12.120549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:12.162659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533215366286736:4391]
2025-10-02T08:08:12.162755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 248, pipe: [1:7556533215366286736:4391]
2025-10-02T08:08:12.261300Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:12.261598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.261618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.261642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366286736:4391], now have 1 active actors on pipe
2025-10-02T08:08:12.261746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533215366286736:4391]
2025-10-02T08:08:12.261768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:12.261774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:12.261829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 249 reason: error at write: Disconnected sessionId: src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0
2025-10-02T08:08:12.261873Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:12.261910Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:12.262008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 249 sessionId: src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0 is DEAD
2025-10-02T08:08:12.262195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:12.262207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0] Write session will restart in 0.006885s
2025-10-02T08:08:12.262237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0] Write session: Do CDS request
2025-10-02T08:08:12.262244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:12.270342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.270418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:12.270436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 250
2025-10-02T08:08:12.270559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.270590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:12.270595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:12.270599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:12.270810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:12.270981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 250 sessionId:  describe result for acl check
2025-10-02T08:08:12.271014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:12.271020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:12.271022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:12.271027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533215366286829:4812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:12.271486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533215366286829:4812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:12.272356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:12.272536Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:12.272545Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:12.272554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:12.272598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:12.272636Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533215366286847:4810]
2025-10-02T08:08:12.273234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:12.273447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:12.273449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533215366286829:4812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:12.273490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:12.273769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:12.273813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.273820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.273821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.273822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.273823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.273828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.273837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.273841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.273844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.273848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.273853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.273860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.273865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.273871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.273875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.273879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.273883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.273889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.273894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.273899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.273917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:12.279969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533215366286829:4812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:12.279984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533215366286829:4812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:12.279987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533215366286829:4812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:12.279995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:12.282205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:12.283881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:12.283899Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:12.283901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:12.283905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:12.283910Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 249 [1:7556533215366286847:4810]
2025-10-02T08:08:12.283920Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:12.283936Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:12.283943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.283945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.283946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.283959Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:12.283962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:12.283967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:12.284011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.284020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.284022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:12.284024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:12.284084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:12.284089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.284097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.284104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:12.284117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533215366286823:4810]
2025-10-02T08:08:12.284123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533215366286823:4810]
2025-10-02T08:08:12.284130Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:12.284142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:12.284154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:12.284158Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:12.284159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:12.284161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:12.284170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366286877:4812], now have 1 active actors on pipe
2025-10-02T08:08:12.284170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 249
2025-10-02T08:08:12.284207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533215826660834:2378], now have 1 active actors on pipe
2025-10-02T08:08:12.284217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533215366286823:4810]
2025-10-02T08:08:12.284226Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:12.284237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.284244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.284244Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:12.284363Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:12.284376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.284381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.284383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:12.284393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.284406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:12.284442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.284499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.284505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.284519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.284556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 250 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0
2025-10-02T08:08:12.284272Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 249
2025-10-02T08:08:12.284913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44326cf2-757ce8c1-6bfd13ef-48c9eede_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:12.288048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0] Write session: try to update token
2025-10-02T08:08:12.288069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:12.301613Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:12.301633Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:12.301636Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:12.301647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533215366286823:4810]
2025-10-02T08:08:12.301650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533215366286823:4810]
2025-10-02T08:08:12.301690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:12.301691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:12.301696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:12.301701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.301703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:12.301851Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:12.314978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId: src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:12.317667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:12.362062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533215366286898:4391]
2025-10-02T08:08:12.362189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 249, pipe: [1:7556533215366286898:4391]
2025-10-02T08:08:12.442216Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:12.442521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.442534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.442554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366286898:4391], now have 1 active actors on pipe
2025-10-02T08:08:12.442646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:12.442655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:12.443046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:12.443057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0] Write session will restart in 0.008008s
2025-10-02T08:08:12.443081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0] Write session: Do CDS request
2025-10-02T08:08:12.443087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:12.442710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 250 reason: error at write: Disconnected sessionId: src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0
2025-10-02T08:08:12.442753Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:12.442888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 250 sessionId: src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0 is DEAD
2025-10-02T08:08:12.443058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533215366286898:4391]
2025-10-02T08:08:12.442758Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:12.448609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:12.450075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:12.450253Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:12.450260Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:12.450268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:12.450313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:12.450350Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533215366286985:4817]
2025-10-02T08:08:12.450958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:12.451189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:12.451239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:12.451540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:12.451576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.451581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.451582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.451583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.451584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.451588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.451596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.451598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.451601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.451604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.451609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.451616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.451629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.451634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.451637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.451641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.451645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.451649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.451652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.451656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.451672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:12.452270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.452552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:12.452563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 251
2025-10-02T08:08:12.452676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.452701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:12.452710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:12.452713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:12.453205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 251 sessionId:  describe result for acl check
2025-10-02T08:08:12.453264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:12.453271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:12.453274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:12.453280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533215366287001:4819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:12.453980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533215366287001:4819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:12.456571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533215366287001:4819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:12.463329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533215366287001:4819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:12.463347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533215366287001:4819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:12.463350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533215366287001:4819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:12.463358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:12.463996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:12.465704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:12.465718Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:12.465719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:12.465722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:12.465727Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 250 [1:7556533215366286985:4817]
2025-10-02T08:08:12.465735Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:12.465751Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:12.465753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.465756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.465758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.465776Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:12.465779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:12.465785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:12.465831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.465837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.465840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:12.465842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:12.465893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:12.465900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.465911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.465928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:12.465944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533215366286979:4817]
2025-10-02T08:08:12.465949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533215366286979:4817]
2025-10-02T08:08:12.465955Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:12.465960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 250
2025-10-02T08:08:12.465966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366287033:4819], now have 1 active actors on pipe
2025-10-02T08:08:12.465966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:12.465969Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:12.465972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533215826660844:2378], now have 1 active actors on pipe
2025-10-02T08:08:12.465976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:12.465990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:12.465997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:12.466003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.466007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.466042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533215366286979:4817]
2025-10-02T08:08:12.466048Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:12.466051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:12.466027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 250
2025-10-02T08:08:12.466059Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da96ea35-bfb4ac89-19717437-712766b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:12.466069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.466073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.466077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:12.466106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.466118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:12.466149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.466197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.466210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.466235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.466278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 251 partition: 0 MaxSeqNo: 17 sessionId: src_id|da96ea35-bfb4ac89-19717437-712766b3_0
2025-10-02T08:08:12.466778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f772944-34adb9b7-e77945dc-bb0ecd84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da96ea35-bfb4ac89-19717437-712766b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:12.469648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da96ea35-bfb4ac89-19717437-712766b3_0] Write session: try to update token
2025-10-02T08:08:12.469662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da96ea35-bfb4ac89-19717437-712766b3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:12.483744Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:12.483762Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:12.483763Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:12.483769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533215366286979:4817]
2025-10-02T08:08:12.483772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533215366286979:4817]
2025-10-02T08:08:12.483812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:12.483816Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:12.483818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.483819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:12.483821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:12.483956Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:12.489560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId: src_id|da96ea35-bfb4ac89-19717437-712766b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:12.492300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:12.543319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533215366287047:4391]
2025-10-02T08:08:12.543484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 250, pipe: [1:7556533215366287047:4391]
2025-10-02T08:08:12.624706Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:12.625058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.625073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.625092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366287047:4391], now have 1 active actors on pipe
2025-10-02T08:08:12.625238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533215366287047:4391]
2025-10-02T08:08:12.625271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:12.625274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:12.625288Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:12.625263Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:12.625353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 251 reason: error at write: Disconnected sessionId: src_id|da96ea35-bfb4ac89-19717437-712766b3_0
2025-10-02T08:08:12.625551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 251 sessionId: src_id|da96ea35-bfb4ac89-19717437-712766b3_0 is DEAD
2025-10-02T08:08:12.625732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da96ea35-bfb4ac89-19717437-712766b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:12.625741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da96ea35-bfb4ac89-19717437-712766b3_0] Write session will restart in 0.006018s
2025-10-02T08:08:12.625769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da96ea35-bfb4ac89-19717437-712766b3_0] Write session: Do CDS request
2025-10-02T08:08:12.625775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da96ea35-bfb4ac89-19717437-712766b3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:12.632129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:12.633298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da96ea35-bfb4ac89-19717437-712766b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.633346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:12.633547Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:12.633556Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:12.633566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:12.633611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:12.633614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:12.633620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 252
2025-10-02T08:08:12.633648Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533215366287130:4823]
2025-10-02T08:08:12.633900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.633927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:12.633935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:12.633938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:12.634256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:12.634270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 252 sessionId:  describe result for acl check
2025-10-02T08:08:12.634293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:12.634300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:12.634302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:12.634306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533215366287135:4825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:12.634459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:12.634513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:12.634742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533215366287135:4825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:12.634840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:12.634906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.634913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.634914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.634915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.634916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.634922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.634930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.634937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.634945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.634948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.634954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.634963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.634972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.634976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.634980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.634985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.634993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.634998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.635002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.635008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.635029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:12.636850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533215366287135:4825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:12.642521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533215366287135:4825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:12.642540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533215366287135:4825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:12.642543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533215366287135:4825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:12.642551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:12.643143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:12.644717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:12.644734Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:12.644736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:12.644740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:12.644745Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 251 [1:7556533215366287130:4823]
2025-10-02T08:08:12.644755Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:12.644773Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:12.644780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.644783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.644784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.645076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 251
2025-10-02T08:08:12.645667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da96ea35-bfb4ac89-19717437-712766b3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c50a1017-790d7e24-15609e25-5e366a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:12.644817Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:12.644828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:12.644834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:12.644885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.644887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.644890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:12.644892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:12.644954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:12.644956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.644967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.644978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:12.644993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533215366287124:4823]
2025-10-02T08:08:12.644994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533215366287124:4823]
2025-10-02T08:08:12.645000Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:12.645008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 251
2025-10-02T08:08:12.645012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:12.645014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366287178:4825], now have 1 active actors on pipe
2025-10-02T08:08:12.645015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:12.645018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533215826660851:2378], now have 1 active actors on pipe
2025-10-02T08:08:12.645025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:12.645037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:12.645040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:12.645046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.645049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.645086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533215366287124:4823]
2025-10-02T08:08:12.645088Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:12.645102Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c50a1017-790d7e24-15609e25-5e366a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:12.645107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:12.645107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.645111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.645113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:12.645125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.645132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:12.645173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.645228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.645234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.645260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.645297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 252 partition: 0 MaxSeqNo: 17 sessionId: src_id|c50a1017-790d7e24-15609e25-5e366a_0
2025-10-02T08:08:12.648851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50a1017-790d7e24-15609e25-5e366a_0] Write session: try to update token
2025-10-02T08:08:12.648869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50a1017-790d7e24-15609e25-5e366a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:12.662725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:12.662747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:12.662749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:12.662757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533215366287124:4823]
2025-10-02T08:08:12.662761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533215366287124:4823]
2025-10-02T08:08:12.662806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:12.662807Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:12.662812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.662813Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:12.662814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:12.662973Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:12.668133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId: src_id|c50a1017-790d7e24-15609e25-5e366a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:12.670805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:12.725596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533215366287192:4391]
2025-10-02T08:08:12.725709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 251, pipe: [1:7556533215366287192:4391]
2025-10-02T08:08:12.800866Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:12.801185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.801195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.801209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366287192:4391], now have 1 active actors on pipe
2025-10-02T08:08:12.801297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533215366287192:4391]
2025-10-02T08:08:12.801401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:12.801402Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:12.801613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:12.801664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 252 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c50a1017-790d7e24-15609e25-5e366a_0
2025-10-02T08:08:12.801818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 252 sessionId: src_id|c50a1017-790d7e24-15609e25-5e366a_0 is DEAD
2025-10-02T08:08:12.801956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50a1017-790d7e24-15609e25-5e366a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:12.801976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50a1017-790d7e24-15609e25-5e366a_0] Write session will restart in 0.005957s
2025-10-02T08:08:12.802000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50a1017-790d7e24-15609e25-5e366a_0] Write session: Do CDS request
2025-10-02T08:08:12.802006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50a1017-790d7e24-15609e25-5e366a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:12.807374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:12.808611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:12.808778Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:12.808785Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:12.808795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:12.808872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:12.808912Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533215366287293:4836]
2025-10-02T08:08:12.809295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c50a1017-790d7e24-15609e25-5e366a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.809564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:12.809616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:12.809623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 253
2025-10-02T08:08:12.809719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:12.809756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:12.810048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:12.810100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.810106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.810107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.810108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.810109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.810115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.810124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.810131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.810134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.810141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.810147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.810157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:12.810167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.810171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:12.810174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.810178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:12.810181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.810185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.810189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.810193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.810211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:12.810253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:12.810280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:12.810288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:12.810291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:12.810598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 253 sessionId:  describe result for acl check
2025-10-02T08:08:12.810625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:12.810631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:12.810632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:12.810637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533215366287309:4838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:12.811079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533215366287309:4838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:12.813095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533215366287309:4838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:12.817567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533215366287309:4838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:12.817581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533215366287309:4838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:12.817585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533215366287309:4838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:12.817593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:12.818606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:12.820260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:12.820275Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:12.820278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:12.820281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:12.820285Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 252 [1:7556533215366287293:4836]
2025-10-02T08:08:12.820292Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:12.820304Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:12.820305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.820307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.820309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.820320Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:12.820323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:12.820328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:12.820368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.820373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.820375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:12.820376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:12.820420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:12.820426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.820434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:12.820441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:12.820452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533215366287287:4836]
2025-10-02T08:08:12.820456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533215366287287:4836]
2025-10-02T08:08:12.820463Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:12.820475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:12.820477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366287341:4838], now have 1 active actors on pipe
2025-10-02T08:08:12.820484Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:12.820484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:12.820496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:12.820498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:12.820502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533215826660862:2378], now have 1 active actors on pipe
2025-10-02T08:08:12.820533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533215366287287:4836]
2025-10-02T08:08:12.820545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:12.820551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:12.820551Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 252
2025-10-02T08:08:12.820601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 252
2025-10-02T08:08:12.820667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.820673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.820695Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c5f2401-cde49a1c-2cdd730-773def33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:12.820702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.820704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.820706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:12.820711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.820718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:12.820731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.820766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.820771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.820780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:12.820832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 253 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c5f2401-cde49a1c-2cdd730-773def33_0
2025-10-02T08:08:12.821131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c50a1017-790d7e24-15609e25-5e366a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c5f2401-cde49a1c-2cdd730-773def33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:12.824245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5f2401-cde49a1c-2cdd730-773def33_0] Write session: try to update token
2025-10-02T08:08:12.824261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5f2401-cde49a1c-2cdd730-773def33_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:12.831230Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:12.831246Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:12.831254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533215366287287:4836]
2025-10-02T08:08:12.831297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:12.831296Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:12.831478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:12.831631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:12.831776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:12.831930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:12.832165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:12.832204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:12.842917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId: src_id|5c5f2401-cde49a1c-2cdd730-773def33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:12.845842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:12.846204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.846230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.846275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:12.846346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:12.850965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:12.851001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:12.851238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.851328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.851444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.851535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.851589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.851595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.851832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.851918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.852006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.852110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.852165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.852168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.852268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.852340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.852421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.852499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.852552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.852555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.852647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.852725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.852830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.852911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.852969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.852972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.853060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.853135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.853209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.853288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.853342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.853346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.853424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.853493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.853573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.853652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.853709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.853713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.853799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.853872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.853953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.854032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.854205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.854209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.854297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.854365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.854436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.854514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.854576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.854579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.854671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.854745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.854820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.854903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.854963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.854967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.855059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:12.855136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:12.855220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:12.855303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:12.855779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:12.855796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:12.855858Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:12.855865Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:12.855869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:12.855880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533215366287287:4836]
2025-10-02T08:08:12.855885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533215366287287:4836]
2025-10-02T08:08:12.855946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:12.855955Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:12.855961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:12.856044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:12.856160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:12.856168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:12.856212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:12.856231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:12.856235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:12.856238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:12.856241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:12.856742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:12.856765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:12.856774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:12.856777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:12.856782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:12.856785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:12.857364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:12.857382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:12.857389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:12.857392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:12.857396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:12.857399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:12.858149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:12.858166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:12.858172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:12.858176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:12.858179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:12.860631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:12.860645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:12.860665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392492860
2025-10-02T08:08:12.860793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:12.861033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:12.861047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:12.861051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:12.861055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:12.861059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:12.861655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:12.861670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:12.861679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:12.861682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:12.861685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:12.861690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:12.862260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:12.862276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:12.862283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:12.862286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:12.862290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:12.862294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:12.863039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:12.863064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:12.863070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:12.864247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:12.864255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:12.864260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:12.864265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:12.864276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392492863
2025-10-02T08:08:12.864587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:12.864601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:12.864607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:12.864611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:12.864615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:12.864618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:12.865140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:12.865151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:12.865155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:12.865160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:12.865162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:12.865165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:12.865679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:12.865692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:12.865810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392492865
2025-10-02T08:08:12.866822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:12.866841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:12.866843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:12.867011Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:12.901700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533215366287377:4391]
2025-10-02T08:08:12.901780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 252, pipe: [1:7556533215366287377:4391]
2025-10-02T08:08:13.019599Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:13.020052Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:13.020086Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:13.020095Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:13.020103Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:13.020125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533215366287377:4391], now have 1 active actors on pipe
2025-10-02T08:08:13.020424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:13.020452Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:13.022675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:13.022721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 253 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c5f2401-cde49a1c-2cdd730-773def33_0
2025-10-02T08:08:13.022915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 253 sessionId: src_id|5c5f2401-cde49a1c-2cdd730-773def33_0 is DEAD
2025-10-02T08:08:13.023096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5f2401-cde49a1c-2cdd730-773def33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:13.023107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5f2401-cde49a1c-2cdd730-773def33_0] Write session will restart in 0.008073s
2025-10-02T08:08:13.023132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5f2401-cde49a1c-2cdd730-773def33_0] Write session: Do CDS request
2025-10-02T08:08:13.023140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5f2401-cde49a1c-2cdd730-773def33_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:13.023121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533215366287377:4391]
2025-10-02T08:08:13.028165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:13.031240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:13.031482Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:13.031495Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:13.031507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:13.031569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:13.031626Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533219661254774:4848]
2025-10-02T08:08:13.032384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5f2401-cde49a1c-2cdd730-773def33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.032330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:13.032615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:13.032666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:13.032742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:13.032756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 254
2025-10-02T08:08:13.033023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:13.033022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.033057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:13.033063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:13.033067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:13.033103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.033111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.033112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.033113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.033115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.033121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.033132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.033138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.033142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.033146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.033153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.033161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.033168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.033174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.033179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.033183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.033188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.033193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.033197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.033201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.033221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:13.033499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 254 sessionId:  describe result for acl check
2025-10-02T08:08:13.033526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:13.033538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:13.033540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:13.033547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533219661254790:4850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:13.034086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533219661254790:4850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:13.036614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533219661254790:4850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:13.043023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:13.043509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533219661254790:4850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:13.043516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533219661254790:4850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:13.043520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533219661254790:4850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:13.043530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:13.044732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:13.044739Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:13.044741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:13.044745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:13.044753Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 253 [1:7556533219661254774:4848]
2025-10-02T08:08:13.044764Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:13.044785Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:13.044789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.044793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.044794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.044833Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:13.044841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:13.044849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:13.044924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.044929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.044932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:13.044936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:13.045012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:13.045014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.045031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.045043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:13.045064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661254818:4850], now have 1 active actors on pipe
2025-10-02T08:08:13.045068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 253
2025-10-02T08:08:13.045073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533219661254767:4848]
2025-10-02T08:08:13.045075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533219661254767:4848]
2025-10-02T08:08:13.045084Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:13.045097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:13.045111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:13.045114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:13.045124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533220121628187:2378], now have 1 active actors on pipe
2025-10-02T08:08:13.045129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.045133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.045180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533219661254767:4848]
2025-10-02T08:08:13.045183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:13.045199Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f85e131d-8774e061-8282cea5-bb04a039_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:13.045206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.045210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.045212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:13.045215Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:13.045217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:13.045224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:13.045224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.045234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:13.045270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.045392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.045400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.045427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.045467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 254 partition: 0 MaxSeqNo: 17 sessionId: src_id|f85e131d-8774e061-8282cea5-bb04a039_0
2025-10-02T08:08:13.045928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c5f2401-cde49a1c-2cdd730-773def33_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f85e131d-8774e061-8282cea5-bb04a039_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:13.045909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 253
2025-10-02T08:08:13.048994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85e131d-8774e061-8282cea5-bb04a039_0] Write session: try to update token
2025-10-02T08:08:13.049012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85e131d-8774e061-8282cea5-bb04a039_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:13.065111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId: src_id|f85e131d-8774e061-8282cea5-bb04a039_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:13.066331Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:13.066352Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:13.066354Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:13.066363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533219661254767:4848]
2025-10-02T08:08:13.066366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533219661254767:4848]
2025-10-02T08:08:13.066408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:13.066423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.066424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:13.066431Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:13.066437Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:13.066561Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:13.067840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:13.123397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533219661254833:4391]
2025-10-02T08:08:13.123552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 253, pipe: [1:7556533219661254833:4391]
2025-10-02T08:08:13.206471Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:13.206871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.206888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.206926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661254833:4391], now have 1 active actors on pipe
2025-10-02T08:08:13.207053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:13.207065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:13.207130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 254 reason: error at write: Disconnected sessionId: src_id|f85e131d-8774e061-8282cea5-bb04a039_0
2025-10-02T08:08:13.207134Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:13.207302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 254 sessionId: src_id|f85e131d-8774e061-8282cea5-bb04a039_0 is DEAD
2025-10-02T08:08:13.207373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533219661254833:4391]
2025-10-02T08:08:13.207449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85e131d-8774e061-8282cea5-bb04a039_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:13.207460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85e131d-8774e061-8282cea5-bb04a039_0] Write session will restart in 0.006619s
2025-10-02T08:08:13.207486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85e131d-8774e061-8282cea5-bb04a039_0] Write session: Do CDS request
2025-10-02T08:08:13.207493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85e131d-8774e061-8282cea5-bb04a039_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:13.208917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:13.215269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85e131d-8774e061-8282cea5-bb04a039_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.215304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:13.215318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 255
2025-10-02T08:08:13.215443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:13.215476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.215507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:13.215516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:13.215519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:13.215898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 255 sessionId:  describe result for acl check
2025-10-02T08:08:13.215929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:13.215930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:13.215931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:13.215936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533219661254934:4857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:13.216418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533219661254934:4857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:13.217064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:13.217241Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:13.217252Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:13.217262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:13.217317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:13.217352Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533219661254944:4855]
2025-10-02T08:08:13.217919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:13.218142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:13.218195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:13.218469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533219661254934:4857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:13.218622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:13.218673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.218677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.218678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.218679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.218680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.218684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.218693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.218696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.218699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.218702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.218707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.218714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.218718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.218726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.218730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.218734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.218737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.218746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.218749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.218757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.218772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:13.222601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533219661254934:4857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:13.222629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533219661254934:4857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:13.222632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533219661254934:4857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:13.222640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:13.236780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:13.238576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:13.238597Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:13.238599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:13.238603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:13.238609Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 254 [1:7556533219661254944:4855]
2025-10-02T08:08:13.238622Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:13.238640Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:13.238645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.238648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.238651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.238668Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:13.238683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:13.238689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:13.238758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.238765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.238769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:13.238771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:13.238837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:13.238844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.238856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.238870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:13.238888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661254983:4857], now have 1 active actors on pipe
2025-10-02T08:08:13.238895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533220121628205:2378], now have 1 active actors on pipe
2025-10-02T08:08:13.238901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533219661254928:4855]
2025-10-02T08:08:13.238903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533219661254928:4855]
2025-10-02T08:08:13.238908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 254
2025-10-02T08:08:13.238911Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:13.238922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:13.238923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:13.238925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:13.238935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:13.238937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:13.238943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.238948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.238991Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 254
2025-10-02T08:08:13.238990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533219661254928:4855]
2025-10-02T08:08:13.239000Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:13.239016Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:13.239015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:13.239022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.239026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.239028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:13.239036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.239045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:13.239084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.239170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.239177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.239190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.239223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 255 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0
2025-10-02T08:08:13.239571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85e131d-8774e061-8282cea5-bb04a039_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:13.242783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0] Write session: try to update token
2025-10-02T08:08:13.242803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:13.259630Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:13.259654Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:13.259661Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:13.259668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533219661254928:4855]
2025-10-02T08:08:13.259672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533219661254928:4855]
2025-10-02T08:08:13.259717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:13.259723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.259726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:13.259883Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:13.262628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId: src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:13.264909Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:13.264925Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:13.265453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:13.307188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533219661254996:4391]
2025-10-02T08:08:13.307328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 254, pipe: [1:7556533219661254996:4391]
2025-10-02T08:08:13.403827Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:13.404249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.404262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.404299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661254996:4391], now have 1 active actors on pipe
2025-10-02T08:08:13.404418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533219661254996:4391]
2025-10-02T08:08:13.404445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:13.404453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:13.404507Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:13.404518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 255 reason: error at write: Disconnected sessionId: src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0
2025-10-02T08:08:13.404539Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:13.404675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 255 sessionId: src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0 is DEAD
2025-10-02T08:08:13.405034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:13.405043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0] Write session will restart in 0.009963s
2025-10-02T08:08:13.405070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0] Write session: Do CDS request
2025-10-02T08:08:13.405076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:13.410654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:13.412193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:13.412383Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:13.412393Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:13.412402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:13.412469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:13.412509Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533219661255096:4862]
2025-10-02T08:08:13.413115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:13.413315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:13.413355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:13.413650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:13.413700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.413705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.413706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.413707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.413708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.413712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.413721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.413725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.413728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.413732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.413736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.413742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.413747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.413752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.413755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.413760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.413764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.413768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.413777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.413781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.413798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:13.416412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.416453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:13.416465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 256
2025-10-02T08:08:13.416657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.416699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:13.416707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:13.416713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:13.417160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 256 sessionId:  describe result for acl check
2025-10-02T08:08:13.417199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:13.417201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:13.417203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:13.417209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533219661255112:4864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:13.417730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533219661255112:4864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:13.420409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533219661255112:4864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:13.423362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533219661255112:4864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:13.423375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533219661255112:4864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:13.423379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533219661255112:4864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:13.423388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:13.423812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:13.425383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:13.425402Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:13.425405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:13.425409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:13.425415Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 255 [1:7556533219661255096:4862]
2025-10-02T08:08:13.425426Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:13.425443Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:13.425446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.425449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.425451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.425466Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:13.425476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:13.425482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:13.425546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.425556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.425559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:13.425561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:13.425624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:13.425630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.425645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.425662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:13.425680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 255
2025-10-02T08:08:13.425681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661255143:4864], now have 1 active actors on pipe
2025-10-02T08:08:13.425685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533220121628213:2378], now have 1 active actors on pipe
2025-10-02T08:08:13.425692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533219661255087:4862]
2025-10-02T08:08:13.425693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533219661255087:4862]
2025-10-02T08:08:13.425701Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:13.425709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:13.425714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:13.425718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:13.425728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:13.425730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:13.425735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.425740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.425784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533219661255087:4862]
2025-10-02T08:08:13.425795Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:13.425805Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:13.425812Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:13.425818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.425821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.425823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:13.425771Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 255
2025-10-02T08:08:13.425832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.425844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:13.425882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.425928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.425935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.425947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.425978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 256 partition: 0 MaxSeqNo: 17 sessionId: src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0
2025-10-02T08:08:13.426326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a09392a-1c49ac7c-9d32921-9a65619a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:13.429347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0] Write session: try to update token
2025-10-02T08:08:13.429363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:13.444171Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:13.444190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:13.444192Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:13.444200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533219661255087:4862]
2025-10-02T08:08:13.444205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533219661255087:4862]
2025-10-02T08:08:13.444248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:13.444254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.444253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:13.444257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:13.444260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:13.444406Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:13.453445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId: src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:13.456335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:13.504839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533219661255158:4391]
2025-10-02T08:08:13.504932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 255, pipe: [1:7556533219661255158:4391]
2025-10-02T08:08:13.588037Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:13.588455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.588466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.588487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661255158:4391], now have 1 active actors on pipe
2025-10-02T08:08:13.588610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:13.588623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:13.588687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 256 reason: error at write: Disconnected sessionId: src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0
2025-10-02T08:08:13.588740Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:13.588752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:13.588882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 256 sessionId: src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0 is DEAD
2025-10-02T08:08:13.589091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533219661255158:4391]
2025-10-02T08:08:13.589424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:13.589438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0] Write session will restart in 0.005384s
2025-10-02T08:08:13.589478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0] Write session: Do CDS request
2025-10-02T08:08:13.589485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:13.596420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.596570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:13.596585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 257
2025-10-02T08:08:13.596781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.596837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:13.596844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:13.596849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:13.597533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 257 sessionId:  describe result for acl check
2025-10-02T08:08:13.597568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:13.597570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:13.597572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:13.597578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533219661255225:4869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:13.598103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533219661255225:4869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:13.600779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533219661255225:4869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:13.605625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:13.607592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:13.607657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533219661255225:4869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:13.607671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533219661255225:4869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:13.607675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533219661255225:4869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:13.607683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:13.607830Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:13.607840Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:13.607851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:13.607922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:13.607959Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533219661255286:4868]
2025-10-02T08:08:13.608565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:13.608771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:13.608843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:13.609156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:13.609220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.609222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.609223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.609224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.609225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.609230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.609241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.609245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.609248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.609251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.609256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.609263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.609269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.609274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.609277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.609281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.609285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.609289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.609293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.609296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.609314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:13.619190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:13.622555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:13.622588Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:13.622592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:13.622598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:13.622607Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 256 [1:7556533219661255286:4868]
2025-10-02T08:08:13.622621Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:13.622648Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:13.622653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.622657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.622660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.622690Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:13.622708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:13.622716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:13.622815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.622830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.622833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:13.622838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:13.622956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:13.622971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.622990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.623010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:13.623037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661255284:4869], now have 1 active actors on pipe
2025-10-02T08:08:13.623039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 256
2025-10-02T08:08:13.623054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533219661255276:4868]
2025-10-02T08:08:13.623056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533219661255276:4868]
2025-10-02T08:08:13.623067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:13.623082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533220121628219:2378], now have 1 active actors on pipe
2025-10-02T08:08:13.623094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.623100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.623125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:13.623148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:13.623159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:13.623183Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:13.623195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:13.623219Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:13.623229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.623234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.623246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:13.623258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.623241Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 256
2025-10-02T08:08:13.623278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:13.623298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533219661255276:4868]
2025-10-02T08:08:13.623313Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:13.623315Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:13.623387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.623462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.623474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.623497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.623627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 257 partition: 0 MaxSeqNo: 17 sessionId: src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0
2025-10-02T08:08:13.624090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5491f1f-de4c110d-f79f483f-df6c688b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:13.627451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0] Write session: try to update token
2025-10-02T08:08:13.627478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:13.643880Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:13.643904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:13.643907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:13.643915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533219661255276:4868]
2025-10-02T08:08:13.643920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533219661255276:4868]
2025-10-02T08:08:13.643969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:13.643973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:13.643979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:13.643980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.643983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:13.644145Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:13.664301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId: src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:13.667503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:13.689137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533219661255314:4391]
2025-10-02T08:08:13.689258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 256, pipe: [1:7556533219661255314:4391]
2025-10-02T08:08:13.792166Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:13.792551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.792560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.792581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661255314:4391], now have 1 active actors on pipe
2025-10-02T08:08:13.792835Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:13.792997Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:13.793512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:13.793521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0] Write session will restart in 0.007666s
2025-10-02T08:08:13.793546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0] Write session: Do CDS request
2025-10-02T08:08:13.793552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:13.793137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:13.793185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533219661255314:4391]
2025-10-02T08:08:13.793207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 257 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0
2025-10-02T08:08:13.793384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 257 sessionId: src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0 is DEAD
2025-10-02T08:08:13.802567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.802621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:13.802635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 258
2025-10-02T08:08:13.804200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:13.804280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:13.804295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:13.804301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:13.804923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 258 sessionId:  describe result for acl check
2025-10-02T08:08:13.804978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:13.804980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:13.804982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:13.804988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533219661255339:4876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:13.805657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533219661255339:4876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:13.809125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533219661255339:4876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:13.813617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:13.815208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:13.815455Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:13.815468Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:13.815478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:13.815531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:13.815570Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533219661255441:4875]
2025-10-02T08:08:13.816267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:13.816554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:13.816620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:13.816655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533219661255339:4876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:13.816663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533219661255339:4876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:13.816669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533219661255339:4876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:13.816679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:13.816940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:13.816984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.816985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.816986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.816988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.816989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.816994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.817004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.817008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.817012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.817015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.817021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.817028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:13.817033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.817038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:13.817045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.817050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:13.817055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.817060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.817064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.817069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.817089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:13.826074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:13.828150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:13.828169Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:13.828172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:13.828176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:13.828183Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 257 [1:7556533219661255441:4875]
2025-10-02T08:08:13.828195Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:13.828210Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:13.828213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.828218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.828220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.828236Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:13.828241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:13.828247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:13.828324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.828331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.828333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:13.828336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:13.828587Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 257
2025-10-02T08:08:13.828401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:13.828411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.828424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:13.828436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:13.828455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661255452:4876], now have 1 active actors on pipe
2025-10-02T08:08:13.828461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533219661255435:4875]
2025-10-02T08:08:13.828463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533219661255435:4875]
2025-10-02T08:08:13.828470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:13.828479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533220121628227:2378], now have 1 active actors on pipe
2025-10-02T08:08:13.828482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:13.828486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:13.828486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:13.828499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:13.828501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:13.828532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533219661255435:4875]
2025-10-02T08:08:13.828540Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:13.828560Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:13.828579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 257
2025-10-02T08:08:13.828600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.828603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.828625Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:13.828640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:13.828644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:13.828646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:13.828656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:13.828665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:13.828686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.828703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.828705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.828715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:13.828746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 258 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0
2025-10-02T08:08:13.829361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1020cf85-8b79229e-85d8fc82-ededce5c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:13.832206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0] Write session: try to update token
2025-10-02T08:08:13.832239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:13.848212Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:13.848232Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:13.848234Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:13.848243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533219661255435:4875]
2025-10-02T08:08:13.848247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533219661255435:4875]
2025-10-02T08:08:13.848284Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:13.848291Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:13.848291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:13.848298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:13.848300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:13.848575Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:13.864218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId: src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:13.867421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:13.892953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533219661255502:4391]
2025-10-02T08:08:13.893094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 257, pipe: [1:7556533219661255502:4391]
2025-10-02T08:08:13.995516Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:13.995896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:13.995912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:13.995932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533219661255502:4391], now have 1 active actors on pipe
2025-10-02T08:08:13.996059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:13.996070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:13.996142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 258 reason: error at write: Disconnected sessionId: src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0
2025-10-02T08:08:13.996187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:13.996313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 258 sessionId: src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0 is DEAD
2025-10-02T08:08:13.996433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:13.996443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0] Write session will restart in 0.006585s
2025-10-02T08:08:13.996450Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:13.996480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0] Write session: Do CDS request
2025-10-02T08:08:13.996488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:13.996488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533219661255502:4391]
2025-10-02T08:08:14.003256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:14.004334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.004479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:14.004494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 259
2025-10-02T08:08:14.004537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:14.004660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.004688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:14.004697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:14.004701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:14.004725Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:14.004747Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:14.004759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:14.004843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:14.004889Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533223956222905:4893]
2025-10-02T08:08:14.005109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 259 sessionId:  describe result for acl check
2025-10-02T08:08:14.005142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:14.005147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:14.005149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:14.005154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533223956222909:4895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:14.005470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:14.005612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533223956222909:4895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:14.005805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:14.005855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:14.006140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:14.006189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.006195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.006196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.006197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.006198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.006203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.006211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.006215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.006218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.006221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.006226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.006232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.006237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.006241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.006245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.006249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.006253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.006258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.006262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.006266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.006283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:14.008081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533223956222909:4895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:14.013817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533223956222909:4895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:14.013834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533223956222909:4895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:14.013839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533223956222909:4895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:14.013850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:14.015152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:14.017307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:14.017324Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:14.017327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:14.017330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:14.017336Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 258 [1:7556533223956222905:4893]
2025-10-02T08:08:14.017347Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:14.017364Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:14.017367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.017370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.017372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.017386Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:14.017391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:14.017398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:14.017458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.017461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.017464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:14.017466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:14.017529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:14.017532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.017547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.017558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:14.017575Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533223956222898:4893]
2025-10-02T08:08:14.017577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533223956222898:4893]
2025-10-02T08:08:14.017585Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:14.017598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956222949:4895], now have 1 active actors on pipe
2025-10-02T08:08:14.017597Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:14.017600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:14.017603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 258
2025-10-02T08:08:14.017605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:14.017619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:14.017622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:14.017922Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 258
2025-10-02T08:08:14.017628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533220121628258:2378], now have 1 active actors on pipe
2025-10-02T08:08:14.017663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.017666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.017680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533223956222898:4893]
2025-10-02T08:08:14.017690Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:14.017714Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:14.017720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.017720Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:14.017725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.017728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:14.017735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.017743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:14.017765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.017847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.017853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.017879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.017917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 259 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0
2025-10-02T08:08:14.018243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0095a-3a83067e-f97b1e24-5f01111_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:14.021517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0] Write session: try to update token
2025-10-02T08:08:14.021536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:14.036483Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:14.036506Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:14.036508Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:14.036518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533223956222898:4893]
2025-10-02T08:08:14.036521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533223956222898:4893]
2025-10-02T08:08:14.036564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:14.036570Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:14.036576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.036577Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:14.036578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:14.036733Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:14.044561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId: src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:14.047739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:14.096679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533223956222963:4391]
2025-10-02T08:08:14.096779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 258, pipe: [1:7556533223956222963:4391]
2025-10-02T08:08:14.183249Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:14.183725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.183738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.183754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956222963:4391], now have 1 active actors on pipe
2025-10-02T08:08:14.183856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533223956222963:4391]
2025-10-02T08:08:14.184070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:14.184078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:14.184090Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:14.184140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 259 reason: error at write: Disconnected sessionId: src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0
2025-10-02T08:08:14.184302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 259 sessionId: src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0 is DEAD
2025-10-02T08:08:14.184471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:14.184485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0] Write session will restart in 0.008765s
2025-10-02T08:08:14.184504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0] Write session: Do CDS request
2025-10-02T08:08:14.184515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:14.184877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:14.191117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:14.192487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:14.192706Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:14.192719Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:14.192731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:14.192796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:14.192852Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533223956223075:4899]
2025-10-02T08:08:14.193483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:14.193726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:14.193794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:14.194118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:14.194199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.194208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.194209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.194210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.194211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.194217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.194227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.194230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.194233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.194236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.194242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.194250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.194255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.194259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.194264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.194269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.194272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.194277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.194282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.194286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.194305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:14.194536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.194568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:14.194579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 260
2025-10-02T08:08:14.194802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.194840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:14.194844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:14.194848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:14.195221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 260 sessionId:  describe result for acl check
2025-10-02T08:08:14.195257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:14.195262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:14.195264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:14.195269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533223956223091:4902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:14.195770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533223956223091:4902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:14.198192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533223956223091:4902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:14.202438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533223956223091:4902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:14.202455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533223956223091:4902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:14.202460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533223956223091:4902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:14.202469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:14.206196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:14.208131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:14.208151Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:14.208154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:14.208158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:14.208165Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 259 [1:7556533223956223075:4899]
2025-10-02T08:08:14.208178Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:14.208198Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:14.208205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.208208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.208210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.208226Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:14.208231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:14.208237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:14.208303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.208312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.208315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:14.208319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:14.208388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:14.208398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.208412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.208423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:14.208438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533223956223069:4899]
2025-10-02T08:08:14.208441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533223956223069:4899]
2025-10-02T08:08:14.208449Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:14.208457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:14.208462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:14.208462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533224416595572:2378], now have 1 active actors on pipe
2025-10-02T08:08:14.208468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223122:4902], now have 1 active actors on pipe
2025-10-02T08:08:14.208473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:14.208486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:14.208512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 259
2025-10-02T08:08:14.208591Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 259
2025-10-02T08:08:14.208726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:14.208771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.208781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.208816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533223956223069:4899]
2025-10-02T08:08:14.208833Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:14.208851Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:14.208867Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:14.208879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.208965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.208972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:14.208984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.209001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:14.209034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.209077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.209083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.209096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.209133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 260 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0
2025-10-02T08:08:14.209568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c3d31e-837664ce-2d07b681-4e4e0055_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:14.212663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0] Write session: try to update token
2025-10-02T08:08:14.212679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:14.227233Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:14.227254Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:14.227257Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:14.227267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533223956223069:4899]
2025-10-02T08:08:14.227272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533223956223069:4899]
2025-10-02T08:08:14.227320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:14.227324Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:14.227330Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:14.227333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.227338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:14.227578Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:14.240546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId: src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:14.243606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:14.284140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533223956223136:4391]
2025-10-02T08:08:14.284232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 259, pipe: [1:7556533223956223136:4391]
2025-10-02T08:08:14.378767Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:14.379071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.379089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.379108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223136:4391], now have 1 active actors on pipe
2025-10-02T08:08:14.379215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533223956223136:4391]
2025-10-02T08:08:14.379244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:14.379246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:14.379282Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:14.379317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 260 reason: error at write: Disconnected sessionId: src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0
2025-10-02T08:08:14.379346Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:14.379486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 260 sessionId: src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0 is DEAD
2025-10-02T08:08:14.379682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:14.379698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0] Write session will restart in 0.005547s
2025-10-02T08:08:14.379738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0] Write session: Do CDS request
2025-10-02T08:08:14.379746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:14.387146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.388084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:14.388252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:14.388268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 261
2025-10-02T08:08:14.388616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.388653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:14.388660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:14.388664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:14.389123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 261 sessionId:  describe result for acl check
2025-10-02T08:08:14.389161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:14.389163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:14.389165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:14.389172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533223956223248:4911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:14.389889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:14.390030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533223956223248:4911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:14.390096Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:14.390100Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:14.390113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:14.390171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:14.390211Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533223956223251:4907]
2025-10-02T08:08:14.390881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:14.391687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:14.391771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:14.392138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:14.392216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.392217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.392219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.392220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.392221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.392228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.392239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.392243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.392248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.392251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.392257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.392266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.392273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.392279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.392283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.392288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.392292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.392296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.392300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.392304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.392323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:14.393076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533223956223248:4911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:14.400280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533223956223248:4911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:14.400304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533223956223248:4911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:14.400309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533223956223248:4911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:14.400320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:14.405788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:14.407630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:14.407647Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:14.407649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:14.407654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:14.407660Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 260 [1:7556533223956223251:4907]
2025-10-02T08:08:14.407671Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:14.407691Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:14.407697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.407702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.407711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.407724Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:14.407733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:14.407740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:14.407819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.407829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.407832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:14.407834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:14.407939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:14.407947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.407964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.407980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:14.408003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533223956223241:4907]
2025-10-02T08:08:14.408009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533223956223241:4907]
2025-10-02T08:08:14.408030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:14.408046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:14.408063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:14.408069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:14.408102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533223956223241:4907]
2025-10-02T08:08:14.408106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:14.408108Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:14.408110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:14.408118Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:14.408207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 260
2025-10-02T08:08:14.408219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223295:4911], now have 1 active actors on pipe
2025-10-02T08:08:14.408284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533224416595580:2378], now have 1 active actors on pipe
2025-10-02T08:08:14.408294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.408299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.408321Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:14.408328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.408331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.408332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:14.408339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.408349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:14.408366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.408449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.408453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.408463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.408487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 261 partition: 0 MaxSeqNo: 17 sessionId: src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0
2025-10-02T08:08:14.408932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f7b719-6f482c29-cba1e1fa-a552efcd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:14.411317Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 260
2025-10-02T08:08:14.412277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0] Write session: try to update token
2025-10-02T08:08:14.412297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:14.426005Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:14.426026Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:14.426028Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:14.426038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533223956223241:4907]
2025-10-02T08:08:14.426043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533223956223241:4907]
2025-10-02T08:08:14.426092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:14.426104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.426106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:14.426121Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:14.426146Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:14.426438Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:14.444306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId: src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:14.447186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:14.479167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533223956223312:4391]
2025-10-02T08:08:14.479271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 260, pipe: [1:7556533223956223312:4391]
2025-10-02T08:08:14.572836Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:14.573358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.573377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.573398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223312:4391], now have 1 active actors on pipe
2025-10-02T08:08:14.573527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533223956223312:4391]
2025-10-02T08:08:14.573565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:14.573570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:14.573633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 261 reason: error at write: Disconnected sessionId: src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0
2025-10-02T08:08:14.573637Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:14.573819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 261 sessionId: src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0 is DEAD
2025-10-02T08:08:14.574016Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:14.577034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:14.577047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0] Write session will restart in 0.007508s
2025-10-02T08:08:14.577078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0] Write session: Do CDS request
2025-10-02T08:08:14.577087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:14.581734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:14.583568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:14.583755Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:14.583765Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:14.583775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:14.583836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:14.583875Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533223956223416:4915]
2025-10-02T08:08:14.584505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:14.584720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:14.584765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:14.585066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:14.585128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.585135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.585136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.585137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.585141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.585145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.585154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.585157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.585160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.585162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.585168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.585174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.585178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.585183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.585187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.585191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.585194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.585198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.585202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.585206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.585224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:14.585277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.585406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:14.585419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 262
2025-10-02T08:08:14.585541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.585589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:14.585601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:14.585604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:14.586032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 262 sessionId:  describe result for acl check
2025-10-02T08:08:14.586071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:14.586073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:14.586075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:14.586080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533223956223432:4917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:14.586590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533223956223432:4917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:14.590288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533223956223432:4917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:14.593297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533223956223432:4917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:14.593312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533223956223432:4917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:14.593315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533223956223432:4917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:14.593323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:14.593808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:14.595865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:14.595880Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:14.595883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:14.595887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:14.595893Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 261 [1:7556533223956223416:4915]
2025-10-02T08:08:14.595903Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:14.595919Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:14.595924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.595927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.595928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.595944Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:14.595957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:14.595971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:14.596050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.596058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.596061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:14.596063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:14.596127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:14.596133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.596146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.596157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:14.596175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223463:4917], now have 1 active actors on pipe
2025-10-02T08:08:14.596184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533223956223410:4915]
2025-10-02T08:08:14.596186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533223956223410:4915]
2025-10-02T08:08:14.596192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:14.596204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:14.596217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:14.596221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:14.596224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 261
2025-10-02T08:08:14.596228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533224416595587:2378], now have 1 active actors on pipe
2025-10-02T08:08:14.596258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533223956223410:4915]
2025-10-02T08:08:14.596265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:14.596336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:14.596339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:14.596344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:14.596380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.596408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.596435Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:14.596445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.596449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.596451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:14.596462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.596473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:14.596418Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 261
2025-10-02T08:08:14.596495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.596593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.596599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.596612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.596646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 262 partition: 0 MaxSeqNo: 17 sessionId: src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0
2025-10-02T08:08:14.597060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4913d1-71f316df-bdce52e1-2b65bb65_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:14.600145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0] Write session: try to update token
2025-10-02T08:08:14.600163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:14.614274Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:14.614291Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:14.614295Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:14.614302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533223956223410:4915]
2025-10-02T08:08:14.614307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533223956223410:4915]
2025-10-02T08:08:14.614355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:14.614362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.614361Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:14.614367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:14.614368Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:14.614527Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:14.636184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId: src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:14.639147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:14.672730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533223956223478:4391]
2025-10-02T08:08:14.673126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 261, pipe: [1:7556533223956223478:4391]
2025-10-02T08:08:14.754798Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:14.755145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.755162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.755183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223478:4391], now have 1 active actors on pipe
2025-10-02T08:08:14.755306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:14.755319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:14.755385Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:14.755388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 262 reason: error at write: Disconnected sessionId: src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0
2025-10-02T08:08:14.755572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 262 sessionId: src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0 is DEAD
2025-10-02T08:08:14.755649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533223956223478:4391]
2025-10-02T08:08:14.755833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:14.755846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0] Write session will restart in 0.005952s
2025-10-02T08:08:14.755838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:14.755874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0] Write session: Do CDS request
2025-10-02T08:08:14.755882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:14.762114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:14.763394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.763550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:14.763572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 263
2025-10-02T08:08:14.763755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:14.764067Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:14.764082Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:14.764100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:14.764186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:14.764241Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533223956223583:4921]
2025-10-02T08:08:14.764944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:14.765152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.765189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:14.765195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:14.765198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:14.765226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:14.765298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:14.765601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 263 sessionId:  describe result for acl check
2025-10-02T08:08:14.765640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:14.765647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:14.765649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:14.765654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533223956223593:4923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:14.765697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:14.765769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.765777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.765778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.765779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.765780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.765786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.765796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.765800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.765806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.765809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.765817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.765826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.765832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.765837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.765843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.765848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.765853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.765859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.765864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.765870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.765894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:14.766224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533223956223593:4923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:14.769237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533223956223593:4923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:14.777883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533223956223593:4923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:14.777903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533223956223593:4923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:14.777907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533223956223593:4923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:14.777915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:14.780073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:14.781793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:14.781810Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:14.781814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:14.781821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:14.781828Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 262 [1:7556533223956223583:4921]
2025-10-02T08:08:14.781840Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:14.781859Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:14.781867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.781870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.781872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.781890Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:14.781895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:14.781901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:14.781969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.781976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.781980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:14.781982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:14.782050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:14.782058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.782072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.782084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:14.782099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533223956223576:4921]
2025-10-02T08:08:14.782106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533223956223576:4921]
2025-10-02T08:08:14.782114Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:14.782127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:14.782143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:14.782146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:14.782149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:14.782151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:14.782154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 262
2025-10-02T08:08:14.782162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223632:4923], now have 1 active actors on pipe
2025-10-02T08:08:14.782197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533224416595593:2378], now have 1 active actors on pipe
2025-10-02T08:08:14.782202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.782206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.782219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533223956223576:4921]
2025-10-02T08:08:14.782234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:14.782251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:14.782259Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3b3c590-a5824b68-41019102-4e73280d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:14.782265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.782269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.782271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:14.782279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.782291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:14.782314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.782460Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 262
2025-10-02T08:08:14.782601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.782622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.782665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.782721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 263 partition: 0 MaxSeqNo: 17 sessionId: src_id|f3b3c590-a5824b68-41019102-4e73280d_0
2025-10-02T08:08:14.783147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4567a8-c112ce47-bdf3f236-6bb982f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f3b3c590-a5824b68-41019102-4e73280d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:14.786130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b3c590-a5824b68-41019102-4e73280d_0] Write session: try to update token
2025-10-02T08:08:14.786153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b3c590-a5824b68-41019102-4e73280d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:14.799678Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:14.799700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:14.799702Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:14.799710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533223956223576:4921]
2025-10-02T08:08:14.799715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533223956223576:4921]
2025-10-02T08:08:14.799760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:14.799763Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:14.799766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.799769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:14.799769Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:14.799923Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:14.805726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId: src_id|f3b3c590-a5824b68-41019102-4e73280d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:14.808714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:14.856033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533223956223648:4391]
2025-10-02T08:08:14.856462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 262, pipe: [1:7556533223956223648:4391]
2025-10-02T08:08:14.941238Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:14.941593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.941606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.941626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223648:4391], now have 1 active actors on pipe
2025-10-02T08:08:14.941720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533223956223648:4391]
2025-10-02T08:08:14.941819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:14.941830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:14.941854Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:14.941894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 263 reason: error at write: Disconnected sessionId: src_id|f3b3c590-a5824b68-41019102-4e73280d_0
2025-10-02T08:08:14.941863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:14.942061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 263 sessionId: src_id|f3b3c590-a5824b68-41019102-4e73280d_0 is DEAD
2025-10-02T08:08:14.942209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b3c590-a5824b68-41019102-4e73280d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:14.942227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b3c590-a5824b68-41019102-4e73280d_0] Write session will restart in 0.006718s
2025-10-02T08:08:14.942251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b3c590-a5824b68-41019102-4e73280d_0] Write session: Do CDS request
2025-10-02T08:08:14.942258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b3c590-a5824b68-41019102-4e73280d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:14.949684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:14.950442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b3c590-a5824b68-41019102-4e73280d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.950526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:14.950540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 264
2025-10-02T08:08:14.950764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:14.950825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:14.950848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:14.950859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:14.951350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 264 sessionId:  describe result for acl check
2025-10-02T08:08:14.951406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:14.951413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:14.951416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:14.951422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533223956223786:4940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:14.952074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533223956223786:4940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:14.954732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533223956223786:4940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:14.959371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:14.959611Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:14.959619Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:14.959629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:14.959658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533223956223786:4940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:14.959673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533223956223786:4940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:14.959676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533223956223786:4940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:14.959685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:14.959692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:14.959720Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533223956223813:4938]
2025-10-02T08:08:14.960334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:14.960704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:14.960762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:14.961104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:14.961162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.961168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.961169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.961170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.961171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.961177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.961187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.961191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.961195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.961198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.961203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.961209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:14.961215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.961225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:14.961228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.961233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:14.961238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.961243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.961252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.961257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.961276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:14.970319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:14.972472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:14.972478Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:14.972480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:14.972485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:14.972495Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 263 [1:7556533223956223813:4938]
2025-10-02T08:08:14.972507Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:14.972524Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:14.972527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.972530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.972532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.972549Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:14.972553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:14.972560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:14.972622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.972624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.972626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:14.972628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:14.972697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:14.972700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.972712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:14.972723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:14.972739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533223956223779:4938]
2025-10-02T08:08:14.972741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533223956223779:4938]
2025-10-02T08:08:14.972748Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:14.972899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 263
2025-10-02T08:08:14.972759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533223956223818:4940], now have 1 active actors on pipe
2025-10-02T08:08:14.972766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:14.972770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 263
2025-10-02T08:08:14.972771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:14.972775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:14.972776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:14.972776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:14.973006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533224416595603:2378], now have 1 active actors on pipe
2025-10-02T08:08:14.973019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533223956223779:4938]
2025-10-02T08:08:14.973029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:14.973038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.973044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.973056Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:14.973104Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:14.973116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:14.973119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:14.973121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:14.973128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:14.973138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:14.973162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.973234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:14.973243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:14.973256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:14.973297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 264 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0
2025-10-02T08:08:14.973664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b3c590-a5824b68-41019102-4e73280d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:14.976098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0] Write session: try to update token
2025-10-02T08:08:14.976119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:14.990788Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:14.990804Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:14.990806Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:14.990813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533223956223779:4938]
2025-10-02T08:08:14.990817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533223956223779:4938]
2025-10-02T08:08:14.990861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:14.990866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:14.990869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:14.991043Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:14.992737Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:14.992750Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:15.003207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId: src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:15.006166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:15.041861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533228251191148:4391]
2025-10-02T08:08:15.042023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 263, pipe: [1:7556533228251191148:4391]
2025-10-02T08:08:15.134381Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:15.134671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.134686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.134706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191148:4391], now have 1 active actors on pipe
2025-10-02T08:08:15.134881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533228251191148:4391]
2025-10-02T08:08:15.134915Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:15.134966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:15.135039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 264 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0
2025-10-02T08:08:15.135205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 264 sessionId: src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0 is DEAD
2025-10-02T08:08:15.135349Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:15.137025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:15.137039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0] Write session will restart in 0.006134s
2025-10-02T08:08:15.137068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0] Write session: Do CDS request
2025-10-02T08:08:15.137076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:15.142480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:15.144001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:15.144225Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:15.144235Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:15.144245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:15.144298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:15.144352Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533228251191256:4946]
2025-10-02T08:08:15.144467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:15.144546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:15.144570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 265
2025-10-02T08:08:15.144750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:15.144797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:15.144821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:15.144827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:15.145028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:15.145297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:15.145314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 265 sessionId:  describe result for acl check
2025-10-02T08:08:15.145347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:15.145347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:15.145358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:15.145360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:15.145366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533228251191265:4948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:15.145657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:15.145726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.145737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.145738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.145739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.145740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.145746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.145757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.145760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.145764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.145768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.145774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.145782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.145790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.145796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.145800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.145809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.145812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.145818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.145825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.145830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.145848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:15.145939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533228251191265:4948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:15.149057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533228251191265:4948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:15.154549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533228251191265:4948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:15.154571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533228251191265:4948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:15.154578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533228251191265:4948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:15.154589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:15.155410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:15.157157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:15.157184Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:15.157188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:15.157192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:15.157204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 264 [1:7556533228251191256:4946]
2025-10-02T08:08:15.157221Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:15.157246Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:15.157264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.157270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.157273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.157294Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:15.157301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:15.157309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:15.157402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.157702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.157715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:15.157718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:15.157991Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 264
2025-10-02T08:08:15.157841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:15.157853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.157871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.157885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:15.157914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191303:4948], now have 1 active actors on pipe
2025-10-02T08:08:15.157918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533228711562939:2378], now have 1 active actors on pipe
2025-10-02T08:08:15.157923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 264
2025-10-02T08:08:15.157927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533228251191250:4946]
2025-10-02T08:08:15.157930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533228251191250:4946]
2025-10-02T08:08:15.157941Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:15.157955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:15.157959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:15.157962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:15.157978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:15.157981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:15.157991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.157997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.158075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533228251191250:4946]
2025-10-02T08:08:15.158090Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:15.158113Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:15.158112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:15.158121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.158126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.158128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:15.158142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.158156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:15.158217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:15.158394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.158402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.158430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:15.158477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 265 partition: 0 MaxSeqNo: 17 sessionId: src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0
2025-10-02T08:08:15.158902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c9e21ff-1ab5d94f-85937444-5ebf5ef6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:15.161736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0] Write session: try to update token
2025-10-02T08:08:15.161761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:15.181407Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:15.181432Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:15.181435Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:15.181445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533228251191250:4946]
2025-10-02T08:08:15.181449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533228251191250:4946]
2025-10-02T08:08:15.181500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:15.181504Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:15.181508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.181511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:15.181513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:15.181700Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:15.184758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId: src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:15.187856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:15.237431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533228251191331:4391]
2025-10-02T08:08:15.237676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 264, pipe: [1:7556533228251191331:4391]
2025-10-02T08:08:15.343203Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:15.343508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.343528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.343575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191331:4391], now have 1 active actors on pipe
2025-10-02T08:08:15.343662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:15.343670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:15.343744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 265 reason: error at write: Disconnected sessionId: src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0
2025-10-02T08:08:15.343792Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:15.343817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:15.344067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 265 sessionId: src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0 is DEAD
2025-10-02T08:08:15.344144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533228251191331:4391]
2025-10-02T08:08:15.344164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:15.344176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0] Write session will restart in 0.005345s
2025-10-02T08:08:15.344206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0] Write session: Do CDS request
2025-10-02T08:08:15.344213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:15.350392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:15.350464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:15.350478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 266
2025-10-02T08:08:15.350652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:15.350694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:15.350703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:15.350707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:15.351100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 266 sessionId:  describe result for acl check
2025-10-02T08:08:15.351132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:15.351135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:15.351138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:15.351139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:15.351144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533228251191443:4955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:15.351589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533228251191443:4955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:15.352536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:15.352717Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:15.352720Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:15.352730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:15.352771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:15.352817Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533228251191465:4953]
2025-10-02T08:08:15.353439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:15.353683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:15.353716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533228251191443:4955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:15.353739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:15.354056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:15.354149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.354155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.354156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.354157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.354158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.354163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.354171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.354174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.354178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.354181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.354186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.354193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.354198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.354203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.354212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.354216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.354220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.354224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.354230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.354234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.354251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:15.359634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533228251191443:4955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:15.359653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533228251191443:4955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:15.359656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533228251191443:4955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:15.359665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:15.362470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:15.364359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:15.364377Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:15.364379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:15.364383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:15.364389Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 265 [1:7556533228251191465:4953]
2025-10-02T08:08:15.364401Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:15.364417Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:15.364422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.364424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.364427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.364440Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:15.364443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:15.364450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:15.364505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.364513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.364516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:15.364518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:15.364585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:15.364596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.364609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.364621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:15.364637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533228251191442:4953]
2025-10-02T08:08:15.364644Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533228251191442:4953]
2025-10-02T08:08:15.364652Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:15.364668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:15.364675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 265
2025-10-02T08:08:15.364682Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:15.364685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:15.364685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:15.364688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:15.364698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191494:4955], now have 1 active actors on pipe
2025-10-02T08:08:15.364727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533228711562947:2378], now have 1 active actors on pipe
2025-10-02T08:08:15.364731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.364735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.364747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533228251191442:4953]
2025-10-02T08:08:15.364756Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:15.364769Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:15.364784Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:15.364794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.364797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.364799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:15.364855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.364869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:15.364789Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 265
2025-10-02T08:08:15.364908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:15.364986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.364994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.365007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:15.365063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 266 partition: 0 MaxSeqNo: 17 sessionId: src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0
2025-10-02T08:08:15.365479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39737a53-80ea76cd-bbdb6948-c9dd4479_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:15.368053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0] Write session: try to update token
2025-10-02T08:08:15.368075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:15.382369Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:15.382392Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:15.382394Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:15.382404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533228251191442:4953]
2025-10-02T08:08:15.382408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533228251191442:4953]
2025-10-02T08:08:15.382461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:15.382466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:15.382468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.382471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:15.382479Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:15.382673Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:15.387091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId: src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:15.389980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:15.444314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533228251191512:4391]
2025-10-02T08:08:15.448935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 265, pipe: [1:7556533228251191512:4391]
2025-10-02T08:08:15.527612Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:15.527916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.527934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.527977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191512:4391], now have 1 active actors on pipe
2025-10-02T08:08:15.528136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533228251191512:4391]
2025-10-02T08:08:15.528172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:15.528174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:15.528193Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:15.528213Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:15.528252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 266 reason: error at write: Disconnected sessionId: src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0
2025-10-02T08:08:15.528424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 266 sessionId: src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0 is DEAD
2025-10-02T08:08:15.528733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:15.528745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0] Write session will restart in 0.005627s
2025-10-02T08:08:15.528774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0] Write session: Do CDS request
2025-10-02T08:08:15.528781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:15.535462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:15.535494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:15.535511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 267
2025-10-02T08:08:15.535720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:15.535765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:15.535769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:15.535772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:15.536226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 267 sessionId:  describe result for acl check
2025-10-02T08:08:15.536259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:15.536266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:15.536267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:15.536273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533228251191622:4961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:15.536370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:15.536789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533228251191622:4961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:15.538068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:15.538315Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:15.538327Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:15.538339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:15.538403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:15.538463Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533228251191646:4960]
2025-10-02T08:08:15.539094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:15.539140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533228251191622:4961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:15.539304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:15.539356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:15.539689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:15.539746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.539752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.539753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.539754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.539755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.539761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.539769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.539772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.539776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.539780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.539785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.539792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.539798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.539807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.539811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.539816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.539824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.539829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.539834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.539838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.539858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:15.546635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533228251191622:4961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:15.546654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533228251191622:4961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:15.546658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533228251191622:4961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:15.546676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:15.549656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:15.551516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:15.551540Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:15.551543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:15.551547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:15.551553Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 266 [1:7556533228251191646:4960]
2025-10-02T08:08:15.551565Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:15.551582Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:15.551585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.551588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.551590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.551606Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:15.551611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:15.551617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:15.551679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.551689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.551696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:15.551698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:15.551759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:15.551767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.551787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.551805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:15.551823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533228711562953:2378], now have 1 active actors on pipe
2025-10-02T08:08:15.551829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533228251191621:4960]
2025-10-02T08:08:15.551832Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533228251191621:4960]
2025-10-02T08:08:15.551838Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:15.551851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:15.551860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:15.551863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:15.551866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:15.551870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:15.551871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191674:4961], now have 1 active actors on pipe
2025-10-02T08:08:15.551886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 266
2025-10-02T08:08:15.551902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533228251191621:4960]
2025-10-02T08:08:15.551910Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:15.551902Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 266
2025-10-02T08:08:15.552144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.552154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.552157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:15.552175Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f455436f-a54c3447-49ad56d8-4df769cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:15.552186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.552194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.552196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:15.552205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.552218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:15.552238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:15.552337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.552343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.552356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:15.552399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 267 partition: 0 MaxSeqNo: 17 sessionId: src_id|f455436f-a54c3447-49ad56d8-4df769cf_0
2025-10-02T08:08:15.552750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e5b07-17fc059b-aa963c5b-7c83248d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f455436f-a54c3447-49ad56d8-4df769cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:15.555823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f455436f-a54c3447-49ad56d8-4df769cf_0] Write session: try to update token
2025-10-02T08:08:15.555838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f455436f-a54c3447-49ad56d8-4df769cf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:15.570629Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:15.570652Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:15.570655Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:15.570667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533228251191621:4960]
2025-10-02T08:08:15.570671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533228251191621:4960]
2025-10-02T08:08:15.570722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:15.570728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.570730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:15.570911Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:15.572871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:15.572888Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:15.577724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId: src_id|f455436f-a54c3447-49ad56d8-4df769cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:15.580440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:15.628114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533228251191687:4391]
2025-10-02T08:08:15.628278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 266, pipe: [1:7556533228251191687:4391]
2025-10-02T08:08:15.719659Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:15.720028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.720042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.720064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191687:4391], now have 1 active actors on pipe
2025-10-02T08:08:15.720657Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:15.720848Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:15.720854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533228251191687:4391]
2025-10-02T08:08:15.720882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:15.720953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 267 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f455436f-a54c3447-49ad56d8-4df769cf_0
2025-10-02T08:08:15.721130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 267 sessionId: src_id|f455436f-a54c3447-49ad56d8-4df769cf_0 is DEAD
2025-10-02T08:08:15.721626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f455436f-a54c3447-49ad56d8-4df769cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:15.721639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f455436f-a54c3447-49ad56d8-4df769cf_0] Write session will restart in 0.005718s
2025-10-02T08:08:15.721661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f455436f-a54c3447-49ad56d8-4df769cf_0] Write session: Do CDS request
2025-10-02T08:08:15.721667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f455436f-a54c3447-49ad56d8-4df769cf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:15.728440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f455436f-a54c3447-49ad56d8-4df769cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:15.728839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:15.728864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 268
2025-10-02T08:08:15.729065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:15.729097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:15.729114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:15.729119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:15.729651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 268 sessionId:  describe result for acl check
2025-10-02T08:08:15.729701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:15.729703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:15.729705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:15.729712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533228251191703:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:15.730376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533228251191703:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:15.735177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533228251191703:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:15.757216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:15.759253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:15.759491Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:15.759505Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:15.759516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:15.759579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:15.759624Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533228251191834:4966]
2025-10-02T08:08:15.760336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:15.760656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:15.760722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:15.761243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:15.761314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.761315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.761316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.761317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.761318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.761324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.761334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.761338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.761342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.761345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.761352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.761360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:15.761366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.761371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:15.761375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.761381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:15.761385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.761390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.761398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.761403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.761421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:15.761823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533228251191703:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:15.761830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533228251191703:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:15.761833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533228251191703:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:15.761843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:15.786849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:15.790672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 267
2025-10-02T08:08:15.790795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f455436f-a54c3447-49ad56d8-4df769cf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:15.788982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:15.788999Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:15.789002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:15.789006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:15.789013Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 267 [1:7556533228251191834:4966]
2025-10-02T08:08:15.789026Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:15.789044Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:15.789047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.789050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.789053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.789070Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:15.789075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:15.789084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:15.789151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.789153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.789156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:15.789159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:15.789227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:15.789230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.789244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:15.789256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:15.789270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533228251191827:4966]
2025-10-02T08:08:15.789273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533228251191827:4966]
2025-10-02T08:08:15.789281Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:15.789294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:15.789309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:15.789311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:15.789321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191850:4967], now have 1 active actors on pipe
2025-10-02T08:08:15.789323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:15.789327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:15.789354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533228251191827:4966]
2025-10-02T08:08:15.789357Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:15.789361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533228711562960:2378], now have 1 active actors on pipe
2025-10-02T08:08:15.789401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 267
2025-10-02T08:08:15.789476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:15.789983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.789991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.790018Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:15.790031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.790035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.790037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:15.790049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.790060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:15.790077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:15.790152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.790155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.790177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:15.790209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 268 partition: 0 MaxSeqNo: 17 sessionId: src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0
2025-10-02T08:08:15.793790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0] Write session: try to update token
2025-10-02T08:08:15.793814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:15.810876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId: src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:15.813790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:15.813937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.813953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.813988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:15.814014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:15.814062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:15.814071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:15.814254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.814375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.814476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.814544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.814587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.814592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.814660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.814715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.814800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.814869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.814937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.814940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.815012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.815078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.815150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.815214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.815269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.815272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.815345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.815416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.815482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.815552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.815605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.815608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.815692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.815765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.815837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.815912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.815961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.815964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.816056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.816143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.816206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.816263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.816309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.816312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.816393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.816460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.816531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.816598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.816649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.816653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.816733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.816797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.816883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.816950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.816995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.816998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.817068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.817129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.817198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.817266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.817316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.817319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.817398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:15.817463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:15.817546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:15.817610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:15.817662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:15.817665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:15.817714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:15.817784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:15.817802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:15.817805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:15.817838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:15.817850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:15.817853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:15.817856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:15.817859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:15.818381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:15.818401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:15.818408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:15.818411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:15.818414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:15.818418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:15.819373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:15.819391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:15.819399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:15.819402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:15.819405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:15.819408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:15.819977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:15.819994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:15.820001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:15.820004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:15.820019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:15.821120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533228251191864:4391]
2025-10-02T08:08:15.821380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 267, pipe: [1:7556533228251191864:4391]
2025-10-02T08:08:15.822358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:15.822381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:15.822394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392495822
2025-10-02T08:08:15.822572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:15.822589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:15.822593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:15.822596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:15.822599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:15.822601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:15.823107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:15.823135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:15.823141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:15.823147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:15.823150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:15.823152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:15.823645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:15.823665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:15.823672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:15.823678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:15.823680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:15.823683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:15.824217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:15.824234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:15.824238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:15.825531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:15.825552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:15.825558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:15.825562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:15.825572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392495825
2025-10-02T08:08:15.825933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:15.825955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:15.825968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:15.825979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:15.825983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:15.825987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:15.826549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:15.826570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:15.826577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:15.826583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:15.826586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:15.826593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:15.827156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:15.827178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:15.827290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392495827
2025-10-02T08:08:15.828202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533228251191864:4391], now have 1 active actors on pipe
2025-10-02T08:08:15.828241Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:15.828255Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:15.828262Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:15.828269Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:15.830347Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:15.830361Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:15.830364Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:15.830377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533228251191827:4966]
2025-10-02T08:08:15.830382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533228251191827:4966]
2025-10-02T08:08:15.830435Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:15.830449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:15.830450Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:15.830453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:15.830456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:15.830619Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:15.988861Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:15.989501Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:15.990169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:15.991161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:15.991182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0] Write session will restart in 0.006972s
2025-10-02T08:08:15.991209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0] Write session: Do CDS request
2025-10-02T08:08:15.991216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:15.990716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533228251191864:4391]
2025-10-02T08:08:15.990744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:15.990777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0
2025-10-02T08:08:15.990955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 268 sessionId: src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0 is DEAD
2025-10-02T08:08:16.003729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.002276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:16.002653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:16.002826Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:16.002831Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:16.002841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:16.002882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:16.002969Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533232546159320:4983]
2025-10-02T08:08:16.003703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:16.003859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:16.003869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 269
2025-10-02T08:08:16.004083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:16.004164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:16.004571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:16.004626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.004627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.004629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.004631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.004632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.004639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.004650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.004654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.004657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.004660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.004668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.004677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.004684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.004689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.004694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.004699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.004704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.004710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.004716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.004721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.004741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:16.004797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.004848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:16.004855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:16.004858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:16.005456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 269 sessionId:  describe result for acl check
2025-10-02T08:08:16.005504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:16.005506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:16.005508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:16.005513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533232546159336:4985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:16.005939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533232546159336:4985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:16.011310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533232546159336:4985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:16.013693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:16.014381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533232546159336:4985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:16.014394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533232546159336:4985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:16.014396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533232546159336:4985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:16.014403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:16.015652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:16.015668Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:16.015670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:16.015674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:16.015679Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 268 [1:7556533232546159320:4983]
2025-10-02T08:08:16.015690Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:16.015706Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:16.015713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.015716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.015718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.015730Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:16.015739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:16.015744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:16.015807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.015814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.015818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:16.015821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:16.015880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:16.015887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.015900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.015916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:16.015924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 268
2025-10-02T08:08:16.015936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546159364:4985], now have 1 active actors on pipe
2025-10-02T08:08:16.015944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533228711562969:2378], now have 1 active actors on pipe
2025-10-02T08:08:16.015949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.015952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.015968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533232546159314:4983]
2025-10-02T08:08:16.015971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533232546159314:4983]
2025-10-02T08:08:16.015981Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:16.015991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:16.015993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:16.015999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:16.016014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:16.016016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:16.016032Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:16.016043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.016020Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 268
2025-10-02T08:08:16.016046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.016047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:16.016054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.016063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:16.016094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533232546159314:4983]
2025-10-02T08:08:16.016106Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:16.016119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:16.016128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.016175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.016182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.016195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.016229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 269 partition: 0 MaxSeqNo: 17 sessionId: src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0
2025-10-02T08:08:16.016647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db4c0b-173e2f46-117fd262-77a088ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:16.019542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0] Write session: try to update token
2025-10-02T08:08:16.019565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:16.031925Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:16.031945Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:16.031953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533232546159314:4983]
2025-10-02T08:08:16.031996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:16.032001Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:16.032534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:16.032690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:16.032880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:16.033035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:16.033250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:16.033291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:16.041141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId: src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:16.043979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:16.044282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.044301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.044318Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:16.044323Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:16.044325Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:16.044331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533232546159314:4983]
2025-10-02T08:08:16.044335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533232546159314:4983]
2025-10-02T08:08:16.044387Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:16.044393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:16.044396Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:16.044399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.044405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:16.044563Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:16.090943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533232546159389:4391]
2025-10-02T08:08:16.091065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 268, pipe: [1:7556533232546159389:4391]
2025-10-02T08:08:16.184057Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:16.184349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:16.184381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546159389:4391], now have 1 active actors on pipe
2025-10-02T08:08:16.184396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:16.184496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:16.184504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:16.184523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 269 reason: error at write: Disconnected sessionId: src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0
2025-10-02T08:08:16.184652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 269 sessionId: src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0 is DEAD
2025-10-02T08:08:16.184644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:16.184781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533232546159389:4391]
2025-10-02T08:08:16.185487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:16.185502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0] Write session will restart in 0.005649s
2025-10-02T08:08:16.185528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0] Write session: Do CDS request
2025-10-02T08:08:16.185539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:16.191751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:16.192405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.192533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:16.192557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 270
2025-10-02T08:08:16.192740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.192798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:16.192828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:16.192833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:16.193273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:16.193374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 270 sessionId:  describe result for acl check
2025-10-02T08:08:16.193421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:16.193428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:16.193430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:16.193437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533232546159521:4994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:16.193543Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:16.193560Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:16.193574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:16.193649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:16.193696Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533232546159522:4991]
2025-10-02T08:08:16.194070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533232546159521:4994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:16.194473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:16.194745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:16.194839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:16.195220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:16.195304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.195312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.195314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.195315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.195316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.195323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.195334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.195337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.195341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.195344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.195351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.195359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.195366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.195371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.195375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.195381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.195385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.195390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.195395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.195399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.195420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:16.196577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533232546159521:4994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:16.201699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533232546159521:4994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:16.201720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533232546159521:4994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:16.201724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533232546159521:4994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:16.201733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:16.204500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:16.206097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:16.206120Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:16.206122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:16.206124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:16.206129Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 269 [1:7556533232546159522:4991]
2025-10-02T08:08:16.206138Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:16.206152Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:16.206154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.206156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.206157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.206170Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:16.206173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:16.206179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:16.206222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.206224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.206226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:16.206229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:16.206281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:16.206289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.206297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.206304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:16.206316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546159564:4994], now have 1 active actors on pipe
2025-10-02T08:08:16.206321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533232546159513:4991]
2025-10-02T08:08:16.206322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533232546159513:4991]
2025-10-02T08:08:16.206327Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:16.206330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 269
2025-10-02T08:08:16.206337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:16.206340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:16.206343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:16.206349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:16.206351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:16.206357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533233006530305:2378], now have 1 active actors on pipe
2025-10-02T08:08:16.206361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.206365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.206407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533232546159513:4991]
2025-10-02T08:08:16.206414Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:16.206431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:16.206435Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:16.206439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.206441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.206442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:16.206449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.206456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:16.206489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.206533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.206541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.206552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.206522Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 269
2025-10-02T08:08:16.206592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 270 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0
2025-10-02T08:08:16.206962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c35c55-a41fd285-49c9a1e0-137aa481_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:16.210227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0] Write session: try to update token
2025-10-02T08:08:16.210250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:16.223929Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:16.223954Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:16.223957Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:16.223967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533232546159513:4991]
2025-10-02T08:08:16.223971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533232546159513:4991]
2025-10-02T08:08:16.224023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:16.224028Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:16.224030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.224033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:16.224034Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:16.224176Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:16.230531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId: src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:16.233717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:16.285000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533232546159579:4391]
2025-10-02T08:08:16.285131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 269, pipe: [1:7556533232546159579:4391]
2025-10-02T08:08:16.369648Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:16.370010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.370033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.370053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546159579:4391], now have 1 active actors on pipe
2025-10-02T08:08:16.370162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:16.370176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:16.370248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 270 reason: error at write: Disconnected sessionId: src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0
2025-10-02T08:08:16.370258Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:16.370309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:16.370438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 270 sessionId: src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0 is DEAD
2025-10-02T08:08:16.370511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533232546159579:4391]
2025-10-02T08:08:16.370672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:16.370684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0] Write session will restart in 0.007915s
2025-10-02T08:08:16.370714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0] Write session: Do CDS request
2025-10-02T08:08:16.370721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:16.377249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:16.378428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:16.378602Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:16.378611Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:16.378621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:16.378670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:16.378703Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533232546159705:4999]
2025-10-02T08:08:16.379327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:16.379490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:16.379528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:16.379810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:16.379847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.379852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.379854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.379855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.379856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.379860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.379870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.379874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.379877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.379881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.379886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.379898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.379903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.379911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.379915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.379919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.379922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.379927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.379935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.379939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.379960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:16.380397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.380613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:16.380621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 271
2025-10-02T08:08:16.380797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.380839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:16.380847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:16.380850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:16.381242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 271 sessionId:  describe result for acl check
2025-10-02T08:08:16.381270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:16.381276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:16.381277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:16.381282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533232546159721:5001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:16.381741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533232546159721:5001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:16.383703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533232546159721:5001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:16.387303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533232546159721:5001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:16.387332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533232546159721:5001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:16.387335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533232546159721:5001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:16.387343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:16.387958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:16.389684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:16.389699Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:16.389702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:16.389706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:16.389712Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 270 [1:7556533232546159705:4999]
2025-10-02T08:08:16.389726Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:16.389743Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:16.389750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.389753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.389759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.389778Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:16.389786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:16.389793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:16.389859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.389865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.389869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:16.389871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:16.389935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:16.389941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.389954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.389970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:16.389990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533232546159699:4999]
2025-10-02T08:08:16.389995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533232546159699:4999]
2025-10-02T08:08:16.390007Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:16.390021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:16.390039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:16.390040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:16.390045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:16.390047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:16.390076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533232546159699:4999]
2025-10-02T08:08:16.390082Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:16.390091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546159752:5001], now have 1 active actors on pipe
2025-10-02T08:08:16.390091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 270
2025-10-02T08:08:16.390100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:16.390162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533233006530315:2378], now have 1 active actors on pipe
2025-10-02T08:08:16.390171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.390175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.390207Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:16.390193Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 270
2025-10-02T08:08:16.390217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.390224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.390226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:16.390232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.390241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:16.390261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.390313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.390328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.390350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.390387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 271 partition: 0 MaxSeqNo: 17 sessionId: src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0
2025-10-02T08:08:16.390895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a083c2b-4cba1552-9c6a82be-bac0beaf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:16.393829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0] Write session: try to update token
2025-10-02T08:08:16.393854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:16.406896Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:16.406920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:16.406922Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:16.406930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533232546159699:4999]
2025-10-02T08:08:16.406935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533232546159699:4999]
2025-10-02T08:08:16.406970Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:16.406981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:16.406987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.406990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:16.406989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:16.407149Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:16.413944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId: src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:16.417309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:16.470881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533232546159770:4391]
2025-10-02T08:08:16.471004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 270, pipe: [1:7556533232546159770:4391]
2025-10-02T08:08:16.551183Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:16.551487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:16.551503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0] Write session will restart in 0.008217s
2025-10-02T08:08:16.551529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0] Write session: Do CDS request
2025-10-02T08:08:16.551536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:16.550537Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:16.550900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.550908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.550930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546159770:4391], now have 1 active actors on pipe
2025-10-02T08:08:16.551034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533232546159770:4391]
2025-10-02T08:08:16.551054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:16.551056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:16.551117Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:16.551124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 271 reason: error at write: Disconnected sessionId: src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0
2025-10-02T08:08:16.551313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 271 sessionId: src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0 is DEAD
2025-10-02T08:08:16.557971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:16.559407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:16.559570Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:16.559573Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:16.559581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:16.559622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:16.559653Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533232546159894:5005]
2025-10-02T08:08:16.560317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:16.560506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:16.560540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:16.560878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:16.560913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.560915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.560916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.560919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.560920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.560925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.560936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.560940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.560944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.560948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.560953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.560960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.560966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.560971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.560976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.560981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.560985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.560990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.560994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.560999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.561018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:16.561515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.562771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:16.562788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 272
2025-10-02T08:08:16.563152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.563178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:16.563183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:16.563187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:16.563626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 272 sessionId:  describe result for acl check
2025-10-02T08:08:16.563650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:16.563652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:16.563653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:16.563658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533232546159910:5007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:16.564139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533232546159910:5007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:16.565808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533232546159910:5007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:16.568491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533232546159910:5007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:16.568498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533232546159910:5007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:16.568501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533232546159910:5007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:16.568509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:16.568943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:16.570758Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 271
2025-10-02T08:08:16.571460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb0aaf7-e60c2765-f99daeae-247ac51c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|633adb46-23703424-29a1871b-15cc5d9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:16.570406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:16.570424Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:16.570426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:16.570430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:16.570435Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 271 [1:7556533232546159894:5005]
2025-10-02T08:08:16.570445Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:16.570463Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:16.570467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.570470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.570476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.570491Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:16.570496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:16.570502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:16.570558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.570561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.570563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:16.570566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:16.570629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:16.570632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.570647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.570660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:16.570674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 271
2025-10-02T08:08:16.570679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546159941:5007], now have 1 active actors on pipe
2025-10-02T08:08:16.570682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533233006530321:2378], now have 1 active actors on pipe
2025-10-02T08:08:16.570688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533232546159888:5005]
2025-10-02T08:08:16.570690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533232546159888:5005]
2025-10-02T08:08:16.570701Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:16.570711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.570715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.570716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:16.570719Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:16.570733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:16.570747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:16.570750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:16.570790Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|633adb46-23703424-29a1871b-15cc5d9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:16.570796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.570800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.570804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:16.570815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.570822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:16.570830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533232546159888:5005]
2025-10-02T08:08:16.570838Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:16.570856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:16.570869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.570941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.570943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.570959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.570998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 272 partition: 0 MaxSeqNo: 17 sessionId: src_id|633adb46-23703424-29a1871b-15cc5d9a_0
2025-10-02T08:08:16.574394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633adb46-23703424-29a1871b-15cc5d9a_0] Write session: try to update token
2025-10-02T08:08:16.574418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633adb46-23703424-29a1871b-15cc5d9a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:16.589626Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:16.589647Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:16.589650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:16.589658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533232546159888:5005]
2025-10-02T08:08:16.589662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533232546159888:5005]
2025-10-02T08:08:16.589708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:16.589707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:16.589714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.589714Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:16.589716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:16.589873Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:16.597268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId: src_id|633adb46-23703424-29a1871b-15cc5d9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:16.599888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:16.651090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533232546159955:4391]
2025-10-02T08:08:16.651221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 271, pipe: [1:7556533232546159955:4391]
2025-10-02T08:08:16.741308Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:16.741734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.741749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.741770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546159955:4391], now have 1 active actors on pipe
2025-10-02T08:08:16.741885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:16.741898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:16.741965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 272 reason: error at write: Disconnected sessionId: src_id|633adb46-23703424-29a1871b-15cc5d9a_0
2025-10-02T08:08:16.742010Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:16.742145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 272 sessionId: src_id|633adb46-23703424-29a1871b-15cc5d9a_0 is DEAD
2025-10-02T08:08:16.742274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633adb46-23703424-29a1871b-15cc5d9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:16.742281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633adb46-23703424-29a1871b-15cc5d9a_0] Write session will restart in 0.009876s
2025-10-02T08:08:16.742305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633adb46-23703424-29a1871b-15cc5d9a_0] Write session: Do CDS request
2025-10-02T08:08:16.742311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633adb46-23703424-29a1871b-15cc5d9a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:16.742303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533232546159955:4391]
2025-10-02T08:08:16.742679Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:16.748965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:16.750312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:16.750487Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:16.750499Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:16.750508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:16.750565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:16.750615Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533232546160081:5011]
2025-10-02T08:08:16.751089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:16.751294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:16.751345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:16.751640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:16.751681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.751686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.751687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.751689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.751690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.751707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.751716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.751720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.751723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.751727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.751732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.751739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.751745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.751748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.751752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.751756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.751761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.751765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.751770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.751779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.751797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:16.753500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633adb46-23703424-29a1871b-15cc5d9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.757000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:16.757026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 273
2025-10-02T08:08:16.757262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.757298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:16.757305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:16.757310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:16.757861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 273 sessionId:  describe result for acl check
2025-10-02T08:08:16.757905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:16.757915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:16.757917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:16.757923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533232546160097:5013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:16.758440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533232546160097:5013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:16.759718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:16.760534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533232546160097:5013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:16.761439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:16.761458Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:16.761461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:16.761465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:16.761470Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 272 [1:7556533232546160081:5011]
2025-10-02T08:08:16.761481Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:16.761496Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:16.761499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.761502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.761504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.761519Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:16.761532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:16.761537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:16.761600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.761608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.761611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:16.761613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:16.761673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:16.761680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.761693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.761708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:16.761727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533232546160075:5011]
2025-10-02T08:08:16.761732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533232546160075:5011]
2025-10-02T08:08:16.761741Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:16.761754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:16.761769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:16.761777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:16.761786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533233006530327:2378], now have 1 active actors on pipe
2025-10-02T08:08:16.761815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533232546160075:5011]
2025-10-02T08:08:16.761821Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:16.761903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:16.761912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:16.761918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:16.761951Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 272
2025-10-02T08:08:16.768439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533232546160097:5013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:16.768457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533232546160097:5013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:16.768461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533232546160097:5013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:16.768470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:16.768752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546160136:5013], now have 1 active actors on pipe
2025-10-02T08:08:16.768779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 272
2025-10-02T08:08:16.768787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.768798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.768840Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:16.768853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.768861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.768864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:16.768876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.768895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:16.768921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.768993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.768996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.769008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.769037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 273 partition: 0 MaxSeqNo: 17 sessionId: src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0
2025-10-02T08:08:16.772976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633adb46-23703424-29a1871b-15cc5d9a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:16.775984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0] Write session: try to update token
2025-10-02T08:08:16.776028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:16.782412Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:16.782433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:16.782436Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:16.782444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533232546160075:5011]
2025-10-02T08:08:16.782448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533232546160075:5011]
2025-10-02T08:08:16.782490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:16.782497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.782499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:16.782661Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:16.786345Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:16.786364Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:16.813283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId: src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:16.816417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:16.842609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533232546160145:4391]
2025-10-02T08:08:16.842911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 272, pipe: [1:7556533232546160145:4391]
2025-10-02T08:08:16.930148Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:16.930437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.930449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.930466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546160145:4391], now have 1 active actors on pipe
2025-10-02T08:08:16.930577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:16.930591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:16.930666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 273 reason: error at write: Disconnected sessionId: src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0
2025-10-02T08:08:16.930744Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:16.930845Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:16.930852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 273 sessionId: src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0 is DEAD
2025-10-02T08:08:16.931014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533232546160145:4391]
2025-10-02T08:08:16.931054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:16.931070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0] Write session will restart in 0.009737s
2025-10-02T08:08:16.931102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0] Write session: Do CDS request
2025-10-02T08:08:16.931110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:16.938272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:16.939494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:16.939689Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:16.939697Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:16.939706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:16.939763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:16.939800Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533232546160271:5018]
2025-10-02T08:08:16.940405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:16.940658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:16.940712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:16.941095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:16.941162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.941167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.941169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.941170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.941171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.941176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.941186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.941190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.941194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.941200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.941205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.941212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:16.941221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.941226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:16.941230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.941235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:16.941243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.941248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.941253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.941258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.941278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:16.942394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.942972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:16.942983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 274
2025-10-02T08:08:16.943248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:16.943308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:16.943319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:16.943324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:16.943795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 274 sessionId:  describe result for acl check
2025-10-02T08:08:16.943839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:16.943844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:16.943846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:16.943862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533232546160288:5020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:16.944379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533232546160288:5020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:16.946456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533232546160288:5020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:16.949427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:16.949496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533232546160288:5020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:16.949512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533232546160288:5020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:16.949515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533232546160288:5020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:16.949521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:16.951333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:16.951354Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:16.951357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:16.951361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:16.951367Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 273 [1:7556533232546160271:5018]
2025-10-02T08:08:16.951378Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:16.951392Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:16.951395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.951398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.951400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.951417Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:16.951426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:16.951433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:16.951491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.951499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.951502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:16.951504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:16.951562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:16.951570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.951582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:16.951597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:16.951610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 273
2025-10-02T08:08:16.951621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533232546160319:5020], now have 1 active actors on pipe
2025-10-02T08:08:16.951627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533232546160265:5018]
2025-10-02T08:08:16.951629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533232546160265:5018]
2025-10-02T08:08:16.951640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:16.951651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533233006530335:2378], now have 1 active actors on pipe
2025-10-02T08:08:16.951652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:16.951655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:16.951659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.951663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.951681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:16.951673Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 273
2025-10-02T08:08:16.951699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:16.951704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:16.951746Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:16.951756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:16.951763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:16.951765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:16.951773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:16.951783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:16.951799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533232546160265:5018]
2025-10-02T08:08:16.951809Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:16.951816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:16.951834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.951884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:16.951889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:16.951901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:16.951934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 274 partition: 0 MaxSeqNo: 17 sessionId: src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0
2025-10-02T08:08:16.952319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52410b1-1582766f-dd6b28a5-ae7e76fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:16.954965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0] Write session: try to update token
2025-10-02T08:08:16.954987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:16.969306Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:16.969328Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:16.969331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:16.969339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533232546160265:5018]
2025-10-02T08:08:16.969343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533232546160265:5018]
2025-10-02T08:08:16.969382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:16.969386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:16.969393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:16.969395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:16.969397Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:16.969576Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:17.015324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId: src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:17.018235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:17.030976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533236841127660:4391]
2025-10-02T08:08:17.031078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 273, pipe: [1:7556533236841127660:4391]
2025-10-02T08:08:17.108378Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:17.108694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.108712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.108732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841127660:4391], now have 1 active actors on pipe
2025-10-02T08:08:17.108880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533236841127660:4391]
2025-10-02T08:08:17.108904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:17.108906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:17.108943Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:17.108973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 274 reason: error at write: Disconnected sessionId: src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0
2025-10-02T08:08:17.109166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 274 sessionId: src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0 is DEAD
2025-10-02T08:08:17.109275Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:17.112950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:17.112966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0] Write session will restart in 0.009336s
2025-10-02T08:08:17.112992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0] Write session: Do CDS request
2025-10-02T08:08:17.112999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:17.116997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:17.118332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:17.118561Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:17.118577Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:17.118589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:17.118653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:17.118698Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533236841127787:5034]
2025-10-02T08:08:17.119371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:17.119604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:17.119656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:17.119955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:17.119992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.119993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.119994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.119995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.119996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.120014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.120020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.120022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.120024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.120035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.120039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.120046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.120052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.120056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.120061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.120066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.120070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.120075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.120078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.120080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.120091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:17.123402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.125332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:17.125353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 275
2025-10-02T08:08:17.125598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.125655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:17.125664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:17.125667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:17.126116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 275 sessionId:  describe result for acl check
2025-10-02T08:08:17.126152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:17.126154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:17.126156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:17.126161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533236841127814:5038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:17.126640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533236841127814:5038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:17.128105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:17.128596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533236841127814:5038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:17.129662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:17.129679Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:17.129682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:17.129685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:17.129692Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 274 [1:7556533236841127787:5034]
2025-10-02T08:08:17.129702Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:17.129716Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:17.129720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.129723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.129726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.129740Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:17.129746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:17.129754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:17.129811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.129819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.129822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:17.129824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:17.129987Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 274
2025-10-02T08:08:17.129888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:17.129895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.129908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.129921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:17.129938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533237301497652:2378], now have 1 active actors on pipe
2025-10-02T08:08:17.129943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533236841127781:5034]
2025-10-02T08:08:17.129945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533236841127781:5034]
2025-10-02T08:08:17.129957Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:17.129969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:17.129981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:17.129984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:17.130016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533236841127781:5034]
2025-10-02T08:08:17.130018Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:17.130034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:17.130039Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:17.130045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:17.134977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533236841127814:5038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:17.134995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533236841127814:5038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:17.134998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533236841127814:5038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:17.135006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:17.135253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 274
2025-10-02T08:08:17.135270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841127851:5038], now have 1 active actors on pipe
2025-10-02T08:08:17.135279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.135285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.135326Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:17.135343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.135350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.135352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:17.135364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.135383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:17.135418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.135477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.135488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.135509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.135544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 275 partition: 0 MaxSeqNo: 17 sessionId: src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0
2025-10-02T08:08:17.135974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d596edd6-78bd8369-8f42cd33-7318fa71_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:17.138473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0] Write session: try to update token
2025-10-02T08:08:17.138492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:17.140897Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:17.140913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:17.140922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533236841127781:5034]
2025-10-02T08:08:17.140966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:17.140978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:17.141163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:17.141321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:17.141475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:17.141635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:17.142225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:17.142271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:17.158725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:17.158745Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:17.158747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:17.158757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533236841127781:5034]
2025-10-02T08:08:17.158760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533236841127781:5034]
2025-10-02T08:08:17.158806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:17.158812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.158811Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:17.158813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:17.158817Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:17.158954Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:17.160377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId: src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:17.163154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:17.209164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533236841127870:4391]
2025-10-02T08:08:17.209280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 274, pipe: [1:7556533236841127870:4391]
2025-10-02T08:08:17.306704Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:17.307001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.307016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.307039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841127870:4391], now have 1 active actors on pipe
2025-10-02T08:08:17.307172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:17.307184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:17.307257Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:17.307266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 275 reason: error at write: Disconnected sessionId: src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0
2025-10-02T08:08:17.307243Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:17.307458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 275 sessionId: src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0 is DEAD
2025-10-02T08:08:17.307551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533236841127870:4391]
2025-10-02T08:08:17.307736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:17.307745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0] Write session will restart in 0.008773s
2025-10-02T08:08:17.307774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0] Write session: Do CDS request
2025-10-02T08:08:17.307781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:17.315745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:17.317205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:17.317379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.317406Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:17.317417Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:17.317428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:17.317478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:17.317488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:17.317498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 276
2025-10-02T08:08:17.317522Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533236841128006:5043]
2025-10-02T08:08:17.317653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.317727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:17.317742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:17.317748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:17.318216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 276 sessionId:  describe result for acl check
2025-10-02T08:08:17.318247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:17.318264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:17.318266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:17.318269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:17.318276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533236841128011:5045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:17.318920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533236841128011:5045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:17.318936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:17.319010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:17.319460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:17.319552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.319566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.319567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.319568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.319569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.319577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.319587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.319591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.319595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.319598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.319605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.319613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.319620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.319624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.319628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.319632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.319636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.319647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.319651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.319655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.319674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:17.322233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533236841128011:5045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:17.327956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533236841128011:5045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:17.327981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533236841128011:5045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:17.327985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533236841128011:5045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:17.328009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:17.332850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:17.334796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:17.334823Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:17.334826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:17.334831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:17.334839Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 275 [1:7556533236841128006:5043]
2025-10-02T08:08:17.334855Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:17.334879Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:17.334884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.334888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.334891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.334911Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:17.334921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:17.334931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:17.335022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.335025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.335029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:17.335031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:17.335122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:17.335135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.335152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.335165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:17.335189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841128061:5045], now have 1 active actors on pipe
2025-10-02T08:08:17.335193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 275
2025-10-02T08:08:17.335198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533236841128000:5043]
2025-10-02T08:08:17.335201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533236841128000:5043]
2025-10-02T08:08:17.335212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:17.335228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:17.335244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:17.335248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:17.335258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.335263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.335281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533237301497680:2378], now have 1 active actors on pipe
2025-10-02T08:08:17.335325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533236841128000:5043]
2025-10-02T08:08:17.335339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:17.335359Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:17.335376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.335387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.335389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:17.335397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:17.335404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.335408Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:17.335416Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:17.335419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:17.335458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.335473Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 275
2025-10-02T08:08:17.335593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.335606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.335643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.335688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 276 partition: 0 MaxSeqNo: 17 sessionId: src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0
2025-10-02T08:08:17.336164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6741a2f9-e4dfcc2-c36b9221-b2bf0273_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:17.338832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0] Write session: try to update token
2025-10-02T08:08:17.338857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:17.355654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId: src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:17.359307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:17.359914Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:17.359939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:17.359943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:17.359954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533236841128000:5043]
2025-10-02T08:08:17.359960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533236841128000:5043]
2025-10-02T08:08:17.360033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:17.360052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.360055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:17.360058Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:17.360064Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:17.360238Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:17.408991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533236841128079:4391]
2025-10-02T08:08:17.409527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 275, pipe: [1:7556533236841128079:4391]
2025-10-02T08:08:17.524556Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:17.525094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.525111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.525170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841128079:4391], now have 1 active actors on pipe
2025-10-02T08:08:17.526695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:17.526707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0] Write session will restart in 0.007927s
2025-10-02T08:08:17.526731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0] Write session: Do CDS request
2025-10-02T08:08:17.526739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:17.525934Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:17.526258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533236841128079:4391]
2025-10-02T08:08:17.526279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:17.526333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 276 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0
2025-10-02T08:08:17.526532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 276 sessionId: src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0 is DEAD
2025-10-02T08:08:17.527455Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:17.536432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.536513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:17.536538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 277
2025-10-02T08:08:17.536677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.536726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:17.536738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:17.536741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:17.537359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 277 sessionId:  describe result for acl check
2025-10-02T08:08:17.537397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:17.537398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:17.537400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:17.537406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533236841128200:5051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:17.538001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533236841128200:5051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:17.540949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:17.542867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:17.543134Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:17.543151Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:17.543166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:17.543233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:17.543288Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533236841128223:5050]
2025-10-02T08:08:17.544052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:17.544754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:17.544826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:17.545175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:17.545252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.545257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.545259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.545260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.545264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.545270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.545282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.545290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.545294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.545298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.545307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.545317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.545323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.545332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.545337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.545347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.545355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.545360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.545365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.545375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.545400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:17.550636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533236841128200:5051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:17.559659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:17.561603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:17.561631Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:17.561636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:17.561641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:17.561650Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 276 [1:7556533236841128223:5050]
2025-10-02T08:08:17.561666Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:17.561688Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:17.561692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.561695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.561698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.561719Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:17.561726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:17.561734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:17.561748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533236841128200:5051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:17.561756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533236841128200:5051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:17.561759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533236841128200:5051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:17.561785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:17.561817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.561819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.561823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:17.561826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:17.561901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:17.561904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.561920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.561931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:17.561954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533236841128217:5050]
2025-10-02T08:08:17.561955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533236841128217:5050]
2025-10-02T08:08:17.561964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:17.561979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:17.561994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:17.561999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:17.562044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533236841128217:5050]
2025-10-02T08:08:17.562046Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:17.562408Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:17.562420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:17.562427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:17.562710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533237301497689:2378], now have 1 active actors on pipe
2025-10-02T08:08:17.562793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 276
2025-10-02T08:08:17.562797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841128263:5051], now have 1 active actors on pipe
2025-10-02T08:08:17.562803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.562808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.562897Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:17.562914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.562919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.562921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:17.562934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.562948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:17.562966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.563042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.563049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.563064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.563094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 277 partition: 0 MaxSeqNo: 17 sessionId: src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0
2025-10-02T08:08:17.563243Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 276
2025-10-02T08:08:17.564695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dbde98f-efaa0cb4-6aee4a1c-e786ec3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:17.567404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0] Write session: try to update token
2025-10-02T08:08:17.567429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:17.592864Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:17.592889Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:17.592892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:17.592904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533236841128217:5050]
2025-10-02T08:08:17.592910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533236841128217:5050]
2025-10-02T08:08:17.592964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:17.592972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.592975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:17.592978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:17.592986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:17.593144Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:17.594238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId: src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:17.598449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:17.627032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533236841128277:4391]
2025-10-02T08:08:17.627196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 276, pipe: [1:7556533236841128277:4391]
2025-10-02T08:08:17.758482Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:17.759233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.759245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.759299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841128277:4391], now have 1 active actors on pipe
2025-10-02T08:08:17.759436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533236841128277:4391]
2025-10-02T08:08:17.759513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:17.759529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:17.759583Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:17.759600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 277 reason: error at write: Disconnected sessionId: src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0
2025-10-02T08:08:17.759553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:17.759781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 277 sessionId: src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0 is DEAD
2025-10-02T08:08:17.760090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:17.760102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0] Write session will restart in 0.009530s
2025-10-02T08:08:17.760130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0] Write session: Do CDS request
2025-10-02T08:08:17.760136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:17.771374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.771424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:17.771443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 278
2025-10-02T08:08:17.771607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.771641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:17.771654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:17.771658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:17.772072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 278 sessionId:  describe result for acl check
2025-10-02T08:08:17.772104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:17.772106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:17.772107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:17.772113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533236841128398:5057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:17.772597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533236841128398:5057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:17.772945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:17.774734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:17.774919Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:17.774932Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:17.774943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:17.774993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:17.775041Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533236841128433:5056]
2025-10-02T08:08:17.775640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:17.775913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:17.775939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533236841128398:5057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:17.775962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:17.776298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:17.776340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.776341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.776342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.776343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.776344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.776349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.776359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.776363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.776366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.776369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.776375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.776381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.776387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.776392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.776397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.776401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.776405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.776410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.776414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.776418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.776439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:17.784389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533236841128398:5057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:17.784411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533236841128398:5057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:17.784416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533236841128398:5057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:17.784425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:17.787847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:17.789817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:17.789836Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:17.789839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:17.789843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:17.789850Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 277 [1:7556533236841128433:5056]
2025-10-02T08:08:17.789862Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:17.789880Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:17.789883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.789887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.789890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.789907Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:17.789912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:17.789918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:17.789982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.789992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.789995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:17.789997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:17.790062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:17.790071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.790084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.790094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:17.790117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841128463:5057], now have 1 active actors on pipe
2025-10-02T08:08:17.790125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 277
2025-10-02T08:08:17.790129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533236841128413:5056]
2025-10-02T08:08:17.790132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533236841128413:5056]
2025-10-02T08:08:17.790142Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:17.790157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533237301497696:2378], now have 1 active actors on pipe
2025-10-02T08:08:17.790157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:17.790160Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:17.790165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:17.790177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:17.790179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:17.790185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.790189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.790236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533236841128413:5056]
2025-10-02T08:08:17.790239Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:17.790254Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:17.790260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.790263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.790264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:17.790267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:17.790273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.790281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:17.790326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.790391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.790398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.790411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.790449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 278 partition: 0 MaxSeqNo: 17 sessionId: src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0
2025-10-02T08:08:17.791338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a0a7e7-6cf2d16a-74606691-4b87dbaa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:17.790226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 277
2025-10-02T08:08:17.793875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0] Write session: try to update token
2025-10-02T08:08:17.793895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:17.811368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId: src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:17.814370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:17.814901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.814930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.814959Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:17.814967Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:17.814970Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:17.814980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533236841128413:5056]
2025-10-02T08:08:17.814985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533236841128413:5056]
2025-10-02T08:08:17.815040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:17.815057Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:17.815063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:17.815070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.815073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:17.815286Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:17.859388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533236841128478:4391]
2025-10-02T08:08:17.859529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 277, pipe: [1:7556533236841128478:4391]
2025-10-02T08:08:17.962927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:17.962943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0] Write session will restart in 0.009985s
2025-10-02T08:08:17.962970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0] Write session: Do CDS request
2025-10-02T08:08:17.962977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:17.961810Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:17.962329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:17.962370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841128478:4391], now have 1 active actors on pipe
2025-10-02T08:08:17.962419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:17.962498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:17.962500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:17.962518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 278 reason: error at write: Disconnected sessionId: src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0
2025-10-02T08:08:17.962665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 278 sessionId: src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0 is DEAD
2025-10-02T08:08:17.963185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533236841128478:4391]
2025-10-02T08:08:17.963043Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:17.974426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.974994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:17.975019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 279
2025-10-02T08:08:17.975159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:17.975203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:17.975215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:17.975220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:17.975604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 279 sessionId:  describe result for acl check
2025-10-02T08:08:17.975633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:17.975635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:17.975636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:17.975640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533236841128601:5064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:17.976241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533236841128601:5064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:17.978009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:17.981178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:17.981222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533236841128601:5064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:17.981523Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:17.981535Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:17.981549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:17.981610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:17.981658Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533236841128636:5063]
2025-10-02T08:08:17.982320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:17.982663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:17.982721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:17.983188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:17.983259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.983261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.983262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.983263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.983265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.983271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.983282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.983287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.983291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.983294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.983301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.983309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:17.983316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.983321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:17.983325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.983331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:17.983339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.983344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.983349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.983353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.983375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:17.996539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533236841128601:5064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:17.996564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533236841128601:5064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:17.996568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533236841128601:5064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:17.996578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:17.997205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:17.999021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:17.999044Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:17.999047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:17.999055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:17.999062Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 278 [1:7556533236841128636:5063]
2025-10-02T08:08:17.999075Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:17.999091Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:17.999092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.999094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.999095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.999108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:17.999111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:17.999115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:17.999171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.999180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.999183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:17.999184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:17.999247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:17.999254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:17.999265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:17.999276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:17.999291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533236841128620:5063]
2025-10-02T08:08:17.999293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533236841128620:5063]
2025-10-02T08:08:17.999301Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:17.999313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:17.999326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:17.999330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:17.999335Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:17.999339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:17.999362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533236841128661:5064], now have 1 active actors on pipe
2025-10-02T08:08:17.999367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533237301497706:2378], now have 1 active actors on pipe
2025-10-02T08:08:17.999369Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533236841128620:5063]
2025-10-02T08:08:17.999376Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:17.999413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 278
2025-10-02T08:08:17.999618Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:17.999625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.999636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.999687Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:17.999708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:17.999713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:17.999716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:17.999731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:17.999749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:17.999769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.999821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:17.999826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:17.999841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:17.999874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 279 partition: 0 MaxSeqNo: 17 sessionId: src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0
2025-10-02T08:08:18.000455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7c1636-beaf357e-4fea3486-5d184c66_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:18.001160Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 278
2025-10-02T08:08:18.003093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0] Write session: try to update token
2025-10-02T08:08:18.003110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:18.024059Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:18.024093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:18.024097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:18.024111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533236841128620:5063]
2025-10-02T08:08:18.024117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533236841128620:5063]
2025-10-02T08:08:18.024173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:18.024188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.024190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:18.024189Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:18.024196Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:18.024360Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:18.034274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId: src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:18.041325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:18.085726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533241136095987:4391]
2025-10-02T08:08:18.087851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 278, pipe: [1:7556533241136095987:4391]
2025-10-02T08:08:18.118453Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:08:18.118482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-02T08:08:18.201177Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:18.201706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.201718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.201741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136095987:4391], now have 1 active actors on pipe
2025-10-02T08:08:18.202153Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:18.202177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-02T08:08:18.201967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:18.201981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:18.202056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 279 reason: error at write: Disconnected sessionId: src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0
2025-10-02T08:08:18.202069Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:18.202230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 279 sessionId: src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0 is DEAD
2025-10-02T08:08:18.202399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533241136095987:4391]
2025-10-02T08:08:18.202986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:18.203002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0] Write session will restart in 0.009504s
2025-10-02T08:08:18.203029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0] Write session: Do CDS request
2025-10-02T08:08:18.203036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:18.213534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:18.213628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:18.213650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 280
2025-10-02T08:08:18.213831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:18.213866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:18.213873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:18.213877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:18.214404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 280 sessionId:  describe result for acl check
2025-10-02T08:08:18.214448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:18.214455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:18.214456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:18.214463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533241136096158:5084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:18.215005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533241136096158:5084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:18.215501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:18.217270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:18.217466Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:18.217476Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:18.217487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:18.217545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:18.217593Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533241136096186:5083]
2025-10-02T08:08:18.218234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:18.218645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:18.218690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:18.219009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:18.219051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.219052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.219054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.219055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.219056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.219062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.219072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.219076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.219080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.219083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.219088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.219095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.219101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.219105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.219109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.219114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.219117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.219122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.219126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.219132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.219149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:18.220173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533241136096158:5084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:18.229655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533241136096158:5084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:18.229680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533241136096158:5084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:18.229684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533241136096158:5084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:18.229695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:18.234942Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 279
2025-10-02T08:08:18.235421Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:08:18.232642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:18.235462Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:08:18.234507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:18.234515Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:18.234517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:18.234521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:18.234530Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 279 [1:7556533241136096186:5083]
2025-10-02T08:08:18.234545Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:18.234565Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:18.234569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.234576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.234578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.234598Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:18.234604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:18.234611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:18.234686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.234689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.234693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:18.234696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:18.234783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:18.234786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.234801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.234814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:18.234838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136096212:5084], now have 1 active actors on pipe
2025-10-02T08:08:18.234846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533241136096167:5083]
2025-10-02T08:08:18.234849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533241136096167:5083]
2025-10-02T08:08:18.234865Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:18.234878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533241596465044:2378], now have 1 active actors on pipe
2025-10-02T08:08:18.234882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:18.234885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:18.234886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:18.234900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:18.234905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:18.234945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533241136096167:5083]
2025-10-02T08:08:18.234948Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:18.234970Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:18.234994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 279
2025-10-02T08:08:18.235018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.235023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.235623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0dac233-e7c37a3b-ce4f60d9-9c939e74_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:18.235094Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:08:18.235128Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:18.235136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.235140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.235144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:18.235156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.235168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:18.235181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:18.235220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.235223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.235236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:18.235266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 280 partition: 0 MaxSeqNo: 17 sessionId: src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0
2025-10-02T08:08:18.238228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0] Write session: try to update token
2025-10-02T08:08:18.238247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:18.259753Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:18.259778Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:18.259790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533241136096167:5083]
2025-10-02T08:08:18.259852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:18.259868Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:18.260149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:18.260298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:18.260341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId: src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:18.260442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:18.260586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:18.261231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:18.261289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:18.263463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:18.263608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.263628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.263675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:18.263702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:18.263828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.263835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.264073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.264146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.264229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.264328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.264387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.264400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.264479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.264549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.264619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.264698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.264752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.264755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.264855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.264938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.265016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.265090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.265139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.265142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.265224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.265294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.265363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.265438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.265492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.265495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.265577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.265646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.265719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.265793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.265857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.265862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.265952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.266020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.266085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.266154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.266204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.266207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.266290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.266356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.266433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.266503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.266557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.266561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.266639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.266704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.266787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.266871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.266929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.266942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.267021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.267090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.267163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.267239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.267300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.267310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.267394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.267460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.267536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.267619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.267676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.267683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.267730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:18.267807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.267830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.267836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:18.267876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:18.267911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:18.267914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:18.267917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:18.267919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:18.268344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:18.268375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:18.268381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:18.268384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:18.268388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:18.268391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:18.269111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:18.269164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:18.269172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:18.269176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:18.269180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:18.269183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:18.269778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:18.269810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:18.269816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:18.269819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:18.269824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:18.272361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:18.272374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:18.272389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392498272
2025-10-02T08:08:18.272590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:18.272608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:18.272619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:18.272622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:18.272627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:18.272630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:18.273432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:18.273478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:18.273500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:18.273504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:18.273508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:18.273511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:18.274093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:18.274123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:18.274134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:18.274140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:18.274149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:18.274153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:18.274694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:18.274719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:18.274725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:18.275987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:18.276021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:18.276027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:18.276031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:18.276039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392498275
2025-10-02T08:08:18.276385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:18.276409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:18.276415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:18.276418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:18.276422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:18.276426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:18.276992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:18.277015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:18.277022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:18.277026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:18.277028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:18.277032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:18.277542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:18.277566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.277678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392498277
2025-10-02T08:08:18.278524Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:18.278556Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:18.278568Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:18.278576Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:18.280211Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:18.280225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:18.280227Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:18.280236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533241136096167:5083]
2025-10-02T08:08:18.280240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533241136096167:5083]
2025-10-02T08:08:18.280302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:18.280311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.280313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:18.280325Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:18.280352Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:18.280459Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:18.302797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533241136096236:4391]
2025-10-02T08:08:18.302896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 279, pipe: [1:7556533241136096236:4391]
2025-10-02T08:08:18.423259Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:18.423672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136096236:4391], now have 1 active actors on pipe
2025-10-02T08:08:18.423805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533241136096236:4391]
2025-10-02T08:08:18.423954Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:18.423965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:18.423926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:18.423967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:18.424010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 280 reason: error at write: Disconnected sessionId: src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0
2025-10-02T08:08:18.424180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 280 sessionId: src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0 is DEAD
2025-10-02T08:08:18.424332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:18.424343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0] Write session will restart in 0.008576s
2025-10-02T08:08:18.424367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0] Write session: Do CDS request
2025-10-02T08:08:18.424375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:18.432513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:18.433920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:18.434131Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:18.434143Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:18.434154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:18.434212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:18.434254Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533241136096389:5091]
2025-10-02T08:08:18.434453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:18.434924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:18.435134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:18.435182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:18.435487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:18.435548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.435555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.435556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.435557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.435558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.435563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.435573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.435586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.435591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.435594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.435600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.435607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.435613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.435618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.435623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.435628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.435637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.435642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.435651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.435656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.435680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:18.437289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:18.437301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 281
2025-10-02T08:08:18.437513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:18.437545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:18.437555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:18.437559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:18.438002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 281 sessionId:  describe result for acl check
2025-10-02T08:08:18.438038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:18.438044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:18.438046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:18.438051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533241136096405:5093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:18.438564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533241136096405:5093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:18.440363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533241136096405:5093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:18.443205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533241136096405:5093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:18.443220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533241136096405:5093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:18.443224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533241136096405:5093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:18.443257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:18.443930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:18.445874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:18.445891Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:18.445893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:18.445896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:18.445901Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 280 [1:7556533241136096389:5091]
2025-10-02T08:08:18.445909Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:18.445923Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:18.445925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.445927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.445928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.445940Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:18.445944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:18.445949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:18.445996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.446002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.446004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:18.446006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:18.446053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:18.446059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.446067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.446077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:18.446190Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 280
2025-10-02T08:08:18.446103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 280
2025-10-02T08:08:18.446112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136096436:5093], now have 1 active actors on pipe
2025-10-02T08:08:18.446119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533241136096383:5091]
2025-10-02T08:08:18.446122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533241136096383:5091]
2025-10-02T08:08:18.446133Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:18.446144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533241596465056:2378], now have 1 active actors on pipe
2025-10-02T08:08:18.446147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:18.446148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.446150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:18.446152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.446165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:18.446177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:18.446180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:18.446226Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:18.446231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.446234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.446236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:18.446243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.446249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:18.446255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533241136096383:5091]
2025-10-02T08:08:18.446262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:18.446271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:18.446283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:18.446376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.446384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.446407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:18.446453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 281 partition: 0 MaxSeqNo: 17 sessionId: src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0
2025-10-02T08:08:18.446893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749e471d-6aecd6d6-4a7b99f5-df832c66_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:18.449806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0] Write session: try to update token
2025-10-02T08:08:18.449831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:18.465074Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:18.465093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:18.465095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:18.465103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533241136096383:5091]
2025-10-02T08:08:18.465108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533241136096383:5091]
2025-10-02T08:08:18.465147Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:18.465153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:18.465153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:18.465159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.465162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:18.465329Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:18.478081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId: src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:18.481003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:18.524118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533241136096451:4391]
2025-10-02T08:08:18.524462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 280, pipe: [1:7556533241136096451:4391]
2025-10-02T08:08:18.603379Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:18.603641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:18.603653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0] Write session will restart in 0.005087s
2025-10-02T08:08:18.603677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0] Write session: Do CDS request
2025-10-02T08:08:18.603685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:18.602854Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:18.603153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.603159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.603175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136096451:4391], now have 1 active actors on pipe
2025-10-02T08:08:18.603281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:18.603285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:18.603346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 281 reason: error at write: Disconnected sessionId: src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0
2025-10-02T08:08:18.603518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 281 sessionId: src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0 is DEAD
2025-10-02T08:08:18.603684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533241136096451:4391]
2025-10-02T08:08:18.604326Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:18.609946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:18.610435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:18.610445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 282
2025-10-02T08:08:18.610481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:18.610713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:18.610744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:18.610749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:18.610752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:18.611170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 282 sessionId:  describe result for acl check
2025-10-02T08:08:18.611214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:18.611216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:18.611217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:18.611223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533241136096594:5099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:18.611264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:18.611419Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:18.611429Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:18.611437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:18.611475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:18.611509Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533241136096596:5097]
2025-10-02T08:08:18.611708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533241136096594:5099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:18.612141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:18.612306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:18.612343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:18.612618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:18.612663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.612664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.612665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.612666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.612668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.612672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.612681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.612685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.612688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.612691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.612695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.612701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.612706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.612712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.612716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.612721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.612724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.612728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.612733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.612738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.612754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:18.614012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533241136096594:5099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:18.619946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533241136096594:5099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:18.619966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533241136096594:5099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:18.619970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533241136096594:5099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:18.619978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:18.620421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:18.622138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:18.622157Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:18.622159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:18.622162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:18.622167Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 281 [1:7556533241136096596:5097]
2025-10-02T08:08:18.622175Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:18.622189Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:18.622191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.622192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.622194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.622207Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:18.622210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:18.622214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:18.622266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.622268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.622272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:18.622274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:18.622420Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 281
2025-10-02T08:08:18.622352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:18.622361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.622373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.622384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:18.622390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 281
2025-10-02T08:08:18.622401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136096641:5099], now have 1 active actors on pipe
2025-10-02T08:08:18.622404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533241596465062:2378], now have 1 active actors on pipe
2025-10-02T08:08:18.622408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.622411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.622424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533241136096587:5097]
2025-10-02T08:08:18.622425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533241136096587:5097]
2025-10-02T08:08:18.622432Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:18.622442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:18.622449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:18.622451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:18.622457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:18.622460Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:18.622462Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cd091e1-55d65a49-aa824249-bc225e30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:18.622466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.622468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.622470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:18.622477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.622485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:18.622519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533241136096587:5097]
2025-10-02T08:08:18.622525Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:18.622532Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:18.622539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:18.622591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.622592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.622602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:18.622629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 282 partition: 0 MaxSeqNo: 17 sessionId: src_id|8cd091e1-55d65a49-aa824249-bc225e30_0
2025-10-02T08:08:18.622947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386fc9b0-f237a415-a9c5eb84-c96f39eb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8cd091e1-55d65a49-aa824249-bc225e30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:18.625885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd091e1-55d65a49-aa824249-bc225e30_0] Write session: try to update token
2025-10-02T08:08:18.625903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd091e1-55d65a49-aa824249-bc225e30_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:18.637948Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:18.637973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:18.637983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533241136096587:5097]
2025-10-02T08:08:18.638035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:18.638040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:18.638265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:18.638439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:18.638612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:18.638775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:18.638988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:18.639039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:18.644812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId: src_id|8cd091e1-55d65a49-aa824249-bc225e30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:18.648040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:18.648123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.648137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.648214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:18.648245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:18.648367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.648393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.649542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.649664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.649757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.650881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.651612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.651627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.651908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.652183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.652926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.653513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.653676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.653686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.653766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.653843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.654120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.654366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.654686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.654702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.654946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.655046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.655124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.655201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.655343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.655355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.655430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.655519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.655830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.656128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.656282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.656291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.657201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.658085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.658862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.659633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.659705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.659715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.660488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.661606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.661874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.662126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.662480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.662492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.663223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.663965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.664508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.665046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.665184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.665198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.665492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.666051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.666335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.666630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.666769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.666781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.667577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:18.668361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:18.669133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:18.669918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:18.670066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:18.670078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:18.670174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:18.670259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.670283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.670290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:18.670330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:18.670355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:18.670359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:18.670362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:18.670366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:18.670841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:18.670874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:18.670888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:18.670892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:18.670896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:18.670903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:18.674062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:18.674097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:18.674106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:18.674113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:18.674121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:18.674128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:18.674824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:18.674849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:18.674860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:18.674864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:18.674868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:18.690053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:18.690087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:18.690104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392498689
2025-10-02T08:08:18.690298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:18.690316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:18.690332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:18.690340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:18.690345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:18.690348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:18.691050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:18.691078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:18.691092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:18.691100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:18.691104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:18.691107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:18.691744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:18.691767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:18.691779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:18.691787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:18.691791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:18.691794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:18.692418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:18.692445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:18.692450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:18.693938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:18.693959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:18.693966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:18.693970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:18.693982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392498693
2025-10-02T08:08:18.694349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:18.694376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:18.694385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:18.694387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:18.694390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:18.694393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:18.695001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:18.695030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:18.695041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:18.695044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:18.695047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:18.695051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:18.695613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:18.695639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.695741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392498695
2025-10-02T08:08:18.700477Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:18.700516Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:18.700524Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:18.700533Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:18.700546Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:18.700548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:18.700550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:18.700560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533241136096587:5097]
2025-10-02T08:08:18.700565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533241136096587:5097]
2025-10-02T08:08:18.700643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:18.700649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:18.700653Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:18.700654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.700656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:18.700847Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:18.703702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533241136096658:4391]
2025-10-02T08:08:18.703813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 281, pipe: [1:7556533241136096658:4391]
2025-10-02T08:08:18.841153Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:18.841656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136096658:4391], now have 1 active actors on pipe
2025-10-02T08:08:18.841911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533241136096658:4391]
2025-10-02T08:08:18.841950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:18.841952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:18.841973Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:18.841981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 282 reason: error at write: Disconnected sessionId: src_id|8cd091e1-55d65a49-aa824249-bc225e30_0
2025-10-02T08:08:18.842009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:18.842159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 282 sessionId: src_id|8cd091e1-55d65a49-aa824249-bc225e30_0 is DEAD
2025-10-02T08:08:18.842452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd091e1-55d65a49-aa824249-bc225e30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:18.842464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd091e1-55d65a49-aa824249-bc225e30_0] Write session will restart in 0.005147s
2025-10-02T08:08:18.842495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd091e1-55d65a49-aa824249-bc225e30_0] Write session: Do CDS request
2025-10-02T08:08:18.842503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd091e1-55d65a49-aa824249-bc225e30_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:18.845590Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [47331244b3b24b29] Result# TEvPutResult {Id# [72075186224037892:281:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:18.845645Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:281:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:18.845705Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:281:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:18.849487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd091e1-55d65a49-aa824249-bc225e30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:18.849556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:18.849569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 283
2025-10-02T08:08:18.849812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:18.849845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:18.849855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:18.849859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:18.850380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 283 sessionId:  describe result for acl check
2025-10-02T08:08:18.850451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:18.850460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:18.850461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:18.850468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533241136096787:5105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:18.851116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533241136096787:5105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:18.852115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:18.853099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533241136096787:5105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:18.855537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:18.855845Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:18.855856Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:18.855868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:18.855940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:18.855976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533241136096787:5105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:18.855985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533241136096787:5105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:18.855988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533241136096787:5105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:18.856004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:18.856012Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533241136096840:5104]
2025-10-02T08:08:18.856639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:18.856823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:18.856868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:18.857167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:18.857216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.857223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.857225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.857226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.857227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.857233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.857242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.857250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.857254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.857258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.857263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.857270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:18.857275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.857280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:18.857284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.857289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:18.857298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.857303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.857312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.857317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.857340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:18.865187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:18.868239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:18.868250Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:18.868252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:18.868257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:18.868261Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 282 [1:7556533241136096840:5104]
2025-10-02T08:08:18.868268Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:18.868282Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:18.868284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.868286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.868287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.868299Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:18.868303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:18.868307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:18.868357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.868363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.868366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:18.868368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:18.868412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:18.868416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.868425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:18.868434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:18.868448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533241136096818:5104]
2025-10-02T08:08:18.868449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533241136096818:5104]
2025-10-02T08:08:18.868453Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:18.868462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:18.868470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:18.868477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:18.868476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:18.868480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:18.868512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533241136096818:5104]
2025-10-02T08:08:18.868518Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:18.868520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:18.868522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 282
2025-10-02T08:08:18.868527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136096845:5105], now have 1 active actors on pipe
2025-10-02T08:08:18.868530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533241596465071:2378], now have 1 active actors on pipe
2025-10-02T08:08:18.868543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.868552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.868575Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc10a643-2324d4cf-68a5f627-a329e177_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:18.868583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:18.868586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:18.868587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:18.868593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:18.868601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:18.868618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:18.868583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 282
2025-10-02T08:08:18.868669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:18.868677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:18.868694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:18.868731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 283 partition: 0 MaxSeqNo: 17 sessionId: src_id|dc10a643-2324d4cf-68a5f627-a329e177_0
2025-10-02T08:08:18.870913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd091e1-55d65a49-aa824249-bc225e30_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dc10a643-2324d4cf-68a5f627-a329e177_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:18.885442Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:18.885456Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:18.885458Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:18.885467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533241136096818:5104]
2025-10-02T08:08:18.885470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533241136096818:5104]
2025-10-02T08:08:18.885513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:18.885515Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:18.885518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:18.885520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:18.885521Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:18.885678Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:18.897141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc10a643-2324d4cf-68a5f627-a329e177_0] Write session: try to update token
2025-10-02T08:08:18.897169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc10a643-2324d4cf-68a5f627-a329e177_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:18.942295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533241136096871:4391]
2025-10-02T08:08:18.942408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 282, pipe: [1:7556533241136096871:4391]
2025-10-02T08:08:18.953195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId: src_id|dc10a643-2324d4cf-68a5f627-a329e177_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:18.956395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:19.023730Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:19.024054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533241136096871:4391], now have 1 active actors on pipe
2025-10-02T08:08:19.024081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.024090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.024179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:19.024188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:19.024235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 283 reason: error at write: Disconnected sessionId: src_id|dc10a643-2324d4cf-68a5f627-a329e177_0
2025-10-02T08:08:19.024334Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:19.024420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 283 sessionId: src_id|dc10a643-2324d4cf-68a5f627-a329e177_0 is DEAD
2025-10-02T08:08:19.024439Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:19.024552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc10a643-2324d4cf-68a5f627-a329e177_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:19.024561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc10a643-2324d4cf-68a5f627-a329e177_0] Write session will restart in 0.005353s
2025-10-02T08:08:19.024537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533241136096871:4391]
2025-10-02T08:08:19.024586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc10a643-2324d4cf-68a5f627-a329e177_0] Write session: Do CDS request
2025-10-02T08:08:19.024593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc10a643-2324d4cf-68a5f627-a329e177_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:19.031355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc10a643-2324d4cf-68a5f627-a329e177_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.031488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:19.031500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 284
2025-10-02T08:08:19.031832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:19.031836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.031859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:19.031862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:19.031866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:19.032211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 284 sessionId:  describe result for acl check
2025-10-02T08:08:19.032242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:19.032243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:19.032244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:19.032249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533245431064314:5112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:19.032736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533245431064314:5112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:19.033203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:19.033492Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:19.033503Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:19.033514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:19.033571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:19.033605Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533245431064324:5110]
2025-10-02T08:08:19.034167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:19.034353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:19.034408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:19.034721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533245431064314:5112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:19.034763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:19.034817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.034823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.034825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.034826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.034827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.034833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.034843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.034847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.034851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.034854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.034860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.034872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.034877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.034886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.034891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.034896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.034900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.034905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.034910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.034915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.034934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:19.040830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533245431064314:5112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:19.040850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533245431064314:5112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:19.040853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533245431064314:5112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:19.040863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:19.042933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:19.044873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:19.044885Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:19.044887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:19.044890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:19.044896Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 283 [1:7556533245431064324:5110]
2025-10-02T08:08:19.044908Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:19.044924Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:19.044927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.044930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.044932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.044949Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:19.044954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:19.044961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:19.045026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.045036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.045039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:19.045041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:19.045098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:19.045105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.045117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.045133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:19.045155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 283
2025-10-02T08:08:19.045158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431064363:5112], now have 1 active actors on pipe
2025-10-02T08:08:19.045164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533245431064308:5110]
2025-10-02T08:08:19.045165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533245431064308:5110]
2025-10-02T08:08:19.045178Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:19.045186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533245891432374:2378], now have 1 active actors on pipe
2025-10-02T08:08:19.045190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.045194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.045206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:19.045213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:19.045217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:19.045226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:19.045228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:19.045234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 283
2025-10-02T08:08:19.045267Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:19.045281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.045284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.045286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:19.045293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.045301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:19.045308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533245431064308:5110]
2025-10-02T08:08:19.045318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:19.045335Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:19.045347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.045425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.045432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.045447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.045484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 284 partition: 0 MaxSeqNo: 17 sessionId: src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0
2025-10-02T08:08:19.045888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc10a643-2324d4cf-68a5f627-a329e177_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:19.048411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0] Write session: try to update token
2025-10-02T08:08:19.048432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:19.062506Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:19.062525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:19.062527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:19.062535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533245431064308:5110]
2025-10-02T08:08:19.062539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533245431064308:5110]
2025-10-02T08:08:19.062588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:19.062592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:19.062597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.062598Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:19.062600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:19.062762Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:19.073478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId: src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:19.076324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:19.128247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533245431064389:4391]
2025-10-02T08:08:19.130122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 283, pipe: [1:7556533245431064389:4391]
2025-10-02T08:08:19.202016Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:19.202305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.202318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.202337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431064389:4391], now have 1 active actors on pipe
2025-10-02T08:08:19.202430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:19.202447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:19.202501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 284 reason: error at write: Disconnected sessionId: src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0
2025-10-02T08:08:19.202514Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:19.202561Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:19.202670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 284 sessionId: src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0 is DEAD
2025-10-02T08:08:19.202789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533245431064389:4391]
2025-10-02T08:08:19.202843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:19.202856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0] Write session will restart in 0.005097s
2025-10-02T08:08:19.202885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0] Write session: Do CDS request
2025-10-02T08:08:19.202893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:19.209461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.209563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:19.209576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 285
2025-10-02T08:08:19.209712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.209740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:19.209749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:19.209753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:19.210093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 285 sessionId:  describe result for acl check
2025-10-02T08:08:19.210123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:19.210129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:19.210131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:19.210136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533245431064560:5128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:19.210599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:19.210620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533245431064560:5128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:19.212106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:19.212324Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:19.212332Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:19.212343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:19.212392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:19.212441Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533245431064588:5127]
2025-10-02T08:08:19.212751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533245431064560:5128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:19.213061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:19.213307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:19.213363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:19.213668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:19.213713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.213718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.213719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.213720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.213721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.213726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.213734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.213738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.213749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.213757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.213761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.213767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.213773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.213777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.213782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.213786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.213791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.213795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.213799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.213804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.213841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:19.218678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533245431064560:5128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:19.218691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533245431064560:5128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:19.218694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533245431064560:5128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:19.218703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:19.221913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:19.223654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:19.223674Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:19.223675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:19.223679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:19.223685Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 284 [1:7556533245431064588:5127]
2025-10-02T08:08:19.223695Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:19.223710Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:19.223712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.223715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.223718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.223733Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:19.223737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:19.223744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:19.223828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.223834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.223837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:19.223840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:19.223906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:19.223920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.223934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.223949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:19.223969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431064615:5128], now have 1 active actors on pipe
2025-10-02T08:08:19.223975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533245891432406:2378], now have 1 active actors on pipe
2025-10-02T08:08:19.223974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 284
2025-10-02T08:08:19.223982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533245431064564:5127]
2025-10-02T08:08:19.223984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533245431064564:5127]
2025-10-02T08:08:19.224004Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:19.224025Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:19.224028Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:19.224033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.224037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.224052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:19.224063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:19.224228Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 284
2025-10-02T08:08:19.224066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:19.224108Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:19.224116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.224120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.224121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:19.224129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.224136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:19.224142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533245431064564:5127]
2025-10-02T08:08:19.224151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:19.224179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.224191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:19.224314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.224320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.224333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.224411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 285 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0
2025-10-02T08:08:19.224881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919be0d5-9b18b9d8-2f91667a-17501a2a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:19.227680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Write session: try to update token
2025-10-02T08:08:19.227703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:19.241920Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:19.241938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:19.241940Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:19.241949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533245431064564:5127]
2025-10-02T08:08:19.241953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533245431064564:5127]
2025-10-02T08:08:19.241993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:19.241993Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:19.241999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:19.241999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.242001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:19.242208Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:19.255195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId: src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:19.258137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:19.295285Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:08:19.302726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533245431064635:4391]
2025-10-02T08:08:19.302832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 284, pipe: [1:7556533245431064635:4391]
2025-10-02T08:08:19.391716Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:19.392111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.392128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.392153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431064635:4391], now have 1 active actors on pipe
2025-10-02T08:08:19.392282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533245431064635:4391]
2025-10-02T08:08:19.392308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:19.392311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:19.392372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 285 reason: error at write: Disconnected sessionId: src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0
2025-10-02T08:08:19.392555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 285 sessionId: src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0 is DEAD
2025-10-02T08:08:19.392516Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:19.393601Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:19.395457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:19.395472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Write session will restart in 0.009668s
2025-10-02T08:08:19.395500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Write session: Do CDS request
2025-10-02T08:08:19.395510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:19.404247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:19.406419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:19.406525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.406649Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:19.406661Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:19.406672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:19.406726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:19.406765Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533245431064804:5144]
2025-10-02T08:08:19.406844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:19.406854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 286
2025-10-02T08:08:19.407039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.407067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:19.407076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:19.407079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:19.407400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:19.407483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 286 sessionId:  describe result for acl check
2025-10-02T08:08:19.407516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:19.407518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:19.407520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:19.407525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533245431064810:5146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:19.407662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:19.407721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:19.408066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533245431064810:5146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:19.408088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:19.408136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.408143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.408144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.408145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.408147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.408152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.408161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.408169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.408173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.408176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.408182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.408189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.408194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.408205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.408214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.408218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.408226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.408231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.408239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.408244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.408266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:19.410503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533245431064810:5146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:19.415786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533245431064810:5146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:19.415800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533245431064810:5146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:19.415803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533245431064810:5146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:19.415823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:19.416401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:19.418135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:19.418147Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:19.418149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:19.418153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:19.418158Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 285 [1:7556533245431064804:5144]
2025-10-02T08:08:19.418167Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:19.418182Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:19.418188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.418190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.418191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.418202Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:19.418209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:19.418215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:19.418272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.418277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.418280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:19.418282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:19.418336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:19.418342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.418355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.418370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:19.418387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431064854:5146], now have 1 active actors on pipe
2025-10-02T08:08:19.418390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533245891432423:2378], now have 1 active actors on pipe
2025-10-02T08:08:19.418395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533245431064796:5144]
2025-10-02T08:08:19.418395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 285
2025-10-02T08:08:19.418397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533245431064796:5144]
2025-10-02T08:08:19.418402Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:19.418412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:19.418415Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:19.418418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:19.418433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:19.418435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:19.418442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.418447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.418482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533245431064796:5144]
2025-10-02T08:08:19.418488Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:19.418499Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:19.418506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:19.418507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.418509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.418510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:19.418518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.418486Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 285
2025-10-02T08:08:19.418524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:19.418557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.418626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.418632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.418644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.418679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 286 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0
2025-10-02T08:08:19.419014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 194 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:08:19.419066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ffb128-dbbb9676-bcf4fa61-a0ae69f9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:19.421668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0] Write session: try to update token
2025-10-02T08:08:19.421686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:19.435423Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:19.435440Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:19.435442Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:19.435448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533245431064796:5144]
2025-10-02T08:08:19.435451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533245431064796:5144]
2025-10-02T08:08:19.435488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:19.435492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.435495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:19.435504Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:19.435511Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:19.435637Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:19.448115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId: src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:19.451013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:19.492697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533245431064868:4391]
2025-10-02T08:08:19.492829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 285, pipe: [1:7556533245431064868:4391]
2025-10-02T08:08:19.573388Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:19.573737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.573752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.573769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431064868:4391], now have 1 active actors on pipe
2025-10-02T08:08:19.573891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:19.573901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:19.573965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 286 reason: error at write: Disconnected sessionId: src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0
2025-10-02T08:08:19.574008Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:19.574156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 286 sessionId: src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0 is DEAD
2025-10-02T08:08:19.574230Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:19.574289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:19.574308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0] Write session will restart in 0.005425s
2025-10-02T08:08:19.574339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533245431064868:4391]
2025-10-02T08:08:19.574414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0] Write session: Do CDS request
2025-10-02T08:08:19.574433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:19.581557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.581670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:19.581691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 287
2025-10-02T08:08:19.581817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.581868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:19.581878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:19.581882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:19.582267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 287 sessionId:  describe result for acl check
2025-10-02T08:08:19.582299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:19.582301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:19.582302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:19.582307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533245431065015:5152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:19.582810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533245431065015:5152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:19.582875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:19.584704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:19.584951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533245431065015:5152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:19.584983Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:19.584988Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:19.585004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:19.585088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:19.585146Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533245431065042:5150]
2025-10-02T08:08:19.585898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:19.586141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:19.586207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:19.586518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:19.586579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.586586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.586587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.586588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.586589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.586594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.586604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.586608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.586612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.586616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.586621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.586628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.586635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.586640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.586645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.586650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.586654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.586659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.586663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.586668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.586687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:19.588998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533245431065015:5152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:19.589012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533245431065015:5152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:19.589016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533245431065015:5152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:19.589024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:19.595190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:19.600929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e15bf83-edb4c83e-9edd46f2-8b761f7a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4b379457-738c9667-2472f6c1-15cbd266_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:19.597829Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 286
2025-10-02T08:08:19.597027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:19.597044Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:19.597050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:19.597053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:19.597059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 286 [1:7556533245431065042:5150]
2025-10-02T08:08:19.597070Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:19.597086Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:19.597089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.597092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.597094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.597108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:19.597114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:19.597120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:19.597179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.597181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.597183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:19.597186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:19.597259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:19.597262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.597277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.597288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:19.597303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533245431065018:5150]
2025-10-02T08:08:19.597305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533245431065018:5150]
2025-10-02T08:08:19.597317Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:19.597331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:19.597344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:19.597347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:19.597369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:19.597372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:19.597378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533245431065018:5150]
2025-10-02T08:08:19.597381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:19.597430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 286
2025-10-02T08:08:19.597438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431065069:5152], now have 1 active actors on pipe
2025-10-02T08:08:19.597443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.597447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.597463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:19.597472Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b379457-738c9667-2472f6c1-15cbd266_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:19.597477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.597481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.597483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:19.597490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.597498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:19.597506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533245891432430:2378], now have 1 active actors on pipe
2025-10-02T08:08:19.597516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.597738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.597741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.597754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.597790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 287 partition: 0 MaxSeqNo: 17 sessionId: src_id|4b379457-738c9667-2472f6c1-15cbd266_0
2025-10-02T08:08:19.603933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b379457-738c9667-2472f6c1-15cbd266_0] Write session: try to update token
2025-10-02T08:08:19.603949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b379457-738c9667-2472f6c1-15cbd266_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:19.615373Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:19.615394Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:19.615396Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:19.615405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533245431065018:5150]
2025-10-02T08:08:19.615410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533245431065018:5150]
2025-10-02T08:08:19.615452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:19.615454Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:19.615459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.615461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:19.615471Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:19.615756Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:19.626672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId: src_id|4b379457-738c9667-2472f6c1-15cbd266_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:19.629949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:19.680877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533245431065083:4391]
2025-10-02T08:08:19.681149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 286, pipe: [1:7556533245431065083:4391]
2025-10-02T08:08:19.758852Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:19.759169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.759179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.759201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431065083:4391], now have 1 active actors on pipe
2025-10-02T08:08:19.759331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:19.759341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:19.759422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 287 reason: error at write: Disconnected sessionId: src_id|4b379457-738c9667-2472f6c1-15cbd266_0
2025-10-02T08:08:19.759437Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:19.759587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 287 sessionId: src_id|4b379457-738c9667-2472f6c1-15cbd266_0 is DEAD
2025-10-02T08:08:19.759649Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:19.759714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b379457-738c9667-2472f6c1-15cbd266_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:19.759722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b379457-738c9667-2472f6c1-15cbd266_0] Write session will restart in 0.008862s
2025-10-02T08:08:19.759742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b379457-738c9667-2472f6c1-15cbd266_0] Write session: Do CDS request
2025-10-02T08:08:19.759748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b379457-738c9667-2472f6c1-15cbd266_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:19.759767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533245431065083:4391]
2025-10-02T08:08:19.767394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:19.768885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:19.769088Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:19.769097Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:19.769108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:19.769176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:19.769212Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533245431065238:5156]
2025-10-02T08:08:19.769436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b379457-738c9667-2472f6c1-15cbd266_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.769823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:19.769834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 288
2025-10-02T08:08:19.769857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:19.770012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.770047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:19.770066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:19.770070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:19.770078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:19.770131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:19.770445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 288 sessionId:  describe result for acl check
2025-10-02T08:08:19.770474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:19.770481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:19.770482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:19.770486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533245431065249:5158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:19.770579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:19.770663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.770671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.770672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.770673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.770674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.770680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.770690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.770694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.770700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.770704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.770710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.770721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.770731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.770739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.770746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.770754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.770758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.770762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.770767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.770771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.770793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:19.770903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533245431065249:5158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:19.773164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533245431065249:5158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:19.779010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533245431065249:5158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:19.779026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533245431065249:5158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:19.779029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533245431065249:5158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:19.779038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:19.779104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:19.780842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:19.780856Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:19.780859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:19.780862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:19.780869Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 287 [1:7556533245431065238:5156]
2025-10-02T08:08:19.780881Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:19.780896Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:19.780899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.780901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.780903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.780919Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:19.780924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:19.780930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:19.780993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.781000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.781003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:19.781005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:19.781072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:19.781080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.781094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.781102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 287
2025-10-02T08:08:19.781111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:19.781136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431065286:5158], now have 1 active actors on pipe
2025-10-02T08:08:19.781145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533245891432438:2378], now have 1 active actors on pipe
2025-10-02T08:08:19.781149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.781153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.781170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533245431065232:5156]
2025-10-02T08:08:19.781179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533245431065232:5156]
2025-10-02T08:08:19.781186Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:19.781198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:19.781200Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:19.781203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:19.781169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 287
2025-10-02T08:08:19.781211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:19.781214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:19.781228Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:19.781233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.781236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.781237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:19.781244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.781250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:19.781283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533245431065232:5156]
2025-10-02T08:08:19.781289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:19.781295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:19.781299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.781407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.781414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.781430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.781469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 288 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0
2025-10-02T08:08:19.781930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b379457-738c9667-2472f6c1-15cbd266_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:19.784933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0] Write session: try to update token
2025-10-02T08:08:19.784954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:19.792001Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:19.792015Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:19.792024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533245431065232:5156]
2025-10-02T08:08:19.792066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:19.792067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:19.792251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:19.792396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:19.792536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:19.792816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:19.793019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:19.793058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:19.804546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId: src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:19.807205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:19.809054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.809079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.809101Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:19.809103Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:19.809106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:19.809113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533245431065232:5156]
2025-10-02T08:08:19.809120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533245431065232:5156]
2025-10-02T08:08:19.809157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:19.809167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:19.809173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:19.809173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.809175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:19.809311Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:19.859801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533245431065303:4391]
2025-10-02T08:08:19.859927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 287, pipe: [1:7556533245431065303:4391]
2025-10-02T08:08:19.954161Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:19.954544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:19.954576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431065303:4391], now have 1 active actors on pipe
2025-10-02T08:08:19.954590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:19.954681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:19.954686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:19.954706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 288 reason: error at write: Disconnected sessionId: src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0
2025-10-02T08:08:19.954833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 288 sessionId: src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0 is DEAD
2025-10-02T08:08:19.954980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533245431065303:4391]
2025-10-02T08:08:19.954996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:19.955011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0] Write session will restart in 0.006335s
2025-10-02T08:08:19.955036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0] Write session: Do CDS request
2025-10-02T08:08:19.955043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:19.954775Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:19.962535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.962661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:19.962677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 289
2025-10-02T08:08:19.963014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:19.963051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:19.963061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:19.963066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:19.963580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 289 sessionId:  describe result for acl check
2025-10-02T08:08:19.963625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:19.963633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:19.963634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:19.963639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533245431065458:5165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:19.964001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:19.964140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533245431065458:5165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:19.966405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533245431065458:5165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:19.967492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:19.967688Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:19.967695Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:19.967702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:19.967764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:19.967802Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533245431065491:5163]
2025-10-02T08:08:19.968339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:19.968570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:19.968612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:19.968873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:19.968907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.968912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.968912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.968913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.968914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.968917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.968941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.968948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.968952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.968955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.968960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.968968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:19.968978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.968983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:19.968991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.968994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:19.968996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.968999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.969002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.969013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.969038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:19.978529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533245431065458:5165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:19.978546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533245431065458:5165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:19.978550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533245431065458:5165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:19.978558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:19.988017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:19.990432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:19.990454Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:19.990457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:19.990461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:19.990468Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 288 [1:7556533245431065491:5163]
2025-10-02T08:08:19.990485Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:19.990505Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:19.990509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.990512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.990515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.990533Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:19.990538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:19.990545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:19.990617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.990629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.990632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:19.990634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:19.990703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:19.990715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:19.990731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:19.990749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:19.990769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533245431065508:5165], now have 1 active actors on pipe
2025-10-02T08:08:19.990776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533245431065459:5163]
2025-10-02T08:08:19.990778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533245431065459:5163]
2025-10-02T08:08:19.990785Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:19.990798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:19.990811Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:19.990813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:19.990815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:19.990817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:19.990855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533245891432447:2378], now have 1 active actors on pipe
2025-10-02T08:08:19.990857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533245431065459:5163]
2025-10-02T08:08:19.990861Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:19.990908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 288
2025-10-02T08:08:19.991185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:19.991267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.991289Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 288
2025-10-02T08:08:19.991280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.991312Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:19.991320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:19.991325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:19.991327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:19.991338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:19.991350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:19.991372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.991456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:19.991464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:19.991476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:19.991506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 289 partition: 0 MaxSeqNo: 17 sessionId: src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0
2025-10-02T08:08:19.991975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e5239dc-ea33dcb8-dbc42a46-61c4fcde_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:19.994860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0] Write session: try to update token
2025-10-02T08:08:19.994884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:20.015072Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:20.015094Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:20.015098Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:20.015110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533245431065459:5163]
2025-10-02T08:08:20.015116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533245431065459:5163]
2025-10-02T08:08:20.015168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:20.015176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.015179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:20.015358Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:20.015895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId: src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:20.018613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:20.018631Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:20.019272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:20.055356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533249726032819:4391]
2025-10-02T08:08:20.056977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 288, pipe: [1:7556533249726032819:4391]
2025-10-02T08:08:20.197018Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:20.197398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.197415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.197440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726032819:4391], now have 1 active actors on pipe
2025-10-02T08:08:20.198464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533249726032819:4391]
2025-10-02T08:08:20.198491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:20.198494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:20.198554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 289 reason: error at write: Disconnected sessionId: src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0
2025-10-02T08:08:20.198623Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:20.198743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 289 sessionId: src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0 is DEAD
2025-10-02T08:08:20.198763Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:20.198893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:20.198905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0] Write session will restart in 0.006361s
2025-10-02T08:08:20.198932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0] Write session: Do CDS request
2025-10-02T08:08:20.198939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:20.207073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:20.207204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.207274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:20.207285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 290
2025-10-02T08:08:20.207785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.207843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:20.207855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:20.207860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:20.208353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 290 sessionId:  describe result for acl check
2025-10-02T08:08:20.208397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:20.208400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:20.208401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:20.208407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533249726033023:5182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:20.208886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:20.209015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533249726033023:5182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:20.209127Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:20.209133Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:20.209147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:20.209213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:20.209256Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533249726033026:5180]
2025-10-02T08:08:20.209915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:20.210211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:20.210266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:20.210783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:20.210871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.210878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.210879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.210881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.210882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.210889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.210900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.210904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.210907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.210911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.210917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.210926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.210937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.210942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.210952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.210958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.210962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.210968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.210973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.210982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.211003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:20.211556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533249726033023:5182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:20.216944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533249726033023:5182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:20.216962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533249726033023:5182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:20.216965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533249726033023:5182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:20.216974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:20.218903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:20.220733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:20.220749Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:20.220751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:20.220757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:20.220764Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 289 [1:7556533249726033026:5180]
2025-10-02T08:08:20.220775Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:20.220792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:20.220795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.220797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.220819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.220835Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:20.220839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:20.220847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:20.220903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.220905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.220909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:20.220912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:20.220974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:20.220976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.220988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.220999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:20.221102Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 289
2025-10-02T08:08:20.221016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033068:5182], now have 1 active actors on pipe
2025-10-02T08:08:20.221015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 289
2025-10-02T08:08:20.221030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533249726033016:5180]
2025-10-02T08:08:20.221032Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533249726033016:5180]
2025-10-02T08:08:20.221044Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:20.221052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533250186399762:2378], now have 1 active actors on pipe
2025-10-02T08:08:20.221057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.221059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:20.221062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:20.221063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.221080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:20.221093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:20.221096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:20.221137Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a385f8d1-1063f67d-832c78e7-479e14c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:20.221142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.221145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.221147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:20.221154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.221162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:20.221170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533249726033016:5180]
2025-10-02T08:08:20.221179Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:20.221190Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:20.221211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.221265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.221268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.221281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.221316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 290 partition: 0 MaxSeqNo: 17 sessionId: src_id|a385f8d1-1063f67d-832c78e7-479e14c_0
2025-10-02T08:08:20.221695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ad8edb-30d8b027-773b3b96-a2ab8079_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a385f8d1-1063f67d-832c78e7-479e14c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:20.224540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a385f8d1-1063f67d-832c78e7-479e14c_0] Write session: try to update token
2025-10-02T08:08:20.224561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a385f8d1-1063f67d-832c78e7-479e14c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:20.240928Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:20.240947Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:20.240949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:20.240957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533249726033016:5180]
2025-10-02T08:08:20.240961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533249726033016:5180]
2025-10-02T08:08:20.241004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:20.241006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:20.241010Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:20.241012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.241014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:20.241179Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:20.247232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId: src_id|a385f8d1-1063f67d-832c78e7-479e14c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:20.250277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:20.298534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533249726033089:4391]
2025-10-02T08:08:20.298684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 289, pipe: [1:7556533249726033089:4391]
2025-10-02T08:08:20.380548Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:20.380897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.380914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.380934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033089:4391], now have 1 active actors on pipe
2025-10-02T08:08:20.381056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533249726033089:4391]
2025-10-02T08:08:20.381083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:20.381085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:20.381146Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:20.381134Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:20.381155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 290 reason: error at write: Disconnected sessionId: src_id|a385f8d1-1063f67d-832c78e7-479e14c_0
2025-10-02T08:08:20.381324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 290 sessionId: src_id|a385f8d1-1063f67d-832c78e7-479e14c_0 is DEAD
2025-10-02T08:08:20.382784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a385f8d1-1063f67d-832c78e7-479e14c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:20.382796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a385f8d1-1063f67d-832c78e7-479e14c_0] Write session will restart in 0.009148s
2025-10-02T08:08:20.382819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a385f8d1-1063f67d-832c78e7-479e14c_0] Write session: Do CDS request
2025-10-02T08:08:20.382824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a385f8d1-1063f67d-832c78e7-479e14c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:20.388978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:20.390360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:20.390508Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:20.390516Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:20.390522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:20.390554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:20.390583Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533249726033257:5189]
2025-10-02T08:08:20.391080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:20.391253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:20.391298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:20.391543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:20.391578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.391582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.391582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.391583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.391584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.391587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.391594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.391596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.391598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.391600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.391605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.391609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.391613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.391616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.391618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.391621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.391624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.391627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.391629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.391632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.391642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:20.393424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a385f8d1-1063f67d-832c78e7-479e14c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.393510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:20.393519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 291
2025-10-02T08:08:20.393777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.393831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:20.393844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:20.393850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:20.394370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 291 sessionId:  describe result for acl check
2025-10-02T08:08:20.394417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:20.394425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:20.394427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:20.394434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533249726033274:5191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:20.395068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533249726033274:5191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:20.397186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533249726033274:5191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:20.399945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533249726033274:5191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:20.399961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533249726033274:5191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:20.399966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533249726033274:5191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:20.399978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:20.400057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:20.401699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:20.401714Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:20.401717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:20.401720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:20.401726Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 290 [1:7556533249726033257:5189]
2025-10-02T08:08:20.401735Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:20.401752Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:20.401757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.401759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.401760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.401773Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:20.401776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:20.401780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:20.401843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.401848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.401850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:20.401852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:20.401938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 290
2025-10-02T08:08:20.402012Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 290
2025-10-02T08:08:20.402029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:20.402040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.402052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.402064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:20.402085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033305:5191], now have 1 active actors on pipe
2025-10-02T08:08:20.402092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533250186399796:2378], now have 1 active actors on pipe
2025-10-02T08:08:20.402097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.402104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.402123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533249726033251:5189]
2025-10-02T08:08:20.402128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533249726033251:5189]
2025-10-02T08:08:20.402137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:20.402150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:20.402155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:20.402157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:20.402162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:20.402163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:20.402174Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:20.402178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.402181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.402185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:20.402193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.402206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:20.402244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533249726033251:5189]
2025-10-02T08:08:20.402254Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:20.402262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:20.402269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.402330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.402342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.402366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.402407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 291 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0
2025-10-02T08:08:20.402828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a385f8d1-1063f67d-832c78e7-479e14c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:20.405492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0] Write session: try to update token
2025-10-02T08:08:20.405515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:20.412575Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:20.412592Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:20.412598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533249726033251:5189]
2025-10-02T08:08:20.412630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:20.412633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:20.412838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:20.412967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:20.413093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:20.413224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:20.413418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:20.413449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:20.416019Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 2 CurrentSessionLifetimeMs: 61110 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:08:20.429041Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:20.429063Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:20.429066Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:20.429077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533249726033251:5189]
2025-10-02T08:08:20.429083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533249726033251:5189]
2025-10-02T08:08:20.429129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:20.429134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:20.429141Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:20.429141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.429143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:20.429323Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:20.432463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId: src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:20.435648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:20.481377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533249726033322:4391]
2025-10-02T08:08:20.481538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 290, pipe: [1:7556533249726033322:4391]
2025-10-02T08:08:20.570260Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:20.570599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.570610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.570627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033322:4391], now have 1 active actors on pipe
2025-10-02T08:08:20.570741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:20.570753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:20.570803Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:20.570821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 291 reason: error at write: Disconnected sessionId: src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0
2025-10-02T08:08:20.570841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:20.571002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 291 sessionId: src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0 is DEAD
2025-10-02T08:08:20.571063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533249726033322:4391]
2025-10-02T08:08:20.571159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:20.571168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0] Write session will restart in 0.008925s
2025-10-02T08:08:20.571199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0] Write session: Do CDS request
2025-10-02T08:08:20.571206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:20.579356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:20.581020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:20.581234Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:20.581245Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:20.581256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:20.581315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:20.581368Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533249726033485:5195]
2025-10-02T08:08:20.581430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.581462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:20.581478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 292
2025-10-02T08:08:20.581668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.581704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:20.581713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:20.581717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:20.581921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:20.582084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 292 sessionId:  describe result for acl check
2025-10-02T08:08:20.582106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:20.582115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:20.582124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:20.582126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:20.582131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533249726033494:5197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:20.582136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:20.582360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:20.582408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.582413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.582414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.582415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.582416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.582422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.582431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.582436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.582440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.582447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.582452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.582463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.582472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.582477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.582481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.582487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.582491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.582500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.582505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.582514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.582532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:20.582662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533249726033494:5197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:20.585192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533249726033494:5197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:20.590270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533249726033494:5197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:20.590286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533249726033494:5197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:20.590290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533249726033494:5197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:20.590298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:20.590837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:20.592922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:20.592938Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:20.592941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:20.592945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:20.592953Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 291 [1:7556533249726033485:5195]
2025-10-02T08:08:20.592966Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:20.592987Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:20.592990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.592994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.592996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.593022Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:20.593031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:20.593037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:20.593099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.593107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.593110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:20.593113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:20.593175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:20.593182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.593195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.593211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:20.593233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033533:5197], now have 1 active actors on pipe
2025-10-02T08:08:20.593242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533249726033479:5195]
2025-10-02T08:08:20.593244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533249726033479:5195]
2025-10-02T08:08:20.593257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:20.593265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533250186399804:2378], now have 1 active actors on pipe
2025-10-02T08:08:20.593273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:20.593285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:20.593288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:20.593323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533249726033479:5195]
2025-10-02T08:08:20.593331Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:20.593368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:20.593355Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 291
2025-10-02T08:08:20.593379Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:20.593383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 291
2025-10-02T08:08:20.593384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:20.593433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.593438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.593461Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|633b7778-6801de9-d3831a2b-f4390efd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:20.593476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.593480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.593481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:20.593489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.593499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:20.593519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.593564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.593569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.593580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.593617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 292 partition: 0 MaxSeqNo: 17 sessionId: src_id|633b7778-6801de9-d3831a2b-f4390efd_0
2025-10-02T08:08:20.594007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6ab6d24-1039f51d-f2a1a503-64a9cc05_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|633b7778-6801de9-d3831a2b-f4390efd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:20.596962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633b7778-6801de9-d3831a2b-f4390efd_0] Write session: try to update token
2025-10-02T08:08:20.596985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633b7778-6801de9-d3831a2b-f4390efd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:20.615524Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:20.615542Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:20.615544Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:20.615554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533249726033479:5195]
2025-10-02T08:08:20.615558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533249726033479:5195]
2025-10-02T08:08:20.615607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:20.615617Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:20.615623Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:20.615624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.615626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:20.615803Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:20.636001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId: src_id|633b7778-6801de9-d3831a2b-f4390efd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:20.638794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:20.671272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533249726033547:4391]
2025-10-02T08:08:20.671377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 291, pipe: [1:7556533249726033547:4391]
2025-10-02T08:08:20.756530Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:20.756853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.756863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.756885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033547:4391], now have 1 active actors on pipe
2025-10-02T08:08:20.757076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533249726033547:4391]
2025-10-02T08:08:20.757098Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:20.757101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:20.757103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:20.757170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 292 reason: error at write: Disconnected sessionId: src_id|633b7778-6801de9-d3831a2b-f4390efd_0
2025-10-02T08:08:20.757189Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:20.757360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 292 sessionId: src_id|633b7778-6801de9-d3831a2b-f4390efd_0 is DEAD
2025-10-02T08:08:20.757553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633b7778-6801de9-d3831a2b-f4390efd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:20.757569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633b7778-6801de9-d3831a2b-f4390efd_0] Write session will restart in 0.005469s
2025-10-02T08:08:20.757602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633b7778-6801de9-d3831a2b-f4390efd_0] Write session: Do CDS request
2025-10-02T08:08:20.757611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633b7778-6801de9-d3831a2b-f4390efd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:20.764361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633b7778-6801de9-d3831a2b-f4390efd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.764464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:20.764478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 293
2025-10-02T08:08:20.764696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.764732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:20.764740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:20.764745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:20.765185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 293 sessionId:  describe result for acl check
2025-10-02T08:08:20.765217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:20.765223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:20.765227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:20.765232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533249726033692:5202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:20.765842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533249726033692:5202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:20.767090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:20.768125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533249726033692:5202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:20.768650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:20.768925Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:20.768934Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:20.768944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:20.768992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:20.769038Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533249726033743:5201]
2025-10-02T08:08:20.769600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:20.769836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:20.769891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:20.770188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:20.770241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.770246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.770247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.770248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.770250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.770254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.770264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.770268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.770271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.770275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.770281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.770287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.770293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.770298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.770302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.770307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.770311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.770316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.770319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.770324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.770341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:20.770908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533249726033692:5202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:20.770917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533249726033692:5202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:20.770919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533249726033692:5202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:20.770925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:20.778206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:20.780072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:20.780092Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:20.780094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:20.780097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:20.780103Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 292 [1:7556533249726033743:5201]
2025-10-02T08:08:20.780114Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:20.780129Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:20.780136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.780139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.780141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.780154Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:20.780158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:20.780164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:20.780226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.780232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.780235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:20.780237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:20.780299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:20.780304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.780316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.780332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:20.780338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 292
2025-10-02T08:08:20.780351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033761:5202], now have 1 active actors on pipe
2025-10-02T08:08:20.780360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533249726033722:5201]
2025-10-02T08:08:20.780362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533249726033722:5201]
2025-10-02T08:08:20.780368Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:20.780381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:20.780384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:20.780391Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:20.780394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:20.780396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:20.780400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533250186399811:2378], now have 1 active actors on pipe
2025-10-02T08:08:20.780406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.780409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.780448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533249726033722:5201]
2025-10-02T08:08:20.780455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:20.780442Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 292
2025-10-02T08:08:20.780462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:20.780468Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|841bf96f-755e18ef-e982689e-39787ea1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:20.780473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.780477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.780480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:20.780494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.780510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:20.780553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.780620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.780626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.780639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.780673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 293 partition: 0 MaxSeqNo: 17 sessionId: src_id|841bf96f-755e18ef-e982689e-39787ea1_0
2025-10-02T08:08:20.781228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633b7778-6801de9-d3831a2b-f4390efd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|841bf96f-755e18ef-e982689e-39787ea1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:20.783889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|841bf96f-755e18ef-e982689e-39787ea1_0] Write session: try to update token
2025-10-02T08:08:20.783909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|841bf96f-755e18ef-e982689e-39787ea1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:20.799678Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:20.799694Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:20.799700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:20.799708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533249726033722:5201]
2025-10-02T08:08:20.799716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533249726033722:5201]
2025-10-02T08:08:20.799756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:20.799757Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:20.799762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.799764Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:20.799765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:20.799918Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:20.804453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId: src_id|841bf96f-755e18ef-e982689e-39787ea1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:20.807369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:20.857151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533249726033776:4391]
2025-10-02T08:08:20.857270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 292, pipe: [1:7556533249726033776:4391]
2025-10-02T08:08:20.941775Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:20.942000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.942012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.942028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033776:4391], now have 1 active actors on pipe
2025-10-02T08:08:20.942165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533249726033776:4391]
2025-10-02T08:08:20.942189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:20.942191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:20.942259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 293 reason: error at write: Disconnected sessionId: src_id|841bf96f-755e18ef-e982689e-39787ea1_0
2025-10-02T08:08:20.942266Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:20.942277Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:20.942430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 293 sessionId: src_id|841bf96f-755e18ef-e982689e-39787ea1_0 is DEAD
2025-10-02T08:08:20.942639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|841bf96f-755e18ef-e982689e-39787ea1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:20.942655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|841bf96f-755e18ef-e982689e-39787ea1_0] Write session will restart in 0.006775s
2025-10-02T08:08:20.942685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|841bf96f-755e18ef-e982689e-39787ea1_0] Write session: Do CDS request
2025-10-02T08:08:20.942692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|841bf96f-755e18ef-e982689e-39787ea1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:20.950576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|841bf96f-755e18ef-e982689e-39787ea1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.951745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:20.951768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 294
2025-10-02T08:08:20.952028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:20.952086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:20.952093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:20.952098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:20.952762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 294 sessionId:  describe result for acl check
2025-10-02T08:08:20.952818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:20.952825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:20.952827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:20.952833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533249726033941:5210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:20.953124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:20.953527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533249726033941:5210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:20.956557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:20.956792Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:20.956818Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:20.956830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:20.956888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:20.956927Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533249726033960:5208]
2025-10-02T08:08:20.957458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:20.957863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:20.957894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:20.958173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:20.958203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.958204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.958205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.958206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.958206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.958210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.958216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.958219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.958221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.958223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.958226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.958231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:20.958236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.958241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:20.958246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.958250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:20.958254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.958258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.958262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.958267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.958288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:20.959549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533249726033941:5210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:20.969290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533249726033941:5210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:20.969310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533249726033941:5210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:20.969313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533249726033941:5210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:20.969329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:20.972454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:20.974550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:20.974573Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:20.974576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:20.974581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:20.974590Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 293 [1:7556533249726033960:5208]
2025-10-02T08:08:20.974609Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:20.974632Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:20.974640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.974643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.974645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.974667Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:20.974679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:20.974693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:20.974785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.974793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.974797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:20.974800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:20.974885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:20.974893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:20.974909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:20.974925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:20.974951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533249726033942:5208]
2025-10-02T08:08:20.974958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533249726033942:5208]
2025-10-02T08:08:20.974975Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:20.974996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:20.975015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:20.975023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:20.975070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533249726033942:5208]
2025-10-02T08:08:20.975079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:20.975185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:20.975194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:20.975201Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:20.975727Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 293
2025-10-02T08:08:20.975811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 293
2025-10-02T08:08:20.975831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533249726033991:5210], now have 1 active actors on pipe
2025-10-02T08:08:20.975835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533250186399820:2378], now have 1 active actors on pipe
2025-10-02T08:08:20.975924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.975934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.975971Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4847de6-2e25e90-5b7054c1-e953a322_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:20.975991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:20.975996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:20.975998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:20.976012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:20.976025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:20.976043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.976157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:20.976162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:20.976175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:20.976207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 294 partition: 0 MaxSeqNo: 17 sessionId: src_id|e4847de6-2e25e90-5b7054c1-e953a322_0
2025-10-02T08:08:20.976546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|841bf96f-755e18ef-e982689e-39787ea1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e4847de6-2e25e90-5b7054c1-e953a322_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:20.979239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4847de6-2e25e90-5b7054c1-e953a322_0] Write session: try to update token
2025-10-02T08:08:20.979260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4847de6-2e25e90-5b7054c1-e953a322_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:21.004498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId: src_id|e4847de6-2e25e90-5b7054c1-e953a322_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:21.007564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:21.009510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.009535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.009562Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:21.009565Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:21.009569Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:21.009579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533249726033942:5208]
2025-10-02T08:08:21.009585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533249726033942:5208]
2025-10-02T08:08:21.009652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:21.009661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.009663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:21.009846Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:21.012979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:21.012994Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:21.042519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533254021001303:4391]
2025-10-02T08:08:21.044693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 293, pipe: [1:7556533254021001303:4391]
2025-10-02T08:08:21.198426Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:21.198855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:21.198912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021001303:4391], now have 1 active actors on pipe
2025-10-02T08:08:21.198963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:21.199059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:21.199066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:21.199084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 294 reason: error at write: Disconnected sessionId: src_id|e4847de6-2e25e90-5b7054c1-e953a322_0
2025-10-02T08:08:21.199234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 294 sessionId: src_id|e4847de6-2e25e90-5b7054c1-e953a322_0 is DEAD
2025-10-02T08:08:21.199322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:21.199381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4847de6-2e25e90-5b7054c1-e953a322_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:21.199392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4847de6-2e25e90-5b7054c1-e953a322_0] Write session will restart in 0.005943s
2025-10-02T08:08:21.199415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4847de6-2e25e90-5b7054c1-e953a322_0] Write session: Do CDS request
2025-10-02T08:08:21.199421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4847de6-2e25e90-5b7054c1-e953a322_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:21.199898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533254021001303:4391]
2025-10-02T08:08:21.207006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4847de6-2e25e90-5b7054c1-e953a322_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:21.208012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:21.208030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 295
2025-10-02T08:08:21.208362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:21.208404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:21.208416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:21.208420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:21.209682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 295 sessionId:  describe result for acl check
2025-10-02T08:08:21.209725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:21.209727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:21.209729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:21.209735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533254021001368:5222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:21.210432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533254021001368:5222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:21.213714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533254021001368:5222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:21.218813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:21.219373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533254021001368:5222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:21.219384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533254021001368:5222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:21.219387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533254021001368:5222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:21.219394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:21.221374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:21.221565Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:21.221575Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:21.221585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:21.221635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:21.221671Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533254021001551:5221]
2025-10-02T08:08:21.222284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:21.222506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:21.222570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:21.222944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:21.223011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.223017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.223018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.223019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.223021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.223026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.223036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.223040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.223044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.223048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.223053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.223061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.223071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.223077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.223081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.223086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.223095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.223101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.223109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.223114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.223133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:21.237740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:21.239627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:21.239646Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:21.239649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:21.239653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:21.239661Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 294 [1:7556533254021001551:5221]
2025-10-02T08:08:21.239674Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:21.239695Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:21.239700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.239703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.239706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.239722Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:21.239735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:21.239743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:21.239821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.239828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.239831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:21.239833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:21.240165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 294
2025-10-02T08:08:21.239903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:21.239913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.239927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.239939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:21.239956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533254021001538:5221]
2025-10-02T08:08:21.239959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533254021001538:5221]
2025-10-02T08:08:21.239966Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:21.239992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021001545:5222], now have 1 active actors on pipe
2025-10-02T08:08:21.239991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:21.239995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:21.239998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 294
2025-10-02T08:08:21.239999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:21.240014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:21.240017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:21.240023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533254481367135:2378], now have 1 active actors on pipe
2025-10-02T08:08:21.240058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.240062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.240076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533254021001538:5221]
2025-10-02T08:08:21.240085Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:21.240112Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:21.240118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.240123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.240124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:21.240133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.240142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:21.240156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:21.240166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:21.240318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.240326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.240364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:21.240408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 295 partition: 0 MaxSeqNo: 17 sessionId: src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0
2025-10-02T08:08:21.240767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4847de6-2e25e90-5b7054c1-e953a322_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:21.243973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0] Write session: try to update token
2025-10-02T08:08:21.244000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:21.260572Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:21.260591Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:21.260603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533254021001538:5221]
2025-10-02T08:08:21.260650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:21.260652Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:21.260992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:21.261157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:21.261472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:21.262072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:21.262884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:21.262938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:21.271037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId: src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:21.273986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:21.274098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.274112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.274146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:21.274169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:21.274255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.274270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.274450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.274518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.274578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.274640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.275022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.275032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.275094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.275192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.275290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.275377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.275420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.275428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.275492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.275585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.275644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.275706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.275754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.275761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.275829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.275889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.275954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.276038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.276084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.276091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.276158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.276223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.276284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.276345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.276389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.276395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.276459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.276520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.276575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.276633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.276698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.276705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.276771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.276850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.276912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.276981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.277056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.277062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.277126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.277191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.277258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.277329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.277378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.277384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.277448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.277523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.277585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.277650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.277713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.277719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.277785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.277846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.277907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.277976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.278026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.278032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.278071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:21.278127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.278147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.278154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:21.278182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:21.278198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:21.278205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:21.278208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:21.278210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:21.278594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:21.278618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:21.278627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:21.278630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:21.278632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:21.278635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:21.279297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:21.279318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:21.279327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:21.279329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:21.279332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:21.279334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:21.280029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:21.280049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:21.280054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:21.280057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:21.280060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:21.289001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:21.289047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:21.289066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392501288
2025-10-02T08:08:21.289478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:21.289514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:21.289533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:21.289546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:21.289557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:21.289570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:21.290469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:21.290499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:21.290506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:21.290510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:21.290517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:21.290522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:21.291184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:21.291219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:21.291237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:21.291248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:21.291253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:21.291263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:21.291863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:21.291889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:21.291895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:21.293300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:21.293321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:21.293327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:21.293334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:21.293343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392501292
2025-10-02T08:08:21.293693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:21.293707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:21.293714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:21.293717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:21.293720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:21.293727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:21.294328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:21.294340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:21.294346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:21.294350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:21.294353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:21.294357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:21.294951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:21.294963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.295080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392501292
2025-10-02T08:08:21.298728Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:21.298753Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:21.298760Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:21.298765Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:21.300104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533254021001575:4391]
2025-10-02T08:08:21.300291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 294, pipe: [1:7556533254021001575:4391]
2025-10-02T08:08:21.300315Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:21.300325Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:21.300327Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:21.300337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533254021001538:5221]
2025-10-02T08:08:21.300342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533254021001538:5221]
2025-10-02T08:08:21.300389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021001575:4391], now have 1 active actors on pipe
2025-10-02T08:08:21.300395Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:21.300404Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:21.300422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:21.300433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.300439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:21.300576Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:21.442510Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:21.442964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:21.442973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:21.443004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 295 reason: error at write: Disconnected sessionId: src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0
2025-10-02T08:08:21.443074Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:21.443092Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:21.443205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 295 sessionId: src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0 is DEAD
2025-10-02T08:08:21.443344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533254021001575:4391]
2025-10-02T08:08:21.443379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:21.443392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0] Write session will restart in 0.009142s
2025-10-02T08:08:21.443420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0] Write session: Do CDS request
2025-10-02T08:08:21.443427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:21.453354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:21.455812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:21.455832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 296
2025-10-02T08:08:21.456041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:21.456089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:21.456095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:21.456101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:21.456146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:21.456776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 296 sessionId:  describe result for acl check
2025-10-02T08:08:21.456821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:21.456823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:21.456825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:21.456830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533254021001772:5236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:21.457368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533254021001772:5236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:21.458204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:21.458379Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:21.458391Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:21.458400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:21.458453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:21.458482Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533254021001782:5234]
2025-10-02T08:08:21.459091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:21.459289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:21.459341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:21.459574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533254021001772:5236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:21.459672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:21.459725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.459731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.459732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.459733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.459734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.459739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.459748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.459752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.459756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.459760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.459766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.459773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.459779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.459789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.459794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.459803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.459807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.459817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.459821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.459830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.459849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:21.466171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533254021001772:5236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:21.466186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533254021001772:5236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:21.466190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533254021001772:5236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:21.466198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:21.468243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:21.469919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:21.469938Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:21.469940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:21.469944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:21.469950Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 295 [1:7556533254021001782:5234]
2025-10-02T08:08:21.469960Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:21.469976Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:21.469978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.469982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.469983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.469997Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:21.470003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:21.470008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:21.470065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.470074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.470077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:21.470079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:21.470147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:21.470153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.470165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.470175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:21.470193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021001819:5236], now have 1 active actors on pipe
2025-10-02T08:08:21.470195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 295
2025-10-02T08:08:21.470205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533254021001765:5234]
2025-10-02T08:08:21.470207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533254021001765:5234]
2025-10-02T08:08:21.470218Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:21.470229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533254481367167:2378], now have 1 active actors on pipe
2025-10-02T08:08:21.470236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.470239Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:21.470242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:21.470243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.470259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:21.470275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:21.470277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:21.470278Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 295
2025-10-02T08:08:21.470317Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:21.470327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.470331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.470332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:21.470340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.470347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:21.470354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533254021001765:5234]
2025-10-02T08:08:21.470360Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:21.470367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:21.470384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:21.470433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.470438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.470450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:21.470487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 296 partition: 0 MaxSeqNo: 17 sessionId: src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0
2025-10-02T08:08:21.470867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3039d32-85fc77d-85f9e168-2cc3cc0c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:21.474018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0] Write session: try to update token
2025-10-02T08:08:21.474043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:21.491966Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:21.491996Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:21.491998Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:21.492008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533254021001765:5234]
2025-10-02T08:08:21.492012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533254021001765:5234]
2025-10-02T08:08:21.492056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:21.492059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:21.492066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:21.492067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.492070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:21.492236Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:21.494760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId: src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:21.498208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:21.543206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533254021001834:4391]
2025-10-02T08:08:21.543286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 295, pipe: [1:7556533254021001834:4391]
2025-10-02T08:08:21.632876Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:21.633325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.633343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.633383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021001834:4391], now have 1 active actors on pipe
2025-10-02T08:08:21.633548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533254021001834:4391]
2025-10-02T08:08:21.633576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:21.633579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:21.633640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 296 reason: error at write: Disconnected sessionId: src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0
2025-10-02T08:08:21.633685Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:21.633862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 296 sessionId: src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0 is DEAD
2025-10-02T08:08:21.634556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:21.634572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0] Write session will restart in 0.006789s
2025-10-02T08:08:21.634600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0] Write session: Do CDS request
2025-10-02T08:08:21.634611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:21.635212Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:21.642047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:21.642619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:21.642698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:21.642711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 297
2025-10-02T08:08:21.642893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:21.642921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:21.642928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:21.642931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:21.643375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 297 sessionId:  describe result for acl check
2025-10-02T08:08:21.643409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:21.643414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:21.643415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:21.643420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533254021002007:5242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:21.643910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533254021002007:5242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:21.644485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:21.644701Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:21.644713Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:21.644723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:21.644774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:21.644831Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533254021002016:5240]
2025-10-02T08:08:21.645439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:21.645645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:21.645691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:21.645927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:21.645960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.645964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.645964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.645965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.645966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.645969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.645975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.645977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.645980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.645982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.645985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.645990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.645994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.645997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.646000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.646003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.646005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.646008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.646010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.646013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.646025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:21.646071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533254021002007:5242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:21.651643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533254021002007:5242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:21.651659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533254021002007:5242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:21.651663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533254021002007:5242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:21.651672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:21.653796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:21.655512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:21.655531Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:21.655533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:21.655537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:21.655543Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 296 [1:7556533254021002016:5240]
2025-10-02T08:08:21.655555Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:21.655571Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:21.655587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.655594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.655595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.655612Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:21.655617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:21.655623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:21.655692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.655699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.655702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:21.655705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:21.655766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:21.655773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.655788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.655808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:21.655816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 296
2025-10-02T08:08:21.655826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021002054:5242], now have 1 active actors on pipe
2025-10-02T08:08:21.655831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533254481367173:2378], now have 1 active actors on pipe
2025-10-02T08:08:21.655836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.655841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.655857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533254021002000:5240]
2025-10-02T08:08:21.655866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533254021002000:5240]
2025-10-02T08:08:21.655878Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:21.655890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:21.655899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:21.655902Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:21.655905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:21.655909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:21.655922Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:21.655933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.655936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.655939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:21.655946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.655955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:21.655933Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 296
2025-10-02T08:08:21.656003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533254021002000:5240]
2025-10-02T08:08:21.656017Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:21.656029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:21.656035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:21.656086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.656094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.656106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:21.656143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 297 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0
2025-10-02T08:08:21.656473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eb1c274-74fcedce-5416d558-c641e7f6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:21.659304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0] Write session: try to update token
2025-10-02T08:08:21.659319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:21.667076Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:21.667090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:21.667098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533254021002000:5240]
2025-10-02T08:08:21.667140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:21.667142Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:21.667338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:21.667497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:21.667649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:21.667806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:21.668025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:21.668067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:21.679016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId: src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:21.681678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:21.681736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.681749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.681785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:21.681812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:21.681849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.681863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.682040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.682113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.682178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.682245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.682394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.682404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.682470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.682540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.682604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.682668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.682713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.682720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.682784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.682856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.682926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.682999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.683047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.683053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.683291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.683540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.683614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.683680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.683730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.683737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.683805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.683866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.683931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.684013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.684066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.684073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.684143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.684203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.684310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.684377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.684425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.684431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.684523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.684586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.684651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.684717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.684769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.684775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.684932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.685009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.685076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.685145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.685194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.685202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.685268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.685335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.685400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.685466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.685531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.685538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.685604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:21.685666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:21.685735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:21.685802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:21.685857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:21.685864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:21.685928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:21.685992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.686018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.686023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:21.686057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:21.686073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:21.686081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:21.686084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:21.686088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:21.686486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:21.686512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:21.686523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:21.686527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:21.686530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:21.686533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:21.687005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:21.687026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:21.687031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:21.687034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:21.687038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:21.687043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:21.687551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:21.687572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:21.687577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:21.687580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:21.687583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:21.690252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:21.690269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:21.690281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392501688
2025-10-02T08:08:21.690531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:21.690548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:21.690553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:21.690558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:21.690562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:21.690567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:21.691154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:21.691177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:21.691182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:21.691185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:21.691189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:21.691192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:21.691726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:21.691739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:21.691747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:21.691750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:21.691754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:21.691757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:21.692273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:21.692284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:21.692289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:21.693582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:21.693601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:21.693606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:21.693610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:21.693619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392501693
2025-10-02T08:08:21.693923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:21.693942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:21.693946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:21.693950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:21.693954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:21.693958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:21.694438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:21.694460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:21.694465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:21.694470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:21.694473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:21.694477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:21.694998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:21.695019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.695132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392501694
2025-10-02T08:08:21.697793Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:21.697821Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:21.697828Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:21.697837Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:21.697848Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:21.697850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:21.697852Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:21.697861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533254021002000:5240]
2025-10-02T08:08:21.697864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533254021002000:5240]
2025-10-02T08:08:21.697911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:21.697917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:21.697940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:21.697945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.697946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:21.698099Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:21.733711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533254021002071:4391]
2025-10-02T08:08:21.733848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 296, pipe: [1:7556533254021002071:4391]
2025-10-02T08:08:21.869455Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:21.869920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021002071:4391], now have 1 active actors on pipe
2025-10-02T08:08:21.871490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:21.873064Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:21.873477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:21.873518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 297 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0
2025-10-02T08:08:21.873743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 297 sessionId: src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0 is DEAD
2025-10-02T08:08:21.873968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533254021002071:4391]
2025-10-02T08:08:21.875175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:21.875192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0] Write session will restart in 0.009330s
2025-10-02T08:08:21.875221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0] Write session: Do CDS request
2025-10-02T08:08:21.875228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:21.885405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:21.885604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:21.885619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 298
2025-10-02T08:08:21.885845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:21.885881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:21.885887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:21.885891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:21.886432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 298 sessionId:  describe result for acl check
2025-10-02T08:08:21.886465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:21.886467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:21.886469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:21.886474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533254021002093:5248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:21.887009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533254021002093:5248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:21.888448Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [1d09c12015348bbb] Result# TEvPutResult {Id# [72075186224037892:296:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:21.888520Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:296:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:21.888557Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:296:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:21.892879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533254021002093:5248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:21.897637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533254021002093:5248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:21.897656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533254021002093:5248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:21.897659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533254021002093:5248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:21.897667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:21.898046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:21.899916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:21.900163Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:21.900175Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:21.900186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:21.900246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:21.900298Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533254021002290:5247]
2025-10-02T08:08:21.900933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:21.901147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:21.901186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:21.901542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:21.901608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.901624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.901625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.901626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.901627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.901633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.901642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.901648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.901656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.901660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.901665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.901672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:21.901683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.901688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:21.901693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.901697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:21.901702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.901711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.901716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.901720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.901746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:21.911240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:21.913194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:21.913212Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:21.913215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:21.913219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:21.913226Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 297 [1:7556533254021002290:5247]
2025-10-02T08:08:21.913238Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:21.913257Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:21.913260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.913264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.913266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.913283Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:21.913293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:21.913300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:21.913373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.913379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.913382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:21.913385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:21.913460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:21.913467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.913480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:21.913496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:21.913519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021002281:5248], now have 1 active actors on pipe
2025-10-02T08:08:21.913529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533254021002284:5247]
2025-10-02T08:08:21.913531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533254021002284:5247]
2025-10-02T08:08:21.913546Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:21.913555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533254481367182:2378], now have 1 active actors on pipe
2025-10-02T08:08:21.913568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:21.913576Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:21.913581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:21.913583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:21.913587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:21.913615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533254021002284:5247]
2025-10-02T08:08:21.913625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:21.913632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:21.913665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 297
2025-10-02T08:08:21.913660Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 297
2025-10-02T08:08:21.913733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.913740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.913768Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42ec154c-6daf345-88394d2d-a7e88d69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:21.913778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:21.913782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:21.913786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:21.913795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:21.913809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:21.913828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:21.913892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:21.913907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:21.913919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:21.913952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 298 partition: 0 MaxSeqNo: 17 sessionId: src_id|42ec154c-6daf345-88394d2d-a7e88d69_0
2025-10-02T08:08:21.914436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a185376-7e55c52f-eb8a7c8d-7f630c6e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|42ec154c-6daf345-88394d2d-a7e88d69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:21.917371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42ec154c-6daf345-88394d2d-a7e88d69_0] Write session: try to update token
2025-10-02T08:08:21.917395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42ec154c-6daf345-88394d2d-a7e88d69_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:21.932887Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:21.932903Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:21.932906Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:21.932916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533254021002284:5247]
2025-10-02T08:08:21.932922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533254021002284:5247]
2025-10-02T08:08:21.932973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:21.932976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:21.932984Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:21.933112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:21.933117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:21.933290Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:21.938556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId: src_id|42ec154c-6daf345-88394d2d-a7e88d69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:21.941789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:21.969733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533254021002314:4391]
2025-10-02T08:08:21.970317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 297, pipe: [1:7556533254021002314:4391]
2025-10-02T08:08:22.082847Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:22.083200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.083213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.083249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533254021002314:4391], now have 1 active actors on pipe
2025-10-02T08:08:22.083500Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:22.083422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:22.083433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:22.083464Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:22.083498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 298 reason: error at write: Disconnected sessionId: src_id|42ec154c-6daf345-88394d2d-a7e88d69_0
2025-10-02T08:08:22.083681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 298 sessionId: src_id|42ec154c-6daf345-88394d2d-a7e88d69_0 is DEAD
2025-10-02T08:08:22.083698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533254021002314:4391]
2025-10-02T08:08:22.083883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ec154c-6daf345-88394d2d-a7e88d69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:22.083898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ec154c-6daf345-88394d2d-a7e88d69_0] Write session will restart in 0.007304s
2025-10-02T08:08:22.083944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ec154c-6daf345-88394d2d-a7e88d69_0] Write session: Do CDS request
2025-10-02T08:08:22.083951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ec154c-6daf345-88394d2d-a7e88d69_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:22.090639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:22.091789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:22.091962Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:22.091981Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:22.091990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:22.092430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42ec154c-6daf345-88394d2d-a7e88d69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.092033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:22.092141Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533258315969788:5253]
2025-10-02T08:08:22.092647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:22.092655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 299
2025-10-02T08:08:22.092710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:22.092857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.092897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:22.092901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:22.092905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:22.093014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:22.093124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:22.093220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 299 sessionId:  describe result for acl check
2025-10-02T08:08:22.093248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:22.093253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:22.093254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:22.093258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533258315969799:5255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:22.093569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:22.093664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.093665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.093667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.093668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.093670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.093678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.093689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.093693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533258315969799:5255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:22.093696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.093700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.093704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.093712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.093721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.093729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.093734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.093739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.093744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.093749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.093755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.093760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.093765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.093790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:22.095515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533258315969799:5255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:22.101632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533258315969799:5255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:22.101649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533258315969799:5255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:22.101652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533258315969799:5255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:22.101662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:22.102173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:22.104024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:22.104045Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:22.104048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:22.104051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:22.104059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 298 [1:7556533258315969788:5253]
2025-10-02T08:08:22.104071Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:22.104089Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:22.104093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.104095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.104097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.104116Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:22.104126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:22.104132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:22.104194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.104201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.104203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:22.104206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:22.104273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:22.104280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.104292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.104305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:22.104328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315969835:5255], now have 1 active actors on pipe
2025-10-02T08:08:22.104337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533258315969782:5253]
2025-10-02T08:08:22.104340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533258315969782:5253]
2025-10-02T08:08:22.104344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 298
2025-10-02T08:08:22.104348Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:22.104357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:22.104358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533258776334486:2378], now have 1 active actors on pipe
2025-10-02T08:08:22.104361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:22.104363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:22.104376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:22.104379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:22.104385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.104394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.104432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533258315969782:5253]
2025-10-02T08:08:22.104414Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 298
2025-10-02T08:08:22.104438Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:22.104453Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|776aedec-11429780-48896252-bf086053_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:22.104459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.104468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.104470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:22.104469Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:22.104479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.104489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:22.104534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.104649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.104660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.104685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.104727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 299 partition: 0 MaxSeqNo: 17 sessionId: src_id|776aedec-11429780-48896252-bf086053_0
2025-10-02T08:08:22.106713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42ec154c-6daf345-88394d2d-a7e88d69_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|776aedec-11429780-48896252-bf086053_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:22.109552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776aedec-11429780-48896252-bf086053_0] Write session: try to update token
2025-10-02T08:08:22.109579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776aedec-11429780-48896252-bf086053_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:22.115788Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:22.115802Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:22.115811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533258315969782:5253]
2025-10-02T08:08:22.115852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:22.115859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:22.116040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:22.116200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:22.116345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:22.116498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:22.116682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:22.116724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:22.134221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId: src_id|776aedec-11429780-48896252-bf086053_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:22.137035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:22.138248Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:22.138262Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:22.138264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:22.138272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533258315969782:5253]
2025-10-02T08:08:22.138275Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533258315969782:5253]
2025-10-02T08:08:22.138308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:22.138313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.138321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:22.138467Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:22.140871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:22.140887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:22.183372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533258315969849:4391]
2025-10-02T08:08:22.183631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 298, pipe: [1:7556533258315969849:4391]
2025-10-02T08:08:22.280747Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:22.281068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.281081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.281103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315969849:4391], now have 1 active actors on pipe
2025-10-02T08:08:22.281235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:22.281245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:22.281323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 299 reason: error at write: Disconnected sessionId: src_id|776aedec-11429780-48896252-bf086053_0
2025-10-02T08:08:22.281366Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:22.281528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 299 sessionId: src_id|776aedec-11429780-48896252-bf086053_0 is DEAD
2025-10-02T08:08:22.281650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:22.281693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533258315969849:4391]
2025-10-02T08:08:22.282311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776aedec-11429780-48896252-bf086053_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:22.282326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776aedec-11429780-48896252-bf086053_0] Write session will restart in 0.006308s
2025-10-02T08:08:22.282357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776aedec-11429780-48896252-bf086053_0] Write session: Do CDS request
2025-10-02T08:08:22.282366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776aedec-11429780-48896252-bf086053_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:22.289375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:22.290842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776aedec-11429780-48896252-bf086053_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.290726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:22.290865Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:22.290868Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:22.290875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:22.290915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:22.290920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 300
2025-10-02T08:08:22.290932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:22.290973Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533258315970073:5270]
2025-10-02T08:08:22.291073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.291094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:22.291099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:22.291102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:22.291453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 300 sessionId:  describe result for acl check
2025-10-02T08:08:22.291476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:22.291477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:22.291478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:22.291483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533258315970078:5272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:22.291548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:22.291739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:22.291792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:22.291940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533258315970078:5272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:22.292109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:22.292160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.292161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.292162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.292163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.292163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.292168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.292176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.292179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.292182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.292184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.292189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.292195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.292200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.292204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.292207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.292211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.292214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.292218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.292222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.292225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.292240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:22.294160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533258315970078:5272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:22.301886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:22.303954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:22.303987Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:22.303990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:22.303993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:22.303999Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 299 [1:7556533258315970073:5270]
2025-10-02T08:08:22.304010Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:22.304026Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:22.304029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.304032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.304034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.304051Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:22.304056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:22.304064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:22.304123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.304132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.304136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:22.304139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:22.304202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:22.304209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.304221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.304237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:22.304258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533258776334505:2378], now have 1 active actors on pipe
2025-10-02T08:08:22.304268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533258315970067:5270]
2025-10-02T08:08:22.304270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533258315970067:5270]
2025-10-02T08:08:22.304281Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:22.304293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:22.304298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:22.304304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:22.304311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:22.304314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:22.304347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533258315970067:5270]
2025-10-02T08:08:22.304359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:22.304366Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:22.304441Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 299
2025-10-02T08:08:22.304679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533258315970078:5272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:22.304691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533258315970078:5272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:22.304694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533258315970078:5272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:22.304703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:22.305201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 299
2025-10-02T08:08:22.305203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315970124:5272], now have 1 active actors on pipe
2025-10-02T08:08:22.305209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.305214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.305238Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:22.305263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.305266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.305268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:22.305277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.305287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:22.305304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.305344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.305355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.305380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.305419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 300 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0
2025-10-02T08:08:22.305789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776aedec-11429780-48896252-bf086053_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:22.309020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0] Write session: try to update token
2025-10-02T08:08:22.309038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:22.322059Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:22.322074Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:22.322076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:22.322084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533258315970067:5270]
2025-10-02T08:08:22.322088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533258315970067:5270]
2025-10-02T08:08:22.322126Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:22.322130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:22.322137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.322138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:22.322139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:22.322303Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:22.328097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId: src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:22.331213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:22.381895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533258315970149:4391]
2025-10-02T08:08:22.382023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 299, pipe: [1:7556533258315970149:4391]
2025-10-02T08:08:22.463324Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:22.463768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.463783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.463805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315970149:4391], now have 1 active actors on pipe
2025-10-02T08:08:22.463948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533258315970149:4391]
2025-10-02T08:08:22.463993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:22.463996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:22.464022Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:22.464060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 300 reason: error at write: Disconnected sessionId: src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0
2025-10-02T08:08:22.464254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 300 sessionId: src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0 is DEAD
2025-10-02T08:08:22.464858Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:22.467391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:22.467407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0] Write session will restart in 0.005895s
2025-10-02T08:08:22.467437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0] Write session: Do CDS request
2025-10-02T08:08:22.467444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:22.474439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.474516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:22.474531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 301
2025-10-02T08:08:22.474744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.474791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:22.474809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:22.474815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:22.476031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 301 sessionId:  describe result for acl check
2025-10-02T08:08:22.476071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:22.476072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:22.476074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:22.476079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533258315970328:5280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:22.476565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533258315970328:5280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:22.477208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:22.479307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:22.479497Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:22.479500Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:22.479511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:22.479556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:22.479641Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533258315970353:5279]
2025-10-02T08:08:22.480152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:22.480783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533258315970328:5280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:22.480880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:22.480918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:22.481215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:22.481261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.481263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.481264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.481264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.481266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.481271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.481280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.481283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.481286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.481289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.481295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.481314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.481319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.481324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.481327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.481332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.481336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.481340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.481345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.481349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.481367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:22.487440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533258315970328:5280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:22.487455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533258315970328:5280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:22.487458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533258315970328:5280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:22.487466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:22.490647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:22.492255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:22.492259Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:22.492261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:22.492264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:22.492269Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 300 [1:7556533258315970353:5279]
2025-10-02T08:08:22.492278Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:22.492292Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:22.492294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.492297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.492298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.492311Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:22.492315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:22.492320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:22.492366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.492368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.492370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:22.492372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:22.492437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:22.492439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.492451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.492462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:22.492478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533258315970331:5279]
2025-10-02T08:08:22.492480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533258315970331:5279]
2025-10-02T08:08:22.492488Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:22.492500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:22.492513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:22.492515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:22.492517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:22.492518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:22.492528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315970380:5280], now have 1 active actors on pipe
2025-10-02T08:08:22.492793Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 300
2025-10-02T08:08:22.492813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533258315970331:5279]
2025-10-02T08:08:22.492831Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:22.492836Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:22.492839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533258776334535:2378], now have 1 active actors on pipe
2025-10-02T08:08:22.492880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 300
2025-10-02T08:08:22.492977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.492983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.493016Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6892231a-a4764868-8ce031ed-60c9e787_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:22.493030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.493034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.493036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:22.493046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.493056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:22.493078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.493110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.493116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.493128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.493157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 301 partition: 0 MaxSeqNo: 17 sessionId: src_id|6892231a-a4764868-8ce031ed-60c9e787_0
2025-10-02T08:08:22.493661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a841571-94aee7fd-e6aaf391-3bd287b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6892231a-a4764868-8ce031ed-60c9e787_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:22.496686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6892231a-a4764868-8ce031ed-60c9e787_0] Write session: try to update token
2025-10-02T08:08:22.496702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6892231a-a4764868-8ce031ed-60c9e787_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:22.504263Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:22.504284Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:22.504299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533258315970331:5279]
2025-10-02T08:08:22.504351Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:22.504362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:22.504567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:22.504741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:22.504907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:22.505062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:22.505293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:22.505342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:22.517279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId: src_id|6892231a-a4764868-8ce031ed-60c9e787_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:22.519838Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:22.519856Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:22.519858Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:22.519867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533258315970331:5279]
2025-10-02T08:08:22.519870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533258315970331:5279]
2025-10-02T08:08:22.519912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:22.519914Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:22.519918Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:22.519918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.519921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:22.520071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:22.520092Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:22.564134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533258315970395:4391]
2025-10-02T08:08:22.564248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 300, pipe: [1:7556533258315970395:4391]
2025-10-02T08:08:22.653767Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:22.654153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.654168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.654189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315970395:4391], now have 1 active actors on pipe
2025-10-02T08:08:22.654323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:22.654330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:22.654384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 301 reason: error at write: Disconnected sessionId: src_id|6892231a-a4764868-8ce031ed-60c9e787_0
2025-10-02T08:08:22.654431Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:22.654422Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:22.654551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 301 sessionId: src_id|6892231a-a4764868-8ce031ed-60c9e787_0 is DEAD
2025-10-02T08:08:22.654641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6892231a-a4764868-8ce031ed-60c9e787_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:22.654649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6892231a-a4764868-8ce031ed-60c9e787_0] Write session will restart in 0.006093s
2025-10-02T08:08:22.654667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6892231a-a4764868-8ce031ed-60c9e787_0] Write session: Do CDS request
2025-10-02T08:08:22.654673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6892231a-a4764868-8ce031ed-60c9e787_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:22.654726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533258315970395:4391]
2025-10-02T08:08:22.663119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:22.664786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:22.664972Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:22.664981Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:22.664991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:22.665039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:22.665075Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533258315970576:5285]
2025-10-02T08:08:22.665563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:22.665711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:22.665748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:22.665944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:22.665980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.665986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.665988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.665988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.665989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.665993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.665999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.666001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.666003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.666005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.666009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.666013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.666017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.666020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.666022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.666025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.666027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.666029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.666032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.666034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.666044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:22.668497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:22.668509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 302
2025-10-02T08:08:22.668569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6892231a-a4764868-8ce031ed-60c9e787_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.668872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.668902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:22.668907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:22.668909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:22.669218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 302 sessionId:  describe result for acl check
2025-10-02T08:08:22.669247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:22.669251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:22.669252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:22.669256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533258315970593:5287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:22.669680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533258315970593:5287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:22.671705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533258315970593:5287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:22.673835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:22.674696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533258315970593:5287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:22.674710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533258315970593:5287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:22.674714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533258315970593:5287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:22.674723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:22.675408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:22.675423Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:22.675425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:22.675429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:22.675434Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 301 [1:7556533258315970576:5285]
2025-10-02T08:08:22.675444Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:22.675458Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:22.675465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.675467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.675469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.675483Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:22.675491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:22.675497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:22.675557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.675565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.675569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:22.675571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:22.675635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:22.675641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.675650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 301
2025-10-02T08:08:22.675651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.675661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:22.675679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315970624:5287], now have 1 active actors on pipe
2025-10-02T08:08:22.675686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533258776334541:2378], now have 1 active actors on pipe
2025-10-02T08:08:22.675690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.675694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.675708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533258315970570:5285]
2025-10-02T08:08:22.675714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533258315970570:5285]
2025-10-02T08:08:22.675720Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:22.675733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:22.675723Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 301
2025-10-02T08:08:22.675744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:22.675754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:22.675759Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:22.675762Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:22.675766Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:22.675773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.675788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.675789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:22.675799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.675807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:22.675842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533258315970570:5285]
2025-10-02T08:08:22.675854Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:22.675872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.675880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:22.675951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.675958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.675982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.676018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 302 partition: 0 MaxSeqNo: 17 sessionId: src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0
2025-10-02T08:08:22.676363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6892231a-a4764868-8ce031ed-60c9e787_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:22.679333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0] Write session: try to update token
2025-10-02T08:08:22.679349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:22.693017Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:22.693033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:22.693035Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:22.693044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533258315970570:5285]
2025-10-02T08:08:22.693052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533258315970570:5285]
2025-10-02T08:08:22.693098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:22.693096Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:22.693102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:22.693110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.693112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:22.693291Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:22.698860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId: src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:22.701760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:22.754591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533258315970640:4391]
2025-10-02T08:08:22.754677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 301, pipe: [1:7556533258315970640:4391]
2025-10-02T08:08:22.825048Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:22.825440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.825451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.825470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315970640:4391], now have 1 active actors on pipe
2025-10-02T08:08:22.825645Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:22.826101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:22.826116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0] Write session will restart in 0.007833s
2025-10-02T08:08:22.826142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0] Write session: Do CDS request
2025-10-02T08:08:22.826150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:22.826149Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:08:22.826155Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533172416588236:4387] disconnected; active server actors: 1
2025-10-02T08:08:22.826164Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533172416588236:4387] client user disconnected session shared/user_1_3_13583134836188586276_v1
2025-10-02T08:08:22.826223Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:08:22.826230Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:08:22.826236Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.008577s
2025-10-02T08:08:22.825603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533258315970640:4391]
2025-10-02T08:08:22.825628Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:22.825642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:22.825644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:22.825735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 302 reason: error at write: Disconnected sessionId: src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0
2025-10-02T08:08:22.825849Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:08:22.825925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 302 sessionId: src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0 is DEAD
2025-10-02T08:08:22.825992Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_13583134836188586276_v1 is DEAD
2025-10-02T08:08:22.833457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:22.834821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:22.834974Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:22.834987Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:22.834997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:22.835039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:22.835069Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533258315970834:5292]
2025-10-02T08:08:22.835454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.835497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:22.835578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:22.835581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 303
2025-10-02T08:08:22.835656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:22.835704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:22.835904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:22.835936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.835937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.835937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.835938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.835938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.835942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.835949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.835953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.835957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.835960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.835965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.835982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:22.835988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.835991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:22.835994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.835997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:22.835999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.836002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.836004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.836008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.836026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:22.836563Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:08:22.841186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:22.841225Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:08:22.841230Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 4
2025-10-02T08:08:22.841252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:22.841258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:22.841265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:22.842263Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_4_14178729189382460213_v1
2025-10-02T08:08:22.842275Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:08:22.841538Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:08:22.841605Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:08:22.841724Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 auth for : user
2025-10-02T08:08:22.841776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 303 sessionId:  describe result for acl check
2025-10-02T08:08:22.841809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:22.841812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:22.841814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:22.841820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533258315970853:5294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:22.841836Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 Handle describe topics response
2025-10-02T08:08:22.841856Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 auth is DEAD
2025-10-02T08:08:22.841870Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:08:22.842138Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:08:22.842355Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:08:22.842426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533258315970853:5294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:22.842474Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:08:22.842525Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 got read request: guid# 8e183454-e2f5e664-f898f869-a131a0ec
2025-10-02T08:08:22.842577Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533258315970855:5295] connected; active server actors: 1
2025-10-02T08:08:22.842809Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533258315970855:5295] session shared/user_1_4_14178729189382460213_v1
2025-10-02T08:08:22.842827Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:08:22.842837Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:08:22.842856Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_4_14178729189382460213_v1" (Sender=[1:7556533258315970850:5295], Pipe=[1:7556533258315970855:5295], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:08:22.842864Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:08:22.842876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:08:22.842884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_4_14178729189382460213_v1" (Sender=[1:7556533258315970850:5295], Pipe=[1:7556533258315970855:5295], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:08:22.842898Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_4_14178729189382460213_v1" sender [1:7556533258315970850:5295] lock partition 0 for ReadingSession "shared/user_1_4_14178729189382460213_v1" (Sender=[1:7556533258315970850:5295], Pipe=[1:7556533258315970855:5295], Partitions=[], ActiveFamilyCount=1) generation 1 step 4
2025-10-02T08:08:22.842920Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:08:22.842928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000048s
2025-10-02T08:08:22.843173Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_4_14178729189382460213_v1" ClientId: "user" PipeClient { RawX1: 7556533258315970855 RawX2: 4503603922343087 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:08:22.843223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:08:22.844197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:22.844658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533258315970853:5294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:22.846437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:22.846457Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:22.846461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:22.846466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:22.846473Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 302 [1:7556533258315970834:5292]
2025-10-02T08:08:22.846491Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:22.846510Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:22.846521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.846524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.846526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.846545Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:22.846551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:22.846559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:22.846635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.846638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.846641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:22.846644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:22.846727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:22.846730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.846746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:22.846759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:22.846780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533258315970828:5292]
2025-10-02T08:08:22.846782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533258315970828:5292]
2025-10-02T08:08:22.846791Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:22.846805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:22.846820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:22.846825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:22.846865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533258315970828:5292]
2025-10-02T08:08:22.846870Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:22.846934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:22.846938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:22.846938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 302, pipe: [1:7556533258315970863:5300]
2025-10-02T08:08:22.846945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:22.846945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315970863:5300], now have 1 active actors on pipe
2025-10-02T08:08:22.847027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.847033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.847046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_4_14178729189382460213_v1 on pipe: [1:7556533258315970863:5300]
2025-10-02T08:08:22.847065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533258776334550:2378], now have 1 active actors on pipe
2025-10-02T08:08:22.847076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.847081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.847083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:22.847103Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_4_14178729189382460213_v1
2025-10-02T08:08:22.847106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.847136Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:22.847278Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_4_14178729189382460213_v1:1 with generation 302
2025-10-02T08:08:22.847351Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 302
2025-10-02T08:08:22.849810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:08:22.849841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:08:22.849852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.849855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.849857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.849865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:08:22.849877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:08:22.849942Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392502846 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:08:22.849982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:08:22.850006Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 sending to client partition status
2025-10-02T08:08:22.851594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84493f13-9d649afa-e2828b7d-a2a40b82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:22.850635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533258315970853:5294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:22.850649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533258315970853:5294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:22.850653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533258315970853:5294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:22.850663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:22.851105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 302
2025-10-02T08:08:22.851117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533258315970902:5294], now have 1 active actors on pipe
2025-10-02T08:08:22.851125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.851131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.851159Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:22.851169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:22.851176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:22.851178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:22.851190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:22.851203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:22.851215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.851253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:22.851257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:22.851270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:22.851293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 303 partition: 0 MaxSeqNo: 17 sessionId: src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0
2025-10-02T08:08:22.854587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0] Write session: try to update token
2025-10-02T08:08:22.854606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:22.865119Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:22.865144Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:22.865148Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:22.865160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533258315970828:5292]
2025-10-02T08:08:22.865166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533258315970828:5292]
2025-10-02T08:08:22.865224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:22.865233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:22.865236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:22.865241Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:22.865251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:22.865437Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:22.871201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId: src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:22.874143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:23.017028Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:23.017574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.017598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.017800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533258315970863:5300]
2025-10-02T08:08:23.017824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:23.017826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:23.017837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_4_14178729189382460213_v1
2025-10-02T08:08:23.017809Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:23.017852Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:23.017887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 303 reason: error at write: Disconnected sessionId: src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0
2025-10-02T08:08:23.018022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 303 sessionId: src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0 is DEAD
2025-10-02T08:08:23.018136Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_4_14178729189382460213_v1
2025-10-02T08:08:23.018298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:23.018314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0] Write session will restart in 0.006736s
2025-10-02T08:08:23.018338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0] Write session: Do CDS request
2025-10-02T08:08:23.018345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:23.026372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.025956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:23.026418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:23.026424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 304
2025-10-02T08:08:23.026625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.026654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:23.026658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:23.026662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:23.027056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 304 sessionId:  describe result for acl check
2025-10-02T08:08:23.027084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:23.027085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:23.027087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:23.027092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:23.027092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533262610938389:5304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:23.027256Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:23.027259Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:23.027266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:23.027301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:23.027324Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533262610938391:5302]
2025-10-02T08:08:23.027503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533262610938389:5304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:23.027708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:23.027835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:23.027866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:23.028065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:23.028097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.028098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.028098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.028099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.028100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.028103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.028109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.028111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.028113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.028115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.028119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.028123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.028127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.028130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.028132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.028135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.028137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.028139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.028142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.028145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.028155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:23.029134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533262610938389:5304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:23.034571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533262610938389:5304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:23.034589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533262610938389:5304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:23.034591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533262610938389:5304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:23.034599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:23.035596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:23.037476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 303
2025-10-02T08:08:23.038024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5f1dba-49cf51a2-7174216f-e62e5025_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:23.037176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:23.037190Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:23.037193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:23.037196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:23.037204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 303 [1:7556533262610938391:5302]
2025-10-02T08:08:23.037215Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:23.037231Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:23.037233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.037236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.037238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.037254Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:23.037258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:23.037263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:23.037314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.037316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.037319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:23.037321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:23.037376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:23.037379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.037390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.037402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:23.037420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610938437:5304], now have 1 active actors on pipe
2025-10-02T08:08:23.037423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533263071301853:2378], now have 1 active actors on pipe
2025-10-02T08:08:23.037426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 303
2025-10-02T08:08:23.037429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533262610938382:5302]
2025-10-02T08:08:23.037431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533262610938382:5302]
2025-10-02T08:08:23.037437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:23.037451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:23.037450Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:23.037453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:23.037463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:23.037465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:23.037472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.037477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.037513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533262610938382:5302]
2025-10-02T08:08:23.037517Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:23.037528Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:23.037530Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:23.037535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.037540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.037542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:23.037549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.037557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:23.037599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.037647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.037649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.037661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.037691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 304 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0
2025-10-02T08:08:23.040563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0] Write session: try to update token
2025-10-02T08:08:23.040580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:23.053903Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:23.053922Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:23.053924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:23.053931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533262610938382:5302]
2025-10-02T08:08:23.053935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533262610938382:5302]
2025-10-02T08:08:23.053971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:23.053976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.053978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:23.053977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:23.053984Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:23.054106Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:23.058328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId: src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:23.061464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:23.118182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533262610938453:5300]
2025-10-02T08:08:23.118278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 303, pipe: [1:7556533262610938453:5300]
2025-10-02T08:08:23.188691Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:23.189572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.189584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.189600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610938453:5300], now have 1 active actors on pipe
2025-10-02T08:08:23.189706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:23.189714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:23.189780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 304 reason: error at write: Disconnected sessionId: src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0
2025-10-02T08:08:23.189820Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:23.189949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 304 sessionId: src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0 is DEAD
2025-10-02T08:08:23.190152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533262610938453:5300]
2025-10-02T08:08:23.190202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:23.190217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0] Write session will restart in 0.006824s
2025-10-02T08:08:23.190243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0] Write session: Do CDS request
2025-10-02T08:08:23.190254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:23.190780Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:23.196790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:23.198122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:23.198276Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:23.198281Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:23.198288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:23.198320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:23.198345Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533262610938642:5308]
2025-10-02T08:08:23.198427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.198524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:23.198533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 305
2025-10-02T08:08:23.198684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.198709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:23.198718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:23.198721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:23.198760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:23.198908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:23.198937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:23.199098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 305 sessionId:  describe result for acl check
2025-10-02T08:08:23.199123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:23.199127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:23.199130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:23.199133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:23.199134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533262610938653:5310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:23.199158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.199164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.199164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.199165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.199165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.199168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.199174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.199176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.199178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.199180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.199184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.199188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.199191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.199194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.199196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.199198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.199201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.199204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.199207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.199209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.199219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:23.199558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533262610938653:5310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:23.201254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533262610938653:5310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:23.206219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533262610938653:5310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:23.206232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533262610938653:5310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:23.206235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533262610938653:5310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:23.206245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:23.206807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:23.208417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:23.208433Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:23.208435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:23.208438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:23.208443Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 304 [1:7556533262610938642:5308]
2025-10-02T08:08:23.208453Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:23.208468Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:23.208470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.208473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.208475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.208488Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:23.208493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:23.208499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:23.208555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.208564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.208567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:23.208569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:23.208625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:23.208631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.208643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.208659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:23.208677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610938689:5310], now have 1 active actors on pipe
2025-10-02T08:08:23.208686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533263071301872:2378], now have 1 active actors on pipe
2025-10-02T08:08:23.208691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533262610938636:5308]
2025-10-02T08:08:23.208691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 304
2025-10-02T08:08:23.208693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533262610938636:5308]
2025-10-02T08:08:23.208700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:23.208711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:23.208711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.208713Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:23.208715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.208731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:23.208744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:23.208747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:23.208787Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:23.208796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.208818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.208824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:23.208831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.208768Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 304
2025-10-02T08:08:23.208840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:23.208852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533262610938636:5308]
2025-10-02T08:08:23.208863Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:23.208877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:23.208899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.208971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.208979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.208993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.209025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 305 partition: 0 MaxSeqNo: 17 sessionId: src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0
2025-10-02T08:08:23.209817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4bb6132-36b01d3e-943235f-c3e01e9a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:23.212358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0] Write session: try to update token
2025-10-02T08:08:23.212383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:23.225515Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:23.225531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:23.225534Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:23.225541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533262610938636:5308]
2025-10-02T08:08:23.225545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533262610938636:5308]
2025-10-02T08:08:23.225584Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:23.225586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:23.225593Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:23.225595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.225597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:23.225742Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:23.231466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId: src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:23.234065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:23.293030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533262610938729:5300]
2025-10-02T08:08:23.294627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 304, pipe: [1:7556533262610938729:5300]
2025-10-02T08:08:23.361593Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:23.361866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.361879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.361899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610938729:5300], now have 1 active actors on pipe
2025-10-02T08:08:23.361964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533262610938729:5300]
2025-10-02T08:08:23.361983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:23.361985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:23.362040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 305 reason: error at write: Disconnected sessionId: src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0
2025-10-02T08:08:23.362070Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:23.362065Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:23.362198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 305 sessionId: src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0 is DEAD
2025-10-02T08:08:23.362342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:23.362358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0] Write session will restart in 0.006698s
2025-10-02T08:08:23.362383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0] Write session: Do CDS request
2025-10-02T08:08:23.362387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:23.370357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.370518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:23.370518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:23.370522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 306
2025-10-02T08:08:23.370656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.370689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:23.370697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:23.370700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:23.371032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 306 sessionId:  describe result for acl check
2025-10-02T08:08:23.371068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:23.371076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:23.371078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:23.371086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533262610938941:5327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:23.371637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533262610938941:5327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:23.372029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:23.372195Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:23.372204Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:23.372212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:23.372253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:23.372299Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533262610938950:5325]
2025-10-02T08:08:23.372945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:23.373128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:23.373168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:23.373458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:23.373497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.373502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.373503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.373503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.373504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.373508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.373516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.373519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.373529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.373534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.373538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.373545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.373552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.373557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.373566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.373572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.373577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.373581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.373586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.373591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.373609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:23.373702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533262610938941:5327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:23.379362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533262610938941:5327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:23.379389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533262610938941:5327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:23.379392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533262610938941:5327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:23.379400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:23.381524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:23.383023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:23.383036Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:23.383037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:23.383040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:23.383045Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 305 [1:7556533262610938950:5325]
2025-10-02T08:08:23.383053Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:23.383065Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:23.383066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.383068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.383069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.383080Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:23.383084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:23.383090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:23.383132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.383138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.383139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:23.383141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:23.383195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:23.383203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.383215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.383226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:23.383240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533262610938934:5325]
2025-10-02T08:08:23.383243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533262610938934:5325]
2025-10-02T08:08:23.383248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:23.383256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:23.383264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:23.383265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:23.383287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:23.383291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533262610938934:5325]
2025-10-02T08:08:23.383293Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:23.383296Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:23.383300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610938992:5327], now have 1 active actors on pipe
2025-10-02T08:08:23.383301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:23.383304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533263071301893:2378], now have 1 active actors on pipe
2025-10-02T08:08:23.383344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 305
2025-10-02T08:08:23.383405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.383413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.383436Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|878cd7ce-f80e0947-f0423078-acde2790_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:23.383423Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 305
2025-10-02T08:08:23.383454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.383461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.383463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:23.383472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.383483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:23.383507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.383534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.383539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.383549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.383576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 306 partition: 0 MaxSeqNo: 17 sessionId: src_id|878cd7ce-f80e0947-f0423078-acde2790_0
2025-10-02T08:08:23.383889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd875d3-5be1e714-a97a8436-bbfbb275_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|878cd7ce-f80e0947-f0423078-acde2790_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:23.386864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|878cd7ce-f80e0947-f0423078-acde2790_0] Write session: try to update token
2025-10-02T08:08:23.386882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|878cd7ce-f80e0947-f0423078-acde2790_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:23.400630Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:23.400644Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:23.400646Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:23.400653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533262610938934:5325]
2025-10-02T08:08:23.400657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533262610938934:5325]
2025-10-02T08:08:23.400703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:23.400703Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:23.400709Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:23.400712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.400715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:23.400888Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:23.407398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId: src_id|878cd7ce-f80e0947-f0423078-acde2790_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:23.410219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:23.462231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533262610939015:5300]
2025-10-02T08:08:23.462355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 305, pipe: [1:7556533262610939015:5300]
2025-10-02T08:08:23.538790Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:23.539102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.539114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.539133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610939015:5300], now have 1 active actors on pipe
2025-10-02T08:08:23.539233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533262610939015:5300]
2025-10-02T08:08:23.539260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:23.539267Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:23.539279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:23.539319Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:23.539347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 306 reason: error at write: Disconnected sessionId: src_id|878cd7ce-f80e0947-f0423078-acde2790_0
2025-10-02T08:08:23.539537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 306 sessionId: src_id|878cd7ce-f80e0947-f0423078-acde2790_0 is DEAD
2025-10-02T08:08:23.539664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878cd7ce-f80e0947-f0423078-acde2790_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:23.539675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878cd7ce-f80e0947-f0423078-acde2790_0] Write session will restart in 0.006774s
2025-10-02T08:08:23.539702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878cd7ce-f80e0947-f0423078-acde2790_0] Write session: Do CDS request
2025-10-02T08:08:23.539708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878cd7ce-f80e0947-f0423078-acde2790_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:23.547064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:23.547311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|878cd7ce-f80e0947-f0423078-acde2790_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.548598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:23.548786Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:23.548798Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:23.548817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:23.548865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:23.548902Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533262610939209:5334]
2025-10-02T08:08:23.548985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:23.549005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 307
2025-10-02T08:08:23.549189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.549229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:23.549244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:23.549249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:23.549499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:23.549651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:23.549687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:23.549705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 307 sessionId:  describe result for acl check
2025-10-02T08:08:23.549754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:23.549756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:23.549758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:23.549768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533262610939220:5336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:23.549987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:23.550029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.550031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.550032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.550033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.550034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.550039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.550048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.550052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.550056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.550059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.550064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.550070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.550075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.550079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.550083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.550086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.550088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.550091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.550093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.550096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.550106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:23.550385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533262610939220:5336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:23.552740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533262610939220:5336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:23.557554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533262610939220:5336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:23.557584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533262610939220:5336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:23.557589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533262610939220:5336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:23.557598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:23.558024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:23.559603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:23.559619Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:23.559621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:23.559625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:23.559630Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 306 [1:7556533262610939209:5334]
2025-10-02T08:08:23.559642Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:23.559657Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:23.559659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.559662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.559663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.559686Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:23.559690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:23.559699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:23.559754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.559760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.559766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:23.559768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:23.559828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:23.559835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.559847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.559858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:23.559865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 306
2025-10-02T08:08:23.559873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610939256:5336], now have 1 active actors on pipe
2025-10-02T08:08:23.559882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533263071301909:2378], now have 1 active actors on pipe
2025-10-02T08:08:23.559886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.559889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.559904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533262610939203:5334]
2025-10-02T08:08:23.559906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533262610939203:5334]
2025-10-02T08:08:23.559914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:23.559926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:23.559933Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:23.559936Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:23.559938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:23.559940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:23.559952Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:23.559957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.559960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.559972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:23.559980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.559988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:23.560002Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 306
2025-10-02T08:08:23.560026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533262610939203:5334]
2025-10-02T08:08:23.560033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:23.560035Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:23.560045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.560082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.560089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.560102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.560142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 307 partition: 0 MaxSeqNo: 17 sessionId: src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0
2025-10-02T08:08:23.560526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|878cd7ce-f80e0947-f0423078-acde2790_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:23.563562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0] Write session: try to update token
2025-10-02T08:08:23.563585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:23.570492Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:23.570504Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:23.570511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533262610939203:5334]
2025-10-02T08:08:23.570545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:23.570559Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:23.570730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:23.570896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:23.571041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:23.571189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:23.571376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:23.571415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:23.581649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId: src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:23.584702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:23.584825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.584842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.584883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:23.588078Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:23.588100Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:23.588103Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:23.588116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533262610939203:5334]
2025-10-02T08:08:23.588120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533262610939203:5334]
2025-10-02T08:08:23.588189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:23.588198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.588205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:23.588395Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:23.591000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:23.591081Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:23.591102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:23.639393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533262610939270:5300]
2025-10-02T08:08:23.639552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 306, pipe: [1:7556533262610939270:5300]
2025-10-02T08:08:23.726438Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:23.726753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.726761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.726941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.727002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.727053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.727110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.727158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.727163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.727224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.727277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.727336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.727400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.727450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.727453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.727525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.727608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.727669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.727729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.727779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.727782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.727850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.727907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.727975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.728032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.728078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.728080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.728141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.728211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.728279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.728338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.728396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.728398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.728465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.728514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.728560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.728608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.728675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.728678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.728736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.728790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.728868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.728934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.728977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.728980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.729044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.729096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.730127Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:23.730497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:23.730511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0] Write session will restart in 0.005312s
2025-10-02T08:08:23.730538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0] Write session: Do CDS request
2025-10-02T08:08:23.730546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:23.729153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.729227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.729272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.729274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.729340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.729397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.729458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.729518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.729563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.729565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.729630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:23.729692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:23.729751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:23.729807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:23.729849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:23.729852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:23.729897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610939270:5300], now have 1 active actors on pipe
2025-10-02T08:08:23.730018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:23.730022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:23.730051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 307 reason: error at write: Disconnected sessionId: src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0
2025-10-02T08:08:23.730234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 307 sessionId: src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0 is DEAD
2025-10-02T08:08:23.730277Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:23.730474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533262610939270:5300]
2025-10-02T08:08:23.737344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.737416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:23.737430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 308
2025-10-02T08:08:23.737613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.737637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:23.737647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:23.737650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:23.737905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:23.737996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 308 sessionId:  describe result for acl check
2025-10-02T08:08:23.738030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:23.738035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:23.738037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:23.738041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533262610939465:5342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:23.738487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533262610939465:5342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:23.739234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:23.739421Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:23.739430Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:23.739439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:23.739485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:23.739520Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533262610939480:5340]
2025-10-02T08:08:23.740017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:23.740149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:23.740175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:23.740368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:23.740401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.740405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.740406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.740406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.740407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.740410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.740415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.740417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.740419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.740421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.740424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.740428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.740432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.740435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.740437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.740440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.740442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.740444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.740446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.740449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.740458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:23.740491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533262610939465:5342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:23.746589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533262610939465:5342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:23.746603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533262610939465:5342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:23.746607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533262610939465:5342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:23.746615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:23.752158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:23.753704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:23.753719Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:23.753722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:23.753726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:23.753733Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 307 [1:7556533262610939480:5340]
2025-10-02T08:08:23.753747Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:23.753767Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:23.753775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.753778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.753781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.753797Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:23.753807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:23.753813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:23.753888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.753895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.753898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:23.753900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:23.754043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 307
2025-10-02T08:08:23.754045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:23.754048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.754061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.754074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:23.754093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610939514:5342], now have 1 active actors on pipe
2025-10-02T08:08:23.754096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533263071301916:2378], now have 1 active actors on pipe
2025-10-02T08:08:23.754102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533262610939461:5340]
2025-10-02T08:08:23.754108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533262610939461:5340]
2025-10-02T08:08:23.754115Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:23.754126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:23.754128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:23.754136Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:23.754142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:23.754144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:23.754150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.754134Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 307
2025-10-02T08:08:23.754155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.754195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533262610939461:5340]
2025-10-02T08:08:23.754207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:23.754222Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:23.754224Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:23.754230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.754233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.754235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:23.754244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.754252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:23.754300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.754334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.754343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.754355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.754390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 308 partition: 0 MaxSeqNo: 17 sessionId: src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0
2025-10-02T08:08:23.754786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0e2158-a1ba51f6-307f5d1d-ef9d3377_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:23.757625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0] Write session: try to update token
2025-10-02T08:08:23.757645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:23.770787Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:23.770806Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:23.770817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533262610939461:5340]
2025-10-02T08:08:23.770866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:23.770872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:23.771084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:23.771237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:23.771440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:23.771589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:23.771803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:23.771852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:23.783724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId: src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:23.783853Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:23.783866Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:23.783868Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:23.783875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533262610939461:5340]
2025-10-02T08:08:23.783879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533262610939461:5340]
2025-10-02T08:08:23.783910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:23.783918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.783920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:23.784051Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:23.784066Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:23.784077Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:23.786530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:23.830875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533262610939530:5300]
2025-10-02T08:08:23.831006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 307, pipe: [1:7556533262610939530:5300]
2025-10-02T08:08:23.916441Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:23.916731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.916744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.916764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610939530:5300], now have 1 active actors on pipe
2025-10-02T08:08:23.916897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533262610939530:5300]
2025-10-02T08:08:23.916924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:23.916933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:23.917012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 308 reason: error at write: Disconnected sessionId: src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0
2025-10-02T08:08:23.917084Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:23.917013Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:23.917187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 308 sessionId: src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0 is DEAD
2025-10-02T08:08:23.917367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:23.917377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0] Write session will restart in 0.005257s
2025-10-02T08:08:23.917403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0] Write session: Do CDS request
2025-10-02T08:08:23.917410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:23.924398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.924455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:23.924468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 309
2025-10-02T08:08:23.924643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:23.924675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:23.924684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:23.924688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:23.925040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 309 sessionId:  describe result for acl check
2025-10-02T08:08:23.925078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:23.925084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:23.925086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:23.925091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533262610939714:5348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:23.925572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533262610939714:5348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:23.925654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:23.926925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:23.927111Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:23.927121Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:23.927133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:23.927194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:23.927234Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533262610939747:5347]
2025-10-02T08:08:23.927543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533262610939714:5348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:23.927797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:23.928019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:23.928070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:23.928354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:23.928418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.928425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.928426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.928426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.928427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.928432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.928440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.928444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.928448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.928451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.928456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.928463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:23.928467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.928471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:23.928477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.928481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:23.928484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.928488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.928491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.928495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.928510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:23.933347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533262610939714:5348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:23.933361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533262610939714:5348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:23.933365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533262610939714:5348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:23.933373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:23.936250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:23.938014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:23.938032Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:23.938036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:23.938039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:23.938046Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 308 [1:7556533262610939747:5347]
2025-10-02T08:08:23.938057Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:23.938073Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:23.938075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.938078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.938080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.938096Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:23.938100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:23.938109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:23.938169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.938180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.938183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:23.938185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:23.938249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:23.938256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.938269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:23.938284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:23.938304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 308
2025-10-02T08:08:23.938306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533262610939775:5348], now have 1 active actors on pipe
2025-10-02T08:08:23.938311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533263071301925:2378], now have 1 active actors on pipe
2025-10-02T08:08:23.938318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533262610939724:5347]
2025-10-02T08:08:23.938319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533262610939724:5347]
2025-10-02T08:08:23.938333Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:23.938343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.938347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.938348Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:23.938351Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:23.938365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:23.938378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:23.938381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:23.938380Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 308
2025-10-02T08:08:23.938421Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:23.938433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:23.938441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:23.938443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:23.938452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:23.938465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:23.938478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533262610939724:5347]
2025-10-02T08:08:23.938486Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:23.938499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:23.938520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.938588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:23.938596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:23.938632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:23.938672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 309 partition: 0 MaxSeqNo: 17 sessionId: src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0
2025-10-02T08:08:23.938999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbc43c89-df1c1702-34ab7044-c7b4b4a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:23.942086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0] Write session: try to update token
2025-10-02T08:08:23.942114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:23.955903Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:23.955922Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:23.955928Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:23.955937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533262610939724:5347]
2025-10-02T08:08:23.955944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533262610939724:5347]
2025-10-02T08:08:23.955998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:23.956001Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:23.956007Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:23.956009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:23.956011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:23.956157Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:23.965874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId: src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:23.969335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:24.017219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533266905907085:5300]
2025-10-02T08:08:24.017370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 308, pipe: [1:7556533266905907085:5300]
2025-10-02T08:08:24.093507Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:24.093810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.093826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.093847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905907085:5300], now have 1 active actors on pipe
2025-10-02T08:08:24.093908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:24.093911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:24.093960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 309 reason: error at write: Disconnected sessionId: src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0
2025-10-02T08:08:24.094039Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:24.094051Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:24.094110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 309 sessionId: src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0 is DEAD
2025-10-02T08:08:24.094333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:24.094343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0] Write session will restart in 0.005930s
2025-10-02T08:08:24.094365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0] Write session: Do CDS request
2025-10-02T08:08:24.094371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:24.094359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533266905907085:5300]
2025-10-02T08:08:24.101310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.101333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:24.101350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 310
2025-10-02T08:08:24.101518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.101559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:24.101570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:24.101574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:24.101945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 310 sessionId:  describe result for acl check
2025-10-02T08:08:24.101975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:24.101977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:24.101979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:24.101984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533266905907276:5354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:24.102432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533266905907276:5354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:24.102618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:24.104160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:24.104338Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:24.104356Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:24.104366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:24.104417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:24.104461Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533266905907304:5353]
2025-10-02T08:08:24.104567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533266905907276:5354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:24.105073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:24.105261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:24.105316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:24.105544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:24.105584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.105585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.105586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.105588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.105589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.105593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.105602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.105606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.105610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.105613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.105618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.105625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.105631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.105636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.105640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.105645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.105649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.105652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.105655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.105657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.105667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:24.110333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533266905907276:5354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:24.110365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533266905907276:5354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:24.110368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533266905907276:5354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:24.110377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:24.113289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:24.114924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:24.114942Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:24.114944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:24.114947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:24.114953Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 309 [1:7556533266905907304:5353]
2025-10-02T08:08:24.114961Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:24.114972Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:24.114974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.114976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.114977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.114988Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:24.114991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:24.114996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:24.115039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.115040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.115043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:24.115044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:24.115088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:24.115089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.115097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.115103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:24.115114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533266905907281:5353]
2025-10-02T08:08:24.115122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533266905907281:5353]
2025-10-02T08:08:24.115128Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:24.115137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:24.115140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:24.115142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:24.115145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:24.115146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:24.115152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533267366269228:2378], now have 1 active actors on pipe
2025-10-02T08:08:24.115155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905907332:5354], now have 1 active actors on pipe
2025-10-02T08:08:24.115169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 309
2025-10-02T08:08:24.115175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533266905907281:5353]
2025-10-02T08:08:24.115176Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:24.115179Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:24.115181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.115183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.115212Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:24.115215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.115218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.115219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:24.115225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.115207Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 309
2025-10-02T08:08:24.115233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:24.115246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.115339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.115358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.115382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.115427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 310 partition: 0 MaxSeqNo: 17 sessionId: src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0
2025-10-02T08:08:24.115733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d7c30e-8ecacbb0-d78f5076-2d3b65cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:24.118538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0] Write session: try to update token
2025-10-02T08:08:24.118554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:24.131893Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:24.131918Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:24.131920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:24.131929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533266905907281:5353]
2025-10-02T08:08:24.131933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533266905907281:5353]
2025-10-02T08:08:24.131982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:24.131985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:24.131988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:24.131990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.131993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:24.132149Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:24.133463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId: src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:24.136203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:24.194344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533266905907346:5300]
2025-10-02T08:08:24.194467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 309, pipe: [1:7556533266905907346:5300]
2025-10-02T08:08:24.266605Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:24.266877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.266890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.266922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905907346:5300], now have 1 active actors on pipe
2025-10-02T08:08:24.267032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533266905907346:5300]
2025-10-02T08:08:24.267064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:24.267066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:24.267099Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:24.267129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 310 reason: error at write: Disconnected sessionId: src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0
2025-10-02T08:08:24.267152Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:24.267288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 310 sessionId: src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0 is DEAD
2025-10-02T08:08:24.267417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:24.267426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0] Write session will restart in 0.007670s
2025-10-02T08:08:24.267444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0] Write session: Do CDS request
2025-10-02T08:08:24.267449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:24.276312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.276387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:24.276408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 311
2025-10-02T08:08:24.276522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.276555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:24.276562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:24.276567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:24.276683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:24.276975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 311 sessionId:  describe result for acl check
2025-10-02T08:08:24.277006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:24.277007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:24.277009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:24.277015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533266905907558:5362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:24.277528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533266905907558:5362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:24.278353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:24.278554Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:24.278565Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:24.278574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:24.278625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:24.278666Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533266905907571:5360]
2025-10-02T08:08:24.279285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:24.279465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:24.279515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:24.279679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533266905907558:5362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:24.279841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:24.279916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.279924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.279925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.279926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.279927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.279932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.279941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.279944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.279948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.279951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.279957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.279973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.279979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.279985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.279989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.279994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.279998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.280002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.280007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.280012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.280030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:24.286011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533266905907558:5362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:24.286031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533266905907558:5362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:24.286036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533266905907558:5362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:24.286044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:24.287994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:24.289672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:24.289693Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:24.289696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:24.289699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:24.289706Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 310 [1:7556533266905907571:5360]
2025-10-02T08:08:24.289718Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:24.289735Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:24.289738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.289741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.289743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.289759Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:24.289764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:24.289770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:24.289836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.289848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.289852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:24.289855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:24.289922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:24.289932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.289945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.289956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:24.289973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533266905907553:5360]
2025-10-02T08:08:24.289982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533266905907553:5360]
2025-10-02T08:08:24.289991Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:24.290004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:24.290012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 310
2025-10-02T08:08:24.290023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:24.290024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:24.290026Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:24.290028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:24.290038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905907607:5362], now have 1 active actors on pipe
2025-10-02T08:08:24.290065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533267366269247:2378], now have 1 active actors on pipe
2025-10-02T08:08:24.290075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533266905907553:5360]
2025-10-02T08:08:24.290080Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:24.290086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.290090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.290121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:24.290131Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:24.290137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.290142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.290144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:24.290157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.290134Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 310
2025-10-02T08:08:24.290166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:24.290199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.290238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.290248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.290261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.290297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 311 partition: 0 MaxSeqNo: 17 sessionId: src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0
2025-10-02T08:08:24.290663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c0aed9a-6fbdb5e5-b5f4c17d-3c993592_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:24.293668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0] Write session: try to update token
2025-10-02T08:08:24.293686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:24.307290Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:24.307309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:24.307312Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:24.307319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533266905907553:5360]
2025-10-02T08:08:24.307324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533266905907553:5360]
2025-10-02T08:08:24.307362Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:24.307365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:24.307370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.307372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:24.307374Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:24.307512Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:24.332872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId: src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:24.335540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:24.367423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533266905907653:5300]
2025-10-02T08:08:24.367517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 310, pipe: [1:7556533266905907653:5300]
2025-10-02T08:08:24.441545Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:24.441916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.441926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.441942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905907653:5300], now have 1 active actors on pipe
2025-10-02T08:08:24.442050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533266905907653:5300]
2025-10-02T08:08:24.442075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:24.442077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:24.442112Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:24.442147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 311 reason: error at write: Disconnected sessionId: src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0
2025-10-02T08:08:24.442198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:24.442318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 311 sessionId: src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0 is DEAD
2025-10-02T08:08:24.442449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:24.442458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0] Write session will restart in 0.005013s
2025-10-02T08:08:24.442482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0] Write session: Do CDS request
2025-10-02T08:08:24.442489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:24.448294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.448283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:24.448297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 312
2025-10-02T08:08:24.448473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.448501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:24.448509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:24.448512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:24.448926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 312 sessionId:  describe result for acl check
2025-10-02T08:08:24.448956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:24.448962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:24.448963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:24.448968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533266905907853:5382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:24.449407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533266905907853:5382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:24.450445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:24.451305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533266905907853:5382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:24.452080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:24.452330Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:24.452340Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:24.452350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:24.452404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:24.452439Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533266905907900:5381]
2025-10-02T08:08:24.453113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:24.453581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:24.453649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:24.453855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533266905907853:5382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:24.453866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533266905907853:5382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:24.453869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533266905907853:5382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:24.453878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:24.453969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:24.454027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.454035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.454036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.454038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.454039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.454043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.454052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.454055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.454058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.454062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.454067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.454074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.454079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.454084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.454087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.454091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.454095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.454099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.454103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.454107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.454126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:24.462416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:24.464191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:24.464205Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:24.464207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:24.464211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:24.464218Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 311 [1:7556533266905907900:5381]
2025-10-02T08:08:24.464229Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:24.464246Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:24.464250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.464252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.464254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.464269Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:24.464284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:24.464295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:24.464363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.464369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.464372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:24.464374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:24.464439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:24.464446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.464460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.464472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:24.464484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 311
2025-10-02T08:08:24.464488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905907911:5382], now have 1 active actors on pipe
2025-10-02T08:08:24.464492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533267366269279:2378], now have 1 active actors on pipe
2025-10-02T08:08:24.464495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.464498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.464512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533266905907879:5381]
2025-10-02T08:08:24.464513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533266905907879:5381]
2025-10-02T08:08:24.464522Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:24.464530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:24.464538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:24.464541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:24.464552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:24.464554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:24.464565Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6d11e91-480dc0e-129e93f1-11df536e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:24.464572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.464576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.464577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:24.464583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.464589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:24.464566Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 311
2025-10-02T08:08:24.464618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533266905907879:5381]
2025-10-02T08:08:24.464628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:24.464638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.464651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:24.464712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.464717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.464728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.464762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 312 partition: 0 MaxSeqNo: 17 sessionId: src_id|d6d11e91-480dc0e-129e93f1-11df536e_0
2025-10-02T08:08:24.465069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764dd2f1-507385f5-912d1a37-8e17dcbe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d6d11e91-480dc0e-129e93f1-11df536e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:24.467786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d11e91-480dc0e-129e93f1-11df536e_0] Write session: try to update token
2025-10-02T08:08:24.467800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d11e91-480dc0e-129e93f1-11df536e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:24.475494Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:24.475512Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:24.475519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533266905907879:5381]
2025-10-02T08:08:24.475558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:24.475562Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:24.475722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:24.475852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:24.475998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:24.476135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:24.476327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:24.476363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:24.481681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId: src_id|d6d11e91-480dc0e-129e93f1-11df536e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:24.484233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:24.484297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.484308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.484344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:24.484365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:24.484407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.484426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.484609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.484689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.484763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.484869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.485093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.485103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.485173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.485242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.485311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.485385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.485534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.485542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.485613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.485678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.485750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.485833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.485882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.485891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.485964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.486035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.486110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.486184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.486258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.486265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.486379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.486449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.486519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.486589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.486647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.486656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.486732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.486803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.486868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.486941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.486992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.486999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.487070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.487137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.487211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.487286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.487332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.487336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.487411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.487476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.487552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.487628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.487681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.487691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.487763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.487833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.487901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.487991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.488042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.488050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.488119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:24.488184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:24.488254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:24.488325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:24.488374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:24.488382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:24.488431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:24.488499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.488517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.488524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:24.488556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:24.488573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:24.488576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:24.488579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:24.488582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:24.489050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:24.489079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:24.489086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:24.489090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:24.489093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:24.489096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:24.489832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:24.489854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:24.489862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:24.489865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:24.489869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:24.489871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:24.490421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:24.490443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:24.490449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:24.490452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:24.490455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:24.491866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:24.491882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:24.491894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392504491
2025-10-02T08:08:24.492035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:24.492053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:24.492057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:24.492060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:24.492064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:24.492067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:24.492669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:24.492688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:24.492694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:24.492702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:24.492706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:24.492714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:24.493181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:24.493197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:24.493205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:24.493207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:24.493210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:24.493212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:24.493633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:24.493651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:24.493655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:24.494653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:24.494663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:24.494666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:24.494668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:24.494675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392504494
2025-10-02T08:08:24.494922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:24.494936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:24.494940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:24.494942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:24.494944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:24.494948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:24.495346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:24.495361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:24.495363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:24.495366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:24.495368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:24.495371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:24.495762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:24.495777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.495849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392504495
2025-10-02T08:08:24.496532Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:24.496553Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:24.496557Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:24.496562Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:24.498294Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:24.498309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:24.498310Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:24.498317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533266905907879:5381]
2025-10-02T08:08:24.498320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533266905907879:5381]
2025-10-02T08:08:24.498366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:24.498373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.498374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:24.498378Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:24.498390Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:24.498506Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:24.542040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533266905907939:5300]
2025-10-02T08:08:24.542196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 311, pipe: [1:7556533266905907939:5300]
2025-10-02T08:08:24.631478Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:24.631860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905907939:5300], now have 1 active actors on pipe
2025-10-02T08:08:24.631955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:24.631994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:24.632023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 312 reason: error at write: Disconnected sessionId: src_id|d6d11e91-480dc0e-129e93f1-11df536e_0
2025-10-02T08:08:24.632069Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:24.632142Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:24.632215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 312 sessionId: src_id|d6d11e91-480dc0e-129e93f1-11df536e_0 is DEAD
2025-10-02T08:08:24.632350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533266905907939:5300]
2025-10-02T08:08:24.632542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d11e91-480dc0e-129e93f1-11df536e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:24.632557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d11e91-480dc0e-129e93f1-11df536e_0] Write session will restart in 0.009928s
2025-10-02T08:08:24.632585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d11e91-480dc0e-129e93f1-11df536e_0] Write session: Do CDS request
2025-10-02T08:08:24.632592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d11e91-480dc0e-129e93f1-11df536e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:24.640963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:24.642577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:24.642740Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:24.642747Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:24.642754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:24.642789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:24.642824Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533266905908143:5387]
2025-10-02T08:08:24.643294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d11e91-480dc0e-129e93f1-11df536e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.643358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:24.643408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:24.643416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 313
2025-10-02T08:08:24.643520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:24.643558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:24.643768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:24.643799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.643803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.643804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.643805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.643805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.643809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.643818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.643821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.643824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.643827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.643832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.643839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.643844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.643848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.643857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.643862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.643870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.643878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.643882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.643888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.643898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:24.644363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.644406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:24.644415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:24.644419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:24.644772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 313 sessionId:  describe result for acl check
2025-10-02T08:08:24.644822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:24.644830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:24.644833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:24.644838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533266905908160:5389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:24.645269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533266905908160:5389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:24.647345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533266905908160:5389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:24.650881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533266905908160:5389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:24.650898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533266905908160:5389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:24.650901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533266905908160:5389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:24.650911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:24.651428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:24.653039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:24.653053Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:24.653054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:24.653057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:24.653062Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 312 [1:7556533266905908143:5387]
2025-10-02T08:08:24.653068Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:24.653080Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:24.653083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.653085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.653087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.653110Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:24.653114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:24.653121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:24.653170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.653178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.653181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:24.653183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:24.653233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:24.653239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.653246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.653256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:24.653269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 312
2025-10-02T08:08:24.653278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905908191:5389], now have 1 active actors on pipe
2025-10-02T08:08:24.653284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533266905908137:5387]
2025-10-02T08:08:24.653286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533266905908137:5387]
2025-10-02T08:08:24.653298Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:24.653306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533267366269286:2378], now have 1 active actors on pipe
2025-10-02T08:08:24.653308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:24.653309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.653311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:24.653313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.653328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:24.653346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:24.653353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:24.653349Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 312
2025-10-02T08:08:24.653388Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:24.653398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.653400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.653402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:24.653409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.653422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:24.653433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533266905908137:5387]
2025-10-02T08:08:24.653441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:24.653448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:24.653468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.653530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.653538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.653553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.653589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 313 partition: 0 MaxSeqNo: 17 sessionId: src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0
2025-10-02T08:08:24.653948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d11e91-480dc0e-129e93f1-11df536e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:24.657198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0] Write session: try to update token
2025-10-02T08:08:24.657215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:24.671346Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:24.671365Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:24.671367Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:24.671375Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533266905908137:5387]
2025-10-02T08:08:24.671379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533266905908137:5387]
2025-10-02T08:08:24.671419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:24.671420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:24.671425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.671426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:24.671428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:24.671578Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:24.673192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId: src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:24.676214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:24.732522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533266905908207:5300]
2025-10-02T08:08:24.732667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 312, pipe: [1:7556533266905908207:5300]
2025-10-02T08:08:24.802054Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:24.802417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.802427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.802456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905908207:5300], now have 1 active actors on pipe
2025-10-02T08:08:24.802562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:24.802578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:24.802637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 313 reason: error at write: Disconnected sessionId: src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0
2025-10-02T08:08:24.802663Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:24.802653Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:24.802804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 313 sessionId: src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0 is DEAD
2025-10-02T08:08:24.802934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:24.802946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0] Write session will restart in 0.007198s
2025-10-02T08:08:24.802946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533266905908207:5300]
2025-10-02T08:08:24.802970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0] Write session: Do CDS request
2025-10-02T08:08:24.802977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:24.811250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.811251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:24.811345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:24.811357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 314
2025-10-02T08:08:24.811467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:24.811502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:24.811511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:24.811517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:24.811849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 314 sessionId:  describe result for acl check
2025-10-02T08:08:24.811879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:24.811880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:24.811881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:24.811885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533266905908413:5396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:24.812273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533266905908413:5396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:24.812501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:24.812659Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:24.812667Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:24.812675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:24.812722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:24.812759Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533266905908421:5394]
2025-10-02T08:08:24.813376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:24.813506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:24.813543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:24.813821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:24.813864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.813869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.813870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.813872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.813873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.813877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.813886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.813894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.813898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.813905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.813909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.813916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:24.813924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.813933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:24.813938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.813947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:24.813953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.813957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.813965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.813974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.813996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:24.814136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533266905908413:5396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:24.819442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533266905908413:5396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:24.819458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533266905908413:5396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:24.819461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533266905908413:5396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:24.819469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:24.821482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:24.823053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:24.823066Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:24.823068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:24.823071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:24.823076Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 313 [1:7556533266905908421:5394]
2025-10-02T08:08:24.823083Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:24.823099Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:24.823103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.823106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.823108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.823122Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:24.823125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:24.823130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:24.823171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.823176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.823179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:24.823180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:24.823237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:24.823246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.823254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:24.823261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:24.823275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533267366269295:2378], now have 1 active actors on pipe
2025-10-02T08:08:24.823281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533266905908407:5394]
2025-10-02T08:08:24.823283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533266905908407:5394]
2025-10-02T08:08:24.823290Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:24.823298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 313
2025-10-02T08:08:24.823299Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:24.823300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905908463:5396], now have 1 active actors on pipe
2025-10-02T08:08:24.823302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:24.823305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:24.823319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:24.823322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:24.823328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.823332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.823344Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 313
2025-10-02T08:08:24.823364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533266905908407:5394]
2025-10-02T08:08:24.823373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:24.823375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:24.823386Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:24.823392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:24.823395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:24.823397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:24.823406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:24.823414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:24.823451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.823520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.823526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.823539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:24.823573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 314 partition: 0 MaxSeqNo: 17 sessionId: src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0
2025-10-02T08:08:24.823888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833b9f0a-a707b7a9-5a2cc9cc-c56e2022_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:24.826726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0] Write session: try to update token
2025-10-02T08:08:24.826744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:24.833306Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:24.833327Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:24.833339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533266905908407:5394]
2025-10-02T08:08:24.833379Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:24.833381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:24.833552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:24.833697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:24.833834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:24.833987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:24.834195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:24.834239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:24.845261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId: src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:24.848180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:24.849799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:24.849818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:24.849837Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:24.849840Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:24.849842Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:24.849850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533266905908407:5394]
2025-10-02T08:08:24.849854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533266905908407:5394]
2025-10-02T08:08:24.849896Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:24.849904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:24.849909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:24.849910Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:24.849914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:24.850048Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:24.903001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533266905908478:5300]
2025-10-02T08:08:24.903103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 313, pipe: [1:7556533266905908478:5300]
2025-10-02T08:08:24.988319Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:24.988763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:24.988815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533266905908478:5300], now have 1 active actors on pipe
2025-10-02T08:08:24.988835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:24.988917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:24.988928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:24.988946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 314 reason: error at write: Disconnected sessionId: src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0
2025-10-02T08:08:24.988970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533266905908478:5300]
2025-10-02T08:08:24.989072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 314 sessionId: src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0 is DEAD
2025-10-02T08:08:24.989446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:24.989462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0] Write session will restart in 0.009580s
2025-10-02T08:08:24.989491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0] Write session: Do CDS request
2025-10-02T08:08:24.989499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:24.989074Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:25.000420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.000561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:25.000580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 315
2025-10-02T08:08:25.000760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.000788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:25.000793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:25.000797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:25.001308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 315 sessionId:  describe result for acl check
2025-10-02T08:08:25.001344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:25.001350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:25.001352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:25.001358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533271200875979:5402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:25.001666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:25.001805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533271200875979:5402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:25.003601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533271200875979:5402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:25.003645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:25.003836Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:25.003846Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:25.003856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:25.003899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:25.003926Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533271200876005:5400]
2025-10-02T08:08:25.004444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:25.004619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:25.004659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:25.004939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:25.004979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.004984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.004985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.004986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.004988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.004993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.005001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.005005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.005008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.005012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.005016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.005022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.005028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.005032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.005048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.005053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.005057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.005061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.005065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.005070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.005086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:25.010090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533271200875979:5402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:25.010106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533271200875979:5402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:25.010109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533271200875979:5402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:25.010117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:25.013132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:25.014791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:25.014811Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:25.014814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:25.014818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:25.014824Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 314 [1:7556533271200876005:5400]
2025-10-02T08:08:25.014835Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:25.014851Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:25.014860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.014863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.014865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.014880Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:25.014890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:25.014896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:25.014962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.014969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.014972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:25.014975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:25.015039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:25.015047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.015060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.015073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:25.015097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200876030:5402], now have 1 active actors on pipe
2025-10-02T08:08:25.015107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533271200875981:5400]
2025-10-02T08:08:25.015109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533271200875981:5400]
2025-10-02T08:08:25.015116Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:25.015128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533267366269302:2378], now have 1 active actors on pipe
2025-10-02T08:08:25.015127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 314
2025-10-02T08:08:25.015139Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:25.015140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:25.015142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:25.015154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:25.015157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:25.015164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.015167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.015172Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 314
2025-10-02T08:08:25.015206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533271200875981:5400]
2025-10-02T08:08:25.015214Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:25.015223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:25.015228Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:25.015235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.015239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.015240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:25.015248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.015256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:25.015295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.015380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.015388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.015401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.015434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 315 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0
2025-10-02T08:08:25.015774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae3ea16-c2ab7522-31f8d8b2-6c6277de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:25.018749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0] Write session: try to update token
2025-10-02T08:08:25.018767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:25.026113Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:25.026133Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:25.026146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533271200875981:5400]
2025-10-02T08:08:25.026187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:25.026194Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:25.026382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:25.026534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:25.026763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:25.026920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:25.027125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:25.027172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:25.034011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId: src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:25.036965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:25.037037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.037050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.037091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:25.037119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:25.037180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.037188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.037366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.037440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.037513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.037591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.037647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.037658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.037725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.037785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.037857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.037926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.037979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.037986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.038055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.038125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.038185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.038244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.038295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.038300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.038371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.038432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.038489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.038546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.038603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.038611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.038684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.038747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.038819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.038895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.038956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.038966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.039045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.039114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.039183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.039247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.039293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.039300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.039366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.039429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.039498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.039565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.039619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.039627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.039698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.039763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.039832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.039907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.039971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.039978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.040048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.040111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.040186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.040256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.040302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.040310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.040387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.040456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.040532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.040608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.040661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.040668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.040710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:25.040774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.040799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.040855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:25.040887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:25.040907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:25.040914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:25.040917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:25.040921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:25.041353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:25.041378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:25.041386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:25.041389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:25.041392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:25.041395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:25.042061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:25.042083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:25.042089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:25.042092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:25.042097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:25.042101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:25.042718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:25.042740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:25.042745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:25.042749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:25.042752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:25.044115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:25.044134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:25.044145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392505043
2025-10-02T08:08:25.044271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:25.044287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:25.044294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:25.044299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:25.044303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:25.044306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:25.044918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:25.044942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:25.044948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:25.044951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:25.044954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:25.044958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:25.045542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:25.045565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:25.045574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:25.045577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:25.045580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:25.045583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:25.046101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:25.046128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:25.046134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:25.047425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:25.047450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:25.047457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:25.047460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:25.047468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392505047
2025-10-02T08:08:25.047790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:25.047812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:25.047818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:25.047821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:25.047825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:25.047830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:25.048385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:25.048408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:25.048413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:25.048417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:25.048420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:25.048424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:25.053034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:25.053069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.053188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392505052
2025-10-02T08:08:25.054092Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:25.054112Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:25.054120Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:25.054129Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:25.056048Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:25.056080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:25.056082Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:25.056090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533271200875981:5400]
2025-10-02T08:08:25.056095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533271200875981:5400]
2025-10-02T08:08:25.056139Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:25.056152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:25.056154Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:25.056158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.056160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:25.056301Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:25.089367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533271200876053:5300]
2025-10-02T08:08:25.089531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 314, pipe: [1:7556533271200876053:5300]
2025-10-02T08:08:25.200088Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:25.200492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200876053:5300], now have 1 active actors on pipe
2025-10-02T08:08:25.200649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533271200876053:5300]
2025-10-02T08:08:25.200682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:25.200684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:25.200712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 315 reason: error at write: Disconnected sessionId: src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0
2025-10-02T08:08:25.200715Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:25.200719Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:25.200976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 315 sessionId: src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0 is DEAD
2025-10-02T08:08:25.204926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:25.204943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0] Write session will restart in 0.007001s
2025-10-02T08:08:25.204969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0] Write session: Do CDS request
2025-10-02T08:08:25.204977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:25.215674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.215763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:25.215781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 316
2025-10-02T08:08:25.215971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.216020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:25.216028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:25.216031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:25.216442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 316 sessionId:  describe result for acl check
2025-10-02T08:08:25.216471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:25.216476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:25.216478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:25.216483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533271200876344:5408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:25.216998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533271200876344:5408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:25.219195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:25.219332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533271200876344:5408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:25.219603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:25.219760Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:25.219771Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:25.219780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:25.219830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:25.219865Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533271200876388:5406]
2025-10-02T08:08:25.220474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:25.220686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:25.220738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:25.221071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:25.221142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.221148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.221149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.221151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.221151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.221157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.221166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.221169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.221173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.221177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.221181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.221187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.221193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.221198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.221201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.221206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.221210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.221214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.221219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.221223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.221242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:25.227143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533271200876344:5408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:25.227158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533271200876344:5408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:25.227162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533271200876344:5408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:25.227170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:25.236018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:25.237775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:25.237790Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:25.237791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:25.237794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:25.237799Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 315 [1:7556533271200876388:5406]
2025-10-02T08:08:25.237808Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:25.237821Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:25.237824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.237838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.237843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.237855Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:25.237862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:25.237868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:25.237915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.237920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.237922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:25.237924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:25.237974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:25.237980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.237988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.237994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:25.238005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533271200876376:5406]
2025-10-02T08:08:25.238006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533271200876376:5406]
2025-10-02T08:08:25.238011Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:25.238020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:25.238028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:25.238029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:25.238043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:25.238047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:25.238059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200876409:5408], now have 1 active actors on pipe
2025-10-02T08:08:25.238066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533271200876376:5406]
2025-10-02T08:08:25.238068Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:25.238070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:25.238072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533271661236617:2378], now have 1 active actors on pipe
2025-10-02T08:08:25.238072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 315
2025-10-02T08:08:25.238083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.238087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.238111Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e84334b0-28653296-4b82a582-7baa6612_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:25.238122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.238125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.238127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:25.238134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.238141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:25.238156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.238142Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 315
2025-10-02T08:08:25.238203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.238209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.238221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.238256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 316 partition: 0 MaxSeqNo: 17 sessionId: src_id|e84334b0-28653296-4b82a582-7baa6612_0
2025-10-02T08:08:25.238641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1e7263-686e8f1f-149d8082-b646cfb1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e84334b0-28653296-4b82a582-7baa6612_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:25.241611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84334b0-28653296-4b82a582-7baa6612_0] Write session: try to update token
2025-10-02T08:08:25.241636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84334b0-28653296-4b82a582-7baa6612_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:25.255470Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:25.255486Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:25.255488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:25.255495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533271200876376:5406]
2025-10-02T08:08:25.255499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533271200876376:5406]
2025-10-02T08:08:25.255533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:25.255538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.255540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:25.255550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:25.255562Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:25.255702Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:25.261166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId: src_id|e84334b0-28653296-4b82a582-7baa6612_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:25.263837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:25.300821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533271200876422:5300]
2025-10-02T08:08:25.300959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 315, pipe: [1:7556533271200876422:5300]
2025-10-02T08:08:25.394959Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:25.395309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.395322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.395341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200876422:5300], now have 1 active actors on pipe
2025-10-02T08:08:25.395443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:25.395453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:25.395504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:25.395517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 316 reason: error at write: Disconnected sessionId: src_id|e84334b0-28653296-4b82a582-7baa6612_0
2025-10-02T08:08:25.395535Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:25.395675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 316 sessionId: src_id|e84334b0-28653296-4b82a582-7baa6612_0 is DEAD
2025-10-02T08:08:25.395787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533271200876422:5300]
2025-10-02T08:08:25.395852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84334b0-28653296-4b82a582-7baa6612_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:25.395866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84334b0-28653296-4b82a582-7baa6612_0] Write session will restart in 0.005974s
2025-10-02T08:08:25.395892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84334b0-28653296-4b82a582-7baa6612_0] Write session: Do CDS request
2025-10-02T08:08:25.395899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84334b0-28653296-4b82a582-7baa6612_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:25.403338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84334b0-28653296-4b82a582-7baa6612_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.403432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:25.403450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 317
2025-10-02T08:08:25.403590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.403622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:25.403626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:25.403629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:25.404025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 317 sessionId:  describe result for acl check
2025-10-02T08:08:25.404070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:25.404076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:25.404077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:25.404083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533271200876734:5425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:25.404534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533271200876734:5425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:25.405303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:25.406103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:25.406292Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:25.406302Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:25.406312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:25.406374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:25.406409Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533271200876767:5424]
2025-10-02T08:08:25.406991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:25.407169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:25.407213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:25.407395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533271200876734:5425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:25.407491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:25.407539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.407545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.407545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.407546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.407547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.407552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.407561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.407565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.407568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.407572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.407577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.407585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.407591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.407595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.407603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.407607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.407611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.407616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.407622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.407626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.407642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:25.413808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533271200876734:5425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:25.413826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533271200876734:5425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:25.413830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533271200876734:5425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:25.413838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:25.415847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:25.417631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:25.417650Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:25.417652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:25.417656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:25.417662Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 316 [1:7556533271200876767:5424]
2025-10-02T08:08:25.417673Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:25.417692Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:25.417700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.417703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.417705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.417720Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:25.417730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:25.417741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:25.417801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.417809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.417812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:25.417815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:25.417875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:25.417883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.417896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.417907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:25.417926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200876795:5425], now have 1 active actors on pipe
2025-10-02T08:08:25.417926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 316
2025-10-02T08:08:25.417936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533271200876751:5424]
2025-10-02T08:08:25.417938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533271200876751:5424]
2025-10-02T08:08:25.417948Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:25.417961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533271661236626:2378], now have 1 active actors on pipe
2025-10-02T08:08:25.417963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:25.417967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:25.417971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.417975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.417989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:25.418008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:25.418014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:25.418000Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 316
2025-10-02T08:08:25.418057Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5181024-42c17939-53c337ec-95f06e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:25.418069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.418072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.418075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:25.418083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.418091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:25.418103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533271200876751:5424]
2025-10-02T08:08:25.418112Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:25.418127Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:25.418159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.418220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.418222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.418235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.418268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 317 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5181024-42c17939-53c337ec-95f06e_0
2025-10-02T08:08:25.418697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84334b0-28653296-4b82a582-7baa6612_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5181024-42c17939-53c337ec-95f06e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:25.421301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5181024-42c17939-53c337ec-95f06e_0] Write session: try to update token
2025-10-02T08:08:25.421323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5181024-42c17939-53c337ec-95f06e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:25.436478Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:25.436500Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:25.436503Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:25.436512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533271200876751:5424]
2025-10-02T08:08:25.436516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533271200876751:5424]
2025-10-02T08:08:25.436551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:25.436556Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:25.436558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:25.436564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.436566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:25.436717Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:25.451793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId: src_id|b5181024-42c17939-53c337ec-95f06e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:25.454984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:25.501157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533271200876818:5300]
2025-10-02T08:08:25.502917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 316, pipe: [1:7556533271200876818:5300]
2025-10-02T08:08:25.587879Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:25.588518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.588532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.588552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200876818:5300], now have 1 active actors on pipe
2025-10-02T08:08:25.588687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533271200876818:5300]
2025-10-02T08:08:25.588715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:25.588718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:25.588787Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:25.588820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 317 reason: error at write: Disconnected sessionId: src_id|b5181024-42c17939-53c337ec-95f06e_0
2025-10-02T08:08:25.589076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 317 sessionId: src_id|b5181024-42c17939-53c337ec-95f06e_0 is DEAD
2025-10-02T08:08:25.589430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5181024-42c17939-53c337ec-95f06e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:25.589455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5181024-42c17939-53c337ec-95f06e_0] Write session will restart in 0.008679s
2025-10-02T08:08:25.589494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5181024-42c17939-53c337ec-95f06e_0] Write session: Do CDS request
2025-10-02T08:08:25.589503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5181024-42c17939-53c337ec-95f06e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:25.589515Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:25.599475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5181024-42c17939-53c337ec-95f06e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.599600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:25.599618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 318
2025-10-02T08:08:25.599757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.599824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:25.599834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:25.599837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:25.600315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 318 sessionId:  describe result for acl check
2025-10-02T08:08:25.600356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:25.600362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:25.600364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:25.600370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533271200877097:5433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:25.600888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533271200877097:5433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:25.601797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:25.602532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:25.602746Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:25.602756Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:25.602766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:25.602828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:25.602958Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533271200877132:5432]
2025-10-02T08:08:25.603671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:25.603671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533271200877097:5433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:25.603899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:25.603977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:25.604355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:25.604423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.604429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.604431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.604432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.604434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.604439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.604448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.604452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.604458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.604462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.604467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.604475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.604480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.604491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.604499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.604507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.604515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.604520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.604525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.604533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.604556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:25.610309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533271200877097:5433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:25.610328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533271200877097:5433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:25.610332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533271200877097:5433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:25.610341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:25.614184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:25.617268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:25.617291Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:25.617293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:25.617297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:25.617304Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 317 [1:7556533271200877132:5432]
2025-10-02T08:08:25.617317Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:25.617335Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:25.617339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.617342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.617345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.617362Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:25.617368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:25.617374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:25.617457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.617460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.617464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:25.617467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:25.617540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:25.617552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.617570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.617583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:25.617599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533271200877114:5432]
2025-10-02T08:08:25.617607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533271200877114:5432]
2025-10-02T08:08:25.617621Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:25.617634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:25.617653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:25.617661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:25.617686Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:25.617702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533271200877114:5432]
2025-10-02T08:08:25.617705Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:25.617712Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:25.617724Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:25.617799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 317
2025-10-02T08:08:25.617809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200877160:5433], now have 1 active actors on pipe
2025-10-02T08:08:25.617851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533271661236655:2378], now have 1 active actors on pipe
2025-10-02T08:08:25.617861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.617866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.617890Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:25.617902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.617906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.617907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:25.617916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.617931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:25.617951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.618065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.618073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.618088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.618122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 318 partition: 0 MaxSeqNo: 17 sessionId: src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0
2025-10-02T08:08:25.618384Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 317
2025-10-02T08:08:25.618611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5181024-42c17939-53c337ec-95f06e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:25.623882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0] Write session: try to update token
2025-10-02T08:08:25.623905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:25.638367Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:25.638387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:25.638389Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:25.638399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533271200877114:5432]
2025-10-02T08:08:25.638403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533271200877114:5432]
2025-10-02T08:08:25.638455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:25.638466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:25.638471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.638472Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:25.638478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:25.638675Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:25.654973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId: src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:25.657907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:25.688919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533271200877174:5300]
2025-10-02T08:08:25.689056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 317, pipe: [1:7556533271200877174:5300]
2025-10-02T08:08:25.775648Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:25.775980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.775993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.776014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200877174:5300], now have 1 active actors on pipe
2025-10-02T08:08:25.776139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533271200877174:5300]
2025-10-02T08:08:25.776168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:25.776170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:25.776212Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:25.776231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 318 reason: error at write: Disconnected sessionId: src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0
2025-10-02T08:08:25.776244Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:25.776386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 318 sessionId: src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0 is DEAD
2025-10-02T08:08:25.776588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:25.776602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0] Write session will restart in 0.006523s
2025-10-02T08:08:25.776633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0] Write session: Do CDS request
2025-10-02T08:08:25.776640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:25.784377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.784411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:25.784428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 319
2025-10-02T08:08:25.784640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.784679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:25.784688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:25.784692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:25.785090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 319 sessionId:  describe result for acl check
2025-10-02T08:08:25.785123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:25.785128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:25.785130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:25.785135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533271200877457:5440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:25.785605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533271200877457:5440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:25.787510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533271200877457:5440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:25.788887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:25.790024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:25.790234Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:25.790243Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:25.790260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:25.790310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:25.790348Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533271200877502:5438]
2025-10-02T08:08:25.790533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533271200877457:5440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:25.790544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533271200877457:5440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:25.790547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533271200877457:5440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:25.790564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:25.790948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:25.791158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:25.791220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:25.791597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:25.791674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.791680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.791681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.791682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.791683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.791688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.791698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.791701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.791704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.791707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.791712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.791718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:25.791723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.791727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:25.791730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.791735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:25.791738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.791752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.791761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.791765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.791781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:25.801148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:25.803069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:25.803091Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:25.803093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:25.803096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:25.803104Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 318 [1:7556533271200877502:5438]
2025-10-02T08:08:25.803114Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:25.803129Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:25.803137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.803140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.803142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.803158Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:25.803166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:25.803174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:25.803234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.803240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.803244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:25.803246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:25.803305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:25.803313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.803324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:25.803334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:25.803350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200877507:5440], now have 1 active actors on pipe
2025-10-02T08:08:25.803361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533271200877496:5438]
2025-10-02T08:08:25.803363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533271200877496:5438]
2025-10-02T08:08:25.803365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 318
2025-10-02T08:08:25.803370Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:25.803377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533271661236661:2378], now have 1 active actors on pipe
2025-10-02T08:08:25.803378Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:25.803381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:25.803383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:25.803395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:25.803397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:25.803403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.803423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.803463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533271200877496:5438]
2025-10-02T08:08:25.803475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:25.803494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:25.803495Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:25.803502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.803506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.803508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:25.803516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.803524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:25.803556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.803668Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 318
2025-10-02T08:08:25.803633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.803640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.803655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:25.803694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 319 partition: 0 MaxSeqNo: 17 sessionId: src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0
2025-10-02T08:08:25.804093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e32a8-da654fd3-b23b7a3-e8d9cf3b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:25.806883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0] Write session: try to update token
2025-10-02T08:08:25.806907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:25.815038Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:25.815057Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:25.815066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533271200877496:5438]
2025-10-02T08:08:25.815108Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:25.815111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:25.815297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:25.815452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:25.815595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:25.815743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:25.816110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:25.816157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:25.825098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId: src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:25.827769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:25.827845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.827858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.827896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:25.827922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:25.827977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:25.827992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:25.828146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.828238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.828341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.828401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.828444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.828451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.828510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.828575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.828643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.828703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.828746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.828754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.828838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.828904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.828969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.829026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.829089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.829096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.829167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.829238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.829298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.829365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.829404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.829414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.829486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.829547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.829607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.829666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.829717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.829724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.829788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.829845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.829903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.829976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.830024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.830030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.830092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.830153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.830216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.830276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.830404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.830414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.830481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.830542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.830602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.830662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.830707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.830716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.830779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.830852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.830917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.830991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.831694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.831704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.831765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:25.831825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:25.831897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:25.831980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:25.832025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:25.832030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:25.832079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:25.832138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:25.832160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:25.832168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:25.832195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:25.832211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:25.832213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:25.832215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:25.832216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:25.832616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:25.832638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:25.832646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:25.832648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:25.832650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:25.832652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:25.833219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:25.833238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:25.833243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:25.833245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:25.833248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:25.833250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:25.833709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:25.833727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:25.833732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:25.833739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:25.833741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:25.834942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:25.834959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:25.834970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392505834
2025-10-02T08:08:25.835094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:25.835111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:25.835120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:25.835123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:25.835132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:25.835135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:25.835635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:25.835658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:25.835663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:25.835668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:25.835670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:25.835672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:25.836153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:25.836172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:25.836180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:25.836187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:25.836190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:25.836192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:25.836603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:25.836620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:25.836623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:25.837666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:25.837683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:25.837690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:25.837692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:25.837699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392505837
2025-10-02T08:08:25.837978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:25.837995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:25.838000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:25.838002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:25.838004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:25.838006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:25.838455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:25.838473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:25.838477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:25.838479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:25.838483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:25.838490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:25.838950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:25.838965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:25.839040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392505838
2025-10-02T08:08:25.841293Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:25.841320Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:25.841326Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:25.841334Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:25.841346Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:25.841352Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:25.841354Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:25.841361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533271200877496:5438]
2025-10-02T08:08:25.841365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533271200877496:5438]
2025-10-02T08:08:25.841408Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:25.841420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:25.841430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:25.841433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:25.841434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:25.841569Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:25.876315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533271200877534:5300]
2025-10-02T08:08:25.876421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 318, pipe: [1:7556533271200877534:5300]
2025-10-02T08:08:25.986435Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:25.986875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533271200877534:5300], now have 1 active actors on pipe
2025-10-02T08:08:25.987013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:25.987027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:25.987059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 319 reason: error at write: Disconnected sessionId: src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0
2025-10-02T08:08:25.987080Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:25.987172Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:25.987227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 319 sessionId: src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0 is DEAD
2025-10-02T08:08:25.987407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:25.987422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0] Write session will restart in 0.008271s
2025-10-02T08:08:25.987423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533271200877534:5300]
2025-10-02T08:08:25.987448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0] Write session: Do CDS request
2025-10-02T08:08:25.987456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:25.992304Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [979249fe506ddb56] Result# TEvPutResult {Id# [72075186224037892:318:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:25.992307Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:318:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:25.992364Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:318:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:25.992413Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [5b0c926307892fcc] Result# TEvPutResult {Id# [72075186224037892:318:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:25.997394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.997962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:25.997978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 320
2025-10-02T08:08:25.998156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:25.998199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:25.998210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:25.998215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:25.998642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 320 sessionId:  describe result for acl check
2025-10-02T08:08:25.998677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:25.998685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:25.998687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:25.998692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533271200877821:5446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:25.999202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533271200877821:5446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:26.000516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:26.001236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:26.001490Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:26.001504Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:26.001516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:26.001577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:26.001618Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533275495845151:5445]
2025-10-02T08:08:26.001710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533271200877821:5446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:26.002205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:26.002383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:26.002419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:26.002705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:26.002755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.002761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.002762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.002763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.002764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.002769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.002778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.002782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.002785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.002789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.002793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.002800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.002805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.002809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.002813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.002822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.002826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.002831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.002835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.002843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.002862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:26.008488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533271200877821:5446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:26.008506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533271200877821:5446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:26.008510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533271200877821:5446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:26.008527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:26.012188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:26.013882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:26.013904Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:26.013907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:26.013910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:26.013918Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 319 [1:7556533275495845151:5445]
2025-10-02T08:08:26.013932Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:26.013948Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:26.013951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.013954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.013956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.013971Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:26.013978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:26.013983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:26.014045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.014054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.014057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:26.014059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:26.014122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:26.014130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.014143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.014160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:26.014183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495845179:5446], now have 1 active actors on pipe
2025-10-02T08:08:26.014194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533275495845138:5445]
2025-10-02T08:08:26.014194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 319
2025-10-02T08:08:26.014196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533275495845138:5445]
2025-10-02T08:08:26.014208Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:26.014221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533271661236669:2378], now have 1 active actors on pipe
2025-10-02T08:08:26.014228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:26.014228Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:26.014232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:26.014245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:26.014248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:26.014255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.014262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.014266Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 319
2025-10-02T08:08:26.014305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533275495845138:5445]
2025-10-02T08:08:26.014312Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:26.014323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:26.014327Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:26.014334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.014339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.014341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:26.014349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.014362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:26.014409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.014480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.014488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.014502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.014553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 320 partition: 0 MaxSeqNo: 17 sessionId: src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0
2025-10-02T08:08:26.014953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89cd9525-223f66be-a2064fc8-1a9410ad_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:26.017567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0] Write session: try to update token
2025-10-02T08:08:26.017589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:26.033490Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:26.033511Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:26.033514Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:26.033522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533275495845138:5445]
2025-10-02T08:08:26.033525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533275495845138:5445]
2025-10-02T08:08:26.033573Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:26.033579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:26.033580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:26.033585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.033588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:26.033744Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:26.035961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId: src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:26.038992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:26.087776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533275495845193:5300]
2025-10-02T08:08:26.087905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 319, pipe: [1:7556533275495845193:5300]
2025-10-02T08:08:26.180296Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:26.180633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.180648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.180684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495845193:5300], now have 1 active actors on pipe
2025-10-02T08:08:26.180880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:26.180892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:26.180904Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:26.180887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:26.180955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 320 reason: error at write: Disconnected sessionId: src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0
2025-10-02T08:08:26.181142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 320 sessionId: src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0 is DEAD
2025-10-02T08:08:26.181167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533275495845193:5300]
2025-10-02T08:08:26.181341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:26.181355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0] Write session will restart in 0.009995s
2025-10-02T08:08:26.181385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0] Write session: Do CDS request
2025-10-02T08:08:26.181393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:26.190484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:26.191263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:26.191519Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:26.191530Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:26.191538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:26.191582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:26.191626Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533275495845491:5451]
2025-10-02T08:08:26.192252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:26.192436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:26.192476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:26.192481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.192755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:26.192799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.192822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.192823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.192824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.192824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.192829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.192838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.192841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.192844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.192848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.192854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.192860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.192865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.192871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.192883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.192888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.192892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.192897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.192901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.192905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.192924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:26.193419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:26.193428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 321
2025-10-02T08:08:26.193625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.193652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:26.193662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:26.193665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:26.194095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 321 sessionId:  describe result for acl check
2025-10-02T08:08:26.194130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:26.194135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:26.194137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:26.194144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533275495845508:5453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:26.194626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533275495845508:5453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:26.196891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533275495845508:5453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:26.201718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:26.201877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533275495845508:5453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:26.201889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533275495845508:5453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:26.201892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533275495845508:5453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:26.201911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:26.203479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:26.203499Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:26.203501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:26.203505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:26.203513Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 320 [1:7556533275495845491:5451]
2025-10-02T08:08:26.203525Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:26.203541Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:26.203544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.203550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.203552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.203569Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:26.203574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:26.203580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:26.203641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.203654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.203658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:26.203660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:26.203756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:26.203762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 320
2025-10-02T08:08:26.203769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.203785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.203797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:26.203816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495845539:5453], now have 1 active actors on pipe
2025-10-02T08:08:26.203824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533275956203985:2378], now have 1 active actors on pipe
2025-10-02T08:08:26.203830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.203834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.203850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533275495845485:5451]
2025-10-02T08:08:26.203860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533275495845485:5451]
2025-10-02T08:08:26.203866Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:26.203879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:26.203878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:26.203881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:26.203892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:26.203895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:26.203909Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:26.203845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 320
2025-10-02T08:08:26.203916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.203925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.203927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:26.203936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.203944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:26.204000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533275495845485:5451]
2025-10-02T08:08:26.204012Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:26.204020Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:26.204025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.204084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.204091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.204105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.204144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 321 partition: 0 MaxSeqNo: 17 sessionId: src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0
2025-10-02T08:08:26.204579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9035d0-1cebad83-c99ae90e-18815ee7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:26.207210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0] Write session: try to update token
2025-10-02T08:08:26.207232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:26.226589Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:26.226613Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:26.226616Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:26.226625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533275495845485:5451]
2025-10-02T08:08:26.226629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533275495845485:5451]
2025-10-02T08:08:26.226672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:26.226683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.226686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:26.226685Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:26.226691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:26.226826Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:26.227276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId: src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:26.230353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:26.281271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533275495845567:5300]
2025-10-02T08:08:26.281411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 320, pipe: [1:7556533275495845567:5300]
2025-10-02T08:08:26.375551Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:26.375838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.375856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.375896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495845567:5300], now have 1 active actors on pipe
2025-10-02T08:08:26.376015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533275495845567:5300]
2025-10-02T08:08:26.376148Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:26.376154Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:26.376423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:26.376487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 321 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0
2025-10-02T08:08:26.376652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 321 sessionId: src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0 is DEAD
2025-10-02T08:08:26.376860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:26.376876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0] Write session will restart in 0.007128s
2025-10-02T08:08:26.376906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0] Write session: Do CDS request
2025-10-02T08:08:26.376914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:26.385358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.386505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:26.386522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 322
2025-10-02T08:08:26.386698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.386737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:26.386742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:26.386746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:26.387153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 322 sessionId:  describe result for acl check
2025-10-02T08:08:26.387193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:26.387196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:26.387197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:26.387202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533275495845875:5463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:26.387329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:26.387899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:26.388108Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:26.388120Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:26.388133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:26.388196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:26.388233Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533275495845884:5458]
2025-10-02T08:08:26.388678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533275495845875:5463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:26.388789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:26.388986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:26.389035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:26.389327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:26.389397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.389403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.389404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.389405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.389406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.389411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.389419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.389422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.389425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.389428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.389433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.389439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.389449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.389453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.389459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.389468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.389472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.389476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.389480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.389483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.389499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:26.390890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533275495845875:5463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:26.396890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533275495845875:5463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:26.396907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533275495845875:5463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:26.396910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533275495845875:5463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:26.396919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:26.397899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:26.399863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 321
2025-10-02T08:08:26.399543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:26.399560Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:26.399562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:26.399565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:26.399571Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 321 [1:7556533275495845884:5458]
2025-10-02T08:08:26.399581Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:26.399593Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:26.399596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.399599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.399600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.399615Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:26.399619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:26.399624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:26.399675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.399677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.399681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:26.399683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:26.399740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:26.399743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.399754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.399765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:26.399782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533275956203994:2378], now have 1 active actors on pipe
2025-10-02T08:08:26.399788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533275495845876:5458]
2025-10-02T08:08:26.399790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533275495845876:5458]
2025-10-02T08:08:26.399799Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:26.399810Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:26.399812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:26.399815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:26.399822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:26.399824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:26.399852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533275495845876:5458]
2025-10-02T08:08:26.399858Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:26.399863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:26.400065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 321
2025-10-02T08:08:26.400070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495845936:5463], now have 1 active actors on pipe
2025-10-02T08:08:26.400075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.400079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.400098Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:26.400103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.400106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.400107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:26.400115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.400123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:26.400135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.400168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.400170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.400179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.400205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 322 partition: 0 MaxSeqNo: 17 sessionId: src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0
2025-10-02T08:08:26.400666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff09f58-bf8e2652-8da3dae2-13d7b24b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:26.403384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0] Write session: try to update token
2025-10-02T08:08:26.403406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:26.418409Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:26.418427Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:26.418429Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:26.418437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533275495845876:5458]
2025-10-02T08:08:26.418442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533275495845876:5458]
2025-10-02T08:08:26.418486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:26.418492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.418496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:26.418655Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:26.419016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:26.419029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:26.425118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId: src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:26.428052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:26.476344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533275495845969:5300]
2025-10-02T08:08:26.476446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 321, pipe: [1:7556533275495845969:5300]
2025-10-02T08:08:26.561479Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:26.561800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.561812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.561828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495845969:5300], now have 1 active actors on pipe
2025-10-02T08:08:26.561931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533275495845969:5300]
2025-10-02T08:08:26.561958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:26.561965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:26.562030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:26.562023Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:26.562036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 322 reason: error at write: Disconnected sessionId: src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0
2025-10-02T08:08:26.562234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 322 sessionId: src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0 is DEAD
2025-10-02T08:08:26.562391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:26.562404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0] Write session will restart in 0.007680s
2025-10-02T08:08:26.562428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0] Write session: Do CDS request
2025-10-02T08:08:26.562433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:26.571188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:26.571336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.571451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:26.571460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 323
2025-10-02T08:08:26.571627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.571650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:26.571657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:26.571659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:26.571952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:26.571955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 323 sessionId:  describe result for acl check
2025-10-02T08:08:26.571987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:26.571995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:26.571997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:26.572002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533275495846283:5479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:26.572153Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:26.572156Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:26.572163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:26.572200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:26.572230Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533275495846285:5477]
2025-10-02T08:08:26.572366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533275495846283:5479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:26.572664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:26.572857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:26.572904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:26.573213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:26.573255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.573260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.573261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.573263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.573264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.573269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.573279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.573283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.573286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.573290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.573294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.573301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.573310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.573315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.573324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.573329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.573336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.573341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.573345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.573350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.573368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:26.574364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533275495846283:5479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:26.580146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533275495846283:5479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:26.580163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533275495846283:5479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:26.580166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533275495846283:5479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:26.580175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:26.581136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:26.582700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:26.582715Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:26.582717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:26.582722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:26.582729Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 322 [1:7556533275495846285:5477]
2025-10-02T08:08:26.582739Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:26.582754Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:26.582757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.582760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.582762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.582777Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:26.582782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:26.582789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:26.582848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.582856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.582858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:26.582861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:26.582918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:26.582929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.582940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.582950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:26.582967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495846326:5479], now have 1 active actors on pipe
2025-10-02T08:08:26.582970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 322
2025-10-02T08:08:26.582974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533275956204024:2378], now have 1 active actors on pipe
2025-10-02T08:08:26.582980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533275495846276:5477]
2025-10-02T08:08:26.582982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533275495846276:5477]
2025-10-02T08:08:26.582996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:26.583008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.583015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.583017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:26.583022Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:26.583030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:26.583044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:26.583046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:26.583082Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:26.583092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.583095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.583097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:26.583105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.583114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:26.583121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533275495846276:5477]
2025-10-02T08:08:26.583127Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:26.583137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:26.583152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.583134Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 322
2025-10-02T08:08:26.583196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.583202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.583218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.583253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 323 partition: 0 MaxSeqNo: 17 sessionId: src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0
2025-10-02T08:08:26.583657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0504a5-99bebb2a-78b1b32e-2fef4ab1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:26.586179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0] Write session: try to update token
2025-10-02T08:08:26.586201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:26.593707Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:26.593722Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:26.593736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533275495846276:5477]
2025-10-02T08:08:26.593775Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:26.593778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:26.593948Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:26.594095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:26.594234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:26.594374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:26.594581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:26.594624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:26.603964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId: src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:26.607166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:26.608472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.608482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.608518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:26.608544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:26.608609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.608629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.608832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.608933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.609007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.609091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.609421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.609435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.609501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.609561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.609631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.609709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.609757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.609762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.609831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.609902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.609988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.610053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.610105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.610108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.610181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.610247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.610313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.610381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.610429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.610432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.610501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.610566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.610634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.610704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.610752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.610755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.610831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.610894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.610953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.611012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.611051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.611054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.611127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.611191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.611259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.611322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.611369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.611372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.611443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.611509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.611577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.611647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.611783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.611786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.611862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.611928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.612010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.612081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.612128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.612130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.612195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:26.612253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:26.612311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:26.612382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:26.612429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:26.612435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:26.612503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:26.612563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.612581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.612584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:26.612614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:26.612628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:26.612631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:26.612634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:26.612637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:26.613356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:26.613393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:26.613400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:26.613404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:26.613408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:26.613410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:26.613924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:26.613951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:26.613959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:26.613962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:26.613967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:26.613970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:26.614471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:26.614495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:26.614501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:26.614505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:26.614508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:26.615799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:26.615808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:26.615821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392506615
2025-10-02T08:08:26.616018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:26.616025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:26.616031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:26.616034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:26.616037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:26.616041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:26.616527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:26.616539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:26.616545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:26.616549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:26.616552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:26.616557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:26.617220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:26.617243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:26.617251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:26.617255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:26.617258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:26.617261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:26.617759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:26.617789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:26.617794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:26.618995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:26.619010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:26.619014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:26.619020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:26.619028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392506618
2025-10-02T08:08:26.619350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:26.619369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:26.619375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:26.619378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:26.619382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:26.619385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:26.619893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:26.619916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:26.619923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:26.619925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:26.619928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:26.619934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:26.620412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:26.620433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.620526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392506620
2025-10-02T08:08:26.623181Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:26.623210Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:26.623220Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:26.623228Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:26.623238Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:26.623240Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:26.623243Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:26.623251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533275495846276:5477]
2025-10-02T08:08:26.623255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533275495846276:5477]
2025-10-02T08:08:26.623303Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:26.623316Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:26.623331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:26.623340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.623342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:26.623482Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:26.662178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533275495846341:5300]
2025-10-02T08:08:26.662495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 322, pipe: [1:7556533275495846341:5300]
2025-10-02T08:08:26.770075Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:26.770445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495846341:5300], now have 1 active actors on pipe
2025-10-02T08:08:26.770544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:26.770550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:26.770577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 323 reason: error at write: Disconnected sessionId: src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0
2025-10-02T08:08:26.770654Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:26.770666Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:26.770784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 323 sessionId: src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0 is DEAD
2025-10-02T08:08:26.770928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:26.770942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0] Write session will restart in 0.009319s
2025-10-02T08:08:26.770969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0] Write session: Do CDS request
2025-10-02T08:08:26.770977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:26.770992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533275495846341:5300]
2025-10-02T08:08:26.776771Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [9578dc703698b88e] Result# TEvPutResult {Id# [72075186224037892:322:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:26.776938Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:322:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:26.777009Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:322:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:26.781436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.782119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:26.782133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 324
2025-10-02T08:08:26.782258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.782282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:26.782289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:26.782293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:26.782708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 324 sessionId:  describe result for acl check
2025-10-02T08:08:26.782739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:26.782747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:26.782749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:26.782754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533275495846583:5484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:26.783273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533275495846583:5484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:26.785622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533275495846583:5484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:26.786074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:26.786771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:26.786993Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:26.787001Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:26.787010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:26.787066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:26.787098Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533275495846684:5483]
2025-10-02T08:08:26.787648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:26.787819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:26.787853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:26.788124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:26.788162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.788167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.788168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.788169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.788170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.788174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.788182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.788185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.788188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.788191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.788195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.788207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.788212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.788216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.788220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.788228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.788231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.788236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.788244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.788249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.788263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:26.788380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533275495846583:5484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:26.788393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533275495846583:5484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:26.788398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533275495846583:5484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:26.788405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:26.798999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:26.800547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:26.800563Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:26.800566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:26.800570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:26.800578Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 323 [1:7556533275495846684:5483]
2025-10-02T08:08:26.800589Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:26.800606Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:26.800609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.800612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.800614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.800628Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:26.800635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:26.800647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:26.800709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.800716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.800720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:26.800723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:26.800788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:26.800795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.800820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.800939Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 323
2025-10-02T08:08:26.800837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:26.800847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 323
2025-10-02T08:08:26.800852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495846701:5484], now have 1 active actors on pipe
2025-10-02T08:08:26.800859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533275495846672:5483]
2025-10-02T08:08:26.800861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533275495846672:5483]
2025-10-02T08:08:26.800867Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:26.800875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533275956204030:2378], now have 1 active actors on pipe
2025-10-02T08:08:26.800877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:26.800880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.800880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:26.800884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.800903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:26.800916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:26.800918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:26.800959Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:26.800965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.800970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.800971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:26.800979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.800986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:26.800993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533275495846672:5483]
2025-10-02T08:08:26.800996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:26.801005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:26.801026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.801059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.801065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.801077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.801121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 324 partition: 0 MaxSeqNo: 17 sessionId: src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0
2025-10-02T08:08:26.801521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226ab92d-a2df1b27-c545ef2b-e9af781_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:26.804023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0] Write session: try to update token
2025-10-02T08:08:26.804041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:26.820588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId: src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:26.823386Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:26.823405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:26.823407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:26.823416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533275495846672:5483]
2025-10-02T08:08:26.823421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533275495846672:5483]
2025-10-02T08:08:26.823465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:26.823476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.823481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:26.823481Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:26.823488Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:26.823626Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:26.823691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:26.870599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533275495846715:5300]
2025-10-02T08:08:26.870706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 323, pipe: [1:7556533275495846715:5300]
2025-10-02T08:08:26.960564Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:26.960887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.960902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.960941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495846715:5300], now have 1 active actors on pipe
2025-10-02T08:08:26.961058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533275495846715:5300]
2025-10-02T08:08:26.961079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:26.961081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:26.961126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 324 reason: error at write: Disconnected sessionId: src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0
2025-10-02T08:08:26.961159Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:26.961228Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:26.961287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 324 sessionId: src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0 is DEAD
2025-10-02T08:08:26.961499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:26.961515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0] Write session will restart in 0.009795s
2025-10-02T08:08:26.961543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0] Write session: Do CDS request
2025-10-02T08:08:26.961552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:26.972458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.972819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:26.972841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 325
2025-10-02T08:08:26.973018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:26.973052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:26.973063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:26.973067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:26.973496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 325 sessionId:  describe result for acl check
2025-10-02T08:08:26.973535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:26.973542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:26.973544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:26.973550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533275495847020:5491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:26.974097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533275495847020:5491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:26.974495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:26.975388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:26.975643Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:26.975657Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:26.975669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:26.975729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:26.975770Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533275495847051:5490]
2025-10-02T08:08:26.976101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533275495847020:5491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:26.976718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:26.976949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:26.976996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:26.977332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:26.977391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.977398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.977399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.977400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.977415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.977420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.977432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.977440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.977444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.977448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.977456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.977468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:26.977476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.977487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:26.977491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.977499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:26.977503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.977508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.977513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.977523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.977542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:26.982641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533275495847020:5491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:26.982659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533275495847020:5491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:26.982663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533275495847020:5491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:26.982672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:26.985897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:26.987799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:26.987816Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:26.987818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:26.987822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:26.987829Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 324 [1:7556533275495847051:5490]
2025-10-02T08:08:26.987839Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:26.987854Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:26.987857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.987861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.987863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.987877Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:26.987882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:26.987893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:26.987962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.987972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.987976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:26.987978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:26.988046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:26.988053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:26.988065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:26.988084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:26.988095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 324
2025-10-02T08:08:26.988107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533275495847078:5491], now have 1 active actors on pipe
2025-10-02T08:08:26.988110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533275956204039:2378], now have 1 active actors on pipe
2025-10-02T08:08:26.988117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533275495847033:5490]
2025-10-02T08:08:26.988119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533275495847033:5490]
2025-10-02T08:08:26.988130Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:26.988139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.988143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.988154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:26.988160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:26.988165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:26.988173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:26.988176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:26.988177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 324
2025-10-02T08:08:26.988216Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17aca864-95582907-7aed8d3a-39817516_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:26.988228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:26.988232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:26.988234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:26.988243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:26.988256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:26.988267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533275495847033:5490]
2025-10-02T08:08:26.988282Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:26.988298Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:26.988315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.988368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:26.988375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:26.988389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:26.988444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 325 partition: 0 MaxSeqNo: 17 sessionId: src_id|17aca864-95582907-7aed8d3a-39817516_0
2025-10-02T08:08:26.988885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef5fe0a9-f676bd82-daf65a91-dbd06239_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|17aca864-95582907-7aed8d3a-39817516_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:26.991467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17aca864-95582907-7aed8d3a-39817516_0] Write session: try to update token
2025-10-02T08:08:26.991491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17aca864-95582907-7aed8d3a-39817516_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:27.005112Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:27.005131Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:27.005133Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:27.005143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533275495847033:5490]
2025-10-02T08:08:27.005147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533275495847033:5490]
2025-10-02T08:08:27.005192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:27.005199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.005198Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:27.005203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:27.005204Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:27.005350Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:27.010496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId: src_id|17aca864-95582907-7aed8d3a-39817516_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:27.013290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:27.061068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533279790814389:5300]
2025-10-02T08:08:27.061159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 324, pipe: [1:7556533279790814389:5300]
2025-10-02T08:08:27.143168Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:27.143473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.143486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.143504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790814389:5300], now have 1 active actors on pipe
2025-10-02T08:08:27.143606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533279790814389:5300]
2025-10-02T08:08:27.143648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:27.143654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:27.143722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 325 reason: error at write: Disconnected sessionId: src_id|17aca864-95582907-7aed8d3a-39817516_0
2025-10-02T08:08:27.143733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:27.143889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 325 sessionId: src_id|17aca864-95582907-7aed8d3a-39817516_0 is DEAD
2025-10-02T08:08:27.143909Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:27.144089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17aca864-95582907-7aed8d3a-39817516_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:27.144104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17aca864-95582907-7aed8d3a-39817516_0] Write session will restart in 0.009210s
2025-10-02T08:08:27.144133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17aca864-95582907-7aed8d3a-39817516_0] Write session: Do CDS request
2025-10-02T08:08:27.144140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17aca864-95582907-7aed8d3a-39817516_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:27.153956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:27.154386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17aca864-95582907-7aed8d3a-39817516_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.154464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:27.154476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 326
2025-10-02T08:08:27.154603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:27.154756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.154787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:27.154789Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:27.154791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:27.154793Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:27.154795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:27.154803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:27.154855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:27.154890Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533279790814697:5496]
2025-10-02T08:08:27.155091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 326 sessionId:  describe result for acl check
2025-10-02T08:08:27.155119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:27.155124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:27.155125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:27.155129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533279790814701:5498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:27.155499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:27.155539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533279790814701:5498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:27.155655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:27.155706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:27.156089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:27.156152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.156158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.156159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.156159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.156160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.156165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.156174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.156178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.156181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.156184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.156189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.156195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.156200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.156203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.156207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.156211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.156215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.156219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.156222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.156226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.156244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:27.157440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533279790814701:5498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:27.163654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533279790814701:5498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:27.163671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533279790814701:5498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:27.163674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533279790814701:5498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:27.163680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:27.164034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:27.165585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:27.165601Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:27.165603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:27.165607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:27.165613Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 325 [1:7556533279790814697:5496]
2025-10-02T08:08:27.165624Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:27.165641Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:27.165643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.165646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.165648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.165662Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:27.165672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:27.165678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:27.165744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.165750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.165753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:27.165756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:27.165820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:27.165829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.165842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.165854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:27.165860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 325
2025-10-02T08:08:27.165871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790814744:5498], now have 1 active actors on pipe
2025-10-02T08:08:27.165881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533280251171341:2378], now have 1 active actors on pipe
2025-10-02T08:08:27.165886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.165890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.165906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533279790814690:5496]
2025-10-02T08:08:27.165910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533279790814690:5496]
2025-10-02T08:08:27.165925Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:27.165936Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:27.165938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:27.165939Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:27.165951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:27.165953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:27.165966Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:27.165941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 325
2025-10-02T08:08:27.165976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.165980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.165982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:27.165989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.165997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:27.166047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533279790814690:5496]
2025-10-02T08:08:27.166058Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:27.166076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:27.166131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.166182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.166188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.166203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.166238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 326 partition: 0 MaxSeqNo: 17 sessionId: src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0
2025-10-02T08:08:27.166615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17aca864-95582907-7aed8d3a-39817516_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:27.169260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0] Write session: try to update token
2025-10-02T08:08:27.169283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:27.176092Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:27.176109Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:27.176118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533279790814690:5496]
2025-10-02T08:08:27.176151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:27.176155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:27.176322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:27.176463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:27.176596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:27.176737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:27.177380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:27.177417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:27.189765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId: src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:27.192046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:27.192271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.192283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.192322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:27.192354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:27.192476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.192491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.192661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.192724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.192779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.192849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.192896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.192910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.192965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.193018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.193083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.193150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.193197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.193203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.193261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.193317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.193369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.193426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.193473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.193481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.193536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.193588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.193655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.193710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.193755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.193761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.193816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.193869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.193924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.193989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.194033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.194041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.194097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.194155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.194219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.194275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.194330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.194336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.194394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.194446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.194506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.194562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.194606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.194612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.194679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.194733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.194792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.194851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.194901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.194910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.194983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.195044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.195103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.195172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.195219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.195222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.195290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:27.195349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:27.195409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:27.195470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:27.195515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:27.195522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:27.195579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:27.195643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.195665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.195686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:27.195715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:27.195726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:27.195728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:27.195731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:27.195734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:27.197218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:27.197246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:27.197251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:27.197255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:27.197257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:27.197259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:27.198080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:27.198098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:27.198103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:27.198106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:27.198109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:27.198111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:27.198908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:27.198931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:27.198935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:27.198938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:27.198940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:27.200044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:27.200069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:27.200080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392507199
2025-10-02T08:08:27.200205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:27.200220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:27.200226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:27.200228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:27.200232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:27.200237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:27.200770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:27.200785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:27.200791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:27.200794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:27.200798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:27.200814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:27.201285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:27.201298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:27.201309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:27.201311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:27.201315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:27.201318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:27.201836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:27.201849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:27.201854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:27.202900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:27.202906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:27.202911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:27.202914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:27.202921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392507202
2025-10-02T08:08:27.203222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:27.203230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:27.203235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:27.203238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:27.203242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:27.203246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:27.203707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:27.203717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:27.203722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:27.203725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:27.203728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:27.203732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:27.204166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:27.204177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.204272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392507203
2025-10-02T08:08:27.206672Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:27.206703Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:27.206709Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:27.206717Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:27.206727Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:27.206729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:27.206731Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:27.206742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533279790814690:5496]
2025-10-02T08:08:27.206751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533279790814690:5496]
2025-10-02T08:08:27.206808Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:27.206823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:27.206826Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:27.206827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.206828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:27.206959Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:27.243859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533279790814773:5300]
2025-10-02T08:08:27.244060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 325, pipe: [1:7556533279790814773:5300]
2025-10-02T08:08:27.347107Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:27.347434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790814773:5300], now have 1 active actors on pipe
2025-10-02T08:08:27.347615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:27.347627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:27.347632Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:27.347659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 326 reason: error at write: Disconnected sessionId: src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0
2025-10-02T08:08:27.347804Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:27.347912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 326 sessionId: src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0 is DEAD
2025-10-02T08:08:27.347966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533279790814773:5300]
2025-10-02T08:08:27.348167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:27.348184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0] Write session will restart in 0.007621s
2025-10-02T08:08:27.348238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0] Write session: Do CDS request
2025-10-02T08:08:27.348247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:27.351425Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [671ece929e7e9d5a] Result# TEvPutResult {Id# [72075186224037892:325:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:27.351453Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:325:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:27.351524Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:325:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:27.357460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.357639Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:27.357653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 327
2025-10-02T08:08:27.357808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.357848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:27.357857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:27.357861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:27.358202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 327 sessionId:  describe result for acl check
2025-10-02T08:08:27.358230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:27.358236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:27.358237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:27.358242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533279790815065:5504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:27.358649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533279790815065:5504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:27.360351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:27.360733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533279790815065:5504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:27.361316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:27.361524Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:27.361534Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:27.361544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:27.361601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:27.361636Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533279790815124:5503]
2025-10-02T08:08:27.362182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:27.362375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:27.362430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:27.362739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:27.362799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.362804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.362805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.362806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.362807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.362812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.362822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.362825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.362829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.362833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.362838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.362845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.362850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.362855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.362859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.362864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.362870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.362874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.362882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.362891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.362915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:27.363584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533279790815065:5504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:27.363597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533279790815065:5504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:27.363601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533279790815065:5504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:27.363609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:27.370821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:27.372577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:27.372596Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:27.372598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:27.372602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:27.372609Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 326 [1:7556533279790815124:5503]
2025-10-02T08:08:27.372620Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:27.372636Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:27.372639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.372642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.372644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.372661Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:27.372672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:27.372678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:27.372739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.372746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.372749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:27.372751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:27.372833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:27.372842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.372857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.372869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:27.372891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790815141:5504], now have 1 active actors on pipe
2025-10-02T08:08:27.372892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 326
2025-10-02T08:08:27.372901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533279790815108:5503]
2025-10-02T08:08:27.372903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533279790815108:5503]
2025-10-02T08:08:27.372914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:27.372925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533280251171362:2378], now have 1 active actors on pipe
2025-10-02T08:08:27.372928Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:27.372932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:27.372934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.372937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.372955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:27.372975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:27.372981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:27.372966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 326
2025-10-02T08:08:27.373022Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:27.373032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.373036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.373039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:27.373048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.373062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:27.373073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533279790815108:5503]
2025-10-02T08:08:27.373083Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:27.373095Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:27.373118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.373176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.373183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.373225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.373268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 327 partition: 0 MaxSeqNo: 17 sessionId: src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0
2025-10-02T08:08:27.373683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5002b7-d510b205-7165f7a2-54c1dfbd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:27.376469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0] Write session: try to update token
2025-10-02T08:08:27.376491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:27.390166Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:27.390183Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:27.390186Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:27.390195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533279790815108:5503]
2025-10-02T08:08:27.390199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533279790815108:5503]
2025-10-02T08:08:27.390238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:27.390243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.390244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:27.390246Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:27.390252Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:27.390381Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:27.393229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId: src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:27.396296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:27.474231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533279790815173:5300]
2025-10-02T08:08:27.476636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 326, pipe: [1:7556533279790815173:5300]
2025-10-02T08:08:27.521767Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:27.522116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.522128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.522160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790815173:5300], now have 1 active actors on pipe
2025-10-02T08:08:27.522332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:27.522355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:27.522389Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:27.522420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 327 reason: error at write: Disconnected sessionId: src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0
2025-10-02T08:08:27.522443Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:27.522621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 327 sessionId: src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0 is DEAD
2025-10-02T08:08:27.522759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533279790815173:5300]
2025-10-02T08:08:27.522822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:27.522836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0] Write session will restart in 0.008404s
2025-10-02T08:08:27.522862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0] Write session: Do CDS request
2025-10-02T08:08:27.522870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:27.532422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.532468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:27.532480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 328
2025-10-02T08:08:27.532647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.532675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:27.532683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:27.532686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:27.532794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:27.533049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 328 sessionId:  describe result for acl check
2025-10-02T08:08:27.533076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:27.533082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:27.533083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:27.533088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533279790815502:5522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:27.533543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533279790815502:5522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:27.533668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:27.533844Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:27.533848Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:27.533857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:27.533916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:27.533946Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533279790815509:5520]
2025-10-02T08:08:27.534620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:27.534785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:27.534847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:27.535194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:27.535245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.535251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.535252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.535253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.535254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.535259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.535268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.535272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.535275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.535279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.535285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.535291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.535296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.535301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.535305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.535310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.535315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.535319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.535323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.535328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.535344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:27.535398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533279790815502:5522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:27.540324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533279790815502:5522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:27.540342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533279790815502:5522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:27.540345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533279790815502:5522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:27.540354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:27.543520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:27.545290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:27.545308Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:27.545311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:27.545314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:27.545320Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 327 [1:7556533279790815509:5520]
2025-10-02T08:08:27.545331Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:27.545348Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:27.545351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.545353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.545355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.545372Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:27.545376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:27.545382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:27.545446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.545456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.545460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:27.545462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:27.545523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:27.545529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.545541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.545552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:27.545571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790815549:5522], now have 1 active actors on pipe
2025-10-02T08:08:27.545583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533279790815496:5520]
2025-10-02T08:08:27.545585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533279790815496:5520]
2025-10-02T08:08:27.545584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 327
2025-10-02T08:08:27.545592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:27.545598Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:27.545600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:27.545603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:27.545617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:27.545620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:27.545626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533280251171369:2378], now have 1 active actors on pipe
2025-10-02T08:08:27.545631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.545635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.545675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533279790815496:5520]
2025-10-02T08:08:27.545689Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:27.545697Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:27.545684Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 327
2025-10-02T08:08:27.545710Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:27.545719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.545723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.545725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:27.545733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.545741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:27.545780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.545877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.545889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.545913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.545956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 328 partition: 0 MaxSeqNo: 17 sessionId: src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0
2025-10-02T08:08:27.546365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d29ae87c-99abe34b-3bd5be6f-5d5ac37e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:27.548977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0] Write session: try to update token
2025-10-02T08:08:27.548999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:27.563489Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:27.563507Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:27.563509Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:27.563517Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533279790815496:5520]
2025-10-02T08:08:27.563522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533279790815496:5520]
2025-10-02T08:08:27.563559Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:27.563565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:27.563566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:27.563574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.563576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:27.563725Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:27.565949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId: src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:27.568972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:27.622717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533279790815571:5300]
2025-10-02T08:08:27.622811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 327, pipe: [1:7556533279790815571:5300]
2025-10-02T08:08:27.700887Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:27.701221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.701236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.701277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790815571:5300], now have 1 active actors on pipe
2025-10-02T08:08:27.701563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533279790815571:5300]
2025-10-02T08:08:27.701597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:27.701600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:27.701658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 328 reason: error at write: Disconnected sessionId: src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0
2025-10-02T08:08:27.702070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:27.702085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0] Write session will restart in 0.007758s
2025-10-02T08:08:27.702111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0] Write session: Do CDS request
2025-10-02T08:08:27.702118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:27.702135Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:27.701839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 328 sessionId: src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0 is DEAD
2025-10-02T08:08:27.702636Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:27.711421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.711542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:27.711562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 329
2025-10-02T08:08:27.711774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.711834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:27.711843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:27.711847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:27.712347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 329 sessionId:  describe result for acl check
2025-10-02T08:08:27.712409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:27.712418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:27.712420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:27.712427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533279790815871:5529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:27.713082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533279790815871:5529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:27.714099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:27.714948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:27.715130Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:27.715140Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:27.715149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:27.715200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:27.715240Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533279790815907:5528]
2025-10-02T08:08:27.715870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:27.715869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533279790815871:5529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:27.716169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:27.716217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:27.716533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:27.716589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.716594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.716595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.716596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.716597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.716602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.716612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.716617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.716621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.716625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.716630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.716637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.716642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.716647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.716651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.716656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.716661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.716666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.716670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.716675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.716699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:27.722564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533279790815871:5529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:27.722589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533279790815871:5529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:27.722593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533279790815871:5529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:27.722605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:27.725775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:27.727827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:27.727849Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:27.727852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:27.727857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:27.727865Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 328 [1:7556533279790815907:5528]
2025-10-02T08:08:27.727881Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:27.727905Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:27.727909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.727913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.727915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.727935Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:27.727961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:27.727971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:27.728065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.728074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.728078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:27.728082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:27.728158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:27.728170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.728186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.728198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:27.728224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790815935:5529], now have 1 active actors on pipe
2025-10-02T08:08:27.728231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533279790815890:5528]
2025-10-02T08:08:27.728233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533279790815890:5528]
2025-10-02T08:08:27.728242Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:27.728254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533280251171398:2378], now have 1 active actors on pipe
2025-10-02T08:08:27.728256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:27.728260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:27.728264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:27.728277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:27.728281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:27.728324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533279790815890:5528]
2025-10-02T08:08:27.728324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 328
2025-10-02T08:08:27.728327Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:27.728331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:27.728334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.728339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.728395Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e6348a1-6ce84c7-380d223c-c841c983_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:27.728403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.728407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.728409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:27.728421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.728432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:27.728451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.728676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.728683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.728698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.728730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 329 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e6348a1-6ce84c7-380d223c-c841c983_0
2025-10-02T08:08:27.729076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 328
2025-10-02T08:08:27.729202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946ec3b9-6b47dfcf-ad59c71c-64b8a64a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e6348a1-6ce84c7-380d223c-c841c983_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:27.731819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6348a1-6ce84c7-380d223c-c841c983_0] Write session: try to update token
2025-10-02T08:08:27.731839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6348a1-6ce84c7-380d223c-c841c983_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:27.748273Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:27.748298Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:27.748301Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:27.748312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533279790815890:5528]
2025-10-02T08:08:27.748317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533279790815890:5528]
2025-10-02T08:08:27.748373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:27.748387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.748393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:27.748564Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:27.748636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId: src_id|3e6348a1-6ce84c7-380d223c-c841c983_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:27.751607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:27.751694Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:27.751701Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:27.801950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533279790815953:5300]
2025-10-02T08:08:27.802084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 328, pipe: [1:7556533279790815953:5300]
2025-10-02T08:08:27.899484Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:27.900352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:27.900025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.900039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.900089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790815953:5300], now have 1 active actors on pipe
2025-10-02T08:08:27.900270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533279790815953:5300]
2025-10-02T08:08:27.900289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:27.900291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:27.900356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 329 reason: error at write: Disconnected sessionId: src_id|3e6348a1-6ce84c7-380d223c-c841c983_0
2025-10-02T08:08:27.900383Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:27.900529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 329 sessionId: src_id|3e6348a1-6ce84c7-380d223c-c841c983_0 is DEAD
2025-10-02T08:08:27.900732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6348a1-6ce84c7-380d223c-c841c983_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:27.900745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6348a1-6ce84c7-380d223c-c841c983_0] Write session will restart in 0.009043s
2025-10-02T08:08:27.900770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6348a1-6ce84c7-380d223c-c841c983_0] Write session: Do CDS request
2025-10-02T08:08:27.900777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6348a1-6ce84c7-380d223c-c841c983_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:27.913640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6348a1-6ce84c7-380d223c-c841c983_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.913832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:27.913852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 330
2025-10-02T08:08:27.916852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:27.916916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:27.916924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:27.916929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:27.917494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 330 sessionId:  describe result for acl check
2025-10-02T08:08:27.917536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:27.917538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:27.917540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:27.917546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533279790816215:5536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:27.918203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533279790816215:5536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:27.921031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533279790816215:5536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:27.922570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:27.924610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:27.924994Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:27.925007Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:27.925025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:27.925064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533279790816215:5536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:27.925073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533279790816215:5536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:27.925076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533279790816215:5536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:27.925086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:27.925090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:27.925132Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533279790816315:5535]
2025-10-02T08:08:27.925768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:27.925981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:27.926032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:27.926366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:27.926437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.926442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.926443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.926445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.926446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.926452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.926462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.926465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.926469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.926472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.926477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.926484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:27.926492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.926497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:27.926502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.926507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:27.926511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.926516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.926521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.926526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.926557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:27.939629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:27.941620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:27.941646Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:27.941649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:27.941654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:27.941663Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 329 [1:7556533279790816315:5535]
2025-10-02T08:08:27.941677Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:27.941701Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:27.941705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.941709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.941711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.941733Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:27.941740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:27.941750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:27.941842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.941854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.941858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:27.941861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:27.941948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:27.941957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.941976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:27.941995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:27.942022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533279790816309:5535]
2025-10-02T08:08:27.942028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533279790816309:5535]
2025-10-02T08:08:27.942039Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:27.942044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 329
2025-10-02T08:08:27.942059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533279790816320:5536], now have 1 active actors on pipe
2025-10-02T08:08:27.942074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:27.942073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:27.942077Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:27.942097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:27.942105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:27.942151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533280251171417:2378], now have 1 active actors on pipe
2025-10-02T08:08:27.942161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.942165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.942182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533279790816309:5535]
2025-10-02T08:08:27.942190Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:27.942226Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:27.942239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:27.942248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:27.942250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:27.942256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:27.942262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:27.942278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:27.942304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.942384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:27.942390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:27.942404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:27.942442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 330 partition: 0 MaxSeqNo: 17 sessionId: src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0
2025-10-02T08:08:27.942876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6348a1-6ce84c7-380d223c-c841c983_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:27.942906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 329
2025-10-02T08:08:27.945614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0] Write session: try to update token
2025-10-02T08:08:27.945632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:27.970101Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:27.970126Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:27.970130Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:27.970143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533279790816309:5535]
2025-10-02T08:08:27.970150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533279790816309:5535]
2025-10-02T08:08:27.970204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:27.970219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:27.970224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:27.970396Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:27.970825Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:27.970842Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:27.972042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId: src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:27.975321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:28.000885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533284085783642:5300]
2025-10-02T08:08:28.001093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 329, pipe: [1:7556533284085783642:5300]
2025-10-02T08:08:28.162648Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:28.163220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.163233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.163293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085783642:5300], now have 1 active actors on pipe
2025-10-02T08:08:28.163651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:28.163666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:28.163726Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:28.163741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 330 reason: error at write: Disconnected sessionId: src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0
2025-10-02T08:08:28.164286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:28.164300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0] Write session will restart in 0.005929s
2025-10-02T08:08:28.163955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 330 sessionId: src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0 is DEAD
2025-10-02T08:08:28.164174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533284085783642:5300]
2025-10-02T08:08:28.164326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0] Write session: Do CDS request
2025-10-02T08:08:28.164338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:28.164663Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:28.171448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:28.171956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:28.171978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 331
2025-10-02T08:08:28.172835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:28.172884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:28.172896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:28.172902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:28.173457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 331 sessionId:  describe result for acl check
2025-10-02T08:08:28.173503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:28.173511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:28.173513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:28.173521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533284085783682:5542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:28.174950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533284085783682:5542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:28.181457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533284085783682:5542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:28.189257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533284085783682:5542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:28.189281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533284085783682:5542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:28.189284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533284085783682:5542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:28.189298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:28.192965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:28.194041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:28.194266Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:28.194281Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:28.194295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:28.194361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:28.194506Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533284085784000:5541]
2025-10-02T08:08:28.195219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:28.195526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:28.195585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:28.195947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:28.196030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.196038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.196039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.196040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.196041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.196048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.196059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.196063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.196067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.196071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.196077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.196084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.196091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.196096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.196100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.196105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.196110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.196116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.196121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.196126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.196145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:28.210109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:28.212482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:28.212510Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:28.212514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:28.212519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:28.212526Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 330 [1:7556533284085784000:5541]
2025-10-02T08:08:28.212542Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:28.212567Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:28.212571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.212575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.212577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.212597Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:28.212603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:28.212612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:28.212697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.212711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.212716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:28.212719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:28.212925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:28.212933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.212951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.212969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:28.212997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085783959:5542], now have 1 active actors on pipe
2025-10-02T08:08:28.213005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533284546138732:2378], now have 1 active actors on pipe
2025-10-02T08:08:28.213012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533284085783994:5541]
2025-10-02T08:08:28.213018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533284085783994:5541]
2025-10-02T08:08:28.213035Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:28.213052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:28.213056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:28.213065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:28.213071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:28.213074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:28.213120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533284085783994:5541]
2025-10-02T08:08:28.213135Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:28.213147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:28.213075Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 330
2025-10-02T08:08:28.213162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 330
2025-10-02T08:08:28.213172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.213178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.213219Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87f891fd-dedd5943-2666b95a-204d40b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:28.213228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.213232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.213234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:28.213246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.213257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:28.213279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:28.213332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.213340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.213355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:28.213385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 331 partition: 0 MaxSeqNo: 17 sessionId: src_id|87f891fd-dedd5943-2666b95a-204d40b2_0
2025-10-02T08:08:28.213980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b972e255-1a5d4b1d-3b8ee614-d257f8c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|87f891fd-dedd5943-2666b95a-204d40b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:28.217339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87f891fd-dedd5943-2666b95a-204d40b2_0] Write session: try to update token
2025-10-02T08:08:28.217363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87f891fd-dedd5943-2666b95a-204d40b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:28.236654Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:28.236679Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:28.236691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533284085783994:5541]
2025-10-02T08:08:28.236754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:28.236762Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:28.236958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:28.237128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:28.237307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:28.237467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:28.237997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:28.238059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:28.239221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId: src_id|87f891fd-dedd5943-2666b95a-204d40b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:28.242156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:28.242254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.242272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.242315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:28.242342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:28.242398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.242417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.242630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.242710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.242796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.242885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.242949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.242958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.243052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.243136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.243222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.243317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.243397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.243410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.243498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.243582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.243670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.243768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.243866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.243875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.243976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.244070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.244155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.244245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.244321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.244331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.244417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.244503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.244591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.244685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.244757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.244765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.244882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.244970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.245040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.245124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.245182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.245185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.245278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.245361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.245448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.245530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.245587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.245593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.245684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.245761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.245841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.245919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.245975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.245979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.246069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.246149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.246226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.246317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.246380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.246391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.246476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.246552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.246632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.246722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.246781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.246789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.246849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:28.246941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.246966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.246973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:28.247014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:28.247036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:28.247045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:28.247048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:28.247052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:28.247521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:28.247554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:28.247562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:28.247568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:28.247571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:28.247574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:28.248656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:28.248709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:28.248722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:28.248726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:28.248728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:28.248731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:28.249340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:28.249359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:28.249367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:28.249371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:28.249375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:28.250840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:28.250871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:28.250890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392508250
2025-10-02T08:08:28.251018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:28.251037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:28.251042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:28.251046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:28.251050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:28.251054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:28.251705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:28.251732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:28.251739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:28.251743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:28.251746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:28.251753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:28.252302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:28.252328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:28.252336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:28.252341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:28.252349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:28.252353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:28.252935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:28.252967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:28.252973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:28.254271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:28.254294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:28.254300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:28.254305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:28.254315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392508253
2025-10-02T08:08:28.254651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:28.254684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:28.254691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:28.254695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:28.254698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:28.254702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:28.255274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:28.255308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:28.255314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:28.255319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:28.255322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:28.255327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:28.255891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:28.255916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.256056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392508256
2025-10-02T08:08:28.257114Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:28.257139Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:28.257161Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:28.257167Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:28.259352Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:28.259369Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:28.259374Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:28.259388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533284085783994:5541]
2025-10-02T08:08:28.259394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533284085783994:5541]
2025-10-02T08:08:28.259466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:28.259476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.259479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:28.259519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:28.259544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:28.259637Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:28.264355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533284085784041:5300]
2025-10-02T08:08:28.264858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 330, pipe: [1:7556533284085784041:5300]
2025-10-02T08:08:28.405229Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:28.405543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085784041:5300], now have 1 active actors on pipe
2025-10-02T08:08:28.405692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:28.405702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:28.405728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 331 reason: error at write: Disconnected sessionId: src_id|87f891fd-dedd5943-2666b95a-204d40b2_0
2025-10-02T08:08:28.405806Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:28.405905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 331 sessionId: src_id|87f891fd-dedd5943-2666b95a-204d40b2_0 is DEAD
2025-10-02T08:08:28.405922Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:28.406019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f891fd-dedd5943-2666b95a-204d40b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:28.406027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f891fd-dedd5943-2666b95a-204d40b2_0] Write session will restart in 0.006017s
2025-10-02T08:08:28.406051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f891fd-dedd5943-2666b95a-204d40b2_0] Write session: Do CDS request
2025-10-02T08:08:28.406056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f891fd-dedd5943-2666b95a-204d40b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:28.406090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533284085784041:5300]
2025-10-02T08:08:28.413375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87f891fd-dedd5943-2666b95a-204d40b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:28.413504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:28.413529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 332
2025-10-02T08:08:28.418055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:28.418122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:28.418133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:28.418138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:28.418618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 332 sessionId:  describe result for acl check
2025-10-02T08:08:28.418659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:28.418666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:28.418667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:28.418672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533284085784309:5550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:28.419296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533284085784309:5550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:28.423831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533284085784309:5550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:28.427160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:28.429669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:28.430160Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:28.430196Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:28.430227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:28.430370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:28.430426Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533284085784406:5549]
2025-10-02T08:08:28.431077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:28.431399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:28.431469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:28.431763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533284085784309:5550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:28.431782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533284085784309:5550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:28.431787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533284085784309:5550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:28.431793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:28.431806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:28.431847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.431860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.431862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.431863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.431864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.431871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.431881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.431885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.431889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.431893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.431899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.431906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.431912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.431919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.431924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.431930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.431946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.431951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.431957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.431962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.431982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:28.442719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:28.444403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:28.444425Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:28.444428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:28.444432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:28.444443Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 331 [1:7556533284085784406:5549]
2025-10-02T08:08:28.444457Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:28.444476Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:28.444483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.444486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.444488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.444504Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:28.444509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:28.444514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:28.444580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.444586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.444588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:28.444590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:28.444644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:28.444649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.444658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.444668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:28.444685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533284085784399:5549]
2025-10-02T08:08:28.444690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533284085784399:5549]
2025-10-02T08:08:28.444696Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:28.444705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:28.444718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:28.444723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:28.444758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085784418:5550], now have 1 active actors on pipe
2025-10-02T08:08:28.444760Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:28.444763Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:28.444764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533284085784399:5549]
2025-10-02T08:08:28.444766Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:28.444770Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:28.444761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 331
2025-10-02T08:08:28.444786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533284546138742:2378], now have 1 active actors on pipe
2025-10-02T08:08:28.444791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.444795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.444850Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|898227ec-e6f6e133-4d5e6260-753361f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:28.444861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.444866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.444877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:28.444887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.444899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:28.444920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:28.445027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.445036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.445052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:28.445102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 332 partition: 0 MaxSeqNo: 17 sessionId: src_id|898227ec-e6f6e133-4d5e6260-753361f9_0
2025-10-02T08:08:28.445032Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 331
2025-10-02T08:08:28.445439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f891fd-dedd5943-2666b95a-204d40b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|898227ec-e6f6e133-4d5e6260-753361f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:28.448556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|898227ec-e6f6e133-4d5e6260-753361f9_0] Write session: try to update token
2025-10-02T08:08:28.448575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|898227ec-e6f6e133-4d5e6260-753361f9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:28.458767Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:28.458792Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:28.458802Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533284085784399:5549]
2025-10-02T08:08:28.458851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:28.459068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:28.459146Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:28.459222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:28.459379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:28.459526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:28.459740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:28.459799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:28.470020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId: src_id|898227ec-e6f6e133-4d5e6260-753361f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:28.473221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:28.473336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.473351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.473392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:28.473427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:28.473521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.473529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.473705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.473788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.473869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.473934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.473985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.473994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.474066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.474135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.474199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.474273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.474328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.474336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.474410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.474480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.474547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.474617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.474665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.474673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.474746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.474813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.474887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.475006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.475099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.475108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.475221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.475333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.475433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.475536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.475608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.475622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.475724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.475798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.475865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.475930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.475991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.475997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.476072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.476130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.476195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.476258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.476308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.476313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.476380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.476440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.476502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.476574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.476620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.476625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.476687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.476755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.476842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.476910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.476963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.476970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.477040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.477112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.477186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.477258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.477317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.477324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.477370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:28.477440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.477468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.477475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:28.477509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:28.477525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:28.477532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:28.477536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:28.477538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:28.477975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:28.478003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:28.478013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:28.478019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:28.478026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:28.478029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:28.478642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:28.478671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:28.478679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:28.478682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:28.478686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:28.478689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:28.479441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:28.479470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:28.479477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:28.479480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:28.479483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:28.480970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:28.480994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:28.481010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392508480
2025-10-02T08:08:28.481181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:28.481199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:28.481208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:28.481212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:28.481216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:28.481219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:28.481775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:28.481800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:28.481807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:28.481812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:28.481815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:28.481818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:28.482366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:28.482395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:28.482406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:28.482409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:28.482413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:28.482417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:28.482975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:28.483003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:28.483010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:28.484289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:28.484307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:28.484314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:28.484318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:28.484329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392508483
2025-10-02T08:08:28.484652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:28.484675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:28.484682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:28.484685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:28.484690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:28.484696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:28.485230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:28.485255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:28.485261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:28.485265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:28.485268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:28.485273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:28.485800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:28.485821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.485931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392508485
2025-10-02T08:08:28.486788Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:28.486810Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:28.486816Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:28.486823Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:28.488521Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:28.488534Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:28.488536Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:28.488548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533284085784399:5549]
2025-10-02T08:08:28.488551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533284085784399:5549]
2025-10-02T08:08:28.488620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:28.488629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.488632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:28.488621Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:28.488643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:28.488774Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:28.519617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533284085784456:5300]
2025-10-02T08:08:28.521999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 331, pipe: [1:7556533284085784456:5300]
2025-10-02T08:08:28.644440Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:28.644911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085784456:5300], now have 1 active actors on pipe
2025-10-02T08:08:28.645313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533284085784456:5300]
2025-10-02T08:08:28.645472Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:28.645815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:28.645854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 332 reason: status is not ok: tablet will be restarted right now sessionId: src_id|898227ec-e6f6e133-4d5e6260-753361f9_0
2025-10-02T08:08:28.646059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 332 sessionId: src_id|898227ec-e6f6e133-4d5e6260-753361f9_0 is DEAD
2025-10-02T08:08:28.646207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|898227ec-e6f6e133-4d5e6260-753361f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:28.646218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|898227ec-e6f6e133-4d5e6260-753361f9_0] Write session will restart in 0.007395s
2025-10-02T08:08:28.646244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|898227ec-e6f6e133-4d5e6260-753361f9_0] Write session: Do CDS request
2025-10-02T08:08:28.646251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|898227ec-e6f6e133-4d5e6260-753361f9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:28.645187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:28.655393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|898227ec-e6f6e133-4d5e6260-753361f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:28.655600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:28.655617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 333
2025-10-02T08:08:28.655753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:28.655785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:28.655794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:28.655798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:28.656311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 333 sessionId:  describe result for acl check
2025-10-02T08:08:28.656346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:28.656353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:28.656355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:28.656360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533284085784685:5568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:28.656763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533284085784685:5568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:28.664043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533284085784685:5568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:28.667696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:28.669244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:28.669589Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:28.669604Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:28.669619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:28.669690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:28.669747Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533284085784834:5567]
2025-10-02T08:08:28.670457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:28.670913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:28.670987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:28.671344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:28.671413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.671420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.671422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.671423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.671425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.671431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.671442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.671446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.671450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.671454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.671461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.671470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.671477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.671483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.671487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.671492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.671497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.671503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.671508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.671514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.671536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:28.676303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533284085784685:5568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:28.676324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533284085784685:5568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:28.676328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533284085784685:5568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:28.676338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:28.682418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:28.684654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:28.684677Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:28.684680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:28.684685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:28.684694Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 332 [1:7556533284085784834:5567]
2025-10-02T08:08:28.684710Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:28.684735Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:28.684742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.684746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.684748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.684767Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:28.684774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:28.684783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:28.684885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.684894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.684898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:28.684901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:28.684984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:28.684988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.685005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.685018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:28.685039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533284085784828:5567]
2025-10-02T08:08:28.685041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533284085784828:5567]
2025-10-02T08:08:28.685050Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:28.685065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:28.685081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:28.685084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:28.685121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:28.685124Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:28.685134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085784850:5568], now have 1 active actors on pipe
2025-10-02T08:08:28.685138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533284085784828:5567]
2025-10-02T08:08:28.685141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:28.685160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533284546138769:2378], now have 1 active actors on pipe
2025-10-02T08:08:28.685198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 332
2025-10-02T08:08:28.685324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:28.685415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.685423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.685459Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:28.685477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.685481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.685483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:28.685495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.685508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:28.685525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:28.685655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.685663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.685678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:28.685959Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 332
2025-10-02T08:08:28.685717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 333 partition: 0 MaxSeqNo: 17 sessionId: src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0
2025-10-02T08:08:28.687792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|898227ec-e6f6e133-4d5e6260-753361f9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:28.694399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0] Write session: try to update token
2025-10-02T08:08:28.694424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:28.716687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId: src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:28.719831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:28.719896Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:28.719916Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:28.719919Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:28.719927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533284085784828:5567]
2025-10-02T08:08:28.719943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533284085784828:5567]
2025-10-02T08:08:28.719986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.719985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:28.719991Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:28.720002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.720022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:28.720033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.720035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:28.720177Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:28.745571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533284085784866:5300]
2025-10-02T08:08:28.745797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 332, pipe: [1:7556533284085784866:5300]
2025-10-02T08:08:28.865555Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:28.866186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085784866:5300], now have 1 active actors on pipe
2025-10-02T08:08:28.866316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533284085784866:5300]
2025-10-02T08:08:28.866336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:28.866342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:28.866396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 333 reason: error at write: Disconnected sessionId: src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0
2025-10-02T08:08:28.866434Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:28.866567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 333 sessionId: src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0 is DEAD
2025-10-02T08:08:28.866785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:28.866801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0] Write session will restart in 0.006484s
2025-10-02T08:08:28.866827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0] Write session: Do CDS request
2025-10-02T08:08:28.866834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:28.868903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:28.874379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:28.874541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:28.874563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 334
2025-10-02T08:08:28.874738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:28.874788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:28.874795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:28.874799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:28.875427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 334 sessionId:  describe result for acl check
2025-10-02T08:08:28.875471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:28.875473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:28.875474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:28.875480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533284085785069:5575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:28.876161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533284085785069:5575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:28.879983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533284085785069:5575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:28.886391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533284085785069:5575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:28.886415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533284085785069:5575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:28.886419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533284085785069:5575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:28.886428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:28.888921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:28.890195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:28.890548Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:28.890562Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:28.890574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:28.890635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:28.890672Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533284085785231:5574]
2025-10-02T08:08:28.891298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:28.891529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:28.891572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:28.891873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:28.891927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.891944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.891945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.891970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.891971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.891976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.891986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.891994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.891998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.892001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.892007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.892015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:28.892021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.892026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:28.892030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.892035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:28.892040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.892044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.892049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.892053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.892071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:28.905010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:28.906765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:28.906784Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:28.906787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:28.906791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:28.906798Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 333 [1:7556533284085785231:5574]
2025-10-02T08:08:28.906808Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:28.906827Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:28.906830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.906832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.906834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.906850Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:28.906860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:28.906866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:28.906936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.906944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.906947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:28.906949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:28.907015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:28.907022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.907036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:28.907054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:28.907073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533284085785225:5574]
2025-10-02T08:08:28.907075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533284085785225:5574]
2025-10-02T08:08:28.907083Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:28.907091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 333
2025-10-02T08:08:28.907097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085785211:5575], now have 1 active actors on pipe
2025-10-02T08:08:28.907098Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:28.907101Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:28.907104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:28.907120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:28.907123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:28.907129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533284546138779:2378], now have 1 active actors on pipe
2025-10-02T08:08:28.907138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.907143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.907187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533284085785225:5574]
2025-10-02T08:08:28.907199Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:28.907215Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:28.907220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.907224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.907227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:28.907236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.907244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:28.907280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:28.907296Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:28.907344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.907351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.907366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:28.907410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 334 partition: 0 MaxSeqNo: 17 sessionId: src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0
2025-10-02T08:08:28.908686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc9c9d7-3a177748-e34f4fa4-fbdba861_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:28.907461Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 333
2025-10-02T08:08:28.911363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0] Write session: try to update token
2025-10-02T08:08:28.911385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:28.936348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId: src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:28.939345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:28.939536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.939562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.939613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:28.939649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:28.939756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:28.939767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:28.940029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.940105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.940189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.940288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.940367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.940379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.940458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.940553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.940645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.940738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.940821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.940835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.940924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.940999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.941087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.941170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.941228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.941232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.941324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.941403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.941487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.941625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.941684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.941687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.941775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.941849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.941927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.942008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.942072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.942075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.942167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.942244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.942325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.942403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.942463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.942466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.942561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.942636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.942720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.942804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.942863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.942866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.942969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.943053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.943138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.943226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.943396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.943406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.943512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.943581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.943666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.943731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.943800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.943810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.943883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:28.943960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:28.944029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:28.944097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:28.944164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:28.944168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:28.944227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:28.944316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:28.944336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:28.944339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:28.944371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:28.944385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:28.944388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:28.944397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:28.944399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:28.944865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:28.944898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:28.944904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:28.944908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:28.944911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:28.944914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:28.945467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:28.945497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:28.945504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:28.945508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:28.945511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:28.945517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:28.946177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:28.946200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:28.946205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:28.946207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:28.946210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:28.948813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:28.948839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:28.948853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392508948
2025-10-02T08:08:28.949073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:28.949094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:28.949101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:28.949105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:28.949109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:28.949115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:28.949718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:28.949751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:28.949757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:28.949760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:28.949762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:28.949765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:28.950266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:28.950292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:28.950305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:28.950311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:28.950315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:28.950319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:28.951017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:28.951050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:28.951057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:28.952495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:28.952520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:28.952526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:28.952530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:28.952544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392508952
2025-10-02T08:08:28.952925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:28.952954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:28.952962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:28.952965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:28.952968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:28.952971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:28.953567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:28.953592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:28.953599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:28.953604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:28.953607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:28.953613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:28.954195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:28.954221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:28.954355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392508953
2025-10-02T08:08:28.955184Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:28.955200Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:28.955205Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:28.955209Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:28.956891Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:28.956901Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:28.956903Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:28.956911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533284085785225:5574]
2025-10-02T08:08:28.956915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533284085785225:5574]
2025-10-02T08:08:28.956968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:28.956975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:28.956978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:28.957118Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:28.957440Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:28.957465Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:28.968878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533284085785261:5300]
2025-10-02T08:08:28.968982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 333, pipe: [1:7556533284085785261:5300]
2025-10-02T08:08:29.099151Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:29.099608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533284085785261:5300], now have 1 active actors on pipe
2025-10-02T08:08:29.099767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533284085785261:5300]
2025-10-02T08:08:29.099962Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:29.100366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:29.100410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 334 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0
2025-10-02T08:08:29.100653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 334 sessionId: src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0 is DEAD
2025-10-02T08:08:29.100737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:29.100761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0] Write session will restart in 0.005844s
2025-10-02T08:08:29.100788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0] Write session: Do CDS request
2025-10-02T08:08:29.100796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:29.100910Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:29.111693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.112075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:29.112097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 335
2025-10-02T08:08:29.116986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.117237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:29.117250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:29.117256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:29.117952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 335 sessionId:  describe result for acl check
2025-10-02T08:08:29.117988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:29.117989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:29.117991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:29.117997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533288380752822:5581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:29.118909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533288380752822:5581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:29.123971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533288380752822:5581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:29.127350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:29.128089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:29.128324Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:29.128329Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:29.128341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:29.128398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:29.128442Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533288380752917:5580]
2025-10-02T08:08:29.129343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:29.130276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:29.130332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:29.130676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:29.130725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.130727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.130728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.130730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.130731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.130738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.130750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.130754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.130757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.130761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.130767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.130775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.130781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.130787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.130790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.130796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.130802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.130807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.130812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.130817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.130836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:29.131206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533288380752822:5581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:29.131214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533288380752822:5581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:29.131217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533288380752822:5581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:29.131228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:29.144229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:29.146519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:29.146547Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:29.146550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:29.146554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:29.146562Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 334 [1:7556533288380752917:5580]
2025-10-02T08:08:29.146574Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:29.146591Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:29.146594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.146597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.146600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.146616Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:29.146622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:29.146629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:29.146702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.146704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.146708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:29.146711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:29.146785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:29.146788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.146803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.146818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:29.146849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380752933:5581], now have 1 active actors on pipe
2025-10-02T08:08:29.146856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533288380752911:5580]
2025-10-02T08:08:29.146859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533288380752911:5580]
2025-10-02T08:08:29.146866Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:29.146877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533288841106081:2378], now have 1 active actors on pipe
2025-10-02T08:08:29.146879Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:29.146881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 334
2025-10-02T08:08:29.146885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:29.146885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:29.146900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:29.146903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:29.146912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.146916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.146959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533288380752911:5580]
2025-10-02T08:08:29.146977Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:29.146984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:29.146994Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:29.147004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.147008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.147010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:29.147019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.147028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:29.147067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.147155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.147166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.147181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.147219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 335 partition: 0 MaxSeqNo: 17 sessionId: src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0
2025-10-02T08:08:29.147627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfbcf2f7-726fb27f-e1a1f38c-a5c9247e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:29.150645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0] Write session: try to update token
2025-10-02T08:08:29.150679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:29.152050Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 334
2025-10-02T08:08:29.165253Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:29.165278Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:29.165281Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:29.165290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533288380752911:5580]
2025-10-02T08:08:29.165295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533288380752911:5580]
2025-10-02T08:08:29.165342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:29.165349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.165351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:29.165429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:29.165436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:29.165509Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:29.179505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId: src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:29.182819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:29.200283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533288380752949:5300]
2025-10-02T08:08:29.200447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 334, pipe: [1:7556533288380752949:5300]
2025-10-02T08:08:29.318034Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:29.318333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.318351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.318373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380752949:5300], now have 1 active actors on pipe
2025-10-02T08:08:29.320527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533288380752949:5300]
2025-10-02T08:08:29.320544Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:29.320557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:29.320560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:29.320639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 335 reason: error at write: Disconnected sessionId: src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0
2025-10-02T08:08:29.320825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 335 sessionId: src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0 is DEAD
2025-10-02T08:08:29.321157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:29.321168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0] Write session will restart in 0.008021s
2025-10-02T08:08:29.321191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0] Write session: Do CDS request
2025-10-02T08:08:29.321122Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:29.321208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:29.336434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.338125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:29.339163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:29.339178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 336
2025-10-02T08:08:29.339515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.339565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:29.339580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:29.339584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:29.339762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:29.339979Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:29.339990Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:29.340002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:29.340055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:29.340099Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533288380753296:5587]
2025-10-02T08:08:29.340139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 336 sessionId:  describe result for acl check
2025-10-02T08:08:29.340189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:29.340201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:29.340203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:29.340208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533288380753299:5589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:29.340714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:29.340865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533288380753299:5589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:29.340941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:29.340988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:29.341299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:29.341354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.341360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.341361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.341362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.341363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.341368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.341378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.341386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.341390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.341397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.341403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.341414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.341421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.341426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.341449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.341458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.341462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.341467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.341471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.341476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.341494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:29.345694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533288380753299:5589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:29.350330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533288380753299:5589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:29.350348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533288380753299:5589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:29.350352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533288380753299:5589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:29.350361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:29.352750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:29.354489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:29.354505Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:29.354507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:29.354511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:29.354518Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 335 [1:7556533288380753296:5587]
2025-10-02T08:08:29.354529Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:29.354546Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:29.354549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.354552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.354554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.354569Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:29.354581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:29.354587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:29.354647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.354655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.354657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:29.354660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:29.354717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:29.354723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.354736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.354757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:29.354780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380753342:5589], now have 1 active actors on pipe
2025-10-02T08:08:29.354788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533288841106099:2378], now have 1 active actors on pipe
2025-10-02T08:08:29.354794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533288380753288:5587]
2025-10-02T08:08:29.354796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533288380753288:5587]
2025-10-02T08:08:29.354812Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:29.354828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:29.354845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:29.354851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:29.354884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533288380753288:5587]
2025-10-02T08:08:29.354891Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:29.354920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 335
2025-10-02T08:08:29.354922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.354926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.354928Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:29.354938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:29.354952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:29.354952Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d32ee6d2-327d975a-283024ab-85717c70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:29.354958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.354964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.354966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:29.354896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 335
2025-10-02T08:08:29.354974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.354988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:29.355019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.355186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.355201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.355227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.355277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 336 partition: 0 MaxSeqNo: 17 sessionId: src_id|d32ee6d2-327d975a-283024ab-85717c70_0
2025-10-02T08:08:29.355793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|502a8a32-1fc6212f-fbc76479-b6d72a10_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d32ee6d2-327d975a-283024ab-85717c70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:29.358688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32ee6d2-327d975a-283024ab-85717c70_0] Write session: try to update token
2025-10-02T08:08:29.358714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32ee6d2-327d975a-283024ab-85717c70_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:29.369151Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:29.369171Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:29.369179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533288380753288:5587]
2025-10-02T08:08:29.369222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:29.369222Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:29.369413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:29.369577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:29.369718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:29.369876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:29.370093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:29.370130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:29.385340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId: src_id|d32ee6d2-327d975a-283024ab-85717c70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:29.388647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:29.389026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.389050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.389070Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:29.389072Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:29.389075Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:29.389083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533288380753288:5587]
2025-10-02T08:08:29.389087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533288380753288:5587]
2025-10-02T08:08:29.389121Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:29.389132Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:29.389137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:29.389145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.389152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:29.389289Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:29.420908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533288380753362:5300]
2025-10-02T08:08:29.421083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 335, pipe: [1:7556533288380753362:5300]
2025-10-02T08:08:29.535872Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:29.536314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:29.536345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380753362:5300], now have 1 active actors on pipe
2025-10-02T08:08:29.536383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:29.536468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:29.536477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:29.536495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 336 reason: error at write: Disconnected sessionId: src_id|d32ee6d2-327d975a-283024ab-85717c70_0
2025-10-02T08:08:29.536638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 336 sessionId: src_id|d32ee6d2-327d975a-283024ab-85717c70_0 is DEAD
2025-10-02T08:08:29.536766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533288380753362:5300]
2025-10-02T08:08:29.536624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:29.536965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32ee6d2-327d975a-283024ab-85717c70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:29.536981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32ee6d2-327d975a-283024ab-85717c70_0] Write session will restart in 0.009117s
2025-10-02T08:08:29.537028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32ee6d2-327d975a-283024ab-85717c70_0] Write session: Do CDS request
2025-10-02T08:08:29.537038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32ee6d2-327d975a-283024ab-85717c70_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:29.547950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32ee6d2-327d975a-283024ab-85717c70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.549190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:29.549207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 337
2025-10-02T08:08:29.549488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:29.550849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:29.551089Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:29.551102Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:29.551114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:29.551172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:29.551212Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533288380753711:5602]
2025-10-02T08:08:29.551794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:29.552024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:29.552077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:29.552324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:29.552373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.552379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.552380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.552381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.552382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.552386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.552396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.552399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.552403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.552406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.552411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.552418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.552424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.552435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.552438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.552441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.552443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.552446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.552449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.552452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.552464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:29.552509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.552543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:29.552549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:29.552552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:29.552826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 337 sessionId:  describe result for acl check
2025-10-02T08:08:29.552856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:29.552862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:29.552864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:29.552870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533288380753726:5604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:29.553362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533288380753726:5604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:29.558690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533288380753726:5604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:29.562022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:29.562739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533288380753726:5604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:29.562753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533288380753726:5604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:29.562756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533288380753726:5604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:29.562765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:29.563673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:29.563693Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:29.563695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:29.563699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:29.563704Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 336 [1:7556533288380753711:5602]
2025-10-02T08:08:29.563714Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:29.563729Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:29.563732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.563734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.563736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.563751Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:29.563756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:29.563761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:29.563816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.563825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.563827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:29.563830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:29.563889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:29.563896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.563908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.563919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:29.563945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533288380753705:5602]
2025-10-02T08:08:29.563947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533288380753705:5602]
2025-10-02T08:08:29.563953Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:29.563963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:29.563966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533288841106108:2378], now have 1 active actors on pipe
2025-10-02T08:08:29.563973Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:29.563973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:29.563985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:29.563988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:29.564016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533288380753705:5602]
2025-10-02T08:08:29.564023Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:29.564045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:29.564290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 336
2025-10-02T08:08:29.564305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380753757:5604], now have 1 active actors on pipe
2025-10-02T08:08:29.564309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.564314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.564334Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|658036b0-ae6fc390-f88bd286-45202afb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:29.564340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.564343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.564345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:29.564353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.564367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:29.564310Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 336
2025-10-02T08:08:29.564391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.564546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.564555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.564568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.564711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 337 partition: 0 MaxSeqNo: 17 sessionId: src_id|658036b0-ae6fc390-f88bd286-45202afb_0
2025-10-02T08:08:29.565149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32ee6d2-327d975a-283024ab-85717c70_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|658036b0-ae6fc390-f88bd286-45202afb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:29.568005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658036b0-ae6fc390-f88bd286-45202afb_0] Write session: try to update token
2025-10-02T08:08:29.568030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658036b0-ae6fc390-f88bd286-45202afb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:29.585907Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:29.585926Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:29.585929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:29.585937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533288380753705:5602]
2025-10-02T08:08:29.585941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533288380753705:5602]
2025-10-02T08:08:29.585985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:29.585986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:29.585991Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:29.585994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.585996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:29.586199Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:29.591427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId: src_id|658036b0-ae6fc390-f88bd286-45202afb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:29.594404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:29.637658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533288380753787:5300]
2025-10-02T08:08:29.637812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 336, pipe: [1:7556533288380753787:5300]
2025-10-02T08:08:29.739730Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:29.740383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.740400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.740441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380753787:5300], now have 1 active actors on pipe
2025-10-02T08:08:29.740630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533288380753787:5300]
2025-10-02T08:08:29.740640Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:29.740657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:29.740723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 337 reason: status is not ok: tablet will be restarted right now sessionId: src_id|658036b0-ae6fc390-f88bd286-45202afb_0
2025-10-02T08:08:29.740785Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:29.740899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 337 sessionId: src_id|658036b0-ae6fc390-f88bd286-45202afb_0 is DEAD
2025-10-02T08:08:29.745087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658036b0-ae6fc390-f88bd286-45202afb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:29.745104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658036b0-ae6fc390-f88bd286-45202afb_0] Write session will restart in 0.007934s
2025-10-02T08:08:29.745133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658036b0-ae6fc390-f88bd286-45202afb_0] Write session: Do CDS request
2025-10-02T08:08:29.745141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658036b0-ae6fc390-f88bd286-45202afb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:29.754334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:29.755688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:29.755887Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:29.755901Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:29.755920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:29.755980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:29.756031Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533288380754130:5614]
2025-10-02T08:08:29.756648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:29.756874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:29.756916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:29.757201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:29.757253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.757259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.757260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.757261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.757262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.757266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.757275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.757278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.757281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.757284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.757289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.757301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.757309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.757313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.757317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.757322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.757326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.757335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.757339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.757344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.757362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:29.757448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658036b0-ae6fc390-f88bd286-45202afb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.757452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:29.757460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 338
2025-10-02T08:08:29.761078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.761136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:29.761142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:29.761146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:29.761689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 338 sessionId:  describe result for acl check
2025-10-02T08:08:29.761733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:29.761740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:29.761742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:29.761748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533288380754146:5616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:29.762318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533288380754146:5616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:29.764821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533288380754146:5616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:29.766017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:29.767770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:29.767789Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:29.767792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:29.767796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:29.767802Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 337 [1:7556533288380754130:5614]
2025-10-02T08:08:29.767814Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:29.767830Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:29.767833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.767835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.767838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.767851Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:29.767857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:29.767869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:29.767938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.767945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.767947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:29.767949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:29.768007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:29.768014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.768026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.768041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:29.768059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533288380754124:5614]
2025-10-02T08:08:29.768065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533288380754124:5614]
2025-10-02T08:08:29.768073Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:29.768085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:29.768100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:29.768102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:29.768104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:29.768111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:29.768134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533288380754124:5614]
2025-10-02T08:08:29.768141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:29.768143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:29.768150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533288841106138:2378], now have 1 active actors on pipe
2025-10-02T08:08:29.768572Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 337
2025-10-02T08:08:29.769929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658036b0-ae6fc390-f88bd286-45202afb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:29.772531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0] Write session: try to update token
2025-10-02T08:08:29.772557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:29.768945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533288380754146:5616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:29.768957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533288380754146:5616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:29.768962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533288380754146:5616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:29.768969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:29.769221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 337
2025-10-02T08:08:29.769229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380754182:5616], now have 1 active actors on pipe
2025-10-02T08:08:29.769235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.769240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.769264Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:29.769273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.769276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.769278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:29.769292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.769303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:29.769317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.769382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.769385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.769395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.769421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 338 partition: 0 MaxSeqNo: 17 sessionId: src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0
2025-10-02T08:08:29.788073Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:29.788095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:29.788097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:29.788105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533288380754124:5614]
2025-10-02T08:08:29.788109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533288380754124:5614]
2025-10-02T08:08:29.788152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:29.788151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:29.788157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:29.788158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.788160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:29.788333Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:29.796330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId: src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:29.799451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:29.840709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533288380754190:5300]
2025-10-02T08:08:29.845166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 337, pipe: [1:7556533288380754190:5300]
2025-10-02T08:08:29.946620Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:29.947109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.947124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.947146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380754190:5300], now have 1 active actors on pipe
2025-10-02T08:08:29.947286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533288380754190:5300]
2025-10-02T08:08:29.947319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:29.947326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:29.947395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 338 reason: error at write: Disconnected sessionId: src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0
2025-10-02T08:08:29.947397Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:29.947593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 338 sessionId: src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0 is DEAD
2025-10-02T08:08:29.948683Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:29.948918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:29.948934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0] Write session will restart in 0.007423s
2025-10-02T08:08:29.948962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0] Write session: Do CDS request
2025-10-02T08:08:29.948969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:29.957454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.957479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:29.957495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 339
2025-10-02T08:08:29.957771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:29.957809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:29.957814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:29.957817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:29.958465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 339 sessionId:  describe result for acl check
2025-10-02T08:08:29.958520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:29.958529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:29.958531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:29.958538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533288380754411:5622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:29.959324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533288380754411:5622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:29.963154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533288380754411:5622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:29.965722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:29.967661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:29.967997Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:29.968013Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:29.968032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:29.968112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:29.968170Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533288380754557:5621]
2025-10-02T08:08:29.968324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533288380754411:5622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:29.968339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533288380754411:5622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:29.968343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533288380754411:5622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:29.968354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:29.968987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:29.969299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:29.969368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:29.969762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:29.969852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.969859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.969861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.969862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.969864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.969871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.969883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.969888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.969893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.969896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.969904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.969914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:29.969930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.969940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:29.969946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.969955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:29.969961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.969972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.969977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.969989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.970017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:29.979047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:29.980764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:29.980789Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:29.980792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:29.980797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:29.980842Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 338 [1:7556533288380754557:5621]
2025-10-02T08:08:29.980855Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:29.980876Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:29.980885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.980898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.980900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.980920Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:29.981288Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 338
2025-10-02T08:08:29.980931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:29.980938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:29.981013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.981015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.981018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:29.981020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:29.981092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:29.981095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:29.981112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:29.981125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:29.981141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533288380754551:5621]
2025-10-02T08:08:29.981143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533288380754551:5621]
2025-10-02T08:08:29.981151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:29.981164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:29.981179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:29.981183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:29.981184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:29.981190Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:29.981195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533288380754562:5622], now have 1 active actors on pipe
2025-10-02T08:08:29.981232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533288841106146:2378], now have 1 active actors on pipe
2025-10-02T08:08:29.981235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533288380754551:5621]
2025-10-02T08:08:29.981247Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:29.981256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:29.981290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 338
2025-10-02T08:08:29.981500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.981525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.981577Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:29.981597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:29.981608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:29.981611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:29.981626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:29.981648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:29.981674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.981729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:29.981746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:29.981776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:29.981830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 339 partition: 0 MaxSeqNo: 17 sessionId: src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0
2025-10-02T08:08:29.982307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd61af4-d5246051-499b6ee4-2b3e7dab_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:29.984893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0] Write session: try to update token
2025-10-02T08:08:29.984914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:30.002467Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:30.002494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:30.002498Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:30.002510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533288380754551:5621]
2025-10-02T08:08:30.002515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533288380754551:5621]
2025-10-02T08:08:30.002566Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:30.002575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:30.002580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:30.002585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.002588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:30.002737Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:30.015666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId: src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:30.018630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:30.047558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533292675721885:5300]
2025-10-02T08:08:30.047694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 338, pipe: [1:7556533292675721885:5300]
2025-10-02T08:08:30.148949Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:30.149354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.149370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.149391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675721885:5300], now have 1 active actors on pipe
2025-10-02T08:08:30.149496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:30.149505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:30.149559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 339 reason: error at write: Disconnected sessionId: src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0
2025-10-02T08:08:30.149646Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:30.149748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 339 sessionId: src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0 is DEAD
2025-10-02T08:08:30.149890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:30.149911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0] Write session will restart in 0.008807s
2025-10-02T08:08:30.149939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0] Write session: Do CDS request
2025-10-02T08:08:30.149945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:30.149921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533292675721885:5300]
2025-10-02T08:08:30.149663Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:30.160605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.160734Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:30.160753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 340
2025-10-02T08:08:30.160964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.160998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:30.161006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:30.161009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:30.161361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 340 sessionId:  describe result for acl check
2025-10-02T08:08:30.161385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:30.161390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:30.161391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:30.161395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533292675722206:5628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:30.161802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533292675722206:5628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:30.163233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:30.163842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533292675722206:5628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:30.164584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:30.164914Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:30.164927Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:30.164940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:30.165007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:30.165051Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533292675722252:5627]
2025-10-02T08:08:30.165707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:30.165984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:30.166034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:30.166362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:30.166417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.166426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.166427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.166428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.166429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.166434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.166443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.166446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.166450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.166454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.166460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.166467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.166473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.166477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.166484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.166489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.166493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.166497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.166506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.166511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.166530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:30.167512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533292675722206:5628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:30.167527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533292675722206:5628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:30.167531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533292675722206:5628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:30.167540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:30.175572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:30.177424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:30.177448Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:30.177450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:30.177454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:30.177460Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 339 [1:7556533292675722252:5627]
2025-10-02T08:08:30.177473Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:30.177491Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:30.177494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.177497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.177500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.177529Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:30.177534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:30.177540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:30.177610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.177612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.177615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:30.177617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:30.177683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:30.177686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.177699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.177711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:30.177727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533292675722236:5627]
2025-10-02T08:08:30.177729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533292675722236:5627]
2025-10-02T08:08:30.177747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:30.177760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:30.177773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:30.177775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:30.177810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533292675722236:5627]
2025-10-02T08:08:30.177813Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:30.177825Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:30.177829Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:30.177835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:30.177932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 339
2025-10-02T08:08:30.177948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675722269:5628], now have 1 active actors on pipe
2025-10-02T08:08:30.177960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533293136073449:2378], now have 1 active actors on pipe
2025-10-02T08:08:30.177966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.177972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.178012Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:30.178020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.178027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.178030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:30.178043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.178074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:30.178093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.178191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.178199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.178215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.178263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 340 partition: 0 MaxSeqNo: 17 sessionId: src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0
2025-10-02T08:08:30.178459Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 339
2025-10-02T08:08:30.178726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a627b82-ccc0fa43-da0403d5-7f64f2db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:30.181544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0] Write session: try to update token
2025-10-02T08:08:30.181572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:30.198983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId: src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:30.200321Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:30.200335Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:30.200337Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:30.200346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533292675722236:5627]
2025-10-02T08:08:30.200350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533292675722236:5627]
2025-10-02T08:08:30.200396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:30.200398Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:30.200401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.200403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:30.200404Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:30.200597Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:30.202018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:30.250339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533292675722296:5300]
2025-10-02T08:08:30.250473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 339, pipe: [1:7556533292675722296:5300]
2025-10-02T08:08:30.345085Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:30.345398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.345411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.345449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675722296:5300], now have 1 active actors on pipe
2025-10-02T08:08:30.345594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:30.345607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:30.345672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 340 reason: error at write: Disconnected sessionId: src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0
2025-10-02T08:08:30.345745Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:30.345862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 340 sessionId: src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0 is DEAD
2025-10-02T08:08:30.346008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533292675722296:5300]
2025-10-02T08:08:30.346098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:30.346115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0] Write session will restart in 0.005849s
2025-10-02T08:08:30.346142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0] Write session: Do CDS request
2025-10-02T08:08:30.346154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:30.346530Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:30.353385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.353432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:30.353449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 341
2025-10-02T08:08:30.353769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.353837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:30.353849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:30.353855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:30.354569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 341 sessionId:  describe result for acl check
2025-10-02T08:08:30.354610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:30.354612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:30.354613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:30.354619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533292675722536:5635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:30.355180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533292675722536:5635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:30.357411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533292675722536:5635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:30.360307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:30.360702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533292675722536:5635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:30.360715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533292675722536:5635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:30.360718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533292675722536:5635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:30.360726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:30.361527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:30.361737Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:30.361749Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:30.361760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:30.361820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:30.361871Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533292675722676:5634]
2025-10-02T08:08:30.362497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:30.365138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:30.365214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:30.365578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:30.365649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.365657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.365658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.365659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.365660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.365667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.365676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.365680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.365683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.365686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.365693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.365700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.365710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.365715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.365721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.365726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.365731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.365736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.365740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.365745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.365763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:30.374398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:30.376943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:30.376966Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:30.376973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:30.376977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:30.376984Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 340 [1:7556533292675722676:5634]
2025-10-02T08:08:30.376996Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:30.377017Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:30.377023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.377027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.377029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.377047Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:30.377059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:30.377066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:30.377143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.377152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.377155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:30.377157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:30.377235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:30.377243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.377258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.377276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:30.377299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675722672:5635], now have 1 active actors on pipe
2025-10-02T08:08:30.377311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533292675722664:5634]
2025-10-02T08:08:30.377313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533292675722664:5634]
2025-10-02T08:08:30.377313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 340
2025-10-02T08:08:30.377321Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:30.377335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:30.377350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:30.377428Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 340
2025-10-02T08:08:30.377352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:30.377358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533293136073467:2378], now have 1 active actors on pipe
2025-10-02T08:08:30.377363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.377363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:30.377366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.377367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:30.377409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533292675722664:5634]
2025-10-02T08:08:30.377416Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:30.377430Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:30.377436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.377441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.377443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:30.377451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.377459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:30.377490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.377493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:30.377543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.377545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.377558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.377597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 341 partition: 0 MaxSeqNo: 17 sessionId: src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0
2025-10-02T08:08:30.378025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be4c0c19-ce0e4465-474dfed0-9b7ca407_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:30.380564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0] Write session: try to update token
2025-10-02T08:08:30.380587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:30.396059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId: src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:30.397196Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:30.397200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:30.397203Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:30.397215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533292675722664:5634]
2025-10-02T08:08:30.397221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533292675722664:5634]
2025-10-02T08:08:30.397281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:30.397290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.397289Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:30.397293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:30.397296Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:30.397452Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:30.398957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:30.445939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533292675722705:5300]
2025-10-02T08:08:30.446043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 340, pipe: [1:7556533292675722705:5300]
2025-10-02T08:08:30.544306Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:30.544642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.544658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.544710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675722705:5300], now have 1 active actors on pipe
2025-10-02T08:08:30.545033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533292675722705:5300]
2025-10-02T08:08:30.545071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:30.545074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:30.545154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 341 reason: error at write: Disconnected sessionId: src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0
2025-10-02T08:08:30.545325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 341 sessionId: src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0 is DEAD
2025-10-02T08:08:30.545489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:30.545501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0] Write session will restart in 0.006432s
2025-10-02T08:08:30.545526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0] Write session: Do CDS request
2025-10-02T08:08:30.545534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:30.545071Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:30.545974Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:30.553454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.553519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:30.553543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 342
2025-10-02T08:08:30.553876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.553913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:30.553918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:30.553921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:30.554335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 342 sessionId:  describe result for acl check
2025-10-02T08:08:30.554372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:30.554374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:30.554375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:30.554380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533292675722996:5642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:30.555068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533292675722996:5642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:30.557414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533292675722996:5642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:30.558329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:30.559340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:30.559533Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:30.559542Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:30.559551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:30.559603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:30.559641Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533292675723078:5641]
2025-10-02T08:08:30.560232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:30.560371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:30.560380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533292675722996:5642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:30.560387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533292675722996:5642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:30.560390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533292675722996:5642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:30.560397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:30.560407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:30.560679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:30.560722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.560730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.560731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.560732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.560733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.560738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.560746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.560750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.560754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.560758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.560762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.560769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.560774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.560779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.560783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.560788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.560792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.560797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.560817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.560822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.560839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:30.571262Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 341
2025-10-02T08:08:30.569079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:30.570981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:30.570987Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:30.570990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:30.570994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:30.571000Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 341 [1:7556533292675723078:5641]
2025-10-02T08:08:30.571010Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:30.571024Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:30.571027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.571030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.571032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.571046Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:30.571051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:30.571057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:30.571113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.571115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.571118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:30.571121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:30.571190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 341
2025-10-02T08:08:30.571201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:30.571204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.571217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.571229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:30.571247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675723089:5642], now have 1 active actors on pipe
2025-10-02T08:08:30.571253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.571257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.571270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533293136073476:2378], now have 1 active actors on pipe
2025-10-02T08:08:30.571276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533292675723068:5641]
2025-10-02T08:08:30.571279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533292675723068:5641]
2025-10-02T08:08:30.571285Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:30.571296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:30.571308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:30.571310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:30.571311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:30.571314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:30.571329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:30.571334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.571338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.571340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:30.571347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.571356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:30.571394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533292675723068:5641]
2025-10-02T08:08:30.571404Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:30.571410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:30.571416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.571532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.571539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.571564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.571598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 342 partition: 0 MaxSeqNo: 17 sessionId: src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0
2025-10-02T08:08:30.572041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316a3e1-2e680b68-46ae2d23-383b6ec6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:30.575194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0] Write session: try to update token
2025-10-02T08:08:30.575214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:30.590400Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:30.590420Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:30.590423Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:30.590432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533292675723068:5641]
2025-10-02T08:08:30.590436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533292675723068:5641]
2025-10-02T08:08:30.590485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:30.590495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.590497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:30.590651Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:30.592300Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:30.592305Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:30.610542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId: src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:30.613198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:30.645086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533292675723137:5300]
2025-10-02T08:08:30.645219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 341, pipe: [1:7556533292675723137:5300]
2025-10-02T08:08:30.739249Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:30.739615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.739632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.739653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675723137:5300], now have 1 active actors on pipe
2025-10-02T08:08:30.740491Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:30.740525Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:30.741039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533292675723137:5300]
2025-10-02T08:08:30.741055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:30.741106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 342 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0
2025-10-02T08:08:30.741272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 342 sessionId: src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0 is DEAD
2025-10-02T08:08:30.741453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:30.741464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0] Write session will restart in 0.007351s
2025-10-02T08:08:30.741491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0] Write session: Do CDS request
2025-10-02T08:08:30.741497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:30.750314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.751025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:30.751041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 343
2025-10-02T08:08:30.751136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.751165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:30.751172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:30.751174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:30.751505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 343 sessionId:  describe result for acl check
2025-10-02T08:08:30.751539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:30.751540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:30.751541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:30.751545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533292675723381:5660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:30.751957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533292675723381:5660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:30.756741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:30.756858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533292675723381:5660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:30.758098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:30.758264Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:30.758272Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:30.758279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:30.758314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:30.758340Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533292675723518:5659]
2025-10-02T08:08:30.758768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:30.758953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:30.758982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:30.759230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:30.759269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.759273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.759274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.759275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.759276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.759279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.759285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.759287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.759289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.759291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.759295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.759300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.759303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.759306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.759309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.759311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.759314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.759317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.759320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.759322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.759333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:30.761532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533292675723381:5660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:30.761549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533292675723381:5660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:30.761552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533292675723381:5660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:30.761561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:30.767703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:30.769617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:30.769638Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:30.769640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:30.769644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:30.769651Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 342 [1:7556533292675723518:5659]
2025-10-02T08:08:30.769662Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:30.769680Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:30.769683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.769686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.769688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.769705Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:30.769710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:30.769720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:30.769788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.769790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.769793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:30.769795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:30.769870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:30.769872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.769887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.769899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:30.769916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533292675723502:5659]
2025-10-02T08:08:30.769917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533292675723502:5659]
2025-10-02T08:08:30.769924Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:30.769938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:30.769952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:30.769955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:30.769976Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:30.769980Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:30.769982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 342
2025-10-02T08:08:30.769997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675723535:5660], now have 1 active actors on pipe
2025-10-02T08:08:30.770000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533292675723502:5659]
2025-10-02T08:08:30.770003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:30.770011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533293136073496:2378], now have 1 active actors on pipe
2025-10-02T08:08:30.770200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.770201Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:30.770213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.770236Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1461d75-44819e85-b1d332db-f0b50319_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:30.770246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.770249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.770251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:30.770257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.770272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:30.770289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.770349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.770357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.770368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.770396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 343 partition: 0 MaxSeqNo: 17 sessionId: src_id|b1461d75-44819e85-b1d332db-f0b50319_0
2025-10-02T08:08:30.770716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff1ec61-6b823817-ad75f591-d108ab8a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b1461d75-44819e85-b1d332db-f0b50319_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:30.770734Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 342
2025-10-02T08:08:30.773832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1461d75-44819e85-b1d332db-f0b50319_0] Write session: try to update token
2025-10-02T08:08:30.773846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1461d75-44819e85-b1d332db-f0b50319_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:30.788589Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:30.788606Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:30.788608Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:30.788618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533292675723502:5659]
2025-10-02T08:08:30.788622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533292675723502:5659]
2025-10-02T08:08:30.788665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:30.788666Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:30.788672Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:30.788672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.788675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:30.788864Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:30.795887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId: src_id|b1461d75-44819e85-b1d332db-f0b50319_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:30.798860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:30.841148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533292675723550:5300]
2025-10-02T08:08:30.841276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 342, pipe: [1:7556533292675723550:5300]
2025-10-02T08:08:30.930719Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:30.931760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1461d75-44819e85-b1d332db-f0b50319_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:30.931776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1461d75-44819e85-b1d332db-f0b50319_0] Write session will restart in 0.008506s
2025-10-02T08:08:30.931803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1461d75-44819e85-b1d332db-f0b50319_0] Write session: Do CDS request
2025-10-02T08:08:30.931811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1461d75-44819e85-b1d332db-f0b50319_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:30.931047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.931064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.931084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675723550:5300], now have 1 active actors on pipe
2025-10-02T08:08:30.931240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533292675723550:5300]
2025-10-02T08:08:30.931261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:30.931263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:30.931292Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:30.931344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 343 reason: error at write: Disconnected sessionId: src_id|b1461d75-44819e85-b1d332db-f0b50319_0
2025-10-02T08:08:30.931549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 343 sessionId: src_id|b1461d75-44819e85-b1d332db-f0b50319_0 is DEAD
2025-10-02T08:08:30.932617Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:30.941441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1461d75-44819e85-b1d332db-f0b50319_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.941816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:30.941832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 344
2025-10-02T08:08:30.941995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:30.942027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:30.942037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:30.942040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:30.942582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 344 sessionId:  describe result for acl check
2025-10-02T08:08:30.942619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:30.942627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:30.942629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:30.942636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533292675723784:5667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:30.943200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533292675723784:5667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:30.948545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533292675723784:5667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:30.950937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:30.952135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:30.952458Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:30.952463Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:30.952476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:30.952535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:30.952573Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533292675723927:5666]
2025-10-02T08:08:30.953230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:30.953443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:30.953495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:30.953834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:30.953889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.953891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.953892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.953893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.953894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.953899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.953909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.953913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.953917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.953920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.953926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.953934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:30.953940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.953945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:30.953952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.953957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:30.953962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.953969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.953973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.953978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.953997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:30.954985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533292675723784:5667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:30.954998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533292675723784:5667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:30.955001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533292675723784:5667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:30.955011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:30.963451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:30.965371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:30.965398Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:30.965401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:30.965405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:30.965414Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 343 [1:7556533292675723927:5666]
2025-10-02T08:08:30.965426Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:30.965444Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:30.965447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.965451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.965453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.965472Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:30.965483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:30.965493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:30.965569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.965576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.965579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:30.965583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:30.965650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:30.965658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.965673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:30.965690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:30.965707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533292675723921:5666]
2025-10-02T08:08:30.965715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533292675723921:5666]
2025-10-02T08:08:30.965724Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:30.965742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533292675723944:5667], now have 1 active actors on pipe
2025-10-02T08:08:30.965753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:30.965755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:30.965758Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:30.965767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:30.965774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:30.965811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533293136073514:2378], now have 1 active actors on pipe
2025-10-02T08:08:30.965823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533292675723921:5666]
2025-10-02T08:08:30.965825Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:30.965911Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:30.965961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 343
2025-10-02T08:08:30.966062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.966082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.966111Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:30.966120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:30.966127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:30.966130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:30.966141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:30.966152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:30.966170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.966206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:30.966215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:30.966227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:30.966262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 344 partition: 0 MaxSeqNo: 17 sessionId: src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0
2025-10-02T08:08:30.966415Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 343
2025-10-02T08:08:30.967573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1461d75-44819e85-b1d332db-f0b50319_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:30.970613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0] Write session: try to update token
2025-10-02T08:08:30.970642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:30.990445Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:30.990466Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:30.990469Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:30.990482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533292675723921:5666]
2025-10-02T08:08:30.990486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533292675723921:5666]
2025-10-02T08:08:30.990541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:30.990548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:30.990550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:30.990552Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:30.990559Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:30.990731Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:31.003722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId: src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:31.006765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:31.029151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533296970691256:5300]
2025-10-02T08:08:31.029285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 343, pipe: [1:7556533296970691256:5300]
2025-10-02T08:08:31.142070Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:31.142388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.142399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.142415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970691256:5300], now have 1 active actors on pipe
2025-10-02T08:08:31.142544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533296970691256:5300]
2025-10-02T08:08:31.142561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:31.142563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:31.142608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 344 reason: error at write: Disconnected sessionId: src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0
2025-10-02T08:08:31.142668Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:31.142679Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:31.142772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 344 sessionId: src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0 is DEAD
2025-10-02T08:08:31.143611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:31.143624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0] Write session will restart in 0.005493s
2025-10-02T08:08:31.143646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0] Write session: Do CDS request
2025-10-02T08:08:31.143652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:31.152086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:31.152186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:31.152223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 345
2025-10-02T08:08:31.152454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:31.152497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:31.152504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:31.152509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:31.153187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 345 sessionId:  describe result for acl check
2025-10-02T08:08:31.153236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:31.153238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:31.153240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:31.153248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533296970691294:5673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:31.155061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533296970691294:5673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:31.158304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533296970691294:5673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:31.161801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533296970691294:5673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:31.161820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533296970691294:5673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:31.161824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533296970691294:5673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:31.161833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:31.163031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:31.164297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:31.164479Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:31.164488Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:31.164499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:31.164555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:31.164597Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533296970691639:5672]
2025-10-02T08:08:31.165273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:31.165623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:31.165670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:31.165979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:31.166036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.166037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.166038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.166039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.166040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.166045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.166054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.166058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.166061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.166065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.166070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.166077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.166083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.166088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.166092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.166096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.166100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.166104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.166108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.166113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.166130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:31.174804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:31.176753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:31.176773Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:31.176776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:31.176779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:31.176786Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 344 [1:7556533296970691639:5672]
2025-10-02T08:08:31.176799Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:31.176832Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:31.176836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.176840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.176842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.176858Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:31.176863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:31.176869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:31.176947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.176950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.176954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:31.176956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:31.177026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:31.177030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.177046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.177062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:31.177079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533296970691633:5672]
2025-10-02T08:08:31.177082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533296970691633:5672]
2025-10-02T08:08:31.177096Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:31.177108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:31.177121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:31.177124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:31.177160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533296970691633:5672]
2025-10-02T08:08:31.177162Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:31.177208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:31.177212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:31.177220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:31.177328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 344
2025-10-02T08:08:31.177343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970691618:5673], now have 1 active actors on pipe
2025-10-02T08:08:31.177352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533297431040817:2378], now have 1 active actors on pipe
2025-10-02T08:08:31.177358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.177364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.177391Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:31.177408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.177411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.177413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:31.177423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.177438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:31.177459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:31.177495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.177501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.177526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:31.177564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 345 partition: 0 MaxSeqNo: 17 sessionId: src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0
2025-10-02T08:08:31.178938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5373598f-ab81fd1c-27c31d89-dd1352e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:31.177447Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 344
2025-10-02T08:08:31.182359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0] Write session: try to update token
2025-10-02T08:08:31.182378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:31.203948Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:31.203971Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:31.203974Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:31.203983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533296970691633:5672]
2025-10-02T08:08:31.203989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533296970691633:5672]
2025-10-02T08:08:31.204038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:31.204045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.204048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:31.204053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:31.204060Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:31.204238Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:31.208913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId: src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:31.212194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:31.244108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533296970691677:5300]
2025-10-02T08:08:31.244501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 344, pipe: [1:7556533296970691677:5300]
2025-10-02T08:08:31.361426Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:31.361887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.361909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.361958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970691677:5300], now have 1 active actors on pipe
2025-10-02T08:08:31.362473Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:31.363240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:31.363260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0] Write session will restart in 0.009291s
2025-10-02T08:08:31.363290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0] Write session: Do CDS request
2025-10-02T08:08:31.363298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:31.362191Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:31.362525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533296970691677:5300]
2025-10-02T08:08:31.362540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:31.362597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 345 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0
2025-10-02T08:08:31.362810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 345 sessionId: src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0 is DEAD
2025-10-02T08:08:31.374516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:31.378667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:31.378682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 346
2025-10-02T08:08:31.378820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:31.378859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:31.378870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:31.378873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:31.379297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 346 sessionId:  describe result for acl check
2025-10-02T08:08:31.379338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:31.379345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:31.379347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:31.379353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533296970692015:5680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:31.379883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533296970692015:5680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:31.381695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:31.382198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533296970692015:5680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:31.382740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:31.382935Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:31.382944Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:31.382955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:31.383004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:31.383039Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533296970692058:5679]
2025-10-02T08:08:31.383764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:31.384054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:31.384126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:31.384560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:31.384635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.384636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.384638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.384639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.384640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.384645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.384655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.384658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.384662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.384665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.384671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.384678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.384684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.384689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.384694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.384699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.384704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.384708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.384712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.384718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.384736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:31.393699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533296970692015:5680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:31.393720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533296970692015:5680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:31.393724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533296970692015:5680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:31.393733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:31.399051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:31.401656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:31.401679Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:31.401682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:31.401686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:31.401694Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 345 [1:7556533296970692058:5679]
2025-10-02T08:08:31.401707Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:31.401724Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:31.401728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.401731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.401738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.401754Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:31.401760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:31.401766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:31.401841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.401850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.401853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:31.401856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:31.401932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:31.401940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.401956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.401972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:31.401995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533296970692045:5679]
2025-10-02T08:08:31.402000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533296970692045:5679]
2025-10-02T08:08:31.402013Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:31.402029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:31.402048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:31.402055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:31.402092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533296970692045:5679]
2025-10-02T08:08:31.402099Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:31.402230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:31.402240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:31.402246Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:31.402252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533297431040838:2378], now have 1 active actors on pipe
2025-10-02T08:08:31.402340Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 345
2025-10-02T08:08:31.402383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 345
2025-10-02T08:08:31.402398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970692080:5680], now have 1 active actors on pipe
2025-10-02T08:08:31.402408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.402414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.402447Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:31.402458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.402467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.402469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:31.402478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.402494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:31.402516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:31.402716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.402725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.402741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:31.402778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 346 partition: 0 MaxSeqNo: 17 sessionId: src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0
2025-10-02T08:08:31.403177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56aacdb2-f311b5fb-2f18af12-2ed381f1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:31.406414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0] Write session: try to update token
2025-10-02T08:08:31.406433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:31.423842Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:31.423864Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:31.423874Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533296970692045:5679]
2025-10-02T08:08:31.423932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:31.423948Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:31.424126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:31.424289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:31.424425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:31.424582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:31.425000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:31.425044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:31.430743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId: src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:31.434151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:31.434616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.434632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.434668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:31.434697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:31.434938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.434946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.435151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.435224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.435301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.435414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.435473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.435486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.435559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.435644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.435726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.435801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.435848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.435851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.435930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.436002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.436079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.436148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.436205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.436208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.436277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.436348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.436413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.436491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.436558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.436561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.436633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.436697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.436775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.436921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.436984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.436987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.437060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.437123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.437184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.437245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.437295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.437298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.437373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.437443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.437515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.437587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.437633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.437637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.437714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.437781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.437855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.437926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.437977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.437980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.438055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.438123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.438193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.438260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.438306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.438309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.438386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:31.438449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:31.438519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:31.438592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:31.438637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:31.438640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:31.438714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:31.438774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.438792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.438795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:31.438830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:31.438843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:31.438847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:31.438850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:31.438852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:31.439303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:31.439322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:31.439330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:31.439334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:31.439336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:31.439339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:31.440050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:31.440064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:31.440073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:31.440076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:31.440080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:31.440083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:31.441089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:31.441111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:31.441117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:31.441121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:31.441124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:31.443576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:31.443585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:31.443598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392511443
2025-10-02T08:08:31.443723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:31.443731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:31.443737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:31.443741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:31.443746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:31.443749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:31.444362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:31.444378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:31.444384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:31.444388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:31.444391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:31.444395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:31.445152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:31.445176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:31.445185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:31.445191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:31.445195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:31.445199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:31.445757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:31.445773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:31.445778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:31.447038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:31.447046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:31.447051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:31.447054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:31.447063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392511446
2025-10-02T08:08:31.447422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:31.447434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:31.447441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:31.447444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:31.447447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:31.447451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:31.448038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:31.448052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:31.448057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:31.448062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:31.448065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:31.448071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:31.448590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:31.448602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.448709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392511448
2025-10-02T08:08:31.451453Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:31.451489Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:31.451495Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:31.451501Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:31.451515Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:31.451517Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:31.451520Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:31.451530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533296970692045:5679]
2025-10-02T08:08:31.451534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533296970692045:5679]
2025-10-02T08:08:31.451604Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:31.451613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:31.451625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:31.451629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.451631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:31.451783Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:31.462757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533296970692097:5300]
2025-10-02T08:08:31.462948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 345, pipe: [1:7556533296970692097:5300]
2025-10-02T08:08:31.602326Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:31.602686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970692097:5300], now have 1 active actors on pipe
2025-10-02T08:08:31.603069Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:31.602905Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:31.603234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533296970692097:5300]
2025-10-02T08:08:31.603253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:31.603274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 346 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0
2025-10-02T08:08:31.603425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 346 sessionId: src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0 is DEAD
2025-10-02T08:08:31.605396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:31.605414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0] Write session will restart in 0.008311s
2025-10-02T08:08:31.605443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0] Write session: Do CDS request
2025-10-02T08:08:31.605451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:31.609674Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [18821238c3b98cd0] Result# TEvPutResult {Id# [72075186224037892:345:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:31.609721Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:345:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:31.609745Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:345:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:31.616453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:31.616939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:31.616953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 347
2025-10-02T08:08:31.617618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:31.617655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:31.617661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:31.617665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:31.618085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 347 sessionId:  describe result for acl check
2025-10-02T08:08:31.618117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:31.618119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:31.618121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:31.618126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533296970692439:5687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:31.618670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533296970692439:5687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:31.619440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:31.621188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:31.621404Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:31.621408Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:31.621417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:31.621492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:31.621527Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533296970692479:5686]
2025-10-02T08:08:31.622174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:31.622589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:31.622621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:31.622834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533296970692439:5687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:31.622839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:31.622863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.622863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.622864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.622865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.622865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.622868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.622874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.622876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.622878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.622880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.622883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.622888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.622895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.622898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.622900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.622903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.622905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.622907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.622910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.622912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.622923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:31.637888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:31.639777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:31.639800Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:31.639804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:31.639809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:31.639821Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 346 [1:7556533296970692479:5686]
2025-10-02T08:08:31.639836Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:31.639860Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:31.639867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.639870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.639872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.639891Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:31.639901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:31.639907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:31.639984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.639993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.639996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:31.639998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:31.640058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:31.640069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.640082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.640095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:31.640113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533297431040846:2378], now have 1 active actors on pipe
2025-10-02T08:08:31.640118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533296970692457:5686]
2025-10-02T08:08:31.640120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533296970692457:5686]
2025-10-02T08:08:31.640127Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:31.640140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:31.640153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:31.640157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:31.640189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533296970692457:5686]
2025-10-02T08:08:31.640191Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:31.640217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:31.640219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:31.640225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:31.640488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533296970692439:5687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:31.640494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533296970692439:5687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:31.640497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533296970692439:5687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:31.640505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:31.640838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 346
2025-10-02T08:08:31.640867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 346
2025-10-02T08:08:31.640883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970692520:5687], now have 1 active actors on pipe
2025-10-02T08:08:31.640888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.640892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.640921Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6582d65-5692a288-8985a348-bb8b237_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:31.640928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.640931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.640933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:31.640942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.640952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:31.640968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:31.640998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.641000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.641014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:31.641036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 347 partition: 0 MaxSeqNo: 17 sessionId: src_id|b6582d65-5692a288-8985a348-bb8b237_0
2025-10-02T08:08:31.641448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec00c2f-4f8ac560-4b4d86c7-ab8e54a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b6582d65-5692a288-8985a348-bb8b237_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:31.645147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6582d65-5692a288-8985a348-bb8b237_0] Write session: try to update token
2025-10-02T08:08:31.645176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6582d65-5692a288-8985a348-bb8b237_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:31.659236Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:31.659261Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:31.659264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:31.659272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533296970692457:5686]
2025-10-02T08:08:31.659276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533296970692457:5686]
2025-10-02T08:08:31.659320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:31.659326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.659328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:31.659513Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:31.660438Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:31.660446Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:31.682421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId: src_id|b6582d65-5692a288-8985a348-bb8b237_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:31.701639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:31.703002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533296970692546:5300]
2025-10-02T08:08:31.703205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 346, pipe: [1:7556533296970692546:5300]
2025-10-02T08:08:31.825780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:31.825133Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:31.825454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.825463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.825483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970692546:5300], now have 1 active actors on pipe
2025-10-02T08:08:31.825617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533296970692546:5300]
2025-10-02T08:08:31.825638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:31.825640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:31.825706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 347 reason: error at write: Disconnected sessionId: src_id|b6582d65-5692a288-8985a348-bb8b237_0
2025-10-02T08:08:31.825919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 347 sessionId: src_id|b6582d65-5692a288-8985a348-bb8b237_0 is DEAD
2025-10-02T08:08:31.826970Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:31.832939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6582d65-5692a288-8985a348-bb8b237_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:31.832956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6582d65-5692a288-8985a348-bb8b237_0] Write session will restart in 0.008952s
2025-10-02T08:08:31.832985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6582d65-5692a288-8985a348-bb8b237_0] Write session: Do CDS request
2025-10-02T08:08:31.832993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6582d65-5692a288-8985a348-bb8b237_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:31.842548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:31.843832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:31.844029Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:31.844039Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:31.844048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:31.844094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:31.844141Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533296970692910:5705]
2025-10-02T08:08:31.844373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6582d65-5692a288-8985a348-bb8b237_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:31.844414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:31.844429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 348
2025-10-02T08:08:31.844779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:31.845061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:31.845095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:31.845105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:31.845105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:31.845109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:31.845192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:31.845717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:31.845791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 348 sessionId:  describe result for acl check
2025-10-02T08:08:31.845801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.845803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.845804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.845806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.845808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.845811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:31.845813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:31.845814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:31.845817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.845818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533296970692922:5707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:31.845832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.845839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.845845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.845850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.845858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.845870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:31.845879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.845885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:31.845890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.845895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:31.845900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.845906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.845911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.845918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.845940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:31.846192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533296970692922:5707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:31.849293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533296970692922:5707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:31.853860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533296970692922:5707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:31.853882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533296970692922:5707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:31.853884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533296970692922:5707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:31.853892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:31.857816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:31.859444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:31.859461Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:31.859463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:31.859466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:31.859473Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 347 [1:7556533296970692910:5705]
2025-10-02T08:08:31.859480Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:31.859493Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:31.859495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.859497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.859498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.859509Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:31.859512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:31.859517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:31.859574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.859575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.859577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:31.859579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:31.859634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:31.859644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.859656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:31.859667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:31.859686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970692954:5707], now have 1 active actors on pipe
2025-10-02T08:08:31.859692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533296970692904:5705]
2025-10-02T08:08:31.859694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533296970692904:5705]
2025-10-02T08:08:31.859700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:31.859711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:31.859720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:31.859722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:31.859754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533296970692904:5705]
2025-10-02T08:08:31.859757Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:31.859776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533297431040877:2378], now have 1 active actors on pipe
2025-10-02T08:08:31.859778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:31.859781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:31.859785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:31.859796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 347
2025-10-02T08:08:31.859879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 347
2025-10-02T08:08:31.859934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.859945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.859973Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:31.859985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:31.859988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:31.859991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:31.859999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:31.860009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:31.860028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:31.860133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:31.860149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:31.860162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:31.860192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 348 partition: 0 MaxSeqNo: 17 sessionId: src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0
2025-10-02T08:08:31.861140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6582d65-5692a288-8985a348-bb8b237_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:31.864386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0] Write session: try to update token
2025-10-02T08:08:31.864410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:31.889585Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:31.889611Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:31.889613Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:31.889622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533296970692904:5705]
2025-10-02T08:08:31.889626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533296970692904:5705]
2025-10-02T08:08:31.889677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:31.889687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:31.889690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:31.889846Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:31.892612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:31.892637Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:31.901812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId: src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:31.908359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:31.925579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533296970692970:5300]
2025-10-02T08:08:31.925795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 347, pipe: [1:7556533296970692970:5300]
2025-10-02T08:08:32.041582Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:32.042004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.042019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.042042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533296970692970:5300], now have 1 active actors on pipe
2025-10-02T08:08:32.042158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533296970692970:5300]
2025-10-02T08:08:32.042181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:32.042183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:32.042237Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:32.042239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 348 reason: error at write: Disconnected sessionId: src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0
2025-10-02T08:08:32.042255Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:32.042462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 348 sessionId: src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0 is DEAD
2025-10-02T08:08:32.042673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:32.042686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0] Write session will restart in 0.006506s
2025-10-02T08:08:32.042718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0] Write session: Do CDS request
2025-10-02T08:08:32.042725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:32.050453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:32.050510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:32.050526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 349
2025-10-02T08:08:32.050838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:32.050882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:32.050892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:32.050896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:32.051308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 349 sessionId:  describe result for acl check
2025-10-02T08:08:32.051345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:32.051351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:32.051353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:32.051359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533301265660537:5712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:32.051872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533301265660537:5712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:32.054937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533301265660537:5712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:32.055075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:32.056329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:32.056505Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:32.056514Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:32.056532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:32.056576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:32.056611Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533301265660652:5711]
2025-10-02T08:08:32.057174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:32.057364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:32.057406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:32.057678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:32.057723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.057728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.057730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.057731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.057732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.057737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.057747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.057750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.057753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.057755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.057759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.057763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.057767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.057773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.057781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.057785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.057789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.057793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.057797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.057802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.057820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:32.058106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533301265660537:5712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:32.058141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533301265660537:5712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:32.058145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533301265660537:5712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:32.058154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:32.069389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:32.071297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:32.071317Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:32.071320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:32.071323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:32.071329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 348 [1:7556533301265660652:5711]
2025-10-02T08:08:32.071340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:32.071358Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:32.071360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.071364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.071365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.071382Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:32.071387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:32.071394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:32.071464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.071471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.071474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:32.071477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:32.071546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:32.071553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.071567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.071581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:32.071605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533301265660669:5712], now have 1 active actors on pipe
2025-10-02T08:08:32.071616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533301265660636:5711]
2025-10-02T08:08:32.071618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533301265660636:5711]
2025-10-02T08:08:32.071625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:32.071637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:32.071655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:32.071658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:32.071663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533301726008181:2378], now have 1 active actors on pipe
2025-10-02T08:08:32.071694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533301265660636:5711]
2025-10-02T08:08:32.071701Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:32.071748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 348
2025-10-02T08:08:32.071768Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:32.071840Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 348
2025-10-02T08:08:32.071789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:32.071801Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:32.071973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.071988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.072014Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:32.072023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.072027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.072029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:32.072039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.072049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:32.072073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:32.072100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.072103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.072114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:32.072143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 349 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0
2025-10-02T08:08:32.072639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da5ffd0-9df92880-ffbcfb95-289ba9aa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:32.077598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0] Write session: try to update token
2025-10-02T08:08:32.077627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:32.093171Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:32.093200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:32.093204Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:32.093216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533301265660636:5711]
2025-10-02T08:08:32.093222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533301265660636:5711]
2025-10-02T08:08:32.093294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:32.093302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:32.093795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:32.093810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.093813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:32.094310Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:32.110363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId: src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:32.113607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:32.142187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533301265660683:5300]
2025-10-02T08:08:32.142424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 348, pipe: [1:7556533301265660683:5300]
2025-10-02T08:08:32.258762Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:32.259156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.259164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.259186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533301265660683:5300], now have 1 active actors on pipe
2025-10-02T08:08:32.259307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:32.259315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:32.259373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 349 reason: error at write: Disconnected sessionId: src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0
2025-10-02T08:08:32.259578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 349 sessionId: src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0 is DEAD
2025-10-02T08:08:32.259698Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:32.259707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533301265660683:5300]
2025-10-02T08:08:32.264398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:32.264416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0] Write session will restart in 0.009046s
2025-10-02T08:08:32.264444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0] Write session: Do CDS request
2025-10-02T08:08:32.264453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:32.261185Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:32.274424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:32.274544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:32.274560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 350
2025-10-02T08:08:32.274719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:32.274755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:32.274761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:32.274764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:32.275129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 350 sessionId:  describe result for acl check
2025-10-02T08:08:32.275166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:32.275175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:32.275177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:32.275182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533301265661038:5719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:32.275690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533301265661038:5719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:32.277220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:32.285415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:32.285792Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:32.285798Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:32.285812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:32.285886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:32.285930Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533301265661074:5718]
2025-10-02T08:08:32.286658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:32.287434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533301265661038:5719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:32.289377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:32.289467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:32.289828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:32.289879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.289880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.289881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.289882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.289884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.289890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.289900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.289905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.289909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.289913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.289920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.289928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.289933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.289939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.289944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.289950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.289955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.289960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.289965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.289970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.289992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:32.310905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533301265661038:5719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:32.310929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533301265661038:5719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:32.310933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533301265661038:5719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:32.310943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:32.311166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:32.313269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:32.313291Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:32.313294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:32.313298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:32.313305Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 349 [1:7556533301265661074:5718]
2025-10-02T08:08:32.313320Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:32.313339Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:32.313342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.313345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.313347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.313364Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:32.313369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:32.313376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:32.313445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.313448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.313451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:32.313454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:32.313523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:32.313525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.313541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.313553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:32.313571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533301265661067:5718]
2025-10-02T08:08:32.313573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533301265661067:5718]
2025-10-02T08:08:32.313580Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:32.313594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:32.313609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:32.313612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:32.313643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533301265661067:5718]
2025-10-02T08:08:32.313646Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:32.314009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:32.314012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:32.314017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:32.317689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 349
2025-10-02T08:08:32.317712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533301265661101:5719], now have 1 active actors on pipe
2025-10-02T08:08:32.317718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533301726008201:2378], now have 1 active actors on pipe
2025-10-02T08:08:32.317921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.317931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.317958Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:32.317968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.317972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.317975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:32.317988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.318004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:32.318024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:32.318631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c14c899-bb28038d-d2b7b9e8-b8e6715a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:32.317112Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 349
2025-10-02T08:08:32.322282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0] Write session: try to update token
2025-10-02T08:08:32.322298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:32.318135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.318141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.318156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:32.318188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 350 partition: 0 MaxSeqNo: 17 sessionId: src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0
2025-10-02T08:08:32.359299Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:32.359325Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:32.359327Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:32.359335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533301265661067:5718]
2025-10-02T08:08:32.359339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533301265661067:5718]
2025-10-02T08:08:32.359389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:32.359396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.359399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:32.359569Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:32.359750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533301265661122:5300]
2025-10-02T08:08:32.361068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:32.361083Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:32.361533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 349, pipe: [1:7556533301265661122:5300]
2025-10-02T08:08:32.376885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId: src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:32.379995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:32.595571Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:32.594673Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:32.594962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533301265661122:5300], now have 1 active actors on pipe
2025-10-02T08:08:32.594974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.594980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.595262Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:32.595547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:32.595568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533301265661122:5300]
2025-10-02T08:08:32.595594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 350 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0
2025-10-02T08:08:32.595778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 350 sessionId: src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0 is DEAD
2025-10-02T08:08:32.596973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:32.596981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0] Write session will restart in 0.006720s
2025-10-02T08:08:32.597009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0] Write session: Do CDS request
2025-10-02T08:08:32.597016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:32.605543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:32.608966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:32.608985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 351
2025-10-02T08:08:32.609939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:32.609977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:32.609982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:32.609986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:32.613380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 351 sessionId:  describe result for acl check
2025-10-02T08:08:32.613424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:32.613426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:32.613427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:32.613433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533301265661375:5726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:32.614012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533301265661375:5726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:32.618821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533301265661375:5726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:32.623357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:32.623595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533301265661375:5726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:32.623611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533301265661375:5726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:32.623614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533301265661375:5726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:32.623625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:32.625384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:32.625592Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:32.625608Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:32.625620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:32.625685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:32.625729Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533301265661528:5725]
2025-10-02T08:08:32.626370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:32.626636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:32.626705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:32.627106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:32.627151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.627157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.627158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.627159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.627161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.627177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.627188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.627197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.627202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.627206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.627216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.627224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.627235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.627242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.627251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.627256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.627261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.627267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.627277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.627284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.627306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:32.636418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:32.638269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:32.638292Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:32.638294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:32.638297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:32.638304Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 350 [1:7556533301265661528:5725]
2025-10-02T08:08:32.638316Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:32.638334Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:32.638337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.638340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.638342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.638356Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:32.638360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:32.638366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:32.638430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.638440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.638443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:32.638445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:32.638512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:32.638519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.638533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.638546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:32.638554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 350
2025-10-02T08:08:32.638564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533301265661524:5726], now have 1 active actors on pipe
2025-10-02T08:08:32.638567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533301726008211:2378], now have 1 active actors on pipe
2025-10-02T08:08:32.638572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.638575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.638591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533301265661516:5725]
2025-10-02T08:08:32.638593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533301265661516:5725]
2025-10-02T08:08:32.638600Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:32.638611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:32.638611Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:32.638614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:32.638626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:32.638629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:32.638643Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:32.638656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.638664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.638666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:32.638674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.638686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:32.638725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533301265661516:5725]
2025-10-02T08:08:32.638739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:32.638757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:32.638752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 350
2025-10-02T08:08:32.638768Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:32.638851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.638863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.638908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:32.638949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 351 partition: 0 MaxSeqNo: 17 sessionId: src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0
2025-10-02T08:08:32.639320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d170edb-ecaf8a7a-292d18ad-85e8e89b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:32.642840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0] Write session: try to update token
2025-10-02T08:08:32.642860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:32.654368Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:32.654384Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:32.654393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533301265661516:5725]
2025-10-02T08:08:32.654432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:32.654434Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:32.654616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:32.654785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:32.654937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:32.655087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:32.655443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:32.655481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:32.668372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId: src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:32.672226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:32.672303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.672311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.672346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:32.672365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:32.672427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.672435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.672601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.672690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.672909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.673000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.673059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.673069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.673141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.673211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.673282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.673354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.673409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.673416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.673482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.673579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.673665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.673731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.673781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.673787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.673863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.673929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.673997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.674064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.674132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.674140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.674211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.674282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.674370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.674447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.674497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.674504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.674581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.674657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.674724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.674797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.675191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.675204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.675284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.675359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.675586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.675663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.675717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.675725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.675799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.675874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.675964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.676038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.676092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.676100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.676169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.676234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.676303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.676370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.676415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.676422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.676507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:32.676581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:32.676642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:32.676709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:32.676759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:32.676768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:32.676821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:32.676877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.676895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.676897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:32.676930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:32.676945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:32.676948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:32.676952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:32.676955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:32.677467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:32.677499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:32.677511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:32.677513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:32.677516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:32.677519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:32.678183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:32.678216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:32.678223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:32.678232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:32.678236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:32.678240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:32.679087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:32.679117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:32.679124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:32.679127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:32.679132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:32.687131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:32.687169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:32.687188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392512686
2025-10-02T08:08:32.687386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:32.687401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:32.687410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:32.687413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:32.687416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:32.687420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:32.688054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:32.688073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:32.688079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:32.688084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:32.688091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:32.688094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:32.688656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:32.688672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:32.688679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:32.688682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:32.688686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:32.688692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:32.689365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:32.689381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:32.689388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:32.690688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:32.690698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:32.690703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:32.690706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:32.690715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392512690
2025-10-02T08:08:32.691061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:32.691079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:32.691086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:32.691089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:32.691092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:32.691096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:32.691648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:32.691666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:32.691674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:32.691682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:32.691686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:32.691691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:32.692261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:32.692272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.692377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392512691
2025-10-02T08:08:32.696187Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:32.696209Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:32.696215Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:32.696219Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:32.697843Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:32.697858Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:32.697859Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:32.697866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533301265661516:5725]
2025-10-02T08:08:32.697870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533301265661516:5725]
2025-10-02T08:08:32.697915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:32.697921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:32.697922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:32.697925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.697926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:32.698066Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:32.710186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533301265661570:5300]
2025-10-02T08:08:32.712404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 350, pipe: [1:7556533301265661570:5300]
2025-10-02T08:08:32.847553Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:32.847972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533301265661570:5300], now have 1 active actors on pipe
2025-10-02T08:08:32.848436Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:32.848712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:32.848736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 351 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0
2025-10-02T08:08:32.849238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:32.849255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0] Write session will restart in 0.006300s
2025-10-02T08:08:32.849281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0] Write session: Do CDS request
2025-10-02T08:08:32.849288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:32.849098Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:32.848991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533301265661570:5300]
2025-10-02T08:08:32.849750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 351 sessionId: src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0 is DEAD
2025-10-02T08:08:32.857569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:32.858061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:32.858077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 352
2025-10-02T08:08:32.858280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:32.858310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:32.858316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:32.858320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:32.858943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 352 sessionId:  describe result for acl check
2025-10-02T08:08:32.858978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:32.858980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:32.858981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:32.858986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533301265661809:5745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:32.859597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533301265661809:5745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:32.865960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533301265661809:5745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:32.869158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:32.871107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:32.871297Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:32.871301Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:32.871309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:32.871350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:32.871381Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533301265661991:5744]
2025-10-02T08:08:32.872089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:32.872529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:32.872570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:32.872898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:32.872932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.872933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.872934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.872936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.872937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.872942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.872952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.872955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.872960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.872964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.872969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.872976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:32.872982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.872987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:32.872991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.872997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:32.873003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.873008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.873014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.873020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.873038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:32.874777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533301265661809:5745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:32.874791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533301265661809:5745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:32.874794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533301265661809:5745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:32.874804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:32.883114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:32.884869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:32.884887Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:32.884890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:32.884894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:32.884900Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 351 [1:7556533301265661991:5744]
2025-10-02T08:08:32.884913Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:32.884928Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:32.884937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.884940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.884942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.884958Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:32.884969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:32.884976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:32.885226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.885237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.885241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:32.885243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:32.885319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:32.885327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.885341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:32.885512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 351
2025-10-02T08:08:32.885724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:32.885748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533301265662007:5745], now have 1 active actors on pipe
2025-10-02T08:08:32.885756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533301726008240:2378], now have 1 active actors on pipe
2025-10-02T08:08:32.885760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.885764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.885784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533301265661984:5744]
2025-10-02T08:08:32.885791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533301265661984:5744]
2025-10-02T08:08:32.885801Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:32.885813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:32.885831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:32.885834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:32.885849Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:32.885861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:32.885864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:32.885873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:32.885883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:32.885898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:32.885939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533301265661984:5744]
2025-10-02T08:08:32.885947Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:32.885959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:32.886010Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:32.886033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:32.886044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:32.886161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:32.886169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:32.886202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:32.886238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 352 partition: 0 MaxSeqNo: 17 sessionId: src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0
2025-10-02T08:08:32.885650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 351
2025-10-02T08:08:32.889089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc74337-a92ba1da-5218c3ef-e3ed9f4e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:32.892105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0] Write session: try to update token
2025-10-02T08:08:32.892130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:32.908170Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:32.908191Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:32.908193Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:32.908202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533301265661984:5744]
2025-10-02T08:08:32.908207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533301265661984:5744]
2025-10-02T08:08:32.908251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:32.908257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:32.908260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:32.908415Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:32.908960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:32.908979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:32.921418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId: src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:32.924632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:32.946009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533301265662023:5300]
2025-10-02T08:08:32.947397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 351, pipe: [1:7556533301265662023:5300]
2025-10-02T08:08:33.055405Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:33.055811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.055826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.055846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533301265662023:5300], now have 1 active actors on pipe
2025-10-02T08:08:33.056314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533301265662023:5300]
2025-10-02T08:08:33.056320Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:33.056343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:33.056387Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:33.056410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 352 reason: status is not ok: tablet will be restarted right now sessionId: src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0
2025-10-02T08:08:33.056605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 352 sessionId: src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0 is DEAD
2025-10-02T08:08:33.057488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:33.057505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0] Write session will restart in 0.006824s
2025-10-02T08:08:33.057538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0] Write session: Do CDS request
2025-10-02T08:08:33.057545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:33.068638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:33.069205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:33.069230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 353
2025-10-02T08:08:33.069401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:33.069444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:33.069448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:33.069453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:33.069808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 353 sessionId:  describe result for acl check
2025-10-02T08:08:33.069833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:33.069835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:33.069836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:33.069840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533305560629678:5752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:33.070380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533305560629678:5752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:33.071374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:33.071929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:33.072087Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:33.072090Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:33.072098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:33.072135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:33.072167Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533305560629692:5750]
2025-10-02T08:08:33.072767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:33.075552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:33.075618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:33.075974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:33.076015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.076016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.076017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.076019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.076020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.076025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.076035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.076039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.076042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.076046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.076051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.076058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.076064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.076068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.076073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.076078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.076082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.076087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.076092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.076096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.076114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:33.079524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533305560629678:5752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:33.086474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:33.088305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:33.088311Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:33.088314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:33.088318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:33.088328Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 352 [1:7556533305560629692:5750]
2025-10-02T08:08:33.088341Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:33.088360Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:33.088363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:33.088366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:33.088368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:33.088384Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:33.088389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:33.088396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:33.088461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.088463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.088466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:33.088469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:33.088541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:33.088545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.088562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.088575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:33.088593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533306020975544:2378], now have 1 active actors on pipe
2025-10-02T08:08:33.088600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533305560629681:5750]
2025-10-02T08:08:33.088602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533305560629681:5750]
2025-10-02T08:08:33.088610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:33.088622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:33.088637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:33.088640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:33.088672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533305560629681:5750]
2025-10-02T08:08:33.088675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:33.088684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:33.088686Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:33.088691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:33.089004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533305560629678:5752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:33.089010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533305560629678:5752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:33.089014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533305560629678:5752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:33.089023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:33.089287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 352
2025-10-02T08:08:33.089306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533305560629737:5752], now have 1 active actors on pipe
2025-10-02T08:08:33.089312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.089317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.089342Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:33.089350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:33.089353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:33.089356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:33.089368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:33.089379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:33.089394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:33.089437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.089439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.089450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:33.089477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 353 partition: 0 MaxSeqNo: 17 sessionId: src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0
2025-10-02T08:08:33.089842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baedbc02-3a83322a-b9e6c35b-6528588a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:33.091525Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 352
2025-10-02T08:08:33.093336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0] Write session: try to update token
2025-10-02T08:08:33.093358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:33.111674Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:33.111701Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:33.111703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:33.111710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533305560629681:5750]
2025-10-02T08:08:33.111716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533305560629681:5750]
2025-10-02T08:08:33.111758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:33.111764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.111767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:33.111962Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:33.113354Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:33.113378Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:33.126972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId: src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:33.130247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:33.160900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533305560629745:5300]
2025-10-02T08:08:33.161217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 352, pipe: [1:7556533305560629745:5300]
2025-10-02T08:08:33.272642Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:33.271255Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:33.271684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.271692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.271726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533305560629745:5300], now have 1 active actors on pipe
2025-10-02T08:08:33.271970Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:33.272286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:33.272350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 353 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0
2025-10-02T08:08:33.272546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 353 sessionId: src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0 is DEAD
2025-10-02T08:08:33.272677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533305560629745:5300]
2025-10-02T08:08:33.273088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:33.273102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0] Write session will restart in 0.009415s
2025-10-02T08:08:33.273133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0] Write session: Do CDS request
2025-10-02T08:08:33.273141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:33.283370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:33.283833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:33.283854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 354
2025-10-02T08:08:33.285326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:33.285375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:33.285380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:33.285384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:33.285852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 354 sessionId:  describe result for acl check
2025-10-02T08:08:33.285879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:33.285881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:33.285882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:33.285887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533305560629984:5758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:33.286450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533305560629984:5758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:33.288794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533305560629984:5758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:33.292327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533305560629984:5758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:33.292350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533305560629984:5758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:33.292353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533305560629984:5758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:33.292362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:33.297191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:33.298115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:33.298424Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:33.298427Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:33.298438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:33.298494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:33.298530Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533305560630160:5757]
2025-10-02T08:08:33.299293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:33.299540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:33.299579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:33.300004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:33.300062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.300063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.300064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.300065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.300067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.300073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.300084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.300088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.300092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.300095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.300101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.300109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.300115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.300120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.300125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.300130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.300135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.300140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.300145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.300150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.300170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:33.315006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:33.317859Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 353
2025-10-02T08:08:33.320684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55fe3417-2157bc4d-ba3fdc32-c2086d02_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:33.317065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:33.317088Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:33.317091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:33.317095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:33.317103Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 353 [1:7556533305560630160:5757]
2025-10-02T08:08:33.317116Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:33.317135Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:33.317138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:33.317141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:33.317143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:33.317160Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:33.317165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:33.317172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:33.317242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.317243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.317247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:33.317250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:33.317315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:33.317318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.317332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.317345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:33.317362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533305560630154:5757]
2025-10-02T08:08:33.317365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533305560630154:5757]
2025-10-02T08:08:33.317379Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:33.317390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:33.317404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:33.317407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:33.317429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:33.317434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:33.317439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533305560630154:5757]
2025-10-02T08:08:33.317442Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:33.317499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 353
2025-10-02T08:08:33.317509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533305560630093:5758], now have 1 active actors on pipe
2025-10-02T08:08:33.317514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.317518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.317530Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:33.317541Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:33.317548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:33.317552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:33.317554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:33.317563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:33.317572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:33.317588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:33.317599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533306020975564:2378], now have 1 active actors on pipe
2025-10-02T08:08:33.318057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.318065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.318099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:33.318135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 354 partition: 0 MaxSeqNo: 17 sessionId: src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0
2025-10-02T08:08:33.324127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0] Write session: try to update token
2025-10-02T08:08:33.324153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:33.360848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId: src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:33.364153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:33.373612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533305560630187:5300]
2025-10-02T08:08:33.373949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 353, pipe: [1:7556533305560630187:5300]
2025-10-02T08:08:33.377162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.377197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.377222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533305560630187:5300], now have 1 active actors on pipe
2025-10-02T08:08:33.377232Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:33.377235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:33.377238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:33.377247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533305560630154:5757]
2025-10-02T08:08:33.377252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533305560630154:5757]
2025-10-02T08:08:33.377310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:33.377326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.377329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:33.377499Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:33.380355Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:33.380377Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:33.542119Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:33.542750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:33.542823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:33.543974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:33.543987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:33.544009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 354 reason: error at write: Disconnected sessionId: src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0
2025-10-02T08:08:33.544169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 354 sessionId: src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0 is DEAD
2025-10-02T08:08:33.544283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533305560630187:5300]
2025-10-02T08:08:33.544983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:33.544995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0] Write session will restart in 0.009088s
2025-10-02T08:08:33.545021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0] Write session: Do CDS request
2025-10-02T08:08:33.545027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:33.544944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:33.557231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:33.557689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:33.557716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 355
2025-10-02T08:08:33.557960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:33.558003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:33.558010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:33.558014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:33.558652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 355 sessionId:  describe result for acl check
2025-10-02T08:08:33.558708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:33.558710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:33.558712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:33.558717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533305560630392:5765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:33.559391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533305560630392:5765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:33.564678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533305560630392:5765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:33.573031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533305560630392:5765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:33.573053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533305560630392:5765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:33.573056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533305560630392:5765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:33.573066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:33.574867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:33.577658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:33.577930Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:33.577943Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:33.577954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:33.578010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:33.578057Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533305560630599:5764]
2025-10-02T08:08:33.578988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:33.579262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:33.579319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:33.579659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:33.579700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.579702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.579703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.579704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.579706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.579711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.579721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.579726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.579730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.579734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.579740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.579748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.579754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.579760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.579764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.579770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.579774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.579780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.579785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.579791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.579811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:33.589742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:33.591578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:33.591592Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:33.591594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:33.591598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:33.591602Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 354 [1:7556533305560630599:5764]
2025-10-02T08:08:33.591611Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:33.591625Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:33.591627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:33.591629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:33.591631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:33.591643Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:33.591647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:33.591652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:33.591703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.591704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.591707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:33.591709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:33.591758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:33.591759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.591769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.592236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 354
2025-10-02T08:08:33.592403Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 354
2025-10-02T08:08:33.592524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:33.592550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533305560630593:5764]
2025-10-02T08:08:33.592552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533305560630593:5764]
2025-10-02T08:08:33.592564Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:33.592580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533305560630578:5765], now have 1 active actors on pipe
2025-10-02T08:08:33.592584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533306020975573:2378], now have 1 active actors on pipe
2025-10-02T08:08:33.592588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.592594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.592620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:33.592637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:33.592640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:33.592704Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:33.592711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:33.592716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:33.592719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:33.592728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:33.592738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:33.592750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533305560630593:5764]
2025-10-02T08:08:33.592753Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:33.592780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:33.592940Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:33.592946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:33.592958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:33.593394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.593397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.593422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:33.593454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 355 partition: 0 MaxSeqNo: 17 sessionId: src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0
2025-10-02T08:08:33.597042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1a30b1-f0fd050c-bcf83383-f63711bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:33.600390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0] Write session: try to update token
2025-10-02T08:08:33.600414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:33.616271Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:33.616289Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:33.616291Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:33.616297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533305560630593:5764]
2025-10-02T08:08:33.616300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533305560630593:5764]
2025-10-02T08:08:33.616339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:33.616344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.616346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:33.616658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:33.616665Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:33.616848Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:33.631326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId: src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:33.634235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:33.644388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533305560630623:5300]
2025-10-02T08:08:33.644593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 354, pipe: [1:7556533305560630623:5300]
2025-10-02T08:08:33.786337Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:33.786709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.786716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.786734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533305560630623:5300], now have 1 active actors on pipe
2025-10-02T08:08:33.786890Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:33.787126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533305560630623:5300]
2025-10-02T08:08:33.787137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:33.787178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 355 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0
2025-10-02T08:08:33.787356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 355 sessionId: src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0 is DEAD
2025-10-02T08:08:33.788798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:33.788827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0] Write session will restart in 0.005809s
2025-10-02T08:08:33.788853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0] Write session: Do CDS request
2025-10-02T08:08:33.788862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:33.788017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:33.796777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:33.797911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:33.797927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 356
2025-10-02T08:08:33.798509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:33.798557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:33.798563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:33.798569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:33.801390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 356 sessionId:  describe result for acl check
2025-10-02T08:08:33.801432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:33.801434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:33.801436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:33.801443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533305560630817:5778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:33.802360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533305560630817:5778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:33.811137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533305560630817:5778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:33.822634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:33.824436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533305560630817:5778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:33.824445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533305560630817:5778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:33.824448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533305560630817:5778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:33.824459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:33.824635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:33.825135Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:33.825151Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:33.825164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:33.825224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:33.825260Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533305560631056:5777]
2025-10-02T08:08:33.826009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:33.826848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:33.826889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:33.827250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:33.827285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.827287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.827289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.827290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.827292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.827298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.827310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.827315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.827319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.827324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.827331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.827339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:33.827346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.827352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:33.827356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.827362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:33.827367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.827373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.827379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.827384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.827422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:33.838779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:33.840678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:33.840698Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:33.840701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:33.840706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:33.840713Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 355 [1:7556533305560631056:5777]
2025-10-02T08:08:33.840725Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:33.840745Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:33.840748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:33.840751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:33.840753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:33.840771Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:33.840778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:33.840784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:33.841009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.841012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.841015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:33.841018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:33.841086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:33.841097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.841113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:33.841126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:33.841146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533305560631047:5777]
2025-10-02T08:08:33.841153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533305560631047:5777]
2025-10-02T08:08:33.841163Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:33.841180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:33.841199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:33.841206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:33.841243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533305560631047:5777]
2025-10-02T08:08:33.841251Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:33.841373Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:33.841380Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:33.841386Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:33.841974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533306020975580:2378], now have 1 active actors on pipe
2025-10-02T08:08:33.841984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533305560631054:5778], now have 1 active actors on pipe
2025-10-02T08:08:33.842004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 355
2025-10-02T08:08:33.842326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.842336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.842365Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9644ddd-6b5fae91-12368b97-60a201c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:33.842377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:33.842381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:33.842383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:33.842393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:33.842411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:33.842432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:33.842772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:33.842780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:33.842795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:33.842827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 356 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9644ddd-6b5fae91-12368b97-60a201c_0
2025-10-02T08:08:33.843443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a177eb49-36c4ee34-205bd464-59aa5dd7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9644ddd-6b5fae91-12368b97-60a201c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:33.842174Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 355
2025-10-02T08:08:33.847598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9644ddd-6b5fae91-12368b97-60a201c_0] Write session: try to update token
2025-10-02T08:08:33.847620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9644ddd-6b5fae91-12368b97-60a201c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:33.883013Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:33.883037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:33.883040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:33.883049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533305560631047:5777]
2025-10-02T08:08:33.883054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533305560631047:5777]
2025-10-02T08:08:33.883100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:33.883107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:33.883109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:33.883265Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:33.885134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:33.885146Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:33.886723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId: src_id|c9644ddd-6b5fae91-12368b97-60a201c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:33.889566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:33.889688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533305560631085:5300]
2025-10-02T08:08:33.900234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 355, pipe: [1:7556533305560631085:5300]
2025-10-02T08:08:34.079207Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:34.079688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.079698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.079720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533305560631085:5300], now have 1 active actors on pipe
2025-10-02T08:08:34.080360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:34.080377Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:34.080405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:34.080409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:34.080477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 356 reason: error at write: Disconnected sessionId: src_id|c9644ddd-6b5fae91-12368b97-60a201c_0
2025-10-02T08:08:34.080647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533305560631085:5300]
2025-10-02T08:08:34.080660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 356 sessionId: src_id|c9644ddd-6b5fae91-12368b97-60a201c_0 is DEAD
2025-10-02T08:08:34.081199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9644ddd-6b5fae91-12368b97-60a201c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:34.081215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9644ddd-6b5fae91-12368b97-60a201c_0] Write session will restart in 0.005592s
2025-10-02T08:08:34.081245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9644ddd-6b5fae91-12368b97-60a201c_0] Write session: Do CDS request
2025-10-02T08:08:34.081253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9644ddd-6b5fae91-12368b97-60a201c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:34.088513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9644ddd-6b5fae91-12368b97-60a201c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:34.088586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:34.088611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 357
2025-10-02T08:08:34.088764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:34.088794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:34.088817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:34.088823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:34.089666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 357 sessionId:  describe result for acl check
2025-10-02T08:08:34.089719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:34.089725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:34.089727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:34.089733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533309855598411:5789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:34.090302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533309855598411:5789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:34.098702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533309855598411:5789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:34.114394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533309855598411:5789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:34.114418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533309855598411:5789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:34.114422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533309855598411:5789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:34.114432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:34.118156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:34.120267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:34.120491Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:34.120495Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:34.120505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:34.120549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:34.120587Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533309855598799:5788]
2025-10-02T08:08:34.121355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:34.123007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:34.123067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:34.123444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:34.123484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.123490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.123491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.123493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.123495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.123501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.123513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.123518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.123523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.123527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.123533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.123541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.123548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.123554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.123559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.123567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.123571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.123577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.123582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.123587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.123608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:34.135455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:34.137401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:34.137424Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:34.137426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:34.137430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:34.137436Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 356 [1:7556533309855598799:5788]
2025-10-02T08:08:34.137447Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:34.137468Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:34.137471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:34.137473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:34.137476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:34.137494Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:34.137499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:34.137507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:34.137572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.137574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.137577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:34.137580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:34.137655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:34.137658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.137672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.137684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:34.137704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533309855598793:5788]
2025-10-02T08:08:34.137706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533309855598793:5788]
2025-10-02T08:08:34.137713Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:34.137730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:34.137745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:34.137748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:34.137774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:34.137777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:34.137787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533309855598768:5789], now have 1 active actors on pipe
2025-10-02T08:08:34.137790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533309855598793:5788]
2025-10-02T08:08:34.137792Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:34.137806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533310315942907:2378], now have 1 active actors on pipe
2025-10-02T08:08:34.137837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 356
2025-10-02T08:08:34.137951Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:34.138175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.138192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.138229Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|354fb568-dfa2b2b1-62729fda-28989481_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:34.138244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:34.138252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:34.138254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:34.138264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:34.138279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:34.138302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:34.138388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.138397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.138411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:34.138462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 357 partition: 0 MaxSeqNo: 17 sessionId: src_id|354fb568-dfa2b2b1-62729fda-28989481_0
2025-10-02T08:08:34.139267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9644ddd-6b5fae91-12368b97-60a201c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|354fb568-dfa2b2b1-62729fda-28989481_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:34.138021Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 356
2025-10-02T08:08:34.142630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354fb568-dfa2b2b1-62729fda-28989481_0] Write session: try to update token
2025-10-02T08:08:34.142649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354fb568-dfa2b2b1-62729fda-28989481_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:34.166008Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:34.166029Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:34.166032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:34.166041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533309855598793:5788]
2025-10-02T08:08:34.166046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533309855598793:5788]
2025-10-02T08:08:34.166094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:34.166105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.166107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:34.166262Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:34.168177Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:34.168196Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:34.171194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId: src_id|354fb568-dfa2b2b1-62729fda-28989481_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:34.174557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:34.180422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533309855598823:5300]
2025-10-02T08:08:34.180693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 356, pipe: [1:7556533309855598823:5300]
2025-10-02T08:08:34.344316Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:34.344732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.344746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.344766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533309855598823:5300], now have 1 active actors on pipe
2025-10-02T08:08:34.345469Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:34.345889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:34.345943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 357 reason: status is not ok: tablet will be restarted right now sessionId: src_id|354fb568-dfa2b2b1-62729fda-28989481_0
2025-10-02T08:08:34.346113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 357 sessionId: src_id|354fb568-dfa2b2b1-62729fda-28989481_0 is DEAD
2025-10-02T08:08:34.346222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533309855598823:5300]
2025-10-02T08:08:34.348879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:34.349744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354fb568-dfa2b2b1-62729fda-28989481_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:34.349762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354fb568-dfa2b2b1-62729fda-28989481_0] Write session will restart in 0.006042s
2025-10-02T08:08:34.349794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354fb568-dfa2b2b1-62729fda-28989481_0] Write session: Do CDS request
2025-10-02T08:08:34.349803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354fb568-dfa2b2b1-62729fda-28989481_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:34.361355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354fb568-dfa2b2b1-62729fda-28989481_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:34.365528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:34.365553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 358
2025-10-02T08:08:34.369298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:34.369344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:34.369350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:34.369355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:34.370943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 358 sessionId:  describe result for acl check
2025-10-02T08:08:34.370977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:34.370978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:34.370980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:34.370986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533309855599211:5796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:34.371529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533309855599211:5796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:34.372273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:34.372769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:34.372976Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:34.372983Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:34.372992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:34.373036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:34.373071Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533309855599222:5795]
2025-10-02T08:08:34.373777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:34.374340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:34.374384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:34.374735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:34.374780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.374782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.374783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.374784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.374786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.374791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.374803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.374807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.374812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.374816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.374822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.374831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.374837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.374843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.374848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.374853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.374858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.374863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.374868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.374874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.374893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:34.377885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533309855599211:5796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:34.384432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533309855599211:5796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:34.384454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533309855599211:5796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:34.384458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533309855599211:5796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:34.384468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:34.396908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:34.399094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:34.399117Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:34.399120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:34.399123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:34.399130Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 357 [1:7556533309855599222:5795]
2025-10-02T08:08:34.399142Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:34.399159Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:34.399162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:34.399165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:34.399168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:34.399186Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:34.399191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:34.399197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:34.399288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.399299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.399302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:34.399304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:34.399990Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 357
2025-10-02T08:08:34.399383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:34.399390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.399404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.399416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:34.399435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533309855599261:5796], now have 1 active actors on pipe
2025-10-02T08:08:34.399442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533309855599209:5795]
2025-10-02T08:08:34.399444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533309855599209:5795]
2025-10-02T08:08:34.399457Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:34.399467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533310315942927:2378], now have 1 active actors on pipe
2025-10-02T08:08:34.399475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:34.399489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:34.399492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:34.399526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533309855599209:5795]
2025-10-02T08:08:34.399528Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:34.399568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 357
2025-10-02T08:08:34.399585Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:34.399589Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:34.399596Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:34.400195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.400208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.400236Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86270854-2148c3e6-79683cb5-c19192fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:34.400245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:34.400250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:34.400253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:34.400264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:34.400276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:34.400295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:34.400601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.400610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.400634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:34.400669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 358 partition: 0 MaxSeqNo: 17 sessionId: src_id|86270854-2148c3e6-79683cb5-c19192fa_0
2025-10-02T08:08:34.401128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354fb568-dfa2b2b1-62729fda-28989481_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|86270854-2148c3e6-79683cb5-c19192fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:34.404434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86270854-2148c3e6-79683cb5-c19192fa_0] Write session: try to update token
2025-10-02T08:08:34.404461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86270854-2148c3e6-79683cb5-c19192fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:34.412757Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:34.412775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:34.412784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533309855599209:5795]
2025-10-02T08:08:34.412835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:34.412897Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:34.413039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:34.413202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:34.413364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:34.413528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:34.414023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:34.414071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:34.432282Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:34.432302Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:34.432305Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:34.432315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533309855599209:5795]
2025-10-02T08:08:34.432319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533309855599209:5795]
2025-10-02T08:08:34.432362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:34.432369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.432372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:34.432530Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:34.436856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:34.436864Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:34.440395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId: src_id|86270854-2148c3e6-79683cb5-c19192fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:34.443769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:34.444789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533309855599285:5300]
2025-10-02T08:08:34.444909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 357, pipe: [1:7556533309855599285:5300]
2025-10-02T08:08:34.628096Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:34.628407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.628427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.628457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533309855599285:5300], now have 1 active actors on pipe
2025-10-02T08:08:34.628931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533309855599285:5300]
2025-10-02T08:08:34.628964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:34.628972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:34.629033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 358 reason: error at write: Disconnected sessionId: src_id|86270854-2148c3e6-79683cb5-c19192fa_0
2025-10-02T08:08:34.629053Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:34.629232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 358 sessionId: src_id|86270854-2148c3e6-79683cb5-c19192fa_0 is DEAD
2025-10-02T08:08:34.629086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:34.633884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86270854-2148c3e6-79683cb5-c19192fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:34.633902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86270854-2148c3e6-79683cb5-c19192fa_0] Write session will restart in 0.009006s
2025-10-02T08:08:34.633932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86270854-2148c3e6-79683cb5-c19192fa_0] Write session: Do CDS request
2025-10-02T08:08:34.633940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86270854-2148c3e6-79683cb5-c19192fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:34.652696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:34.653360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86270854-2148c3e6-79683cb5-c19192fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:34.653762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:34.653787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 359
2025-10-02T08:08:34.653914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:34.653958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:34.653970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:34.653975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:34.654542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 359 sessionId:  describe result for acl check
2025-10-02T08:08:34.654591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:34.654594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:34.654595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:34.654601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533309855599662:5806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:34.655216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533309855599662:5806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:34.655399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:34.655608Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:34.655612Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:34.655621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:34.655770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:34.655819Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533309855599668:5804]
2025-10-02T08:08:34.656410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:34.656960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:34.657007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:34.657311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:34.657360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.657362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.657363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.657363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.657365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.657370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.657378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.657381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.657385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.657388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.657393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.657400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.657404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.657409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.657416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.657420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.657424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.657429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.657432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.657436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.657453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:34.659742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533309855599662:5806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:34.666011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533309855599662:5806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:34.666026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533309855599662:5806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:34.666029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533309855599662:5806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:34.666038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:34.668742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:34.670724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:34.670731Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:34.670734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:34.670737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:34.670743Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 358 [1:7556533309855599668:5804]
2025-10-02T08:08:34.670755Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:34.670773Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:34.670776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:34.670779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:34.670780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:34.670796Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:34.670802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:34.670808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:34.670868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.670870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.670873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:34.670875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:34.670950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:34.670952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.670965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.670975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:34.670989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533309855599655:5804]
2025-10-02T08:08:34.670991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533309855599655:5804]
2025-10-02T08:08:34.670998Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:34.671009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:34.671051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:34.671054Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:34.671292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 358
2025-10-02T08:08:34.671312Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 358
2025-10-02T08:08:34.671489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:34.671500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:34.671511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533309855599708:5806], now have 1 active actors on pipe
2025-10-02T08:08:34.671544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533310315942935:2378], now have 1 active actors on pipe
2025-10-02T08:08:34.671554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.671558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.671572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533309855599655:5804]
2025-10-02T08:08:34.671584Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:34.671588Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:34.671618Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:34.671628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:34.671631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:34.671633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:34.671644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:34.671657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:34.671686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:34.671885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.671892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.671919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:34.671949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 359 partition: 0 MaxSeqNo: 17 sessionId: src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0
2025-10-02T08:08:34.673173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86270854-2148c3e6-79683cb5-c19192fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:34.676111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0] Write session: try to update token
2025-10-02T08:08:34.676137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:34.707090Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:34.707113Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:34.707116Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:34.707125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533309855599655:5804]
2025-10-02T08:08:34.707130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533309855599655:5804]
2025-10-02T08:08:34.707178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:34.707185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.707187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:34.707373Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:34.708863Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:34.708871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:34.716923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId: src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:34.719942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:34.728778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533309855599724:5300]
2025-10-02T08:08:34.728926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 358, pipe: [1:7556533309855599724:5300]
2025-10-02T08:08:34.877634Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:34.878074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.878084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.878128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533309855599724:5300], now have 1 active actors on pipe
2025-10-02T08:08:34.878377Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:34.878716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:34.878770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 359 reason: status is not ok: tablet will be restarted right now sessionId: src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0
2025-10-02T08:08:34.878975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 359 sessionId: src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0 is DEAD
2025-10-02T08:08:34.879096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533309855599724:5300]
2025-10-02T08:08:34.879303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:34.879311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0] Write session will restart in 0.006149s
2025-10-02T08:08:34.879337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0] Write session: Do CDS request
2025-10-02T08:08:34.879347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:34.884914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:34.887700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:34.888048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:34.888067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 360
2025-10-02T08:08:34.888205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:34.888232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:34.888238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:34.888242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:34.888797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 360 sessionId:  describe result for acl check
2025-10-02T08:08:34.888859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:34.888865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:34.888867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:34.888873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533309855599765:5821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:34.889445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533309855599765:5821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:34.893077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533309855599765:5821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:34.899173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533309855599765:5821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:34.899191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533309855599765:5821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:34.899195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533309855599765:5821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:34.899211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:34.917842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:34.918182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:34.918378Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:34.918393Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:34.918409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:34.918468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:34.918515Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533309855600170:5825]
2025-10-02T08:08:34.919209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:34.919548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:34.919606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:34.919947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:34.920020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.920021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.920022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.920023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.920024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.920030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.920042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.920046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.920050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.920055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.920061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.920069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:34.920074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.920081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:34.920086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.920091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:34.920095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.920101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.920105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.920111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.920131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:34.932206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:34.934439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:34.934447Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:34.934450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:34.934454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:34.934462Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 359 [1:7556533309855600170:5825]
2025-10-02T08:08:34.934476Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:34.934496Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:34.934499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:34.934502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:34.934504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:34.934522Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:34.934527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:34.934534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:34.934611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.934612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.934616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:34.934618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:34.934702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:34.934704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.934720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:34.934733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:34.934751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533309855600163:5825]
2025-10-02T08:08:34.934753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533309855600163:5825]
2025-10-02T08:08:34.934815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:34.934818Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:34.935262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 359
2025-10-02T08:08:34.936025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:34.936057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:34.936085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:34.936088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:34.936103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533309855599824:5821], now have 1 active actors on pipe
2025-10-02T08:08:34.936106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533310315942944:2378], now have 1 active actors on pipe
2025-10-02T08:08:34.936112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.936118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.936166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533309855600163:5825]
2025-10-02T08:08:34.936171Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:34.936184Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:34.936191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:34.936194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:34.936196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:34.936204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:34.936215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:34.936245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:34.936262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:34.936422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:34.936427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:34.936440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:34.936466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 360 partition: 0 MaxSeqNo: 17 sessionId: src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0
2025-10-02T08:08:34.935162Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 359
2025-10-02T08:08:34.937050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|811b131e-1b106d9a-b87f1fd8-cb900321_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:34.944902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0] Write session: try to update token
2025-10-02T08:08:34.944926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:34.958843Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:34.958863Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:34.958865Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:34.958874Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533309855600163:5825]
2025-10-02T08:08:34.958878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533309855600163:5825]
2025-10-02T08:08:34.958923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:34.958930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:34.958932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:34.959102Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:34.960861Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:34.960879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:34.980929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533309855600194:5300]
2025-10-02T08:08:34.981237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 359, pipe: [1:7556533309855600194:5300]
2025-10-02T08:08:34.987197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId: src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:34.990527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:35.118167Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:35.118739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533309855600194:5300], now have 1 active actors on pipe
2025-10-02T08:08:35.118750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.118756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.120446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:35.120457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0] Write session will restart in 0.008690s
2025-10-02T08:08:35.120482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0] Write session: Do CDS request
2025-10-02T08:08:35.120489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:35.119447Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:35.119775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533309855600194:5300]
2025-10-02T08:08:35.119798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:35.119854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 360 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0
2025-10-02T08:08:35.120066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 360 sessionId: src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0 is DEAD
2025-10-02T08:08:35.120882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:35.130353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:35.131043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:35.131068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 361
2025-10-02T08:08:35.131302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:35.131349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:35.131356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:35.131360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:35.132673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 361 sessionId:  describe result for acl check
2025-10-02T08:08:35.132705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:35.132707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:35.132708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:35.132714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533314150567725:5830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:35.133308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533314150567725:5830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:35.146262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533314150567725:5830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:35.151642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:35.154276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:35.154514Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:35.154520Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:35.154543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:35.154597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:35.154642Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533314150567910:5829]
2025-10-02T08:08:35.155321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:35.156396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:35.156466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:35.156908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:35.156979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.156980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.156982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.156983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.156984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.156984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533314150567725:5830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:35.156991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.156991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533314150567725:5830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:35.156994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533314150567725:5830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:35.157001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.157003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:35.157005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.157012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.157015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.157022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.157029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.157035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.157040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.157045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.157049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.157054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.157059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.157068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.157074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.157094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:35.170841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:35.172752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:35.172776Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:35.172780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:35.172784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:35.172792Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 360 [1:7556533314150567910:5829]
2025-10-02T08:08:35.172825Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:35.172849Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:35.172852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.172856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.172859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.172880Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:35.172885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:35.172892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:35.172983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.172988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.172992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:35.172995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:35.173075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:35.173079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.173094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.173106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:35.173125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533314150567904:5829]
2025-10-02T08:08:35.173126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533314150567904:5829]
2025-10-02T08:08:35.173140Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:35.173155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:35.173169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:35.173173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:35.173211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533314150567904:5829]
2025-10-02T08:08:35.173213Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:35.174280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:35.174294Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:35.174300Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:35.174522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 360
2025-10-02T08:08:35.174538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533314150567922:5830], now have 1 active actors on pipe
2025-10-02T08:08:35.174543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533314610910269:2378], now have 1 active actors on pipe
2025-10-02T08:08:35.174564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.174570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.174600Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c36eb15-f83f324f-254068f5-d47642d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:35.174610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.174616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.174618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:35.174631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.174647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:35.174666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:35.174863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.174866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.174881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:35.174917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 361 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c36eb15-f83f324f-254068f5-d47642d6_0
2025-10-02T08:08:35.175422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad5af0-d656b863-abc8cf47-ea727146_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c36eb15-f83f324f-254068f5-d47642d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:35.175279Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 360
2025-10-02T08:08:35.178939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c36eb15-f83f324f-254068f5-d47642d6_0] Write session: try to update token
2025-10-02T08:08:35.178958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c36eb15-f83f324f-254068f5-d47642d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:35.206555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId: src_id|5c36eb15-f83f324f-254068f5-d47642d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:35.209819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:35.210139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.210156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.210192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:35.210216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:35.210369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.210376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.210565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.210646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.210725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.210807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.210864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.210869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.210963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.211046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.211133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.211219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.211286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.211290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.211383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.211464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.211547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.211632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.211699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.211703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.211794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.211884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.211983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.212072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.212141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.212144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.212242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.212328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.212567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.212650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.212706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.212709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.212826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.212913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.212996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.213085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.213152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.213155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.213255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.213338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.213423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.213509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.213570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.213587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.213675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.213743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.213832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.213911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.213969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.213972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.214051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.214124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.214202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.214280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.214331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.214334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.214414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:35.214491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:35.214572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:35.214647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:35.214704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:35.214708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:35.214761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:35.214836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.214862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.214865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:35.214902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:35.214918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:35.214921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:35.214925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:35.214928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:35.215524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:35.215546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:35.215555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:35.215560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:35.215564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:35.215568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:35.216642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:35.216671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:35.216679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:35.216682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:35.216686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:35.216690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:35.217506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:35.217522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:35.217529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:35.217533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:35.217537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:35.219134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:35.219145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:35.219166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392515218
2025-10-02T08:08:35.219404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:35.219416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:35.219424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:35.219428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:35.219433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:35.219436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:35.219814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533314150567940:5300]
2025-10-02T08:08:35.220206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:35.220225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:35.220231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:35.220235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:35.220239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:35.220243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:35.221227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:35.221252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:35.221263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:35.221267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:35.221272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:35.221280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:35.221905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:35.221920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:35.221926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:35.222989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 360, pipe: [1:7556533314150567940:5300]
2025-10-02T08:08:35.223457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:35.223470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:35.223478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:35.223483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:35.223495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392515223
2025-10-02T08:08:35.224059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:35.224075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:35.224086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:35.224089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:35.224094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:35.224098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:35.224724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:35.224737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:35.224742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:35.224745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:35.224749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:35.224753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:35.225655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:35.225680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.225811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392515225
2025-10-02T08:08:35.226783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533314150567940:5300], now have 1 active actors on pipe
2025-10-02T08:08:35.226791Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:35.226807Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:35.226813Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:35.226830Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:35.230087Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:35.230104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:35.230113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533314150567904:5829]
2025-10-02T08:08:35.230174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:35.230321Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:35.230389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:35.230565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:35.230745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:35.230957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:35.231256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:35.231296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:35.254285Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:35.254306Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:35.254308Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:35.254319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533314150567904:5829]
2025-10-02T08:08:35.254324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533314150567904:5829]
2025-10-02T08:08:35.254370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:35.254377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.254380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:35.254548Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:35.255688Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:35.255705Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:35.429046Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:35.430284Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:35.433285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c36eb15-f83f324f-254068f5-d47642d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:35.433297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c36eb15-f83f324f-254068f5-d47642d6_0] Write session will restart in 0.009710s
2025-10-02T08:08:35.433323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c36eb15-f83f324f-254068f5-d47642d6_0] Write session: Do CDS request
2025-10-02T08:08:35.433330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c36eb15-f83f324f-254068f5-d47642d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:35.430539Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:35.432540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533314150567940:5300]
2025-10-02T08:08:35.432563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:35.432595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 361 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c36eb15-f83f324f-254068f5-d47642d6_0
2025-10-02T08:08:35.432814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 361 sessionId: src_id|5c36eb15-f83f324f-254068f5-d47642d6_0 is DEAD
2025-10-02T08:08:35.444402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c36eb15-f83f324f-254068f5-d47642d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:35.447290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:35.447307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 362
2025-10-02T08:08:35.447970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:35.448008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:35.448013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:35.448016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:35.449568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 362 sessionId:  describe result for acl check
2025-10-02T08:08:35.449602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:35.449605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:35.449606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:35.449612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533314150568180:5838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:35.450109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533314150568180:5838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:35.465908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533314150568180:5838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:35.475456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:35.481375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:35.481606Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:35.481610Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:35.481620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:35.481669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:35.481701Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533314150568385:5837]
2025-10-02T08:08:35.482331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:35.482675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:35.482712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:35.483003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:35.483039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.483040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.483041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.483042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.483043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.483048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.483058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.483062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.483065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.483069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.483073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.483080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.483085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.483090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.483094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.483098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.483102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.483108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.483112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.483117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.483136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:35.489306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533314150568180:5838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:35.489328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533314150568180:5838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:35.489332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533314150568180:5838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:35.489342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:35.503532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:35.505475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:35.505497Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:35.505500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:35.505503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:35.505510Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 361 [1:7556533314150568385:5837]
2025-10-02T08:08:35.505524Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:35.505544Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:35.505549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.505557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.505560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.505576Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:35.505586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:35.505594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:35.505661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.505670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.505674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:35.505677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:35.505745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:35.505753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.505768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.505787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:35.505810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533314150568379:5837]
2025-10-02T08:08:35.505817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533314150568379:5837]
2025-10-02T08:08:35.505830Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:35.505847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:35.505867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:35.505875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:35.505910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533314150568379:5837]
2025-10-02T08:08:35.505918Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:35.506328Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:35.506331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:35.506337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:35.506822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 361
2025-10-02T08:08:35.506835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533314150568402:5838], now have 1 active actors on pipe
2025-10-02T08:08:35.506840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533314610910290:2378], now have 1 active actors on pipe
2025-10-02T08:08:35.507056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.507067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.507095Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:35.507103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.507106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.507108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:35.507120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.507131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:35.507149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:35.507328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.507333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.507347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:35.507379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 362 partition: 0 MaxSeqNo: 17 sessionId: src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0
2025-10-02T08:08:35.509167Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 361
2025-10-02T08:08:35.509300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c36eb15-f83f324f-254068f5-d47642d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:35.512951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0] Write session: try to update token
2025-10-02T08:08:35.512973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:35.530281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533314150568413:5300]
2025-10-02T08:08:35.531357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 361, pipe: [1:7556533314150568413:5300]
2025-10-02T08:08:35.531384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533314150568413:5300], now have 1 active actors on pipe
2025-10-02T08:08:35.533310Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:35.533315Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:35.533317Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:35.533326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533314150568379:5837]
2025-10-02T08:08:35.533333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533314150568379:5837]
2025-10-02T08:08:35.533388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:35.533396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.533398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:35.533695Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:35.537255Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:35.537269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:35.541483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId: src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:35.544883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:35.716511Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:35.717115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.717131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.719131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:35.719144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0] Write session will restart in 0.007545s
2025-10-02T08:08:35.719171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0] Write session: Do CDS request
2025-10-02T08:08:35.719179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:35.718035Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:35.718414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533314150568413:5300]
2025-10-02T08:08:35.718435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:35.718491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 362 reason: status is not ok: tablet will be restarted right now sessionId: src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0
2025-10-02T08:08:35.718720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 362 sessionId: src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0 is DEAD
2025-10-02T08:08:35.720893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:35.731003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:35.732210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:35.732231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 363
2025-10-02T08:08:35.733160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:35.733207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:35.733213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:35.733218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:35.733936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 363 sessionId:  describe result for acl check
2025-10-02T08:08:35.733976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:35.733978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:35.733980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:35.733987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533314150568601:5844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:35.734643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533314150568601:5844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:35.740942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533314150568601:5844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:35.748323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533314150568601:5844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:35.748339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533314150568601:5844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:35.748342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533314150568601:5844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:35.748351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:35.748774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:35.751079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:35.751369Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:35.751373Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:35.751380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:35.751419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:35.751444Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533314150568838:5843]
2025-10-02T08:08:35.751851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:35.752098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:35.752125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:35.752315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:35.752339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.752339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.752340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.752340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.752341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.752344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.752350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.752352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.752354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.752356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.752360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.752364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.752368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.752370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.752373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.752376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.752378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.752381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.752383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.752386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.752397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:35.761811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:35.763258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:35.763279Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:35.763282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:35.763291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:35.763298Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 362 [1:7556533314150568838:5843]
2025-10-02T08:08:35.763312Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:35.763331Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:35.763338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.763342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.763344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.763361Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:35.763369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:35.763375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:35.763438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.763444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.763448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:35.763450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:35.763518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:35.763525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.763538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.763549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:35.763566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533314150568830:5843]
2025-10-02T08:08:35.763569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533314150568830:5843]
2025-10-02T08:08:35.763576Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:35.763591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533314150568827:5844], now have 1 active actors on pipe
2025-10-02T08:08:35.763597Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:35.763597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:35.763598Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:35.763610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:35.763614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:35.763648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533314610910297:2378], now have 1 active actors on pipe
2025-10-02T08:08:35.763650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533314150568830:5843]
2025-10-02T08:08:35.763652Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:35.763688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 362
2025-10-02T08:08:35.763741Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:35.763842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.763847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.763873Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab535fcd-7574587e-297f14a-5ac6d632_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:35.763879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.763884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.763886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:35.763911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.763920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:35.763936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:35.763988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.763990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.764468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb19d4b-3e341287-7b5230b0-d4de9cc4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ab535fcd-7574587e-297f14a-5ac6d632_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:35.764288Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 362
2025-10-02T08:08:35.767622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab535fcd-7574587e-297f14a-5ac6d632_0] Write session: try to update token
2025-10-02T08:08:35.767641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab535fcd-7574587e-297f14a-5ac6d632_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:35.764003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:35.764032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 363 partition: 0 MaxSeqNo: 17 sessionId: src_id|ab535fcd-7574587e-297f14a-5ac6d632_0
2025-10-02T08:08:35.783945Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:35.783969Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:35.783971Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:35.783980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533314150568830:5843]
2025-10-02T08:08:35.783984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533314150568830:5843]
2025-10-02T08:08:35.784026Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:35.784032Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:35.784032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:35.784040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.784042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:35.784201Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:35.790597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId: src_id|ab535fcd-7574587e-297f14a-5ac6d632_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:35.793839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:35.814178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533314150568864:5300]
2025-10-02T08:08:35.814408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 362, pipe: [1:7556533314150568864:5300]
2025-10-02T08:08:35.930908Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:35.931278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.931293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.931330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533314150568864:5300], now have 1 active actors on pipe
2025-10-02T08:08:35.931560Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:35.931869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:35.931836Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:35.931941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 363 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab535fcd-7574587e-297f14a-5ac6d632_0
2025-10-02T08:08:35.932138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 363 sessionId: src_id|ab535fcd-7574587e-297f14a-5ac6d632_0 is DEAD
2025-10-02T08:08:35.932490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533314150568864:5300]
2025-10-02T08:08:35.932618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab535fcd-7574587e-297f14a-5ac6d632_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:35.932628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab535fcd-7574587e-297f14a-5ac6d632_0] Write session will restart in 0.008303s
2025-10-02T08:08:35.932656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab535fcd-7574587e-297f14a-5ac6d632_0] Write session: Do CDS request
2025-10-02T08:08:35.932664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab535fcd-7574587e-297f14a-5ac6d632_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:35.942366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab535fcd-7574587e-297f14a-5ac6d632_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:35.942494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:35.942514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 364
2025-10-02T08:08:35.942676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:35.942709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:35.942720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:35.942724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:35.943443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 364 sessionId:  describe result for acl check
2025-10-02T08:08:35.943504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:35.943514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:35.943517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:35.943524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533314150569255:5861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:35.944232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533314150569255:5861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:35.946211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:35.947293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533314150569255:5861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:35.947867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:35.948102Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:35.948117Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:35.948128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:35.948182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:35.948222Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533314150569308:5860]
2025-10-02T08:08:35.948859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:35.949085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:35.949131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:35.949424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:35.949463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.949465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.949466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.949467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.949468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.949473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.949484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.949487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.949491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.949495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.949501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.949509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:35.949515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.949519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:35.949523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.949528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:35.949532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.949537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.949541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.949546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.949566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:35.953688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533314150569255:5861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:35.953707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533314150569255:5861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:35.953714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533314150569255:5861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:35.953724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:35.960081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:35.962096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:35.962115Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:35.962118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:35.962122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:35.962130Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 363 [1:7556533314150569308:5860]
2025-10-02T08:08:35.962144Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:35.962164Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:35.962167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.962171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.962173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.962191Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:35.962196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:35.962203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:35.962281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.962283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.962286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:35.962289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:35.962356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:35.962358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:35.962374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:35.962385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:35.962403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533314150569289:5860]
2025-10-02T08:08:35.962405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533314150569289:5860]
2025-10-02T08:08:35.962417Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:35.962431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:35.962443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:35.962446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:35.962481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533314150569289:5860]
2025-10-02T08:08:35.962484Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:35.963044Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 363
2025-10-02T08:08:35.962925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:35.962934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:35.962939Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:35.964892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 363
2025-10-02T08:08:35.964913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533314150569326:5861], now have 1 active actors on pipe
2025-10-02T08:08:35.964930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533314610910305:2378], now have 1 active actors on pipe
2025-10-02T08:08:35.964958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.964985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.965033Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:35.965057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:35.965064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:35.965067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:35.965086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:35.965114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:35.965144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:35.965803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab535fcd-7574587e-297f14a-5ac6d632_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:35.965307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:35.965331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:35.965367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:35.965416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 364 partition: 0 MaxSeqNo: 17 sessionId: src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0
2025-10-02T08:08:35.973266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0] Write session: try to update token
2025-10-02T08:08:35.973294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:35.982256Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:35.982278Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:35.982287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533314150569289:5860]
2025-10-02T08:08:35.982341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:35.982379Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:35.982518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:35.982652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:35.982787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:35.982926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:35.983135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:35.983170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:36.000895Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:36.000916Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:36.000919Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:36.000928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533314150569289:5860]
2025-10-02T08:08:36.000932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533314150569289:5860]
2025-10-02T08:08:36.000975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:36.000981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.000983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:36.000983Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:36.000989Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:36.001131Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:36.008874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId: src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:36.012037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:36.032872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533318445536636:5300]
2025-10-02T08:08:36.033018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 363, pipe: [1:7556533318445536636:5300]
2025-10-02T08:08:36.153683Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:36.154088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.154096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.154119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533318445536636:5300], now have 1 active actors on pipe
2025-10-02T08:08:36.154426Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:36.154803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:36.154860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0
2025-10-02T08:08:36.155079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 364 sessionId: src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0 is DEAD
2025-10-02T08:08:36.155135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533318445536636:5300]
2025-10-02T08:08:36.155541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:36.155556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0] Write session will restart in 0.006986s
2025-10-02T08:08:36.155584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0] Write session: Do CDS request
2025-10-02T08:08:36.155596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:36.157047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:36.164156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:36.164416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:36.164436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 365
2025-10-02T08:08:36.164601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:36.164630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:36.164636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:36.164639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:36.165573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 365 sessionId:  describe result for acl check
2025-10-02T08:08:36.165614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:36.165616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:36.165617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:36.165623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533318445536841:5869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:36.166213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533318445536841:5869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:36.181179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533318445536841:5869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:36.185541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:36.187452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:36.187882Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:36.187886Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:36.187912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:36.187979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:36.188019Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533318445537061:5868]
2025-10-02T08:08:36.188645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:36.188863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:36.188916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:36.189274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:36.189311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.189312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.189313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.189315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.189316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.189322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.189332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.189336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.189340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.189344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.189350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.189358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.189364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.189370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.189375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.189381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.189385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.189391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.189396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.189402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.189422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:36.191956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533318445536841:5869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:36.191974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533318445536841:5869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:36.191978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533318445536841:5869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:36.191989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:36.211300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:36.213362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:36.213382Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:36.213385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:36.213389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:36.213397Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 364 [1:7556533318445537061:5868]
2025-10-02T08:08:36.213410Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:36.213433Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:36.213436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:36.213440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:36.213443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:36.213464Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:36.213470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:36.213478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:36.213559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.213563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.213567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:36.213570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:36.213650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:36.213654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.213672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.213686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:36.213705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533318445537054:5868]
2025-10-02T08:08:36.213707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533318445537054:5868]
2025-10-02T08:08:36.213721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:36.213737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:36.213753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:36.213756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:36.213795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533318445537054:5868]
2025-10-02T08:08:36.213797Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:36.214014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:36.214028Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:36.214034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:36.214965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 364
2025-10-02T08:08:36.215078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 364
2025-10-02T08:08:36.215099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533318445537078:5869], now have 1 active actors on pipe
2025-10-02T08:08:36.215106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533318905877630:2378], now have 1 active actors on pipe
2025-10-02T08:08:36.215216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.215230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.215266Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:36.215279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:36.215285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:36.215288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:36.215302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:36.215318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:36.215343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:36.215376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.215378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.215392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:36.215426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 365 partition: 0 MaxSeqNo: 17 sessionId: src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0
2025-10-02T08:08:36.215934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229833c-bd15f0fc-cfaf55d2-d7603a77_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:36.219358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0] Write session: try to update token
2025-10-02T08:08:36.219380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:36.246160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId: src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:36.249447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:36.250134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.250149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.252123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:36.252143Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:36.252146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:36.252149Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:36.252160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533318445537054:5868]
2025-10-02T08:08:36.252165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533318445537054:5868]
2025-10-02T08:08:36.252215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:36.252225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.252228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:36.252394Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:36.252921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:36.256874Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:36.256881Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:36.257626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533318445537101:5300]
2025-10-02T08:08:36.258464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 364, pipe: [1:7556533318445537101:5300]
2025-10-02T08:08:36.403378Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:36.404100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.404111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.404338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.404430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.404523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.404623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.404701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.404705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.404903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.405000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.405097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.405196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.405256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.405259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.405355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.405436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.405526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.405617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.405676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.405680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.405772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.405861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.405944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.406036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.406094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.406097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.406187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.406269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.406352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.406440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.406502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.406505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.406597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.406678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.406761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.406843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.406901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.406904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.406998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.407081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.407170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.407259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.407326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.407329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.407455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.407547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.407638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.407725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.407783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.407785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.407880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.407982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.408065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.408152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.408283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.408286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.408381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:36.408460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:36.408546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:36.408631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:36.408692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:36.408695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:36.408755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533318445537101:5300], now have 1 active actors on pipe
2025-10-02T08:08:36.409419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:36.409434Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:36.409434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:36.409465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 365 reason: error at write: Disconnected sessionId: src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0
2025-10-02T08:08:36.409657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 365 sessionId: src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0 is DEAD
2025-10-02T08:08:36.409793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533318445537101:5300]
2025-10-02T08:08:36.410021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:36.410029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0] Write session will restart in 0.008010s
2025-10-02T08:08:36.410054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0] Write session: Do CDS request
2025-10-02T08:08:36.410061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:36.410783Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:36.424449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:36.425936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:36.425957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 366
2025-10-02T08:08:36.426290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:36.426330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:36.426336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:36.426340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:36.426897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 366 sessionId:  describe result for acl check
2025-10-02T08:08:36.426933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:36.426935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:36.426936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:36.426942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533318445537397:5877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:36.427537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533318445537397:5877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:36.432737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533318445537397:5877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:36.433668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:36.436325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:36.436673Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:36.436688Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:36.436702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:36.436764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:36.436830Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533318445537536:5876]
2025-10-02T08:08:36.437094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533318445537397:5877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:36.437103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533318445537397:5877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:36.437106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533318445537397:5877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:36.437117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:36.437578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:36.437778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:36.437827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:36.438214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:36.438267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.438271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.438272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.438274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.438275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.438280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.438290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.438293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.438297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.438300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.438307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.438315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.438322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.438327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.438331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.438336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.438341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.438346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.438351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.438357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.438377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:36.448467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:36.450291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:36.450311Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:36.450314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:36.450318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:36.450325Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 365 [1:7556533318445537536:5876]
2025-10-02T08:08:36.450338Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:36.450357Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:36.450360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:36.450363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:36.450366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:36.450383Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:36.450388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:36.450395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:36.450461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.450470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.450473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:36.450475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:36.450633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:36.450639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.450652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.450662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:36.450683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533318445537541:5877], now have 1 active actors on pipe
2025-10-02T08:08:36.450686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533318905877649:2378], now have 1 active actors on pipe
2025-10-02T08:08:36.450693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533318445537525:5876]
2025-10-02T08:08:36.450694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533318445537525:5876]
2025-10-02T08:08:36.450708Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:36.450721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:36.450729Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:36.450732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:36.450734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:36.450737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:36.450770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533318445537525:5876]
2025-10-02T08:08:36.450777Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:36.450783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:36.450823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 365
2025-10-02T08:08:36.450829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.450834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.450859Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:36.450868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:36.450871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:36.450874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:36.450891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:36.450899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:36.450919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:36.451100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.451105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.451120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:36.451150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 366 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0
2025-10-02T08:08:36.451045Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 365
2025-10-02T08:08:36.453441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3098f-c56ba03-1354055f-4ebda72f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:36.456690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0] Write session: try to update token
2025-10-02T08:08:36.456715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:36.475362Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:36.475385Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:36.475397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533318445537525:5876]
2025-10-02T08:08:36.475454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:36.475575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:36.475684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:36.475856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:36.476045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:36.476208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:36.477176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:36.477295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:36.488520Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:36.488543Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:36.488545Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:36.488555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533318445537525:5876]
2025-10-02T08:08:36.488559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533318445537525:5876]
2025-10-02T08:08:36.488598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:36.488604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.488606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:36.488780Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:36.490073Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:36.490093Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:36.512899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533318445537566:5300]
2025-10-02T08:08:36.517076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 365, pipe: [1:7556533318445537566:5300]
2025-10-02T08:08:36.532213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId: src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:36.535536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:36.656475Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:36.656893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533318445537566:5300], now have 1 active actors on pipe
2025-10-02T08:08:36.656910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.656916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.657223Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:36.657686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:36.657747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 366 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0
2025-10-02T08:08:36.657916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 366 sessionId: src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0 is DEAD
2025-10-02T08:08:36.658065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533318445537566:5300]
2025-10-02T08:08:36.658621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:36.658639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0] Write session will restart in 0.005826s
2025-10-02T08:08:36.658677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0] Write session: Do CDS request
2025-10-02T08:08:36.658688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:36.657861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:36.665580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:36.669087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:36.669108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 367
2025-10-02T08:08:36.669517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:36.669564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:36.669574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:36.669579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:36.670258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 367 sessionId:  describe result for acl check
2025-10-02T08:08:36.670285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:36.670286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:36.670288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:36.670293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533318445537807:5883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:36.670942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533318445537807:5883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:36.681077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533318445537807:5883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:36.686463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:36.687202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533318445537807:5883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:36.687207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533318445537807:5883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:36.687210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533318445537807:5883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:36.687218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:36.687346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:36.687567Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:36.687570Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:36.687577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:36.687687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:36.687715Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533318445537992:5882]
2025-10-02T08:08:36.688332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:36.688851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:36.688887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:36.689135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:36.689176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.689177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.689177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.689178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.689179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.689182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.689188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.689191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.689193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.689195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.689199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.689203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.689207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.689211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.689213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.689216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.689218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.689221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.689224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.689227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.689238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:36.699201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:36.701147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:36.701166Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:36.701169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:36.701174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:36.701181Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 366 [1:7556533318445537992:5882]
2025-10-02T08:08:36.701195Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:36.701217Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:36.701221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:36.701225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:36.701227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:36.701249Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:36.701254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:36.701260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:36.701333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.701336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.701339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:36.701341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:36.701412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:36.701415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.701428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.701440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:36.701456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533318445537983:5882]
2025-10-02T08:08:36.701458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533318445537983:5882]
2025-10-02T08:08:36.701470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:36.701483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:36.701496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:36.701500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:36.701534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533318445537983:5882]
2025-10-02T08:08:36.701536Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:36.701623Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:36.701626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:36.701632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:36.703545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 366
2025-10-02T08:08:36.703571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533318445537990:5883], now have 1 active actors on pipe
2025-10-02T08:08:36.703576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533318905877656:2378], now have 1 active actors on pipe
2025-10-02T08:08:36.703658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.703666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.703697Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:36.703706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:36.703710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:36.703713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:36.703726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:36.703741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:36.703763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:36.703862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.703867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.703880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:36.703926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 367 partition: 0 MaxSeqNo: 17 sessionId: src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0
2025-10-02T08:08:36.705283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad96360-91fe779a-c6e6ac7c-f908ed46_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:36.708626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0] Write session: try to update token
2025-10-02T08:08:36.708648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:36.704817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 366
2025-10-02T08:08:36.746642Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:36.746665Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:36.746668Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:36.746681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533318445537983:5882]
2025-10-02T08:08:36.746685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533318445537983:5882]
2025-10-02T08:08:36.746723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:36.746730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.746733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:36.746888Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:36.748948Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:36.748963Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:36.760699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId: src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:36.763782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:36.763851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533318445538021:5300]
2025-10-02T08:08:36.764074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 366, pipe: [1:7556533318445538021:5300]
2025-10-02T08:08:36.943055Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:36.943525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:36.943535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:36.943563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533318445538021:5300], now have 1 active actors on pipe
2025-10-02T08:08:36.944585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:36.944598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0] Write session will restart in 0.009239s
2025-10-02T08:08:36.944626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0] Write session: Do CDS request
2025-10-02T08:08:36.944634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:36.943906Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:36.944227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:36.944275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 367 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0
2025-10-02T08:08:36.944434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 367 sessionId: src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0 is DEAD
2025-10-02T08:08:36.944571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533318445538021:5300]
2025-10-02T08:08:36.944905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:36.955575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:36.956310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:36.956334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 368
2025-10-02T08:08:36.960893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:36.960963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:36.960969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:36.960974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:36.963018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 368 sessionId:  describe result for acl check
2025-10-02T08:08:36.963062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:36.963064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:36.963065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:36.963071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533318445538210:5896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:36.963594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533318445538210:5896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:36.973400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533318445538210:5896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:36.984071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:36.986202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533318445538210:5896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:36.986221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533318445538210:5896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:36.986225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533318445538210:5896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:36.986234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:36.986502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:36.986701Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:36.986704Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:36.986712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:36.986753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:36.986784Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533318445538465:5895]
2025-10-02T08:08:36.987236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:36.987440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:36.987478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:36.987727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:36.987760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.987761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.987762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.987763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.987764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.987768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.987775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.987777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.987780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.987782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.987787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.987791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:36.987795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.987799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:36.987804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.987806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:36.987811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.987814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:36.987816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.987819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:36.987830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:37.002246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:37.004260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:37.004268Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:37.004271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:37.004275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:37.004283Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 367 [1:7556533318445538465:5895]
2025-10-02T08:08:37.004297Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:37.004318Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:37.004322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:37.004325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:37.004327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:37.004346Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:37.004351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:37.004358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:37.004437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.004440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.004445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:37.004448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:37.004536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:37.004539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.004556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.004568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:37.004585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533318445538454:5895]
2025-10-02T08:08:37.004587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533318445538454:5895]
2025-10-02T08:08:37.004602Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:37.004616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:37.004631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:37.004633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:37.004671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533318445538454:5895]
2025-10-02T08:08:37.004674Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:37.004883Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:37.004887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:37.004895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:37.006012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a224f0-ddbc71c6-40b24c0e-bf7e0907_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6bad7503-85a226a4-25225c3d-447587f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:37.008476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 367
2025-10-02T08:08:37.005214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 367
2025-10-02T08:08:37.005245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533318445538462:5896], now have 1 active actors on pipe
2025-10-02T08:08:37.005250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533318905877666:2378], now have 1 active actors on pipe
2025-10-02T08:08:37.005255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.005261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.005290Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bad7503-85a226a4-25225c3d-447587f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:37.005298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:37.005302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:37.005307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:37.005318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:37.005330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:37.005346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:37.005457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.005460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.005474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:37.005505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 368 partition: 0 MaxSeqNo: 17 sessionId: src_id|6bad7503-85a226a4-25225c3d-447587f7_0
2025-10-02T08:08:37.009848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bad7503-85a226a4-25225c3d-447587f7_0] Write session: try to update token
2025-10-02T08:08:37.009865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bad7503-85a226a4-25225c3d-447587f7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:37.035348Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:37.035372Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:37.035374Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:37.035383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533318445538454:5895]
2025-10-02T08:08:37.035388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533318445538454:5895]
2025-10-02T08:08:37.035442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:37.035448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.035450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:37.035459Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:37.035466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:37.035613Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:37.042748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533322740505799:5300]
2025-10-02T08:08:37.044613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 367, pipe: [1:7556533322740505799:5300]
2025-10-02T08:08:37.059224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId: src_id|6bad7503-85a226a4-25225c3d-447587f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:37.062412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:37.282851Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:37.281613Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:37.282148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533322740505799:5300], now have 1 active actors on pipe
2025-10-02T08:08:37.282182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.282191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.283254Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:37.283588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:37.283643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 368 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6bad7503-85a226a4-25225c3d-447587f7_0
2025-10-02T08:08:37.283826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 368 sessionId: src_id|6bad7503-85a226a4-25225c3d-447587f7_0 is DEAD
2025-10-02T08:08:37.283991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533322740505799:5300]
2025-10-02T08:08:37.288251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bad7503-85a226a4-25225c3d-447587f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:37.288273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bad7503-85a226a4-25225c3d-447587f7_0] Write session will restart in 0.009413s
2025-10-02T08:08:37.288317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bad7503-85a226a4-25225c3d-447587f7_0] Write session: Do CDS request
2025-10-02T08:08:37.288327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bad7503-85a226a4-25225c3d-447587f7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:37.301399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bad7503-85a226a4-25225c3d-447587f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:37.304993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:37.305012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 369
2025-10-02T08:08:37.305281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:37.305313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:37.305318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:37.305322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:37.305815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 369 sessionId:  describe result for acl check
2025-10-02T08:08:37.305848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:37.305850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:37.305851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:37.305857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533322740506018:5909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:37.306379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533322740506018:5909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:37.316587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533322740506018:5909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:37.323288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:37.325074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:37.325296Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:37.325307Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:37.325318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:37.325366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:37.325408Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533322740506255:5908]
2025-10-02T08:08:37.326061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:37.326375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:37.326422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:37.326731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:37.326770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.326772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.326773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.326774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.326776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.326781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.326791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.326795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.326799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.326802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.326813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.326823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.326827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.326833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.326837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.326842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.326846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.326851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.326855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.326860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.326878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:37.340012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533322740506018:5909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:37.340029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533322740506018:5909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:37.340032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533322740506018:5909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:37.340041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:37.341320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:37.343293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:37.343300Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:37.343302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:37.343305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:37.343311Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 368 [1:7556533322740506255:5908]
2025-10-02T08:08:37.343331Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:37.343347Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:37.343349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:37.343352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:37.343354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:37.343368Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:37.343373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:37.343379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:37.343433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.343435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.343438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:37.343440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:37.343507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:37.343510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.343524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.343534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:37.343551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533322740506248:5908]
2025-10-02T08:08:37.343553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533322740506248:5908]
2025-10-02T08:08:37.343560Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:37.343571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:37.343582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:37.343585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:37.343610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:37.343615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533322740506248:5908]
2025-10-02T08:08:37.343616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:37.343617Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:37.343623Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:37.343625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533322740506274:5909], now have 1 active actors on pipe
2025-10-02T08:08:37.343646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533323200845003:2378], now have 1 active actors on pipe
2025-10-02T08:08:37.343666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 368
2025-10-02T08:08:37.343873Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 368
2025-10-02T08:08:37.343908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.343920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.343943Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:37.343949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:37.343953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:37.343955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:37.343964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:37.343973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:37.343994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:37.344102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.344108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.344121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:37.344151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 369 partition: 0 MaxSeqNo: 17 sessionId: src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0
2025-10-02T08:08:37.344567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bad7503-85a226a4-25225c3d-447587f7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:37.348389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0] Write session: try to update token
2025-10-02T08:08:37.348407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:37.376579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId: src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:37.378102Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:37.378121Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:37.378124Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:37.378133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533322740506248:5908]
2025-10-02T08:08:37.378137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533322740506248:5908]
2025-10-02T08:08:37.378187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:37.378194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.378197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:37.378368Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:37.380269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:37.380400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:37.380412Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:37.383220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533322740506288:5300]
2025-10-02T08:08:37.383468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 368, pipe: [1:7556533322740506288:5300]
2025-10-02T08:08:37.542021Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:37.542450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.542457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.542478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533322740506288:5300], now have 1 active actors on pipe
2025-10-02T08:08:37.543580Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:37.544824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:37.544835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0] Write session will restart in 0.007708s
2025-10-02T08:08:37.544862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0] Write session: Do CDS request
2025-10-02T08:08:37.544870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:37.543862Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:37.544217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533322740506288:5300]
2025-10-02T08:08:37.544237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:37.544290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 369 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0
2025-10-02T08:08:37.544467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 369 sessionId: src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0 is DEAD
2025-10-02T08:08:37.557343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:37.557600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:37.557618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 370
2025-10-02T08:08:37.566374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:37.566437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:37.566442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:37.566446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:37.566826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 370 sessionId:  describe result for acl check
2025-10-02T08:08:37.566848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:37.566849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:37.566850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:37.566854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533322740506685:5916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:37.567439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533322740506685:5916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:37.567470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:37.569613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:37.569826Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:37.569839Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:37.569851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:37.569914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:37.569958Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533322740506705:5915]
2025-10-02T08:08:37.570542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:37.570811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:37.570856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:37.571157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:37.571218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.571219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.571220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.571221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.571222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.571228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.571236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.571238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.571240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.571242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.571246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.571251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.571255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.571260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.571268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.571272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.571276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.571281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.571284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.571288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.571305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:37.573743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533322740506685:5916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:37.580771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:37.582736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:37.582752Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:37.582755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:37.582759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:37.582765Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 369 [1:7556533322740506705:5915]
2025-10-02T08:08:37.582778Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:37.582796Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:37.582799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:37.582802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:37.582804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:37.582819Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:37.582828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:37.582835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:37.582907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.582914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.582916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:37.582919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:37.582977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:37.582986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.583000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.583011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:37.583037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533323200845012:2378], now have 1 active actors on pipe
2025-10-02T08:08:37.583043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533322740506689:5915]
2025-10-02T08:08:37.583045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533322740506689:5915]
2025-10-02T08:08:37.583055Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:37.583065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:37.583068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:37.583072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:37.583084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:37.583091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:37.583127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533322740506689:5915]
2025-10-02T08:08:37.583142Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:37.583167Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:37.585040Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 369
2025-10-02T08:08:37.589596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533322740506685:5916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:37.589616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533322740506685:5916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:37.589620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533322740506685:5916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:37.589629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:37.589863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 369
2025-10-02T08:08:37.589876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533322740506747:5916], now have 1 active actors on pipe
2025-10-02T08:08:37.589884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.589890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.589916Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|891df719-b54bf3c1-470113e5-f72fa945_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:37.589926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:37.589931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:37.589933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:37.589945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:37.590497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd289dbc-583e26c4-5fca8a5f-eac7575d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|891df719-b54bf3c1-470113e5-f72fa945_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:37.589959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:37.589983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:37.590053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.590055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.590069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:37.590099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 370 partition: 0 MaxSeqNo: 17 sessionId: src_id|891df719-b54bf3c1-470113e5-f72fa945_0
2025-10-02T08:08:37.594059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891df719-b54bf3c1-470113e5-f72fa945_0] Write session: try to update token
2025-10-02T08:08:37.594077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891df719-b54bf3c1-470113e5-f72fa945_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:37.596227Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:37.596245Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:37.596259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533322740506689:5915]
2025-10-02T08:08:37.596305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:37.596361Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:37.596505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:37.596673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:37.596859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:37.597017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:37.597234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:37.597272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:37.621583Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:37.621605Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:37.621608Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:37.621618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533322740506689:5915]
2025-10-02T08:08:37.621622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533322740506689:5915]
2025-10-02T08:08:37.621669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:37.621676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.621678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:37.621832Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:37.624692Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:37.624707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:37.625094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId: src_id|891df719-b54bf3c1-470113e5-f72fa945_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:37.628306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:37.641121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533322740506754:5300]
2025-10-02T08:08:37.641454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 369, pipe: [1:7556533322740506754:5300]
2025-10-02T08:08:37.778988Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:37.779355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.779373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.779398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533322740506754:5300], now have 1 active actors on pipe
2025-10-02T08:08:37.779552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:37.779565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:37.779627Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:37.779635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 370 reason: error at write: Disconnected sessionId: src_id|891df719-b54bf3c1-470113e5-f72fa945_0
2025-10-02T08:08:37.780004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891df719-b54bf3c1-470113e5-f72fa945_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:37.780014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891df719-b54bf3c1-470113e5-f72fa945_0] Write session will restart in 0.006104s
2025-10-02T08:08:37.780039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891df719-b54bf3c1-470113e5-f72fa945_0] Write session: Do CDS request
2025-10-02T08:08:37.780045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891df719-b54bf3c1-470113e5-f72fa945_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:37.779811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 370 sessionId: src_id|891df719-b54bf3c1-470113e5-f72fa945_0 is DEAD
2025-10-02T08:08:37.780001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533322740506754:5300]
2025-10-02T08:08:37.780643Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:37.787439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891df719-b54bf3c1-470113e5-f72fa945_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:37.787834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:37.787853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 371
2025-10-02T08:08:37.788062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:37.788105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:37.788114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:37.788118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:37.789329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 371 sessionId:  describe result for acl check
2025-10-02T08:08:37.789390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:37.789392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:37.789394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:37.789401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533322740506770:5922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:37.790101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533322740506770:5922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:37.796027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533322740506770:5922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:37.802649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533322740506770:5922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:37.802683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533322740506770:5922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:37.802692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533322740506770:5922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:37.802704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:37.817467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:37.820282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:37.820543Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:37.820546Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:37.820559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:37.820623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:37.820664Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533322740507193:5921]
2025-10-02T08:08:37.821271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:37.821524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:37.821568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:37.821814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:37.821858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.821859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.821860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.821861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.821862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.821867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.821877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.821880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.821884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.821887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.821893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.821900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:37.821905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.821910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:37.821915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.821919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:37.821924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.821928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.821933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.821937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.821956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:37.836357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:37.840051Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 370
2025-10-02T08:08:37.838663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:37.838690Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:37.838693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:37.838698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:37.838706Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 370 [1:7556533322740507193:5921]
2025-10-02T08:08:37.838722Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:37.838745Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:37.838748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:37.838751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:37.838753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:37.838775Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:37.838780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:37.838800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:37.838889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.838891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.838894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:37.838897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:37.838984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:37.838988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.839004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:37.839016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:37.839039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533322740507186:5921]
2025-10-02T08:08:37.839041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533322740507186:5921]
2025-10-02T08:08:37.839050Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:37.839067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:37.839081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:37.839084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:37.839084Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:37.839087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:37.839097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533322740507035:5922], now have 1 active actors on pipe
2025-10-02T08:08:37.839137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533322740507186:5921]
2025-10-02T08:08:37.839151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:37.839157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533323200845018:2378], now have 1 active actors on pipe
2025-10-02T08:08:37.839211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 370
2025-10-02T08:08:37.839333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:37.843220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.843245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.843297Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:37.843309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:37.843314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:37.843317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:37.843332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:37.843350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:37.843373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:37.843456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:37.843458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:37.843471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:37.843506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 371 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0
2025-10-02T08:08:37.845126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891df719-b54bf3c1-470113e5-f72fa945_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:37.848341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0] Write session: try to update token
2025-10-02T08:08:37.848367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:37.856042Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:37.856066Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:37.856081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533322740507186:5921]
2025-10-02T08:08:37.856130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:37.856340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:37.856509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:37.856677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:37.856872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:37.857113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:37.857171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:37.857547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:37.879821Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:37.879844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:37.879847Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:37.879858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533322740507186:5921]
2025-10-02T08:08:37.879863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533322740507186:5921]
2025-10-02T08:08:37.879929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:37.879937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:37.879940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:37.880139Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:37.880584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId: src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:37.880854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:37.880860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:37.883595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:37.883654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533322740507218:5300]
2025-10-02T08:08:37.883810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 370, pipe: [1:7556533322740507218:5300]
2025-10-02T08:08:38.035860Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:38.036439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.036450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.036476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533322740507218:5300], now have 1 active actors on pipe
2025-10-02T08:08:38.036923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:38.037378Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:38.037743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:38.037810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 371 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0
2025-10-02T08:08:38.038015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 371 sessionId: src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0 is DEAD
2025-10-02T08:08:38.038171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533322740507218:5300]
2025-10-02T08:08:38.038496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:38.038514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0] Write session will restart in 0.006403s
2025-10-02T08:08:38.038548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0] Write session: Do CDS request
2025-10-02T08:08:38.038556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:38.049404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:38.049563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:38.049582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 372
2025-10-02T08:08:38.051381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:38.051465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:38.051474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:38.051480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:38.053310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 372 sessionId:  describe result for acl check
2025-10-02T08:08:38.053347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:38.053348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:38.053350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:38.053357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533327035474721:5931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:38.054019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533327035474721:5931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:38.083569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533327035474721:5931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:38.094114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:38.097187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:38.097420Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:38.097429Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:38.097441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:38.097497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:38.097538Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533327035474959:5928]
2025-10-02T08:08:38.098302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:38.098602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:38.098646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:38.098964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:38.099008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.099009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.099010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.099012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.099013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.099018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.099028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.099032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.099036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.099039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.099045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.099052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.099059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.099064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.099069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.099074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.099081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.099086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.099090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.099095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.099118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:38.105204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533327035474721:5931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:38.105224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533327035474721:5931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:38.105228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533327035474721:5931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:38.105237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:38.114089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:38.116188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:38.116194Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:38.116198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:38.116202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:38.116209Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 371 [1:7556533327035474959:5928]
2025-10-02T08:08:38.116222Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:38.116242Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:38.116245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:38.116250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:38.116251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:38.116272Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:38.116278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:38.116285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:38.116357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.116378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.116381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:38.116383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:38.116462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:38.116866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 371
2025-10-02T08:08:38.116885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.116900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.116911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:38.116935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533327035474975:5931], now have 1 active actors on pipe
2025-10-02T08:08:38.116938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533327495812325:2378], now have 1 active actors on pipe
2025-10-02T08:08:38.116943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.116951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.116971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533327035474947:5928]
2025-10-02T08:08:38.117005Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 371
2025-10-02T08:08:38.116982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533327035474947:5928]
2025-10-02T08:08:38.116991Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:38.117007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:38.117020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:38.117023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:38.117040Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:38.117047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:38.117051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:38.117053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:38.117063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:38.117073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:38.117115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533327035474947:5928]
2025-10-02T08:08:38.117124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:38.117138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:38.117233Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:38.117236Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:38.117241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:38.117503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.117514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.117545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:38.117579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 372 partition: 0 MaxSeqNo: 17 sessionId: src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0
2025-10-02T08:08:38.118036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f5a8f58-cea6c88e-e3b4a7df-166572f3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:38.121022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0] Write session: try to update token
2025-10-02T08:08:38.121051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:38.134870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533327035475008:5300]
2025-10-02T08:08:38.135135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 371, pipe: [1:7556533327035475008:5300]
2025-10-02T08:08:38.135162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533327035475008:5300], now have 1 active actors on pipe
2025-10-02T08:08:38.142705Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:38.142726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:38.142729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:38.142737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533327035474947:5928]
2025-10-02T08:08:38.142740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533327035474947:5928]
2025-10-02T08:08:38.142785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:38.142783Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:38.142790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:38.142791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.142793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:38.142983Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:38.152858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId: src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:38.156392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:38.318528Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:38.320771Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:38.321067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:38.321086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0] Write session will restart in 0.009000s
2025-10-02T08:08:38.321115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0] Write session: Do CDS request
2025-10-02T08:08:38.321123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:38.319614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.319638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.320015Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:38.320348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:38.320411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 372 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0
2025-10-02T08:08:38.320621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 372 sessionId: src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0 is DEAD
2025-10-02T08:08:38.320771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533327035475008:5300]
2025-10-02T08:08:38.331425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:38.332650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:38.332667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 373
2025-10-02T08:08:38.332905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:38.332953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:38.332961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:38.332966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:38.334314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 373 sessionId:  describe result for acl check
2025-10-02T08:08:38.334348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:38.334350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:38.334352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:38.334359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533327035475170:5948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:38.334974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533327035475170:5948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:38.346811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533327035475170:5948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:38.352486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533327035475170:5948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:38.352505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533327035475170:5948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:38.352510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533327035475170:5948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:38.352519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:38.355775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:38.356294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:38.356474Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:38.356477Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:38.356486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:38.356530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:38.356563Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533327035475473:5947]
2025-10-02T08:08:38.357206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:38.357443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:38.357479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:38.357785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:38.357820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.357822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.357823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.357824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.357825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.357829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.357840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.357844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.357847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.357850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.357856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.357863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.357869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.357873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.357879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.357884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.357888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.357892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.357897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.357901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.357917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:38.376785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:38.378794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:38.378800Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:38.378801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:38.378805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:38.378812Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 372 [1:7556533327035475473:5947]
2025-10-02T08:08:38.378824Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:38.378842Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:38.378845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:38.378848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:38.378849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:38.378865Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:38.378870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:38.378878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:38.378938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.378940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.378943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:38.378948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:38.379014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:38.379016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.379029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.379038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:38.379054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533327035475467:5947]
2025-10-02T08:08:38.379056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533327035475467:5947]
2025-10-02T08:08:38.379062Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:38.379077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:38.379090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:38.379093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:38.379128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533327035475467:5947]
2025-10-02T08:08:38.379129Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:38.379838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 372
2025-10-02T08:08:38.379383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:38.379392Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:38.379397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:38.380113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 372
2025-10-02T08:08:38.380127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533327035475462:5948], now have 1 active actors on pipe
2025-10-02T08:08:38.380131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533327495812366:2378], now have 1 active actors on pipe
2025-10-02T08:08:38.380454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.380465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.380490Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:38.380498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:38.380501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:38.380503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:38.380514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:38.380525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:38.380541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:38.380647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.380652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.380665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:38.380696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 373 partition: 0 MaxSeqNo: 17 sessionId: src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0
2025-10-02T08:08:38.384944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52b9937-fc700227-38cf7cb3-f38a99e2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:38.387858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0] Write session: try to update token
2025-10-02T08:08:38.387906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:38.408205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:38.408226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:38.408229Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:38.408237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533327035475467:5947]
2025-10-02T08:08:38.408242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533327035475467:5947]
2025-10-02T08:08:38.408288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:38.408295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.408298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:38.408481Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:38.413115Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:38.413130Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:38.420851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533327035475501:5300]
2025-10-02T08:08:38.421075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 372, pipe: [1:7556533327035475501:5300]
2025-10-02T08:08:38.435307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId: src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:38.438897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:38.590036Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:38.590348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533327035475501:5300], now have 1 active actors on pipe
2025-10-02T08:08:38.590386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.590392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.592903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533327035475501:5300]
2025-10-02T08:08:38.592928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:38.592930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:38.593003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 373 reason: error at write: Disconnected sessionId: src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0
2025-10-02T08:08:38.593116Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:38.593203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 373 sessionId: src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0 is DEAD
2025-10-02T08:08:38.596585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:38.596597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0] Write session will restart in 0.008607s
2025-10-02T08:08:38.596625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0] Write session: Do CDS request
2025-10-02T08:08:38.596643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:38.594861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:38.609338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:38.609486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:38.609509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 374
2025-10-02T08:08:38.612714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:38.612780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:38.612785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:38.612789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:38.616142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 374 sessionId:  describe result for acl check
2025-10-02T08:08:38.616189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:38.616191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:38.616193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:38.616202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533327035475895:5955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:38.616738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533327035475895:5955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:38.624605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:38.625280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:38.625484Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:38.625498Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:38.625508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:38.625558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:38.625614Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533327035475929:5954]
2025-10-02T08:08:38.626283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:38.626535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:38.626582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:38.626923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:38.626968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.626976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.626978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.626979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.626981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.626986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.626998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.627002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.627007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.627011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.627016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.627024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.627030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.627036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.627041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.627047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.627051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.627056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.627061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.627067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.627087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:38.633839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533327035475895:5955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:38.646942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:38.648782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:38.648825Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:38.648828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:38.648833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:38.648842Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 373 [1:7556533327035475929:5954]
2025-10-02T08:08:38.648856Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:38.648877Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:38.648880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:38.648884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:38.648886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:38.648906Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:38.648911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:38.648918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:38.648992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.649004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.649008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:38.649011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:38.649074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:38.649078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.649093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.649105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:38.649124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533327035475920:5954]
2025-10-02T08:08:38.649126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533327035475920:5954]
2025-10-02T08:08:38.649137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:38.649149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:38.649166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:38.649169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:38.649208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533327035475920:5954]
2025-10-02T08:08:38.649211Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:38.649295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533327035475895:5955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:38.649304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533327035475895:5955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:38.649307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533327035475895:5955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:38.649434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:38.649649Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:38.649652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:38.649657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:38.650018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533327495812374:2378], now have 1 active actors on pipe
2025-10-02T08:08:38.650109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 373
2025-10-02T08:08:38.650116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533327035475962:5955], now have 1 active actors on pipe
2025-10-02T08:08:38.650121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.650127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.650155Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:38.650163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:38.650167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:38.650170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:38.650180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:38.650195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:38.650213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:38.650322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.650329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.650357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:38.650401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 374 partition: 0 MaxSeqNo: 17 sessionId: src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0
2025-10-02T08:08:38.650396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 373
2025-10-02T08:08:38.656217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0c64c6e-9ccfb3ef-97c8cba-5782066d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:38.659239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0] Write session: try to update token
2025-10-02T08:08:38.659260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:38.677319Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:38.677340Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:38.677342Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:38.677352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533327035475920:5954]
2025-10-02T08:08:38.677356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533327035475920:5954]
2025-10-02T08:08:38.677400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:38.677408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.677411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:38.677593Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:38.679523Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:38.679531Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:38.686584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId: src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:38.689937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:38.696979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533327035475973:5300]
2025-10-02T08:08:38.697651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 373, pipe: [1:7556533327035475973:5300]
2025-10-02T08:08:38.824058Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:38.824530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.824538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.824560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533327035475973:5300], now have 1 active actors on pipe
2025-10-02T08:08:38.824903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:38.824697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533327035475973:5300]
2025-10-02T08:08:38.824721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:38.824723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:38.824784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 374 reason: error at write: Disconnected sessionId: src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0
2025-10-02T08:08:38.824966Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:38.824977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 374 sessionId: src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0 is DEAD
2025-10-02T08:08:38.828933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:38.828952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0] Write session will restart in 0.008258s
2025-10-02T08:08:38.828982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0] Write session: Do CDS request
2025-10-02T08:08:38.828991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:38.841562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:38.842128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:38.842157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 375
2025-10-02T08:08:38.847346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:38.847417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:38.847423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:38.847428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:38.849179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 375 sessionId:  describe result for acl check
2025-10-02T08:08:38.849214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:38.849216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:38.849218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:38.849224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533327035476009:5962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:38.849804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533327035476009:5962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:38.865517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533327035476009:5962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:38.879612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533327035476009:5962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:38.879634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533327035476009:5962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:38.879637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533327035476009:5962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:38.879649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:38.896022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:38.898123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:38.898339Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:38.898348Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:38.898361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:38.898409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:38.898458Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533327035476420:5961]
2025-10-02T08:08:38.899118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:38.899481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:38.899519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:38.899781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:38.899819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.899819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.899820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.899821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.899822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.899826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.899834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.899837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.899840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.899842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.899846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.899852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:38.899857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.899860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:38.899864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.899868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:38.899871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.899888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.899893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.899896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.899912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:38.909943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:38.912524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:38.912550Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:38.912552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:38.912557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:38.912566Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 374 [1:7556533327035476420:5961]
2025-10-02T08:08:38.912583Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:38.912606Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:38.912609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:38.912613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:38.912616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:38.912639Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:38.912650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:38.912660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:38.912753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.912755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.912759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:38.912761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:38.913345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 374
2025-10-02T08:08:38.913891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:38.913903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.913922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:38.913933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:38.913945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533327035476265:5962], now have 1 active actors on pipe
2025-10-02T08:08:38.913949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533327495812382:2378], now have 1 active actors on pipe
2025-10-02T08:08:38.913955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.913961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.914002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533327035476414:5961]
2025-10-02T08:08:38.914005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533327035476414:5961]
2025-10-02T08:08:38.914013Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:38.914039Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:38.914044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:38.914047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:38.914049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:38.914056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:38.914059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:38.914072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:38.914086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:38.914103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:38.914119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:38.914122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:38.914176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:38.914203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533327035476414:5961]
2025-10-02T08:08:38.914211Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:38.914377Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:38.914725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:38.914732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:38.914753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:38.914796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 375 partition: 0 MaxSeqNo: 17 sessionId: src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0
2025-10-02T08:08:38.916993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbdbd80-48c1b964-be2e9399-5bf82987_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:38.916990Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 374
2025-10-02T08:08:38.919567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0] Write session: try to update token
2025-10-02T08:08:38.919590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:38.924691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533327035476442:5300]
2025-10-02T08:08:38.924952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 374, pipe: [1:7556533327035476442:5300]
2025-10-02T08:08:38.924978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533327035476442:5300], now have 1 active actors on pipe
2025-10-02T08:08:38.941153Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:38.941178Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:38.941182Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:38.941194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533327035476414:5961]
2025-10-02T08:08:38.941200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533327035476414:5961]
2025-10-02T08:08:38.941253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:38.941263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:38.941266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:38.941471Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:38.941864Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:38.941872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:38.956467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId: src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:38.959549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:39.152584Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:39.153418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.153430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.157697Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:39.158119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:39.158174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 375 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0
2025-10-02T08:08:39.158363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 375 sessionId: src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0 is DEAD
2025-10-02T08:08:39.158502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533327035476442:5300]
2025-10-02T08:08:39.161269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:39.161286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0] Write session will restart in 0.006791s
2025-10-02T08:08:39.161315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0] Write session: Do CDS request
2025-10-02T08:08:39.161325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:39.160884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:39.170938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:39.172772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:39.172789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 376
2025-10-02T08:08:39.178547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:39.178597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:39.178601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:39.178604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:39.179602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 376 sessionId:  describe result for acl check
2025-10-02T08:08:39.179633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:39.179635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:39.179636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:39.179644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533331330443953:5974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:39.180401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533331330443953:5974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:39.186603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533331330443953:5974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:39.203168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533331330443953:5974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:39.203192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533331330443953:5974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:39.203196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533331330443953:5974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:39.203208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:39.210776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:39.211167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:39.211355Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:39.211359Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:39.211369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:39.211418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:39.211458Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533331330444218:5973]
2025-10-02T08:08:39.212177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:39.212499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:39.212549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:39.212871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:39.212922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.212923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.212924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.212926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.212927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.212931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.212941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.212945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.212949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.212952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.212957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.212964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.212970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.212975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.212979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.212983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.212987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.212992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.212997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.213001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.213020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:39.226171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:39.230192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:39.230221Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:39.230224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:39.230230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:39.230241Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 375 [1:7556533331330444218:5973]
2025-10-02T08:08:39.230259Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:39.230287Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:39.230291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.230295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.230297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.230324Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:39.230332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:39.230342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:39.230442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.230444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.230449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:39.230452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:39.230554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:39.230558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.230577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.230589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:39.230615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533331330444212:5973]
2025-10-02T08:08:39.230617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533331330444212:5973]
2025-10-02T08:08:39.230698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:39.230702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:39.232906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 375
2025-10-02T08:08:39.236923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 375
2025-10-02T08:08:39.236215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:39.236330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:39.236364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:39.236369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:39.236394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533331330444197:5974], now have 1 active actors on pipe
2025-10-02T08:08:39.236402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533331790779686:2378], now have 1 active actors on pipe
2025-10-02T08:08:39.236410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.236417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.236493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533331330444212:5973]
2025-10-02T08:08:39.236508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:39.236533Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:39.236548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.236554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.236557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:39.236576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.236610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:39.236662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:39.236768Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:39.237072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.237085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.237131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:39.237178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 376 partition: 0 MaxSeqNo: 17 sessionId: src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0
2025-10-02T08:08:39.237915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc9c613-6401b4d0-47a06a8c-d958ecc0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:39.241141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0] Write session: try to update token
2025-10-02T08:08:39.241166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:39.260930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533331330444247:5300]
2025-10-02T08:08:39.261189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 375, pipe: [1:7556533331330444247:5300]
2025-10-02T08:08:39.261213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533331330444247:5300], now have 1 active actors on pipe
2025-10-02T08:08:39.264051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId: src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:39.267471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:39.268919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.268943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.268992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:39.269012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:39.269262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.269268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.269437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.269502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.269576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.269650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.270151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.270157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.270259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.270334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.270415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.270572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.270626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.270630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.270729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.270814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.270905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.270999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.271057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.271061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.271155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.271242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.271340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.271470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.271565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.271569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.271665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.271754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.271834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.271934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.272012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.272015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.272126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.272221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.272304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.272385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.272438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.272442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.272553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.272646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.272750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.272861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.272932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.272934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.273034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.273126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.273210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.273299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.273357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.273360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.273461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.273548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.273640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.273725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.273786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.273790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.273892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:39.273978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:39.274071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:39.274160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:39.274226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:39.274230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:39.274297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:39.274388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.274411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.274415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:39.274466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:39.274486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:39.274490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:39.274494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:39.274498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:39.274994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:39.275019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:39.275028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:39.275033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:39.275036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:39.275040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:39.275641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:39.275661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:39.275669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:39.275673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:39.275678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:39.275682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:39.276490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:39.276509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:39.276517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:39.276521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:39.276525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:39.278860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:39.278894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:39.278912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392519277
2025-10-02T08:08:39.279222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:39.279239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:39.279247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:39.279252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:39.279262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:39.279266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:39.279899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:39.279919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:39.279927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:39.279931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:39.279935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:39.279939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:39.280591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:39.280611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:39.280619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:39.280623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:39.280628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:39.280632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:39.281692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:39.281731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:39.281739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:39.283290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:39.283303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:39.283310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:39.283316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:39.283329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392519280
2025-10-02T08:08:39.283742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:39.283763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:39.283776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:39.283780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:39.283785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:39.283792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:39.284358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:39.284378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:39.284386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:39.284391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:39.284395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:39.284399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:39.285331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:39.285365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.285501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392519284
2025-10-02T08:08:39.286494Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:39.286511Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:39.286519Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:39.286526Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:39.290307Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:39.290330Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:39.290333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:39.290344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533331330444212:5973]
2025-10-02T08:08:39.290350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533331330444212:5973]
2025-10-02T08:08:39.290409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:39.290417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.290421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:39.290594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:39.290603Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:39.290831Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:39.472749Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:39.473638Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:39.473922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:39.473973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0
2025-10-02T08:08:39.474194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 376 sessionId: src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0 is DEAD
2025-10-02T08:08:39.474416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533331330444247:5300]
2025-10-02T08:08:39.474771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:39.474783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0] Write session will restart in 0.008339s
2025-10-02T08:08:39.474808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0] Write session: Do CDS request
2025-10-02T08:08:39.474815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:39.474812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:39.484473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:39.484640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:39.484662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 377
2025-10-02T08:08:39.486528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:39.486591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:39.486598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:39.486603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:39.487256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 377 sessionId:  describe result for acl check
2025-10-02T08:08:39.487304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:39.487306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:39.487307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:39.487313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533331330444663:5990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:39.487910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533331330444663:5990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:39.492698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533331330444663:5990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:39.493689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:39.496996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:39.497168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533331330444663:5990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:39.497176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533331330444663:5990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:39.497180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533331330444663:5990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:39.497192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:39.497251Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:39.497256Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:39.497268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:39.497339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:39.497381Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533331330444725:5989]
2025-10-02T08:08:39.498075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:39.498357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:39.498405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:39.498717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:39.498776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.498782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.498784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.498785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.498785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.498791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.498801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.498806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.498810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.498813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.498819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.498826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.498833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.498838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.498843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.498848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.498852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.498857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.498863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.498873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.498892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:39.507527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:39.509029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:39.509048Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:39.509050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:39.509054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:39.509060Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 376 [1:7556533331330444725:5989]
2025-10-02T08:08:39.509074Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:39.509094Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:39.509104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.509107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.509109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.509127Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:39.509132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:39.509139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:39.509204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.509212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.509215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:39.509218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:39.509285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:39.509293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.509306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.509321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:39.509344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533331330444714:5989]
2025-10-02T08:08:39.509350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533331330444714:5989]
2025-10-02T08:08:39.509363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:39.509380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:39.509393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:39.509396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:39.509433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533331330444714:5989]
2025-10-02T08:08:39.509436Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:39.509452Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:39.509455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:39.509457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533331790779729:2378], now have 1 active actors on pipe
2025-10-02T08:08:39.509461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:39.510416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ecc3f-37201ffb-b0d7a736-67a8689e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:39.513328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 376
2025-10-02T08:08:39.513779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0] Write session: try to update token
2025-10-02T08:08:39.513795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:39.509789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 376
2025-10-02T08:08:39.509807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533331330444727:5990], now have 1 active actors on pipe
2025-10-02T08:08:39.509814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.509819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.509849Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:39.509857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.509861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.509864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:39.509877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.509889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:39.509906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:39.509947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.509949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.509962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:39.510000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 377 partition: 0 MaxSeqNo: 17 sessionId: src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0
2025-10-02T08:08:39.542494Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:39.542516Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:39.542518Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:39.542525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533331330444714:5989]
2025-10-02T08:08:39.542528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533331330444714:5989]
2025-10-02T08:08:39.542562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:39.542567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.542568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:39.542583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:39.542600Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:39.542709Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:39.550784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId: src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:39.555034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:39.576949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533331330444754:5300]
2025-10-02T08:08:39.577095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 376, pipe: [1:7556533331330444754:5300]
2025-10-02T08:08:39.692125Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:39.692548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.692555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.692576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533331330444754:5300], now have 1 active actors on pipe
2025-10-02T08:08:39.692941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533331330444754:5300]
2025-10-02T08:08:39.692972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:39.692975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:39.693106Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:39.693643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:39.693653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0] Write session will restart in 0.008399s
2025-10-02T08:08:39.693680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0] Write session: Do CDS request
2025-10-02T08:08:39.693688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:39.693038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 377 reason: error at write: Disconnected sessionId: src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0
2025-10-02T08:08:39.693243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 377 sessionId: src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0 is DEAD
2025-10-02T08:08:39.693755Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:39.703684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:39.705192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:39.705219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 378
2025-10-02T08:08:39.705382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:39.705412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:39.705419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:39.705428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:39.706047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 378 sessionId:  describe result for acl check
2025-10-02T08:08:39.706091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:39.706094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:39.706095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:39.706104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533331330444953:5996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:39.706733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533331330444953:5996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:39.714093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533331330444953:5996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:39.720576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:39.721210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533331330444953:5996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:39.721232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533331330444953:5996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:39.721236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533331330444953:5996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:39.721255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:39.722417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:39.722833Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:39.722845Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:39.722858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:39.722919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:39.722966Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533331330445205:5995]
2025-10-02T08:08:39.723604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:39.723854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:39.723921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:39.724254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:39.724297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.724298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.724299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.724300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.724301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.724307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.724318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.724322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.724326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.724330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.724336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.724343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.724349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.724355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.724362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.724367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.724371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.724377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.724381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.724386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.724402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:39.733886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:39.735397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:39.735416Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:39.735419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:39.735422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:39.735428Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 377 [1:7556533331330445205:5995]
2025-10-02T08:08:39.735439Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:39.735455Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:39.735457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.735459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.735461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.735474Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:39.735478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:39.735484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:39.735537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.735539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.735541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:39.735543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:39.735601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:39.735603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.735611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.735619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:39.735632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533331330445193:5995]
2025-10-02T08:08:39.735638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533331330445193:5995]
2025-10-02T08:08:39.735644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:39.735654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:39.735663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:39.735667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:39.735668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:39.735669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:39.735677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533331330445201:5996], now have 1 active actors on pipe
2025-10-02T08:08:39.735705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533331330445193:5995]
2025-10-02T08:08:39.735713Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:39.735717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533331790779735:2378], now have 1 active actors on pipe
2025-10-02T08:08:39.735722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:39.735758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 377
2025-10-02T08:08:39.735774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.735778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.735799Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:39.735808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.735811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.735813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:39.735820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.735828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:39.735843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:39.735882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.735889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.735902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:39.735938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 378 partition: 0 MaxSeqNo: 17 sessionId: src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0
2025-10-02T08:08:39.736158Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 377
2025-10-02T08:08:39.736345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163c7d81-9c7cb3ee-a6bc079c-1584c72b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:39.739797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0] Write session: try to update token
2025-10-02T08:08:39.739815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:39.763050Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:39.763079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:39.763083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:39.763096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533331330445193:5995]
2025-10-02T08:08:39.763101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533331330445193:5995]
2025-10-02T08:08:39.763162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:39.763171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.763174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:39.763174Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:39.763186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:39.763328Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:39.778726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId: src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:39.781943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:39.797305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533331330445229:5300]
2025-10-02T08:08:39.797702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 377, pipe: [1:7556533331330445229:5300]
2025-10-02T08:08:39.949123Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:39.949573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.949585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.949608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533331330445229:5300], now have 1 active actors on pipe
2025-10-02T08:08:39.949731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533331330445229:5300]
2025-10-02T08:08:39.949749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:39.949751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:39.949797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 378 reason: error at write: Disconnected sessionId: src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0
2025-10-02T08:08:39.949880Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:39.949873Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:39.949995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 378 sessionId: src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0 is DEAD
2025-10-02T08:08:39.952930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:39.952945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0] Write session will restart in 0.008832s
2025-10-02T08:08:39.952973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0] Write session: Do CDS request
2025-10-02T08:08:39.952980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:39.963689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:39.965465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:39.965490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 379
2025-10-02T08:08:39.969116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:39.969577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:39.969659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:39.969667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:39.969673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:39.970263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 379 sessionId:  describe result for acl check
2025-10-02T08:08:39.970300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:39.970302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:39.970303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:39.970309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533331330445651:6003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:39.970828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533331330445651:6003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:39.971066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:39.971279Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:39.971282Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:39.971291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:39.971336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:39.971371Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533331330445656:6002]
2025-10-02T08:08:39.972032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:39.972296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:39.972358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:39.972686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:39.972752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.972757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.972758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.972759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.972760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.972764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.972771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.972773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.972775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.972778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.972783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.972789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:39.972793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.972796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:39.972799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.972820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:39.972824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.972829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.972834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.972839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.972858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:39.974719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533331330445651:6003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:39.980167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533331330445651:6003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:39.980184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533331330445651:6003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:39.980188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533331330445651:6003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:39.980196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:39.984686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:39.986355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:39.986375Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:39.986377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:39.986381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:39.986389Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 378 [1:7556533331330445656:6002]
2025-10-02T08:08:39.986402Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:39.986421Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:39.986436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.986439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.986442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.986459Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:39.986465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:39.986472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:39.986539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.986547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.986551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:39.986553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:39.986619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:39.986626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:39.986640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:39.986652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:39.986670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533331330445694:6003], now have 1 active actors on pipe
2025-10-02T08:08:39.986678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533331790779743:2378], now have 1 active actors on pipe
2025-10-02T08:08:39.986687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533331330445645:6002]
2025-10-02T08:08:39.986689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533331330445645:6002]
2025-10-02T08:08:39.986698Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:39.986708Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:39.986710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:39.986712Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:39.986726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:39.986733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:39.986768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533331330445645:6002]
2025-10-02T08:08:39.986781Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:39.986826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 378
2025-10-02T08:08:39.986839Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:39.986874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.986885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.986908Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22e26f77-2c814d35-2258ab24-80378b4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:39.986914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:39.986917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:39.986896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 378
2025-10-02T08:08:39.986920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:39.986929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:39.986939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:39.986960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:39.987001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:39.987007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:39.987020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:39.987049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 379 partition: 0 MaxSeqNo: 17 sessionId: src_id|22e26f77-2c814d35-2258ab24-80378b4e_0
2025-10-02T08:08:39.987547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|683c51f1-bc309268-8f0fa4b6-b545135e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|22e26f77-2c814d35-2258ab24-80378b4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:39.991153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22e26f77-2c814d35-2258ab24-80378b4e_0] Write session: try to update token
2025-10-02T08:08:39.991181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22e26f77-2c814d35-2258ab24-80378b4e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:40.003577Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:40.003600Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:40.003609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533331330445645:6002]
2025-10-02T08:08:40.003660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:40.003660Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:40.003923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:40.004124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:40.004304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:40.004492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:40.004997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:40.005035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:40.020059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId: src_id|22e26f77-2c814d35-2258ab24-80378b4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:40.022775Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:40.022796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:40.022799Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:40.022808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533331330445645:6002]
2025-10-02T08:08:40.022812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533331330445645:6002]
2025-10-02T08:08:40.022854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:40.022861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.022863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:40.022863Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:40.022870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:40.023014Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:40.023252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:40.049997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533335625413006:5300]
2025-10-02T08:08:40.050110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 378, pipe: [1:7556533335625413006:5300]
2025-10-02T08:08:40.179628Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:40.180007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.180023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.180046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625413006:5300], now have 1 active actors on pipe
2025-10-02T08:08:40.180187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:40.180197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:40.180258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 379 reason: error at write: Disconnected sessionId: src_id|22e26f77-2c814d35-2258ab24-80378b4e_0
2025-10-02T08:08:40.180288Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:40.180356Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:40.180426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 379 sessionId: src_id|22e26f77-2c814d35-2258ab24-80378b4e_0 is DEAD
2025-10-02T08:08:40.180569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533335625413006:5300]
2025-10-02T08:08:40.180581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e26f77-2c814d35-2258ab24-80378b4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:40.180591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e26f77-2c814d35-2258ab24-80378b4e_0] Write session will restart in 0.008134s
2025-10-02T08:08:40.180621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e26f77-2c814d35-2258ab24-80378b4e_0] Write session: Do CDS request
2025-10-02T08:08:40.180628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e26f77-2c814d35-2258ab24-80378b4e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:40.190389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22e26f77-2c814d35-2258ab24-80378b4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.190558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:40.190576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 380
2025-10-02T08:08:40.190740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.190776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:40.190786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:40.190790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:40.191313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 380 sessionId:  describe result for acl check
2025-10-02T08:08:40.191376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:40.191386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:40.191388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:40.191395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533335625413369:6009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:40.192169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533335625413369:6009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:40.195348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:40.196020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533335625413369:6009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:40.196492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:40.196679Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:40.196689Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:40.196698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:40.196746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:40.196781Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533335625413464:6008]
2025-10-02T08:08:40.197467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:40.198021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:40.198067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:40.198399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:40.198443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.198449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.198450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.198452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.198453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.198459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.198469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.198473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.198478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.198482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.198487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.198507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.198517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.198522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.198528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.198533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.198537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.198542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.198547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.198551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.198572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:40.203297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533335625413369:6009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:40.203314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533335625413369:6009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:40.203318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533335625413369:6009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:40.203326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:40.207300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:40.209392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:40.209412Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:40.209414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:40.209418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:40.209424Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 379 [1:7556533335625413464:6008]
2025-10-02T08:08:40.209435Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:40.209450Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:40.209453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.209456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.209457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.209476Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:40.209481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:40.209487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:40.209543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.209545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.209548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:40.209550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:40.209616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:40.209619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.209646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.209657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:40.209674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625413484:6009], now have 1 active actors on pipe
2025-10-02T08:08:40.209677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533336085747047:2378], now have 1 active actors on pipe
2025-10-02T08:08:40.209683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533335625413443:6008]
2025-10-02T08:08:40.209685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533335625413443:6008]
2025-10-02T08:08:40.209696Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:40.209707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:40.209719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:40.209721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:40.209724Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:40.209727Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:40.209753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533335625413443:6008]
2025-10-02T08:08:40.209759Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:40.209790Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:40.209801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 379
2025-10-02T08:08:40.210132Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 379
2025-10-02T08:08:40.210182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.210206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.210238Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:40.210251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.210267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.210281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:40.210291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.210306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:40.210329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:40.210364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.210371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.210383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:40.210411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 380 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0
2025-10-02T08:08:40.210841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e26f77-2c814d35-2258ab24-80378b4e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:40.214342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0] Write session: try to update token
2025-10-02T08:08:40.214360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:40.229346Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:40.229366Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:40.229369Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:40.229379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533335625413443:6008]
2025-10-02T08:08:40.229383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533335625413443:6008]
2025-10-02T08:08:40.229431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:40.229437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.229439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:40.229600Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:40.232075Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:40.232099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:40.241751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId: src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:40.244706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:40.280890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533335625413526:5300]
2025-10-02T08:08:40.281110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 379, pipe: [1:7556533335625413526:5300]
2025-10-02T08:08:40.402290Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:40.402567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.402580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.402601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625413526:5300], now have 1 active actors on pipe
2025-10-02T08:08:40.402814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533335625413526:5300]
2025-10-02T08:08:40.402833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:40.402839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:40.402887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 380 reason: error at write: Disconnected sessionId: src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0
2025-10-02T08:08:40.402904Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:40.403058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 380 sessionId: src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0 is DEAD
2025-10-02T08:08:40.403228Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:40.404896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:40.404908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0] Write session will restart in 0.006630s
2025-10-02T08:08:40.404935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0] Write session: Do CDS request
2025-10-02T08:08:40.404942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:40.412372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.412491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:40.412519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 381
2025-10-02T08:08:40.412727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.412784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:40.412797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:40.412817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:40.413341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 381 sessionId:  describe result for acl check
2025-10-02T08:08:40.413392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:40.413399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:40.413401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:40.413406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533335625413864:6029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:40.413939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533335625413864:6029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:40.417218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533335625413864:6029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:40.418470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:40.419529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:40.419720Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:40.419733Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:40.419745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:40.419805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:40.419844Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533335625413991:6028]
2025-10-02T08:08:40.420498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:40.420606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533335625413864:6029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:40.420620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533335625413864:6029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:40.420624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533335625413864:6029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:40.420632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:40.420757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:40.420819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:40.421118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:40.421153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.421155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.421156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.421157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.421158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.421164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.421174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.421177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.421181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.421185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.421191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.421201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.421207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.421213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.421217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.421223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.421227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.421232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.421237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.421241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.421259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:40.434651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:40.436353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:40.436374Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:40.436376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:40.436380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:40.436386Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 380 [1:7556533335625413991:6028]
2025-10-02T08:08:40.436399Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:40.436417Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:40.436419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.436422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.436423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.436436Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:40.436441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:40.436447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:40.436513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.436523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.436527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:40.436529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:40.436605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:40.436616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.436630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.436644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:40.436662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625414001:6029], now have 1 active actors on pipe
2025-10-02T08:08:40.436669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533335625413985:6028]
2025-10-02T08:08:40.436671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533335625413985:6028]
2025-10-02T08:08:40.436673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 380
2025-10-02T08:08:40.436678Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:40.436688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533336085747089:2378], now have 1 active actors on pipe
2025-10-02T08:08:40.436689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:40.436693Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:40.436695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:40.436710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:40.436713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:40.436720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.436813Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 380
2025-10-02T08:08:40.436723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.436763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533335625413985:6028]
2025-10-02T08:08:40.436772Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:40.436780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:40.436787Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:40.436792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.436796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.436817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:40.436826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.436836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:40.436876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:40.436995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.436998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.437013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:40.437061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 381 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0
2025-10-02T08:08:40.437466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9732f2c-434ba8da-9c3e58ca-5eb31ae4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:40.440523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0] Write session: try to update token
2025-10-02T08:08:40.440545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:40.449392Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:40.449410Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:40.449422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533335625413985:6028]
2025-10-02T08:08:40.449458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:40.449465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:40.449634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:40.449774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:40.449910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:40.450045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:40.450238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:40.450271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:40.469889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId: src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:40.473174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:40.473323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.473345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.473392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:40.473426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:40.473503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.473514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.473703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.473777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.473875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.473965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.474201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.474204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.474272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.474340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.474409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.474482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.474523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.474525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.474603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.474663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.474728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.474807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.474859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.474862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.474944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.475017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.475087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.475159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.475243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.475246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.475331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.475411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.475497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.475589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.475647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.475656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.475737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.475815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.475905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.475992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.476051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.476058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.476141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.476221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.476304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.476383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.476433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.476443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.476527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.476608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.476682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.476759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.476822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.476828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.476895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.476964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.477040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.477110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.477161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.477167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.477245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:40.477317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:40.477402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:40.477482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:40.477542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:40.477553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:40.477630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:40.477704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.477728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.477735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:40.477769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:40.477785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:40.477788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:40.477791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:40.477794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:40.478296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:40.478334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:40.478347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:40.478355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:40.478358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:40.478361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:40.479023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:40.479051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:40.479056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:40.479058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:40.479060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:40.479062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:40.479662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:40.479688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:40.479699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:40.479708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:40.479711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:40.482234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:40.482253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:40.482267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392520482
2025-10-02T08:08:40.482406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:40.482418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:40.482423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:40.482425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:40.482427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:40.482430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:40.482941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:40.482962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:40.482971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:40.482974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:40.482977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:40.482981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:40.483518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:40.483549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:40.483561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:40.483568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:40.483571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:40.483574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:40.484152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:40.484174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:40.484179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:40.485358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:40.485374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:40.485377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:40.485386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:40.485394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392520485
2025-10-02T08:08:40.485743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:40.485768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:40.485778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:40.485781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:40.485784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:40.485792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:40.486360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:40.486383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:40.486388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:40.486390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:40.486394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:40.486397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:40.486842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:40.486860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.486956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392520486
2025-10-02T08:08:40.489507Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:40.489530Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:40.489534Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:40.489538Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:40.489547Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:40.489549Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:40.489550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:40.489557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533335625413985:6028]
2025-10-02T08:08:40.489561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533335625413985:6028]
2025-10-02T08:08:40.489613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:40.489623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:40.489624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:40.489626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.489627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:40.489758Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:40.503097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533335625414027:5300]
2025-10-02T08:08:40.503234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 380, pipe: [1:7556533335625414027:5300]
2025-10-02T08:08:40.622395Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:40.622781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625414027:5300], now have 1 active actors on pipe
2025-10-02T08:08:40.622991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:40.622997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:40.623027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 381 reason: error at write: Disconnected sessionId: src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0
2025-10-02T08:08:40.623089Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:40.623192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 381 sessionId: src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0 is DEAD
2025-10-02T08:08:40.623319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533335625414027:5300]
2025-10-02T08:08:40.623091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:40.624907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:40.624921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0] Write session will restart in 0.006629s
2025-10-02T08:08:40.624966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0] Write session: Do CDS request
2025-10-02T08:08:40.624974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:40.627546Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f80c618c1b2f61b6] Result# TEvPutResult {Id# [72075186224037892:380:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:40.627569Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:380:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:40.627613Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:380:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:40.632524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.632584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:40.632600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 382
2025-10-02T08:08:40.632826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.632863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:40.632876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:40.632879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:40.633302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 382 sessionId:  describe result for acl check
2025-10-02T08:08:40.633337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:40.633339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:40.633340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:40.633345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533335625414300:6035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:40.634042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533335625414300:6035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:40.636448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533335625414300:6035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:40.639589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533335625414300:6035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:40.639606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533335625414300:6035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:40.639608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533335625414300:6035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:40.639615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:40.639759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:40.641051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:40.641240Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:40.641250Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:40.641260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:40.641304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:40.641349Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533335625414489:6034]
2025-10-02T08:08:40.641964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:40.642113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:40.642156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:40.642445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:40.642484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.642489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.642491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.642492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.642493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.642497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.642507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.642511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.642515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.642518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.642523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.642529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.642535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.642548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.642556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.642561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.642565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.642569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.642572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.642577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.642595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:40.650766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:40.652440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:40.652454Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:40.652456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:40.652459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:40.652466Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 381 [1:7556533335625414489:6034]
2025-10-02T08:08:40.652474Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:40.652486Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:40.652488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.652490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.652491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.652502Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:40.652506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:40.652513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:40.652567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.652573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.652576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:40.652578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:40.652639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:40.652645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.652654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.652660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:40.652676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533335625414478:6034]
2025-10-02T08:08:40.652681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533335625414478:6034]
2025-10-02T08:08:40.652685Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:40.652694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:40.652698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:40.652702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:40.652704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:40.652705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:40.652714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625414480:6035], now have 1 active actors on pipe
2025-10-02T08:08:40.652730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 381
2025-10-02T08:08:40.652741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533336085747096:2378], now have 1 active actors on pipe
2025-10-02T08:08:40.652743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533335625414478:6034]
2025-10-02T08:08:40.652750Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:40.652755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.652761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.652783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:40.652792Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce44c0b-53d229d1-48228d44-ef635136_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:40.652797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.652813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.652815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:40.652822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.652832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:40.652813Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 381
2025-10-02T08:08:40.652850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:40.652921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.652926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.652935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:40.652966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 382 partition: 0 MaxSeqNo: 17 sessionId: src_id|ce44c0b-53d229d1-48228d44-ef635136_0
2025-10-02T08:08:40.653244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c629c8-1e89e8ae-6e68a44f-678a7822_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ce44c0b-53d229d1-48228d44-ef635136_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:40.656657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce44c0b-53d229d1-48228d44-ef635136_0] Write session: try to update token
2025-10-02T08:08:40.656671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce44c0b-53d229d1-48228d44-ef635136_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:40.669864Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:40.669885Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:40.669887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:40.669894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533335625414478:6034]
2025-10-02T08:08:40.669898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533335625414478:6034]
2025-10-02T08:08:40.669935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:40.669946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.669946Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:40.669948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:40.669951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:40.670102Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:40.676300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId: src_id|ce44c0b-53d229d1-48228d44-ef635136_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:40.679015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:40.723265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533335625414515:5300]
2025-10-02T08:08:40.723353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 381, pipe: [1:7556533335625414515:5300]
2025-10-02T08:08:40.806744Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:40.806959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.806969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.806985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625414515:5300], now have 1 active actors on pipe
2025-10-02T08:08:40.807087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533335625414515:5300]
2025-10-02T08:08:40.807112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:40.807117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:40.807139Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:40.807176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 382 reason: error at write: Disconnected sessionId: src_id|ce44c0b-53d229d1-48228d44-ef635136_0
2025-10-02T08:08:40.807219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:40.807314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 382 sessionId: src_id|ce44c0b-53d229d1-48228d44-ef635136_0 is DEAD
2025-10-02T08:08:40.807484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce44c0b-53d229d1-48228d44-ef635136_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:40.807494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce44c0b-53d229d1-48228d44-ef635136_0] Write session will restart in 0.007416s
2025-10-02T08:08:40.807520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce44c0b-53d229d1-48228d44-ef635136_0] Write session: Do CDS request
2025-10-02T08:08:40.807527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce44c0b-53d229d1-48228d44-ef635136_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:40.816407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce44c0b-53d229d1-48228d44-ef635136_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.816509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:40.816522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 383
2025-10-02T08:08:40.816643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.816665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:40.816672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:40.816674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:40.817005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 383 sessionId:  describe result for acl check
2025-10-02T08:08:40.817034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:40.817035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:40.817036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:40.817040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533335625414926:6042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:40.817404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533335625414926:6042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:40.817777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:40.819066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:40.819181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533335625414926:6042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:40.819205Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:40.819213Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:40.819219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:40.819260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:40.819286Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533335625414960:6041]
2025-10-02T08:08:40.819752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:40.819906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:40.819944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:40.820164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:40.820194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.820199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.820199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.820200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.820200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.820204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.820210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.820213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.820215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.820217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.820220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.820225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.820229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.820231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.820234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.820237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.820239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.820242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.820244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.820246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.820256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:40.825208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533335625414926:6042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:40.825229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533335625414926:6042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:40.825233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533335625414926:6042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:40.825241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:40.828198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:40.829755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:40.829774Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:40.829776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:40.829779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:40.829784Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 382 [1:7556533335625414960:6041]
2025-10-02T08:08:40.829792Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:40.829805Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:40.829806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.829808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.829809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.829822Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:40.829828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:40.829834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:40.829882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.829890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.829892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:40.829893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:40.829940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:40.829944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.829953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.829964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:40.829974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533335625414940:6041]
2025-10-02T08:08:40.829979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533335625414940:6041]
2025-10-02T08:08:40.829984Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:40.829995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:40.830007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:40.830009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:40.830011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:40.830012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:40.830018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625414987:6042], now have 1 active actors on pipe
2025-10-02T08:08:40.830027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 382
2025-10-02T08:08:40.830054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533336085747103:2378], now have 1 active actors on pipe
2025-10-02T08:08:40.830059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533335625414940:6041]
2025-10-02T08:08:40.830062Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:40.830066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.830068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.830071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:40.830101Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:40.830109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:40.830114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:40.830115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:40.830123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:40.830129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:40.830141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:40.830115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 382
2025-10-02T08:08:40.830173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.830178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.830187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:40.830230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 383 partition: 0 MaxSeqNo: 17 sessionId: src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0
2025-10-02T08:08:40.830592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce44c0b-53d229d1-48228d44-ef635136_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:40.833413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0] Write session: try to update token
2025-10-02T08:08:40.833432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:40.847339Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:40.847357Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:40.847359Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:40.847365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533335625414940:6041]
2025-10-02T08:08:40.847372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533335625414940:6041]
2025-10-02T08:08:40.847415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:40.847423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.847424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:40.847433Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:40.847449Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:40.847559Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:40.848676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId: src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:40.851413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:40.907076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533335625415002:5300]
2025-10-02T08:08:40.907217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 382, pipe: [1:7556533335625415002:5300]
2025-10-02T08:08:40.976644Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:40.976861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:40.976874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:40.976907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625415002:5300], now have 1 active actors on pipe
2025-10-02T08:08:40.977039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:40.977048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:40.977100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 383 reason: error at write: Disconnected sessionId: src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0
2025-10-02T08:08:40.977114Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:40.977157Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:40.977294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 383 sessionId: src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0 is DEAD
2025-10-02T08:08:40.977384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533335625415002:5300]
2025-10-02T08:08:40.977494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:40.977508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0] Write session will restart in 0.006713s
2025-10-02T08:08:40.977531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0] Write session: Do CDS request
2025-10-02T08:08:40.977538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:40.985352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.985420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:40.985437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 384
2025-10-02T08:08:40.985645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:40.985678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:40.985687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:40.985690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:40.986185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 384 sessionId:  describe result for acl check
2025-10-02T08:08:40.986222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:40.986228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:40.986229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:40.986234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533335625415348:6048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:40.986656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533335625415348:6048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:40.989431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533335625415348:6048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:40.990034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:40.991437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:40.991567Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:40.991575Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:40.991582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:40.991613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:40.991640Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533335625415456:6047]
2025-10-02T08:08:40.991762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533335625415348:6048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:40.991773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533335625415348:6048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:40.991775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533335625415348:6048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:40.991786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:40.992035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:40.992166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:40.992191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:40.992391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:40.992470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.992476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.992477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.992478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.992479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.992483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.992490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.992492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.992494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.992496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.992500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.992504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:40.992508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.992510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:40.992513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.992520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:40.992523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.992526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:40.992531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.992534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:40.992543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:41.000433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:41.002081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:41.002101Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:41.002104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:41.002107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:41.002112Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 383 [1:7556533335625415456:6047]
2025-10-02T08:08:41.002124Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:41.002139Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:41.002141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.002144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.002146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.002159Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:41.002164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:41.002169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:41.002230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.002239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.002242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:41.002244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:41.002301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:41.002307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.002321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.002334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:41.002355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533335625415448:6047]
2025-10-02T08:08:41.002360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533335625415448:6047]
2025-10-02T08:08:41.002368Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:41.002371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 383
2025-10-02T08:08:41.002378Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:41.002381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:41.002383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533335625415461:6048], now have 1 active actors on pipe
2025-10-02T08:08:41.002391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:41.002403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:41.002409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:41.002416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533336085747112:2378], now have 1 active actors on pipe
2025-10-02T08:08:41.002420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.002424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.002459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533335625415448:6047]
2025-10-02T08:08:41.002470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:41.002481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:41.002484Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f55d7906-d0a684e5-de172d31-d19a8675_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:41.002491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.002494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.002496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:41.002503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.002511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:41.002490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 383
2025-10-02T08:08:41.002549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.002586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.002596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.002615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.002651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 384 partition: 0 MaxSeqNo: 17 sessionId: src_id|f55d7906-d0a684e5-de172d31-d19a8675_0
2025-10-02T08:08:41.003015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe496-85ad0c9a-80ae5665-f873cdf3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f55d7906-d0a684e5-de172d31-d19a8675_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:41.006741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f55d7906-d0a684e5-de172d31-d19a8675_0] Write session: try to update token
2025-10-02T08:08:41.006765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f55d7906-d0a684e5-de172d31-d19a8675_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:41.020927Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:41.020948Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:41.020950Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:41.020958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533335625415448:6047]
2025-10-02T08:08:41.020961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533335625415448:6047]
2025-10-02T08:08:41.021001Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:41.021007Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:41.021007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:41.021013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.021015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:41.021174Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:41.023925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId: src_id|f55d7906-d0a684e5-de172d31-d19a8675_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:41.027003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:41.077672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533339920382784:5300]
2025-10-02T08:08:41.077921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 383, pipe: [1:7556533339920382784:5300]
2025-10-02T08:08:41.156956Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:41.157276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.157294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.157334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920382784:5300], now have 1 active actors on pipe
2025-10-02T08:08:41.157519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533339920382784:5300]
2025-10-02T08:08:41.157541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:41.157548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:41.157600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 384 reason: error at write: Disconnected sessionId: src_id|f55d7906-d0a684e5-de172d31-d19a8675_0
2025-10-02T08:08:41.157604Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:41.157654Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:41.157776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 384 sessionId: src_id|f55d7906-d0a684e5-de172d31-d19a8675_0 is DEAD
2025-10-02T08:08:41.157916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55d7906-d0a684e5-de172d31-d19a8675_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:41.157925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55d7906-d0a684e5-de172d31-d19a8675_0] Write session will restart in 0.005099s
2025-10-02T08:08:41.157952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55d7906-d0a684e5-de172d31-d19a8675_0] Write session: Do CDS request
2025-10-02T08:08:41.157958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55d7906-d0a684e5-de172d31-d19a8675_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:41.165511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f55d7906-d0a684e5-de172d31-d19a8675_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:41.165700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:41.165715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 385
2025-10-02T08:08:41.168419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:41.168470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:41.168476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:41.168481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:41.168952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 385 sessionId:  describe result for acl check
2025-10-02T08:08:41.168980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:41.168982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:41.168984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:41.168989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533339920383121:6054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:41.169599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533339920383121:6054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:41.172996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533339920383121:6054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:41.175043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:41.175346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:41.175599Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:41.175602Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:41.175613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:41.175646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533339920383121:6054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:41.175658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533339920383121:6054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:41.175661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533339920383121:6054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:41.175669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:41.175678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:41.175715Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533339920383243:6053]
2025-10-02T08:08:41.176317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:41.176505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:41.176542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:41.176846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:41.176890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.176891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.176893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.176894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.176895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.176899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.176908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.176912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.176916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.176919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.176924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.176930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.176935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.176940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.176943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.176947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.176951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.176956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.176960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.176964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.176979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:41.186295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:41.187896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:41.187914Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:41.187917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:41.187921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:41.187928Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 384 [1:7556533339920383243:6053]
2025-10-02T08:08:41.187940Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:41.187958Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:41.187961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.187963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.187965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.187980Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:41.187985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:41.187991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:41.188052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.188060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.188062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:41.188065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:41.188129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:41.188135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.188146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.188160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:41.188179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533339920383237:6053]
2025-10-02T08:08:41.188184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533339920383237:6053]
2025-10-02T08:08:41.188191Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:41.188204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920383248:6054], now have 1 active actors on pipe
2025-10-02T08:08:41.188210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 384
2025-10-02T08:08:41.188213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:41.188217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:41.188220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:41.188224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:41.188226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:41.188255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533340380714416:2378], now have 1 active actors on pipe
2025-10-02T08:08:41.188263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.188266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.188279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533339920383237:6053]
2025-10-02T08:08:41.188286Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:41.188308Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:41.188319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.188323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.188327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:41.188334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.188347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:41.188364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:41.188370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.188439Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 384
2025-10-02T08:08:41.188477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.188483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.188499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.188556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 385 partition: 0 MaxSeqNo: 17 sessionId: src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0
2025-10-02T08:08:41.188982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55d7906-d0a684e5-de172d31-d19a8675_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:41.191987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0] Write session: try to update token
2025-10-02T08:08:41.192014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:41.206888Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:41.206910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:41.206913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:41.206921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533339920383237:6053]
2025-10-02T08:08:41.206929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533339920383237:6053]
2025-10-02T08:08:41.206974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:41.206973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:41.206980Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:41.206982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.206985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:41.207150Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:41.225207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId: src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:41.228040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:41.283528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533339920383286:5300]
2025-10-02T08:08:41.285864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 384, pipe: [1:7556533339920383286:5300]
2025-10-02T08:08:41.345475Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:41.345760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.345774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.345794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920383286:5300], now have 1 active actors on pipe
2025-10-02T08:08:41.346002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:41.346007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:41.346048Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:41.346095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 385 reason: error at write: Disconnected sessionId: src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0
2025-10-02T08:08:41.346177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:41.346467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:41.346480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0] Write session will restart in 0.006302s
2025-10-02T08:08:41.346517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0] Write session: Do CDS request
2025-10-02T08:08:41.346524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:41.346303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 385 sessionId: src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0 is DEAD
2025-10-02T08:08:41.346393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533339920383286:5300]
2025-10-02T08:08:41.354393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:41.354490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:41.354507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 386
2025-10-02T08:08:41.354783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:41.354808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:41.354813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:41.354817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:41.355269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 386 sessionId:  describe result for acl check
2025-10-02T08:08:41.355312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:41.355314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:41.355316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:41.355321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533339920383345:6073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:41.355801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533339920383345:6073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:41.361756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533339920383345:6073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:41.365954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533339920383345:6073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:41.365974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533339920383345:6073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:41.365978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533339920383345:6073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:41.365985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:41.379426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:41.381052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:41.381299Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:41.381309Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:41.381319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:41.381366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:41.381404Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533339920383793:6072]
2025-10-02T08:08:41.382013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:41.382183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:41.382215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:41.382472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:41.382504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.382505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.382506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.382507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.382508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.382513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.382522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.382525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.382528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.382531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.382535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.382542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.382546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.382551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.382554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.382558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.382561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.382565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.382569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.382573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.382591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:41.402217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:41.404202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:41.404221Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:41.404224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:41.404227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:41.404234Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 385 [1:7556533339920383793:6072]
2025-10-02T08:08:41.404246Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:41.404261Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:41.404264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.404266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.404268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.404286Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:41.404293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:41.404300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:41.404367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.404375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.404378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:41.404381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:41.404453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:41.404460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.404473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.404485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:41.404501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533339920383787:6072]
2025-10-02T08:08:41.404503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533339920383787:6072]
2025-10-02T08:08:41.404510Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:41.404522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920383659:6073], now have 1 active actors on pipe
2025-10-02T08:08:41.404528Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:41.404530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:41.404531Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:41.404542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:41.404545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:41.404551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533340380714456:2378], now have 1 active actors on pipe
2025-10-02T08:08:41.404578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 385
2025-10-02T08:08:41.404582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533339920383787:6072]
2025-10-02T08:08:41.404585Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:41.404620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:41.404839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 385
2025-10-02T08:08:41.408878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.408901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.408950Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:41.408964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.408969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.408972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:41.408988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.409004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:41.409025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.409211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.409217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.409233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.409269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 386 partition: 0 MaxSeqNo: 17 sessionId: src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0
2025-10-02T08:08:41.409736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9629fec0-b55cb2d2-94cd1ef0-578bd560_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:41.413015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0] Write session: try to update token
2025-10-02T08:08:41.413038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:41.435965Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:41.435983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:41.435992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533339920383787:6072]
2025-10-02T08:08:41.436034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:41.436048Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:41.436244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:41.436399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:41.436558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:41.436717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:41.436948Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:41.436984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:41.446600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533339920383822:5300]
2025-10-02T08:08:41.446856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920383822:5300], now have 1 active actors on pipe
2025-10-02T08:08:41.446882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 385, pipe: [1:7556533339920383822:5300]
2025-10-02T08:08:41.447930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId: src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:41.451029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:41.451427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.451446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.451482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:41.451513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:41.451664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.451667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.451852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.451937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.452026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.452111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.452391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.452407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.452481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.452563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.452639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.452711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.452756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.452764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.452980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.453058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.453142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.453212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.453263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.453271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.453368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.453440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.453510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.453579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.453628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.453635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.453703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.453771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.453842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.453927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.453983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.453991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.454070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.454143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.454213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.454286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.454336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.454346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.454415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.454482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.454552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.454619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.454664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.454671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.454740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.454824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.454893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.454967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.455013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.455021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.455091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.455157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.455232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.455306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.455356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.455363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.455438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.455510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.455575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.455642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.455712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.455719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.455785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:41.455851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.455886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.455889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:41.455918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:41.455936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:41.455944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:41.455947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:41.455949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:41.456405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:41.456435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:41.456445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:41.456449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:41.456454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:41.456457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:41.457452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:41.457478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:41.457486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:41.457490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:41.457493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:41.457496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:41.458121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:41.458144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:41.458149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:41.458160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:41.458163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:41.461764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:41.461787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:41.461806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392521461
2025-10-02T08:08:41.461999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:41.462017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:41.462024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:41.462028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:41.462032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:41.462035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:41.462593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:41.462605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:41.462611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:41.462615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:41.462621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:41.462626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:41.463199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:41.463208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:41.463218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:41.463221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:41.463224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:41.463227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:41.463754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:41.463768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:41.463773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:41.465270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:41.465289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:41.465294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:41.465298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:41.465308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392521465
2025-10-02T08:08:41.465653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:41.465664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:41.465671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:41.465675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:41.465678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:41.465681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:41.466221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:41.466232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:41.466238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:41.466242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:41.466245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:41.466249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:41.466723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:41.466733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.466862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392521466
2025-10-02T08:08:41.469711Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:41.469744Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:41.469751Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:41.469760Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:41.469771Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:41.469773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:41.469776Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:41.469786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533339920383787:6072]
2025-10-02T08:08:41.469789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533339920383787:6072]
2025-10-02T08:08:41.469866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:41.469875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.469877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:41.470032Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:41.472884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:41.472890Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:41.634071Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:41.635622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:41.635634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0] Write session will restart in 0.008545s
2025-10-02T08:08:41.635659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0] Write session: Do CDS request
2025-10-02T08:08:41.635666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:41.634835Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:41.635231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:41.635259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 386 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0
2025-10-02T08:08:41.635443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 386 sessionId: src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0 is DEAD
2025-10-02T08:08:41.635575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533339920383822:5300]
2025-10-02T08:08:41.636880Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:41.643183Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6a98d919ff325453] Result# TEvPutResult {Id# [72075186224037892:385:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:41.643221Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:385:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:41.643246Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:385:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:41.645466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:41.646320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:41.646334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 387
2025-10-02T08:08:41.646495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:41.646526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:41.646531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:41.646535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:41.646981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 387 sessionId:  describe result for acl check
2025-10-02T08:08:41.647007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:41.647009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:41.647010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:41.647015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533339920384044:6080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:41.647600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533339920384044:6080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:41.652780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533339920384044:6080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:41.657405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:41.657410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533339920384044:6080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:41.657417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533339920384044:6080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:41.657420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533339920384044:6080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:41.657428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:41.660089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:41.660303Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:41.660307Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:41.660317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:41.660370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:41.660405Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533339920384296:6079]
2025-10-02T08:08:41.661044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:41.661291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:41.661357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:41.661740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:41.661796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.661797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.661798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.661799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.661801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.661806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.661816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.661820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.661824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.661828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.661834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.661842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.661850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.661855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.661859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.661868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.661872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.661877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.661881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.661886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.661906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:41.671874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:41.673924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:41.673941Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:41.673943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:41.673946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:41.673950Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 386 [1:7556533339920384296:6079]
2025-10-02T08:08:41.673961Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:41.673977Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:41.673979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.673981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.673982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.673995Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:41.673999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:41.674004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:41.674067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.674073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.674076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:41.674077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:41.674144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:41.674150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.674161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.674168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:41.674181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533339920384284:6079]
2025-10-02T08:08:41.674184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533339920384284:6079]
2025-10-02T08:08:41.674190Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:41.674201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:41.674218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:41.674224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:41.674254Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:41.674260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 386
2025-10-02T08:08:41.674265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920384291:6080], now have 1 active actors on pipe
2025-10-02T08:08:41.674267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:41.674268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533339920384284:6079]
2025-10-02T08:08:41.674270Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:41.674273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:41.674292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533340380714466:2378], now have 1 active actors on pipe
2025-10-02T08:08:41.674297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.674301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.674329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1367fe8a-89d63798-36807bec-8dcd00c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:41.674338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.674342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.674343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:41.674350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.674361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:41.674372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.674463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.674483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.674505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.674513Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 386
2025-10-02T08:08:41.674558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 387 partition: 0 MaxSeqNo: 17 sessionId: src_id|1367fe8a-89d63798-36807bec-8dcd00c_0
2025-10-02T08:08:41.674899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8080b9a-f37d4a43-a1435eed-8949ebca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1367fe8a-89d63798-36807bec-8dcd00c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:41.678337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1367fe8a-89d63798-36807bec-8dcd00c_0] Write session: try to update token
2025-10-02T08:08:41.678359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1367fe8a-89d63798-36807bec-8dcd00c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:41.691974Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:41.691994Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:41.692003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533339920384284:6079]
2025-10-02T08:08:41.692047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:41.692258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:41.692487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:41.692638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:41.692813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:41.693066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:41.693102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:41.694331Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:41.700610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId: src_id|1367fe8a-89d63798-36807bec-8dcd00c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:41.703619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:41.703695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.703710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.703746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:41.703767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:41.703896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.703899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.704091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.704161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.704243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.704341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.704403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.704407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.704481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.704546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.704619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.704694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.704742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.704745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.704831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.704892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.704960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.705029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.705078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.705086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.705152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.705219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.705285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.705352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.705426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.705434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.705501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.705567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.705655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.705717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.705770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.705777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.705850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.705912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.705969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.706025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.706065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.706068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.706137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.706269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.706416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.706559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.706611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.706613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.706679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.706741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.706802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.706863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.706906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.706909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.706981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.707043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.707116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.707179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.707222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.707226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.707294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:41.707354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:41.707420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:41.707488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:41.707535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:41.707552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:41.707617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:41.707685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.707708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.707715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:41.707746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:41.707763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:41.707771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:41.707775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:41.707777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:41.708202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:41.708230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:41.708236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:41.708239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:41.708242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:41.708245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:41.709008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:41.709032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:41.709038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:41.709041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:41.709044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:41.709047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:41.709525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:41.709547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:41.709552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:41.709557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:41.709561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:41.710860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:41.710868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:41.710880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392521710
2025-10-02T08:08:41.711092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:41.711098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:41.711104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:41.711107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:41.711110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:41.711114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:41.711660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:41.711676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:41.711682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:41.711685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:41.711689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:41.711695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:41.712188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:41.712200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:41.712209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:41.712211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:41.712215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:41.712218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:41.712737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:41.712749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:41.712754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:41.714193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:41.714216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:41.714223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:41.714227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:41.714237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392521713
2025-10-02T08:08:41.714530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:41.714540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:41.714545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:41.714549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:41.714552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:41.714554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:41.715046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:41.715056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:41.715059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:41.715062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:41.715065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:41.715067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:41.715561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:41.715571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.715683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392521715
2025-10-02T08:08:41.718574Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:41.718604Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:41.718613Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:41.718620Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:41.718632Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:41.718635Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:41.718638Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:41.718649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533339920384284:6079]
2025-10-02T08:08:41.718652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533339920384284:6079]
2025-10-02T08:08:41.718730Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:41.718737Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:41.718739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:41.718744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.718746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:41.718900Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:41.736507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533339920384323:5300]
2025-10-02T08:08:41.737353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 386, pipe: [1:7556533339920384323:5300]
2025-10-02T08:08:41.860779Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:41.861096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920384323:5300], now have 1 active actors on pipe
2025-10-02T08:08:41.861214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:41.861224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:41.861242Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:41.861247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 387 reason: error at write: Disconnected sessionId: src_id|1367fe8a-89d63798-36807bec-8dcd00c_0
2025-10-02T08:08:41.861390Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:41.861393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 387 sessionId: src_id|1367fe8a-89d63798-36807bec-8dcd00c_0 is DEAD
2025-10-02T08:08:41.861453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533339920384323:5300]
2025-10-02T08:08:41.861576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367fe8a-89d63798-36807bec-8dcd00c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:41.861589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367fe8a-89d63798-36807bec-8dcd00c_0] Write session will restart in 0.008174s
2025-10-02T08:08:41.861609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367fe8a-89d63798-36807bec-8dcd00c_0] Write session: Do CDS request
2025-10-02T08:08:41.861615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367fe8a-89d63798-36807bec-8dcd00c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:41.864830Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f3b6436ef7447e56] Result# TEvPutResult {Id# [72075186224037892:386:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:41.864865Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:386:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:41.864917Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:386:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:41.871367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1367fe8a-89d63798-36807bec-8dcd00c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:41.871430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:41.871441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 388
2025-10-02T08:08:41.871588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:41.871610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:41.871613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:41.871615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:41.872012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 388 sessionId:  describe result for acl check
2025-10-02T08:08:41.872042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:41.872047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:41.872049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:41.872053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533339920384748:6087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:41.872454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533339920384748:6087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:41.872824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:41.874038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:41.874188Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:41.874197Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:41.874205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:41.874205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533339920384748:6087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:41.874249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:41.874284Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533339920384785:6086]
2025-10-02T08:08:41.874807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:41.874959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:41.874994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:41.875195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:41.875221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.875225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.875226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.875226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.875227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.875230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.875236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.875238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.875240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.875242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.875245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.875249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:41.875258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.875261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:41.875263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.875266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:41.875269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.875275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.875277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.875279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.875289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:41.879624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533339920384748:6087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:41.879637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533339920384748:6087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:41.879639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533339920384748:6087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:41.879645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:41.882600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:41.884044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:41.884055Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:41.884057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:41.884060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:41.884065Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 387 [1:7556533339920384785:6086]
2025-10-02T08:08:41.884073Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:41.884085Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:41.884087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.884089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.884090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.884100Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:41.884104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:41.884109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:41.884200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.884206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.884209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:41.884210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:41.884253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:41.884258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.884266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:41.884272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:41.884287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533339920384765:6086]
2025-10-02T08:08:41.884291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533339920384765:6086]
2025-10-02T08:08:41.884296Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:41.884305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920384812:6087], now have 1 active actors on pipe
2025-10-02T08:08:41.884305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 387
2025-10-02T08:08:41.884311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:41.884313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:41.884315Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:41.884322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:41.884323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:41.884327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533340380714477:2378], now have 1 active actors on pipe
2025-10-02T08:08:41.884331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.884334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.884359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533339920384765:6086]
2025-10-02T08:08:41.884364Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:41.884373Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|226d691e-a0f14587-c5a08d47-d074e156_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:41.884380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:41.884382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:41.884383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:41.884383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:41.884388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:41.884394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:41.884364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 387
2025-10-02T08:08:41.884420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.884453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:41.884459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:41.884467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:41.884491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 388 partition: 0 MaxSeqNo: 17 sessionId: src_id|226d691e-a0f14587-c5a08d47-d074e156_0
2025-10-02T08:08:41.884837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367fe8a-89d63798-36807bec-8dcd00c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|226d691e-a0f14587-c5a08d47-d074e156_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:41.887579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226d691e-a0f14587-c5a08d47-d074e156_0] Write session: try to update token
2025-10-02T08:08:41.887599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226d691e-a0f14587-c5a08d47-d074e156_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:41.900447Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:41.900465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:41.900466Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:41.900475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533339920384765:6086]
2025-10-02T08:08:41.900478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533339920384765:6086]
2025-10-02T08:08:41.900509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:41.900514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:41.900515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:41.900522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:41.900528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:41.900642Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:41.902400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId: src_id|226d691e-a0f14587-c5a08d47-d074e156_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:41.905684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:41.961807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533339920384825:5300]
2025-10-02T08:08:41.961916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 387, pipe: [1:7556533339920384825:5300]
2025-10-02T08:08:42.042424Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:42.042658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.042668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.042700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533339920384825:5300], now have 1 active actors on pipe
2025-10-02T08:08:42.042806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533339920384825:5300]
2025-10-02T08:08:42.042830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:42.042836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:42.042886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 388 reason: error at write: Disconnected sessionId: src_id|226d691e-a0f14587-c5a08d47-d074e156_0
2025-10-02T08:08:42.042909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:42.043046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 388 sessionId: src_id|226d691e-a0f14587-c5a08d47-d074e156_0 is DEAD
2025-10-02T08:08:42.043220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226d691e-a0f14587-c5a08d47-d074e156_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:42.043232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226d691e-a0f14587-c5a08d47-d074e156_0] Write session will restart in 0.007608s
2025-10-02T08:08:42.043257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226d691e-a0f14587-c5a08d47-d074e156_0] Write session: Do CDS request
2025-10-02T08:08:42.043263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226d691e-a0f14587-c5a08d47-d074e156_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:42.043934Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:42.052376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226d691e-a0f14587-c5a08d47-d074e156_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.052453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:42.052467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 389
2025-10-02T08:08:42.052693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.052726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:42.052734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:42.052737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:42.053154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 389 sessionId:  describe result for acl check
2025-10-02T08:08:42.053196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:42.053202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:42.053204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:42.053209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533344215352506:6093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:42.053699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533344215352506:6093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:42.055782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533344215352506:6093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:42.055938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:42.057273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:42.057424Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:42.057432Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:42.057439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:42.057472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:42.057497Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533344215352588:6092]
2025-10-02T08:08:42.057977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:42.058189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:42.058247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:42.058349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533344215352506:6093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:42.058359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533344215352506:6093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:42.058361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533344215352506:6093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:42.058372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:42.058594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:42.058654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.058661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.058662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.058663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.058664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.058669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.058679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.058683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.058688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.058692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.058697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.058707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.058714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.058723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.058729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.058734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.058739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.058745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.058750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.058755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.058775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:42.067161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:42.068861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:42.068876Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:42.068879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:42.068881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:42.068887Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 388 [1:7556533344215352588:6092]
2025-10-02T08:08:42.068896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:42.068909Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:42.068910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.068913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.068915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.068931Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:42.068936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:42.068943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:42.069003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.069012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.069015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:42.069017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:42.069071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:42.069077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.069089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.069102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:42.069122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215352599:6093], now have 1 active actors on pipe
2025-10-02T08:08:42.069128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533344215352572:6092]
2025-10-02T08:08:42.069131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533344215352572:6092]
2025-10-02T08:08:42.069138Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:42.069138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 388
2025-10-02T08:08:42.069146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533344675681780:2378], now have 1 active actors on pipe
2025-10-02T08:08:42.069152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:42.069153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:42.069157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:42.069161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:42.069163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:42.069167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.069170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.069204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533344215352572:6092]
2025-10-02T08:08:42.069210Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:42.069220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:42.069221Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:42.069215Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 388
2025-10-02T08:08:42.069226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.069228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.069230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:42.069238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.069246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:42.069281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.069319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.069326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.069338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.069365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 389 partition: 0 MaxSeqNo: 17 sessionId: src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0
2025-10-02T08:08:42.069758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226d691e-a0f14587-c5a08d47-d074e156_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:42.072247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0] Write session: try to update token
2025-10-02T08:08:42.072267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:42.085879Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:42.085900Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:42.085902Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:42.085912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533344215352572:6092]
2025-10-02T08:08:42.085917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533344215352572:6092]
2025-10-02T08:08:42.085954Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:42.085959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:42.085961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:42.085968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.085970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:42.086116Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:42.087098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId: src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:42.089992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:42.143047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533344215352618:5300]
2025-10-02T08:08:42.143146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 388, pipe: [1:7556533344215352618:5300]
2025-10-02T08:08:42.220131Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:42.220494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.220508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.220541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215352618:5300], now have 1 active actors on pipe
2025-10-02T08:08:42.220646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533344215352618:5300]
2025-10-02T08:08:42.220670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:42.220695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:42.220729Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:42.220757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 389 reason: error at write: Disconnected sessionId: src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0
2025-10-02T08:08:42.220761Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:42.220938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 389 sessionId: src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0 is DEAD
2025-10-02T08:08:42.221145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:42.221161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0] Write session will restart in 0.007887s
2025-10-02T08:08:42.221189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0] Write session: Do CDS request
2025-10-02T08:08:42.221196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:42.230427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.230480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:42.230499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 390
2025-10-02T08:08:42.232861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:42.233001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.233038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:42.233049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:42.233052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:42.233446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 390 sessionId:  describe result for acl check
2025-10-02T08:08:42.233469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:42.233474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:42.233475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:42.233478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533344215353057:6099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:42.233839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533344215353057:6099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:42.234283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:42.234419Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:42.234428Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:42.234436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:42.234465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:42.234489Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533344215353064:6098]
2025-10-02T08:08:42.234914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:42.235179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:42.235275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:42.235721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:42.235796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.235797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.235798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.235800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.235801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.235808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.235818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.235822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.235825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.235829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.235836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.235845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.235866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.235871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.235877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.235883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.235887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.235892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.235898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.235903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.235922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:42.236022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533344215353057:6099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:42.241820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533344215353057:6099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:42.241841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533344215353057:6099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:42.241844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533344215353057:6099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:42.241867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:42.244031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:42.245788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:42.245806Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:42.245808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:42.245811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:42.245817Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 389 [1:7556533344215353064:6098]
2025-10-02T08:08:42.245829Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:42.245847Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:42.245850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.245853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.245854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.245869Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:42.245874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:42.245879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:42.245935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.245942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.245944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:42.245946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:42.246008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:42.246017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.246030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.246042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:42.246054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533344215353051:6098]
2025-10-02T08:08:42.246061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533344215353051:6098]
2025-10-02T08:08:42.246070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:42.246082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:42.246101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:42.246109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:42.246117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:42.246120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215353103:6099], now have 1 active actors on pipe
2025-10-02T08:08:42.246122Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:42.246138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 389
2025-10-02T08:08:42.246152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533344675681787:2378], now have 1 active actors on pipe
2025-10-02T08:08:42.246155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533344215353051:6098]
2025-10-02T08:08:42.246161Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:42.246166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:42.246167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.246171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.246215Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e48d470-f73aa626-2dab4757-19c41635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:42.246227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.246229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.246231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:42.246238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.246245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:42.246259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.246254Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 389
2025-10-02T08:08:42.246360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.246368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.246386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.246432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 390 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e48d470-f73aa626-2dab4757-19c41635_0
2025-10-02T08:08:42.246789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3edb352-d5d7fb52-ab1302b1-abe19c0a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e48d470-f73aa626-2dab4757-19c41635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:42.249731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e48d470-f73aa626-2dab4757-19c41635_0] Write session: try to update token
2025-10-02T08:08:42.249755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e48d470-f73aa626-2dab4757-19c41635_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:42.263393Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:42.263418Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:42.263421Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:42.263432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533344215353051:6098]
2025-10-02T08:08:42.263437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533344215353051:6098]
2025-10-02T08:08:42.263485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:42.263486Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:42.263492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:42.263493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.263497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:42.263642Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:42.264987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId: src_id|5e48d470-f73aa626-2dab4757-19c41635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:42.267968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:42.323910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533344215353146:5300]
2025-10-02T08:08:42.325981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 389, pipe: [1:7556533344215353146:5300]
2025-10-02T08:08:42.420170Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:42.420685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.420707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.420758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215353146:5300], now have 1 active actors on pipe
2025-10-02T08:08:42.421003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:42.421338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e48d470-f73aa626-2dab4757-19c41635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:42.421349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e48d470-f73aa626-2dab4757-19c41635_0] Write session will restart in 0.006318s
2025-10-02T08:08:42.421373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e48d470-f73aa626-2dab4757-19c41635_0] Write session: Do CDS request
2025-10-02T08:08:42.421379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e48d470-f73aa626-2dab4757-19c41635_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:42.420905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533344215353146:5300]
2025-10-02T08:08:42.420936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:42.420938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:42.421003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 390 reason: error at write: Disconnected sessionId: src_id|5e48d470-f73aa626-2dab4757-19c41635_0
2025-10-02T08:08:42.421157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 390 sessionId: src_id|5e48d470-f73aa626-2dab4757-19c41635_0 is DEAD
2025-10-02T08:08:42.422048Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:42.430175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e48d470-f73aa626-2dab4757-19c41635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.430312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:42.430331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 391
2025-10-02T08:08:42.430528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.430560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:42.430564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:42.430567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:42.431008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 391 sessionId:  describe result for acl check
2025-10-02T08:08:42.431041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:42.431048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:42.431050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:42.431054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533344215353548:6119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:42.431608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533344215353548:6119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:42.433875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533344215353548:6119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:42.435730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:42.436037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533344215353548:6119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:42.436049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533344215353548:6119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:42.436051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533344215353548:6119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:42.436056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:42.436062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:42.436238Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:42.436252Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:42.436261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:42.436318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:42.436348Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533344215353652:6118]
2025-10-02T08:08:42.436974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:42.437171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:42.437215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:42.437459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:42.437492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.437492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.437493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.437494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.437495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.437498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.437504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.437506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.437509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.437511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.437514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.437519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.437522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.437525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.437527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.437529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.437532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.437534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.437536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.437539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.437549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:42.445275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:42.447172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:42.447194Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:42.447195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:42.447198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:42.447203Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 390 [1:7556533344215353652:6118]
2025-10-02T08:08:42.447212Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:42.447225Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:42.447226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.447229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.447230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.447241Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:42.447245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:42.447250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:42.447292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.447301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.447303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:42.447305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:42.447352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:42.447362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.447371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.447377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:42.447388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533344215353641:6118]
2025-10-02T08:08:42.447389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533344215353641:6118]
2025-10-02T08:08:42.447394Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:42.447404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:42.447411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:42.447411Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:42.447413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:42.447413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 390
2025-10-02T08:08:42.447415Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:42.447420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215353649:6119], now have 1 active actors on pipe
2025-10-02T08:08:42.447423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533344675681830:2378], now have 1 active actors on pipe
2025-10-02T08:08:42.447444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533344215353641:6118]
2025-10-02T08:08:42.447450Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:42.447455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.447456Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:42.447458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.447486Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:42.447490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.447492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.447494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:42.447499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.447505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:42.447519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.447542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.447521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 390
2025-10-02T08:08:42.447551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.447559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.447594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 391 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0
2025-10-02T08:08:42.448021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e48d470-f73aa626-2dab4757-19c41635_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:42.450772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0] Write session: try to update token
2025-10-02T08:08:42.450788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:42.467159Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:42.467187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:42.467189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:42.467198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533344215353641:6118]
2025-10-02T08:08:42.467202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533344215353641:6118]
2025-10-02T08:08:42.467246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:42.467253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.467256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:42.467260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:42.467267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:42.467401Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:42.470240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId: src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:42.474207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:42.520938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533344215353682:5300]
2025-10-02T08:08:42.521273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 390, pipe: [1:7556533344215353682:5300]
2025-10-02T08:08:42.622911Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:42.623202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.623219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.623259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215353682:5300], now have 1 active actors on pipe
2025-10-02T08:08:42.623371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533344215353682:5300]
2025-10-02T08:08:42.623411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:42.623414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:42.623472Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:42.623488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 391 reason: error at write: Disconnected sessionId: src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0
2025-10-02T08:08:42.623488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:42.623668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 391 sessionId: src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0 is DEAD
2025-10-02T08:08:42.623870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:42.623884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0] Write session will restart in 0.008924s
2025-10-02T08:08:42.623913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0] Write session: Do CDS request
2025-10-02T08:08:42.623920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:42.634498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.635792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:42.635824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 392
2025-10-02T08:08:42.636156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.636213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:42.636227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:42.636233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:42.637033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 392 sessionId:  describe result for acl check
2025-10-02T08:08:42.637088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:42.637094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:42.637096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:42.637103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533344215353918:6125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:42.637831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533344215353918:6125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:42.643706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533344215353918:6125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:42.648051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:42.649684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533344215353918:6125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:42.649707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533344215353918:6125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:42.649710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533344215353918:6125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:42.649717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:42.649845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:42.650043Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:42.650057Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:42.650067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:42.650115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:42.650154Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533344215354159:6124]
2025-10-02T08:08:42.650879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:42.651218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:42.651312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:42.651722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:42.651801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.651810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.651811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.651812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.651814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.651821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.651832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.651836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.651840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.651844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.651861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.651877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.651884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.651890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.651900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.651906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.651910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.651916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.651922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.651927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.651950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:42.662524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:42.664773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:42.664819Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:42.664823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:42.664827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:42.664836Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 391 [1:7556533344215354159:6124]
2025-10-02T08:08:42.664851Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:42.664873Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:42.664878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.664881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.664884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.664908Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:42.664915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:42.664924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:42.665017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.665028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.665032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:42.665035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:42.665120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:42.665129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.665146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.665160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:42.665188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215354154:6125], now have 1 active actors on pipe
2025-10-02T08:08:42.665202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533344215354147:6124]
2025-10-02T08:08:42.665205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533344215354147:6124]
2025-10-02T08:08:42.665221Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:42.665236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:42.665237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 391
2025-10-02T08:08:42.665259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:42.665262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:42.665270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533344675681837:2378], now have 1 active actors on pipe
2025-10-02T08:08:42.665289Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:42.665302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:42.665313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533344215354147:6124]
2025-10-02T08:08:42.665316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:42.665318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:42.665337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.665342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.665380Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:42.665394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.665398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.665401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:42.665417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.665427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:42.665371Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 391
2025-10-02T08:08:42.665445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.665514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.665522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.665535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.665563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 392 partition: 0 MaxSeqNo: 17 sessionId: src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0
2025-10-02T08:08:42.665956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c724a40-63bf0f7f-9bf7307-36f05a89_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:42.669259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0] Write session: try to update token
2025-10-02T08:08:42.669276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:42.685071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId: src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:42.687524Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:42.687551Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:42.687555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:42.687566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533344215354147:6124]
2025-10-02T08:08:42.687571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533344215354147:6124]
2025-10-02T08:08:42.687623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:42.687624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:42.687630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:42.687636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.687639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:42.687808Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:42.687915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:42.723688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533344215354185:5300]
2025-10-02T08:08:42.723842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 391, pipe: [1:7556533344215354185:5300]
2025-10-02T08:08:42.831641Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:42.832217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.832233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.832273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215354185:5300], now have 1 active actors on pipe
2025-10-02T08:08:42.832362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533344215354185:5300]
2025-10-02T08:08:42.832385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:42.832388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:42.832432Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:42.832435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 392 reason: error at write: Disconnected sessionId: src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0
2025-10-02T08:08:42.832432Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:42.832608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 392 sessionId: src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0 is DEAD
2025-10-02T08:08:42.832758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:42.832770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0] Write session will restart in 0.007679s
2025-10-02T08:08:42.832814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0] Write session: Do CDS request
2025-10-02T08:08:42.832823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:42.841247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.841336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:42.841352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 393
2025-10-02T08:08:42.841512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:42.841537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:42.841541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:42.841543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:42.841865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 393 sessionId:  describe result for acl check
2025-10-02T08:08:42.841893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:42.841894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:42.841895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:42.841899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533344215354624:6134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:42.842231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533344215354624:6134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:42.843277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:42.844442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:42.844472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533344215354624:6134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:42.844637Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:42.844647Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:42.844655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:42.844700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:42.844735Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533344215354662:6133]
2025-10-02T08:08:42.845405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:42.845582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:42.845634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:42.845887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:42.845926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.845927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.845928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.845930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.845931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.845948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.845957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.845961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.845965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.845968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.845972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.845980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:42.845985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.845990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:42.846008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.846013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:42.846017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.846021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.846025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.846030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.846047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:42.846776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533344215354624:6134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:42.846791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533344215354624:6134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:42.846795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533344215354624:6134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:42.846801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:42.854590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:42.856133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:42.856151Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:42.856153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:42.856157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:42.856163Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 392 [1:7556533344215354662:6133]
2025-10-02T08:08:42.856174Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:42.856190Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:42.856192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.856195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.856196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.856207Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:42.856210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:42.856215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:42.856264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.856271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.856274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:42.856275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:42.856337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:42.856346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.856354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:42.856366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:42.856378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533344215354650:6133]
2025-10-02T08:08:42.856384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533344215354650:6133]
2025-10-02T08:08:42.856392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:42.856402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:42.856416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:42.856419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 392
2025-10-02T08:08:42.856420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:42.856422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:42.856426Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:42.856431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215354688:6134], now have 1 active actors on pipe
2025-10-02T08:08:42.856454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533344675681852:2378], now have 1 active actors on pipe
2025-10-02T08:08:42.856456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533344215354650:6133]
2025-10-02T08:08:42.856458Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:42.856462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.856465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.856451Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 392
2025-10-02T08:08:42.856497Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:42.856506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:42.856509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:42.856510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:42.856516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:42.856523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:42.856529Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:42.856544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.856613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:42.856621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:42.856633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:42.856668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 393 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0
2025-10-02T08:08:42.857022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f29bf-3f0da5f7-2e1fd66b-421fd543_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:42.859573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0] Write session: try to update token
2025-10-02T08:08:42.859593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:42.874171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId: src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:42.874707Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:42.874727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:42.874730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:42.874739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533344215354650:6133]
2025-10-02T08:08:42.874747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533344215354650:6133]
2025-10-02T08:08:42.874799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:42.874810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:42.874812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:42.874820Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:42.874839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:42.874960Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:42.876688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:42.932545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533344215354701:5300]
2025-10-02T08:08:42.932699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 392, pipe: [1:7556533344215354701:5300]
2025-10-02T08:08:43.007697Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:43.008001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.008012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.008043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533344215354701:5300], now have 1 active actors on pipe
2025-10-02T08:08:43.008130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:43.008141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:43.008201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 393 reason: error at write: Disconnected sessionId: src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0
2025-10-02T08:08:43.008230Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:43.008261Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:43.008391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 393 sessionId: src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0 is DEAD
2025-10-02T08:08:43.008459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533344215354701:5300]
2025-10-02T08:08:43.008566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:43.008581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0] Write session will restart in 0.009877s
2025-10-02T08:08:43.008633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0] Write session: Do CDS request
2025-10-02T08:08:43.008642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:43.019363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.019431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:43.019449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 394
2025-10-02T08:08:43.019625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.019684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:43.019695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:43.019699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:43.020173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 394 sessionId:  describe result for acl check
2025-10-02T08:08:43.020205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:43.020206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:43.020208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:43.020219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533348510322401:6140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:43.020731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533348510322401:6140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:43.023045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:43.023138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533348510322401:6140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:43.025116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:43.025293Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:43.025303Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:43.025313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:43.025362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:43.025396Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533348510322474:6139]
2025-10-02T08:08:43.025658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533348510322401:6140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:43.025670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533348510322401:6140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:43.025673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533348510322401:6140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:43.025685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:43.025927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:43.026200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:43.026246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:43.026517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:43.026563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.026569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.026570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.026571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.026572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.026576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.026585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.026589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.026592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.026595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.026601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.026608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.026617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.026623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.026627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.026634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.026638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.026642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.026650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.026654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.026672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:43.034505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:43.036269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:43.036286Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:43.036289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:43.036293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:43.036299Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 393 [1:7556533348510322474:6139]
2025-10-02T08:08:43.036311Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:43.036325Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:43.036332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.036335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.036337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.036353Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:43.036362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:43.036368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:43.036423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.036430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.036432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:43.036435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:43.036494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:43.036502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.036515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.036528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:43.036535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 393
2025-10-02T08:08:43.036546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510322479:6140], now have 1 active actors on pipe
2025-10-02T08:08:43.036554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533348970649154:2378], now have 1 active actors on pipe
2025-10-02T08:08:43.036560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533348510322458:6139]
2025-10-02T08:08:43.036568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533348510322458:6139]
2025-10-02T08:08:43.036580Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:43.036589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.036593Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:43.036596Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:43.036597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.036614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:43.036627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:43.036628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:43.036666Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91333697-5d859f35-23d3f030-9cc38554_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:43.036671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.036674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.036675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:43.036631Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 393
2025-10-02T08:08:43.036683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.036695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:43.036702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533348510322458:6139]
2025-10-02T08:08:43.036708Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:43.036716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:43.036739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.036816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.036824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.036838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.036876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 394 partition: 0 MaxSeqNo: 17 sessionId: src_id|91333697-5d859f35-23d3f030-9cc38554_0
2025-10-02T08:08:43.037280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0300a9-12d8c969-a3c82cd7-54413ad7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|91333697-5d859f35-23d3f030-9cc38554_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:43.040499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91333697-5d859f35-23d3f030-9cc38554_0] Write session: try to update token
2025-10-02T08:08:43.040514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91333697-5d859f35-23d3f030-9cc38554_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:43.053733Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:43.053757Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:43.053760Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:43.053768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533348510322458:6139]
2025-10-02T08:08:43.053771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533348510322458:6139]
2025-10-02T08:08:43.053816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:43.053821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:43.053826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.053827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:43.053829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:43.053972Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:43.056039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId: src_id|91333697-5d859f35-23d3f030-9cc38554_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:43.058803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:43.110508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533348510322504:5300]
2025-10-02T08:08:43.110630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 393, pipe: [1:7556533348510322504:5300]
2025-10-02T08:08:43.206319Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:43.206658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.206676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.206719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510322504:5300], now have 1 active actors on pipe
2025-10-02T08:08:43.209024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:43.209040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:43.209116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 394 reason: error at write: Disconnected sessionId: src_id|91333697-5d859f35-23d3f030-9cc38554_0
2025-10-02T08:08:43.209174Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:43.209318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 394 sessionId: src_id|91333697-5d859f35-23d3f030-9cc38554_0 is DEAD
2025-10-02T08:08:43.209476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533348510322504:5300]
2025-10-02T08:08:43.209485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91333697-5d859f35-23d3f030-9cc38554_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:43.209496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91333697-5d859f35-23d3f030-9cc38554_0] Write session will restart in 0.007013s
2025-10-02T08:08:43.209522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91333697-5d859f35-23d3f030-9cc38554_0] Write session: Do CDS request
2025-10-02T08:08:43.209533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91333697-5d859f35-23d3f030-9cc38554_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:43.209167Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:43.217414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:43.217429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 395
2025-10-02T08:08:43.217560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91333697-5d859f35-23d3f030-9cc38554_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.217843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.217885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:43.217890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:43.217894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:43.218323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 395 sessionId:  describe result for acl check
2025-10-02T08:08:43.218354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:43.218359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:43.218361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:43.218366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533348510322794:6146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:43.218937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533348510322794:6146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:43.222137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533348510322794:6146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:43.225311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:43.225368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533348510322794:6146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:43.225383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533348510322794:6146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:43.225387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533348510322794:6146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:43.225395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:43.227146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:43.227370Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:43.227389Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:43.227406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:43.227500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:43.227544Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533348510322989:6145]
2025-10-02T08:08:43.228272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:43.228513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:43.228580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:43.228979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:43.229031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.229036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.229038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.229039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.229039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.229044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.229053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.229056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.229060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.229063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.229068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.229075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.229081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.229086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.229091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.229096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.229101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.229111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.229115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.229120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.229143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:43.238079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:43.240102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:43.240119Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:43.240122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:43.240129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:43.240135Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 394 [1:7556533348510322989:6145]
2025-10-02T08:08:43.240146Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:43.240164Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:43.240167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.240170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.240171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.240187Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:43.240193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:43.240198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:43.240263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.240271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.240274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:43.240277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:43.240344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:43.240352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.240366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.240378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:43.240399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533348510322977:6145]
2025-10-02T08:08:43.240407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533348510322977:6145]
2025-10-02T08:08:43.240416Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:43.240428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:43.240442Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:43.240446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:43.240436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 394
2025-10-02T08:08:43.240449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:43.240455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:43.240459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510322984:6146], now have 1 active actors on pipe
2025-10-02T08:08:43.240464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533348970649160:2378], now have 1 active actors on pipe
2025-10-02T08:08:43.240497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533348510322977:6145]
2025-10-02T08:08:43.240508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:43.240514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.240517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:43.240522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.240568Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d516ef5-84289556-4fa0c51-f90ad217_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:43.240578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.240584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.240590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:43.240599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.240607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:43.240633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.240677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.240684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.240695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.240735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 395 partition: 0 MaxSeqNo: 17 sessionId: src_id|1d516ef5-84289556-4fa0c51-f90ad217_0
2025-10-02T08:08:43.241067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 394
2025-10-02T08:08:43.241620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91333697-5d859f35-23d3f030-9cc38554_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1d516ef5-84289556-4fa0c51-f90ad217_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:43.245136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d516ef5-84289556-4fa0c51-f90ad217_0] Write session: try to update token
2025-10-02T08:08:43.245154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d516ef5-84289556-4fa0c51-f90ad217_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:43.259831Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:43.259866Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:43.259869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:43.259876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533348510322977:6145]
2025-10-02T08:08:43.259880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533348510322977:6145]
2025-10-02T08:08:43.259924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:43.259931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.259933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:43.259939Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:43.259944Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:43.260092Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:43.263227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId: src_id|1d516ef5-84289556-4fa0c51-f90ad217_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:43.269594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:43.309938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533348510323025:5300]
2025-10-02T08:08:43.310097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 394, pipe: [1:7556533348510323025:5300]
2025-10-02T08:08:43.401429Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:43.401667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.401679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.401695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510323025:5300], now have 1 active actors on pipe
2025-10-02T08:08:43.401796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533348510323025:5300]
2025-10-02T08:08:43.401814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:43.401820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:43.401869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 395 reason: error at write: Disconnected sessionId: src_id|1d516ef5-84289556-4fa0c51-f90ad217_0
2025-10-02T08:08:43.401958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:43.401932Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:43.402058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 395 sessionId: src_id|1d516ef5-84289556-4fa0c51-f90ad217_0 is DEAD
2025-10-02T08:08:43.402442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d516ef5-84289556-4fa0c51-f90ad217_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:43.402450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d516ef5-84289556-4fa0c51-f90ad217_0] Write session will restart in 0.009920s
2025-10-02T08:08:43.402471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d516ef5-84289556-4fa0c51-f90ad217_0] Write session: Do CDS request
2025-10-02T08:08:43.402476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d516ef5-84289556-4fa0c51-f90ad217_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:43.414665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d516ef5-84289556-4fa0c51-f90ad217_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.414743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:43.414762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 396
2025-10-02T08:08:43.415053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.415089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:43.415098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:43.415102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:43.415729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 396 sessionId:  describe result for acl check
2025-10-02T08:08:43.415765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:43.415767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:43.415768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:43.415773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533348510323359:6164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:43.416458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533348510323359:6164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:43.419097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533348510323359:6164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:43.423573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:43.425109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:43.425324Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:43.425334Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:43.425343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:43.425408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:43.425450Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533348510323539:6163]
2025-10-02T08:08:43.426167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:43.426363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:43.426400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:43.426725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:43.426764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.426770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.426771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.426772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.426773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.426778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.426788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.426792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.426796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.426800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.426811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.426818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.426829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.426834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.426837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.426841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.426845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.426849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.426854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.426859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.426875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:43.442732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533348510323359:6164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:43.442751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533348510323359:6164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:43.442755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533348510323359:6164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:43.442765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:43.443764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:43.445737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:43.445755Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:43.445757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:43.445761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:43.445767Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 395 [1:7556533348510323539:6163]
2025-10-02T08:08:43.445778Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:43.445794Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:43.445797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.445800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.445802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.445818Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:43.445823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:43.445829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:43.445894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.445903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.445905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:43.445908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:43.445974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:43.445981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.445995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.446007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:43.446031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533348510323533:6163]
2025-10-02T08:08:43.446033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533348510323533:6163]
2025-10-02T08:08:43.446039Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:43.446051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533348970649193:2378], now have 1 active actors on pipe
2025-10-02T08:08:43.446053Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:43.446056Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:43.446059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:43.446071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:43.446070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 395
2025-10-02T08:08:43.446073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:43.446078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510323558:6164], now have 1 active actors on pipe
2025-10-02T08:08:43.446108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.446113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.446125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533348510323533:6163]
2025-10-02T08:08:43.446133Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:43.446150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:43.446156Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ec8003-a6ac936-803207bf-4d0bc075_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:43.446162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.446165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.446166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:43.446174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.446183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:43.446202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.446266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.446271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.446295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.446332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 396 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ec8003-a6ac936-803207bf-4d0bc075_0
2025-10-02T08:08:43.446807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d516ef5-84289556-4fa0c51-f90ad217_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ec8003-a6ac936-803207bf-4d0bc075_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:43.447861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 395
2025-10-02T08:08:43.450292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8003-a6ac936-803207bf-4d0bc075_0] Write session: try to update token
2025-10-02T08:08:43.450316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8003-a6ac936-803207bf-4d0bc075_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:43.464728Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:43.464749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:43.464752Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:43.464759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533348510323533:6163]
2025-10-02T08:08:43.464764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533348510323533:6163]
2025-10-02T08:08:43.464827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:43.464834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:43.464837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:43.464843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.464846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:43.464996Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:43.474173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId: src_id|2ec8003-a6ac936-803207bf-4d0bc075_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:43.477189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:43.500860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533348510323580:5300]
2025-10-02T08:08:43.500959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 395, pipe: [1:7556533348510323580:5300]
2025-10-02T08:08:43.595202Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:43.595628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.595651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.595689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510323580:5300], now have 1 active actors on pipe
2025-10-02T08:08:43.595781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533348510323580:5300]
2025-10-02T08:08:43.595798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:43.595802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:43.595841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 396 reason: error at write: Disconnected sessionId: src_id|2ec8003-a6ac936-803207bf-4d0bc075_0
2025-10-02T08:08:43.595865Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:43.595935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:43.596001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 396 sessionId: src_id|2ec8003-a6ac936-803207bf-4d0bc075_0 is DEAD
2025-10-02T08:08:43.596211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8003-a6ac936-803207bf-4d0bc075_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:43.596226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8003-a6ac936-803207bf-4d0bc075_0] Write session will restart in 0.006031s
2025-10-02T08:08:43.596255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8003-a6ac936-803207bf-4d0bc075_0] Write session: Do CDS request
2025-10-02T08:08:43.596261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8003-a6ac936-803207bf-4d0bc075_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:43.603393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8003-a6ac936-803207bf-4d0bc075_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.603390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:43.603405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 397
2025-10-02T08:08:43.603665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.603697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:43.603704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:43.603707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:43.604016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 397 sessionId:  describe result for acl check
2025-10-02T08:08:43.604039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:43.604044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:43.604046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:43.604050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533348510323946:6172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:43.604509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533348510323946:6172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:43.607185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533348510323946:6172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:43.607924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:43.609371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:43.609645Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:43.609656Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:43.609665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:43.609671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533348510323946:6172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:43.609678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533348510323946:6172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:43.609681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533348510323946:6172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:43.609689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:43.609715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:43.609748Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533348510324062:6171]
2025-10-02T08:08:43.610286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:43.610425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:43.610454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:43.610672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:43.610715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.610720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.610721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.610722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.610724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.610728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.610737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.610740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.610742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.610743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.610747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.610751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.610754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.610757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.610762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.610767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.610770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.610780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.610784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.610792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.610809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:43.618321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:43.619628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:43.619642Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:43.619644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:43.619648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:43.619653Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 396 [1:7556533348510324062:6171]
2025-10-02T08:08:43.619664Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:43.619682Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:43.619684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.619686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.619687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.619699Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:43.619702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:43.619706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:43.619750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.619756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.619758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:43.619760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:43.619804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:43.619809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.619816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.619822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:43.619834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533348510324056:6171]
2025-10-02T08:08:43.619835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533348510324056:6171]
2025-10-02T08:08:43.619840Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:43.619857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:43.619873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:43.619879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:43.619883Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:43.619886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:43.619898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 396
2025-10-02T08:08:43.619911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510324067:6172], now have 1 active actors on pipe
2025-10-02T08:08:43.619919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533348970649209:2378], now have 1 active actors on pipe
2025-10-02T08:08:43.619922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533348510324056:6171]
2025-10-02T08:08:43.619926Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:43.619930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.619933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.619936Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:43.619961Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:43.619969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.619972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.619974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:43.619980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.619987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:43.620002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.619998Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 396
2025-10-02T08:08:43.620034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.620039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.620048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.620077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 397 partition: 0 MaxSeqNo: 17 sessionId: src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0
2025-10-02T08:08:43.620416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ec8003-a6ac936-803207bf-4d0bc075_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:43.622816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0] Write session: try to update token
2025-10-02T08:08:43.622838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:43.636106Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:43.636119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:43.636121Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:43.636128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533348510324056:6171]
2025-10-02T08:08:43.636132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533348510324056:6171]
2025-10-02T08:08:43.636165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:43.636167Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:43.636170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.636171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:43.636172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:43.636297Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:43.636710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId: src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:43.639226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:43.695938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533348510324093:5300]
2025-10-02T08:08:43.696049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 396, pipe: [1:7556533348510324093:5300]
2025-10-02T08:08:43.762200Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:43.762698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.762709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.762748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510324093:5300], now have 1 active actors on pipe
2025-10-02T08:08:43.762860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533348510324093:5300]
2025-10-02T08:08:43.762879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:43.762885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:43.762934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 397 reason: error at write: Disconnected sessionId: src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0
2025-10-02T08:08:43.762982Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:43.763018Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:43.763109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 397 sessionId: src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0 is DEAD
2025-10-02T08:08:43.763308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:43.763321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0] Write session will restart in 0.005716s
2025-10-02T08:08:43.763342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0] Write session: Do CDS request
2025-10-02T08:08:43.763348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:43.770457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.770483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:43.770494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 398
2025-10-02T08:08:43.770715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.770737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:43.770744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:43.770746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:43.771174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 398 sessionId:  describe result for acl check
2025-10-02T08:08:43.771204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:43.771210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:43.771211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:43.771216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533348510324426:6178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:43.771671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533348510324426:6178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:43.774831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533348510324426:6178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:43.777372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:43.778035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533348510324426:6178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:43.778048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533348510324426:6178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:43.778052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533348510324426:6178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:43.778063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:43.779705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:43.779907Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:43.779914Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:43.779922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:43.779966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:43.779994Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533348510324582:6177]
2025-10-02T08:08:43.780599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:43.780787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:43.780840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:43.781126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:43.781169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.781174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.781175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.781177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.781178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.781183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.781193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.781200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.781204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.781207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.781213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.781219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.781225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.781240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.781245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.781251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.781258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.781264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.781274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.781282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.781300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:43.789093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:43.790572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:43.790585Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:43.790587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:43.790591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:43.790597Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 397 [1:7556533348510324582:6177]
2025-10-02T08:08:43.790608Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:43.790623Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:43.790628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.790632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.790634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.790649Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:43.790657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:43.790669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:43.790731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.790738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.790740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:43.790743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:43.790802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:43.790808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.790820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.790836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:43.790861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510324578:6178], now have 1 active actors on pipe
2025-10-02T08:08:43.790868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533348510324570:6177]
2025-10-02T08:08:43.790870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533348510324570:6177]
2025-10-02T08:08:43.790873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 397
2025-10-02T08:08:43.790876Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:43.790887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:43.790888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533348970649215:2378], now have 1 active actors on pipe
2025-10-02T08:08:43.790890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:43.790893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:43.790907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:43.790909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:43.790914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.790918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.790952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533348510324570:6177]
2025-10-02T08:08:43.790956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:43.790965Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:43.790969Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:43.790983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.790954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 397
2025-10-02T08:08:43.790986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.790988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:43.790997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.791004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:43.791045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.791121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.791128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.791141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.791182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 398 partition: 0 MaxSeqNo: 17 sessionId: src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0
2025-10-02T08:08:43.791540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e95ff98-ce099dc3-13e0a49d-5ebdd6c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:43.794083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0] Write session: try to update token
2025-10-02T08:08:43.794103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:43.807431Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:43.807445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:43.807447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:43.807455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533348510324570:6177]
2025-10-02T08:08:43.807459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533348510324570:6177]
2025-10-02T08:08:43.807501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:43.807506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.807506Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:43.807509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:43.807512Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:43.807639Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:43.808413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId: src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:43.810960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:43.862840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533348510324609:5300]
2025-10-02T08:08:43.862929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 397, pipe: [1:7556533348510324609:5300]
2025-10-02T08:08:43.933596Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:43.933929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.933944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.933978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510324609:5300], now have 1 active actors on pipe
2025-10-02T08:08:43.934104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533348510324609:5300]
2025-10-02T08:08:43.934123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:43.934129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:43.934179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 398 reason: error at write: Disconnected sessionId: src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0
2025-10-02T08:08:43.934210Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:43.934223Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:43.934366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 398 sessionId: src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0 is DEAD
2025-10-02T08:08:43.934549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:43.934566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0] Write session will restart in 0.006111s
2025-10-02T08:08:43.934594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0] Write session: Do CDS request
2025-10-02T08:08:43.934601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:43.942331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.942385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:43.942396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 399
2025-10-02T08:08:43.942631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:43.942667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:43.942676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:43.942681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:43.943042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 399 sessionId:  describe result for acl check
2025-10-02T08:08:43.943071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:43.943077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:43.943079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:43.943084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533348510324970:6185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:43.943556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533348510324970:6185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:43.946523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533348510324970:6185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:43.947250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:43.948617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:43.948793Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:43.948818Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:43.948826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:43.948868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:43.948895Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533348510325095:6184]
2025-10-02T08:08:43.949010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533348510324970:6185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:43.949021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533348510324970:6185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:43.949025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533348510324970:6185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:43.949032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:43.949296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:43.949410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:43.949438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:43.949661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:43.949699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.949703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.949704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.949705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.949705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.949708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.949717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.949724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.949727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.949735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.949740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.949750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:43.949759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.949764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:43.949769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.949773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:43.949777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.949783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.949791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.949796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.949813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:43.957589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:43.959455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:43.959471Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:43.959474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:43.959476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:43.959483Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 398 [1:7556533348510325095:6184]
2025-10-02T08:08:43.959496Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:43.959515Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:43.959517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.959520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.959522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.959538Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:43.959543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:43.959549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:43.959612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.959619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.959622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:43.959624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:43.959688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:43.959694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.959706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:43.959718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:43.959737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533348510325100:6185], now have 1 active actors on pipe
2025-10-02T08:08:43.959750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533348510325087:6184]
2025-10-02T08:08:43.959752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533348510325087:6184]
2025-10-02T08:08:43.959759Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:43.959758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 398
2025-10-02T08:08:43.959768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533348970649224:2378], now have 1 active actors on pipe
2025-10-02T08:08:43.959769Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:43.959772Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:43.959776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:43.959787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:43.959790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:43.959796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.959801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.959853Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 398
2025-10-02T08:08:43.959857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533348510325087:6184]
2025-10-02T08:08:43.959868Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:43.959882Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:43.959888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:43.959891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:43.959892Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:43.959893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:43.959902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:43.959910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:43.959953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.960032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:43.960039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:43.960053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:43.960092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 399 partition: 0 MaxSeqNo: 17 sessionId: src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0
2025-10-02T08:08:43.960505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33362b8-4329a48a-21bb544e-9a26d37f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:43.963057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0] Write session: try to update token
2025-10-02T08:08:43.963092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:43.977871Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:43.977887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:43.977890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:43.977900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533348510325087:6184]
2025-10-02T08:08:43.977909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533348510325087:6184]
2025-10-02T08:08:43.977954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:43.977954Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:43.977959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:43.977965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:43.977967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:43.978139Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:43.980427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId: src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:43.983520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:44.034389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533352805292422:5300]
2025-10-02T08:08:44.034502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 398, pipe: [1:7556533352805292422:5300]
2025-10-02T08:08:44.110716Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:44.111148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.111160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.111404Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:44.111196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805292422:5300], now have 1 active actors on pipe
2025-10-02T08:08:44.111281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533352805292422:5300]
2025-10-02T08:08:44.111296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:44.111298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:44.111339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 399 reason: error at write: Disconnected sessionId: src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0
2025-10-02T08:08:44.111380Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:44.111534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 399 sessionId: src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0 is DEAD
2025-10-02T08:08:44.111677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:44.111690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0] Write session will restart in 0.007386s
2025-10-02T08:08:44.111718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0] Write session: Do CDS request
2025-10-02T08:08:44.111725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:44.120339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.120440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:44.120451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 400
2025-10-02T08:08:44.120633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.120668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:44.120677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:44.120681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:44.121060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 400 sessionId:  describe result for acl check
2025-10-02T08:08:44.121087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:44.121093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:44.121094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:44.121099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533352805292844:6191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:44.121512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533352805292844:6191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:44.122929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:44.123063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533352805292844:6191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:44.124226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:44.124378Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:44.124386Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:44.124395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:44.124439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:44.124473Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533352805292910:6190]
2025-10-02T08:08:44.125059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533352805292844:6191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:44.125069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533352805292844:6191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:44.125071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533352805292844:6191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:44.125077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:44.125099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:44.125257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:44.125295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:44.125571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:44.125610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.125615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.125616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.125617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.125619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.125623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.125633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.125643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.125647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.125650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.125655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.125663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.125669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.125674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.125678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.125688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.125692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.125697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.125701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.125706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.125724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:44.133193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:44.134913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:44.134927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:44.134929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:44.134933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:44.134939Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 399 [1:7556533352805292910:6190]
2025-10-02T08:08:44.134949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:44.134966Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:44.134974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.134977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.134979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.134994Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:44.134999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:44.135008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:44.135073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.135079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.135084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:44.135086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:44.135146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:44.135153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.135165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.135178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 399
2025-10-02T08:08:44.135182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:44.135200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805292916:6191], now have 1 active actors on pipe
2025-10-02T08:08:44.135207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533353265616527:2378], now have 1 active actors on pipe
2025-10-02T08:08:44.135211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.135215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.135230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533352805292894:6190]
2025-10-02T08:08:44.135236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533352805292894:6190]
2025-10-02T08:08:44.135247Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:44.135256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:44.135258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:44.135263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:44.135279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:44.135286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:44.135265Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 399
2025-10-02T08:08:44.135301Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:44.135313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.135321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.135322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:44.135330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.135342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:44.135381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533352805292894:6190]
2025-10-02T08:08:44.135393Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:44.135406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.135408Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:44.135454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.135461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.135475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.135505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 400 partition: 0 MaxSeqNo: 17 sessionId: src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0
2025-10-02T08:08:44.135869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd7c82a-24e5cdb6-6a33aebe-d659a146_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:44.138994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0] Write session: try to update token
2025-10-02T08:08:44.139014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:44.150847Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:44.150875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:44.150885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533352805292894:6190]
2025-10-02T08:08:44.150924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:44.150926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:44.151107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:44.151257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:44.151405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:44.151548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:44.151752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:44.151797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:44.154098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId: src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:44.156771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:44.156851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.156862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.156894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:44.156918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:44.156975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.156986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.157152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.157238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.157310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.157377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.157601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.157608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.157666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.157724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.157788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.157855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.157900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.157905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.157972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.158026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.158085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.158144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.158192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.158197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.158262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.158318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.158385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.158446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.158492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.158497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.158559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.158614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.158672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.158738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.158788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.158796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.158852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.158913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.158974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.159029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.159067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.159072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.159130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.159187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.159260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.159327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.159370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.159375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.159432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.159485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.159541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.159595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.159641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.159647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.159704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.159758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.159823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.159890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.159929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.159936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.159993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.160046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.160103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.160158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.160197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.160202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.160248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:44.160305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.160321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.160326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:44.160351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:44.160367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:44.160374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:44.160377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:44.160380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:44.160728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:44.160748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:44.160753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:44.160755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:44.160756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:44.160758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:44.161376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:44.161393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:44.161399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:44.161404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:44.161407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:44.161410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:44.161914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:44.161930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:44.161935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:44.161939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:44.161940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:44.163814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:44.163824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:44.163832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392524163
2025-10-02T08:08:44.163972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:44.163983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:44.163987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:44.163992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:44.163994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:44.163996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:44.164448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:44.164462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:44.164466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:44.164468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:44.164470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:44.164473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:44.164932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:44.164945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:44.164952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:44.164956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:44.164959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:44.164961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:44.165407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:44.165428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:44.165432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:44.166496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:44.166508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:44.166512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:44.166515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:44.166521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392524166
2025-10-02T08:08:44.166813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:44.166826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:44.166830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:44.166832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:44.166839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:44.166842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:44.167295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:44.167312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:44.167317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:44.167320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:44.167322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:44.167324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:44.167739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:44.167756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.167832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392524167
2025-10-02T08:08:44.172621Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:44.172644Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:44.172649Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:44.172656Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:44.172664Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:44.172666Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:44.172668Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:44.172676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533352805292894:6190]
2025-10-02T08:08:44.172678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533352805292894:6190]
2025-10-02T08:08:44.172724Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:44.172735Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:44.172737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:44.172740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.172742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:44.172895Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:44.211516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533352805292943:5300]
2025-10-02T08:08:44.211601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 399, pipe: [1:7556533352805292943:5300]
2025-10-02T08:08:44.298011Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:44.298277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805292943:5300], now have 1 active actors on pipe
2025-10-02T08:08:44.298385Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:44.298471Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:44.298579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:44.298601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 400 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0
2025-10-02T08:08:44.298696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533352805292943:5300]
2025-10-02T08:08:44.298757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 400 sessionId: src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0 is DEAD
2025-10-02T08:08:44.299023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:44.299036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0] Write session will restart in 0.007292s
2025-10-02T08:08:44.299069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0] Write session: Do CDS request
2025-10-02T08:08:44.299077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:44.301550Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:399:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:44.301587Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [9b446e7c42bb9e46] Result# TEvPutResult {Id# [72075186224037892:399:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:44.301679Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:399:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:44.307273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.307355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:44.307365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 401
2025-10-02T08:08:44.307480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.307507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:44.307517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:44.307520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:44.307920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 401 sessionId:  describe result for acl check
2025-10-02T08:08:44.307968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:44.307970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:44.307971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:44.307976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533352805293306:6198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:44.308360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533352805293306:6198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:44.311258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533352805293306:6198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:44.312600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:44.313997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:44.314236Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:44.314242Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:44.314249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:44.314288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:44.314312Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533352805293448:6197]
2025-10-02T08:08:44.314343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533352805293306:6198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:44.314353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533352805293306:6198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:44.314356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533352805293306:6198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:44.314364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:44.314725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:44.314842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:44.314866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:44.315047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:44.315071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.315075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.315075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.315076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.315076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.315079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.315085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.315088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.315090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.315092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.315095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.315100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.315107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.315110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.315116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.315119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.315121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.315124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.315126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.315128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.315138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:44.322443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:44.323961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:44.323975Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:44.323978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:44.323981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:44.323987Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 400 [1:7556533352805293448:6197]
2025-10-02T08:08:44.324000Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:44.324019Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:44.324025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.324028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.324032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.324049Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:44.324057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:44.324064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:44.324119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.324126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.324129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:44.324131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:44.324191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:44.324198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.324209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.324223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:44.324238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533352805293442:6197]
2025-10-02T08:08:44.324244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533352805293442:6197]
2025-10-02T08:08:44.324250Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:44.324261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:44.324264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 400
2025-10-02T08:08:44.324265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:44.324267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:44.324277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:44.324280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:44.324288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805293453:6198], now have 1 active actors on pipe
2025-10-02T08:08:44.324313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.324321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.324332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533353265616545:2378], now have 1 active actors on pipe
2025-10-02T08:08:44.324334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533352805293442:6197]
2025-10-02T08:08:44.324336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:44.324340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:44.324354Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|513adb40-737680c0-ec367fb4-ef08293e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:44.324358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.324361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.324363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:44.324326Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 400
2025-10-02T08:08:44.324370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.324383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:44.324410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.324446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.324452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.324463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.324494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 401 partition: 0 MaxSeqNo: 17 sessionId: src_id|513adb40-737680c0-ec367fb4-ef08293e_0
2025-10-02T08:08:44.324785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65719cf1-67173449-dfaa4a3d-d8bf67e1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|513adb40-737680c0-ec367fb4-ef08293e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:44.327712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|513adb40-737680c0-ec367fb4-ef08293e_0] Write session: try to update token
2025-10-02T08:08:44.327727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|513adb40-737680c0-ec367fb4-ef08293e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:44.340447Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:44.340460Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:44.340462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:44.340467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533352805293442:6197]
2025-10-02T08:08:44.340470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533352805293442:6197]
2025-10-02T08:08:44.340501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:44.340503Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:44.340507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:44.340509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.340510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:44.340642Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:44.341392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId: src_id|513adb40-737680c0-ec367fb4-ef08293e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:44.343949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:44.404695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533352805293499:5300]
2025-10-02T08:08:44.406295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 400, pipe: [1:7556533352805293499:5300]
2025-10-02T08:08:44.467927Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:44.468235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.468244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.468276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805293499:5300], now have 1 active actors on pipe
2025-10-02T08:08:44.468373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533352805293499:5300]
2025-10-02T08:08:44.468394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:44.468396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:44.468452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 401 reason: error at write: Disconnected sessionId: src_id|513adb40-737680c0-ec367fb4-ef08293e_0
2025-10-02T08:08:44.468460Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:44.468438Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:44.468610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 401 sessionId: src_id|513adb40-737680c0-ec367fb4-ef08293e_0 is DEAD
2025-10-02T08:08:44.468925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513adb40-737680c0-ec367fb4-ef08293e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:44.468940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513adb40-737680c0-ec367fb4-ef08293e_0] Write session will restart in 0.006299s
2025-10-02T08:08:44.468978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513adb40-737680c0-ec367fb4-ef08293e_0] Write session: Do CDS request
2025-10-02T08:08:44.468987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513adb40-737680c0-ec367fb4-ef08293e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:44.476465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|513adb40-737680c0-ec367fb4-ef08293e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.476532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:44.476542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 402
2025-10-02T08:08:44.476709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.476745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:44.476754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:44.476757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:44.477140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 402 sessionId:  describe result for acl check
2025-10-02T08:08:44.477173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:44.477179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:44.477181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:44.477186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533352805293863:6217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:44.477694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533352805293863:6217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:44.480097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533352805293863:6217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:44.482878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:44.483069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533352805293863:6217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:44.483079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533352805293863:6217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:44.483082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533352805293863:6217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:44.483088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:44.483217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:44.483387Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:44.483395Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:44.483404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:44.483447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:44.483482Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533352805294026:6216]
2025-10-02T08:08:44.484062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:44.484219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:44.484258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:44.484510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:44.484541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.484545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.484546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.484546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.484547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.484550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.484556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.484559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.484561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.484563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.484566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.484570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.484573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.484576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.484578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.484581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.484583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.484585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.484591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.484594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.484603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:44.492004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:44.494662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:44.494673Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:44.494675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:44.494678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:44.494683Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 401 [1:7556533352805294026:6216]
2025-10-02T08:08:44.494690Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:44.494703Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:44.494707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.494709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.494710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.494720Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:44.494723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:44.494728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:44.494766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.494771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.494772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:44.494774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:44.494815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:44.494820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.494828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.494840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:44.494847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 401
2025-10-02T08:08:44.494860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805294022:6217], now have 1 active actors on pipe
2025-10-02T08:08:44.494862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533353265616567:2378], now have 1 active actors on pipe
2025-10-02T08:08:44.494865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.494867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.494879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533352805294014:6216]
2025-10-02T08:08:44.494881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533352805294014:6216]
2025-10-02T08:08:44.494887Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:44.494896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:44.494901Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:44.494904Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:44.494907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:44.494908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:44.494918Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:44.494921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.494923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.494925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:44.494930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.494936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:44.494916Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 401
2025-10-02T08:08:44.494960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533352805294014:6216]
2025-10-02T08:08:44.494968Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:44.494975Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:44.494980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.495046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.495050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.495059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.495085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 402 partition: 0 MaxSeqNo: 17 sessionId: src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0
2025-10-02T08:08:44.495370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|513adb40-737680c0-ec367fb4-ef08293e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:44.502359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0] Write session: try to update token
2025-10-02T08:08:44.502383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:44.511684Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:44.511695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:44.511697Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:44.511705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533352805294014:6216]
2025-10-02T08:08:44.511707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533352805294014:6216]
2025-10-02T08:08:44.511736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:44.511741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.511742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:44.511751Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:44.511756Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:44.511871Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:44.529669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId: src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:44.532167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:44.568389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533352805294052:5300]
2025-10-02T08:08:44.568499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 401, pipe: [1:7556533352805294052:5300]
2025-10-02T08:08:44.639121Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:44.639539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.639552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.639572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805294052:5300], now have 1 active actors on pipe
2025-10-02T08:08:44.639673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:44.639682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:44.639739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 402 reason: error at write: Disconnected sessionId: src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0
2025-10-02T08:08:44.639779Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:44.639927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 402 sessionId: src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0 is DEAD
2025-10-02T08:08:44.640059Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:44.640080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:44.640088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0] Write session will restart in 0.006755s
2025-10-02T08:08:44.640116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0] Write session: Do CDS request
2025-10-02T08:08:44.640122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:44.640229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533352805294052:5300]
2025-10-02T08:08:44.640250Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:08:44.640395Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 4 consumer shared/user session shared/user_1_4_14178729189382460213_v1 is DEAD
2025-10-02T08:08:44.640587Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533258315970855:5295] disconnected; active server actors: 1
2025-10-02T08:08:44.640598Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533258315970855:5295] client user disconnected session shared/user_1_4_14178729189382460213_v1
2025-10-02T08:08:44.640640Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:08:44.640789Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:08:44.640793Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:08:44.640815Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.007003s
2025-10-02T08:08:44.648344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.648408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:44.648424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 403
2025-10-02T08:08:44.648622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.648653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:44.648663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:44.648667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:44.649084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 403 sessionId:  describe result for acl check
2025-10-02T08:08:44.649115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:44.649122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:44.649123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:44.649128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533352805294419:6225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:44.649166Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:08:44.649286Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:08:44.649296Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 5
2025-10-02T08:08:44.649529Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:08:44.649573Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:08:44.649646Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 auth for : user
2025-10-02T08:08:44.649653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533352805294419:6225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:44.649757Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 Handle describe topics response
2025-10-02T08:08:44.649776Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 auth is DEAD
2025-10-02T08:08:44.649791Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:08:44.650031Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:08:44.650137Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_5_13424274763044140484_v1
2025-10-02T08:08:44.650150Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:08:44.650220Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:08:44.650313Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:08:44.650357Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 got read request: guid# 571d6f7-3e89d5a1-98753858-48089794
2025-10-02T08:08:44.650854Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533352805294458:6227] connected; active server actors: 1
2025-10-02T08:08:44.650882Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533352805294458:6227] session shared/user_1_5_13424274763044140484_v1
2025-10-02T08:08:44.650889Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:08:44.650898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:08:44.650903Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_5_13424274763044140484_v1" (Sender=[1:7556533352805294427:6227], Pipe=[1:7556533352805294458:6227], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:08:44.650909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:08:44.650917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:08:44.650928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_5_13424274763044140484_v1" (Sender=[1:7556533352805294427:6227], Pipe=[1:7556533352805294458:6227], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:08:44.650939Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_5_13424274763044140484_v1" sender [1:7556533352805294427:6227] lock partition 0 for ReadingSession "shared/user_1_5_13424274763044140484_v1" (Sender=[1:7556533352805294427:6227], Pipe=[1:7556533352805294458:6227], Partitions=[], ActiveFamilyCount=1) generation 1 step 5
2025-10-02T08:08:44.650962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:08:44.650966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000043s
2025-10-02T08:08:44.651315Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_5_13424274763044140484_v1" ClientId: "user" PipeClient { RawX1: 7556533352805294458 RawX2: 4503603922344019 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:08:44.651335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:08:44.652492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533352805294419:6225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:44.654915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:44.655195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:44.655379Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:44.655392Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:44.655394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533352805294419:6225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:44.655400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533352805294419:6225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:44.655403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533352805294419:6225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:44.655411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:44.655413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:44.655467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:44.655507Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533352805294553:6224]
2025-10-02T08:08:44.656150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:44.656337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:44.656385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:44.656689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:44.656731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.656737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.656738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.656739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.656740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.656745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.656756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.656760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.656764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.656770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.656775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.656783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.656788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.656794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.656798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.656817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.656822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.656827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.656831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.656836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.656855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:44.665852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:44.667634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:44.667644Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:44.667645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:44.667649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:44.667654Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 402 [1:7556533352805294553:6224]
2025-10-02T08:08:44.667662Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:44.667675Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:44.667681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.667684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.667686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.667701Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:44.667706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:44.667711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:44.667775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.667780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.667782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:44.667784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:44.667856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:44.667863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.667874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.667888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:44.667899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 402
2025-10-02T08:08:44.667907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805294557:6225], now have 1 active actors on pipe
2025-10-02T08:08:44.667913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805294502:6232], now have 1 active actors on pipe
2025-10-02T08:08:44.667915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533353265616583:2378], now have 1 active actors on pipe
2025-10-02T08:08:44.667920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.667927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.667928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 402, pipe: [1:7556533352805294502:6232]
2025-10-02T08:08:44.667942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533352805294547:6224]
2025-10-02T08:08:44.667948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533352805294547:6224]
2025-10-02T08:08:44.667958Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:44.667972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:44.667988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:44.667994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:44.667994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:44.667996Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:44.667999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.668001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.668007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_5_13424274763044140484_v1 on pipe: [1:7556533352805294502:6232]
2025-10-02T08:08:44.668003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 402
2025-10-02T08:08:44.668031Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:44.668038Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_5_13424274763044140484_v1:1 with generation 402
2025-10-02T08:08:44.668039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.668043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.668045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:44.668053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.668066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:44.668098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533352805294547:6224]
2025-10-02T08:08:44.668107Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:44.668116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.668121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:44.668124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.668125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:44.668138Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_5_13424274763044140484_v1
2025-10-02T08:08:44.668143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.668172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.668209Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:44.668238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.668244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.668327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.668366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 403 partition: 0 MaxSeqNo: 17 sessionId: src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0
2025-10-02T08:08:44.668757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb18715e-ec6fe1d2-f2dd9da1-aae18fe4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:44.669917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:08:44.669937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:08:44.669951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.669953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.669954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.669959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:08:44.669967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:08:44.670020Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392524667 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:08:44.670029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:08:44.670050Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 sending to client partition status
2025-10-02T08:08:44.671576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0] Write session: try to update token
2025-10-02T08:08:44.671590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:44.678527Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:44.678537Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:44.678545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533352805294547:6224]
2025-10-02T08:08:44.678579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:44.678585Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:44.679009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:44.679264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:44.679526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:44.679798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:44.680191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:44.680234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:44.688243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId: src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:44.690575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:44.690629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.690637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.690661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:44.690677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:44.690705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.690718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.690878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.690980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.691042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.691113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.691453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.691464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.691543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.691821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.692005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.692101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.692490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.692498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.692591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.692646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.692705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.692762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.692840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.692847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.692906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.692965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.693028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.693093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.693231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.693241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.693305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.693360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.693415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.693473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.693578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.693585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.693648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.693702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.693759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.693815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.693934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.693940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.694002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.694063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.694121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.694180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.694301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.694308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.694374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.694430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.694491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.694553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.694602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.694608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.694670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.694725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.694784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.694846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.694984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.694991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.695049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:44.695105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:44.695166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:44.695224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:44.695329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:44.695337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:44.695387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:44.695441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.695462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.695468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:44.695497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:44.695512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:44.695519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:44.695523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:44.695529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:44.695925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:44.695947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:44.695956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:44.695959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:44.695962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:44.695969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:44.696456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:44.696473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:44.696477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:44.696480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:44.696482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:44.696484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:44.697057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:44.697075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:44.697084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:44.697087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:44.697094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:44.699984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:44.699998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:44.700006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392524699
2025-10-02T08:08:44.700134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:44.700144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:44.700147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:44.700149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:44.700152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:44.700154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:44.700626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:44.700644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:44.700650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:44.700653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:44.700655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:44.700657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:44.701101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:44.701120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:44.701126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:44.701131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:44.701134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:44.701141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:44.701591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:44.701609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:44.701613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:44.702609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:44.702622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:44.702627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:44.702628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:44.702633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392524702
2025-10-02T08:08:44.702906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:44.702920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:44.702924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:44.702930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:44.702932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:44.702934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:44.703378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:44.703393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:44.703400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:44.703402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:44.703405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:44.703407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:44.703853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:44.703866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.703929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392524703
2025-10-02T08:08:44.706193Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:44.706211Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:44.706215Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:44.706221Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:44.706230Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:44.706236Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:44.706238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:44.706246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533352805294547:6224]
2025-10-02T08:08:44.706253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533352805294547:6224]
2025-10-02T08:08:44.706294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:44.706304Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:44.706315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:44.706321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.706322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:44.706442Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:44.830920Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:44.831324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533352805294502:6232]
2025-10-02T08:08:44.831338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:44.831340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:44.831358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 403 reason: error at write: Disconnected sessionId: src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0
2025-10-02T08:08:44.831391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_5_13424274763044140484_v1
2025-10-02T08:08:44.831405Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:44.831473Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:44.831501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 403 sessionId: src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0 is DEAD
2025-10-02T08:08:44.831614Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_5_13424274763044140484_v1
2025-10-02T08:08:44.831662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:44.831673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0] Write session will restart in 0.008038s
2025-10-02T08:08:44.831696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0] Write session: Do CDS request
2025-10-02T08:08:44.831705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:44.835419Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:402:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:44.835424Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7f342a8854e24514] Result# TEvPutResult {Id# [72075186224037892:402:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:44.835477Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:402:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:44.841246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.841502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:44.841511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 404
2025-10-02T08:08:44.841643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:44.841664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:44.841670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:44.841673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:44.842051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 404 sessionId:  describe result for acl check
2025-10-02T08:08:44.842081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:44.842088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:44.842090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:44.842095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533352805294941:6236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:44.842485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533352805294941:6236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:44.845234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533352805294941:6236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:44.846346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:44.847645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:44.847800Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:44.847808Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:44.847815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:44.847860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:44.847886Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533352805295089:6235]
2025-10-02T08:08:44.848026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533352805294941:6236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:44.848036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533352805294941:6236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:44.848039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533352805294941:6236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:44.848046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:44.848264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:44.848388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:44.848412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:44.848620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:44.848667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.848672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.848673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.848674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.848674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.848678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.848686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.848689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.848692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.848695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.848699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.848708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:44.848716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.848724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:44.848731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.848735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:44.848742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.848746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.848753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.848759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.848778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:44.856287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:44.857869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:44.857881Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:44.857883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:44.857886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:44.857890Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 403 [1:7556533352805295089:6235]
2025-10-02T08:08:44.857898Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:44.857910Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:44.857916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.857918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.857919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.857932Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:44.857938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:44.857942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:44.857982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.857987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.857989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:44.857990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:44.858197Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 403
2025-10-02T08:08:44.858045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:44.858051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.858059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:44.858069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:44.858083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533352805295083:6235]
2025-10-02T08:08:44.858085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533352805295083:6235]
2025-10-02T08:08:44.858091Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:44.858101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:44.858112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:44.858112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:44.858115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:44.858115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:44.858123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 403
2025-10-02T08:08:44.858125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805295094:6236], now have 1 active actors on pipe
2025-10-02T08:08:44.858144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533353265616593:2378], now have 1 active actors on pipe
2025-10-02T08:08:44.858146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533352805295083:6235]
2025-10-02T08:08:44.858164Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:44.858169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.858171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.858174Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:44.858197Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86c5e27c-ca46658f-e1071124-25a826e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:44.858201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:44.858204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:44.858205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:44.858211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:44.858218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:44.858230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.858260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:44.858262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:44.858274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:44.858299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 404 partition: 0 MaxSeqNo: 17 sessionId: src_id|86c5e27c-ca46658f-e1071124-25a826e5_0
2025-10-02T08:08:44.858583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe6ed7-9bd81f70-a53b210b-bf856660_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|86c5e27c-ca46658f-e1071124-25a826e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:44.861618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86c5e27c-ca46658f-e1071124-25a826e5_0] Write session: try to update token
2025-10-02T08:08:44.861631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86c5e27c-ca46658f-e1071124-25a826e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:44.875904Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:44.875917Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:44.875920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:44.875928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533352805295083:6235]
2025-10-02T08:08:44.875932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533352805295083:6235]
2025-10-02T08:08:44.875976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:44.875976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:44.875982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:44.875986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:44.875988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:44.876166Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:44.877904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId: src_id|86c5e27c-ca46658f-e1071124-25a826e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:44.880692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:44.931390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533352805295120:6232]
2025-10-02T08:08:44.931488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 403, pipe: [1:7556533352805295120:6232]
2025-10-02T08:08:45.001214Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:45.001590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.001602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.001633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533352805295120:6232], now have 1 active actors on pipe
2025-10-02T08:08:45.001775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533352805295120:6232]
2025-10-02T08:08:45.001786Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:45.001793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:45.001794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:45.001844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 404 reason: error at write: Disconnected sessionId: src_id|86c5e27c-ca46658f-e1071124-25a826e5_0
2025-10-02T08:08:45.001827Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:45.002007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 404 sessionId: src_id|86c5e27c-ca46658f-e1071124-25a826e5_0 is DEAD
2025-10-02T08:08:45.002139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c5e27c-ca46658f-e1071124-25a826e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:45.002147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c5e27c-ca46658f-e1071124-25a826e5_0] Write session will restart in 0.009203s
2025-10-02T08:08:45.002167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c5e27c-ca46658f-e1071124-25a826e5_0] Write session: Do CDS request
2025-10-02T08:08:45.002173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c5e27c-ca46658f-e1071124-25a826e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:45.012300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86c5e27c-ca46658f-e1071124-25a826e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.012477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:45.012499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 405
2025-10-02T08:08:45.012584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.012607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:45.012610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:45.012612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:45.012986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 405 sessionId:  describe result for acl check
2025-10-02T08:08:45.013016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:45.013017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:45.013019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:45.013023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533357100262868:6242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:45.013465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533357100262868:6242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:45.014359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:45.015853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:45.016003Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:45.016010Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:45.016016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:45.016050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:45.016076Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533357100262904:6241]
2025-10-02T08:08:45.016259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533357100262868:6242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:45.016462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:45.016581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:45.016614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:45.016843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:45.016873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.016877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.016878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.016878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.016879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.016882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.016887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.016890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.016891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.016893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.016897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.016901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.016905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.016908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.016910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.016912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.016915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.016917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.016919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.016922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.016932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:45.021390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533357100262868:6242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:45.021400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533357100262868:6242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:45.021403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533357100262868:6242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:45.021409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:45.024210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:45.025718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:45.025730Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:45.025732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:45.025735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:45.025741Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 404 [1:7556533357100262904:6241]
2025-10-02T08:08:45.025750Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:45.025761Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:45.025766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.025768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.025769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.025781Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:45.025784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:45.025788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:45.025838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.025843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.025845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:45.025847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:45.025890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:45.025894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.025902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.025909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:45.025920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533357100262885:6241]
2025-10-02T08:08:45.025921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533357100262885:6241]
2025-10-02T08:08:45.025927Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:45.025935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100262931:6242], now have 1 active actors on pipe
2025-10-02T08:08:45.025944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:45.025946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:45.025946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 404
2025-10-02T08:08:45.025949Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:45.025951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:45.025953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:45.025978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533357560583896:2378], now have 1 active actors on pipe
2025-10-02T08:08:45.025985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.025987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.025996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533357100262885:6241]
2025-10-02T08:08:45.026001Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:45.026013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:45.026017Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:45.026021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.026023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.026024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:45.026030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.026035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:45.026050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.026052Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 404
2025-10-02T08:08:45.026103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.026108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.026116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.026144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 405 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0
2025-10-02T08:08:45.026459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c5e27c-ca46658f-e1071124-25a826e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:45.029238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0] Write session: try to update token
2025-10-02T08:08:45.029252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:45.042384Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:45.042398Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:45.042400Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:45.042406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533357100262885:6241]
2025-10-02T08:08:45.042409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533357100262885:6241]
2025-10-02T08:08:45.042451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:45.042457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.042458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:45.042459Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:45.042464Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:45.042609Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:45.044780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId: src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:45.047280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:45.101924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533357100262945:6232]
2025-10-02T08:08:45.102079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 404, pipe: [1:7556533357100262945:6232]
2025-10-02T08:08:45.169837Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:45.170067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.170076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.170105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100262945:6232], now have 1 active actors on pipe
2025-10-02T08:08:45.170196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:45.170199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:45.170235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 405 reason: error at write: Disconnected sessionId: src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0
2025-10-02T08:08:45.170327Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:45.170327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:45.170372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 405 sessionId: src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0 is DEAD
2025-10-02T08:08:45.170476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:45.170483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0] Write session will restart in 0.007733s
2025-10-02T08:08:45.170500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0] Write session: Do CDS request
2025-10-02T08:08:45.170504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:45.170496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533357100262945:6232]
2025-10-02T08:08:45.179259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.179328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:45.179337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 406
2025-10-02T08:08:45.179419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.179440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:45.179446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:45.179449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:45.179784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 406 sessionId:  describe result for acl check
2025-10-02T08:08:45.179807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:45.179811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:45.179812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:45.179815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533357100263366:6248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:45.180196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533357100263366:6248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:45.181795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533357100263366:6248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:45.181836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:45.183346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:45.183490Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:45.183509Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:45.183517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:45.183553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:45.183594Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533357100263444:6247]
2025-10-02T08:08:45.184007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533357100263366:6248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:45.184018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533357100263366:6248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:45.184020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533357100263366:6248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:45.184025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:45.184151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:45.184300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:45.184336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:45.184544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:45.184574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.184579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.184580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.184580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.184581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.184584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.184590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.184592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.184594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.184595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.184599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.184603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.184607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.184610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.184612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.184615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.184617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.184619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.184622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.184624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.184634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:45.192001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:45.193487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:45.193498Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:45.193501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:45.193503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:45.193508Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 405 [1:7556533357100263444:6247]
2025-10-02T08:08:45.193515Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:45.193528Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:45.193535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.193537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.193539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.193553Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:45.193560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:45.193565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:45.193607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.193612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.193614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:45.193616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:45.193667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:45.193671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.193679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.193688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:45.193699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533357100263428:6247]
2025-10-02T08:08:45.193704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533357100263428:6247]
2025-10-02T08:08:45.193710Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:45.193721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:45.193732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:45.193734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 405
2025-10-02T08:08:45.193737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:45.193740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:45.193740Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:45.193749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100263449:6248], now have 1 active actors on pipe
2025-10-02T08:08:45.193751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533357560583902:2378], now have 1 active actors on pipe
2025-10-02T08:08:45.193774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533357100263428:6247]
2025-10-02T08:08:45.193781Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:45.193785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:45.193792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.193796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.193833Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:45.193843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.193846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.193848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:45.193856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.193830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 405
2025-10-02T08:08:45.193868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:45.193888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.193913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.193918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.193927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.193954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 406 partition: 0 MaxSeqNo: 17 sessionId: src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0
2025-10-02T08:08:45.194281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e0c48a5-e1387c8a-b1f3aa5d-64cdf8e1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:45.197018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0] Write session: try to update token
2025-10-02T08:08:45.197030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:45.209961Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:45.209973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:45.209974Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:45.209980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533357100263428:6247]
2025-10-02T08:08:45.209983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533357100263428:6247]
2025-10-02T08:08:45.210019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:45.210023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.210025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:45.210038Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:45.210043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:45.210150Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:45.212915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId: src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:45.215520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:45.270863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533357100263475:6232]
2025-10-02T08:08:45.270967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 405, pipe: [1:7556533357100263475:6232]
2025-10-02T08:08:45.335749Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:45.336042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.336052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.336085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100263475:6232], now have 1 active actors on pipe
2025-10-02T08:08:45.336179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533357100263475:6232]
2025-10-02T08:08:45.336196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:45.336201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:45.336240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 406 reason: error at write: Disconnected sessionId: src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0
2025-10-02T08:08:45.336298Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:45.336298Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:45.336393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 406 sessionId: src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0 is DEAD
2025-10-02T08:08:45.336521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:45.336527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0] Write session will restart in 0.005987s
2025-10-02T08:08:45.336554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0] Write session: Do CDS request
2025-10-02T08:08:45.336559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:45.343305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.343331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:45.343344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 407
2025-10-02T08:08:45.343462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.343483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:45.343489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:45.343491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:45.343820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 407 sessionId:  describe result for acl check
2025-10-02T08:08:45.343858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:45.343865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:45.343866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:45.343871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533357100263787:6255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:45.344358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533357100263787:6255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:45.346758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533357100263787:6255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:45.349310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533357100263787:6255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:45.349321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533357100263787:6255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:45.349324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533357100263787:6255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:45.349331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:45.349671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:45.351095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:45.351308Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:45.351315Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:45.351322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:45.351367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:45.351392Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533357100263997:6254]
2025-10-02T08:08:45.351970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:45.352143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:45.352170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:45.352360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:45.352388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.352392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.352392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.352393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.352393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.352396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.352402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.352404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.352406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.352408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.352411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.352415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.352419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.352421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.352424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.352426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.352428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.352430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.352432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.352435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.352445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:45.359926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:45.361299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:45.361312Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:45.361314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:45.361317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:45.361322Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 406 [1:7556533357100263997:6254]
2025-10-02T08:08:45.361329Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:45.361342Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:45.361347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.361349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.361351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.361362Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:45.361365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:45.361374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:45.361417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.361422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.361433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:45.361435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:45.361494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:45.361499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.361508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.361517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:45.361532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533357100263991:6254]
2025-10-02T08:08:45.361539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533357100263991:6254]
2025-10-02T08:08:45.361544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:45.361554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:45.361555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:45.361557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:45.361561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 406
2025-10-02T08:08:45.361563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:45.361565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:45.361571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100263987:6255], now have 1 active actors on pipe
2025-10-02T08:08:45.361573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533357560583920:2378], now have 1 active actors on pipe
2025-10-02T08:08:45.361598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.361604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.361614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533357100263991:6254]
2025-10-02T08:08:45.361619Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:45.361607Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 406
2025-10-02T08:08:45.361637Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:45.361646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.361648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.361649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:45.361652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:45.361655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.361661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:45.361680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.361723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.361729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.361738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.361765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 407 partition: 0 MaxSeqNo: 17 sessionId: src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0
2025-10-02T08:08:45.362134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe2e82ab-3679291c-a55dcb5c-91e51407_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:45.364918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0] Write session: try to update token
2025-10-02T08:08:45.364934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:45.377853Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:45.377869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:45.377872Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:45.377878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533357100263991:6254]
2025-10-02T08:08:45.377881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533357100263991:6254]
2025-10-02T08:08:45.377923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:45.377931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.377933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:45.377952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:45.377963Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:45.378083Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:45.380605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId: src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:45.383384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:45.441981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533357100264040:6232]
2025-10-02T08:08:45.442435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 406, pipe: [1:7556533357100264040:6232]
2025-10-02T08:08:45.503220Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:45.503590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.503602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.503634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100264040:6232], now have 1 active actors on pipe
2025-10-02T08:08:45.503714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533357100264040:6232]
2025-10-02T08:08:45.503730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:45.503735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:45.503768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 407 reason: error at write: Disconnected sessionId: src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0
2025-10-02T08:08:45.503827Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:45.503827Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:45.503947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 407 sessionId: src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0 is DEAD
2025-10-02T08:08:45.504176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:45.504184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0] Write session will restart in 0.007289s
2025-10-02T08:08:45.504204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0] Write session: Do CDS request
2025-10-02T08:08:45.504209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:45.512300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.512392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:45.512403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 408
2025-10-02T08:08:45.512564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.512584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:45.512587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:45.512590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:45.512970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 408 sessionId:  describe result for acl check
2025-10-02T08:08:45.512997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:45.512999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:45.513000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:45.513010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533357100264419:6274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:45.513421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533357100264419:6274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:45.515719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533357100264419:6274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:45.517717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:45.519176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:45.519331Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:45.519339Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:45.519348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:45.519392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:45.519427Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533357100264566:6271]
2025-10-02T08:08:45.519541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533357100264419:6274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:45.519552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533357100264419:6274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:45.519554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533357100264419:6274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:45.519560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:45.519871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:45.520027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:45.520059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:45.520283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:45.520320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.520326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.520328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.520329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.520330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.520334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.520343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.520351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.520355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.520363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.520367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.520378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.520387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.520393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.520401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.520405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.520413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.520419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.520426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.520431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.520453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:45.528308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:45.529959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:45.529970Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:45.529972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:45.529974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:45.529978Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 407 [1:7556533357100264566:6271]
2025-10-02T08:08:45.529985Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:45.529997Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:45.529999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.530001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.530002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.530013Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:45.530016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:45.530021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:45.530065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.530066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.530068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:45.530070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:45.530115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:45.530120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.530128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.530134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:45.530146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533357100264560:6271]
2025-10-02T08:08:45.530147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533357100264560:6271]
2025-10-02T08:08:45.530152Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:45.530160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:45.530171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:45.530173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:45.530176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:45.530176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:45.530184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100264571:6274], now have 1 active actors on pipe
2025-10-02T08:08:45.530189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 407
2025-10-02T08:08:45.530205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533357560583942:2378], now have 1 active actors on pipe
2025-10-02T08:08:45.530211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533357100264560:6271]
2025-10-02T08:08:45.530217Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:45.530222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.530223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:45.530226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.530259Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:45.530269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.530272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.530273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:45.530279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.530285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:45.530297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.530275Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 407
2025-10-02T08:08:45.530339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.530345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.530356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.530390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 408 partition: 0 MaxSeqNo: 17 sessionId: src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0
2025-10-02T08:08:45.530698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c275e6-3cec2c48-8c4abcc1-7c6f2235_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:45.533351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0] Write session: try to update token
2025-10-02T08:08:45.533363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:45.546929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId: src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:45.547051Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:45.547069Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:45.547071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:45.547078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533357100264560:6271]
2025-10-02T08:08:45.547081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533357100264560:6271]
2025-10-02T08:08:45.547125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:45.547131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:45.547136Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:45.547136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.547138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:45.547286Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:45.549793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:45.603644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533357100264597:6232]
2025-10-02T08:08:45.603722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 407, pipe: [1:7556533357100264597:6232]
2025-10-02T08:08:45.677834Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:45.678256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.678266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.678297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100264597:6232], now have 1 active actors on pipe
2025-10-02T08:08:45.678454Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:45.678490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:45.678548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 408 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0
2025-10-02T08:08:45.678649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533357100264597:6232]
2025-10-02T08:08:45.678705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 408 sessionId: src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0 is DEAD
2025-10-02T08:08:45.678716Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:45.678890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:45.678904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0] Write session will restart in 0.007864s
2025-10-02T08:08:45.678924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0] Write session: Do CDS request
2025-10-02T08:08:45.678929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:45.688320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.688370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:45.688381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 409
2025-10-02T08:08:45.688506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.688527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:45.688534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:45.688537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:45.689010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 409 sessionId:  describe result for acl check
2025-10-02T08:08:45.689056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:45.689064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:45.689066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:45.689072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533357100265057:6280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:45.689646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533357100265057:6280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:45.690275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:45.691586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:45.691718Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:45.691726Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:45.691733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:45.691765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:45.691791Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533357100265093:6279]
2025-10-02T08:08:45.691792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533357100265057:6280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:45.692196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:45.692331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:45.692359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:45.692554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:45.692584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.692588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.692589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.692590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.692590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.692593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.692599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.692601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.692603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.692605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.692608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.692612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.692615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.692617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.692619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.692623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.692625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.692628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.692630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.692632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.692642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:45.697080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533357100265057:6280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:45.697093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533357100265057:6280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:45.697096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533357100265057:6280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:45.697105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:45.700099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:45.701755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:45.701768Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:45.701770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:45.701773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:45.701778Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 408 [1:7556533357100265093:6279]
2025-10-02T08:08:45.701788Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:45.701802Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:45.701805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.701808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.701810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.701823Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:45.701831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:45.701837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:45.701894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.701901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.701904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:45.701906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:45.701962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:45.701968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.701979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.701989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:45.702008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100265120:6280], now have 1 active actors on pipe
2025-10-02T08:08:45.702017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533357100265075:6279]
2025-10-02T08:08:45.702018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533357100265075:6279]
2025-10-02T08:08:45.702023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 408
2025-10-02T08:08:45.702028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:45.702037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:45.702040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:45.702043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533357560583958:2378], now have 1 active actors on pipe
2025-10-02T08:08:45.702047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.702051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.702070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:45.702085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:45.702092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:45.702076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 408
2025-10-02T08:08:45.702123Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:45.702134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.702141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.702143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:45.702150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.702161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:45.702168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533357100265075:6279]
2025-10-02T08:08:45.702180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:45.702193Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:45.702211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.702258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.702264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.702275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.702309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 409 partition: 0 MaxSeqNo: 17 sessionId: src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0
2025-10-02T08:08:45.702614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd1cdfb-28538da5-99043db1-4591d28a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:45.705328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0] Write session: try to update token
2025-10-02T08:08:45.705340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:45.718293Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:45.718310Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:45.718313Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:45.718320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533357100265075:6279]
2025-10-02T08:08:45.718323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533357100265075:6279]
2025-10-02T08:08:45.718361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:45.718367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.718369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:45.718370Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:45.718374Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:45.718518Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:45.719466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId: src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:45.722151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:45.778770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533357100265134:6232]
2025-10-02T08:08:45.778848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 408, pipe: [1:7556533357100265134:6232]
2025-10-02T08:08:45.844378Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:45.844694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.844705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.844735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100265134:6232], now have 1 active actors on pipe
2025-10-02T08:08:45.844840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533357100265134:6232]
2025-10-02T08:08:45.844862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:45.844868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:45.844895Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:45.844927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 409 reason: error at write: Disconnected sessionId: src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0
2025-10-02T08:08:45.844944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:45.845091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 409 sessionId: src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0 is DEAD
2025-10-02T08:08:45.845235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:45.845244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0] Write session will restart in 0.006358s
2025-10-02T08:08:45.845272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0] Write session: Do CDS request
2025-10-02T08:08:45.845277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:45.852301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.852536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:45.852549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 410
2025-10-02T08:08:45.852654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:45.852689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:45.852698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:45.852702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:45.853078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 410 sessionId:  describe result for acl check
2025-10-02T08:08:45.853106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:45.853110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:45.853112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:45.853116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533357100265479:6287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:45.853497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533357100265479:6287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:45.856034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533357100265479:6287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:45.857915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:45.858203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533357100265479:6287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:45.858213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533357100265479:6287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:45.858216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533357100265479:6287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:45.858222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:45.859328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:45.859482Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:45.859491Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:45.859500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:45.859545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:45.859577Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533357100265649:6286]
2025-10-02T08:08:45.859972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:45.860118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:45.860145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:45.860328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:45.860353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.860356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.860357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.860358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.860358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.860361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.860367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.860369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.860371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.860373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.860376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.860380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:45.860384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.860386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:45.860390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.860392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:45.860394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.860397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.860400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.860402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.860411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:45.867969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:45.869748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:45.869765Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:45.869768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:45.869771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:45.869777Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 409 [1:7556533357100265649:6286]
2025-10-02T08:08:45.869789Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:45.869806Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:45.869809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.869812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.869813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.869831Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:45.869839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:45.869846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:45.869911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.869922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.869924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:45.869926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:45.869989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:45.869996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.870007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:45.870016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:45.870033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 409
2025-10-02T08:08:45.870034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100265645:6287], now have 1 active actors on pipe
2025-10-02T08:08:45.870037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533357560583966:2378], now have 1 active actors on pipe
2025-10-02T08:08:45.870043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533357100265637:6286]
2025-10-02T08:08:45.870045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533357100265637:6286]
2025-10-02T08:08:45.870057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:45.870066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.870067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:45.870070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.870070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:45.870087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:45.870104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:45.870110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:45.870094Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 409
2025-10-02T08:08:45.870151Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71c0ccb9-310421b2-ac716e83-486e639c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:45.870162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:45.870165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:45.870167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:45.870176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:45.870185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:45.870203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533357100265637:6286]
2025-10-02T08:08:45.870217Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:45.870240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:45.870247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.870284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:45.870291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:45.870303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:45.870340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 410 partition: 0 MaxSeqNo: 17 sessionId: src_id|71c0ccb9-310421b2-ac716e83-486e639c_0
2025-10-02T08:08:45.870684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4180b2d6-2a9ccad9-24f9dcb2-95ffd90f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|71c0ccb9-310421b2-ac716e83-486e639c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:45.873417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c0ccb9-310421b2-ac716e83-486e639c_0] Write session: try to update token
2025-10-02T08:08:45.873430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c0ccb9-310421b2-ac716e83-486e639c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:45.886532Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:45.886548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:45.886554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:45.886561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533357100265637:6286]
2025-10-02T08:08:45.886565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533357100265637:6286]
2025-10-02T08:08:45.886608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:45.886608Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:45.886614Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:45.886617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:45.886619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:45.886754Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:45.889150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId: src_id|71c0ccb9-310421b2-ac716e83-486e639c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:45.891844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:45.945157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533357100265674:6232]
2025-10-02T08:08:45.945263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 409, pipe: [1:7556533357100265674:6232]
2025-10-02T08:08:46.017255Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:46.017623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.017634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.017664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533357100265674:6232], now have 1 active actors on pipe
2025-10-02T08:08:46.017752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533357100265674:6232]
2025-10-02T08:08:46.017770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:46.017771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:46.017817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 410 reason: error at write: Disconnected sessionId: src_id|71c0ccb9-310421b2-ac716e83-486e639c_0
2025-10-02T08:08:46.017869Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:46.017901Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:46.017989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 410 sessionId: src_id|71c0ccb9-310421b2-ac716e83-486e639c_0 is DEAD
2025-10-02T08:08:46.018156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c0ccb9-310421b2-ac716e83-486e639c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:46.018165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c0ccb9-310421b2-ac716e83-486e639c_0] Write session will restart in 0.006101s
2025-10-02T08:08:46.018190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c0ccb9-310421b2-ac716e83-486e639c_0] Write session: Do CDS request
2025-10-02T08:08:46.018197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c0ccb9-310421b2-ac716e83-486e639c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:46.025209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c0ccb9-310421b2-ac716e83-486e639c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.025305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:46.025317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 411
2025-10-02T08:08:46.025455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.025481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:46.025488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:46.025500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:46.025881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 411 sessionId:  describe result for acl check
2025-10-02T08:08:46.025907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:46.025911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:46.025912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:46.025916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533361395233314:6293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:46.026441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533361395233314:6293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:46.028947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533361395233314:6293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:46.032082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:46.032379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:46.032455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533361395233314:6293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:46.032463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533361395233314:6293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:46.032465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533361395233314:6293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:46.032471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:46.032538Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:46.032546Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:46.032553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:46.032587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:46.032614Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533361395233482:6292]
2025-10-02T08:08:46.033103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:46.033269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:46.033311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:46.033554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:46.033586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.033591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.033592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.033593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.033593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.033598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.033607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.033612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.033614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.033616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.033619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.033624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.033627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.033630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.033632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.033634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.033637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.033639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.033641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.033644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.033655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:46.041024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:46.042462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:46.042472Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:46.042474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:46.042477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:46.042481Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 410 [1:7556533361395233482:6292]
2025-10-02T08:08:46.042489Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:46.042500Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:46.042502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.042504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.042505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.042516Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:46.042519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:46.042523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:46.042563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.042569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.042571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:46.042572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:46.042619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:46.042627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.042638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.042648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:46.042665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395233483:6293], now have 1 active actors on pipe
2025-10-02T08:08:46.042667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 410
2025-10-02T08:08:46.042670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533361395233474:6292]
2025-10-02T08:08:46.042672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533361395233474:6292]
2025-10-02T08:08:46.042679Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:46.042686Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:46.042688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:46.042690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:46.042703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:46.042710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:46.042715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533361855551269:2378], now have 1 active actors on pipe
2025-10-02T08:08:46.042719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.042723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.042757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533361395233474:6292]
2025-10-02T08:08:46.042763Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:46.042752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 410
2025-10-02T08:08:46.042777Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|288a574b-21990770-698180cf-7999104a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:46.042782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:46.042786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.042789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.042791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:46.042799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.042807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:46.042843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.042910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.042920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.042948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.042983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 411 partition: 0 MaxSeqNo: 17 sessionId: src_id|288a574b-21990770-698180cf-7999104a_0
2025-10-02T08:08:46.043298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c0ccb9-310421b2-ac716e83-486e639c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|288a574b-21990770-698180cf-7999104a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:46.046093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288a574b-21990770-698180cf-7999104a_0] Write session: try to update token
2025-10-02T08:08:46.046107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288a574b-21990770-698180cf-7999104a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:46.052554Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:46.052571Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:46.052580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533361395233474:6292]
2025-10-02T08:08:46.052614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:46.052635Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:46.052785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:46.052950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:46.053105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:46.053232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:46.053412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:46.053447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:46.060335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId: src_id|288a574b-21990770-698180cf-7999104a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:46.062751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:46.062809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.062818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.062842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:46.062859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:46.062915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.062926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.063077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.063170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.063246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.063306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.063596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.063603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.063658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.063745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.063800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.063883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.063924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.063929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.063983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.064033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.064089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.064147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.064203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.064208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.064266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.064319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.064372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.064422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.064469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.064476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.064531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.064579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.064634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.064688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.064829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.064835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.064887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.064935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.064986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.065034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.065070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.065075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.065128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.065178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.065239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.065296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.065339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.065344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.065396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.065445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.065496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.065554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.065653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.065660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.065716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.065769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.065869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.065930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.066056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.066061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.066116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:46.066191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:46.066242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:46.066302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:46.066342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:46.066347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:46.066389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:46.066432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.066446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.066450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:46.066473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:46.066489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:46.066496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:46.066498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:46.066505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:46.066861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:46.066879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:46.066884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:46.066887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:46.066889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:46.066891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:46.067408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:46.067427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:46.067433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:46.067435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:46.067437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:46.067439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:46.067862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:46.067879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:46.067889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:46.067896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:46.067898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:46.069103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:46.069116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:46.069123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392526069
2025-10-02T08:08:46.069248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:46.069257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:46.069261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:46.069263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:46.069266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:46.069268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:46.069727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:46.069744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:46.069748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:46.069751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:46.069754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:46.069756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:46.070187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:46.070201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:46.070206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:46.070211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:46.070213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:46.070214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:46.070645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:46.070658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:46.070662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:46.071724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:46.071736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:46.071739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:46.071742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:46.071748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392526071
2025-10-02T08:08:46.072016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:46.072031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:46.072034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:46.072036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:46.072039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:46.072041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:46.072455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:46.072470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:46.072476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:46.072478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:46.072479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:46.072481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:46.072948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:46.072965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.073056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392526072
2025-10-02T08:08:46.077686Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:46.077707Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:46.077712Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:46.077717Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:46.077726Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:46.077731Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:46.077732Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:46.077742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533361395233474:6292]
2025-10-02T08:08:46.077745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533361395233474:6292]
2025-10-02T08:08:46.077787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:46.077796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:46.077808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:46.077814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.077815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:46.077936Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:46.117651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533361395233512:6232]
2025-10-02T08:08:46.117756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 410, pipe: [1:7556533361395233512:6232]
2025-10-02T08:08:46.201215Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:46.201522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395233512:6232], now have 1 active actors on pipe
2025-10-02T08:08:46.201635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:46.201642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:46.201667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 411 reason: error at write: Disconnected sessionId: src_id|288a574b-21990770-698180cf-7999104a_0
2025-10-02T08:08:46.201735Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:46.201768Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:46.201839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 411 sessionId: src_id|288a574b-21990770-698180cf-7999104a_0 is DEAD
2025-10-02T08:08:46.201966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288a574b-21990770-698180cf-7999104a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:46.201978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288a574b-21990770-698180cf-7999104a_0] Write session will restart in 0.007108s
2025-10-02T08:08:46.202000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288a574b-21990770-698180cf-7999104a_0] Write session: Do CDS request
2025-10-02T08:08:46.202006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288a574b-21990770-698180cf-7999104a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:46.202000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533361395233512:6232]
2025-10-02T08:08:46.205111Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [322b4811a6542b70] Result# TEvPutResult {Id# [72075186224037892:410:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:08:46.205151Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:410:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:46.205175Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:410:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:08:46.210451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|288a574b-21990770-698180cf-7999104a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.210490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:46.210503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 412
2025-10-02T08:08:46.210714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.210742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:46.210750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:46.210753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:46.211167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 412 sessionId:  describe result for acl check
2025-10-02T08:08:46.211200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:46.211201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:46.211202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:46.211207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533361395233834:6299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:46.211671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533361395233834:6299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:46.214329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533361395233834:6299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:46.217076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:46.217231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533361395233834:6299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:46.217244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533361395233834:6299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:46.217247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533361395233834:6299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:46.217254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:46.218447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:46.218614Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:46.218623Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:46.218632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:46.218676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:46.218714Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533361395234035:6298]
2025-10-02T08:08:46.219243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:46.219399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:46.219437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:46.219704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:46.219750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.219755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.219756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.219757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.219757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.219762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.219770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.219773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.219777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.219780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.219789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.219795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.219800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.219808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.219813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.219820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.219824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.219839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.219848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.219852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.219871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:46.227353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:46.228888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:46.228901Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:46.228903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:46.228906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:46.228912Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 411 [1:7556533361395234035:6298]
2025-10-02T08:08:46.228923Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:46.228938Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:46.228941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.228944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.228946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.228960Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:46.228965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:46.228972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:46.229038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.229046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.229049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:46.229051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:46.229112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:46.229119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.229131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.229145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:46.229165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395234030:6299], now have 1 active actors on pipe
2025-10-02T08:08:46.229173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533361855551276:2378], now have 1 active actors on pipe
2025-10-02T08:08:46.229173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 411
2025-10-02T08:08:46.229179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533361395234023:6298]
2025-10-02T08:08:46.229181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533361395234023:6298]
2025-10-02T08:08:46.229192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:46.229205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.229208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:46.229211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:46.229212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.229227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:46.229241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:46.229243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:46.229243Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 411
2025-10-02T08:08:46.229278Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:46.229288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.229292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.229294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:46.229303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.229312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:46.229319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533361395234023:6298]
2025-10-02T08:08:46.229328Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:46.229332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:46.229352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.229395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.229402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.229415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.229448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 412 partition: 0 MaxSeqNo: 17 sessionId: src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0
2025-10-02T08:08:46.229756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|288a574b-21990770-698180cf-7999104a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:46.232505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0] Write session: try to update token
2025-10-02T08:08:46.232524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:46.245478Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:46.245495Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:46.245497Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:46.245505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533361395234023:6298]
2025-10-02T08:08:46.245509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533361395234023:6298]
2025-10-02T08:08:46.245547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:46.245553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.245554Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:46.245555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:46.245559Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:46.245691Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:46.246478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId: src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:46.248953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:46.302043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533361395234070:6232]
2025-10-02T08:08:46.302105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 411, pipe: [1:7556533361395234070:6232]
2025-10-02T08:08:46.373406Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:46.373940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.373953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.373985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395234070:6232], now have 1 active actors on pipe
2025-10-02T08:08:46.374075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:46.374085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:46.374148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 412 reason: error at write: Disconnected sessionId: src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0
2025-10-02T08:08:46.374148Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:46.374144Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:46.374320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 412 sessionId: src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0 is DEAD
2025-10-02T08:08:46.374459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533361395234070:6232]
2025-10-02T08:08:46.374523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:46.374538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0] Write session will restart in 0.006740s
2025-10-02T08:08:46.374567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0] Write session: Do CDS request
2025-10-02T08:08:46.374575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:46.382395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.382471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:46.382485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 413
2025-10-02T08:08:46.382659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.382691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:46.382700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:46.382703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:46.383084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 413 sessionId:  describe result for acl check
2025-10-02T08:08:46.383115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:46.383117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:46.383118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:46.383123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533361395234377:6306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:46.383611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533361395234377:6306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:46.387011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533361395234377:6306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:46.389817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533361395234377:6306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:46.389845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533361395234377:6306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:46.389848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533361395234377:6306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:46.389855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:46.390114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:46.391504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:46.391630Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:46.391637Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:46.391643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:46.391672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:46.391703Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533361395234597:6305]
2025-10-02T08:08:46.392098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:46.392243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:46.392274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:46.392459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:46.392485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.392490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.392491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.392492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.392493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.392495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.392501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.392503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.392505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.392507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.392511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.392515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.392518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.392521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.392523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.392525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.392528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.392530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.392532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.392535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.392544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:46.400128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:46.401826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:46.401839Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:46.401841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:46.401845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:46.401850Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 412 [1:7556533361395234597:6305]
2025-10-02T08:08:46.401860Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:46.401879Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:46.401885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.401888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.401890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.401904Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:46.401911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:46.401917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:46.401986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.401993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.401996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:46.401998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:46.402055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:46.402062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.402072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.402086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:46.402105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 412
2025-10-02T08:08:46.402107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395234588:6306], now have 1 active actors on pipe
2025-10-02T08:08:46.402110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533361855551297:2378], now have 1 active actors on pipe
2025-10-02T08:08:46.402115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533361395234590:6305]
2025-10-02T08:08:46.402117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533361395234590:6305]
2025-10-02T08:08:46.402126Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:46.402139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.402140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:46.402142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:46.402147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.402163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:46.402170Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 412
2025-10-02T08:08:46.402179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:46.402189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:46.402223Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:46.402233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.402236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.402237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:46.402244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.402255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:46.402268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533361395234590:6305]
2025-10-02T08:08:46.402278Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:46.402288Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:46.402304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.402352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.402360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.402371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.402402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 413 partition: 0 MaxSeqNo: 17 sessionId: src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0
2025-10-02T08:08:46.402724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbe94c2-bc4dddda-54f2b1d-52e502e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:46.405378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0] Write session: try to update token
2025-10-02T08:08:46.405393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:46.418778Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:46.418797Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:46.418799Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:46.418808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533361395234590:6305]
2025-10-02T08:08:46.418812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533361395234590:6305]
2025-10-02T08:08:46.418855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:46.418858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:46.418861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.418863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:46.418875Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:46.419009Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:46.420563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId: src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:46.423033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:46.474849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533361395234655:6232]
2025-10-02T08:08:46.474932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 412, pipe: [1:7556533361395234655:6232]
2025-10-02T08:08:46.552730Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:46.552929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.552939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.552968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395234655:6232], now have 1 active actors on pipe
2025-10-02T08:08:46.553084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533361395234655:6232]
2025-10-02T08:08:46.553109Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:46.553109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:46.553111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:46.553106Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:46.553165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 413 reason: error at write: Disconnected sessionId: src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0
2025-10-02T08:08:46.553324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 413 sessionId: src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0 is DEAD
2025-10-02T08:08:46.553460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:46.553468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0] Write session will restart in 0.009396s
2025-10-02T08:08:46.553495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0] Write session: Do CDS request
2025-10-02T08:08:46.553501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:46.564288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.564370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:46.564383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 414
2025-10-02T08:08:46.564523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.564552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:46.564562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:46.564569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:46.564950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 414 sessionId:  describe result for acl check
2025-10-02T08:08:46.564980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:46.564985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:46.564986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:46.564989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533361395235146:6325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:46.565121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:46.565453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533361395235146:6325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:46.566580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:46.566700Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:46.566706Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:46.566712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:46.566741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:46.566767Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533361395235166:6324]
2025-10-02T08:08:46.567159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:46.567296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:46.567321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:46.567556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533361395235146:6325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:46.567561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:46.567586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.567587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.567588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.567588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.567589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.567592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.567597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.567599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.567601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.567603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.567606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.567610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.567613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.567615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.567620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.567622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.567624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.567627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.567629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.567631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.567641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:46.573072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533361395235146:6325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:46.573081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533361395235146:6325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:46.573084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533361395235146:6325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:46.573090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:46.575037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:46.576645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:46.576656Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:46.576658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:46.576661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:46.576668Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 413 [1:7556533361395235166:6324]
2025-10-02T08:08:46.576678Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:46.576691Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:46.576697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.576700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.576702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.576714Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:46.576723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:46.576729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:46.576777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.576782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.576784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:46.576786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:46.576854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:46.576860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.576869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.576880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:46.576899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533361395235147:6324]
2025-10-02T08:08:46.576905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533361395235147:6324]
2025-10-02T08:08:46.576912Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:46.576925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 413
2025-10-02T08:08:46.576928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395235195:6325], now have 1 active actors on pipe
2025-10-02T08:08:46.576930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:46.576934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:46.576934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:46.576944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:46.576945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:46.576949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533361855551327:2378], now have 1 active actors on pipe
2025-10-02T08:08:46.576971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.576976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.576986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533361395235147:6324]
2025-10-02T08:08:46.576991Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:46.576992Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 413
2025-10-02T08:08:46.577007Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:46.577016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.577018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:46.577019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.577020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:46.577028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.577035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:46.577060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.577124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.577137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.577148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.577174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 414 partition: 0 MaxSeqNo: 17 sessionId: src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0
2025-10-02T08:08:46.577480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bf906-1cc3b4d1-4298b775-2ee18e3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:46.580326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0] Write session: try to update token
2025-10-02T08:08:46.580338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:46.594642Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:46.594660Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:46.594662Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:46.594669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533361395235147:6324]
2025-10-02T08:08:46.594672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533361395235147:6324]
2025-10-02T08:08:46.594711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:46.594710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:46.594715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:46.594716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.594718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:46.594771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId: src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:46.594855Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:46.597534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:46.653254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533361395235208:6232]
2025-10-02T08:08:46.653349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 413, pipe: [1:7556533361395235208:6232]
2025-10-02T08:08:46.732972Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:46.733241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.733254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.733289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395235208:6232], now have 1 active actors on pipe
2025-10-02T08:08:46.733372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:46.733383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:46.733436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 414 reason: error at write: Disconnected sessionId: src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0
2025-10-02T08:08:46.733477Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:46.733502Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:46.733610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 414 sessionId: src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0 is DEAD
2025-10-02T08:08:46.733766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:46.733775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0] Write session will restart in 0.008546s
2025-10-02T08:08:46.733760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533361395235208:6232]
2025-10-02T08:08:46.733797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0] Write session: Do CDS request
2025-10-02T08:08:46.733803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:46.743274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.743496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:46.743514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 415
2025-10-02T08:08:46.743748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.743784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:46.743795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:46.743799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:46.744257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 415 sessionId:  describe result for acl check
2025-10-02T08:08:46.744308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:46.744315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:46.744316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:46.744321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533361395235630:6331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:46.744835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533361395235630:6331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:46.747523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533361395235630:6331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:46.749368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:46.749796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:46.749972Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:46.749985Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:46.749994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:46.750043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:46.750080Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533361395235727:6330]
2025-10-02T08:08:46.750270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533361395235630:6331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:46.750280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533361395235630:6331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:46.750283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533361395235630:6331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:46.750292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:46.750630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:46.750820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:46.750866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:46.751148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:46.751211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.751217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.751218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.751219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.751220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.751225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.751235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.751239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.751242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.751245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.751250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.751257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.751263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.751266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.751271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.751277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.751281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.751285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.751290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.751299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.751316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:46.758975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:46.760704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:46.760725Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:46.760728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:46.760732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:46.760739Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 414 [1:7556533361395235727:6330]
2025-10-02T08:08:46.760750Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:46.760768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:46.760771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.760774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.760777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.760792Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:46.760797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:46.760824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:46.760896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.760903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.760906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:46.760909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:46.760975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:46.760983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.760997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.761008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:46.761028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395235732:6331], now have 1 active actors on pipe
2025-10-02T08:08:46.761034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533361395235721:6330]
2025-10-02T08:08:46.761036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533361395235721:6330]
2025-10-02T08:08:46.761038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 414
2025-10-02T08:08:46.761044Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:46.761051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:46.761054Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:46.761055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:46.761071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:46.761079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:46.761086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.761089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.761105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533361855551333:2378], now have 1 active actors on pipe
2025-10-02T08:08:46.761140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533361395235721:6330]
2025-10-02T08:08:46.761147Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:46.761139Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 414
2025-10-02T08:08:46.761162Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:46.761163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:46.761172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.761175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.761177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:46.761187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.761195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:46.761247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.761349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.761359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.761375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.761412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 415 partition: 0 MaxSeqNo: 17 sessionId: src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0
2025-10-02T08:08:46.761776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89633832-ce91ecaa-3b4215b1-6101cc72_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:46.764648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0] Write session: try to update token
2025-10-02T08:08:46.764660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:46.777894Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:46.777916Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:46.777919Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:46.777927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533361395235721:6330]
2025-10-02T08:08:46.777931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533361395235721:6330]
2025-10-02T08:08:46.777972Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:46.777975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:46.777981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:46.777981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.777984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:46.778124Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:46.779957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId: src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:46.782640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:46.833952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533361395235760:6232]
2025-10-02T08:08:46.834046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 414, pipe: [1:7556533361395235760:6232]
2025-10-02T08:08:46.907425Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:46.907774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.907784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.907812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395235760:6232], now have 1 active actors on pipe
2025-10-02T08:08:46.907946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533361395235760:6232]
2025-10-02T08:08:46.907962Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:46.907964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:46.907966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:46.908021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 415 reason: error at write: Disconnected sessionId: src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0
2025-10-02T08:08:46.908014Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:46.908159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 415 sessionId: src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0 is DEAD
2025-10-02T08:08:46.908318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:46.908324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0] Write session will restart in 0.008500s
2025-10-02T08:08:46.908342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0] Write session: Do CDS request
2025-10-02T08:08:46.908346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:46.918309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.918442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:46.918454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 416
2025-10-02T08:08:46.918575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:46.918602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:46.918609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:46.918612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:46.918961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 416 sessionId:  describe result for acl check
2025-10-02T08:08:46.918985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:46.918989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:46.918990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:46.918994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533361395236235:6338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:46.919315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533361395236235:6338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:46.920242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:46.921223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533361395236235:6338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:46.921962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:46.922116Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:46.922123Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:46.922131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:46.922170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:46.922203Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533361395236281:6337]
2025-10-02T08:08:46.922777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:46.922937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:46.922962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:46.923213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:46.923260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.923265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.923266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.923267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.923268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.923272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.923281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.923285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.923294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.923297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.923301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.923308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:46.923317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.923322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:46.923326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.923333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:46.923335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.923338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.923340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.923343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.923353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:46.923875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533361395236235:6338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:46.923885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533361395236235:6338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:46.923888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533361395236235:6338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:46.923896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:46.930780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:46.932280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:46.932292Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:46.932293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:46.932295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:46.932300Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 415 [1:7556533361395236281:6337]
2025-10-02T08:08:46.932307Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:46.932320Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:46.932328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.932330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.932332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.932347Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:46.932356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:46.932361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:46.932403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.932408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.932411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:46.932412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:46.932455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:46.932461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.932471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:46.932481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:46.932497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 415
2025-10-02T08:08:46.932501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533361395236298:6338], now have 1 active actors on pipe
2025-10-02T08:08:46.932504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533361855551341:2378], now have 1 active actors on pipe
2025-10-02T08:08:46.932509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533361395236254:6337]
2025-10-02T08:08:46.932511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533361395236254:6337]
2025-10-02T08:08:46.932521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:46.932531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.932532Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:46.932534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:46.932539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.932555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:46.932571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:46.932577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:46.932569Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 415
2025-10-02T08:08:46.932606Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:46.932613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:46.932616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:46.932617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:46.932623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:46.932629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:46.932636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533361395236254:6337]
2025-10-02T08:08:46.932639Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:46.932655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.932659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:46.932696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:46.932701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:46.932709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:46.932738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 416 partition: 0 MaxSeqNo: 17 sessionId: src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0
2025-10-02T08:08:46.933070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|654c5a6f-3fd0f795-d5656a55-78ac21c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:46.935743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0] Write session: try to update token
2025-10-02T08:08:46.935758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:46.948604Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:46.948619Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:46.948622Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:46.948630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533361395236254:6337]
2025-10-02T08:08:46.948635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533361395236254:6337]
2025-10-02T08:08:46.948678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:46.948680Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:46.948684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:46.948686Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:46.948686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:46.948867Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:46.950234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId: src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:46.953045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:47.008062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533365690203612:6232]
2025-10-02T08:08:47.008191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 415, pipe: [1:7556533365690203612:6232]
2025-10-02T08:08:47.074869Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:47.075109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.075118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.075148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690203612:6232], now have 1 active actors on pipe
2025-10-02T08:08:47.075227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533365690203612:6232]
2025-10-02T08:08:47.075240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:47.075245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:47.075282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 416 reason: error at write: Disconnected sessionId: src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0
2025-10-02T08:08:47.075314Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:47.075363Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:47.075425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 416 sessionId: src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0 is DEAD
2025-10-02T08:08:47.075619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:47.075627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0] Write session will restart in 0.007997s
2025-10-02T08:08:47.075648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0] Write session: Do CDS request
2025-10-02T08:08:47.075653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:47.084296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.084356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:47.084370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 417
2025-10-02T08:08:47.084557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.084585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:47.084593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:47.084596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:47.085030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 417 sessionId:  describe result for acl check
2025-10-02T08:08:47.085060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:47.085065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:47.085067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:47.085071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533365690204069:6344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:47.085434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533365690204069:6344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:47.086659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:47.086982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533365690204069:6344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:47.087891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:47.088092Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:47.088099Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:47.088106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:47.088138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:47.088163Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533365690204134:6343]
2025-10-02T08:08:47.088535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:47.088687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:47.088712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:47.088926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:47.088959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.088960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.088960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.088961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.088962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.088965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.088971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.088972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.088974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.088976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.088980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.088985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.088992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.088995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.088997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.088999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.089005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.089007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.089010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.089012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.089022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:47.089142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533365690204069:6344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:47.089150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533365690204069:6344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:47.089152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533365690204069:6344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:47.089157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:47.096270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:47.097902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:47.097914Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:47.097916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:47.097918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:47.097923Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 416 [1:7556533365690204134:6343]
2025-10-02T08:08:47.097930Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:47.097943Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:47.097945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.097947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.097949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.097963Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:47.097972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:47.097982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:47.098030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.098034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.098037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:47.098040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:47.098098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:47.098104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.098111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.098118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:47.098128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533365690204117:6343]
2025-10-02T08:08:47.098130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533365690204117:6343]
2025-10-02T08:08:47.098134Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:47.098144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690204151:6344], now have 1 active actors on pipe
2025-10-02T08:08:47.098150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:47.098150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:47.098154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:47.098157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:47.098158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:47.098162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533366150518643:2378], now have 1 active actors on pipe
2025-10-02T08:08:47.098178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 416
2025-10-02T08:08:47.098181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533365690204117:6343]
2025-10-02T08:08:47.098183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:47.098185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:47.098187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.098189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.098220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|748009f8-5377976b-e3941f92-81263079_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:47.098232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.098235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.098237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:47.098244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.098251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:47.098264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.098246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 416
2025-10-02T08:08:47.098346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.098351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.098360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.098393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 417 partition: 0 MaxSeqNo: 17 sessionId: src_id|748009f8-5377976b-e3941f92-81263079_0
2025-10-02T08:08:47.098773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d42bf7-74db8a3-ee9b5e2e-77dd1db1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|748009f8-5377976b-e3941f92-81263079_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:47.101493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748009f8-5377976b-e3941f92-81263079_0] Write session: try to update token
2025-10-02T08:08:47.101514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748009f8-5377976b-e3941f92-81263079_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:47.114121Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:47.114136Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:47.114138Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:47.114145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533365690204117:6343]
2025-10-02T08:08:47.114149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533365690204117:6343]
2025-10-02T08:08:47.114184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:47.114187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:47.114192Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:47.114193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.114195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:47.114341Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:47.115787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId: src_id|748009f8-5377976b-e3941f92-81263079_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:47.118551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:47.175471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533365690204165:6232]
2025-10-02T08:08:47.175574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 416, pipe: [1:7556533365690204165:6232]
2025-10-02T08:08:47.239331Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:47.239531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.239540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.239566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690204165:6232], now have 1 active actors on pipe
2025-10-02T08:08:47.239648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:47.239656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:47.239699Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:47.239713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 417 reason: error at write: Disconnected sessionId: src_id|748009f8-5377976b-e3941f92-81263079_0
2025-10-02T08:08:47.239717Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:47.239858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 417 sessionId: src_id|748009f8-5377976b-e3941f92-81263079_0 is DEAD
2025-10-02T08:08:47.239898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533365690204165:6232]
2025-10-02T08:08:47.240061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748009f8-5377976b-e3941f92-81263079_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:47.240073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748009f8-5377976b-e3941f92-81263079_0] Write session will restart in 0.009679s
2025-10-02T08:08:47.240094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748009f8-5377976b-e3941f92-81263079_0] Write session: Do CDS request
2025-10-02T08:08:47.240099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748009f8-5377976b-e3941f92-81263079_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:47.251274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748009f8-5377976b-e3941f92-81263079_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.251351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:47.251364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 418
2025-10-02T08:08:47.251498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.251546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:47.251555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:47.251559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:47.251857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 418 sessionId:  describe result for acl check
2025-10-02T08:08:47.251880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:47.251885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:47.251886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:47.251890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533365690204642:6350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:47.252244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533365690204642:6350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:47.254283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533365690204642:6350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:47.254549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:47.254908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:47.255051Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:47.255058Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:47.255065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:47.255098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:47.255123Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533365690204689:6349]
2025-10-02T08:08:47.255502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:47.255637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:47.255670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:47.255869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:47.255900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.255905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.255906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.255907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.255908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.255912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.255920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.255924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.255927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.255930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.255939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.255947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.255951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.255957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.255959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.255962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.255965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.255968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.255971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.255974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.255984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:47.256635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533365690204642:6350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:47.256645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533365690204642:6350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:47.256648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533365690204642:6350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:47.256654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:47.263566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:47.265139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:47.265152Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:47.265155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:47.265158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:47.265164Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 417 [1:7556533365690204689:6349]
2025-10-02T08:08:47.265174Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:47.265190Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:47.265197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.265200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.265202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.265217Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:47.265226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:47.265233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:47.265292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.265303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.265306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:47.265308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:47.265365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:47.265372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.265382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.265400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:47.265414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 417
2025-10-02T08:08:47.265417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690204705:6350], now have 1 active actors on pipe
2025-10-02T08:08:47.265421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533366150518662:2378], now have 1 active actors on pipe
2025-10-02T08:08:47.265426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533365690204675:6349]
2025-10-02T08:08:47.265428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533365690204675:6349]
2025-10-02T08:08:47.265436Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:47.265443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.265447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:47.265450Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:47.265451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.265468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:47.265481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:47.265487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:47.265482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 417
2025-10-02T08:08:47.265522Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:47.265532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.265539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.265541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:47.265548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.265559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:47.265569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533365690204675:6349]
2025-10-02T08:08:47.265580Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:47.265591Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:47.265610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.265646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.265652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.265665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.265699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 418 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0
2025-10-02T08:08:47.266032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748009f8-5377976b-e3941f92-81263079_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:47.268540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0] Write session: try to update token
2025-10-02T08:08:47.268561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:47.281683Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:47.281700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:47.281703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:47.281712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533365690204675:6349]
2025-10-02T08:08:47.281716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533365690204675:6349]
2025-10-02T08:08:47.281757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:47.281763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.281765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:47.281774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:47.281787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:47.281901Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:47.282752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId: src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:47.285517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:47.339845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533365690204732:6232]
2025-10-02T08:08:47.339935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 417, pipe: [1:7556533365690204732:6232]
2025-10-02T08:08:47.410229Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:47.410517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.410531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.410567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690204732:6232], now have 1 active actors on pipe
2025-10-02T08:08:47.410650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533365690204732:6232]
2025-10-02T08:08:47.410669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:47.410674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:47.410721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 418 reason: error at write: Disconnected sessionId: src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0
2025-10-02T08:08:47.410733Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:47.410731Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:47.410869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 418 sessionId: src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0 is DEAD
2025-10-02T08:08:47.411032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:47.411041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0] Write session will restart in 0.006066s
2025-10-02T08:08:47.411057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0] Write session: Do CDS request
2025-10-02T08:08:47.411062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:47.418200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.418244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:47.418255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 419
2025-10-02T08:08:47.418378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.418406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:47.418409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:47.418412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:47.418788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 419 sessionId:  describe result for acl check
2025-10-02T08:08:47.418818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:47.418824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:47.418826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:47.418830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533365690205104:6358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:47.419286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533365690205104:6358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:47.421566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533365690205104:6358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:47.424651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:47.424905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533365690205104:6358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:47.424914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533365690205104:6358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:47.424916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533365690205104:6358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:47.424921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:47.424926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:47.425055Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:47.425067Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:47.425076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:47.425116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:47.425149Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533365690205270:6357]
2025-10-02T08:08:47.425717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:47.425856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:47.425892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:47.426126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:47.426164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.426171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.426171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.426172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.426173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.426177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.426187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.426190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.426193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.426196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.426200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.426206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.426211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.426215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.426219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.426223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.426226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.426230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.426234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.426239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.426260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:47.433493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:47.435043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:47.435058Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:47.435060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:47.435062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:47.435065Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 418 [1:7556533365690205270:6357]
2025-10-02T08:08:47.435071Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:47.435083Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:47.435085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.435087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.435088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.435099Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:47.435105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:47.435110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:47.435149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.435153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.435155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:47.435157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:47.435200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:47.435205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.435212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.435222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:47.435236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690205267:6358], now have 1 active actors on pipe
2025-10-02T08:08:47.435244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533365690205259:6357]
2025-10-02T08:08:47.435245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533365690205259:6357]
2025-10-02T08:08:47.435250Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:47.435255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533366150518670:2378], now have 1 active actors on pipe
2025-10-02T08:08:47.435259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:47.435261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:47.435262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:47.435266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 418
2025-10-02T08:08:47.435272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:47.435274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:47.435280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.435288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.435314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533365690205259:6357]
2025-10-02T08:08:47.435319Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:47.435322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:47.435329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:47.435306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 418
2025-10-02T08:08:47.435336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.435338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.435339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:47.435345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.435351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:47.435378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.435409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.435419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.435431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.435458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 419 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0
2025-10-02T08:08:47.435745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9130a40-c06f0b17-88c4fb17-956c078c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:47.438473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0] Write session: try to update token
2025-10-02T08:08:47.438484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:47.451178Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:47.451195Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:47.451197Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:47.451204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533365690205259:6357]
2025-10-02T08:08:47.451209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533365690205259:6357]
2025-10-02T08:08:47.451243Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:47.451246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:47.451247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:47.451251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.451253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:47.451308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId: src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:47.451382Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:47.453855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:47.510859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533365690205327:6232]
2025-10-02T08:08:47.511089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 418, pipe: [1:7556533365690205327:6232]
2025-10-02T08:08:47.576015Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:47.576263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.576273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.576308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690205327:6232], now have 1 active actors on pipe
2025-10-02T08:08:47.576432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533365690205327:6232]
2025-10-02T08:08:47.576435Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:47.576457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:47.576512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 419 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0
2025-10-02T08:08:47.576504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:47.576685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 419 sessionId: src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0 is DEAD
2025-10-02T08:08:47.576888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:08:47.576903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0] Write session will restart in 0.008628s
2025-10-02T08:08:47.576925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0] Write session: Do CDS request
2025-10-02T08:08:47.576930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:47.586345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.586496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:47.586511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 420
2025-10-02T08:08:47.586639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.586670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:47.586678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:47.586681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:47.587019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 420 sessionId:  describe result for acl check
2025-10-02T08:08:47.587045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:47.587050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:47.587052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:47.587056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533365690205768:6376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:47.587445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533365690205768:6376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:47.589499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533365690205768:6376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:47.589511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:47.591096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:47.591396Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:47.591407Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:47.591416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:47.591474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:47.591507Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533365690205862:6373]
2025-10-02T08:08:47.591816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533365690205768:6376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:47.591836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533365690205768:6376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:47.591838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533365690205768:6376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:47.591844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:47.591934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:47.592080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:47.592117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:47.592360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:47.592391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.592395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.592396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.592396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.592397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.592400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.592406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.592408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.592411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.592412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.592416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.592420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.592426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.592429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.592432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.592434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.592436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.592440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.592442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.592444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.592457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:47.600211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:47.602079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:47.602097Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:47.602099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:47.602103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:47.602110Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 419 [1:7556533365690205862:6373]
2025-10-02T08:08:47.602122Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:47.602141Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:47.602144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.602146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.602148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.602165Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:47.602171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:47.602177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:47.602240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.602248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.602251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:47.602254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:47.602324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:47.602330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.602343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.602359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:47.602377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 419
2025-10-02T08:08:47.602380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690205867:6376], now have 1 active actors on pipe
2025-10-02T08:08:47.602386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533365690205846:6373]
2025-10-02T08:08:47.602389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533365690205846:6373]
2025-10-02T08:08:47.602395Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:47.602404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533366150518690:2378], now have 1 active actors on pipe
2025-10-02T08:08:47.602409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:47.602410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:47.602413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:47.602422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:47.602426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:47.602432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.602436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.602471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533365690205846:6373]
2025-10-02T08:08:47.602484Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:47.602502Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|867bedbb-5db10016-6a09b430-2108d5be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:47.602506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:47.602511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.602514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.602516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:47.602500Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 419
2025-10-02T08:08:47.602524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.602536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:47.602580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.602633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.602639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.602650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.602683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 420 partition: 0 MaxSeqNo: 17 sessionId: src_id|867bedbb-5db10016-6a09b430-2108d5be_0
2025-10-02T08:08:47.603029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0703b5-998a08d7-c728aa95-9a218fd7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|867bedbb-5db10016-6a09b430-2108d5be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:47.606051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|867bedbb-5db10016-6a09b430-2108d5be_0] Write session: try to update token
2025-10-02T08:08:47.606068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|867bedbb-5db10016-6a09b430-2108d5be_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:47.619309Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:47.619322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:47.619324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:47.619332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533365690205846:6373]
2025-10-02T08:08:47.619337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533365690205846:6373]
2025-10-02T08:08:47.619381Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:47.619387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:47.619390Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:47.619393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.619395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:47.619536Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:47.621190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId: src_id|867bedbb-5db10016-6a09b430-2108d5be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:47.623958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:47.676718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533365690205893:6232]
2025-10-02T08:08:47.676786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 419, pipe: [1:7556533365690205893:6232]
2025-10-02T08:08:47.747411Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:47.747677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.747687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.747715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690205893:6232], now have 1 active actors on pipe
2025-10-02T08:08:47.747787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533365690205893:6232]
2025-10-02T08:08:47.747801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:47.747802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:47.747857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 420 reason: error at write: Disconnected sessionId: src_id|867bedbb-5db10016-6a09b430-2108d5be_0
2025-10-02T08:08:47.747937Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:47.747925Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:47.748020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 420 sessionId: src_id|867bedbb-5db10016-6a09b430-2108d5be_0 is DEAD
2025-10-02T08:08:47.748212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867bedbb-5db10016-6a09b430-2108d5be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:47.748227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867bedbb-5db10016-6a09b430-2108d5be_0] Write session will restart in 0.007503s
2025-10-02T08:08:47.748255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867bedbb-5db10016-6a09b430-2108d5be_0] Write session: Do CDS request
2025-10-02T08:08:47.748262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867bedbb-5db10016-6a09b430-2108d5be_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:47.757332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|867bedbb-5db10016-6a09b430-2108d5be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.757386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:47.757399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 421
2025-10-02T08:08:47.757587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.757620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:47.757629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:47.757633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:47.758047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 421 sessionId:  describe result for acl check
2025-10-02T08:08:47.758072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:47.758077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:47.758078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:47.758081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533365690206309:6382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:47.758433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533365690206309:6382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:47.760864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533365690206309:6382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:47.761222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:47.762622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:47.762815Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:47.762837Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:47.762847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:47.762856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533365690206309:6382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:47.762862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533365690206309:6382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:47.762869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533365690206309:6382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:47.762876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:47.762909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:47.762946Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533365690206423:6381]
2025-10-02T08:08:47.763348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:47.763485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:47.763512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:47.763694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:47.763722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.763726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.763726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.763727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.763727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.763730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.763736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.763738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.763740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.763742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.763745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.763749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.763752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.763755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.763757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.763759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.763761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.763764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.763766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.763769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.763779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:47.775045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:47.776914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:47.776924Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:47.776925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:47.776927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:47.776932Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 420 [1:7556533365690206423:6381]
2025-10-02T08:08:47.776940Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:47.776952Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:47.776956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.776959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.776960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.776971Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:47.776977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:47.776982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:47.777024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.777029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.777031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:47.777033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:47.777080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:47.777085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.777095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.777103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:47.777120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690206428:6382], now have 1 active actors on pipe
2025-10-02T08:08:47.777128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533365690206413:6381]
2025-10-02T08:08:47.777130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533365690206413:6381]
2025-10-02T08:08:47.777135Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:47.777142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:47.777146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:47.777150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:47.777153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:47.777155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:47.777160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.777162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.777173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533366150518706:2378], now have 1 active actors on pipe
2025-10-02T08:08:47.777195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533365690206413:6381]
2025-10-02T08:08:47.777203Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:47.777214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:47.777215Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:47.777221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.777223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.777224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:47.777230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.777236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:47.777219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 420
2025-10-02T08:08:47.777260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.777387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 420
2025-10-02T08:08:47.777422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.777428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.777438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.777465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 421 partition: 0 MaxSeqNo: 17 sessionId: src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0
2025-10-02T08:08:47.777814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867bedbb-5db10016-6a09b430-2108d5be_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:47.780532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0] Write session: try to update token
2025-10-02T08:08:47.780546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:47.794024Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:47.794036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:47.794038Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:47.794046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533365690206413:6381]
2025-10-02T08:08:47.794050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533365690206413:6381]
2025-10-02T08:08:47.794092Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:47.794093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:47.794097Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:47.794100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.794102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:47.794256Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:47.795224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId: src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:47.797708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:47.847702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533365690206456:6232]
2025-10-02T08:08:47.847771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 420, pipe: [1:7556533365690206456:6232]
2025-10-02T08:08:47.917263Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:47.917479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.917488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.917512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690206456:6232], now have 1 active actors on pipe
2025-10-02T08:08:47.917598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533365690206456:6232]
2025-10-02T08:08:47.917613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:47.917616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:47.917654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 421 reason: error at write: Disconnected sessionId: src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0
2025-10-02T08:08:47.917729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:47.917736Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:47.917777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 421 sessionId: src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0 is DEAD
2025-10-02T08:08:47.917961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:47.917975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0] Write session will restart in 0.008229s
2025-10-02T08:08:47.918005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0] Write session: Do CDS request
2025-10-02T08:08:47.918011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:47.927215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.927293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:47.927304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 422
2025-10-02T08:08:47.927410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:47.927440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:47.927448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:47.927452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:47.927757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 422 sessionId:  describe result for acl check
2025-10-02T08:08:47.927776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:47.927780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:47.927781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:47.927784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533365690206882:6389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:47.928216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533365690206882:6389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:47.930612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533365690206882:6389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:47.932724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:47.932960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533365690206882:6389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:47.932970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533365690206882:6389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:47.932974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533365690206882:6389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:47.932980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:47.933044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:47.933169Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:47.933175Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:47.933182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:47.933216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:47.933254Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533365690206994:6388]
2025-10-02T08:08:47.933697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:47.933851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:47.933887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:47.934085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:47.934111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.934115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.934116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.934116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.934117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.934120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.934126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.934128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.934130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.934132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.934135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.934139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:47.934142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.934145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:47.934150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.934152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:47.934155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.934157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.934159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.934162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.934172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:47.941587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:47.942976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:47.942987Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:47.942989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:47.942991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:47.942995Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 421 [1:7556533365690206994:6388]
2025-10-02T08:08:47.943002Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:47.943013Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:47.943015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.943016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.943017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.943029Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:47.943032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:47.943037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:47.943073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.943078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.943081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:47.943082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:47.943141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:47.943150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.943160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:47.943170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:47.943186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533365690206989:6389], now have 1 active actors on pipe
2025-10-02T08:08:47.943193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 421
2025-10-02T08:08:47.943194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533365690206982:6388]
2025-10-02T08:08:47.943196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533365690206982:6388]
2025-10-02T08:08:47.943202Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:47.943211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:47.943214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533366150518715:2378], now have 1 active actors on pipe
2025-10-02T08:08:47.943218Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:47.943220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:47.943231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:47.943238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:47.943244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.943252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.943278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533365690206982:6388]
2025-10-02T08:08:47.943286Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:47.943297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:47.943299Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a490b356-138dc443-50490316-afb9733a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:47.943305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:47.943307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:47.943309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:47.943318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:47.943306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 421
2025-10-02T08:08:47.943329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:47.943362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.943402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:47.943409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:47.943421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:47.943455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 422 partition: 0 MaxSeqNo: 17 sessionId: src_id|a490b356-138dc443-50490316-afb9733a_0
2025-10-02T08:08:47.943778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbd45ff-3bfa1161-3ce87c0c-bc76a675_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a490b356-138dc443-50490316-afb9733a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:47.946658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a490b356-138dc443-50490316-afb9733a_0] Write session: try to update token
2025-10-02T08:08:47.946672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a490b356-138dc443-50490316-afb9733a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:47.959634Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:47.959648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:47.959650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:47.959656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533365690206982:6388]
2025-10-02T08:08:47.959659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533365690206982:6388]
2025-10-02T08:08:47.959701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:47.959706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:47.959707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:47.959707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:47.959712Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:47.959845Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:47.960556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId: src_id|a490b356-138dc443-50490316-afb9733a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:47.963117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:48.017754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533369985174315:6232]
2025-10-02T08:08:48.017845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 421, pipe: [1:7556533369985174315:6232]
2025-10-02T08:08:48.082895Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:48.083132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.083142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.083170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985174315:6232], now have 1 active actors on pipe
2025-10-02T08:08:48.083290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533369985174315:6232]
2025-10-02T08:08:48.083316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:48.083318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:48.083355Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:48.083382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 422 reason: error at write: Disconnected sessionId: src_id|a490b356-138dc443-50490316-afb9733a_0
2025-10-02T08:08:48.083567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 422 sessionId: src_id|a490b356-138dc443-50490316-afb9733a_0 is DEAD
2025-10-02T08:08:48.083746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a490b356-138dc443-50490316-afb9733a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:48.083752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a490b356-138dc443-50490316-afb9733a_0] Write session will restart in 0.009179s
2025-10-02T08:08:48.083768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a490b356-138dc443-50490316-afb9733a_0] Write session: Do CDS request
2025-10-02T08:08:48.083776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a490b356-138dc443-50490316-afb9733a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:48.084360Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:48.094283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a490b356-138dc443-50490316-afb9733a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.094311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:48.094321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 423
2025-10-02T08:08:48.094552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.094577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:48.094593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:48.094600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:48.094947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 423 sessionId:  describe result for acl check
2025-10-02T08:08:48.094984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:48.094989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:48.094990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:48.094995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533369985174792:6395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:48.095367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533369985174792:6395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:48.096974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:48.097480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533369985174792:6395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:48.098658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:48.098866Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:48.098873Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:48.098882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:48.098925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:48.098972Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533369985174850:6394]
2025-10-02T08:08:48.099394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:48.099544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:48.099572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:48.099765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:48.099792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.099796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.099797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.099797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.099798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.099801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.099807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.099810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.099812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.099814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.099827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.099834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.099844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.099849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.099854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.099864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.099866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.099869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.099872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.099874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.099884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:48.099964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533369985174792:6395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:48.099980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533369985174792:6395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:48.099983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533369985174792:6395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:48.099990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:48.108404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:48.110284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:48.110301Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:48.110304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:48.110307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:48.110313Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 422 [1:7556533369985174850:6394]
2025-10-02T08:08:48.110323Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:48.110338Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:48.110345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.110347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.110349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.110362Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:48.110371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:48.110376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:48.110437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.110443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.110446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:48.110448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:48.110513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:48.110520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.110531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.110546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:48.110556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 422
2025-10-02T08:08:48.110562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985174867:6395], now have 1 active actors on pipe
2025-10-02T08:08:48.110567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533369985174834:6394]
2025-10-02T08:08:48.110570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533369985174834:6394]
2025-10-02T08:08:48.110576Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:48.110585Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:48.110587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533370445486019:2378], now have 1 active actors on pipe
2025-10-02T08:08:48.110588Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:48.110591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.110595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.110612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:48.110629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:48.110635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:48.110655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 422
2025-10-02T08:08:48.110674Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:48.110684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.110686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.110688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:48.110696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.110703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:48.110714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533369985174834:6394]
2025-10-02T08:08:48.110726Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:48.110735Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:48.110755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.110804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.110812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.110826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.110861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 423 partition: 0 MaxSeqNo: 17 sessionId: src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0
2025-10-02T08:08:48.111183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a490b356-138dc443-50490316-afb9733a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:48.113966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0] Write session: try to update token
2025-10-02T08:08:48.113980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:48.118577Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:08:48.118598Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-02T08:08:48.118842Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:08:48.119063Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 3 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:08:48.119104Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:08:48.127407Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:48.127423Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:48.127425Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:48.127433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533369985174834:6394]
2025-10-02T08:08:48.127436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533369985174834:6394]
2025-10-02T08:08:48.127479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:48.127479Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:48.127482Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:48.127486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.127488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:48.127628Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:48.128201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId: src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:48.131129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:48.183616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533369985174883:6232]
2025-10-02T08:08:48.183723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 422, pipe: [1:7556533369985174883:6232]
2025-10-02T08:08:48.258650Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:48.258968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.258977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.259008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985174883:6232], now have 1 active actors on pipe
2025-10-02T08:08:48.259099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:48.259108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:48.259179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 423 reason: error at write: Disconnected sessionId: src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0
2025-10-02T08:08:48.259214Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:48.259354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 423 sessionId: src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0 is DEAD
2025-10-02T08:08:48.259371Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:48.259499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:48.259516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0] Write session will restart in 0.009647s
2025-10-02T08:08:48.259511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533369985174883:6232]
2025-10-02T08:08:48.259536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0] Write session: Do CDS request
2025-10-02T08:08:48.259541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:48.270337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.270475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:48.270486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 424
2025-10-02T08:08:48.270595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.270616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:48.270622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:48.270626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:48.270904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 424 sessionId:  describe result for acl check
2025-10-02T08:08:48.270927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:48.270931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:48.270932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:48.270936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533369985175378:6402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:48.271295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533369985175378:6402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:48.271704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:48.272831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533369985175378:6402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:48.273243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:48.273476Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:48.273485Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:48.273494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:48.273549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:48.273579Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533369985175422:6401]
2025-10-02T08:08:48.274229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:48.274376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:48.274411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:48.274628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:48.274670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.274675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.274676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.274677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.274678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.274682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.274687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.274689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.274691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.274693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.274696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.274700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.274704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.274706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.274708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.274711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.274713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.274731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.274738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.274741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.274752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:48.274946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533369985175378:6402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:48.274957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533369985175378:6402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:48.274959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533369985175378:6402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:48.274966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:48.282142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:48.283701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:48.283716Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:48.283718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:48.283720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:48.283724Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 423 [1:7556533369985175422:6401]
2025-10-02T08:08:48.283732Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:48.283744Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:48.283746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.283748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.283749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.283759Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:48.283766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:48.283770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:48.283812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.283831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.283838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:48.283839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:48.283888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:48.283893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.283901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.283909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:48.283924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985175439:6402], now have 1 active actors on pipe
2025-10-02T08:08:48.283929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533369985175393:6401]
2025-10-02T08:08:48.283930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533369985175393:6401]
2025-10-02T08:08:48.283935Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:48.283943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:48.283943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:48.283944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 423
2025-10-02T08:08:48.283945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:48.283954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:48.283956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:48.283961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533370445486040:2378], now have 1 active actors on pipe
2025-10-02T08:08:48.283965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.283969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.284005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533369985175393:6401]
2025-10-02T08:08:48.284020Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:48.284029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:48.284036Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ca06efc-dc94b3be-482cb91c-50726421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:48.284041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.284048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.284050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:48.284028Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 423
2025-10-02T08:08:48.284055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.284064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:48.284094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.284163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.284170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.284180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.284207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 424 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ca06efc-dc94b3be-482cb91c-50726421_0
2025-10-02T08:08:48.284484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|646f3e5c-bc622407-97d77f60-42eebb2b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ca06efc-dc94b3be-482cb91c-50726421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:48.287235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca06efc-dc94b3be-482cb91c-50726421_0] Write session: try to update token
2025-10-02T08:08:48.287250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca06efc-dc94b3be-482cb91c-50726421_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:48.300059Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:48.300072Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:48.300074Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:48.300080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533369985175393:6401]
2025-10-02T08:08:48.300083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533369985175393:6401]
2025-10-02T08:08:48.300118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:48.300118Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:48.300122Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:48.300128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.300130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:48.300258Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:48.301496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId: src_id|4ca06efc-dc94b3be-482cb91c-50726421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:48.304107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:48.359765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533369985175468:6232]
2025-10-02T08:08:48.359858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 423, pipe: [1:7556533369985175468:6232]
2025-10-02T08:08:48.431728Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:48.432070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.432081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.432120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985175468:6232], now have 1 active actors on pipe
2025-10-02T08:08:48.432233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533369985175468:6232]
2025-10-02T08:08:48.432257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:48.432263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:48.432309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:48.432333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 424 reason: error at write: Disconnected sessionId: src_id|4ca06efc-dc94b3be-482cb91c-50726421_0
2025-10-02T08:08:48.432490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 424 sessionId: src_id|4ca06efc-dc94b3be-482cb91c-50726421_0 is DEAD
2025-10-02T08:08:48.432665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca06efc-dc94b3be-482cb91c-50726421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:48.432679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca06efc-dc94b3be-482cb91c-50726421_0] Write session will restart in 0.009082s
2025-10-02T08:08:48.432702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca06efc-dc94b3be-482cb91c-50726421_0] Write session: Do CDS request
2025-10-02T08:08:48.432712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca06efc-dc94b3be-482cb91c-50726421_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:48.432704Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:48.443336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca06efc-dc94b3be-482cb91c-50726421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.443398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:48.443409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 425
2025-10-02T08:08:48.443609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.443649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:48.443658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:48.443661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:48.444020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 425 sessionId:  describe result for acl check
2025-10-02T08:08:48.444049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:48.444055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:48.444056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:48.444060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533369985175954:6410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:48.444416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533369985175954:6410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:48.446031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533369985175954:6410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:48.447241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:48.447569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:48.447698Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:48.447705Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:48.447712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:48.447738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:48.447764Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533369985176011:6409]
2025-10-02T08:08:48.448217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:48.448430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:48.448435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533369985175954:6410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:48.448440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533369985175954:6410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:48.448443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533369985175954:6410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:48.448450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:48.448482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:48.448791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:48.448848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.448854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.448855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.448856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.448857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.448861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.448870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.448874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.448878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.448881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.448887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.448894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.448899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.448904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.448909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.448918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.448922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.448927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.448935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.448944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.448964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:48.456294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:48.457902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:48.457915Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:48.457917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:48.457920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:48.457924Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 424 [1:7556533369985176011:6409]
2025-10-02T08:08:48.457931Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:48.457942Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:48.457944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.457946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.457947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.457958Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:48.457961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:48.457965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:48.458006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.458012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.458014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:48.458015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:48.458077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:48.458085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.458095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.458109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:48.458130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533369985176005:6409]
2025-10-02T08:08:48.458135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533369985176005:6409]
2025-10-02T08:08:48.458142Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:48.458147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:48.458153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:48.458154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985176022:6410], now have 1 active actors on pipe
2025-10-02T08:08:48.458157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533370445486048:2378], now have 1 active actors on pipe
2025-10-02T08:08:48.458161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 424
2025-10-02T08:08:48.458164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:48.458175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:48.458177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:48.458207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.458214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.458224Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533369985176005:6409]
2025-10-02T08:08:48.458229Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:48.458248Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:48.458231Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 424
2025-10-02T08:08:48.458250Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:48.458258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.458260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.458262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:48.458270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.458278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:48.458302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.458337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.458342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.458354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.458387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 425 partition: 0 MaxSeqNo: 17 sessionId: src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0
2025-10-02T08:08:48.458670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca06efc-dc94b3be-482cb91c-50726421_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:48.461329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0] Write session: try to update token
2025-10-02T08:08:48.461343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:48.474144Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:48.474159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:48.474161Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:48.474168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533369985176005:6409]
2025-10-02T08:08:48.474172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533369985176005:6409]
2025-10-02T08:08:48.474204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:48.474208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.474208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:48.474209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:48.474212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:48.474343Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:48.476781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId: src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:48.479288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:48.550437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533369985176055:6232]
2025-10-02T08:08:48.552562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 424, pipe: [1:7556533369985176055:6232]
2025-10-02T08:08:48.595739Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:48.595983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.595994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.596021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985176055:6232], now have 1 active actors on pipe
2025-10-02T08:08:48.596159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:48.596169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:48.596258Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:48.596213Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:48.596222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 425 reason: error at write: Disconnected sessionId: src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0
2025-10-02T08:08:48.596371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 425 sessionId: src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0 is DEAD
2025-10-02T08:08:48.596507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:48.596525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0] Write session will restart in 0.008272s
2025-10-02T08:08:48.596522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533369985176055:6232]
2025-10-02T08:08:48.596548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0] Write session: Do CDS request
2025-10-02T08:08:48.596554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:48.606324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.606462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:48.606475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 426
2025-10-02T08:08:48.606591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.606611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:48.606617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:48.606620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:48.607122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 426 sessionId:  describe result for acl check
2025-10-02T08:08:48.607152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:48.607158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:48.607159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:48.607163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533369985176500:6426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:48.607506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533369985176500:6426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:48.610352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533369985176500:6426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:48.611000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:48.612439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:48.612583Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:48.612589Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:48.612596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:48.612637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:48.612671Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533369985176617:6425]
2025-10-02T08:08:48.612918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533369985176500:6426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:48.612929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533369985176500:6426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:48.612932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533369985176500:6426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:48.612938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:48.613269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:48.613416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:48.613450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:48.613728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:48.613765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.613771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.613772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.613773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.613774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.613778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.613788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.613792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.613796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.613799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.613804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.613811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.613817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.613822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.613826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.613831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.613835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.613840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.613844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.613849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.613866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:48.621301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:48.622884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:48.622895Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:48.622897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:48.622899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:48.622903Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 425 [1:7556533369985176617:6425]
2025-10-02T08:08:48.622910Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:48.622921Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:48.622922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.622924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.622925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.622934Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:48.622937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:48.622941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:48.622981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.622987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.622989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:48.622991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:48.623043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:48.623048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.623054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.623064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:48.623079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533369985176609:6425]
2025-10-02T08:08:48.623083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533369985176609:6425]
2025-10-02T08:08:48.623089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:48.623098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985176622:6426], now have 1 active actors on pipe
2025-10-02T08:08:48.623104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:48.623106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:48.623107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:48.623113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:48.623115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:48.623118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533370445486067:2378], now have 1 active actors on pipe
2025-10-02T08:08:48.623129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 425
2025-10-02T08:08:48.623138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533369985176609:6425]
2025-10-02T08:08:48.623155Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:48.623160Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:48.623163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.623166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.623178Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 425
2025-10-02T08:08:48.623205Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d221909a-1293a536-73e2a734-b34afc0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:48.623214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.623216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.623217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:48.623223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.623229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:48.623244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.623269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.623274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.623282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.623319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 426 partition: 0 MaxSeqNo: 17 sessionId: src_id|d221909a-1293a536-73e2a734-b34afc0e_0
2025-10-02T08:08:48.623642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6b167f-5c317981-af48b76f-38bcbb6b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d221909a-1293a536-73e2a734-b34afc0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:48.626378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d221909a-1293a536-73e2a734-b34afc0e_0] Write session: try to update token
2025-10-02T08:08:48.626394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d221909a-1293a536-73e2a734-b34afc0e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:48.639554Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:48.639566Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:48.639568Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:48.639576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533369985176609:6425]
2025-10-02T08:08:48.639578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533369985176609:6425]
2025-10-02T08:08:48.639608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:48.639613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.639612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:48.639614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:48.639616Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:48.639740Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:48.640674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId: src_id|d221909a-1293a536-73e2a734-b34afc0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:48.643331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:48.696648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533369985176648:6232]
2025-10-02T08:08:48.696765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 425, pipe: [1:7556533369985176648:6232]
2025-10-02T08:08:48.766436Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:48.766623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.766633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.766664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985176648:6232], now have 1 active actors on pipe
2025-10-02T08:08:48.766784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533369985176648:6232]
2025-10-02T08:08:48.766807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:48.766810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:48.766845Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:48.766867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 426 reason: error at write: Disconnected sessionId: src_id|d221909a-1293a536-73e2a734-b34afc0e_0
2025-10-02T08:08:48.766878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:48.767033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 426 sessionId: src_id|d221909a-1293a536-73e2a734-b34afc0e_0 is DEAD
2025-10-02T08:08:48.767191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d221909a-1293a536-73e2a734-b34afc0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:48.767199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d221909a-1293a536-73e2a734-b34afc0e_0] Write session will restart in 0.007396s
2025-10-02T08:08:48.767218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d221909a-1293a536-73e2a734-b34afc0e_0] Write session: Do CDS request
2025-10-02T08:08:48.767223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d221909a-1293a536-73e2a734-b34afc0e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:48.775297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d221909a-1293a536-73e2a734-b34afc0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.775316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:48.775328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 427
2025-10-02T08:08:48.775487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.775516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:48.775525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:48.775528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:48.775948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 427 sessionId:  describe result for acl check
2025-10-02T08:08:48.775976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:48.775981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:48.775983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:48.775988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533369985177021:6434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:48.776397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533369985177021:6434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:48.779440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533369985177021:6434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:48.781758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533369985177021:6434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:48.781768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533369985177021:6434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:48.781770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533369985177021:6434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:48.781775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:48.784023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:48.784340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:48.784457Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:48.784463Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:48.784468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:48.784494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:48.784521Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533369985177196:6433]
2025-10-02T08:08:48.784926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:48.785063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:48.785088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:48.785266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:48.785293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.785296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.785297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.785298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.785298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.785301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.785307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.785309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.785311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.785313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.785318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.785322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.785325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.785328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.785330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.785332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.785335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.785337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.785340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.785343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.785352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:48.792703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:48.794221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:48.794233Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:48.794235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:48.794238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:48.794242Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 426 [1:7556533369985177196:6433]
2025-10-02T08:08:48.794249Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:48.794262Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:48.794264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.794265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.794266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.794278Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:48.794281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:48.794285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:48.794328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.794334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.794336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:48.794338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:48.794381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:48.794387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.794395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.794402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:48.794416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533369985177190:6433]
2025-10-02T08:08:48.794420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533369985177190:6433]
2025-10-02T08:08:48.794426Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:48.794430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 426
2025-10-02T08:08:48.794435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985177181:6434], now have 1 active actors on pipe
2025-10-02T08:08:48.794437Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:48.794440Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:48.794441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:48.794448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:48.794450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:48.794454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.794457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.794467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533370445486083:2378], now have 1 active actors on pipe
2025-10-02T08:08:48.794493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533369985177190:6433]
2025-10-02T08:08:48.794500Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:48.794506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:48.794511Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:48.794519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.794522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.794523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:48.794530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.794536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:48.794524Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 426
2025-10-02T08:08:48.794563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.794599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.794604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.794613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.794638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 427 partition: 0 MaxSeqNo: 17 sessionId: src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0
2025-10-02T08:08:48.794950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d221909a-1293a536-73e2a734-b34afc0e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:48.797888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0] Write session: try to update token
2025-10-02T08:08:48.797900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:48.810645Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:48.810660Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:48.810662Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:48.810668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533369985177190:6433]
2025-10-02T08:08:48.810671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533369985177190:6433]
2025-10-02T08:08:48.810703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:48.810708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.810707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:48.810709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:48.810712Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:48.810860Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:48.812393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId: src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:48.814968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:48.867117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533369985177223:6232]
2025-10-02T08:08:48.867209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 426, pipe: [1:7556533369985177223:6232]
2025-10-02T08:08:48.939306Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:48.939750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.939765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.939800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985177223:6232], now have 1 active actors on pipe
2025-10-02T08:08:48.939922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:48.939929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:48.939976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 427 reason: error at write: Disconnected sessionId: src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0
2025-10-02T08:08:48.940003Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:48.940015Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:48.940132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 427 sessionId: src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0 is DEAD
2025-10-02T08:08:48.940250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:48.940258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0] Write session will restart in 0.008485s
2025-10-02T08:08:48.940274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0] Write session: Do CDS request
2025-10-02T08:08:48.940278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:48.940267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533369985177223:6232]
2025-10-02T08:08:48.950254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.950304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:48.950316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 428
2025-10-02T08:08:48.950450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:48.950486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:48.950495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:48.950499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:48.950868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 428 sessionId:  describe result for acl check
2025-10-02T08:08:48.950912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:48.950919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:48.950920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:48.950925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533369985177661:6441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:48.951389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533369985177661:6441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:48.953699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533369985177661:6441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:48.953881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:48.955679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:48.955838Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:48.955846Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:48.955854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:48.955892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:48.955926Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533369985177767:6440]
2025-10-02T08:08:48.956242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533369985177661:6441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:48.956254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533369985177661:6441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:48.956257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533369985177661:6441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:48.956265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:48.956488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:48.956611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:48.956644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:48.956925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:48.956969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.956973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.956975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.956976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.956976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.956981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.956990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.956994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.956998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.957002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.957011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.957018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:48.957026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.957031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:48.957038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.957044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:48.957048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.957052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.957056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.957061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.957079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:48.964343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:48.965903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:48.965917Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:48.965919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:48.965922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:48.965928Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 427 [1:7556533369985177767:6440]
2025-10-02T08:08:48.965939Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:48.965954Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:48.965956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.965959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.965961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.965974Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:48.965983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:48.965989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:48.966040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.966046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.966050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:48.966053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:48.966107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:48.966113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.966124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:48.966140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:48.966160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533369985177772:6441], now have 1 active actors on pipe
2025-10-02T08:08:48.966166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533370445486092:2378], now have 1 active actors on pipe
2025-10-02T08:08:48.966171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533369985177752:6440]
2025-10-02T08:08:48.966174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533369985177752:6440]
2025-10-02T08:08:48.966174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 427
2025-10-02T08:08:48.966181Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:48.966189Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:48.966193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:48.966195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:48.966206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:48.966209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:48.966220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.966228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.966219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 427
2025-10-02T08:08:48.966260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533369985177752:6440]
2025-10-02T08:08:48.966271Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:48.966280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:48.966288Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:48.966294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:48.966297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:48.966299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:48.966308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:48.966319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:48.966359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.966393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:48.966398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:48.966411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:48.966445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 428 partition: 0 MaxSeqNo: 17 sessionId: src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0
2025-10-02T08:08:48.966722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63f85c1-f6c2e1a1-d987b77d-cb651505_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:48.969533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0] Write session: try to update token
2025-10-02T08:08:48.969556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:48.982938Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:48.982959Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:48.982961Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:48.982969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533369985177752:6440]
2025-10-02T08:08:48.982972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533369985177752:6440]
2025-10-02T08:08:48.983001Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:48.983006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:48.983007Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:48.983012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:48.983013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:48.983210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId: src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:48.983357Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:48.986310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:49.040213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533374280145094:6232]
2025-10-02T08:08:49.040337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 427, pipe: [1:7556533374280145094:6232]
2025-10-02T08:08:49.107554Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:49.107864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.107875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.107905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280145094:6232], now have 1 active actors on pipe
2025-10-02T08:08:49.108024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533374280145094:6232]
2025-10-02T08:08:49.108047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:49.108052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:49.108062Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:49.108126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 428 reason: error at write: Disconnected sessionId: src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0
2025-10-02T08:08:49.108119Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:49.108302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 428 sessionId: src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0 is DEAD
2025-10-02T08:08:49.108453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:49.108471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0] Write session will restart in 0.005714s
2025-10-02T08:08:49.108490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0] Write session: Do CDS request
2025-10-02T08:08:49.108494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:49.115271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.115330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:49.115342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 429
2025-10-02T08:08:49.115464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.115501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:49.115510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:49.115513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:49.115890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 429 sessionId:  describe result for acl check
2025-10-02T08:08:49.115922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:49.115929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:49.115931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:49.115935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533374280145477:6447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:49.116392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533374280145477:6447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:49.119010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533374280145477:6447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:49.122183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:49.122404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:49.122493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533374280145477:6447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:49.122501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533374280145477:6447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:49.122504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533374280145477:6447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:49.122509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:49.122525Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:49.122532Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:49.122538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:49.122569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:49.122600Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533374280145639:6446]
2025-10-02T08:08:49.122985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:49.123102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:49.123131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:49.123347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:49.123381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.123385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.123385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.123386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.123387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.123389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.123395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.123397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.123399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.123401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.123405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.123409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.123412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.123415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.123417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.123420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.123422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.123425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.123427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.123430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.123439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:49.130670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:49.132137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:49.132149Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:49.132151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:49.132153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:49.132158Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 428 [1:7556533374280145639:6446]
2025-10-02T08:08:49.132165Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:49.132178Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:49.132183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.132185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.132187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.132197Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:49.132204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:49.132209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:49.132253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.132258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.132260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:49.132262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:49.132305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:49.132310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.132319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.132330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:49.132345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533374280145633:6446]
2025-10-02T08:08:49.132350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533374280145633:6446]
2025-10-02T08:08:49.132355Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:49.132364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 428
2025-10-02T08:08:49.132367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280145643:6447], now have 1 active actors on pipe
2025-10-02T08:08:49.132367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:49.132371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533374740453395:2378], now have 1 active actors on pipe
2025-10-02T08:08:49.132371Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:49.132375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:49.132382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:49.132384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:49.132389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.132391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.132419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533374280145633:6446]
2025-10-02T08:08:49.132428Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:49.132442Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:49.132443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:49.132450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.132452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.132453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:49.132460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.132469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:49.132452Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 428
2025-10-02T08:08:49.132499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.132535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.132540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.132548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.132577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 429 partition: 0 MaxSeqNo: 17 sessionId: src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0
2025-10-02T08:08:49.132848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803f36c9-ec630177-5d3b8bfa-37ca713a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:49.135622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0] Write session: try to update token
2025-10-02T08:08:49.135637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:49.149554Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:49.149571Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:49.149573Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:49.149582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533374280145633:6446]
2025-10-02T08:08:49.149587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533374280145633:6446]
2025-10-02T08:08:49.149632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:49.149638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.149641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:49.149642Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:49.149647Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:49.149802Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:49.150269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId: src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:49.152931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:49.208119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533374280145670:6232]
2025-10-02T08:08:49.208210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 428, pipe: [1:7556533374280145670:6232]
2025-10-02T08:08:49.276126Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:49.276497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.276508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.276539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280145670:6232], now have 1 active actors on pipe
2025-10-02T08:08:49.276642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533374280145670:6232]
2025-10-02T08:08:49.276665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:49.276671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:49.276732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 429 reason: error at write: Disconnected sessionId: src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0
2025-10-02T08:08:49.276749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:49.276912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 429 sessionId: src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0 is DEAD
2025-10-02T08:08:49.276958Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:49.277052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:49.277062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0] Write session will restart in 0.005515s
2025-10-02T08:08:49.277088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0] Write session: Do CDS request
2025-10-02T08:08:49.277094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:49.283149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.283230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:49.283241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 430
2025-10-02T08:08:49.283336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.283386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:49.283394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:49.283398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:49.283752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 430 sessionId:  describe result for acl check
2025-10-02T08:08:49.283780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:49.283785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:49.283787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:49.283791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533374280145974:6453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:49.284258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533374280145974:6453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:49.286609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533374280145974:6453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:49.289562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533374280145974:6453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:49.289573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533374280145974:6453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:49.289576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533374280145974:6453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:49.289583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:49.290759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:49.292356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:49.292489Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:49.292496Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:49.292503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:49.292537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:49.292571Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533374280146224:6452]
2025-10-02T08:08:49.292974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:49.293135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:49.293159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:49.293347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:49.293372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.293376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.293377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.293377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.293378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.293380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.293387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.293389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.293391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.293393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.293396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.293401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.293404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.293407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.293409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.293411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.293414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.293416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.293419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.293421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.293430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:49.300761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:49.302259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:49.302271Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:49.302273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:49.302275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:49.302279Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 429 [1:7556533374280146224:6452]
2025-10-02T08:08:49.302287Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:49.302299Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:49.302302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.302304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.302305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.302315Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:49.302322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:49.302326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:49.302380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.302386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.302388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:49.302389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:49.302435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:49.302440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.302448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.302455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:49.302469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533374280146218:6452]
2025-10-02T08:08:49.302473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533374280146218:6452]
2025-10-02T08:08:49.302479Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:49.302490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:49.302496Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:49.302500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:49.302501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:49.302503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:49.302510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280146203:6453], now have 1 active actors on pipe
2025-10-02T08:08:49.302519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 429
2025-10-02T08:08:49.302534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533374740453413:2378], now have 1 active actors on pipe
2025-10-02T08:08:49.302536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533374280146218:6452]
2025-10-02T08:08:49.302541Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:49.302549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.302551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.302552Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:49.302582Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:49.302589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.302591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.302592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:49.302598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.302606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:49.302589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 429
2025-10-02T08:08:49.302624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.302651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.302656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.302663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.302691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 430 partition: 0 MaxSeqNo: 17 sessionId: src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0
2025-10-02T08:08:49.303008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d1c674-3c0b89f7-3eac79eb-99f02051_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:49.305895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0] Write session: try to update token
2025-10-02T08:08:49.305910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:49.318982Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:49.318997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:49.318999Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:49.319004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533374280146218:6452]
2025-10-02T08:08:49.319007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533374280146218:6452]
2025-10-02T08:08:49.319040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:49.319044Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:49.319045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.319047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:49.319048Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:49.319208Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:49.320781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId: src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:49.323387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:49.376587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533374280146264:6232]
2025-10-02T08:08:49.376675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 429, pipe: [1:7556533374280146264:6232]
2025-10-02T08:08:49.448152Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:49.448574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.448583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.448612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280146264:6232], now have 1 active actors on pipe
2025-10-02T08:08:49.448708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533374280146264:6232]
2025-10-02T08:08:49.448731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:49.448737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:49.448759Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:49.448791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 430 reason: error at write: Disconnected sessionId: src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0
2025-10-02T08:08:49.448796Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:49.448945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 430 sessionId: src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0 is DEAD
2025-10-02T08:08:49.449116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:49.449123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0] Write session will restart in 0.007063s
2025-10-02T08:08:49.449154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0] Write session: Do CDS request
2025-10-02T08:08:49.449159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:49.457275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.457313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:49.457322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 431
2025-10-02T08:08:49.457448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.457469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:49.457475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:49.457478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:49.457881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 431 sessionId:  describe result for acl check
2025-10-02T08:08:49.457903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:49.457905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:49.457905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:49.457909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533374280146700:6463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:49.458256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533374280146700:6463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:49.460374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533374280146700:6463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:49.461057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:49.462757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:49.462891Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:49.462899Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:49.462905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:49.462936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:49.462963Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533374280146822:6462]
2025-10-02T08:08:49.463292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533374280146700:6463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:49.463303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533374280146700:6463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:49.463306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533374280146700:6463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:49.463312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:49.463447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:49.463551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:49.463575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:49.463883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:49.463919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.463923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.463924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.463924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.463925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.463928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.463934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.463936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.463938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.463940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.463944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.463950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.463956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.463958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.463962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.463965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.463967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.463970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.463972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.463974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.463985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:49.471306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:49.472725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:49.472736Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:49.472737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:49.472740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:49.472744Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 430 [1:7556533374280146822:6462]
2025-10-02T08:08:49.472752Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:49.472763Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:49.472768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.472770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.472771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.472782Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:49.472785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:49.472789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:49.472848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.472853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.472855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:49.472857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:49.472900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:49.472905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.472911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.472918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:49.472929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280146827:6463], now have 1 active actors on pipe
2025-10-02T08:08:49.472937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533374280146815:6462]
2025-10-02T08:08:49.472938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533374280146815:6462]
2025-10-02T08:08:49.472944Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:49.472952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:49.472953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:49.472952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 430
2025-10-02T08:08:49.472958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:49.472960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:49.472962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:49.472966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533374740453422:2378], now have 1 active actors on pipe
2025-10-02T08:08:49.472970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.472973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.472998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533374280146815:6462]
2025-10-02T08:08:49.473006Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:49.473011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:49.473016Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:49.473024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.473026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.473028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:49.473034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.473042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:49.473019Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 430
2025-10-02T08:08:49.473071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.473122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.473125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.473134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.473161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 431 partition: 0 MaxSeqNo: 17 sessionId: src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0
2025-10-02T08:08:49.473417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f097da-d70a470f-dc80bb7e-5228ed41_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:49.476140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0] Write session: try to update token
2025-10-02T08:08:49.476152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:49.488954Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:49.488966Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:49.488968Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:49.488974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533374280146815:6462]
2025-10-02T08:08:49.488985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533374280146815:6462]
2025-10-02T08:08:49.489015Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:49.489022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:49.489023Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:49.489028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.489029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:49.489159Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:49.489215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId: src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:49.491729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:49.549145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533374280146853:6232]
2025-10-02T08:08:49.549223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 430, pipe: [1:7556533374280146853:6232]
2025-10-02T08:08:49.616549Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:49.616779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.616790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.616852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280146853:6232], now have 1 active actors on pipe
2025-10-02T08:08:49.616952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:49.616961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:49.617007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 431 reason: error at write: Disconnected sessionId: src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0
2025-10-02T08:08:49.617030Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:49.617068Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:49.617169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 431 sessionId: src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0 is DEAD
2025-10-02T08:08:49.617327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:49.617307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533374280146853:6232]
2025-10-02T08:08:49.617335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0] Write session will restart in 0.008571s
2025-10-02T08:08:49.617360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0] Write session: Do CDS request
2025-10-02T08:08:49.617367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:49.627263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.627336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:49.627351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 432
2025-10-02T08:08:49.627455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.627480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:49.627489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:49.627493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:49.627866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 432 sessionId:  describe result for acl check
2025-10-02T08:08:49.627892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:49.627898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:49.627900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:49.627905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533374280147300:6479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:49.628361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533374280147300:6479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:49.631071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533374280147300:6479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:49.632357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:49.633844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:49.633985Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:49.633992Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:49.634000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:49.634042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:49.634067Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533374280147433:6478]
2025-10-02T08:08:49.634114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533374280147300:6479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:49.634127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533374280147300:6479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:49.634130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533374280147300:6479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:49.634144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:49.634487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:49.634643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:49.634684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:49.635018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:49.635076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.635081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.635082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.635083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.635085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.635090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.635098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.635106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.635110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.635117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.635122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.635133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.635142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.635147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.635163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.635172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.635180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.635185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.635193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.635199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.635217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:49.642937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:49.644345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:49.644357Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:49.644359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:49.644361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:49.644365Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 431 [1:7556533374280147433:6478]
2025-10-02T08:08:49.644371Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:49.644382Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:49.644383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.644385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.644386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.644398Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:49.644401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:49.644406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:49.644456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.644462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.644465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:49.644466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:49.644606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:49.644611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.644619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.644626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:49.644607Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 431
2025-10-02T08:08:49.644641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280147438:6479], now have 1 active actors on pipe
2025-10-02T08:08:49.644646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533374740453442:2378], now have 1 active actors on pipe
2025-10-02T08:08:49.644650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533374280147427:6478]
2025-10-02T08:08:49.644652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533374280147427:6478]
2025-10-02T08:08:49.644656Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:49.644665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:49.644666Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:49.644669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:49.644676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:49.644677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:49.644704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533374280147427:6478]
2025-10-02T08:08:49.644708Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:49.644711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:49.644736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 431
2025-10-02T08:08:49.644743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.644745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.644761Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:49.644769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.644772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.644773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:49.644779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.644785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:49.644795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.645015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.645023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.645036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.645125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 432 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0
2025-10-02T08:08:49.645456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a0d93b-8e65473f-cbf979c7-a33eda09_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:49.648339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0] Write session: try to update token
2025-10-02T08:08:49.648350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:49.661154Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:49.661170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:49.661173Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:49.661181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533374280147427:6478]
2025-10-02T08:08:49.661186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533374280147427:6478]
2025-10-02T08:08:49.661219Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:49.661224Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:49.661233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:49.661239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.661242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:49.661375Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:49.662168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId: src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:49.665001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:49.717754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533374280147471:6232]
2025-10-02T08:08:49.717837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 431, pipe: [1:7556533374280147471:6232]
2025-10-02T08:08:49.784711Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:49.784989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.784999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.785025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280147471:6232], now have 1 active actors on pipe
2025-10-02T08:08:49.785113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533374280147471:6232]
2025-10-02T08:08:49.785127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:49.785134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:49.785179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 432 reason: error at write: Disconnected sessionId: src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0
2025-10-02T08:08:49.785253Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:49.785251Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:49.785321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 432 sessionId: src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0 is DEAD
2025-10-02T08:08:49.785490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:49.785500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0] Write session will restart in 0.008010s
2025-10-02T08:08:49.785535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0] Write session: Do CDS request
2025-10-02T08:08:49.785541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:49.794233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.794318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:49.794331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 433
2025-10-02T08:08:49.794439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.794478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:49.794486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:49.794490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:49.794850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 433 sessionId:  describe result for acl check
2025-10-02T08:08:49.794881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:49.794886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:49.794887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:49.794890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533374280147898:6487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:49.795266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533374280147898:6487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:49.797711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533374280147898:6487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:49.799023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:49.800794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:49.801068Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:49.801078Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:49.801088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:49.801136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:49.801172Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533374280148025:6486]
2025-10-02T08:08:49.801172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533374280147898:6487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:49.801178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533374280147898:6487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:49.801182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533374280147898:6487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:49.801189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:49.801728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:49.801893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:49.801932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:49.802144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:49.802173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.802177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.802178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.802178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.802179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.802182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.802188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.802191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.802193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.802195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.802198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.802202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.802206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.802208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.802211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.802217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.802219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.802222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.802224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.802226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.802237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:49.810295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:49.812204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:49.812227Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:49.812229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:49.812233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:49.812240Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 432 [1:7556533374280148025:6486]
2025-10-02T08:08:49.812252Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:49.812271Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:49.812274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.812277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.812279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.812295Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:49.812301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:49.812309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:49.812381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.812391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.812394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:49.812397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:49.812463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:49.812470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.812484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.812500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:49.812519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 432
2025-10-02T08:08:49.812522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280148030:6487], now have 1 active actors on pipe
2025-10-02T08:08:49.812529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533374280148019:6486]
2025-10-02T08:08:49.812532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533374280148019:6486]
2025-10-02T08:08:49.812542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:49.812550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533374740453457:2378], now have 1 active actors on pipe
2025-10-02T08:08:49.812555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.812564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.812566Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:49.812569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:49.812585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:49.812603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:49.812610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:49.812644Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:49.812652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.812655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.812656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:49.812663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.812669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:49.812674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533374280148019:6486]
2025-10-02T08:08:49.812644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 432
2025-10-02T08:08:49.812676Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:49.812680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:49.812695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.812771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.812777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.812788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.812862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 433 partition: 0 MaxSeqNo: 17 sessionId: src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0
2025-10-02T08:08:49.813247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b8939bb-ce00964a-a976f9aa-7f59ad59_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:49.816170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0] Write session: try to update token
2025-10-02T08:08:49.816183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:49.829412Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:49.829426Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:49.829428Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:49.829436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533374280148019:6486]
2025-10-02T08:08:49.829440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533374280148019:6486]
2025-10-02T08:08:49.829474Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:49.829480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:49.829482Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:49.829486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.829488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:49.829634Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:49.829922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId: src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:49.832320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:49.885496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533374280148058:6232]
2025-10-02T08:08:49.885583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 432, pipe: [1:7556533374280148058:6232]
2025-10-02T08:08:49.961613Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:49.961868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.961879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.961909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280148058:6232], now have 1 active actors on pipe
2025-10-02T08:08:49.962043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533374280148058:6232]
2025-10-02T08:08:49.962067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:49.962071Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:49.962074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:49.962133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 433 reason: error at write: Disconnected sessionId: src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0
2025-10-02T08:08:49.962126Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:49.962253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 433 sessionId: src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0 is DEAD
2025-10-02T08:08:49.962403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:49.962412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0] Write session will restart in 0.007262s
2025-10-02T08:08:49.962460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0] Write session: Do CDS request
2025-10-02T08:08:49.962466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:49.971318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.971383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:49.971396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 434
2025-10-02T08:08:49.971550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:49.971589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:49.971598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:49.971602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:49.972287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 434 sessionId:  describe result for acl check
2025-10-02T08:08:49.972321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:49.972329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:49.972332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:49.972337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533374280148427:6494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:49.972869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533374280148427:6494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:49.976508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533374280148427:6494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:49.979226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:49.979454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533374280148427:6494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:49.979464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533374280148427:6494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:49.979466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533374280148427:6494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:49.979474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:49.981326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:49.981611Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:49.981619Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:49.981630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:49.981679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:49.981716Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533374280148619:6493]
2025-10-02T08:08:49.982339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:49.982505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:49.982541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:49.982787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:49.982821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.982825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.982826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.982827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.982827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.982831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.982837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.982840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.982842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.982844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.982848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.982853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:49.982857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.982860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:49.982863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.982866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:49.982868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.982871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.982873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.982876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.982887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:49.991711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:49.993649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:49.993669Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:49.993671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:49.993675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:49.993681Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 433 [1:7556533374280148619:6493]
2025-10-02T08:08:49.993694Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:49.993712Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:49.993714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.993717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.993719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.993735Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:49.993741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:49.993748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:49.993816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.993825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.993829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:49.993831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:49.993899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:49.993907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:49.993921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:49.993935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:49.993955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533374280148607:6493]
2025-10-02T08:08:49.993961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533374280148607:6493]
2025-10-02T08:08:49.993969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:49.993971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 433
2025-10-02T08:08:49.993982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533374280148615:6494], now have 1 active actors on pipe
2025-10-02T08:08:49.993987Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:49.993990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:49.993990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:49.994005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:49.994008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:49.994013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533374740453466:2378], now have 1 active actors on pipe
2025-10-02T08:08:49.994018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.994021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.994059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533374280148607:6493]
2025-10-02T08:08:49.994069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:49.994085Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:49.994091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:49.994091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:49.994095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:49.994097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:49.994106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:49.994114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:49.994095Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 433
2025-10-02T08:08:49.994145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.994254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:49.994261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:49.994273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:49.994311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 434 partition: 0 MaxSeqNo: 17 sessionId: src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0
2025-10-02T08:08:49.994705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6023cd30-5ad216f0-dd5130bf-fe23154b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:49.998154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0] Write session: try to update token
2025-10-02T08:08:49.998176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:50.011538Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:50.011556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:50.011558Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:50.011565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533374280148607:6493]
2025-10-02T08:08:50.011569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533374280148607:6493]
2025-10-02T08:08:50.011601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:50.011603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:50.011606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:50.011608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.011609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:50.011752Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:50.014573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId: src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:50.017379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:50.062133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533378575115941:6232]
2025-10-02T08:08:50.062206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 433, pipe: [1:7556533378575115941:6232]
2025-10-02T08:08:50.142269Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:50.142589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.142604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.142647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575115941:6232], now have 1 active actors on pipe
2025-10-02T08:08:50.142753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533378575115941:6232]
2025-10-02T08:08:50.142772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:50.142777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:50.142824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 434 reason: error at write: Disconnected sessionId: src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0
2025-10-02T08:08:50.142854Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:50.142877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:50.142973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 434 sessionId: src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0 is DEAD
2025-10-02T08:08:50.143113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:50.143124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0] Write session will restart in 0.009911s
2025-10-02T08:08:50.143148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0] Write session: Do CDS request
2025-10-02T08:08:50.143155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:50.154251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.154282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:50.154296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 435
2025-10-02T08:08:50.154444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.154471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:50.154478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:50.154480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:50.154836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 435 sessionId:  describe result for acl check
2025-10-02T08:08:50.154858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:50.154863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:50.154863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:50.154867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533378575116434:6500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:50.155256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533378575116434:6500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:50.156520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:50.157046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533378575116434:6500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:50.158083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:50.158234Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:50.158243Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:50.158252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:50.158298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:50.158331Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533378575116498:6499]
2025-10-02T08:08:50.158896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:50.159041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:50.159070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:50.159268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:50.159299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.159303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.159304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.159304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.159305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.159308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.159314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.159316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.159318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.159319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.159323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.159327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.159330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.159333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.159335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.159337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.159339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.159342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.159344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.159346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.159356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:50.159537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533378575116434:6500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:50.159544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533378575116434:6500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:50.159546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533378575116434:6500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:50.159551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:50.166504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:50.168042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:50.168052Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:50.168054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:50.168056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:50.168059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 434 [1:7556533378575116498:6499]
2025-10-02T08:08:50.168066Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:50.168077Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:50.168079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.168081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.168082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.168092Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:50.168098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:50.168103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:50.168149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.168155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.168157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:50.168158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:50.168205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:50.168211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.168223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.168235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 434
2025-10-02T08:08:50.168239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:50.168253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575116514:6500], now have 1 active actors on pipe
2025-10-02T08:08:50.168261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533379035420768:2378], now have 1 active actors on pipe
2025-10-02T08:08:50.168265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.168268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.168282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533378575116482:6499]
2025-10-02T08:08:50.168289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533378575116482:6499]
2025-10-02T08:08:50.168298Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:50.168311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:50.168311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:50.168313Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:50.168319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:50.168321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:50.168333Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:50.168338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.168341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.168343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:50.168350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.168362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:50.168387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533378575116482:6499]
2025-10-02T08:08:50.168394Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:50.168368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 434
2025-10-02T08:08:50.168398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:50.168402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.168441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.168448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.168460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.168492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 435 partition: 0 MaxSeqNo: 17 sessionId: src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0
2025-10-02T08:08:50.168776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b346d1-d99ba676-ed35ca7c-dddad471_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:50.171510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0] Write session: try to update token
2025-10-02T08:08:50.171523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:50.182329Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:50.182345Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:50.182351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533378575116482:6499]
2025-10-02T08:08:50.182386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:50.182398Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:50.182536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:50.182662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:50.182786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:50.182909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:50.183076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:50.183105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:50.184869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId: src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:50.187259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:50.187299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.187305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.187333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:50.187348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:50.187379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.187390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.187535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.187591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.187663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.187754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.188003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.188010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.188063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.188116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.188172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.188226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.188267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.188272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.188326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.188377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.188434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.188484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.188540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.188548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.188600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.188650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.188702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.188838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.188878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.188883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.188982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.189032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.189084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.189137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.189240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.189245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.189301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.189354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.189405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.189459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.189497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.189503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.189559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.189612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.189676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.189733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.189841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.189846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.189903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.189956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.190010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.190065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.190103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.190108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.190162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.190214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.190267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.190337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.190376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.190381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.190437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:50.190488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:50.190540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:50.190593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:50.190649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:50.190654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:50.190683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:50.190732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.190747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.190752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:50.190776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:50.190789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:50.190794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:50.190796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:50.190797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:50.191127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:50.191144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:50.191150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:50.191153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:50.191155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:50.191158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:50.191732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:50.191746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:50.191749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:50.191753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:50.191756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:50.191757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:50.192165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:50.192179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:50.192183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:50.192185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:50.192188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:50.193238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:50.193250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:50.193259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392530193
2025-10-02T08:08:50.193392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:50.193401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:50.193403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:50.193408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:50.193410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:50.193412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:50.193805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:50.193820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:50.193826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:50.193830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:50.193836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:50.193838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:50.194222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:50.194236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:50.194241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:50.194246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:50.194248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:50.194250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:50.194647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:50.194660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:50.194663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:50.195600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:50.195612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:50.195617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:50.195621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:50.195626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392530195
2025-10-02T08:08:50.195881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:50.195894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:50.195900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:50.195905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:50.195908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:50.195910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:50.196302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:50.196316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:50.196320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:50.196322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:50.196324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:50.196326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:50.196742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:50.196755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.196881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392530196
2025-10-02T08:08:50.197543Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:50.197558Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:50.197562Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:50.197565Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:50.199121Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:50.199130Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:50.199131Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:50.199139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533378575116482:6499]
2025-10-02T08:08:50.199141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533378575116482:6499]
2025-10-02T08:08:50.199181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:50.199181Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:50.199187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.199187Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:50.199188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:50.199302Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:50.242857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533378575116537:6232]
2025-10-02T08:08:50.242918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 434, pipe: [1:7556533378575116537:6232]
2025-10-02T08:08:50.319621Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:50.319903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575116537:6232], now have 1 active actors on pipe
2025-10-02T08:08:50.320030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533378575116537:6232]
2025-10-02T08:08:50.320049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:50.320051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:50.320064Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:50.320073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 435 reason: error at write: Disconnected sessionId: src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0
2025-10-02T08:08:50.320091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:50.320208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 435 sessionId: src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0 is DEAD
2025-10-02T08:08:50.320342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:50.320351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0] Write session will restart in 0.009943s
2025-10-02T08:08:50.320368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0] Write session: Do CDS request
2025-10-02T08:08:50.320373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:50.331198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.331197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:50.331207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 436
2025-10-02T08:08:50.331370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.331391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:50.331397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:50.331400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:50.331631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 436 sessionId:  describe result for acl check
2025-10-02T08:08:50.331653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:50.331654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:50.331660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:50.331663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533378575117062:6507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:50.331978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533378575117062:6507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:50.332838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:50.333929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533378575117062:6507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:50.334508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:50.334650Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:50.334656Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:50.334663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:50.334696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:50.334720Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533378575117108:6506]
2025-10-02T08:08:50.335126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:50.335303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:50.335340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:50.335594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:50.335624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.335628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.335629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.335630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.335631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.335634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.335643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.335648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.335652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.335659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.335666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.335673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.335682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.335687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.335689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.335692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.335695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.335697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.335700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.335702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.335712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:50.336279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533378575117062:6507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:50.336289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533378575117062:6507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:50.336292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533378575117062:6507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:50.336298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:50.342773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:50.344115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:50.344127Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:50.344129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:50.344132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:50.344137Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 435 [1:7556533378575117108:6506]
2025-10-02T08:08:50.344147Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:50.344161Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:50.344164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.344166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.344169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.344180Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:50.344184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:50.344188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:50.344228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.344235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.344238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:50.344240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:50.344297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:50.344303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.344311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.344317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:50.344329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533378575117085:6506]
2025-10-02T08:08:50.344333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533378575117085:6506]
2025-10-02T08:08:50.344339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:50.344350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575117125:6507], now have 1 active actors on pipe
2025-10-02T08:08:50.344354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 435
2025-10-02T08:08:50.344359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:50.344365Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:50.344369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:50.344371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:50.344372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:50.344394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533379035420786:2378], now have 1 active actors on pipe
2025-10-02T08:08:50.344401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533378575117085:6506]
2025-10-02T08:08:50.344403Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:50.344407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:50.344409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.344413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.344446Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:50.344456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.344461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.344463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:50.344470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.344481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:50.344499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.344530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.344535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.344545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.344586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 436 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0
2025-10-02T08:08:50.344844Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 435
2025-10-02T08:08:50.344930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25e0f06-9a461cb5-d6b4762-9ad3d13e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:50.347997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0] Write session: try to update token
2025-10-02T08:08:50.348013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:50.360892Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:50.360904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:50.360906Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:50.360913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533378575117085:6506]
2025-10-02T08:08:50.360916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533378575117085:6506]
2025-10-02T08:08:50.360949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:50.360949Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:50.360953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:50.360954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.360955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:50.361086Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:50.362596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId: src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:50.364943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:50.420085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533378575117147:6232]
2025-10-02T08:08:50.420189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 435, pipe: [1:7556533378575117147:6232]
2025-10-02T08:08:50.486769Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:50.487273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.487286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.487321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575117147:6232], now have 1 active actors on pipe
2025-10-02T08:08:50.487412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533378575117147:6232]
2025-10-02T08:08:50.487427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:50.487431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:50.487481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 436 reason: error at write: Disconnected sessionId: src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0
2025-10-02T08:08:50.487549Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:50.487612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 436 sessionId: src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0 is DEAD
2025-10-02T08:08:50.487614Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:50.487832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:50.487842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0] Write session will restart in 0.006936s
2025-10-02T08:08:50.487880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0] Write session: Do CDS request
2025-10-02T08:08:50.487887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:50.496216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.496352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:50.496363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 437
2025-10-02T08:08:50.496457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.496477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:50.496483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:50.496485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:50.496932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 437 sessionId:  describe result for acl check
2025-10-02T08:08:50.496957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:50.496958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:50.496959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:50.496963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533378575117542:6514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:50.497350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533378575117542:6514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:50.499651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533378575117542:6514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:50.501969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533378575117542:6514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:50.501978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533378575117542:6514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:50.501980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533378575117542:6514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:50.501985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:50.502221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:50.503723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:50.503914Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:50.503920Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:50.503928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:50.503959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:50.503985Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533378575117716:6513]
2025-10-02T08:08:50.504423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:50.504546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:50.504570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:50.504782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:50.504818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.504822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.504823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.504823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.504824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.504827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.504833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.504835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.504837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.504839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.504841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.504845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.504852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.504855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.504861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.504863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.504865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.504868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.504870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.504875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.504885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:50.512619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:50.514401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:50.514414Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:50.514415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:50.514417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:50.514421Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 436 [1:7556533378575117716:6513]
2025-10-02T08:08:50.514428Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:50.514438Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:50.514440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.514442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.514443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.514453Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:50.514456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:50.514460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:50.514498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.514505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.514507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:50.514509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:50.514556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:50.514561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.514567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.514573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:50.514588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575117707:6514], now have 1 active actors on pipe
2025-10-02T08:08:50.514596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533378575117710:6513]
2025-10-02T08:08:50.514595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 436
2025-10-02T08:08:50.514597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533378575117710:6513]
2025-10-02T08:08:50.514601Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:50.514606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533379035420794:2378], now have 1 active actors on pipe
2025-10-02T08:08:50.514608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:50.514610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:50.514614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.514617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.514629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:50.514639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:50.514644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:50.514667Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce0ca97-a76d0b81-42efca09-660000d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:50.514675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.514677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.514678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:50.514684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.514693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:50.514702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533378575117710:6513]
2025-10-02T08:08:50.514704Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:50.514679Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 436
2025-10-02T08:08:50.514707Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:50.514720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.514760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.514764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.514773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.514801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 437 partition: 0 MaxSeqNo: 17 sessionId: src_id|ce0ca97-a76d0b81-42efca09-660000d1_0
2025-10-02T08:08:50.515106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4873c2d-e2dd527e-ac7a1e2a-6281c48b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ce0ca97-a76d0b81-42efca09-660000d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:50.520646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ca97-a76d0b81-42efca09-660000d1_0] Write session: try to update token
2025-10-02T08:08:50.520661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ca97-a76d0b81-42efca09-660000d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:50.532512Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:50.532528Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:50.532530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:50.532537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533378575117710:6513]
2025-10-02T08:08:50.532540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533378575117710:6513]
2025-10-02T08:08:50.532571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:50.532576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.532575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:50.532578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:50.532580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:50.532719Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:50.536891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId: src_id|ce0ca97-a76d0b81-42efca09-660000d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:50.539222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:50.587413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533378575117742:6232]
2025-10-02T08:08:50.587486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 436, pipe: [1:7556533378575117742:6232]
2025-10-02T08:08:50.653698Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:50.653922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.653943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.653974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575117742:6232], now have 1 active actors on pipe
2025-10-02T08:08:50.654083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:50.654090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:50.654115Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:50.654137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 437 reason: error at write: Disconnected sessionId: src_id|ce0ca97-a76d0b81-42efca09-660000d1_0
2025-10-02T08:08:50.654141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:50.654275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 437 sessionId: src_id|ce0ca97-a76d0b81-42efca09-660000d1_0 is DEAD
2025-10-02T08:08:50.654335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533378575117742:6232]
2025-10-02T08:08:50.654379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ca97-a76d0b81-42efca09-660000d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:50.654388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ca97-a76d0b81-42efca09-660000d1_0] Write session will restart in 0.006850s
2025-10-02T08:08:50.654406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ca97-a76d0b81-42efca09-660000d1_0] Write session: Do CDS request
2025-10-02T08:08:50.654410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ca97-a76d0b81-42efca09-660000d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:50.662214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ca97-a76d0b81-42efca09-660000d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.662261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:50.662270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 438
2025-10-02T08:08:50.662482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.662508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:50.662514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:50.662518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:50.662934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 438 sessionId:  describe result for acl check
2025-10-02T08:08:50.662959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:50.662964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:50.662965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:50.662969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533378575118168:6530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:50.663325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533378575118168:6530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:50.665963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533378575118168:6530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:50.668442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:50.668449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533378575118168:6530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:50.668453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533378575118168:6530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:50.668455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533378575118168:6530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:50.668461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:50.670191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:50.670324Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:50.670330Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:50.670336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:50.670366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:50.670404Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533378575118339:6529]
2025-10-02T08:08:50.670770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:50.670942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:50.670981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:50.671338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:50.671381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.671385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.671386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.671386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.671387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.671390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.671395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.671397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.671399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.671401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.671404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.671408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.671412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.671414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.671417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.671420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.671422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.671424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.671426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.671428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.671439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:50.679581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:50.681039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:50.681049Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:50.681050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:50.681052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:50.681056Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 437 [1:7556533378575118339:6529]
2025-10-02T08:08:50.681063Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:50.681074Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:50.681075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.681077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.681078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.681089Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:50.681092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:50.681096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:50.681133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.681141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.681144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:50.681146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:50.681195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:50.681202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.681210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.681216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:50.681228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575118334:6530], now have 1 active actors on pipe
2025-10-02T08:08:50.681229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533379035420814:2378], now have 1 active actors on pipe
2025-10-02T08:08:50.681233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533378575118327:6529]
2025-10-02T08:08:50.681234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533378575118327:6529]
2025-10-02T08:08:50.681240Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:50.681241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 437
2025-10-02T08:08:50.681247Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:50.681248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:50.681249Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:50.681255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:50.681256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:50.681260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.681262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.681288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533378575118327:6529]
2025-10-02T08:08:50.681294Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:50.681303Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:50.681303Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:50.681311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.681313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.681283Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 437
2025-10-02T08:08:50.681314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:50.681320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.681326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:50.681350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.681388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.681396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.681411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.681439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 438 partition: 0 MaxSeqNo: 17 sessionId: src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0
2025-10-02T08:08:50.681768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ca97-a76d0b81-42efca09-660000d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:50.684476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0] Write session: try to update token
2025-10-02T08:08:50.684493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:50.697923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId: src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:50.699038Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:50.699051Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:50.699052Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:50.699060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533378575118327:6529]
2025-10-02T08:08:50.699063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533378575118327:6529]
2025-10-02T08:08:50.699092Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:50.699100Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:50.699100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:50.699104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.699106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:50.699230Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:50.700323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:50.754354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533378575118372:6232]
2025-10-02T08:08:50.754435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 437, pipe: [1:7556533378575118372:6232]
2025-10-02T08:08:50.822048Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:50.822370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.822378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.822410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575118372:6232], now have 1 active actors on pipe
2025-10-02T08:08:50.822618Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:50.822618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:50.822621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:50.822650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:50.822696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 438 reason: error at write: Disconnected sessionId: src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0
2025-10-02T08:08:50.822864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 438 sessionId: src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0 is DEAD
2025-10-02T08:08:50.822917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533378575118372:6232]
2025-10-02T08:08:50.823003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:50.823017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0] Write session will restart in 0.009018s
2025-10-02T08:08:50.823043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0] Write session: Do CDS request
2025-10-02T08:08:50.823051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:50.833308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.833385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:50.833397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 439
2025-10-02T08:08:50.833491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.833514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:50.833521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:50.833524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:50.833878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 439 sessionId:  describe result for acl check
2025-10-02T08:08:50.833898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:50.833901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:50.833902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:50.833905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533378575118852:6539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:50.834250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533378575118852:6539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:50.835944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533378575118852:6539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:50.837750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:50.837987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533378575118852:6539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:50.837999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533378575118852:6539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:50.838002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533378575118852:6539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:50.838009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:50.838062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:50.838196Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:50.838203Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:50.838210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:50.838242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:50.838271Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533378575118944:6538]
2025-10-02T08:08:50.838733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:50.838907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:50.838940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:50.839133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:50.839161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.839165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.839166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.839167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.839167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.839170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.839176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.839178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.839180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.839182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.839186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.839190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:50.839194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.839196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:50.839198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.839201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:50.839203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.839206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.839208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.839211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.839220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:50.846401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:50.847838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:50.847850Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:50.847852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:50.847855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:50.847861Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 438 [1:7556533378575118944:6538]
2025-10-02T08:08:50.847872Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:50.847888Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:50.847890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.847892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.847895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.847908Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:50.847917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:50.847923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:50.847970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.847976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.847979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:50.847981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:50.848062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 438
2025-10-02T08:08:50.848142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:50.848149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.848162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:50.848177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:50.848148Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 438
2025-10-02T08:08:50.848197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575118941:6539], now have 1 active actors on pipe
2025-10-02T08:08:50.848204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533379035420830:2378], now have 1 active actors on pipe
2025-10-02T08:08:50.848208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.848214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.848229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533378575118933:6538]
2025-10-02T08:08:50.848235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533378575118933:6538]
2025-10-02T08:08:50.848246Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:50.848257Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:50.848265Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:50.848265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:50.848278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:50.848280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:50.848297Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ded30bd-26ffc93f-224f90f7-41d72248_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:50.848305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:50.848309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:50.848314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:50.848322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:50.848333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:50.848363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533378575118933:6538]
2025-10-02T08:08:50.848373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:50.848378Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:50.848387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.848442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.848449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.848461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:50.848497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 439 partition: 0 MaxSeqNo: 17 sessionId: src_id|ded30bd-26ffc93f-224f90f7-41d72248_0
2025-10-02T08:08:50.848785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab73930-aeb26ee5-6ce5d57e-484b2714_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ded30bd-26ffc93f-224f90f7-41d72248_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:50.851451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded30bd-26ffc93f-224f90f7-41d72248_0] Write session: try to update token
2025-10-02T08:08:50.851462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded30bd-26ffc93f-224f90f7-41d72248_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:50.865324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId: src_id|ded30bd-26ffc93f-224f90f7-41d72248_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:50.865948Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:50.865962Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:50.865964Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:50.865972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533378575118933:6538]
2025-10-02T08:08:50.865975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533378575118933:6538]
2025-10-02T08:08:50.866012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:50.866023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:50.866026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:50.866032Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:50.866041Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:50.866162Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:50.868005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:50.922827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533378575118971:6232]
2025-10-02T08:08:50.922927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 438, pipe: [1:7556533378575118971:6232]
2025-10-02T08:08:50.987976Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:50.988209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:50.988218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:50.988246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533378575118971:6232], now have 1 active actors on pipe
2025-10-02T08:08:50.988339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533378575118971:6232]
2025-10-02T08:08:50.988353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:50.988358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:50.988395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 439 reason: error at write: Disconnected sessionId: src_id|ded30bd-26ffc93f-224f90f7-41d72248_0
2025-10-02T08:08:50.988425Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:50.988451Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:50.988533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 439 sessionId: src_id|ded30bd-26ffc93f-224f90f7-41d72248_0 is DEAD
2025-10-02T08:08:50.988720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded30bd-26ffc93f-224f90f7-41d72248_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:50.988731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded30bd-26ffc93f-224f90f7-41d72248_0] Write session will restart in 0.005821s
2025-10-02T08:08:50.988756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded30bd-26ffc93f-224f90f7-41d72248_0] Write session: Do CDS request
2025-10-02T08:08:50.988763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded30bd-26ffc93f-224f90f7-41d72248_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:50.995268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded30bd-26ffc93f-224f90f7-41d72248_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.995336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:50.995351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 440
2025-10-02T08:08:50.995444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:50.995469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:50.995476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:50.995478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:50.995893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 440 sessionId:  describe result for acl check
2025-10-02T08:08:50.995920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:50.995924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:50.995925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:50.995928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533378575119318:6545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:50.996295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533378575119318:6545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:50.998993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533378575119318:6545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:51.001774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533378575119318:6545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:51.001793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533378575119318:6545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:51.001795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533378575119318:6545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:51.001801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:51.002585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:51.004207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:51.004347Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:51.004353Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:51.004359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:51.004389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:51.004415Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533382870086839:6544]
2025-10-02T08:08:51.005123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:51.005276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:51.005309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:51.005533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:51.005563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.005567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.005568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.005568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.005569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.005572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.005578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.005580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.005582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.005584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.005587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.005591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.005595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.005597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.005599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.005602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.005604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.005606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.005610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.005613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.005621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:51.012832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:51.014360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:51.014373Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:51.014374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:51.014377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:51.014380Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 439 [1:7556533382870086839:6544]
2025-10-02T08:08:51.014388Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:51.014399Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:51.014404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.014406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.014407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.014418Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:51.014424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:51.014428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:51.014480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.014487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.014491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:51.014493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:51.014545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:51.014550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.014557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.014563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:51.014579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870086821:6545], now have 1 active actors on pipe
2025-10-02T08:08:51.014586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533382870086833:6544]
2025-10-02T08:08:51.014588Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533382870086833:6544]
2025-10-02T08:08:51.014588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 439
2025-10-02T08:08:51.014592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:51.014601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:51.014600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:51.014604Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:51.014608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:51.014613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:51.014616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533379035420839:2378], now have 1 active actors on pipe
2025-10-02T08:08:51.014621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.014623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.014651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533382870086833:6544]
2025-10-02T08:08:51.014661Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:51.014672Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:51.014673Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:51.014677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.014679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.014681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:51.014687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.014692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:51.014674Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 439
2025-10-02T08:08:51.014709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.014743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.014748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.014756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.014784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 440 partition: 0 MaxSeqNo: 17 sessionId: src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0
2025-10-02T08:08:51.015087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded30bd-26ffc93f-224f90f7-41d72248_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:51.017719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0] Write session: try to update token
2025-10-02T08:08:51.017730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:51.031693Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:51.031706Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:51.031707Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:51.031712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533382870086833:6544]
2025-10-02T08:08:51.031715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533382870086833:6544]
2025-10-02T08:08:51.031730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId: src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:51.031744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:51.031749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.031752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:51.031752Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:51.031756Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:51.031899Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:51.034426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:51.088698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533382870086865:6232]
2025-10-02T08:08:51.088808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 439, pipe: [1:7556533382870086865:6232]
2025-10-02T08:08:51.155130Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:51.155439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.155451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.155480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870086865:6232], now have 1 active actors on pipe
2025-10-02T08:08:51.155599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:51.155607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:51.155655Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:51.155661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 440 reason: error at write: Disconnected sessionId: src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0
2025-10-02T08:08:51.155702Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:51.155818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 440 sessionId: src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0 is DEAD
2025-10-02T08:08:51.155939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533382870086865:6232]
2025-10-02T08:08:51.155991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:51.156002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0] Write session will restart in 0.009090s
2025-10-02T08:08:51.156025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0] Write session: Do CDS request
2025-10-02T08:08:51.156032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:51.166209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.166395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:51.166409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 441
2025-10-02T08:08:51.166527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.166563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:51.166573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:51.166576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:51.166960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 441 sessionId:  describe result for acl check
2025-10-02T08:08:51.166988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:51.166994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:51.166995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:51.166999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533382870087362:6551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:51.167347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533382870087362:6551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:51.168687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:51.169123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533382870087362:6551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:51.170622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:51.170828Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:51.170836Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:51.170843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:51.170880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:51.170906Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533382870087434:6550]
2025-10-02T08:08:51.171341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533382870087362:6551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:51.171349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533382870087362:6551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:51.171351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533382870087362:6551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:51.171356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:51.171409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:51.171550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:51.171585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:51.171789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:51.171827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.171833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.171834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.171834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.171835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.171838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.171844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.171847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.171849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.171850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.171854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.171858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.171862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.171865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.171868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.171871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.171873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.171875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.171878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.171881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.171890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:51.179271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:51.180882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:51.180892Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:51.180894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:51.180896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:51.180900Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 440 [1:7556533382870087434:6550]
2025-10-02T08:08:51.180907Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:51.180920Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:51.180921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.180923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.180924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.180934Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:51.180937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:51.180941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:51.180984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.180991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.180994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:51.180996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:51.181048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:51.181053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.181060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.181069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:51.181080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533382870087418:6550]
2025-10-02T08:08:51.181084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533382870087418:6550]
2025-10-02T08:08:51.181089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:51.181098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:51.181111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:51.181113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:51.181116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:51.181118Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:51.181131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 440
2025-10-02T08:08:51.181147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533383330388142:2378], now have 1 active actors on pipe
2025-10-02T08:08:51.181155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870087439:6551], now have 1 active actors on pipe
2025-10-02T08:08:51.181157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533382870087418:6550]
2025-10-02T08:08:51.181164Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:51.181174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.181181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.181194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:51.181214Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:51.181223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.181198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 440
2025-10-02T08:08:51.181231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.181233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:51.181241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.181248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:51.181273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.181302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.181306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.181315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.181344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 441 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0
2025-10-02T08:08:51.181685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744330d8-c02277b5-625b3ff4-2a601e4f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:51.184912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0] Write session: try to update token
2025-10-02T08:08:51.184927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:51.198029Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:51.198041Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:51.198043Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:51.198050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533382870087418:6550]
2025-10-02T08:08:51.198054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533382870087418:6550]
2025-10-02T08:08:51.198094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:51.198097Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:51.198102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:51.198104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.198106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:51.198245Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:51.198635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId: src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:51.201385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:51.256120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533382870087466:6232]
2025-10-02T08:08:51.256227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 440, pipe: [1:7556533382870087466:6232]
2025-10-02T08:08:51.324727Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:51.324937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.324949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.324979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870087466:6232], now have 1 active actors on pipe
2025-10-02T08:08:51.325099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533382870087466:6232]
2025-10-02T08:08:51.325118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:51.325121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:51.325165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 441 reason: error at write: Disconnected sessionId: src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0
2025-10-02T08:08:51.325187Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:51.325219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:51.325343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 441 sessionId: src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0 is DEAD
2025-10-02T08:08:51.325530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:51.325547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0] Write session will restart in 0.006046s
2025-10-02T08:08:51.325570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0] Write session: Do CDS request
2025-10-02T08:08:51.325575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:51.333265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.333363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:51.333373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 442
2025-10-02T08:08:51.333498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.333521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:51.333528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:51.333531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:51.333806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 442 sessionId:  describe result for acl check
2025-10-02T08:08:51.333830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:51.333831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:51.333832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:51.333835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533382870087826:6558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:51.334276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533382870087826:6558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:51.337802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533382870087826:6558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:51.340189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533382870087826:6558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:51.340199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533382870087826:6558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:51.340200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533382870087826:6558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:51.340206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:51.340791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:51.342308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:51.342470Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:51.342477Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:51.342483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:51.342516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:51.342543Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533382870088055:6557]
2025-10-02T08:08:51.343147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:51.343328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:51.343354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:51.343535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:51.343561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.343567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.343568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.343569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.343569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.343572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.343578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.343580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.343582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.343584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.343587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.343591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.343595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.343598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.343600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.343602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.343604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.343607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.343609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.343612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.343621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:51.351037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:51.352756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:51.352768Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:51.352770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:51.352773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:51.352778Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 441 [1:7556533382870088055:6557]
2025-10-02T08:08:51.352786Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:51.352817Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:51.352820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.352822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.352824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.352838Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:51.352843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:51.352850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:51.352910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.352917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.352920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:51.352922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:51.352972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:51.352978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.352990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.353005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:51.353025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870088037:6558], now have 1 active actors on pipe
2025-10-02T08:08:51.353033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 441
2025-10-02T08:08:51.353035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533382870088049:6557]
2025-10-02T08:08:51.353036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533382870088049:6557]
2025-10-02T08:08:51.353041Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:51.353052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:51.353054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:51.353060Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:51.353061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:51.353063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:51.353067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533383330388160:2378], now have 1 active actors on pipe
2025-10-02T08:08:51.353070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.353072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.353101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533382870088049:6557]
2025-10-02T08:08:51.353109Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:51.353116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:51.353122Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b564d232-bafc05c9-6719d705-f040311d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:51.353126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.353128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.353129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:51.353135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.353145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:51.353141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 441
2025-10-02T08:08:51.353177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.353222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.353228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.353238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.353271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 442 partition: 0 MaxSeqNo: 17 sessionId: src_id|b564d232-bafc05c9-6719d705-f040311d_0
2025-10-02T08:08:51.353689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba189a59-6a25fbb8-144aaa6-6b1a2716_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b564d232-bafc05c9-6719d705-f040311d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:51.356657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b564d232-bafc05c9-6719d705-f040311d_0] Write session: try to update token
2025-10-02T08:08:51.356673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b564d232-bafc05c9-6719d705-f040311d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:51.369908Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:51.369928Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:51.369930Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:51.369938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533382870088049:6557]
2025-10-02T08:08:51.369942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533382870088049:6557]
2025-10-02T08:08:51.369983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:51.369997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.369999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:51.370003Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:51.370009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:51.370138Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:51.371825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId: src_id|b564d232-bafc05c9-6719d705-f040311d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:51.374215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:51.425105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533382870088086:6232]
2025-10-02T08:08:51.425216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 441, pipe: [1:7556533382870088086:6232]
2025-10-02T08:08:51.500813Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:51.501143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.501156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.501188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870088086:6232], now have 1 active actors on pipe
2025-10-02T08:08:51.501292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:51.501297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:51.501336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 442 reason: error at write: Disconnected sessionId: src_id|b564d232-bafc05c9-6719d705-f040311d_0
2025-10-02T08:08:51.501382Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:51.501425Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:51.501465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 442 sessionId: src_id|b564d232-bafc05c9-6719d705-f040311d_0 is DEAD
2025-10-02T08:08:51.501591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533382870088086:6232]
2025-10-02T08:08:51.501627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b564d232-bafc05c9-6719d705-f040311d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:51.501636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b564d232-bafc05c9-6719d705-f040311d_0] Write session will restart in 0.008634s
2025-10-02T08:08:51.501661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b564d232-bafc05c9-6719d705-f040311d_0] Write session: Do CDS request
2025-10-02T08:08:51.501667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b564d232-bafc05c9-6719d705-f040311d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:51.511381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b564d232-bafc05c9-6719d705-f040311d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.511471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:51.511484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 443
2025-10-02T08:08:51.511589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.511611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:51.511618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:51.511621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:51.511991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 443 sessionId:  describe result for acl check
2025-10-02T08:08:51.512014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:51.512019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:51.512020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:51.512023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533382870088532:6565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:51.512424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533382870088532:6565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:51.514999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533382870088532:6565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:51.515976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:51.517812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:51.517942Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:51.517950Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:51.517957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:51.517990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:51.518017Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533382870088663:6564]
2025-10-02T08:08:51.518070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533382870088532:6565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:51.518080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533382870088532:6565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:51.518082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533382870088532:6565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:51.518089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:51.518446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:51.518578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:51.518604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:51.518806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:51.518840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.518845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.518845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.518846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.518847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.518850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.518857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.518859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.518861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.518863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.518866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.518871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.518874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.518877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.518879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.518882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.518887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.518892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.518896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.518900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.518917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:51.526516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:51.528183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:51.528208Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:51.528212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:51.528217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:51.528222Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 442 [1:7556533382870088663:6564]
2025-10-02T08:08:51.528234Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:51.528250Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:51.528257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.528260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.528262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.528274Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:51.528284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:51.528290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:51.528354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.528361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.528364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:51.528366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:51.528428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:51.528435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.528446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.528464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:51.528470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 442
2025-10-02T08:08:51.528480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870088668:6565], now have 1 active actors on pipe
2025-10-02T08:08:51.528483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533383330388169:2378], now have 1 active actors on pipe
2025-10-02T08:08:51.528489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533382870088657:6564]
2025-10-02T08:08:51.528497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533382870088657:6564]
2025-10-02T08:08:51.528509Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:51.528518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.528526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.528528Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:51.528536Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:51.528543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:51.528561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:51.528567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:51.528561Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 442
2025-10-02T08:08:51.528600Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:51.528609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.528612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.528614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:51.528622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.528634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:51.528640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533382870088657:6564]
2025-10-02T08:08:51.528651Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:51.528667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:51.528684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.528735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.528741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.528752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.528790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 443 partition: 0 MaxSeqNo: 17 sessionId: src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0
2025-10-02T08:08:51.529126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b564d232-bafc05c9-6719d705-f040311d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:51.531724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0] Write session: try to update token
2025-10-02T08:08:51.531735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:51.545199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId: src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:51.545462Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:51.545475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:51.545477Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:51.545484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533382870088657:6564]
2025-10-02T08:08:51.545492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533382870088657:6564]
2025-10-02T08:08:51.545528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:51.545533Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:51.545539Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:51.545539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.545541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:51.545671Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:51.547854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:51.601735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533382870088694:6232]
2025-10-02T08:08:51.601856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 442, pipe: [1:7556533382870088694:6232]
2025-10-02T08:08:51.670008Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:51.670377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.670387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.670418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870088694:6232], now have 1 active actors on pipe
2025-10-02T08:08:51.670566Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:51.670584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:51.670588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:51.670622Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:51.670652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 443 reason: error at write: Disconnected sessionId: src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0
2025-10-02T08:08:51.670768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533382870088694:6232]
2025-10-02T08:08:51.670838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 443 sessionId: src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0 is DEAD
2025-10-02T08:08:51.671014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:51.671035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0] Write session will restart in 0.007803s
2025-10-02T08:08:51.671055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0] Write session: Do CDS request
2025-10-02T08:08:51.671061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:51.680348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.680480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:51.680493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 444
2025-10-02T08:08:51.680595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.680622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:51.680631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:51.680634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:51.681029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 444 sessionId:  describe result for acl check
2025-10-02T08:08:51.681056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:51.681062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:51.681065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:51.681070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533382870089173:6581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:51.681463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533382870089173:6581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:51.683871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533382870089173:6581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:51.685428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:51.687402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:51.687549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533382870089173:6581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:51.687552Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:51.687556Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:51.687559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533382870089173:6581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:51.687561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533382870089173:6581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:51.687565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:51.687567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:51.687607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:51.687641Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533382870089298:6580]
2025-10-02T08:08:51.688225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:51.688435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:51.688480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:51.688767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:51.688824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.688830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.688831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.688832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.688833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.688838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.688847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.688855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.688859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.688867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.688872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.688883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.688889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.688894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.688903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.688912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.688917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.688922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.688931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.688940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.688964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:51.696291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:51.697620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:51.697633Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:51.697635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:51.697637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:51.697642Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 443 [1:7556533382870089298:6580]
2025-10-02T08:08:51.697649Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:51.697661Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:51.697666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.697668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.697670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.697679Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:51.697682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:51.697687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:51.697739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.697746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.697748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:51.697750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:51.697792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:51.697797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.697804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.697810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:51.697821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533382870089292:6580]
2025-10-02T08:08:51.697826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533382870089292:6580]
2025-10-02T08:08:51.697831Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:51.697839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:51.697850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:51.697855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:51.697873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 443
2025-10-02T08:08:51.697877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:51.697878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870089302:6581], now have 1 active actors on pipe
2025-10-02T08:08:51.697880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:51.697880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533382870089292:6580]
2025-10-02T08:08:51.697882Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:51.697886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:51.697896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533383330388176:2378], now have 1 active actors on pipe
2025-10-02T08:08:51.697899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.697902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.697919Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:51.697927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.697929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.697931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:51.697937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.697946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:51.697958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.698092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.698098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.698109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.698136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 444 partition: 0 MaxSeqNo: 17 sessionId: src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0
2025-10-02T08:08:51.698137Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 443
2025-10-02T08:08:51.698428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce4e51b-7f5cc6f4-59566abf-d4d54eea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:51.701159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0] Write session: try to update token
2025-10-02T08:08:51.701173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:51.714555Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:51.714572Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:51.714574Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:51.714579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533382870089292:6580]
2025-10-02T08:08:51.714582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533382870089292:6580]
2025-10-02T08:08:51.714620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:51.714627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.714629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:51.714629Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:51.714633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:51.714768Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:51.715467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId: src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:51.718198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:51.770690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533382870089336:6232]
2025-10-02T08:08:51.770799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 443, pipe: [1:7556533382870089336:6232]
2025-10-02T08:08:51.837883Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:51.838126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.838140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.838172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870089336:6232], now have 1 active actors on pipe
2025-10-02T08:08:51.838271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533382870089336:6232]
2025-10-02T08:08:51.838298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:51.838300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:51.838317Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:51.838362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 444 reason: error at write: Disconnected sessionId: src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0
2025-10-02T08:08:51.838370Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:51.838553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 444 sessionId: src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0 is DEAD
2025-10-02T08:08:51.838683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:51.838693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0] Write session will restart in 0.009180s
2025-10-02T08:08:51.838712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0] Write session: Do CDS request
2025-10-02T08:08:51.838718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:51.849232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.849292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:51.849308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 445
2025-10-02T08:08:51.849396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:51.849417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:51.849424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:51.849426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:51.849730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 445 sessionId:  describe result for acl check
2025-10-02T08:08:51.849752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:51.849757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:51.849758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:51.849761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533382870089828:6590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:51.850114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533382870089828:6590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:51.851968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533382870089828:6590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:51.854034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:51.854230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533382870089828:6590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:51.854243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533382870089828:6590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:51.854245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533382870089828:6590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:51.854252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:51.854280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:51.854390Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:51.854396Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:51.854402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:51.854432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:51.854457Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533382870089922:6589]
2025-10-02T08:08:51.854893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:51.855039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:51.855074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:51.855295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:51.855324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.855329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.855330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.855330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.855331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.855334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.855340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.855342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.855344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.855346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.855349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.855353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:51.855357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.855360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:51.855362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.855365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:51.855367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.855369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.855371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.855374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.855384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:51.866156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:51.867889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:51.867902Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:51.867904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:51.867907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:51.867913Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 444 [1:7556533382870089922:6589]
2025-10-02T08:08:51.867921Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:51.867932Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:51.867938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.867940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.867941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.867952Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:51.867957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:51.867963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:51.868019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.868025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.868029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:51.868030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:51.868080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:51.868085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.868091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:51.868101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:51.868117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870089919:6590], now have 1 active actors on pipe
2025-10-02T08:08:51.868126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533382870089911:6589]
2025-10-02T08:08:51.868128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 444
2025-10-02T08:08:51.868130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533382870089911:6589]
2025-10-02T08:08:51.868136Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:51.868143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533383330388208:2378], now have 1 active actors on pipe
2025-10-02T08:08:51.868144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:51.868147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:51.868150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:51.868166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:51.868172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:51.868179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.868186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.868216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533382870089911:6589]
2025-10-02T08:08:51.868222Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:51.868224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:51.868203Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 444
2025-10-02T08:08:51.868233Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|917f0509-2761e439-d759dd7b-2af0308d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:51.868241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:51.868243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:51.868244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:51.868250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:51.868260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:51.868293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.868379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:51.868384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:51.868394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:51.868424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 445 partition: 0 MaxSeqNo: 17 sessionId: src_id|917f0509-2761e439-d759dd7b-2af0308d_0
2025-10-02T08:08:51.868733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53fd1ede-cce8039e-b6411c9a-1e70c635_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|917f0509-2761e439-d759dd7b-2af0308d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:51.871688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|917f0509-2761e439-d759dd7b-2af0308d_0] Write session: try to update token
2025-10-02T08:08:51.871706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|917f0509-2761e439-d759dd7b-2af0308d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:51.884400Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:51.884415Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:51.884417Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:51.884426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533382870089911:6589]
2025-10-02T08:08:51.884429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533382870089911:6589]
2025-10-02T08:08:51.884460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:51.884467Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:51.884468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:51.884470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:51.884471Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:51.884605Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:51.887477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId: src_id|917f0509-2761e439-d759dd7b-2af0308d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:51.889954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:51.938610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533382870089948:6232]
2025-10-02T08:08:51.938703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 444, pipe: [1:7556533382870089948:6232]
2025-10-02T08:08:52.009566Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:52.009764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.009773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.009803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533382870089948:6232], now have 1 active actors on pipe
2025-10-02T08:08:52.009945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:52.009954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:52.010041Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:52.010004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 445 reason: error at write: Disconnected sessionId: src_id|917f0509-2761e439-d759dd7b-2af0308d_0
2025-10-02T08:08:52.010019Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:52.010163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 445 sessionId: src_id|917f0509-2761e439-d759dd7b-2af0308d_0 is DEAD
2025-10-02T08:08:52.010296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533382870089948:6232]
2025-10-02T08:08:52.010356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917f0509-2761e439-d759dd7b-2af0308d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:52.010364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917f0509-2761e439-d759dd7b-2af0308d_0] Write session will restart in 0.008778s
2025-10-02T08:08:52.010384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917f0509-2761e439-d759dd7b-2af0308d_0] Write session: Do CDS request
2025-10-02T08:08:52.010390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917f0509-2761e439-d759dd7b-2af0308d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:52.020249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|917f0509-2761e439-d759dd7b-2af0308d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.020318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:52.020330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 446
2025-10-02T08:08:52.020412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.020432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:52.020439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:52.020441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:52.020742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 446 sessionId:  describe result for acl check
2025-10-02T08:08:52.020767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:52.020773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:52.020775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:52.020779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533387165057760:6596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:52.021120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533387165057760:6596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:52.023843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:52.023994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533387165057760:6596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:52.025934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:52.026093Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:52.026103Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:52.026113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:52.026157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:52.026213Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533387165057833:6595]
2025-10-02T08:08:52.026499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533387165057760:6596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:52.026512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533387165057760:6596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:52.026515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533387165057760:6596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:52.026522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:52.026710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:52.026863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:52.026888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:52.027076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:52.027115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.027116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.027116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.027117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.027117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.027120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.027126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.027128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.027130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.027132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.027135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.027139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.027143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.027145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.027147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.027150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.027152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.027155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.027157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.027159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.027170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:52.036039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:52.037484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:52.037496Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:52.037498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:52.037501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:52.037505Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 445 [1:7556533387165057833:6595]
2025-10-02T08:08:52.037513Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:52.037526Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:52.037527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.037529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.037531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.037542Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:52.037545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:52.037550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:52.037594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.037601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.037603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:52.037605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:52.037659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:52.037665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.037673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.037680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:52.037691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533387165057817:6595]
2025-10-02T08:08:52.037692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533387165057817:6595]
2025-10-02T08:08:52.037700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:52.037708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 445
2025-10-02T08:08:52.037711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165057838:6596], now have 1 active actors on pipe
2025-10-02T08:08:52.037719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:52.037718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:52.037722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:52.037729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:52.037737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:52.037743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533387625355511:2378], now have 1 active actors on pipe
2025-10-02T08:08:52.037747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.037751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.037788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533387165057817:6595]
2025-10-02T08:08:52.037797Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:52.037809Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:52.037815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:52.037819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.037823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.037825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:52.037833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.037843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:52.037794Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 445
2025-10-02T08:08:52.037875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.037915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.037922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.037931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.037962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 446 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0
2025-10-02T08:08:52.038308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|917f0509-2761e439-d759dd7b-2af0308d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:52.041171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0] Write session: try to update token
2025-10-02T08:08:52.041185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:52.055683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId: src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:52.055910Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:52.055924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:52.055927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:52.055935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533387165057817:6595]
2025-10-02T08:08:52.055939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533387165057817:6595]
2025-10-02T08:08:52.055966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:52.055975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:52.055983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:52.055991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.055993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:52.056128Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:52.058361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:52.110700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533387165057864:6232]
2025-10-02T08:08:52.110807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 445, pipe: [1:7556533387165057864:6232]
2025-10-02T08:08:52.181107Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:52.181384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.181394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.181422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165057864:6232], now have 1 active actors on pipe
2025-10-02T08:08:52.181512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533387165057864:6232]
2025-10-02T08:08:52.181529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:52.181536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:52.181579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 446 reason: error at write: Disconnected sessionId: src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0
2025-10-02T08:08:52.181625Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:52.181658Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:52.181749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 446 sessionId: src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0 is DEAD
2025-10-02T08:08:52.181882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:52.181890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0] Write session will restart in 0.008115s
2025-10-02T08:08:52.181907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0] Write session: Do CDS request
2025-10-02T08:08:52.181911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:52.191268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.191292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:52.191307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 447
2025-10-02T08:08:52.191451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.191480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:52.191487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:52.191490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:52.191808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 447 sessionId:  describe result for acl check
2025-10-02T08:08:52.191834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:52.191840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:52.191841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:52.191845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533387165058345:6602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:52.192301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533387165058345:6602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:52.194358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533387165058345:6602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:52.196462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:52.196834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533387165058345:6602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:52.196834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:52.196843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533387165058345:6602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:52.196845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533387165058345:6602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:52.196851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:52.197005Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:52.197016Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:52.197024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:52.197072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:52.197110Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533387165058451:6601]
2025-10-02T08:08:52.197738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:52.197902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:52.197935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:52.198145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:52.198184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.198188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.198189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.198189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.198190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.198193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.198199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.198201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.198203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.198205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.198208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.198212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.198215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.198218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.198219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.198222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.198224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.198226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.198229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.198231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.198242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:52.206781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:52.208465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:52.208475Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:52.208477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:52.208479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:52.208484Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 446 [1:7556533387165058451:6601]
2025-10-02T08:08:52.208491Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:52.208503Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:52.208505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.208507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.208508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.208518Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:52.208521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:52.208525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:52.208566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.208572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.208574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:52.208575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:52.208628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:52.208634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.208646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.208659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:52.208670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 446
2025-10-02T08:08:52.208679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165058448:6602], now have 1 active actors on pipe
2025-10-02T08:08:52.208682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533387625355517:2378], now have 1 active actors on pipe
2025-10-02T08:08:52.208688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533387165058440:6601]
2025-10-02T08:08:52.208690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533387165058440:6601]
2025-10-02T08:08:52.208701Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:52.208710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:52.208713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.208718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.208718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:52.208734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:52.208751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:52.208757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:52.208760Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 446
2025-10-02T08:08:52.208793Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:52.208816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.208824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.208825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:52.208833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.208844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:52.208854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533387165058440:6601]
2025-10-02T08:08:52.208863Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:52.208872Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:52.208893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.208934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.208944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.208965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.209004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 447 partition: 0 MaxSeqNo: 17 sessionId: src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0
2025-10-02T08:08:52.209339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d250e2-fbd9127d-948a6e7f-d283f1ca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:52.212071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0] Write session: try to update token
2025-10-02T08:08:52.212081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:52.226707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId: src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:52.228140Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:52.228156Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:52.228159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:52.228167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533387165058440:6601]
2025-10-02T08:08:52.228170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533387165058440:6601]
2025-10-02T08:08:52.228210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:52.228217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:52.228222Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:52.228222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.228224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:52.228381Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:52.229284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:52.281669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533387165058478:6232]
2025-10-02T08:08:52.281783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 446, pipe: [1:7556533387165058478:6232]
2025-10-02T08:08:52.355719Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:52.356050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.356059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.356088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165058478:6232], now have 1 active actors on pipe
2025-10-02T08:08:52.356171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:52.356180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:52.356239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 447 reason: error at write: Disconnected sessionId: src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0
2025-10-02T08:08:52.356276Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:52.356376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 447 sessionId: src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0 is DEAD
2025-10-02T08:08:52.356557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:52.356569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0] Write session will restart in 0.008673s
2025-10-02T08:08:52.356589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0] Write session: Do CDS request
2025-10-02T08:08:52.356595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:52.356609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533387165058478:6232]
2025-10-02T08:08:52.356628Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:52.366187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.366411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:52.366437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 448
2025-10-02T08:08:52.366557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.366583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:52.366590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:52.366593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:52.366984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 448 sessionId:  describe result for acl check
2025-10-02T08:08:52.367018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:52.367024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:52.367025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:52.367030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533387165058936:6609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:52.367374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533387165058936:6609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:52.369937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533387165058936:6609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:52.373232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:52.373505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533387165058936:6609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:52.373511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:52.373513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533387165058936:6609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:52.373515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533387165058936:6609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:52.373521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:52.373657Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:52.373667Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:52.373675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:52.373720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:52.373753Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533387165059087:6608]
2025-10-02T08:08:52.374138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:52.374296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:52.374337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:52.374552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:52.374580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.374584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.374584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.374585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.374586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.374589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.374595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.374597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.374599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.374601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.374604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.374608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.374615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.374617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.374620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.374622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.374624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.374626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.374632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.374634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.374644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:52.381850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:52.383481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:52.383496Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:52.383498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:52.383501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:52.383507Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 447 [1:7556533387165059087:6608]
2025-10-02T08:08:52.383516Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:52.383529Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:52.383534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.383536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.383537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.383548Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:52.383551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:52.383555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:52.383592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.383597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.383600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:52.383601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:52.383642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:52.383647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.383654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.383660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:52.383674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533387165059076:6608]
2025-10-02T08:08:52.383680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533387165059076:6608]
2025-10-02T08:08:52.383686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:52.383693Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:52.383695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165059084:6609], now have 1 active actors on pipe
2025-10-02T08:08:52.383696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:52.383700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:52.383703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 447
2025-10-02T08:08:52.383707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:52.383709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:52.383712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533387625355536:2378], now have 1 active actors on pipe
2025-10-02T08:08:52.383730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.383732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.383742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533387165059076:6608]
2025-10-02T08:08:52.383747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:52.383761Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:52.383764Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:52.383769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.383771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.383772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:52.383778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.383751Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 447
2025-10-02T08:08:52.383783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:52.383812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.383853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.383858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.383867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.383893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 448 partition: 0 MaxSeqNo: 17 sessionId: src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0
2025-10-02T08:08:52.384173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5b8354-197e8681-c9d8dde1-bd72d68d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:52.386879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0] Write session: try to update token
2025-10-02T08:08:52.386892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:52.400310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId: src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:52.402808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:52.402910Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:52.402925Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:52.402927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:52.402932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533387165059076:6608]
2025-10-02T08:08:52.402935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533387165059076:6608]
2025-10-02T08:08:52.402965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.402977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.402982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:52.402986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:52.402995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:52.403001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.403002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:52.403137Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:52.456770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533387165059119:6232]
2025-10-02T08:08:52.456898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 447, pipe: [1:7556533387165059119:6232]
2025-10-02T08:08:52.526926Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:52.527474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165059119:6232], now have 1 active actors on pipe
2025-10-02T08:08:52.527584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533387165059119:6232]
2025-10-02T08:08:52.527599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:52.527601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:52.527643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 448 reason: error at write: Disconnected sessionId: src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0
2025-10-02T08:08:52.527695Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:52.527686Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:52.527788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 448 sessionId: src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0 is DEAD
2025-10-02T08:08:52.527926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:52.527934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0] Write session will restart in 0.008686s
2025-10-02T08:08:52.527951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0] Write session: Do CDS request
2025-10-02T08:08:52.527956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:52.537277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.537331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:52.537350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 449
2025-10-02T08:08:52.537465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.537495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:52.537504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:52.537509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:52.537917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 449 sessionId:  describe result for acl check
2025-10-02T08:08:52.537949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:52.537955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:52.537957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:52.537961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533387165059552:6616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:52.538442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533387165059552:6616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:52.541211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533387165059552:6616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:52.544648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:52.544927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:52.544972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533387165059552:6616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:52.544986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533387165059552:6616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:52.544990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533387165059552:6616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:52.544999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:52.545081Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:52.545089Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:52.545099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:52.545133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:52.545167Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533387165059706:6615]
2025-10-02T08:08:52.545718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:52.545866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:52.545903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:52.546160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:52.546195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.546201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.546202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.546203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.546204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.546208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.546216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.546223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.546226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.546229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.546233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.546239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.546244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.546248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.546251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.546255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.546258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.546267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.546275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.546279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.546298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:52.553907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:52.555554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:52.555572Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:52.555575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:52.555579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:52.555585Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 448 [1:7556533387165059706:6615]
2025-10-02T08:08:52.555597Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:52.555614Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:52.555616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.555625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.555627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.555643Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:52.555652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:52.555664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:52.555731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.555740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.555742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:52.555745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:52.555818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:52.555825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.555838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.555849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 448
2025-10-02T08:08:52.555853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:52.555872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165059708:6616], now have 1 active actors on pipe
2025-10-02T08:08:52.555879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533387625355544:2378], now have 1 active actors on pipe
2025-10-02T08:08:52.555884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.555892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.555908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533387165059699:6615]
2025-10-02T08:08:52.555915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533387165059699:6615]
2025-10-02T08:08:52.555927Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:52.555940Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:52.555943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:52.555948Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:52.555934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 448
2025-10-02T08:08:52.555957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:52.555964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:52.555977Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:52.555987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.555990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.555992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:52.555999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.556009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:52.556047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533387165059699:6615]
2025-10-02T08:08:52.556058Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:52.556070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:52.556071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.556144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.556151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.556163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.556197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 449 partition: 0 MaxSeqNo: 17 sessionId: src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0
2025-10-02T08:08:52.556511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e218bec7-3fb2e6e0-1ec25e46-70e07cfd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:52.559189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0] Write session: try to update token
2025-10-02T08:08:52.559208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:52.573138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId: src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:52.575099Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:52.575112Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:52.575119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533387165059699:6615]
2025-10-02T08:08:52.575153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:52.575158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:52.575321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:52.575451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:52.575589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:52.575718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:52.575758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:52.575911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:52.575941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.575949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.575963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:52.575989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:52.576011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:52.576048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.576055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.576192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.576250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.576307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.576369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.576410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.576416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.576467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.576520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.576583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.576643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.577093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.577102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.577162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.577220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.577278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.577334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.577377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.577382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.577438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.577495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.577558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.577629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.577674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.577678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.577731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.577782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.577836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.577893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.577931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.577936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.577991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.578053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.578108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.578165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.578203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.578208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.578263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.578316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.578375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.578429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.578474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.578480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.578535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.578585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.578646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.578703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.578820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.578826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.578882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.578934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.578987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.579044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.579089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.579100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.579160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:52.579213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:52.579265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:52.579322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:52.579381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:52.579386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:52.579415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:52.579464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.579478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.579483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:52.579504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:52.579516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:52.579521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:52.579523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:52.579525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:52.579879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:52.579896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:52.579905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:52.579910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:52.579913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:52.579915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:52.580330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:52.580353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:52.580363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:52.580366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:52.580369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:52.580374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:52.580896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:52.580911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:52.580915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:52.580923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:52.580928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:52.583175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:52.583190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:52.583199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392532583
2025-10-02T08:08:52.583400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:52.583412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:52.583415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:52.583421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:52.583423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:52.583425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:52.583905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:52.583922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:52.583930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:52.583932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:52.583934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:52.583937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:52.584352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:52.584367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:52.584378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:52.584387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:52.584391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:52.584395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:52.584829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:52.584844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:52.584847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:52.585831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:52.585845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:52.585849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:52.585851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:52.585856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392532585
2025-10-02T08:08:52.586102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:52.586119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:52.586122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:52.586126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:52.586127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:52.586130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:52.586561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:52.586576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:52.586580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:52.586582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:52.586584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:52.586586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:52.586996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:52.587011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.587086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392532586
2025-10-02T08:08:52.591367Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:52.591407Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:52.591416Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:52.591427Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:52.592830Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:52.592839Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:52.592840Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:52.592846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533387165059699:6615]
2025-10-02T08:08:52.592848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533387165059699:6615]
2025-10-02T08:08:52.592884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:52.592892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:52.592895Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:52.592898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.592899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:52.593020Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:52.627766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533387165059744:6232]
2025-10-02T08:08:52.627859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 448, pipe: [1:7556533387165059744:6232]
2025-10-02T08:08:52.716954Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:52.717196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165059744:6232], now have 1 active actors on pipe
2025-10-02T08:08:52.717274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533387165059744:6232]
2025-10-02T08:08:52.717289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:52.717291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:52.717305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 449 reason: error at write: Disconnected sessionId: src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0
2025-10-02T08:08:52.717365Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:52.717378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:52.717453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 449 sessionId: src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0 is DEAD
2025-10-02T08:08:52.717654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:52.717669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0] Write session will restart in 0.005772s
2025-10-02T08:08:52.717690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0] Write session: Do CDS request
2025-10-02T08:08:52.717695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:52.724259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.724499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:52.724512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 450
2025-10-02T08:08:52.724638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.724660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:52.724665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:52.724668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:52.725020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 450 sessionId:  describe result for acl check
2025-10-02T08:08:52.725045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:52.725051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:52.725052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:52.725056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533387165060105:6632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:52.725421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533387165060105:6632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:52.727686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533387165060105:6632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:52.730641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533387165060105:6632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:52.730654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533387165060105:6632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:52.730657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533387165060105:6632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:52.730663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:52.733917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:52.734179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:52.734307Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:52.734314Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:52.734321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:52.734350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:52.734380Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533387165060367:6631]
2025-10-02T08:08:52.735193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:52.735337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:52.735367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:52.735585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:52.735619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.735624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.735624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.735625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.735626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.735629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.735635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.735638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.735640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.735642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.735645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.735649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.735653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.735656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.735658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.735661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.735664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.735666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.735669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.735672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.735686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:52.743672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:52.745268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:52.745283Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:52.745286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:52.745289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:52.745295Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 449 [1:7556533387165060367:6631]
2025-10-02T08:08:52.745303Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:52.745316Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:52.745318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.745320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.745321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.745333Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:52.745341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:52.745345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:52.745383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.745388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.745390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:52.745392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:52.745436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:52.745442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.745450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.745456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:52.745468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533387165060361:6631]
2025-10-02T08:08:52.745469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533387165060361:6631]
2025-10-02T08:08:52.745474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:52.745484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:52.745488Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:52.745491Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:52.745491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:52.745493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:52.745502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165060333:6632], now have 1 active actors on pipe
2025-10-02T08:08:52.745506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533387625355564:2378], now have 1 active actors on pipe
2025-10-02T08:08:52.745509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 449
2025-10-02T08:08:52.745538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533387165060361:6631]
2025-10-02T08:08:52.745547Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:52.745551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:52.745551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.745554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.745583Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:52.745592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.745596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.745597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:52.745605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.745614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:52.745634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.745553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 449
2025-10-02T08:08:52.745706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.745711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.745720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.745746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 450 partition: 0 MaxSeqNo: 17 sessionId: src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0
2025-10-02T08:08:52.746092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5699a8db-68d13836-29aecb0d-db1f0e47_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:52.756365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0] Write session: try to update token
2025-10-02T08:08:52.756382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:52.765307Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:52.765323Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:52.765325Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:52.765333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533387165060361:6631]
2025-10-02T08:08:52.765336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533387165060361:6631]
2025-10-02T08:08:52.765373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:52.765373Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:52.765378Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:52.765378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.765379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:52.765519Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:52.777762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId: src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:52.785253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:52.817212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533387165060400:6232]
2025-10-02T08:08:52.817303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 449, pipe: [1:7556533387165060400:6232]
2025-10-02T08:08:52.889488Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:52.890012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.890022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.890038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165060400:6232], now have 1 active actors on pipe
2025-10-02T08:08:52.890126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:52.890136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:52.890185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 450 reason: error at write: Disconnected sessionId: src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0
2025-10-02T08:08:52.890246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:52.890325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 450 sessionId: src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0 is DEAD
2025-10-02T08:08:52.890479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533387165060400:6232]
2025-10-02T08:08:52.890512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:52.890525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0] Write session will restart in 0.005971s
2025-10-02T08:08:52.890545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0] Write session: Do CDS request
2025-10-02T08:08:52.890551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:52.891130Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:52.897182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.897246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:52.897258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 451
2025-10-02T08:08:52.897380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:52.897411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:52.897418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:52.897420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:52.897703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 451 sessionId:  describe result for acl check
2025-10-02T08:08:52.897728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:52.897734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:52.897735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:52.897740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533387165060763:6641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:52.898092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533387165060763:6641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:52.900079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533387165060763:6641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:52.902605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533387165060763:6641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:52.902615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533387165060763:6641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:52.902617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533387165060763:6641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:52.902622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:52.905861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:52.906175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:52.906354Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:52.906360Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:52.906367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:52.906401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:52.906434Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533387165060997:6640]
2025-10-02T08:08:52.907099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:52.907224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:52.907248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:52.907533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:52.907560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.907564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.907565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.907566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.907566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.907569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.907575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.907577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.907579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.907581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.907585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.907589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:52.907592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.907595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:52.907597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.907600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:52.907603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.907605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.907608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.907610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.907620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:52.914980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:52.916468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:52.916481Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:52.916483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:52.916486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:52.916493Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 450 [1:7556533387165060997:6640]
2025-10-02T08:08:52.916500Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:52.916513Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:52.916515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.916517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.916518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.916528Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:52.916532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:52.916536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:52.916579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.916584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.916587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:52.916589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:52.916633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:52.916638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.916644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:52.916651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:52.916662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533387165060991:6640]
2025-10-02T08:08:52.916667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533387165060991:6640]
2025-10-02T08:08:52.916673Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:52.916682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165060958:6641], now have 1 active actors on pipe
2025-10-02T08:08:52.916689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 450
2025-10-02T08:08:52.916691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:52.916692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:52.916695Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:52.916699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:52.916700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:52.916721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533387625355582:2378], now have 1 active actors on pipe
2025-10-02T08:08:52.916724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.916726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.916736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533387165060991:6640]
2025-10-02T08:08:52.916742Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:52.916751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:52.916763Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adf30825-9403aa94-c2099a0-33f5fee3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:52.916768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:52.916770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:52.916771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:52.916777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:52.916783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:52.916796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.916779Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 450
2025-10-02T08:08:52.916853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:52.916858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:52.916867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:52.916896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 451 partition: 0 MaxSeqNo: 17 sessionId: src_id|adf30825-9403aa94-c2099a0-33f5fee3_0
2025-10-02T08:08:52.917173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea2aa43-6ffe953d-4e22e476-84d2d11a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|adf30825-9403aa94-c2099a0-33f5fee3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:52.919978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf30825-9403aa94-c2099a0-33f5fee3_0] Write session: try to update token
2025-10-02T08:08:52.919993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf30825-9403aa94-c2099a0-33f5fee3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:52.934273Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:52.934290Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:52.934293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:52.934301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533387165060991:6640]
2025-10-02T08:08:52.934305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533387165060991:6640]
2025-10-02T08:08:52.934338Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:52.934348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:52.934349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:52.934356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:52.934359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:52.934492Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:52.934950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId: src_id|adf30825-9403aa94-c2099a0-33f5fee3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:52.937565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:52.990751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533387165061021:6232]
2025-10-02T08:08:52.990839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 450, pipe: [1:7556533387165061021:6232]
2025-10-02T08:08:53.057566Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:53.058017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.058029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.058066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533387165061021:6232], now have 1 active actors on pipe
2025-10-02T08:08:53.058169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:53.058183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:53.058227Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:53.058259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 451 reason: error at write: Disconnected sessionId: src_id|adf30825-9403aa94-c2099a0-33f5fee3_0
2025-10-02T08:08:53.058286Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:53.058428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 451 sessionId: src_id|adf30825-9403aa94-c2099a0-33f5fee3_0 is DEAD
2025-10-02T08:08:53.058461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533387165061021:6232]
2025-10-02T08:08:53.058575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf30825-9403aa94-c2099a0-33f5fee3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:53.058585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf30825-9403aa94-c2099a0-33f5fee3_0] Write session will restart in 0.007545s
2025-10-02T08:08:53.058609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf30825-9403aa94-c2099a0-33f5fee3_0] Write session: Do CDS request
2025-10-02T08:08:53.058616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf30825-9403aa94-c2099a0-33f5fee3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:53.067173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf30825-9403aa94-c2099a0-33f5fee3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.067322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:53.067336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 452
2025-10-02T08:08:53.067459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.067491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:53.067498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:53.067501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:53.067869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 452 sessionId:  describe result for acl check
2025-10-02T08:08:53.067894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:53.067899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:53.067900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:53.067904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533391460028743:6647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:53.068286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533391460028743:6647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:53.071140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533391460028743:6647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:53.074825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:53.075162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:53.075175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533391460028743:6647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:53.075179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533391460028743:6647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:53.075181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533391460028743:6647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:53.075187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:53.075312Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:53.075319Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:53.075325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:53.075359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:53.075390Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533391460028914:6646]
2025-10-02T08:08:53.075778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:53.075932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:53.075968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:53.076179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:53.076204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.076208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.076209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.076209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.076210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.076213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.076219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.076221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.076223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.076225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.076228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.076232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.076236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.076239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.076242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.076246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.076249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.076253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.076262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.076266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.076283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:53.083770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:53.086115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:53.086132Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:53.086134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:53.086136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:53.086140Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 451 [1:7556533391460028914:6646]
2025-10-02T08:08:53.086149Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:53.086163Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:53.086165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.086166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.086167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.086180Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:53.086185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:53.086191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:53.086239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.086243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.086246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:53.086248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:53.086293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:53.086300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.086310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.086316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:53.086330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460028912:6647], now have 1 active actors on pipe
2025-10-02T08:08:53.086339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533391460028904:6646]
2025-10-02T08:08:53.086340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533391460028904:6646]
2025-10-02T08:08:53.086344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 451
2025-10-02T08:08:53.086346Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:53.086354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:53.086355Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:53.086357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:53.086366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:53.086368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:53.086371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533391920322884:2378], now have 1 active actors on pipe
2025-10-02T08:08:53.086374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.086377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.086407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533391460028904:6646]
2025-10-02T08:08:53.086415Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:53.086421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:53.086425Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f997df7e-94728ef0-101b383-629eed94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:53.086431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.086435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.086436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:53.086443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.086453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:53.086474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.086436Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 451
2025-10-02T08:08:53.086546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.086551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.086560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.086587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 452 partition: 0 MaxSeqNo: 17 sessionId: src_id|f997df7e-94728ef0-101b383-629eed94_0
2025-10-02T08:08:53.086915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf30825-9403aa94-c2099a0-33f5fee3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f997df7e-94728ef0-101b383-629eed94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:53.089763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f997df7e-94728ef0-101b383-629eed94_0] Write session: try to update token
2025-10-02T08:08:53.089780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f997df7e-94728ef0-101b383-629eed94_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:53.097306Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:53.097321Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:53.097328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533391460028904:6646]
2025-10-02T08:08:53.097359Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:53.097363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:53.097517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:53.097653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.097872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.098020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.098213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:53.098245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:53.103978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId: src_id|f997df7e-94728ef0-101b383-629eed94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:53.106608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:53.106664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.106674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.106705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:53.106724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:53.106764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.106776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.106932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.107003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.107070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.107135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.107451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.107459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.107525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.107580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.107641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.107702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.107746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.107751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.107852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.107906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.107958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.108014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.108053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.108057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.108134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.108203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.108256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.108311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.108366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.108372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.108426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.108477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.108544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.108602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.108644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.108649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.108709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.108762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.108828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.108882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.108942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.108948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.109003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.109059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.109119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.109174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.109221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.109226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.109281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.109337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.109394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.109451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.109490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.109495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.109550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.109605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.109660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.109720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.109759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.109765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.109823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.109876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.109929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.109985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.110027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.110033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.110065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:53.110114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.110129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.110134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:53.110158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:53.110180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:53.110185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:53.110187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:53.110189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:53.110572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:53.110590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:53.110597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:53.110599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:53.110601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:53.110603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:53.111137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:53.111155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:53.111162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:53.111168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:53.111171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:53.111172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:53.111603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:53.111618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:53.111621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:53.111624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:53.111626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:53.113503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:53.113519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:53.113528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392533113
2025-10-02T08:08:53.113635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:53.113644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:53.113647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:53.113649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:53.113651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:53.113653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:53.114091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:53.114109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:53.114113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:53.114116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:53.114118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:53.114121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:53.114569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:53.114584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:53.114589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:53.114591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:53.114597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:53.114598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:53.115070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:53.115087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:53.115090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:53.116155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:53.116171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:53.116175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:53.116177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:53.116184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392533116
2025-10-02T08:08:53.116429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:53.116444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:53.116449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:53.116455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:53.116457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:53.116458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:53.116875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:53.116888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:53.116892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:53.116898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:53.116901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:53.116903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:53.117321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:53.117337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.117415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392533117
2025-10-02T08:08:53.118150Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:53.118183Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:53.118194Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:53.118197Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:53.119973Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:53.119984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:53.119986Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:53.119993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533391460028904:6646]
2025-10-02T08:08:53.119997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533391460028904:6646]
2025-10-02T08:08:53.120041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:53.120047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:53.120048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.120050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:53.120053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:53.120179Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:53.158736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533391460028948:6232]
2025-10-02T08:08:53.158835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 451, pipe: [1:7556533391460028948:6232]
2025-10-02T08:08:53.245092Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:53.245398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460028948:6232], now have 1 active actors on pipe
2025-10-02T08:08:53.245486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533391460028948:6232]
2025-10-02T08:08:53.245500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:53.245505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:53.245523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 452 reason: error at write: Disconnected sessionId: src_id|f997df7e-94728ef0-101b383-629eed94_0
2025-10-02T08:08:53.245566Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:53.245609Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:53.245693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 452 sessionId: src_id|f997df7e-94728ef0-101b383-629eed94_0 is DEAD
2025-10-02T08:08:53.245825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f997df7e-94728ef0-101b383-629eed94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:53.245834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f997df7e-94728ef0-101b383-629eed94_0] Write session will restart in 0.005946s
2025-10-02T08:08:53.245856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f997df7e-94728ef0-101b383-629eed94_0] Write session: Do CDS request
2025-10-02T08:08:53.245862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f997df7e-94728ef0-101b383-629eed94_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:53.253306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f997df7e-94728ef0-101b383-629eed94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.253358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:53.253371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 453
2025-10-02T08:08:53.253472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.253494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:53.253497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:53.253500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:53.253818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 453 sessionId:  describe result for acl check
2025-10-02T08:08:53.253840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:53.253845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:53.253846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:53.253849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533391460029315:6653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:53.254177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533391460029315:6653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:53.256693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533391460029315:6653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:53.259978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533391460029315:6653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:53.259989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533391460029315:6653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:53.259991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533391460029315:6653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:53.259996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:53.262819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:53.263061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:53.263205Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:53.263214Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:53.263223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:53.263266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:53.263298Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533391460029549:6652]
2025-10-02T08:08:53.263836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:53.263980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:53.264013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:53.264263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:53.264314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.264319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.264321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.264322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.264323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.264327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.264337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.264345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.264352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.264356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.264365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.264376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.264382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.264387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.264396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.264400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.264408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.264417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.264425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.264434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.264452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:53.274664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:53.276432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:53.276448Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:53.276450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:53.276452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:53.276458Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 452 [1:7556533391460029549:6652]
2025-10-02T08:08:53.276468Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:53.276484Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:53.276491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.276493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.276495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.276510Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:53.276520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:53.276530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:53.276592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.276598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.276600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:53.276602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:53.276661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:53.276667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.276679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.276692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:53.276692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 452
2025-10-02T08:08:53.276713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460029528:6653], now have 1 active actors on pipe
2025-10-02T08:08:53.276722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.276726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.276742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533391920322890:2378], now have 1 active actors on pipe
2025-10-02T08:08:53.276751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533391460029543:6652]
2025-10-02T08:08:53.276756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533391460029543:6652]
2025-10-02T08:08:53.276768Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:53.276781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 452
2025-10-02T08:08:53.276783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:53.276786Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:53.276789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:53.276813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:53.276816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:53.276831Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4857a1a-b8758a6d-d297a746-76403ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:53.276836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.276844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.276846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:53.276854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.276867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:53.276908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533391460029543:6652]
2025-10-02T08:08:53.276919Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:53.276933Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:53.276942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.276979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.276989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.277005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.277036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 453 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4857a1a-b8758a6d-d297a746-76403ed_0
2025-10-02T08:08:53.277327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f997df7e-94728ef0-101b383-629eed94_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4857a1a-b8758a6d-d297a746-76403ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:53.279976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4857a1a-b8758a6d-d297a746-76403ed_0] Write session: try to update token
2025-10-02T08:08:53.279991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4857a1a-b8758a6d-d297a746-76403ed_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:53.287080Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:53.287102Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:53.287110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533391460029543:6652]
2025-10-02T08:08:53.287141Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:53.287150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:53.287343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:53.287493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.287639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.287798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.287995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:53.288036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:53.292781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId: src_id|f4857a1a-b8758a6d-d297a746-76403ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:53.295052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:53.295112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.295122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.295146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:53.295165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:53.295200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.295213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.295357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.295419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.295479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.295539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.295584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.295590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.295656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.295712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.295773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.295849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.295887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.295892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.295949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.296006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.296059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.296110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.296148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.296153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.296218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.296285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.296338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.296390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.296429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.296434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.296487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.296538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.296591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.296645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.296682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.296687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.296739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.296787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.296863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.296930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.296974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.296981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.297048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.297108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.297173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.297240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.297284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.297295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.297362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.297425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.297492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.297565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.297610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.297616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.297683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.297746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.297815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.297883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.297927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.297937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.298013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.298079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.298149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.298218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.298269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.298276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.298311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:53.298385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.298408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.298414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:53.298441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:53.298457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:53.298459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:53.298461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:53.298462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:53.298799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:53.298819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:53.298826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:53.298828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:53.298830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:53.298832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:53.299382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:53.299399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:53.299403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:53.299405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:53.299407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:53.299409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:53.299882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:53.299897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:53.299901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:53.299906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:53.299908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:53.301061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:53.301078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:53.301092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392533301
2025-10-02T08:08:53.301262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:53.301278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:53.301289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:53.301297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:53.301301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:53.301304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:53.301821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:53.301841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:53.301847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:53.301851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:53.301859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:53.301862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:53.302283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:53.302299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:53.302303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:53.302307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:53.302310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:53.302312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:53.302716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:53.302730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:53.302733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:53.303667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:53.303680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:53.303685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:53.303687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:53.303693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392533303
2025-10-02T08:08:53.303964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:53.303977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:53.303981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:53.303983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:53.303985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:53.303987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:53.304367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:53.304381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:53.304384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:53.304386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:53.304388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:53.304390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:53.304852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:53.304868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.304954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392533304
2025-10-02T08:08:53.305590Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:53.305609Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:53.305615Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:53.305625Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:53.307176Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:53.307187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:53.307187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:53.307195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533391460029543:6652]
2025-10-02T08:08:53.307198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533391460029543:6652]
2025-10-02T08:08:53.307233Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:53.307240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:53.307243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.307243Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:53.307244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:53.307355Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:53.345602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533391460029595:6232]
2025-10-02T08:08:53.345699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 452, pipe: [1:7556533391460029595:6232]
2025-10-02T08:08:53.435461Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:53.435708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460029595:6232], now have 1 active actors on pipe
2025-10-02T08:08:53.435881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533391460029595:6232]
2025-10-02T08:08:53.435901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:53.435906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:53.435924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 453 reason: error at write: Disconnected sessionId: src_id|f4857a1a-b8758a6d-d297a746-76403ed_0
2025-10-02T08:08:53.435929Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:53.435984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:53.436096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 453 sessionId: src_id|f4857a1a-b8758a6d-d297a746-76403ed_0 is DEAD
2025-10-02T08:08:53.436228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4857a1a-b8758a6d-d297a746-76403ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:53.436236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4857a1a-b8758a6d-d297a746-76403ed_0] Write session will restart in 0.009212s
2025-10-02T08:08:53.436260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4857a1a-b8758a6d-d297a746-76403ed_0] Write session: Do CDS request
2025-10-02T08:08:53.436266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4857a1a-b8758a6d-d297a746-76403ed_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:53.446229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4857a1a-b8758a6d-d297a746-76403ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.446290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:53.446302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 454
2025-10-02T08:08:53.446405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.446428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:53.446434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:53.446437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:53.446832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 454 sessionId:  describe result for acl check
2025-10-02T08:08:53.446852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:53.446856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:53.446857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:53.446861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533391460030038:6661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:53.447201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533391460030038:6661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:53.449642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533391460030038:6661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:53.452034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:53.452162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533391460030038:6661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:53.452174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533391460030038:6661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:53.452176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533391460030038:6661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:53.452181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:53.453799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:53.453933Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:53.453940Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:53.453947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:53.453980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:53.454004Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533391460030206:6660]
2025-10-02T08:08:53.454389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:53.454556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:53.454580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:53.454905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:53.454945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.454949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.454950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.454951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.454951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.454954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.454960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.454962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.454964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.454966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.454970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.454974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.454978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.454980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.454982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.454985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.454987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.454990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.454992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.454995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.455005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:53.462554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:53.464029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:53.464041Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:53.464042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:53.464044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:53.464050Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 453 [1:7556533391460030206:6660]
2025-10-02T08:08:53.464057Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:53.464071Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:53.464076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.464078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.464079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.464088Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:53.464092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:53.464096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:53.464136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.464143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.464145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:53.464148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:53.464203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:53.464210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.464220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.464236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:53.464252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533391460030194:6660]
2025-10-02T08:08:53.464258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533391460030194:6660]
2025-10-02T08:08:53.464264Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:53.464271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 453
2025-10-02T08:08:53.464272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460030202:6661], now have 1 active actors on pipe
2025-10-02T08:08:53.464273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:53.464276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:53.464278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:53.464285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:53.464286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:53.464290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533391920322912:2378], now have 1 active actors on pipe
2025-10-02T08:08:53.464293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.464295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.464315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533391460030194:6660]
2025-10-02T08:08:53.464324Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:53.464334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:53.464336Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:53.464341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.464344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.464345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:53.464351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.464357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:53.464349Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 453
2025-10-02T08:08:53.464379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.464420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.464425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.464433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.464462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 454 partition: 0 MaxSeqNo: 17 sessionId: src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0
2025-10-02T08:08:53.464778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4857a1a-b8758a6d-d297a746-76403ed_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:53.467608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0] Write session: try to update token
2025-10-02T08:08:53.467622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:53.482250Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:53.482265Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:53.482266Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:53.482274Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533391460030194:6660]
2025-10-02T08:08:53.482277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533391460030194:6660]
2025-10-02T08:08:53.482306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:53.482311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.482313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:53.482321Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:53.482325Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:53.482436Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:53.483083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId: src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:53.485644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:53.536083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533391460030231:6232]
2025-10-02T08:08:53.536186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 453, pipe: [1:7556533391460030231:6232]
2025-10-02T08:08:53.607988Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:53.608314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.608323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.608352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460030231:6232], now have 1 active actors on pipe
2025-10-02T08:08:53.608461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:53.608471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:53.608499Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:53.608521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 454 reason: error at write: Disconnected sessionId: src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0
2025-10-02T08:08:53.608665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 454 sessionId: src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0 is DEAD
2025-10-02T08:08:53.608749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533391460030231:6232]
2025-10-02T08:08:53.608853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:53.608862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0] Write session will restart in 0.008430s
2025-10-02T08:08:53.608832Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:53.608879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0] Write session: Do CDS request
2025-10-02T08:08:53.608884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:53.618187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.618308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:53.618322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 455
2025-10-02T08:08:53.618451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.618483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:53.618494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:53.618497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:53.618862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 455 sessionId:  describe result for acl check
2025-10-02T08:08:53.618895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:53.618901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:53.618903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:53.618908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533391460030677:6667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:53.619275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533391460030677:6667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:53.621732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533391460030677:6667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:53.624274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533391460030677:6667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:53.624289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533391460030677:6667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:53.624292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533391460030677:6667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:53.624298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:53.625735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:53.626046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:53.626198Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:53.626209Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:53.626220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:53.626271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:53.626304Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533391460030835:6666]
2025-10-02T08:08:53.626859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:53.627018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:53.627061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:53.627399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:53.627468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.627475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.627476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.627477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.627478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.627483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.627492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.627500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.627504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.627510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.627516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.627526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.627531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.627539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.627547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.627552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.627560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.627566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.627576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.627580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.627600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:53.635054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:53.636728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:53.636742Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:53.636743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:53.636746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:53.636750Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 454 [1:7556533391460030835:6666]
2025-10-02T08:08:53.636757Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:53.636769Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:53.636770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.636772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.636773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.636782Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:53.636785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:53.636791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:53.636854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.636861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.636864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:53.636866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:53.636911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:53.636917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.636925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.636932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:53.636943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533391460030829:6666]
2025-10-02T08:08:53.636944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533391460030829:6666]
2025-10-02T08:08:53.636948Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:53.636956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:53.636962Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:53.636963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:53.636964Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:53.636965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:53.636971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460030826:6667], now have 1 active actors on pipe
2025-10-02T08:08:53.636978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 454
2025-10-02T08:08:53.636992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533391920322918:2378], now have 1 active actors on pipe
2025-10-02T08:08:53.636998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533391460030829:6666]
2025-10-02T08:08:53.637003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:53.637006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:53.637008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.637011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.637038Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:53.637045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.637047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.637048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:53.637054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.637062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:53.637073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.637110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.637121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.637148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.637054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 454
2025-10-02T08:08:53.637183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 455 partition: 0 MaxSeqNo: 17 sessionId: src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0
2025-10-02T08:08:53.637508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8c661b-64144070-fbf7b48d-c4fde2e3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:53.640333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0] Write session: try to update token
2025-10-02T08:08:53.640347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:53.653031Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:53.653048Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:53.653050Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:53.653057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533391460030829:6666]
2025-10-02T08:08:53.653061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533391460030829:6666]
2025-10-02T08:08:53.653093Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:53.653095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:53.653096Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:53.653101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.653102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:53.653235Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:53.655316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId: src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:53.658088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:53.713430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533391460030873:6232]
2025-10-02T08:08:53.713687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 454, pipe: [1:7556533391460030873:6232]
2025-10-02T08:08:53.780889Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:53.781216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.781229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.781265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460030873:6232], now have 1 active actors on pipe
2025-10-02T08:08:53.781387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533391460030873:6232]
2025-10-02T08:08:53.781417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:53.781418Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:53.781420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:53.781454Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:53.781500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 455 reason: error at write: Disconnected sessionId: src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0
2025-10-02T08:08:53.781689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 455 sessionId: src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0 is DEAD
2025-10-02T08:08:53.781847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:53.781856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0] Write session will restart in 0.009563s
2025-10-02T08:08:53.781880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0] Write session: Do CDS request
2025-10-02T08:08:53.781886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:53.792421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.792458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:53.792470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 456
2025-10-02T08:08:53.792631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.792654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:53.792659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:53.792661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:53.793089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 456 sessionId:  describe result for acl check
2025-10-02T08:08:53.793122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:53.793127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:53.793129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:53.793135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533391460031373:6685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:53.793503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533391460031373:6685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:53.796066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533391460031373:6685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:53.797078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:53.798938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:53.799066Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:53.799073Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:53.799079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:53.799110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:53.799133Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533391460031495:6684]
2025-10-02T08:08:53.799259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533391460031373:6685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:53.799270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533391460031373:6685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:53.799272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533391460031373:6685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:53.799277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:53.799555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:53.799680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:53.799705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:53.799908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:53.799940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.799944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.799945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.799946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.799946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.799949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.799956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.799958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.799960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.799962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.799965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.799969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.799975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.799978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.799980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.799986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.799989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.799992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.799994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.799997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.800007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:53.808170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:53.810345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:53.810364Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:53.810367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:53.810370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:53.810378Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 455 [1:7556533391460031495:6684]
2025-10-02T08:08:53.810392Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:53.810410Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:53.810415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.810418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.810420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.810444Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:53.810449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:53.810456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:53.810530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.810538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.810541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:53.810544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:53.810614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:53.810630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.810645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.810665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:53.810678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 455
2025-10-02T08:08:53.810704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460031500:6685], now have 1 active actors on pipe
2025-10-02T08:08:53.810717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533391460031489:6684]
2025-10-02T08:08:53.810724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533391460031489:6684]
2025-10-02T08:08:53.810738Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:53.810751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533391920322946:2378], now have 1 active actors on pipe
2025-10-02T08:08:53.810754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:53.810762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.810766Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:53.810767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.810788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:53.810808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:53.810815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:53.810800Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 455
2025-10-02T08:08:53.810861Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:53.810872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.810882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.810884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:53.810895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.810909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:53.810920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533391460031489:6684]
2025-10-02T08:08:53.810934Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:53.810957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:53.810977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.811088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.811097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.811114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:53.811160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 456 partition: 0 MaxSeqNo: 17 sessionId: src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0
2025-10-02T08:08:53.811545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ea535a-7ea66b87-e630a8ef-4486d2eb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:53.814779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0] Write session: try to update token
2025-10-02T08:08:53.814797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:53.823885Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:53.823908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:53.823918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533391460031489:6684]
2025-10-02T08:08:53.823966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:53.823967Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:53.824185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:53.824362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.824533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.824705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:53.824969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:53.825017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:53.831842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId: src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:53.834885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:53.834950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.834962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.834996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:53.835022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:53.835075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:53.835081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:53.835268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.835343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.835417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.835492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.835817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.835829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.835899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.835958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.836022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.836097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.836146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.836154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.836228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.836295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.836364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.836445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.836495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.836503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.836575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.836640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.836709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.836780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.836844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.836854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.836926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.836997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.837072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.837146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.837196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.837204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.837281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.837347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.837415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.837494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.837557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.837560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.837632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.837696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.837767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.837837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.837981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.837985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.838056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.838117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.838177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.838237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.838277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.838279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.838342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.838394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.838466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.838525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.838578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.838591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.838654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:53.838716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:53.838784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:53.838852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:53.838907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:53.838914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:53.838950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:53.839000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:53.839017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:53.839022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:53.839047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:53.839064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:53.839071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:53.839074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:53.839076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:53.839515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:53.839539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:53.839545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:53.839548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:53.839550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:53.839553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:53.840241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:53.840266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:53.840274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:53.840277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:53.840281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:53.840284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:53.840871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:53.840890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:53.840897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:53.840900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:53.840902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:53.842130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:53.842147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:53.842159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392533841
2025-10-02T08:08:53.842264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:53.842276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:53.842280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:53.842283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:53.842286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:53.842288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:53.842737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:53.842760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:53.842763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:53.842766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:53.842768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:53.842770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:53.843242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:53.843263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:53.843270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:53.843272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:53.843275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:53.843277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:53.843778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:53.843819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:53.843825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:53.845147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:53.845171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:53.845180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:53.845184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:53.845193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392533844
2025-10-02T08:08:53.845540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:53.845563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:53.845569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:53.845575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:53.845578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:53.845584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:53.846118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:53.846143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:53.846149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:53.846152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:53.846155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:53.846159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:53.846712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:53.846736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:53.846877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392533846
2025-10-02T08:08:53.847754Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:53.847780Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:53.847802Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:53.847810Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:53.849730Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:53.849747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:53.849750Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:53.849761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533391460031489:6684]
2025-10-02T08:08:53.849766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533391460031489:6684]
2025-10-02T08:08:53.849818Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:53.849833Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:53.849835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:53.849840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.849843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:53.849994Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:53.881655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533391460031536:6232]
2025-10-02T08:08:53.881745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 455, pipe: [1:7556533391460031536:6232]
2025-10-02T08:08:53.980157Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:53.980413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460031536:6232], now have 1 active actors on pipe
2025-10-02T08:08:53.980511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:53.980520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:53.980544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 456 reason: error at write: Disconnected sessionId: src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0
2025-10-02T08:08:53.980620Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:53.980640Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:53.980762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 456 sessionId: src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0 is DEAD
2025-10-02T08:08:53.980945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:53.980957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0] Write session will restart in 0.005261s
2025-10-02T08:08:53.980946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533391460031536:6232]
2025-10-02T08:08:53.980982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0] Write session: Do CDS request
2025-10-02T08:08:53.980990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:53.987243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.987361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:53.987376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 457
2025-10-02T08:08:53.987532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:53.987559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:53.987568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:53.987571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:53.987942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 457 sessionId:  describe result for acl check
2025-10-02T08:08:53.987982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:53.987990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:53.987992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:53.987997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533391460031906:6692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:53.988443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533391460031906:6692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:53.991020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533391460031906:6692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:53.993636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533391460031906:6692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:53.993648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533391460031906:6692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:53.993650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533391460031906:6692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:53.993655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:53.994744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:53.996274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:53.996395Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:53.996404Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:53.996410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:53.996438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:53.996464Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533391460032144:6691]
2025-10-02T08:08:53.996858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:53.996996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:53.997023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:53.997211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:53.997240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.997246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.997246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.997247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.997248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.997250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.997257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.997259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.997261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.997263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.997266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.997270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:53.997273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.997276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:53.997278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.997281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:53.997283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.997286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:53.997288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.997291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:53.997301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:54.004859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:54.006292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:54.006306Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:54.006308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:54.006311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:54.006316Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 456 [1:7556533391460032144:6691]
2025-10-02T08:08:54.006325Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:54.006339Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:54.006341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.006343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.006344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.006356Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:54.006359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:54.006364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:54.006408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.006415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.006417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:54.006419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:54.006469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:54.006476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.006484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.006491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:54.006503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533391460032123:6692], now have 1 active actors on pipe
2025-10-02T08:08:54.006511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 456
2025-10-02T08:08:54.006513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533391460032138:6691]
2025-10-02T08:08:54.006514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533391460032138:6691]
2025-10-02T08:08:54.006519Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:54.006524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533391920322955:2378], now have 1 active actors on pipe
2025-10-02T08:08:54.006527Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:54.006529Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:54.006530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:54.006537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:54.006539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:54.006545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.006548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.006585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533391460032138:6691]
2025-10-02T08:08:54.006597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:54.006604Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:54.006611Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a90fa28-d1c28579-6fafe34-96476883_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:54.006617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.006620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.006622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:54.006630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.006638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:54.006618Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 456
2025-10-02T08:08:54.006671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.006710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.006716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.006727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.006754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 457 partition: 0 MaxSeqNo: 17 sessionId: src_id|9a90fa28-d1c28579-6fafe34-96476883_0
2025-10-02T08:08:54.007055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb84b68-79dea6cb-d02006aa-acc20e31_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9a90fa28-d1c28579-6fafe34-96476883_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:54.009854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a90fa28-d1c28579-6fafe34-96476883_0] Write session: try to update token
2025-10-02T08:08:54.009868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a90fa28-d1c28579-6fafe34-96476883_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:54.023006Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:54.023021Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:54.023023Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:54.023029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533391460032138:6691]
2025-10-02T08:08:54.023032Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533391460032138:6691]
2025-10-02T08:08:54.023064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:54.023064Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:54.023070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:54.023070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.023071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:54.023314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId: src_id|9a90fa28-d1c28579-6fafe34-96476883_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:54.023496Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:54.025867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:54.081340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533395754999466:6232]
2025-10-02T08:08:54.081408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 456, pipe: [1:7556533395754999466:6232]
2025-10-02T08:08:54.155815Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:54.156233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.156249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.156293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395754999466:6232], now have 1 active actors on pipe
2025-10-02T08:08:54.156399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533395754999466:6232]
2025-10-02T08:08:54.156432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:54.156437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:54.156460Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:54.156482Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:54.156485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 457 reason: error at write: Disconnected sessionId: src_id|9a90fa28-d1c28579-6fafe34-96476883_0
2025-10-02T08:08:54.156627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 457 sessionId: src_id|9a90fa28-d1c28579-6fafe34-96476883_0 is DEAD
2025-10-02T08:08:54.156764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a90fa28-d1c28579-6fafe34-96476883_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:54.156773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a90fa28-d1c28579-6fafe34-96476883_0] Write session will restart in 0.009225s
2025-10-02T08:08:54.156793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a90fa28-d1c28579-6fafe34-96476883_0] Write session: Do CDS request
2025-10-02T08:08:54.156798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a90fa28-d1c28579-6fafe34-96476883_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:54.167202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a90fa28-d1c28579-6fafe34-96476883_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.167270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:54.167284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 458
2025-10-02T08:08:54.167556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.167590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:54.167599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:54.167603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:54.168019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 458 sessionId:  describe result for acl check
2025-10-02T08:08:54.168057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:54.168066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:54.168068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:54.168073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533395754999997:6698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:54.168569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533395754999997:6698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:54.170065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:54.170626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533395754999997:6698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:54.171968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:54.172112Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:54.172122Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:54.172129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:54.172160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:54.172190Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533395755000069:6697]
2025-10-02T08:08:54.172561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533395754999997:6698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:54.172572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533395754999997:6698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:54.172575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533395754999997:6698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:54.172578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:54.172583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:54.172757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:54.172821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:54.173110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:54.173145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.173150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.173151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.173152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.173153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.173158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.173167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.173174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.173178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.173185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.173190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.173201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.173207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.173210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.173212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.173215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.173218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.173224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.173226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.173229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.173239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:54.180407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:54.182060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:54.182074Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:54.182076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:54.182078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:54.182082Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 457 [1:7556533395755000069:6697]
2025-10-02T08:08:54.182089Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:54.182101Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:54.182104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.182105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.182107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.182117Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:54.182124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:54.182129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:54.182169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.182174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.182177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:54.182178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:54.182223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:54.182228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.182235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.182242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:54.182252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533395755000053:6697]
2025-10-02T08:08:54.182257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533395755000053:6697]
2025-10-02T08:08:54.182262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:54.182272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755000076:6698], now have 1 active actors on pipe
2025-10-02T08:08:54.182273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:54.182276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:54.182282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533396215290258:2378], now have 1 active actors on pipe
2025-10-02T08:08:54.182287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:54.182297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:54.182303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:54.182332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.182339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.182352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533395755000053:6697]
2025-10-02T08:08:54.182360Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:54.182342Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 457
2025-10-02T08:08:54.182366Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:54.182379Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|586cd964-101b641e-560ef76b-8874c21f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:54.182389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.182395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 457
2025-10-02T08:08:54.182396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.182398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:54.182406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.182416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:54.182438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.182492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.182497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.182506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.182535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 458 partition: 0 MaxSeqNo: 17 sessionId: src_id|586cd964-101b641e-560ef76b-8874c21f_0
2025-10-02T08:08:54.182859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a90fa28-d1c28579-6fafe34-96476883_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|586cd964-101b641e-560ef76b-8874c21f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:54.185591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586cd964-101b641e-560ef76b-8874c21f_0] Write session: try to update token
2025-10-02T08:08:54.185604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586cd964-101b641e-560ef76b-8874c21f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:54.198432Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:54.198449Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:54.198451Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:54.198458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533395755000053:6697]
2025-10-02T08:08:54.198461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533395755000053:6697]
2025-10-02T08:08:54.198496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:54.198499Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:54.198503Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:54.198504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.198505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:54.198633Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:54.199544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId: src_id|586cd964-101b641e-560ef76b-8874c21f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:54.202280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:54.256455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533395755000101:6232]
2025-10-02T08:08:54.256538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 457, pipe: [1:7556533395755000101:6232]
2025-10-02T08:08:54.322230Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:54.322616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.322626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.322657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755000101:6232], now have 1 active actors on pipe
2025-10-02T08:08:54.322755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:54.322768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:54.322789Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:54.322829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 458 reason: error at write: Disconnected sessionId: src_id|586cd964-101b641e-560ef76b-8874c21f_0
2025-10-02T08:08:54.322844Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:54.322994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533395755000101:6232]
2025-10-02T08:08:54.322994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 458 sessionId: src_id|586cd964-101b641e-560ef76b-8874c21f_0 is DEAD
2025-10-02T08:08:54.323157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586cd964-101b641e-560ef76b-8874c21f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:54.323169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586cd964-101b641e-560ef76b-8874c21f_0] Write session will restart in 0.009659s
2025-10-02T08:08:54.323191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586cd964-101b641e-560ef76b-8874c21f_0] Write session: Do CDS request
2025-10-02T08:08:54.323196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586cd964-101b641e-560ef76b-8874c21f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:54.334254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586cd964-101b641e-560ef76b-8874c21f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.334245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:54.334261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 459
2025-10-02T08:08:54.334483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.334518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:54.334528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:54.334535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:54.335015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 459 sessionId:  describe result for acl check
2025-10-02T08:08:54.335039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:54.335044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:54.335045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:54.335049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533395755000594:6705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:54.335403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533395755000594:6705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:54.337925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533395755000594:6705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:54.338851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:54.340531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:54.340658Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:54.340667Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:54.340675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:54.340712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:54.340737Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533395755000717:6704]
2025-10-02T08:08:54.340918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533395755000594:6705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:54.340932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533395755000594:6705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:54.340935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533395755000594:6705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:54.340942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:54.341330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:54.341497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:54.341542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:54.341837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:54.341875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.341881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.341882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.341883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.341884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.341888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.341896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.341900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.341908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.341912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.341920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.341930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.341941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.341946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.341949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.341954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.341963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.341972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.341980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.341988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.342004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:54.349471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:54.350973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:54.350993Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:54.350995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:54.350999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:54.351005Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 458 [1:7556533395755000717:6704]
2025-10-02T08:08:54.351015Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:54.351035Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:54.351042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.351044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.351046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.351062Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:54.351082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:54.351087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:54.351146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.351152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.351155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:54.351156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:54.351215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:54.351221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.351232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.351242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:54.351257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755000722:6705], now have 1 active actors on pipe
2025-10-02T08:08:54.351260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533396215290276:2378], now have 1 active actors on pipe
2025-10-02T08:08:54.351269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533395755000711:6704]
2025-10-02T08:08:54.351269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 458
2025-10-02T08:08:54.351277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533395755000711:6704]
2025-10-02T08:08:54.351288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:54.351303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:54.351306Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:54.351309Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:54.351321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:54.351330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:54.351336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.351339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.351337Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 458
2025-10-02T08:08:54.351372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533395755000711:6704]
2025-10-02T08:08:54.351380Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:54.351381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:54.351392Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:54.351404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.351412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.351417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:54.351426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.351437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:54.351475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.351514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.351520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.351535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.351568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 459 partition: 0 MaxSeqNo: 17 sessionId: src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0
2025-10-02T08:08:54.351905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586cd964-101b641e-560ef76b-8874c21f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:54.354527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0] Write session: try to update token
2025-10-02T08:08:54.354539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:54.367609Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:54.367626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:54.367628Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:54.367635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533395755000711:6704]
2025-10-02T08:08:54.367638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533395755000711:6704]
2025-10-02T08:08:54.367670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:54.367669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:54.367673Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:54.367680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.367682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:54.367821Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:54.368446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId: src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:54.371111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:54.423367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533395755000757:6232]
2025-10-02T08:08:54.423460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 458, pipe: [1:7556533395755000757:6232]
2025-10-02T08:08:54.491497Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:54.491899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.491909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.491938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755000757:6232], now have 1 active actors on pipe
2025-10-02T08:08:54.492028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533395755000757:6232]
2025-10-02T08:08:54.492048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:54.492052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:54.492104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 459 reason: error at write: Disconnected sessionId: src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0
2025-10-02T08:08:54.492116Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:54.492218Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:54.492242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 459 sessionId: src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0 is DEAD
2025-10-02T08:08:54.492386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:54.492393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0] Write session will restart in 0.005128s
2025-10-02T08:08:54.492411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0] Write session: Do CDS request
2025-10-02T08:08:54.492416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:54.498304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.498410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:54.498423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 460
2025-10-02T08:08:54.498534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.498570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:54.498579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:54.498582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:54.498895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 460 sessionId:  describe result for acl check
2025-10-02T08:08:54.498921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:54.498927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:54.498928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:54.498933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533395755001099:6714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:54.499302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533395755001099:6714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:54.502211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533395755001099:6714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:54.505275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533395755001099:6714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:54.505293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533395755001099:6714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:54.505296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533395755001099:6714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:54.505304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:54.508928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:54.509316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:54.509440Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:54.509449Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:54.509455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:54.509484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:54.509518Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533395755001372:6713]
2025-10-02T08:08:54.510183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:54.510335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:54.510362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:54.510654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:54.510682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.510683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.510684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.510684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.510685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.510688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.510695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.510697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.510699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.510702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.510705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.510709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.510713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.510716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.510718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.510721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.510723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.510730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.510733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.510735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.510747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:54.518493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:54.520175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:54.520192Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:54.520194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:54.520198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:54.520207Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 459 [1:7556533395755001372:6713]
2025-10-02T08:08:54.520219Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:54.520235Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:54.520243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.520246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.520248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.520263Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:54.520274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:54.520280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:54.520333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.520340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.520343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:54.520345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:54.520408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:54.520415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.520428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.520444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:54.520460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 459
2025-10-02T08:08:54.520467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755001338:6714], now have 1 active actors on pipe
2025-10-02T08:08:54.520470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533396215290285:2378], now have 1 active actors on pipe
2025-10-02T08:08:54.520475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533395755001366:6713]
2025-10-02T08:08:54.520477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533395755001366:6713]
2025-10-02T08:08:54.520491Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:54.520504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.520512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.520513Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:54.520516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:54.520529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:54.520547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:54.520554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:54.520557Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 459
2025-10-02T08:08:54.520591Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:54.520602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.520607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.520613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:54.520620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.520632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:54.520643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533395755001366:6713]
2025-10-02T08:08:54.520650Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:54.520655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:54.520676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.520726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.520732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.520744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.520773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 460 partition: 0 MaxSeqNo: 17 sessionId: src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0
2025-10-02T08:08:54.521123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa91c60-50b34bf6-60eac37b-f6b29286_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:54.523902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0] Write session: try to update token
2025-10-02T08:08:54.523916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:54.536787Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:54.536822Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:54.536824Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:54.536833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533395755001366:6713]
2025-10-02T08:08:54.536837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533395755001366:6713]
2025-10-02T08:08:54.536870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:54.536878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:54.536880Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:54.536884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.536886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:54.537038Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:54.537295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId: src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:54.539846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:54.592327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533395755001398:6232]
2025-10-02T08:08:54.592436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 459, pipe: [1:7556533395755001398:6232]
2025-10-02T08:08:54.671298Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:54.671804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.671817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.671856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755001398:6232], now have 1 active actors on pipe
2025-10-02T08:08:54.671915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:54.671922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:54.671967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 460 reason: error at write: Disconnected sessionId: src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0
2025-10-02T08:08:54.672010Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:54.672040Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:54.672130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 460 sessionId: src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0 is DEAD
2025-10-02T08:08:54.672282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:54.672290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0] Write session will restart in 0.005185s
2025-10-02T08:08:54.672282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533395755001398:6232]
2025-10-02T08:08:54.672306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0] Write session: Do CDS request
2025-10-02T08:08:54.672311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:54.678225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.678257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:54.678272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 461
2025-10-02T08:08:54.678403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.678434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:54.678441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:54.678445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:54.678783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 461 sessionId:  describe result for acl check
2025-10-02T08:08:54.678816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:54.678822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:54.678823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:54.678829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533395755001749:6720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:54.679301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533395755001749:6720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:54.681324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533395755001749:6720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:54.684295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533395755001749:6720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:54.684308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533395755001749:6720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:54.684310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533395755001749:6720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:54.684315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:54.685851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:54.687409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:54.687517Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:54.687523Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:54.687529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:54.687554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:54.687579Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533395755002013:6719]
2025-10-02T08:08:54.687996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:54.688320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:54.688358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:54.688551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:54.688576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.688581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.688581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.688582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.688583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.688586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.688592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.688594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.688596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.688598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.688601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.688609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.688612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.688614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.688618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.688620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.688622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.688625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.688627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.688630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.688639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:54.695663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:54.697330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:54.697342Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:54.697343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:54.697346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:54.697351Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 460 [1:7556533395755002013:6719]
2025-10-02T08:08:54.697358Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:54.697370Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:54.697375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.697378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.697379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.697391Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:54.697394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:54.697400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:54.697441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.697446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.697449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:54.697450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:54.697501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:54.697507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.697513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.697520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:54.697532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533395755002007:6719]
2025-10-02T08:08:54.697537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533395755002007:6719]
2025-10-02T08:08:54.697542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:54.697555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:54.697559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:54.697562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:54.697565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:54.697567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:54.697589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533396215290292:2378], now have 1 active actors on pipe
2025-10-02T08:08:54.697595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533395755002007:6719]
2025-10-02T08:08:54.697597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:54.697599Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:54.697602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755001981:6720], now have 1 active actors on pipe
2025-10-02T08:08:54.697632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 460
2025-10-02T08:08:54.697634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.697637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.697656Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a1a9523-41229a21-404206da-ae31aaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:54.697666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.697672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.697674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:54.697682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.697694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:54.697669Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 460
2025-10-02T08:08:54.697712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.697741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.697746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.697755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.697788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 461 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a1a9523-41229a21-404206da-ae31aaf_0
2025-10-02T08:08:54.698094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c62a38f-82d2634d-707c48d1-250f6a0a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a1a9523-41229a21-404206da-ae31aaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:54.700935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a9523-41229a21-404206da-ae31aaf_0] Write session: try to update token
2025-10-02T08:08:54.700948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a9523-41229a21-404206da-ae31aaf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:54.713575Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:54.713594Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:54.713597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:54.713605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533395755002007:6719]
2025-10-02T08:08:54.713608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533395755002007:6719]
2025-10-02T08:08:54.713648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:54.713650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:54.713653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.713655Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:54.713655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:54.713807Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:54.715038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId: src_id|2a1a9523-41229a21-404206da-ae31aaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:54.717515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:54.772540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533395755002068:6232]
2025-10-02T08:08:54.772632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 460, pipe: [1:7556533395755002068:6232]
2025-10-02T08:08:54.843195Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:54.843675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.843686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.843716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755002068:6232], now have 1 active actors on pipe
2025-10-02T08:08:54.843863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533395755002068:6232]
2025-10-02T08:08:54.843902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:54.843906Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:54.843912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:54.843937Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:54.843988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 461 reason: error at write: Disconnected sessionId: src_id|2a1a9523-41229a21-404206da-ae31aaf_0
2025-10-02T08:08:54.844235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 461 sessionId: src_id|2a1a9523-41229a21-404206da-ae31aaf_0 is DEAD
2025-10-02T08:08:54.844378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a9523-41229a21-404206da-ae31aaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:54.844387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a9523-41229a21-404206da-ae31aaf_0] Write session will restart in 0.008504s
2025-10-02T08:08:54.844412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a9523-41229a21-404206da-ae31aaf_0] Write session: Do CDS request
2025-10-02T08:08:54.844418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a9523-41229a21-404206da-ae31aaf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:54.854312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a9523-41229a21-404206da-ae31aaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.854364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:54.854379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 462
2025-10-02T08:08:54.854537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:54.854566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:54.854574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:54.854577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:54.855011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 462 sessionId:  describe result for acl check
2025-10-02T08:08:54.855066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:54.855075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:54.855076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:54.855081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533395755002568:6739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:54.855540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533395755002568:6739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:54.857926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533395755002568:6739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:54.858611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:54.860496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:54.860634Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:54.860641Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:54.860648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:54.860679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:54.860704Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533395755002702:6738]
2025-10-02T08:08:54.860929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533395755002568:6739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:54.860940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533395755002568:6739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:54.860942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533395755002568:6739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:54.860949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:54.861109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:54.861232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:54.861266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:54.861456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:54.861483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.861489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.861490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.861491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.861491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.861494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.861500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.861502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.861504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.861506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.861509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.861513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:54.861516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.861519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:54.861522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.861527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:54.861531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.861535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.861539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.861543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.861555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:54.869004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:54.870808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:54.870823Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:54.870825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:54.870828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:54.870832Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 461 [1:7556533395755002702:6738]
2025-10-02T08:08:54.870843Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:54.870858Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:54.870867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.870869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.870871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.870884Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:54.870887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:54.870893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:54.870933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.870939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.870941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:54.870942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:54.871001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:54.871008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.871019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:54.871031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:54.871047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755002707:6739], now have 1 active actors on pipe
2025-10-02T08:08:54.871052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 461
2025-10-02T08:08:54.871053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533396215290322:2378], now have 1 active actors on pipe
2025-10-02T08:08:54.871057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533395755002692:6738]
2025-10-02T08:08:54.871059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533395755002692:6738]
2025-10-02T08:08:54.871068Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:54.871077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.871081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.871081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:54.871084Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:54.871094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:54.871105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:54.871109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:54.871142Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:54.871152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:54.871124Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 461
2025-10-02T08:08:54.871158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:54.871159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:54.871166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:54.871174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:54.871180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533395755002692:6738]
2025-10-02T08:08:54.871190Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:54.871199Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:54.871217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.871258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:54.871262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:54.871271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:54.871300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 462 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0
2025-10-02T08:08:54.871601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a9523-41229a21-404206da-ae31aaf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:54.874341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0] Write session: try to update token
2025-10-02T08:08:54.874355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:54.887343Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:54.887362Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:54.887364Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:54.887372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533395755002692:6738]
2025-10-02T08:08:54.887379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533395755002692:6738]
2025-10-02T08:08:54.887413Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:54.887418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:54.887423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:54.887424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:54.887426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:54.887562Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:54.887967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId: src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:54.890640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:54.944066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533395755002733:6232]
2025-10-02T08:08:54.944158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 461, pipe: [1:7556533395755002733:6232]
2025-10-02T08:08:55.013249Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:55.013452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.013464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.013495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533395755002733:6232], now have 1 active actors on pipe
2025-10-02T08:08:55.013571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:55.013577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:55.013621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 462 reason: error at write: Disconnected sessionId: src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0
2025-10-02T08:08:55.013696Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:55.013724Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:55.013763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 462 sessionId: src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0 is DEAD
2025-10-02T08:08:55.013900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:55.013911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0] Write session will restart in 0.007966s
2025-10-02T08:08:55.013888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533395755002733:6232]
2025-10-02T08:08:55.013933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0] Write session: Do CDS request
2025-10-02T08:08:55.013938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:55.023347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.023440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:55.023454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 463
2025-10-02T08:08:55.023567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.023589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:55.023593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:55.023596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:55.023970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 463 sessionId:  describe result for acl check
2025-10-02T08:08:55.024012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:55.024019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:55.024020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:55.024025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533400049970483:6745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:55.024526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533400049970483:6745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:55.027333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533400049970483:6745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:55.029926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533400049970483:6745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:55.029941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533400049970483:6745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:55.029944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533400049970483:6745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:55.029951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:55.031577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:55.031825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:55.031936Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:55.031944Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:55.031949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:55.031980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:55.032005Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533400049970650:6744]
2025-10-02T08:08:55.032388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:55.032508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:55.032531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:55.032717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:55.032744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.032748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.032749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.032749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.032750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.032752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.032758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.032760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.032762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.032764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.032767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.032771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.032775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.032777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.032779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.032782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.032784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.032787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.032789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.032791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.032816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:55.040274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:55.041829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:55.041846Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:55.041848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:55.041852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:55.041857Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 462 [1:7556533400049970650:6744]
2025-10-02T08:08:55.041867Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:55.041882Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:55.041887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.041889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.041890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.041900Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:55.041903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:55.041908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:55.041950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.041956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.041958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:55.041960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:55.042004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:55.042012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.042020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.042026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:55.042038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049970641:6745], now have 1 active actors on pipe
2025-10-02T08:08:55.042047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533400049970644:6744]
2025-10-02T08:08:55.042048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533400049970644:6744]
2025-10-02T08:08:55.042054Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:55.042057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 462
2025-10-02T08:08:55.042064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:55.042066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:55.042073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:55.042073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:55.042074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:55.042078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533400510257625:2378], now have 1 active actors on pipe
2025-10-02T08:08:55.042081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.042083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.042113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533400049970644:6744]
2025-10-02T08:08:55.042124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:55.042138Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:55.042145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.042147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.042148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:55.042153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:55.042155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.042161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:55.042145Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 462
2025-10-02T08:08:55.042202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.042251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.042255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.042265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.042307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 463 partition: 0 MaxSeqNo: 17 sessionId: src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0
2025-10-02T08:08:55.042727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4531ad0-8d0e5a97-36c46bf5-d3130bc9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:55.045500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0] Write session: try to update token
2025-10-02T08:08:55.045513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:55.052182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:55.052205Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:55.052215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533400049970644:6744]
2025-10-02T08:08:55.052242Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:55.052254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:55.052418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:55.052558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:55.052690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:55.052842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:55.053039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:55.053078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:55.059909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId: src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:55.062331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:55.062387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.062399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.062434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:55.062457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:55.062494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.062508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.062646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.062702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.062761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.062821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.063247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.063256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.063307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.063359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.063416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.063474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.063515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.063520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.063574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.063624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.063673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.063728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.063765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.063770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.063835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.063887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.063940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.063993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.064033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.064041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.064107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.064161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.064214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.064267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.064340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.064346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.064401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.064452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.064500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.064557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.064597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.064602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.064656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.064708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.064775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.064860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.064906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.064911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.064964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.065018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.065074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.065135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.065188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.065193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.065246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.065296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.065350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.065404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.065443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.065447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.065499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:55.065552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:55.065609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:55.065669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:55.065707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:55.065712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:55.065737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:55.065782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.065796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.065801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:55.065824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:55.065836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:55.065840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:55.065842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:55.065844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:55.066175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:55.066198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:55.066206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:55.066213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:55.066215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:55.066216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:55.066602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:55.066617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:55.066620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:55.066622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:55.066625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:55.066627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:55.067143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:55.067160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:55.067167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:55.067170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:55.067175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:55.068273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:55.068289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:55.068297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392535067
2025-10-02T08:08:55.068439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:55.068448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:55.068451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:55.068453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:55.068456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:55.068457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:55.068915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:55.068928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:55.068934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:55.068937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:55.068938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:55.068940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:55.069372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:55.069388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:55.069394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:55.069398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:55.069400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:55.069402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:55.069799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:55.069813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:55.069816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:55.070806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:55.070820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:55.070823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:55.070825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:55.070829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392535070
2025-10-02T08:08:55.071088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:55.071101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:55.071104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:55.071106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:55.071109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:55.071110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:55.071513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:55.071531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:55.071534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:55.071536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:55.071538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:55.071541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:55.071964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:55.071979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.072044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392535072
2025-10-02T08:08:55.072717Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:55.072734Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:55.072741Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:55.072744Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:55.074349Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:55.074358Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:55.074360Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:55.074367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533400049970644:6744]
2025-10-02T08:08:55.074370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533400049970644:6744]
2025-10-02T08:08:55.074412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:55.074418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.074420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:55.074419Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:55.074424Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:55.074548Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:55.114037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533400049970686:6232]
2025-10-02T08:08:55.114123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 462, pipe: [1:7556533400049970686:6232]
2025-10-02T08:08:55.198508Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:55.198862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049970686:6232], now have 1 active actors on pipe
2025-10-02T08:08:55.198959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533400049970686:6232]
2025-10-02T08:08:55.198977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:55.198983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:55.199002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 463 reason: error at write: Disconnected sessionId: src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0
2025-10-02T08:08:55.199021Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:55.199061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:55.199176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 463 sessionId: src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0 is DEAD
2025-10-02T08:08:55.199323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:55.199330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0] Write session will restart in 0.007362s
2025-10-02T08:08:55.199348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0] Write session: Do CDS request
2025-10-02T08:08:55.199353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:55.208247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.208307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:55.208323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 464
2025-10-02T08:08:55.208422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.208451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:55.208460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:55.208463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:55.208841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 464 sessionId:  describe result for acl check
2025-10-02T08:08:55.208872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:55.208878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:55.208879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:55.208883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533400049971291:6751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:55.209328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533400049971291:6751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:55.211409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533400049971291:6751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:55.212663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:55.213087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:55.213268Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:55.213276Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:55.213283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:55.213317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:55.213344Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533400049971453:6750]
2025-10-02T08:08:55.213751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:55.213994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:55.214080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:55.214159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533400049971291:6751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:55.214168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533400049971291:6751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:55.214169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533400049971291:6751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:55.214175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:55.214498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:55.214686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.214705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.214706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.214707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.214708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.214717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.214729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.214734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.214737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.214741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.214759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.214775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.214787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.214798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.214803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.214816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.214828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.214840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.214849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.214862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.214891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:55.222184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:55.223761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:55.223787Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:55.223789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:55.223792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:55.223797Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 463 [1:7556533400049971453:6750]
2025-10-02T08:08:55.223805Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:55.223818Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:55.223820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.223822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.223823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.223833Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:55.223836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:55.223841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:55.223885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.223891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.223893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:55.223895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:55.223939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:55.223944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.223952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.223958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:55.223974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 463
2025-10-02T08:08:55.223975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049971464:6751], now have 1 active actors on pipe
2025-10-02T08:08:55.223979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533400049971447:6750]
2025-10-02T08:08:55.223981Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533400049971447:6750]
2025-10-02T08:08:55.223987Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:55.223993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.223995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:55.223996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.223998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:55.224009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:55.224020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:55.224026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:55.224029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533400510257632:2378], now have 1 active actors on pipe
2025-10-02T08:08:55.224058Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4757122-456413ee-4e049a35-9cf64ea8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:55.224066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.224068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.224070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:55.224076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.224082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:55.224090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533400049971447:6750]
2025-10-02T08:08:55.224092Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:55.224099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:55.224107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.224081Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 463
2025-10-02T08:08:55.224164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.224171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.224181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.224210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 464 partition: 0 MaxSeqNo: 17 sessionId: src_id|d4757122-456413ee-4e049a35-9cf64ea8_0
2025-10-02T08:08:55.224506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe296f8-c4adc277-9b41146b-bf9d5036_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d4757122-456413ee-4e049a35-9cf64ea8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:55.227204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4757122-456413ee-4e049a35-9cf64ea8_0] Write session: try to update token
2025-10-02T08:08:55.227218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4757122-456413ee-4e049a35-9cf64ea8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:55.240107Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:55.240123Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:55.240125Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:55.240132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533400049971447:6750]
2025-10-02T08:08:55.240137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533400049971447:6750]
2025-10-02T08:08:55.240169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:55.240179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:55.240181Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:55.240184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.240186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:55.240339Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:55.243889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId: src_id|d4757122-456413ee-4e049a35-9cf64ea8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:55.246534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:55.298873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533400049971484:6232]
2025-10-02T08:08:55.298989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 463, pipe: [1:7556533400049971484:6232]
2025-10-02T08:08:55.364597Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:55.364939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.364951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.364980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049971484:6232], now have 1 active actors on pipe
2025-10-02T08:08:55.365078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:55.365090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:55.365144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 464 reason: error at write: Disconnected sessionId: src_id|d4757122-456413ee-4e049a35-9cf64ea8_0
2025-10-02T08:08:55.365160Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:55.365300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 464 sessionId: src_id|d4757122-456413ee-4e049a35-9cf64ea8_0 is DEAD
2025-10-02T08:08:55.365412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4757122-456413ee-4e049a35-9cf64ea8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:55.365426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4757122-456413ee-4e049a35-9cf64ea8_0] Write session will restart in 0.006991s
2025-10-02T08:08:55.365444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4757122-456413ee-4e049a35-9cf64ea8_0] Write session: Do CDS request
2025-10-02T08:08:55.365448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4757122-456413ee-4e049a35-9cf64ea8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:55.365453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533400049971484:6232]
2025-10-02T08:08:55.365842Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:55.373292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4757122-456413ee-4e049a35-9cf64ea8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.373351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:55.373365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 465
2025-10-02T08:08:55.373455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.373480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:55.373488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:55.373492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:55.373832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 465 sessionId:  describe result for acl check
2025-10-02T08:08:55.373862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:55.373868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:55.373869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:55.373873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533400049972008:6758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:55.374344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533400049972008:6758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:55.376325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533400049972008:6758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:55.379131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533400049972008:6758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:55.379144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533400049972008:6758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:55.379148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533400049972008:6758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:55.379155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:55.379423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:55.379690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:55.379848Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:55.379857Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:55.379867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:55.379912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:55.379944Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533400049972270:6757]
2025-10-02T08:08:55.380508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:55.380678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:55.380708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:55.380913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:55.380940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.380945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.380946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.380946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.380947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.380950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.380956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.380958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.380960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.380962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.380965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.380970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.380974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.380976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.380980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.380982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.380984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.380987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.380993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.380995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.381005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:55.388220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:55.389722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:55.389734Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:55.389735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:55.389737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:55.389742Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 464 [1:7556533400049972270:6757]
2025-10-02T08:08:55.389748Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:55.389759Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:55.389761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.389763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.389764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.389774Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:55.389777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:55.389782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:55.389820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.389825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.389828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:55.389829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:55.389871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:55.389877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.389884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.389890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:55.389904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533400049972264:6757]
2025-10-02T08:08:55.389908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533400049972264:6757]
2025-10-02T08:08:55.389914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:55.389925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:55.389925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:55.389929Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:55.389935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:55.389937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:55.389951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533400049972264:6757]
2025-10-02T08:08:55.389956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:55.389977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533400510257650:2378], now have 1 active actors on pipe
2025-10-02T08:08:55.389990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:55.389998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 464
2025-10-02T08:08:55.390010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049972261:6758], now have 1 active actors on pipe
2025-10-02T08:08:55.390048Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 464
2025-10-02T08:08:55.390081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.390090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.390109Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:55.390117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.390119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.390121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:55.390128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.390141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:55.390163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.390186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.390190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.390198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.390227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 465 partition: 0 MaxSeqNo: 17 sessionId: src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0
2025-10-02T08:08:55.390514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4757122-456413ee-4e049a35-9cf64ea8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:55.393294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0] Write session: try to update token
2025-10-02T08:08:55.393307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:55.407015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId: src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:55.407044Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:55.407047Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:55.407049Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:55.407060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533400049972264:6757]
2025-10-02T08:08:55.407063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533400049972264:6757]
2025-10-02T08:08:55.407111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:55.407125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.407127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:55.407126Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:55.407132Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:55.407271Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:55.409768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:55.465831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533400049972300:6232]
2025-10-02T08:08:55.465922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 464, pipe: [1:7556533400049972300:6232]
2025-10-02T08:08:55.536837Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:55.537414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.537429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.537465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049972300:6232], now have 1 active actors on pipe
2025-10-02T08:08:55.537584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533400049972300:6232]
2025-10-02T08:08:55.537609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:55.537616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:55.537670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 465 reason: error at write: Disconnected sessionId: src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0
2025-10-02T08:08:55.537676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:55.537827Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:55.537842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 465 sessionId: src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0 is DEAD
2025-10-02T08:08:55.538029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:55.538039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0] Write session will restart in 0.005335s
2025-10-02T08:08:55.538065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0] Write session: Do CDS request
2025-10-02T08:08:55.538071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:55.544233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.544307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:55.544324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 466
2025-10-02T08:08:55.544444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.544472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:55.544479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:55.544482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:55.544991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 466 sessionId:  describe result for acl check
2025-10-02T08:08:55.545030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:55.545035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:55.545036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:55.545040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533400049972692:6765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:55.545427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533400049972692:6765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:55.547581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533400049972692:6765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:55.550064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533400049972692:6765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:55.550079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533400049972692:6765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:55.550082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533400049972692:6765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:55.550089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:55.552983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:55.553362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:55.553499Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:55.553507Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:55.553514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:55.553544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:55.553571Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533400049973074:6764]
2025-10-02T08:08:55.554025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:55.554186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:55.554212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:55.554423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:55.554464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.554470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.554470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.554471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.554472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.554475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.554484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.554488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.554491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.554494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.554500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.554508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.554513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.554518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.554522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.554525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.554527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.554530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.554536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.554539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.554549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:55.562145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:55.563991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:55.564012Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:55.564015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:55.564018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:55.564024Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 465 [1:7556533400049973074:6764]
2025-10-02T08:08:55.564038Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:55.564054Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:55.564056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.564060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.564061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.564077Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:55.564082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:55.564088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:55.564150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.564158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.564161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:55.564163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:55.564224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:55.564231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.564242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.564256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:55.564275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049973019:6765], now have 1 active actors on pipe
2025-10-02T08:08:55.564282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533400510257659:2378], now have 1 active actors on pipe
2025-10-02T08:08:55.564285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 465
2025-10-02T08:08:55.564289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533400049973068:6764]
2025-10-02T08:08:55.564290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533400049973068:6764]
2025-10-02T08:08:55.564301Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:55.564309Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:55.564317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:55.564318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:55.564329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:55.564336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:55.564342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.564349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.564345Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 465
2025-10-02T08:08:55.564382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533400049973068:6764]
2025-10-02T08:08:55.564393Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:55.564401Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:55.564409Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2571a10e-a33a692c-fee392db-cd5283a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:55.564416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.564424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.564425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:55.564434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.564446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:55.564483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.564532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.564539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.564551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.564586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 466 partition: 0 MaxSeqNo: 17 sessionId: src_id|2571a10e-a33a692c-fee392db-cd5283a9_0
2025-10-02T08:08:55.564920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae2db3d-db97291b-8d99cf6c-176acbe0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2571a10e-a33a692c-fee392db-cd5283a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:55.567562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2571a10e-a33a692c-fee392db-cd5283a9_0] Write session: try to update token
2025-10-02T08:08:55.567574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2571a10e-a33a692c-fee392db-cd5283a9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:55.580711Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:55.580733Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:55.580735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:55.580742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533400049973068:6764]
2025-10-02T08:08:55.580745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533400049973068:6764]
2025-10-02T08:08:55.580781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:55.580785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.580787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:55.580815Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:55.580824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:55.580950Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:55.581266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId: src_id|2571a10e-a33a692c-fee392db-cd5283a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:55.583812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:55.637845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533400049973099:6232]
2025-10-02T08:08:55.637971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 465, pipe: [1:7556533400049973099:6232]
2025-10-02T08:08:55.707367Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:55.707963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.707976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.708014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049973099:6232], now have 1 active actors on pipe
2025-10-02T08:08:55.708123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:55.708135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:55.708200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:55.708196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 466 reason: error at write: Disconnected sessionId: src_id|2571a10e-a33a692c-fee392db-cd5283a9_0
2025-10-02T08:08:55.708372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 466 sessionId: src_id|2571a10e-a33a692c-fee392db-cd5283a9_0 is DEAD
2025-10-02T08:08:55.708514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571a10e-a33a692c-fee392db-cd5283a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:55.708522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571a10e-a33a692c-fee392db-cd5283a9_0] Write session will restart in 0.007103s
2025-10-02T08:08:55.708526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533400049973099:6232]
2025-10-02T08:08:55.708550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571a10e-a33a692c-fee392db-cd5283a9_0] Write session: Do CDS request
2025-10-02T08:08:55.708554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571a10e-a33a692c-fee392db-cd5283a9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:55.709147Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:55.716259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2571a10e-a33a692c-fee392db-cd5283a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.716341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:55.716355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 467
2025-10-02T08:08:55.716525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.716548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:55.716555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:55.716557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:55.717007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 467 sessionId:  describe result for acl check
2025-10-02T08:08:55.717043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:55.717050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:55.717051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:55.717056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533400049973553:6771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:55.717612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533400049973553:6771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:55.719848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533400049973553:6771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:55.722761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533400049973553:6771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:55.722773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533400049973553:6771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:55.722774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533400049973553:6771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:55.722779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:55.724207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:55.725118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:55.725228Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:55.725235Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:55.725241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:55.725267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:55.725292Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533400049973875:6770]
2025-10-02T08:08:55.725733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:55.725912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:55.725935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:55.726126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:55.726154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.726158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.726159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.726160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.726160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.726163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.726169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.726171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.726173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.726175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.726178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.726182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.726185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.726188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.726190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.726193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.726195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.726197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.726200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.726203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.726214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:55.733622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:55.735194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:55.735208Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:55.735209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:55.735212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:55.735216Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 466 [1:7556533400049973875:6770]
2025-10-02T08:08:55.735224Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:55.735236Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:55.735238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.735240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.735241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.735252Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:55.735258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:55.735263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:55.735316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.735322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.735324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:55.735326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:55.735370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:55.735377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.735387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.735399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:55.735416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533400049973869:6770]
2025-10-02T08:08:55.735421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533400049973869:6770]
2025-10-02T08:08:55.735426Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:55.735436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049973854:6771], now have 1 active actors on pipe
2025-10-02T08:08:55.735436Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:55.735439Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:55.735444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:55.735452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:55.735456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 466
2025-10-02T08:08:55.735457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:55.735460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533400510257666:2378], now have 1 active actors on pipe
2025-10-02T08:08:55.735479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.735485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.735495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533400049973869:6770]
2025-10-02T08:08:55.735504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:55.735523Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fe170e5-64322924-f7f90c65-80ffba70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:55.735530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.735532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.735533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:55.735510Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 466
2025-10-02T08:08:55.735539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.735548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:55.735567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.735573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:55.735646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.735651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.735660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.735688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 467 partition: 0 MaxSeqNo: 17 sessionId: src_id|7fe170e5-64322924-f7f90c65-80ffba70_0
2025-10-02T08:08:55.735978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571a10e-a33a692c-fee392db-cd5283a9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7fe170e5-64322924-f7f90c65-80ffba70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:55.738715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe170e5-64322924-f7f90c65-80ffba70_0] Write session: try to update token
2025-10-02T08:08:55.738728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe170e5-64322924-f7f90c65-80ffba70_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:55.751854Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:55.751875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:55.751877Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:55.751885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533400049973869:6770]
2025-10-02T08:08:55.751888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533400049973869:6770]
2025-10-02T08:08:55.751926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:55.751929Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:55.751932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.751934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:55.751934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:55.752076Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:55.753572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId: src_id|7fe170e5-64322924-f7f90c65-80ffba70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:55.755958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:55.808841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533400049973931:6232]
2025-10-02T08:08:55.808919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 466, pipe: [1:7556533400049973931:6232]
2025-10-02T08:08:55.875374Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:55.875667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.875676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.875705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049973931:6232], now have 1 active actors on pipe
2025-10-02T08:08:55.875819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533400049973931:6232]
2025-10-02T08:08:55.875847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:55.875854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:55.875858Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:55.875891Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:55.875915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 467 reason: error at write: Disconnected sessionId: src_id|7fe170e5-64322924-f7f90c65-80ffba70_0
2025-10-02T08:08:55.876084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 467 sessionId: src_id|7fe170e5-64322924-f7f90c65-80ffba70_0 is DEAD
2025-10-02T08:08:55.876197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe170e5-64322924-f7f90c65-80ffba70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:55.876207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe170e5-64322924-f7f90c65-80ffba70_0] Write session will restart in 0.008289s
2025-10-02T08:08:55.876226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe170e5-64322924-f7f90c65-80ffba70_0] Write session: Do CDS request
2025-10-02T08:08:55.876230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe170e5-64322924-f7f90c65-80ffba70_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:55.885139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe170e5-64322924-f7f90c65-80ffba70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.885179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:55.885191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 468
2025-10-02T08:08:55.885310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:55.885330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:55.885337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:55.885339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:55.885606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 468 sessionId:  describe result for acl check
2025-10-02T08:08:55.885627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:55.885631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:55.885631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:55.885634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533400049974651:6790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:55.885942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533400049974651:6790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:55.887000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:55.887498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:55.887607Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:55.887614Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:55.887620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:55.887647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:55.887670Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533400049974699:6789]
2025-10-02T08:08:55.887734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533400049974651:6790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:55.888034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:55.888153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:55.888179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:55.888359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:55.888383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.888387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.888388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.888389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.888389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.888392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.888397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.888399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.888401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.888402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.888405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.888409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:55.888413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.888415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:55.888419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.888421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:55.888423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.888427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.888429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.888431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.888440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:55.892495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533400049974651:6790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:55.892506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533400049974651:6790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:55.892508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533400049974651:6790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:55.892513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:55.895756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:55.897269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:55.897283Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:55.897284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:55.897286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:55.897290Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 467 [1:7556533400049974699:6789]
2025-10-02T08:08:55.897297Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:55.897309Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:55.897314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.897316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.897317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.897327Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:55.897329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:55.897333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:55.897371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.897377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.897379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:55.897381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:55.897422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:55.897428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.897435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:55.897441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:55.897455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049974727:6790], now have 1 active actors on pipe
2025-10-02T08:08:55.897463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533400049974689:6789]
2025-10-02T08:08:55.897464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533400049974689:6789]
2025-10-02T08:08:55.897469Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:55.897474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533400510257696:2378], now have 1 active actors on pipe
2025-10-02T08:08:55.897474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 467
2025-10-02T08:08:55.897479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:55.897479Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:55.897482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:55.897487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:55.897489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:55.897493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.897497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.897521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533400049974689:6789]
2025-10-02T08:08:55.897527Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:55.897537Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b20e466-b7fab151-127c38f-a48744fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:55.897542Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:55.897518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 467
2025-10-02T08:08:55.897544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:55.897546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:55.897547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:55.897553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:55.897559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:55.897586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.897630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:55.897636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:55.897645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:55.897669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 468 partition: 0 MaxSeqNo: 17 sessionId: src_id|9b20e466-b7fab151-127c38f-a48744fe_0
2025-10-02T08:08:55.897938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe170e5-64322924-f7f90c65-80ffba70_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9b20e466-b7fab151-127c38f-a48744fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:55.900719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b20e466-b7fab151-127c38f-a48744fe_0] Write session: try to update token
2025-10-02T08:08:55.900731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b20e466-b7fab151-127c38f-a48744fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:55.913424Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:55.913442Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:55.913444Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:55.913450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533400049974689:6789]
2025-10-02T08:08:55.913454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533400049974689:6789]
2025-10-02T08:08:55.913483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:55.913484Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:55.913487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:55.913488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:55.913489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:55.913619Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:55.913909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId: src_id|9b20e466-b7fab151-127c38f-a48744fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:55.916389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:55.975736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533400049974741:6232]
2025-10-02T08:08:55.975842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 467, pipe: [1:7556533400049974741:6232]
2025-10-02T08:08:56.036777Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:56.037040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.037050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.037081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533400049974741:6232], now have 1 active actors on pipe
2025-10-02T08:08:56.037215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:56.037221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:56.037262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 468 reason: error at write: Disconnected sessionId: src_id|9b20e466-b7fab151-127c38f-a48744fe_0
2025-10-02T08:08:56.037315Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:56.037387Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:56.037451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 468 sessionId: src_id|9b20e466-b7fab151-127c38f-a48744fe_0 is DEAD
2025-10-02T08:08:56.037593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b20e466-b7fab151-127c38f-a48744fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:56.037604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b20e466-b7fab151-127c38f-a48744fe_0] Write session will restart in 0.008368s
2025-10-02T08:08:56.037581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533400049974741:6232]
2025-10-02T08:08:56.037629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b20e466-b7fab151-127c38f-a48744fe_0] Write session: Do CDS request
2025-10-02T08:08:56.037637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b20e466-b7fab151-127c38f-a48744fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:56.047318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b20e466-b7fab151-127c38f-a48744fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.047338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:56.047356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 469
2025-10-02T08:08:56.047493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.047528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:56.047537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:56.047541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:56.048036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 469 sessionId:  describe result for acl check
2025-10-02T08:08:56.048066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:56.048067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:56.048069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:56.048074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533404344942698:6796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:56.048586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533404344942698:6796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:56.050244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533404344942698:6796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:56.051211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:56.051484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:56.051627Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:56.051638Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:56.051660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:56.051711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:56.051748Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533404344942810:6795]
2025-10-02T08:08:56.052319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:56.052491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:56.052538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:56.052718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533404344942698:6796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:56.052729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533404344942698:6796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:56.052731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533404344942698:6796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:56.052736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:56.052859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:56.052929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.052935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.052936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.052937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.052938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.052943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.052953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.052956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.052960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.052963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.052969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.052981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.052991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.052996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.053003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.053008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.053012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.053021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.053027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.053035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.053051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:56.060693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:56.062859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:56.062885Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:56.062887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:56.062892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:56.062899Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 468 [1:7556533404344942810:6795]
2025-10-02T08:08:56.062912Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:56.062930Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:56.062933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.062937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.062939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.062956Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:56.062966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:56.062973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:56.063048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.063059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.063062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:56.063066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:56.063142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:56.063152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.063165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.063175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:56.063180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 468
2025-10-02T08:08:56.063199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344942821:6796], now have 1 active actors on pipe
2025-10-02T08:08:56.063208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533404805224999:2378], now have 1 active actors on pipe
2025-10-02T08:08:56.063213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.063218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.063241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533404344942804:6795]
2025-10-02T08:08:56.063250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533404344942804:6795]
2025-10-02T08:08:56.063258Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:56.063249Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 468
2025-10-02T08:08:56.063277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:56.063279Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:56.063281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:56.063295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:56.063298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:56.063313Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13f256d7-eb780e20-706567cf-f8446474_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:56.063326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.063331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.063335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:56.063344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.063355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:56.063407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533404344942804:6795]
2025-10-02T08:08:56.063425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:56.063431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:56.063441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.063484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.063492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.063511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.063549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 469 partition: 0 MaxSeqNo: 17 sessionId: src_id|13f256d7-eb780e20-706567cf-f8446474_0
2025-10-02T08:08:56.063863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b20e466-b7fab151-127c38f-a48744fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|13f256d7-eb780e20-706567cf-f8446474_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:56.066484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f256d7-eb780e20-706567cf-f8446474_0] Write session: try to update token
2025-10-02T08:08:56.066495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f256d7-eb780e20-706567cf-f8446474_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:56.079536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId: src_id|13f256d7-eb780e20-706567cf-f8446474_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:56.080235Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:56.080262Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:56.080265Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:56.080274Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533404344942804:6795]
2025-10-02T08:08:56.080280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533404344942804:6795]
2025-10-02T08:08:56.080318Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:56.080328Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:56.080330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:56.080338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.080341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:56.080524Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:56.082195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:56.137532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533404344942841:6232]
2025-10-02T08:08:56.137624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 468, pipe: [1:7556533404344942841:6232]
2025-10-02T08:08:56.212137Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:56.212399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.212408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.212439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344942841:6232], now have 1 active actors on pipe
2025-10-02T08:08:56.212524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533404344942841:6232]
2025-10-02T08:08:56.212544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:56.212549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:56.212574Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:56.212599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 469 reason: error at write: Disconnected sessionId: src_id|13f256d7-eb780e20-706567cf-f8446474_0
2025-10-02T08:08:56.212625Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:56.212746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 469 sessionId: src_id|13f256d7-eb780e20-706567cf-f8446474_0 is DEAD
2025-10-02T08:08:56.212902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f256d7-eb780e20-706567cf-f8446474_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:56.212910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f256d7-eb780e20-706567cf-f8446474_0] Write session will restart in 0.009849s
2025-10-02T08:08:56.212928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f256d7-eb780e20-706567cf-f8446474_0] Write session: Do CDS request
2025-10-02T08:08:56.212933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f256d7-eb780e20-706567cf-f8446474_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:56.224264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f256d7-eb780e20-706567cf-f8446474_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.224327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:56.224342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 470
2025-10-02T08:08:56.224427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.224453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:56.224463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:56.224465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:56.224934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 470 sessionId:  describe result for acl check
2025-10-02T08:08:56.224972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:56.224978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:56.224980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:56.224986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533404344943582:6803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:56.225082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:56.225389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:56.225483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533404344943582:6803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:56.225498Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:56.225500Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:56.225506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:56.225534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:56.225569Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533404344943590:6801]
2025-10-02T08:08:56.226026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:56.226169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:56.226206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:56.226479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:56.226509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.226513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.226514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.226515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.226515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.226518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.226524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.226526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.226528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.226530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.226533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.226537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.226540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.226543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.226545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.226547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.226549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.226552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.226554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.226557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.226571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:56.227354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533404344943582:6803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:56.232872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533404344943582:6803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:56.232888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533404344943582:6803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:56.232891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533404344943582:6803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:56.232899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:56.234026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:56.235659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:56.235674Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:56.235677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:56.235680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:56.235686Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 469 [1:7556533404344943590:6801]
2025-10-02T08:08:56.235696Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:56.235710Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:56.235713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.235716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.235717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.235731Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:56.235740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:56.235750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:56.235816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.235825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.235828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:56.235830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:56.235887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:56.235894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.235908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.235925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:56.235942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 469
2025-10-02T08:08:56.235944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344943634:6803], now have 1 active actors on pipe
2025-10-02T08:08:56.235947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533404805225007:2378], now have 1 active actors on pipe
2025-10-02T08:08:56.235953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533404344943583:6801]
2025-10-02T08:08:56.235955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533404344943583:6801]
2025-10-02T08:08:56.235965Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:56.235974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.235978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.235982Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:56.235985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:56.235993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:56.236005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:56.236007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:56.235998Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 469
2025-10-02T08:08:56.236043Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92707135-bc4e844b-ff394153-4840e88a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:56.236054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.236059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.236061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:56.236068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.236076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:56.236087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533404344943583:6801]
2025-10-02T08:08:56.236100Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:56.236122Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:56.236131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.236191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.236198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.236211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.236246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 470 partition: 0 MaxSeqNo: 17 sessionId: src_id|92707135-bc4e844b-ff394153-4840e88a_0
2025-10-02T08:08:56.236551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f256d7-eb780e20-706567cf-f8446474_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|92707135-bc4e844b-ff394153-4840e88a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:56.239155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92707135-bc4e844b-ff394153-4840e88a_0] Write session: try to update token
2025-10-02T08:08:56.239168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92707135-bc4e844b-ff394153-4840e88a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:56.252344Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:56.252363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:56.252364Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:56.252371Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533404344943583:6801]
2025-10-02T08:08:56.252374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533404344943583:6801]
2025-10-02T08:08:56.252405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:56.252411Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:56.252415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.252416Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:56.252417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:56.252550Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:56.252835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId: src_id|92707135-bc4e844b-ff394153-4840e88a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:56.255339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:56.312641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533404344943648:6232]
2025-10-02T08:08:56.312743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 469, pipe: [1:7556533404344943648:6232]
2025-10-02T08:08:56.374996Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:56.375294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.375304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.375333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344943648:6232], now have 1 active actors on pipe
2025-10-02T08:08:56.375431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533404344943648:6232]
2025-10-02T08:08:56.375445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:56.375450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:56.375488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 470 reason: error at write: Disconnected sessionId: src_id|92707135-bc4e844b-ff394153-4840e88a_0
2025-10-02T08:08:56.375521Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:56.375537Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:56.375662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 470 sessionId: src_id|92707135-bc4e844b-ff394153-4840e88a_0 is DEAD
2025-10-02T08:08:56.375826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92707135-bc4e844b-ff394153-4840e88a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:56.375835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92707135-bc4e844b-ff394153-4840e88a_0] Write session will restart in 0.009789s
2025-10-02T08:08:56.375855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92707135-bc4e844b-ff394153-4840e88a_0] Write session: Do CDS request
2025-10-02T08:08:56.375860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92707135-bc4e844b-ff394153-4840e88a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:56.386266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92707135-bc4e844b-ff394153-4840e88a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.386366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:56.386380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 471
2025-10-02T08:08:56.386460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.386481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:56.386485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:56.386487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:56.386751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 471 sessionId:  describe result for acl check
2025-10-02T08:08:56.386772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:56.386777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:56.386778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:56.386782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533404344944407:6809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:56.387082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:56.387134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533404344944407:6809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:56.387735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:56.387878Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:56.387886Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:56.387895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:56.387939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:56.387967Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533404344944420:6808]
2025-10-02T08:08:56.388348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:56.388467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:56.388505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:56.388713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:56.388753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.388757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.388757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.388758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.388759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.388764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.388771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.388773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.388775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.388777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.388780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.388784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.388787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.388790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.388794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.388798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.388813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.388816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.388818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.388821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.388837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:56.388964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533404344944407:6809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:56.395084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533404344944407:6809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:56.395101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533404344944407:6809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:56.395103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533404344944407:6809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:56.395110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:56.397128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:56.398740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:56.398753Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:56.398754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:56.398756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:56.398761Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 470 [1:7556533404344944420:6808]
2025-10-02T08:08:56.398769Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:56.398780Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:56.398781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.398784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.398785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.398798Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:56.398801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:56.398807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:56.398849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.398854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.398856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:56.398858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:56.398900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:56.398905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.398912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.398922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:56.398939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344944460:6809], now have 1 active actors on pipe
2025-10-02T08:08:56.398942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 470
2025-10-02T08:08:56.398949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533404344944409:6808]
2025-10-02T08:08:56.398951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533404344944409:6808]
2025-10-02T08:08:56.398958Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:56.398964Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:56.398967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:56.398971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533404805225027:2378], now have 1 active actors on pipe
2025-10-02T08:08:56.398976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:56.398992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:56.398998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:56.399004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.399012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.399046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533404344944409:6808]
2025-10-02T08:08:56.399053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:56.399055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:56.399063Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:56.399070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.399072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.399074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:56.399016Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 470
2025-10-02T08:08:56.399080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.399089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:56.399124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.399159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.399166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.399175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.399199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 471 partition: 0 MaxSeqNo: 17 sessionId: src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0
2025-10-02T08:08:56.399486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92707135-bc4e844b-ff394153-4840e88a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:56.402192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0] Write session: try to update token
2025-10-02T08:08:56.402206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:56.415061Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:56.415076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:56.415078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:56.415084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533404344944409:6808]
2025-10-02T08:08:56.415087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533404344944409:6808]
2025-10-02T08:08:56.415120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:56.415120Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:56.415124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:56.415125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.415127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:56.415255Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:56.415479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId: src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:56.417960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:56.475431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533404344944479:6232]
2025-10-02T08:08:56.475530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 470, pipe: [1:7556533404344944479:6232]
2025-10-02T08:08:56.537493Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:56.537858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.537867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.537897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344944479:6232], now have 1 active actors on pipe
2025-10-02T08:08:56.537998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:56.538006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:56.538055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 471 reason: error at write: Disconnected sessionId: src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0
2025-10-02T08:08:56.538112Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:56.538112Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:56.538204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 471 sessionId: src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0 is DEAD
2025-10-02T08:08:56.538326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533404344944479:6232]
2025-10-02T08:08:56.538380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:56.538390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0] Write session will restart in 0.006400s
2025-10-02T08:08:56.538413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0] Write session: Do CDS request
2025-10-02T08:08:56.538420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:56.546245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.546298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:56.546308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 472
2025-10-02T08:08:56.546451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.546474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:56.546477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:56.546479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:56.546844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 472 sessionId:  describe result for acl check
2025-10-02T08:08:56.546869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:56.546870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:56.546871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:56.546876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533404344944988:6816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:56.547227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533404344944988:6816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:56.548919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533404344944988:6816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:56.551344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533404344944988:6816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:56.551353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533404344944988:6816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:56.551355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533404344944988:6816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:56.551361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:56.552762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:56.553027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:56.553236Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:56.553244Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:56.553251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:56.553282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:56.553307Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533404344945264:6815]
2025-10-02T08:08:56.553677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:56.553802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:56.553831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:56.554012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:56.554038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.554042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.554042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.554043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.554044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.554046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.554053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.554055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.554057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.554058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.554062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.554066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.554069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.554072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.554074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.554077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.554079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.554081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.554084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.554087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.554096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:56.564688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:56.566197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:56.566212Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:56.566214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:56.566218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:56.566224Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 471 [1:7556533404344945264:6815]
2025-10-02T08:08:56.566236Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:56.566251Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:56.566257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.566261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.566263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.566277Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:56.566282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:56.566293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:56.566350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.566357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.566360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:56.566362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:56.566426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:56.566433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.566444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.566456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:56.566476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344945247:6816], now have 1 active actors on pipe
2025-10-02T08:08:56.566483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533404805225033:2378], now have 1 active actors on pipe
2025-10-02T08:08:56.566487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 471
2025-10-02T08:08:56.566488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533404344945258:6815]
2025-10-02T08:08:56.566490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533404344945258:6815]
2025-10-02T08:08:56.566497Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:56.566506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:56.566508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:56.566515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:56.566521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:56.566524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:56.566530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.566534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.566538Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 471
2025-10-02T08:08:56.566571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533404344945258:6815]
2025-10-02T08:08:56.566578Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:56.566587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:56.566591Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e66368-f0d042cb-dd8369fa-db94f144_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:56.566599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.566603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.566604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:56.566613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.566622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:56.566660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.566697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.566702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.566713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.566744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 472 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e66368-f0d042cb-dd8369fa-db94f144_0
2025-10-02T08:08:56.567009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9515fbf-3172ff0c-afdc1d6d-bcda7a01_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e66368-f0d042cb-dd8369fa-db94f144_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:56.569780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e66368-f0d042cb-dd8369fa-db94f144_0] Write session: try to update token
2025-10-02T08:08:56.569794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e66368-f0d042cb-dd8369fa-db94f144_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:56.582955Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:56.582970Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:56.582973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:56.582980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533404344945258:6815]
2025-10-02T08:08:56.582984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533404344945258:6815]
2025-10-02T08:08:56.583020Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:56.583025Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:56.583025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:56.583032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.583034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:56.583213Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:56.584914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId: src_id|3e66368-f0d042cb-dd8369fa-db94f144_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:56.587162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:56.638268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533404344945289:6232]
2025-10-02T08:08:56.638361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 471, pipe: [1:7556533404344945289:6232]
2025-10-02T08:08:56.707645Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:56.707992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.708002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.708033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344945289:6232], now have 1 active actors on pipe
2025-10-02T08:08:56.708152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:56.708166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:56.708190Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:56.708220Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:56.708248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 472 reason: error at write: Disconnected sessionId: src_id|3e66368-f0d042cb-dd8369fa-db94f144_0
2025-10-02T08:08:56.708437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 472 sessionId: src_id|3e66368-f0d042cb-dd8369fa-db94f144_0 is DEAD
2025-10-02T08:08:56.708459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533404344945289:6232]
2025-10-02T08:08:56.708579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e66368-f0d042cb-dd8369fa-db94f144_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:56.708587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e66368-f0d042cb-dd8369fa-db94f144_0] Write session will restart in 0.008294s
2025-10-02T08:08:56.708607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e66368-f0d042cb-dd8369fa-db94f144_0] Write session: Do CDS request
2025-10-02T08:08:56.708612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e66368-f0d042cb-dd8369fa-db94f144_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:56.718241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e66368-f0d042cb-dd8369fa-db94f144_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.718437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:56.718450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 473
2025-10-02T08:08:56.718542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.718571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:56.718580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:56.718584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:56.718917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 473 sessionId:  describe result for acl check
2025-10-02T08:08:56.718940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:56.718941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:56.718942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:56.718946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533404344945970:6822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:56.719296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533404344945970:6822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:56.720794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533404344945970:6822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:56.721994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:56.722245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:56.722367Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:56.722375Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:56.722381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:56.722412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:56.722439Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533404344946071:6821]
2025-10-02T08:08:56.722836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:56.722968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:56.723000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:56.723218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:56.723254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.723259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.723260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.723261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.723262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.723267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.723273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.723276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.723278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.723279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.723283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.723286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.723289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.723292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.723294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.723297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.723299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.723301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.723303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.723306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.723318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:56.723356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533404344945970:6822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:56.723364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533404344945970:6822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:56.723366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533404344945970:6822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:56.723372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:56.730625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:56.732284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:56.732296Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:56.732297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:56.732299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:56.732303Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 472 [1:7556533404344946071:6821]
2025-10-02T08:08:56.732310Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:56.732322Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:56.732323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.732325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.732326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.732337Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:56.732340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:56.732344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:56.732396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.732402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.732404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:56.732406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:56.732452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:56.732459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.732469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.732479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:56.732480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 472
2025-10-02T08:08:56.732497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344946087:6822], now have 1 active actors on pipe
2025-10-02T08:08:56.732504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533404805225040:2378], now have 1 active actors on pipe
2025-10-02T08:08:56.732507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.732510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.732521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533404344946065:6821]
2025-10-02T08:08:56.732526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533404344946065:6821]
2025-10-02T08:08:56.732534Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:56.732545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:56.732547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:56.732549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:56.732556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:56.732558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:56.732569Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:56.732576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.732578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.732579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:56.732585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.732593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:56.732564Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 472
2025-10-02T08:08:56.732617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533404344946065:6821]
2025-10-02T08:08:56.732625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:56.732630Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:56.732640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.732676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.732681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.732690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.732721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 473 partition: 0 MaxSeqNo: 17 sessionId: src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0
2025-10-02T08:08:56.733010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e66368-f0d042cb-dd8369fa-db94f144_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:56.735720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0] Write session: try to update token
2025-10-02T08:08:56.735733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:56.747753Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:56.747779Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:56.747788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533404344946065:6821]
2025-10-02T08:08:56.747829Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:56.747831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:56.748006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:56.748160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:56.748311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:56.748337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId: src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:56.748448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:56.748651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:56.748699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:56.750853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:56.750914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.750924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.750947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:56.750966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:56.751008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.751017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.751156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.751216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.751280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.751346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.751555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.751564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.751621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.751676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.751738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.751811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.751851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.751856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.751913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.751971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.752038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.752096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.752140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.752145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.752206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.752268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.752327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.752382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.752442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.752448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.752506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.752562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.752637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.752693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.752733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.752737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.752797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.752873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.752934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.752991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.753032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.753037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.753095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.753153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.753213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.753274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.753316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.753321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.753383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.753441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.753500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.753565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.753605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.753610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.753677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.753742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.753804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.753863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.753903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.753908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.753966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:56.754021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:56.754082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:56.754141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:56.754184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:56.754190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:56.754218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:56.754268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.754285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.754289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:56.754312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:56.754325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:56.754330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:56.754333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:56.754334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:56.754716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:56.754739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:56.754750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:56.754753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:56.754756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:56.754763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:56.755365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:56.755382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:56.755387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:56.755391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:56.755396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:56.755398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:56.755910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:56.755926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:56.755934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:56.755936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:56.755940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:56.757116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:56.757132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:56.757142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392536757
2025-10-02T08:08:56.757256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:56.757265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:56.757268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:56.757270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:56.757274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:56.757279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:56.757713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:56.757731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:56.757738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:56.757740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:56.757742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:56.757744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:56.758209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:56.758225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:56.758236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:56.758242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:56.758244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:56.758247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:56.758668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:56.758682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:56.758685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:56.759701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:56.759717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:56.759722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:56.759725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:56.759731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392536759
2025-10-02T08:08:56.760022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:56.760038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:56.760042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:56.760044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:56.760050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:56.760053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:56.760485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:56.760501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:56.760505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:56.760508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:56.760513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:56.760515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:56.760950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:56.760962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.761037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392536760
2025-10-02T08:08:56.761758Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:56.761772Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:56.761782Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:56.761789Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:56.763446Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:56.763455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:56.763456Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:56.763464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533404344946065:6821]
2025-10-02T08:08:56.763466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533404344946065:6821]
2025-10-02T08:08:56.763497Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:56.763507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:56.763509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:56.763511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.763513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:56.763632Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:56.816144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533404344946123:6232]
2025-10-02T08:08:56.817905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 472, pipe: [1:7556533404344946123:6232]
2025-10-02T08:08:56.885342Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:56.885648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344946123:6232], now have 1 active actors on pipe
2025-10-02T08:08:56.885742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533404344946123:6232]
2025-10-02T08:08:56.885766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:56.885772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:56.885798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 473 reason: error at write: Disconnected sessionId: src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0
2025-10-02T08:08:56.885823Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:56.885841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:56.885988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 473 sessionId: src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0 is DEAD
2025-10-02T08:08:56.886122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:56.886128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0] Write session will restart in 0.009687s
2025-10-02T08:08:56.886145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0] Write session: Do CDS request
2025-10-02T08:08:56.886151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:56.897210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.897290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:56.897303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 474
2025-10-02T08:08:56.897397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:56.897418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:56.897424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:56.897427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:56.897686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 474 sessionId:  describe result for acl check
2025-10-02T08:08:56.897707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:56.897711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:56.897712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:56.897716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533404344946890:6841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:56.898076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533404344946890:6841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:56.898364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:56.898939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:56.899097Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:56.899105Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:56.899113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:56.899158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:56.899189Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533404344946920:6840]
2025-10-02T08:08:56.899494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533404344946890:6841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:56.899707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:56.899858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:56.899892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:56.900087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:56.900113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.900114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.900115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.900115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.900116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.900119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.900125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.900127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.900129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.900131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.900134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.900138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:56.900141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.900144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:56.900146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.900148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:56.900150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.900153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.900155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.900158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.900168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:56.904576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533404344946890:6841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:56.904588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533404344946890:6841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:56.904591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533404344946890:6841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:56.904599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:56.907283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:56.908616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:56.908627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:56.908629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:56.908631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:56.908636Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 473 [1:7556533404344946920:6840]
2025-10-02T08:08:56.908643Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:56.908656Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:56.908658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.908660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.908661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.908673Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:56.908677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:56.908681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:56.908725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.908730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.908732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:56.908734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:56.908777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:56.908785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.908797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:56.908823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:56.908843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533404344946902:6840]
2025-10-02T08:08:56.908843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 473
2025-10-02T08:08:56.908850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533404344946902:6840]
2025-10-02T08:08:56.908858Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:56.908866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:56.908871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344946946:6841], now have 1 active actors on pipe
2025-10-02T08:08:56.908873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:56.908874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533404805225070:2378], now have 1 active actors on pipe
2025-10-02T08:08:56.908881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.908885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.908899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:56.908917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:56.908924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:56.908934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 473
2025-10-02T08:08:56.908961Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|831b987c-f933dd62-684c7691-a7f3d524_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:56.908972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:56.908975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:56.908977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:56.908986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:56.908997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:56.909006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533404344946902:6840]
2025-10-02T08:08:56.909014Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:56.909033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:56.909036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.909094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:56.909102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:56.909116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:56.909152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 474 partition: 0 MaxSeqNo: 17 sessionId: src_id|831b987c-f933dd62-684c7691-a7f3d524_0
2025-10-02T08:08:56.909457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4566fecc-30cd6ba6-b0cf11cc-1793defb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|831b987c-f933dd62-684c7691-a7f3d524_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:56.912049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|831b987c-f933dd62-684c7691-a7f3d524_0] Write session: try to update token
2025-10-02T08:08:56.912062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|831b987c-f933dd62-684c7691-a7f3d524_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:56.925466Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:56.925484Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:56.925487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:56.925496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533404344946902:6840]
2025-10-02T08:08:56.925501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533404344946902:6840]
2025-10-02T08:08:56.925542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:56.925553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:56.925555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:56.925571Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:56.925591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:56.925690Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:56.925971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId: src_id|831b987c-f933dd62-684c7691-a7f3d524_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:56.930855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:56.985928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533404344946961:6232]
2025-10-02T08:08:56.986010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 473, pipe: [1:7556533404344946961:6232]
2025-10-02T08:08:57.048964Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:57.049298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.049309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.049339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533404344946961:6232], now have 1 active actors on pipe
2025-10-02T08:08:57.049440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533404344946961:6232]
2025-10-02T08:08:57.049462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:57.049468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:57.049504Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:57.049528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 474 reason: error at write: Disconnected sessionId: src_id|831b987c-f933dd62-684c7691-a7f3d524_0
2025-10-02T08:08:57.049565Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:57.049705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 474 sessionId: src_id|831b987c-f933dd62-684c7691-a7f3d524_0 is DEAD
2025-10-02T08:08:57.049853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831b987c-f933dd62-684c7691-a7f3d524_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:57.049863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831b987c-f933dd62-684c7691-a7f3d524_0] Write session will restart in 0.007553s
2025-10-02T08:08:57.049885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831b987c-f933dd62-684c7691-a7f3d524_0] Write session: Do CDS request
2025-10-02T08:08:57.049890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831b987c-f933dd62-684c7691-a7f3d524_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:57.058251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|831b987c-f933dd62-684c7691-a7f3d524_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.058366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:57.058379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 475
2025-10-02T08:08:57.058481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.058506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:57.058515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:57.058518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:57.058859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 475 sessionId:  describe result for acl check
2025-10-02T08:08:57.058885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:57.058890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:57.058891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:57.058895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533408639914827:6847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:57.059266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533408639914827:6847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:57.061564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533408639914827:6847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:57.063980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:57.064196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533408639914827:6847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:57.064206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533408639914827:6847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:57.064209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533408639914827:6847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:57.064215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:57.064218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:57.064346Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:57.064355Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:57.064361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:57.064393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:57.064418Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533408639915048:6846]
2025-10-02T08:08:57.064826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:57.064973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:57.065007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:57.065213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:57.065245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.065251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.065252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.065253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.065254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.065259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.065265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.065267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.065269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.065271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.065274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.065279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.065283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.065285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.065288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.065290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.065292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.065295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.065298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.065300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.065310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:57.072573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:57.074214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:57.074224Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:57.074225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:57.074228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:57.074232Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 474 [1:7556533408639915048:6846]
2025-10-02T08:08:57.074239Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:57.074251Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:57.074252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.074254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.074256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.074266Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:57.074268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:57.074272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:57.074310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.074315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.074317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:57.074318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:57.074370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:57.074377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.074388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.074401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:57.074423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639915045:6847], now have 1 active actors on pipe
2025-10-02T08:08:57.074430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533409100192372:2378], now have 1 active actors on pipe
2025-10-02T08:08:57.074436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533408639915037:6846]
2025-10-02T08:08:57.074441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533408639915037:6846]
2025-10-02T08:08:57.074451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:57.074462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.074465Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:57.074467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:57.074469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.074485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:57.074497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:57.074499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:57.074502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 474
2025-10-02T08:08:57.074495Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 474
2025-10-02T08:08:57.074530Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:57.074541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.074544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.074546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:57.074554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.074561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:57.074568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533408639915037:6846]
2025-10-02T08:08:57.074575Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:57.074592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:57.074601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.074641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.074646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.074655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.074685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 475 partition: 0 MaxSeqNo: 17 sessionId: src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0
2025-10-02T08:08:57.075002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831b987c-f933dd62-684c7691-a7f3d524_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:57.077720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0] Write session: try to update token
2025-10-02T08:08:57.077733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:57.089962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId: src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:57.090868Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:57.090882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:57.090884Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:57.090891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533408639915037:6846]
2025-10-02T08:08:57.090895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533408639915037:6846]
2025-10-02T08:08:57.090935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:57.090945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:57.090946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.090948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:57.090949Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:57.091086Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:57.092323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:57.149764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533408639915074:6232]
2025-10-02T08:08:57.149850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 474, pipe: [1:7556533408639915074:6232]
2025-10-02T08:08:57.212939Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:57.213344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.213354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.213383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639915074:6232], now have 1 active actors on pipe
2025-10-02T08:08:57.213468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:57.213473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:57.213515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 475 reason: error at write: Disconnected sessionId: src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0
2025-10-02T08:08:57.213565Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:57.213586Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:57.213666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 475 sessionId: src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0 is DEAD
2025-10-02T08:08:57.213802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533408639915074:6232]
2025-10-02T08:08:57.213867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:57.213879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0] Write session will restart in 0.005800s
2025-10-02T08:08:57.213898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0] Write session: Do CDS request
2025-10-02T08:08:57.213903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:57.221195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.221271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:57.221282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 476
2025-10-02T08:08:57.221413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.221448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:57.221454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:57.221458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:57.221758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 476 sessionId:  describe result for acl check
2025-10-02T08:08:57.221780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:57.221785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:57.221786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:57.221789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533408639915597:6853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:57.222143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533408639915597:6853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:57.223810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533408639915597:6853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:57.225993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533408639915597:6853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:57.226006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533408639915597:6853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:57.226008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533408639915597:6853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:57.226012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:57.226140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:57.226833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:57.226982Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:57.226990Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:57.226996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:57.227024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:57.227046Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533408639915867:6852]
2025-10-02T08:08:57.227405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:57.227528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:57.227550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:57.227722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:57.227745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.227749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.227750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.227750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.227751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.227753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.227759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.227761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.227771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.227773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.227776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.227780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.227784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.227787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.227789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.227791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.227793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.227796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.227798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.227800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.227812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:57.234950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:57.236455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:57.236466Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:57.236467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:57.236469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:57.236475Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 475 [1:7556533408639915867:6852]
2025-10-02T08:08:57.236481Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:57.236492Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:57.236493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.236495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.236496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.236506Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:57.236510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:57.236514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:57.236552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.236558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.236561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:57.236563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:57.236602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:57.236607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.236613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.236619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:57.236630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533408639915859:6852]
2025-10-02T08:08:57.236634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533408639915859:6852]
2025-10-02T08:08:57.236640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:57.236649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:57.236659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:57.236664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:57.236663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:57.236668Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:57.236671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639915858:6853], now have 1 active actors on pipe
2025-10-02T08:08:57.236673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 475
2025-10-02T08:08:57.236686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533409100192378:2378], now have 1 active actors on pipe
2025-10-02T08:08:57.236689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533408639915859:6852]
2025-10-02T08:08:57.236691Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:57.236692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:57.236696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.236698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.236723Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:57.236731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.236733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.236734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:57.236740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.236733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 475
2025-10-02T08:08:57.236748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:57.236762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.236797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.236818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.236827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.236850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 476 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0
2025-10-02T08:08:57.237130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|790a64d-e7dfe875-130e1fd4-1d19a364_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:57.239581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0] Write session: try to update token
2025-10-02T08:08:57.239596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:57.252379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId: src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:57.252452Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:57.252462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:57.252464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:57.252470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533408639915859:6852]
2025-10-02T08:08:57.252473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533408639915859:6852]
2025-10-02T08:08:57.252503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:57.252512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.252513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:57.252532Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:57.252544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:57.252637Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:57.254879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:57.314111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533408639915892:6232]
2025-10-02T08:08:57.314200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 475, pipe: [1:7556533408639915892:6232]
2025-10-02T08:08:57.376334Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:57.376723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.376732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.376763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639915892:6232], now have 1 active actors on pipe
2025-10-02T08:08:57.376919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533408639915892:6232]
2025-10-02T08:08:57.376942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:57.376948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:57.376955Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:57.377007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 476 reason: error at write: Disconnected sessionId: src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0
2025-10-02T08:08:57.377106Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:57.377185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 476 sessionId: src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0 is DEAD
2025-10-02T08:08:57.377315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:57.377322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0] Write session will restart in 0.005358s
2025-10-02T08:08:57.377341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0] Write session: Do CDS request
2025-10-02T08:08:57.377346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:57.384239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.384301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:57.384310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 477
2025-10-02T08:08:57.384430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.384453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:57.384456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:57.384458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:57.384752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 477 sessionId:  describe result for acl check
2025-10-02T08:08:57.384777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:57.384778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:57.384779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:57.384782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533408639916314:6860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:57.385248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533408639916314:6860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:57.387356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533408639916314:6860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:57.390128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533408639916314:6860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:57.390138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533408639916314:6860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:57.390140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533408639916314:6860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:57.390145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:57.391078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:57.391744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:57.391858Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:57.391865Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:57.391871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:57.391906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:57.391932Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533408639916704:6859]
2025-10-02T08:08:57.392302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:57.392415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:57.392438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:57.392629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:57.392656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.392660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.392660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.392661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.392661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.392664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.392670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.392672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.392674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.392676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.392679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.392683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.392686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.392689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.392691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.392693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.392696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.392698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.392700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.392703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.392715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:57.400062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:57.401503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:57.401516Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:57.401518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:57.401521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:57.401847Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 476 [1:7556533408639916704:6859]
2025-10-02T08:08:57.401860Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:57.401876Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:57.401882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.401884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.401885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.401897Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:57.401904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:57.401909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:57.401968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.401973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.401975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:57.401978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:57.402020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:57.402025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.402033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.402043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:57.402054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533408639916698:6859]
2025-10-02T08:08:57.402058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533408639916698:6859]
2025-10-02T08:08:57.402064Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:57.402071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:57.402082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:57.402084Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:57.402086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:57.402087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:57.402093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639916683:6860], now have 1 active actors on pipe
2025-10-02T08:08:57.402117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 476
2025-10-02T08:08:57.402120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533409100192398:2378], now have 1 active actors on pipe
2025-10-02T08:08:57.402122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533408639916698:6859]
2025-10-02T08:08:57.402129Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:57.402132Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:57.402136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.402145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.402183Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7528e41d-54dcd699-da71992f-390c8d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:57.402193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.402195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.402196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:57.402203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.402209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:57.402190Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 476
2025-10-02T08:08:57.402221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.402256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.402261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.402273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.402298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 477 partition: 0 MaxSeqNo: 17 sessionId: src_id|7528e41d-54dcd699-da71992f-390c8d6_0
2025-10-02T08:08:57.402634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ea09e2e-2afa4982-a0805c47-88eea8e9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7528e41d-54dcd699-da71992f-390c8d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:57.404947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7528e41d-54dcd699-da71992f-390c8d6_0] Write session: try to update token
2025-10-02T08:08:57.404960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7528e41d-54dcd699-da71992f-390c8d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:57.412073Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:57.412087Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:57.412093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533408639916698:6859]
2025-10-02T08:08:57.412125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:57.412133Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:57.412278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:57.412398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:57.412519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:57.412642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:57.412842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:57.412871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:57.418065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId: src_id|7528e41d-54dcd699-da71992f-390c8d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:57.420360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:57.420410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.420419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.420448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:57.420465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:57.420504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.420519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.420674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.420735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.420821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.420898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.421149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.421159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.421223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.421287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.421360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.421439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.421482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.421489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.421555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.421628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.421693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.421759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.421805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.421812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.421877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.421942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.422003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.422058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.422103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.422108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.422175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.422236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.422306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.422375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.422416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.422421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.422487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.422548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.422607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.422673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.422714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.422720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.422781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.422842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.422910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.422978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.423021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.423028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.423094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.423158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.423223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.423305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.423352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.423360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.423423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.423488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.423548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.423610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.423670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.423677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.423745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:57.423815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:57.423885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:57.423953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:57.424002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:57.424010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:57.424076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:57.424139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.424163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.424170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:57.424203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:57.424220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:57.424227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:57.424230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:57.424237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:57.424638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:57.424661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:57.424672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:57.424680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:57.424684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:57.424692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:57.425434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:57.425459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:57.425468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:57.425472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:57.425476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:57.425484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:57.426027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:57.426047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:57.426055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:57.426058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:57.426062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:57.427350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:57.427364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:57.427373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392537427
2025-10-02T08:08:57.427499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:57.427510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:57.427513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:57.427516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:57.427519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:57.427522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:57.428029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:57.428046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:57.428050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:57.428054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:57.428057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:57.428060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:57.428555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:57.428573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:57.428582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:57.428586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:57.428595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:57.428600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:57.429154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:57.429178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:57.429184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:57.430361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:57.430375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:57.430382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:57.430385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:57.430392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392537430
2025-10-02T08:08:57.430708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:57.430723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:57.430733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:57.430739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:57.430741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:57.430744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:57.431215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:57.431234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:57.431245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:57.431249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:57.431253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:57.431260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:57.431726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:57.431743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.431829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392537431
2025-10-02T08:08:57.432580Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:57.432608Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:57.432617Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:57.432625Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:57.434353Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:57.434364Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:57.434365Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:57.434374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533408639916698:6859]
2025-10-02T08:08:57.434379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533408639916698:6859]
2025-10-02T08:08:57.434420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:57.434423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:57.434427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.434429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:57.434430Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:57.434554Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:57.476979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533408639916741:6232]
2025-10-02T08:08:57.477101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 476, pipe: [1:7556533408639916741:6232]
2025-10-02T08:08:57.566328Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:57.566714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639916741:6232], now have 1 active actors on pipe
2025-10-02T08:08:57.566808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:57.566816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:57.566844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 477 reason: error at write: Disconnected sessionId: src_id|7528e41d-54dcd699-da71992f-390c8d6_0
2025-10-02T08:08:57.567007Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:57.567013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 477 sessionId: src_id|7528e41d-54dcd699-da71992f-390c8d6_0 is DEAD
2025-10-02T08:08:57.566992Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:57.567186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7528e41d-54dcd699-da71992f-390c8d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:57.567194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7528e41d-54dcd699-da71992f-390c8d6_0] Write session will restart in 0.005708s
2025-10-02T08:08:57.567182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533408639916741:6232]
2025-10-02T08:08:57.567214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7528e41d-54dcd699-da71992f-390c8d6_0] Write session: Do CDS request
2025-10-02T08:08:57.567219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7528e41d-54dcd699-da71992f-390c8d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:57.574227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7528e41d-54dcd699-da71992f-390c8d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.574375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:57.574393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 478
2025-10-02T08:08:57.574593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.574639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:57.574650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:57.574658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:57.575078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 478 sessionId:  describe result for acl check
2025-10-02T08:08:57.575108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:57.575114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:57.575115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:57.575119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533408639917194:6867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:57.575568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533408639917194:6867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:57.577925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533408639917194:6867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:57.580951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533408639917194:6867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:57.580968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533408639917194:6867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:57.580971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533408639917194:6867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:57.580979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:57.581849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:57.582651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:57.582783Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:57.582790Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:57.582798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:57.582828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:57.582860Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533408639917539:6866]
2025-10-02T08:08:57.583361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:57.583504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:57.583528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:57.583725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:57.583752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.583756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.583768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.583769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.583770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.583773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.583779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.583781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.583783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.583784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.583788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.583792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.583796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.583798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.583800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.583803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.583805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.583808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.583811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.583814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.583828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:57.591593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:57.593583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:57.593593Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:57.593594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:57.593596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:57.593600Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 477 [1:7556533408639917539:6866]
2025-10-02T08:08:57.593607Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:57.593618Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:57.593622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.593624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.593625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.593638Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:57.593641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:57.593647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:57.593686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.593690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.593693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:57.593695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:57.593742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:57.593747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.593755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.593761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:57.593776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533408639917533:6866]
2025-10-02T08:08:57.593780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533408639917533:6866]
2025-10-02T08:08:57.593786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:57.593796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:57.593798Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:57.593802Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:57.593807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:57.593808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:57.593816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639917518:6867], now have 1 active actors on pipe
2025-10-02T08:08:57.593822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533409100192405:2378], now have 1 active actors on pipe
2025-10-02T08:08:57.593827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 477
2025-10-02T08:08:57.593834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533408639917533:6866]
2025-10-02T08:08:57.593840Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:57.593845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.593847Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:57.593849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.593883Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:57.593892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.593896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.593898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:57.593906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.593915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:57.593929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.593931Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 477
2025-10-02T08:08:57.593967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.593971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.593980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.594007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 478 partition: 0 MaxSeqNo: 17 sessionId: src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0
2025-10-02T08:08:57.594339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7528e41d-54dcd699-da71992f-390c8d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:57.597040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0] Write session: try to update token
2025-10-02T08:08:57.597054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:57.610410Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:57.610423Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:57.610425Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:57.610431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533408639917533:6866]
2025-10-02T08:08:57.610434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533408639917533:6866]
2025-10-02T08:08:57.610465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:57.610470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.610472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:57.610484Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:57.610494Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:57.610593Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:57.615371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId: src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:57.617846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:57.667389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533408639917564:6232]
2025-10-02T08:08:57.667518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 477, pipe: [1:7556533408639917564:6232]
2025-10-02T08:08:57.733220Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:57.733911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.733929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.733960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639917564:6232], now have 1 active actors on pipe
2025-10-02T08:08:57.734100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533408639917564:6232]
2025-10-02T08:08:57.734123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:57.734130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:57.734132Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:57.734186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 478 reason: error at write: Disconnected sessionId: src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0
2025-10-02T08:08:57.734217Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:57.734372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 478 sessionId: src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0 is DEAD
2025-10-02T08:08:57.734492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:57.734502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0] Write session will restart in 0.007553s
2025-10-02T08:08:57.734519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0] Write session: Do CDS request
2025-10-02T08:08:57.734524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:57.743244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.743314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:57.743328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 479
2025-10-02T08:08:57.743462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.743485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:57.743493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:57.743495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:57.743842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 479 sessionId:  describe result for acl check
2025-10-02T08:08:57.743865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:57.743869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:57.743871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:57.743875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533408639918044:6873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:57.744251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533408639918044:6873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:57.746739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533408639918044:6873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:57.749190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533408639918044:6873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:57.749200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533408639918044:6873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:57.749202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533408639918044:6873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:57.749207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:57.752468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:57.752740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:57.752875Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:57.752885Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:57.752892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:57.752936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:57.752961Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533408639918364:6872]
2025-10-02T08:08:57.753403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:57.753585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:57.753611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:57.753825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:57.753870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.753875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.753875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.753876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.753877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.753880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.753887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.753889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.753892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.753894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.753897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.753902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.753907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.753910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.753912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.753915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.753917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.753920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.753922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.753925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.753939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:57.763440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:57.765394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:57.765406Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:57.765408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:57.765410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:57.765425Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 478 [1:7556533408639918364:6872]
2025-10-02T08:08:57.765436Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:57.765451Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:57.765456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.765459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.765461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.765474Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:57.765481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:57.765488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:57.765538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.765543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.765546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:57.765549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:57.765605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:57.765610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.765619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.765630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:57.765650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639918321:6873], now have 1 active actors on pipe
2025-10-02T08:08:57.765659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533408639918358:6872]
2025-10-02T08:08:57.765661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 478
2025-10-02T08:08:57.765664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533408639918358:6872]
2025-10-02T08:08:57.765672Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:57.765682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:57.765685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:57.765688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:57.765691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:57.765693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:57.765696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533409100192411:2378], now have 1 active actors on pipe
2025-10-02T08:08:57.765703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.765705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.765735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533408639918358:6872]
2025-10-02T08:08:57.765745Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:57.765755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:57.765760Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:57.765766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.765769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.765770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:57.765778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.765757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 478
2025-10-02T08:08:57.765785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:57.765818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.765859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.765864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.765872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.765908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 479 partition: 0 MaxSeqNo: 17 sessionId: src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0
2025-10-02T08:08:57.766263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5cbb47-8647f398-64af943a-bce2fa0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:57.768685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0] Write session: try to update token
2025-10-02T08:08:57.768697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:57.776111Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:08:57.782031Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:57.782044Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:57.782046Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:57.782053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533408639918358:6872]
2025-10-02T08:08:57.782057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533408639918358:6872]
2025-10-02T08:08:57.782093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:57.782098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.782104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:57.782108Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:57.782115Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:57.782242Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:57.785036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId: src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:57.787364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:57.846809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533408639918405:6232]
2025-10-02T08:08:57.848464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 478, pipe: [1:7556533408639918405:6232]
2025-10-02T08:08:57.901167Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:57.901822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.901834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.901872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639918405:6232], now have 1 active actors on pipe
2025-10-02T08:08:57.901987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533408639918405:6232]
2025-10-02T08:08:57.902015Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:57.902019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:57.902021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:57.902081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 479 reason: error at write: Disconnected sessionId: src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0
2025-10-02T08:08:57.902067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:57.902259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 479 sessionId: src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0 is DEAD
2025-10-02T08:08:57.902395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:57.902403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0] Write session will restart in 0.009309s
2025-10-02T08:08:57.902424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0] Write session: Do CDS request
2025-10-02T08:08:57.902429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:57.913150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.913257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:57.913271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 480
2025-10-02T08:08:57.913370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:57.913393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:57.913399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:57.913402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:57.913704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 480 sessionId:  describe result for acl check
2025-10-02T08:08:57.913732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:57.913733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:57.913734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:57.913737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533408639919177:6892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:57.914104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533408639919177:6892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:57.915273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:57.915878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533408639919177:6892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:57.916215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:57.916332Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:57.916340Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:57.916347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:57.916375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:57.916401Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533408639919227:6891]
2025-10-02T08:08:57.916825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:57.916966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:57.917011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:57.917406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:57.917444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.917449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.917450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.917451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.917451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.917454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.917461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.917463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.917465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.917467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.917470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.917474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:57.917479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.917481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:57.917483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.917486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:57.917488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.917490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.917492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.917495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.917505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:57.921852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533408639919177:6892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:57.921862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533408639919177:6892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:57.921865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533408639919177:6892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:57.921871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:57.925036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:57.926701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:57.926713Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:57.926715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:57.926717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:57.926722Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 479 [1:7556533408639919227:6891]
2025-10-02T08:08:57.926730Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:57.926743Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:57.926745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.926746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.926748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.926760Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:57.926762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:57.926766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:57.926805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.926813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.926815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:57.926817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:57.926860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:57.926867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.926874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:57.926880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:57.926893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533408639919212:6891]
2025-10-02T08:08:57.926899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533408639919212:6891]
2025-10-02T08:08:57.926904Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:57.926906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 479
2025-10-02T08:08:57.926912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:57.926914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533408639919245:6892], now have 1 active actors on pipe
2025-10-02T08:08:57.926914Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:57.926920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:57.926928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:57.926930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:57.926933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533409100192443:2378], now have 1 active actors on pipe
2025-10-02T08:08:57.926937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.926941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.926968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533408639919212:6891]
2025-10-02T08:08:57.926975Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:57.926985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:57.926985Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:57.926989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:57.926992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:57.926980Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 479
2025-10-02T08:08:57.926993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:57.926998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:57.927004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:57.927028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.927057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:57.927064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:57.927073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:57.927099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 480 partition: 0 MaxSeqNo: 17 sessionId: src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0
2025-10-02T08:08:57.927384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0cc0f42-c831bad0-2a816a2c-1773e611_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:57.930074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0] Write session: try to update token
2025-10-02T08:08:57.930086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:57.943658Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:57.943675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:57.943676Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:57.943683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533408639919212:6891]
2025-10-02T08:08:57.943686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533408639919212:6891]
2025-10-02T08:08:57.943715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:57.943717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:57.943719Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:57.943722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:57.943724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:57.943821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId: src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:57.943922Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:57.946337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:58.002228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533412934886554:6232]
2025-10-02T08:08:58.002323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 479, pipe: [1:7556533412934886554:6232]
2025-10-02T08:08:58.070930Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:58.071244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.071257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.071286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934886554:6232], now have 1 active actors on pipe
2025-10-02T08:08:58.071403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:58.071416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:58.071444Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:58.071472Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:58.071482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 480 reason: error at write: Disconnected sessionId: src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0
2025-10-02T08:08:58.071680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533412934886554:6232]
2025-10-02T08:08:58.071683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 480 sessionId: src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0 is DEAD
2025-10-02T08:08:58.071850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:58.071859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0] Write session will restart in 0.006502s
2025-10-02T08:08:58.071886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0] Write session: Do CDS request
2025-10-02T08:08:58.071892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:58.079226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.079256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:58.079270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 481
2025-10-02T08:08:58.079399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.079427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:58.079436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:58.079439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:58.079731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 481 sessionId:  describe result for acl check
2025-10-02T08:08:58.079767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:58.079772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:58.079773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:58.079776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533412934887075:6898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:58.080110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533412934887075:6898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:58.081758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533412934887075:6898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:58.084187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533412934887075:6898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:58.084198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533412934887075:6898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:58.084201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533412934887075:6898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:58.084207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:58.085817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:58.086063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:58.086173Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:58.086180Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:58.086187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:58.086213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:58.086240Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533412934887359:6897]
2025-10-02T08:08:58.086643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:58.086761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:58.086786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:58.086975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:58.087003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.087007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.087008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.087008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.087009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.087012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.087017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.087019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.087021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.087023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.087026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.087030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.087033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.087040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.087044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.087050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.087052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.087055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.087061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.087063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.087074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:58.094762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:58.096339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:58.096349Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:58.096350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:58.096353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:58.096358Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 480 [1:7556533412934887359:6897]
2025-10-02T08:08:58.096365Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:58.096377Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:58.096379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.096380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.096382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.096393Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:58.096402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:58.096406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:58.096445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.096449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.096452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:58.096453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:58.096496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:58.096501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.096507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.096514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:58.096529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934887341:6898], now have 1 active actors on pipe
2025-10-02T08:08:58.096537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533412934887353:6897]
2025-10-02T08:08:58.096539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533412934887353:6897]
2025-10-02T08:08:58.096544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:58.096543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 480
2025-10-02T08:08:58.096551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:58.096553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:58.096558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:58.096560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:58.096562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:58.096565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533413395159745:2378], now have 1 active actors on pipe
2025-10-02T08:08:58.096569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.096571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.096597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533412934887353:6897]
2025-10-02T08:08:58.096605Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:58.096613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:58.096620Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:58.096625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.096632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.096634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:58.096642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.096650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:58.096627Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 480
2025-10-02T08:08:58.096680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.096709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.096714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.096723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.096750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 481 partition: 0 MaxSeqNo: 17 sessionId: src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0
2025-10-02T08:08:58.097084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb22dcc8-e9dfe19d-834f6afc-5cd68b9d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:58.099664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0] Write session: try to update token
2025-10-02T08:08:58.099677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:58.113507Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:58.113523Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:58.113525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:58.113532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533412934887353:6897]
2025-10-02T08:08:58.113535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533412934887353:6897]
2025-10-02T08:08:58.113565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:58.113567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:58.113569Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:58.113572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.113574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:58.113708Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:58.114181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId: src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:58.116646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:58.171699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533412934887383:6232]
2025-10-02T08:08:58.171804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 480, pipe: [1:7556533412934887383:6232]
2025-10-02T08:08:58.238705Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:58.239294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.239307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.239339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934887383:6232], now have 1 active actors on pipe
2025-10-02T08:08:58.239447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533412934887383:6232]
2025-10-02T08:08:58.239466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:58.239468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:58.239499Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:58.239520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 481 reason: error at write: Disconnected sessionId: src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0
2025-10-02T08:08:58.239551Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:58.239691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 481 sessionId: src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0 is DEAD
2025-10-02T08:08:58.239878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:58.239888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0] Write session will restart in 0.009021s
2025-10-02T08:08:58.239913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0] Write session: Do CDS request
2025-10-02T08:08:58.239920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:58.250238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.250276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:58.250289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 482
2025-10-02T08:08:58.250415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.250438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:58.250441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:58.250443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:58.250747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 482 sessionId:  describe result for acl check
2025-10-02T08:08:58.250771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:58.250776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:58.250777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:58.250780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533412934888047:6904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:58.251148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533412934888047:6904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:58.253297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533412934888047:6904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:58.254367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:58.255261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:58.255380Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:58.255387Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:58.255393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:58.255426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:58.255461Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533412934888184:6903]
2025-10-02T08:08:58.255816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533412934888047:6904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:58.255825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533412934888047:6904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:58.255828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533412934888047:6904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:58.255833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:58.255930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:58.256057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:58.256099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:58.256372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:58.256428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.256434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.256435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.256436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.256436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.256441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.256449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.256452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.256455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.256463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.256467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.256473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.256478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.256488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.256495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.256499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.256507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.256512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.256520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.256523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.256542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:58.264328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:58.266277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:58.266289Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:58.266291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:58.266293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:58.266298Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 481 [1:7556533412934888184:6903]
2025-10-02T08:08:58.266305Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:58.266317Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:58.266319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.266320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.266321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.266333Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:58.266340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:58.266344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:58.266386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.266391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.266394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:58.266395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:58.266450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:58.266455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.266464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.266470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:58.266482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 481
2025-10-02T08:08:58.266485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934888189:6904], now have 1 active actors on pipe
2025-10-02T08:08:58.266487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533413395159752:2378], now have 1 active actors on pipe
2025-10-02T08:08:58.266492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533412934888178:6903]
2025-10-02T08:08:58.266493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533412934888178:6903]
2025-10-02T08:08:58.266502Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:58.266508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.266511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.266515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:58.266518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:58.266523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:58.266533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:58.266539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:58.266560Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 481
2025-10-02T08:08:58.266573Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:58.266585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.266588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.266589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:58.266594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.266600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:58.266605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533412934888178:6903]
2025-10-02T08:08:58.266609Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:58.266613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:58.266627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.266662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.266668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.266679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.266708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 482 partition: 0 MaxSeqNo: 17 sessionId: src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0
2025-10-02T08:08:58.267007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f159f3bb-bb11ed36-99a12710-92b9206d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:58.270054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0] Write session: try to update token
2025-10-02T08:08:58.270065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:58.283239Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:58.283255Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:58.283257Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:58.283265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533412934888178:6903]
2025-10-02T08:08:58.283269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533412934888178:6903]
2025-10-02T08:08:58.283300Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:58.283303Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:58.283313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:58.283319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.283321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:58.283471Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:58.284825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId: src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:58.287405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:58.339637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533412934888226:6232]
2025-10-02T08:08:58.339739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 481, pipe: [1:7556533412934888226:6232]
2025-10-02T08:08:58.408460Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:58.409012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.409022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.409056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934888226:6232], now have 1 active actors on pipe
2025-10-02T08:08:58.409161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:58.409169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:58.409214Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:58.409221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 482 reason: error at write: Disconnected sessionId: src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0
2025-10-02T08:08:58.409249Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:58.409384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 482 sessionId: src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0 is DEAD
2025-10-02T08:08:58.409441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533412934888226:6232]
2025-10-02T08:08:58.409497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:58.409506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0] Write session will restart in 0.009607s
2025-10-02T08:08:58.409531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0] Write session: Do CDS request
2025-10-02T08:08:58.409538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:58.420236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.420260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:58.420269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 483
2025-10-02T08:08:58.420410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.420431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:58.420437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:58.420439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:58.420740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 483 sessionId:  describe result for acl check
2025-10-02T08:08:58.420763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:58.420768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:58.420769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:58.420773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533412934888963:6912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:58.421245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533412934888963:6912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:58.422573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533412934888963:6912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:58.423556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:58.423804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:58.423902Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:58.423910Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:58.423916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:58.423941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:58.423965Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533412934889036:6910]
2025-10-02T08:08:58.424105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533412934888963:6912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:58.424115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533412934888963:6912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:58.424117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533412934888963:6912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:58.424121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:58.424511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:58.424633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:58.424656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:58.424873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:58.424912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.424917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.424918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.424918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.424919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.424922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.424928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.424930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.424932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.424934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.424937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.424941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.424945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.424947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.424949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.424952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.424954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.424957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.424959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.424962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.424973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:58.432299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:58.434029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:58.434042Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:58.434043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:58.434045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:58.434050Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 482 [1:7556533412934889036:6910]
2025-10-02T08:08:58.434056Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:58.434068Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:58.434073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.434076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.434077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.434089Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:58.434092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:58.434097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:58.434138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.434145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.434147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:58.434149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:58.434200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:58.434207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.434214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.434220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:58.434232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533413395159773:2378], now have 1 active actors on pipe
2025-10-02T08:08:58.434234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934889041:6912], now have 1 active actors on pipe
2025-10-02T08:08:58.434238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533412934889030:6910]
2025-10-02T08:08:58.434240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533412934889030:6910]
2025-10-02T08:08:58.434243Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:58.434251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:58.434258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:58.434258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 482
2025-10-02T08:08:58.434259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:58.434260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:58.434260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:58.434277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533412934889030:6910]
2025-10-02T08:08:58.434283Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:58.434284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:58.434287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.434289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.434318Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:58.434325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.434294Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 482
2025-10-02T08:08:58.434328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.434329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:58.434336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.434342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:58.434359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.434385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.434392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.434402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.434438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 483 partition: 0 MaxSeqNo: 17 sessionId: src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0
2025-10-02T08:08:58.434695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b3f7e4-16dfb7e9-2f1f65d7-18f1a6ee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:58.437332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0] Write session: try to update token
2025-10-02T08:08:58.437344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:58.450087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId: src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:58.450366Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:58.450379Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:58.450380Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:58.450386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533412934889030:6910]
2025-10-02T08:08:58.450390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533412934889030:6910]
2025-10-02T08:08:58.450419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:58.450427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.450428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:58.450452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:58.450461Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:58.450567Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:58.452451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:58.509621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533412934889069:6232]
2025-10-02T08:08:58.509709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 482, pipe: [1:7556533412934889069:6232]
2025-10-02T08:08:58.569679Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:58.570306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.570320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.570362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934889069:6232], now have 1 active actors on pipe
2025-10-02T08:08:58.570489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:58.570503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:58.570542Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:58.570577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 483 reason: error at write: Disconnected sessionId: src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0
2025-10-02T08:08:58.570591Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:58.570764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 483 sessionId: src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0 is DEAD
2025-10-02T08:08:58.570900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:58.570907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0] Write session will restart in 0.006988s
2025-10-02T08:08:58.570925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0] Write session: Do CDS request
2025-10-02T08:08:58.570930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:58.570949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533412934889069:6232]
2025-10-02T08:08:58.579246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.579316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:58.579335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 484
2025-10-02T08:08:58.579436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.579468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:58.579477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:58.579480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:58.579862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 484 sessionId:  describe result for acl check
2025-10-02T08:08:58.579899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:58.579905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:58.579906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:58.579910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533412934889518:6918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:58.580388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533412934889518:6918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:58.582358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533412934889518:6918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:58.585162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533412934889518:6918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:58.585176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533412934889518:6918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:58.585178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533412934889518:6918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:58.585183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:58.588859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:58.589131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:58.589254Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:58.589262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:58.589269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:58.589297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:58.589325Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533412934889879:6917]
2025-10-02T08:08:58.589748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:58.589880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:58.589903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:58.590102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:58.590136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.590139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.590140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.590141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.590142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.590145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.590151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.590153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.590155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.590157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.590160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.590165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.590168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.590171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.590174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.590176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.590178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.590181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.590184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.590187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.590197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:58.597692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:58.599708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:58.599725Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:58.599727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:58.599730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:58.599736Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 483 [1:7556533412934889879:6917]
2025-10-02T08:08:58.599744Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:58.599768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:58.599775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.599777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.599778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.599788Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:58.599792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:58.599796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:58.599847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.599854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.599856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:58.599858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:58.599907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:58.599913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.599924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.599930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:58.599943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934889814:6918], now have 1 active actors on pipe
2025-10-02T08:08:58.599952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533412934889873:6917]
2025-10-02T08:08:58.599953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533412934889873:6917]
2025-10-02T08:08:58.599956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 483
2025-10-02T08:08:58.599958Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:58.599967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:58.599966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:58.599969Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:58.599980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:58.599982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:58.599985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533413395159780:2378], now have 1 active actors on pipe
2025-10-02T08:08:58.599988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.599992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.600024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533412934889873:6917]
2025-10-02T08:08:58.600035Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:58.600042Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:58.600046Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:58.600050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.600052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.600053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:58.600059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.600065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:58.600064Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 483
2025-10-02T08:08:58.600090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.600128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.600134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.600142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.600172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 484 partition: 0 MaxSeqNo: 17 sessionId: src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0
2025-10-02T08:08:58.600561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4891b44-a761ee92-15d16a53-419bbbf3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:58.603293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0] Write session: try to update token
2025-10-02T08:08:58.603309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:58.617074Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:58.617092Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:58.617094Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:58.617101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533412934889873:6917]
2025-10-02T08:08:58.617105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533412934889873:6917]
2025-10-02T08:08:58.617140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:58.617145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.617146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:58.617151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:58.617158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:58.617276Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:58.618427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId: src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:58.620895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:58.670890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533412934889903:6232]
2025-10-02T08:08:58.670967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 483, pipe: [1:7556533412934889903:6232]
2025-10-02T08:08:58.743054Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:58.743392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.743406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.743440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934889903:6232], now have 1 active actors on pipe
2025-10-02T08:08:58.743540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:58.743546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:58.743588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 484 reason: error at write: Disconnected sessionId: src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0
2025-10-02T08:08:58.743640Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:58.743717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 484 sessionId: src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0 is DEAD
2025-10-02T08:08:58.743713Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:58.743846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533412934889903:6232]
2025-10-02T08:08:58.743876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:58.743884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0] Write session will restart in 0.006405s
2025-10-02T08:08:58.743901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0] Write session: Do CDS request
2025-10-02T08:08:58.743906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:58.751207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.751252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:58.751265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 485
2025-10-02T08:08:58.751354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.751384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:58.751390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:58.751394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:58.751722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 485 sessionId:  describe result for acl check
2025-10-02T08:08:58.751745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:58.751751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:58.751753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:58.751790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533412934890365:6924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:58.752162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533412934890365:6924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:58.754509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533412934890365:6924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:58.757302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533412934890365:6924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:58.757312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533412934890365:6924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:58.757314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533412934890365:6924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:58.757319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:58.761963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:58.762318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:58.762438Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:58.762444Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:58.762451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:58.762477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:58.762502Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533412934890716:6923]
2025-10-02T08:08:58.762929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:58.763082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:58.763107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:58.763306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:58.763344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.763349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.763350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.763351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.763352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.763357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.763366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.763373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.763377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.763384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.763388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.763398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.763407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.763416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.763425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.763434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.763437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.763442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.763450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.763458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.763478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:58.770942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:58.772545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:58.772561Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:58.772563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:58.772566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:58.772572Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 484 [1:7556533412934890716:6923]
2025-10-02T08:08:58.772583Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:58.772599Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:58.772601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.772605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.772607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.772622Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:58.772627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:58.772635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:58.772692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.772700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.772703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:58.772706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:58.772765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:58.772772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.772784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.772815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:58.772835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 484
2025-10-02T08:08:58.772838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934890637:6924], now have 1 active actors on pipe
2025-10-02T08:08:58.772844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533412934890710:6923]
2025-10-02T08:08:58.772846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533412934890710:6923]
2025-10-02T08:08:58.772859Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:58.772872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533413395159787:2378], now have 1 active actors on pipe
2025-10-02T08:08:58.772881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.772881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:58.772885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:58.772889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.772906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:58.772923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:58.772931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:58.772918Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 484
2025-10-02T08:08:58.772969Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b964f18f-a1207feb-65343576-2c5cefcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:58.772979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.772987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.772989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:58.772998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.773009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:58.773022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533412934890710:6923]
2025-10-02T08:08:58.773034Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:58.773052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:58.773072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.773116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.773122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.773134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.773169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 485 partition: 0 MaxSeqNo: 17 sessionId: src_id|b964f18f-a1207feb-65343576-2c5cefcc_0
2025-10-02T08:08:58.773561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8b7116-3a9634dc-c45bb64b-a9629443_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b964f18f-a1207feb-65343576-2c5cefcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:58.776986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b964f18f-a1207feb-65343576-2c5cefcc_0] Write session: try to update token
2025-10-02T08:08:58.776997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b964f18f-a1207feb-65343576-2c5cefcc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:58.789174Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:58.789189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:58.789192Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:58.789200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533412934890710:6923]
2025-10-02T08:08:58.789204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533412934890710:6923]
2025-10-02T08:08:58.789246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:58.789247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:58.789253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:58.789257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.789260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:58.789412Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:58.791329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId: src_id|b964f18f-a1207feb-65343576-2c5cefcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:58.793787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:58.843960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533412934890742:6232]
2025-10-02T08:08:58.844110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 484, pipe: [1:7556533412934890742:6232]
2025-10-02T08:08:58.913991Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:58.914582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.914600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.914633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934890742:6232], now have 1 active actors on pipe
2025-10-02T08:08:58.914763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:58.914768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:58.914817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 485 reason: error at write: Disconnected sessionId: src_id|b964f18f-a1207feb-65343576-2c5cefcc_0
2025-10-02T08:08:58.914902Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:58.914951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 485 sessionId: src_id|b964f18f-a1207feb-65343576-2c5cefcc_0 is DEAD
2025-10-02T08:08:58.915065Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:58.915076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533412934890742:6232]
2025-10-02T08:08:58.915098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b964f18f-a1207feb-65343576-2c5cefcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:58.915106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b964f18f-a1207feb-65343576-2c5cefcc_0] Write session will restart in 0.007590s
2025-10-02T08:08:58.915126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b964f18f-a1207feb-65343576-2c5cefcc_0] Write session: Do CDS request
2025-10-02T08:08:58.915132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b964f18f-a1207feb-65343576-2c5cefcc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:58.924262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b964f18f-a1207feb-65343576-2c5cefcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.924338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:58.924351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 486
2025-10-02T08:08:58.924643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:58.924673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:58.924679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:58.924682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:58.925239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 486 sessionId:  describe result for acl check
2025-10-02T08:08:58.925271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:58.925277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:58.925278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:58.925281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533412934891288:6941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:58.925689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533412934891288:6941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:58.927847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533412934891288:6941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:58.930859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533412934891288:6941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:58.930871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533412934891288:6941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:58.930873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533412934891288:6941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:58.930879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:58.933178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:58.935150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:58.935294Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:58.935302Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:58.935311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:58.935342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:58.935379Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533412934891592:6940]
2025-10-02T08:08:58.935837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:58.936039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:58.936065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:58.936267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:58.936300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.936309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.936310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.936310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.936311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.936315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.936322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.936324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.936326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.936328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.936332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.936337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:58.936340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.936344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:58.936346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.936350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:58.936354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.936357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.936359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.936362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.936374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:58.944500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:58.946276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:58.946288Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:58.946290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:58.946293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:58.946299Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 485 [1:7556533412934891592:6940]
2025-10-02T08:08:58.946309Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:58.946326Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:58.946333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.946336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.946338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.946354Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:58.946358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:58.946365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:58.946416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.946423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.946426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:58.946428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:58.946489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:58.946496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.946504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:58.946511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:58.946533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533412934891564:6941], now have 1 active actors on pipe
2025-10-02T08:08:58.946545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533412934891586:6940]
2025-10-02T08:08:58.946546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533412934891586:6940]
2025-10-02T08:08:58.946552Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:58.946559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 485
2025-10-02T08:08:58.946565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533413395159809:2378], now have 1 active actors on pipe
2025-10-02T08:08:58.946567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:58.946570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:58.946573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:58.946581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:58.946588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:58.946595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.946602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.946639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533412934891586:6940]
2025-10-02T08:08:58.946647Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:58.946661Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44f18f61-e1f4371b-e9959143-fa923534_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:58.946667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:58.946671Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:58.946675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:58.946676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:58.946684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:58.946658Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 485
2025-10-02T08:08:58.946691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:58.946728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.946773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:58.946780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:58.946789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:58.946823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 486 partition: 0 MaxSeqNo: 17 sessionId: src_id|44f18f61-e1f4371b-e9959143-fa923534_0
2025-10-02T08:08:58.947162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b964f18f-a1207feb-65343576-2c5cefcc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|44f18f61-e1f4371b-e9959143-fa923534_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:58.949740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f18f61-e1f4371b-e9959143-fa923534_0] Write session: try to update token
2025-10-02T08:08:58.949752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f18f61-e1f4371b-e9959143-fa923534_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:58.963015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId: src_id|44f18f61-e1f4371b-e9959143-fa923534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:58.963658Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:58.963675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:58.963678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:58.963688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533412934891586:6940]
2025-10-02T08:08:58.963693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533412934891586:6940]
2025-10-02T08:08:58.963730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:58.963741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:58.963742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:58.963771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:58.963788Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:58.963890Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:58.965625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:59.014964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533417229858912:6232]
2025-10-02T08:08:59.015080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 485, pipe: [1:7556533417229858912:6232]
2025-10-02T08:08:59.091966Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:59.092615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.092628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.092666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229858912:6232], now have 1 active actors on pipe
2025-10-02T08:08:59.092820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:59.092830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:59.092830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:59.092869Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:59.092900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 486 reason: error at write: Disconnected sessionId: src_id|44f18f61-e1f4371b-e9959143-fa923534_0
2025-10-02T08:08:59.093055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 486 sessionId: src_id|44f18f61-e1f4371b-e9959143-fa923534_0 is DEAD
2025-10-02T08:08:59.093180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533417229858912:6232]
2025-10-02T08:08:59.093224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f18f61-e1f4371b-e9959143-fa923534_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:59.093237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f18f61-e1f4371b-e9959143-fa923534_0] Write session will restart in 0.007411s
2025-10-02T08:08:59.093262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f18f61-e1f4371b-e9959143-fa923534_0] Write session: Do CDS request
2025-10-02T08:08:59.093268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f18f61-e1f4371b-e9959143-fa923534_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:59.102242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f18f61-e1f4371b-e9959143-fa923534_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.102279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:59.102295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 487
2025-10-02T08:08:59.102492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.102528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:59.102534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:59.102538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:59.102869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 487 sessionId:  describe result for acl check
2025-10-02T08:08:59.102895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:59.102899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:59.102900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:59.102903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533417229859400:6949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:59.103339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533417229859400:6949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:59.105970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533417229859400:6949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:59.108502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533417229859400:6949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:59.108513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533417229859400:6949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:59.108515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533417229859400:6949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:59.108520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:59.112216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:59.112540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:59.112714Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:59.112722Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:59.112729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:59.112761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:59.112786Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533417229859735:6948]
2025-10-02T08:08:59.113271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:59.113709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:59.113750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:59.113969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:59.114019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.114023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.114023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.114024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.114024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.114028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.114034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.114036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.114038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.114040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.114044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.114048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.114051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.114054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.114057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.114060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.114066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.114068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.114071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.114074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.114087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:59.121333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:59.122909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:59.122920Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:59.122921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:59.122924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:59.122928Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 486 [1:7556533417229859735:6948]
2025-10-02T08:08:59.122934Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:59.122946Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:59.122947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.122949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.122950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.122970Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:59.122977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:59.122983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:59.123018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.123023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.123026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:59.123028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:59.123070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:59.123075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.123081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.123087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:59.123100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533417229859723:6948]
2025-10-02T08:08:59.123105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533417229859723:6948]
2025-10-02T08:08:59.123111Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:59.123121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:59.123132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:59.123137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:59.123154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:59.123157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229859689:6949], now have 1 active actors on pipe
2025-10-02T08:08:59.123160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533417229859723:6948]
2025-10-02T08:08:59.123161Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:59.123164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533417690127121:2378], now have 1 active actors on pipe
2025-10-02T08:08:59.123167Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:59.123167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 486
2025-10-02T08:08:59.123175Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:59.123185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.123187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.123205Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:59.123214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.123216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.123220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:59.123226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.123233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:59.123245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.123268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.123272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.123281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.123308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 487 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0
2025-10-02T08:08:59.123318Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 486
2025-10-02T08:08:59.123671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f18f61-e1f4371b-e9959143-fa923534_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:59.126307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0] Write session: try to update token
2025-10-02T08:08:59.126318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:59.139021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId: src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:59.139252Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:59.139266Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:59.139267Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:59.139273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533417229859723:6948]
2025-10-02T08:08:59.139276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533417229859723:6948]
2025-10-02T08:08:59.139308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:59.139319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.139324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:59.139386Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:59.139401Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:59.139461Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:59.141450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:59.193148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533417229859768:6232]
2025-10-02T08:08:59.193285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 486, pipe: [1:7556533417229859768:6232]
2025-10-02T08:08:59.259722Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:59.260108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.260117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.260145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229859768:6232], now have 1 active actors on pipe
2025-10-02T08:08:59.260243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:59.260252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:59.260301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 487 reason: error at write: Disconnected sessionId: src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0
2025-10-02T08:08:59.260329Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:59.260369Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:59.260410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 487 sessionId: src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0 is DEAD
2025-10-02T08:08:59.260495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533417229859768:6232]
2025-10-02T08:08:59.260541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:59.260549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0] Write session will restart in 0.008577s
2025-10-02T08:08:59.260575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0] Write session: Do CDS request
2025-10-02T08:08:59.260580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:59.265070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:59.265840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:59.265993Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:59.266002Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:59.266011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:59.266054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:59.266092Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533417229859824:6954]
2025-10-02T08:08:59.266685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:59.267123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:59.267165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:59.267373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:59.267402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.267406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.267407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.267408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.267409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.267412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.267418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.267420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.267422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.267424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.267428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.267432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.267435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.267438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.267440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.267443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.267445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.267448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.267450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.267453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.267463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:59.270264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.270311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:59.270320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 488
2025-10-02T08:08:59.270444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.270475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:59.270481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:59.270484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:59.270808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 488 sessionId:  describe result for acl check
2025-10-02T08:08:59.270837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:59.270841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:59.270842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:59.270846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533417229859840:6956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:59.271237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533417229859840:6956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:59.273092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533417229859840:6956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:59.274901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533417229859840:6956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:59.274911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533417229859840:6956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:59.274913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533417229859840:6956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:59.274918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:59.274918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:59.276222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:59.276234Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:59.276236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:59.276238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:59.276242Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 487 [1:7556533417229859824:6954]
2025-10-02T08:08:59.276249Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:59.276259Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:59.276260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.276263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.276264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.276274Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:59.276277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:59.276286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:59.276325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.276330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.276332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:59.276334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:59.276379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:59.276384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.276393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.276400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:59.276415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229859873:6956], now have 1 active actors on pipe
2025-10-02T08:08:59.276421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533417690127128:2378], now have 1 active actors on pipe
2025-10-02T08:08:59.276425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533417229859818:6954]
2025-10-02T08:08:59.276427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 487
2025-10-02T08:08:59.276430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533417229859818:6954]
2025-10-02T08:08:59.276435Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:59.276442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:59.276444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:59.276447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:59.276453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:59.276454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:59.276459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.276465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.276454Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 487
2025-10-02T08:08:59.276490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533417229859818:6954]
2025-10-02T08:08:59.276502Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:59.276517Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:59.276517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:59.276521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.276523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.276524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:59.276530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.276536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:59.276561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.276609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.276614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.276623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.276648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 488 partition: 0 MaxSeqNo: 17 sessionId: src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0
2025-10-02T08:08:59.276908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa073f84-ccf5fd76-3eb1cc2-2a4a3ed9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:59.279697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0] Write session: try to update token
2025-10-02T08:08:59.279722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:59.292722Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:59.292737Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:59.292739Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:59.292851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533417229859818:6954]
2025-10-02T08:08:59.292859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533417229859818:6954]
2025-10-02T08:08:59.292891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:59.292899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.292901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:59.292899Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:59.292904Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:59.293027Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:59.293469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId: src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:59.295635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:59.360579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533417229859907:6232]
2025-10-02T08:08:59.360715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 487, pipe: [1:7556533417229859907:6232]
2025-10-02T08:08:59.414749Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:59.414987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.414997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.415026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229859907:6232], now have 1 active actors on pipe
2025-10-02T08:08:59.415115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533417229859907:6232]
2025-10-02T08:08:59.415129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:59.415134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:59.415174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 488 reason: error at write: Disconnected sessionId: src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0
2025-10-02T08:08:59.415204Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:59.415251Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:59.415320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 488 sessionId: src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0 is DEAD
2025-10-02T08:08:59.415488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:59.415501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0] Write session will restart in 0.005687s
2025-10-02T08:08:59.415521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0] Write session: Do CDS request
2025-10-02T08:08:59.415527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:59.418899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:59.419474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:59.419577Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:59.419583Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:59.419589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:59.419616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:59.419644Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533417229859969:6964]
2025-10-02T08:08:59.420045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:59.420173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:59.420199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:59.420378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:59.420402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.420406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.420407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.420408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.420408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.420411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.420417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.420419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.420421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.420423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.420426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.420430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.420434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.420436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.420438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.420441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.420443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.420446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.420448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.420451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.420461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:59.422178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.422354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:59.422360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 489
2025-10-02T08:08:59.422482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.422504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:59.422507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:59.422509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:59.422816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 489 sessionId:  describe result for acl check
2025-10-02T08:08:59.422843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:59.422847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:59.422848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:59.422852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533417229859985:6966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:59.423204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533417229859985:6966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:59.424469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533417229859985:6966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:59.427152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533417229859985:6966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:59.427161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533417229859985:6966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:59.427163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533417229859985:6966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:59.427169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:59.427841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:59.429269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:59.429280Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:59.429282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:59.429284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:59.429289Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 488 [1:7556533417229859969:6964]
2025-10-02T08:08:59.429296Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:59.429308Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:59.429314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.429316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.429317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.429327Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:59.429334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:59.429339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:59.429379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.429384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.429386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:59.429387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:59.429438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:59.429445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.429454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.429468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:59.429476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 488
2025-10-02T08:08:59.429489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229860016:6966], now have 1 active actors on pipe
2025-10-02T08:08:59.429498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533417229859963:6964]
2025-10-02T08:08:59.429500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533417229859963:6964]
2025-10-02T08:08:59.429508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:59.429519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533417690127156:2378], now have 1 active actors on pipe
2025-10-02T08:08:59.429527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.429527Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:59.429531Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:59.429534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.429552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:59.429568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:59.429574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:59.429559Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 488
2025-10-02T08:08:59.429604Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:59.429611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.429614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.429618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:59.429624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.429634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:59.429642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533417229859963:6964]
2025-10-02T08:08:59.429652Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:59.429664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:59.429673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.429709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.429717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.429734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.429758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 489 partition: 0 MaxSeqNo: 17 sessionId: src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0
2025-10-02T08:08:59.430041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31ec5fd-8c51a687-54437ee5-fd56ebd3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:59.432567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0] Write session: try to update token
2025-10-02T08:08:59.432578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:59.444756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId: src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:59.446325Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:59.446338Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:59.446342Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:59.446348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533417229859963:6964]
2025-10-02T08:08:59.446351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533417229859963:6964]
2025-10-02T08:08:59.446378Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:59.446381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:59.446386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.446387Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:59.446387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:59.446502Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:59.447901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:59.515182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533417229860033:6232]
2025-10-02T08:08:59.515300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 488, pipe: [1:7556533417229860033:6232]
2025-10-02T08:08:59.565112Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:59.565397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.565406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.565435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229860033:6232], now have 1 active actors on pipe
2025-10-02T08:08:59.565539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533417229860033:6232]
2025-10-02T08:08:59.565555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:59.565557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:59.565587Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:59.565594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 489 reason: error at write: Disconnected sessionId: src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0
2025-10-02T08:08:59.565628Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:59.565762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 489 sessionId: src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0 is DEAD
2025-10-02T08:08:59.565903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:59.565914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0] Write session will restart in 0.007349s
2025-10-02T08:08:59.565934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0] Write session: Do CDS request
2025-10-02T08:08:59.565940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:59.569270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:59.569837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:59.569939Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:59.569946Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:59.569952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:59.569979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:59.570004Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533417229860093:6970]
2025-10-02T08:08:59.570377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:59.570505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:59.570528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:59.570706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:59.570730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.570734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.570734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.570735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.570736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.570738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.570744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.570746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.570748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.570751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.570754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.570758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.570762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.570764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.570766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.570769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.570771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.570774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.570777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.570783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.570792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:59.574162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.574281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:59.574291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 490
2025-10-02T08:08:59.574435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.574461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:59.574468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:59.574471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:59.574792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 490 sessionId:  describe result for acl check
2025-10-02T08:08:59.574820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:59.574826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:59.574828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:59.574833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533417229860109:6972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:59.575284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533417229860109:6972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:59.576661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533417229860109:6972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:59.577871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:59.578686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533417229860109:6972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:59.578696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533417229860109:6972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:59.578698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533417229860109:6972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:59.578702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:59.579129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:59.579140Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:59.579142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:59.579144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:59.579147Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 489 [1:7556533417229860093:6970]
2025-10-02T08:08:59.579153Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:59.579165Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:59.579170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.579172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.579173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.579182Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:59.579188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:59.579192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:59.579228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.579233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.579235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:59.579238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:59.579275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:59.579280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.579286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.579293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:59.579298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 489
2025-10-02T08:08:59.579308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229860141:6972], now have 1 active actors on pipe
2025-10-02T08:08:59.579314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533417690127162:2378], now have 1 active actors on pipe
2025-10-02T08:08:59.579317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533417229860087:6970]
2025-10-02T08:08:59.579322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533417229860087:6970]
2025-10-02T08:08:59.579326Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:59.579332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.579337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.579341Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:59.579347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:59.579349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:59.579324Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 489
2025-10-02T08:08:59.579356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:59.579360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:59.579383Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:59.579389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.579392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.579393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:59.579399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.579406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:59.579418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533417229860087:6970]
2025-10-02T08:08:59.579425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:59.579431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:59.579439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.579471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.579475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.579483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.579506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 490 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0
2025-10-02T08:08:59.579774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a83efdd2-9bdee3c4-4fac3d28-a8f04a58_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:59.582069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0] Write session: try to update token
2025-10-02T08:08:59.582083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:59.594930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId: src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:59.595297Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:59.595309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:59.595311Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:59.595317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533417229860087:6970]
2025-10-02T08:08:59.595321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533417229860087:6970]
2025-10-02T08:08:59.595348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:59.595356Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:59.595359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:59.595366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.595373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:59.595511Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:59.597242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:59.665710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533417229860155:6232]
2025-10-02T08:08:59.665799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 489, pipe: [1:7556533417229860155:6232]
2025-10-02T08:08:59.716846Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:59.717105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.717115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.717147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229860155:6232], now have 1 active actors on pipe
2025-10-02T08:08:59.717232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533417229860155:6232]
2025-10-02T08:08:59.717246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:59.717251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:59.717287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 490 reason: error at write: Disconnected sessionId: src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0
2025-10-02T08:08:59.717317Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:59.717387Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:59.717411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 490 sessionId: src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0 is DEAD
2025-10-02T08:08:59.717556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:59.717563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0] Write session will restart in 0.008204s
2025-10-02T08:08:59.717586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0] Write session: Do CDS request
2025-10-02T08:08:59.717591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:59.721597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:59.722253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:59.722385Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:59.722391Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:59.722397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:59.722440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:59.722467Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533417229860217:6976]
2025-10-02T08:08:59.722853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:59.722964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:59.722988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:59.723176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:59.723202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.723205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.723206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.723207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.723207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.723210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.723216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.723219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.723221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.723222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.723226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.723230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.723234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.723238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.723240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.723246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.723248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.723251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.723254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.723256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.723270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:59.727225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.727300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:59.727309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 491
2025-10-02T08:08:59.727443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.727464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:59.727471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:59.727473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:59.727778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 491 sessionId:  describe result for acl check
2025-10-02T08:08:59.727810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:59.727814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:59.727816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:59.727819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533417229860233:6978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:59.728182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533417229860233:6978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:59.729769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533417229860233:6978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:59.730505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:59.731739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:59.731763Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:59.731764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:59.731767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:59.731771Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 490 [1:7556533417229860217:6976]
2025-10-02T08:08:59.731778Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:59.731788Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:59.731790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.731793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.731794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.731807Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:59.731813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:59.731817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:59.731848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533417229860233:6978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:59.731856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.731857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533417229860233:6978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:59.731857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.731859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533417229860233:6978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:59.731859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:59.731860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:59.731864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:59.731943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:59.731949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.731955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.731965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:59.731980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533417690127169:2378], now have 1 active actors on pipe
2025-10-02T08:08:59.731987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533417229860211:6976]
2025-10-02T08:08:59.731988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533417229860211:6976]
2025-10-02T08:08:59.731992Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:59.731962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 490
2025-10-02T08:08:59.732000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:59.732002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:59.732004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:59.732012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:59.732017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:59.732039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533417229860211:6976]
2025-10-02T08:08:59.732048Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:59.732052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:59.732061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 490
2025-10-02T08:08:59.732064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229860265:6978], now have 1 active actors on pipe
2025-10-02T08:08:59.732067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.732070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.732087Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:59.732094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.732099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.732104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:59.732110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.732118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:59.732129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.732150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.732154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.732162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.732184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 491 partition: 0 MaxSeqNo: 17 sessionId: src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0
2025-10-02T08:08:59.732440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ff33a6-81f4f0e2-73315289-3f8b7d78_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:59.735410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0] Write session: try to update token
2025-10-02T08:08:59.735425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:59.748859Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:59.748873Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:59.748875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:59.748882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533417229860211:6976]
2025-10-02T08:08:59.748885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533417229860211:6976]
2025-10-02T08:08:59.748912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:59.748917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:59.748921Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:59.748921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.748923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:59.749049Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:59.749814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId: src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:59.752177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:59.817379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533417229860279:6232]
2025-10-02T08:08:59.817487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 490, pipe: [1:7556533417229860279:6232]
2025-10-02T08:08:59.869627Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:08:59.869864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.869874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.869905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229860279:6232], now have 1 active actors on pipe
2025-10-02T08:08:59.870001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:08:59.870010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:08:59.870063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 491 reason: error at write: Disconnected sessionId: src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0
2025-10-02T08:08:59.870079Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:08:59.870114Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:08:59.870255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 491 sessionId: src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0 is DEAD
2025-10-02T08:08:59.870312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533417229860279:6232]
2025-10-02T08:08:59.870370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:08:59.870383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0] Write session will restart in 0.006449s
2025-10-02T08:08:59.870400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0] Write session: Do CDS request
2025-10-02T08:08:59.870405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:08:59.874074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:08:59.874797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:08:59.875363Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:08:59.875385Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:08:59.875407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:08:59.875532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:08:59.875573Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533417229860355:6983]
2025-10-02T08:08:59.876128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:08:59.876296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:08:59.876340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:08:59.876628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:08:59.876671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.876679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.876680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.876681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.876682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.876687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.876696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.876700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.876703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.876706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.876712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.876719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:08:59.876728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.876732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:08:59.876736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.876741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:08:59.876745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.876753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.876761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.876767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.876787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:08:59.878222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.878345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:08:59.878357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 492
2025-10-02T08:08:59.878481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:08:59.878510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:08:59.878519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:08:59.878526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:08:59.878875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 492 sessionId:  describe result for acl check
2025-10-02T08:08:59.878906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:08:59.878911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:08:59.878912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:08:59.878917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533417229860371:6985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:08:59.879411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533417229860371:6985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:08:59.880884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533417229860371:6985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:08:59.883502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533417229860371:6985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:08:59.883511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533417229860371:6985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:08:59.883513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533417229860371:6985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:08:59.883518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:08:59.884355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:08:59.885749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:08:59.885760Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:08:59.885762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:08:59.885764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:08:59.885768Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 491 [1:7556533417229860355:6983]
2025-10-02T08:08:59.885774Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:08:59.885784Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:08:59.885786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.885787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.885789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.885800Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:08:59.885806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:08:59.885811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:08:59.885849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.885854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.885856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:08:59.885858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:08:59.885899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:08:59.885904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.885911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:08:59.885917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:08:59.885933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229860406:6985], now have 1 active actors on pipe
2025-10-02T08:08:59.885940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533417229860349:6983]
2025-10-02T08:08:59.885942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533417229860349:6983]
2025-10-02T08:08:59.885946Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:08:59.885953Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:08:59.885955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533417690127178:2378], now have 1 active actors on pipe
2025-10-02T08:08:59.885955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:08:59.885960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:08:59.885967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:08:59.885971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:08:59.885992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533417229860349:6983]
2025-10-02T08:08:59.885997Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:08:59.885999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:08:59.885976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 491
2025-10-02T08:08:59.886030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 491
2025-10-02T08:08:59.886077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.886082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.886098Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb85461c-59d3a535-783472c9-a1888792_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:08:59.886109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.886131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.886136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:08:59.886142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.886151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:08:59.886164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.886185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.886189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.886198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:08:59.886219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 492 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb85461c-59d3a535-783472c9-a1888792_0
2025-10-02T08:08:59.886490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8acaa9f6-2bb2520a-dd16cada-9ea83b65_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb85461c-59d3a535-783472c9-a1888792_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:08:59.889125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb85461c-59d3a535-783472c9-a1888792_0] Write session: try to update token
2025-10-02T08:08:59.889137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb85461c-59d3a535-783472c9-a1888792_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:08:59.896043Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:08:59.896057Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:59.896062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533417229860349:6983]
2025-10-02T08:08:59.896083Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:08:59.896090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:08:59.896258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:08:59.896388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:59.896513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:59.896640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:08:59.896859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:08:59.896887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:08:59.901535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId: src_id|bb85461c-59d3a535-783472c9-a1888792_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:08:59.903756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:08:59.903806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.903815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.903840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:08:59.903853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:08:59.903891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:08:59.903896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:08:59.904025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.904082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.904141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.904217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.904264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.904274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.904328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.904378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.904438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.904495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.904534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.904538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.904593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.904644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.904698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.904777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.904834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.904839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.904893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.904946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.904999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.905055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.905093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.905098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.905152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.905206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.905259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.905315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.905359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.905364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.905418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.905467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.905517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.905572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.905614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.905618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.905673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.905729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.905790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.905842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.905952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.905957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.906010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.906063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.906117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.906170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.906208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.906213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.906268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.906319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.906372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.906425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.906463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.906468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.906523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:08:59.906573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:08:59.906622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:08:59.906675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:08:59.906763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:08:59.906771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:08:59.906795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:08:59.906842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:08:59.906856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:08:59.906859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:08:59.906879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:08:59.906891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:08:59.906896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:08:59.906898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:08:59.906902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:08:59.907268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:08:59.907286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:08:59.907293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:08:59.907295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:08:59.907296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:08:59.907299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:08:59.907706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:08:59.907721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:08:59.907724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:08:59.907730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:08:59.907732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:08:59.907734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:08:59.908159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:08:59.908174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:08:59.908178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:08:59.908184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:08:59.908186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:08:59.909997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:08:59.910014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:08:59.910022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392539909
2025-10-02T08:08:59.910119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:08:59.910129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:08:59.910133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:08:59.910135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:08:59.910138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:08:59.910140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:08:59.910532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:08:59.910548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:08:59.910551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:08:59.910555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:08:59.910560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:08:59.910562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:08:59.910954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:08:59.910969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:08:59.910973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:08:59.910980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:08:59.910982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:08:59.910984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:08:59.911421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:08:59.911435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:08:59.911439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:08:59.912392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:08:59.912406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:08:59.912409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:08:59.912411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:08:59.912416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392539911
2025-10-02T08:08:59.912665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:08:59.912678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:08:59.912682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:08:59.912688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:08:59.912690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:08:59.912692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:08:59.913193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:08:59.913215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:08:59.913224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:08:59.913231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:08:59.913235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:08:59.913238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:08:59.913744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:08:59.913763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:08:59.913865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392539913
2025-10-02T08:08:59.914630Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:08:59.914649Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:08:59.914655Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:08:59.914665Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:08:59.916412Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:08:59.916427Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:08:59.916429Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:08:59.916437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533417229860349:6983]
2025-10-02T08:08:59.916440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533417229860349:6983]
2025-10-02T08:08:59.916472Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:08:59.916480Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:08:59.916485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:08:59.916489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:08:59.916490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:08:59.916618Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:08:59.970376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533417229860459:6232]
2025-10-02T08:08:59.970471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 491, pipe: [1:7556533417229860459:6232]
2025-10-02T08:09:00.038800Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:00.039107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533417229860459:6232], now have 1 active actors on pipe
2025-10-02T08:09:00.039259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533417229860459:6232]
2025-10-02T08:09:00.039274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:00.039279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:00.039295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 492 reason: error at write: Disconnected sessionId: src_id|bb85461c-59d3a535-783472c9-a1888792_0
2025-10-02T08:09:00.039328Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:00.039301Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:00.039459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 492 sessionId: src_id|bb85461c-59d3a535-783472c9-a1888792_0 is DEAD
2025-10-02T08:09:00.039581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb85461c-59d3a535-783472c9-a1888792_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:00.039587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb85461c-59d3a535-783472c9-a1888792_0] Write session will restart in 0.006755s
2025-10-02T08:09:00.039613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb85461c-59d3a535-783472c9-a1888792_0] Write session: Do CDS request
2025-10-02T08:09:00.039618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb85461c-59d3a535-783472c9-a1888792_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:00.043344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:00.043899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:00.044004Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:00.044010Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:00.044016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:00.044043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:00.044070Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533421524827822:7001]
2025-10-02T08:09:00.044449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:00.044559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:00.044582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:00.044768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:00.044795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.044814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.044815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.044816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.044817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.044821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.044830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.044834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.044836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.044840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.044844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.044851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.044856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.044864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.044866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.044870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.044873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.044875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.044879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.044881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.044891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:00.047295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb85461c-59d3a535-783472c9-a1888792_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.047411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:00.047425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 493
2025-10-02T08:09:00.047524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.047543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:00.047550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:00.047552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:00.047820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 493 sessionId:  describe result for acl check
2025-10-02T08:09:00.047846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:00.047858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:00.047859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:00.047863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533421524827839:7003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:00.048186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533421524827839:7003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:00.050147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533421524827839:7003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:00.052382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533421524827839:7003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:00.052392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533421524827839:7003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:00.052394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533421524827839:7003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:00.052399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:00.052598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:00.054216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:00.054228Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:00.054229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:00.054231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:00.054235Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 492 [1:7556533421524827822:7001]
2025-10-02T08:09:00.054242Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:00.054253Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:00.054258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.054260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.054261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.054272Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:00.054276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:00.054280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:00.054318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.054324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.054327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:00.054329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:00.054376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:00.054382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.054389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.054399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:00.054402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 492
2025-10-02T08:09:00.054415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524827870:7003], now have 1 active actors on pipe
2025-10-02T08:09:00.054420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533421985094502:2378], now have 1 active actors on pipe
2025-10-02T08:09:00.054423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.054425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.054436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533421524827816:7001]
2025-10-02T08:09:00.054442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533421524827816:7001]
2025-10-02T08:09:00.054447Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:00.054457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:00.054468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:00.054450Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 492
2025-10-02T08:09:00.054470Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:00.054472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:00.054473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:00.054483Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:00.054487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.054489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.054490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:00.054496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.054502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:00.054525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533421524827816:7001]
2025-10-02T08:09:00.054535Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:00.054548Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:00.054551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.054589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.054593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.054602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.054630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 493 partition: 0 MaxSeqNo: 17 sessionId: src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0
2025-10-02T08:09:00.054952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb85461c-59d3a535-783472c9-a1888792_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:00.057452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0] Write session: try to update token
2025-10-02T08:09:00.057465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:00.068346Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:00.068361Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:00.068367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533421524827816:7001]
2025-10-02T08:09:00.068398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:00.068400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:00.068564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:00.068698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:00.068844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:00.068977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:00.069156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:00.069185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:00.070183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId: src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:00.072558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:00.072600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.072610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.072632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:00.072648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:00.072682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.072695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.072861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.072936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.073017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.073100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.073349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.073362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.073430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.073499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.073572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.073643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.073695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.073704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.073769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.073829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.073893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.073948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.073998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.074005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.074062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.074118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.074173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.074226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.074277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.074283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.074338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.074389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.074440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.074493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.074531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.074537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.074594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.074647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.074703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.074762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.074813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.074818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.074875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.074925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.074983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.075040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.075097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.075103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.075157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.075209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.075262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.075317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.075356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.075362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.075417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.075471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.075526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.075577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.075616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.075620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.075674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.075724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.075796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.075849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.075916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.075920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.075950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:00.075995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.076009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.076013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:00.076034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:00.076046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:00.076050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:00.076052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:00.076054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:00.076396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:00.076416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:00.076423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:00.076426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:00.076430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:00.076432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:00.076864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:00.076888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:00.076892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:00.076894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:00.076895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:00.076898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:00.077303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:00.077318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:00.077321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:00.077323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:00.077325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:00.078487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:00.078501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:00.078509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392540078
2025-10-02T08:09:00.078661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:00.078671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:00.078674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:00.078677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:00.078679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:00.078693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:00.079153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:00.079170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:00.079173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:00.079179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:00.079183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:00.079185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:00.079585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:00.079599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:00.079604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:00.079606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:00.079608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:00.079610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:00.080030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:00.080050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:00.080055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:00.081111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:00.081128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:00.081133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:00.081141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:00.081149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392540080
2025-10-02T08:09:00.081399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:00.081415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:00.081423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:00.081425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:00.081427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:00.081431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:00.081833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:00.081849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:00.081852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:00.081855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:00.081856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:00.081859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:00.082245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:00.082259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.082327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392540081
2025-10-02T08:09:00.082997Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:00.083020Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:00.083028Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:00.083031Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:00.084628Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:00.084642Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:00.084643Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:00.084649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533421524827816:7001]
2025-10-02T08:09:00.084651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533421524827816:7001]
2025-10-02T08:09:00.084680Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:00.084689Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:00.084693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:00.084695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.084698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:00.084832Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:00.139320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533421524827892:6232]
2025-10-02T08:09:00.139425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 492, pipe: [1:7556533421524827892:6232]
2025-10-02T08:09:00.211137Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:00.211433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524827892:6232], now have 1 active actors on pipe
2025-10-02T08:09:00.211538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533421524827892:6232]
2025-10-02T08:09:00.211560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:00.211561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:00.211592Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:00.211594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 493 reason: error at write: Disconnected sessionId: src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0
2025-10-02T08:09:00.211624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:00.211788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 493 sessionId: src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0 is DEAD
2025-10-02T08:09:00.211958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:00.211970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0] Write session will restart in 0.005508s
2025-10-02T08:09:00.211994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0] Write session: Do CDS request
2025-10-02T08:09:00.212001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:00.215568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:00.216143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:00.216272Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:00.216279Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:00.216286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:00.216317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:00.216346Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533421524827961:7007]
2025-10-02T08:09:00.216735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:00.216874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:00.216904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:00.217127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:00.217158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.217164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.217165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.217165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.217166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.217169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.217175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.217177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.217179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.217181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.217184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.217188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.217191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.217194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.217197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.217199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.217203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.217207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.217211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.217215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.217232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:00.218248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.218309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:00.218318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 494
2025-10-02T08:09:00.218514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.218540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:00.218543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:00.218545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:00.218844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 494 sessionId:  describe result for acl check
2025-10-02T08:09:00.218870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:00.218874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:00.218875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:00.218879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533421524827977:7009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:00.219240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533421524827977:7009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:00.220655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533421524827977:7009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:00.223972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533421524827977:7009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:00.223985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533421524827977:7009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:00.223987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533421524827977:7009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:00.223993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:00.224682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:00.226201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:00.226215Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:00.226217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:00.226220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:00.226225Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 493 [1:7556533421524827961:7007]
2025-10-02T08:09:00.226233Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:00.226246Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:00.226248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.226249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.226250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.226261Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:00.226269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:00.226273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:00.226316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.226321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.226323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:00.226324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:00.226367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:00.226372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.226379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.226391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:00.226408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533421524827954:7007]
2025-10-02T08:09:00.226414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533421524827954:7007]
2025-10-02T08:09:00.226420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:00.226429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 493
2025-10-02T08:09:00.226437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828009:7009], now have 1 active actors on pipe
2025-10-02T08:09:00.226445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:00.226463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:00.226470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:00.226486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:00.226493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:00.226499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533421524827954:7007]
2025-10-02T08:09:00.226502Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:00.226503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:00.226512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533421985094508:2378], now have 1 active actors on pipe
2025-10-02T08:09:00.226517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.226525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.226559Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|133eb712-d6c12742-ffc9165d-bacac957_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:00.226568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.226570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.226571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:00.226578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.226587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:00.226610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.226583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 493
2025-10-02T08:09:00.226644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.226648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.226657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.226682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 494 partition: 0 MaxSeqNo: 17 sessionId: src_id|133eb712-d6c12742-ffc9165d-bacac957_0
2025-10-02T08:09:00.226953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b4c2c-f142f538-87fd4e6c-e1e24d08_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|133eb712-d6c12742-ffc9165d-bacac957_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:00.229778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133eb712-d6c12742-ffc9165d-bacac957_0] Write session: try to update token
2025-10-02T08:09:00.229793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133eb712-d6c12742-ffc9165d-bacac957_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:00.242906Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:00.242922Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:00.242924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:00.242930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533421524827954:7007]
2025-10-02T08:09:00.242933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533421524827954:7007]
2025-10-02T08:09:00.242966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:00.242968Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:00.242972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.242973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:00.242973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:00.243097Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:00.245019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId: src_id|133eb712-d6c12742-ffc9165d-bacac957_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:00.247300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:00.311832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533421524828023:6232]
2025-10-02T08:09:00.311993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 493, pipe: [1:7556533421524828023:6232]
2025-10-02T08:09:00.365384Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:00.365599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.365609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.365639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828023:6232], now have 1 active actors on pipe
2025-10-02T08:09:00.365776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533421524828023:6232]
2025-10-02T08:09:00.365795Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:00.365814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:00.365856Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:00.365900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 494 reason: status is not ok: tablet will be restarted right now sessionId: src_id|133eb712-d6c12742-ffc9165d-bacac957_0
2025-10-02T08:09:00.366094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 494 sessionId: src_id|133eb712-d6c12742-ffc9165d-bacac957_0 is DEAD
2025-10-02T08:09:00.366227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133eb712-d6c12742-ffc9165d-bacac957_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:00.366238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133eb712-d6c12742-ffc9165d-bacac957_0] Write session will restart in 0.005817s
2025-10-02T08:09:00.366257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133eb712-d6c12742-ffc9165d-bacac957_0] Write session: Do CDS request
2025-10-02T08:09:00.366263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133eb712-d6c12742-ffc9165d-bacac957_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:00.370990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:00.371650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:00.371759Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:00.371767Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:00.371774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:00.371809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:00.371840Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533421524828109:7014]
2025-10-02T08:09:00.372204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:00.372326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:00.372349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:00.372534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:00.372559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.372563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.372563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.372564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.372564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.372567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.372575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.372580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.372582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.372584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.372589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.372595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.372601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.372604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.372609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.372612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.372614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.372617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.372619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.372622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.372631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:00.373172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133eb712-d6c12742-ffc9165d-bacac957_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.373296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:00.373305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 495
2025-10-02T08:09:00.373410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.373431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:00.373437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:00.373440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:00.373791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 495 sessionId:  describe result for acl check
2025-10-02T08:09:00.373825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:00.373830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:00.373831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:00.373835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533421524828125:7016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:00.374257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533421524828125:7016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:00.375885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533421524828125:7016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:00.379089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533421524828125:7016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:00.379099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533421524828125:7016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:00.379101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533421524828125:7016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:00.379106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:00.379920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:00.381578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:00.381592Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:00.381594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:00.381599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:00.381605Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 494 [1:7556533421524828109:7014]
2025-10-02T08:09:00.381614Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:00.381626Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:00.381633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.381635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.381637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.381651Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:00.381659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:00.381665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:00.381710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.381717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.381719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:00.381721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:00.381778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:00.381785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.381794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.381801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:00.381809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 494
2025-10-02T08:09:00.381821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828156:7016], now have 1 active actors on pipe
2025-10-02T08:09:00.381829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533421985094527:2378], now have 1 active actors on pipe
2025-10-02T08:09:00.381833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533421524828103:7014]
2025-10-02T08:09:00.381835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533421524828103:7014]
2025-10-02T08:09:00.381847Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:00.381858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.381863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.381871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:00.381874Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:00.381863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 494
2025-10-02T08:09:00.381886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:00.381899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:00.381905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:00.381939Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:00.381950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.381953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.381954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:00.381961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.381973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:00.381981Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533421524828103:7014]
2025-10-02T08:09:00.381989Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:00.382002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:00.382014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.382061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.382071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.382092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.382125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 495 partition: 0 MaxSeqNo: 17 sessionId: src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0
2025-10-02T08:09:00.382396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133eb712-d6c12742-ffc9165d-bacac957_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:00.384896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0] Write session: try to update token
2025-10-02T08:09:00.384908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:00.397433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId: src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:00.398112Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:00.398134Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:00.398137Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:00.398144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533421524828103:7014]
2025-10-02T08:09:00.398149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533421524828103:7014]
2025-10-02T08:09:00.398177Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:00.398189Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:00.398203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:00.398210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.398218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:00.398365Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:00.399665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:00.465988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533421524828175:6232]
2025-10-02T08:09:00.466083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 494, pipe: [1:7556533421524828175:6232]
2025-10-02T08:09:00.518786Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:00.518986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.518996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.519028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828175:6232], now have 1 active actors on pipe
2025-10-02T08:09:00.519127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533421524828175:6232]
2025-10-02T08:09:00.519148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:00.519152Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:00.519153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:00.519210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 495 reason: error at write: Disconnected sessionId: src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0
2025-10-02T08:09:00.519234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:00.519355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 495 sessionId: src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0 is DEAD
2025-10-02T08:09:00.519540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:00.519552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0] Write session will restart in 0.006885s
2025-10-02T08:09:00.519585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0] Write session: Do CDS request
2025-10-02T08:09:00.519590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:00.523864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:00.524700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:00.524819Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:00.524826Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:00.524833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:00.524862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:00.524889Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533421524828248:7021]
2025-10-02T08:09:00.525416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:00.525589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:00.525616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:00.525798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:00.525825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.525829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.525830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.525830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.525831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.525834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.525840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.525842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.525844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.525847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.525851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.525855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.525859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.525861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.525864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.525867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.525869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.525872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.525875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.525881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.525891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:00.527160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.527254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:00.527262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 496
2025-10-02T08:09:00.527361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.527379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:00.527385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:00.527388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:00.527648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 496 sessionId:  describe result for acl check
2025-10-02T08:09:00.527670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:00.527675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:00.527678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:00.527690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533421524828264:7023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:00.528046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533421524828264:7023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:00.529627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533421524828264:7023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:00.532567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533421524828264:7023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:00.532576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533421524828264:7023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:00.532578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533421524828264:7023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:00.532583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:00.533067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:00.534366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:00.534377Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:00.534378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:00.534380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:00.534384Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 495 [1:7556533421524828248:7021]
2025-10-02T08:09:00.534391Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:00.534401Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:00.534403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.534404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.534406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.534417Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:00.534423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:00.534428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:00.534461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.534466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.534468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:00.534469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:00.534510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:00.534516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.534522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.534532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:00.534543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 495
2025-10-02T08:09:00.534547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828295:7023], now have 1 active actors on pipe
2025-10-02T08:09:00.534552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533421524828242:7021]
2025-10-02T08:09:00.534554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533421524828242:7021]
2025-10-02T08:09:00.534559Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:00.534569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533421985094535:2378], now have 1 active actors on pipe
2025-10-02T08:09:00.534576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:00.534583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:00.534581Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:00.534585Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:00.534587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:00.534591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.534594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.534617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533421524828242:7021]
2025-10-02T08:09:00.534623Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:00.534631Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:00.534639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.534641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.534642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:00.534643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:00.534647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.534616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 495
2025-10-02T08:09:00.534656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:00.534681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.534718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.534722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.534730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.534755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 496 partition: 0 MaxSeqNo: 17 sessionId: src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0
2025-10-02T08:09:00.535025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a632b5-4aa94fdf-5afe0d55-10e7d04e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:00.537207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0] Write session: try to update token
2025-10-02T08:09:00.537219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:00.549592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId: src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:00.550235Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:00.550247Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:00.550248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:00.550253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533421524828242:7021]
2025-10-02T08:09:00.550257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533421524828242:7021]
2025-10-02T08:09:00.550288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:00.550295Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:00.550297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.550300Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:00.550301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:00.550415Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:00.551876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:00.619093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533421524828309:6232]
2025-10-02T08:09:00.619208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 495, pipe: [1:7556533421524828309:6232]
2025-10-02T08:09:00.670810Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:00.671030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.671038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.671069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828309:6232], now have 1 active actors on pipe
2025-10-02T08:09:00.671231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533421524828309:6232]
2025-10-02T08:09:00.671255Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:00.671257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:00.671258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:00.671307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 496 reason: error at write: Disconnected sessionId: src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0
2025-10-02T08:09:00.671367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:00.671450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 496 sessionId: src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0 is DEAD
2025-10-02T08:09:00.671604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:00.671617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0] Write session will restart in 0.005070s
2025-10-02T08:09:00.671636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0] Write session: Do CDS request
2025-10-02T08:09:00.671641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:00.675986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:00.676946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:00.677064Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:00.677070Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:00.677077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:00.677103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:00.677131Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533421524828381:7027]
2025-10-02T08:09:00.677785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:00.677927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:00.677950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:00.678241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:00.678258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.678266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.678270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.678270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:00.678271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.678271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.678272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.678274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 497
2025-10-02T08:09:00.678275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.678281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.678284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.678286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.678288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.678292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.678296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.678301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.678304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.678307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.678310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.678313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.678315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.678321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.678324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.678335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:00.678504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.678526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:00.678531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:00.678534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:00.678800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 497 sessionId:  describe result for acl check
2025-10-02T08:09:00.678828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:00.678832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:00.678833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:00.678836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533421524828397:7029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:00.679169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533421524828397:7029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:00.680509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533421524828397:7029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:00.684963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533421524828397:7029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:00.684972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533421524828397:7029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:00.684975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533421524828397:7029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:00.684980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:00.685410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:00.687166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:00.687175Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:00.687177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:00.687179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:00.687183Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 496 [1:7556533421524828381:7027]
2025-10-02T08:09:00.687191Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:00.687203Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:00.687205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.687207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.687208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.687219Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:00.687226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:00.687229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:00.687264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.687269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.687271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:00.687273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:00.687311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:00.687317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.687323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.687329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:00.687343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533421524828375:7027]
2025-10-02T08:09:00.687344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533421524828375:7027]
2025-10-02T08:09:00.687350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:00.687361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:00.687363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 496
2025-10-02T08:09:00.687363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:00.687366Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:00.687371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:00.687373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:00.687378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828431:7029], now have 1 active actors on pipe
2025-10-02T08:09:00.687381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533421985094541:2378], now have 1 active actors on pipe
2025-10-02T08:09:00.687420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.687427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.687436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533421524828375:7027]
2025-10-02T08:09:00.687441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:00.687454Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:00.687457Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:00.687461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.687463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.687464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:00.687470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.687431Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 496
2025-10-02T08:09:00.687475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:00.687493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.687523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.687527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.687534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.687558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 497 partition: 0 MaxSeqNo: 17 sessionId: src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0
2025-10-02T08:09:00.687811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe9e7d-d1ab2217-331073e7-49289f13_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:00.690534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0] Write session: try to update token
2025-10-02T08:09:00.690546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:00.703092Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:00.703107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:00.703109Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:00.703114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533421524828375:7027]
2025-10-02T08:09:00.703117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533421524828375:7027]
2025-10-02T08:09:00.703149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:00.703154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.703158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:00.703159Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:00.703165Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:00.703214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId: src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:00.703285Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:00.705615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:00.771126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533421524828445:6232]
2025-10-02T08:09:00.771243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 496, pipe: [1:7556533421524828445:6232]
2025-10-02T08:09:00.822751Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:00.822977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.822986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.823018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828445:6232], now have 1 active actors on pipe
2025-10-02T08:09:00.823114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533421524828445:6232]
2025-10-02T08:09:00.823129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:00.823131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:00.823172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 497 reason: error at write: Disconnected sessionId: src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0
2025-10-02T08:09:00.823203Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:00.823324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 497 sessionId: src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0 is DEAD
2025-10-02T08:09:00.823327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:00.823458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:00.823467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0] Write session will restart in 0.009360s
2025-10-02T08:09:00.823485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0] Write session: Do CDS request
2025-10-02T08:09:00.823490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:00.827897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:00.828761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:00.828889Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:00.828896Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:00.828902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:00.828930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:00.828958Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533421524828522:7034]
2025-10-02T08:09:00.829374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:00.829524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:00.829548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:00.829729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:00.829754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.829759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.829759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.829760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.829760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.829763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.829770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.829772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.829774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.829775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.829779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.829783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.829786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.829791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.829793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.829795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.829798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.829801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.829803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.829805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.829817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:00.834232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.834338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:00.834350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 498
2025-10-02T08:09:00.834434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:00.834460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:00.834469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:00.834472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:00.834819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 498 sessionId:  describe result for acl check
2025-10-02T08:09:00.834849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:00.834853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:00.834854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:00.834858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533421524828538:7036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:00.835222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533421524828538:7036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:00.836794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533421524828538:7036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:00.837051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:00.838438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:00.838452Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:00.838454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:00.838457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:00.838463Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 497 [1:7556533421524828522:7034]
2025-10-02T08:09:00.838472Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:00.838486Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:00.838492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.838494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.838496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.838506Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:00.838512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:00.838516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:00.838554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.838560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.838562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:00.838563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:00.838614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:00.838619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.838626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.838633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:00.838648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533421985094548:2378], now have 1 active actors on pipe
2025-10-02T08:09:00.838656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533421524828516:7034]
2025-10-02T08:09:00.838657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533421524828516:7034]
2025-10-02T08:09:00.838666Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:00.838677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:00.838689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:00.838688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:00.838692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:00.838693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:00.838714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533421524828516:7034]
2025-10-02T08:09:00.838722Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:00.838724Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:00.838693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 497
2025-10-02T08:09:00.839450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533421524828538:7036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:00.839459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533421524828538:7036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:00.839461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533421524828538:7036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:00.839467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:00.839620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 497
2025-10-02T08:09:00.839631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828576:7036], now have 1 active actors on pipe
2025-10-02T08:09:00.839636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.839640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.839657Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:00.839668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.839670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.839671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:00.839677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.839685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:00.839696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.839728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.839736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.839765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:00.839797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 498 partition: 0 MaxSeqNo: 17 sessionId: src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0
2025-10-02T08:09:00.840049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a6f5ec-ea5f2eb8-d3be1a09-9b19c59b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:00.842685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0] Write session: try to update token
2025-10-02T08:09:00.842700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:00.848188Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:00.848202Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:00.848210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533421524828516:7034]
2025-10-02T08:09:00.848246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:00.848246Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:00.848408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:00.848541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:00.848673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:00.848799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:00.848999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:00.849032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:00.854591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId: src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:00.856702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:00.856758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.856770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.856795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:00.856831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:00.856870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:00.856875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:00.856999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.857053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.857110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.857169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.857215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.857224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.857299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.857352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.857407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.857459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.857496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.857501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.857553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.857603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.857656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.857708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.857748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.857753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.857805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.857865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.857917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.857966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.858007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.858013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.858065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.858114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.858191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.858244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.858301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.858309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.858366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.858416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.858461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.858513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.858552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.858556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.858607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.858654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.858705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.858761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.858814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.858819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.858873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.858928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.858978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.859028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.859066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.859070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.859124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.859173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.859226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.859276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.859316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.859321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.859380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:00.859435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:00.859484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:00.859534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:00.859588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:00.859594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:00.859615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:00.859660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:00.859673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:00.859676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:00.859697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:00.859709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:00.859713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:00.859714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:00.859716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:00.860056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:00.860076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:00.860081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:00.860082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:00.860084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:00.860086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:00.860492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:00.860507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:00.860511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:00.860513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:00.860514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:00.860516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:00.860977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:00.860992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:00.860996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:00.860997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:00.860999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:00.862861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:00.862878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:00.862885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392540862
2025-10-02T08:09:00.863007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:00.863017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:00.863020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:00.863022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:00.863024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:00.863027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:00.863415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:00.863432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:00.863439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:00.863440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:00.863442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:00.863444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:00.863875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:00.863890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:00.863894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:00.863897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:00.863899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:00.863901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:00.864310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:00.864326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:00.864331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:00.865302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:00.865317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:00.865322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:00.865325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:00.865331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392540865
2025-10-02T08:09:00.865592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:00.865608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:00.865618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:00.865620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:00.865622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:00.865625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:00.866012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:00.866027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:00.866035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:00.866037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:00.866039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:00.866041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:00.866430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:00.866443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:00.866513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392540866
2025-10-02T08:09:00.867186Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:00.867204Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:00.867211Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:00.867215Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:00.868725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:00.868736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:00.868737Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:00.868743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533421524828516:7034]
2025-10-02T08:09:00.868745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533421524828516:7034]
2025-10-02T08:09:00.868785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:00.868787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:00.868791Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:00.868793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.868794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:00.868914Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:00.938460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533421524828605:6232]
2025-10-02T08:09:00.939597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 497, pipe: [1:7556533421524828605:6232]
2025-10-02T08:09:00.990721Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:00.991007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533421524828605:6232], now have 1 active actors on pipe
2025-10-02T08:09:00.991107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:00.991117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:00.991139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 498 reason: error at write: Disconnected sessionId: src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0
2025-10-02T08:09:00.991170Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:00.991223Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:00.991299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 498 sessionId: src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0 is DEAD
2025-10-02T08:09:00.991383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533421524828605:6232]
2025-10-02T08:09:00.991451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:00.991460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0] Write session will restart in 0.009294s
2025-10-02T08:09:00.991483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0] Write session: Do CDS request
2025-10-02T08:09:00.991489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:00.994840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:00.995470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:00.995594Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:00.995602Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:00.995608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:00.995637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:00.995673Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533421524828708:7052]
2025-10-02T08:09:00.996063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:00.996191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:00.996219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:00.996394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:00.996418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.996422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.996423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.996423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.996424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.996426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.996433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.996435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.996437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.996439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.996442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.996447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:00.996452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.996462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:00.996469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.996478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:00.996484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.996486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:00.996490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.996492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:00.996502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:01.002205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.002267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:01.002276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 499
2025-10-02T08:09:01.002362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.002382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:01.002389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:01.002391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:01.002677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 499 sessionId:  describe result for acl check
2025-10-02T08:09:01.002705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:01.002709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:01.002710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:01.002714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533425819796020:7054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:01.003035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533425819796020:7054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:01.004450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533425819796020:7054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:01.005975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:01.007263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533425819796020:7054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:01.007273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533425819796020:7054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:01.007275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533425819796020:7054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:01.007280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:01.007562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:01.007581Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:01.007584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:01.007587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:01.007593Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 498 [1:7556533421524828708:7052]
2025-10-02T08:09:01.007612Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:01.007634Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:01.007642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.007644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.007647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.007661Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:01.007669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:01.007675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:01.007735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.007750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.007754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:01.007755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:01.007813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:01.007820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.007827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 498
2025-10-02T08:09:01.007830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.007837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:01.007859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796048:7054], now have 1 active actors on pipe
2025-10-02T08:09:01.007867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533421985094578:2378], now have 1 active actors on pipe
2025-10-02T08:09:01.007871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.007874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.007891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533421524828702:7052]
2025-10-02T08:09:01.007897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533421524828702:7052]
2025-10-02T08:09:01.007904Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:01.007877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 498
2025-10-02T08:09:01.007911Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:01.007913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:01.007919Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:01.007922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:01.007924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:01.007938Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:01.007948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.007953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.007954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:01.007961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.007968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:01.008005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533421524828702:7052]
2025-10-02T08:09:01.008016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:01.008024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.008035Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:01.008063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.008068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.008078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.008106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 499 partition: 0 MaxSeqNo: 17 sessionId: src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0
2025-10-02T08:09:01.008388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d48783c-f3a8aa68-bb07a352-71309a1b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:01.011011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0] Write session: try to update token
2025-10-02T08:09:01.011023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:01.024272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId: src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:01.024746Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:01.024763Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.024765Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:01.024772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533421524828702:7052]
2025-10-02T08:09:01.024777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533421524828702:7052]
2025-10-02T08:09:01.024827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:01.024831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:01.024837Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:01.024840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.024842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:01.024978Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:01.026604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:01.091657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533425819796064:6232]
2025-10-02T08:09:01.091755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 498, pipe: [1:7556533425819796064:6232]
2025-10-02T08:09:01.148961Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:01.149370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.149384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.149425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796064:6232], now have 1 active actors on pipe
2025-10-02T08:09:01.149503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533425819796064:6232]
2025-10-02T08:09:01.149524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:01.149526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:01.149576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 499 reason: error at write: Disconnected sessionId: src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0
2025-10-02T08:09:01.149643Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:01.149666Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:01.149747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 499 sessionId: src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0 is DEAD
2025-10-02T08:09:01.149902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:01.149911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0] Write session will restart in 0.006075s
2025-10-02T08:09:01.149931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0] Write session: Do CDS request
2025-10-02T08:09:01.149937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:01.153886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:01.154506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:01.154614Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:01.154621Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:01.154628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:01.154656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:01.154684Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533425819796144:7058]
2025-10-02T08:09:01.155059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:01.155188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:01.155214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:01.155390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:01.155417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.155422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.155422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.155423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.155423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.155426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.155432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.155434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.155436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.155438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.155442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.155445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.155449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.155451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.155454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.155457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.155459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.155461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.155464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.155466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.155476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:01.157164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.157222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:01.157230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 500
2025-10-02T08:09:01.157344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.157363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:01.157374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:01.157377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:01.157644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 500 sessionId:  describe result for acl check
2025-10-02T08:09:01.157676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:01.157685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:01.157686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:01.157690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533425819796160:7060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:01.158018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533425819796160:7060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:01.159672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533425819796160:7060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:01.162469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533425819796160:7060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:01.162480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533425819796160:7060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:01.162483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533425819796160:7060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:01.162498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:01.162884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:01.164327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:01.164340Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:01.164341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:01.164343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:01.164348Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 499 [1:7556533425819796144:7058]
2025-10-02T08:09:01.164357Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:01.164374Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:01.164376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.164379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.164381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.164392Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:01.164395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:01.164400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:01.164442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.164447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.164449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:01.164450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:01.164491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:01.164497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.164504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.164510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:01.164526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796192:7060], now have 1 active actors on pipe
2025-10-02T08:09:01.164528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533426280061880:2378], now have 1 active actors on pipe
2025-10-02T08:09:01.164530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 499
2025-10-02T08:09:01.164532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533425819796138:7058]
2025-10-02T08:09:01.164533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533425819796138:7058]
2025-10-02T08:09:01.164538Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:01.164546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:01.164547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:01.164549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:01.164557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:01.164558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:01.164564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.164566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.164594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533425819796138:7058]
2025-10-02T08:09:01.164604Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:01.164611Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:01.164615Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:01.164619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.164622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.164627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:01.164634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.164643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:01.164668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.164633Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 499
2025-10-02T08:09:01.164714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.164719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.164727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.164753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 500 partition: 0 MaxSeqNo: 17 sessionId: src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0
2025-10-02T08:09:01.165041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37d3b36-e18584c4-6259f04d-c2eea323_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:01.167665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0] Write session: try to update token
2025-10-02T08:09:01.167678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:01.174454Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:01.174470Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.174476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533425819796138:7058]
2025-10-02T08:09:01.174509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:01.174519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:01.174654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:01.174773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.174883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.175027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.175200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:01.175229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:01.180086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId: src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:01.182380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:01.182439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.182449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.182479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:01.182497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:01.182530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.182542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.182684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.182746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.182815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.182882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.183029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.183036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.183091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.183147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.183206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.183263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.183304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.183308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.183364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.183415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.183468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.183544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.183590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.183596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.183651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.183704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.183772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.183823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.183880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.183885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.183940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.183990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.184042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.184097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.184139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.184144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.184202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.184254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.184305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.184358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.184396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.184401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.184453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.184505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.184561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.184621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.184668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.184675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.184737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.184790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.184865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.184918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.184956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.184960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.185015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.185067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.185120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.185173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.185213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.185218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.185272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.185323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.185376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.185428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.185465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.185470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.185496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:01.185543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.185560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.185564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:01.185587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:01.185599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:01.185604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:01.185606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:01.185608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:01.185961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:01.185981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:01.185989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:01.185994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:01.185996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:01.185998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:01.186612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:01.186631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:01.186635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:01.186639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:01.186641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:01.186642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:01.187087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:01.187103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:01.187110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:01.187112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:01.187113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:01.188203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:01.188218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:01.188230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392541187
2025-10-02T08:09:01.188338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:01.188348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:01.188351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:01.188353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:01.188356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:01.188357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:01.188837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:01.188853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:01.188857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:01.188859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:01.188861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:01.188864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:01.189288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:01.189305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:01.189310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:01.189314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:01.189318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:01.189320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:01.189728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:01.189744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:01.189748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:01.190728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:01.190742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:01.190745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:01.190747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:01.190752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392541190
2025-10-02T08:09:01.191016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:01.191032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:01.191039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:01.191041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:01.191043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:01.191045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:01.191465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:01.191483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:01.191488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:01.191492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:01.191493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:01.191497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:01.191922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:01.191938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.192008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392541191
2025-10-02T08:09:01.192673Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:01.192687Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:01.192691Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:01.192698Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:01.194279Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:01.194292Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.194293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:01.194298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533425819796138:7058]
2025-10-02T08:09:01.194300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533425819796138:7058]
2025-10-02T08:09:01.194339Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:01.194341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:01.194344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.194345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:01.194351Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:01.194453Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:01.249810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533425819796217:6232]
2025-10-02T08:09:01.249920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 499, pipe: [1:7556533425819796217:6232]
2025-10-02T08:09:01.319019Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:01.319320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796217:6232], now have 1 active actors on pipe
2025-10-02T08:09:01.319416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533425819796217:6232]
2025-10-02T08:09:01.319441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:01.319446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:01.319466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 500 reason: error at write: Disconnected sessionId: src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0
2025-10-02T08:09:01.319471Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:01.319633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 500 sessionId: src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0 is DEAD
2025-10-02T08:09:01.319656Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:01.319776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:01.319786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0] Write session will restart in 0.008905s
2025-10-02T08:09:01.319807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0] Write session: Do CDS request
2025-10-02T08:09:01.319812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:01.323932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:01.324433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:01.324543Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:01.324549Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:01.324555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:01.324583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:01.324609Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533425819796297:7064]
2025-10-02T08:09:01.325016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:01.325130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:01.325156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:01.325367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:01.325410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.325415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.325417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.325417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.325419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.325424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.325433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.325439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.325441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.325443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.325446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.325451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.325454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.325457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.325460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.325462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.325464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.325467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.325469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.325472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.325482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:01.330252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.330282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:01.330293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 501
2025-10-02T08:09:01.330435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.330455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:01.330462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:01.330465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:01.330725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 501 sessionId:  describe result for acl check
2025-10-02T08:09:01.330752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:01.330757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:01.330759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:01.330762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533425819796325:7067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:01.331101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533425819796325:7067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:01.332813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:01.333107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533425819796325:7067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:01.334278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:01.334292Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:01.334294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:01.334298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:01.334303Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 500 [1:7556533425819796297:7064]
2025-10-02T08:09:01.334309Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:01.334319Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:01.334320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.334322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.334323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.334334Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:01.334337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:01.334341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:01.334376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.334382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.334384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:01.334385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:01.334427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:01.334432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.334444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.334458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:01.334477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533426280061904:2378], now have 1 active actors on pipe
2025-10-02T08:09:01.334487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533425819796291:7064]
2025-10-02T08:09:01.334489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533425819796291:7064]
2025-10-02T08:09:01.334500Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:01.334513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:01.334519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:01.334520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:01.334521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:01.334524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:01.334545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533425819796291:7064]
2025-10-02T08:09:01.334550Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:01.334552Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:01.334504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 500
2025-10-02T08:09:01.338973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533425819796325:7067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:01.338985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533425819796325:7067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:01.338987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533425819796325:7067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:01.338993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:01.339192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 500
2025-10-02T08:09:01.339203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796366:7067], now have 1 active actors on pipe
2025-10-02T08:09:01.339207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.339211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.339230Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:01.339238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.339246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.339249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:01.339261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.339273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:01.339286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.339325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.339330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.339338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.339362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 501 partition: 0 MaxSeqNo: 17 sessionId: src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0
2025-10-02T08:09:01.339673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71a953-b889ac57-9565d65d-5ff4a30b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:01.342476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0] Write session: try to update token
2025-10-02T08:09:01.342491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:01.344349Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:01.344364Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.344373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533425819796291:7064]
2025-10-02T08:09:01.344412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:01.344416Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:01.344568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:01.344697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.344832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.344959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.345140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:01.345169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:01.357185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId: src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:01.360763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:01.362016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.362034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.362049Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:01.362055Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.362056Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:01.362062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533425819796291:7064]
2025-10-02T08:09:01.362065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533425819796291:7064]
2025-10-02T08:09:01.362099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:01.362107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:01.362110Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:01.362112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.362113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:01.362236Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:01.419312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533425819796380:6232]
2025-10-02T08:09:01.419388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 500, pipe: [1:7556533425819796380:6232]
2025-10-02T08:09:01.488037Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:01.488263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:01.488294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796380:6232], now have 1 active actors on pipe
2025-10-02T08:09:01.488296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:01.488410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:01.488417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:01.488430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 501 reason: error at write: Disconnected sessionId: src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0
2025-10-02T08:09:01.488469Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:01.488542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 501 sessionId: src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0 is DEAD
2025-10-02T08:09:01.488680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:01.488675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533425819796380:6232]
2025-10-02T08:09:01.488695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0] Write session will restart in 0.006749s
2025-10-02T08:09:01.488715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0] Write session: Do CDS request
2025-10-02T08:09:01.488721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:01.493253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:01.493906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:01.494030Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:01.494037Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:01.494044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:01.494075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:01.494101Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533425819796465:7072]
2025-10-02T08:09:01.494499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:01.494673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:01.494723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:01.495015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:01.495059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.495064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.495065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.495065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.495066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.495069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.495075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.495080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.495082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.495083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.495087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.495091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.495095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.495097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.495099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.495102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.495104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.495107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.495109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.495111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.495122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:01.496186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.496287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:01.496299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 502
2025-10-02T08:09:01.496432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.496460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:01.496470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:01.496473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:01.496826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 502 sessionId:  describe result for acl check
2025-10-02T08:09:01.496853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:01.496859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:01.496860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:01.496865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533425819796481:7074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:01.497328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533425819796481:7074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:01.498691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533425819796481:7074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:01.501825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533425819796481:7074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:01.501834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533425819796481:7074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:01.501836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533425819796481:7074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:01.501842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:01.502386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:01.503781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:01.503792Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:01.503795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:01.503797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:01.503801Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 501 [1:7556533425819796465:7072]
2025-10-02T08:09:01.503808Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:01.503819Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:01.503820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.503822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.503823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.503835Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:01.503842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:01.503847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:01.503885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.503890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.503892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:01.503893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:01.503933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:01.503937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.503945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.503952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:01.503964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796513:7074], now have 1 active actors on pipe
2025-10-02T08:09:01.503965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 501
2025-10-02T08:09:01.503970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533426280061914:2378], now have 1 active actors on pipe
2025-10-02T08:09:01.503974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533425819796459:7072]
2025-10-02T08:09:01.503975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533425819796459:7072]
2025-10-02T08:09:01.503980Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:01.503986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.503988Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:01.503989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.503990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:01.504001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:01.504010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:01.504015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:01.504042Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be7168cb-303461a3-f7742db3-93fda740_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:01.504048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.504006Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 501
2025-10-02T08:09:01.504051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.504052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:01.504057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.504062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:01.504071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533425819796459:7072]
2025-10-02T08:09:01.504076Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:01.504090Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:01.504092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.504129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.504138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.504156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.504182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 502 partition: 0 MaxSeqNo: 17 sessionId: src_id|be7168cb-303461a3-f7742db3-93fda740_0
2025-10-02T08:09:01.504484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf2a6f4-691c8dad-65f1ffdb-1a11b8d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|be7168cb-303461a3-f7742db3-93fda740_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:01.507069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be7168cb-303461a3-f7742db3-93fda740_0] Write session: try to update token
2025-10-02T08:09:01.507080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be7168cb-303461a3-f7742db3-93fda740_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:01.519897Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:01.519914Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.519915Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:01.519919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId: src_id|be7168cb-303461a3-f7742db3-93fda740_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:01.519921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533425819796459:7072]
2025-10-02T08:09:01.519924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533425819796459:7072]
2025-10-02T08:09:01.519954Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:01.519956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:01.519958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:01.519960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.519962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:01.520101Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:01.522454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:01.588796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533425819796529:6232]
2025-10-02T08:09:01.588891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 501, pipe: [1:7556533425819796529:6232]
2025-10-02T08:09:01.643616Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:01.643900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.643910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.643941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796529:6232], now have 1 active actors on pipe
2025-10-02T08:09:01.644036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:01.644046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:01.644081Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:01.644108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 502 reason: error at write: Disconnected sessionId: src_id|be7168cb-303461a3-f7742db3-93fda740_0
2025-10-02T08:09:01.644133Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:01.644263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533425819796529:6232]
2025-10-02T08:09:01.644277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 502 sessionId: src_id|be7168cb-303461a3-f7742db3-93fda740_0 is DEAD
2025-10-02T08:09:01.644279Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:09:01.644398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be7168cb-303461a3-f7742db3-93fda740_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:01.644408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be7168cb-303461a3-f7742db3-93fda740_0] Write session will restart in 0.009439s
2025-10-02T08:09:01.644397Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 5 consumer shared/user session shared/user_1_5_13424274763044140484_v1 is DEAD
2025-10-02T08:09:01.644427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be7168cb-303461a3-f7742db3-93fda740_0] Write session: Do CDS request
2025-10-02T08:09:01.644432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be7168cb-303461a3-f7742db3-93fda740_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:01.644552Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:09:01.644542Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533352805294458:6227] disconnected; active server actors: 1
2025-10-02T08:09:01.644551Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533352805294458:6227] client user disconnected session shared/user_1_5_13424274763044140484_v1
2025-10-02T08:09:01.644667Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:09:01.644672Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:09:01.644680Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.005665s
2025-10-02T08:09:01.649134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:01.649877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:01.649984Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:01.649991Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:01.649998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:01.650025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:01.650053Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533425819796613:7078]
2025-10-02T08:09:01.650445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:01.650590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:01.650614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:01.650795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:01.650820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.650824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.650825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.650825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.650826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.650829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.650835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.650837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.650838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.650842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.650845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.650849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.650852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.650855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.650857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.650859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.650861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.650864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.650866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.650869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.650883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:01.651145Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:09:01.651329Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:09:01.651335Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 6
2025-10-02T08:09:01.651475Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:09:01.651504Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:09:01.651561Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 auth for : user
2025-10-02T08:09:01.651678Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 Handle describe topics response
2025-10-02T08:09:01.651692Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 auth is DEAD
2025-10-02T08:09:01.651695Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:09:01.651893Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:09:01.651992Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_6_8771659216780997938_v1
2025-10-02T08:09:01.652002Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:09:01.652035Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533425819796630:7080] connected; active server actors: 1
2025-10-02T08:09:01.652068Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:09:01.652116Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533425819796630:7080] session shared/user_1_6_8771659216780997938_v1
2025-10-02T08:09:01.652126Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:09:01.652131Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:09:01.652135Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_6_8771659216780997938_v1" (Sender=[1:7556533425819796627:7080], Pipe=[1:7556533425819796630:7080], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:09:01.652138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:09:01.652136Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:09:01.652144Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:09:01.652152Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_6_8771659216780997938_v1" (Sender=[1:7556533425819796627:7080], Pipe=[1:7556533425819796630:7080], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:09:01.652158Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_6_8771659216780997938_v1" sender [1:7556533425819796627:7080] lock partition 0 for ReadingSession "shared/user_1_6_8771659216780997938_v1" (Sender=[1:7556533425819796627:7080], Pipe=[1:7556533425819796630:7080], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-02T08:09:01.652169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:09:01.652173Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000024s
2025-10-02T08:09:01.652182Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 got read request: guid# dbe84b0b-67a16f31-99e86833-84ef8963
2025-10-02T08:09:01.652306Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_6_8771659216780997938_v1" ClientId: "user" PipeClient { RawX1: 7556533425819796630 RawX2: 4503603922344872 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:09:01.652320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:09:01.655136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:01.655142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 503
2025-10-02T08:09:01.655180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be7168cb-303461a3-f7742db3-93fda740_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.655347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.655367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:01.655370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:01.655372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:01.655641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 503 sessionId:  describe result for acl check
2025-10-02T08:09:01.655667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:01.655672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:01.655674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:01.655677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533425819796637:7084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:01.656022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533425819796637:7084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:01.657446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533425819796637:7084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:01.658596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:01.659649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533425819796637:7084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:01.659661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533425819796637:7084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:01.659663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533425819796637:7084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:01.659669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:01.660231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:01.660247Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:01.660249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:01.660252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:01.660257Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 502 [1:7556533425819796613:7078]
2025-10-02T08:09:01.660268Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:01.660284Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:01.660292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.660294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.660296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.660310Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:01.660319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:01.660324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:01.660372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.660380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.660382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:01.660384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:01.660437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:01.660444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.660452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.660459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:01.660461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 502
2025-10-02T08:09:01.660470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 502, pipe: [1:7556533425819796632:7083]
2025-10-02T08:09:01.660481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796669:7084], now have 1 active actors on pipe
2025-10-02T08:09:01.660486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796632:7083], now have 1 active actors on pipe
2025-10-02T08:09:01.660488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533426280061921:2378], now have 1 active actors on pipe
2025-10-02T08:09:01.660494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533425819796607:7078]
2025-10-02T08:09:01.660495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533425819796607:7078]
2025-10-02T08:09:01.660504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:01.660511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.660517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:01.660519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.660520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:01.660533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.660540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.660545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_6_8771659216780997938_v1 on pipe: [1:7556533425819796632:7083]
2025-10-02T08:09:01.660532Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 502
2025-10-02T08:09:01.660566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:01.660569Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_6_8771659216780997938_v1:1 with generation 502
2025-10-02T08:09:01.660579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:01.660580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:01.660616Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74a06421-c1c1306e-94989713-f42ad40c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:01.660626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.660628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.660630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:01.660638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.660650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:01.660667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.660675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.660676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:01.660687Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_6_8771659216780997938_v1
2025-10-02T08:09:01.660693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.660707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533425819796607:7078]
2025-10-02T08:09:01.660719Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:01.660741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.660742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:01.660762Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:01.660792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.660817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.660923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.660967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 503 partition: 0 MaxSeqNo: 17 sessionId: src_id|74a06421-c1c1306e-94989713-f42ad40c_0
2025-10-02T08:09:01.661241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be7168cb-303461a3-f7742db3-93fda740_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74a06421-c1c1306e-94989713-f42ad40c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:01.663834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a06421-c1c1306e-94989713-f42ad40c_0] Write session: try to update token
2025-10-02T08:09:01.663845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a06421-c1c1306e-94989713-f42ad40c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:01.663851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:09:01.663876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:09:01.663884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.663888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.663890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.663896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:09:01.663906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:09:01.663954Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392541660 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:09:01.663964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:09:01.663984Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 sending to client partition status
2025-10-02T08:09:01.677170Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:01.677187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.677189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:01.677196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533425819796607:7078]
2025-10-02T08:09:01.677199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533425819796607:7078]
2025-10-02T08:09:01.677233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:01.677240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.677242Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:01.677245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:01.677248Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:01.677376Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:01.677623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId: src_id|74a06421-c1c1306e-94989713-f42ad40c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:01.679885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:01.797999Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:01.798352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.798362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.798468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:01.798473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:01.798495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533425819796632:7083]
2025-10-02T08:09:01.798518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 503 reason: error at write: Disconnected sessionId: src_id|74a06421-c1c1306e-94989713-f42ad40c_0
2025-10-02T08:09:01.798638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 503 sessionId: src_id|74a06421-c1c1306e-94989713-f42ad40c_0 is DEAD
2025-10-02T08:09:01.798642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_6_8771659216780997938_v1
2025-10-02T08:09:01.798647Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:01.798611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:01.798760Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_6_8771659216780997938_v1
2025-10-02T08:09:01.798780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a06421-c1c1306e-94989713-f42ad40c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:01.798790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a06421-c1c1306e-94989713-f42ad40c_0] Write session will restart in 0.008000s
2025-10-02T08:09:01.798807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a06421-c1c1306e-94989713-f42ad40c_0] Write session: Do CDS request
2025-10-02T08:09:01.798811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a06421-c1c1306e-94989713-f42ad40c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:01.803046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:01.803716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:01.803835Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:01.803842Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:01.803848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:01.803873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:01.803897Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533425819796772:7088]
2025-10-02T08:09:01.804263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:01.804372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:01.804395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:01.804566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:01.804591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.804595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.804595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.804596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.804597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.804600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.804606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.804608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.804610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.804612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.804615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.804619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.804622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.804625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.804627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.804629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.804633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.804635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.804638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.804640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.804649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:01.808236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a06421-c1c1306e-94989713-f42ad40c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.808312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:01.808318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 504
2025-10-02T08:09:01.808455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.808474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:01.808479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:01.808481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:01.808750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 504 sessionId:  describe result for acl check
2025-10-02T08:09:01.808776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:01.808777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:01.808778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:01.808782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533425819796788:7090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:01.809143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533425819796788:7090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:01.810564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533425819796788:7090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:01.811679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:01.812582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533425819796788:7090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:01.812592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533425819796788:7090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:01.812594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533425819796788:7090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:01.812599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:01.813168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:01.813181Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:01.813183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:01.813185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:01.813188Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 503 [1:7556533425819796772:7088]
2025-10-02T08:09:01.813196Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:01.813206Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:01.813208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.813210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.813211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.813222Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:01.813231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:01.813235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:01.813268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.813273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.813275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:01.813277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:01.813318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:01.813324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.813330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.813336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:01.813345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 503
2025-10-02T08:09:01.813348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796820:7090], now have 1 active actors on pipe
2025-10-02T08:09:01.813350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533426280061929:2378], now have 1 active actors on pipe
2025-10-02T08:09:01.813353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533425819796766:7088]
2025-10-02T08:09:01.813354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533425819796766:7088]
2025-10-02T08:09:01.813359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:01.813365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.813366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.813368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:01.813371Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:01.813379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:01.813388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:01.813393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:01.813419Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:01.813428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.813430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.813431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:01.813437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.813443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:01.813448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533425819796766:7088]
2025-10-02T08:09:01.813402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 503
2025-10-02T08:09:01.813451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:01.813455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:01.813464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.813490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.813497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.813513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.813538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 504 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0
2025-10-02T08:09:01.813783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a06421-c1c1306e-94989713-f42ad40c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:01.816282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0] Write session: try to update token
2025-10-02T08:09:01.816296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:01.828992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId: src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:01.829156Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:01.829168Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.829170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:01.829176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533425819796766:7088]
2025-10-02T08:09:01.829179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533425819796766:7088]
2025-10-02T08:09:01.829207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:01.829208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:01.829212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:01.829214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.829215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:01.829337Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:01.831473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:01.898569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533425819796838:7083]
2025-10-02T08:09:01.898675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 503, pipe: [1:7556533425819796838:7083]
2025-10-02T08:09:01.951130Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:01.951312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.951321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.951347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796838:7083], now have 1 active actors on pipe
2025-10-02T08:09:01.951398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:01.951403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:01.951438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 504 reason: error at write: Disconnected sessionId: src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0
2025-10-02T08:09:01.951467Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:01.951592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 504 sessionId: src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0 is DEAD
2025-10-02T08:09:01.951751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:01.951765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0] Write session will restart in 0.006516s
2025-10-02T08:09:01.951757Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:01.951784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0] Write session: Do CDS request
2025-10-02T08:09:01.951790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:01.951927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533425819796838:7083]
2025-10-02T08:09:01.955895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:01.956812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:01.956957Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:01.956963Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:01.956969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:01.957004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:01.957029Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533425819796943:7101]
2025-10-02T08:09:01.957405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:01.957735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:01.957775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:01.957977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:01.958002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.958007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.958007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.958008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.958008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.958011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.958016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.958018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.958020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.958022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.958025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.958029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:01.958032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.958036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:01.958038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.958040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:01.958042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.958045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.958047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.958049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.958060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:01.959308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.959329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:01.959338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 505
2025-10-02T08:09:01.959520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:01.959540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:01.959553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:01.959559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:01.959870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 505 sessionId:  describe result for acl check
2025-10-02T08:09:01.959891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:01.959895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:01.959896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:01.959899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533425819796959:7103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:01.960243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533425819796959:7103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:01.961311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533425819796959:7103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:01.964858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533425819796959:7103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:01.964869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533425819796959:7103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:01.964871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533425819796959:7103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:01.964878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:01.965566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:01.966879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:01.966890Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:01.966891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:01.966894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:01.966897Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 504 [1:7556533425819796943:7101]
2025-10-02T08:09:01.966904Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:01.966914Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:01.966916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.966917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.966918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.966927Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:01.966930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:01.966934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:01.966969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.966976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.966978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:01.966980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:01.967019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:01.967024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.967030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:01.967037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:01.967047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533425819796937:7101]
2025-10-02T08:09:01.967054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533425819796937:7101]
2025-10-02T08:09:01.967059Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:01.967066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:01.967069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:01.967073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:01.967074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:01.967076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:01.967082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533426280061938:2378], now have 1 active actors on pipe
2025-10-02T08:09:01.967098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533425819796937:7101]
2025-10-02T08:09:01.967103Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:01.967111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:01.967120Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 504
2025-10-02T08:09:01.967331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 504
2025-10-02T08:09:01.967344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533425819796987:7103], now have 1 active actors on pipe
2025-10-02T08:09:01.967349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.967352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.967369Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:01.967378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.967384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.967386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:01.967392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.967403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:01.967416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.967451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.967458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.967466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:01.967486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 505 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0
2025-10-02T08:09:01.967803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3ae380-7dac399c-122afec3-43f3ebaf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:01.969972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0] Write session: try to update token
2025-10-02T08:09:01.969985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:01.976974Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:01.976986Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.976992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533425819796937:7101]
2025-10-02T08:09:01.977020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:01.977028Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:01.977165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:01.977288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.977410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.977533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:01.977710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:01.977740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:01.983483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId: src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:01.985903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:01.985951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.985960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.985985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:01.986002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:01.986041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:01.986054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:01.986198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.986268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.986332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.986396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.986579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.986589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.986655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.986718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.986784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.986861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.986908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.986913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.986980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.987041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.987106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.987171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.987219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.987225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.987291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.987355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.987420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.987495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.987541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.987546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.987610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.987669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.987744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.987805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.987851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.987856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.987922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.987980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.988043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.988106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.988152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.988158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.988217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.988274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.988336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.988394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.988435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.988440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.988499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.988556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.988616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.988675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.988719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.988727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.988784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.988856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.988913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.988972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.989016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.989022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.989081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:01.989136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:01.989193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:01.989249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:01.989288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:01.989293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:01.989325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:01.989369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:01.989384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:01.989390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:01.989413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:01.989428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:01.989430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:01.989432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:01.989434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:01.989791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:01.989812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:01.989822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:01.989824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:01.989825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:01.989827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:01.990408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:01.990426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:01.990434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:01.990436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:01.990438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:01.990440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:01.990870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:01.990887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:01.990892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:01.990898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:01.990899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:01.992045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:01.992061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:01.992071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392541991
2025-10-02T08:09:01.992186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:01.992199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:01.992202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:01.992204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:01.992206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:01.992208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:01.992635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:01.992653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:01.992657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:01.992659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:01.992663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:01.992665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:01.993111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:01.993128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:01.993134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:01.993140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:01.993142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:01.993144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:01.993578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:01.993594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:01.993598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:01.994631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:01.994647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:01.994651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:01.994653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:01.994659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392541994
2025-10-02T08:09:01.994941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:01.994957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:01.994960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:01.994967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:01.994969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:01.994972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:01.995399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:01.995419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:01.995430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:01.995433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:01.995435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:01.995436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:01.995848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:01.995864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:01.995934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392541995
2025-10-02T08:09:01.996629Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:01.996646Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:01.996651Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:01.996655Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:01.998199Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:01.998211Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:01.998213Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:01.998218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533425819796937:7101]
2025-10-02T08:09:01.998221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533425819796937:7101]
2025-10-02T08:09:01.998249Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:01.998260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:01.998261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:01.998264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:01.998265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:01.998398Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:02.052151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533430114764330:7083]
2025-10-02T08:09:02.052226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 504, pipe: [1:7556533430114764330:7083]
2025-10-02T08:09:02.124667Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:02.125399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764330:7083], now have 1 active actors on pipe
2025-10-02T08:09:02.125569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533430114764330:7083]
2025-10-02T08:09:02.125599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:02.125601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:02.125616Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:02.125625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 505 reason: error at write: Disconnected sessionId: src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0
2025-10-02T08:09:02.125655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:02.125781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 505 sessionId: src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0 is DEAD
2025-10-02T08:09:02.126013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:02.126024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0] Write session will restart in 0.007932s
2025-10-02T08:09:02.126043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0] Write session: Do CDS request
2025-10-02T08:09:02.126048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:02.130280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:02.131502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:02.131636Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:02.131646Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:02.131654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:02.131685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:02.131720Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533430114764422:7113]
2025-10-02T08:09:02.132185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:02.132360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:02.132393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:02.132693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:02.132827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.132833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.132834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.132835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.132836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.132842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.132851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.132854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.132857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.132860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.132866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.132873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.132877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.132882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.132885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.132889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.132893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.132902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.132906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.132916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.132931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:02.135189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.135412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:02.135422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 506
2025-10-02T08:09:02.135553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.135574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:02.135580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:02.135583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:02.135869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 506 sessionId:  describe result for acl check
2025-10-02T08:09:02.135895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:02.135900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:02.135901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:02.135904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533430114764438:7115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:02.136244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533430114764438:7115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:02.137579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533430114764438:7115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:02.139997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533430114764438:7115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:02.140007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533430114764438:7115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:02.140009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533430114764438:7115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:02.140015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:02.140577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:02.141992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:02.142006Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:02.142007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:02.142010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:02.142014Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 505 [1:7556533430114764422:7113]
2025-10-02T08:09:02.142022Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:02.142033Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:02.142038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.142040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.142041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.142053Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:02.142056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:02.142061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:02.142100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.142106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.142108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:02.142110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:02.142157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:02.142162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.142169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.142175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:02.142190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533430114764416:7113]
2025-10-02T08:09:02.142194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533430114764416:7113]
2025-10-02T08:09:02.142199Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:02.142206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:02.142208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:02.142212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:02.142221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 505
2025-10-02T08:09:02.142223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:02.142225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:02.142231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764469:7115], now have 1 active actors on pipe
2025-10-02T08:09:02.142233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533430575029262:2378], now have 1 active actors on pipe
2025-10-02T08:09:02.142256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.142262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.142272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533430114764416:7113]
2025-10-02T08:09:02.142240Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 505
2025-10-02T08:09:02.142274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:02.142281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:02.142289Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:02.142293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.142295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.142296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:02.142302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.142308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:02.142325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.142375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.142387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.142408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.142441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 506 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0
2025-10-02T08:09:02.142720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c08b719-c433e96c-9ec2408d-d36fcf5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:02.144899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0] Write session: try to update token
2025-10-02T08:09:02.144911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:02.157230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId: src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:02.158048Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:02.158059Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:02.158061Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:02.158066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533430114764416:7113]
2025-10-02T08:09:02.158069Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533430114764416:7113]
2025-10-02T08:09:02.158096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:02.158104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.158105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:02.158116Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:02.158128Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:02.158234Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:02.159704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:02.225727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533430114764485:7083]
2025-10-02T08:09:02.225829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 505, pipe: [1:7556533430114764485:7083]
2025-10-02T08:09:02.281807Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:02.282202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.282213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.282244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764485:7083], now have 1 active actors on pipe
2025-10-02T08:09:02.282331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:02.282342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:02.282364Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:02.282402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 506 reason: error at write: Disconnected sessionId: src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0
2025-10-02T08:09:02.282392Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:02.282537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533430114764485:7083]
2025-10-02T08:09:02.282592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 506 sessionId: src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0 is DEAD
2025-10-02T08:09:02.282771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:02.282782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0] Write session will restart in 0.009247s
2025-10-02T08:09:02.282804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0] Write session: Do CDS request
2025-10-02T08:09:02.282809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:02.286590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:02.287174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:02.287282Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:02.287289Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:02.287295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:02.287321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:02.287347Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533430114764579:7119]
2025-10-02T08:09:02.287761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:02.287879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:02.287903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:02.288082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:02.288107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.288111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.288111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.288112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.288112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.288115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.288121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.288123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.288125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.288127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.288131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.288135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.288138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.288144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.288148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.288150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.288152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.288154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.288157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.288159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.288172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:02.293273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.293326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:02.293340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 507
2025-10-02T08:09:02.293493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.293516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:02.293523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:02.293525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:02.293835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 507 sessionId:  describe result for acl check
2025-10-02T08:09:02.293857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:02.293870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:02.293871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:02.293875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533430114764595:7121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:02.294212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533430114764595:7121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:02.295378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:02.295986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533430114764595:7121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:02.296700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:02.296711Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:02.296713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:02.296715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:02.296719Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 506 [1:7556533430114764579:7119]
2025-10-02T08:09:02.296725Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:02.296737Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:02.296741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.296743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.296745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.296757Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:02.296760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:02.296766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:02.296818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.296823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.296827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:02.296829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:02.296871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:02.296876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.296883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.296890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:02.296900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533430114764573:7119]
2025-10-02T08:09:02.296901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533430114764573:7119]
2025-10-02T08:09:02.296905Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:02.296914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533430575029281:2378], now have 1 active actors on pipe
2025-10-02T08:09:02.296913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:02.296916Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:02.296922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:02.296929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:02.296931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:02.296948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533430114764573:7119]
2025-10-02T08:09:02.296953Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:02.296960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:02.296948Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 506
2025-10-02T08:09:02.301344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533430114764595:7121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:02.301355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533430114764595:7121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:02.301358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533430114764595:7121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:02.301364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:02.301498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 506
2025-10-02T08:09:02.301509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764635:7121], now have 1 active actors on pipe
2025-10-02T08:09:02.301514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.301520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.301537Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|694ce43e-d0f922d0-2a124320-fceba358_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:02.301548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.301554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.301557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:02.301565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.301576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:02.301590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.301617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.301621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.301630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.301652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 507 partition: 0 MaxSeqNo: 17 sessionId: src_id|694ce43e-d0f922d0-2a124320-fceba358_0
2025-10-02T08:09:02.301949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf805212-7bd6eadd-4ae41251-ada1c4ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|694ce43e-d0f922d0-2a124320-fceba358_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:02.304208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694ce43e-d0f922d0-2a124320-fceba358_0] Write session: try to update token
2025-10-02T08:09:02.304224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694ce43e-d0f922d0-2a124320-fceba358_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:02.306533Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:02.306545Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:02.306550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533430114764573:7119]
2025-10-02T08:09:02.306575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:02.306576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:02.306713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:02.306835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:02.306953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:02.307070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:02.307234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:02.307261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:02.318616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId: src_id|694ce43e-d0f922d0-2a124320-fceba358_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:02.321039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:02.321964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.321981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.321998Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:02.322003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:02.322005Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:02.322012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533430114764573:7119]
2025-10-02T08:09:02.322014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533430114764573:7119]
2025-10-02T08:09:02.322045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:02.322052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:02.322054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:02.322057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.322059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:02.322181Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:02.382891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533430114764663:7083]
2025-10-02T08:09:02.382960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 506, pipe: [1:7556533430114764663:7083]
2025-10-02T08:09:02.443335Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:02.443549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:02.443568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764663:7083], now have 1 active actors on pipe
2025-10-02T08:09:02.443580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:02.443668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:02.443675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:02.443689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 507 reason: error at write: Disconnected sessionId: src_id|694ce43e-d0f922d0-2a124320-fceba358_0
2025-10-02T08:09:02.443775Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:02.443828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 507 sessionId: src_id|694ce43e-d0f922d0-2a124320-fceba358_0 is DEAD
2025-10-02T08:09:02.443930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533430114764663:7083]
2025-10-02T08:09:02.443982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694ce43e-d0f922d0-2a124320-fceba358_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:02.443994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694ce43e-d0f922d0-2a124320-fceba358_0] Write session will restart in 0.007429s
2025-10-02T08:09:02.444014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694ce43e-d0f922d0-2a124320-fceba358_0] Write session: Do CDS request
2025-10-02T08:09:02.444021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694ce43e-d0f922d0-2a124320-fceba358_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:02.448897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:02.449627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:02.449786Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:02.449793Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:02.449801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:02.449833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:02.449859Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533430114764762:7127]
2025-10-02T08:09:02.450245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:02.450423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:02.450467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:02.450673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:02.450709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.450715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.450716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.450716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.450717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.450720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.450726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.450727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.450730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.450731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.450735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.450739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.450743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.450745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.450748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.450751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.450753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.450756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.450758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.450761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.450771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:02.452195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694ce43e-d0f922d0-2a124320-fceba358_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.452291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:02.452299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 508
2025-10-02T08:09:02.452427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.452448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:02.452454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:02.452457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:02.452718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 508 sessionId:  describe result for acl check
2025-10-02T08:09:02.452740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:02.452744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:02.452745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:02.452748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533430114764778:7129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:02.453107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533430114764778:7129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:02.454648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533430114764778:7129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:02.457494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533430114764778:7129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:02.457506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533430114764778:7129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:02.457509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533430114764778:7129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:02.457517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:02.458122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:02.459553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:02.459566Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:02.459568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:02.459571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:02.459575Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 507 [1:7556533430114764762:7127]
2025-10-02T08:09:02.459582Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:02.459593Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:02.459599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.459601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.459603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.459616Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:02.459623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:02.459627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:02.459668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.459673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.459675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:02.459677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:02.459743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:02.459750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.459761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.459775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:02.459781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 507
2025-10-02T08:09:02.459796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764810:7129], now have 1 active actors on pipe
2025-10-02T08:09:02.459802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533430575029289:2378], now have 1 active actors on pipe
2025-10-02T08:09:02.459807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533430114764756:7127]
2025-10-02T08:09:02.459813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533430114764756:7127]
2025-10-02T08:09:02.459823Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:02.459833Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:02.459836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.459840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.459841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:02.459857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:02.459839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 507
2025-10-02T08:09:02.459875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:02.459881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:02.459913Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:02.459921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.459924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.459925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:02.459931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.459938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:02.459950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533430114764756:7127]
2025-10-02T08:09:02.459960Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:02.459977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:02.459986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.460016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.460025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.460043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.460072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 508 partition: 0 MaxSeqNo: 17 sessionId: src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0
2025-10-02T08:09:02.460393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694ce43e-d0f922d0-2a124320-fceba358_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:02.462762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0] Write session: try to update token
2025-10-02T08:09:02.462780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:02.475728Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:02.475756Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:02.475758Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:02.475764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533430114764756:7127]
2025-10-02T08:09:02.475767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533430114764756:7127]
2025-10-02T08:09:02.475796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:02.475798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:02.475799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:02.475803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.475804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:02.475942Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:02.477205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId: src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:02.479778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:02.544206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533430114764826:7083]
2025-10-02T08:09:02.544289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 507, pipe: [1:7556533430114764826:7083]
2025-10-02T08:09:02.602660Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:02.602957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.602968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.603009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764826:7083], now have 1 active actors on pipe
2025-10-02T08:09:02.603118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:02.603127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:02.603183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 508 reason: error at write: Disconnected sessionId: src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0
2025-10-02T08:09:02.603276Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:02.603288Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:02.603400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 508 sessionId: src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0 is DEAD
2025-10-02T08:09:02.603582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:02.603595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0] Write session will restart in 0.005118s
2025-10-02T08:09:02.603593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533430114764826:7083]
2025-10-02T08:09:02.603614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0] Write session: Do CDS request
2025-10-02T08:09:02.603621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:02.610195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.610300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:02.610320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 509
2025-10-02T08:09:02.610343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:02.610494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.610538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:02.610549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:02.610553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:02.611005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 509 sessionId:  describe result for acl check
2025-10-02T08:09:02.611044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:02.611053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:02.611055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:02.611061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533430114764924:7135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:02.611279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:02.611463Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:02.611476Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:02.611487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:02.611559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:02.611598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533430114764924:7135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:02.611602Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533430114764926:7133]
2025-10-02T08:09:02.612289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:02.612588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:02.612641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:02.613012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:02.613081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.613091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.613092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.613094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.613095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.613101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.613113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.613121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.613126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.613130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.613136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.613145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.613158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.613164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.613176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.613181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.613192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.613198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.613210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.613216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.613242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:02.613859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533430114764924:7135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:02.621023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533430114764924:7135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:02.621044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533430114764924:7135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:02.621048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533430114764924:7135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:02.621058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:02.622227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:02.624167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:02.624189Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:02.624191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:02.624197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:02.624205Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 508 [1:7556533430114764926:7133]
2025-10-02T08:09:02.624218Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:02.624245Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:02.624256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.624260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.624262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.624280Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:02.624291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:02.624298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:02.624377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.624387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.624391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:02.624394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:02.624461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:02.624471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.624487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.624507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:02.624532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533430114764917:7133]
2025-10-02T08:09:02.624541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533430114764917:7133]
2025-10-02T08:09:02.624552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 508
2025-10-02T08:09:02.624554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:02.624561Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:02.624565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:02.624570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764971:7135], now have 1 active actors on pipe
2025-10-02T08:09:02.624574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533430575029296:2378], now have 1 active actors on pipe
2025-10-02T08:09:02.624584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:02.624599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:02.624610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:02.624617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.624628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.624672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533430114764917:7133]
2025-10-02T08:09:02.624682Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:02.624650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 508
2025-10-02T08:09:02.624691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:02.624699Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:02.624708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.624713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.624715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:02.624725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.624742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:02.624795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.624862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.624872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.624886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.624930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 509 partition: 0 MaxSeqNo: 17 sessionId: src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0
2025-10-02T08:09:02.625335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f30372f-f3eeb0e-1ce4d770-7ef7129d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:02.627633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0] Write session: try to update token
2025-10-02T08:09:02.627653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:02.637624Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:02.637649Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:02.637660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533430114764917:7133]
2025-10-02T08:09:02.637707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:02.637709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:02.637936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:02.638136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:02.638327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:02.638517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:02.638776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:02.638827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:02.644036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId: src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:02.646381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:02.646434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.646445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.646467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:02.646487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:02.646534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.646541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.646670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.646727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.646782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.646841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.646893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.646901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.646954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.647008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.647070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.647123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.647162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.647169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.647222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.647275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.647328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.647381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.647427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.647434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.647486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.647539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.647594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.647647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.647685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.647691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.647758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.647815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.647870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.647923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.647966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.647972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.648023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.648073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.648127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.648180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.648219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.648225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.648277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.648328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.648384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.648438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.648480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.648486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.648539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.648593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.648646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.648697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.648737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.648744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.648797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.648863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.648915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.648967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.649011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.649017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.649070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:02.649120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:02.649172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:02.649227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:02.649271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:02.649277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:02.649300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:02.649348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.649364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.649370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:02.649392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:02.649404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:02.649407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:02.649410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:02.649411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:02.649761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:02.649782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:02.649787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:02.649789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:02.649791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:02.649793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:02.650221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:02.650239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:02.650244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:02.650246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:02.650249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:02.650250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:02.650650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:02.650667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:02.650670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:02.650673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:02.650675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:02.651748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:02.651764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:02.651773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392542651
2025-10-02T08:09:02.651916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:02.651927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:02.651930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:02.651932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:02.651935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:02.651938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:02.652339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:02.652356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:02.652360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:02.652362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:02.652365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:02.652367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:02.652834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:02.652855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:02.652861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:02.652869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:02.652874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:02.652878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:02.653435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:02.653466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:02.653471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:02.654710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:02.654732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:02.654737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:02.654741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:02.654749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392542654
2025-10-02T08:09:02.655064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:02.655087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:02.655094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:02.655097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:02.655101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:02.655107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:02.655649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:02.655674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:02.655678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:02.655684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:02.655687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:02.655691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:02.656222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:02.656247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.656348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392542656
2025-10-02T08:09:02.657259Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:02.657282Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:02.657289Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:02.657296Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:02.659313Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:02.659332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:02.659335Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:02.659345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533430114764917:7133]
2025-10-02T08:09:02.659351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533430114764917:7133]
2025-10-02T08:09:02.659401Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:02.659409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:02.659413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.659415Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:02.659416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:02.659577Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:02.703903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533430114764993:7083]
2025-10-02T08:09:02.703987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 508, pipe: [1:7556533430114764993:7083]
2025-10-02T08:09:02.781038Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:02.781299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114764993:7083], now have 1 active actors on pipe
2025-10-02T08:09:02.781387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:02.781398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:02.781420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 509 reason: error at write: Disconnected sessionId: src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0
2025-10-02T08:09:02.781425Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:02.781468Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:02.781578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 509 sessionId: src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0 is DEAD
2025-10-02T08:09:02.781610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533430114764993:7083]
2025-10-02T08:09:02.781725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:02.781734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0] Write session will restart in 0.005779s
2025-10-02T08:09:02.781751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0] Write session: Do CDS request
2025-10-02T08:09:02.781756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:02.785893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:02.786571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:02.786675Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:02.786684Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:02.786689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:02.786715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:02.786743Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533430114765093:7139]
2025-10-02T08:09:02.787109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:02.787242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:02.787266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:02.787440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:02.787464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.787470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.787471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.787471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.787472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.787475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.787481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.787483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.787485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.787487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.787491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.787495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.787498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.787501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.787503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.787506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.787508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.787511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.787513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.787516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.787525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:02.788197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.788269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:02.788282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 510
2025-10-02T08:09:02.788381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.788402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:02.788406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:02.788408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:02.788699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 510 sessionId:  describe result for acl check
2025-10-02T08:09:02.788726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:02.788732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:02.788734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:02.788737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533430114765109:7141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:02.789083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533430114765109:7141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:02.790325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533430114765109:7141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:02.794095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533430114765109:7141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:02.794107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533430114765109:7141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:02.794109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533430114765109:7141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:02.794114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:02.794643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:02.796015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:02.796028Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:02.796030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:02.796032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:02.796036Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 509 [1:7556533430114765093:7139]
2025-10-02T08:09:02.796042Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:02.796052Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:02.796054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.796055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.796056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.796066Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:02.796069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:02.796073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:02.796106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.796113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.796115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:02.796116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:02.796154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:02.796160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.796166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.796173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:02.796182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 509
2025-10-02T08:09:02.796184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114765140:7141], now have 1 active actors on pipe
2025-10-02T08:09:02.796186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533430575029302:2378], now have 1 active actors on pipe
2025-10-02T08:09:02.796190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533430114765087:7139]
2025-10-02T08:09:02.796192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533430114765087:7139]
2025-10-02T08:09:02.796195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:02.796202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.796203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:02.796205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.796205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:02.796218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:02.796225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:02.796229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:02.796215Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 509
2025-10-02T08:09:02.796254Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:02.796264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.796266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.796267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:02.796272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.796277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:02.796286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533430114765087:7139]
2025-10-02T08:09:02.796292Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:02.796306Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:02.796312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.796349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.796359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.796375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.796400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 510 partition: 0 MaxSeqNo: 17 sessionId: src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0
2025-10-02T08:09:02.796618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806098fd-1c64446a-d23f25b8-2d9ab049_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:02.799291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0] Write session: try to update token
2025-10-02T08:09:02.799302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:02.812618Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:02.812640Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:02.812642Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:02.812648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533430114765087:7139]
2025-10-02T08:09:02.812652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533430114765087:7139]
2025-10-02T08:09:02.812683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:02.812684Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:02.812687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.812688Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:02.812688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:02.812830Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:02.813107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId: src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:02.815493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:02.881593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533430114765158:7083]
2025-10-02T08:09:02.881680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 509, pipe: [1:7556533430114765158:7083]
2025-10-02T08:09:02.935012Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:02.935298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.935312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.935343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114765158:7083], now have 1 active actors on pipe
2025-10-02T08:09:02.935443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:02.935454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:02.935491Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:02.935504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 510 reason: error at write: Disconnected sessionId: src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0
2025-10-02T08:09:02.935529Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:02.935643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 510 sessionId: src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0 is DEAD
2025-10-02T08:09:02.935670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533430114765158:7083]
2025-10-02T08:09:02.935792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:02.935802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0] Write session will restart in 0.005413s
2025-10-02T08:09:02.935819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0] Write session: Do CDS request
2025-10-02T08:09:02.935824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:02.939967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:02.940727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:02.940851Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:02.940859Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:02.940865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:02.940892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:02.940922Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533430114765258:7146]
2025-10-02T08:09:02.941292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:02.941397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:02.941423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:02.941608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:02.941635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.941640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.941641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.941641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.941642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.941645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.941651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.941652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.941654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.941656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.941660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.941664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:02.941668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.941670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:02.941673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.941675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:02.941678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.941680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.941682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.941684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.941694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:02.942237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.942333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:02.942343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 511
2025-10-02T08:09:02.942465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:02.942485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:02.942492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:02.942496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:02.942747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 511 sessionId:  describe result for acl check
2025-10-02T08:09:02.942774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:02.942782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:02.942783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:02.942786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533430114765274:7148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:02.943117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533430114765274:7148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:02.944581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533430114765274:7148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:02.948271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533430114765274:7148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:02.948283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533430114765274:7148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:02.948285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533430114765274:7148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:02.948290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:02.948829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:02.950203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:02.950217Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:02.950219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:02.950221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:02.950224Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 510 [1:7556533430114765258:7146]
2025-10-02T08:09:02.950231Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:02.950242Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:02.950244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.950246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.950249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.950261Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:02.950269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:02.950273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:02.950309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.950315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.950317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:02.950319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:02.950360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:02.950367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.950374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:02.950380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:02.950391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 510
2025-10-02T08:09:02.950393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533430114765306:7148], now have 1 active actors on pipe
2025-10-02T08:09:02.950397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533430114765252:7146]
2025-10-02T08:09:02.950398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533430114765252:7146]
2025-10-02T08:09:02.950402Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:02.950407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533430575029310:2378], now have 1 active actors on pipe
2025-10-02T08:09:02.950410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:02.950412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.950413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:02.950414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.950437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:02.950449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:02.950451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:02.950441Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 510
2025-10-02T08:09:02.950479Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:02.950487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:02.950490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:02.950492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:02.950499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:02.950504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:02.950518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533430114765252:7146]
2025-10-02T08:09:02.950529Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:02.950537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:02.950545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.950588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:02.950599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:02.950622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:02.950656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 511 partition: 0 MaxSeqNo: 17 sessionId: src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0
2025-10-02T08:09:02.950956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe11b60-55a3e6f7-af6f33c0-73995ba7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:02.953624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0] Write session: try to update token
2025-10-02T08:09:02.953637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:02.967265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId: src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:02.967451Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:02.967467Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:02.967469Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:02.967476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533430114765252:7146]
2025-10-02T08:09:02.967480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533430114765252:7146]
2025-10-02T08:09:02.967511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:02.967521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:02.967522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:02.967522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:02.967528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:02.967659Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:02.969651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:03.035689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533434409732647:7083]
2025-10-02T08:09:03.035781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 510, pipe: [1:7556533434409732647:7083]
2025-10-02T08:09:03.092891Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:03.093251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.093262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.093293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409732647:7083], now have 1 active actors on pipe
2025-10-02T08:09:03.093419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:03.093435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:03.093441Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:03.093498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 511 reason: error at write: Disconnected sessionId: src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0
2025-10-02T08:09:03.093614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533434409732647:7083]
2025-10-02T08:09:03.093726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 511 sessionId: src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0 is DEAD
2025-10-02T08:09:03.093875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:03.093888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0] Write session will restart in 0.009003s
2025-10-02T08:09:03.093911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0] Write session: Do CDS request
2025-10-02T08:09:03.093920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:03.093876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:03.098216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:03.098904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:03.099018Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:03.099026Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:03.099032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:03.099059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:03.099084Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533434409732758:7164]
2025-10-02T08:09:03.099488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:03.099605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:03.099632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:03.099824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:03.099851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.099857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.099857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.099858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.099858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.099861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.099867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.099869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.099871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.099873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.099877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.099881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.099885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.099887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.099890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.099892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.099894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.099898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.099901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.099905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.099915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:03.104222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.104276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:03.104293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 512
2025-10-02T08:09:03.104408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.104437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:03.104442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:03.104451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:03.104828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 512 sessionId:  describe result for acl check
2025-10-02T08:09:03.104861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:03.104863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:03.104864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:03.104869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533434409732774:7166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:03.105263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533434409732774:7166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:03.107016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533434409732774:7166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:03.107380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:03.108881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:03.108898Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:03.108900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:03.108903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:03.108909Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 511 [1:7556533434409732758:7164]
2025-10-02T08:09:03.108919Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:03.108933Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:03.108942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.108945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.108947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.108962Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:03.108973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:03.108980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:03.109063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.109071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.109074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:03.109078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:03.109136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:03.109144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.109156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.109166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:03.109188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533434869996638:2378], now have 1 active actors on pipe
2025-10-02T08:09:03.109199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533434409732752:7164]
2025-10-02T08:09:03.109200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533434409732752:7164]
2025-10-02T08:09:03.109208Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:03.109223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:03.109205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 511
2025-10-02T08:09:03.109240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:03.109248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:03.109252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:03.109255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:03.109273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533434409732752:7164]
2025-10-02T08:09:03.109281Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:03.109283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:03.109860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533434409732774:7166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:03.109874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533434409732774:7166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:03.109877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533434409732774:7166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:03.109884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:03.110070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 511
2025-10-02T08:09:03.110070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409732812:7166], now have 1 active actors on pipe
2025-10-02T08:09:03.110076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.110078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.110096Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a2d85f9-36d96d99-2051353-72147c16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:03.110101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.110104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.110105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:03.110111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.110129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:03.110145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.110184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.110195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.110216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.110247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 512 partition: 0 MaxSeqNo: 17 sessionId: src_id|7a2d85f9-36d96d99-2051353-72147c16_0
2025-10-02T08:09:03.110536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f716fb2a-65dc58cf-d3aa9207-341ea134_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7a2d85f9-36d96d99-2051353-72147c16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:03.113360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a2d85f9-36d96d99-2051353-72147c16_0] Write session: try to update token
2025-10-02T08:09:03.113373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a2d85f9-36d96d99-2051353-72147c16_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:03.126157Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:03.126175Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:03.126177Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:03.126186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533434409732752:7164]
2025-10-02T08:09:03.126190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533434409732752:7164]
2025-10-02T08:09:03.126229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:03.126237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.126236Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:03.126242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:03.126243Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:03.126377Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:03.126753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId: src_id|7a2d85f9-36d96d99-2051353-72147c16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:03.129257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:03.193860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533434409732821:7083]
2025-10-02T08:09:03.193987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 511, pipe: [1:7556533434409732821:7083]
2025-10-02T08:09:03.259984Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:03.260268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.260281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.260313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409732821:7083], now have 1 active actors on pipe
2025-10-02T08:09:03.260433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:03.260446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:03.260476Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:03.260499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 512 reason: error at write: Disconnected sessionId: src_id|7a2d85f9-36d96d99-2051353-72147c16_0
2025-10-02T08:09:03.260499Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:03.260629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 512 sessionId: src_id|7a2d85f9-36d96d99-2051353-72147c16_0 is DEAD
2025-10-02T08:09:03.260656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533434409732821:7083]
2025-10-02T08:09:03.260778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a2d85f9-36d96d99-2051353-72147c16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:03.260786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a2d85f9-36d96d99-2051353-72147c16_0] Write session will restart in 0.006707s
2025-10-02T08:09:03.260828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a2d85f9-36d96d99-2051353-72147c16_0] Write session: Do CDS request
2025-10-02T08:09:03.260833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a2d85f9-36d96d99-2051353-72147c16_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:03.265498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:03.266188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:03.266303Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:03.266312Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:03.266318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:03.266343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:03.266365Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533434409732925:7170]
2025-10-02T08:09:03.266731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:03.266843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:03.266868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:03.267039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:03.267064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.267065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.267066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.267066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.267068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.267072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.267077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.267079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.267082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.267083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.267087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.267091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.267095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.267097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.267100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.267102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.267104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.267107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.267109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.267111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.267122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:03.268165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a2d85f9-36d96d99-2051353-72147c16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.268223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:03.268230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 513
2025-10-02T08:09:03.268340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.268358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:03.268361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:03.268363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:03.268627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 513 sessionId:  describe result for acl check
2025-10-02T08:09:03.268656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:03.268658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:03.268659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:03.268664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533434409732941:7172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:03.269022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533434409732941:7172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:03.271126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533434409732941:7172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:03.274032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533434409732941:7172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:03.274044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533434409732941:7172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:03.274047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533434409732941:7172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:03.274052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:03.274425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:03.275892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:03.275910Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:03.275911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:03.275914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:03.275919Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 512 [1:7556533434409732925:7170]
2025-10-02T08:09:03.275928Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:03.275942Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:03.275944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.275947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.275949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.275962Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:03.275966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:03.275971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:03.276022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.276034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.276036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:03.276039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:03.276094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:03.276103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.276105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 512
2025-10-02T08:09:03.276113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.276124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:03.276141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409732973:7172], now have 1 active actors on pipe
2025-10-02T08:09:03.276150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533434869996644:2378], now have 1 active actors on pipe
2025-10-02T08:09:03.276154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.276158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.276175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533434409732919:7170]
2025-10-02T08:09:03.276182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533434409732919:7170]
2025-10-02T08:09:03.276188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:03.276195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:03.276159Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 512
2025-10-02T08:09:03.276198Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:03.276199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:03.276210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:03.276213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:03.276226Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:03.276232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.276235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.276237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:03.276246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.276255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:03.276287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533434409732919:7170]
2025-10-02T08:09:03.276302Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:03.276312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.276315Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:03.276378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.276388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.276402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.276431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 513 partition: 0 MaxSeqNo: 17 sessionId: src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0
2025-10-02T08:09:03.276699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a2d85f9-36d96d99-2051353-72147c16_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:03.279377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0] Write session: try to update token
2025-10-02T08:09:03.279391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:03.286209Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:03.286235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:03.286245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533434409732919:7170]
2025-10-02T08:09:03.286272Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:03.286285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:03.286461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:03.286616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:03.286765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:03.286908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:03.287112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:03.287160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:03.291644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId: src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:03.294217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:03.294276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.294290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.294321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:03.294346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:03.294394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.294412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.294550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.294645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.294709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.294776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.294938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.294947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.295010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.295067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.295131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.295188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.295228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.295235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.295307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.295363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.295424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.295487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.295531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.295537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.295590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.295649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.295707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.295778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.295826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.295834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.295892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.295956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.296014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.296068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.296108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.296114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.296172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.296227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.296279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.296344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.296402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.296408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.296468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.296524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.296584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.296642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.296695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.296701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.296763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.296837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.296894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.296957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.297154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.297165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.297220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.297276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.297337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.297400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.297438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.297444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.297503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.297558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.297615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.297676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.297717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.297723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.297749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:03.297803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.297819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.297825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:03.297848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:03.297862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:03.297864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:03.297867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:03.297869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:03.298213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:03.298234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:03.298241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:03.298243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:03.298247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:03.298249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:03.298782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:03.298803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:03.298808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:03.298810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:03.298812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:03.298814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:03.299263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:03.299282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:03.299286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:03.299288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:03.299290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:03.301239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:03.301253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:03.301261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392543300
2025-10-02T08:09:03.301357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:03.301370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:03.301373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:03.301376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:03.301378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:03.301380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:03.301828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:03.301846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:03.301850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:03.301853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:03.301855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:03.301860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:03.302281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:03.302301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:03.302306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:03.302309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:03.302312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:03.302314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:03.302728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:03.302745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:03.302749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:03.303755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:03.303770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:03.303773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:03.303776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:03.303781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392543303
2025-10-02T08:09:03.304053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:03.304069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:03.304073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:03.304075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:03.304077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:03.304081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:03.304531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:03.304548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:03.304552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:03.304554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:03.304558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:03.304562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:03.304996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:03.305016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.305102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392543304
2025-10-02T08:09:03.308315Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:03.308343Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:03.308347Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:03.308351Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:03.310034Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:03.310048Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:03.310049Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:03.310056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533434409732919:7170]
2025-10-02T08:09:03.310058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533434409732919:7170]
2025-10-02T08:09:03.310086Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:03.310097Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:03.310101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:03.310104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.310105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:03.310245Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:03.360850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533434409733013:7083]
2025-10-02T08:09:03.360936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 512, pipe: [1:7556533434409733013:7083]
2025-10-02T08:09:03.434726Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:03.434986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409733013:7083], now have 1 active actors on pipe
2025-10-02T08:09:03.435084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533434409733013:7083]
2025-10-02T08:09:03.435109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:03.435110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:03.435131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 513 reason: error at write: Disconnected sessionId: src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0
2025-10-02T08:09:03.435167Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:03.435205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:03.435330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 513 sessionId: src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0 is DEAD
2025-10-02T08:09:03.435454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:03.435462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0] Write session will restart in 0.005417s
2025-10-02T08:09:03.435479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0] Write session: Do CDS request
2025-10-02T08:09:03.435483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:03.439734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:03.440420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:03.440529Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:03.440537Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:03.440543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:03.440570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:03.440597Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533434409733123:7178]
2025-10-02T08:09:03.441002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:03.441145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:03.441171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:03.441357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:03.441384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.441389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.441390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.441390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.441391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.441393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.441401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.441403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.441405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.441407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.441410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.441415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.441418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.441420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.441422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.441425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.441427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.441430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.441432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.441435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.441446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:03.442224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.442374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:03.442386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 514
2025-10-02T08:09:03.442488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.442509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:03.442517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:03.442520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:03.442816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 514 sessionId:  describe result for acl check
2025-10-02T08:09:03.442847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:03.442853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:03.442854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:03.442858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533434409733139:7180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:03.443236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533434409733139:7180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:03.444795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533434409733139:7180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:03.448507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533434409733139:7180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:03.448521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533434409733139:7180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:03.448523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533434409733139:7180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:03.448530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:03.449089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:03.450417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:03.450432Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:03.450433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:03.450436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:03.450442Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 513 [1:7556533434409733123:7178]
2025-10-02T08:09:03.450449Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:03.450462Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:03.450463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.450465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.450466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.450478Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:03.450481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:03.450485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:03.450529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.450537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.450540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:03.450541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:03.450585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:03.450591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.450599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.450604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 513
2025-10-02T08:09:03.450606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:03.450619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409733173:7180], now have 1 active actors on pipe
2025-10-02T08:09:03.450627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533434869996665:2378], now have 1 active actors on pipe
2025-10-02T08:09:03.450631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533434409733117:7178]
2025-10-02T08:09:03.450632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533434409733117:7178]
2025-10-02T08:09:03.450641Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:03.450652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.450655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.450654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:03.450658Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:03.450669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:03.450682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:03.450688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:03.450676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 513
2025-10-02T08:09:03.450718Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:03.450727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.450729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.450731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:03.450737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.450742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:03.450752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533434409733117:7178]
2025-10-02T08:09:03.450757Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:03.450771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:03.450783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.450819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.450829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.450846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.450874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 514 partition: 0 MaxSeqNo: 17 sessionId: src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0
2025-10-02T08:09:03.451165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae13ab-9db18ebd-1e288211-d6e36cca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:03.453973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0] Write session: try to update token
2025-10-02T08:09:03.453985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:03.467415Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:03.467436Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:03.467438Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:03.467444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533434409733117:7178]
2025-10-02T08:09:03.467448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533434409733117:7178]
2025-10-02T08:09:03.467488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:03.467487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:03.467492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:03.467492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.467494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:03.467625Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:03.468089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId: src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:03.470908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:03.535425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533434409733189:7083]
2025-10-02T08:09:03.535507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 513, pipe: [1:7556533434409733189:7083]
2025-10-02T08:09:03.597978Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:03.598325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.598337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.598367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409733189:7083], now have 1 active actors on pipe
2025-10-02T08:09:03.598467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:03.598476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:03.598516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 514 reason: error at write: Disconnected sessionId: src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0
2025-10-02T08:09:03.598547Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:03.598594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:03.598685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 514 sessionId: src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0 is DEAD
2025-10-02T08:09:03.598788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533434409733189:7083]
2025-10-02T08:09:03.598828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:03.598837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0] Write session will restart in 0.009682s
2025-10-02T08:09:03.598866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0] Write session: Do CDS request
2025-10-02T08:09:03.598871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:03.603202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:03.603885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:03.603994Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:03.604002Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:03.604009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:03.604034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:03.604063Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533434409733297:7184]
2025-10-02T08:09:03.604438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:03.604549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:03.604575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:03.604753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:03.604780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.604793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.604794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.604795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.604796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.604816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.604826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.604835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.604837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.604839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.604846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.604850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.604853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.604855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.604858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.604860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.604864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.604866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.604869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.604871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.604881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:03.609285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.609401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:03.609414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 515
2025-10-02T08:09:03.609485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.609508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:03.609516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:03.609518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:03.609871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 515 sessionId:  describe result for acl check
2025-10-02T08:09:03.609907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:03.609913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:03.609914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:03.609918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533434409733313:7186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:03.610310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533434409733313:7186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:03.611783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533434409733313:7186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:03.612092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:03.613507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:03.613523Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:03.613524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:03.613526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:03.613531Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 514 [1:7556533434409733297:7184]
2025-10-02T08:09:03.613539Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:03.613552Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:03.613553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.613555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.613556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.613567Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:03.613571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:03.613575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:03.613623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.613630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.613632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:03.613634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:03.613679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:03.613686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.613693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.613700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:03.613713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533434869996671:2378], now have 1 active actors on pipe
2025-10-02T08:09:03.613723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533434409733291:7184]
2025-10-02T08:09:03.613725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533434409733291:7184]
2025-10-02T08:09:03.613739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:03.613751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:03.613753Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:03.613756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:03.613769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:03.613771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:03.613795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533434409733291:7184]
2025-10-02T08:09:03.613803Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:03.613809Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:03.613786Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 514
2025-10-02T08:09:03.614432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533434409733313:7186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:03.614445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533434409733313:7186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:03.614448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533434409733313:7186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:03.614455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:03.614590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 514
2025-10-02T08:09:03.614598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409733353:7186], now have 1 active actors on pipe
2025-10-02T08:09:03.614603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.614606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.614624Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67041219-79be02db-5c4a6a9e-50dda612_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:03.614638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.614640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.614642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:03.614648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.614660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:03.614675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.614713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.614721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.614738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.614765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 515 partition: 0 MaxSeqNo: 17 sessionId: src_id|67041219-79be02db-5c4a6a9e-50dda612_0
2025-10-02T08:09:03.615025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cc5076c-b1a305d8-8a3916f7-74171912_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|67041219-79be02db-5c4a6a9e-50dda612_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:03.617650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67041219-79be02db-5c4a6a9e-50dda612_0] Write session: try to update token
2025-10-02T08:09:03.617664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67041219-79be02db-5c4a6a9e-50dda612_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:03.630203Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:03.630224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:03.630226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:03.630234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533434409733291:7184]
2025-10-02T08:09:03.630239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533434409733291:7184]
2025-10-02T08:09:03.630276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:03.630287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.630288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:03.630306Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:03.630337Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:03.630420Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:03.631311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId: src_id|67041219-79be02db-5c4a6a9e-50dda612_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:03.633695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:03.698750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533434409733362:7083]
2025-10-02T08:09:03.698846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 514, pipe: [1:7556533434409733362:7083]
2025-10-02T08:09:03.756997Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:03.757254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.757265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.757297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409733362:7083], now have 1 active actors on pipe
2025-10-02T08:09:03.757435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533434409733362:7083]
2025-10-02T08:09:03.757460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:03.757461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:03.757505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 515 reason: error at write: Disconnected sessionId: src_id|67041219-79be02db-5c4a6a9e-50dda612_0
2025-10-02T08:09:03.757496Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:03.757525Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:03.757641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 515 sessionId: src_id|67041219-79be02db-5c4a6a9e-50dda612_0 is DEAD
2025-10-02T08:09:03.757802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67041219-79be02db-5c4a6a9e-50dda612_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:03.757814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67041219-79be02db-5c4a6a9e-50dda612_0] Write session will restart in 0.006285s
2025-10-02T08:09:03.757836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67041219-79be02db-5c4a6a9e-50dda612_0] Write session: Do CDS request
2025-10-02T08:09:03.757842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67041219-79be02db-5c4a6a9e-50dda612_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:03.762178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:03.763026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:03.763147Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:03.763154Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:03.763161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:03.763198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:03.763233Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533434409733473:7190]
2025-10-02T08:09:03.763627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:03.763759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:03.763792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:03.764035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:03.764069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.764074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.764076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.764077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.764078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.764083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.764092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.764099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.764106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.764110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.764115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.764121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.764131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.764135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.764139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.764144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.764152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.764161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.764167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.764170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.764180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:03.765195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67041219-79be02db-5c4a6a9e-50dda612_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.765266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:03.765276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 516
2025-10-02T08:09:03.765431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.765456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:03.765465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:03.765468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:03.765847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 516 sessionId:  describe result for acl check
2025-10-02T08:09:03.765882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:03.765888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:03.765890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:03.765894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533434409733489:7192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:03.766359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533434409733489:7192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:03.767876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533434409733489:7192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:03.771163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533434409733489:7192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:03.771174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533434409733489:7192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:03.771176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533434409733489:7192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:03.771181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:03.771872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:03.773521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:03.773540Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:03.773543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:03.773546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:03.773552Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 515 [1:7556533434409733473:7190]
2025-10-02T08:09:03.773561Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:03.773578Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:03.773586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.773588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.773590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.773603Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:03.773612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:03.773621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:03.773680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.773689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.773692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:03.773695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:03.773754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:03.773762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.773771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 515
2025-10-02T08:09:03.773775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.773787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:03.773814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409733520:7192], now have 1 active actors on pipe
2025-10-02T08:09:03.773817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533434869996678:2378], now have 1 active actors on pipe
2025-10-02T08:09:03.773821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.773825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.773821Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 515
2025-10-02T08:09:03.773841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533434409733467:7190]
2025-10-02T08:09:03.773849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533434409733467:7190]
2025-10-02T08:09:03.773856Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:03.773862Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:03.773868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:03.773869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:03.773882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:03.773889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:03.773902Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:03.773912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.773919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.773921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:03.773929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.773942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:03.773980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533434409733467:7190]
2025-10-02T08:09:03.773993Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:03.773998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:03.774007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.774055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.774065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.774083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.774115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 516 partition: 0 MaxSeqNo: 17 sessionId: src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0
2025-10-02T08:09:03.774463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67041219-79be02db-5c4a6a9e-50dda612_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:03.777046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0] Write session: try to update token
2025-10-02T08:09:03.777058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:03.784537Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:03.784564Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:03.784574Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533434409733467:7190]
2025-10-02T08:09:03.784603Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:03.784614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:03.784910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:03.785153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:03.785377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:03.785619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:03.785949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:03.785997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:03.790760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId: src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:03.793377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:03.793474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.793489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.793519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:03.793537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:03.793580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.793592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.793732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.793794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.793853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.793919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.793964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.793971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.794027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.794084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.794144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.794201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.794251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.794257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.794312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.794368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.794425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.794483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.794521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.794526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.794583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.794640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.794695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.794761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.794804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.794808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.794867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.794922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.794979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.795038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.795078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.795085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.795141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.795195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.795243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.795296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.795337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.795342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.795397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.795450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.795505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.795561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.795605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.795610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.795665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.795719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.795788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.795849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.795889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.795894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.795951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.796005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.796061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.796149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.796190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.796195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.796251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:03.796303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:03.796363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:03.796423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:03.796462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:03.796467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:03.796497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:03.796550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.796564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.796570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:03.796593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:03.796606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:03.796611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:03.796612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:03.796613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:03.797008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:03.797027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:03.797034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:03.797036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:03.797037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:03.797039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:03.797527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:03.797544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:03.797551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:03.797554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:03.797555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:03.797557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:03.797964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:03.797982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:03.797986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:03.797988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:03.797990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:03.799068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:03.799083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:03.799092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392543799
2025-10-02T08:09:03.799225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:03.799234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:03.799237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:03.799241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:03.799243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:03.799246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:03.799706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:03.799721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:03.799735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:03.799741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:03.799743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:03.799745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:03.800159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:03.800176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:03.800182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:03.800188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:03.800190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:03.800192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:03.800645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:03.800659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:03.800664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:03.801686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:03.801704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:03.801707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:03.801710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:03.801716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392543801
2025-10-02T08:09:03.801985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:03.802001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:03.802004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:03.802011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:03.802013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:03.802015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:03.802464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:03.802480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:03.802488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:03.802490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:03.802493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:03.802495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:03.802906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:03.802923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.803000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392543802
2025-10-02T08:09:03.803711Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:03.803736Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:03.803746Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:03.803749Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:03.805365Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:03.805378Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:03.805379Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:03.805386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533434409733467:7190]
2025-10-02T08:09:03.805389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533434409733467:7190]
2025-10-02T08:09:03.805429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:03.805433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:03.805442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.805444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:03.805444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:03.805565Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:03.857462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533434409733546:7083]
2025-10-02T08:09:03.857528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 515, pipe: [1:7556533434409733546:7083]
2025-10-02T08:09:03.938746Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:03.939046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409733546:7083], now have 1 active actors on pipe
2025-10-02T08:09:03.939198Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:03.939248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:03.939260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:03.939255Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:03.939290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 516 reason: error at write: Disconnected sessionId: src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0
2025-10-02T08:09:03.939429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533434409733546:7083]
2025-10-02T08:09:03.939514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 516 sessionId: src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0 is DEAD
2025-10-02T08:09:03.939682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:03.939697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0] Write session will restart in 0.005191s
2025-10-02T08:09:03.939734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0] Write session: Do CDS request
2025-10-02T08:09:03.939740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:03.944351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:03.945117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:03.945297Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:03.945310Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:03.945321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:03.945380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:03.945417Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533434409733660:7197]
2025-10-02T08:09:03.945958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:03.946332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.946403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:03.946416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 517
2025-10-02T08:09:03.946424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:03.946468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:03.946616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:03.946639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:03.946646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:03.946649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:03.946671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:03.946696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.946700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.946700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.946701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.946701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.946704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.946710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.946712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.946714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.946716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.946720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.946724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:03.946728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.946734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:03.946737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.946739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:03.946745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.946748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.946750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.946756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.946766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:03.946923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 517 sessionId:  describe result for acl check
2025-10-02T08:09:03.946946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:03.946951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:03.946952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:03.946955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533434409733676:7199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:03.947310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533434409733676:7199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:03.949118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533434409733676:7199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:03.954121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533434409733676:7199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:03.954137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533434409733676:7199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:03.954140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533434409733676:7199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:03.954149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:03.954608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:03.955940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:03.955953Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:03.955954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:03.955957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:03.955961Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 516 [1:7556533434409733660:7197]
2025-10-02T08:09:03.955968Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:03.955980Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:03.955985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.955987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.955989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.955999Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:03.956006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:03.956011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:03.956054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.956058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.956061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:03.956062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:03.956106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:03.956111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.956119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:03.956130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:03.956143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 516
2025-10-02T08:09:03.956146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533434409733707:7199], now have 1 active actors on pipe
2025-10-02T08:09:03.956148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533434869996686:2378], now have 1 active actors on pipe
2025-10-02T08:09:03.956152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533434409733654:7197]
2025-10-02T08:09:03.956154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533434409733654:7197]
2025-10-02T08:09:03.956158Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:03.956164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.956167Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:03.956170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:03.956170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.956182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:03.956193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:03.956196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:03.956202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 516
2025-10-02T08:09:03.956224Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:03.956234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:03.956236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:03.956238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:03.956243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:03.956249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:03.956255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533434409733654:7197]
2025-10-02T08:09:03.956260Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:03.956276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:03.956283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.956329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:03.956340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:03.956358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:03.956388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 517 partition: 0 MaxSeqNo: 17 sessionId: src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0
2025-10-02T08:09:03.956740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1cccae-844e10b8-b1c60a59-a5b3026f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:03.959136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0] Write session: try to update token
2025-10-02T08:09:03.959154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:03.973653Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:03.973682Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:03.973685Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:03.973694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533434409733654:7197]
2025-10-02T08:09:03.973699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533434409733654:7197]
2025-10-02T08:09:03.973741Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:03.973743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:03.973751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:03.973752Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:03.973753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:03.973891Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:03.976197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId: src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:03.978650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:04.039756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533438704701048:7083]
2025-10-02T08:09:04.039838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 516, pipe: [1:7556533438704701048:7083]
2025-10-02T08:09:04.100599Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:04.100926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.100937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.100972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701048:7083], now have 1 active actors on pipe
2025-10-02T08:09:04.101075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533438704701048:7083]
2025-10-02T08:09:04.101093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:04.101095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:04.101143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 517 reason: error at write: Disconnected sessionId: src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0
2025-10-02T08:09:04.101190Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:04.101210Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:04.101315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 517 sessionId: src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0 is DEAD
2025-10-02T08:09:04.101515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:04.101526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0] Write session will restart in 0.008956s
2025-10-02T08:09:04.101568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0] Write session: Do CDS request
2025-10-02T08:09:04.101575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:04.107748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:04.108787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:04.108948Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:04.108955Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:04.108964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:04.109005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:04.109033Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533438704701169:7215]
2025-10-02T08:09:04.109531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:04.109700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:04.109737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:04.110024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:04.110070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.110075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.110078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.110079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.110080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.110084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.110093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.110097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.110100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.110103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.110108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.110115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.110120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.110125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.110129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.110134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.110138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.110142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.110146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.110151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.110169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:04.111394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.111468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:04.111479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 518
2025-10-02T08:09:04.111616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.111644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:04.111653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:04.111657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:04.112071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 518 sessionId:  describe result for acl check
2025-10-02T08:09:04.112110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:04.112117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:04.112118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:04.112124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533438704701185:7217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:04.112646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533438704701185:7217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:04.114805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533438704701185:7217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:04.117710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533438704701185:7217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:04.117725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533438704701185:7217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:04.117728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533438704701185:7217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:04.117737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:04.118344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:04.120154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:04.120172Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:04.120174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:04.120178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:04.120184Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 517 [1:7556533438704701169:7215]
2025-10-02T08:09:04.120196Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:04.120213Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:04.120220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.120225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.120228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.120243Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:04.120253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:04.120259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:04.120326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.120334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.120338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:04.120341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:04.120404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:04.120412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.120426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.120443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:04.120453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 517
2025-10-02T08:09:04.120464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701217:7217], now have 1 active actors on pipe
2025-10-02T08:09:04.120468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533439164964010:2378], now have 1 active actors on pipe
2025-10-02T08:09:04.120474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533438704701163:7215]
2025-10-02T08:09:04.120477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533438704701163:7215]
2025-10-02T08:09:04.120487Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:04.120499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:04.120501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.120505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.120505Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:04.120522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:04.120536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:04.120545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:04.120551Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 517
2025-10-02T08:09:04.120587Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:04.120595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.120602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.120605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:04.120613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.120626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:04.120638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533438704701163:7215]
2025-10-02T08:09:04.120648Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:04.120659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:04.120698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.120817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.120835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.120871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.120922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 518 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0
2025-10-02T08:09:04.121307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32c32d-b930b8de-dfba4457-a7fa758c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:04.124184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0] Write session: try to update token
2025-10-02T08:09:04.124199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:04.137652Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:04.137672Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:04.137675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:04.137684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533438704701163:7215]
2025-10-02T08:09:04.137689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533438704701163:7215]
2025-10-02T08:09:04.137734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:04.137739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:04.137745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.137748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:04.137748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:04.137899Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:04.139343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId: src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:04.142135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:04.201042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533438704701233:7083]
2025-10-02T08:09:04.201166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 517, pipe: [1:7556533438704701233:7083]
2025-10-02T08:09:04.276624Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:04.276863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.276881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.276915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701233:7083], now have 1 active actors on pipe
2025-10-02T08:09:04.276995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:04.277007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:04.277058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 518 reason: error at write: Disconnected sessionId: src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0
2025-10-02T08:09:04.277091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:04.277246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 518 sessionId: src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0 is DEAD
2025-10-02T08:09:04.277370Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:04.277396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533438704701233:7083]
2025-10-02T08:09:04.277440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:04.277451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0] Write session will restart in 0.006164s
2025-10-02T08:09:04.277479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0] Write session: Do CDS request
2025-10-02T08:09:04.277486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:04.283086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:04.284073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:04.284284Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:04.284294Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:04.284304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:04.284334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.284355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:04.284373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:04.284387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 519
2025-10-02T08:09:04.284397Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533438704701350:7221]
2025-10-02T08:09:04.284542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.284569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:04.284576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:04.284579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:04.284894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 519 sessionId:  describe result for acl check
2025-10-02T08:09:04.284917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:04.284922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:04.284924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:04.284927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533438704701355:7223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:04.284992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:04.285192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:04.285240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:04.285331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533438704701355:7223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:04.285531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:04.285590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.285596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.285597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.285598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.285599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.285604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.285614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.285617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.285621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.285624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.285629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.285636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.285646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.285651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.285660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.285665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.285668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.285673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.285678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.285683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.285705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:04.287631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533438704701355:7223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:04.293574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533438704701355:7223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:04.293593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533438704701355:7223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:04.293597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533438704701355:7223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:04.293607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:04.294258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:04.295682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:04.295694Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:04.295696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:04.295699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:04.295705Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 518 [1:7556533438704701350:7221]
2025-10-02T08:09:04.295713Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:04.295738Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:04.295739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.295743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.295745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.295757Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:04.295761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:04.295766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:04.295811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.295818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.295821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:04.295823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:04.295878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:04.295883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.295892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.295899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:04.295912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533438704701344:7221]
2025-10-02T08:09:04.295918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533438704701344:7221]
2025-10-02T08:09:04.295926Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:04.295938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:04.295940Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:04.295943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:04.295944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 518
2025-10-02T08:09:04.295954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:04.295956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:04.295965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701398:7223], now have 1 active actors on pipe
2025-10-02T08:09:04.295968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533439164964029:2378], now have 1 active actors on pipe
2025-10-02T08:09:04.295997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.296005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.296016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533438704701344:7221]
2025-10-02T08:09:04.296024Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:04.296049Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3196d2f8-46f460b-72734101-d37b0413_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:04.296051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:04.296058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.296064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.296066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:04.296074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.296063Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 518
2025-10-02T08:09:04.296085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:04.296110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.296168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.296174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.296189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.296225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 519 partition: 0 MaxSeqNo: 17 sessionId: src_id|3196d2f8-46f460b-72734101-d37b0413_0
2025-10-02T08:09:04.296768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8ca854-fb354d64-c5c1d7d0-53034c28_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3196d2f8-46f460b-72734101-d37b0413_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:04.299931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3196d2f8-46f460b-72734101-d37b0413_0] Write session: try to update token
2025-10-02T08:09:04.299952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3196d2f8-46f460b-72734101-d37b0413_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:04.313426Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:04.313443Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:04.313445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:04.313455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533438704701344:7221]
2025-10-02T08:09:04.313459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533438704701344:7221]
2025-10-02T08:09:04.313516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:04.313528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.313531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:04.313530Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:04.313536Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:04.313714Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:04.316000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId: src_id|3196d2f8-46f460b-72734101-d37b0413_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:04.318895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:04.377684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533438704701431:7083]
2025-10-02T08:09:04.377814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 518, pipe: [1:7556533438704701431:7083]
2025-10-02T08:09:04.453450Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:04.453770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.453780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.453813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701431:7083], now have 1 active actors on pipe
2025-10-02T08:09:04.453903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:04.453914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:04.453972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 519 reason: error at write: Disconnected sessionId: src_id|3196d2f8-46f460b-72734101-d37b0413_0
2025-10-02T08:09:04.454012Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:04.454179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 519 sessionId: src_id|3196d2f8-46f460b-72734101-d37b0413_0 is DEAD
2025-10-02T08:09:04.454330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3196d2f8-46f460b-72734101-d37b0413_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:04.454342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3196d2f8-46f460b-72734101-d37b0413_0] Write session will restart in 0.008619s
2025-10-02T08:09:04.454366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3196d2f8-46f460b-72734101-d37b0413_0] Write session: Do CDS request
2025-10-02T08:09:04.454373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3196d2f8-46f460b-72734101-d37b0413_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:04.454366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533438704701431:7083]
2025-10-02T08:09:04.455276Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:04.460077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:04.461154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:04.461327Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:04.461335Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:04.461344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:04.461387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:04.461426Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533438704701558:7231]
2025-10-02T08:09:04.462035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:04.462232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:04.462277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:04.462574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:04.462634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.462640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.462641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.462642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.462646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.462651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.462660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.462664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.462667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.462671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.462676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.462683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.462688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.462693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.462697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.462703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.462711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.462716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.462721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.462729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.462749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:04.464389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3196d2f8-46f460b-72734101-d37b0413_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.464402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:04.464414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 520
2025-10-02T08:09:04.464570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.464599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:04.464608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:04.464612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:04.465001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 520 sessionId:  describe result for acl check
2025-10-02T08:09:04.465035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:04.465036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:04.465038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:04.465042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533438704701574:7233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:04.465543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533438704701574:7233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:04.467620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533438704701574:7233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:04.470271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533438704701574:7233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:04.470283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533438704701574:7233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:04.470286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533438704701574:7233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:04.470295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:04.470623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:04.472225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:04.472246Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:04.472249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:04.472253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:04.472258Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 519 [1:7556533438704701558:7231]
2025-10-02T08:09:04.472271Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:04.472288Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:04.472290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.472292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.472294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.472307Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:04.472317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:04.472322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:04.472378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.472385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.472387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:04.472390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:04.472452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:04.472459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.472470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.472483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:04.472491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 519
2025-10-02T08:09:04.472500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701606:7233], now have 1 active actors on pipe
2025-10-02T08:09:04.472503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533439164964038:2378], now have 1 active actors on pipe
2025-10-02T08:09:04.472509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533438704701552:7231]
2025-10-02T08:09:04.472511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533438704701552:7231]
2025-10-02T08:09:04.472521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:04.472533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.472540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.472544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:04.472548Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:04.472557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:04.472573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:04.472577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:04.472615Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:04.472626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.472629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.472630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:04.472639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.472647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:04.472662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533438704701552:7231]
2025-10-02T08:09:04.472673Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:04.472691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:04.472695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.472555Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 519
2025-10-02T08:09:04.472774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.472781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.472795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.472844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 520 partition: 0 MaxSeqNo: 17 sessionId: src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0
2025-10-02T08:09:04.473192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3196d2f8-46f460b-72734101-d37b0413_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:04.476196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0] Write session: try to update token
2025-10-02T08:09:04.476213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:04.483161Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:04.483178Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:04.483186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533438704701552:7231]
2025-10-02T08:09:04.483229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:04.483233Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:04.483402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:04.483551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:04.483693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:04.483842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:04.484045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:04.484105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:04.491746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId: src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:04.494467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:04.494555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.494569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.494607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:04.494633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:04.494673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.494689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.494859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.494935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.495009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.495079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.495129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.495139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.495215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.495277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.495341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.495406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.495451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.495458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.495524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.495584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.495648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.495710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.495772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.495779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.495843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.495907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.495969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.496033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.496079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.496086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.496147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.496202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.496260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.496332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.496378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.496384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.496449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.496508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.496571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.496634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.496678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.496685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.496747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.496830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.496898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.496961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.497006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.497013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.497078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.497139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.497203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.497266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.497312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.497318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.497392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.497452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.497511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.497571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.497613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.497620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.497683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:04.497747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:04.497815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:04.497881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:04.497926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:04.497933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:04.497988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:04.498052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.498075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.498081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:04.498112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:04.498128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:04.498136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:04.498140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:04.498143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:04.498538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:04.498564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:04.498569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:04.498572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:04.498574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:04.498577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:04.499131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:04.499154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:04.499159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:04.499163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:04.499166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:04.499169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:04.499763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:04.499784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:04.499789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:04.499793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:04.499796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:04.501094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:04.501112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:04.501123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392544501
2025-10-02T08:09:04.501230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:04.501243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:04.501249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:04.501253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:04.501261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:04.501265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:04.501783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:04.501803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:04.501809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:04.501812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:04.501815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:04.501818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:04.502267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:04.502284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:04.502294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:04.502297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:04.502302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:04.502305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:04.502819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:04.502839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:04.502847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:04.503987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:04.504006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:04.504011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:04.504014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:04.504022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392544503
2025-10-02T08:09:04.504349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:04.504366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:04.504375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:04.504379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:04.504383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:04.504387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:04.504889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:04.504908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:04.504913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:04.504922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:04.504925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:04.504929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:04.505390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:04.505410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.505519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392544505
2025-10-02T08:09:04.507988Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:04.508016Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:04.508025Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:04.508031Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:04.508043Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:04.508046Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:04.508048Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:04.508057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533438704701552:7231]
2025-10-02T08:09:04.508061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533438704701552:7231]
2025-10-02T08:09:04.508116Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:04.508129Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:04.508151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:04.508160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.508162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:04.508291Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:04.554303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533438704701623:7083]
2025-10-02T08:09:04.554410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 519, pipe: [1:7556533438704701623:7083]
2025-10-02T08:09:04.639021Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:04.639339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701623:7083], now have 1 active actors on pipe
2025-10-02T08:09:04.639451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533438704701623:7083]
2025-10-02T08:09:04.639465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:04.639466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:04.639488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 520 reason: error at write: Disconnected sessionId: src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0
2025-10-02T08:09:04.639541Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:04.639570Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:04.639647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 520 sessionId: src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0 is DEAD
2025-10-02T08:09:04.639810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:04.639820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0] Write session will restart in 0.007071s
2025-10-02T08:09:04.639844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0] Write session: Do CDS request
2025-10-02T08:09:04.639850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:04.643409Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0f9db321177d6763] Result# TEvPutResult {Id# [72075186224037892:519:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:04.643431Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:519:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:04.643474Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:519:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:04.647750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:04.648378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.648417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:04.648426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 521
2025-10-02T08:09:04.648610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.648639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:04.648643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:04.648646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:04.648812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:04.648950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 521 sessionId:  describe result for acl check
2025-10-02T08:09:04.648994Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:04.648996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:04.648998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:04.649000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:04.649004Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:04.649005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533438704701750:7239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:04.649014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:04.649060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:04.649091Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533438704701751:7237]
2025-10-02T08:09:04.649373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533438704701750:7239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:04.649511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:04.649685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:04.649734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:04.649968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:04.650004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.650009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.650010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.650012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.650012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.650017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.650026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.650029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.650033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.650037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.650042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.650049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.650054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.650061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.650065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.650069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.650073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.650078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.650086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.650090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.650108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:04.651711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533438704701750:7239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:04.657583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533438704701750:7239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:04.657594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533438704701750:7239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:04.657596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533438704701750:7239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:04.657604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:04.658211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:04.659714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:04.659741Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:04.659743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:04.659747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:04.659753Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 520 [1:7556533438704701751:7237]
2025-10-02T08:09:04.659764Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:04.659781Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:04.659783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.659787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.659789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.659803Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:04.659808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:04.659814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:04.659877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.659884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.659887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:04.659890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:04.659950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:04.659957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.659967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.659975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 520
2025-10-02T08:09:04.659979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:04.659996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701796:7239], now have 1 active actors on pipe
2025-10-02T08:09:04.660003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533439164964045:2378], now have 1 active actors on pipe
2025-10-02T08:09:04.660007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.660011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.660027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533438704701742:7237]
2025-10-02T08:09:04.660033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533438704701742:7237]
2025-10-02T08:09:04.660044Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:04.660060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:04.660077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:04.660054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 520
2025-10-02T08:09:04.660082Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:04.660083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:04.660086Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:04.660104Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:04.660110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.660113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.660116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:04.660124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.660135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:04.660164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533438704701742:7237]
2025-10-02T08:09:04.660174Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:04.660186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:04.660189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.660231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.660241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.660257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.660286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 521 partition: 0 MaxSeqNo: 17 sessionId: src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0
2025-10-02T08:09:04.660643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6062efe8-13c71ab9-bb47ee6c-84c6d9db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:04.663621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0] Write session: try to update token
2025-10-02T08:09:04.663639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:04.679435Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:04.679458Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:04.679462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:04.679473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533438704701742:7237]
2025-10-02T08:09:04.679481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533438704701742:7237]
2025-10-02T08:09:04.679527Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:04.679537Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:04.679539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:04.679549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.679559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:04.679744Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:04.679997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId: src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:04.682719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:04.739656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533438704701812:7083]
2025-10-02T08:09:04.739821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 520, pipe: [1:7556533438704701812:7083]
2025-10-02T08:09:04.813598Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:04.813951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.813964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.814007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701812:7083], now have 1 active actors on pipe
2025-10-02T08:09:04.814118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:04.814126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:04.814190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 521 reason: error at write: Disconnected sessionId: src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0
2025-10-02T08:09:04.814223Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:04.814215Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:04.814390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 521 sessionId: src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0 is DEAD
2025-10-02T08:09:04.814496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533438704701812:7083]
2025-10-02T08:09:04.814545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:04.814550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0] Write session will restart in 0.005273s
2025-10-02T08:09:04.814571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0] Write session: Do CDS request
2025-10-02T08:09:04.814576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:04.820029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:04.821137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:04.821256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.821301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:04.821303Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:04.821306Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:04.821311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 522
2025-10-02T08:09:04.821314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:04.821351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:04.821389Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533438704701936:7243]
2025-10-02T08:09:04.821477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.821505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:04.821515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:04.821518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:04.821871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 522 sessionId:  describe result for acl check
2025-10-02T08:09:04.821894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:04.821898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:04.821899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:04.821903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533438704701943:7245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:04.822043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:04.822225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:04.822267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:04.822320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533438704701943:7245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:04.822581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:04.822617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.822622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.822623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.822625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.822626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.822630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.822639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.822643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.822646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.822650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.822655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.822661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.822671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.822676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.822681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.822690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.822694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.822698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.822703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.822711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.822730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:04.824588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533438704701943:7245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:04.829912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533438704701943:7245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:04.829924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533438704701943:7245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:04.829928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533438704701943:7245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:04.829935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:04.830377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:04.831773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:04.831786Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:04.831789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:04.831792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:04.831797Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 521 [1:7556533438704701936:7243]
2025-10-02T08:09:04.831807Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:04.831818Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:04.831821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.831823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.831824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.831835Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:04.831837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:04.831842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:04.831887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.831892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.831894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:04.831896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:04.831940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:04.831945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.831952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.831958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:04.831974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533438704701930:7243]
2025-10-02T08:09:04.831977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533438704701930:7243]
2025-10-02T08:09:04.831982Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:04.831992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704701985:7245], now have 1 active actors on pipe
2025-10-02T08:09:04.831994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:04.831997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:04.832002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:04.832009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:04.832013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 521
2025-10-02T08:09:04.832013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:04.832017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533439164964052:2378], now have 1 active actors on pipe
2025-10-02T08:09:04.832037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.832043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.832053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533438704701930:7243]
2025-10-02T08:09:04.832057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:04.832064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:04.832074Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:04.832039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 521
2025-10-02T08:09:04.832079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.832084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.832085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:04.832090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.832100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:04.832119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.832155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.832167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.832192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.832228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 522 partition: 0 MaxSeqNo: 17 sessionId: src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0
2025-10-02T08:09:04.832577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3016079e-d0fc414f-a3cb597b-7b1de39a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:04.835350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0] Write session: try to update token
2025-10-02T08:09:04.835368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:04.848929Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:04.848946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:04.848948Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:04.848956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533438704701930:7243]
2025-10-02T08:09:04.848960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533438704701930:7243]
2025-10-02T08:09:04.849004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:04.849003Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:04.849008Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:04.849016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.849020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:04.849163Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:04.850311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId: src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:04.852779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:04.914759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533438704702001:7083]
2025-10-02T08:09:04.914871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 521, pipe: [1:7556533438704702001:7083]
2025-10-02T08:09:04.976050Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:04.976385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.976399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.976432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704702001:7083], now have 1 active actors on pipe
2025-10-02T08:09:04.976565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533438704702001:7083]
2025-10-02T08:09:04.976588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:04.976603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:04.976621Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:04.976640Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:04.976666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 522 reason: error at write: Disconnected sessionId: src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0
2025-10-02T08:09:04.976895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 522 sessionId: src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0 is DEAD
2025-10-02T08:09:04.977089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:04.977106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0] Write session will restart in 0.006838s
2025-10-02T08:09:04.977135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0] Write session: Do CDS request
2025-10-02T08:09:04.977142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:04.982613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:04.983758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:04.983913Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:04.983922Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:04.983932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:04.983978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:04.984007Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533438704702128:7250]
2025-10-02T08:09:04.984425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:04.984591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:04.984624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:04.984902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:04.984939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.984943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.984944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.984944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.984945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.984949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.984955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.984957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.984959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.984961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.984964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.984968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:04.984973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.984978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:04.984982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.984987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:04.984990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.984994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.984999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.985004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.985021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:04.985283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.985357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:04.985366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 523
2025-10-02T08:09:04.985474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:04.985500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:04.985508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:04.985511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:04.985881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 523 sessionId:  describe result for acl check
2025-10-02T08:09:04.985913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:04.985919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:04.985922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:04.985927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533438704702144:7252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:04.986392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533438704702144:7252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:04.988501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533438704702144:7252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:04.992298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533438704702144:7252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:04.992314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533438704702144:7252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:04.992318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533438704702144:7252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:04.992326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:04.992744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:04.994209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:04.994223Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:04.994225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:04.994232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:04.994238Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 522 [1:7556533438704702128:7250]
2025-10-02T08:09:04.994247Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:04.994259Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:04.994261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.994263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.994266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.994279Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:04.994286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:04.994291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:04.994336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.994341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.994343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:04.994344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:04.994390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:04.994395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:04.994404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:04.994414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:04.994426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533438704702173:7252], now have 1 active actors on pipe
2025-10-02T08:09:04.994438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533438704702122:7250]
2025-10-02T08:09:04.994439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 522
2025-10-02T08:09:04.994440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533438704702122:7250]
2025-10-02T08:09:04.994445Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:04.994453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:04.994457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:04.994461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:04.994463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:04.994463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:04.994466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533439164964060:2378], now have 1 active actors on pipe
2025-10-02T08:09:04.994469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.994474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.994504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533438704702122:7250]
2025-10-02T08:09:04.994509Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:04.994520Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:04.994529Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:04.994506Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 522
2025-10-02T08:09:04.994529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:04.994532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:04.994533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:04.994539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:04.994545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:04.994579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.994642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:04.994647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:04.994656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:04.994684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 523 partition: 0 MaxSeqNo: 17 sessionId: src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0
2025-10-02T08:09:04.995063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd700067-bafea87e-35d05875-fe5ee0fd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:04.998254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0] Write session: try to update token
2025-10-02T08:09:04.998279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:05.005381Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:05.005402Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:05.005411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533438704702122:7250]
2025-10-02T08:09:05.005452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:05.005456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:05.005635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:05.005793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:05.005943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:05.006087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:05.006305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:05.006356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:05.015576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId: src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:05.018644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:05.018731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.018745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.018785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:05.018814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:05.018894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.018908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.019098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.019198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.019286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.019369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.019430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.019441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.019522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.019592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.019665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.019752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.019821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.019829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.019908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.019988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.020058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.020138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.020187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.020195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.020270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.020349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.020430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.020499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.020554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.020561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.020627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.020690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.020759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.020850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.020904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.020914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.020985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.021056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.021137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.021210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.021261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.021268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.021346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.021417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.021491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.021569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.021619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.021625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.021705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.021776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.021865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.021937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.021989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.021996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.022074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.022143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.022209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.022293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.022345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.022352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.022424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.022499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.022573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.022644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.022695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.022703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.022783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:05.022853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.022876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.022882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:05.022919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:05.022939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:05.022947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:05.022951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:05.022954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:05.023393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:05.023422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:05.023433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:05.023437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:05.023440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:05.023448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:05.024130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:05.024152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:05.024158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:05.024162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:05.024165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:05.024169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:05.024688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:05.024711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:05.024717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:05.024721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:05.024724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:05.026119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:05.026143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:05.026155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392545025
2025-10-02T08:09:05.026431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:05.026450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:05.026461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:05.026464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:05.026468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:05.026472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:05.027045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:05.027068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:05.027079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:05.027088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:05.027095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:05.027098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:05.027660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:05.027681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:05.027692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:05.027700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:05.027704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:05.027711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:05.028390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:05.028419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:05.028425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:05.029725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:05.029748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:05.029754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:05.029758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:05.029768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392545029
2025-10-02T08:09:05.030155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:05.030184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:05.030191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:05.030201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:05.030205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:05.030208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:05.030768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:05.030797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:05.030803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:05.030807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:05.030809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:05.030815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:05.031371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:05.031398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.031505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392545030
2025-10-02T08:09:05.034326Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:05.034356Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:05.034366Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:05.034373Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:05.034386Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:05.034389Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:05.034391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:05.034399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533438704702122:7250]
2025-10-02T08:09:05.034407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533438704702122:7250]
2025-10-02T08:09:05.034463Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:05.034475Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:05.034490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:05.034495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.034497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:05.034635Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:05.076704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533442999669515:7083]
2025-10-02T08:09:05.076969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 522, pipe: [1:7556533442999669515:7083]
2025-10-02T08:09:05.186169Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:05.186607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999669515:7083], now have 1 active actors on pipe
2025-10-02T08:09:05.186719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:05.186728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:05.186757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 523 reason: error at write: Disconnected sessionId: src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0
2025-10-02T08:09:05.186824Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:05.186872Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:05.186941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 523 sessionId: src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0 is DEAD
2025-10-02T08:09:05.187077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:05.187098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0] Write session will restart in 0.009263s
2025-10-02T08:09:05.187123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0] Write session: Do CDS request
2025-10-02T08:09:05.187101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533442999669515:7083]
2025-10-02T08:09:05.187130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:05.191686Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6228b9909e475f6c] Result# TEvPutResult {Id# [72075186224037892:522:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:05.191752Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:522:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:05.191803Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:522:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:05.196624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:05.197278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.197470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:05.197482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 524
2025-10-02T08:09:05.197635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:05.197658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.197710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:05.197720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:05.197723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:05.197804Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:05.197813Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:05.197823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:05.197870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:05.197906Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533442999669658:7268]
2025-10-02T08:09:05.198069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 524 sessionId:  describe result for acl check
2025-10-02T08:09:05.198094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:05.198099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:05.198100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:05.198104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533442999669662:7270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:05.198346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:05.198467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533442999669662:7270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:05.198511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:05.198554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:05.198771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:05.198801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.198805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.198806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.198807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.198808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.198812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.198818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.198823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.198830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.198833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.198837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.198844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.198849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.198852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.198855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.198857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.198860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.198862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.198865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.198867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.198877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:05.200091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533442999669662:7270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:05.205640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533442999669662:7270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:05.205658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533442999669662:7270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:05.205661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533442999669662:7270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:05.205670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:05.206677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:05.208544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:05.208568Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:05.208571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:05.208574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:05.208581Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 523 [1:7556533442999669658:7268]
2025-10-02T08:09:05.208592Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:05.208615Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:05.208622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.208626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.208628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.208644Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:05.208652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:05.208658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:05.208718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.208725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.208727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:05.208730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:05.208797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:05.208822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.208835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.208846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:05.208852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 523
2025-10-02T08:09:05.208870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999669703:7270], now have 1 active actors on pipe
2025-10-02T08:09:05.208880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533442999669649:7268]
2025-10-02T08:09:05.208886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533442999669649:7268]
2025-10-02T08:09:05.208899Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:05.208912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.208916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.208921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:05.208925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:05.208935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533443459931385:2378], now have 1 active actors on pipe
2025-10-02T08:09:05.208946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:05.208965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:05.208972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:05.208960Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 523
2025-10-02T08:09:05.209012Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:05.209023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.209031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.209034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:05.209041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.209054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:05.209071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533442999669649:7268]
2025-10-02T08:09:05.209081Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:05.209097Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:05.209113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.209148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.209154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.209170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.209206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 524 partition: 0 MaxSeqNo: 17 sessionId: src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0
2025-10-02T08:09:05.209586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da21b252-6e4c5027-ec2dcf17-80af1df0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:05.212522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0] Write session: try to update token
2025-10-02T08:09:05.212538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:05.227242Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:05.227264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:05.227266Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:05.227276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533442999669649:7268]
2025-10-02T08:09:05.227280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533442999669649:7268]
2025-10-02T08:09:05.227324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:05.227326Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:05.227332Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:05.227336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.227339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:05.227501Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:05.229053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId: src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:05.231682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:05.287489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533442999669717:7083]
2025-10-02T08:09:05.287614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 523, pipe: [1:7556533442999669717:7083]
2025-10-02T08:09:05.368901Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:05.369182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.369197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.369236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999669717:7083], now have 1 active actors on pipe
2025-10-02T08:09:05.369392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533442999669717:7083]
2025-10-02T08:09:05.369416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:05.369421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:05.369438Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:05.369443Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:05.369469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 524 reason: error at write: Disconnected sessionId: src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0
2025-10-02T08:09:05.369644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 524 sessionId: src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0 is DEAD
2025-10-02T08:09:05.369786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:05.369794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0] Write session will restart in 0.008168s
2025-10-02T08:09:05.369813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0] Write session: Do CDS request
2025-10-02T08:09:05.369817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:05.376241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:05.377502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:05.377680Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:05.377690Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:05.377699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:05.377750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:05.377790Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533442999669864:7275]
2025-10-02T08:09:05.378354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:05.378563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:05.378612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:05.378908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:05.378977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.378985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.378986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.378986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.378987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.378993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.379002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.379005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.379013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.379016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.379021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.379032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.379043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.379052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.379059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.379063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.379071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.379075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.379083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.379087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.379104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:05.379243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.379310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:05.379318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 525
2025-10-02T08:09:05.379438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.379466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:05.379474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:05.379478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:05.379835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 525 sessionId:  describe result for acl check
2025-10-02T08:09:05.379867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:05.379872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:05.379874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:05.379878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533442999669880:7277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:05.380334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533442999669880:7277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:05.382482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533442999669880:7277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:05.386240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533442999669880:7277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:05.386253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533442999669880:7277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:05.386256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533442999669880:7277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:05.386263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:05.386859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:05.388503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:05.388520Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:05.388523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:05.388526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:05.388532Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 524 [1:7556533442999669864:7275]
2025-10-02T08:09:05.388544Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:05.388563Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:05.388570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.388576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.388582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.388596Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:05.388604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:05.388613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:05.388669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.388676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.388678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:05.388681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:05.388736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:05.388742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.388753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.388767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:05.388778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 524
2025-10-02T08:09:05.388787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999669912:7277], now have 1 active actors on pipe
2025-10-02T08:09:05.388790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533443459931404:2378], now have 1 active actors on pipe
2025-10-02T08:09:05.388816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533442999669858:7275]
2025-10-02T08:09:05.388818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533442999669858:7275]
2025-10-02T08:09:05.388833Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:05.388843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.388846Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:05.388849Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:05.388850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.388868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:05.388841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 524
2025-10-02T08:09:05.388884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:05.388890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:05.388927Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:05.388938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.388945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.388947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:05.388956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.388969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:05.388984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533442999669858:7275]
2025-10-02T08:09:05.388992Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:05.389017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:05.389019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.389086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.389094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.389107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.389140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 525 partition: 0 MaxSeqNo: 17 sessionId: src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0
2025-10-02T08:09:05.389425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a524dae1-37f552f3-48eeb350-9318ad7b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:05.392207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0] Write session: try to update token
2025-10-02T08:09:05.392220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:05.406125Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:05.406141Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:05.406143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:05.406151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533442999669858:7275]
2025-10-02T08:09:05.406156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533442999669858:7275]
2025-10-02T08:09:05.406195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:05.406201Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:05.406205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.406207Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:05.406207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:05.406349Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:05.406562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId: src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:05.409147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:05.469776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533442999669931:7083]
2025-10-02T08:09:05.469888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 524, pipe: [1:7556533442999669931:7083]
2025-10-02T08:09:05.545344Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:05.545668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.545682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.545722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999669931:7083], now have 1 active actors on pipe
2025-10-02T08:09:05.545839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:05.545847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:05.545902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 525 reason: error at write: Disconnected sessionId: src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0
2025-10-02T08:09:05.545928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:05.546042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 525 sessionId: src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0 is DEAD
2025-10-02T08:09:05.546071Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:05.546174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533442999669931:7083]
2025-10-02T08:09:05.546185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:05.546194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0] Write session will restart in 0.005607s
2025-10-02T08:09:05.546221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0] Write session: Do CDS request
2025-10-02T08:09:05.546228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:05.551761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:05.552557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:05.552677Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:05.552684Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:05.552690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:05.552718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:05.552746Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533442999670065:7282]
2025-10-02T08:09:05.553223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:05.553285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.553371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:05.553398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:05.553441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:05.553451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 526
2025-10-02T08:09:05.553566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.553586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:05.553593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:05.553596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:05.553600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:05.553622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.553627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.553628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.553629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.553629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.553632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.553639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.553641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.553643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.553645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.553649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.553653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.553657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.553660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.553662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.553667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.553670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.553673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.553675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.553678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.553688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:05.553845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 526 sessionId:  describe result for acl check
2025-10-02T08:09:05.553868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:05.553873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:05.553873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:05.553876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533442999670081:7284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:05.554249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533442999670081:7284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:05.555839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533442999670081:7284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:05.560543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533442999670081:7284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:05.560554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533442999670081:7284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:05.560558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533442999670081:7284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:05.560566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:05.560988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:05.562295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:05.562307Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:05.562309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:05.562311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:05.562314Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 525 [1:7556533442999670065:7282]
2025-10-02T08:09:05.562321Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:05.562331Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:05.562336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.562338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.562340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.562350Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:05.562352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:05.562357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:05.562396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.562400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.562403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:05.562404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:05.562443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:05.562449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.562456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.562462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:05.562478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999670112:7284], now have 1 active actors on pipe
2025-10-02T08:09:05.562488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533442999670059:7282]
2025-10-02T08:09:05.562490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533442999670059:7282]
2025-10-02T08:09:05.562495Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:05.562498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 525
2025-10-02T08:09:05.562506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:05.562510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:05.562513Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:05.562521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:05.562527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:05.562533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533443459931413:2378], now have 1 active actors on pipe
2025-10-02T08:09:05.562540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.562547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.562558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 525
2025-10-02T08:09:05.562576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533442999670059:7282]
2025-10-02T08:09:05.562583Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:05.562586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:05.562594Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b772a510-178330f0-964d268-d8642ce6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:05.562598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.562600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.562601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:05.562608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.562618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:05.562646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.562673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.562678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.562686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.562708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 526 partition: 0 MaxSeqNo: 17 sessionId: src_id|b772a510-178330f0-964d268-d8642ce6_0
2025-10-02T08:09:05.563027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe4a3ae-a160fa6c-74cb8b1c-47af82fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b772a510-178330f0-964d268-d8642ce6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:05.565709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b772a510-178330f0-964d268-d8642ce6_0] Write session: try to update token
2025-10-02T08:09:05.565722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b772a510-178330f0-964d268-d8642ce6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:05.572615Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:05.572634Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:05.572645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533442999670059:7282]
2025-10-02T08:09:05.572680Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:05.572682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:05.572878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:05.573013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:05.573141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:05.573274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:05.573466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:05.573498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:05.580265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId: src_id|b772a510-178330f0-964d268-d8642ce6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:05.582620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:05.582679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.582688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.582713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:05.582732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:05.582779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.582792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.582942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.582997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.583052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.583125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.583282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.583290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.583362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.583424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.583488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.583547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.583591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.583597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.583654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.583727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.583785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.583840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.583893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.583900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.583969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.584033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.584099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.584161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.584203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.584208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.584261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.584309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.584364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.584422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.584476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.584483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.584541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.584595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.584651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.584705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.584749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.584753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.584838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.584888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.584944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.584997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.585091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.585098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.585157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.585211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.585266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.585321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.585359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.585364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.585420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.585474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.585528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.585593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.585636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.585640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.585694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:05.585744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:05.585797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:05.585856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:05.585894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:05.585899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:05.585932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:05.585984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.585999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.586004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:05.586033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:05.586049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:05.586055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:05.586058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:05.586060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:05.586402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:05.586423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:05.586425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:05.586427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:05.586429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:05.586432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:05.586933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:05.586952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:05.586956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:05.586962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:05.586964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:05.586967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:05.587403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:05.587420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:05.587423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:05.587425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:05.587427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:05.588499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:05.588516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:05.588531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392545588
2025-10-02T08:09:05.588631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:05.588641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:05.588645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:05.588647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:05.588649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:05.588651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:05.589112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:05.589129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:05.589133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:05.589135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:05.589137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:05.589143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:05.589555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:05.589571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:05.589581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:05.589587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:05.589590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:05.589593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:05.589985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:05.590003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:05.590006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:05.590984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:05.590997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:05.591000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:05.591002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:05.591007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392545590
2025-10-02T08:09:05.591254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:05.591269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:05.591272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:05.591274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:05.591277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:05.591279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:05.591685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:05.591699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:05.591702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:05.591704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:05.591706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:05.591708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:05.592154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:05.592170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.592240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392545592
2025-10-02T08:09:05.592914Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:05.592929Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:05.592932Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:05.592936Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:05.594509Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:05.594521Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:05.594522Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:05.594527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533442999670059:7282]
2025-10-02T08:09:05.594529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533442999670059:7282]
2025-10-02T08:09:05.594564Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:05.594569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:05.594572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.594573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:05.594575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:05.594708Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:05.646404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533442999670133:7083]
2025-10-02T08:09:05.646521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 525, pipe: [1:7556533442999670133:7083]
2025-10-02T08:09:05.723381Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:05.723656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999670133:7083], now have 1 active actors on pipe
2025-10-02T08:09:05.723725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:05.723730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:05.723748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 526 reason: error at write: Disconnected sessionId: src_id|b772a510-178330f0-964d268-d8642ce6_0
2025-10-02T08:09:05.723826Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:05.723841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:05.723911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 526 sessionId: src_id|b772a510-178330f0-964d268-d8642ce6_0 is DEAD
2025-10-02T08:09:05.724034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533442999670133:7083]
2025-10-02T08:09:05.724070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b772a510-178330f0-964d268-d8642ce6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:05.724079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b772a510-178330f0-964d268-d8642ce6_0] Write session will restart in 0.008514s
2025-10-02T08:09:05.724102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b772a510-178330f0-964d268-d8642ce6_0] Write session: Do CDS request
2025-10-02T08:09:05.724108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b772a510-178330f0-964d268-d8642ce6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:05.729424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:05.730232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:05.730427Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:05.730438Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:05.730448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:05.730505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:05.730545Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533442999670268:7288]
2025-10-02T08:09:05.730918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:05.731043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:05.731068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:05.731251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:05.731277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.731280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.731281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.731282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.731282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.731285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.731292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.731294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.731295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.731297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.731301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.731304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.731308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.731312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.731318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.731320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.731322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.731325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.731327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.731330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.731339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:05.733241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b772a510-178330f0-964d268-d8642ce6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.733337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:05.733347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 527
2025-10-02T08:09:05.733468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.733497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:05.733505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:05.733508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:05.733882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 527 sessionId:  describe result for acl check
2025-10-02T08:09:05.733916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:05.733921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:05.733923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:05.733929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533442999670284:7290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:05.734364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533442999670284:7290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:05.736095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533442999670284:7290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:05.738763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533442999670284:7290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:05.738774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533442999670284:7290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:05.738779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533442999670284:7290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:05.738786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:05.738986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:05.740336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:05.740348Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:05.740350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:05.740352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:05.740356Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 526 [1:7556533442999670268:7288]
2025-10-02T08:09:05.740363Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:05.740375Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:05.740383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.740386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.740388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.740401Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:05.740405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:05.740411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:05.740451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.740457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.740459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:05.740461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:05.740505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:05.740510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.740518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.740533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:05.740552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999670316:7290], now have 1 active actors on pipe
2025-10-02T08:09:05.740555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 526
2025-10-02T08:09:05.740562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533442999670262:7288]
2025-10-02T08:09:05.740564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533442999670262:7288]
2025-10-02T08:09:05.740570Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:05.740579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:05.740581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533443459931419:2378], now have 1 active actors on pipe
2025-10-02T08:09:05.740586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.740587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:05.740591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.740604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:05.740621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:05.740628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:05.740600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 526
2025-10-02T08:09:05.740657Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:05.740666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.740668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.740669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:05.740674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.740680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:05.740692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533442999670262:7288]
2025-10-02T08:09:05.740699Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:05.740710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:05.740715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.740757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.740763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.740774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.740820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 527 partition: 0 MaxSeqNo: 17 sessionId: src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0
2025-10-02T08:09:05.741099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b772a510-178330f0-964d268-d8642ce6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:05.743779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0] Write session: try to update token
2025-10-02T08:09:05.743792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:05.757721Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:05.757736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:05.757740Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:05.757746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533442999670262:7288]
2025-10-02T08:09:05.757748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533442999670262:7288]
2025-10-02T08:09:05.757779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:05.757783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.757784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:05.757793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:05.757799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:05.757903Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:05.758002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId: src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:05.760557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:05.824057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533442999670332:7083]
2025-10-02T08:09:05.824143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 526, pipe: [1:7556533442999670332:7083]
2025-10-02T08:09:05.880144Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:05.880455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.880466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.880503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999670332:7083], now have 1 active actors on pipe
2025-10-02T08:09:05.880624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:05.880636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:05.880670Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:05.880711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 527 reason: error at write: Disconnected sessionId: src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0
2025-10-02T08:09:05.880746Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:05.880893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533442999670332:7083]
2025-10-02T08:09:05.880901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 527 sessionId: src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0 is DEAD
2025-10-02T08:09:05.881063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:05.881073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0] Write session will restart in 0.007983s
2025-10-02T08:09:05.881097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0] Write session: Do CDS request
2025-10-02T08:09:05.881103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:05.886110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:05.887168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:05.887310Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:05.887317Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:05.887325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:05.887366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:05.887397Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533442999670469:7295]
2025-10-02T08:09:05.887878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:05.888034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:05.888065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:05.888305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:05.888336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.888340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.888340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.888341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.888341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.888344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.888353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.888357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.888361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.888363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.888369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.888379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:05.888388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.888393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:05.888397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.888405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:05.888413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.888418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.888426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.888434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.888455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:05.890211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.890311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:05.890321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 528
2025-10-02T08:09:05.890408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:05.890430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:05.890435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:05.890438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:05.890736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 528 sessionId:  describe result for acl check
2025-10-02T08:09:05.890762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:05.890767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:05.890769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:05.890772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533442999670485:7297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:05.891122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533442999670485:7297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:05.892762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533442999670485:7297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:05.895331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533442999670485:7297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:05.895343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533442999670485:7297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:05.895347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533442999670485:7297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:05.895354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:05.895764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:05.897437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:05.897446Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:05.897448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:05.897450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:05.897455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 527 [1:7556533442999670469:7295]
2025-10-02T08:09:05.897463Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:05.897474Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:05.897477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.897479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.897480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.897491Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:05.897497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:05.897502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:05.897543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.897547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.897549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:05.897551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:05.897604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:05.897609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.897617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:05.897623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:05.897636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533442999670463:7295]
2025-10-02T08:09:05.897640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533442999670463:7295]
2025-10-02T08:09:05.897645Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:05.897653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999670516:7297], now have 1 active actors on pipe
2025-10-02T08:09:05.897657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 527
2025-10-02T08:09:05.897662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:05.897670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:05.897671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:05.897687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:05.897692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533442999670463:7295]
2025-10-02T08:09:05.897693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:05.897695Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:05.897697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533443459931428:2378], now have 1 active actors on pipe
2025-10-02T08:09:05.897701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:05.897711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.897717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.897740Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:05.897749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:05.897756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:05.897758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:05.897765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:05.897775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:05.897791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.897812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 527
2025-10-02T08:09:05.897846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:05.897852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:05.897868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:05.897894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 528 partition: 0 MaxSeqNo: 17 sessionId: src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0
2025-10-02T08:09:05.898186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|212e3907-93d7f63a-39aa7caa-c7e3d479_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:05.900886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0] Write session: try to update token
2025-10-02T08:09:05.900897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:05.914719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId: src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:05.914960Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:05.914974Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:05.914976Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:05.914982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533442999670463:7295]
2025-10-02T08:09:05.914985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533442999670463:7295]
2025-10-02T08:09:05.915017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:05.915021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:05.915023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:05.915046Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:05.915060Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:05.915149Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:05.917504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:05.981255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533442999670530:7083]
2025-10-02T08:09:05.981349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 527, pipe: [1:7556533442999670530:7083]
2025-10-02T08:09:06.041110Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:06.041316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.041328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.041364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533442999670530:7083], now have 1 active actors on pipe
2025-10-02T08:09:06.041500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533442999670530:7083]
2025-10-02T08:09:06.041521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:06.041523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:06.041530Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:06.041573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 528 reason: error at write: Disconnected sessionId: src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0
2025-10-02T08:09:06.041585Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:06.041785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 528 sessionId: src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0 is DEAD
2025-10-02T08:09:06.041885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:06.041899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0] Write session will restart in 0.007098s
2025-10-02T08:09:06.041919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0] Write session: Do CDS request
2025-10-02T08:09:06.041923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:06.049152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:06.050352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.050374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:06.050394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 529
2025-10-02T08:09:06.050427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:06.050562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.050578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:06.050585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:06.050589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:06.050595Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:06.050599Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:06.050609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:06.050656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:06.050701Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533447294637965:7301]
2025-10-02T08:09:06.050885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 529 sessionId:  describe result for acl check
2025-10-02T08:09:06.050914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:06.050919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:06.050921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:06.050926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533447294637969:7303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:06.051246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:06.051281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533447294637969:7303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:06.051421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:06.051455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:06.051692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:06.051739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.051744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.051745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.051746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.051746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.051751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.051760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.051764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.051768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.051773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.051778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.051787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.051795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.051801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.051807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.051812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.051819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.051824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.051828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.051832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.051849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:06.053076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533447294637969:7303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:06.059086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533447294637969:7303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:06.059101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533447294637969:7303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:06.059103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533447294637969:7303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:06.059110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:06.059589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:06.061044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:06.061054Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:06.061056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:06.061058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:06.061062Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 528 [1:7556533447294637965:7301]
2025-10-02T08:09:06.061073Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:06.061088Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:06.061089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.061092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.061093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.061107Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:06.061111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:06.061117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:06.061169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.061174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.061177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:06.061178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:06.061222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:06.061226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.061235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.061245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:06.061259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533447294637958:7301]
2025-10-02T08:09:06.061263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533447294637958:7301]
2025-10-02T08:09:06.061272Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:06.061284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:06.061295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:06.061297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:06.061300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:06.061301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:06.061323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533447294637958:7301]
2025-10-02T08:09:06.061328Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:06.061339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:06.061344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638012:7303], now have 1 active actors on pipe
2025-10-02T08:09:06.061349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 528
2025-10-02T08:09:06.061353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533447754898730:2378], now have 1 active actors on pipe
2025-10-02T08:09:06.061439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.061446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.061464Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f53b9250-df918452-5ac3881e-a713ed91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:06.061472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.061477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.061481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:06.061488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.061467Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 528
2025-10-02T08:09:06.061499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:06.061517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.061541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.061545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.061554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.061580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 529 partition: 0 MaxSeqNo: 17 sessionId: src_id|f53b9250-df918452-5ac3881e-a713ed91_0
2025-10-02T08:09:06.061880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68499f3-bcaaf3e1-261416f2-edf2a5fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f53b9250-df918452-5ac3881e-a713ed91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:06.064845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f53b9250-df918452-5ac3881e-a713ed91_0] Write session: try to update token
2025-10-02T08:09:06.064861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f53b9250-df918452-5ac3881e-a713ed91_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:06.078191Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:06.078206Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:06.078208Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:06.078214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533447294637958:7301]
2025-10-02T08:09:06.078218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533447294637958:7301]
2025-10-02T08:09:06.078248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:06.078254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.078257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:06.078267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:06.078272Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:06.078406Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:06.081184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId: src_id|f53b9250-df918452-5ac3881e-a713ed91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:06.084054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:06.141529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533447294638055:7083]
2025-10-02T08:09:06.141617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 528, pipe: [1:7556533447294638055:7083]
2025-10-02T08:09:06.204326Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:06.204645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.204663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.204705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638055:7083], now have 1 active actors on pipe
2025-10-02T08:09:06.204859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:06.204869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:06.204917Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:06.204922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 529 reason: error at write: Disconnected sessionId: src_id|f53b9250-df918452-5ac3881e-a713ed91_0
2025-10-02T08:09:06.204984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:06.205082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 529 sessionId: src_id|f53b9250-df918452-5ac3881e-a713ed91_0 is DEAD
2025-10-02T08:09:06.205214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f53b9250-df918452-5ac3881e-a713ed91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:06.205223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f53b9250-df918452-5ac3881e-a713ed91_0] Write session will restart in 0.009163s
2025-10-02T08:09:06.205223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533447294638055:7083]
2025-10-02T08:09:06.205246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f53b9250-df918452-5ac3881e-a713ed91_0] Write session: Do CDS request
2025-10-02T08:09:06.205265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f53b9250-df918452-5ac3881e-a713ed91_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:06.211522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:06.212744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:06.212969Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:06.212978Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:06.212989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:06.213041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:06.213077Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533447294638203:7319]
2025-10-02T08:09:06.213500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:06.213694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:06.213724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:06.213917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:06.213944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.213948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.213949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.213950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.213950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.213953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.213960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.213962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.213964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.213966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.213969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.213974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.213978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.213980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.213983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.213987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.213991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.213996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.213999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.214004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.214020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:06.215317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f53b9250-df918452-5ac3881e-a713ed91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.215384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:06.215396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 530
2025-10-02T08:09:06.215503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.215531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:06.215540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:06.215543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:06.215918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 530 sessionId:  describe result for acl check
2025-10-02T08:09:06.215957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:06.215963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:06.215964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:06.215970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533447294638219:7321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:06.216472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533447294638219:7321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:06.218366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533447294638219:7321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:06.221359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533447294638219:7321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:06.221371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533447294638219:7321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:06.221373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533447294638219:7321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:06.221379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:06.221914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:06.223455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:06.223467Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:06.223469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:06.223471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:06.223475Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 529 [1:7556533447294638203:7319]
2025-10-02T08:09:06.223485Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:06.223497Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:06.223498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.223500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.223501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.223512Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:06.223515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:06.223519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:06.223560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.223566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.223568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:06.223569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:06.223619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:06.223625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.223635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.223642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:06.223657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533447294638197:7319]
2025-10-02T08:09:06.223661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533447294638197:7319]
2025-10-02T08:09:06.223667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:06.223675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:06.223680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:06.223682Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:06.223683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 529
2025-10-02T08:09:06.223686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:06.223688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:06.223695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638250:7321], now have 1 active actors on pipe
2025-10-02T08:09:06.223733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533447754898759:2378], now have 1 active actors on pipe
2025-10-02T08:09:06.223742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.223746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.223761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533447294638197:7319]
2025-10-02T08:09:06.223770Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:06.223782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:06.223788Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:06.223792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.223795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.223796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:06.223802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.223812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:06.223832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.223827Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 529
2025-10-02T08:09:06.223907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.223916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.223936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.223972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 530 partition: 0 MaxSeqNo: 17 sessionId: src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0
2025-10-02T08:09:06.224298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f53b9250-df918452-5ac3881e-a713ed91_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:06.227134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0] Write session: try to update token
2025-10-02T08:09:06.227153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:06.241698Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:06.241715Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:06.241717Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:06.241723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533447294638197:7319]
2025-10-02T08:09:06.241726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533447294638197:7319]
2025-10-02T08:09:06.241758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:06.241763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.241764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:06.241768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:06.241774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:06.241894Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:06.242053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId: src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:06.244998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:06.305345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533447294638264:7083]
2025-10-02T08:09:06.305461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 529, pipe: [1:7556533447294638264:7083]
2025-10-02T08:09:06.372732Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:06.373039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.373049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.373080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638264:7083], now have 1 active actors on pipe
2025-10-02T08:09:06.373196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533447294638264:7083]
2025-10-02T08:09:06.373222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:06.373228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:06.373231Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:06.373296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 530 reason: error at write: Disconnected sessionId: src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0
2025-10-02T08:09:06.373300Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:06.373517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 530 sessionId: src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0 is DEAD
2025-10-02T08:09:06.373659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:06.373668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0] Write session will restart in 0.008203s
2025-10-02T08:09:06.373691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0] Write session: Do CDS request
2025-10-02T08:09:06.373697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:06.378872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:06.379760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:06.379905Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:06.379914Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:06.379923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:06.379964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:06.379999Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533447294638422:7326]
2025-10-02T08:09:06.380566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:06.380711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:06.380746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:06.380978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:06.381017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.381017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.381018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.381018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.381019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.381022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.381028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.381030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.381031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.381033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.381037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.381040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.381044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.381046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.381048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.381050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.381052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.381055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.381057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.381059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.381069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:06.383213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.383295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:06.383306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 531
2025-10-02T08:09:06.383413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.383433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:06.383436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:06.383439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:06.383795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 531 sessionId:  describe result for acl check
2025-10-02T08:09:06.383827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:06.383833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:06.383835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:06.383841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533447294638438:7328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:06.384290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533447294638438:7328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:06.385711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533447294638438:7328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:06.388033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533447294638438:7328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:06.388044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533447294638438:7328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:06.388048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533447294638438:7328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:06.388056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:06.388387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:06.389764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:06.389775Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:06.389776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:06.389779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:06.389783Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 530 [1:7556533447294638422:7326]
2025-10-02T08:09:06.389789Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:06.389800Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:06.389802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.389804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.389806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.389820Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:06.389824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:06.389830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:06.389866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.389872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.389874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:06.389876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:06.389917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:06.389922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.389929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.389935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:06.389946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638470:7328], now have 1 active actors on pipe
2025-10-02T08:09:06.389954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533447294638416:7326]
2025-10-02T08:09:06.389955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533447294638416:7326]
2025-10-02T08:09:06.389958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 530
2025-10-02T08:09:06.389960Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:06.389966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533447754898777:2378], now have 1 active actors on pipe
2025-10-02T08:09:06.389966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:06.389968Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:06.389972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:06.389982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:06.389986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:06.389992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.389995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.390025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533447294638416:7326]
2025-10-02T08:09:06.390033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:06.390012Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 530
2025-10-02T08:09:06.390033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:06.390043Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:06.390048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.390051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.390053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:06.390059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.390067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:06.390095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.390165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.390173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.390185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.390219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 531 partition: 0 MaxSeqNo: 17 sessionId: src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0
2025-10-02T08:09:06.390502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd1f28c7-ecc67c0a-5976ef02-7eee8513_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:06.393404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0] Write session: try to update token
2025-10-02T08:09:06.393419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:06.406401Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:06.406422Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:06.406424Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:06.406432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533447294638416:7326]
2025-10-02T08:09:06.406437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533447294638416:7326]
2025-10-02T08:09:06.406466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:06.406470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:06.406476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:06.406483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.406485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:06.406621Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:06.408393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId: src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:06.410948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:06.473264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533447294638489:7083]
2025-10-02T08:09:06.473348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 530, pipe: [1:7556533447294638489:7083]
2025-10-02T08:09:06.529928Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:06.530152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.530162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.530193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638489:7083], now have 1 active actors on pipe
2025-10-02T08:09:06.530357Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:06.530383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533447294638489:7083]
2025-10-02T08:09:06.530423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:06.530429Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:06.530494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0
2025-10-02T08:09:06.530688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 531 sessionId: src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0 is DEAD
2025-10-02T08:09:06.530876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:06.530883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0] Write session will restart in 0.008393s
2025-10-02T08:09:06.530909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0] Write session: Do CDS request
2025-10-02T08:09:06.530916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:06.536260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:06.537326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:06.537458Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:06.537465Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:06.537473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:06.537504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:06.537539Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533447294638634:7333]
2025-10-02T08:09:06.537949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:06.538106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:06.538131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:06.538325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:06.538352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.538357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.538357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.538358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.538358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.538361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.538367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.538369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.538371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.538373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.538377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.538381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.538384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.538387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.538390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.538392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.538395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.538397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.538399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.538402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.538412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:06.540340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.540394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:06.540405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 532
2025-10-02T08:09:06.540583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.540616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:06.540621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:06.540624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:06.541014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 532 sessionId:  describe result for acl check
2025-10-02T08:09:06.541045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:06.541047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:06.541049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:06.541054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533447294638650:7335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:06.541561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533447294638650:7335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:06.543718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533447294638650:7335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:06.546261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533447294638650:7335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:06.546276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533447294638650:7335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:06.546279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533447294638650:7335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:06.546287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:06.546385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:06.547795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:06.547806Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:06.547808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:06.547811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:06.547815Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 531 [1:7556533447294638634:7333]
2025-10-02T08:09:06.547822Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:06.547835Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:06.547836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.547838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.547839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.547851Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:06.547854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:06.547859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:06.547900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.547902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.547904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:06.547906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:06.547951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:06.547956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.547964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.547971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:06.547982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638681:7335], now have 1 active actors on pipe
2025-10-02T08:09:06.547987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533447294638628:7333]
2025-10-02T08:09:06.547988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533447294638628:7333]
2025-10-02T08:09:06.547994Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:06.548001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533447754898785:2378], now have 1 active actors on pipe
2025-10-02T08:09:06.548003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:06.548006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:06.548008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:06.548011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 531
2025-10-02T08:09:06.548016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:06.548018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:06.548042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.548049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.548059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533447294638628:7333]
2025-10-02T08:09:06.548060Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:06.548070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:06.548077Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:06.548081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.548083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.548054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 531
2025-10-02T08:09:06.548084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:06.548091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.548096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:06.548115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.548151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.548156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.548164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.548186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 532 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0
2025-10-02T08:09:06.548524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b871c-3831cc96-c364e2ba-82f620e2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:06.551357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0] Write session: try to update token
2025-10-02T08:09:06.551375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:06.566610Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:06.566625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:06.566627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:06.566635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533447294638628:7333]
2025-10-02T08:09:06.566639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533447294638628:7333]
2025-10-02T08:09:06.566680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:06.566686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.566688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:06.566687Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:06.566688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId: src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:06.566692Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:06.566820Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:06.569220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:06.630514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533447294638695:7083]
2025-10-02T08:09:06.630615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 531, pipe: [1:7556533447294638695:7083]
2025-10-02T08:09:06.691298Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:06.691538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.691553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.691588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638695:7083], now have 1 active actors on pipe
2025-10-02T08:09:06.691694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:06.691700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:06.691753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 532 reason: error at write: Disconnected sessionId: src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0
2025-10-02T08:09:06.691786Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:06.691830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:06.691902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 532 sessionId: src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0 is DEAD
2025-10-02T08:09:06.692023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533447294638695:7083]
2025-10-02T08:09:06.692073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:06.692082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0] Write session will restart in 0.006836s
2025-10-02T08:09:06.692099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0] Write session: Do CDS request
2025-10-02T08:09:06.692104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:06.697801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:06.698652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:06.698778Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:06.698784Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:06.698790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:06.698816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:06.698841Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533447294638839:7339]
2025-10-02T08:09:06.699244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:06.699347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:06.699371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:06.699557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:06.699582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.699586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.699586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.699587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.699587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.699590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.699596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.699598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.699600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.699602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.699605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.699609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.699613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.699615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.699617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.699619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.699622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.699628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.699630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.699632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.699642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:06.700197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.700275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:06.700286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 533
2025-10-02T08:09:06.700391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.700415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:06.700424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:06.700427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:06.700738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 533 sessionId:  describe result for acl check
2025-10-02T08:09:06.700766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:06.700772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:06.700773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:06.700777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533447294638857:7341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:06.701222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533447294638857:7341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:06.702932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533447294638857:7341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:06.706515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533447294638857:7341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:06.706526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533447294638857:7341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:06.706529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533447294638857:7341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:06.706536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:06.707025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:06.708609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:06.708621Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:06.708622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:06.708625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:06.708630Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 532 [1:7556533447294638839:7339]
2025-10-02T08:09:06.708636Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:06.708646Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:06.708648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.708650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.708651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.708662Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:06.708668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:06.708673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:06.708710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.708714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.708717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:06.708719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:06.708763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:06.708769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.708779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.708793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:06.708828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638889:7341], now have 1 active actors on pipe
2025-10-02T08:09:06.708834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533447754898791:2378], now have 1 active actors on pipe
2025-10-02T08:09:06.708838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533447294638833:7339]
2025-10-02T08:09:06.708838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 532
2025-10-02T08:09:06.708839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533447294638833:7339]
2025-10-02T08:09:06.708845Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:06.708852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:06.708854Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:06.708856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:06.708860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:06.708862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:06.708866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.708872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.708901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533447294638833:7339]
2025-10-02T08:09:06.708906Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:06.708909Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:06.708917Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d872c099-ae45951-8335b704-a982cf31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:06.708882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 532
2025-10-02T08:09:06.708923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.708928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.708929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:06.708935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.708941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:06.708971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.709007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.709020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.709043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.709095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 533 partition: 0 MaxSeqNo: 17 sessionId: src_id|d872c099-ae45951-8335b704-a982cf31_0
2025-10-02T08:09:06.709420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f4112-b99fe115-1b686fc5-4af74d1b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d872c099-ae45951-8335b704-a982cf31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:06.712082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d872c099-ae45951-8335b704-a982cf31_0] Write session: try to update token
2025-10-02T08:09:06.712096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d872c099-ae45951-8335b704-a982cf31_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:06.725178Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:06.725196Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:06.725198Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:06.725205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533447294638833:7339]
2025-10-02T08:09:06.725208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533447294638833:7339]
2025-10-02T08:09:06.725241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:06.725246Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:06.725249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.725251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:06.725251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:06.725394Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:06.725898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId: src_id|d872c099-ae45951-8335b704-a982cf31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:06.728507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:06.792260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533447294638903:7083]
2025-10-02T08:09:06.792360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 532, pipe: [1:7556533447294638903:7083]
2025-10-02T08:09:06.851474Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:06.851956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.851968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.852003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294638903:7083], now have 1 active actors on pipe
2025-10-02T08:09:06.852103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533447294638903:7083]
2025-10-02T08:09:06.852122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:06.852124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:06.852169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 533 reason: error at write: Disconnected sessionId: src_id|d872c099-ae45951-8335b704-a982cf31_0
2025-10-02T08:09:06.852242Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:06.852259Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:06.852495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 533 sessionId: src_id|d872c099-ae45951-8335b704-a982cf31_0 is DEAD
2025-10-02T08:09:06.852654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872c099-ae45951-8335b704-a982cf31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:06.852664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872c099-ae45951-8335b704-a982cf31_0] Write session will restart in 0.007648s
2025-10-02T08:09:06.852689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872c099-ae45951-8335b704-a982cf31_0] Write session: Do CDS request
2025-10-02T08:09:06.852695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872c099-ae45951-8335b704-a982cf31_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:06.859571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:06.860749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:06.860891Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:06.860899Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:06.860905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:06.860937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:06.860965Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533447294639052:7346]
2025-10-02T08:09:06.861299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d872c099-ae45951-8335b704-a982cf31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.861350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:06.861364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 534
2025-10-02T08:09:06.861421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:06.861563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:06.861592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:06.861599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:06.861601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:06.861616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:06.861670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:06.861856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 534 sessionId:  describe result for acl check
2025-10-02T08:09:06.861877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:06.861879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:06.861880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:06.861883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533447294639063:7348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:06.861985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:06.862028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.862034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.862035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.862036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.862037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.862041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.862050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.862054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.862058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.862062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.862066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.862078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:06.862087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.862092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:06.862096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.862101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:06.862109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.862113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.862118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.862123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.862143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:06.862285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533447294639063:7348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:06.863980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533447294639063:7348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:06.869059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533447294639063:7348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:06.869072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533447294639063:7348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:06.869074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533447294639063:7348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:06.869091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:06.870009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:06.871446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:06.871458Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:06.871461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:06.871466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:06.871470Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 533 [1:7556533447294639052:7346]
2025-10-02T08:09:06.871478Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:06.871490Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:06.871491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.871493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.871494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.871506Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:06.871509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:06.871514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:06.871555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.871561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.871563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:06.871564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:06.871606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:06.871611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.871618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:06.871625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:06.871636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533447294639046:7346]
2025-10-02T08:09:06.871640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533447294639046:7346]
2025-10-02T08:09:06.871645Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:06.871651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 533
2025-10-02T08:09:06.871653Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:06.871654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294639103:7348], now have 1 active actors on pipe
2025-10-02T08:09:06.871655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:06.871658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533447754898800:2378], now have 1 active actors on pipe
2025-10-02T08:09:06.871661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:06.871669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:06.871672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:06.871677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.871679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.871720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533447294639046:7346]
2025-10-02T08:09:06.871730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:06.871738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:06.871740Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:06.871745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:06.871744Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 533
2025-10-02T08:09:06.871747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:06.871748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:06.871753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:06.871760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:06.871784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.871812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:06.871817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:06.871826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:06.871864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 534 partition: 0 MaxSeqNo: 17 sessionId: src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0
2025-10-02T08:09:06.872146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872c099-ae45951-8335b704-a982cf31_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:06.875115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0] Write session: try to update token
2025-10-02T08:09:06.875136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:06.888848Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:06.888862Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:06.888864Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:06.888870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533447294639046:7346]
2025-10-02T08:09:06.888874Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533447294639046:7346]
2025-10-02T08:09:06.888907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:06.888916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:06.888919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:06.888932Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:06.888939Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:06.889047Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:06.889658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId: src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:06.891997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:06.952521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533447294639116:7083]
2025-10-02T08:09:06.952620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 533, pipe: [1:7556533447294639116:7083]
2025-10-02T08:09:07.014040Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:07.014294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.014303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.014336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533447294639116:7083], now have 1 active actors on pipe
2025-10-02T08:09:07.014464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533447294639116:7083]
2025-10-02T08:09:07.014485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:07.014488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:07.014492Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:07.014542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 534 reason: error at write: Disconnected sessionId: src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0
2025-10-02T08:09:07.014559Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:07.014702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 534 sessionId: src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0 is DEAD
2025-10-02T08:09:07.015210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:07.015220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0] Write session will restart in 0.006386s
2025-10-02T08:09:07.015243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0] Write session: Do CDS request
2025-10-02T08:09:07.015249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:07.020609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:07.021596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:07.021728Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:07.021736Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:07.021742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:07.021779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:07.021823Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533451589606560:7352]
2025-10-02T08:09:07.022215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:07.022317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.022356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:07.022382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:07.022387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:07.022396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 535
2025-10-02T08:09:07.022524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.022545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:07.022552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:07.022555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:07.022561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:07.022597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.022602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.022603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.022604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.022605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.022609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.022617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.022621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.022625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.022628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.022632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.022638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.022643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.022650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.022652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.022655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.022657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.022660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.022662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.022664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.022678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:07.022846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 535 sessionId:  describe result for acl check
2025-10-02T08:09:07.022867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:07.022871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:07.022872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:07.022875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533451589606576:7354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:07.023215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533451589606576:7354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:07.024702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533451589606576:7354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:07.029982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533451589606576:7354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:07.029994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533451589606576:7354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:07.029997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533451589606576:7354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:07.030003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:07.030288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:07.031690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:07.031714Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:07.031716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:07.031719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:07.031725Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 534 [1:7556533451589606560:7352]
2025-10-02T08:09:07.031732Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:07.031745Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:07.031747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.031749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.031750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.031761Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:07.031764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:07.031769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:07.031811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.031817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.031819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:07.031821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:07.031866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:07.031871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.031879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.031885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:07.031896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533451589606554:7352]
2025-10-02T08:09:07.031900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533451589606554:7352]
2025-10-02T08:09:07.031901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 534
2025-10-02T08:09:07.031905Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:07.031913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:07.031915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589606608:7354], now have 1 active actors on pipe
2025-10-02T08:09:07.031915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:07.031921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533452049866104:2378], now have 1 active actors on pipe
2025-10-02T08:09:07.031924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:07.031932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:07.031934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:07.031939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.031941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.031952Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 534
2025-10-02T08:09:07.031969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533451589606554:7352]
2025-10-02T08:09:07.031977Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:07.031979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:07.031987Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|166e5932-b2612a3d-2c74972-de074319_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:07.031991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.031993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.031994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:07.031999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.032004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:07.032032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.032062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.032067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.032075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.032102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 535 partition: 0 MaxSeqNo: 17 sessionId: src_id|166e5932-b2612a3d-2c74972-de074319_0
2025-10-02T08:09:07.032418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cf38e8-334473ce-8a93409c-cc16e9b5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|166e5932-b2612a3d-2c74972-de074319_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:07.035141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e5932-b2612a3d-2c74972-de074319_0] Write session: try to update token
2025-10-02T08:09:07.035159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e5932-b2612a3d-2c74972-de074319_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:07.048589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId: src_id|166e5932-b2612a3d-2c74972-de074319_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:07.048760Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:07.048772Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:07.048774Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:07.048779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533451589606554:7352]
2025-10-02T08:09:07.048782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533451589606554:7352]
2025-10-02T08:09:07.048831Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:07.048836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:07.048840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.048841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:07.048843Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:07.048966Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:07.051164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:07.114839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533451589606624:7083]
2025-10-02T08:09:07.118945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 534, pipe: [1:7556533451589606624:7083]
2025-10-02T08:09:07.171473Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:07.171720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.171730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.171760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589606624:7083], now have 1 active actors on pipe
2025-10-02T08:09:07.171840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533451589606624:7083]
2025-10-02T08:09:07.171859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:07.171861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:07.171905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 535 reason: error at write: Disconnected sessionId: src_id|166e5932-b2612a3d-2c74972-de074319_0
2025-10-02T08:09:07.171932Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:07.171954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:07.172062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 535 sessionId: src_id|166e5932-b2612a3d-2c74972-de074319_0 is DEAD
2025-10-02T08:09:07.172252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e5932-b2612a3d-2c74972-de074319_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:07.172257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e5932-b2612a3d-2c74972-de074319_0] Write session will restart in 0.007346s
2025-10-02T08:09:07.172276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e5932-b2612a3d-2c74972-de074319_0] Write session: Do CDS request
2025-10-02T08:09:07.172281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e5932-b2612a3d-2c74972-de074319_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:07.177831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:07.179060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:07.179192Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:07.179200Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:07.179206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:07.179239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:07.179264Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533451589606807:7368]
2025-10-02T08:09:07.179759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:07.179911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:07.179946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:07.180144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:07.180182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.180187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.180188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.180189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.180190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.180194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.180203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.180208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.180210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.180211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.180215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.180219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.180222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.180225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.180229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.180232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.180235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.180237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.180240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.180242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.180256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:07.180285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166e5932-b2612a3d-2c74972-de074319_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.180498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:07.180504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 536
2025-10-02T08:09:07.180618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.180637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:07.180645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:07.180648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:07.181036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 536 sessionId:  describe result for acl check
2025-10-02T08:09:07.181086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:07.181092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:07.181094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:07.181099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533451589606823:7370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:07.181553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533451589606823:7370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:07.183456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533451589606823:7370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:07.187651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533451589606823:7370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:07.187665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533451589606823:7370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:07.187668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533451589606823:7370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:07.187676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:07.188279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:07.189739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:07.189754Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:07.189756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:07.189758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:07.189762Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 535 [1:7556533451589606807:7368]
2025-10-02T08:09:07.189772Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:07.189803Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:07.189808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.189810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.189814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.189823Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:07.189830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:07.189835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:07.189879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.189884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.189886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:07.189887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:07.189942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:07.189949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.189959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.189973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:07.189993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589606851:7370], now have 1 active actors on pipe
2025-10-02T08:09:07.190003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533451589606801:7368]
2025-10-02T08:09:07.190003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 535
2025-10-02T08:09:07.190006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533451589606801:7368]
2025-10-02T08:09:07.190013Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:07.190022Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:07.190025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533452049866124:2378], now have 1 active actors on pipe
2025-10-02T08:09:07.190026Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:07.190032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:07.190043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:07.190045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:07.190051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.190056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.190068Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 535
2025-10-02T08:09:07.190090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533451589606801:7368]
2025-10-02T08:09:07.190098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:07.190105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:07.190113Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:07.190122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.190126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.190127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:07.190137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.190149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:07.190186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.190261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.190267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.190279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.190313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 536 partition: 0 MaxSeqNo: 17 sessionId: src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0
2025-10-02T08:09:07.190647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166e5932-b2612a3d-2c74972-de074319_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:07.193431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0] Write session: try to update token
2025-10-02T08:09:07.193443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:07.205791Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:07.205807Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:07.205814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533451589606801:7368]
2025-10-02T08:09:07.205847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:07.205855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:07.206029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:07.206166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:07.206301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:07.206467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:07.206668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:07.206702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:07.207320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId: src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:07.209751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:07.209797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.209818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.209844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:07.209859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:07.209912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.209923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.210079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.210138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.210216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.210286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.210595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.210602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.210661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.210719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.210774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.210836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.210883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.210890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.210945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.210999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.211054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.211125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.211168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.211173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.211228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.211283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.211342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.211401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.211453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.211460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.211512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.211559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.211609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.211662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.211716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.211722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.211777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.211828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.211884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.211946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.211986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.211993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.212050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.212102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.212165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.212222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.212260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.212266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.212321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.212372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.212427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.212486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.212529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.212536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.212591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.212643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.212699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.212757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.212871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.212877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.212934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.212986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.213052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.213112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.213150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.213155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.213186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:07.213241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.213258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.213263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:07.213288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:07.213301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:07.213306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:07.213309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:07.213311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:07.213640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:07.213658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:07.213664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:07.213666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:07.213668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:07.213670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:07.214205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:07.214222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:07.214225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:07.214227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:07.214230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:07.214231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:07.214659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:07.214675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:07.214681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:07.214684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:07.214686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:07.216525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:07.216538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:07.216550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392547216
2025-10-02T08:09:07.216691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:07.216700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:07.216703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:07.216705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:07.216707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:07.216709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:07.217133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:07.217151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:07.217155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:07.217162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:07.217164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:07.217166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:07.217585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:07.217601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:07.217607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:07.217612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:07.217615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:07.217617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:07.218030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:07.218046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:07.218050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:07.219003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:07.219015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:07.219020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:07.219022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:07.219029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392547218
2025-10-02T08:09:07.219290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:07.219305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:07.219313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:07.219319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:07.219322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:07.219324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:07.219756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:07.219771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:07.219775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:07.219779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:07.219781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:07.219784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:07.220204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:07.220219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.220286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392547220
2025-10-02T08:09:07.220986Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:07.221005Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:07.221013Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:07.221021Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:07.222729Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:07.222744Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:07.222745Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:07.222751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533451589606801:7368]
2025-10-02T08:09:07.222754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533451589606801:7368]
2025-10-02T08:09:07.222788Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:07.222796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:07.222804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:07.222809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.222811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:07.222952Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:07.271992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533451589606886:7083]
2025-10-02T08:09:07.272123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 535, pipe: [1:7556533451589606886:7083]
2025-10-02T08:09:07.356797Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:07.357115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589606886:7083], now have 1 active actors on pipe
2025-10-02T08:09:07.357243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:07.357254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:07.357264Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:07.357278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 536 reason: error at write: Disconnected sessionId: src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0
2025-10-02T08:09:07.357432Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:07.357456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 536 sessionId: src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0 is DEAD
2025-10-02T08:09:07.357614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533451589606886:7083]
2025-10-02T08:09:07.357643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:07.357654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0] Write session will restart in 0.008236s
2025-10-02T08:09:07.357681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0] Write session: Do CDS request
2025-10-02T08:09:07.357689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:07.365252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:07.365825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:07.366005Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:07.366014Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:07.366024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:07.366068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:07.366104Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533451589607108:7377]
2025-10-02T08:09:07.366745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:07.366886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:07.366923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:07.367222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:07.367262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.367267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.367268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.367270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.367271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.367275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.367286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.367290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.367294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.367297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.367302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.367309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.367318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.367324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.367332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.367338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.367342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.367347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.367356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.367361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.367385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.367379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:07.367421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:07.367429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 537
2025-10-02T08:09:07.367630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.367659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:07.367664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:07.367668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:07.368038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 537 sessionId:  describe result for acl check
2025-10-02T08:09:07.368076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:07.368082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:07.368083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:07.368089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533451589607126:7379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:07.368547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533451589607126:7379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:07.370775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533451589607126:7379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:07.374781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533451589607126:7379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:07.374797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533451589607126:7379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:07.374800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533451589607126:7379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:07.374810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:07.377878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:07.379335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:07.379350Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:07.379353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:07.379356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:07.379362Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 536 [1:7556533451589607108:7377]
2025-10-02T08:09:07.379373Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:07.379388Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:07.379396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.379399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.379400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.379412Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:07.379415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:07.379420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:07.379468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.379474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.379477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:07.379479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:07.379530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:07.379537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.379547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.379557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:07.379577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533451589607102:7377]
2025-10-02T08:09:07.379583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533451589607102:7377]
2025-10-02T08:09:07.379589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:07.379601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:07.379606Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:07.379609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:07.379616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:07.379618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:07.379622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 536
2025-10-02T08:09:07.379628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589607157:7379], now have 1 active actors on pipe
2025-10-02T08:09:07.379631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533452049866151:2378], now have 1 active actors on pipe
2025-10-02T08:09:07.379660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.379669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.379683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533451589607102:7377]
2025-10-02T08:09:07.379689Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:07.379686Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 536
2025-10-02T08:09:07.379720Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:07.379725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:07.379730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.379733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.379734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:07.379743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.379752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:07.379777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.379818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.379829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.379857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.379899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 537 partition: 0 MaxSeqNo: 17 sessionId: src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0
2025-10-02T08:09:07.380268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe6a5df-5c37b952-f78021d-520c8ac2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:07.383266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0] Write session: try to update token
2025-10-02T08:09:07.383280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:07.396756Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:07.396777Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:07.396779Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:07.396788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533451589607102:7377]
2025-10-02T08:09:07.396792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533451589607102:7377]
2025-10-02T08:09:07.396835Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:07.396839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:07.396852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:07.396859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.396861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:07.397016Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:07.397881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId: src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:07.400525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:07.457839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533451589607176:7083]
2025-10-02T08:09:07.457938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 536, pipe: [1:7556533451589607176:7083]
2025-10-02T08:09:07.531070Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:07.531509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.531520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.531553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589607176:7083], now have 1 active actors on pipe
2025-10-02T08:09:07.531653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533451589607176:7083]
2025-10-02T08:09:07.531773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:07.531783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:07.531785Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:07.531836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 537 reason: error at write: Disconnected sessionId: src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0
2025-10-02T08:09:07.531797Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:07.532005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 537 sessionId: src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0 is DEAD
2025-10-02T08:09:07.532182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:07.532191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0] Write session will restart in 0.005638s
2025-10-02T08:09:07.532211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0] Write session: Do CDS request
2025-10-02T08:09:07.532216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:07.539328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:07.539370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.539424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:07.539433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 538
2025-10-02T08:09:07.539696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.539743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:07.539753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:07.539756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:07.539765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:07.539921Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:07.539932Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:07.539939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:07.539976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:07.540004Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533451589607385:7384]
2025-10-02T08:09:07.540095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 538 sessionId:  describe result for acl check
2025-10-02T08:09:07.540123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:07.540129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:07.540131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:07.540136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533451589607388:7386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:07.540455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:07.540537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533451589607388:7386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:07.540608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:07.540637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:07.540959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:07.541016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.541022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.541023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.541024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.541026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.541031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.541041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.541045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.541054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.541058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.541063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.541071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.541077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.541088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.541094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.541104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.541109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.541114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.541124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.541130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.541154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:07.542647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533451589607388:7386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:07.547527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533451589607388:7386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:07.547541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533451589607388:7386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:07.547543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533451589607388:7386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:07.547550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:07.549055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:07.550726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:07.550744Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:07.550747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:07.550751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:07.550757Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 537 [1:7556533451589607385:7384]
2025-10-02T08:09:07.550768Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:07.550785Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:07.550794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.550799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.550801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.550817Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:07.550822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:07.550829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:07.550900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.550909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.550911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:07.550914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:07.550981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:07.550988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.551001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.551015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 537
2025-10-02T08:09:07.551017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:07.551035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589607432:7386], now have 1 active actors on pipe
2025-10-02T08:09:07.551039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533452049866159:2378], now have 1 active actors on pipe
2025-10-02T08:09:07.551044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.551047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.551063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533451589607377:7384]
2025-10-02T08:09:07.551072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533451589607377:7384]
2025-10-02T08:09:07.551082Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:07.551096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:07.551100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:07.551103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:07.551112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:07.551086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 537
2025-10-02T08:09:07.551115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:07.551128Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:07.551135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.551142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.551144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:07.551152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.551169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:07.551207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533451589607377:7384]
2025-10-02T08:09:07.551217Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:07.551224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:07.551239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.551296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.551306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.551325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.551358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 538 partition: 0 MaxSeqNo: 17 sessionId: src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0
2025-10-02T08:09:07.551773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b726f6-ee8259f8-5a83cc86-86ca8c90_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:07.554418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0] Write session: try to update token
2025-10-02T08:09:07.554435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:07.561645Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:07.561664Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:07.561676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533451589607377:7384]
2025-10-02T08:09:07.561718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:07.561722Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:07.561897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:07.562051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:07.562199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:07.562351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:07.562557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:07.562598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:07.568738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId: src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:07.571616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:07.571698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.571725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.571759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:07.571791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:07.571927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.571940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.572100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.572165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.572228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.572286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.572336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.572347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.572414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.572482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.572545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.572610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.572652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.572659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.572720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.572788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.572864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.572931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.573036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.573043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.573107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.573165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.573227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.573287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.573332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.573339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.573396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.573481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.573543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.573609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.573653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.573660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.573723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.573781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.573843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.573905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.573954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.573959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.574015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.574078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.574144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.574202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.574252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.574257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.574313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.574377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.574438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.574495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.574538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.574545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.574602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.574657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.574715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.574772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.574863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.574873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.574934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:07.574996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:07.575051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:07.575112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:07.575152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:07.575156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:07.575204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:07.575256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.575272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.575277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:07.575300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:07.575314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:07.575320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:07.575321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:07.575323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:07.575690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:07.575719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:07.575728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:07.575730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:07.575732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:07.575735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:07.576267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:07.576283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:07.576288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:07.576290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:07.576292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:07.576294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:07.576826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:07.576846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:07.576852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:07.576855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:07.576858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:07.577991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:07.578008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:07.578019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392547577
2025-10-02T08:09:07.578131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:07.578147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:07.578152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:07.578155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:07.578159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:07.578162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:07.578656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:07.578674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:07.578680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:07.578688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:07.578691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:07.578694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:07.579156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:07.579178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:07.579183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:07.579186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:07.579189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:07.579192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:07.579685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:07.579717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:07.579723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:07.580863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:07.580877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:07.580882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:07.580887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:07.580897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392547580
2025-10-02T08:09:07.581172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:07.581188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:07.581192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:07.581194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:07.581196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:07.581198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:07.581619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:07.581637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:07.581641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:07.581644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:07.581646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:07.581648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:07.582079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:07.582095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.582167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392547581
2025-10-02T08:09:07.582890Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:07.582919Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:07.582928Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:07.582932Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:07.584659Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:07.584671Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:07.584673Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:07.584682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533451589607377:7384]
2025-10-02T08:09:07.584685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533451589607377:7384]
2025-10-02T08:09:07.584725Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:07.584734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:07.584741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:07.584745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.584747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:07.584895Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:07.631930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533451589607452:7083]
2025-10-02T08:09:07.632066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 537, pipe: [1:7556533451589607452:7083]
2025-10-02T08:09:07.713744Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:07.714059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589607452:7083], now have 1 active actors on pipe
2025-10-02T08:09:07.714166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:07.714171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:07.714198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 538 reason: error at write: Disconnected sessionId: src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0
2025-10-02T08:09:07.714273Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:07.714296Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:07.714414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 538 sessionId: src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0 is DEAD
2025-10-02T08:09:07.714577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533451589607452:7083]
2025-10-02T08:09:07.714632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:07.714645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0] Write session will restart in 0.009601s
2025-10-02T08:09:07.714666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0] Write session: Do CDS request
2025-10-02T08:09:07.714671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:07.723015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:07.723726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:07.723891Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:07.723900Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:07.723911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:07.723973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:07.724028Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533451589607661:7390]
2025-10-02T08:09:07.724767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:07.725024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:07.725084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:07.725413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.725445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:07.725456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 539
2025-10-02T08:09:07.725479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:07.725551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.725569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.725570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.725572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.725573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.725580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.725590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.725594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.725598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.725601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.725610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.725626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.725640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.725645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.725651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.725657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.725668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.725674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.725688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.725719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.725746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:07.725787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.725819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:07.725827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:07.725831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:07.726204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 539 sessionId:  describe result for acl check
2025-10-02T08:09:07.726237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:07.726242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:07.726244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:07.726248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533451589607678:7392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:07.726735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533451589607678:7392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:07.728499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533451589607678:7392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:07.733060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533451589607678:7392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:07.733075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533451589607678:7392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:07.733078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533451589607678:7392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:07.733086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:07.733591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:07.735034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:07.735049Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:07.735052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:07.735056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:07.735062Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 538 [1:7556533451589607661:7390]
2025-10-02T08:09:07.735075Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:07.735090Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:07.735092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.735095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.735098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.735112Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:07.735117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:07.735123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:07.735167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.735175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.735177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:07.735178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:07.735227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:07.735232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.735240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.735247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:07.735257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533451589607655:7390]
2025-10-02T08:09:07.735262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533451589607655:7390]
2025-10-02T08:09:07.735267Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:07.735279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589607709:7392], now have 1 active actors on pipe
2025-10-02T08:09:07.735284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:07.735286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:07.735288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:07.735288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 538
2025-10-02T08:09:07.735296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:07.735298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:07.735301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533452049866166:2378], now have 1 active actors on pipe
2025-10-02T08:09:07.735327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.735336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.735348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533451589607655:7390]
2025-10-02T08:09:07.735358Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:07.735379Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:07.735384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:07.735368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 538
2025-10-02T08:09:07.735386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.735389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.735391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:07.735397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.735404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:07.735430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.735469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.735481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.735502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.735541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 539 partition: 0 MaxSeqNo: 17 sessionId: src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0
2025-10-02T08:09:07.735906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0420ed-35814783-6e0060cf-5f341bfb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:07.738178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0] Write session: try to update token
2025-10-02T08:09:07.738193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:07.751183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId: src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:07.752599Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:07.752610Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:07.752612Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:07.752618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533451589607655:7390]
2025-10-02T08:09:07.752625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533451589607655:7390]
2025-10-02T08:09:07.752660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:07.752669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.752670Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:07.752674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:07.752676Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:07.752823Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:07.753860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:07.814728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533451589607723:7083]
2025-10-02T08:09:07.814809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 538, pipe: [1:7556533451589607723:7083]
2025-10-02T08:09:07.881236Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:07.881599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.881618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.881661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589607723:7083], now have 1 active actors on pipe
2025-10-02T08:09:07.881791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:07.881802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:07.881857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 539 reason: error at write: Disconnected sessionId: src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0
2025-10-02T08:09:07.881887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:07.882019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 539 sessionId: src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0 is DEAD
2025-10-02T08:09:07.882120Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:07.882190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533451589607723:7083]
2025-10-02T08:09:07.882207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:07.882222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0] Write session will restart in 0.008714s
2025-10-02T08:09:07.882248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0] Write session: Do CDS request
2025-10-02T08:09:07.882255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:07.889096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:07.889705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:07.889833Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:07.889840Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:07.889846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:07.889873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:07.889898Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533451589607935:7397]
2025-10-02T08:09:07.890301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:07.890481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:07.890519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:07.890721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:07.890751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.890755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.890756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.890756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.890757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.890760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.890765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.890767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.890769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.890771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.890775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.890779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:07.890782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.890785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:07.890787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.890790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:07.890792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.890794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.890797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.890799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.890810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:07.892441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.892513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:07.892524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 540
2025-10-02T08:09:07.892774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:07.892816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:07.892820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:07.892824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:07.893244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 540 sessionId:  describe result for acl check
2025-10-02T08:09:07.893276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:07.893281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:07.893283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:07.893287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533451589607951:7399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:07.893714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533451589607951:7399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:07.895222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533451589607951:7399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:07.897821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533451589607951:7399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:07.897831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533451589607951:7399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:07.897833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533451589607951:7399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:07.897839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:07.898088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:07.899603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:07.899617Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:07.899619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:07.899621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:07.899626Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 539 [1:7556533451589607935:7397]
2025-10-02T08:09:07.899633Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:07.899645Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:07.899646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.899648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.899650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.899662Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:07.899666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:07.899670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:07.899724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.899731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.899734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:07.899736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:07.899778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:07.899784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.899791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:07.899803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:07.899824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589607984:7399], now have 1 active actors on pipe
2025-10-02T08:09:07.899834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 539
2025-10-02T08:09:07.899834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533451589607929:7397]
2025-10-02T08:09:07.899836Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533451589607929:7397]
2025-10-02T08:09:07.899843Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:07.899851Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:07.899853Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:07.899856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533452049866175:2378], now have 1 active actors on pipe
2025-10-02T08:09:07.899862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:07.899870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:07.899875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:07.899879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.899881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.899907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533451589607929:7397]
2025-10-02T08:09:07.899912Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:07.899900Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 539
2025-10-02T08:09:07.899922Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:07.899924Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:07.899929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:07.899932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:07.899935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:07.899940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:07.899946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:07.899972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.900011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:07.900016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:07.900024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:07.900046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 540 partition: 0 MaxSeqNo: 17 sessionId: src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0
2025-10-02T08:09:07.900423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae31c983-8f77747e-2ae7927d-60f43bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:07.902789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0] Write session: try to update token
2025-10-02T08:09:07.902807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:07.916773Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:07.916791Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:07.916793Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:07.916819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533451589607929:7397]
2025-10-02T08:09:07.916823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533451589607929:7397]
2025-10-02T08:09:07.916861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:07.916867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:07.916867Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:07.916869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:07.916873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:07.917013Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:07.917555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId: src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:07.920139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:07.982166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533451589607998:7083]
2025-10-02T08:09:07.982284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 539, pipe: [1:7556533451589607998:7083]
2025-10-02T08:09:08.047376Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:08.047662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.047678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.047721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533451589607998:7083], now have 1 active actors on pipe
2025-10-02T08:09:08.047880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533451589607998:7083]
2025-10-02T08:09:08.047914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:08.047917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:08.047977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 540 reason: error at write: Disconnected sessionId: src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0
2025-10-02T08:09:08.047957Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:08.048158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 540 sessionId: src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0 is DEAD
2025-10-02T08:09:08.048288Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:08.048332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:08.048343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0] Write session will restart in 0.007720s
2025-10-02T08:09:08.048365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0] Write session: Do CDS request
2025-10-02T08:09:08.048370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:08.055321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:08.055742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:08.055883Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:08.055891Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:08.055897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:08.055925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:08.055952Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533455884575506:7403]
2025-10-02T08:09:08.056331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:08.056464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:08.056494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:08.056687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:08.056715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.056719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.056720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.056721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.056721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.056724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.056731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.056733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.056735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.056737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.056740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.056744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.056747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.056754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.056756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.056759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.056761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.056764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.056767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.056769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.056781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:08.057284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.057391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:08.057399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 541
2025-10-02T08:09:08.057614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.057636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:08.057643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:08.057646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:08.057992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 541 sessionId:  describe result for acl check
2025-10-02T08:09:08.058024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:08.058029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:08.058030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:08.058035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533455884575522:7405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:08.058493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533455884575522:7405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:08.060025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533455884575522:7405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:08.063950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533455884575522:7405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:08.063961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533455884575522:7405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:08.063963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533455884575522:7405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:08.063969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:08.064445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:08.066130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:08.066142Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:08.066145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:08.066148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:08.066152Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 540 [1:7556533455884575506:7403]
2025-10-02T08:09:08.066161Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:08.066175Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:08.066182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.066185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.066186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.066200Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:08.066209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:08.066214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:08.066266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.066271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.066274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:08.066276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:08.066331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:08.066337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.066347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.066361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:08.066377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 540
2025-10-02T08:09:08.066379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884575554:7405], now have 1 active actors on pipe
2025-10-02T08:09:08.066382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533456344833478:2378], now have 1 active actors on pipe
2025-10-02T08:09:08.066387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533455884575500:7403]
2025-10-02T08:09:08.066388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533455884575500:7403]
2025-10-02T08:09:08.066398Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:08.066410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:08.066413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:08.066414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.066417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.066432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:08.066443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:08.066451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:08.066438Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 540
2025-10-02T08:09:08.066487Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99d51f4b-e122f986-676181e3-7e2138ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:08.066498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.066500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.066502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:08.066510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.066520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:08.066535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533455884575500:7403]
2025-10-02T08:09:08.066545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:08.066554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:08.066567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.066614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.066624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.066644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.066679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 541 partition: 0 MaxSeqNo: 17 sessionId: src_id|99d51f4b-e122f986-676181e3-7e2138ef_0
2025-10-02T08:09:08.066983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e86e0e-331c9325-88d63fcc-ff7cdb86_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|99d51f4b-e122f986-676181e3-7e2138ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:08.069784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d51f4b-e122f986-676181e3-7e2138ef_0] Write session: try to update token
2025-10-02T08:09:08.069795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d51f4b-e122f986-676181e3-7e2138ef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:08.082683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId: src_id|99d51f4b-e122f986-676181e3-7e2138ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:08.083336Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:08.083352Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:08.083354Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:08.083361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533455884575500:7403]
2025-10-02T08:09:08.083365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533455884575500:7403]
2025-10-02T08:09:08.083405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:08.083417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.083419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:08.083424Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:08.083436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:08.083559Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:08.085461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:08.148066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533455884575568:7083]
2025-10-02T08:09:08.148209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 540, pipe: [1:7556533455884575568:7083]
2025-10-02T08:09:08.220498Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:08.220746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.220759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.220797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884575568:7083], now have 1 active actors on pipe
2025-10-02T08:09:08.220928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533455884575568:7083]
2025-10-02T08:09:08.220951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:08.220956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:08.221002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 541 reason: error at write: Disconnected sessionId: src_id|99d51f4b-e122f986-676181e3-7e2138ef_0
2025-10-02T08:09:08.221017Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:08.221055Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:08.221145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 541 sessionId: src_id|99d51f4b-e122f986-676181e3-7e2138ef_0 is DEAD
2025-10-02T08:09:08.221229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d51f4b-e122f986-676181e3-7e2138ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:08.221236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d51f4b-e122f986-676181e3-7e2138ef_0] Write session will restart in 0.007648s
2025-10-02T08:09:08.221260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d51f4b-e122f986-676181e3-7e2138ef_0] Write session: Do CDS request
2025-10-02T08:09:08.221266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d51f4b-e122f986-676181e3-7e2138ef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:08.228042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:08.228508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:08.228634Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:08.228641Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:08.228647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:08.228681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:08.228709Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533455884575822:7419]
2025-10-02T08:09:08.229110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:08.229246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:08.229275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:08.229463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:08.229490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.229494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.229494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.229495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.229496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.229499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.229505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.229507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.229509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.229511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.229514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.229518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.229521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.229524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.229526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.229528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.229530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.229533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.229536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.229538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.229547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:08.230328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d51f4b-e122f986-676181e3-7e2138ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.230493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:08.230502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 542
2025-10-02T08:09:08.230640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.230666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:08.230670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:08.230672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:08.231002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 542 sessionId:  describe result for acl check
2025-10-02T08:09:08.231028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:08.231033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:08.231034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:08.231038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533455884575838:7423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:08.231395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533455884575838:7423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:08.233237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533455884575838:7423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:08.236489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533455884575838:7423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:08.236507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533455884575838:7423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:08.236511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533455884575838:7423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:08.236520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:08.236999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:08.238519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:08.238530Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:08.238532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:08.238535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:08.238540Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 541 [1:7556533455884575822:7419]
2025-10-02T08:09:08.238547Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:08.238561Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:08.238563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.238565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.238568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.238578Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:08.238581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:08.238585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:08.238641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.238652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.238654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:08.238657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:08.238708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:08.238714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.238721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.238728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:08.238745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884575866:7423], now have 1 active actors on pipe
2025-10-02T08:09:08.238753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533455884575816:7419]
2025-10-02T08:09:08.238754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533455884575816:7419]
2025-10-02T08:09:08.238760Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:08.238764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 541
2025-10-02T08:09:08.238770Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:08.238772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533456344833498:2378], now have 1 active actors on pipe
2025-10-02T08:09:08.238773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:08.238778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:08.238790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:08.238797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:08.238804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.238810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.238845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533455884575816:7419]
2025-10-02T08:09:08.238852Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:08.238860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:08.238865Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:08.238876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.238883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.238884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:08.238868Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 541
2025-10-02T08:09:08.238891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.238902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:08.238934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.238975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.238981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.238993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.239029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 542 partition: 0 MaxSeqNo: 17 sessionId: src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0
2025-10-02T08:09:08.239371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d51f4b-e122f986-676181e3-7e2138ef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:08.242272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0] Write session: try to update token
2025-10-02T08:09:08.242286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:08.255844Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:08.255861Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:08.255862Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:08.255869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533455884575816:7419]
2025-10-02T08:09:08.255873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533455884575816:7419]
2025-10-02T08:09:08.255902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:08.255906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.255908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:08.255912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:08.255916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:08.256042Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:08.257199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId: src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:08.259737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:08.321065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533455884575880:7083]
2025-10-02T08:09:08.321180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 541, pipe: [1:7556533455884575880:7083]
2025-10-02T08:09:08.382059Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:08.382284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.382293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.382324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884575880:7083], now have 1 active actors on pipe
2025-10-02T08:09:08.382435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533455884575880:7083]
2025-10-02T08:09:08.382462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:08.382467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:08.382479Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:08.382523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 542 reason: error at write: Disconnected sessionId: src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0
2025-10-02T08:09:08.382520Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:08.382678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 542 sessionId: src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0 is DEAD
2025-10-02T08:09:08.382844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:08.382855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0] Write session will restart in 0.006755s
2025-10-02T08:09:08.382880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0] Write session: Do CDS request
2025-10-02T08:09:08.382886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:08.389616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:08.390105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:08.390223Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:08.390230Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:08.390236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:08.390262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:08.390288Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533455884576114:7428]
2025-10-02T08:09:08.390385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.390454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:08.390469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 543
2025-10-02T08:09:08.390573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.390610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:08.390619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:08.390632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:08.390666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:08.390799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:08.390824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:08.391012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:08.391035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 543 sessionId:  describe result for acl check
2025-10-02T08:09:08.391036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.391037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.391038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.391038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.391039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.391042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.391048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.391050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.391052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.391053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.391056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.391061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.391064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.391067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.391069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.391070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:08.391072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:08.391072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.391073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:08.391074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.391077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.391078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533455884576126:7430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:08.391079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.391082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.391091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:08.391577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533455884576126:7430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:08.393592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533455884576126:7430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:08.398325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533455884576126:7430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:08.398340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533455884576126:7430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:08.398342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533455884576126:7430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:08.398351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:08.398941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:08.400475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:08.400491Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:08.400494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:08.400498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:08.400505Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 542 [1:7556533455884576114:7428]
2025-10-02T08:09:08.400518Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:08.400539Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:08.400545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.400548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.400550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.400566Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:08.400576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:08.400582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:08.400640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.400648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.400651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:08.400654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:08.400775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 542
2025-10-02T08:09:08.400798Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 542
2025-10-02T08:09:08.400878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:08.400887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.400900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.400914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:08.400932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533456344833527:2378], now have 1 active actors on pipe
2025-10-02T08:09:08.400940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884576162:7430], now have 1 active actors on pipe
2025-10-02T08:09:08.400945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.400949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.400975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533455884576108:7428]
2025-10-02T08:09:08.400982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533455884576108:7428]
2025-10-02T08:09:08.400993Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:08.401009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:08.401012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:08.401017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:08.401026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:08.401029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:08.401045Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c804661-e4bde099-8068c32c-b984b491_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:08.401056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.401059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.401066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:08.401075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.401089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:08.401130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533455884576108:7428]
2025-10-02T08:09:08.401142Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:08.401150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:08.401159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.401219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.401226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.401241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.401276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 543 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c804661-e4bde099-8068c32c-b984b491_0
2025-10-02T08:09:08.401624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14452ad-839a11f9-a4765cb3-cc661d70_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c804661-e4bde099-8068c32c-b984b491_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:08.404521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c804661-e4bde099-8068c32c-b984b491_0] Write session: try to update token
2025-10-02T08:09:08.404535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c804661-e4bde099-8068c32c-b984b491_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:08.413669Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:08.413685Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:08.413692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533455884576108:7428]
2025-10-02T08:09:08.413729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:08.413733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:08.413895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:08.414029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:08.414157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:08.414593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:08.414779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:08.414810Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:08.419604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId: src_id|9c804661-e4bde099-8068c32c-b984b491_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:08.422013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:08.422078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.422090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.422115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:08.422129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:08.422173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.422189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.422357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.422419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.422493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.422572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.422838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.422849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.422922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.422982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.423045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.423114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.423158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.423165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.423234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.423296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.423362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.423423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.423469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.423476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.423544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.423619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.423687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.423772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.423818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.423829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.423890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.423983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.424051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.424118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.424169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.424176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.424244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.424306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.424368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.424432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.424479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.424485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.424552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.424613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.424679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.424742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.424789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.424797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.424882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.424947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.425008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.425072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.425116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.425122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.425190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.425250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.425316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.425378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.425426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.425432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.425497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.425562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.425627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.425694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.425761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.425767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.425819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:08.425877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.425897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.425903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:08.425931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:08.425947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:08.425954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:08.425957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:08.425960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:08.426389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:08.426415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:08.426421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:08.426426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:08.426428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:08.426431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:08.427087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:08.427107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:08.427113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:08.427115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:08.427118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:08.427122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:08.427597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:08.427618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:08.427623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:08.427626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:08.427629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:08.429873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:08.429892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:08.429903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392548429
2025-10-02T08:09:08.430108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:08.430124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:08.430130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:08.430134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:08.430138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:08.430141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:08.430674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:08.430697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:08.430703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:08.430706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:08.430709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:08.430714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:08.431237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:08.431258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:08.431266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:08.431270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:08.431274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:08.431280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:08.431775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:08.431797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:08.431803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:08.433016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:08.433032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:08.433036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:08.433042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:08.433050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392548432
2025-10-02T08:09:08.433360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:08.433381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:08.433389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:08.433392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:08.433395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:08.433397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:08.433907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:08.433927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:08.433932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:08.433935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:08.433938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:08.433942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:08.434475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:08.434495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.434613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392548434
2025-10-02T08:09:08.437237Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:08.437258Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:08.437265Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:08.437273Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:08.437285Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:08.437287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:08.437289Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:08.437298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533455884576108:7428]
2025-10-02T08:09:08.437304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533455884576108:7428]
2025-10-02T08:09:08.437359Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:08.437364Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:08.437380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:08.437389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.437391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:08.437523Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:08.482460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533455884576182:7083]
2025-10-02T08:09:08.482602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 542, pipe: [1:7556533455884576182:7083]
2025-10-02T08:09:08.570646Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:08.570981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884576182:7083], now have 1 active actors on pipe
2025-10-02T08:09:08.571197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:08.571207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:08.571222Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:08.571232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 543 reason: error at write: Disconnected sessionId: src_id|9c804661-e4bde099-8068c32c-b984b491_0
2025-10-02T08:09:08.571257Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:08.571388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 543 sessionId: src_id|9c804661-e4bde099-8068c32c-b984b491_0 is DEAD
2025-10-02T08:09:08.571532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533455884576182:7083]
2025-10-02T08:09:08.571738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c804661-e4bde099-8068c32c-b984b491_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:08.571754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c804661-e4bde099-8068c32c-b984b491_0] Write session will restart in 0.008083s
2025-10-02T08:09:08.571783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c804661-e4bde099-8068c32c-b984b491_0] Write session: Do CDS request
2025-10-02T08:09:08.571790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c804661-e4bde099-8068c32c-b984b491_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:08.574084Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2d90fe91c00af9ef] Result# TEvPutResult {Id# [72075186224037892:542:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:08.574113Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:542:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:08.574179Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:542:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:08.580181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:08.580759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:08.580935Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:08.580945Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:08.580955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:08.580999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:08.581036Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533455884576405:7435]
2025-10-02T08:09:08.581367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c804661-e4bde099-8068c32c-b984b491_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.581468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:08.581480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 544
2025-10-02T08:09:08.581629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.581658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:08.581659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:08.581668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:08.581671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:08.581852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:08.581911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:08.581998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 544 sessionId:  describe result for acl check
2025-10-02T08:09:08.582029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:08.582031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:08.582033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:08.582037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533455884576416:7437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:08.582258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:08.582307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.582312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.582313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.582316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.582317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.582323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.582337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.582344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.582348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.582352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.582357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.582363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.582373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.582378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.582383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.582388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.582396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.582400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.582408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.582416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.582427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:08.582514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533455884576416:7437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:08.584733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533455884576416:7437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:08.589555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533455884576416:7437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:08.589569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533455884576416:7437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:08.589572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533455884576416:7437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:08.589580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:08.590414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:08.591970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:08.591988Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:08.591991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:08.591994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:08.592001Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 543 [1:7556533455884576405:7435]
2025-10-02T08:09:08.592012Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:08.592029Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:08.592038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.592041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.592045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.592063Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:08.592072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:08.592078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:08.592140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.592149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.592151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:08.592154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:08.592239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:08.592247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.592262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.592279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:08.592279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 543
2025-10-02T08:09:08.592302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884576453:7437], now have 1 active actors on pipe
2025-10-02T08:09:08.592310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533456344833534:2378], now have 1 active actors on pipe
2025-10-02T08:09:08.592315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.592319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.592339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533455884576399:7435]
2025-10-02T08:09:08.592345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533455884576399:7435]
2025-10-02T08:09:08.592357Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:08.592373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:08.592351Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 543
2025-10-02T08:09:08.592382Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:08.592390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:08.592392Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:08.592393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:08.592408Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:08.592419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.592422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.592425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:08.592434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.592442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:08.592481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533455884576399:7435]
2025-10-02T08:09:08.592493Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:08.592510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.592516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:08.592568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.592580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.592602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.592641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 544 partition: 0 MaxSeqNo: 17 sessionId: src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0
2025-10-02T08:09:08.593030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c804661-e4bde099-8068c32c-b984b491_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:08.596100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0] Write session: try to update token
2025-10-02T08:09:08.596122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:08.609745Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:08.609764Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:08.609766Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:08.609774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533455884576399:7435]
2025-10-02T08:09:08.609779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533455884576399:7435]
2025-10-02T08:09:08.609824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:08.609829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:08.609835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.609837Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:08.609837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:08.609977Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:08.610213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId: src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:08.613105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:08.671828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533455884576467:7083]
2025-10-02T08:09:08.671953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 543, pipe: [1:7556533455884576467:7083]
2025-10-02T08:09:08.762527Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:08.762951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.762965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.763004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884576467:7083], now have 1 active actors on pipe
2025-10-02T08:09:08.763123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533455884576467:7083]
2025-10-02T08:09:08.763154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:08.763156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:08.763211Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:08.763217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 544 reason: error at write: Disconnected sessionId: src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0
2025-10-02T08:09:08.763253Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:08.763445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 544 sessionId: src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0 is DEAD
2025-10-02T08:09:08.763639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:08.763650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0] Write session will restart in 0.007260s
2025-10-02T08:09:08.763676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0] Write session: Do CDS request
2025-10-02T08:09:08.763683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:08.772379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:08.772433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.772840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:08.772851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 545
2025-10-02T08:09:08.772984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.773016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:08.773020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:08.773024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:08.773032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:08.773228Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:08.773238Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:08.773245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:08.773289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:08.773326Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533455884576691:7441]
2025-10-02T08:09:08.773360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 545 sessionId:  describe result for acl check
2025-10-02T08:09:08.773388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:08.773394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:08.773395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:08.773400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533455884576694:7443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:08.773770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:08.773876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533455884576694:7443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:08.773985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:08.774044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:08.774366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:08.774410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.774415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.774417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.774418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.774419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.774424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.774434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.774437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.774440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.774443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.774449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.774462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.774471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.774476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.774484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.774489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.774495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.774504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.774509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.774517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.774537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:08.776040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533455884576694:7443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:08.781337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533455884576694:7443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:08.781351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533455884576694:7443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:08.781355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533455884576694:7443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:08.781362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:08.782899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:08.784427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:08.784440Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:08.784443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:08.784447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:08.784453Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 544 [1:7556533455884576691:7441]
2025-10-02T08:09:08.784466Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:08.784487Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:08.784490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.784493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.784495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.784511Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:08.784519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:08.784526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:08.784578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.784584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.784588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:08.784590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:08.784644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:08.784651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.784664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.784680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:08.784701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884576737:7443], now have 1 active actors on pipe
2025-10-02T08:09:08.784712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533455884576683:7441]
2025-10-02T08:09:08.784706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 544
2025-10-02T08:09:08.784717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533455884576683:7441]
2025-10-02T08:09:08.784724Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:08.784734Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:08.784736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:08.784745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:08.784750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:08.784752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:08.784759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533456344833542:2378], now have 1 active actors on pipe
2025-10-02T08:09:08.784763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.784772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.784827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533455884576683:7441]
2025-10-02T08:09:08.784834Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:08.784817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 544
2025-10-02T08:09:08.784849Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:08.784852Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:08.784858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.784862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.784865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:08.784873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.784885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:08.784930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.785000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.785007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.785021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.785064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 545 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0
2025-10-02T08:09:08.785479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419f1629-afbe1ee8-9a6817a5-94f34ef8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:08.788292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0] Write session: try to update token
2025-10-02T08:09:08.788313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:08.802777Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:08.802796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:08.802798Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:08.802807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533455884576683:7441]
2025-10-02T08:09:08.802812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533455884576683:7441]
2025-10-02T08:09:08.802857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:08.802865Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:08.802868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.802871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:08.802871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:08.803017Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:08.805195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId: src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:08.808007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:08.863313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533455884576752:7083]
2025-10-02T08:09:08.863445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 544, pipe: [1:7556533455884576752:7083]
2025-10-02T08:09:08.947301Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:08.947554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.947569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.947609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884576752:7083], now have 1 active actors on pipe
2025-10-02T08:09:08.947713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533455884576752:7083]
2025-10-02T08:09:08.947733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:08.947735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:08.947787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 545 reason: error at write: Disconnected sessionId: src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0
2025-10-02T08:09:08.947859Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:08.947876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:08.947957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 545 sessionId: src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0 is DEAD
2025-10-02T08:09:08.948127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:08.948139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0] Write session will restart in 0.005622s
2025-10-02T08:09:08.948161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0] Write session: Do CDS request
2025-10-02T08:09:08.948166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:08.955397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.955450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:08.955466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 546
2025-10-02T08:09:08.955660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:08.955717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:08.955728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:08.955733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:08.956129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 546 sessionId:  describe result for acl check
2025-10-02T08:09:08.956157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:08.956163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:08.956165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:08.956170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533455884576965:7449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:08.956695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533455884576965:7449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:08.957108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:08.957841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:08.957995Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:08.958004Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:08.958013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:08.958057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:08.958093Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533455884576992:7448]
2025-10-02T08:09:08.958708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:08.958963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:08.959043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:08.959194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533455884576965:7449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:08.959384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:08.959459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.959467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.959468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.959469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.959470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.959476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.959486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.959490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.959495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.959499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.959505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.959512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:08.959518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.959523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:08.959527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.959532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:08.959537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.959542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.959547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.959557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.959577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:08.965736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533455884576965:7449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:08.965755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533455884576965:7449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:08.965758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533455884576965:7449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:08.965767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:08.967845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:08.969726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:08.969748Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:08.969750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:08.969754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:08.969761Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 545 [1:7556533455884576992:7448]
2025-10-02T08:09:08.969775Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:08.969794Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:08.969797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.969801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.969803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.969820Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:08.969825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:08.969833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:08.969895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.969904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.969907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:08.969910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:08.970011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:08.970019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:08.970049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:08.970057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 545
2025-10-02T08:09:08.970065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:08.970084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533455884577024:7449], now have 1 active actors on pipe
2025-10-02T08:09:08.970092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533456344833550:2378], now have 1 active actors on pipe
2025-10-02T08:09:08.970097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.970101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.970123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533455884576980:7448]
2025-10-02T08:09:08.970131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533455884576980:7448]
2025-10-02T08:09:08.970143Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:08.970161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:08.970163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:08.970166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:08.970179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:08.970182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:08.970167Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 545
2025-10-02T08:09:08.970197Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:08.970207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.970213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.970215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:08.970226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:08.970240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:08.970280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533455884576980:7448]
2025-10-02T08:09:08.970295Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:08.970314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.970315Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:08.970370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.970377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.970391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:08.970433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 546 partition: 0 MaxSeqNo: 17 sessionId: src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0
2025-10-02T08:09:08.970829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d8092-671f1737-71ac8d3c-ce3fdf9c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:08.973299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0] Write session: try to update token
2025-10-02T08:09:08.973323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:08.981228Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:08.981249Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:08.981258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533455884576980:7448]
2025-10-02T08:09:08.981296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:08.981308Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:08.981498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:08.981661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:08.981812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:08.981979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:08.982184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:08.982229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:08.990165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId: src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:08.993050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:08.993172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.993187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.993219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:08.993244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:08.993305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:08.993324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:08.993501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.993570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.993637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.993705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.994010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.994023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.994094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.994158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.994230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.994304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.994352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.994362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.994434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.994498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.994565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.994650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.994700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.994708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.994779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.994848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.994919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.994988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.995040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.995050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.995120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.995186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.995255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.995325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.995380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.995392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.995467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.995534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.995605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.995675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.995745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.995753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.995821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.995884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.995956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.996030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.996085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.996093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.996165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.996233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.996316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.996393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.996449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.996457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.996529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.996600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.996671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.996741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.996789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.996796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.996897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:08.996968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:08.997036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:08.997108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:08.997163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:08.997170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:08.997237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:08.997304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:08.997327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:08.997334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:08.997365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:08.997383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:08.997392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:08.997395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:08.997399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:08.997847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:08.997879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:08.997885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:08.997888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:08.997891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:08.997895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:08.998595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:08.998619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:08.998625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:08.998628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:08.998631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:08.998635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:08.999207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:08.999231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:08.999238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:08.999242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:08.999244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:09.000642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:09.000662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:09.000674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392549000
2025-10-02T08:09:09.000897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:09.000915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:09.000920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:09.000924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:09.000929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:09.000933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:09.001479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:09.001504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:09.001509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:09.001515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:09.001519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:09.001522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:09.002088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:09.002113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:09.002124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:09.002127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:09.002131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:09.002135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:09.002631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:09.002655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:09.002660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:09.003850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:09.003868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:09.003873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:09.003876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:09.003884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392549003
2025-10-02T08:09:09.004228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:09.004252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:09.004260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:09.004263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:09.004267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:09.004271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:09.004790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:09.004855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:09.004867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:09.004870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:09.004876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:09.004880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:09.005375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:09.005398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.005493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392549005
2025-10-02T08:09:09.008066Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:09.008100Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:09.008108Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:09.008117Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:09.008129Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:09.008131Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:09.008133Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:09.008143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533455884576980:7448]
2025-10-02T08:09:09.008147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533455884576980:7448]
2025-10-02T08:09:09.008212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:09.008221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:09.008224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.008227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:09.008227Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:09.008357Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:09.047660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533460179544336:7083]
2025-10-02T08:09:09.047799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 545, pipe: [1:7556533460179544336:7083]
2025-10-02T08:09:09.148138Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:09.148480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179544336:7083], now have 1 active actors on pipe
2025-10-02T08:09:09.148683Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:09.148703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533460179544336:7083]
2025-10-02T08:09:09.148720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:09.148746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 546 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0
2025-10-02T08:09:09.148865Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:09.148905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 546 sessionId: src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0 is DEAD
2025-10-02T08:09:09.149070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:09.149081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0] Write session will restart in 0.008954s
2025-10-02T08:09:09.149105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0] Write session: Do CDS request
2025-10-02T08:09:09.149111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:09.152955Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [b78d796d249d17d2] Result# TEvPutResult {Id# [72075186224037892:545:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:09.152984Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:545:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:09.153016Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:545:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:09.158923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:09.159372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:09.159435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:09.159456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 547
2025-10-02T08:09:09.159529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:09.159701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:09.159729Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:09.159737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:09.159742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:09.159744Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:09.159746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:09.159756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:09.159810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:09.159854Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533460179544564:7454]
2025-10-02T08:09:09.160163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 547 sessionId:  describe result for acl check
2025-10-02T08:09:09.160190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:09.160198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:09.160200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:09.160204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533460179544568:7456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:09.160397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:09.160574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:09.160614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:09.160660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533460179544568:7456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:09.160863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:09.160903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.160912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.160914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.160915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.160916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.160921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.160932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.160936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.160940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.160943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.160949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.160954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.160959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.160961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.160964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.160967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.160969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.160972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.160975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.160980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.160996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:09.162710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533460179544568:7456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:09.168170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533460179544568:7456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:09.168188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533460179544568:7456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:09.168191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533460179544568:7456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:09.168198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:09.168896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:09.170441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:09.170458Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:09.170461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:09.170465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:09.170471Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 546 [1:7556533460179544564:7454]
2025-10-02T08:09:09.170481Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:09.170497Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:09.170500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.170503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.170509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.170523Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:09.170527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:09.170533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:09.170585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.170592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.170595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:09.170597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:09.170663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:09.170671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.170684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.170698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:09.170718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533460179544557:7454]
2025-10-02T08:09:09.170722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533460179544557:7454]
2025-10-02T08:09:09.170725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 546
2025-10-02T08:09:09.170730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:09.170741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179544611:7456], now have 1 active actors on pipe
2025-10-02T08:09:09.170742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:09.170745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:09.170749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:09.170758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:09.170766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:09.170771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533460639800853:2378], now have 1 active actors on pipe
2025-10-02T08:09:09.170779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.170785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.170823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533460179544557:7454]
2025-10-02T08:09:09.170829Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:09.170835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:09.170843Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:09.170816Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 546
2025-10-02T08:09:09.170851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.170858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.170860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:09.170868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.170878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:09.170917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:09.171002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.171007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.171018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:09.171044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 547 partition: 0 MaxSeqNo: 17 sessionId: src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0
2025-10-02T08:09:09.171428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f06a40-1bbc7fc3-41af171-d1ef5330_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:09.174336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0] Write session: try to update token
2025-10-02T08:09:09.174356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:09.189111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId: src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:09.189180Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:09.189185Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:09.189189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:09.189200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533460179544557:7454]
2025-10-02T08:09:09.189205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533460179544557:7454]
2025-10-02T08:09:09.189266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:09.189280Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:09.189284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.189286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:09.189288Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:09.189444Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:09.191922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:09.248876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533460179544656:7083]
2025-10-02T08:09:09.248983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 546, pipe: [1:7556533460179544656:7083]
2025-10-02T08:09:09.322235Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:09.322631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.322647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.322700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179544656:7083], now have 1 active actors on pipe
2025-10-02T08:09:09.322854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:09.322866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:09.322931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 547 reason: error at write: Disconnected sessionId: src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0
2025-10-02T08:09:09.322973Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:09.322957Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:09.323138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 547 sessionId: src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0 is DEAD
2025-10-02T08:09:09.323300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:09.323311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0] Write session will restart in 0.005115s
2025-10-02T08:09:09.323329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0] Write session: Do CDS request
2025-10-02T08:09:09.323335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:09.323325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533460179544656:7083]
2025-10-02T08:09:09.329323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:09.329414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:09.329433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 548
2025-10-02T08:09:09.329555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:09.329584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:09.329590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:09.329599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:09.330042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 548 sessionId:  describe result for acl check
2025-10-02T08:09:09.330085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:09.330093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:09.330095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:09.330100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533460179544863:7473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:09.330560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533460179544863:7473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:09.332162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:09.332881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533460179544863:7473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:09.332938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:09.333100Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:09.333109Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:09.333116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:09.333151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:09.333187Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533460179544911:7472]
2025-10-02T08:09:09.333646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:09.333845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:09.333910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:09.334289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:09.334327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.334332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.334333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.334334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.334335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.334339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.334348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.334350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.334352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.334354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.334358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.334363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.334367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.334370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.334373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.334376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.334378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.334381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.334384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.334389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.334407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:09.339762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533460179544863:7473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:09.339780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533460179544863:7473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:09.339784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533460179544863:7473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:09.339793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:09.343039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:09.344627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:09.344645Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:09.344651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:09.344654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:09.344660Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 547 [1:7556533460179544911:7472]
2025-10-02T08:09:09.344670Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:09.344687Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:09.344695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.344698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.344699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.344714Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:09.344725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:09.344730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:09.344796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.344831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.344834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:09.344837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:09.344898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:09.344906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.344919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.344936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:09.344937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 547
2025-10-02T08:09:09.344964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179544937:7473], now have 1 active actors on pipe
2025-10-02T08:09:09.344971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533460179544904:7472]
2025-10-02T08:09:09.344973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533460179544904:7472]
2025-10-02T08:09:09.344981Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:09.344997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533460639800894:2378], now have 1 active actors on pipe
2025-10-02T08:09:09.344999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:09.345005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:09.345006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.345010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.345028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:09.345041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:09.345051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:09.345090Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:09.345096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.345102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.345106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:09.345113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.345100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 547
2025-10-02T08:09:09.345127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:09.345137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533460179544904:7472]
2025-10-02T08:09:09.345152Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:09.345169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:09.345177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:09.345260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.345272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.345288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:09.345316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 548 partition: 0 MaxSeqNo: 17 sessionId: src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0
2025-10-02T08:09:09.345663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a751fe51-22d00653-cb2ebe13-2786d5e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:09.348478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0] Write session: try to update token
2025-10-02T08:09:09.348493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:09.356830Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:09.356851Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:09.356868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533460179544904:7472]
2025-10-02T08:09:09.356891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:09.356906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:09.357076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:09.357212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.357365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.357497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.357705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:09.357749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:09.363215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId: src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:09.365961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:09.366029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.366042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.366074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:09.366096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:09.366157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.366172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.366336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.366390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.366445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.366512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.366552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.366558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.366637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.366695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.366752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.366810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.366851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.366856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.366914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.366977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.367040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.367113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.367160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.367166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.367226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.367281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.367341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.367398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.367443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.367449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.367503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.367553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.367615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.367680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.367741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.367747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.367807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.367863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.367922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.367980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.368107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.368115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.368174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.368236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.368301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.368356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.368400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.368404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.368462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.368517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.368574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.368634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.368678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.368684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.368749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.368821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.368879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.368937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.368981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.368988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.369046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.369105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.369171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.369237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.369280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.369285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.369318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:09.369365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.369379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.369385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:09.369408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:09.369423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:09.369428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:09.369430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:09.369432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:09.369791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:09.369811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:09.369816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:09.369818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:09.369820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:09.369822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:09.370413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:09.370430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:09.370437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:09.370439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:09.370441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:09.370443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:09.371002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:09.371021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:09.371026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:09.371028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:09.371031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:09.372185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:09.372201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:09.372214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392549372
2025-10-02T08:09:09.372327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:09.372337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:09.372342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:09.372345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:09.372348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:09.372351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:09.372853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:09.372869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:09.372873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:09.372876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:09.372878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:09.372881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:09.373364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:09.373381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:09.373387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:09.373389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:09.373391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:09.373393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:09.373807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:09.373825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:09.373829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:09.374831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:09.374846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:09.374849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:09.374851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:09.374857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392549374
2025-10-02T08:09:09.375105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:09.375120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:09.375125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:09.375127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:09.375130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:09.375132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:09.375559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:09.375580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:09.375585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:09.375589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:09.375592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:09.375595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:09.376020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:09.376038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.376108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392549375
2025-10-02T08:09:09.376826Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:09.376846Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:09.376851Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:09.376854Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:09.378455Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:09.378468Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:09.378469Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:09.378476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533460179544904:7472]
2025-10-02T08:09:09.378479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533460179544904:7472]
2025-10-02T08:09:09.378524Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:09.378532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:09.378535Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:09.378536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.378537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:09.378650Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:09.423451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533460179544979:7083]
2025-10-02T08:09:09.423557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 547, pipe: [1:7556533460179544979:7083]
2025-10-02T08:09:09.528078Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:09.528455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179544979:7083], now have 1 active actors on pipe
2025-10-02T08:09:09.529045Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:09.529395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533460179544979:7083]
2025-10-02T08:09:09.529411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:09.529435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0
2025-10-02T08:09:09.529625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 548 sessionId: src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0 is DEAD
2025-10-02T08:09:09.529045Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:09.529891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:09.529909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0] Write session will restart in 0.009799s
2025-10-02T08:09:09.529937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0] Write session: Do CDS request
2025-10-02T08:09:09.529945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:09.545343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:09.545781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:09.545803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 549
2025-10-02T08:09:09.545982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:09.546024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:09.546031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:09.546035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:09.546449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 549 sessionId:  describe result for acl check
2025-10-02T08:09:09.546485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:09.546487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:09.546489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:09.546495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533460179545197:7483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:09.547050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533460179545197:7483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:09.547506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:09.548746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:09.548966Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:09.548982Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:09.548994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:09.549056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:09.549104Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533460179545231:7482]
2025-10-02T08:09:09.549778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:09.549969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:09.550010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:09.550164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533460179545197:7483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:09.550339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:09.550402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.550408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.550409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.550410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.550411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.550417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.550428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.550436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.550441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.550444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.550449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.550458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.550470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.550476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.550499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.550504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.550508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.550513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.550523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.550527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.550545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:09.557996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533460179545197:7483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:09.558019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533460179545197:7483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:09.558022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533460179545197:7483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:09.558032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:09.564499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:09.566319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:09.566339Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:09.566341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:09.566344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:09.566350Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 548 [1:7556533460179545231:7482]
2025-10-02T08:09:09.566360Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:09.566375Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:09.566377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.566379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.566381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.566399Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:09.566404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:09.566411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:09.566476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.566489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.566492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:09.566495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:09.566648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:09.566662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.566675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.566678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 548
2025-10-02T08:09:09.566687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:09.566709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179545258:7483], now have 1 active actors on pipe
2025-10-02T08:09:09.566712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533460639800902:2378], now have 1 active actors on pipe
2025-10-02T08:09:09.566718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.566725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.566742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533460179545212:7482]
2025-10-02T08:09:09.566751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533460179545212:7482]
2025-10-02T08:09:09.566763Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:09.566783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:09.566790Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:09.566794Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:09.566803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:09.566806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:09.566823Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f57af401-62ff9c14-2822546d-499b42b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:09.566839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.566843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.566845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:09.566855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.566871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:09.566917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533460179545212:7482]
2025-10-02T08:09:09.566932Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:09.566947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:09.566952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:09.567114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.567131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.567158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:09.567630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397ca032-a126a2eb-5ceaf7af-c2f7ab8d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f57af401-62ff9c14-2822546d-499b42b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:09.567731Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 548
2025-10-02T08:09:09.567227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 549 partition: 0 MaxSeqNo: 17 sessionId: src_id|f57af401-62ff9c14-2822546d-499b42b1_0
2025-10-02T08:09:09.570816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f57af401-62ff9c14-2822546d-499b42b1_0] Write session: try to update token
2025-10-02T08:09:09.570836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f57af401-62ff9c14-2822546d-499b42b1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:09.579966Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:09.579989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:09.580002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533460179545212:7482]
2025-10-02T08:09:09.580047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:09.580053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:09.580243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:09.580407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.580558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.580707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.580947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:09.580992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:09.590055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId: src_id|f57af401-62ff9c14-2822546d-499b42b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:09.593002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:09.593165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.593194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.593253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:09.593294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:09.593464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.593474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.593713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.593798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.593883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.593979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.594042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.594047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.594150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.594236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.594320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.594416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.594475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.594479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.594574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.594666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.594757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.594844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.594920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.594924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.595019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.595106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.595208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.595305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.595360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.595364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.595455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.595548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.595632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.595738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.595796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.595800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.595907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.595994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.596078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.596164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.596220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.596244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.596341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.596422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.596514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.596620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.596685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.596689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.596793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.597033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.597129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.597214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.597282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.597285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.597388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.597480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.597570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.597664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.597732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.597735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.597847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.597936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.598030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.598124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.598194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.598198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.598263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:09.598356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.598381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.598384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:09.598429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:09.598449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:09.598453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:09.598457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:09.598461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:09.598974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:09.598999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:09.599008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:09.599012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:09.599015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:09.599019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:09.599919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:09.599949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:09.599956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:09.599960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:09.599964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:09.599969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:09.601457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:09.601487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:09.601495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:09.601499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:09.601503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:09.603170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:09.603181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:09.603196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392549603
2025-10-02T08:09:09.603339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:09.603350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:09.603356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:09.603360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:09.603365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:09.603368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:09.604070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:09.604085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:09.604091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:09.604095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:09.604099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:09.604103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:09.604707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:09.604721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:09.604730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:09.604734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:09.604738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:09.604742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:09.605660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:09.605687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:09.605696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:09.607207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:09.607216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:09.607222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:09.607226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:09.607236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392549607
2025-10-02T08:09:09.607585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:09.607598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:09.607606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:09.607611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:09.607616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:09.607620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:09.608211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:09.608240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:09.608249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:09.608254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:09.608257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:09.608262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:09.609025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:09.609049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.609177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392549608
2025-10-02T08:09:09.610291Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:09.610323Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:09.610331Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:09.610338Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:09.612278Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:09.612294Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:09.612296Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:09.612306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533460179545212:7482]
2025-10-02T08:09:09.612309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533460179545212:7482]
2025-10-02T08:09:09.612386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:09.612396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.612399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:09.612420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:09.612428Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:09.612563Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:09.629873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533460179545280:7083]
2025-10-02T08:09:09.630138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 548, pipe: [1:7556533460179545280:7083]
2025-10-02T08:09:09.762587Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:09.763002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179545280:7083], now have 1 active actors on pipe
2025-10-02T08:09:09.763393Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:09.763321Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:09.763666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:09.763703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533460179545280:7083]
2025-10-02T08:09:09.763713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 549 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f57af401-62ff9c14-2822546d-499b42b1_0
2025-10-02T08:09:09.764072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f57af401-62ff9c14-2822546d-499b42b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:09.764099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f57af401-62ff9c14-2822546d-499b42b1_0] Write session will restart in 0.007033s
2025-10-02T08:09:09.764125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f57af401-62ff9c14-2822546d-499b42b1_0] Write session: Do CDS request
2025-10-02T08:09:09.763937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 549 sessionId: src_id|f57af401-62ff9c14-2822546d-499b42b1_0 is DEAD
2025-10-02T08:09:09.764133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f57af401-62ff9c14-2822546d-499b42b1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:09.772513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f57af401-62ff9c14-2822546d-499b42b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:09.772727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:09.772748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 550
2025-10-02T08:09:09.772916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:09.772975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:09.772989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:09.772994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:09.773974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 550 sessionId:  describe result for acl check
2025-10-02T08:09:09.774013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:09.774015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:09.774017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:09.774027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533460179545475:7489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:09.774641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533460179545475:7489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:09.777783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:09.778482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533460179545475:7489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:09.778846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:09.779022Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:09.779026Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:09.779037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:09.779083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:09.779121Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533460179545535:7488]
2025-10-02T08:09:09.779840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:09.780070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:09.780102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:09.780446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:09.780485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.780486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.780487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.780488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.780489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.780493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.780505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.780509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.780514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.780518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.780523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.780531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:09.780538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.780543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:09.780548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.780553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:09.780558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.780563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.780568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.780574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.780594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:09.787307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533460179545475:7489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:09.787327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533460179545475:7489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:09.787330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533460179545475:7489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:09.787340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:09.790187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:09.792250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:09.792274Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:09.792278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:09.792284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:09.792294Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 549 [1:7556533460179545535:7488]
2025-10-02T08:09:09.792310Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:09.792334Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:09.792344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.792347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.792351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.792371Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:09.792383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:09.792397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:09.792476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.792485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.792489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:09.792493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:09.792581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:09.792589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.792607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:09.792625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:09.792655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533460179545527:7488]
2025-10-02T08:09:09.792661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 549
2025-10-02T08:09:09.792662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533460179545527:7488]
2025-10-02T08:09:09.792672Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:09.792686Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:09.792689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179545560:7489], now have 1 active actors on pipe
2025-10-02T08:09:09.792696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533460639800910:2378], now have 1 active actors on pipe
2025-10-02T08:09:09.792698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:09.792703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:09.792719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:09.792728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:09.792736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.792745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.792790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 549
2025-10-02T08:09:09.792796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533460179545527:7488]
2025-10-02T08:09:09.792821Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:09.792833Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:09.792839Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:09.792847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.792852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.792854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:09.792865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.792875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:09.792921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:09.793021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.793033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.793059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:09.793115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 550 partition: 0 MaxSeqNo: 17 sessionId: src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0
2025-10-02T08:09:09.793549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f57af401-62ff9c14-2822546d-499b42b1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:09.796349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0] Write session: try to update token
2025-10-02T08:09:09.796368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:09.813216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId: src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:09.816438Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:09.816462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:09.816473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533460179545527:7488]
2025-10-02T08:09:09.816480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:09.816530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:09.816660Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:09.816830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:09.816984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.817136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.817287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:09.817509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:09.817546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.817558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.817581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:09.817679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:09.817715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:09.817794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:09.817805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:09.818012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.818086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.818155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.818220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.818264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.818270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.818367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.818445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.818524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.818623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.818686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.818693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.818783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.818865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.818951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.819038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.819099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.819106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.819272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.819358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.819443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.819523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.819592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.819603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.819685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.819781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.819861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.819947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.820008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.820016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.820112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.820194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.820276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.820357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.820414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.820422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.820510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.820587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.820670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.820751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.820835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.820843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.820927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.821003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.821087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.821174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.821239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.821250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.821345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.821433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.821519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.821602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.821661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.821669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.821764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:09.821852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:09.821936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:09.822020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:09.822094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:09.822097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:09.822144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:09.822237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:09.822266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:09.822273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:09.822317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:09.822337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:09.822346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:09.822350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:09.822353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:09.822821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:09.822858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:09.822867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:09.822870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:09.822874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:09.822878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:09.823534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:09.823554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:09.823561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:09.823567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:09.823572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:09.823576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:09.824394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:09.824413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:09.824421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:09.824425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:09.824428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:09.826302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:09.826323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:09.826339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392549822
2025-10-02T08:09:09.826474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:09.826484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:09.826492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:09.826495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:09.826501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:09.826504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:09.827287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:09.827313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:09.827320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:09.827323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:09.827326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:09.827330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:09.828110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:09.828140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:09.828151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:09.828154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:09.828157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:09.828161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:09.828739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:09.828759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:09.828765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:09.830316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:09.830339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:09.830346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:09.830352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:09.830364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392549829
2025-10-02T08:09:09.830720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:09.830735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:09.830743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:09.830750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:09.830755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:09.830759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:09.831482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:09.831514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:09.831520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:09.831525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:09.831529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:09.831533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:09.832105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:09.832122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:09.832246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392549829
2025-10-02T08:09:09.833212Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:09.833230Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:09.833237Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:09.833246Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:09.838459Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:09.838487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:09.838490Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:09.838502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533460179545527:7488]
2025-10-02T08:09:09.838512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533460179545527:7488]
2025-10-02T08:09:09.838570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:09.838579Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:09.838582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:09.838584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:09.838593Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:09.838752Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:09.865107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533460179545582:7083]
2025-10-02T08:09:09.865269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 549, pipe: [1:7556533460179545582:7083]
2025-10-02T08:09:09.990588Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:09.991040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533460179545582:7083], now have 1 active actors on pipe
2025-10-02T08:09:09.991192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:09.991211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:09.991253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 550 reason: error at write: Disconnected sessionId: src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0
2025-10-02T08:09:09.991259Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:09.991375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:09.991485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 550 sessionId: src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0 is DEAD
2025-10-02T08:09:09.991527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533460179545582:7083]
2025-10-02T08:09:09.993025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:09.993037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0] Write session will restart in 0.008356s
2025-10-02T08:09:09.993076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0] Write session: Do CDS request
2025-10-02T08:09:09.993083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:10.001311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:10.002190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:10.002382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.002398Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:10.002409Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:10.002421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:10.002489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:10.002504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:10.002512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 551
2025-10-02T08:09:10.002539Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533464474513115:7495]
2025-10-02T08:09:10.002700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.002742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:10.002753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:10.002761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:10.003193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 551 sessionId:  describe result for acl check
2025-10-02T08:09:10.003194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:10.003227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:10.003235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:10.003237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:10.003243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533464474513120:7497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:10.003386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:10.003419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:10.003650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:10.003700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.003705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.003706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.003708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.003709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.003714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.003724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.003728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.003730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.003732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.003736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.003741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.003745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.003748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.003751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.003754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.003758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.003761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.003764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.003766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.003779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:10.003807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533464474513120:7497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:10.006500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533464474513120:7497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:10.011725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533464474513120:7497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:10.011747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533464474513120:7497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:10.011751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533464474513120:7497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:10.011766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:10.012435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:10.014453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:10.014471Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:10.014474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:10.014480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:10.014490Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 550 [1:7556533464474513115:7495]
2025-10-02T08:09:10.014505Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:10.014527Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:10.014534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.014537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.014539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.014555Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:10.014562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:10.014568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:10.014628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.014634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.014637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:10.014639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:10.014719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:10.014727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.014741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.014758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:10.014768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 550
2025-10-02T08:09:10.014785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474513159:7497], now have 1 active actors on pipe
2025-10-02T08:09:10.014791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533460639800919:2378], now have 1 active actors on pipe
2025-10-02T08:09:10.014796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.014800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.014819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533464474513109:7495]
2025-10-02T08:09:10.014826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533464474513109:7495]
2025-10-02T08:09:10.014839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:10.014854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:10.014857Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:10.014860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:10.014871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:10.014874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:10.014891Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:10.014903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.014909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.014915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:10.014924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.014939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:10.014890Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 550
2025-10-02T08:09:10.014978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533464474513109:7495]
2025-10-02T08:09:10.014997Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:10.015010Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:10.015019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.015067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.015073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.015084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.015120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 551 partition: 0 MaxSeqNo: 17 sessionId: src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0
2025-10-02T08:09:10.016544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a663b915-c3ccdabd-8f9e1172-8047933f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:10.019094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0] Write session: try to update token
2025-10-02T08:09:10.019112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:10.026551Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:10.026575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:10.026586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533464474513109:7495]
2025-10-02T08:09:10.026644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:10.026643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:10.026849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:10.027026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.027192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.027372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.027591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:10.027648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:10.035945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId: src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:10.038809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:10.038903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.038919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.038954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:10.038980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:10.039036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.039053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.039205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.039264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.039323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.039399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.039451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.039460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.039521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.039590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.039648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.039727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.039771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.039778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.039838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.039903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.039964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.040041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.040085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.040092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.040153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.040223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.040279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.040333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.040374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.040380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.040435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.040497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.040552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.040611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.040731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.040737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.040795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.040873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.040947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.041021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.041075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.041085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.041161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.041223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.041290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.041353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.041401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.041408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.041475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.041537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.041608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.041675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.041728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.041736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.041804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.041870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.041931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.041995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.042044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.042052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.042117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.042177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.042246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.042316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.042366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.042372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.042437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:10.042503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.042524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.042530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:10.042560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:10.042578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:10.042585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:10.042588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:10.042590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:10.043005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:10.043033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:10.043045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:10.043048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:10.043052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:10.043055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:10.043571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:10.043599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:10.043605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:10.043609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:10.043612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:10.043614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:10.044242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:10.044268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:10.044274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:10.044279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:10.044285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:10.045534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:10.045550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:10.045560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392550045
2025-10-02T08:09:10.045652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:10.045663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:10.045667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:10.045669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:10.045671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:10.045674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:10.046155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:10.046172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:10.046177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:10.046180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:10.046182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:10.046184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:10.046629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:10.046646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:10.046651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:10.046653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:10.046656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:10.046658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:10.047106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:10.047124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:10.047128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:10.048190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:10.048211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:10.048216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:10.048219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:10.048227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392550048
2025-10-02T08:09:10.048493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:10.048513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:10.048519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:10.048522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:10.048526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:10.048528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:10.048974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:10.048991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:10.048995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:10.048997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:10.048999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:10.049003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:10.049466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:10.049484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.049587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392550049
2025-10-02T08:09:10.051972Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:10.051993Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:10.052000Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:10.052004Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:10.052014Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:10.052018Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:10.052019Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:10.052026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533464474513109:7495]
2025-10-02T08:09:10.052028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533464474513109:7495]
2025-10-02T08:09:10.052083Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:10.052088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:10.052091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.052092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:10.052098Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:10.052221Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:10.091592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533464474513176:7083]
2025-10-02T08:09:10.091712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 550, pipe: [1:7556533464474513176:7083]
2025-10-02T08:09:10.193107Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:10.193873Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:10.194479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:10.194491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0] Write session will restart in 0.007669s
2025-10-02T08:09:10.194518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0] Write session: Do CDS request
2025-10-02T08:09:10.194526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:10.193476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474513176:7083], now have 1 active actors on pipe
2025-10-02T08:09:10.193713Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:10.194081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533464474513176:7083]
2025-10-02T08:09:10.194096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:10.194121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 551 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0
2025-10-02T08:09:10.194301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 551 sessionId: src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0 is DEAD
2025-10-02T08:09:10.198302Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [461c57c596e36713] Result# TEvPutResult {Id# [72075186224037892:550:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:10.198336Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:550:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:10.198395Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:550:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:10.203461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.203524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:10.203547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 552
2025-10-02T08:09:10.203672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:10.203740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.203777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:10.203787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:10.203791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:10.204136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 552 sessionId:  describe result for acl check
2025-10-02T08:09:10.204166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:10.204168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:10.204168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:10.204174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533464474513415:7503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:10.204655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:10.204704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533464474513415:7503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:10.204865Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:10.204874Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:10.204884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:10.204937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:10.204978Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533464474513419:7501]
2025-10-02T08:09:10.205588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:10.205752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:10.205809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:10.206139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:10.206192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.206198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.206203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.206204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.206205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.206211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.206219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.206223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.206227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.206230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.206236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.206244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.206249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.206253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.206257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.206261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.206264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.206268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.206272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.206276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.206293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:10.206908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533464474513415:7503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:10.213812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533464474513415:7503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:10.213848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533464474513415:7503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:10.213852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533464474513415:7503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:10.213862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:10.214740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:10.216433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:10.216453Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:10.216455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:10.216459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:10.216466Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 551 [1:7556533464474513419:7501]
2025-10-02T08:09:10.216483Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:10.216504Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:10.216506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.216509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.216510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.216529Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:10.216534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:10.216540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:10.216604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.216614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.216617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:10.216619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:10.216692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:10.216701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.216715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.216727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:10.216745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474513462:7503], now have 1 active actors on pipe
2025-10-02T08:09:10.216756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533464474513408:7501]
2025-10-02T08:09:10.216758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533464474513408:7501]
2025-10-02T08:09:10.216759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 551
2025-10-02T08:09:10.216766Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:10.216778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:10.216790Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:10.216796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:10.216798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:10.216818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:10.216825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.216831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.216845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533464934768221:2378], now have 1 active actors on pipe
2025-10-02T08:09:10.216883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533464474513408:7501]
2025-10-02T08:09:10.216893Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:10.216910Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5938ffe1-32b0060a-98a804e7-154f908d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:10.216920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.216924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.216926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:10.216876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 551
2025-10-02T08:09:10.216936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.216937Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:10.216949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:10.216993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.217112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.217130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.217154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.217192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 552 partition: 0 MaxSeqNo: 17 sessionId: src_id|5938ffe1-32b0060a-98a804e7-154f908d_0
2025-10-02T08:09:10.217542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e970eb88-ffc6a813-4f5b92cb-3f61fc1f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5938ffe1-32b0060a-98a804e7-154f908d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:10.220764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5938ffe1-32b0060a-98a804e7-154f908d_0] Write session: try to update token
2025-10-02T08:09:10.220781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5938ffe1-32b0060a-98a804e7-154f908d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:10.235628Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:10.235647Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:10.235650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:10.235660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533464474513408:7501]
2025-10-02T08:09:10.235665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533464474513408:7501]
2025-10-02T08:09:10.235728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:10.235732Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:10.235735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.235738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:10.235740Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:10.235892Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:10.244616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId: src_id|5938ffe1-32b0060a-98a804e7-154f908d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:10.247429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:10.294384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533464474513507:7083]
2025-10-02T08:09:10.294516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 551, pipe: [1:7556533464474513507:7083]
2025-10-02T08:09:10.369817Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:10.370190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.370206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.370228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474513507:7083], now have 1 active actors on pipe
2025-10-02T08:09:10.370336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:10.370356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:10.370365Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:10.370436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 552 reason: error at write: Disconnected sessionId: src_id|5938ffe1-32b0060a-98a804e7-154f908d_0
2025-10-02T08:09:10.370415Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:10.370573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533464474513507:7083]
2025-10-02T08:09:10.370632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 552 sessionId: src_id|5938ffe1-32b0060a-98a804e7-154f908d_0 is DEAD
2025-10-02T08:09:10.370787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5938ffe1-32b0060a-98a804e7-154f908d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:10.370799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5938ffe1-32b0060a-98a804e7-154f908d_0] Write session will restart in 0.007856s
2025-10-02T08:09:10.370827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5938ffe1-32b0060a-98a804e7-154f908d_0] Write session: Do CDS request
2025-10-02T08:09:10.370835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5938ffe1-32b0060a-98a804e7-154f908d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:10.379920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:10.380354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5938ffe1-32b0060a-98a804e7-154f908d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.380431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:10.380440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 553
2025-10-02T08:09:10.380590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.380615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:10.380623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:10.380626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:10.380661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:10.380896Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:10.380910Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:10.380923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:10.380986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 553 sessionId:  describe result for acl check
2025-10-02T08:09:10.380986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:10.381014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:10.381015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:10.381016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:10.381020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533464474513771:7522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:10.381030Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533464474513769:7520]
2025-10-02T08:09:10.381478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533464474513771:7522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:10.381715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:10.381905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:10.381946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:10.382319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:10.382376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.382382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.382383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.382385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.382386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.382392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.382402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.382407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.382411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.382414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.382420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.382429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.382433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.382436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.382439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.382442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.382446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.382449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.382452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.382455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.382468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:10.383524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533464474513771:7522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:10.390104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533464474513771:7522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:10.390125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533464474513771:7522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:10.390129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533464474513771:7522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:10.390138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:10.391246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:10.393052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:10.393067Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:10.393070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:10.393073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:10.393079Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 552 [1:7556533464474513769:7520]
2025-10-02T08:09:10.393090Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:10.393106Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:10.393107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.393110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.393111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.393125Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:10.393129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:10.393136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:10.393190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.393198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.393201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:10.393203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:10.393262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:10.393270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.393283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.393300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:10.393320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533464474513761:7520]
2025-10-02T08:09:10.393326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533464474513761:7520]
2025-10-02T08:09:10.393336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:10.393340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 552
2025-10-02T08:09:10.393348Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:10.393352Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:10.393356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474513815:7522], now have 1 active actors on pipe
2025-10-02T08:09:10.393365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:10.393381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:10.393389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:10.393395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533464934768262:2378], now have 1 active actors on pipe
2025-10-02T08:09:10.393400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.393410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.393424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 552
2025-10-02T08:09:10.393459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533464474513761:7520]
2025-10-02T08:09:10.393467Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:10.393472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:10.393482Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:10.393487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.393491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.393492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:10.393502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.393515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:10.393562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.393650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.393656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.393666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.393700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 553 partition: 0 MaxSeqNo: 17 sessionId: src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0
2025-10-02T08:09:10.394077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5938ffe1-32b0060a-98a804e7-154f908d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:10.396853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0] Write session: try to update token
2025-10-02T08:09:10.396868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:10.404909Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:10.404930Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:10.404939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533464474513761:7520]
2025-10-02T08:09:10.404982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:10.404986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:10.405137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:10.405267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.405394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.405532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.405728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:10.405764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:10.413847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId: src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:10.416462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:10.416561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.416575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.416617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:10.416641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:10.416716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.416732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.416917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.416983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.417048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.417120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.417519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.417531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.417604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.417670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.417739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.417810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.417857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.417871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.417941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.417999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.418060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.418123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.418172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.418175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.418244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.418310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.418379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.418438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.418484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.418487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.418552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.418612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.418674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.418739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.418786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.418789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.418859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.418920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.418983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.419047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.419094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.419097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.419168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.419227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.419290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.419349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.419398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.419400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.419471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.419536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.419595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.419658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.419715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.419718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.419786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.419851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.419915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.419985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.420037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.420039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.420114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.420178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.420242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.420313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.420360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.420362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.420404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:10.420468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.420486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.420489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:10.420519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:10.420532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:10.420536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:10.420539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:10.420542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:10.421230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:10.421264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:10.421271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:10.421275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:10.421278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:10.421282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:10.421799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:10.421827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:10.421833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:10.421837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:10.421840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:10.421842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:10.422550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:10.422576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:10.422581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:10.422585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:10.422588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:10.423947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:10.423966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:10.423978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392550423
2025-10-02T08:09:10.424095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:10.424108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:10.424119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:10.424126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:10.424130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:10.424133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:10.424786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:10.424830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:10.424835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:10.424842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:10.424847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:10.424852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:10.425410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:10.425434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:10.425440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:10.425443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:10.425447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:10.425450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:10.425977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:10.426002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:10.426007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:10.427205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:10.427230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:10.427235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:10.427239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:10.427247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392550426
2025-10-02T08:09:10.427555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:10.427578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:10.427589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:10.427594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:10.427600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:10.427604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:10.428135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:10.428161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:10.428166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:10.428171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:10.428174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:10.428178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:10.428679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:10.428704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.428823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392550428
2025-10-02T08:09:10.429681Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:10.429725Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:10.429737Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:10.429744Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:10.431705Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:10.431721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:10.431723Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:10.431734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533464474513761:7520]
2025-10-02T08:09:10.431740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533464474513761:7520]
2025-10-02T08:09:10.431790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:10.431803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:10.431804Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:10.431809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.431812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:10.431953Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:10.471007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533464474513842:7083]
2025-10-02T08:09:10.471132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 552, pipe: [1:7556533464474513842:7083]
2025-10-02T08:09:10.583719Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:10.584130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474513842:7083], now have 1 active actors on pipe
2025-10-02T08:09:10.584263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533464474513842:7083]
2025-10-02T08:09:10.584294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:10.584296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:10.584329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 553 reason: error at write: Disconnected sessionId: src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0
2025-10-02T08:09:10.584362Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:10.584392Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:10.584527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 553 sessionId: src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0 is DEAD
2025-10-02T08:09:10.584679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:10.584691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0] Write session will restart in 0.007828s
2025-10-02T08:09:10.584717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0] Write session: Do CDS request
2025-10-02T08:09:10.584723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:10.592737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:10.593321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.593588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:10.593833Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:10.593843Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:10.593853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:10.593900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:10.593934Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533464474514082:7527]
2025-10-02T08:09:10.594523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:10.594718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:10.594756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:10.595030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:10.595084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.595090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.595091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.595092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.595093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.595098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.595107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.595111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.595115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.595118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.595128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.595140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.595145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.595154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.595158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.595162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.595166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.595170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.595174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.595179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.595195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:10.596333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:10.596348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 554
2025-10-02T08:09:10.596504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.596552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:10.596563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:10.596567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:10.596994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 554 sessionId:  describe result for acl check
2025-10-02T08:09:10.597028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:10.597034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:10.597036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:10.597041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533464474514098:7529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:10.597521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533464474514098:7529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:10.599738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533464474514098:7529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:10.604083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533464474514098:7529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:10.604100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533464474514098:7529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:10.604103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533464474514098:7529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:10.604113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:10.605268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:10.607050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:10.607071Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:10.607074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:10.607080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:10.607088Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 553 [1:7556533464474514082:7527]
2025-10-02T08:09:10.607102Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:10.607122Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:10.607129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.607133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.607135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.607153Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:10.607159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:10.607165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:10.607237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.607245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.607248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:10.607254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:10.607323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:10.607484Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 553
2025-10-02T08:09:10.607400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.607419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.607432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:10.607451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474514130:7529], now have 1 active actors on pipe
2025-10-02T08:09:10.607455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533464934768270:2378], now have 1 active actors on pipe
2025-10-02T08:09:10.607463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533464474514076:7527]
2025-10-02T08:09:10.607465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533464474514076:7527]
2025-10-02T08:09:10.607472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:10.607485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:10.607501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:10.607505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:10.607520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:10.607523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:10.607539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533464474514076:7527]
2025-10-02T08:09:10.607542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:10.607545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:10.607601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 553
2025-10-02T08:09:10.607675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.607699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.607729Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:10.607747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.607751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.607753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:10.607766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.607782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:10.607805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.607831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.607843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.607859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.607893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 554 partition: 0 MaxSeqNo: 17 sessionId: src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0
2025-10-02T08:09:10.608289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07ede2-31b6afe3-c1a6923f-37f6be25_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:10.611595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0] Write session: try to update token
2025-10-02T08:09:10.611614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:10.626523Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:10.626548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:10.626556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533464474514076:7527]
2025-10-02T08:09:10.626600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:10.626612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:10.626797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:10.626968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.627136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.627303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:10.627550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:10.627596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:10.632544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId: src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:10.635738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:10.636535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.636557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.636594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:10.636624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:10.636685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.636703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.636904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.636972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.637052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.637114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.637169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.637174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.637245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.637309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.637371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.637436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.637477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.637480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.637566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.637626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.637702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.637766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.637816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.637818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.637886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.637946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.638008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.638068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.638113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.638115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.638186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.638250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.638313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.638379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.638426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.638429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.638515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.638574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.638639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.638706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.638751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.638754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.638825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.638885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.638955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.639016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.639063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.639067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.639133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.639194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.639257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.639322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.639368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.639371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.639444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.639502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.639567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.639631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.639677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.639680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.639764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:10.639823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:10.639885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:10.639952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:10.640002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:10.640005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:10.640045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:10.640110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.640129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.640133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:10.640168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:10.640182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:10.640187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:10.640190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:10.640193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:10.640605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:10.640623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:10.640630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:10.640633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:10.640637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:10.640641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:10.641852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:10.641896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:10.641906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:10.641921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:10.641928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:10.641945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:10.642775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:10.642797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:10.642806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:10.642812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:10.642819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:10.645194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:10.645228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:10.645246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392550645
2025-10-02T08:09:10.645592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:10.645624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:10.645634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:10.645637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:10.645644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:10.645647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:10.646368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:10.646395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:10.646400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:10.646404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:10.646407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:10.646411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:10.646947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:10.646972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:10.646979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:10.646982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:10.646986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:10.646991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:10.647515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:10.647541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:10.647545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:10.648719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:10.648742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:10.648748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:10.648751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:10.648758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392550648
2025-10-02T08:09:10.649075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:10.649092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:10.649098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:10.649100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:10.649103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:10.649104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:10.649554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:10.649572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:10.649575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:10.649578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:10.649580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:10.649582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:10.650056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:10.650064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.650143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392550650
2025-10-02T08:09:10.650939Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:10.650950Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:10.650955Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:10.650961Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:10.652730Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:10.652733Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:10.652734Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:10.652739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533464474514076:7527]
2025-10-02T08:09:10.652742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533464474514076:7527]
2025-10-02T08:09:10.652796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:10.652816Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:10.652857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:10.652862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.652864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:10.652991Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:10.684882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533464474514151:7083]
2025-10-02T08:09:10.685690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 553, pipe: [1:7556533464474514151:7083]
2025-10-02T08:09:10.803232Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:10.803630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474514151:7083], now have 1 active actors on pipe
2025-10-02T08:09:10.803794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533464474514151:7083]
2025-10-02T08:09:10.803821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:10.803823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:10.803849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 554 reason: error at write: Disconnected sessionId: src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0
2025-10-02T08:09:10.803889Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:10.804027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 554 sessionId: src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0 is DEAD
2025-10-02T08:09:10.804158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:10.804170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0] Write session will restart in 0.007512s
2025-10-02T08:09:10.804193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0] Write session: Do CDS request
2025-10-02T08:09:10.804200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:10.805261Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:10.813356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.813354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:10.813371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 555
2025-10-02T08:09:10.813549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:10.813579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:10.813588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:10.813592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:10.813762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:10.813950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 555 sessionId:  describe result for acl check
2025-10-02T08:09:10.813981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:10.813986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:10.813990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:10.813996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533464474514394:7535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:10.814483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533464474514394:7535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:10.814522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:10.814686Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:10.814697Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:10.814706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:10.814751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:10.814790Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533464474514399:7533]
2025-10-02T08:09:10.815443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:10.815639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:10.815718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:10.816040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:10.816088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.816089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.816090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.816091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.816092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.816098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.816107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.816112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.816116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.816119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.816124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.816132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:10.816138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.816143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:10.816147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.816153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:10.816157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.816162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.816167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.816172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.816191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:10.816492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533464474514394:7535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:10.823290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533464474514394:7535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:10.823309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533464474514394:7535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:10.823314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533464474514394:7535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:10.823326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:10.824336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:10.826011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:10.826029Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:10.826031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:10.826035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:10.826042Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 554 [1:7556533464474514399:7533]
2025-10-02T08:09:10.826055Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:10.826071Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:10.826074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.826080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.826082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.826098Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:10.826103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:10.826110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:10.826174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.826176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.826179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:10.826181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:10.826246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:10.826258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.826273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:10.826286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:10.826304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 554
2025-10-02T08:09:10.826309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474514441:7535], now have 1 active actors on pipe
2025-10-02T08:09:10.826316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533464474514388:7533]
2025-10-02T08:09:10.826318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533464474514388:7533]
2025-10-02T08:09:10.826325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:10.826337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:10.826340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:10.826345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:10.826361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:10.826364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:10.826370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533464934768277:2378], now have 1 active actors on pipe
2025-10-02T08:09:10.826374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.826378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.826417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533464474514388:7533]
2025-10-02T08:09:10.826425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:10.826440Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:10.826445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:10.826451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:10.826455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:10.826456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:10.826414Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 554
2025-10-02T08:09:10.826465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:10.826478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:10.826580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.826626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.826633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.826646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:10.826684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 555 partition: 0 MaxSeqNo: 17 sessionId: src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0
2025-10-02T08:09:10.827064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3201bf9b-ae842ebd-db15b86f-43736dc2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:10.830305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0] Write session: try to update token
2025-10-02T08:09:10.830323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:10.844953Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:10.844980Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:10.844983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:10.844992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533464474514388:7533]
2025-10-02T08:09:10.844997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533464474514388:7533]
2025-10-02T08:09:10.845044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:10.845049Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:10.845057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:10.845057Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:10.845060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:10.845223Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:10.846485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId: src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:10.849800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:10.904161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533464474514456:7083]
2025-10-02T08:09:10.904258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 554, pipe: [1:7556533464474514456:7083]
2025-10-02T08:09:10.995053Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:10.995393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:10.995412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:10.995459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533464474514456:7083], now have 1 active actors on pipe
2025-10-02T08:09:10.995612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533464474514456:7083]
2025-10-02T08:09:10.995640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:10.995647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:10.995712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 555 reason: error at write: Disconnected sessionId: src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0
2025-10-02T08:09:10.995723Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:10.995708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:10.995880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 555 sessionId: src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0 is DEAD
2025-10-02T08:09:10.996948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:10.996959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0] Write session will restart in 0.005306s
2025-10-02T08:09:10.996984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0] Write session: Do CDS request
2025-10-02T08:09:10.996989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:11.003374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.003418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:11.003448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 556
2025-10-02T08:09:11.003586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.003615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:11.003625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:11.003628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:11.003998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 556 sessionId:  describe result for acl check
2025-10-02T08:09:11.004028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:11.004030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:11.004032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:11.004037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533468769481989:7541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:11.004509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533468769481989:7541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:11.004624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:11.005581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:11.005764Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:11.005775Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:11.005787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:11.005836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:11.005877Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533468769482016:7540]
2025-10-02T08:09:11.006454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:11.006460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533468769481989:7541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:11.006631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:11.006672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:11.006951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:11.007007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.007014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.007015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.007016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.007017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.007022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.007032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.007036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.007039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.007043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.007048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.007055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.007061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.007071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.007075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.007080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.007084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.007089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.007095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.007104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.007120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:11.012246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533468769481989:7541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:11.012268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533468769481989:7541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:11.012289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533468769481989:7541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:11.012299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:11.015588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:11.017463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:11.017487Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:11.017490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:11.017493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:11.017501Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 555 [1:7556533468769482016:7540]
2025-10-02T08:09:11.017514Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:11.017530Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:11.017533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.017536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.017538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.017559Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:11.017571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:11.017578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:11.017646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.017654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.017658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:11.017660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:11.017725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:11.017732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.017744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.017757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:11.017779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 555
2025-10-02T08:09:11.017781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769482043:7541], now have 1 active actors on pipe
2025-10-02T08:09:11.017789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533468769481996:7540]
2025-10-02T08:09:11.017791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533468769481996:7540]
2025-10-02T08:09:11.017804Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:11.017812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533464934768285:2378], now have 1 active actors on pipe
2025-10-02T08:09:11.017821Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:11.017822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.017825Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:11.017826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.017844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:11.017861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:11.017868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:11.017883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 555
2025-10-02T08:09:11.017911Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:11.017921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.017924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.017926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:11.017936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.017946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:11.017961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533468769481996:7540]
2025-10-02T08:09:11.017973Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:11.017984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:11.018013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.018086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.018094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.018107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.018148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 556 partition: 0 MaxSeqNo: 17 sessionId: src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0
2025-10-02T08:09:11.018490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9426093c-6c81d034-ccde1e68-b3eedbc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:11.021384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0] Write session: try to update token
2025-10-02T08:09:11.021400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:11.039491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId: src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:11.041492Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:11.041515Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:11.041518Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:11.041528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533468769481996:7540]
2025-10-02T08:09:11.041533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533468769481996:7540]
2025-10-02T08:09:11.041576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:11.041583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.041586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:11.041749Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:11.042662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:11.042727Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:11.042733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:11.095638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533468769482058:7083]
2025-10-02T08:09:11.095774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 555, pipe: [1:7556533468769482058:7083]
2025-10-02T08:09:11.190062Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:11.190342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.190357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.190398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769482058:7083], now have 1 active actors on pipe
2025-10-02T08:09:11.193191Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:11.193569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533468769482058:7083]
2025-10-02T08:09:11.193601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:11.193655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 556 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0
2025-10-02T08:09:11.193763Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:11.193843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 556 sessionId: src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0 is DEAD
2025-10-02T08:09:11.194108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:11.194123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0] Write session will restart in 0.009558s
2025-10-02T08:09:11.194152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0] Write session: Do CDS request
2025-10-02T08:09:11.194160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:11.201823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:11.205520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.205899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:11.206210Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:11.206233Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:11.206246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:11.206314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:11.206367Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533468769482302:7546]
2025-10-02T08:09:11.207048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:11.207656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:11.207750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:11.208118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:11.208158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:11.208179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 557
2025-10-02T08:09:11.208193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.208203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.208205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.208206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.208208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.208213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.208220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.208222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.208224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.208226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.208231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.208236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.208240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.208244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.208246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.208250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.208253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.208256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.208259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.208262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.208273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:11.208378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.208419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:11.208424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:11.208433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:11.208829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 557 sessionId:  describe result for acl check
2025-10-02T08:09:11.208859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:11.208860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:11.208861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:11.208864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533468769482318:7548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:11.209263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533468769482318:7548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:11.211572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533468769482318:7548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:11.216353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533468769482318:7548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:11.216370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533468769482318:7548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:11.216373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533468769482318:7548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:11.216382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:11.217007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:11.218727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:11.218751Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:11.218754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:11.218757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:11.218764Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 556 [1:7556533468769482302:7546]
2025-10-02T08:09:11.218776Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:11.218791Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:11.218794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.218797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.218800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.218817Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:11.218828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:11.218836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:11.218901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.218909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.218912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:11.218914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:11.218982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:11.218993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.219006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.219018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:11.219035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769482349:7548], now have 1 active actors on pipe
2025-10-02T08:09:11.219037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 556
2025-10-02T08:09:11.219046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533468769482296:7546]
2025-10-02T08:09:11.219048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533468769482296:7546]
2025-10-02T08:09:11.219058Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:11.219071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533469229735587:2378], now have 1 active actors on pipe
2025-10-02T08:09:11.219075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:11.219078Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:11.219080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.219085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.219104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:11.219122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:11.219129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:11.219113Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 556
2025-10-02T08:09:11.219166Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:11.219177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.219181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.219183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:11.219192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.219204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:11.219211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533468769482296:7546]
2025-10-02T08:09:11.219218Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:11.219225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:11.219246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.219286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.219307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.219325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.219357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 557 partition: 0 MaxSeqNo: 17 sessionId: src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0
2025-10-02T08:09:11.219759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c6dda5-c5b852b-6f7c5a11-6026c56_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:11.222682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0] Write session: try to update token
2025-10-02T08:09:11.222704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:11.237939Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:11.237962Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:11.237965Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:11.237973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533468769482296:7546]
2025-10-02T08:09:11.237978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533468769482296:7546]
2025-10-02T08:09:11.238018Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:11.238022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:11.238030Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:11.238030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.238032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:11.238209Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:11.238784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId: src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:11.241628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:11.296650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533468769482371:7083]
2025-10-02T08:09:11.296911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 556, pipe: [1:7556533468769482371:7083]
2025-10-02T08:09:11.391295Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:11.391756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.391771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.391815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769482371:7083], now have 1 active actors on pipe
2025-10-02T08:09:11.392738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:11.392751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:11.392779Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:11.392832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 557 reason: error at write: Disconnected sessionId: src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0
2025-10-02T08:09:11.393011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 557 sessionId: src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0 is DEAD
2025-10-02T08:09:11.393135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533468769482371:7083]
2025-10-02T08:09:11.396929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:11.396948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0] Write session will restart in 0.009215s
2025-10-02T08:09:11.396976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0] Write session: Do CDS request
2025-10-02T08:09:11.396997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:11.393271Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:11.406836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:11.407455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.407574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:11.407863Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:11.407877Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:11.407888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:11.407956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:11.408000Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533468769482673:7565]
2025-10-02T08:09:11.408645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:11.408913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:11.408960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:11.409275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:11.409296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:11.409301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 558
2025-10-02T08:09:11.409321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.409327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.409328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.409329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.409330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.409335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.409344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.409352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.409355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.409359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.409365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.409377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.409387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.409391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.409394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.409398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.409402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.409406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.409413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.409419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.409441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:11.412444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.412501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:11.412512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:11.412520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:11.412965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 558 sessionId:  describe result for acl check
2025-10-02T08:09:11.413006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:11.413014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:11.413017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:11.413022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533468769482689:7567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:11.413549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533468769482689:7567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:11.415317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533468769482689:7567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:11.417213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:11.418353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533468769482689:7567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:11.418369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533468769482689:7567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:11.418371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533468769482689:7567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:11.418378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:11.418874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:11.418888Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:11.418890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:11.418892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:11.418897Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 557 [1:7556533468769482673:7565]
2025-10-02T08:09:11.418904Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:11.418918Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:11.418923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.418925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.418927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.418938Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:11.418942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:11.418946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:11.418991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.418996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.418998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:11.419000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:11.419045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:11.419050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.419058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.419065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:11.419076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 557
2025-10-02T08:09:11.419080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769482717:7567], now have 1 active actors on pipe
2025-10-02T08:09:11.419085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533468769482666:7565]
2025-10-02T08:09:11.419086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533468769482666:7565]
2025-10-02T08:09:11.419091Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:11.419097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533469229735629:2378], now have 1 active actors on pipe
2025-10-02T08:09:11.419102Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:11.419102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.419104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:11.419105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.419120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:11.419136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:11.419143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:11.419156Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 557
2025-10-02T08:09:11.419182Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:11.419195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.419198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.419199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:11.419207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.419215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:11.419226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533468769482666:7565]
2025-10-02T08:09:11.419232Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:11.419241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:11.419255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.419322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.419327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.419336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.419361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 558 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0
2025-10-02T08:09:11.419759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79741ebf-f0f43491-a5cdcca-5de1d3ef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:11.423397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0] Write session: try to update token
2025-10-02T08:09:11.423422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:11.441195Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:11.441222Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:11.441226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:11.441238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533468769482666:7565]
2025-10-02T08:09:11.441246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533468769482666:7565]
2025-10-02T08:09:11.441306Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:11.441311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:11.441313Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:11.441319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.441327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:11.441613Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:11.443019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId: src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:11.445654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:11.496520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533468769482737:7083]
2025-10-02T08:09:11.496687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 557, pipe: [1:7556533468769482737:7083]
2025-10-02T08:09:11.585107Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:11.585432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.585448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.585490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769482737:7083], now have 1 active actors on pipe
2025-10-02T08:09:11.585629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533468769482737:7083]
2025-10-02T08:09:11.585666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:11.585668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:11.585705Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:11.585735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 558 reason: error at write: Disconnected sessionId: src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0
2025-10-02T08:09:11.585943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 558 sessionId: src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0 is DEAD
2025-10-02T08:09:11.586082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:11.586093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0] Write session will restart in 0.009285s
2025-10-02T08:09:11.586117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0] Write session: Do CDS request
2025-10-02T08:09:11.586125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:11.585739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:11.595358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:11.596511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.596596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:11.596612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 559
2025-10-02T08:09:11.596643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:11.596763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.596792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:11.596816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:11.596819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:11.596861Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:11.596874Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:11.596887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:11.596943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:11.597002Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533468769482988:7572]
2025-10-02T08:09:11.597213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 559 sessionId:  describe result for acl check
2025-10-02T08:09:11.597244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:11.597250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:11.597253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:11.597258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533468769482992:7574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:11.597640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:11.597782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533468769482992:7574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:11.597818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:11.597861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:11.598221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:11.598270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.598276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.598278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.598279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.598280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.598305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.598319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.598329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.598332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.598336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.598346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.598354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.598364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.598370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.598374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.598379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.598384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.598388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.598394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.598405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.598424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:11.600094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533468769482992:7574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:11.606659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533468769482992:7574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:11.606680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533468769482992:7574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:11.606683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533468769482992:7574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:11.606692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:11.608141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:11.609944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:11.609966Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:11.609969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:11.609972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:11.609980Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 558 [1:7556533468769482988:7572]
2025-10-02T08:09:11.609996Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:11.610014Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:11.610019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.610022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.610025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.610042Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:11.610052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:11.610059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:11.610119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.610125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.610128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:11.610129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:11.610207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:11.610220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.610235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.610247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:11.610267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533468769482981:7572]
2025-10-02T08:09:11.610274Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533468769482981:7572]
2025-10-02T08:09:11.610277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 558
2025-10-02T08:09:11.610284Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:11.610297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769483035:7574], now have 1 active actors on pipe
2025-10-02T08:09:11.610307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:11.610325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:11.610326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:11.610328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:11.610329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:11.610364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533469229735637:2378], now have 1 active actors on pipe
2025-10-02T08:09:11.610375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.610379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.610392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533468769482981:7572]
2025-10-02T08:09:11.610404Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:11.610416Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:11.610433Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:11.610442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.610445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.610447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:11.610456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.610472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:11.610468Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 558
2025-10-02T08:09:11.610509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.610547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.610554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.610566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.610608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 559 partition: 0 MaxSeqNo: 17 sessionId: src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0
2025-10-02T08:09:11.611098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e7de077-3d0a7c27-f897c4a0-ee90173c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:11.613641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0] Write session: try to update token
2025-10-02T08:09:11.613663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:11.630872Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:11.630899Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:11.630902Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:11.630911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533468769482981:7572]
2025-10-02T08:09:11.630915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533468769482981:7572]
2025-10-02T08:09:11.630961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:11.630968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.630970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:11.630976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:11.630982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:11.631131Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:11.636910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId: src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:11.639912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:11.686011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533468769483049:7083]
2025-10-02T08:09:11.686234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 558, pipe: [1:7556533468769483049:7083]
2025-10-02T08:09:11.778100Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:11.778424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.778432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.778453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769483049:7083], now have 1 active actors on pipe
2025-10-02T08:09:11.778848Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:11.778897Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:11.779156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:11.779205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 559 reason: status is not ok: tablet will be restarted right now sessionId: src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0
2025-10-02T08:09:11.779270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533468769483049:7083]
2025-10-02T08:09:11.779384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 559 sessionId: src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0 is DEAD
2025-10-02T08:09:11.780958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:11.780977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0] Write session will restart in 0.008175s
2025-10-02T08:09:11.781013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0] Write session: Do CDS request
2025-10-02T08:09:11.781020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:11.789669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:11.791071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.791197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:11.791393Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:11.791405Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:11.791414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:11.791463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:11.791508Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533468769483301:7578]
2025-10-02T08:09:11.792041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:11.792244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:11.792294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:11.792606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:11.792677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.792683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.792684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.792685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.792686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.792691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.792702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.792706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.792710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.792713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.792719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.792725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:11.792731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.792736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:11.792740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.792745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:11.792755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.792760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.792770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.792774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.792798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:11.793801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:11.793815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 560
2025-10-02T08:09:11.793975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:11.794005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:11.794011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:11.794015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:11.794432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 560 sessionId:  describe result for acl check
2025-10-02T08:09:11.794482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:11.794490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:11.794492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:11.794497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533468769483317:7580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:11.794965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533468769483317:7580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:11.799219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533468769483317:7580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:11.802783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:11.803462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533468769483317:7580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:11.803478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533468769483317:7580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:11.803482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533468769483317:7580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:11.803492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:11.804772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:11.804796Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:11.804798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:11.804821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:11.804828Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 559 [1:7556533468769483301:7578]
2025-10-02T08:09:11.804840Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:11.804861Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:11.804869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.804872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.804874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.804891Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:11.804900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:11.804906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:11.804970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.804978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.804981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:11.804984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:11.805056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:11.805065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.805080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:11.805100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:11.805121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533468769483294:7578]
2025-10-02T08:09:11.805129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533468769483294:7578]
2025-10-02T08:09:11.805140Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:11.805156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:11.805169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:11.805172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:11.805209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533468769483294:7578]
2025-10-02T08:09:11.805211Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:11.805362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:11.805365Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:11.805375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:11.805835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 559
2025-10-02T08:09:11.805853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769483348:7580], now have 1 active actors on pipe
2025-10-02T08:09:11.805856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533469229735644:2378], now have 1 active actors on pipe
2025-10-02T08:09:11.805955Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 559
2025-10-02T08:09:11.805957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.805966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.805987Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:11.805993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.805999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.806001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:11.806009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.806020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:11.806035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.806066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.806070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.806084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:11.806114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 560 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0
2025-10-02T08:09:11.808961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb6bfb6-a20562bc-e97c407e-ffee2492_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:11.811772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0] Write session: try to update token
2025-10-02T08:09:11.811797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:11.817417Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:11.817437Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:11.817445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533468769483294:7578]
2025-10-02T08:09:11.817487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:11.817677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:11.817845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:11.817984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:11.818126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:11.818342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:11.818376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:11.820572Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:11.833189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId: src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:11.836732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:11.836830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.836838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.836874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:11.836900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:11.836953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:11.836957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:11.837113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.837176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.837244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.837323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.837387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.837397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.837474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.837542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.837617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.837680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.837746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.837755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.837827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.837891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.837963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.838034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.838084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.838091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.838161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.838214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.838279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.838344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.838394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.838397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.838460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.838520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.838574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.838645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.838697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.838699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.838765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.838826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.838889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.838950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.838993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.838995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.839079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.839177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.839262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.839342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.839400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.839404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.839494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.839568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.839651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.839747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.839803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.839818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.839922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.839999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.840075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.840160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.840215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.840219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.840302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:11.840377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:11.840455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:11.840532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:11.840588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:11.840591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:11.840656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:11.840719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:11.840738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:11.840741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:11.840771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:11.840783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:11.840786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:11.840789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:11.840792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:11.841241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:11.841259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:11.841265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:11.841270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:11.841273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:11.841276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:11.841991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:11.842003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:11.842011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:11.842013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:11.842016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:11.842017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:11.842703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:11.842718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:11.842723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:11.842726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:11.842728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:11.844117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:11.844125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:11.844137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392551843
2025-10-02T08:09:11.844381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:11.844390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:11.844396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:11.844399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:11.844403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:11.844406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:11.844977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:11.845005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:11.845016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:11.845020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:11.845031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:11.845039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:11.845639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:11.845665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:11.845675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:11.845678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:11.845682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:11.845685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:11.846262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:11.846287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:11.846294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:11.847597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:11.847614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:11.847620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:11.847625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:11.847636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392551846
2025-10-02T08:09:11.848000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:11.848013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:11.848020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:11.848026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:11.848031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:11.848035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:11.848583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:11.848607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:11.848615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:11.848617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:11.848620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:11.848624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:11.849177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:11.849201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:11.849314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392551849
2025-10-02T08:09:11.852303Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:11.852342Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:11.852352Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:11.852361Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:11.852375Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:11.852378Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:11.852381Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:11.852392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533468769483294:7578]
2025-10-02T08:09:11.852400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533468769483294:7578]
2025-10-02T08:09:11.852459Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:11.852476Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:11.852489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:11.852495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:11.852497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:11.852645Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:11.877841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533468769483365:7083]
2025-10-02T08:09:11.878074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 559, pipe: [1:7556533468769483365:7083]
2025-10-02T08:09:11.999599Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:11.999988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533468769483365:7083], now have 1 active actors on pipe
2025-10-02T08:09:12.001860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:12.001876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0] Write session will restart in 0.007675s
2025-10-02T08:09:12.001904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0] Write session: Do CDS request
2025-10-02T08:09:12.001911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:12.001088Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:12.001397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533468769483365:7083]
2025-10-02T08:09:12.001416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:12.001446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 560 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0
2025-10-02T08:09:12.001642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 560 sessionId: src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0 is DEAD
2025-10-02T08:09:12.004892Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:12.011902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:12.013004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:12.013022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 561
2025-10-02T08:09:12.013240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:12.013266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:12.013271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:12.013273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:12.013722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 561 sessionId:  describe result for acl check
2025-10-02T08:09:12.013750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:12.013751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:12.013753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:12.013757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533473064450704:7586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:12.014181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533473064450704:7586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:12.014572Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [013e4fd001150536] Result# TEvPutResult {Id# [72075186224037892:559:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:12.014629Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:559:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:12.014670Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:559:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:12.018196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533473064450704:7586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:12.023480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533473064450704:7586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:12.023498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533473064450704:7586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:12.023500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533473064450704:7586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:12.023507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:12.031348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:12.033010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:12.033182Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:12.033185Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:12.033193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:12.033226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:12.033254Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533473064450955:7585]
2025-10-02T08:09:12.033739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:12.037094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:12.037174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:12.037528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:12.037567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.037569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.037570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.037572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.037573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.037579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.037590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.037595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.037599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.037602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.037609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.037616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.037623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.037627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.037632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.037636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.037640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.037646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.037651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.037655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.037680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:12.052161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:12.054148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:12.054155Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:12.054158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:12.054162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:12.054169Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 560 [1:7556533473064450955:7585]
2025-10-02T08:09:12.054182Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:12.054201Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:12.054204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.054207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.054209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.054225Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:12.054230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:12.054238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:12.054310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.054313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.054316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:12.054318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:12.054388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:12.054390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.054403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.054413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:12.054430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533473064450948:7585]
2025-10-02T08:09:12.054432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533473064450948:7585]
2025-10-02T08:09:12.054444Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:12.054455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:12.054468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:12.054470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:12.054504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533473064450948:7585]
2025-10-02T08:09:12.054507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:12.054980Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:12.054993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:12.054999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:12.055471Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 560
2025-10-02T08:09:12.056906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 560
2025-10-02T08:09:12.056935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533473064450848:7586], now have 1 active actors on pipe
2025-10-02T08:09:12.056941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533473524702948:2378], now have 1 active actors on pipe
2025-10-02T08:09:12.060050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.060072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.060106Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59794eb7-317a059a-5215bb66-38bdc10a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:12.060118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.060122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.060129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:12.060141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.060159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:12.060178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:12.060320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.060325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.060339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:12.060370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 561 partition: 0 MaxSeqNo: 17 sessionId: src_id|59794eb7-317a059a-5215bb66-38bdc10a_0
2025-10-02T08:09:12.060932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb9d92c6-69b3ee9f-234b3ff0-d252e54b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59794eb7-317a059a-5215bb66-38bdc10a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:12.063572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59794eb7-317a059a-5215bb66-38bdc10a_0] Write session: try to update token
2025-10-02T08:09:12.063595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59794eb7-317a059a-5215bb66-38bdc10a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:12.083927Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:12.083956Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:12.083959Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:12.083970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533473064450948:7585]
2025-10-02T08:09:12.083977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533473064450948:7585]
2025-10-02T08:09:12.084030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:12.084040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.084043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:12.084361Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:12.088893Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:12.088923Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:12.092887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId: src_id|59794eb7-317a059a-5215bb66-38bdc10a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:12.095740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:12.103256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533473064450981:7083]
2025-10-02T08:09:12.103955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 560, pipe: [1:7556533473064450981:7083]
2025-10-02T08:09:12.246117Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:12.246739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.246752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.246810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533473064450981:7083], now have 1 active actors on pipe
2025-10-02T08:09:12.247149Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:12.247555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:12.247618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 561 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59794eb7-317a059a-5215bb66-38bdc10a_0
2025-10-02T08:09:12.247860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 561 sessionId: src_id|59794eb7-317a059a-5215bb66-38bdc10a_0 is DEAD
2025-10-02T08:09:12.248045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533473064450981:7083]
2025-10-02T08:09:12.249058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59794eb7-317a059a-5215bb66-38bdc10a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:12.249073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59794eb7-317a059a-5215bb66-38bdc10a_0] Write session will restart in 0.008028s
2025-10-02T08:09:12.249103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59794eb7-317a059a-5215bb66-38bdc10a_0] Write session: Do CDS request
2025-10-02T08:09:12.249115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59794eb7-317a059a-5215bb66-38bdc10a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:12.249044Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:12.261246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59794eb7-317a059a-5215bb66-38bdc10a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:12.261592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:12.261612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 562
2025-10-02T08:09:12.261779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:12.261808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:12.261815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:12.261818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:12.262903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 562 sessionId:  describe result for acl check
2025-10-02T08:09:12.262944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:12.262946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:12.262947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:12.262953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533473064451018:7592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:12.263497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533473064451018:7592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:12.268652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533473064451018:7592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:12.279796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533473064451018:7592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:12.279818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533473064451018:7592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:12.279831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533473064451018:7592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:12.279849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:12.290328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:12.290670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:12.290872Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:12.290876Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:12.290892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:12.290940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:12.290989Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533473064451275:7591]
2025-10-02T08:09:12.291748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:12.292019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:12.292060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:12.292410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:12.292465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.292466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.292468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.292470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.292472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.292478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.292490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.292494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.292498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.292502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.292509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.292518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.292524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.292530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.292536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.292541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.292546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.292552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.292558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.292563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.292589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:12.305192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:12.307209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:12.307232Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:12.307234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:12.307239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:12.307246Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 561 [1:7556533473064451275:7591]
2025-10-02T08:09:12.307259Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:12.307279Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:12.307282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.307286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.307288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.307306Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:12.307311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:12.307318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:12.307386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.307389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.307391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:12.307394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:12.307466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:12.307469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.307482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.307493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:12.307509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533473064451269:7591]
2025-10-02T08:09:12.307511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533473064451269:7591]
2025-10-02T08:09:12.307518Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:12.307531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:12.307543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:12.307546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:12.307603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533473064451269:7591]
2025-10-02T08:09:12.307605Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:12.308032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:12.308058Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:12.308068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:12.308493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 561
2025-10-02T08:09:12.308517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533473064451173:7592], now have 1 active actors on pipe
2025-10-02T08:09:12.308523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533473524702953:2378], now have 1 active actors on pipe
2025-10-02T08:09:12.308529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.308534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.308559Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:12.308568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.308571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.308574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:12.308836Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 561
2025-10-02T08:09:12.308584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.308597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:12.308613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:12.308648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.308651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.308663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:12.308696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 562 partition: 0 MaxSeqNo: 17 sessionId: src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0
2025-10-02T08:09:12.313278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59794eb7-317a059a-5215bb66-38bdc10a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:12.316577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0] Write session: try to update token
2025-10-02T08:09:12.316597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:12.333989Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:12.334012Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:12.334016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:12.334025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533473064451269:7591]
2025-10-02T08:09:12.334029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533473064451269:7591]
2025-10-02T08:09:12.334074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:12.334081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.334083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:12.334168Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:12.334175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:12.334236Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:12.346360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533473064451308:7083]
2025-10-02T08:09:12.348884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId: src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:12.351828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:12.351989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 561, pipe: [1:7556533473064451308:7083]
2025-10-02T08:09:12.511257Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:12.511654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.511664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.511701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533473064451308:7083], now have 1 active actors on pipe
2025-10-02T08:09:12.512045Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:12.512208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533473064451308:7083]
2025-10-02T08:09:12.512228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:12.512285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 562 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0
2025-10-02T08:09:12.512484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 562 sessionId: src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0 is DEAD
2025-10-02T08:09:12.512627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:12.512636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0] Write session will restart in 0.008048s
2025-10-02T08:09:12.512662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0] Write session: Do CDS request
2025-10-02T08:09:12.512671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:12.512050Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:12.522365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:12.524788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:12.524824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 563
2025-10-02T08:09:12.525179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:12.525201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:12.525204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:12.525208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:12.525275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:12.525534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 563 sessionId:  describe result for acl check
2025-10-02T08:09:12.525558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:12.525559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:12.525560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:12.525564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533473064451620:7613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:12.525974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533473064451620:7613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:12.526479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:12.526680Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:12.526685Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:12.526695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:12.526741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:12.526775Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533473064451633:7611]
2025-10-02T08:09:12.527333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:12.527499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:12.527526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:12.527814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:12.527867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.527868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.527869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.527870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.527871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.527877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.527886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.527890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.527893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.527896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.527901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.527908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.527914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.527919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.527923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.527927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.527931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.527935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.527940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.527945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.527960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:12.528118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533473064451620:7613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:12.535912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533473064451620:7613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:12.535937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533473064451620:7613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:12.535940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533473064451620:7613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:12.535949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:12.540340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:12.542053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:12.542077Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:12.542079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:12.542084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:12.542092Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 562 [1:7556533473064451633:7611]
2025-10-02T08:09:12.542105Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:12.542126Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:12.542129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.542136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.542143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.542160Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:12.542169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:12.542176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:12.542255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.542263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.542267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:12.542269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:12.542340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:12.542347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.542361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.542373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:12.542393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533473524702998:2378], now have 1 active actors on pipe
2025-10-02T08:09:12.542399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533473064451615:7611]
2025-10-02T08:09:12.543197Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 562
2025-10-02T08:09:12.542401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533473064451615:7611]
2025-10-02T08:09:12.542408Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:12.542421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:12.542425Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:12.542428Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:12.542436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:12.542438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:12.542444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533473064451665:7613], now have 1 active actors on pipe
2025-10-02T08:09:12.542474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533473064451615:7611]
2025-10-02T08:09:12.542475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:12.542517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 562
2025-10-02T08:09:12.542588Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:12.543052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.543059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.543087Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a39f5835-e24b33ea-d3551335-6c28d471_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:12.543095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.543099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.543101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:12.543113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.543125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:12.543143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:12.543291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.543300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.543333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:12.543370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 563 partition: 0 MaxSeqNo: 17 sessionId: src_id|a39f5835-e24b33ea-d3551335-6c28d471_0
2025-10-02T08:09:12.543906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de130c5-55eec3b5-aa00c298-6360ed7e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a39f5835-e24b33ea-d3551335-6c28d471_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:12.547088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a39f5835-e24b33ea-d3551335-6c28d471_0] Write session: try to update token
2025-10-02T08:09:12.547112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a39f5835-e24b33ea-d3551335-6c28d471_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:12.570464Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:12.570489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:12.570492Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:12.570501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533473064451615:7611]
2025-10-02T08:09:12.570505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533473064451615:7611]
2025-10-02T08:09:12.570545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:12.570551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.570553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:12.570634Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:12.570648Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:12.570699Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:12.590745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId: src_id|a39f5835-e24b33ea-d3551335-6c28d471_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:12.593868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:12.617055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533473064451680:7083]
2025-10-02T08:09:12.617550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 562, pipe: [1:7556533473064451680:7083]
2025-10-02T08:09:12.716414Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:12.716844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.716864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.716885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533473064451680:7083], now have 1 active actors on pipe
2025-10-02T08:09:12.717049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:12.717066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:12.717121Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:12.717130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 563 reason: error at write: Disconnected sessionId: src_id|a39f5835-e24b33ea-d3551335-6c28d471_0
2025-10-02T08:09:12.717330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 563 sessionId: src_id|a39f5835-e24b33ea-d3551335-6c28d471_0 is DEAD
2025-10-02T08:09:12.717634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533473064451680:7083]
2025-10-02T08:09:12.717736Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:12.719453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a39f5835-e24b33ea-d3551335-6c28d471_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:12.719468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a39f5835-e24b33ea-d3551335-6c28d471_0] Write session will restart in 0.005118s
2025-10-02T08:09:12.719497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a39f5835-e24b33ea-d3551335-6c28d471_0] Write session: Do CDS request
2025-10-02T08:09:12.719507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a39f5835-e24b33ea-d3551335-6c28d471_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:12.729313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a39f5835-e24b33ea-d3551335-6c28d471_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:12.729541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:12.729566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 564
2025-10-02T08:09:12.729853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:12.729888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:12.729894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:12.729898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:12.730571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 564 sessionId:  describe result for acl check
2025-10-02T08:09:12.730613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:12.730624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:12.730626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:12.730634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533473064451924:7620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:12.731269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533473064451924:7620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:12.735368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:12.737034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:12.737220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533473064451924:7620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:12.737308Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:12.737315Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:12.737329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:12.737389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:12.737435Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533473064451960:7619]
2025-10-02T08:09:12.738241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:12.738695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:12.738755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:12.739050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:12.739085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.739086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.739087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.739088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.739089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.739095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.739103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.739106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.739108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.739110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.739116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.739123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:12.739129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.739135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:12.739139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.739145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:12.739148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.739151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.739154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.739157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.739169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:12.749299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533473064451924:7620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:12.749321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533473064451924:7620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:12.749324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533473064451924:7620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:12.749345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:12.751170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:12.753192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:12.753214Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:12.753217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:12.753220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:12.753227Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 563 [1:7556533473064451960:7619]
2025-10-02T08:09:12.753241Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:12.753261Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:12.753264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.753267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.753269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.753289Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:12.753299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:12.753305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:12.753375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.753381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.753384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:12.753387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:12.753451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:12.753457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.753473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:12.753483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:12.753504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533473064451954:7619]
2025-10-02T08:09:12.753510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533473064451954:7619]
2025-10-02T08:09:12.753517Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:12.753533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:12.753550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:12.753556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:12.753560Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:12.753561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:12.753570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533473064451986:7620], now have 1 active actors on pipe
2025-10-02T08:09:12.753603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533473064451954:7619]
2025-10-02T08:09:12.753613Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:12.753618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533473524703004:2378], now have 1 active actors on pipe
2025-10-02T08:09:12.753955Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 563
2025-10-02T08:09:12.753668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 563
2025-10-02T08:09:12.753726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:12.754014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.754022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.754049Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:12.754058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.754063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.754066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:12.754078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.754089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:12.754113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:12.754142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.754157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.754170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:12.754202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 564 partition: 0 MaxSeqNo: 17 sessionId: src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0
2025-10-02T08:09:12.754693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a39f5835-e24b33ea-d3551335-6c28d471_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:12.757459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0] Write session: try to update token
2025-10-02T08:09:12.757481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:12.769321Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:12.769344Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:12.769351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533473064451954:7619]
2025-10-02T08:09:12.769391Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:12.769393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:12.769579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:12.769727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:12.769865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:12.769992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:12.770186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:12.770222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:12.789497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId: src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:12.792469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:12.793188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.793212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.793262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:12.793292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:12.793527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:12.793539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:12.793824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.793939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.794031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.794120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.794190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.794195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.794292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.794381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.794463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.794549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.794607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.794610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.794728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.794817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.794924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.795022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.795083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.795093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.795179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.795266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.795343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.795424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.795485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.795488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.795573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.795649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.795741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.795926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.795995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.795998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.796087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.796158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.796231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.796315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.796447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.796457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.796557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.796634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.796715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.796885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.796981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.796988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.797091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.797180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.797272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.797351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.797400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.797403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.797486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.797565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.797640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.797714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.797774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.797777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.797863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:12.797927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:12.797996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:12.798063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:12.798112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:12.798115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:12.798199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:12.798280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:12.798306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:12.798309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:12.798352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:12.798369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:12.798373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:12.798376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:12.798379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:12.798832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:12.798854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:12.798861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:12.798864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:12.798868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:12.798871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:12.799562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:12.799579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:12.799586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:12.799589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:12.799593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:12.799600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:12.800493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:12.800558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:12.800570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:12.800574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:12.800580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:12.803257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:12.803298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:12.803318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392552799
2025-10-02T08:09:12.803497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:12.803508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:12.803515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:12.803520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:12.803526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:12.803532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:12.804089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:12.804103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:12.804110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:12.804117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:12.804120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:12.804124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:12.804969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:12.805005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:12.805019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:12.805022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:12.805027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:12.805030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:12.805600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:12.805613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:12.805619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:12.806920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:12.806928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:12.806936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:12.806941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:12.806950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392552806
2025-10-02T08:09:12.807296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:12.807308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:12.807316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:12.807322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:12.807326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:12.807329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:12.807892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:12.807906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:12.807911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:12.807915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:12.807918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:12.807922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:12.808447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:12.808458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:12.808576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392552806
2025-10-02T08:09:12.814990Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:12.815040Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:12.815050Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:12.815060Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:12.815075Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:12.815078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:12.815081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:12.815089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533473064451954:7619]
2025-10-02T08:09:12.815093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533473064451954:7619]
2025-10-02T08:09:12.815188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:12.815193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:12.815195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:12.815310Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:12.815319Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:12.815357Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:12.820399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533473064452003:7083]
2025-10-02T08:09:12.821442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 563, pipe: [1:7556533473064452003:7083]
2025-10-02T08:09:12.989589Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:12.990038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533473064452003:7083], now have 1 active actors on pipe
2025-10-02T08:09:12.990325Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:12.990953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533473064452003:7083]
2025-10-02T08:09:12.990975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:12.991002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 564 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0
2025-10-02T08:09:12.991213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 564 sessionId: src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0 is DEAD
2025-10-02T08:09:12.991290Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:12.993111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:12.993127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0] Write session will restart in 0.007061s
2025-10-02T08:09:12.993155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0] Write session: Do CDS request
2025-10-02T08:09:12.993162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:13.004630Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [d8ec4c9ddfdfee81] Result# TEvPutResult {Id# [72075186224037892:563:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:13.004765Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:563:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:13.004833Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:563:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:13.005613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.006255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:13.006268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 565
2025-10-02T08:09:13.006517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.006586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:13.006598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:13.006604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:13.007210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 565 sessionId:  describe result for acl check
2025-10-02T08:09:13.007266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:13.007268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:13.007270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:13.007277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533477359419467:7627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:13.008017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533477359419467:7627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:13.013567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533477359419467:7627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:13.019085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533477359419467:7627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:13.019105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533477359419467:7627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:13.019109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533477359419467:7627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:13.019118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:13.021589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:13.021960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:13.022154Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:13.022158Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:13.022167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:13.022213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:13.022250Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533477359419610:7626]
2025-10-02T08:09:13.022956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:13.023291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:13.023340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:13.023693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:13.023730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.023731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.023733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.023734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.023735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.023741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.023752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.023756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.023761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.023766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.023772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.023780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.023785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.023791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.023797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.023802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.023807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.023813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.023818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.023823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.023844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:13.034940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:13.036912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:13.036934Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:13.036937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:13.036942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:13.036949Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 564 [1:7556533477359419610:7626]
2025-10-02T08:09:13.036961Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:13.036981Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:13.036984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.036987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.036989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.037009Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:13.037014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:13.037020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:13.037090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.037100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.037103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:13.037106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:13.037181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:13.037191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.037205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.037217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:13.037237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359419600:7627], now have 1 active actors on pipe
2025-10-02T08:09:13.037244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533477359419603:7626]
2025-10-02T08:09:13.037247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533477359419603:7626]
2025-10-02T08:09:13.037254Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:13.037267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:13.037279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:13.037283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:13.037289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533473524703017:2378], now have 1 active actors on pipe
2025-10-02T08:09:13.037320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533477359419603:7626]
2025-10-02T08:09:13.037323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:13.037372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 564
2025-10-02T08:09:13.037407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:13.037410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:13.037417Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:13.037884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.037898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.037932Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:13.037940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.037944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.037946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:13.037956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.037967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:13.037990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.038152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.038163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.038179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.038211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 565 partition: 0 MaxSeqNo: 17 sessionId: src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0
2025-10-02T08:09:13.038661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afdb0af-a027860c-664bde16-4f5ed7c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:13.037603Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 564
2025-10-02T08:09:13.041955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0] Write session: try to update token
2025-10-02T08:09:13.041971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:13.062215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId: src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:13.063044Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:13.063048Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:13.063050Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:13.063059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533477359419603:7626]
2025-10-02T08:09:13.063064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533477359419603:7626]
2025-10-02T08:09:13.063111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:13.063118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.063120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:13.063282Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:13.065211Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:13.065217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:13.065413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:13.093441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533477359419634:7083]
2025-10-02T08:09:13.093797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 564, pipe: [1:7556533477359419634:7083]
2025-10-02T08:09:13.230181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:13.230195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0] Write session will restart in 0.006610s
2025-10-02T08:09:13.230220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0] Write session: Do CDS request
2025-10-02T08:09:13.230227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:13.228899Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:13.229302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.229313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.229356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359419634:7083], now have 1 active actors on pipe
2025-10-02T08:09:13.229629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533477359419634:7083]
2025-10-02T08:09:13.229630Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:13.229644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:13.229646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:13.229702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 565 reason: error at write: Disconnected sessionId: src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0
2025-10-02T08:09:13.229895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 565 sessionId: src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0 is DEAD
2025-10-02T08:09:13.232887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:13.238961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.239431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:13.239449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 566
2025-10-02T08:09:13.239631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.239662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:13.239683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:13.239689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:13.240265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 566 sessionId:  describe result for acl check
2025-10-02T08:09:13.240318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:13.240320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:13.240322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:13.240329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533477359419670:7633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:13.240996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533477359419670:7633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:13.254218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533477359419670:7633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:13.260732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533477359419670:7633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:13.260752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533477359419670:7633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:13.260756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533477359419670:7633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:13.260765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:13.266587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:13.266855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:13.267014Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:13.267018Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:13.267026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:13.267067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:13.267106Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533477359419935:7632]
2025-10-02T08:09:13.267729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:13.267950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:13.267990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:13.268287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:13.268326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.268327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.268329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.268330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.268331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.268337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.268347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.268350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.268354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.268358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.268364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.268370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.268376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.268380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.268384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.268389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.268394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.268399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.268404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.268408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.268428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:13.280594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:13.282478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:13.282489Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:13.282492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:13.282497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:13.282506Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 565 [1:7556533477359419935:7632]
2025-10-02T08:09:13.282520Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:13.282542Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:13.282546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.282550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.282552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.282571Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:13.282577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:13.282585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:13.282671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.282674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.282678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:13.282681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:13.282760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:13.282764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.282779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.282791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:13.282810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533477359419929:7632]
2025-10-02T08:09:13.282812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533477359419929:7632]
2025-10-02T08:09:13.282827Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:13.282842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:13.282855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:13.282859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:13.282897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533477359419929:7632]
2025-10-02T08:09:13.282900Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:13.286570Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 565
2025-10-02T08:09:13.283148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:13.283154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:13.283159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:13.286016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 565
2025-10-02T08:09:13.286039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359419894:7633], now have 1 active actors on pipe
2025-10-02T08:09:13.286045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533477819670319:2378], now have 1 active actors on pipe
2025-10-02T08:09:13.286886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.286898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.286938Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:13.286951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.286957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.286961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:13.286975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.286991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:13.287014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.287416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.287423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.287446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.287483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 566 partition: 0 MaxSeqNo: 17 sessionId: src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0
2025-10-02T08:09:13.295304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f296d5fd-77b021d7-2c0b8086-67fab6d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:13.299512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0] Write session: try to update token
2025-10-02T08:09:13.299551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:13.329505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533477359419957:7083]
2025-10-02T08:09:13.329764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 565, pipe: [1:7556533477359419957:7083]
2025-10-02T08:09:13.329781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359419957:7083], now have 1 active actors on pipe
2025-10-02T08:09:13.336258Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:13.336279Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:13.336281Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:13.336292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533477359419929:7632]
2025-10-02T08:09:13.336298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533477359419929:7632]
2025-10-02T08:09:13.336349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:13.336362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.336366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:13.336551Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:13.336966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:13.336973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:13.339761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId: src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:13.342982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:13.565656Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:13.566032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.566041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.566348Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:13.566847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533477359419957:7083]
2025-10-02T08:09:13.566869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:13.566917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 566 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0
2025-10-02T08:09:13.567105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 566 sessionId: src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0 is DEAD
2025-10-02T08:09:13.568905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:13.568923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0] Write session will restart in 0.006456s
2025-10-02T08:09:13.568951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0] Write session: Do CDS request
2025-10-02T08:09:13.568959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:13.568885Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:13.577322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.577835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:13.577849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 567
2025-10-02T08:09:13.578152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.578208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:13.578222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:13.578228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:13.578708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 567 sessionId:  describe result for acl check
2025-10-02T08:09:13.578744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:13.578746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:13.578747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:13.578754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533477359420222:7653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:13.579238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533477359420222:7653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:13.581866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533477359420222:7653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:13.582477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:13.583871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:13.584067Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:13.584075Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:13.584085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:13.584127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:13.584159Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533477359420314:7652]
2025-10-02T08:09:13.585190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:13.585355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:13.585410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:13.585464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533477359420222:7653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:13.585474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533477359420222:7653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:13.585477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533477359420222:7653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:13.585492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:13.585685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:13.585735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.585741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.585742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.585743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.585744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.585749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.585759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.585762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.585766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.585770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.585775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.585782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.585791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.585794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.585798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.585802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.585805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.585808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.585810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.585813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.585824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:13.595855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:13.597697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:13.597704Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:13.597707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:13.597712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:13.597720Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 566 [1:7556533477359420314:7652]
2025-10-02T08:09:13.597734Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:13.597754Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:13.597758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.597762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.597765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.597782Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:13.597787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:13.597795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:13.597868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.597870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.597873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:13.597875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:13.597950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:13.597953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.597968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.597979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:13.597996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533477359420302:7652]
2025-10-02T08:09:13.597998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533477359420302:7652]
2025-10-02T08:09:13.598007Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:13.598022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:13.598036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:13.598039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:13.598049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359420325:7653], now have 1 active actors on pipe
2025-10-02T08:09:13.598048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:13.598052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:13.598082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533477359420302:7652]
2025-10-02T08:09:13.598085Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:13.598091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533477819670362:2378], now have 1 active actors on pipe
2025-10-02T08:09:13.598133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 566
2025-10-02T08:09:13.598191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:13.598357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 566
2025-10-02T08:09:13.598348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.598358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.598383Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:13.598391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.598395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.598397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:13.598407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.598418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:13.598435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.598596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.598603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.598620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.598652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 567 partition: 0 MaxSeqNo: 17 sessionId: src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0
2025-10-02T08:09:13.599090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8550277-cb2948ba-72171b5d-87c8ff34_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:13.601980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0] Write session: try to update token
2025-10-02T08:09:13.602005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:13.619744Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:13.619760Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:13.619762Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:13.619771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533477359420302:7652]
2025-10-02T08:09:13.619775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533477359420302:7652]
2025-10-02T08:09:13.619820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:13.619827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.619829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:13.619999Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:13.620885Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:13.620892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:13.626377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId: src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:13.629547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:13.668894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533477359420344:7083]
2025-10-02T08:09:13.669187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 566, pipe: [1:7556533477359420344:7083]
2025-10-02T08:09:13.766282Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:13.766574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.766586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.766625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359420344:7083], now have 1 active actors on pipe
2025-10-02T08:09:13.766739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:13.766751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:13.766805Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:13.766811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 567 reason: error at write: Disconnected sessionId: src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0
2025-10-02T08:09:13.766841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:13.766982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 567 sessionId: src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0 is DEAD
2025-10-02T08:09:13.767109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533477359420344:7083]
2025-10-02T08:09:13.767284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:13.767293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0] Write session will restart in 0.005481s
2025-10-02T08:09:13.767330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0] Write session: Do CDS request
2025-10-02T08:09:13.767336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:13.774423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.774545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:13.774558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 568
2025-10-02T08:09:13.774718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.774769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:13.774774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:13.774778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:13.775191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 568 sessionId:  describe result for acl check
2025-10-02T08:09:13.775216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:13.775218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:13.775220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:13.775224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533477359420576:7659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:13.775720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533477359420576:7659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:13.777388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:13.778196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:13.778359Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:13.778368Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:13.778377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:13.778399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533477359420576:7659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:13.778425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:13.778472Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533477359420632:7658]
2025-10-02T08:09:13.779049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:13.779246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:13.779291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:13.779590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:13.779635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.779641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.779642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.779644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.779645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.779649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.779658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.779661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.779677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.779680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.779685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.779693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.779698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.779703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.779711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.779715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.779721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.779725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.779729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.779734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.779750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:13.784819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533477359420576:7659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:13.784834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533477359420576:7659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:13.784837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533477359420576:7659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:13.784845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:13.788274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:13.790012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:13.790028Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:13.790031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:13.790034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:13.790040Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 567 [1:7556533477359420632:7658]
2025-10-02T08:09:13.790052Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:13.790069Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:13.790077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.790081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.790082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.790099Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:13.790109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:13.790115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:13.790179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.790185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.790189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:13.790191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:13.790258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:13.790266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.790279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.790292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:13.790312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533477359420621:7658]
2025-10-02T08:09:13.790317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533477359420621:7658]
2025-10-02T08:09:13.790325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:13.790330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 567
2025-10-02T08:09:13.790336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:13.790340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:13.790341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359420659:7659], now have 1 active actors on pipe
2025-10-02T08:09:13.790350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:13.790362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:13.790365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:13.790371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.790375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.790415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533477819670368:2378], now have 1 active actors on pipe
2025-10-02T08:09:13.790422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533477359420621:7658]
2025-10-02T08:09:13.790429Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:13.790436Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:13.790447Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:13.790431Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 567
2025-10-02T08:09:13.790457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.790461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.790463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:13.790472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.790481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:13.790526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.790599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.790605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.790618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.790659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 568 partition: 0 MaxSeqNo: 17 sessionId: src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0
2025-10-02T08:09:13.790991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|631c58d6-35d9bb81-f2549fa4-8f442c40_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:13.794004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0] Write session: try to update token
2025-10-02T08:09:13.794023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:13.808892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId: src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:13.809300Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:13.809315Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:13.809318Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:13.809326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533477359420621:7658]
2025-10-02T08:09:13.809330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533477359420621:7658]
2025-10-02T08:09:13.809372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:13.809375Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:13.809381Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:13.809383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.809385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:13.809560Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:13.811841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:13.867091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533477359420677:7083]
2025-10-02T08:09:13.867229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 567, pipe: [1:7556533477359420677:7083]
2025-10-02T08:09:13.954443Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:13.954769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:13.954783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0] Write session will restart in 0.005219s
2025-10-02T08:09:13.953834Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:13.954202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.954210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.954249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359420677:7083], now have 1 active actors on pipe
2025-10-02T08:09:13.954325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533477359420677:7083]
2025-10-02T08:09:13.954339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:13.954811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0] Write session: Do CDS request
2025-10-02T08:09:13.954341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:13.954391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 568 reason: error at write: Disconnected sessionId: src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0
2025-10-02T08:09:13.954819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:13.954455Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:13.954586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 568 sessionId: src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0 is DEAD
2025-10-02T08:09:13.965348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.965095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:13.965756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:13.965764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 569
2025-10-02T08:09:13.965885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:13.965913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:13.965920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:13.965925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:13.966442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:13.966607Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:13.966614Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:13.966621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:13.966666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:13.966701Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533477359420949:7665]
2025-10-02T08:09:13.967142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:13.967418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 569 sessionId:  describe result for acl check
2025-10-02T08:09:13.967446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:13.967450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:13.967452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:13.967455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533477359420957:7667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:13.967851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533477359420957:7667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:13.967947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:13.967988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:13.968202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:13.968232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.968238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.968240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.968241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.968242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.968247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.968256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.968259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.968262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.968265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.968270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.968276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:13.968280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.968290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:13.968294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.968298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:13.968310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.968319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.968323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.968328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.968348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:13.975214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533477359420957:7667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:13.978068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:13.978241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533477359420957:7667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:13.978256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533477359420957:7667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:13.978259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533477359420957:7667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:13.978268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:13.979967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:13.979986Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:13.979989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:13.979993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:13.980000Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 568 [1:7556533477359420949:7665]
2025-10-02T08:09:13.980011Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:13.980029Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:13.980033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.980035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.980037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.980054Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:13.980060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:13.980067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:13.980134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.980146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.980150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:13.980153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:13.980228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:13.980237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.980251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:13.980260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:13.980284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533477359420992:7667], now have 1 active actors on pipe
2025-10-02T08:09:13.980285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 568
2025-10-02T08:09:13.980293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533477819670378:2378], now have 1 active actors on pipe
2025-10-02T08:09:13.980299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533477359420942:7665]
2025-10-02T08:09:13.980301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533477359420942:7665]
2025-10-02T08:09:13.980315Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:13.980327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.980334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:13.980336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:13.980337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.980356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:13.980372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:13.980374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:13.980422Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:13.980434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:13.980438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:13.980440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:13.980449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:13.980458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:13.980471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533477359420942:7665]
2025-10-02T08:09:13.980484Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:13.980509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.980508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:13.980360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 568
2025-10-02T08:09:13.980603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:13.980613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:13.980628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:13.980669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 569 partition: 0 MaxSeqNo: 17 sessionId: src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0
2025-10-02T08:09:13.981026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56e1da30-57fd7bdb-a4a18d2a-a477ccdd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:13.983804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0] Write session: try to update token
2025-10-02T08:09:13.983881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:13.999124Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:13.999160Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:13.999163Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:13.999176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533477359420942:7665]
2025-10-02T08:09:13.999183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533477359420942:7665]
2025-10-02T08:09:13.999244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:13.999243Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:13.999250Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:13.999261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:13.999264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:13.999429Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:13.999971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId: src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:14.003025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:14.060880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533481654388304:7083]
2025-10-02T08:09:14.062696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 568, pipe: [1:7556533481654388304:7083]
2025-10-02T08:09:14.154784Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:14.155498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.155512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.155569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533481654388304:7083], now have 1 active actors on pipe
2025-10-02T08:09:14.156455Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:14.156895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533481654388304:7083]
2025-10-02T08:09:14.156933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:14.157002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 569 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0
2025-10-02T08:09:14.157249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 569 sessionId: src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0 is DEAD
2025-10-02T08:09:14.159973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:14.159987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0] Write session will restart in 0.005240s
2025-10-02T08:09:14.160016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0] Write session: Do CDS request
2025-10-02T08:09:14.160026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:14.160380Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:14.168751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:14.168982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:14.169003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 570
2025-10-02T08:09:14.169885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:14.169945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:14.169951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:14.169956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:14.170611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 570 sessionId:  describe result for acl check
2025-10-02T08:09:14.170649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:14.170651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:14.170652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:14.170659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533481654388473:7672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:14.171272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533481654388473:7672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:14.177282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533481654388473:7672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:14.179692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:14.181199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:14.181423Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:14.181427Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:14.181436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:14.181485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:14.181519Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533481654388605:7671]
2025-10-02T08:09:14.182163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:14.182561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:14.182603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:14.182924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:14.182977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.182978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.182979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.182980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.182981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.182986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.182996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.182999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.183003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.183007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.183012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.183019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.183024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.183031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.183035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.183040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.183044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.183050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.183054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.183059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.183078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:14.184890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533481654388473:7672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:14.184909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533481654388473:7672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:14.184913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533481654388473:7672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:14.184923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:14.192195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:14.193933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:14.193950Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:14.193953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:14.193958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:14.193964Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 569 [1:7556533481654388605:7671]
2025-10-02T08:09:14.193973Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:14.193987Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:14.193990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:14.193991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:14.193993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:14.194006Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:14.194011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:14.194016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:14.194072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.194080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.194082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:14.194087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:14.194142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:14.194149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.194158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.194165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:14.194178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533481654388598:7671]
2025-10-02T08:09:14.194184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533481654388598:7671]
2025-10-02T08:09:14.194196Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:14.194207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:14.194220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:14.194223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:14.194252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533481654388598:7671]
2025-10-02T08:09:14.194259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:14.194407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:14.194418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:14.194424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:14.194424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 569
2025-10-02T08:09:14.194441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533481654388621:7672], now have 1 active actors on pipe
2025-10-02T08:09:14.194539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.194546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.194582Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:14.194590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:14.194992Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 569
2025-10-02T08:09:14.194595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:14.194598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:14.194610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:14.194621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:14.194639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:14.195114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533482114637680:2378], now have 1 active actors on pipe
2025-10-02T08:09:14.195130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.195135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.195161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:14.195205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 570 partition: 0 MaxSeqNo: 17 sessionId: src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0
2025-10-02T08:09:14.195648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce23a5e-6f372f18-fe6e08b8-cab3b880_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:14.198528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0] Write session: try to update token
2025-10-02T08:09:14.198549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:14.217603Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:14.217627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:14.217631Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:14.217646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533481654388598:7671]
2025-10-02T08:09:14.217650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533481654388598:7671]
2025-10-02T08:09:14.217700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:14.217708Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:14.217716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.217728Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:14.217732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:14.218303Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:14.257263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533481654388637:7083]
2025-10-02T08:09:14.257495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 569, pipe: [1:7556533481654388637:7083]
2025-10-02T08:09:14.262047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId: src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:14.265250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:14.380388Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:14.380875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533481654388637:7083], now have 1 active actors on pipe
2025-10-02T08:09:14.380893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.380900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.381190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533481654388637:7083]
2025-10-02T08:09:14.381219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:14.381222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:14.381224Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:14.381289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 570 reason: error at write: Disconnected sessionId: src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0
2025-10-02T08:09:14.381535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 570 sessionId: src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0 is DEAD
2025-10-02T08:09:14.381823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:14.381836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0] Write session will restart in 0.006704s
2025-10-02T08:09:14.381869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0] Write session: Do CDS request
2025-10-02T08:09:14.381880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:14.381177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:14.390521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:14.393028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:14.393052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 571
2025-10-02T08:09:14.396968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:14.397023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:14.397029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:14.397035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:14.397510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 571 sessionId:  describe result for acl check
2025-10-02T08:09:14.397553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:14.397554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:14.397566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:14.397569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:14.397573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533481654388913:7678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:14.398210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533481654388913:7678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:14.398847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:14.399062Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:14.399076Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:14.399085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:14.399130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:14.399186Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533481654388925:7677]
2025-10-02T08:09:14.399853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:14.400028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:14.400068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:14.400400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:14.400449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.400454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.400456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.400457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.400458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.400465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.400476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.400479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.400483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.400488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.400493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.400500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.400507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.400513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.400518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.400523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.400528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.400534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.400539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.400551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.400570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:14.400688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533481654388913:7678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:14.407395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533481654388913:7678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:14.407412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533481654388913:7678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:14.407416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533481654388913:7678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:14.407426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:14.412382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:14.416101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:14.416122Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:14.416126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:14.416130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:14.416138Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 570 [1:7556533481654388925:7677]
2025-10-02T08:09:14.416153Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:14.416176Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:14.416179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:14.416182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:14.416185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:14.416202Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:14.416208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:14.416216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:14.416310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.416319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.416322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:14.416325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:14.416409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:14.416416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.416432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.416451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:14.416476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533481654388966:7678], now have 1 active actors on pipe
2025-10-02T08:09:14.416485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 570
2025-10-02T08:09:14.416487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533481654388912:7677]
2025-10-02T08:09:14.416490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533481654388912:7677]
2025-10-02T08:09:14.416498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:14.416513Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:14.416518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533482114637700:2378], now have 1 active actors on pipe
2025-10-02T08:09:14.416525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:14.416527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:14.416542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:14.416549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:14.416556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.416565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.416611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533481654388912:7677]
2025-10-02T08:09:14.416618Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:14.416635Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8adacb4-497f7765-c51d4132-68536ffa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:14.416646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:14.416650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:14.416656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:14.416666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:14.416679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:14.416727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:14.416894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:14.416946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.416958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.416984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:14.417033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 571 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8adacb4-497f7765-c51d4132-68536ffa_0
2025-10-02T08:09:14.417593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 570
2025-10-02T08:09:14.417796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d56fb4-15bcb4b5-10b371d0-d4ad0225_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8adacb4-497f7765-c51d4132-68536ffa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:14.440372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8adacb4-497f7765-c51d4132-68536ffa_0] Write session: try to update token
2025-10-02T08:09:14.440405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8adacb4-497f7765-c51d4132-68536ffa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:14.463445Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:14.463465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:14.463468Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:14.463478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533481654388912:7677]
2025-10-02T08:09:14.463483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533481654388912:7677]
2025-10-02T08:09:14.463531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:14.463539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.463542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:14.463780Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:14.465287Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:14.465301Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:14.481030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533481654388997:7083]
2025-10-02T08:09:14.485395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 570, pipe: [1:7556533481654388997:7083]
2025-10-02T08:09:14.508740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId: src_id|d8adacb4-497f7765-c51d4132-68536ffa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:14.512065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:14.702848Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:14.703166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533481654388997:7083], now have 1 active actors on pipe
2025-10-02T08:09:14.703195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.703200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.705786Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:14.705132Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:14.705615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533481654388997:7083]
2025-10-02T08:09:14.705637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:14.705693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 571 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8adacb4-497f7765-c51d4132-68536ffa_0
2025-10-02T08:09:14.705889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 571 sessionId: src_id|d8adacb4-497f7765-c51d4132-68536ffa_0 is DEAD
2025-10-02T08:09:14.708911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8adacb4-497f7765-c51d4132-68536ffa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:14.708924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8adacb4-497f7765-c51d4132-68536ffa_0] Write session will restart in 0.005739s
2025-10-02T08:09:14.708957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8adacb4-497f7765-c51d4132-68536ffa_0] Write session: Do CDS request
2025-10-02T08:09:14.708964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8adacb4-497f7765-c51d4132-68536ffa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:14.720852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8adacb4-497f7765-c51d4132-68536ffa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:14.721894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:14.721909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 572
2025-10-02T08:09:14.726815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:14.726861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:14.726867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:14.726872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:14.727588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 572 sessionId:  describe result for acl check
2025-10-02T08:09:14.727615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:14.727617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:14.727619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:14.727624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533481654389173:7700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:14.728206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533481654389173:7700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:14.753933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533481654389173:7700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:14.754988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:14.755644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:14.755842Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:14.755845Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:14.755855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:14.755902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:14.755946Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533481654389339:7699]
2025-10-02T08:09:14.756668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:14.757702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:14.757760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:14.758104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:14.758166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.758182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.758183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.758184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.758186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.758192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.758202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.758205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.758208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.758211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.758217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.758224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:14.758230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.758235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:14.758240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.758244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:14.758248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.758253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.758258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.758263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.758286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:14.774215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:14.776565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:14.776572Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:14.776576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:14.776580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:14.776588Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 571 [1:7556533481654389339:7699]
2025-10-02T08:09:14.776600Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:14.776618Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:14.776622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:14.776625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:14.776627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:14.776645Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:14.776650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:14.776660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:14.776730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.776732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.776735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:14.776738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:14.777256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 571
2025-10-02T08:09:14.777189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533481654389173:7700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:14.777202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533481654389173:7700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:14.777206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533481654389173:7700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:14.777215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:14.777638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 571
2025-10-02T08:09:14.778153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:14.778159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.778175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:14.778189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:14.778211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533482114637730:2378], now have 1 active actors on pipe
2025-10-02T08:09:14.778222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533481654389361:7700], now have 1 active actors on pipe
2025-10-02T08:09:14.778229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533481654389329:7699]
2025-10-02T08:09:14.778230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533481654389329:7699]
2025-10-02T08:09:14.778238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:14.778257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:14.778271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:14.778274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:14.778313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533481654389329:7699]
2025-10-02T08:09:14.778316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:14.780405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.780416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.780439Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:14.780443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:14.780449Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:14.780450Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:14.780460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:14.780494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:14.780500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:14.780512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:14.780527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:14.780552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:14.780684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.780688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.780705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:14.780741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 572 partition: 0 MaxSeqNo: 17 sessionId: src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0
2025-10-02T08:09:14.785114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8adacb4-497f7765-c51d4132-68536ffa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:14.788905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0] Write session: try to update token
2025-10-02T08:09:14.788928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:14.803570Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:14.803587Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:14.803590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:14.803599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533481654389329:7699]
2025-10-02T08:09:14.803604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533481654389329:7699]
2025-10-02T08:09:14.803647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:14.803655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:14.803670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:14.803882Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:14.805054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:14.805064Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:14.805123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533481654389375:7083]
2025-10-02T08:09:14.805324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 571, pipe: [1:7556533481654389375:7083]
2025-10-02T08:09:14.854979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId: src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:14.858363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:14.988455Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:14.988812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533481654389375:7083], now have 1 active actors on pipe
2025-10-02T08:09:14.988848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:14.988854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:14.989392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533481654389375:7083]
2025-10-02T08:09:14.989399Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:14.989421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:14.989488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 572 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0
2025-10-02T08:09:14.989661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 572 sessionId: src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0 is DEAD
2025-10-02T08:09:14.990073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:14.990082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0] Write session will restart in 0.006549s
2025-10-02T08:09:14.990108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0] Write session: Do CDS request
2025-10-02T08:09:14.990119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:14.993059Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:15.001815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.002334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:15.002349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 573
2025-10-02T08:09:15.002535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.002564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:15.002570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:15.002574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:15.003122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 573 sessionId:  describe result for acl check
2025-10-02T08:09:15.003153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:15.003155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:15.003157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:15.003162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533485949356717:7707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:15.003743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533485949356717:7707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:15.010869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533485949356717:7707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:15.019523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533485949356717:7707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:15.019541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533485949356717:7707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:15.019545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533485949356717:7707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:15.019555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:15.020097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:15.021805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:15.021993Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:15.022002Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:15.022012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:15.022064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:15.022104Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533485949356988:7706]
2025-10-02T08:09:15.022559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:15.022757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:15.022804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:15.023056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:15.023100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.023101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.023103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.023104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.023105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.023112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.023124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.023128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.023133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.023136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.023142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.023150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.023158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.023164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.023169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.023174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.023178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.023184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.023195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.023201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.023225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:15.034309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:15.036563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:15.036581Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:15.036584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:15.036588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:15.036597Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 572 [1:7556533485949356988:7706]
2025-10-02T08:09:15.036610Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:15.036632Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:15.036640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:15.036644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:15.036646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:15.036665Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:15.036674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:15.036683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:15.036754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.036760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.036764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:15.036766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:15.037251Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 572
2025-10-02T08:09:15.037030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:15.037039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.037054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.037066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:15.037087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949356977:7707], now have 1 active actors on pipe
2025-10-02T08:09:15.037098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533482114637740:2378], now have 1 active actors on pipe
2025-10-02T08:09:15.037105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533485949356978:7706]
2025-10-02T08:09:15.037107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533485949356978:7706]
2025-10-02T08:09:15.037122Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:15.037136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:15.037152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:15.037163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:15.037201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533485949356978:7706]
2025-10-02T08:09:15.037204Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:15.037248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 572
2025-10-02T08:09:15.037308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:15.037311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:15.037316Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:15.037496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.037503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.037532Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:15.037539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:15.037544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:15.037546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:15.037558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:15.037569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:15.037588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:15.037687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.037690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.037705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:15.037737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 573 partition: 0 MaxSeqNo: 17 sessionId: src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0
2025-10-02T08:09:15.038206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda6e50d-f898e9b8-2105a7ee-dd846a6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:15.041651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0] Write session: try to update token
2025-10-02T08:09:15.041673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:15.083882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId: src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:15.093263Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:15.093277Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:15.093280Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:15.093289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533485949356978:7706]
2025-10-02T08:09:15.093295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533485949356978:7706]
2025-10-02T08:09:15.093357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:15.093363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.093365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:15.093566Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:15.096874Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:15.096883Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:15.106860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533485949357014:7083]
2025-10-02T08:09:15.106920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:15.107731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 572, pipe: [1:7556533485949357014:7083]
2025-10-02T08:09:15.273580Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:15.274027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.274035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.274059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949357014:7083], now have 1 active actors on pipe
2025-10-02T08:09:15.275225Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:15.275577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533485949357014:7083]
2025-10-02T08:09:15.275596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:15.275652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 573 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0
2025-10-02T08:09:15.275876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 573 sessionId: src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0 is DEAD
2025-10-02T08:09:15.277024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:15.277037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0] Write session will restart in 0.006481s
2025-10-02T08:09:15.277064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0] Write session: Do CDS request
2025-10-02T08:09:15.277073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:15.276877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:15.285324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.289194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:15.289209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 574
2025-10-02T08:09:15.289365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.289397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:15.289403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:15.289407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:15.290263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 574 sessionId:  describe result for acl check
2025-10-02T08:09:15.290298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:15.290300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:15.290301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:15.290307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533485949357169:7713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:15.290872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533485949357169:7713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:15.301193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533485949357169:7713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:15.304542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:15.305790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:15.306032Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:15.306041Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:15.306051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:15.306114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:15.306158Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533485949357326:7712]
2025-10-02T08:09:15.306798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:15.307652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:15.307729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:15.308071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:15.308112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.308113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.308114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.308115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.308116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.308123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.308133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.308137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.308141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.308144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.308150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.308157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.308164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.308168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.308172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.308176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.308181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.308185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.308190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.308194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.308212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:15.308830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533485949357169:7713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:15.308845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533485949357169:7713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:15.308849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533485949357169:7713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:15.308858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:15.318697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:15.321317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:15.321336Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:15.321340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:15.321346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:15.321354Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 573 [1:7556533485949357326:7712]
2025-10-02T08:09:15.321368Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:15.321393Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:15.321396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:15.321400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:15.321403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:15.323917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1422b819-7bef9d8c-b1b0de2a-66fcfbbb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:15.322499Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:15.322520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:15.322528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:15.322627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.322629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.322633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:15.322635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:15.323037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:15.323041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.323057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.323070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:15.323093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949357342:7713], now have 1 active actors on pipe
2025-10-02T08:09:15.323099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533486409605042:2378], now have 1 active actors on pipe
2025-10-02T08:09:15.323106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533485949357316:7712]
2025-10-02T08:09:15.323109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533485949357316:7712]
2025-10-02T08:09:15.323122Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:15.323141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:15.323153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 573
2025-10-02T08:09:15.323170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:15.323173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:15.323211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533485949357316:7712]
2025-10-02T08:09:15.323214Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:15.323318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:15.323321Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:15.323327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:15.323351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.323356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.323383Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:15.323392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:15.323396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:15.323398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:15.323408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:15.323421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:15.323439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:15.323480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.323482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.323494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:15.323524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 574 partition: 0 MaxSeqNo: 17 sessionId: src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0
2025-10-02T08:09:15.323825Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 573
2025-10-02T08:09:15.327681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0] Write session: try to update token
2025-10-02T08:09:15.327704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:15.343686Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:15.343703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:15.343706Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:15.343717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533485949357316:7712]
2025-10-02T08:09:15.343721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533485949357316:7712]
2025-10-02T08:09:15.343771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:15.343783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.343786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:15.343787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:15.343792Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:15.344012Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:15.354141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId: src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:15.357105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:15.376347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533485949357359:7083]
2025-10-02T08:09:15.376603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 573, pipe: [1:7556533485949357359:7083]
2025-10-02T08:09:15.485129Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:15.485705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.485718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.485739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949357359:7083], now have 1 active actors on pipe
2025-10-02T08:09:15.485987Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:15.486290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:15.486347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 574 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0
2025-10-02T08:09:15.486519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 574 sessionId: src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0 is DEAD
2025-10-02T08:09:15.486653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533485949357359:7083]
2025-10-02T08:09:15.486858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:15.486868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0] Write session will restart in 0.009549s
2025-10-02T08:09:15.486887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0] Write session: Do CDS request
2025-10-02T08:09:15.486894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:15.488986Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:15.501318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.505981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:15.505999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 575
2025-10-02T08:09:15.506201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.506229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:15.506234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:15.506239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:15.506692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 575 sessionId:  describe result for acl check
2025-10-02T08:09:15.506724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:15.506726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:15.506732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:15.506738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533485949357523:7721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:15.507389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533485949357523:7721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:15.511918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533485949357523:7721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:15.518949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533485949357523:7721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:15.518967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533485949357523:7721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:15.518971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533485949357523:7721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:15.518980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:15.519752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:15.520533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:15.520708Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:15.520712Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:15.520722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:15.520764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:15.520820Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533485949357695:7720]
2025-10-02T08:09:15.521488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:15.521758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:15.521800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:15.522117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:15.522153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.522154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.522156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.522157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.522158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.522163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.522174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.522179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.522183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.522187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.522193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.522201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.522207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.522213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.522217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.522223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.522227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.522233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.522240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.522245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.522265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:15.531280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:15.533313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:15.533330Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:15.533333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:15.533336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:15.533343Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 574 [1:7556533485949357695:7720]
2025-10-02T08:09:15.533355Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:15.533372Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:15.533375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:15.533378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:15.533380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:15.533395Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:15.533400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:15.533405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:15.533467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.533474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.533477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:15.533479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:15.533561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:15.533570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.533585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.533596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:15.533611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949357685:7721], now have 1 active actors on pipe
2025-10-02T08:09:15.533615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 574
2025-10-02T08:09:15.533620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533485949357689:7720]
2025-10-02T08:09:15.533622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533485949357689:7720]
2025-10-02T08:09:15.533628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:15.533642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:15.533644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:15.533651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:15.533656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:15.533658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:15.533664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533486409605063:2378], now have 1 active actors on pipe
2025-10-02T08:09:15.533668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.533671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.533714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533485949357689:7720]
2025-10-02T08:09:15.533727Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:15.533738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:15.533741Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:15.533746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:15.533750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:15.533752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:15.533761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:15.533776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:15.533733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 574
2025-10-02T08:09:15.533817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:15.533917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.533924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.533939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:15.533974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 575 partition: 0 MaxSeqNo: 17 sessionId: src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0
2025-10-02T08:09:15.534285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3f7885-ce1cd7a8-c446b06b-8ac9bc10_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:15.537406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0] Write session: try to update token
2025-10-02T08:09:15.537424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:15.553980Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:15.554000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:15.554003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:15.554013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533485949357689:7720]
2025-10-02T08:09:15.554018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533485949357689:7720]
2025-10-02T08:09:15.554065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:15.554066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:15.554071Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:15.554073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.554075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:15.554457Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:15.558661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId: src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:15.561859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:15.588960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533485949357721:7083]
2025-10-02T08:09:15.589102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 574, pipe: [1:7556533485949357721:7083]
2025-10-02T08:09:15.714109Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:15.714401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.714417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.714459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949357721:7083], now have 1 active actors on pipe
2025-10-02T08:09:15.714684Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:15.714558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533485949357721:7083]
2025-10-02T08:09:15.714584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:15.714587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:15.714647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 575 reason: error at write: Disconnected sessionId: src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0
2025-10-02T08:09:15.714823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 575 sessionId: src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0 is DEAD
2025-10-02T08:09:15.714928Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:15.714965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:15.714977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0] Write session will restart in 0.008956s
2025-10-02T08:09:15.715010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0] Write session: Do CDS request
2025-10-02T08:09:15.715017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:15.724433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:15.725315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.725382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:15.725393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 576
2025-10-02T08:09:15.725565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.725597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:15.725608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:15.725625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:15.725735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:15.725921Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:15.725930Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:15.725939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:15.725986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:15.725999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 576 sessionId:  describe result for acl check
2025-10-02T08:09:15.726024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:15.726025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:15.726027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:15.726032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533485949358047:7740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:15.726042Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533485949358045:7738]
2025-10-02T08:09:15.726550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533485949358047:7740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:15.726614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:15.726809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:15.726839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:15.727088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:15.727131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.727137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.727138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.727139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.727141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.727146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.727155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.727159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.727162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.727165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.727170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.727178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.727183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.727188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.727192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.727197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.727202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.727206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.727211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.727216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.727234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:15.734303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533485949358047:7740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:15.735928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:15.737755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533485949358047:7740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:15.737775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533485949358047:7740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:15.737780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533485949358047:7740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:15.737788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:15.737863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:15.737877Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:15.737880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:15.737883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:15.737889Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 575 [1:7556533485949358045:7738]
2025-10-02T08:09:15.737901Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:15.737922Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:15.737930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:15.737932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:15.737935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:15.737951Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:15.737956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:15.737962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:15.738036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.738044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.738047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:15.738049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:15.738112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:15.738119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.738131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.738145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:15.738168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533486409605091:2378], now have 1 active actors on pipe
2025-10-02T08:09:15.738178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533485949358037:7738]
2025-10-02T08:09:15.738181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533485949358037:7738]
2025-10-02T08:09:15.738192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:15.738191Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 575
2025-10-02T08:09:15.738211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:15.738216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:15.738219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:15.738228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:15.738231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:15.738261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533485949358037:7738]
2025-10-02T08:09:15.738268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:15.738270Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:15.738284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 575
2025-10-02T08:09:15.738291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949358087:7740], now have 1 active actors on pipe
2025-10-02T08:09:15.738301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.738311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.738336Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:15.738347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:15.738352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:15.738360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:15.738369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:15.738378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:15.738398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:15.738472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.738483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.738508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:15.738550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 576 partition: 0 MaxSeqNo: 17 sessionId: src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0
2025-10-02T08:09:15.738910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b680da-4fd2476e-48e1e1e3-181971a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:15.742124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0] Write session: try to update token
2025-10-02T08:09:15.742145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:15.757310Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:15.757330Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:15.757332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:15.757341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533485949358037:7738]
2025-10-02T08:09:15.757345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533485949358037:7738]
2025-10-02T08:09:15.757390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:15.757396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.757398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:15.757564Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:15.757577Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:15.757590Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:15.758628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId: src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:15.761658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:15.814722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533485949358101:7083]
2025-10-02T08:09:15.814893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 575, pipe: [1:7556533485949358101:7083]
2025-10-02T08:09:15.908689Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:15.909449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:15.909466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:15.909509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949358101:7083], now have 1 active actors on pipe
2025-10-02T08:09:15.910196Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:15.910618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:15.910671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 576 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0
2025-10-02T08:09:15.910866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 576 sessionId: src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0 is DEAD
2025-10-02T08:09:15.911004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533485949358101:7083]
2025-10-02T08:09:15.911943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:15.911956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0] Write session will restart in 0.005881s
2025-10-02T08:09:15.911977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0] Write session: Do CDS request
2025-10-02T08:09:15.911985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:15.912945Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:15.919501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.923371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:15.923386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 577
2025-10-02T08:09:15.923636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:15.923680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:15.923685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:15.923690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:15.924271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 577 sessionId:  describe result for acl check
2025-10-02T08:09:15.924310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:15.924312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:15.924313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:15.924320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533485949358143:7746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:15.925016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533485949358143:7746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:15.942392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533485949358143:7746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:15.963125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533485949358143:7746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:15.963142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533485949358143:7746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:15.963145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533485949358143:7746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:15.963155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:15.987723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:15.987908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:15.988162Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:15.988167Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:15.988180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:15.988232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:15.988273Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533485949358426:7745]
2025-10-02T08:09:15.988989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:15.989513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:15.989559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:15.989885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:15.989923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.989924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.989926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.989927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.989928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.989934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.989946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.989951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.989955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.989959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.989966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.989974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:15.989980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.989986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:15.989994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.990000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:15.990005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.990011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:15.990016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.990022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:15.990041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:16.001418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:16.003507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:16.003514Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:16.003517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:16.003521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:16.003528Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 576 [1:7556533485949358426:7745]
2025-10-02T08:09:16.003542Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:16.003558Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:16.003563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.003566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.003568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.003585Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:16.003590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:16.003598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:16.003674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.003676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.003680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:16.003682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:16.003756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:16.003759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.003773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.003786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:16.003806Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533485949358420:7745]
2025-10-02T08:09:16.003809Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533485949358420:7745]
2025-10-02T08:09:16.003824Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:16.003836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:16.003850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:16.003853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:16.003893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533485949358420:7745]
2025-10-02T08:09:16.003895Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:16.004142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:16.004148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:16.004155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:16.005002Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 576
2025-10-02T08:09:16.005215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 576
2025-10-02T08:09:16.005236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533485949358333:7746], now have 1 active actors on pipe
2025-10-02T08:09:16.005241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533486409605099:2378], now have 1 active actors on pipe
2025-10-02T08:09:16.005324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.005330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.005358Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:16.005367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.005371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.005374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:16.005386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.005401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:16.005420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.005493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.005496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.005510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.005543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 577 partition: 0 MaxSeqNo: 17 sessionId: src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0
2025-10-02T08:09:16.009159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc4e041-5b760aaf-27b02dbd-8cc68562_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:16.010822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533490244325744:7083]
2025-10-02T08:09:16.010958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533490244325744:7083], now have 1 active actors on pipe
2025-10-02T08:09:16.010991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 576, pipe: [1:7556533490244325744:7083]
2025-10-02T08:09:16.012518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0] Write session: try to update token
2025-10-02T08:09:16.012536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:16.033110Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:16.033126Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:16.033129Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:16.033138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533485949358420:7745]
2025-10-02T08:09:16.033142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533485949358420:7745]
2025-10-02T08:09:16.033187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:16.033212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.033214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:16.033388Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:16.036922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId: src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:16.040200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:16.040860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:16.040878Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:16.185793Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:16.186119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.186132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.186987Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:16.187295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533490244325744:7083]
2025-10-02T08:09:16.187320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:16.187375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 577 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0
2025-10-02T08:09:16.187586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 577 sessionId: src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0 is DEAD
2025-10-02T08:09:16.188964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:16.188977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0] Write session will restart in 0.007403s
2025-10-02T08:09:16.189003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0] Write session: Do CDS request
2025-10-02T08:09:16.189010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:16.192900Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:16.197965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:16.198329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:16.198346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 578
2025-10-02T08:09:16.198493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:16.198523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:16.198528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:16.198533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:16.199057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 578 sessionId:  describe result for acl check
2025-10-02T08:09:16.199091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:16.199093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:16.199094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:16.199100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533490244325762:7752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:16.199672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533490244325762:7752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:16.204068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533490244325762:7752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:16.208682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533490244325762:7752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:16.208703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533490244325762:7752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:16.208707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533490244325762:7752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:16.208717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:16.239276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:16.241024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:16.241245Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:16.241249Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:16.241259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:16.241309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:16.241348Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533490244326071:7751]
2025-10-02T08:09:16.242042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:16.242341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:16.242385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:16.242709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:16.242750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.242751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.242752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.242754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.242755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.242761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.242772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.242777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.242781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.242784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.242790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.242797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.242804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.242809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.242815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.242821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.242826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.242833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.242839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.242845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.242866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:16.258961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:16.260949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:16.260959Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:16.260963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:16.260967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:16.260974Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 577 [1:7556533490244326071:7751]
2025-10-02T08:09:16.260989Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:16.261014Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:16.261017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.261021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.261023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.261040Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:16.261046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:16.261054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:16.261131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.261134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.261138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:16.261140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:16.261216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:16.261220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.261237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.261251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:16.261269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533490244326064:7751]
2025-10-02T08:09:16.261272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533490244326064:7751]
2025-10-02T08:09:16.261286Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:16.261302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:16.261318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:16.261320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:16.261358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533490244326064:7751]
2025-10-02T08:09:16.261361Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:16.261657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:16.261663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:16.261669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:16.262197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 577
2025-10-02T08:09:16.262211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533490244325818:7752], now have 1 active actors on pipe
2025-10-02T08:09:16.262215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533490704572403:2378], now have 1 active actors on pipe
2025-10-02T08:09:16.262660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.262670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.262702Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:16.262713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.262717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.262719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:16.262731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.262744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:16.262762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.263293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.263303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.263324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.263366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 578 partition: 0 MaxSeqNo: 17 sessionId: src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0
2025-10-02T08:09:16.263796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dafcd05-3703c92f-82906a8-2ed19e21_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:16.262518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 577
2025-10-02T08:09:16.267223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0] Write session: try to update token
2025-10-02T08:09:16.267246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:16.286321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533490244326094:7083]
2025-10-02T08:09:16.286524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 577, pipe: [1:7556533490244326094:7083]
2025-10-02T08:09:16.286558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533490244326094:7083], now have 1 active actors on pipe
2025-10-02T08:09:16.292932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId: src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:16.294855Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:16.294875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:16.294878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:16.294888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533490244326064:7751]
2025-10-02T08:09:16.294894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533490244326064:7751]
2025-10-02T08:09:16.294946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:16.294954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.294957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:16.295007Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:16.295015Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:16.295182Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:16.296310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:16.455388Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:16.455797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.455809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.455973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533490244326094:7083]
2025-10-02T08:09:16.455998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:16.456000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:16.456063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 578 reason: error at write: Disconnected sessionId: src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0
2025-10-02T08:09:16.456123Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:16.456235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 578 sessionId: src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0 is DEAD
2025-10-02T08:09:16.456156Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:16.456672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:16.456678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0] Write session will restart in 0.008434s
2025-10-02T08:09:16.456699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0] Write session: Do CDS request
2025-10-02T08:09:16.456706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:16.466229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:16.466446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:16.466458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 579
2025-10-02T08:09:16.466581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:16.466608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:16.466615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:16.466619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:16.467179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 579 sessionId:  describe result for acl check
2025-10-02T08:09:16.467225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:16.467233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:16.467236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:16.467242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533490244326286:7760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:16.468006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533490244326286:7760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:16.477945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:16.478232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533490244326286:7760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:16.482656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:16.482908Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:16.482922Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:16.482938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:16.483000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:16.483048Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533490244326439:7759]
2025-10-02T08:09:16.483816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:16.484246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:16.484288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:16.484633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:16.484715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.484725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.484727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.484728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.484730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.484735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.484747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.484751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.484756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.484759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.484766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.484775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.484782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.484788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.484794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.484811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.484820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.484832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.484840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.484846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.484866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:16.492703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533490244326286:7760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:16.492729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533490244326286:7760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:16.492734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533490244326286:7760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:16.492745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:16.500570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:16.502504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:16.502520Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:16.502523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:16.502526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:16.502534Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 578 [1:7556533490244326439:7759]
2025-10-02T08:09:16.502548Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:16.502567Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:16.502571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.502574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.502577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.502592Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:16.502598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:16.502604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:16.502677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.502688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.502691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:16.502693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:16.502761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:16.502770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.502786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.502802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:16.502824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533490244326423:7759]
2025-10-02T08:09:16.502831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533490244326423:7759]
2025-10-02T08:09:16.502844Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:16.502862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:16.502866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:16.502871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:16.502882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:16.502884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:16.502938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533490244326423:7759]
2025-10-02T08:09:16.502947Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:16.502958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533490244326455:7760], now have 1 active actors on pipe
2025-10-02T08:09:16.502958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:16.502962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533490704572423:2378], now have 1 active actors on pipe
2025-10-02T08:09:16.503034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 578
2025-10-02T08:09:16.503053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.503057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.503083Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|789761f0-5094c704-30284941-8ca271dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:16.503097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.503105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.503108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:16.503118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.503134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:16.503155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.503457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.503467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.503485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.503527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 579 partition: 0 MaxSeqNo: 17 sessionId: src_id|789761f0-5094c704-30284941-8ca271dd_0
2025-10-02T08:09:16.503933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e4f50f-9641c18d-3b68d699-8eaaf015_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|789761f0-5094c704-30284941-8ca271dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:16.504886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 578
2025-10-02T08:09:16.507131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789761f0-5094c704-30284941-8ca271dd_0] Write session: try to update token
2025-10-02T08:09:16.507146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789761f0-5094c704-30284941-8ca271dd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:16.525323Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:16.525341Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:16.525344Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:16.525353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533490244326423:7759]
2025-10-02T08:09:16.525359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533490244326423:7759]
2025-10-02T08:09:16.525411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:16.525418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.525422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:16.525594Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:16.525768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:16.525781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:16.528226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId: src_id|789761f0-5094c704-30284941-8ca271dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:16.531470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:16.556125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533490244326471:7083]
2025-10-02T08:09:16.556225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 578, pipe: [1:7556533490244326471:7083]
2025-10-02T08:09:16.677055Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:16.677445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.677452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.677492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533490244326471:7083], now have 1 active actors on pipe
2025-10-02T08:09:16.678064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533490244326471:7083]
2025-10-02T08:09:16.678209Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:16.678542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:16.678594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 579 reason: status is not ok: tablet will be restarted right now sessionId: src_id|789761f0-5094c704-30284941-8ca271dd_0
2025-10-02T08:09:16.678769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 579 sessionId: src_id|789761f0-5094c704-30284941-8ca271dd_0 is DEAD
2025-10-02T08:09:16.678935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789761f0-5094c704-30284941-8ca271dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:16.678946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789761f0-5094c704-30284941-8ca271dd_0] Write session will restart in 0.008225s
2025-10-02T08:09:16.678981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789761f0-5094c704-30284941-8ca271dd_0] Write session: Do CDS request
2025-10-02T08:09:16.678989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789761f0-5094c704-30284941-8ca271dd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:16.681580Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:16.688393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789761f0-5094c704-30284941-8ca271dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:16.692006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:16.692033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 580
2025-10-02T08:09:16.692843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:16.692892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:16.692898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:16.692905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:16.695299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 580 sessionId:  describe result for acl check
2025-10-02T08:09:16.695336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:16.695338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:16.695339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:16.695345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533490244326618:7772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:16.696109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533490244326618:7772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:16.714030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533490244326618:7772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:16.726099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533490244326618:7772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:16.726119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533490244326618:7772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:16.726122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533490244326618:7772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:16.726131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:16.733078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:16.734982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:16.735374Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:16.735386Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:16.735398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:16.735460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:16.735505Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533490244326834:7771]
2025-10-02T08:09:16.736220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:16.736477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:16.736543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:16.736928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:16.736987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.736993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.736994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.736995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.736996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.737002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.737012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.737017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.737020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.737023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.737032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.737039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.737045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.737056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.737061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.737066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.737071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.737075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.737086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.737091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.737114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:16.747188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:16.749111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:16.749131Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:16.749135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:16.749140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:16.749148Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 579 [1:7556533490244326834:7771]
2025-10-02T08:09:16.749160Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:16.749181Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:16.749184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.749187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.749190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.749206Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:16.749213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:16.749220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:16.749300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.749653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.749664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:16.749667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:16.749757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:16.750170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 579
2025-10-02T08:09:16.750639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.750666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.750681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:16.750675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 579
2025-10-02T08:09:16.750710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533490244326785:7772], now have 1 active actors on pipe
2025-10-02T08:09:16.750720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533490704572444:2378], now have 1 active actors on pipe
2025-10-02T08:09:16.750727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.750734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.750753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533490244326828:7771]
2025-10-02T08:09:16.750756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533490244326828:7771]
2025-10-02T08:09:16.750766Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:16.750784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:16.750805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:16.750808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:16.750825Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:16.750833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.750838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.750840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:16.750852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.750865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:16.750890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:16.750894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:16.750903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533490244326828:7771]
2025-10-02T08:09:16.750911Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:16.750925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.750937Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:16.751092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.751095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.751112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.751148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 580 partition: 0 MaxSeqNo: 17 sessionId: src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0
2025-10-02T08:09:16.754578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789761f0-5094c704-30284941-8ca271dd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:16.757915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0] Write session: try to update token
2025-10-02T08:09:16.757935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:16.776605Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:16.776629Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:16.776632Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:16.776642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533490244326828:7771]
2025-10-02T08:09:16.776647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533490244326828:7771]
2025-10-02T08:09:16.776702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:16.776709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.776711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:16.776910Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:16.778427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533490244326858:7083]
2025-10-02T08:09:16.778674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:16.778681Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:16.779868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 579, pipe: [1:7556533490244326858:7083]
2025-10-02T08:09:16.796882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId: src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:16.800171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:16.927979Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:16.928556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533490244326858:7083], now have 1 active actors on pipe
2025-10-02T08:09:16.928588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.928597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.929166Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:16.928999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:16.929010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:16.929071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 580 reason: error at write: Disconnected sessionId: src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0
2025-10-02T08:09:16.929226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 580 sessionId: src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0 is DEAD
2025-10-02T08:09:16.929509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:16.929519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0] Write session will restart in 0.007943s
2025-10-02T08:09:16.929543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0] Write session: Do CDS request
2025-10-02T08:09:16.929550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:16.929704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533490244326858:7083]
2025-10-02T08:09:16.930279Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:16.941481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:16.942854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:16.942998Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:16.943006Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:16.943014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:16.943049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:16.943079Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533490244327154:7783]
2025-10-02T08:09:16.943598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:16.943746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:16.943785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:16.944027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:16.944065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.944070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.944070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.944071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.944073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.944081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:16.944077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.944086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.944089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.944092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.944095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.944099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.944105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:16.944109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.944113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:16.944116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.944120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:16.944125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.944129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.944133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.944137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.944152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:16.944425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:16.944434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 581
2025-10-02T08:09:16.944519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:16.944536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:16.944540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:16.944543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:16.944844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 581 sessionId:  describe result for acl check
2025-10-02T08:09:16.944864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:16.944865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:16.944866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:16.944869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533490244327170:7785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:16.945280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533490244327170:7785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:16.948209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533490244327170:7785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:16.952768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533490244327170:7785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:16.952779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533490244327170:7785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:16.952782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533490244327170:7785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:16.952791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:16.953855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:16.955724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:16.955729Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:16.955731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:16.955733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:16.955738Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 580 [1:7556533490244327154:7783]
2025-10-02T08:09:16.955746Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:16.955759Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:16.955761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.955763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.955765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.955780Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:16.955784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:16.955789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:16.955838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.955840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.955842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:16.955844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:16.955887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:16.955889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.955898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:16.955905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:16.955919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533490244327147:7783]
2025-10-02T08:09:16.955920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533490244327147:7783]
2025-10-02T08:09:16.955934Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:16.955943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:16.955951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:16.955953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:16.955979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533490244327147:7783]
2025-10-02T08:09:16.955981Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:16.955989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533490244327201:7785], now have 1 active actors on pipe
2025-10-02T08:09:16.956002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533490704572461:2378], now have 1 active actors on pipe
2025-10-02T08:09:16.956006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:16.956008Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:16.956014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:16.956020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 580
2025-10-02T08:09:16.956025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.956027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.956046Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:16.956051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:16.956054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:16.956056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:16.956065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:16.956072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:16.956082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.956111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:16.956112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:16.956120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:16.956142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 581 partition: 0 MaxSeqNo: 17 sessionId: src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0
2025-10-02T08:09:16.957883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 580
2025-10-02T08:09:16.964942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25763947-24ccf3d5-c7882c64-4fb0d968_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:16.968436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0] Write session: try to update token
2025-10-02T08:09:16.968461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:16.989586Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:16.989604Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:16.989606Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:16.989616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533490244327147:7783]
2025-10-02T08:09:16.989621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533490244327147:7783]
2025-10-02T08:09:16.989660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:16.989666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:16.989668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:16.989911Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:16.997849Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:16.997869Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:17.032936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533494539294511:7083]
2025-10-02T08:09:17.033176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 580, pipe: [1:7556533494539294511:7083]
2025-10-02T08:09:17.054859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId: src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:17.058236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:17.164849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:17.165031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:17.165043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0] Write session will restart in 0.006636s
2025-10-02T08:09:17.165071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0] Write session: Do CDS request
2025-10-02T08:09:17.165079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:17.162818Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:17.163183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533494539294511:7083], now have 1 active actors on pipe
2025-10-02T08:09:17.163193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.163198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.163775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533494539294511:7083]
2025-10-02T08:09:17.163799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:17.163802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:17.163870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 581 reason: error at write: Disconnected sessionId: src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0
2025-10-02T08:09:17.164055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 581 sessionId: src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0 is DEAD
2025-10-02T08:09:17.164165Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:17.177264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:17.177718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:17.177736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 582
2025-10-02T08:09:17.178149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:17.178177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:17.178183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:17.178188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:17.179064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 582 sessionId:  describe result for acl check
2025-10-02T08:09:17.179092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:17.179094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:17.179095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:17.179101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533494539294552:7790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:17.179688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533494539294552:7790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:17.190754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533494539294552:7790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:17.203828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533494539294552:7790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:17.203850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533494539294552:7790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:17.203854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533494539294552:7790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:17.203865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:17.208137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:17.210199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:17.210507Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:17.210512Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:17.210528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:17.210610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:17.210667Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533494539294844:7789]
2025-10-02T08:09:17.211397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:17.213564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:17.213638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:17.214031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:17.214085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.214091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.214092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.214093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.214095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.214111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.214121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.214130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.214134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.214137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.214145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.214156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.214162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.214174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.214178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.214183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.214187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.214192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.214198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.214208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.214231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:17.226738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:17.228495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:17.228512Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:17.228516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:17.228520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:17.228526Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 581 [1:7556533494539294844:7789]
2025-10-02T08:09:17.228539Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:17.228559Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:17.228562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:17.228565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:17.228567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:17.228585Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:17.228590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:17.228598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:17.228683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.228692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.228695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:17.228697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:17.228766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:17.228773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.228785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.228795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:17.228877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 581
2025-10-02T08:09:17.229182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533494539294838:7789]
2025-10-02T08:09:17.229191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533494539294838:7789]
2025-10-02T08:09:17.229206Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:17.229222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533494539294832:7790], now have 1 active actors on pipe
2025-10-02T08:09:17.229222Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:17.229225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:17.229231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533494999539765:2378], now have 1 active actors on pipe
2025-10-02T08:09:17.229236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.229240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.229262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:17.229284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:17.229292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:17.229342Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6463467-3c167c30-70268754-6a5cafea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:17.229354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:17.229358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:17.229360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:17.229370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:17.229383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:17.229396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533494539294838:7789]
2025-10-02T08:09:17.229405Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:17.229409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:17.229427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:17.229488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.229496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.229512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:17.229554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 582 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6463467-3c167c30-70268754-6a5cafea_0
2025-10-02T08:09:17.229934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1a7bfbd-e37037bb-5d9bc6c8-4699ac16_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6463467-3c167c30-70268754-6a5cafea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:17.233294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6463467-3c167c30-70268754-6a5cafea_0] Write session: try to update token
2025-10-02T08:09:17.233312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6463467-3c167c30-70268754-6a5cafea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:17.229202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 581
2025-10-02T08:09:17.260475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId: src_id|c6463467-3c167c30-70268754-6a5cafea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:17.261075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533494539294868:7083]
2025-10-02T08:09:17.261281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 581, pipe: [1:7556533494539294868:7083]
2025-10-02T08:09:17.261301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533494539294868:7083], now have 1 active actors on pipe
2025-10-02T08:09:17.264346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:17.266519Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:17.266523Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:17.266526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:17.266537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533494539294838:7789]
2025-10-02T08:09:17.266541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533494539294838:7789]
2025-10-02T08:09:17.266593Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:17.266597Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:17.268890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.268911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.268938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:17.268947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.268950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:17.269131Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:17.493200Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:17.497204Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:17.497679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533494539294868:7083]
2025-10-02T08:09:17.497699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:17.497759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 582 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c6463467-3c167c30-70268754-6a5cafea_0
2025-10-02T08:09:17.497977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 582 sessionId: src_id|c6463467-3c167c30-70268754-6a5cafea_0 is DEAD
2025-10-02T08:09:17.498944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:17.500935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6463467-3c167c30-70268754-6a5cafea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:17.500949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6463467-3c167c30-70268754-6a5cafea_0] Write session will restart in 0.009965s
2025-10-02T08:09:17.500987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6463467-3c167c30-70268754-6a5cafea_0] Write session: Do CDS request
2025-10-02T08:09:17.500995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6463467-3c167c30-70268754-6a5cafea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:17.513467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6463467-3c167c30-70268754-6a5cafea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:17.521002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:17.521019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 583
2025-10-02T08:09:17.521199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:17.521230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:17.521236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:17.521242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:17.522827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 583 sessionId:  describe result for acl check
2025-10-02T08:09:17.522871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:17.522873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:17.522874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:17.522880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533494539295066:7798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:17.523484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533494539295066:7798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:17.531574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533494539295066:7798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:17.545693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533494539295066:7798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:17.545715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533494539295066:7798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:17.545719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533494539295066:7798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:17.545730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:17.557363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:17.557635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:17.557849Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:17.557859Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:17.557870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:17.557920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:17.557958Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533494539295229:7797]
2025-10-02T08:09:17.558612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:17.558853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:17.558892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:17.559185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:17.559226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.559227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.559229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.559230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.559231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.559250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.559260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.559264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.559267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.559271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.559277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.559284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.559291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.559296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.559301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.559306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.559310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.559315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.559319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.559324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.559343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:17.584474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:17.586429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:17.586436Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:17.586441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:17.586446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:17.586455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 582 [1:7556533494539295229:7797]
2025-10-02T08:09:17.586471Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:17.586492Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:17.586496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:17.586499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:17.586502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:17.586521Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:17.586527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:17.586535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:17.586617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.586619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.586622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:17.586625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:17.586706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:17.586709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.586724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.586736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:17.586755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533494539295223:7797]
2025-10-02T08:09:17.586757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533494539295223:7797]
2025-10-02T08:09:17.586771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:17.586786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:17.586800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:17.586804Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:17.586843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533494539295223:7797]
2025-10-02T08:09:17.586846Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:17.587121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:17.587129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:17.587135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:17.589026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 582
2025-10-02T08:09:17.589050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533494539295172:7798], now have 1 active actors on pipe
2025-10-02T08:09:17.589056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533494999539786:2378], now have 1 active actors on pipe
2025-10-02T08:09:17.589479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.589490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.589523Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:17.589535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:17.589539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:17.589542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:17.589555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:17.589572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:17.589593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:17.589753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.589759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.589776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:17.589809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 583 partition: 0 MaxSeqNo: 17 sessionId: src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0
2025-10-02T08:09:17.587903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 582
2025-10-02T08:09:17.592938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6463467-3c167c30-70268754-6a5cafea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:17.596553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0] Write session: try to update token
2025-10-02T08:09:17.596573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:17.600152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533494539295253:7083]
2025-10-02T08:09:17.600568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 582, pipe: [1:7556533494539295253:7083]
2025-10-02T08:09:17.600590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533494539295253:7083], now have 1 active actors on pipe
2025-10-02T08:09:17.626739Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:17.626760Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:17.626762Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:17.626772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533494539295223:7797]
2025-10-02T08:09:17.626777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533494539295223:7797]
2025-10-02T08:09:17.626826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:17.626834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.626837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:17.627120Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:17.629085Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:17.629097Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:17.642482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId: src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:17.646118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:17.885847Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:17.886534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.886540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.892719Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:17.891071Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:17.891430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533494539295253:7083]
2025-10-02T08:09:17.891450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:17.891507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 583 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0
2025-10-02T08:09:17.891711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 583 sessionId: src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0 is DEAD
2025-10-02T08:09:17.896893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:17.896906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0] Write session will restart in 0.006803s
2025-10-02T08:09:17.896929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0] Write session: Do CDS request
2025-10-02T08:09:17.896936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:17.905265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:17.909211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:17.909226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 584
2025-10-02T08:09:17.910684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:17.910724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:17.910729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:17.910734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:17.911901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 584 sessionId:  describe result for acl check
2025-10-02T08:09:17.911952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:17.911954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:17.911955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:17.911961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533494539295585:7817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:17.912475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533494539295585:7817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:17.915857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:17.916273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:17.916481Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:17.916485Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:17.916495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:17.916545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:17.916585Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533494539295606:7816]
2025-10-02T08:09:17.917240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:17.917463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:17.917501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:17.917795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:17.917832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.917833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.917834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.917835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.917836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.917840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.917849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.917852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.918037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.918042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.918047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.918054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:17.918060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.918065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:17.918069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.918074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:17.918077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.918082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.918087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.918092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.918111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:17.924411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533494539295585:7817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:17.942463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:17.944706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:17.944713Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:17.944715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:17.944718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:17.944724Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 583 [1:7556533494539295606:7816]
2025-10-02T08:09:17.944736Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:17.944756Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:17.944759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:17.944762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:17.944764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:17.944780Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:17.944784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:17.944792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:17.944878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.944881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.944884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:17.944886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:17.944960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:17.944963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.944977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:17.944988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:17.945007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533494539295598:7816]
2025-10-02T08:09:17.945009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533494539295598:7816]
2025-10-02T08:09:17.945016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:17.945028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:17.945043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:17.945045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:17.945086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533494539295598:7816]
2025-10-02T08:09:17.945087Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:17.945162Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:17.945166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:17.945173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:17.946349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533494539295585:7817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:17.946365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533494539295585:7817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:17.946369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533494539295585:7817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:17.946377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:17.946482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533494999539820:2378], now have 1 active actors on pipe
2025-10-02T08:09:17.947802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 583
2025-10-02T08:09:17.947816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533494539295646:7817], now have 1 active actors on pipe
2025-10-02T08:09:17.947875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.947881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.947911Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:17.947921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:17.947925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:17.947928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:17.947939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:17.947955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:17.947990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:17.948977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 583
2025-10-02T08:09:17.948091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:17.948098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:17.948113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:17.948142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 584 partition: 0 MaxSeqNo: 17 sessionId: src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0
2025-10-02T08:09:17.956924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195787e-4e9a83a6-6504f235-d5d6a2f4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:17.960431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0] Write session: try to update token
2025-10-02T08:09:17.960449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:17.985720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:17.985739Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:17.985741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:17.985756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533494539295598:7816]
2025-10-02T08:09:17.985760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533494539295598:7816]
2025-10-02T08:09:17.985802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:17.985808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:17.985810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:17.985977Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:17.989165Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:17.989179Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:17.992278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533494539295657:7083]
2025-10-02T08:09:17.992881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 583, pipe: [1:7556533494539295657:7083]
2025-10-02T08:09:18.013300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId: src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:18.016481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:18.124864Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:09:18.124893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-02T08:09:18.167242Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:18.167676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533494539295657:7083], now have 1 active actors on pipe
2025-10-02T08:09:18.167716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.167723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.168664Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:18.168701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-02T08:09:18.168844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533494539295657:7083]
2025-10-02T08:09:18.168871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:18.168874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:18.168949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 584 reason: error at write: Disconnected sessionId: src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0
2025-10-02T08:09:18.169141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 584 sessionId: src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0 is DEAD
2025-10-02T08:09:18.169412Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:18.176906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:18.176920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0] Write session will restart in 0.007499s
2025-10-02T08:09:18.176946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0] Write session: Do CDS request
2025-10-02T08:09:18.176954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:18.189502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:18.190325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:18.190338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 585
2025-10-02T08:09:18.190612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:18.190643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:18.190649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:18.190652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:18.191709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 585 sessionId:  describe result for acl check
2025-10-02T08:09:18.191748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:18.191750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:18.191752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:18.191758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533498834263252:7825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:18.192324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533498834263252:7825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:18.196080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:18.196923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:18.197116Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:18.197119Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:18.197129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:18.197171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:18.197211Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533498834263267:7823]
2025-10-02T08:09:18.197814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:18.198551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:18.198593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:18.198886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:18.198922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.198923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.198924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.198925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.198928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.198932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.198942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.198945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.198949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.198952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.198958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.198965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.198970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.198975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.198979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.198984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.198987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.198992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.198997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.199015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.199035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:18.205674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533498834263252:7825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:18.211470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:18.213364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:18.213371Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:18.213373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:18.213378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:18.213385Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 584 [1:7556533498834263267:7823]
2025-10-02T08:09:18.213397Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:18.213416Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:18.213420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:18.213423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:18.213426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:18.213444Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:18.213450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:18.213457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:18.213524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533498834263252:7825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:18.213532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533498834263252:7825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:18.213535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533498834263252:7825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:18.213536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.213538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.213541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:18.213542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:18.213543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:18.213608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:18.213611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.213625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.213637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:18.213654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533498834263259:7823]
2025-10-02T08:09:18.213656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533498834263259:7823]
2025-10-02T08:09:18.213663Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:18.213675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:18.213690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:18.213692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:18.213730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533498834263259:7823]
2025-10-02T08:09:18.213732Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:18.214992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a770e6-ccc0e5fa-2dff1cf3-c0dd0367_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:18.213997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:18.214006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:18.214012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:18.214137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533499294507125:2378], now have 1 active actors on pipe
2025-10-02T08:09:18.214225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 584
2025-10-02T08:09:18.214230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533498834263304:7825], now have 1 active actors on pipe
2025-10-02T08:09:18.214235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.214240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.214266Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:18.214275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:18.214279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:18.214281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:18.214294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:18.214306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:18.214323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:18.214347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.214349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.214360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:18.214387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 585 partition: 0 MaxSeqNo: 17 sessionId: src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0
2025-10-02T08:09:18.216762Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:09:18.218787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0] Write session: try to update token
2025-10-02T08:09:18.218805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:18.216186Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 584
2025-10-02T08:09:18.217066Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 4 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:09:18.217115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:09:18.242032Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:18.242052Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:18.242055Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:18.242064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533498834263259:7823]
2025-10-02T08:09:18.242069Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533498834263259:7823]
2025-10-02T08:09:18.242115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:18.242123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.242125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:18.242383Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:18.242751Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:18.242760Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:18.251680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId: src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:18.254704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:18.272890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533498834263322:7083]
2025-10-02T08:09:18.276307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 584, pipe: [1:7556533498834263322:7083]
2025-10-02T08:09:18.409151Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:18.409565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.409574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.409616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533498834263322:7083], now have 1 active actors on pipe
2025-10-02T08:09:18.413127Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:18.413653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:18.413712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 585 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0
2025-10-02T08:09:18.413900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 585 sessionId: src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0 is DEAD
2025-10-02T08:09:18.413962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533498834263322:7083]
2025-10-02T08:09:18.413803Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:18.416897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:18.416908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0] Write session will restart in 0.005990s
2025-10-02T08:09:18.416938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0] Write session: Do CDS request
2025-10-02T08:09:18.416945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:18.429270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:18.433329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:18.433348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 586
2025-10-02T08:09:18.434249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:18.434282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:18.434287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:18.434291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:18.438686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 586 sessionId:  describe result for acl check
2025-10-02T08:09:18.438725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:18.438729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:18.438733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:18.438739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533498834263371:7832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:18.439294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533498834263371:7832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:18.453410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533498834263371:7832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:18.477213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533498834263371:7832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:18.477232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533498834263371:7832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:18.477236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533498834263371:7832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:18.477246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:18.485159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:18.485548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:18.485743Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:18.485747Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:18.485755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:18.485802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:18.485838Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533498834263686:7830]
2025-10-02T08:09:18.486536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:18.486910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:18.486954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:18.487276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:18.487316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.487317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.487318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.487320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.487321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.487326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.487336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.487340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.487344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.487348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.487353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.487362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.487367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.487373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.487377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.487382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.487386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.487391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.487395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.487400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.487417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:18.507925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:18.510343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:18.510350Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:18.510352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:18.510357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:18.510364Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 585 [1:7556533498834263686:7830]
2025-10-02T08:09:18.510377Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:18.510398Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:18.510401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:18.510406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:18.510408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:18.510422Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:18.510428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:18.510435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:18.510507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.510509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.510513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:18.510515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:18.510591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:18.510595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.510609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.510621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:18.510640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533498834263680:7830]
2025-10-02T08:09:18.510641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533498834263680:7830]
2025-10-02T08:09:18.510655Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:18.510668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:18.510683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:18.510686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:18.510722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533498834263680:7830]
2025-10-02T08:09:18.510725Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:18.510992Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:18.510998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:18.511004Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:18.511590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 585
2025-10-02T08:09:18.511604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533498834263665:7832], now have 1 active actors on pipe
2025-10-02T08:09:18.511609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533499294507147:2378], now have 1 active actors on pipe
2025-10-02T08:09:18.512357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.512367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.512400Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:18.512409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:18.512413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:18.512415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:18.512427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:18.512440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:18.512458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:18.512566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.512571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.512585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:18.512620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 586 partition: 0 MaxSeqNo: 17 sessionId: src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0
2025-10-02T08:09:18.513047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dabad-c4989551-6e38fa2-703d6ed6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:18.514540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533498834263708:7083]
2025-10-02T08:09:18.516632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 585, pipe: [1:7556533498834263708:7083]
2025-10-02T08:09:18.516652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533498834263708:7083], now have 1 active actors on pipe
2025-10-02T08:09:18.511790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 585
2025-10-02T08:09:18.522605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0] Write session: try to update token
2025-10-02T08:09:18.522632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:18.576118Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:18.576138Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:18.576141Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:18.576151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533498834263680:7830]
2025-10-02T08:09:18.576155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533498834263680:7830]
2025-10-02T08:09:18.576203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:18.576210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.576213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:18.576382Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:18.581141Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:18.581153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:18.588545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId: src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:18.591760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:18.833819Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:18.834154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.834163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.836677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:18.836273Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:18.836735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:18.836796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 586 reason: status is not ok: tablet will be restarted right now sessionId: src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0
2025-10-02T08:09:18.836882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533498834263708:7083]
2025-10-02T08:09:18.837047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 586 sessionId: src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0 is DEAD
2025-10-02T08:09:18.844924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:18.844940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0] Write session will restart in 0.005869s
2025-10-02T08:09:18.844971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0] Write session: Do CDS request
2025-10-02T08:09:18.844979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:18.852618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:18.853102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:18.853116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 587
2025-10-02T08:09:18.853271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:18.853302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:18.853309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:18.853312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:18.855706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 587 sessionId:  describe result for acl check
2025-10-02T08:09:18.855745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:18.855746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:18.855748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:18.855753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533498834263871:7839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:18.856511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533498834263871:7839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:18.865317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533498834263871:7839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:18.893624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:18.894073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533498834263871:7839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:18.894079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533498834263871:7839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:18.894083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533498834263871:7839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:18.894092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:18.902923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:18.903179Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:18.903184Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:18.903196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:18.903253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:18.903289Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533498834264073:7838]
2025-10-02T08:09:18.903947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:18.912959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:18.913052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:18.913441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:18.913487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.913489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.913490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.913492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.913493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.913500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.913510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.913514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.913518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.913522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.913528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.913536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:18.913541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.913547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:18.913551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.913557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:18.913562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.913567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.913572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.913578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.913597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:18.935675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:18.937865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:18.937870Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:18.937873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:18.937876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:18.937886Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 586 [1:7556533498834264073:7838]
2025-10-02T08:09:18.937898Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:18.937915Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:18.937918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:18.937921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:18.937923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:18.937939Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:18.937944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:18.937951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:18.945120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.945134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.945137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:18.945140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:18.945219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:18.945221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.945238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:18.945250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:18.945270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533498834264045:7838]
2025-10-02T08:09:18.945272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533498834264045:7838]
2025-10-02T08:09:18.945286Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:18.945303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:18.945319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:18.945322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:18.945370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533498834264045:7838]
2025-10-02T08:09:18.945372Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:18.945421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533498834264089:7083]
2025-10-02T08:09:18.945566Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:18.945571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:18.945577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:18.951304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 586
2025-10-02T08:09:18.951327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533498834264057:7839], now have 1 active actors on pipe
2025-10-02T08:09:18.951332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533499294507155:2378], now have 1 active actors on pipe
2025-10-02T08:09:18.951469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.951478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.951493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533498834264089:7083], now have 1 active actors on pipe
2025-10-02T08:09:18.951508Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8df53f60-d2533135-6a46217e-264d1e13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:18.951518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:18.951522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:18.951524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:18.951537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:18.951553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:18.951575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:18.951601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 586, pipe: [1:7556533498834264089:7083]
2025-10-02T08:09:18.951737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:18.951742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:18.951758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:18.951787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 587 partition: 0 MaxSeqNo: 17 sessionId: src_id|8df53f60-d2533135-6a46217e-264d1e13_0
2025-10-02T08:09:18.948998Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 586
2025-10-02T08:09:18.954993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531ba4e1-399a8e30-ec38f65d-f784bd7a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8df53f60-d2533135-6a46217e-264d1e13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:18.961077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8df53f60-d2533135-6a46217e-264d1e13_0] Write session: try to update token
2025-10-02T08:09:18.961098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8df53f60-d2533135-6a46217e-264d1e13_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:18.972324Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:18.972343Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:18.972346Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:18.972354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533498834264045:7838]
2025-10-02T08:09:18.972358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533498834264045:7838]
2025-10-02T08:09:18.972400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:18.972407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:18.972410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:18.972590Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:18.976379Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:18.976392Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:18.983268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId: src_id|8df53f60-d2533135-6a46217e-264d1e13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:18.986704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:19.134287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:19.134892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df53f60-d2533135-6a46217e-264d1e13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:19.134902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df53f60-d2533135-6a46217e-264d1e13_0] Write session will restart in 0.006466s
2025-10-02T08:09:19.134925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df53f60-d2533135-6a46217e-264d1e13_0] Write session: Do CDS request
2025-10-02T08:09:19.134930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df53f60-d2533135-6a46217e-264d1e13_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:19.133685Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:19.133920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.133927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.134326Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:19.134365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:19.134413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 587 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8df53f60-d2533135-6a46217e-264d1e13_0
2025-10-02T08:09:19.134557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 587 sessionId: src_id|8df53f60-d2533135-6a46217e-264d1e13_0 is DEAD
2025-10-02T08:09:19.134655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533498834264089:7083]
2025-10-02T08:09:19.144261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8df53f60-d2533135-6a46217e-264d1e13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:19.144438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:19.144456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 588
2025-10-02T08:09:19.144539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:19.144563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:19.144575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:19.144579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:19.145062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 588 sessionId:  describe result for acl check
2025-10-02T08:09:19.145099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:19.145101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:19.145102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:19.145107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533503129231674:7858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:19.145598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533503129231674:7858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:19.149462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533503129231674:7858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:19.150662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:19.151268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:19.151702Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:19.151711Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:19.151723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:19.151778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:19.151848Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533503129231755:7857]
2025-10-02T08:09:19.152518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:19.152797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:19.152862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:19.152891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533503129231674:7858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:19.152898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533503129231674:7858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:19.152901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533503129231674:7858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:19.152910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:19.153157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:19.153193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.153194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.153195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.153196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.153197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.153202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.153210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.153213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.153217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.153220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.153225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.153231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.153236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.153241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.153244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.153249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.153253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.153257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.153261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.153266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.153281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:19.162357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:19.164509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:19.164527Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:19.164530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:19.164534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:19.164541Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 587 [1:7556533503129231755:7857]
2025-10-02T08:09:19.164553Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:19.164571Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:19.164579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:19.164582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:19.164584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:19.164600Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:19.164610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:19.164617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:19.164685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.164692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.164696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:19.164698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:19.164953Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 587
2025-10-02T08:09:19.164766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:19.164775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.164790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.164819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:19.164837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533503129231766:7858], now have 1 active actors on pipe
2025-10-02T08:09:19.164841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533503589474483:2378], now have 1 active actors on pipe
2025-10-02T08:09:19.164847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533503129231744:7857]
2025-10-02T08:09:19.164849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533503129231744:7857]
2025-10-02T08:09:19.164862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:19.164875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:19.164889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:19.164892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:19.164926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533503129231744:7857]
2025-10-02T08:09:19.164929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:19.164955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:19.164957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:19.164958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 587
2025-10-02T08:09:19.164962Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:19.165012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.165016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.165040Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:19.165048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:19.165052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:19.165054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:19.165062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:19.165071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:19.165086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:19.165129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.165136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.165148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:19.165179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 588 partition: 0 MaxSeqNo: 17 sessionId: src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0
2025-10-02T08:09:19.165560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8df53f60-d2533135-6a46217e-264d1e13_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:19.168713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0] Write session: try to update token
2025-10-02T08:09:19.168729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:19.184714Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:19.184735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:19.184738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:19.184747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533503129231744:7857]
2025-10-02T08:09:19.184753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533503129231744:7857]
2025-10-02T08:09:19.184821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:19.184828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.184830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:19.185045Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:19.188893Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:19.188910Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:19.197880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId: src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:19.201192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:19.236964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533503129231787:7083]
2025-10-02T08:09:19.237300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 587, pipe: [1:7556533503129231787:7083]
2025-10-02T08:09:19.343248Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:19.342106Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:19.342658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.342667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.342687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533503129231787:7083], now have 1 active actors on pipe
2025-10-02T08:09:19.343353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:19.343356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:19.343417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 588 reason: error at write: Disconnected sessionId: src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0
2025-10-02T08:09:19.343567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 588 sessionId: src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0 is DEAD
2025-10-02T08:09:19.343725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533503129231787:7083]
2025-10-02T08:09:19.343871Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:19.344696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:19.344709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0] Write session will restart in 0.005729s
2025-10-02T08:09:19.344750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0] Write session: Do CDS request
2025-10-02T08:09:19.344757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:19.351765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:19.353079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:19.353100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 589
2025-10-02T08:09:19.353271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:19.353301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:19.353307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:19.353312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:19.353773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 589 sessionId:  describe result for acl check
2025-10-02T08:09:19.353806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:19.353808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:19.353809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:19.353815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533503129231824:7870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:19.354942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533503129231824:7870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:19.367361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533503129231824:7870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:19.384097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:19.385908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533503129231824:7870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:19.385923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533503129231824:7870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:19.385926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533503129231824:7870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:19.385935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:19.386164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:19.386529Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:19.386533Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:19.386544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:19.386608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:19.386644Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533503129232143:7869]
2025-10-02T08:09:19.387240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:19.388038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:19.388087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:19.388395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:19.388435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.388436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.388437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.388438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.388439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.388445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.388454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.388458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.388462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.388466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.388471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.388478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.388484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.388489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.388494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.388499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.388503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.388508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.388512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.388517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.388538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:19.412580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:19.414190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:19.414208Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:19.414211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:19.414215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:19.414221Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 588 [1:7556533503129232143:7869]
2025-10-02T08:09:19.414234Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:19.414253Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:19.414257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:19.414260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:19.414262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:19.414278Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:19.414288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:19.414294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:19.414357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.414363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.414366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:19.414369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:19.414437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:19.414445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.414457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.414468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:19.414485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533503129232141:7870], now have 1 active actors on pipe
2025-10-02T08:09:19.414492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533503129232133:7869]
2025-10-02T08:09:19.414494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533503129232133:7869]
2025-10-02T08:09:19.414501Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:19.414514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:19.414515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:19.414519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:19.414527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:19.414529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:19.414535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533503589474489:2378], now have 1 active actors on pipe
2025-10-02T08:09:19.414567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533503129232133:7869]
2025-10-02T08:09:19.414573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:19.414610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 588
2025-10-02T08:09:19.414727Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:19.414761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.414766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.414789Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:19.414795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:19.414799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:19.414800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:19.414810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:19.414818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:19.414842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:19.414927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.414931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.414942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:19.414972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 589 partition: 0 MaxSeqNo: 17 sessionId: src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0
2025-10-02T08:09:19.414671Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 588
2025-10-02T08:09:19.415294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450a09ef-e10d25a2-b81f8c38-a1fa38c3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:19.418609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Write session: try to update token
2025-10-02T08:09:19.418629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:19.430788Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:19.430804Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:19.430813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533503129232133:7869]
2025-10-02T08:09:19.430859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:19.430862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:19.431047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:19.431197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:19.431358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:19.431514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:19.431731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:19.431765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:19.440976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533503129232177:7083]
2025-10-02T08:09:19.441223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 588, pipe: [1:7556533503129232177:7083]
2025-10-02T08:09:19.441239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533503129232177:7083], now have 1 active actors on pipe
2025-10-02T08:09:19.448463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId: src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:19.451689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:19.454998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.455019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.455065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:19.455127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:19.455897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.455909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.456064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.456128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.456350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.456429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.456569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.456578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.456697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.456787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.456870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.456938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.456987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.456989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.457061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.457132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.457345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.457407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.457466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.457469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.457587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.457659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.457730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.457804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.457858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.457861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.458054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.458144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.458232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.458319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.458375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.458379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.458510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.458575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.458681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.458782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.458834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.458837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.458922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.458987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.459050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.459115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.459160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.459162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.459233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.460866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.460938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.461015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.461066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.461072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.461192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.461316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.461434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.461541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.461610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.461613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.461688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:19.461749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:19.461812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:19.461881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:19.461949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:19.461952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:19.462023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:19.462079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:19.462106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:19.462108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:19.462140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:19.462154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:19.462158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:19.462172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:19.462174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:19.462606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:19.462635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:19.462646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:19.462653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:19.462656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:19.462661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:19.463262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:19.463283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:19.463292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:19.463295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:19.463298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:19.463301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:19.463782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:19.463803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:19.463808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:19.463811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:19.463814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:19.466952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:19.466974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:19.466991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392559466
2025-10-02T08:09:19.467180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:19.467192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:19.467197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:19.467204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:19.467209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:19.467212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:19.467809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:19.467826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:19.467833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:19.467836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:19.467842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:19.467845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:19.468445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:19.468470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:19.468477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:19.468481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:19.468489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:19.468492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:19.469076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:19.469100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:19.469107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:19.470241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:19.470248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:19.470253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:19.470255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:19.470263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392559468
2025-10-02T08:09:19.470573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:19.470581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:19.470585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:19.470588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:19.470591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:19.470593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:19.471049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:19.471059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:19.471063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:19.471069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:19.471071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:19.471073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:19.471513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:19.471524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:19.471616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392559471
2025-10-02T08:09:19.486194Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:19.486234Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:19.486243Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:19.486251Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:19.486265Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:19.486269Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:19.486272Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:19.486281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533503129232133:7869]
2025-10-02T08:09:19.486285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533503129232133:7869]
2025-10-02T08:09:19.486349Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:19.486362Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:19.486389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:19.486396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.486398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:19.486599Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:19.696133Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:19.697479Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:19.697752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:19.697761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:19.697770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:19.697790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 589 reason: error at write: Disconnected sessionId: src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0
2025-10-02T08:09:19.697975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 589 sessionId: src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0 is DEAD
2025-10-02T08:09:19.698099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533503129232177:7083]
2025-10-02T08:09:19.701079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 285 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:09:19.701107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:19.701112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Write session will restart in 0.007716s
2025-10-02T08:09:19.701141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Write session: Do CDS request
2025-10-02T08:09:19.701149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:19.705905Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [8a0188013a93e3fa] Result# TEvPutResult {Id# [72075186224037892:588:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:19.706006Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:588:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:19.706117Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:588:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:19.713212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:19.713673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:19.713687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 590
2025-10-02T08:09:19.716922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:19.716971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:19.716977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:19.716981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:19.717301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 590 sessionId:  describe result for acl check
2025-10-02T08:09:19.717342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:19.717344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:19.717345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:19.717349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533503129232428:7880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:19.717801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533503129232428:7880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:19.724067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:19.725717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:19.725887Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:19.725897Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:19.725906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:19.725957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:19.725997Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533503129232531:7879]
2025-10-02T08:09:19.726299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533503129232428:7880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:19.726507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:19.726712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:19.726750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:19.727029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:19.727087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.727088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.727089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.727090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.727091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.727096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.727104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.727107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.727110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.727114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.727119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.727124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:19.727130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.727134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:19.727138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.727142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:19.727145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.727149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.727154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.727159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.727174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:19.738372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:19.739939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:19.739953Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:19.739955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:19.739958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:19.739963Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 589 [1:7556533503129232531:7879]
2025-10-02T08:09:19.739973Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:19.739987Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:19.739990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:19.739993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:19.739994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:19.740008Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:19.740011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:19.740017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:19.740075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.740084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.740087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:19.740089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:19.740145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:19.740147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.740156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:19.740163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:19.740176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533503129232525:7879]
2025-10-02T08:09:19.740178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533503129232525:7879]
2025-10-02T08:09:19.740183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:19.740192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:19.740203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:19.740206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:19.740206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:19.740208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:19.740232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533503129232525:7879]
2025-10-02T08:09:19.740234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:19.740240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533503129232428:7880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:19.740242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533503589474511:2378], now have 1 active actors on pipe
2025-10-02T08:09:19.740247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533503129232428:7880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:19.740250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533503129232428:7880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:19.740259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:19.740365Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:19.740675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 589
2025-10-02T08:09:19.740683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533503129232561:7880], now have 1 active actors on pipe
2025-10-02T08:09:19.740724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.740728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.740746Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:19.740751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:19.740754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:19.740756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:19.740764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:19.740773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:19.740785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:19.740866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.740872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.740884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:19.740913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 590 partition: 0 MaxSeqNo: 17 sessionId: src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0
2025-10-02T08:09:19.741325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb619f2-1991fe17-d63470b-1f48ee82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:19.741200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 589
2025-10-02T08:09:19.748286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0] Write session: try to update token
2025-10-02T08:09:19.748303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:19.770444Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:19.770464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:19.770466Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:19.770476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533503129232525:7879]
2025-10-02T08:09:19.770481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533503129232525:7879]
2025-10-02T08:09:19.770529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:19.770544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:19.770546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:19.770722Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:19.773118Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:19.773135Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:19.774251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId: src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:19.776959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:19.799209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533503129232573:7083]
2025-10-02T08:09:19.799466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 589, pipe: [1:7556533503129232573:7083]
2025-10-02T08:09:19.963680Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:19.964195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:19.964206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:19.964251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533503129232573:7083], now have 1 active actors on pipe
2025-10-02T08:09:19.965247Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:19.965632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533503129232573:7083]
2025-10-02T08:09:19.965648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:19.965707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 590 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0
2025-10-02T08:09:19.965902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 590 sessionId: src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0 is DEAD
2025-10-02T08:09:19.965909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:19.972993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:19.973007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0] Write session will restart in 0.008411s
2025-10-02T08:09:19.973036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0] Write session: Do CDS request
2025-10-02T08:09:19.973043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:19.989273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:19.990357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:19.990370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 591
2025-10-02T08:09:19.993262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:19.993305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:19.993311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:19.993316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:19.994635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 591 sessionId:  describe result for acl check
2025-10-02T08:09:19.994672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:19.994674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:19.994676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:19.994681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533503129232772:7893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:19.995291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533503129232772:7893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:20.018813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533503129232772:7893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:20.024420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533503129232772:7893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:20.024443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533503129232772:7893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:20.024447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533503129232772:7893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:20.024458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:20.034401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:20.034576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:20.034749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:20.034753Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:20.034763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:20.034808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:20.035119Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533507424200235:7888]
2025-10-02T08:09:20.035802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:20.041044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:20.041131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:20.041495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:20.041533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.041534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.041535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.041536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.041538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.041543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.041555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.041558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.041562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.041566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.041575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.041583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.041589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.041594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.041598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.041604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.041607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.041612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.041616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.041621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.041641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:20.065996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533507424200249:7083]
2025-10-02T08:09:20.071893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:20.073669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:20.073677Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:20.073679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:20.073684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:20.073692Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 590 [1:7556533507424200235:7888]
2025-10-02T08:09:20.073707Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:20.073725Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:20.073728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:20.073732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:20.073734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:20.073753Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:20.073759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:20.073766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:20.073847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.073849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.073853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:20.073855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:20.073932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:20.073934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.073950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.073962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:20.073980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533507424200228:7888]
2025-10-02T08:09:20.073982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533507424200228:7888]
2025-10-02T08:09:20.073996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:20.074009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:20.074022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:20.074025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:20.074062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533507424200228:7888]
2025-10-02T08:09:20.074064Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:20.074332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:20.074339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:20.074345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:20.079569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 590, pipe: [1:7556533507424200249:7083]
2025-10-02T08:09:20.079595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533507424200249:7083], now have 1 active actors on pipe
2025-10-02T08:09:20.079602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533507424200219:7893], now have 1 active actors on pipe
2025-10-02T08:09:20.079605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533503589474520:2378], now have 1 active actors on pipe
2025-10-02T08:09:20.079623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 590
2025-10-02T08:09:20.079848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.079856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.079889Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:20.079899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:20.079905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:20.079908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:20.079921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:20.079938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:20.079957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:20.080061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.080066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.080079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:20.080111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 591 partition: 0 MaxSeqNo: 17 sessionId: src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0
2025-10-02T08:09:20.080589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72e107a9-7972d3fb-8e3cef46-6cef1ec6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:20.084111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0] Write session: try to update token
2025-10-02T08:09:20.084135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:20.082514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 590
2025-10-02T08:09:20.120850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId: src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:20.123435Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:20.123439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:20.123441Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:20.123449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533507424200228:7888]
2025-10-02T08:09:20.123454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533507424200228:7888]
2025-10-02T08:09:20.123506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:20.123512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.123514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:20.123734Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:20.124534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:20.125248Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:20.125258Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:20.313917Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:20.314388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.314398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.314631Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:20.315395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533507424200249:7083]
2025-10-02T08:09:20.315413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:20.315465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 591 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0
2025-10-02T08:09:20.315659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 591 sessionId: src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0 is DEAD
2025-10-02T08:09:20.315832Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:20.316880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:20.316891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0] Write session will restart in 0.006236s
2025-10-02T08:09:20.316926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0] Write session: Do CDS request
2025-10-02T08:09:20.316932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:20.325227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:20.329282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:20.329310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 592
2025-10-02T08:09:20.329653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:20.329706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:20.329714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:20.329721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:20.330623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 592 sessionId:  describe result for acl check
2025-10-02T08:09:20.330661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:20.330666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:20.330677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:20.330683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533507424200459:7905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:20.331388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533507424200459:7905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:20.336990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533507424200459:7905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:20.346047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533507424200459:7905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:20.346070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533507424200459:7905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:20.346076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533507424200459:7905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:20.346087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:20.365751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:20.366439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:20.366736Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:20.366739Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:20.366751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:20.366809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:20.366856Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533507424200638:7904]
2025-10-02T08:09:20.367718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:20.368033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:20.368078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:20.368746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:20.368844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.368845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.368846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.368848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.368849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.368855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.368866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.368869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.368873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.368877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.368884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.368892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.368900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.368906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.368911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.368916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.368921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.368927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.368937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.368943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.368966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:20.391134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:20.393410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:20.393418Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:20.393421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:20.393426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:20.393434Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 591 [1:7556533507424200638:7904]
2025-10-02T08:09:20.393448Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:20.393473Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:20.393476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:20.393480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:20.393483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:20.393502Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:20.393507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:20.393514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:20.393593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.393596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.393600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:20.393603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:20.393683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:20.393687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.393702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.393714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:20.393733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533507424200632:7904]
2025-10-02T08:09:20.393735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533507424200632:7904]
2025-10-02T08:09:20.393749Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:20.393769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:20.393786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:20.393789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:20.393826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533507424200632:7904]
2025-10-02T08:09:20.393829Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:20.394404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:20.394411Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:20.394417Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:20.395137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533507884441846:2378], now have 1 active actors on pipe
2025-10-02T08:09:20.395143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533507424200532:7905], now have 1 active actors on pipe
2025-10-02T08:09:20.395172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 591
2025-10-02T08:09:20.395295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.395302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.395333Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:20.395341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:20.395346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:20.395348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:20.395364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:20.395379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:20.395400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:20.396167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2a8c19-a8349814-9a9c3ffc-27f3c417_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:20.397527Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 591
2025-10-02T08:09:20.395538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.395543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.395558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:20.395595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 592 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0
2025-10-02T08:09:20.420117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533507424200664:7083]
2025-10-02T08:09:20.420438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 591, pipe: [1:7556533507424200664:7083]
2025-10-02T08:09:20.420461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533507424200664:7083], now have 1 active actors on pipe
2025-10-02T08:09:20.430918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0] Write session: try to update token
2025-10-02T08:09:20.430942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:20.435095Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:20.435115Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:20.435118Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:20.435127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533507424200632:7904]
2025-10-02T08:09:20.435136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533507424200632:7904]
2025-10-02T08:09:20.435182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:20.435190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.435193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:20.435356Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:20.435390Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:20.435398Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:20.469938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId: src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:20.473728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:20.513426Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 5 CurrentSessionLifetimeMs: 121208 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:09:20.674848Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:20.675346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.675356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.678524Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:20.678933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:20.679003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 592 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0
2025-10-02T08:09:20.679335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 592 sessionId: src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0 is DEAD
2025-10-02T08:09:20.679516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533507424200664:7083]
2025-10-02T08:09:20.680947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:20.680961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0] Write session will restart in 0.006205s
2025-10-02T08:09:20.680989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0] Write session: Do CDS request
2025-10-02T08:09:20.680997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:20.678069Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:20.688815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:20.691914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:20.691935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 593
2025-10-02T08:09:20.692261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:20.692299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:20.692306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:20.692311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:20.692918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 593 sessionId:  describe result for acl check
2025-10-02T08:09:20.692965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:20.692966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:20.692968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:20.692973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533507424200719:7913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:20.693502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533507424200719:7913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:20.711415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533507424200719:7913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:20.735835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533507424200719:7913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:20.735860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533507424200719:7913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:20.735864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533507424200719:7913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:20.735875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:20.742750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:20.743187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:20.743641Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:20.743646Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:20.743662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:20.743740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:20.743806Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533507424201038:7912]
2025-10-02T08:09:20.744494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:20.744816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:20.744863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:20.745213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:20.745291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.745292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.745294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.745295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.745296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.745303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.745314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.745318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.745321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.745325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.745331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.745339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:20.745344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.745349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:20.745353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.745358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:20.745362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.745367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.745371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.745376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.745395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:20.761594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:20.763618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:20.763642Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:20.763645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:20.763650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:20.763658Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 592 [1:7556533507424201038:7912]
2025-10-02T08:09:20.763674Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:20.763696Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:20.763700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:20.763704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:20.763706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:20.763725Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:20.763731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:20.763740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:20.763826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.763830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.763834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:20.763837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:20.763915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:20.763917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.763932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:20.763944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:20.763962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533507424201032:7912]
2025-10-02T08:09:20.763965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533507424201032:7912]
2025-10-02T08:09:20.763979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:20.763993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:20.764009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:20.764012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:20.764054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533507424201032:7912]
2025-10-02T08:09:20.764056Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:20.765069Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 592
2025-10-02T08:09:20.764510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:20.764518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:20.764525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:20.765334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 592
2025-10-02T08:09:20.765348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533507424201017:7913], now have 1 active actors on pipe
2025-10-02T08:09:20.765353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533507884441867:2378], now have 1 active actors on pipe
2025-10-02T08:09:20.766703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.766715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.766751Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:20.766762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:20.766767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:20.766770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:20.766784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:20.766801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:20.766821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:20.766937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.766943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.766959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:20.766995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 593 partition: 0 MaxSeqNo: 17 sessionId: src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0
2025-10-02T08:09:20.769086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a7bafa3-d9ec72eb-695fe00f-5284b739_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:20.772901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0] Write session: try to update token
2025-10-02T08:09:20.772922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:20.784901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533507424201061:7083]
2025-10-02T08:09:20.789129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 592, pipe: [1:7556533507424201061:7083]
2025-10-02T08:09:20.789156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533507424201061:7083], now have 1 active actors on pipe
2025-10-02T08:09:20.812905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId: src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:20.817222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:20.820876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.820908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.820970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:20.821030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:20.821296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:20.821307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:20.821608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.821759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.821843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.821930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.821991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.821997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.822118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.822219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.822323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.822441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.822638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.822644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.822767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.822928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.823039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.823147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.823221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.823225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.823337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.823441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.823560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.823690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.823767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.823771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.823926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.824025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.824126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.824238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.824334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.824338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.824619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.824730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.829479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.829591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.829709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.829714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.829930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.830193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.830286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.830364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.830421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.830425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.830515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.830596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.830676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.830759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.830835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.830839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.830926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.831000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.831085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.831172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.831238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.831241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.831331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:20.831409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:20.831491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:20.831574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:20.831676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:20.831679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:20.831784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:20.831864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:20.831890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:20.831893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:20.831931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:20.831945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:20.831950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:20.831953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:20.831959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:20.832511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:20.832532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:20.832539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:20.832543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:20.832548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:20.832554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:20.837627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:20.837689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:20.837706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:20.837712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:20.837719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:20.837724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:20.838705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:20.838735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:20.838745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:20.838750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:20.838754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:20.850676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:20.850730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:20.850761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392560848
2025-10-02T08:09:20.851183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:20.851218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:20.851235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:20.851243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:20.851252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:20.851260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:20.853152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:20.853189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:20.853200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:20.853209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:20.853214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:20.853221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:20.853918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:20.853939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:20.853949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:20.853953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:20.853958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:20.853963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:20.854613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:20.854636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:20.854644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:20.856286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:20.856298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:20.856307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:20.856312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:20.856325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392560852
2025-10-02T08:09:20.857272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:20.857301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:20.857311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:20.857315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:20.857320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:20.857326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:20.858030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:20.858049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:20.858056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:20.858061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:20.858066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:20.858072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:20.858793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:20.858808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:20.858947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392560857
2025-10-02T08:09:20.862645Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:20.862671Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:20.862679Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:20.862688Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:20.862703Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:20.862706Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:20.862709Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:20.862718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533507424201032:7912]
2025-10-02T08:09:20.862723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533507424201032:7912]
2025-10-02T08:09:20.865176Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:20.865187Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:20.870117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:20.870142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:20.870144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:20.870346Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:21.091228Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:21.092005Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:21.092009Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:21.092019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533507424201032:7912]
2025-10-02T08:09:21.092763Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:21.092642Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:21.093100Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:21.093439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:21.093470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 593 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0
2025-10-02T08:09:21.093676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 593 sessionId: src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0 is DEAD
2025-10-02T08:09:21.093814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533507424201061:7083]
2025-10-02T08:09:21.096935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:21.096950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0] Write session will restart in 0.008730s
2025-10-02T08:09:21.096978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0] Write session: Do CDS request
2025-10-02T08:09:21.096986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:21.106792Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:592:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:21.106942Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [cf5527c611554898] Result# TEvPutResult {Id# [72075186224037892:592:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:21.106982Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:592:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:21.109327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:21.110374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:21.110387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 594
2025-10-02T08:09:21.112362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:21.112387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:21.112391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:21.112394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:21.113374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 594 sessionId:  describe result for acl check
2025-10-02T08:09:21.113403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:21.113404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:21.113406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:21.113410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533511719168530:7926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:21.113870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533511719168530:7926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:21.127333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:21.129014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533511719168530:7926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:21.129578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:21.129773Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:21.129775Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:21.129783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:21.129821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:21.129845Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533511719168728:7925]
2025-10-02T08:09:21.130294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:21.131034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:21.131081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:21.131307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:21.131332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.131333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.131333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.131334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.131335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.131338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.131344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.131346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.131348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.131350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.131354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.131359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.131362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.131366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.131368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.131371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.131373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.131375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.131378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.131381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.131393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:21.136276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533511719168530:7926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:21.136290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533511719168530:7926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:21.136294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533511719168530:7926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:21.136313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:21.143081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:21.145094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:21.145109Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:21.145112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:21.145115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:21.145122Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 593 [1:7556533511719168728:7925]
2025-10-02T08:09:21.145136Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:21.145154Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:21.145157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:21.145160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:21.145161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:21.145180Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:21.145186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:21.145193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:21.145264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.145266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.145269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:21.145272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:21.145343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:21.145346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.145361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.145371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:21.145389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533511719168713:7925]
2025-10-02T08:09:21.145390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533511719168713:7925]
2025-10-02T08:09:21.145404Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:21.145417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:21.145431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:21.145433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:21.145470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533511719168713:7925]
2025-10-02T08:09:21.145472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:21.146682Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 593
2025-10-02T08:09:21.145857Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:21.145863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:21.145869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:21.147033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 593
2025-10-02T08:09:21.147046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533511719168750:7926], now have 1 active actors on pipe
2025-10-02T08:09:21.147052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533512179409173:2378], now have 1 active actors on pipe
2025-10-02T08:09:21.147066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.147070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.147096Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:21.147104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:21.147108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:21.147110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:21.147120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:21.147132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:21.147153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:21.147320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.147334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.147359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:21.147399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 594 partition: 0 MaxSeqNo: 17 sessionId: src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0
2025-10-02T08:09:21.148908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffcffa4-51ef0d8b-ed252bbd-2824463b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:21.152084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0] Write session: try to update token
2025-10-02T08:09:21.152101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:21.171128Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:21.171145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:21.171147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:21.171156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533511719168713:7925]
2025-10-02T08:09:21.171159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533511719168713:7925]
2025-10-02T08:09:21.171204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:21.171210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.171212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:21.171374Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:21.171500Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:21.171505Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:21.183486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId: src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:21.186923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:21.192550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533511719168781:7083]
2025-10-02T08:09:21.194642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 593, pipe: [1:7556533511719168781:7083]
2025-10-02T08:09:21.338797Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:21.339212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.339222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.339266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533511719168781:7083], now have 1 active actors on pipe
2025-10-02T08:09:21.339775Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:21.340659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:21.340672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0] Write session will restart in 0.008247s
2025-10-02T08:09:21.340697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0] Write session: Do CDS request
2025-10-02T08:09:21.340705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:21.339530Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:21.340047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:21.340102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 594 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0
2025-10-02T08:09:21.340318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 594 sessionId: src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0 is DEAD
2025-10-02T08:09:21.340449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533511719168781:7083]
2025-10-02T08:09:21.350386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:21.357811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:21.357835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 595
2025-10-02T08:09:21.357873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:21.358089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:21.358143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:21.358148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:21.358152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:21.358573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 595 sessionId:  describe result for acl check
2025-10-02T08:09:21.358602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:21.358603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:21.358605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:21.358611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533511719169111:7939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:21.359144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533511719169111:7939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:21.362004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:21.362253Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:21.362262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:21.362270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:21.362309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:21.362334Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533511719169131:7937]
2025-10-02T08:09:21.362775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:21.362978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:21.363009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:21.363218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:21.363242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.363243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.363243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.363244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.363245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.363248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.363254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.363256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.363259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.363261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.363265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.363270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.363274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.363277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.363282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.363285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.363288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.363291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.363293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.363296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.363307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:21.366165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533511719169111:7939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:21.374724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533511719169111:7939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:21.374741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533511719169111:7939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:21.374743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533511719169111:7939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:21.374752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:21.380137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:21.382823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:21.382844Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:21.382847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:21.382851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:21.382859Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 594 [1:7556533511719169131:7937]
2025-10-02T08:09:21.382873Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:21.382893Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:21.382900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:21.382904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:21.382906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:21.382924Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:21.382929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:21.382935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:21.383022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.383024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.383028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:21.383031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:21.383123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:21.383125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.383139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.383150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:21.383171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533511719169160:7939], now have 1 active actors on pipe
2025-10-02T08:09:21.383179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533511719169104:7937]
2025-10-02T08:09:21.383181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533511719169104:7937]
2025-10-02T08:09:21.383189Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:21.383203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:21.383203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:21.383207Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:21.383215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:21.383218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:21.383224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533512179409203:2378], now have 1 active actors on pipe
2025-10-02T08:09:21.383259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533511719169104:7937]
2025-10-02T08:09:21.383262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:21.383281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 594
2025-10-02T08:09:21.383327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:21.383354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.383366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.383404Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:21.383415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:21.383421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:21.383423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:21.383439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:21.383452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:21.383474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:21.383614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.383634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.383653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:21.383644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 594
2025-10-02T08:09:21.383713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 595 partition: 0 MaxSeqNo: 17 sessionId: src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0
2025-10-02T08:09:21.384143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65663587-6d589efe-5cfcf6d2-1b5d955c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:21.387433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0] Write session: try to update token
2025-10-02T08:09:21.387453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:21.408378Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:21.408394Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:21.408396Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:21.408404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533511719169104:7937]
2025-10-02T08:09:21.408407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533511719169104:7937]
2025-10-02T08:09:21.408439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:21.408445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.408447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:21.408599Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:21.411458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:21.411466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:21.416413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId: src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:21.419463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:21.440619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533511719169177:7083]
2025-10-02T08:09:21.440887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 594, pipe: [1:7556533511719169177:7083]
2025-10-02T08:09:21.555989Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:21.556414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.556422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.556460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533511719169177:7083], now have 1 active actors on pipe
2025-10-02T08:09:21.557104Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:21.557129Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:21.557707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:21.557718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533511719169177:7083]
2025-10-02T08:09:21.557783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 595 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0
2025-10-02T08:09:21.557978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 595 sessionId: src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0 is DEAD
2025-10-02T08:09:21.558356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:21.558368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0] Write session will restart in 0.005517s
2025-10-02T08:09:21.558399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0] Write session: Do CDS request
2025-10-02T08:09:21.558406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:21.565378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:21.565526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:21.565540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 596
2025-10-02T08:09:21.565654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:21.565691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:21.565700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:21.565704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:21.566079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 596 sessionId:  describe result for acl check
2025-10-02T08:09:21.566119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:21.566121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:21.566123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:21.566130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533511719169358:7946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:21.566921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533511719169358:7946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:21.578112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533511719169358:7946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:21.578164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:21.580111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:21.580305Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:21.580308Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:21.580318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:21.580374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:21.580408Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533511719169546:7945]
2025-10-02T08:09:21.581006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:21.581189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:21.581236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:21.581515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:21.581555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.581560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.581562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.581563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.581564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.581570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.581580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.581585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.581589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.581593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.581598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.581605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.581611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.581617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.581622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.581627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.581632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.581636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.581640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.581644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.581664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:21.591470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533511719169358:7946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:21.591485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533511719169358:7946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:21.591488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533511719169358:7946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:21.591499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:21.591503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:21.593430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:21.593448Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:21.593451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:21.593456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:21.593463Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 595 [1:7556533511719169546:7945]
2025-10-02T08:09:21.593475Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:21.593496Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:21.593500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:21.593503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:21.593505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:21.593526Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:21.593537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:21.593545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:21.593604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.593611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.593614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:21.593617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:21.593689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:21.593695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.593706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.593719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:21.593737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533511719169562:7946], now have 1 active actors on pipe
2025-10-02T08:09:21.593744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533511719169529:7945]
2025-10-02T08:09:21.593746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533511719169529:7945]
2025-10-02T08:09:21.593753Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:21.593766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:21.593778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:21.593782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:21.593789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533512179409224:2378], now have 1 active actors on pipe
2025-10-02T08:09:21.593822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533511719169529:7945]
2025-10-02T08:09:21.593824Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:21.593862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 595
2025-10-02T08:09:21.593883Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:21.593885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:21.593890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:21.594562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.594569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.594603Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:21.594610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:21.594613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:21.594615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:21.594625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:21.594636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:21.594653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:21.594751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.594756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.594768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:21.594798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 596 partition: 0 MaxSeqNo: 17 sessionId: src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0
2025-10-02T08:09:21.596913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c87d6e-8ffea9eb-9c33aa37-f8866308_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:21.599949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0] Write session: try to update token
2025-10-02T08:09:21.599967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:21.594315Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 595
2025-10-02T08:09:21.621346Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:21.621363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:21.621366Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:21.621376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533511719169529:7945]
2025-10-02T08:09:21.621381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533511719169529:7945]
2025-10-02T08:09:21.621434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:21.621441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.621443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:21.621636Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:21.623270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:21.623277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:21.634825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId: src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:21.637641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:21.657692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533511719169578:7083]
2025-10-02T08:09:21.657817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 595, pipe: [1:7556533511719169578:7083]
2025-10-02T08:09:21.776386Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:21.776876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.776893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.776916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533511719169578:7083], now have 1 active actors on pipe
2025-10-02T08:09:21.777496Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:21.777835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533511719169578:7083]
2025-10-02T08:09:21.777857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:21.778427Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:21.777917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 596 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0
2025-10-02T08:09:21.778090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 596 sessionId: src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0 is DEAD
2025-10-02T08:09:21.781140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:21.781152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0] Write session will restart in 0.008421s
2025-10-02T08:09:21.781178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0] Write session: Do CDS request
2025-10-02T08:09:21.781186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:21.793112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:21.795686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:21.795706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 597
2025-10-02T08:09:21.795920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:21.795972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:21.795983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:21.795988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:21.796580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 597 sessionId:  describe result for acl check
2025-10-02T08:09:21.796633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:21.796641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:21.796643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:21.796650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533511719169617:7952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:21.797217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533511719169617:7952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:21.803631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533511719169617:7952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:21.807859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533511719169617:7952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:21.807873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533511719169617:7952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:21.807876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533511719169617:7952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:21.807885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:21.814693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:21.816223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:21.816526Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:21.816536Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:21.816548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:21.816614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:21.816657Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533511719169941:7951]
2025-10-02T08:09:21.817303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:21.817621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:21.817663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:21.817973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:21.818022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.818028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.818030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.818031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.818032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.818036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.818046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.818050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.818054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.818057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.818063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.818069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:21.818075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.818079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:21.818084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.818088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:21.818093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.818097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.818103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.818112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.818130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:21.844034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:21.846051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:21.846072Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:21.846074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:21.846078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:21.846086Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 596 [1:7556533511719169941:7951]
2025-10-02T08:09:21.846100Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:21.846121Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:21.846124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:21.846127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:21.846129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:21.846147Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:21.846159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:21.846167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:21.846246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.846254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.846258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:21.846260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:21.846339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:21.846347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.846362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:21.846376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:21.846393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533511719169935:7951]
2025-10-02T08:09:21.846401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533511719169935:7951]
2025-10-02T08:09:21.846410Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:21.846424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:21.846444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:21.846452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:21.846462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533511719169822:7952], now have 1 active actors on pipe
2025-10-02T08:09:21.846462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:21.846465Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:21.846496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533511719169935:7951]
2025-10-02T08:09:21.846504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:21.846509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533512179409232:2378], now have 1 active actors on pipe
2025-10-02T08:09:21.846560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 596
2025-10-02T08:09:21.846636Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:21.846717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.846726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.846753Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:21.846764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:21.846773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:21.846776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:21.846787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:21.846800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:21.846822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:21.846916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:21.846924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:21.846938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:21.846975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 597 partition: 0 MaxSeqNo: 17 sessionId: src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0
2025-10-02T08:09:21.847313Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 596
2025-10-02T08:09:21.848988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4093d262-1cb99ad6-cc38130a-c2f87505_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:21.853058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0] Write session: try to update token
2025-10-02T08:09:21.853083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:21.875680Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:21.875700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:21.875702Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:21.875713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533511719169935:7951]
2025-10-02T08:09:21.875719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533511719169935:7951]
2025-10-02T08:09:21.875767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:21.875775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:21.875777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:21.875966Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:21.877286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533511719169966:7083]
2025-10-02T08:09:21.877303Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:21.877309Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:21.877360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 596, pipe: [1:7556533511719169966:7083]
2025-10-02T08:09:21.883434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId: src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:21.887000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:22.034775Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:22.035380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533511719169966:7083], now have 1 active actors on pipe
2025-10-02T08:09:22.035405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.035412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.035593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:22.035607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:22.035691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 597 reason: error at write: Disconnected sessionId: src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0
2025-10-02T08:09:22.035904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 597 sessionId: src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0 is DEAD
2025-10-02T08:09:22.036106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533511719169966:7083]
2025-10-02T08:09:22.036471Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:22.036911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:22.036929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0] Write session will restart in 0.006249s
2025-10-02T08:09:22.036960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0] Write session: Do CDS request
2025-10-02T08:09:22.036973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:22.036928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:22.053269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.061335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:22.061362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 598
2025-10-02T08:09:22.062911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.062974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:22.062981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:22.062986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:22.064276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 598 sessionId:  describe result for acl check
2025-10-02T08:09:22.064326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:22.064328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:22.064330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:22.064336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533516014137436:7959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:22.064917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533516014137436:7959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:22.089176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533516014137436:7959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:22.102228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533516014137436:7959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:22.102246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533516014137436:7959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:22.102250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533516014137436:7959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:22.102259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:22.117161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:22.120284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:22.120684Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:22.120706Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:22.120725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:22.120827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:22.120878Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533516014137632:7958]
2025-10-02T08:09:22.121535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:22.121816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:22.121863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:22.122174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:22.122235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.122236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.122237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.122239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.122240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.122245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.122256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.122260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.122263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.122267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.122273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.122280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.122286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.122291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.122296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.122300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.122303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.122308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.122359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.122364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.122384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:22.136401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533516014137646:7083]
2025-10-02T08:09:22.137673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:22.140907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 597
2025-10-02T08:09:22.141513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af4621ad-44c3ff30-c47c6fb3-432e99ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:22.144720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0] Write session: try to update token
2025-10-02T08:09:22.144742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:22.139694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:22.139714Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:22.139717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:22.139722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:22.139729Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 597 [1:7556533516014137632:7958]
2025-10-02T08:09:22.139741Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:22.139761Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:22.139764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:22.139768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:22.139769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:22.139792Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:22.139797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:22.139803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:22.139883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.139885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.139888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:22.139891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:22.139963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:22.139966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.139980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.139992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:22.140010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533516014137625:7958]
2025-10-02T08:09:22.140012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533516014137625:7958]
2025-10-02T08:09:22.140021Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:22.140038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014137606:7959], now have 1 active actors on pipe
2025-10-02T08:09:22.140045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:22.140048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:22.140048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:22.140062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:22.140065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:22.140071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014137646:7083], now have 1 active actors on pipe
2025-10-02T08:09:22.140075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533516474376538:2378], now have 1 active actors on pipe
2025-10-02T08:09:22.140109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533516014137625:7958]
2025-10-02T08:09:22.140121Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:22.140131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:22.140174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 597, pipe: [1:7556533516014137646:7083]
2025-10-02T08:09:22.140187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 597
2025-10-02T08:09:22.140274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.140279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.140308Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:22.140316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:22.140320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:22.140321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:22.140331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:22.140342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:22.140362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:22.140432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.140436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.140451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:22.140488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 598 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0
2025-10-02T08:09:22.167061Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:22.167078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:22.167080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:22.167091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533516014137625:7958]
2025-10-02T08:09:22.167094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533516014137625:7958]
2025-10-02T08:09:22.167134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:22.167140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.167142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:22.167325Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:22.168331Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:22.168348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:22.178682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId: src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:22.182081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:22.313849Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:22.314329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.314336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.315011Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:22.315238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:22.315280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0
2025-10-02T08:09:22.315419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 598 sessionId: src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0 is DEAD
2025-10-02T08:09:22.315513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533516014137646:7083]
2025-10-02T08:09:22.314825Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:22.318179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:22.318189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0] Write session will restart in 0.009669s
2025-10-02T08:09:22.318215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0] Write session: Do CDS request
2025-10-02T08:09:22.318222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:22.329314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.333473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:22.333488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 599
2025-10-02T08:09:22.335380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:22.337098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:22.337297Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:22.337301Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:22.337310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:22.337352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:22.337383Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533516014138030:7976]
2025-10-02T08:09:22.337821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:22.337898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.337933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:22.337938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:22.337943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:22.338000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:22.338030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:22.338237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:22.338261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.338262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.338263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.338264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.338264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.338268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.338275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.338277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.338279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.338282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.338288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.338292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.338296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.338298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.338301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.338304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.338306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.338309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.338311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.338314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.338326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:22.338631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 599 sessionId:  describe result for acl check
2025-10-02T08:09:22.338652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:22.338653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:22.338654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:22.338657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533516014138045:7977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:22.339054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533516014138045:7977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:22.344860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533516014138045:7977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:22.350066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:22.351855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:22.351878Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:22.351881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:22.351884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:22.351891Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 598 [1:7556533516014138030:7976]
2025-10-02T08:09:22.351903Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:22.351924Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:22.351927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:22.351930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:22.351931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:22.351948Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:22.351953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:22.351959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:22.352037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.352047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.352050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:22.352053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:22.352125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:22.352133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.352146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.352163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:22.352190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533516474376568:2378], now have 1 active actors on pipe
2025-10-02T08:09:22.352202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533516014138024:7976]
2025-10-02T08:09:22.352204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533516014138024:7976]
2025-10-02T08:09:22.352213Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:22.352231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:22.352252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:22.352259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:22.352295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533516014138024:7976]
2025-10-02T08:09:22.352303Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:22.352311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:22.352313Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:22.352319Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:22.356202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 598
2025-10-02T08:09:22.357049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533516014138045:7977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:22.357064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533516014138045:7977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:22.357068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533516014138045:7977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:22.357077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:22.357888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 598
2025-10-02T08:09:22.357906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014138081:7977], now have 1 active actors on pipe
2025-10-02T08:09:22.358019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.358027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.358054Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:22.358064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:22.358072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:22.358075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:22.358087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:22.358105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:22.358125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:22.358266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.358271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.358285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:22.358315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 599 partition: 0 MaxSeqNo: 17 sessionId: src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0
2025-10-02T08:09:22.361034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e72134e-e1bcec2d-7fea30aa-c7db3ea2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:22.365576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0] Write session: try to update token
2025-10-02T08:09:22.365601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:22.372508Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:22.372529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:22.372532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:22.372540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533516014138024:7976]
2025-10-02T08:09:22.372544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533516014138024:7976]
2025-10-02T08:09:22.372580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:22.372589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:22.372591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:22.372596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.372599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:22.372736Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:22.394460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId: src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:22.397563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:22.416863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533516014138094:7083]
2025-10-02T08:09:22.416960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 598, pipe: [1:7556533516014138094:7083]
2025-10-02T08:09:22.521803Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:22.522181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.522192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.522221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014138094:7083], now have 1 active actors on pipe
2025-10-02T08:09:22.523084Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:22.523281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533516014138094:7083]
2025-10-02T08:09:22.523303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:22.523370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 599 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0
2025-10-02T08:09:22.523563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 599 sessionId: src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0 is DEAD
2025-10-02T08:09:22.524064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:22.524071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0] Write session will restart in 0.008969s
2025-10-02T08:09:22.524090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0] Write session: Do CDS request
2025-10-02T08:09:22.524100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:22.522733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:22.536556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.537284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:22.537301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 600
2025-10-02T08:09:22.537501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.537539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:22.537546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:22.537550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:22.538031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 600 sessionId:  describe result for acl check
2025-10-02T08:09:22.538062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:22.538064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:22.538065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:22.538071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533516014138333:7985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:22.538843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533516014138333:7985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:22.544154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533516014138333:7985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:22.546521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:22.548695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:22.548971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533516014138333:7985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:22.548980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533516014138333:7985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:22.548983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533516014138333:7985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:22.548992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:22.549034Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:22.549039Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:22.549049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:22.549103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:22.549142Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533516014138473:7984]
2025-10-02T08:09:22.549708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:22.550524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:22.550571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:22.550941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:22.550986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.550987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.550989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.550990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.550991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.550998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.551008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.551013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.551017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.551021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.551027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.551036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.551044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.551049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.551054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.551059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.551063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.551068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.551072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.551077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.551098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:22.564333Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 599
2025-10-02T08:09:22.565043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e81a8ebe-c433b0bc-39e57ee8-8b28c2f1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:22.561189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:22.562850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:22.562858Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:22.562861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:22.562866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:22.562875Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 599 [1:7556533516014138473:7984]
2025-10-02T08:09:22.562889Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:22.562914Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:22.562917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:22.562922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:22.562924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:22.562944Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:22.562950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:22.562959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:22.563034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.563037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.563041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:22.563044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:22.563126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:22.563129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.563143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.563156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:22.563173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533516014138467:7984]
2025-10-02T08:09:22.563176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533516014138467:7984]
2025-10-02T08:09:22.563189Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:22.563204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:22.563220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:22.563224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:22.563259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533516014138467:7984]
2025-10-02T08:09:22.563266Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:22.563573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:22.563577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:22.563584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:22.564325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 599
2025-10-02T08:09:22.564339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014138477:7985], now have 1 active actors on pipe
2025-10-02T08:09:22.564343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533516474376589:2378], now have 1 active actors on pipe
2025-10-02T08:09:22.564415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.564420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.564451Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:22.564459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:22.564464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:22.564467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:22.564479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:22.564492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:22.564511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:22.564610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.564613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.564632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:22.564664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 600 partition: 0 MaxSeqNo: 17 sessionId: src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0
2025-10-02T08:09:22.568670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0] Write session: try to update token
2025-10-02T08:09:22.568692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:22.587956Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:22.587976Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:22.587979Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:22.587993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533516014138467:7984]
2025-10-02T08:09:22.587998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533516014138467:7984]
2025-10-02T08:09:22.588043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:22.588050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.588053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:22.588213Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:22.590621Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:22.590628Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:22.596853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId: src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:22.600084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:22.625018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533516014138504:7083]
2025-10-02T08:09:22.625253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 599, pipe: [1:7556533516014138504:7083]
2025-10-02T08:09:22.748427Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:22.748896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.748910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.748955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014138504:7083], now have 1 active actors on pipe
2025-10-02T08:09:22.749379Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:22.749264Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:22.749652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:22.749717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 600 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0
2025-10-02T08:09:22.749917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 600 sessionId: src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0 is DEAD
2025-10-02T08:09:22.750086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533516014138504:7083]
2025-10-02T08:09:22.753665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:22.753678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0] Write session will restart in 0.006930s
2025-10-02T08:09:22.753709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0] Write session: Do CDS request
2025-10-02T08:09:22.753717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:22.764008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.764574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:22.764597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 601
2025-10-02T08:09:22.764715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.764749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:22.764760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:22.764764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:22.769078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 601 sessionId:  describe result for acl check
2025-10-02T08:09:22.769135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:22.769137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:22.769139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:22.769146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533516014138676:7991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:22.769779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533516014138676:7991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:22.777701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533516014138676:7991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:22.781682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:22.782915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:22.783138Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:22.783149Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:22.783160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:22.783225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:22.783269Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533516014138869:7990]
2025-10-02T08:09:22.783348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533516014138676:7991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:22.783364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533516014138676:7991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:22.783368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533516014138676:7991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:22.783378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:22.783954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:22.784520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:22.784578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:22.784980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:22.785053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.785054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.785056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.785057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.785058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.785064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.785075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.785080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.785084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.785088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.785095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.785103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:22.785109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.785116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:22.785122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.785128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:22.785132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.785138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.785143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.785148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.785169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:22.798237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:22.800487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:22.800508Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:22.800511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:22.800514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:22.800522Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 600 [1:7556533516014138869:7990]
2025-10-02T08:09:22.800534Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:22.800553Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:22.800556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:22.800560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:22.800562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:22.800579Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:22.800585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:22.800591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:22.800665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.800674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.800678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:22.800680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:22.800974Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 600
2025-10-02T08:09:22.800756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:22.800767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.800781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:22.800795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:22.800864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 600
2025-10-02T08:09:22.801296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533516014138863:7990]
2025-10-02T08:09:22.801305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533516014138863:7990]
2025-10-02T08:09:22.801321Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:22.801338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014138874:7991], now have 1 active actors on pipe
2025-10-02T08:09:22.801343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533516474376596:2378], now have 1 active actors on pipe
2025-10-02T08:09:22.801345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:22.801348Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:22.801349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.801354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.801386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:22.801409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:22.801417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:22.801488Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:22.801502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:22.801507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:22.801509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:22.801519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:22.801535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:22.801548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533516014138863:7990]
2025-10-02T08:09:22.801563Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:22.801602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:22.801711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.801723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.801755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:22.801793Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:22.801805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 601 partition: 0 MaxSeqNo: 17 sessionId: src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0
2025-10-02T08:09:22.802175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e351a45b-f60d5a65-77941d46-5a4d31bd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:22.805591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0] Write session: try to update token
2025-10-02T08:09:22.805611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:22.825098Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:22.825115Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:22.825117Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:22.825127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533516014138863:7990]
2025-10-02T08:09:22.825132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533516014138863:7990]
2025-10-02T08:09:22.825175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:22.825182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:22.825184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:22.825186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:22.825195Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:22.825359Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:22.826944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId: src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:22.830601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:22.849107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533516014138900:7083]
2025-10-02T08:09:22.849322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 600, pipe: [1:7556533516014138900:7083]
2025-10-02T08:09:22.971825Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:22.972170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:22.972183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:22.972240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014138900:7083], now have 1 active actors on pipe
2025-10-02T08:09:22.972833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533516014138900:7083]
2025-10-02T08:09:22.972864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:22.972866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:22.973088Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:22.972927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 601 reason: error at write: Disconnected sessionId: src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0
2025-10-02T08:09:22.973114Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:22.973116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 601 sessionId: src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0 is DEAD
2025-10-02T08:09:22.975250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:22.975263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0] Write session will restart in 0.007158s
2025-10-02T08:09:22.975289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0] Write session: Do CDS request
2025-10-02T08:09:22.975295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:22.984890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.984893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:22.984910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 602
2025-10-02T08:09:22.985253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:22.985289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:22.985294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:22.985298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:22.989436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 602 sessionId:  describe result for acl check
2025-10-02T08:09:22.989478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:22.989480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:22.989482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:22.989487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533516014138921:7998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:22.990092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533516014138921:7998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:22.993388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533516014138921:7998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:22.999585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533516014138921:7998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:22.999617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533516014138921:7998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:22.999620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533516014138921:7998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:22.999629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:23.013596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:23.018521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:23.018796Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:23.018810Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:23.018822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:23.018888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:23.018940Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533520309106571:7997]
2025-10-02T08:09:23.019648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:23.019928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:23.019980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:23.020318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:23.020365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.020373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.020375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.020376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.020378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.020384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.020395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.020400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.020404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.020408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.020413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.020421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.020428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.020434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.020439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.020444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.020449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.020455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.020460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.020465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.020486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:23.032757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:23.035011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:23.035033Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:23.035036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:23.035040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:23.035047Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 601 [1:7556533520309106571:7997]
2025-10-02T08:09:23.035058Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:23.035076Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:23.035079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.035082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.035084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.035100Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:23.035104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:23.035111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:23.035189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.035199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.035202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:23.035204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:23.035278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:23.035286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.035301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.035319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:23.035342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533520309106565:7997]
2025-10-02T08:09:23.035349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533520309106565:7997]
2025-10-02T08:09:23.035360Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:23.035378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:23.036490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 601
2025-10-02T08:09:23.035399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:23.035409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:23.035446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533520309106565:7997]
2025-10-02T08:09:23.035449Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:23.035661Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:23.035665Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:23.035671Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:23.035855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 601
2025-10-02T08:09:23.035871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533516014139170:7998], now have 1 active actors on pipe
2025-10-02T08:09:23.035876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533516474376606:2378], now have 1 active actors on pipe
2025-10-02T08:09:23.035892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.035899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.035926Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:23.035935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.035939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.035942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:23.035964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.035977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:23.035994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:23.036037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.036040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.036052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:23.036085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 602 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0
2025-10-02T08:09:23.037348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1689ce4d-97291a5-ffa5b12f-455b3ee2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:23.040709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0] Write session: try to update token
2025-10-02T08:09:23.040735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:23.065081Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:23.065099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:23.065101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:23.065111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533520309106565:7997]
2025-10-02T08:09:23.065116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533520309106565:7997]
2025-10-02T08:09:23.065160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:23.065169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.065172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:23.065364Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:23.068789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:23.068813Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:23.076256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId: src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:23.079171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:23.079235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533520309106595:7083]
2025-10-02T08:09:23.079561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 601, pipe: [1:7556533520309106595:7083]
2025-10-02T08:09:23.237762Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:23.238039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.238047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.238070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533520309106595:7083], now have 1 active actors on pipe
2025-10-02T08:09:23.241514Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:23.241876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533520309106595:7083]
2025-10-02T08:09:23.241896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:23.241957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 602 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0
2025-10-02T08:09:23.242146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 602 sessionId: src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0 is DEAD
2025-10-02T08:09:23.243115Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533425819796630:7080] disconnected; active server actors: 1
2025-10-02T08:09:23.243132Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533425819796630:7080] client user disconnected session shared/user_1_6_8771659216780997938_v1
2025-10-02T08:09:23.243157Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:23.242269Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:09:23.242386Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 6 consumer shared/user session shared/user_1_6_8771659216780997938_v1 is DEAD
2025-10-02T08:09:23.245127Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:09:23.245322Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:09:23.245333Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:09:23.245344Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.009685s
2025-10-02T08:09:23.247573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:23.247585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0] Write session will restart in 0.009368s
2025-10-02T08:09:23.247623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0] Write session: Do CDS request
2025-10-02T08:09:23.247630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:23.257176Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:09:23.261351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:23.265569Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:09:23.265583Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 7
2025-10-02T08:09:23.265614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:23.265617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 603
2025-10-02T08:09:23.266504Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:09:23.266564Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:09:23.266663Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 auth for : user
2025-10-02T08:09:23.266685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:23.266707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:23.266712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:23.266714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:23.273628Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 Handle describe topics response
2025-10-02T08:09:23.273673Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 auth is DEAD
2025-10-02T08:09:23.273694Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:09:23.274083Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:09:23.274389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 603 sessionId:  describe result for acl check
2025-10-02T08:09:23.274410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:23.274411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:23.274413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:23.274418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533520309106853:8011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:23.275040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533520309106853:8011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:23.275937Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533520309106847:8010] connected; active server actors: 1
2025-10-02T08:09:23.276865Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533520309106847:8010] session shared/user_1_7_13606406994983615898_v1
2025-10-02T08:09:23.276896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:09:23.276913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:09:23.276921Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_7_13606406994983615898_v1" (Sender=[1:7556533520309106815:8010], Pipe=[1:7556533520309106847:8010], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:09:23.276926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:09:23.276950Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:09:23.276962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_7_13606406994983615898_v1" (Sender=[1:7556533520309106815:8010], Pipe=[1:7556533520309106847:8010], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:09:23.276984Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_7_13606406994983615898_v1" sender [1:7556533520309106815:8010] lock partition 0 for ReadingSession "shared/user_1_7_13606406994983615898_v1" (Sender=[1:7556533520309106815:8010], Pipe=[1:7556533520309106847:8010], Partitions=[], ActiveFamilyCount=1) generation 1 step 7
2025-10-02T08:09:23.276998Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:09:23.277004Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000051s
2025-10-02T08:09:23.280912Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_7_13606406994983615898_v1
2025-10-02T08:09:23.280934Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:09:23.281092Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:09:23.281420Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_7_13606406994983615898_v1" ClientId: "user" PipeClient { RawX1: 7556533520309106847 RawX2: 4503603922345802 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:09:23.281457Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:09:23.281549Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 got read request: guid# 6eaf5fdd-7e986f0c-c2046bf1-c8d8d76d
2025-10-02T08:09:23.281573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:09:23.297792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533520309106853:8011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:23.302783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:23.313277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:23.313518Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:23.313522Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:23.313532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:23.313586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:23.313628Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533520309106981:8003]
2025-10-02T08:09:23.314257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:23.315316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:23.315365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:23.315705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:23.315754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.315755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.315756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.315757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.315757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.315764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.315774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.315778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.315781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.315785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.315789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.315796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.315802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.315806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.315810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.315815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.315818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.315823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.315827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.315831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.315854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:23.329405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:23.330462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533520309106853:8011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:23.330479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533520309106853:8011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:23.330482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533520309106853:8011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:23.330491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:23.331302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:23.331317Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:23.331320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:23.331324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:23.331329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 602 [1:7556533520309106981:8003]
2025-10-02T08:09:23.331340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:23.331358Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:23.331360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.331364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.331365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.331382Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:23.331387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:23.331394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:23.331460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.331463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.331465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:23.331468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:23.331536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:23.331539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.331553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.331565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:23.331582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533520309106969:8003]
2025-10-02T08:09:23.331584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533520309106969:8003]
2025-10-02T08:09:23.331592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:23.331620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:23.331633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:23.331637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:23.331672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533520309106969:8003]
2025-10-02T08:09:23.331675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:23.332895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 602
2025-10-02T08:09:23.331973Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:23.331979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:23.331985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:23.332397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533520309107004:8011], now have 1 active actors on pipe
2025-10-02T08:09:23.332401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533520309106918:8017], now have 1 active actors on pipe
2025-10-02T08:09:23.332403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533520769343908:2378], now have 1 active actors on pipe
2025-10-02T08:09:23.332436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 602, pipe: [1:7556533520309106918:8017]
2025-10-02T08:09:23.332625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.332629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.332645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_7_13606406994983615898_v1 on pipe: [1:7556533520309106918:8017]
2025-10-02T08:09:23.332663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.332669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.332670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:23.332686Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_7_13606406994983615898_v1
2025-10-02T08:09:23.332688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.332710Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:23.332947Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_7_13606406994983615898_v1:1 with generation 602
2025-10-02T08:09:23.332983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 602
2025-10-02T08:09:23.333314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.333319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.333345Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:23.333352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:09:23.336445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:09:23.336476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:09:23.336484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.336488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.336490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:23.336500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.336512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:23.336519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:09:23.336532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:09:23.336543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:23.336769Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392563328 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:09:23.336780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:09:23.336854Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 sending to client partition status
2025-10-02T08:09:23.336939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.336945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.336966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:23.337067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 603 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0
2025-10-02T08:09:23.337400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccc86c3-d3b0d8d1-eeff0217-1cb0a9bc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:23.340723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0] Write session: try to update token
2025-10-02T08:09:23.340743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:23.363815Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:23.363834Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:23.363837Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:23.363847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533520309106969:8003]
2025-10-02T08:09:23.363851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533520309106969:8003]
2025-10-02T08:09:23.363907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:23.363914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.363917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:23.363949Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:23.363960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:23.364096Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:23.364937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId: src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:23.367872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:23.516086Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:23.516629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.516639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.516813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:23.516815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:23.516868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 603 reason: error at write: Disconnected sessionId: src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0
2025-10-02T08:09:23.516966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_7_13606406994983615898_v1
2025-10-02T08:09:23.516985Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:23.517049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 603 sessionId: src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0 is DEAD
2025-10-02T08:09:23.517179Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_7_13606406994983615898_v1
2025-10-02T08:09:23.517200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:23.517211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0] Write session will restart in 0.009138s
2025-10-02T08:09:23.517247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0] Write session: Do CDS request
2025-10-02T08:09:23.517253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:23.517216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533520309106918:8017]
2025-10-02T08:09:23.520888Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:23.528258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:23.528773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:23.528788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 604
2025-10-02T08:09:23.528959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:23.528996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:23.529018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:23.529029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:23.529522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 604 sessionId:  describe result for acl check
2025-10-02T08:09:23.529565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:23.529567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:23.529568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:23.529573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533520309107358:8028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:23.530060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533520309107358:8028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:23.532240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:23.534161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:23.534406Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:23.534417Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:23.534428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:23.534499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:23.534545Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533520309107422:8027]
2025-10-02T08:09:23.535100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533520309107358:8028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:23.535190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:23.535419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:23.535472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:23.535812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:23.535867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.535873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.535875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.535876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.535877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.535883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.535892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.535896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.535899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.535902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.535908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.535915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.535926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.535932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.535941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.535947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.535951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.535956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.535961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.535966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.535988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:23.540467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533520309107358:8028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:23.540482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533520309107358:8028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:23.540486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533520309107358:8028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:23.540495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:23.544978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:23.546616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:23.546631Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:23.546633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:23.546637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:23.546646Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 603 [1:7556533520309107422:8027]
2025-10-02T08:09:23.546658Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:23.546678Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:23.546681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.546684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.546686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.546701Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:23.546713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:23.546721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:23.546789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.546796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.546799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:23.546802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:23.546875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:23.546882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.546894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.546905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:23.546918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 603
2025-10-02T08:09:23.546924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533520309107449:8028], now have 1 active actors on pipe
2025-10-02T08:09:23.546930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533520309107403:8027]
2025-10-02T08:09:23.546933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533520309107403:8027]
2025-10-02T08:09:23.546945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:23.546955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533520769343953:2378], now have 1 active actors on pipe
2025-10-02T08:09:23.546956Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:23.546959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:23.546960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.546981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.546999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:23.547016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:23.547023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:23.547001Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 603
2025-10-02T08:09:23.547065Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:23.547075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.547079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.547081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:23.547089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.547099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:23.547111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533520309107403:8027]
2025-10-02T08:09:23.547119Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:23.547146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:23.547154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:23.547241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.547247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.547259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:23.547287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 604 partition: 0 MaxSeqNo: 17 sessionId: src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0
2025-10-02T08:09:23.547764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ebe831e-77e211cd-76501d26-4fa22fa2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:23.550860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0] Write session: try to update token
2025-10-02T08:09:23.550887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:23.558798Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:23.558815Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:23.558824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533520309107403:8027]
2025-10-02T08:09:23.558867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:23.558870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:23.559043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:23.559203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:23.559353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:23.559504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:23.559716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:23.559759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:23.569558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId: src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:23.572530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:23.572638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.572652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.572685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:23.572710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:23.572753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.572770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.572965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.573045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.573203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.573284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.573650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.573663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.573753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.573837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.574036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.574128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.574188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.574195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.574274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.574340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.574413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.574490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.574541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.574549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.574625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.574703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.574773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.574845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.574894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.574901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.574968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.575033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.575110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.575183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.575246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.575253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.575325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.575389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.575456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.575529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.575575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.575582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.575669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.575739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.575812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.575896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.575947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.575954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.576029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.576095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.576164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.576235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.576279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.576286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.576358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.576418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.576482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.576551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.576602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.576609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.576680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.576745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.576827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.576895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.576959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.576966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.577038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:23.577110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.577131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.577135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:23.577169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:23.577188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:23.577192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:23.577194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:23.577197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:23.577622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:23.577653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:23.577665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:23.577669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:23.577672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:23.577674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:23.578283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:23.578309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:23.578317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:23.578326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:23.578329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:23.578333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:23.578936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:23.578968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:23.578975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:23.578978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:23.578981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:23.581598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:23.581624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:23.581638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392563581
2025-10-02T08:09:23.581799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:23.581818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:23.581825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:23.581830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:23.581834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:23.581841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:23.582371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:23.582401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:23.582407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:23.582411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:23.582415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:23.582419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:23.582904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:23.582927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:23.582944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:23.582952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:23.582958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:23.582961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:23.583512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:23.583535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:23.583545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:23.584726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:23.584744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:23.584750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:23.584753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:23.584761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392563584
2025-10-02T08:09:23.585099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:23.585121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:23.585131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:23.585140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:23.585143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:23.585150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:23.585633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:23.585661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:23.585667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:23.585673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:23.585676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:23.585679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:23.586156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:23.586180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.586284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392563585
2025-10-02T08:09:23.588832Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:23.588859Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:23.588866Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:23.588873Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:23.588885Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:23.588892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:23.588894Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:23.588903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533520309107403:8027]
2025-10-02T08:09:23.588907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533520309107403:8027]
2025-10-02T08:09:23.588961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:23.588974Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:23.588984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:23.588989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.588991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:23.589121Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:23.617174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533520309107464:8017]
2025-10-02T08:09:23.617286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 603, pipe: [1:7556533520309107464:8017]
2025-10-02T08:09:23.738583Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:23.739242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533520309107464:8017], now have 1 active actors on pipe
2025-10-02T08:09:23.739479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:23.739492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:23.739493Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:23.739530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 604 reason: error at write: Disconnected sessionId: src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0
2025-10-02T08:09:23.739772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 604 sessionId: src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0 is DEAD
2025-10-02T08:09:23.739861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533520309107464:8017]
2025-10-02T08:09:23.740179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:23.740196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0] Write session will restart in 0.008677s
2025-10-02T08:09:23.740230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0] Write session: Do CDS request
2025-10-02T08:09:23.740238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:23.741177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:23.747046Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [c4b24ea6356a9530] Result# TEvPutResult {Id# [72075186224037892:603:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:23.747126Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:603:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:23.747175Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:603:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:23.750693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:23.755522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:23.755538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 605
2025-10-02T08:09:23.756003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:23.756037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:23.756043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:23.756046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:23.756660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 605 sessionId:  describe result for acl check
2025-10-02T08:09:23.756696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:23.756703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:23.756705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:23.756711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533520309107673:8034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:23.757390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533520309107673:8034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:23.761330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533520309107673:8034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:23.771878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533520309107673:8034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:23.771895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533520309107673:8034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:23.771898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533520309107673:8034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:23.771908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:23.782492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:23.784420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:23.784659Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:23.784670Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:23.784691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:23.784749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:23.784791Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533520309107846:8033]
2025-10-02T08:09:23.785505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:23.785740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:23.785789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:23.786129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:23.786198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.786204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.786206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.786207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.786209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.786214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.786223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.786227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.786230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.786234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.786239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.786247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:23.786252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.786258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:23.786267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.786273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:23.786282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.786287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.786291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.786301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.786320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:23.795159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:23.797237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:23.797252Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:23.797255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:23.797259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:23.797265Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 604 [1:7556533520309107846:8033]
2025-10-02T08:09:23.797278Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:23.797295Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:23.797298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.797302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.797304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.797321Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:23.797327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:23.797333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:23.797406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.797414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.797418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:23.797421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:23.797489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:23.797499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.797513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:23.797523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:23.797533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 604
2025-10-02T08:09:23.797546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533520309107762:8034], now have 1 active actors on pipe
2025-10-02T08:09:23.797552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533520309107840:8033]
2025-10-02T08:09:23.797560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533520309107840:8033]
2025-10-02T08:09:23.797575Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:23.797596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533520769343958:2378], now have 1 active actors on pipe
2025-10-02T08:09:23.797602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.797608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.797633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:23.797656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:23.797664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:23.797649Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 604
2025-10-02T08:09:23.797673Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:23.797685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:23.797715Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:23.797731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.797741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.797743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:23.797753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.797770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:23.797789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533520309107840:8033]
2025-10-02T08:09:23.797804Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:23.797816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:23.797851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:23.797932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.797942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.797961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:23.798008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 605 partition: 0 MaxSeqNo: 17 sessionId: src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0
2025-10-02T08:09:23.798448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd0ee19-6006ed8f-ef374235-c1c0436d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:23.801639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0] Write session: try to update token
2025-10-02T08:09:23.801667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:23.828842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId: src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:23.832385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:23.832693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.832709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.832747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:23.832779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:23.832919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:23.832938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:23.833134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.833206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.833298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.833386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.833447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.833451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.833544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.833622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.833712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.833791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.833850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.833854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.833944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.834015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.834095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.834168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.834217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.834220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.834406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.834491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.834582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.834664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.834721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.834729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.834815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.834903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.835024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.835103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.835157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.835164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.835245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.835322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.835406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.835485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.835540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.835548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.835644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.835720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.835797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.835878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.835936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.835943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.836023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.836099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.836174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.836252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.836303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.836311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.836394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.836476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.836558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.836639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.836693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.836703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.836786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:23.836887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:23.836966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:23.837040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:23.837093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:23.837096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:23.837167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:23.837236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:23.837255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:23.837258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:23.837293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:23.837307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:23.837310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:23.837313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:23.837316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:23.837797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:23.837815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:23.837821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:23.837825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:23.837830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:23.837833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:23.838441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:23.838461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:23.838467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:23.838488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:23.838491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:23.838494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:23.839297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:23.839313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:23.839319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:23.839323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:23.839326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:23.839818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533520309107870:8017]
2025-10-02T08:09:23.840041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 604, pipe: [1:7556533520309107870:8017]
2025-10-02T08:09:23.843861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:23.843896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:23.843915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392563843
2025-10-02T08:09:23.844216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:23.844231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:23.844240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:23.844245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:23.844249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:23.844255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:23.844778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:23.844792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:23.844798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:23.845962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:23.845974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:23.845979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:23.846577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:23.846594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:23.846602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:23.846606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:23.846611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:23.846616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:23.847207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:23.847220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:23.847225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:23.848424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:23.848431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:23.848436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:23.848439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:23.848447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392563845
2025-10-02T08:09:23.848740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:23.848749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:23.848755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:23.848758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:23.848761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:23.848767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:23.849333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:23.849364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:23.849370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:23.849373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:23.849377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:23.849381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:23.849946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:23.849958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:23.850072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392563848
2025-10-02T08:09:23.855997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533520309107870:8017], now have 1 active actors on pipe
2025-10-02T08:09:23.856022Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:23.856043Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:23.856050Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:23.856057Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:23.856086Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:23.856093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:23.856095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:23.856102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533520309107840:8033]
2025-10-02T08:09:23.856106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533520309107840:8033]
2025-10-02T08:09:23.860935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:23.860955Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:23.862534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:23.862552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:23.862554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:23.862697Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:24.010361Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:24.010698Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:24.010708Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:24.010715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533520309107840:8033]
2025-10-02T08:09:24.010765Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:24.010873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:24.010883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:24.010914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 605 reason: error at write: Disconnected sessionId: src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0
2025-10-02T08:09:24.010957Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:24.011132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 605 sessionId: src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0 is DEAD
2025-10-02T08:09:24.011292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533520309107870:8017]
2025-10-02T08:09:24.011780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:24.011796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0] Write session will restart in 0.006956s
2025-10-02T08:09:24.011827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0] Write session: Do CDS request
2025-10-02T08:09:24.011835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:24.012999Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:24.015859Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [cb50c2c63c5550e7] Result# TEvPutResult {Id# [72075186224037892:604:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:24.015931Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:604:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:24.016000Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:604:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:24.022390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.025205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:24.025219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 606
2025-10-02T08:09:24.025364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.025405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:24.025410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:24.025414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:24.025809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 606 sessionId:  describe result for acl check
2025-10-02T08:09:24.025845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:24.025851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:24.025853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:24.025858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533524604075440:8041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:24.026415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533524604075440:8041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:24.029337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533524604075440:8041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:24.033163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:24.033601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:24.033791Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:24.033795Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:24.033807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:24.033862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:24.033902Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533524604075547:8040]
2025-10-02T08:09:24.034361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533524604075440:8041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:24.034370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533524604075440:8041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:24.034374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533524604075440:8041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:24.034383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:24.034508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:24.034733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:24.034774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:24.035122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:24.035169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.035171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.035172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.035174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.035175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.035182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.035194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.035199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.035203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.035208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.035214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.035223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.035230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.035235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.035240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.035246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.035251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.035257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.035264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.035270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.035292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:24.046074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:24.048027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:24.048042Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:24.048046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:24.048049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:24.048056Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 605 [1:7556533524604075547:8040]
2025-10-02T08:09:24.048069Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:24.048090Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:24.048093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:24.048097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:24.048100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:24.048117Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:24.048123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:24.048129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:24.048208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.048210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.048213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:24.048216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:24.048286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:24.048288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.048305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.048317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:24.048335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533524604075541:8040]
2025-10-02T08:09:24.048337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533524604075541:8040]
2025-10-02T08:09:24.048350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:24.048363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:24.048378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:24.048381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:24.048417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533524604075541:8040]
2025-10-02T08:09:24.048420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:24.048566Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:24.048569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:24.048575Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:24.048701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 605
2025-10-02T08:09:24.048719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604075552:8041], now have 1 active actors on pipe
2025-10-02T08:09:24.048756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533525064311264:2378], now have 1 active actors on pipe
2025-10-02T08:09:24.048764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.048770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.048798Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:24.048818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:24.048822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:24.048825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:24.048838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:24.048850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:24.048875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:24.048984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.048987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.049000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:24.049034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 606 partition: 0 MaxSeqNo: 17 sessionId: src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0
2025-10-02T08:09:24.049292Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 605
2025-10-02T08:09:24.053401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b97c1402-5a5b27b-7e948bd7-c4c213d3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:24.057105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0] Write session: try to update token
2025-10-02T08:09:24.057137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:24.071131Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:24.071150Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:24.071152Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:24.071161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533524604075541:8040]
2025-10-02T08:09:24.071166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533524604075541:8040]
2025-10-02T08:09:24.071210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:24.071217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.071219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:24.071248Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:24.071254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:24.071376Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:24.088254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId: src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:24.094091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:24.114516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533524604075577:8017]
2025-10-02T08:09:24.114721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 605, pipe: [1:7556533524604075577:8017]
2025-10-02T08:09:24.227402Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:24.227973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.227983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.228005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604075577:8017], now have 1 active actors on pipe
2025-10-02T08:09:24.229235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:24.229244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:24.229308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 606 reason: error at write: Disconnected sessionId: src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0
2025-10-02T08:09:24.229499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 606 sessionId: src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0 is DEAD
2025-10-02T08:09:24.229651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533524604075577:8017]
2025-10-02T08:09:24.230519Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:24.228648Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:24.233160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:24.233175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0] Write session will restart in 0.008181s
2025-10-02T08:09:24.233208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0] Write session: Do CDS request
2025-10-02T08:09:24.233216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:24.245646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.245985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:24.246001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 607
2025-10-02T08:09:24.246123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.246147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:24.246151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:24.246155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:24.246890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 607 sessionId:  describe result for acl check
2025-10-02T08:09:24.246927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:24.246928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:24.246930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:24.246936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533524604075833:8047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:24.247527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533524604075833:8047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:24.258146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:24.259672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533524604075833:8047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:24.263070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:24.263313Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:24.263323Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:24.263333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:24.263391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:24.263425Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533524604075947:8046]
2025-10-02T08:09:24.264054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:24.264667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:24.264727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:24.265095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:24.265144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.265145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.265147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.265148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.265149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.265155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.265164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.265168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.265171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.265174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.265181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.265188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.265195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.265200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.265205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.265210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.265217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.265221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.265225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.265230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.265248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:24.278342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:24.278356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533524604075833:8047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:24.278368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533524604075833:8047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:24.278372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533524604075833:8047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:24.278382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:24.279984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:24.279999Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:24.280002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:24.280007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:24.280014Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 606 [1:7556533524604075947:8046]
2025-10-02T08:09:24.280026Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:24.280047Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:24.280049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:24.280053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:24.280055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:24.280073Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:24.280079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:24.280086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:24.280140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.280141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.280143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:24.280145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:24.280200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:24.280202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.280212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.280219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:24.280235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533524604075933:8046]
2025-10-02T08:09:24.280236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533524604075933:8046]
2025-10-02T08:09:24.280242Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:24.280251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:24.280260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:24.280262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:24.280294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533524604075933:8046]
2025-10-02T08:09:24.280296Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:24.280422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:24.280431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:24.280438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:24.280609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 606
2025-10-02T08:09:24.280618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604075969:8047], now have 1 active actors on pipe
2025-10-02T08:09:24.280635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533525064311270:2378], now have 1 active actors on pipe
2025-10-02T08:09:24.280639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.280642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.280663Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:24.280671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:24.280675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:24.280677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:24.280686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:24.280694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:24.280709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:24.280922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.280924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.280934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:24.280961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 607 partition: 0 MaxSeqNo: 17 sessionId: src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0
2025-10-02T08:09:24.281035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 606
2025-10-02T08:09:24.281387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbde491-26cf1b4e-a0521274-4c11b86c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:24.285219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0] Write session: try to update token
2025-10-02T08:09:24.285239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:24.316116Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:24.316138Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:24.316140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:24.316148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533524604075933:8046]
2025-10-02T08:09:24.316153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533524604075933:8046]
2025-10-02T08:09:24.316197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:24.316203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.316206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:24.316367Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:24.317604Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:24.317611Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:24.327724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId: src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:24.331038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:24.333884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533524604075984:8017]
2025-10-02T08:09:24.334356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 606, pipe: [1:7556533524604075984:8017]
2025-10-02T08:09:24.470873Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:24.471319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.471327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.471350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604075984:8017], now have 1 active actors on pipe
2025-10-02T08:09:24.471533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533524604075984:8017]
2025-10-02T08:09:24.471555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:24.471557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:24.471630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 607 reason: error at write: Disconnected sessionId: src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0
2025-10-02T08:09:24.471801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 607 sessionId: src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0 is DEAD
2025-10-02T08:09:24.471860Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:24.472683Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:24.472765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:24.472780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0] Write session will restart in 0.005283s
2025-10-02T08:09:24.472845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0] Write session: Do CDS request
2025-10-02T08:09:24.472852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:24.481419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.482778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:24.482793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 608
2025-10-02T08:09:24.483256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.483282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:24.483285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:24.483288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:24.484072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 608 sessionId:  describe result for acl check
2025-10-02T08:09:24.484092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:24.484093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:24.484094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:24.484098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533524604076058:8069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:24.484892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533524604076058:8069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:24.487237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533524604076058:8069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:24.491021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533524604076058:8069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:24.491039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533524604076058:8069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:24.491044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533524604076058:8069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:24.491052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:24.505396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:24.509372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:24.509644Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:24.509648Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:24.509662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:24.509726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:24.509771Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533524604076427:8067]
2025-10-02T08:09:24.510682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:24.511074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:24.511129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:24.511519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:24.511580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.511582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.511583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.511585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.511586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.511593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.511618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.511623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.511627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.511632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.511638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.511648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.511655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.511661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.511666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.511672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.511676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.511683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.511689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.511694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.511715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:24.526337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:24.528161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:24.528184Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:24.528187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:24.528191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:24.528198Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 607 [1:7556533524604076427:8067]
2025-10-02T08:09:24.528213Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:24.528235Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:24.528238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:24.528242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:24.528245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:24.528266Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:24.528272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:24.528280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:24.528355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.528357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.528361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:24.528364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:24.528443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:24.528453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.528468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.528475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 607
2025-10-02T08:09:24.528486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:24.528513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604076115:8069], now have 1 active actors on pipe
2025-10-02T08:09:24.528521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533525064311313:2378], now have 1 active actors on pipe
2025-10-02T08:09:24.528528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.528532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.528557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533524604076421:8067]
2025-10-02T08:09:24.528565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533524604076421:8067]
2025-10-02T08:09:24.528573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:24.528593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:24.528616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:24.528624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:24.528642Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:24.528654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:24.528595Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 607
2025-10-02T08:09:24.533420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9602e0ab-d08592db-715fb6f9-f55d2f25_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:24.528658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:24.528670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:24.528681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:24.528687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:24.528691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:24.528692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:24.528734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533524604076421:8067]
2025-10-02T08:09:24.528741Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:24.528745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:24.528756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:24.529415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.529421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.529456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:24.529497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 608 partition: 0 MaxSeqNo: 17 sessionId: src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0
2025-10-02T08:09:24.536629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0] Write session: try to update token
2025-10-02T08:09:24.536647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:24.554899Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:24.554918Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:24.554920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:24.554927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533524604076421:8067]
2025-10-02T08:09:24.554932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533524604076421:8067]
2025-10-02T08:09:24.554984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:24.554986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:24.554993Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:24.554994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.554997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:24.555179Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:24.572212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533524604076453:8017]
2025-10-02T08:09:24.572411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 607, pipe: [1:7556533524604076453:8017]
2025-10-02T08:09:24.572698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId: src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:24.575578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:24.703141Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:24.703717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604076453:8017], now have 1 active actors on pipe
2025-10-02T08:09:24.703738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.703745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.703896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533524604076453:8017]
2025-10-02T08:09:24.703921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:24.703923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:24.703982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 608 reason: error at write: Disconnected sessionId: src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0
2025-10-02T08:09:24.703996Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:24.704007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:24.704160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 608 sessionId: src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0 is DEAD
2025-10-02T08:09:24.704373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:24.704389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0] Write session will restart in 0.006565s
2025-10-02T08:09:24.704421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0] Write session: Do CDS request
2025-10-02T08:09:24.704428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:24.712514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.712526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:24.712542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 609
2025-10-02T08:09:24.712834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.712867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:24.712872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:24.712876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:24.713263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 609 sessionId:  describe result for acl check
2025-10-02T08:09:24.713298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:24.713304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:24.713306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:24.713311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533524604076712:8075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:24.713842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533524604076712:8075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:24.717519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533524604076712:8075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:24.717763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:24.719416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:24.719617Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:24.719628Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:24.719638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:24.719690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:24.719747Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533524604076832:8074]
2025-10-02T08:09:24.720314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:24.720435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533524604076712:8075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:24.720450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533524604076712:8075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:24.720454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533524604076712:8075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:24.720463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:24.720522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:24.720562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:24.720875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:24.720929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.720935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.720936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.720937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.720938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.720944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.720954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.720958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.720962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.720965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.720971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.720977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.720983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.720988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.720993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.720998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.721003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.721008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.721012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.721018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.721036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:24.730557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:24.732683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:24.732704Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:24.732707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:24.732711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:24.732718Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 608 [1:7556533524604076832:8074]
2025-10-02T08:09:24.732732Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:24.732753Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:24.732757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:24.732759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:24.732762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:24.732781Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:24.732787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:24.732794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:24.732892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.732894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.732898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:24.732900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:24.732978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:24.732990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.733005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.733016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:24.733034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533524604076817:8074]
2025-10-02T08:09:24.733042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533524604076817:8074]
2025-10-02T08:09:24.733057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:24.733076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:24.733093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:24.733102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:24.733140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533524604076817:8074]
2025-10-02T08:09:24.733140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:24.733144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:24.733148Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:24.733151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:24.733219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 608
2025-10-02T08:09:24.733231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604076841:8075], now have 1 active actors on pipe
2025-10-02T08:09:24.733284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.733295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.733312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533525064311321:2378], now have 1 active actors on pipe
2025-10-02T08:09:24.733329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:24.733338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:24.733342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:24.733344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:24.733355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:24.733367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:24.733381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:24.733483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.733492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.733508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:24.733550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 609 partition: 0 MaxSeqNo: 17 sessionId: src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0
2025-10-02T08:09:24.734284Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 608
2025-10-02T08:09:24.734516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a7603f-ebb9b79b-8b98cde5-883f999e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:24.738078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0] Write session: try to update token
2025-10-02T08:09:24.738099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:24.753885Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:24.753910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:24.753913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:24.753923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533524604076817:8074]
2025-10-02T08:09:24.753933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533524604076817:8074]
2025-10-02T08:09:24.753983Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:24.753986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:24.753990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:24.753994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.753997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:24.754187Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:24.755468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId: src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:24.758501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:24.804020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533524604076864:8017]
2025-10-02T08:09:24.804178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 608, pipe: [1:7556533524604076864:8017]
2025-10-02T08:09:24.954778Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:24.953921Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:24.954486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:24.954496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:24.954531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604076864:8017], now have 1 active actors on pipe
2025-10-02T08:09:24.954702Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:24.955008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:24.955057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 609 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0
2025-10-02T08:09:24.955232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 609 sessionId: src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0 is DEAD
2025-10-02T08:09:24.955408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533524604076864:8017]
2025-10-02T08:09:24.956948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:24.956963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0] Write session will restart in 0.005770s
2025-10-02T08:09:24.957005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0] Write session: Do CDS request
2025-10-02T08:09:24.957011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:24.965373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.965544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:24.965563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 610
2025-10-02T08:09:24.965762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:24.965794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:24.965800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:24.965804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:24.966344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 610 sessionId:  describe result for acl check
2025-10-02T08:09:24.966377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:24.966380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:24.966382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:24.966388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533524604077102:8082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:24.967129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533524604077102:8082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:24.971562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533524604077102:8082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:24.977913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:24.978342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533524604077102:8082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:24.978359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533524604077102:8082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:24.978363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533524604077102:8082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:24.978373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:24.987157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:24.987450Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:24.987468Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:24.987482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:24.987557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:24.987615Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533524604077255:8081]
2025-10-02T08:09:24.988289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:24.988513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:24.988554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:24.988849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:24.988896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.988897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.988898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.988899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.988901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.988907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.988917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.988922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.988926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.988930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.988934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.988939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:24.988943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.988946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:24.988949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.988953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:24.988955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.988958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:24.988961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.988964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:24.988979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:24.998341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:25.000973Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 609
2025-10-02T08:09:25.000535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:25.000555Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:25.000558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:25.000563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:25.000570Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 609 [1:7556533524604077255:8081]
2025-10-02T08:09:25.000585Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:25.000606Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:25.000610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.000613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.000616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.000634Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:25.000639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:25.000646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:25.000720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.000723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.000726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:25.000730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:25.000825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:25.000828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.000846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.000861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:25.000874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 609
2025-10-02T08:09:25.000880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533524604077249:8082], now have 1 active actors on pipe
2025-10-02T08:09:25.000884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533525064311330:2378], now have 1 active actors on pipe
2025-10-02T08:09:25.000891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533524604077242:8081]
2025-10-02T08:09:25.000893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533524604077242:8081]
2025-10-02T08:09:25.000901Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:25.000912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.000915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:25.000916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.000919Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:25.000936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:25.000952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:25.000955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:25.001002Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee509028-c80b360-f8036a63-89e5c407_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:25.001010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.001014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.001016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:25.001026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.001034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:25.001042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533524604077242:8081]
2025-10-02T08:09:25.001047Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:25.001055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:25.001085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.001153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.001156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.001378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.001421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 610 partition: 0 MaxSeqNo: 17 sessionId: src_id|ee509028-c80b360-f8036a63-89e5c407_0
2025-10-02T08:09:25.004946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f3c2d5-e2adb881-cda5999c-b5fa690c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ee509028-c80b360-f8036a63-89e5c407_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:25.008086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee509028-c80b360-f8036a63-89e5c407_0] Write session: try to update token
2025-10-02T08:09:25.008111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee509028-c80b360-f8036a63-89e5c407_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:25.019785Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:25.019806Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:25.019809Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:25.019821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533524604077242:8081]
2025-10-02T08:09:25.019826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533524604077242:8081]
2025-10-02T08:09:25.019870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:25.019875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:25.019877Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:25.019881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.019883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:25.020063Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:25.033146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId: src_id|ee509028-c80b360-f8036a63-89e5c407_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:25.036748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:25.055828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533528899044575:8017]
2025-10-02T08:09:25.056071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 609, pipe: [1:7556533528899044575:8017]
2025-10-02T08:09:25.176504Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:25.178364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee509028-c80b360-f8036a63-89e5c407_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:25.178380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee509028-c80b360-f8036a63-89e5c407_0] Write session will restart in 0.009361s
2025-10-02T08:09:25.178405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee509028-c80b360-f8036a63-89e5c407_0] Write session: Do CDS request
2025-10-02T08:09:25.178412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee509028-c80b360-f8036a63-89e5c407_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:25.180875Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:25.176874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.176894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.176917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899044575:8017], now have 1 active actors on pipe
2025-10-02T08:09:25.177319Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:25.177816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533528899044575:8017]
2025-10-02T08:09:25.177836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:25.177893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 610 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee509028-c80b360-f8036a63-89e5c407_0
2025-10-02T08:09:25.178082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 610 sessionId: src_id|ee509028-c80b360-f8036a63-89e5c407_0 is DEAD
2025-10-02T08:09:25.190338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee509028-c80b360-f8036a63-89e5c407_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:25.193595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:25.193615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 611
2025-10-02T08:09:25.193959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:25.193997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:25.194002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:25.194006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:25.194502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 611 sessionId:  describe result for acl check
2025-10-02T08:09:25.194540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:25.194542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:25.194544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:25.194551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533528899044910:8088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:25.195174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533528899044910:8088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:25.198364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:25.200476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:25.200813Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:25.200818Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:25.200831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:25.200895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:25.200930Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533528899044942:8087]
2025-10-02T08:09:25.201555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:25.201988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:25.202047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:25.202393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:25.202455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.202461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.202463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.202464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.202465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.202470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.202494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.202502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.202506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.202510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.202520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.202528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.202535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.202544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.202548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.202557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.202561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.202567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.202575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.202580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.202600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:25.203730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533528899044910:8088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:25.212402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533528899044910:8088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:25.212422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533528899044910:8088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:25.212426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533528899044910:8088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:25.212436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:25.212860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:25.214502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:25.214521Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:25.214524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:25.214528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:25.214535Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 610 [1:7556533528899044942:8087]
2025-10-02T08:09:25.214553Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:25.214573Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:25.214577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.214581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.214583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.214602Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:25.214607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:25.214615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:25.214692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.214695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.214698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:25.214701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:25.214773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:25.214783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.214797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.214810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:25.214828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533528899044931:8087]
2025-10-02T08:09:25.214830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533528899044931:8087]
2025-10-02T08:09:25.214838Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:25.214852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899044976:8088], now have 1 active actors on pipe
2025-10-02T08:09:25.214860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:25.214872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:25.214875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:25.214881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533529359278634:2378], now have 1 active actors on pipe
2025-10-02T08:09:25.214913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533528899044931:8087]
2025-10-02T08:09:25.214915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:25.214954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 610
2025-10-02T08:09:25.214980Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:25.214983Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:25.214990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:25.215106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.215116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.215142Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:25.215148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.215153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.215155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:25.215167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.215177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:25.215193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.215286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.215292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.215307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.215339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 611 partition: 0 MaxSeqNo: 17 sessionId: src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0
2025-10-02T08:09:25.215559Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 610
2025-10-02T08:09:25.215869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee509028-c80b360-f8036a63-89e5c407_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:25.218886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0] Write session: try to update token
2025-10-02T08:09:25.218915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:25.237389Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:25.237408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:25.237410Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:25.237419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533528899044931:8087]
2025-10-02T08:09:25.237423Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533528899044931:8087]
2025-10-02T08:09:25.237466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:25.237473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.237475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:25.237624Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:25.238044Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:25.238052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:25.257931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId: src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:25.261144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:25.278590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533528899044991:8017]
2025-10-02T08:09:25.278907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 610, pipe: [1:7556533528899044991:8017]
2025-10-02T08:09:25.397497Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:25.397907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.397922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.397943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899044991:8017], now have 1 active actors on pipe
2025-10-02T08:09:25.398161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:25.398182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:25.398282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 611 reason: error at write: Disconnected sessionId: src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0
2025-10-02T08:09:25.398507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 611 sessionId: src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0 is DEAD
2025-10-02T08:09:25.398718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533528899044991:8017]
2025-10-02T08:09:25.398935Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:25.399416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:25.399433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0] Write session will restart in 0.008493s
2025-10-02T08:09:25.399460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0] Write session: Do CDS request
2025-10-02T08:09:25.399471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:25.400257Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:25.410488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:25.411001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:25.411022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 612
2025-10-02T08:09:25.411159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:25.411195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:25.411209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:25.411215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:25.413262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 612 sessionId:  describe result for acl check
2025-10-02T08:09:25.413330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:25.413339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:25.413341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:25.413350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533528899045188:8100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:25.414145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533528899045188:8100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:25.419226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533528899045188:8100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:25.425647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533528899045188:8100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:25.425672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533528899045188:8100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:25.425677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533528899045188:8100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:25.425687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:25.426847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:25.428901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:25.429161Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:25.429172Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:25.429184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:25.429235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:25.429287Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533528899045402:8095]
2025-10-02T08:09:25.429941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:25.430225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:25.430270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:25.430570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:25.430612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.430617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.430618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.430619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.430620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.430624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.430666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.430673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.430675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.430678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.430682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.430688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.430693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.430696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.430699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.430702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.430705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.430708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.430711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.430713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.430726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:25.444252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:25.446290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:25.446312Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:25.446314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:25.446318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:25.446325Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 611 [1:7556533528899045402:8095]
2025-10-02T08:09:25.446338Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:25.446355Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:25.446358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.446361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.446364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.446382Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:25.446388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:25.446395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:25.446474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.446485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.446488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:25.446490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:25.446563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:25.446572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.446587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.446599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:25.446613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533528899045396:8095]
2025-10-02T08:09:25.446618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533528899045396:8095]
2025-10-02T08:09:25.446625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:25.446636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899045389:8100], now have 1 active actors on pipe
2025-10-02T08:09:25.446643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:25.446646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:25.446647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:25.446657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:25.446660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:25.446664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533529359278642:2378], now have 1 active actors on pipe
2025-10-02T08:09:25.446692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533528899045396:8095]
2025-10-02T08:09:25.446703Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:25.446763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 611
2025-10-02T08:09:25.446804Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 611
2025-10-02T08:09:25.446804Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:25.446916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.446923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.446950Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|891a4eaf-30af7c71-4458f036-3f56de25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:25.446959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.446962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.446964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:25.446974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.446985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:25.447009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.447047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.447053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.447077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.447123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 612 partition: 0 MaxSeqNo: 17 sessionId: src_id|891a4eaf-30af7c71-4458f036-3f56de25_0
2025-10-02T08:09:25.447771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8735cc9-20b3a9e9-97736e4-3ccc3461_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|891a4eaf-30af7c71-4458f036-3f56de25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:25.450925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891a4eaf-30af7c71-4458f036-3f56de25_0] Write session: try to update token
2025-10-02T08:09:25.450943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891a4eaf-30af7c71-4458f036-3f56de25_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:25.468403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId: src_id|891a4eaf-30af7c71-4458f036-3f56de25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:25.471554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:25.471663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.471673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.471710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:25.471740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:25.472003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.472008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.472190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.472254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.472326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.472399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.472896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.472903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.472987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.473067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.473137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.473215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.473262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.473265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.473347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.473414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.473475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.473545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.473589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.473592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.473671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.473732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.473798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.473861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.473918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.473921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.473997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.474064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.474147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.474218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.474272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.474275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.474352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.474418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.474487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.474556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.474606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.474609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.474686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.474756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.474825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.474890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.474943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.474946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.475029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.475096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.475172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.475247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.475298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.475301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.475377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.475449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.475518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.475587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.475656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.475659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.475743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:25.475806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:25.475887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:25.475957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:25.476004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:25.476007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:25.476075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:25.476139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.476158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.476161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:25.476199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:25.476213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:25.476217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:25.476220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:25.476222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:25.476674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:25.476695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:25.476703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:25.476706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:25.476710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:25.476714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:25.477313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:25.477328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:25.477336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:25.477339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:25.477347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:25.477350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:25.477964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:25.477982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:25.477988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:25.477991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:25.477994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:25.480727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:25.480754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:25.480768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392565480
2025-10-02T08:09:25.481217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:25.481233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:25.481243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:25.481247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:25.481252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:25.481256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:25.482059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:25.482076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:25.482083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:25.482088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:25.482092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:25.482096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:25.482695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:25.482710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:25.482718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:25.482727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:25.482731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:25.482735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:25.483348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:25.483362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:25.483368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:25.484742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:25.484751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:25.484757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:25.484762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:25.484772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392565484
2025-10-02T08:09:25.485870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:25.485887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:25.485893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:25.485897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:25.485901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:25.485918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:25.486446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:25.486460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:25.486466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:25.486471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:25.486474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:25.486478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:25.487024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:25.487036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.487149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392565486
2025-10-02T08:09:25.493550Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:25.493591Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:25.493600Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:25.493609Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:25.493622Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:25.493624Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:25.493627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:25.493637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533528899045396:8095]
2025-10-02T08:09:25.493645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533528899045396:8095]
2025-10-02T08:09:25.496860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:25.496886Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:25.497672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533528899045467:8017]
2025-10-02T08:09:25.497782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 611, pipe: [1:7556533528899045467:8017]
2025-10-02T08:09:25.501598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:25.501619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.501621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:25.501790Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:25.652222Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:25.654238Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:25.652673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899045467:8017], now have 1 active actors on pipe
2025-10-02T08:09:25.652694Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:25.652697Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:25.652708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533528899045396:8095]
2025-10-02T08:09:25.652861Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:25.654408Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:25.654742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533528899045467:8017]
2025-10-02T08:09:25.654762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:25.654789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 612 reason: status is not ok: tablet will be restarted right now sessionId: src_id|891a4eaf-30af7c71-4458f036-3f56de25_0
2025-10-02T08:09:25.654983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 612 sessionId: src_id|891a4eaf-30af7c71-4458f036-3f56de25_0 is DEAD
2025-10-02T08:09:25.655333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891a4eaf-30af7c71-4458f036-3f56de25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:25.655347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891a4eaf-30af7c71-4458f036-3f56de25_0] Write session will restart in 0.008188s
2025-10-02T08:09:25.655372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891a4eaf-30af7c71-4458f036-3f56de25_0] Write session: Do CDS request
2025-10-02T08:09:25.655379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891a4eaf-30af7c71-4458f036-3f56de25_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:25.662390Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2ca8ef8110d7263d] Result# TEvPutResult {Id# [72075186224037892:611:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:25.662465Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:611:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:25.662547Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [39df527f34214954] Result# TEvPutResult {Id# [72075186224037892:611:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:25.662611Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:611:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:25.664768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891a4eaf-30af7c71-4458f036-3f56de25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:25.665026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:25.665050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 613
2025-10-02T08:09:25.665171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:25.665205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:25.665219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:25.665225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:25.665976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 613 sessionId:  describe result for acl check
2025-10-02T08:09:25.666011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:25.666017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:25.666019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:25.666025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533528899045646:8114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:25.666559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533528899045646:8114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:25.669974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533528899045646:8114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:25.675189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533528899045646:8114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:25.675212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533528899045646:8114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:25.675215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533528899045646:8114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:25.675225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:25.677930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:25.680661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:25.680999Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:25.681010Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:25.681024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:25.681106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:25.681170Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533528899045867:8113]
2025-10-02T08:09:25.681821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:25.682083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:25.682132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:25.682455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:25.682505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.682510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.682511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.682512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.682514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.682519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.682529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.682533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.682537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.682540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.682546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.682555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.682565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.682570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.682579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.682583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.682587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.682593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.682597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.682601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.682619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:25.691760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:25.693615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:25.693640Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:25.693643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:25.693647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:25.693655Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 612 [1:7556533528899045867:8113]
2025-10-02T08:09:25.693672Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:25.693695Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:25.693698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.693701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.693703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.693723Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:25.693735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:25.693743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:25.693820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.693828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.693831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:25.693834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:25.693925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:25.693934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.693949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.693960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:25.693980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533528899045861:8113]
2025-10-02T08:09:25.693983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533528899045861:8113]
2025-10-02T08:09:25.693992Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:25.694011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:25.694011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:25.694015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:25.694030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:25.694033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:25.694044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899045841:8114], now have 1 active actors on pipe
2025-10-02T08:09:25.694047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533529359278683:2378], now have 1 active actors on pipe
2025-10-02T08:09:25.694086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533528899045861:8113]
2025-10-02T08:09:25.694098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:25.694111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:25.694149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 612
2025-10-02T08:09:25.694234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.694248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.694286Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:25.694299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.694302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.694304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:25.694317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.694343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:25.694367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.694440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.694448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.694462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.694497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 613 partition: 0 MaxSeqNo: 17 sessionId: src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0
2025-10-02T08:09:25.695452Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 612
2025-10-02T08:09:25.698052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891a4eaf-30af7c71-4458f036-3f56de25_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:25.701505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0] Write session: try to update token
2025-10-02T08:09:25.701527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:25.713531Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:25.713550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:25.713553Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:25.713564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533528899045861:8113]
2025-10-02T08:09:25.713569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533528899045861:8113]
2025-10-02T08:09:25.713618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:25.713625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.713628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:25.713803Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:25.714059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:25.714066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:25.721609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId: src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:25.725550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:25.754845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533528899045892:8017]
2025-10-02T08:09:25.755100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 612, pipe: [1:7556533528899045892:8017]
2025-10-02T08:09:25.872265Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:25.872828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.872836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.872855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899045892:8017], now have 1 active actors on pipe
2025-10-02T08:09:25.873789Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:25.873045Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:25.873139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:25.873210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 613 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0
2025-10-02T08:09:25.873401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 613 sessionId: src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0 is DEAD
2025-10-02T08:09:25.873591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533528899045892:8017]
2025-10-02T08:09:25.876930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:25.876946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0] Write session will restart in 0.009747s
2025-10-02T08:09:25.876975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0] Write session: Do CDS request
2025-10-02T08:09:25.876982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:25.893384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:25.893788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:25.893804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 614
2025-10-02T08:09:25.896462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:25.896933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:25.896975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:25.897030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:25.897036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:25.897043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:25.897110Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:25.897113Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:25.897124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:25.897166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:25.897217Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533528899046252:8119]
2025-10-02T08:09:25.897917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:25.898247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 614 sessionId:  describe result for acl check
2025-10-02T08:09:25.898284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:25.898285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:25.898287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:25.898293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533528899046257:8120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:25.898780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533528899046257:8120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:25.900781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:25.900862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:25.901228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:25.901267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.901268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.901269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.901271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.901272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.901278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.901288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.901292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.901296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.901299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.901305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.901313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:25.901319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.901325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:25.901329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.901334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:25.901338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.901344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.901349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.901354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.901374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:25.904935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533528899046257:8120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:25.919692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:25.921761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:25.921795Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:25.921799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:25.921805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:25.921816Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 613 [1:7556533528899046252:8119]
2025-10-02T08:09:25.921835Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:25.921861Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:25.921865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.921870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.921873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.921894Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:25.921902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:25.921911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:25.922008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.922022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.922026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:25.922030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:25.922120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:25.922133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.922153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:25.922173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:25.922203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533528899046246:8119]
2025-10-02T08:09:25.922212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533528899046246:8119]
2025-10-02T08:09:25.922229Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:25.922253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:25.922276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:25.922280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:25.922334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533528899046246:8119]
2025-10-02T08:09:25.922344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:25.922975Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:25.922991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:25.923003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:25.924016Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 613
2025-10-02T08:09:25.925043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533528899046257:8120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:25.925067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533528899046257:8120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:25.925071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533528899046257:8120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:25.925082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:25.925633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533529359278691:2378], now have 1 active actors on pipe
2025-10-02T08:09:25.926196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 613
2025-10-02T08:09:25.926214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899046309:8120], now have 1 active actors on pipe
2025-10-02T08:09:25.926272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.926286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.926321Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:25.926342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:25.926348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:25.926351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:25.926367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:25.926386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:25.926411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.926491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:25.926500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:25.926515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:25.926543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 614 partition: 0 MaxSeqNo: 17 sessionId: src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0
2025-10-02T08:09:25.927064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57bc63c9-23d630ae-66d59387-5cb6ef61_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:25.930396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0] Write session: try to update token
2025-10-02T08:09:25.930420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:25.963119Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:25.963151Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:25.963155Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:25.963166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533528899046246:8119]
2025-10-02T08:09:25.963172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533528899046246:8119]
2025-10-02T08:09:25.963235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:25.963245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:25.963249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:25.963417Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:25.964985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:25.964994Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:25.965550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId: src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:25.968733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:25.973855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533528899046316:8017]
2025-10-02T08:09:25.975810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 613, pipe: [1:7556533528899046316:8017]
2025-10-02T08:09:26.179604Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:26.180065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.180079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.180112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533528899046316:8017], now have 1 active actors on pipe
2025-10-02T08:09:26.181659Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:26.180887Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:26.181347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533528899046316:8017]
2025-10-02T08:09:26.181368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:26.181426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 614 reason: status is not ok: tablet will be restarted right now sessionId: src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0
2025-10-02T08:09:26.181596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 614 sessionId: src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0 is DEAD
2025-10-02T08:09:26.182007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:26.182025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0] Write session will restart in 0.006996s
2025-10-02T08:09:26.182057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0] Write session: Do CDS request
2025-10-02T08:09:26.182066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:26.190465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:26.191799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:26.191824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 615
2025-10-02T08:09:26.192017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:26.192073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:26.192085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:26.192090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:26.192705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 615 sessionId:  describe result for acl check
2025-10-02T08:09:26.192761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:26.192770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:26.192773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:26.192780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533533194013628:8127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:26.193517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533533194013628:8127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:26.199151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533533194013628:8127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:26.205294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533533194013628:8127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:26.205312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533533194013628:8127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:26.205316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533533194013628:8127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:26.205325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:26.209875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:26.212379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:26.212620Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:26.212625Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:26.212635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:26.212687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:26.212719Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533533194014011:8126]
2025-10-02T08:09:26.213420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:26.213754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:26.213803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:26.214112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:26.214154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.214170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.214171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.214173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.214174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.214180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.214192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.214197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.214202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.214206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.214212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.214223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.214235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.214244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.214255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.214261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.214273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.214279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.214284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.214290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.214310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:26.229109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:26.232068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:26.232121Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:26.232127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:26.232135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:26.232147Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 614 [1:7556533533194014011:8126]
2025-10-02T08:09:26.232172Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:26.232207Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:26.232211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:26.232217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:26.232220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:26.232248Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:26.232257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:26.232271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:26.232432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.232435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.232439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:26.232443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:26.232609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:26.232616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.232646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.232664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:26.232693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533533194014005:8126]
2025-10-02T08:09:26.232700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533533194014005:8126]
2025-10-02T08:09:26.232734Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:26.232762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:26.232787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:26.232794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:26.233489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:26.233510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:26.233863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 614
2025-10-02T08:09:26.235180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533533194014005:8126]
2025-10-02T08:09:26.235234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:26.235257Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:26.235261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533533654245995:2378], now have 1 active actors on pipe
2025-10-02T08:09:26.235271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533533194013935:8127], now have 1 active actors on pipe
2025-10-02T08:09:26.235280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.235291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.235398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62179f34-5cf0fd91-d6679d25-e161e295_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:26.235415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:26.235423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:26.235428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:26.235450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:26.235477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:26.235519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:26.235740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.235751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.235790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:26.235844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 615 partition: 0 MaxSeqNo: 17 sessionId: src_id|62179f34-5cf0fd91-d6679d25-e161e295_0
2025-10-02T08:09:26.236996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d5306-dec94fe0-e8422f3c-4cf3204d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|62179f34-5cf0fd91-d6679d25-e161e295_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:26.237050Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 614
2025-10-02T08:09:26.240578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62179f34-5cf0fd91-d6679d25-e161e295_0] Write session: try to update token
2025-10-02T08:09:26.241708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62179f34-5cf0fd91-d6679d25-e161e295_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:26.275769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId: src_id|62179f34-5cf0fd91-d6679d25-e161e295_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:26.278810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:26.279040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.279058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.279097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:26.279120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:26.279550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.279562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.279754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.279831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.279900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.279970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.280022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.280037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.280119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.280187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.280261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.280336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.280394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.280397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.280476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.280543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.280617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.280691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.280734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.280737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.280833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.280896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.280964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.281037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.281086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.281089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.281170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.281241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.281315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.281387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.281443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.281446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.281523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.281591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.281661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.281735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.281784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.281787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.281864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.281936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.282009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.282083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.282135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.282139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.282219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.282290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.282364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.282440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.282494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.282497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.282582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.282655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.282733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.282810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.282864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.282867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.282957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.283027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.283100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.283175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.283233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.283235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.283289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:26.283360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:26.283379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:26.283382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:26.283420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:26.283436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:26.283439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:26.283443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:26.283446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:26.283916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533533194014034:8017]
2025-10-02T08:09:26.283940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:26.283960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:26.283969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:26.283972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:26.283979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:26.283983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:26.284024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 614, pipe: [1:7556533533194014034:8017]
2025-10-02T08:09:26.284541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:26.284554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:26.284561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:26.284565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:26.284568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:26.284572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:26.285946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:26.285980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:26.285989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:26.285993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:26.285996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:26.287509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:26.287519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:26.287534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392566287
2025-10-02T08:09:26.287896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:26.287907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:26.287915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:26.287920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:26.287925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:26.287929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:26.288506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:26.288519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:26.288526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:26.288530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:26.288534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:26.288539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:26.289355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:26.289386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:26.289398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:26.289402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:26.289409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:26.289412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:26.289994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:26.290020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:26.290027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:26.291346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:26.291367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:26.291373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:26.291378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:26.291389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392566291
2025-10-02T08:09:26.291744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:26.291757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:26.291765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:26.291768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:26.291773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:26.291777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:26.292291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:26.292304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:26.292310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:26.292314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:26.292318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:26.292326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:26.296279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:26.296311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:26.296441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392566296
2025-10-02T08:09:26.297322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533533194014034:8017], now have 1 active actors on pipe
2025-10-02T08:09:26.297355Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:26.297399Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:26.297408Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:26.297416Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:26.299073Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:26.299076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:26.299078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:26.299085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533533194014005:8126]
2025-10-02T08:09:26.299090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533533194014005:8126]
2025-10-02T08:09:26.299148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:26.299152Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:26.299658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:26.299670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.299673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:26.299821Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:26.466281Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:26.468278Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:26.468296Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:26.468307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533533194014005:8126]
2025-10-02T08:09:26.468493Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:26.468714Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:26.469211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533533194014034:8017]
2025-10-02T08:09:26.469248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:26.469275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 615 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62179f34-5cf0fd91-d6679d25-e161e295_0
2025-10-02T08:09:26.469488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 615 sessionId: src_id|62179f34-5cf0fd91-d6679d25-e161e295_0 is DEAD
2025-10-02T08:09:26.469828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62179f34-5cf0fd91-d6679d25-e161e295_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:26.469840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62179f34-5cf0fd91-d6679d25-e161e295_0] Write session will restart in 0.008171s
2025-10-02T08:09:26.469868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62179f34-5cf0fd91-d6679d25-e161e295_0] Write session: Do CDS request
2025-10-02T08:09:26.469874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62179f34-5cf0fd91-d6679d25-e161e295_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:26.468847Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:26.485654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62179f34-5cf0fd91-d6679d25-e161e295_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:26.485846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:26.485867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 616
2025-10-02T08:09:26.489335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:26.489411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:26.489418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:26.489425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:26.490280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 616 sessionId:  describe result for acl check
2025-10-02T08:09:26.490326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:26.490328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:26.490329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:26.490335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533533194014412:8140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:26.493399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533533194014412:8140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:26.496890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:26.499219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533533194014412:8140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:26.499602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:26.500177Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:26.500198Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:26.500219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:26.500308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:26.500370Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533533194014462:8139]
2025-10-02T08:09:26.501219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:26.501673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:26.501729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:26.502083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:26.502132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.502133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.502134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.502136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.502137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.502144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.502154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.502159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.502163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.502166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.502172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.502180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.502187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.502193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.502198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.502203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.502207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.502212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.502217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.502223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.502244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:26.511020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533533194014412:8140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:26.511044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533533194014412:8140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:26.511048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533533194014412:8140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:26.511059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:26.514756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:26.517104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:26.517120Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:26.517123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:26.517128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:26.517137Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 615 [1:7556533533194014462:8139]
2025-10-02T08:09:26.517151Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:26.517173Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:26.517182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:26.517185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:26.517187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:26.517206Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:26.517218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:26.517231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:26.517307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.517314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.517317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:26.517320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:26.517396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:26.517404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.517417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.517428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:26.517449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533533194014512:8140], now have 1 active actors on pipe
2025-10-02T08:09:26.517457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533533194014456:8139]
2025-10-02T08:09:26.517460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533533194014456:8139]
2025-10-02T08:09:26.517470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:26.517488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:26.517506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:26.517513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:26.517519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533533654246029:2378], now have 1 active actors on pipe
2025-10-02T08:09:26.517557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533533194014456:8139]
2025-10-02T08:09:26.517563Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:26.517609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 615
2025-10-02T08:09:26.517624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:26.517633Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:26.517639Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:26.517704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.517717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.517750Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:26.517761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:26.517766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:26.517768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:26.517781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:26.517795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:26.517811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:26.517916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.517922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.517937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:26.517972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 616 partition: 0 MaxSeqNo: 17 sessionId: src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0
2025-10-02T08:09:26.518729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 615
2025-10-02T08:09:26.524920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62179f34-5cf0fd91-d6679d25-e161e295_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:26.527748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0] Write session: try to update token
2025-10-02T08:09:26.527766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:26.543324Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:26.543351Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:26.543354Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:26.543365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533533194014456:8139]
2025-10-02T08:09:26.543370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533533194014456:8139]
2025-10-02T08:09:26.543416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:26.543425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.543428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:26.543622Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:26.545043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:26.545057Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:26.552140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId: src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:26.555247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:26.569388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533533194014525:8017]
2025-10-02T08:09:26.577034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 615, pipe: [1:7556533533194014525:8017]
2025-10-02T08:09:26.750872Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:26.752755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:26.752770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0] Write session will restart in 0.008531s
2025-10-02T08:09:26.752796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0] Write session: Do CDS request
2025-10-02T08:09:26.752820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:26.752889Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:26.751475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.751496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.751556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533533194014525:8017], now have 1 active actors on pipe
2025-10-02T08:09:26.751822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:26.751828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:26.751872Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:26.751941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 616 reason: error at write: Disconnected sessionId: src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0
2025-10-02T08:09:26.752173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 616 sessionId: src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0 is DEAD
2025-10-02T08:09:26.752320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533533194014525:8017]
2025-10-02T08:09:26.762774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:26.768827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:26.768849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 617
2025-10-02T08:09:26.769910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:26.769980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:26.769989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:26.769996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:26.770582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 617 sessionId:  describe result for acl check
2025-10-02T08:09:26.770630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:26.770632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:26.770634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:26.770642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533533194014715:8153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:26.771531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533533194014715:8153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:26.778623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533533194014715:8153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:26.793834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:26.794940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533533194014715:8153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:26.794950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533533194014715:8153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:26.794953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533533194014715:8153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:26.794964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:26.800012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:26.800332Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:26.800336Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:26.800350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:26.800419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:26.800470Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533533194014929:8152]
2025-10-02T08:09:26.801084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:26.801344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:26.801379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:26.801703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:26.801763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.801765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.801766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.801768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.801769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.801775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.801788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.801793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.801797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.801801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.801808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.801817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:26.801823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.801832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:26.801838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.801843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:26.801848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.801854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.801859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.801865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.801883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:26.820238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:26.822621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:26.822639Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:26.822641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:26.822645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:26.822652Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 616 [1:7556533533194014929:8152]
2025-10-02T08:09:26.822665Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:26.822686Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:26.822689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:26.822692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:26.822694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:26.822713Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:26.822717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:26.822725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:26.822800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.822806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.822810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:26.822812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:26.822904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:26.822912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.822929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:26.822941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:26.822964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533533194014917:8152]
2025-10-02T08:09:26.822965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533533194014917:8152]
2025-10-02T08:09:26.822974Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:26.822993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533533194014924:8153], now have 1 active actors on pipe
2025-10-02T08:09:26.822997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:26.823000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:26.823001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:26.823015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:26.823018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:26.823024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533533654246045:2378], now have 1 active actors on pipe
2025-10-02T08:09:26.823064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533533194014917:8152]
2025-10-02T08:09:26.823072Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:26.823093Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:26.823134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 616
2025-10-02T08:09:26.823413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.823426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.823467Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:26.823478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:26.823483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:26.823485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:26.823499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:26.823524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:26.823546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:26.823696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.823699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.823716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:26.823762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 617 partition: 0 MaxSeqNo: 17 sessionId: src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0
2025-10-02T08:09:26.824152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bbb697a-40d9db26-9f11aee7-e91ae9f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:26.826930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0] Write session: try to update token
2025-10-02T08:09:26.826948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:26.825864Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 616
2025-10-02T08:09:26.843885Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:26.843906Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:26.843919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533533194014917:8152]
2025-10-02T08:09:26.843981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:26.844245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:26.844427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:26.844610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:26.844780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:26.844950Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:26.845046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:26.845094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:26.851440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533533194014954:8017]
2025-10-02T08:09:26.851580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 616, pipe: [1:7556533533194014954:8017]
2025-10-02T08:09:26.851614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533533194014954:8017], now have 1 active actors on pipe
2025-10-02T08:09:26.854710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId: src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:26.858242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:26.858334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.858344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.858383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:26.858409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:26.858482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:26.858485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:26.858674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.858740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.858809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.858877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.858924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.858930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.859008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.859094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.859165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.859240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.859287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.859290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.859371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.859444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.859521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.859616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.859670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.859673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.859754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.859877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.859959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.860030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.860082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.860085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.860165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.860234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.860309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.860382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.860438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.860456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.860544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.860625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.860711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.860798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.860886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.860889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.860974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.861040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.861122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.861229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.861290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.861297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.861384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.861468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.861547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.861620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.861676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.861678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.861764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.861831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.861901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.861967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.862033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.862035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.862104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:26.862166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:26.862232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:26.862302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:26.862350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:26.862353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:26.862405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:26.862479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:26.862509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:26.862512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:26.862549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:26.862564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:26.862567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:26.862570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:26.862573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:26.863026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:26.863057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:26.863064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:26.863068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:26.863071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:26.863074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:26.863673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:26.863698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:26.863705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:26.863711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:26.863717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:26.863720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:26.864254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:26.864283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:26.864289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:26.864293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:26.864297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:26.865828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:26.865851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:26.865865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392566865
2025-10-02T08:09:26.866187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:26.866208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:26.866214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:26.866218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:26.866222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:26.866226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:26.866786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:26.866811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:26.866816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:26.866820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:26.866823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:26.866831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:26.867397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:26.867424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:26.867432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:26.867438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:26.867442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:26.867446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:26.868081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:26.868111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:26.868118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:26.869518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:26.869537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:26.869542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:26.869545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:26.869553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392566869
2025-10-02T08:09:26.869897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:26.869923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:26.869931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:26.869934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:26.869940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:26.869945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:26.870489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:26.870518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:26.870525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:26.870532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:26.870537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:26.870540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:26.871060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:26.871081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:26.871164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392566870
2025-10-02T08:09:26.872088Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:26.872110Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:26.872118Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:26.872127Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:26.873875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:26.873894Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:26.873897Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:26.873906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533533194014917:8152]
2025-10-02T08:09:26.873911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533533194014917:8152]
2025-10-02T08:09:26.873984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:26.873990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:26.873993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:26.874119Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:26.874126Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:26.874145Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:27.038156Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:27.038972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533533194014954:8017]
2025-10-02T08:09:27.038990Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:27.038999Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:27.039013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:27.039016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:27.039067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 617 reason: error at write: Disconnected sessionId: src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0
2025-10-02T08:09:27.039238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 617 sessionId: src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0 is DEAD
2025-10-02T08:09:27.040909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:27.040924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0] Write session will restart in 0.007824s
2025-10-02T08:09:27.040950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0] Write session: Do CDS request
2025-10-02T08:09:27.040958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:27.050407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.050477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:27.050499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 618
2025-10-02T08:09:27.050669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.050710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:27.050722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:27.050727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:27.051281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 618 sessionId:  describe result for acl check
2025-10-02T08:09:27.051329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:27.051337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:27.051339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:27.051347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533537488982470:8160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:27.051985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533537488982470:8160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:27.054610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533537488982470:8160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:27.059004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533537488982470:8160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:27.059024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533537488982470:8160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:27.059027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533537488982470:8160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:27.059037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:27.065169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:27.067401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:27.067713Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:27.067727Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:27.067752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:27.067815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:27.067869Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533537488982667:8159]
2025-10-02T08:09:27.068651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:27.068899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:27.068941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:27.069290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:27.069343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.069349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.069351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.069352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.069353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.069360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.069371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.069376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.069380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.069383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.069390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.069414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.069426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.069432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.069441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.069448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.069453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.069464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.069470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.069481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.069507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:27.079271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:27.080963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:27.080983Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:27.080986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:27.080990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:27.080999Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 617 [1:7556533537488982667:8159]
2025-10-02T08:09:27.081013Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:27.081032Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:27.081035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.081038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.081041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.081061Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:27.081067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:27.081075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:27.081164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.081175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.081178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:27.081182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:27.081257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:27.081269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.081288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.081306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:27.081324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533537488982661:8159]
2025-10-02T08:09:27.081333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533537488982661:8159]
2025-10-02T08:09:27.081342Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:27.081357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:27.081369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:27.081373Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:27.081377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:27.081380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:27.081387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 617
2025-10-02T08:09:27.081391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488982575:8160], now have 1 active actors on pipe
2025-10-02T08:09:27.081428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533537949213352:2378], now have 1 active actors on pipe
2025-10-02T08:09:27.081440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.081445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.081460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533537488982661:8159]
2025-10-02T08:09:27.081476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:27.081502Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:27.081508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:27.081515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.081521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.081523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:27.081533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.081542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:27.081575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.081550Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 617
2025-10-02T08:09:27.081962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.081978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.082002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.082048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 618 partition: 0 MaxSeqNo: 17 sessionId: src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0
2025-10-02T08:09:27.083114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbebfa6-c248af11-b7146ab5-76898c31_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:27.086150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0] Write session: try to update token
2025-10-02T08:09:27.086175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:27.104063Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:27.104087Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:27.104089Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:27.104100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533537488982661:8159]
2025-10-02T08:09:27.104105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533537488982661:8159]
2025-10-02T08:09:27.104151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:27.104151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:27.104157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:27.104158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.104159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:27.104323Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:27.110028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId: src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:27.113221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:27.139109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533537488982693:8017]
2025-10-02T08:09:27.139637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 617, pipe: [1:7556533537488982693:8017]
2025-10-02T08:09:27.265053Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:27.265626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.265643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.265695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488982693:8017], now have 1 active actors on pipe
2025-10-02T08:09:27.266093Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:27.265900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533537488982693:8017]
2025-10-02T08:09:27.265918Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:27.265948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:27.266029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 618 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0
2025-10-02T08:09:27.266254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 618 sessionId: src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0 is DEAD
2025-10-02T08:09:27.266424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:27.266438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0] Write session will restart in 0.006528s
2025-10-02T08:09:27.266468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0] Write session: Do CDS request
2025-10-02T08:09:27.266476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:27.274680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.274765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:27.274786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 619
2025-10-02T08:09:27.274999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.275035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:27.275039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:27.275043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:27.275599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 619 sessionId:  describe result for acl check
2025-10-02T08:09:27.275644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:27.275646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:27.275649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:27.275656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533537488982890:8166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:27.276228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533537488982890:8166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:27.279695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533537488982890:8166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:27.293844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533537488982890:8166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:27.293873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533537488982890:8166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:27.293876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533537488982890:8166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:27.293888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:27.298524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:27.306910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:27.307207Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:27.307213Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:27.307226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:27.307282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:27.307332Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533537488983099:8165]
2025-10-02T08:09:27.308062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:27.309496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:27.309575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:27.309948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:27.310002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.310003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.310004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.310005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.310006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.310012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.310020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.310022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.310025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.310027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.310033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.310039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.310045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.310052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.310058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.310065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.310070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.310076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.310082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.310088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.310103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:27.327417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:27.329644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:27.329654Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:27.329658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:27.329664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:27.329676Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 618 [1:7556533537488983099:8165]
2025-10-02T08:09:27.329695Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:27.329723Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:27.329728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.329732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.329735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.329758Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:27.329765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:27.329775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:27.329870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.329872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.329876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:27.329881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:27.329971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:27.329974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.329992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.330003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:27.330024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533537488983092:8165]
2025-10-02T08:09:27.330026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533537488983092:8165]
2025-10-02T08:09:27.330037Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:27.330053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:27.330068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:27.330072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:27.330126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533537488983092:8165]
2025-10-02T08:09:27.330129Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:27.331718Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 618
2025-10-02T08:09:27.330600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:27.330610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:27.331895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63c41c3-47291da1-ce36eeeb-94b37276_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:27.330617Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:27.330623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 618
2025-10-02T08:09:27.330651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488983081:8166], now have 1 active actors on pipe
2025-10-02T08:09:27.330935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.330950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.330998Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:27.331013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.331020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.331023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:27.331041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.331060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:27.331082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.331137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533537949213358:2378], now have 1 active actors on pipe
2025-10-02T08:09:27.331258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.331262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.331280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.331320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 619 partition: 0 MaxSeqNo: 17 sessionId: src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0
2025-10-02T08:09:27.335366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0] Write session: try to update token
2025-10-02T08:09:27.335389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:27.355947Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:27.355976Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:27.355980Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:27.355993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533537488983092:8165]
2025-10-02T08:09:27.355998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533537488983092:8165]
2025-10-02T08:09:27.356058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:27.356068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.356080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:27.356191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:27.356205Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:27.356445Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:27.363027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId: src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:27.366503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:27.366583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533537488983126:8017]
2025-10-02T08:09:27.366935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 618, pipe: [1:7556533537488983126:8017]
2025-10-02T08:09:27.510570Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:27.510932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.510943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.510970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488983126:8017], now have 1 active actors on pipe
2025-10-02T08:09:27.511356Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:27.511773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:27.511860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 619 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0
2025-10-02T08:09:27.512062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 619 sessionId: src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0 is DEAD
2025-10-02T08:09:27.512238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533537488983126:8017]
2025-10-02T08:09:27.512501Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:27.514108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:27.514122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0] Write session will restart in 0.005810s
2025-10-02T08:09:27.514150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0] Write session: Do CDS request
2025-10-02T08:09:27.514157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:27.521461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.521567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:27.521586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 620
2025-10-02T08:09:27.521807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.521851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:27.521857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:27.521863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:27.522404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 620 sessionId:  describe result for acl check
2025-10-02T08:09:27.522435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:27.522437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:27.522439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:27.522445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533537488983350:8180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:27.523111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533537488983350:8180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:27.533413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533537488983350:8180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:27.539373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:27.539962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533537488983350:8180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:27.539977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533537488983350:8180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:27.539981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533537488983350:8180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:27.539990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:27.542138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:27.542352Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:27.542357Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:27.542372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:27.542416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:27.542453Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533537488983568:8179]
2025-10-02T08:09:27.542979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:27.543228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:27.543279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:27.543628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:27.543689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.543694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.543696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.543697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.543698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.543704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.543716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.543720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.543729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.543733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.543741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.543754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.543761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.543766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.543771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.543777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.543781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.543787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.543793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.543802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.543828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:27.555452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:27.557696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:27.557720Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:27.557723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:27.557727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:27.557735Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 619 [1:7556533537488983568:8179]
2025-10-02T08:09:27.557748Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:27.557769Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:27.557772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.557775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.557777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.557796Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:27.557801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:27.557809Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:27.557877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.557889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.557892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:27.557895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:27.557965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:27.557976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.557990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.558002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:27.558020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533537488983556:8179]
2025-10-02T08:09:27.558028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533537488983556:8179]
2025-10-02T08:09:27.558044Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:27.558062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:27.558084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:27.558093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:27.558130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533537488983556:8179]
2025-10-02T08:09:27.558140Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:27.558297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:27.558313Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:27.558323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:27.558486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 619
2025-10-02T08:09:27.558493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488983563:8180], now have 1 active actors on pipe
2025-10-02T08:09:27.558599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533537949213384:2378], now have 1 active actors on pipe
2025-10-02T08:09:27.558610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.558618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.558660Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d652146-512b4070-76945932-79f5617c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:27.558686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.558696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.558699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:27.558716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.558740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:27.558768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.559010Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 619
2025-10-02T08:09:27.558945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.558956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.558974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.559021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 620 partition: 0 MaxSeqNo: 17 sessionId: src_id|3d652146-512b4070-76945932-79f5617c_0
2025-10-02T08:09:27.559430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af8e1e4b-dd962bf3-4282f1a9-ea4245aa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3d652146-512b4070-76945932-79f5617c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:27.562454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d652146-512b4070-76945932-79f5617c_0] Write session: try to update token
2025-10-02T08:09:27.562474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d652146-512b4070-76945932-79f5617c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:27.578893Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:27.578918Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:27.578922Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:27.578934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533537488983556:8179]
2025-10-02T08:09:27.578939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533537488983556:8179]
2025-10-02T08:09:27.578999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:27.579009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.579012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:27.579188Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:27.580290Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:27.580311Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:27.588030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId: src_id|3d652146-512b4070-76945932-79f5617c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:27.590878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:27.612248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533537488983616:8017]
2025-10-02T08:09:27.612396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 619, pipe: [1:7556533537488983616:8017]
2025-10-02T08:09:27.749257Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:27.749653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.749669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.749694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488983616:8017], now have 1 active actors on pipe
2025-10-02T08:09:27.749950Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:27.750002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:27.750096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 620 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d652146-512b4070-76945932-79f5617c_0
2025-10-02T08:09:27.750324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 620 sessionId: src_id|3d652146-512b4070-76945932-79f5617c_0 is DEAD
2025-10-02T08:09:27.750605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533537488983616:8017]
2025-10-02T08:09:27.752730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d652146-512b4070-76945932-79f5617c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:27.752745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d652146-512b4070-76945932-79f5617c_0] Write session will restart in 0.005325s
2025-10-02T08:09:27.752772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d652146-512b4070-76945932-79f5617c_0] Write session: Do CDS request
2025-10-02T08:09:27.752784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d652146-512b4070-76945932-79f5617c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:27.753055Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:27.759452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d652146-512b4070-76945932-79f5617c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.759828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:27.759848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 621
2025-10-02T08:09:27.760090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.760127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:27.760151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:27.760155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:27.760838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 621 sessionId:  describe result for acl check
2025-10-02T08:09:27.760886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:27.760898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:27.760900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:27.760906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533537488983863:8192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:27.761410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533537488983863:8192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:27.765923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533537488983863:8192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:27.773156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:27.775433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:27.775645Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:27.775655Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:27.775665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:27.775713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:27.775763Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533537488984021:8191]
2025-10-02T08:09:27.776425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:27.776626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:27.776669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:27.776990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:27.777037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.777043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.777044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.777046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.777047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.777053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.777064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.777068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.777072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.777076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.777082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.777094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.777101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.777111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.777116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.777126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.777130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.777135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.777141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.777147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.777167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:27.781227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533537488983863:8192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:27.781243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533537488983863:8192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:27.781247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533537488983863:8192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:27.781257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:27.785783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:27.787532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:27.787554Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:27.787557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:27.787560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:27.787569Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 620 [1:7556533537488984021:8191]
2025-10-02T08:09:27.787591Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:27.787610Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:27.787615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.787617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.787619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.787635Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:27.787639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:27.787645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:27.787703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.787710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.787713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:27.787716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:27.787785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:27.787791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.787805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.787818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:27.787841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488984037:8192], now have 1 active actors on pipe
2025-10-02T08:09:27.787848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533537949213409:2378], now have 1 active actors on pipe
2025-10-02T08:09:27.787849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 620
2025-10-02T08:09:27.787853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533537488984015:8191]
2025-10-02T08:09:27.787855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533537488984015:8191]
2025-10-02T08:09:27.787862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:27.787877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:27.787880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:27.787887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:27.787893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:27.787895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:27.787902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.787906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.787951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533537488984015:8191]
2025-10-02T08:09:27.787964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:27.787983Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|def6a40c-8fa912a3-22882615-4de6cd19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:27.787988Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:27.787993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.787997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.787998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:27.788006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.788013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:27.788055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.788204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.788212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.788228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.788271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 621 partition: 0 MaxSeqNo: 17 sessionId: src_id|def6a40c-8fa912a3-22882615-4de6cd19_0
2025-10-02T08:09:27.788230Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 620
2025-10-02T08:09:27.788917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d652146-512b4070-76945932-79f5617c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|def6a40c-8fa912a3-22882615-4de6cd19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:27.791809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|def6a40c-8fa912a3-22882615-4de6cd19_0] Write session: try to update token
2025-10-02T08:09:27.791829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|def6a40c-8fa912a3-22882615-4de6cd19_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:27.808089Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:27.808111Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:27.808113Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:27.808121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533537488984015:8191]
2025-10-02T08:09:27.808126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533537488984015:8191]
2025-10-02T08:09:27.808168Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:27.808171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:27.808175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:27.808178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.808181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:27.808325Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:27.817012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId: src_id|def6a40c-8fa912a3-22882615-4de6cd19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:27.820389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:27.851921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533537488984058:8017]
2025-10-02T08:09:27.852010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 620, pipe: [1:7556533537488984058:8017]
2025-10-02T08:09:27.959426Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:27.959958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.959982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.960016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488984058:8017], now have 1 active actors on pipe
2025-10-02T08:09:27.960176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:27.960195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:27.960275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 621 reason: error at write: Disconnected sessionId: src_id|def6a40c-8fa912a3-22882615-4de6cd19_0
2025-10-02T08:09:27.960361Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:27.960653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|def6a40c-8fa912a3-22882615-4de6cd19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:27.960666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|def6a40c-8fa912a3-22882615-4de6cd19_0] Write session will restart in 0.009409s
2025-10-02T08:09:27.960693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|def6a40c-8fa912a3-22882615-4de6cd19_0] Write session: Do CDS request
2025-10-02T08:09:27.960699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|def6a40c-8fa912a3-22882615-4de6cd19_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:27.960466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 621 sessionId: src_id|def6a40c-8fa912a3-22882615-4de6cd19_0 is DEAD
2025-10-02T08:09:27.960656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533537488984058:8017]
2025-10-02T08:09:27.960411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:27.971404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|def6a40c-8fa912a3-22882615-4de6cd19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.971671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:27.971693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 622
2025-10-02T08:09:27.971823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:27.971855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:27.971864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:27.971869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:27.972402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 622 sessionId:  describe result for acl check
2025-10-02T08:09:27.972435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:27.972441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:27.972443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:27.972447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533537488984341:8199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:27.973026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533537488984341:8199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:27.977621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533537488984341:8199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:27.978878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:27.981693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:27.982062Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:27.982078Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:27.982092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:27.982150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:27.982198Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533537488984466:8198]
2025-10-02T08:09:27.982438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533537488984341:8199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:27.982453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533537488984341:8199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:27.982457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533537488984341:8199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:27.982467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:27.982939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:27.983148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:27.983191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:27.983524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:27.983591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.983597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.983598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.983600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.983601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.983608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.983620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.983624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.983628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.983632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.983638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.983646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:27.983653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.983658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:27.983663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.983668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:27.983673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.983679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.983689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.983695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.983722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:27.995662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:27.997926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:27.997954Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:27.997957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:27.997962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:27.997972Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 621 [1:7556533537488984466:8198]
2025-10-02T08:09:27.997988Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:27.998011Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:27.998022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.998025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.998032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.998052Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:27.998064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:27.998073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:27.998168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.998178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.998182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:27.998185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:27.998278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:27.998288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:27.998307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:27.998324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:27.998351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533537488984471:8199], now have 1 active actors on pipe
2025-10-02T08:09:27.998361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533537488984460:8198]
2025-10-02T08:09:27.998367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533537488984460:8198]
2025-10-02T08:09:27.998376Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:27.998388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533537949213418:2378], now have 1 active actors on pipe
2025-10-02T08:09:27.998395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 621
2025-10-02T08:09:27.998397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:27.998403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:27.998407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:27.998407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:27.998410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:27.998417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.998421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.998470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533537488984460:8198]
2025-10-02T08:09:27.998485Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:27.998500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:27.998502Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:27.998508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:27.998512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:27.998513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:27.998523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:27.998532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:27.998570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.998793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:27.998803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:27.998836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:27.998879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 622 partition: 0 MaxSeqNo: 17 sessionId: src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0
2025-10-02T08:09:27.999373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|def6a40c-8fa912a3-22882615-4de6cd19_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:27.998600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 621
2025-10-02T08:09:28.002347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0] Write session: try to update token
2025-10-02T08:09:28.002366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:28.023403Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:28.023427Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:28.023430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:28.023442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533537488984460:8198]
2025-10-02T08:09:28.023447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533537488984460:8198]
2025-10-02T08:09:28.023455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId: src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:28.023506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:28.023513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:28.023515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.023518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:28.023531Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:28.023743Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:28.026581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:28.061279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533541783951794:8017]
2025-10-02T08:09:28.061503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 621, pipe: [1:7556533541783951794:8017]
2025-10-02T08:09:28.192946Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:28.193535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.193548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.193606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533541783951794:8017], now have 1 active actors on pipe
2025-10-02T08:09:28.195052Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:28.194075Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:28.194551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533541783951794:8017]
2025-10-02T08:09:28.194575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:28.194641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 622 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0
2025-10-02T08:09:28.194852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 622 sessionId: src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0 is DEAD
2025-10-02T08:09:28.197073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:28.197088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0] Write session will restart in 0.005207s
2025-10-02T08:09:28.197119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0] Write session: Do CDS request
2025-10-02T08:09:28.197127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:28.209367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:28.212867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:28.212887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 623
2025-10-02T08:09:28.213359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:28.213409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:28.213416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:28.213422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:28.215185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 623 sessionId:  describe result for acl check
2025-10-02T08:09:28.215235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:28.215237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:28.215239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:28.215245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533541783952049:8205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:28.215978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533541783952049:8205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:28.227485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533541783952049:8205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:28.240737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533541783952049:8205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:28.240761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533541783952049:8205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:28.240765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533541783952049:8205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:28.240774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:28.250584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:28.251349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:28.251609Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:28.251625Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:28.251641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:28.251721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:28.251814Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533541783952209:8204]
2025-10-02T08:09:28.252605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:28.252967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:28.253033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:28.253526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:28.253597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.253598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.253600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.253601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.253603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.253611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.253622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.253626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.253630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.253634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.253642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.253652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.253660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.253665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.253670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.253675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.253681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.253687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.253693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.253699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.253727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:28.271614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:28.274294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:28.274322Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:28.274325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:28.274331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:28.274340Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 622 [1:7556533541783952209:8204]
2025-10-02T08:09:28.274356Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:28.274380Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:28.274384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:28.274388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:28.274391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:28.274416Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:28.274423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:28.274431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:28.274522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.274525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.274529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:28.274533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:28.274815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:28.274818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.274849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.274866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:28.274879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533541783952196:8205], now have 1 active actors on pipe
2025-10-02T08:09:28.274883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533542244180721:2378], now have 1 active actors on pipe
2025-10-02T08:09:28.274906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533541783952203:8204]
2025-10-02T08:09:28.274909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533541783952203:8204]
2025-10-02T08:09:28.274923Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:28.274940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:28.274960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:28.274963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:28.275011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533541783952203:8204]
2025-10-02T08:09:28.275015Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:28.275086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 622
2025-10-02T08:09:28.275131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:28.275133Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:28.275140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:28.275605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.275612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.275644Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e332d8bb-4b891673-130111a-dca89c14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:28.275655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:28.275660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:28.275663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:28.275676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:28.275690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:28.275708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:28.275940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.275944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.275960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:28.276002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 623 partition: 0 MaxSeqNo: 17 sessionId: src_id|e332d8bb-4b891673-130111a-dca89c14_0
2025-10-02T08:09:28.277180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbe632c-925d77d2-69882a6d-3974d6cf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e332d8bb-4b891673-130111a-dca89c14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:28.277753Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 622
2025-10-02T08:09:28.280191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e332d8bb-4b891673-130111a-dca89c14_0] Write session: try to update token
2025-10-02T08:09:28.280216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e332d8bb-4b891673-130111a-dca89c14_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:28.296887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533541783952231:8017]
2025-10-02T08:09:28.297213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 622, pipe: [1:7556533541783952231:8017]
2025-10-02T08:09:28.297237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533541783952231:8017], now have 1 active actors on pipe
2025-10-02T08:09:28.318502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId: src_id|e332d8bb-4b891673-130111a-dca89c14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:28.319123Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:28.319128Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:28.319132Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:28.319146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533541783952203:8204]
2025-10-02T08:09:28.319152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533541783952203:8204]
2025-10-02T08:09:28.319227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:28.319239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.319242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:28.319477Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:28.321027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:28.321046Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:28.321762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:28.510223Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:28.511030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.511044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.513095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e332d8bb-4b891673-130111a-dca89c14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:28.513109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e332d8bb-4b891673-130111a-dca89c14_0] Write session will restart in 0.005742s
2025-10-02T08:09:28.513134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e332d8bb-4b891673-130111a-dca89c14_0] Write session: Do CDS request
2025-10-02T08:09:28.513141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e332d8bb-4b891673-130111a-dca89c14_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:28.511975Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:28.512424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533541783952231:8017]
2025-10-02T08:09:28.512451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:28.512514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 623 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e332d8bb-4b891673-130111a-dca89c14_0
2025-10-02T08:09:28.512735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 623 sessionId: src_id|e332d8bb-4b891673-130111a-dca89c14_0 is DEAD
2025-10-02T08:09:28.513627Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:28.524449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e332d8bb-4b891673-130111a-dca89c14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:28.524703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:28.524725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 624
2025-10-02T08:09:28.533164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:28.533235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:28.533251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:28.533257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:28.533826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 624 sessionId:  describe result for acl check
2025-10-02T08:09:28.533870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:28.533882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:28.533884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:28.533891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533541783952627:8213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:28.534552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533541783952627:8213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:28.534735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:28.536954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533541783952627:8213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:28.537090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:28.537349Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:28.537355Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:28.537368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:28.537869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:28.537920Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533541783952660:8212]
2025-10-02T08:09:28.538650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:28.538937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:28.539004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:28.539399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:28.539446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.539448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.539449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.539450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.539451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.539458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.539472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.539477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.539481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.539485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.539492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.539499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.539505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.539511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.539515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.539520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.539525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.539531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.539535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.539541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.539560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:28.540389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533541783952627:8213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:28.540397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533541783952627:8213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:28.540400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533541783952627:8213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:28.540410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:28.551845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 623
2025-10-02T08:09:28.549036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:28.551213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:28.551222Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:28.551226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:28.551231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:28.551238Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 623 [1:7556533541783952660:8212]
2025-10-02T08:09:28.551253Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:28.551273Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:28.551276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:28.551279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:28.551282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:28.551298Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:28.551304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:28.551312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:28.551385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.551388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.551391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:28.551394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:28.551470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:28.551472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.551487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.551499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:28.551516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533541783952633:8212]
2025-10-02T08:09:28.551518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533541783952633:8212]
2025-10-02T08:09:28.551525Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:28.551539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533541783952684:8213], now have 1 active actors on pipe
2025-10-02T08:09:28.551544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:28.551546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:28.551548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:28.551564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:28.551566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:28.551583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533542244180742:2378], now have 1 active actors on pipe
2025-10-02T08:09:28.551620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533541783952633:8212]
2025-10-02T08:09:28.551631Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:28.551679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 623
2025-10-02T08:09:28.551717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:28.551928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.551933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.551965Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:28.551973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:28.551978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:28.551981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:28.551992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:28.552004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:28.552030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:28.552057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.552059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.552071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:28.552104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 624 partition: 0 MaxSeqNo: 17 sessionId: src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0
2025-10-02T08:09:28.552946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e332d8bb-4b891673-130111a-dca89c14_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:28.555949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0] Write session: try to update token
2025-10-02T08:09:28.555972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:28.576363Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:28.576386Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:28.576388Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:28.576397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533541783952633:8212]
2025-10-02T08:09:28.576401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533541783952633:8212]
2025-10-02T08:09:28.576442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:28.576443Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:28.576447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.576449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:28.576450Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:28.576602Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:28.596917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId: src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:28.600237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:28.613518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533541783952726:8017]
2025-10-02T08:09:28.613953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 623, pipe: [1:7556533541783952726:8017]
2025-10-02T08:09:28.772947Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:28.775715Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:28.773457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.773474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.773495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533541783952726:8017], now have 1 active actors on pipe
2025-10-02T08:09:28.773626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:28.773630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:28.773696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 624 reason: error at write: Disconnected sessionId: src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0
2025-10-02T08:09:28.773833Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:28.773873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 624 sessionId: src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0 is DEAD
2025-10-02T08:09:28.774006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533541783952726:8017]
2025-10-02T08:09:28.781071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:28.781090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0] Write session will restart in 0.008873s
2025-10-02T08:09:28.781203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0] Write session: Do CDS request
2025-10-02T08:09:28.781220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:28.793435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:28.794690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:28.795774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:28.795789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 625
2025-10-02T08:09:28.795978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:28.796005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:28.796012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:28.796016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:28.796509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 625 sessionId:  describe result for acl check
2025-10-02T08:09:28.796541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:28.796543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:28.796545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:28.796549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533541783953117:8232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:28.797087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533541783953117:8232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:28.797667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:28.797883Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:28.797893Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:28.797902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:28.797953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:28.797989Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533541783953124:8230]
2025-10-02T08:09:28.798597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:28.798807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:28.798850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:28.799180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:28.799225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.799231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.799233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.799234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.799236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.799240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.799252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.799261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.799268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.799272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.799278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.799286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:28.799292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.799297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:28.799301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.799306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:28.799310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.799316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.799320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.799325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.799344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:28.802682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533541783953117:8232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:28.809220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533541783953117:8232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:28.809242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533541783953117:8232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:28.809246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533541783953117:8232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:28.809256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:28.810498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:28.812598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:28.812621Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:28.812625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:28.812628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:28.812635Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 624 [1:7556533541783953124:8230]
2025-10-02T08:09:28.812648Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:28.812668Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:28.812671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:28.812675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:28.812677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:28.812701Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:28.812717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:28.812724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:28.812819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.812828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.812831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:28.812834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:28.812910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:28.812912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.812927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:28.812938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:28.812956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533541783953110:8230]
2025-10-02T08:09:28.812958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533541783953110:8230]
2025-10-02T08:09:28.812966Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:28.812980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:28.813004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:28.813008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:28.813047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:28.813050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533541783953110:8230]
2025-10-02T08:09:28.813052Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:28.813057Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:28.813063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533541783953163:8232], now have 1 active actors on pipe
2025-10-02T08:09:28.813063Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:28.813104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 624
2025-10-02T08:09:28.813394Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 624
2025-10-02T08:09:28.815184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.815204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.815231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533542244180770:2378], now have 1 active actors on pipe
2025-10-02T08:09:28.815263Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85e29598-cb4983a7-954ae450-86ffb26a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:28.815275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:28.815281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:28.815284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:28.815301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:28.815320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:28.815346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:28.815561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.815587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.815608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:28.815647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 625 partition: 0 MaxSeqNo: 17 sessionId: src_id|85e29598-cb4983a7-954ae450-86ffb26a_0
2025-10-02T08:09:28.816050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aaf89b8-ea2c06cc-74a644c3-e5763a53_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|85e29598-cb4983a7-954ae450-86ffb26a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:28.819002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e29598-cb4983a7-954ae450-86ffb26a_0] Write session: try to update token
2025-10-02T08:09:28.819027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e29598-cb4983a7-954ae450-86ffb26a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:28.833904Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:28.833926Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:28.833936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533541783953110:8230]
2025-10-02T08:09:28.833990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:28.834016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:28.834195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:28.834356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:28.834516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:28.834681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:28.834915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:28.834951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:28.847266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId: src_id|85e29598-cb4983a7-954ae450-86ffb26a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:28.850204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:28.850878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:28.850909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:28.850934Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:28.850940Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:28.850943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:28.850956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533541783953110:8230]
2025-10-02T08:09:28.850962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533541783953110:8230]
2025-10-02T08:09:28.851018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:28.851025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:28.851027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:28.851173Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:28.852899Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:28.852906Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:28.874492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533541783953179:8017]
2025-10-02T08:09:28.874748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 624, pipe: [1:7556533541783953179:8017]
2025-10-02T08:09:29.009563Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:29.009900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:29.009925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533541783953179:8017], now have 1 active actors on pipe
2025-10-02T08:09:29.009951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:29.010745Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:29.011665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:29.011678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:29.011700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 625 reason: error at write: Disconnected sessionId: src_id|85e29598-cb4983a7-954ae450-86ffb26a_0
2025-10-02T08:09:29.011886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 625 sessionId: src_id|85e29598-cb4983a7-954ae450-86ffb26a_0 is DEAD
2025-10-02T08:09:29.012028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533541783953179:8017]
2025-10-02T08:09:29.012281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e29598-cb4983a7-954ae450-86ffb26a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:29.012300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e29598-cb4983a7-954ae450-86ffb26a_0] Write session will restart in 0.007791s
2025-10-02T08:09:29.012329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e29598-cb4983a7-954ae450-86ffb26a_0] Write session: Do CDS request
2025-10-02T08:09:29.012342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e29598-cb4983a7-954ae450-86ffb26a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:29.025552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e29598-cb4983a7-954ae450-86ffb26a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:29.028417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:29.028435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 626
2025-10-02T08:09:29.029424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:29.029470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:29.029476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:29.029489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:29.030988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 626 sessionId:  describe result for acl check
2025-10-02T08:09:29.031023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:29.031025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:29.031025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:29.031029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533546078920853:8238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:29.031404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533546078920853:8238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:29.033423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:29.033664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:29.033803Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:29.033806Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:29.033812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:29.033843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:29.033868Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533546078920869:8237]
2025-10-02T08:09:29.034304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:29.034535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:29.034575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:29.034783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:29.034806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.034807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.034808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.034809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.034810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.034813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.034820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.034823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.034825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.034827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.034831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.034835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.034839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.034842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.034844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.034847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.034849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.034852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.034855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.034858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.034869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:29.039097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533546078920853:8238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:29.044775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533546078920853:8238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:29.044811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533546078920853:8238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:29.044815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533546078920853:8238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:29.044824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:29.045572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:29.047182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:29.047198Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:29.047200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:29.047203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:29.047209Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 625 [1:7556533546078920869:8237]
2025-10-02T08:09:29.047217Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:29.047232Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:29.047234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.047236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.047238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.047252Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:29.047255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:29.047260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:29.047313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.047314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.047316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:29.047318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:29.047370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:29.047372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.047384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.047391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:29.047403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533546078920861:8237]
2025-10-02T08:09:29.047404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533546078920861:8237]
2025-10-02T08:09:29.047419Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:29.047429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:29.047437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:29.047439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:29.047452Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:29.047455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:29.047467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533546078920861:8237]
2025-10-02T08:09:29.047469Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:29.047501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 625
2025-10-02T08:09:29.047508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533546078920907:8238], now have 1 active actors on pipe
2025-10-02T08:09:29.047512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:29.047759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.047773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.047791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533546539148075:2378], now have 1 active actors on pipe
2025-10-02T08:09:29.047814Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:29.047822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.047826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.047828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:29.047838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.047850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:29.047873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:29.047906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.047908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.047911Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 625
2025-10-02T08:09:29.047920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:29.047950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 626 partition: 0 MaxSeqNo: 17 sessionId: src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0
2025-10-02T08:09:29.048990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e29598-cb4983a7-954ae450-86ffb26a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:29.052417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0] Write session: try to update token
2025-10-02T08:09:29.052441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:29.066954Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:29.066981Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:29.066984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:29.066995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533546078920861:8237]
2025-10-02T08:09:29.067000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533546078920861:8237]
2025-10-02T08:09:29.067048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:29.067063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.067065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:29.067234Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:29.069193Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:29.069210Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:29.069999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId: src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:29.073152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:29.110879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533546078920921:8017]
2025-10-02T08:09:29.111034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 625, pipe: [1:7556533546078920921:8017]
2025-10-02T08:09:29.229190Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:29.230005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.230025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.230073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533546078920921:8017], now have 1 active actors on pipe
2025-10-02T08:09:29.230226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533546078920921:8017]
2025-10-02T08:09:29.230252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:29.230254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:29.230306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 626 reason: error at write: Disconnected sessionId: src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0
2025-10-02T08:09:29.230342Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:29.230471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 626 sessionId: src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0 is DEAD
2025-10-02T08:09:29.230806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:29.230816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0] Write session will restart in 0.006838s
2025-10-02T08:09:29.230843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0] Write session: Do CDS request
2025-10-02T08:09:29.230855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:29.235849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:29.239338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:29.239798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:29.239816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 627
2025-10-02T08:09:29.239946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:29.239980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:29.239990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:29.239999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:29.240481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 627 sessionId:  describe result for acl check
2025-10-02T08:09:29.240524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:29.240532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:29.240534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:29.240544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533546078920962:8244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:29.241092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533546078920962:8244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:29.245810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533546078920962:8244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:29.258776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:29.261076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:29.261299Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:29.261310Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:29.261318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533546078920962:8244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:29.261321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:29.261325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533546078920962:8244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:29.261330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533546078920962:8244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:29.261339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:29.261397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:29.261435Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533546078921338:8243]
2025-10-02T08:09:29.262128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:29.262524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:29.262593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:29.262864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:29.262906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.262907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.262907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.262908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.262909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.262913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.262921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.262923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.262925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.262927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.262932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.262937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.262941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.262944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.262947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.262950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.262953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.262956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.262958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.262961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.262976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:29.276550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:29.278735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 626
2025-10-02T08:09:29.278260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:29.278283Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:29.278286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:29.278290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:29.278298Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 626 [1:7556533546078921338:8243]
2025-10-02T08:09:29.278312Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:29.278330Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:29.278334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.278337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.278339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.278355Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:29.278361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:29.278367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:29.278437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.278440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.278444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:29.278446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:29.278520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:29.278523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.278537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.278549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:29.278568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533546078921343:8244], now have 1 active actors on pipe
2025-10-02T08:09:29.278576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533546078921331:8243]
2025-10-02T08:09:29.278579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533546078921331:8243]
2025-10-02T08:09:29.278591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:29.278600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533546539148082:2378], now have 1 active actors on pipe
2025-10-02T08:09:29.278608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:29.278608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:29.278612Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:29.278621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:29.278624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:29.278668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533546078921331:8243]
2025-10-02T08:09:29.278675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:29.278682Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:29.278719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 626
2025-10-02T08:09:29.278726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.278730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.278754Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ce03246-32306717-699ad2a1-d583abd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:29.278761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.278765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.278767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:29.278778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.278787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:29.278803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:29.278827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.278830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.278844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:29.278874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 627 partition: 0 MaxSeqNo: 17 sessionId: src_id|3ce03246-32306717-699ad2a1-d583abd0_0
2025-10-02T08:09:29.280381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da27c72d-dc401f4d-9d245a3d-69656ca5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3ce03246-32306717-699ad2a1-d583abd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:29.286481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce03246-32306717-699ad2a1-d583abd0_0] Write session: try to update token
2025-10-02T08:09:29.286514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce03246-32306717-699ad2a1-d583abd0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:29.296333Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:29.296355Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:29.296365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533546078921331:8243]
2025-10-02T08:09:29.296405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:29.296409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:29.296602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:29.296757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:29.296923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:29.297076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:29.297277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:29.297311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:29.317254Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:29.317278Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:29.317281Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:29.317292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533546078921331:8243]
2025-10-02T08:09:29.317296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533546078921331:8243]
2025-10-02T08:09:29.317348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:29.317356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.317358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:29.317357Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:29.317364Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:29.317665Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:29.332868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533546078921368:8017]
2025-10-02T08:09:29.336984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId: src_id|3ce03246-32306717-699ad2a1-d583abd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:29.340353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:29.340434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 626, pipe: [1:7556533546078921368:8017]
2025-10-02T08:09:29.498127Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:29.498477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533546078921368:8017], now have 1 active actors on pipe
2025-10-02T08:09:29.498497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.498503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.498853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:29.498860Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:29.498864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:29.498942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 627 reason: error at write: Disconnected sessionId: src_id|3ce03246-32306717-699ad2a1-d583abd0_0
2025-10-02T08:09:29.498926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:29.499147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 627 sessionId: src_id|3ce03246-32306717-699ad2a1-d583abd0_0 is DEAD
2025-10-02T08:09:29.499298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533546078921368:8017]
2025-10-02T08:09:29.499461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce03246-32306717-699ad2a1-d583abd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:29.499471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce03246-32306717-699ad2a1-d583abd0_0] Write session will restart in 0.008760s
2025-10-02T08:09:29.499507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce03246-32306717-699ad2a1-d583abd0_0] Write session: Do CDS request
2025-10-02T08:09:29.499517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce03246-32306717-699ad2a1-d583abd0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:29.509376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce03246-32306717-699ad2a1-d583abd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:29.509465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:29.509486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 628
2025-10-02T08:09:29.509604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:29.509642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:29.509652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:29.509657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:29.510432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 628 sessionId:  describe result for acl check
2025-10-02T08:09:29.510470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:29.510472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:29.510474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:29.510480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533546078921583:8254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:29.511029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533546078921583:8254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:29.516781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533546078921583:8254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:29.521503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:29.523506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533546078921583:8254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:29.523524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533546078921583:8254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:29.523528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533546078921583:8254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:29.523538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:29.524109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:29.524337Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:29.524341Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:29.524352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:29.524400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:29.524436Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533546078921818:8253]
2025-10-02T08:09:29.525134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:29.525455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:29.525498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:29.525832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:29.525889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.525895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.525896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.525897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.525898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.525904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.525916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.525925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.525929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.525933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.525950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.525957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.525968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.525974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.525978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.525989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.525993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.525999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.526008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.526013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.526038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:29.536112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:29.538593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 627
2025-10-02T08:09:29.538151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:29.538172Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:29.538174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:29.538179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:29.538185Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 627 [1:7556533546078921818:8253]
2025-10-02T08:09:29.538198Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:29.538216Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:29.538219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.538222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.538225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.538242Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:29.538249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:29.538257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:29.538328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.538331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.538334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:29.538336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:29.538409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:29.538411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.538425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.538439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:29.538457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533546078921814:8254], now have 1 active actors on pipe
2025-10-02T08:09:29.538462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 627
2025-10-02T08:09:29.538465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533546078921806:8253]
2025-10-02T08:09:29.538467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533546078921806:8253]
2025-10-02T08:09:29.538474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:29.538483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533546539148101:2378], now have 1 active actors on pipe
2025-10-02T08:09:29.538487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:29.538490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:29.538490Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:29.538506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:29.538508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:29.538515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.538520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.538559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533546078921806:8253]
2025-10-02T08:09:29.538568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:29.538574Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:29.538585Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:29.538591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.538596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.538597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:29.538606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.538614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:29.538656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:29.538912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.538919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.538948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:29.538989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 628 partition: 0 MaxSeqNo: 17 sessionId: src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0
2025-10-02T08:09:29.539379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce03246-32306717-699ad2a1-d583abd0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:29.542987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0] Write session: try to update token
2025-10-02T08:09:29.543010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:29.552266Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:29.552298Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:29.552309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533546078921806:8253]
2025-10-02T08:09:29.552356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:29.552356Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:29.552558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:29.552726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:29.552897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:29.553087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:29.553357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:29.553401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:29.572186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId: src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:29.575740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:29.576061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.576073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.576113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:29.576144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:29.576211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.576220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.576417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.576485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.576566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.576641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.576694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.576699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.576789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.576893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.576972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.577053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.577139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.577144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.577237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.577318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.577398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.577477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.577527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.577530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.577602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.577668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.577737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.577802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.577848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.577851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.577930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.577997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.578068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.578141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.578188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.578191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.578269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.578334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.578403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.578472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.578518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.578521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.578592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.578654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.578719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.578784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.578827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.578830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.578902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.578973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.579037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.579104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.579155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.579159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.579236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.579304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.579375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.579449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.579498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.579501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.579593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:29.579676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:29.579745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:29.579813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:29.580168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:29.580172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:29.580216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:29.580285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.580304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.580307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:29.580341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:29.580355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:29.580359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:29.580362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:29.580365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:29.581577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:29.581620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:29.581630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:29.581634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:29.581639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:29.581643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:29.584753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:29.584794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:29.584823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:29.584826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:29.584831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:29.584835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:29.585956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:29.585988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:29.585995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:29.586002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:29.586007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:29.587313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:29.587330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:29.587342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392569585
2025-10-02T08:09:29.587530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:29.587538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:29.587543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:29.587546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:29.587549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:29.587551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:29.588042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:29.588063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:29.588068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:29.588071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:29.588073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:29.588076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:29.588560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:29.588570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:29.588577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:29.588581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:29.588584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:29.588586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:29.589164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:29.589185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:29.589189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:29.590428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:29.590435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:29.590442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:29.590447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:29.590457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392569590
2025-10-02T08:09:29.590772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:29.590782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:29.590787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:29.590789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:29.590792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:29.590795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:29.591290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:29.591300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:29.591304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:29.591308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:29.591311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:29.591314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:29.591794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:29.591804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.591903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392569591
2025-10-02T08:09:29.592935Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:29.592957Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:29.592963Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:29.592971Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:29.594826Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:29.594843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:29.594845Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:29.594856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533546078921806:8253]
2025-10-02T08:09:29.594863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533546078921806:8253]
2025-10-02T08:09:29.594917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:29.594933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:29.594937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.594939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:29.594945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:29.595094Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:29.599327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533546078921849:8017]
2025-10-02T08:09:29.599552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 627, pipe: [1:7556533546078921849:8017]
2025-10-02T08:09:29.751962Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:29.752680Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:29.752390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533546078921849:8017], now have 1 active actors on pipe
2025-10-02T08:09:29.752978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533546078921849:8017]
2025-10-02T08:09:29.753010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:29.753012Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:29.753019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:29.753060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 628 reason: error at write: Disconnected sessionId: src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0
2025-10-02T08:09:29.753387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:29.753397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0] Write session will restart in 0.008891s
2025-10-02T08:09:29.753421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0] Write session: Do CDS request
2025-10-02T08:09:29.753430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:29.753627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 628 sessionId: src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0 is DEAD
2025-10-02T08:09:29.764433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:29.764676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:29.764693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 629
2025-10-02T08:09:29.765113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:29.765150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:29.765155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:29.765160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:29.765832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 629 sessionId:  describe result for acl check
2025-10-02T08:09:29.765871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:29.765873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:29.765874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:29.765880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533546078922098:8272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:29.766514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533546078922098:8272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:29.772095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533546078922098:8272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:29.783873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533546078922098:8272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:29.783893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533546078922098:8272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:29.783897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533546078922098:8272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:29.783909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:29.786705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:29.788979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:29.789258Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:29.789263Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:29.789275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:29.789336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:29.789374Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533546078922314:8271]
2025-10-02T08:09:29.790041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:29.790385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:29.790442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:29.790771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:29.790835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.790842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.790843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.790845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.790847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.790854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.790865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.790869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.790880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.790884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.790890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.790903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:29.790910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.790918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:29.790928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.790934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:29.790938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.790944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.790949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.790953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.790973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:29.802685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:29.806589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 628
2025-10-02T08:09:29.805255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:29.805284Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:29.805287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:29.805292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:29.805302Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 628 [1:7556533546078922314:8271]
2025-10-02T08:09:29.805319Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:29.805342Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:29.805348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.805352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.805354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.805377Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:29.805383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:29.805390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:29.805471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.805473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.805478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:29.805480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:29.805553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:29.805555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.805570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:29.805581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:29.805599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533546078922308:8271]
2025-10-02T08:09:29.805601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533546078922308:8271]
2025-10-02T08:09:29.805615Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:29.805628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:29.805642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:29.805644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:29.805689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533546078922308:8271]
2025-10-02T08:09:29.805693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:29.806166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:29.806170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:29.806175Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:29.806905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 628
2025-10-02T08:09:29.806926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533546078922294:8272], now have 1 active actors on pipe
2025-10-02T08:09:29.806931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533546539148131:2378], now have 1 active actors on pipe
2025-10-02T08:09:29.807174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.807187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.807219Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bafb9df6-8361021e-cea787a8-949dde8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:29.807229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:29.807234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:29.807237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:29.807249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:29.807266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:29.807285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:29.807334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.807337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.807352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:29.807387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 629 partition: 0 MaxSeqNo: 17 sessionId: src_id|bafb9df6-8361021e-cea787a8-949dde8e_0
2025-10-02T08:09:29.807920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f86274-28bd2503-c8a2c9fe-fd29785c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bafb9df6-8361021e-cea787a8-949dde8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:29.810970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bafb9df6-8361021e-cea787a8-949dde8e_0] Write session: try to update token
2025-10-02T08:09:29.810987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bafb9df6-8361021e-cea787a8-949dde8e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:29.831984Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:29.832001Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:29.832003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:29.832012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533546078922308:8271]
2025-10-02T08:09:29.832015Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533546078922308:8271]
2025-10-02T08:09:29.832055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:29.832061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:29.832063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:29.832211Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:29.832874Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:29.832894Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:29.840277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId: src_id|bafb9df6-8361021e-cea787a8-949dde8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:29.843396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:29.853609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533546078922339:8017]
2025-10-02T08:09:29.860480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 628, pipe: [1:7556533546078922339:8017]
2025-10-02T08:09:29.984034Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:29.984520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:29.984529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:29.984574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533546078922339:8017], now have 1 active actors on pipe
2025-10-02T08:09:29.984796Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:29.984796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:29.984820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:29.985285Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:29.984927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 629 reason: error at write: Disconnected sessionId: src_id|bafb9df6-8361021e-cea787a8-949dde8e_0
2025-10-02T08:09:29.985158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533546078922339:8017]
2025-10-02T08:09:29.985172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 629 sessionId: src_id|bafb9df6-8361021e-cea787a8-949dde8e_0 is DEAD
2025-10-02T08:09:29.989195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafb9df6-8361021e-cea787a8-949dde8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:29.989206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafb9df6-8361021e-cea787a8-949dde8e_0] Write session will restart in 0.006057s
2025-10-02T08:09:29.989237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafb9df6-8361021e-cea787a8-949dde8e_0] Write session: Do CDS request
2025-10-02T08:09:29.989246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafb9df6-8361021e-cea787a8-949dde8e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:29.997495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bafb9df6-8361021e-cea787a8-949dde8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.001248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:30.001267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 630
2025-10-02T08:09:30.005069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.005155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:30.005162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:30.005169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:30.010190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 630 sessionId:  describe result for acl check
2025-10-02T08:09:30.010242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:30.010244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:30.010246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:30.010252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533550373890016:8279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:30.010722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533550373890016:8279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:30.014286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:30.016819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:30.017086Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:30.017091Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:30.017102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:30.017159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:30.017196Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533550373890041:8278]
2025-10-02T08:09:30.017868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:30.018084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:30.018133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:30.018484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:30.018541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.018542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.018543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.018544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.018546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.018551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.018563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.018567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.018571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.018575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.018580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.018588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.018594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.018599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.018616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.018621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.018626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.018631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.018636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.018641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.018661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:30.019466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533550373890016:8279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:30.034001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533550373890016:8279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:30.034025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533550373890016:8279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:30.034030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533550373890016:8279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:30.034041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:30.037498Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 629
2025-10-02T08:09:30.034886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:30.037030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:30.037038Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:30.037041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:30.037044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:30.037052Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 629 [1:7556533550373890041:8278]
2025-10-02T08:09:30.037065Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:30.037087Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:30.037090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.037094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.037097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.037115Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:30.037121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:30.037129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:30.037199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.037201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.037205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:30.037208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:30.037287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:30.037290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.037305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.037316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:30.037336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373890075:8279], now have 1 active actors on pipe
2025-10-02T08:09:30.037339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533546539148140:2378], now have 1 active actors on pipe
2025-10-02T08:09:30.037346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533550373890030:8278]
2025-10-02T08:09:30.037348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533550373890030:8278]
2025-10-02T08:09:30.037347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 629
2025-10-02T08:09:30.037362Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:30.037376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.037382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.037403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:30.037418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:30.037421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:30.037468Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:30.037474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.037478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.037480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:30.037490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.037494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:30.037497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:30.037500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:30.037511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533550373890030:8278]
2025-10-02T08:09:30.037515Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:30.037517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:30.037540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.037631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.037641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.037676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.037756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 630 partition: 0 MaxSeqNo: 17 sessionId: src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0
2025-10-02T08:09:30.040932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bafb9df6-8361021e-cea787a8-949dde8e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:30.044087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0] Write session: try to update token
2025-10-02T08:09:30.044118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:30.058482Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:30.058500Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:30.058503Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:30.058514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533550373890030:8278]
2025-10-02T08:09:30.058519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533550373890030:8278]
2025-10-02T08:09:30.058571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:30.058580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.058582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:30.058770Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:30.060960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:30.060983Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:30.083646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId: src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:30.086979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:30.087080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533550373890091:8017]
2025-10-02T08:09:30.087231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 629, pipe: [1:7556533550373890091:8017]
2025-10-02T08:09:30.211001Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:30.211635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.211653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.211678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373890091:8017], now have 1 active actors on pipe
2025-10-02T08:09:30.211848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533550373890091:8017]
2025-10-02T08:09:30.211880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:30.211883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:30.211940Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:30.211954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 630 reason: error at write: Disconnected sessionId: src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0
2025-10-02T08:09:30.212158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 630 sessionId: src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0 is DEAD
2025-10-02T08:09:30.212402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:30.212419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0] Write session will restart in 0.006888s
2025-10-02T08:09:30.212448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0] Write session: Do CDS request
2025-10-02T08:09:30.212460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:30.212266Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:30.220481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.220636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:30.220655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 631
2025-10-02T08:09:30.220874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.220949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:30.220963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:30.220970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:30.221521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 631 sessionId:  describe result for acl check
2025-10-02T08:09:30.221559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:30.221561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:30.221563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:30.221568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533550373890282:8285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:30.222214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533550373890282:8285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:30.226637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533550373890282:8285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:30.230729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533550373890282:8285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:30.230750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533550373890282:8285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:30.230754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533550373890282:8285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:30.230765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:30.241165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:30.242906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:30.243202Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:30.243216Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:30.243231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:30.243302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:30.243513Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533550373890522:8284]
2025-10-02T08:09:30.244328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:30.249229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:30.249344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:30.249869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:30.249937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.249946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.249948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.249949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.249951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.249960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.249972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.249978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.249982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.249992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.250003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.250015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.250022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.250030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.250037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.250044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.250050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.250057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.250063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.250076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.250101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:30.261396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:30.263426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:30.263441Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:30.263444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:30.263447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:30.263455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 630 [1:7556533550373890522:8284]
2025-10-02T08:09:30.263469Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:30.263489Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:30.263492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.263495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.263498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.263516Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:30.263522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:30.263530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:30.263616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.263626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.263629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:30.263633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:30.263708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:30.263771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.263791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.263804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:30.263826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373890382:8285], now have 1 active actors on pipe
2025-10-02T08:09:30.263830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533550834115443:2378], now have 1 active actors on pipe
2025-10-02T08:09:30.263837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533550373890516:8284]
2025-10-02T08:09:30.263837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 630
2025-10-02T08:09:30.263840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533550373890516:8284]
2025-10-02T08:09:30.263856Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:30.263872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.263872Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:30.263875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:30.263876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.263893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:30.263909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:30.263913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:30.263962Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:30.263968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.263973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.263975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:30.263986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.263997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:30.264011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533550373890516:8284]
2025-10-02T08:09:30.264022Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:30.264046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.264075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:30.264283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.264293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.264315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.264369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 631 partition: 0 MaxSeqNo: 17 sessionId: src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0
2025-10-02T08:09:30.264837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ec8456-4251893c-fd5f5c0b-3fff98de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:30.268169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0] Write session: try to update token
2025-10-02T08:09:30.268192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:30.263943Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 630
2025-10-02T08:09:30.288569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId: src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:30.289640Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:30.289665Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:30.289668Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:30.289678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533550373890516:8284]
2025-10-02T08:09:30.289684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533550373890516:8284]
2025-10-02T08:09:30.289729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:30.289743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.289743Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:30.289745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:30.289751Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:30.289927Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:30.292112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:30.312077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533550373890546:8017]
2025-10-02T08:09:30.312373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 630, pipe: [1:7556533550373890546:8017]
2025-10-02T08:09:30.448591Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:30.448970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.448989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.449024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373890546:8017], now have 1 active actors on pipe
2025-10-02T08:09:30.449113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:30.449120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:30.449178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 631 reason: error at write: Disconnected sessionId: src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0
2025-10-02T08:09:30.449270Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:30.449294Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:30.449395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 631 sessionId: src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0 is DEAD
2025-10-02T08:09:30.449572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533550373890546:8017]
2025-10-02T08:09:30.452142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:30.452161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0] Write session will restart in 0.006315s
2025-10-02T08:09:30.452218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0] Write session: Do CDS request
2025-10-02T08:09:30.452226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:30.462196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.462256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:30.462285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 632
2025-10-02T08:09:30.462445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.462481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:30.462493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:30.462497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:30.462968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 632 sessionId:  describe result for acl check
2025-10-02T08:09:30.463017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:30.463023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:30.463025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:30.463030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533550373890811:8291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:30.463630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533550373890811:8291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:30.467134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533550373890811:8291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:30.479365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:30.479643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533550373890811:8291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:30.479662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533550373890811:8291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:30.479667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533550373890811:8291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:30.479676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:30.485868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:30.486155Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:30.486159Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:30.486170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:30.486230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:30.486273Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533550373890984:8290]
2025-10-02T08:09:30.487004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:30.487984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:30.488043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:30.488428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:30.488472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.488473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.488474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.488476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.488477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.488484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.488495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.488500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.488504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.488509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.488515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.488524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.488531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.488538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.488547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.488553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.488558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.488563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.488569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.488574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.488597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:30.507962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:30.510272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:30.510293Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:30.510296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:30.510299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:30.510307Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 631 [1:7556533550373890984:8290]
2025-10-02T08:09:30.510323Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:30.510344Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:30.510347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.510351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.510353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.510371Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:30.510377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:30.510385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:30.510469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.510479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.510483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:30.510485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:30.510636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:30.510646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.510662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.510674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:30.510696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373890980:8291], now have 1 active actors on pipe
2025-10-02T08:09:30.510704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533550834115464:2378], now have 1 active actors on pipe
2025-10-02T08:09:30.510711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533550373890972:8290]
2025-10-02T08:09:30.510714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533550373890972:8290]
2025-10-02T08:09:30.510721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:30.510738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:30.510751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:30.510761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:30.510798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533550373890972:8290]
2025-10-02T08:09:30.510804Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:30.510830Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:30.510840Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:30.510847Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:30.510848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 631
2025-10-02T08:09:30.510920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.510930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.510964Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a3bd03-36477695-99119ee7-2541dcda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:30.510975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.510981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.510983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:30.510994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.511005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:30.511025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.511115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.511124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.511140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.511178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 632 partition: 0 MaxSeqNo: 17 sessionId: src_id|4a3bd03-36477695-99119ee7-2541dcda_0
2025-10-02T08:09:30.511696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bedd2e-fd2be7c8-59391f5e-b7f5190d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4a3bd03-36477695-99119ee7-2541dcda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:30.511887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 631
2025-10-02T08:09:30.515096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3bd03-36477695-99119ee7-2541dcda_0] Write session: try to update token
2025-10-02T08:09:30.515123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3bd03-36477695-99119ee7-2541dcda_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:30.533845Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:30.533869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:30.533872Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:30.533881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533550373890972:8290]
2025-10-02T08:09:30.533886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533550373890972:8290]
2025-10-02T08:09:30.533936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:30.533944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.533946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:30.534132Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:30.536869Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:30.536892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:30.547002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId: src_id|4a3bd03-36477695-99119ee7-2541dcda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:30.550591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:30.550859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533550373891023:8017]
2025-10-02T08:09:30.551397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 631, pipe: [1:7556533550373891023:8017]
2025-10-02T08:09:30.696545Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:30.696851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.696868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.696888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373891023:8017], now have 1 active actors on pipe
2025-10-02T08:09:30.697116Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:30.697140Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:30.697570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533550373891023:8017]
2025-10-02T08:09:30.697596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:30.697650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 632 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a3bd03-36477695-99119ee7-2541dcda_0
2025-10-02T08:09:30.697853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 632 sessionId: src_id|4a3bd03-36477695-99119ee7-2541dcda_0 is DEAD
2025-10-02T08:09:30.698072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3bd03-36477695-99119ee7-2541dcda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:30.698087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3bd03-36477695-99119ee7-2541dcda_0] Write session will restart in 0.006790s
2025-10-02T08:09:30.698134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3bd03-36477695-99119ee7-2541dcda_0] Write session: Do CDS request
2025-10-02T08:09:30.698143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3bd03-36477695-99119ee7-2541dcda_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:30.706545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:30.706586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3bd03-36477695-99119ee7-2541dcda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.706564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 633
2025-10-02T08:09:30.706862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.706900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:30.706905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:30.706909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:30.707474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 633 sessionId:  describe result for acl check
2025-10-02T08:09:30.707519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:30.707526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:30.707527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:30.707533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533550373891333:8305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:30.708269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533550373891333:8305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:30.711468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533550373891333:8305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:30.713275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:30.715344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:30.715937Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:30.715953Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:30.715967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:30.716033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:30.716075Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533550373891481:8304]
2025-10-02T08:09:30.716788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:30.716901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533550373891333:8305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:30.716915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533550373891333:8305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:30.716918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533550373891333:8305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:30.716926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:30.717070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:30.717121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:30.717450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:30.717495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.717502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.717503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.717505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.717506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.717511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.717520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.717524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.717528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.717532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.717537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.717545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.717551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.717556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.717560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.717570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.717574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.717579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.717584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.717593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.717616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:30.726712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:30.728508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:30.728523Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:30.728527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:30.728530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:30.728537Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 632 [1:7556533550373891481:8304]
2025-10-02T08:09:30.728548Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:30.728564Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:30.728567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.728569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.728573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.728587Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:30.728592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:30.728600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:30.728666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.728673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.728675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:30.728678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:30.728743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:30.728752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.728765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.728778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:30.728814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 632
2025-10-02T08:09:30.728818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373891491:8305], now have 1 active actors on pipe
2025-10-02T08:09:30.728826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533550373891454:8304]
2025-10-02T08:09:30.728828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533550373891454:8304]
2025-10-02T08:09:30.728840Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:30.728849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533550834115472:2378], now have 1 active actors on pipe
2025-10-02T08:09:30.728855Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:30.728856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.728859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:30.728860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.728877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:30.728891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:30.728894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:30.728937Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35949e08-c0c72948-488648e1-ab9d8502_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:30.728949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.728952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.728955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:30.728929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 632
2025-10-02T08:09:30.728966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.728981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:30.728993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533550373891454:8304]
2025-10-02T08:09:30.729005Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:30.729013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:30.729040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.729140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.729155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.729193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.729249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 633 partition: 0 MaxSeqNo: 17 sessionId: src_id|35949e08-c0c72948-488648e1-ab9d8502_0
2025-10-02T08:09:30.729703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3bd03-36477695-99119ee7-2541dcda_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|35949e08-c0c72948-488648e1-ab9d8502_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:30.732777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35949e08-c0c72948-488648e1-ab9d8502_0] Write session: try to update token
2025-10-02T08:09:30.732821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35949e08-c0c72948-488648e1-ab9d8502_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:30.747964Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:30.747988Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:30.747990Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:30.747999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533550373891454:8304]
2025-10-02T08:09:30.748003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533550373891454:8304]
2025-10-02T08:09:30.748054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:30.748057Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:30.748061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.748063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:30.748064Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:30.748250Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:30.751721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId: src_id|35949e08-c0c72948-488648e1-ab9d8502_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:30.755220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:30.797926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533550373891520:8017]
2025-10-02T08:09:30.798053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 632, pipe: [1:7556533550373891520:8017]
2025-10-02T08:09:30.897567Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:30.897873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.897905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.897972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373891520:8017], now have 1 active actors on pipe
2025-10-02T08:09:30.898089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533550373891520:8017]
2025-10-02T08:09:30.898110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:30.898116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:30.898171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 633 reason: error at write: Disconnected sessionId: src_id|35949e08-c0c72948-488648e1-ab9d8502_0
2025-10-02T08:09:30.898232Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:30.898260Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:30.898369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 633 sessionId: src_id|35949e08-c0c72948-488648e1-ab9d8502_0 is DEAD
2025-10-02T08:09:30.898568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35949e08-c0c72948-488648e1-ab9d8502_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:30.898585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35949e08-c0c72948-488648e1-ab9d8502_0] Write session will restart in 0.005211s
2025-10-02T08:09:30.898619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35949e08-c0c72948-488648e1-ab9d8502_0] Write session: Do CDS request
2025-10-02T08:09:30.898627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35949e08-c0c72948-488648e1-ab9d8502_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:30.905450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35949e08-c0c72948-488648e1-ab9d8502_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.905429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:30.905443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 634
2025-10-02T08:09:30.905760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:30.905791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:30.905801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:30.905805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:30.906326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 634 sessionId:  describe result for acl check
2025-10-02T08:09:30.906364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:30.906375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:30.906382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:30.906387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533550373891805:8317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:30.906896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533550373891805:8317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:30.910190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533550373891805:8317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:30.911666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:30.913070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:30.913242Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:30.913257Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:30.913266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:30.913307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:30.913439Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533550373891953:8316]
2025-10-02T08:09:30.913565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533550373891805:8317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:30.913578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533550373891805:8317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:30.913582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533550373891805:8317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:30.913590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:30.914124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:30.914301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:30.914344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:30.914664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:30.914705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.914710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.914711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.914713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.914714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.914719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.914729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.914733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.914737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.914745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.914751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.914758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:30.914768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.914774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:30.914783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.914793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:30.914801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.914812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.914820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.914829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.914854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:30.923888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:30.925917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:30.925944Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:30.925947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:30.925952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:30.925961Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 633 [1:7556533550373891953:8316]
2025-10-02T08:09:30.925976Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:30.925997Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:30.926001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.926004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.926006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.926026Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:30.926033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:30.926041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:30.926116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.926124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.926128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:30.926131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:30.926208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:30.926216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.926232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:30.926247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:30.926266Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533550373891947:8316]
2025-10-02T08:09:30.926275Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533550373891947:8316]
2025-10-02T08:09:30.926283Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:30.926295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:30.926311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:30.926323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:30.926332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:30.926335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373891958:8317], now have 1 active actors on pipe
2025-10-02T08:09:30.926336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 633
2025-10-02T08:09:30.926355Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:30.926370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533550373891947:8316]
2025-10-02T08:09:30.926373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:30.926381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533550834115502:2378], now have 1 active actors on pipe
2025-10-02T08:09:30.926386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.926398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.926443Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:30.926455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:30.926458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:30.926461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:30.926483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:30.926496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:30.926524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.926541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:30.926644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 633
2025-10-02T08:09:30.926702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:30.926718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:30.926752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:30.926818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 634 partition: 0 MaxSeqNo: 17 sessionId: src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0
2025-10-02T08:09:30.927234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35949e08-c0c72948-488648e1-ab9d8502_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:30.931232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0] Write session: try to update token
2025-10-02T08:09:30.931252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:30.947544Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:30.947581Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:30.947584Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:30.947595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533550373891947:8316]
2025-10-02T08:09:30.947600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533550373891947:8316]
2025-10-02T08:09:30.947646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:30.947652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:30.947655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:30.947656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:30.947674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:30.947826Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:30.952834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId: src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:30.957577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:30.998084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533550373891983:8017]
2025-10-02T08:09:30.998209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 633, pipe: [1:7556533550373891983:8017]
2025-10-02T08:09:31.086467Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:31.086765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.086776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.086796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533550373891983:8017], now have 1 active actors on pipe
2025-10-02T08:09:31.086906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:31.086917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:31.086982Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:31.086996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 634 reason: error at write: Disconnected sessionId: src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0
2025-10-02T08:09:31.087042Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:31.087201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 634 sessionId: src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0 is DEAD
2025-10-02T08:09:31.087238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533550373891983:8017]
2025-10-02T08:09:31.087345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:31.087357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0] Write session will restart in 0.007244s
2025-10-02T08:09:31.087386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0] Write session: Do CDS request
2025-10-02T08:09:31.087393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:31.095401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:31.095476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:31.095495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 635
2025-10-02T08:09:31.095647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:31.095678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:31.095688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:31.095692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:31.096115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 635 sessionId:  describe result for acl check
2025-10-02T08:09:31.096150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:31.096152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:31.096153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:31.096158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533554668859586:8324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:31.096679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533554668859586:8324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:31.099853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533554668859586:8324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:31.101527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:31.103544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:31.103732Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:31.103741Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:31.103749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:31.103800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:31.103840Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533554668859712:8323]
2025-10-02T08:09:31.104016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533554668859586:8324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:31.104033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533554668859586:8324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:31.104037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533554668859586:8324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:31.104045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:31.104317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:31.104459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:31.104495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:31.104744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:31.104899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.104908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.104909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.104910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.104911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.104917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.104927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.104932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.104935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.104938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.104944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.104950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.104956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.104960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.104964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.104968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.104972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.104976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.104982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.104986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.105009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:31.113235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:31.115041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:31.115069Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:31.115073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:31.115078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:31.115086Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 634 [1:7556533554668859712:8323]
2025-10-02T08:09:31.115100Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:31.115126Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:31.115135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.115139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.115141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.115160Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:31.115170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:31.115181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:31.115259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.115271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.115274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:31.115278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:31.115355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:31.115364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.115380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.115400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:31.115420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533554668859706:8323]
2025-10-02T08:09:31.115422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533554668859706:8323]
2025-10-02T08:09:31.115431Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:31.115444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:31.115447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533554668859717:8324], now have 1 active actors on pipe
2025-10-02T08:09:31.115447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:31.115451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533555129082805:2378], now have 1 active actors on pipe
2025-10-02T08:09:31.115460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:31.115473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:31.115477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:31.115515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533554668859706:8323]
2025-10-02T08:09:31.115525Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:31.115526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 634
2025-10-02T08:09:31.115543Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:31.115545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.115515Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 634
2025-10-02T08:09:31.115549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.115608Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:31.115621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.115631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.115634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:31.115648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.115668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:31.115696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:31.115741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.115750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.115765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:31.115807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 635 partition: 0 MaxSeqNo: 17 sessionId: src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0
2025-10-02T08:09:31.116167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ce91b-ef7d4917-9b9f7808-f170a43a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:31.119487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0] Write session: try to update token
2025-10-02T08:09:31.119509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:31.139725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:31.139747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:31.139749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:31.139758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533554668859706:8323]
2025-10-02T08:09:31.139762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533554668859706:8323]
2025-10-02T08:09:31.139811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:31.139818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.139821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:31.139978Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:31.140948Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:31.140961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:31.143662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId: src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:31.147601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:31.187723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533554668859742:8017]
2025-10-02T08:09:31.187875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 634, pipe: [1:7556533554668859742:8017]
2025-10-02T08:09:31.315954Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:31.316452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.316464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.316505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533554668859742:8017], now have 1 active actors on pipe
2025-10-02T08:09:31.316649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:31.316657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:31.316712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 635 reason: error at write: Disconnected sessionId: src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0
2025-10-02T08:09:31.316818Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:31.316914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 635 sessionId: src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0 is DEAD
2025-10-02T08:09:31.317046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533554668859742:8017]
2025-10-02T08:09:31.317453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:31.317471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0] Write session will restart in 0.008586s
2025-10-02T08:09:31.317503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0] Write session: Do CDS request
2025-10-02T08:09:31.317513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:31.320907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:31.327757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:31.328519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:31.328539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 636
2025-10-02T08:09:31.328765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:31.328797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:31.328826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:31.328829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:31.333478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 636 sessionId:  describe result for acl check
2025-10-02T08:09:31.333523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:31.333525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:31.333526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:31.333532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533554668859984:8330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:31.334175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533554668859984:8330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:31.344846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533554668859984:8330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:31.346003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:31.347685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:31.347971Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:31.347984Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:31.347997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:31.348056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:31.348104Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533554668860177:8329]
2025-10-02T08:09:31.348794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:31.349051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:31.349102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:31.349439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:31.349479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.349485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.349487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.349488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.349489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.349494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.349505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.349509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.349513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.349516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.349523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.349530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.349536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.349541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.349546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.349551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.349556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.349566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.349571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.349576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.349602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:31.358382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533554668859984:8330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:31.358402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533554668859984:8330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:31.358407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533554668859984:8330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:31.358418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:31.360778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:31.362664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:31.362671Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:31.362676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:31.362680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:31.362689Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 635 [1:7556533554668860177:8329]
2025-10-02T08:09:31.362702Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:31.362722Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:31.362725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.362728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.362730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.362748Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:31.362753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:31.362759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:31.362829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.362832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.362838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:31.362841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:31.362922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:31.362925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.362939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.362950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:31.362970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533554668860194:8330], now have 1 active actors on pipe
2025-10-02T08:09:31.362978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533554668860171:8329]
2025-10-02T08:09:31.362981Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533554668860171:8329]
2025-10-02T08:09:31.362989Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:31.362991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 635
2025-10-02T08:09:31.362999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533555129082811:2378], now have 1 active actors on pipe
2025-10-02T08:09:31.362999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:31.363001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:31.363006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:31.363019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:31.363022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:31.363030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.363035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.363080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533554668860171:8329]
2025-10-02T08:09:31.363089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:31.363093Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:31.363107Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|150524de-a86492e7-a5067aba-2b69b469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:31.363115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.363119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.363121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:31.363130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.363143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:31.363186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:31.363230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.363232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.363246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:31.363282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 636 partition: 0 MaxSeqNo: 17 sessionId: src_id|150524de-a86492e7-a5067aba-2b69b469_0
2025-10-02T08:09:31.363697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa1fe54-b16615cf-b6ee795-c48c994d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|150524de-a86492e7-a5067aba-2b69b469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:31.364984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 635
2025-10-02T08:09:31.367162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150524de-a86492e7-a5067aba-2b69b469_0] Write session: try to update token
2025-10-02T08:09:31.367184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150524de-a86492e7-a5067aba-2b69b469_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:31.393427Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:31.393449Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:31.393451Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:31.393460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533554668860171:8329]
2025-10-02T08:09:31.393464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533554668860171:8329]
2025-10-02T08:09:31.393509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:31.393510Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:31.393517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.393517Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:31.393519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:31.393683Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:31.395082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId: src_id|150524de-a86492e7-a5067aba-2b69b469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:31.398726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:31.417482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533554668860214:8017]
2025-10-02T08:09:31.417714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 635, pipe: [1:7556533554668860214:8017]
2025-10-02T08:09:31.551881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150524de-a86492e7-a5067aba-2b69b469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:31.551895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150524de-a86492e7-a5067aba-2b69b469_0] Write session will restart in 0.006297s
2025-10-02T08:09:31.551915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150524de-a86492e7-a5067aba-2b69b469_0] Write session: Do CDS request
2025-10-02T08:09:31.551920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150524de-a86492e7-a5067aba-2b69b469_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:31.550501Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:31.550913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.550922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.550966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533554668860214:8017], now have 1 active actors on pipe
2025-10-02T08:09:31.551108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533554668860214:8017]
2025-10-02T08:09:31.551129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:31.551131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:31.551189Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:31.551193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 636 reason: error at write: Disconnected sessionId: src_id|150524de-a86492e7-a5067aba-2b69b469_0
2025-10-02T08:09:31.551372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 636 sessionId: src_id|150524de-a86492e7-a5067aba-2b69b469_0 is DEAD
2025-10-02T08:09:31.553738Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:31.559340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150524de-a86492e7-a5067aba-2b69b469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:31.560952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:31.560971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 637
2025-10-02T08:09:31.561119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:31.561145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:31.561151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:31.561155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:31.561821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 637 sessionId:  describe result for acl check
2025-10-02T08:09:31.561859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:31.561860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:31.561863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:31.561868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533554668860264:8338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:31.562988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533554668860264:8338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:31.567004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533554668860264:8338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:31.582969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533554668860264:8338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:31.582992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533554668860264:8338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:31.582996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533554668860264:8338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:31.583007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:31.593944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:31.596266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:31.596506Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:31.596517Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:31.596528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:31.596592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:31.596640Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533554668860674:8337]
2025-10-02T08:09:31.597290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:31.597532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:31.597604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:31.597870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:31.597923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.597929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.597930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.597930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.597931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.597935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.597943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.597945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.597947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.597950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.597954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.597959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.597963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.597966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.597969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.597973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.597977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.597980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.597982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.597985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.597997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:31.606508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:31.608242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:31.608264Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:31.608267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:31.608270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:31.608275Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 636 [1:7556533554668860674:8337]
2025-10-02T08:09:31.608286Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:31.608300Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:31.608302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.608304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.608306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.608320Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:31.608324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:31.608329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:31.608388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.608394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.608397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:31.608399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:31.608455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:31.608461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.608472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.608478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:31.608495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533554668860668:8337]
2025-10-02T08:09:31.608501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533554668860668:8337]
2025-10-02T08:09:31.608514Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:31.608530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:31.608548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:31.608551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:31.608581Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:31.608590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533554668860668:8337]
2025-10-02T08:09:31.608590Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:31.608592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:31.608595Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:31.608662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 636
2025-10-02T08:09:31.608677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533554668860519:8338], now have 1 active actors on pipe
2025-10-02T08:09:31.608932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.608949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.608971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533555129082831:2378], now have 1 active actors on pipe
2025-10-02T08:09:31.608992Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2074a9f-618478bc-21dab12-20b69ac3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:31.609004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.609013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.609015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:31.609026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.609042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:31.609068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:31.608883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 636
2025-10-02T08:09:31.609484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.609498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.609521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:31.609569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 637 partition: 0 MaxSeqNo: 17 sessionId: src_id|2074a9f-618478bc-21dab12-20b69ac3_0
2025-10-02T08:09:31.609942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150524de-a86492e7-a5067aba-2b69b469_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2074a9f-618478bc-21dab12-20b69ac3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:31.613232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2074a9f-618478bc-21dab12-20b69ac3_0] Write session: try to update token
2025-10-02T08:09:31.613252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2074a9f-618478bc-21dab12-20b69ac3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:31.629277Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:31.629298Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:31.629301Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:31.629310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533554668860668:8337]
2025-10-02T08:09:31.629315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533554668860668:8337]
2025-10-02T08:09:31.629362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:31.629369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.629372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:31.629564Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:31.630772Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:31.630786Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:31.634841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId: src_id|2074a9f-618478bc-21dab12-20b69ac3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:31.638037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:31.651652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533554668860698:8017]
2025-10-02T08:09:31.651822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 636, pipe: [1:7556533554668860698:8017]
2025-10-02T08:09:31.787272Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:31.787798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.787815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.787859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533554668860698:8017], now have 1 active actors on pipe
2025-10-02T08:09:31.788319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:31.788332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:31.788369Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:31.788400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 637 reason: error at write: Disconnected sessionId: src_id|2074a9f-618478bc-21dab12-20b69ac3_0
2025-10-02T08:09:31.788598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 637 sessionId: src_id|2074a9f-618478bc-21dab12-20b69ac3_0 is DEAD
2025-10-02T08:09:31.788759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533554668860698:8017]
2025-10-02T08:09:31.789043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2074a9f-618478bc-21dab12-20b69ac3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:31.789059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2074a9f-618478bc-21dab12-20b69ac3_0] Write session will restart in 0.009243s
2025-10-02T08:09:31.789091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2074a9f-618478bc-21dab12-20b69ac3_0] Write session: Do CDS request
2025-10-02T08:09:31.789108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2074a9f-618478bc-21dab12-20b69ac3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:31.790037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:31.799384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2074a9f-618478bc-21dab12-20b69ac3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:31.801031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:31.801049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 638
2025-10-02T08:09:31.806394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:31.806449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:31.806454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:31.806460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:31.807514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 638 sessionId:  describe result for acl check
2025-10-02T08:09:31.807568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:31.807570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:31.807572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:31.807578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533554668860950:8356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:31.808107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533554668860950:8356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:31.824437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533554668860950:8356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:31.829435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:31.830465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533554668860950:8356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:31.830482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533554668860950:8356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:31.830486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533554668860950:8356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:31.830494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:31.832075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:31.832281Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:31.832285Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:31.832295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:31.832344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:31.832381Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533554668861180:8353]
2025-10-02T08:09:31.833110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:31.833365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:31.833406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:31.833716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:31.833767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.833775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.833776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.833777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.833779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.833784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.833794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.833798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.833803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.833808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.833813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.833821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:31.833826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.833831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:31.833835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.833840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:31.833844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.833849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.833854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.833858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.833879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:31.844969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:31.846881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:31.846888Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:31.846889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:31.846892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:31.846896Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 637 [1:7556533554668861180:8353]
2025-10-02T08:09:31.846905Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:31.846921Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:31.846924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.846926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.846927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.846939Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:31.846943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:31.846949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:31.847000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.847002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.847004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:31.847005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:31.847089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:31.847092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.847107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:31.847117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:31.847136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533554668861168:8353]
2025-10-02T08:09:31.847138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533554668861168:8353]
2025-10-02T08:09:31.847147Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:31.847163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533554668861175:8356], now have 1 active actors on pipe
2025-10-02T08:09:31.847169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:31.847170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:31.847173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:31.847182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:31.847184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:31.847219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533555129082852:2378], now have 1 active actors on pipe
2025-10-02T08:09:31.847222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533554668861168:8353]
2025-10-02T08:09:31.847224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:31.847260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 637
2025-10-02T08:09:31.847342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:31.847525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.847535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.847575Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:31.847583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.847587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.847589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:31.847598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.847609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:31.847625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:31.847645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.847647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.847659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:31.847688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 638 partition: 0 MaxSeqNo: 17 sessionId: src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0
2025-10-02T08:09:31.847954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 637
2025-10-02T08:09:31.848131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2074a9f-618478bc-21dab12-20b69ac3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:31.851317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0] Write session: try to update token
2025-10-02T08:09:31.851335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:31.864277Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:31.864295Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:31.864304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533554668861168:8353]
2025-10-02T08:09:31.864347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:31.864555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:31.864716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:31.864887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:31.864895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:31.865052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:31.865262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:31.865297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:31.870735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId: src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:31.874003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:31.874695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.874713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.874756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:31.874783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:31.874912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:31.874922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:31.875120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.875202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.875269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.875335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.875380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.875384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.875456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.875520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.875599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.875673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.875889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.875892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.875970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.876033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.876099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.876167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.876217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.876220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.876291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.876358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.876423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.876489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.876543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.876546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.876619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.876684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.876754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.876872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.876916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.876919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.876992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.877056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.877124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.877193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.877342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.877345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.877423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.877487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.877553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.877621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.877690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.877694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.877758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.877811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.877869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.877929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.877974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.877976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.878038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.878090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.878146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.878203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.878248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.878250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.878312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:31.878365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:31.878420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:31.878474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:31.878518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:31.878520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:31.878555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:31.878609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:31.878623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:31.878626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:31.878652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:31.878665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:31.878668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:31.878670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:31.878672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:31.879084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:31.879096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:31.879100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:31.879104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:31.879107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:31.879109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:31.880241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:31.880273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:31.880280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:31.880283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:31.880287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:31.880290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:31.881000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:31.881022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:31.881027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:31.881031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:31.881035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:31.883586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:31.883603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:31.883617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392571882
2025-10-02T08:09:31.883799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:31.883807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:31.883813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:31.883816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:31.883821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:31.883824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:31.884358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:31.884370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:31.884376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:31.884380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:31.884384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:31.884387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:31.885570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:31.885594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:31.885602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:31.885607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:31.885610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:31.885614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:31.886173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:31.886184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:31.886191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:31.887615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:31.887632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:31.887638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:31.887642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:31.887655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392571887
2025-10-02T08:09:31.888024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:31.888046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:31.888053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:31.888059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:31.888063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:31.888067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:31.888514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533554668861204:8017]
2025-10-02T08:09:31.888627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:31.888640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:31.888647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:31.888651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:31.888656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:31.888660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:31.888697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 637, pipe: [1:7556533554668861204:8017]
2025-10-02T08:09:31.889392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:31.889415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:31.889578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392571889
2025-10-02T08:09:31.890602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533554668861204:8017], now have 1 active actors on pipe
2025-10-02T08:09:31.890610Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:31.890625Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:31.890632Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:31.890638Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:31.895726Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:31.895751Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:31.895754Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:31.895767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533554668861168:8353]
2025-10-02T08:09:31.895771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533554668861168:8353]
2025-10-02T08:09:31.895831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:31.895838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:31.895841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:31.895840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:31.895846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:31.896019Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:32.059907Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:32.060876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:32.061035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:32.061044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0] Write session will restart in 0.007457s
2025-10-02T08:09:32.061069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0] Write session: Do CDS request
2025-10-02T08:09:32.061076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:32.060382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533554668861204:8017]
2025-10-02T08:09:32.060404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:32.060407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:32.060436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 638 reason: error at write: Disconnected sessionId: src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0
2025-10-02T08:09:32.060624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 638 sessionId: src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0 is DEAD
2025-10-02T08:09:32.061451Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:32.069333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.069676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:32.069692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 639
2025-10-02T08:09:32.069867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.069895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:32.069900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:32.069903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:32.070500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 639 sessionId:  describe result for acl check
2025-10-02T08:09:32.070525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:32.070527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:32.070529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:32.070536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533558963828546:8363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:32.071035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533558963828546:8363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:32.078786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533558963828546:8363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:32.084675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:32.087652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:32.087870Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:32.087874Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:32.087883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:32.087924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:32.087961Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533558963828950:8362]
2025-10-02T08:09:32.088761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:32.091005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:32.091079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:32.091467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:32.091503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.091505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.091507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.091508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.091509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.091517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.091527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.091531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.091535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.091538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.091545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.091564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.091570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.091575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.091580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.091585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.091589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.091594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.091600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.091605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.091624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:32.095989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533558963828546:8363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:32.096005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533558963828546:8363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:32.096009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533558963828546:8363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:32.096020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:32.106191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:32.108174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:32.108194Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:32.108197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:32.108201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:32.108207Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 638 [1:7556533558963828950:8362]
2025-10-02T08:09:32.108220Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:32.108236Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:32.108240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.108243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.108245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.108261Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:32.108266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:32.108272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:32.108340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.108348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.108352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:32.108354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:32.108422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:32.108430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.108443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.108458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:32.108479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533558963828944:8362]
2025-10-02T08:09:32.108485Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533558963828944:8362]
2025-10-02T08:09:32.108499Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:32.108528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:32.108546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:32.108553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:32.108589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533558963828944:8362]
2025-10-02T08:09:32.108598Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:32.108714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:32.108721Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:32.108728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:32.108886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 638
2025-10-02T08:09:32.108906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963828966:8363], now have 1 active actors on pipe
2025-10-02T08:09:32.108911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533559424050167:2378], now have 1 active actors on pipe
2025-10-02T08:09:32.108925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.108931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.108959Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:32.108968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.108973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.108976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:32.108987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.108999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:32.109017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:32.109288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.109294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.109311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:32.109343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 639 partition: 0 MaxSeqNo: 17 sessionId: src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0
2025-10-02T08:09:32.109507Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 638
2025-10-02T08:09:32.113287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a40ad6b5-58ab1e89-90832deb-d73868bd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:32.116179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0] Write session: try to update token
2025-10-02T08:09:32.116199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:32.134394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId: src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:32.137673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:32.137810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.137826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.137866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:32.137894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:32.138054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.138065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.138274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.138353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.138416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.138472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.138524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.138529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.138618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.138696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.138778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.138864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.138920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.138923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.139009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.139075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.139144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.139211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.139252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.139255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.139315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.139380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.139447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.139504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.139568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.139576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.139646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.139713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.139781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.139848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.139893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.139896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.139961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.140019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.140078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.140145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.140185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.140190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.140262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.140322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.140390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.140451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.140502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.140505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.140571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.140631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.140688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.140746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.140791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.140792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.140885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.140949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.141025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.141100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.141150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.141158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.141226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.141283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.141343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.141404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.141452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.141461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.141519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:32.141587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.141612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.141619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:32.141648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:32.141664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:32.141669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:32.141672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:32.141674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:32.142096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:32.142124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:32.142133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:32.142141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:32.142144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:32.142147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:32.142796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:32.142821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:32.142827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:32.142830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:32.142834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:32.142837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:32.143289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:32.143299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:32.143303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:32.143305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:32.143306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:32.145638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:32.145659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:32.145672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392572145
2025-10-02T08:09:32.145977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:32.145988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:32.145995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:32.145998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:32.146003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:32.146006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:32.146433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:32.146440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:32.146444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:32.146447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:32.146449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:32.146453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:32.146908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:32.146916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:32.146921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:32.146926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:32.146929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:32.146931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:32.147436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:32.147452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:32.147457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:32.148610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:32.148631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:32.148635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:32.148639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:32.148645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392572148
2025-10-02T08:09:32.148959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:32.148978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:32.148984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:32.148988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:32.148993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:32.148996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:32.149509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:32.149533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:32.149538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:32.149542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:32.149545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:32.149548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:32.150079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:32.150091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.150190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392572150
2025-10-02T08:09:32.152611Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:32.152663Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:32.152675Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:32.152683Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:32.152695Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:32.152700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:32.152702Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:32.152707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533558963828944:8362]
2025-10-02T08:09:32.152717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533558963828944:8362]
2025-10-02T08:09:32.152787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:32.152820Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:32.159957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:32.159973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533558963828984:8017]
2025-10-02T08:09:32.159977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.159980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:32.160125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 638, pipe: [1:7556533558963828984:8017]
2025-10-02T08:09:32.160133Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:32.308558Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:32.308968Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:32.308979Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:32.308989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533558963828944:8362]
2025-10-02T08:09:32.309043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:32.309068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963828984:8017], now have 1 active actors on pipe
2025-10-02T08:09:32.309179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533558963828984:8017]
2025-10-02T08:09:32.309395Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:32.309708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:32.309733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 639 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0
2025-10-02T08:09:32.309977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:32.310089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 639 sessionId: src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0 is DEAD
2025-10-02T08:09:32.310121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:32.310130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0] Write session will restart in 0.006532s
2025-10-02T08:09:32.310154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0] Write session: Do CDS request
2025-10-02T08:09:32.310161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:32.317030Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [ddf52ad386016cca] Result# TEvPutResult {Id# [72075186224037892:638:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:32.317044Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:638:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:32.317098Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:638:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:32.318357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.318430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:32.318448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 640
2025-10-02T08:09:32.318599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.318630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:32.318640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:32.318644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:32.319391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 640 sessionId:  describe result for acl check
2025-10-02T08:09:32.319425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:32.319427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:32.319429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:32.319436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533558963829203:8369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:32.320031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533558963829203:8369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:32.323512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533558963829203:8369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:32.327383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533558963829203:8369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:32.327404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533558963829203:8369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:32.327407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533558963829203:8369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:32.327417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:32.328203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:32.330010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:32.330241Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:32.330249Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:32.330257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:32.330297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:32.330327Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533558963829442:8368]
2025-10-02T08:09:32.330744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:32.330899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:32.330927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:32.331157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:32.331193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.331199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.331200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.331201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.331202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.331206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.331215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.331219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.331222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.331225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.331230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.331237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.331242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.331247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.331251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.331256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.331264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.331270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.331280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.331285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.331306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:32.339585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:32.341413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:32.341431Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:32.341433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:32.341437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:32.341444Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 639 [1:7556533558963829442:8368]
2025-10-02T08:09:32.341458Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:32.341475Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:32.341478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.341481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.341483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.341500Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:32.341506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:32.341513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:32.341580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.341587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.341590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:32.341593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:32.341660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:32.341667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.341681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.341699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:32.341707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 639
2025-10-02T08:09:32.341717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963829424:8369], now have 1 active actors on pipe
2025-10-02T08:09:32.341720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533559424050174:2378], now have 1 active actors on pipe
2025-10-02T08:09:32.341726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533558963829436:8368]
2025-10-02T08:09:32.341728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533558963829436:8368]
2025-10-02T08:09:32.341742Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:32.341755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.341756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:32.341758Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:32.341760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.341849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 639
2025-10-02T08:09:32.341777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:32.341796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:32.341799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:32.341841Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|699a7513-b8c09138-4691e2cc-59cb7600_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:32.341845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.341848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.341850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:32.341856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.341863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:32.341871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533558963829436:8368]
2025-10-02T08:09:32.341880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:32.341898Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:32.341903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:32.341933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.341935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.341947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:32.341979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 640 partition: 0 MaxSeqNo: 17 sessionId: src_id|699a7513-b8c09138-4691e2cc-59cb7600_0
2025-10-02T08:09:32.342360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04686ea-252c5c48-f49c96fe-c404f2fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|699a7513-b8c09138-4691e2cc-59cb7600_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:32.345403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|699a7513-b8c09138-4691e2cc-59cb7600_0] Write session: try to update token
2025-10-02T08:09:32.345428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|699a7513-b8c09138-4691e2cc-59cb7600_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:32.354157Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:32.354176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:32.354185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533558963829436:8368]
2025-10-02T08:09:32.354232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:32.354235Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:32.354410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:32.354556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:32.354706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:32.354847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:32.355040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:32.355078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:32.364746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId: src_id|699a7513-b8c09138-4691e2cc-59cb7600_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:32.367735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:32.368610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.368629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.368667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:32.368695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:32.368784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.368794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.369032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.369120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.369193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.369266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.369430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.369440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.369524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.369595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.369669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.369742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.369797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.369800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.369875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.369947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.370018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.370085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.370134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.370137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.370211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.370280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.370353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.370416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.370461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.370464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.370532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.370599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.370669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.370741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.370787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.370790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.370861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.370921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.370985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.371050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.371197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.371201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.371277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.371348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.371420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.371488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.371539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.371542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.371638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.371706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.371771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.371842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.371892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.371895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.371970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.372035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.372099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.372169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.372221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.372224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.372298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:32.372364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:32.372431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:32.372501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:32.372550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:32.372553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:32.372598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:32.372665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.372682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.372685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:32.372718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:32.372731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:32.372735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:32.372740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:32.372743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:32.373456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:32.373490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:32.373498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:32.373501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:32.373506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:32.373509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:32.374148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:32.374176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:32.374184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:32.374187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:32.374190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:32.374193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:32.374736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:32.374752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:32.374757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:32.374762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:32.374766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:32.376162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:32.376171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:32.376185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392572375
2025-10-02T08:09:32.376303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:32.376310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:32.376316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:32.376320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:32.376324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:32.376328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:32.377009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:32.377030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:32.377036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:32.377040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:32.377043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:32.377046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:32.377579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:32.377590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:32.377601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:32.377607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:32.377610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:32.377613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:32.378133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:32.378145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:32.378150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:32.379400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:32.379407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:32.379414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:32.379418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:32.379429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392572379
2025-10-02T08:09:32.379777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:32.379788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:32.379796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:32.379799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:32.379803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:32.379808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:32.380354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:32.380365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:32.380370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:32.380374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:32.380377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:32.380382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:32.381113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:32.381136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.381269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392572380
2025-10-02T08:09:32.382178Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:32.382192Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:32.382198Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:32.382204Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:32.384011Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:32.384014Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:32.384016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:32.384026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533558963829436:8368]
2025-10-02T08:09:32.384030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533558963829436:8368]
2025-10-02T08:09:32.384091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:32.384097Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:32.384100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:32.384105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.384107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:32.384251Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:32.416926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533558963829477:8017]
2025-10-02T08:09:32.417140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 639, pipe: [1:7556533558963829477:8017]
2025-10-02T08:09:32.555305Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:32.555715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963829477:8017], now have 1 active actors on pipe
2025-10-02T08:09:32.555933Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:32.556335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:32.556370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 640 reason: status is not ok: tablet will be restarted right now sessionId: src_id|699a7513-b8c09138-4691e2cc-59cb7600_0
2025-10-02T08:09:32.556599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 640 sessionId: src_id|699a7513-b8c09138-4691e2cc-59cb7600_0 is DEAD
2025-10-02T08:09:32.556630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533558963829477:8017]
2025-10-02T08:09:32.556740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699a7513-b8c09138-4691e2cc-59cb7600_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:32.556757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699a7513-b8c09138-4691e2cc-59cb7600_0] Write session will restart in 0.009024s
2025-10-02T08:09:32.556786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699a7513-b8c09138-4691e2cc-59cb7600_0] Write session: Do CDS request
2025-10-02T08:09:32.556794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699a7513-b8c09138-4691e2cc-59cb7600_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:32.556848Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:32.568579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|699a7513-b8c09138-4691e2cc-59cb7600_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.569133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:32.569150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 641
2025-10-02T08:09:32.572848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.572897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:32.572907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:32.572911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:32.573368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 641 sessionId:  describe result for acl check
2025-10-02T08:09:32.573398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:32.573404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:32.573405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:32.573410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533558963829805:8377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:32.574011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533558963829805:8377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:32.580146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533558963829805:8377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:32.580648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:32.581160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:32.581327Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:32.581330Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:32.581340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:32.581381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:32.581416Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533558963829938:8376]
2025-10-02T08:09:32.582065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:32.582729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:32.582769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:32.583069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:32.583103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.583104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.583105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.583106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.583107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.583112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.583122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.583126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.583130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.583134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.583140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.583147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.583153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.583158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.583162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.583167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.583171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.583176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.583181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.583185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.583201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:32.583500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533558963829805:8377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:32.583506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533558963829805:8377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:32.583509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533558963829805:8377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:32.583518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:32.595094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:32.596688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:32.596710Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:32.596712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:32.596717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:32.596724Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 640 [1:7556533558963829938:8376]
2025-10-02T08:09:32.596736Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:32.596755Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:32.596757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.596760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.596765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.596780Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:32.596790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:32.596796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:32.596932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.596941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.596944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:32.596947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:32.597010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:32.597017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.597030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.597042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:32.597062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533558963829923:8376]
2025-10-02T08:09:32.597068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533558963829923:8376]
2025-10-02T08:09:32.597080Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:32.597095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:32.597112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:32.597118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:32.597152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533558963829923:8376]
2025-10-02T08:09:32.597159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:32.597387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 640
2025-10-02T08:09:32.597403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963829955:8377], now have 1 active actors on pipe
2025-10-02T08:09:32.597404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:32.597407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:32.597408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533559424050196:2378], now have 1 active actors on pipe
2025-10-02T08:09:32.597412Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:32.597413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.597419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.597504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 640
2025-10-02T08:09:32.597444Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:32.597451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.597455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.597457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:32.597467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.597478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:32.597495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:32.597748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.597757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.597777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:32.597806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 641 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0
2025-10-02T08:09:32.598220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|699a7513-b8c09138-4691e2cc-59cb7600_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:32.601193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0] Write session: try to update token
2025-10-02T08:09:32.601209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:32.621090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId: src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:32.622282Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:32.622287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:32.622292Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:32.622302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533558963829923:8376]
2025-10-02T08:09:32.622305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533558963829923:8376]
2025-10-02T08:09:32.622347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:32.622353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.622355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:32.622416Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:32.622423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:32.622503Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:32.624433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:32.655459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533558963829971:8017]
2025-10-02T08:09:32.655638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 640, pipe: [1:7556533558963829971:8017]
2025-10-02T08:09:32.766531Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:32.766926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.766939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.766977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963829971:8017], now have 1 active actors on pipe
2025-10-02T08:09:32.767259Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:32.767337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533558963829971:8017]
2025-10-02T08:09:32.767364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:32.767369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:32.767430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 641 reason: error at write: Disconnected sessionId: src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0
2025-10-02T08:09:32.767629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 641 sessionId: src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0 is DEAD
2025-10-02T08:09:32.768016Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:32.768456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:32.768474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0] Write session will restart in 0.007272s
2025-10-02T08:09:32.768504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0] Write session: Do CDS request
2025-10-02T08:09:32.768512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:32.777408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.777498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:32.777515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 642
2025-10-02T08:09:32.777706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.777738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:32.777749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:32.777754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:32.778393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 642 sessionId:  describe result for acl check
2025-10-02T08:09:32.778432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:32.778439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:32.778440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:32.778446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533558963830197:8389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:32.779059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533558963830197:8389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:32.781933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533558963830197:8389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:32.786292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533558963830197:8389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:32.786309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533558963830197:8389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:32.786312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533558963830197:8389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:32.786321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:32.788373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:32.790203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:32.790392Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:32.790405Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:32.790416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:32.790466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:32.790519Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533558963830437:8387]
2025-10-02T08:09:32.791312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:32.791494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:32.791537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:32.791928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:32.791993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.791994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.791996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.791997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.791998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.792003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.792013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.792017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.792021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.792025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.792031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.792039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.792046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.792051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.792059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.792065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.792069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.792075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.792079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.792085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.792105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:32.801087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:32.803080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:32.803098Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:32.803100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:32.803104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:32.803110Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 641 [1:7556533558963830437:8387]
2025-10-02T08:09:32.803121Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:32.803140Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:32.803150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.803157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.803159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.803176Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:32.803186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:32.803196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:32.803263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.803272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.803275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:32.803277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:32.803338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:32.803345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.803359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.803376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:32.803400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533559424050203:2378], now have 1 active actors on pipe
2025-10-02T08:09:32.803411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533558963830431:8387]
2025-10-02T08:09:32.803417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533558963830431:8387]
2025-10-02T08:09:32.803433Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:32.803450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963830416:8389], now have 1 active actors on pipe
2025-10-02T08:09:32.803451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:32.803454Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:32.803458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:32.803473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:32.803476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:32.803452Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 641
2025-10-02T08:09:32.803509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533558963830431:8387]
2025-10-02T08:09:32.803517Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:32.803519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:32.803582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 641
2025-10-02T08:09:32.803594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.803598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.803624Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:32.803637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:32.803641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:32.803643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:32.803652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:32.803666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:32.803700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:32.803726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.803733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.803745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:32.803778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 642 partition: 0 MaxSeqNo: 17 sessionId: src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0
2025-10-02T08:09:32.804186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9e8ba3-3a9d5402-1a9592e8-da2c4fb8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:32.807287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0] Write session: try to update token
2025-10-02T08:09:32.807311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:32.822868Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:32.822889Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:32.822892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:32.822901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533558963830431:8387]
2025-10-02T08:09:32.822905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533558963830431:8387]
2025-10-02T08:09:32.822950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:32.822959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:32.822962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.822965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:32.822975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:32.823154Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:32.830963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId: src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:32.834061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:32.867411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533558963830484:8017]
2025-10-02T08:09:32.867600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 641, pipe: [1:7556533558963830484:8017]
2025-10-02T08:09:32.978374Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:32.979163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:32.979187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:32.979210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963830484:8017], now have 1 active actors on pipe
2025-10-02T08:09:32.979491Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:32.979825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533558963830484:8017]
2025-10-02T08:09:32.979844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:32.979900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 642 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0
2025-10-02T08:09:32.980105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 642 sessionId: src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0 is DEAD
2025-10-02T08:09:32.980824Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:32.981115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:32.981132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0] Write session will restart in 0.007216s
2025-10-02T08:09:32.981161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0] Write session: Do CDS request
2025-10-02T08:09:32.981168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:32.991060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.991464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:32.991484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 643
2025-10-02T08:09:32.991702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:32.991739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:32.991745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:32.991751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:32.992299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 643 sessionId:  describe result for acl check
2025-10-02T08:09:32.992335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:32.992341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:32.992342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:32.992348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533558963830844:8402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:32.992867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533558963830844:8402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:32.995486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533558963830844:8402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:32.996222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:32.998193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:32.998394Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:32.998398Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:32.998408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:32.998469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:32.998512Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533558963830935:8401]
2025-10-02T08:09:32.998663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533558963830844:8402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:32.998670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533558963830844:8402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:32.998673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533558963830844:8402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:32.998682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:32.999122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:32.999314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:32.999352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:32.999675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:32.999719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.999720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.999721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.999722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.999723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.999728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.999738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.999742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.999746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.999749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.999755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.999763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:32.999769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.999774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:32.999778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.999783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:32.999788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.999792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:32.999797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.999802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:32.999819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:33.009765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:33.011677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:33.011685Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:33.011687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:33.011691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:33.011697Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 642 [1:7556533558963830935:8401]
2025-10-02T08:09:33.011709Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:33.011730Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:33.011733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.011736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.011738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.011756Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:33.011762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:33.011769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:33.011846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.011848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.011852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:33.011854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:33.011931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:33.011933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.011947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.011958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:33.011976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533558963830926:8401]
2025-10-02T08:09:33.011977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533558963830926:8401]
2025-10-02T08:09:33.011995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:33.012008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:33.012021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:33.012023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:33.012053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533558963830926:8401]
2025-10-02T08:09:33.012055Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:33.012071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:33.012076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:33.012082Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:33.012179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 642
2025-10-02T08:09:33.012197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533558963830940:8402], now have 1 active actors on pipe
2025-10-02T08:09:33.012755Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 642
2025-10-02T08:09:33.012282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533559424050234:2378], now have 1 active actors on pipe
2025-10-02T08:09:33.012298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.012312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.012340Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97602a1-ef79fd44-80866565-eb9345ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:33.012348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.012353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.012355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:33.012368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.012383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:33.012400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.012429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.012431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.012444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.012475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 643 partition: 0 MaxSeqNo: 17 sessionId: src_id|97602a1-ef79fd44-80866565-eb9345ca_0
2025-10-02T08:09:33.012986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d71d08-4177ba9-66e5b51d-b2eb71ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|97602a1-ef79fd44-80866565-eb9345ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:33.016110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97602a1-ef79fd44-80866565-eb9345ca_0] Write session: try to update token
2025-10-02T08:09:33.016142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97602a1-ef79fd44-80866565-eb9345ca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:33.031168Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:33.031190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:33.031193Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:33.031202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533558963830926:8401]
2025-10-02T08:09:33.031209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533558963830926:8401]
2025-10-02T08:09:33.031259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:33.031265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.031268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:33.031272Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:33.031279Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:33.031440Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:33.036635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId: src_id|97602a1-ef79fd44-80866565-eb9345ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:33.041302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:33.080454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533563258798262:8017]
2025-10-02T08:09:33.081052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 642, pipe: [1:7556533563258798262:8017]
2025-10-02T08:09:33.175089Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:33.175526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.175540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.175592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258798262:8017], now have 1 active actors on pipe
2025-10-02T08:09:33.175740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533563258798262:8017]
2025-10-02T08:09:33.175772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:33.175780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:33.175806Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:33.175861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 643 reason: error at write: Disconnected sessionId: src_id|97602a1-ef79fd44-80866565-eb9345ca_0
2025-10-02T08:09:33.176088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 643 sessionId: src_id|97602a1-ef79fd44-80866565-eb9345ca_0 is DEAD
2025-10-02T08:09:33.176260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97602a1-ef79fd44-80866565-eb9345ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:33.176278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97602a1-ef79fd44-80866565-eb9345ca_0] Write session will restart in 0.009338s
2025-10-02T08:09:33.176308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97602a1-ef79fd44-80866565-eb9345ca_0] Write session: Do CDS request
2025-10-02T08:09:33.176318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97602a1-ef79fd44-80866565-eb9345ca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:33.176876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:33.187395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97602a1-ef79fd44-80866565-eb9345ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:33.187496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:33.187518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 644
2025-10-02T08:09:33.187719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:33.187757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:33.187767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:33.187770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:33.188242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 644 sessionId:  describe result for acl check
2025-10-02T08:09:33.188278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:33.188284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:33.188285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:33.188290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533563258798652:8408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:33.188838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533563258798652:8408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:33.190404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:33.191058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533563258798652:8408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:33.192015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:33.192186Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:33.192196Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:33.192205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:33.192248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:33.192287Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533563258798713:8407]
2025-10-02T08:09:33.192903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:33.193119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:33.193172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:33.193465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:33.193531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.193538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.193539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.193540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.193541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.193546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.193556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.193560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.193563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.193566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.193571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.193579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.193584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.193589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.193593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.193597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.193601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.193605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.193610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.193614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.193631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:33.193920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533563258798652:8408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:33.193931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533563258798652:8408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:33.193934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533563258798652:8408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:33.193954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:33.202215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:33.204094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:33.204112Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:33.204115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:33.204118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:33.204124Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 643 [1:7556533563258798713:8407]
2025-10-02T08:09:33.204137Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:33.204155Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:33.204158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.204161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.204163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.204180Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:33.204191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:33.204197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:33.204263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.204271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.204273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:33.204276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:33.204343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:33.204351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.204366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.204383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:33.204406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533563719017538:2378], now have 1 active actors on pipe
2025-10-02T08:09:33.204417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533563258798697:8407]
2025-10-02T08:09:33.204429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533563258798697:8407]
2025-10-02T08:09:33.204437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:33.204445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258798730:8408], now have 1 active actors on pipe
2025-10-02T08:09:33.204451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 643
2025-10-02T08:09:33.204453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:33.204461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:33.204464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:33.204466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:33.204469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:33.204504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.204513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.204481Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 643
2025-10-02T08:09:33.204528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533563258798697:8407]
2025-10-02T08:09:33.204541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:33.204542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:33.204567Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81517ea1-7522f390-5c425294-2cfcfb69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:33.204574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.204579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.204581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:33.204590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.204602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:33.204768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.204860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.204867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.204881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.204919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 644 partition: 0 MaxSeqNo: 17 sessionId: src_id|81517ea1-7522f390-5c425294-2cfcfb69_0
2025-10-02T08:09:33.205255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97602a1-ef79fd44-80866565-eb9345ca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|81517ea1-7522f390-5c425294-2cfcfb69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:33.208215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81517ea1-7522f390-5c425294-2cfcfb69_0] Write session: try to update token
2025-10-02T08:09:33.208229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81517ea1-7522f390-5c425294-2cfcfb69_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:33.223111Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:33.223136Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:33.223139Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:33.223148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533563258798697:8407]
2025-10-02T08:09:33.223152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533563258798697:8407]
2025-10-02T08:09:33.223202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:33.223202Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:33.223208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:33.223209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.223211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:33.223374Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:33.223598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId: src_id|81517ea1-7522f390-5c425294-2cfcfb69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:33.226593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:33.275974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533563258798745:8017]
2025-10-02T08:09:33.276102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 643, pipe: [1:7556533563258798745:8017]
2025-10-02T08:09:33.367125Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:33.367537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.367577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.367628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258798745:8017], now have 1 active actors on pipe
2025-10-02T08:09:33.367760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533563258798745:8017]
2025-10-02T08:09:33.367784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:33.367791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:33.367851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 644 reason: error at write: Disconnected sessionId: src_id|81517ea1-7522f390-5c425294-2cfcfb69_0
2025-10-02T08:09:33.367862Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:33.367903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:33.368024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 644 sessionId: src_id|81517ea1-7522f390-5c425294-2cfcfb69_0 is DEAD
2025-10-02T08:09:33.368182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81517ea1-7522f390-5c425294-2cfcfb69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:33.368189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81517ea1-7522f390-5c425294-2cfcfb69_0] Write session will restart in 0.005315s
2025-10-02T08:09:33.368215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81517ea1-7522f390-5c425294-2cfcfb69_0] Write session: Do CDS request
2025-10-02T08:09:33.368222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81517ea1-7522f390-5c425294-2cfcfb69_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:33.374444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81517ea1-7522f390-5c425294-2cfcfb69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:33.374597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:33.374614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 645
2025-10-02T08:09:33.374777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:33.374810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:33.374819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:33.374823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:33.375218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 645 sessionId:  describe result for acl check
2025-10-02T08:09:33.375262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:33.375271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:33.375273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:33.375278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533563258798975:8414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:33.375798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533563258798975:8414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:33.379372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533563258798975:8414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:33.383054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533563258798975:8414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:33.383078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533563258798975:8414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:33.383081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533563258798975:8414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:33.383101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:33.383200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:33.384821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:33.385022Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:33.385032Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:33.385042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:33.385088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:33.385132Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533563258799202:8413]
2025-10-02T08:09:33.385761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:33.385977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:33.386020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:33.386319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:33.386370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.386376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.386377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.386378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.386379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.386383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.386392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.386396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.386399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.386402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.386408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.386415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.386421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.386426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.386432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.386437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.386441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.386445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.386450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.386455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.386469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:33.395233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:33.397187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:33.397207Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:33.397209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:33.397213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:33.397221Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 644 [1:7556533563258799202:8413]
2025-10-02T08:09:33.397234Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:33.397252Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:33.397264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.397267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.397270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.397288Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:33.397293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:33.397301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:33.397371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.397380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.397384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:33.397387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:33.397662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 644
2025-10-02T08:09:33.397460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:33.397471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.397486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.397499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:33.397518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533563719017544:2378], now have 1 active actors on pipe
2025-10-02T08:09:33.397525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533563258799191:8413]
2025-10-02T08:09:33.397527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533563258799191:8413]
2025-10-02T08:09:33.397540Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:33.397548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258799194:8414], now have 1 active actors on pipe
2025-10-02T08:09:33.397554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:33.397558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:33.397559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:33.397572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:33.397575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:33.397610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533563258799191:8413]
2025-10-02T08:09:33.397618Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:33.397624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:33.397663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 644
2025-10-02T08:09:33.397669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.397673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.397697Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|314a3ed4-ed9ba841-c8221944-2953754b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:33.397704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.397708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.397710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:33.397720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.397728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:33.397751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.397780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.397783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.397794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.397825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 645 partition: 0 MaxSeqNo: 17 sessionId: src_id|314a3ed4-ed9ba841-c8221944-2953754b_0
2025-10-02T08:09:33.398271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81517ea1-7522f390-5c425294-2cfcfb69_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|314a3ed4-ed9ba841-c8221944-2953754b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:33.401535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|314a3ed4-ed9ba841-c8221944-2953754b_0] Write session: try to update token
2025-10-02T08:09:33.401558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|314a3ed4-ed9ba841-c8221944-2953754b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:33.416138Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:33.416159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:33.416161Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:33.416171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533563258799191:8413]
2025-10-02T08:09:33.416175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533563258799191:8413]
2025-10-02T08:09:33.416221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:33.416228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.416231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:33.416240Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:33.416248Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:33.416398Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:33.418170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId: src_id|314a3ed4-ed9ba841-c8221944-2953754b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:33.421301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:33.467991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533563258799231:8017]
2025-10-02T08:09:33.468085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 644, pipe: [1:7556533563258799231:8017]
2025-10-02T08:09:33.570481Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:33.571072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.571093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.571144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258799231:8017], now have 1 active actors on pipe
2025-10-02T08:09:33.571273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533563258799231:8017]
2025-10-02T08:09:33.571302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:33.571304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:33.571414Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:33.571361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 645 reason: error at write: Disconnected sessionId: src_id|314a3ed4-ed9ba841-c8221944-2953754b_0
2025-10-02T08:09:33.571390Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:33.571537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 645 sessionId: src_id|314a3ed4-ed9ba841-c8221944-2953754b_0 is DEAD
2025-10-02T08:09:33.572271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|314a3ed4-ed9ba841-c8221944-2953754b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:33.572288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|314a3ed4-ed9ba841-c8221944-2953754b_0] Write session will restart in 0.009220s
2025-10-02T08:09:33.572320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|314a3ed4-ed9ba841-c8221944-2953754b_0] Write session: Do CDS request
2025-10-02T08:09:33.572327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|314a3ed4-ed9ba841-c8221944-2953754b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:33.582783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|314a3ed4-ed9ba841-c8221944-2953754b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:33.582882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:33.582899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 646
2025-10-02T08:09:33.583325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:33.583358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:33.583364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:33.583369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:33.583816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 646 sessionId:  describe result for acl check
2025-10-02T08:09:33.583854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:33.583856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:33.583858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:33.583864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533563258799465:8422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:33.584349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533563258799465:8422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:33.587056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533563258799465:8422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:33.597183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:33.602725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:33.602971Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:33.602983Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:33.602995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:33.603057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:33.603109Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533563258799701:8421]
2025-10-02T08:09:33.603843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:33.604214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533563258799465:8422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:33.604226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533563258799465:8422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:33.604230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533563258799465:8422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:33.604239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:33.604372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:33.604421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:33.609153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:33.609298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.609305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.609307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.609308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.609309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.609315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.609327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.609331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.609335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.609339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.609345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.609353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.609359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.609364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.609369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.609375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.609380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.609386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.609392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.609397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.609418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:33.618318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:33.620208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:33.620230Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:33.620232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:33.620236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:33.620243Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 645 [1:7556533563258799701:8421]
2025-10-02T08:09:33.620256Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:33.620276Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:33.620280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.620283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.620285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.620305Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:33.620310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:33.620317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:33.620394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.620402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.620405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:33.620408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:33.620487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:33.620496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.620510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.620521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:33.620543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533563258799695:8421]
2025-10-02T08:09:33.620546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533563258799695:8421]
2025-10-02T08:09:33.620558Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:33.620571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:33.620586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:33.620589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:33.620625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533563258799695:8421]
2025-10-02T08:09:33.620627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:33.621023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:33.621028Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:33.621034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:33.621159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258799710:8422], now have 1 active actors on pipe
2025-10-02T08:09:33.621166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 645
2025-10-02T08:09:33.622263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|314a3ed4-ed9ba841-c8221944-2953754b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:33.621531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533563719017564:2378], now have 1 active actors on pipe
2025-10-02T08:09:33.621548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.621554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.621582Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:33.621591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.621595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.621597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:33.621610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.621622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:33.621642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.621712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.621715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.621728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.621768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 646 partition: 0 MaxSeqNo: 17 sessionId: src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0
2025-10-02T08:09:33.625515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0] Write session: try to update token
2025-10-02T08:09:33.625541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:33.629106Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 645
2025-10-02T08:09:33.650643Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:33.650678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:33.650681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:33.650693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533563258799695:8421]
2025-10-02T08:09:33.650699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533563258799695:8421]
2025-10-02T08:09:33.650757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:33.650766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.650781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:33.650782Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:33.650790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:33.650947Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:33.653165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId: src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:33.656082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:33.671780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533563258799733:8017]
2025-10-02T08:09:33.671978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 645, pipe: [1:7556533563258799733:8017]
2025-10-02T08:09:33.808243Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:33.808738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.808750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.808786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258799733:8017], now have 1 active actors on pipe
2025-10-02T08:09:33.809216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:33.809231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:33.809284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 646 reason: error at write: Disconnected sessionId: src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0
2025-10-02T08:09:33.809438Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:33.809455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 646 sessionId: src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0 is DEAD
2025-10-02T08:09:33.809586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533563258799733:8017]
2025-10-02T08:09:33.811002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:33.811018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0] Write session will restart in 0.005428s
2025-10-02T08:09:33.811057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0] Write session: Do CDS request
2025-10-02T08:09:33.811069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:33.813433Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:33.817456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:33.819495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:33.819523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 647
2025-10-02T08:09:33.819729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:33.819763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:33.819774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:33.819780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:33.821670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 647 sessionId:  describe result for acl check
2025-10-02T08:09:33.821711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:33.821714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:33.821716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:33.821721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533563258799963:8432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:33.822208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533563258799963:8432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:33.829647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533563258799963:8432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:33.839169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533563258799963:8432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:33.839201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533563258799963:8432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:33.839205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533563258799963:8432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:33.839215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:33.849625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:33.851527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:33.851721Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:33.851733Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:33.851744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:33.851800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:33.851845Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533563258800209:8429]
2025-10-02T08:09:33.852359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:33.852556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:33.852604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:33.852922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:33.852976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.852982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.852983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.852984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.852985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.852990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.853000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.853004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.853008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.853012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.853017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.853025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:33.853030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.853035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:33.853045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.853050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:33.853059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.853064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.853073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.853078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.853097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:33.861416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:33.862998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:33.863020Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:33.863023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:33.863027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:33.863033Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 646 [1:7556533563258800209:8429]
2025-10-02T08:09:33.863045Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:33.863061Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:33.863068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.863070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.863072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.863088Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:33.863098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:33.863109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:33.863180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.863187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.863190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:33.863192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:33.863259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:33.863269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.863283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:33.863295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:33.863313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258800127:8432], now have 1 active actors on pipe
2025-10-02T08:09:33.863316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533563719017572:2378], now have 1 active actors on pipe
2025-10-02T08:09:33.863322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533563258800203:8429]
2025-10-02T08:09:33.863325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533563258800203:8429]
2025-10-02T08:09:33.863340Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:33.863352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:33.863370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:33.863376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:33.863381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:33.863385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:33.863409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533563258800203:8429]
2025-10-02T08:09:33.863420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:33.863449Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:33.863461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 646
2025-10-02T08:09:33.863498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.863507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.863474Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 646
2025-10-02T08:09:33.863536Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:33.863557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:33.863568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:33.863571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:33.863580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:33.863592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:33.863612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.863636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:33.863642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:33.863654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:33.863686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 647 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0
2025-10-02T08:09:33.864155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc14a6d1-58a38069-2487f4dc-6686d4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:33.867332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0] Write session: try to update token
2025-10-02T08:09:33.867351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:33.886691Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:33.886717Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:33.886720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:33.886729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533563258800203:8429]
2025-10-02T08:09:33.886733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533563258800203:8429]
2025-10-02T08:09:33.886780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:33.886781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:33.886787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:33.886787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:33.886789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:33.886964Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:33.894822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId: src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:33.898857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:33.909825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533563258800258:8017]
2025-10-02T08:09:33.912008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 646, pipe: [1:7556533563258800258:8017]
2025-10-02T08:09:34.031360Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:34.031884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.031903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.031928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533563258800258:8017], now have 1 active actors on pipe
2025-10-02T08:09:34.032067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533563258800258:8017]
2025-10-02T08:09:34.032090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:34.032096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:34.032168Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:34.032172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 647 reason: error at write: Disconnected sessionId: src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0
2025-10-02T08:09:34.032344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 647 sessionId: src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0 is DEAD
2025-10-02T08:09:34.032520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:34.032534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0] Write session will restart in 0.005092s
2025-10-02T08:09:34.032563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0] Write session: Do CDS request
2025-10-02T08:09:34.032572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:34.032960Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:34.039391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.039450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:34.039475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 648
2025-10-02T08:09:34.041060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.041118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:34.041129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:34.041133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:34.041659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 648 sessionId:  describe result for acl check
2025-10-02T08:09:34.041694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:34.041700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:34.041702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:34.041708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533567553767797:8447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:34.042438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533567553767797:8447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:34.046486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533567553767797:8447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:34.051303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533567553767797:8447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:34.051327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533567553767797:8447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:34.051331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533567553767797:8447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:34.051342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:34.051525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:34.054049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:34.054425Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:34.054440Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:34.054457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:34.054531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:34.054585Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533567553768018:8446]
2025-10-02T08:09:34.055317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:34.055603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:34.055664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:34.056109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:34.056192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.056200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.056202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.056203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.056204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.056212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.056225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.056230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.056234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.056238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.056246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.056254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.056261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.056267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.056274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.056279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.056285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.056290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.056296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.056303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.056340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:34.065804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:34.067726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:34.067748Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:34.067753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:34.067759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:34.067767Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 647 [1:7556533567553768018:8446]
2025-10-02T08:09:34.067787Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:34.067814Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:34.067822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.067826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.067829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.067852Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:34.067866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:34.067875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:34.067971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.067980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.067984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:34.067988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:34.068085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:34.068094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.068111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.068129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:34.068159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553768009:8447], now have 1 active actors on pipe
2025-10-02T08:09:34.068171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 647
2025-10-02T08:09:34.068172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533567553768007:8446]
2025-10-02T08:09:34.068177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533567553768007:8446]
2025-10-02T08:09:34.068188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:34.068200Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:34.068203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:34.068218Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:34.068219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:34.068222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:34.068231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.068238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.068255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533568013984897:2378], now have 1 active actors on pipe
2025-10-02T08:09:34.068300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533567553768007:8446]
2025-10-02T08:09:34.068307Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:34.068315Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:34.068326Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:34.068340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.068345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.068347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:34.068360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.068375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:34.068313Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 647
2025-10-02T08:09:34.068425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.068550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.068557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.068573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.068615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 648 partition: 0 MaxSeqNo: 17 sessionId: src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0
2025-10-02T08:09:34.069116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4da138-8cd212c2-ca57d2a3-dbda8617_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:34.072448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0] Write session: try to update token
2025-10-02T08:09:34.072477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:34.082685Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:34.082713Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:34.082726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533567553768007:8446]
2025-10-02T08:09:34.082788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:34.082789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:34.083068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:34.083253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.083436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.083627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.083889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:34.083941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:34.098618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId: src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:34.101559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:34.102091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.102113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.102139Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:34.102146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:34.102149Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:34.102157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533567553768007:8446]
2025-10-02T08:09:34.102160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533567553768007:8446]
2025-10-02T08:09:34.102213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:34.102223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.102222Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:34.102225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:34.102229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:34.102389Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:34.132100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533567553768045:8017]
2025-10-02T08:09:34.132272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 647, pipe: [1:7556533567553768045:8017]
2025-10-02T08:09:34.252053Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:34.252505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:34.252544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553768045:8017], now have 1 active actors on pipe
2025-10-02T08:09:34.252573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:34.252664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:34.252675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:34.252695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 648 reason: error at write: Disconnected sessionId: src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0
2025-10-02T08:09:34.252848Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:34.252892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 648 sessionId: src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0 is DEAD
2025-10-02T08:09:34.253072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533567553768045:8017]
2025-10-02T08:09:34.253301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:34.253316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0] Write session will restart in 0.008700s
2025-10-02T08:09:34.253342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0] Write session: Do CDS request
2025-10-02T08:09:34.253354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:34.263523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.264932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:34.264958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 649
2025-10-02T08:09:34.265189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.265245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:34.265257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:34.265263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:34.265836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 649 sessionId:  describe result for acl check
2025-10-02T08:09:34.265877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:34.265879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:34.265882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:34.265889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533567553768381:8453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:34.266533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533567553768381:8453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:34.269579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533567553768381:8453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:34.271512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:34.273447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:34.273744Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:34.273757Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:34.273769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:34.273816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:34.273851Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533567553768504:8452]
2025-10-02T08:09:34.274052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533567553768381:8453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:34.274060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533567553768381:8453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:34.274063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533567553768381:8453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:34.274071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:34.274460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:34.274646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:34.274685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:34.274983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:34.275047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.275048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.275049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.275050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.275051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.275056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.275067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.275070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.275074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.275077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.275083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.275090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.275096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.275100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.275105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.275110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.275114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.275118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.275123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.275127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.275144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:34.284330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:34.286055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:34.286078Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:34.286081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:34.286085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:34.286093Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 648 [1:7556533567553768504:8452]
2025-10-02T08:09:34.286107Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:34.286126Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:34.286128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.286132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.286135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.286152Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:34.286158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:34.286164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:34.286239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.286252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.286256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:34.286259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:34.286334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:34.286345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.286360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.286372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:34.286399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553768509:8453], now have 1 active actors on pipe
2025-10-02T08:09:34.286402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 648
2025-10-02T08:09:34.286407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533567553768497:8452]
2025-10-02T08:09:34.286409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533567553768497:8452]
2025-10-02T08:09:34.286421Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:34.286436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533568013984904:2378], now have 1 active actors on pipe
2025-10-02T08:09:34.286437Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:34.286441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:34.286442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.286445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.286464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:34.286485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:34.286495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:34.286541Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|845026e-212a386a-8899882a-667582b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:34.286555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.286558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.286562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:34.286572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.286588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:34.286600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533567553768497:8452]
2025-10-02T08:09:34.286615Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:34.286623Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:34.286641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.286678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.286685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.286701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.286741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 649 partition: 0 MaxSeqNo: 17 sessionId: src_id|845026e-212a386a-8899882a-667582b1_0
2025-10-02T08:09:34.287115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876fffb5-9f8e2d7-bfeeabd7-bd1ca2d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|845026e-212a386a-8899882a-667582b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:34.286604Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 648
2025-10-02T08:09:34.290364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|845026e-212a386a-8899882a-667582b1_0] Write session: try to update token
2025-10-02T08:09:34.290390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|845026e-212a386a-8899882a-667582b1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:34.302953Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:34.302975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:34.302985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533567553768497:8452]
2025-10-02T08:09:34.303031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:34.303056Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:34.303221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:34.303392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.303569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.303733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.303944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:34.303996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:34.307681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId: src_id|845026e-212a386a-8899882a-667582b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:34.310904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:34.311099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.311121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.311164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:34.311196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:34.311387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.311402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.311601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.311694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.311790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.311866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.311919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.311928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.312010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.312081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.312155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.312229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.312294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.312303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.312381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.312462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.312536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.312616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.312672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.312680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.312755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.312846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.312919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.312992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.313049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.313061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.313138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.313212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.313281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.313349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.313406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.313409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.313493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.313562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.313639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.313709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.313754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.313761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.313836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.313905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.313982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.314055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.314108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.314111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.314189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.314255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.314328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.314410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.314461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.314464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.314542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.314611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.314682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.314759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.314806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.314809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.314889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.314955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.315021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.315093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.315143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.315147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.315190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:34.315255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.315275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.315277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:34.315311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:34.315326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:34.315329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:34.315332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:34.315335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:34.315829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:34.315848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:34.315858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:34.315861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:34.315864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:34.315868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:34.316469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:34.316492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:34.316500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:34.316504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:34.316511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:34.316516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:34.317511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:34.317542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:34.317549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:34.317553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:34.317557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:34.320114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:34.320125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:34.320139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392574319
2025-10-02T08:09:34.320338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:34.320348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:34.320354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:34.320357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:34.320361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:34.320365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:34.321123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:34.321148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:34.321154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:34.321160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:34.321164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:34.321168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:34.321702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:34.321716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:34.321726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:34.321730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:34.321735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:34.321739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:34.322296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:34.322308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:34.322314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:34.323570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:34.323578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:34.323583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:34.323587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:34.323596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392574323
2025-10-02T08:09:34.323940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:34.323954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:34.323961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:34.323964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:34.323968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:34.323972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:34.324524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:34.324538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:34.324544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:34.324548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:34.324551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:34.324557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:34.325294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:34.325323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.325430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392574325
2025-10-02T08:09:34.329308Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:34.329338Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:34.329347Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:34.329361Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:34.331082Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:34.331096Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:34.331098Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:34.331105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533567553768497:8452]
2025-10-02T08:09:34.331110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533567553768497:8452]
2025-10-02T08:09:34.331173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:34.331172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:34.331178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:34.331186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.331188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:34.331324Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:34.353243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533567553768545:8017]
2025-10-02T08:09:34.353467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 648, pipe: [1:7556533567553768545:8017]
2025-10-02T08:09:34.482355Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:34.482919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553768545:8017], now have 1 active actors on pipe
2025-10-02T08:09:34.483015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:34.483021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:34.483042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 649 reason: error at write: Disconnected sessionId: src_id|845026e-212a386a-8899882a-667582b1_0
2025-10-02T08:09:34.483103Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:34.483211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 649 sessionId: src_id|845026e-212a386a-8899882a-667582b1_0 is DEAD
2025-10-02T08:09:34.483192Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:34.483343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533567553768545:8017]
2025-10-02T08:09:34.483439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845026e-212a386a-8899882a-667582b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:34.483453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845026e-212a386a-8899882a-667582b1_0] Write session will restart in 0.006702s
2025-10-02T08:09:34.483482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845026e-212a386a-8899882a-667582b1_0] Write session: Do CDS request
2025-10-02T08:09:34.483489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845026e-212a386a-8899882a-667582b1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:34.491460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|845026e-212a386a-8899882a-667582b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.491548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:34.491569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 650
2025-10-02T08:09:34.491732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.491782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:34.491795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:34.491801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:34.492332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 650 sessionId:  describe result for acl check
2025-10-02T08:09:34.492376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:34.492384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:34.492386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:34.492393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533567553768824:8462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:34.493089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533567553768824:8462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:34.496382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533567553768824:8462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:34.500297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533567553768824:8462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:34.500319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533567553768824:8462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:34.500323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533567553768824:8462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:34.500333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:34.504662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:34.505937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:34.506277Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:34.506282Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:34.506295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:34.506368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:34.506414Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533567553769146:8461]
2025-10-02T08:09:34.507174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:34.507534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:34.507598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:34.507944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:34.507990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.507991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.507992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.507994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.507995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.508001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.508014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.508019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.508023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.508027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.508034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.508043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.508050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.508055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.508062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.508067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.508072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.508078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.508083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.508089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.508111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:34.522662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:34.524687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:34.524718Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:34.524722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:34.524728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:34.524737Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 649 [1:7556533567553769146:8461]
2025-10-02T08:09:34.524754Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:34.524794Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:34.524891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.524902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.524905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.524929Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:34.524936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:34.524946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:34.525050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.525064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.525068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:34.525072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:34.525157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:34.525166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.525185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.525203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:34.525232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533567553769139:8461]
2025-10-02T08:09:34.525240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533567553769139:8461]
2025-10-02T08:09:34.525251Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:34.525274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:34.525296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:34.525300Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:34.525302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:34.525304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:34.525355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533567553769139:8461]
2025-10-02T08:09:34.525363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:34.525395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553769059:8462], now have 1 active actors on pipe
2025-10-02T08:09:34.525395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 649
2025-10-02T08:09:34.525401Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:34.525413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533568013984925:2378], now have 1 active actors on pipe
2025-10-02T08:09:34.525419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.525426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.525463Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:34.525478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.525490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.525493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:34.525507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.525524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:34.525547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.525620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.525629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.525654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.525705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 650 partition: 0 MaxSeqNo: 17 sessionId: src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0
2025-10-02T08:09:34.525577Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 649
2025-10-02T08:09:34.526105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|845026e-212a386a-8899882a-667582b1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:34.529315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0] Write session: try to update token
2025-10-02T08:09:34.529338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:34.546940Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:34.546967Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:34.546971Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:34.546985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533567553769139:8461]
2025-10-02T08:09:34.546992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533567553769139:8461]
2025-10-02T08:09:34.547052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:34.547062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.547064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:34.547065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:34.547073Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:34.547265Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:34.548498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId: src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:34.551786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:34.583647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533567553769182:8017]
2025-10-02T08:09:34.583787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 649, pipe: [1:7556533567553769182:8017]
2025-10-02T08:09:34.697963Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:34.698446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.698466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.698510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553769182:8017], now have 1 active actors on pipe
2025-10-02T08:09:34.698635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533567553769182:8017]
2025-10-02T08:09:34.698663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:34.698665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:34.698711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 650 reason: error at write: Disconnected sessionId: src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0
2025-10-02T08:09:34.698745Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:34.698811Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:34.698861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 650 sessionId: src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0 is DEAD
2025-10-02T08:09:34.699065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:34.699078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0] Write session will restart in 0.005849s
2025-10-02T08:09:34.699108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0] Write session: Do CDS request
2025-10-02T08:09:34.699115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:34.706475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.706575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:34.706595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 651
2025-10-02T08:09:34.706717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.706760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:34.706770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:34.706774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:34.707273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 651 sessionId:  describe result for acl check
2025-10-02T08:09:34.707307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:34.707313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:34.707315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:34.707319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533567553769452:8469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:34.707743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533567553769452:8469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:34.710767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533567553769452:8469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:34.717700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533567553769452:8469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:34.717730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533567553769452:8469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:34.717734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533567553769452:8469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:34.717744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:34.723812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:34.724795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:34.725027Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:34.725044Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:34.725055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:34.725105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:34.725152Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533567553769766:8468]
2025-10-02T08:09:34.725803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:34.726043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:34.726093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:34.726442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:34.726513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.726521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.726523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.726524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.726525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.726531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.726543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.726547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.726551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.726554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.726560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.726568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.726575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.726586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.726627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.726637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.726646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.726651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.726660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.726671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.726697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:34.736418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:34.738479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:34.738513Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:34.738517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:34.738522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:34.738531Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 650 [1:7556533567553769766:8468]
2025-10-02T08:09:34.738549Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:34.738576Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:34.738581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.738585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.738588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.738612Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:34.738619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:34.738628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:34.738725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.738738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.738742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:34.738745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:34.738847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:34.738858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.738876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.738893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:34.738926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553769585:8469], now have 1 active actors on pipe
2025-10-02T08:09:34.738935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 650
2025-10-02T08:09:34.738941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533567553769760:8468]
2025-10-02T08:09:34.738944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533567553769760:8468]
2025-10-02T08:09:34.738954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:34.738974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:34.738992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:34.738996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:34.739004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533568013984932:2378], now have 1 active actors on pipe
2025-10-02T08:09:34.739010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.739017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.739079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533567553769760:8468]
2025-10-02T08:09:34.739090Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:34.739112Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:34.739126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.739135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.739138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:34.739152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.739165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:34.739167Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:34.739171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:34.739179Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:34.739216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.739336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.739348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.739376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.739419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 651 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0
2025-10-02T08:09:34.739812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a7195a-bb57d820-c1a68e14-6bda3841_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:34.739234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 650
2025-10-02T08:09:34.742485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0] Write session: try to update token
2025-10-02T08:09:34.742501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:34.759223Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:09:34.762804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId: src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:34.764674Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:34.764701Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:34.764706Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:34.764718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533567553769760:8468]
2025-10-02T08:09:34.764725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533567553769760:8468]
2025-10-02T08:09:34.764781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:34.764790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:34.764795Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:34.764820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.764823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:34.765047Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:34.766524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:34.798715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533567553769792:8017]
2025-10-02T08:09:34.798899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 650, pipe: [1:7556533567553769792:8017]
2025-10-02T08:09:34.913034Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:34.914051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.914079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.914127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553769792:8017], now have 1 active actors on pipe
2025-10-02T08:09:34.914347Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:34.914754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533567553769792:8017]
2025-10-02T08:09:34.914787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:34.914845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 651 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0
2025-10-02T08:09:34.915054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 651 sessionId: src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0 is DEAD
2025-10-02T08:09:34.915386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:34.915397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0] Write session will restart in 0.005828s
2025-10-02T08:09:34.915424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0] Write session: Do CDS request
2025-10-02T08:09:34.915436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:34.914433Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:34.922442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.922849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:34.922869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 652
2025-10-02T08:09:34.923130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:34.923166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:34.923172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:34.923177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:34.923889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 652 sessionId:  describe result for acl check
2025-10-02T08:09:34.923918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:34.923920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:34.923921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:34.923926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533567553770080:8483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:34.925112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533567553770080:8483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:34.928741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533567553770080:8483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:34.935310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533567553770080:8483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:34.935331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533567553770080:8483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:34.935334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533567553770080:8483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:34.935341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:34.939647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:34.940324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:34.940483Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:34.940486Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:34.940495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:34.940527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:34.940562Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533567553770407:8481]
2025-10-02T08:09:34.941136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:34.941348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:34.941392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:34.941666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:34.941713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.941719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.941720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.941721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.941722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.941727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.941738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.941743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.941747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.941751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.941756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.941766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:34.941773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.941780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:34.941789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.941796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:34.941804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.941810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.941819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.941826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.941852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:34.963432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:34.965462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:34.965489Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:34.965492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:34.965496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:34.965505Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 651 [1:7556533567553770407:8481]
2025-10-02T08:09:34.965519Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:34.965541Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:34.965544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.965548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.965551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.965571Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:34.965579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:34.965586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:34.965675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.965685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.965689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:34.965692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:34.965778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:34.965786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:34.965804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:34.965816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:34.965839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533567553770401:8481]
2025-10-02T08:09:34.965841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533567553770401:8481]
2025-10-02T08:09:34.965851Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:34.965867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:34.965888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:34.965891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:34.965905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533567553770347:8483], now have 1 active actors on pipe
2025-10-02T08:09:34.965902Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:34.965908Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:34.965947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533567553770401:8481]
2025-10-02T08:09:34.965957Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:34.965959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:34.965962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533568013984954:2378], now have 1 active actors on pipe
2025-10-02T08:09:34.966017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 651
2025-10-02T08:09:34.966031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.966036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.966067Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|286da03a-40664fb9-ba500ca8-a1326c48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:34.966081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.966086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.966088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:34.966100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:34.966114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:34.966134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.966115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 651
2025-10-02T08:09:34.966728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a9a47-f348d01a-b513ad64-d0889bd4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|286da03a-40664fb9-ba500ca8-a1326c48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:34.966204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.966212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.966227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:34.966268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 652 partition: 0 MaxSeqNo: 17 sessionId: src_id|286da03a-40664fb9-ba500ca8-a1326c48_0
2025-10-02T08:09:34.969589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286da03a-40664fb9-ba500ca8-a1326c48_0] Write session: try to update token
2025-10-02T08:09:34.969610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286da03a-40664fb9-ba500ca8-a1326c48_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:34.983911Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:34.983944Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:34.983958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533567553770401:8481]
2025-10-02T08:09:34.984025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:34.984230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:34.984405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.984575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.984749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:34.984859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:34.985170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:34.985232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:34.989842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId: src_id|286da03a-40664fb9-ba500ca8-a1326c48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:34.993376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:34.993474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.993496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.993548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:34.993589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:34.993661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:34.993678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:34.993920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.994011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.994099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.994202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.994443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.994457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.994554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.994632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.994719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.994815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.994871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.994879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.994969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.995045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.995122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.995205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.995269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.995277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.995357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.995432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.995505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.995602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.995663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.995671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.995757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.995836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.995919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.996001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.996061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.996069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.996158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.996253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.996336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.996416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.996477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.996486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.996566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.996649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.996731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.996958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.997028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.997037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.997121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.997212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.997300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.997384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.997445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.997456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.997544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.997612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.997687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.997763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.997818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.997827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.997912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:34.997987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:34.998066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:34.998148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:34.998204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:34.998207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:34.998260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:34.998343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:34.998362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:34.998366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:34.998409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:34.998425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:34.998429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:34.998431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:34.998435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:34.998927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:34.998952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:34.998959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:34.998963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:34.998969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:34.998972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:34.999773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:34.999794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:34.999801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:34.999804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:34.999808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:34.999813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:35.000407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:35.000427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:35.000434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:35.000439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:35.000443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:35.002933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:35.002963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:35.002985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392575002
2025-10-02T08:09:35.003118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:35.003128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:35.003134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:35.003138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:35.003142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:35.003146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:35.003715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:35.003731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:35.003735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:35.003740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:35.003742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:35.003744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:35.004271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:35.004281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:35.004291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:35.004294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:35.004297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:35.004299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:35.004879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:35.004899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:35.004905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:35.006174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:35.006199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:35.006204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:35.006208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:35.006218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392575005
2025-10-02T08:09:35.006540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:35.006566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:35.006575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:35.006579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:35.006583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:35.006590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:35.007060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:35.007086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:35.007092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:35.007096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:35.007101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:35.007105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:35.007650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:35.007672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.007774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392575007
2025-10-02T08:09:35.011248Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:35.011274Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:35.011279Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:35.011283Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:35.013321Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:35.013345Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:35.013346Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:35.013361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533567553770401:8481]
2025-10-02T08:09:35.013365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533567553770401:8481]
2025-10-02T08:09:35.013451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:35.013468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.013477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:35.013499Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:35.013508Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:35.013640Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:35.014731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533571848737741:8017]
2025-10-02T08:09:35.014852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 651, pipe: [1:7556533571848737741:8017]
2025-10-02T08:09:35.178958Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:35.179528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848737741:8017], now have 1 active actors on pipe
2025-10-02T08:09:35.180771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286da03a-40664fb9-ba500ca8-a1326c48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:35.180255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533571848737741:8017]
2025-10-02T08:09:35.180280Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:35.180785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286da03a-40664fb9-ba500ca8-a1326c48_0] Write session will restart in 0.005752s
2025-10-02T08:09:35.180289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:35.180292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:35.180326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 652 reason: error at write: Disconnected sessionId: src_id|286da03a-40664fb9-ba500ca8-a1326c48_0
2025-10-02T08:09:35.180547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 652 sessionId: src_id|286da03a-40664fb9-ba500ca8-a1326c48_0 is DEAD
2025-10-02T08:09:35.180843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286da03a-40664fb9-ba500ca8-a1326c48_0] Write session: Do CDS request
2025-10-02T08:09:35.180850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286da03a-40664fb9-ba500ca8-a1326c48_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:35.185406Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:35.187496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286da03a-40664fb9-ba500ca8-a1326c48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:35.187582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:35.187605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 653
2025-10-02T08:09:35.187809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:35.187847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:35.187854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:35.187858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:35.188707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 653 sessionId:  describe result for acl check
2025-10-02T08:09:35.188749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:35.188751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:35.188754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:35.188760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533571848737959:8494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:35.189489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533571848737959:8494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:35.192454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533571848737959:8494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:35.197611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533571848737959:8494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:35.197633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533571848737959:8494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:35.197637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533571848737959:8494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:35.197648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:35.206677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:35.208539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:35.208821Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:35.208836Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:35.208851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:35.208925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:35.208976Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533571848738331:8493]
2025-10-02T08:09:35.209725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:35.213198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:35.213304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:35.213910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:35.213993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.213994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.213996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.213998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.213999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.214008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.214020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.214024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.214028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.214032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.214040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.214050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.214057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.214064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.214069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.214076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.214084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.214089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.214096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.214101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.214126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:35.226865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:35.229024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:35.229035Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:35.229038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:35.229043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:35.229054Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 652 [1:7556533571848738331:8493]
2025-10-02T08:09:35.229073Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:35.229103Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:35.229107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.229112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.229114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.229141Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:35.229149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:35.229160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:35.229262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.229265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.229269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:35.229272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:35.229379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:35.229381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.229401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.229412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:35.229435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533571848738325:8493]
2025-10-02T08:09:35.229437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533571848738325:8493]
2025-10-02T08:09:35.229448Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:35.229465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:35.229482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:35.229486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:35.229540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:35.229546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848738165:8494], now have 1 active actors on pipe
2025-10-02T08:09:35.229548Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:35.229550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533571848738325:8493]
2025-10-02T08:09:35.229553Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:35.229555Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:35.229587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533572308952267:2378], now have 1 active actors on pipe
2025-10-02T08:09:35.229626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 652
2025-10-02T08:09:35.229887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 652
2025-10-02T08:09:35.230297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.230320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.230368Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adb7646b-7e85594e-afeb5b03-97791a24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:35.230381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.230392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.230395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:35.230421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.230436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:35.230457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:35.232919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286da03a-40664fb9-ba500ca8-a1326c48_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|adb7646b-7e85594e-afeb5b03-97791a24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:35.235796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb7646b-7e85594e-afeb5b03-97791a24_0] Write session: try to update token
2025-10-02T08:09:35.235818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb7646b-7e85594e-afeb5b03-97791a24_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:35.231341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.231360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.231388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:35.231434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 653 partition: 0 MaxSeqNo: 17 sessionId: src_id|adb7646b-7e85594e-afeb5b03-97791a24_0
2025-10-02T08:09:35.254068Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:35.254090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:35.254093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:35.254104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533571848738325:8493]
2025-10-02T08:09:35.254108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533571848738325:8493]
2025-10-02T08:09:35.254149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:35.254155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.254157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:35.254251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:35.254260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:35.254323Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:35.260350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId: src_id|adb7646b-7e85594e-afeb5b03-97791a24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:35.263754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:35.280788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533571848738357:8017]
2025-10-02T08:09:35.281040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 652, pipe: [1:7556533571848738357:8017]
2025-10-02T08:09:35.405861Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:35.406555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.406583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.406634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848738357:8017], now have 1 active actors on pipe
2025-10-02T08:09:35.407267Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:35.407309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:35.407322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:35.407383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 653 reason: error at write: Disconnected sessionId: src_id|adb7646b-7e85594e-afeb5b03-97791a24_0
2025-10-02T08:09:35.407584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 653 sessionId: src_id|adb7646b-7e85594e-afeb5b03-97791a24_0 is DEAD
2025-10-02T08:09:35.407707Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:35.407725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533571848738357:8017]
2025-10-02T08:09:35.407808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb7646b-7e85594e-afeb5b03-97791a24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:35.407818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb7646b-7e85594e-afeb5b03-97791a24_0] Write session will restart in 0.006353s
2025-10-02T08:09:35.407863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb7646b-7e85594e-afeb5b03-97791a24_0] Write session: Do CDS request
2025-10-02T08:09:35.407870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb7646b-7e85594e-afeb5b03-97791a24_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:35.415441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb7646b-7e85594e-afeb5b03-97791a24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:35.417505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:35.417529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 654
2025-10-02T08:09:35.418497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:35.418551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:35.418556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:35.418561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:35.419466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 654 sessionId:  describe result for acl check
2025-10-02T08:09:35.419506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:35.419508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:35.419510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:35.419516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533571848738559:8500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:35.420063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533571848738559:8500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:35.423896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533571848738559:8500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:35.429200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533571848738559:8500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:35.429223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533571848738559:8500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:35.429227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533571848738559:8500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:35.429238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:35.434546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:35.435564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:35.435750Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:35.435754Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:35.435764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:35.435828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:35.435862Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533571848738950:8499]
2025-10-02T08:09:35.436459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:35.436663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:35.436708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:35.437024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:35.437076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.437077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.437078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.437079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.437080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.437084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.437095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.437099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.437103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.437106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.437112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.437119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.437125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.437140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.437144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.437148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.437152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.437157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.437161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.437166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.437186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:35.446471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:35.448584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:35.448607Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:35.448610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:35.448613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:35.448621Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 653 [1:7556533571848738950:8499]
2025-10-02T08:09:35.448633Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:35.448652Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:35.448656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.448659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.448661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.448680Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:35.448684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:35.448692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:35.448762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.448771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.448774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:35.448777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:35.448863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:35.448871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.448884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.448895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:35.448915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533571848738944:8499]
2025-10-02T08:09:35.448922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533571848738944:8499]
2025-10-02T08:09:35.448931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:35.448950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:35.448974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:35.448980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:35.448992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848738773:8500], now have 1 active actors on pipe
2025-10-02T08:09:35.449000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533572308952272:2378], now have 1 active actors on pipe
2025-10-02T08:09:35.449031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533571848738944:8499]
2025-10-02T08:09:35.449039Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:35.449076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:35.449084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 653
2025-10-02T08:09:35.449088Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:35.449095Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:35.449218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.449228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.449255Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:35.449267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.449275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.449282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:35.449293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.449308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:35.449328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:35.449384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.449391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.449406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:35.449442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 654 partition: 0 MaxSeqNo: 17 sessionId: src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0
2025-10-02T08:09:35.449865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb7646b-7e85594e-afeb5b03-97791a24_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:35.449913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 653
2025-10-02T08:09:35.453351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0] Write session: try to update token
2025-10-02T08:09:35.453371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:35.471821Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:35.471839Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:35.471841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:35.471852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533571848738944:8499]
2025-10-02T08:09:35.471858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533571848738944:8499]
2025-10-02T08:09:35.471906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:35.471912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.471915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:35.471924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:35.471931Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:35.472066Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:35.480094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId: src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:35.483363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:35.507439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533571848738981:8017]
2025-10-02T08:09:35.507828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 653, pipe: [1:7556533571848738981:8017]
2025-10-02T08:09:35.626226Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:35.627078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.627100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.627124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848738981:8017], now have 1 active actors on pipe
2025-10-02T08:09:35.627295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533571848738981:8017]
2025-10-02T08:09:35.627329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:35.627332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:35.627503Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:35.627406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 654 reason: error at write: Disconnected sessionId: src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0
2025-10-02T08:09:35.627412Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:35.627621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 654 sessionId: src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0 is DEAD
2025-10-02T08:09:35.629057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:35.629079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0] Write session will restart in 0.009249s
2025-10-02T08:09:35.629108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0] Write session: Do CDS request
2025-10-02T08:09:35.629115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:35.639481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:35.639608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:35.639634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 655
2025-10-02T08:09:35.639835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:35.639876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:35.639888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:35.639892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:35.640332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 655 sessionId:  describe result for acl check
2025-10-02T08:09:35.640386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:35.640394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:35.640396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:35.640403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533571848739515:8508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:35.640915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533571848739515:8508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:35.642502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:35.643149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533571848739515:8508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:35.643435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:35.643630Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:35.643641Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:35.643652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:35.643698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:35.643737Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533571848739574:8507]
2025-10-02T08:09:35.644356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:35.644556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:35.644602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:35.644925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:35.644978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.644985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.644986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.644987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.644989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.644994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.645004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.645007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.645011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.645015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.645020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.645027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.645033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.645038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.645046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.645052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.645057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.645062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.645071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.645075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.645094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:35.645873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533571848739515:8508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:35.645891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533571848739515:8508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:35.645895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533571848739515:8508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:35.645905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:35.653724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:35.655479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:35.655496Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:35.655498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:35.655501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:35.655506Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 654 [1:7556533571848739574:8507]
2025-10-02T08:09:35.655514Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:35.655527Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:35.655541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.655544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.655546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.655561Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:35.655571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:35.655578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:35.655626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.655631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.655634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:35.655635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:35.655691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:35.655699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.655712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.655727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:35.655747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533571848739563:8507]
2025-10-02T08:09:35.655753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533571848739563:8507]
2025-10-02T08:09:35.655759Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:35.655769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:35.655778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:35.655781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:35.655785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:35.655788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:35.655799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848739596:8508], now have 1 active actors on pipe
2025-10-02T08:09:35.655802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 654
2025-10-02T08:09:35.655836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533572308952294:2378], now have 1 active actors on pipe
2025-10-02T08:09:35.655846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.655850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.655863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533571848739563:8507]
2025-10-02T08:09:35.655870Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:35.655893Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:35.655904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.655907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.655909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:35.655912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:35.655918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.655926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:35.655906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 654
2025-10-02T08:09:35.655951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:35.656054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.656063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.656075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:35.656111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 655 partition: 0 MaxSeqNo: 17 sessionId: src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0
2025-10-02T08:09:35.656453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57543e16-21e36c51-3c50ddf0-cc9065da_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:35.659343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0] Write session: try to update token
2025-10-02T08:09:35.659360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:35.677233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId: src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:35.680265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:35.680381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.680395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.680432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:35.680463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:35.680522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.680541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.680841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.680982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.681054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.681123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.681258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.681270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.681346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.681412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.681498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.681577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.681630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.681637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.681706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.681772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.681844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.681919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.681968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.681973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.682039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.682097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.682154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.682217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.682267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.682270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.682338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.682399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.682462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.682524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.682566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.682568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.682632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.682683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.682738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.682797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.682843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.682846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.682922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.682986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.683065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.683121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.683168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.683170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.683231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.683293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.683352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.683414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.683467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.683470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.683556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.683648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.683795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.683906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.683975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.683979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.684112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.684227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.684355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.684493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.684568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.684621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.684729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:35.685236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.685285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.685296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:35.685352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:35.685384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:35.685397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:35.685404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:35.685418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:35.686499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:35.686552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:35.686566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:35.686581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:35.686586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:35.686599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:35.688003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:35.688044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:35.688059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:35.688065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:35.688079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:35.688093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:35.689215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:35.689252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:35.689262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:35.689281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:35.689293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:35.691795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:35.691813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:35.691865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392575691
2025-10-02T08:09:35.691992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:35.692002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:35.692007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:35.692010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:35.692012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:35.692014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:35.692434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:35.692453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:35.692462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:35.692468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:35.692473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:35.692476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:35.692921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:35.692942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:35.692949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:35.692951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:35.692953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:35.692956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:35.693366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:35.693384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:35.693387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:35.694433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:35.694447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:35.694451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:35.694453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:35.694461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392575694
2025-10-02T08:09:35.694718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:35.694732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:35.694737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:35.694740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:35.694743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:35.694745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:35.695164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:35.695182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:35.695185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:35.695187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:35.695189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:35.695192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:35.695614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:35.695631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.695738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392575695
2025-10-02T08:09:35.698167Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:35.698195Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:35.698204Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:35.698210Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:35.698221Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:35.698223Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:35.698225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:35.698237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533571848739563:8507]
2025-10-02T08:09:35.698241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533571848739563:8507]
2025-10-02T08:09:35.698302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:35.698315Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:35.704763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:35.704784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.704785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:35.704956Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:35.727450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533571848739610:8017]
2025-10-02T08:09:35.727605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 654, pipe: [1:7556533571848739610:8017]
2025-10-02T08:09:35.853578Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:35.853982Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:35.853991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:35.854002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533571848739563:8507]
2025-10-02T08:09:35.854081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848739610:8017], now have 1 active actors on pipe
2025-10-02T08:09:35.854138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:35.854648Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:35.855231Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:35.855799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:35.855829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0
2025-10-02T08:09:35.856037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 655 sessionId: src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0 is DEAD
2025-10-02T08:09:35.856187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533571848739610:8017]
2025-10-02T08:09:35.857172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:35.857192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0] Write session will restart in 0.007277s
2025-10-02T08:09:35.857219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0] Write session: Do CDS request
2025-10-02T08:09:35.857227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:35.865631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:35.865743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:35.865765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 656
2025-10-02T08:09:35.865883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:35.865917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:35.865923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:35.865926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:35.866476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 656 sessionId:  describe result for acl check
2025-10-02T08:09:35.866514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:35.866515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:35.866517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:35.866522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533571848739655:8514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:35.867712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533571848739655:8514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:35.869715Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [e9a296932f13ba0f] Result# TEvPutResult {Id# [72075186224037892:654:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:35.869797Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:654:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:35.871409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533571848739655:8514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:35.875133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533571848739655:8514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:35.875150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533571848739655:8514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:35.875153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533571848739655:8514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:35.875161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:35.888548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:35.889004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:35.889293Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:35.889310Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:35.889322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:35.889378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:35.889421Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533571848740209:8513]
2025-10-02T08:09:35.889992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:35.890195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:35.890237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:35.890511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:35.890562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.890569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.890570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.890571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.890572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.890577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.890587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.890595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.890598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.890605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.890611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.890622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:35.890627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.890633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:35.890637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.890645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:35.890648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.890656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.890660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.890669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.890689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:35.899704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:35.901576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:35.901596Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:35.901599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:35.901603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:35.901609Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 655 [1:7556533571848740209:8513]
2025-10-02T08:09:35.901620Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:35.901638Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:35.901641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.901644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.901645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.901660Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:35.901665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:35.901671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:35.901730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.901732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.901735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:35.901737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:35.901931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 655
2025-10-02T08:09:35.902098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:35.902101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.902111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:35.902121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:35.902138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533572308952301:2378], now have 1 active actors on pipe
2025-10-02T08:09:35.902141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848740046:8514], now have 1 active actors on pipe
2025-10-02T08:09:35.902146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.902149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.902164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533571848740203:8513]
2025-10-02T08:09:35.902167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533571848740203:8513]
2025-10-02T08:09:35.902178Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:35.902190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:35.902199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:35.902199Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:35.902201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:35.902202Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:35.902216Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:35.902220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.902224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.902226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:35.902234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.902243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:35.902279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533571848740203:8513]
2025-10-02T08:09:35.902286Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:35.902296Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:35.902301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:35.902362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.902364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.902375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:35.902407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 656 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0
2025-10-02T08:09:35.903127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fffd1e86-2f591c57-7b9b575d-4d07a62_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:35.906347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0] Write session: try to update token
2025-10-02T08:09:35.906366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:35.908916Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 655
2025-10-02T08:09:35.924601Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:35.924627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:35.924636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533571848740203:8513]
2025-10-02T08:09:35.924679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:35.924693Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:35.924881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:35.925042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:35.925205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:35.925361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:35.925588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:35.925631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:35.934266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId: src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:35.937678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:35.937745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.937757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.937790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:35.937808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:35.937878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:35.937889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:35.938058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.938125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.938197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.938274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.938325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.938337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.938413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.938476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.938537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.938595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.938639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.938642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.938715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.938778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.938850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.938925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.938969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.938973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.939048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.939139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.939207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.939276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.939323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.939328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.939406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.939472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.939557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.939635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.939677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.939680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.939753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.939811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.939876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.939944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.939992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.939995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.940071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.940136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.940204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.940276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.940331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.940334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.940412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.940478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.940551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.940621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.940672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.940677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.940757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.941025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.941105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.941182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.941238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.941246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.941321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:35.941394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:35.941465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:35.941535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:35.941584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:35.941592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:35.941637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:35.941713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:35.941742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:35.941745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:35.941782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:35.941799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:35.941803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:35.941807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:35.941810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:35.942287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:35.942308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:35.942315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:35.942318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:35.942321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:35.942325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:35.943113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:35.943131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:35.943138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:35.943142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:35.943145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:35.943148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:35.943895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:35.943910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:35.943916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:35.943922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:35.943925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:35.945636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:35.945663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:35.945675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392575944
2025-10-02T08:09:35.945809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:35.945823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:35.945828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:35.945831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:35.945839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:35.945842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:35.946467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:35.946496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:35.946502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:35.946505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:35.946509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:35.946512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:35.947138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:35.947165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:35.947173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:35.947176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:35.947180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:35.947184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:35.947759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:35.947775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:35.947782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:35.949293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:35.949310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:35.949317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:35.949321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:35.949329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392575949
2025-10-02T08:09:35.949707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:35.949736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:35.949743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:35.949748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:35.949751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:35.949754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:35.950348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:35.950372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:35.950378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:35.950382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:35.950385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:35.950389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:35.950940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:35.950954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:35.951064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392575950
2025-10-02T08:09:35.951927Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:35.951939Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:35.951943Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:35.951946Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:35.953984Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:35.954000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:35.954002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:35.954012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533571848740203:8513]
2025-10-02T08:09:35.954016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533571848740203:8513]
2025-10-02T08:09:35.954069Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:35.954074Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:35.954081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:35.954086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:35.954088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:35.954237Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:35.973734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533571848740257:8017]
2025-10-02T08:09:35.975900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 655, pipe: [1:7556533571848740257:8017]
2025-10-02T08:09:36.097790Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:36.098234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533571848740257:8017], now have 1 active actors on pipe
2025-10-02T08:09:36.098334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:36.098341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:36.098367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 656 reason: error at write: Disconnected sessionId: src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0
2025-10-02T08:09:36.098552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 656 sessionId: src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0 is DEAD
2025-10-02T08:09:36.098848Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:36.098934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533571848740257:8017]
2025-10-02T08:09:36.099379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:36.099390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0] Write session will restart in 0.007870s
2025-10-02T08:09:36.099417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0] Write session: Do CDS request
2025-10-02T08:09:36.099424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:36.100909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:36.108391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:36.108634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:36.108653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 657
2025-10-02T08:09:36.109008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:36.109048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:36.109058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:36.109062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:36.109493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 657 sessionId:  describe result for acl check
2025-10-02T08:09:36.109525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:36.109527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:36.109529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:36.109534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533576143707857:8533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:36.110042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533576143707857:8533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:36.112293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533576143707857:8533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:36.115461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533576143707857:8533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:36.115479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533576143707857:8533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:36.115482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533576143707857:8533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:36.115491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:36.119758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:36.120174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:36.120561Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:36.120583Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:36.120598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:36.120660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:36.120712Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533576143708171:8532]
2025-10-02T08:09:36.121447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:36.121726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:36.121777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:36.122054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:36.122084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.122085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.122086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.122087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.122087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.122093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.122101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.122103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.122106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.122108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.122112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.122119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.122125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.122131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.122136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.122141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.122145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.122151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.122154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.122159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.122173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:36.131372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:36.133158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:36.133180Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:36.133183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:36.133187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:36.133195Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 656 [1:7556533576143708171:8532]
2025-10-02T08:09:36.133206Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:36.133223Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:36.133225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:36.133228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:36.133229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:36.133243Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:36.133248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:36.133254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:36.133307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.133314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.133317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:36.133319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:36.133391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:36.133402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.133419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.133432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:36.133451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533576143708099:8533], now have 1 active actors on pipe
2025-10-02T08:09:36.133458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533576143708165:8532]
2025-10-02T08:09:36.133461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533576143708165:8532]
2025-10-02T08:09:36.133468Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:36.133480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 656
2025-10-02T08:09:36.133481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:36.133482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:36.133484Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:36.133496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:36.133500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:36.133506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533576603919629:2378], now have 1 active actors on pipe
2025-10-02T08:09:36.133512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.133516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.133564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533576143708165:8532]
2025-10-02T08:09:36.133574Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:36.133592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:36.133593Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf96eaa4-3ab92932-540404f0-77b08995_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:36.133574Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 656
2025-10-02T08:09:36.133600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:36.133604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:36.133606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:36.133615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:36.133625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:36.133661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:36.133730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.133738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.133752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:36.133799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 657 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf96eaa4-3ab92932-540404f0-77b08995_0
2025-10-02T08:09:36.134223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc155dcb-350446f1-48255f1f-4434e1bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf96eaa4-3ab92932-540404f0-77b08995_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:36.137341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf96eaa4-3ab92932-540404f0-77b08995_0] Write session: try to update token
2025-10-02T08:09:36.137362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf96eaa4-3ab92932-540404f0-77b08995_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:36.153962Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:36.153989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:36.153992Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:36.154004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533576143708165:8532]
2025-10-02T08:09:36.154009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533576143708165:8532]
2025-10-02T08:09:36.154052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:36.154057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:36.154058Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:36.154065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.154067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:36.154242Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:36.155584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId: src_id|bf96eaa4-3ab92932-540404f0-77b08995_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:36.158579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:36.199005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533576143708196:8017]
2025-10-02T08:09:36.199160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 656, pipe: [1:7556533576143708196:8017]
2025-10-02T08:09:36.305585Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:36.306113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.306122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.306167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533576143708196:8017], now have 1 active actors on pipe
2025-10-02T08:09:36.306312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:36.306321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:36.306452Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:36.306760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf96eaa4-3ab92932-540404f0-77b08995_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:36.306771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf96eaa4-3ab92932-540404f0-77b08995_0] Write session will restart in 0.006681s
2025-10-02T08:09:36.306798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf96eaa4-3ab92932-540404f0-77b08995_0] Write session: Do CDS request
2025-10-02T08:09:36.306806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf96eaa4-3ab92932-540404f0-77b08995_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:36.306377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 657 reason: error at write: Disconnected sessionId: src_id|bf96eaa4-3ab92932-540404f0-77b08995_0
2025-10-02T08:09:36.306439Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:36.306560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 657 sessionId: src_id|bf96eaa4-3ab92932-540404f0-77b08995_0 is DEAD
2025-10-02T08:09:36.306689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533576143708196:8017]
2025-10-02T08:09:36.314501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf96eaa4-3ab92932-540404f0-77b08995_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:36.314537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:36.314558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 658
2025-10-02T08:09:36.314796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:36.314839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:36.314851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:36.314855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:36.315686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 658 sessionId:  describe result for acl check
2025-10-02T08:09:36.315729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:36.315736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:36.315738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:36.315744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533576143708434:8539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:36.316287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533576143708434:8539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:36.318989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533576143708434:8539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:36.322434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533576143708434:8539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:36.322453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533576143708434:8539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:36.322456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533576143708434:8539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:36.322465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:36.326578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:36.327897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:36.328157Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:36.328168Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:36.328180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:36.328238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:36.328292Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533576143708802:8538]
2025-10-02T08:09:36.328957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:36.329186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:36.329224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:36.329545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:36.329587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.329589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.329591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.329592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.329593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.329598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.329611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.329616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.329619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.329623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.329630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.329637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.329645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.329650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.329655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.329659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.329663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.329668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.329673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.329677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.329697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:36.343551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:36.345614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:36.345633Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:36.345636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:36.345641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:36.345647Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 657 [1:7556533576143708802:8538]
2025-10-02T08:09:36.345661Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:36.345681Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:36.345684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:36.345687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:36.345690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:36.345707Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:36.345713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:36.345721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:36.345800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.345802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.345806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:36.345809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:36.345886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:36.345888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.345904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.345917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:36.345934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533576143708796:8538]
2025-10-02T08:09:36.345937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533576143708796:8538]
2025-10-02T08:09:36.345950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:36.345963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:36.345977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:36.345980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:36.346016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533576143708796:8538]
2025-10-02T08:09:36.346018Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:36.346807Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 657
2025-10-02T08:09:36.346095Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:36.346105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:36.346112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:36.346223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 657
2025-10-02T08:09:36.346234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533576143708682:8539], now have 1 active actors on pipe
2025-10-02T08:09:36.346308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533576603919635:2378], now have 1 active actors on pipe
2025-10-02T08:09:36.346315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.346321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.346349Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|719dd047-f3963968-5a4b5a10-1be969d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:36.346356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:36.346360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:36.346362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:36.346372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:36.346383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:36.346399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:36.346506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.346509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.346521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:36.346558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 658 partition: 0 MaxSeqNo: 17 sessionId: src_id|719dd047-f3963968-5a4b5a10-1be969d6_0
2025-10-02T08:09:36.346970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf96eaa4-3ab92932-540404f0-77b08995_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|719dd047-f3963968-5a4b5a10-1be969d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:36.350970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719dd047-f3963968-5a4b5a10-1be969d6_0] Write session: try to update token
2025-10-02T08:09:36.350993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719dd047-f3963968-5a4b5a10-1be969d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:36.372927Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:36.372947Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:36.372949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:36.372959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533576143708796:8538]
2025-10-02T08:09:36.372965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533576143708796:8538]
2025-10-02T08:09:36.373019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:36.373025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.373028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:36.373210Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:36.373255Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:36.373261Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:36.379812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId: src_id|719dd047-f3963968-5a4b5a10-1be969d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:36.383008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:36.407766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533576143708830:8017]
2025-10-02T08:09:36.408078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 657, pipe: [1:7556533576143708830:8017]
2025-10-02T08:09:36.536152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719dd047-f3963968-5a4b5a10-1be969d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:36.536168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719dd047-f3963968-5a4b5a10-1be969d6_0] Write session will restart in 0.006557s
2025-10-02T08:09:36.536192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719dd047-f3963968-5a4b5a10-1be969d6_0] Write session: Do CDS request
2025-10-02T08:09:36.536199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719dd047-f3963968-5a4b5a10-1be969d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:36.533061Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:36.533575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.533585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.533630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533576143708830:8017], now have 1 active actors on pipe
2025-10-02T08:09:36.534896Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:36.535355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:36.535442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 658 reason: status is not ok: tablet will be restarted right now sessionId: src_id|719dd047-f3963968-5a4b5a10-1be969d6_0
2025-10-02T08:09:36.535655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 658 sessionId: src_id|719dd047-f3963968-5a4b5a10-1be969d6_0 is DEAD
2025-10-02T08:09:36.535799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533576143708830:8017]
2025-10-02T08:09:36.536882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:36.544346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719dd047-f3963968-5a4b5a10-1be969d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:36.544487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:36.544520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 659
2025-10-02T08:09:36.544643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:36.544662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:36.544665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:36.544668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:36.545097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 659 sessionId:  describe result for acl check
2025-10-02T08:09:36.545125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:36.545126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:36.545127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:36.545130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533576143708888:8547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:36.545629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533576143708888:8547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:36.550837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533576143708888:8547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:36.554508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533576143708888:8547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:36.554524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533576143708888:8547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:36.554527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533576143708888:8547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:36.554537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:36.605912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:36.606552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:36.606754Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:36.606764Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:36.606774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:36.606826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:36.606862Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533576143709447:8546]
2025-10-02T08:09:36.607436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:36.607679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:36.607730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:36.608017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:36.608067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.608068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.608069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.608070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.608071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.608075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.608084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.608086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.608088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.608090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.608095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.608107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.608113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.608116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.608120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.608123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.608126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.608129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.608136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.608140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.608152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:36.624795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:36.627418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:36.627452Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:36.627456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:36.627463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:36.627473Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 658 [1:7556533576143709447:8546]
2025-10-02T08:09:36.627492Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:36.627520Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:36.627536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:36.627541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:36.627544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:36.627567Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:36.627584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:36.627600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:36.627711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.627721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.627726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:36.627729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:36.627841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:36.627851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.627872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.627892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:36.627925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533576143709441:8546]
2025-10-02T08:09:36.627937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533576143709441:8546]
2025-10-02T08:09:36.627950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:36.627970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:36.627992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:36.628001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:36.628056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 658
2025-10-02T08:09:36.628057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533576143709441:8546]
2025-10-02T08:09:36.628060Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:36.628072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533576143709128:8547], now have 1 active actors on pipe
2025-10-02T08:09:36.628090Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:36.628100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:36.628109Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:36.628126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533576603919655:2378], now have 1 active actors on pipe
2025-10-02T08:09:36.628136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.628141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.628168Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:36.628179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:36.628183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:36.628185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:36.628200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:36.628218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:36.628231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:36.628582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.628590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.628605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:36.628650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 659 partition: 0 MaxSeqNo: 17 sessionId: src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0
2025-10-02T08:09:36.629144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719dd047-f3963968-5a4b5a10-1be969d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:36.630107Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 658
2025-10-02T08:09:36.632267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0] Write session: try to update token
2025-10-02T08:09:36.632291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:36.635745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533576143709471:8017]
2025-10-02T08:09:36.636189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 658, pipe: [1:7556533576143709471:8017]
2025-10-02T08:09:36.636213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533576143709471:8017], now have 1 active actors on pipe
2025-10-02T08:09:36.652912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId: src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:36.654909Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:36.654915Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:36.654918Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:36.654929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533576143709441:8546]
2025-10-02T08:09:36.654934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533576143709441:8546]
2025-10-02T08:09:36.654990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:36.654999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.655001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:36.655117Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:36.655125Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:36.655167Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:36.656178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:36.849475Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:36.850262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.850282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.850515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:36.850525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:36.850554Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:36.850552Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:36.850587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 659 reason: error at write: Disconnected sessionId: src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0
2025-10-02T08:09:36.850784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 659 sessionId: src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0 is DEAD
2025-10-02T08:09:36.850908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:36.850918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0] Write session will restart in 0.009530s
2025-10-02T08:09:36.850942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0] Write session: Do CDS request
2025-10-02T08:09:36.850949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:36.850965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533576143709471:8017]
2025-10-02T08:09:36.861363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:36.861412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:36.861379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 660
2025-10-02T08:09:36.861627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:36.861685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:36.861695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:36.861699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:36.862097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 660 sessionId:  describe result for acl check
2025-10-02T08:09:36.862135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:36.862141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:36.862142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:36.862156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533576143709991:8553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:36.862653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533576143709991:8553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:36.864286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533576143709991:8553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:36.865489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:36.865850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:36.866012Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:36.866021Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:36.866030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:36.866070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:36.866104Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533576143710069:8552]
2025-10-02T08:09:36.866703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:36.866856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533576143709991:8553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:36.866870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533576143709991:8553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:36.866874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533576143709991:8553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:36.866882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:36.866933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:36.866971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:36.867256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:36.867297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.867303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.867304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.867305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.867306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.867311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.867321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.867324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.867327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.867330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.867336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.867343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:36.867348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.867352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:36.867356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.867360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:36.867364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.867369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.867372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.867377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.867395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:36.875683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:36.877609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:36.877633Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:36.877636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:36.877640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:36.877647Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 659 [1:7556533576143710069:8552]
2025-10-02T08:09:36.877661Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:36.877680Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:36.877684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:36.877687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:36.877689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:36.877707Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:36.877712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:36.877719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:36.877797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.877807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.877811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:36.877814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:36.877890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:36.877900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.877915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:36.877927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:36.877947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533576143710078:8553], now have 1 active actors on pipe
2025-10-02T08:09:36.877959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533576143710063:8552]
2025-10-02T08:09:36.877967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533576143710063:8552]
2025-10-02T08:09:36.877973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 659
2025-10-02T08:09:36.877976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:36.877985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:36.877987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533576603919662:2378], now have 1 active actors on pipe
2025-10-02T08:09:36.877989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:36.877993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:36.878007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:36.878016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:36.878023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.878027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.878072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533576143710063:8552]
2025-10-02T08:09:36.878060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 659
2025-10-02T08:09:36.878083Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:36.878094Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:36.878099Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:36.878106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:36.878111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:36.878113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:36.878123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:36.878132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:36.878180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:36.878257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:36.878265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:36.878280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:36.878317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 660 partition: 0 MaxSeqNo: 17 sessionId: src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0
2025-10-02T08:09:36.878694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccac6f39-931a4d2d-90d1622-387a4f8c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:36.881966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0] Write session: try to update token
2025-10-02T08:09:36.881983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:36.897160Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:36.897183Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:36.897186Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:36.897195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533576143710063:8552]
2025-10-02T08:09:36.897202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533576143710063:8552]
2025-10-02T08:09:36.897252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:36.897250Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:36.897257Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:36.897265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:36.897267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:36.897462Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:36.900406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId: src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:36.903486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:36.951131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533576143710101:8017]
2025-10-02T08:09:36.951213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 659, pipe: [1:7556533576143710101:8017]
2025-10-02T08:09:37.036974Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:37.037236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.037254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.037294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533576143710101:8017], now have 1 active actors on pipe
2025-10-02T08:09:37.037417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533576143710101:8017]
2025-10-02T08:09:37.037443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:37.037449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:37.037494Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:37.037518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 660 reason: error at write: Disconnected sessionId: src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0
2025-10-02T08:09:37.037516Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:37.037698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 660 sessionId: src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0 is DEAD
2025-10-02T08:09:37.037902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:37.037930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0] Write session will restart in 0.006613s
2025-10-02T08:09:37.037961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0] Write session: Do CDS request
2025-10-02T08:09:37.037969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:37.045453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.045471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:37.045500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 661
2025-10-02T08:09:37.045653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.045684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:37.045692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:37.045696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:37.046126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 661 sessionId:  describe result for acl check
2025-10-02T08:09:37.046163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:37.046168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:37.046170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:37.046176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533580438677793:8570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:37.046682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533580438677793:8570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:37.049350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533580438677793:8570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:37.052429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533580438677793:8570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:37.052451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533580438677793:8570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:37.052455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533580438677793:8570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:37.052465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:37.053387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:37.054392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:37.054553Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:37.054562Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:37.054572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:37.054614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:37.054670Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533580438678029:8569]
2025-10-02T08:09:37.055186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:37.055358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:37.055386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:37.055611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:37.055650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.055656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.055657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.055658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.055659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.055664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.055674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.055676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.055678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.055680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.055683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.055688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.055692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.055696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.055700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.055705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.055709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.055713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.055717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.055722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.055740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:37.064424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:37.066281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:37.066300Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:37.066303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:37.066306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:37.066313Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 660 [1:7556533580438678029:8569]
2025-10-02T08:09:37.066326Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:37.066344Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:37.066354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.066357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.066359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.066375Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:37.066380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:37.066386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:37.066448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.066456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.066459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:37.066461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:37.066529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:37.066538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.066550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.066567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:37.066588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438678011:8570], now have 1 active actors on pipe
2025-10-02T08:09:37.066602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533580438678023:8569]
2025-10-02T08:09:37.066604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533580438678023:8569]
2025-10-02T08:09:37.066617Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:37.066627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533580898886979:2378], now have 1 active actors on pipe
2025-10-02T08:09:37.066638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.066642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.066711Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 660
2025-10-02T08:09:37.066667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:37.066684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:37.066686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:37.066724Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:37.066727Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:37.066730Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|477df352-f9ed1207-c494e96d-fe995c89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:37.066736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.066739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.066741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:37.066751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.066759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:37.066769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533580438678023:8569]
2025-10-02T08:09:37.066781Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:37.066800Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:37.066803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 660
2025-10-02T08:09:37.066808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.066838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.066841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.066854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.066902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 661 partition: 0 MaxSeqNo: 17 sessionId: src_id|477df352-f9ed1207-c494e96d-fe995c89_0
2025-10-02T08:09:37.067259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69f789f4-bd6eff05-d8eca697-3cc2c302_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|477df352-f9ed1207-c494e96d-fe995c89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:37.070238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|477df352-f9ed1207-c494e96d-fe995c89_0] Write session: try to update token
2025-10-02T08:09:37.070257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|477df352-f9ed1207-c494e96d-fe995c89_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:37.112633Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:37.112647Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:37.112650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:37.112659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533580438678023:8569]
2025-10-02T08:09:37.112662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533580438678023:8569]
2025-10-02T08:09:37.112924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:37.112937Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:37.113950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:37.113972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.113974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:37.114136Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:37.114361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId: src_id|477df352-f9ed1207-c494e96d-fe995c89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:37.122560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:37.137493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533580438678062:8017]
2025-10-02T08:09:37.137638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 660, pipe: [1:7556533580438678062:8017]
2025-10-02T08:09:37.254628Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:37.255120Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:37.255131Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:37.255140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533580438678023:8569]
2025-10-02T08:09:37.255185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.255192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.255201Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:37.255211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438678062:8017], now have 1 active actors on pipe
2025-10-02T08:09:37.255662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533580438678062:8017]
2025-10-02T08:09:37.255838Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:37.256108Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:37.256180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:37.256232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 661 reason: status is not ok: tablet will be restarted right now sessionId: src_id|477df352-f9ed1207-c494e96d-fe995c89_0
2025-10-02T08:09:37.256421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 661 sessionId: src_id|477df352-f9ed1207-c494e96d-fe995c89_0 is DEAD
2025-10-02T08:09:37.256686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477df352-f9ed1207-c494e96d-fe995c89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:37.256697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477df352-f9ed1207-c494e96d-fe995c89_0] Write session will restart in 0.007814s
2025-10-02T08:09:37.256718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477df352-f9ed1207-c494e96d-fe995c89_0] Write session: Do CDS request
2025-10-02T08:09:37.256728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477df352-f9ed1207-c494e96d-fe995c89_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:37.265466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|477df352-f9ed1207-c494e96d-fe995c89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.265655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:37.265680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 662
2025-10-02T08:09:37.265854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.265900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:37.265912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:37.265917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:37.266467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 662 sessionId:  describe result for acl check
2025-10-02T08:09:37.266511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:37.266514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:37.266516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:37.266522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533580438678309:8578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:37.267689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533580438678309:8578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:37.272087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533580438678309:8578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:37.276196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533580438678309:8578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:37.276222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533580438678309:8578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:37.276226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533580438678309:8578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:37.276239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:37.276566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:37.278417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:37.278719Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:37.278732Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:37.278745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:37.278802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:37.278842Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533580438678666:8577]
2025-10-02T08:09:37.279651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:37.279895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:37.279942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:37.280222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:37.280284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.280291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.280293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.280294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.280295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.280301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.280309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.280311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.280313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.280316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.280320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.280326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.280331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.280334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.280337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.280340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.280343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.280346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.280349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.280352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.280368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:37.291516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:37.293768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:37.293786Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:37.293790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:37.293794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:37.293800Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 661 [1:7556533580438678666:8577]
2025-10-02T08:09:37.293815Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:37.293839Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:37.293846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.293849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.293850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.293867Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:37.293871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:37.293878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:37.293945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.293954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.293957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:37.293959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:37.294025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:37.294032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.294044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.294055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:37.294073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438678656:8578], now have 1 active actors on pipe
2025-10-02T08:09:37.294080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533580438678657:8577]
2025-10-02T08:09:37.294081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533580438678657:8577]
2025-10-02T08:09:37.294087Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:37.294101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:37.294102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 661
2025-10-02T08:09:37.294104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:37.294107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:37.294123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:37.294126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:37.294134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533580898886994:2378], now have 1 active actors on pipe
2025-10-02T08:09:37.294139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.294142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.294188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533580438678657:8577]
2025-10-02T08:09:37.294202Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:37.294218Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77266e15-21da0139-965e84f4-917a7370_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:37.294224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.294229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.294230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:37.294238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.294238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:37.294247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:37.294236Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 661
2025-10-02T08:09:37.294281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.294381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.294388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.294401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.294433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 662 partition: 0 MaxSeqNo: 17 sessionId: src_id|77266e15-21da0139-965e84f4-917a7370_0
2025-10-02T08:09:37.294838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|477df352-f9ed1207-c494e96d-fe995c89_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|77266e15-21da0139-965e84f4-917a7370_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:37.298645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77266e15-21da0139-965e84f4-917a7370_0] Write session: try to update token
2025-10-02T08:09:37.298664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77266e15-21da0139-965e84f4-917a7370_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:37.307142Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:37.307164Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:37.307177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533580438678657:8577]
2025-10-02T08:09:37.307229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:37.307234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:37.307423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:37.307614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:37.307840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:37.308018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:37.308295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:37.308363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:37.315976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId: src_id|77266e15-21da0139-965e84f4-917a7370_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:37.319409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:37.319546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.319568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.319611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:37.319645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:37.319719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.319747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.319935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.320007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.320094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.320176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.320232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.320244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.320343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.320411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.320479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.320567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.320621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.320632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.320703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.320779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.320877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.320951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.321004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.321013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.321091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.321162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.321236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.321307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.321370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.321373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.321444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.321510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.321587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.321661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.321708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.321712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.321791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.321852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.321921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.321991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.322043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.322047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.322123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.322187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.322259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.322330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.322375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.322379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.322457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.322524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.322595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.322668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.322713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.322716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.322799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.322871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.322945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.323014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.323059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.323063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.323138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:37.323200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:37.323266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:37.323337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:37.323386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:37.323389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:37.323444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:37.323511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.323579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.323582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:37.323618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:37.323631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:37.323635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:37.323638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:37.323640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:37.324095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:37.324114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:37.324120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:37.324123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:37.324126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:37.324130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:37.326254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:37.326286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:37.326295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:37.326298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:37.326301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:37.326304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:37.326979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:37.327000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:37.327006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:37.327011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:37.327016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:37.328420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:37.328441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:37.328452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392577328
2025-10-02T08:09:37.328644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:37.328651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:37.328656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:37.328659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:37.328663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:37.328665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:37.329188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:37.329212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:37.329217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:37.329223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:37.329226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:37.329229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:37.330653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:37.330675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:37.330726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:37.330730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:37.330734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:37.330738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:37.331229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:37.331240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:37.331247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:37.332658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:37.332664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:37.332670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:37.332673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:37.332684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392577332
2025-10-02T08:09:37.333028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:37.333039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:37.333045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:37.333048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:37.333052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:37.333055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:37.333597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:37.333611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:37.333616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:37.333620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:37.333623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:37.333627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:37.334153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:37.334163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.334263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392577333
2025-10-02T08:09:37.335084Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:37.335097Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:37.335103Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:37.335110Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:37.337391Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:37.337407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:37.337408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:37.337419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533580438678657:8577]
2025-10-02T08:09:37.337423Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533580438678657:8577]
2025-10-02T08:09:37.337491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:37.337496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.337498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:37.337506Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:37.337519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:37.337651Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:37.355624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533580438678699:8017]
2025-10-02T08:09:37.355779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 661, pipe: [1:7556533580438678699:8017]
2025-10-02T08:09:37.469749Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:37.470085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438678699:8017], now have 1 active actors on pipe
2025-10-02T08:09:37.470156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533580438678699:8017]
2025-10-02T08:09:37.470171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:37.470177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:37.470193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 662 reason: error at write: Disconnected sessionId: src_id|77266e15-21da0139-965e84f4-917a7370_0
2025-10-02T08:09:37.470302Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:37.470361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 662 sessionId: src_id|77266e15-21da0139-965e84f4-917a7370_0 is DEAD
2025-10-02T08:09:37.470369Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:37.470451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77266e15-21da0139-965e84f4-917a7370_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:37.470457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77266e15-21da0139-965e84f4-917a7370_0] Write session will restart in 0.007247s
2025-10-02T08:09:37.470474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77266e15-21da0139-965e84f4-917a7370_0] Write session: Do CDS request
2025-10-02T08:09:37.470479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77266e15-21da0139-965e84f4-917a7370_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:37.479367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77266e15-21da0139-965e84f4-917a7370_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.479424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:37.479446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 663
2025-10-02T08:09:37.479618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.479640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:37.479647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:37.479650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:37.480013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 663 sessionId:  describe result for acl check
2025-10-02T08:09:37.480037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:37.480041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:37.480042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:37.480045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533580438679096:8585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:37.480396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533580438679096:8585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:37.482853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533580438679096:8585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:37.485503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533580438679096:8585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:37.485525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533580438679096:8585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:37.485529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533580438679096:8585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:37.485538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:37.486477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:37.487534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:37.487690Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:37.487697Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:37.487704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:37.487737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:37.487765Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533580438679314:8584]
2025-10-02T08:09:37.488194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:37.488371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:37.488398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:37.488594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:37.488622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.488626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.488626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.488627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.488628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.488631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.488640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.488644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.488652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.488655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.488664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.488672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.488680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.488683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.488690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.488693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.488695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.488699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.488702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.488704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.488718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:37.497037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:37.498888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:37.498905Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:37.498908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:37.498912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:37.498918Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 662 [1:7556533580438679314:8584]
2025-10-02T08:09:37.498929Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:37.498945Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:37.498948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.498950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.498953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.498968Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:37.498977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:37.498983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:37.499043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.499050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.499053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:37.499056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:37.499117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:37.499124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.499135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.499150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:37.499170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533580438679308:8584]
2025-10-02T08:09:37.499177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533580438679308:8584]
2025-10-02T08:09:37.499184Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:37.499200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438679296:8585], now have 1 active actors on pipe
2025-10-02T08:09:37.499200Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:37.499204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:37.499213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:37.499223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 662
2025-10-02T08:09:37.499225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:37.499228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:37.499233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533580898887016:2378], now have 1 active actors on pipe
2025-10-02T08:09:37.499261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.499269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.499282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533580438679308:8584]
2025-10-02T08:09:37.499289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:37.499281Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 662
2025-10-02T08:09:37.499310Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:37.499314Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:37.499319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.499321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.499322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:37.499328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.499335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:37.499355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.499408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.499414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.499423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.499464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 663 partition: 0 MaxSeqNo: 17 sessionId: src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0
2025-10-02T08:09:37.499786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77266e15-21da0139-965e84f4-917a7370_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:37.502774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0] Write session: try to update token
2025-10-02T08:09:37.502791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:37.516825Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:37.516847Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:37.516850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:37.516858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533580438679308:8584]
2025-10-02T08:09:37.516863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533580438679308:8584]
2025-10-02T08:09:37.516907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:37.516909Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:37.516915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:37.516920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.516923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:37.517077Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:37.518108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId: src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:37.521416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:37.570121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533580438679353:8017]
2025-10-02T08:09:37.570249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 662, pipe: [1:7556533580438679353:8017]
2025-10-02T08:09:37.656233Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:37.656789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.656822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.656863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438679353:8017], now have 1 active actors on pipe
2025-10-02T08:09:37.657006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533580438679353:8017]
2025-10-02T08:09:37.657034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:37.657035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:37.657081Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:37.657100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 663 reason: error at write: Disconnected sessionId: src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0
2025-10-02T08:09:37.657170Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:37.657276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 663 sessionId: src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0 is DEAD
2025-10-02T08:09:37.657467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:37.657481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0] Write session will restart in 0.007482s
2025-10-02T08:09:37.657507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0] Write session: Do CDS request
2025-10-02T08:09:37.657515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:37.666431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.666517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:37.666536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 664
2025-10-02T08:09:37.666751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.666786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:37.666795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:37.666799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:37.667368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 664 sessionId:  describe result for acl check
2025-10-02T08:09:37.667442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:37.667445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:37.667447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:37.667454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533580438679738:8592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:37.668054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533580438679738:8592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:37.673051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533580438679738:8592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:37.675432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:37.675964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:37.676263Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:37.676274Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:37.676283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:37.676328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:37.676369Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533580438679957:8591]
2025-10-02T08:09:37.676991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:37.677241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:37.677299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:37.677557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533580438679738:8592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:37.677564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533580438679738:8592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:37.677567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533580438679738:8592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:37.677577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:37.677604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:37.677655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.677656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.677657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.677658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.677659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.677665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.677675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.677679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.677682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.677686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.677691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.677698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.677704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.677709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.677713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.677718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.677721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.677726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.677730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.677734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.677751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:37.686698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:37.688554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:37.688571Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:37.688573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:37.688576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:37.688582Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 663 [1:7556533580438679957:8591]
2025-10-02T08:09:37.688591Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:37.688607Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:37.688609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.688611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.688612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.688625Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:37.688629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:37.688634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:37.688684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.688690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.688693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:37.688695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:37.688748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:37.688754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.688764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.688773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:37.688790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533580438679947:8591]
2025-10-02T08:09:37.688795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533580438679947:8591]
2025-10-02T08:09:37.688819Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:37.688833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:37.688834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:37.688837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:37.688849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:37.688851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:37.688860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438679969:8592], now have 1 active actors on pipe
2025-10-02T08:09:37.688959Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 663
2025-10-02T08:09:37.688889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533580898887023:2378], now have 1 active actors on pipe
2025-10-02T08:09:37.688897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533580438679947:8591]
2025-10-02T08:09:37.688899Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:37.688913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:37.688914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 663
2025-10-02T08:09:37.688922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.688925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.688948Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:37.688952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.688957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.688959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:37.688966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.688974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:37.688987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.689019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.689021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.689031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.689058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 664 partition: 0 MaxSeqNo: 17 sessionId: src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0
2025-10-02T08:09:37.689489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468081ff-c209b39b-47f9e2aa-2a6a573c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:37.692875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0] Write session: try to update token
2025-10-02T08:09:37.692892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:37.708007Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:37.708030Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:37.708033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:37.708041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533580438679947:8591]
2025-10-02T08:09:37.708046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533580438679947:8591]
2025-10-02T08:09:37.708088Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:37.708090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:37.708094Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:37.708096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.708098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:37.708250Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:37.711920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId: src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:37.714664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:37.757045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533580438679987:8017]
2025-10-02T08:09:37.757291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 663, pipe: [1:7556533580438679987:8017]
2025-10-02T08:09:37.841923Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:37.842431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.842443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.842478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438679987:8017], now have 1 active actors on pipe
2025-10-02T08:09:37.842618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:37.842635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:37.842713Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:37.842728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 664 reason: error at write: Disconnected sessionId: src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0
2025-10-02T08:09:37.842719Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:37.842938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 664 sessionId: src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0 is DEAD
2025-10-02T08:09:37.842941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533580438679987:8017]
2025-10-02T08:09:37.843111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:37.843125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0] Write session will restart in 0.006174s
2025-10-02T08:09:37.843162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0] Write session: Do CDS request
2025-10-02T08:09:37.843169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:37.850389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.850523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:37.850541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 665
2025-10-02T08:09:37.850684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:37.850714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:37.850724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:37.850731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:37.851238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 665 sessionId:  describe result for acl check
2025-10-02T08:09:37.851296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:37.851305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:37.851307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:37.851314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533580438680306:8598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:37.851908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533580438680306:8598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:37.854735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533580438680306:8598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:37.857765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533580438680306:8598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:37.857781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533580438680306:8598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:37.857785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533580438680306:8598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:37.857801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:37.858762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:37.859128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:37.859297Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:37.859307Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:37.859316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:37.859362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:37.859398Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533580438680599:8597]
2025-10-02T08:09:37.859992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:37.860145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:37.860185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:37.860479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:37.860528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.860534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.860535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.860536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.860537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.860542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.860552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.860555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.860563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.860567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.860577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.860587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:37.860593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.860602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:37.860607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.860611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:37.860616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.860625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.860630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.860655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.860678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:37.868966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:37.870971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:37.870991Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:37.870993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:37.870997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:37.871004Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 664 [1:7556533580438680599:8597]
2025-10-02T08:09:37.871017Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:37.871036Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:37.871040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.871043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.871046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.871061Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:37.871067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:37.871073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:37.871144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.871153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.871156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:37.871158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:37.871226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:37.871234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.871249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:37.871266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:37.871286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438680590:8598], now have 1 active actors on pipe
2025-10-02T08:09:37.871297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533580438680593:8597]
2025-10-02T08:09:37.871302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533580438680593:8597]
2025-10-02T08:09:37.871310Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:37.871318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 664
2025-10-02T08:09:37.871321Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:37.871324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:37.871325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533580898887030:2378], now have 1 active actors on pipe
2025-10-02T08:09:37.871334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:37.871346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:37.871349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:37.871357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.871365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.871407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533580438680593:8597]
2025-10-02T08:09:37.871421Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:37.871400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 664
2025-10-02T08:09:37.871424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:37.871442Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53cbc25-1986b850-815c63c9-5ad28a97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:37.871449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:37.871458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:37.871461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:37.871470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:37.871484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:37.871544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.871590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:37.871597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:37.871609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:37.871648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 665 partition: 0 MaxSeqNo: 17 sessionId: src_id|53cbc25-1986b850-815c63c9-5ad28a97_0
2025-10-02T08:09:37.872024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f793f3-6636b40d-a8e51b3d-c185236d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53cbc25-1986b850-815c63c9-5ad28a97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:37.874879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53cbc25-1986b850-815c63c9-5ad28a97_0] Write session: try to update token
2025-10-02T08:09:37.874905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53cbc25-1986b850-815c63c9-5ad28a97_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:37.888466Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:37.888485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:37.888488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:37.888496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533580438680593:8597]
2025-10-02T08:09:37.888501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533580438680593:8597]
2025-10-02T08:09:37.888543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:37.888549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:37.888552Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:37.888555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:37.888559Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:37.888689Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:37.893029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId: src_id|53cbc25-1986b850-815c63c9-5ad28a97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:37.895960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:37.942887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533580438680625:8017]
2025-10-02T08:09:37.942988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 664, pipe: [1:7556533580438680625:8017]
2025-10-02T08:09:38.031079Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:38.031607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.031621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.031659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533580438680625:8017], now have 1 active actors on pipe
2025-10-02T08:09:38.031872Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:38.032187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533580438680625:8017]
2025-10-02T08:09:38.032212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:38.032263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 665 reason: status is not ok: tablet will be restarted right now sessionId: src_id|53cbc25-1986b850-815c63c9-5ad28a97_0
2025-10-02T08:09:38.032444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 665 sessionId: src_id|53cbc25-1986b850-815c63c9-5ad28a97_0 is DEAD
2025-10-02T08:09:38.031933Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:38.032655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53cbc25-1986b850-815c63c9-5ad28a97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:38.032667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53cbc25-1986b850-815c63c9-5ad28a97_0] Write session will restart in 0.005726s
2025-10-02T08:09:38.032695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53cbc25-1986b850-815c63c9-5ad28a97_0] Write session: Do CDS request
2025-10-02T08:09:38.032701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53cbc25-1986b850-815c63c9-5ad28a97_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:38.039506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53cbc25-1986b850-815c63c9-5ad28a97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.039525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:38.039545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 666
2025-10-02T08:09:38.039881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.039923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:38.039933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:38.039936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:38.040306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 666 sessionId:  describe result for acl check
2025-10-02T08:09:38.040355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:38.040362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:38.040363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:38.040368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533584733648245:8611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:38.041070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533584733648245:8611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:38.043490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533584733648245:8611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:38.046971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533584733648245:8611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:38.046990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533584733648245:8611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:38.046993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533584733648245:8611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:38.047002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:38.053307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:38.061226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:38.061422Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:38.061431Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:38.061438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:38.061481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:38.061512Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533584733648548:8610]
2025-10-02T08:09:38.061968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:38.062138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:38.062170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:38.062376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:38.062412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.062416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.062417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.062417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.062418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.062421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.062427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.062430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.062433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.062435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.062439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.062444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.062447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.062450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.062452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.062455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.062458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.062460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.062463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.062465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.062476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:38.070422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:38.072359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:38.072375Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:38.072376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:38.072379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:38.072383Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 665 [1:7556533584733648548:8610]
2025-10-02T08:09:38.072391Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:38.072403Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:38.072405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.072407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.072408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.072419Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:38.072426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:38.072431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:38.072475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.072480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.072482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:38.072484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:38.072538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:38.072544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.072556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.072569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:38.072591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533584733648542:8610]
2025-10-02T08:09:38.072597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533584733648542:8610]
2025-10-02T08:09:38.072605Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:38.072606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 665
2025-10-02T08:09:38.072614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:38.072617Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:38.072621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733648428:8611], now have 1 active actors on pipe
2025-10-02T08:09:38.072629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:38.072649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:38.072651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:38.072657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533585193854335:2378], now have 1 active actors on pipe
2025-10-02T08:09:38.072661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.072664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.072684Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 665
2025-10-02T08:09:38.072702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533584733648542:8610]
2025-10-02T08:09:38.072710Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:38.072714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:38.072723Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:38.072729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.072732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.072734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:38.072740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.072749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:38.072793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.072892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.072899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.072913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.072936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 666 partition: 0 MaxSeqNo: 17 sessionId: src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0
2025-10-02T08:09:38.073270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53cbc25-1986b850-815c63c9-5ad28a97_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:38.076251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0] Write session: try to update token
2025-10-02T08:09:38.076267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:38.091104Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:38.091140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:38.091146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:38.091158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533584733648542:8610]
2025-10-02T08:09:38.091165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533584733648542:8610]
2025-10-02T08:09:38.091225Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:38.091241Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:38.091246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:38.091252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.091254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:38.091414Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:38.092132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId: src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:38.094900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:38.134561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533584733648597:8017]
2025-10-02T08:09:38.134695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 665, pipe: [1:7556533584733648597:8017]
2025-10-02T08:09:38.254086Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:38.254717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.254731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.254769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733648597:8017], now have 1 active actors on pipe
2025-10-02T08:09:38.255009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:38.255322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:38.255333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0] Write session will restart in 0.005477s
2025-10-02T08:09:38.255356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0] Write session: Do CDS request
2025-10-02T08:09:38.255362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:38.254899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533584733648597:8017]
2025-10-02T08:09:38.254926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:38.254928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:38.254988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 666 reason: error at write: Disconnected sessionId: src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0
2025-10-02T08:09:38.255014Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:38.255187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 666 sessionId: src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0 is DEAD
2025-10-02T08:09:38.264360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.264398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:38.264416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 667
2025-10-02T08:09:38.264632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.264666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:38.264671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:38.264674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:38.265092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 667 sessionId:  describe result for acl check
2025-10-02T08:09:38.265116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:38.265118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:38.265119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:38.265124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533584733648922:8623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:38.265693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533584733648922:8623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:38.270416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533584733648922:8623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:38.274402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533584733648922:8623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:38.274418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533584733648922:8623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:38.274422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533584733648922:8623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:38.274429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:38.278036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:38.279153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:38.279407Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:38.279418Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:38.279428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:38.279480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:38.279531Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533584733649211:8622]
2025-10-02T08:09:38.280199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:38.280376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:38.280413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:38.280742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:38.280786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.280792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.280793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.280794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.280795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.280820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.280830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.280834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.280837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.280840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.280846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.280858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.280863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.280867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.280871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.280875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.280884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.280889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.280899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.280904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.280926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:38.291176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:38.293728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:38.293759Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:38.293765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:38.293769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:38.293776Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 666 [1:7556533584733649211:8622]
2025-10-02T08:09:38.293788Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:38.293806Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:38.293816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.293819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.293820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.293837Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:38.293846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:38.293854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:38.293930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.293938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.293941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:38.293943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:38.294013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:38.294025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.294040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.294056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:38.294072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533584733649205:8622]
2025-10-02T08:09:38.294074Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533584733649205:8622]
2025-10-02T08:09:38.294081Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:38.294095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:38.294110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:38.294113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:38.294118Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:38.294118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 666
2025-10-02T08:09:38.294121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:38.294123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733649140:8623], now have 1 active actors on pipe
2025-10-02T08:09:38.294157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533584733649205:8622]
2025-10-02T08:09:38.294160Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:38.294165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533585193854364:2378], now have 1 active actors on pipe
2025-10-02T08:09:38.294169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.294173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.294226Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81deea95-2e981809-119ad3b2-137e135_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:38.294233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.294237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.294239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:38.294248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.294257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:38.294276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.294283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:38.294395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.294412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.294439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.294482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 667 partition: 0 MaxSeqNo: 17 sessionId: src_id|81deea95-2e981809-119ad3b2-137e135_0
2025-10-02T08:09:38.294362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 666
2025-10-02T08:09:38.296930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72deb009-46f7261e-cd9e4cf7-c0908246_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|81deea95-2e981809-119ad3b2-137e135_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:38.299892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81deea95-2e981809-119ad3b2-137e135_0] Write session: try to update token
2025-10-02T08:09:38.299909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81deea95-2e981809-119ad3b2-137e135_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:38.321308Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:38.321333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:38.321336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:38.321346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533584733649205:8622]
2025-10-02T08:09:38.321350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533584733649205:8622]
2025-10-02T08:09:38.321401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:38.321409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.321411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:38.321573Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:38.322259Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:38.322274Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:38.336253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId: src_id|81deea95-2e981809-119ad3b2-137e135_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:38.339016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:38.355033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533584733649237:8017]
2025-10-02T08:09:38.355210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 666, pipe: [1:7556533584733649237:8017]
2025-10-02T08:09:38.470918Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:38.471154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.471169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.471205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733649237:8017], now have 1 active actors on pipe
2025-10-02T08:09:38.471490Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:38.471780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:38.471893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533584733649237:8017]
2025-10-02T08:09:38.471921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:38.471977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 667 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81deea95-2e981809-119ad3b2-137e135_0
2025-10-02T08:09:38.472172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 667 sessionId: src_id|81deea95-2e981809-119ad3b2-137e135_0 is DEAD
2025-10-02T08:09:38.473014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81deea95-2e981809-119ad3b2-137e135_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:38.473029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81deea95-2e981809-119ad3b2-137e135_0] Write session will restart in 0.006396s
2025-10-02T08:09:38.473059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81deea95-2e981809-119ad3b2-137e135_0] Write session: Do CDS request
2025-10-02T08:09:38.473066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81deea95-2e981809-119ad3b2-137e135_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:38.481370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81deea95-2e981809-119ad3b2-137e135_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.481518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:38.481536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 668
2025-10-02T08:09:38.481746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.481797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:38.481809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:38.481812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:38.482223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 668 sessionId:  describe result for acl check
2025-10-02T08:09:38.482250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:38.482252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:38.482253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:38.482258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533584733649515:8630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:38.482843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533584733649515:8630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:38.488351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533584733649515:8630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:38.495241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533584733649515:8630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:38.495260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533584733649515:8630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:38.495264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533584733649515:8630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:38.495273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:38.498962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:38.500488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:38.500639Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:38.500642Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:38.500650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:38.500685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:38.500723Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533584733649863:8629]
2025-10-02T08:09:38.501214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:38.501430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:38.501465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:38.501680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:38.501711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.501716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.501717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.501718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.501718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.501722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.501729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.501731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.501734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.501736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.501739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.501744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.501748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.501751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.501754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.501757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.501759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.501762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.501765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.501768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.501779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:38.515718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:38.517548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:38.517568Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:38.517570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:38.517574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:38.517581Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 667 [1:7556533584733649863:8629]
2025-10-02T08:09:38.517592Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:38.517606Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:38.517608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.517610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.517612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.517625Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:38.517629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:38.517635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:38.517686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.517694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.517696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:38.517699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:38.517871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 667
2025-10-02T08:09:38.517889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:38.517892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.517902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.517916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:38.517932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733649838:8630], now have 1 active actors on pipe
2025-10-02T08:09:38.517940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533585193854386:2378], now have 1 active actors on pipe
2025-10-02T08:09:38.517945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.517948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.517963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533584733649857:8629]
2025-10-02T08:09:38.517969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533584733649857:8629]
2025-10-02T08:09:38.517978Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:38.517988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:38.517998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:38.517998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:38.518000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:38.518001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:38.518015Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:38.518026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.518029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.518030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:38.518037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.518044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:38.518078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533584733649857:8629]
2025-10-02T08:09:38.518086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:38.518095Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:38.518100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.520234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.520258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.520293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.520357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 668 partition: 0 MaxSeqNo: 17 sessionId: src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0
2025-10-02T08:09:38.520896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 667
2025-10-02T08:09:38.524954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81deea95-2e981809-119ad3b2-137e135_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:38.528207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0] Write session: try to update token
2025-10-02T08:09:38.528233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:38.538927Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:38.538951Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:38.538954Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:38.538962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533584733649857:8629]
2025-10-02T08:09:38.538966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533584733649857:8629]
2025-10-02T08:09:38.539016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:38.539022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.539025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:38.539205Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:38.541111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:38.541128Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:38.569922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId: src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:38.572974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:38.573048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533584733649899:8017]
2025-10-02T08:09:38.573119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 667, pipe: [1:7556533584733649899:8017]
2025-10-02T08:09:38.672867Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:38.673212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.673224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.673240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733649899:8017], now have 1 active actors on pipe
2025-10-02T08:09:38.673329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533584733649899:8017]
2025-10-02T08:09:38.673351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:38.673352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:38.673401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 668 reason: error at write: Disconnected sessionId: src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0
2025-10-02T08:09:38.673471Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:38.673464Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:38.673629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 668 sessionId: src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0 is DEAD
2025-10-02T08:09:38.673728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:38.673740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0] Write session will restart in 0.008833s
2025-10-02T08:09:38.673766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0] Write session: Do CDS request
2025-10-02T08:09:38.673773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:38.683332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.683366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:38.683383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 669
2025-10-02T08:09:38.683542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.683578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:38.683586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:38.683589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:38.683948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 669 sessionId:  describe result for acl check
2025-10-02T08:09:38.683976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:38.683984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:38.683986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:38.683991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533584733650402:8637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:38.684483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533584733650402:8637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:38.687201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533584733650402:8637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:38.687866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:38.688180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:38.688331Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:38.688339Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:38.688345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:38.688385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:38.688414Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533584733650513:8636]
2025-10-02T08:09:38.688928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:38.689073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:38.689110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:38.689353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:38.689386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.689391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.689392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.689393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.689394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.689398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.689408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.689411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.689415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.689424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.689428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.689435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.689444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.689450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.689458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.689464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.689472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.689476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.689480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.689485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.689495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533584733650402:8637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:38.689504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533584733650402:8637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:38.689506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:38.689507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533584733650402:8637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:38.689512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:38.698424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:38.700207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:38.700224Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:38.700226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:38.700231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:38.700238Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 668 [1:7556533584733650513:8636]
2025-10-02T08:09:38.700250Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:38.700268Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:38.700271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.700274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.700277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.700295Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:38.700304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:38.700315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:38.700378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.700384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.700387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:38.700390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:38.700454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:38.700460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.700474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.700488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:38.700508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733650527:8637], now have 1 active actors on pipe
2025-10-02T08:09:38.700518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533584733650505:8636]
2025-10-02T08:09:38.700524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533584733650505:8636]
2025-10-02T08:09:38.700530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 668
2025-10-02T08:09:38.700533Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:38.700540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:38.700542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533585193854393:2378], now have 1 active actors on pipe
2025-10-02T08:09:38.700543Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:38.700550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:38.700563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:38.700566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:38.700572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.700576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.700620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533584733650505:8636]
2025-10-02T08:09:38.700605Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 668
2025-10-02T08:09:38.700624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:38.700627Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:38.700652Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|889831d4-54786f21-ed1ec063-c0538497_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:38.700663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.700668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.700674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:38.700684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.700695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:38.700740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.700815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.700822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.700835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.700871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 669 partition: 0 MaxSeqNo: 17 sessionId: src_id|889831d4-54786f21-ed1ec063-c0538497_0
2025-10-02T08:09:38.701206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe048f41-f9858d21-77e0c4ca-300141f2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|889831d4-54786f21-ed1ec063-c0538497_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:38.703982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889831d4-54786f21-ed1ec063-c0538497_0] Write session: try to update token
2025-10-02T08:09:38.703996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889831d4-54786f21-ed1ec063-c0538497_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:38.717350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId: src_id|889831d4-54786f21-ed1ec063-c0538497_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:38.717830Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:38.717848Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:38.717850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:38.717859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533584733650505:8636]
2025-10-02T08:09:38.717863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533584733650505:8636]
2025-10-02T08:09:38.717904Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:38.717906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:38.717914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.717916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:38.717917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:38.718036Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:38.719789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:38.773333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533584733650543:8017]
2025-10-02T08:09:38.773458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 668, pipe: [1:7556533584733650543:8017]
2025-10-02T08:09:38.846253Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:38.846515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.846525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.846563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733650543:8017], now have 1 active actors on pipe
2025-10-02T08:09:38.846668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:38.846674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:38.846723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 669 reason: error at write: Disconnected sessionId: src_id|889831d4-54786f21-ed1ec063-c0538497_0
2025-10-02T08:09:38.846802Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:38.846875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 669 sessionId: src_id|889831d4-54786f21-ed1ec063-c0538497_0 is DEAD
2025-10-02T08:09:38.846902Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:38.847005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889831d4-54786f21-ed1ec063-c0538497_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:38.847016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889831d4-54786f21-ed1ec063-c0538497_0] Write session will restart in 0.006208s
2025-10-02T08:09:38.847009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533584733650543:8017]
2025-10-02T08:09:38.847042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889831d4-54786f21-ed1ec063-c0538497_0] Write session: Do CDS request
2025-10-02T08:09:38.847048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889831d4-54786f21-ed1ec063-c0538497_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:38.854293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889831d4-54786f21-ed1ec063-c0538497_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.854361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:38.854378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 670
2025-10-02T08:09:38.854495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:38.854534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:38.854544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:38.854552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:38.854911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 670 sessionId:  describe result for acl check
2025-10-02T08:09:38.854944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:38.854951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:38.854952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:38.854957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533584733650883:8643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:38.855451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533584733650883:8643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:38.857980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533584733650883:8643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:38.860761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533584733650883:8643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:38.860774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533584733650883:8643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:38.860777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533584733650883:8643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:38.860785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:38.863181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:38.863485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:38.863719Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:38.863730Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:38.863740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:38.863791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:38.863826Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533584733651165:8642]
2025-10-02T08:09:38.864285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:38.864473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:38.864503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:38.864734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:38.864781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.864788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.864789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.864790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.864791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.864796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.864819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.864823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.864826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.864829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.864834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.864841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:38.864846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.864850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:38.864855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.864860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:38.864864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.864868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.864872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.864877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.864900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:38.873579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:38.875279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:38.875298Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:38.875301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:38.875305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:38.875311Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 669 [1:7556533584733651165:8642]
2025-10-02T08:09:38.875324Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:38.875343Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:38.875346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.875349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.875351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.875369Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:38.875374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:38.875380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:38.875459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.875466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.875470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:38.875472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:38.875551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:38.875559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.875573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:38.875581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 669
2025-10-02T08:09:38.875589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:38.875611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733651144:8643], now have 1 active actors on pipe
2025-10-02T08:09:38.875620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.875625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.875638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533585193854400:2378], now have 1 active actors on pipe
2025-10-02T08:09:38.875649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533584733651159:8642]
2025-10-02T08:09:38.875656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533584733651159:8642]
2025-10-02T08:09:38.875667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:38.875684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:38.875697Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:38.875701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:38.875704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:38.875707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:38.875721Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:38.875727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.875731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.875732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:38.875740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.875696Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 669
2025-10-02T08:09:38.875747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:38.875786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533584733651159:8642]
2025-10-02T08:09:38.875797Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:38.875810Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:38.875818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.875873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.875880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.875893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:38.875933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 670 partition: 0 MaxSeqNo: 17 sessionId: src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0
2025-10-02T08:09:38.876255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889831d4-54786f21-ed1ec063-c0538497_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:38.878975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0] Write session: try to update token
2025-10-02T08:09:38.878991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:38.887145Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:38.887168Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:38.887176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533584733651159:8642]
2025-10-02T08:09:38.887208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:38.887217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:38.887408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:38.887582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:38.887753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:38.887920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:38.888152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:38.888199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:38.895013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId: src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:38.897782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:38.897854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.897867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.897901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:38.897925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:38.897984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:38.898000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:38.898173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.898250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.898330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.898408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.898685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.898702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.898772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.898838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.898905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.898973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.899020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.899033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.899104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.899168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.899235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.899303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.899352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.899360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.899429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.899494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.899574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.899636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.899684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.899691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.899772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.899833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.899892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.899962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.900013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.900020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.900090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.900156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.900227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.900296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.900347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.900354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.900415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.900476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.900545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.900608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.900657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.900663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.900731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.900796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.900879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.900947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.901002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.901009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.901080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.901140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.901210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.901279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.901331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.901339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.901412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:38.901470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:38.901536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:38.901601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:38.901652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:38.901662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:38.901699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:38.901768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:38.901791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:38.901794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:38.901826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:38.901844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:38.901852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:38.901855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:38.901858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:38.902261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:38.902290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:38.902301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:38.902309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:38.902312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:38.902315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:38.903020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:38.903047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:38.903058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:38.903067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:38.903072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:38.903080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:38.903573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:38.903596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:38.903605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:38.903609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:38.903612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:38.905736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:38.905757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:38.905771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392578905
2025-10-02T08:09:38.905965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:38.905982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:38.905991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:38.905998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:38.906002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:38.906005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:38.906493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:38.906519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:38.906529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:38.906538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:38.906541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:38.906546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:38.907013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:38.907054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:38.907063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:38.907071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:38.907074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:38.907081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:38.907585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:38.907609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:38.907614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:38.908716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:38.908735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:38.908740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:38.908745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:38.908753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392578908
2025-10-02T08:09:38.909087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:38.909115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:38.909122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:38.909127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:38.909131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:38.909133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:38.909615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:38.909638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:38.909644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:38.909648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:38.909651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:38.909657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:38.910138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:38.910162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:38.910264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392578909
2025-10-02T08:09:38.911047Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:38.911068Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:38.911074Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:38.911081Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:38.912656Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:38.912671Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:38.912672Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:38.912682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533584733651159:8642]
2025-10-02T08:09:38.912686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533584733651159:8642]
2025-10-02T08:09:38.912733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:38.912736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:38.912740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:38.912741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:38.912747Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:38.912884Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:38.947435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533584733651198:8017]
2025-10-02T08:09:38.947521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 669, pipe: [1:7556533584733651198:8017]
2025-10-02T08:09:39.044502Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:39.045083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533584733651198:8017], now have 1 active actors on pipe
2025-10-02T08:09:39.045263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533584733651198:8017]
2025-10-02T08:09:39.045277Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:39.045286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:39.045287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:39.045316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 670 reason: error at write: Disconnected sessionId: src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0
2025-10-02T08:09:39.045319Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:39.045492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 670 sessionId: src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0 is DEAD
2025-10-02T08:09:39.045700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:39.045716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0] Write session will restart in 0.009862s
2025-10-02T08:09:39.045743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0] Write session: Do CDS request
2025-10-02T08:09:39.045751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:39.057424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.057474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:39.057494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 671
2025-10-02T08:09:39.057674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.057704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:39.057713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:39.057717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:39.058106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 671 sessionId:  describe result for acl check
2025-10-02T08:09:39.058144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:39.058150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:39.058151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:39.058157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533589028619077:8650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:39.058377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:39.058653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533589028619077:8650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:39.059296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:39.059456Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:39.059468Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:39.059479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:39.059547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:39.059585Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533589028619100:8649]
2025-10-02T08:09:39.060166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:39.060287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533589028619077:8650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:39.060362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:39.060410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:39.060902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:39.060962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.060968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.060969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.060970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.060971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.060976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.060985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.060993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.061001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.061004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.061010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.061018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.061027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.061032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.061040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.061044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.061053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.061062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.061070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.061076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.061094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:39.065814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533589028619077:8650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:39.065830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533589028619077:8650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:39.065833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533589028619077:8650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:39.065841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:39.069213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:39.070660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:39.070679Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:39.070681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:39.070684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:39.070691Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 670 [1:7556533589028619100:8649]
2025-10-02T08:09:39.070702Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:39.070716Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:39.070723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.070726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.070728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.070743Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:39.070752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:39.070759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:39.070818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.070825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.070828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:39.070831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:39.070886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:39.070896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.070907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.070918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:39.070934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028619129:8650], now have 1 active actors on pipe
2025-10-02T08:09:39.070946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533589488821704:2378], now have 1 active actors on pipe
2025-10-02T08:09:39.070953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533589028619078:8649]
2025-10-02T08:09:39.070955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533589028619078:8649]
2025-10-02T08:09:39.070967Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:39.070978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:39.070984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:39.070987Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:39.070992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:39.070995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:39.071022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533589028619078:8649]
2025-10-02T08:09:39.071030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:39.071010Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 670
2025-10-02T08:09:39.071043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:39.071070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 670
2025-10-02T08:09:39.071081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.071085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.071106Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:39.071117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.071121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.071123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:39.071131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.071144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:39.071162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.071191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.071197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.071208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.071238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 671 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0
2025-10-02T08:09:39.071622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d7648a-48cdae2a-ab6e5c57-d0194d90_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:39.074598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0] Write session: try to update token
2025-10-02T08:09:39.074616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:39.083357Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:39.083375Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:39.083382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533589028619078:8649]
2025-10-02T08:09:39.083424Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:39.083442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:39.084061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:39.084398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:39.084944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:39.085281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:39.086013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:39.086064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:39.097300Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:39.097320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:39.097322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:39.097330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533589028619078:8649]
2025-10-02T08:09:39.097334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533589028619078:8649]
2025-10-02T08:09:39.097371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:39.097378Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:39.097382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.097383Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:39.097384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:39.097879Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:39.106130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId: src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:39.108523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:39.145630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533589028619173:8017]
2025-10-02T08:09:39.145861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 670, pipe: [1:7556533589028619173:8017]
2025-10-02T08:09:39.233809Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:39.234259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.234268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.234289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028619173:8017], now have 1 active actors on pipe
2025-10-02T08:09:39.237042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:39.237063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:39.237132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 671 reason: error at write: Disconnected sessionId: src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0
2025-10-02T08:09:39.237143Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:39.237727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:39.237740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0] Write session will restart in 0.007912s
2025-10-02T08:09:39.237771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0] Write session: Do CDS request
2025-10-02T08:09:39.237779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:39.237328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 671 sessionId: src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0 is DEAD
2025-10-02T08:09:39.237500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533589028619173:8017]
2025-10-02T08:09:39.241204Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:39.247429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.252893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:39.252917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 672
2025-10-02T08:09:39.253111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.253154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:39.253166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:39.253170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:39.253822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 672 sessionId:  describe result for acl check
2025-10-02T08:09:39.253862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:39.253865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:39.253867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:39.253873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533589028619215:8668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:39.254408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533589028619215:8668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:39.256774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533589028619215:8668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:39.261136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533589028619215:8668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:39.261154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533589028619215:8668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:39.261158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533589028619215:8668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:39.261167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:39.299114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:39.301011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:39.301268Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:39.301280Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:39.301291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:39.301350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:39.301390Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533589028619806:8667]
2025-10-02T08:09:39.301986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:39.302212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:39.302254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:39.302551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:39.302592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.302597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.302598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.302599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.302600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.302605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.302615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.302619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.302623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.302626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.302632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.302639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.302645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.302650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.302654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.302659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.302664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.302669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.302673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.302677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.302696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:39.312059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:39.314917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:39.314923Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:39.314925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:39.314928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:39.314934Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 671 [1:7556533589028619806:8667]
2025-10-02T08:09:39.314946Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:39.314962Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:39.314965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.314968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.314969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.314985Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:39.314990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:39.314996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:39.315068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.315070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.315073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:39.315075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:39.315142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:39.315144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.315157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.315167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:39.315182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533589028619800:8667]
2025-10-02T08:09:39.315184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533589028619800:8667]
2025-10-02T08:09:39.315196Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:39.315207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:39.315220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:39.315223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:39.315252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533589028619800:8667]
2025-10-02T08:09:39.315254Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:39.315279Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:39.315283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:39.315290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:39.315658Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 671
2025-10-02T08:09:39.318826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5938c99-f3f605e0-dd0dea0c-7abccbc9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:39.315716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 671
2025-10-02T08:09:39.315737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028619250:8668], now have 1 active actors on pipe
2025-10-02T08:09:39.315743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533589488821733:2378], now have 1 active actors on pipe
2025-10-02T08:09:39.315803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.315808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.315840Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:39.315850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.315853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.315855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:39.315865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.315876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:39.315892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.315961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.315963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.315974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.316007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 672 partition: 0 MaxSeqNo: 17 sessionId: src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0
2025-10-02T08:09:39.322128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0] Write session: try to update token
2025-10-02T08:09:39.322149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:39.337039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533589028619830:8017]
2025-10-02T08:09:39.337246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 671, pipe: [1:7556533589028619830:8017]
2025-10-02T08:09:39.337479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028619830:8017], now have 1 active actors on pipe
2025-10-02T08:09:39.337502Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:39.337505Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:39.337507Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:39.337514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533589028619800:8667]
2025-10-02T08:09:39.337518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533589028619800:8667]
2025-10-02T08:09:39.337558Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:39.337561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:39.337564Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:39.337567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.337569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:39.338069Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:39.353279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId: src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:39.356559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:39.477446Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:39.477942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.477956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.478051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:39.478061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:39.478110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 672 reason: error at write: Disconnected sessionId: src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0
2025-10-02T08:09:39.478184Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:39.478207Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:39.478312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 672 sessionId: src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0 is DEAD
2025-10-02T08:09:39.478487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:39.478496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0] Write session will restart in 0.005439s
2025-10-02T08:09:39.478525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0] Write session: Do CDS request
2025-10-02T08:09:39.478533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:39.478585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533589028619830:8017]
2025-10-02T08:09:39.485310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.485466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:39.485491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 673
2025-10-02T08:09:39.485826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.485871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:39.485877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:39.485881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:39.486361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 673 sessionId:  describe result for acl check
2025-10-02T08:09:39.486401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:39.486409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:39.486410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:39.486415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533589028620100:8677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:39.486901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533589028620100:8677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:39.490000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533589028620100:8677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:39.493367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533589028620100:8677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:39.493394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533589028620100:8677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:39.493398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533589028620100:8677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:39.493408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:39.499690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:39.503178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:39.503455Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:39.503471Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:39.503484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:39.503562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:39.503621Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533589028620469:8676]
2025-10-02T08:09:39.504303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:39.504617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:39.504669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:39.505039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:39.505118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.505125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.505126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.505128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.505129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.505135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.505146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.505150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.505153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.505157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.505165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.505173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.505180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.505186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.505190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.505196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.505201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.505205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.505211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.505216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.505240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:39.524881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:39.527338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:39.527361Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:39.527363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:39.527367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:39.527373Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 672 [1:7556533589028620469:8676]
2025-10-02T08:09:39.527384Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:39.527413Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:39.527415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.527418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.527419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.527435Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:39.527440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:39.527446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:39.527515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.527523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.527526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:39.527528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:39.527595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:39.527602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.527616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.527632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:39.527651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533589028620463:8676]
2025-10-02T08:09:39.527661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533589028620463:8676]
2025-10-02T08:09:39.527674Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:39.527686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:39.527702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:39.527709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:39.527745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533589028620463:8676]
2025-10-02T08:09:39.527753Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:39.527770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028620398:8677], now have 1 active actors on pipe
2025-10-02T08:09:39.527783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533589488821755:2378], now have 1 active actors on pipe
2025-10-02T08:09:39.527808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 672
2025-10-02T08:09:39.527972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.527983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.527987Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:39.527989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:39.527995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:39.528007Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c16832b-252e0767-840180ab-bcb959e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:39.528013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.528016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.528018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:39.528026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.528035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:39.528054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.528108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.528115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.528126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.528157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 673 partition: 0 MaxSeqNo: 17 sessionId: src_id|4c16832b-252e0767-840180ab-bcb959e_0
2025-10-02T08:09:39.528535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de95d621-560f7bf0-cd6198f7-8c09c41c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4c16832b-252e0767-840180ab-bcb959e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:39.528882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 672
2025-10-02T08:09:39.531631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c16832b-252e0767-840180ab-bcb959e_0] Write session: try to update token
2025-10-02T08:09:39.531647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c16832b-252e0767-840180ab-bcb959e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:39.548580Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:39.548599Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:39.548601Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:39.548606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533589028620463:8676]
2025-10-02T08:09:39.548610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533589028620463:8676]
2025-10-02T08:09:39.548641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:39.548646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.548648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:39.548664Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:39.548677Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:39.548774Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:39.553466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId: src_id|4c16832b-252e0767-840180ab-bcb959e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:39.556043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:39.578712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533589028620505:8017]
2025-10-02T08:09:39.579075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 672, pipe: [1:7556533589028620505:8017]
2025-10-02T08:09:39.681695Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:39.682120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.682133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.682170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028620505:8017], now have 1 active actors on pipe
2025-10-02T08:09:39.682281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533589028620505:8017]
2025-10-02T08:09:39.682305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:39.682307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:39.682361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 673 reason: error at write: Disconnected sessionId: src_id|4c16832b-252e0767-840180ab-bcb959e_0
2025-10-02T08:09:39.682369Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:39.682401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:39.682516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 673 sessionId: src_id|4c16832b-252e0767-840180ab-bcb959e_0 is DEAD
2025-10-02T08:09:39.682690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c16832b-252e0767-840180ab-bcb959e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:39.682700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c16832b-252e0767-840180ab-bcb959e_0] Write session will restart in 0.009032s
2025-10-02T08:09:39.682724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c16832b-252e0767-840180ab-bcb959e_0] Write session: Do CDS request
2025-10-02T08:09:39.682729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c16832b-252e0767-840180ab-bcb959e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:39.693352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c16832b-252e0767-840180ab-bcb959e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.693461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:39.693481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 674
2025-10-02T08:09:39.693620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.693651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:39.693665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:39.693669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:39.694043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 674 sessionId:  describe result for acl check
2025-10-02T08:09:39.694075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:39.694076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:39.694078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:39.694083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533589028620941:8684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:39.694603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533589028620941:8684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:39.697281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533589028620941:8684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:39.699732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533589028620941:8684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:39.699743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533589028620941:8684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:39.699745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533589028620941:8684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:39.699751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:39.702027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:39.702411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:39.702561Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:39.702571Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:39.702580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:39.702619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:39.702654Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533589028621135:8683]
2025-10-02T08:09:39.703261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:39.703434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:39.703472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:39.703784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:39.703829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.703835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.703836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.703837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.703838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.703843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.703852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.703857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.703861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.703864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.703870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.703881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.703887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.703893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.703901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.703906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.703911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.703916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.703920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.703925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.703943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:39.712175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:39.714003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:39.714023Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:39.714026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:39.714030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:39.714039Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 673 [1:7556533589028621135:8683]
2025-10-02T08:09:39.714052Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:39.714068Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:39.714072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.714079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.714082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.714097Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:39.714106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:39.714114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:39.714179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.714186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.714189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:39.714192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:39.714258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:39.714264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.714277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.714294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:39.714315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028621116:8684], now have 1 active actors on pipe
2025-10-02T08:09:39.714325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533589028621129:8683]
2025-10-02T08:09:39.714331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 673
2025-10-02T08:09:39.714332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533589028621129:8683]
2025-10-02T08:09:39.714340Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:39.714350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533589488821761:2378], now have 1 active actors on pipe
2025-10-02T08:09:39.714353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:39.714356Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:39.714356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:39.714370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:39.714372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:39.714380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.714384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.714420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533589028621129:8683]
2025-10-02T08:09:39.714432Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:39.714439Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:39.714446Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:39.714452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.714455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.714457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:39.714433Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 673
2025-10-02T08:09:39.714465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.714477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:39.714515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.714593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.714599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.714611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.714650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 674 partition: 0 MaxSeqNo: 17 sessionId: src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0
2025-10-02T08:09:39.715004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c16832b-252e0767-840180ab-bcb959e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:39.717784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0] Write session: try to update token
2025-10-02T08:09:39.717804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:39.732365Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:39.732387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:39.732390Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:39.732398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533589028621129:8683]
2025-10-02T08:09:39.732402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533589028621129:8683]
2025-10-02T08:09:39.732448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:39.732452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:39.732456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.732457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:39.732458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:39.732614Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:39.735176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId: src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:39.738049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:39.782514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533589028621159:8017]
2025-10-02T08:09:39.782665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 673, pipe: [1:7556533589028621159:8017]
2025-10-02T08:09:39.859926Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:39.860464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.860476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.860508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028621159:8017], now have 1 active actors on pipe
2025-10-02T08:09:39.860653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533589028621159:8017]
2025-10-02T08:09:39.860677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:39.860679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:39.860698Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:39.860736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 674 reason: error at write: Disconnected sessionId: src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0
2025-10-02T08:09:39.860765Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:39.860956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 674 sessionId: src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0 is DEAD
2025-10-02T08:09:39.861273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:39.861283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0] Write session will restart in 0.007947s
2025-10-02T08:09:39.861320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0] Write session: Do CDS request
2025-10-02T08:09:39.861327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:39.870269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.870357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:39.870375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 675
2025-10-02T08:09:39.870492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:39.870527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:39.870531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:39.870534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:39.870951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 675 sessionId:  describe result for acl check
2025-10-02T08:09:39.870985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:39.870992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:39.870993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:39.870999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533589028621564:8690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:39.871424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533589028621564:8690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:39.873907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533589028621564:8690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:39.876878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533589028621564:8690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:39.876893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533589028621564:8690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:39.876895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533589028621564:8690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:39.876900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:39.878645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:39.879034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:39.879186Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:39.879197Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:39.879206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:39.879252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:39.879289Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533589028621791:8689]
2025-10-02T08:09:39.879733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:39.879879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:39.879906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:39.880099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:39.880126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.880130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.880131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.880132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.880132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.880135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.880142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.880145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.880147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.880150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.880154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.880158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:39.880161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.880164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:39.880166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.880173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:39.880176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.880179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.880181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.880184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.880196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:39.888653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:39.890277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:39.890296Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:39.890299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:39.890303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:39.890311Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 674 [1:7556533589028621791:8689]
2025-10-02T08:09:39.890319Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:39.890333Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:39.890334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.890337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.890338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.890350Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:39.890358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:39.890363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:39.890418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.890426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.890429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:39.890431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:39.890479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:39.890484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.890492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:39.890503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:39.890518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533589028621785:8689]
2025-10-02T08:09:39.890523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533589028621785:8689]
2025-10-02T08:09:39.890531Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:39.890543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:39.890555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:39.890555Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:39.890559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:39.890560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:39.890566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 674
2025-10-02T08:09:39.890567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028621775:8690], now have 1 active actors on pipe
2025-10-02T08:09:39.890590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533589488821767:2378], now have 1 active actors on pipe
2025-10-02T08:09:39.890595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533589028621785:8689]
2025-10-02T08:09:39.890599Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:39.890603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.890609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:39.890610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.890639Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:39.890648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:39.890651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:39.890656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:39.890663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:39.890672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:39.890655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 674
2025-10-02T08:09:39.890693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.890761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:39.890767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:39.890778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:39.890810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 675 partition: 0 MaxSeqNo: 17 sessionId: src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0
2025-10-02T08:09:39.891110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15cd1320-f7e62f0c-a769eb6b-e3ebeaa5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:39.894098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0] Write session: try to update token
2025-10-02T08:09:39.894116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:39.908972Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:39.909003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:39.909007Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:39.909018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533589028621785:8689]
2025-10-02T08:09:39.909025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533589028621785:8689]
2025-10-02T08:09:39.909084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:39.909095Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:39.909101Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:39.909101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:39.909104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:39.909476Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:39.912077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId: src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:39.914569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:39.960682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533589028621817:8017]
2025-10-02T08:09:39.960889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 674, pipe: [1:7556533589028621817:8017]
2025-10-02T08:09:40.047333Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:40.047938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.047958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.047997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533589028621817:8017], now have 1 active actors on pipe
2025-10-02T08:09:40.048124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533589028621817:8017]
2025-10-02T08:09:40.048175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:40.048195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:40.048252Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:40.048293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 675 reason: error at write: Disconnected sessionId: src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0
2025-10-02T08:09:40.048370Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:40.048662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:40.048673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0] Write session will restart in 0.006660s
2025-10-02T08:09:40.048700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0] Write session: Do CDS request
2025-10-02T08:09:40.048710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:40.048516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 675 sessionId: src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0 is DEAD
2025-10-02T08:09:40.056348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.056516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:40.056539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 676
2025-10-02T08:09:40.056645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.056682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:40.056688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:40.056692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:40.057147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 676 sessionId:  describe result for acl check
2025-10-02T08:09:40.057203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:40.057211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:40.057213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:40.057219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533593323589386:8697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:40.057777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533593323589386:8697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:40.060750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533593323589386:8697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:40.064731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533593323589386:8697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:40.064751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533593323589386:8697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:40.064754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533593323589386:8697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:40.064762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:40.067957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:40.069488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:40.069724Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:40.069735Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:40.069749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:40.069807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:40.069855Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533593323589747:8696]
2025-10-02T08:09:40.070557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:40.070843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:40.070895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:40.071221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:40.071295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.071303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.071305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.071306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.071307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.071312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.071323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.071327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.071330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.071334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.071341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.071350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.071356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.071360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.071364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.071369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.071375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.071384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.071388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.071393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.071418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:40.080054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:40.082102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:40.082124Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:40.082127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:40.082132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:40.082141Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 675 [1:7556533593323589747:8696]
2025-10-02T08:09:40.082156Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:40.082185Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:40.082192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.082196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.082199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.082221Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:40.082232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:40.082241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:40.082316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.082325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.082332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:40.082335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:40.082417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:40.082425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.082436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.082451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:40.082478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323589705:8697], now have 1 active actors on pipe
2025-10-02T08:09:40.082480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 675
2025-10-02T08:09:40.082487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533593783789072:2378], now have 1 active actors on pipe
2025-10-02T08:09:40.082496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533593323589741:8696]
2025-10-02T08:09:40.082498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533593323589741:8696]
2025-10-02T08:09:40.082513Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:40.082528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:40.082529Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:40.082533Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:40.082541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:40.082545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:40.082553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.082558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.082565Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 675
2025-10-02T08:09:40.082609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533593323589741:8696]
2025-10-02T08:09:40.082622Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:40.082626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:40.082641Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:40.082653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.082662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.082664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:40.082675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.082691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:40.082738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.082827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.082835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.082850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.082891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 676 partition: 0 MaxSeqNo: 17 sessionId: src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0
2025-10-02T08:09:40.083290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2426fcc-4d6b2cf2-757d6a98-4a5b0e72_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:40.086234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0] Write session: try to update token
2025-10-02T08:09:40.086254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:40.094177Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:40.094202Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:40.094214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533593323589741:8696]
2025-10-02T08:09:40.094264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:40.094271Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:40.094459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:40.094676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:40.094836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:40.095000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:40.095332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:40.095384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:40.104585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId: src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:40.107614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:40.107677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.107687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.107724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:40.107742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:40.107807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.107817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.108005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.108085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.108211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.108333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.108665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.108682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.108761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.108849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.108941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.109021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.109093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.109102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.109191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.109269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.109389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.109519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.109578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.109586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.109714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.109796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.109888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.110014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.110176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.110186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.110303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.110373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.110477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.110557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.110670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.110678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.110800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.110900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.110982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.111057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.111127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.111136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.111215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.111288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.111372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.111447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.111516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.111524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.111648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.111769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.111886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.111987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.112046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.112054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.112139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.112214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.112290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.112368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.112427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.112435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.112518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:40.112595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:40.112668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:40.112746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:40.112822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:40.112831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:40.112913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:40.112991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.113015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.113024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:40.113065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:40.113086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:40.113094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:40.113098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:40.113106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:40.113564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:40.113598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:40.113606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:40.113615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:40.113618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:40.113621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:40.114401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:40.114453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:40.114471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:40.114473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:40.114476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:40.114479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:40.114970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:40.114994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:40.114998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:40.115000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:40.115005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:40.116199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:40.116215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:40.116225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392580115
2025-10-02T08:09:40.116342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:40.116353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:40.116358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:40.116361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:40.116364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:40.116366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:40.116784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:40.116823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:40.116828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:40.116832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:40.116835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:40.116840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:40.117290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:40.117316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:40.117323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:40.117326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:40.117328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:40.117331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:40.117746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:40.117766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:40.117770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:40.118791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:40.118808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:40.118811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:40.118814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:40.118820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392580118
2025-10-02T08:09:40.119118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:40.119141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:40.119146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:40.119154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:40.119156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:40.119159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:40.119563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:40.119581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:40.119584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:40.119588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:40.119591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:40.119593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:40.119978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:40.119996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.120092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392580119
2025-10-02T08:09:40.122234Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:40.122256Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:40.122260Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:40.122265Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:40.122272Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:40.122274Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:40.122275Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:40.122286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533593323589741:8696]
2025-10-02T08:09:40.122290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533593323589741:8696]
2025-10-02T08:09:40.122352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:40.122359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.122361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:40.122363Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:40.122372Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:40.122473Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:40.148340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533593323589803:8017]
2025-10-02T08:09:40.148687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 675, pipe: [1:7556533593323589803:8017]
2025-10-02T08:09:40.246582Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:40.246892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323589803:8017], now have 1 active actors on pipe
2025-10-02T08:09:40.247114Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:40.247121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:40.247124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:40.247145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 676 reason: error at write: Disconnected sessionId: src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0
2025-10-02T08:09:40.247281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 676 sessionId: src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0 is DEAD
2025-10-02T08:09:40.247424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:40.247437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0] Write session will restart in 0.009735s
2025-10-02T08:09:40.247406Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:40.247460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0] Write session: Do CDS request
2025-10-02T08:09:40.247434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533593323589803:8017]
2025-10-02T08:09:40.247467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:40.250745Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [23387a362fee9a05] Result# TEvPutResult {Id# [72075186224037892:675:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:40.250754Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:675:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:40.250790Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:675:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:40.258260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.258418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:40.258434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 677
2025-10-02T08:09:40.258539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.258561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:40.258571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:40.258577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:40.258883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 677 sessionId:  describe result for acl check
2025-10-02T08:09:40.258906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:40.258910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:40.258911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:40.258914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533593323590336:8715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:40.259412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533593323590336:8715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:40.261631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533593323590336:8715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:40.262029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:40.263125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:40.263301Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:40.263309Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:40.263318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:40.263367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:40.263566Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533593323590441:8714]
2025-10-02T08:09:40.263971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533593323590336:8715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:40.263980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533593323590336:8715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:40.263982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533593323590336:8715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:40.263987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:40.264087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:40.264238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:40.264277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:40.264534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:40.264579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.264584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.264585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.264586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.264587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.264592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.264601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.264604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.264608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.264611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.264616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.264625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.264635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.264643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.264651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.264661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.264668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.264674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.264682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.264686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.264706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:40.272465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:40.273973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:40.273990Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:40.273993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:40.273996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:40.274002Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 676 [1:7556533593323590441:8714]
2025-10-02T08:09:40.274012Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:40.274027Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:40.274030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.274033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.274035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.274049Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:40.274059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:40.274065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:40.274120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.274128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.274131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:40.274133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:40.274193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:40.274205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.274217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.274227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:40.274231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 676
2025-10-02T08:09:40.274246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323590446:8715], now have 1 active actors on pipe
2025-10-02T08:09:40.274255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533593783789100:2378], now have 1 active actors on pipe
2025-10-02T08:09:40.274259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.274263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.274278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533593323590431:8714]
2025-10-02T08:09:40.274285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533593323590431:8714]
2025-10-02T08:09:40.274296Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:40.274304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:40.274307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:40.274312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:40.274328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:40.274335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:40.274349Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66f7fae9-ac072431-cc8af83-739da9e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:40.274360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.274363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.274370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:40.274379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.274392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:40.274368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 676
2025-10-02T08:09:40.274428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533593323590431:8714]
2025-10-02T08:09:40.274440Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:40.274448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:40.274456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.274500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.274507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.274519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.274559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 677 partition: 0 MaxSeqNo: 17 sessionId: src_id|66f7fae9-ac072431-cc8af83-739da9e6_0
2025-10-02T08:09:40.274864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bf012a-679ba0b7-ee62c66-3f4fec0c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|66f7fae9-ac072431-cc8af83-739da9e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:40.277637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f7fae9-ac072431-cc8af83-739da9e6_0] Write session: try to update token
2025-10-02T08:09:40.277655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f7fae9-ac072431-cc8af83-739da9e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:40.290794Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:40.290814Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:40.290816Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:40.290824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533593323590431:8714]
2025-10-02T08:09:40.290827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533593323590431:8714]
2025-10-02T08:09:40.290867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:40.290867Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:40.290871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:40.290875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.290877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:40.290994Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:40.293974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId: src_id|66f7fae9-ac072431-cc8af83-739da9e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:40.296552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:40.347686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533593323590473:8017]
2025-10-02T08:09:40.347799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 676, pipe: [1:7556533593323590473:8017]
2025-10-02T08:09:40.421156Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:40.421688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.421702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.421741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323590473:8017], now have 1 active actors on pipe
2025-10-02T08:09:40.421844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:40.421855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:40.421912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 677 reason: error at write: Disconnected sessionId: src_id|66f7fae9-ac072431-cc8af83-739da9e6_0
2025-10-02T08:09:40.422002Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:40.422076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 677 sessionId: src_id|66f7fae9-ac072431-cc8af83-739da9e6_0 is DEAD
2025-10-02T08:09:40.422085Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:40.422232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f7fae9-ac072431-cc8af83-739da9e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:40.422243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f7fae9-ac072431-cc8af83-739da9e6_0] Write session will restart in 0.008700s
2025-10-02T08:09:40.422265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f7fae9-ac072431-cc8af83-739da9e6_0] Write session: Do CDS request
2025-10-02T08:09:40.422271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f7fae9-ac072431-cc8af83-739da9e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:40.422263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533593323590473:8017]
2025-10-02T08:09:40.432264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f7fae9-ac072431-cc8af83-739da9e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.432284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:40.432304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 678
2025-10-02T08:09:40.432450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.432481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:40.432491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:40.432495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:40.432886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 678 sessionId:  describe result for acl check
2025-10-02T08:09:40.432920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:40.432926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:40.432927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:40.432932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533593323590958:8721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:40.433411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533593323590958:8721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:40.435679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533593323590958:8721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:40.438019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:40.438289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:40.438361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533593323590958:8721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:40.438372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533593323590958:8721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:40.438379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533593323590958:8721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:40.438400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:40.438456Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:40.438465Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:40.438474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:40.438532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:40.438599Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533593323591109:8720]
2025-10-02T08:09:40.439021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:40.439169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:40.439207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:40.439579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:40.439634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.439640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.439640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.439641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.439641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.439645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.439651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.439653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.439656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.439657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.439661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.439665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.439671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.439674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.439676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.439679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.439685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.439688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.439690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.439696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.439708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:40.447392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:40.449089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:40.449109Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:40.449112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:40.449116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:40.449122Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 677 [1:7556533593323591109:8720]
2025-10-02T08:09:40.449135Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:40.449152Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:40.449159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.449162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.449165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.449181Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:40.449192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:40.449200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:40.449268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.449275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.449279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:40.449282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:40.449368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:40.449378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.449392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.449407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:40.449429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 677
2025-10-02T08:09:40.449431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533593783789107:2378], now have 1 active actors on pipe
2025-10-02T08:09:40.449435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323591111:8721], now have 1 active actors on pipe
2025-10-02T08:09:40.449490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 677
2025-10-02T08:09:40.449441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533593323591102:8720]
2025-10-02T08:09:40.449443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533593323591102:8720]
2025-10-02T08:09:40.449455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:40.449466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.449469Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:40.449470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.449472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:40.449488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:40.449501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:40.449507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:40.449551Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:40.449557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.449561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.449563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:40.449573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.449582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:40.449589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533593323591102:8720]
2025-10-02T08:09:40.449597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:40.449605Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:40.449625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.449680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.449689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.449702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.449739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 678 partition: 0 MaxSeqNo: 17 sessionId: src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0
2025-10-02T08:09:40.450060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f7fae9-ac072431-cc8af83-739da9e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:40.452783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0] Write session: try to update token
2025-10-02T08:09:40.452820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:40.467304Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:40.467328Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:40.467330Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:40.467338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533593323591102:8720]
2025-10-02T08:09:40.467341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533593323591102:8720]
2025-10-02T08:09:40.467378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:40.467384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.467383Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:40.467385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:40.467388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:40.467539Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:40.470843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId: src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:40.473713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:40.522331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533593323591145:8017]
2025-10-02T08:09:40.522479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 677, pipe: [1:7556533593323591145:8017]
2025-10-02T08:09:40.603193Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:40.603563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.603578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.603613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323591145:8017], now have 1 active actors on pipe
2025-10-02T08:09:40.603742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533593323591145:8017]
2025-10-02T08:09:40.603770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:40.603776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:40.603844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 678 reason: error at write: Disconnected sessionId: src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0
2025-10-02T08:09:40.603849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:40.603992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 678 sessionId: src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0 is DEAD
2025-10-02T08:09:40.604049Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:40.604149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:40.604160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0] Write session will restart in 0.005571s
2025-10-02T08:09:40.604197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0] Write session: Do CDS request
2025-10-02T08:09:40.604205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:40.611289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.611362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:40.611381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 679
2025-10-02T08:09:40.611537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.611596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:40.611609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:40.611613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:40.612061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 679 sessionId:  describe result for acl check
2025-10-02T08:09:40.612091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:40.612097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:40.612099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:40.612103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533593323591462:8729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:40.612576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533593323591462:8729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:40.615109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533593323591462:8729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:40.618494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533593323591462:8729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:40.618518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533593323591462:8729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:40.618521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533593323591462:8729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:40.618528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:40.622840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:40.623192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:40.623332Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:40.623345Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:40.623354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:40.623394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:40.623438Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533593323591795:8728]
2025-10-02T08:09:40.624008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:40.624226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:40.624298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:40.624570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:40.624618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.624624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.624625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.624625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.624635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.624640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.624651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.624661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.624665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.624668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.624674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.624688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.624700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.624706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.624710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.624715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.624720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.624725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.624730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.624735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.624754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:40.633119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:40.634897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:40.634914Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:40.634917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:40.634919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:40.634924Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 678 [1:7556533593323591795:8728]
2025-10-02T08:09:40.634933Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:40.634946Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:40.634948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.634950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.634952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.634963Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:40.634966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:40.634971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:40.635019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.635026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.635028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:40.635030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:40.635076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:40.635084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.635095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.635102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:40.635114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533593323591789:8728]
2025-10-02T08:09:40.635121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533593323591789:8728]
2025-10-02T08:09:40.635129Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:40.635138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:40.635146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:40.635152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:40.635155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:40.635159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:40.635160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323591752:8729], now have 1 active actors on pipe
2025-10-02T08:09:40.635162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533593783789129:2378], now have 1 active actors on pipe
2025-10-02T08:09:40.635171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 678
2025-10-02T08:09:40.635187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533593323591789:8728]
2025-10-02T08:09:40.635203Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:40.635209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:40.635209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.635212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.635251Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:40.635261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.635263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.635265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:40.635271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.635277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:40.635253Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 678
2025-10-02T08:09:40.635294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.635333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.635342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.635353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.635386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 679 partition: 0 MaxSeqNo: 17 sessionId: src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0
2025-10-02T08:09:40.635686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503b9622-e21a71d5-c1e42a96-2245f0e4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:40.638396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0] Write session: try to update token
2025-10-02T08:09:40.638412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:40.652464Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:40.652488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:40.652491Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:40.652499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533593323591789:8728]
2025-10-02T08:09:40.652503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533593323591789:8728]
2025-10-02T08:09:40.652545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:40.652547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:40.652550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.652551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:40.652552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:40.652697Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:40.655166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId: src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:40.657806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:40.704067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533593323591821:8017]
2025-10-02T08:09:40.704177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 678, pipe: [1:7556533593323591821:8017]
2025-10-02T08:09:40.793775Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:40.794056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.794076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.794116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323591821:8017], now have 1 active actors on pipe
2025-10-02T08:09:40.794273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533593323591821:8017]
2025-10-02T08:09:40.794305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:40.794313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:40.794380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 679 reason: error at write: Disconnected sessionId: src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0
2025-10-02T08:09:40.794400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:40.794571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 679 sessionId: src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0 is DEAD
2025-10-02T08:09:40.794603Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:40.794734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:40.794742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0] Write session will restart in 0.007904s
2025-10-02T08:09:40.794765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0] Write session: Do CDS request
2025-10-02T08:09:40.794771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:40.804300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.804367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:40.804385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 680
2025-10-02T08:09:40.804512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.804544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:40.804554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:40.804558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:40.804971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 680 sessionId:  describe result for acl check
2025-10-02T08:09:40.805009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:40.805016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:40.805018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:40.805023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533593323592273:8735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:40.805451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533593323592273:8735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:40.807380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533593323592273:8735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:40.811033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533593323592273:8735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:40.811050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533593323592273:8735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:40.811054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533593323592273:8735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:40.811063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:40.812778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:40.814108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:40.814450Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:40.814462Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:40.814472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:40.814532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:40.814575Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533593323592463:8734]
2025-10-02T08:09:40.815320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:40.815507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:40.815540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:40.815741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:40.815774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.815779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.815780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.815781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.815782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.815785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.815791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.815794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.815796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.815798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.815803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.815807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.815810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.815814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.815816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.815819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.815822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.815825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.815827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.815830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.815840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:40.823893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:40.825346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:40.825366Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:40.825368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:40.825371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:40.825377Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 679 [1:7556533593323592463:8734]
2025-10-02T08:09:40.825386Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:40.825402Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:40.825409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.825412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.825413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.825425Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:40.825430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:40.825435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:40.825491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.825499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.825502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:40.825503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:40.825555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:40.825566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.825579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.825591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:40.825607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533593323592457:8734]
2025-10-02T08:09:40.825610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533593323592457:8734]
2025-10-02T08:09:40.825620Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:40.825634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:40.825639Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:40.825642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 679
2025-10-02T08:09:40.825644Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:40.825651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:40.825654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:40.825664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323592441:8735], now have 1 active actors on pipe
2025-10-02T08:09:40.825729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 679
2025-10-02T08:09:40.825672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533593783789136:2378], now have 1 active actors on pipe
2025-10-02T08:09:40.825704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.825707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.825722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533593323592457:8734]
2025-10-02T08:09:40.825730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:40.825744Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:40.825755Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:40.825761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:40.825764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:40.825766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:40.825776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:40.825783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:40.825801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.825858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.825867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.825879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:40.825913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 680 partition: 0 MaxSeqNo: 17 sessionId: src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0
2025-10-02T08:09:40.826329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52bf9060-9816b83f-d14c6729-1f6373f2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:40.829144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0] Write session: try to update token
2025-10-02T08:09:40.829163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:40.842826Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:40.842848Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:40.842850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:40.842859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533593323592457:8734]
2025-10-02T08:09:40.842863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533593323592457:8734]
2025-10-02T08:09:40.842902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:40.842902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:40.842907Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:40.842909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.842911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:40.843062Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:40.847140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId: src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:40.849763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:40.894534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533593323592487:8017]
2025-10-02T08:09:40.894640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 679, pipe: [1:7556533593323592487:8017]
2025-10-02T08:09:40.973544Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:40.973873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:40.973884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:40.973917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323592487:8017], now have 1 active actors on pipe
2025-10-02T08:09:40.974023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:40.974029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:40.974070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 680 reason: error at write: Disconnected sessionId: src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0
2025-10-02T08:09:40.974161Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:40.974166Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:40.974216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 680 sessionId: src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0 is DEAD
2025-10-02T08:09:40.974336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533593323592487:8017]
2025-10-02T08:09:40.974376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:40.974382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0] Write session will restart in 0.005672s
2025-10-02T08:09:40.974405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0] Write session: Do CDS request
2025-10-02T08:09:40.974411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:40.981321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.981513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:40.981532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 681
2025-10-02T08:09:40.981677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:40.981717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:40.981726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:40.981729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:40.982139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 681 sessionId:  describe result for acl check
2025-10-02T08:09:40.982175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:40.982181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:40.982182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:40.982188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533593323592850:8742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:40.982767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533593323592850:8742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:40.984816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533593323592850:8742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:40.987911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533593323592850:8742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:40.987930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533593323592850:8742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:40.987933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533593323592850:8742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:40.987941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:40.991079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:40.991456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:40.991624Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:40.991635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:40.991643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:40.991688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:40.991724Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533593323593132:8741]
2025-10-02T08:09:40.992268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:40.992472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:40.992517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:40.992772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:40.992832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.992839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.992840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.992840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.992842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.992846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.992856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.992860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.992863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.992866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.992871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.992877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:40.992882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.992887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:40.992890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.992895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:40.992898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.992903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:40.992907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.992911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:40.992927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:41.001013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:41.002916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:41.002937Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:41.002939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:41.002943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:41.002950Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 680 [1:7556533593323593132:8741]
2025-10-02T08:09:41.002962Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:41.002980Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:41.002983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.002987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.002989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.003006Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:41.003011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:41.003017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:41.003074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.003083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.003086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:41.003089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:41.003300Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 680
2025-10-02T08:09:41.003154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:41.003161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.003173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.003184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:41.003199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533593323593126:8741]
2025-10-02T08:09:41.003201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533593323593126:8741]
2025-10-02T08:09:41.003207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:41.003219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:41.003221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:41.003223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:41.003234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:41.003237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:41.003246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533593323593111:8742], now have 1 active actors on pipe
2025-10-02T08:09:41.003258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 680
2025-10-02T08:09:41.003277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533593783789144:2378], now have 1 active actors on pipe
2025-10-02T08:09:41.003282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.003286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.003299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533593323593126:8741]
2025-10-02T08:09:41.003303Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:41.003325Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:41.003329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:41.003335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.003338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.003340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:41.003350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.003358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:41.003383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.003454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.003457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.003469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.003522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 681 partition: 0 MaxSeqNo: 17 sessionId: src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0
2025-10-02T08:09:41.003908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd14efa-72f982fa-11c2c2fe-e8b34dac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:41.006578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0] Write session: try to update token
2025-10-02T08:09:41.006601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:41.020764Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:41.020792Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.020796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:41.020821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533593323593126:8741]
2025-10-02T08:09:41.020825Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533593323593126:8741]
2025-10-02T08:09:41.020867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:41.020875Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:41.020876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.020878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:41.020891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:41.021028Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:41.025035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId: src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:41.027856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:41.074242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533597618560453:8017]
2025-10-02T08:09:41.074410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 680, pipe: [1:7556533597618560453:8017]
2025-10-02T08:09:41.155767Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:41.156081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.156097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.156133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618560453:8017], now have 1 active actors on pipe
2025-10-02T08:09:41.156181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533597618560453:8017]
2025-10-02T08:09:41.156301Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:41.156362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:41.156598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:41.156652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 681 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0
2025-10-02T08:09:41.156845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 681 sessionId: src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0 is DEAD
2025-10-02T08:09:41.156975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:41.156982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0] Write session will restart in 0.008342s
2025-10-02T08:09:41.157007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0] Write session: Do CDS request
2025-10-02T08:09:41.157013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:41.166293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.166430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:41.166448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 682
2025-10-02T08:09:41.166599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.166627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:41.166636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:41.166639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:41.167013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 682 sessionId:  describe result for acl check
2025-10-02T08:09:41.167044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:41.167051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:41.167052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:41.167057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533597618561034:8754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:41.168826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533597618561034:8754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:41.170283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:41.170912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533597618561034:8754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:41.171153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:41.171443Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:41.171458Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:41.171469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:41.171533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:41.171568Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533597618561098:8753]
2025-10-02T08:09:41.172103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:41.172322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:41.172360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:41.172621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:41.172666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.172672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.172673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.172674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.172675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.172679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.172687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.172691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.172694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.172697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.172702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.172709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.172718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.172727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.172734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.172739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.172747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.172752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.172766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.172774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.172791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:41.178391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533597618561034:8754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:41.178410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533597618561034:8754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:41.178413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533597618561034:8754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:41.178420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:41.180523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:41.182342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:41.182361Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:41.182364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:41.182367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:41.182372Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 681 [1:7556533597618561098:8753]
2025-10-02T08:09:41.182382Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:41.182397Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:41.182400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.182403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.182404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.182420Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:41.182424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:41.182430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:41.182488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.182497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.182499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:41.182501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:41.182561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:41.182568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.182580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.182589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:41.182608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533597618561090:8753]
2025-10-02T08:09:41.182614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533597618561090:8753]
2025-10-02T08:09:41.182621Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:41.182632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618561122:8754], now have 1 active actors on pipe
2025-10-02T08:09:41.182637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:41.182640Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:41.182644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:41.182657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:41.182663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:41.182668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533598078756447:2378], now have 1 active actors on pipe
2025-10-02T08:09:41.182695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533597618561090:8753]
2025-10-02T08:09:41.182708Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:41.182721Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:41.182744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 681
2025-10-02T08:09:41.182756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.182763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.182785Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53853877-213e468-f685a5b6-f08aa141_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:41.182795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.182798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.182799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:41.182807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.182819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:41.182780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 681
2025-10-02T08:09:41.182843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.182876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.182881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.182894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.182925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 682 partition: 0 MaxSeqNo: 17 sessionId: src_id|53853877-213e468-f685a5b6-f08aa141_0
2025-10-02T08:09:41.183282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1be020-c4b0f076-5f75d1ae-7601c2a9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53853877-213e468-f685a5b6-f08aa141_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:41.185960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53853877-213e468-f685a5b6-f08aa141_0] Write session: try to update token
2025-10-02T08:09:41.185978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53853877-213e468-f685a5b6-f08aa141_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:41.192981Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:41.193002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.193010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533597618561090:8753]
2025-10-02T08:09:41.193046Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:41.193048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:41.193225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:41.193375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.193514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.193662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.193863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:41.193901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:41.202979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId: src_id|53853877-213e468-f685a5b6-f08aa141_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:41.205710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:41.205796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.205808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.205838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:41.205861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:41.206221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.206239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.206407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.206482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.206560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.206639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.206911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.206923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.206994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.207054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.207119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.207187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.207236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.207246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.207315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.207378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.207443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.207522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.207567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.207575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.207647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.207711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.207776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.207842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.207884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.207890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.207949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.208008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.208067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.208131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.208178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.208184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.208251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.208315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.208378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.208442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.208488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.208494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.208557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.208622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.208690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.208755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.208817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.208824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.208891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.208951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.209015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.209079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.209129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.209137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.209203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.209267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.209333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.209396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.209466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.209473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.209541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.209601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.209663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.209731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.209776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.209783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.209839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:41.209899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.209922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.209925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:41.209953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:41.209969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:41.209976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:41.209979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:41.209982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:41.210383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:41.210411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:41.210418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:41.210421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:41.210427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:41.210430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:41.210961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:41.210984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:41.210989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:41.210992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:41.210997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:41.211002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:41.211647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:41.211670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:41.211675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:41.211680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:41.211685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:41.213005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:41.213022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:41.213036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392581212
2025-10-02T08:09:41.213179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:41.213193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:41.213197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:41.213201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:41.213205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:41.213208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:41.213767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:41.213791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:41.213796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:41.213799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:41.213802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:41.213805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:41.214319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:41.214343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:41.214353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:41.214359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:41.214362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:41.214365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:41.214843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:41.214868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:41.214876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:41.216069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:41.216087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:41.216094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:41.216097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:41.216104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392581216
2025-10-02T08:09:41.216401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:41.216425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:41.216430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:41.216433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:41.216436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:41.216439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:41.216946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:41.216969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:41.216973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:41.216977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:41.216980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:41.216983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:41.217471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:41.217493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.217593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392581217
2025-10-02T08:09:41.220005Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:41.220035Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:41.220041Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:41.220050Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:41.220060Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:41.220062Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.220064Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:41.220071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533597618561090:8753]
2025-10-02T08:09:41.220080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533597618561090:8753]
2025-10-02T08:09:41.220143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:41.220154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:41.220158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.220160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:41.220161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:41.220299Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:41.256530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533597618561160:8017]
2025-10-02T08:09:41.256609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 681, pipe: [1:7556533597618561160:8017]
2025-10-02T08:09:41.352865Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:41.353175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618561160:8017], now have 1 active actors on pipe
2025-10-02T08:09:41.353302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533597618561160:8017]
2025-10-02T08:09:41.353323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:41.353330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:41.353355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 682 reason: error at write: Disconnected sessionId: src_id|53853877-213e468-f685a5b6-f08aa141_0
2025-10-02T08:09:41.353409Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:41.353526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 682 sessionId: src_id|53853877-213e468-f685a5b6-f08aa141_0 is DEAD
2025-10-02T08:09:41.353466Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:41.353683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53853877-213e468-f685a5b6-f08aa141_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:41.353695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53853877-213e468-f685a5b6-f08aa141_0] Write session will restart in 0.008598s
2025-10-02T08:09:41.353718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53853877-213e468-f685a5b6-f08aa141_0] Write session: Do CDS request
2025-10-02T08:09:41.353741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53853877-213e468-f685a5b6-f08aa141_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:41.356730Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [3bf27f7214b45676] Result# TEvPutResult {Id# [72075186224037892:681:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:41.356738Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:681:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:41.356822Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:681:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:41.363488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53853877-213e468-f685a5b6-f08aa141_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.363654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:41.363675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 683
2025-10-02T08:09:41.363799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.363831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:41.363841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:41.363845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:41.364251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 683 sessionId:  describe result for acl check
2025-10-02T08:09:41.364295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:41.364302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:41.364303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:41.364309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533597618561602:8766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:41.364676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533597618561602:8766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:41.366874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533597618561602:8766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:41.369763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:41.369915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533597618561602:8766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:41.369932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533597618561602:8766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:41.369935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533597618561602:8766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:41.369944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:41.371060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:41.371237Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:41.371248Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:41.371257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:41.371303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:41.371340Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533597618561812:8765]
2025-10-02T08:09:41.371962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:41.372136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:41.372181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:41.372478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:41.372521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.372527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.372529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.372530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.372531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.372536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.372546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.372550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.372554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.372558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.372563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.372570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.372576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.372581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.372586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.372591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.372601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.372607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.372612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.372622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.372643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:41.380573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:41.382567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:41.382592Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:41.382594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:41.382599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:41.382605Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 682 [1:7556533597618561812:8765]
2025-10-02T08:09:41.382616Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:41.382634Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:41.382637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.382640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.382642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.382658Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:41.382670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:41.382679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:41.382743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.382750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.382753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:41.382756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:41.382820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:41.382828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.382843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.382861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:41.382886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533598078756475:2378], now have 1 active actors on pipe
2025-10-02T08:09:41.382891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 682
2025-10-02T08:09:41.382894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618561808:8766], now have 1 active actors on pipe
2025-10-02T08:09:41.382900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533597618561800:8765]
2025-10-02T08:09:41.382902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533597618561800:8765]
2025-10-02T08:09:41.382914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:41.382929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.382935Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:41.382938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.382940Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:41.382954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:41.382946Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 682
2025-10-02T08:09:41.382972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:41.382980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:41.383023Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|580bce0d-8c7a36ad-391fea12-53a39903_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:41.383034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.383042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.383044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:41.383053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.383065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:41.383078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533597618561800:8765]
2025-10-02T08:09:41.383094Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:41.383110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:41.383125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.383162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.383169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.383183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.383219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 683 partition: 0 MaxSeqNo: 17 sessionId: src_id|580bce0d-8c7a36ad-391fea12-53a39903_0
2025-10-02T08:09:41.383586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53853877-213e468-f685a5b6-f08aa141_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|580bce0d-8c7a36ad-391fea12-53a39903_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:41.386284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580bce0d-8c7a36ad-391fea12-53a39903_0] Write session: try to update token
2025-10-02T08:09:41.386306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580bce0d-8c7a36ad-391fea12-53a39903_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:41.399550Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:41.399574Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.399577Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:41.399586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533597618561800:8765]
2025-10-02T08:09:41.399590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533597618561800:8765]
2025-10-02T08:09:41.399620Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:41.399624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:41.399632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:41.399638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.399641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:41.399779Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:41.402233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId: src_id|580bce0d-8c7a36ad-391fea12-53a39903_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:41.405884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:41.453637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533597618561841:8017]
2025-10-02T08:09:41.453804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 682, pipe: [1:7556533597618561841:8017]
2025-10-02T08:09:41.534473Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:41.534844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.534855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.534887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618561841:8017], now have 1 active actors on pipe
2025-10-02T08:09:41.535001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533597618561841:8017]
2025-10-02T08:09:41.535015Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:41.535027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:41.535034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:41.535098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 683 reason: error at write: Disconnected sessionId: src_id|580bce0d-8c7a36ad-391fea12-53a39903_0
2025-10-02T08:09:41.535094Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:41.535289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 683 sessionId: src_id|580bce0d-8c7a36ad-391fea12-53a39903_0 is DEAD
2025-10-02T08:09:41.535422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bce0d-8c7a36ad-391fea12-53a39903_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:41.535431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bce0d-8c7a36ad-391fea12-53a39903_0] Write session will restart in 0.005825s
2025-10-02T08:09:41.535452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bce0d-8c7a36ad-391fea12-53a39903_0] Write session: Do CDS request
2025-10-02T08:09:41.535458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bce0d-8c7a36ad-391fea12-53a39903_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:41.542322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580bce0d-8c7a36ad-391fea12-53a39903_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.542569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:41.542582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 684
2025-10-02T08:09:41.542726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.542772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:41.542783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:41.542787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:41.543161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 684 sessionId:  describe result for acl check
2025-10-02T08:09:41.543189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:41.543194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:41.543196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:41.543200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533597618562190:8773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:41.543699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533597618562190:8773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:41.546431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533597618562190:8773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:41.549630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533597618562190:8773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:41.549650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533597618562190:8773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:41.549653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533597618562190:8773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:41.549661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:41.552060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:41.553393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:41.553587Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:41.553598Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:41.553608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:41.553654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:41.553811Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533597618562508:8772]
2025-10-02T08:09:41.554420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:41.554580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:41.554622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:41.554913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:41.554957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.554964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.554965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.554967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.554968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.554973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.554984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.554988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.554992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.554996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.555001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.555013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.555019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.555028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.555033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.555038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.555044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.555050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.555058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.555063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.555086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:41.562830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:41.564368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:41.564382Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:41.564384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:41.564387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:41.564392Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 683 [1:7556533597618562508:8772]
2025-10-02T08:09:41.564403Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:41.564416Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:41.564418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.564420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.564421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.564433Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:41.564436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:41.564442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:41.564484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.564490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.564493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:41.564494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:41.564545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:41.564551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.564562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.564569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:41.564588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618562461:8773], now have 1 active actors on pipe
2025-10-02T08:09:41.564594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 683
2025-10-02T08:09:41.564596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533597618562502:8772]
2025-10-02T08:09:41.564598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533597618562502:8772]
2025-10-02T08:09:41.564603Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:41.564611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:41.564619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:41.564621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:41.564621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:41.564626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533598078756496:2378], now have 1 active actors on pipe
2025-10-02T08:09:41.564626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:41.564629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.564632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.564664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533597618562502:8772]
2025-10-02T08:09:41.564674Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:41.564684Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:41.564689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:41.564691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.564694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.564695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:41.564701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.564707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:41.564730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.564702Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 683
2025-10-02T08:09:41.564841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.564849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.564863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.564900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 684 partition: 0 MaxSeqNo: 17 sessionId: src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0
2025-10-02T08:09:41.565242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bce0d-8c7a36ad-391fea12-53a39903_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:41.568056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0] Write session: try to update token
2025-10-02T08:09:41.568068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:41.575311Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:41.575332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.575340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533597618562502:8772]
2025-10-02T08:09:41.575384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:41.575392Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:41.575579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:41.575750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.575876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.576012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.576255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:41.576286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:41.582651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId: src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:41.585350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:41.585455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.585470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.585503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:41.585533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:41.585592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.585614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.585766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.585878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.585949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.586013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.586459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.586470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.586540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.586603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.586670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.586735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.586779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.586787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.586878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.586961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.587040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.587132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.587188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.587196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.587269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.587332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.587399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.587462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.587531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.587537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.587594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.587645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.587701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.587757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.587814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.587820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.587887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.587941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.587999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.588054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.588111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.588118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.588175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.588229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.588286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.588339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.588386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.588395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.588455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.588513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.588571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.588627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.588676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.588683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.588750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.588832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.588897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.588968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.589018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.589025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.589100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.589164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.589235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.589306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.589351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.589359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.589397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:41.589466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.589490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.589496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:41.589526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:41.589543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:41.589551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:41.589554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:41.589556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:41.590010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:41.590036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:41.590042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:41.590049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:41.590054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:41.590057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:41.590770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:41.590791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:41.590795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:41.590797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:41.590799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:41.590801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:41.591314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:41.591332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:41.591336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:41.591338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:41.591340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:41.593025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:41.593041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:41.593051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392581592
2025-10-02T08:09:41.593186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:41.593196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:41.593200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:41.593202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:41.593205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:41.593208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:41.593660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:41.593682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:41.593685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:41.593687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:41.593689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:41.593691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:41.594103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:41.594120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:41.594127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:41.594129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:41.594131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:41.594133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:41.594585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:41.594604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:41.594608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:41.595639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:41.595653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:41.595656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:41.595658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:41.595663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392581595
2025-10-02T08:09:41.595925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:41.595940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:41.595945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:41.595948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:41.595951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:41.595955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:41.596374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:41.596394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:41.596397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:41.596400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:41.596402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:41.596404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:41.596853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:41.596870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.596942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392581596
2025-10-02T08:09:41.599005Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:41.599024Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:41.599031Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:41.599037Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:41.600541Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:41.600555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.600556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:41.600567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533597618562502:8772]
2025-10-02T08:09:41.600570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533597618562502:8772]
2025-10-02T08:09:41.600620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:41.600628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.600629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:41.600631Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:41.600637Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:41.600752Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:41.634935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533597618562539:8017]
2025-10-02T08:09:41.635036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 683, pipe: [1:7556533597618562539:8017]
2025-10-02T08:09:41.740222Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:41.740507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618562539:8017], now have 1 active actors on pipe
2025-10-02T08:09:41.740636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:41.740642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:41.740661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 684 reason: error at write: Disconnected sessionId: src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0
2025-10-02T08:09:41.740767Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:41.740767Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:41.740820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 684 sessionId: src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0 is DEAD
2025-10-02T08:09:41.740988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533597618562539:8017]
2025-10-02T08:09:41.741037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:41.741051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0] Write session will restart in 0.009609s
2025-10-02T08:09:41.741071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0] Write session: Do CDS request
2025-10-02T08:09:41.741077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:41.752481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.752476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:41.752494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 685
2025-10-02T08:09:41.752775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.752817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:41.752821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:41.752825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:41.753115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 685 sessionId:  describe result for acl check
2025-10-02T08:09:41.753140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:41.753141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:41.753142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:41.753145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533597618563139:8780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:41.753494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533597618563139:8780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:41.754197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:41.755375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533597618563139:8780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:41.755401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:41.755559Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:41.755573Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:41.755582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:41.755626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:41.755672Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533597618563176:8779]
2025-10-02T08:09:41.756147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:41.756317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:41.756357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:41.756570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:41.756598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.756600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.756601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.756601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.756602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.756605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.756611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.756613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.756615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.756617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.756620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.756624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.756628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.756630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.756633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.756635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.756637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.756640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.756643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.756645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.756655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:41.761229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533597618563139:8780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:41.761245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533597618563139:8780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:41.761248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533597618563139:8780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:41.761256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:41.764698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:41.766800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:41.766820Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:41.766823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:41.766827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:41.766833Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 684 [1:7556533597618563176:8779]
2025-10-02T08:09:41.766845Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:41.766863Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:41.766866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.766869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.766871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.766886Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:41.766892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:41.766903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:41.766966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.766973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.766976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:41.766978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:41.767042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:41.767050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.767062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.767074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:41.767090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533597618563156:8779]
2025-10-02T08:09:41.767094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533597618563156:8779]
2025-10-02T08:09:41.767101Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:41.767109Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:41.767111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:41.767120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618563202:8780], now have 1 active actors on pipe
2025-10-02T08:09:41.767122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 684
2025-10-02T08:09:41.767132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:41.767145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:41.767153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:41.767159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533598078756503:2378], now have 1 active actors on pipe
2025-10-02T08:09:41.767192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.767199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.767212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533597618563156:8779]
2025-10-02T08:09:41.767215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:41.767207Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 684
2025-10-02T08:09:41.767239Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:41.767240Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e613a27c-1a009db1-1615efe8-3c44097b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:41.767248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.767252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.767254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:41.767262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.767272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:41.767298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.767349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.767355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.767367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.767405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 685 partition: 0 MaxSeqNo: 17 sessionId: src_id|e613a27c-1a009db1-1615efe8-3c44097b_0
2025-10-02T08:09:41.767764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ec2e9a-e8499d98-b85b5215-1038c182_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e613a27c-1a009db1-1615efe8-3c44097b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:41.770655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e613a27c-1a009db1-1615efe8-3c44097b_0] Write session: try to update token
2025-10-02T08:09:41.770670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e613a27c-1a009db1-1615efe8-3c44097b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:41.784423Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:41.784442Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.784443Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:41.784450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533597618563156:8779]
2025-10-02T08:09:41.784453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533597618563156:8779]
2025-10-02T08:09:41.784491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:41.784499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.784503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:41.784510Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:41.784516Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:41.784634Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:41.786937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId: src_id|e613a27c-1a009db1-1615efe8-3c44097b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:41.789503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:41.841267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533597618563217:8017]
2025-10-02T08:09:41.841417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 684, pipe: [1:7556533597618563217:8017]
2025-10-02T08:09:41.913567Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:41.914008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.914021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.914052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618563217:8017], now have 1 active actors on pipe
2025-10-02T08:09:41.914176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533597618563217:8017]
2025-10-02T08:09:41.914209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:41.914211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:41.914241Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:41.914273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 685 reason: error at write: Disconnected sessionId: src_id|e613a27c-1a009db1-1615efe8-3c44097b_0
2025-10-02T08:09:41.914298Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:41.914469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 685 sessionId: src_id|e613a27c-1a009db1-1615efe8-3c44097b_0 is DEAD
2025-10-02T08:09:41.914651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e613a27c-1a009db1-1615efe8-3c44097b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:41.914664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e613a27c-1a009db1-1615efe8-3c44097b_0] Write session will restart in 0.008777s
2025-10-02T08:09:41.914684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e613a27c-1a009db1-1615efe8-3c44097b_0] Write session: Do CDS request
2025-10-02T08:09:41.914690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e613a27c-1a009db1-1615efe8-3c44097b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:41.924387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e613a27c-1a009db1-1615efe8-3c44097b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.924489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:41.924506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 686
2025-10-02T08:09:41.924622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:41.924650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:41.924659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:41.924661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:41.925085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 686 sessionId:  describe result for acl check
2025-10-02T08:09:41.925115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:41.925117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:41.925118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:41.925123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533597618563694:8787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:41.925605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533597618563694:8787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:41.927958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533597618563694:8787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:41.930745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:41.931247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533597618563694:8787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:41.931260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533597618563694:8787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:41.931263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533597618563694:8787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:41.931270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:41.932053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:41.932198Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:41.932207Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:41.932214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:41.932249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:41.932274Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533597618563871:8785]
2025-10-02T08:09:41.932692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:41.932873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:41.932902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:41.933123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:41.933155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.933159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.933160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.933161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.933161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.933165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.933172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.933174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.933176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.933178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.933182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.933186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:41.933190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.933192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:41.933195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.933198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:41.933200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.933203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.933206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.933209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.933220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:41.941426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:41.943090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:41.943106Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:41.943108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:41.943110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:41.943114Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 685 [1:7556533597618563871:8785]
2025-10-02T08:09:41.943122Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:41.943134Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:41.943136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.943138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.943139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.943152Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:41.943155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:41.943159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:41.943205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.943206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.943209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:41.943210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:41.943336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 685
2025-10-02T08:09:41.943390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:41.943397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.943406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:41.943414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:41.943429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533597618563867:8787], now have 1 active actors on pipe
2025-10-02T08:09:41.943435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533598078756511:2378], now have 1 active actors on pipe
2025-10-02T08:09:41.943439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.943442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.943431Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 685
2025-10-02T08:09:41.943456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533597618563859:8785]
2025-10-02T08:09:41.943462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533597618563859:8785]
2025-10-02T08:09:41.943474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:41.943486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:41.943486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:41.943488Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:41.943509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:41.943511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:41.943528Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:41.943538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.943541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.943542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:41.943549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.943555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:41.943586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533597618563859:8785]
2025-10-02T08:09:41.943598Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:41.943610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.943626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:41.943642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.943649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.943661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:41.943699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 686 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0
2025-10-02T08:09:41.944065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e613a27c-1a009db1-1615efe8-3c44097b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:41.947056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0] Write session: try to update token
2025-10-02T08:09:41.947076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:41.954366Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:41.954385Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.954392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533597618563859:8785]
2025-10-02T08:09:41.954431Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:41.954432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:41.954613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:41.954775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.954927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.955071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:41.955258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:41.955289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:41.962252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId: src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:41.964726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:41.964825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.964834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.964860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:41.964882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:41.964926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:41.964937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:41.965093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.965177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.965260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.965327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.965502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.965510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.965571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.965629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.965705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.965762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.965805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.965811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.965871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.965926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.965985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.966042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.966084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.966090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.966163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.966224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.966279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.966334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.966376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.966381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.966434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.966485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.966540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.966596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.966645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.966652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.966719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.966774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.966830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.966885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.966926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.966932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.966989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.967041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.967097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.967162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.967291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.967298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.967354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.967405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.967462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.967534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.967575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.967580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.967645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.967704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.967764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.967821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.967893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.967902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.967971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:41.968032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:41.968091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:41.968156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:41.968204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:41.968211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:41.968243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:41.968298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:41.968314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:41.968316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:41.968341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:41.968355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:41.968357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:41.968359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:41.968361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:41.968716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:41.968740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:41.968744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:41.968746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:41.968748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:41.968750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:41.969510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:41.969531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:41.969540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:41.969541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:41.969543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:41.969545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:41.970186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:41.970211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:41.970217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:41.970220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:41.970223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:41.972793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:41.972825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:41.972836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392581972
2025-10-02T08:09:41.972938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:41.972949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:41.972954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:41.972956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:41.972959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:41.972961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:41.973522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:41.973544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:41.973550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:41.973553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:41.973557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:41.973560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:41.974121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:41.974143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:41.974152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:41.974156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:41.974160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:41.974163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:41.974686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:41.974710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:41.974717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:41.975854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:41.975877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:41.975883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:41.975886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:41.975893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392581975
2025-10-02T08:09:41.976166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:41.976182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:41.976186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:41.976188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:41.976191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:41.976193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:41.976653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:41.976675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:41.976680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:41.976684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:41.976687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:41.976689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:41.977215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:41.977239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:41.977371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392581977
2025-10-02T08:09:41.978924Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:41.978946Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:41.978953Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:41.978966Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:41.980500Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:41.980515Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:41.980516Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:41.980523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533597618563859:8785]
2025-10-02T08:09:41.980526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533597618563859:8785]
2025-10-02T08:09:41.980567Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:41.980569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:41.980573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:41.980574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:41.980580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:41.980698Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:42.014308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533601913531201:8017]
2025-10-02T08:09:42.014434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 685, pipe: [1:7556533601913531201:8017]
2025-10-02T08:09:42.107421Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:42.107741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913531201:8017], now have 1 active actors on pipe
2025-10-02T08:09:42.107834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:42.107845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:42.107867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 686 reason: error at write: Disconnected sessionId: src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0
2025-10-02T08:09:42.107904Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:42.107959Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:42.108008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 686 sessionId: src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0 is DEAD
2025-10-02T08:09:42.108131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:42.108139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0] Write session will restart in 0.006901s
2025-10-02T08:09:42.108157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0] Write session: Do CDS request
2025-10-02T08:09:42.108165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:42.108151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533601913531201:8017]
2025-10-02T08:09:42.116414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.116456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:42.116474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 687
2025-10-02T08:09:42.116626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.116658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:42.116667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:42.116671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:42.117042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 687 sessionId:  describe result for acl check
2025-10-02T08:09:42.117071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:42.117077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:42.117080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:42.117084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533601913531593:8793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:42.117542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533601913531593:8793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:42.119700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533601913531593:8793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:42.122686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533601913531593:8793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:42.122701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533601913531593:8793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:42.122704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533601913531593:8793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:42.122712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:42.123534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:42.124616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:42.124783Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:42.124792Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:42.124813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:42.124853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:42.124895Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533601913531855:8792]
2025-10-02T08:09:42.125283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:42.125496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:42.125552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:42.125877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:42.125936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.125942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.125944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.125945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.125946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.125952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.125961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.125965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.125969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.125972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.125977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.125984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.125994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.125999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.126003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.126007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.126012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.126016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.126021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.126026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.126044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:42.134896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:42.136903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:42.136925Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:42.136927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:42.136931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:42.136937Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 686 [1:7556533601913531855:8792]
2025-10-02T08:09:42.136949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:42.136966Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:42.136970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.136973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.136975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.136991Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:42.136996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:42.137002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:42.137063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.137075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.137078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:42.137080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:42.137146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:42.137153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.137169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.137186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:42.137206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533601913531849:8792]
2025-10-02T08:09:42.137212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533601913531849:8792]
2025-10-02T08:09:42.137219Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:42.137232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913531837:8793], now have 1 active actors on pipe
2025-10-02T08:09:42.137234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 686
2025-10-02T08:09:42.137239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:42.137248Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:42.137251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:42.137254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:42.137259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:42.137350Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 686
2025-10-02T08:09:42.137286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533602373723814:2378], now have 1 active actors on pipe
2025-10-02T08:09:42.137295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.137298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.137310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533601913531849:8792]
2025-10-02T08:09:42.137317Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:42.137322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:42.137341Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:42.137348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.137351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.137353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:42.137361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.137371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:42.137398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.137440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.137447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.137460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.137500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 687 partition: 0 MaxSeqNo: 17 sessionId: src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0
2025-10-02T08:09:42.137852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f7bea68-cc751a86-b8fdaf03-ff17d87f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:42.140519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0] Write session: try to update token
2025-10-02T08:09:42.140533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:42.154531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId: src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:42.154875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:42.154892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:42.154894Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:42.154902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533601913531849:8792]
2025-10-02T08:09:42.154906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533601913531849:8792]
2025-10-02T08:09:42.154946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:42.154951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:42.154955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.154956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:42.154956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:42.155088Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:42.157257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:42.227768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533601913531894:8017]
2025-10-02T08:09:42.229810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 686, pipe: [1:7556533601913531894:8017]
2025-10-02T08:09:42.283870Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:42.284222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.284235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.284268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913531894:8017], now have 1 active actors on pipe
2025-10-02T08:09:42.284381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533601913531894:8017]
2025-10-02T08:09:42.284406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:42.284408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:42.284422Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:42.284468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 687 reason: error at write: Disconnected sessionId: src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0
2025-10-02T08:09:42.284482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:42.284650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 687 sessionId: src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0 is DEAD
2025-10-02T08:09:42.284910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:42.284926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0] Write session will restart in 0.006687s
2025-10-02T08:09:42.284957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0] Write session: Do CDS request
2025-10-02T08:09:42.284966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:42.293465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.293555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:42.293573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 688
2025-10-02T08:09:42.293829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.293865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:42.293871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:42.293874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:42.294248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 688 sessionId:  describe result for acl check
2025-10-02T08:09:42.294296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:42.294302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:42.294303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:42.294309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533601913532253:8811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:42.294797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533601913532253:8811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:42.297896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533601913532253:8811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:42.301594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533601913532253:8811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:42.301610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533601913532253:8811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:42.301613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533601913532253:8811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:42.301621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:42.314619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:42.315955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:42.316128Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:42.316138Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:42.316147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:42.316189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:42.316224Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533601913532577:8810]
2025-10-02T08:09:42.316716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:42.316881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:42.316934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:42.317213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:42.317357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.317366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.317367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.317368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.317369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.317374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.317384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.317389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.317392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.317396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.317402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.317410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.317422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.317432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.317440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.317449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.317457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.317463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.317467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.317472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.317498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:42.325411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:42.326793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:42.326811Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:42.326813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:42.326815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:42.326820Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 687 [1:7556533601913532577:8810]
2025-10-02T08:09:42.326829Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:42.326840Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:42.326842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.326844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.326846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.326857Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:42.326860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:42.326864Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:42.326912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.326921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.326923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:42.326926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:42.326987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:42.326994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.327005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.327020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:42.327043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913532359:8811], now have 1 active actors on pipe
2025-10-02T08:09:42.327049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533602373723844:2378], now have 1 active actors on pipe
2025-10-02T08:09:42.327054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533601913532570:8810]
2025-10-02T08:09:42.327057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533601913532570:8810]
2025-10-02T08:09:42.327067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:42.327079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.327086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.327089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:42.327092Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:42.327105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:42.327121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:42.327128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:42.327120Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 687
2025-10-02T08:09:42.327165Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:42.327175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.327178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.327180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:42.327190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.327202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:42.327205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 687
2025-10-02T08:09:42.327214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533601913532570:8810]
2025-10-02T08:09:42.327224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:42.327235Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:42.327252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.327321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.327328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.327342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.327383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 688 partition: 0 MaxSeqNo: 17 sessionId: src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0
2025-10-02T08:09:42.327735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2f6cc7-953e78fa-7eb1b17a-52b7f74b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:42.330490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0] Write session: try to update token
2025-10-02T08:09:42.330506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:42.344374Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:42.344396Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:42.344399Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:42.344407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533601913532570:8810]
2025-10-02T08:09:42.344411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533601913532570:8810]
2025-10-02T08:09:42.344454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:42.344462Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:42.344468Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:42.344468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.344471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:42.344613Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:42.347282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId: src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:42.349749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:42.384462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533601913532604:8017]
2025-10-02T08:09:42.384572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 687, pipe: [1:7556533601913532604:8017]
2025-10-02T08:09:42.474581Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:42.475074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.475088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.475127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913532604:8017], now have 1 active actors on pipe
2025-10-02T08:09:42.475248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533601913532604:8017]
2025-10-02T08:09:42.475277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:42.475279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:42.475283Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:42.475340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 688 reason: error at write: Disconnected sessionId: src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0
2025-10-02T08:09:42.475336Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:42.475539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 688 sessionId: src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0 is DEAD
2025-10-02T08:09:42.475759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:42.475774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0] Write session will restart in 0.009886s
2025-10-02T08:09:42.475804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0] Write session: Do CDS request
2025-10-02T08:09:42.475811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:42.487358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:42.487377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 689
2025-10-02T08:09:42.487428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.487771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.487811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:42.487822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:42.487825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:42.488259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 689 sessionId:  describe result for acl check
2025-10-02T08:09:42.488300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:42.488301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:42.488303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:42.488307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533601913533195:8818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:42.488835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533601913533195:8818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:42.490711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:42.490790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533601913533195:8818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:42.492122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:42.492268Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:42.492275Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:42.492281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:42.492317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:42.492342Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533601913533264:8817]
2025-10-02T08:09:42.492770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:42.492935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:42.492969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:42.493163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:42.493191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.493195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.493196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.493197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.493197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.493200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.493208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.493210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.493212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.493214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.493217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.493221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.493225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.493228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.493230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.493233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.493236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.493239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.493241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.493244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.493254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:42.494618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533601913533195:8818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:42.494630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533601913533195:8818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:42.494633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533601913533195:8818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:42.494640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:42.502071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:42.503951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:42.503969Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:42.503971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:42.503973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:42.503978Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 688 [1:7556533601913533264:8817]
2025-10-02T08:09:42.503987Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:42.504001Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:42.504003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.504006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.504007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.504019Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:42.504024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:42.504030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:42.504080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.504087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.504089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:42.504090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:42.504137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:42.504143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.504151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.504163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:42.504183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533601913533248:8817]
2025-10-02T08:09:42.504188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533601913533248:8817]
2025-10-02T08:09:42.504195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:42.504206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:42.504311Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 688
2025-10-02T08:09:42.504217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:42.504221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:42.504223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 688
2025-10-02T08:09:42.504228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:42.504231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:42.504241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913533281:8818], now have 1 active actors on pipe
2025-10-02T08:09:42.504268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533602373723853:2378], now have 1 active actors on pipe
2025-10-02T08:09:42.504271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.504273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.504285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533601913533248:8817]
2025-10-02T08:09:42.504293Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:42.504307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:42.504316Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|321c3777-74dca6a-5a18a226-db89ee1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:42.504322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.504325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.504327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:42.504334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.504340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:42.504357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.504421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.504429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.504441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.504477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 689 partition: 0 MaxSeqNo: 17 sessionId: src_id|321c3777-74dca6a-5a18a226-db89ee1a_0
2025-10-02T08:09:42.504885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e52c0d-8e341f68-b64a521f-ccf695c4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|321c3777-74dca6a-5a18a226-db89ee1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:42.507856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321c3777-74dca6a-5a18a226-db89ee1a_0] Write session: try to update token
2025-10-02T08:09:42.507874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321c3777-74dca6a-5a18a226-db89ee1a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:42.522302Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:42.522328Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:42.522331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:42.522340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533601913533248:8817]
2025-10-02T08:09:42.522346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533601913533248:8817]
2025-10-02T08:09:42.522387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:42.522387Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:42.522392Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:42.522397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.522400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:42.522544Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:42.522743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId: src_id|321c3777-74dca6a-5a18a226-db89ee1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:42.525498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:42.575434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533601913533309:8017]
2025-10-02T08:09:42.575562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 688, pipe: [1:7556533601913533309:8017]
2025-10-02T08:09:42.651048Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:42.651250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.651263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.651301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913533309:8017], now have 1 active actors on pipe
2025-10-02T08:09:42.651398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533601913533309:8017]
2025-10-02T08:09:42.651418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:42.651420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:42.651468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 689 reason: error at write: Disconnected sessionId: src_id|321c3777-74dca6a-5a18a226-db89ee1a_0
2025-10-02T08:09:42.651520Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:42.651510Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:42.651637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 689 sessionId: src_id|321c3777-74dca6a-5a18a226-db89ee1a_0 is DEAD
2025-10-02T08:09:42.651794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c3777-74dca6a-5a18a226-db89ee1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:42.651804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c3777-74dca6a-5a18a226-db89ee1a_0] Write session will restart in 0.009511s
2025-10-02T08:09:42.651825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c3777-74dca6a-5a18a226-db89ee1a_0] Write session: Do CDS request
2025-10-02T08:09:42.651832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c3777-74dca6a-5a18a226-db89ee1a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:42.662444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|321c3777-74dca6a-5a18a226-db89ee1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.662505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:42.662523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 690
2025-10-02T08:09:42.662682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.662713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:42.662722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:42.662727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:42.663158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 690 sessionId:  describe result for acl check
2025-10-02T08:09:42.663186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:42.663191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:42.663192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:42.663195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533601913533765:8825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:42.663578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533601913533765:8825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:42.665635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533601913533765:8825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:42.668112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533601913533765:8825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:42.668128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533601913533765:8825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:42.668131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533601913533765:8825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:42.668138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:42.669599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:42.673356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:42.673598Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:42.673610Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:42.673621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:42.673680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:42.673735Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533601913533971:8824]
2025-10-02T08:09:42.674461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:42.674735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:42.674775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:42.675105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:42.675155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.675156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.675158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.675159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.675160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.675165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.675176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.675180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.675184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.675188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.675195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.675204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.675210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.675216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.675221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.675228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.675233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.675239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.675244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.675250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.675272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:42.685902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:42.688040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:42.688068Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:42.688072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:42.688078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:42.688086Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 689 [1:7556533601913533971:8824]
2025-10-02T08:09:42.688101Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:42.688123Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:42.688127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.688131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.688134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.688154Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:42.688161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:42.688169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:42.688246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.688249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.688252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:42.688255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:42.688338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:42.688341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.688357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.688372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:42.688394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533601913533965:8824]
2025-10-02T08:09:42.688397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533601913533965:8824]
2025-10-02T08:09:42.688406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:42.688422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:42.688423Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:42.688428Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:42.688441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:42.688445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:42.688458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913533961:8825], now have 1 active actors on pipe
2025-10-02T08:09:42.688463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533602373723871:2378], now have 1 active actors on pipe
2025-10-02T08:09:42.688501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533601913533965:8824]
2025-10-02T08:09:42.688516Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:42.688562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 689
2025-10-02T08:09:42.688578Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:42.688705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.688715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.688761Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:42.688782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.688787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.688789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:42.688553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 689
2025-10-02T08:09:42.689518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|321c3777-74dca6a-5a18a226-db89ee1a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:42.692697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0] Write session: try to update token
2025-10-02T08:09:42.692725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:42.688821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.688838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:42.688860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.688913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.688916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.688931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.688970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 690 partition: 0 MaxSeqNo: 17 sessionId: src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0
2025-10-02T08:09:42.709833Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:42.709856Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:42.709858Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:42.709865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533601913533965:8824]
2025-10-02T08:09:42.709869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533601913533965:8824]
2025-10-02T08:09:42.709903Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:42.709905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:42.709908Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:42.709910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.709911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:42.710058Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:42.718858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId: src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:42.722188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:42.751572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533601913533995:8017]
2025-10-02T08:09:42.751726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 689, pipe: [1:7556533601913533995:8017]
2025-10-02T08:09:42.837263Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:42.837656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.837667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.837682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913533995:8017], now have 1 active actors on pipe
2025-10-02T08:09:42.837811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533601913533995:8017]
2025-10-02T08:09:42.837842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:42.837842Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:42.837848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:42.837909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 690 reason: error at write: Disconnected sessionId: src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0
2025-10-02T08:09:42.837951Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:42.838097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 690 sessionId: src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0 is DEAD
2025-10-02T08:09:42.838290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:42.838301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0] Write session will restart in 0.008086s
2025-10-02T08:09:42.838325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0] Write session: Do CDS request
2025-10-02T08:09:42.838330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:42.847278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.847391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:42.847407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 691
2025-10-02T08:09:42.847588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:42.847652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:42.847657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:42.847661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:42.848021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 691 sessionId:  describe result for acl check
2025-10-02T08:09:42.848052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:42.848057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:42.848058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:42.848061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533601913534485:8833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:42.848438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533601913534485:8833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:42.850493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533601913534485:8833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:42.853030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:42.854474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:42.854640Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:42.854649Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:42.854658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:42.854703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:42.854735Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533601913534663:8832]
2025-10-02T08:09:42.855043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533601913534485:8833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:42.855059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533601913534485:8833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:42.855062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533601913534485:8833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:42.855070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:42.855309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:42.855450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:42.855496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:42.855782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:42.855820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.855826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.855827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.855828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.855828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.855833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.855841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.855844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.855848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.855851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.855856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.855862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:42.855867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.855871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:42.855875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.855880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:42.855884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.855890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.855894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.855899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.855923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:42.863422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:42.865189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:42.865208Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:42.865212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:42.865215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:42.865222Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 690 [1:7556533601913534663:8832]
2025-10-02T08:09:42.865233Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:42.865250Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:42.865255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.865258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.865260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.865275Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:42.865288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:42.865295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:42.865355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.865363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.865365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:42.865368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:42.865433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:42.865440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.865453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:42.865470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:42.865494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913534668:8833], now have 1 active actors on pipe
2025-10-02T08:09:42.865500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533601913534657:8832]
2025-10-02T08:09:42.865502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533601913534657:8832]
2025-10-02T08:09:42.865511Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:42.865511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 690
2025-10-02T08:09:42.865521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533602373723879:2378], now have 1 active actors on pipe
2025-10-02T08:09:42.865521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:42.865525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:42.865530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:42.865543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:42.865547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:42.865554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.865558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.865597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533601913534657:8832]
2025-10-02T08:09:42.865600Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:42.865613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:42.865615Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|800ea595-16167e0e-ecd69566-8b406f68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:42.865621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:42.865625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:42.865594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 690
2025-10-02T08:09:42.865634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:42.865643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:42.865652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:42.865691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.865728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:42.865734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:42.865746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:42.865786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 691 partition: 0 MaxSeqNo: 17 sessionId: src_id|800ea595-16167e0e-ecd69566-8b406f68_0
2025-10-02T08:09:42.866137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dbe2b08-10ef1770-209d22bb-45aa89d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|800ea595-16167e0e-ecd69566-8b406f68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:42.868652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800ea595-16167e0e-ecd69566-8b406f68_0] Write session: try to update token
2025-10-02T08:09:42.868668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800ea595-16167e0e-ecd69566-8b406f68_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:42.882361Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:42.882379Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:42.882382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:42.882390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533601913534657:8832]
2025-10-02T08:09:42.882395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533601913534657:8832]
2025-10-02T08:09:42.882435Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:42.882436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:42.882443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:42.882445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:42.882446Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:42.882584Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:42.886585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId: src_id|800ea595-16167e0e-ecd69566-8b406f68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:42.888890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:42.937925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533601913534695:8017]
2025-10-02T08:09:42.938003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 690, pipe: [1:7556533601913534695:8017]
2025-10-02T08:09:43.026513Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:43.026957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.026966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.026997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533601913534695:8017], now have 1 active actors on pipe
2025-10-02T08:09:43.027106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533601913534695:8017]
2025-10-02T08:09:43.027129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:43.027134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:43.027143Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:43.027186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 691 reason: error at write: Disconnected sessionId: src_id|800ea595-16167e0e-ecd69566-8b406f68_0
2025-10-02T08:09:43.027200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:43.027339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 691 sessionId: src_id|800ea595-16167e0e-ecd69566-8b406f68_0 is DEAD
2025-10-02T08:09:43.027517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800ea595-16167e0e-ecd69566-8b406f68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:43.027533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800ea595-16167e0e-ecd69566-8b406f68_0] Write session will restart in 0.009413s
2025-10-02T08:09:43.027573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800ea595-16167e0e-ecd69566-8b406f68_0] Write session: Do CDS request
2025-10-02T08:09:43.027580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800ea595-16167e0e-ecd69566-8b406f68_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:43.038274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800ea595-16167e0e-ecd69566-8b406f68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.038479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:43.038491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 692
2025-10-02T08:09:43.038669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.038708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:43.038717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:43.038721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:43.039211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 692 sessionId:  describe result for acl check
2025-10-02T08:09:43.039238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:43.039239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:43.039240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:43.039244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533606208502587:8840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:43.039652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533606208502587:8840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:43.042047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533606208502587:8840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:43.042951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:43.043398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:43.043600Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:43.043610Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:43.043620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:43.043669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:43.043706Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533606208502651:8839]
2025-10-02T08:09:43.044330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:43.044487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:43.044531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:43.044840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:43.044872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533606208502587:8840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:43.044888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533606208502587:8840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:43.044892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.044893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.044895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.044895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533606208502587:8840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:43.044896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.044897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.044902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.044903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:43.044913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.044918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.044922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.044926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.044931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.044939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.044944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.044950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.044955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.044960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.044965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.044976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.044981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.044991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.045012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:43.053215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:43.055010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:43.055027Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:43.055030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:43.055034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:43.055041Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 691 [1:7556533606208502651:8839]
2025-10-02T08:09:43.055054Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:43.055071Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:43.055079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.055083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.055085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.055102Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:43.055112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:43.055122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:43.055184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.055190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.055193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:43.055196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:43.055258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:43.055264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.055278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.055287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:43.055303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533606208502645:8839]
2025-10-02T08:09:43.055310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533606208502645:8839]
2025-10-02T08:09:43.055316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:43.055326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208502663:8840], now have 1 active actors on pipe
2025-10-02T08:09:43.055329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:43.055332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:43.055333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:43.055341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:43.055343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:43.055346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 691
2025-10-02T08:09:43.055347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533606668691183:2378], now have 1 active actors on pipe
2025-10-02T08:09:43.055372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.055374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.055384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533606208502645:8839]
2025-10-02T08:09:43.055392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:43.055402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:43.055415Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:43.055423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.055425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.055427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:43.055433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.055443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:43.055411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 691
2025-10-02T08:09:43.055457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.055522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.055527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.055537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.055566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 692 partition: 0 MaxSeqNo: 17 sessionId: src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0
2025-10-02T08:09:43.055891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800ea595-16167e0e-ecd69566-8b406f68_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:43.058702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0] Write session: try to update token
2025-10-02T08:09:43.058726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:43.071651Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:43.071666Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:43.071668Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:43.071675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533606208502645:8839]
2025-10-02T08:09:43.071679Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533606208502645:8839]
2025-10-02T08:09:43.071715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:43.071717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:43.071719Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:43.071724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.071726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:43.071860Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:43.078007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId: src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:43.080655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:43.127378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533606208502681:8017]
2025-10-02T08:09:43.127507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 691, pipe: [1:7556533606208502681:8017]
2025-10-02T08:09:43.218518Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:43.219139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.219156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.219178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208502681:8017], now have 1 active actors on pipe
2025-10-02T08:09:43.219360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:43.219367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:43.219406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533606208502681:8017]
2025-10-02T08:09:43.219423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 692 reason: error at write: Disconnected sessionId: src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0
2025-10-02T08:09:43.219838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:43.219851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0] Write session will restart in 0.009684s
2025-10-02T08:09:43.219877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0] Write session: Do CDS request
2025-10-02T08:09:43.219885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:43.219578Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:43.219629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 692 sessionId: src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0 is DEAD
2025-10-02T08:09:43.220103Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:43.230407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.230493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:43.230509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 693
2025-10-02T08:09:43.230664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.230699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:43.230704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:43.230708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:43.231227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 693 sessionId:  describe result for acl check
2025-10-02T08:09:43.231267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:43.231274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:43.231276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:43.231282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533606208503074:8846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:43.231844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533606208503074:8846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:43.234273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533606208503074:8846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:43.238550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533606208503074:8846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:43.238566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533606208503074:8846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:43.238570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533606208503074:8846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:43.238578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:43.245547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:43.247235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:43.247479Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:43.247510Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:43.247524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:43.247595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:43.247642Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533606208503362:8845]
2025-10-02T08:09:43.248311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:43.248556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:43.248609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:43.248940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:43.249012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.249023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.249024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.249025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.249026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.249032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.249055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.249059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.249063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.249067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.249073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.249081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.249087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.249093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.249097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.249103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.249107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.249112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.249117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.249122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.249143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:43.258750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:43.261053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:43.261070Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:43.261072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:43.261076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:43.261081Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 692 [1:7556533606208503362:8845]
2025-10-02T08:09:43.261095Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:43.261112Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:43.261114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.261117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.261119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.261135Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:43.261145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:43.261151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:43.261215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.261222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.261224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:43.261226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:43.261291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:43.261297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.261312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.261327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:43.261349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533606208503356:8845]
2025-10-02T08:09:43.261355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533606208503356:8845]
2025-10-02T08:09:43.261362Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:43.261375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:43.261381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:43.261384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:43.261392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:43.261394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:43.261403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208503235:8846], now have 1 active actors on pipe
2025-10-02T08:09:43.261494Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 692
2025-10-02T08:09:43.261437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533606668691190:2378], now have 1 active actors on pipe
2025-10-02T08:09:43.261457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533606208503356:8845]
2025-10-02T08:09:43.261465Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:43.261477Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:43.261509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 692
2025-10-02T08:09:43.261559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.261568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.261607Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:43.261619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.261629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.261631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:43.261641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.261657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:43.261677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.261718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.261725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.261737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.261774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 693 partition: 0 MaxSeqNo: 17 sessionId: src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0
2025-10-02T08:09:43.262181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84e006a-7ec57a3a-c0e57477-705e94b1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:43.265458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0] Write session: try to update token
2025-10-02T08:09:43.265481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:43.283319Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:43.283336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:43.283339Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:43.283347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533606208503356:8845]
2025-10-02T08:09:43.283351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533606208503356:8845]
2025-10-02T08:09:43.283384Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:43.283388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:43.283394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:43.283400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.283402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:43.283568Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:43.287773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId: src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:43.290410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:43.319355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533606208503409:8017]
2025-10-02T08:09:43.319462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 692, pipe: [1:7556533606208503409:8017]
2025-10-02T08:09:43.424081Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:43.424749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.424760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.424794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208503409:8017], now have 1 active actors on pipe
2025-10-02T08:09:43.424942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:43.424955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:43.425024Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:43.425017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 693 reason: error at write: Disconnected sessionId: src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0
2025-10-02T08:09:43.425035Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:43.425228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 693 sessionId: src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0 is DEAD
2025-10-02T08:09:43.425424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533606208503409:8017]
2025-10-02T08:09:43.425500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:43.425515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0] Write session will restart in 0.008544s
2025-10-02T08:09:43.425540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0] Write session: Do CDS request
2025-10-02T08:09:43.425547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:43.435388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.435540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:43.435556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 694
2025-10-02T08:09:43.435744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.435780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:43.435785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:43.435788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:43.436242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 694 sessionId:  describe result for acl check
2025-10-02T08:09:43.436275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:43.436281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:43.436283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:43.436288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533606208503854:8864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:43.436812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533606208503854:8864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:43.439633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533606208503854:8864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:43.442987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533606208503854:8864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:43.443002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533606208503854:8864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:43.443006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533606208503854:8864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:43.443014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:43.444934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:43.446958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:43.447162Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:43.447171Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:43.447181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:43.447226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:43.447269Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533606208504084:8863]
2025-10-02T08:09:43.447854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:43.448065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:43.448101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:43.448432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:43.448474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.448479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.448480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.448481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.448482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.448487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.448496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.448505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.448508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.448516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.448522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.448528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.448535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.448545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.448553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.448560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.448568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.448573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.448581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.448586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.448606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:43.457083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:43.458743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:43.458758Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:43.458761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:43.458765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:43.458773Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 693 [1:7556533606208504084:8863]
2025-10-02T08:09:43.458786Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:43.458803Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:43.458811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.458815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.458817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.458831Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:43.458838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:43.458843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:43.458901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.458910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.458912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:43.458915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:43.458966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:43.458971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.458981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.458991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:43.459012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533606208504078:8863]
2025-10-02T08:09:43.459019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533606208504078:8863]
2025-10-02T08:09:43.459026Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:43.459044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:43.459051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:43.459054Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:43.459058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:43.459060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:43.459067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208504063:8864], now have 1 active actors on pipe
2025-10-02T08:09:43.459070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533606668691218:2378], now have 1 active actors on pipe
2025-10-02T08:09:43.459069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 693
2025-10-02T08:09:43.459093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533606208504078:8863]
2025-10-02T08:09:43.459103Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:43.459109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.459113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.459133Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:43.459163Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:43.459172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.459180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.459146Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 693
2025-10-02T08:09:43.459182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:43.459190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.459199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:43.459216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.459298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.459304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.459320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.459364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 694 partition: 0 MaxSeqNo: 17 sessionId: src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0
2025-10-02T08:09:43.459782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d4f0db-a8981146-1aa1de70-f3c01247_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:43.462947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0] Write session: try to update token
2025-10-02T08:09:43.462970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:43.476676Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:43.476691Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:43.476694Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:43.476702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533606208504078:8863]
2025-10-02T08:09:43.476707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533606208504078:8863]
2025-10-02T08:09:43.476751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:43.476759Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:43.476762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.476764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:43.476765Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:43.476913Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:43.485010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId: src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:43.487737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:43.525733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533606208504115:8017]
2025-10-02T08:09:43.525879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 693, pipe: [1:7556533606208504115:8017]
2025-10-02T08:09:43.620960Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:43.621429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.621444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.621465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208504115:8017], now have 1 active actors on pipe
2025-10-02T08:09:43.621688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533606208504115:8017]
2025-10-02T08:09:43.621706Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:43.621728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:43.621796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 694 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0
2025-10-02T08:09:43.622009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:43.622028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 694 sessionId: src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0 is DEAD
2025-10-02T08:09:43.622236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:43.622253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0] Write session will restart in 0.007415s
2025-10-02T08:09:43.622283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0] Write session: Do CDS request
2025-10-02T08:09:43.622291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:43.631438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.631569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:43.631582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 695
2025-10-02T08:09:43.631794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.631823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:43.631833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:43.631837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:43.632312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 695 sessionId:  describe result for acl check
2025-10-02T08:09:43.632347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:43.632353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:43.632355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:43.632360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533606208504533:8872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:43.632885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533606208504533:8872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:43.635697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533606208504533:8872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:43.639183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533606208504533:8872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:43.639208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533606208504533:8872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:43.639212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533606208504533:8872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:43.639225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:43.641971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:43.642378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:43.642545Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:43.642554Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:43.642563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:43.642603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:43.642641Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533606208504797:8871]
2025-10-02T08:09:43.643287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:43.643474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:43.643526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:43.643838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:43.643885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.643891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.643892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.643894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.643895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.643900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.643910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.643915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.643919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.643923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.643928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.643936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.643942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.643953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.643957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.643963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.643968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.643973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.643978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.643984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.644006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:43.652580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:43.654959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:43.654980Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:43.654983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:43.654987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:43.654993Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 694 [1:7556533606208504797:8871]
2025-10-02T08:09:43.655007Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:43.655026Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:43.655029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.655032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.655034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.655052Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:43.655057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:43.655065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:43.655146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.655155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.655159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:43.655162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:43.655234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:43.655245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.655261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.655271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:43.655292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208504779:8872], now have 1 active actors on pipe
2025-10-02T08:09:43.655302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 694
2025-10-02T08:09:43.655304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533606208504791:8871]
2025-10-02T08:09:43.655306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533606208504791:8871]
2025-10-02T08:09:43.655314Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:43.655325Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:43.655326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533606668691239:2378], now have 1 active actors on pipe
2025-10-02T08:09:43.655334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:43.655335Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:43.655348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:43.655351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:43.655358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.655363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.655409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533606208504791:8871]
2025-10-02T08:09:43.655422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:43.655429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:43.655444Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:43.655424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 694
2025-10-02T08:09:43.655456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.655460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.655462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:43.655473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.655500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:43.655550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.655650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.655659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.655676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.655715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 695 partition: 0 MaxSeqNo: 17 sessionId: src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0
2025-10-02T08:09:43.656606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77098ac8-66b09b20-33279ea4-c3a9b64a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:43.659703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0] Write session: try to update token
2025-10-02T08:09:43.659723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:43.666972Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:43.666989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:43.666999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533606208504791:8871]
2025-10-02T08:09:43.667041Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:43.667043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:43.667226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:43.667379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:43.667544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:43.667701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:43.668022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:43.668067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:43.676444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId: src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:43.678970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:43.679037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.679049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.679082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:43.679105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:43.679154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.679167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.679338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.679400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.679492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.679554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.679613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.679622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.679691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.679753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.679829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.679896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.679938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.679946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.680018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.680077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.680143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.680206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.680576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.680584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.680652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.680713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.680778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.680863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.680912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.680919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.680981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.681039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.681099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.681165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.681237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.681244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.681312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.681377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.681440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.681525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.681573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.681580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.681678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.681739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.681806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.681881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.681927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.681934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.682002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.682060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.682122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.682190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.682242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.682249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.682315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.682376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.682441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.682505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.682560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.682567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.682632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:43.682692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:43.682753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:43.682811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:43.682865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:43.682872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:43.682939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:43.682995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.683011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.683019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:43.683045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:43.683057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:43.683064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:43.683066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:43.683068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:43.683443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:43.683463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:43.683471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:43.683474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:43.683498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:43.683505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:43.684289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:43.684312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:43.684317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:43.684320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:43.684323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:43.684326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:43.685042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:43.685065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:43.685070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:43.685074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:43.685077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:43.686335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:43.686351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:43.686365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392583685
2025-10-02T08:09:43.686481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:43.686495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:43.686500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:43.686505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:43.686509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:43.686516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:43.687107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:43.687130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:43.687136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:43.687139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:43.687142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:43.687146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:43.687637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:43.687655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:43.687661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:43.687665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:43.687670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:43.687679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:43.688200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:43.688220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:43.688225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:43.689430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:43.689448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:43.689454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:43.689457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:43.689467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392583688
2025-10-02T08:09:43.689803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:43.689828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:43.689834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:43.689837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:43.689841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:43.689844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:43.690307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:43.690330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:43.690335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:43.690339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:43.690342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:43.690346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:43.690805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:43.690827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.690919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392583690
2025-10-02T08:09:43.693248Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:43.693271Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:43.693276Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:43.693280Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:43.693290Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:43.693292Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:43.693294Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:43.693301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533606208504791:8871]
2025-10-02T08:09:43.693304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533606208504791:8871]
2025-10-02T08:09:43.693364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:43.693371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.693372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:43.693483Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:43.693496Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:43.693508Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:43.721822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533606208504824:8017]
2025-10-02T08:09:43.721974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 694, pipe: [1:7556533606208504824:8017]
2025-10-02T08:09:43.834283Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:43.834643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208504824:8017], now have 1 active actors on pipe
2025-10-02T08:09:43.834778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:43.834783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:43.834806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 695 reason: error at write: Disconnected sessionId: src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0
2025-10-02T08:09:43.834879Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:43.834941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:43.834982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 695 sessionId: src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0 is DEAD
2025-10-02T08:09:43.835126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533606208504824:8017]
2025-10-02T08:09:43.835161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:43.835179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0] Write session will restart in 0.006119s
2025-10-02T08:09:43.835208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0] Write session: Do CDS request
2025-10-02T08:09:43.835216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:43.838308Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:694:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:43.838338Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [36fd198b77535754] Result# TEvPutResult {Id# [72075186224037892:694:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:43.838360Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:694:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:43.842402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.842507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:43.842519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 696
2025-10-02T08:09:43.842669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:43.842698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:43.842706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:43.842709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:43.843082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 696 sessionId:  describe result for acl check
2025-10-02T08:09:43.843116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:43.843122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:43.843124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:43.843129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533606208505155:8878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:43.843629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533606208505155:8878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:43.846092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533606208505155:8878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:43.849430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533606208505155:8878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:43.849444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533606208505155:8878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:43.849448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533606208505155:8878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:43.849456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:43.852826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:43.854337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:43.854614Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:43.854622Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:43.854630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:43.854674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:43.854705Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533606208505502:8877]
2025-10-02T08:09:43.855145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:43.855289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:43.855320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:43.855546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:43.855577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.855582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.855582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.855583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.855584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.855587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.855594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.855596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.855598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.855600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.855604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.855609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:43.855613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.855616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:43.855618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.855621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:43.855623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.855626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.855628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.855631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.855641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:43.864678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:43.866430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:43.866449Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:43.866452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:43.866456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:43.866463Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 695 [1:7556533606208505502:8877]
2025-10-02T08:09:43.866477Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:43.866496Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:43.866500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.866503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.866505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.866522Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:43.866533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:43.866545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:43.866620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.866628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.866632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:43.866635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:43.866701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:43.866712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.866726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:43.866737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:43.866755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533606208505494:8877]
2025-10-02T08:09:43.866761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533606208505494:8877]
2025-10-02T08:09:43.866769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 695
2025-10-02T08:09:43.866770Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:43.866778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:43.866785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208505444:8878], now have 1 active actors on pipe
2025-10-02T08:09:43.866787Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:43.866793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:43.866806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:43.866814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:43.866821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533606668691245:2378], now have 1 active actors on pipe
2025-10-02T08:09:43.866826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.866834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.866876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533606208505494:8877]
2025-10-02T08:09:43.866883Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:43.866898Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:43.866898Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:43.866905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:43.866911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:43.866913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:43.866881Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 695
2025-10-02T08:09:43.866922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:43.866936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:43.866989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.867065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:43.867072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:43.867086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:43.867124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 696 partition: 0 MaxSeqNo: 17 sessionId: src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0
2025-10-02T08:09:43.867547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617f5e26-69abfe2f-a47caf6f-77a9491b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:43.870821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0] Write session: try to update token
2025-10-02T08:09:43.870848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:43.885356Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:43.885374Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:43.885377Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:43.885387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533606208505494:8877]
2025-10-02T08:09:43.885392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533606208505494:8877]
2025-10-02T08:09:43.885432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:43.885436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:43.885439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:43.885441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:43.885442Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:43.885589Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:43.886450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId: src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:43.889271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:43.935349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533606208505528:8017]
2025-10-02T08:09:43.935495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 695, pipe: [1:7556533606208505528:8017]
2025-10-02T08:09:44.024839Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:44.025301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.025316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.025359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533606208505528:8017], now have 1 active actors on pipe
2025-10-02T08:09:44.025477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:44.025488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:44.025622Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:44.025553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 696 reason: error at write: Disconnected sessionId: src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0
2025-10-02T08:09:44.025726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 696 sessionId: src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0 is DEAD
2025-10-02T08:09:44.025896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533606208505528:8017]
2025-10-02T08:09:44.026161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:44.026177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0] Write session will restart in 0.008332s
2025-10-02T08:09:44.026210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0] Write session: Do CDS request
2025-10-02T08:09:44.026234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:44.026726Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:44.035442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.035578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:44.035593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 697
2025-10-02T08:09:44.035724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.035753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:44.035762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:44.035765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:44.036147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 697 sessionId:  describe result for acl check
2025-10-02T08:09:44.036177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:44.036182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:44.036183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:44.036188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533610503473255:8885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:44.036610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533610503473255:8885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:44.039112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533610503473255:8885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:44.042262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533610503473255:8885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:44.042290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533610503473255:8885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:44.042294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533610503473255:8885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:44.042302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:44.043192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:44.044868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:44.045021Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:44.045028Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:44.045036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:44.045075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:44.045107Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533610503473500:8884]
2025-10-02T08:09:44.045593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:44.045760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:44.045808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:44.046034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:44.046069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.046073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.046074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.046075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.046076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.046079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.046086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.046088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.046091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.046093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.046097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.046101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.046105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.046108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.046111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.046114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.046117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.046120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.046123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.046128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.046145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:44.054742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:44.056507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:44.056526Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:44.056528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:44.056533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:44.056540Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 696 [1:7556533610503473500:8884]
2025-10-02T08:09:44.056552Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:44.056571Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:44.056579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.056582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.056584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.056602Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:44.056611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:44.056617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:44.056685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.056693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.056696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:44.056698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:44.056853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 696
2025-10-02T08:09:44.056946Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 696
2025-10-02T08:09:44.056967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:44.056981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.056996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.057009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:44.057032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503473483:8885], now have 1 active actors on pipe
2025-10-02T08:09:44.057041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533610963658550:2378], now have 1 active actors on pipe
2025-10-02T08:09:44.057047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.057052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.057075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533610503473494:8884]
2025-10-02T08:09:44.057082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533610503473494:8884]
2025-10-02T08:09:44.057095Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:44.057110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:44.057114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:44.057114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:44.057129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:44.057137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:44.057152Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:44.057159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.057163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.057165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:44.057175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.057192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:44.057232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533610503473494:8884]
2025-10-02T08:09:44.057244Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:44.057251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:44.057258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.057342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.057350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.057366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.057406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 697 partition: 0 MaxSeqNo: 17 sessionId: src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0
2025-10-02T08:09:44.057804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1160a62-647d7d4f-eb01545c-eb7c4d0f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:44.060640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0] Write session: try to update token
2025-10-02T08:09:44.060661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:44.075123Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:44.075139Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:44.075142Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:44.075150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533610503473494:8884]
2025-10-02T08:09:44.075154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533610503473494:8884]
2025-10-02T08:09:44.075194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:44.075200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.075199Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:44.075202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:44.075204Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:44.075341Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:44.076420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId: src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:44.079119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:44.126295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533610503473524:8017]
2025-10-02T08:09:44.126375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 696, pipe: [1:7556533610503473524:8017]
2025-10-02T08:09:44.206806Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:44.207169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.207179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.207215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503473524:8017], now have 1 active actors on pipe
2025-10-02T08:09:44.207298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:44.207304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:44.207351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 697 reason: error at write: Disconnected sessionId: src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0
2025-10-02T08:09:44.207454Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:44.207436Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:44.207524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 697 sessionId: src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0 is DEAD
2025-10-02T08:09:44.207659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533610503473524:8017]
2025-10-02T08:09:44.207736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:44.207755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0] Write session will restart in 0.007902s
2025-10-02T08:09:44.207792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0] Write session: Do CDS request
2025-10-02T08:09:44.207802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:44.217434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.217546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:44.217562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 698
2025-10-02T08:09:44.217764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.217798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:44.217803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:44.217807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:44.218240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 698 sessionId:  describe result for acl check
2025-10-02T08:09:44.218278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:44.218280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:44.218281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:44.218287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533610503473906:8891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:44.218787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533610503473906:8891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:44.221668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533610503473906:8891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:44.225060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533610503473906:8891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:44.225075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533610503473906:8891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:44.225079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533610503473906:8891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:44.225087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:44.231845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:44.233656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:44.233894Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:44.233903Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:44.233909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:44.233945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:44.233984Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533610503474202:8890]
2025-10-02T08:09:44.234416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:44.234589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:44.234616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:44.234819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:44.234850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.234855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.234855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.234856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.234857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.234860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.234866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.234868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.234870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.234872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.234876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.234884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.234887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.234890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.234893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.234896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.234900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.234906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.234909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.234911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.234922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:44.249693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:44.251806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:44.251820Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:44.251821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:44.251824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:44.251829Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 697 [1:7556533610503474202:8890]
2025-10-02T08:09:44.251837Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:44.251850Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:44.251852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.251855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.251856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.251873Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:44.251879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:44.251890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:44.251950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.251955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.251957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:44.251958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:44.252013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:44.252017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.252026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.252033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:44.252048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533610503474196:8890]
2025-10-02T08:09:44.252053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533610503474196:8890]
2025-10-02T08:09:44.252058Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:44.252068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:44.252081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:44.252088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:44.252096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:44.252100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:44.252100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 697
2025-10-02T08:09:44.252117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503474149:8891], now have 1 active actors on pipe
2025-10-02T08:09:44.252119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533610503474196:8890]
2025-10-02T08:09:44.252121Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:44.252124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533610963658557:2378], now have 1 active actors on pipe
2025-10-02T08:09:44.252124Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:44.252136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.252139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.252163Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6188ab9-9d19d550-b262b620-5629fb15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:44.252168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.252170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.252172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:44.252177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.252184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:44.252205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.252222Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 697
2025-10-02T08:09:44.252291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.252297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.252307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.252337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 698 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6188ab9-9d19d550-b262b620-5629fb15_0
2025-10-02T08:09:44.252688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b26b3e4-7f9f37ce-50c2d381-c03c4927_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6188ab9-9d19d550-b262b620-5629fb15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:44.255334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6188ab9-9d19d550-b262b620-5629fb15_0] Write session: try to update token
2025-10-02T08:09:44.255353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6188ab9-9d19d550-b262b620-5629fb15_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:44.268854Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:44.268871Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:44.268873Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:44.268880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533610503474196:8890]
2025-10-02T08:09:44.268883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533610503474196:8890]
2025-10-02T08:09:44.268917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:44.268923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.268924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:44.268932Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:44.268944Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:44.269065Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:44.272008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId: src_id|e6188ab9-9d19d550-b262b620-5629fb15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:44.275144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:44.321174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533610503474243:8017]
2025-10-02T08:09:44.323715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 697, pipe: [1:7556533610503474243:8017]
2025-10-02T08:09:44.402039Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:44.402290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.402301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.402339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503474243:8017], now have 1 active actors on pipe
2025-10-02T08:09:44.402536Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:44.402536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:44.402539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:44.402596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 698 reason: error at write: Disconnected sessionId: src_id|e6188ab9-9d19d550-b262b620-5629fb15_0
2025-10-02T08:09:44.402594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:44.402758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 698 sessionId: src_id|e6188ab9-9d19d550-b262b620-5629fb15_0 is DEAD
2025-10-02T08:09:44.402901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6188ab9-9d19d550-b262b620-5629fb15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:44.402910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6188ab9-9d19d550-b262b620-5629fb15_0] Write session will restart in 0.009276s
2025-10-02T08:09:44.402915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533610503474243:8017]
2025-10-02T08:09:44.402932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6188ab9-9d19d550-b262b620-5629fb15_0] Write session: Do CDS request
2025-10-02T08:09:44.402951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6188ab9-9d19d550-b262b620-5629fb15_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:44.420435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6188ab9-9d19d550-b262b620-5629fb15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.420553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:44.420568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 699
2025-10-02T08:09:44.420690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.420725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:44.420735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:44.420740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:44.420955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:44.421158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 699 sessionId:  describe result for acl check
2025-10-02T08:09:44.421192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:44.421198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:44.421199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:44.421205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533610503474919:8912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:44.421695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533610503474919:8912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:44.422677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:44.422853Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:44.422863Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:44.422874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:44.422920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:44.422956Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533610503474935:8908]
2025-10-02T08:09:44.423562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:44.423573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533610503474919:8912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:44.423759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:44.423806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:44.424104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:44.424155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.424160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.424161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.424162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.424164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.424169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.424178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.424181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.424185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.424188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.424193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.424201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.424220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.424224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.424231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.424236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.424240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.424245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.424249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.424254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.424271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:44.430417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533610503474919:8912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:44.430433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533610503474919:8912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:44.430436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533610503474919:8912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:44.430446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:44.432573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:44.434552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:44.434567Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:44.434570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:44.434572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:44.434576Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 698 [1:7556533610503474935:8908]
2025-10-02T08:09:44.434585Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:44.434600Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:44.434601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.434604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.434605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.434618Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:44.434621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:44.434626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:44.434674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.434680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.434683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:44.434684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:44.434741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:44.434753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.434768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.434779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:44.434781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 698
2025-10-02T08:09:44.434796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503474963:8912], now have 1 active actors on pipe
2025-10-02T08:09:44.434804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533610963658585:2378], now have 1 active actors on pipe
2025-10-02T08:09:44.434807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.434810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.434827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533610503474913:8908]
2025-10-02T08:09:44.434831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533610503474913:8908]
2025-10-02T08:09:44.434841Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:44.434857Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:44.434858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:44.434867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:44.434872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:44.434875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:44.434889Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:44.434895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.434898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.434878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 698
2025-10-02T08:09:44.434900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:44.434909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.434923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:44.434958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533610503474913:8908]
2025-10-02T08:09:44.434968Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:44.434981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.434992Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:44.435033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.435041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.435054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.435093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 699 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0
2025-10-02T08:09:44.435434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6188ab9-9d19d550-b262b620-5629fb15_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:44.438293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0] Write session: try to update token
2025-10-02T08:09:44.438308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:44.452696Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:44.452714Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:44.452716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:44.452728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533610503474913:8908]
2025-10-02T08:09:44.452732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533610503474913:8908]
2025-10-02T08:09:44.452775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:44.452782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.452785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:44.452785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:44.452792Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:44.452943Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:44.453470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId: src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:44.455989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:44.503104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533610503474981:8017]
2025-10-02T08:09:44.503187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 698, pipe: [1:7556533610503474981:8017]
2025-10-02T08:09:44.588366Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:44.588726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.588740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.588779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503474981:8017], now have 1 active actors on pipe
2025-10-02T08:09:44.589052Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:44.588892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:44.588899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:44.588946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 699 reason: error at write: Disconnected sessionId: src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0
2025-10-02T08:09:44.589049Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:44.589109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 699 sessionId: src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0 is DEAD
2025-10-02T08:09:44.589232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533610503474981:8017]
2025-10-02T08:09:44.589505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:44.589522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0] Write session will restart in 0.006840s
2025-10-02T08:09:44.589554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0] Write session: Do CDS request
2025-10-02T08:09:44.589561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:44.597324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.597402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:44.597417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 700
2025-10-02T08:09:44.597591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.597645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:44.597657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:44.597661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:44.598100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 700 sessionId:  describe result for acl check
2025-10-02T08:09:44.598134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:44.598139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:44.598141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:44.598146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533610503475381:8919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:44.598539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533610503475381:8919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:44.601133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533610503475381:8919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:44.604146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533610503475381:8919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:44.604163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533610503475381:8919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:44.604166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533610503475381:8919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:44.604174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:44.606789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:44.607181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:44.607347Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:44.607356Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:44.607365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:44.607425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:44.607459Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533610503475675:8918]
2025-10-02T08:09:44.608081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:44.608267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:44.608308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:44.608579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:44.608627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.608632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.608633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.608634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.608635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.608639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.608648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.608651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.608654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.608658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.608667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.608673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.608683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.608691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.608699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.608703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.608711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.608719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.608723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.608731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.608751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:44.616689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:44.618469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:44.618487Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:44.618490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:44.618493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:44.618500Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 699 [1:7556533610503475675:8918]
2025-10-02T08:09:44.618512Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:44.618530Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:44.618538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.618541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.618543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.618559Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:44.618567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:44.618574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:44.618632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.618640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.618642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:44.618645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:44.618705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:44.618714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.618728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.618740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:44.618755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533610503475669:8918]
2025-10-02T08:09:44.618757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533610503475669:8918]
2025-10-02T08:09:44.618764Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:44.618779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503475657:8919], now have 1 active actors on pipe
2025-10-02T08:09:44.618784Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:44.618787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:44.618788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:44.618796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:44.618798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:44.618798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 699
2025-10-02T08:09:44.618824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533610963658605:2378], now have 1 active actors on pipe
2025-10-02T08:09:44.618830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.618835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.618845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533610503475669:8918]
2025-10-02T08:09:44.618857Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:44.618869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:44.618881Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5306765-221ec43d-f0cc9777-3c571851_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:44.618891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.618895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.618897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:44.618905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.618918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:44.618895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 699
2025-10-02T08:09:44.618949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.618997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.619004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.619017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.619054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 700 partition: 0 MaxSeqNo: 17 sessionId: src_id|a5306765-221ec43d-f0cc9777-3c571851_0
2025-10-02T08:09:44.619431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6fbe9e-a864ab0a-133f5a24-ccc86394_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a5306765-221ec43d-f0cc9777-3c571851_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:44.622520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5306765-221ec43d-f0cc9777-3c571851_0] Write session: try to update token
2025-10-02T08:09:44.622543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5306765-221ec43d-f0cc9777-3c571851_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:44.635773Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:44.635788Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:44.635790Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:44.635797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533610503475669:8918]
2025-10-02T08:09:44.635800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533610503475669:8918]
2025-10-02T08:09:44.635834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:44.635839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.635841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:44.635840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:44.635846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:44.635974Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:44.638823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId: src_id|a5306765-221ec43d-f0cc9777-3c571851_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:44.641784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:44.689488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533610503475701:8017]
2025-10-02T08:09:44.689643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 699, pipe: [1:7556533610503475701:8017]
2025-10-02T08:09:44.772139Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:44.772669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.772681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.772718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503475701:8017], now have 1 active actors on pipe
2025-10-02T08:09:44.772878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:44.772891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:44.772940Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:44.772955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 700 reason: error at write: Disconnected sessionId: src_id|a5306765-221ec43d-f0cc9777-3c571851_0
2025-10-02T08:09:44.772974Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:44.773143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 700 sessionId: src_id|a5306765-221ec43d-f0cc9777-3c571851_0 is DEAD
2025-10-02T08:09:44.773292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5306765-221ec43d-f0cc9777-3c571851_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:44.773307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5306765-221ec43d-f0cc9777-3c571851_0] Write session will restart in 0.005009s
2025-10-02T08:09:44.773299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533610503475701:8017]
2025-10-02T08:09:44.773332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5306765-221ec43d-f0cc9777-3c571851_0] Write session: Do CDS request
2025-10-02T08:09:44.773340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5306765-221ec43d-f0cc9777-3c571851_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:44.779408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5306765-221ec43d-f0cc9777-3c571851_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.779487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:44.779502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 701
2025-10-02T08:09:44.779687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.779720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:44.779730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:44.779733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:44.780184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 701 sessionId:  describe result for acl check
2025-10-02T08:09:44.780215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:44.780216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:44.780218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:44.780223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533610503475979:8925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:44.780615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533610503475979:8925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:44.782880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533610503475979:8925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:44.785833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533610503475979:8925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:44.785854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533610503475979:8925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:44.785857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533610503475979:8925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:44.785864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:44.791646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:44.793283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:44.793468Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:44.793489Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:44.793503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:44.793550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:44.793588Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533610503476383:8924]
2025-10-02T08:09:44.794201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:44.794370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:44.794404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:44.794690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:44.794731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.794736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.794738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.794739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.794740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.794745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.794755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.794759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.794763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.794767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.794772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.794780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.794785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.794791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.794795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.794800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.794810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.794819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.794828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.794837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.794862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:44.803328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:44.805201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:44.805216Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:44.805218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:44.805221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:44.805227Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 700 [1:7556533610503476383:8924]
2025-10-02T08:09:44.805236Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:44.805251Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:44.805252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.805254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.805256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.805269Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:44.805276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:44.805281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:44.805331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.805336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.805340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:44.805342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:44.805394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:44.805400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.805410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.805416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:44.805429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533610503476377:8924]
2025-10-02T08:09:44.805434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533610503476377:8924]
2025-10-02T08:09:44.805440Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:44.805449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:44.805461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:44.805464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:44.805467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:44.805468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:44.805474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503476222:8925], now have 1 active actors on pipe
2025-10-02T08:09:44.805484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 700
2025-10-02T08:09:44.805500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533610963658611:2378], now have 1 active actors on pipe
2025-10-02T08:09:44.805506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533610503476377:8924]
2025-10-02T08:09:44.805513Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:44.805520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:44.805521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.805526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.805565Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46083069-7a2ecd45-482278c9-eb20a126_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:44.805576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.805585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.805587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:44.805596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.805566Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 700
2025-10-02T08:09:44.805607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:44.805631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.805687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.805694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.805705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.805736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 701 partition: 0 MaxSeqNo: 17 sessionId: src_id|46083069-7a2ecd45-482278c9-eb20a126_0
2025-10-02T08:09:44.806112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5306765-221ec43d-f0cc9777-3c571851_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|46083069-7a2ecd45-482278c9-eb20a126_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:44.809147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46083069-7a2ecd45-482278c9-eb20a126_0] Write session: try to update token
2025-10-02T08:09:44.809162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46083069-7a2ecd45-482278c9-eb20a126_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:44.822475Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:44.822491Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:44.822494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:44.822501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533610503476377:8924]
2025-10-02T08:09:44.822505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533610503476377:8924]
2025-10-02T08:09:44.822553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:44.822556Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:44.822559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.822562Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:44.822562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:44.822706Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:44.823764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId: src_id|46083069-7a2ecd45-482278c9-eb20a126_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:44.826255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:44.873269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533610503476409:8017]
2025-10-02T08:09:44.873385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 700, pipe: [1:7556533610503476409:8017]
2025-10-02T08:09:44.959441Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:44.959947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.959959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.959996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503476409:8017], now have 1 active actors on pipe
2025-10-02T08:09:44.960125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533610503476409:8017]
2025-10-02T08:09:44.960152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:44.960155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:44.960201Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:44.960235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 701 reason: error at write: Disconnected sessionId: src_id|46083069-7a2ecd45-482278c9-eb20a126_0
2025-10-02T08:09:44.960313Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:44.960394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 701 sessionId: src_id|46083069-7a2ecd45-482278c9-eb20a126_0 is DEAD
2025-10-02T08:09:44.960539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46083069-7a2ecd45-482278c9-eb20a126_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:44.960548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46083069-7a2ecd45-482278c9-eb20a126_0] Write session will restart in 0.007901s
2025-10-02T08:09:44.960573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46083069-7a2ecd45-482278c9-eb20a126_0] Write session: Do CDS request
2025-10-02T08:09:44.960580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46083069-7a2ecd45-482278c9-eb20a126_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:44.969447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46083069-7a2ecd45-482278c9-eb20a126_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.969521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:44.969534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 702
2025-10-02T08:09:44.969677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:44.969705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:44.969713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:44.969716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:44.970101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 702 sessionId:  describe result for acl check
2025-10-02T08:09:44.970155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:44.970161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:44.970163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:44.970168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533610503476825:8932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:44.970730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533610503476825:8932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:44.973928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533610503476825:8932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:44.977097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533610503476825:8932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:44.977111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533610503476825:8932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:44.977114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533610503476825:8932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:44.977127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:44.977252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:44.978620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:44.978947Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:44.978954Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:44.978963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:44.979006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:44.979034Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533610503477095:8931]
2025-10-02T08:09:44.979446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:44.979677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:44.979728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:44.980050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:44.980101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.980107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.980109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.980109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.980111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.980115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.980124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.980128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.980131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.980135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.980140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.980147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:44.980153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.980157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:44.980160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.980164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:44.980168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.980172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.980176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.980180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.980196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:44.988324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:44.989948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:44.989966Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:44.989969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:44.989974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:44.989981Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 701 [1:7556533610503477095:8931]
2025-10-02T08:09:44.989992Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:44.990009Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:44.990012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.990015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.990017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.990033Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:44.990037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:44.990044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:44.990110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.990119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.990122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:44.990124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:44.990189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:44.990195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:44.990207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:44.990223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:44.990244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533610963658621:2378], now have 1 active actors on pipe
2025-10-02T08:09:44.990253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533610503477083:8931]
2025-10-02T08:09:44.990259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533610503477083:8931]
2025-10-02T08:09:44.990266Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:44.990274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533610503477086:8932], now have 1 active actors on pipe
2025-10-02T08:09:44.990281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 701
2025-10-02T08:09:44.990287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:44.990286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:44.990290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:44.990300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:44.990302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:44.990309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.990317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.990355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533610503477083:8931]
2025-10-02T08:09:44.990367Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:44.990359Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 701
2025-10-02T08:09:44.990383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:44.990385Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:44.990391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:44.990394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:44.990396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:44.990405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:44.990414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:44.990456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.990530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:44.990537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:44.990551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:44.990591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 702 partition: 0 MaxSeqNo: 17 sessionId: src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0
2025-10-02T08:09:44.990952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46083069-7a2ecd45-482278c9-eb20a126_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:44.993956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0] Write session: try to update token
2025-10-02T08:09:44.993974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:45.001319Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:45.001341Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:45.001351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533610503477083:8931]
2025-10-02T08:09:45.001395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:45.001394Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:45.001634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:45.001854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:45.002031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:45.002225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:45.002479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:45.002526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:45.009467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId: src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:45.011852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:45.011917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.011928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.011954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:45.011975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:45.012043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.012052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.012207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.012269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.012330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.012389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.012648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.012657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.012721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.012778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.012868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.012940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.012987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.012994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.013069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.013142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.013217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.013290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.013351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.013359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.013437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.013511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.013586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.013659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.013706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.013714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.013786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.013853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.013910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.013972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.014019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.014024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.014087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.014143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.014204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.014265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.014310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.014316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.014379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.014436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.014496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.014551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.014591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.014596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.014656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.014709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.014766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.014825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.014866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.014871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.014933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.014991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.015055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.015141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.015188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.015194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.015255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:45.015311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:45.015370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:45.015427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:45.015488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:45.015494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:45.015531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:45.015584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.015600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.015604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:45.015631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:45.015643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:45.015650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:45.015652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:45.015653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:45.016028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:45.016049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:45.016054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:45.016056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:45.016058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:45.016060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:45.016618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:45.016639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:45.016644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:45.016652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:45.016655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:45.016658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:45.017175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:45.017192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:45.017197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:45.017200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:45.017202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:45.018336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:45.018353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:45.018361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392585018
2025-10-02T08:09:45.018486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:45.018495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:45.018499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:45.018501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:45.018506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:45.018508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:45.018942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:45.018960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:45.018963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:45.018967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:45.018969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:45.018971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:45.019401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:45.019417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:45.019423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:45.019425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:45.019427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:45.019429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:45.019867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:45.019883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:45.019887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:45.020942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:45.020955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:45.020958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:45.020961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:45.020966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392585020
2025-10-02T08:09:45.021228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:45.021244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:45.021248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:45.021250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:45.021253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:45.021257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:45.021675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:45.021691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:45.021695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:45.021701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:45.021703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:45.021705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:45.022139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:45.022158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.022238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392585022
2025-10-02T08:09:45.022966Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:45.022986Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:45.022990Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:45.022995Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:45.024514Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:45.024523Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:45.024525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:45.024530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533610503477083:8931]
2025-10-02T08:09:45.024533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533610503477083:8931]
2025-10-02T08:09:45.024575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:45.024578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:45.024584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.024585Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:45.024586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:45.024709Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:45.060187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533614798444424:8017]
2025-10-02T08:09:45.060282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 701, pipe: [1:7556533614798444424:8017]
2025-10-02T08:09:45.160435Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:45.160828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798444424:8017], now have 1 active actors on pipe
2025-10-02T08:09:45.160931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533614798444424:8017]
2025-10-02T08:09:45.160953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:45.160956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:45.160978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 702 reason: error at write: Disconnected sessionId: src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0
2025-10-02T08:09:45.161081Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:45.161128Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:45.161372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:45.161386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0] Write session will restart in 0.005393s
2025-10-02T08:09:45.161409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0] Write session: Do CDS request
2025-10-02T08:09:45.161415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:45.161183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 702 sessionId: src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0 is DEAD
2025-10-02T08:09:45.161368Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:09:45.161559Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 7 consumer shared/user session shared/user_1_7_13606406994983615898_v1 is DEAD
2025-10-02T08:09:45.161749Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:09:45.161760Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533520309106847:8010] disconnected; active server actors: 1
2025-10-02T08:09:45.161770Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533520309106847:8010] client user disconnected session shared/user_1_7_13606406994983615898_v1
2025-10-02T08:09:45.161806Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:09:45.161812Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:09:45.161823Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.005878s
2025-10-02T08:09:45.168363Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:09:45.168410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.168532Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:09:45.168532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:45.168538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 703
2025-10-02T08:09:45.168545Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 8
2025-10-02T08:09:45.168647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.168676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:45.168681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:45.168684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:45.168700Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:09:45.168753Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:09:45.168838Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 auth for : user
2025-10-02T08:09:45.169236Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 Handle describe topics response
2025-10-02T08:09:45.169263Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 auth is DEAD
2025-10-02T08:09:45.169283Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:09:45.169373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 703 sessionId:  describe result for acl check
2025-10-02T08:09:45.169407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:45.169413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:45.169414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:45.169419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533614798444701:8939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:45.169535Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:09:45.169666Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_8_14934402208375093245_v1
2025-10-02T08:09:45.169677Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:09:45.169742Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:09:45.169830Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:09:45.169873Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 got read request: guid# 9385515e-605f844c-d391c8fc-1dfbc85a
2025-10-02T08:09:45.169896Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533614798444704:8938] connected; active server actors: 1
2025-10-02T08:09:45.169993Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533614798444704:8938] session shared/user_1_8_14934402208375093245_v1
2025-10-02T08:09:45.170006Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:09:45.170016Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:09:45.170022Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_8_14934402208375093245_v1" (Sender=[1:7556533614798444660:8938], Pipe=[1:7556533614798444704:8938], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:09:45.170030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:09:45.170040Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:09:45.170053Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_8_14934402208375093245_v1" (Sender=[1:7556533614798444660:8938], Pipe=[1:7556533614798444704:8938], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:09:45.170067Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_8_14934402208375093245_v1" sender [1:7556533614798444660:8938] lock partition 0 for ReadingSession "shared/user_1_8_14934402208375093245_v1" (Sender=[1:7556533614798444660:8938], Pipe=[1:7556533614798444704:8938], Partitions=[], ActiveFamilyCount=1) generation 1 step 8
2025-10-02T08:09:45.170085Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:09:45.170094Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000047s
2025-10-02T08:09:45.170082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533614798444701:8939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:45.170319Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_8_14934402208375093245_v1" ClientId: "user" PipeClient { RawX1: 7556533614798444704 RawX2: 4503603922346730 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:09:45.170344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:09:45.172472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533614798444701:8939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:45.175286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533614798444701:8939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:45.175301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533614798444701:8939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:45.175304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533614798444701:8939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:45.175324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:45.181782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:45.182111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:45.182242Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:45.182249Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:45.182256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:45.182290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:45.182319Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533614798445117:8937]
2025-10-02T08:09:45.182748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:45.182940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:45.182996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:45.183312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:45.183353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.183359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.183360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.183361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.183362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.183367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.183374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.183376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.183378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.183380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.183384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.183388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.183392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.183395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.183399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.183402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.183408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.183411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.183413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.183416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.183426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:45.191820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:45.193575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:45.193589Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:45.193590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:45.193593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:45.193599Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 702 [1:7556533614798445117:8937]
2025-10-02T08:09:45.193607Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:45.193623Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:45.193628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.193631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.193632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.193644Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:45.193651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:45.193656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:45.193702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.193707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.193709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:45.193711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:45.193764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:45.193775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.193789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.193797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:45.193809Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533614798445111:8937]
2025-10-02T08:09:45.193810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533614798445111:8937]
2025-10-02T08:09:45.193817Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:45.193826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798444746:8944], now have 1 active actors on pipe
2025-10-02T08:09:45.193829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798444980:8939], now have 1 active actors on pipe
2025-10-02T08:09:45.193834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:45.193835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:45.193838Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:45.193841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 702
2025-10-02T08:09:45.193843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:45.193845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:45.193849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533615258625924:2378], now have 1 active actors on pipe
2025-10-02T08:09:45.193862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 702, pipe: [1:7556533614798444746:8944]
2025-10-02T08:09:45.193874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.193877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.193887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533614798445111:8937]
2025-10-02T08:09:45.193898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:45.193905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.193906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.193910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_8_14934402208375093245_v1 on pipe: [1:7556533614798444746:8944]
2025-10-02T08:09:45.193923Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:45.193945Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_8_14934402208375093245_v1:1 with generation 702
2025-10-02T08:09:45.193927Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 702
2025-10-02T08:09:45.193947Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:45.193954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.193980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.193986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:45.193993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.194002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:45.194022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.194028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.194029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:45.194039Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_8_14934402208375093245_v1
2025-10-02T08:09:45.194041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.194065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.194085Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:45.194106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.194112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.194199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.194231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 703 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0
2025-10-02T08:09:45.194652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9dc0b72-f0dcbe70-2857a154-730e787d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:45.197494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0] Write session: try to update token
2025-10-02T08:09:45.197514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:45.198353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:09:45.198385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:09:45.198394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.198396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.198398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.198407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:09:45.198418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:09:45.198480Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392585193 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:09:45.198497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:09:45.198525Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 sending to client partition status
2025-10-02T08:09:45.213219Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:45.213237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:45.213239Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:45.213247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533614798445111:8937]
2025-10-02T08:09:45.213252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533614798445111:8937]
2025-10-02T08:09:45.213289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:45.213295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.213296Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:45.213300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:45.213302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:45.213425Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:45.215773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId: src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:45.218060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:45.357323Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:45.357925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.357939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.358135Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:45.358812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:45.358823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0] Write session will restart in 0.009419s
2025-10-02T08:09:45.358846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0] Write session: Do CDS request
2025-10-02T08:09:45.358853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:45.358103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_8_14934402208375093245_v1
2025-10-02T08:09:45.358119Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:45.358405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533614798444746:8944]
2025-10-02T08:09:45.358420Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_8_14934402208375093245_v1
2025-10-02T08:09:45.358434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:45.358485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 703 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0
2025-10-02T08:09:45.358645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 703 sessionId: src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0 is DEAD
2025-10-02T08:09:45.369441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.369498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:45.369514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 704
2025-10-02T08:09:45.369719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.369750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:45.369759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:45.369763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:45.370254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 704 sessionId:  describe result for acl check
2025-10-02T08:09:45.370292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:45.370294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:45.370295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:45.370300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533614798445637:8958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:45.370819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533614798445637:8958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:45.375715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533614798445637:8958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:45.377536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:45.379307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:45.379530Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:45.379544Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:45.379556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:45.379615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:45.379657Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533614798445857:8955]
2025-10-02T08:09:45.379678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533614798445637:8958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:45.379690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533614798445637:8958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:45.379693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533614798445637:8958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:45.379700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:45.380275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:45.380507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:45.380555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:45.380885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:45.380951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.380958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.380959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.380961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.380962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.380968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.380978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.380983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.380987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.380990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.380996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.381004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.381010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.381015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.381019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.381023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.381027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.381032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.381036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.381042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.381064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:45.390403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:45.392391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:45.392411Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:45.392414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:45.392417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:45.392424Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 703 [1:7556533614798445857:8955]
2025-10-02T08:09:45.392439Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:45.392455Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:45.392459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.392461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.392463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.392480Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:45.392484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:45.392491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:45.392560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.392569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.392571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:45.392575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:45.392637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:45.392647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.392662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.392674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:45.392686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 703
2025-10-02T08:09:45.392691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798445862:8958], now have 1 active actors on pipe
2025-10-02T08:09:45.392698Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533614798445851:8955]
2025-10-02T08:09:45.392700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533614798445851:8955]
2025-10-02T08:09:45.392713Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:45.392725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.392726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:45.392730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:45.392734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.392748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533615258625936:2378], now have 1 active actors on pipe
2025-10-02T08:09:45.392755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:45.392773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:45.392780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:45.392822Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 703
2025-10-02T08:09:45.392866Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:45.392878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.392882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.392884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:45.392893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.392902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:45.392910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533614798445851:8955]
2025-10-02T08:09:45.392918Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:45.392931Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:45.392956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.393056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.393072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.393104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.393161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 704 partition: 0 MaxSeqNo: 17 sessionId: src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0
2025-10-02T08:09:45.393603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca2a8f1-7b0e3342-e22b977a-ee3aa4b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:45.396588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0] Write session: try to update token
2025-10-02T08:09:45.396608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:45.410444Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:45.410466Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:45.410468Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:45.410477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533614798445851:8955]
2025-10-02T08:09:45.410481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533614798445851:8955]
2025-10-02T08:09:45.410523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:45.410527Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:45.410531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.410532Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:45.410534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:45.410683Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:45.419397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId: src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:45.422056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:45.458533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533614798445899:8944]
2025-10-02T08:09:45.458682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 703, pipe: [1:7556533614798445899:8944]
2025-10-02T08:09:45.560529Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:45.560920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.560933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.560952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798445899:8944], now have 1 active actors on pipe
2025-10-02T08:09:45.561026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533614798445899:8944]
2025-10-02T08:09:45.561051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:45.561054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:45.561109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 704 reason: error at write: Disconnected sessionId: src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0
2025-10-02T08:09:45.561157Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:45.561130Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:45.561272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 704 sessionId: src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0 is DEAD
2025-10-02T08:09:45.561502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:45.561510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0] Write session will restart in 0.008062s
2025-10-02T08:09:45.561534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0] Write session: Do CDS request
2025-10-02T08:09:45.561539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:45.570518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.570553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:45.570571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 705
2025-10-02T08:09:45.570876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.570910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:45.570920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:45.570923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:45.571400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 705 sessionId:  describe result for acl check
2025-10-02T08:09:45.571437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:45.571443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:45.571445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:45.571451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533614798446265:8968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:45.571992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533614798446265:8968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:45.575021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533614798446265:8968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:45.578838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533614798446265:8968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:45.578855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533614798446265:8968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:45.578858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533614798446265:8968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:45.578867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:45.583299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:45.583650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:45.583822Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:45.583831Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:45.583841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:45.583888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:45.583927Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533614798446607:8967]
2025-10-02T08:09:45.584571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:45.584746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:45.584785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:45.585110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:45.585156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.585162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.585163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.585164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.585165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.585171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.585181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.585189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.585193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.585197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.585202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.585210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.585215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.585220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.585224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.585229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.585233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.585237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.585242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.585246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.585268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:45.593527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:45.595390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:45.595411Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:45.595414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:45.595418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:45.595423Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 704 [1:7556533614798446607:8967]
2025-10-02T08:09:45.595432Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:45.595447Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:45.595450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.595453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.595455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.595481Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:45.595485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:45.595491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:45.595549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.595557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.595560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:45.595563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:45.595623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:45.595630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.595643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.595655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:45.595675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533614798446601:8967]
2025-10-02T08:09:45.595683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533614798446601:8967]
2025-10-02T08:09:45.595690Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:45.595700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:45.595703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798446566:8968], now have 1 active actors on pipe
2025-10-02T08:09:45.595703Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:45.595710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:45.595725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:45.595731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:45.595738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533615258625975:2378], now have 1 active actors on pipe
2025-10-02T08:09:45.595768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.595777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.595789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533614798446601:8967]
2025-10-02T08:09:45.595795Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:45.595761Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 704
2025-10-02T08:09:45.595803Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:45.595829Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40138948-2112efe6-5c46a0e1-9aa479de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:45.595838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.595846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.595848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:45.595855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.595867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:45.595882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 704
2025-10-02T08:09:45.595891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.595916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.595926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.595952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.595993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 705 partition: 0 MaxSeqNo: 17 sessionId: src_id|40138948-2112efe6-5c46a0e1-9aa479de_0
2025-10-02T08:09:45.596693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8099ed6b-e46bedba-7a0fe6ac-e7572ee1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|40138948-2112efe6-5c46a0e1-9aa479de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:45.599788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40138948-2112efe6-5c46a0e1-9aa479de_0] Write session: try to update token
2025-10-02T08:09:45.599810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40138948-2112efe6-5c46a0e1-9aa479de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:45.613402Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:45.613420Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:45.613423Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:45.613432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533614798446601:8967]
2025-10-02T08:09:45.613441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533614798446601:8967]
2025-10-02T08:09:45.613483Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:45.613484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:45.613488Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:45.613492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.613494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:45.613644Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:45.617607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId: src_id|40138948-2112efe6-5c46a0e1-9aa479de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:45.620515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:45.661308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533614798446631:8944]
2025-10-02T08:09:45.665038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 704, pipe: [1:7556533614798446631:8944]
2025-10-02T08:09:45.748469Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:45.749012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.749027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.749065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798446631:8944], now have 1 active actors on pipe
2025-10-02T08:09:45.749189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533614798446631:8944]
2025-10-02T08:09:45.749219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:45.749226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:45.749247Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:45.749310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 705 reason: error at write: Disconnected sessionId: src_id|40138948-2112efe6-5c46a0e1-9aa479de_0
2025-10-02T08:09:45.749331Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:45.749478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 705 sessionId: src_id|40138948-2112efe6-5c46a0e1-9aa479de_0 is DEAD
2025-10-02T08:09:45.749767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40138948-2112efe6-5c46a0e1-9aa479de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:45.749781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40138948-2112efe6-5c46a0e1-9aa479de_0] Write session will restart in 0.005110s
2025-10-02T08:09:45.749803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40138948-2112efe6-5c46a0e1-9aa479de_0] Write session: Do CDS request
2025-10-02T08:09:45.749809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40138948-2112efe6-5c46a0e1-9aa479de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:45.756413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40138948-2112efe6-5c46a0e1-9aa479de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.756487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:45.756500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 706
2025-10-02T08:09:45.756650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.756682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:45.756686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:45.756690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:45.757112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 706 sessionId:  describe result for acl check
2025-10-02T08:09:45.757147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:45.757153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:45.757155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:45.757160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533614798446965:8974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:45.757660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533614798446965:8974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:45.760484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533614798446965:8974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:45.763586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533614798446965:8974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:45.763599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533614798446965:8974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:45.763602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533614798446965:8974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:45.763611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:45.767791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:45.769671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:45.769853Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:45.769861Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:45.769869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:45.769918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:45.769946Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533614798447324:8973]
2025-10-02T08:09:45.770428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:45.770612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:45.770639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:45.770824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:45.770851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.770855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.770856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.770856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.770857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.770860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.770866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.770868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.770870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.770872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.770876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.770880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.770883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.770886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.770889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.770891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.770895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.770898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.770900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.770902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.770913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:45.778743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:45.780582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:45.780602Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:45.780605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:45.780608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:45.780617Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 705 [1:7556533614798447324:8973]
2025-10-02T08:09:45.780628Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:45.780644Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:45.780651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.780654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.780656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.780672Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:45.780681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:45.780686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:45.780752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.780759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.780761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:45.780764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:45.780922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 705
2025-10-02T08:09:45.781042Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 705
2025-10-02T08:09:45.781136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:45.781147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.781161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.781178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:45.781203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798447229:8974], now have 1 active actors on pipe
2025-10-02T08:09:45.781211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533615258625981:2378], now have 1 active actors on pipe
2025-10-02T08:09:45.781216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.781221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.781242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533614798447318:8973]
2025-10-02T08:09:45.781246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533614798447318:8973]
2025-10-02T08:09:45.781256Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:45.781266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:45.781271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:45.781274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:45.781279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:45.781281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:45.781292Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:45.781300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.781303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.781304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:45.781311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.781319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:45.781350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533614798447318:8973]
2025-10-02T08:09:45.781358Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:45.781364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:45.781368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.781443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.781450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.781463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.781493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 706 partition: 0 MaxSeqNo: 17 sessionId: src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0
2025-10-02T08:09:45.781848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40138948-2112efe6-5c46a0e1-9aa479de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:45.784663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0] Write session: try to update token
2025-10-02T08:09:45.784688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:45.798022Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:45.798036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:45.798038Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:45.798046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533614798447318:8973]
2025-10-02T08:09:45.798054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533614798447318:8973]
2025-10-02T08:09:45.798090Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:45.798093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:45.798095Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:45.798099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.798101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:45.798229Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:45.800519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId: src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:45.802945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:45.849181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533614798447348:8944]
2025-10-02T08:09:45.849295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 705, pipe: [1:7556533614798447348:8944]
2025-10-02T08:09:45.932142Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:45.932396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.932409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.932448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798447348:8944], now have 1 active actors on pipe
2025-10-02T08:09:45.932569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533614798447348:8944]
2025-10-02T08:09:45.932595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:45.932600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:45.932654Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:45.932663Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:45.932657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 706 reason: error at write: Disconnected sessionId: src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0
2025-10-02T08:09:45.932842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 706 sessionId: src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0 is DEAD
2025-10-02T08:09:45.933038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:45.933054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0] Write session will restart in 0.005326s
2025-10-02T08:09:45.933084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0] Write session: Do CDS request
2025-10-02T08:09:45.933091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:45.939324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.939454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:45.939478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 707
2025-10-02T08:09:45.939637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:45.939675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:45.939684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:45.939688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:45.940137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 707 sessionId:  describe result for acl check
2025-10-02T08:09:45.940167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:45.940171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:45.940173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:45.940177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533614798447681:8981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:45.940691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533614798447681:8981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:45.942844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533614798447681:8981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:45.945917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533614798447681:8981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:45.945929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533614798447681:8981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:45.945932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533614798447681:8981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:45.945940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:45.950173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:45.951863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:45.952081Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:45.952088Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:45.952095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:45.952141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:45.952167Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533614798448045:8980]
2025-10-02T08:09:45.952577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:45.952725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:45.952764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:45.952973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:45.953003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.953004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.953005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.953005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.953006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.953009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.953016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.953019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.953033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.953035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.953041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.953046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:45.953049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.953052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:45.953054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.953057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:45.953059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.953062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.953065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.953069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.953080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:45.961678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:45.963268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:45.963283Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:45.963286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:45.963290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:45.963297Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 706 [1:7556533614798448045:8980]
2025-10-02T08:09:45.963310Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:45.963328Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:45.963335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.963338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.963340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.963356Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:45.963366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:45.963375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:45.963438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.963445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.963448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:45.963451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:45.963604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 706
2025-10-02T08:09:45.963676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 706
2025-10-02T08:09:45.963857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:45.963865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.963879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:45.963897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:45.963920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533614798447936:8981], now have 1 active actors on pipe
2025-10-02T08:09:45.963929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533615258625990:2378], now have 1 active actors on pipe
2025-10-02T08:09:45.963934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.963939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.963960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533614798448039:8980]
2025-10-02T08:09:45.963966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533614798448039:8980]
2025-10-02T08:09:45.963982Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:45.963994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:45.963997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:45.963999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:45.964013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:45.964019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:45.964034Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cad90842-963975b6-b0171720-d0c6aef6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:45.964043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:45.964046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:45.964048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:45.964057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:45.964069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:45.964106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533614798448039:8980]
2025-10-02T08:09:45.964118Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:45.964126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:45.964130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.964242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:45.964249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:45.964261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:45.964296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 707 partition: 0 MaxSeqNo: 17 sessionId: src_id|cad90842-963975b6-b0171720-d0c6aef6_0
2025-10-02T08:09:45.964692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2ab8c8-cc874ff-1ebe42db-6a459a50_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cad90842-963975b6-b0171720-d0c6aef6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:45.967489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad90842-963975b6-b0171720-d0c6aef6_0] Write session: try to update token
2025-10-02T08:09:45.967511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad90842-963975b6-b0171720-d0c6aef6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:45.982716Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:45.982734Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:45.982736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:45.982745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533614798448039:8980]
2025-10-02T08:09:45.982749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533614798448039:8980]
2025-10-02T08:09:45.982790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:45.982794Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:45.982796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:45.982798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:45.982799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:45.982938Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:45.983900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId: src_id|cad90842-963975b6-b0171720-d0c6aef6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:45.986749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:46.032980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533619093415366:8944]
2025-10-02T08:09:46.033096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 706, pipe: [1:7556533619093415366:8944]
2025-10-02T08:09:46.113809Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:46.114236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.114250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.114288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093415366:8944], now have 1 active actors on pipe
2025-10-02T08:09:46.114363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533619093415366:8944]
2025-10-02T08:09:46.114472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:46.114482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:46.114492Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:46.114554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 707 reason: error at write: Disconnected sessionId: src_id|cad90842-963975b6-b0171720-d0c6aef6_0
2025-10-02T08:09:46.114568Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:46.114726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 707 sessionId: src_id|cad90842-963975b6-b0171720-d0c6aef6_0 is DEAD
2025-10-02T08:09:46.114959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad90842-963975b6-b0171720-d0c6aef6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:46.114975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad90842-963975b6-b0171720-d0c6aef6_0] Write session will restart in 0.008279s
2025-10-02T08:09:46.114998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad90842-963975b6-b0171720-d0c6aef6_0] Write session: Do CDS request
2025-10-02T08:09:46.115003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad90842-963975b6-b0171720-d0c6aef6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:46.124358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad90842-963975b6-b0171720-d0c6aef6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.124454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:46.124470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 708
2025-10-02T08:09:46.124671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.124729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:46.124740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:46.124745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:46.125234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 708 sessionId:  describe result for acl check
2025-10-02T08:09:46.125275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:46.125276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:46.125277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:46.125282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533619093415779:8987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:46.125951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533619093415779:8987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:46.128477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533619093415779:8987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:46.131631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533619093415779:8987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:46.131647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533619093415779:8987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:46.131650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533619093415779:8987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:46.131659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:46.133677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:46.135406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:46.135548Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:46.135556Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:46.135562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:46.135609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:46.135637Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533619093416062:8986]
2025-10-02T08:09:46.136051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:46.136230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:46.136271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:46.136457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:46.136483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.136487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.136488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.136488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.136489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.136492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.136499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.136501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.136503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.136505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.136508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.136512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.136515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.136518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.136520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.136523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.136525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.136527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.136530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.136533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.136543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:46.144420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:46.145972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:46.145986Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:46.145988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:46.145991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:46.145997Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 707 [1:7556533619093416062:8986]
2025-10-02T08:09:46.146006Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:46.146020Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:46.146022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.146024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.146025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.146037Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:46.146041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:46.146046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:46.146090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.146097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.146099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:46.146101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:46.146215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 707
2025-10-02T08:09:46.146319Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 707
2025-10-02T08:09:46.146410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:46.146418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.146430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.146441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:46.146466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093416025:8987], now have 1 active actors on pipe
2025-10-02T08:09:46.146474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533619553593294:2378], now have 1 active actors on pipe
2025-10-02T08:09:46.146479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.146484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.146506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533619093416056:8986]
2025-10-02T08:09:46.146512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533619093416056:8986]
2025-10-02T08:09:46.146523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:46.146536Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:46.146540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:46.146542Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:46.146552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:46.146558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:46.146573Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:46.146581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.146590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.146592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:46.146599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.146607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:46.146641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533619093416056:8986]
2025-10-02T08:09:46.146652Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:46.146657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:46.146666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.146762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.146770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.146781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.146810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 708 partition: 0 MaxSeqNo: 17 sessionId: src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0
2025-10-02T08:09:46.147122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad90842-963975b6-b0171720-d0c6aef6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:46.150137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0] Write session: try to update token
2025-10-02T08:09:46.150155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:46.165167Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:46.165189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:46.165192Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:46.165202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533619093416056:8986]
2025-10-02T08:09:46.165206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533619093416056:8986]
2025-10-02T08:09:46.165245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:46.165252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.165250Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:46.165254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:46.165257Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:46.165400Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:46.167503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId: src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:46.170408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:46.214774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533619093416087:8944]
2025-10-02T08:09:46.214898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 707, pipe: [1:7556533619093416087:8944]
2025-10-02T08:09:46.299430Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:46.299896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.299908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.299942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093416087:8944], now have 1 active actors on pipe
2025-10-02T08:09:46.300094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:46.300107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:46.300120Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:46.300175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 708 reason: error at write: Disconnected sessionId: src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0
2025-10-02T08:09:46.300129Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:46.300341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 708 sessionId: src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0 is DEAD
2025-10-02T08:09:46.300432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533619093416087:8944]
2025-10-02T08:09:46.300499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:46.300510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0] Write session will restart in 0.005246s
2025-10-02T08:09:46.300536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0] Write session: Do CDS request
2025-10-02T08:09:46.300542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:46.307275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.307326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:46.307340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 709
2025-10-02T08:09:46.307472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.307503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:46.307513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:46.307516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:46.307935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 709 sessionId:  describe result for acl check
2025-10-02T08:09:46.307968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:46.307974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:46.307975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:46.307980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533619093416441:8993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:46.308512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533619093416441:8993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:46.310689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533619093416441:8993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:46.313340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533619093416441:8993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:46.313355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533619093416441:8993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:46.313358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533619093416441:8993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:46.313366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:46.317091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:46.318572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:46.318730Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:46.318739Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:46.318748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:46.318797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:46.318835Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533619093416785:8992]
2025-10-02T08:09:46.319442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:46.319658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:46.319705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:46.319999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:46.320053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.320064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.320065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.320066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.320067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.320072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.320082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.320086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.320089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.320093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.320098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.320105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.320111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.320116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.320119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.320125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.320129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.320134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.320139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.320144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.320161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:46.328256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:46.330144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:46.330165Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:46.330169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:46.330172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:46.330178Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 708 [1:7556533619093416785:8992]
2025-10-02T08:09:46.330191Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:46.330206Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:46.330209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.330213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.330214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.330230Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:46.330235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:46.330241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:46.330312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.330321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.330324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:46.330327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:46.330382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:46.330389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.330402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.330415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:46.330433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093416705:8993], now have 1 active actors on pipe
2025-10-02T08:09:46.330435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 708
2025-10-02T08:09:46.330439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533619093416779:8992]
2025-10-02T08:09:46.330444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533619093416779:8992]
2025-10-02T08:09:46.330455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:46.330463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533619553593301:2378], now have 1 active actors on pipe
2025-10-02T08:09:46.330468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.330468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:46.330471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:46.330472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.330489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:46.330479Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 708
2025-10-02T08:09:46.330507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:46.330514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:46.330555Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:46.330566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.330569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.330575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:46.330586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.330600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:46.330618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533619093416779:8992]
2025-10-02T08:09:46.330630Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:46.330659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.330661Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:46.330708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.330716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.330731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.330769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 709 partition: 0 MaxSeqNo: 17 sessionId: src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0
2025-10-02T08:09:46.331096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d237dcbe-f2bbb260-eac151e1-1dc8da34_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:46.333882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0] Write session: try to update token
2025-10-02T08:09:46.333899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:46.347673Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:46.347690Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:46.347692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:46.347700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533619093416779:8992]
2025-10-02T08:09:46.347703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533619093416779:8992]
2025-10-02T08:09:46.347739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:46.347745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.347746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:46.347767Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:46.347784Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:46.347880Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:46.350627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId: src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:46.353365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:46.402363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533619093416826:8944]
2025-10-02T08:09:46.404150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 708, pipe: [1:7556533619093416826:8944]
2025-10-02T08:09:46.487154Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:46.487642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.487655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.487693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093416826:8944], now have 1 active actors on pipe
2025-10-02T08:09:46.487811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:46.487824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:46.487883Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:46.487886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 709 reason: error at write: Disconnected sessionId: src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0
2025-10-02T08:09:46.487930Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:46.488035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 709 sessionId: src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0 is DEAD
2025-10-02T08:09:46.488165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:46.488175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0] Write session will restart in 0.006799s
2025-10-02T08:09:46.488197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0] Write session: Do CDS request
2025-10-02T08:09:46.488203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:46.488177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533619093416826:8944]
2025-10-02T08:09:46.496263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.496351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:46.496366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 710
2025-10-02T08:09:46.496478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.496506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:46.496515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:46.496518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:46.497012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 710 sessionId:  describe result for acl check
2025-10-02T08:09:46.497044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:46.497051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:46.497052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:46.497057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533619093417238:9012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:46.497601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533619093417238:9012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:46.499889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533619093417238:9012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:46.503204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533619093417238:9012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:46.503221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533619093417238:9012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:46.503224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533619093417238:9012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:46.503232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:46.505962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:46.507498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:46.507653Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:46.507660Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:46.507667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:46.507712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:46.507757Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533619093417554:9011]
2025-10-02T08:09:46.508292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:46.508481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:46.508529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:46.508870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:46.508920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.508926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.508927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.508928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.508929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.508934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.508954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.508962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.508965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.508969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.508974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.508981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.508987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.508991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.508995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.508998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.509002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.509005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.509014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.509018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.509033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:46.517165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:46.519068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:46.519081Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:46.519083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:46.519086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:46.519090Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 709 [1:7556533619093417554:9011]
2025-10-02T08:09:46.519099Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:46.519114Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:46.519117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.519121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.519123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.519137Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:46.519142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:46.519149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:46.519208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.519215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.519218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:46.519220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:46.519280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:46.519287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.519299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.519317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:46.519337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093417510:9012], now have 1 active actors on pipe
2025-10-02T08:09:46.519344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 709
2025-10-02T08:09:46.519347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533619093417548:9011]
2025-10-02T08:09:46.519350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533619093417548:9011]
2025-10-02T08:09:46.519356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:46.519365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533619553593332:2378], now have 1 active actors on pipe
2025-10-02T08:09:46.519368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:46.519370Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:46.519376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:46.519389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:46.519396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:46.519404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.519411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.519460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533619093417548:9011]
2025-10-02T08:09:46.519478Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:46.519459Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 709
2025-10-02T08:09:46.519493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:46.519495Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:46.519500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.519504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.519506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:46.519515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.519523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:46.519563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.519646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.519656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.519674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.519716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 710 partition: 0 MaxSeqNo: 17 sessionId: src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0
2025-10-02T08:09:46.520041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82fc36d-601e3e55-2b1f2efc-dd5102f6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:46.523087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0] Write session: try to update token
2025-10-02T08:09:46.523108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:46.530720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:46.530739Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:46.530748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533619093417548:9011]
2025-10-02T08:09:46.530790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:46.530816Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:46.530976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:46.531131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:46.531281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:46.531428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:46.531649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:46.531688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:46.542536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId: src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:46.545435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:46.545574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.545596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.545648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:46.545679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:46.546045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.546065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.546266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.546360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.546449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.546515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.546566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.546580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.546661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.546730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.546805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.546882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.546944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.546953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.547033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.547107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.547180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.547258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.547322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.547333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.547414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.547505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.547583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.547662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.547717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.547724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.547798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.547866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.547938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.548017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.548071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.548083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.548163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.548237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.548315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.548387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.548447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.548454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.548534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.548607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.548684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.548760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.548855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.548864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.548951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.549029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.549119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.549204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.549267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.549276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.549359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.549437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.549518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.549598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.549657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.549665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.549750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.549823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.549898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.549972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.550030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.550038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.550124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:46.550210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.550238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.550242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:46.550281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:46.550303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:46.550312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:46.550315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:46.550318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:46.550778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:46.550813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:46.550826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:46.550834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:46.550843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:46.550848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:46.551767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:46.551803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:46.551812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:46.551815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:46.551820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:46.551823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:46.552345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:46.552374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:46.552381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:46.552387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:46.552396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:46.553854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:46.553876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:46.553890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392586553
2025-10-02T08:09:46.554138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:46.554164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:46.554171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:46.554175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:46.554180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:46.554185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:46.554767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:46.554802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:46.554812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:46.554817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:46.554821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:46.554825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:46.555345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:46.555374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:46.555381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:46.555385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:46.555391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:46.555397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:46.555931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:46.555960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:46.555966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:46.557259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:46.557286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:46.557292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:46.557296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:46.557306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392586557
2025-10-02T08:09:46.557652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:46.557681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:46.557689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:46.557699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:46.557704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:46.557708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:46.558246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:46.558274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:46.558279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:46.558284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:46.558287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:46.558292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:46.558862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:46.558893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.559008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392586558
2025-10-02T08:09:46.562030Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:46.562064Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:46.562071Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:46.562078Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:46.562093Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:46.562102Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:46.562105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:46.562113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533619093417548:9011]
2025-10-02T08:09:46.562121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533619093417548:9011]
2025-10-02T08:09:46.562160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:46.562175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:46.562209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:46.562214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.562216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:46.562373Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:46.588564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533619093417593:8944]
2025-10-02T08:09:46.588736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 709, pipe: [1:7556533619093417593:8944]
2025-10-02T08:09:46.706317Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:46.706933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093417593:8944], now have 1 active actors on pipe
2025-10-02T08:09:46.707080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:46.707094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:46.707124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 710 reason: error at write: Disconnected sessionId: src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0
2025-10-02T08:09:46.707133Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:46.707296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 710 sessionId: src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0 is DEAD
2025-10-02T08:09:46.707475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533619093417593:8944]
2025-10-02T08:09:46.707563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:46.707577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0] Write session will restart in 0.005151s
2025-10-02T08:09:46.707600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0] Write session: Do CDS request
2025-10-02T08:09:46.707607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:46.708870Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:46.711297Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [66019b0c159e2a0a] Result# TEvPutResult {Id# [72075186224037892:709:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:46.711310Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:709:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:46.711374Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:709:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:46.714300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.714400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:46.714414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 711
2025-10-02T08:09:46.714507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.714533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:46.714543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:46.714546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:46.715440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 711 sessionId:  describe result for acl check
2025-10-02T08:09:46.715487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:46.715492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:46.715494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:46.715499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533619093417880:9019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:46.715985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533619093417880:9019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:46.718330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533619093417880:9019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:46.721887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533619093417880:9019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:46.721901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533619093417880:9019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:46.721904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533619093417880:9019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:46.721911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:46.728045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:46.729883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:46.730032Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:46.730040Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:46.730047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:46.730080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:46.730107Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533619093418302:9018]
2025-10-02T08:09:46.730600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:46.730782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:46.730844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:46.731150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:46.731214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.731219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.731221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.731222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.731223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.731227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.731237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.731240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.731243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.731247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.731252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.731259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.731263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.731268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.731272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.731276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.731279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.731284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.731287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.731292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.731311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:46.739938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:46.741786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:46.741806Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:46.741808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:46.741811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:46.741817Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 710 [1:7556533619093418302:9018]
2025-10-02T08:09:46.741830Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:46.741848Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:46.741851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.741854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.741857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.741875Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:46.741880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:46.741888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:46.741953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.741963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.741965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:46.741968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:46.742036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:46.742048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.742062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.742073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:46.742093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533619553593350:2378], now have 1 active actors on pipe
2025-10-02T08:09:46.742096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093418140:9019], now have 1 active actors on pipe
2025-10-02T08:09:46.742103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533619093418296:9018]
2025-10-02T08:09:46.742106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533619093418296:9018]
2025-10-02T08:09:46.742107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 710
2025-10-02T08:09:46.742113Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:46.742126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:46.742127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:46.742130Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:46.742141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:46.742144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:46.742151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.742155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.742195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533619093418296:9018]
2025-10-02T08:09:46.742203Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:46.742214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:46.742219Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d13377e9-625b4d64-b614e378-9b2511dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:46.742225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.742229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.742231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:46.742240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.742250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:46.742295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.742395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.742403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.742428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.742480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 711 partition: 0 MaxSeqNo: 17 sessionId: src_id|d13377e9-625b4d64-b614e378-9b2511dd_0
2025-10-02T08:09:46.742842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b810eec-6f8fb6f1-6369ea52-8961581c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d13377e9-625b4d64-b614e378-9b2511dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:46.745721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d13377e9-625b4d64-b614e378-9b2511dd_0] Write session: try to update token
2025-10-02T08:09:46.745740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d13377e9-625b4d64-b614e378-9b2511dd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:46.742447Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 710
2025-10-02T08:09:46.753940Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:46.753963Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:46.753973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533619093418296:9018]
2025-10-02T08:09:46.754020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:46.754031Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:46.754226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:46.754389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:46.754551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:46.754710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:46.754945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:46.754982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:46.767079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId: src_id|d13377e9-625b4d64-b614e378-9b2511dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:46.769821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:46.769908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.769917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.769955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:46.769980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:46.770047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.770056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.770233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.770298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.770365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.770430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.770725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.770731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.770814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.770884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.770958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.771038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.771094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.771097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.771179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.771244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.771310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.771375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.771429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.771432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.771522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.771593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.771655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.771714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.771765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.771767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.771827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.771887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.771959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.772023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.772066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.772067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.772128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.772180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.772235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.772297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.772344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.772347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.772423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.772486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.772553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.772617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.772668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.772671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.772743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.772797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.772894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.772961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.773012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.773015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.773092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.773164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.773231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.773302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.773347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.773356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.773426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:46.773496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:46.773565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:46.773632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:46.773678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:46.773685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:46.773751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:46.773816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.773841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.773848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:46.773880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:46.773898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:46.773906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:46.773909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:46.773913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:46.774333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:46.774360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:46.774366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:46.774369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:46.774378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:46.774381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:46.775003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:46.775028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:46.775040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:46.775049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:46.775053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:46.775060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:46.775664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:46.775685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:46.775692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:46.775701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:46.775704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:46.777078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:46.777096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:46.777108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392586776
2025-10-02T08:09:46.777299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:46.777315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:46.777325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:46.777329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:46.777333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:46.777336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:46.777929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:46.777955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:46.777966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:46.777975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:46.777983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:46.777991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:46.778549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:46.778573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:46.778584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:46.778587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:46.778593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:46.778601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:46.779187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:46.779211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:46.779217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:46.780561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:46.780579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:46.780584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:46.780588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:46.780597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392586780
2025-10-02T08:09:46.780946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:46.780972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:46.780979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:46.780982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:46.780985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:46.780988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:46.781485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:46.781507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:46.781511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:46.781516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:46.781521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:46.781524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:46.782002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:46.782023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.782125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392586781
2025-10-02T08:09:46.784417Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:46.784438Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:46.784442Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:46.784447Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:46.784454Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:46.784456Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:46.784458Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:46.784465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533619093418296:9018]
2025-10-02T08:09:46.784469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533619093418296:9018]
2025-10-02T08:09:46.784529Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:46.784530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:46.784534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.784536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:46.784542Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:46.784663Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:46.807633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533619093418328:8944]
2025-10-02T08:09:46.807756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 710, pipe: [1:7556533619093418328:8944]
2025-10-02T08:09:46.921942Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:46.922308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093418328:8944], now have 1 active actors on pipe
2025-10-02T08:09:46.922434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:46.922443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:46.922469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 711 reason: error at write: Disconnected sessionId: src_id|d13377e9-625b4d64-b614e378-9b2511dd_0
2025-10-02T08:09:46.922484Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:46.922530Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:46.922634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 711 sessionId: src_id|d13377e9-625b4d64-b614e378-9b2511dd_0 is DEAD
2025-10-02T08:09:46.922763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533619093418328:8944]
2025-10-02T08:09:46.922847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13377e9-625b4d64-b614e378-9b2511dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:46.922866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13377e9-625b4d64-b614e378-9b2511dd_0] Write session will restart in 0.005722s
2025-10-02T08:09:46.922893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13377e9-625b4d64-b614e378-9b2511dd_0] Write session: Do CDS request
2025-10-02T08:09:46.922900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13377e9-625b4d64-b614e378-9b2511dd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:46.927205Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:710:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:46.927205Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [c387aaca3aa7a69f] Result# TEvPutResult {Id# [72075186224037892:710:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:46.927284Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:710:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:46.930470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d13377e9-625b4d64-b614e378-9b2511dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.930729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:46.930741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 712
2025-10-02T08:09:46.934104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:46.934156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:46.934166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:46.934171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:46.934598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 712 sessionId:  describe result for acl check
2025-10-02T08:09:46.934636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:46.934642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:46.934644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:46.934648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533619093418731:9026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:46.935171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533619093418731:9026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:46.938706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533619093418731:9026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:46.942131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533619093418731:9026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:46.942148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533619093418731:9026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:46.942151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533619093418731:9026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:46.942159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:46.943932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:46.945503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:46.945694Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:46.945703Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:46.945712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:46.945758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:46.945794Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533619093419040:9025]
2025-10-02T08:09:46.946423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:46.946573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:46.946608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:46.946886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:46.946925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.946930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.946931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.946932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.946933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.946937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.946946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.946949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.946952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.946955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.946960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.946972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:46.946982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.946991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:46.946999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.947004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:46.947012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.947021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.947025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.947032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.947050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:46.955488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:46.957163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:46.957182Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:46.957183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:46.957187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:46.957192Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 711 [1:7556533619093419040:9025]
2025-10-02T08:09:46.957201Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:46.957216Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:46.957218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.957220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.957222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.957235Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:46.957242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:46.957248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:46.957306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.957313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.957316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:46.957319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:46.957379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:46.957386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.957394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:46.957401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:46.957416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533619093419034:9025]
2025-10-02T08:09:46.957424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533619093419034:9025]
2025-10-02T08:09:46.957430Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:46.957440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:46.957443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 711
2025-10-02T08:09:46.957453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:46.957457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:46.957460Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:46.957460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:46.957470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533619093419019:9026], now have 1 active actors on pipe
2025-10-02T08:09:46.957502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.957510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.957523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533619093419034:9025]
2025-10-02T08:09:46.957533Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:46.957539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533619553593359:2378], now have 1 active actors on pipe
2025-10-02T08:09:46.957540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:46.957564Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:46.957574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:46.957578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:46.957584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:46.957560Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 711
2025-10-02T08:09:46.957594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:46.957606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:46.957634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.957679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:46.957686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:46.957698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:46.957734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 712 partition: 0 MaxSeqNo: 17 sessionId: src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0
2025-10-02T08:09:46.958088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13377e9-625b4d64-b614e378-9b2511dd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:46.960956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0] Write session: try to update token
2025-10-02T08:09:46.960972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:46.975608Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:46.975630Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:46.975632Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:46.975642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533619093419034:9025]
2025-10-02T08:09:46.975646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533619093419034:9025]
2025-10-02T08:09:46.975685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:46.975686Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:46.975691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:46.975692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:46.975694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:46.975836Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:46.980232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId: src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:46.983521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:47.022710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533623388386360:8944]
2025-10-02T08:09:47.022825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 711, pipe: [1:7556533623388386360:8944]
2025-10-02T08:09:47.114307Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:47.114798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.114816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.114855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388386360:8944], now have 1 active actors on pipe
2025-10-02T08:09:47.114963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533623388386360:8944]
2025-10-02T08:09:47.114984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:47.114991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:47.115041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 712 reason: error at write: Disconnected sessionId: src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0
2025-10-02T08:09:47.115090Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:47.115110Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:47.115206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 712 sessionId: src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0 is DEAD
2025-10-02T08:09:47.115361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:47.115370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0] Write session will restart in 0.006133s
2025-10-02T08:09:47.115394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0] Write session: Do CDS request
2025-10-02T08:09:47.115401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:47.122427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.122564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:47.122585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 713
2025-10-02T08:09:47.122726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.122767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:47.122774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:47.122779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:47.123292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 713 sessionId:  describe result for acl check
2025-10-02T08:09:47.123325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:47.123327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:47.123328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:47.123332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533623388386658:9032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:47.123847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533623388386658:9032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:47.127317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533623388386658:9032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:47.132441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533623388386658:9032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:47.132458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533623388386658:9032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:47.132461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533623388386658:9032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:47.132471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:47.147215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:47.149272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:47.149502Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:47.149520Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:47.149532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:47.149598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:47.149641Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533623388387068:9031]
2025-10-02T08:09:47.150250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:47.150450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:47.150503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:47.150771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:47.150823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.150833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.150834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.150835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.150836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.150842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.150852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.150856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.150858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.150860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.150864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.150869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.150872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.150875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.150881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.150884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.150886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.150889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.150891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.150894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.150921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:47.159746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:47.161930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:47.161960Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:47.161962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:47.161966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:47.161973Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 712 [1:7556533623388387068:9031]
2025-10-02T08:09:47.161987Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:47.162006Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:47.162010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.162013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.162015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.162032Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:47.162037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:47.162044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:47.162116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.162130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.162134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:47.162136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:47.162209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:47.162221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.162238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.162249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:47.162252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 712
2025-10-02T08:09:47.162269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388386817:9032], now have 1 active actors on pipe
2025-10-02T08:09:47.162279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533623848560663:2378], now have 1 active actors on pipe
2025-10-02T08:09:47.162284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.162289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.162307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533623388387062:9031]
2025-10-02T08:09:47.162316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533623388387062:9031]
2025-10-02T08:09:47.162329Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:47.162348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:47.162349Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:47.162353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:47.162369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:47.162373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:47.162338Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 712
2025-10-02T08:09:47.162390Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc344e01-2a991356-a927eabd-d35256b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:47.162403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.162407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.162409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:47.162419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.162429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:47.162466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533623388387062:9031]
2025-10-02T08:09:47.162476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:47.162491Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:47.162496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.162551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.162554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.162569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.162614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 713 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc344e01-2a991356-a927eabd-d35256b9_0
2025-10-02T08:09:47.163552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea2e111-6dd5dc18-5f3751e4-c0737d07_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc344e01-2a991356-a927eabd-d35256b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:47.166798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc344e01-2a991356-a927eabd-d35256b9_0] Write session: try to update token
2025-10-02T08:09:47.166820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc344e01-2a991356-a927eabd-d35256b9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:47.180591Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:47.180609Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:47.180611Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:47.180618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533623388387062:9031]
2025-10-02T08:09:47.180621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533623388387062:9031]
2025-10-02T08:09:47.180654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:47.180659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.180658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:47.180660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:47.180663Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:47.180814Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:47.185970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId: src_id|cc344e01-2a991356-a927eabd-d35256b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:47.188790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:47.215192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533623388387093:8944]
2025-10-02T08:09:47.215304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 712, pipe: [1:7556533623388387093:8944]
2025-10-02T08:09:47.315124Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:47.315560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.315575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.315591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388387093:8944], now have 1 active actors on pipe
2025-10-02T08:09:47.315666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:47.315673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:47.315716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 713 reason: error at write: Disconnected sessionId: src_id|cc344e01-2a991356-a927eabd-d35256b9_0
2025-10-02T08:09:47.315799Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:47.315816Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:47.315900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 713 sessionId: src_id|cc344e01-2a991356-a927eabd-d35256b9_0 is DEAD
2025-10-02T08:09:47.316043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533623388387093:8944]
2025-10-02T08:09:47.316194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc344e01-2a991356-a927eabd-d35256b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:47.316208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc344e01-2a991356-a927eabd-d35256b9_0] Write session will restart in 0.009458s
2025-10-02T08:09:47.316239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc344e01-2a991356-a927eabd-d35256b9_0] Write session: Do CDS request
2025-10-02T08:09:47.316246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc344e01-2a991356-a927eabd-d35256b9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:47.327444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc344e01-2a991356-a927eabd-d35256b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.328149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:47.328168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 714
2025-10-02T08:09:47.328410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.328448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:47.328460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:47.328464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:47.328901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 714 sessionId:  describe result for acl check
2025-10-02T08:09:47.328952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:47.328954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:47.328956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:47.328961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533623388387559:9038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:47.329473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533623388387559:9038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:47.331751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533623388387559:9038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:47.336194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533623388387559:9038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:47.336212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533623388387559:9038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:47.336216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533623388387559:9038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:47.336225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:47.337237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:47.339219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:47.339414Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:47.339427Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:47.339449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:47.339511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:47.339552Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533623388387802:9037]
2025-10-02T08:09:47.340203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:47.340437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:47.340480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:47.340798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:47.340863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.340864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.340865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.340866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.340867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.340873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.340883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.340887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.340891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.340894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.340899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.340906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.340911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.340916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.340921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.340926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.340930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.340935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.340939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.340945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.340966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:47.349459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:47.351454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:47.351484Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:47.351486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:47.351489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:47.351494Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 713 [1:7556533623388387802:9037]
2025-10-02T08:09:47.351504Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:47.351517Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:47.351519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.351521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.351522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.351535Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:47.351538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:47.351543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:47.351590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.351596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.351598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:47.351600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:47.351653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:47.351663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.351676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.351691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:47.351713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388387784:9038], now have 1 active actors on pipe
2025-10-02T08:09:47.351724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533623388387796:9037]
2025-10-02T08:09:47.351726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533623388387796:9037]
2025-10-02T08:09:47.351726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 713
2025-10-02T08:09:47.351733Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:47.351742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:47.351745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:47.351746Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:47.351757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:47.351760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:47.351766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533623848560669:2378], now have 1 active actors on pipe
2025-10-02T08:09:47.351775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.351779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.351819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533623388387796:9037]
2025-10-02T08:09:47.351833Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:47.351849Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f6b37eb-ce422af-f0565002-584419cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:47.351855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.351859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.351860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:47.351845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 713
2025-10-02T08:09:47.351859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:47.351870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.351878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:47.351910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.351952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.351959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.351972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.352011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 714 partition: 0 MaxSeqNo: 17 sessionId: src_id|7f6b37eb-ce422af-f0565002-584419cc_0
2025-10-02T08:09:47.352334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc344e01-2a991356-a927eabd-d35256b9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7f6b37eb-ce422af-f0565002-584419cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:47.355443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6b37eb-ce422af-f0565002-584419cc_0] Write session: try to update token
2025-10-02T08:09:47.355477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6b37eb-ce422af-f0565002-584419cc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:47.363165Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:47.363185Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:47.363194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533623388387796:9037]
2025-10-02T08:09:47.363234Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:47.363238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:47.363420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:47.363596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:47.363753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:47.363894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:47.364119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:47.364166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:47.374088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId: src_id|7f6b37eb-ce422af-f0565002-584419cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:47.376765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:47.376852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.376863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.376899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:47.376926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:47.377011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.377030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.377210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.377291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.377362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.377433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.377691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.377703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.377774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.377838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.377906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.377983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.378036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.378048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.378125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.378201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.378282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.378362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.378420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.378430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.378496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.378568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.378633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.378708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.378759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.378771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.378840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.378912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.378986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.379055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.379103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.379111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.379180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.379242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.379306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.379373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.379418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.379424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.379506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.379570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.379638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.379707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.379757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.379764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.379833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.379896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.379960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.380035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.380098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.380106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.380178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.380241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.380304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.380372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.380425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.380434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.380500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:47.380560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:47.380627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:47.380696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:47.380748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:47.380756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:47.380866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:47.380935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.380957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.380963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:47.380997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:47.381015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:47.381019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:47.381023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:47.381026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:47.381533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:47.381567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:47.381575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:47.381584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:47.381587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:47.381591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:47.382385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:47.382414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:47.382423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:47.382431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:47.382435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:47.382438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:47.383001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:47.383031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:47.383037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:47.383041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:47.383044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:47.385120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:47.385145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:47.385158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392587385
2025-10-02T08:09:47.385361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:47.385379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:47.385385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:47.385389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:47.385393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:47.385396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:47.385903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:47.385917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:47.385923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:47.385927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:47.385932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:47.385937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:47.386438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:47.386452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:47.386460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:47.386463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:47.386469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:47.386472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:47.386949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:47.386961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:47.386967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:47.388124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:47.388133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:47.388139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:47.388143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:47.388152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392587387
2025-10-02T08:09:47.388462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:47.388474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:47.388479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:47.388486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:47.388489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:47.388494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:47.389138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:47.389166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:47.389173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:47.389177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:47.389181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:47.389187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:47.389669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:47.389694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.389797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392587389
2025-10-02T08:09:47.392141Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:47.392158Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:47.392165Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:47.392173Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:47.392183Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:47.392186Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:47.392188Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:47.392198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533623388387796:9037]
2025-10-02T08:09:47.392205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533623388387796:9037]
2025-10-02T08:09:47.392277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:47.392283Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:47.392292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:47.392296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.392298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:47.392455Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:47.461023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533623388387847:8944]
2025-10-02T08:09:47.463406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 713, pipe: [1:7556533623388387847:8944]
2025-10-02T08:09:47.536322Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:47.536724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388387847:8944], now have 1 active actors on pipe
2025-10-02T08:09:47.536835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:47.536845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:47.536873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 714 reason: error at write: Disconnected sessionId: src_id|7f6b37eb-ce422af-f0565002-584419cc_0
2025-10-02T08:09:47.536935Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:47.537055Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:47.537036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 714 sessionId: src_id|7f6b37eb-ce422af-f0565002-584419cc_0 is DEAD
2025-10-02T08:09:47.537171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533623388387847:8944]
2025-10-02T08:09:47.537213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6b37eb-ce422af-f0565002-584419cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:47.537244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6b37eb-ce422af-f0565002-584419cc_0] Write session will restart in 0.009867s
2025-10-02T08:09:47.537266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6b37eb-ce422af-f0565002-584419cc_0] Write session: Do CDS request
2025-10-02T08:09:47.537272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6b37eb-ce422af-f0565002-584419cc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:47.541548Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [146dc318f8959b24] Result# TEvPutResult {Id# [72075186224037892:713:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:47.541581Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:713:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:47.541639Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:713:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:47.548428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6b37eb-ce422af-f0565002-584419cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.548455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:47.548471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 715
2025-10-02T08:09:47.548719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.548754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:47.548762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:47.548766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:47.549211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 715 sessionId:  describe result for acl check
2025-10-02T08:09:47.549247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:47.549255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:47.549257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:47.549263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533623388388289:9057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:47.549843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533623388388289:9057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:47.552214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533623388388289:9057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:47.555304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533623388388289:9057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:47.555319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533623388388289:9057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:47.555323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533623388388289:9057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:47.555331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:47.558585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:47.558878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:47.559035Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:47.559047Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:47.559056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:47.559107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:47.559142Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533623388388589:9056]
2025-10-02T08:09:47.559719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:47.559875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:47.559920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:47.560200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:47.560267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.560274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.560275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.560276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.560277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.560282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.560292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.560296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.560300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.560303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.560308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.560314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.560320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.560324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.560328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.560332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.560336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.560340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.560344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.560348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.560371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:47.568100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:47.569759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:47.569777Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:47.569780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:47.569783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:47.569789Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 714 [1:7556533623388388589:9056]
2025-10-02T08:09:47.569800Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:47.569816Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:47.569818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.569821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.569824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.569840Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:47.569845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:47.569851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:47.569911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.569921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.569924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:47.569927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:47.569982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:47.569990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.570003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.570013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:47.570036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533623848560711:2378], now have 1 active actors on pipe
2025-10-02T08:09:47.570046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533623388388583:9056]
2025-10-02T08:09:47.570049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533623388388583:9056]
2025-10-02T08:09:47.570055Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:47.570064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 714
2025-10-02T08:09:47.570068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388388569:9057], now have 1 active actors on pipe
2025-10-02T08:09:47.570069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:47.570072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:47.570075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:47.570087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:47.570094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:47.570100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.570103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.570109Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 714
2025-10-02T08:09:47.570138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533623388388583:9056]
2025-10-02T08:09:47.570147Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:47.570154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:47.570161Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:47.570167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.570170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.570173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:47.570181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.570193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:47.570235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.570307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.570315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.570331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.570370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 715 partition: 0 MaxSeqNo: 17 sessionId: src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0
2025-10-02T08:09:47.570750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6b37eb-ce422af-f0565002-584419cc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:47.573672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0] Write session: try to update token
2025-10-02T08:09:47.573694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:47.587070Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:47.587090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:47.587093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:47.587101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533623388388583:9056]
2025-10-02T08:09:47.587105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533623388388583:9056]
2025-10-02T08:09:47.587145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:47.587150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.587153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:47.587155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:47.587162Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:47.587301Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:47.590567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId: src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:47.593348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:47.637084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533623388388627:8944]
2025-10-02T08:09:47.637217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 714, pipe: [1:7556533623388388627:8944]
2025-10-02T08:09:47.722888Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:47.723422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.723438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.723484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388388627:8944], now have 1 active actors on pipe
2025-10-02T08:09:47.723767Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:47.723991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:47.723560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533623388388627:8944]
2025-10-02T08:09:47.724005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0] Write session will restart in 0.007474s
2025-10-02T08:09:47.723582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:47.723585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:47.723632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 715 reason: error at write: Disconnected sessionId: src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0
2025-10-02T08:09:47.723707Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:47.723792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 715 sessionId: src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0 is DEAD
2025-10-02T08:09:47.724031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0] Write session: Do CDS request
2025-10-02T08:09:47.724040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:47.732397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.732457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:47.732476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 716
2025-10-02T08:09:47.732685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.732729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:47.732739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:47.732743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:47.733131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 716 sessionId:  describe result for acl check
2025-10-02T08:09:47.733160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:47.733165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:47.733166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:47.733170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533623388389017:9064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:47.733621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533623388389017:9064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:47.736126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533623388389017:9064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:47.740213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533623388389017:9064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:47.740239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533623388389017:9064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:47.740242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533623388389017:9064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:47.740253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:47.744961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:47.745430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:47.745641Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:47.745651Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:47.745661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:47.745729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:47.745767Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533623388389340:9063]
2025-10-02T08:09:47.746397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:47.746598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:47.746645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:47.746960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:47.747009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.747015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.747017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.747018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.747019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.747025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.747036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.747039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.747042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.747045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.747051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.747058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.747063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.747073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.747078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.747083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.747087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.747092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.747097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.747103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.747125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:47.755508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:47.757576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:47.757593Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:47.757595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:47.757599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:47.757606Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 715 [1:7556533623388389340:9063]
2025-10-02T08:09:47.757619Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:47.757636Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:47.757646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.757649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.757651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.757666Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:47.757675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:47.757685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:47.757744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.757751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.757754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:47.757756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:47.757820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:47.757824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.757836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.757851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:47.757870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388389302:9064], now have 1 active actors on pipe
2025-10-02T08:09:47.757876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533623388389334:9063]
2025-10-02T08:09:47.757879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533623388389334:9063]
2025-10-02T08:09:47.757879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 715
2025-10-02T08:09:47.757886Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:47.757899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:47.757898Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:47.757901Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:47.757912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:47.757915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:47.757921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533623848560718:2378], now have 1 active actors on pipe
2025-10-02T08:09:47.757926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.757930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.757969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533623388389334:9063]
2025-10-02T08:09:47.757983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:47.757997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:47.757999Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:47.758005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.758009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.758011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:47.758019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.758028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:47.758009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 715
2025-10-02T08:09:47.758073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.758145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.758152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.758166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.758213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 716 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0
2025-10-02T08:09:47.758608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ad349-fc6ecfa6-d5b7b4ad-c287cb3d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:47.761474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0] Write session: try to update token
2025-10-02T08:09:47.761496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:47.776306Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:47.776327Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:47.776330Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:47.776340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533623388389334:9063]
2025-10-02T08:09:47.776345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533623388389334:9063]
2025-10-02T08:09:47.776386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:47.776399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.776399Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:47.776404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:47.776406Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:47.776565Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:47.779010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId: src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:47.781976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:47.823953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533623388389364:8944]
2025-10-02T08:09:47.824051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 715, pipe: [1:7556533623388389364:8944]
2025-10-02T08:09:47.929066Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:47.929559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.929573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.929615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388389364:8944], now have 1 active actors on pipe
2025-10-02T08:09:47.930153Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:47.929723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533623388389364:8944]
2025-10-02T08:09:47.929745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:47.929747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:47.929802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 716 reason: error at write: Disconnected sessionId: src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0
2025-10-02T08:09:47.929861Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:47.929977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 716 sessionId: src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0 is DEAD
2025-10-02T08:09:47.930494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:47.930511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0] Write session will restart in 0.008878s
2025-10-02T08:09:47.930541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0] Write session: Do CDS request
2025-10-02T08:09:47.930548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:47.940442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.940586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:47.940612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 717
2025-10-02T08:09:47.940775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:47.940840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:47.940852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:47.940857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:47.941416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 717 sessionId:  describe result for acl check
2025-10-02T08:09:47.941462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:47.941469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:47.941471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:47.941477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533623388389789:9071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:47.942091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533623388389789:9071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:47.944536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533623388389789:9071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:47.947885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533623388389789:9071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:47.947907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533623388389789:9071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:47.947910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533623388389789:9071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:47.947916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:47.953238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:47.953677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:47.953843Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:47.953855Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:47.953864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:47.953898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:47.953930Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533623388390082:9070]
2025-10-02T08:09:47.954347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:47.954540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:47.954568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:47.954768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:47.954799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.954805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.954806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.954807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.954808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.954811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.954818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.954820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.954823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.954825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.954829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.954833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:47.954837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.954841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:47.954843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.954846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:47.954848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.954851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.954853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.954856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.954866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:47.963083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:47.965332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:47.965357Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:47.965360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:47.965363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:47.965368Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 716 [1:7556533623388390082:9070]
2025-10-02T08:09:47.965380Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:47.965397Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:47.965400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.965403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.965406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.965422Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:47.965427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:47.965434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:47.965496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.965511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.965514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:47.965517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:47.965583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:47.965593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.965607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:47.965620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:47.965646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533623388390028:9071], now have 1 active actors on pipe
2025-10-02T08:09:47.965659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533623388390076:9070]
2025-10-02T08:09:47.965660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 716
2025-10-02T08:09:47.965663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533623388390076:9070]
2025-10-02T08:09:47.965675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:47.965683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533623848560727:2378], now have 1 active actors on pipe
2025-10-02T08:09:47.965693Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:47.965695Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:47.965697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:47.965711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:47.965714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:47.965723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.965727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.965769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533623388390076:9070]
2025-10-02T08:09:47.965779Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:47.965762Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 716
2025-10-02T08:09:47.965793Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:47.965794Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:47.965800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:47.965803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:47.965805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:47.965815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:47.965823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:47.965865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.965959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:47.965967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:47.965982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:47.966029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 717 partition: 0 MaxSeqNo: 17 sessionId: src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0
2025-10-02T08:09:47.966445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ef8e477-d710f679-1816dbd-8b8e6081_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:47.969285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0] Write session: try to update token
2025-10-02T08:09:47.969308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:47.983708Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:47.983730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:47.983733Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:47.983741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533623388390076:9070]
2025-10-02T08:09:47.983745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533623388390076:9070]
2025-10-02T08:09:47.983785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:47.983804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:47.983807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:47.983825Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:47.983840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:47.983949Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:47.985144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId: src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:47.988246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:48.030026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533627683357403:8944]
2025-10-02T08:09:48.030219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 716, pipe: [1:7556533627683357403:8944]
2025-10-02T08:09:48.124493Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:09:48.124520Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-02T08:09:48.127762Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:48.127966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.127972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.128004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683357403:8944], now have 1 active actors on pipe
2025-10-02T08:09:48.128211Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:48.128462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533627683357403:8944]
2025-10-02T08:09:48.128471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:48.128521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 717 reason: status is not ok: tablet will be restarted right now sessionId: src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0
2025-10-02T08:09:48.128663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 717 sessionId: src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0 is DEAD
2025-10-02T08:09:48.128926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:48.128946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0] Write session will restart in 0.006282s
2025-10-02T08:09:48.128974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0] Write session: Do CDS request
2025-10-02T08:09:48.128981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:48.128449Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:48.128470Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-02T08:09:48.136475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:48.136754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:48.136773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 718
2025-10-02T08:09:48.138301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:48.138336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:48.138343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:48.138346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:48.138652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 718 sessionId:  describe result for acl check
2025-10-02T08:09:48.138682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:48.138688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:48.138690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:48.138695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533627683357444:9078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:48.139116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533627683357444:9078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:48.144553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533627683357444:9078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:48.147600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533627683357444:9078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:48.147618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533627683357444:9078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:48.147622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533627683357444:9078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:48.147629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:48.160776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:48.161502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:48.161816Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:48.161830Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:48.161842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:48.161900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:48.161938Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533627683358122:9077]
2025-10-02T08:09:48.162635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:48.162910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:48.162950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:48.163255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:48.163296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.163302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.163303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.163304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.163305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.163310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.163320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.163325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.163329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.163333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.163339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.163346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.163351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.163357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.163360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.163365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.163369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.163374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.163381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.163386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.163404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:48.174751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:48.176394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:48.176414Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:48.176418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:48.176422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:48.176430Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 717 [1:7556533627683358122:9077]
2025-10-02T08:09:48.176443Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:48.176462Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:48.176465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:48.176469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:48.176471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:48.176488Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:48.176500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:48.176507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:48.176570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.176579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.176583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:48.176585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:48.176657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:48.176672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.176687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.176701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:48.176717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533627683358116:9077]
2025-10-02T08:09:48.176720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533627683358116:9077]
2025-10-02T08:09:48.176727Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:48.176740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:48.176754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:48.176754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 717
2025-10-02T08:09:48.176764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:48.176775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683357859:9078], now have 1 active actors on pipe
2025-10-02T08:09:48.176776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:48.176782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:48.176836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533628143528031:2378], now have 1 active actors on pipe
2025-10-02T08:09:48.176846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.176851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.176865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533627683358116:9077]
2025-10-02T08:09:48.176931Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 717
2025-10-02T08:09:48.176876Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:48.176893Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:48.176909Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:48.176915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:48.176920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:48.176922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:48.176932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:48.176940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:48.176962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:48.177048Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:09:48.177108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.177110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.177123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:48.177153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 718 partition: 0 MaxSeqNo: 17 sessionId: src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0
2025-10-02T08:09:48.177500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594ee8a8-28907ef5-13da5b99-a6ac92e4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:48.177610Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 5 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:09:48.177657Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:09:48.180328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0] Write session: try to update token
2025-10-02T08:09:48.180354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:48.198327Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:48.198350Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:48.198353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:48.198361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533627683358116:9077]
2025-10-02T08:09:48.198365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533627683358116:9077]
2025-10-02T08:09:48.198407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:48.198406Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:48.198412Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:48.198413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.198415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:48.198564Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:48.206026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId: src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:48.209909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:48.228464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533627683358149:8944]
2025-10-02T08:09:48.228659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 717, pipe: [1:7556533627683358149:8944]
2025-10-02T08:09:48.347349Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:48.347959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.347976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.347996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683358149:8944], now have 1 active actors on pipe
2025-10-02T08:09:48.348116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:48.348129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:48.348198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 718 reason: error at write: Disconnected sessionId: src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0
2025-10-02T08:09:48.348218Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:48.348345Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:48.348393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 718 sessionId: src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0 is DEAD
2025-10-02T08:09:48.348565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533627683358149:8944]
2025-10-02T08:09:48.348935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:48.348953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0] Write session will restart in 0.009201s
2025-10-02T08:09:48.348986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0] Write session: Do CDS request
2025-10-02T08:09:48.348993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:48.359568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:48.360071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:48.360091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 719
2025-10-02T08:09:48.360327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:48.360377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:48.360387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:48.360392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:48.361860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 719 sessionId:  describe result for acl check
2025-10-02T08:09:48.361899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:48.361906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:48.361908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:48.361914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533627683358299:9085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:48.362433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533627683358299:9085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:48.369887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533627683358299:9085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:48.379071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533627683358299:9085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:48.379096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533627683358299:9085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:48.379100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533627683358299:9085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:48.379109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:48.388947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:48.394520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:48.394829Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:48.394846Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:48.394862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:48.394933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:48.394996Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533627683358872:9084]
2025-10-02T08:09:48.395819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:48.396176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:48.396237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:48.396621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:48.396696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.396707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.396708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.396710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.396711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.396719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.396732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.396736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.396741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.396746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.396753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.396768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.396778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.396791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.396797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.396821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.396834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.396840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.396847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.396853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.396873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:48.410096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:48.415208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:48.415241Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:48.415243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:48.415248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:48.415258Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 718 [1:7556533627683358872:9084]
2025-10-02T08:09:48.415275Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:48.415300Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:48.415304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:48.415307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:48.415310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:48.415331Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:48.415339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:48.415349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:48.415499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.415502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.415506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:48.415510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:48.415603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:48.415606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.415626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.415639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:48.415662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533627683358865:9084]
2025-10-02T08:09:48.415665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533627683358865:9084]
2025-10-02T08:09:48.415680Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:48.415702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:48.415720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:48.415723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:48.415775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533627683358865:9084]
2025-10-02T08:09:48.415778Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:48.416050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:48.416067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:48.416073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:48.416328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 718
2025-10-02T08:09:48.416338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683358741:9085], now have 1 active actors on pipe
2025-10-02T08:09:48.416401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533628143528040:2378], now have 1 active actors on pipe
2025-10-02T08:09:48.416413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.416421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.416457Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:48.416469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:48.416475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:48.416477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:48.416493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:48.416508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:48.416528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:48.416710Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 718
2025-10-02T08:09:48.416773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.416786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.416821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:48.416906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 719 partition: 0 MaxSeqNo: 17 sessionId: src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0
2025-10-02T08:09:48.417379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0c6f38-9ae53c34-499d8d55-847aba1e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:48.420420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0] Write session: try to update token
2025-10-02T08:09:48.420446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:48.434602Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:48.434638Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:48.434641Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:48.434654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533627683358865:9084]
2025-10-02T08:09:48.434660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533627683358865:9084]
2025-10-02T08:09:48.434719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:48.434732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.434739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:48.434740Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:48.434748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:48.434913Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:48.443713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId: src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:48.446384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:48.448587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533627683358900:8944]
2025-10-02T08:09:48.448690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 718, pipe: [1:7556533627683358900:8944]
2025-10-02T08:09:48.593012Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:48.594019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.594047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.594069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683358900:8944], now have 1 active actors on pipe
2025-10-02T08:09:48.594332Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:48.594300Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:48.594675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533627683358900:8944]
2025-10-02T08:09:48.594693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:48.594743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 719 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0
2025-10-02T08:09:48.594902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 719 sessionId: src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0 is DEAD
2025-10-02T08:09:48.595082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:48.595094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0] Write session will restart in 0.009233s
2025-10-02T08:09:48.595125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0] Write session: Do CDS request
2025-10-02T08:09:48.595133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:48.605709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:48.607888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:48.607902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 720
2025-10-02T08:09:48.608053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:48.608077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:48.608084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:48.608086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:48.608530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 720 sessionId:  describe result for acl check
2025-10-02T08:09:48.608562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:48.608563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:48.608565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:48.608570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533627683359509:9105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:48.609053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533627683359509:9105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:48.612482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533627683359509:9105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:48.614696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:48.617027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:48.617217Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:48.617228Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:48.617239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:48.617285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:48.617325Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533627683359668:9104]
2025-10-02T08:09:48.617978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:48.618140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533627683359509:9105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:48.618144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:48.618154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533627683359509:9105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:48.618157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533627683359509:9105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:48.618165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:48.618177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:48.618471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:48.618515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.618521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.618522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.618523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.618525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.618530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.618540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.618544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.618548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.618553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.618565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.618577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.618588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.618594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.618598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.618603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.618607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.618612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.618617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.618621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.618639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:48.627153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:48.628708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:48.628732Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:48.628735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:48.628740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:48.628747Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 719 [1:7556533627683359668:9104]
2025-10-02T08:09:48.628760Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:48.628783Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:48.628785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:48.628788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:48.628790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:48.628831Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:48.628844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:48.628850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:48.628920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.628928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.628931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:48.628934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:48.628999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:48.629007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.629021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.629042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:48.629056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 719
2025-10-02T08:09:48.629062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683359679:9105], now have 1 active actors on pipe
2025-10-02T08:09:48.629069Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533627683359662:9104]
2025-10-02T08:09:48.629071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533627683359662:9104]
2025-10-02T08:09:48.629082Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:48.629093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.629098Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:48.629101Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:48.629103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.629119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533628143528084:2378], now have 1 active actors on pipe
2025-10-02T08:09:48.629135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:48.629151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:48.629154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:48.629167Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 719
2025-10-02T08:09:48.629199Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:48.629210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:48.629214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:48.629216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:48.629225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:48.629233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:48.629241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533627683359662:9104]
2025-10-02T08:09:48.629249Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:48.629257Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:48.629283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:48.629328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.629336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.629350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:48.629393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 720 partition: 0 MaxSeqNo: 17 sessionId: src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0
2025-10-02T08:09:48.632941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6b3d1a0-799cd766-3a459efa-7adc648c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:48.635732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0] Write session: try to update token
2025-10-02T08:09:48.635758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:48.647418Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:48.647447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:48.647464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:48.647475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533627683359662:9104]
2025-10-02T08:09:48.647481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533627683359662:9104]
2025-10-02T08:09:48.647544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:48.647543Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:48.647551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:48.647553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.647556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:48.647723Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:48.661370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId: src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:48.665317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:48.694851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533627683359699:8944]
2025-10-02T08:09:48.695050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 719, pipe: [1:7556533627683359699:8944]
2025-10-02T08:09:48.802727Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:48.803308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.803330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.803356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683359699:8944], now have 1 active actors on pipe
2025-10-02T08:09:48.803592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533627683359699:8944]
2025-10-02T08:09:48.803627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:48.803633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:48.803656Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:48.803695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 720 reason: error at write: Disconnected sessionId: src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0
2025-10-02T08:09:48.803720Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:48.803839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 720 sessionId: src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0 is DEAD
2025-10-02T08:09:48.804041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:48.804057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0] Write session will restart in 0.006358s
2025-10-02T08:09:48.804087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0] Write session: Do CDS request
2025-10-02T08:09:48.804094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:48.811379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:48.811574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:48.811597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 721
2025-10-02T08:09:48.811752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:48.811801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:48.811814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:48.811819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:48.812576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 721 sessionId:  describe result for acl check
2025-10-02T08:09:48.812630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:48.812638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:48.812640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:48.812646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533627683360008:9111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:48.813301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533627683360008:9111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:48.817058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533627683360008:9111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:48.821358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533627683360008:9111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:48.821382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533627683360008:9111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:48.821386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533627683360008:9111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:48.821395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:48.829727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:48.831892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:48.832289Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:48.832298Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:48.832309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:48.832361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:48.832404Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533627683360422:9110]
2025-10-02T08:09:48.832875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:48.833056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:48.833096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:48.833314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:48.833353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.833358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.833359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.833360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.833361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.833366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.833376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.833381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.833384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.833388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.833393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.833404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:48.833410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.833418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:48.833423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.833433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:48.833438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.833448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.833457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.833465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.833485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:48.842725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:48.844409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:48.844430Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:48.844433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:48.844437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:48.844445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 720 [1:7556533627683360422:9110]
2025-10-02T08:09:48.844458Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:48.844478Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:48.844481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:48.844485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:48.844487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:48.844504Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:48.844509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:48.844515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:48.844585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.844594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.844597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:48.844600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:48.844664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:48.844672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.844684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:48.844699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:48.844721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533627683360416:9110]
2025-10-02T08:09:48.844727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533627683360416:9110]
2025-10-02T08:09:48.844738Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:48.844755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:48.844756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 720
2025-10-02T08:09:48.844758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683360277:9111], now have 1 active actors on pipe
2025-10-02T08:09:48.844765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533628143528090:2378], now have 1 active actors on pipe
2025-10-02T08:09:48.844767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:48.844769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:48.844782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:48.844786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:48.844793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.844796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.844894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533627683360416:9110]
2025-10-02T08:09:48.844904Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:48.844912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:48.844922Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:48.844929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:48.844932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:48.844934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:48.844910Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 720
2025-10-02T08:09:48.844944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:48.844957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:48.845003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:48.845075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:48.845087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:48.845101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:48.845141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 721 partition: 0 MaxSeqNo: 17 sessionId: src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0
2025-10-02T08:09:48.845526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af11a9-e683fc9b-6a0a00bf-3e4f8d04_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:48.848483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0] Write session: try to update token
2025-10-02T08:09:48.848505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:48.865688Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:48.865707Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:48.865709Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:48.865716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533627683360416:9110]
2025-10-02T08:09:48.865718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533627683360416:9110]
2025-10-02T08:09:48.865762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:48.865767Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:48.865770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:48.865771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:48.865772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:48.865917Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:48.870970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId: src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:48.873916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:48.903771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533627683360447:8944]
2025-10-02T08:09:48.903910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 720, pipe: [1:7556533627683360447:8944]
2025-10-02T08:09:49.002091Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:49.002531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.002548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.002591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533627683360447:8944], now have 1 active actors on pipe
2025-10-02T08:09:49.002698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533627683360447:8944]
2025-10-02T08:09:49.002731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:49.002734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:49.002841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:49.002795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 721 reason: error at write: Disconnected sessionId: src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0
2025-10-02T08:09:49.002812Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:49.002986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 721 sessionId: src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0 is DEAD
2025-10-02T08:09:49.003356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:49.003371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0] Write session will restart in 0.007013s
2025-10-02T08:09:49.003402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0] Write session: Do CDS request
2025-10-02T08:09:49.003409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:49.011362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.012098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:49.012116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 722
2025-10-02T08:09:49.012219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.012251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:49.012267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:49.012275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:49.012834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 722 sessionId:  describe result for acl check
2025-10-02T08:09:49.012869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:49.012871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:49.012872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:49.012878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533631978328141:9118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:49.013395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533631978328141:9118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:49.015872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533631978328141:9118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:49.019013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533631978328141:9118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:49.019031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533631978328141:9118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:49.019034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533631978328141:9118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:49.019043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:49.024965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:49.025448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:49.025641Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:49.025650Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:49.025659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:49.025705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:49.025745Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533631978328469:9117]
2025-10-02T08:09:49.026380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:49.026567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:49.026609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:49.026901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:49.026947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.026953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.026954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.026955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.026956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.026960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.026970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.026974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.026978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.026982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.026988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.026995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.027001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.027006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.027011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.027021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.027025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.027035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.027040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.027050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.027068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:49.035383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:49.037251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:49.037272Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:49.037274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:49.037278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:49.037284Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 721 [1:7556533631978328469:9117]
2025-10-02T08:09:49.037295Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:49.037312Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:49.037323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.037326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.037328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.037344Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:49.037348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:49.037355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:49.037414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.037422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.037426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:49.037428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:49.037493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:49.037501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.037514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.037524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:49.037540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533631978328463:9117]
2025-10-02T08:09:49.037541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533631978328463:9117]
2025-10-02T08:09:49.037548Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:49.037560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:49.037572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:49.037575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:49.037577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:49.037580Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:49.037584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978328395:9118], now have 1 active actors on pipe
2025-10-02T08:09:49.037612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533632438495394:2378], now have 1 active actors on pipe
2025-10-02T08:09:49.037619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533631978328463:9117]
2025-10-02T08:09:49.037629Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:49.037654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 721
2025-10-02T08:09:49.037654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:49.037668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.037673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.037696Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:49.037706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.037710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.037712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:49.037721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.037733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:49.037752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.037784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.037790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.037804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.037843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 722 partition: 0 MaxSeqNo: 17 sessionId: src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0
2025-10-02T08:09:49.037968Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 721
2025-10-02T08:09:49.038189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82882d96-e9522b44-4d33a5a6-a7a2a242_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:49.041235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0] Write session: try to update token
2025-10-02T08:09:49.041252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:49.057081Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:49.057106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:49.057108Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:49.057117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533631978328463:9117]
2025-10-02T08:09:49.057121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533631978328463:9117]
2025-10-02T08:09:49.057161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:49.057163Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:49.057168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.057169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:49.057170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:49.057318Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:49.058416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId: src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:49.061076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:49.102920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533631978328495:8944]
2025-10-02T08:09:49.103045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 721, pipe: [1:7556533631978328495:8944]
2025-10-02T08:09:49.195601Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:49.196067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.196080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.196116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978328495:8944], now have 1 active actors on pipe
2025-10-02T08:09:49.196303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533631978328495:8944]
2025-10-02T08:09:49.196343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:49.196345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:49.196318Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:49.196366Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:49.196416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 722 reason: error at write: Disconnected sessionId: src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0
2025-10-02T08:09:49.196604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 722 sessionId: src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0 is DEAD
2025-10-02T08:09:49.196783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:49.196793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0] Write session will restart in 0.006109s
2025-10-02T08:09:49.196833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0] Write session: Do CDS request
2025-10-02T08:09:49.196842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:49.204509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.204545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:49.204564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 723
2025-10-02T08:09:49.204748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.204780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:49.204784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:49.204787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:49.205218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 723 sessionId:  describe result for acl check
2025-10-02T08:09:49.205258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:49.205265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:49.205268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:49.205274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533631978328846:9124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:49.205825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533631978328846:9124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:49.208790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533631978328846:9124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:49.215928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533631978328846:9124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:49.215948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533631978328846:9124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:49.215952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533631978328846:9124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:49.215961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:49.218738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:49.220819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:49.221097Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:49.221110Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:49.221120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:49.221183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:49.221221Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533631978329222:9123]
2025-10-02T08:09:49.221830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:49.222035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:49.222087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:49.222421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:49.222476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.222481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.222483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.222484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.222485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.222490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.222500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.222508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.222512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.222515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.222525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.222532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.222538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.222543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.222549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.222554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.222558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.222563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.222567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.222572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.222587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:49.230816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:49.232677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:49.232694Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:49.232697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:49.232700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:49.232710Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 722 [1:7556533631978329222:9123]
2025-10-02T08:09:49.232722Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:49.232739Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:49.232742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.232745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.232747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.232764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:49.232774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:49.232780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:49.232853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.232859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.232862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:49.232864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:49.232923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:49.232935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.232946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.232956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:49.232973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978329176:9124], now have 1 active actors on pipe
2025-10-02T08:09:49.232980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533631978329216:9123]
2025-10-02T08:09:49.232982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533631978329216:9123]
2025-10-02T08:09:49.232989Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:49.232995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:49.232997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:49.233000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:49.233013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:49.233015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 722
2025-10-02T08:09:49.233021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:49.233026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533632438495400:2378], now have 1 active actors on pipe
2025-10-02T08:09:49.233056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.233064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.233076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533631978329216:9123]
2025-10-02T08:09:49.233093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:49.233098Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:49.233122Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:49.233132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.233111Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 722
2025-10-02T08:09:49.233137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.233143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:49.233153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.233161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:49.233187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.233229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.233235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.233247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.233279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 723 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0
2025-10-02T08:09:49.233598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|583bb630-2cc39ae8-9a8a2627-7221f747_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:49.236636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0] Write session: try to update token
2025-10-02T08:09:49.236654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:49.251018Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:49.251044Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:49.251047Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:49.251056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533631978329216:9123]
2025-10-02T08:09:49.251060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533631978329216:9123]
2025-10-02T08:09:49.251102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:49.251108Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:49.251108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:49.251114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.251116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:49.251297Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:49.256914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId: src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:49.259521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:49.296478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533631978329247:8944]
2025-10-02T08:09:49.296632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 722, pipe: [1:7556533631978329247:8944]
2025-10-02T08:09:49.391379Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:49.391853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.391862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.391885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978329247:8944], now have 1 active actors on pipe
2025-10-02T08:09:49.392067Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:49.392541Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:49.392868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:49.392879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0] Write session will restart in 0.009047s
2025-10-02T08:09:49.392399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533631978329247:8944]
2025-10-02T08:09:49.392414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:49.392904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0] Write session: Do CDS request
2025-10-02T08:09:49.392463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 723 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0
2025-10-02T08:09:49.392629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 723 sessionId: src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0 is DEAD
2025-10-02T08:09:49.392912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:49.403555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.403748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:49.403770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 724
2025-10-02T08:09:49.403942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.403998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:49.404009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:49.404013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:49.404451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 724 sessionId:  describe result for acl check
2025-10-02T08:09:49.404490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:49.404497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:49.404499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:49.404504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533631978329589:9130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:49.404974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533631978329589:9130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:49.409630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533631978329589:9130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:49.413744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533631978329589:9130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:49.413767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533631978329589:9130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:49.413771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533631978329589:9130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:49.413783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:49.424150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:49.424538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:49.424757Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:49.424769Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:49.424780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:49.424850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:49.424891Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533631978329982:9129]
2025-10-02T08:09:49.425491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:49.425690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:49.425736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:49.426031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:49.426088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.426095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.426096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.426098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.426099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.426104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.426114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.426123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.426127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.426136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.426143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.426154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.426163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.426168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.426177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.426186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.426194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.426199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.426208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.426213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.426231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:49.434501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:49.436373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:49.436390Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:49.436393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:49.436397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:49.436402Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 723 [1:7556533631978329982:9129]
2025-10-02T08:09:49.436414Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:49.436433Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:49.436436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.436440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.436442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.436456Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:49.436460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:49.436466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:49.436522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.436531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.436534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:49.436536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:49.436598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:49.436606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.436619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.436631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:49.436650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533632438495407:2378], now have 1 active actors on pipe
2025-10-02T08:09:49.436662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533631978329976:9129]
2025-10-02T08:09:49.436664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533631978329976:9129]
2025-10-02T08:09:49.436676Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:49.436689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978329845:9130], now have 1 active actors on pipe
2025-10-02T08:09:49.436696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:49.436709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:49.436711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:49.436712Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:49.436716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:49.436744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533631978329976:9129]
2025-10-02T08:09:49.436747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:49.436742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 723
2025-10-02T08:09:49.436754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:49.436794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 723
2025-10-02T08:09:49.436799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.436818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.436840Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:49.436846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.436850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.436852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:49.436860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.436869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:49.436885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.436904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.436912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.436925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.436965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 724 partition: 0 MaxSeqNo: 17 sessionId: src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0
2025-10-02T08:09:49.437314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c081d04-6ae4b20-e1043e96-8b78196d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:49.440311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0] Write session: try to update token
2025-10-02T08:09:49.440328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:49.448839Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:49.448860Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:49.448869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533631978329976:9129]
2025-10-02T08:09:49.448911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:49.448944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:49.449142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:49.449303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:49.449464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:49.449633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:49.449844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:49.449887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:49.461638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId: src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:49.464447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:49.464540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.464553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.464591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:49.464628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:49.464705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.464713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.464880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.464960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.465027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.465096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.465150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.465162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.465234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.465316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.465385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.465461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.465501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.465505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.465573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.465638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.465704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.465773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.465821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.465825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.465898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.465962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.466028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.466091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.466136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.466139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.466215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.466284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.466353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.466420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.466475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.466478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.466552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.466614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.466678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.466739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.466782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.466786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.466854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.466912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.466980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.467042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.467089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.467092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.467161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.467223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.467287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.467356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.467404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.467407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.467493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.467553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.467612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.467675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.467717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.467720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.467791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:49.467850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:49.467913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:49.467975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:49.468016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:49.468022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:49.468081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:49.468146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.468163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.468165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:49.468196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:49.468208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:49.468211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:49.468214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:49.468216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:49.468638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:49.468655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:49.468662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:49.468666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:49.468669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:49.468672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:49.469520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:49.469549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:49.469556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:49.469560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:49.469563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:49.469566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:49.470223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:49.470250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:49.470256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:49.470260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:49.470263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:49.472668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:49.472691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:49.472708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392589472
2025-10-02T08:09:49.472957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:49.472977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:49.472983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:49.472988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:49.472992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:49.472995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:49.473527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:49.473554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:49.473560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:49.473563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:49.473567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:49.473571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:49.474151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:49.474176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:49.474183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:49.474187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:49.474192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:49.474202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:49.474775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:49.474801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:49.474807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:49.476106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:49.476126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:49.476131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:49.476135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:49.476143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392589476
2025-10-02T08:09:49.476544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:49.476564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:49.476572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:49.476575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:49.476581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:49.476584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:49.477095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:49.477120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:49.477125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:49.477129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:49.477133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:49.477144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:49.477627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:49.477648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.477752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392589477
2025-10-02T08:09:49.483494Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:49.483529Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:49.483538Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:49.483547Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:49.483560Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:49.483568Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:49.483570Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:49.483578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533631978329976:9129]
2025-10-02T08:09:49.483582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533631978329976:9129]
2025-10-02T08:09:49.483616Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:49.483627Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:49.483659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:49.483669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.483672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:49.483815Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:49.492032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533631978330010:8944]
2025-10-02T08:09:49.492145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 723, pipe: [1:7556533631978330010:8944]
2025-10-02T08:09:49.626723Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:49.627121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978330010:8944], now have 1 active actors on pipe
2025-10-02T08:09:49.627249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:49.627261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:49.627290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 724 reason: error at write: Disconnected sessionId: src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0
2025-10-02T08:09:49.627324Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:49.627485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 724 sessionId: src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0 is DEAD
2025-10-02T08:09:49.627671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533631978330010:8944]
2025-10-02T08:09:49.627723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:49.627734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0] Write session will restart in 0.006765s
2025-10-02T08:09:49.627757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0] Write session: Do CDS request
2025-10-02T08:09:49.627763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:49.627492Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:49.631759Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [761744fff983b39d] Result# TEvPutResult {Id# [72075186224037892:723:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:49.631823Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:723:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:49.631894Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:723:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:49.635439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.635914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:49.635934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 725
2025-10-02T08:09:49.636104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.636139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:49.636149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:49.636153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:49.636823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 725 sessionId:  describe result for acl check
2025-10-02T08:09:49.636866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:49.636871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:49.636873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:49.636878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533631978330365:9152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:49.637408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533631978330365:9152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:49.639795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533631978330365:9152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:49.642547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533631978330365:9152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:49.642569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533631978330365:9152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:49.642573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533631978330365:9152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:49.642582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:49.652246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:49.654581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:49.654802Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:49.654811Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:49.654820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:49.654876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:49.654915Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533631978330798:9151]
2025-10-02T08:09:49.655576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:49.655811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:49.655882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:49.656197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:49.656252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.656259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.656260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.656261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.656262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.656267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.656274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.656276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.656278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.656280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.656284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.656288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.656292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.656295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.656297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.656300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.656302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.656305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.656307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.656310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.656326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:49.665106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:49.666971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:49.666997Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:49.666999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:49.667004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:49.667011Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 724 [1:7556533631978330798:9151]
2025-10-02T08:09:49.667021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:49.667036Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:49.667038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.667042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.667044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.667060Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:49.667074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:49.667086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:49.667155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.667161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.667163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:49.667165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:49.667216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:49.667222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.667231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.667242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:49.667254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533631978330792:9151]
2025-10-02T08:09:49.667256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533631978330792:9151]
2025-10-02T08:09:49.667261Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:49.667270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:49.667276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:49.667278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:49.667280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:49.667287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533632438495450:2378], now have 1 active actors on pipe
2025-10-02T08:09:49.667288Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:49.667314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533631978330792:9151]
2025-10-02T08:09:49.667320Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:49.667323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978330575:9152], now have 1 active actors on pipe
2025-10-02T08:09:49.667339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:49.667342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 724
2025-10-02T08:09:49.667360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.667369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.667391Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8fecb66-1b029b81-cc476a12-723b571c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:49.667400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.667403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.667404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:49.667391Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 724
2025-10-02T08:09:49.667411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.667418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:49.667434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.667486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.667493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.667502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.667530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 725 partition: 0 MaxSeqNo: 17 sessionId: src_id|c8fecb66-1b029b81-cc476a12-723b571c_0
2025-10-02T08:09:49.669020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dd683ca-1af3f9d1-abd5c4f7-ac48b135_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c8fecb66-1b029b81-cc476a12-723b571c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:49.672084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8fecb66-1b029b81-cc476a12-723b571c_0] Write session: try to update token
2025-10-02T08:09:49.672112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8fecb66-1b029b81-cc476a12-723b571c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:49.685166Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:49.685186Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:49.685189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:49.685197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533631978330792:9151]
2025-10-02T08:09:49.685202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533631978330792:9151]
2025-10-02T08:09:49.685243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:49.685250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.685252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:49.685403Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:49.688857Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:49.688877Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:49.694721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId: src_id|c8fecb66-1b029b81-cc476a12-723b571c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:49.697395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:49.728083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533631978330824:8944]
2025-10-02T08:09:49.728191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 724, pipe: [1:7556533631978330824:8944]
2025-10-02T08:09:49.827563Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:49.827971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.827983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.828017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978330824:8944], now have 1 active actors on pipe
2025-10-02T08:09:49.828147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533631978330824:8944]
2025-10-02T08:09:49.828173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:49.828175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:49.828230Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:49.828235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 725 reason: error at write: Disconnected sessionId: src_id|c8fecb66-1b029b81-cc476a12-723b571c_0
2025-10-02T08:09:49.828288Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:49.828398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 725 sessionId: src_id|c8fecb66-1b029b81-cc476a12-723b571c_0 is DEAD
2025-10-02T08:09:49.828613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8fecb66-1b029b81-cc476a12-723b571c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:49.828630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8fecb66-1b029b81-cc476a12-723b571c_0] Write session will restart in 0.008810s
2025-10-02T08:09:49.828676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8fecb66-1b029b81-cc476a12-723b571c_0] Write session: Do CDS request
2025-10-02T08:09:49.828683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8fecb66-1b029b81-cc476a12-723b571c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:49.838383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8fecb66-1b029b81-cc476a12-723b571c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.838563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:49.838590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 726
2025-10-02T08:09:49.838717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:49.838753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:49.838760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:49.838764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:49.839246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 726 sessionId:  describe result for acl check
2025-10-02T08:09:49.839292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:49.839301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:49.839303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:49.839310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533631978331293:9158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:49.839955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533631978331293:9158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:49.842788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533631978331293:9158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:49.846898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533631978331293:9158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:49.846932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533631978331293:9158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:49.846936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533631978331293:9158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:49.846946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:49.850055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:49.850608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:49.850782Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:49.850792Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:49.850800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:49.850850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:49.850902Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533631978331556:9157]
2025-10-02T08:09:49.851576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:49.851769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:49.851809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:49.852090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:49.852133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.852138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.852140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.852141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.852142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.852146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.852156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.852160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.852164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.852167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.852172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.852179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:49.852184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.852189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:49.852193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.852197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:49.852204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.852208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.852217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.852222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.852243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:49.860451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:49.862570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:49.862593Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:49.862595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:49.862599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:49.862606Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 725 [1:7556533631978331556:9157]
2025-10-02T08:09:49.862620Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:49.862640Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:49.862643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.862646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.862648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.862664Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:49.862676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:49.862682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:49.862766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.862774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.862777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:49.862780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:49.862850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:49.862858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.862873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:49.862884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:49.862909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978331537:9158], now have 1 active actors on pipe
2025-10-02T08:09:49.862920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533631978331550:9157]
2025-10-02T08:09:49.862925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 725
2025-10-02T08:09:49.862927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533631978331550:9157]
2025-10-02T08:09:49.862934Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:49.862946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:49.862957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:49.862948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533632438495457:2378], now have 1 active actors on pipe
2025-10-02T08:09:49.862972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:49.862990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:49.862998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:49.863005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.863009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.863050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533631978331550:9157]
2025-10-02T08:09:49.863062Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:49.863067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:49.863082Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a88aab66-46361712-bf812173-a6745809_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:49.863093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:49.863102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:49.863104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:49.863113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:49.863078Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 725
2025-10-02T08:09:49.863127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:49.863178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.863267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:49.863275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:49.863290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:49.863329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 726 partition: 0 MaxSeqNo: 17 sessionId: src_id|a88aab66-46361712-bf812173-a6745809_0
2025-10-02T08:09:49.863753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8fecb66-1b029b81-cc476a12-723b571c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a88aab66-46361712-bf812173-a6745809_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:49.866853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88aab66-46361712-bf812173-a6745809_0] Write session: try to update token
2025-10-02T08:09:49.866880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88aab66-46361712-bf812173-a6745809_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:49.875401Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:49.875419Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:49.875427Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533631978331550:9157]
2025-10-02T08:09:49.875480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:49.875482Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:49.875643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:49.875784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:49.875923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:49.876060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:49.876240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:49.876281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:49.892272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId: src_id|a88aab66-46361712-bf812173-a6745809_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:49.893452Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:49.893471Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:49.893473Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:49.893483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533631978331550:9157]
2025-10-02T08:09:49.893487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533631978331550:9157]
2025-10-02T08:09:49.893522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:49.893529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:49.893535Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:49.893536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:49.893538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:49.893681Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:49.894937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:49.928264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533631978331584:8944]
2025-10-02T08:09:49.928510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 725, pipe: [1:7556533631978331584:8944]
2025-10-02T08:09:50.034394Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:50.034920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.034935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.034956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533631978331584:8944], now have 1 active actors on pipe
2025-10-02T08:09:50.035061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533631978331584:8944]
2025-10-02T08:09:50.035083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:50.035085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:50.035139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 726 reason: error at write: Disconnected sessionId: src_id|a88aab66-46361712-bf812173-a6745809_0
2025-10-02T08:09:50.035766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88aab66-46361712-bf812173-a6745809_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:50.035781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88aab66-46361712-bf812173-a6745809_0] Write session will restart in 0.008564s
2025-10-02T08:09:50.035242Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:50.035810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88aab66-46361712-bf812173-a6745809_0] Write session: Do CDS request
2025-10-02T08:09:50.035817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88aab66-46361712-bf812173-a6745809_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:50.035321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 726 sessionId: src_id|a88aab66-46361712-bf812173-a6745809_0 is DEAD
2025-10-02T08:09:50.036886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:50.045973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88aab66-46361712-bf812173-a6745809_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.048998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:50.049016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 727
2025-10-02T08:09:50.052969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.053026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:50.053038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:50.053043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:50.054033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 727 sessionId:  describe result for acl check
2025-10-02T08:09:50.054072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:50.054074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:50.054075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:50.054080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533636273299278:9165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:50.054604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533636273299278:9165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:50.069686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533636273299278:9165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:50.079192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:50.081480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:50.081688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533636273299278:9165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:50.081706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533636273299278:9165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:50.081710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533636273299278:9165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:50.081719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:50.081837Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:50.081842Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:50.081855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:50.081917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:50.081951Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533636273299613:9164]
2025-10-02T08:09:50.082691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:50.082933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:50.082992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:50.083382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:50.083435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.083436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.083437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.083439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.083451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.083458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.083469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.083473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.083478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.083482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.083488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.083497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.083503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.083509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.083533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.083539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.083549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.083555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.083564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.083570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.083593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:50.093838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:50.095955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:50.095962Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:50.095964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:50.095969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:50.095975Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 726 [1:7556533636273299613:9164]
2025-10-02T08:09:50.095988Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:50.096006Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:50.096009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.096012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.096014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.096032Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:50.096037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:50.096046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:50.096109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.096111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.096114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:50.096116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:50.096196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:50.096199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.096213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.096224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:50.096242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533636273299603:9164]
2025-10-02T08:09:50.096244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533636273299603:9164]
2025-10-02T08:09:50.096252Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:50.096264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:50.096277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:50.096279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:50.096289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273299612:9165], now have 1 active actors on pipe
2025-10-02T08:09:50.096289Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:50.096293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:50.096327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533636273299603:9164]
2025-10-02T08:09:50.096330Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:50.096335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533636733462761:2378], now have 1 active actors on pipe
2025-10-02T08:09:50.096381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 726
2025-10-02T08:09:50.096454Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:50.096571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.096585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.096610Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7deaf565-12562dae-2c430e58-5a53421b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:50.096620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.096625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.096627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:50.096637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.096648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:50.096665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.096908Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 726
2025-10-02T08:09:50.096764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.096770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.096784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.096828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 727 partition: 0 MaxSeqNo: 17 sessionId: src_id|7deaf565-12562dae-2c430e58-5a53421b_0
2025-10-02T08:09:50.097451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88aab66-46361712-bf812173-a6745809_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7deaf565-12562dae-2c430e58-5a53421b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:50.100656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7deaf565-12562dae-2c430e58-5a53421b_0] Write session: try to update token
2025-10-02T08:09:50.100682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7deaf565-12562dae-2c430e58-5a53421b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:50.125552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId: src_id|7deaf565-12562dae-2c430e58-5a53421b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:50.126610Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:50.126646Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:50.126649Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:50.126658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533636273299603:9164]
2025-10-02T08:09:50.126664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533636273299603:9164]
2025-10-02T08:09:50.126716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:50.126731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.126733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:50.126884Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:50.128752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:50.128863Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:50.128895Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:50.135755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533636273299640:8944]
2025-10-02T08:09:50.137440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 726, pipe: [1:7556533636273299640:8944]
2025-10-02T08:09:50.294035Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:50.294580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.294601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.294623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273299640:8944], now have 1 active actors on pipe
2025-10-02T08:09:50.294886Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:50.295214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:50.295281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 727 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7deaf565-12562dae-2c430e58-5a53421b_0
2025-10-02T08:09:50.295483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 727 sessionId: src_id|7deaf565-12562dae-2c430e58-5a53421b_0 is DEAD
2025-10-02T08:09:50.295746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533636273299640:8944]
2025-10-02T08:09:50.295963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deaf565-12562dae-2c430e58-5a53421b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:50.295978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deaf565-12562dae-2c430e58-5a53421b_0] Write session will restart in 0.007832s
2025-10-02T08:09:50.296001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deaf565-12562dae-2c430e58-5a53421b_0] Write session: Do CDS request
2025-10-02T08:09:50.296011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deaf565-12562dae-2c430e58-5a53421b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:50.298647Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:50.305547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7deaf565-12562dae-2c430e58-5a53421b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.305631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:50.305655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 728
2025-10-02T08:09:50.305824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.305850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:50.305855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:50.305859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:50.306300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 728 sessionId:  describe result for acl check
2025-10-02T08:09:50.306330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:50.306332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:50.306334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:50.306339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533636273299656:9171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:50.306881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533636273299656:9171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:50.311552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533636273299656:9171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:50.317096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533636273299656:9171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:50.317117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533636273299656:9171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:50.317120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533636273299656:9171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:50.317148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:50.333040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:50.335450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:50.335667Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:50.335677Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:50.335687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:50.335735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:50.335778Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533636273300378:9170]
2025-10-02T08:09:50.336347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:50.336529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:50.336588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:50.336855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:50.336899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.336904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.336905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.336907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.336908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.336912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.336923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.336927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.336931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.336935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.336941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.336947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.336953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.336958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.336962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.336967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.336971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.336976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.336985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.336990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.337009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:50.345679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:50.347288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:50.347306Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:50.347309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:50.347312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:50.347318Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 727 [1:7556533636273300378:9170]
2025-10-02T08:09:50.347326Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:50.347341Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:50.347343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.347346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.347347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.347358Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:50.347363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:50.347369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:50.347415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.347422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.347424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:50.347426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:50.347501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:50.347509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.347518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.347525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:50.347537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533636273300372:9170]
2025-10-02T08:09:50.347544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533636273300372:9170]
2025-10-02T08:09:50.347550Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:50.347563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273299991:9171], now have 1 active actors on pipe
2025-10-02T08:09:50.347569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:50.347573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:50.347575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:50.347575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 727
2025-10-02T08:09:50.347591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:50.347593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:50.347628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533636733462768:2378], now have 1 active actors on pipe
2025-10-02T08:09:50.347640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.347645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.347658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533636273300372:9170]
2025-10-02T08:09:50.347666Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:50.347680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:50.347690Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:50.347696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.347706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.347713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:50.347722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.347737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:50.347757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.347828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.347838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.347851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.347885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 728 partition: 0 MaxSeqNo: 17 sessionId: src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0
2025-10-02T08:09:50.348313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deaf565-12562dae-2c430e58-5a53421b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:50.348946Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 727
2025-10-02T08:09:50.351097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0] Write session: try to update token
2025-10-02T08:09:50.351126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:50.366071Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:50.366093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:50.366096Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:50.366103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533636273300372:9170]
2025-10-02T08:09:50.366106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533636273300372:9170]
2025-10-02T08:09:50.366139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:50.366145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.366146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:50.366151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:50.366157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:50.366279Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:50.366835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId: src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:50.369571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:50.393669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533636273300403:8944]
2025-10-02T08:09:50.393785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 727, pipe: [1:7556533636273300403:8944]
2025-10-02T08:09:50.507779Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:50.508625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.508645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.508686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273300403:8944], now have 1 active actors on pipe
2025-10-02T08:09:50.508786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:50.508799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:50.508928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:50.508883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 728 reason: error at write: Disconnected sessionId: src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0
2025-10-02T08:09:50.508885Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:50.509079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 728 sessionId: src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0 is DEAD
2025-10-02T08:09:50.509217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:50.509226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0] Write session will restart in 0.008537s
2025-10-02T08:09:50.509245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0] Write session: Do CDS request
2025-10-02T08:09:50.509251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:50.509187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533636273300403:8944]
2025-10-02T08:09:50.519538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.519515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:50.519533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 729
2025-10-02T08:09:50.519880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.519914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:50.519924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:50.519928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:50.520523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 729 sessionId:  describe result for acl check
2025-10-02T08:09:50.520558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:50.520566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:50.520569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:50.520574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533636273300798:9178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:50.521114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533636273300798:9178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:50.524678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533636273300798:9178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:50.528414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533636273300798:9178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:50.528434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533636273300798:9178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:50.528436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533636273300798:9178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:50.528445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:50.532717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:50.535524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:50.535734Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:50.535747Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:50.535756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:50.535815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:50.535856Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533636273301150:9177]
2025-10-02T08:09:50.536467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:50.536692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:50.536738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:50.537038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:50.537088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.537094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.537095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.537096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.537097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.537102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.537112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.537115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.537118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.537121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.537127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.537133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.537139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.537143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.537147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.537151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.537155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.537159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.537163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.537168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.537186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:50.546008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:50.547976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:50.548005Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:50.548008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:50.548012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:50.548022Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 728 [1:7556533636273301150:9177]
2025-10-02T08:09:50.548037Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:50.548057Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:50.548065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.548069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.548071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.548089Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:50.548099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:50.548111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:50.548190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.548197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.548200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:50.548203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:50.548277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:50.548287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.548302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.548314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:50.548333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533636273301144:9177]
2025-10-02T08:09:50.548340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533636273301144:9177]
2025-10-02T08:09:50.548347Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:50.548362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:50.548367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:50.548370Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:50.548376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:50.548378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 728
2025-10-02T08:09:50.548379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:50.548390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273301062:9178], now have 1 active actors on pipe
2025-10-02T08:09:50.548394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533636733462777:2378], now have 1 active actors on pipe
2025-10-02T08:09:50.548429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.548439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.548453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533636273301144:9177]
2025-10-02T08:09:50.548466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:50.548476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:50.548500Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:50.548513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.548524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.548526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:50.548537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.548491Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 728
2025-10-02T08:09:50.548546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:50.548586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.548626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.548633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.548648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.548692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 729 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0
2025-10-02T08:09:50.549051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d76e7a3c-2ab77ec3-365a0000-d5a9a173_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:50.552084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0] Write session: try to update token
2025-10-02T08:09:50.552103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:50.568224Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:50.568245Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:50.568247Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:50.568255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533636273301144:9177]
2025-10-02T08:09:50.568259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533636273301144:9177]
2025-10-02T08:09:50.568306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:50.568311Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:50.568319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.568321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:50.568327Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:50.568467Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:50.595285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId: src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:50.597728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:50.609237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533636273301216:8944]
2025-10-02T08:09:50.609409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 728, pipe: [1:7556533636273301216:8944]
2025-10-02T08:09:50.700762Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:50.701258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.701271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.701289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273301216:8944], now have 1 active actors on pipe
2025-10-02T08:09:50.701431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533636273301216:8944]
2025-10-02T08:09:50.701461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:50.701464Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:50.701468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:50.701547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 729 reason: error at write: Disconnected sessionId: src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0
2025-10-02T08:09:50.701537Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:50.701727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 729 sessionId: src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0 is DEAD
2025-10-02T08:09:50.701863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:50.701874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0] Write session will restart in 0.005159s
2025-10-02T08:09:50.701900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0] Write session: Do CDS request
2025-10-02T08:09:50.701907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:50.708317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.708390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:50.708407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 730
2025-10-02T08:09:50.708512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.708542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:50.708551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:50.708555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:50.709047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 730 sessionId:  describe result for acl check
2025-10-02T08:09:50.709091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:50.709098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:50.709099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:50.709104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533636273301562:9197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:50.709630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533636273301562:9197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:50.712227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533636273301562:9197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:50.715857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533636273301562:9197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:50.715881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533636273301562:9197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:50.715885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533636273301562:9197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:50.715894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:50.723632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:50.724017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:50.724179Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:50.724190Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:50.724200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:50.724240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:50.724281Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533636273301964:9196]
2025-10-02T08:09:50.724916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:50.725086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:50.725125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:50.725402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:50.725442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.725447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.725448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.725449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.725450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.725455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.725464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.725468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.725472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.725476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.725481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.725492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.725497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.725506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.725513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.725518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.725526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.725530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.725539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.725543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.725559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:50.734020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:50.735924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:50.735945Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:50.735948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:50.735953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:50.735959Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 729 [1:7556533636273301964:9196]
2025-10-02T08:09:50.735972Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:50.735996Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:50.736004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.736007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.736010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.736024Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:50.736034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:50.736046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:50.736116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.736125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.736128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:50.736130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:50.736197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:50.736208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.736224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.736236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:50.736255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273301854:9197], now have 1 active actors on pipe
2025-10-02T08:09:50.736264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 729
2025-10-02T08:09:50.736266Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533636273301958:9196]
2025-10-02T08:09:50.736268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533636273301958:9196]
2025-10-02T08:09:50.736283Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:50.736294Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:50.736297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:50.736298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533636733462818:2378], now have 1 active actors on pipe
2025-10-02T08:09:50.736306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:50.736320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:50.736323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:50.736330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.736334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.736379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533636273301958:9196]
2025-10-02T08:09:50.736393Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:50.736397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:50.736408Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:50.736387Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 729
2025-10-02T08:09:50.736419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.736427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.736429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:50.736439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.736452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:50.736506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.736576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.736580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.736595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.736638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 730 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0
2025-10-02T08:09:50.737069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f775435-badf8ee1-f62ec748-74dc70c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:50.739987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0] Write session: try to update token
2025-10-02T08:09:50.740014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:50.756233Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:50.756258Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:50.756260Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:50.756270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533636273301958:9196]
2025-10-02T08:09:50.756275Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533636273301958:9196]
2025-10-02T08:09:50.756317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:50.756320Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:50.756325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.756326Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:50.756328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:50.756468Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:50.757200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId: src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:50.759799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:50.801733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533636273301988:8944]
2025-10-02T08:09:50.801932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 729, pipe: [1:7556533636273301988:8944]
2025-10-02T08:09:50.901071Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:50.902118Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:50.901669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.901687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.901728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273301988:8944], now have 1 active actors on pipe
2025-10-02T08:09:50.901952Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:50.902430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533636273301988:8944]
2025-10-02T08:09:50.902448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:50.902516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 730 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0
2025-10-02T08:09:50.902705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 730 sessionId: src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0 is DEAD
2025-10-02T08:09:50.902862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:50.902873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0] Write session will restart in 0.009075s
2025-10-02T08:09:50.902897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0] Write session: Do CDS request
2025-10-02T08:09:50.902904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:50.913392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.913504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:50.913521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 731
2025-10-02T08:09:50.913660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:50.913695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:50.913701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:50.913705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:50.914232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 731 sessionId:  describe result for acl check
2025-10-02T08:09:50.914261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:50.914262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:50.914264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:50.914268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533636273302311:9203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:50.914818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533636273302311:9203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:50.919488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533636273302311:9203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:50.930430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533636273302311:9203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:50.930449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533636273302311:9203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:50.930452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533636273302311:9203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:50.930461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:50.941201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:50.941721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:50.941917Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:50.941931Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:50.941941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:50.941994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:50.942037Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533636273302733:9202]
2025-10-02T08:09:50.942667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:50.942894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:50.942933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:50.943232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:50.943276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.943277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.943279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.943280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.943281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.943285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.943296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.943299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.943302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.943305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.943311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.943318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:50.943324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.943328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:50.943333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.943338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:50.943342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.943349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.943353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.943358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.943376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:50.955892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:50.957700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:50.957721Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:50.957723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:50.957727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:50.957734Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 730 [1:7556533636273302733:9202]
2025-10-02T08:09:50.957748Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:50.957765Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:50.957768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.957771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.957773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.957790Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:50.957795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:50.957805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:50.957859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.957866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.957869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:50.957872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:50.957927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:50.957934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.957948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:50.957964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:50.957985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533636273302727:9202]
2025-10-02T08:09:50.957991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533636273302727:9202]
2025-10-02T08:09:50.957998Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:50.958015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:50.958025Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:50.958032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:50.958035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:50.958039Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:50.958046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533636273302578:9203], now have 1 active actors on pipe
2025-10-02T08:09:50.958076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533636273302727:9202]
2025-10-02T08:09:50.958087Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:50.958091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533636733462827:2378], now have 1 active actors on pipe
2025-10-02T08:09:50.958096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.958099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:50.958101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.958144Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75895f26-83e943bb-d8d30699-3212824c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:50.958155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:50.958163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:50.958165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:50.958139Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 730
2025-10-02T08:09:50.958175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:50.958187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:50.958212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.958266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 730
2025-10-02T08:09:50.958308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:50.958311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:50.958326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:50.958366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 731 partition: 0 MaxSeqNo: 17 sessionId: src_id|75895f26-83e943bb-d8d30699-3212824c_0
2025-10-02T08:09:50.958751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9589eb9-a1da11d6-d2331f15-9e71d0e3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|75895f26-83e943bb-d8d30699-3212824c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:50.961652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75895f26-83e943bb-d8d30699-3212824c_0] Write session: try to update token
2025-10-02T08:09:50.961668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75895f26-83e943bb-d8d30699-3212824c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:50.978416Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:50.978440Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:50.978443Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:50.978451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533636273302727:9202]
2025-10-02T08:09:50.978456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533636273302727:9202]
2025-10-02T08:09:50.978503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:50.978510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:50.978511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:50.978680Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:50.980681Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:50.980702Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:50.991017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId: src_id|75895f26-83e943bb-d8d30699-3212824c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:50.994033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:51.002421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533640568270053:8944]
2025-10-02T08:09:51.003021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 730, pipe: [1:7556533640568270053:8944]
2025-10-02T08:09:51.135209Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:51.136395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.136411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.136436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568270053:8944], now have 1 active actors on pipe
2025-10-02T08:09:51.137031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:51.137048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:51.137120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 731 reason: error at write: Disconnected sessionId: src_id|75895f26-83e943bb-d8d30699-3212824c_0
2025-10-02T08:09:51.137209Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:51.137323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 731 sessionId: src_id|75895f26-83e943bb-d8d30699-3212824c_0 is DEAD
2025-10-02T08:09:51.137487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533640568270053:8944]
2025-10-02T08:09:51.137838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75895f26-83e943bb-d8d30699-3212824c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:51.137850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75895f26-83e943bb-d8d30699-3212824c_0] Write session will restart in 0.009625s
2025-10-02T08:09:51.137879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75895f26-83e943bb-d8d30699-3212824c_0] Write session: Do CDS request
2025-10-02T08:09:51.137889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75895f26-83e943bb-d8d30699-3212824c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:51.140898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:51.148439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75895f26-83e943bb-d8d30699-3212824c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:51.149113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:51.149134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 732
2025-10-02T08:09:51.149282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:51.149324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:51.149335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:51.149339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:51.149836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 732 sessionId:  describe result for acl check
2025-10-02T08:09:51.149879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:51.149887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:51.149889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:51.149896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533640568270361:9210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:51.150502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533640568270361:9210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:51.155222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533640568270361:9210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:51.160114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533640568270361:9210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:51.160141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533640568270361:9210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:51.160146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533640568270361:9210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:51.160161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:51.175712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:51.178006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:51.178226Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:51.178237Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:51.178247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:51.178299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:51.178342Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533640568270799:9209]
2025-10-02T08:09:51.178899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:51.179108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:51.179155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:51.179423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:51.179481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.179487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.179488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.179490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.179490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.179496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.179505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.179509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.179513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.179520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.179525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.179533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.179544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.179548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.179556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.179561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.179567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.179571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.179580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.179585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.179611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:51.188416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:51.190199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:51.190217Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:51.190220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:51.190224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:51.190232Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 731 [1:7556533640568270799:9209]
2025-10-02T08:09:51.190244Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:51.190262Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:51.190270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.190273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.190276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.190293Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:51.190297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:51.190304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:51.190367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.190375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.190378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:51.190380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:51.190447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:51.190458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.190475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.190484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:51.190503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568270493:9210], now have 1 active actors on pipe
2025-10-02T08:09:51.190514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533640568270793:9209]
2025-10-02T08:09:51.190518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 731
2025-10-02T08:09:51.190521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533640568270793:9209]
2025-10-02T08:09:51.190529Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:51.190540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:51.190543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533641028430131:2378], now have 1 active actors on pipe
2025-10-02T08:09:51.190548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:51.190552Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:51.190562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:51.190565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:51.190571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.190579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.190623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533640568270793:9209]
2025-10-02T08:09:51.190632Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:51.190615Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 731
2025-10-02T08:09:51.190647Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de4fd252-63038924-d73b815-76db2194_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:51.190654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:51.190660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.190664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.190666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:51.190675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.190683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:51.190726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:51.190780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.190787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.190800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:51.190838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 732 partition: 0 MaxSeqNo: 17 sessionId: src_id|de4fd252-63038924-d73b815-76db2194_0
2025-10-02T08:09:51.191307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75895f26-83e943bb-d8d30699-3212824c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de4fd252-63038924-d73b815-76db2194_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:51.194470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de4fd252-63038924-d73b815-76db2194_0] Write session: try to update token
2025-10-02T08:09:51.194496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de4fd252-63038924-d73b815-76db2194_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:51.201874Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:51.201898Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:51.201909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533640568270793:9209]
2025-10-02T08:09:51.201956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:51.201970Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:51.202171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:51.202332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:51.202495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:51.202650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:51.202993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:51.203043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:51.211365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId: src_id|de4fd252-63038924-d73b815-76db2194_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:51.213980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:51.214082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.214096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.214132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:51.214156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:51.214350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.214381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.214602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.214673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.214749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.214822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.215145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.215160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.215231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.215298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.215365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.215458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.215509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.215522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.215599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.215669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.215739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.215811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.215863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.215871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.215938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.216008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.216077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.216149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.216201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.216209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.216272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.216338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.216401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.216470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.216518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.216527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.216597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.216672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.216742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.216839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.216894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.216903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.216977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.217047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.217120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.217202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.217259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.217268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.217339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.217409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.217482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.217552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.217603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.217612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.217685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.217757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.217826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.217896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.217950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.217957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.218025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.218093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.218161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.218239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.218289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.218292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.218361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:51.218429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.218457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.218459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:51.218491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:51.218510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:51.218518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:51.218522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:51.218526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:51.218965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:51.218996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:51.219008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:51.219012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:51.219018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:51.219022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:51.219767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:51.219797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:51.219805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:51.219812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:51.219816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:51.219819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:51.220357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:51.220386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:51.220391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:51.220401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:51.220405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:51.221852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:51.221877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:51.221891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392591221
2025-10-02T08:09:51.222102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:51.222112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:51.222118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:51.222124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:51.222128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:51.222132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:51.222677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:51.222694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:51.222700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:51.222708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:51.222712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:51.222716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:51.223300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:51.223315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:51.223324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:51.223327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:51.223331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:51.223335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:51.223939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:51.223955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:51.223962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:51.225475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:51.225501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:51.225506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:51.225511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:51.225521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392591225
2025-10-02T08:09:51.225867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:51.225895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:51.225913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:51.225922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:51.225926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:51.225930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:51.226476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:51.226501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:51.226512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:51.226520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:51.226524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:51.226530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:51.227055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:51.227084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.227227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392591227
2025-10-02T08:09:51.229924Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:51.229958Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:51.229967Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:51.229976Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:51.229988Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:51.229993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:51.229996Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:51.230008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533640568270793:9209]
2025-10-02T08:09:51.230011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533640568270793:9209]
2025-10-02T08:09:51.230072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:51.230089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:51.230099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:51.230109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.230111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:51.230264Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:51.237466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533640568270825:8944]
2025-10-02T08:09:51.237605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 731, pipe: [1:7556533640568270825:8944]
2025-10-02T08:09:51.382214Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:51.382585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568270825:8944], now have 1 active actors on pipe
2025-10-02T08:09:51.382741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:51.382749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:51.382775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 732 reason: error at write: Disconnected sessionId: src_id|de4fd252-63038924-d73b815-76db2194_0
2025-10-02T08:09:51.382838Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:51.383145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4fd252-63038924-d73b815-76db2194_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:51.383118Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:51.383161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4fd252-63038924-d73b815-76db2194_0] Write session will restart in 0.007817s
2025-10-02T08:09:51.382954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 732 sessionId: src_id|de4fd252-63038924-d73b815-76db2194_0 is DEAD
2025-10-02T08:09:51.383132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533640568270825:8944]
2025-10-02T08:09:51.383211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4fd252-63038924-d73b815-76db2194_0] Write session: Do CDS request
2025-10-02T08:09:51.383218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4fd252-63038924-d73b815-76db2194_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:51.388071Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [5d98ddad766a783c] Result# TEvPutResult {Id# [72075186224037892:731:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:51.388142Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:731:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:51.388245Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:731:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:51.392603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de4fd252-63038924-d73b815-76db2194_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:51.392570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:51.392593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 733
2025-10-02T08:09:51.392911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:51.392970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:51.392976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:51.392981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:51.393480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 733 sessionId:  describe result for acl check
2025-10-02T08:09:51.393524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:51.393526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:51.393528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:51.393533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533640568271114:9216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:51.394274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533640568271114:9216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:51.397244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533640568271114:9216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:51.400725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533640568271114:9216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:51.400742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533640568271114:9216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:51.400745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533640568271114:9216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:51.400754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:51.414374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:51.421514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:51.421787Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:51.421802Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:51.421815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:51.421886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:51.422122Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533640568271581:9215]
2025-10-02T08:09:51.422746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:51.422957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:51.422992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:51.423211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:51.423248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.423254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.423254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.423255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.423256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.423260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.423269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.423274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.423277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.423281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.423286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.423293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.423299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.423305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.423309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.423312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.423315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.423318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.423321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.423327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.423347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:51.432164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:51.433883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:51.433908Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:51.433912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:51.433916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:51.433924Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 732 [1:7556533640568271581:9215]
2025-10-02T08:09:51.433937Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:51.433956Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:51.433959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.433963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.433965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.433984Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:51.433997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:51.434004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:51.434073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.434082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.434086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:51.434088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:51.434160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:51.434171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.434186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.434197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:51.434214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 732
2025-10-02T08:09:51.434217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568271298:9216], now have 1 active actors on pipe
2025-10-02T08:09:51.434220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533641028430137:2378], now have 1 active actors on pipe
2025-10-02T08:09:51.434227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533640568271573:9215]
2025-10-02T08:09:51.434230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533640568271573:9215]
2025-10-02T08:09:51.434245Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:51.434259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.434262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.434269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:51.434274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:51.434279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:51.434294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:51.434299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:51.434347Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69085da-449874ba-53f80844-f9dfa9f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:51.434360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.434363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.434365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:51.434375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.434388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:51.434405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533640568271573:9215]
2025-10-02T08:09:51.434373Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 732
2025-10-02T08:09:51.434415Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:51.434424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:51.434439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:51.434491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.434500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.434515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:51.434561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 733 partition: 0 MaxSeqNo: 17 sessionId: src_id|69085da-449874ba-53f80844-f9dfa9f4_0
2025-10-02T08:09:51.434917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de4fd252-63038924-d73b815-76db2194_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|69085da-449874ba-53f80844-f9dfa9f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:51.438029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69085da-449874ba-53f80844-f9dfa9f4_0] Write session: try to update token
2025-10-02T08:09:51.438046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69085da-449874ba-53f80844-f9dfa9f4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:51.454370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId: src_id|69085da-449874ba-53f80844-f9dfa9f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:51.456974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:51.457053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.457067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.457103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:51.457132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:51.457201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.457224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.457416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.457498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.457571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.457641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.457687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.457694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.457760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.457824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.457893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.457963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.458014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.458021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.458087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.458150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.458218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.458288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.458336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.458342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.458402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.458461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.458525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.458589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.458638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.458644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.458706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.458766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.458830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.458897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.458940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.458945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.459013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.459075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.459134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.459196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.459264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.459270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.459340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.459417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.459506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.459571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.459616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.459621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.459685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.459743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.459804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.459868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.459915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.459920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.459982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.460055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.460119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.460177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.460222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.460231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.460299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:51.460365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:51.460435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:51.460499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:51.460554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:51.460562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:51.460627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:51.460677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.460692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.460698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:51.460726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:51.460739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:51.460746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:51.460747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:51.460749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:51.461198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:51.461224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:51.461228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:51.461230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:51.461232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:51.461234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:51.461803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:51.461827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:51.461832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:51.461834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:51.461836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:51.461838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:51.462435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:51.462462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:51.462468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:51.462471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:51.462475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:51.470782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:51.470820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:51.470838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392591470
2025-10-02T08:09:51.471032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:51.471057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:51.471070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:51.471078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:51.471084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:51.471088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:51.471637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:51.471665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:51.471672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:51.471676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:51.471679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:51.471684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:51.472218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:51.472244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:51.472262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:51.472270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:51.472274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:51.472277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:51.472782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:51.472825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:51.472838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:51.474155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:51.474180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:51.474186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:51.474190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:51.474200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392591473
2025-10-02T08:09:51.474547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:51.474573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:51.474580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:51.474587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:51.474591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:51.474594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:51.475173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:51.475188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:51.475195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:51.475199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:51.475202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:51.475205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:51.475836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:51.475860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.476014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392591475
2025-10-02T08:09:51.482585Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:51.482629Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:51.482640Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:51.482649Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:51.482666Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:51.482669Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:51.482674Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:51.482683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533640568271573:9215]
2025-10-02T08:09:51.482692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533640568271573:9215]
2025-10-02T08:09:51.482744Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:51.482762Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:51.483222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533640568271605:8944]
2025-10-02T08:09:51.483344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 732, pipe: [1:7556533640568271605:8944]
2025-10-02T08:09:51.490150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:51.490179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.490182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:51.490341Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:51.632437Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:51.632736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568271605:8944], now have 1 active actors on pipe
2025-10-02T08:09:51.632751Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:51.632753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:51.632762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533640568271573:9215]
2025-10-02T08:09:51.632839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:51.633005Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:51.633077Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:51.633335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:51.633366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 733 reason: status is not ok: tablet will be restarted right now sessionId: src_id|69085da-449874ba-53f80844-f9dfa9f4_0
2025-10-02T08:09:51.633535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 733 sessionId: src_id|69085da-449874ba-53f80844-f9dfa9f4_0 is DEAD
2025-10-02T08:09:51.633671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533640568271605:8944]
2025-10-02T08:09:51.633967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69085da-449874ba-53f80844-f9dfa9f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:51.633985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69085da-449874ba-53f80844-f9dfa9f4_0] Write session will restart in 0.005281s
2025-10-02T08:09:51.634011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69085da-449874ba-53f80844-f9dfa9f4_0] Write session: Do CDS request
2025-10-02T08:09:51.634019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69085da-449874ba-53f80844-f9dfa9f4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:51.638093Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [51d2ca45df547b6e] Result# TEvPutResult {Id# [72075186224037892:732:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:51.638119Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:732:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:51.638193Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:732:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:51.640366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69085da-449874ba-53f80844-f9dfa9f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:51.640420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:51.640434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 734
2025-10-02T08:09:51.640558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:51.640599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:51.640607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:51.640612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:51.641874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 734 sessionId:  describe result for acl check
2025-10-02T08:09:51.641918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:51.641924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:51.641926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:51.641932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533640568271779:9230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:51.642416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533640568271779:9230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:51.645540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533640568271779:9230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:51.648594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533640568271779:9230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:51.648621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533640568271779:9230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:51.648624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533640568271779:9230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:51.648632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:51.659328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:51.659808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:51.659979Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:51.659988Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:51.659997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:51.660035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:51.660067Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533640568272404:9229]
2025-10-02T08:09:51.660627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:51.660843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:51.660885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:51.661172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:51.661221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.661227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.661228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.661228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.661229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.661234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.661244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.661248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.661252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.661256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.661262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.661269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.661276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.661280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.661284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.661290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.661294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.661304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.661309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.661319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.661338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:51.669903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:51.671975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:51.671999Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:51.672001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:51.672004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:51.672011Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 733 [1:7556533640568272404:9229]
2025-10-02T08:09:51.672022Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:51.672041Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:51.672045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.672048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.672050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.672067Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:51.672072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:51.672079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:51.672146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.672157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.672160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:51.672163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:51.672230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:51.672244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.672257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.672269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:51.672289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568272168:9230], now have 1 active actors on pipe
2025-10-02T08:09:51.672296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533640568272398:9229]
2025-10-02T08:09:51.672302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 733
2025-10-02T08:09:51.672303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533640568272398:9229]
2025-10-02T08:09:51.672310Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:51.672320Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:51.672321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533641028430172:2378], now have 1 active actors on pipe
2025-10-02T08:09:51.672323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:51.672329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:51.672341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:51.672350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:51.672356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.672360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.672406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533640568272398:9229]
2025-10-02T08:09:51.672418Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:51.672403Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 733
2025-10-02T08:09:51.672436Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f47502fb-453c89eb-680ae068-20ef28e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:51.672448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.672451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.672453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:51.672462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.672467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:51.672471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:51.672505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:51.672598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.672607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.672621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:51.672660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 734 partition: 0 MaxSeqNo: 17 sessionId: src_id|f47502fb-453c89eb-680ae068-20ef28e4_0
2025-10-02T08:09:51.673016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69085da-449874ba-53f80844-f9dfa9f4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f47502fb-453c89eb-680ae068-20ef28e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:51.676293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f47502fb-453c89eb-680ae068-20ef28e4_0] Write session: try to update token
2025-10-02T08:09:51.676315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f47502fb-453c89eb-680ae068-20ef28e4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:51.694293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId: src_id|f47502fb-453c89eb-680ae068-20ef28e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:51.696128Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:51.696132Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:51.696135Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:51.696143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533640568272398:9229]
2025-10-02T08:09:51.696147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533640568272398:9229]
2025-10-02T08:09:51.696197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:51.696204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.696206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:51.696350Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:51.697787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:51.698261Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:51.698274Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:51.733597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533640568272436:8944]
2025-10-02T08:09:51.733760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 733, pipe: [1:7556533640568272436:8944]
2025-10-02T08:09:51.834250Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:51.834511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.834524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.834568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568272436:8944], now have 1 active actors on pipe
2025-10-02T08:09:51.834679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:51.834687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:51.834751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 734 reason: error at write: Disconnected sessionId: src_id|f47502fb-453c89eb-680ae068-20ef28e4_0
2025-10-02T08:09:51.834809Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:51.834820Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:51.835145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47502fb-453c89eb-680ae068-20ef28e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:51.835161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47502fb-453c89eb-680ae068-20ef28e4_0] Write session will restart in 0.006245s
2025-10-02T08:09:51.835188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47502fb-453c89eb-680ae068-20ef28e4_0] Write session: Do CDS request
2025-10-02T08:09:51.835196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47502fb-453c89eb-680ae068-20ef28e4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:51.834942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 734 sessionId: src_id|f47502fb-453c89eb-680ae068-20ef28e4_0 is DEAD
2025-10-02T08:09:51.835164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533640568272436:8944]
2025-10-02T08:09:51.842460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f47502fb-453c89eb-680ae068-20ef28e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:51.842555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:51.842588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 735
2025-10-02T08:09:51.842730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:51.842763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:51.842773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:51.842778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:51.843234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 735 sessionId:  describe result for acl check
2025-10-02T08:09:51.843280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:51.843282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:51.843284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:51.843291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533640568272782:9241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:51.843822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533640568272782:9241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:51.846685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533640568272782:9241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:51.849369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533640568272782:9241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:51.849389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533640568272782:9241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:51.849393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533640568272782:9241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:51.849401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:51.855663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:51.857272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:51.857496Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:51.857507Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:51.857517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:51.857570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:51.857608Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533640568273187:9240]
2025-10-02T08:09:51.858233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:51.858398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:51.858429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:51.858685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:51.858724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.858729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.858729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.858730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.858731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.858734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.858741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.858743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.858745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.858747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.858751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.858755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:51.858759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.858762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:51.858765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.858767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:51.858772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.858774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.858777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.858779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.858790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:51.866711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:51.868509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:51.868530Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:51.868533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:51.868537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:51.868545Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 734 [1:7556533640568273187:9240]
2025-10-02T08:09:51.868557Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:51.868574Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:51.868582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.868585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.868587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.868605Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:51.868614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:51.868621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:51.868683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.868690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.868693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:51.868696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:51.868759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:51.868766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.868780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:51.868796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:51.868833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533640568273181:9240]
2025-10-02T08:09:51.868840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533640568273181:9240]
2025-10-02T08:09:51.868847Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:51.868856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:51.868859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:51.868862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 734
2025-10-02T08:09:51.868863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568273023:9241], now have 1 active actors on pipe
2025-10-02T08:09:51.868870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:51.868888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:51.868895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:51.868900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533641028430188:2378], now have 1 active actors on pipe
2025-10-02T08:09:51.868905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.868913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.868950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533640568273181:9240]
2025-10-02T08:09:51.868957Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:51.868935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 734
2025-10-02T08:09:51.868968Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:51.868972Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:51.868979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:51.868983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:51.868985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:51.868995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:51.869007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:51.869050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:51.869108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:51.869114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:51.869125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:51.869163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 735 partition: 0 MaxSeqNo: 17 sessionId: src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0
2025-10-02T08:09:51.869543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f47502fb-453c89eb-680ae068-20ef28e4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:51.872359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0] Write session: try to update token
2025-10-02T08:09:51.872382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:51.886346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId: src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:51.886513Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:51.886527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:51.886530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:51.886537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533640568273181:9240]
2025-10-02T08:09:51.886541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533640568273181:9240]
2025-10-02T08:09:51.886581Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:51.886583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:51.886589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:51.886591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:51.886591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:51.886722Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:51.888955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:51.935330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533640568273214:8944]
2025-10-02T08:09:51.935455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 734, pipe: [1:7556533640568273214:8944]
2025-10-02T08:09:52.045963Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:52.046801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.046810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.046853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533640568273214:8944], now have 1 active actors on pipe
2025-10-02T08:09:52.048218Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:52.047525Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:52.048069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533640568273214:8944]
2025-10-02T08:09:52.048087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:52.048152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 735 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0
2025-10-02T08:09:52.048346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 735 sessionId: src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0 is DEAD
2025-10-02T08:09:52.048732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:52.048743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0] Write session will restart in 0.005778s
2025-10-02T08:09:52.048771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0] Write session: Do CDS request
2025-10-02T08:09:52.048778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:52.055394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.055634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:52.055654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 736
2025-10-02T08:09:52.055844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.055877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:52.055887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:52.055891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:52.056784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 736 sessionId:  describe result for acl check
2025-10-02T08:09:52.056845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:52.056851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:52.056852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:52.056857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533644863240817:9248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:52.057415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533644863240817:9248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:52.061359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533644863240817:9248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:52.072132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533644863240817:9248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:52.072153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533644863240817:9248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:52.072156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533644863240817:9248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:52.072167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:52.078815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:52.081822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:52.082040Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:52.082054Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:52.082090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:52.082150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:52.082189Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533644863241276:9247]
2025-10-02T08:09:52.082805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:52.082995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:52.083036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:52.083327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:52.083373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.083379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.083380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.083381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.083382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.083386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.083395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.083399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.083402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.083406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.083411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.083418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.083423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.083440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.083448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.083453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.083458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.083462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.083466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.083471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.083488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:52.097636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:52.100084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:52.100110Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:52.100112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:52.100116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:52.100123Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 735 [1:7556533644863241276:9247]
2025-10-02T08:09:52.100136Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:52.100156Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:52.100159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.100161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.100163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.100180Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:52.100190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:52.100201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:52.100276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.100283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.100288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:52.100290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:52.100356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:52.100363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.100377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.100392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:52.100410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533644863241260:9247]
2025-10-02T08:09:52.100416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533644863241260:9247]
2025-10-02T08:09:52.100424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:52.100441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:52.100457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:52.100464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:52.100465Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:52.100467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:52.100475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241148:9248], now have 1 active actors on pipe
2025-10-02T08:09:52.100508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533644863241260:9247]
2025-10-02T08:09:52.100517Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:52.100524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533645323397492:2378], now have 1 active actors on pipe
2025-10-02T08:09:52.100567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 735
2025-10-02T08:09:52.100619Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:52.100726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.100738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.100760Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:52.100771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.100779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.100781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:52.100790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.100821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:52.100837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.100869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.101132Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 735
2025-10-02T08:09:52.100871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.100884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.100919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 736 partition: 0 MaxSeqNo: 17 sessionId: src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0
2025-10-02T08:09:52.101346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c701bfdc-3e0df8ac-1dd504c8-1113b7f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:52.104409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0] Write session: try to update token
2025-10-02T08:09:52.104432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:52.124115Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:52.124140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:52.124143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:52.124152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533644863241260:9247]
2025-10-02T08:09:52.124156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533644863241260:9247]
2025-10-02T08:09:52.124198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:52.124203Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:52.124205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.124207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:52.124208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:52.124358Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:52.126539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId: src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:52.129231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:52.148284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533644863241302:8944]
2025-10-02T08:09:52.148371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 735, pipe: [1:7556533644863241302:8944]
2025-10-02T08:09:52.262216Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:52.262505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.262519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.262552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241302:8944], now have 1 active actors on pipe
2025-10-02T08:09:52.263006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:52.263018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:52.263079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 736 reason: error at write: Disconnected sessionId: src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0
2025-10-02T08:09:52.263114Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:52.263100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:52.263231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 736 sessionId: src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0 is DEAD
2025-10-02T08:09:52.263404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:52.263436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0] Write session will restart in 0.005828s
2025-10-02T08:09:52.263404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533644863241302:8944]
2025-10-02T08:09:52.263460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0] Write session: Do CDS request
2025-10-02T08:09:52.263467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:52.270369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.270413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:52.270449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:52.270454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 737
2025-10-02T08:09:52.270639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.270677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:52.270684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:52.270687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:52.271050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 737 sessionId:  describe result for acl check
2025-10-02T08:09:52.271078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:52.271079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:52.271080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:52.271084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533644863241361:9255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:52.271542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533644863241361:9255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:52.272542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:52.272758Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:52.272767Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:52.272777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:52.272844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:52.272882Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533644863241380:9253]
2025-10-02T08:09:52.273423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:52.273620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:52.273673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:52.273986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:52.274026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.274031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.274032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.274033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.274034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.274040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.274050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.274054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.274057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.274059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.274062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.274067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.274074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.274077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.274080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.274083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.274085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.274088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.274091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.274094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.274106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:52.274204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533644863241361:9255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:52.279921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533644863241361:9255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:52.279942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533644863241361:9255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:52.279947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533644863241361:9255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:52.279955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:52.282149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:52.283867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:52.283893Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:52.283896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:52.283900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:52.283908Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 736 [1:7556533644863241380:9253]
2025-10-02T08:09:52.283921Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:52.283940Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:52.283943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.283946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.283949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.283965Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:52.283970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:52.283976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:52.284045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.284053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.284056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:52.284059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:52.284128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:52.284136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.284151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.284163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:52.284188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241410:9255], now have 1 active actors on pipe
2025-10-02T08:09:52.284201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533644863241355:9253]
2025-10-02T08:09:52.284203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533644863241355:9253]
2025-10-02T08:09:52.284215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:52.284226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533645323397499:2378], now have 1 active actors on pipe
2025-10-02T08:09:52.284227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:52.284230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:52.284231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:52.284233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 736
2025-10-02T08:09:52.284245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:52.284247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:52.284281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.284291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.284303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533644863241355:9253]
2025-10-02T08:09:52.284312Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:52.284322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:52.284335Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:52.284309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 736
2025-10-02T08:09:52.284342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.284350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.284352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:52.284362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.284370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:52.284402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.284444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.284452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.284466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.284508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 737 partition: 0 MaxSeqNo: 17 sessionId: src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0
2025-10-02T08:09:52.284904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c81a69-c1470492-fd55daf8-cf415b8b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:52.287776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0] Write session: try to update token
2025-10-02T08:09:52.287802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:52.303364Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:52.303390Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:52.303393Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:52.303401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533644863241355:9253]
2025-10-02T08:09:52.303405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533644863241355:9253]
2025-10-02T08:09:52.303451Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:52.303457Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:52.303459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:52.303466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.303469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:52.303608Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:52.304905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId: src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:52.307386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:52.363355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533644863241427:8944]
2025-10-02T08:09:52.363534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 736, pipe: [1:7556533644863241427:8944]
2025-10-02T08:09:52.441809Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:52.442262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.442278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.442310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241427:8944], now have 1 active actors on pipe
2025-10-02T08:09:52.442396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533644863241427:8944]
2025-10-02T08:09:52.442412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:52.442417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:52.442466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 737 reason: error at write: Disconnected sessionId: src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0
2025-10-02T08:09:52.442545Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:52.442571Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:52.442626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 737 sessionId: src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0 is DEAD
2025-10-02T08:09:52.442797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:52.442811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0] Write session will restart in 0.009644s
2025-10-02T08:09:52.442848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0] Write session: Do CDS request
2025-10-02T08:09:52.442856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:52.451549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:52.451962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:52.452166Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:52.452183Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:52.452199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:52.452254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:52.452292Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533644863241489:9259]
2025-10-02T08:09:52.452998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:52.453205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:52.453255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:52.453409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.453519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:52.453525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:52.453531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 738
2025-10-02T08:09:52.453571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.453581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.453582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.453583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.453584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.453598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.453609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.453616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.453619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.453622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.453628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.453637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.453643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.453647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.453650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.453654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.453658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.453662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.453666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.453670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.453689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:52.453702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.453731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:52.453740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:52.453744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:52.454209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 738 sessionId:  describe result for acl check
2025-10-02T08:09:52.454245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:52.454249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:52.454250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:52.454254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533644863241505:9261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:52.454716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533644863241505:9261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:52.457029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533644863241505:9261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:52.461682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533644863241505:9261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:52.461705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533644863241505:9261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:52.461709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533644863241505:9261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:52.461718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:52.462202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:52.463801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:52.463818Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:52.463820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:52.463823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:52.463829Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 737 [1:7556533644863241489:9259]
2025-10-02T08:09:52.463838Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:52.463852Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:52.463854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.463856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.463857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.463869Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:52.463877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:52.463882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:52.463941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.463947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.463950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:52.463952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:52.464001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:52.464007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.464015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.464021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:52.464038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533645323397509:2378], now have 1 active actors on pipe
2025-10-02T08:09:52.464043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533644863241483:9259]
2025-10-02T08:09:52.464045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533644863241483:9259]
2025-10-02T08:09:52.464049Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:52.464056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241537:9261], now have 1 active actors on pipe
2025-10-02T08:09:52.464057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 737
2025-10-02T08:09:52.464059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:52.464062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:52.464062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:52.464070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:52.464073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:52.464079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.464082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.464116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533644863241483:9259]
2025-10-02T08:09:52.464124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:52.464117Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 737
2025-10-02T08:09:52.464139Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:52.464149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:52.464153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.464157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.464159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:52.464165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.464175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:52.464211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.464250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.464255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.464264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.464293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 738 partition: 0 MaxSeqNo: 17 sessionId: src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0
2025-10-02T08:09:52.464698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1946a-3b61bec7-373fba9e-7ae0991a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:52.467561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0] Write session: try to update token
2025-10-02T08:09:52.467588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:52.482343Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:52.482366Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:52.482369Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:52.482379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533644863241483:9259]
2025-10-02T08:09:52.482384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533644863241483:9259]
2025-10-02T08:09:52.482426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:52.482431Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:52.482437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.482437Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:52.482439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:52.482582Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:52.484630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId: src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:52.487393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:52.542560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533644863241557:8944]
2025-10-02T08:09:52.542668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 737, pipe: [1:7556533644863241557:8944]
2025-10-02T08:09:52.620045Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:52.620540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.620561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.620598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241557:8944], now have 1 active actors on pipe
2025-10-02T08:09:52.620700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533644863241557:8944]
2025-10-02T08:09:52.620720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:52.620729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:52.620781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 738 reason: error at write: Disconnected sessionId: src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0
2025-10-02T08:09:52.620788Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:52.620961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 738 sessionId: src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0 is DEAD
2025-10-02T08:09:52.620849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:52.621152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:52.621168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0] Write session will restart in 0.009640s
2025-10-02T08:09:52.621203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0] Write session: Do CDS request
2025-10-02T08:09:52.621210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:52.631009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:52.631466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:52.631650Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:52.631661Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:52.631670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:52.631709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:52.631739Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533644863241629:9267]
2025-10-02T08:09:52.632304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:52.632416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.632521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:52.632533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 739
2025-10-02T08:09:52.632537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:52.632574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:52.632690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.632719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:52.632723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:52.632727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:52.632935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:52.633000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.633001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.633002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.633003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.633005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.633010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.633019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.633023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.633027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.633032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.633038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.633045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.633051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.633056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.633061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.633066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.633071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.633076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.633081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.633086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.633097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 739 sessionId:  describe result for acl check
2025-10-02T08:09:52.633105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:52.633124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:52.633126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:52.633127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:52.633142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533644863241642:9269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:52.633657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533644863241642:9269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:52.635629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533644863241642:9269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:52.640942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533644863241642:9269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:52.640976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533644863241642:9269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:52.640979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533644863241642:9269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:52.640988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:52.641587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:52.643164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:52.643188Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:52.643191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:52.643195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:52.643202Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 738 [1:7556533644863241629:9267]
2025-10-02T08:09:52.643212Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:52.643226Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:52.643228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.643230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.643232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.643245Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:52.643248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:52.643254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:52.643320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.643326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.643329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:52.643330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:52.643390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:52.643397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.643407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.643440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:52.643457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533644863241623:9267]
2025-10-02T08:09:52.643458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533644863241623:9267]
2025-10-02T08:09:52.643468Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:52.643479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:52.643487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:52.643493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:52.643522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533644863241623:9267]
2025-10-02T08:09:52.643528Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:52.643651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:52.643668Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:52.643675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:52.643748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241677:9269], now have 1 active actors on pipe
2025-10-02T08:09:52.643753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 738
2025-10-02T08:09:52.643797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533645323397528:2378], now have 1 active actors on pipe
2025-10-02T08:09:52.643812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.643818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.643844Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:52.643857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.643866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.643878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:52.643892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.643907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:52.643927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.644065Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 738
2025-10-02T08:09:52.644104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.644114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.644130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.644166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 739 partition: 0 MaxSeqNo: 17 sessionId: src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0
2025-10-02T08:09:52.644607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ea34ff-865d7854-2ee70144-b1c7c9fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:52.647533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0] Write session: try to update token
2025-10-02T08:09:52.647560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:52.664520Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:52.664545Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:52.664547Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:52.664556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533644863241623:9267]
2025-10-02T08:09:52.664561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533644863241623:9267]
2025-10-02T08:09:52.664606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:52.664613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.664617Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:52.664620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:52.664635Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:52.664764Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:52.691745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId: src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:52.694180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:52.720701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533644863241728:8944]
2025-10-02T08:09:52.720867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 738, pipe: [1:7556533644863241728:8944]
2025-10-02T08:09:52.803678Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:52.804126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.804143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.804160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241728:8944], now have 1 active actors on pipe
2025-10-02T08:09:52.804254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533644863241728:8944]
2025-10-02T08:09:52.804279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:52.804280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:52.804333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 739 reason: error at write: Disconnected sessionId: src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0
2025-10-02T08:09:52.804348Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:52.804370Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:52.804504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 739 sessionId: src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0 is DEAD
2025-10-02T08:09:52.804644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:52.804651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0] Write session will restart in 0.007009s
2025-10-02T08:09:52.804676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0] Write session: Do CDS request
2025-10-02T08:09:52.804683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:52.812569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:52.812973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:52.813129Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:52.813137Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:52.813146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:52.813185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:52.813222Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533644863241791:9285]
2025-10-02T08:09:52.813737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:52.813952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:52.814017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.814012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:52.814085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:52.814098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 740
2025-10-02T08:09:52.814201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:52.814229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:52.814239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:52.814242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:52.814347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:52.814401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.814408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.814409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.814410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.814411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.814416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.814425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.814429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.814432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.814444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.814450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.814462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:52.814472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.814476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:52.814497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.814508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:52.814513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.814518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.814522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.814527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.814544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:52.814622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 740 sessionId:  describe result for acl check
2025-10-02T08:09:52.814653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:52.814659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:52.814661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:52.814666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533644863241805:9287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:52.815198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533644863241805:9287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:52.817801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533644863241805:9287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:52.822358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533644863241805:9287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:52.822378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533644863241805:9287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:52.822382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533644863241805:9287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:52.822392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:52.823192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:52.825411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:52.825434Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:52.825436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:52.825441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:52.825447Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 739 [1:7556533644863241791:9285]
2025-10-02T08:09:52.825457Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:52.825470Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:52.825472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.825474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.825475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.825488Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:52.825491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:52.825496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:52.825547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.825553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.825555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:52.825557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:52.825609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:52.825614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.825632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:52.825649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:52.825671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241839:9287], now have 1 active actors on pipe
2025-10-02T08:09:52.825680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533644863241785:9285]
2025-10-02T08:09:52.825682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533644863241785:9285]
2025-10-02T08:09:52.825682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 739
2025-10-02T08:09:52.825687Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:52.825697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:52.825759Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 739
2025-10-02T08:09:52.825708Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:52.825713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:52.825716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:52.825719Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:52.825722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533645323397557:2378], now have 1 active actors on pipe
2025-10-02T08:09:52.825727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.825730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.825765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533644863241785:9285]
2025-10-02T08:09:52.825767Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:52.825783Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:52.825787Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:52.825789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.825792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.825794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:52.825802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.825811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:52.825854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.825910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.825921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.825949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:52.825990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 740 partition: 0 MaxSeqNo: 17 sessionId: src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0
2025-10-02T08:09:52.826329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4662388b-2802fcfa-a537c5f9-8a5cf285_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:52.829204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0] Write session: try to update token
2025-10-02T08:09:52.829222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:52.836929Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:52.836949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:52.836957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533644863241785:9285]
2025-10-02T08:09:52.836995Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:52.836998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:52.837161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:52.837300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:52.837437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:52.837581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:52.837760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:52.837792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:52.844066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId: src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:52.846708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:52.846782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.846794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.846826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:52.846849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:52.846906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:52.846920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:52.847073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.847128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.847197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.847268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.847325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.847332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.847393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.847462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.847530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.847596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.847647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.847655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.847715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.847770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.847822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.847888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.847931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.847936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.847993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.848048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.848102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.848157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.848209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.848215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.848275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.848329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.848384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.848444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.848495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.848503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.848570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.848629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.848695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.848754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.848795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.848817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.848884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.848942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.849004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.849077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.849126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.849134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.849202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.849263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.849322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.849382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.849423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.849429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.849491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.849552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.849616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.849671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.849721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.849728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.849788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:52.849842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:52.849898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:52.849953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:52.849996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:52.850005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:52.850044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:52.850100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:52.850116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:52.850121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:52.850147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:52.850160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:52.850165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:52.850166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:52.850168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:52.850544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:52.850569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:52.850574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:52.850575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:52.850577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:52.850579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:52.851046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:52.851065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:52.851069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:52.851071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:52.851073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:52.851075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:52.851597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:52.851616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:52.851620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:52.851622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:52.851623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:52.854322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:52.854347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:52.854361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392592854
2025-10-02T08:09:52.854566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:52.854587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:52.854598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:52.854601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:52.854605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:52.854613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:52.855138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:52.855161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:52.855166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:52.855175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:52.855178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:52.855182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:52.855752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:52.855776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:52.855787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:52.855790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:52.855794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:52.855798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:52.856365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:52.856393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:52.856404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:52.857664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:52.857685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:52.857691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:52.857695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:52.857705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392592857
2025-10-02T08:09:52.858012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:52.858037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:52.858047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:52.858054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:52.858058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:52.858066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:52.858568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:52.858592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:52.858597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:52.858601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:52.858604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:52.858608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:52.859140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:52.859164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:52.859272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392592858
2025-10-02T08:09:52.860141Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:52.860169Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:52.860175Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:52.860183Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:52.861963Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:52.861981Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:52.861983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:52.861990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533644863241785:9285]
2025-10-02T08:09:52.861994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533644863241785:9285]
2025-10-02T08:09:52.862043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:52.862055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:52.862055Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:52.862060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:52.862062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:52.862205Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:52.904532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533644863241861:8944]
2025-10-02T08:09:52.904654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 739, pipe: [1:7556533644863241861:8944]
2025-10-02T08:09:52.998837Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:52.999341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533644863241861:8944], now have 1 active actors on pipe
2025-10-02T08:09:52.999516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:52.999533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:52.999568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 740 reason: error at write: Disconnected sessionId: src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0
2025-10-02T08:09:52.999618Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:53.000019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 740 sessionId: src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0 is DEAD
2025-10-02T08:09:53.000055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:53.000073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0] Write session will restart in 0.006140s
2025-10-02T08:09:53.000100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0] Write session: Do CDS request
2025-10-02T08:09:53.000107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:53.000192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533644863241861:8944]
2025-10-02T08:09:53.000880Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:53.005957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:53.007341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.007430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:53.007444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 741
2025-10-02T08:09:53.007560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.007585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:53.007592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:53.007595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:53.007925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:53.008007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 741 sessionId:  describe result for acl check
2025-10-02T08:09:53.008036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:53.008043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:53.008045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:53.008051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533649158209228:9294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:53.008093Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:53.008103Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:53.008113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:53.008165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:53.008228Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533649158209229:9292]
2025-10-02T08:09:53.008509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533649158209228:9294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:53.008791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:53.008994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:53.009055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:53.009371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:53.009426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.009432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.009433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.009436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.009437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.009442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.009452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.009455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.009459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.009462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.009467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.009475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.009480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.009485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.009488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.009494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.009498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.009503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.009508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.009512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.009532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:53.010439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533649158209228:9294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:53.016479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533649158209228:9294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:53.016502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533649158209228:9294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:53.016505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533649158209228:9294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:53.016514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:53.017576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:53.019453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:53.019471Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:53.019474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:53.019478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:53.019484Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 740 [1:7556533649158209229:9292]
2025-10-02T08:09:53.019496Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:53.019512Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:53.019515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.019518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.019520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.019536Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:53.019541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:53.019548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:53.019608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.019617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.019620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:53.019623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:53.019687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:53.019694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.019707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.019724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:53.019749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209271:9294], now have 1 active actors on pipe
2025-10-02T08:09:53.019750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 740
2025-10-02T08:09:53.019760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533649158209220:9292]
2025-10-02T08:09:53.019762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533649158209220:9292]
2025-10-02T08:09:53.019774Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:53.019783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533649618364861:2378], now have 1 active actors on pipe
2025-10-02T08:09:53.019788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:53.019790Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:53.019792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.019796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.019811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:53.019827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:53.019835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:53.019829Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 740
2025-10-02T08:09:53.019873Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:53.019884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.019888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.019890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:53.019898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.019906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:53.019918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533649158209220:9292]
2025-10-02T08:09:53.019929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:53.019956Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:53.019963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.020037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.020046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.020061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.020097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 741 partition: 0 MaxSeqNo: 17 sessionId: src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0
2025-10-02T08:09:53.020433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8994e0-b2a0ddfd-91ebf3b8-fdd1c583_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:53.023195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0] Write session: try to update token
2025-10-02T08:09:53.023213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:53.037573Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:53.037595Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:53.037598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:53.037607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533649158209220:9292]
2025-10-02T08:09:53.037612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533649158209220:9292]
2025-10-02T08:09:53.037663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:53.037665Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:53.037672Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:53.037674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.037676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:53.037827Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:53.038641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId: src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:53.041337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:53.100164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533649158209285:8944]
2025-10-02T08:09:53.100329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 740, pipe: [1:7556533649158209285:8944]
2025-10-02T08:09:53.180276Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:53.180617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.180632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.180678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209285:8944], now have 1 active actors on pipe
2025-10-02T08:09:53.180833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:53.180849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:53.180921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 741 reason: error at write: Disconnected sessionId: src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0
2025-10-02T08:09:53.181146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 741 sessionId: src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0 is DEAD
2025-10-02T08:09:53.181225Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:53.181274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:53.181295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0] Write session will restart in 0.006574s
2025-10-02T08:09:53.181320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0] Write session: Do CDS request
2025-10-02T08:09:53.181327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:53.181327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533649158209285:8944]
2025-10-02T08:09:53.185118Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:53.189331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.189825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:53.189841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 742
2025-10-02T08:09:53.189900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:53.189949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.189988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:53.189998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:53.190002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:53.190437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 742 sessionId:  describe result for acl check
2025-10-02T08:09:53.190473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:53.190479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:53.190481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:53.190486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533649158209353:9300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:53.190550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:53.190740Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:53.190751Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:53.190762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:53.190825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:53.190863Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533649158209355:9298]
2025-10-02T08:09:53.191472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:53.192020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:53.192073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:53.192363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:53.192419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.192426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.192427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.192428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.192429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.192434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.192442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.192446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.192450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.192453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.192459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.192466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.192472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.192477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.192481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.192486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.192492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.192501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.192506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.192511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.192527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:53.192568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533649158209353:9300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:53.194679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533649158209353:9300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:53.200301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533649158209353:9300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:53.200321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533649158209353:9300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:53.200325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533649158209353:9300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:53.200333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:53.201019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:53.202726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:53.202742Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:53.202743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:53.202746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:53.202751Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 741 [1:7556533649158209355:9298]
2025-10-02T08:09:53.202759Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:53.202771Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:53.202774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.202777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.202779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.202795Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:53.202800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:53.202806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:53.202845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.202852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.202854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:53.202856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:53.202900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:53.202905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.202914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.202920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:53.202936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533649158209346:9298]
2025-10-02T08:09:53.202942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533649158209346:9298]
2025-10-02T08:09:53.202950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:53.202961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:53.202961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:53.202969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:53.202971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:53.202971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 741
2025-10-02T08:09:53.202980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209399:9300], now have 1 active actors on pipe
2025-10-02T08:09:53.202980Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:53.202983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533649618364867:2378], now have 1 active actors on pipe
2025-10-02T08:09:53.203012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533649158209346:9298]
2025-10-02T08:09:53.203021Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:53.203026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.203027Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:53.203008Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 741
2025-10-02T08:09:53.203032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.203065Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc9c051a-44e9c060-77677535-62dff584_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:53.203072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.203075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.203077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:53.203082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.203089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:53.203104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.203143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.203153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.203170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.203205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 742 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc9c051a-44e9c060-77677535-62dff584_0
2025-10-02T08:09:53.203568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8ff4b3d-77cf202e-344597b-2868acd9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc9c051a-44e9c060-77677535-62dff584_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:53.206333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9c051a-44e9c060-77677535-62dff584_0] Write session: try to update token
2025-10-02T08:09:53.206348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9c051a-44e9c060-77677535-62dff584_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:53.220729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId: src_id|cc9c051a-44e9c060-77677535-62dff584_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:53.222888Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:53.222911Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:53.222914Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:53.222923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533649158209346:9298]
2025-10-02T08:09:53.222928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533649158209346:9298]
2025-10-02T08:09:53.222971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:53.222975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:53.222981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:53.222982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.222985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:53.223131Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:53.224234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:53.289254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533649158209414:8944]
2025-10-02T08:09:53.289758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 741, pipe: [1:7556533649158209414:8944]
2025-10-02T08:09:53.356775Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:53.357203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.357228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.357275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209414:8944], now have 1 active actors on pipe
2025-10-02T08:09:53.357406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:53.357414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:53.357475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 742 reason: error at write: Disconnected sessionId: src_id|cc9c051a-44e9c060-77677535-62dff584_0
2025-10-02T08:09:53.357489Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:53.357639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 742 sessionId: src_id|cc9c051a-44e9c060-77677535-62dff584_0 is DEAD
2025-10-02T08:09:53.357750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533649158209414:8944]
2025-10-02T08:09:53.357972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9c051a-44e9c060-77677535-62dff584_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:53.357984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9c051a-44e9c060-77677535-62dff584_0] Write session will restart in 0.009617s
2025-10-02T08:09:53.358007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9c051a-44e9c060-77677535-62dff584_0] Write session: Do CDS request
2025-10-02T08:09:53.358016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9c051a-44e9c060-77677535-62dff584_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:53.358145Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:53.365867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:53.368029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:53.368227Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:53.368236Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:53.368246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:53.368312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:53.368349Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533649158209482:9304]
2025-10-02T08:09:53.368399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9c051a-44e9c060-77677535-62dff584_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.368596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:53.368621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 743
2025-10-02T08:09:53.368816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.368856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:53.368872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:53.368882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:53.368982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:53.369197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:53.369246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:53.369346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 743 sessionId:  describe result for acl check
2025-10-02T08:09:53.369397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:53.369406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:53.369408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:53.369416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533649158209493:9306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:53.369544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:53.369604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.369610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.369611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.369612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.369613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.369618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.369627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.369634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.369637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.369644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.369650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.369664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.369670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.369674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.369677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.369682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.369686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.369690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.369693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.369698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.369715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:53.369978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533649158209493:9306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:53.371728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533649158209493:9306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:53.377779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:53.377892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533649158209493:9306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:53.377906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533649158209493:9306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:53.377909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533649158209493:9306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:53.377917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:53.379674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:53.379690Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:53.379692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:53.379694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:53.379699Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 742 [1:7556533649158209482:9304]
2025-10-02T08:09:53.379706Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:53.379721Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:53.379733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.379736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.379738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.379755Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:53.379763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:53.379769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:53.379830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.379840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.379842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:53.379844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:53.379904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:53.379911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.379925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.379941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:53.379958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 742
2025-10-02T08:09:53.379962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209530:9306], now have 1 active actors on pipe
2025-10-02T08:09:53.379969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533649158209476:9304]
2025-10-02T08:09:53.379970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533649158209476:9304]
2025-10-02T08:09:53.379980Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:53.379988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533649618364872:2378], now have 1 active actors on pipe
2025-10-02T08:09:53.379992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.379994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:53.379997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:53.380000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.380017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:53.380032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:53.380040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:53.380040Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 742
2025-10-02T08:09:53.380080Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:53.380103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.380106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.380108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:53.380115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.380124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:53.380135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533649158209476:9304]
2025-10-02T08:09:53.380147Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:53.380173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:53.380175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.380247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.380252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.380262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.380289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 743 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0
2025-10-02T08:09:53.380658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc9c051a-44e9c060-77677535-62dff584_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:53.383720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0] Write session: try to update token
2025-10-02T08:09:53.383749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:53.391084Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:53.391108Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:53.391117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533649158209476:9304]
2025-10-02T08:09:53.391155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:53.391156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:53.391324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:53.391484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:53.391633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:53.391774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:53.391976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:53.392017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:53.401433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId: src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:53.404006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:53.404067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.404080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.404116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:53.404146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:53.404210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.404225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.404405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.404480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.404546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.404616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.404661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.404675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.404742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.404827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.404888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.404955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.405014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.405023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.405092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.405154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.405215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.405285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.405338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.405345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.405413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.405475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.405539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.405603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.405648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.405655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.405719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.405778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.405838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.405905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.405949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.405955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.406022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.406079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.406146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.406210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.406257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.406267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.406333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.406394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.406459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.406527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.406593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.406601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.406674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.406735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.406805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.406870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.406933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.406939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.407012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.407077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.407146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.407207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.407252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.407264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.407328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.407394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.407467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.407530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.407586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.407593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.407652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:53.407720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.407745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.407751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:53.407781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:53.407800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:53.407804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:53.407807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:53.407810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:53.408285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:53.408312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:53.408318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:53.408321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:53.408323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:53.408325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:53.408904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:53.408926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:53.408932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:53.408936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:53.408939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:53.408944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:53.409428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:53.409450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:53.409455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:53.409459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:53.409462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:53.410844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:53.410862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:53.410875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392593410
2025-10-02T08:09:53.411113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:53.411132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:53.411140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:53.411153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:53.411157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:53.411160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:53.411634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:53.411655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:53.411660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:53.411664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:53.411667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:53.411673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:53.412222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:53.412245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:53.412251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:53.412255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:53.412259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:53.412263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:53.412795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:53.412831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:53.412837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:53.414058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:53.414078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:53.414083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:53.414087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:53.414095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392593413
2025-10-02T08:09:53.414413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:53.414423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:53.414427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:53.414430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:53.414433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:53.414436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:53.414930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:53.414941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:53.414946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:53.414951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:53.414955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:53.414959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:53.415483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:53.415505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.415614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392593415
2025-10-02T08:09:53.418162Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:53.418193Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:53.418201Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:53.418208Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:53.418221Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:53.418225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:53.418228Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:53.418237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533649158209476:9304]
2025-10-02T08:09:53.418241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533649158209476:9304]
2025-10-02T08:09:53.418319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:53.418323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.418325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:53.418411Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:53.418429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:53.418468Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:53.456456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533649158209551:8944]
2025-10-02T08:09:53.456581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 742, pipe: [1:7556533649158209551:8944]
2025-10-02T08:09:53.556214Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:53.556521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209551:8944], now have 1 active actors on pipe
2025-10-02T08:09:53.556695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:53.556702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:53.556723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 743 reason: error at write: Disconnected sessionId: src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0
2025-10-02T08:09:53.556841Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:53.556892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 743 sessionId: src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0 is DEAD
2025-10-02T08:09:53.556950Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:53.556987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:53.556995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0] Write session will restart in 0.007146s
2025-10-02T08:09:53.557016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0] Write session: Do CDS request
2025-10-02T08:09:53.557023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:53.557096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533649158209551:8944]
2025-10-02T08:09:53.560570Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [80277ea43e7da6d1] Result# TEvPutResult {Id# [72075186224037892:742:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:53.560616Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:742:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:53.560664Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:742:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:53.565320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.565399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:53.565427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 744
2025-10-02T08:09:53.565608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.565661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:53.565674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:53.565679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:53.566087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 744 sessionId:  describe result for acl check
2025-10-02T08:09:53.566126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:53.566130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:53.566132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:53.566137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533649158209627:9313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:53.566645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533649158209627:9313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:53.567925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:53.568250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:53.568424Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:53.568433Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:53.568444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:53.568485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533649158209627:9313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:53.568494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:53.568540Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533649158209652:9311]
2025-10-02T08:09:53.569178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:53.569399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:53.569467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:53.569820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:53.569869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.569875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.569876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.569877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.569881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.569887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.569897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.569905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.569910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.569913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.569921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.569929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.569935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.569941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.569945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.569951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.569960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.569966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.569974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.569980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.570004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:53.572238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533649158209627:9313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:53.572250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533649158209627:9313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:53.572254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533649158209627:9313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:53.572262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:53.578307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:53.579851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:53.579864Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:53.579870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:53.579873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:53.579878Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 743 [1:7556533649158209652:9311]
2025-10-02T08:09:53.579885Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:53.579899Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:53.579901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.579903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.579904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.579916Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:53.579923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:53.579928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:53.579980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.579986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.579989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:53.579990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:53.580039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:53.580045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.580054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.580061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:53.580073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533649158209646:9311]
2025-10-02T08:09:53.580078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533649158209646:9311]
2025-10-02T08:09:53.580084Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:53.580094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:53.580105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:53.580107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:53.580110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:53.580110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:53.580117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209679:9313], now have 1 active actors on pipe
2025-10-02T08:09:53.580142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533649618364893:2378], now have 1 active actors on pipe
2025-10-02T08:09:53.580149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533649158209646:9311]
2025-10-02T08:09:53.580147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 743
2025-10-02T08:09:53.580154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:53.580159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.580162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.580165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:53.580191Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:53.580195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.580198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.580199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:53.580204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.580211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:53.580223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.580220Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 743
2025-10-02T08:09:53.580309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.580315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.580333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.580370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 744 partition: 0 MaxSeqNo: 17 sessionId: src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0
2025-10-02T08:09:53.580711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5464a45-5a4cc1f6-c29a6730-c17045a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:53.583641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0] Write session: try to update token
2025-10-02T08:09:53.583658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:53.599015Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:53.599032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:53.599034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:53.599043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533649158209646:9311]
2025-10-02T08:09:53.599046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533649158209646:9311]
2025-10-02T08:09:53.599091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:53.599097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.599099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:53.599099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:53.599106Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:53.599150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId: src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:53.599273Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:53.601927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:53.657172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533649158209706:8944]
2025-10-02T08:09:53.657293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 743, pipe: [1:7556533649158209706:8944]
2025-10-02T08:09:53.732385Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:53.732617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.732627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.732654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209706:8944], now have 1 active actors on pipe
2025-10-02T08:09:53.732748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533649158209706:8944]
2025-10-02T08:09:53.732782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:53.732788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:53.732822Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:53.732868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 744 reason: error at write: Disconnected sessionId: src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0
2025-10-02T08:09:53.732923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:53.733053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 744 sessionId: src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0 is DEAD
2025-10-02T08:09:53.733221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:53.733231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0] Write session will restart in 0.008925s
2025-10-02T08:09:53.733256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0] Write session: Do CDS request
2025-10-02T08:09:53.733263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:53.741231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:53.741641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:53.741794Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:53.741802Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:53.741810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:53.741846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:53.741885Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533649158209810:9328]
2025-10-02T08:09:53.742506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:53.742697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:53.742734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:53.743018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:53.743056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.743061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.743062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.743063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.743064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.743068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.743079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.743083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.743087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.743090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.743095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.743102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.743107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.743112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.743116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.743122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.743125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.743130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.743140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.743145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.743163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:53.743435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.743513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:53.743524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 745
2025-10-02T08:09:53.743673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.743706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:53.743724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:53.743731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:53.744082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 745 sessionId:  describe result for acl check
2025-10-02T08:09:53.744115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:53.744117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:53.744118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:53.744122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533649158209826:9330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:53.744594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533649158209826:9330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:53.746703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533649158209826:9330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:53.750665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533649158209826:9330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:53.750677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533649158209826:9330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:53.750679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533649158209826:9330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:53.750684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:53.751335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:53.752885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:53.752898Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:53.752900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:53.752904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:53.752911Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 744 [1:7556533649158209810:9328]
2025-10-02T08:09:53.752922Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:53.752937Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:53.752940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.752943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.752946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.752961Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:53.752966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:53.752972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:53.753027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.753035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.753038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:53.753041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:53.753102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:53.753109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.753123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.753137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:53.753161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209861:9330], now have 1 active actors on pipe
2025-10-02T08:09:53.753168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533649158209804:9328]
2025-10-02T08:09:53.753170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533649158209804:9328]
2025-10-02T08:09:53.753176Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:53.753185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533649618364913:2378], now have 1 active actors on pipe
2025-10-02T08:09:53.753190Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:53.753192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:53.753194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:53.753207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:53.753210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:53.753240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533649158209804:9328]
2025-10-02T08:09:53.753248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:53.753222Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 744
2025-10-02T08:09:53.753269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:53.753282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 744
2025-10-02T08:09:53.753293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.753302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.753329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99315213-2c98aea5-dc641426-535648e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:53.753340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.753344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.753346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:53.753354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.753362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:53.753381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.753488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.753500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.753525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.753578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 745 partition: 0 MaxSeqNo: 17 sessionId: src_id|99315213-2c98aea5-dc641426-535648e1_0
2025-10-02T08:09:53.754001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61bc45e-8ca11d7b-d483a664-7e8e4711_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|99315213-2c98aea5-dc641426-535648e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:53.756856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99315213-2c98aea5-dc641426-535648e1_0] Write session: try to update token
2025-10-02T08:09:53.756872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99315213-2c98aea5-dc641426-535648e1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:53.774377Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:53.774397Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:53.774400Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:53.774409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533649158209804:9328]
2025-10-02T08:09:53.774413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533649158209804:9328]
2025-10-02T08:09:53.774463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:53.774469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.774471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:53.774475Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:53.774482Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:53.774615Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:53.779087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId: src_id|99315213-2c98aea5-dc641426-535648e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:53.781747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:53.832795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533649158209876:8944]
2025-10-02T08:09:53.832906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 744, pipe: [1:7556533649158209876:8944]
2025-10-02T08:09:53.913577Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:53.913960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.913966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.913998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158209876:8944], now have 1 active actors on pipe
2025-10-02T08:09:53.914109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:53.914113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:53.914190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 745 reason: error at write: Disconnected sessionId: src_id|99315213-2c98aea5-dc641426-535648e1_0
2025-10-02T08:09:53.914198Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:53.914362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 745 sessionId: src_id|99315213-2c98aea5-dc641426-535648e1_0 is DEAD
2025-10-02T08:09:53.914421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533649158209876:8944]
2025-10-02T08:09:53.914488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:53.916336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99315213-2c98aea5-dc641426-535648e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:53.916353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99315213-2c98aea5-dc641426-535648e1_0] Write session will restart in 0.008254s
2025-10-02T08:09:53.916384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99315213-2c98aea5-dc641426-535648e1_0] Write session: Do CDS request
2025-10-02T08:09:53.916393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99315213-2c98aea5-dc641426-535648e1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:53.923318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:53.923755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:53.923929Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:53.923932Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:53.923942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:53.923991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:53.924027Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533649158209951:9336]
2025-10-02T08:09:53.924626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:53.924812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:53.924850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:53.925127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:53.925163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.925164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.925165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.925166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.925167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.925171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.925181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.925185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.925188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.925191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.925197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.925203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:53.925209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.925213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:53.925216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.925221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:53.925224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.925228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.925233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.925237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.925253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:53.926675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99315213-2c98aea5-dc641426-535648e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.926765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:53.926779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 746
2025-10-02T08:09:53.927034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:53.927066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:53.927069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:53.927072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:53.927463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 746 sessionId:  describe result for acl check
2025-10-02T08:09:53.927498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:53.927505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:53.927506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:53.927512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533649158209967:9338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:53.928014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533649158209967:9338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:53.932340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533649158209967:9338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:53.934017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:53.936023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:53.936025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533649158209967:9338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:53.936033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533649158209967:9338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:53.936037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533649158209967:9338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:53.936037Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:53.936039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:53.936042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:53.936045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:53.936048Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 745 [1:7556533649158209951:9336]
2025-10-02T08:09:53.936058Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:53.936072Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:53.936075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.936077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.936079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.936093Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:53.936097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:53.936102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:53.936158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.936169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.936172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:53.936174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:53.936225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:53.936228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.936240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:53.936250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:53.936268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533649618364930:2378], now have 1 active actors on pipe
2025-10-02T08:09:53.936273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533649158209945:9336]
2025-10-02T08:09:53.936275Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533649158209945:9336]
2025-10-02T08:09:53.936318Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 745
2025-10-02T08:09:53.936288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:53.936309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:53.936309Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:53.936311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:53.936320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:53.936323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:53.936357Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533649158209945:9336]
2025-10-02T08:09:53.936363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:53.936369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:53.936388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533649158210000:9338], now have 1 active actors on pipe
2025-10-02T08:09:53.936393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 745
2025-10-02T08:09:53.936394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.936397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.936432Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:53.936438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.936444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.936445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:53.936455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.936463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:53.936476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.936580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.936585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.936605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:53.936657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 746 partition: 0 MaxSeqNo: 17 sessionId: src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0
2025-10-02T08:09:53.937066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99315213-2c98aea5-dc641426-535648e1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:53.940208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0] Write session: try to update token
2025-10-02T08:09:53.940233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:53.947963Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:53.947976Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:53.947983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533649158209945:9336]
2025-10-02T08:09:53.948018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:53.948029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:53.948188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:53.948336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:53.948475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:53.948610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:53.949125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:53.949176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:53.956687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId: src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:53.959261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:53.959350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.959362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.959389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:53.959411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:53.959469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:53.959478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:53.959653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.959717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.959786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.959847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.959894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.959897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.959960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.960012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.960063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.960118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.960169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.960173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.960241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.960305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.960353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.960408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.960455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.960456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.960516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.960567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.960619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.960673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.960711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.960713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.960766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.960850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.960915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.960980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.961034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.961037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.961109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.961177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.961247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.961318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.961486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.961492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.961568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.961638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.961719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.961784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.961832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.961835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.961908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.961988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.962054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.962121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.962172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.962178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.962255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.962319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.962383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.962445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.962487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.962490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.962557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:53.962606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:53.962658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:53.962723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:53.962764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:53.962766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:53.962800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:53.962858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:53.962876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:53.962878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:53.962910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:53.962923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:53.962927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:53.962929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:53.962932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:53.963340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:53.963373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:53.963379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:53.963382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:53.963385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:53.963388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:53.963878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:53.963901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:53.963907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:53.963913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:53.963916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:53.963919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:53.964378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:53.964398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:53.964403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:53.964405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:53.964407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:53.965567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:53.965582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:53.965591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392593965
2025-10-02T08:09:53.965755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:53.965766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:53.965769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:53.965772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:53.965775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:53.965776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:53.966249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:53.966268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:53.966272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:53.966275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:53.966277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:53.966280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:53.966718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:53.966734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:53.966739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:53.966742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:53.966744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:53.966746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:53.967185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:53.967202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:53.967206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:53.968315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:53.968344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:53.968348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:53.968350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:53.968359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392593967
2025-10-02T08:09:53.968643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:53.968659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:53.968666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:53.968671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:53.968674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:53.968677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:53.969154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:53.969171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:53.969176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:53.969180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:53.969182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:53.969184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:53.969586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:53.969602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:53.969680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392593969
2025-10-02T08:09:53.970418Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:53.970440Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:53.970446Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:53.970452Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:53.972149Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:53.972165Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:53.972167Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:53.972175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533649158209945:9336]
2025-10-02T08:09:53.972180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533649158209945:9336]
2025-10-02T08:09:53.972239Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:53.972246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:53.972250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:53.972252Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:53.972252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:53.972388Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:54.014560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533653453177320:8944]
2025-10-02T08:09:54.014665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 745, pipe: [1:7556533653453177320:8944]
2025-10-02T08:09:54.114771Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:54.115139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177320:8944], now have 1 active actors on pipe
2025-10-02T08:09:54.115250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:54.115260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:54.115293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 746 reason: error at write: Disconnected sessionId: src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0
2025-10-02T08:09:54.115360Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:54.115367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:54.115480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 746 sessionId: src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0 is DEAD
2025-10-02T08:09:54.115680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533653453177320:8944]
2025-10-02T08:09:54.115693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:54.115709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0] Write session will restart in 0.005062s
2025-10-02T08:09:54.115738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0] Write session: Do CDS request
2025-10-02T08:09:54.115746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:54.122386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.122493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:54.122517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 747
2025-10-02T08:09:54.122693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.122731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:54.122740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:54.122744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:54.123194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 747 sessionId:  describe result for acl check
2025-10-02T08:09:54.123228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:54.123233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:54.123235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:54.123239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533653453177392:9345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:54.123635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:54.123750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533653453177392:9345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:54.125415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:54.125731Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:54.125740Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:54.125750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:54.125806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:54.125841Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533653453177417:9343]
2025-10-02T08:09:54.126285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533653453177392:9345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:54.126369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:54.126548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:54.126584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:54.126850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:54.126891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.126896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.126897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.126899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.126900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.126904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.126914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.126917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.126921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.126923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.126928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.126935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.126941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.126946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.126954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.126958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.126961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.126968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.126975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.126979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.126995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:54.131854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533653453177392:9345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:54.131865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533653453177392:9345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:54.131868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533653453177392:9345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:54.131876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:54.134917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:54.136385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:54.136411Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:54.136413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:54.136415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:54.136420Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 746 [1:7556533653453177417:9343]
2025-10-02T08:09:54.136428Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:54.136442Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:54.136444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.136447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.136448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.136460Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:54.136464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:54.136471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:54.136514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.136520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.136522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:54.136524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:54.136569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:54.136574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.136582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.136589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:54.136600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533653453177393:9343]
2025-10-02T08:09:54.136604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533653453177393:9343]
2025-10-02T08:09:54.136610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:54.136619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:54.136622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:54.136625Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:54.136627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:54.136629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:54.136636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177445:9345], now have 1 active actors on pipe
2025-10-02T08:09:54.136636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 746
2025-10-02T08:09:54.136642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533653913332233:2378], now have 1 active actors on pipe
2025-10-02T08:09:54.136667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.136673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.136684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533653453177393:9343]
2025-10-02T08:09:54.136691Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:54.136699Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:54.136709Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff66c53f-25568f3-9780600-74052887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:54.136713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.136716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.136717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:54.136724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.136733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:54.136748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.136752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 746
2025-10-02T08:09:54.136786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.136791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.136823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.136876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 747 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff66c53f-25568f3-9780600-74052887_0
2025-10-02T08:09:54.137383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99487fce-a5723eb2-a97a7c5-4e98c70e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff66c53f-25568f3-9780600-74052887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:54.140237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff66c53f-25568f3-9780600-74052887_0] Write session: try to update token
2025-10-02T08:09:54.140261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff66c53f-25568f3-9780600-74052887_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:54.154715Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:54.154735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:54.154737Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:54.154744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533653453177393:9343]
2025-10-02T08:09:54.154751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533653453177393:9343]
2025-10-02T08:09:54.154786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:54.154793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.154794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:54.154912Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:54.155796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:54.155802Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:54.160668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId: src_id|ff66c53f-25568f3-9780600-74052887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:54.163710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:54.215767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533653453177459:8944]
2025-10-02T08:09:54.215986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 746, pipe: [1:7556533653453177459:8944]
2025-10-02T08:09:54.296006Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:54.296363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.296378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.296399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177459:8944], now have 1 active actors on pipe
2025-10-02T08:09:54.296556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533653453177459:8944]
2025-10-02T08:09:54.296786Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:54.297046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff66c53f-25568f3-9780600-74052887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:54.297056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff66c53f-25568f3-9780600-74052887_0] Write session will restart in 0.008819s
2025-10-02T08:09:54.297079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff66c53f-25568f3-9780600-74052887_0] Write session: Do CDS request
2025-10-02T08:09:54.297098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff66c53f-25568f3-9780600-74052887_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:54.296601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:54.296609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:54.296679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 747 reason: error at write: Disconnected sessionId: src_id|ff66c53f-25568f3-9780600-74052887_0
2025-10-02T08:09:54.296902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 747 sessionId: src_id|ff66c53f-25568f3-9780600-74052887_0 is DEAD
2025-10-02T08:09:54.297618Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:54.305161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:54.307227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:54.307443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff66c53f-25568f3-9780600-74052887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.307405Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:54.307423Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:54.307434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:54.307474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:54.307507Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533653453177537:9349]
2025-10-02T08:09:54.307541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:54.307552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 748
2025-10-02T08:09:54.307700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.307735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:54.307744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:54.307748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:54.308082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:54.308106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 748 sessionId:  describe result for acl check
2025-10-02T08:09:54.308134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:54.308139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:54.308141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:54.308146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533653453177543:9351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:54.308246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:54.308286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:54.308578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:54.308625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.308630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.308631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.308632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.308633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.308637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533653453177543:9351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:54.308638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.308645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.308648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.308651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.308654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.308660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.308666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.308671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.308675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.308679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.308683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.308687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.308691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.308696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.308707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.308723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:54.310956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533653453177543:9351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:54.317014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533653453177543:9351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:54.317033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533653453177543:9351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:54.317036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533653453177543:9351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:54.317045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:54.317503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:54.319202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:54.319222Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:54.319224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:54.319228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:54.319235Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 747 [1:7556533653453177537:9349]
2025-10-02T08:09:54.319248Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:54.319265Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:54.319269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.319272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.319275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.319290Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:54.319298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:54.319304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:54.320529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.320542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.320546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:54.320548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:54.320620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:54.320627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.320642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.320654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:54.320663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 747
2025-10-02T08:09:54.320679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177585:9351], now have 1 active actors on pipe
2025-10-02T08:09:54.320686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533653913332240:2378], now have 1 active actors on pipe
2025-10-02T08:09:54.320693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533653453177531:9349]
2025-10-02T08:09:54.320697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533653453177531:9349]
2025-10-02T08:09:54.320709Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:54.320725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.320725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:54.320728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:54.320733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.320752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:54.320770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:54.320777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:54.320845Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:54.320860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.320863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.320866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:54.320875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.320886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:54.320897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533653453177531:9349]
2025-10-02T08:09:54.320906Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:54.320918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:54.320940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.321211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.321222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.321246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.321286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 748 partition: 0 MaxSeqNo: 17 sessionId: src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0
2025-10-02T08:09:54.320771Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 747
2025-10-02T08:09:54.322128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff66c53f-25568f3-9780600-74052887_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:54.325132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0] Write session: try to update token
2025-10-02T08:09:54.325157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:54.339358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:54.339377Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:54.339379Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:54.339387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533653453177531:9349]
2025-10-02T08:09:54.339391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533653453177531:9349]
2025-10-02T08:09:54.339442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:54.339441Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:54.339447Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:54.339453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.339455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:54.339608Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:54.347973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId: src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:54.350557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:54.396510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533653453177601:8944]
2025-10-02T08:09:54.396599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 747, pipe: [1:7556533653453177601:8944]
2025-10-02T08:09:54.476218Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:54.476596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.476609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.476632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177601:8944], now have 1 active actors on pipe
2025-10-02T08:09:54.477157Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:54.477573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:54.477583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0] Write session will restart in 0.007307s
2025-10-02T08:09:54.477609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0] Write session: Do CDS request
2025-10-02T08:09:54.477616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:54.476847Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:54.476852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533653453177601:8944]
2025-10-02T08:09:54.476868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:54.476920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 748 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0
2025-10-02T08:09:54.477098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 748 sessionId: src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0 is DEAD
2025-10-02T08:09:54.485934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:54.486304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.486313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:54.486358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:54.486373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 749
2025-10-02T08:09:54.486487Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:54.486501Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:54.486510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.486512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:54.486542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:54.486553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:54.486557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:54.486596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:54.486643Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533653453177688:9357]
2025-10-02T08:09:54.486915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 749 sessionId:  describe result for acl check
2025-10-02T08:09:54.486938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:54.486943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:54.486944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:54.486948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533653453177692:9359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:54.487239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:54.487310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533653453177692:9359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:54.487410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:54.487474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:54.487777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:54.487821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.487825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.487826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.487827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.487828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.487831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.487837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.487839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.487841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.487843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.487847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.487852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.487856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.487858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.487861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.487864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.487868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.487871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.487873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.487876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.487887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:54.489550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533653453177692:9359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:54.495410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533653453177692:9359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:54.495437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533653453177692:9359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:54.495440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533653453177692:9359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:54.495449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:54.496120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:54.498114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:54.498139Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:54.498141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:54.498145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:54.498151Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 748 [1:7556533653453177688:9357]
2025-10-02T08:09:54.498163Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:54.498178Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:54.498181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.498184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.498186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.498206Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:54.498216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:54.498222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:54.498287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.498294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.498297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:54.498299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:54.498360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:54.498366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.498380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.498396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:54.498411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 748
2025-10-02T08:09:54.498419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177735:9359], now have 1 active actors on pipe
2025-10-02T08:09:54.498422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533653913332249:2378], now have 1 active actors on pipe
2025-10-02T08:09:54.498428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533653453177681:9357]
2025-10-02T08:09:54.498430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533653453177681:9357]
2025-10-02T08:09:54.498442Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:54.498455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.498463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.498463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:54.498466Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:54.498481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:54.498498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:54.498504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:54.498544Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:54.498556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.498523Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 748
2025-10-02T08:09:54.498561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.498562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:54.498572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.498584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:54.498596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533653453177681:9357]
2025-10-02T08:09:54.498607Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:54.498618Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:54.498642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.498695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.498701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.498713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.498751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 749 partition: 0 MaxSeqNo: 17 sessionId: src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0
2025-10-02T08:09:54.499091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1107fbdc-747c5ee8-3aedc0b2-dd0fd45c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:54.502272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0] Write session: try to update token
2025-10-02T08:09:54.502287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:54.517891Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:54.517919Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:54.517923Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:54.517933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533653453177681:9357]
2025-10-02T08:09:54.517939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533653453177681:9357]
2025-10-02T08:09:54.517990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:54.517997Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:54.517997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:54.518003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.518005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:54.518164Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:54.518435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId: src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:54.521255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:54.577255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533653453177755:8944]
2025-10-02T08:09:54.577383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 748, pipe: [1:7556533653453177755:8944]
2025-10-02T08:09:54.656274Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:54.656622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.656635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.656670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177755:8944], now have 1 active actors on pipe
2025-10-02T08:09:54.656732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:54.656739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:54.656783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 749 reason: error at write: Disconnected sessionId: src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0
2025-10-02T08:09:54.656895Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:54.656895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:54.656971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 749 sessionId: src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0 is DEAD
2025-10-02T08:09:54.657091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533653453177755:8944]
2025-10-02T08:09:54.657117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:54.657127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0] Write session will restart in 0.007193s
2025-10-02T08:09:54.657157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0] Write session: Do CDS request
2025-10-02T08:09:54.657165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:54.665271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.665346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:54.665360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 750
2025-10-02T08:09:54.665480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.665507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:54.665512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:54.665518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:54.665939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 750 sessionId:  describe result for acl check
2025-10-02T08:09:54.665974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:54.665979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:54.665981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:54.665988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533653453177846:9367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:54.666022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:54.666377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:54.666433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533653453177846:9367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:54.666519Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:54.666545Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:54.666554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:54.666594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:54.666628Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533653453177854:9365]
2025-10-02T08:09:54.667223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:54.667383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:54.667433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:54.667714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:54.667760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.667765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.667766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.667768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.667769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.667774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.667783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.667787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.667790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.667794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.667799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.667805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.667810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.667814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.667818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.667824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.667828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.667832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.667837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.667841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.667857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:54.668157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533653453177846:9367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:54.673734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533653453177846:9367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:54.673749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533653453177846:9367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:54.673752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533653453177846:9367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:54.673762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:54.675929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:54.677750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:54.677767Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:54.677769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:54.677772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:54.677779Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 749 [1:7556533653453177854:9365]
2025-10-02T08:09:54.677791Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:54.677807Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:54.677810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.677813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.677815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.677833Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:54.677844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:54.677850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:54.677913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.677923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.677925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:54.677928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:54.677996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:54.678004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.678019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.678037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:54.678039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 749
2025-10-02T08:09:54.678062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177898:9367], now have 1 active actors on pipe
2025-10-02T08:09:54.678071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533653913332268:2378], now have 1 active actors on pipe
2025-10-02T08:09:54.678076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.678080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.678096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533653453177845:9365]
2025-10-02T08:09:54.678099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533653453177845:9365]
2025-10-02T08:09:54.678109Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:54.678121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:54.678126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:54.678130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:54.678132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:54.678135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:54.678144Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:54.678149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.678152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.678153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:54.678160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.678168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:54.678195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533653453177845:9365]
2025-10-02T08:09:54.678204Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:54.678210Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:54.678213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.678169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 749
2025-10-02T08:09:54.678302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.678308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.678319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.678354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 750 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0
2025-10-02T08:09:54.678676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2b1af03-31a5225b-d8e212d-844e6b56_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:54.681596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0] Write session: try to update token
2025-10-02T08:09:54.681613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:54.691636Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:54.691653Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:54.691663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533653453177845:9365]
2025-10-02T08:09:54.691700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:54.691701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:54.691876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:54.692023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:54.692164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:54.692288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:54.692498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:54.692537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:54.698388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId: src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:54.701065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:54.701142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.701159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.701195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:54.701222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:54.701274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.701287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.701478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.701552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.701620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.701697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.702091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.702099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.702180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.702253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.702321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.702394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.702446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.702454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.702527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.702594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.702662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.702729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.702777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.702784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.702849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.702916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.702977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.703043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.703089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.703095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.703167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.703232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.703298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.703363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.703436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.703443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.703517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.703584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.703648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.703713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.703759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.703767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.703837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.703899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.703969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.704038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.704091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.704102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.704165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.704227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.704290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.704356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.704405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.704411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.704479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.704543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.704620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.704690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.704862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.704875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.704953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.705019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.705084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.705153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.705198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.705205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.705247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:54.705314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.705340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.705342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:54.705372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:54.705389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:54.705395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:54.705398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:54.705401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:54.705809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:54.705837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:54.705844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:54.705847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:54.705850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:54.705854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:54.706329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:54.706350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:54.706356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:54.706359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:54.706362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:54.706365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:54.706837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:54.706861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:54.706866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:54.706869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:54.706872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:54.709124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:54.709141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:54.709154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392594708
2025-10-02T08:09:54.709451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:54.709466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:54.709472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:54.709475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:54.709480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:54.709483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:54.709936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:54.709956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:54.709963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:54.709965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:54.709968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:54.709970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:54.710509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:54.710528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:54.710533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:54.710535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:54.710537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:54.710539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:54.710973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:54.710998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:54.711003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:54.712112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:54.712129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:54.712137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:54.712140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:54.712148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392594711
2025-10-02T08:09:54.712455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:54.712481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:54.712489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:54.712492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:54.712497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:54.712500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:54.713005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:54.713026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:54.713032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:54.713035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:54.713038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:54.713042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:54.713589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:54.713611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.713714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392594713
2025-10-02T08:09:54.717939Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:54.717963Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:54.717971Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:54.717979Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:54.719769Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:54.719784Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:54.719786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:54.719794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533653453177845:9365]
2025-10-02T08:09:54.719798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533653453177845:9365]
2025-10-02T08:09:54.719866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:54.719882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.719884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:54.719885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:54.719888Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:54.720040Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:54.760468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533653453177932:8944]
2025-10-02T08:09:54.762204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 749, pipe: [1:7556533653453177932:8944]
2025-10-02T08:09:54.863196Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:54.863547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453177932:8944], now have 1 active actors on pipe
2025-10-02T08:09:54.863679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533653453177932:8944]
2025-10-02T08:09:54.863701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:54.863703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:54.863728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 750 reason: error at write: Disconnected sessionId: src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0
2025-10-02T08:09:54.863749Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:54.863773Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:54.863998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:54.864005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0] Write session will restart in 0.008757s
2025-10-02T08:09:54.864026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0] Write session: Do CDS request
2025-10-02T08:09:54.864034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:54.863897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 750 sessionId: src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0 is DEAD
2025-10-02T08:09:54.872193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:54.872554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:54.872669Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:54.872675Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:54.872682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:54.872707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:54.872740Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533653453178042:9383]
2025-10-02T08:09:54.873224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:54.873719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:54.873772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:54.874070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:54.874107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.874114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.874116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.874117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.874118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.874123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.874132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.874136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.874139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.874143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.874148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.874165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:54.874173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.874178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:54.874181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.874186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:54.874190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.874195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.874200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.874209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.874226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:54.874355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.874504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:54.874515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 751
2025-10-02T08:09:54.874652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:54.874686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:54.874694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:54.874698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:54.875116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 751 sessionId:  describe result for acl check
2025-10-02T08:09:54.875170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:54.875176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:54.875178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:54.875184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533653453178058:9385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:54.875713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533653453178058:9385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:54.877652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533653453178058:9385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:54.883255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533653453178058:9385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:54.883274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533653453178058:9385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:54.883277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533653453178058:9385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:54.883286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:54.883706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:54.885458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:54.885475Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:54.885477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:54.885480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:54.885485Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 750 [1:7556533653453178042:9383]
2025-10-02T08:09:54.885496Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:54.885509Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:54.885512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.885515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.885517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.885530Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:54.885535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:54.885540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:54.885599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.885605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.885608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:54.885610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:54.885668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:54.885675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.885688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:54.885703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:54.885722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453178086:9385], now have 1 active actors on pipe
2025-10-02T08:09:54.885729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533653913332297:2378], now have 1 active actors on pipe
2025-10-02T08:09:54.885736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533653453178036:9383]
2025-10-02T08:09:54.885739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 750
2025-10-02T08:09:54.885742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533653453178036:9383]
2025-10-02T08:09:54.885748Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:54.885758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:54.885758Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:54.885761Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:54.885774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:54.885781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:54.885787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.885794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.885831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533653453178036:9383]
2025-10-02T08:09:54.885838Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:54.885841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:54.885819Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 750
2025-10-02T08:09:54.885851Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:54.885860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.885867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.885869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:54.885876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.885884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:54.885919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.885996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.886002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.886014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:54.886044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 751 partition: 0 MaxSeqNo: 17 sessionId: src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0
2025-10-02T08:09:54.886353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1949ac-736ffcac-7bd8784-abbc8eca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:54.889065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0] Write session: try to update token
2025-10-02T08:09:54.889077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:54.897136Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:54.897163Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:54.897176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533653453178036:9383]
2025-10-02T08:09:54.897230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:54.897232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:54.897427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:54.897652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:54.897860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:54.898084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:54.898334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:54.898378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:54.903385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId: src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:54.905962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:54.906030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.906038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.906074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:54.906099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:54.906219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:54.906227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:54.906418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.906476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.906558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.906621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.906676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.906680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.906763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.906827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.906895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.906960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.907019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.907022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.907086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.907144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.907209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.907266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.907320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.907328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.907400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.907480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.907544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.907611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.907659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.907666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.907729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.907789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.907853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.907922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.907974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.907981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.908048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.908110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.908175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.908240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.908288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.908298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.908365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.908427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.908495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.908560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.908606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.908613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.908677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.908739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.908828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.908901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.908947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.908954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.909024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.909088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.909152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.909224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.909274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.909281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.909348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:54.909419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:54.909485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:54.909549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:54.909594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:54.909601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:54.909642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:54.909721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:54.909747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:54.909754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:54.909784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:54.909800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:54.909809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:54.909811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:54.909814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:54.910228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:54.910251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:54.910256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:54.910260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:54.910263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:54.910265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:54.910769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:54.910788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:54.910793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:54.910796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:54.910800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:54.910804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:54.911607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:54.911633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:54.911639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:54.911642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:54.911648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:54.913045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:54.913066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:54.913077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392594913
2025-10-02T08:09:54.913202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:54.913218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:54.913227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:54.913232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:54.913236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:54.913239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:54.913861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:54.913883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:54.913889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:54.913893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:54.913896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:54.913899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:54.914461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:54.914481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:54.914492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:54.914495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:54.914499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:54.914502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:54.914980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:54.915004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:54.915009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:54.916197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:54.916214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:54.916219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:54.916223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:54.916232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392594916
2025-10-02T08:09:54.916575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:54.916594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:54.916601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:54.916603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:54.916605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:54.916607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:54.917151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:54.917176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:54.917185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:54.917189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:54.917192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:54.917195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:54.917718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:54.917730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:54.917811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392594917
2025-10-02T08:09:54.918525Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:54.918550Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:54.918558Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:54.918561Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:54.919975Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:54.919977Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:54.919978Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:54.919984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533653453178036:9383]
2025-10-02T08:09:54.919986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533653453178036:9383]
2025-10-02T08:09:54.920039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:54.920043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:54.920044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:54.920049Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:54.920055Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:54.920164Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:54.963792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533653453178118:8944]
2025-10-02T08:09:54.963905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 750, pipe: [1:7556533653453178118:8944]
2025-10-02T08:09:55.066664Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:55.067012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533653453178118:8944], now have 1 active actors on pipe
2025-10-02T08:09:55.067115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:55.067123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:55.067148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 751 reason: error at write: Disconnected sessionId: src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0
2025-10-02T08:09:55.067221Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:55.067301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 751 sessionId: src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0 is DEAD
2025-10-02T08:09:55.067470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:55.067446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:55.067479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0] Write session will restart in 0.008027s
2025-10-02T08:09:55.067513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0] Write session: Do CDS request
2025-10-02T08:09:55.067519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:55.067489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533653453178118:8944]
2025-10-02T08:09:55.075203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:55.076275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.076339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:55.076360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:55.076366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 752
2025-10-02T08:09:55.076484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.076519Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:55.076521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:55.076526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:55.076528Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:55.076529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:55.076537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:55.076588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:55.076627Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533657748145520:9390]
2025-10-02T08:09:55.076977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 752 sessionId:  describe result for acl check
2025-10-02T08:09:55.077009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:55.077011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:55.077013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:55.077017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533657748145524:9392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:55.077219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:55.077521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533657748145524:9392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:55.077550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:55.077592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:55.077923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:55.077977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.077978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.077979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.077980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.077982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.077987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.077997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.078001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.078004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.078008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.078013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.078020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.078026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.078030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.078035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.078039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.078043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.078048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.078052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.078057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.078076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:55.080482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533657748145524:9392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:55.084759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533657748145524:9392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:55.084775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533657748145524:9392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:55.084778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533657748145524:9392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:55.084786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:55.086392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:55.087990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:55.088009Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:55.088012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:55.088015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:55.088022Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 751 [1:7556533657748145520:9390]
2025-10-02T08:09:55.088034Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:55.088053Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:55.088058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.088061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.088063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.088079Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:55.088091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:55.088097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:55.088159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.088167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.088169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:55.088171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:55.088235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:55.088248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.088261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.088272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:55.088291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748145568:9392], now have 1 active actors on pipe
2025-10-02T08:09:55.088303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533657748145512:9390]
2025-10-02T08:09:55.088305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533657748145512:9390]
2025-10-02T08:09:55.088317Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:55.088326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533658208299601:2378], now have 1 active actors on pipe
2025-10-02T08:09:55.088334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:55.088347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:55.088354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:55.088385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:55.088387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533657748145512:9390]
2025-10-02T08:09:55.088390Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:55.088395Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:55.088402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:55.088403Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 751
2025-10-02T08:09:55.088428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 751
2025-10-02T08:09:55.088449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.088457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.088479Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:55.088491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.088498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.088502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:55.088511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.088523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:55.088550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.088674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.088682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.088694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.088721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 752 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0
2025-10-02T08:09:55.089074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1469fcd-1df81500-d455471b-a21ed9f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:55.091781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0] Write session: try to update token
2025-10-02T08:09:55.091798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:55.106327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId: src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:55.109035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:55.109086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.109094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.109126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:55.109155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:55.109213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.109221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.109389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.109465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.109538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.109611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.109660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.109669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.109743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.109807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.109890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.109957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.110008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.110016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.110086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.110156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.110222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.110299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.110353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.110361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.110422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.110492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.110553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.110624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.110674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.110687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.110760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.110828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.110904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.110973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.111027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.111037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.111105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.111175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.111244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.111313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.111368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.111379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.111462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.111522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.111584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.111641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.111686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.111689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.111757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.111821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.111882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.111943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.111992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.111997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.112064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.112119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.112176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.112236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.112287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.112291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.112358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.112415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.112474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.112533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.112580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.112583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.112623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:55.112690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.112708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.112710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:55.112742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:55.112756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:55.112759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:55.112762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:55.112764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:55.113248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:55.113279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:55.113286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:55.113290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:55.113292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:55.113296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:55.113989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:55.114005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:55.114013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:55.114016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:55.114019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:55.114021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:55.114551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:55.114570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:55.114576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:55.114579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:55.114583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:55.115890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:55.115901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:55.115914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392595115
2025-10-02T08:09:55.116183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:55.116196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:55.116201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:55.116204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:55.116207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:55.116209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:55.116721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:55.116736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:55.116741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:55.116745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:55.116748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:55.116752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:55.117580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:55.117614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:55.117621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:55.117624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:55.117628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:55.117631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:55.118139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:55.118167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:55.118176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:55.119393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:55.119427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:55.119432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:55.119436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:55.119447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392595119
2025-10-02T08:09:55.119745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:55.119772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:55.119778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:55.119781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:55.119785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:55.119788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:55.120312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:55.120327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:55.120351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:55.120356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:55.120360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:55.120363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:55.120906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:55.120919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.121033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392595120
2025-10-02T08:09:55.121838Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:55.121855Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:55.121862Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:55.121869Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:55.123486Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:55.123496Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:55.123498Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:55.123505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533657748145512:9390]
2025-10-02T08:09:55.123509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533657748145512:9390]
2025-10-02T08:09:55.123540Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:55.123549Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:55.123559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:55.123567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.123569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:55.123688Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:55.167557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533657748145589:8944]
2025-10-02T08:09:55.167674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 751, pipe: [1:7556533657748145589:8944]
2025-10-02T08:09:55.258318Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:55.258598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748145589:8944], now have 1 active actors on pipe
2025-10-02T08:09:55.258789Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:55.258926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:55.258883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:55.258959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 752 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0
2025-10-02T08:09:55.259045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533657748145589:8944]
2025-10-02T08:09:55.259115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 752 sessionId: src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0 is DEAD
2025-10-02T08:09:55.259252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:55.259262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0] Write session will restart in 0.005209s
2025-10-02T08:09:55.259287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0] Write session: Do CDS request
2025-10-02T08:09:55.259294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:55.265269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.265381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:55.265395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 753
2025-10-02T08:09:55.265511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.265544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:55.265551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:55.265554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:55.265986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 753 sessionId:  describe result for acl check
2025-10-02T08:09:55.266021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:55.266027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:55.266028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:55.266034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533657748145687:9398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:55.266509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533657748145687:9398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:55.266896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:55.268050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:55.268183Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:55.268189Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:55.268196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:55.268226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:55.268254Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533657748145714:9396]
2025-10-02T08:09:55.268661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:55.268697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533657748145687:9398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:55.268819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:55.268857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:55.269069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:55.269096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.269100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.269101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.269102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.269102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.269106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.269112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.269114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.269116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.269119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.269122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.269127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.269130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.269133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.269135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.269138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.269140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.269143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.269145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.269148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.269157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:55.274469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533657748145687:9398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:55.274487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533657748145687:9398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:55.274490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533657748145687:9398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:55.274499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:55.277218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:55.278785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:55.278800Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:55.278802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:55.278806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:55.278813Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 752 [1:7556533657748145714:9396]
2025-10-02T08:09:55.278823Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:55.278841Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:55.278844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.278846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.278848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.278864Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:55.278868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:55.278874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:55.278932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.278939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.278942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:55.278945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:55.279006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:55.279016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.279030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.279041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:55.279057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748145742:9398], now have 1 active actors on pipe
2025-10-02T08:09:55.279068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533657748145694:9396]
2025-10-02T08:09:55.279070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533657748145694:9396]
2025-10-02T08:09:55.279076Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:55.279081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 752
2025-10-02T08:09:55.279085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533658208299608:2378], now have 1 active actors on pipe
2025-10-02T08:09:55.279087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:55.279090Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:55.279090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:55.279102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:55.279109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:55.279116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.279119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.279155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533657748145694:9396]
2025-10-02T08:09:55.279164Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:55.279177Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:55.279156Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 752
2025-10-02T08:09:55.279182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.279186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.279187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:55.279195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.279195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:55.279202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:55.279451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.279490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.279496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.279508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.279545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 753 partition: 0 MaxSeqNo: 17 sessionId: src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0
2025-10-02T08:09:55.279880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc73ef26-b883bc95-6859bd47-9d5567be_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:55.282648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0] Write session: try to update token
2025-10-02T08:09:55.282666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:55.312526Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:55.312544Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:55.312549Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:55.312557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533657748145694:9396]
2025-10-02T08:09:55.312561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533657748145694:9396]
2025-10-02T08:09:55.312605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:55.312610Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:55.312612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.312614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:55.312615Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:55.312760Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:55.313392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId: src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:55.316079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:55.359100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533657748145756:8944]
2025-10-02T08:09:55.359212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 752, pipe: [1:7556533657748145756:8944]
2025-10-02T08:09:55.467862Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:55.468290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.468298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.468339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748145756:8944], now have 1 active actors on pipe
2025-10-02T08:09:55.468461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533657748145756:8944]
2025-10-02T08:09:55.468481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:55.468483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:55.468552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 753 reason: error at write: Disconnected sessionId: src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0
2025-10-02T08:09:55.468698Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:55.468718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 753 sessionId: src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0 is DEAD
2025-10-02T08:09:55.468747Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:55.468890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:55.468901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0] Write session will restart in 0.006113s
2025-10-02T08:09:55.468928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0] Write session: Do CDS request
2025-10-02T08:09:55.468935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:55.476302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.477145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:55.477159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 754
2025-10-02T08:09:55.477300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.477324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:55.477328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:55.477333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:55.478523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 754 sessionId:  describe result for acl check
2025-10-02T08:09:55.478553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:55.478554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:55.478556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:55.478561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533657748145836:9403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:55.480608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533657748145836:9403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:55.482959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533657748145836:9403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:55.486218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:55.488107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:55.488357Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:55.488362Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:55.488373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:55.488434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:55.488483Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533657748145900:9402]
2025-10-02T08:09:55.489783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:55.490019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:55.490076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:55.490419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:55.490469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.490470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.490475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.490476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.490477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.490483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.490493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.490497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.490502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.490506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.490511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.490519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.490524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.490529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.490533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.490538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.490542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.490548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.490552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.490557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.490576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:55.491386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533657748145836:9403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:55.491397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533657748145836:9403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:55.491400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533657748145836:9403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:55.491421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:55.500085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:55.501776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:55.501797Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:55.501801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:55.501806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:55.501814Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 753 [1:7556533657748145900:9402]
2025-10-02T08:09:55.501827Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:55.501860Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:55.501864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.501867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.501869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.501888Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:55.501894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:55.501902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:55.501973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.501976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.501979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:55.501982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:55.502057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:55.502060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.502075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.502088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:55.502105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533657748145892:9402]
2025-10-02T08:09:55.502107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533657748145892:9402]
2025-10-02T08:09:55.502115Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:55.502133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:55.502148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:55.502148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 753
2025-10-02T08:09:55.502152Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:55.502155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:55.502156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:55.502166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748145916:9403], now have 1 active actors on pipe
2025-10-02T08:09:55.502199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533657748145892:9402]
2025-10-02T08:09:55.502207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:55.502212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:55.502213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.502217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.502229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533658208299618:2378], now have 1 active actors on pipe
2025-10-02T08:09:55.502264Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:55.502270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.502274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.502276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:55.502284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.502292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:55.502311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.502508Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 753
2025-10-02T08:09:55.502408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.502423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.502450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.502491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 754 partition: 0 MaxSeqNo: 17 sessionId: src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0
2025-10-02T08:09:55.505037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79638bce-466bf324-eb6f2dce-3b9d17ee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:55.507937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0] Write session: try to update token
2025-10-02T08:09:55.507954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:55.519219Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:55.519234Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:55.519243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533657748145892:9402]
2025-10-02T08:09:55.519289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:55.519483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:55.519623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:55.519747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:55.519886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:55.520167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:55.520195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:55.520969Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:55.531267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId: src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:55.534472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:55.536117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.536140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.536186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:55.536219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:55.536436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.536442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.536671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.536743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.536835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.536915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.536973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.536979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.537063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.537149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.537221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.537294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.537348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.537352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.537439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.537511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.537581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.537653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.537706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.537710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.537792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.537860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.537928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.538003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.538056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.538059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.538153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.538231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.538311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.538399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.538456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.538460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.538551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.538635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.538715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.538803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.538860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.538862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.538948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.539015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.539085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.539158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.539222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.539224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.539308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.539375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.539465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.539544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.539595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.539597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.539685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.539761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.539841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.539913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.539967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.539970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.540057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:55.540129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:55.540203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:55.540278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:55.540338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:55.540342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:55.540632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:55.540715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.540737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.540740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:55.540780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:55.540795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:55.540798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:55.540815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:55.540821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:55.541277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:55.541299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:55.541306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:55.541309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:55.541312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:55.541316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:55.541857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:55.541872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:55.541879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:55.541882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:55.541886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:55.541889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:55.542701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:55.542719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:55.542725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:55.542730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:55.542734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:55.544583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:55.544605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:55.544620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392595544
2025-10-02T08:09:55.544755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:55.544768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:55.544774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:55.544778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:55.544783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:55.544791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:55.545558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:55.545574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:55.545581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:55.545585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:55.545589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:55.545593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:55.546163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:55.546179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:55.546191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:55.546195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:55.546200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:55.546203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:55.546825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:55.546840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:55.546847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:55.548580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:55.548861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:55.548879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:55.548885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:55.548901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392595548
2025-10-02T08:09:55.549262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:55.549277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:55.549288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:55.549292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:55.549299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:55.549302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:55.549928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:55.549956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:55.549964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:55.549968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:55.549972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:55.549977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:55.550557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:55.550571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.550694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392595550
2025-10-02T08:09:55.553541Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:55.553575Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:55.553583Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:55.553591Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:55.553605Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:55.553608Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:55.553614Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:55.553624Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533657748145892:9402]
2025-10-02T08:09:55.553631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533657748145892:9402]
2025-10-02T08:09:55.553715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:55.553724Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:55.553738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:55.553744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.553747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:55.553919Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:55.568484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533657748145937:8944]
2025-10-02T08:09:55.568656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 753, pipe: [1:7556533657748145937:8944]
2025-10-02T08:09:55.700761Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:55.700148Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:55.700478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748145937:8944], now have 1 active actors on pipe
2025-10-02T08:09:55.700708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533657748145937:8944]
2025-10-02T08:09:55.700727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:55.700729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:55.700731Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:55.700757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 754 reason: error at write: Disconnected sessionId: src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0
2025-10-02T08:09:55.700935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 754 sessionId: src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0 is DEAD
2025-10-02T08:09:55.701084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:55.701096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0] Write session will restart in 0.006328s
2025-10-02T08:09:55.701119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0] Write session: Do CDS request
2025-10-02T08:09:55.701126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:55.708320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.708412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:55.708432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 755
2025-10-02T08:09:55.708464Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [8b60f72f83a3b166] Result# TEvPutResult {Id# [72075186224037892:753:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:55.708464Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:753:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:55.708490Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:753:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:55.708571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.708616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:55.708627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:55.708631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:55.709015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 755 sessionId:  describe result for acl check
2025-10-02T08:09:55.709047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:55.709049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:55.709050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:55.709055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533657748145989:9411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:55.709512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533657748145989:9411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:55.712241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533657748145989:9411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:55.714658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:55.715192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533657748145989:9411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:55.715204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533657748145989:9411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:55.715208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533657748145989:9411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:55.715217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:55.715485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:55.715702Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:55.715714Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:55.715726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:55.715803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:55.715844Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533657748146103:9410]
2025-10-02T08:09:55.716421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:55.716626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:55.716680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:55.717097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:55.717163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.717164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.717165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.717166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.717167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.717172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.717183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.717186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.717190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.717193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.717199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.717206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.717212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.717216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.717220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.717224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.717230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.717234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.717238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.717242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.717259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:55.726872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:55.728420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:55.728441Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:55.728444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:55.728448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:55.728454Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 754 [1:7556533657748146103:9410]
2025-10-02T08:09:55.728466Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:55.728482Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:55.728484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.728487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.728489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.728508Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:55.728512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:55.728518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:55.728579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.728587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.728590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:55.728592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:55.728657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:55.728666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.728683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.728693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:55.728710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533657748146091:9410]
2025-10-02T08:09:55.728716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533657748146091:9410]
2025-10-02T08:09:55.728724Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:55.728730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 754
2025-10-02T08:09:55.728733Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:55.728735Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:55.728736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748146098:9411], now have 1 active actors on pipe
2025-10-02T08:09:55.728745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:55.728756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:55.728759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:55.728764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533658208299637:2378], now have 1 active actors on pipe
2025-10-02T08:09:55.728769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.728772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.728835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533657748146091:9410]
2025-10-02T08:09:55.728844Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:55.728853Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:55.728859Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:55.728865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.728873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.728879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:55.728867Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 754
2025-10-02T08:09:55.728888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.728899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:55.728939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.728992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.728999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.729013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.729055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 755 partition: 0 MaxSeqNo: 17 sessionId: src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0
2025-10-02T08:09:55.729499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cb8373-b8e90a85-b904739-2f2b838d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:55.732532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0] Write session: try to update token
2025-10-02T08:09:55.732549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:55.747998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId: src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:55.748866Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:55.748879Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:55.748882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:55.748890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533657748146091:9410]
2025-10-02T08:09:55.748895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533657748146091:9410]
2025-10-02T08:09:55.748937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:55.748947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.748949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:55.749005Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:55.749018Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:55.749099Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:55.750881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:55.808595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533657748146141:8944]
2025-10-02T08:09:55.808822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 754, pipe: [1:7556533657748146141:8944]
2025-10-02T08:09:55.903433Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:55.903719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.903728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.903763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748146141:8944], now have 1 active actors on pipe
2025-10-02T08:09:55.904291Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:55.904178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:55.904190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:55.904245Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:55.904254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 755 reason: error at write: Disconnected sessionId: src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0
2025-10-02T08:09:55.904594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:55.904609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0] Write session will restart in 0.005926s
2025-10-02T08:09:55.904426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 755 sessionId: src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0 is DEAD
2025-10-02T08:09:55.904641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0] Write session: Do CDS request
2025-10-02T08:09:55.904648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:55.904554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533657748146141:8944]
2025-10-02T08:09:55.914414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.914512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:55.914524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 756
2025-10-02T08:09:55.916226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:55.916251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:55.916255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:55.916258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:55.916629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:55.916674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 756 sessionId:  describe result for acl check
2025-10-02T08:09:55.916703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:55.916704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:55.916705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:55.916710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533657748146279:9430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:55.917247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533657748146279:9430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:55.918956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:55.919143Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:55.919152Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:55.919161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:55.919225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:55.919258Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533657748146287:9428]
2025-10-02T08:09:55.919809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:55.920201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:55.920244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:55.920478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:55.920520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.920524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.920526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.920527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.920527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.920534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.920544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.920552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.920556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.920559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.920565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.920576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:55.920585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.920590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:55.920598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.920603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:55.920611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.920615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.920620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.920628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.920647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:55.923094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533657748146279:9430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:55.929507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:55.931976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 755
2025-10-02T08:09:55.931300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:55.931310Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:55.931314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:55.931320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:55.931329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 755 [1:7556533657748146287:9428]
2025-10-02T08:09:55.931347Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:55.931371Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:55.931375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.931379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.931381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.931417Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:55.931424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:55.931433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:55.931531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.931533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.931537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:55.931541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:55.931630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:55.931633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.931650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:55.931664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:55.931688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533657748146275:9428]
2025-10-02T08:09:55.931690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533657748146275:9428]
2025-10-02T08:09:55.931700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:55.931717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:55.931725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:55.931732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:55.931732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:55.931736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:55.931749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533658208299668:2378], now have 1 active actors on pipe
2025-10-02T08:09:55.931798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533657748146275:9428]
2025-10-02T08:09:55.931815Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:55.931961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:55.932672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533657748146279:9430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:55.932687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533657748146279:9430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:55.932691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533657748146279:9430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:55.932700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:55.933266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 755
2025-10-02T08:09:55.933277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533657748146331:9430], now have 1 active actors on pipe
2025-10-02T08:09:55.933284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.933290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.933322Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a10a382a-ceec6915-96bf7-e61d59db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:55.933333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:55.933338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:55.933341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:55.933353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:55.933370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:55.933388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.933532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:55.933541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:55.933560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:55.933591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 756 partition: 0 MaxSeqNo: 17 sessionId: src_id|a10a382a-ceec6915-96bf7-e61d59db_0
2025-10-02T08:09:55.934062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|207ce3d1-1424ed8f-b934064d-3ac63c2b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a10a382a-ceec6915-96bf7-e61d59db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:55.937031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a10a382a-ceec6915-96bf7-e61d59db_0] Write session: try to update token
2025-10-02T08:09:55.937049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a10a382a-ceec6915-96bf7-e61d59db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:55.952658Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:55.952681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:55.952684Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:55.952695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533657748146275:9428]
2025-10-02T08:09:55.952699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533657748146275:9428]
2025-10-02T08:09:55.952754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:55.952759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:55.952766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:55.952790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:55.952799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:55.952959Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:55.968886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId: src_id|a10a382a-ceec6915-96bf7-e61d59db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:55.972024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:56.005800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533662043113636:8944]
2025-10-02T08:09:56.006546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 755, pipe: [1:7556533662043113636:8944]
2025-10-02T08:09:56.106227Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:56.106811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.106833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.106861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043113636:8944], now have 1 active actors on pipe
2025-10-02T08:09:56.107179Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:56.107263Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:56.107720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533662043113636:8944]
2025-10-02T08:09:56.107754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:56.107813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 756 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a10a382a-ceec6915-96bf7-e61d59db_0
2025-10-02T08:09:56.108013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 756 sessionId: src_id|a10a382a-ceec6915-96bf7-e61d59db_0 is DEAD
2025-10-02T08:09:56.108443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10a382a-ceec6915-96bf7-e61d59db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:56.108455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10a382a-ceec6915-96bf7-e61d59db_0] Write session will restart in 0.005631s
2025-10-02T08:09:56.108484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10a382a-ceec6915-96bf7-e61d59db_0] Write session: Do CDS request
2025-10-02T08:09:56.108492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10a382a-ceec6915-96bf7-e61d59db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:56.115390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a10a382a-ceec6915-96bf7-e61d59db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.115532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:56.115552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 757
2025-10-02T08:09:56.115725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.115763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:56.115769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:56.115772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:56.116206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 757 sessionId:  describe result for acl check
2025-10-02T08:09:56.116257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:56.116265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:56.116267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:56.116273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533662043113744:9436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:56.116787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:56.116861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533662043113744:9436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:56.118401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:56.118600Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:56.118615Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:56.118625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:56.118682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:56.118721Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533662043113769:9435]
2025-10-02T08:09:56.119353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:56.119377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533662043113744:9436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:56.119553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:56.119592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:56.119886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:56.119923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.119924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.119926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.119927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.119928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.119932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.119942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.119945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.119949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.119953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.119959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.119966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.119971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.119976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.119980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.119985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.119989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.119994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.119999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.120003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.120022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:56.126467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533662043113744:9436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:56.126496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533662043113744:9436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:56.126500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533662043113744:9436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:56.126509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:56.130052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:56.131939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:56.131958Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:56.131961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:56.131964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:56.131971Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 756 [1:7556533662043113769:9435]
2025-10-02T08:09:56.131983Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:56.132000Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:56.132004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.132008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.132010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.132029Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:56.132040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:56.132046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:56.132106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.132113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.132116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:56.132119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:56.132184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:56.132192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.132206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.132219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:56.132239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533662043113745:9435]
2025-10-02T08:09:56.132248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533662043113745:9435]
2025-10-02T08:09:56.132256Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:56.132270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:56.132275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 756
2025-10-02T08:09:56.132284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:56.132286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:56.132296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043113796:9436], now have 1 active actors on pipe
2025-10-02T08:09:56.132296Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:56.132303Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:56.132305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533662503266972:2378], now have 1 active actors on pipe
2025-10-02T08:09:56.132336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533662043113745:9435]
2025-10-02T08:09:56.132352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:56.132363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.132367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.132390Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:56.132408Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|403a6958-89af61fb-23962929-820f8fbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:56.132414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.132418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.132421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:56.132428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.132437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:56.132419Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 756
2025-10-02T08:09:56.132465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.132551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.132559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.132572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.132614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 757 partition: 0 MaxSeqNo: 17 sessionId: src_id|403a6958-89af61fb-23962929-820f8fbe_0
2025-10-02T08:09:56.132946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a10a382a-ceec6915-96bf7-e61d59db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|403a6958-89af61fb-23962929-820f8fbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:56.135680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403a6958-89af61fb-23962929-820f8fbe_0] Write session: try to update token
2025-10-02T08:09:56.135698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403a6958-89af61fb-23962929-820f8fbe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:56.151888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId: src_id|403a6958-89af61fb-23962929-820f8fbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:56.152531Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:56.152547Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:56.152550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:56.152557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533662043113745:9435]
2025-10-02T08:09:56.152561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533662043113745:9435]
2025-10-02T08:09:56.152604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:56.152607Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:56.152612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.152615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:56.152626Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:56.152756Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:56.154596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:56.207961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533662043113811:8944]
2025-10-02T08:09:56.208232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 756, pipe: [1:7556533662043113811:8944]
2025-10-02T08:09:56.289585Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:56.289942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.289956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.289994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043113811:8944], now have 1 active actors on pipe
2025-10-02T08:09:56.290145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:56.290159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:56.290228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 757 reason: error at write: Disconnected sessionId: src_id|403a6958-89af61fb-23962929-820f8fbe_0
2025-10-02T08:09:56.290342Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:56.290586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403a6958-89af61fb-23962929-820f8fbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:56.290597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403a6958-89af61fb-23962929-820f8fbe_0] Write session will restart in 0.006449s
2025-10-02T08:09:56.290622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403a6958-89af61fb-23962929-820f8fbe_0] Write session: Do CDS request
2025-10-02T08:09:56.290629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403a6958-89af61fb-23962929-820f8fbe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:56.290416Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:56.290436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 757 sessionId: src_id|403a6958-89af61fb-23962929-820f8fbe_0 is DEAD
2025-10-02T08:09:56.290656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533662043113811:8944]
2025-10-02T08:09:56.298369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403a6958-89af61fb-23962929-820f8fbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.298447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:56.298468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 758
2025-10-02T08:09:56.298620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.298657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:56.298667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:56.298672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:56.299121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 758 sessionId:  describe result for acl check
2025-10-02T08:09:56.299166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:56.299174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:56.299176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:56.299183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533662043113913:9442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:56.299795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533662043113913:9442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:56.301782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:56.302331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:56.302569Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:56.302574Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:56.302588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:56.302634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533662043113913:9442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:56.302658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:56.302714Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533662043113947:9441]
2025-10-02T08:09:56.303414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:56.303649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:56.303687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:56.304026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:56.304072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.304082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.304082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.304083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.304085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.304090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.304099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.304102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.304105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.304109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.304115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.304122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.304128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.304135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.304138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.304143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.304148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.304152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.304157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.304161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.304178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:56.310147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533662043113913:9442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:56.310175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533662043113913:9442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:56.310178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533662043113913:9442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:56.310187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:56.313757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:56.315322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:56.315339Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:56.315343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:56.315348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:56.315357Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 757 [1:7556533662043113947:9441]
2025-10-02T08:09:56.315372Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:56.315394Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:56.315413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.315417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.315420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.315441Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:56.315448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:56.315460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:56.315522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.315532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.315537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:56.315540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:56.315609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:56.315617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.315632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.315643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:56.315670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533662043113941:9441]
2025-10-02T08:09:56.315676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533662043113941:9441]
2025-10-02T08:09:56.315686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:56.315698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:56.315702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:56.315705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043113974:9442], now have 1 active actors on pipe
2025-10-02T08:09:56.315715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:56.315735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:56.315742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:56.315749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533662503266980:2378], now have 1 active actors on pipe
2025-10-02T08:09:56.315789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533662043113941:9441]
2025-10-02T08:09:56.315802Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:56.315830Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:56.315855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 757
2025-10-02T08:09:56.315869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.315874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.315907Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f52e457-418f1b00-df434389-e38a38b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:56.315856Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 757
2025-10-02T08:09:56.315921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.315925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.315927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:56.315940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.315951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:56.315966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.316422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.316432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.316455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.316504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 758 partition: 0 MaxSeqNo: 17 sessionId: src_id|9f52e457-418f1b00-df434389-e38a38b3_0
2025-10-02T08:09:56.316944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403a6958-89af61fb-23962929-820f8fbe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9f52e457-418f1b00-df434389-e38a38b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:56.319819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f52e457-418f1b00-df434389-e38a38b3_0] Write session: try to update token
2025-10-02T08:09:56.319840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f52e457-418f1b00-df434389-e38a38b3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:56.336137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId: src_id|9f52e457-418f1b00-df434389-e38a38b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:56.338512Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:56.338531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:56.338534Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:56.338551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533662043113941:9441]
2025-10-02T08:09:56.338557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533662043113941:9441]
2025-10-02T08:09:56.338608Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:56.338610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:56.338615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.338617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:56.338622Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:56.338772Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:56.340713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:56.390221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533662043113988:8944]
2025-10-02T08:09:56.390315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 757, pipe: [1:7556533662043113988:8944]
2025-10-02T08:09:56.481431Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:56.481652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.481667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.481707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043113988:8944], now have 1 active actors on pipe
2025-10-02T08:09:56.481863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533662043113988:8944]
2025-10-02T08:09:56.481894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:56.481896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:56.481969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 758 reason: error at write: Disconnected sessionId: src_id|9f52e457-418f1b00-df434389-e38a38b3_0
2025-10-02T08:09:56.481984Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:56.482300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f52e457-418f1b00-df434389-e38a38b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:56.482311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f52e457-418f1b00-df434389-e38a38b3_0] Write session will restart in 0.007589s
2025-10-02T08:09:56.482329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f52e457-418f1b00-df434389-e38a38b3_0] Write session: Do CDS request
2025-10-02T08:09:56.482335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f52e457-418f1b00-df434389-e38a38b3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:56.482143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 758 sessionId: src_id|9f52e457-418f1b00-df434389-e38a38b3_0 is DEAD
2025-10-02T08:09:56.483862Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:56.491355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f52e457-418f1b00-df434389-e38a38b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.491489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:56.491508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 759
2025-10-02T08:09:56.491632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.491668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:56.491678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:56.491681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:56.492110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 759 sessionId:  describe result for acl check
2025-10-02T08:09:56.492146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:56.492152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:56.492154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:56.492160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533662043114012:9447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:56.492702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533662043114012:9447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:56.494881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533662043114012:9447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:56.498953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533662043114012:9447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:56.498968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533662043114012:9447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:56.498971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533662043114012:9447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:56.498979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:56.501842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:56.503212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:56.503458Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:56.503471Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:56.503485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:56.503548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:56.503595Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533662043114147:9448]
2025-10-02T08:09:56.504111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:56.504404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:56.504477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:56.504867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:56.504924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.504930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.504932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.504933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.504934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.504940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.504950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.504954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.504957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.504965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.504971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.504978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.504983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.504988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.504995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.505001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.505005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.505015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.505020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.505025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.505045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:56.515063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:56.516779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:56.516855Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:56.516865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:56.516869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:56.516880Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 758 [1:7556533662043114147:9448]
2025-10-02T08:09:56.516896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:56.516926Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:56.516946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.516949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.516952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.516973Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:56.516980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:56.516989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:56.517083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.517093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.517097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:56.517099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:56.517184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:56.517195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.517265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.517288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:56.517311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533662043114141:9448]
2025-10-02T08:09:56.517319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533662043114141:9448]
2025-10-02T08:09:56.517335Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:56.517358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:56.517372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:56.517375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:56.517419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533662043114141:9448]
2025-10-02T08:09:56.517427Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:56.517452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043114117:9447], now have 1 active actors on pipe
2025-10-02T08:09:56.517492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 758
2025-10-02T08:09:56.517508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.517513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.517519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:56.517524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:56.517531Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:56.517542Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29b738aa-5d6fda00-829593d5-29156c4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:56.517551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.517555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.517557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:56.517570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.517580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:56.517599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.517691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.517694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.517707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.517739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 759 partition: 0 MaxSeqNo: 17 sessionId: src_id|29b738aa-5d6fda00-829593d5-29156c4c_0
2025-10-02T08:09:56.517937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533662503266988:2378], now have 1 active actors on pipe
2025-10-02T08:09:56.518178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f52e457-418f1b00-df434389-e38a38b3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|29b738aa-5d6fda00-829593d5-29156c4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:56.520913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 758
2025-10-02T08:09:56.521225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b738aa-5d6fda00-829593d5-29156c4c_0] Write session: try to update token
2025-10-02T08:09:56.521243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b738aa-5d6fda00-829593d5-29156c4c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:56.542078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId: src_id|29b738aa-5d6fda00-829593d5-29156c4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:56.542805Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:56.542826Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:56.542828Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:56.542838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533662043114141:9448]
2025-10-02T08:09:56.542843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533662043114141:9448]
2025-10-02T08:09:56.542894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:56.542904Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:56.542908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.542911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:56.542912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:56.543071Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:56.545244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:56.582229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533662043114177:8944]
2025-10-02T08:09:56.582391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 758, pipe: [1:7556533662043114177:8944]
2025-10-02T08:09:56.692070Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:56.692717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.692738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.692773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043114177:8944], now have 1 active actors on pipe
2025-10-02T08:09:56.692937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533662043114177:8944]
2025-10-02T08:09:56.692965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:56.692967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:56.692994Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:56.693035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 759 reason: error at write: Disconnected sessionId: src_id|29b738aa-5d6fda00-829593d5-29156c4c_0
2025-10-02T08:09:56.693220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 759 sessionId: src_id|29b738aa-5d6fda00-829593d5-29156c4c_0 is DEAD
2025-10-02T08:09:56.693482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:56.693611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b738aa-5d6fda00-829593d5-29156c4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:56.693624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b738aa-5d6fda00-829593d5-29156c4c_0] Write session will restart in 0.006148s
2025-10-02T08:09:56.693653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b738aa-5d6fda00-829593d5-29156c4c_0] Write session: Do CDS request
2025-10-02T08:09:56.693660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b738aa-5d6fda00-829593d5-29156c4c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:56.701441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b738aa-5d6fda00-829593d5-29156c4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.701501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:56.701516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 760
2025-10-02T08:09:56.701713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.701758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:56.701767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:56.701772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:56.702190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 760 sessionId:  describe result for acl check
2025-10-02T08:09:56.702221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:56.702230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:56.702231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:56.702236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533662043114296:9456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:56.702764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533662043114296:9456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:56.703310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:56.704737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:56.704979Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:56.704994Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:56.705006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:56.705063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:56.705113Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533662043114329:9455]
2025-10-02T08:09:56.705326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533662043114296:9456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:56.705837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:56.706092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:56.706151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:56.706486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:56.706537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.706543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.706544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.706546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.706546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.706552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.706562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.706565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.706568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.706572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.706580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.706593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.706602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.706607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.706611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.706621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.706626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.706631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.706638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.706648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.706667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:56.712475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533662043114296:9456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:56.712496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533662043114296:9456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:56.712500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533662043114296:9456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:56.712510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:56.715011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:56.717257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:56.717277Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:56.717280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:56.717285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:56.717292Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 759 [1:7556533662043114329:9455]
2025-10-02T08:09:56.717313Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:56.717337Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:56.717340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.717344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.717346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.717366Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:56.717372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:56.717381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:56.717466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.717481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.717485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:56.717489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:56.717565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:56.717576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.717591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.717608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:56.717636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043114356:9456], now have 1 active actors on pipe
2025-10-02T08:09:56.717635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 759
2025-10-02T08:09:56.717649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533662043114310:9455]
2025-10-02T08:09:56.717651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533662043114310:9455]
2025-10-02T08:09:56.717662Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:56.717678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:56.717687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:56.717691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:56.717693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:56.717697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:56.717706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.717712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.717766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533662043114310:9455]
2025-10-02T08:09:56.717780Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:56.717792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:56.717800Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b99707cc-3747a49-70c0858a-5c47471c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:56.717808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.717813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.717815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:56.717829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.717840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:56.717814Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 759
2025-10-02T08:09:56.717851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533662503267007:2378], now have 1 active actors on pipe
2025-10-02T08:09:56.717910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.718012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.718020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.718036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.718074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 760 partition: 0 MaxSeqNo: 17 sessionId: src_id|b99707cc-3747a49-70c0858a-5c47471c_0
2025-10-02T08:09:56.718465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b738aa-5d6fda00-829593d5-29156c4c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b99707cc-3747a49-70c0858a-5c47471c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:56.721168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99707cc-3747a49-70c0858a-5c47471c_0] Write session: try to update token
2025-10-02T08:09:56.721185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99707cc-3747a49-70c0858a-5c47471c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:56.736689Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:56.736711Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:56.736714Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:56.736722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533662043114310:9455]
2025-10-02T08:09:56.736726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533662043114310:9455]
2025-10-02T08:09:56.736773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:56.736780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.736782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:56.736783Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:56.736794Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:56.736948Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:56.740326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId: src_id|b99707cc-3747a49-70c0858a-5c47471c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:56.743113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:56.793199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533662043114370:8944]
2025-10-02T08:09:56.793321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 759, pipe: [1:7556533662043114370:8944]
2025-10-02T08:09:56.872247Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:56.872489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.872500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.872540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043114370:8944], now have 1 active actors on pipe
2025-10-02T08:09:56.872655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:56.872663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:56.872709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 760 reason: error at write: Disconnected sessionId: src_id|b99707cc-3747a49-70c0858a-5c47471c_0
2025-10-02T08:09:56.872789Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:56.872769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:56.872903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 760 sessionId: src_id|b99707cc-3747a49-70c0858a-5c47471c_0 is DEAD
2025-10-02T08:09:56.873019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533662043114370:8944]
2025-10-02T08:09:56.873259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99707cc-3747a49-70c0858a-5c47471c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:56.873286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99707cc-3747a49-70c0858a-5c47471c_0] Write session will restart in 0.008685s
2025-10-02T08:09:56.873315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99707cc-3747a49-70c0858a-5c47471c_0] Write session: Do CDS request
2025-10-02T08:09:56.873322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99707cc-3747a49-70c0858a-5c47471c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:56.880165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:56.881474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:56.881651Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:56.881660Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:56.881670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:56.881720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:56.881757Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533662043114529:9471]
2025-10-02T08:09:56.882515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:56.882741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:56.882799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:56.883153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:56.883214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.883220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.883220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.883222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.883223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.883228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.883239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.883243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.883247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.883251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.883258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.883265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:56.883271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.883277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:56.883282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.883288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:56.883292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.883298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.883308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.883313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.883335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:56.883421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99707cc-3747a49-70c0858a-5c47471c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.883483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:56.883492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 761
2025-10-02T08:09:56.883663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:56.883704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:56.883715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:56.883719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:56.884081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 761 sessionId:  describe result for acl check
2025-10-02T08:09:56.884115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:56.884121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:56.884123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:56.884129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533662043114545:9475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:56.884608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533662043114545:9475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:56.886920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533662043114545:9475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:56.891784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533662043114545:9475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:56.891803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533662043114545:9475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:56.891806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533662043114545:9475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:56.891816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:56.892286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:56.894238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:56.894255Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:56.894258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:56.894262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:56.894268Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 760 [1:7556533662043114529:9471]
2025-10-02T08:09:56.894281Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:56.894299Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:56.894302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.894305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.894307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.894322Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:56.894328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:56.894335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:56.894416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.894424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.894428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:56.894430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:56.894504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:56.894512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.894528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:56.894549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:56.894567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 760
2025-10-02T08:09:56.894572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043114573:9475], now have 1 active actors on pipe
2025-10-02T08:09:56.894579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533662043114523:9471]
2025-10-02T08:09:56.894581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533662043114523:9471]
2025-10-02T08:09:56.894596Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:56.894611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533662503267030:2378], now have 1 active actors on pipe
2025-10-02T08:09:56.894620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.894625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.894642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:56.894648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:56.894651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:56.894664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:56.894667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:56.894668Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 760
2025-10-02T08:09:56.894710Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:56.894724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:56.894731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:56.894733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:56.894741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:56.894753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:56.894767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533662043114523:9471]
2025-10-02T08:09:56.894779Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:56.894802Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:56.894817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.894907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:56.894915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:56.894928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:56.894981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 761 partition: 0 MaxSeqNo: 17 sessionId: src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0
2025-10-02T08:09:56.895383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99707cc-3747a49-70c0858a-5c47471c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:56.898177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0] Write session: try to update token
2025-10-02T08:09:56.898202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:56.917482Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:56.917505Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:56.917510Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:56.917523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533662043114523:9471]
2025-10-02T08:09:56.917529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533662043114523:9471]
2025-10-02T08:09:56.917578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:56.917593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:56.917598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:56.917739Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:56.917752Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:56.917757Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:56.921344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId: src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:56.924187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:56.973458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533662043114590:8944]
2025-10-02T08:09:56.973588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 760, pipe: [1:7556533662043114590:8944]
2025-10-02T08:09:57.065293Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:57.065870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.065885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.065936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533662043114590:8944], now have 1 active actors on pipe
2025-10-02T08:09:57.066096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533662043114590:8944]
2025-10-02T08:09:57.066109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:57.066114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:57.066183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 761 reason: error at write: Disconnected sessionId: src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0
2025-10-02T08:09:57.066234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:57.066394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 761 sessionId: src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0 is DEAD
2025-10-02T08:09:57.066520Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:57.066596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:57.066609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0] Write session will restart in 0.007187s
2025-10-02T08:09:57.066637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0] Write session: Do CDS request
2025-10-02T08:09:57.066646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:57.075380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.075441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:57.075459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 762
2025-10-02T08:09:57.075671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.075710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:57.075718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:57.075722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:57.076101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 762 sessionId:  describe result for acl check
2025-10-02T08:09:57.076134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:57.076143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:57.076144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:57.076145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:57.076151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533666338082007:9482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:57.076632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533666338082007:9482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:57.077110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:57.077287Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:57.077296Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:57.077306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:57.077350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:57.077387Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533666338082018:9480]
2025-10-02T08:09:57.077966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:57.078106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:57.078145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:57.078425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:57.078471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.078486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.078491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.078492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.078493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.078497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.078505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.078509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.078513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.078516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.078521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.078527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.078532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.078541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.078545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.078549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.078552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.078557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.078566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.078570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.078586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:57.079042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533666338082007:9482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:57.085075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533666338082007:9482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:57.085097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533666338082007:9482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:57.085100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533666338082007:9482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:57.085108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:57.096201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:57.101993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:57.102014Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:57.102017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:57.102021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:57.102028Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 761 [1:7556533666338082018:9480]
2025-10-02T08:09:57.102042Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:57.102067Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:57.102072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.102075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.102076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.102096Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:57.102101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:57.102113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:57.102190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.102198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.102201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:57.102204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:57.102278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:57.102285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.102300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.102316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:57.102333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533666338082006:9480]
2025-10-02T08:09:57.102335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533666338082006:9480]
2025-10-02T08:09:57.102342Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:57.102356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082058:9482], now have 1 active actors on pipe
2025-10-02T08:09:57.102359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:57.102363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:57.102364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:57.102367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 761
2025-10-02T08:09:57.102378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:57.102381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:57.102386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533666798234339:2378], now have 1 active actors on pipe
2025-10-02T08:09:57.102424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.102428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.102441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533666338082006:9480]
2025-10-02T08:09:57.102450Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:57.102456Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:57.102474Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:57.102480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.102484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.102486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:57.102497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.102505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:57.102526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.102579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.102584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.102598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.102643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 762 partition: 0 MaxSeqNo: 17 sessionId: src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0
2025-10-02T08:09:57.103138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 761
2025-10-02T08:09:57.105121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19e66f80-2ab44b64-4ee50655-d97d69cf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:57.123929Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:57.123950Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:57.123953Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:57.123961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533666338082006:9480]
2025-10-02T08:09:57.123966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533666338082006:9480]
2025-10-02T08:09:57.124010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:57.124016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.124019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:57.124026Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:57.124044Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:57.124160Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:57.127513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0] Write session: try to update token
2025-10-02T08:09:57.127537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:57.166438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533666338082071:8944]
2025-10-02T08:09:57.166599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 761, pipe: [1:7556533666338082071:8944]
2025-10-02T08:09:57.170559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId: src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:57.173210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:57.262901Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:57.263671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082071:8944], now have 1 active actors on pipe
2025-10-02T08:09:57.263680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.263686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.264457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:57.264468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0] Write session will restart in 0.007737s
2025-10-02T08:09:57.264491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0] Write session: Do CDS request
2025-10-02T08:09:57.264498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:57.263849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533666338082071:8944]
2025-10-02T08:09:57.263880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:57.263882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:57.263932Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:57.263947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 762 reason: error at write: Disconnected sessionId: src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0
2025-10-02T08:09:57.264126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 762 sessionId: src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0 is DEAD
2025-10-02T08:09:57.265195Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:57.273416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.273728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:57.273743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 763
2025-10-02T08:09:57.273882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.273920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:57.273926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:57.273930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:57.274496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 763 sessionId:  describe result for acl check
2025-10-02T08:09:57.274537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:57.274539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:57.274541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:57.274546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533666338082096:9487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:57.275039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533666338082096:9487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:57.286806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533666338082096:9487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:57.291178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:57.292659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:57.292842Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:57.292849Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:57.292857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:57.292903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:57.292943Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533666338082228:9486]
2025-10-02T08:09:57.293540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:57.293791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:57.293863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:57.293914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533666338082096:9487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:57.293925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533666338082096:9487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:57.293928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533666338082096:9487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:57.293938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:57.294336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:57.294414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.294421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.294422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.294423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.294426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.294431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.294441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.294449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.294452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.294455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.294461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.294472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.294497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.294506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.294514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.294519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.294523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.294528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.294532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.294537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.294555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:57.306620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:57.308930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:57.308950Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:57.308952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:57.308956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:57.308963Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 762 [1:7556533666338082228:9486]
2025-10-02T08:09:57.308975Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:57.308998Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:57.309000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.309006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.309008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.309025Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:57.309030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:57.309037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:57.309111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.309120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.309122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:57.309125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:57.309210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:57.309213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.309228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.309239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:57.309256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533666338082222:9486]
2025-10-02T08:09:57.309259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533666338082222:9486]
2025-10-02T08:09:57.309267Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:57.309281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:57.309296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:57.309299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:57.309310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082239:9487], now have 1 active actors on pipe
2025-10-02T08:09:57.309319Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:57.309331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:57.309343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533666338082222:9486]
2025-10-02T08:09:57.309346Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:57.309352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533666798234345:2378], now have 1 active actors on pipe
2025-10-02T08:09:57.309395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 762
2025-10-02T08:09:57.309518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:57.309579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.309587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.309613Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:57.309622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.309626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.309629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:57.309639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.309649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:57.309669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.309777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.309784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.309798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.309837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 763 partition: 0 MaxSeqNo: 17 sessionId: src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0
2025-10-02T08:09:57.310269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d5090f-26bc21bb-93ffb2a-c8e26e9b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:57.312903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 762
2025-10-02T08:09:57.313183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0] Write session: try to update token
2025-10-02T08:09:57.313204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:57.331531Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:57.331552Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:57.331555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:57.331566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533666338082222:9486]
2025-10-02T08:09:57.331570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533666338082222:9486]
2025-10-02T08:09:57.331613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:57.331612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:57.331618Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:57.331619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.331620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:57.331753Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:57.335689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId: src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:57.338776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:57.363218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533666338082259:8944]
2025-10-02T08:09:57.363360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 762, pipe: [1:7556533666338082259:8944]
2025-10-02T08:09:57.478146Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:57.478453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.478462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.478503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082259:8944], now have 1 active actors on pipe
2025-10-02T08:09:57.478676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533666338082259:8944]
2025-10-02T08:09:57.478723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:57.478726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:57.478742Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:57.478796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 763 reason: error at write: Disconnected sessionId: src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0
2025-10-02T08:09:57.478937Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:57.479164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:57.479175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0] Write session will restart in 0.009629s
2025-10-02T08:09:57.479200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0] Write session: Do CDS request
2025-10-02T08:09:57.478988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 763 sessionId: src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0 is DEAD
2025-10-02T08:09:57.479210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:57.487864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:57.489635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:57.489799Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:57.489806Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:57.489813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:57.489845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:57.489877Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533666338082392:9492]
2025-10-02T08:09:57.490365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.490439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:57.490484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:57.490495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 764
2025-10-02T08:09:57.490626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.490647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:57.490660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:57.490669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:57.490672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:57.490697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:57.490987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:57.490993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 764 sessionId:  describe result for acl check
2025-10-02T08:09:57.491016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:57.491025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:57.491027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:57.491031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533666338082403:9494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:57.491039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.491040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.491042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.491043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.491044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.491049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.491057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.491061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.491064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.491068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.491075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.491081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.491093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.491097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.491101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.491109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.491112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.491116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.491123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.491127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.491147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:57.491522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533666338082403:9494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:57.493633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533666338082403:9494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:57.500098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533666338082403:9494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:57.500124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533666338082403:9494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:57.500128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533666338082403:9494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:57.500138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:57.500441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:57.502090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:57.502105Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:57.502107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:57.502111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:57.502117Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 763 [1:7556533666338082392:9492]
2025-10-02T08:09:57.502130Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:57.502147Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:57.502150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.502153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.502155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.502172Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:57.502177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:57.502183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:57.502248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.502260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.502263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:57.502265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:57.502381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 763
2025-10-02T08:09:57.502621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:57.502632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.502645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.502657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:57.502682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082440:9494], now have 1 active actors on pipe
2025-10-02T08:09:57.502688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533666798234354:2378], now have 1 active actors on pipe
2025-10-02T08:09:57.502693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.502698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.502720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533666338082386:9492]
2025-10-02T08:09:57.502726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533666338082386:9492]
2025-10-02T08:09:57.502740Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:57.502757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:57.502765Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:57.502769Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:57.502774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:57.502777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:57.502792Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8251658f-64a3b613-4e25720b-af80ce54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:57.502802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.502806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.502812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:57.502821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.502834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:57.502873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533666338082386:9492]
2025-10-02T08:09:57.502885Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:57.502897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:57.502898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.502948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.502955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.502970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.503009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 764 partition: 0 MaxSeqNo: 17 sessionId: src_id|8251658f-64a3b613-4e25720b-af80ce54_0
2025-10-02T08:09:57.503376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a397d9a2-163f4ca0-9fb16c98-2bd17e6b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8251658f-64a3b613-4e25720b-af80ce54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:57.502459Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 763
2025-10-02T08:09:57.506124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8251658f-64a3b613-4e25720b-af80ce54_0] Write session: try to update token
2025-10-02T08:09:57.506142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8251658f-64a3b613-4e25720b-af80ce54_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:57.514875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:57.514914Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:57.514927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533666338082386:9492]
2025-10-02T08:09:57.514976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:57.514982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:57.515163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:57.515346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:57.515571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:57.515805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:57.516121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:57.516173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:57.523991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId: src_id|8251658f-64a3b613-4e25720b-af80ce54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:57.526667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:57.526789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.526807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.526846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:57.526878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:57.526949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.526957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.527113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.527175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.527235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.527294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.527340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.527348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.527433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.527495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.527616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.527755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.528103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.528114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.528178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.528236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.528324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.528414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.528454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.528463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.528554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.528615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.528678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.528737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.528797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.528819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.528918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.528991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.529063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.529134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.529183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.529192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.529267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.529335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.529436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.529560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.529613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.529620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.529793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.529863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.529933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.530004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.530056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.530063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.530135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.530200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.530273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.530343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.530397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.530408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.530476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.530549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.530617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.530681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.530732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.530740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.530811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.530878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.530945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.531019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.531085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.531092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.531139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:57.531213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.531236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.531243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:57.531276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:57.531294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:57.531302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:57.531305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:57.531308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:57.531760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:57.531789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:57.531796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:57.531800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:57.531809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:57.531813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:57.532444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:57.532465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:57.532472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:57.532475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:57.532480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:57.532484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:57.533265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:57.533290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:57.533297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:57.533300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:57.533302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:57.534630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:57.534639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:57.534651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392597532
2025-10-02T08:09:57.534775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:57.534783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:57.534789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:57.534793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:57.534797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:57.534800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:57.535471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:57.535485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:57.535491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:57.535495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:57.535498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:57.535503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:57.536085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:57.536098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:57.536107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:57.536110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:57.536115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:57.536119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:57.536712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:57.536727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:57.536733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:57.538022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:57.538044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:57.538052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:57.538057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:57.538067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392597538
2025-10-02T08:09:57.538395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:57.538409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:57.538416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:57.538420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:57.538424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:57.538427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:57.538983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:57.539010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:57.539018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:57.539027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:57.539030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:57.539034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:57.539587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:57.539608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.539715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392597539
2025-10-02T08:09:57.540599Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:57.540623Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:57.540631Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:57.540638Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:57.542319Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:57.542333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:57.542336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:57.542344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533666338082386:9492]
2025-10-02T08:09:57.542347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533666338082386:9492]
2025-10-02T08:09:57.542393Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:57.542404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:57.542407Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:57.542411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.542413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:57.542543Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:57.577051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533666338082467:8944]
2025-10-02T08:09:57.577257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 763, pipe: [1:7556533666338082467:8944]
2025-10-02T08:09:57.686358Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:57.686691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082467:8944], now have 1 active actors on pipe
2025-10-02T08:09:57.686835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533666338082467:8944]
2025-10-02T08:09:57.686867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:57.686874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:57.686885Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:57.686915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 764 reason: error at write: Disconnected sessionId: src_id|8251658f-64a3b613-4e25720b-af80ce54_0
2025-10-02T08:09:57.686911Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:57.687098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 764 sessionId: src_id|8251658f-64a3b613-4e25720b-af80ce54_0 is DEAD
2025-10-02T08:09:57.687241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8251658f-64a3b613-4e25720b-af80ce54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:57.687248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8251658f-64a3b613-4e25720b-af80ce54_0] Write session will restart in 0.007207s
2025-10-02T08:09:57.687270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8251658f-64a3b613-4e25720b-af80ce54_0] Write session: Do CDS request
2025-10-02T08:09:57.687277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8251658f-64a3b613-4e25720b-af80ce54_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:57.695304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8251658f-64a3b613-4e25720b-af80ce54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.695380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:57.695406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 765
2025-10-02T08:09:57.695646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.695674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:57.695683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:57.695686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:57.696047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 765 sessionId:  describe result for acl check
2025-10-02T08:09:57.696080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:57.696087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:57.696089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:57.696095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533666338082605:9502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:57.696532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:57.696646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533666338082605:9502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:57.696977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:57.697142Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:57.697150Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:57.697160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:57.697212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:57.697251Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533666338082617:9500]
2025-10-02T08:09:57.697820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:57.698051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:57.698104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:57.698333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:57.698372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.698376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.698377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.698377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.698378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.698381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.698387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.698389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.698391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.698393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.698396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.698401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.698404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.698407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.698409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.698412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.698414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.698416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.698420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.698424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.698434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:57.698777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533666338082605:9502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:57.705429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533666338082605:9502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:57.705444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533666338082605:9502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:57.705449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533666338082605:9502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:57.705456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:57.706260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:57.708055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:57.708071Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:57.708073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:57.708077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:57.708083Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 764 [1:7556533666338082617:9500]
2025-10-02T08:09:57.708097Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:57.708115Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:57.708118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.708121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.708123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.708140Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:57.708145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:57.708156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:57.708215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.708224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.708227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:57.708229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:57.708293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:57.708299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.708312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.708328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:57.708352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082656:9502], now have 1 active actors on pipe
2025-10-02T08:09:57.708354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 764
2025-10-02T08:09:57.708362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533666338082606:9500]
2025-10-02T08:09:57.708363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533666338082606:9500]
2025-10-02T08:09:57.708374Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:57.708385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533666798234373:2378], now have 1 active actors on pipe
2025-10-02T08:09:57.708389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:57.708392Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:57.708394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.708398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.708413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:57.708430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:57.708436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:57.708424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 764
2025-10-02T08:09:57.708478Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:57.708488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.708492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.708497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:57.708505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.708514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:57.708530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533666338082606:9500]
2025-10-02T08:09:57.708541Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:57.708562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:57.708575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.708665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.708679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.708702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.708743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 765 partition: 0 MaxSeqNo: 17 sessionId: src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0
2025-10-02T08:09:57.709144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8251658f-64a3b613-4e25720b-af80ce54_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:57.712120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0] Write session: try to update token
2025-10-02T08:09:57.712136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:57.727123Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:57.727150Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:57.727153Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:57.727160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533666338082606:9500]
2025-10-02T08:09:57.727165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533666338082606:9500]
2025-10-02T08:09:57.727208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:57.727217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:57.727221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.727223Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:57.727223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:57.727264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId: src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:57.727367Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:57.729865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:57.786965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533666338082671:8944]
2025-10-02T08:09:57.787135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 764, pipe: [1:7556533666338082671:8944]
2025-10-02T08:09:57.866882Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:57.867606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.867619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.867654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082671:8944], now have 1 active actors on pipe
2025-10-02T08:09:57.867886Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:57.867918Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:57.868190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533666338082671:8944]
2025-10-02T08:09:57.868220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:57.868277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 765 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0
2025-10-02T08:09:57.868466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 765 sessionId: src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0 is DEAD
2025-10-02T08:09:57.868665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:57.868672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0] Write session will restart in 0.006915s
2025-10-02T08:09:57.868701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0] Write session: Do CDS request
2025-10-02T08:09:57.868708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:57.876313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.876451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:57.876478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 766
2025-10-02T08:09:57.876622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:57.876657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:57.876663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:57.876668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:57.877227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:57.877657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:57.877922Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:57.877936Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:57.877951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:57.878011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:57.878061Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533666338082823:9512]
2025-10-02T08:09:57.878899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:57.879172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 766 sessionId:  describe result for acl check
2025-10-02T08:09:57.879199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:57.879206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:57.879206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:57.879210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533666338082830:9514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:57.879248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:57.879288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:57.879606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:57.879648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.879653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.879654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.879655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.879656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.879660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.879667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.879669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.879671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.879673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.879677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.879683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:57.879687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.879690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:57.879694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.879697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:57.879700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.879703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.879706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.879709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.879721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:57.880170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533666338082830:9514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:57.882327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533666338082830:9514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:57.888927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533666338082830:9514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:57.888943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533666338082830:9514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:57.888947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533666338082830:9514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:57.888956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:57.890029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:57.892971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:57.892985Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:57.892989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:57.892993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:57.893000Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 765 [1:7556533666338082823:9512]
2025-10-02T08:09:57.893013Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:57.893033Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:57.893041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.893045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.893054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.893074Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:57.893083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:57.893095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:57.893169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.893176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.893180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:57.893183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:57.893260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:57.893270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.893284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:57.893297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:57.893320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533666338082816:9512]
2025-10-02T08:09:57.893322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533666338082816:9512]
2025-10-02T08:09:57.893332Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:57.893349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:57.893368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:57.893374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:57.893412Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:57.893417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533666338082816:9512]
2025-10-02T08:09:57.893419Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:57.893428Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:57.893429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533666798234381:2378], now have 1 active actors on pipe
2025-10-02T08:09:57.893435Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:57.893630Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 765
2025-10-02T08:09:57.893825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 765
2025-10-02T08:09:57.893837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082869:9514], now have 1 active actors on pipe
2025-10-02T08:09:57.893850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.893857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.893889Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:57.893902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.893906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.893908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:57.893918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.893929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:57.893944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.894000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.894006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.894020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:57.894051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 766 partition: 0 MaxSeqNo: 17 sessionId: src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0
2025-10-02T08:09:57.894514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b389e51-5c4c5ce0-77c23fb6-9d226288_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:57.900695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0] Write session: try to update token
2025-10-02T08:09:57.900719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:57.924608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId: src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:57.925903Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:57.925924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:57.925932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533666338082816:9512]
2025-10-02T08:09:57.925975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:57.925978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:57.926155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:57.926356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:57.926512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:57.926669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:57.927286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:57.927338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:57.927680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:57.927756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.927768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.927801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:57.927824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:57.927881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:57.927898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:57.928069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.928138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.928210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.928280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.928330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.928339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.928414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.928484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.928600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.928677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.928727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.928736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.928830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.928939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.929009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.929082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.929133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.929141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.929213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.929284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.929348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.929423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.929479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.929488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.929558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.929624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.929683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.929758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.929814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.929824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.929903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.929971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.930039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.930129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.930204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.930213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.930285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.930367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.930439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.930513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.930561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.930569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.930640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.930708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.930777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.930847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.930915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.930924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.930996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.931063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.931131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.931205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.931260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.931268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.931343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:57.931430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:57.931502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:57.931573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:57.931622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:57.931630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:57.931673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:57.931740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:57.931766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:57.931774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:57.931809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:57.931827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:57.931831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:57.931834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:57.931837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:57.932977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:57.933028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:57.933037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:57.933040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:57.933043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:57.933046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:57.933847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:57.933881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:57.933888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:57.933891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:57.933894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:57.933897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:57.934443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:57.934466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:57.934472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:57.934475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:57.934481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:57.935895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:57.935915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:57.935926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392597935
2025-10-02T08:09:57.936113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:57.936132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:57.936137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:57.936142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:57.936146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:57.936149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:57.936697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:57.936724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:57.936730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:57.936734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:57.936739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:57.936743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:57.937318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:57.937344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:57.937353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:57.937357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:57.937360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:57.937363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:57.937921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:57.937947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:57.937953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:57.939230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:57.939250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:57.939256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:57.939260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:57.939271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392597938
2025-10-02T08:09:57.939640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:57.939663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:57.939669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:57.939675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:57.939681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:57.939685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:57.940213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:57.940235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:57.940242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:57.940246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:57.940249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:57.940254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:57.940822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:57.940844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:57.940956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392597940
2025-10-02T08:09:57.941852Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:57.941875Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:57.941882Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:57.941889Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:57.949165Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:57.949187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:57.949190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:57.949199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533666338082816:9512]
2025-10-02T08:09:57.949203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533666338082816:9512]
2025-10-02T08:09:57.949248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:57.949253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:57.949255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:57.949293Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:57.949305Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:57.949416Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:57.968653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533666338082915:8944]
2025-10-02T08:09:57.968859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 765, pipe: [1:7556533666338082915:8944]
2025-10-02T08:09:58.110543Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:58.111108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533666338082915:8944], now have 1 active actors on pipe
2025-10-02T08:09:58.111432Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:58.111556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533666338082915:8944]
2025-10-02T08:09:58.111499Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:58.111579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:58.111617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 766 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0
2025-10-02T08:09:58.111820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 766 sessionId: src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0 is DEAD
2025-10-02T08:09:58.111995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:58.112009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0] Write session will restart in 0.006345s
2025-10-02T08:09:58.112037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0] Write session: Do CDS request
2025-10-02T08:09:58.112043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:58.119570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.119690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:58.119710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 767
2025-10-02T08:09:58.119873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.119904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:58.119914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:58.119918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:58.120290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 767 sessionId:  describe result for acl check
2025-10-02T08:09:58.120334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:58.120346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:58.120349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:58.120355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533670633050330:9526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:58.120927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533670633050330:9526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:58.122794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:58.124172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533670633050330:9526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:58.124226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:58.124399Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:58.124407Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:58.124415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:58.124460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:58.124489Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533670633050367:9525]
2025-10-02T08:09:58.125103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:58.125289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:58.125331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:58.125585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:58.125620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.125625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.125626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.125630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.125631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.125637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.125646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.125654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.125658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.125660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.125666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.125673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.125681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.125690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.125694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.125703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.125711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.125716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.125720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.125725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.125747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:58.131437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533670633050330:9526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:58.131457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533670633050330:9526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:58.131461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533670633050330:9526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:58.131472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:58.135654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:58.137319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:58.137338Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:58.137342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:58.137346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:58.137353Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 766 [1:7556533670633050367:9525]
2025-10-02T08:09:58.137366Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:58.137386Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:58.137393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.137397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.137399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.137415Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:58.137425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:58.137432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:58.137504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.137512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.137515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:58.137518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:58.137587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:58.137598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.137613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.137625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:58.137641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 766
2025-10-02T08:09:58.137643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633050393:9526], now have 1 active actors on pipe
2025-10-02T08:09:58.137649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533670633050352:9525]
2025-10-02T08:09:58.137651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533670633050352:9525]
2025-10-02T08:09:58.137662Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:58.137674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533671093201708:2378], now have 1 active actors on pipe
2025-10-02T08:09:58.137680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:58.137684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:58.137684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.137689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.137709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:58.137728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:58.137735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:58.137745Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 766
2025-10-02T08:09:58.137781Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:58.137791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.137795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.137797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:58.137806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.137815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:58.137823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533670633050352:9525]
2025-10-02T08:09:58.137832Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:58.137842Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:58.137866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.137942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.137952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.137979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.138019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 767 partition: 0 MaxSeqNo: 17 sessionId: src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0
2025-10-02T08:09:58.138391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe7a757-27ae8334-8af8b4fb-9e7cf399_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:58.141495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0] Write session: try to update token
2025-10-02T08:09:58.141514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:58.158039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId: src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:58.159277Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:58.159294Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:58.159300Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:58.159510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533670633050352:9525]
2025-10-02T08:09:58.159518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533670633050352:9525]
2025-10-02T08:09:58.159566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:58.159578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.159580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:58.159586Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:58.159600Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:58.159748Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:58.160602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:58.211955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533670633050408:8944]
2025-10-02T08:09:58.212124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 766, pipe: [1:7556533670633050408:8944]
2025-10-02T08:09:58.298481Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:58.298753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.298766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.298808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633050408:8944], now have 1 active actors on pipe
2025-10-02T08:09:58.298929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:58.298939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:58.298993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 767 reason: error at write: Disconnected sessionId: src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0
2025-10-02T08:09:58.299018Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:58.299069Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:58.299176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 767 sessionId: src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0 is DEAD
2025-10-02T08:09:58.299338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:58.299345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0] Write session will restart in 0.009120s
2025-10-02T08:09:58.299368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0] Write session: Do CDS request
2025-10-02T08:09:58.299341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533670633050408:8944]
2025-10-02T08:09:58.299376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:58.306711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:58.307646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:58.307801Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:58.307809Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:58.307818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:58.307855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:58.307885Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533670633050541:9531]
2025-10-02T08:09:58.308361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:58.308539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:58.308576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:58.308868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:58.308925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.308934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.308935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.308936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.308937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.308942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.308952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.308955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.308959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.308962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.308968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.308975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.308982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.308987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.308990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.308996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.309000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.309006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.309011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.309015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.309034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:58.309487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.309515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:58.309526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 768
2025-10-02T08:09:58.309746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.309774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:58.309783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:58.309786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:58.310222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 768 sessionId:  describe result for acl check
2025-10-02T08:09:58.310261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:58.310268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:58.310269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:58.310275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533670633050557:9533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:58.310795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533670633050557:9533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:58.314766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533670633050557:9533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:58.318961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533670633050557:9533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:58.318980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533670633050557:9533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:58.318988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533670633050557:9533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:58.318997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:58.319342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:58.321424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:58.321449Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:58.321452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:58.321456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:58.321463Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 767 [1:7556533670633050541:9531]
2025-10-02T08:09:58.321475Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:58.321493Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:58.321497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.321500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.321502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.321518Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:58.321529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:58.321537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:58.321607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.321615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.321619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:58.321622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:58.321694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:58.321701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.321717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.321735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:58.321747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 767
2025-10-02T08:09:58.321760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633050589:9533], now have 1 active actors on pipe
2025-10-02T08:09:58.321767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533670633050535:9531]
2025-10-02T08:09:58.321774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533670633050535:9531]
2025-10-02T08:09:58.321781Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:58.321790Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:58.321793Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:58.321794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533671093201715:2378], now have 1 active actors on pipe
2025-10-02T08:09:58.321799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.321804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.321823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:58.321842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:58.321849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:58.321823Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 767
2025-10-02T08:09:58.321896Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:58.321908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.321912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.321914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:58.321923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.321937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:58.321950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533670633050535:9531]
2025-10-02T08:09:58.321965Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:58.321992Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:58.321997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.322080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.322088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.322103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.322143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 768 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0
2025-10-02T08:09:58.322562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0cc4bc-6af22549-f775436c-cc81d567_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:58.325998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0] Write session: try to update token
2025-10-02T08:09:58.326044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:58.333420Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:58.333439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:58.333446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533670633050535:9531]
2025-10-02T08:09:58.333483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:58.333488Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:58.333672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:58.333819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.333952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.334085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.334287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:58.334322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:58.344700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId: src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:58.347539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:58.347624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.347637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.347676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:58.347702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:58.347749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.347768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.347949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.348028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.348112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.348238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.348550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.348568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.348646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.348718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.348822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.348924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.348985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.348995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.349071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.349145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.349243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.349321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.349370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.349378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.349451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.349522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.349601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.349718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.349767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.349775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.349840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.349907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.349975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.350046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.350120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.350129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.350204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.350278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.350350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.350423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.350477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.350488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.350560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.350628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.350700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.350773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.350826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.350833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.350906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.350970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.351039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.351112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.351164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.351171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.351244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.351312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.351381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.351464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.351518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.351526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.351599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.351665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.351731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.351802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.351980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.351995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.352066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:58.352136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.352163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.352167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:58.352198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:58.352218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:58.352228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:58.352231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:58.352234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:58.352655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:58.352687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:58.352699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:58.352707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:58.352715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:58.352719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:58.353531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:58.353560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:58.353568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:58.353573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:58.353577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:58.353581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:58.354118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:58.354148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:58.354155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:58.354160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:58.354163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:58.356856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:58.356878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:58.356891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392598356
2025-10-02T08:09:58.357137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:58.357163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:58.357171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:58.357181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:58.357185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:58.357192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:58.357700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:58.357744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:58.357755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:58.357764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:58.357772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:58.357777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:58.358323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:58.358348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:58.358353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:58.358356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:58.358358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:58.358361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:58.358797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:58.358815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:58.358821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:58.359898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:58.359918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:58.359924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:58.359927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:58.359933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392598359
2025-10-02T08:09:58.360201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:58.360221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:58.360224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:58.360227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:58.360229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:58.360231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:58.360628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:58.360645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:58.360649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:58.360652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:58.360654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:58.360656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:58.361091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:58.361113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.361193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392598360
2025-10-02T08:09:58.363434Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:58.363454Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:58.363459Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:58.363463Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:58.363472Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:58.363473Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:58.363475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:58.363484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533670633050535:9531]
2025-10-02T08:09:58.363495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533670633050535:9531]
2025-10-02T08:09:58.363560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:58.363568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.363569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:58.363663Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:58.363682Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:58.363686Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:58.399327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533670633050606:8944]
2025-10-02T08:09:58.399503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 767, pipe: [1:7556533670633050606:8944]
2025-10-02T08:09:58.515115Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:58.515537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633050606:8944], now have 1 active actors on pipe
2025-10-02T08:09:58.515702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:58.515711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:58.515739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 768 reason: error at write: Disconnected sessionId: src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0
2025-10-02T08:09:58.515750Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:58.515936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 768 sessionId: src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0 is DEAD
2025-10-02T08:09:58.516069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533670633050606:8944]
2025-10-02T08:09:58.516087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:58.516103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0] Write session will restart in 0.006606s
2025-10-02T08:09:58.516132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0] Write session: Do CDS request
2025-10-02T08:09:58.516140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:58.516160Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:58.520753Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [d5389d0c7ac300f2] Result# TEvPutResult {Id# [72075186224037892:767:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:58.520775Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:767:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:58.520864Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:767:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:58.524550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.524700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:58.524727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 769
2025-10-02T08:09:58.524900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.524943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:58.524952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:58.524956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:58.525365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 769 sessionId:  describe result for acl check
2025-10-02T08:09:58.525397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:58.525399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:58.525400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:58.525404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533670633050740:9539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:58.525890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533670633050740:9539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:58.527276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:58.528204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533670633050740:9539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:58.528848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:58.529057Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:58.529071Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:58.529082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:58.529136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:58.529175Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533670633050786:9538]
2025-10-02T08:09:58.529838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:58.530091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:58.530148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:58.530609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:58.530671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.530676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.530677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.530678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.530680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.530685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.530696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.530704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.530708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.530716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.530723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.530731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.530736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.530742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.530746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.530755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.530760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.530768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.530773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.530778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.530797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:58.536688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533670633050740:9539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:58.536705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533670633050740:9539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:58.536709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533670633050740:9539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:58.536717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:58.542488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 768
2025-10-02T08:09:58.543141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca5f53e9-a13b7cfc-44043615-d8141df0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:58.540182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:58.542041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:58.542047Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:58.542050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:58.542053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:58.542059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 768 [1:7556533670633050786:9538]
2025-10-02T08:09:58.542070Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:58.542086Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:58.542089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.542092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.542094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.542108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:58.542113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:58.542120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:58.542312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.542315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.542317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:58.542319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:58.542385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:58.542389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.542405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.542418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:58.542417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 768
2025-10-02T08:09:58.542438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633050804:9539], now have 1 active actors on pipe
2025-10-02T08:09:58.542441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533671093201724:2378], now have 1 active actors on pipe
2025-10-02T08:09:58.542445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.542449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.542466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533670633050770:9538]
2025-10-02T08:09:58.542468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533670633050770:9538]
2025-10-02T08:09:58.542480Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:58.542494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:58.542494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:58.542497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:58.542508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:58.542510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:58.542525Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:58.542530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.542533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.542535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:58.542544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.542552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:58.542584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533670633050770:9538]
2025-10-02T08:09:58.542591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:58.542603Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:58.542609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.542655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.542657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.542670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.542703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 769 partition: 0 MaxSeqNo: 17 sessionId: src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0
2025-10-02T08:09:58.546383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0] Write session: try to update token
2025-10-02T08:09:58.546405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:58.554160Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:58.554175Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:58.554185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533670633050770:9538]
2025-10-02T08:09:58.554219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:58.554223Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:58.554389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:58.554534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.554693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.554823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.555021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:58.555060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:58.565473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId: src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:58.568001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:58.568089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.568102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.568135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:58.568157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:58.568226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.568243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.568547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.568611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.568675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.568739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.568786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.568795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.568907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.568975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.569039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.569103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.569152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.569159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.569230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.569296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.569362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.569425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.569471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.569479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.569546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.569609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.569672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.569737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.569789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.569796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.569858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.569914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.569973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.570039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.570085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.570092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.570157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.570218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.570282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.570349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.570643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.570653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.570715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.570774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.570837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.570899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.570944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.570952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.571014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.571072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.571133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.571195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.571240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.571247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.571311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.571374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.571448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.571512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.571559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.571565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.571627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:58.571686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:58.571746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:58.571809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:58.571852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:58.571862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:58.571923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:58.571983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.572004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.572011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:58.572040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:58.572056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:58.572063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:58.572066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:58.572069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:58.572471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:58.572498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:58.572508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:58.572511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:58.572514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:58.572521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:58.573334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:58.573361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:58.573366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:58.573371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:58.573374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:58.573377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:58.574023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:58.574046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:58.574051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:58.574055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:58.574062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:58.575357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:58.575376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:58.575398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392598575
2025-10-02T08:09:58.575510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:58.575524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:58.575527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:58.575531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:58.575535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:58.575538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:58.575975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:58.575997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:58.576002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:58.576006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:58.576014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:58.576018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:58.576565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:58.576583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:58.576591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:58.576599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:58.576603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:58.576606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:58.577049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:58.577071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:58.577076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:58.578233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:58.578250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:58.578255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:58.578259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:58.578267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392598577
2025-10-02T08:09:58.578602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:58.578624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:58.578637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:58.578645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:58.578648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:58.578651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:58.579207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:58.579230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:58.579236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:58.579239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:58.579242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:58.579245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:58.579732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:58.579752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.579845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392598579
2025-10-02T08:09:58.582134Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:58.582162Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:58.582168Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:58.582175Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:58.582186Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:58.582193Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:58.582195Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:58.582202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533670633050770:9538]
2025-10-02T08:09:58.582210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533670633050770:9538]
2025-10-02T08:09:58.582264Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:58.582278Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:58.582290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:58.582293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.582295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:58.582425Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:58.616420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533670633050818:8944]
2025-10-02T08:09:58.616618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 768, pipe: [1:7556533670633050818:8944]
2025-10-02T08:09:58.733522Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:58.733955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633050818:8944], now have 1 active actors on pipe
2025-10-02T08:09:58.734118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:58.734130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:58.734159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 769 reason: error at write: Disconnected sessionId: src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0
2025-10-02T08:09:58.734200Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:58.734361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 769 sessionId: src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0 is DEAD
2025-10-02T08:09:58.734480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:58.734491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0] Write session will restart in 0.006163s
2025-10-02T08:09:58.734514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0] Write session: Do CDS request
2025-10-02T08:09:58.734521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:58.734583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:58.734531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533670633050818:8944]
2025-10-02T08:09:58.738721Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [574fdc4b31949f86] Result# TEvPutResult {Id# [72075186224037892:768:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:09:58.738727Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:768:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:58.738800Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:768:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:09:58.745414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.745515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:58.745535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 770
2025-10-02T08:09:58.745705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.745748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:58.745759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:58.745763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:58.746276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 770 sessionId:  describe result for acl check
2025-10-02T08:09:58.746328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:58.746338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:58.746341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:58.746349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533670633050926:9546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:58.746917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533670633050926:9546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:58.749252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533670633050926:9546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:58.751728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:58.752145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:58.752311Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:58.752314Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:58.752324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:58.752363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:58.752396Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533670633051005:9545]
2025-10-02T08:09:58.753158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:58.753387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:58.753443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:58.753791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:58.753840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.753845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.753846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.753848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.753849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.753855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.753865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.753869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.753873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.753876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.753881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.753889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.753895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.753899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.753904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.753908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.753912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.753917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.753921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.753926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.753946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:58.768595Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 769
2025-10-02T08:09:58.765348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533670633050926:9546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:58.765370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533670633050926:9546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:58.765373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533670633050926:9546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:58.765383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:58.765933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:58.767694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:58.767702Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:58.767705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:58.767709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:58.767717Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 769 [1:7556533670633051005:9545]
2025-10-02T08:09:58.767731Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:58.767750Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:58.767754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.767757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.767760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.767779Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:58.767786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:58.767793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:58.767892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.767897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.767900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:58.767902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:58.767980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:58.767983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.767997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.768010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:58.768030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633051021:9546], now have 1 active actors on pipe
2025-10-02T08:09:58.768038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533670633050999:9545]
2025-10-02T08:09:58.768040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533670633050999:9545]
2025-10-02T08:09:58.768048Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:58.768063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:58.768080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:58.768083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:58.768090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533671093201743:2378], now have 1 active actors on pipe
2025-10-02T08:09:58.768125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533670633050999:9545]
2025-10-02T08:09:58.768128Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:58.768177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 769
2025-10-02T08:09:58.768221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:58.768225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:58.768232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:58.768663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.768672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.768702Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:58.768712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.768716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.768719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:58.768729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.768743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:58.768782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.768886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.768889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.768914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.768958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 770 partition: 0 MaxSeqNo: 17 sessionId: src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0
2025-10-02T08:09:58.773097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b4bfc5-d15c88be-94a0a3d7-cc1578f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:58.776318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0] Write session: try to update token
2025-10-02T08:09:58.776341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:58.799263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId: src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:58.799621Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:58.799624Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:58.799625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:58.799632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533670633050999:9545]
2025-10-02T08:09:58.799635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533670633050999:9545]
2025-10-02T08:09:58.799673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:58.799678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.799679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:58.799731Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:58.799737Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:58.799810Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:58.801980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:58.834536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533670633051035:8944]
2025-10-02T08:09:58.834849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 769, pipe: [1:7556533670633051035:8944]
2025-10-02T08:09:58.938685Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:58.939686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.939702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.939741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633051035:8944], now have 1 active actors on pipe
2025-10-02T08:09:58.939934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:58.939917Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:58.940162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533670633051035:8944]
2025-10-02T08:09:58.940178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:58.940225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 770 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0
2025-10-02T08:09:58.940410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 770 sessionId: src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0 is DEAD
2025-10-02T08:09:58.940601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:58.940619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0] Write session will restart in 0.006451s
2025-10-02T08:09:58.940648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0] Write session: Do CDS request
2025-10-02T08:09:58.940654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:58.948118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:58.948444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.948594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:58.948605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 771
2025-10-02T08:09:58.948708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:58.948733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:58.948741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:58.948744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:58.949375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 771 sessionId:  describe result for acl check
2025-10-02T08:09:58.949407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:58.949409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:58.949410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:58.949425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533670633051197:9560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:58.949606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:58.949768Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:58.949777Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:58.949787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:58.949831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:58.949871Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533670633051199:9558]
2025-10-02T08:09:58.950509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:58.950676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533670633051197:9560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:58.951358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:58.951417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:58.951719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:58.951752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.951756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.951757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.951757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.951758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.951762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.951768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.951770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.951772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.951774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.951777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.951781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:58.951785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.951790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:58.951793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.951795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:58.951798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.951800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.951803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.951805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.951816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:58.953326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533670633051197:9560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:58.959006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533670633051197:9560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:58.959027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533670633051197:9560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:58.959031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533670633051197:9560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:58.959040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:58.960005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:58.962298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:58.962317Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:58.962319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:58.962323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:58.962329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 770 [1:7556533670633051199:9558]
2025-10-02T08:09:58.962340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:58.962355Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:58.962358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.962362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.962364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.962380Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:58.962386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:58.962392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:58.962453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.962466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.962469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:58.962472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:58.962537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:58.962546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.962560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:58.962571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:58.962589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533670633051256:9560], now have 1 active actors on pipe
2025-10-02T08:09:58.962600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533671093201765:2378], now have 1 active actors on pipe
2025-10-02T08:09:58.962602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 770
2025-10-02T08:09:58.962606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533670633051186:9558]
2025-10-02T08:09:58.962609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533670633051186:9558]
2025-10-02T08:09:58.962620Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:58.962634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:58.962634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:58.962637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:58.962652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:58.962654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:58.962662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.962669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.962709Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533670633051186:9558]
2025-10-02T08:09:58.962721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:58.962733Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:58.962734Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:58.962740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:58.962744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:58.962746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:58.962755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:58.962763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:58.962805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.962833Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 770
2025-10-02T08:09:58.962902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:58.962917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:58.962969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:58.963013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 771 partition: 0 MaxSeqNo: 17 sessionId: src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0
2025-10-02T08:09:58.963429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdfc84f-9a3adb25-2fc86147-49c6ecd3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:58.966350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0] Write session: try to update token
2025-10-02T08:09:58.966377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:58.974890Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:58.974909Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:58.974917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533670633051186:9558]
2025-10-02T08:09:58.974952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:58.974955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:58.975126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:58.975267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.975415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.975552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:58.975934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:58.975975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:58.991457Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:58.991476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:58.991479Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:58.991488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533670633051186:9558]
2025-10-02T08:09:58.991491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533670633051186:9558]
2025-10-02T08:09:58.991534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:58.991544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:58.991550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:58.991561Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:58.991567Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:58.991680Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:58.992559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId: src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:58.995020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:59.039809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533674928018574:8944]
2025-10-02T08:09:59.039913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 770, pipe: [1:7556533674928018574:8944]
2025-10-02T08:09:59.123815Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:59.124023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.124041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.124063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928018574:8944], now have 1 active actors on pipe
2025-10-02T08:09:59.124173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533674928018574:8944]
2025-10-02T08:09:59.124195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:59.124201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:59.124260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 771 reason: error at write: Disconnected sessionId: src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0
2025-10-02T08:09:59.124276Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:59.124271Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:59.124458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 771 sessionId: src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0 is DEAD
2025-10-02T08:09:59.124608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:59.124616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0] Write session will restart in 0.007811s
2025-10-02T08:09:59.124635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0] Write session: Do CDS request
2025-10-02T08:09:59.124639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:59.133293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.133321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:59.133558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:59.133571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 772
2025-10-02T08:09:59.133689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.133707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:59.133727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:59.133737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:59.133740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:59.133875Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:59.133890Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:59.133900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:59.133952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:59.133992Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533674928018717:9570]
2025-10-02T08:09:59.134071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 772 sessionId:  describe result for acl check
2025-10-02T08:09:59.134104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:59.134111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:59.134113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:59.134118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533674928018720:9572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:59.134528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:59.134579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533674928018720:9572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:59.134710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:59.134758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:59.135051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:59.135088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.135093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.135094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.135095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.135096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.135100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.135108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.135112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.135115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.135118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.135123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.135129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.135134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.135138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.135142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.135148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.135152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.135156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.135159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.135169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.135185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:59.136470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533674928018720:9572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:59.142249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533674928018720:9572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:59.142269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533674928018720:9572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:59.142272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533674928018720:9572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:59.142281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:59.143187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:59.144837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:59.144851Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:59.144853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:59.144857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:59.144863Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 771 [1:7556533674928018717:9570]
2025-10-02T08:09:59.144874Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:59.144891Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:59.144899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.144902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.144904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.144921Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:59.144925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:59.144935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:59.144999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.145007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.145009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:59.145011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:59.145075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:59.145082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.145092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.145106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:59.145126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533674928018709:9570]
2025-10-02T08:09:59.145131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533674928018709:9570]
2025-10-02T08:09:59.145145Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:59.145161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:59.145176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:59.145182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:59.145214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533674928018709:9570]
2025-10-02T08:09:59.145220Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:59.146212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:59.146225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:59.146232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:59.146350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 771
2025-10-02T08:09:59.146357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928018764:9572], now have 1 active actors on pipe
2025-10-02T08:09:59.146427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533675388169077:2378], now have 1 active actors on pipe
2025-10-02T08:09:59.146438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.146443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.146467Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:59.146480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.146487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.146489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:59.146499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.146514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:59.146534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.146787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.146795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.146811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.146851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 772 partition: 0 MaxSeqNo: 17 sessionId: src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0
2025-10-02T08:09:59.146853Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 771
2025-10-02T08:09:59.147216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a29f2-4ff747f6-59f60662-17ed39fd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:59.149854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0] Write session: try to update token
2025-10-02T08:09:59.149869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:59.166431Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:59.166458Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:59.166460Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:59.166475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533674928018709:9570]
2025-10-02T08:09:59.166479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533674928018709:9570]
2025-10-02T08:09:59.166523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:59.166529Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:59.166535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.166536Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:59.166537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:59.166691Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:59.167725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId: src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:59.170215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:59.224137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533674928018779:8944]
2025-10-02T08:09:59.224248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 771, pipe: [1:7556533674928018779:8944]
2025-10-02T08:09:59.314526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:59.315974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:09:59.315985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0] Write session will restart in 0.009019s
2025-10-02T08:09:59.316009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0] Write session: Do CDS request
2025-10-02T08:09:59.316015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:59.313161Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:59.313525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.313532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.313573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928018779:8944], now have 1 active actors on pipe
2025-10-02T08:09:59.315010Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:59.315510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:59.315575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 772 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0
2025-10-02T08:09:59.315822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 772 sessionId: src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0 is DEAD
2025-10-02T08:09:59.316039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533674928018779:8944]
2025-10-02T08:09:59.326318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.326440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:59.326459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 773
2025-10-02T08:09:59.326554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:59.326618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.326653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:59.326663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:59.326667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:59.326947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:59.327051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 773 sessionId:  describe result for acl check
2025-10-02T08:09:59.327088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:59.327095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:59.327097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:59.327103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533674928018924:9578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:59.327114Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:59.327123Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:59.327134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:59.327183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:59.327227Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533674928018925:9576]
2025-10-02T08:09:59.327584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533674928018924:9578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:59.327825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:59.328026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:59.328074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:59.328399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:59.328439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.328440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.328441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.328442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.328443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.328446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.328452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.328454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.328456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.328458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.328462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.328467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.328470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.328473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.328476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.328478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.328480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.328484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.328487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.328489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.328499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:59.329344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533674928018924:9578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:59.335534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533674928018924:9578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:59.335556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533674928018924:9578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:59.335560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533674928018924:9578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:59.335569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:59.336585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:59.338763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:59.338787Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:59.338790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:59.338793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:59.338799Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 772 [1:7556533674928018925:9576]
2025-10-02T08:09:59.338813Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:59.338832Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:59.338835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.338838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.338839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.338856Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:59.338863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:59.338879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:59.338948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.338958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.338962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:59.338965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:59.339031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:59.339038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.339053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.339069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:59.339089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533674928018916:9576]
2025-10-02T08:09:59.339096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533674928018916:9576]
2025-10-02T08:09:59.339103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 772
2025-10-02T08:09:59.339105Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:59.339115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:59.339119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928018971:9578], now have 1 active actors on pipe
2025-10-02T08:09:59.339126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:59.339127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:59.339141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:59.339144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:59.339150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.339155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.339168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533675388169084:2378], now have 1 active actors on pipe
2025-10-02T08:09:59.339198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533674928018916:9576]
2025-10-02T08:09:59.339210Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:59.339216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:59.339225Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:59.339232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.339235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.339237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:59.339245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.339216Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 772
2025-10-02T08:09:59.339253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:59.339289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.339399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.339422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.339441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.339481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 773 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0
2025-10-02T08:09:59.339827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc38eeb-5601503f-c91a667f-e41559d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:59.342557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0] Write session: try to update token
2025-10-02T08:09:59.342576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:59.361136Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:59.361158Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:59.361161Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:59.361170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533674928018916:9576]
2025-10-02T08:09:59.361175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533674928018916:9576]
2025-10-02T08:09:59.361225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:59.361232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.361234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:59.361236Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:59.361244Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:59.361420Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:59.363035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId: src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:59.365709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:59.416151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533674928018991:8944]
2025-10-02T08:09:59.416239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 772, pipe: [1:7556533674928018991:8944]
2025-10-02T08:09:59.497476Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:59.497888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.497900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.497936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928018991:8944], now have 1 active actors on pipe
2025-10-02T08:09:59.498045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:59.498056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:59.498105Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:59.498120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 773 reason: error at write: Disconnected sessionId: src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0
2025-10-02T08:09:59.498196Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:59.498301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 773 sessionId: src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0 is DEAD
2025-10-02T08:09:59.498335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533674928018991:8944]
2025-10-02T08:09:59.498442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:59.498453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0] Write session will restart in 0.007565s
2025-10-02T08:09:59.498503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0] Write session: Do CDS request
2025-10-02T08:09:59.498509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:59.506842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:59.507337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.507408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:59.507418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 774
2025-10-02T08:09:59.507569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.507601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:59.507610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:59.507613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:59.508008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 774 sessionId:  describe result for acl check
2025-10-02T08:09:59.508042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:59.508044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:59.508045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:59.508051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533674928019140:9586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:59.508158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:59.508301Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:59.508310Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:59.508317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:59.508350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:59.508378Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533674928019142:9584]
2025-10-02T08:09:59.508538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533674928019140:9586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:59.508790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:59.508959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:59.508994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:59.509249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:59.509293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.509298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.509299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.509300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.509301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.509307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.509317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.509321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.509325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.509328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.509332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.509339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.509344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.509348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.509352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.509356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.509360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.509364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.509368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.509373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.509389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:59.510703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533674928019140:9586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:59.516625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533674928019140:9586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:59.516642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533674928019140:9586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:59.516645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533674928019140:9586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:59.516653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:59.518002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:59.519664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:59.519681Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:59.519683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:59.519686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:59.519691Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 773 [1:7556533674928019142:9584]
2025-10-02T08:09:59.519699Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:59.519712Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:59.519714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.519716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.519718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.519730Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:59.519733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:59.519738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:59.519799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.519808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.519811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:59.519814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:59.519882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:59.519894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.519907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.519917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:59.519936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533675388169093:2378], now have 1 active actors on pipe
2025-10-02T08:09:59.519942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533674928019133:9584]
2025-10-02T08:09:59.519949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533674928019133:9584]
2025-10-02T08:09:59.519956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:59.519967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:59.519967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:59.519969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 773
2025-10-02T08:09:59.519971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:59.519987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:59.519989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:59.520015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928019193:9586], now have 1 active actors on pipe
2025-10-02T08:09:59.520009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 773
2025-10-02T08:09:59.520046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.520054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.520064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533674928019133:9584]
2025-10-02T08:09:59.520070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:59.520078Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:59.520094Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:59.520103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.520106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.520107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:59.520115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.520122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:59.520140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.520206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.520217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.520239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.520276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 774 partition: 0 MaxSeqNo: 17 sessionId: src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0
2025-10-02T08:09:59.520596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3d2820-4581fd47-6df3eb11-b9bcc6a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:59.523267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0] Write session: try to update token
2025-10-02T08:09:59.523281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:59.537587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId: src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:59.538702Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:59.538722Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:59.538724Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:59.538737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533674928019133:9584]
2025-10-02T08:09:59.538741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533674928019133:9584]
2025-10-02T08:09:59.538783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:59.538794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.538796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:59.538943Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:59.538955Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:59.538962Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:59.540030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:59.598438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533674928019208:8944]
2025-10-02T08:09:59.598604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 773, pipe: [1:7556533674928019208:8944]
2025-10-02T08:09:59.673941Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:59.674394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.674414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.674463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928019208:8944], now have 1 active actors on pipe
2025-10-02T08:09:59.674605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:59.674614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:59.674682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 774 reason: error at write: Disconnected sessionId: src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0
2025-10-02T08:09:59.674688Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:59.674704Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:59.674992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:59.674999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0] Write session will restart in 0.009483s
2025-10-02T08:09:59.675016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0] Write session: Do CDS request
2025-10-02T08:09:59.675022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:59.674871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 774 sessionId: src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0 is DEAD
2025-10-02T08:09:59.674941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533674928019208:8944]
2025-10-02T08:09:59.685353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.685712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:59.685790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:59.685798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 775
2025-10-02T08:09:59.685937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.685974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:59.685980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:59.685984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:59.686418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 775 sessionId:  describe result for acl check
2025-10-02T08:09:59.686448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:59.686449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:59.686451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:59.686456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533674928019369:9594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:59.686926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533674928019369:9594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:59.689623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533674928019369:9594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:59.690778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:59.690972Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:59.690981Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:59.690991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:59.691043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:59.691081Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533674928019401:9592]
2025-10-02T08:09:59.691709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:59.691917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:59.691957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:59.692242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:59.692289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.692295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.692296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.692297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.692298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.692302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.692311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.692314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.692318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.692321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.692326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.692332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.692337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.692341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.692350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.692354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.692354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533674928019369:9594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:59.692361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.692363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533674928019369:9594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:59.692366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.692366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533674928019369:9594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:59.692374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:59.692391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.692395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.692412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:59.701098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:59.702930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:59.702948Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:59.702951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:59.702955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:59.702962Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 774 [1:7556533674928019401:9592]
2025-10-02T08:09:59.702974Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:59.702990Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:59.702993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.702996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.703004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.703020Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:59.703029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:59.703037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:59.703101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.703108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.703111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:59.703114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:59.703173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:59.703182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.703194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.703205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:59.703229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928019415:9594], now have 1 active actors on pipe
2025-10-02T08:09:59.703231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 774
2025-10-02T08:09:59.703239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533674928019362:9592]
2025-10-02T08:09:59.703243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533674928019362:9592]
2025-10-02T08:09:59.703255Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:59.703269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533675388169112:2378], now have 1 active actors on pipe
2025-10-02T08:09:59.703278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.703282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.703284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:59.703289Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:59.703299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:59.703314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:59.703321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:59.703361Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:59.703325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 774
2025-10-02T08:09:59.703375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.703378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.703396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:59.703405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.703414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:59.703425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533674928019362:9592]
2025-10-02T08:09:59.703436Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:59.703448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:59.703469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.703539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.703546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.703559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.703892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 775 partition: 0 MaxSeqNo: 17 sessionId: src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0
2025-10-02T08:09:59.704228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5655d4a-c24400f2-1b6c1740-dd0394cd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:59.706919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0] Write session: try to update token
2025-10-02T08:09:59.706937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:59.720795Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:59.721055Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:59.721059Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:59.721067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533674928019362:9592]
2025-10-02T08:09:59.721071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533674928019362:9592]
2025-10-02T08:09:59.721114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:59.721122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.721124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:59.721127Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:59.721132Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:59.721277Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:59.721647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId: src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:59.724219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:59.775067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533674928019431:8944]
2025-10-02T08:09:59.775229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 774, pipe: [1:7556533674928019431:8944]
2025-10-02T08:09:59.868521Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:09:59.868815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.868830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.868868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928019431:8944], now have 1 active actors on pipe
2025-10-02T08:09:59.868966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:09:59.868973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:09:59.869027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 775 reason: error at write: Disconnected sessionId: src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0
2025-10-02T08:09:59.869100Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:09:59.869100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:09:59.869186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 775 sessionId: src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0 is DEAD
2025-10-02T08:09:59.869300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:09:59.869308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0] Write session will restart in 0.008780s
2025-10-02T08:09:59.869326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0] Write session: Do CDS request
2025-10-02T08:09:59.869332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:09:59.869343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533674928019431:8944]
2025-10-02T08:09:59.878823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:09:59.879204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:09:59.879334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.879372Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:09:59.879394Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:09:59.879403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:09:59.879445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:09:59.879483Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533674928019582:9598]
2025-10-02T08:09:59.879567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:09:59.879580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 776
2025-10-02T08:09:59.879728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:09:59.879757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:09:59.879767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:09:59.879771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:09:59.880085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:09:59.880112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 776 sessionId:  describe result for acl check
2025-10-02T08:09:59.880145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:09:59.880153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:09:59.880155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:09:59.880160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533674928019588:9600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:09:59.880271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:09:59.880309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:09:59.880604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:09:59.880650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.880656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.880657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.880658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.880659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.880663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.880672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.880675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.880678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.880682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.880686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.880688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533674928019588:9600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:09:59.880693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:09:59.880699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.880703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:09:59.880707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.880716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:09:59.880721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.880725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.880729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.880734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.880752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:09:59.882819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533674928019588:9600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:09:59.888320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533674928019588:9600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:09:59.888338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533674928019588:9600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:09:59.888342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533674928019588:9600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:09:59.888351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:09:59.889037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:09:59.890805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:09:59.890819Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:09:59.890821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:09:59.890823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:09:59.890830Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 775 [1:7556533674928019582:9598]
2025-10-02T08:09:59.890839Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:09:59.890854Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:09:59.890857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.890859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.890860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.890874Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:09:59.890877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:09:59.890882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:09:59.890937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.890944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.890947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:09:59.890949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:09:59.891014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:09:59.891022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.891034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:09:59.891051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:09:59.891071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 775
2025-10-02T08:09:59.891076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928019630:9600], now have 1 active actors on pipe
2025-10-02T08:09:59.891082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533674928019576:9598]
2025-10-02T08:09:59.891084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533674928019576:9598]
2025-10-02T08:09:59.891093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:09:59.891102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533675388169118:2378], now have 1 active actors on pipe
2025-10-02T08:09:59.891106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.891106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:09:59.891109Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:09:59.891110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.891129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:09:59.891141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:09:59.891145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:09:59.891168Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 775
2025-10-02T08:09:59.891187Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:09:59.891201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.891205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.891207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:09:59.891213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.891223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:09:59.891236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533674928019576:9598]
2025-10-02T08:09:59.891248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:09:59.891270Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:09:59.891283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.891390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.891402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.891426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:09:59.891471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 776 partition: 0 MaxSeqNo: 17 sessionId: src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0
2025-10-02T08:09:59.891819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2f3b30-39e99516-9dcc499e-fa6ad1b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:09:59.894774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0] Write session: try to update token
2025-10-02T08:09:59.894791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:09:59.910912Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:09:59.910934Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:59.910945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533674928019576:9598]
2025-10-02T08:09:59.910991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:09:59.910992Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:09:59.911171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:09:59.911323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:59.911489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:59.911628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:09:59.911792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId: src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:09:59.912269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:09:59.912330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:09:59.914492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:09:59.914773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.914779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.914806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:09:59.914823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:09:59.914875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:09:59.914882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:09:59.915034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.915117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.915184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.915253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.915303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.915310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.915388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.915448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.915506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.915565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.915621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.915627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.915686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.915742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.915810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.915875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.915921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.915930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.915993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.916051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.916120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.916215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.916274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.916279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.916338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.916416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.916474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.916535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.916585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.916591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.916661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.916719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.916776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.916863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.916909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.916916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.916978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.917036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.917102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.917172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.917222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.917228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.917290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.917348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.917418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.917477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.917520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.917525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.917589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.917657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.917722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.917784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.917833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.917838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.917906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:09:59.917964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:09:59.918022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:09:59.918080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:09:59.918123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:09:59.918129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:09:59.918169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:09:59.918224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:09:59.918243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:09:59.918245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:09:59.918275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:09:59.918291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:09:59.918294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:09:59.918297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:09:59.918299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:09:59.918656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:09:59.918682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:09:59.918687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:09:59.918693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:09:59.918695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:09:59.918697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:09:59.919294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:09:59.919312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:09:59.919316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:09:59.919318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:09:59.919321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:09:59.919323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:09:59.919807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:09:59.919828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:09:59.919834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:09:59.919842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:09:59.919845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:09:59.921975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:09:59.921994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:09:59.922003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392599921
2025-10-02T08:09:59.922174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:09:59.922191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:09:59.922197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:09:59.922204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:09:59.922207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:09:59.922209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:09:59.922726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:09:59.922747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:09:59.922754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:09:59.922759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:09:59.922763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:09:59.922769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:09:59.923212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:09:59.923230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:09:59.923236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:09:59.923238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:09:59.923240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:09:59.923242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:09:59.923697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:09:59.923718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:09:59.923722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:09:59.925153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:09:59.925172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:09:59.925178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:09:59.925182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:09:59.925190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392599924
2025-10-02T08:09:59.925497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:09:59.925521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:09:59.925526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:09:59.925530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:09:59.925533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:09:59.925537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:09:59.926040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:09:59.926062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:09:59.926069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:09:59.926073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:09:59.926078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:09:59.926082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:09:59.926591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:09:59.926611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:09:59.926716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392599924
2025-10-02T08:09:59.931030Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:09:59.931061Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:09:59.931070Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:09:59.931080Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:09:59.932861Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:09:59.932878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:09:59.932880Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:09:59.932893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533674928019576:9598]
2025-10-02T08:09:59.932897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533674928019576:9598]
2025-10-02T08:09:59.932966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:09:59.932978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:09:59.932981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:09:59.933130Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:09:59.936868Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:09:59.936889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:09:59.988993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533674928019666:8944]
2025-10-02T08:09:59.991034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 775, pipe: [1:7556533674928019666:8944]
2025-10-02T08:10:00.078909Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:00.079284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533674928019666:8944], now have 1 active actors on pipe
2025-10-02T08:10:00.079562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:00.079422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533674928019666:8944]
2025-10-02T08:10:00.079443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:00.079445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:00.079473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 776 reason: error at write: Disconnected sessionId: src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0
2025-10-02T08:10:00.079690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 776 sessionId: src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0 is DEAD
2025-10-02T08:10:00.080131Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:00.080631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:00.080638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0] Write session will restart in 0.007542s
2025-10-02T08:10:00.080656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0] Write session: Do CDS request
2025-10-02T08:10:00.080661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:00.087098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:00.088543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:00.088709Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:00.088718Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:00.088727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:00.088765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:00.088845Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533679222987141:9617]
2025-10-02T08:10:00.089226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.089329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:00.089341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 777
2025-10-02T08:10:00.089404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:00.089469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.089498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:00.089506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:00.089509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:00.089586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:00.089626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:00.089874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 777 sessionId:  describe result for acl check
2025-10-02T08:10:00.089903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:00.089910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:00.089911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:00.089915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:00.089920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533679222987152:9619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:00.089937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.089937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.089938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.089939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.089940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.089945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.089954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.089957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.089961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.089963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.089968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.089974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.089980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.089984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.089987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.089991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.089994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.089998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.090001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.090006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.090021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:00.090396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533679222987152:9619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:00.092296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533679222987152:9619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:00.099748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533679222987152:9619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:00.099766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533679222987152:9619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:00.099769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533679222987152:9619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:00.099779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:00.100352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:00.102205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:00.102230Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:00.102233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:00.102237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:00.102244Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 776 [1:7556533679222987141:9617]
2025-10-02T08:10:00.102256Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:00.102275Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:00.102278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.102281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.102284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.102301Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:00.102306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:00.102313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:00.102388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.102403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.102406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:00.102409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:00.102485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:00.102493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.102508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.102524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:00.102546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533679222987135:9617]
2025-10-02T08:10:00.102553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533679222987135:9617]
2025-10-02T08:10:00.102570Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:00.102589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:00.102608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:00.102617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:00.102667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533679222987135:9617]
2025-10-02T08:10:00.102670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:00.102673Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:00.102674Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:00.102680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:00.102695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533679683136445:2378], now have 1 active actors on pipe
2025-10-02T08:10:00.102740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 776
2025-10-02T08:10:00.102749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222987185:9619], now have 1 active actors on pipe
2025-10-02T08:10:00.102833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.102843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.102830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 776
2025-10-02T08:10:00.102868Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:00.102879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.102883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.102885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:00.102897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.102911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:00.102932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.103027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.103045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.103075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.103126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 777 partition: 0 MaxSeqNo: 17 sessionId: src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0
2025-10-02T08:10:00.103506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08249ae-1850bbe8-81077cc6-d8a775c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:00.106387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0] Write session: try to update token
2025-10-02T08:10:00.106406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:00.122397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId: src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:00.124229Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:00.124247Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:00.124248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:00.124256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533679222987135:9617]
2025-10-02T08:10:00.124260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533679222987135:9617]
2025-10-02T08:10:00.124293Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:00.124295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:00.124297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:00.124300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.124302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:00.124478Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:00.125064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:00.179530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533679222987200:8944]
2025-10-02T08:10:00.179645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 776, pipe: [1:7556533679222987200:8944]
2025-10-02T08:10:00.260077Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:00.260380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.260393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.260430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222987200:8944], now have 1 active actors on pipe
2025-10-02T08:10:00.260526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:00.260530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:00.260572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 777 reason: error at write: Disconnected sessionId: src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0
2025-10-02T08:10:00.260609Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:00.260683Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:00.260761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 777 sessionId: src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0 is DEAD
2025-10-02T08:10:00.260912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533679222987200:8944]
2025-10-02T08:10:00.261010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:00.261017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0] Write session will restart in 0.005781s
2025-10-02T08:10:00.261039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0] Write session: Do CDS request
2025-10-02T08:10:00.261045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:00.268310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.268510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:00.268526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 778
2025-10-02T08:10:00.268645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.268687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:00.268699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:00.268703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:00.269106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 778 sessionId:  describe result for acl check
2025-10-02T08:10:00.269143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:00.269149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:00.269151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:00.269156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533679222987243:9624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:00.269651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533679222987243:9624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:00.271896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533679222987243:9624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:00.275023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:00.275402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:00.275411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533679222987243:9624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:00.275415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533679222987243:9624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:00.275417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533679222987243:9624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:00.275422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:00.275709Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:00.275720Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:00.275730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:00.275781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:00.275819Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533679222987392:9623]
2025-10-02T08:10:00.276373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:00.276572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:00.276613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:00.276906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:00.276947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.276951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.276952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.276952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.276953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.276958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.276966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.276970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.276974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.276977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.276983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.276994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.277004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.277008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.277012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.277016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.277023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.277027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.277031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.277034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.277052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:00.285559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:00.287311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:00.287331Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:00.287334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:00.287342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:00.287348Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 777 [1:7556533679222987392:9623]
2025-10-02T08:10:00.287357Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:00.287370Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:00.287372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.287374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.287375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.287400Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:00.287404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:00.287408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:00.287466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.287467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.287470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:00.287472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:00.287545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:00.287548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.287562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.287576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:00.287592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533679222987380:9623]
2025-10-02T08:10:00.287600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533679222987380:9623]
2025-10-02T08:10:00.287608Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:00.287619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:00.287624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:00.287628Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:00.287631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:00.287635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:00.287638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 777
2025-10-02T08:10:00.287644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222987388:9624], now have 1 active actors on pipe
2025-10-02T08:10:00.287648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533679683136451:2378], now have 1 active actors on pipe
2025-10-02T08:10:00.287681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533679222987380:9623]
2025-10-02T08:10:00.287693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:00.287700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.287706Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:00.287708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.287752Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:00.287716Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 777
2025-10-02T08:10:00.287764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.287767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.287770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:00.287778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.287787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:00.287805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.287854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.287866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.287883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.287918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 778 partition: 0 MaxSeqNo: 17 sessionId: src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0
2025-10-02T08:10:00.288380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2190ede-fd47cd78-fa40caa5-8aa63100_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:00.291994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0] Write session: try to update token
2025-10-02T08:10:00.292021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:00.312263Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:00.312284Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:00.312287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:00.312295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533679222987380:9623]
2025-10-02T08:10:00.312299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533679222987380:9623]
2025-10-02T08:10:00.312337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:00.312339Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:00.312344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.312345Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:00.312347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:00.312495Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:00.320450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId: src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:00.323034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:00.360796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533679222987418:8944]
2025-10-02T08:10:00.361026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 777, pipe: [1:7556533679222987418:8944]
2025-10-02T08:10:00.449567Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:00.449959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.449970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.449988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222987418:8944], now have 1 active actors on pipe
2025-10-02T08:10:00.450130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533679222987418:8944]
2025-10-02T08:10:00.450162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:00.450164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:00.450174Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:00.450228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 778 reason: error at write: Disconnected sessionId: src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0
2025-10-02T08:10:00.450422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 778 sessionId: src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0 is DEAD
2025-10-02T08:10:00.450252Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:00.450546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:00.450569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0] Write session will restart in 0.009144s
2025-10-02T08:10:00.450608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0] Write session: Do CDS request
2025-10-02T08:10:00.450616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:00.458680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:00.459041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:00.459198Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:00.459205Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:00.459213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:00.459251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:00.459278Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533679222987577:9629]
2025-10-02T08:10:00.459700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:00.459852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:00.459883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:00.460089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:00.460121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.460125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.460126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.460126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.460127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.460130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.460137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.460139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.460141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.460143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.460146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.460150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.460154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.460156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.460158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.460161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.460163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.460166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.460168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.460171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.460181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:00.461262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.461356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:00.461377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 779
2025-10-02T08:10:00.461521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.461551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:00.461563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:00.461567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:00.461985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 779 sessionId:  describe result for acl check
2025-10-02T08:10:00.462022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:00.462027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:00.462029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:00.462034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533679222987593:9631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:00.462523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533679222987593:9631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:00.464934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533679222987593:9631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:00.467754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533679222987593:9631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:00.467770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533679222987593:9631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:00.467773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533679222987593:9631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:00.467781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:00.468034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:00.469533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:00.469546Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:00.469548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:00.469551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:00.469555Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 778 [1:7556533679222987577:9629]
2025-10-02T08:10:00.469564Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:00.469576Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:00.469579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.469581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.469582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.469593Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:00.469599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:00.469603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:00.469644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.469649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.469651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:00.469653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:00.469707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:00.469714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.469725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.469734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:00.469751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222987624:9631], now have 1 active actors on pipe
2025-10-02T08:10:00.469755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 778
2025-10-02T08:10:00.469758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533679222987571:9629]
2025-10-02T08:10:00.469760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533679222987571:9629]
2025-10-02T08:10:00.469779Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:00.469782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:00.469793Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:00.469805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533679683136460:2378], now have 1 active actors on pipe
2025-10-02T08:10:00.469815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.469822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.469838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:00.469855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:00.469861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:00.469862Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 778
2025-10-02T08:10:00.469902Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f808e50-8b7359bb-988eaeba-946efca8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:00.469912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.469916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.469921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:00.469928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.469934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:00.469939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533679222987571:9629]
2025-10-02T08:10:00.469945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:00.469962Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:00.469975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.470044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.470052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.470065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.470096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 779 partition: 0 MaxSeqNo: 17 sessionId: src_id|f808e50-8b7359bb-988eaeba-946efca8_0
2025-10-02T08:10:00.470406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909af9ac-e353cf8c-40b1969c-b033c6aa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f808e50-8b7359bb-988eaeba-946efca8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:00.473273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f808e50-8b7359bb-988eaeba-946efca8_0] Write session: try to update token
2025-10-02T08:10:00.473288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f808e50-8b7359bb-988eaeba-946efca8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:00.487775Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:00.487792Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:00.487793Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:00.487800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533679222987571:9629]
2025-10-02T08:10:00.487804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533679222987571:9629]
2025-10-02T08:10:00.487841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:00.487846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:00.487848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.487850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:00.487850Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:00.487890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId: src_id|f808e50-8b7359bb-988eaeba-946efca8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:00.487998Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:00.492795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:00.549713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533679222987645:8944]
2025-10-02T08:10:00.549868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 778, pipe: [1:7556533679222987645:8944]
2025-10-02T08:10:00.619987Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:00.620479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.620492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.620523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222987645:8944], now have 1 active actors on pipe
2025-10-02T08:10:00.620644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533679222987645:8944]
2025-10-02T08:10:00.620670Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:00.620672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:00.620674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:00.620741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 779 reason: error at write: Disconnected sessionId: src_id|f808e50-8b7359bb-988eaeba-946efca8_0
2025-10-02T08:10:00.620858Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:00.620926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 779 sessionId: src_id|f808e50-8b7359bb-988eaeba-946efca8_0 is DEAD
2025-10-02T08:10:00.621078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f808e50-8b7359bb-988eaeba-946efca8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:00.621089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f808e50-8b7359bb-988eaeba-946efca8_0] Write session will restart in 0.007175s
2025-10-02T08:10:00.621129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f808e50-8b7359bb-988eaeba-946efca8_0] Write session: Do CDS request
2025-10-02T08:10:00.621136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f808e50-8b7359bb-988eaeba-946efca8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:00.629254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f808e50-8b7359bb-988eaeba-946efca8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.629488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:00.629502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 780
2025-10-02T08:10:00.629633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.629663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:00.629671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:00.629674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:00.629886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:00.630124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 780 sessionId:  describe result for acl check
2025-10-02T08:10:00.630171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:00.630185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:00.630187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:00.630193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533679222987816:9639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:00.630766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533679222987816:9639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:00.631443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:00.631664Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:00.631676Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:00.631688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:00.631757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:00.631806Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533679222987824:9636]
2025-10-02T08:10:00.632468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:00.632681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:00.632749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:00.633112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:00.633171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.633179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.633180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.633181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.633183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.633190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.633199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.633201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.633204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.633206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.633212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.633217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.633221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.633224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.633228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.633232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.633234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.633237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.633240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.633243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.633255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:00.633285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533679222987816:9639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:00.639178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533679222987816:9639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:00.639205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533679222987816:9639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:00.639208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533679222987816:9639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:00.639215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:00.641347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:00.643211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:00.643230Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:00.643232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:00.643235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:00.643241Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 779 [1:7556533679222987824:9636]
2025-10-02T08:10:00.643253Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:00.643269Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:00.643271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.643274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.643275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.643292Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:00.643301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:00.643308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:00.643369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.643388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.643391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:00.643392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:00.643469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:00.643478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.643492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.643510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:00.643531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533679222987809:9636]
2025-10-02T08:10:00.643536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533679222987809:9636]
2025-10-02T08:10:00.643550Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:00.643567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:00.643582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:00.643584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:00.643584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:00.643588Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:00.643619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533679222987809:9636]
2025-10-02T08:10:00.643621Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:00.643667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:00.643679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 779
2025-10-02T08:10:00.643694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222987863:9639], now have 1 active actors on pipe
2025-10-02T08:10:00.643772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533679683136478:2378], now have 1 active actors on pipe
2025-10-02T08:10:00.643791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.643798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.643832Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:00.643847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.643857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.643860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:00.643874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.643888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:00.643905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.643938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.643951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.643964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.643998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 780 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0
2025-10-02T08:10:00.644091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 779
2025-10-02T08:10:00.644417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f808e50-8b7359bb-988eaeba-946efca8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:00.647418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0] Write session: try to update token
2025-10-02T08:10:00.647437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:00.663161Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:00.663188Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:00.663191Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:00.663203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533679222987809:9636]
2025-10-02T08:10:00.663210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533679222987809:9636]
2025-10-02T08:10:00.663262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:00.663270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.663272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:00.663452Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:00.664870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:00.664877Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:00.668696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId: src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:00.671815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:00.720729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533679222987878:8944]
2025-10-02T08:10:00.720875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 779, pipe: [1:7556533679222987878:8944]
2025-10-02T08:10:00.810767Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:00.811357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.811390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.811419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222987878:8944], now have 1 active actors on pipe
2025-10-02T08:10:00.811563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533679222987878:8944]
2025-10-02T08:10:00.811589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:00.811596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:00.811665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 780 reason: error at write: Disconnected sessionId: src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0
2025-10-02T08:10:00.811674Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:00.811739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:00.811866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 780 sessionId: src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0 is DEAD
2025-10-02T08:10:00.812041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:00.812053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0] Write session will restart in 0.007065s
2025-10-02T08:10:00.812093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0] Write session: Do CDS request
2025-10-02T08:10:00.812100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:00.820351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.820438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:00.820457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 781
2025-10-02T08:10:00.820623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:00.820656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:00.820668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:00.820671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:00.821082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 781 sessionId:  describe result for acl check
2025-10-02T08:10:00.821118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:00.821120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:00.821121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:00.821127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533679222988033:9644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:00.821652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533679222988033:9644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:00.823036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:00.823537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:00.823759Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:00.823771Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:00.823780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:00.823835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:00.823873Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533679222988059:9643]
2025-10-02T08:10:00.823886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533679222988033:9644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:00.824519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:00.824704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:00.824760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:00.825082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:00.825131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.825138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.825139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.825140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.825141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.825147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.825156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.825159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.825163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.825166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.825171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.825178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:00.825185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.825190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:00.825194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.825200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:00.825203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.825208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.825213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.825217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.825234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:00.831796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533679222988033:9644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:00.831816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533679222988033:9644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:00.831819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533679222988033:9644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:00.831828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:00.837583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:00.839316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:00.839337Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:00.839340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:00.839344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:00.839352Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 780 [1:7556533679222988059:9643]
2025-10-02T08:10:00.839364Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:00.839392Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:00.839395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.839398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.839400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.839418Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:00.839426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:00.839432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:00.839507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.839516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.839519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:00.839521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:00.839592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:00.839602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.839616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:00.839627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:00.839643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533679222988053:9643]
2025-10-02T08:10:00.839651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533679222988053:9643]
2025-10-02T08:10:00.839665Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:00.839678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:00.839690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:00.839705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:00.839717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:00.839720Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:00.839742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533679222988053:9643]
2025-10-02T08:10:00.839744Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:00.839790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 780
2025-10-02T08:10:00.839806Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:00.839814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222988086:9644], now have 1 active actors on pipe
2025-10-02T08:10:00.839856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.839867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.839883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533679683136485:2378], now have 1 active actors on pipe
2025-10-02T08:10:00.839897Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:00.839904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:00.839907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:00.839910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:00.839920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:00.839936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:00.839952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.839993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.840006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.840017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:00.840047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 781 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0
2025-10-02T08:10:00.840153Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 780
2025-10-02T08:10:00.842818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bcbc7e-f17ebf2f-f7391661-2d61242a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:00.845578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0] Write session: try to update token
2025-10-02T08:10:00.845596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:00.862310Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:00.862332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:00.862342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533679222988053:9643]
2025-10-02T08:10:00.862393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:00.862585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:00.862745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:00.862897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:00.863049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:00.863248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:00.863284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:00.865579Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:00.871537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId: src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:00.874264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:00.877920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:00.877949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:00.877972Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:00.877975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:00.877977Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:00.877987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533679222988053:9643]
2025-10-02T08:10:00.877991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533679222988053:9643]
2025-10-02T08:10:00.878052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:00.878059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:00.878065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:00.878066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:00.878068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:00.878227Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:00.912044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533679222988101:8944]
2025-10-02T08:10:00.912183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 780, pipe: [1:7556533679222988101:8944]
2025-10-02T08:10:01.025817Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:01.026444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:01.026473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533679222988101:8944], now have 1 active actors on pipe
2025-10-02T08:10:01.026490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:01.026612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:01.026621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:01.026640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 781 reason: error at write: Disconnected sessionId: src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0
2025-10-02T08:10:01.026799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 781 sessionId: src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0 is DEAD
2025-10-02T08:10:01.026742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:01.026990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:01.027003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0] Write session will restart in 0.008346s
2025-10-02T08:10:01.027029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0] Write session: Do CDS request
2025-10-02T08:10:01.027036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:01.028469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533679222988101:8944]
2025-10-02T08:10:01.036361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.036784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:01.036818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 782
2025-10-02T08:10:01.036991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.037029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:01.037033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:01.037037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:01.037424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 782 sessionId:  describe result for acl check
2025-10-02T08:10:01.037451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:01.037453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:01.037454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:01.037459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533683517955573:9658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:01.037988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533683517955573:9658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:01.038957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:01.039401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:01.039651Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:01.039665Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:01.039677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:01.039737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:01.039777Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533683517955591:9656]
2025-10-02T08:10:01.040382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:01.040795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:01.040865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:01.041171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:01.041217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.041218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.041220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.041221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.041222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.041227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.041237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.041241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.041245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.041249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.041254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.041261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.041266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.041271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.041275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.041281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.041285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.041290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.041295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.041301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.041321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:01.042417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533683517955573:9658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:01.049938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533683517955573:9658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:01.049957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533683517955573:9658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:01.049960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533683517955573:9658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:01.049969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:01.050707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:01.053010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:01.053028Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:01.053030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:01.053033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:01.053038Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 781 [1:7556533683517955591:9656]
2025-10-02T08:10:01.053048Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:01.053067Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:01.053070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.053073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.053075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.053091Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:01.053096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:01.053102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:01.053166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.053168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.053170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:01.053172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:01.053243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:01.053245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.053258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.053268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:01.053283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533683517955581:9656]
2025-10-02T08:10:01.053284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533683517955581:9656]
2025-10-02T08:10:01.053291Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:01.053302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:01.053313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:01.053315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:01.053350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533683517955581:9656]
2025-10-02T08:10:01.053352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:01.053360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517955637:9658], now have 1 active actors on pipe
2025-10-02T08:10:01.053367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 781
2025-10-02T08:10:01.053388Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:01.053393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:01.053401Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:01.053458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533683978103802:2378], now have 1 active actors on pipe
2025-10-02T08:10:01.053468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.053477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.053514Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:01.053527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.053759Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 781
2025-10-02T08:10:01.053533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.053536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:01.053554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.053572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:01.053594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.053733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.053736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.053752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.053791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 782 partition: 0 MaxSeqNo: 17 sessionId: src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0
2025-10-02T08:10:01.054178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c061a8-916a35b3-704f00cc-f64fa5ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:01.057427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0] Write session: try to update token
2025-10-02T08:10:01.057445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:01.073170Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:01.073199Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:01.073202Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:01.073213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533683517955581:9656]
2025-10-02T08:10:01.073222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533683517955581:9656]
2025-10-02T08:10:01.073266Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:01.073270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:01.073272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:01.073279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.073282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:01.073433Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:01.084446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId: src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:01.087048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:01.128947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533683517955659:8944]
2025-10-02T08:10:01.129178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 781, pipe: [1:7556533683517955659:8944]
2025-10-02T08:10:01.227834Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:01.228311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.228325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.228346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517955659:8944], now have 1 active actors on pipe
2025-10-02T08:10:01.228488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:01.228503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:01.228581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 782 reason: error at write: Disconnected sessionId: src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0
2025-10-02T08:10:01.228770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 782 sessionId: src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0 is DEAD
2025-10-02T08:10:01.228641Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:01.228958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:01.228967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0] Write session will restart in 0.005920s
2025-10-02T08:10:01.228990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0] Write session: Do CDS request
2025-10-02T08:10:01.228997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:01.228978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533683517955659:8944]
2025-10-02T08:10:01.229504Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:01.236643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.241213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:01.241236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 783
2025-10-02T08:10:01.244986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.245055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:01.245068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:01.245074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:01.245547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 783 sessionId:  describe result for acl check
2025-10-02T08:10:01.245583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:01.245592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:01.245595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:01.245602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533683517955808:9669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:01.246193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533683517955808:9669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:01.253395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:01.255921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533683517955808:9669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:01.265340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:01.265666Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:01.265670Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:01.265681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:01.265741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:01.265781Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533683517955854:9668]
2025-10-02T08:10:01.266469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:01.266666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:01.266704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:01.266994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:01.267032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.267033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.267035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.267036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.267037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.267042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.267052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.267057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.267061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.267065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.267070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.267077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.267084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.267089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.267094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.267100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.267105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.267109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.267114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.267119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.267140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:01.277756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533683517955808:9669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:01.277777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533683517955808:9669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:01.277780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533683517955808:9669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:01.277790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:01.284465Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 782
2025-10-02T08:10:01.282419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:01.284023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:01.284030Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:01.284034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:01.284038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:01.284045Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 782 [1:7556533683517955854:9668]
2025-10-02T08:10:01.284058Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:01.284077Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:01.284080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.284084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.284087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.284104Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:01.284109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:01.284116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:01.284188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.284194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.284197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:01.284199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:01.284278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:01.284289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.284303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.284315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:01.284333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533683517955826:9668]
2025-10-02T08:10:01.284335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533683517955826:9668]
2025-10-02T08:10:01.284342Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:01.284356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517955870:9669], now have 1 active actors on pipe
2025-10-02T08:10:01.284362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533683978103817:2378], now have 1 active actors on pipe
2025-10-02T08:10:01.284354Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:01.284365Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:01.284367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:01.284380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:01.284383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:01.284418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533683517955826:9668]
2025-10-02T08:10:01.284428Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:01.284458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:01.284471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 782
2025-10-02T08:10:01.284568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.284573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.284604Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba237dbe-5367dbca-78d1e918-9072842e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:01.284610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.284614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.284616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:01.284627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.284636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:01.284653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.284692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.284694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.284706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.284737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 783 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba237dbe-5367dbca-78d1e918-9072842e_0
2025-10-02T08:10:01.285177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bbdee-ca57e8a8-de55c5ce-4a579ef4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba237dbe-5367dbca-78d1e918-9072842e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:01.288223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba237dbe-5367dbca-78d1e918-9072842e_0] Write session: try to update token
2025-10-02T08:10:01.288244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba237dbe-5367dbca-78d1e918-9072842e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:01.304959Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:01.304981Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:01.304993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533683517955826:9668]
2025-10-02T08:10:01.305036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:01.305216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:01.305359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:01.305497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:01.305632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:01.305838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:01.305873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:01.306028Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:01.315163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId: src_id|ba237dbe-5367dbca-78d1e918-9072842e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:01.318036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:01.318251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.318260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.318296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:01.318310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:01.318438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.318441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.318612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.318702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.318772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.318848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.319107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.319117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.319192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.319256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.319345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.319457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.319506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.319517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.319590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.319655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.319759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.319833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.319890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.319897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.319967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.320037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.320104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.320172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.320243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.320251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.320320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.320389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.320461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.320535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.320592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.320600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.320677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.320742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.320831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.320912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.320967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.320976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.321061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.321133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.321215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.321292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.321349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.321359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.321435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.321512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.321589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.321665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.321726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.321734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.321810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.321887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.321963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.322133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.322187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.322195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.322281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:01.322357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:01.322431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:01.322507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:01.322561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:01.322570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:01.322620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:01.322694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.322720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.322727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:01.322763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:01.322785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:01.322793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:01.322797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:01.322800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:01.323297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:01.323334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:01.323349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:01.323359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:01.323363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:01.323385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:01.324100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:01.324132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:01.324140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:01.324152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:01.324160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:01.324164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:01.324876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:01.324902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:01.324908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:01.324912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:01.324916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:01.326417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:01.326440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:01.326452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392601322
2025-10-02T08:10:01.326625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:01.326640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:01.326646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:01.326652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:01.326657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:01.326660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:01.327207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:01.327231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:01.327238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:01.327242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:01.327247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:01.327253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:01.327792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:01.327819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:01.327833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:01.327836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:01.327840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:01.327844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:01.328370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:01.328397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:01.328402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:01.329785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:01.329804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:01.329811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:01.329815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:01.329825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392601328
2025-10-02T08:10:01.330146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:01.330161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:01.330168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:01.330171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:01.330175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:01.330179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:01.330850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:01.330862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:01.330867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:01.330872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:01.330875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:01.330879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:01.331394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:01.331405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.331515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392601328
2025-10-02T08:10:01.332403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533683517955884:8944]
2025-10-02T08:10:01.332452Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:01.332464Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:01.332471Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:01.332480Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:01.334642Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:01.334661Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:01.334663Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:01.334677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533683517955826:9668]
2025-10-02T08:10:01.334681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533683517955826:9668]
2025-10-02T08:10:01.334748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:01.334753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.334755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:01.334904Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:01.336873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:01.336880Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:01.344367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 782, pipe: [1:7556533683517955884:8944]
2025-10-02T08:10:01.498916Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:01.499341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517955884:8944], now have 1 active actors on pipe
2025-10-02T08:10:01.500163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba237dbe-5367dbca-78d1e918-9072842e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:01.500179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba237dbe-5367dbca-78d1e918-9072842e_0] Write session will restart in 0.008493s
2025-10-02T08:10:01.499668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533683517955884:8944]
2025-10-02T08:10:01.499694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:01.499696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:01.500209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba237dbe-5367dbca-78d1e918-9072842e_0] Write session: Do CDS request
2025-10-02T08:10:01.499717Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:01.499729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 783 reason: error at write: Disconnected sessionId: src_id|ba237dbe-5367dbca-78d1e918-9072842e_0
2025-10-02T08:10:01.499926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 783 sessionId: src_id|ba237dbe-5367dbca-78d1e918-9072842e_0 is DEAD
2025-10-02T08:10:01.500219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba237dbe-5367dbca-78d1e918-9072842e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:01.500595Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:01.511737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:01.512046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:01.512178Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:01.512185Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:01.512192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:01.512222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:01.512251Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533683517956063:9674]
2025-10-02T08:10:01.512694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:01.513454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba237dbe-5367dbca-78d1e918-9072842e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.513511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:01.513520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 784
2025-10-02T08:10:01.514019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:01.514061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:01.514313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:01.514353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.514358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.514359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.514360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.514361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.514364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.514371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.514374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.514376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.514378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.514383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.514387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.514392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.514395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.514397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.514401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.514403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.514406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.514409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.514412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.514423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:01.517105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.517157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:01.517163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:01.517167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:01.517637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 784 sessionId:  describe result for acl check
2025-10-02T08:10:01.517677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:01.517679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:01.517681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:01.517687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533683517956085:9676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:01.518325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533683517956085:9676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:01.522280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533683517956085:9676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:01.526757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:01.528607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:01.528612Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:01.528615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:01.528619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:01.528626Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 783 [1:7556533683517956063:9674]
2025-10-02T08:10:01.528638Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:01.528655Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:01.528662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.528664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.528666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.528681Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:01.528686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:01.528692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:01.528754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.528756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.528760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:01.528762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:01.534656Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 783
2025-10-02T08:10:01.534759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:01.534780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.534796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.534808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:01.534832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533683978103827:2378], now have 1 active actors on pipe
2025-10-02T08:10:01.534849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533683517956057:9674]
2025-10-02T08:10:01.534852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533683517956057:9674]
2025-10-02T08:10:01.534862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:01.534882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:01.534896Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:01.534900Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:01.534902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:01.534906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:01.534944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533683517956057:9674]
2025-10-02T08:10:01.534955Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:01.535073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:01.536061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533683517956085:9676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:01.536079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533683517956085:9676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:01.536083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533683517956085:9676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:01.536093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:01.536478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 783
2025-10-02T08:10:01.536495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517956125:9676], now have 1 active actors on pipe
2025-10-02T08:10:01.536502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.536508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.536534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:01.536548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.536552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.536555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:01.536565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.536583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:01.536605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.536682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.536690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.536704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.536730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 784 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0
2025-10-02T08:10:01.539239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba237dbe-5367dbca-78d1e918-9072842e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:01.542170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0] Write session: try to update token
2025-10-02T08:10:01.542191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:01.546662Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:01.546684Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:01.546695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533683517956057:9674]
2025-10-02T08:10:01.546741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:01.546742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:01.546929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:01.547084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:01.547227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:01.547384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:01.547587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:01.547624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:01.566731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId: src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:01.566935Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:01.566955Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:01.566957Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:01.566970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533683517956057:9674]
2025-10-02T08:10:01.566974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533683517956057:9674]
2025-10-02T08:10:01.567018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:01.567023Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:01.567028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.567029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:01.567031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:01.567191Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:01.569481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:01.596245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533683517956131:8944]
2025-10-02T08:10:01.596456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 783, pipe: [1:7556533683517956131:8944]
2025-10-02T08:10:01.732995Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:01.733345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.733360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.733381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517956131:8944], now have 1 active actors on pipe
2025-10-02T08:10:01.733693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:01.734324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:01.734335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0] Write session will restart in 0.009485s
2025-10-02T08:10:01.733618Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:01.734356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0] Write session: Do CDS request
2025-10-02T08:10:01.733620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:01.734364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:01.733625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:01.733726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 784 reason: error at write: Disconnected sessionId: src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0
2025-10-02T08:10:01.733904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 784 sessionId: src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0 is DEAD
2025-10-02T08:10:01.734075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533683517956131:8944]
2025-10-02T08:10:01.745317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.745622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:01.745638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 785
2025-10-02T08:10:01.745758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.745789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:01.745798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:01.745801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:01.746221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 785 sessionId:  describe result for acl check
2025-10-02T08:10:01.746265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:01.746271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:01.746273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:01.746279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533683517956292:9683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:01.746789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533683517956292:9683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:01.748676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533683517956292:9683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:01.748777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:01.750162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:01.750357Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:01.750366Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:01.750376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:01.750426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:01.750465Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533683517956343:9682]
2025-10-02T08:10:01.751119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:01.751290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:01.751330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:01.751631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533683517956292:9683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:01.751634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:01.751646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533683517956292:9683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:01.751648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533683517956292:9683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:01.751657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:01.751669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.751677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.751679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.751680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.751681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.751686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.751696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.751705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.751709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.751717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.751722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.751728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.751738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.751743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.751748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.751757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.751761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.751767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.751772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.751782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.751800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:01.760681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:01.762366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:01.762385Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:01.762388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:01.762391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:01.762399Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 784 [1:7556533683517956343:9682]
2025-10-02T08:10:01.762411Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:01.762430Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:01.762433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.762436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.762438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.762455Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:01.762466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:01.762474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:01.762542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.762548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.762551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:01.762554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:01.762624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:01.762631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.762645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.762663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:01.762682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533683517956327:9682]
2025-10-02T08:10:01.762687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533683517956327:9682]
2025-10-02T08:10:01.762702Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:01.762718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:01.762735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:01.762741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:01.762777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533683517956327:9682]
2025-10-02T08:10:01.762782Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:01.762801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517956355:9683], now have 1 active actors on pipe
2025-10-02T08:10:01.762819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533683978103846:2378], now have 1 active actors on pipe
2025-10-02T08:10:01.762823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 784
2025-10-02T08:10:01.762863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.762871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.762895Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:01.762905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.762908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.762911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:01.762921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.762930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:01.762949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.763073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:01.763085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:01.763091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:01.763128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.763134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.763148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.763183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 785 partition: 0 MaxSeqNo: 17 sessionId: src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0
2025-10-02T08:10:01.763518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7402a9-3d60a484-6012bc29-ebed151f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:01.763096Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 784
2025-10-02T08:10:01.766464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0] Write session: try to update token
2025-10-02T08:10:01.766480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:01.783197Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:01.783219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:01.783222Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:01.783230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533683517956327:9682]
2025-10-02T08:10:01.783234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533683517956327:9682]
2025-10-02T08:10:01.783275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:01.783283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.783286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:01.783287Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:01.783293Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:01.783452Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:01.791879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId: src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:01.794746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:01.834312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533683517956373:8944]
2025-10-02T08:10:01.834443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 784, pipe: [1:7556533683517956373:8944]
2025-10-02T08:10:01.949604Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:01.950023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.950031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.950054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517956373:8944], now have 1 active actors on pipe
2025-10-02T08:10:01.950372Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:01.951179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:01.951192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0] Write session will restart in 0.009124s
2025-10-02T08:10:01.951219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0] Write session: Do CDS request
2025-10-02T08:10:01.951227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:01.950753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:01.950837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 785 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0
2025-10-02T08:10:01.951027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 785 sessionId: src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0 is DEAD
2025-10-02T08:10:01.951162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533683517956373:8944]
2025-10-02T08:10:01.953418Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:01.961370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.963699Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:01.963716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 786
2025-10-02T08:10:01.963900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:01.963950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:01.963965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:01.963969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:01.964715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 786 sessionId:  describe result for acl check
2025-10-02T08:10:01.964754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:01.964756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:01.964758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:01.964763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533683517956545:9691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:01.965158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:01.965291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533683517956545:9691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:01.966714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:01.966903Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:01.966907Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:01.966917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:01.966968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:01.967003Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533683517956563:9689]
2025-10-02T08:10:01.967700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:01.967911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:01.967967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:01.968531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:01.968603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.968611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.968612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.968613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.968614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.968620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.968631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.968635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.968640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.968644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.968650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.968663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:01.968674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.968681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:01.968686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.968697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:01.968702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.968713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.968718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.968728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.968750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:01.969657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533683517956545:9691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:01.980639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:01.982445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:01.982464Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:01.982466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:01.982470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:01.982476Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 785 [1:7556533683517956563:9689]
2025-10-02T08:10:01.982488Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:01.982506Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:01.982508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.982511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.982514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.982530Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:01.982534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:01.982543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:01.982608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.982620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.982622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:01.982624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:01.982689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:01.982697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:01.982711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:01.982723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:01.982739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533683517956546:9689]
2025-10-02T08:10:01.982742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533683517956546:9689]
2025-10-02T08:10:01.982748Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:01.982763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:01.982777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:01.982779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:01.982813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533683517956546:9689]
2025-10-02T08:10:01.982815Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:01.984951Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:01.984964Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:01.984971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:01.985368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533683517956545:9691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:01.985375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533683517956545:9691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:01.985378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533683517956545:9691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:01.985386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:01.985563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533683978103855:2378], now have 1 active actors on pipe
2025-10-02T08:10:01.987299Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 785
2025-10-02T08:10:01.985781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 785
2025-10-02T08:10:01.985791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533683517956598:9691], now have 1 active actors on pipe
2025-10-02T08:10:01.989475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.989496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.989541Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d228636-77f7b576-fe620e80-fad7c353_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:01.989551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:01.989557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:01.989560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:01.989572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:01.989588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:01.989609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.990479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cf3592-ecca6a62-8a6b0ca8-5911dab4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d228636-77f7b576-fe620e80-fad7c353_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:01.993524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d228636-77f7b576-fe620e80-fad7c353_0] Write session: try to update token
2025-10-02T08:10:01.993544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d228636-77f7b576-fe620e80-fad7c353_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:01.990022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:01.990033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:01.990052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:01.990096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 786 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d228636-77f7b576-fe620e80-fad7c353_0
2025-10-02T08:10:02.008903Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:02.008922Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:02.008924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:02.008933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533683517956546:9689]
2025-10-02T08:10:02.008938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533683517956546:9689]
2025-10-02T08:10:02.008980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:02.008986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.008989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:02.009130Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:02.015342Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:02.015365Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:02.031998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId: src_id|2d228636-77f7b576-fe620e80-fad7c353_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:02.034841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:02.086360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533687812923917:8944]
2025-10-02T08:10:02.089437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 785, pipe: [1:7556533687812923917:8944]
2025-10-02T08:10:02.161209Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:02.162003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.162019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.162040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812923917:8944], now have 1 active actors on pipe
2025-10-02T08:10:02.162267Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:02.162527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533687812923917:8944]
2025-10-02T08:10:02.162571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:02.162630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 786 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d228636-77f7b576-fe620e80-fad7c353_0
2025-10-02T08:10:02.162622Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:02.162796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 786 sessionId: src_id|2d228636-77f7b576-fe620e80-fad7c353_0 is DEAD
2025-10-02T08:10:02.163148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d228636-77f7b576-fe620e80-fad7c353_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:02.163166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d228636-77f7b576-fe620e80-fad7c353_0] Write session will restart in 0.009141s
2025-10-02T08:10:02.163196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d228636-77f7b576-fe620e80-fad7c353_0] Write session: Do CDS request
2025-10-02T08:10:02.163204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d228636-77f7b576-fe620e80-fad7c353_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:02.173561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d228636-77f7b576-fe620e80-fad7c353_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:02.174235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:02.174257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 787
2025-10-02T08:10:02.174359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:02.174391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:02.174401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:02.174405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:02.174775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 787 sessionId:  describe result for acl check
2025-10-02T08:10:02.174822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:02.174829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:02.174831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:02.174836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533687812924102:9708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:02.175357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533687812924102:9708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:02.178595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:02.178933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:02.179091Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:02.179101Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:02.179111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:02.179153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:02.179194Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533687812924133:9707]
2025-10-02T08:10:02.179800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533687812924102:9708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:02.179802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:02.179984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:02.180043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:02.180343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:02.180410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.180419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.180420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.180424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.180425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.180430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.180440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.180444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.180448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.180451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.180456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.180464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.180468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.180472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.180481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.180486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.180494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.180499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.180505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.180510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.180535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:02.186489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533687812924102:9708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:02.186507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533687812924102:9708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:02.186510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533687812924102:9708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:02.186520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:02.191818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:02.193358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:02.193377Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:02.193380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:02.193384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:02.193392Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 786 [1:7556533687812924133:9707]
2025-10-02T08:10:02.193405Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:02.193427Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:02.193434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:02.193437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:02.193440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:02.193457Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:02.193462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:02.193469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:02.193537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.193545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.193549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:02.193551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:02.193625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:02.193633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.193647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.193663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:02.193686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812924160:9708], now have 1 active actors on pipe
2025-10-02T08:10:02.193686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 786
2025-10-02T08:10:02.193698Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533687812924123:9707]
2025-10-02T08:10:02.193700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533687812924123:9707]
2025-10-02T08:10:02.193711Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:02.193725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533688273071179:2378], now have 1 active actors on pipe
2025-10-02T08:10:02.193727Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:02.193730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:02.193735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.193740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.193758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:02.193778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:02.193785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:02.193787Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 786
2025-10-02T08:10:02.193828Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:02.193838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:02.193842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:02.193844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:02.193852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:02.193864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:02.193877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533687812924123:9707]
2025-10-02T08:10:02.193888Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:02.193906Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:02.193933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:02.194012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.194021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.194037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:02.194077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 787 partition: 0 MaxSeqNo: 17 sessionId: src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0
2025-10-02T08:10:02.194401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d228636-77f7b576-fe620e80-fad7c353_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:02.197088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0] Write session: try to update token
2025-10-02T08:10:02.197106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:02.214750Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:02.214793Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:02.214797Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:02.214810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533687812924123:9707]
2025-10-02T08:10:02.214822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533687812924123:9707]
2025-10-02T08:10:02.214872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:02.214898Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:02.215154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:02.215177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.215179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:02.215459Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:02.223153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId: src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:02.226254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:02.262883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533687812924177:8944]
2025-10-02T08:10:02.263102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 786, pipe: [1:7556533687812924177:8944]
2025-10-02T08:10:02.374433Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:02.374749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.374763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.374785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812924177:8944], now have 1 active actors on pipe
2025-10-02T08:10:02.375110Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:02.375156Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:02.375429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:02.375486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 787 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0
2025-10-02T08:10:02.375550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533687812924177:8944]
2025-10-02T08:10:02.375655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 787 sessionId: src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0 is DEAD
2025-10-02T08:10:02.375824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:02.375835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0] Write session will restart in 0.005887s
2025-10-02T08:10:02.375873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0] Write session: Do CDS request
2025-10-02T08:10:02.375880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:02.388341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:02.390198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:02.390221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 788
2025-10-02T08:10:02.390491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:02.390525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:02.390536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:02.390539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:02.390912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 788 sessionId:  describe result for acl check
2025-10-02T08:10:02.390951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:02.390958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:02.390960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:02.390965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533687812924339:9714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:02.391497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533687812924339:9714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:02.397427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533687812924339:9714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:02.398085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:02.398632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:02.398825Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:02.398829Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:02.398839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:02.398886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:02.398927Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533687812924386:9713]
2025-10-02T08:10:02.399521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:02.399766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:02.399824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:02.400149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:02.400213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.400221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.400222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.400223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.400224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.400230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.400239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.400243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.400247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.400250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.400258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.400264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.400271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.400276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.400280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.400284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.400288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.400292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.400296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.400301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.400319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:02.407700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533687812924339:9714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:02.407725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533687812924339:9714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:02.407728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533687812924339:9714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:02.407740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:02.411412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:02.414256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:02.414286Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:02.414289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:02.414294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:02.414302Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 787 [1:7556533687812924386:9713]
2025-10-02T08:10:02.414315Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:02.414336Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:02.414343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:02.414347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:02.414349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:02.414368Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:02.414374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:02.414382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:02.414472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.414475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.414478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:02.414480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:02.414583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:02.414585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.414602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.414614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:02.414642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812924402:9714], now have 1 active actors on pipe
2025-10-02T08:10:02.414647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533688273071186:2378], now have 1 active actors on pipe
2025-10-02T08:10:02.414655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533687812924374:9713]
2025-10-02T08:10:02.414658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533687812924374:9713]
2025-10-02T08:10:02.414677Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:02.414694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:02.414696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:02.414698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:02.414711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:02.414714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:02.414755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533687812924374:9713]
2025-10-02T08:10:02.414758Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:02.414763Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:02.414826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 787
2025-10-02T08:10:02.414966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.414972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.415000Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|114aed36-444d2858-acb4e199-52e718e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:02.415009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:02.415013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:02.415015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:02.415025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:02.415036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:02.415054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:02.415078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.415081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.415092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:02.415122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 788 partition: 0 MaxSeqNo: 17 sessionId: src_id|114aed36-444d2858-acb4e199-52e718e2_0
2025-10-02T08:10:02.414746Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 787
2025-10-02T08:10:02.415660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b07ee0-9d9654d7-ccadd151-e82b2d98_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|114aed36-444d2858-acb4e199-52e718e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:02.418432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114aed36-444d2858-acb4e199-52e718e2_0] Write session: try to update token
2025-10-02T08:10:02.418451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114aed36-444d2858-acb4e199-52e718e2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:02.435622Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:02.435643Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:02.435646Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:02.435655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533687812924374:9713]
2025-10-02T08:10:02.435658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533687812924374:9713]
2025-10-02T08:10:02.435694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:02.435700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.435702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:02.435720Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:02.435726Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:02.435839Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:02.447274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId: src_id|114aed36-444d2858-acb4e199-52e718e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:02.450261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:02.475465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533687812924420:8944]
2025-10-02T08:10:02.475750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 787, pipe: [1:7556533687812924420:8944]
2025-10-02T08:10:02.578651Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:02.579071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.579079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.579099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812924420:8944], now have 1 active actors on pipe
2025-10-02T08:10:02.579604Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:02.579924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:02.579980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 788 reason: status is not ok: tablet will be restarted right now sessionId: src_id|114aed36-444d2858-acb4e199-52e718e2_0
2025-10-02T08:10:02.580144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 788 sessionId: src_id|114aed36-444d2858-acb4e199-52e718e2_0 is DEAD
2025-10-02T08:10:02.580285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533687812924420:8944]
2025-10-02T08:10:02.580732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114aed36-444d2858-acb4e199-52e718e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:02.580749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114aed36-444d2858-acb4e199-52e718e2_0] Write session will restart in 0.005833s
2025-10-02T08:10:02.580777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114aed36-444d2858-acb4e199-52e718e2_0] Write session: Do CDS request
2025-10-02T08:10:02.580786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114aed36-444d2858-acb4e199-52e718e2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:02.581236Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:02.588357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114aed36-444d2858-acb4e199-52e718e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:02.588732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:02.588755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 789
2025-10-02T08:10:02.588887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:02.588925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:02.588942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:02.588951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:02.593834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 789 sessionId:  describe result for acl check
2025-10-02T08:10:02.593891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:02.593892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:02.593894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:02.593902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533687812924468:9721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:02.594493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533687812924468:9721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:02.600702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533687812924468:9721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:02.605613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:02.607853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:02.608089Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:02.608094Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:02.608106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:02.608158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:02.608201Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533687812924636:9720]
2025-10-02T08:10:02.608976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:02.609392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:02.609443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:02.609812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:02.609861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.609863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.609865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.609866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.609867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.609873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.609885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.609890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.609894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.609899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.609905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.609914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.609921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.609927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.609931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.609936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.609941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.609947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.609952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.609957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.609977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:02.620400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533687812924468:9721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:02.620428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533687812924468:9721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:02.620432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533687812924468:9721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:02.620442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:02.621937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:02.624977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:02.625004Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:02.625009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:02.625013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:02.625023Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 788 [1:7556533687812924636:9720]
2025-10-02T08:10:02.625041Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:02.625071Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:02.625074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:02.625078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:02.625080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:02.625101Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:02.625109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:02.625118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:02.625211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.625214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.625218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:02.625222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:02.625484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:02.625495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.625513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.625526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:02.625539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812924653:9721], now have 1 active actors on pipe
2025-10-02T08:10:02.625558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533688273071207:2378], now have 1 active actors on pipe
2025-10-02T08:10:02.625569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533687812924630:9720]
2025-10-02T08:10:02.625571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533687812924630:9720]
2025-10-02T08:10:02.625582Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:02.625599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:02.625614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:02.625618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:02.625647Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:02.625651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:02.625667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533687812924630:9720]
2025-10-02T08:10:02.625673Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:02.625674Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:02.625723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 788
2025-10-02T08:10:02.625747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.625752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.625789Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:02.625798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:02.625802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:02.625805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:02.625819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:02.625831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:02.625847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:02.625879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.625882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.625897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:02.625928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 789 partition: 0 MaxSeqNo: 17 sessionId: src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0
2025-10-02T08:10:02.626518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114aed36-444d2858-acb4e199-52e718e2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:02.626488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 788
2025-10-02T08:10:02.630018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0] Write session: try to update token
2025-10-02T08:10:02.630039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:02.651776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId: src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:02.653246Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:02.653274Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:02.653276Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:02.653287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533687812924630:9720]
2025-10-02T08:10:02.653292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533687812924630:9720]
2025-10-02T08:10:02.653344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:02.653351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.653359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:02.653511Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:02.654315Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:02.654338Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:02.654995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:02.680677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533687812924678:8944]
2025-10-02T08:10:02.681041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 788, pipe: [1:7556533687812924678:8944]
2025-10-02T08:10:02.795102Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:02.795458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.795477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.795514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812924678:8944], now have 1 active actors on pipe
2025-10-02T08:10:02.795692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533687812924678:8944]
2025-10-02T08:10:02.795738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:02.795740Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:02.795740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:02.795832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 789 reason: error at write: Disconnected sessionId: src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0
2025-10-02T08:10:02.795899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:02.796686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:02.796702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0] Write session will restart in 0.008565s
2025-10-02T08:10:02.796283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 789 sessionId: src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0 is DEAD
2025-10-02T08:10:02.796735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0] Write session: Do CDS request
2025-10-02T08:10:02.796743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:02.807935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:02.809356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:02.809721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:02.809737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 790
2025-10-02T08:10:02.809893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:02.809951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:02.809963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:02.809967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:02.810446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 790 sessionId:  describe result for acl check
2025-10-02T08:10:02.810495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:02.810497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:02.810498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:02.810507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533687812924859:9729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:02.811123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533687812924859:9729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:02.813647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:02.813883Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:02.813892Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:02.813903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:02.813950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:02.814002Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533687812924866:9727]
2025-10-02T08:10:02.815558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:02.816119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:02.816161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:02.816435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:02.816479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.816480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.816482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.816483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.816484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.816489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.816500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.816504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.816508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.816512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.816517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.816526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:02.816535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.816539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:02.816543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.816548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:02.816552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.816556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.816561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.816566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.816587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:02.818388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533687812924859:9729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:02.826268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533687812924859:9729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:02.826296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533687812924859:9729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:02.826300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533687812924859:9729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:02.826309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:02.829670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:02.831613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:02.831641Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:02.831645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:02.831650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:02.831659Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 789 [1:7556533687812924866:9727]
2025-10-02T08:10:02.831676Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:02.831703Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:02.831712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:02.831717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:02.831720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:02.831743Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:02.831757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:02.831766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:02.831868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.831877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.831881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:02.831884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:02.831984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:02.831993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.832014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:02.832033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:02.832055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 789
2025-10-02T08:10:02.832069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812924906:9729], now have 1 active actors on pipe
2025-10-02T08:10:02.832078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533687812924851:9727]
2025-10-02T08:10:02.832085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533687812924851:9727]
2025-10-02T08:10:02.832105Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:02.832122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533688273071213:2378], now have 1 active actors on pipe
2025-10-02T08:10:02.832133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.832141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.832146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:02.832151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:02.832170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:02.832193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:02.832201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:02.832182Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 789
2025-10-02T08:10:02.832258Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:02.832272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:02.832283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:02.832292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:02.832307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:02.832324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:02.832339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533687812924851:9727]
2025-10-02T08:10:02.832352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:02.832359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:02.832391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:02.832711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:02.832722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:02.832744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:02.832888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 790 partition: 0 MaxSeqNo: 17 sessionId: src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0
2025-10-02T08:10:02.833350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378b4210-808d7dcf-6893a2c-1d7df43e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:02.836666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0] Write session: try to update token
2025-10-02T08:10:02.836684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:02.851912Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:02.851938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:02.851942Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:02.851968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533687812924851:9727]
2025-10-02T08:10:02.851973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533687812924851:9727]
2025-10-02T08:10:02.852034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:02.852040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:02.852047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:02.852049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:02.852052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:02.852251Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:02.858026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId: src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:02.861478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:02.896432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533687812924920:8944]
2025-10-02T08:10:02.899849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 789, pipe: [1:7556533687812924920:8944]
2025-10-02T08:10:03.018276Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:03.018793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.018814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.018835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533687812924920:8944], now have 1 active actors on pipe
2025-10-02T08:10:03.018966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533687812924920:8944]
2025-10-02T08:10:03.019001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:03.019009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:03.019069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 790 reason: error at write: Disconnected sessionId: src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0
2025-10-02T08:10:03.019072Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:03.019260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 790 sessionId: src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0 is DEAD
2025-10-02T08:10:03.019239Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:03.019494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:03.019502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0] Write session will restart in 0.009650s
2025-10-02T08:10:03.019526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0] Write session: Do CDS request
2025-10-02T08:10:03.019532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:03.030560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.030591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:03.030613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 791
2025-10-02T08:10:03.030848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.030899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:03.030905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:03.030910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:03.031672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 791 sessionId:  describe result for acl check
2025-10-02T08:10:03.031710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:03.031711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:03.031713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:03.031719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533692107892352:9735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:03.032270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533692107892352:9735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:03.034859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533692107892352:9735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:03.038304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533692107892352:9735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:03.038325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533692107892352:9735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:03.038328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533692107892352:9735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:03.038337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:03.039056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:03.041155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:03.041355Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:03.041359Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:03.041370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:03.041418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:03.041462Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533692107892436:9734]
2025-10-02T08:10:03.042224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:03.042425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:03.042471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:03.042919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:03.043092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.043100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.043102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.043103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.043104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.043110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.043130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.043134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.043138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.043142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.043149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.043157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.043163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.043168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.043173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.043178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.043182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.043188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.043193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.043198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.043217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:03.051425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:03.053092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:03.053113Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:03.053116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:03.053121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:03.053128Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 790 [1:7556533692107892436:9734]
2025-10-02T08:10:03.053141Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:03.053158Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:03.053163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.053166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.053169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.053185Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:03.053197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:03.053204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:03.053267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.053278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.053281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:03.053284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:03.053354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:03.053363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.053378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.053397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:03.053420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107892424:9735], now have 1 active actors on pipe
2025-10-02T08:10:03.053429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533692568038519:2378], now have 1 active actors on pipe
2025-10-02T08:10:03.053436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533692107892429:9734]
2025-10-02T08:10:03.053438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533692107892429:9734]
2025-10-02T08:10:03.053443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 790
2025-10-02T08:10:03.053445Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:03.053457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:03.053457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:03.053471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:03.053474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:03.053477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:03.053484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.053488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.053528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533692107892429:9734]
2025-10-02T08:10:03.053538Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:03.053547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:03.053552Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:03.053559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.053562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.053564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:03.053574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.053530Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 790
2025-10-02T08:10:03.053582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:03.053629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.053697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.053704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.053717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.053750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 791 partition: 0 MaxSeqNo: 17 sessionId: src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0
2025-10-02T08:10:03.054131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d53813a-ebd0d0c3-fac71cfa-70c8eb14_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:03.057387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0] Write session: try to update token
2025-10-02T08:10:03.057407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:03.072337Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:03.072360Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:03.072362Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:03.072372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533692107892429:9734]
2025-10-02T08:10:03.072377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533692107892429:9734]
2025-10-02T08:10:03.072423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:03.072435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.072438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:03.072453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:03.072470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:03.072590Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:03.074711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId: src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:03.077356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:03.137347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533692107892477:8944]
2025-10-02T08:10:03.137576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 790, pipe: [1:7556533692107892477:8944]
2025-10-02T08:10:03.213393Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:03.214000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.214020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.214067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107892477:8944], now have 1 active actors on pipe
2025-10-02T08:10:03.214311Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:03.214568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:03.214606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533692107892477:8944]
2025-10-02T08:10:03.214617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 791 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0
2025-10-02T08:10:03.215079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:03.215091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0] Write session will restart in 0.006858s
2025-10-02T08:10:03.215130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0] Write session: Do CDS request
2025-10-02T08:10:03.215137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:03.214468Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:03.214764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 791 sessionId: src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0 is DEAD
2025-10-02T08:10:03.223363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.223472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:03.223500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 792
2025-10-02T08:10:03.224191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.224227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:03.224231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:03.224233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:03.224603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 792 sessionId:  describe result for acl check
2025-10-02T08:10:03.224645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:03.224652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:03.224654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:03.224659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533692107892680:9753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:03.225171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533692107892680:9753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:03.226721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:03.227548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:03.227781Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:03.227785Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:03.227792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:03.227831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:03.227858Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533692107892701:9752]
2025-10-02T08:10:03.228336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:03.228557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:03.228603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:03.228937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:03.229016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.229023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.229025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.229026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.229027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.229028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533692107892680:9753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:03.229033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.229043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.229047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.229053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.229056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.229062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.229074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.229082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.229087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.229090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.229095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.229099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.229103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.229110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.229115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.229135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:03.236177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533692107892680:9753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:03.236197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533692107892680:9753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:03.236200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533692107892680:9753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:03.236209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:03.238551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:03.240415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:03.240429Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:03.240431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:03.240434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:03.240440Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 791 [1:7556533692107892701:9752]
2025-10-02T08:10:03.240448Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:03.240461Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:03.240463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.240465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.240467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.240481Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:03.240485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:03.240489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:03.240547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.240554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.240557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:03.240560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:03.240609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:03.240614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.240626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.240642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:03.240661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533692107892686:9752]
2025-10-02T08:10:03.240671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533692107892686:9752]
2025-10-02T08:10:03.240677Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:03.240692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107892730:9753], now have 1 active actors on pipe
2025-10-02T08:10:03.240692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 791
2025-10-02T08:10:03.240698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:03.240698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:03.240701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:03.240710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:03.240714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:03.240719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533692568038549:2378], now have 1 active actors on pipe
2025-10-02T08:10:03.240752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.240755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.240767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533692107892686:9752]
2025-10-02T08:10:03.240780Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:03.240788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:03.240817Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:03.240823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.240826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.240829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:03.240840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.240854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:03.240782Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 791
2025-10-02T08:10:03.240884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.240964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.240976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.240991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.241044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 792 partition: 0 MaxSeqNo: 17 sessionId: src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0
2025-10-02T08:10:03.241494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88dd8ceb-95cc2d0f-2086b87f-50de0b63_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:03.244575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0] Write session: try to update token
2025-10-02T08:10:03.244596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:03.261908Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:03.261933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:03.261936Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:03.261944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533692107892686:9752]
2025-10-02T08:10:03.261948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533692107892686:9752]
2025-10-02T08:10:03.261990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:03.261998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.262000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:03.262146Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:03.262335Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:03.262342Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:03.266032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId: src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:03.268937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:03.315048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533692107892745:8944]
2025-10-02T08:10:03.315224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 791, pipe: [1:7556533692107892745:8944]
2025-10-02T08:10:03.400529Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:03.400893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.400906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.400940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107892745:8944], now have 1 active actors on pipe
2025-10-02T08:10:03.401594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:03.401448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:03.401462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:03.401524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 792 reason: error at write: Disconnected sessionId: src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0
2025-10-02T08:10:03.401557Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:03.401889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:03.401904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0] Write session will restart in 0.009682s
2025-10-02T08:10:03.401703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 792 sessionId: src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0 is DEAD
2025-10-02T08:10:03.401873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533692107892745:8944]
2025-10-02T08:10:03.401927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0] Write session: Do CDS request
2025-10-02T08:10:03.401933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:03.412361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.412442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:03.412460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 793
2025-10-02T08:10:03.412618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.412649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:03.412659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:03.412662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:03.412842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:03.413062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 793 sessionId:  describe result for acl check
2025-10-02T08:10:03.413098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:03.413099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:03.413101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:03.413106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533692107892929:9760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:03.413633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533692107892929:9760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:03.414362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:03.414582Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:03.414593Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:03.414603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:03.414658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:03.414699Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533692107892939:9758]
2025-10-02T08:10:03.415343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:03.415530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:03.415574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:03.415866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:03.415921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.415927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.415928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.415930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.415931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.415936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.415946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.415951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.415955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.415958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.415964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.415971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.415977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.415982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.415987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.415992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.415996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.416001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.416006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.416011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.416030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:03.416706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533692107892929:9760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:03.423981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533692107892929:9760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:03.424004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533692107892929:9760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:03.424007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533692107892929:9760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:03.424016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:03.425066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:03.427114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:03.427137Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:03.427140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:03.427144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:03.427150Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 792 [1:7556533692107892939:9758]
2025-10-02T08:10:03.427163Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:03.427181Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:03.427184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.427188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.427191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.427204Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:03.427208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:03.427214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:03.427268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.427274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.427276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:03.427278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:03.427330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:03.427338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.427353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.427369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:03.427400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533692107892923:9758]
2025-10-02T08:10:03.427406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533692107892923:9758]
2025-10-02T08:10:03.427415Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:03.427422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:03.427424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:03.427435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107892980:9760], now have 1 active actors on pipe
2025-10-02T08:10:03.427445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:03.427459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:03.427466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:03.427472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533692568038556:2378], now have 1 active actors on pipe
2025-10-02T08:10:03.427471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 792
2025-10-02T08:10:03.427504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.427512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.427523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533692107892923:9758]
2025-10-02T08:10:03.427533Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:03.427544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:03.427561Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:03.427573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.427582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.427583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:03.427595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.427563Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 792
2025-10-02T08:10:03.427608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:03.427636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.427743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.427753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.427771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.427827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 793 partition: 0 MaxSeqNo: 17 sessionId: src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0
2025-10-02T08:10:03.428188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9479cb-713f5def-12ad6b18-ad7e5d21_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:03.431050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0] Write session: try to update token
2025-10-02T08:10:03.431075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:03.447976Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:03.448000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:03.448002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:03.448011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533692107892923:9758]
2025-10-02T08:10:03.448015Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533692107892923:9758]
2025-10-02T08:10:03.448055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:03.448061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.448061Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:03.448064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:03.448067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:03.448360Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:03.448403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId: src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:03.451205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:03.501965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533692107892996:8944]
2025-10-02T08:10:03.502271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 792, pipe: [1:7556533692107892996:8944]
2025-10-02T08:10:03.600990Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:03.601314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.601330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.601374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107892996:8944], now have 1 active actors on pipe
2025-10-02T08:10:03.601565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533692107892996:8944]
2025-10-02T08:10:03.601728Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:03.601735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:03.601970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:03.602053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 793 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0
2025-10-02T08:10:03.602417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:03.602428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0] Write session will restart in 0.006168s
2025-10-02T08:10:03.602457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0] Write session: Do CDS request
2025-10-02T08:10:03.602466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:03.602221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 793 sessionId: src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0 is DEAD
2025-10-02T08:10:03.610425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.610602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:03.610634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 794
2025-10-02T08:10:03.610840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.610907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:03.610915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:03.610920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:03.611491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 794 sessionId:  describe result for acl check
2025-10-02T08:10:03.611556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:03.611558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:03.611560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:03.611569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533692107893041:9766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:03.612244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533692107893041:9766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:03.615069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533692107893041:9766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:03.623547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:03.626024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533692107893041:9766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:03.626048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533692107893041:9766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:03.626052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533692107893041:9766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:03.626062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:03.626274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:03.626562Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:03.626567Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:03.626580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:03.626646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:03.626687Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533692107893223:9765]
2025-10-02T08:10:03.627394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:03.627676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:03.627726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:03.628057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:03.628105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.628111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.628113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.628115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.628116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.628122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.628133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.628136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.628140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.628144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.628149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.628157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.628167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.628175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.628185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.628191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.628199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.628205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.628215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.628224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.628247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:03.638664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:03.640237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:03.640254Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:03.640256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:03.640258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:03.640264Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 793 [1:7556533692107893223:9765]
2025-10-02T08:10:03.640273Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:03.640288Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:03.640294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.640296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.640298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.640310Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:03.640313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:03.640320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:03.640370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.640376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.640380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:03.640383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:03.640436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:03.640447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.640458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.640468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:03.640486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107893221:9766], now have 1 active actors on pipe
2025-10-02T08:10:03.640495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 793
2025-10-02T08:10:03.640497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533692107893214:9765]
2025-10-02T08:10:03.640499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533692107893214:9765]
2025-10-02T08:10:03.640505Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:03.640519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:03.640519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:03.640523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:03.640532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:03.640538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:03.640547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533692568038578:2378], now have 1 active actors on pipe
2025-10-02T08:10:03.640553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.640560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.640598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533692107893214:9765]
2025-10-02T08:10:03.640610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:03.640616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:03.640624Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:03.640630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.640634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.640636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:03.640646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.640660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:03.640720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.640680Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 793
2025-10-02T08:10:03.640793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.640826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.640855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.640901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 794 partition: 0 MaxSeqNo: 17 sessionId: src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0
2025-10-02T08:10:03.641253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff67a23-766aa9e7-a908cbbe-1030f2b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:03.644604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0] Write session: try to update token
2025-10-02T08:10:03.644624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:03.662661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId: src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:03.665373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:03.666658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.666694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.666722Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:03.666726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:03.666730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:03.666740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533692107893214:9765]
2025-10-02T08:10:03.666745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533692107893214:9765]
2025-10-02T08:10:03.666796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:03.666807Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:03.666814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:03.666822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.666826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:03.667008Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:03.701596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533692107893262:8944]
2025-10-02T08:10:03.701747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 793, pipe: [1:7556533692107893262:8944]
2025-10-02T08:10:03.821827Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:03.822750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:03.822814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107893262:8944], now have 1 active actors on pipe
2025-10-02T08:10:03.822815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:03.823676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533692107893262:8944]
2025-10-02T08:10:03.823708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:03.823710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:03.823734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 794 reason: error at write: Disconnected sessionId: src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0
2025-10-02T08:10:03.823938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 794 sessionId: src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0 is DEAD
2025-10-02T08:10:03.824116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:03.824131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0] Write session will restart in 0.007262s
2025-10-02T08:10:03.824160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0] Write session: Do CDS request
2025-10-02T08:10:03.824167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:03.823308Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:03.832472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.832499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:03.832517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 795
2025-10-02T08:10:03.833794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:03.833833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:03.833838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:03.833843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:03.834853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 795 sessionId:  describe result for acl check
2025-10-02T08:10:03.834892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:03.834894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:03.834896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:03.834903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533692107893362:9773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:03.835552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533692107893362:9773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:03.838371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533692107893362:9773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:03.845040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533692107893362:9773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:03.845059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533692107893362:9773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:03.845063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533692107893362:9773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:03.845073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:03.851245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:03.853292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:03.853753Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:03.853765Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:03.853780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:03.853848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:03.853914Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533692107893489:9772]
2025-10-02T08:10:03.854615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:03.854949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:03.854998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:03.855422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:03.855493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.855494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.855495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.855497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.855498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.855504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.855514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.855518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.855522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.855525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.855532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.855540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:03.855546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.855551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:03.855555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.855560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:03.855565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.855570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.855575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.855581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.855599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:03.867769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:03.869606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:03.869627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:03.869630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:03.869635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:03.869644Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 794 [1:7556533692107893489:9772]
2025-10-02T08:10:03.869658Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:03.869682Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:03.869686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.869689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.869692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.869710Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:03.869722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:03.869731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:03.869821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.869829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.869833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:03.869837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:03.869921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:03.869930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.869947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:03.869958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:03.869979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533692107893483:9772]
2025-10-02T08:10:03.869986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533692107893483:9772]
2025-10-02T08:10:03.869995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:03.870012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:03.870033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:03.870040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:03.870080Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:03.870086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107893468:9773], now have 1 active actors on pipe
2025-10-02T08:10:03.870089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533692107893483:9772]
2025-10-02T08:10:03.870090Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:03.870093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:03.870098Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:03.870117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533692568038585:2378], now have 1 active actors on pipe
2025-10-02T08:10:03.870151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 794
2025-10-02T08:10:03.870564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.870576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.870560Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 794
2025-10-02T08:10:03.870608Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:03.870622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:03.870627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:03.870630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:03.870642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:03.870652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:03.870672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.870728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:03.870736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:03.870749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:03.870784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 795 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0
2025-10-02T08:10:03.871185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbff91c8-5c89e934-b3fe65b6-21bcb95c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:03.874613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0] Write session: try to update token
2025-10-02T08:10:03.874636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:03.896934Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:03.896951Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:03.896954Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:03.896962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533692107893483:9772]
2025-10-02T08:10:03.896968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533692107893483:9772]
2025-10-02T08:10:03.897015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:03.897017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:03.897022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:03.897025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:03.897026Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:03.897192Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:03.897288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId: src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:03.900466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:03.923829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533692107893514:8944]
2025-10-02T08:10:03.924040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 794, pipe: [1:7556533692107893514:8944]
2025-10-02T08:10:04.042649Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:04.043263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.043281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.043321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533692107893514:8944], now have 1 active actors on pipe
2025-10-02T08:10:04.043580Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:04.043536Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:04.044139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:04.044149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0] Write session will restart in 0.007230s
2025-10-02T08:10:04.044172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0] Write session: Do CDS request
2025-10-02T08:10:04.044179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:04.043789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:04.043866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 795 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0
2025-10-02T08:10:04.043890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533692107893514:8944]
2025-10-02T08:10:04.044025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 795 sessionId: src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0 is DEAD
2025-10-02T08:10:04.052283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.052414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:04.052428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 796
2025-10-02T08:10:04.052522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.052546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:04.052551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:04.052555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:04.052952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 796 sessionId:  describe result for acl check
2025-10-02T08:10:04.052975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:04.052976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:04.052978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:04.052982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533696402860967:9780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:04.053488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533696402860967:9780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:04.056217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:04.058619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:04.058812Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:04.058821Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:04.058830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:04.058876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:04.058914Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533696402861024:9779]
2025-10-02T08:10:04.059559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:04.059755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:04.059794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:04.060092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:04.060136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.060142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.060143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.060144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.060145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.060150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.060160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.060164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.060168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.060172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.060177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.060185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.060195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.060200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.060209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.060214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.060223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.060228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.060232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.060250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.060270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:04.061644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533696402860967:9780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:04.069633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533696402860967:9780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:04.069649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533696402860967:9780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:04.069664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533696402860967:9780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:04.069673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:04.070790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:04.072531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:04.072547Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:04.072550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:04.072554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:04.072564Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 795 [1:7556533696402861024:9779]
2025-10-02T08:10:04.072576Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:04.072594Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:04.072601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.072604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.072605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.072622Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:04.072631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:04.072637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:04.072984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.072992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.072995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:04.072997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:04.073066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:04.073073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.073087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.073105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:04.073125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402861052:9780], now have 1 active actors on pipe
2025-10-02T08:10:04.073135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533696402861005:9779]
2025-10-02T08:10:04.073137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533696402861005:9779]
2025-10-02T08:10:04.073143Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:04.073162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:04.073178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:04.073181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:04.073188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533696863005889:2378], now have 1 active actors on pipe
2025-10-02T08:10:04.073225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533696402861005:9779]
2025-10-02T08:10:04.073234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:04.073267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:04.073270Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:04.073270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 795
2025-10-02T08:10:04.073275Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:04.073333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.073347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.073373Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1544bda-327c8076-521f84f4-8bd10a81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:04.073382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.073389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.073403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:04.073419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.073433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:04.073454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.073498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.073505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.073517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.073564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 796 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1544bda-327c8076-521f84f4-8bd10a81_0
2025-10-02T08:10:04.073892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4f8ef55-2385dfab-e0cd4618-693e14c0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1544bda-327c8076-521f84f4-8bd10a81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:04.076689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1544bda-327c8076-521f84f4-8bd10a81_0] Write session: try to update token
2025-10-02T08:10:04.076706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1544bda-327c8076-521f84f4-8bd10a81_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:04.076987Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 795
2025-10-02T08:10:04.106005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId: src_id|e1544bda-327c8076-521f84f4-8bd10a81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:04.109001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:04.110401Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:04.110416Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:04.110419Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:04.110428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533696402861005:9779]
2025-10-02T08:10:04.110432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533696402861005:9779]
2025-10-02T08:10:04.110474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.110484Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:04.110486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.110490Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:04.110505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:04.110509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.110511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:04.110663Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:04.145416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533696402861072:8944]
2025-10-02T08:10:04.145534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 795, pipe: [1:7556533696402861072:8944]
2025-10-02T08:10:04.259427Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:04.259834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1544bda-327c8076-521f84f4-8bd10a81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:04.259844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1544bda-327c8076-521f84f4-8bd10a81_0] Write session will restart in 0.005606s
2025-10-02T08:10:04.259869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1544bda-327c8076-521f84f4-8bd10a81_0] Write session: Do CDS request
2025-10-02T08:10:04.259876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1544bda-327c8076-521f84f4-8bd10a81_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:04.258697Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:04.259139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402861072:8944], now have 1 active actors on pipe
2025-10-02T08:10:04.259264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533696402861072:8944]
2025-10-02T08:10:04.259281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:04.259286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:04.259339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 796 reason: error at write: Disconnected sessionId: src_id|e1544bda-327c8076-521f84f4-8bd10a81_0
2025-10-02T08:10:04.259397Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:04.259525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 796 sessionId: src_id|e1544bda-327c8076-521f84f4-8bd10a81_0 is DEAD
2025-10-02T08:10:04.269339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1544bda-327c8076-521f84f4-8bd10a81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.269459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:04.269472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 797
2025-10-02T08:10:04.272106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:04.272148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.272187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:04.272192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:04.272196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:04.272513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:04.272640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 797 sessionId:  describe result for acl check
2025-10-02T08:10:04.272672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:04.272674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:04.272676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:04.272681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533696402861300:9799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:04.272732Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:04.272736Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:04.272746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:04.272815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:04.272852Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533696402861301:9797]
2025-10-02T08:10:04.273214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533696402861300:9799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:04.273518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:04.273991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:04.274045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:04.274371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:04.274424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.274425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.274426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.274427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.274428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.274433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.274442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.274445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.274449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.274452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.274457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.274464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.274469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.274474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.274479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.274483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.274487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.274491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.274495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.274500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.274517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:04.277023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533696402861300:9799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:04.284108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533696402861300:9799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:04.284126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533696402861300:9799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:04.284130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533696402861300:9799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:04.284140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:04.284541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:04.286300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:04.286319Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:04.286322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:04.286326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:04.286334Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 796 [1:7556533696402861301:9797]
2025-10-02T08:10:04.286349Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:04.286368Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:04.286371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.286374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.286376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.286393Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:04.286398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:04.286405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:04.286476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.286485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.286488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:04.286490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:04.286568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:04.286576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.286593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.286607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:04.286629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533696402861293:9797]
2025-10-02T08:10:04.286631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533696402861293:9797]
2025-10-02T08:10:04.286647Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:04.286665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:04.286685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:04.286692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:04.286726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:04.286729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533696402861293:9797]
2025-10-02T08:10:04.286731Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:04.286738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:04.286748Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:04.286832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 796
2025-10-02T08:10:04.286850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402861342:9799], now have 1 active actors on pipe
2025-10-02T08:10:04.287035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533696863005919:2378], now have 1 active actors on pipe
2025-10-02T08:10:04.287049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.287054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.287082Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:04.287090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.287095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.287097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:04.287108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.287120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:04.287141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.287589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 796
2025-10-02T08:10:04.287553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.287563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.287580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.287619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 797 partition: 0 MaxSeqNo: 17 sessionId: src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0
2025-10-02T08:10:04.289302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1544bda-327c8076-521f84f4-8bd10a81_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:04.292694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0] Write session: try to update token
2025-10-02T08:10:04.292713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:04.308084Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:04.308101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:04.308104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:04.308115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533696402861293:9797]
2025-10-02T08:10:04.308120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533696402861293:9797]
2025-10-02T08:10:04.308167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:04.308173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.308174Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:04.308178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:04.308180Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:04.308322Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:04.316068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId: src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:04.319302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:04.359521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533696402861357:8944]
2025-10-02T08:10:04.359634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 796, pipe: [1:7556533696402861357:8944]
2025-10-02T08:10:04.458169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:04.458185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0] Write session will restart in 0.006514s
2025-10-02T08:10:04.458211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0] Write session: Do CDS request
2025-10-02T08:10:04.458218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:04.456898Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:04.457553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.457563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.457605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402861357:8944], now have 1 active actors on pipe
2025-10-02T08:10:04.457745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:04.457750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:04.457824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 797 reason: error at write: Disconnected sessionId: src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0
2025-10-02T08:10:04.458002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 797 sessionId: src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0 is DEAD
2025-10-02T08:10:04.458071Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:04.458177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533696402861357:8944]
2025-10-02T08:10:04.460743Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:04.466520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.466579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:04.466595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 798
2025-10-02T08:10:04.466742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.466790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:04.466802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:04.466816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:04.467201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 798 sessionId:  describe result for acl check
2025-10-02T08:10:04.467234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:04.467240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:04.467244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:04.467251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533696402861546:9806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:04.467721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533696402861546:9806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:04.470132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533696402861546:9806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:04.470709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:04.471149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:04.471337Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:04.471345Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:04.471354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:04.471412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:04.471455Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533696402861589:9805]
2025-10-02T08:10:04.472090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:04.472264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:04.472304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:04.472603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:04.472650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.472656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.472657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.472658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.472660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.472665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.472676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.472684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.472688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.472692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.472698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.472705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.472716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.472721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.472730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.472735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.472739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.472743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.472747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.472752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.472770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:04.473209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533696402861546:9806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:04.473222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533696402861546:9806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:04.473225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533696402861546:9806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:04.473234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:04.481316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:04.483155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:04.483169Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:04.483171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:04.483174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:04.483179Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 797 [1:7556533696402861589:9805]
2025-10-02T08:10:04.483188Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:04.483204Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:04.483207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.483210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.483212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.483229Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:04.483233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:04.483240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:04.483304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.483311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.483314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:04.483317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:04.483374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:04.483382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.483403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.483415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:04.483434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533696402861579:9805]
2025-10-02T08:10:04.483441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533696402861579:9805]
2025-10-02T08:10:04.483449Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:04.483460Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:04.483461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402861605:9806], now have 1 active actors on pipe
2025-10-02T08:10:04.483464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 797
2025-10-02T08:10:04.483469Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:04.483469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:04.483483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:04.483485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:04.483491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533696863005927:2378], now have 1 active actors on pipe
2025-10-02T08:10:04.483522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.483530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.483542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533696402861579:9805]
2025-10-02T08:10:04.483549Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:04.483558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:04.483550Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 797
2025-10-02T08:10:04.483571Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91c4453d-258c783b-128a938e-1b03c94d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:04.483583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.483586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.483588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:04.483598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.483607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:04.483633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.483681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.483689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.483702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.483738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 798 partition: 0 MaxSeqNo: 17 sessionId: src_id|91c4453d-258c783b-128a938e-1b03c94d_0
2025-10-02T08:10:04.484070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d17dedc4-e27d424a-7d5fab4b-6089d217_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|91c4453d-258c783b-128a938e-1b03c94d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:04.486989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c4453d-258c783b-128a938e-1b03c94d_0] Write session: try to update token
2025-10-02T08:10:04.487005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c4453d-258c783b-128a938e-1b03c94d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:04.502347Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:04.502367Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:04.502368Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:04.502375Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533696402861579:9805]
2025-10-02T08:10:04.502379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533696402861579:9805]
2025-10-02T08:10:04.502419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:04.502424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.502426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:04.502426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:04.502432Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:04.502580Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:04.505451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId: src_id|91c4453d-258c783b-128a938e-1b03c94d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:04.507973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:04.558155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533696402861625:8944]
2025-10-02T08:10:04.558288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 797, pipe: [1:7556533696402861625:8944]
2025-10-02T08:10:04.644037Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:04.644538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.644554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.644594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402861625:8944], now have 1 active actors on pipe
2025-10-02T08:10:04.644989Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:04.645578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c4453d-258c783b-128a938e-1b03c94d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:04.645590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c4453d-258c783b-128a938e-1b03c94d_0] Write session will restart in 0.005239s
2025-10-02T08:10:04.644694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533696402861625:8944]
2025-10-02T08:10:04.645611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c4453d-258c783b-128a938e-1b03c94d_0] Write session: Do CDS request
2025-10-02T08:10:04.644845Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:04.645165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:04.645619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c4453d-258c783b-128a938e-1b03c94d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:04.645216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 798 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91c4453d-258c783b-128a938e-1b03c94d_0
2025-10-02T08:10:04.645411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 798 sessionId: src_id|91c4453d-258c783b-128a938e-1b03c94d_0 is DEAD
2025-10-02T08:10:04.652333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c4453d-258c783b-128a938e-1b03c94d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.652400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:04.652414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 799
2025-10-02T08:10:04.652580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.652611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:04.652620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:04.652623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:04.653065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 799 sessionId:  describe result for acl check
2025-10-02T08:10:04.653094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:04.653100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:04.653102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:04.653107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533696402861819:9814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:04.653608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533696402861819:9814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:04.656039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533696402861819:9814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:04.657305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:04.657737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:04.657934Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:04.657946Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:04.657972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:04.658027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:04.658070Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533696402861865:9813]
2025-10-02T08:10:04.658715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:04.658869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:04.658900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:04.659068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533696402861819:9814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:04.659080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533696402861819:9814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:04.659083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533696402861819:9814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:04.659092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:04.659170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:04.659221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.659227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.659228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.659229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.659230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.659234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.659244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.659248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.659252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.659255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.659260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.659267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.659276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.659281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.659285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.659289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.659294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.659304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.659308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.659314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.659333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:04.668588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:04.670749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:04.670769Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:04.670772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:04.670775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:04.670782Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 798 [1:7556533696402861865:9813]
2025-10-02T08:10:04.670794Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:04.670812Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:04.670815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.670819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.670821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.670838Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:04.670843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:04.670849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:04.671189Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 798
2025-10-02T08:10:04.670918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.670928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.670931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:04.670933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:04.671004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:04.671007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.671020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.671031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:04.671050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402861876:9814], now have 1 active actors on pipe
2025-10-02T08:10:04.671057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533696402861859:9813]
2025-10-02T08:10:04.671059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533696402861859:9813]
2025-10-02T08:10:04.671065Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:04.671076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533696863005944:2378], now have 1 active actors on pipe
2025-10-02T08:10:04.671081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:04.671081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:04.671085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:04.671094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:04.671096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:04.671129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533696402861859:9813]
2025-10-02T08:10:04.671138Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:04.671162Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:04.671178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 798
2025-10-02T08:10:04.671293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.671302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.671332Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:04.671351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.671355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.671358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:04.671370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.671385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:04.671425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.671461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.671468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.671483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.671512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 799 partition: 0 MaxSeqNo: 17 sessionId: src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0
2025-10-02T08:10:04.676726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c4453d-258c783b-128a938e-1b03c94d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:04.679345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0] Write session: try to update token
2025-10-02T08:10:04.679361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:04.692547Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:04.692568Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:04.692571Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:04.692579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533696402861859:9813]
2025-10-02T08:10:04.692583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533696402861859:9813]
2025-10-02T08:10:04.692626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:04.692633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.692635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:04.692645Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:04.692658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:04.692796Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:04.693989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId: src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:04.696793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:04.745664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533696402861896:8944]
2025-10-02T08:10:04.745790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 798, pipe: [1:7556533696402861896:8944]
2025-10-02T08:10:04.835967Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:04.836350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.836366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.836404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402861896:8944], now have 1 active actors on pipe
2025-10-02T08:10:04.836545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:04.836554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:04.836621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 799 reason: error at write: Disconnected sessionId: src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0
2025-10-02T08:10:04.836624Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:04.836617Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:04.836782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 799 sessionId: src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0 is DEAD
2025-10-02T08:10:04.836899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533696402861896:8944]
2025-10-02T08:10:04.836976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:04.836986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0] Write session will restart in 0.007216s
2025-10-02T08:10:04.837015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0] Write session: Do CDS request
2025-10-02T08:10:04.837022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:04.846671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.847378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:04.847402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 800
2025-10-02T08:10:04.847526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:04.847556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:04.847566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:04.847569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:04.847965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 800 sessionId:  describe result for acl check
2025-10-02T08:10:04.847996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:04.847997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:04.847999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:04.848004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533696402862091:9821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:04.848504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533696402862091:9821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:04.849076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:04.849531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:04.849736Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:04.849746Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:04.849756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:04.849804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:04.849845Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533696402862105:9819]
2025-10-02T08:10:04.850495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:04.850657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:04.850693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:04.850979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:04.851014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.851015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.851016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.851017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.851018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.851022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.851031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.851035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.851038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.851042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.851046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.851053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:04.851058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.851063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:04.851067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.851071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:04.851075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.851079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.851084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.851088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.851105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:04.851828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533696402862091:9821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:04.858469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533696402862091:9821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:04.858484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533696402862091:9821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:04.858487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533696402862091:9821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:04.858497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:04.860403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:04.862321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:04.862337Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:04.862339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:04.862343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:04.862350Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 799 [1:7556533696402862105:9819]
2025-10-02T08:10:04.862361Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:04.862378Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:04.862381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.862384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.862386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.862402Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:04.862408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:04.862415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:04.862480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.862482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.862484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:04.862486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:04.862553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:04.862556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.862569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:04.862579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:04.862595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533696402862097:9819]
2025-10-02T08:10:04.862597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533696402862097:9819]
2025-10-02T08:10:04.862608Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:04.862622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:04.862635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:04.862638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:04.862671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533696402862097:9819]
2025-10-02T08:10:04.862673Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:04.862873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:04.862878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:04.862884Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:04.863429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 799
2025-10-02T08:10:04.863440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402862143:9821], now have 1 active actors on pipe
2025-10-02T08:10:04.863443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533696863005950:2378], now have 1 active actors on pipe
2025-10-02T08:10:04.863531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.863538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.863559Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:04.863566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:04.863570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:04.863573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:04.863583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:04.863594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:04.863610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.863707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:04.863711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:04.863723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:04.863754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 800 partition: 0 MaxSeqNo: 17 sessionId: src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0
2025-10-02T08:10:04.864911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733bfb89-dc87bb58-c12fb065-f1612a0d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:04.867619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0] Write session: try to update token
2025-10-02T08:10:04.867636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:04.865523Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 799
2025-10-02T08:10:04.887465Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:04.887482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:04.887484Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:04.887492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533696402862097:9819]
2025-10-02T08:10:04.887500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533696402862097:9819]
2025-10-02T08:10:04.887540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:04.887547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:04.887549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:04.887573Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:04.887586Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:04.887689Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:04.887894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId: src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:04.890578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:04.937052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533696402862158:8944]
2025-10-02T08:10:04.937291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 799, pipe: [1:7556533696402862158:8944]
2025-10-02T08:10:05.055553Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:05.056105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.056113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.056153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533696402862158:8944], now have 1 active actors on pipe
2025-10-02T08:10:05.057385Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:05.056916Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:05.057213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:05.057280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 800 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0
2025-10-02T08:10:05.057290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533696402862158:8944]
2025-10-02T08:10:05.057454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 800 sessionId: src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0 is DEAD
2025-10-02T08:10:05.057726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:05.057734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0] Write session will restart in 0.008365s
2025-10-02T08:10:05.057768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0] Write session: Do CDS request
2025-10-02T08:10:05.057775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:05.068220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.068294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:05.068310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 801
2025-10-02T08:10:05.068489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.068538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:05.068550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:05.068554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:05.069006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 801 sessionId:  describe result for acl check
2025-10-02T08:10:05.069039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:05.069041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:05.069044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:05.069050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533700697829472:9827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:05.069562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533700697829472:9827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:05.073399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533700697829472:9827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:05.078626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533700697829472:9827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:05.078643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533700697829472:9827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:05.078650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533700697829472:9827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:05.078659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:05.080742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:05.083561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:05.083767Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:05.083780Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:05.083789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:05.083834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:05.083869Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533700697829694:9826]
2025-10-02T08:10:05.084582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:05.084782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:05.084840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:05.085167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:05.085207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.085213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.085214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.085215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.085216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.085221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.085232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.085236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.085240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.085244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.085249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.085256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.085262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.085267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.085271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.085277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.085281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.085286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.085293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.085303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.085322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:05.102593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:05.104505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:05.104520Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:05.104523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:05.104527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:05.104533Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 800 [1:7556533700697829694:9826]
2025-10-02T08:10:05.104546Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:05.104563Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:05.104569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.104572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.104574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.104590Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:05.104594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:05.104601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:05.104676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.104678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.104681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:05.104683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:05.104754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:05.104756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.104771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.104784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:05.104890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533700697829688:9826]
2025-10-02T08:10:05.104896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533700697829688:9826]
2025-10-02T08:10:05.104903Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:05.104918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:05.104933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:05.104935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:05.104944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697829673:9827], now have 1 active actors on pipe
2025-10-02T08:10:05.104948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533701157973254:2378], now have 1 active actors on pipe
2025-10-02T08:10:05.104980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533700697829688:9826]
2025-10-02T08:10:05.104982Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:05.105000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:05.105003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:05.105010Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:05.105026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 800
2025-10-02T08:10:05.105049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.105053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.105078Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:05.105084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.105088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.105090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:05.105100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.105108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:05.105124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.105303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.105309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.105321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.105352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 801 partition: 0 MaxSeqNo: 17 sessionId: src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0
2025-10-02T08:10:05.105704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1069cda8-2e66f194-9f9d831b-a5fc1a7b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:05.108047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 800
2025-10-02T08:10:05.108498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0] Write session: try to update token
2025-10-02T08:10:05.108513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:05.130076Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:05.130092Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:05.130094Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:05.130102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533700697829688:9826]
2025-10-02T08:10:05.130107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533700697829688:9826]
2025-10-02T08:10:05.130150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:05.130156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.130158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:05.130169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:05.130179Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:05.130319Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:05.136847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId: src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:05.139565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:05.157196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533700697829719:8944]
2025-10-02T08:10:05.157405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 800, pipe: [1:7556533700697829719:8944]
2025-10-02T08:10:05.292449Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:05.292898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.292909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.292951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697829719:8944], now have 1 active actors on pipe
2025-10-02T08:10:05.293287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:05.293646Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:05.294099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:05.294153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 801 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0
2025-10-02T08:10:05.294318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 801 sessionId: src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0 is DEAD
2025-10-02T08:10:05.294413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533700697829719:8944]
2025-10-02T08:10:05.296911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:05.296924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0] Write session will restart in 0.008138s
2025-10-02T08:10:05.296953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0] Write session: Do CDS request
2025-10-02T08:10:05.296962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:05.306870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:05.309250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.309413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:05.309642Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:05.309645Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:05.309654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:05.309698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:05.309736Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533700697829962:9844]
2025-10-02T08:10:05.310415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:05.311237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:05.311282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:05.311623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:05.311662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.311663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.311664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.311665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.311667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.311672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.311683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.311687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.311691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.311695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.311701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.311709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.311715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.311720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.311724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.311729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.311734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.311739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.311744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.311750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.311768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:05.318672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:05.318688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 802
2025-10-02T08:10:05.319150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.319189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:05.319194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:05.319199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:05.319784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 802 sessionId:  describe result for acl check
2025-10-02T08:10:05.319834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:05.319841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:05.319843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:05.319850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533700697829978:9846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:05.320445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533700697829978:9846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:05.322825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:05.325062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:05.325069Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:05.325072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:05.325075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:05.325083Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 801 [1:7556533700697829962:9844]
2025-10-02T08:10:05.325095Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:05.325112Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:05.325117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.325120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.325121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.325138Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:05.325143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:05.325149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:05.325218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.325220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.325223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:05.325226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:05.325979Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 801
2025-10-02T08:10:05.326515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:05.326526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.326555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.326568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:05.326578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533701157973284:2378], now have 1 active actors on pipe
2025-10-02T08:10:05.326605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533700697829955:9844]
2025-10-02T08:10:05.326607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533700697829955:9844]
2025-10-02T08:10:05.326616Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:05.326645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:05.326665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:05.326669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:05.326669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:05.326673Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:05.326708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533700697829955:9844]
2025-10-02T08:10:05.326711Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:05.326724Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:05.326942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533700697829978:9846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:05.334577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533700697829978:9846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:05.334591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533700697829978:9846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:05.334596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533700697829978:9846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:05.334605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:05.335354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 801
2025-10-02T08:10:05.335369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697830014:9846], now have 1 active actors on pipe
2025-10-02T08:10:05.335450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.335459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.335486Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:05.335494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.335499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.335501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:05.335513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.335527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:05.335545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.335646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.335651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.335662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.335687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 802 partition: 0 MaxSeqNo: 17 sessionId: src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0
2025-10-02T08:10:05.337039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d680720-43a2f3e1-6540a1b7-7a82368_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:05.339557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0] Write session: try to update token
2025-10-02T08:10:05.339574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:05.354284Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:05.354307Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:05.354310Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:05.354321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533700697829955:9844]
2025-10-02T08:10:05.354328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533700697829955:9844]
2025-10-02T08:10:05.354382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:05.354384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:05.354389Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:05.354393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.354396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:05.354600Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:05.362832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId: src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:05.366402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:05.394797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533700697830020:8944]
2025-10-02T08:10:05.394882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 801, pipe: [1:7556533700697830020:8944]
2025-10-02T08:10:05.497960Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:05.498280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.498295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.498318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697830020:8944], now have 1 active actors on pipe
2025-10-02T08:10:05.498461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533700697830020:8944]
2025-10-02T08:10:05.498480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:05.498482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:05.498544Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:05.498548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 802 reason: error at write: Disconnected sessionId: src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0
2025-10-02T08:10:05.498731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 802 sessionId: src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0 is DEAD
2025-10-02T08:10:05.498895Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:10:05.499033Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 8 consumer shared/user session shared/user_1_8_14934402208375093245_v1 is DEAD
2025-10-02T08:10:05.500334Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533614798444704:8938] disconnected; active server actors: 1
2025-10-02T08:10:05.500350Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533614798444704:8938] client user disconnected session shared/user_1_8_14934402208375093245_v1
2025-10-02T08:10:05.500378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:05.501036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:05.501047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0] Write session will restart in 0.007374s
2025-10-02T08:10:05.501045Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:10:05.501067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0] Write session: Do CDS request
2025-10-02T08:10:05.501072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:05.501153Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:10:05.501158Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:10:05.501165Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.005318s
2025-10-02T08:10:05.507248Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:10:05.507430Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:10:05.507441Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 9
2025-10-02T08:10:05.508954Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:10:05.509017Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:10:05.509110Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 auth for : user
2025-10-02T08:10:05.509194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.509263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:05.509272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 803
2025-10-02T08:10:05.509290Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 Handle describe topics response
2025-10-02T08:10:05.509315Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 auth is DEAD
2025-10-02T08:10:05.509334Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:10:05.509588Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:10:05.509683Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_9_9807394147570821438_v1
2025-10-02T08:10:05.509677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.509708Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:10:05.509702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:05.509706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:05.509709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:05.509779Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:10:05.509869Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533700697830229:9851] connected; active server actors: 1
2025-10-02T08:10:05.509986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 803 sessionId:  describe result for acl check
2025-10-02T08:10:05.510009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:05.510014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:05.510026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:05.510030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533700697830231:9855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:05.510050Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:10:05.510130Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 got read request: guid# 25ead658-26a6252f-32256c47-a7091d27
2025-10-02T08:10:05.510578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533700697830231:9855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:05.510840Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533700697830229:9851] session shared/user_1_9_9807394147570821438_v1
2025-10-02T08:10:05.510855Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:10:05.510868Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:10:05.510875Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_9_9807394147570821438_v1" (Sender=[1:7556533700697830214:9851], Pipe=[1:7556533700697830229:9851], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:10:05.510883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:10:05.510895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:10:05.510907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_9_9807394147570821438_v1" (Sender=[1:7556533700697830214:9851], Pipe=[1:7556533700697830229:9851], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:10:05.510917Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_9_9807394147570821438_v1" sender [1:7556533700697830214:9851] lock partition 0 for ReadingSession "shared/user_1_9_9807394147570821438_v1" (Sender=[1:7556533700697830214:9851], Pipe=[1:7556533700697830229:9851], Partitions=[], ActiveFamilyCount=1) generation 1 step 9
2025-10-02T08:10:05.510931Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:10:05.510935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-02T08:10:05.511141Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 9 Session: "shared/user_1_9_9807394147570821438_v1" ClientId: "user" PipeClient { RawX1: 7556533700697830229 RawX2: 4503603922347643 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:10:05.511164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:10:05.511604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:05.512126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:05.512335Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:05.512344Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:05.512355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:05.512409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:05.512464Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533700697830260:9850]
2025-10-02T08:10:05.513102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:05.513492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:05.513516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533700697830231:9855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:05.513548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:05.513849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:05.513893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.513898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.513900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.513901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.513901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.513905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.513911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.513913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.513915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.513917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.513921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.513926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.513929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.513932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.513935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.513938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.513940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.513943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.513945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.513948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.513958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:05.520854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533700697830231:9855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:05.520874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533700697830231:9855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:05.520878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533700697830231:9855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:05.520887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:05.523268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:05.524954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:05.524968Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:05.524971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:05.524975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:05.524982Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 802 [1:7556533700697830260:9850]
2025-10-02T08:10:05.524996Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:05.525015Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:05.525019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.525022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.525025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.525042Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:05.525047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:05.525053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:05.525120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.525127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.525129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:05.525131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:05.525185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:05.525191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.525201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.525209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:05.525221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533700697830240:9850]
2025-10-02T08:10:05.525226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533700697830240:9850]
2025-10-02T08:10:05.525234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:05.525251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697830238:9858], now have 1 active actors on pipe
2025-10-02T08:10:05.525252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:05.525255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:05.525262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:05.525277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:05.525285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:05.525290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697830292:9855], now have 1 active actors on pipe
2025-10-02T08:10:05.525292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533701157973292:2378], now have 1 active actors on pipe
2025-10-02T08:10:05.525328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533700697830240:9850]
2025-10-02T08:10:05.525338Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:05.525346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:05.525379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 802, pipe: [1:7556533700697830238:9858]
2025-10-02T08:10:05.525391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 802
2025-10-02T08:10:05.525460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.525472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.525485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_9_9807394147570821438_v1 on pipe: [1:7556533700697830238:9858]
2025-10-02T08:10:05.525501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.525506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.525522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.525531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.525533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:05.525550Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_9_9807394147570821438_v1
2025-10-02T08:10:05.525552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.525590Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1eedce2d-1ac52900-1b890098-27c9f161_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:05.525599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:10:05.525603Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:05.525753Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_9_9807394147570821438_v1:1 with generation 802
2025-10-02T08:10:05.526296Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 802
2025-10-02T08:10:05.528353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:10:05.528384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:10:05.528393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.528398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.528401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:05.528412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.528426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:05.528434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:10:05.528459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:10:05.528481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.528526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.528536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.528552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.528564Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392605524 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:10:05.528580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:10:05.528588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 803 partition: 0 MaxSeqNo: 17 sessionId: src_id|1eedce2d-1ac52900-1b890098-27c9f161_0
2025-10-02T08:10:05.528612Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 sending to client partition status
2025-10-02T08:10:05.529013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2886f49c-276d10f-a72f36c8-2a0fd05_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1eedce2d-1ac52900-1b890098-27c9f161_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:05.531648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eedce2d-1ac52900-1b890098-27c9f161_0] Write session: try to update token
2025-10-02T08:10:05.531663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eedce2d-1ac52900-1b890098-27c9f161_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:05.546545Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:05.546563Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:05.546565Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:05.546578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533700697830240:9850]
2025-10-02T08:10:05.546583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533700697830240:9850]
2025-10-02T08:10:05.546626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:05.546636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.546638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:05.546637Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:05.546643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:05.546787Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:05.551681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId: src_id|1eedce2d-1ac52900-1b890098-27c9f161_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:05.554981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:05.702916Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:05.703416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.703433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.703597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:05.703605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:05.703700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 803 reason: error at write: Disconnected sessionId: src_id|1eedce2d-1ac52900-1b890098-27c9f161_0
2025-10-02T08:10:05.703763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_9_9807394147570821438_v1
2025-10-02T08:10:05.703773Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:05.703772Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:05.703869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 803 sessionId: src_id|1eedce2d-1ac52900-1b890098-27c9f161_0 is DEAD
2025-10-02T08:10:05.704023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eedce2d-1ac52900-1b890098-27c9f161_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:05.704033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eedce2d-1ac52900-1b890098-27c9f161_0] Write session will restart in 0.006059s
2025-10-02T08:10:05.704057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eedce2d-1ac52900-1b890098-27c9f161_0] Write session: Do CDS request
2025-10-02T08:10:05.704064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eedce2d-1ac52900-1b890098-27c9f161_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:05.704048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533700697830238:9858]
2025-10-02T08:10:05.704066Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_9_9807394147570821438_v1
2025-10-02T08:10:05.712357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eedce2d-1ac52900-1b890098-27c9f161_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.712411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:05.712427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 804
2025-10-02T08:10:05.712582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.712616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:05.712626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:05.712630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:05.713101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 804 sessionId:  describe result for acl check
2025-10-02T08:10:05.713136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:05.713143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:05.713145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:05.713150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533700697830510:9863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:05.713704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533700697830510:9863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:05.717582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:05.718037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:05.718218Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:05.718228Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:05.718238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:05.718284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:05.718351Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533700697830547:9862]
2025-10-02T08:10:05.718366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533700697830510:9863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:05.719084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:05.719263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:05.719306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:05.719646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:05.719697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.719703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.719704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.719706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.719707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.719712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.719722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.719726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.719730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.719734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.719739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.719746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.719757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.719762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.719771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.719776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.719781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.719786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.719791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.719801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.719824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:05.725058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533700697830510:9863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:05.725076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533700697830510:9863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:05.725079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533700697830510:9863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:05.725089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:05.728390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:05.730657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:05.730676Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:05.730679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:05.730683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:05.730690Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 803 [1:7556533700697830547:9862]
2025-10-02T08:10:05.730704Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:05.730721Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:05.730725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.730729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.730731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.730749Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:05.730755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:05.730763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:05.730836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.730844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.730848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:05.730851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:05.730919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:05.730927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.730945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.730963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:05.730984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 803
2025-10-02T08:10:05.730988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697830574:9863], now have 1 active actors on pipe
2025-10-02T08:10:05.730992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533701157973311:2378], now have 1 active actors on pipe
2025-10-02T08:10:05.730998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533700697830541:9862]
2025-10-02T08:10:05.731000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533700697830541:9862]
2025-10-02T08:10:05.731007Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:05.731017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.731019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:05.731022Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:05.731021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.731040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:05.731054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:05.731061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:05.731104Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:05.731116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.731119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.731121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:05.731130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.731107Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 803
2025-10-02T08:10:05.731143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:05.731156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533700697830541:9862]
2025-10-02T08:10:05.731160Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:05.731169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:05.731191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.731236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.731243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.731257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.731299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 804 partition: 0 MaxSeqNo: 17 sessionId: src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0
2025-10-02T08:10:05.731695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eedce2d-1ac52900-1b890098-27c9f161_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:05.734452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0] Write session: try to update token
2025-10-02T08:10:05.734474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:05.750740Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:05.750767Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:05.750770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:05.750780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533700697830541:9862]
2025-10-02T08:10:05.750790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533700697830541:9862]
2025-10-02T08:10:05.750843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:05.750856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.750854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:05.750862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:05.750864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:05.751030Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:05.755168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId: src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:05.757913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:05.804349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533700697830589:9858]
2025-10-02T08:10:05.804497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 803, pipe: [1:7556533700697830589:9858]
2025-10-02T08:10:05.894908Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:05.895166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.895183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.895231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697830589:9858], now have 1 active actors on pipe
2025-10-02T08:10:05.895352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:05.895358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:05.895421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 804 reason: error at write: Disconnected sessionId: src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0
2025-10-02T08:10:05.895499Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:05.895566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 804 sessionId: src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0 is DEAD
2025-10-02T08:10:05.895698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533700697830589:9858]
2025-10-02T08:10:05.895908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:05.895918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0] Write session will restart in 0.006028s
2025-10-02T08:10:05.895941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0] Write session: Do CDS request
2025-10-02T08:10:05.895952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:05.895481Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:05.903323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.903382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:05.903407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 805
2025-10-02T08:10:05.903587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:05.903618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:05.903627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:05.903631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:05.904280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 805 sessionId:  describe result for acl check
2025-10-02T08:10:05.904317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:05.904332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:05.904336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:05.904341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533700697830760:9869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:05.905056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533700697830760:9869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:05.907872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533700697830760:9869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:05.910392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:05.910746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:05.910910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:05.910921Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:05.910930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:05.910971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:05.911003Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533700697830828:9868]
2025-10-02T08:10:05.911137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533700697830760:9869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:05.911145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533700697830760:9869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:05.911149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533700697830760:9869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:05.911159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:05.911642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:05.911813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:05.911852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:05.912147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:05.912188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.912194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.912195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.912197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.912198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.912203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.912212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.912221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.912224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.912232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.912237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.912248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:05.912257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.912262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:05.912272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.912281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:05.912286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.912291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.912297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.912302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.912319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:05.921441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:05.923528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:05.923547Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:05.923549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:05.923554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:05.923562Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 804 [1:7556533700697830828:9868]
2025-10-02T08:10:05.923577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:05.923598Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:05.923602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.923606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.923608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.923630Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:05.923636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:05.923642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:05.923713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.923723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.923726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:05.923729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:05.923810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:05.923819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.923838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:05.923854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:05.923876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697830833:9869], now have 1 active actors on pipe
2025-10-02T08:10:05.923887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533701157973320:2378], now have 1 active actors on pipe
2025-10-02T08:10:05.923891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 804
2025-10-02T08:10:05.923894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533700697830822:9868]
2025-10-02T08:10:05.923896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533700697830822:9868]
2025-10-02T08:10:05.923908Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:05.923922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:05.923927Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:05.923931Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:05.923936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:05.923938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:05.923946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.923952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.924021Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 804
2025-10-02T08:10:05.924000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533700697830822:9868]
2025-10-02T08:10:05.924014Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:05.924029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:05.924032Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:05.924039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:05.924043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:05.924045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:05.924057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:05.924068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:05.924109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.924221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:05.924229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:05.924244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:05.924282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 805 partition: 0 MaxSeqNo: 17 sessionId: src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0
2025-10-02T08:10:05.924680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a517aabb-ab202be4-c8ebb907-66b4ae9c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:05.927733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0] Write session: try to update token
2025-10-02T08:10:05.927754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:05.945199Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:05.945217Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:05.945220Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:05.945229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533700697830822:9868]
2025-10-02T08:10:05.945234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533700697830822:9868]
2025-10-02T08:10:05.945276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:05.945283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:05.945286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:05.945290Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:05.945296Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:05.945451Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:05.950786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId: src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:05.953484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:05.995855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533700697830862:9858]
2025-10-02T08:10:05.995961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 804, pipe: [1:7556533700697830862:9858]
2025-10-02T08:10:06.086835Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:06.087218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.087233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.087270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533700697830862:9858], now have 1 active actors on pipe
2025-10-02T08:10:06.087715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:06.087723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:06.087708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:06.087778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 805 reason: error at write: Disconnected sessionId: src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0
2025-10-02T08:10:06.087958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 805 sessionId: src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0 is DEAD
2025-10-02T08:10:06.088216Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:06.088627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533700697830862:9858]
2025-10-02T08:10:06.092568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:06.092579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0] Write session will restart in 0.006398s
2025-10-02T08:10:06.092606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0] Write session: Do CDS request
2025-10-02T08:10:06.092613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:06.103564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.104873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:06.105664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:06.105679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 806
2025-10-02T08:10:06.105787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.105813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:06.105818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:06.105822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:06.106663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 806 sessionId:  describe result for acl check
2025-10-02T08:10:06.106701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:06.106703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:06.106704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:06.106710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533704992798372:9877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:06.107210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533704992798372:9877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:06.108463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:06.108708Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:06.108715Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:06.108724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:06.108770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:06.108818Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533704992798385:9875]
2025-10-02T08:10:06.109455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:06.109723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:06.109778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:06.110084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:06.110124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.110125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.110126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.110127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.110129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.110133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.110142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.110156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.110166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.110169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.110173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533704992798372:9877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:06.110175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.110182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.110188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.110193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.110198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.110202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.110206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.110211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.110216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.110221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.110239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:06.116923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533704992798372:9877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:06.116952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533704992798372:9877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:06.116955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533704992798372:9877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:06.116962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:06.119215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:06.121348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:06.121369Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:06.121372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:06.121377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:06.121387Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 805 [1:7556533704992798385:9875]
2025-10-02T08:10:06.121399Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:06.121417Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:06.121421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.121424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.121433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.121450Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:06.121458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:06.121470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:06.121537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.121545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.121548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:06.121550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:06.121619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:06.121629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.121644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.121655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:06.121669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 805
2025-10-02T08:10:06.121675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992798419:9877], now have 1 active actors on pipe
2025-10-02T08:10:06.121678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533705452940623:2378], now have 1 active actors on pipe
2025-10-02T08:10:06.121685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533704992798364:9875]
2025-10-02T08:10:06.121686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533704992798364:9875]
2025-10-02T08:10:06.121698Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:06.121707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.121711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.121713Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:06.121716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:06.121732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:06.121750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:06.121766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:06.121762Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 805
2025-10-02T08:10:06.121814Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:06.121825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.121828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.121829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:06.121836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.121843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:06.121853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533704992798364:9875]
2025-10-02T08:10:06.121859Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:06.121869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:06.121885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.121935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.121944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.121959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.121994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 806 partition: 0 MaxSeqNo: 17 sessionId: src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0
2025-10-02T08:10:06.122329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da3c0af4-590cd24a-ca9eaaf3-2a7af161_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:06.125212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0] Write session: try to update token
2025-10-02T08:10:06.125231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:06.143572Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:06.143591Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:06.143594Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:06.143603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533704992798364:9875]
2025-10-02T08:10:06.143608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533704992798364:9875]
2025-10-02T08:10:06.143656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:06.143658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:06.143662Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:06.143665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.143667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:06.143820Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:06.145893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId: src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:06.148988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:06.188903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533704992798432:9858]
2025-10-02T08:10:06.189038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 805, pipe: [1:7556533704992798432:9858]
2025-10-02T08:10:06.293844Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:06.294159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.294172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.294203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992798432:9858], now have 1 active actors on pipe
2025-10-02T08:10:06.294314Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:06.294417Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:06.294531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533704992798432:9858]
2025-10-02T08:10:06.294552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:06.294599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 806 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0
2025-10-02T08:10:06.294737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 806 sessionId: src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0 is DEAD
2025-10-02T08:10:06.294881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:06.294890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0] Write session will restart in 0.005205s
2025-10-02T08:10:06.294917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0] Write session: Do CDS request
2025-10-02T08:10:06.294936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:06.301330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.301828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:06.301842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 807
2025-10-02T08:10:06.301927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.301961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:06.301971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:06.301974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:06.302544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 807 sessionId:  describe result for acl check
2025-10-02T08:10:06.302574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:06.302579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:06.302580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:06.302585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533704992798643:9888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:06.304473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533704992798643:9888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:06.306608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533704992798643:9888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:06.307040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:06.307487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:06.307647Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:06.307657Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:06.307668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:06.307709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:06.307748Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533704992798684:9887]
2025-10-02T08:10:06.308392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:06.309191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:06.309241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:06.309559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:06.309600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.309605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.309606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.309608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.309609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.309614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.309623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.309627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.309631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.309635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.309640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.309647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.309654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.309659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.309662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.309667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.309672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.309676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.309681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.309686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.309704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:06.314637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533704992798643:9888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:06.314650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533704992798643:9888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:06.314653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533704992798643:9888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:06.314661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:06.318302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:06.319953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:06.319974Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:06.319977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:06.319982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:06.319989Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 806 [1:7556533704992798684:9887]
2025-10-02T08:10:06.320002Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:06.320019Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:06.320021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.320027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.320029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.320044Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:06.320047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:06.320053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:06.320113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.320121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.320123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:06.320125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:06.320181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:06.320185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.320195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.320202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:06.320219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533704992798674:9887]
2025-10-02T08:10:06.320220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533704992798674:9887]
2025-10-02T08:10:06.320226Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:06.320238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:06.320257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:06.320265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:06.320264Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:06.320268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:06.320286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 806
2025-10-02T08:10:06.320305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992798730:9888], now have 1 active actors on pipe
2025-10-02T08:10:06.320309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533705452940643:2378], now have 1 active actors on pipe
2025-10-02T08:10:06.320311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533704992798674:9887]
2025-10-02T08:10:06.320319Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:06.320325Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:06.320326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.320330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.320375Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:06.320384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.320387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.320388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:06.320395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.320402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:06.320416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.320384Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 806
2025-10-02T08:10:06.320451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.320457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.320470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.320523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 807 partition: 0 MaxSeqNo: 17 sessionId: src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0
2025-10-02T08:10:06.320926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8083b804-a2cf8d53-ce6b45b2-32e998b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:06.323803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0] Write session: try to update token
2025-10-02T08:10:06.323822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:06.340013Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:06.340032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:06.340035Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:06.340044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533704992798674:9887]
2025-10-02T08:10:06.340049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533704992798674:9887]
2025-10-02T08:10:06.340094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:06.340101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.340103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:06.340117Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:06.340124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:06.340251Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:06.343736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId: src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:06.346839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:06.394712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533704992798743:9858]
2025-10-02T08:10:06.394840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 806, pipe: [1:7556533704992798743:9858]
2025-10-02T08:10:06.486636Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:06.487077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.487096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.487140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992798743:9858], now have 1 active actors on pipe
2025-10-02T08:10:06.487262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:06.487270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:06.487321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 807 reason: error at write: Disconnected sessionId: src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0
2025-10-02T08:10:06.487461Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:06.487415Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:06.487504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 807 sessionId: src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0 is DEAD
2025-10-02T08:10:06.487652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:06.487662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0] Write session will restart in 0.007351s
2025-10-02T08:10:06.487686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0] Write session: Do CDS request
2025-10-02T08:10:06.487693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:06.487620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533704992798743:9858]
2025-10-02T08:10:06.496428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.496476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:06.496491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 808
2025-10-02T08:10:06.496667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.496716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:06.496727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:06.496732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:06.497164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 808 sessionId:  describe result for acl check
2025-10-02T08:10:06.497198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:06.497205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:06.497206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:06.497212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533704992798957:9900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:06.497708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533704992798957:9900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:06.499885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:06.500291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:06.500428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533704992798957:9900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:06.500481Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:06.500493Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:06.500504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:06.500566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:06.500619Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533704992798983:9899]
2025-10-02T08:10:06.501239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:06.501453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:06.501505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:06.501802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:06.501860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.501869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.501870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.501871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.501872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.501877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.501887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.501891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.501894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.501898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.501905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.501912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.501919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.501924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.501929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.501934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.501939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.501944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.501949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.501954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.501970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:06.510356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533704992798957:9900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:06.510379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533704992798957:9900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:06.510383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533704992798957:9900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:06.510393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:06.511023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:06.512763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:06.512776Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:06.512778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:06.512781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:06.512786Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 807 [1:7556533704992798983:9899]
2025-10-02T08:10:06.512794Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:06.512822Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:06.512824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.512826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.512828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.512839Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:06.512843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:06.512848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:06.512904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.512911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.512913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:06.512915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:06.512979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:06.512987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.512998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.513006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:06.513024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533704992798977:9899]
2025-10-02T08:10:06.513030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533704992798977:9899]
2025-10-02T08:10:06.513036Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:06.513045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 807
2025-10-02T08:10:06.513050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992799009:9900], now have 1 active actors on pipe
2025-10-02T08:10:06.513053Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:06.513056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:06.513056Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:06.513069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:06.513071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:06.513078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.513082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.513134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533705452940661:2378], now have 1 active actors on pipe
2025-10-02T08:10:06.513143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533704992798977:9899]
2025-10-02T08:10:06.513150Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:06.513159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:06.513164Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:06.513171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.513173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.513175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:06.513181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.513188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:06.513211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.513319Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 807
2025-10-02T08:10:06.513350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.513376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.513430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.513494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 808 partition: 0 MaxSeqNo: 17 sessionId: src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0
2025-10-02T08:10:06.513836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ab45ffc-64918b2a-d74c792f-fcc45594_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:06.516528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0] Write session: try to update token
2025-10-02T08:10:06.516540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:06.533058Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:06.533074Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:06.533076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:06.533082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533704992798977:9899]
2025-10-02T08:10:06.533086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533704992798977:9899]
2025-10-02T08:10:06.533121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:06.533127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.533128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:06.533137Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:06.533143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:06.533266Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:06.534156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId: src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:06.536704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:06.587736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533704992799028:9858]
2025-10-02T08:10:06.587887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 807, pipe: [1:7556533704992799028:9858]
2025-10-02T08:10:06.675498Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:06.676061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.676077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.676118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992799028:9858], now have 1 active actors on pipe
2025-10-02T08:10:06.676247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:06.676260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:06.676326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 808 reason: error at write: Disconnected sessionId: src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0
2025-10-02T08:10:06.676333Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:06.676359Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:06.676486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 808 sessionId: src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0 is DEAD
2025-10-02T08:10:06.676598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533704992799028:9858]
2025-10-02T08:10:06.676832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:06.676843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0] Write session will restart in 0.007608s
2025-10-02T08:10:06.676871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0] Write session: Do CDS request
2025-10-02T08:10:06.676878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:06.685272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.685346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:06.685361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 809
2025-10-02T08:10:06.685468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.685509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:06.685519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:06.685522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:06.685992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 809 sessionId:  describe result for acl check
2025-10-02T08:10:06.686022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:06.686027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:06.686029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:06.686034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533704992799245:9908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:06.686531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533704992799245:9908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:06.688473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533704992799245:9908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:06.689002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:06.689546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:06.689941Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:06.689945Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:06.689957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:06.690016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:06.690047Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533704992799289:9907]
2025-10-02T08:10:06.690742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:06.691002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:06.691049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:06.691372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:06.691427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.691428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.691429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.691430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.691431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.691436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.691446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.691450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.691454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.691458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.691464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.691472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.691481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.691487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.691490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.691496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.691499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533704992799245:9908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:06.691500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.691506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.691506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533704992799245:9908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:06.691509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533704992799245:9908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:06.691512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.691517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:06.691517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.691536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:06.700866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:06.702726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:06.702739Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:06.702742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:06.702746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:06.702752Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 808 [1:7556533704992799289:9907]
2025-10-02T08:10:06.702766Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:06.702785Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:06.702798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.702801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.702803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.702821Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:06.702827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:06.702834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:06.702901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.702909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.702912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:06.702915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:06.702984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:06.702992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.703006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.703022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:06.703044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 808
2025-10-02T08:10:06.703045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992799303:9908], now have 1 active actors on pipe
2025-10-02T08:10:06.703052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533704992799278:9907]
2025-10-02T08:10:06.703054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533704992799278:9907]
2025-10-02T08:10:06.703060Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:06.703070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.703071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:06.703074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.703074Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:06.703092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:06.703114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:06.703121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:06.703127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533705452940679:2378], now have 1 active actors on pipe
2025-10-02T08:10:06.703168Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:06.703177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.703180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.703182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:06.703192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.703205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:06.703218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533704992799278:9907]
2025-10-02T08:10:06.703231Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:06.703258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:06.703264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.703348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.703356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.703369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.703401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 809 partition: 0 MaxSeqNo: 17 sessionId: src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0
2025-10-02T08:10:06.705235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d06f8c2d-6ed87d3a-7e80ec80-7f1873e8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:06.705600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 808
2025-10-02T08:10:06.707982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0] Write session: try to update token
2025-10-02T08:10:06.707996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:06.718612Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:06.718631Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:06.718641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533704992799278:9907]
2025-10-02T08:10:06.718695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:06.718889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:06.719068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:06.719221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:06.719380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:06.719610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:06.719659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:06.719749Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:06.728577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId: src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:06.731551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:06.731712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.731729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.731761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:06.731789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:06.731963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.731980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.732158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.732244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.732324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.732402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.732464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.732473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.732565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.732653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.732754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.732875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.732941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.732944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.733033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.733100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.733166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.733245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.733304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.733307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.733391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.733459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.733542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.733615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.733668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.733671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.733770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.733836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.733899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.733974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.734021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.734024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.734108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.734169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.734236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.734312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.734367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.734376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.734467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.734544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.734633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.734725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.734791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.734798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.734876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.734950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.735034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.735163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.735266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.735272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.735344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.735419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.735487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.735550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.735623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.735630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.735695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:06.735755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:06.735818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:06.735881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:06.735927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:06.735933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:06.735994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:06.736048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.736065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.736070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:06.736099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:06.736113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:06.736120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:06.736122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:06.736124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:06.736532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:06.736554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:06.736559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:06.736561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:06.736563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:06.736566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:06.737132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:06.737160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:06.737166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:06.737169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:06.737174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:06.737177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:06.737803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:06.737832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:06.737844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:06.737847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:06.737851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:06.739230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:06.739246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:06.739255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392606739
2025-10-02T08:10:06.739375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:06.739390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:06.739394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:06.739400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:06.739415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:06.739418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:06.739946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:06.739975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:06.739982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:06.739986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:06.739990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:06.739996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:06.740522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:06.740547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:06.740556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:06.740560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:06.740566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:06.740574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:06.741378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:06.741411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:06.741419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:06.743173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:06.743192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:06.743198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:06.743202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:06.743214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392606742
2025-10-02T08:10:06.743626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:06.743649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:06.743655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:06.743658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:06.743663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:06.743667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:06.744183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:06.744206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:06.744212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:06.744216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:06.744220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:06.744223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:06.744731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:06.744752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.744891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392606744
2025-10-02T08:10:06.747389Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:06.747429Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:06.747438Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:06.747446Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:06.747457Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:06.747460Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:06.747463Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:06.747471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533704992799278:9907]
2025-10-02T08:10:06.747475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533704992799278:9907]
2025-10-02T08:10:06.747525Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:06.747539Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:06.747557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:06.747562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.747565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:06.747699Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:06.776669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533704992799321:9858]
2025-10-02T08:10:06.776796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 808, pipe: [1:7556533704992799321:9858]
2025-10-02T08:10:06.907327Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:06.907937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992799321:9858], now have 1 active actors on pipe
2025-10-02T08:10:06.908278Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:06.908673Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:06.909602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:06.909612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0] Write session will restart in 0.006866s
2025-10-02T08:10:06.909636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0] Write session: Do CDS request
2025-10-02T08:10:06.909644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:06.908567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533704992799321:9858]
2025-10-02T08:10:06.908586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:06.908614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 809 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0
2025-10-02T08:10:06.908776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 809 sessionId: src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0 is DEAD
2025-10-02T08:10:06.914497Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6536e0e6572762bf] Result# TEvPutResult {Id# [72075186224037892:808:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:06.914569Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:808:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:06.915231Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:808:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:06.921330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.922704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:06.922719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 810
2025-10-02T08:10:06.922857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:06.922890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:06.922899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:06.922902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:06.923323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 810 sessionId:  describe result for acl check
2025-10-02T08:10:06.923354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:06.923360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:06.923362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:06.923368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533704992799460:9914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:06.923883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533704992799460:9914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:06.928643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533704992799460:9914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:06.932113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:06.932217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533704992799460:9914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:06.932232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533704992799460:9914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:06.932235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533704992799460:9914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:06.932244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:06.934496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:06.934676Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:06.934686Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:06.934697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:06.934750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:06.934790Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533704992799582:9913]
2025-10-02T08:10:06.935315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:06.935542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:06.935595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:06.935903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:06.935952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.935961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.935962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.935963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.935964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.935969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.935978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.935981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.935985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.935999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.936005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.936016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:06.936022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.936031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:06.936035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.936039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:06.936043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.936053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.936057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.936061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.936082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:06.944421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:06.946283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:06.946300Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:06.946302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:06.946306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:06.946313Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 809 [1:7556533704992799582:9913]
2025-10-02T08:10:06.946324Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:06.946342Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:06.946349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.946353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.946354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.946373Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:06.946382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:06.946388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:06.946451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.946458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.946461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:06.946463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:06.946529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:06.946536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.946549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:06.946563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:06.946583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533704992799570:9913]
2025-10-02T08:10:06.946589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533704992799570:9913]
2025-10-02T08:10:06.946597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:06.946607Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:06.946615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533704992799578:9914], now have 1 active actors on pipe
2025-10-02T08:10:06.946616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:06.946622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:06.946634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:06.946641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:06.946647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533705452940688:2378], now have 1 active actors on pipe
2025-10-02T08:10:06.946673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533704992799570:9913]
2025-10-02T08:10:06.946683Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:06.946689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:06.946731Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 809
2025-10-02T08:10:06.946724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 809
2025-10-02T08:10:06.946734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.946738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.946761Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:06.946767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:06.946770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:06.946772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:06.946780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:06.946788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:06.946809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.946841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:06.946848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:06.946858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:06.946889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 810 partition: 0 MaxSeqNo: 17 sessionId: src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0
2025-10-02T08:10:06.947232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b6dd22-4df9c2bc-e7321676-edb8a014_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:06.949985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0] Write session: try to update token
2025-10-02T08:10:06.950007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:06.957549Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:06.957566Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:06.957576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533704992799570:9913]
2025-10-02T08:10:06.957621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:06.957802Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:06.957815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:06.957979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:06.958143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:06.958300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:06.958520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:06.958558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:06.973179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId: src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:06.975463Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:06.975479Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:06.975482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:06.975490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533704992799570:9913]
2025-10-02T08:10:06.975494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533704992799570:9913]
2025-10-02T08:10:06.975539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:06.975545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:06.975545Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:06.975547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:06.975549Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:06.975689Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:06.975803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:07.008599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533709287766905:9858]
2025-10-02T08:10:07.008719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 809, pipe: [1:7556533709287766905:9858]
2025-10-02T08:10:07.133289Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:07.133639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.133658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.133680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287766905:9858], now have 1 active actors on pipe
2025-10-02T08:10:07.133784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533709287766905:9858]
2025-10-02T08:10:07.133803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:07.133809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:07.133859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 810 reason: error at write: Disconnected sessionId: src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0
2025-10-02T08:10:07.133881Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:07.134013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 810 sessionId: src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0 is DEAD
2025-10-02T08:10:07.134195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:07.134205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0] Write session will restart in 0.009290s
2025-10-02T08:10:07.134229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0] Write session: Do CDS request
2025-10-02T08:10:07.134241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:07.134558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:07.144381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.144394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:07.144406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 811
2025-10-02T08:10:07.144566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.144588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:07.144591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:07.144594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:07.145019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 811 sessionId:  describe result for acl check
2025-10-02T08:10:07.145065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:07.145067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:07.145068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:07.145074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533709287767123:9922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:07.145611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533709287767123:9922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:07.146414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:07.146848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:07.147028Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:07.147041Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:07.147051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:07.147102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:07.147137Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533709287767146:9920]
2025-10-02T08:10:07.147761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:07.147926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:07.147965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:07.148200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533709287767123:9922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:07.148261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:07.148298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.148299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.148300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.148301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.148303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.148308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.148318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.148322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.148326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.148329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.148334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.148340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.148347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.148352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.148356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.148361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.148365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.148371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.148376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.148380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.148396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:07.156217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533709287767123:9922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:07.156248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533709287767123:9922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:07.156252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533709287767123:9922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:07.156262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:07.160034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:07.162286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:07.162304Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:07.162307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:07.162311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:07.162317Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 810 [1:7556533709287767146:9920]
2025-10-02T08:10:07.162330Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:07.162348Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:07.162352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.162355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.162357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.162374Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:07.162379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:07.162386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:07.162456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.162465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.162469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:07.162472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:07.162549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:07.162557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.162571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.162588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:07.162614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287767174:9922], now have 1 active actors on pipe
2025-10-02T08:10:07.162623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533709747907993:2378], now have 1 active actors on pipe
2025-10-02T08:10:07.162629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533709287767129:9920]
2025-10-02T08:10:07.162636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533709287767129:9920]
2025-10-02T08:10:07.162653Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:07.162662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 810
2025-10-02T08:10:07.162670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:07.162684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:07.162693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:07.162728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533709287767129:9920]
2025-10-02T08:10:07.162736Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:07.162748Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 810
2025-10-02T08:10:07.162794Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:07.162805Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:07.162812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:07.162854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.162866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.162913Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29b2a0af-d05f7a8-c798966a-5929a260_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:07.162925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.162933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.162936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:07.162947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.162968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:07.162991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.163027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.163029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.163041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.163070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 811 partition: 0 MaxSeqNo: 17 sessionId: src_id|29b2a0af-d05f7a8-c798966a-5929a260_0
2025-10-02T08:10:07.165467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95df88f-c2e2c62b-83ff5590-69ad5bbc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|29b2a0af-d05f7a8-c798966a-5929a260_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:07.168439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b2a0af-d05f7a8-c798966a-5929a260_0] Write session: try to update token
2025-10-02T08:10:07.168461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b2a0af-d05f7a8-c798966a-5929a260_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:07.185699Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:07.185718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:07.185720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:07.185728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533709287767129:9920]
2025-10-02T08:10:07.185733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533709287767129:9920]
2025-10-02T08:10:07.185777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:07.185788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.185791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:07.185927Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:07.188867Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:07.188884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:07.189377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId: src_id|29b2a0af-d05f7a8-c798966a-5929a260_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:07.192072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:07.233890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533709287767188:9858]
2025-10-02T08:10:07.234048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 810, pipe: [1:7556533709287767188:9858]
2025-10-02T08:10:07.323065Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:07.323343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.323361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.323406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287767188:9858], now have 1 active actors on pipe
2025-10-02T08:10:07.325051Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:07.325101Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:07.325339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:07.325394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 811 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29b2a0af-d05f7a8-c798966a-5929a260_0
2025-10-02T08:10:07.325552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 811 sessionId: src_id|29b2a0af-d05f7a8-c798966a-5929a260_0 is DEAD
2025-10-02T08:10:07.325735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b2a0af-d05f7a8-c798966a-5929a260_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:07.325745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b2a0af-d05f7a8-c798966a-5929a260_0] Write session will restart in 0.005039s
2025-10-02T08:10:07.325770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b2a0af-d05f7a8-c798966a-5929a260_0] Write session: Do CDS request
2025-10-02T08:10:07.325777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b2a0af-d05f7a8-c798966a-5929a260_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:07.325796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533709287767188:9858]
2025-10-02T08:10:07.332368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b2a0af-d05f7a8-c798966a-5929a260_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.332446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:07.332463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 812
2025-10-02T08:10:07.332567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.332594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:07.332603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:07.332606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:07.333065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 812 sessionId:  describe result for acl check
2025-10-02T08:10:07.333102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:07.333108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:07.333109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:07.333114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533709287767399:9933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:07.335082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533709287767399:9933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:07.335524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:07.337406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533709287767399:9933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:07.337987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:07.338190Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:07.338199Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:07.338209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:07.338256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:07.338293Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533709287767447:9932]
2025-10-02T08:10:07.338887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:07.339060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:07.339091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:07.339322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:07.339356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.339361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.339362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.339363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.339364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.339367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.339373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.339375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.339377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.339379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.339383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.339389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.339392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.339395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.339400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.339403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.339406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.339423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.339426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.339429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.339440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:07.346003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533709287767399:9933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:07.346019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533709287767399:9933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:07.346023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533709287767399:9933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:07.346033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:07.348298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:07.350254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:07.350270Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:07.350272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:07.350274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:07.350280Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 811 [1:7556533709287767447:9932]
2025-10-02T08:10:07.350287Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:07.350300Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:07.350302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.350305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.350307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.350324Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:07.350337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:07.350343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:07.350406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.350413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.350416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:07.350418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:07.350482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:07.350491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.350504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.350518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:07.350620Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 811
2025-10-02T08:10:07.350540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287767472:9933], now have 1 active actors on pipe
2025-10-02T08:10:07.350550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533709747908012:2378], now have 1 active actors on pipe
2025-10-02T08:10:07.350555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533709287767426:9932]
2025-10-02T08:10:07.350557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533709287767426:9932]
2025-10-02T08:10:07.350568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:07.350579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:07.350580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:07.350582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:07.350592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:07.350594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:07.350628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533709287767426:9932]
2025-10-02T08:10:07.350631Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:07.350636Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:07.350669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 811
2025-10-02T08:10:07.350675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.350679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.350702Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3239880e-945a7bd2-85aab0c0-973d7979_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:07.350709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.350712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.350714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:07.350722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.350730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:07.350743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.350760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.350763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.350774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.350801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 812 partition: 0 MaxSeqNo: 17 sessionId: src_id|3239880e-945a7bd2-85aab0c0-973d7979_0
2025-10-02T08:10:07.351145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b2a0af-d05f7a8-c798966a-5929a260_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3239880e-945a7bd2-85aab0c0-973d7979_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:07.353852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3239880e-945a7bd2-85aab0c0-973d7979_0] Write session: try to update token
2025-10-02T08:10:07.353868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3239880e-945a7bd2-85aab0c0-973d7979_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:07.361618Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:07.361637Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:07.361646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533709287767426:9932]
2025-10-02T08:10:07.361686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:07.361686Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:07.361899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:07.362058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:07.362222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:07.362375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:07.362596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:07.362641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:07.368201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId: src_id|3239880e-945a7bd2-85aab0c0-973d7979_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:07.370980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:07.371050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.371063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.371098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:07.371117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:07.371648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.371658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.371831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.371915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.371995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.372082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.372146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.372151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.372241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.372315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.372390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.372487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.372536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.372539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.372617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.372680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.372747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.372834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.372881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.372884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.372955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.373018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.373082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.373147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.373195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.373214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.373289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.373360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.373431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.373502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.373549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.373557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.373629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.373696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.373765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.373835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.373888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.373895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.373973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.374038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.374121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.374187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.374238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.374245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.374318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.374383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.374457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.374528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.374578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.374585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.374655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.374721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.374791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.374865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.374913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.374920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.374989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.375057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.375133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.375204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.375251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.375259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.375301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:07.375371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.375393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.375400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:07.375451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:07.375469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:07.375473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:07.375478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:07.375480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:07.375912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:07.375941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:07.375952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:07.375955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:07.375959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:07.375962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:07.376477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:07.376502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:07.376513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:07.376517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:07.376520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:07.376523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:07.377189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:07.377215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:07.377220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:07.377229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:07.377232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:07.379732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:07.379753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:07.379767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392607379
2025-10-02T08:10:07.379939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:07.379957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:07.379965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:07.379979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:07.379983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:07.379989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:07.380529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:07.380556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:07.380563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:07.380567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:07.380571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:07.380574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:07.381209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:07.381235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:07.381242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:07.381245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:07.381249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:07.381253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:07.381786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:07.381811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:07.381817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:07.383003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:07.383024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:07.383029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:07.383035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:07.383045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392607382
2025-10-02T08:10:07.383378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:07.383405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:07.383427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:07.383435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:07.383441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:07.383443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:07.383922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:07.383949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:07.383954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:07.383963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:07.383966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:07.383970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:07.384504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:07.384526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.384630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392607384
2025-10-02T08:10:07.385470Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:07.385488Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:07.385497Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:07.385507Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:07.387222Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:07.387235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:07.387237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:07.387245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533709287767426:9932]
2025-10-02T08:10:07.387248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533709287767426:9932]
2025-10-02T08:10:07.387310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:07.387310Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:07.387317Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:07.387319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.387321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:07.387466Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:07.425853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533709287767523:9858]
2025-10-02T08:10:07.425940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 811, pipe: [1:7556533709287767523:9858]
2025-10-02T08:10:07.522982Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:07.523366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287767523:9858], now have 1 active actors on pipe
2025-10-02T08:10:07.523527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:07.523538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:07.523584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 812 reason: error at write: Disconnected sessionId: src_id|3239880e-945a7bd2-85aab0c0-973d7979_0
2025-10-02T08:10:07.523625Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:07.523644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:07.523796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 812 sessionId: src_id|3239880e-945a7bd2-85aab0c0-973d7979_0 is DEAD
2025-10-02T08:10:07.523943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239880e-945a7bd2-85aab0c0-973d7979_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:07.523954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239880e-945a7bd2-85aab0c0-973d7979_0] Write session will restart in 0.006214s
2025-10-02T08:10:07.523978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239880e-945a7bd2-85aab0c0-973d7979_0] Write session: Do CDS request
2025-10-02T08:10:07.523985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239880e-945a7bd2-85aab0c0-973d7979_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:07.523999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533709287767523:9858]
2025-10-02T08:10:07.531299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3239880e-945a7bd2-85aab0c0-973d7979_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.531394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:07.531418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 813
2025-10-02T08:10:07.531600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.531642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:07.531653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:07.531657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:07.532079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 813 sessionId:  describe result for acl check
2025-10-02T08:10:07.532111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:07.532113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:07.532114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:07.532119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533709287767695:9946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:07.532622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533709287767695:9946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:07.535331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533709287767695:9946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:07.538812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:07.539137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533709287767695:9946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:07.539152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533709287767695:9946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:07.539156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533709287767695:9946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:07.539165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:07.539317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:07.539716Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:07.539729Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:07.539740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:07.539798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:07.539837Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533709287767790:9945]
2025-10-02T08:10:07.540468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:07.540658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:07.540716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:07.541080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:07.541151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.541159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.541160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.541161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.541162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.541167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.541177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.541186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.541190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.541197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.541204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.541216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.541226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.541232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.541241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.541250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.541258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.541263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.541272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.541277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.541300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:07.550164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:07.551984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:07.552006Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:07.552008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:07.552012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:07.552018Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 812 [1:7556533709287767790:9945]
2025-10-02T08:10:07.552031Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:07.552048Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:07.552052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.552054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.552057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.552073Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:07.552078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:07.552092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:07.552156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.552165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.552168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:07.552171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:07.552241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:07.552248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.552262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.552275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:07.552300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287767786:9946], now have 1 active actors on pipe
2025-10-02T08:10:07.552308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 812
2025-10-02T08:10:07.552310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533709287767778:9945]
2025-10-02T08:10:07.552313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533709287767778:9945]
2025-10-02T08:10:07.552325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:07.552339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533709747908030:2378], now have 1 active actors on pipe
2025-10-02T08:10:07.552340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:07.552344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:07.552357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:07.552370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:07.552373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:07.552380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.552384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.552438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533709287767778:9945]
2025-10-02T08:10:07.552447Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:07.552455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:07.552461Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75ebc590-386e8774-e3d333be-542217db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:07.552468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.552476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.552478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:07.552436Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 812
2025-10-02T08:10:07.552486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.552500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:07.552541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.552585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.552591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.552603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.552647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 813 partition: 0 MaxSeqNo: 17 sessionId: src_id|75ebc590-386e8774-e3d333be-542217db_0
2025-10-02T08:10:07.552941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3239880e-945a7bd2-85aab0c0-973d7979_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|75ebc590-386e8774-e3d333be-542217db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:07.555453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebc590-386e8774-e3d333be-542217db_0] Write session: try to update token
2025-10-02T08:10:07.555468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebc590-386e8774-e3d333be-542217db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:07.569994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId: src_id|75ebc590-386e8774-e3d333be-542217db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:07.572626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:07.572707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.572718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.572748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:07.572768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:07.572828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.572841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.573022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.573091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.573154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.573235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.573501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.573511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.573578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.573643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.573710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.573888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.573932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.573938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.574002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.574062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.574124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.574185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.574249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.574255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.574314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.574378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.574435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.574493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.574551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.574558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.574620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.574676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.574737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.574797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.574843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.574850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.574917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.574978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.575046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.575108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.575154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.575161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.575223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.575280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.575345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.575402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.575460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.575468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.575527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.575579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.575637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.575702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.575744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.575751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.575818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.575878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.575939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.575999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.576037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.576042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.576103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:07.576160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:07.576223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:07.576280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:07.576326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:07.576333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:07.576371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:07.576434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.576455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.576466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:07.576505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:07.576522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:07.576526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:07.576529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:07.576531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:07.576918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:07.576944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:07.576955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:07.576962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:07.576964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:07.576966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:07.577558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:07.577581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:07.577586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:07.577593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:07.577596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:07.577599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:07.578103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:07.578121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:07.578125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:07.578127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:07.578130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:07.585250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:07.585278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:07.585296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392607585
2025-10-02T08:10:07.585477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:07.585499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:07.585508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:07.585511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:07.585516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:07.585519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:07.585996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:07.586016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:07.586022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:07.586027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:07.586030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:07.586033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:07.586520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:07.586542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:07.586555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:07.586558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:07.586563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:07.586570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:07.587073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:07.587093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:07.587102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:07.588101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:07.588114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:07.588118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:07.588122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:07.588128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392607588
2025-10-02T08:10:07.588398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:07.588414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:07.588423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:07.588429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:07.588433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:07.588435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:07.588895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:07.588911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:07.588915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:07.588920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:07.588923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:07.588928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:07.589381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:07.589398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.589482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392607589
2025-10-02T08:10:07.592940Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:07.592960Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:07.592966Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:07.592971Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:07.601675Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:07.601695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:07.601697Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:07.601707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533709287767778:9945]
2025-10-02T08:10:07.601712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533709287767778:9945]
2025-10-02T08:10:07.601759Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:07.601761Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:07.601766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533709287767778:9945]
2025-10-02T08:10:07.601774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:07.601789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:07.601798Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:07.601816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:07.601829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.601836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:07.601991Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:07.624022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533709287767822:9858]
2025-10-02T08:10:07.624168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 812, pipe: [1:7556533709287767822:9858]
2025-10-02T08:10:07.765368Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:07.766089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287767822:9858], now have 1 active actors on pipe
2025-10-02T08:10:07.766223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533709287767822:9858]
2025-10-02T08:10:07.766252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:07.766254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:07.766280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 813 reason: error at write: Disconnected sessionId: src_id|75ebc590-386e8774-e3d333be-542217db_0
2025-10-02T08:10:07.766353Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:07.766378Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:07.766440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 813 sessionId: src_id|75ebc590-386e8774-e3d333be-542217db_0 is DEAD
2025-10-02T08:10:07.766602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebc590-386e8774-e3d333be-542217db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:07.766623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebc590-386e8774-e3d333be-542217db_0] Write session will restart in 0.009006s
2025-10-02T08:10:07.766651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebc590-386e8774-e3d333be-542217db_0] Write session: Do CDS request
2025-10-02T08:10:07.766657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebc590-386e8774-e3d333be-542217db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:07.779764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:07.780323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:07.780608Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:07.780627Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:07.780645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:07.780726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:07.780782Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533709287768062:9952]
2025-10-02T08:10:07.781416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebc590-386e8774-e3d333be-542217db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.781457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:07.781468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 814
2025-10-02T08:10:07.781568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:07.781664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.781710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:07.781722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:07.781727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:07.781804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:07.781872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:07.782124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 814 sessionId:  describe result for acl check
2025-10-02T08:10:07.782154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:07.782160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:07.782161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:07.782166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533709287768073:9954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:07.782266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:07.782357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.782368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.782370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.782371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.782372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.782379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.782389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.782392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.782396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.782399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.782406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.782414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.782421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.782434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.782440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.782448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.782454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.782464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.782470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.782480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.782499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:07.782623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533709287768073:9954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:07.784984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533709287768073:9954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:07.790482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533709287768073:9954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:07.790499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533709287768073:9954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:07.790503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533709287768073:9954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:07.790513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:07.791001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:07.793023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:07.793036Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:07.793039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:07.793043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:07.793048Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 813 [1:7556533709287768062:9952]
2025-10-02T08:10:07.793056Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:07.793071Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:07.793072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.793075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.793076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.793093Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:07.793097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:07.793104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:07.793165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.793174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.793178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:07.793180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:07.793246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:07.793253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.793266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.793281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:07.793301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 813
2025-10-02T08:10:07.793302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287768109:9954], now have 1 active actors on pipe
2025-10-02T08:10:07.793309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533709287768056:9952]
2025-10-02T08:10:07.793311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533709287768056:9952]
2025-10-02T08:10:07.793325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:07.793333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533709747908049:2378], now have 1 active actors on pipe
2025-10-02T08:10:07.793337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.793341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.793357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:07.793369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:07.793378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:07.793366Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 813
2025-10-02T08:10:07.793416Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:07.793419Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:07.793424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:07.793425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.793429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.793430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:07.793439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.793449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:07.793457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533709287768056:9952]
2025-10-02T08:10:07.793466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:07.793467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:07.793492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.793551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.793558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.793573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.793612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 814 partition: 0 MaxSeqNo: 17 sessionId: src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0
2025-10-02T08:10:07.793956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75ebc590-386e8774-e3d333be-542217db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:07.796582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0] Write session: try to update token
2025-10-02T08:10:07.796600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:07.811665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId: src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:07.812316Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:07.812332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:07.812335Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:07.812343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533709287768056:9952]
2025-10-02T08:10:07.812350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533709287768056:9952]
2025-10-02T08:10:07.812392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:07.812399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.812402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:07.812426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:07.812436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:07.812536Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:07.814628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:07.866196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533709287768124:9858]
2025-10-02T08:10:07.866316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 813, pipe: [1:7556533709287768124:9858]
2025-10-02T08:10:07.968329Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:07.968814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.968826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.968860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287768124:9858], now have 1 active actors on pipe
2025-10-02T08:10:07.969385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:07.969396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0] Write session will restart in 0.006845s
2025-10-02T08:10:07.969425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0] Write session: Do CDS request
2025-10-02T08:10:07.969433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:07.968984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533709287768124:9858]
2025-10-02T08:10:07.969014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:07.969016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:07.969087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 814 reason: error at write: Disconnected sessionId: src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0
2025-10-02T08:10:07.969261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 814 sessionId: src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0 is DEAD
2025-10-02T08:10:07.970117Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:07.972927Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:07.977631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.977734Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:07.977750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 815
2025-10-02T08:10:07.977884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:07.977927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:07.977936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:07.977940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:07.978359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 815 sessionId:  describe result for acl check
2025-10-02T08:10:07.978392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:07.978398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:07.978400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:07.978404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533709287768285:9960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:07.978880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533709287768285:9960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:07.981588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533709287768285:9960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:07.982497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:07.984968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:07.985147Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:07.985157Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:07.985166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:07.985226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:07.985262Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533709287768386:9959]
2025-10-02T08:10:07.985327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533709287768285:9960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:07.985336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533709287768285:9960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:07.985339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533709287768285:9960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:07.985344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:07.985885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:07.986095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:07.986132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:07.986395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:07.986447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.986452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.986453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.986454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.986455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.986460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.986470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.986474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.986478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.986481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.986486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.986493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:07.986504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.986510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:07.986514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.986519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:07.986528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.986533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.986537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.986546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.986566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:07.995263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:07.996831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:07.996845Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:07.996848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:07.996852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:07.996859Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 814 [1:7556533709287768386:9959]
2025-10-02T08:10:07.996872Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:07.996890Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:07.996897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.996901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.996903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.996919Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:07.996930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:07.996937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:07.996998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.997006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.997010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:07.997012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:07.997076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:07.997084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:07.997097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:07.997115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:07.997132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 814
2025-10-02T08:10:07.997138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533709287768391:9960], now have 1 active actors on pipe
2025-10-02T08:10:07.997144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533709287768380:9959]
2025-10-02T08:10:07.997147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533709287768380:9959]
2025-10-02T08:10:07.997159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:07.997168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533709747908059:2378], now have 1 active actors on pipe
2025-10-02T08:10:07.997172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.997246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 814
2025-10-02T08:10:07.997173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:07.997176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:07.997176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.997193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:07.997208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:07.997211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:07.997250Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:07.997255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:07.997259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:07.997261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:07.997269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:07.997277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:07.997284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533709287768380:9959]
2025-10-02T08:10:07.997288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:07.997297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:07.997318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.997345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:07.997353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:07.997366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:07.997399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 815 partition: 0 MaxSeqNo: 17 sessionId: src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0
2025-10-02T08:10:07.997745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19accbae-7152a4c9-94dc0efa-77cd57bb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:08.000340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0] Write session: try to update token
2025-10-02T08:10:08.000356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:08.015558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId: src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:08.016090Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:08.016112Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:08.016114Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:08.016124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533709287768380:9959]
2025-10-02T08:10:08.016127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533709287768380:9959]
2025-10-02T08:10:08.016174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:08.016187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.016190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:08.016191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:08.016197Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:08.016366Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:08.018292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:08.069007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533713582735712:9858]
2025-10-02T08:10:08.069146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 814, pipe: [1:7556533713582735712:9858]
2025-10-02T08:10:08.164654Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:08.165431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.165451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.165492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582735712:9858], now have 1 active actors on pipe
2025-10-02T08:10:08.165623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:08.165650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:08.165723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 815 reason: error at write: Disconnected sessionId: src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0
2025-10-02T08:10:08.165726Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:08.165916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 815 sessionId: src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0 is DEAD
2025-10-02T08:10:08.166003Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:08.166081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:08.166090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0] Write session will restart in 0.005977s
2025-10-02T08:10:08.166083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533713582735712:9858]
2025-10-02T08:10:08.166119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0] Write session: Do CDS request
2025-10-02T08:10:08.166125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:08.174000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.174052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:08.174067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 816
2025-10-02T08:10:08.174205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.174235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:08.174244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:08.174250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:08.174645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 816 sessionId:  describe result for acl check
2025-10-02T08:10:08.174684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:08.174685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:08.174687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:08.174692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533713582735915:9966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:08.175222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533713582735915:9966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:08.177270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:08.177693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533713582735915:9966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:08.177752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:08.177906Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:08.177917Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:08.177928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:08.177968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:08.178005Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533713582735967:9965]
2025-10-02T08:10:08.178640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:08.178808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:08.178847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:08.179153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:08.179195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.179201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.179202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.179203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.179204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.179208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.179218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.179226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.179230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.179238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.179242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.179254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.179264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.179273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.179281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.179285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.179290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.179299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.179307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.179316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.179332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:08.181463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533713582735915:9966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:08.181476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533713582735915:9966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:08.181480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533713582735915:9966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:08.181488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:08.190554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:08.192545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:08.192559Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:08.192561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:08.192564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:08.192568Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 815 [1:7556533713582735967:9965]
2025-10-02T08:10:08.192577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:08.192589Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:08.192592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.192594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.192595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.192606Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:08.192609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:08.192614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:08.192673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.192679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.192681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:08.192683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:08.192728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:08.192735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.192744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.192751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:08.192763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533713582735958:9965]
2025-10-02T08:10:08.192764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533713582735958:9965]
2025-10-02T08:10:08.192771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:08.192781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:08.192787Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:08.192791Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:08.192794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:08.192796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:08.192833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 815
2025-10-02T08:10:08.192846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582735992:9966], now have 1 active actors on pipe
2025-10-02T08:10:08.192849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533713582735958:9965]
2025-10-02T08:10:08.192855Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:08.192859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533714042875361:2378], now have 1 active actors on pipe
2025-10-02T08:10:08.192863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.192866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.192869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:08.192898Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:08.192903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.192905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.192907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:08.192913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.192920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:08.192937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:08.192917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 815
2025-10-02T08:10:08.193013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.193019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.193034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:08.193072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 816 partition: 0 MaxSeqNo: 17 sessionId: src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0
2025-10-02T08:10:08.193398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbaec04-8de0e61d-be16ed24-cf63cdcc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:08.196343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0] Write session: try to update token
2025-10-02T08:10:08.196358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:08.211100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId: src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:08.212578Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:08.212594Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:08.212598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:08.212608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533713582735958:9965]
2025-10-02T08:10:08.212612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533713582735958:9965]
2025-10-02T08:10:08.212655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:08.212661Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:08.212667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.212668Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:08.212669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:08.212836Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:08.213940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:08.266032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533713582736006:9858]
2025-10-02T08:10:08.266171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 815, pipe: [1:7556533713582736006:9858]
2025-10-02T08:10:08.367005Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:08.367251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.367268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.367312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582736006:9858], now have 1 active actors on pipe
2025-10-02T08:10:08.369148Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:08.369531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:08.369596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 816 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0
2025-10-02T08:10:08.369778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 816 sessionId: src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0 is DEAD
2025-10-02T08:10:08.370040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533713582736006:9858]
2025-10-02T08:10:08.370275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:08.370285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0] Write session will restart in 0.008858s
2025-10-02T08:10:08.370310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0] Write session: Do CDS request
2025-10-02T08:10:08.370320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:08.372874Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:08.380576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.380593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:08.380610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 817
2025-10-02T08:10:08.380873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.380908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:08.380917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:08.380921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:08.381436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 817 sessionId:  describe result for acl check
2025-10-02T08:10:08.381468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:08.381472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:08.381473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:08.381478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533713582736197:9978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:08.382084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533713582736197:9978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:08.387591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533713582736197:9978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:08.389135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:08.389762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:08.389959Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:08.389962Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:08.389976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:08.390024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:08.390058Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533713582736283:9977]
2025-10-02T08:10:08.390777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:08.390998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:08.391042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:08.391365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:08.391413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.391429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.391431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.391432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.391433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.391438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.391449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.391453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.391457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.391461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.391467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.391476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.391487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.391494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.391503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.391509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.391516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.391523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.391532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.391538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.391558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:08.392100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533713582736197:9978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:08.392114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533713582736197:9978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:08.392118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533713582736197:9978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:08.392125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:08.400490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:08.402230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:08.402249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:08.402252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:08.402256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:08.402262Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 816 [1:7556533713582736283:9977]
2025-10-02T08:10:08.402273Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:08.402289Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:08.402292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.402295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.402297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.402312Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:08.402317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:08.402324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:08.402381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.402390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.402393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:08.402396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:08.402461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:08.402469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.402483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.402490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 816
2025-10-02T08:10:08.402496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:08.402515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582736299:9978], now have 1 active actors on pipe
2025-10-02T08:10:08.402518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533714042875381:2378], now have 1 active actors on pipe
2025-10-02T08:10:08.402523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.402531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.402549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533713582736273:9977]
2025-10-02T08:10:08.402556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533713582736273:9977]
2025-10-02T08:10:08.402569Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:08.402581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:08.402583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:08.402586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:08.402601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:08.402603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:08.402582Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 816
2025-10-02T08:10:08.402620Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:08.402630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.402634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.402636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:08.402644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.402657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:08.402694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533713582736273:9977]
2025-10-02T08:10:08.402706Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:08.402709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:08.402725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:08.402784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.402797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.402820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:08.402855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 817 partition: 0 MaxSeqNo: 17 sessionId: src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0
2025-10-02T08:10:08.403236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d3e2a1-37a417eb-196f24d0-4d4900bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:08.406167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0] Write session: try to update token
2025-10-02T08:10:08.406186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:08.421914Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:08.421939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:08.421943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:08.421953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533713582736273:9977]
2025-10-02T08:10:08.421958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533713582736273:9977]
2025-10-02T08:10:08.421998Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:08.422009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:08.422009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:08.422017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.422019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:08.422180Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:08.423026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId: src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:08.425887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:08.469316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533713582736341:9858]
2025-10-02T08:10:08.469445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 816, pipe: [1:7556533713582736341:9858]
2025-10-02T08:10:08.571214Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:08.571522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.571532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.571566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582736341:9858], now have 1 active actors on pipe
2025-10-02T08:10:08.571682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:08.571693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:08.571756Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:08.571758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 817 reason: error at write: Disconnected sessionId: src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0
2025-10-02T08:10:08.571770Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:08.571994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 817 sessionId: src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0 is DEAD
2025-10-02T08:10:08.571998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533713582736341:9858]
2025-10-02T08:10:08.572149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:08.572159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0] Write session will restart in 0.008896s
2025-10-02T08:10:08.572187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0] Write session: Do CDS request
2025-10-02T08:10:08.572194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:08.581671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:08.582379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.582420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:08.582429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 818
2025-10-02T08:10:08.582609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.582632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:08.582639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:08.582642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:08.582962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 818 sessionId:  describe result for acl check
2025-10-02T08:10:08.582988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:08.582989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:08.582990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:08.582993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533713582736580:9992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:08.583383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533713582736580:9992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:08.583981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:08.584121Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:08.584128Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:08.584135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:08.584170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:08.584200Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533713582736590:9990]
2025-10-02T08:10:08.584657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:08.584799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:08.584858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:08.585111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:08.585151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.585156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.585157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.585157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.585158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.585161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.585167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.585169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.585171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.585173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.585177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.585181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.585184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.585187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.585189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.585192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.585194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.585196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.585199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.585201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.585211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:08.585309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533713582736580:9992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:08.590977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533713582736580:9992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:08.590997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533713582736580:9992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:08.591001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533713582736580:9992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:08.591010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:08.593059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:08.595087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:08.595106Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:08.595108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:08.595111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:08.595117Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 817 [1:7556533713582736590:9990]
2025-10-02T08:10:08.595135Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:08.595151Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:08.595159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.595162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.595164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.595182Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:08.595186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:08.595191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:08.595249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.595257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.595260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:08.595263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:08.595321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:08.595330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.595344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.595352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 817
2025-10-02T08:10:08.595360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:08.595377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582736628:9992], now have 1 active actors on pipe
2025-10-02T08:10:08.595384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533714042875410:2378], now have 1 active actors on pipe
2025-10-02T08:10:08.595389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.595393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.595414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533713582736573:9990]
2025-10-02T08:10:08.595429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533713582736573:9990]
2025-10-02T08:10:08.595436Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:08.595445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:08.595447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:08.595451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:08.595429Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 817
2025-10-02T08:10:08.595464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:08.595473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:08.595488Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48b6734-c37d507f-e779241a-842b397c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:08.595494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.595497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.595499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:08.595507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.595515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:08.595554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533713582736573:9990]
2025-10-02T08:10:08.595567Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:08.595580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:08.595587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:08.595624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.595629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.595644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:08.595686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 818 partition: 0 MaxSeqNo: 17 sessionId: src_id|48b6734-c37d507f-e779241a-842b397c_0
2025-10-02T08:10:08.596003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838a28f9-17fd0cb2-2a1bd6d8-e53dfb88_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|48b6734-c37d507f-e779241a-842b397c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:08.598567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b6734-c37d507f-e779241a-842b397c_0] Write session: try to update token
2025-10-02T08:10:08.598583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b6734-c37d507f-e779241a-842b397c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:08.607266Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:08.607287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:08.607302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533713582736573:9990]
2025-10-02T08:10:08.607349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:08.607365Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:08.607633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:08.607833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:08.608033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:08.608221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:08.608489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:08.608540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:08.614772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId: src_id|48b6734-c37d507f-e779241a-842b397c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:08.617549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:08.617656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.617671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.617713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:08.617739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:08.617804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.617820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.618003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.618078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.618157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.618234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.618594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.618605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.618682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.618752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.618825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.618896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.618951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.618959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.619029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.619102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.619174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.619247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.619404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.619413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.619534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.619605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.619668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.619734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.619786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.619798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.619872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.619944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.620024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.620099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.620154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.620161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.620240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.620312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.620390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.620469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.620529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.620553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.620636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.620706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.620786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.620881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.620932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.620939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.621015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.621085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.621157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.621235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.621291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.621299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.621376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.621447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.621519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.621598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.621655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.621664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.621735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:08.621809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:08.621884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:08.621960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:08.622011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:08.622019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:08.622066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:08.622141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.622167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.622173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:08.622206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:08.622223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:08.622230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:08.622234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:08.622236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:08.622712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:08.622740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:08.622752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:08.622755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:08.622763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:08.622768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:08.623387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:08.623412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:08.623450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:08.623454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:08.623457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:08.623461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:08.624067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:08.624087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:08.624091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:08.624095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:08.624100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:08.632033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:08.632069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:08.632087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392608632
2025-10-02T08:10:08.632241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:08.632264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:08.632272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:08.632277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:08.632291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:08.632299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:08.632980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:08.633009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:08.633019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:08.633023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:08.633027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:08.633031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:08.633586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:08.633613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:08.633621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:08.633625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:08.633631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:08.633636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:08.634213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:08.634242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:08.634249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:08.635501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:08.635516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:08.635520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:08.635526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:08.635533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392608635
2025-10-02T08:10:08.635850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:08.635871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:08.635878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:08.635884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:08.635888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:08.635890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:08.636371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:08.636396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:08.636405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:08.636407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:08.636409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:08.636412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:08.636944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:08.636967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.637066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392608636
2025-10-02T08:10:08.637942Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:08.637965Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:08.637975Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:08.637982Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:08.639701Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:08.639716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:08.639721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:08.639732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533713582736573:9990]
2025-10-02T08:10:08.639737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533713582736573:9990]
2025-10-02T08:10:08.639798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:08.639799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:08.639805Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:08.639808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.639811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:08.639945Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:08.672038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533713582736663:9858]
2025-10-02T08:10:08.672192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 817, pipe: [1:7556533713582736663:9858]
2025-10-02T08:10:08.778595Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:08.778972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582736663:9858], now have 1 active actors on pipe
2025-10-02T08:10:08.779094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533713582736663:9858]
2025-10-02T08:10:08.779125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:08.779127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:08.779155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 818 reason: error at write: Disconnected sessionId: src_id|48b6734-c37d507f-e779241a-842b397c_0
2025-10-02T08:10:08.779234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:08.779195Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:08.779344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 818 sessionId: src_id|48b6734-c37d507f-e779241a-842b397c_0 is DEAD
2025-10-02T08:10:08.779558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b6734-c37d507f-e779241a-842b397c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:08.779574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b6734-c37d507f-e779241a-842b397c_0] Write session will restart in 0.006572s
2025-10-02T08:10:08.779601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b6734-c37d507f-e779241a-842b397c_0] Write session: Do CDS request
2025-10-02T08:10:08.779609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b6734-c37d507f-e779241a-842b397c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:08.787394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b6734-c37d507f-e779241a-842b397c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.787484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:08.787501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 819
2025-10-02T08:10:08.787708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.787739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:08.787749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:08.787752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:08.788289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 819 sessionId:  describe result for acl check
2025-10-02T08:10:08.788316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:08.788324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:08.788327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:08.788331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533713582736880:9998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:08.788775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533713582736880:9998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:08.791681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533713582736880:9998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:08.792770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:08.796019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:08.796240Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:08.796252Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:08.796262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:08.796314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:08.796356Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533713582736931:9997]
2025-10-02T08:10:08.796613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533713582736880:9998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:08.796628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533713582736880:9998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:08.796631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533713582736880:9998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:08.796640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:08.797051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:08.797252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:08.797301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:08.797630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:08.797683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.797689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.797690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.797691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.797692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.797698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.797709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.797713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.797716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.797720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.797726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.797735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.797741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.797752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.797757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.797763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.797767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.797772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.797780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.797785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.797810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:08.807561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:08.809366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:08.809381Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:08.809383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:08.809386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:08.809391Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 818 [1:7556533713582736931:9997]
2025-10-02T08:10:08.809402Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:08.809421Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:08.809424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.809427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.809429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.809441Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:08.809444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:08.809450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:08.809504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.809510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.809513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:08.809514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:08.809564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:08.809574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.809586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.809596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:08.809612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533713582736923:9997]
2025-10-02T08:10:08.809615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533713582736923:9997]
2025-10-02T08:10:08.809622Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:08.809634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:08.809652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:08.809654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:08.809659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:08.809662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:08.809665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582736936:9998], now have 1 active actors on pipe
2025-10-02T08:10:08.809674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 818
2025-10-02T08:10:08.809697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533713582736923:9997]
2025-10-02T08:10:08.809703Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:08.809708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533714042875418:2378], now have 1 active actors on pipe
2025-10-02T08:10:08.809711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:08.809712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.809719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.809764Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:08.809770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:08.809775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:08.809776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:08.809786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:08.809795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:08.809776Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 818
2025-10-02T08:10:08.809812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:08.809859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.809868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.809881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:08.809915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 819 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0
2025-10-02T08:10:08.810332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b6734-c37d507f-e779241a-842b397c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:08.816660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0] Write session: try to update token
2025-10-02T08:10:08.816683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:08.827748Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:08.827765Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:08.827767Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:08.827775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533713582736923:9997]
2025-10-02T08:10:08.827778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533713582736923:9997]
2025-10-02T08:10:08.827816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:08.827822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.827824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:08.827825Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:08.827830Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:08.827954Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:08.833487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId: src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:08.836922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:08.879478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533713582736962:9858]
2025-10-02T08:10:08.879624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 818, pipe: [1:7556533713582736962:9858]
2025-10-02T08:10:08.975343Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:08.975760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:08.975772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:08.975789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582736962:9858], now have 1 active actors on pipe
2025-10-02T08:10:08.975903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533713582736962:9858]
2025-10-02T08:10:08.975932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:08.975934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:08.975957Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:08.976024Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:08.976000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 819 reason: error at write: Disconnected sessionId: src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0
2025-10-02T08:10:08.976173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 819 sessionId: src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0 is DEAD
2025-10-02T08:10:08.976425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:08.976439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0] Write session will restart in 0.005869s
2025-10-02T08:10:08.976464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0] Write session: Do CDS request
2025-10-02T08:10:08.976470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:08.983432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.983466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:08.983733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 820
2025-10-02T08:10:08.983924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:08.983957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:08.983964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:08.983967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:08.984321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 820 sessionId:  describe result for acl check
2025-10-02T08:10:08.984348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:08.984352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:08.984353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:08.984357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533713582737170:10005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:08.984857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533713582737170:10005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:08.987505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533713582737170:10005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:08.987512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:08.990034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:08.990270Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:08.990281Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:08.990293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:08.990355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:08.990402Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533713582737234:10004]
2025-10-02T08:10:08.990431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533713582737170:10005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:08.990444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533713582737170:10005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:08.990447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533713582737170:10005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:08.990455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:08.990998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:08.991239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:08.991284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:08.991615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:08.991649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.991652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.991653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.991654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.991655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.991658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.991666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.991678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.991680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.991683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.991687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.991692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:08.991696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.991699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:08.991702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.991706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:08.991711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.991715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:08.991718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.991721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:08.991735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:09.001222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:09.003078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:09.003101Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:09.003103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:09.003107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:09.003115Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 819 [1:7556533713582737234:10004]
2025-10-02T08:10:09.003130Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:09.003151Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:09.003160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.003164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.003165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.003183Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:09.003189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:09.003201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:09.003269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.003275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.003277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:09.003279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:09.003339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:09.003346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.003357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.003368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:09.003382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533713582737218:10004]
2025-10-02T08:10:09.003388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533713582737218:10004]
2025-10-02T08:10:09.003396Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:09.003409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:09.003411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533713582737239:10005], now have 1 active actors on pipe
2025-10-02T08:10:09.003412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 819
2025-10-02T08:10:09.003418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:09.003419Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:09.003444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:09.003447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:09.003454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533714042875427:2378], now have 1 active actors on pipe
2025-10-02T08:10:09.003489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.003498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.003513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533713582737218:10004]
2025-10-02T08:10:09.003525Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:09.003539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:09.003554Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:09.003563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.003569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.003570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:09.003580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.003593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:09.003624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.003696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.003704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.003716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.003756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 820 partition: 0 MaxSeqNo: 17 sessionId: src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0
2025-10-02T08:10:09.004140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e886521-7eb8ce43-dae110c6-d94616bb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:09.004936Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 819
2025-10-02T08:10:09.007386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0] Write session: try to update token
2025-10-02T08:10:09.007409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:09.022503Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:09.022524Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:09.022526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:09.022536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533713582737218:10004]
2025-10-02T08:10:09.022541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533713582737218:10004]
2025-10-02T08:10:09.022586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:09.022594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.022592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:09.022596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:09.022599Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:09.022756Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:09.025587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId: src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:09.028703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:09.076050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533717877704560:9858]
2025-10-02T08:10:09.076179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 819, pipe: [1:7556533717877704560:9858]
2025-10-02T08:10:09.166805Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:09.167224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.167240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.167283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877704560:9858], now have 1 active actors on pipe
2025-10-02T08:10:09.167621Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:09.167420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:09.167440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:09.167519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 820 reason: error at write: Disconnected sessionId: src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0
2025-10-02T08:10:09.167534Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:09.167708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 820 sessionId: src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0 is DEAD
2025-10-02T08:10:09.167848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533717877704560:9858]
2025-10-02T08:10:09.167930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:09.167943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0] Write session will restart in 0.009264s
2025-10-02T08:10:09.167968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0] Write session: Do CDS request
2025-10-02T08:10:09.167973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:09.178460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.178460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:09.178477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 821
2025-10-02T08:10:09.178688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.178724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:09.178728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:09.178731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:09.179214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 821 sessionId:  describe result for acl check
2025-10-02T08:10:09.179259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:09.179261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:09.179263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:09.179268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533717877704775:10011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:09.179766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533717877704775:10011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:09.182362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533717877704775:10011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:09.186011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533717877704775:10011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:09.186031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533717877704775:10011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:09.186035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533717877704775:10011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:09.186044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:09.193216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:09.199473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:09.199740Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:09.199752Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:09.199764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:09.199826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:09.199867Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533717877704839:10010]
2025-10-02T08:10:09.200475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:09.200858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:09.200909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:09.201218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:09.201267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.201268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.201269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.201270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.201271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.201276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.201286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.201290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.201293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.201296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.201302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.201309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.201314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.201321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.201326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.201330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.201334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.201338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.201343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.201347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.201368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:09.216409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:09.218232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:09.218241Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:09.218244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:09.218248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:09.218256Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 820 [1:7556533717877704839:10010]
2025-10-02T08:10:09.218272Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:09.218295Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:09.218300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.218303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.218312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.218331Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:09.218338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:09.218345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:09.218421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.218423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.218426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:09.218429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:09.218505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:09.218508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.218526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.218538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:09.218557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533717877704833:10010]
2025-10-02T08:10:09.218559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533717877704833:10010]
2025-10-02T08:10:09.218573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:09.218585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:09.218601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:09.218604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:09.218642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533717877704833:10010]
2025-10-02T08:10:09.218645Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:09.219457Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 820
2025-10-02T08:10:09.218995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:09.219004Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:09.219010Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:09.219441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 820
2025-10-02T08:10:09.219472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533718337842729:2378], now have 1 active actors on pipe
2025-10-02T08:10:09.219476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877704818:10011], now have 1 active actors on pipe
2025-10-02T08:10:09.219608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.219615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.219654Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:09.219672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.219677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.219680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:09.219693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.219707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:09.219730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.223189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.223208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.223245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.223287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 821 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0
2025-10-02T08:10:09.223835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501e-142f8b01-e0c8051f-c9c530b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:09.227243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0] Write session: try to update token
2025-10-02T08:10:09.227273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:09.245822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId: src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:09.246454Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:09.246475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:09.246477Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:09.246486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533717877704833:10010]
2025-10-02T08:10:09.246490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533717877704833:10010]
2025-10-02T08:10:09.246538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:09.246544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.246554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:09.246713Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:09.248377Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:09.248395Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:09.249056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:09.267564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533717877704864:9858]
2025-10-02T08:10:09.267778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 820, pipe: [1:7556533717877704864:9858]
2025-10-02T08:10:09.392434Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:09.393223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.393240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.393261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877704864:9858], now have 1 active actors on pipe
2025-10-02T08:10:09.393411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:09.393418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:09.393468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 821 reason: error at write: Disconnected sessionId: src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0
2025-10-02T08:10:09.393548Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:09.393557Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:09.393652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 821 sessionId: src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0 is DEAD
2025-10-02T08:10:09.393808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533717877704864:9858]
2025-10-02T08:10:09.393847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:09.393884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0] Write session will restart in 0.007430s
2025-10-02T08:10:09.393926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0] Write session: Do CDS request
2025-10-02T08:10:09.393933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:09.402358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.402630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:09.402649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 822
2025-10-02T08:10:09.402830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.402864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:09.402874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:09.402877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:09.403253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 822 sessionId:  describe result for acl check
2025-10-02T08:10:09.403286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:09.403292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:09.403293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:09.403298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533717877705092:10017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:09.403726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533717877705092:10017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:09.405623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533717877705092:10017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:09.406876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:09.407244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:09.407386Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:09.407396Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:09.407404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:09.407452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:09.407480Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533717877705142:10016]
2025-10-02T08:10:09.408058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:09.408223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:09.408271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533717877705092:10017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:09.408280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:09.408280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533717877705092:10017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:09.408283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533717877705092:10017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:09.408291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:09.408514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:09.408557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.408563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.408564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.408565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.408567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.408571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.408577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.408579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.408581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.408583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.408586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.408590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.408594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.408597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.408599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.408601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.408604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.408606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.408609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.408614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.408629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:09.417395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:09.419047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:09.419065Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:09.419067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:09.419071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:09.419077Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 821 [1:7556533717877705142:10016]
2025-10-02T08:10:09.419089Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:09.419105Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:09.419107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.419110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.419113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.419128Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:09.419137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:09.419142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:09.419203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.419209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.419212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:09.419214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:09.419274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:09.419281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.419294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.419311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:09.419333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877705155:10017], now have 1 active actors on pipe
2025-10-02T08:10:09.419340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533718337842736:2378], now have 1 active actors on pipe
2025-10-02T08:10:09.419345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533717877705136:10016]
2025-10-02T08:10:09.419347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533717877705136:10016]
2025-10-02T08:10:09.419359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:09.419373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:09.419378Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:09.419382Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:09.419384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:09.419386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:09.419416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533717877705136:10016]
2025-10-02T08:10:09.419434Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:09.419444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:09.419476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 821
2025-10-02T08:10:09.419460Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 821
2025-10-02T08:10:09.419561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.419569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.419594Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:09.419604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.419608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.419614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:09.419622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.419630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:09.419650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.419682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.419688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.419700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.419730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 822 partition: 0 MaxSeqNo: 17 sessionId: src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0
2025-10-02T08:10:09.420132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc28e749-12439a51-696e5af5-e5c44d3d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:09.423365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0] Write session: try to update token
2025-10-02T08:10:09.423387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:09.439180Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:09.439198Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:09.439199Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:09.439205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533717877705136:10016]
2025-10-02T08:10:09.439208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533717877705136:10016]
2025-10-02T08:10:09.439241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:09.439240Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:09.439245Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:09.439246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.439247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:09.439383Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:09.443780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId: src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:09.446645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:09.493865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533717877705214:9858]
2025-10-02T08:10:09.494040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 821, pipe: [1:7556533717877705214:9858]
2025-10-02T08:10:09.582268Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:09.582748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.582763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.582807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877705214:9858], now have 1 active actors on pipe
2025-10-02T08:10:09.582920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:09.582927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:09.582935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533717877705214:9858]
2025-10-02T08:10:09.582978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 822 reason: error at write: Disconnected sessionId: src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0
2025-10-02T08:10:09.583069Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:09.583099Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:09.583166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 822 sessionId: src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0 is DEAD
2025-10-02T08:10:09.583310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:09.583319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0] Write session will restart in 0.009379s
2025-10-02T08:10:09.583345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0] Write session: Do CDS request
2025-10-02T08:10:09.583352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:09.594602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.594643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:09.594661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 823
2025-10-02T08:10:09.594865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.594901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:09.594906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:09.594910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:09.595386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 823 sessionId:  describe result for acl check
2025-10-02T08:10:09.595421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:09.595436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:09.595438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:09.595442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533717877705460:10039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:09.595915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533717877705460:10039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:09.598083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:09.598630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:09.598632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533717877705460:10039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:09.598836Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:09.598844Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:09.598854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:09.598915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:09.598953Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533717877705486:10037]
2025-10-02T08:10:09.599622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:09.599866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:09.599912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:09.600150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:09.600179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.600183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.600184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.600185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.600185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.600189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.600196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.600198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.600200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.600202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.600205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.600210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.600214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.600217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.600220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.600223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.600227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.600231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.600236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.600241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.600257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:09.601361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533717877705460:10039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:09.601374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533717877705460:10039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:09.601377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533717877705460:10039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:09.601386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:09.612783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:09.614820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:09.614841Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:09.614843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:09.614846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:09.614853Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 822 [1:7556533717877705486:10037]
2025-10-02T08:10:09.614864Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:09.614883Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:09.614886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.614889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.614891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.614909Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:09.614914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:09.614921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:09.614985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.614994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.614997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:09.615000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:09.615073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:09.615083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.615098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.615108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:09.615125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533717877705479:10037]
2025-10-02T08:10:09.615132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533717877705479:10037]
2025-10-02T08:10:09.615140Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:09.615155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 822
2025-10-02T08:10:09.615156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:09.615159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:09.615159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:09.615175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:09.615178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:09.615187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877705512:10039], now have 1 active actors on pipe
2025-10-02T08:10:09.615195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533718337842779:2378], now have 1 active actors on pipe
2025-10-02T08:10:09.615200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.615208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.615233Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 822
2025-10-02T08:10:09.615253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533717877705479:10037]
2025-10-02T08:10:09.615265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:09.615268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:09.615281Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:09.615287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.615291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.615293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:09.615302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.615312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:09.615365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.615475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.615484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.615500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.615541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 823 partition: 0 MaxSeqNo: 17 sessionId: src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0
2025-10-02T08:10:09.615900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2861cd3-aeda9cc5-d22895f2-d5844ee5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:09.618821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0] Write session: try to update token
2025-10-02T08:10:09.618836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:09.637421Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:09.637444Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:09.637447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:09.637455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533717877705479:10037]
2025-10-02T08:10:09.637460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533717877705479:10037]
2025-10-02T08:10:09.637506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:09.637521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.637519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:09.637524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:09.637527Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:09.637672Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:09.638325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId: src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:09.641114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:09.683287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533717877705538:9858]
2025-10-02T08:10:09.683449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 822, pipe: [1:7556533717877705538:9858]
2025-10-02T08:10:09.782511Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:09.782944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.782957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.782999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877705538:9858], now have 1 active actors on pipe
2025-10-02T08:10:09.783147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:09.783158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:09.783221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 823 reason: error at write: Disconnected sessionId: src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0
2025-10-02T08:10:09.783238Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:09.783258Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:09.783455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 823 sessionId: src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0 is DEAD
2025-10-02T08:10:09.783584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:09.783574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533717877705538:9858]
2025-10-02T08:10:09.783593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0] Write session will restart in 0.006239s
2025-10-02T08:10:09.783630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0] Write session: Do CDS request
2025-10-02T08:10:09.783638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:09.791424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.791493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:09.791508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 824
2025-10-02T08:10:09.791693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.791738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:09.791743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:09.791747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:09.792205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 824 sessionId:  describe result for acl check
2025-10-02T08:10:09.792242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:09.792250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:09.792252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:09.792257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533717877705766:10045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:09.792726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533717877705766:10045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:09.794776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533717877705766:10045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:09.796524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:09.796967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:09.797112Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:09.797120Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:09.797126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:09.797160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:09.797199Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533717877705816:10044]
2025-10-02T08:10:09.797624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:09.797752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533717877705766:10045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:09.797756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:09.797767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533717877705766:10045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:09.797770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533717877705766:10045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:09.797778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:09.797783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:09.798003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:09.798054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.798059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.798060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.798061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.798063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.798068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.798078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.798082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.798085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.798088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.798093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.798105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.798115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.798120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.798125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.798128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.798132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.798135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.798137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.798140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.798150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:09.806763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:09.808380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:09.808395Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:09.808399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:09.808404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:09.808412Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 823 [1:7556533717877705816:10044]
2025-10-02T08:10:09.808426Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:09.808443Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:09.808452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.808455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.808457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.808472Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:09.808485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:09.808492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:09.808559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.808567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.808570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:09.808573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:09.808636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:09.808646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.808659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.808886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 823
2025-10-02T08:10:09.808676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:09.808705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877705827:10045], now have 1 active actors on pipe
2025-10-02T08:10:09.808711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533717877705810:10044]
2025-10-02T08:10:09.808713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533717877705810:10044]
2025-10-02T08:10:09.808720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 823
2025-10-02T08:10:09.808721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:09.808730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533718337842787:2378], now have 1 active actors on pipe
2025-10-02T08:10:09.808731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:09.808734Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:09.808738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:09.808752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:09.808754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:09.808761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.808768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.808833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533717877705810:10044]
2025-10-02T08:10:09.808842Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:09.808857Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:09.808860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:09.808865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:09.808869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:09.808871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:09.808880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:09.808889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:09.808923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.809005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.809011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.809043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:09.809086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 824 partition: 0 MaxSeqNo: 17 sessionId: src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0
2025-10-02T08:10:09.809408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e9022b-8e6df764-9c42b4b9-b289ea3f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:09.812079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0] Write session: try to update token
2025-10-02T08:10:09.812095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:09.827105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId: src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:09.829884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:09.831187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:09.831208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:09.831228Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:09.831231Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:09.831233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:09.831240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533717877705810:10044]
2025-10-02T08:10:09.831247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533717877705810:10044]
2025-10-02T08:10:09.831290Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:09.831299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:09.831304Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:09.831304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.831307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:09.831461Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:09.883968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533717877705847:9858]
2025-10-02T08:10:09.884123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 823, pipe: [1:7556533717877705847:9858]
2025-10-02T08:10:09.976072Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:09.976719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:09.976767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533717877705847:9858], now have 1 active actors on pipe
2025-10-02T08:10:09.976785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:09.980304Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:09.980495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:09.980507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0] Write session will restart in 0.005747s
2025-10-02T08:10:09.980531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0] Write session: Do CDS request
2025-10-02T08:10:09.980538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:09.976893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:09.976904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:09.976924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 824 reason: error at write: Disconnected sessionId: src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0
2025-10-02T08:10:09.977073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 824 sessionId: src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0 is DEAD
2025-10-02T08:10:09.977241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533717877705847:9858]
2025-10-02T08:10:09.987345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.987409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:09.987425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 825
2025-10-02T08:10:09.987598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:09.987628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:09.987637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:09.987641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:09.988015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 825 sessionId:  describe result for acl check
2025-10-02T08:10:09.988052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:09.988060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:09.988062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:09.988067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533717877706095:10052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:09.988565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533717877706095:10052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:09.992725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:09.993244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:09.993431Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:09.993439Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:09.993449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:09.993489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:09.993525Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533717877706124:10051]
2025-10-02T08:10:09.994246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:09.994424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:09.994458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:09.994767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:09.994804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.994810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.994811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.994812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.994814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.994819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.994829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.994833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.994837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.994845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.994850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.994862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:09.994871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.994881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:09.994890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.994899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:09.994904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.994913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:09.994926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.994931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:09.994941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533717877706095:10052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:09.994949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:10.001589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533717877706095:10052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:10.001611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533717877706095:10052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:10.001615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533717877706095:10052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:10.001624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:10.003889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:10.005688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:10.005706Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:10.005710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:10.005713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:10.005720Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 824 [1:7556533717877706124:10051]
2025-10-02T08:10:10.005731Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:10.005749Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:10.005752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.005755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.005757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.005773Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:10.005778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:10.005785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:10.005843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.005850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.005853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:10.005856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:10.005922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:10.005933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.005947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.005959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:10.005978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533718337842796:2378], now have 1 active actors on pipe
2025-10-02T08:10:10.005986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172673451:10052], now have 1 active actors on pipe
2025-10-02T08:10:10.005993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533717877706112:10051]
2025-10-02T08:10:10.005995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533717877706112:10051]
2025-10-02T08:10:10.006002Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:10.006019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:10.006019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 824
2025-10-02T08:10:10.006023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:10.006026Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:10.006037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:10.006041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:10.006037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 824
2025-10-02T08:10:10.006075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.006084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.006098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533717877706112:10051]
2025-10-02T08:10:10.006106Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:10.006114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:10.006141Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|390d6175-1a3b323e-838735f0-b8453a21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:10.006152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.006160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.006162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:10.006171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.006184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:10.006214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.006268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.006274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.006286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.006321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 825 partition: 0 MaxSeqNo: 17 sessionId: src_id|390d6175-1a3b323e-838735f0-b8453a21_0
2025-10-02T08:10:10.006664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963410d0-b2ff932e-8b2451ac-40aa2053_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|390d6175-1a3b323e-838735f0-b8453a21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:10.009547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|390d6175-1a3b323e-838735f0-b8453a21_0] Write session: try to update token
2025-10-02T08:10:10.009562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|390d6175-1a3b323e-838735f0-b8453a21_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:10.024925Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:10.024945Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:10.024948Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:10.024957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533717877706112:10051]
2025-10-02T08:10:10.024962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533717877706112:10051]
2025-10-02T08:10:10.025008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:10.025013Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:10.025015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.025016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:10.025019Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:10.025168Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:10.025730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId: src_id|390d6175-1a3b323e-838735f0-b8453a21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:10.028658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:10.077499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533722172673464:9858]
2025-10-02T08:10:10.077598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 824, pipe: [1:7556533722172673464:9858]
2025-10-02T08:10:10.184307Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:10.184795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.184822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.184867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172673464:9858], now have 1 active actors on pipe
2025-10-02T08:10:10.184963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533722172673464:9858]
2025-10-02T08:10:10.184984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:10.184990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:10.185051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 825 reason: error at write: Disconnected sessionId: src_id|390d6175-1a3b323e-838735f0-b8453a21_0
2025-10-02T08:10:10.185082Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:10.185115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:10.185233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 825 sessionId: src_id|390d6175-1a3b323e-838735f0-b8453a21_0 is DEAD
2025-10-02T08:10:10.185397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390d6175-1a3b323e-838735f0-b8453a21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:10.185410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390d6175-1a3b323e-838735f0-b8453a21_0] Write session will restart in 0.008352s
2025-10-02T08:10:10.185441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390d6175-1a3b323e-838735f0-b8453a21_0] Write session: Do CDS request
2025-10-02T08:10:10.185449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390d6175-1a3b323e-838735f0-b8453a21_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:10.195338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|390d6175-1a3b323e-838735f0-b8453a21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:10.195424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:10.195450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 826
2025-10-02T08:10:10.195555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:10.195585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:10.195594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:10.195598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:10.195942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 826 sessionId:  describe result for acl check
2025-10-02T08:10:10.195970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:10.195972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:10.195973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:10.195978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533722172673705:10058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:10.196374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533722172673705:10058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:10.198155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533722172673705:10058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:10.199316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:10.199757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:10.200046Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:10.200056Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:10.200065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:10.200099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:10.200134Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533722172673747:10057]
2025-10-02T08:10:10.200841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:10.200892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533722172673705:10058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:10.200906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533722172673705:10058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:10.200914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533722172673705:10058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:10.200923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:10.200985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:10.201019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:10.201315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:10.201348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.201353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.201355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.201356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.201357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.201362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.201371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.201379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.201383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.201391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.201396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.201407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.201415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.201420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.201429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.201435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.201443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.201448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.201457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.201466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.201490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:10.210148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:10.211656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:10.211676Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:10.211678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:10.211682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:10.211688Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 825 [1:7556533722172673747:10057]
2025-10-02T08:10:10.211699Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:10.211716Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:10.211724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.211727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.211729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.211745Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:10.211749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:10.211759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:10.211827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.211834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.211837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:10.211840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:10.211906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:10.211915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.211927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.211939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:10.211955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533722172673741:10057]
2025-10-02T08:10:10.211962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533722172673741:10057]
2025-10-02T08:10:10.211969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:10.211981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172673756:10058], now have 1 active actors on pipe
2025-10-02T08:10:10.211988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:10.211991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:10.211992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 825
2025-10-02T08:10:10.211994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:10.212000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:10.212003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:10.212031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533722632810097:2378], now have 1 active actors on pipe
2025-10-02T08:10:10.212035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.212039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.212052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533722172673741:10057]
2025-10-02T08:10:10.212059Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:10.212072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:10.212082Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:10.212087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.212091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.212093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:10.212104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.212085Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 825
2025-10-02T08:10:10.212111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:10.212129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.212183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.212190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.212201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.212239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 826 partition: 0 MaxSeqNo: 17 sessionId: src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0
2025-10-02T08:10:10.216923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|390d6175-1a3b323e-838735f0-b8453a21_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:10.219670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0] Write session: try to update token
2025-10-02T08:10:10.219693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:10.246448Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:10.246471Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:10.246475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:10.246484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533722172673741:10057]
2025-10-02T08:10:10.246489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533722172673741:10057]
2025-10-02T08:10:10.246542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:10.246554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.246557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:10.246719Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:10.250349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId: src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:10.252915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:10.252940Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:10.253432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:10.288050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533722172673778:9858]
2025-10-02T08:10:10.288360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 825, pipe: [1:7556533722172673778:9858]
2025-10-02T08:10:10.424539Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:10.424791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.424816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.424856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172673778:9858], now have 1 active actors on pipe
2025-10-02T08:10:10.424967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533722172673778:9858]
2025-10-02T08:10:10.424992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:10.425000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:10.425066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 826 reason: error at write: Disconnected sessionId: src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0
2025-10-02T08:10:10.425074Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:10.425235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 826 sessionId: src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0 is DEAD
2025-10-02T08:10:10.425384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:10.425391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0] Write session will restart in 0.005638s
2025-10-02T08:10:10.425414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0] Write session: Do CDS request
2025-10-02T08:10:10.425424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:10.425955Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:10.432386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:10.432422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:10.432435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 827
2025-10-02T08:10:10.432616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:10.432647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:10.432656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:10.432660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:10.433143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 827 sessionId:  describe result for acl check
2025-10-02T08:10:10.433180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:10.433182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:10.433183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:10.433188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533722172673994:10064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:10.433684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533722172673994:10064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:10.435600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533722172673994:10064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:10.437914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:10.438257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:10.438367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533722172673994:10064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:10.438376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533722172673994:10064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:10.438378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533722172673994:10064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:10.438384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:10.438520Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:10.438529Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:10.438539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:10.438588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:10.438626Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533722172674070:10063]
2025-10-02T08:10:10.439197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:10.439349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:10.439387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:10.439612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:10.439640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.439641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.439641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.439642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.439643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.439646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.439652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.439654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.439656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.439658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.439661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.439665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.439668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.439671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.439673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.439676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.439687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.439692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.439695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.439700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.439717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:10.447609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:10.449374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:10.449389Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:10.449391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:10.449394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:10.449401Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 826 [1:7556533722172674070:10063]
2025-10-02T08:10:10.449412Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:10.449428Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:10.449430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.449433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.449435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.449450Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:10.449460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:10.449466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:10.449523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.449531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.449534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:10.449537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:10.449602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:10.449610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.449622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.449635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:10.449644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 826
2025-10-02T08:10:10.449656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172674068:10064], now have 1 active actors on pipe
2025-10-02T08:10:10.449659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533722632810104:2378], now have 1 active actors on pipe
2025-10-02T08:10:10.449663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.449668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.449687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533722172674060:10063]
2025-10-02T08:10:10.449690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533722172674060:10063]
2025-10-02T08:10:10.449703Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:10.449715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:10.449726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:10.449701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 826
2025-10-02T08:10:10.449728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:10.449737Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:10.449740Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:10.449741Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:10.449746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.449750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.449752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:10.449760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.449768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:10.449801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533722172674060:10063]
2025-10-02T08:10:10.449813Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:10.449830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.449835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:10.449873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.449879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.449890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.449922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 827 partition: 0 MaxSeqNo: 17 sessionId: src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0
2025-10-02T08:10:10.450256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c963dc0a-bfc0d7e5-dafe62b8-eb879449_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:10.452826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0] Write session: try to update token
2025-10-02T08:10:10.452838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:10.460781Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:10.460829Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:10.460838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533722172674060:10063]
2025-10-02T08:10:10.460878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:10.460878Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:10.461057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:10.461207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:10.461348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:10.461486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:10.461854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:10.461895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:10.471577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId: src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:10.474461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:10.474538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.474555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.474589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:10.474605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:10.474660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.474665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.474802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.474865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.474931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.474991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.475039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.475046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.475121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.475184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.475244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.475312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.475359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.475365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.475427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.475498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.475559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.475621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.475671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.475676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.475733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.475789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.475847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.475910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.475961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.475969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.476031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.476091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.476152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.476214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.476262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.476267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.476330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.476397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.476459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.476522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.476571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.476576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.476640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.476697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.476761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.476854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.476911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.476919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.477010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.477091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.477162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.477234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.477289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.477297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.477376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.477450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.477524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.477599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.477648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.477655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.477731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.477801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.477874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.477947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.477999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.478006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.478063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:10.478131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.478153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.478159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:10.478189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:10.478210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:10.478213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:10.478217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:10.478219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:10.478692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:10.478720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:10.478732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:10.478735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:10.478738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:10.478741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:10.479388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:10.479414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:10.479420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:10.479423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:10.479426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:10.479430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:10.480011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:10.480038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:10.480043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:10.480051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:10.480054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:10.481386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:10.481407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:10.481421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392610477
2025-10-02T08:10:10.481549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:10.481563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:10.481568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:10.481572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:10.481576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:10.481579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:10.482055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:10.482075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:10.482083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:10.482086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:10.482089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:10.482091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:10.482567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:10.482584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:10.482590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:10.482592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:10.482595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:10.482599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:10.483070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:10.483090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:10.483095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:10.484222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:10.484237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:10.484243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:10.484246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:10.484254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392610477
2025-10-02T08:10:10.484558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:10.484578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:10.484583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:10.484586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:10.484590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:10.484594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:10.485072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:10.485096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:10.485102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:10.485105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:10.485108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:10.485114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:10.485576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:10.485586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.485679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392610485
2025-10-02T08:10:10.488224Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:10.488236Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:10.488241Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:10.488245Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:10.488253Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:10.488254Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:10.488255Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:10.488263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533722172674060:10063]
2025-10-02T08:10:10.488266Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533722172674060:10063]
2025-10-02T08:10:10.488299Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:10.488303Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:10.488325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:10.488332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.488333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:10.488472Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:10.525011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533722172674138:9858]
2025-10-02T08:10:10.525105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 826, pipe: [1:7556533722172674138:9858]
2025-10-02T08:10:10.624193Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:10.624616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172674138:9858], now have 1 active actors on pipe
2025-10-02T08:10:10.624740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533722172674138:9858]
2025-10-02T08:10:10.624759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:10.624765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:10.624789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 827 reason: error at write: Disconnected sessionId: src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0
2025-10-02T08:10:10.624876Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:10.625006Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:10.625153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:10.625167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0] Write session will restart in 0.005036s
2025-10-02T08:10:10.624986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 827 sessionId: src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0 is DEAD
2025-10-02T08:10:10.625190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0] Write session: Do CDS request
2025-10-02T08:10:10.625197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:10.631457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:10.631574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:10.631592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 828
2025-10-02T08:10:10.631787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:10.631821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:10.631831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:10.631836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:10.632376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 828 sessionId:  describe result for acl check
2025-10-02T08:10:10.632413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:10.632415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:10.632416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:10.632422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533722172674165:10083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:10.632905Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:826:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:10.632990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533722172674165:10083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:10.633014Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [08ad0f406ff41210] Result# TEvPutResult {Id# [72075186224037892:826:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:10.633046Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:826:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:10.635402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533722172674165:10083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:10.645785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:10.648366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533722172674165:10083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:10.648388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533722172674165:10083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:10.648391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533722172674165:10083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:10.648401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:10.649464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:10.649681Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:10.649692Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:10.649701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:10.649752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:10.649791Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533722172674434:10082]
2025-10-02T08:10:10.650484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:10.650721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:10.650776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:10.651087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:10.651131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.651136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.651138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.651139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.651140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.651145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.651155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.651159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.651163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.651166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.651172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.651178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.651185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.651189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.651194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.651199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.651204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.651209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.651213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.651227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.651246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:10.660913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:10.662503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:10.662526Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:10.662529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:10.662533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:10.662540Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 827 [1:7556533722172674434:10082]
2025-10-02T08:10:10.662552Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:10.662569Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:10.662572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.662575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.662577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.662595Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:10.662606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:10.662613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:10.662680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.662688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.662691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:10.662694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:10.662764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:10.662774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.662787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.662799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:10.662817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172674429:10083], now have 1 active actors on pipe
2025-10-02T08:10:10.662824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533722172674422:10082]
2025-10-02T08:10:10.662833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533722172674422:10082]
2025-10-02T08:10:10.662846Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:10.662858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:10.662863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:10.662868Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:10.662877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:10.662880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:10.662886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533722632810148:2378], now have 1 active actors on pipe
2025-10-02T08:10:10.662917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533722172674422:10082]
2025-10-02T08:10:10.662931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:10.662947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:10.662973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 827
2025-10-02T08:10:10.663041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.663049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.663073Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6deee94-a478b651-895bca6b-97ed8bd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:10.663084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.663088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.663094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:10.663103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.663116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:10.663134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.663171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.663177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.663189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.663224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 828 partition: 0 MaxSeqNo: 17 sessionId: src_id|6deee94-a478b651-895bca6b-97ed8bd9_0
2025-10-02T08:10:10.663626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1099cf60-9bb664ce-8dec81a1-4b374c60_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6deee94-a478b651-895bca6b-97ed8bd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:10.664925Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 827
2025-10-02T08:10:10.666466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6deee94-a478b651-895bca6b-97ed8bd9_0] Write session: try to update token
2025-10-02T08:10:10.666483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6deee94-a478b651-895bca6b-97ed8bd9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:10.686976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId: src_id|6deee94-a478b651-895bca6b-97ed8bd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:10.689533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:10.689594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.689605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.689638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:10.689658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:10.689725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.689735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.689924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.689999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.690086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.690194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.690444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.690454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.690528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.690596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.690666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.690738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.690789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.690800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.690874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.690943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.691015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.691091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.691159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.691167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.691235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.691311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.691378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.691467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.691522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.691529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.691599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.691675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.691745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.691820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.691872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.691884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.691957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.692019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.692086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.692168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.692218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.692222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.692296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.692358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.692423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.692495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.692534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.692537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.692610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.692673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.692758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.692928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.692985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.692993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.693065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.693141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.693213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.693282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.693329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.693337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.693408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:10.693473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:10.693547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:10.693619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:10.693681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:10.693689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:10.693752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:10.693825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.693845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.693847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:10.693877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:10.693889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:10.693893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:10.693896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:10.693899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:10.694336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:10.694358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:10.694365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:10.694368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:10.694371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:10.694374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:10.695092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:10.695106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:10.695112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:10.695115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:10.695118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:10.695122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:10.695684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:10.695699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:10.695706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:10.695710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:10.695716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:10.697426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:10.697449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:10.697462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392610697
2025-10-02T08:10:10.697598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:10.697612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:10.697618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:10.697622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:10.697626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:10.697630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:10.698243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:10.698264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:10.698270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:10.698275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:10.698279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:10.698282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:10.698834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:10.698855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:10.698864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:10.698871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:10.698877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:10.698884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:10.699412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:10.699432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:10.699452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:10.700745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:10.700764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:10.700769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:10.700773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:10.700781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392610700
2025-10-02T08:10:10.701153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:10.701172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:10.701181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:10.701185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:10.701188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:10.701194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:10.701717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:10.701741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:10.701753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:10.701757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:10.701760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:10.701764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:10.702301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:10.702323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.702439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392610702
2025-10-02T08:10:10.705147Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:10.705178Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:10.705185Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:10.705192Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:10.705203Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:10.705206Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:10.705208Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:10.705215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533722172674422:10082]
2025-10-02T08:10:10.705218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533722172674422:10082]
2025-10-02T08:10:10.706278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:10.706297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.706299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:10.706450Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:10.710405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:10.710421Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:10.724695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533722172674471:9858]
2025-10-02T08:10:10.724833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 827, pipe: [1:7556533722172674471:9858]
2025-10-02T08:10:10.847802Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:10.848460Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:10.848464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:10.848475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533722172674422:10082]
2025-10-02T08:10:10.848543Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:10.848553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172674471:9858], now have 1 active actors on pipe
2025-10-02T08:10:10.848856Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:10.848783Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:10.848796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533722172674471:9858]
2025-10-02T08:10:10.848835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:10.848872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 828 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6deee94-a478b651-895bca6b-97ed8bd9_0
2025-10-02T08:10:10.849071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 828 sessionId: src_id|6deee94-a478b651-895bca6b-97ed8bd9_0 is DEAD
2025-10-02T08:10:10.849197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deee94-a478b651-895bca6b-97ed8bd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:10.849211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deee94-a478b651-895bca6b-97ed8bd9_0] Write session will restart in 0.007910s
2025-10-02T08:10:10.849239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deee94-a478b651-895bca6b-97ed8bd9_0] Write session: Do CDS request
2025-10-02T08:10:10.849247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deee94-a478b651-895bca6b-97ed8bd9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:10.853896Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [3e38132a322dc535] Result# TEvPutResult {Id# [72075186224037892:827:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:10.853958Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:827:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:10.854038Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:827:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:10.858411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6deee94-a478b651-895bca6b-97ed8bd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:10.860670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:10.860690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 829
2025-10-02T08:10:10.861628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:10.861671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:10.861680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:10.861683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:10.862082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 829 sessionId:  describe result for acl check
2025-10-02T08:10:10.862113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:10.862121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:10.862123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:10.862128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533722172674645:10090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:10.864965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533722172674645:10090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:10.867838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:10.867919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533722172674645:10090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:10.871220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:10.871476Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:10.871480Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:10.871493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:10.871561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:10.871593Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533722172674763:10089]
2025-10-02T08:10:10.871670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533722172674645:10090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:10.871678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533722172674645:10090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:10.871682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533722172674645:10090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:10.871690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:10.872264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:10.872510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:10.872559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:10.872929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:10.872980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.872981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.872982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.872984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.872985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.872990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.873003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.873007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.873011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.873015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.873021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.873028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:10.873033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.873038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:10.873043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.873048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:10.873053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.873058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.873063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.873069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.873087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:10.884601Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 828
2025-10-02T08:10:10.882345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:10.884197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:10.884203Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:10.884206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:10.884210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:10.884217Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 828 [1:7556533722172674763:10089]
2025-10-02T08:10:10.884228Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:10.884246Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:10.884248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.884251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.884253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.884270Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:10.884275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:10.884282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:10.884352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.884354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.884357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:10.884359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:10.884424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:10.884426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.884439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:10.884449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:10.884463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533722172674747:10089]
2025-10-02T08:10:10.884465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533722172674747:10089]
2025-10-02T08:10:10.884471Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:10.884483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:10.884492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:10.884494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 828
2025-10-02T08:10:10.884496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:10.884496Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:10.884498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:10.884507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172674768:10090], now have 1 active actors on pipe
2025-10-02T08:10:10.884539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533722632810155:2378], now have 1 active actors on pipe
2025-10-02T08:10:10.884544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.884547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.884559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533722172674747:10089]
2025-10-02T08:10:10.884569Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:10.884580Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:10.884594Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:10.884600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:10.884604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:10.884605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:10.884612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:10.884623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:10.884646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.885048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:10.885058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:10.885075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:10.885129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 829 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0
2025-10-02T08:10:10.885495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deee94-a478b651-895bca6b-97ed8bd9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:10.888246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0] Write session: try to update token
2025-10-02T08:10:10.888264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:10.903989Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:10.904009Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:10.904012Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:10.904021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533722172674747:10089]
2025-10-02T08:10:10.904025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533722172674747:10089]
2025-10-02T08:10:10.904068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:10.904080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:10.904082Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:10.904087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:10.904091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:10.904220Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:10.905872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId: src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:10.908356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:10.948966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533722172674794:9858]
2025-10-02T08:10:10.949375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 828, pipe: [1:7556533722172674794:9858]
2025-10-02T08:10:11.052388Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:11.052869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.052881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.052918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533722172674794:9858], now have 1 active actors on pipe
2025-10-02T08:10:11.053326Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:11.053627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533722172674794:9858]
2025-10-02T08:10:11.053643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:11.053693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 829 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0
2025-10-02T08:10:11.053860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 829 sessionId: src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0 is DEAD
2025-10-02T08:10:11.054147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:11.054163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0] Write session will restart in 0.006691s
2025-10-02T08:10:11.054191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0] Write session: Do CDS request
2025-10-02T08:10:11.054201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:11.060886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:11.062421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.062941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:11.062968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 830
2025-10-02T08:10:11.063318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.063353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:11.063358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:11.063362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:11.066255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 830 sessionId:  describe result for acl check
2025-10-02T08:10:11.066293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:11.066294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:11.066296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:11.066302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533726467642131:10097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:11.066838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533726467642131:10097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:11.073876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533726467642131:10097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:11.081541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533726467642131:10097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:11.081568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533726467642131:10097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:11.081571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533726467642131:10097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:11.081581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:11.083939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:11.085974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:11.086173Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:11.086182Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:11.086191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:11.086241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:11.086280Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533726467642387:10096]
2025-10-02T08:10:11.086745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:11.086928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:11.086957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:11.088977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:11.089053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.089054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.089055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.089056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.089058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.089064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.089073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.089077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.089080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.089084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.089089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.089097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.089103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.089108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.089113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.089118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.089122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.089127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.089132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.089136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.089155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:11.100401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:11.102539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:11.102547Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:11.102549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:11.102553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:11.102560Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 829 [1:7556533726467642387:10096]
2025-10-02T08:10:11.102573Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:11.102591Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:11.102595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.102597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.102600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.102618Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:11.102623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:11.102630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:11.102702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.102705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.102710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:11.102713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:11.102792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:11.102794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.102809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.102822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:11.102839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533726467642381:10096]
2025-10-02T08:10:11.102841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533726467642381:10096]
2025-10-02T08:10:11.102856Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:11.102869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:11.102883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:11.102885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:11.102920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533726467642381:10096]
2025-10-02T08:10:11.102922Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:11.102941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533726467642366:10097], now have 1 active actors on pipe
2025-10-02T08:10:11.102965Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:11.102969Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:11.102976Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:11.102980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 829
2025-10-02T08:10:11.103373Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 829
2025-10-02T08:10:11.103222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533726927777460:2378], now have 1 active actors on pipe
2025-10-02T08:10:11.103239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.103245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.103272Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:11.103280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.103285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.103287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:11.103298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.103309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:11.103326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:11.103670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.103678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.103706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:11.103740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 830 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0
2025-10-02T08:10:11.105685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca519d8-c6f6071d-77cf9b5e-1e8ac845_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:11.108321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0] Write session: try to update token
2025-10-02T08:10:11.108343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:11.129279Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:11.129300Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:11.129303Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:11.129313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533726467642381:10096]
2025-10-02T08:10:11.129318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533726467642381:10096]
2025-10-02T08:10:11.129367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:11.129375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.129378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:11.129388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:11.129395Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:11.129537Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:11.133113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId: src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:11.136180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:11.153193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533726467642412:9858]
2025-10-02T08:10:11.153409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 829, pipe: [1:7556533726467642412:9858]
2025-10-02T08:10:11.279657Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:11.280090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.280103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.280142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533726467642412:9858], now have 1 active actors on pipe
2025-10-02T08:10:11.280284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533726467642412:9858]
2025-10-02T08:10:11.280316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:11.280323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:11.280376Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:11.280385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 830 reason: error at write: Disconnected sessionId: src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0
2025-10-02T08:10:11.280391Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:11.280583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 830 sessionId: src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0 is DEAD
2025-10-02T08:10:11.281006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:11.281024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0] Write session will restart in 0.009475s
2025-10-02T08:10:11.281056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0] Write session: Do CDS request
2025-10-02T08:10:11.281064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:11.291529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.291689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:11.291706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 831
2025-10-02T08:10:11.291845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.291884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:11.291889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:11.291892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:11.292380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 831 sessionId:  describe result for acl check
2025-10-02T08:10:11.292407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:11.292408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:11.292410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:11.292416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533726467642655:10103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:11.293071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533726467642655:10103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:11.294900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:11.295751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533726467642655:10103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:11.297013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:11.297193Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:11.297197Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:11.297208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:11.297268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:11.297302Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533726467642705:10102]
2025-10-02T08:10:11.297995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:11.298246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:11.298303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:11.298421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533726467642655:10103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:11.298434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533726467642655:10103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:11.298437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533726467642655:10103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:11.298446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:11.298639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:11.298679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.298684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.298684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.298685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.298686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.298690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.298698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.298702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.298705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.298708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.298713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.298721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.298732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.298737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.298746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.298751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.298755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.298760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.298764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.298774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.298791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:11.309176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:11.310759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:11.310775Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:11.310777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:11.310781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:11.310786Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 830 [1:7556533726467642705:10102]
2025-10-02T08:10:11.310795Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:11.310810Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:11.310813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.310815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.310816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.310829Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:11.310832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:11.310837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:11.310906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.310915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.310918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:11.310921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:11.310973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:11.310979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.310988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.310999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:11.311011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533726467642687:10102]
2025-10-02T08:10:11.311017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533726467642687:10102]
2025-10-02T08:10:11.311024Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:11.311035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:11.311052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:11.311053Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:11.311053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 830
2025-10-02T08:10:11.311057Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:11.311061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:11.311070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533726467642716:10103], now have 1 active actors on pipe
2025-10-02T08:10:11.311106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533726927777465:2378], now have 1 active actors on pipe
2025-10-02T08:10:11.311115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.311120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.311132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533726467642687:10102]
2025-10-02T08:10:11.311142Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:11.311149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:11.311165Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62a2ac6e-d913c98d-41840986-6f91e370_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:11.311176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.311180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.311182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:11.311192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.311206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:11.311196Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 830
2025-10-02T08:10:11.311232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:11.311310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.311323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.311364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:11.311420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 831 partition: 0 MaxSeqNo: 17 sessionId: src_id|62a2ac6e-d913c98d-41840986-6f91e370_0
2025-10-02T08:10:11.311779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec0c56d9-56312010-ba2a6a41-3194d0a0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|62a2ac6e-d913c98d-41840986-6f91e370_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:11.314594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62a2ac6e-d913c98d-41840986-6f91e370_0] Write session: try to update token
2025-10-02T08:10:11.314616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62a2ac6e-d913c98d-41840986-6f91e370_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:11.331707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId: src_id|62a2ac6e-d913c98d-41840986-6f91e370_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:11.334823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:11.335254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.335265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.335304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:11.335332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:11.335503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.335507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.335706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.335792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.335878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.335968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.336020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.336025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.336166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.336245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.336384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.336482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.336541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.336544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.336641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.336718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.336796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.336910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.336968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.336973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.337062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.337157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.337239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.337343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.337399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.337403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.337493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.337571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.337653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.337732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.337785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.337789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.337880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.337958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.338041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.338125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.338179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.338182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.338270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.338347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.338434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.338515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.338568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.338575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.338660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.338743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.338834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.338922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.338983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.338986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.339073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.339152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.339236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.339319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.339374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.339378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.339487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:11.339572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:11.339655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:11.339739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:11.339793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:11.339797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:11.339881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:11.339960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.339984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.339987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:11.340023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:11.340040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:11.340044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:11.340048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:11.340051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:11.340615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:11.340637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:11.340644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:11.340651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:11.340656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:11.340662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:11.345861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:11.345930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:11.345944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:11.345949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:11.345954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:11.345959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:11.346882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:11.346902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:11.346910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:11.346914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:11.346919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:11.353919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:11.353955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:11.353979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392611353
2025-10-02T08:10:11.354153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:11.354178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:11.354194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:11.354204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:11.354215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:11.354220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:11.354880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:11.354912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:11.354927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:11.354932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:11.354947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:11.354952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:11.355788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:11.355819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:11.355830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:11.355835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:11.355839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:11.355844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:11.356592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:11.356621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:11.356629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:11.358295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:11.358327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:11.358335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:11.358340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:11.358354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392611355
2025-10-02T08:10:11.358836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:11.358868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:11.358876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:11.358880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:11.358885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:11.358888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:11.359580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:11.359605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:11.359611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:11.359616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:11.359621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:11.359625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:11.360297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:11.360310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.360443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392611355
2025-10-02T08:10:11.363812Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:11.363848Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:11.363857Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:11.363866Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:11.363909Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:11.363912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:11.363915Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:11.363926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533726467642687:10102]
2025-10-02T08:10:11.363932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533726467642687:10102]
2025-10-02T08:10:11.364006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:11.364016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:11.370240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:11.370259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.370261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:11.370394Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:11.380573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533726467642736:9858]
2025-10-02T08:10:11.380831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 830, pipe: [1:7556533726467642736:9858]
2025-10-02T08:10:11.522855Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:11.523380Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:11.523384Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:11.523399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533726467642687:10102]
2025-10-02T08:10:11.523462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533726467642736:9858], now have 1 active actors on pipe
2025-10-02T08:10:11.524965Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:11.528894Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:11.529117Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:11.529522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:11.529553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 831 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62a2ac6e-d913c98d-41840986-6f91e370_0
2025-10-02T08:10:11.529759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 831 sessionId: src_id|62a2ac6e-d913c98d-41840986-6f91e370_0 is DEAD
2025-10-02T08:10:11.529943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533726467642736:9858]
2025-10-02T08:10:11.530576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a2ac6e-d913c98d-41840986-6f91e370_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:11.530596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a2ac6e-d913c98d-41840986-6f91e370_0] Write session will restart in 0.008557s
2025-10-02T08:10:11.530644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a2ac6e-d913c98d-41840986-6f91e370_0] Write session: Do CDS request
2025-10-02T08:10:11.530652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a2ac6e-d913c98d-41840986-6f91e370_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:11.540419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62a2ac6e-d913c98d-41840986-6f91e370_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.541056Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [aa71b9815832b9ad] Result# TEvPutResult {Id# [72075186224037892:830:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:11.541134Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:830:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:11.541209Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:830:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:11.543330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:11.543342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 832
2025-10-02T08:10:11.545285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.545334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:11.545340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:11.545344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:11.546558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 832 sessionId:  describe result for acl check
2025-10-02T08:10:11.546610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:11.546612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:11.546614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:11.546620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533726467642803:10116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:11.547241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533726467642803:10116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:11.558985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533726467642803:10116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:11.559191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:11.561695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:11.561896Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:11.561908Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:11.561917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:11.561959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:11.561993Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533726467643058:10115]
2025-10-02T08:10:11.562596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:11.563010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533726467642803:10116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:11.563026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533726467642803:10116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:11.563029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533726467642803:10116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:11.563037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:11.563142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:11.563179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:11.563480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:11.563519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.563524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.563525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.563526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.563527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.563532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.563540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.563544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.563547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.563550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.563555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.563563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.563572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.563576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.563584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.563588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.563592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.563596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.563608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.563612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.563627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:11.576690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:11.578642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:11.578664Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:11.578666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:11.578669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:11.578675Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 831 [1:7556533726467643058:10115]
2025-10-02T08:10:11.578685Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:11.578701Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:11.578705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.578708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.578710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.578725Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:11.578730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:11.578736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:11.578804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.578812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.578815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:11.578818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:11.578884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:11.578893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.578908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.578926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:11.578947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533726467643042:10115]
2025-10-02T08:10:11.578953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533726467643042:10115]
2025-10-02T08:10:11.578961Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:11.578974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:11.578992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:11.578992Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:11.578994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 831
2025-10-02T08:10:11.578995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:11.578999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:11.579009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533726467643067:10116], now have 1 active actors on pipe
2025-10-02T08:10:11.579039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533726467643042:10115]
2025-10-02T08:10:11.579046Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:11.579051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533726927777488:2378], now have 1 active actors on pipe
2025-10-02T08:10:11.579056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.579061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.579103Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:11.579114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.579118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.579119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:11.579120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:11.579130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.579144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:11.579167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:11.579266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.579280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.579302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:11.579343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 832 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0
2025-10-02T08:10:11.579750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a2ac6e-d913c98d-41840986-6f91e370_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:11.581057Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 831
2025-10-02T08:10:11.582546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0] Write session: try to update token
2025-10-02T08:10:11.582563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:11.600219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId: src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:11.601987Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:11.602017Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:11.602021Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:11.602033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533726467643042:10115]
2025-10-02T08:10:11.602040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533726467643042:10115]
2025-10-02T08:10:11.602102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:11.602119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.602123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:11.602308Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:11.602823Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:11.602844Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:11.603412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:11.629912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533726467643113:9858]
2025-10-02T08:10:11.630014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 831, pipe: [1:7556533726467643113:9858]
2025-10-02T08:10:11.758784Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:11.759348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.759386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.759434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533726467643113:9858], now have 1 active actors on pipe
2025-10-02T08:10:11.759658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533726467643113:9858]
2025-10-02T08:10:11.759685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:11.759687Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:11.759693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:11.759751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 832 reason: error at write: Disconnected sessionId: src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0
2025-10-02T08:10:11.759938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 832 sessionId: src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0 is DEAD
2025-10-02T08:10:11.760056Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:11.760431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:11.760449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0] Write session will restart in 0.009804s
2025-10-02T08:10:11.760486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0] Write session: Do CDS request
2025-10-02T08:10:11.760494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:11.776082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.779832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:11.779893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 833
2025-10-02T08:10:11.780119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.780155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:11.780165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:11.780170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:11.780644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 833 sessionId:  describe result for acl check
2025-10-02T08:10:11.780678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:11.780679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:11.780681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:11.780687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533726467643289:10129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:11.781267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533726467643289:10129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:11.786543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533726467643289:10129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:11.793539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:11.793931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533726467643289:10129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:11.793946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533726467643289:10129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:11.793948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533726467643289:10129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:11.793955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:11.794077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:11.794238Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:11.794241Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:11.794251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:11.794300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:11.794333Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533726467643427:10128]
2025-10-02T08:10:11.794808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:11.795010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:11.795043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:11.795319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:11.795359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.795360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.795362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.795363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.795364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.795369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.795379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.795384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.795387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.795390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.795394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.795398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:11.795402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.795405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:11.795409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.795414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:11.795418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.795422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.795426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.795430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.795459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:11.809627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:11.811579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:11.811598Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:11.811601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:11.811606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:11.811613Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 832 [1:7556533726467643427:10128]
2025-10-02T08:10:11.811625Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:11.811644Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:11.811648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.811651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.811653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.811671Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:11.811677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:11.811685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:11.811764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.811774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.811777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:11.811780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:11.811849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:11.811856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.811872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:11.811890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:11.811912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533726467643416:10128]
2025-10-02T08:10:11.811918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533726467643416:10128]
2025-10-02T08:10:11.811933Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:11.811950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533726927777516:2378], now have 1 active actors on pipe
2025-10-02T08:10:11.811954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533726467643424:10129], now have 1 active actors on pipe
2025-10-02T08:10:11.811962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:11.811977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:11.811980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:11.812007Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:11.812012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:11.812014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533726467643416:10128]
2025-10-02T08:10:11.812016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:11.812020Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:11.812016Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 832
2025-10-02T08:10:11.812071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 832
2025-10-02T08:10:11.812085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.812089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.812113Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:11.812126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:11.812130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:11.812137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:11.812147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:11.812160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:11.812185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:11.812219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.812226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.812239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:11.812274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 833 partition: 0 MaxSeqNo: 17 sessionId: src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0
2025-10-02T08:10:11.813937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa16b30c-39da8c33-71c1f52e-32d900ac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:11.817849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0] Write session: try to update token
2025-10-02T08:10:11.817878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:11.837698Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:11.837720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:11.837723Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:11.837732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533726467643416:10128]
2025-10-02T08:10:11.837737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533726467643416:10128]
2025-10-02T08:10:11.837797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:11.837809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:11.837816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:11.837989Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:11.840865Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:11.840889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:11.857299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId: src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:11.860743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:11.860851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533726467643452:9858]
2025-10-02T08:10:11.861081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 832, pipe: [1:7556533726467643452:9858]
2025-10-02T08:10:11.980728Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:11.981209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:11.981227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:11.981250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533726467643452:9858], now have 1 active actors on pipe
2025-10-02T08:10:11.981365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533726467643452:9858]
2025-10-02T08:10:11.981402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:11.981405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:11.981470Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:11.981465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 833 reason: error at write: Disconnected sessionId: src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0
2025-10-02T08:10:11.981489Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:11.981652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 833 sessionId: src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0 is DEAD
2025-10-02T08:10:11.981796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:11.981804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0] Write session will restart in 0.006969s
2025-10-02T08:10:11.981829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0] Write session: Do CDS request
2025-10-02T08:10:11.981835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:11.993375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.995041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:11.996643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:11.996660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 834
2025-10-02T08:10:11.996866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:11.996906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:11.996916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:11.996919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:11.997313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 834 sessionId:  describe result for acl check
2025-10-02T08:10:11.997346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:11.997348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:11.997349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:11.997354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533726467643726:10137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:11.997926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533726467643726:10137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:12.000599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533726467643726:10137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:12.001297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:12.001533Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:12.001544Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:12.001555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:12.001613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:12.001654Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533730762611049:10135]
2025-10-02T08:10:12.002349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:12.002631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:12.002714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:12.003120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:12.003220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.003234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.003235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.003237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.003238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.003244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.003256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.003261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.003275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.003280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.003288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.003303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.003316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.003327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.003334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.003339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.003343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.003348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.003352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.003364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.003385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:12.006057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533726467643726:10137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:12.006072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533726467643726:10137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:12.006076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533726467643726:10137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:12.006084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:12.015365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:12.017498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:12.017507Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:12.017509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:12.017513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:12.017521Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 833 [1:7556533730762611049:10135]
2025-10-02T08:10:12.017535Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:12.017555Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:12.017558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.017561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.017564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.017585Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:12.017590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:12.017597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:12.017676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.017678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.017681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:12.017684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:12.017766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:12.017769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.017785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.017799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:12.017818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533726467643719:10135]
2025-10-02T08:10:12.017820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533726467643719:10135]
2025-10-02T08:10:12.017827Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:12.017841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762611066:10137], now have 1 active actors on pipe
2025-10-02T08:10:12.017847Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:12.017850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:12.017851Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:12.017865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:12.017868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:12.017875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533726927777526:2378], now have 1 active actors on pipe
2025-10-02T08:10:12.017910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533726467643719:10135]
2025-10-02T08:10:12.017913Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:12.017963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 833
2025-10-02T08:10:12.018024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:12.018093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.018097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.018122Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a033d774-84360ec7-c16e342-1d990dc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:12.018129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.018133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.018135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:12.018144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.018153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:12.018173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.018207Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 833
2025-10-02T08:10:12.018265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.018281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.018302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.018342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 834 partition: 0 MaxSeqNo: 17 sessionId: src_id|a033d774-84360ec7-c16e342-1d990dc0_0
2025-10-02T08:10:12.018767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4293fb70-b5e4d4e9-bd966c93-8f744818_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a033d774-84360ec7-c16e342-1d990dc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:12.021960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a033d774-84360ec7-c16e342-1d990dc0_0] Write session: try to update token
2025-10-02T08:10:12.021977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a033d774-84360ec7-c16e342-1d990dc0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:12.049448Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:12.049469Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:12.049472Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:12.049481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533726467643719:10135]
2025-10-02T08:10:12.049488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533726467643719:10135]
2025-10-02T08:10:12.049543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:12.049547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:12.049551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.049553Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:12.049554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:12.049698Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:12.054532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId: src_id|a033d774-84360ec7-c16e342-1d990dc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:12.065022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:12.081568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533730762611080:9858]
2025-10-02T08:10:12.081728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 833, pipe: [1:7556533730762611080:9858]
2025-10-02T08:10:12.211180Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:12.211613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.211622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.211643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762611080:9858], now have 1 active actors on pipe
2025-10-02T08:10:12.213100Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:12.213404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:12.213464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 834 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a033d774-84360ec7-c16e342-1d990dc0_0
2025-10-02T08:10:12.213645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 834 sessionId: src_id|a033d774-84360ec7-c16e342-1d990dc0_0 is DEAD
2025-10-02T08:10:12.213755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533730762611080:9858]
2025-10-02T08:10:12.213983Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:12.214137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a033d774-84360ec7-c16e342-1d990dc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:12.214154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a033d774-84360ec7-c16e342-1d990dc0_0] Write session will restart in 0.009511s
2025-10-02T08:10:12.214186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a033d774-84360ec7-c16e342-1d990dc0_0] Write session: Do CDS request
2025-10-02T08:10:12.214195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a033d774-84360ec7-c16e342-1d990dc0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:12.225573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a033d774-84360ec7-c16e342-1d990dc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:12.231365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:12.231393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 835
2025-10-02T08:10:12.231629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:12.231671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:12.231677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:12.231681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:12.232200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 835 sessionId:  describe result for acl check
2025-10-02T08:10:12.232246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:12.232248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:12.232251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:12.232258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533730762611345:10143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:12.233083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533730762611345:10143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:12.234832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:12.237208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:12.237443Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:12.237455Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:12.237465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:12.237517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:12.237558Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533730762611358:10141]
2025-10-02T08:10:12.238259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:12.239696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:12.239772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:12.240093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:12.240128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.240129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.240130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.240131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.240132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.240138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.240147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.240150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.240152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.240155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.240161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.240168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.240173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.240177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.240180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.240184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.240187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.240191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.240195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.240198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.240214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:12.243392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533730762611345:10143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:12.250265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533730762611345:10143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:12.250291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533730762611345:10143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:12.250295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533730762611345:10143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:12.250306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:12.250890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:12.253009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:12.253041Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:12.253045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:12.253049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:12.253058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 834 [1:7556533730762611358:10141]
2025-10-02T08:10:12.253073Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:12.253096Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:12.253099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.253102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.253105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.253124Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:12.253131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:12.253139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:12.253213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.253224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.253230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:12.253235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:12.253314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:12.253322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.253338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.253358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:12.253382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533730762611351:10141]
2025-10-02T08:10:12.253388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533730762611351:10141]
2025-10-02T08:10:12.253407Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:12.253425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:12.253446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:12.253454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:12.253500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533730762611351:10141]
2025-10-02T08:10:12.253508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:12.253518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:12.253530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533731222744828:2378], now have 1 active actors on pipe
2025-10-02T08:10:12.253530Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:12.253538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:12.253658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 834
2025-10-02T08:10:12.253726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762611397:10143], now have 1 active actors on pipe
2025-10-02T08:10:12.253697Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 834
2025-10-02T08:10:12.253740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.253744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.253771Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:12.253784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.253793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.253795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:12.253806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.253816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:12.253842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.253985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.253994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.254012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.254057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 835 partition: 0 MaxSeqNo: 17 sessionId: src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0
2025-10-02T08:10:12.254534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a033d774-84360ec7-c16e342-1d990dc0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:12.260627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0] Write session: try to update token
2025-10-02T08:10:12.260657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:12.283648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId: src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:12.288701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:12.288792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.288822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.288869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:12.288898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:12.289532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.289551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.289811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.289897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.289994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.290080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.290357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.290365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.290473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.290560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.290651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.290743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.290818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.290821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.290928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.291017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.291104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.291192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.291261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.291265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.291353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.291435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.292472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.292574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.292636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.292639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.292749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.293286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.293459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.293558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.293622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.293625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.293717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.293807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.294048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.294140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.294206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.294210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.294311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.294396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.294487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.294580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.294643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.294647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.294749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.294834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.294921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.295016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.295089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.295093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.295189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.295271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.295357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.295473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.295542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.295552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.295662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:12.295753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:12.295856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:12.296003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:12.296095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:12.296099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:12.296208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:12.296301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.296323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.296327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:12.296384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:12.296404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:12.296408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:12.296412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:12.296416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:12.296960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:12.296983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:12.296990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:12.296995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:12.296998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:12.297002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:12.297932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:12.297962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:12.297971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:12.297978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:12.297983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:12.297987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:12.298752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:12.298769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:12.298776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:12.298781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:12.298789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:12.300645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:12.300656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:12.300676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392612299
2025-10-02T08:10:12.302121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:12.302151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:12.302161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:12.302165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:12.302171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:12.302175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:12.302967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:12.302982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:12.302989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:12.302992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:12.302995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:12.302999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:12.303588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:12.303599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:12.303606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:12.303610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:12.303613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:12.303616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:12.304144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:12.304154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:12.304160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:12.308387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:12.308422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:12.308434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:12.308439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:12.308452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392612305
2025-10-02T08:10:12.308853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:12.308883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:12.308892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:12.308895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:12.308900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:12.308904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:12.309450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:12.309464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:12.309471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:12.309478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:12.309482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:12.309488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:12.310034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:12.310047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.310144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392612309
2025-10-02T08:10:12.313096Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:12.313127Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:12.313134Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:12.313141Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:12.313156Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:12.313159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:12.313162Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:12.313181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533730762611351:10141]
2025-10-02T08:10:12.313186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533730762611351:10141]
2025-10-02T08:10:12.313307Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:12.313324Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:12.314497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:12.314517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.314519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:12.314728Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:12.316110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533730762611414:9858]
2025-10-02T08:10:12.316848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 834, pipe: [1:7556533730762611414:9858]
2025-10-02T08:10:12.476396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:12.475511Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:12.475896Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:12.475900Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:12.475911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533730762611351:10141]
2025-10-02T08:10:12.475971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:12.476008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762611414:9858], now have 1 active actors on pipe
2025-10-02T08:10:12.476705Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:12.477028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533730762611414:9858]
2025-10-02T08:10:12.477048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:12.477074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 835 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0
2025-10-02T08:10:12.477246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 835 sessionId: src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0 is DEAD
2025-10-02T08:10:12.480916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:12.480937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0] Write session will restart in 0.005458s
2025-10-02T08:10:12.480985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0] Write session: Do CDS request
2025-10-02T08:10:12.480993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:12.485413Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [8baa6ac96658fdd5] Result# TEvPutResult {Id# [72075186224037892:834:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:12.485419Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:834:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:12.485478Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:834:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:12.488018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:12.489150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:12.489173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 836
2025-10-02T08:10:12.489355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:12.489390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:12.489400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:12.489403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:12.489943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 836 sessionId:  describe result for acl check
2025-10-02T08:10:12.489980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:12.489990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:12.489992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:12.489998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533730762611610:10148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:12.490536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533730762611610:10148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:12.494475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533730762611610:10148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:12.495743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:12.499179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:12.499765Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:12.499781Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:12.499800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:12.499885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:12.499932Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533730762611730:10147]
2025-10-02T08:10:12.500621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:12.501070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:12.501142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:12.501495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:12.501543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533730762611610:10148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:12.501552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533730762611610:10148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:12.501556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533730762611610:10148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:12.501559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.501560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.501561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.501562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.501564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.501566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:12.501569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.501580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.501583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.501586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.501589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.501595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.501603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.501609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.501615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.501620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.501626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.501630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.501636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.501642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.501647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.501667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:12.511429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:12.513134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:12.513141Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:12.513145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:12.513148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:12.513155Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 835 [1:7556533730762611730:10147]
2025-10-02T08:10:12.513182Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:12.513201Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:12.513204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.513208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.513210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.513227Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:12.513232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:12.513239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:12.513310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.513312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.513315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:12.513738Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 835
2025-10-02T08:10:12.513317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:12.513387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:12.513390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.513404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.513416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:12.513432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533730762611722:10147]
2025-10-02T08:10:12.513434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533730762611722:10147]
2025-10-02T08:10:12.513441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:12.513453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:12.513466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:12.513470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:12.513476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 835
2025-10-02T08:10:12.513477Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:12.513480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762611742:10148], now have 1 active actors on pipe
2025-10-02T08:10:12.513480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:12.513513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533730762611722:10147]
2025-10-02T08:10:12.513516Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:12.513521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533731222744838:2378], now have 1 active actors on pipe
2025-10-02T08:10:12.513526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.513530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.513573Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:12.513578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.513584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.513586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:12.513594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.513603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:12.513620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.513645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:12.513789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.513792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.513813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.513853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 836 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0
2025-10-02T08:10:12.514359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a6be07-c475dca7-7a932bbd-21b09a7a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:12.517957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0] Write session: try to update token
2025-10-02T08:10:12.517984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:12.533068Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:12.533090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:12.533093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:12.533107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533730762611722:10147]
2025-10-02T08:10:12.533112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533730762611722:10147]
2025-10-02T08:10:12.533165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:12.533167Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:12.533171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.533173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:12.533174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:12.533345Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:12.545562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId: src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:12.548446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:12.580171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533730762611771:9858]
2025-10-02T08:10:12.580469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 835, pipe: [1:7556533730762611771:9858]
2025-10-02T08:10:12.690893Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:12.691436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.691473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.691497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762611771:9858], now have 1 active actors on pipe
2025-10-02T08:10:12.691726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533730762611771:9858]
2025-10-02T08:10:12.691751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:12.691757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:12.691775Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:12.691817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 836 reason: error at write: Disconnected sessionId: src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0
2025-10-02T08:10:12.691791Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:12.691992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 836 sessionId: src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0 is DEAD
2025-10-02T08:10:12.693063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:12.693078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0] Write session will restart in 0.005457s
2025-10-02T08:10:12.693109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0] Write session: Do CDS request
2025-10-02T08:10:12.693116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:12.701441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:12.701767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:12.701788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 837
2025-10-02T08:10:12.701937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:12.701994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:12.702004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:12.702008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:12.702543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 837 sessionId:  describe result for acl check
2025-10-02T08:10:12.702579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:12.702581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:12.702583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:12.702588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533730762612039:10168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:12.703163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533730762612039:10168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:12.705430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533730762612039:10168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:12.709500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:12.709827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533730762612039:10168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:12.709843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533730762612039:10168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:12.709847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533730762612039:10168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:12.709855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:12.709922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:12.710199Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:12.710214Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:12.710226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:12.710279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:12.710330Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533730762612123:10167]
2025-10-02T08:10:12.710974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:12.711145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:12.711188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:12.711492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:12.711538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.711544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.711545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.711545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.711546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.711551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.711558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.711560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.711562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.711564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.711568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.711572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.711579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.711583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.711585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.711589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.711595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.711598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.711600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.711603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.711614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:12.719993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:12.721937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:12.721955Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:12.721958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:12.721961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:12.721968Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 836 [1:7556533730762612123:10167]
2025-10-02T08:10:12.721980Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:12.722000Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:12.722003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.722006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.722011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.722029Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:12.722034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:12.722041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:12.722109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.722117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.722121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:12.722123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:12.722192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:12.722202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.722216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.722227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:12.722238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 836
2025-10-02T08:10:12.722246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762612119:10168], now have 1 active actors on pipe
2025-10-02T08:10:12.722254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533730762612111:10167]
2025-10-02T08:10:12.722256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533730762612111:10167]
2025-10-02T08:10:12.722263Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:12.722276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533731222744879:2378], now have 1 active actors on pipe
2025-10-02T08:10:12.722277Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:12.722281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:12.722289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.722294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.722310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:12.722327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:12.722334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:12.722383Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29663648-caa2d4af-746784d-ba5cce0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:12.722394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.722398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.722399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:12.722409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.722417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:12.722379Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 836
2025-10-02T08:10:12.722429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533730762612111:10167]
2025-10-02T08:10:12.722438Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:12.722445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:12.722464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.722514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.722521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.722533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.722575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 837 partition: 0 MaxSeqNo: 17 sessionId: src_id|29663648-caa2d4af-746784d-ba5cce0a_0
2025-10-02T08:10:12.723043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f49ba80-bf83fae7-b6f9451d-5a5ed895_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|29663648-caa2d4af-746784d-ba5cce0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:12.728004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29663648-caa2d4af-746784d-ba5cce0a_0] Write session: try to update token
2025-10-02T08:10:12.728026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29663648-caa2d4af-746784d-ba5cce0a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:12.734288Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:12.734310Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:12.734319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533730762612111:10167]
2025-10-02T08:10:12.734360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:12.734412Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:12.734543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:12.734723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:12.734884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:12.735026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:12.735224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:12.735272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:12.754128Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:12.754154Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:12.754157Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:12.754168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533730762612111:10167]
2025-10-02T08:10:12.754173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533730762612111:10167]
2025-10-02T08:10:12.754222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:12.754235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.754237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:12.754253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:12.754259Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:12.754405Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:12.758506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId: src_id|29663648-caa2d4af-746784d-ba5cce0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:12.761378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:12.791640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533730762612150:9858]
2025-10-02T08:10:12.792039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 836, pipe: [1:7556533730762612150:9858]
2025-10-02T08:10:12.902581Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:12.902963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.902977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.902999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762612150:9858], now have 1 active actors on pipe
2025-10-02T08:10:12.903273Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:12.903621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:12.903721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533730762612150:9858]
2025-10-02T08:10:12.903730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 837 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29663648-caa2d4af-746784d-ba5cce0a_0
2025-10-02T08:10:12.903873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 837 sessionId: src_id|29663648-caa2d4af-746784d-ba5cce0a_0 is DEAD
2025-10-02T08:10:12.904941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29663648-caa2d4af-746784d-ba5cce0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:12.904929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:12.905050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29663648-caa2d4af-746784d-ba5cce0a_0] Write session will restart in 0.005956s
2025-10-02T08:10:12.905083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29663648-caa2d4af-746784d-ba5cce0a_0] Write session: Do CDS request
2025-10-02T08:10:12.905090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29663648-caa2d4af-746784d-ba5cce0a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:12.912547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29663648-caa2d4af-746784d-ba5cce0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:12.916978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:12.916995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 838
2025-10-02T08:10:12.917158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:12.917184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:12.917188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:12.917193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:12.917573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 838 sessionId:  describe result for acl check
2025-10-02T08:10:12.917607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:12.917608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:12.917610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:12.917615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533730762612344:10174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:12.918100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533730762612344:10174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:12.920925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533730762612344:10174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:12.923982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533730762612344:10174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:12.924001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533730762612344:10174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:12.924005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533730762612344:10174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:12.924014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:12.928649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:12.928973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:12.929149Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:12.929159Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:12.929169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:12.929214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:12.929253Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533730762612467:10173]
2025-10-02T08:10:12.929901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:12.930257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:12.930313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:12.930658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:12.930711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.930713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.930714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.930715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.930716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.930722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.930732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.930737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.930741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.930745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.930750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.930757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:12.930762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.930767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:12.930771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.930776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:12.930780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.930785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.930789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.930793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.930811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:12.940493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:12.942593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:12.942619Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:12.942621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:12.942625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:12.942632Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 837 [1:7556533730762612467:10173]
2025-10-02T08:10:12.942646Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:12.942664Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:12.942668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.942672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.942674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.942691Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:12.942697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:12.942704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:12.942789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.942791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.942794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:12.942797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:12.942869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:12.942872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.942888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:12.942901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:12.942918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533730762612461:10173]
2025-10-02T08:10:12.942920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533730762612461:10173]
2025-10-02T08:10:12.942939Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:12.942954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:12.942968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:12.942971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:12.943005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533730762612461:10173]
2025-10-02T08:10:12.943008Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:12.943133Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:12.943138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:12.943144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:12.943278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 837
2025-10-02T08:10:12.943303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533730762612451:10174], now have 1 active actors on pipe
2025-10-02T08:10:12.943315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533731222744892:2378], now have 1 active actors on pipe
2025-10-02T08:10:12.943323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.943335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.943374Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:12.943387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:12.943404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:12.943411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:12.943422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:12.943436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:12.943469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.943517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:12.943524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:12.943536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:12.943582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 838 partition: 0 MaxSeqNo: 17 sessionId: src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0
2025-10-02T08:10:12.943567Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 837
2025-10-02T08:10:12.943949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29663648-caa2d4af-746784d-ba5cce0a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:12.946825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0] Write session: try to update token
2025-10-02T08:10:12.946839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:12.963010Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:12.963040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:12.963043Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:12.963055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533730762612461:10173]
2025-10-02T08:10:12.963061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533730762612461:10173]
2025-10-02T08:10:12.963117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:12.963126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:12.963129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:12.963285Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:12.964864Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:12.964886Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:12.985770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId: src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:12.990281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:13.004112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533735057579789:9858]
2025-10-02T08:10:13.006158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 837, pipe: [1:7556533735057579789:9858]
2025-10-02T08:10:13.117474Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:13.118036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.118054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.118075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057579789:9858], now have 1 active actors on pipe
2025-10-02T08:10:13.118715Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:13.119191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:13.119250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 838 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0
2025-10-02T08:10:13.119424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 838 sessionId: src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0 is DEAD
2025-10-02T08:10:13.119565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533735057579789:9858]
2025-10-02T08:10:13.119786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:13.119792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0] Write session will restart in 0.005599s
2025-10-02T08:10:13.119811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0] Write session: Do CDS request
2025-10-02T08:10:13.119829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:13.118416Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:13.126300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:13.126374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:13.126390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 839
2025-10-02T08:10:13.126525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:13.126556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:13.126561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:13.126564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:13.127172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 839 sessionId:  describe result for acl check
2025-10-02T08:10:13.127208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:13.127210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:13.127213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:13.127218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533735057579950:10181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:13.127832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533735057579950:10181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:13.131178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533735057579950:10181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:13.137215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:13.137333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533735057579950:10181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:13.137350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533735057579950:10181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:13.137354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533735057579950:10181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:13.137363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:13.137874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:13.138021Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:13.138028Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:13.138035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:13.138065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:13.138096Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533735057580104:10180]
2025-10-02T08:10:13.138505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:13.138674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:13.138712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:13.138912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:13.138938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.138943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.138944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.138945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.138945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.138948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.138955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.138957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.138959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.138961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.138966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.138971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.138974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.138976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.138979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.138982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.138983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.138986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.138988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.138991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.139000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:13.147480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:13.149405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:13.149427Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:13.149430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:13.149433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:13.149440Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 838 [1:7556533735057580104:10180]
2025-10-02T08:10:13.149454Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:13.149470Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:13.149474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:13.149476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:13.149478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:13.149494Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:13.149499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:13.149505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:13.149573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.149580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.149583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:13.149585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:13.149641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:13.149650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.149663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.149674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:13.149691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533735057580092:10180]
2025-10-02T08:10:13.149693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533735057580092:10180]
2025-10-02T08:10:13.149699Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:13.149704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 838
2025-10-02T08:10:13.149710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:13.149712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057580100:10181], now have 1 active actors on pipe
2025-10-02T08:10:13.149712Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:13.149721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:13.149732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:13.149735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:13.149740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533735517712194:2378], now have 1 active actors on pipe
2025-10-02T08:10:13.149745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.149748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.149788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533735057580092:10180]
2025-10-02T08:10:13.149796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:13.149812Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|316f8500-f2b156f1-4035365-fd61e134_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:13.149818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:13.149821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:13.149823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:13.149832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:13.149839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:13.149856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:13.149869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:13.149976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.149980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.149996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:13.150048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 839 partition: 0 MaxSeqNo: 17 sessionId: src_id|316f8500-f2b156f1-4035365-fd61e134_0
2025-10-02T08:10:13.150409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92a5d32-d84f8c5e-a3f1a43e-6b85d4a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|316f8500-f2b156f1-4035365-fd61e134_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:13.149809Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 838
2025-10-02T08:10:13.153138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316f8500-f2b156f1-4035365-fd61e134_0] Write session: try to update token
2025-10-02T08:10:13.153157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316f8500-f2b156f1-4035365-fd61e134_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:13.168062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId: src_id|316f8500-f2b156f1-4035365-fd61e134_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:13.169155Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:13.169170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:13.169173Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:13.169182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533735057580092:10180]
2025-10-02T08:10:13.169186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533735057580092:10180]
2025-10-02T08:10:13.169230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:13.169241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.169239Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:13.169244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:13.169247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:13.169376Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:13.170723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:13.219739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533735057580130:9858]
2025-10-02T08:10:13.219868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 838, pipe: [1:7556533735057580130:9858]
2025-10-02T08:10:13.314824Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:13.315410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.315427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.315483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057580130:9858], now have 1 active actors on pipe
2025-10-02T08:10:13.315864Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:13.315718Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:13.315804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:13.315866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 839 reason: status is not ok: tablet will be restarted right now sessionId: src_id|316f8500-f2b156f1-4035365-fd61e134_0
2025-10-02T08:10:13.316007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 839 sessionId: src_id|316f8500-f2b156f1-4035365-fd61e134_0 is DEAD
2025-10-02T08:10:13.316109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533735057580130:9858]
2025-10-02T08:10:13.316557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316f8500-f2b156f1-4035365-fd61e134_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:13.316576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316f8500-f2b156f1-4035365-fd61e134_0] Write session will restart in 0.009058s
2025-10-02T08:10:13.316606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316f8500-f2b156f1-4035365-fd61e134_0] Write session: Do CDS request
2025-10-02T08:10:13.316615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316f8500-f2b156f1-4035365-fd61e134_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:13.330347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316f8500-f2b156f1-4035365-fd61e134_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:13.331993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:13.332017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 840
2025-10-02T08:10:13.334530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:13.334592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:13.334597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:13.334604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:13.335308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 840 sessionId:  describe result for acl check
2025-10-02T08:10:13.335356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:13.335358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:13.335360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:13.335367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533735057580408:10187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:13.336036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533735057580408:10187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:13.337864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:13.338775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:13.338979Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:13.338988Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:13.339000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:13.339053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:13.339090Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533735057580432:10186]
2025-10-02T08:10:13.339789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:13.340949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533735057580408:10187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:13.341915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:13.341989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:13.342341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:13.342403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.342409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.342410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.342411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.342412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.342417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.342427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.342431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.342435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.342439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.342445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.342452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.342459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.342463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.342468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.342472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.342477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.342483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.342490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.342494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.342512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:13.350929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533735057580408:10187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:13.350952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533735057580408:10187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:13.350956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533735057580408:10187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:13.350967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:13.352115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:13.356483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:13.356503Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:13.356506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:13.356516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:13.356523Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 839 [1:7556533735057580432:10186]
2025-10-02T08:10:13.356536Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:13.356557Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:13.356560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:13.356564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:13.356567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:13.356590Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:13.356596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:13.356603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:13.356675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.356677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.356680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:13.356683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:13.356761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:13.356764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.356780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.356795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:13.356829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057580462:10187], now have 1 active actors on pipe
2025-10-02T08:10:13.356837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533735057580415:10186]
2025-10-02T08:10:13.356839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533735057580415:10186]
2025-10-02T08:10:13.356847Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:13.356861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:13.357701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 839
2025-10-02T08:10:13.356875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 839
2025-10-02T08:10:13.356877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:13.356880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:13.356909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533735517712202:2378], now have 1 active actors on pipe
2025-10-02T08:10:13.356947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533735057580415:10186]
2025-10-02T08:10:13.356950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:13.356985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:13.356989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:13.356995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:13.357009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.357015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.357042Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:13.357049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:13.357056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:13.357058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:13.357067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:13.357077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:13.357099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:13.357215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.357220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.357236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:13.357276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 840 partition: 0 MaxSeqNo: 17 sessionId: src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0
2025-10-02T08:10:13.361062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316f8500-f2b156f1-4035365-fd61e134_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:13.364579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0] Write session: try to update token
2025-10-02T08:10:13.364604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:13.394001Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:13.394023Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:13.394025Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:13.394033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533735057580415:10186]
2025-10-02T08:10:13.394037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533735057580415:10186]
2025-10-02T08:10:13.394078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:13.394090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.394092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:13.394233Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:13.396458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:13.396471Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:13.402194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId: src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:13.404997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:13.419807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533735057580480:9858]
2025-10-02T08:10:13.420101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 839, pipe: [1:7556533735057580480:9858]
2025-10-02T08:10:13.576407Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:13.576750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.576758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.576885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057580480:9858], now have 1 active actors on pipe
2025-10-02T08:10:13.577060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533735057580480:9858]
2025-10-02T08:10:13.577234Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:13.577401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:13.577468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:13.577557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 840 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0
2025-10-02T08:10:13.577759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 840 sessionId: src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0 is DEAD
2025-10-02T08:10:13.581080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:13.581098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0] Write session will restart in 0.008754s
2025-10-02T08:10:13.581130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0] Write session: Do CDS request
2025-10-02T08:10:13.581138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:13.593362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:13.593406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:13.593652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 841
2025-10-02T08:10:13.593841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:13.593883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:13.593888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:13.593897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:13.594421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 841 sessionId:  describe result for acl check
2025-10-02T08:10:13.594459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:13.594465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:13.594467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:13.594473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533735057580753:10194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:13.594981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533735057580753:10194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:13.596952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:13.597399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533735057580753:10194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:13.600352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:13.600566Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:13.600577Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:13.600587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:13.600642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:13.600685Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533735057580801:10193]
2025-10-02T08:10:13.601050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533735057580753:10194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:13.601065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533735057580753:10194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:13.601069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533735057580753:10194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:13.601078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:13.601421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:13.601609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:13.601650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:13.601944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:13.602016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.602023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.602024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.602026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.602027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.602033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.602043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.602046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.602050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.602053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.602060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.602066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.602072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.602077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.602082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.602086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.602090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.602094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.602099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.602103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.602120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:13.610939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:13.612675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:13.612695Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:13.612697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:13.612700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:13.612705Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 840 [1:7556533735057580801:10193]
2025-10-02T08:10:13.612715Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:13.612730Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:13.612732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:13.612734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:13.612735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:13.612748Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:13.612751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:13.612756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:13.612836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.612844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.612846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:13.612849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:13.612904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:13.612910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.612919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.612926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:13.612940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533735057580785:10193]
2025-10-02T08:10:13.612945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533735057580785:10193]
2025-10-02T08:10:13.612952Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:13.612963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:13.612971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:13.612973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:13.612986Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:13.612990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:13.613004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057580806:10194], now have 1 active actors on pipe
2025-10-02T08:10:13.613010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533735057580785:10193]
2025-10-02T08:10:13.613012Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:13.613012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 840
2025-10-02T08:10:13.613019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:13.613024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533735517712211:2378], now have 1 active actors on pipe
2025-10-02T08:10:13.613028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.613031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.613056Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:13.613064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:13.613067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:13.613069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:13.613078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:13.613089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:13.613081Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 840
2025-10-02T08:10:13.613115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:13.613164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.613171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.613207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:13.613262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 841 partition: 0 MaxSeqNo: 17 sessionId: src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0
2025-10-02T08:10:13.613664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6edc8-5c2ed5f7-549ff097-4e43b15e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:13.617336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0] Write session: try to update token
2025-10-02T08:10:13.617361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:13.632540Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:13.632563Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:13.632566Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:13.632575Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533735057580785:10193]
2025-10-02T08:10:13.632579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533735057580785:10193]
2025-10-02T08:10:13.632616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:13.632619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:13.632622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.632624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:13.632624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:13.632770Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:13.670165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId: src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:13.673002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:13.681031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533735057580852:9858]
2025-10-02T08:10:13.681892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 840, pipe: [1:7556533735057580852:9858]
2025-10-02T08:10:13.778405Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:13.778839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.778846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.778865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057580852:9858], now have 1 active actors on pipe
2025-10-02T08:10:13.779659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:13.779671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0] Write session will restart in 0.007130s
2025-10-02T08:10:13.779698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0] Write session: Do CDS request
2025-10-02T08:10:13.779705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:13.779794Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:13.779081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533735057580852:9858]
2025-10-02T08:10:13.779112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:13.779115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:13.779142Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:13.779178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 841 reason: error at write: Disconnected sessionId: src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0
2025-10-02T08:10:13.779382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 841 sessionId: src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0 is DEAD
2025-10-02T08:10:13.788940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:13.791495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:13.791522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 842
2025-10-02T08:10:13.792246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:13.792288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:13.792295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:13.792299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:13.796090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 842 sessionId:  describe result for acl check
2025-10-02T08:10:13.796133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:13.796135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:13.796136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:13.796141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533735057581147:10213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:13.796646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533735057581147:10213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:13.801387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:13.802001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:13.802191Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:13.802200Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:13.802209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:13.802252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:13.802298Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533735057581184:10212]
2025-10-02T08:10:13.802749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533735057581147:10213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:13.802982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:13.803169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:13.803213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:13.803492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:13.803543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.803547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.803548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.803549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.803550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.803553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.803560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.803562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.803564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.803565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.803570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.803574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:13.803578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.803581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:13.803584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.803587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:13.803590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.803592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.803595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.803598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.803609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:13.811010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533735057581147:10213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:13.811030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533735057581147:10213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:13.811034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533735057581147:10213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:13.811042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:13.816217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:13.817924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:13.817948Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:13.817951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:13.817956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:13.817963Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 841 [1:7556533735057581184:10212]
2025-10-02T08:10:13.817976Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:13.817994Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:13.817997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:13.818001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:13.818003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:13.818022Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:13.818033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:13.818040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:13.818119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.818126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.818132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:13.818135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:13.818202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:13.818205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.818221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:13.818233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:13.818249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533735057581174:10212]
2025-10-02T08:10:13.818261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533735057581174:10212]
2025-10-02T08:10:13.818269Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:13.818284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:13.818304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:13.818306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:13.818342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533735057581174:10212]
2025-10-02T08:10:13.818350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:13.818508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:13.818518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:13.818524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:13.818688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057581211:10213], now have 1 active actors on pipe
2025-10-02T08:10:13.818717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 841
2025-10-02T08:10:13.818726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533735517712252:2378], now have 1 active actors on pipe
2025-10-02T08:10:13.818733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.818739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.818771Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:13.818781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:13.818785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:13.818787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:13.818797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:13.818815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:13.818829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:13.819212Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 841
2025-10-02T08:10:13.819556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad9884a-8b153ae9-3c6c0427-1c43d6d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:13.819046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:13.819050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:13.819063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:13.819096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 842 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0
2025-10-02T08:10:13.822761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0] Write session: try to update token
2025-10-02T08:10:13.822781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:13.840582Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:13.840607Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:13.840609Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:13.840617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533735057581174:10212]
2025-10-02T08:10:13.840621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533735057581174:10212]
2025-10-02T08:10:13.840667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:13.840681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:13.840683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:13.840841Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:13.840914Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:13.840922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:13.846314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId: src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:13.849842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:13.878650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533735057581226:9858]
2025-10-02T08:10:13.878955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 841, pipe: [1:7556533735057581226:9858]
2025-10-02T08:10:14.002976Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:14.004286Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:14.003864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.003888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.003916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533735057581226:9858], now have 1 active actors on pipe
2025-10-02T08:10:14.004227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533735057581226:9858]
2025-10-02T08:10:14.004348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:14.004355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:14.004951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 842 reason: error at write: Disconnected sessionId: src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0
2025-10-02T08:10:14.005166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 842 sessionId: src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0 is DEAD
2025-10-02T08:10:14.005352Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:14.006255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:14.006265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0] Write session will restart in 0.009455s
2025-10-02T08:10:14.006287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0] Write session: Do CDS request
2025-10-02T08:10:14.006291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:14.017443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.017823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:14.017851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 843
2025-10-02T08:10:14.018061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.018109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:14.018121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:14.018127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:14.018656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 843 sessionId:  describe result for acl check
2025-10-02T08:10:14.018694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:14.018706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:14.018708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:14.018715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533739352548700:10220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:14.019328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533739352548700:10220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:14.023914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533739352548700:10220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:14.027803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:14.028826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533739352548700:10220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:14.028849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533739352548700:10220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:14.028854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533739352548700:10220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:14.028863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:14.033885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:14.034440Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:14.034462Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:14.034479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:14.034563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:14.034613Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533739352548846:10219]
2025-10-02T08:10:14.035271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:14.035585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:14.035689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:14.036121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:14.036203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.036209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.036210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.036212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.036213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.036219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.036230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.036234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.036237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.036241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.036248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.036256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.036261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.036267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.036272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.036278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.036282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.036290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.036299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.036307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.036330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:14.050117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:14.053943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:14.053963Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:14.053966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:14.053970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:14.053977Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 842 [1:7556533739352548846:10219]
2025-10-02T08:10:14.053992Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:14.054012Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:14.054016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:14.054019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:14.054022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:14.054038Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:14.054049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:14.054056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:14.054121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.054127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.054132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:14.054135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:14.054222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:14.054230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.054244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.054255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:14.054273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533739352548839:10220], now have 1 active actors on pipe
2025-10-02T08:10:14.054276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533739812679558:2378], now have 1 active actors on pipe
2025-10-02T08:10:14.054281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 842
2025-10-02T08:10:14.054283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533739352548832:10219]
2025-10-02T08:10:14.054285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533739352548832:10219]
2025-10-02T08:10:14.054297Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:14.054308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:14.054308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.054310Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:14.054313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.054331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:14.054345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:14.054353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:14.054378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 842
2025-10-02T08:10:14.054397Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:14.054412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:14.054416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:14.054417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:14.054426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:14.054435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:14.054446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533739352548832:10219]
2025-10-02T08:10:14.054456Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:14.054462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:14.054484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:14.054523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.054531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.054544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:14.054586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 843 partition: 0 MaxSeqNo: 17 sessionId: src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0
2025-10-02T08:10:14.054935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a651b1c-5a16319d-7ebcefa6-d5b9eed9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:14.057881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0] Write session: try to update token
2025-10-02T08:10:14.057901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:14.082492Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:14.082513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:14.082515Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:14.082523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533739352548832:10219]
2025-10-02T08:10:14.082526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533739352548832:10219]
2025-10-02T08:10:14.082571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:14.082577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.082582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:14.082606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:14.082622Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:14.082918Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:14.100894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId: src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:14.103578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:14.104375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533739352548870:9858]
2025-10-02T08:10:14.104459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 842, pipe: [1:7556533739352548870:9858]
2025-10-02T08:10:14.228943Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:14.229433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.229442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.229466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533739352548870:9858], now have 1 active actors on pipe
2025-10-02T08:10:14.229747Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:14.229731Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:14.230017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:14.230024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533739352548870:9858]
2025-10-02T08:10:14.230065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 843 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0
2025-10-02T08:10:14.230203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 843 sessionId: src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0 is DEAD
2025-10-02T08:10:14.233519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:14.233536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0] Write session will restart in 0.005851s
2025-10-02T08:10:14.233582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0] Write session: Do CDS request
2025-10-02T08:10:14.233590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:14.243139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.243855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:14.243875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 844
2025-10-02T08:10:14.244392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.244426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:14.244432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:14.244435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:14.244966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 844 sessionId:  describe result for acl check
2025-10-02T08:10:14.245009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:14.245011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:14.245012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:14.245017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533739352549090:10226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:14.245789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533739352549090:10226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:14.254596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533739352549090:10226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:14.262317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:14.263825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:14.264096Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:14.264101Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:14.264115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:14.264176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:14.264230Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533739352549189:10225]
2025-10-02T08:10:14.265042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:14.265628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:14.265682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:14.265740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533739352549090:10226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:14.265749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533739352549090:10226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:14.265753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533739352549090:10226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:14.265762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:14.266067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:14.266114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.266115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.266117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.266118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.266119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.266126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.266138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.266142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.266146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.266150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.266160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.266169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.266175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.266181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.266190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.266196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.266202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.266208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.266214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.266220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.266243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:14.280476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:14.282963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:14.282997Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:14.283001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:14.283006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:14.283016Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 843 [1:7556533739352549189:10225]
2025-10-02T08:10:14.283033Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:14.283057Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:14.283062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:14.283066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:14.283068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:14.283089Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:14.283096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:14.283106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:14.283198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.283201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.283204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:14.283207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:14.283297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:14.283300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.283317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.283328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:14.283350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533739352549183:10225]
2025-10-02T08:10:14.283352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533739352549183:10225]
2025-10-02T08:10:14.283370Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:14.283387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:14.283402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:14.283405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:14.283450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533739352549183:10225]
2025-10-02T08:10:14.283452Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:14.283728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:14.283742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:14.283749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:14.283938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 843
2025-10-02T08:10:14.283987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533739352549200:10226], now have 1 active actors on pipe
2025-10-02T08:10:14.283997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.284006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.284024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533739812679565:2378], now have 1 active actors on pipe
2025-10-02T08:10:14.284053Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:14.284065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:14.284070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:14.284072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:14.284488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:14.284515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:14.284538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:14.284594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.284605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.284619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:14.284672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 844 partition: 0 MaxSeqNo: 17 sessionId: src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0
2025-10-02T08:10:14.284607Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 843
2025-10-02T08:10:14.285141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44d373d5-df784321-7e70a9d5-bf2c3789_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:14.288724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0] Write session: try to update token
2025-10-02T08:10:14.288744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:14.307872Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:14.307901Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:14.307904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:14.307916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533739352549183:10225]
2025-10-02T08:10:14.307922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533739352549183:10225]
2025-10-02T08:10:14.307978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:14.307987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.307990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:14.308318Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:14.308329Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:14.308427Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:14.316511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId: src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:14.319274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:14.330227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533739352549219:9858]
2025-10-02T08:10:14.330364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 843, pipe: [1:7556533739352549219:9858]
2025-10-02T08:10:14.477022Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:14.478208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:14.475970Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:14.478225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0] Write session will restart in 0.005639s
2025-10-02T08:10:14.476720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.476732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.476786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533739352549219:9858], now have 1 active actors on pipe
2025-10-02T08:10:14.478254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0] Write session: Do CDS request
2025-10-02T08:10:14.477033Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:14.477510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533739352549219:9858]
2025-10-02T08:10:14.478261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:14.477532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:14.477592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 844 reason: status is not ok: tablet will be restarted right now sessionId: src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0
2025-10-02T08:10:14.477799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 844 sessionId: src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0 is DEAD
2025-10-02T08:10:14.486983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.487916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:14.487943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 845
2025-10-02T08:10:14.488130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.488180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:14.488188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:14.488194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:14.489425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 845 sessionId:  describe result for acl check
2025-10-02T08:10:14.489471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:14.489474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:14.489477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:14.489484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533739352549234:10233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:14.490423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533739352549234:10233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:14.493675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533739352549234:10233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:14.501720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533739352549234:10233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:14.501742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533739352549234:10233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:14.501746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533739352549234:10233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:14.501757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:14.509015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:14.513507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:14.513763Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:14.513767Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:14.513777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:14.513833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:14.513866Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533739352549552:10235]
2025-10-02T08:10:14.514518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:14.514775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:14.514811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:14.515110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:14.515164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.515165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.515166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.515168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.515169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.515174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.515185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.515190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.515194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.515198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.515203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.515211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.515217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.515222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.515227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.515231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.515236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.515242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.515246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.515252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.515273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:14.524570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:14.526716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:14.526740Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:14.526743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:14.526747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:14.526755Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 844 [1:7556533739352549552:10235]
2025-10-02T08:10:14.526769Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:14.526791Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:14.526795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:14.526798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:14.526800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:14.526819Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:14.526827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:14.526835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:14.526909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.526919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.526922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:14.526924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:14.527000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:14.527008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.527022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.527039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:14.527062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533739352549545:10235]
2025-10-02T08:10:14.527069Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533739352549545:10235]
2025-10-02T08:10:14.527085Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:14.527108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:14.527127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:14.527135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:14.527171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533739352549545:10235]
2025-10-02T08:10:14.527178Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:14.527188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533739352549447:10233], now have 1 active actors on pipe
2025-10-02T08:10:14.527209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:14.527216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.527217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 844
2025-10-02T08:10:14.527221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:14.527221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.527228Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:14.527250Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9099daf9-72f4e144-d5f45264-c028ce42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:14.527263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:14.527268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:14.527275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:14.527286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:14.527302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:14.527319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:14.527410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.527423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.527440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533739812679574:2378], now have 1 active actors on pipe
2025-10-02T08:10:14.527459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:14.527524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 845 partition: 0 MaxSeqNo: 17 sessionId: src_id|9099daf9-72f4e144-d5f45264-c028ce42_0
2025-10-02T08:10:14.527565Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 844
2025-10-02T08:10:14.528091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472fddab-ca56a491-8ae68014-3b10c9dd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9099daf9-72f4e144-d5f45264-c028ce42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:14.531958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9099daf9-72f4e144-d5f45264-c028ce42_0] Write session: try to update token
2025-10-02T08:10:14.531984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9099daf9-72f4e144-d5f45264-c028ce42_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:14.547060Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:14.547079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:14.547081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:14.547087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533739352549545:10235]
2025-10-02T08:10:14.547092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533739352549545:10235]
2025-10-02T08:10:14.547129Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:14.547134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:14.547138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:14.547143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.547144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:14.547330Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:14.564207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId: src_id|9099daf9-72f4e144-d5f45264-c028ce42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:14.566989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:14.576894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533739352549583:9858]
2025-10-02T08:10:14.577963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 844, pipe: [1:7556533739352549583:9858]
2025-10-02T08:10:14.656923Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:10:14.708309Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:14.710171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.710191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.710210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533739352549583:9858], now have 1 active actors on pipe
2025-10-02T08:10:14.711099Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:14.711456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533739352549583:9858]
2025-10-02T08:10:14.711496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:14.711995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:14.711559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 845 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9099daf9-72f4e144-d5f45264-c028ce42_0
2025-10-02T08:10:14.711728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 845 sessionId: src_id|9099daf9-72f4e144-d5f45264-c028ce42_0 is DEAD
2025-10-02T08:10:14.716910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9099daf9-72f4e144-d5f45264-c028ce42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:14.716926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9099daf9-72f4e144-d5f45264-c028ce42_0] Write session will restart in 0.008333s
2025-10-02T08:10:14.716959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9099daf9-72f4e144-d5f45264-c028ce42_0] Write session: Do CDS request
2025-10-02T08:10:14.716967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9099daf9-72f4e144-d5f45264-c028ce42_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:14.729381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9099daf9-72f4e144-d5f45264-c028ce42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.732982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:14.733000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 846
2025-10-02T08:10:14.733280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.733327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:14.733332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:14.733336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:14.736933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 846 sessionId:  describe result for acl check
2025-10-02T08:10:14.736973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:14.736974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:14.736975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:14.736980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533739352549814:10248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:14.737605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533739352549814:10248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:14.744393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533739352549814:10248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:14.747617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:14.748791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:14.749002Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:14.749005Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:14.749015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:14.749060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:14.749099Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533739352549951:10247]
2025-10-02T08:10:14.749751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:14.749984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:14.750033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:14.750366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:14.750412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.750414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.750415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.750417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.750418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.750423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.750433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.750437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.750440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.750444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.750449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.750456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.750462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.750466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.750470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.750475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.750478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.750483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.750487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.750491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.750512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:14.761086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533739352549814:10248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:14.761114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533739352549814:10248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:14.761118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533739352549814:10248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:14.761127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:14.765116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:14.767577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:14.767592Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:14.767594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:14.767598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:14.767605Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 845 [1:7556533739352549951:10247]
2025-10-02T08:10:14.767617Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:14.767636Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:14.767638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:14.767641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:14.767643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:14.767660Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:14.767665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:14.767672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:14.767745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.767755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.767758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:14.767761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:14.767862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:14.767871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.767886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.767898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:14.767922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533739352549936:10247]
2025-10-02T08:10:14.767928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533739352549936:10247]
2025-10-02T08:10:14.767940Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:14.767959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:14.767977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:14.767984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:14.768020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533739352549936:10247]
2025-10-02T08:10:14.768027Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:14.768148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:14.768156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:14.768161Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:14.770234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 845
2025-10-02T08:10:14.770255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533739352549967:10248], now have 1 active actors on pipe
2025-10-02T08:10:14.770260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533739812679607:2378], now have 1 active actors on pipe
2025-10-02T08:10:14.770418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.770431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.770473Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:14.770487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:14.770492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:14.770495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:14.770506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:14.770525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:14.770556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:14.770603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.770610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.770622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:14.770653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 846 partition: 0 MaxSeqNo: 17 sessionId: src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0
2025-10-02T08:10:14.770320Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 845
2025-10-02T08:10:14.776996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9099daf9-72f4e144-d5f45264-c028ce42_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:14.780015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0] Write session: try to update token
2025-10-02T08:10:14.780035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:14.783590Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:14.783611Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:14.783620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533739352549936:10247]
2025-10-02T08:10:14.783662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:14.783850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:14.783999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:14.784144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:14.784304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:14.785082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:14.785124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:14.785562Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:14.806712Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:14.806736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:14.806739Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:14.806749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533739352549936:10247]
2025-10-02T08:10:14.806754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533739352549936:10247]
2025-10-02T08:10:14.806796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:14.806803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.806804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:14.806964Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:14.807032Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:14.807047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:14.811428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId: src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:14.814606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:14.814685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533739352549981:9858]
2025-10-02T08:10:14.814759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 845, pipe: [1:7556533739352549981:9858]
2025-10-02T08:10:14.973280Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:14.973547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:14.973555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:14.973580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533739352549981:9858], now have 1 active actors on pipe
2025-10-02T08:10:14.973810Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:14.974103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:14.974157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 846 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0
2025-10-02T08:10:14.974318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 846 sessionId: src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0 is DEAD
2025-10-02T08:10:14.974436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533739352549981:9858]
2025-10-02T08:10:14.975014Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:14.977280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:14.977293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0] Write session will restart in 0.006006s
2025-10-02T08:10:14.977325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0] Write session: Do CDS request
2025-10-02T08:10:14.977332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:14.985609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.985928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:14.985945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 847
2025-10-02T08:10:14.991627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:14.991682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:14.991688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:14.991693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:14.993176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 847 sessionId:  describe result for acl check
2025-10-02T08:10:14.993211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:14.993214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:14.993216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:14.993222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533739352550275:10260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:14.993769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533739352550275:10260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:14.994475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:14.994898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:14.995059Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:14.995063Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:14.995072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:14.995113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:14.995145Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533739352550292:10259]
2025-10-02T08:10:14.995843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:14.996094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:14.996141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:14.996452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:14.996508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.996513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.996514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.996516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.996518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.996523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.996532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.996536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.996539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.996542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.996548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.996555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:14.996561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.996566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:14.996570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.996574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:14.996578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.996583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:14.996588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.996593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:14.996630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:14.996923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533739352550275:10260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:15.007070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533739352550275:10260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:15.007089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533739352550275:10260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:15.007093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533739352550275:10260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:15.007102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:15.011583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:15.013833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:15.013843Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:15.013847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:15.013851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:15.013860Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 846 [1:7556533739352550292:10259]
2025-10-02T08:10:15.013877Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:15.013902Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:15.013908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.013913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.013916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.013939Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:15.013945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:15.013955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:15.014032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.014034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.014036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:15.014039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:15.014119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:15.014122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.014137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.014150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:15.014166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533739352550278:10259]
2025-10-02T08:10:15.014168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533739352550278:10259]
2025-10-02T08:10:15.014179Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:15.014192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:15.014206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:15.014209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:15.014241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533739352550278:10259]
2025-10-02T08:10:15.014243Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:15.014456Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:15.014465Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:15.014470Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:15.015012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 846
2025-10-02T08:10:15.015026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647517619:10260], now have 1 active actors on pipe
2025-10-02T08:10:15.015030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533739812679624:2378], now have 1 active actors on pipe
2025-10-02T08:10:15.015510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.015520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.015550Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:15.015559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.015564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.015566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:15.015578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.015590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:15.015610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.016160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d2d786-42015234-e0a6f6c2-bcbc9c75_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:15.015272Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 846
2025-10-02T08:10:15.019030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0] Write session: try to update token
2025-10-02T08:10:15.019049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:15.015715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.015719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.015732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.015763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 847 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0
2025-10-02T08:10:15.048427Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:15.048450Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:15.048453Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:15.048462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533739352550278:10259]
2025-10-02T08:10:15.048466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533739352550278:10259]
2025-10-02T08:10:15.048509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:15.048515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.048518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:15.048684Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:15.052856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId: src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:15.054045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:15.054068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:15.056006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:15.073784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533743647517634:9858]
2025-10-02T08:10:15.074006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 846, pipe: [1:7556533743647517634:9858]
2025-10-02T08:10:15.197937Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:15.198221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.198235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.198276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647517634:9858], now have 1 active actors on pipe
2025-10-02T08:10:15.198437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533743647517634:9858]
2025-10-02T08:10:15.198475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:15.198478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:15.198914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:15.198933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0] Write session will restart in 0.005594s
2025-10-02T08:10:15.198528Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:15.198538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 847 reason: error at write: Disconnected sessionId: src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0
2025-10-02T08:10:15.198713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 847 sessionId: src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0 is DEAD
2025-10-02T08:10:15.198961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0] Write session: Do CDS request
2025-10-02T08:10:15.198970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:15.199752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:15.205461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:15.205387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:15.205405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 848
2025-10-02T08:10:15.205679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:15.205714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:15.205719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:15.205722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:15.206101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 848 sessionId:  describe result for acl check
2025-10-02T08:10:15.206131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:15.206133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:15.206134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:15.206139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533743647517807:10266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:15.206596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533743647517807:10266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:15.210463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533743647517807:10266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:15.215032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533743647517807:10266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:15.215052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533743647517807:10266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:15.215056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533743647517807:10266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:15.215064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:15.216155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:15.219091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:15.219336Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:15.219345Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:15.219354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:15.219396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:15.219431Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533743647517966:10265]
2025-10-02T08:10:15.219937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:15.220134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:15.220176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:15.220482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:15.220529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.220538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.220539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.220540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.220541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.220547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.220557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.220561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.220565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.220569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.220575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.220583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.220588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.220594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.220599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.220605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.220609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.220614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.220618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.220624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.220643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:15.229405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:15.231405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:15.231427Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:15.231429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:15.231434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:15.231444Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 847 [1:7556533743647517966:10265]
2025-10-02T08:10:15.231455Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:15.231485Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:15.231486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.231488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.231490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.231503Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:15.231507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:15.231512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:15.231568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.231575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.231577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:15.231579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:15.231829Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 847
2025-10-02T08:10:15.231626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:15.231633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.231645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.231656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:15.231676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533743647517960:10265]
2025-10-02T08:10:15.231677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533743647517960:10265]
2025-10-02T08:10:15.231686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:15.231698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:15.231699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647517949:10266], now have 1 active actors on pipe
2025-10-02T08:10:15.231702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:15.231708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:15.231709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 847
2025-10-02T08:10:15.231720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:15.231726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:15.231732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533744107646928:2378], now have 1 active actors on pipe
2025-10-02T08:10:15.231765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.231769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.231782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533743647517960:10265]
2025-10-02T08:10:15.231792Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:15.231807Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:15.231819Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21c0204a-12f2dffc-2761127c-b577100b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:15.231824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.231826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.231828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:15.231835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.231842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:15.231861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.231919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.231920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.231931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.231961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 848 partition: 0 MaxSeqNo: 17 sessionId: src_id|21c0204a-12f2dffc-2761127c-b577100b_0
2025-10-02T08:10:15.232289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a52d2ab-f2cdce7d-b2a3efdd-8e4bd371_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|21c0204a-12f2dffc-2761127c-b577100b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:15.234945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21c0204a-12f2dffc-2761127c-b577100b_0] Write session: try to update token
2025-10-02T08:10:15.234960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21c0204a-12f2dffc-2761127c-b577100b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:15.251419Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:15.251444Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:15.251447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:15.251457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533743647517960:10265]
2025-10-02T08:10:15.251462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533743647517960:10265]
2025-10-02T08:10:15.251512Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:15.251516Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:15.251522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:15.251529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.251531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:15.251694Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:15.255751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId: src_id|21c0204a-12f2dffc-2761127c-b577100b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:15.258938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:15.298380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533743647517990:9858]
2025-10-02T08:10:15.298526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 847, pipe: [1:7556533743647517990:9858]
2025-10-02T08:10:15.394764Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:15.395507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.395523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.395565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647517990:9858], now have 1 active actors on pipe
2025-10-02T08:10:15.396920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:15.396930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:15.396988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 848 reason: error at write: Disconnected sessionId: src_id|21c0204a-12f2dffc-2761127c-b577100b_0
2025-10-02T08:10:15.397161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 848 sessionId: src_id|21c0204a-12f2dffc-2761127c-b577100b_0 is DEAD
2025-10-02T08:10:15.397127Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:15.397273Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:15.397333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533743647517990:9858]
2025-10-02T08:10:15.397503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c0204a-12f2dffc-2761127c-b577100b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:15.397513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c0204a-12f2dffc-2761127c-b577100b_0] Write session will restart in 0.007633s
2025-10-02T08:10:15.397540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c0204a-12f2dffc-2761127c-b577100b_0] Write session: Do CDS request
2025-10-02T08:10:15.397547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c0204a-12f2dffc-2761127c-b577100b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:15.406387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21c0204a-12f2dffc-2761127c-b577100b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:15.406507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:15.406525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 849
2025-10-02T08:10:15.407187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:15.407230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:15.407236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:15.407242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:15.407796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 849 sessionId:  describe result for acl check
2025-10-02T08:10:15.407828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:15.407829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:15.407830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:15.407836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533743647518214:10272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:15.408496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533743647518214:10272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:15.413308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533743647518214:10272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:15.419965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:15.421125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:15.421480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533743647518214:10272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:15.421488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533743647518214:10272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:15.421492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533743647518214:10272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:15.421499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:15.421564Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:15.421570Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:15.421587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:15.421669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:15.421716Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533743647518320:10271]
2025-10-02T08:10:15.422884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:15.423189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:15.423268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:15.423749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:15.423815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.423822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.423823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.423825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.423827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.423834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.423847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.423857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.423863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.423867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.423879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.423890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.423903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.423909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.423915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.423921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.423926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.423933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.423938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.423943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.423971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:15.433253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:15.435522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:15.435540Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:15.435543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:15.435546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:15.435553Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 848 [1:7556533743647518320:10271]
2025-10-02T08:10:15.435565Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:15.435588Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:15.435590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.435593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.435594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.435611Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:15.435615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:15.435622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:15.435687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.435689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.435692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:15.435694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:15.435756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:15.435759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.435770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.435779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:15.435795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533743647518312:10271]
2025-10-02T08:10:15.435796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533743647518312:10271]
2025-10-02T08:10:15.435809Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:15.435820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:15.435829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:15.435831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:15.435867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533743647518312:10271]
2025-10-02T08:10:15.435868Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:15.435883Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:15.435896Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:15.435903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:15.435986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 848
2025-10-02T08:10:15.435996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647518322:10272], now have 1 active actors on pipe
2025-10-02T08:10:15.436078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533744107646934:2378], now have 1 active actors on pipe
2025-10-02T08:10:15.436083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.436086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.436110Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:15.436116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.436119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.436121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:15.436131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.436142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:15.436158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.436245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.436247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.436263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.436298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 849 partition: 0 MaxSeqNo: 17 sessionId: src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0
2025-10-02T08:10:15.437205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c0204a-12f2dffc-2761127c-b577100b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:15.437917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 848
2025-10-02T08:10:15.441390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0] Write session: try to update token
2025-10-02T08:10:15.441412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:15.457884Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:15.457913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:15.457916Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:15.457929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533743647518312:10271]
2025-10-02T08:10:15.457936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533743647518312:10271]
2025-10-02T08:10:15.458002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:15.458010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.458008Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:15.458013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:15.458017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:15.458193Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:15.468178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId: src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:15.471459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:15.500701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533743647518353:9858]
2025-10-02T08:10:15.500958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 848, pipe: [1:7556533743647518353:9858]
2025-10-02T08:10:15.621331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:15.621350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0] Write session will restart in 0.006619s
2025-10-02T08:10:15.621379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0] Write session: Do CDS request
2025-10-02T08:10:15.621388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:15.621748Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:15.619592Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:15.620122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.620131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.620153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647518353:9858], now have 1 active actors on pipe
2025-10-02T08:10:15.620443Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:15.620684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:15.620728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 849 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0
2025-10-02T08:10:15.620926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 849 sessionId: src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0 is DEAD
2025-10-02T08:10:15.621073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533743647518353:9858]
2025-10-02T08:10:15.629389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:15.633057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:15.633078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 850
2025-10-02T08:10:15.633266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:15.633315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:15.633320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:15.633325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:15.633884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 850 sessionId:  describe result for acl check
2025-10-02T08:10:15.633915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:15.633916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:15.633918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:15.633923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533743647518548:10279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:15.634503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533743647518548:10279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:15.640706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533743647518548:10279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:15.653579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:15.654226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533743647518548:10279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:15.654235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533743647518548:10279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:15.654239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533743647518548:10279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:15.654249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:15.659047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:15.659377Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:15.659383Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:15.659398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:15.659456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:15.659592Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533743647518693:10278]
2025-10-02T08:10:15.660389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:15.660704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:15.660758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:15.661135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:15.661180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.661182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.661183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.661185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.661187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.661193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.661205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.661211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.661215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.661220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.661227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.661236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.661243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.661249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.661259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.661265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.661271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.661278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.661283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.661290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.661313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:15.674702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:15.677142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:15.677178Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:15.677181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:15.677186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:15.677193Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 849 [1:7556533743647518693:10278]
2025-10-02T08:10:15.677209Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:15.677231Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:15.677234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.677238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.677240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.677259Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:15.677265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:15.677272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:15.677364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.677367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.677370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:15.677373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:15.677463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:15.677467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.677483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.677497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:15.677513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533743647518681:10278]
2025-10-02T08:10:15.677516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533743647518681:10278]
2025-10-02T08:10:15.677532Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:15.677547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:15.677562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:15.677566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:15.677604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533743647518681:10278]
2025-10-02T08:10:15.677606Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:15.678524Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 849
2025-10-02T08:10:15.680989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab10e2d-6e92fa23-9f24a8cb-1d07e045_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:15.684303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0] Write session: try to update token
2025-10-02T08:10:15.684329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:15.677785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:15.677789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:15.677796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:15.678008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 849
2025-10-02T08:10:15.678022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647518689:10279], now have 1 active actors on pipe
2025-10-02T08:10:15.678045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533744107646954:2378], now have 1 active actors on pipe
2025-10-02T08:10:15.678051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.678056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.678082Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:15.678089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.678094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.678097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:15.678107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.678118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:15.678135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.678388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.678392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.678408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.678443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 850 partition: 0 MaxSeqNo: 17 sessionId: src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0
2025-10-02T08:10:15.706740Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:15.706771Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:15.706774Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:15.706788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533743647518681:10278]
2025-10-02T08:10:15.706795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533743647518681:10278]
2025-10-02T08:10:15.706855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:15.706865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.706869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:15.707058Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:15.708921Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:15.708928Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:15.724759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533743647518731:9858]
2025-10-02T08:10:15.725022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 849, pipe: [1:7556533743647518731:9858]
2025-10-02T08:10:15.730692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId: src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:15.733536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:15.882480Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:15.883047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647518731:9858], now have 1 active actors on pipe
2025-10-02T08:10:15.883065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.883071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.883212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:15.883219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:15.883271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 850 reason: error at write: Disconnected sessionId: src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0
2025-10-02T08:10:15.883445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 850 sessionId: src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0 is DEAD
2025-10-02T08:10:15.883981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:15.883646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533743647518731:9858]
2025-10-02T08:10:15.883825Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:15.885077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:15.885090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0] Write session will restart in 0.005393s
2025-10-02T08:10:15.885123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0] Write session: Do CDS request
2025-10-02T08:10:15.885130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:15.891616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:15.892986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:15.893011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 851
2025-10-02T08:10:15.893319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:15.893368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:15.893375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:15.893379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:15.893878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 851 sessionId:  describe result for acl check
2025-10-02T08:10:15.893908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:15.893910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:15.893911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:15.893917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533743647518942:10298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:15.894505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533743647518942:10298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:15.902646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533743647518942:10298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:15.908579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:15.912536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:15.912845Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:15.912856Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:15.912872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:15.912940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:15.912985Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533743647519099:10297]
2025-10-02T08:10:15.913592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533743647518942:10298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:15.913600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533743647518942:10298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:15.913604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533743647518942:10298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:15.913615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:15.913664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:15.914391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:15.914448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:15.914750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:15.914803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.914812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.914814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.914815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.914816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.914823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.914836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.914844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.914849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.914856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.914862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.914871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:15.914878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.914884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:15.914894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.914900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:15.914908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.914914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.914919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.914924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.914946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:15.934618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:15.937222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:15.937254Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:15.937257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:15.937268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:15.937277Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 850 [1:7556533743647519099:10297]
2025-10-02T08:10:15.937293Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:15.937318Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:15.937322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.937325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.937327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.937348Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:15.937354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:15.937363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:15.937457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.937459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.937462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:15.937466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:15.937557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:15.937560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.937581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:15.937595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:15.937616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533743647519093:10297]
2025-10-02T08:10:15.937619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533743647519093:10297]
2025-10-02T08:10:15.938360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 850
2025-10-02T08:10:15.937636Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:15.937657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:15.937673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:15.937677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:15.937723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533743647519093:10297]
2025-10-02T08:10:15.937725Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:15.938090Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:15.938094Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:15.938100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:15.938169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 850
2025-10-02T08:10:15.938186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647519105:10298], now have 1 active actors on pipe
2025-10-02T08:10:15.938191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533744107646983:2378], now have 1 active actors on pipe
2025-10-02T08:10:15.938478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.938483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.938515Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc72620d-928ff253-c292b9ea-d08aa780_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:15.938526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:15.938532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:15.938534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:15.938547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:15.938561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:15.938579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.939036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:15.939048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:15.939077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:15.939116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 851 partition: 0 MaxSeqNo: 17 sessionId: src_id|fc72620d-928ff253-c292b9ea-d08aa780_0
2025-10-02T08:10:15.944949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f812cc-b12fbc3a-6b74fbbd-289ddc94_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fc72620d-928ff253-c292b9ea-d08aa780_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:15.948525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc72620d-928ff253-c292b9ea-d08aa780_0] Write session: try to update token
2025-10-02T08:10:15.948551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc72620d-928ff253-c292b9ea-d08aa780_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:15.964525Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:15.964550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:15.964553Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:15.964563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533743647519093:10297]
2025-10-02T08:10:15.964569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533743647519093:10297]
2025-10-02T08:10:15.964622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:15.964630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:15.964632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:15.964643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:15.964663Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:15.964799Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:15.974638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId: src_id|fc72620d-928ff253-c292b9ea-d08aa780_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:15.977491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:15.983943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533743647519135:9858]
2025-10-02T08:10:15.984247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 850, pipe: [1:7556533743647519135:9858]
2025-10-02T08:10:16.116970Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:16.118003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:16.118376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc72620d-928ff253-c292b9ea-d08aa780_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:16.118392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc72620d-928ff253-c292b9ea-d08aa780_0] Write session will restart in 0.009242s
2025-10-02T08:10:16.118422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc72620d-928ff253-c292b9ea-d08aa780_0] Write session: Do CDS request
2025-10-02T08:10:16.118429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc72620d-928ff253-c292b9ea-d08aa780_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:16.117559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.117577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.117601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533743647519135:9858], now have 1 active actors on pipe
2025-10-02T08:10:16.117858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533743647519135:9858]
2025-10-02T08:10:16.117880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:16.117883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:16.117985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 851 reason: error at write: Disconnected sessionId: src_id|fc72620d-928ff253-c292b9ea-d08aa780_0
2025-10-02T08:10:16.118109Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:16.118211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 851 sessionId: src_id|fc72620d-928ff253-c292b9ea-d08aa780_0 is DEAD
2025-10-02T08:10:16.129406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc72620d-928ff253-c292b9ea-d08aa780_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:16.133220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:16.133245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 852
2025-10-02T08:10:16.136947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:16.137012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:16.137016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:16.137021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:16.137565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 852 sessionId:  describe result for acl check
2025-10-02T08:10:16.137610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:16.137612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:16.137613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:16.137617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533747942486705:10305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:16.140146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533747942486705:10305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:16.144631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:16.147878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533747942486705:10305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:16.148973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:16.149201Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:16.149219Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:16.149228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:16.149271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:16.149302Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533747942486763:10304]
2025-10-02T08:10:16.149928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:16.150121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:16.150159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:16.150399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:16.150425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.150433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.150434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.150435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.150436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.150440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.150446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.150449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.150451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.150453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.150457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.150461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.150466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.150469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.150471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.150474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.150477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.150480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.150483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.150486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.150497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:16.153929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533747942486705:10305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:16.153954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533747942486705:10305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:16.153959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533747942486705:10305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:16.153970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:16.160860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:16.163404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:16.163414Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:16.163422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:16.163429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:16.163440Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 851 [1:7556533747942486763:10304]
2025-10-02T08:10:16.163460Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:16.163503Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:16.163509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:16.163513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:16.163516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:16.163540Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:16.163551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:16.163561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:16.163672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.163676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.163681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:16.163684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:16.163785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:16.163788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.163811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.163825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:16.163850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533747942486739:10304]
2025-10-02T08:10:16.163852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533747942486739:10304]
2025-10-02T08:10:16.163862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:16.163878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:16.163893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:16.163897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:16.163947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533747942486739:10304]
2025-10-02T08:10:16.163950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:16.164145Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:16.164149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:16.164156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:16.165028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 851
2025-10-02T08:10:16.165061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533747942486783:10305], now have 1 active actors on pipe
2025-10-02T08:10:16.165065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533748402614288:2378], now have 1 active actors on pipe
2025-10-02T08:10:16.165138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.165102Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 851
2025-10-02T08:10:16.165152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.165189Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:16.165208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:16.165220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:16.165223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:16.165238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:16.165261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:16.165297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:16.165649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.165662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.165684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:16.165728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 852 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0
2025-10-02T08:10:16.166225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc72620d-928ff253-c292b9ea-d08aa780_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:16.169805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0] Write session: try to update token
2025-10-02T08:10:16.169832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:16.185784Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:16.185809Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:16.185812Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:16.185822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533747942486739:10304]
2025-10-02T08:10:16.185831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533747942486739:10304]
2025-10-02T08:10:16.185880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:16.185888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.185895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:16.186068Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:16.187909Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:16.187930Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:16.188030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId: src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:16.191638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:16.218502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533747942486798:9858]
2025-10-02T08:10:16.218676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 851, pipe: [1:7556533747942486798:9858]
2025-10-02T08:10:16.344363Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:16.344958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.344982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.345029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533747942486798:9858], now have 1 active actors on pipe
2025-10-02T08:10:16.345215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:16.345223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:16.345284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 852 reason: error at write: Disconnected sessionId: src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0
2025-10-02T08:10:16.345446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 852 sessionId: src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0 is DEAD
2025-10-02T08:10:16.345556Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:16.345576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533747942486798:9858]
2025-10-02T08:10:16.345891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:16.345900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0] Write session will restart in 0.006808s
2025-10-02T08:10:16.345925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0] Write session: Do CDS request
2025-10-02T08:10:16.345937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:16.345948Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:16.359050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:16.360247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:16.360263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 853
2025-10-02T08:10:16.360412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:16.360438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:16.360444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:16.360448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:16.360932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 853 sessionId:  describe result for acl check
2025-10-02T08:10:16.360969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:16.360971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:16.360972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:16.360978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533747942487097:10311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:16.361487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533747942487097:10311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:16.362123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:16.365165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533747942487097:10311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:16.369000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:16.369242Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:16.369246Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:16.369256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:16.369307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:16.369345Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533747942487134:10310]
2025-10-02T08:10:16.370027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:16.370346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:16.370395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:16.370721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:16.370760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.370769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.370770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.370771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.370773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.370779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.370791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.370796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.370800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.370804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.370814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.370822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.370829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.370835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.370840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.370846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.370852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.370858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.370863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.370869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.370893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:16.373110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533747942487097:10311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:16.373127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533747942487097:10311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:16.373131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533747942487097:10311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:16.373141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:16.383784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:16.385959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:16.385967Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:16.385970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:16.385974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:16.385982Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 852 [1:7556533747942487134:10310]
2025-10-02T08:10:16.385997Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:16.386019Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:16.386022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:16.386026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:16.386028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:16.386046Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:16.386052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:16.386059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:16.386135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.386138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.386141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:16.386144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:16.386228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:16.386231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.386248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.386260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:16.386278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533747942487103:10310]
2025-10-02T08:10:16.386280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533747942487103:10310]
2025-10-02T08:10:16.386296Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:16.386310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:16.386327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:16.386330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:16.386366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533747942487103:10310]
2025-10-02T08:10:16.386368Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:16.387474Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 852
2025-10-02T08:10:16.386618Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:16.386628Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:16.386635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:16.387579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 852
2025-10-02T08:10:16.387595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533747942487150:10311], now have 1 active actors on pipe
2025-10-02T08:10:16.387600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533748402614296:2378], now have 1 active actors on pipe
2025-10-02T08:10:16.388382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0cea1c8-5b4253e5-9c6a93ef-f9930f3b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|becd28f0-488204f4-d6394815-d468fdc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:16.391615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|becd28f0-488204f4-d6394815-d468fdc9_0] Write session: try to update token
2025-10-02T08:10:16.391637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|becd28f0-488204f4-d6394815-d468fdc9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:16.387764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.387775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.387808Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|becd28f0-488204f4-d6394815-d468fdc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:16.387816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:16.387821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:16.387823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:16.387835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:16.387850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:16.387870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:16.387902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.387904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.387917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:16.387949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 853 partition: 0 MaxSeqNo: 17 sessionId: src_id|becd28f0-488204f4-d6394815-d468fdc9_0
2025-10-02T08:10:16.428570Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:16.428597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:16.428599Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:16.428608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533747942487103:10310]
2025-10-02T08:10:16.428613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533747942487103:10310]
2025-10-02T08:10:16.428654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:16.428661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.428664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:16.428864Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:16.432957Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:16.432981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:16.433351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId: src_id|becd28f0-488204f4-d6394815-d468fdc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:16.436291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:16.446799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533747942487168:9858]
2025-10-02T08:10:16.447567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 852, pipe: [1:7556533747942487168:9858]
2025-10-02T08:10:16.592021Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:16.592593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.592612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.592654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533747942487168:9858], now have 1 active actors on pipe
2025-10-02T08:10:16.595188Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:16.596090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becd28f0-488204f4-d6394815-d468fdc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:16.596102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becd28f0-488204f4-d6394815-d468fdc9_0] Write session will restart in 0.006329s
2025-10-02T08:10:16.595690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:16.595753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 853 reason: status is not ok: tablet will be restarted right now sessionId: src_id|becd28f0-488204f4-d6394815-d468fdc9_0
2025-10-02T08:10:16.595916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533747942487168:9858]
2025-10-02T08:10:16.595939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 853 sessionId: src_id|becd28f0-488204f4-d6394815-d468fdc9_0 is DEAD
2025-10-02T08:10:16.596125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becd28f0-488204f4-d6394815-d468fdc9_0] Write session: Do CDS request
2025-10-02T08:10:16.596135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becd28f0-488204f4-d6394815-d468fdc9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:16.596910Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:16.605386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|becd28f0-488204f4-d6394815-d468fdc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:16.609477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:16.609503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 854
2025-10-02T08:10:16.609840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:16.609882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:16.609887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:16.609892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:16.610396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 854 sessionId:  describe result for acl check
2025-10-02T08:10:16.610436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:16.610442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:16.610444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:16.610449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533747942487448:10318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:16.611022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533747942487448:10318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:16.614395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533747942487448:10318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:16.617922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:16.618300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533747942487448:10318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:16.618307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533747942487448:10318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:16.618311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533747942487448:10318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:16.618320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:16.618739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:16.618910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:16.618914Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:16.618924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:16.618973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:16.619009Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533747942487518:10317]
2025-10-02T08:10:16.619596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:16.621948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:16.622029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:16.622357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:16.622416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.622417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.622418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.622420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.622421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.622427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.622437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.622441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.622444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.622452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.622458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.622465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.622471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.622476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.622480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.622485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.622488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.622492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.622496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.622501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.622522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:16.634950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:16.637256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:16.637281Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:16.637284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:16.637288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:16.637296Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 853 [1:7556533747942487518:10317]
2025-10-02T08:10:16.637309Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:16.637330Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:16.637333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:16.637340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:16.637342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:16.637362Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:16.637374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:16.637385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:16.637466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.637473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.637476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:16.637479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:16.637554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:16.637567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.637582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.637594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:16.637614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533747942487513:10318], now have 1 active actors on pipe
2025-10-02T08:10:16.637621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533747942487505:10317]
2025-10-02T08:10:16.637623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533747942487505:10317]
2025-10-02T08:10:16.637632Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:16.637647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533748402614305:2378], now have 1 active actors on pipe
2025-10-02T08:10:16.637646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:16.637650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:16.637654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:16.637660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 853
2025-10-02T08:10:16.637668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:16.637671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:16.637708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.637718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.637732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533747942487505:10317]
2025-10-02T08:10:16.637739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:16.637746Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:16.637770Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:16.637781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:16.637785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:16.637793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:16.637802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:16.637812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:16.637749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 853
2025-10-02T08:10:16.637847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:16.637894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.637901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.637915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:16.637956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 854 partition: 0 MaxSeqNo: 17 sessionId: src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0
2025-10-02T08:10:16.638343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becd28f0-488204f4-d6394815-d468fdc9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:16.641307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0] Write session: try to update token
2025-10-02T08:10:16.641328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:16.661786Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:16.661813Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:16.661817Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:16.661827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533747942487505:10317]
2025-10-02T08:10:16.661831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533747942487505:10317]
2025-10-02T08:10:16.661880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:16.661886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.661889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:16.662045Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:16.662353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId: src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:16.662798Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:16.662814Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:16.665138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:16.696441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533747942487543:9858]
2025-10-02T08:10:16.696980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 853, pipe: [1:7556533747942487543:9858]
2025-10-02T08:10:16.818799Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:16.819245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.819253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.819293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533747942487543:9858], now have 1 active actors on pipe
2025-10-02T08:10:16.819926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:16.820060Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:16.820390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:16.820430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 854 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0
2025-10-02T08:10:16.820572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 854 sessionId: src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0 is DEAD
2025-10-02T08:10:16.820706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533747942487543:9858]
2025-10-02T08:10:16.821005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:16.821018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0] Write session will restart in 0.005009s
2025-10-02T08:10:16.821047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0] Write session: Do CDS request
2025-10-02T08:10:16.821054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:16.827683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:16.827797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:16.827816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 855
2025-10-02T08:10:16.829235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:16.829287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:16.829297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:16.829301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:16.829669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 855 sessionId:  describe result for acl check
2025-10-02T08:10:16.829696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:16.829697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:16.829698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:16.829703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533747942487778:10331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:16.830165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533747942487778:10331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:16.832920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533747942487778:10331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:16.838247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:16.842178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533747942487778:10331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:16.842201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533747942487778:10331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:16.842205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533747942487778:10331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:16.842213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:16.842732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:16.842992Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:16.842995Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:16.843006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:16.843061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:16.843095Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533747942487913:10330]
2025-10-02T08:10:16.843723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:16.843981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:16.844039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:16.844728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:16.844791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.844792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.844793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.844794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.844795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.844822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.844831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.844834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.844838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.844841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.844847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.844854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:16.844862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.844866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:16.844871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.844875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:16.844878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.844883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.844887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.844891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.844908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:16.853658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:16.855670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:16.855695Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:16.855697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:16.855701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:16.855707Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 854 [1:7556533747942487913:10330]
2025-10-02T08:10:16.855720Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:16.855741Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:16.855744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:16.855746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:16.855748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:16.855764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:16.855770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:16.855784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:16.855857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.855866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.855869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:16.855871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:16.855968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:16.855976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.855991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:16.856008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:16.856022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 854
2025-10-02T08:10:16.856028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533747942487910:10331], now have 1 active actors on pipe
2025-10-02T08:10:16.856036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533747942487903:10330]
2025-10-02T08:10:16.856038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533747942487903:10330]
2025-10-02T08:10:16.856047Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:16.856059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533748402614335:2378], now have 1 active actors on pipe
2025-10-02T08:10:16.856069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:16.856083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:16.856092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:16.856098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.856102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.856143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533747942487903:10330]
2025-10-02T08:10:16.856150Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:16.856166Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58630216-31cac523-864db03d-5ca754b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:16.856177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:16.856186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:16.856188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:16.856197Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:16.856199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:16.856206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:16.856207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:16.856212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:16.856263Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 854
2025-10-02T08:10:16.856241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:16.856347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:16.856352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:16.856387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:16.856424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 855 partition: 0 MaxSeqNo: 17 sessionId: src_id|58630216-31cac523-864db03d-5ca754b2_0
2025-10-02T08:10:16.856776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17faa2a6-8e5d52ef-8202916b-498916b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|58630216-31cac523-864db03d-5ca754b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:16.859349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58630216-31cac523-864db03d-5ca754b2_0] Write session: try to update token
2025-10-02T08:10:16.859363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58630216-31cac523-864db03d-5ca754b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:16.877726Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:16.877757Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:16.877760Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:16.877770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533747942487903:10330]
2025-10-02T08:10:16.877774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533747942487903:10330]
2025-10-02T08:10:16.877833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:16.877842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:16.877842Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:16.877845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:16.877848Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:16.878064Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:16.888336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId: src_id|58630216-31cac523-864db03d-5ca754b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:16.891298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:16.920900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533747942487963:9858]
2025-10-02T08:10:16.921288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 854, pipe: [1:7556533747942487963:9858]
2025-10-02T08:10:17.049248Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:17.049909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.049926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.049949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533747942487963:9858], now have 1 active actors on pipe
2025-10-02T08:10:17.050163Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:17.050590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533747942487963:9858]
2025-10-02T08:10:17.050613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:17.050661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 855 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58630216-31cac523-864db03d-5ca754b2_0
2025-10-02T08:10:17.050929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 855 sessionId: src_id|58630216-31cac523-864db03d-5ca754b2_0 is DEAD
2025-10-02T08:10:17.051075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58630216-31cac523-864db03d-5ca754b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:17.051093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58630216-31cac523-864db03d-5ca754b2_0] Write session will restart in 0.007718s
2025-10-02T08:10:17.051121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58630216-31cac523-864db03d-5ca754b2_0] Write session: Do CDS request
2025-10-02T08:10:17.051133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58630216-31cac523-864db03d-5ca754b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:17.050304Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:17.061342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58630216-31cac523-864db03d-5ca754b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.061804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:17.061822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 856
2025-10-02T08:10:17.062035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.062069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:17.062073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:17.062076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:17.062676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 856 sessionId:  describe result for acl check
2025-10-02T08:10:17.062716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:17.062722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:17.062723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:17.062728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533752237455522:10344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:17.063255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533752237455522:10344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:17.066942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533752237455522:10344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:17.072631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:17.072672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533752237455522:10344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:17.072679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533752237455522:10344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:17.072682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533752237455522:10344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:17.072689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:17.073223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:17.073399Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:17.073410Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:17.073420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:17.073465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:17.073506Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533752237455609:10343]
2025-10-02T08:10:17.074182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:17.074334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:17.074386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:17.074939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:17.074994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.075001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.075002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.075003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.075004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.075010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.075020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.075029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.075036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.075042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.075052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.075065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.075075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.075081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.075090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.075097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.075106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.075116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.075121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.075131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.075155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:17.085971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:17.087537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:17.087558Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:17.087561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:17.087566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:17.087573Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 855 [1:7556533752237455609:10343]
2025-10-02T08:10:17.087586Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:17.087605Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:17.087608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.087611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.087613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.087630Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:17.087637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:17.087650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:17.087717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.087724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.087728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:17.087731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:17.087809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:17.087820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.087835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.087849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:17.087860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 855
2025-10-02T08:10:17.087869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237455603:10344], now have 1 active actors on pipe
2025-10-02T08:10:17.087880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533752237455597:10343]
2025-10-02T08:10:17.087883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533752237455597:10343]
2025-10-02T08:10:17.087898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:17.087908Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:17.087910Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:17.087913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.087918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.087932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533752697581649:2378], now have 1 active actors on pipe
2025-10-02T08:10:17.087944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:17.087958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:17.087966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:17.088024Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f93c33c0-65af9391-ff99317d-d543fe39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:17.088034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.088038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.088040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:17.087967Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 855
2025-10-02T08:10:17.088048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.088061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:17.088073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533752237455597:10343]
2025-10-02T08:10:17.088082Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:17.088106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:17.088117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:17.088194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.088203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.088217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:17.088259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 856 partition: 0 MaxSeqNo: 17 sessionId: src_id|f93c33c0-65af9391-ff99317d-d543fe39_0
2025-10-02T08:10:17.089634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58630216-31cac523-864db03d-5ca754b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f93c33c0-65af9391-ff99317d-d543fe39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:17.093204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93c33c0-65af9391-ff99317d-d543fe39_0] Write session: try to update token
2025-10-02T08:10:17.093230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93c33c0-65af9391-ff99317d-d543fe39_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:17.099964Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:17.099988Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:17.099999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533752237455597:10343]
2025-10-02T08:10:17.100047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:17.100049Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:17.100241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:17.100440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:17.100583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:17.100736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:17.101096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:17.101142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:17.114780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId: src_id|f93c33c0-65af9391-ff99317d-d543fe39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:17.117525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:17.117575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.117583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.117618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:17.117678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:17.122971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.122999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.123172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.123270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.123340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.123411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.123459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.123468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.123550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.123615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.123687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.123797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.123940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.123948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.124035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.124097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.124163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.124230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.124276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.124284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.124354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.124421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.124487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.124553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.124608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.124616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.124679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.124739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.124821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.124893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.124959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.124967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.125039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.125102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.125166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.125236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.125375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.125384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.125457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.125526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.125600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.125672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.125720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.125728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.125804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.125874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.125943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.126030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.126173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.126182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.126251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.126318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.126392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.126467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.126581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.126589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.126662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:17.126728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:17.126795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:17.126865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:17.126914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:17.126922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:17.126972Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:17.126980Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:17.126983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:17.126993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533752237455597:10343]
2025-10-02T08:10:17.126997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533752237455597:10343]
2025-10-02T08:10:17.127050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:17.127054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:17.127060Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:17.127121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.127147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.127154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:17.127187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:17.127205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:17.127213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:17.127216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:17.127219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:17.127663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:17.127694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:17.127704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:17.127709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:17.127712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:17.127716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:17.128578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:17.128604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:17.128615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:17.128619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:17.128622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:17.128631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:17.129322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:17.129349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:17.129355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:17.129360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:17.129364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:17.131779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:17.131804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:17.131817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392617131
2025-10-02T08:10:17.131946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:17.131960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:17.131971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:17.131975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:17.131979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:17.131983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:17.132640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:17.132667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:17.132672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:17.132677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:17.132680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:17.132684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:17.133218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:17.133243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:17.133252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:17.133263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:17.133268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:17.133271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:17.133762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:17.133788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:17.133794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:17.134962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:17.134986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:17.134992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:17.134997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:17.135005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392617134
2025-10-02T08:10:17.135297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:17.135320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:17.135325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:17.135331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:17.135335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:17.135339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:17.135850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:17.135875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:17.135893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:17.135897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:17.135901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:17.135905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:17.136404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:17.136426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.136535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392617136
2025-10-02T08:10:17.140742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:17.140762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.140765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:17.140942Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:17.150795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533752237455635:9858]
2025-10-02T08:10:17.150925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 855, pipe: [1:7556533752237455635:9858]
2025-10-02T08:10:17.289571Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:17.289966Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:17.289987Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:17.289994Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:17.290002Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:17.290022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237455635:9858], now have 1 active actors on pipe
2025-10-02T08:10:17.290276Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:17.291258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:17.291298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 856 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f93c33c0-65af9391-ff99317d-d543fe39_0
2025-10-02T08:10:17.291520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 856 sessionId: src_id|f93c33c0-65af9391-ff99317d-d543fe39_0 is DEAD
2025-10-02T08:10:17.291529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533752237455635:9858]
2025-10-02T08:10:17.290214Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:17.293262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93c33c0-65af9391-ff99317d-d543fe39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:17.293282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93c33c0-65af9391-ff99317d-d543fe39_0] Write session will restart in 0.009247s
2025-10-02T08:10:17.293312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93c33c0-65af9391-ff99317d-d543fe39_0] Write session: Do CDS request
2025-10-02T08:10:17.293320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93c33c0-65af9391-ff99317d-d543fe39_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:17.305486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93c33c0-65af9391-ff99317d-d543fe39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.305549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:17.305570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 857
2025-10-02T08:10:17.305761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.305798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:17.305810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:17.305814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:17.306211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 857 sessionId:  describe result for acl check
2025-10-02T08:10:17.306241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:17.306245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:17.306248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:17.306253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533752237455937:10350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:17.306748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533752237455937:10350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:17.307691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:17.309691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533752237455937:10350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:17.311299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:17.311559Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:17.311571Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:17.311583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:17.311636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:17.311664Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533752237455980:10349]
2025-10-02T08:10:17.312114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:17.312342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:17.312372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:17.312599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:17.312634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.312635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.312636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.312637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.312637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.312641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.312648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.312650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.312652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.312654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.312659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.312663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.312667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.312670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.312673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.312676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.312678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.312681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.312684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.312687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.312699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:17.313086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533752237455937:10350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:17.313101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533752237455937:10350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:17.313105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533752237455937:10350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:17.313114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:17.325410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:17.327180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:17.327186Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:17.327188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:17.327191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:17.327197Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 856 [1:7556533752237455980:10349]
2025-10-02T08:10:17.327207Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:17.327225Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:17.327228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.327230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.327232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.327248Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:17.327253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:17.327260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:17.327316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.327321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.327323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:17.327325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:17.327380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:17.327382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.327392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.327399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:17.327414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533752237455953:10349]
2025-10-02T08:10:17.327417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533752237455953:10349]
2025-10-02T08:10:17.327424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:17.327437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:17.327448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:17.327450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:17.327500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237455997:10350], now have 1 active actors on pipe
2025-10-02T08:10:17.327500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:17.327503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533752237455953:10349]
2025-10-02T08:10:17.327504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:17.327504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:17.327511Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:17.327523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533752697581656:2378], now have 1 active actors on pipe
2025-10-02T08:10:17.327548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 856
2025-10-02T08:10:17.327803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.327828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.327855Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:17.327861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.327864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.327866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:17.327873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.327882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:17.327896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:17.328101Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 856
2025-10-02T08:10:17.327934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.327944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.327956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:17.327982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 857 partition: 0 MaxSeqNo: 17 sessionId: src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0
2025-10-02T08:10:17.328603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93c33c0-65af9391-ff99317d-d543fe39_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:17.332099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0] Write session: try to update token
2025-10-02T08:10:17.332125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:17.350605Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:17.350628Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:17.350630Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:17.350640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533752237455953:10349]
2025-10-02T08:10:17.350644Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533752237455953:10349]
2025-10-02T08:10:17.350681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:17.350686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.350688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:17.350698Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:17.350704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:17.350842Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:17.362676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId: src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:17.366018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:17.392017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533752237456010:9858]
2025-10-02T08:10:17.392143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 856, pipe: [1:7556533752237456010:9858]
2025-10-02T08:10:17.499511Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:17.500093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.500130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.500149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237456010:9858], now have 1 active actors on pipe
2025-10-02T08:10:17.500289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533752237456010:9858]
2025-10-02T08:10:17.500321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:17.500324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:17.500410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 857 reason: error at write: Disconnected sessionId: src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0
2025-10-02T08:10:17.500609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 857 sessionId: src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0 is DEAD
2025-10-02T08:10:17.500659Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:17.500744Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:17.500872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:17.500888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0] Write session will restart in 0.008869s
2025-10-02T08:10:17.500930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0] Write session: Do CDS request
2025-10-02T08:10:17.500937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:17.511454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.511920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:17.511954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 858
2025-10-02T08:10:17.512134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.512198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:17.512211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:17.512215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:17.512663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 858 sessionId:  describe result for acl check
2025-10-02T08:10:17.512698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:17.512700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:17.512702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:17.512707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533752237456295:10356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:17.513299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533752237456295:10356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:17.515820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:17.516614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533752237456295:10356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:17.519738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:17.520094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533752237456295:10356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:17.520110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533752237456295:10356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:17.520114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533752237456295:10356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:17.520124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:17.520388Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:17.520413Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:17.520431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:17.520521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:17.520583Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533752237456368:10355]
2025-10-02T08:10:17.521265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:17.521513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:17.521573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:17.521861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:17.521910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.521915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.521916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.521917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.521917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.521921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.521929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.521931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.521934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.521936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.521940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.521944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.521948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.521951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.521953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.521957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.521959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.521962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.521965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.521968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.521981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:17.531673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:17.533301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:17.533321Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:17.533324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:17.533328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:17.533334Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 857 [1:7556533752237456368:10355]
2025-10-02T08:10:17.533344Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:17.533360Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:17.533363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.533365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.533367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.533385Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:17.533391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:17.533397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:17.533466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.533474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.533476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:17.533478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:17.533634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 857
2025-10-02T08:10:17.533858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:17.533867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.533878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.533886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:17.533901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237456364:10356], now have 1 active actors on pipe
2025-10-02T08:10:17.533903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533752697581666:2378], now have 1 active actors on pipe
2025-10-02T08:10:17.533907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.533910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.533925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533752237456346:10355]
2025-10-02T08:10:17.533927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533752237456346:10355]
2025-10-02T08:10:17.533941Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:17.533958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:17.533974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:17.533975Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:17.533979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:17.533984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:17.533999Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:17.534006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.534013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.534015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:17.534021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.534029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:17.533977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 857
2025-10-02T08:10:17.534058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533752237456346:10355]
2025-10-02T08:10:17.534067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:17.534080Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:17.534083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:17.534164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.534172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.534187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:17.534224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 858 partition: 0 MaxSeqNo: 17 sessionId: src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0
2025-10-02T08:10:17.534608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70ed503f-b55a2325-2b6f9ec0-33639ef4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:17.538114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0] Write session: try to update token
2025-10-02T08:10:17.538142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:17.557258Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:17.557281Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:17.557284Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:17.557294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533752237456346:10355]
2025-10-02T08:10:17.557298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533752237456346:10355]
2025-10-02T08:10:17.557346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:17.557353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.557356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:17.557361Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:17.557369Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:17.557531Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:17.567684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId: src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:17.570740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:17.600347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533752237456398:9858]
2025-10-02T08:10:17.600475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 857, pipe: [1:7556533752237456398:9858]
2025-10-02T08:10:17.706168Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:17.706655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.706668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.706689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237456398:9858], now have 1 active actors on pipe
2025-10-02T08:10:17.708465Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:17.708474Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:17.708761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:17.708835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 858 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0
2025-10-02T08:10:17.709004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 858 sessionId: src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0 is DEAD
2025-10-02T08:10:17.709146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533752237456398:9858]
2025-10-02T08:10:17.713120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:17.713134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0] Write session will restart in 0.009061s
2025-10-02T08:10:17.713162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0] Write session: Do CDS request
2025-10-02T08:10:17.713169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:17.725509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.728607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:17.729227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:17.729326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:17.729331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 859
2025-10-02T08:10:17.729403Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:17.729406Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:17.729413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:17.729450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:17.729477Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533752237456729:10362]
2025-10-02T08:10:17.729939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:17.730147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:17.730183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:17.730412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:17.730447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.730452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.730453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.730453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.730454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.730458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.730465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.730468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.730470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.730472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.730476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.730481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.730485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.730488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.730490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.730494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.730497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.730500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.730503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.730506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.730517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:17.732997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.733082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:17.733097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:17.733103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:17.735336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 859 sessionId:  describe result for acl check
2025-10-02T08:10:17.735391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:17.735394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:17.735396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:17.735404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533752237456744:10365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:17.736084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533752237456744:10365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:17.740205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:17.741991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:17.742016Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:17.742020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:17.742023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:17.742030Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 858 [1:7556533752237456729:10362]
2025-10-02T08:10:17.742043Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:17.742064Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:17.742067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.742070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.742073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.742090Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:17.742095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:17.742103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:17.742183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.742186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.742190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:17.742193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:17.742271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:17.742274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.742291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.742306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:17.742324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533752237456722:10362]
2025-10-02T08:10:17.742327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533752237456722:10362]
2025-10-02T08:10:17.742336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:17.742350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:17.742366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:17.742369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:17.742403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:17.742408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533752237456722:10362]
2025-10-02T08:10:17.742412Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:17.742412Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:17.742421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:17.743229Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 858
2025-10-02T08:10:17.744400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533752697581685:2378], now have 1 active actors on pipe
2025-10-02T08:10:17.745227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533752237456744:10365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:17.754543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533752237456744:10365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:17.754564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533752237456744:10365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:17.754568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533752237456744:10365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:17.754577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:17.754928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 858
2025-10-02T08:10:17.754947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237456784:10365], now have 1 active actors on pipe
2025-10-02T08:10:17.755019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.755037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.755076Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:17.755093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:17.755098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:17.755101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:17.755113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:17.755130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:17.755156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:17.755687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.755699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.755730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:17.755764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 859 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0
2025-10-02T08:10:17.757041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32404f69-1fd226b6-b3213b5d-51f19abe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:17.760275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0] Write session: try to update token
2025-10-02T08:10:17.760293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:17.762915Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:17.762950Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:17.762954Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:17.762968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533752237456722:10362]
2025-10-02T08:10:17.762974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533752237456722:10362]
2025-10-02T08:10:17.763036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:17.763046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.763050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:17.763246Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:17.764967Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:17.764989Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:17.794138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId: src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:17.797658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:17.811759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533752237456790:9858]
2025-10-02T08:10:17.813524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 858, pipe: [1:7556533752237456790:9858]
2025-10-02T08:10:17.929483Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:17.929915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:17.929923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:17.929941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237456790:9858], now have 1 active actors on pipe
2025-10-02T08:10:17.930089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:17.930100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:17.930149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 859 reason: error at write: Disconnected sessionId: src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0
2025-10-02T08:10:17.930206Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:17.930336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 859 sessionId: src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0 is DEAD
2025-10-02T08:10:17.930468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533752237456790:9858]
2025-10-02T08:10:17.930757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:17.933628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:17.933643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0] Write session will restart in 0.009572s
2025-10-02T08:10:17.933673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0] Write session: Do CDS request
2025-10-02T08:10:17.933680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:17.949438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.952086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:17.952111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 860
2025-10-02T08:10:17.952532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:17.952577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:17.952585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:17.952590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:17.953053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 860 sessionId:  describe result for acl check
2025-10-02T08:10:17.953089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:17.953091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:17.953093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:17.953098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533752237457010:10382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:17.953656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533752237457010:10382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:17.957208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533752237457010:10382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:17.973398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:17.979048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533752237457010:10382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:17.979070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533752237457010:10382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:17.979073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533752237457010:10382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:17.979083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:17.980401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:17.980634Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:17.980638Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:17.980649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:17.980702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:17.980737Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533752237457184:10381]
2025-10-02T08:10:17.981451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:17.982919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:17.982965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:17.983216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:17.983244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.983244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.983245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.983246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.983246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.983250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.983257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.983260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.983262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.983264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.983269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.983274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:17.983278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.983281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:17.983284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.983287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:17.983290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.983293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:17.983296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.983300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:17.983312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:18.010799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:18.014103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:18.014122Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:18.014125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:18.014129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:18.014136Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 859 [1:7556533752237457184:10381]
2025-10-02T08:10:18.014149Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:18.014168Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:18.014172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.014175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.014177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.014193Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:18.014197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:18.014204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:18.014281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.014283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.014286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:18.014289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:18.014368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:18.014372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.014385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.014398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:18.014416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533752237457170:10381]
2025-10-02T08:10:18.014418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533752237457170:10381]
2025-10-02T08:10:18.014426Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:18.014441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:18.014456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:18.014458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:18.014482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:18.014485Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:18.014502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533752237457179:10382], now have 1 active actors on pipe
2025-10-02T08:10:18.014504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533752237457170:10381]
2025-10-02T08:10:18.014507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:18.014522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533752697581715:2378], now have 1 active actors on pipe
2025-10-02T08:10:18.014630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 859
2025-10-02T08:10:18.014690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:18.014812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.014823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.014848Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:18.014856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.014863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.014865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:18.014875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.014885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:18.014902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.014977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.014982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.014994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.015038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 860 partition: 0 MaxSeqNo: 17 sessionId: src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0
2025-10-02T08:10:18.015198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 859
2025-10-02T08:10:18.017068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d864354-fc0244d5-46def0d9-b62bb0da_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:18.020646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0] Write session: try to update token
2025-10-02T08:10:18.020672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:18.033029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533756532424502:9858]
2025-10-02T08:10:18.033828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 859, pipe: [1:7556533756532424502:9858]
2025-10-02T08:10:18.033849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533756532424502:9858], now have 1 active actors on pipe
2025-10-02T08:10:18.040760Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:18.040783Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:18.040786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:18.040796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533752237457170:10381]
2025-10-02T08:10:18.040816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533752237457170:10381]
2025-10-02T08:10:18.040859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:18.040871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.040873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:18.041028Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:18.045111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:18.045128Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:18.060506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId: src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:18.063297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:18.129335Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:10:18.129365Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-02T08:10:18.243581Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:18.244416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.244424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.245426Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:18.245458Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-02T08:10:18.247331Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:18.247661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533756532424502:9858]
2025-10-02T08:10:18.247677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:18.247730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 860 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0
2025-10-02T08:10:18.247879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 860 sessionId: src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0 is DEAD
2025-10-02T08:10:18.248244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:18.248267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0] Write session will restart in 0.007980s
2025-10-02T08:10:18.248300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0] Write session: Do CDS request
2025-10-02T08:10:18.248307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:18.257461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:18.261270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:18.261289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 861
2025-10-02T08:10:18.261437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:18.261464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:18.261469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:18.261474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:18.261851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 861 sessionId:  describe result for acl check
2025-10-02T08:10:18.261877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:18.261878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:18.261880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:18.261886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533756532424524:10390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:18.262413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533756532424524:10390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:18.265545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533756532424524:10390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:18.272191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533756532424524:10390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:18.272208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533756532424524:10390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:18.272210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533756532424524:10390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:18.272217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:18.285714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:18.287894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:18.288135Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:18.288148Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:18.288158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:18.288213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:18.288273Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533756532424867:10389]
2025-10-02T08:10:18.288987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:18.289265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:18.289331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:18.289713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:18.289780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.289787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.289789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.289790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.289792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.289798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.289811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.289816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.289822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.289828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.289835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.289844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.289857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.289866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.289876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.289885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.289895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.289901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.289913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.289925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.289951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:18.299458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:18.301092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:18.301115Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:18.301118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:18.301122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:18.301129Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 860 [1:7556533756532424867:10389]
2025-10-02T08:10:18.301143Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:18.301163Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:18.301165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.301169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.301171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.301187Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:18.301193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:18.301199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:18.301266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.301276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.301279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:18.301282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:18.301374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:18.301383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.301397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.301410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:18.301429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533756532424722:10390], now have 1 active actors on pipe
2025-10-02T08:10:18.301453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533756532424861:10389]
2025-10-02T08:10:18.301456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533756532424861:10389]
2025-10-02T08:10:18.301463Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:18.301474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:18.301489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:18.301497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:18.301503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533756992549019:2378], now have 1 active actors on pipe
2025-10-02T08:10:18.301533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533756532424861:10389]
2025-10-02T08:10:18.301541Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:18.301596Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:18.301614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:18.301622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:18.302018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 860
2025-10-02T08:10:18.302125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.302129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.302155Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|124678c-7bea7851-6a0edda4-86c9ad62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:18.302162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.302167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.302168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:18.302179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.302189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:18.302205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.303707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.303723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.303754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.303798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 861 partition: 0 MaxSeqNo: 17 sessionId: src_id|124678c-7bea7851-6a0edda4-86c9ad62_0
2025-10-02T08:10:18.304295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23577605-9b9fab67-fc5c0ba6-cdee5559_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|124678c-7bea7851-6a0edda4-86c9ad62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:18.304936Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 860
2025-10-02T08:10:18.305249Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:10:18.305766Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 6 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:10:18.305814Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:10:18.307851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124678c-7bea7851-6a0edda4-86c9ad62_0] Write session: try to update token
2025-10-02T08:10:18.307873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124678c-7bea7851-6a0edda4-86c9ad62_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:18.320869Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:18.320890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:18.320894Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:18.320903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533756532424861:10389]
2025-10-02T08:10:18.320908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533756532424861:10389]
2025-10-02T08:10:18.320954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:18.320961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.320964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:18.321111Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:18.324005Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:18.324023Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:18.332379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId: src_id|124678c-7bea7851-6a0edda4-86c9ad62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:18.335089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:18.347363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533756532424894:9858]
2025-10-02T08:10:18.349251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 860, pipe: [1:7556533756532424894:9858]
2025-10-02T08:10:18.486670Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:18.487244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.487259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.487279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533756532424894:9858], now have 1 active actors on pipe
2025-10-02T08:10:18.487527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533756532424894:9858]
2025-10-02T08:10:18.487582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:18.487596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:18.487659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 861 reason: error at write: Disconnected sessionId: src_id|124678c-7bea7851-6a0edda4-86c9ad62_0
2025-10-02T08:10:18.487661Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:18.487848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 861 sessionId: src_id|124678c-7bea7851-6a0edda4-86c9ad62_0 is DEAD
2025-10-02T08:10:18.488115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:18.488592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124678c-7bea7851-6a0edda4-86c9ad62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:18.488607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124678c-7bea7851-6a0edda4-86c9ad62_0] Write session will restart in 0.006508s
2025-10-02T08:10:18.488638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124678c-7bea7851-6a0edda4-86c9ad62_0] Write session: Do CDS request
2025-10-02T08:10:18.488645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124678c-7bea7851-6a0edda4-86c9ad62_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:18.496581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124678c-7bea7851-6a0edda4-86c9ad62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:18.498535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:18.498552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 862
2025-10-02T08:10:18.498872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:18.498940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:18.498947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:18.498953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:18.500130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 862 sessionId:  describe result for acl check
2025-10-02T08:10:18.500176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:18.500178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:18.500180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:18.500186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533756532425085:10397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:18.500859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533756532425085:10397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:18.504164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533756532425085:10397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:18.508167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533756532425085:10397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:18.508189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533756532425085:10397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:18.508193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533756532425085:10397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:18.508203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:18.511510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:18.516024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:18.516383Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:18.516399Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:18.516415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:18.516492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:18.516549Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533756532425261:10396]
2025-10-02T08:10:18.517268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:18.517543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:18.517595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:18.517984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:18.518032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.518034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.518035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.518037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.518039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.518046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.518058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.518064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.518070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.518075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.518084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.518093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.518101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.518109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.518115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.518122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.518127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.518134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.518141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.518149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.518174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:18.529648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:18.531952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:18.531983Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:18.531986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:18.531990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:18.531997Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 861 [1:7556533756532425261:10396]
2025-10-02T08:10:18.532010Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:18.532029Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:18.532032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.532035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.532038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.532055Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:18.532060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:18.532067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:18.532147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.532156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.532159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:18.532162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:18.532236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:18.532244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.532259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.532277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:18.532298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533756532425255:10396]
2025-10-02T08:10:18.532300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533756532425255:10396]
2025-10-02T08:10:18.532314Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:18.532327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:18.532342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:18.532345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:18.532376Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:18.532381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:18.532381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533756532425255:10396]
2025-10-02T08:10:18.532384Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:18.532387Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:18.532445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 861
2025-10-02T08:10:18.532454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533756532425240:10397], now have 1 active actors on pipe
2025-10-02T08:10:18.532460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.532464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.532488Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:18.532494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.532497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.532499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:18.532508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.532517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:18.532535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.532566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533756992549032:2378], now have 1 active actors on pipe
2025-10-02T08:10:18.533205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.533214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.533234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.533272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 862 partition: 0 MaxSeqNo: 17 sessionId: src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0
2025-10-02T08:10:18.533707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124678c-7bea7851-6a0edda4-86c9ad62_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:18.532963Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 861
2025-10-02T08:10:18.536619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0] Write session: try to update token
2025-10-02T08:10:18.536637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:18.552446Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:18.552474Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:18.552476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:18.552487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533756532425255:10396]
2025-10-02T08:10:18.552491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533756532425255:10396]
2025-10-02T08:10:18.552540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:18.552544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:18.552551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:18.552552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.552555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:18.552729Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:18.563484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId: src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:18.566284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:18.587509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533756532425291:9858]
2025-10-02T08:10:18.589065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 861, pipe: [1:7556533756532425291:9858]
2025-10-02T08:10:18.707178Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:18.707873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.707886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.707918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533756532425291:9858], now have 1 active actors on pipe
2025-10-02T08:10:18.708625Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:18.708352Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:18.708684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533756532425291:9858]
2025-10-02T08:10:18.708704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:18.708762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 862 reason: status is not ok: tablet will be restarted right now sessionId: src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0
2025-10-02T08:10:18.708966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 862 sessionId: src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0 is DEAD
2025-10-02T08:10:18.711667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:18.711683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0] Write session will restart in 0.007534s
2025-10-02T08:10:18.711714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0] Write session: Do CDS request
2025-10-02T08:10:18.711722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:18.720416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:18.720992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:18.721010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 863
2025-10-02T08:10:18.721171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:18.721216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:18.721226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:18.721230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:18.721694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 863 sessionId:  describe result for acl check
2025-10-02T08:10:18.721730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:18.721732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:18.721734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:18.721739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533756532425571:10404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:18.722304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533756532425571:10404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:18.725187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533756532425571:10404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:18.729605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:18.730088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:18.730281Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:18.730291Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:18.730301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:18.730348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:18.730391Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533756532425659:10403]
2025-10-02T08:10:18.731036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:18.731307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:18.731356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:18.731686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:18.731746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.731753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.731754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.731756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.731757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.731762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.731773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.731777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.731781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.731784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.731789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.731796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.731802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.731806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.731811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.731820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.731824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.731828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.731833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.731837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.731856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:18.733605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533756532425571:10404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:18.733623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533756532425571:10404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:18.733626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533756532425571:10404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:18.733635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:18.741136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:18.743301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:18.743330Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:18.743333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:18.743337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:18.743344Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 862 [1:7556533756532425659:10403]
2025-10-02T08:10:18.743359Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:18.743378Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:18.743382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.743385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.743387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.743404Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:18.743410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:18.743417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:18.743492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.743517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.743520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:18.743523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:18.743600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:18.743608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.743623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.743636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:18.743664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533756532425676:10404], now have 1 active actors on pipe
2025-10-02T08:10:18.743676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533756532425653:10403]
2025-10-02T08:10:18.743675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 862
2025-10-02T08:10:18.743678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533756532425653:10403]
2025-10-02T08:10:18.743690Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:18.743699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533756992549050:2378], now have 1 active actors on pipe
2025-10-02T08:10:18.743708Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:18.743711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:18.743713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:18.743726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:18.743734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:18.743741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.743750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.743769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 862
2025-10-02T08:10:18.743796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533756532425653:10403]
2025-10-02T08:10:18.743806Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:18.743816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:18.743820Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82b49077-a6446130-fc0d1de3-62519cf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:18.743828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.743831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.743833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:18.743843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.743857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:18.743904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.743955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.743962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.743976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.744016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 863 partition: 0 MaxSeqNo: 17 sessionId: src_id|82b49077-a6446130-fc0d1de3-62519cf8_0
2025-10-02T08:10:18.748967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367ea025-703fd7c3-70d8fa2b-738a98d0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82b49077-a6446130-fc0d1de3-62519cf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:18.752392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b49077-a6446130-fc0d1de3-62519cf8_0] Write session: try to update token
2025-10-02T08:10:18.752420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b49077-a6446130-fc0d1de3-62519cf8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:18.763359Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:18.763382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:18.763386Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:18.763395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533756532425653:10403]
2025-10-02T08:10:18.763399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533756532425653:10403]
2025-10-02T08:10:18.763451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:18.763451Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:18.763458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:18.763464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.763466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:18.763633Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:18.774270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId: src_id|82b49077-a6446130-fc0d1de3-62519cf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:18.777819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:18.808188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533756532425690:9858]
2025-10-02T08:10:18.808471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 862, pipe: [1:7556533756532425690:9858]
2025-10-02T08:10:18.908619Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:18.909164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.909180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.909202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533756532425690:9858], now have 1 active actors on pipe
2025-10-02T08:10:18.909383Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:18.909487Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:18.909562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533756532425690:9858]
2025-10-02T08:10:18.909597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:18.909659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 863 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82b49077-a6446130-fc0d1de3-62519cf8_0
2025-10-02T08:10:18.909852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 863 sessionId: src_id|82b49077-a6446130-fc0d1de3-62519cf8_0 is DEAD
2025-10-02T08:10:18.910076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b49077-a6446130-fc0d1de3-62519cf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:18.910088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b49077-a6446130-fc0d1de3-62519cf8_0] Write session will restart in 0.009316s
2025-10-02T08:10:18.910117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b49077-a6446130-fc0d1de3-62519cf8_0] Write session: Do CDS request
2025-10-02T08:10:18.910125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b49077-a6446130-fc0d1de3-62519cf8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:18.920467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b49077-a6446130-fc0d1de3-62519cf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:18.921550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:18.921577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 864
2025-10-02T08:10:18.921835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:18.921895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:18.921907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:18.921911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:18.926002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 864 sessionId:  describe result for acl check
2025-10-02T08:10:18.926058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:18.926059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:18.926064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:18.926070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533756532426025:10417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:18.926688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533756532426025:10417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:18.935549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:18.940944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:18.941230Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:18.941235Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:18.941249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:18.941313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:18.941369Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533756532426048:10412]
2025-10-02T08:10:18.942127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:18.942434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:18.942481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:18.942815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:18.942864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.942866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.942867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.942868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.942869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.942875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.942885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.942888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.942892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.942896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.942902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.942911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:18.942917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.942922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:18.942926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.942931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:18.942935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.942940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.942945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.942949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.942970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:18.944005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533756532426025:10417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:18.953202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533756532426025:10417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:18.953224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533756532426025:10417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:18.953227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533756532426025:10417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:18.953236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:18.954063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:18.957368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:18.957397Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:18.957400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:18.957405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:18.957415Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 863 [1:7556533756532426048:10412]
2025-10-02T08:10:18.957430Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:18.957457Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:18.957461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.957464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.957467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.957490Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:18.957497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:18.957506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:18.957592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.957601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.957604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:18.957607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:18.957710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:18.957713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.957732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:18.957743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:18.957766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533756532426031:10412]
2025-10-02T08:10:18.957768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533756532426031:10412]
2025-10-02T08:10:18.957778Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:18.957796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:18.957796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:18.957801Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:18.957808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 863
2025-10-02T08:10:18.957813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:18.957816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:18.957831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533756532426094:10417], now have 1 active actors on pipe
2025-10-02T08:10:18.957836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533756992549058:2378], now have 1 active actors on pipe
2025-10-02T08:10:18.957913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 863
2025-10-02T08:10:18.957880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.957893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.957913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533756532426031:10412]
2025-10-02T08:10:18.957917Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:18.957952Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:18.957961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:18.957968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:18.957970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:18.957983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:18.957995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:18.958003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:18.958024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.958145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:18.958154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:18.958172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:18.958216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 864 partition: 0 MaxSeqNo: 17 sessionId: src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0
2025-10-02T08:10:18.958630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b49077-a6446130-fc0d1de3-62519cf8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:18.962043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0] Write session: try to update token
2025-10-02T08:10:18.962068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:18.981424Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:18.981451Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:18.981454Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:18.981467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533756532426031:10412]
2025-10-02T08:10:18.981471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533756532426031:10412]
2025-10-02T08:10:18.981534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:18.981542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:18.981545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:18.981735Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:18.984091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:18.984102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:18.993131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId: src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:18.998146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:19.009853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533760827393414:9858]
2025-10-02T08:10:19.010077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 863, pipe: [1:7556533760827393414:9858]
2025-10-02T08:10:19.135635Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:19.135970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.135978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.135999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533760827393414:9858], now have 1 active actors on pipe
2025-10-02T08:10:19.138155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:19.138173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0] Write session will restart in 0.009939s
2025-10-02T08:10:19.138204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0] Write session: Do CDS request
2025-10-02T08:10:19.138212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:19.138757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:19.137568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533760827393414:9858]
2025-10-02T08:10:19.137601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:19.137603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:19.137660Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:19.137680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 864 reason: error at write: Disconnected sessionId: src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0
2025-10-02T08:10:19.137836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 864 sessionId: src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0 is DEAD
2025-10-02T08:10:19.149381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:19.152336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:19.152357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 865
2025-10-02T08:10:19.159077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:19.159164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:19.159176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:19.159182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:19.160055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 865 sessionId:  describe result for acl check
2025-10-02T08:10:19.160108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:19.160110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:19.160112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:19.160118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533760827393611:10430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:19.160932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533760827393611:10430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:19.169454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533760827393611:10430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:19.170189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:19.170907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:19.171083Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:19.171094Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:19.171106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:19.171149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:19.171181Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533760827393775:10429]
2025-10-02T08:10:19.171864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:19.174198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:19.174260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:19.174885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:19.175008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.175015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.175016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.175017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.175018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.175024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.175034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.175038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.175043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.175046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.175052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.175064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.175070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.175075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.175079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.175084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.175088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.175093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.175097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.175107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.175126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:19.175887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533760827393611:10430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:19.175901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533760827393611:10430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:19.175906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533760827393611:10430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:19.175916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:19.186749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:19.188977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:19.188994Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:19.188996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:19.189001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:19.189007Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 864 [1:7556533760827393775:10429]
2025-10-02T08:10:19.189020Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:19.189038Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:19.189041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:19.189044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:19.189045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:19.189061Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:19.189067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:19.189074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:19.189150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.189158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.189161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:19.189163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:19.189230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:19.189238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.189251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.189266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:19.189285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533760827393792:10430], now have 1 active actors on pipe
2025-10-02T08:10:19.189288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533761287516384:2378], now have 1 active actors on pipe
2025-10-02T08:10:19.189293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533760827393758:10429]
2025-10-02T08:10:19.189296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533760827393758:10429]
2025-10-02T08:10:19.189310Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:19.189323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:19.189326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:19.189330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:19.189336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:19.189339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:19.189371Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533760827393758:10429]
2025-10-02T08:10:19.189377Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:19.189383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:19.189478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 864
2025-10-02T08:10:19.189484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.189487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.189511Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:19.189520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:19.189523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:19.189524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:19.189533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:19.189541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:19.189556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:19.189585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.189587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.189598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:19.189629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 865 partition: 0 MaxSeqNo: 17 sessionId: src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0
2025-10-02T08:10:19.194353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2359f4b-fa2402d8-5e658aee-338be7cd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:19.192962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 864
2025-10-02T08:10:19.201844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0] Write session: try to update token
2025-10-02T08:10:19.201870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:19.214147Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:19.214168Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:19.214170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:19.214182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533760827393758:10429]
2025-10-02T08:10:19.214186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533760827393758:10429]
2025-10-02T08:10:19.214229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:19.214235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.214237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:19.214393Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:19.215185Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:19.215191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:19.221574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId: src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:19.224898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:19.234665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533760827393805:9858]
2025-10-02T08:10:19.234929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 864, pipe: [1:7556533760827393805:9858]
2025-10-02T08:10:19.361647Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:19.361913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.361922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.361964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533760827393805:9858], now have 1 active actors on pipe
2025-10-02T08:10:19.362196Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:19.362591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533760827393805:9858]
2025-10-02T08:10:19.362606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:19.362655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 865 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0
2025-10-02T08:10:19.362817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 865 sessionId: src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0 is DEAD
2025-10-02T08:10:19.363000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:19.363009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0] Write session will restart in 0.006588s
2025-10-02T08:10:19.363031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0] Write session: Do CDS request
2025-10-02T08:10:19.363041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:19.363141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:19.371681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:19.372135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:19.372160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 866
2025-10-02T08:10:19.372396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:19.372431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:19.372437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:19.372443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:19.373119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 866 sessionId:  describe result for acl check
2025-10-02T08:10:19.373167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:19.373170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:19.373171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:19.373178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533760827393830:10442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:19.373769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533760827393830:10442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:19.388109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533760827393830:10442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:19.401110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:19.401694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533760827393830:10442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:19.401710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533760827393830:10442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:19.401713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533760827393830:10442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:19.401723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:19.403593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:19.403989Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:19.403994Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:19.404006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:19.404067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:19.404106Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533760827394183:10441]
2025-10-02T08:10:19.404720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:19.405006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:19.405047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:19.405264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:19.405297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.405298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.405299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.405300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.405301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.405307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.405317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.405321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.405324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.405327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.405333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.405340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.405345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.405350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.405354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.405361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.405365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.405370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.405374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.405379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.405397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:19.419001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:19.421369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:19.421390Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:19.421393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:19.421397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:19.421405Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 865 [1:7556533760827394183:10441]
2025-10-02T08:10:19.421420Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:19.421442Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:19.421445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:19.421448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:19.421451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:19.421468Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:19.421473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:19.421480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:19.421551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.421563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.421566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:19.421568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:19.421643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:19.421646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.421665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.421677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:19.421694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533760827394171:10441]
2025-10-02T08:10:19.421696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533760827394171:10441]
2025-10-02T08:10:19.421706Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:19.421721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533760827394178:10442], now have 1 active actors on pipe
2025-10-02T08:10:19.421725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:19.421728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:19.421730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:19.421744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:19.421747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:19.421780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533761287516390:2378], now have 1 active actors on pipe
2025-10-02T08:10:19.421782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533760827394171:10441]
2025-10-02T08:10:19.421785Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:19.421826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 865
2025-10-02T08:10:19.421877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:19.422004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.422013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.422039Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:19.422046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:19.422050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:19.422053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:19.422066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:19.422076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:19.422092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:19.422168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.422173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.422185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:19.422215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 866 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0
2025-10-02T08:10:19.422772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63004b8a-1c57a003-d9dfb607-c59cab1c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:19.425288Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 865
2025-10-02T08:10:19.426197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Write session: try to update token
2025-10-02T08:10:19.426220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:19.463718Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:19.463741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:19.463744Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:19.463754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533760827394171:10441]
2025-10-02T08:10:19.463758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533760827394171:10441]
2025-10-02T08:10:19.463805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:19.463812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.463815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:19.463975Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:19.464916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533760827394216:9858]
2025-10-02T08:10:19.468868Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:19.468889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:19.469729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId: src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:19.472637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:19.472699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 865, pipe: [1:7556533760827394216:9858]
2025-10-02T08:10:19.661848Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:19.662448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533760827394216:9858], now have 1 active actors on pipe
2025-10-02T08:10:19.662460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.662465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.663601Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:19.663924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533760827394216:9858]
2025-10-02T08:10:19.663942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:19.664003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 866 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0
2025-10-02T08:10:19.664179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 866 sessionId: src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0 is DEAD
2025-10-02T08:10:19.665027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:19.669283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:19.669302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Write session will restart in 0.009789s
2025-10-02T08:10:19.669335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Write session: Do CDS request
2025-10-02T08:10:19.669345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:19.685845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:19.688052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:19.688079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 867
2025-10-02T08:10:19.688224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:19.688256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:19.688262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:19.688266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:19.690091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 867 sessionId:  describe result for acl check
2025-10-02T08:10:19.690132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:19.690133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:19.690135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:19.690140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533760827394545:10451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:19.690670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533760827394545:10451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:19.694963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:19.700139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533760827394545:10451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:19.702503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:19.702729Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:19.702733Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:19.702744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:19.702801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:19.702832Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533760827394587:10450]
2025-10-02T08:10:19.703497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:19.703939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:19.703991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:19.704291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:19.704329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.704331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.704332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.704333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.704334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.704339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.704350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.704353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.704357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.704360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.704365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.704372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:19.704378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.704383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:19.704388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.704393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:19.704398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.704403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.704408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.704412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.704431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:19.714292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533760827394545:10451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:19.714312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533760827394545:10451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:19.714315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533760827394545:10451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:19.714324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:19.719975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:19.722001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:19.722008Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:19.722011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:19.722015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:19.722022Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 866 [1:7556533760827394587:10450]
2025-10-02T08:10:19.722035Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:19.722053Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:19.722056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:19.722059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:19.722061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:19.722078Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:19.722083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:19.722090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:19.722160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.722162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.722165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:19.722167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:19.722240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:19.722244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.722259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:19.722269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:19.722285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533760827394558:10450]
2025-10-02T08:10:19.722287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533760827394558:10450]
2025-10-02T08:10:19.722299Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:19.722313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:19.722326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:19.722329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:19.722362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533760827394558:10450]
2025-10-02T08:10:19.722365Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:19.722690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:19.722700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:19.722705Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:19.723353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 866
2025-10-02T08:10:19.723366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533760827394603:10451], now have 1 active actors on pipe
2025-10-02T08:10:19.723371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533761287516412:2378], now have 1 active actors on pipe
2025-10-02T08:10:19.723578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.723584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.723614Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:19.723622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:19.723626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:19.723628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:19.723639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:19.723651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:19.723685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:19.723853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.723861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.723875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:19.723906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 867 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0
2025-10-02T08:10:19.725182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 302 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:10:19.725225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7fc6ff-e89acd0e-9aef7688-268b7597_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:19.728468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0] Write session: try to update token
2025-10-02T08:10:19.728489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:19.723455Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 866
2025-10-02T08:10:19.759650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId: src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:19.762475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:19.763353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.763371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.763408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:19.763432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:19.763596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:19.763602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:19.763780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.763849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.763916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.763988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.764033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.764039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.764160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.764223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.764296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.764369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.764413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.764416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.764493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.764560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.764626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.764694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.764741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.764743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.764841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.764907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.765022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.765095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.765161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.765164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.765257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.765328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.765392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.765463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.765609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.765612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.765690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.765754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.765825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.765895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.765940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.765942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.766022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.766086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.766154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.766219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.766273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.766277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.766350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.766422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.766493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.766561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.766604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.766607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.766681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.766746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.766823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.766894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.766942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.766945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.767024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:19.767089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:19.767154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:19.767222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:19.767269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:19.767272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:19.767317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:19.767384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:19.767403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:19.767406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:19.767441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:19.767457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:19.767461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:19.767465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:19.767468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:19.767923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:19.767941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:19.767951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:19.767957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:19.767960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:19.767963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:19.769181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533760827394628:9858]
2025-10-02T08:10:19.769392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 866, pipe: [1:7556533760827394628:9858]
2025-10-02T08:10:19.768798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:19.769588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:19.769594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:19.769597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:19.769601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:19.769605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:19.770364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:19.770379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:19.770385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:19.770389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:19.770392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:19.771852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:19.771861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:19.771874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392619769
2025-10-02T08:10:19.771996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:19.772004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:19.772009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:19.772012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:19.772019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:19.772022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:19.772529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:19.772541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:19.772547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:19.772553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:19.772556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:19.772561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:19.774113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:19.774141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:19.774149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:19.774152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:19.774158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:19.774163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:19.774769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:19.774785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:19.774794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:19.776077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:19.776085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:19.776091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:19.776096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:19.776105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392619773
2025-10-02T08:10:19.776531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:19.776543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:19.776549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:19.776553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:19.776557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:19.776564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:19.777302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:19.777334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:19.777341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:19.777345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:19.777349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:19.777353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:19.777921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:19.777931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:19.778050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392619777
2025-10-02T08:10:19.778954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533760827394628:9858], now have 1 active actors on pipe
2025-10-02T08:10:19.778961Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:19.778973Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:19.778981Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:19.778988Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:19.806200Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:19.806223Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:19.806225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:19.806233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533760827394558:10450]
2025-10-02T08:10:19.806239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533760827394558:10450]
2025-10-02T08:10:19.806283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:19.806289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:19.806291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:19.806291Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:19.806297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:19.806428Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:20.057543Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:20.058555Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:20.058880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:20.058909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 867 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0
2025-10-02T08:10:20.059053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533760827394628:9858]
2025-10-02T08:10:20.059086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 867 sessionId: src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0 is DEAD
2025-10-02T08:10:20.061086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:20.061097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0] Write session will restart in 0.008753s
2025-10-02T08:10:20.061125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0] Write session: Do CDS request
2025-10-02T08:10:20.061132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:20.061392Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:20.073309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:20.077172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:20.077195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 868
2025-10-02T08:10:20.084062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:20.084137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:20.084143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:20.084149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:20.085639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 868 sessionId:  describe result for acl check
2025-10-02T08:10:20.085680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:20.085682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:20.085684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:20.085690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533765122362269:10471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:20.086204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533765122362269:10471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:20.092273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:20.096162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:20.096415Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:20.096425Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:20.096438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:20.096501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:20.096535Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533765122362332:10470]
2025-10-02T08:10:20.097248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:20.097732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:20.097780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:20.098133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:20.098167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.098168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.098169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.098170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.098171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.098178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.098188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.098192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.098196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.098200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.098206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.098214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.098220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.098226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.098231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.098236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.098241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.098246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.098251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.098256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.098275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:20.102078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533765122362269:10471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:20.115368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:20.119740Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 867
2025-10-02T08:10:20.117361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:20.117383Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:20.117386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:20.117390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:20.117398Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 867 [1:7556533765122362332:10470]
2025-10-02T08:10:20.117411Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:20.117432Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:20.117436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:20.117438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:20.117441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:20.117458Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:20.117463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:20.117470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:20.117538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.117541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.117544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:20.117547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:20.117625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:20.117628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.117644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.117655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:20.117673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533765122362318:10470]
2025-10-02T08:10:20.117675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533765122362318:10470]
2025-10-02T08:10:20.117690Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:20.117705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:20.117719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:20.117722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:20.117758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533765122362318:10470]
2025-10-02T08:10:20.117760Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:20.118016Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:20.118019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:20.118024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:20.120907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533765582483738:2378], now have 1 active actors on pipe
2025-10-02T08:10:20.121538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533765122362269:10471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:20.121557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533765122362269:10471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:20.121561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533765122362269:10471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:20.121571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:20.132878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533765122362365:10471], now have 1 active actors on pipe
2025-10-02T08:10:20.132892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 867
2025-10-02T08:10:20.132978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.132988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.133020Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a46d9473-ccaffaae-7060dff2-5241719f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:20.133038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:20.133042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:20.133045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:20.133059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:20.133077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:20.133099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:20.133670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9bb38d-b59c0c61-2ead59e0-c0b2ceec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a46d9473-ccaffaae-7060dff2-5241719f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:20.136606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46d9473-ccaffaae-7060dff2-5241719f_0] Write session: try to update token
2025-10-02T08:10:20.136629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46d9473-ccaffaae-7060dff2-5241719f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:20.133181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.133193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.133208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:20.133245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 868 partition: 0 MaxSeqNo: 17 sessionId: src_id|a46d9473-ccaffaae-7060dff2-5241719f_0
2025-10-02T08:10:20.162366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533765122362371:9858]
2025-10-02T08:10:20.163754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 867, pipe: [1:7556533765122362371:9858]
2025-10-02T08:10:20.163788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533765122362371:9858], now have 1 active actors on pipe
2025-10-02T08:10:20.169576Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:20.169600Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:20.169603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:20.169613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533765122362318:10470]
2025-10-02T08:10:20.169618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533765122362318:10470]
2025-10-02T08:10:20.169665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:20.169673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.169676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:20.169842Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:20.173052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:20.173060Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:20.208875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId: src_id|a46d9473-ccaffaae-7060dff2-5241719f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:20.211821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:20.363076Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:20.363391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.363399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.364975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533765122362371:9858]
2025-10-02T08:10:20.365137Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:20.365190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:20.365263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 868 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a46d9473-ccaffaae-7060dff2-5241719f_0
2025-10-02T08:10:20.365440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 868 sessionId: src_id|a46d9473-ccaffaae-7060dff2-5241719f_0 is DEAD
2025-10-02T08:10:20.365573Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:20.368949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46d9473-ccaffaae-7060dff2-5241719f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:20.368962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46d9473-ccaffaae-7060dff2-5241719f_0] Write session will restart in 0.007284s
2025-10-02T08:10:20.368988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46d9473-ccaffaae-7060dff2-5241719f_0] Write session: Do CDS request
2025-10-02T08:10:20.368995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46d9473-ccaffaae-7060dff2-5241719f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:20.379905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46d9473-ccaffaae-7060dff2-5241719f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:20.384941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:20.384963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 869
2025-10-02T08:10:20.385181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:20.385229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:20.385235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:20.385240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:20.386656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 869 sessionId:  describe result for acl check
2025-10-02T08:10:20.386704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:20.386705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:20.386707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:20.386713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533765122362703:10477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:20.387263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533765122362703:10477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:20.387781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:20.392675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:20.392964Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:20.392976Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:20.392988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:20.393040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:20.393073Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533765122362731:10476]
2025-10-02T08:10:20.393604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:20.393747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533765122362703:10477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:20.393796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:20.393831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:20.394141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:20.394195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.394197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.394198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.394199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.394200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.394205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.394220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.394225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.394229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.394233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.394239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.394246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.394251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.394256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.394260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.394265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.394270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.394280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.394285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.394290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.394309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:20.405903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533765122362703:10477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:20.405928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533765122362703:10477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:20.405932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533765122362703:10477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:20.405944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:20.406202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:20.408366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:20.408373Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:20.408376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:20.408379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:20.408384Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 868 [1:7556533765122362731:10476]
2025-10-02T08:10:20.408393Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:20.408412Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:20.408415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:20.408418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:20.408420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:20.408436Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:20.408442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:20.408448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:20.408522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.408524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.408527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:20.408530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:20.408606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:20.408609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.408623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.408634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:20.408653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533765122362707:10476]
2025-10-02T08:10:20.408655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533765122362707:10476]
2025-10-02T08:10:20.408662Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:20.408678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:20.408685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:20.408690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:20.408692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:20.408695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:20.408705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533765122362757:10477], now have 1 active actors on pipe
2025-10-02T08:10:20.408743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533765582483745:2378], now have 1 active actors on pipe
2025-10-02T08:10:20.408746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533765122362707:10476]
2025-10-02T08:10:20.408752Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:20.408795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 868
2025-10-02T08:10:20.408872Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:20.408893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 868
2025-10-02T08:10:20.409017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.409028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.409058Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:20.409064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:20.409068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:20.409070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:20.409079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:20.409090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:20.409108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:20.409137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.409139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.409150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:20.409181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 869 partition: 0 MaxSeqNo: 17 sessionId: src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0
2025-10-02T08:10:20.412930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46d9473-ccaffaae-7060dff2-5241719f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:20.415897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0] Write session: try to update token
2025-10-02T08:10:20.415921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:20.430302Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:20.430330Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:20.430333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:20.430344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533765122362707:10476]
2025-10-02T08:10:20.430348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533765122362707:10476]
2025-10-02T08:10:20.430397Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:20.430399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:20.430404Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:20.430407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.430410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:20.430595Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:20.459239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId: src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:20.462353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:20.465839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533765122362775:9858]
2025-10-02T08:10:20.466145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 868, pipe: [1:7556533765122362775:9858]
2025-10-02T08:10:20.590528Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:20.591054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.591072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.591094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533765122362775:9858], now have 1 active actors on pipe
2025-10-02T08:10:20.591727Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:20.591338Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:20.591709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:20.591763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 869 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0
2025-10-02T08:10:20.591930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 869 sessionId: src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0 is DEAD
2025-10-02T08:10:20.592105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533765122362775:9858]
2025-10-02T08:10:20.592565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:20.592575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0] Write session will restart in 0.009036s
2025-10-02T08:10:20.592599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0] Write session: Do CDS request
2025-10-02T08:10:20.592606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:20.602779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:20.603487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:20.603584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 870
2025-10-02T08:10:20.603984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:20.604035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:20.604045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:20.604050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:20.604461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 870 sessionId:  describe result for acl check
2025-10-02T08:10:20.604496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:20.604502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:20.604504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:20.604509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533765122362971:10484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:20.605099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533765122362971:10484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:20.609034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533765122362971:10484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:20.613684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533765122362971:10484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:20.613706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533765122362971:10484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:20.613710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533765122362971:10484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:20.613720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:20.620619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:20.621400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:20.621640Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:20.621653Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:20.621666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:20.621735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:20.621778Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533765122363156:10483]
2025-10-02T08:10:20.622451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:20.622723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:20.622801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:20.623080Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 8 CurrentSessionLifetimeMs: 181318 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:10:20.623182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:20.623231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.623238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.623240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.623241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.623243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.623249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.623261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.623265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.623270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.623275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.623281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.623288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.623295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.623318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.623329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.623336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.623341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.623357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.623368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.623378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.623401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:20.636574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:20.640826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:20.640855Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:20.640858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:20.640863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:20.640871Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 869 [1:7556533765122363156:10483]
2025-10-02T08:10:20.640888Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:20.640911Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:20.640915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:20.640919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:20.640921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:20.640939Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:20.640949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:20.640957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:20.641040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.641049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.641053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:20.641056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:20.641132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:20.641139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.641160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.641178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:20.641199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533765122363150:10483]
2025-10-02T08:10:20.641206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533765122363150:10483]
2025-10-02T08:10:20.641221Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:20.641239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:20.641258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:20.641264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:20.641308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533765122363150:10483]
2025-10-02T08:10:20.641315Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:20.641575Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:20.641591Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:20.641599Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:20.641800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 869
2025-10-02T08:10:20.641813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533765122363135:10484], now have 1 active actors on pipe
2025-10-02T08:10:20.641828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.641832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.641861Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b567243-ae3bafbf-389050e8-ff01533f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:20.641870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:20.641875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:20.641877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:20.641900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:20.641913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:20.641933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:20.642261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533765582483753:2378], now have 1 active actors on pipe
2025-10-02T08:10:20.642268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.642273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.642300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:20.642341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 870 partition: 0 MaxSeqNo: 17 sessionId: src_id|3b567243-ae3bafbf-389050e8-ff01533f_0
2025-10-02T08:10:20.642956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6e1015-404a3177-13f178ce-b5bd68f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3b567243-ae3bafbf-389050e8-ff01533f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:20.644916Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 869
2025-10-02T08:10:20.648823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b567243-ae3bafbf-389050e8-ff01533f_0] Write session: try to update token
2025-10-02T08:10:20.648846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b567243-ae3bafbf-389050e8-ff01533f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:20.674971Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:20.675001Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:20.675005Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:20.675016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533765122363150:10483]
2025-10-02T08:10:20.675021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533765122363150:10483]
2025-10-02T08:10:20.675088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:20.675097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.675100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:20.675102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:20.675114Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:20.675285Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:20.684872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId: src_id|3b567243-ae3bafbf-389050e8-ff01533f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:20.688061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:20.696074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533765122363180:9858]
2025-10-02T08:10:20.696567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 869, pipe: [1:7556533765122363180:9858]
2025-10-02T08:10:20.880257Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:20.884948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.884972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.884998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533765122363180:9858], now have 1 active actors on pipe
2025-10-02T08:10:20.891963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b567243-ae3bafbf-389050e8-ff01533f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:20.891979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b567243-ae3bafbf-389050e8-ff01533f_0] Write session will restart in 0.005047s
2025-10-02T08:10:20.892005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b567243-ae3bafbf-389050e8-ff01533f_0] Write session: Do CDS request
2025-10-02T08:10:20.892012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b567243-ae3bafbf-389050e8-ff01533f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:20.890610Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:20.891208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533765122363180:9858]
2025-10-02T08:10:20.891234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:20.891291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 870 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b567243-ae3bafbf-389050e8-ff01533f_0
2025-10-02T08:10:20.891485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 870 sessionId: src_id|3b567243-ae3bafbf-389050e8-ff01533f_0 is DEAD
2025-10-02T08:10:20.893102Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:20.901256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b567243-ae3bafbf-389050e8-ff01533f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:20.909020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:20.909043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 871
2025-10-02T08:10:20.909370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:20.909402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:20.909408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:20.909411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:20.913413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 871 sessionId:  describe result for acl check
2025-10-02T08:10:20.913461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:20.913463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:20.913464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:20.913470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533765122363227:10491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:20.913961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533765122363227:10491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:20.929461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533765122363227:10491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:20.950762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533765122363227:10491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:20.950786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533765122363227:10491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:20.950789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533765122363227:10491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:20.950799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:20.957098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:20.960987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:20.961284Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:20.961288Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:20.961301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:20.961366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:20.961402Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533765122363571:10490]
2025-10-02T08:10:20.962269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:20.963592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:20.963665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:20.964017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:20.964059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.964060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.964062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.964063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.964065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.964071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.964082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.964085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.964089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.964093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.964100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.964108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:20.964114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.964120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:20.964129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.964134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:20.964140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.964145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.964150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.964155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.964174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:20.977054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:20.978802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:20.978809Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:20.978812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:20.978816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:20.978823Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 870 [1:7556533765122363571:10490]
2025-10-02T08:10:20.978836Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:20.978856Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:20.978859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:20.978863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:20.978866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:20.978883Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:20.978889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:20.978896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:20.979297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.979300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.979304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:20.979306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:20.979391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:20.979395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:20.979411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:20.979425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:20.979443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533765122363564:10490]
2025-10-02T08:10:20.979446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533765122363564:10490]
2025-10-02T08:10:20.979454Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:20.979472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:20.979488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:20.979491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:20.979544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533765122363564:10490]
2025-10-02T08:10:20.979546Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:20.980928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 870
2025-10-02T08:10:20.979995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:20.980005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:20.980011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:20.980499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 870
2025-10-02T08:10:20.980512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533765122363550:10491], now have 1 active actors on pipe
2025-10-02T08:10:20.980517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533765582483773:2378], now have 1 active actors on pipe
2025-10-02T08:10:20.981469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.981483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.981518Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:20.981527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:20.981531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:20.981534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:20.981544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:20.981560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:20.981581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:20.981731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:20.981737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:20.981751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:20.981784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 871 partition: 0 MaxSeqNo: 17 sessionId: src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0
2025-10-02T08:10:20.992972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b567243-ae3bafbf-389050e8-ff01533f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:20.992923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533765122363595:9858]
2025-10-02T08:10:20.993864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 870, pipe: [1:7556533765122363595:9858]
2025-10-02T08:10:20.993888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533765122363595:9858], now have 1 active actors on pipe
2025-10-02T08:10:20.996554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0] Write session: try to update token
2025-10-02T08:10:20.996582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:21.009507Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:21.009531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:21.009535Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:21.009543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533765122363564:10490]
2025-10-02T08:10:21.009548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533765122363564:10490]
2025-10-02T08:10:21.009596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:21.009603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.009606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:21.009766Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:21.012815Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:21.012835Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:21.049126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId: src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:21.054585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:21.240749Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:21.241455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.241471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.247830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:21.247849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0] Write session will restart in 0.009123s
2025-10-02T08:10:21.247879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0] Write session: Do CDS request
2025-10-02T08:10:21.247887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:21.245486Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:21.245852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533765122363595:9858]
2025-10-02T08:10:21.245872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:21.245927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 871 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0
2025-10-02T08:10:21.246124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 871 sessionId: src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0 is DEAD
2025-10-02T08:10:21.249017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:21.261262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:21.263817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:21.263839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 872
2025-10-02T08:10:21.267788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:21.267843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:21.267848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:21.267854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:21.268338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 872 sessionId:  describe result for acl check
2025-10-02T08:10:21.268366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:21.268368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:21.268369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:21.268376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533769417331127:10510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:21.269004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533769417331127:10510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:21.281291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533769417331127:10510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:21.288702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:21.288879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533769417331127:10510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:21.288896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533769417331127:10510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:21.288900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533769417331127:10510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:21.288909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:21.293406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:21.293941Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:21.293946Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:21.293957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:21.294020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:21.294055Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533769417331310:10509]
2025-10-02T08:10:21.294750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:21.295034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:21.295072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:21.295395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:21.295432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.295433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.295434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.295435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.295436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.295442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.295454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.295459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.295463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.295467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.295474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.295482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.295493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.295499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.295505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.295510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.295527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.295532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.295537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.295542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.295560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:21.309934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:21.311877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:21.311885Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:21.311888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:21.311892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:21.311899Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 871 [1:7556533769417331310:10509]
2025-10-02T08:10:21.311911Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:21.311932Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:21.311936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:21.311939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:21.311940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:21.311958Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:21.311964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:21.311971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:21.312038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.312040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.312043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:21.312046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:21.312126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:21.312129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.312144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.312154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:21.312170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533769417331298:10509]
2025-10-02T08:10:21.312172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533769417331298:10509]
2025-10-02T08:10:21.312186Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:21.312199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:21.312212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:21.312214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:21.312250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533769417331298:10509]
2025-10-02T08:10:21.312253Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:21.312642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:21.312647Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:21.312653Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:21.313258Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 871
2025-10-02T08:10:21.315299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3476c9f1-8a5a88c7-d19c9c8a-6c2ba3d2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:21.313105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 871
2025-10-02T08:10:21.313133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533769417331303:10510], now have 1 active actors on pipe
2025-10-02T08:10:21.313140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533769877451100:2378], now have 1 active actors on pipe
2025-10-02T08:10:21.313152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.313158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.313187Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:21.313196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:21.313200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:21.313203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:21.313218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:21.313231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:21.313252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:21.314831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.314838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.314874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:21.314912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 872 partition: 0 MaxSeqNo: 17 sessionId: src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0
2025-10-02T08:10:21.321303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0] Write session: try to update token
2025-10-02T08:10:21.321327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:21.346787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533769417331335:9858]
2025-10-02T08:10:21.346907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId: src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:21.347980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 871, pipe: [1:7556533769417331335:9858]
2025-10-02T08:10:21.347997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533769417331335:9858], now have 1 active actors on pipe
2025-10-02T08:10:21.351771Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:21.351794Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:21.351797Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:21.351806Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533769417331298:10509]
2025-10-02T08:10:21.351810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533769417331298:10509]
2025-10-02T08:10:21.351851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:21.351857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.351860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:21.352019Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:21.352278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:21.354347Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:21.354354Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:21.524447Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:21.524943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.524962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.525184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533769417331335:9858]
2025-10-02T08:10:21.525210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:21.525212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:21.525247Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:21.525271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 872 reason: error at write: Disconnected sessionId: src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0
2025-10-02T08:10:21.525439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 872 sessionId: src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0 is DEAD
2025-10-02T08:10:21.528904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:21.528918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0] Write session will restart in 0.006569s
2025-10-02T08:10:21.528944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0] Write session: Do CDS request
2025-10-02T08:10:21.528952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:21.528892Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:21.537273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:21.537470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:21.537494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 873
2025-10-02T08:10:21.537689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:21.537727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:21.537738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:21.537742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:21.538296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 873 sessionId:  describe result for acl check
2025-10-02T08:10:21.538333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:21.538335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:21.538336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:21.538342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533769417331590:10516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:21.539025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533769417331590:10516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:21.544892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533769417331590:10516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:21.546878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:21.547640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:21.548095Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:21.548102Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:21.548117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:21.548182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:21.548231Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533769417331724:10515]
2025-10-02T08:10:21.549509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:21.550610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:21.550662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:21.550936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:21.550972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.550973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.550973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.550974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.550975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.550979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.550987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.550989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.550991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.550994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.550999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.551003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.551008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.551011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.551013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.551016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.551019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.551022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.551027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.551030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.551042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:21.551251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533769417331590:10516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:21.551258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533769417331590:10516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:21.551262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533769417331590:10516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:21.551272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:21.564210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:21.566514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:21.566539Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:21.566542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:21.566546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:21.566553Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 872 [1:7556533769417331724:10515]
2025-10-02T08:10:21.566565Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:21.566584Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:21.566587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:21.566589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:21.566592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:21.566608Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:21.566613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:21.566620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:21.566690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.566700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.566706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:21.566709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:21.566795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:21.566804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.566819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.566831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:21.566867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533769417331717:10515]
2025-10-02T08:10:21.566869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533769417331717:10515]
2025-10-02T08:10:21.566873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 872
2025-10-02T08:10:21.566875Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:21.566887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:21.566889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533769417331740:10516], now have 1 active actors on pipe
2025-10-02T08:10:21.566891Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:21.566893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533769877451109:2378], now have 1 active actors on pipe
2025-10-02T08:10:21.566900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.566904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.566919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:21.566940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:21.566943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:21.566990Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:21.567002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:21.567006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:21.567008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:21.567017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:21.567031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:21.567042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533769417331717:10515]
2025-10-02T08:10:21.567054Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:21.567069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:21.567092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:21.567173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.567182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.567152Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 872
2025-10-02T08:10:21.567203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:21.567243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 873 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0
2025-10-02T08:10:21.567629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4d0098-c4720bfb-7291392f-1a52ee3a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:21.577738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0] Write session: try to update token
2025-10-02T08:10:21.577764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:21.583646Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:21.583673Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:21.583684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533769417331717:10515]
2025-10-02T08:10:21.583731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:21.583732Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:21.583932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:21.584096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:21.584245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:21.584401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:21.584620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:21.584671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:21.593989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId: src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:21.596942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:21.597061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.597077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.597113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:21.597141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:21.597210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.597217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.597389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.597463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.597540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.597612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.597671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.597676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.597748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.597809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.597871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.597947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.598001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.598012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.598082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.598148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.598220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.598295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.598342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.598348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.598418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.598484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.598547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.598616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.598661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.598663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.598731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.598791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.598851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.598914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.598966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.598969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.599041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.599097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.599159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.599242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.599292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.599300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.599373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.599480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.599562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.599632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.599684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.599692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.599763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.599828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.599896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.599967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.600034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.600043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.600113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.600179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.600246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.600317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.600391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.600398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.600468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:21.600538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:21.600599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:21.600670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:21.600741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:21.600749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:21.600793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:21.600882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:21.600907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:21.600910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:21.600942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:21.600959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:21.600963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:21.600966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:21.600969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:21.601389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:21.601419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:21.601425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:21.601428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:21.601431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:21.601434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:21.602235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:21.602254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:21.602260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:21.602263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:21.602267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:21.602270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:21.602950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:21.602975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:21.602981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:21.602985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:21.602987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:21.605534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:21.605560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:21.605575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392621605
2025-10-02T08:10:21.605820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:21.605838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:21.605844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:21.605853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:21.605858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:21.605861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:21.606368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:21.606396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:21.606402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:21.606406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:21.606410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:21.606413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:21.606896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:21.606920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:21.606927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:21.606930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:21.606934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:21.606938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:21.607546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:21.607571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:21.607581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:21.608823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:21.608845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:21.608851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:21.608855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:21.608865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392621608
2025-10-02T08:10:21.609202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:21.609215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:21.609224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:21.609227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:21.609231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:21.609235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:21.609730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:21.609743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:21.609748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:21.609753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:21.609756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:21.609760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:21.610256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:21.610266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:21.610376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392621610
2025-10-02T08:10:21.622836Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:21.622871Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:21.622883Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:21.622890Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:21.624677Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:21.624700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:21.624702Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:21.624711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533769417331717:10515]
2025-10-02T08:10:21.624715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533769417331717:10515]
2025-10-02T08:10:21.624763Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:21.624779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:21.624783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:21.624789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.624792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:21.625165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533769417331760:9858]
2025-10-02T08:10:21.625238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 872, pipe: [1:7556533769417331760:9858]
2025-10-02T08:10:21.626980Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:21.783609Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:21.783969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533769417331760:9858], now have 1 active actors on pipe
2025-10-02T08:10:21.784110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533769417331760:9858]
2025-10-02T08:10:21.784134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:21.784136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:21.784164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 873 reason: error at write: Disconnected sessionId: src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0
2025-10-02T08:10:21.784211Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:21.784470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:21.784480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0] Write session will restart in 0.008256s
2025-10-02T08:10:21.784507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0] Write session: Do CDS request
2025-10-02T08:10:21.784513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:21.784517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 873 sessionId: src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0 is DEAD
2025-10-02T08:10:21.784367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:21.794681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:21.794845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:21.794865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 874
2025-10-02T08:10:21.795079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:21.795115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:21.795125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:21.795129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:21.795733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 874 sessionId:  describe result for acl check
2025-10-02T08:10:21.795785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:21.795787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:21.795789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:21.795794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533769417332029:10524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:21.796361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533769417332029:10524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:21.800011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533769417332029:10524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:21.802211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:21.806171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:21.806180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533769417332029:10524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:21.806188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533769417332029:10524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:21.806192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533769417332029:10524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:21.806201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:21.806416Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:21.806430Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:21.806442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:21.806503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:21.806537Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533769417332157:10523]
2025-10-02T08:10:21.807185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:21.807565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:21.807625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:21.808118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:21.808163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.808170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.808171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.808172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.808173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.808179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.808191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.808196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.808200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.808204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.808210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.808218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:21.808224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.808231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:21.808241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.808247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:21.808253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.808258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.808264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.808274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.808295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:21.817264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:21.819342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:21.819366Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:21.819367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:21.819372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:21.819380Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 873 [1:7556533769417332157:10523]
2025-10-02T08:10:21.819394Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:21.819416Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:21.819420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:21.819423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:21.819425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:21.819443Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:21.819449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:21.819457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:21.819546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.819550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.819553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:21.819556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:21.819631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:21.819634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.819653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:21.819666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:21.819684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533769417332147:10523]
2025-10-02T08:10:21.819688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533769417332147:10523]
2025-10-02T08:10:21.819704Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:21.819717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:21.819733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:21.819735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:21.819769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533769417332147:10523]
2025-10-02T08:10:21.819769Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:21.819771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:21.819773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:21.819780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:21.820210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 873
2025-10-02T08:10:21.820236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533769417332155:10524], now have 1 active actors on pipe
2025-10-02T08:10:21.820240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533769877451127:2378], now have 1 active actors on pipe
2025-10-02T08:10:21.820265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.820276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.820306Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|caedc51a-322da43b-827f859e-30dbf8f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:21.820319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:21.820329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:21.820331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:21.820342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:21.820354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:21.820371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:21.820433Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 873
2025-10-02T08:10:21.820413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.820422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.820436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:21.820478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 874 partition: 0 MaxSeqNo: 17 sessionId: src_id|caedc51a-322da43b-827f859e-30dbf8f2_0
2025-10-02T08:10:21.820858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5626f32-b0213782-91a57d3b-e5c7b284_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|caedc51a-322da43b-827f859e-30dbf8f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:21.823664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caedc51a-322da43b-827f859e-30dbf8f2_0] Write session: try to update token
2025-10-02T08:10:21.823679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caedc51a-322da43b-827f859e-30dbf8f2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:21.840011Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:21.840035Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:21.840037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:21.840046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533769417332147:10523]
2025-10-02T08:10:21.840050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533769417332147:10523]
2025-10-02T08:10:21.840097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:21.840107Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:21.840111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:21.840114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:21.840125Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:21.840280Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:21.851515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId: src_id|caedc51a-322da43b-827f859e-30dbf8f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:21.854269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:21.886723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533769417332185:9858]
2025-10-02T08:10:21.890036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 873, pipe: [1:7556533769417332185:9858]
2025-10-02T08:10:21.995968Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:21.996461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:21.996469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:21.996492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533769417332185:9858], now have 1 active actors on pipe
2025-10-02T08:10:21.997354Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:21.998595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caedc51a-322da43b-827f859e-30dbf8f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:21.998607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caedc51a-322da43b-827f859e-30dbf8f2_0] Write session will restart in 0.005292s
2025-10-02T08:10:21.998632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caedc51a-322da43b-827f859e-30dbf8f2_0] Write session: Do CDS request
2025-10-02T08:10:21.998639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caedc51a-322da43b-827f859e-30dbf8f2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:21.997630Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:21.998010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:21.998061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 874 reason: status is not ok: tablet will be restarted right now sessionId: src_id|caedc51a-322da43b-827f859e-30dbf8f2_0
2025-10-02T08:10:21.998253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 874 sessionId: src_id|caedc51a-322da43b-827f859e-30dbf8f2_0 is DEAD
2025-10-02T08:10:21.998379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533769417332185:9858]
2025-10-02T08:10:22.011979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caedc51a-322da43b-827f859e-30dbf8f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:22.016963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:22.016982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 875
2025-10-02T08:10:22.017970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:22.018005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:22.018011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:22.018015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:22.023250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 875 sessionId:  describe result for acl check
2025-10-02T08:10:22.023296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:22.023298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:22.023299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:22.023305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533773712299820:10531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:22.023849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533773712299820:10531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:22.032664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:22.033169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:22.033538Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:22.033547Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:22.033556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:22.033594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:22.033622Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533773712299853:10530]
2025-10-02T08:10:22.034066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:22.034567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:22.034620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:22.034633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533773712299820:10531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:22.034948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:22.034992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.034993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.034994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.034996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.034997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.035002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.035014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.035019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.035022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.035026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.035031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.035039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.035046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.035051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.035056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.035061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.035081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.035086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.035091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.035097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.035117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:22.047134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533773712299820:10531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:22.047155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533773712299820:10531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:22.047159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533773712299820:10531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:22.047168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:22.047303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:22.049433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:22.049457Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:22.049459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:22.049463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:22.049471Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 874 [1:7556533773712299853:10530]
2025-10-02T08:10:22.049484Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:22.049503Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:22.049506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:22.049510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:22.049512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:22.049528Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:22.049534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:22.049541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:22.049610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.049613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.049615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:22.049618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:22.049686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:22.049688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.049705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.049719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:22.049736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533773712299839:10530]
2025-10-02T08:10:22.049738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533773712299839:10530]
2025-10-02T08:10:22.049751Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:22.049764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:22.049782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:22.049786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:22.049822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533773712299839:10530]
2025-10-02T08:10:22.049825Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:22.050047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:22.050055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:22.050061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:22.050704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 874
2025-10-02T08:10:22.050720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533773712299879:10531], now have 1 active actors on pipe
2025-10-02T08:10:22.050724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533769877451136:2378], now have 1 active actors on pipe
2025-10-02T08:10:22.050800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.050809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.050833Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:22.050841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:22.050845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:22.050848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:22.050859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:22.050870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:22.050886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:22.050989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.050994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.051007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:22.051037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 875 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0
2025-10-02T08:10:22.051509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caedc51a-322da43b-827f859e-30dbf8f2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:22.052061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 874
2025-10-02T08:10:22.054353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0] Write session: try to update token
2025-10-02T08:10:22.054370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:22.078706Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:22.078732Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:22.078735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:22.078744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533773712299839:10530]
2025-10-02T08:10:22.078749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533773712299839:10530]
2025-10-02T08:10:22.078800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:22.078806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.078808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:22.078815Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:22.078822Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:22.079019Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:22.095533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId: src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:22.098488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:22.098564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533773712299893:9858]
2025-10-02T08:10:22.098845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 874, pipe: [1:7556533773712299893:9858]
2025-10-02T08:10:22.247352Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:22.247853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.247861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.247880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533773712299893:9858], now have 1 active actors on pipe
2025-10-02T08:10:22.251958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:22.251344Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:22.251797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533773712299893:9858]
2025-10-02T08:10:22.251828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:22.251898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 875 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0
2025-10-02T08:10:22.252086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 875 sessionId: src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0 is DEAD
2025-10-02T08:10:22.253153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:22.253164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0] Write session will restart in 0.006180s
2025-10-02T08:10:22.253192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0] Write session: Do CDS request
2025-10-02T08:10:22.253200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:22.261282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:22.263465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:22.263479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 876
2025-10-02T08:10:22.263659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:22.263688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:22.263693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:22.263698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:22.264127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 876 sessionId:  describe result for acl check
2025-10-02T08:10:22.264167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:22.264168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:22.264170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:22.264175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533773712299967:10547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:22.264681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533773712299967:10547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:22.270409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533773712299967:10547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:22.275898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533773712299967:10547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:22.275919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533773712299967:10547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:22.275922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533773712299967:10547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:22.275937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:22.278356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:22.281342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:22.281640Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:22.281643Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:22.281654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:22.281709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:22.281744Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533773712300319:10546]
2025-10-02T08:10:22.282369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:22.282642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:22.282707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:22.283483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:22.283579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.283581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.283582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.283584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.283585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.283591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.283602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.283606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.283610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.283614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.283620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.283629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.283635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.283640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.283644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.283650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.283654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.283659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.283664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.283669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.283690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:22.293807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:22.296035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:22.296061Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:22.296063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:22.296071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:22.296078Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 875 [1:7556533773712300319:10546]
2025-10-02T08:10:22.296091Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:22.296110Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:22.296113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:22.296115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:22.296117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:22.296133Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:22.296138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:22.296144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:22.296213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.296221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.296224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:22.296226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:22.296301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:22.296311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.296326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.296337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:22.296359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533773712300301:10547], now have 1 active actors on pipe
2025-10-02T08:10:22.296366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533773712300313:10546]
2025-10-02T08:10:22.296368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533773712300313:10546]
2025-10-02T08:10:22.296381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:22.296396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533774172418452:2378], now have 1 active actors on pipe
2025-10-02T08:10:22.296403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:22.296415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:22.296426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:22.296461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533773712300313:10546]
2025-10-02T08:10:22.296468Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:22.296498Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:22.296509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:22.296515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:22.296516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 875
2025-10-02T08:10:22.296568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.296576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.296601Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:22.296612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:22.296616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:22.296618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:22.296629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:22.296642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:22.296500Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 875
2025-10-02T08:10:22.296668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:22.296693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.296695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.296708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:22.296739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 876 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0
2025-10-02T08:10:22.298261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1f1cbc-f0dda29e-7ff8d9c2-3cf72de0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:22.301663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0] Write session: try to update token
2025-10-02T08:10:22.301682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:22.310364Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:22.310386Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:22.310395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533773712300313:10546]
2025-10-02T08:10:22.310442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:22.310674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:22.310846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:22.311021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:22.311183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:22.311396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:22.311438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:22.311881Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:22.332534Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:22.332554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:22.332556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:22.332567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533773712300313:10546]
2025-10-02T08:10:22.332571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533773712300313:10546]
2025-10-02T08:10:22.332617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:22.332625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.332627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:22.332795Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:22.336976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:22.336997Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:22.352211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533773712300348:9858]
2025-10-02T08:10:22.352514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 875, pipe: [1:7556533773712300348:9858]
2025-10-02T08:10:22.364534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId: src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:22.367986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:22.493866Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:22.494471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533773712300348:9858], now have 1 active actors on pipe
2025-10-02T08:10:22.494480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.494487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.494717Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:22.495011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:22.495061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 876 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0
2025-10-02T08:10:22.495230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 876 sessionId: src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0 is DEAD
2025-10-02T08:10:22.495363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533773712300348:9858]
2025-10-02T08:10:22.495594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:22.495614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0] Write session will restart in 0.005682s
2025-10-02T08:10:22.495640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0] Write session: Do CDS request
2025-10-02T08:10:22.495650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:22.497835Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:22.502350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:22.502870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:22.502887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 877
2025-10-02T08:10:22.503003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:22.503031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:22.503036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:22.503039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:22.504146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 877 sessionId:  describe result for acl check
2025-10-02T08:10:22.504181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:22.504183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:22.504185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:22.504190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533773712300554:10555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:22.504692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533773712300554:10555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:22.512553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533773712300554:10555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:22.521925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:22.523589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533773712300554:10555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:22.523610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533773712300554:10555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:22.523613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533773712300554:10555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:22.523622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:22.526928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:22.527389Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:22.527393Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:22.527406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:22.527467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:22.527508Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533773712300744:10554]
2025-10-02T08:10:22.528235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:22.528607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:22.528660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:22.528982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:22.529036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.529038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.529039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.529040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.529041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.529047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.529058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.529062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.529067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.529071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.529078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.529085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.529092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.529098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.529104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.529110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.529115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.529121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.529126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.529132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.529152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:22.541313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:22.546127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:22.546150Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:22.546153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:22.546156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:22.546161Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 876 [1:7556533773712300744:10554]
2025-10-02T08:10:22.546171Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:22.546185Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:22.546188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:22.546190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:22.546191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:22.546205Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:22.546208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:22.546213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:22.546274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.546275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.546278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:22.546280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:22.546330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:22.546332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.546344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.546351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:22.546364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533773712300732:10554]
2025-10-02T08:10:22.546365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533773712300732:10554]
2025-10-02T08:10:22.546373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:22.546383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:22.546392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:22.546394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:22.546423Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533773712300732:10554]
2025-10-02T08:10:22.546425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:22.550481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:22.550487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:22.550495Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:22.550616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533773712300740:10555], now have 1 active actors on pipe
2025-10-02T08:10:22.550646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 876
2025-10-02T08:10:22.550655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533774172418471:2378], now have 1 active actors on pipe
2025-10-02T08:10:22.550852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.550859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.550891Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:22.550901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:22.550906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:22.550909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:22.550922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:22.550942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:22.550965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:22.551001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.551004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.551017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:22.551065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 877 partition: 0 MaxSeqNo: 17 sessionId: src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0
2025-10-02T08:10:22.551461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3f42fc-99fd03c6-5d4331e7-b1419349_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:22.554290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0] Write session: try to update token
2025-10-02T08:10:22.554315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:22.554737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 876
2025-10-02T08:10:22.578751Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:22.578777Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:22.578779Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:22.578788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533773712300732:10554]
2025-10-02T08:10:22.578793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533773712300732:10554]
2025-10-02T08:10:22.578842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:22.578849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.578852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:22.579027Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:22.580406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId: src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:22.581108Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:22.581124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:22.583226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:22.600863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533773712300774:9858]
2025-10-02T08:10:22.609018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 876, pipe: [1:7556533773712300774:9858]
2025-10-02T08:10:22.740335Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:22.740888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.740903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.740949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533773712300774:9858], now have 1 active actors on pipe
2025-10-02T08:10:22.742257Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:22.741618Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:22.741969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:22.742032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 877 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0
2025-10-02T08:10:22.742194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 877 sessionId: src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0 is DEAD
2025-10-02T08:10:22.742293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533773712300774:9858]
2025-10-02T08:10:22.748156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:22.748172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0] Write session will restart in 0.007410s
2025-10-02T08:10:22.748205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0] Write session: Do CDS request
2025-10-02T08:10:22.748216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:22.762156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:22.762369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:22.762398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 878
2025-10-02T08:10:22.762958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:22.763001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:22.763007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:22.763011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:22.763465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 878 sessionId:  describe result for acl check
2025-10-02T08:10:22.763504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:22.763510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:22.763511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:22.763517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533773712301126:10563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:22.763936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533773712301126:10563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:22.766663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:22.770231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:22.770516Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:22.770527Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:22.770539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:22.770608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:22.770652Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533773712301154:10562]
2025-10-02T08:10:22.771248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:22.772224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:22.772289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:22.772647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:22.772717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.772723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.772725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.772726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.772727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.772732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.772742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.772746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.772750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.772753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.772759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.772766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:22.772771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.772776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:22.772781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.772787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:22.772791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.772796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.772816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.772822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.772844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:22.774256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533773712301126:10563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:22.782744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:22.787430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:22.787455Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:22.787458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:22.787462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:22.787469Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 877 [1:7556533773712301154:10562]
2025-10-02T08:10:22.787484Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:22.787506Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:22.787509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:22.787513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:22.787516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:22.787549Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:22.787554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:22.787562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:22.787650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.787652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.787656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:22.787658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:22.787725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:22.787728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.787744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:22.787757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:22.787776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533773712301142:10562]
2025-10-02T08:10:22.787778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533773712301142:10562]
2025-10-02T08:10:22.787787Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:22.787801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:22.787816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:22.787819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:22.787858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533773712301142:10562]
2025-10-02T08:10:22.787862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:22.788229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:22.788242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:22.788249Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:22.790499Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 877
2025-10-02T08:10:22.790781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533774172418488:2378], now have 1 active actors on pipe
2025-10-02T08:10:22.794872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533773712301126:10563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:22.794892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533773712301126:10563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:22.794896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533773712301126:10563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:22.794907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:22.795821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 877
2025-10-02T08:10:22.795839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533773712301198:10563], now have 1 active actors on pipe
2025-10-02T08:10:22.795898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.795906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.795935Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:22.795945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:22.795950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:22.795953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:22.795966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:22.795982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:22.796004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:22.796080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:22.796083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:22.796098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:22.796126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 878 partition: 0 MaxSeqNo: 17 sessionId: src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0
2025-10-02T08:10:22.796607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc67b8e-8c4cca21-57b05eaa-9e2caa4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:22.809733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0] Write session: try to update token
2025-10-02T08:10:22.809757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:22.825345Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:22.825365Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:22.825368Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:22.825376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533773712301142:10562]
2025-10-02T08:10:22.825380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533773712301142:10562]
2025-10-02T08:10:22.825438Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:22.825444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:22.826592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:22.826610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:22.826613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:22.827662Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:22.842907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533773712301205:9858]
2025-10-02T08:10:22.843071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 877, pipe: [1:7556533773712301205:9858]
2025-10-02T08:10:22.868323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId: src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:22.871348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:23.005591Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:23.005900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533773712301205:9858], now have 1 active actors on pipe
2025-10-02T08:10:23.005909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.005915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.006654Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:23.006953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533773712301205:9858]
2025-10-02T08:10:23.006986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:23.007035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 878 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0
2025-10-02T08:10:23.007214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 878 sessionId: src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0 is DEAD
2025-10-02T08:10:23.008782Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:23.016873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:23.016894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0] Write session will restart in 0.009840s
2025-10-02T08:10:23.016930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0] Write session: Do CDS request
2025-10-02T08:10:23.016940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:23.029210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:23.029556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:23.029577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 879
2025-10-02T08:10:23.029711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:23.029739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:23.029745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:23.029748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:23.030203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 879 sessionId:  describe result for acl check
2025-10-02T08:10:23.030230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:23.030232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:23.030234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:23.030241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533778007268717:10570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:23.030909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533778007268717:10570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:23.049443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:23.051400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:23.051638Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:23.051642Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:23.051653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:23.051708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:23.051741Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533778007268883:10569]
2025-10-02T08:10:23.052411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:23.052694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:23.052737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:23.053069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:23.053111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.053112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.053114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.053115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.053117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.053122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.053132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.053136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.053140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.053144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.053150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.053157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.053163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.053168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.053173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.053178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.053183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.053188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.053193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.053198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.053218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:23.056364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533778007268717:10570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:23.068722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:23.070837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:23.070843Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:23.070846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:23.070850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:23.070856Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 878 [1:7556533778007268883:10569]
2025-10-02T08:10:23.070869Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:23.070888Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:23.070891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:23.070894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:23.070895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:23.070911Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:23.070921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:23.070928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:23.071003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.071005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.071010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:23.071013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:23.071087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:23.071090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.071105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.071119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:23.071140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533778007268877:10569]
2025-10-02T08:10:23.071142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533778007268877:10569]
2025-10-02T08:10:23.071153Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:23.071167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:23.071183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:23.071186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:23.071219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533778007268877:10569]
2025-10-02T08:10:23.071221Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:23.072506Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 878
2025-10-02T08:10:23.071642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:23.071655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:23.071660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:23.073024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533778467385796:2378], now have 1 active actors on pipe
2025-10-02T08:10:23.073341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533778007268717:10570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:23.073348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533778007268717:10570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:23.073351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533778007268717:10570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:23.073361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:23.074421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 878
2025-10-02T08:10:23.074437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533778007268915:10570], now have 1 active actors on pipe
2025-10-02T08:10:23.074521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.074530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.074556Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:23.074565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:23.074569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:23.074572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:23.074582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:23.074597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:23.074616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:23.074743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.074748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.074761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:23.074788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 879 partition: 0 MaxSeqNo: 17 sessionId: src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0
2025-10-02T08:10:23.075261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92cd9209-8e508300-4c9fbd1f-a336563e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:23.078597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0] Write session: try to update token
2025-10-02T08:10:23.078619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:23.100786Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:23.100841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:23.100844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:23.100857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533778007268877:10569]
2025-10-02T08:10:23.100861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533778007268877:10569]
2025-10-02T08:10:23.100909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:23.100917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.100920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:23.101062Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:23.103439Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:23.103460Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:23.108895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533778007268923:9858]
2025-10-02T08:10:23.110183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 878, pipe: [1:7556533778007268923:9858]
2025-10-02T08:10:23.138567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId: src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:23.143898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:23.308595Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:23.309454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533778007268923:9858], now have 1 active actors on pipe
2025-10-02T08:10:23.309499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.309505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.310164Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:23.310797Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:23.311134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:23.311196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 879 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0
2025-10-02T08:10:23.311378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 879 sessionId: src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0 is DEAD
2025-10-02T08:10:23.311498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533778007268923:9858]
2025-10-02T08:10:23.317344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:23.317360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0] Write session will restart in 0.005829s
2025-10-02T08:10:23.317388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0] Write session: Do CDS request
2025-10-02T08:10:23.317395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:23.325275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:23.328939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:23.328960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 880
2025-10-02T08:10:23.329153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:23.329179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:23.329184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:23.329188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:23.332428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 880 sessionId:  describe result for acl check
2025-10-02T08:10:23.332474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:23.332475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:23.332492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:23.332498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533778007269186:10582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:23.333204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533778007269186:10582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:23.344828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533778007269186:10582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:23.355816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:23.360334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:23.360597Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:23.360601Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:23.360612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:23.360673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:23.360716Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533778007269352:10581]
2025-10-02T08:10:23.361362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533778007269186:10582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:23.361370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533778007269186:10582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:23.361373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533778007269186:10582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:23.361384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:23.361461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:23.362304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:23.362364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:23.363066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:23.363124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.363126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.363127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.363128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.363129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.363134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.363144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.363165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.363169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.363175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.363182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.363189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.363195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.363200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.363205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.363209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.363215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.363220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.363226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.363230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.363249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:23.376708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:23.379706Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 879
2025-10-02T08:10:23.378847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:23.378869Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:23.378872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:23.378876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:23.378885Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 879 [1:7556533778007269352:10581]
2025-10-02T08:10:23.378899Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:23.378919Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:23.378923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:23.378926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:23.378928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:23.378945Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:23.378950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:23.378958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:23.379031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.379033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.379036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:23.379039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:23.379124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:23.379128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.379144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.379156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:23.379173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533778007269338:10581]
2025-10-02T08:10:23.379175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533778007269338:10581]
2025-10-02T08:10:23.379182Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:23.379194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:23.379209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:23.379211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:23.379222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533778007269358:10582], now have 1 active actors on pipe
2025-10-02T08:10:23.379227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:23.379231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:23.379252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533778007269338:10581]
2025-10-02T08:10:23.379255Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:23.379259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533778467385817:2378], now have 1 active actors on pipe
2025-10-02T08:10:23.379311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 879
2025-10-02T08:10:23.379390Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:23.379876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.379882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.379912Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:23.379920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:23.379925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:23.379927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:23.379940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:23.379953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:23.379972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:23.380074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.380086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.380105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:23.380138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 880 partition: 0 MaxSeqNo: 17 sessionId: src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0
2025-10-02T08:10:23.381419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa6f83d-dd4fd55f-454ec4f-330366f3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:23.384299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0] Write session: try to update token
2025-10-02T08:10:23.384319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:23.404790Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:23.404833Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:23.404836Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:23.404845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533778007269338:10581]
2025-10-02T08:10:23.404850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533778007269338:10581]
2025-10-02T08:10:23.404896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:23.404904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.404906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:23.405069Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:23.407964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533778007269383:9858]
2025-10-02T08:10:23.408049Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:23.408060Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:23.408209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 879, pipe: [1:7556533778007269383:9858]
2025-10-02T08:10:23.425308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId: src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:23.429675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:23.562013Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:23.562310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533778007269383:9858], now have 1 active actors on pipe
2025-10-02T08:10:23.562347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.562358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.563682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:23.563693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0] Write session will restart in 0.007454s
2025-10-02T08:10:23.563717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0] Write session: Do CDS request
2025-10-02T08:10:23.563723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:23.562577Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:23.563072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:23.563144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 880 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0
2025-10-02T08:10:23.563332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 880 sessionId: src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0 is DEAD
2025-10-02T08:10:23.563472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533778007269383:9858]
2025-10-02T08:10:23.566735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:23.572338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:23.572639Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:23.572662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 881
2025-10-02T08:10:23.572786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:23.572831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:23.572841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:23.572845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:23.573278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 881 sessionId:  describe result for acl check
2025-10-02T08:10:23.573313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:23.573320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:23.573322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:23.573328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533778007269432:10595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:23.574359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533778007269432:10595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:23.580865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533778007269432:10595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:23.587051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533778007269432:10595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:23.587072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533778007269432:10595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:23.587076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533778007269432:10595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:23.587084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:23.587766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:23.591092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:23.591274Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:23.591276Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:23.591284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:23.591319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:23.591349Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533778007269790:10594]
2025-10-02T08:10:23.591829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:23.591980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:23.592020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:23.592314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:23.592349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.592351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.592352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.592353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.592354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.592359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.592368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.592371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.592374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.592378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.592383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.592389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.592395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.592400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.592407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.592412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.592416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.592422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.592426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.592430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.592446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:23.606166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:23.608196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:23.608218Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:23.608220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:23.608224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:23.608232Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 880 [1:7556533778007269790:10594]
2025-10-02T08:10:23.608246Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:23.608265Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:23.608268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:23.608271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:23.608273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:23.608291Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:23.608297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:23.608304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:23.608671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.608682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.608686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:23.608689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:23.609188Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 880
2025-10-02T08:10:23.608759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:23.608768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.608782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.608793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:23.609074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 880
2025-10-02T08:10:23.609326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533778007269783:10594]
2025-10-02T08:10:23.609335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533778007269783:10594]
2025-10-02T08:10:23.609343Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:23.609357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533778007269780:10595], now have 1 active actors on pipe
2025-10-02T08:10:23.609361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533778467385835:2378], now have 1 active actors on pipe
2025-10-02T08:10:23.609366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.609370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.609394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:23.609396Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:23.609398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:23.609409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:23.609411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:23.609454Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:23.609461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:23.609464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:23.609466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:23.609475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:23.609485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:23.609494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533778007269783:10594]
2025-10-02T08:10:23.609498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:23.609516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:23.609954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d596bfd-3b2d5cbc-a12d2450-a1c865ac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:23.609524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:23.609576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.609579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.609593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:23.609625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 881 partition: 0 MaxSeqNo: 17 sessionId: src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0
2025-10-02T08:10:23.612656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0] Write session: try to update token
2025-10-02T08:10:23.612675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:23.634319Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:23.634343Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:23.634346Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:23.634355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533778007269783:10594]
2025-10-02T08:10:23.634359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533778007269783:10594]
2025-10-02T08:10:23.634403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:23.634410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.634413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:23.634523Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:23.634536Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:23.634607Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:23.642102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId: src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:23.645315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:23.669047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533778007269814:9858]
2025-10-02T08:10:23.669311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 880, pipe: [1:7556533778007269814:9858]
2025-10-02T08:10:23.789728Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:23.790021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.790030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.790069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533778007269814:9858], now have 1 active actors on pipe
2025-10-02T08:10:23.790720Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:23.791020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533778007269814:9858]
2025-10-02T08:10:23.791036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:23.791086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 881 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0
2025-10-02T08:10:23.791260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 881 sessionId: src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0 is DEAD
2025-10-02T08:10:23.792363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:23.792370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0] Write session will restart in 0.008779s
2025-10-02T08:10:23.792399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0] Write session: Do CDS request
2025-10-02T08:10:23.792409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:23.795343Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:23.805272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:23.809127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:23.809146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 882
2025-10-02T08:10:23.814775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:23.814831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:23.814837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:23.814841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:23.820751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 882 sessionId:  describe result for acl check
2025-10-02T08:10:23.820798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:23.820815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:23.820816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:23.820823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533778007270156:10602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:23.821349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533778007270156:10602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:23.828526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533778007270156:10602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:23.830752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:23.832067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:23.832509Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:23.832519Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:23.832528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:23.832567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:23.832593Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533778007270221:10601]
2025-10-02T08:10:23.833123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:23.833318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:23.833357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:23.833645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:23.833693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.833694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.833695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.833696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.833697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.833702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.833712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.833715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.833719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.833722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.833727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.833734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:23.833738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.833744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:23.833747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.833752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:23.833756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.833760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.833765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.833768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.833785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:23.833918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533778007270156:10602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:23.833925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533778007270156:10602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:23.833929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533778007270156:10602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:23.833938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:23.846671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:23.849075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:23.849098Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:23.849101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:23.849105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:23.849113Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 881 [1:7556533778007270221:10601]
2025-10-02T08:10:23.849127Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:23.849147Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:23.849151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:23.849155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:23.849156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:23.849176Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:23.849182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:23.849191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:23.849267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.849269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.849273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:23.849276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:23.849356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:23.849359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.849376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:23.849390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:23.849411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533778007270205:10601]
2025-10-02T08:10:23.849413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533778007270205:10601]
2025-10-02T08:10:23.849422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:23.849438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533778007270236:10602], now have 1 active actors on pipe
2025-10-02T08:10:23.849444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:23.849446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:23.849448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:23.849461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:23.849463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:23.849470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533778467385852:2378], now have 1 active actors on pipe
2025-10-02T08:10:23.849508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533778007270205:10601]
2025-10-02T08:10:23.849511Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:23.849558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 881
2025-10-02T08:10:23.850101Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 881
2025-10-02T08:10:23.849753Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:23.850149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.850156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.850187Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:23.850196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:23.850200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:23.850202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:23.850213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:23.850226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:23.850244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:23.850346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:23.850358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:23.850383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:23.850417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 882 partition: 0 MaxSeqNo: 17 sessionId: src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0
2025-10-02T08:10:23.850768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca413ee-5c8b97b-94126b83-16bc9bd6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:23.853677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0] Write session: try to update token
2025-10-02T08:10:23.853697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:23.879830Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:23.879855Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:23.879858Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:23.879868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533778007270205:10601]
2025-10-02T08:10:23.879873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533778007270205:10601]
2025-10-02T08:10:23.879926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:23.879934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:23.879936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:23.879955Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:23.879964Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:23.880092Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:23.887592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId: src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:23.891039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:23.891648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533778007270253:9858]
2025-10-02T08:10:23.891924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 881, pipe: [1:7556533778007270253:9858]
2025-10-02T08:10:24.063652Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:24.064298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.064307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.064330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533778007270253:9858], now have 1 active actors on pipe
2025-10-02T08:10:24.064866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:24.064882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:24.065134Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:24.064952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 882 reason: error at write: Disconnected sessionId: src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0
2025-10-02T08:10:24.065024Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:24.065109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 882 sessionId: src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0 is DEAD
2025-10-02T08:10:24.065240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533778007270253:9858]
2025-10-02T08:10:24.068939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:24.068957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0] Write session will restart in 0.007635s
2025-10-02T08:10:24.068989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0] Write session: Do CDS request
2025-10-02T08:10:24.068997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:24.081674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:24.085031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:24.085053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 883
2025-10-02T08:10:24.085288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:24.085341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:24.085346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:24.085351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:24.086358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 883 sessionId:  describe result for acl check
2025-10-02T08:10:24.086404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:24.086407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:24.086408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:24.086414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533782302237693:10609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:24.087044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533782302237693:10609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:24.093615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533782302237693:10609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:24.099474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533782302237693:10609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:24.099496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533782302237693:10609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:24.099500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533782302237693:10609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:24.099509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:24.104924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:24.105582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:24.105786Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:24.105797Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:24.105808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:24.105857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:24.105897Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533782302237956:10608]
2025-10-02T08:10:24.106559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:24.106825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:24.106877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:24.107190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:24.107231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.107232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.107233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.107235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.107236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.107242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.107252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.107256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.107261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.107265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.107271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.107278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.107286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.107291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.107295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.107299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.107303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.107308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.107312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.107317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.107335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:24.116750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:24.118639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:24.118657Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:24.118660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:24.118664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:24.118672Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 882 [1:7556533782302237956:10608]
2025-10-02T08:10:24.118684Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:24.118701Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:24.118703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.118707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.118710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.118726Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:24.118738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:24.118745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:24.118808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.118811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.118814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:24.118816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:24.118878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:24.118881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.118893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.118903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:24.118919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533782302237950:10608]
2025-10-02T08:10:24.118920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533782302237950:10608]
2025-10-02T08:10:24.118926Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:24.118940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533782302237935:10609], now have 1 active actors on pipe
2025-10-02T08:10:24.118944Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:24.118946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:24.118946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:24.118958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:24.118961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:24.118962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 882
2025-10-02T08:10:24.118995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533782762353156:2378], now have 1 active actors on pipe
2025-10-02T08:10:24.118998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533782302237950:10608]
2025-10-02T08:10:24.119000Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:24.119103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:24.119277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.119288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.119311Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:24.119321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.119329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.119331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:24.119341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.119354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:24.119372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:24.119461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.119466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.119480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:24.119490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 882
2025-10-02T08:10:24.119522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 883 partition: 0 MaxSeqNo: 17 sessionId: src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0
2025-10-02T08:10:24.119866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|471d7d2c-1ccbe89-ad91a8ce-f39b1f9f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:24.123008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0] Write session: try to update token
2025-10-02T08:10:24.123026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:24.152423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId: src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:24.155298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:24.158032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.158059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.158092Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:24.158095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:24.158097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:24.158108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533782302237950:10608]
2025-10-02T08:10:24.158112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533782302237950:10608]
2025-10-02T08:10:24.158163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:24.158170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.158173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:24.158389Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:24.159283Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:24.159288Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:24.168654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533782302237980:9858]
2025-10-02T08:10:24.173115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 882, pipe: [1:7556533782302237980:9858]
2025-10-02T08:10:24.305846Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:24.306363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:24.306397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533782302237980:9858], now have 1 active actors on pipe
2025-10-02T08:10:24.306417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:24.307188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:24.307201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:24.307223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 883 reason: error at write: Disconnected sessionId: src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0
2025-10-02T08:10:24.307316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533782302237980:9858]
2025-10-02T08:10:24.307375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 883 sessionId: src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0 is DEAD
2025-10-02T08:10:24.307710Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:24.309081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:24.309093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0] Write session will restart in 0.007507s
2025-10-02T08:10:24.309116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0] Write session: Do CDS request
2025-10-02T08:10:24.309125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:24.317960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:24.321297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:24.321315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 884
2025-10-02T08:10:24.321526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:24.321558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:24.321565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:24.321568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:24.325272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 884 sessionId:  describe result for acl check
2025-10-02T08:10:24.325310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:24.325315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:24.325317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:24.325323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533782302238333:10615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:24.325709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533782302238333:10615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:24.327327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:24.328615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533782302238333:10615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:24.331080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:24.331290Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:24.331301Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:24.331312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:24.331365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:24.331407Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533782302238379:10614]
2025-10-02T08:10:24.331968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:24.332216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:24.332268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:24.332373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533782302238333:10615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:24.332380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533782302238333:10615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:24.332383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533782302238333:10615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:24.332395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:24.332633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:24.332676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.332677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.332678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.332679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.332680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.332685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.332695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.332699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.332702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.332706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.332712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.332719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.332725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.332729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.332733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.332737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.332740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.332744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.332748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.332752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.332769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:24.346468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:24.348604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:24.348628Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:24.348631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:24.348635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:24.348642Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 883 [1:7556533782302238379:10614]
2025-10-02T08:10:24.348655Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:24.348672Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:24.348675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.348679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.348681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.348699Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:24.348703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:24.348710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:24.348781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.348783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.348786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:24.348788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:24.348886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:24.348889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.348903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.348915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:24.348933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533782302238356:10614]
2025-10-02T08:10:24.348935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533782302238356:10614]
2025-10-02T08:10:24.348945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:24.348958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:24.348972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:24.348975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:24.349013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533782302238356:10614]
2025-10-02T08:10:24.349016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:24.352012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:24.352029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:24.352036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:24.354937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83866db-9fe9c18c-9cfb1923-8909c9bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:24.354897Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 883
2025-10-02T08:10:24.352971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 883
2025-10-02T08:10:24.352999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533782302238390:10615], now have 1 active actors on pipe
2025-10-02T08:10:24.353005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533782762353164:2378], now have 1 active actors on pipe
2025-10-02T08:10:24.353011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.353019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.353053Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:24.353064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.353069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.353076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:24.353091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.353108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:24.353129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:24.353154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.353157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.353170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:24.353203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 884 partition: 0 MaxSeqNo: 17 sessionId: src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0
2025-10-02T08:10:24.358448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0] Write session: try to update token
2025-10-02T08:10:24.358465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:24.390982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId: src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:24.394754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:24.405034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.405066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.405115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:24.405157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:24.408864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533782302238422:9858]
2025-10-02T08:10:24.408920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.408931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.409160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.409272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.409371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.409521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.409579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.409584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.409686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.409781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.409874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.409981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.410034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.410038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.410196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.410337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.410436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.410528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.410588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.410592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.410751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.410833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.410974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.411113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.411196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.411201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.411302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.411397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.411489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.411619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.411681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.411684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.411785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.411873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.411962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.412047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.412117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.412125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.412216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.412299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.412397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.412491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.412740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.412746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.412909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.413002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.413100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.413228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.413416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.413420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.413530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.413665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.413765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.413858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.413915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.413918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.414022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:24.414113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:24.414196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:24.414295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:24.414382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:24.414386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:24.414468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:24.414537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.414561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.414564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:24.414605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:24.414626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:24.414630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:24.414634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:24.414637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:24.415212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:24.415235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:24.415247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:24.415251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:24.415254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:24.415258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:24.416325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:24.416346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:24.416354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:24.416359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:24.416369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:24.416373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:24.421596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:24.421660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:24.421680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:24.421685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:24.421690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:24.433725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:24.433771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:24.433791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392624433
2025-10-02T08:10:24.433988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:24.434010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:24.434022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:24.434026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:24.434030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:24.434034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:24.434905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:24.434927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:24.434940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:24.434944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:24.434947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:24.434955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:24.435839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:24.435859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:24.435872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:24.435875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:24.435880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:24.435884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:24.436559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:24.436579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:24.436588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:24.438369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:24.438395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:24.438401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:24.438406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:24.438416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392624438
2025-10-02T08:10:24.438778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:24.438791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:24.438797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:24.438801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:24.438804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:24.438808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:24.439409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:24.439420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:24.439426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:24.439430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:24.439433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:24.439437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:24.440033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:24.440043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.440155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392624440
2025-10-02T08:10:24.443144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 883, pipe: [1:7556533782302238422:9858]
2025-10-02T08:10:24.447144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533782302238422:9858], now have 1 active actors on pipe
2025-10-02T08:10:24.447166Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:24.447205Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:24.447212Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:24.447222Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:24.447235Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:24.447237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:24.447239Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:24.447244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533782302238356:10614]
2025-10-02T08:10:24.447248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533782302238356:10614]
2025-10-02T08:10:24.447964Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:24.447969Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:24.453905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:24.453927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.453929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:24.454092Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:24.607109Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:24.607479Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:24.607487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:24.607497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533782302238356:10614]
2025-10-02T08:10:24.607620Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:24.607861Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:24.608143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533782302238422:9858]
2025-10-02T08:10:24.608166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:24.608193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 884 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0
2025-10-02T08:10:24.608336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 884 sessionId: src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0 is DEAD
2025-10-02T08:10:24.609070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:24.609089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0] Write session will restart in 0.009856s
2025-10-02T08:10:24.609125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0] Write session: Do CDS request
2025-10-02T08:10:24.609133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:24.609551Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:24.626114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:24.626191Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f58bbedff4fa2347] Result# TEvPutResult {Id# [72075186224037892:883:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:24.626203Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:883:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:24.626263Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:883:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:24.627332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:24.627346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 885
2025-10-02T08:10:24.628226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:24.628276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:24.628287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:24.628291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:24.629259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 885 sessionId:  describe result for acl check
2025-10-02T08:10:24.629296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:24.629298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:24.629299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:24.629306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533782302238723:10636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:24.629930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533782302238723:10636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:24.642060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533782302238723:10636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:24.644237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:24.644612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:24.644781Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:24.644784Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:24.644793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:24.644859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:24.644896Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533782302238868:10635]
2025-10-02T08:10:24.645531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:24.646007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:24.646053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:24.646377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:24.646411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.646412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.646414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.646415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.646417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.646422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.646432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.646436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.646439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.646443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.646449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.646457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.646463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.646469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.646472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.646478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.646483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.646489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.646494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.646499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.646519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:24.647288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533782302238723:10636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:24.647304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533782302238723:10636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:24.647308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533782302238723:10636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:24.647316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:24.656403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:24.660702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e1746b-c67d0187-97ff5c44-4f27efd6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:24.660011Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 884
2025-10-02T08:10:24.658593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:24.658614Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:24.658616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:24.658620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:24.658626Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 884 [1:7556533782302238868:10635]
2025-10-02T08:10:24.658640Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:24.658658Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:24.658661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.658664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.658666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.658685Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:24.658691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:24.658696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:24.658759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.658761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.658764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:24.658767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:24.658833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:24.658836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.658850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.658861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:24.658877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533782302238862:10635]
2025-10-02T08:10:24.658879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533782302238862:10635]
2025-10-02T08:10:24.658892Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:24.658904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:24.658918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:24.658920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:24.658955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533782302238862:10635]
2025-10-02T08:10:24.658958Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:24.659072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:24.659075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:24.659081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:24.660026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 884
2025-10-02T08:10:24.660038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533782302238884:10636], now have 1 active actors on pipe
2025-10-02T08:10:24.660042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533782762353194:2378], now have 1 active actors on pipe
2025-10-02T08:10:24.660097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.660102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.660128Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:24.660136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.660145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.660147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:24.660157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.660168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:24.660185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:24.660218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.660220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.660231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:24.660259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 885 partition: 0 MaxSeqNo: 17 sessionId: src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0
2025-10-02T08:10:24.663764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0] Write session: try to update token
2025-10-02T08:10:24.663780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:24.685720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:24.685745Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:24.685747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:24.685758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533782302238862:10635]
2025-10-02T08:10:24.685762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533782302238862:10635]
2025-10-02T08:10:24.685814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:24.685821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.685823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:24.685840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:24.685852Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:24.686001Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:24.696866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId: src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:24.700240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:24.707802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533782302238900:9858]
2025-10-02T08:10:24.708025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 884, pipe: [1:7556533782302238900:9858]
2025-10-02T08:10:24.840272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:24.840294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0] Write session will restart in 0.006134s
2025-10-02T08:10:24.840326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0] Write session: Do CDS request
2025-10-02T08:10:24.840334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:24.838109Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:24.838573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.838582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.838629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533782302238900:9858], now have 1 active actors on pipe
2025-10-02T08:10:24.839170Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:24.839509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533782302238900:9858]
2025-10-02T08:10:24.839527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:24.839590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 885 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0
2025-10-02T08:10:24.839877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 885 sessionId: src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0 is DEAD
2025-10-02T08:10:24.841251Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:24.847772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:24.848045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:24.848078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 886
2025-10-02T08:10:24.848227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:24.848260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:24.848269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:24.848273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:24.848985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 886 sessionId:  describe result for acl check
2025-10-02T08:10:24.849034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:24.849043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:24.849045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:24.849051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533782302238948:10643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:24.849628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533782302238948:10643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:24.857579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533782302238948:10643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:24.864745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533782302238948:10643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:24.864768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533782302238948:10643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:24.864771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533782302238948:10643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:24.864780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:24.870508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:24.875122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:24.875526Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:24.875529Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:24.875553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:24.875611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:24.875648Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533782302239321:10642]
2025-10-02T08:10:24.876208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:24.876436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:24.876478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:24.876766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:24.876820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.876821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.876822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.876823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.876824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.876830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.876842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.876845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.876849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.876852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.876858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.876865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:24.876870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.876875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:24.876878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.876883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:24.876887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.876891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.876895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.876899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.876916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:24.889587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:24.891457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:24.891465Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:24.891468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:24.891473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:24.891481Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 885 [1:7556533782302239321:10642]
2025-10-02T08:10:24.891497Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:24.891520Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:24.891524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.891527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.891530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.891566Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:24.891572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:24.891580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:24.891661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.891663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.891666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:24.891669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:24.891751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:24.891754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.891770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:24.891781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:24.891799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533782302239315:10642]
2025-10-02T08:10:24.891801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533782302239315:10642]
2025-10-02T08:10:24.891810Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:24.891824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:24.891842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:24.891845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:24.891855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533782302239264:10643], now have 1 active actors on pipe
2025-10-02T08:10:24.891869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:24.891873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:24.891894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533782302239315:10642]
2025-10-02T08:10:24.891897Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:24.891903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533782762353214:2378], now have 1 active actors on pipe
2025-10-02T08:10:24.892040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:24.892420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 885
2025-10-02T08:10:24.892666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.892674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.892704Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:24.892714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:24.892718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:24.892720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:24.892732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:24.892745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:24.892765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:24.893115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:24.893128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:24.893151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:24.893184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 886 partition: 0 MaxSeqNo: 17 sessionId: src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0
2025-10-02T08:10:24.893616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50819d66-c4b65005-9dc77a76-fd4937c9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:24.892975Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 885
2025-10-02T08:10:24.896667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0] Write session: try to update token
2025-10-02T08:10:24.896685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:24.924559Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:24.924588Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:24.924591Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:24.924602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533782302239315:10642]
2025-10-02T08:10:24.924608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533782302239315:10642]
2025-10-02T08:10:24.924655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:24.924664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:24.924666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:24.924927Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:24.925470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:24.925483Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:24.937095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533782302239345:9858]
2025-10-02T08:10:24.940466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 885, pipe: [1:7556533782302239345:9858]
2025-10-02T08:10:24.952152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId: src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:24.955528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:25.165841Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:25.166303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533782302239345:9858], now have 1 active actors on pipe
2025-10-02T08:10:25.166338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:25.166343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:25.167098Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:25.167407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533782302239345:9858]
2025-10-02T08:10:25.167437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:25.167507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 886 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0
2025-10-02T08:10:25.167696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 886 sessionId: src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0 is DEAD
2025-10-02T08:10:25.172961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:25.172982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0] Write session will restart in 0.008264s
2025-10-02T08:10:25.173013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0] Write session: Do CDS request
2025-10-02T08:10:25.173024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:25.173091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:25.182728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:25.183190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:25.183214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 887
2025-10-02T08:10:25.183448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:25.183481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:25.183486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:25.183490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:25.186217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 887 sessionId:  describe result for acl check
2025-10-02T08:10:25.186262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:25.186265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:25.186266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:25.186272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533786597206680:10650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:25.187893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533786597206680:10650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:25.221739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533786597206680:10650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:25.222270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:25.227883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:25.228179Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:25.228183Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:25.228198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:25.228269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:25.228307Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533786597207047:10649]
2025-10-02T08:10:25.229018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:25.230056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:25.230123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:25.230835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:25.230917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:25.230918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:25.230919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:25.230920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.230922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.230927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:25.230936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:25.230939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:25.230943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.230947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.230953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:25.230961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:25.230968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:25.230973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:25.230977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:25.230982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:25.230986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.230993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.230998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.231002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.231021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:25.246552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:25.248706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:25.248718Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:25.248721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:25.248726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:25.249524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533786597206680:10650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:25.249542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533786597206680:10650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:25.249545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533786597206680:10650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:25.249554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:25.250514Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 886 [1:7556533786597207047:10649]
2025-10-02T08:10:25.250540Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:25.250563Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:25.250567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:25.250571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:25.250573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:25.250593Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:25.250599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:25.250606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:25.250681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.250684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.250687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:25.250691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:25.250799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:25.250803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.250825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.250842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:25.250869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533786597207034:10649]
2025-10-02T08:10:25.250872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533786597207034:10649]
2025-10-02T08:10:25.250892Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:25.250912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:25.250936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:25.250941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:25.250994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533786597207034:10649]
2025-10-02T08:10:25.251001Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:25.252569Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 886
2025-10-02T08:10:25.256773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3986ad05-a64a8ca7-70aaa120-739ed48e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:25.251297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:25.251310Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:25.251319Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:25.252168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 886
2025-10-02T08:10:25.252188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533786597207067:10650], now have 1 active actors on pipe
2025-10-02T08:10:25.252195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533787057320519:2378], now have 1 active actors on pipe
2025-10-02T08:10:25.255505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:25.255519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:25.255581Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:25.255595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:25.255604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:25.255610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:25.255627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:25.255652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:25.255681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:25.256100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:25.256110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:25.256152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:25.256207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 887 partition: 0 MaxSeqNo: 17 sessionId: src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0
2025-10-02T08:10:25.260128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0] Write session: try to update token
2025-10-02T08:10:25.260149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:25.270016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533786597207079:9858]
2025-10-02T08:10:25.270316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 886, pipe: [1:7556533786597207079:9858]
2025-10-02T08:10:25.270338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533786597207079:9858], now have 1 active actors on pipe
2025-10-02T08:10:25.306294Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:25.306327Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:25.306330Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:25.306341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533786597207034:10649]
2025-10-02T08:10:25.306347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533786597207034:10649]
2025-10-02T08:10:25.306401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:25.306409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.306411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:25.306624Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:25.309287Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:25.309304Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:25.334397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId: src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:25.338168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:25.610263Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:25.610757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:25.610770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:25.611681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:25.613528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:25.613540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0] Write session will restart in 0.007502s
2025-10-02T08:10:25.613567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0] Write session: Do CDS request
2025-10-02T08:10:25.613576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:25.612061Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:25.612514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533786597207079:9858]
2025-10-02T08:10:25.612537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:25.612901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 887 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0
2025-10-02T08:10:25.613112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 887 sessionId: src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0 is DEAD
2025-10-02T08:10:25.622407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:25.623275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:25.623292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 888
2025-10-02T08:10:25.625237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:25.625278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:25.625283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:25.625286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:25.625975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 888 sessionId:  describe result for acl check
2025-10-02T08:10:25.626010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:25.626012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:25.626014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:25.626019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533786597207342:10669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:25.626660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533786597207342:10669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:25.638144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533786597207342:10669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:25.642944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:25.652170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:25.652419Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:25.652422Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:25.652433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:25.652497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:25.652534Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533786597207535:10668]
2025-10-02T08:10:25.653214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:25.653752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:25.653810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:25.654119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:25.654159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:25.654160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:25.654162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:25.654163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.654164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.654170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:25.654180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:25.654184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:25.654187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.654191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.654200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:25.654207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:25.654212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:25.654218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:25.654222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:25.654227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:25.654232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.654237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.654241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.654246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.654266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:25.655298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533786597207342:10669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:25.655311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533786597207342:10669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:25.655315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533786597207342:10669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:25.655325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:25.671748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:25.673859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:25.673865Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:25.673868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:25.673872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:25.673878Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 887 [1:7556533786597207535:10668]
2025-10-02T08:10:25.673888Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:25.673907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:25.673911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:25.673914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:25.673915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:25.673932Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:25.673938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:25.673944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:25.674007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.674010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.674013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:25.674016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:25.674082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:25.674085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.674098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:25.674109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:25.674126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533786597207523:10668]
2025-10-02T08:10:25.674128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533786597207523:10668]
2025-10-02T08:10:25.674141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:25.674154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:25.674168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:25.674170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:25.674202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533786597207523:10668]
2025-10-02T08:10:25.674204Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:25.674432Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:25.674442Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:25.674447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:25.676933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 887
2025-10-02T08:10:25.676961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533786597207551:10669], now have 1 active actors on pipe
2025-10-02T08:10:25.676966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533787057320549:2378], now have 1 active actors on pipe
2025-10-02T08:10:25.677180Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 887
2025-10-02T08:10:25.680851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:25.680874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:25.680922Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|316e0510-9134524b-d7f3675-6cde0fad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:25.680934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:25.680940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:25.680943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:25.680960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:25.680977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:25.680999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:25.681159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:25.681166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:25.681181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:25.681219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 888 partition: 0 MaxSeqNo: 17 sessionId: src_id|316e0510-9134524b-d7f3675-6cde0fad_0
2025-10-02T08:10:25.681911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9cf0338-9892eca0-4384b0f0-ae2bb2ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|316e0510-9134524b-d7f3675-6cde0fad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:25.684945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316e0510-9134524b-d7f3675-6cde0fad_0] Write session: try to update token
2025-10-02T08:10:25.684963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316e0510-9134524b-d7f3675-6cde0fad_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:25.714562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533786597207564:9858]
2025-10-02T08:10:25.719470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 887, pipe: [1:7556533786597207564:9858]
2025-10-02T08:10:25.719513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533786597207564:9858], now have 1 active actors on pipe
2025-10-02T08:10:25.724258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId: src_id|316e0510-9134524b-d7f3675-6cde0fad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:25.727203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:25.727412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:25.727426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:25.727461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:25.727475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:25.727605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:25.727610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:25.727787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.727861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.727932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.728002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.728591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.728596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.728676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.728742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.728846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.728953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.729001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.729005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.729106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.729179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.729255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.729334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.729387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.729390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.729478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.729559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.729630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.729702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.729759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.729762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.729840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.729913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.729985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.730058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.730104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.730107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.730185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.730255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.730330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.730407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.730492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.730495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.730574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.730645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.730722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.730792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.730840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.730843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.730926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.730994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.731068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.731141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.731192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.731195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.731275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.731345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.731421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.731496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.731575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.731579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.731660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:25.731733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:25.731806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:25.732287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:25.732348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:25.732351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:25.732415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:25.732483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:25.732504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:25.732507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:25.732537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:25.732551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:25.732555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:25.732558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:25.732561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:25.733114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:25.733135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:25.733144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:25.733149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:25.733153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:25.733156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:25.733868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:25.733884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:25.733891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:25.733894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:25.733898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:25.733902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:25.734968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:25.734982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:25.734989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:25.734994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:25.734997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:25.737930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:25.737955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:25.737968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392625737
2025-10-02T08:10:25.738245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:25.738254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:25.738260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:25.738263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:25.738267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:25.738270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:25.738820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:25.738833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:25.738839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:25.738842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:25.738846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:25.738849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:25.739507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:25.739519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:25.739526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:25.739530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:25.739534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:25.739537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:25.740147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:25.740159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:25.740166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:25.741869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:25.741895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:25.741902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:25.741906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:25.741915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392625741
2025-10-02T08:10:25.742315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:25.742330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:25.742338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:25.742342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:25.742346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:25.742350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:25.742938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:25.742951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:25.742957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:25.742962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:25.742965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:25.742969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:25.743584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:25.743597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:25.743721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392625742
2025-10-02T08:10:25.751453Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:25.751494Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:25.751501Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:25.751509Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:25.751528Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:25.751530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:25.751533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:25.751542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533786597207523:10668]
2025-10-02T08:10:25.751560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533786597207523:10668]
2025-10-02T08:10:25.752853Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:25.752858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:25.761477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:25.761496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:25.761498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:25.761670Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:25.915622Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:25.916018Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:25.916022Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:25.916032Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533786597207523:10668]
2025-10-02T08:10:25.918201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316e0510-9134524b-d7f3675-6cde0fad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:25.918214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316e0510-9134524b-d7f3675-6cde0fad_0] Write session will restart in 0.007454s
2025-10-02T08:10:25.918238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316e0510-9134524b-d7f3675-6cde0fad_0] Write session: Do CDS request
2025-10-02T08:10:25.918246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316e0510-9134524b-d7f3675-6cde0fad_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:25.919055Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:25.916329Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:25.917108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:25.917111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:25.917139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 888 reason: error at write: Disconnected sessionId: src_id|316e0510-9134524b-d7f3675-6cde0fad_0
2025-10-02T08:10:25.917325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 888 sessionId: src_id|316e0510-9134524b-d7f3675-6cde0fad_0 is DEAD
2025-10-02T08:10:25.917469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533786597207564:9858]
2025-10-02T08:10:25.917635Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:25.927942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316e0510-9134524b-d7f3675-6cde0fad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:25.929278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:25.929298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 889
2025-10-02T08:10:25.929462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:25.929490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:25.929496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:25.929500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:25.933412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 889 sessionId:  describe result for acl check
2025-10-02T08:10:25.933463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:25.933464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:25.933466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:25.933470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533786597207592:10675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:25.933920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533786597207592:10675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:25.937885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533786597207592:10675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:25.939278Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [97277906ce64ff21] Result# TEvPutResult {Id# [72075186224037892:887:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:25.939347Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:887:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:25.939472Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:887:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:25.983975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533786597207592:10675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:25.983998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533786597207592:10675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:25.984003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533786597207592:10675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:25.984012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:25.989360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:25.997173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:25.997631Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:25.997642Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:25.997654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:25.997716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:25.997753Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533786597208000:10678]
2025-10-02T08:10:25.998462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:26.001051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:26.001130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:26.001519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:26.001558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.001560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.001561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.001562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.001564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.001571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.001582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.001586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.001591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.001595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.001601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.001609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.001616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.001622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.001627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.001632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.001637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.001644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.001658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.001664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.001683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:26.019981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:26.022171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:26.022180Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:26.022183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:26.022187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:26.022194Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 888 [1:7556533786597208000:10678]
2025-10-02T08:10:26.022209Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:26.022232Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:26.022235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:26.022238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:26.022240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:26.022259Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:26.022265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:26.022272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:26.022351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.022354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.022357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:26.022360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:26.022439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:26.022442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.022460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.022474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:26.022494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533786597207992:10678]
2025-10-02T08:10:26.022497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533786597207992:10678]
2025-10-02T08:10:26.022516Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:26.022535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:26.022553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:26.022557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:26.022595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533786597207992:10678]
2025-10-02T08:10:26.022598Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:26.022945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:26.022957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:26.022965Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:26.025050Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 888
2025-10-02T08:10:26.024879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533790892175318:9858]
2025-10-02T08:10:26.024923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533787057320568:2378], now have 1 active actors on pipe
2025-10-02T08:10:26.024928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533786597207977:10675], now have 1 active actors on pipe
2025-10-02T08:10:26.024953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 888
2025-10-02T08:10:26.025262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.025269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.025302Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4358061e-c9487ded-b2938bb6-10064d26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:26.025312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:26.025317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:26.025319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:26.025330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:26.025346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:26.025367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:26.025447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.025450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.025458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533790892175318:9858], now have 1 active actors on pipe
2025-10-02T08:10:26.025467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:26.025481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 888, pipe: [1:7556533790892175318:9858]
2025-10-02T08:10:26.025509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 889 partition: 0 MaxSeqNo: 17 sessionId: src_id|4358061e-c9487ded-b2938bb6-10064d26_0
2025-10-02T08:10:26.027914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316e0510-9134524b-d7f3675-6cde0fad_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4358061e-c9487ded-b2938bb6-10064d26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:26.031705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4358061e-c9487ded-b2938bb6-10064d26_0] Write session: try to update token
2025-10-02T08:10:26.031731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4358061e-c9487ded-b2938bb6-10064d26_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:26.065900Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:26.065926Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:26.065929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:26.065940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533786597207992:10678]
2025-10-02T08:10:26.065946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533786597207992:10678]
2025-10-02T08:10:26.066006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:26.066013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.066016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:26.066187Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:26.067917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:26.067924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:26.089529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId: src_id|4358061e-c9487ded-b2938bb6-10064d26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:26.092775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:26.244065Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:26.244334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.244342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.245485Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:26.245305Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:26.245991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:26.246043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 889 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4358061e-c9487ded-b2938bb6-10064d26_0
2025-10-02T08:10:26.246241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 889 sessionId: src_id|4358061e-c9487ded-b2938bb6-10064d26_0 is DEAD
2025-10-02T08:10:26.246366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533790892175318:9858]
2025-10-02T08:10:26.248914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4358061e-c9487ded-b2938bb6-10064d26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:26.248929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4358061e-c9487ded-b2938bb6-10064d26_0] Write session will restart in 0.005041s
2025-10-02T08:10:26.248958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4358061e-c9487ded-b2938bb6-10064d26_0] Write session: Do CDS request
2025-10-02T08:10:26.248966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4358061e-c9487ded-b2938bb6-10064d26_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:26.261856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4358061e-c9487ded-b2938bb6-10064d26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:26.262352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:26.262371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 890
2025-10-02T08:10:26.262606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:26.262637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:26.262642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:26.262646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:26.263131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 890 sessionId:  describe result for acl check
2025-10-02T08:10:26.263165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:26.263167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:26.263169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:26.263174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533790892175559:10683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:26.263794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533790892175559:10683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:26.272585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533790892175559:10683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:26.283956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:26.292478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:26.292724Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:26.292736Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:26.292746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:26.292799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:26.292854Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533790892175732:10682]
2025-10-02T08:10:26.292913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533790892175559:10683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:26.292922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533790892175559:10683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:26.292926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533790892175559:10683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:26.292934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:26.293605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:26.296591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:26.296667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:26.297079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:26.297123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.297124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.297126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.297127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.297128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.297135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.297146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.297151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.297155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.297159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.297166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.297175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.297181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.297186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.297192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.297198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.297203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.297208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.297213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.297219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.297245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:26.317043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:26.324827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:26.324852Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:26.324855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:26.324860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:26.324867Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 889 [1:7556533790892175732:10682]
2025-10-02T08:10:26.324881Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:26.324903Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:26.324906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:26.324909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:26.324911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:26.324933Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:26.324939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:26.324946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:26.325016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.325018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.325021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:26.325023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:26.325096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:26.325099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.325112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.325123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:26.325142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533790892175725:10682]
2025-10-02T08:10:26.325144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533790892175725:10682]
2025-10-02T08:10:26.325157Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:26.325170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:26.325183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:26.325185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:26.325222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533790892175725:10682]
2025-10-02T08:10:26.325224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:26.325509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:26.325512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:26.325518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:26.326587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 889
2025-10-02T08:10:26.326606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533790892175737:10683], now have 1 active actors on pipe
2025-10-02T08:10:26.326610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533791352287876:2378], now have 1 active actors on pipe
2025-10-02T08:10:26.326688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.326696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.326736Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21afb565-4ff7610b-732588d5-805c88c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:26.326746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:26.326750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:26.326753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:26.326763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:26.326776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:26.326804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:26.327183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.327191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.327208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:26.327250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 890 partition: 0 MaxSeqNo: 17 sessionId: src_id|21afb565-4ff7610b-732588d5-805c88c5_0
2025-10-02T08:10:26.328623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4358061e-c9487ded-b2938bb6-10064d26_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|21afb565-4ff7610b-732588d5-805c88c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:26.331831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21afb565-4ff7610b-732588d5-805c88c5_0] Write session: try to update token
2025-10-02T08:10:26.331848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21afb565-4ff7610b-732588d5-805c88c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:26.329012Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 889
2025-10-02T08:10:26.346289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533790892175760:9858]
2025-10-02T08:10:26.349584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 889, pipe: [1:7556533790892175760:9858]
2025-10-02T08:10:26.349621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533790892175760:9858], now have 1 active actors on pipe
2025-10-02T08:10:26.356311Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:26.356333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:26.356335Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:26.356348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533790892175725:10682]
2025-10-02T08:10:26.356353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533790892175725:10682]
2025-10-02T08:10:26.356395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:26.356402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.356404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:26.356554Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:26.360232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:26.360252Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:26.362939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId: src_id|21afb565-4ff7610b-732588d5-805c88c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:26.365807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:26.535524Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:26.536274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.536284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.536551Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:26.536860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:26.537420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21afb565-4ff7610b-732588d5-805c88c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:26.537433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21afb565-4ff7610b-732588d5-805c88c5_0] Write session will restart in 0.006975s
2025-10-02T08:10:26.537457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21afb565-4ff7610b-732588d5-805c88c5_0] Write session: Do CDS request
2025-10-02T08:10:26.537464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21afb565-4ff7610b-732588d5-805c88c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:26.536913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 890 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21afb565-4ff7610b-732588d5-805c88c5_0
2025-10-02T08:10:26.537088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 890 sessionId: src_id|21afb565-4ff7610b-732588d5-805c88c5_0 is DEAD
2025-10-02T08:10:26.537228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533790892175760:9858]
2025-10-02T08:10:26.541382Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:26.553253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21afb565-4ff7610b-732588d5-805c88c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:26.559131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:26.559153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 891
2025-10-02T08:10:26.561237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:26.561299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:26.561306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:26.561311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:26.561905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 891 sessionId:  describe result for acl check
2025-10-02T08:10:26.561933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:26.561935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:26.561936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:26.561942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533790892176066:10689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:26.562638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533790892176066:10689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:26.570201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533790892176066:10689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:26.573082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:26.578051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:26.578489Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:26.578494Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:26.578510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:26.578584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:26.578624Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533790892176180:10688]
2025-10-02T08:10:26.579285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:26.580004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:26.580058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:26.580364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:26.580414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.580416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.580417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.580418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.580419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.580424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.580435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.580439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.580442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.580445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.580452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.580458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.580464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.580469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.580473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.580477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.580481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.580485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.580490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.580494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.580512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:26.581721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533790892176066:10689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:26.581735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533790892176066:10689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:26.581739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533790892176066:10689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:26.581748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:26.596937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:26.598880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:26.598886Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:26.598888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:26.598893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:26.598899Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 890 [1:7556533790892176180:10688]
2025-10-02T08:10:26.598912Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:26.598931Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:26.598935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:26.598937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:26.598939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:26.598956Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:26.598961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:26.598968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:26.599037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.599039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.599042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:26.599045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:26.599128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:26.599131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.599143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.599155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:26.599171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533790892176168:10688]
2025-10-02T08:10:26.599173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533790892176168:10688]
2025-10-02T08:10:26.599186Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:26.599200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:26.599214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:26.599217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:26.599250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533790892176168:10688]
2025-10-02T08:10:26.599252Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:26.601956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21afb565-4ff7610b-732588d5-805c88c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6cc83600-2f737c60-975656c2-d5889ff1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:26.605644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc83600-2f737c60-975656c2-d5889ff1_0] Write session: try to update token
2025-10-02T08:10:26.605665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc83600-2f737c60-975656c2-d5889ff1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:26.599781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:26.599795Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:26.599801Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:26.600888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 890
2025-10-02T08:10:26.600905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533790892176196:10689], now have 1 active actors on pipe
2025-10-02T08:10:26.600909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533791352287886:2378], now have 1 active actors on pipe
2025-10-02T08:10:26.601336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.601342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.601369Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cc83600-2f737c60-975656c2-d5889ff1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:26.601380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:26.601385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:26.601389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:26.601401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:26.601414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:26.601432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:26.601508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.601510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.601524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:26.601561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 891 partition: 0 MaxSeqNo: 17 sessionId: src_id|6cc83600-2f737c60-975656c2-d5889ff1_0
2025-10-02T08:10:26.607402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 890
2025-10-02T08:10:26.639446Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:26.639479Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:26.639482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:26.639493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533790892176168:10688]
2025-10-02T08:10:26.639498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533790892176168:10688]
2025-10-02T08:10:26.639572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:26.639581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.639584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:26.639796Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:26.640966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:26.640982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:26.660618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533790892176226:9858]
2025-10-02T08:10:26.661109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId: src_id|6cc83600-2f737c60-975656c2-d5889ff1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:26.664249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:26.666410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 890, pipe: [1:7556533790892176226:9858]
2025-10-02T08:10:26.792276Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:26.793215Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:26.794691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc83600-2f737c60-975656c2-d5889ff1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:26.794701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc83600-2f737c60-975656c2-d5889ff1_0] Write session will restart in 0.008372s
2025-10-02T08:10:26.794720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc83600-2f737c60-975656c2-d5889ff1_0] Write session: Do CDS request
2025-10-02T08:10:26.794734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc83600-2f737c60-975656c2-d5889ff1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:26.792883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.792899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.792921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533790892176226:9858], now have 1 active actors on pipe
2025-10-02T08:10:26.793151Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:26.793441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:26.793501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 891 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6cc83600-2f737c60-975656c2-d5889ff1_0
2025-10-02T08:10:26.793690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 891 sessionId: src_id|6cc83600-2f737c60-975656c2-d5889ff1_0 is DEAD
2025-10-02T08:10:26.793826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533790892176226:9858]
2025-10-02T08:10:26.805471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc83600-2f737c60-975656c2-d5889ff1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:26.805816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:26.805836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 892
2025-10-02T08:10:26.805953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:26.805980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:26.805985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:26.805990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:26.806388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 892 sessionId:  describe result for acl check
2025-10-02T08:10:26.806420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:26.806422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:26.806425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:26.806431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533790892176302:10709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:26.807021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533790892176302:10709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:26.816193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533790892176302:10709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:26.833944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533790892176302:10709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:26.833964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533790892176302:10709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:26.833968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533790892176302:10709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:26.833977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:26.837551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:26.845728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:26.846273Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:26.846278Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:26.846290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:26.846361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:26.846394Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533790892176683:10708]
2025-10-02T08:10:26.847075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:26.847406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:26.847448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:26.847787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:26.847832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.847834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.847836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.847837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.847839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.847845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.847855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.847860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.847865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.847868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.847874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.847882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:26.847887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.847892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:26.847896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.847901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:26.847905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.847910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.847915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.847919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.847938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:26.862681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:26.868347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc83600-2f737c60-975656c2-d5889ff1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:26.865715Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 891
2025-10-02T08:10:26.864392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:26.864415Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:26.864419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:26.864423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:26.864430Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 891 [1:7556533790892176683:10708]
2025-10-02T08:10:26.864445Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:26.864467Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:26.864470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:26.864473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:26.864476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:26.864493Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:26.864498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:26.864505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:26.864577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.864579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.864582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:26.864585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:26.864654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:26.864656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.864670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:26.864680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:26.864697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533790892176677:10708]
2025-10-02T08:10:26.864699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533790892176677:10708]
2025-10-02T08:10:26.864713Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:26.864726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:26.864740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:26.864742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:26.864779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533790892176677:10708]
2025-10-02T08:10:26.864783Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:26.864873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:26.864875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:26.864880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:26.865138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 891
2025-10-02T08:10:26.866190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533790892176661:10709], now have 1 active actors on pipe
2025-10-02T08:10:26.866199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533791352287927:2378], now have 1 active actors on pipe
2025-10-02T08:10:26.866206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.866212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.866249Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:26.866260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:26.866264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:26.866267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:26.866280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:26.866294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:26.866312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:26.867321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:26.867327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:26.867359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:26.867402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 892 partition: 0 MaxSeqNo: 17 sessionId: src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0
2025-10-02T08:10:26.872660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0] Write session: try to update token
2025-10-02T08:10:26.872682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:26.888414Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:26.888447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:26.888450Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:26.888459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533790892176677:10708]
2025-10-02T08:10:26.888465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533790892176677:10708]
2025-10-02T08:10:26.888513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:26.888524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:26.888526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:26.888723Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:26.893089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533790892176707:9858]
2025-10-02T08:10:26.893105Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:26.893112Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:26.893175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 891, pipe: [1:7556533790892176707:9858]
2025-10-02T08:10:26.918250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId: src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:26.920990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:27.053105Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:27.053720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533790892176707:9858], now have 1 active actors on pipe
2025-10-02T08:10:27.053780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.053791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.057079Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:27.057150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:27.057228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 892 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0
2025-10-02T08:10:27.057436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 892 sessionId: src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0 is DEAD
2025-10-02T08:10:27.057611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533790892176707:9858]
2025-10-02T08:10:27.059151Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:27.061057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:27.061068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0] Write session will restart in 0.006750s
2025-10-02T08:10:27.061095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0] Write session: Do CDS request
2025-10-02T08:10:27.061102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:27.073332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:27.073920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:27.073941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 893
2025-10-02T08:10:27.074058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:27.074085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:27.074090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:27.074094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:27.074599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 893 sessionId:  describe result for acl check
2025-10-02T08:10:27.074626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:27.074627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:27.074628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:27.074634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533795187144378:10716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:27.075163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533795187144378:10716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:27.077909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:27.080330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533795187144378:10716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:27.082783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:27.083032Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:27.083037Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:27.083047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:27.083099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:27.083130Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533795187144424:10715]
2025-10-02T08:10:27.083841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:27.084852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:27.084895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:27.085165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:27.085199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.085200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.085202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.085203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.085204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.085208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.085214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.085216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.085218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.085220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.085224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.085228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.085232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.085235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.085237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.085240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.085242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.085245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.085247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.085250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.085260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:27.089858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533795187144378:10716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:27.089876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533795187144378:10716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:27.089880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533795187144378:10716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:27.089889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:27.100335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:27.102489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:27.102513Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:27.102515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:27.102519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:27.102526Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 892 [1:7556533795187144424:10715]
2025-10-02T08:10:27.102539Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:27.102557Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:27.102560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:27.102563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:27.102565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:27.102584Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:27.102589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:27.102595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:27.102667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.102670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.102673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:27.102676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:27.102747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:27.102750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.102765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.102775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:27.102794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533795187144398:10715]
2025-10-02T08:10:27.102796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533795187144398:10715]
2025-10-02T08:10:27.102814Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:27.102826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:27.102840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:27.102842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:27.102877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533795187144398:10715]
2025-10-02T08:10:27.102880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:27.103119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533795187144441:10716], now have 1 active actors on pipe
2025-10-02T08:10:27.103135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:27.103925Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 892
2025-10-02T08:10:27.103138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:27.103139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533795647255233:2378], now have 1 active actors on pipe
2025-10-02T08:10:27.103143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:27.103171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 892
2025-10-02T08:10:27.103279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.103284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.103312Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25e5d178-274d9fb9-722d5745-f8e17882_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:27.103320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:27.103324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:27.103326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:27.103341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:27.103353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:27.103370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:27.103467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.103470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.103482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:27.103520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 893 partition: 0 MaxSeqNo: 17 sessionId: src_id|25e5d178-274d9fb9-722d5745-f8e17882_0
2025-10-02T08:10:27.105155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9c81f64-96d08abe-e81c1f59-7a0d002_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25e5d178-274d9fb9-722d5745-f8e17882_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:27.108058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e5d178-274d9fb9-722d5745-f8e17882_0] Write session: try to update token
2025-10-02T08:10:27.108079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e5d178-274d9fb9-722d5745-f8e17882_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:27.130294Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:27.130322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:27.130325Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:27.130334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533795187144398:10715]
2025-10-02T08:10:27.130339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533795187144398:10715]
2025-10-02T08:10:27.130389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:27.130397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.130399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:27.130558Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:27.131766Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:27.131773Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:27.132423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId: src_id|25e5d178-274d9fb9-722d5745-f8e17882_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:27.135218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:27.159239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533795187144455:9858]
2025-10-02T08:10:27.161152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 892, pipe: [1:7556533795187144455:9858]
2025-10-02T08:10:27.375734Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:27.376185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.376195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.376244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533795187144455:9858], now have 1 active actors on pipe
2025-10-02T08:10:27.377007Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:27.377501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533795187144455:9858]
2025-10-02T08:10:27.377529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:27.377590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 893 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25e5d178-274d9fb9-722d5745-f8e17882_0
2025-10-02T08:10:27.377772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 893 sessionId: src_id|25e5d178-274d9fb9-722d5745-f8e17882_0 is DEAD
2025-10-02T08:10:27.381048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e5d178-274d9fb9-722d5745-f8e17882_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:27.381064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e5d178-274d9fb9-722d5745-f8e17882_0] Write session will restart in 0.006852s
2025-10-02T08:10:27.381093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e5d178-274d9fb9-722d5745-f8e17882_0] Write session: Do CDS request
2025-10-02T08:10:27.381105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e5d178-274d9fb9-722d5745-f8e17882_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:27.378348Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:27.394174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e5d178-274d9fb9-722d5745-f8e17882_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:27.394601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:27.394623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 894
2025-10-02T08:10:27.394766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:27.394796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:27.394801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:27.394806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:27.395412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 894 sessionId:  describe result for acl check
2025-10-02T08:10:27.395459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:27.395461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:27.395464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:27.395472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533795187144498:10722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:27.396130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533795187144498:10722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:27.419217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533795187144498:10722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:27.445537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533795187144498:10722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:27.445562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533795187144498:10722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:27.445566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533795187144498:10722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:27.445577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:27.456764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:27.457257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:27.457476Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:27.457480Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:27.457492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:27.457540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:27.457578Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533795187144887:10721]
2025-10-02T08:10:27.458232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:27.458685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:27.458733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:27.459047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:27.459085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.459087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.459088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.459089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.459091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.459095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.459107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.459112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.459116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.459120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.459127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.459135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.459141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.459147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.459151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.459156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.459160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.459164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.459169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.459174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.459197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:27.472041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:27.474420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:27.474431Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:27.474433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:27.474437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:27.474445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 893 [1:7556533795187144887:10721]
2025-10-02T08:10:27.474459Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:27.474479Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:27.474484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:27.474487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:27.474489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:27.474506Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:27.474512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:27.474519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:27.474602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.474605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.474608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:27.474611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:27.474689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:27.474691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.474707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.474718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:27.474737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533795187144881:10721]
2025-10-02T08:10:27.474739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533795187144881:10721]
2025-10-02T08:10:27.474754Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:27.474769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:27.474782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:27.474785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:27.474825Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533795187144881:10721]
2025-10-02T08:10:27.474828Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:27.475091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:27.475105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:27.475111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:27.475773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 893
2025-10-02T08:10:27.475787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533795187144867:10722], now have 1 active actors on pipe
2025-10-02T08:10:27.475792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533795647255240:2378], now have 1 active actors on pipe
2025-10-02T08:10:27.476083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.476095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.476122Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c7bb543-d8310d47-480d565f-f144dedb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:27.476128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:27.476132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:27.476134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:27.476142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:27.476153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:27.476166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:27.476253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.476257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.476268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:27.476296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 894 partition: 0 MaxSeqNo: 17 sessionId: src_id|7c7bb543-d8310d47-480d565f-f144dedb_0
2025-10-02T08:10:27.476908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e5d178-274d9fb9-722d5745-f8e17882_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7c7bb543-d8310d47-480d565f-f144dedb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:27.477013Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 893
2025-10-02T08:10:27.478372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533795187144909:9858]
2025-10-02T08:10:27.480035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c7bb543-d8310d47-480d565f-f144dedb_0] Write session: try to update token
2025-10-02T08:10:27.480052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c7bb543-d8310d47-480d565f-f144dedb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:27.480620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 893, pipe: [1:7556533795187144909:9858]
2025-10-02T08:10:27.480640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533795187144909:9858], now have 1 active actors on pipe
2025-10-02T08:10:27.512704Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:27.512726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:27.512729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:27.512738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533795187144881:10721]
2025-10-02T08:10:27.512743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533795187144881:10721]
2025-10-02T08:10:27.512785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:27.512792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.512795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:27.512981Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:27.515502Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:27.515531Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:27.523758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId: src_id|7c7bb543-d8310d47-480d565f-f144dedb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:27.526752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:27.677016Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:27.677422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.677431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.678344Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:27.679298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:27.679359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 894 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7c7bb543-d8310d47-480d565f-f144dedb_0
2025-10-02T08:10:27.679538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 894 sessionId: src_id|7c7bb543-d8310d47-480d565f-f144dedb_0 is DEAD
2025-10-02T08:10:27.679674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533795187144909:9858]
2025-10-02T08:10:27.679948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c7bb543-d8310d47-480d565f-f144dedb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:27.679961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c7bb543-d8310d47-480d565f-f144dedb_0] Write session will restart in 0.009519s
2025-10-02T08:10:27.679986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c7bb543-d8310d47-480d565f-f144dedb_0] Write session: Do CDS request
2025-10-02T08:10:27.679994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c7bb543-d8310d47-480d565f-f144dedb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:27.678181Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:27.695919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c7bb543-d8310d47-480d565f-f144dedb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:27.708415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:27.708429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 895
2025-10-02T08:10:27.708918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:27.708961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:27.708966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:27.708970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:27.713630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 895 sessionId:  describe result for acl check
2025-10-02T08:10:27.713677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:27.713679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:27.713680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:27.713686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533795187145173:10735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:27.714348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533795187145173:10735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:27.723860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533795187145173:10735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:27.730560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:27.731196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:27.731404Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:27.731416Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:27.731425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:27.731475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:27.731515Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533795187145369:10734]
2025-10-02T08:10:27.732176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:27.732708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533795187145173:10735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:27.732730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533795187145173:10735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:27.732734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533795187145173:10735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:27.732752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:27.732756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:27.732867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:27.733260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:27.733356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.733370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.733371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.733373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.733374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.733381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.733392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.733402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.733406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.733410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.733418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.733426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.733440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.733451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.733456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.733469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.733482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.733487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.733493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.733500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.733521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:27.745421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:27.747234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:27.747261Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:27.747265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:27.747269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:27.747277Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 894 [1:7556533795187145369:10734]
2025-10-02T08:10:27.747291Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:27.747312Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:27.747321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:27.747325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:27.747328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:27.747345Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:27.747351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:27.747359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:27.747434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.747441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.747444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:27.747447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:27.747535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:27.747544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.747573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.747591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:27.747612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533795187145363:10734]
2025-10-02T08:10:27.747619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533795187145363:10734]
2025-10-02T08:10:27.747634Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:27.747654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:27.747686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:27.747694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:27.747732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533795187145363:10734]
2025-10-02T08:10:27.747739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:27.747789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 894
2025-10-02T08:10:27.747803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533795187145384:10735], now have 1 active actors on pipe
2025-10-02T08:10:27.748029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:27.748043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:27.748050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:27.748483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.748504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.748526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533795647255270:2378], now have 1 active actors on pipe
2025-10-02T08:10:27.748546Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:27.748555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:27.748561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:27.748564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:27.748577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:27.748592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:27.748726Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 894
2025-10-02T08:10:27.748613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:27.750104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c7bb543-d8310d47-480d565f-f144dedb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:27.749586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.749602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.749641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:27.749691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 895 partition: 0 MaxSeqNo: 17 sessionId: src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0
2025-10-02T08:10:27.753001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0] Write session: try to update token
2025-10-02T08:10:27.753028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:27.771062Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:27.771083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:27.771085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:27.771093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533795187145363:10734]
2025-10-02T08:10:27.771097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533795187145363:10734]
2025-10-02T08:10:27.771139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:27.771146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.771148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:27.771297Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:27.771984Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:27.771996Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:27.772133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533795187145410:9858]
2025-10-02T08:10:27.772378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 894, pipe: [1:7556533795187145410:9858]
2025-10-02T08:10:27.784913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId: src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:27.787588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:27.929279Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:27.929731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533795187145410:9858], now have 1 active actors on pipe
2025-10-02T08:10:27.929770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:27.929776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:27.930673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533795187145410:9858]
2025-10-02T08:10:27.930713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:27.930715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:27.930792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 895 reason: error at write: Disconnected sessionId: src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0
2025-10-02T08:10:27.931005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 895 sessionId: src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0 is DEAD
2025-10-02T08:10:27.932060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:27.932418Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:27.935024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:27.935039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0] Write session will restart in 0.005602s
2025-10-02T08:10:27.935070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0] Write session: Do CDS request
2025-10-02T08:10:27.935078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:27.945238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:27.949146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:27.949172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 896
2025-10-02T08:10:27.953267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:27.953330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:27.953335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:27.953340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:27.962065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 896 sessionId:  describe result for acl check
2025-10-02T08:10:27.962120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:27.962122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:27.962123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:27.962129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533795187145755:10748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:27.963272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533795187145755:10748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:27.969835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533795187145755:10748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:27.976462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:27.982055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533795187145755:10748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:27.982078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533795187145755:10748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:27.982082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533795187145755:10748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:27.982093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:27.984727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:27.985022Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:27.985029Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:27.985043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:27.985107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:27.985152Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533795187145852:10747]
2025-10-02T08:10:27.985949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:27.987175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:27.987246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:27.987640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:27.987693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.987694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.987695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.987697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.987698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.987704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.987717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.987721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.987726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.987730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.987737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.987746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:27.987753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.987760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:27.987766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.987772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:27.987778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.987784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:27.987790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.987797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:27.987821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:28.002260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:28.004697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:28.004708Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:28.004711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:28.004716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:28.004726Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 895 [1:7556533795187145852:10747]
2025-10-02T08:10:28.004743Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:28.004768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:28.004773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.004777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.004780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.004822Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:28.004829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:28.004843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:28.004936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.004938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.004942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:28.004945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:28.005042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:28.005045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.005065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.005080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:28.005104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533795187145839:10747]
2025-10-02T08:10:28.005106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533795187145839:10747]
2025-10-02T08:10:28.005122Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:28.005138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:28.005156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:28.005159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:28.005207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533795187145839:10747]
2025-10-02T08:10:28.005209Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:28.006190Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:28.006206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:28.006214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:28.007291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 895
2025-10-02T08:10:28.007307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533795187145847:10748], now have 1 active actors on pipe
2025-10-02T08:10:28.007312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533795647255292:2378], now have 1 active actors on pipe
2025-10-02T08:10:28.007442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.007449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.007490Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:28.007506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.007512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.007515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:28.007530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.007547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:28.007581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:28.006913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 895
2025-10-02T08:10:28.007906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.007920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.007942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:28.007979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 896 partition: 0 MaxSeqNo: 17 sessionId: src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0
2025-10-02T08:10:28.013542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8adef7ed-5ab94eb2-d3dd1d6e-efae5ab5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:28.016441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0] Write session: try to update token
2025-10-02T08:10:28.016463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:28.030773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533799482113174:9858]
2025-10-02T08:10:28.031048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 895, pipe: [1:7556533799482113174:9858]
2025-10-02T08:10:28.031062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533799482113174:9858], now have 1 active actors on pipe
2025-10-02T08:10:28.035812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId: src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:28.038709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:28.039515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.039527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.039581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:28.039653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:28.039783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.039786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.039987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.040056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.040126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.040194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.040239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.040243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.040343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.040416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.040503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.040577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.040624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.040627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.040705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.040776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.040911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.040989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.041035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.041039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.041113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.041201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.041267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.041337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.041380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.041383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.041461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.041529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.041636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.041705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.041754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.041757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.041833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.041901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.041970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.042042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.042105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.042108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.042186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.042254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.042330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.042403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.042471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.042474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.042551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.042635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.042703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.042775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.042820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.042824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.042900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.042969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.043038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.043123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.043173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.043176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.043251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.043315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.043382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.043453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.043498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.043502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.043555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:28.043638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.043662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.043665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:28.043703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:28.043716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:28.043720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:28.043723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:28.043726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:28.044156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:28.044174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:28.044181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:28.044184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:28.044187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:28.044191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:28.044710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:28.044724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:28.044730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:28.044733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:28.044736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:28.044739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:28.049035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:28.049078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:28.049087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:28.049092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:28.049096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:28.050420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:28.050447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:28.050461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392628050
2025-10-02T08:10:28.050677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:28.050701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:28.050707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:28.050711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:28.050715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:28.050719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:28.051259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:28.051274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:28.051280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:28.051284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:28.051288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:28.051293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:28.051765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:28.051778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:28.051817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:28.051821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:28.051826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:28.051829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:28.052278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:28.052291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:28.052297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:28.053711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:28.053741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:28.053750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:28.053756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:28.053769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392628053
2025-10-02T08:10:28.054075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:28.054100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:28.054107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:28.054110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:28.054114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:28.054118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:28.054592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:28.054605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:28.054611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:28.054616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:28.054622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:28.054627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:28.055101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:28.055123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.055234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392628054
2025-10-02T08:10:28.056042Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:28.056067Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:28.056077Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:28.056085Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:28.057793Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:28.057809Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:28.057811Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:28.057818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533795187145839:10747]
2025-10-02T08:10:28.057823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533795187145839:10747]
2025-10-02T08:10:28.057887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:28.057889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:28.057893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.057895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:28.057897Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:28.058040Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:28.234505Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:28.236907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:28.236920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0] Write session will restart in 0.008585s
2025-10-02T08:10:28.236945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0] Write session: Do CDS request
2025-10-02T08:10:28.236952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:28.235453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533799482113174:9858]
2025-10-02T08:10:28.235476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:28.235479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:28.235504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 896 reason: error at write: Disconnected sessionId: src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0
2025-10-02T08:10:28.235698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 896 sessionId: src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0 is DEAD
2025-10-02T08:10:28.236364Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:28.235290Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:28.253256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:28.253619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:28.253641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 897
2025-10-02T08:10:28.253789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:28.253820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:28.253825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:28.253829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:28.254602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 897 sessionId:  describe result for acl check
2025-10-02T08:10:28.254633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:28.254635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:28.254637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:28.254644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533799482113324:10755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:28.255205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533799482113324:10755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:28.260845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533799482113324:10755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:28.286476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533799482113324:10755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:28.286493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533799482113324:10755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:28.286496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533799482113324:10755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:28.286505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:28.292320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:28.293709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:28.293908Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:28.293912Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:28.293922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:28.293971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:28.294009Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533799482113614:10754]
2025-10-02T08:10:28.294676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:28.295014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:28.295057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:28.295366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:28.295407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.295408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.295409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.295410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.295412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.295417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.295427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.295431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.295435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.295438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.295444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.295451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.295456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.295460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.295464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.295469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.295474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.295479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.295483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.295488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.295506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:28.310639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:28.312670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:28.312678Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:28.312680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:28.312683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:28.312691Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 896 [1:7556533799482113614:10754]
2025-10-02T08:10:28.312702Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:28.312720Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:28.312724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.312727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.312729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.312745Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:28.312748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:28.312754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:28.320191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.320213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.320218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:28.320220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:28.320343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:28.320347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.320370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.321472Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 896
2025-10-02T08:10:28.320381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:28.320403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533799482113608:10754]
2025-10-02T08:10:28.320406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533799482113608:10754]
2025-10-02T08:10:28.320415Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:28.320436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:28.320452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:28.320455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:28.320498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533799482113608:10754]
2025-10-02T08:10:28.320501Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:28.320777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:28.320781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:28.320788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:28.321184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 896
2025-10-02T08:10:28.321197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533799482113597:10755], now have 1 active actors on pipe
2025-10-02T08:10:28.321201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533799942222597:2378], now have 1 active actors on pipe
2025-10-02T08:10:28.321207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.321213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.321244Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:28.321254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.321259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.321261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:28.321274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.321288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:28.321308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:28.321396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.321399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.321415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:28.321446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 897 partition: 0 MaxSeqNo: 17 sessionId: src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0
2025-10-02T08:10:28.321871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f79f15-362d9812-e3142a59-2ebc8122_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:28.326635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0] Write session: try to update token
2025-10-02T08:10:28.326661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:28.338046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533799482113636:9858]
2025-10-02T08:10:28.338265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533799482113636:9858], now have 1 active actors on pipe
2025-10-02T08:10:28.338317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 896, pipe: [1:7556533799482113636:9858]
2025-10-02T08:10:28.346742Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:28.346772Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:28.346775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:28.346785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533799482113608:10754]
2025-10-02T08:10:28.346790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533799482113608:10754]
2025-10-02T08:10:28.346845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:28.346854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.346857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:28.347045Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:28.348702Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:28.348711Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:28.349555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId: src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:28.352228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:28.514709Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:28.515455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.515468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.521315Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:28.521818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:28.521886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 897 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0
2025-10-02T08:10:28.522092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 897 sessionId: src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0 is DEAD
2025-10-02T08:10:28.522220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533799482113636:9858]
2025-10-02T08:10:28.522541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:28.522550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0] Write session will restart in 0.009780s
2025-10-02T08:10:28.522576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0] Write session: Do CDS request
2025-10-02T08:10:28.522583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:28.523327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:28.533274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:28.533634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:28.533658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 898
2025-10-02T08:10:28.533904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:28.533960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:28.533972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:28.533982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:28.535445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 898 sessionId:  describe result for acl check
2025-10-02T08:10:28.535495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:28.535499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:28.535501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:28.535508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533799482113866:10761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:28.536066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533799482113866:10761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:28.541942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533799482113866:10761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:28.554223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:28.555975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533799482113866:10761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:28.555999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533799482113866:10761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:28.556004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533799482113866:10761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:28.556016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:28.559098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:28.559313Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:28.559318Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:28.559327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:28.559368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:28.559404Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533799482114081:10760]
2025-10-02T08:10:28.559967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:28.560372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:28.560429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:28.560775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:28.560895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.560904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.560905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.560907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.560908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.560914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.560925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.560929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.560932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.560935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.560942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.560950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.560957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.560962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.560967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.560971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.560975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.560980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.560984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.560989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.561009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:28.582185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:28.589002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:28.589061Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:28.589065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:28.589072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:28.589084Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 897 [1:7556533799482114081:10760]
2025-10-02T08:10:28.589104Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:28.589135Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:28.589140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.589144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.589146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.589170Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:28.589178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:28.589187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:28.589298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.589302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.589306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:28.589309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:28.589411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:28.589415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.589436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.589450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:28.589472Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533799482114068:10760]
2025-10-02T08:10:28.589484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533799482114068:10760]
2025-10-02T08:10:28.589501Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:28.589519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:28.589534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:28.589537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:28.589586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533799482114068:10760]
2025-10-02T08:10:28.589590Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:28.589767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:28.589772Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:28.589782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:28.590207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 897
2025-10-02T08:10:28.590225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533799482114076:10761], now have 1 active actors on pipe
2025-10-02T08:10:28.590231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533799942222606:2378], now have 1 active actors on pipe
2025-10-02T08:10:28.590239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.590247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.590279Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4363b58-2ecc97f-11da4007-2affb10d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:28.590289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.590293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.590295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:28.590307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.590323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:28.590344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:28.590661Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 897
2025-10-02T08:10:28.590780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.590797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.590841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:28.590889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 898 partition: 0 MaxSeqNo: 17 sessionId: src_id|4363b58-2ecc97f-11da4007-2affb10d_0
2025-10-02T08:10:28.591308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e142-7d1f2310-896f45c5-4a6d5ca3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4363b58-2ecc97f-11da4007-2affb10d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:28.594097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4363b58-2ecc97f-11da4007-2affb10d_0] Write session: try to update token
2025-10-02T08:10:28.594116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4363b58-2ecc97f-11da4007-2affb10d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:28.612393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId: src_id|4363b58-2ecc97f-11da4007-2affb10d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:28.615424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:28.615561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.615593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.615638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:28.615664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:28.615731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.615734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.615922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.615999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.616070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.616137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.616187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.616206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.616282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.616347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.616430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.616502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.616557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.616560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.616637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.616702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.616769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.616861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.616906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.616909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.616978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.617045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.617114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.617186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.617303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.617307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.617400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.617481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.617556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.617626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.617700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.617716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.617796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.617867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.617939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.618017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.618138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.618149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.618226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.618305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.618387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.618465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.618540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.618550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.618627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.618699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.618780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.618860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.618916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.618925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.619002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.619075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.619150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.619228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.619281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.619293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.619369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:28.619445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:28.619519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:28.619610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:28.619683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:28.619692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:28.619743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:28.619816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.619841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.619849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:28.619886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:28.619907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:28.619911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:28.619914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:28.619917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:28.620391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:28.620425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:28.620432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:28.620436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:28.620439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:28.620442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:28.621465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:28.621496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:28.621506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:28.621511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:28.621515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:28.621519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:28.622086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:28.622116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:28.622122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:28.622125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:28.622129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:28.622296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533799482114107:9858]
2025-10-02T08:10:28.622516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 897, pipe: [1:7556533799482114107:9858]
2025-10-02T08:10:28.624653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:28.624681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:28.624695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392628624
2025-10-02T08:10:28.625096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:28.625110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:28.625121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:28.625124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:28.625130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:28.625133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:28.625725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:28.625741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:28.625746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:28.625750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:28.625753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:28.625756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:28.626232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:28.626239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:28.626247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:28.626251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:28.626253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:28.626256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:28.626739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:28.626748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:28.626753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:28.627979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:28.628121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:28.628128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:28.628133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:28.628143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392628624
2025-10-02T08:10:28.628470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:28.628481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:28.628488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:28.628492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:28.628496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:28.628499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:28.629112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:28.629128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:28.629133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:28.629137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:28.629141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:28.629144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:28.629702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:28.629736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.629883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392628629
2025-10-02T08:10:28.630707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533799482114107:9858], now have 1 active actors on pipe
2025-10-02T08:10:28.630712Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:28.630722Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:28.630726Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:28.630730Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:28.632355Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:28.632375Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:28.632376Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:28.632382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533799482114068:10760]
2025-10-02T08:10:28.632385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533799482114068:10760]
2025-10-02T08:10:28.632437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:28.632441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.632442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:28.632575Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:28.634263Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:28.634288Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:28.776679Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:28.781048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4363b58-2ecc97f-11da4007-2affb10d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:28.781064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4363b58-2ecc97f-11da4007-2affb10d_0] Write session will restart in 0.007935s
2025-10-02T08:10:28.781090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4363b58-2ecc97f-11da4007-2affb10d_0] Write session: Do CDS request
2025-10-02T08:10:28.781096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4363b58-2ecc97f-11da4007-2affb10d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:28.780950Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:28.780004Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:28.780145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533799482114107:9858]
2025-10-02T08:10:28.780168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:28.780195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 898 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4363b58-2ecc97f-11da4007-2affb10d_0
2025-10-02T08:10:28.780379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 898 sessionId: src_id|4363b58-2ecc97f-11da4007-2affb10d_0 is DEAD
2025-10-02T08:10:28.790331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4363b58-2ecc97f-11da4007-2affb10d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:28.792976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:28.792997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 899
2025-10-02T08:10:28.793236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:28.793285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:28.793289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:28.793292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:28.793752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 899 sessionId:  describe result for acl check
2025-10-02T08:10:28.793797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:28.793803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:28.793805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:28.793811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533799482114200:10779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:28.794278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533799482114200:10779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:28.796949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533799482114200:10779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:28.805200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533799482114200:10779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:28.805221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533799482114200:10779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:28.805224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533799482114200:10779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:28.805237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:28.827060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:28.828178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:28.828394Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:28.828404Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:28.828414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:28.828465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:28.828505Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533799482114752:10774]
2025-10-02T08:10:28.829233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:28.829456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:28.829496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:28.829807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:28.829873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.829879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.829880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.829881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.829882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.829887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.829897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.829901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.829904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.829907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.829913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.829920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:28.829926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.829930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:28.829934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.829938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:28.829942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.829946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.829949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.829954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.829971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:28.842890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:28.845139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:28.845160Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:28.845163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:28.845167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:28.845173Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 898 [1:7556533799482114752:10774]
2025-10-02T08:10:28.845186Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:28.845205Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:28.845209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.845211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.845213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.845231Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:28.845236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:28.845243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:28.845314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.845322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.845325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:28.845327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:28.845392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:28.845400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.845415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:28.845430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:28.845449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533799482114746:10774]
2025-10-02T08:10:28.845456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533799482114746:10774]
2025-10-02T08:10:28.845470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:28.845486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:28.845502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:28.845506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:28.845509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:28.845512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:28.845545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533799482114746:10774]
2025-10-02T08:10:28.845552Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:28.845594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 898
2025-10-02T08:10:28.845600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533799482114429:10779], now have 1 active actors on pipe
2025-10-02T08:10:28.845609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:28.845845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.845858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.845875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533799942222637:2378], now have 1 active actors on pipe
2025-10-02T08:10:28.845895Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e19e4d58-54c0c61c-3a270860-437d6198_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:28.845906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:28.845914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:28.845916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:28.845926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:28.845943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:28.845959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:28.846046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.846053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.846066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:28.846053Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 898
2025-10-02T08:10:28.846101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 899 partition: 0 MaxSeqNo: 17 sessionId: src_id|e19e4d58-54c0c61c-3a270860-437d6198_0
2025-10-02T08:10:28.846473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4363b58-2ecc97f-11da4007-2affb10d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e19e4d58-54c0c61c-3a270860-437d6198_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:28.849410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e4d58-54c0c61c-3a270860-437d6198_0] Write session: try to update token
2025-10-02T08:10:28.849431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e4d58-54c0c61c-3a270860-437d6198_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:28.869154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId: src_id|e19e4d58-54c0c61c-3a270860-437d6198_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:28.871805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:28.873124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:28.873149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:28.873170Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:28.873173Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:28.873175Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:28.873183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533799482114746:10774]
2025-10-02T08:10:28.873187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533799482114746:10774]
2025-10-02T08:10:28.873231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:28.873239Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:28.873240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:28.873246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:28.873249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:28.873398Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:28.877143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533799482114778:9858]
2025-10-02T08:10:28.877376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 898, pipe: [1:7556533799482114778:9858]
2025-10-02T08:10:29.022300Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:29.023209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:29.023238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533799482114778:9858], now have 1 active actors on pipe
2025-10-02T08:10:29.023258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:29.023968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:29.023978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:29.023999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 899 reason: error at write: Disconnected sessionId: src_id|e19e4d58-54c0c61c-3a270860-437d6198_0
2025-10-02T08:10:29.024152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 899 sessionId: src_id|e19e4d58-54c0c61c-3a270860-437d6198_0 is DEAD
2025-10-02T08:10:29.024247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:29.024343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e4d58-54c0c61c-3a270860-437d6198_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:29.024352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e4d58-54c0c61c-3a270860-437d6198_0] Write session will restart in 0.009664s
2025-10-02T08:10:29.024370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533799482114778:9858]
2025-10-02T08:10:29.024386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e4d58-54c0c61c-3a270860-437d6198_0] Write session: Do CDS request
2025-10-02T08:10:29.024396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e4d58-54c0c61c-3a270860-437d6198_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:29.035354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e4d58-54c0c61c-3a270860-437d6198_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:29.035558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:29.035604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 900
2025-10-02T08:10:29.036297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:29.036351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:29.036362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:29.036365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:29.036866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 900 sessionId:  describe result for acl check
2025-10-02T08:10:29.036903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:29.036910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:29.036911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:29.036916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533803777082521:10788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:29.037423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533803777082521:10788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:29.040135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533803777082521:10788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:29.042561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:29.042906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533803777082521:10788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:29.042917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533803777082521:10788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:29.042919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533803777082521:10788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:29.042924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:29.042927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:29.043138Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:29.043154Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:29.043166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:29.043219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:29.043251Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533803777082658:10787]
2025-10-02T08:10:29.043824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:29.044027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:29.044073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:29.044370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:29.044404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.044409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.044410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.044410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.044411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.044415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.044421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.044424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.044426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.044428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.044432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.044437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.044440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.044444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.044446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.044449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.044451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.044454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.044456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.044459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.044470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:29.057592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:29.060268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:29.060291Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:29.060293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:29.060298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:29.060304Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 899 [1:7556533803777082658:10787]
2025-10-02T08:10:29.060313Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:29.060327Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:29.060329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.060331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.060332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.060345Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:29.060349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:29.060354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:29.060419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.060429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.060432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:29.060434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:29.060500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:29.060508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.060520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.060534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:29.060556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533803777082647:10787]
2025-10-02T08:10:29.060562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533803777082647:10787]
2025-10-02T08:10:29.060570Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:29.060587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:29.060589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533803777082655:10788], now have 1 active actors on pipe
2025-10-02T08:10:29.060597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:29.060599Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:29.060610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:29.060612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:29.060618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533804237189951:2378], now have 1 active actors on pipe
2025-10-02T08:10:29.060654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 899
2025-10-02T08:10:29.060672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533803777082647:10787]
2025-10-02T08:10:29.060675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:29.060684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.060688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.060696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:29.060729Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:29.060743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.060746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.060749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:29.060758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.060771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:29.060781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 899
2025-10-02T08:10:29.060817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:29.060871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.060874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.060888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:29.060929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 900 partition: 0 MaxSeqNo: 17 sessionId: src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0
2025-10-02T08:10:29.061316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19e4d58-54c0c61c-3a270860-437d6198_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:29.066867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0] Write session: try to update token
2025-10-02T08:10:29.066885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:29.084785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId: src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:29.088182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:29.088272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.088286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.088340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:29.088368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:29.088447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.088450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.088684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.088786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.088934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.089027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.089087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.089092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.089183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.089254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.089332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.089419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.089486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.089489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.089593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.089672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.089754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.089839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.089901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.089904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.089991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.090066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.090143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.090221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.090359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.090363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.090449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.090523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.090617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.090699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.090753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.090756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.090844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.090919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.091009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.091086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.091212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.091215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.091302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.091459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.091548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.091643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.091694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.091697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.091787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.091864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.091939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.092016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.092099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.092103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.092210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.092286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.092366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.092442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.092515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.092519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.092610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.092683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.092763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.092860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.092916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.092920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.093009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:29.093086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.093111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.093115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:29.093159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:29.093176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:29.093180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:29.093184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:29.093187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:29.093650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:29.093673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:29.093681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:29.093685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:29.093688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:29.093693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:29.094314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:29.094333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:29.094340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:29.094345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:29.094350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:29.094354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:29.094969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:29.094989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:29.094996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:29.095001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:29.095010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:29.101285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:29.101335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:29.101359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392629101
2025-10-02T08:10:29.101514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:29.101531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:29.101540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:29.101545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:29.101551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:29.101556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:29.102130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:29.102148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:29.102157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:29.102163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:29.102169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:29.102174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:29.103215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:29.103237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:29.103247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:29.103251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:29.103256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:29.103261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:29.103838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:29.103856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:29.103867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:29.105465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:29.105496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:29.105504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:29.105509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:29.105521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392629105
2025-10-02T08:10:29.106165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:29.106185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:29.106192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:29.106196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:29.106201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:29.106205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:29.106789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:29.106805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:29.106811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:29.106819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:29.106824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:29.106828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:29.107792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:29.107844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.107986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392629107
2025-10-02T08:10:29.110693Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:29.110738Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:29.110744Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:29.110752Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:29.110765Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:29.110767Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:29.110770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:29.110777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533803777082647:10787]
2025-10-02T08:10:29.110782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533803777082647:10787]
2025-10-02T08:10:29.110839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:29.110846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:29.117249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:29.117283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.117286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:29.117465Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:29.124438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533803777082685:9858]
2025-10-02T08:10:29.124592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 899, pipe: [1:7556533803777082685:9858]
2025-10-02T08:10:29.270700Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:29.271079Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:29.271097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:29.271110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533803777082647:10787]
2025-10-02T08:10:29.271172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:29.271197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533803777082685:9858], now have 1 active actors on pipe
2025-10-02T08:10:29.271326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533803777082685:9858]
2025-10-02T08:10:29.271360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:29.271362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:29.271388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 900 reason: error at write: Disconnected sessionId: src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0
2025-10-02T08:10:29.271443Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:29.271499Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:29.271566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 900 sessionId: src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0 is DEAD
2025-10-02T08:10:29.271967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:29.271979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0] Write session will restart in 0.008114s
2025-10-02T08:10:29.272005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0] Write session: Do CDS request
2025-10-02T08:10:29.272013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:29.276104Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [899348c7fa86aa8a] Result# TEvPutResult {Id# [72075186224037892:899:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:29.276133Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:899:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:29.276191Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:899:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:29.285426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:29.289316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:29.289339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 901
2025-10-02T08:10:29.289828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:29.290844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:29.291060Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:29.291073Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:29.291084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:29.291132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:29.291177Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533803777083239:10793]
2025-10-02T08:10:29.291822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:29.292061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:29.292120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:29.292417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:29.292464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:29.292488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.292489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.292490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.292491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.292492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.292498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.292507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.292510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.292514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.292517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.292524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.292528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:29.292531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.292535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:29.292537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.292540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:29.292543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.292547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.292552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.292558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.292563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.292569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.292574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.292590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:29.293016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 901 sessionId:  describe result for acl check
2025-10-02T08:10:29.293062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:29.293064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:29.293065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:29.293071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533803777083254:10795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:29.293560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533803777083254:10795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:29.295827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533803777083254:10795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:29.301015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:29.301293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533803777083254:10795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:29.301317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533803777083254:10795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:29.301322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533803777083254:10795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:29.301334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:29.303189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:29.303212Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:29.303214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:29.303217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:29.303224Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 900 [1:7556533803777083239:10793]
2025-10-02T08:10:29.303235Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:29.303252Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:29.303255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.303258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.303259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.303276Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:29.303280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:29.303287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:29.303351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.303353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.303356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:29.303359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:29.303422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:29.303425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.303437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.303521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 900
2025-10-02T08:10:29.303447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:29.303466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533803777083285:10795], now have 1 active actors on pipe
2025-10-02T08:10:29.303473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533803777083233:10793]
2025-10-02T08:10:29.303475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533803777083233:10793]
2025-10-02T08:10:29.303483Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:29.303490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533804237189957:2378], now have 1 active actors on pipe
2025-10-02T08:10:29.303496Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:29.303498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:29.303500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:29.303511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:29.303514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:29.303547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533803777083233:10793]
2025-10-02T08:10:29.303549Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:29.303552Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:29.303624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 900
2025-10-02T08:10:29.303630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.303634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.303657Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:29.303664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.303667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.303669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:29.303678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.303687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:29.303702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:29.303753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.303756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.303767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:29.303795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 901 partition: 0 MaxSeqNo: 17 sessionId: src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0
2025-10-02T08:10:29.304162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10de26bb-6499f40c-2f905268-5d5b59c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:29.306812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0] Write session: try to update token
2025-10-02T08:10:29.306828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:29.314109Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:29.314128Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:29.314136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533803777083233:10793]
2025-10-02T08:10:29.314171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:29.314187Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:29.314331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:29.314479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:29.314616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:29.314747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:29.315057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:29.315096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:29.327845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId: src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:29.330867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:29.330946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.330955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.332868Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:29.332872Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:29.332875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:29.332885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533803777083233:10793]
2025-10-02T08:10:29.332889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533803777083233:10793]
2025-10-02T08:10:29.332937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:29.332939Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:29.332946Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:29.332960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:29.332966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.332968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:29.333117Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:29.336978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:29.372019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533803777083301:9858]
2025-10-02T08:10:29.372271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 900, pipe: [1:7556533803777083301:9858]
2025-10-02T08:10:29.474936Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:29.475495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.475516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.475707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.475774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.475850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.475915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.475977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.475988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.476062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.476131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.476205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.476279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.476330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.476338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.476411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.476476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.476542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.476612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.476754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.476763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.479482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:29.479841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:29.479857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0] Write session will restart in 0.007098s
2025-10-02T08:10:29.479885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0] Write session: Do CDS request
2025-10-02T08:10:29.479892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:29.476849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.476935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.477001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.477066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.477166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.477169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.477241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.477301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.477366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.477428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.477531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.477534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.477609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.477670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.477731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.477839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.477886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.477889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.477959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.478018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.478084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.478148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.478193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.478196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.478267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.478325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.478389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.478452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.478525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.478528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.478603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.478658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.478713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.478771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.478813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.478815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.478880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:29.478945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:29.479009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:29.479075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:29.479195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:29.479197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:29.479239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533803777083301:9858], now have 1 active actors on pipe
2025-10-02T08:10:29.479380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:29.479385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:29.479418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 901 reason: error at write: Disconnected sessionId: src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0
2025-10-02T08:10:29.479672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 901 sessionId: src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0 is DEAD
2025-10-02T08:10:29.479717Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:29.480001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533803777083301:9858]
2025-10-02T08:10:29.488881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:29.489000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:29.489022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 902
2025-10-02T08:10:29.489276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:29.489321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:29.489331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:29.489335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:29.489797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 902 sessionId:  describe result for acl check
2025-10-02T08:10:29.489853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:29.489861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:29.489863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:29.489869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533803777083614:10802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:29.490600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533803777083614:10802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:29.494354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533803777083614:10802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:29.498367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533803777083614:10802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:29.498390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533803777083614:10802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:29.498394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533803777083614:10802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:29.498404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:29.508847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:29.510030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:29.510273Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:29.510291Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:29.510304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:29.510366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:29.510422Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533803777083893:10801]
2025-10-02T08:10:29.511227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:29.511459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:29.511514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:29.511892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:29.511954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.511961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.511962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.511964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.511965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.511971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.511983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.511987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.511991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.511994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.512002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.512011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.512018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.512024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.512029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.512038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.512049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.512054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.512062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.512073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.512094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:29.522943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:29.524917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:29.524949Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:29.524953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:29.524962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:29.524973Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 901 [1:7556533803777083893:10801]
2025-10-02T08:10:29.524989Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:29.525014Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:29.525018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.525022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.525025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.525050Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:29.525057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:29.525066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:29.525162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.525165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.525168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:29.525172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:29.525572Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 901
2025-10-02T08:10:29.525262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:29.525273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.525290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.525300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:29.525324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533803777083887:10801]
2025-10-02T08:10:29.525327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533803777083887:10801]
2025-10-02T08:10:29.525337Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:29.525351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:29.525366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:29.525370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:29.525408Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:29.525410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:29.525426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533803777083735:10802], now have 1 active actors on pipe
2025-10-02T08:10:29.525430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533803777083887:10801]
2025-10-02T08:10:29.525434Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:29.525455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533804237189964:2378], now have 1 active actors on pipe
2025-10-02T08:10:29.525480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:29.525497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 901
2025-10-02T08:10:29.525635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.525641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.525675Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:29.525684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.525690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.525693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:29.525711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.525724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:29.525749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:29.525837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.525841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.525856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:29.525896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 902 partition: 0 MaxSeqNo: 17 sessionId: src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0
2025-10-02T08:10:29.526335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc3aa25-d55c5057-76893b1e-a7dde7b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:29.529699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0] Write session: try to update token
2025-10-02T08:10:29.529725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:29.549763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId: src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:29.554814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:29.555859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.555888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.555915Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:29.555925Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:29.555928Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:29.555938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533803777083887:10801]
2025-10-02T08:10:29.555943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533803777083887:10801]
2025-10-02T08:10:29.556007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:29.556018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.556021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:29.556186Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:29.559427Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:29.559439Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:29.580421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533803777083922:9858]
2025-10-02T08:10:29.580625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 901, pipe: [1:7556533803777083922:9858]
2025-10-02T08:10:29.720688Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:29.721120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:29.721177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533803777083922:9858], now have 1 active actors on pipe
2025-10-02T08:10:29.721176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:29.721476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:29.721750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:29.721765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0] Write session will restart in 0.007745s
2025-10-02T08:10:29.721867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0] Write session: Do CDS request
2025-10-02T08:10:29.721882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:29.721293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:29.721328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:29.721350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 902 reason: error at write: Disconnected sessionId: src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0
2025-10-02T08:10:29.721532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 902 sessionId: src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0 is DEAD
2025-10-02T08:10:29.721712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533803777083922:9858]
2025-10-02T08:10:29.721731Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:10:29.721870Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 9 consumer shared/user session shared/user_1_9_9807394147570821438_v1 is DEAD
2025-10-02T08:10:29.722075Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533700697830229:9851] disconnected; active server actors: 1
2025-10-02T08:10:29.722088Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533700697830229:9851] client user disconnected session shared/user_1_9_9807394147570821438_v1
2025-10-02T08:10:29.722116Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:10:29.722338Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:10:29.722345Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:10:29.722358Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.008770s
2025-10-02T08:10:29.734343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:29.734440Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:10:29.738719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:29.738738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 903
2025-10-02T08:10:29.738757Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:10:29.738761Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 10
2025-10-02T08:10:29.738910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:29.738943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:29.738958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:29.738962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:29.739362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 903 sessionId:  describe result for acl check
2025-10-02T08:10:29.739403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:29.739408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:29.739410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:29.739415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533803777084177:10809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:29.739826Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 10 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:10:29.739879Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:10:29.739898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533803777084177:10809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:29.739959Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 auth for : user
2025-10-02T08:10:29.740038Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 Handle describe topics response
2025-10-02T08:10:29.740059Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 auth is DEAD
2025-10-02T08:10:29.740064Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:10:29.740329Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:10:29.740760Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533803777084186:10810] connected; active server actors: 1
2025-10-02T08:10:29.741603Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533803777084186:10810] session shared/user_1_10_9309877639626385662_v1
2025-10-02T08:10:29.741618Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:10:29.741626Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:10:29.741630Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_10_9309877639626385662_v1" (Sender=[1:7556533803777084175:10810], Pipe=[1:7556533803777084186:10810], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:10:29.741632Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:10:29.741641Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:10:29.741647Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_10_9309877639626385662_v1" (Sender=[1:7556533803777084175:10810], Pipe=[1:7556533803777084186:10810], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:10:29.741655Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_10_9309877639626385662_v1" sender [1:7556533803777084175:10810] lock partition 0 for ReadingSession "shared/user_1_10_9309877639626385662_v1" (Sender=[1:7556533803777084175:10810], Pipe=[1:7556533803777084186:10810], Partitions=[], ActiveFamilyCount=1) generation 1 step 10
2025-10-02T08:10:29.741666Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:10:29.741668Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000025s
2025-10-02T08:10:29.741817Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_10_9309877639626385662_v1
2025-10-02T08:10:29.741835Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:10:29.741953Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:10:29.742281Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 10 Session: "shared/user_1_10_9309877639626385662_v1" ClientId: "user" PipeClient { RawX1: 7556533803777084186 RawX2: 4503603922348602 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:10:29.742307Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:10:29.742397Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 got read request: guid# 200dca23-d5739cdd-c18e5b39-10b55218
2025-10-02T08:10:29.742424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:10:29.742692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533803777084177:10809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:29.747910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533803777084177:10809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:29.747930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533803777084177:10809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:29.747935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533803777084177:10809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:29.747944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:29.766052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:29.768075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:29.768356Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:29.768361Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:29.768377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:29.768452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:29.768526Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533803777084521:10808]
2025-10-02T08:10:29.769279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:29.769577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:29.769635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:29.769999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:29.770071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.770072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.770073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.770075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.770076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.770082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.770094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.770098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.770101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.770104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.770111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.770119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:29.770126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.770132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:29.770136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.770141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:29.770145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.770150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.770154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.770159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.770178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:29.815434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:29.817994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:29.818009Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:29.818013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:29.818018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:29.818027Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 902 [1:7556533803777084521:10808]
2025-10-02T08:10:29.818047Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:29.818089Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:29.818094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.818098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.818100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.818127Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:29.818134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:29.818143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:29.818250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.818257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.818261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:29.818266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:29.819519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 902
2025-10-02T08:10:29.829166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 902
2025-10-02T08:10:29.829341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:29.829346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.829373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:29.829390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:29.829404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533803777084270:10809], now have 1 active actors on pipe
2025-10-02T08:10:29.829409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533803777084218:10816], now have 1 active actors on pipe
2025-10-02T08:10:29.829412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533804237189985:2378], now have 1 active actors on pipe
2025-10-02T08:10:29.829455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533803777084515:10808]
2025-10-02T08:10:29.829458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533803777084515:10808]
2025-10-02T08:10:29.829476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:29.829502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:29.829519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:29.829524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:29.829580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533803777084515:10808]
2025-10-02T08:10:29.829583Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:29.829641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 902, pipe: [1:7556533803777084218:10816]
2025-10-02T08:10:29.831268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:29.831273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:29.831282Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:29.832860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.832896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.832918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_10_9309877639626385662_v1 on pipe: [1:7556533803777084218:10816]
2025-10-02T08:10:29.832959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.832962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.832986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.832997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.833001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:29.833033Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_10_9309877639626385662_v1
2025-10-02T08:10:29.833036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.833095Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:29.833104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:10:29.833110Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:29.833344Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_10_9309877639626385662_v1:1 with generation 902
2025-10-02T08:10:29.849374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:10:29.849416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:10:29.849427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:29.849433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:29.849436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:29.849447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:29.849462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:29.849471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:10:29.849485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:10:29.849498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:29.849579Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392629818 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:10:29.849598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:10:29.849643Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 sending to client partition status
2025-10-02T08:10:29.849825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:29.849839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:29.849859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:29.849900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 903 partition: 0 MaxSeqNo: 17 sessionId: src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0
2025-10-02T08:10:29.852663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7a1aac-8a51d7c2-200c46b5-30a801cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:29.856269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0] Write session: try to update token
2025-10-02T08:10:29.856290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:29.872154Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:29.872181Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:29.872184Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:29.872198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533803777084515:10808]
2025-10-02T08:10:29.872202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533803777084515:10808]
2025-10-02T08:10:29.872262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:29.872270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:29.872273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:29.872422Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:29.872443Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:29.872455Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:29.880414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId: src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:29.883046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:30.027076Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:30.027453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.027471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.027643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533803777084218:10816]
2025-10-02T08:10:30.027676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:30.027683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:30.027746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 903 reason: error at write: Disconnected sessionId: src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0
2025-10-02T08:10:30.027746Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:30.028143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:30.028161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0] Write session will restart in 0.005877s
2025-10-02T08:10:30.028190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0] Write session: Do CDS request
2025-10-02T08:10:30.027792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_10_9309877639626385662_v1
2025-10-02T08:10:30.028197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:30.027813Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:30.027965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 903 sessionId: src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0 is DEAD
2025-10-02T08:10:30.028131Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_10_9309877639626385662_v1
2025-10-02T08:10:30.035484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:30.035505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 904
2025-10-02T08:10:30.035523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:30.035860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:30.035930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:30.035942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:30.035948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:30.036478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 904 sessionId:  describe result for acl check
2025-10-02T08:10:30.036542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:30.036544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:30.036546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:30.036552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533808072052149:10833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:30.037136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533808072052149:10833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:30.040493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533808072052149:10833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:30.044425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533808072052149:10833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:30.044447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533808072052149:10833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:30.044451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533808072052149:10833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:30.044460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:30.050702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:30.051132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:30.051384Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:30.051397Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:30.051407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:30.051454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:30.051497Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533808072052489:10832]
2025-10-02T08:10:30.052174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:30.052397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:30.052447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:30.052756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:30.052835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.052845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.052846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.052847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.052848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.052853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.052863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.052867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.052870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.052873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.052880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.052887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.052893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.052897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.052902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.052907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.052911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.052916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.052920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.052925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.052942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:30.066689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:30.068960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:30.068968Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:30.068971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:30.068975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:30.068982Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 903 [1:7556533808072052489:10832]
2025-10-02T08:10:30.068993Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:30.069014Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:30.069017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.069020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.069022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.069041Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:30.069047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:30.069055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:30.069128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.069131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.069136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:30.069138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:30.069216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:30.069221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.069237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.069247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:30.069263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533808072052483:10832]
2025-10-02T08:10:30.069265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533808072052483:10832]
2025-10-02T08:10:30.069284Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:30.069298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:30.069311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:30.069313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:30.069351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533808072052483:10832]
2025-10-02T08:10:30.069353Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:30.069468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:30.069475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:30.069500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:30.069816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 903
2025-10-02T08:10:30.069841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533808072052428:10833], now have 1 active actors on pipe
2025-10-02T08:10:30.069847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533808532157314:2378], now have 1 active actors on pipe
2025-10-02T08:10:30.070064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.070074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.070102Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:30.070110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.070114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.070116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:30.070127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.070142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:30.070165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:30.070202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.070204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.070217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:30.070251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 904 partition: 0 MaxSeqNo: 17 sessionId: src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0
2025-10-02T08:10:30.070597Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 903
2025-10-02T08:10:30.072976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f66230-f0b1afc8-5859bfb8-2ef69b48_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:30.076206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0] Write session: try to update token
2025-10-02T08:10:30.076234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:30.100163Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:30.100200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:30.100205Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:30.100220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533808072052483:10832]
2025-10-02T08:10:30.100229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533808072052483:10832]
2025-10-02T08:10:30.100305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:30.100324Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:30.100326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.100329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:30.100331Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:30.100572Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:30.110136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId: src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:30.112843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:30.129049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533808072052513:10816]
2025-10-02T08:10:30.129348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 903, pipe: [1:7556533808072052513:10816]
2025-10-02T08:10:30.250579Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:30.249273Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:30.250167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.250176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.250215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533808072052513:10816], now have 1 active actors on pipe
2025-10-02T08:10:30.250383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533808072052513:10816]
2025-10-02T08:10:30.250408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:30.250411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:30.250470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 904 reason: error at write: Disconnected sessionId: src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0
2025-10-02T08:10:30.250655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 904 sessionId: src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0 is DEAD
2025-10-02T08:10:30.250947Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:30.252942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:30.252954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0] Write session will restart in 0.006073s
2025-10-02T08:10:30.252984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0] Write session: Do CDS request
2025-10-02T08:10:30.252991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:30.260544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:30.260603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:30.260624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 905
2025-10-02T08:10:30.260992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:30.261036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:30.261041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:30.261045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:30.261541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 905 sessionId:  describe result for acl check
2025-10-02T08:10:30.261581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:30.261583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:30.261585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:30.261591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533808072052808:10839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:30.262151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533808072052808:10839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:30.268989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533808072052808:10839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:30.278066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:30.278644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533808072052808:10839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:30.278664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533808072052808:10839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:30.278668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533808072052808:10839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:30.278677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:30.282078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:30.282395Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:30.282412Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:30.282427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:30.282503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:30.282564Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533808072053116:10838]
2025-10-02T08:10:30.283344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:30.283630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:30.283692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:30.284100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:30.284173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.284180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.284182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.284184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.284185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.284193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.284205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.284209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.284213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.284218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.284225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.284234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.284241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.284247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.284258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.284264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.284269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.284280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.284292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.284297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.284326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:30.302052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:30.303747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:30.303756Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:30.303760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:30.303764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:30.303772Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 904 [1:7556533808072053116:10838]
2025-10-02T08:10:30.303786Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:30.303805Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:30.303809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.303814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.303816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.303832Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:30.303838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:30.303844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:30.303898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.303900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.303905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:30.303907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:30.303975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:30.303977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.303991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.304002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:30.304019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533808072053103:10838]
2025-10-02T08:10:30.304021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533808072053103:10838]
2025-10-02T08:10:30.304028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:30.304042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:30.304054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:30.304057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:30.304086Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:30.304089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:30.304097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533808072053111:10839], now have 1 active actors on pipe
2025-10-02T08:10:30.304101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533808072053103:10838]
2025-10-02T08:10:30.304103Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:30.304119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533808532157320:2378], now have 1 active actors on pipe
2025-10-02T08:10:30.304140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 904
2025-10-02T08:10:30.304255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:30.304346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.304360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.304386Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3868b9f5-59e88480-c0f07cc7-63337387_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:30.304394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.304397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.304399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:30.304409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.304419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:30.304437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:30.304524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.304531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.304545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:30.304593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 905 partition: 0 MaxSeqNo: 17 sessionId: src_id|3868b9f5-59e88480-c0f07cc7-63337387_0
2025-10-02T08:10:30.305000Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 904
2025-10-02T08:10:30.305049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780982ac-dbd1bdbb-1f58fb2b-15833155_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3868b9f5-59e88480-c0f07cc7-63337387_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:30.307788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3868b9f5-59e88480-c0f07cc7-63337387_0] Write session: try to update token
2025-10-02T08:10:30.307805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3868b9f5-59e88480-c0f07cc7-63337387_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:30.334909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId: src_id|3868b9f5-59e88480-c0f07cc7-63337387_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:30.337856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:30.338449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.338471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.338510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:30.338529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:30.339212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.339222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.339454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.339535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.339632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.339710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.339762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.339767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.339851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.339921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.339993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.340069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.340137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.340140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.340221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.340290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.340354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.340424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.340478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.340481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.340562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.340637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.340710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.340780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.340850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.340854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.340927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.340991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.341062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.341139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.341190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.341193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.341275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.341344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.341416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.341489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.341536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.341540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.341616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.341685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.341775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.341843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.341888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.341891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.341967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.342035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.342105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.342174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.342220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.342223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.342302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.342370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.342440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.342508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.342556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.342558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.342637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:30.342708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:30.342779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:30.342856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:30.342905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:30.342908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:30.342978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:30.343046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.343071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.343074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:30.343107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:30.343123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:30.343127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:30.343130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:30.343134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:30.343640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:30.343662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:30.343668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:30.343672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:30.343678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:30.343682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:30.344932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:30.344970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:30.344978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:30.344983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:30.344987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:30.344991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:30.346159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:30.346178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:30.346185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:30.346190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:30.346193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:30.347883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:30.347893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:30.347905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392630344
2025-10-02T08:10:30.348042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:30.348051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:30.348057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:30.348060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:30.348065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:30.348072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:30.348664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:30.348678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:30.348684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:30.348688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:30.348691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:30.348695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:30.349044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533808072053140:10816]
2025-10-02T08:10:30.349230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 904, pipe: [1:7556533808072053140:10816]
2025-10-02T08:10:30.350068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:30.350091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:30.350099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:30.350103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:30.350107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:30.350111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:30.350799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:30.350814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:30.350820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:30.352292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:30.352301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:30.352308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:30.352313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:30.352327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392630349
2025-10-02T08:10:30.352741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:30.352754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:30.352764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:30.352770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:30.352775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:30.352778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:30.353572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:30.353601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:30.353608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:30.353612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:30.353616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:30.353620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:30.354163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:30.354173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.354296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392630352
2025-10-02T08:10:30.360573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533808072053140:10816], now have 1 active actors on pipe
2025-10-02T08:10:30.360599Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:30.360620Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:30.360627Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:30.360634Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:30.360645Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:30.360648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:30.360651Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:30.360658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533808072053103:10838]
2025-10-02T08:10:30.360663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533808072053103:10838]
2025-10-02T08:10:30.360704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:30.360707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:30.360737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:30.360742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.360744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:30.361027Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:30.534294Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:30.538558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:30.538666Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:30.539041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533808072053140:10816]
2025-10-02T08:10:30.539068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:30.539096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 905 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3868b9f5-59e88480-c0f07cc7-63337387_0
2025-10-02T08:10:30.539307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 905 sessionId: src_id|3868b9f5-59e88480-c0f07cc7-63337387_0 is DEAD
2025-10-02T08:10:30.539749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3868b9f5-59e88480-c0f07cc7-63337387_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:30.539758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3868b9f5-59e88480-c0f07cc7-63337387_0] Write session will restart in 0.006950s
2025-10-02T08:10:30.539784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3868b9f5-59e88480-c0f07cc7-63337387_0] Write session: Do CDS request
2025-10-02T08:10:30.539791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3868b9f5-59e88480-c0f07cc7-63337387_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:30.548747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3868b9f5-59e88480-c0f07cc7-63337387_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:30.552975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:30.552996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 906
2025-10-02T08:10:30.553993Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6353898a00897a05] Result# TEvPutResult {Id# [72075186224037892:904:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:30.554049Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:904:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:30.556948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:30.557008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:30.557015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:30.557019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:30.561173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 906 sessionId:  describe result for acl check
2025-10-02T08:10:30.561226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:30.561232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:30.561234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:30.561240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533808072053194:10845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:30.561778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533808072053194:10845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:30.568541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533808072053194:10845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:30.576394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533808072053194:10845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:30.576419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533808072053194:10845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:30.576422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533808072053194:10845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:30.576431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:30.591134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:30.593897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:30.594132Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:30.594136Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:30.594146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:30.594197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:30.594235Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533808072053750:10844]
2025-10-02T08:10:30.594851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:30.595161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:30.595212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:30.595522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:30.595568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.595591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.595592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.595593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.595595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.595600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.595611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.595614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.595618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.595622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.595628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.595636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.595641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.595646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.595651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.595657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.595661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.595666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.595670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.595675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.595694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:30.608227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:30.610023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:30.610030Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:30.610033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:30.610037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:30.610044Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 905 [1:7556533808072053750:10844]
2025-10-02T08:10:30.610058Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:30.610077Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:30.610081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.610084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.610087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.610104Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:30.610109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:30.610116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:30.610183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.610185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.610188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:30.610191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:30.610275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:30.610279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.610294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.610305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:30.610322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533808072053743:10844]
2025-10-02T08:10:30.610324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533808072053743:10844]
2025-10-02T08:10:30.610335Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:30.610348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:30.610361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:30.610363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:30.610396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533808072053743:10844]
2025-10-02T08:10:30.610399Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:30.610674Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:30.610685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:30.610691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:30.610832Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 905
2025-10-02T08:10:30.612941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533808532157329:2378], now have 1 active actors on pipe
2025-10-02T08:10:30.612967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533808072053576:10845], now have 1 active actors on pipe
2025-10-02T08:10:30.613011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 905
2025-10-02T08:10:30.614634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.614650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.614682Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:30.614694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.614698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.614702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:30.614715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.614731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:30.614751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:30.615777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.615789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.615817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:30.615858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 906 partition: 0 MaxSeqNo: 17 sessionId: src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0
2025-10-02T08:10:30.617023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3868b9f5-59e88480-c0f07cc7-63337387_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:30.620235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0] Write session: try to update token
2025-10-02T08:10:30.620256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:30.639713Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:30.639738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:30.639737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533808072053776:10816]
2025-10-02T08:10:30.639741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:30.639751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533808072053743:10844]
2025-10-02T08:10:30.639757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533808072053743:10844]
2025-10-02T08:10:30.639799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:30.639808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.639810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:30.639910Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:30.639914Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:30.639999Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:30.640036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 905, pipe: [1:7556533808072053776:10816]
2025-10-02T08:10:30.659305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId: src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:30.662687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:30.789935Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:30.790283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533808072053776:10816], now have 1 active actors on pipe
2025-10-02T08:10:30.790358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.790372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.790508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533808072053776:10816]
2025-10-02T08:10:30.790527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:30.790529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:30.790575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 906 reason: error at write: Disconnected sessionId: src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0
2025-10-02T08:10:30.790646Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:30.790667Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:30.790745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 906 sessionId: src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0 is DEAD
2025-10-02T08:10:30.790881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:30.790888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0] Write session will restart in 0.007462s
2025-10-02T08:10:30.790916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0] Write session: Do CDS request
2025-10-02T08:10:30.790923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:30.805343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:30.805388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:30.805408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 907
2025-10-02T08:10:30.805559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:30.805588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:30.805599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:30.805603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:30.806153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 907 sessionId:  describe result for acl check
2025-10-02T08:10:30.806185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:30.806196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:30.806198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:30.806203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533808072054334:10853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:30.806724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533808072054334:10853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:30.808765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533808072054334:10853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:30.809940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:30.810400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:30.810602Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:30.810614Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:30.810624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:30.810673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:30.810714Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533808072054380:10851]
2025-10-02T08:10:30.811428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:30.811651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:30.811696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:30.812036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:30.812096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.812103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.812104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.812105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.812107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.812113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.812124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.812129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.812133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.812138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.812143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.812151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:30.812158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.812164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:30.812174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.812179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:30.812189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.812194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.812199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.812204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.812229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:30.817553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533808072054334:10853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:30.817573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533808072054334:10853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:30.817577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533808072054334:10853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:30.817587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:30.820968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:30.823254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:30.823276Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:30.823279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:30.823283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:30.823290Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 906 [1:7556533808072054380:10851]
2025-10-02T08:10:30.823306Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:30.823325Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:30.823333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.823337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.823339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.823357Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:30.823362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:30.823369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:30.823436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.823444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.823448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:30.823450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:30.823519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:30.823527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.823543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:30.823562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:30.823596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533808072054374:10851]
2025-10-02T08:10:30.823603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533808072054374:10851]
2025-10-02T08:10:30.823611Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:30.823625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533808072054396:10853], now have 1 active actors on pipe
2025-10-02T08:10:30.823633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 906
2025-10-02T08:10:30.823634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:30.823637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:30.823638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:30.823652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:30.823655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:30.823661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533808532157348:2378], now have 1 active actors on pipe
2025-10-02T08:10:30.823697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.823706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.823719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533808072054374:10851]
2025-10-02T08:10:30.823731Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:30.823744Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:30.823762Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c86734d-109da618-f1197c1-a52712ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:30.823773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:30.823778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:30.823785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:30.823794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:30.823808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:30.823836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:30.823926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 906
2025-10-02T08:10:30.823891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:30.823898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:30.823911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:30.823942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 907 partition: 0 MaxSeqNo: 17 sessionId: src_id|c86734d-109da618-f1197c1-a52712ec_0
2025-10-02T08:10:30.824280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f0ee31-f5df2ff4-e0bbc27a-bcf882fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c86734d-109da618-f1197c1-a52712ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:30.827099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86734d-109da618-f1197c1-a52712ec_0] Write session: try to update token
2025-10-02T08:10:30.827116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86734d-109da618-f1197c1-a52712ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:30.842614Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:30.842635Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:30.842638Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:30.842648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533808072054374:10851]
2025-10-02T08:10:30.842652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533808072054374:10851]
2025-10-02T08:10:30.842696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:30.842701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:30.842702Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:30.842708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:30.842710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:30.842866Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:30.849341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId: src_id|c86734d-109da618-f1197c1-a52712ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:30.852237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:30.891568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533808072054420:10816]
2025-10-02T08:10:30.891811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 906, pipe: [1:7556533808072054420:10816]
2025-10-02T08:10:31.000618Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:31.001231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.001249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.001270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533808072054420:10816], now have 1 active actors on pipe
2025-10-02T08:10:31.001554Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:31.001547Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:31.001619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533808072054420:10816]
2025-10-02T08:10:31.001634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:31.001691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 907 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c86734d-109da618-f1197c1-a52712ec_0
2025-10-02T08:10:31.001862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 907 sessionId: src_id|c86734d-109da618-f1197c1-a52712ec_0 is DEAD
2025-10-02T08:10:31.002200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86734d-109da618-f1197c1-a52712ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:31.002210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86734d-109da618-f1197c1-a52712ec_0] Write session will restart in 0.007006s
2025-10-02T08:10:31.002241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86734d-109da618-f1197c1-a52712ec_0] Write session: Do CDS request
2025-10-02T08:10:31.002249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86734d-109da618-f1197c1-a52712ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:31.017364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c86734d-109da618-f1197c1-a52712ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.020217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:31.020237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 908
2025-10-02T08:10:31.020630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.020665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:31.020671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:31.020676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:31.021121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 908 sessionId:  describe result for acl check
2025-10-02T08:10:31.021159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:31.021161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:31.021162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:31.021167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533812367022105:10872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:31.021779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533812367022105:10872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:31.026168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533812367022105:10872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:31.033224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533812367022105:10872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:31.033246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533812367022105:10872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:31.033250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533812367022105:10872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:31.033260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:31.037989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:31.038405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:31.038605Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:31.038615Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:31.038624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:31.038682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:31.038712Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533812367022343:10870]
2025-10-02T08:10:31.039360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:31.039742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:31.039817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:31.040200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:31.040253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.040260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.040262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.040263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.040265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.040271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.040282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.040287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.040291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.040296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.040303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.040312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.040318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.040329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.040333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.040344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.040349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.040354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.040363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.040368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.040389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:31.054655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:31.056663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:31.056688Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:31.056690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:31.056695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:31.056701Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 907 [1:7556533812367022343:10870]
2025-10-02T08:10:31.056714Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:31.056734Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:31.056738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.056741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.056744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.056761Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:31.056767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:31.056774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:31.056869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.056880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.056883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:31.056886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:31.056960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:31.056970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.056987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.057005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:31.057027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367022322:10872], now have 1 active actors on pipe
2025-10-02T08:10:31.057040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533812367022337:10870]
2025-10-02T08:10:31.057048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533812367022337:10870]
2025-10-02T08:10:31.057065Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:31.057078Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:31.057081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:31.057084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:31.057099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:31.057107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:31.057114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533812827124675:2378], now have 1 active actors on pipe
2025-10-02T08:10:31.057146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533812367022337:10870]
2025-10-02T08:10:31.057154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:31.057200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 907
2025-10-02T08:10:31.057263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:31.057279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.057284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.057314Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90ea771f-d636513f-55d968a8-8b236ce6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:31.057327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.057336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.057339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:31.057349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.057363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:31.057386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.057568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.057577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.057594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.057631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 908 partition: 0 MaxSeqNo: 17 sessionId: src_id|90ea771f-d636513f-55d968a8-8b236ce6_0
2025-10-02T08:10:31.058051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c86734d-109da618-f1197c1-a52712ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|90ea771f-d636513f-55d968a8-8b236ce6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:31.058242Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 907
2025-10-02T08:10:31.061132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ea771f-d636513f-55d968a8-8b236ce6_0] Write session: try to update token
2025-10-02T08:10:31.061150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ea771f-d636513f-55d968a8-8b236ce6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:31.077689Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:31.077713Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:31.077716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:31.077727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533812367022337:10870]
2025-10-02T08:10:31.077731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533812367022337:10870]
2025-10-02T08:10:31.077775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:31.077782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.077785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:31.077973Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:31.080876Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:31.080900Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:31.089928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId: src_id|90ea771f-d636513f-55d968a8-8b236ce6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:31.092651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:31.101735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533812367022369:10816]
2025-10-02T08:10:31.102365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 907, pipe: [1:7556533812367022369:10816]
2025-10-02T08:10:31.229351Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:31.229893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.229901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.229936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367022369:10816], now have 1 active actors on pipe
2025-10-02T08:10:31.230112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533812367022369:10816]
2025-10-02T08:10:31.230133Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:31.230142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:31.230144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:31.230228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 908 reason: error at write: Disconnected sessionId: src_id|90ea771f-d636513f-55d968a8-8b236ce6_0
2025-10-02T08:10:31.230436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 908 sessionId: src_id|90ea771f-d636513f-55d968a8-8b236ce6_0 is DEAD
2025-10-02T08:10:31.230613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ea771f-d636513f-55d968a8-8b236ce6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:31.230624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ea771f-d636513f-55d968a8-8b236ce6_0] Write session will restart in 0.007932s
2025-10-02T08:10:31.230660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ea771f-d636513f-55d968a8-8b236ce6_0] Write session: Do CDS request
2025-10-02T08:10:31.230670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ea771f-d636513f-55d968a8-8b236ce6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:31.230936Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:31.239466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ea771f-d636513f-55d968a8-8b236ce6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.239874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:31.239891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 909
2025-10-02T08:10:31.240078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.240108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:31.240113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:31.240117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:31.240613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 909 sessionId:  describe result for acl check
2025-10-02T08:10:31.240654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:31.240656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:31.240657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:31.240663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533812367022709:10878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:31.241225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533812367022709:10878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:31.244543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533812367022709:10878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:31.250303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533812367022709:10878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:31.250323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533812367022709:10878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:31.250326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533812367022709:10878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:31.250335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:31.255701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:31.256012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:31.256396Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:31.256400Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:31.256409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:31.256455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:31.256486Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533812367022973:10877]
2025-10-02T08:10:31.256984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:31.257158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:31.257197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:31.257498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:31.257563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.257564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.257565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.257566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.257567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.257572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.257582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.257586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.257589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.257593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.257598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.257605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.257611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.257616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.257620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.257624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.257628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.257632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.257636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.257640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.257657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:31.267434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:31.269321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:31.269347Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:31.269351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:31.269355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:31.269363Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 908 [1:7556533812367022973:10877]
2025-10-02T08:10:31.269378Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:31.269398Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:31.269402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.269406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.269408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.269428Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:31.269433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:31.269440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:31.269517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.269520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.269523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:31.269526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:31.269597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:31.269601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.269616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.269629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:31.269647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533812367022967:10877]
2025-10-02T08:10:31.269649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533812367022967:10877]
2025-10-02T08:10:31.269664Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:31.269678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:31.269692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:31.269695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:31.269729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533812367022967:10877]
2025-10-02T08:10:31.269733Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:31.269836Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:31.269839Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:31.269844Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:31.270454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 908
2025-10-02T08:10:31.270473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367022952:10878], now have 1 active actors on pipe
2025-10-02T08:10:31.270477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533812827124683:2378], now have 1 active actors on pipe
2025-10-02T08:10:31.270687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.270699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.270726Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:31.270735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.270739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.270742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:31.270752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.270764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:31.270781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.270894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.270912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.270940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.270991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 909 partition: 0 MaxSeqNo: 17 sessionId: src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0
2025-10-02T08:10:31.271392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ea771f-d636513f-55d968a8-8b236ce6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:31.271880Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 908
2025-10-02T08:10:31.274088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0] Write session: try to update token
2025-10-02T08:10:31.274104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:31.296226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId: src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:31.296891Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:31.296908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:31.296911Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:31.296920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533812367022967:10877]
2025-10-02T08:10:31.296925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533812367022967:10877]
2025-10-02T08:10:31.296973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:31.296980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.296983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:31.297130Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:31.299188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:31.299297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:31.299302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:31.331447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533812367022997:10816]
2025-10-02T08:10:31.331814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 908, pipe: [1:7556533812367022997:10816]
2025-10-02T08:10:31.444340Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:31.444938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.444946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.444985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367022997:10816], now have 1 active actors on pipe
2025-10-02T08:10:31.445124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533812367022997:10816]
2025-10-02T08:10:31.445346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:31.445349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:31.445399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 909 reason: error at write: Disconnected sessionId: src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0
2025-10-02T08:10:31.445578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 909 sessionId: src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0 is DEAD
2025-10-02T08:10:31.445598Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:31.448916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:31.448931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0] Write session will restart in 0.005165s
2025-10-02T08:10:31.448958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0] Write session: Do CDS request
2025-10-02T08:10:31.448968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:31.448930Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:31.455932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.456273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:31.456294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 910
2025-10-02T08:10:31.456443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.456469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:31.456474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:31.456478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:31.456964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 910 sessionId:  describe result for acl check
2025-10-02T08:10:31.456999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:31.457001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:31.457003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:31.457017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533812367023322:10884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:31.457628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533812367023322:10884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:31.462695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533812367023322:10884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:31.471707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:31.475576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:31.475860Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:31.475864Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:31.475875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:31.475926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:31.475963Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533812367023600:10883]
2025-10-02T08:10:31.476605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:31.483006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533812367023322:10884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:31.483030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533812367023322:10884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:31.483033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533812367023322:10884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:31.483043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:31.487117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:31.487229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:31.487641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:31.487695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.487696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.487698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.487699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.487701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.487706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.487716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.487719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.487723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.487726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.487733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.487741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.487747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.487752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.487757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.487762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.487766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.487771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.487775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.487779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.487801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:31.507444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:31.509358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:31.509368Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:31.509371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:31.509374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:31.509382Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 909 [1:7556533812367023600:10883]
2025-10-02T08:10:31.509395Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:31.509414Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:31.509417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.509420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.509423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.509441Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:31.509445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:31.509451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:31.509524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.509527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.509529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:31.509532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:31.509604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:31.509607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.509621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.509632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:31.509649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533812367023594:10883]
2025-10-02T08:10:31.509651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533812367023594:10883]
2025-10-02T08:10:31.509664Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:31.509676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:31.509690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:31.509693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:31.509728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533812367023594:10883]
2025-10-02T08:10:31.509730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:31.510001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:31.510012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:31.510017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:31.510556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 909
2025-10-02T08:10:31.510570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367023609:10884], now have 1 active actors on pipe
2025-10-02T08:10:31.510574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533812827124689:2378], now have 1 active actors on pipe
2025-10-02T08:10:31.510689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.510701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.510726Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92195713-dfc7971-a4ad67d9-13562ff5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:31.510733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.510739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.510741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:31.510752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.510764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:31.510781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.511282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.511295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.511325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.511782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a03305-71e77a4c-d76e1a31-4b9b21fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|92195713-dfc7971-a4ad67d9-13562ff5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:31.514743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92195713-dfc7971-a4ad67d9-13562ff5_0] Write session: try to update token
2025-10-02T08:10:31.514763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92195713-dfc7971-a4ad67d9-13562ff5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:31.511358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 910 partition: 0 MaxSeqNo: 17 sessionId: src_id|92195713-dfc7971-a4ad67d9-13562ff5_0
2025-10-02T08:10:31.517017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 909
2025-10-02T08:10:31.546647Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:31.546678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:31.546681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:31.546693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533812367023594:10883]
2025-10-02T08:10:31.546697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533812367023594:10883]
2025-10-02T08:10:31.546749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:31.546748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:31.546757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.546760Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:31.546760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:31.546917Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:31.548695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533812367023632:10816]
2025-10-02T08:10:31.548728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId: src_id|92195713-dfc7971-a4ad67d9-13562ff5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:31.551837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:31.552003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 909, pipe: [1:7556533812367023632:10816]
2025-10-02T08:10:31.697806Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:31.698098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.698113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.698135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367023632:10816], now have 1 active actors on pipe
2025-10-02T08:10:31.698288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533812367023632:10816]
2025-10-02T08:10:31.698318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:31.698321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:31.698403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 910 reason: error at write: Disconnected sessionId: src_id|92195713-dfc7971-a4ad67d9-13562ff5_0
2025-10-02T08:10:31.698589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 910 sessionId: src_id|92195713-dfc7971-a4ad67d9-13562ff5_0 is DEAD
2025-10-02T08:10:31.698606Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:31.698725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92195713-dfc7971-a4ad67d9-13562ff5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:31.698736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92195713-dfc7971-a4ad67d9-13562ff5_0] Write session will restart in 0.008313s
2025-10-02T08:10:31.698711Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:31.698761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92195713-dfc7971-a4ad67d9-13562ff5_0] Write session: Do CDS request
2025-10-02T08:10:31.698769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92195713-dfc7971-a4ad67d9-13562ff5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:31.708353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92195713-dfc7971-a4ad67d9-13562ff5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.708422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:31.708443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 911
2025-10-02T08:10:31.708603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.708642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:31.708655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:31.708659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:31.709232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 911 sessionId:  describe result for acl check
2025-10-02T08:10:31.709284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:31.709293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:31.709294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:31.709300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533812367024023:10891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:31.709854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533812367024023:10891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:31.713250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533812367024023:10891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:31.716297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533812367024023:10891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:31.716317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533812367024023:10891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:31.716321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533812367024023:10891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:31.716329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:31.718023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:31.718526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:31.718695Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:31.718707Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:31.718717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:31.718762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:31.718800Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533812367024243:10890]
2025-10-02T08:10:31.719422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:31.719638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:31.719683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:31.719970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:31.720019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.720026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.720027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.720028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.720029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.720034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.720043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.720047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.720051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.720055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.720061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.720067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.720073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.720077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.720082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.720086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.720090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.720095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.720099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.720103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.720121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:31.732409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:31.734215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:31.734236Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:31.734239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:31.734242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:31.734248Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 910 [1:7556533812367024243:10890]
2025-10-02T08:10:31.734260Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:31.734278Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:31.734281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.734284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.734286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.734303Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:31.734313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:31.734323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:31.734385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.734392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.734395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:31.734397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:31.734467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:31.734477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.734491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.734501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:31.734520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533812367024237:10890]
2025-10-02T08:10:31.734521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533812367024237:10890]
2025-10-02T08:10:31.734529Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:31.734543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:31.734557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:31.734563Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:31.734565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:31.734569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:31.734570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 910
2025-10-02T08:10:31.734579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367024233:10891], now have 1 active actors on pipe
2025-10-02T08:10:31.734613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533812827124709:2378], now have 1 active actors on pipe
2025-10-02T08:10:31.734617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.734621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.734634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533812367024237:10890]
2025-10-02T08:10:31.734644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:31.734670Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e676710f-16c14656-202c8823-6d27abb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:31.734669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:31.734676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.734680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.734682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:31.734691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.734705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:31.734729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.734712Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 910
2025-10-02T08:10:31.734781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.734788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.734801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.734839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 911 partition: 0 MaxSeqNo: 17 sessionId: src_id|e676710f-16c14656-202c8823-6d27abb2_0
2025-10-02T08:10:31.735206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92195713-dfc7971-a4ad67d9-13562ff5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e676710f-16c14656-202c8823-6d27abb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:31.738052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e676710f-16c14656-202c8823-6d27abb2_0] Write session: try to update token
2025-10-02T08:10:31.738073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e676710f-16c14656-202c8823-6d27abb2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:31.753155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId: src_id|e676710f-16c14656-202c8823-6d27abb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:31.754445Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:31.754462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:31.754465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:31.754473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533812367024237:10890]
2025-10-02T08:10:31.754478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533812367024237:10890]
2025-10-02T08:10:31.754524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:31.754528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:31.754533Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:31.754534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.754536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:31.754678Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:31.755830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:31.804992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533812367024267:10816]
2025-10-02T08:10:31.806498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 910, pipe: [1:7556533812367024267:10816]
E1002 08:10:31.813657474  540992 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:25313: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-02T08:10:31.908418Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:31.908995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.909011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.909054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367024267:10816], now have 1 active actors on pipe
2025-10-02T08:10:31.909704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533812367024267:10816]
2025-10-02T08:10:31.909735Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:31.909736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:31.909739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:31.909819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 911 reason: error at write: Disconnected sessionId: src_id|e676710f-16c14656-202c8823-6d27abb2_0
2025-10-02T08:10:31.910013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 911 sessionId: src_id|e676710f-16c14656-202c8823-6d27abb2_0 is DEAD
2025-10-02T08:10:31.912907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e676710f-16c14656-202c8823-6d27abb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:31.912920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e676710f-16c14656-202c8823-6d27abb2_0] Write session will restart in 0.006692s
2025-10-02T08:10:31.912943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e676710f-16c14656-202c8823-6d27abb2_0] Write session: Do CDS request
2025-10-02T08:10:31.912951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e676710f-16c14656-202c8823-6d27abb2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:31.912926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:31.921149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e676710f-16c14656-202c8823-6d27abb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.922328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:31.922341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 912
2025-10-02T08:10:31.922595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:31.922656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:31.922668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:31.922674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:31.923358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 912 sessionId:  describe result for acl check
2025-10-02T08:10:31.923391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:31.923451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:31.923452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:31.923458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533812367024532:10898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:31.924076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533812367024532:10898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:31.927699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533812367024532:10898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:31.931183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533812367024532:10898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:31.931199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533812367024532:10898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:31.931202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533812367024532:10898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:31.931211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:31.938796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:31.941214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:31.941423Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:31.941435Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:31.941446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:31.941500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:31.941535Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533812367024891:10897]
2025-10-02T08:10:31.942180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:31.942593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:31.942646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:31.942992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:31.943054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.943055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.943056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.943058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.943058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.943064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.943074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.943078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.943082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.943085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.943090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.943097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:31.943103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.943108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:31.943113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.943119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:31.943125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.943131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.943136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.943141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.943162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:31.956652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:31.958738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:31.958750Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:31.958752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:31.958755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:31.958759Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 911 [1:7556533812367024891:10897]
2025-10-02T08:10:31.958767Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:31.958780Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:31.958782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.958784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.958785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.958801Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:31.958806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:31.958813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:31.958866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.958867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.958869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:31.958870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:31.958919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:31.958921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.958930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:31.958937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:31.958949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533812367024885:10897]
2025-10-02T08:10:31.958951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533812367024885:10897]
2025-10-02T08:10:31.958965Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:31.958977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:31.958990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:31.958993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:31.959023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533812367024885:10897]
2025-10-02T08:10:31.959024Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:31.959789Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 911
2025-10-02T08:10:31.959486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:31.959492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:31.959497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:31.959654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 911
2025-10-02T08:10:31.959665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533812367024794:10898], now have 1 active actors on pipe
2025-10-02T08:10:31.959669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533812827124716:2378], now have 1 active actors on pipe
2025-10-02T08:10:31.960042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.960047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.960073Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:31.960082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:31.960086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:31.960087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:31.960094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:31.960104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:31.960119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.960252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:31.960256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:31.960265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:31.960306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 912 partition: 0 MaxSeqNo: 17 sessionId: src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0
2025-10-02T08:10:31.961120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e676710f-16c14656-202c8823-6d27abb2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:31.964545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0] Write session: try to update token
2025-10-02T08:10:31.964570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:31.979218Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:31.979237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:31.979240Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:31.979248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533812367024885:10897]
2025-10-02T08:10:31.979253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533812367024885:10897]
2025-10-02T08:10:31.979300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:31.979307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:31.979309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:31.979457Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:31.981002Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:31.981012Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:31.991388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId: src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:31.994153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:32.010109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533816661992244:10816]
2025-10-02T08:10:32.010405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 911, pipe: [1:7556533816661992244:10816]
2025-10-02T08:10:32.127945Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:32.128716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.128725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.128748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661992244:10816], now have 1 active actors on pipe
2025-10-02T08:10:32.129003Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:32.129003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533816661992244:10816]
2025-10-02T08:10:32.129026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:32.129094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 912 reason: status is not ok: tablet will be restarted right now sessionId: src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0
2025-10-02T08:10:32.129276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 912 sessionId: src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0 is DEAD
2025-10-02T08:10:32.129704Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:32.132284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:32.132300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0] Write session will restart in 0.005435s
2025-10-02T08:10:32.132332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0] Write session: Do CDS request
2025-10-02T08:10:32.132341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:32.139372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:32.139461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:32.139476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 913
2025-10-02T08:10:32.139576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:32.139611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:32.139618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:32.139622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:32.140009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 913 sessionId:  describe result for acl check
2025-10-02T08:10:32.140035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:32.140040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:32.140041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:32.140045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533816661992558:10917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:32.140550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533816661992558:10917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:32.143127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533816661992558:10917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:32.150207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533816661992558:10917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:32.150228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533816661992558:10917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:32.150231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533816661992558:10917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:32.150241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:32.156250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:32.162680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:32.162901Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:32.162912Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:32.162921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:32.162970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:32.163012Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533816661992856:10916]
2025-10-02T08:10:32.163643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:32.163832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:32.163876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:32.164180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:32.164226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.164232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.164233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.164234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.164236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.164241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.164251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.164255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.164263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.164267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.164285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.164300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.164307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.164313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.164318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.164323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.164327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.164333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.164338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.164343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.164363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:32.175674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:32.177513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:32.177528Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:32.177531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:32.177535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:32.177540Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 912 [1:7556533816661992856:10916]
2025-10-02T08:10:32.177553Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:32.177571Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:32.177575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.177577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.177579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.177596Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:32.177602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:32.177608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:32.177676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.177683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.177686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:32.177689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:32.177753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:32.177760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.177774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.177789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:32.177810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533816661992850:10916]
2025-10-02T08:10:32.177816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533816661992850:10916]
2025-10-02T08:10:32.177822Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:32.177836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661992844:10917], now have 1 active actors on pipe
2025-10-02T08:10:32.177848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:32.177861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:32.177868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:32.177875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533817122092042:2378], now have 1 active actors on pipe
2025-10-02T08:10:32.177910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533816661992850:10916]
2025-10-02T08:10:32.177917Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:32.177958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 912
2025-10-02T08:10:32.178274Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 912
2025-10-02T08:10:32.177996Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:32.178004Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:32.178009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:32.178051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.178061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.178093Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|908f10ba-10528d87-af31918e-e2c5330a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:32.178101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.178105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.178108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:32.178122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.178134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:32.178152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:32.178197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.178200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.178213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:32.178243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 913 partition: 0 MaxSeqNo: 17 sessionId: src_id|908f10ba-10528d87-af31918e-e2c5330a_0
2025-10-02T08:10:32.180954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36157c1e-6a33cf9-8d1c2335-e44dcfed_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|908f10ba-10528d87-af31918e-e2c5330a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:32.184423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908f10ba-10528d87-af31918e-e2c5330a_0] Write session: try to update token
2025-10-02T08:10:32.184448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908f10ba-10528d87-af31918e-e2c5330a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:32.190070Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:32.190088Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:32.190097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533816661992850:10916]
2025-10-02T08:10:32.190138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:32.190311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:32.190452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:32.190594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:32.190731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:32.190913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:32.190944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:32.191105Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:32.211146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId: src_id|908f10ba-10528d87-af31918e-e2c5330a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:32.213878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:32.214288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.214302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.215879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:32.215902Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:32.215905Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:32.215907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:32.215916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533816661992850:10916]
2025-10-02T08:10:32.215920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533816661992850:10916]
2025-10-02T08:10:32.215960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:32.215970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.215972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:32.215984Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:32.215998Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:32.216105Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:32.216976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:32.231533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533816661992882:10816]
2025-10-02T08:10:32.231802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 912, pipe: [1:7556533816661992882:10816]
2025-10-02T08:10:32.382684Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:32.382987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.382996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.383173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.383239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.383315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.383385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.383431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.383435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.383517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.383603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.383681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.383754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.383807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.383810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.383888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.383957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.384030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.384105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.384150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.384155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.384237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.384324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.384393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.384462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.384513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.384516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.384586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.384652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.384721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.384794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.385651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.385662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.385744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.385816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.385890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.385958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.386002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.386005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.386082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.386150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.386226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.386296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.386342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.386345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.386422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.386491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.386557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.386630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.386700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.386703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.386782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.386857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.386926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.386995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.387052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.387055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.387132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.387195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.387264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.387329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.387374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.387377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.387434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661992882:10816], now have 1 active actors on pipe
2025-10-02T08:10:32.388656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533816661992882:10816]
2025-10-02T08:10:32.388681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:32.388683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:32.388717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 913 reason: error at write: Disconnected sessionId: src_id|908f10ba-10528d87-af31918e-e2c5330a_0
2025-10-02T08:10:32.388854Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:32.388919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 913 sessionId: src_id|908f10ba-10528d87-af31918e-e2c5330a_0 is DEAD
2025-10-02T08:10:32.389061Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:32.389357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908f10ba-10528d87-af31918e-e2c5330a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:32.389368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908f10ba-10528d87-af31918e-e2c5330a_0] Write session will restart in 0.005202s
2025-10-02T08:10:32.389392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908f10ba-10528d87-af31918e-e2c5330a_0] Write session: Do CDS request
2025-10-02T08:10:32.389400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908f10ba-10528d87-af31918e-e2c5330a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:32.396960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908f10ba-10528d87-af31918e-e2c5330a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:32.397141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:32.397160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 914
2025-10-02T08:10:32.397293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:32.397323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:32.397329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:32.397332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:32.397793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 914 sessionId:  describe result for acl check
2025-10-02T08:10:32.397830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:32.397833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:32.397837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:32.397842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533816661992923:10923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:32.398381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533816661992923:10923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:32.405994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533816661992923:10923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:32.412757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533816661992923:10923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:32.412770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533816661992923:10923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:32.412772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533816661992923:10923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:32.412779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:32.428705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:32.429443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:32.429667Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:32.429676Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:32.429687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:32.429736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:32.429769Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533816661993499:10922]
2025-10-02T08:10:32.430394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:32.431108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:32.431156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:32.431468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:32.431515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.431521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.431522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.431523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.431524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.431529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.431539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.431542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.431546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.431549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.431555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.431567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.431577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.431582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.431586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.431605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.431615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.431620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.431624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.431628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.431645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:32.441474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:32.445047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 913
2025-10-02T08:10:32.444085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:32.444104Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:32.444106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:32.444110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:32.444117Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 913 [1:7556533816661993499:10922]
2025-10-02T08:10:32.444129Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:32.444149Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:32.444153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.444155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.444157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.444175Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:32.444180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:32.444187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:32.444256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.444259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.444261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:32.444264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:32.444330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:32.444332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.444348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.444358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:32.444374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533816661993492:10922]
2025-10-02T08:10:32.444376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533816661993492:10922]
2025-10-02T08:10:32.444386Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:32.444399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:32.444413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:32.444416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:32.444449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533816661993492:10922]
2025-10-02T08:10:32.444451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:32.444539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:32.444541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:32.444545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:32.445138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 913
2025-10-02T08:10:32.445152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661993271:10923], now have 1 active actors on pipe
2025-10-02T08:10:32.445155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533817122092050:2378], now have 1 active actors on pipe
2025-10-02T08:10:32.445166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.445171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.445197Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|697423cd-ae393e32-997e9649-a89b67d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:32.445204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.445207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.445210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:32.445220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.445230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:32.445254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:32.446927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.446937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.446966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:32.447004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 914 partition: 0 MaxSeqNo: 17 sessionId: src_id|697423cd-ae393e32-997e9649-a89b67d9_0
2025-10-02T08:10:32.447639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908f10ba-10528d87-af31918e-e2c5330a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|697423cd-ae393e32-997e9649-a89b67d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:32.450821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697423cd-ae393e32-997e9649-a89b67d9_0] Write session: try to update token
2025-10-02T08:10:32.450844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697423cd-ae393e32-997e9649-a89b67d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:32.472563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId: src_id|697423cd-ae393e32-997e9649-a89b67d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:32.475361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:32.475646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.475658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.475695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:32.475716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:32.475884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.475890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.476061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.476126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.476195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.476261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.476310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.476315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.476392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.476452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.476528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.476593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.476642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.476645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.476736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.476818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.476879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.476937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.476988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.476990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.477053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.477112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.477179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.477241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.477284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.477287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.477363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.477427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.477493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.477557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.477625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.477628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.477703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.477774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.477843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.477910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.477955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.477957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.478032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.478096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.478167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.478231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.478279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.478281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.478356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.478416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.478485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.478547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.478596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.478598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.478665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.478719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.478776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.478833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.478878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.478880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.478946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:32.479000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:32.479055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:32.479111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:32.479151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:32.479153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:32.479192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:32.479245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.479259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.479261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:32.479288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:32.479298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:32.479300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:32.479302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:32.479304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:32.479744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:32.479763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:32.479771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:32.479774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:32.479778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:32.479782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:32.480348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:32.480362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:32.480368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:32.480372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:32.480375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:32.480379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:32.481823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:32.481843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:32.481850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:32.481854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:32.481857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:32.483308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:32.483330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:32.483343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392632483
2025-10-02T08:10:32.483641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:32.483650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:32.483656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:32.483659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:32.483664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:32.483667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:32.484308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:32.484322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:32.484330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:32.484334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:32.484338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:32.484341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:32.485138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:32.485158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:32.485165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:32.485168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:32.485171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:32.485175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:32.485932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:32.485949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:32.485957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:32.487319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:32.487329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:32.487336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:32.487340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:32.487352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392632486
2025-10-02T08:10:32.487736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:32.487749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:32.487754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:32.487758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:32.487762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:32.487767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:32.488283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:32.488296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:32.488304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:32.488308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:32.488310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:32.488316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:32.489065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:32.489083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.489187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392632489
2025-10-02T08:10:32.489564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533816661993526:10816]
2025-10-02T08:10:32.490245Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:32.490260Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:32.490268Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:32.490275Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:32.491568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 913, pipe: [1:7556533816661993526:10816]
2025-10-02T08:10:32.492126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661993526:10816], now have 1 active actors on pipe
2025-10-02T08:10:32.492142Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:32.492145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:32.492146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:32.492153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533816661993492:10922]
2025-10-02T08:10:32.492156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533816661993492:10922]
2025-10-02T08:10:32.492210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:32.492215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.492218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:32.492365Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:32.492924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:32.492930Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:32.650264Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:32.651035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:32.651044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:32.651070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 914 reason: error at write: Disconnected sessionId: src_id|697423cd-ae393e32-997e9649-a89b67d9_0
2025-10-02T08:10:32.651150Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:32.651239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 914 sessionId: src_id|697423cd-ae393e32-997e9649-a89b67d9_0 is DEAD
2025-10-02T08:10:32.651136Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:32.651408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697423cd-ae393e32-997e9649-a89b67d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:32.651419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697423cd-ae393e32-997e9649-a89b67d9_0] Write session will restart in 0.007545s
2025-10-02T08:10:32.651445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697423cd-ae393e32-997e9649-a89b67d9_0] Write session: Do CDS request
2025-10-02T08:10:32.651451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697423cd-ae393e32-997e9649-a89b67d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:32.651440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533816661993526:10816]
2025-10-02T08:10:32.661035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697423cd-ae393e32-997e9649-a89b67d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:32.661612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:32.661628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 915
2025-10-02T08:10:32.661826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:32.661872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:32.661882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:32.661885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:32.662553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 915 sessionId:  describe result for acl check
2025-10-02T08:10:32.662584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:32.662585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:32.662587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:32.662590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533816661993812:10930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:32.663049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533816661993812:10930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:32.666208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533816661993812:10930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:32.675120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533816661993812:10930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:32.675139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533816661993812:10930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:32.675143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533816661993812:10930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:32.675152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:32.683494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:32.685649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:32.685862Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:32.685873Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:32.685883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:32.685928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:32.685969Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533816661994152:10929]
2025-10-02T08:10:32.686666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:32.686874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:32.686915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:32.687214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:32.687260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.687266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.687267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.687269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.687270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.687276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.687287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.687291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.687296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.687301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.687306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.687315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.687321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.687327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.687331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.687337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.687343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.687349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.687361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.687366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.687388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:32.700203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:32.703226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 914
2025-10-02T08:10:32.701831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:32.701848Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:32.701851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:32.701855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:32.701862Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 914 [1:7556533816661994152:10929]
2025-10-02T08:10:32.701876Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:32.701898Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:32.701901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.701904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.701906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.701923Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:32.701928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:32.701935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:32.702000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.702003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.702006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:32.702008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:32.702080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:32.702082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.702098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.702111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:32.702127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533816661994146:10929]
2025-10-02T08:10:32.702130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533816661994146:10929]
2025-10-02T08:10:32.702142Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:32.702155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:32.702170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:32.702173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:32.702211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533816661994146:10929]
2025-10-02T08:10:32.702214Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:32.702377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 914
2025-10-02T08:10:32.702395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661993991:10930], now have 1 active actors on pipe
2025-10-02T08:10:32.702400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533817122092059:2378], now have 1 active actors on pipe
2025-10-02T08:10:32.702406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.702413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.702442Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:32.702450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.702455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.702457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:32.702468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.702479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:32.702497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:32.702510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:32.702512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:32.702517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:32.702636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.702647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.702661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:32.702691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 915 partition: 0 MaxSeqNo: 17 sessionId: src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0
2025-10-02T08:10:32.703879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697423cd-ae393e32-997e9649-a89b67d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:32.706515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0] Write session: try to update token
2025-10-02T08:10:32.706538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:32.723407Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:32.723425Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:32.723428Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:32.723437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533816661994146:10929]
2025-10-02T08:10:32.723442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533816661994146:10929]
2025-10-02T08:10:32.723485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:32.723491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.723493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:32.723650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:32.723659Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:32.723667Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:32.728919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId: src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:32.731893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:32.750954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533816661994178:10816]
2025-10-02T08:10:32.751109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 914, pipe: [1:7556533816661994178:10816]
2025-10-02T08:10:32.890319Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:32.891265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.891275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.891319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661994178:10816], now have 1 active actors on pipe
2025-10-02T08:10:32.891766Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:32.892119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:32.892365Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:32.892253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 915 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0
2025-10-02T08:10:32.892465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 915 sessionId: src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0 is DEAD
2025-10-02T08:10:32.892603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533816661994178:10816]
2025-10-02T08:10:32.892917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:32.892938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0] Write session will restart in 0.008167s
2025-10-02T08:10:32.892975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0] Write session: Do CDS request
2025-10-02T08:10:32.892988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:32.902453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:32.902544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:32.902557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 916
2025-10-02T08:10:32.902767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:32.902797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:32.902803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:32.902806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:32.903464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 916 sessionId:  describe result for acl check
2025-10-02T08:10:32.903496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:32.903498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:32.903500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:32.903505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533816661994470:10937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:32.904138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533816661994470:10937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:32.907048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533816661994470:10937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:32.910534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533816661994470:10937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:32.910554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533816661994470:10937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:32.910557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533816661994470:10937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:32.910566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:32.924781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:32.925312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:32.925451Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:32.925458Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:32.925465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:32.925497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:32.925527Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533816661994806:10936]
2025-10-02T08:10:32.925989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:32.926176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:32.926205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:32.926433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:32.926465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.926469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.926471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.926471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.926472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.926475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.926482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.926484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.926487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.926489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.926493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.926497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:32.926501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.926504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:32.926507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.926510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:32.926512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.926515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.926518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.926521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.926531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:32.938073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:32.939640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:32.939655Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:32.939658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:32.939663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:32.939671Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 915 [1:7556533816661994806:10936]
2025-10-02T08:10:32.939683Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:32.939701Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:32.939704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.939707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.939709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.939724Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:32.939730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:32.939736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:32.939802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.939810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.939813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:32.939815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:32.939881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:32.939887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.939902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:32.939920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:32.939942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661994572:10937], now have 1 active actors on pipe
2025-10-02T08:10:32.939952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533816661994800:10936]
2025-10-02T08:10:32.939954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533816661994800:10936]
2025-10-02T08:10:32.939962Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:32.939972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533817122092078:2378], now have 1 active actors on pipe
2025-10-02T08:10:32.939976Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:32.939978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:32.939980Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:32.939991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:32.939994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:32.940025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533816661994800:10936]
2025-10-02T08:10:32.940033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:32.940042Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:32.940072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 915
2025-10-02T08:10:32.940142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.940145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.940164Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:32.940168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:32.940171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:32.940172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:32.940178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:32.940186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:32.940205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:32.940282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:32.940291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:32.940323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:32.940365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 916 partition: 0 MaxSeqNo: 17 sessionId: src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0
2025-10-02T08:10:32.940705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98834018-b9acd1b8-3ac741a2-1a3411fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:32.943498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0] Write session: try to update token
2025-10-02T08:10:32.943515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:32.940090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 915
2025-10-02T08:10:32.952341Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:32.952361Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:32.952370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533816661994800:10936]
2025-10-02T08:10:32.952419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:32.952447Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:32.952618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:32.952818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:32.952974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:32.953134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:32.953361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:32.953398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:32.971094Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:32.971114Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:32.971117Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:32.971128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533816661994800:10936]
2025-10-02T08:10:32.971135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533816661994800:10936]
2025-10-02T08:10:32.971184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:32.971190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:32.971193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:32.971215Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:32.971222Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:32.971357Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:32.976832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId: src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:32.979883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:32.992594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533816661994830:10816]
2025-10-02T08:10:32.992719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 915, pipe: [1:7556533816661994830:10816]
2025-10-02T08:10:33.121418Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:33.122491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.122509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.122531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533816661994830:10816], now have 1 active actors on pipe
2025-10-02T08:10:33.122813Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:33.122957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:33.123033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 916 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0
2025-10-02T08:10:33.123222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 916 sessionId: src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0 is DEAD
2025-10-02T08:10:33.123385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533816661994830:10816]
2025-10-02T08:10:33.123815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:33.123826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0] Write session will restart in 0.006647s
2025-10-02T08:10:33.123854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0] Write session: Do CDS request
2025-10-02T08:10:33.123865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:33.124784Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:33.133410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:33.133755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:33.133768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 917
2025-10-02T08:10:33.135033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:33.135079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:33.135084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:33.135089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:33.135874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 917 sessionId:  describe result for acl check
2025-10-02T08:10:33.135910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:33.135912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:33.135914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:33.135920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533820956962387:10956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:33.136439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533820956962387:10956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:33.142174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533820956962387:10956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:33.148132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533820956962387:10956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:33.148146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533820956962387:10956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:33.148150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533820956962387:10956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:33.148159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:33.157070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:33.157928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:33.158081Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:33.158083Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:33.158090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:33.158121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:33.158147Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533820956962781:10955]
2025-10-02T08:10:33.158578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:33.159127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:33.159164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:33.159375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:33.159398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.159398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.159399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.159400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.159400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.159404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.159410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.159412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.159415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.159417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.159421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.159426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.159430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.159433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.159435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.159438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.159441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.159443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.159446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.159450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.159461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:33.169761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:33.171423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:33.171440Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:33.171443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:33.171447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:33.171454Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 916 [1:7556533820956962781:10955]
2025-10-02T08:10:33.171467Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:33.171488Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:33.171491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:33.171495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:33.171497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:33.171512Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:33.171517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:33.171524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:33.171614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.171616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.171619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:33.171622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:33.171697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:33.171700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.171714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.171725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:33.171742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533820956962775:10955]
2025-10-02T08:10:33.171744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533820956962775:10955]
2025-10-02T08:10:33.171757Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:33.171769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:33.171782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:33.171784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:33.171822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533820956962775:10955]
2025-10-02T08:10:33.171823Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:33.171827Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:33.171829Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:33.171834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:33.171901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 916
2025-10-02T08:10:33.171910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533820956962646:10956], now have 1 active actors on pipe
2025-10-02T08:10:33.171924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.171927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.171942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533821417059406:2378], now have 1 active actors on pipe
2025-10-02T08:10:33.171957Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:33.171963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:33.171968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:33.171969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:33.171977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:33.171985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:33.171999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:33.172175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.172179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.172194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:33.172225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 917 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0
2025-10-02T08:10:33.172581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1403086-93d59474-7f1068b7-1f21e3ee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:33.172518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 916
2025-10-02T08:10:33.175343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0] Write session: try to update token
2025-10-02T08:10:33.175360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:33.194655Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:33.194677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:33.194680Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:33.194691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533820956962775:10955]
2025-10-02T08:10:33.194696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533820956962775:10955]
2025-10-02T08:10:33.194744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:33.194753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.194759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:33.194932Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:33.195350Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:33.195364Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:33.198567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId: src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:33.201517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:33.222444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533820956962807:10816]
2025-10-02T08:10:33.222607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 916, pipe: [1:7556533820956962807:10816]
2025-10-02T08:10:33.343834Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:33.344369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.344384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.344427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533820956962807:10816], now have 1 active actors on pipe
2025-10-02T08:10:33.344627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:33.344638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:33.344700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 917 reason: error at write: Disconnected sessionId: src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0
2025-10-02T08:10:33.344749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:33.344889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 917 sessionId: src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0 is DEAD
2025-10-02T08:10:33.345251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:33.345261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0] Write session will restart in 0.005207s
2025-10-02T08:10:33.344964Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:33.345039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533820956962807:10816]
2025-10-02T08:10:33.345285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0] Write session: Do CDS request
2025-10-02T08:10:33.345306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:33.352283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:33.352429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:33.352444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 918
2025-10-02T08:10:33.352645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:33.352670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:33.352675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:33.352679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:33.353910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 918 sessionId:  describe result for acl check
2025-10-02T08:10:33.353946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:33.353947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:33.353949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:33.353954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533820956962845:10962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:33.354371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533820956962845:10962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:33.367807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533820956962845:10962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:33.373986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533820956962845:10962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:33.374000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533820956962845:10962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:33.374003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533820956962845:10962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:33.374013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:33.401894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:33.404396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:33.404616Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:33.404625Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:33.404636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:33.404690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:33.404729Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533820956963425:10961]
2025-10-02T08:10:33.406132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:33.406825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:33.406878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:33.407466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:33.407528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.407529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.407530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.407531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.407532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.407538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.407548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.407552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.407555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.407559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.407565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.407572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.407577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.407583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.407588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.407593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.407614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.407619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.407624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.407629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.407646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:33.420145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:33.421939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:33.421954Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:33.421958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:33.421963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:33.421969Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 917 [1:7556533820956963425:10961]
2025-10-02T08:10:33.421983Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:33.422003Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:33.422006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:33.422009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:33.422011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:33.422030Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:33.422036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:33.422043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:33.422111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.422113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.422116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:33.422118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:33.422185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:33.422189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.422204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.422216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:33.422231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533820956963418:10961]
2025-10-02T08:10:33.422233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533820956963418:10961]
2025-10-02T08:10:33.422247Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:33.422260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:33.422273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:33.422276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:33.422310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533820956963418:10961]
2025-10-02T08:10:33.422313Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:33.423113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:33.423116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:33.423121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:33.423320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533820956963183:10962], now have 1 active actors on pipe
2025-10-02T08:10:33.423342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533821417059413:2378], now have 1 active actors on pipe
2025-10-02T08:10:33.423360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 917
2025-10-02T08:10:33.423640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.423653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.423681Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:33.423690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:33.423694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:33.423696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:33.423709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:33.423723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:33.423742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:33.423772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.423775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.423788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:33.423819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 918 partition: 0 MaxSeqNo: 17 sessionId: src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0
2025-10-02T08:10:33.424241Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 917
2025-10-02T08:10:33.424906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc1e7b6c-735b701d-b0b481ef-29cbe2e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:33.427799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0] Write session: try to update token
2025-10-02T08:10:33.427817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:33.445214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533820956963447:10816]
2025-10-02T08:10:33.447566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533820956963447:10816], now have 1 active actors on pipe
2025-10-02T08:10:33.447589Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:33.447592Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:33.447594Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:33.447620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533820956963418:10961]
2025-10-02T08:10:33.447624Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533820956963418:10961]
2025-10-02T08:10:33.447676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:33.447683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.447685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:33.447839Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:33.448886Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:33.448892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:33.448912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 917, pipe: [1:7556533820956963447:10816]
2025-10-02T08:10:33.462048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId: src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:33.465217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:33.593623Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:33.594217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.594231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.594557Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:33.594561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533820956963447:10816]
2025-10-02T08:10:33.594954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:33.594987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0] Write session will restart in 0.009580s
2025-10-02T08:10:33.594578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:33.594634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 918 reason: status is not ok: tablet will be restarted right now sessionId: src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0
2025-10-02T08:10:33.594807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 918 sessionId: src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0 is DEAD
2025-10-02T08:10:33.595017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0] Write session: Do CDS request
2025-10-02T08:10:33.595024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:33.598608Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:33.605277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:33.605658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:33.605672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 919
2025-10-02T08:10:33.606097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:33.606133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:33.606137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:33.606140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:33.606760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 919 sessionId:  describe result for acl check
2025-10-02T08:10:33.606800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:33.606806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:33.606808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:33.606814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533820956963700:10968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:33.607361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533820956963700:10968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:33.610948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533820956963700:10968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:33.614626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533820956963700:10968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:33.614646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533820956963700:10968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:33.614649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533820956963700:10968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:33.614658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:33.624133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:33.626362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:33.626547Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:33.626556Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:33.626565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:33.626617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:33.626661Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533820956964080:10967]
2025-10-02T08:10:33.627310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:33.627529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:33.627579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:33.627892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:33.627948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.627955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.627957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.627958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.627959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.627964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.627975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.627979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.627983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.627987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.627993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.627999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.628006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.628011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.628016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.628020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.628025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.628031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.628040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.628045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.628065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:33.639754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:33.641522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:33.641543Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:33.641546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:33.641551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:33.641557Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 918 [1:7556533820956964080:10967]
2025-10-02T08:10:33.641571Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:33.641590Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:33.641593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:33.641597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:33.641599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:33.641616Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:33.641621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:33.641626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:33.641699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.641708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.641714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:33.641716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:33.641778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:33.641785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.641798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.641814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:33.641836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533820956963935:10968], now have 1 active actors on pipe
2025-10-02T08:10:33.641846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533820956964074:10967]
2025-10-02T08:10:33.641848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533820956964074:10967]
2025-10-02T08:10:33.641856Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:33.641864Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:33.641866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:33.641872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:33.641885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:33.641891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:33.641897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533821417059422:2378], now have 1 active actors on pipe
2025-10-02T08:10:33.641918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 918
2025-10-02T08:10:33.641929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533820956964074:10967]
2025-10-02T08:10:33.641932Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:33.641936Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:33.641939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.641944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.641966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 918
2025-10-02T08:10:33.641989Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:33.642003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:33.642006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:33.642008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:33.642017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:33.642026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:33.642050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:33.642084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.642090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.642101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:33.642139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 919 partition: 0 MaxSeqNo: 17 sessionId: src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0
2025-10-02T08:10:33.642506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883ab5eb-f656d9b6-610e4bc0-ea387b3f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:33.645362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0] Write session: try to update token
2025-10-02T08:10:33.645383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:33.667903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId: src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:33.670641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:33.672479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.672503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.672526Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:33.672529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:33.672532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:33.672540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533820956964074:10967]
2025-10-02T08:10:33.672544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533820956964074:10967]
2025-10-02T08:10:33.672595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:33.672605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:33.672609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:33.672611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.672613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:33.672766Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:33.696058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533820956964104:10816]
2025-10-02T08:10:33.696255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 918, pipe: [1:7556533820956964104:10816]
2025-10-02T08:10:33.826028Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:33.826462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:33.827486Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:33.827672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:33.827683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0] Write session will restart in 0.005973s
2025-10-02T08:10:33.826514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533820956964104:10816], now have 1 active actors on pipe
2025-10-02T08:10:33.826558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:33.827037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:33.827041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:33.827065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 919 reason: error at write: Disconnected sessionId: src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0
2025-10-02T08:10:33.827710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0] Write session: Do CDS request
2025-10-02T08:10:33.827218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 919 sessionId: src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0 is DEAD
2025-10-02T08:10:33.827478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533820956964104:10816]
2025-10-02T08:10:33.827719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:33.835814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:33.835993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:33.836010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 920
2025-10-02T08:10:33.836878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:33.836924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:33.836930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:33.836934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:33.838467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 920 sessionId:  describe result for acl check
2025-10-02T08:10:33.838505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:33.838506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:33.838508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:33.838513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533820956964155:10976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:33.839014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533820956964155:10976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:33.847365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533820956964155:10976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:33.852134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533820956964155:10976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:33.852152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533820956964155:10976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:33.852155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533820956964155:10976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:33.852164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:33.879843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:33.882603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:33.882835Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:33.882839Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:33.882849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:33.882902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:33.882939Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533820956964739:10975]
2025-10-02T08:10:33.883537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:33.883778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:33.883818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:33.884128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:33.884196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.884198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.884199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.884200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.884201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.884206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.884216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.884220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.884223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.884226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.884232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.884239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:33.884245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.884252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:33.884256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.884261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:33.884264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.884268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.884272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.884276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.884292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:33.894770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:33.897161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:33.897180Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:33.897183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:33.897186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:33.897193Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 919 [1:7556533820956964739:10975]
2025-10-02T08:10:33.897205Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:33.897224Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:33.897226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:33.897229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:33.897231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:33.897247Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:33.897252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:33.897259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:33.897330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.897339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.897341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:33.897344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:33.897413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:33.897421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.897438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:33.897449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:33.897467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533820956964733:10975]
2025-10-02T08:10:33.897470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533820956964733:10975]
2025-10-02T08:10:33.897483Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:33.897503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:33.897522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:33.897529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:33.897564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533820956964733:10975]
2025-10-02T08:10:33.897571Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:33.897755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 919
2025-10-02T08:10:33.897765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533820956964611:10976], now have 1 active actors on pipe
2025-10-02T08:10:33.897773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533821417059439:2378], now have 1 active actors on pipe
2025-10-02T08:10:33.897781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.897786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.897816Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:33.897825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:33.897830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:33.897832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:33.897844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:33.897857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:33.897885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:33.898335Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 919
2025-10-02T08:10:33.898557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8562bb9c-46d513f0-7f12eb64-776bde88_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:33.897988Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:33.898000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:33.898006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:33.898039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:33.898045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:33.898083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:33.898134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 920 partition: 0 MaxSeqNo: 17 sessionId: src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0
2025-10-02T08:10:33.902087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0] Write session: try to update token
2025-10-02T08:10:33.902106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:33.917053Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:33.917072Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:33.917075Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:33.917083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533820956964733:10975]
2025-10-02T08:10:33.917088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533820956964733:10975]
2025-10-02T08:10:33.917133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:33.917140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:33.917143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:33.917146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:33.917149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:33.917298Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:33.927059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId: src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:33.933993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:33.934092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533820956964764:10816]
2025-10-02T08:10:33.934206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 919, pipe: [1:7556533820956964764:10816]
2025-10-02T08:10:34.061454Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:34.062056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.062073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.062094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533820956964764:10816], now have 1 active actors on pipe
2025-10-02T08:10:34.065032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533820956964764:10816]
2025-10-02T08:10:34.065184Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:34.065477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:34.065555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 920 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0
2025-10-02T08:10:34.065593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:34.065762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 920 sessionId: src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0 is DEAD
2025-10-02T08:10:34.065912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:34.065920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0] Write session will restart in 0.008004s
2025-10-02T08:10:34.065954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0] Write session: Do CDS request
2025-10-02T08:10:34.065961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:34.075277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:34.075347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:34.075362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 921
2025-10-02T08:10:34.075483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:34.075515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:34.075524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:34.075528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:34.075939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 921 sessionId:  describe result for acl check
2025-10-02T08:10:34.075963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:34.075967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:34.075968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:34.075972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533825251932411:10989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:34.076360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533825251932411:10989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:34.081586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533825251932411:10989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:34.089221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533825251932411:10989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:34.089243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533825251932411:10989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:34.089247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533825251932411:10989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:34.089257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:34.093096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:34.093842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:34.094068Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:34.094081Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:34.094094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:34.094153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:34.094196Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533825251932700:10988]
2025-10-02T08:10:34.094835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:34.095062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:34.095097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:34.095359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:34.095400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.095404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.095405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.095406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.095407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.095411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.095419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.095422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.095424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.095426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.095430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.095435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.095440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.095443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.095450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.095454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.095457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.095460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.095463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.095467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.095479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:34.103833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:34.105415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:34.105435Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:34.105437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:34.105439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:34.105445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 920 [1:7556533825251932700:10988]
2025-10-02T08:10:34.105453Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:34.105465Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:34.105467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.105469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.105470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.105483Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:34.105487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:34.105492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:34.105535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.105536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.105539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:34.105541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:34.105591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:34.105599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.105612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.105623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:34.105642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533825251932694:10988]
2025-10-02T08:10:34.105649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533825251932694:10988]
2025-10-02T08:10:34.105657Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:34.105668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533825251932688:10989], now have 1 active actors on pipe
2025-10-02T08:10:34.105674Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:34.105678Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:34.105681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:34.105689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:34.105691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:34.105696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533825712026757:2378], now have 1 active actors on pipe
2025-10-02T08:10:34.105722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533825251932694:10988]
2025-10-02T08:10:34.105734Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:34.105770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 920
2025-10-02T08:10:34.105838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 920
2025-10-02T08:10:34.105895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:34.105933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.105942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.105967Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:34.105977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.105980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.105982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:34.105988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.105995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:34.106007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:34.106032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.106038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.106047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:34.106073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 921 partition: 0 MaxSeqNo: 17 sessionId: src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0
2025-10-02T08:10:34.106414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4217d7-b1e16d66-1e1515d-aad3fd72_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:34.109015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0] Write session: try to update token
2025-10-02T08:10:34.109029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:34.117512Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:34.117529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:34.117536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533825251932694:10988]
2025-10-02T08:10:34.117587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:34.117606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:34.117791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:34.117951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:34.118117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:34.118276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:34.118501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:34.118544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:34.123367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId: src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:34.126268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:34.126413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.126430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.126465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:34.126532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:34.126675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.126702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.126958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.127049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.127141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.127247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.127322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.127335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.127429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.127512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.127614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.127709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.127774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.127802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.127896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.127979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.128065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.128154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.128224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.128228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.128311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.128394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.128464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.128538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.128592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.128596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.128682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.128753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.129380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.129472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.129527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.129531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.129623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.129703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.129781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.129861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.129923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.129927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.130015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.130085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.130168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.130245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.130297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.130300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.130388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.130489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.130564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.130641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.130694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.130701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.130807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.130882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.130955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.131029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.131086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.131089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.131179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.131250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.131323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.131394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.131450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.131454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.131516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:34.131620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.131644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.131647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:34.131696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:34.131712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:34.131716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:34.131720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:34.131724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:34.132215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:34.132240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:34.132248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:34.132252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:34.132256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:34.132264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:34.133606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:34.133643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:34.133651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:34.133656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:34.133660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:34.133665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:34.134600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:34.134622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:34.134629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:34.134636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:34.134639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:34.136131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:34.136144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:34.136160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392634135
2025-10-02T08:10:34.136304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:34.136315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:34.136321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:34.136325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:34.136330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:34.136337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:34.137296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:34.137328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:34.137335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:34.137339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:34.137342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:34.137347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:34.137902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:34.137918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:34.137927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:34.137931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:34.137935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:34.137939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:34.138516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:34.138533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:34.138540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:34.139885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:34.139896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:34.139903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:34.139908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:34.139919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392634139
2025-10-02T08:10:34.140371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:34.140388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:34.140398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:34.140402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:34.140407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:34.140411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:34.141156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:34.141182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:34.141189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:34.141193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:34.141196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:34.141200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:34.141864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:34.141892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.142073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392634142
2025-10-02T08:10:34.143034Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:34.143055Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:34.143062Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:34.143070Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:34.145084Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:34.145099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:34.145101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:34.145110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533825251932694:10988]
2025-10-02T08:10:34.145116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533825251932694:10988]
2025-10-02T08:10:34.145178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:34.145186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:34.145195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:34.145204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.145207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:34.145370Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:34.165092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533825251932755:10816]
2025-10-02T08:10:34.165253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 920, pipe: [1:7556533825251932755:10816]
2025-10-02T08:10:34.312391Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:34.313013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533825251932755:10816], now have 1 active actors on pipe
2025-10-02T08:10:34.317429Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:34.317582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:34.317594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:34.317627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 921 reason: error at write: Disconnected sessionId: src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0
2025-10-02T08:10:34.317827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 921 sessionId: src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0 is DEAD
2025-10-02T08:10:34.318032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533825251932755:10816]
2025-10-02T08:10:34.318189Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:34.320915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:34.320928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0] Write session will restart in 0.008855s
2025-10-02T08:10:34.320955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0] Write session: Do CDS request
2025-10-02T08:10:34.320963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:34.333400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:34.336963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:34.336983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 922
2025-10-02T08:10:34.340912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:34.340964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:34.340969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:34.340974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:34.345090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 922 sessionId:  describe result for acl check
2025-10-02T08:10:34.345141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:34.345142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:34.345144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:34.345149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533825251933008:11001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:34.345718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533825251933008:11001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:34.350344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533825251933008:11001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:34.371579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533825251933008:11001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:34.371597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533825251933008:11001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:34.371613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533825251933008:11001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:34.371621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:34.390963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:34.391318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:34.391482Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:34.391494Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:34.391504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:34.391551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:34.391592Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533825251933383:11000]
2025-10-02T08:10:34.392360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:34.392583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:34.392627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:34.392989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:34.393043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.393044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.393045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.393046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.393048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.393054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.393066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.393070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.393074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.393079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.393085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.393093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.393100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.393105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.393111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.393116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.393121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.393127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.393132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.393138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.393158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:34.405547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:34.407726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:34.407745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:34.407748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:34.407752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:34.407760Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 921 [1:7556533825251933383:11000]
2025-10-02T08:10:34.407773Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:34.407793Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:34.407796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.407800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.407802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.407820Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:34.407826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:34.407832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:34.407899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.407908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.407912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:34.407915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:34.407993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:34.408002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.408018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.408032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:34.408054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533825251933377:11000]
2025-10-02T08:10:34.408061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533825251933377:11000]
2025-10-02T08:10:34.408078Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:34.408093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:34.408114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:34.408122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:34.408160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533825251933377:11000]
2025-10-02T08:10:34.408168Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:34.409205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:34.409217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:34.409224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:34.409797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 921
2025-10-02T08:10:34.409822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533825251933202:11001], now have 1 active actors on pipe
2025-10-02T08:10:34.409826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533825712026774:2378], now have 1 active actors on pipe
2025-10-02T08:10:34.409916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.409928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.409956Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:34.409969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.409979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.409982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:34.409994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.410013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:34.410036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:34.410199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.410209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.410232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:34.410272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 922 partition: 0 MaxSeqNo: 17 sessionId: src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0
2025-10-02T08:10:34.410657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f795a6-4840e7d4-820e9468-60fc76a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:34.412965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 921
2025-10-02T08:10:34.413714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0] Write session: try to update token
2025-10-02T08:10:34.413732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:34.420937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533825251933406:10816]
2025-10-02T08:10:34.421176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 921, pipe: [1:7556533825251933406:10816]
2025-10-02T08:10:34.421192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533825251933406:10816], now have 1 active actors on pipe
2025-10-02T08:10:34.434679Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:34.434702Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:34.434705Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:34.434715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533825251933377:11000]
2025-10-02T08:10:34.434720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533825251933377:11000]
2025-10-02T08:10:34.434768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:34.434778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.434780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:34.434980Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:34.436869Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:34.436885Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:34.466001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId: src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:34.468694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:34.614389Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:34.615270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.615279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.615491Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:34.615823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:34.615903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 922 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0
2025-10-02T08:10:34.616105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 922 sessionId: src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0 is DEAD
2025-10-02T08:10:34.616174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533825251933406:10816]
2025-10-02T08:10:34.616976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:34.617262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:34.617271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0] Write session will restart in 0.007828s
2025-10-02T08:10:34.617295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0] Write session: Do CDS request
2025-10-02T08:10:34.617302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:34.626568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:34.627658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:34.627673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 923
2025-10-02T08:10:34.627855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:34.627884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:34.627890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:34.627893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:34.630721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 923 sessionId:  describe result for acl check
2025-10-02T08:10:34.630765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:34.630767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:34.630769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:34.630775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533825251933671:11010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:34.631387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533825251933671:11010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:34.638456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533825251933671:11010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:34.646891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533825251933671:11010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:34.646909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533825251933671:11010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:34.646913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533825251933671:11010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:34.646921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:34.659094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:34.660832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:34.661062Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:34.661066Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:34.661075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:34.661122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:34.661157Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533825251934052:11009]
2025-10-02T08:10:34.661803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:34.662593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:34.662643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:34.662973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:34.663020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.663021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.663023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.663024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.663025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.663031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.663042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.663046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.663049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.663053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.663058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.663066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.663072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.663077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.663081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.663087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.663091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.663096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.663101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.663106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.663123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:34.674264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:34.676469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:34.676490Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:34.676493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:34.676496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:34.676503Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 922 [1:7556533825251934052:11009]
2025-10-02T08:10:34.676516Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:34.676533Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:34.676536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.676540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.676542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.676558Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:34.676564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:34.676579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:34.676646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.676655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.676659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:34.676661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:34.676738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:34.676745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.676761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.676775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:34.676796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533825251934046:11009]
2025-10-02T08:10:34.677075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533825251934046:11009]
2025-10-02T08:10:34.677091Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:34.677113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:34.677134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:34.677142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:34.677153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533825251933897:11010], now have 1 active actors on pipe
2025-10-02T08:10:34.677162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533825712026783:2378], now have 1 active actors on pipe
2025-10-02T08:10:34.677168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:34.677172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:34.677194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533825251934046:11009]
2025-10-02T08:10:34.677197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:34.677211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:34.677247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 922
2025-10-02T08:10:34.677253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.677258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.677282Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|caa95366-73200986-9734225c-6a8a18eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:34.677290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.677294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.677296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:34.677305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.677315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:34.677332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:34.677455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.677460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.677473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:34.677505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 923 partition: 0 MaxSeqNo: 17 sessionId: src_id|caa95366-73200986-9734225c-6a8a18eb_0
2025-10-02T08:10:34.677908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069eca6-67d73f74-42e4c9a2-8dd158d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|caa95366-73200986-9734225c-6a8a18eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:34.677093Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 922
2025-10-02T08:10:34.680856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caa95366-73200986-9734225c-6a8a18eb_0] Write session: try to update token
2025-10-02T08:10:34.680871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caa95366-73200986-9734225c-6a8a18eb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:34.704041Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:34.704057Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:34.704059Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:34.704067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533825251934046:11009]
2025-10-02T08:10:34.704070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533825251934046:11009]
2025-10-02T08:10:34.704107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:34.704116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.704118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:34.704145Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:34.704153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:34.704460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId: src_id|caa95366-73200986-9734225c-6a8a18eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:34.707401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:34.712931Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:34.722361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533825251934076:10816]
2025-10-02T08:10:34.723367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 922, pipe: [1:7556533825251934076:10816]
2025-10-02T08:10:34.900739Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:34.905492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.905511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.905545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533825251934076:10816], now have 1 active actors on pipe
2025-10-02T08:10:34.905716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:34.905724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:34.905743Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:34.905782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 923 reason: error at write: Disconnected sessionId: src_id|caa95366-73200986-9734225c-6a8a18eb_0
2025-10-02T08:10:34.905980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 923 sessionId: src_id|caa95366-73200986-9734225c-6a8a18eb_0 is DEAD
2025-10-02T08:10:34.906027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:34.906077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533825251934076:10816]
2025-10-02T08:10:34.906280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caa95366-73200986-9734225c-6a8a18eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:34.906289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caa95366-73200986-9734225c-6a8a18eb_0] Write session will restart in 0.009667s
2025-10-02T08:10:34.906317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caa95366-73200986-9734225c-6a8a18eb_0] Write session: Do CDS request
2025-10-02T08:10:34.906325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caa95366-73200986-9734225c-6a8a18eb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:34.917405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caa95366-73200986-9734225c-6a8a18eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:34.917593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:34.917616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 924
2025-10-02T08:10:34.917779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:34.917819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:34.917826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:34.917831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:34.918355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 924 sessionId:  describe result for acl check
2025-10-02T08:10:34.918395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:34.918402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:34.918405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:34.918412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533825251934526:11017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:34.919024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533825251934526:11017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:34.922092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533825251934526:11017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:34.924683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533825251934526:11017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:34.924698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533825251934526:11017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:34.924700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533825251934526:11017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:34.924707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:34.924942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:34.927141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:34.927344Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:34.927353Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:34.927363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:34.927411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:34.927462Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533825251934721:11016]
2025-10-02T08:10:34.928126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:34.928328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:34.928370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:34.928673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:34.928719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.928725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.928726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.928727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.928728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.928733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.928742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.928750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.928754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.928757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.928762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.928774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:34.928780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.928790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:34.928795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.928817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:34.928822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.928827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.928836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.928840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.928860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:34.937055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:34.939083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:34.939102Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:34.939104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:34.939108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:34.939115Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 923 [1:7556533825251934721:11016]
2025-10-02T08:10:34.939126Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:34.939144Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:34.939147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.939150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.939151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.939168Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:34.939178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:34.939185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:34.939249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.939255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.939258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:34.939260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:34.939319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:34.939329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.939343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:34.939354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:34.939356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 923
2025-10-02T08:10:34.939372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533825251934712:11017], now have 1 active actors on pipe
2025-10-02T08:10:34.939375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533825712026801:2378], now have 1 active actors on pipe
2025-10-02T08:10:34.939379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.939383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.939399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533825251934709:11016]
2025-10-02T08:10:34.939401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533825251934709:11016]
2025-10-02T08:10:34.939412Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:34.939423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:34.939435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:34.939438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:34.939453Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:34.939458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.939461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.939462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:34.939463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:34.939465Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:34.939471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.939479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:34.939514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533825251934709:11016]
2025-10-02T08:10:34.939522Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:34.939536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:34.939539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:34.939629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.939636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.939650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:34.939688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 924 partition: 0 MaxSeqNo: 17 sessionId: src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0
2025-10-02T08:10:34.939476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 923
2025-10-02T08:10:34.940907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caa95366-73200986-9734225c-6a8a18eb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:34.943563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0] Write session: try to update token
2025-10-02T08:10:34.943578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:34.951052Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:34.951071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:34.951079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533825251934709:11016]
2025-10-02T08:10:34.951119Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:34.951121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:34.951292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:34.951437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:34.951576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:34.951730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:34.951936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:34.951980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:34.964533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId: src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:34.967412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:34.967492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.967506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.967540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:34.967566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:34.967634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:34.967647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:34.967801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.967862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.967937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.968019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.968312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.968322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.968400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.968459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.968530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.968609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.968666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.968675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.968754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.968849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.968925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.968994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.969045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.969051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.969128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.969194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.969253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.969308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.969347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.969349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.969410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.969473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.969537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.969598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.969643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.969645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.969709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.969763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.969822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.969884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.969926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.969928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.969992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.970063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.970126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.970193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.970238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.970239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.970302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.970355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.970414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.970474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.970522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.970529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.970600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.970657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.970715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.970775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.970821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.970822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.970885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:34.970940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:34.971000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:34.971069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:34.971210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:34.971213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:34.971275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:34.971325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:34.971337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:34.971339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:34.971367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:34.971379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:34.971382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:34.971384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:34.971386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:34.971801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:34.971816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:34.971821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:34.971824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:34.971827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:34.971829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:34.973195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:34.973233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:34.973243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:34.973249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:34.973281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:34.973292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:34.973902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:34.973936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:34.973943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:34.973946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:34.973951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:34.975425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:34.975453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:34.975466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392634974
2025-10-02T08:10:34.975638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:34.975656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:34.975664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:34.975667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:34.975673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:34.975677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:34.976260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:34.976299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:34.976306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:34.976313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:34.976316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:34.976319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:34.976972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:34.977000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:34.977012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:34.977015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:34.977020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:34.977023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:34.977585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:34.977616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:34.977627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:34.979028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:34.979052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:34.979058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:34.979061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:34.979070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392634977
2025-10-02T08:10:34.979410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:34.979439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:34.979451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:34.979455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:34.979459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:34.979467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:34.980029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:34.980063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:34.980069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:34.980074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:34.980080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:34.980086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:34.980612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:34.980642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:34.980762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392634980
2025-10-02T08:10:34.983443Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:34.983478Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:34.983487Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:34.983495Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:34.983508Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:34.983511Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:34.983513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:34.983525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533825251934709:11016]
2025-10-02T08:10:34.983529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533825251934709:11016]
2025-10-02T08:10:34.983592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:34.983616Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:34.983635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:34.983645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:34.983648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:34.983790Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:35.008885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533829546902043:10816]
2025-10-02T08:10:35.010177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 923, pipe: [1:7556533829546902043:10816]
2025-10-02T08:10:35.154652Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:35.155058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533829546902043:10816], now have 1 active actors on pipe
2025-10-02T08:10:35.155292Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:35.155315Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:35.155479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533829546902043:10816]
2025-10-02T08:10:35.155520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:35.155550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 924 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0
2025-10-02T08:10:35.155725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 924 sessionId: src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0 is DEAD
2025-10-02T08:10:35.157053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:35.157064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0] Write session will restart in 0.007539s
2025-10-02T08:10:35.157089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0] Write session: Do CDS request
2025-10-02T08:10:35.157096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:35.160291Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [22e4d347061bbb0c] Result# TEvPutResult {Id# [72075186224037892:923:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:35.160357Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:923:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:35.160454Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:923:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:35.166194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:35.166428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:35.166441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 925
2025-10-02T08:10:35.166547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:35.166569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:35.166573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:35.166576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:35.167038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 925 sessionId:  describe result for acl check
2025-10-02T08:10:35.167074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:35.167080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:35.167082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:35.167087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533829546902336:11036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:35.167597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533829546902336:11036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:35.176096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533829546902336:11036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:35.183337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533829546902336:11036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:35.183355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533829546902336:11036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:35.183358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533829546902336:11036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:35.183367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:35.194131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:35.196039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:35.196234Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:35.196258Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:35.196269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:35.196335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:35.196370Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533829546902719:11033]
2025-10-02T08:10:35.197017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:35.200312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:35.200384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:35.200900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:35.200978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.200979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.200980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.200982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.200982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.200988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.201000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.201003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.201007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.201010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.201017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.201024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.201030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.201035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.201039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.201045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.201049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.201053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.201058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.201063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.201082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:35.213457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:35.215229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:35.215238Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:35.215242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:35.215247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:35.215255Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 924 [1:7556533829546902719:11033]
2025-10-02T08:10:35.215269Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:35.215289Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:35.215293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:35.215297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:35.215299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:35.215318Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:35.215323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:35.215329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:35.215408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.215410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.215413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:35.215416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:35.215501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:35.215504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.215519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.215532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:35.215550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533829546902713:11033]
2025-10-02T08:10:35.215552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533829546902713:11033]
2025-10-02T08:10:35.215567Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:35.215579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:35.215597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:35.215599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:35.215656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533829546902713:11033]
2025-10-02T08:10:35.216921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b92973-c14cad54-bdf0159e-a98e3e80_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da814360-d894022b-79ab55e5-42378ddf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:35.218306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 924
2025-10-02T08:10:35.219725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da814360-d894022b-79ab55e5-42378ddf_0] Write session: try to update token
2025-10-02T08:10:35.219741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da814360-d894022b-79ab55e5-42378ddf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:35.215659Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:35.215894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 924
2025-10-02T08:10:35.215895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:35.215899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:35.215906Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:35.215910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533829546902542:11036], now have 1 active actors on pipe
2025-10-02T08:10:35.215916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.215921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.215950Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da814360-d894022b-79ab55e5-42378ddf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:35.215959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:35.215964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:35.215966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:35.215977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:35.216005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:35.216023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:35.216455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.216461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.216477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533830006994120:2378], now have 1 active actors on pipe
2025-10-02T08:10:35.216491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:35.216534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 925 partition: 0 MaxSeqNo: 17 sessionId: src_id|da814360-d894022b-79ab55e5-42378ddf_0
2025-10-02T08:10:35.232990Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:35.233008Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:35.233017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533829546902713:11033]
2025-10-02T08:10:35.233061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:35.233254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:35.233262Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:35.233423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:35.233593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:35.233759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:35.234075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:35.234122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:35.248303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId: src_id|da814360-d894022b-79ab55e5-42378ddf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:35.252171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:35.252303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.252317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.252353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:35.252375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:35.252592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.252599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.252779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.252877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.252946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.253019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.253063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.253067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.253152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.253221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.253292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.253364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.253423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.253426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.253508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.253575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.253644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.253717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.253768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.253771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.253850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.253915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.253980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.254052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.254101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.254108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.254185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.254251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.254322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.254392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.254447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.254450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.254528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.254597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.254668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.254785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.254845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.254848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.254927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.254992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.255070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.255141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.255185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.255188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.255270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.255339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.255413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.255485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.255536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.255539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.255639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.255710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.255714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533829546902744:10816]
2025-10-02T08:10:35.255778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.255850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.255902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.255905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.255985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:35.256058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:35.256131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:35.256201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:35.256247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:35.256249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:35.256292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:35.256368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:35.256388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:35.256391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:35.256426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:35.256439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:35.256443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:35.256446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:35.256449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:35.257350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:35.257382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:35.257390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:35.257395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:35.257398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:35.257403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:35.257418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 924, pipe: [1:7556533829546902744:10816]
2025-10-02T08:10:35.258538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:35.258559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:35.258567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:35.258571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:35.258575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:35.258578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:35.259186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:35.259201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:35.259207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:35.259211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:35.259214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:35.261964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:35.261984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:35.261997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392635258
2025-10-02T08:10:35.262428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:35.262440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:35.262447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:35.262451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:35.262455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:35.262460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:35.263024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:35.263039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:35.263045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:35.263049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:35.263052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:35.263055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:35.263641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:35.263655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:35.263662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:35.263666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:35.263670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:35.263674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:35.264250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:35.264262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:35.264268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:35.265596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:35.265616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:35.265621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:35.265626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:35.265635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392635264
2025-10-02T08:10:35.266170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:35.266185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:35.266195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:35.266199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:35.266203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:35.266207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:35.266867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:35.266880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:35.266886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:35.266890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:35.266894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:35.266900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:35.267640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:35.267661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:35.267772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392635267
2025-10-02T08:10:35.272210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533829546902744:10816], now have 1 active actors on pipe
2025-10-02T08:10:35.272228Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:35.272247Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:35.272254Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:35.272262Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:35.274309Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:35.274324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:35.274326Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:35.274335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533829546902713:11033]
2025-10-02T08:10:35.274338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533829546902713:11033]
2025-10-02T08:10:35.274408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:35.274415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.274417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:35.274443Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:35.274450Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:35.274577Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:35.535840Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:35.536354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:35.536366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:35.536398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 925 reason: error at write: Disconnected sessionId: src_id|da814360-d894022b-79ab55e5-42378ddf_0
2025-10-02T08:10:35.536455Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:35.536569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 925 sessionId: src_id|da814360-d894022b-79ab55e5-42378ddf_0 is DEAD
2025-10-02T08:10:35.536739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533829546902744:10816]
2025-10-02T08:10:35.536908Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:35.538008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da814360-d894022b-79ab55e5-42378ddf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:35.538028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da814360-d894022b-79ab55e5-42378ddf_0] Write session will restart in 0.009230s
2025-10-02T08:10:35.538061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da814360-d894022b-79ab55e5-42378ddf_0] Write session: Do CDS request
2025-10-02T08:10:35.538070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da814360-d894022b-79ab55e5-42378ddf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:35.549210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da814360-d894022b-79ab55e5-42378ddf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:35.552997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:35.553012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 926
2025-10-02T08:10:35.554437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:35.554488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:35.554494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:35.554498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:35.555110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 926 sessionId:  describe result for acl check
2025-10-02T08:10:35.555143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:35.555145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:35.555146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:35.555152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533829546903027:11042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:35.555968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533829546903027:11042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:35.562132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533829546903027:11042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:35.573162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533829546903027:11042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:35.573180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533829546903027:11042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:35.573184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533829546903027:11042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:35.573193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:35.582237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:35.585733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:35.585901Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:35.585903Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:35.585909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:35.585950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:35.585981Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533829546903396:11041]
2025-10-02T08:10:35.586420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:35.586665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:35.586697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:35.586891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:35.586918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.586919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.586919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.586920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.586921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.586923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.586930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.586932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.586934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.586936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.586940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.586945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.586948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.586951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.586953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.586956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.586958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.586961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.586963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.586966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.586976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:35.595626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:35.597092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:35.597097Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:35.597099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:35.597103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:35.597109Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 925 [1:7556533829546903396:11041]
2025-10-02T08:10:35.597117Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:35.597131Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:35.597134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:35.597136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:35.597138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:35.597149Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:35.597153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:35.597158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:35.597206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.597208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.597210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:35.597212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:35.597282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:35.597284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.597297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.597306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:35.597322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533829546903390:11041]
2025-10-02T08:10:35.597324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533829546903390:11041]
2025-10-02T08:10:35.597331Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:35.597343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:35.597354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:35.597357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:35.597362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:35.597364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:35.597366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533829546903303:11042], now have 1 active actors on pipe
2025-10-02T08:10:35.597396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533829546903390:11041]
2025-10-02T08:10:35.597398Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:35.597406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533830006994138:2378], now have 1 active actors on pipe
2025-10-02T08:10:35.597444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 925
2025-10-02T08:10:35.597522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:35.598936Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 925
2025-10-02T08:10:35.597885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.597897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.597921Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58604717-e58f7989-46b64b64-da8bdf9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:35.597930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:35.597934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:35.597936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:35.597946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:35.597958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:35.597974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:35.598446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.598449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.598463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:35.598498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 926 partition: 0 MaxSeqNo: 17 sessionId: src_id|58604717-e58f7989-46b64b64-da8bdf9b_0
2025-10-02T08:10:35.601147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da814360-d894022b-79ab55e5-42378ddf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|58604717-e58f7989-46b64b64-da8bdf9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:35.603835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58604717-e58f7989-46b64b64-da8bdf9b_0] Write session: try to update token
2025-10-02T08:10:35.603854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58604717-e58f7989-46b64b64-da8bdf9b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:35.628432Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:35.628462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:35.628466Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:35.628478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533829546903390:11041]
2025-10-02T08:10:35.628485Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533829546903390:11041]
2025-10-02T08:10:35.628563Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:35.628566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:35.628572Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:35.628582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.628586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:35.632926Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:35.632954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId: src_id|58604717-e58f7989-46b64b64-da8bdf9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:35.635651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:35.643965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533829546903422:10816]
2025-10-02T08:10:35.644207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 925, pipe: [1:7556533829546903422:10816]
2025-10-02T08:10:35.778828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:35.779640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58604717-e58f7989-46b64b64-da8bdf9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:35.779651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58604717-e58f7989-46b64b64-da8bdf9b_0] Write session will restart in 0.007967s
2025-10-02T08:10:35.779677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58604717-e58f7989-46b64b64-da8bdf9b_0] Write session: Do CDS request
2025-10-02T08:10:35.779684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58604717-e58f7989-46b64b64-da8bdf9b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:35.777565Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:35.778169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.778179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.778218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533829546903422:10816], now have 1 active actors on pipe
2025-10-02T08:10:35.779036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:35.779039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:35.779098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 926 reason: error at write: Disconnected sessionId: src_id|58604717-e58f7989-46b64b64-da8bdf9b_0
2025-10-02T08:10:35.779272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 926 sessionId: src_id|58604717-e58f7989-46b64b64-da8bdf9b_0 is DEAD
2025-10-02T08:10:35.779408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533829546903422:10816]
2025-10-02T08:10:35.779702Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:35.789375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58604717-e58f7989-46b64b64-da8bdf9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:35.793059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:35.793075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 927
2025-10-02T08:10:35.796241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:35.796309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:35.796316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:35.796322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:35.796909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 927 sessionId:  describe result for acl check
2025-10-02T08:10:35.796952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:35.796954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:35.796956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:35.796962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533829546903798:11049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:35.797514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533829546903798:11049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:35.802859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533829546903798:11049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:35.807853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533829546903798:11049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:35.807872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533829546903798:11049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:35.807875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533829546903798:11049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:35.807884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:35.821919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:35.827462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:35.827727Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:35.827731Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:35.827741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:35.827794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:35.827831Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533829546904073:11048]
2025-10-02T08:10:35.828446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:35.828759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:35.828796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:35.829154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:35.829210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.829211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.829212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.829214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.829215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.829221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.829231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.829234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.829239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.829242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.829248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.829256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:35.829262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.829267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:35.829272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.829277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:35.829282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.829288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.829296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.829302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.829322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:35.838832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:35.840360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:35.840367Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:35.840370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:35.840374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:35.840381Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 926 [1:7556533829546904073:11048]
2025-10-02T08:10:35.840397Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:35.840414Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:35.840418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:35.840421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:35.840423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:35.840439Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:35.840445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:35.840451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:35.840516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.840518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.840522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:35.840524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:35.840595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:35.840597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.840611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:35.840625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:35.840644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533829546903891:11049], now have 1 active actors on pipe
2025-10-02T08:10:35.840651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533829546904054:11048]
2025-10-02T08:10:35.840654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533829546904054:11048]
2025-10-02T08:10:35.840662Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:35.840662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 926
2025-10-02T08:10:35.840675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:35.840688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:35.840691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:35.840725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533829546904054:11048]
2025-10-02T08:10:35.840728Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:35.840924Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:35.840926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:35.840932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:35.841362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 926
2025-10-02T08:10:35.841146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533830006994157:2378], now have 1 active actors on pipe
2025-10-02T08:10:35.841164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.841170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.841198Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|783681ca-9c069d18-ee3a6010-d6939259_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:35.841204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:35.841209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:35.841211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:35.841220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:35.841232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:35.841248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:35.841348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:35.841351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:35.841365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:35.841404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 927 partition: 0 MaxSeqNo: 17 sessionId: src_id|783681ca-9c069d18-ee3a6010-d6939259_0
2025-10-02T08:10:35.845271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58604717-e58f7989-46b64b64-da8bdf9b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|783681ca-9c069d18-ee3a6010-d6939259_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:35.851934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783681ca-9c069d18-ee3a6010-d6939259_0] Write session: try to update token
2025-10-02T08:10:35.851962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783681ca-9c069d18-ee3a6010-d6939259_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:35.860853Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:35.860872Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:35.860875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:35.860884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533829546904054:11048]
2025-10-02T08:10:35.860889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533829546904054:11048]
2025-10-02T08:10:35.860934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:35.860940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:35.860943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:35.860956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:35.860964Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:35.861096Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:35.877736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533829546904097:10816]
2025-10-02T08:10:35.877954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 926, pipe: [1:7556533829546904097:10816]
2025-10-02T08:10:35.885643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId: src_id|783681ca-9c069d18-ee3a6010-d6939259_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:35.889447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:36.020566Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:36.020985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533829546904097:10816], now have 1 active actors on pipe
2025-10-02T08:10:36.020998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.021004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.021378Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:36.021934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533829546904097:10816]
2025-10-02T08:10:36.021977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:36.022034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 927 reason: status is not ok: tablet will be restarted right now sessionId: src_id|783681ca-9c069d18-ee3a6010-d6939259_0
2025-10-02T08:10:36.022035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:36.022243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 927 sessionId: src_id|783681ca-9c069d18-ee3a6010-d6939259_0 is DEAD
2025-10-02T08:10:36.029093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783681ca-9c069d18-ee3a6010-d6939259_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:36.029115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783681ca-9c069d18-ee3a6010-d6939259_0] Write session will restart in 0.006957s
2025-10-02T08:10:36.029151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783681ca-9c069d18-ee3a6010-d6939259_0] Write session: Do CDS request
2025-10-02T08:10:36.029160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783681ca-9c069d18-ee3a6010-d6939259_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:36.045431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783681ca-9c069d18-ee3a6010-d6939259_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:36.045797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:36.045826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 928
2025-10-02T08:10:36.046017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:36.046048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:36.046055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:36.046060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:36.047042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 928 sessionId:  describe result for acl check
2025-10-02T08:10:36.047079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:36.047080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:36.047082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:36.047086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533833841871854:11056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:36.047664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533833841871854:11056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:36.052881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533833841871854:11056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:36.056916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:36.058073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533833841871854:11056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:36.058087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533833841871854:11056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:36.058091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533833841871854:11056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:36.058100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:36.059849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:36.060068Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:36.060072Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:36.060082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:36.060138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:36.060175Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533833841872032:11055]
2025-10-02T08:10:36.060744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:36.060991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:36.061055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:36.061389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:36.061437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.061438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.061439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.061441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.061442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.061448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.061460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.061464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.061469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.061473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.061479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.061486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.061492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.061498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.061504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.061509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.061513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.061520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.061524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.061530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.061552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:36.070708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:36.072959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:36.072976Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:36.072979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:36.072982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:36.072989Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 927 [1:7556533833841872032:11055]
2025-10-02T08:10:36.073002Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:36.073020Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:36.073024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.073026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.073029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.073044Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:36.073049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:36.073056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:36.073721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.073732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.073735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:36.073738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:36.073820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:36.073823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.073840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.073854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:36.073871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533833841872020:11055]
2025-10-02T08:10:36.073873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533833841872020:11055]
2025-10-02T08:10:36.073887Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:36.073901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:36.073917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:36.073920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:36.073957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533833841872020:11055]
2025-10-02T08:10:36.073959Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:36.074195Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 927
2025-10-02T08:10:36.074060Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:36.074068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:36.074074Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:36.074409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 927
2025-10-02T08:10:36.074423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533833841872027:11056], now have 1 active actors on pipe
2025-10-02T08:10:36.074429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533834301961462:2378], now have 1 active actors on pipe
2025-10-02T08:10:36.074442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.074448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.074491Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:36.074499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.074503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.074506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:36.074516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.074528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:36.074654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:36.074780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.074785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.074804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:36.074839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 928 partition: 0 MaxSeqNo: 17 sessionId: src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0
2025-10-02T08:10:36.076405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783681ca-9c069d18-ee3a6010-d6939259_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:36.079655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0] Write session: try to update token
2025-10-02T08:10:36.079677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:36.097337Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:36.097354Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:36.097356Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:36.097362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533833841872020:11055]
2025-10-02T08:10:36.097367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533833841872020:11055]
2025-10-02T08:10:36.097403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:36.097409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.097410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:36.097558Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:36.101742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:36.101764Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:36.106214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId: src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:36.109308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:36.122013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533833841872060:10816]
2025-10-02T08:10:36.122242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 927, pipe: [1:7556533833841872060:10816]
2025-10-02T08:10:36.255173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:36.256009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.256028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.256050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533833841872060:10816], now have 1 active actors on pipe
2025-10-02T08:10:36.256858Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:36.256988Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:36.257280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:36.257337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 928 reason: status is not ok: tablet will be restarted right now sessionId: src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0
2025-10-02T08:10:36.257514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 928 sessionId: src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0 is DEAD
2025-10-02T08:10:36.257634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533833841872060:10816]
2025-10-02T08:10:36.261021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:36.261033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0] Write session will restart in 0.005906s
2025-10-02T08:10:36.261062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0] Write session: Do CDS request
2025-10-02T08:10:36.261070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:36.268462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:36.269103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:36.269121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 929
2025-10-02T08:10:36.269277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:36.269319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:36.269329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:36.269333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:36.269857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 929 sessionId:  describe result for acl check
2025-10-02T08:10:36.269898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:36.269905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:36.269907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:36.269912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533833841872404:11075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:36.270461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533833841872404:11075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:36.274749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533833841872404:11075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:36.279849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533833841872404:11075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:36.279868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533833841872404:11075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:36.279872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533833841872404:11075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:36.279880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:36.290757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:36.291129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:36.291319Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:36.291330Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:36.291341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:36.291390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:36.291433Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533833841872737:11074]
2025-10-02T08:10:36.292154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:36.292442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:36.292490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:36.292846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:36.292907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.292914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.292915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.292917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.292918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.292924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.292936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.292941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.292946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.292950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.292956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.292965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.292971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.292977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.292981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.292986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.292990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.292995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.293003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.293008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.293033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:36.302085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:36.304267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:36.304285Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:36.304287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:36.304291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:36.304298Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 928 [1:7556533833841872737:11074]
2025-10-02T08:10:36.304311Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:36.304331Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:36.304334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.304337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.304339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.304355Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:36.304361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:36.304368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:36.304427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.304434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.304440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:36.304443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:36.304753Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 928
2025-10-02T08:10:36.304514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:36.304522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.304535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.304546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:36.304563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533833841872731:11074]
2025-10-02T08:10:36.304565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533833841872731:11074]
2025-10-02T08:10:36.304573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:36.304586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:36.304598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:36.304597Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:36.304601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:36.304602Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:36.304611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533833841872663:11075], now have 1 active actors on pipe
2025-10-02T08:10:36.304612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 928
2025-10-02T08:10:36.304643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533833841872731:11074]
2025-10-02T08:10:36.304653Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:36.304658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533834301961490:2378], now have 1 active actors on pipe
2025-10-02T08:10:36.304662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.304667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.304711Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:36.304718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.304721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.304723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:36.304732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.304736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:36.304741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:36.304760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:36.304879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.304882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.304898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:36.304934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 929 partition: 0 MaxSeqNo: 17 sessionId: src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0
2025-10-02T08:10:36.305480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faaaff4-17e7738c-8bf9ec2f-516ed217_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:36.308349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0] Write session: try to update token
2025-10-02T08:10:36.308368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:36.333481Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:36.333497Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:36.333501Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:36.333516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533833841872731:11074]
2025-10-02T08:10:36.333521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533833841872731:11074]
2025-10-02T08:10:36.333569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:36.333575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:36.333577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.333580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:36.333583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:36.333745Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:36.340895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId: src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:36.343863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:36.358240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533833841872762:10816]
2025-10-02T08:10:36.358808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 928, pipe: [1:7556533833841872762:10816]
2025-10-02T08:10:36.478615Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:36.479221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.479228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.479246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533833841872762:10816], now have 1 active actors on pipe
2025-10-02T08:10:36.481097Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:36.481489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:36.481540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 929 reason: status is not ok: tablet will be restarted right now sessionId: src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0
2025-10-02T08:10:36.481728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 929 sessionId: src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0 is DEAD
2025-10-02T08:10:36.481858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533833841872762:10816]
2025-10-02T08:10:36.482371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:36.482379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0] Write session will restart in 0.009743s
2025-10-02T08:10:36.482404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0] Write session: Do CDS request
2025-10-02T08:10:36.482433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:36.482815Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:36.493915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:36.494766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:36.494782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 930
2025-10-02T08:10:36.494904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:36.494939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:36.494944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:36.494947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:36.495353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 930 sessionId:  describe result for acl check
2025-10-02T08:10:36.495399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:36.495400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:36.495402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:36.495407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533833841873074:11081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:36.495936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533833841873074:11081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:36.501028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533833841873074:11081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:36.507097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533833841873074:11081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:36.507113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533833841873074:11081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:36.507117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533833841873074:11081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:36.507127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:36.521339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:36.522567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:36.522829Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:36.522840Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:36.522853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:36.522925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:36.522970Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533833841873409:11080]
2025-10-02T08:10:36.523651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:36.524195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:36.524252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:36.524603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:36.524681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.524682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.524683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.524685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.524685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.524692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.524703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.524707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.524711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.524715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.524721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.524729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.524734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.524739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.524744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.524749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.524754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.524759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.524763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.524769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.524790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:36.535329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:36.537627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:36.537635Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:36.537638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:36.537642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:36.537650Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 929 [1:7556533833841873409:11080]
2025-10-02T08:10:36.537664Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:36.537684Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:36.537688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.537691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.537693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.537713Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:36.537718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:36.537725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:36.537796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.537802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.537804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:36.537807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:36.537885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:36.537888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.537904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.537917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:36.537935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533833841873403:11080]
2025-10-02T08:10:36.537938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533833841873403:11080]
2025-10-02T08:10:36.537946Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:36.537962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:36.537976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:36.537979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:36.538016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533833841873403:11080]
2025-10-02T08:10:36.538018Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:36.538394Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:36.538407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:36.538413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:36.538593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 929
2025-10-02T08:10:36.538739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533833841873273:11081], now have 1 active actors on pipe
2025-10-02T08:10:36.538757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533834301961497:2378], now have 1 active actors on pipe
2025-10-02T08:10:36.538764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.538775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.538806Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:36.538820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.538823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.538825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:36.538835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.538852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:36.538874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:36.538939Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 929
2025-10-02T08:10:36.539013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.539029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.539071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:36.539120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 930 partition: 0 MaxSeqNo: 17 sessionId: src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0
2025-10-02T08:10:36.539961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73681218-fdc6a1be-9e2a5fda-2aef42d0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:36.542863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0] Write session: try to update token
2025-10-02T08:10:36.542883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:36.560947Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:36.560965Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:36.560967Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:36.560976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533833841873403:11080]
2025-10-02T08:10:36.560980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533833841873403:11080]
2025-10-02T08:10:36.561024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:36.561031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.561033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:36.561181Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:36.564903Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:36.564926Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:36.566962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId: src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:36.569881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:36.582231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533833841873437:10816]
2025-10-02T08:10:36.583129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 929, pipe: [1:7556533833841873437:10816]
2025-10-02T08:10:36.715375Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:36.716085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.716095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.716138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533833841873437:10816], now have 1 active actors on pipe
2025-10-02T08:10:36.716850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:36.718241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:36.718251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0] Write session will restart in 0.005488s
2025-10-02T08:10:36.718275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0] Write session: Do CDS request
2025-10-02T08:10:36.718282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:36.717074Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:36.717389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:36.717446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 930 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0
2025-10-02T08:10:36.717644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 930 sessionId: src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0 is DEAD
2025-10-02T08:10:36.717766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533833841873437:10816]
2025-10-02T08:10:36.726898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:36.727837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:36.727860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 931
2025-10-02T08:10:36.728280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:36.728316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:36.728322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:36.728326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:36.728899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 931 sessionId:  describe result for acl check
2025-10-02T08:10:36.728933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:36.728936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:36.728938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:36.728944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533833841873736:11088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:36.729537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533833841873736:11088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:36.738705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533833841873736:11088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:36.746768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533833841873736:11088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:36.746783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533833841873736:11088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:36.746786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533833841873736:11088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:36.746794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:36.768830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:36.773069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:36.773373Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:36.773378Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:36.773395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:36.773485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:36.773538Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533833841874085:11087]
2025-10-02T08:10:36.774339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:36.774608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:36.774680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:36.775117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:36.775199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.775201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.775202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.775203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.775204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.775211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.775221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.775225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.775229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.775232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.775239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.775248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:36.775255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.775260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:36.775266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.775272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:36.775277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.775284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.775289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.775294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.775312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:36.792350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:36.795198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:36.795207Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:36.795210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:36.795215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:36.795222Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 930 [1:7556533833841874085:11087]
2025-10-02T08:10:36.795237Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:36.795257Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:36.795261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.795263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.795266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.795286Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:36.795292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:36.795299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:36.795384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.795387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.795394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:36.795396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:36.795593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 930
2025-10-02T08:10:36.796029Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 930
2025-10-02T08:10:36.796077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:36.796088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.796098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:36.796105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:36.796113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533833841873894:11088], now have 1 active actors on pipe
2025-10-02T08:10:36.796115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533834301961517:2378], now have 1 active actors on pipe
2025-10-02T08:10:36.796119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.796122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.796157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533833841874079:11087]
2025-10-02T08:10:36.796165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533833841874079:11087]
2025-10-02T08:10:36.796177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:36.796197Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:36.796199Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:36.796206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.796208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:36.796210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.796212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:36.796221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.796232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:36.796245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:36.796261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:36.796269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:36.796313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:36.796335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533833841874079:11087]
2025-10-02T08:10:36.796345Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:36.796358Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:36.796423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.796433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.796456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:36.796501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 931 partition: 0 MaxSeqNo: 17 sessionId: src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0
2025-10-02T08:10:36.796939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b74fe46-a0352d61-d47f4a42-1d0447cc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:36.799848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0] Write session: try to update token
2025-10-02T08:10:36.799868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:36.814903Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:36.814930Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:36.814942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533833841874079:11087]
2025-10-02T08:10:36.815003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:36.815282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:36.815505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:36.815736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:36.815947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:36.816256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:36.816314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:36.817026Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:36.819648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533833841874110:10816]
2025-10-02T08:10:36.820991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 930, pipe: [1:7556533833841874110:10816]
2025-10-02T08:10:36.821012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533833841874110:10816], now have 1 active actors on pipe
2025-10-02T08:10:36.826542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId: src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:36.829661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:36.830081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.830105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.830142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:36.830186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:36.830256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:36.830264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:36.830447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.830522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.830598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.830673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.830735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.830745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.830824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.830899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.830981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.831065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.831127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.831135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.831213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.831283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.831361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.831440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.831495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.831504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.831580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.831667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.831743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.831820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.831880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.831888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.831967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.832042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.832123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.832202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.832262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.832270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.832348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.832423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.832510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.832593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.832660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.832668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.832753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.836955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.837074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.837171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.837233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.837245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.837338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.837416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.837500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.837582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.837643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.837652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.837738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.837814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.837892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.837968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.838021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.838029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.838113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:36.838182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:36.838264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:36.838338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:36.838393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:36.838402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:36.838458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:36.838541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:36.838573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:36.838580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:36.838617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:36.838636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:36.838645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:36.838649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:36.838652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:36.839135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:36.839167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:36.839176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:36.839185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:36.839189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:36.839192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:36.839845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:36.839882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:36.839896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:36.839907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:36.839914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:36.839918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:36.841129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:36.841156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:36.841164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:36.841167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:36.841175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:36.843832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:36.843844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:36.843857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392636843
2025-10-02T08:10:36.844284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:36.844296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:36.844304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:36.844308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:36.844313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:36.844317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:36.848988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:36.849031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:36.849048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:36.849054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:36.849058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:36.849064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:36.849973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:36.849997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:36.850006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:36.850012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:36.850015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:36.850018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:36.850513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:36.850530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:36.850538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:36.851935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:36.851943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:36.851947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:36.851950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:36.851958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392636850
2025-10-02T08:10:36.852255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:36.852265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:36.852270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:36.852272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:36.852278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:36.852280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:36.852990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:36.853012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:36.853018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:36.853021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:36.853024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:36.853028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:36.853525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:36.853547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:36.853647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392636853
2025-10-02T08:10:36.857719Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:36.857748Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:36.857756Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:36.857763Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:36.859581Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:36.859603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:36.859605Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:36.859613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533833841874079:11087]
2025-10-02T08:10:36.859628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533833841874079:11087]
2025-10-02T08:10:36.859695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:36.859700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:36.859705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:36.859707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:36.859708Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:36.859845Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:37.030223Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:37.033196Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:37.033223Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:37.033605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533833841874110:10816]
2025-10-02T08:10:37.033652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:37.033699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 931 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0
2025-10-02T08:10:37.033962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 931 sessionId: src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0 is DEAD
2025-10-02T08:10:37.039149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:37.039169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0] Write session will restart in 0.008907s
2025-10-02T08:10:37.039195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0] Write session: Do CDS request
2025-10-02T08:10:37.039202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:37.049382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:37.049917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:37.049933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 932
2025-10-02T08:10:37.050134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:37.050169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:37.050175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:37.050178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:37.050796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 932 sessionId:  describe result for acl check
2025-10-02T08:10:37.050862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:37.050879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:37.050881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:37.050887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533838136841774:11095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:37.051553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533838136841774:11095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:37.058986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533838136841774:11095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:37.065366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533838136841774:11095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:37.065383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533838136841774:11095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:37.065387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533838136841774:11095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:37.065396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:37.071292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:37.076379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:37.076599Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:37.076602Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:37.076611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:37.076656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:37.076684Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533838136842077:11094]
2025-10-02T08:10:37.077195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:37.077436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:37.077483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:37.077723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:37.077767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.077772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.077773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.077774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.077775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.077780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.077791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.077795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.077798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.077802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.077808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.077816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.077823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.077829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.077838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.077844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.077852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.077858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.077864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.077873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.077894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:37.091543Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 931
2025-10-02T08:10:37.089317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:37.091125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:37.091131Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:37.091133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:37.091137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:37.091144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 931 [1:7556533838136842077:11094]
2025-10-02T08:10:37.091155Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:37.091176Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:37.091179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:37.091182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:37.091184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:37.091202Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:37.091207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:37.091214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:37.091273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.091276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.091280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:37.091282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:37.091337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:37.091339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.091362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.091372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:37.091389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533838136842057:11095], now have 1 active actors on pipe
2025-10-02T08:10:37.091394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533838136842070:11094]
2025-10-02T08:10:37.091397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533838136842070:11094]
2025-10-02T08:10:37.091406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:37.091416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533838596928824:2378], now have 1 active actors on pipe
2025-10-02T08:10:37.091418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:37.091421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:37.091421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:37.091433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:37.091436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:37.091468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533838136842070:11094]
2025-10-02T08:10:37.091470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 931
2025-10-02T08:10:37.091471Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:37.091505Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:37.091507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.091511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.091534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:37.091541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:37.091545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:37.091547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:37.091557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:37.091566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:37.091584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:37.091613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.091616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.091645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:37.091674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 932 partition: 0 MaxSeqNo: 17 sessionId: src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0
2025-10-02T08:10:37.097042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab0cb80-6d7ad1d5-1b22c737-44816adc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:37.099858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0] Write session: try to update token
2025-10-02T08:10:37.099882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:37.105013Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:37.105034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:37.105042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533838136842070:11094]
2025-10-02T08:10:37.105088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:37.105112Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:37.105268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:37.105426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:37.105595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:37.105740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:37.105964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:37.106000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:37.126913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId: src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:37.128652Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:37.128672Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:37.128676Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:37.128687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533838136842070:11094]
2025-10-02T08:10:37.128692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533838136842070:11094]
2025-10-02T08:10:37.128749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:37.128753Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:37.128758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.128759Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:37.128760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:37.128968Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:37.130218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:37.136688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533838136842102:10816]
2025-10-02T08:10:37.143948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 931, pipe: [1:7556533838136842102:10816]
2025-10-02T08:10:37.288131Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:37.288701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.288712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.288731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533838136842102:10816], now have 1 active actors on pipe
2025-10-02T08:10:37.288919Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:37.288931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533838136842102:10816]
2025-10-02T08:10:37.288952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:37.289019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 932 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0
2025-10-02T08:10:37.289216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 932 sessionId: src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0 is DEAD
2025-10-02T08:10:37.289548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:37.289554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0] Write session will restart in 0.006299s
2025-10-02T08:10:37.289572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0] Write session: Do CDS request
2025-10-02T08:10:37.289581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:37.292139Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:37.297569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:37.301009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:37.301025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 933
2025-10-02T08:10:37.301210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:37.301239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:37.301244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:37.301248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:37.305598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 933 sessionId:  describe result for acl check
2025-10-02T08:10:37.305649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:37.305651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:37.305654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:37.305660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533838136842180:11114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:37.306240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533838136842180:11114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:37.319881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533838136842180:11114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:37.323659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533838136842180:11114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:37.323677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533838136842180:11114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:37.323680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533838136842180:11114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:37.323689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:37.332669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:37.335822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:37.336055Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:37.336065Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:37.336076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:37.336141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:37.336189Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533838136842788:11113]
2025-10-02T08:10:37.336866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:37.337087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:37.337138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:37.337508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:37.337570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.337571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.337572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.337573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.337574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.337580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.337590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.337594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.337597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.337600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.337606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.337612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.337618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.337623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.337630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.337635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.337640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.337645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.337650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.337655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.337675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:37.348512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:37.350411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:37.350430Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:37.350433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:37.350436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:37.350443Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 932 [1:7556533838136842788:11113]
2025-10-02T08:10:37.350456Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:37.350477Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:37.350480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:37.350484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:37.350486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:37.350504Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:37.350509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:37.350515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:37.350568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.350575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.350577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:37.350579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:37.350632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:37.350638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.350649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.350659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:37.350672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533838136842781:11113]
2025-10-02T08:10:37.350677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533838136842781:11113]
2025-10-02T08:10:37.350683Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:37.350692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:37.350705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:37.350710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:37.350738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533838136842781:11113]
2025-10-02T08:10:37.350743Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:37.350747Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:37.350750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533838136842609:11114], now have 1 active actors on pipe
2025-10-02T08:10:37.350756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:37.350761Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:37.350786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 932
2025-10-02T08:10:37.351124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.351135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.351149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533838596928845:2378], now have 1 active actors on pipe
2025-10-02T08:10:37.351160Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:37.351177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:37.351179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:37.351181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:37.351188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:37.351198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:37.351212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:37.351299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.351302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.351312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:37.351340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 933 partition: 0 MaxSeqNo: 17 sessionId: src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0
2025-10-02T08:10:37.352001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6943964-4f20070f-6a99862a-6b5fcb76_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:37.355597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0] Write session: try to update token
2025-10-02T08:10:37.355636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:37.357170Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 932
2025-10-02T08:10:37.371000Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:37.371016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:37.371018Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:37.371026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533838136842781:11113]
2025-10-02T08:10:37.371030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533838136842781:11113]
2025-10-02T08:10:37.371069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:37.371075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.371077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:37.371129Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:37.371137Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:37.371225Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:37.386019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId: src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:37.389619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:37.389754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533838136842812:10816]
2025-10-02T08:10:37.390025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 932, pipe: [1:7556533838136842812:10816]
2025-10-02T08:10:37.518464Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:37.519118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.519127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.519150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533838136842812:10816], now have 1 active actors on pipe
2025-10-02T08:10:37.520467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533838136842812:10816]
2025-10-02T08:10:37.520609Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:37.520203Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:37.520874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:37.520960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 933 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0
2025-10-02T08:10:37.521159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 933 sessionId: src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0 is DEAD
2025-10-02T08:10:37.522170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:37.522181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0] Write session will restart in 0.006623s
2025-10-02T08:10:37.522215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0] Write session: Do CDS request
2025-10-02T08:10:37.522223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:37.530457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:37.532697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:37.532716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 934
2025-10-02T08:10:37.532927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:37.532959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:37.532964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:37.532969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:37.533501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 934 sessionId:  describe result for acl check
2025-10-02T08:10:37.533528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:37.533530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:37.533532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:37.533537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533838136842858:11120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:37.534129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533838136842858:11120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:37.554108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533838136842858:11120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:37.575678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533838136842858:11120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:37.575698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533838136842858:11120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:37.575702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533838136842858:11120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:37.575711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:37.586242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:37.587030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:37.587230Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:37.587243Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:37.587254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:37.587313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:37.587356Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533838136843473:11119]
2025-10-02T08:10:37.588103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:37.589803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:37.589858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:37.590097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:37.590360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.590360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.590361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.590362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.590362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.590367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.590373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.590375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.590378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.590380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.590384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.590389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.590393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.590395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.590400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.590403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.590406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.590409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.590411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.590413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.590424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:37.601297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:37.603985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:37.604011Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:37.604013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:37.604018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:37.604027Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 933 [1:7556533838136843473:11119]
2025-10-02T08:10:37.604042Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:37.604061Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:37.604065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:37.604068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:37.604070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:37.604088Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:37.604093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:37.604100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:37.604171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.604181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.604184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:37.604187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:37.604262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:37.604271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.604288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.604307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:37.604324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533838136843466:11119]
2025-10-02T08:10:37.604327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533838136843466:11119]
2025-10-02T08:10:37.604336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:37.604350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:37.604365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:37.604367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:37.604404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533838136843466:11119]
2025-10-02T08:10:37.604413Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:37.604584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:37.604592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:37.604597Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:37.604710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 933
2025-10-02T08:10:37.604725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533838136843358:11120], now have 1 active actors on pipe
2025-10-02T08:10:37.604748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.604753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.604778Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:37.604785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:37.604789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:37.604791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:37.604818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:37.604829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:37.604850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:37.604863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533838596928863:2378], now have 1 active actors on pipe
2025-10-02T08:10:37.605045Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 933
2025-10-02T08:10:37.605185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.605195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.605219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:37.605259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 934 partition: 0 MaxSeqNo: 17 sessionId: src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0
2025-10-02T08:10:37.605719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64c6ce5-1c98bc8f-b7050218-66bffe9b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:37.608765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0] Write session: try to update token
2025-10-02T08:10:37.608785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:37.620984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533838136843497:10816]
2025-10-02T08:10:37.621904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 933, pipe: [1:7556533838136843497:10816]
2025-10-02T08:10:37.621926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533838136843497:10816], now have 1 active actors on pipe
2025-10-02T08:10:37.626853Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:37.626869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:37.626872Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:37.626881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533838136843466:11119]
2025-10-02T08:10:37.626886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533838136843466:11119]
2025-10-02T08:10:37.626940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:37.626945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.626947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:37.627086Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:37.628990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:37.628999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:37.638438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId: src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:37.642495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:37.785537Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:37.785852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.785862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.786282Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:37.786440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533838136843497:10816]
2025-10-02T08:10:37.786557Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:37.786803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:37.786847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 934 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0
2025-10-02T08:10:37.786999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 934 sessionId: src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0 is DEAD
2025-10-02T08:10:37.787394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:37.787412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0] Write session will restart in 0.009260s
2025-10-02T08:10:37.787440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0] Write session: Do CDS request
2025-10-02T08:10:37.787448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:37.798623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:37.799032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:37.799056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 935
2025-10-02T08:10:37.799188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:37.799220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:37.799227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:37.799231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:37.800102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 935 sessionId:  describe result for acl check
2025-10-02T08:10:37.800150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:37.800152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:37.800154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:37.800159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533838136843533:11127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:37.800628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533838136843533:11127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:37.807520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533838136843533:11127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:37.811643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533838136843533:11127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:37.811658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533838136843533:11127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:37.811660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533838136843533:11127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:37.811666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:37.825062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:37.839473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:37.839729Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:37.839732Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:37.839741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:37.839785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:37.839811Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533838136844166:11126]
2025-10-02T08:10:37.840249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:37.840456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:37.840486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:37.840693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:37.840717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.840718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.840719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.840719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.840720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.840724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.840731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.840733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.840735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.840737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.840742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.840746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:37.840751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.840754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:37.840756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.840760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:37.840762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.840765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.840768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.840771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.840782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:37.850992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:37.852883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:37.852891Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:37.852894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:37.852900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:37.852907Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 934 [1:7556533838136844166:11126]
2025-10-02T08:10:37.852920Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:37.852939Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:37.852942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:37.852945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:37.852947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:37.852974Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:37.852979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:37.852986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:37.853054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.853055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.853058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:37.853061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:37.853134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:37.853136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.853151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:37.853163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:37.853179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533838136844147:11126]
2025-10-02T08:10:37.853181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533838136844147:11126]
2025-10-02T08:10:37.853194Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:37.853208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:37.853222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:37.853227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:37.853259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533838136844147:11126]
2025-10-02T08:10:37.853261Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:37.855156Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 934
2025-10-02T08:10:37.854920Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:37.854931Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:37.854938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:37.854945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533838596928883:2378], now have 1 active actors on pipe
2025-10-02T08:10:37.855107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 934
2025-10-02T08:10:37.855114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533838136843934:11127], now have 1 active actors on pipe
2025-10-02T08:10:37.855123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.855128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.855168Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:37.855176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:37.855181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:37.855183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:37.855193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:37.855207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:37.855226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:37.855329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:37.855331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:37.855351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:37.855382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 935 partition: 0 MaxSeqNo: 17 sessionId: src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0
2025-10-02T08:10:37.856322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7137fa7-2932e3bb-d15b7bf7-386fea23_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:37.859825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0] Write session: try to update token
2025-10-02T08:10:37.859855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:37.882174Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:37.882194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:37.882197Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:37.882205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533838136844147:11126]
2025-10-02T08:10:37.882210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533838136844147:11126]
2025-10-02T08:10:37.882256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:37.882263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:37.882268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:37.882319Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:37.882333Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:37.882417Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:37.888326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533838136844190:10816]
2025-10-02T08:10:37.888476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 934, pipe: [1:7556533838136844190:10816]
2025-10-02T08:10:37.890493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId: src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:37.893502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:38.036109Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:38.036661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533838136844190:10816], now have 1 active actors on pipe
2025-10-02T08:10:38.036673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.036678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.036940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:38.036944Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:38.036945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:38.037040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 935 reason: error at write: Disconnected sessionId: src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0
2025-10-02T08:10:38.037308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 935 sessionId: src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0 is DEAD
2025-10-02T08:10:38.037494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533838136844190:10816]
2025-10-02T08:10:38.038637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:38.038648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0] Write session will restart in 0.006560s
2025-10-02T08:10:38.038678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0] Write session: Do CDS request
2025-10-02T08:10:38.038687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:38.037643Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:38.049390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:38.053784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:38.053799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 936
2025-10-02T08:10:38.054162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:38.054197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:38.054202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:38.054206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:38.055672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 936 sessionId:  describe result for acl check
2025-10-02T08:10:38.055716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:38.055722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:38.055724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:38.055729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533842431811785:11134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:38.056291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533842431811785:11134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:38.059702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533842431811785:11134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:38.075212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533842431811785:11134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:38.075230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533842431811785:11134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:38.075234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533842431811785:11134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:38.075244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:38.079849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:38.080299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:38.080478Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:38.080490Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:38.080500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:38.080545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:38.080584Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533842431812143:11133]
2025-10-02T08:10:38.081152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:38.083175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:38.083233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:38.083520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:38.083569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.083574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.083576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.083577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.083578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.083584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.083594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.083598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.083602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.083607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.083613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.083620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.083641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.083649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.083657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.083662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.083667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.083672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.083677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.083681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.083704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:38.093064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:38.094897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:38.094916Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:38.094919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:38.094924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:38.094931Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 935 [1:7556533842431812143:11133]
2025-10-02T08:10:38.094949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:38.094970Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:38.094978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.094981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.094983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.095000Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:38.095017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:38.095027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:38.095091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.095098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.095102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:38.095105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:38.095172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:38.095182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.095195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.095208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:38.095230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533842431812097:11134], now have 1 active actors on pipe
2025-10-02T08:10:38.095241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533842431812137:11133]
2025-10-02T08:10:38.095248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533842431812137:11133]
2025-10-02T08:10:38.095256Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:38.095273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:38.095272Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:38.095276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:38.095292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:38.095300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:38.095307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533842891896188:2378], now have 1 active actors on pipe
2025-10-02T08:10:38.095335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 935
2025-10-02T08:10:38.095342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533842431812137:11133]
2025-10-02T08:10:38.095345Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:38.095361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:38.095368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.095373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.095399Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:38.095410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.095419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.095425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:38.095435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.095447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:38.095466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:38.095502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.095512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.095535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:38.095585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 936 partition: 0 MaxSeqNo: 17 sessionId: src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0
2025-10-02T08:10:38.097113Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 935
2025-10-02T08:10:38.101104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d50717b-371ab0e8-85d4236-3edcd28c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:38.103995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0] Write session: try to update token
2025-10-02T08:10:38.104011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:38.117657Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:38.117676Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:38.117683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533842431812137:11133]
2025-10-02T08:10:38.117725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:38.117905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:38.118053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:38.118197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:38.118344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:38.119129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:38.119180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:38.119251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:38.134905Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:38.134923Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:38.134925Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:38.134934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533842431812137:11133]
2025-10-02T08:10:38.134936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533842431812137:11133]
2025-10-02T08:10:38.134979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:38.134986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.134988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:38.135131Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:38.135157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:38.135172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:38.137696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533842431812169:10816]
2025-10-02T08:10:38.137819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 935, pipe: [1:7556533842431812169:10816]
2025-10-02T08:10:38.150754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId: src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:38.154043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:38.288872Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:38.289216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:38.289227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0] Write session will restart in 0.009016s
2025-10-02T08:10:38.289255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0] Write session: Do CDS request
2025-10-02T08:10:38.289262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:38.287770Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:38.288298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533842431812169:10816], now have 1 active actors on pipe
2025-10-02T08:10:38.288308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.288313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.288497Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:38.288848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533842431812169:10816]
2025-10-02T08:10:38.288864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:38.288910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 936 reason: status is not ok: tablet will be restarted right now sessionId: src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0
2025-10-02T08:10:38.289072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 936 sessionId: src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0 is DEAD
2025-10-02T08:10:38.301403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:38.304981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:38.304998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 937
2025-10-02T08:10:38.307407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:38.307446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:38.307452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:38.307456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:38.308097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 937 sessionId:  describe result for acl check
2025-10-02T08:10:38.308121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:38.308123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:38.308124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:38.308129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533842431812611:11147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:38.309061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533842431812611:11147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:38.319962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533842431812611:11147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:38.329974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533842431812611:11147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:38.329993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533842431812611:11147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:38.329996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533842431812611:11147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:38.330006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:38.346413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:38.347276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:38.347460Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:38.347464Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:38.347475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:38.347523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:38.347556Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533842431812857:11146]
2025-10-02T08:10:38.348213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:38.348414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:38.348454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:38.348736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:38.348772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.348773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.348775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.348776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.348777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.348782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.348790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.348794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.348798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.348819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.348824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.348831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.348836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.348841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.348845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.348851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.348854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.348860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.348864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.348869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.348887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:38.374105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:38.375928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:38.375937Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:38.375940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:38.375945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:38.375954Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 936 [1:7556533842431812857:11146]
2025-10-02T08:10:38.375968Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:38.375987Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:38.375990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.375994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.375996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.376013Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:38.376019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:38.376025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:38.376093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.376096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.376100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:38.376102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:38.376185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:38.376188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.376203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.376215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:38.376233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533842431812851:11146]
2025-10-02T08:10:38.376235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533842431812851:11146]
2025-10-02T08:10:38.376242Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:38.376256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533842431812695:11147], now have 1 active actors on pipe
2025-10-02T08:10:38.376262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:38.376263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:38.376266Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:38.376278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:38.376280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:38.376286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533842891896195:2378], now have 1 active actors on pipe
2025-10-02T08:10:38.376318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533842431812851:11146]
2025-10-02T08:10:38.376327Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:38.376332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:38.376369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 936
2025-10-02T08:10:38.376896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.376905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.376933Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:38.376943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.376947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.376949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:38.376963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.376974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:38.376993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:38.377836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c6e49-fb24c661-f4ffd05b-d1d022ca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:38.380747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0] Write session: try to update token
2025-10-02T08:10:38.380769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:38.377328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.377341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.377358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:38.377391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 937 partition: 0 MaxSeqNo: 17 sessionId: src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0
2025-10-02T08:10:38.380975Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 936
2025-10-02T08:10:38.390433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533842431812886:10816]
2025-10-02T08:10:38.390663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 936, pipe: [1:7556533842431812886:10816]
2025-10-02T08:10:38.390685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533842431812886:10816], now have 1 active actors on pipe
2025-10-02T08:10:38.402537Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:38.402562Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:38.402564Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:38.402574Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533842431812851:11146]
2025-10-02T08:10:38.402578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533842431812851:11146]
2025-10-02T08:10:38.402628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:38.402640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.402642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:38.402805Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:38.403694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId: src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:38.404935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:38.404953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:38.407667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:38.552724Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:38.551774Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:38.552285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.552296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.554338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:38.554349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0] Write session will restart in 0.008972s
2025-10-02T08:10:38.554373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0] Write session: Do CDS request
2025-10-02T08:10:38.554380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:38.553366Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:38.553944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:38.553997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 937 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0
2025-10-02T08:10:38.554190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 937 sessionId: src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0 is DEAD
2025-10-02T08:10:38.554334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533842431812886:10816]
2025-10-02T08:10:38.564477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:38.566748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:38.566763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 938
2025-10-02T08:10:38.567014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:38.567053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:38.567057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:38.567060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:38.567702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 938 sessionId:  describe result for acl check
2025-10-02T08:10:38.567738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:38.567739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:38.567741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:38.567746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533842431813169:11159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:38.568213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533842431813169:11159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:38.590190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:38.593518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:38.593825Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:38.593828Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:38.593836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:38.593894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:38.593921Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533842431813538:11158]
2025-10-02T08:10:38.594352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:38.594909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533842431813169:11159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:38.594979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:38.595007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:38.595217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:38.595242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.595243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.595244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.595244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.595245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.595248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.595255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.595257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.595259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.595261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.595266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.595272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.595275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.595280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.595282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.595285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.595288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.595291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.595293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.595296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.595309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:38.608327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 937
2025-10-02T08:10:38.606086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:38.607695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:38.607702Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:38.607706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:38.607710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:38.607718Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 937 [1:7556533842431813538:11158]
2025-10-02T08:10:38.607731Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:38.607750Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:38.607753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.607756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.607758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.607774Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:38.607779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:38.607787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:38.607852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.607854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.607857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:38.607860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:38.607924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:38.607927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.607941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.607951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:38.607968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533842431813527:11158]
2025-10-02T08:10:38.607969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533842431813527:11158]
2025-10-02T08:10:38.607976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:38.607991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533842891896226:2378], now have 1 active actors on pipe
2025-10-02T08:10:38.607990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:38.607994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:38.607998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:38.608011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:38.608013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:38.608047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533842431813527:11158]
2025-10-02T08:10:38.608058Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:38.608075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:38.612448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ce4922-ab2a07e1-5a6a7c1d-86a815fc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:38.611450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533842431813169:11159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:38.611466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533842431813169:11159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:38.611470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533842431813169:11159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:38.611478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:38.611773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 937
2025-10-02T08:10:38.611785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533842431813574:11159], now have 1 active actors on pipe
2025-10-02T08:10:38.611793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.611799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.611825Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:38.611834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.611838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.611842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:38.611852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.611867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:38.611883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:38.611956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.611965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.611993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:38.612044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 938 partition: 0 MaxSeqNo: 17 sessionId: src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0
2025-10-02T08:10:38.615234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0] Write session: try to update token
2025-10-02T08:10:38.615250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:38.620525Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:38.620539Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:38.620546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533842431813527:11158]
2025-10-02T08:10:38.620577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:38.620591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:38.620757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:38.620934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:38.621093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:38.621251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:38.621444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:38.621477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:38.633382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId: src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:38.636028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:38.636107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.636119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.636155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:38.636177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:38.636234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.636237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.636398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.636458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.636521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.636581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.636623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.636628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.636699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.636759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.636882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.636986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.637033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.637036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.637109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.637169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.637229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.637292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.637334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.637337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.637411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.637469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.637531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.637595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.637638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.637641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.637710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.637768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.637831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.637896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.637939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.637942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.638010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.638073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.638149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.638209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.638257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.638260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.638331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.638392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.638458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.638522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.638566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.638569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.638639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.638700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.638762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.638827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.638870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.638872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.638939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.638996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.639056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.639121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.639169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.639172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.639252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:38.639314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:38.639387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:38.639453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:38.639519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:38.639522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:38.639586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:38.639693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.639719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.639722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:38.639764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:38.639780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:38.639785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:38.639790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:38.639794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:38.640546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:38.640568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:38.640577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:38.640580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:38.640584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:38.640586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:38.649964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:38.650010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:38.650023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:38.650027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:38.650030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:38.650035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:38.650588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:38.650607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:38.650614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:38.650618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:38.650621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:38.656869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533842431813581:10816]
2025-10-02T08:10:38.657103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 937, pipe: [1:7556533842431813581:10816]
2025-10-02T08:10:38.657602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:38.657628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:38.657644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392638656
2025-10-02T08:10:38.658091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:38.658109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:38.658117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:38.658121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:38.658126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:38.658129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:38.658634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:38.658651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:38.658658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:38.658662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:38.658666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:38.658670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:38.659320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:38.659338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:38.659346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:38.659349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:38.659353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:38.659357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:38.659870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:38.659887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:38.659893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:38.661345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:38.661381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:38.661390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:38.661399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:38.661413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392638661
2025-10-02T08:10:38.661836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:38.661850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:38.661857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:38.661860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:38.661864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:38.661867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:38.662369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:38.662384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:38.662389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:38.662393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:38.662396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:38.662400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:38.662942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:38.662953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.663098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392638662
2025-10-02T08:10:38.669127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533842431813581:10816], now have 1 active actors on pipe
2025-10-02T08:10:38.669150Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:38.669167Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:38.669175Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:38.669186Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:38.669199Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:38.669201Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:38.669204Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:38.669212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533842431813527:11158]
2025-10-02T08:10:38.669215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533842431813527:11158]
2025-10-02T08:10:38.669293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:38.669301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.669303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:38.669444Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:38.672952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:38.672965Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:38.826039Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:38.826614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:38.826625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:38.826649Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:38.826657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 938 reason: error at write: Disconnected sessionId: src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0
2025-10-02T08:10:38.826831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 938 sessionId: src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0 is DEAD
2025-10-02T08:10:38.826987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:38.826998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0] Write session will restart in 0.006166s
2025-10-02T08:10:38.827023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0] Write session: Do CDS request
2025-10-02T08:10:38.827029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:38.827017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533842431813581:10816]
2025-10-02T08:10:38.827107Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:38.831473Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2fbd0a4a387876c3] Result# TEvPutResult {Id# [72075186224037892:937:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:38.831730Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:937:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:38.831851Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:937:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:38.834758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:38.834867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:38.834881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 939
2025-10-02T08:10:38.834993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:38.835024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:38.835032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:38.835036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:38.835416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 939 sessionId:  describe result for acl check
2025-10-02T08:10:38.835451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:38.835456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:38.835458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:38.835463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533842431813638:11167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:38.835955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533842431813638:11167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:38.841572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533842431813638:11167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:38.845238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533842431813638:11167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:38.845257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533842431813638:11167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:38.845261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533842431813638:11167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:38.845270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:38.856245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:38.859718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:38.859976Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:38.859988Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:38.859998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:38.860053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:38.860105Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533842431814261:11165]
2025-10-02T08:10:38.860770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:38.861017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:38.861063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:38.861374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:38.861423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.861424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.861425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.861426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.861428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.861432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.861443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.861452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.861457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.861460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.861465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.861472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:38.861482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.861488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:38.861497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.861502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:38.861510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.861514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.861518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.861523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.861546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:38.871811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:38.873668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:38.873686Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:38.873689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:38.873693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:38.873700Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 938 [1:7556533842431814261:11165]
2025-10-02T08:10:38.873712Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:38.873734Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:38.873742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.873745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.873747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.873764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:38.873774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:38.873781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:38.873850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.873857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.873860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:38.873862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:38.873926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:38.873933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.873946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:38.873959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:38.873980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533842431813961:11167], now have 1 active actors on pipe
2025-10-02T08:10:38.873991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533842431814255:11165]
2025-10-02T08:10:38.873997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533842431814255:11165]
2025-10-02T08:10:38.873996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 938
2025-10-02T08:10:38.874004Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:38.874015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:38.874017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:38.874019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:38.874031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:38.874034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:38.874039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533842891896246:2378], now have 1 active actors on pipe
2025-10-02T08:10:38.874044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.874054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.874099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533842431814255:11165]
2025-10-02T08:10:38.874108Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:38.874115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:38.874123Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:38.874130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:38.874139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:38.874142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:38.874151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:38.874159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:38.874203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:38.874320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:38.874328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:38.874341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:38.874383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 939 partition: 0 MaxSeqNo: 17 sessionId: src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0
2025-10-02T08:10:38.874807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3da29f9-1d9c6a26-57b0ea5d-4b8855ad_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:38.876952Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 938
2025-10-02T08:10:38.877592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0] Write session: try to update token
2025-10-02T08:10:38.877606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:38.898756Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:38.898788Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:38.898791Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:38.898799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533842431814255:11165]
2025-10-02T08:10:38.898805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533842431814255:11165]
2025-10-02T08:10:38.898850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:38.898855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:38.898860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:38.898861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:38.898864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:38.898999Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:38.901975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId: src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:38.905454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:38.927231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533842431814285:10816]
2025-10-02T08:10:38.927537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 938, pipe: [1:7556533842431814285:10816]
2025-10-02T08:10:39.054131Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:39.055109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.055129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.055174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533842431814285:10816], now have 1 active actors on pipe
2025-10-02T08:10:39.055680Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:39.056095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533842431814285:10816]
2025-10-02T08:10:39.056118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:39.056180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 939 reason: status is not ok: tablet will be restarted right now sessionId: src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0
2025-10-02T08:10:39.056383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 939 sessionId: src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0 is DEAD
2025-10-02T08:10:39.055869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:39.056914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:39.056924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0] Write session will restart in 0.007936s
2025-10-02T08:10:39.056951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0] Write session: Do CDS request
2025-10-02T08:10:39.056959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:39.069452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:39.070596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:39.070621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 940
2025-10-02T08:10:39.072044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:39.072111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:39.072118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:39.072124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:39.073311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 940 sessionId:  describe result for acl check
2025-10-02T08:10:39.073361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:39.073369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:39.073371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:39.073377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533846726781900:11174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:39.074044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533846726781900:11174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:39.085582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533846726781900:11174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:39.099144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:39.108032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:39.108293Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:39.108298Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:39.108308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:39.108367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:39.108406Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533846726782242:11172]
2025-10-02T08:10:39.109270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:39.109617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:39.109665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:39.109726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533846726781900:11174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:39.109734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533846726781900:11174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:39.109738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533846726781900:11174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:39.109748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:39.109984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:39.110030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.110032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.110033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.110034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.110036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.110041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.110052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.110056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.110060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.110064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.110070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.110077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.110083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.110089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.110093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.110098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.110102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.110108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.110112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.110117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.110136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:39.126704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:39.131084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:39.131102Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:39.131105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:39.131109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:39.131116Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 939 [1:7556533846726782242:11172]
2025-10-02T08:10:39.131129Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:39.131148Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:39.131152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.131155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.131157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.131175Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:39.131180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:39.131188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:39.131261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.131263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.131266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:39.131269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:39.131339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:39.131342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.131357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.131369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:39.131386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533846726782236:11172]
2025-10-02T08:10:39.131388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533846726782236:11172]
2025-10-02T08:10:39.131405Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:39.131418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:39.131433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:39.131435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:39.131469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533846726782236:11172]
2025-10-02T08:10:39.131472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:39.131478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:39.131482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:39.131486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:39.131542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 939
2025-10-02T08:10:39.131553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533846726782253:11174], now have 1 active actors on pipe
2025-10-02T08:10:39.131816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.131825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.131839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533847186863551:2378], now have 1 active actors on pipe
2025-10-02T08:10:39.131854Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:39.131860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.131864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.131866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:39.131875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.131885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:39.131903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:39.131926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.131927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.131941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:39.132179Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 939
2025-10-02T08:10:39.131973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 940 partition: 0 MaxSeqNo: 17 sessionId: src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0
2025-10-02T08:10:39.132495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|623f8249-72f9e7cb-9a645230-24ff17f3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:39.135222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0] Write session: try to update token
2025-10-02T08:10:39.135240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:39.156311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533846726782270:10816]
2025-10-02T08:10:39.156350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId: src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:39.159361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:39.159789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.159804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.159840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:39.159856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:39.160009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.160015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.160199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.160297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.160369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.160436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.160631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.160635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.160714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.160787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.160876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.160881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 939, pipe: [1:7556533846726782270:10816]
2025-10-02T08:10:39.160954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.161001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.161004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.161080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.161142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.161213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.161292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.161347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.161350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.161437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.161498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.161569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.161631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.161677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.161680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.161757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.161820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.161890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.161962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.162009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.162011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.162096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.162178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.162264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.162349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.162428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.162432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.162565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.162645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.162738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.162836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.162912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.162916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.163042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.163136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.163223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.163370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.163436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.163439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.163521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.163587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.163669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.163774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.163853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.163858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.164032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:39.164174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:39.164323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:39.164483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:39.164565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:39.164570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:39.164635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533846726782270:10816], now have 1 active actors on pipe
2025-10-02T08:10:39.164646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:39.164743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.164768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.164771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:39.165196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:39.165225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:39.165229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:39.165232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:39.165236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:39.165983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:39.166009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:39.166020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:39.166023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:39.166026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:39.166029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:39.167379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:39.167401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:39.167408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:39.167411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:39.167415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:39.167421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:39.168038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:39.168058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:39.168063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:39.168067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:39.168071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:39.171483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:39.171512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:39.171528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392639171
2025-10-02T08:10:39.171755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:39.171767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:39.171776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:39.171779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:39.171783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:39.171787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:39.172306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:39.172325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:39.172332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:39.172338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:39.172341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:39.172345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:39.174346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:39.174377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:39.174390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:39.174395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:39.174400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:39.174404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:39.174972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:39.174984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:39.174988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:39.176199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:39.176206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:39.176214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:39.176218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:39.176225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392639171
2025-10-02T08:10:39.176505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:39.176515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:39.176522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:39.176524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:39.176528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:39.176530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:39.177031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:39.177045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:39.177051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:39.177055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:39.177058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:39.177063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:39.177603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:39.177618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.177734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392639176
2025-10-02T08:10:39.178636Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:39.178650Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:39.178656Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:39.178664Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:39.180343Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:39.180362Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:39.180364Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:39.180375Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533846726782236:11172]
2025-10-02T08:10:39.180382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533846726782236:11172]
2025-10-02T08:10:39.180422Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:39.180430Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:39.180673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:39.180683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.180686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:39.180848Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:39.360002Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:39.361191Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:39.361271Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:39.361535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533846726782270:10816]
2025-10-02T08:10:39.361561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:39.361588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 940 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0
2025-10-02T08:10:39.361951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:39.361958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0] Write session will restart in 0.006045s
2025-10-02T08:10:39.361993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0] Write session: Do CDS request
2025-10-02T08:10:39.361999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:39.361767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 940 sessionId: src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0 is DEAD
2025-10-02T08:10:39.374169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:39.374578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:39.374594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 941
2025-10-02T08:10:39.374768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:39.374801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:39.374806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:39.374809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:39.375291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 941 sessionId:  describe result for acl check
2025-10-02T08:10:39.375322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:39.375325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:39.375327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:39.375333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533846726782591:11186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:39.375879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533846726782591:11186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:39.378682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533846726782591:11186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:39.397535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:39.398053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:39.398578Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:39.398583Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:39.398597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:39.398662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:39.398698Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533846726782969:11185]
2025-10-02T08:10:39.399423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:39.399448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533846726782591:11186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:39.399457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533846726782591:11186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:39.399460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533846726782591:11186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:39.399469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:39.399843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:39.399894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:39.400235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:39.400281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.400282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.400283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.400284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.400285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.400290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.400300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.400303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.400307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.400311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.400316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.400323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.400329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.400334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.400337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.400342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.400346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.400350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.400355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.400360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.400379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:39.426645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:39.429527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:39.429546Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:39.429549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:39.429553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:39.429559Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 940 [1:7556533846726782969:11185]
2025-10-02T08:10:39.429572Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:39.429590Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:39.429593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.429596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.429598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.429615Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:39.429621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:39.429628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:39.429696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.429698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.429701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:39.429703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:39.429772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:39.429775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.429789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.429801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:39.429817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533846726782963:11185]
2025-10-02T08:10:39.429819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533846726782963:11185]
2025-10-02T08:10:39.429825Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:39.429838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:39.429850Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:39.429851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:39.429854Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:39.429854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:39.429865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533846726782975:11186], now have 1 active actors on pipe
2025-10-02T08:10:39.429898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533846726782963:11185]
2025-10-02T08:10:39.429901Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:39.429992Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:39.430126Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 940
2025-10-02T08:10:39.431708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbb9258-66df2b7f-af7fbd3a-9037a681_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:39.430608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 940
2025-10-02T08:10:39.430622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533847186863562:2378], now have 1 active actors on pipe
2025-10-02T08:10:39.430635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.430639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.430664Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:39.430670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.430673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.430675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:39.430684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.430694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:39.430712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:39.431258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.431263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.431284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:39.431334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 941 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0
2025-10-02T08:10:39.434801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0] Write session: try to update token
2025-10-02T08:10:39.434818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:39.461735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533846726783010:10816]
2025-10-02T08:10:39.461905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 940, pipe: [1:7556533846726783010:10816]
2025-10-02T08:10:39.467872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533846726783010:10816], now have 1 active actors on pipe
2025-10-02T08:10:39.467894Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:39.467897Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:39.467900Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:39.467908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533846726782963:11185]
2025-10-02T08:10:39.467913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533846726782963:11185]
2025-10-02T08:10:39.467959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:39.467960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:39.467966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:39.467966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.467969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:39.468123Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:39.473443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId: src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:39.486654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:39.621453Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:39.621971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.621989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.623677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533846726783010:10816]
2025-10-02T08:10:39.623698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:39.623701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:39.623754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 941 reason: error at write: Disconnected sessionId: src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0
2025-10-02T08:10:39.623949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 941 sessionId: src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0 is DEAD
2025-10-02T08:10:39.623981Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:39.624113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:39.624120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0] Write session will restart in 0.006493s
2025-10-02T08:10:39.624144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0] Write session: Do CDS request
2025-10-02T08:10:39.624152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:39.624395Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:39.631405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:39.632680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:39.632696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 942
2025-10-02T08:10:39.632902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:39.632937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:39.632947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:39.632951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:39.633347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 942 sessionId:  describe result for acl check
2025-10-02T08:10:39.633376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:39.633378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:39.633380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:39.633386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533846726783057:11201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:39.633913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533846726783057:11201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:39.647572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533846726783057:11201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:39.654043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533846726783057:11201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:39.654060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533846726783057:11201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:39.654063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533846726783057:11201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:39.654072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:39.665203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:39.665620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:39.665769Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:39.665772Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:39.665779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:39.665812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:39.665838Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533846726783688:11200]
2025-10-02T08:10:39.666298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:39.666484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:39.666515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:39.666728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:39.666757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.666757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.666758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.666759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.666759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.666763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.666770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.666772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.666774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.666776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.666780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.666784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.666789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.666792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.666794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.666797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.666800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.666804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.666807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.666810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.666828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:39.681184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:39.683412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:39.683418Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:39.683421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:39.683424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:39.683431Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 941 [1:7556533846726783688:11200]
2025-10-02T08:10:39.683445Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:39.683462Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:39.683465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.683467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.683469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.683485Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:39.683490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:39.683496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:39.683565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.683567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.683570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:39.683572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:39.683659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:39.683661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.683675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.683687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:39.683704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533846726783682:11200]
2025-10-02T08:10:39.683707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533846726783682:11200]
2025-10-02T08:10:39.683715Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:39.683727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:39.683744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:39.683746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:39.683755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533846726783528:11201], now have 1 active actors on pipe
2025-10-02T08:10:39.683754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:39.683758Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:39.683788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533846726783682:11200]
2025-10-02T08:10:39.683791Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:39.683796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533847186863589:2378], now have 1 active actors on pipe
2025-10-02T08:10:39.683839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 941
2025-10-02T08:10:39.683916Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:39.684462Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 941
2025-10-02T08:10:39.685622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6364294-f64f5db0-7560e8e4-9d2b0c88_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:39.688610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0] Write session: try to update token
2025-10-02T08:10:39.688626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:39.684642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.684655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.684682Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:39.684692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.684696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.684699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:39.684710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.684722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:39.684740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:39.685133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.685141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.685174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:39.685214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 942 partition: 0 MaxSeqNo: 17 sessionId: src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0
2025-10-02T08:10:39.710832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId: src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:39.711337Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:39.711353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:39.711355Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:39.711364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533846726783682:11200]
2025-10-02T08:10:39.711368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533846726783682:11200]
2025-10-02T08:10:39.711417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:39.711423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.711425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:39.711577Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:39.712942Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:39.712961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:39.714723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:39.724187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533846726783713:10816]
2025-10-02T08:10:39.726477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 941, pipe: [1:7556533846726783713:10816]
2025-10-02T08:10:39.866396Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:39.866677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.866692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.866730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533846726783713:10816], now have 1 active actors on pipe
2025-10-02T08:10:39.866879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:39.866889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:39.866950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 942 reason: error at write: Disconnected sessionId: src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0
2025-10-02T08:10:39.866976Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:39.867037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:39.867135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 942 sessionId: src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0 is DEAD
2025-10-02T08:10:39.867280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:39.867287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0] Write session will restart in 0.007238s
2025-10-02T08:10:39.867309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0] Write session: Do CDS request
2025-10-02T08:10:39.867323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:39.867287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533846726783713:10816]
2025-10-02T08:10:39.875301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:39.875389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:39.875403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 943
2025-10-02T08:10:39.875565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:39.875594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:39.875601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:39.875604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:39.875940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 943 sessionId:  describe result for acl check
2025-10-02T08:10:39.875967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:39.875968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:39.875969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:39.875973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533846726784073:11208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:39.876349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533846726784073:11208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:39.879262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533846726784073:11208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:39.882592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533846726784073:11208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:39.882608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533846726784073:11208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:39.882611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533846726784073:11208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:39.882620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:39.888747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:39.889257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:39.889449Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:39.889460Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:39.889471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:39.889516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:39.889555Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533846726784395:11207]
2025-10-02T08:10:39.890181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:39.890361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:39.890400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:39.890684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:39.890725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.890731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.890732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.890733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.890734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.890738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.890748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.890752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.890755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.890758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.890763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.890770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:39.890779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.890783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:39.890792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.890801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:39.890805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.890814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.890822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.890831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.890851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:39.899316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:39.901122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:39.901137Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:39.901140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:39.901144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:39.901150Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 942 [1:7556533846726784395:11207]
2025-10-02T08:10:39.901163Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:39.901181Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:39.901183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.901186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.901193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.901208Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:39.901217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:39.901229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:39.901296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.901304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.901306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:39.901309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:39.901370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:39.901377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.901388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:39.901403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:39.901420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533847186863609:2378], now have 1 active actors on pipe
2025-10-02T08:10:39.901430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533846726784389:11207]
2025-10-02T08:10:39.901432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533846726784389:11207]
2025-10-02T08:10:39.901442Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:39.901457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:39.901466Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:39.901469Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:39.901473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 942
2025-10-02T08:10:39.901477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:39.901479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:39.901485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533846726784341:11208], now have 1 active actors on pipe
2025-10-02T08:10:39.901515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.901522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.901534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533846726784389:11207]
2025-10-02T08:10:39.901545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:39.901556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:39.901572Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|957f4cba-f7cac162-f8f61105-90e812a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:39.901581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:39.901553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 942
2025-10-02T08:10:39.901586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:39.901588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:39.901595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:39.901603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:39.901622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:39.901674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:39.901680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:39.901691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:39.901727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 943 partition: 0 MaxSeqNo: 17 sessionId: src_id|957f4cba-f7cac162-f8f61105-90e812a1_0
2025-10-02T08:10:39.902073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f870d489-779b4135-1f70d5dd-ea61d9d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|957f4cba-f7cac162-f8f61105-90e812a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:39.904738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957f4cba-f7cac162-f8f61105-90e812a1_0] Write session: try to update token
2025-10-02T08:10:39.904755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957f4cba-f7cac162-f8f61105-90e812a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:39.918757Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:39.918774Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:39.918777Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:39.918785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533846726784389:11207]
2025-10-02T08:10:39.918789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533846726784389:11207]
2025-10-02T08:10:39.918832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:39.918839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:39.918841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:39.918862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:39.918875Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:39.918983Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:39.919259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId: src_id|957f4cba-f7cac162-f8f61105-90e812a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:39.922082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:39.967574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533846726784420:10816]
2025-10-02T08:10:39.967709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 942, pipe: [1:7556533846726784420:10816]
2025-10-02T08:10:40.062919Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:40.063693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.063709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.063751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533846726784420:10816], now have 1 active actors on pipe
2025-10-02T08:10:40.064327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957f4cba-f7cac162-f8f61105-90e812a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:40.064338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957f4cba-f7cac162-f8f61105-90e812a1_0] Write session will restart in 0.008637s
2025-10-02T08:10:40.063873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533846726784420:10816]
2025-10-02T08:10:40.063899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:40.064363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957f4cba-f7cac162-f8f61105-90e812a1_0] Write session: Do CDS request
2025-10-02T08:10:40.063902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:40.063972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 943 reason: error at write: Disconnected sessionId: src_id|957f4cba-f7cac162-f8f61105-90e812a1_0
2025-10-02T08:10:40.064374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957f4cba-f7cac162-f8f61105-90e812a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:40.064019Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:40.064146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 943 sessionId: src_id|957f4cba-f7cac162-f8f61105-90e812a1_0 is DEAD
2025-10-02T08:10:40.064286Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:40.074361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957f4cba-f7cac162-f8f61105-90e812a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.074535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:40.074555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 944
2025-10-02T08:10:40.074698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.074731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:40.074739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:40.074748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:40.075191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 944 sessionId:  describe result for acl check
2025-10-02T08:10:40.075234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:40.075240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:40.075242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:40.075247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533851021752019:11215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:40.075910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533851021752019:11215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:40.079361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533851021752019:11215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:40.082449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533851021752019:11215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:40.082467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533851021752019:11215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:40.082471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533851021752019:11215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:40.082481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:40.094910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:40.095405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:40.095590Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:40.095600Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:40.095610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:40.095670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:40.095707Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533851021752389:11213]
2025-10-02T08:10:40.096378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:40.096575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:40.096614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:40.096938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:40.097002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.097009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.097011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.097012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.097013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.097019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.097030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.097034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.097046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.097050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.097056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.097068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.097073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.097078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.097083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.097089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.097094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.097099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.097104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.097109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.097130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:40.105497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:40.107261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:40.107276Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:40.107278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:40.107281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:40.107286Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 943 [1:7556533851021752389:11213]
2025-10-02T08:10:40.107295Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:40.107312Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:40.107315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.107318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.107320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.107336Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:40.107346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:40.107353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:40.107402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.107408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.107410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:40.107412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:40.107466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:40.107473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.107485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.107499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:40.107523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021752232:11215], now have 1 active actors on pipe
2025-10-02T08:10:40.107533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533851021752383:11213]
2025-10-02T08:10:40.107533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 943
2025-10-02T08:10:40.107537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533851021752383:11213]
2025-10-02T08:10:40.107544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:40.107551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533851481830914:2378], now have 1 active actors on pipe
2025-10-02T08:10:40.107554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:40.107557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:40.107558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:40.107570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:40.107577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:40.107584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.107588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.107631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533851021752383:11213]
2025-10-02T08:10:40.107647Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:40.107619Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 943
2025-10-02T08:10:40.107656Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:40.107663Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:40.107670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.107674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.107676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:40.107684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.107693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:40.107735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.107778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.107785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.107798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.107840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 944 partition: 0 MaxSeqNo: 17 sessionId: src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0
2025-10-02T08:10:40.108164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957f4cba-f7cac162-f8f61105-90e812a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:40.110708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0] Write session: try to update token
2025-10-02T08:10:40.110727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:40.126413Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:40.126441Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:40.126444Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:40.126454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533851021752383:11213]
2025-10-02T08:10:40.126458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533851021752383:11213]
2025-10-02T08:10:40.126505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:40.126515Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:40.126518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.126521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:40.126522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:40.126685Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:40.128704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId: src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:40.131621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:40.168984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533851021752414:10816]
2025-10-02T08:10:40.169135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 943, pipe: [1:7556533851021752414:10816]
2025-10-02T08:10:40.281891Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:40.282636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.282646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.282686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021752414:10816], now have 1 active actors on pipe
2025-10-02T08:10:40.283094Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:40.283060Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:40.283381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:40.283427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 944 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0
2025-10-02T08:10:40.283583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 944 sessionId: src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0 is DEAD
2025-10-02T08:10:40.283656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533851021752414:10816]
2025-10-02T08:10:40.285329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:40.285341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0] Write session will restart in 0.005513s
2025-10-02T08:10:40.285370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0] Write session: Do CDS request
2025-10-02T08:10:40.285378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:40.293241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.295652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:40.295668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 945
2025-10-02T08:10:40.295848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.295889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:40.295895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:40.295899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:40.297048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 945 sessionId:  describe result for acl check
2025-10-02T08:10:40.297084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:40.297086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:40.297088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:40.297094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533851021752663:11221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:40.297615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533851021752663:11221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:40.306678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533851021752663:11221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:40.316074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533851021752663:11221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:40.316094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533851021752663:11221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:40.316097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533851021752663:11221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:40.316106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:40.328012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:40.331118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:40.331299Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:40.331307Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:40.331314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:40.331352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:40.331384Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533851021753088:11220]
2025-10-02T08:10:40.331833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:40.332046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:40.332087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:40.332356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:40.332413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.332419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.332421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.332422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.332423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.332431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.332441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.332445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.332449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.332452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.332458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.332464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.332469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.332475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.332479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.332485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.332494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.332499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.332508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.332517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.332535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:40.341336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:40.343394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:40.343408Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:40.343410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:40.343413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:40.343418Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 944 [1:7556533851021753088:11220]
2025-10-02T08:10:40.343430Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:40.343448Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:40.343450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.343452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.343453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.343465Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:40.343468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:40.343473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:40.343526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.343532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.343534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:40.343536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:40.343584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:40.343591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.343599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.343606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:40.343619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533851481830921:2378], now have 1 active actors on pipe
2025-10-02T08:10:40.343623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533851021753082:11220]
2025-10-02T08:10:40.343626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533851021753082:11220]
2025-10-02T08:10:40.343631Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:40.343653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:40.343656Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:40.343659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:40.343665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:40.343668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:40.343672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021752765:11221], now have 1 active actors on pipe
2025-10-02T08:10:40.343682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 944
2025-10-02T08:10:40.343692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533851021753082:11220]
2025-10-02T08:10:40.343698Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:40.343703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.343706Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:40.343711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.343749Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|778cac1-5b11b084-5f63e880-496eee4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:40.343758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.343761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.343762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:40.343769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.343776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:40.343733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 944
2025-10-02T08:10:40.343793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.343829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.343836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.343845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.343879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 945 partition: 0 MaxSeqNo: 17 sessionId: src_id|778cac1-5b11b084-5f63e880-496eee4_0
2025-10-02T08:10:40.344193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41ec85d-5f061e7d-a6a6b37a-e9cd40cc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|778cac1-5b11b084-5f63e880-496eee4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:40.346803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|778cac1-5b11b084-5f63e880-496eee4_0] Write session: try to update token
2025-10-02T08:10:40.346820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|778cac1-5b11b084-5f63e880-496eee4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:40.368922Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:40.368940Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:40.368943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:40.368952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533851021753082:11220]
2025-10-02T08:10:40.368958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533851021753082:11220]
2025-10-02T08:10:40.369008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:40.369009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:40.369015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.369016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:40.369018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:40.369179Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:40.371490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId: src_id|778cac1-5b11b084-5f63e880-496eee4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:40.374556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:40.389864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533851021753119:10816]
2025-10-02T08:10:40.390056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 944, pipe: [1:7556533851021753119:10816]
2025-10-02T08:10:40.508127Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:40.508736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.508750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.508782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021753119:10816], now have 1 active actors on pipe
2025-10-02T08:10:40.508937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533851021753119:10816]
2025-10-02T08:10:40.508966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:40.508972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:40.508982Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:40.509053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 945 reason: error at write: Disconnected sessionId: src_id|778cac1-5b11b084-5f63e880-496eee4_0
2025-10-02T08:10:40.509061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:40.509213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 945 sessionId: src_id|778cac1-5b11b084-5f63e880-496eee4_0 is DEAD
2025-10-02T08:10:40.509368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778cac1-5b11b084-5f63e880-496eee4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:40.509391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778cac1-5b11b084-5f63e880-496eee4_0] Write session will restart in 0.009092s
2025-10-02T08:10:40.509421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778cac1-5b11b084-5f63e880-496eee4_0] Write session: Do CDS request
2025-10-02T08:10:40.509428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778cac1-5b11b084-5f63e880-496eee4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:40.521262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|778cac1-5b11b084-5f63e880-496eee4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.521597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:40.521630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 946
2025-10-02T08:10:40.521788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.521814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:40.521819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:40.521823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:40.522256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 946 sessionId:  describe result for acl check
2025-10-02T08:10:40.522283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:40.522285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:40.522287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:40.522292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533851021753598:11239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:40.522856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533851021753598:11239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:40.525353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533851021753598:11239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:40.534486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533851021753598:11239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:40.534501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533851021753598:11239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:40.534503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533851021753598:11239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:40.534510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:40.539503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:40.544290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:40.544477Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:40.544486Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:40.544494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:40.544534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:40.544568Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533851021753829:11238]
2025-10-02T08:10:40.545137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:40.545330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:40.545363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:40.545579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:40.545618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.545623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.545624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.545625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.545625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.545628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.545635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.545637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.545639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.545641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.545646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.545650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.545654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.545658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.545660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.545663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.545665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.545669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.545671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.545674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.545684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:40.563577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:40.567285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:40.567306Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:40.567310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:40.567314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:40.567321Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 945 [1:7556533851021753829:11238]
2025-10-02T08:10:40.567332Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:40.567351Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:40.567354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.567357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.567359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.567375Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:40.567381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:40.567386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:40.567472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.567479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.567482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:40.567485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:40.567554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:40.567562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.567576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.567596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:40.567612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533851021753823:11238]
2025-10-02T08:10:40.567614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533851021753823:11238]
2025-10-02T08:10:40.567628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:40.567632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:40.567635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:40.567640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021753738:11239], now have 1 active actors on pipe
2025-10-02T08:10:40.567654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 945
2025-10-02T08:10:40.567657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:40.567665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:40.567667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:40.567671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533851481830951:2378], now have 1 active actors on pipe
2025-10-02T08:10:40.567698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.567706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.567718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533851021753823:11238]
2025-10-02T08:10:40.567724Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:40.567743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:40.567748Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23a7523f-ce801c8a-71358b42-721a634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:40.567722Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 945
2025-10-02T08:10:40.567752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.567755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.567757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:40.567763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.567770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:40.567790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.567834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.567839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.567848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.567879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 946 partition: 0 MaxSeqNo: 17 sessionId: src_id|23a7523f-ce801c8a-71358b42-721a634_0
2025-10-02T08:10:40.568221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|778cac1-5b11b084-5f63e880-496eee4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|23a7523f-ce801c8a-71358b42-721a634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:40.570793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a7523f-ce801c8a-71358b42-721a634_0] Write session: try to update token
2025-10-02T08:10:40.570808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a7523f-ce801c8a-71358b42-721a634_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:40.586663Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:40.586687Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:40.586689Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:40.586696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533851021753823:11238]
2025-10-02T08:10:40.586700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533851021753823:11238]
2025-10-02T08:10:40.586744Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:40.586748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:40.586756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:40.586768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.586771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:40.587093Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:40.597119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId: src_id|23a7523f-ce801c8a-71358b42-721a634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:40.599700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:40.609089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533851021753858:10816]
2025-10-02T08:10:40.609192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 945, pipe: [1:7556533851021753858:10816]
2025-10-02T08:10:40.728601Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:40.729225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.729240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.729259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021753858:10816], now have 1 active actors on pipe
2025-10-02T08:10:40.729364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533851021753858:10816]
2025-10-02T08:10:40.729393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:40.729395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:40.729440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:40.729455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 946 reason: error at write: Disconnected sessionId: src_id|23a7523f-ce801c8a-71358b42-721a634_0
2025-10-02T08:10:40.729633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 946 sessionId: src_id|23a7523f-ce801c8a-71358b42-721a634_0 is DEAD
2025-10-02T08:10:40.729763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a7523f-ce801c8a-71358b42-721a634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:40.729771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a7523f-ce801c8a-71358b42-721a634_0] Write session will restart in 0.008508s
2025-10-02T08:10:40.729798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a7523f-ce801c8a-71358b42-721a634_0] Write session: Do CDS request
2025-10-02T08:10:40.729807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a7523f-ce801c8a-71358b42-721a634_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:40.730322Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:40.739334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a7523f-ce801c8a-71358b42-721a634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.739738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:40.754082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 947
2025-10-02T08:10:40.754394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.754422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:40.754429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:40.754432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:40.754813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 947 sessionId:  describe result for acl check
2025-10-02T08:10:40.754837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:40.754843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:40.754845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:40.754849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533851021754316:11246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:40.755291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533851021754316:11246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:40.757638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533851021754316:11246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:40.765896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533851021754316:11246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:40.765913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533851021754316:11246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:40.765917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533851021754316:11246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:40.765927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:40.769392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:40.769939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:40.770120Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:40.770132Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:40.770141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:40.770187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:40.770248Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533851021754536:11245]
2025-10-02T08:10:40.770940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:40.771144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:40.771190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:40.771511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:40.771569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.771576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.771577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.771579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.771580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.771586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.771597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.771601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.771606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.771610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.771617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.771624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.771635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.771641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.771663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.771668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.771674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.771679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.771684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.771690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.771715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:40.780825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:40.783031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:40.783049Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:40.783052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:40.783056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:40.783063Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 946 [1:7556533851021754536:11245]
2025-10-02T08:10:40.783074Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:40.783094Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:40.783096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.783100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.783102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.783120Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:40.783124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:40.783131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:40.783200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.783209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.783212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:40.783215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:40.783279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:40.783287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.783303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.783319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:40.783343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 946
2025-10-02T08:10:40.783344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021754519:11246], now have 1 active actors on pipe
2025-10-02T08:10:40.783348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533851481830966:2378], now have 1 active actors on pipe
2025-10-02T08:10:40.783354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533851021754530:11245]
2025-10-02T08:10:40.783357Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533851021754530:11245]
2025-10-02T08:10:40.783368Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:40.783382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.783385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:40.783388Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:40.783391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.783410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:40.783429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:40.783437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:40.783484Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:40.783495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.783449Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 946
2025-10-02T08:10:40.783499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.783507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:40.783515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.783528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:40.783540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533851021754530:11245]
2025-10-02T08:10:40.783551Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:40.783581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.783587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:40.783698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.783707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.783721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.783762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 947 partition: 0 MaxSeqNo: 17 sessionId: src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0
2025-10-02T08:10:40.784146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a7523f-ce801c8a-71358b42-721a634_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:40.786912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0] Write session: try to update token
2025-10-02T08:10:40.786935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:40.805615Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:40.805639Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:40.805642Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:40.805651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533851021754530:11245]
2025-10-02T08:10:40.805656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533851021754530:11245]
2025-10-02T08:10:40.805700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:40.805702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:40.805710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.805712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:40.805716Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:40.806158Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:40.816255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId: src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:40.819413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:40.829796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533851021754561:10816]
2025-10-02T08:10:40.829988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 946, pipe: [1:7556533851021754561:10816]
2025-10-02T08:10:40.952152Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:40.952905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.952927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.952948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021754561:10816], now have 1 active actors on pipe
2025-10-02T08:10:40.953052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533851021754561:10816]
2025-10-02T08:10:40.953082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:40.953089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:40.953137Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:40.953160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 947 reason: error at write: Disconnected sessionId: src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0
2025-10-02T08:10:40.953369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 947 sessionId: src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0 is DEAD
2025-10-02T08:10:40.953368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:40.953543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:40.953553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0] Write session will restart in 0.005307s
2025-10-02T08:10:40.953579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0] Write session: Do CDS request
2025-10-02T08:10:40.953585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:40.960372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.960446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:40.960467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 948
2025-10-02T08:10:40.962287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:40.962342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:40.962347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:40.962351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:40.962985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 948 sessionId:  describe result for acl check
2025-10-02T08:10:40.963025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:40.963027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:40.963029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:40.963035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533851021754898:11253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:40.963595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533851021754898:11253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:40.966663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533851021754898:11253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:40.973727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533851021754898:11253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:40.973747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533851021754898:11253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:40.973751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533851021754898:11253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:40.973759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:40.978280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:40.980507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:40.980651Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:40.980659Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:40.980666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:40.980700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:40.980728Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533851021755253:11252]
2025-10-02T08:10:40.981181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:40.981368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:40.981399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:40.981601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:40.981629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.981634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.981634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.981635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.981636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.981639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.981646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.981648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.981650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.981653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.981659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.981665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:40.981670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.981675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:40.981679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.981684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:40.981688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.981691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.981694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.981697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.981707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:40.989952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:40.991626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:40.991651Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:40.991654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:40.991658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:40.991665Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 947 [1:7556533851021755253:11252]
2025-10-02T08:10:40.991676Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:40.991693Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:40.991696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.991698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.991700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.991718Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:40.991726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:40.991734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:40.991799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.991805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.991809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:40.991811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:40.991880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:40.991887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:40.991901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:40.991915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:40.991937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533851021755148:11253], now have 1 active actors on pipe
2025-10-02T08:10:40.991946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533851481830978:2378], now have 1 active actors on pipe
2025-10-02T08:10:40.991946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 947
2025-10-02T08:10:40.991952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533851021755247:11252]
2025-10-02T08:10:40.991955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533851021755247:11252]
2025-10-02T08:10:40.991968Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:40.991982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.991989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.991993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:40.991996Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:40.992007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:40.992022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:40.992025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:40.992025Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 947
2025-10-02T08:10:40.992063Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d4287d6-f11f5027-af8fa600-6254942f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:40.992073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:40.992077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:40.992079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:40.992089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:40.992097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:40.992105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533851021755247:11252]
2025-10-02T08:10:40.992114Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:40.992126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:40.992144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.992215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:40.992223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:40.992238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:40.992272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 948 partition: 0 MaxSeqNo: 17 sessionId: src_id|7d4287d6-f11f5027-af8fa600-6254942f_0
2025-10-02T08:10:40.992610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1abba183-4477f5c7-14ff230d-36b4ebc4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7d4287d6-f11f5027-af8fa600-6254942f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:40.995391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4287d6-f11f5027-af8fa600-6254942f_0] Write session: try to update token
2025-10-02T08:10:40.995404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4287d6-f11f5027-af8fa600-6254942f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:41.011223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId: src_id|7d4287d6-f11f5027-af8fa600-6254942f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:41.011711Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:41.011724Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:41.011726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:41.011735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533851021755247:11252]
2025-10-02T08:10:41.011740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533851021755247:11252]
2025-10-02T08:10:41.011786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:41.011796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.011798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:41.011798Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:41.011805Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:41.011942Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:41.013784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:41.053021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533855316722575:10816]
2025-10-02T08:10:41.053097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 947, pipe: [1:7556533855316722575:10816]
2025-10-02T08:10:41.162177Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:41.162902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.162920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.162958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316722575:10816], now have 1 active actors on pipe
2025-10-02T08:10:41.163051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:41.163059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:41.163111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 948 reason: error at write: Disconnected sessionId: src_id|7d4287d6-f11f5027-af8fa600-6254942f_0
2025-10-02T08:10:41.163184Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:41.163203Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:41.163284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 948 sessionId: src_id|7d4287d6-f11f5027-af8fa600-6254942f_0 is DEAD
2025-10-02T08:10:41.163420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4287d6-f11f5027-af8fa600-6254942f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:41.163430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4287d6-f11f5027-af8fa600-6254942f_0] Write session will restart in 0.006335s
2025-10-02T08:10:41.163453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4287d6-f11f5027-af8fa600-6254942f_0] Write session: Do CDS request
2025-10-02T08:10:41.163459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4287d6-f11f5027-af8fa600-6254942f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:41.163449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533855316722575:10816]
2025-10-02T08:10:41.171350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4287d6-f11f5027-af8fa600-6254942f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.171471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:41.171489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 949
2025-10-02T08:10:41.171615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.171660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:41.171669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:41.171673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:41.172076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 949 sessionId:  describe result for acl check
2025-10-02T08:10:41.172113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:41.172120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:41.172121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:41.172126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533855316722918:11260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:41.172623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533855316722918:11260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:41.175707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533855316722918:11260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:41.178922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533855316722918:11260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:41.178938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533855316722918:11260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:41.178941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533855316722918:11260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:41.178949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:41.182202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:41.185092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:41.185278Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:41.185289Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:41.185298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:41.185345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:41.185382Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533855316723258:11259]
2025-10-02T08:10:41.186054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:41.186260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:41.186301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:41.186606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:41.186656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.186662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.186663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.186664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.186665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.186670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.186681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.186685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.186689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.186693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.186699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.186706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.186715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.186725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.186729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.186735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.186743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.186748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.186757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.186762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.186782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:41.196020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:41.198093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:41.198111Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:41.198114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:41.198117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:41.198125Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 948 [1:7556533855316723258:11259]
2025-10-02T08:10:41.198137Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:41.198156Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:41.198159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:41.198161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:41.198163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:41.198178Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:41.198186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:41.198193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:41.198253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.198261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.198265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:41.198267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:41.198329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:41.198337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.198351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.198363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:41.198381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316723203:11260], now have 1 active actors on pipe
2025-10-02T08:10:41.198393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533855316723252:11259]
2025-10-02T08:10:41.198395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533855316723252:11259]
2025-10-02T08:10:41.198402Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:41.198403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 948
2025-10-02T08:10:41.198417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:41.198433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:41.198440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:41.198445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533855776798284:2378], now have 1 active actors on pipe
2025-10-02T08:10:41.198462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:41.198471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533855316723252:11259]
2025-10-02T08:10:41.198472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:41.198473Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:41.198479Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:41.198480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.198483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.198488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 948
2025-10-02T08:10:41.198522Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9806e83c-5a5c6387-257b8e19-b5279825_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:41.198533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:41.198537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:41.198538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:41.198547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:41.198559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:41.198581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:41.198643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.198651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.198664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:41.198700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 949 partition: 0 MaxSeqNo: 17 sessionId: src_id|9806e83c-5a5c6387-257b8e19-b5279825_0
2025-10-02T08:10:41.199088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d4287d6-f11f5027-af8fa600-6254942f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9806e83c-5a5c6387-257b8e19-b5279825_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:41.201681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9806e83c-5a5c6387-257b8e19-b5279825_0] Write session: try to update token
2025-10-02T08:10:41.201697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9806e83c-5a5c6387-257b8e19-b5279825_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:41.218330Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:41.218353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:41.218356Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:41.218364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533855316723252:11259]
2025-10-02T08:10:41.218369Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533855316723252:11259]
2025-10-02T08:10:41.218412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:41.218420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.218419Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:41.218422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:41.218425Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:41.218563Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:41.219749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId: src_id|9806e83c-5a5c6387-257b8e19-b5279825_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:41.222307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:41.263418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533855316723283:10816]
2025-10-02T08:10:41.263520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 948, pipe: [1:7556533855316723283:10816]
2025-10-02T08:10:41.373304Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:41.373949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.373965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.374007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316723283:10816], now have 1 active actors on pipe
2025-10-02T08:10:41.374308Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:41.374361Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:41.374593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533855316723283:10816]
2025-10-02T08:10:41.374619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:41.374682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 949 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9806e83c-5a5c6387-257b8e19-b5279825_0
2025-10-02T08:10:41.374863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 949 sessionId: src_id|9806e83c-5a5c6387-257b8e19-b5279825_0 is DEAD
2025-10-02T08:10:41.375249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9806e83c-5a5c6387-257b8e19-b5279825_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:41.375264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9806e83c-5a5c6387-257b8e19-b5279825_0] Write session will restart in 0.006143s
2025-10-02T08:10:41.375290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9806e83c-5a5c6387-257b8e19-b5279825_0] Write session: Do CDS request
2025-10-02T08:10:41.375303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9806e83c-5a5c6387-257b8e19-b5279825_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:41.382665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9806e83c-5a5c6387-257b8e19-b5279825_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.382708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:41.382725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 950
2025-10-02T08:10:41.383007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.383044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:41.383049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:41.383053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:41.384055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 950 sessionId:  describe result for acl check
2025-10-02T08:10:41.384091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:41.384093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:41.384094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:41.384099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533855316723556:11266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:41.384837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533855316723556:11266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:41.388196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533855316723556:11266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:41.393949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533855316723556:11266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:41.393969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533855316723556:11266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:41.393972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533855316723556:11266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:41.393982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:41.408916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:41.411212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:41.411433Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:41.411443Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:41.411453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:41.411506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:41.411548Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533855316723978:11265]
2025-10-02T08:10:41.412230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:41.412476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:41.412522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:41.412846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:41.412896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.412897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.412898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.412899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.412900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.412905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.412914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.412918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.412921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.412925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.412930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.412937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.412943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.412948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.412952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.412957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.412961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.412965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.412970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.412974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.412992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:41.424893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:41.427204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:41.427220Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:41.427222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:41.427224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:41.427229Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 949 [1:7556533855316723978:11265]
2025-10-02T08:10:41.427239Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:41.427252Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:41.427255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:41.427256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:41.427258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:41.427269Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:41.427272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:41.427277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:41.427330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.427338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.427340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:41.427342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:41.427392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:41.427398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.427407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.427417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:41.427432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533855316723972:11265]
2025-10-02T08:10:41.427437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533855316723972:11265]
2025-10-02T08:10:41.427441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:41.427452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:41.427463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:41.427463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:41.427465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:41.427468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:41.427496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316723804:11266], now have 1 active actors on pipe
2025-10-02T08:10:41.427502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533855316723972:11265]
2025-10-02T08:10:41.427502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 949
2025-10-02T08:10:41.427504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:41.427507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533855776798292:2378], now have 1 active actors on pipe
2025-10-02T08:10:41.427510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.427513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.427514Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:41.427545Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:41.427553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:41.427556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:41.427557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:41.427565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:41.427571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:41.427585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:41.427596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 949
2025-10-02T08:10:41.427632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.427639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.427664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:41.427693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 950 partition: 0 MaxSeqNo: 17 sessionId: src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0
2025-10-02T08:10:41.427987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9806e83c-5a5c6387-257b8e19-b5279825_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:41.430510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0] Write session: try to update token
2025-10-02T08:10:41.430524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:41.444598Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:41.444618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:41.444620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:41.444625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533855316723972:11265]
2025-10-02T08:10:41.444628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533855316723972:11265]
2025-10-02T08:10:41.444660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:41.444661Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:41.444666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.444666Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:41.444668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:41.444851Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:41.462120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId: src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:41.464515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:41.474843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533855316724035:10816]
2025-10-02T08:10:41.474929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 949, pipe: [1:7556533855316724035:10816]
2025-10-02T08:10:41.574951Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:41.575210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.575222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.575241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316724035:10816], now have 1 active actors on pipe
2025-10-02T08:10:41.575333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:41.575341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:41.575388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 950 reason: error at write: Disconnected sessionId: src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0
2025-10-02T08:10:41.575442Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:41.575471Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:41.575537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 950 sessionId: src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0 is DEAD
2025-10-02T08:10:41.575704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533855316724035:10816]
2025-10-02T08:10:41.575763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:41.575778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0] Write session will restart in 0.009166s
2025-10-02T08:10:41.575810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0] Write session: Do CDS request
2025-10-02T08:10:41.575818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:41.586385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.586504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:41.586520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 951
2025-10-02T08:10:41.586620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.586650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:41.586660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:41.586663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:41.587166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 951 sessionId:  describe result for acl check
2025-10-02T08:10:41.587201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:41.587207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:41.587209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:41.587213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533855316724504:11284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:41.587735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533855316724504:11284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:41.590227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533855316724504:11284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:41.593511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533855316724504:11284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:41.593527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533855316724504:11284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:41.593530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533855316724504:11284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:41.593539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:41.596925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:41.597368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:41.597587Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:41.597600Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:41.597611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:41.597669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:41.597715Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533855316724730:11283]
2025-10-02T08:10:41.598401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:41.598605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:41.598653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:41.598972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:41.599029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.599034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.599035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.599036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.599037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.599057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.599072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.599080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.599084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.599087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.599093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.599105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.599111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.599116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.599120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.599130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.599135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.599145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.599151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.599157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.599180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:41.607601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:41.609694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:41.609707Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:41.609708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:41.609711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:41.609715Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 950 [1:7556533855316724730:11283]
2025-10-02T08:10:41.609724Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:41.609737Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:41.609739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:41.609741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:41.609742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:41.609754Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:41.609757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:41.609766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:41.609820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.609826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.609829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:41.609830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:41.609883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:41.609888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.609896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.609907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:41.609918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533855316724724:11283]
2025-10-02T08:10:41.609922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533855316724724:11283]
2025-10-02T08:10:41.609927Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:41.609936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:41.609948Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:41.609950Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:41.609953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:41.609953Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:41.609953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 950
2025-10-02T08:10:41.609961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316724713:11284], now have 1 active actors on pipe
2025-10-02T08:10:41.609987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533855776798322:2378], now have 1 active actors on pipe
2025-10-02T08:10:41.609996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.609999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.610010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533855316724724:11283]
2025-10-02T08:10:41.610016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:41.610029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:41.610038Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:41.610044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:41.610048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:41.610050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:41.610059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:41.610067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:41.610083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:41.610085Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 950
2025-10-02T08:10:41.610120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.610132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.610155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:41.610192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 951 partition: 0 MaxSeqNo: 17 sessionId: src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0
2025-10-02T08:10:41.610500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cf4f60-93845af8-72dc94f9-f0614f18_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:41.613019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0] Write session: try to update token
2025-10-02T08:10:41.613035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:41.628980Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:41.628998Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:41.629000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:41.629009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533855316724724:11283]
2025-10-02T08:10:41.629014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533855316724724:11283]
2025-10-02T08:10:41.629060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:41.629061Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:41.629068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:41.629071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.629074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:41.629224Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:41.632145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId: src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:41.635367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:41.676114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533855316724757:10816]
2025-10-02T08:10:41.676347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 950, pipe: [1:7556533855316724757:10816]
2025-10-02T08:10:41.770648Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:41.770928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.770943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.770983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316724757:10816], now have 1 active actors on pipe
2025-10-02T08:10:41.771075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:41.771083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:41.771136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 951 reason: error at write: Disconnected sessionId: src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0
2025-10-02T08:10:41.771224Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:41.771334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 951 sessionId: src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0 is DEAD
2025-10-02T08:10:41.771449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533855316724757:10816]
2025-10-02T08:10:41.771740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:41.771758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0] Write session will restart in 0.007381s
2025-10-02T08:10:41.771788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0] Write session: Do CDS request
2025-10-02T08:10:41.771795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:41.771261Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:41.780678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.781101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:41.781117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 952
2025-10-02T08:10:41.781297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.781340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:41.781348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:41.781353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:41.781788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 952 sessionId:  describe result for acl check
2025-10-02T08:10:41.781821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:41.781827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:41.781829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:41.781833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533855316725119:11291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:41.782323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533855316725119:11291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:41.784895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533855316725119:11291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:41.788386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533855316725119:11291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:41.788403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533855316725119:11291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:41.788406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533855316725119:11291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:41.788414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:41.795618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:41.796050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:41.796249Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:41.796257Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:41.796268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:41.796321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:41.796372Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533855316725445:11290]
2025-10-02T08:10:41.796929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:41.797160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:41.797212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:41.797545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:41.797593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.797599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.797600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.797602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.797603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.797608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.797619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.797628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.797632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.797636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.797642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.797654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:41.797660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.797666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:41.797675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.797681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:41.797686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.797691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.797700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.797705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.797728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:41.806344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:41.808376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:41.808396Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:41.808399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:41.808403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:41.808410Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 951 [1:7556533855316725445:11290]
2025-10-02T08:10:41.808424Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:41.808444Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:41.808448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:41.808451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:41.808453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:41.808471Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:41.808477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:41.808484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:41.808548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.808557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.808561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:41.808564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:41.808645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:41.808659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.808675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:41.808692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:41.808708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533855316725439:11290]
2025-10-02T08:10:41.808711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533855316725439:11290]
2025-10-02T08:10:41.808718Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:41.808732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:41.808747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:41.808755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:41.808789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533855316725439:11290]
2025-10-02T08:10:41.808843Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:41.808856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:41.808863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:41.808798Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:41.808934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316725368:11291], now have 1 active actors on pipe
2025-10-02T08:10:41.808966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 951
2025-10-02T08:10:41.809070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533855776798341:2378], now have 1 active actors on pipe
2025-10-02T08:10:41.809085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.809091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.809118Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:41.809126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:41.809131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:41.809133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:41.809145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:41.809157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:41.809174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:41.809150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 951
2025-10-02T08:10:41.809209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.809215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.809227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:41.809261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 952 partition: 0 MaxSeqNo: 17 sessionId: src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0
2025-10-02T08:10:41.809661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1dcb7cf-f8a20c3c-1bef52e3-45c775ee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:41.812660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0] Write session: try to update token
2025-10-02T08:10:41.812681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:41.834628Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:41.834652Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:41.834655Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:41.834664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533855316725439:11290]
2025-10-02T08:10:41.834668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533855316725439:11290]
2025-10-02T08:10:41.834719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:41.834726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:41.834729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:41.834742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:41.834750Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:41.834912Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:41.840919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId: src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:41.843863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:41.871709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533855316725482:10816]
2025-10-02T08:10:41.871814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 951, pipe: [1:7556533855316725482:10816]
2025-10-02T08:10:41.967331Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:41.968001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:41.968012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:41.968028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316725482:10816], now have 1 active actors on pipe
2025-10-02T08:10:41.968116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533855316725482:10816]
2025-10-02T08:10:41.968133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:41.968134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:41.968175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 952 reason: error at write: Disconnected sessionId: src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0
2025-10-02T08:10:41.968221Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:41.968254Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:41.968319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 952 sessionId: src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0 is DEAD
2025-10-02T08:10:41.968468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:41.968477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0] Write session will restart in 0.006024s
2025-10-02T08:10:41.968502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0] Write session: Do CDS request
2025-10-02T08:10:41.968509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:41.975604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.975619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:41.975636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 953
2025-10-02T08:10:41.975919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:41.975954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:41.975961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:41.975964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:41.976386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 953 sessionId:  describe result for acl check
2025-10-02T08:10:41.976427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:41.976440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:41.976442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:41.976448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533855316725520:11298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:41.977027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533855316725520:11298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:41.981694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533855316725520:11298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:41.985033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533855316725520:11298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:41.985048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533855316725520:11298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:41.985051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533855316725520:11298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:41.985059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:42.003100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:42.003504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:42.003634Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:42.003641Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:42.003648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:42.003694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:42.003728Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533859611693466:11297]
2025-10-02T08:10:42.004157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:42.004365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:42.004436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:42.004793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:42.004859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.004865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.004867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.004867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.004868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.004874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.004884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.004887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.004890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.004893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.004898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.004905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.004910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.004914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.004919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.004924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.004941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.004946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.004950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.004954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.004969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:42.013544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:42.015092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:42.015110Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:42.015113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:42.015116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:42.015124Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 952 [1:7556533859611693466:11297]
2025-10-02T08:10:42.015136Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:42.015155Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:42.015159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.015162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.015164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.015179Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:42.015183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:42.015188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:42.015240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.015246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.015248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:42.015251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:42.015305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:42.015311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.015327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.015344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:42.015363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533859611693460:11297]
2025-10-02T08:10:42.015369Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533859611693460:11297]
2025-10-02T08:10:42.015377Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:42.015388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 952
2025-10-02T08:10:42.015390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533855316725824:11298], now have 1 active actors on pipe
2025-10-02T08:10:42.015397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:42.015398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:42.015400Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:42.015411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:42.015413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:42.015419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533855776798351:2378], now have 1 active actors on pipe
2025-10-02T08:10:42.015423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.015427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.015468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533859611693460:11297]
2025-10-02T08:10:42.015481Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:42.015489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:42.015498Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|400361d6-1c1d6652-b9ff457b-90689c50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:42.015504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.015509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.015512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:42.015482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 952
2025-10-02T08:10:42.015521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.015535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:42.015588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.015697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.015706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.015724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.015763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 953 partition: 0 MaxSeqNo: 17 sessionId: src_id|400361d6-1c1d6652-b9ff457b-90689c50_0
2025-10-02T08:10:42.016129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315c62d2-891f73c0-98fe4c60-e1053e00_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|400361d6-1c1d6652-b9ff457b-90689c50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:42.018957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400361d6-1c1d6652-b9ff457b-90689c50_0] Write session: try to update token
2025-10-02T08:10:42.018973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400361d6-1c1d6652-b9ff457b-90689c50_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:42.033930Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:42.033959Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.033973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533859611693460:11297]
2025-10-02T08:10:42.034032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:42.034033Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:42.034249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:42.034425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.034588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.034797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.035071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:42.035129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:42.036778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId: src_id|400361d6-1c1d6652-b9ff457b-90689c50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:42.040015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:42.040148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.040165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.040206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:42.040496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:42.040581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.040592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.040818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.040900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.040987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.041062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.041124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.041129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.041220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.041289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.041378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.041467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.042259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.042279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.042364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.042493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.042577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.042660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.042824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.042833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.042953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.043029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.043119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.043219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.043268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.043278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.043350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.043437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.043495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.043553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.043597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.043604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.043685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.043746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.043804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.043866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.043929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.043937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.044002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.044056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.044147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.044234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.044290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.044296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.044380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.044496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.044587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.044696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.044742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.044749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.044871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.044939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.044998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.045058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.045123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.045132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.045199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.045267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.045338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.045408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.045461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.045469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.045531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:42.045587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.045605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.045615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:42.045648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:42.045667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:42.045673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:42.045676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:42.045678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:42.046051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:42.046087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:42.046093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:42.046095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:42.046098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:42.046100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:42.046638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:42.046667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:42.046671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:42.046673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:42.046676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:42.046678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:42.047128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:42.047151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:42.047157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:42.047160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:42.047163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:42.049334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:42.049354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:42.049364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392642049
2025-10-02T08:10:42.049718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:42.049737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:42.049741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:42.049746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:42.049749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:42.049754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:42.050374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:42.050396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:42.050401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:42.050403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:42.050406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:42.050408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:42.050922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:42.050942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:42.050948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:42.050950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:42.050954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:42.050956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:42.051424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:42.051450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:42.051456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:42.052538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:42.052559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:42.052563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:42.052566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:42.052575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392642052
2025-10-02T08:10:42.052871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:42.052890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:42.052894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:42.052898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:42.052901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:42.052903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:42.053385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:42.053408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:42.053411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:42.053414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:42.053416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:42.053419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:42.053846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:42.053863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.053936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392642053
2025-10-02T08:10:42.056093Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:42.056118Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:42.056125Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:42.056131Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:42.056142Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:42.056145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.056148Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:42.056157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533859611693460:11297]
2025-10-02T08:10:42.056161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533859611693460:11297]
2025-10-02T08:10:42.056211Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:42.056216Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:42.056228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:42.056232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.056234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:42.056355Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:42.068304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533859611693492:10816]
2025-10-02T08:10:42.068418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 952, pipe: [1:7556533859611693492:10816]
2025-10-02T08:10:42.188092Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:42.188486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611693492:10816], now have 1 active actors on pipe
2025-10-02T08:10:42.188593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:42.188605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:42.188634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 953 reason: error at write: Disconnected sessionId: src_id|400361d6-1c1d6652-b9ff457b-90689c50_0
2025-10-02T08:10:42.188666Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:42.188726Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:42.188848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 953 sessionId: src_id|400361d6-1c1d6652-b9ff457b-90689c50_0 is DEAD
2025-10-02T08:10:42.189061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533859611693492:10816]
2025-10-02T08:10:42.189138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400361d6-1c1d6652-b9ff457b-90689c50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:42.189150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400361d6-1c1d6652-b9ff457b-90689c50_0] Write session will restart in 0.008868s
2025-10-02T08:10:42.189176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400361d6-1c1d6652-b9ff457b-90689c50_0] Write session: Do CDS request
2025-10-02T08:10:42.189184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400361d6-1c1d6652-b9ff457b-90689c50_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:42.192079Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [e42faa2477ab3606] Result# TEvPutResult {Id# [72075186224037892:952:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:42.192144Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:952:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:42.192233Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:952:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:42.199381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400361d6-1c1d6652-b9ff457b-90689c50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:42.199462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:42.199479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 954
2025-10-02T08:10:42.199665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:42.199694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:42.199700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:42.199702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:42.200169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 954 sessionId:  describe result for acl check
2025-10-02T08:10:42.200202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:42.200204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:42.200205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:42.200210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533859611693894:11305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:42.200712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533859611693894:11305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:42.203371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533859611693894:11305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:42.207284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533859611693894:11305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:42.207298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533859611693894:11305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:42.207301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533859611693894:11305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:42.207306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:42.212863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:42.213291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:42.213450Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:42.213459Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:42.213468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:42.213505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:42.213539Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533859611694190:11304]
2025-10-02T08:10:42.214020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:42.214196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:42.214233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:42.214465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:42.214509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.214515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.214516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.214517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.214518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.214523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.214532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.214539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.214543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.214550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.214556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.214567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.214572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.214578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.214585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.214591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.214596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.214601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.214608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.214613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.214629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:42.223259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:42.224786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:42.224816Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:42.224818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:42.224822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:42.224829Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 953 [1:7556533859611694190:11304]
2025-10-02T08:10:42.224840Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:42.224859Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:42.224862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.224865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.224867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.224883Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:42.224889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:42.224895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:42.224955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.224963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.224966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:42.224969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:42.225030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:42.225037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.225049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.225061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:42.225083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611694156:11305], now have 1 active actors on pipe
2025-10-02T08:10:42.225093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533859611694184:11304]
2025-10-02T08:10:42.225096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533859611694184:11304]
2025-10-02T08:10:42.225103Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:42.225115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:42.225118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533860071765653:2378], now have 1 active actors on pipe
2025-10-02T08:10:42.225119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:42.225125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:42.225137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:42.225140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:42.225169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533859611694184:11304]
2025-10-02T08:10:42.225177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:42.225187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:42.225193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 953
2025-10-02T08:10:42.225201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.225205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.225198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 953
2025-10-02T08:10:42.225231Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:42.225242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.225246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.225253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:42.225263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.225271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:42.225297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.225342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.225349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.225361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.225398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 954 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0
2025-10-02T08:10:42.225760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400361d6-1c1d6652-b9ff457b-90689c50_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:42.228619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0] Write session: try to update token
2025-10-02T08:10:42.228639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:42.236289Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:42.236304Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.236313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533859611694184:11304]
2025-10-02T08:10:42.236357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:42.236376Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:42.236545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:42.236745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.236928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.237076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.237292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:42.237335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:42.245137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId: src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:42.247665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:42.247733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.247744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.247777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:42.247801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:42.247932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.247951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.248130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.248261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.248403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.248485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.248533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.248545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.248634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.248717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.248823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.248906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.248964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.248972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.249052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.249131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.249209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.249289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.249341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.249348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.249426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.249505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.249624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.249738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.249797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.249810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.249891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.249968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.250131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.250221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.250277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.250285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.250365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.250447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.250527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.250611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.250671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.250681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.250762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.250840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.250920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.251001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.251066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.251073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.251152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.251232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.251312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.251388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.251442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.251452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.251528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.251605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.251695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.251774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.251833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.251841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.251919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.251995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.252074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.252170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.252222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.252229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.252290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:42.252358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.252379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.252385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:42.252420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:42.252436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:42.252439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:42.252442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:42.252444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:42.252958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:42.252986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:42.252997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:42.253005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:42.253008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:42.253010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:42.253985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:42.254014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:42.254026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:42.254033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:42.254036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:42.254039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:42.254660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:42.254687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:42.254693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:42.254701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:42.254704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:42.256207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:42.256227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:42.256239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392642256
2025-10-02T08:10:42.256612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:42.256635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:42.256641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:42.256644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:42.256648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:42.256651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:42.257292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:42.257320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:42.257327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:42.257334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:42.257337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:42.257340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:42.258086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:42.258113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:42.258124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:42.258133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:42.258137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:42.258140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:42.258805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:42.258832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:42.258838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:42.260261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:42.260282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:42.260287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:42.260291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:42.260299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392642260
2025-10-02T08:10:42.260693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:42.260719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:42.260733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:42.260741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:42.260744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:42.260747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:42.261335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:42.261361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:42.261373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:42.261376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:42.261384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:42.261388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:42.261968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:42.261991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.262095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392642261
2025-10-02T08:10:42.266042Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:42.266070Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:42.266076Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:42.266085Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:42.266096Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:42.266105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.266107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:42.266115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533859611694184:11304]
2025-10-02T08:10:42.266123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533859611694184:11304]
2025-10-02T08:10:42.266163Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:42.266175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:42.266200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:42.266209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.266211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:42.266374Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:42.289491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533859611694217:10816]
2025-10-02T08:10:42.289598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 953, pipe: [1:7556533859611694217:10816]
2025-10-02T08:10:42.409597Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:42.410016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611694217:10816], now have 1 active actors on pipe
2025-10-02T08:10:42.410134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533859611694217:10816]
2025-10-02T08:10:42.410159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:42.410161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:42.410183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 954 reason: error at write: Disconnected sessionId: src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0
2025-10-02T08:10:42.410226Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:42.410316Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:42.410410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 954 sessionId: src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0 is DEAD
2025-10-02T08:10:42.410616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:42.410631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0] Write session will restart in 0.008175s
2025-10-02T08:10:42.410659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0] Write session: Do CDS request
2025-10-02T08:10:42.410666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:42.415262Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [1d4f210f4dc4d257] Result# TEvPutResult {Id# [72075186224037892:953:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:42.415290Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:953:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:42.415386Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:953:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:42.420519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:42.420510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:42.420536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 955
2025-10-02T08:10:42.420811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:42.420856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:42.420865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:42.420870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:42.421411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 955 sessionId:  describe result for acl check
2025-10-02T08:10:42.421443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:42.421449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:42.421451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:42.421456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533859611694526:11311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:42.421974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533859611694526:11311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:42.424423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533859611694526:11311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:42.427760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533859611694526:11311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:42.427774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533859611694526:11311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:42.427778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533859611694526:11311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:42.427785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:42.436852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:42.437328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:42.437488Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:42.437496Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:42.437505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:42.437541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:42.437579Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533859611694920:11310]
2025-10-02T08:10:42.438182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:42.438377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:42.438413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:42.438707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:42.438746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.438752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.438753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.438754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.438755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.438760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.438770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.438774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.438778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.438782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.438787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.438794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.438799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.438806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.438813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.438822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.438827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.438831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.438835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.438840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.438858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:42.446556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:42.448629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:42.448645Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:42.448646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:42.448650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:42.448655Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 954 [1:7556533859611694920:11310]
2025-10-02T08:10:42.448663Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:42.448677Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:42.448679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.448681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.448682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.448697Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:42.448701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:42.448708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:42.448754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.448760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.448762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:42.448764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:42.448836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:42.448842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.448851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.448862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:42.448873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533859611694914:11310]
2025-10-02T08:10:42.448878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533859611694914:11310]
2025-10-02T08:10:42.448884Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:42.448896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:42.448907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:42.448908Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:42.448911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:42.448913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:42.448942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611694790:11311], now have 1 active actors on pipe
2025-10-02T08:10:42.448947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 954
2025-10-02T08:10:42.448950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533859611694914:11310]
2025-10-02T08:10:42.448952Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:42.448956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.448959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.448963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:42.448977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533860071765661:2378], now have 1 active actors on pipe
2025-10-02T08:10:42.448990Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e3db19-b9d9250a-68783867-cb111925_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:42.448994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.448996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.448997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:42.449004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.449010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:42.449022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.449047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 954
2025-10-02T08:10:42.449093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.449098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.449111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.449139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 955 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0e3db19-b9d9250a-68783867-cb111925_0
2025-10-02T08:10:42.449503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9a59be-ad3ba908-b0476435-8aa05802_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0e3db19-b9d9250a-68783867-cb111925_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:42.452302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3db19-b9d9250a-68783867-cb111925_0] Write session: try to update token
2025-10-02T08:10:42.452319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3db19-b9d9250a-68783867-cb111925_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:42.466055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId: src_id|a0e3db19-b9d9250a-68783867-cb111925_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:42.466683Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:42.466699Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.466701Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:42.466707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533859611694914:11310]
2025-10-02T08:10:42.466711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533859611694914:11310]
2025-10-02T08:10:42.466744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:42.466745Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:42.466750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.466751Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:42.466752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:42.466883Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:42.468983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:42.510241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533859611694976:10816]
2025-10-02T08:10:42.510975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 954, pipe: [1:7556533859611694976:10816]
2025-10-02T08:10:42.598708Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:42.599200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.599214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.599256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611694976:10816], now have 1 active actors on pipe
2025-10-02T08:10:42.599533Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:42.599364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533859611694976:10816]
2025-10-02T08:10:42.599390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:42.599393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:42.599449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 955 reason: error at write: Disconnected sessionId: src_id|a0e3db19-b9d9250a-68783867-cb111925_0
2025-10-02T08:10:42.599485Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:42.599625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 955 sessionId: src_id|a0e3db19-b9d9250a-68783867-cb111925_0 is DEAD
2025-10-02T08:10:42.600185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3db19-b9d9250a-68783867-cb111925_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:42.600194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3db19-b9d9250a-68783867-cb111925_0] Write session will restart in 0.008427s
2025-10-02T08:10:42.600220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3db19-b9d9250a-68783867-cb111925_0] Write session: Do CDS request
2025-10-02T08:10:42.600227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3db19-b9d9250a-68783867-cb111925_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:42.611124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3db19-b9d9250a-68783867-cb111925_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:42.611258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:42.611278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 956
2025-10-02T08:10:42.611461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:42.611498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:42.611507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:42.611511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:42.611899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 956 sessionId:  describe result for acl check
2025-10-02T08:10:42.611946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:42.611952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:42.611953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:42.611958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533859611695401:11329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:42.612440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533859611695401:11329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:42.614642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533859611695401:11329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:42.624569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533859611695401:11329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:42.624590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533859611695401:11329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:42.624594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533859611695401:11329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:42.624602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:42.624893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:42.627891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:42.628072Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:42.628074Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:42.628081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:42.628117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:42.628141Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533859611695685:11328]
2025-10-02T08:10:42.628650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:42.628873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:42.628919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:42.629213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:42.629272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.629278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.629279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.629280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.629282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.629287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.629298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.629302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.629305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.629309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.629313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.629321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.629326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.629331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.629335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.629342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.629346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.629352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.629362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.629367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.629388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:42.637866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:42.639488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:42.639506Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:42.639508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:42.639511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:42.639517Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 955 [1:7556533859611695685:11328]
2025-10-02T08:10:42.639526Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:42.639540Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:42.639542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.639544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.639545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.639557Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:42.639561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:42.639567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:42.639614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.639620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.639622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:42.639624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:42.639830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 955
2025-10-02T08:10:42.639954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:42.639967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.639980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.639992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:42.640004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 955
2025-10-02T08:10:42.640017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611695675:11329], now have 1 active actors on pipe
2025-10-02T08:10:42.640020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533860071765692:2378], now have 1 active actors on pipe
2025-10-02T08:10:42.640025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.640033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.640056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533859611695677:11328]
2025-10-02T08:10:42.640062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533859611695677:11328]
2025-10-02T08:10:42.640071Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:42.640084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:42.640097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:42.640099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:42.640109Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:42.640118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.640121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.640122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:42.640130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.640139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:42.640165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:42.640169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:42.640177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533859611695677:11328]
2025-10-02T08:10:42.640180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:42.640183Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:42.640192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.640256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.640262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.640274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.640316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 956 partition: 0 MaxSeqNo: 17 sessionId: src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0
2025-10-02T08:10:42.640619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e3db19-b9d9250a-68783867-cb111925_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:42.643157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0] Write session: try to update token
2025-10-02T08:10:42.643174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:42.651443Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:42.651464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.651473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533859611695677:11328]
2025-10-02T08:10:42.651513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:42.651516Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:42.651711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:42.651858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.652006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.652146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.652347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:42.652389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:42.668441Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:42.668463Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.668466Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:42.668475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533859611695677:11328]
2025-10-02T08:10:42.668478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533859611695677:11328]
2025-10-02T08:10:42.668521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:42.668528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:42.668533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.668534Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:42.668536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:42.668676Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:42.669361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId: src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:42.671961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:42.699577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533859611695709:10816]
2025-10-02T08:10:42.699714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 955, pipe: [1:7556533859611695709:10816]
2025-10-02T08:10:42.806004Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:42.806504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.806520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.806542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611695709:10816], now have 1 active actors on pipe
2025-10-02T08:10:42.806652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533859611695709:10816]
2025-10-02T08:10:42.806680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:42.806682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:42.806734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 956 reason: error at write: Disconnected sessionId: src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0
2025-10-02T08:10:42.806735Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:42.806915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 956 sessionId: src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0 is DEAD
2025-10-02T08:10:42.807099Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:42.807178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:42.807187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0] Write session will restart in 0.006311s
2025-10-02T08:10:42.807212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0] Write session: Do CDS request
2025-10-02T08:10:42.807218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:42.814308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:42.814410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:42.814422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 957
2025-10-02T08:10:42.814559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:42.814585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:42.814594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:42.814597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:42.814885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 957 sessionId:  describe result for acl check
2025-10-02T08:10:42.814912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:42.814917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:42.814918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:42.814922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533859611696083:11338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:42.815365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533859611696083:11338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:42.817556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533859611696083:11338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:42.821461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533859611696083:11338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:42.821487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533859611696083:11338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:42.821490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533859611696083:11338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:42.821501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:42.832011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:42.832466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:42.832636Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:42.832647Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:42.832656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:42.832698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:42.832738Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533859611696411:11337]
2025-10-02T08:10:42.833286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:42.833444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:42.833484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:42.833686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:42.833718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.833720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.833722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.833723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.833724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.833728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.833737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.833740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.833744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.833748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.833753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.833760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:42.833765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.833768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:42.833771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.833775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:42.833777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.833780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.833783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.833787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.833803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:42.843315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:42.845134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:42.845147Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:42.845148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:42.845151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:42.845156Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 956 [1:7556533859611696411:11337]
2025-10-02T08:10:42.845164Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:42.845178Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:42.845180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.845182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.845184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.845196Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:42.845199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:42.845204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:42.845262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.845270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.845273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:42.845275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:42.845332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:42.845337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.845343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 956
2025-10-02T08:10:42.845346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:42.845353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:42.845370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611696315:11338], now have 1 active actors on pipe
2025-10-02T08:10:42.845378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.845382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.845400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533859611696405:11337]
2025-10-02T08:10:42.845402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533859611696405:11337]
2025-10-02T08:10:42.845414Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:42.845422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533860071765713:2378], now have 1 active actors on pipe
2025-10-02T08:10:42.845429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:42.845434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:42.845441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:42.845443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:42.845444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:42.845458Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:42.845464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.845450Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 956
2025-10-02T08:10:42.845473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.845475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:42.845483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.845491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:42.845525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533859611696405:11337]
2025-10-02T08:10:42.845536Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:42.845542Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:42.845553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.845609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.845619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.845635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:42.845665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 957 partition: 0 MaxSeqNo: 17 sessionId: src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0
2025-10-02T08:10:42.846089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78ae3b2-da99d6f6-e2b8abcb-d69f2629_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:42.849666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0] Write session: try to update token
2025-10-02T08:10:42.849688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:42.858341Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:42.858358Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.858367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533859611696405:11337]
2025-10-02T08:10:42.858403Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:42.858408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:42.858694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:42.858845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.858982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.859121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:42.859307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:42.859348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:42.864277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId: src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:42.866837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:42.866902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.866914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.866947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:42.866970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:42.867036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:42.867052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:42.867211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.867280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.867341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.867399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.867579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.867590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.867707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.867768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.867843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.867912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.867952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.867958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.868014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.868072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.868137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.868194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.868248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.868256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.868320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.868386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.868447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.868529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.868588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.868594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.868655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.868713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.868776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.868855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.868919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.868926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.868990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.869066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.869132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.869204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.869254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.869261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.869331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.869394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.869466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.869562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.869626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.869632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.869705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.869764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.869822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.869881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.870172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.870184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.870255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.870314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.870370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.870564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.870628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.870643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.870720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:42.870785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:42.870853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:42.870912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:42.870957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:42.870965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:42.871002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:42.871058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:42.871076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:42.871078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:42.871112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:42.871127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:42.871131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:42.871138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:42.871141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:42.871524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:42.871537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:42.871542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:42.871544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:42.871546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:42.871549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:42.872112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:42.872129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:42.872135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:42.872138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:42.872141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:42.872144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:42.872589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:42.872599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:42.872604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:42.872607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:42.872609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:42.875012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:42.875035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:42.875047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392642874
2025-10-02T08:10:42.875190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:42.875202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:42.875205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:42.875207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:42.875211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:42.875213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:42.875708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:42.875734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:42.875740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:42.875751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:42.875754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:42.875758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:42.876244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:42.876267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:42.876274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:42.876278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:42.876280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:42.876283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:42.876759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:42.876780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:42.876785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:42.877944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:42.877960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:42.877964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:42.877966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:42.877973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392642877
2025-10-02T08:10:42.878263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:42.878287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:42.878294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:42.878297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:42.878302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:42.878306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:42.878758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:42.878775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:42.878780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:42.878785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:42.878789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:42.878793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:42.879305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:42.879330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:42.879456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392642879
2025-10-02T08:10:42.880248Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:42.880282Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:42.880291Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:42.880300Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:42.881942Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:42.881957Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:42.881961Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:42.881970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533859611696405:11337]
2025-10-02T08:10:42.881973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533859611696405:11337]
2025-10-02T08:10:42.882016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:42.882022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:42.882034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:42.882039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:42.882041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:42.882180Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:42.906948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533859611696460:10816]
2025-10-02T08:10:42.907058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 956, pipe: [1:7556533859611696460:10816]
2025-10-02T08:10:43.012520Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:43.012821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533859611696460:10816], now have 1 active actors on pipe
2025-10-02T08:10:43.012937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:43.012948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:43.012978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 957 reason: error at write: Disconnected sessionId: src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0
2025-10-02T08:10:43.013046Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:43.013034Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:43.013161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 957 sessionId: src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0 is DEAD
2025-10-02T08:10:43.013374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:43.013389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0] Write session will restart in 0.009093s
2025-10-02T08:10:43.013416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0] Write session: Do CDS request
2025-10-02T08:10:43.013423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:43.013578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533859611696460:10816]
2025-10-02T08:10:43.023412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.023453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:43.023468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 958
2025-10-02T08:10:43.023652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.023691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:43.023701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:43.023704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:43.024125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 958 sessionId:  describe result for acl check
2025-10-02T08:10:43.024155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:43.024157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:43.024158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:43.024162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533863906664310:11345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:43.024617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533863906664310:11345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:43.027009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533863906664310:11345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:43.031891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533863906664310:11345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:43.031907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533863906664310:11345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:43.031910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533863906664310:11345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:43.031919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:43.039246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:43.039684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:43.039856Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:43.039867Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:43.039877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:43.039928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:43.039965Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533863906664455:11344]
2025-10-02T08:10:43.040642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:43.040840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:43.040883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:43.041195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:43.041239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.041244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.041245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.041246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.041248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.041252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.041263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.041268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.041272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.041276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.041281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.041290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.041299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.041305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.041309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.041320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.041330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.041335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.041342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.041351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.041370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:43.050098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:43.051993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:43.052012Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:43.052014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:43.052018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:43.052042Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 957 [1:7556533863906664455:11344]
2025-10-02T08:10:43.052054Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:43.052075Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:43.052082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.052085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.052087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.052101Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:43.052106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:43.052113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:43.052173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.052181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.052184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:43.052186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:43.052248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:43.052256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.052271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.052290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:43.052310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533863906664449:11344]
2025-10-02T08:10:43.052317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533863906664449:11344]
2025-10-02T08:10:43.052327Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:43.052338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 957
2025-10-02T08:10:43.052347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906664391:11345], now have 1 active actors on pipe
2025-10-02T08:10:43.052348Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:43.052351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533864366733017:2378], now have 1 active actors on pipe
2025-10-02T08:10:43.052351Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:43.052358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:43.052373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:43.052380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:43.052387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.052390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.052426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533863906664449:11344]
2025-10-02T08:10:43.052439Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:43.052446Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:43.052454Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:43.052464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.052468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.052471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:43.052440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 957
2025-10-02T08:10:43.052479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.052492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:43.052536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.052615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.052622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.052635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.052670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 958 partition: 0 MaxSeqNo: 17 sessionId: src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0
2025-10-02T08:10:43.053066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f68dac-7b5162f5-216a16a2-f472e5f6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:43.056227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0] Write session: try to update token
2025-10-02T08:10:43.056247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:43.065608Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:43.065623Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:43.065636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533863906664449:11344]
2025-10-02T08:10:43.065681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:43.065684Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:43.065876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:43.066030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:43.066189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:43.066363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:43.066610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:43.066651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:43.072938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId: src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:43.075518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:43.075621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.075632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.075677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:43.075702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:43.075877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.075894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.076059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.076153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.076228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.076296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.076347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.076356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.076425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.076489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.076563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.076636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.076683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.076692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.076762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.076847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.076911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.076975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.077019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.077026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.077091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.077160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.077228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.077293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.077340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.077347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.077414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.077481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.077544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.077609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.077654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.077662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.077728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.077789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.077856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.077919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.077984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.077992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.078058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.078122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.078187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.078255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.078311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.078319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.078386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.078450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.078513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.078577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.078630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.078638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.078705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.078768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.078830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.078895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.078940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.078948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.079014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:43.079081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:43.079160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:43.079235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:43.079282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:43.079290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:43.079349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:43.079417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.079440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.079444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:43.079473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:43.079490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:43.079498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:43.079502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:43.079506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:43.080003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:43.080036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:43.080042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:43.080045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:43.080049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:43.080052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:43.080845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:43.080874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:43.080881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:43.080885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:43.080888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:43.080892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:43.081534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:43.081562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:43.081568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:43.081572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:43.081577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:43.084387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:43.084419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:43.084433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392643084
2025-10-02T08:10:43.084611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:43.084633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:43.084640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:43.084643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:43.084648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:43.084652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:43.085149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:43.085179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:43.085215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:43.085224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:43.085227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:43.085231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:43.085722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:43.085748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:43.085758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:43.085762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:43.085768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:43.085772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:43.086254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:43.086280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:43.086285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:43.087477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:43.087504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:43.087511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:43.087515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:43.087524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392643087
2025-10-02T08:10:43.087857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:43.087884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:43.087892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:43.087896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:43.087899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:43.087902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:43.088376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:43.088404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:43.088410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:43.088414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:43.088417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:43.088421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:43.088929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:43.088954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.089059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392643088
2025-10-02T08:10:43.094402Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:43.094441Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:43.094449Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:43.094456Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:43.094467Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:43.094470Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:43.094472Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:43.094482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533863906664449:11344]
2025-10-02T08:10:43.094490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533863906664449:11344]
2025-10-02T08:10:43.094541Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:43.094554Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:43.094583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:43.094593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.094594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:43.094751Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:43.113830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533863906664482:10816]
2025-10-02T08:10:43.114001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 957, pipe: [1:7556533863906664482:10816]
2025-10-02T08:10:43.229367Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:43.229699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906664482:10816], now have 1 active actors on pipe
2025-10-02T08:10:43.230009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:43.229902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533863906664482:10816]
2025-10-02T08:10:43.229912Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:43.229923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:43.229946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 958 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0
2025-10-02T08:10:43.230121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 958 sessionId: src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0 is DEAD
2025-10-02T08:10:43.230332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:43.230349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0] Write session will restart in 0.005258s
2025-10-02T08:10:43.230372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0] Write session: Do CDS request
2025-10-02T08:10:43.230377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:43.234675Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [dc68ce8d36b75df1] Result# TEvPutResult {Id# [72075186224037892:957:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:43.234696Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:957:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:43.234781Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:957:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:43.237415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.237488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:43.237501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 959
2025-10-02T08:10:43.237640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.237662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:43.237669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:43.237672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:43.238062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 959 sessionId:  describe result for acl check
2025-10-02T08:10:43.238098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:43.238104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:43.238106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:43.238112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533863906664526:11352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:43.238597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533863906664526:11352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:43.242579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533863906664526:11352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:43.245307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533863906664526:11352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:43.245322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533863906664526:11352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:43.245326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533863906664526:11352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:43.245334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:43.255008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:43.257881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:43.258354Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:43.258367Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:43.258376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:43.258424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:43.258453Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533863906665188:11351]
2025-10-02T08:10:43.258992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:43.259182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:43.259231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:43.259505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:43.259552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.259558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.259559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.259560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.259561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.259565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.259575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.259582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.259586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.259589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.259593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.259604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.259613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.259617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.259621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.259625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.259633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.259637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.259648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.259656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.259686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:43.268065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:43.269600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:43.269624Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:43.269626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:43.269629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:43.269636Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 958 [1:7556533863906665188:11351]
2025-10-02T08:10:43.269648Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:43.269665Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:43.269668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.269671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.269673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.269689Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:43.269694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:43.269702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:43.269762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.269771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.269774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:43.269777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:43.269840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:43.269850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.269864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.269876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:43.269893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533863906665182:11351]
2025-10-02T08:10:43.269895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533863906665182:11351]
2025-10-02T08:10:43.269902Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:43.270034Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 958
2025-10-02T08:10:43.269914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906664911:11352], now have 1 active actors on pipe
2025-10-02T08:10:43.269926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:43.269929Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:43.269931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:43.269944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:43.269946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:43.269952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533864366733024:2378], now have 1 active actors on pipe
2025-10-02T08:10:43.269960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 958
2025-10-02T08:10:43.269981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.269985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.269997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533863906665182:11351]
2025-10-02T08:10:43.270006Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:43.270014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:43.270031Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cad486-3040e0c5-702baaa3-5f306608_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:43.270037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.270043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.270045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:43.270054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.270062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:43.270084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.270167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.270174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.270199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.270243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 959 partition: 0 MaxSeqNo: 17 sessionId: src_id|cad486-3040e0c5-702baaa3-5f306608_0
2025-10-02T08:10:43.270674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b00716-a43a45d8-508386b7-5ad9775c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cad486-3040e0c5-702baaa3-5f306608_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:43.274000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad486-3040e0c5-702baaa3-5f306608_0] Write session: try to update token
2025-10-02T08:10:43.274023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad486-3040e0c5-702baaa3-5f306608_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:43.288095Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:43.288116Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:43.288119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:43.288128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533863906665182:11351]
2025-10-02T08:10:43.288132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533863906665182:11351]
2025-10-02T08:10:43.288173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:43.288179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.288179Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:43.288181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:43.288186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:43.288334Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:43.295831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId: src_id|cad486-3040e0c5-702baaa3-5f306608_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:43.298597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:43.329831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533863906665212:10816]
2025-10-02T08:10:43.329968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 958, pipe: [1:7556533863906665212:10816]
2025-10-02T08:10:43.441912Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:43.442616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.442636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.442657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906665212:10816], now have 1 active actors on pipe
2025-10-02T08:10:43.442787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533863906665212:10816]
2025-10-02T08:10:43.442818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:43.442824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:43.442881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 959 reason: error at write: Disconnected sessionId: src_id|cad486-3040e0c5-702baaa3-5f306608_0
2025-10-02T08:10:43.442931Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:43.443073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 959 sessionId: src_id|cad486-3040e0c5-702baaa3-5f306608_0 is DEAD
2025-10-02T08:10:43.443459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad486-3040e0c5-702baaa3-5f306608_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:43.443469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad486-3040e0c5-702baaa3-5f306608_0] Write session will restart in 0.007708s
2025-10-02T08:10:43.443499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad486-3040e0c5-702baaa3-5f306608_0] Write session: Do CDS request
2025-10-02T08:10:43.443509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad486-3040e0c5-702baaa3-5f306608_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:43.444000Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:43.452504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad486-3040e0c5-702baaa3-5f306608_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.452570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:43.452601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 960
2025-10-02T08:10:43.452873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.452911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:43.452920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:43.452924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:43.453320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 960 sessionId:  describe result for acl check
2025-10-02T08:10:43.453376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:43.453384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:43.453386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:43.453391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533863906665252:11358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:43.453948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533863906665252:11358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:43.458440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533863906665252:11358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:43.461197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533863906665252:11358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:43.461215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533863906665252:11358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:43.461218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533863906665252:11358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:43.461226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:43.474310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:43.474751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:43.474927Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:43.474937Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:43.474946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:43.474985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:43.475019Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533863906665921:11357]
2025-10-02T08:10:43.475727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:43.475916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:43.475952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:43.476250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:43.476290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.476291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.476292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.476294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.476295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.476299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.476308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.476312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.476316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.476320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.476326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.476333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.476340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.476350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.476355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.476359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.476363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.476368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.476372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.476377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.476396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:43.485069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:43.486916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:43.486934Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:43.486937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:43.486941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:43.486947Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 959 [1:7556533863906665921:11357]
2025-10-02T08:10:43.486960Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:43.486978Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:43.486981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.486984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.486986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.487000Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:43.487005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:43.487011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:43.487072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.487080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.487083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:43.487086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:43.487166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:43.487173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.487187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.487474Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 959
2025-10-02T08:10:43.487203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:43.487224Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533863906665915:11357]
2025-10-02T08:10:43.487226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533863906665915:11357]
2025-10-02T08:10:43.487232Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:43.487244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906665665:11358], now have 1 active actors on pipe
2025-10-02T08:10:43.487244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 959
2025-10-02T08:10:43.487252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:43.487260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:43.487263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:43.487265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:43.487267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:43.487300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533864366733031:2378], now have 1 active actors on pipe
2025-10-02T08:10:43.487304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.487308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.487321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533863906665915:11357]
2025-10-02T08:10:43.487323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:43.487350Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|825ef916-315919f5-73faf835-61fd9092_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:43.487356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.487359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.487361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:43.487370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.487370Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:43.487379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:43.487398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.487442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.487445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.487457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.487493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 960 partition: 0 MaxSeqNo: 17 sessionId: src_id|825ef916-315919f5-73faf835-61fd9092_0
2025-10-02T08:10:43.488743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad486-3040e0c5-702baaa3-5f306608_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|825ef916-315919f5-73faf835-61fd9092_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:43.492129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825ef916-315919f5-73faf835-61fd9092_0] Write session: try to update token
2025-10-02T08:10:43.492154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825ef916-315919f5-73faf835-61fd9092_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:43.510083Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:43.510105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:43.510107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:43.510116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533863906665915:11357]
2025-10-02T08:10:43.510121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533863906665915:11357]
2025-10-02T08:10:43.510163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:43.510166Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:43.510171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.510172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:43.510173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:43.510327Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:43.566552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533863906665958:10816]
2025-10-02T08:10:43.568662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId: src_id|825ef916-315919f5-73faf835-61fd9092_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:43.571085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:43.571215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 959, pipe: [1:7556533863906665958:10816]
2025-10-02T08:10:43.653816Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:43.654385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.654392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.654410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906665958:10816], now have 1 active actors on pipe
2025-10-02T08:10:43.654653Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:43.654698Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:43.654840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:43.654969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 960 reason: status is not ok: tablet will be restarted right now sessionId: src_id|825ef916-315919f5-73faf835-61fd9092_0
2025-10-02T08:10:43.655000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533863906665958:10816]
2025-10-02T08:10:43.655187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 960 sessionId: src_id|825ef916-315919f5-73faf835-61fd9092_0 is DEAD
2025-10-02T08:10:43.655594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825ef916-315919f5-73faf835-61fd9092_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:43.655609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825ef916-315919f5-73faf835-61fd9092_0] Write session will restart in 0.006571s
2025-10-02T08:10:43.655638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825ef916-315919f5-73faf835-61fd9092_0] Write session: Do CDS request
2025-10-02T08:10:43.655646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825ef916-315919f5-73faf835-61fd9092_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:43.665530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825ef916-315919f5-73faf835-61fd9092_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.666055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:43.666072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 961
2025-10-02T08:10:43.666246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.666276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:43.666286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:43.666289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:43.666872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 961 sessionId:  describe result for acl check
2025-10-02T08:10:43.666925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:43.666934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:43.666936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:43.666943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533863906666470:11377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:43.667634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533863906666470:11377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:43.670346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533863906666470:11377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:43.673853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533863906666470:11377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:43.673869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533863906666470:11377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:43.673873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533863906666470:11377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:43.673879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:43.676828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:43.677155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:43.677297Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:43.677309Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:43.677317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:43.677355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:43.677385Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533863906666691:11376]
2025-10-02T08:10:43.677946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:43.678144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:43.678168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:43.678393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:43.678415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.678416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.678416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.678417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.678418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.678421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.678433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.678436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.678440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.678442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.678448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.678454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.678458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.678463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.678467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.678471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.678474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.678478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.678482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.678486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.678503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:43.686576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:43.688851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:43.688868Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:43.688870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:43.688873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:43.688879Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 960 [1:7556533863906666691:11376]
2025-10-02T08:10:43.688889Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:43.688907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:43.688910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.688913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.688914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.688929Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:43.688934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:43.688940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:43.688993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.689000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.689003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:43.689005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:43.689073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:43.689085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.689096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.689107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:43.689125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906666680:11377], now have 1 active actors on pipe
2025-10-02T08:10:43.689137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533863906666685:11376]
2025-10-02T08:10:43.689139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533863906666685:11376]
2025-10-02T08:10:43.689143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 960
2025-10-02T08:10:43.689145Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:43.689154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533864366733063:2378], now have 1 active actors on pipe
2025-10-02T08:10:43.689157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:43.689160Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:43.689161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:43.689173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:43.689176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:43.689182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.689185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.689219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533863906666685:11376]
2025-10-02T08:10:43.689232Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:43.689237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:43.689249Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9944f443-a31a55c3-d63f108-413f11a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:43.689259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.689262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.689264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:43.689273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.689247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 960
2025-10-02T08:10:43.689285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:43.689328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.689401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.689407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.689419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.689452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 961 partition: 0 MaxSeqNo: 17 sessionId: src_id|9944f443-a31a55c3-d63f108-413f11a0_0
2025-10-02T08:10:43.689836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825ef916-315919f5-73faf835-61fd9092_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9944f443-a31a55c3-d63f108-413f11a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:43.693170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9944f443-a31a55c3-d63f108-413f11a0_0] Write session: try to update token
2025-10-02T08:10:43.693190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9944f443-a31a55c3-d63f108-413f11a0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:43.707144Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:43.707162Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:43.707165Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:43.707174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533863906666685:11376]
2025-10-02T08:10:43.707178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533863906666685:11376]
2025-10-02T08:10:43.707214Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:43.707217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:43.707218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:43.707224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.707226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:43.707366Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:43.716268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId: src_id|9944f443-a31a55c3-d63f108-413f11a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:43.718806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:43.755370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533863906666717:10816]
2025-10-02T08:10:43.755487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 960, pipe: [1:7556533863906666717:10816]
2025-10-02T08:10:43.841662Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:43.841953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.841966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.841986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906666717:10816], now have 1 active actors on pipe
2025-10-02T08:10:43.842095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533863906666717:10816]
2025-10-02T08:10:43.842118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:43.842120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:43.842172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 961 reason: error at write: Disconnected sessionId: src_id|9944f443-a31a55c3-d63f108-413f11a0_0
2025-10-02T08:10:43.842172Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:43.842184Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:43.842357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 961 sessionId: src_id|9944f443-a31a55c3-d63f108-413f11a0_0 is DEAD
2025-10-02T08:10:43.842554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9944f443-a31a55c3-d63f108-413f11a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:43.842574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9944f443-a31a55c3-d63f108-413f11a0_0] Write session will restart in 0.005221s
2025-10-02T08:10:43.842608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9944f443-a31a55c3-d63f108-413f11a0_0] Write session: Do CDS request
2025-10-02T08:10:43.842615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9944f443-a31a55c3-d63f108-413f11a0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:43.849332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9944f443-a31a55c3-d63f108-413f11a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.852976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:43.852995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 962
2025-10-02T08:10:43.856346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:43.856396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:43.856405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:43.856410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:43.856844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 962 sessionId:  describe result for acl check
2025-10-02T08:10:43.856877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:43.856883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:43.856885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:43.856891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533863906667345:11384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:43.857364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533863906667345:11384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:43.859402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533863906667345:11384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:43.864044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:43.864441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:43.864446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533863906667345:11384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:43.864454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533863906667345:11384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:43.864458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533863906667345:11384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:43.864467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:43.864667Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:43.864679Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:43.864687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:43.864734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:43.864769Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533863906667433:11382]
2025-10-02T08:10:43.865371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:43.865532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:43.865571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:43.865857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:43.865903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.865908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.865909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.865910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.865911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.865915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.865925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.865928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.865932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.865935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.865942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.865949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:43.865954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.865959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:43.865968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.865973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:43.865981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.865986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.865990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.865995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.866014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:43.874262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:43.876417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:43.876433Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:43.876436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:43.876439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:43.876445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 961 [1:7556533863906667433:11382]
2025-10-02T08:10:43.876457Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:43.876471Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:43.876479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.876481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.876484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.876498Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:43.876506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:43.876512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:43.876575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.876581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.876584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:43.876587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:43.876648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:43.876655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.876667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:43.876682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:43.876699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533863906667423:11382]
2025-10-02T08:10:43.876705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533863906667423:11382]
2025-10-02T08:10:43.876711Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:43.876722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:43.876722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 961
2025-10-02T08:10:43.876727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906667431:11384], now have 1 active actors on pipe
2025-10-02T08:10:43.876735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:43.876735Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:43.876746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:43.876753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:43.876758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533864366733081:2378], now have 1 active actors on pipe
2025-10-02T08:10:43.876766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.876770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.876784Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 961
2025-10-02T08:10:43.876825Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533863906667423:11382]
2025-10-02T08:10:43.876833Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:43.876835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:43.876847Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1520d63f-871d8a82-68df2bc0-18676853_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:43.876864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:43.876873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:43.876875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:43.876884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:43.876892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:43.876941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.877020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:43.877027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:43.877039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:43.877076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 962 partition: 0 MaxSeqNo: 17 sessionId: src_id|1520d63f-871d8a82-68df2bc0-18676853_0
2025-10-02T08:10:43.878132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9944f443-a31a55c3-d63f108-413f11a0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1520d63f-871d8a82-68df2bc0-18676853_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:43.881690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1520d63f-871d8a82-68df2bc0-18676853_0] Write session: try to update token
2025-10-02T08:10:43.881717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1520d63f-871d8a82-68df2bc0-18676853_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:43.894358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:43.894379Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:43.894381Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:43.894390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533863906667423:11382]
2025-10-02T08:10:43.894395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533863906667423:11382]
2025-10-02T08:10:43.894430Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:43.894434Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:43.894436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:43.894443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:43.894445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:43.894656Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:43.902647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId: src_id|1520d63f-871d8a82-68df2bc0-18676853_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:43.905487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:43.942179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533863906667461:10816]
2025-10-02T08:10:43.942491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 961, pipe: [1:7556533863906667461:10816]
2025-10-02T08:10:44.037272Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:44.037858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.037873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.037895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533863906667461:10816], now have 1 active actors on pipe
2025-10-02T08:10:44.037993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533863906667461:10816]
2025-10-02T08:10:44.038013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:44.038020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:44.038071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 962 reason: error at write: Disconnected sessionId: src_id|1520d63f-871d8a82-68df2bc0-18676853_0
2025-10-02T08:10:44.038129Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:44.038151Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:44.038245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 962 sessionId: src_id|1520d63f-871d8a82-68df2bc0-18676853_0 is DEAD
2025-10-02T08:10:44.038447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1520d63f-871d8a82-68df2bc0-18676853_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:44.038463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1520d63f-871d8a82-68df2bc0-18676853_0] Write session will restart in 0.006632s
2025-10-02T08:10:44.038495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1520d63f-871d8a82-68df2bc0-18676853_0] Write session: Do CDS request
2025-10-02T08:10:44.038502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1520d63f-871d8a82-68df2bc0-18676853_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:44.046353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1520d63f-871d8a82-68df2bc0-18676853_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.046405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:44.046422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 963
2025-10-02T08:10:44.046581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.046614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:44.046624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:44.046627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:44.047085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 963 sessionId:  describe result for acl check
2025-10-02T08:10:44.047127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:44.047134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:44.047136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:44.047141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533868201635127:11390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:44.047687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533868201635127:11390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:44.050179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533868201635127:11390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:44.053117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533868201635127:11390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:44.053139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533868201635127:11390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:44.053142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533868201635127:11390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:44.053149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:44.059585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:44.060011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:44.060155Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:44.060162Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:44.060168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:44.060222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:44.060250Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533868201635465:11389]
2025-10-02T08:10:44.060693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:44.060891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:44.060934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:44.061154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:44.061183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.061187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.061187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.061188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.061189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.061192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.061198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.061200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.061203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.061204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.061208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.061212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.061215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.061218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.061220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.061223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.061225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.061228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.061230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.061233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.061243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:44.069407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:44.070978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:44.070992Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:44.070995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:44.070997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:44.071002Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 962 [1:7556533868201635465:11389]
2025-10-02T08:10:44.071012Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:44.071025Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:44.071026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.071028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.071030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.071042Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:44.071046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:44.071051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:44.071094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.071100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.071102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:44.071104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:44.071154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:44.071160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.071168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.071175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:44.071191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533868201635459:11389]
2025-10-02T08:10:44.071199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533868201635459:11389]
2025-10-02T08:10:44.071207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:44.071225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:44.071232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:44.071236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:44.071238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:44.071239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:44.071248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201635385:11390], now have 1 active actors on pipe
2025-10-02T08:10:44.071252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533868661700385:2378], now have 1 active actors on pipe
2025-10-02T08:10:44.071282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533868201635459:11389]
2025-10-02T08:10:44.071295Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:44.071312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:44.071311Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 962
2025-10-02T08:10:44.071359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 962
2025-10-02T08:10:44.071453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.071460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.071477Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|775d02df-e4730d84-8b62f45c-3eb30045_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:44.071484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.071487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.071488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:44.071496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.071506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:44.071519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.071543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.071547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.071556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.071585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 963 partition: 0 MaxSeqNo: 17 sessionId: src_id|775d02df-e4730d84-8b62f45c-3eb30045_0
2025-10-02T08:10:44.071964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1520d63f-871d8a82-68df2bc0-18676853_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|775d02df-e4730d84-8b62f45c-3eb30045_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:44.074937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775d02df-e4730d84-8b62f45c-3eb30045_0] Write session: try to update token
2025-10-02T08:10:44.074957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775d02df-e4730d84-8b62f45c-3eb30045_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:44.081663Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:44.081682Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:44.081690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533868201635459:11389]
2025-10-02T08:10:44.081729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:44.081732Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:44.081911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:44.082054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:44.082190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:44.082318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:44.082525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:44.082569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:44.090666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId: src_id|775d02df-e4730d84-8b62f45c-3eb30045_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:44.093288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:44.093370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.093384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.093418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:44.093443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:44.093502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.093519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.093669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.093735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.093791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.093848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.094359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.094371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.094443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.094507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.094569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.094633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.094671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.094676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.094736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.094788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.094844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.094901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.094947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.094953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.095017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.095082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.095149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.095204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.095246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.095255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.095317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.095373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.095434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.095494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.095534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.095539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.095606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.095660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.095728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.095783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.095825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.095831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.095890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.095952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.096014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.096078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.096123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.096129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.096190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.096245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.096319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.096379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.096431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.096437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.096496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.096552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.096616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.096684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.096728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.096734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.096792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.096876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.096937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.096999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.097048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.097050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.097099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:44.097153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.097166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.097168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:44.097197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:44.097209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:44.097212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:44.097214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:44.097216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:44.097652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:44.097679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:44.097689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:44.097695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:44.097699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:44.097701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:44.098292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:44.098311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:44.098320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:44.098323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:44.098325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:44.098328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:44.098815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:44.098833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:44.098837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:44.098840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:44.098844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:44.100881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:44.100899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:44.100912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392644100
2025-10-02T08:10:44.101045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:44.101056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:44.101062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:44.101068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:44.101070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:44.101072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:44.101505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:44.101524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:44.101528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:44.101535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:44.101537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:44.101541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:44.101950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:44.101970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:44.101979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:44.101986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:44.101989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:44.101992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:44.102393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:44.102411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:44.102415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:44.103552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:44.103569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:44.103574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:44.103577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:44.103583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392644103
2025-10-02T08:10:44.103870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:44.103893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:44.103900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:44.103904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:44.103907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:44.103910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:44.104342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:44.104362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:44.104366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:44.104368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:44.104371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:44.104376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:44.104790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:44.104825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.104897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392644104
2025-10-02T08:10:44.107118Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:44.107149Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:44.107158Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:44.107166Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:44.107182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:44.107190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:44.107192Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:44.107200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533868201635459:11389]
2025-10-02T08:10:44.107208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533868201635459:11389]
2025-10-02T08:10:44.107252Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:44.107265Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:44.107280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:44.107289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.107291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:44.107415Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:44.138329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533868201635494:10816]
2025-10-02T08:10:44.138422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 962, pipe: [1:7556533868201635494:10816]
2025-10-02T08:10:44.239703Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:44.240681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201635494:10816], now have 1 active actors on pipe
2025-10-02T08:10:44.240836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:44.240849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:44.240875Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:44.240882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 963 reason: error at write: Disconnected sessionId: src_id|775d02df-e4730d84-8b62f45c-3eb30045_0
2025-10-02T08:10:44.240994Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:44.241241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d02df-e4730d84-8b62f45c-3eb30045_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:44.241251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d02df-e4730d84-8b62f45c-3eb30045_0] Write session will restart in 0.009223s
2025-10-02T08:10:44.241274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d02df-e4730d84-8b62f45c-3eb30045_0] Write session: Do CDS request
2025-10-02T08:10:44.241280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d02df-e4730d84-8b62f45c-3eb30045_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:44.241084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 963 sessionId: src_id|775d02df-e4730d84-8b62f45c-3eb30045_0 is DEAD
2025-10-02T08:10:44.241182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533868201635494:10816]
2025-10-02T08:10:44.245231Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [c871d67f1e6af59e] Result# TEvPutResult {Id# [72075186224037892:962:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:44.245318Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:962:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:44.245396Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:962:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:44.251346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775d02df-e4730d84-8b62f45c-3eb30045_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.251475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:44.251491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 964
2025-10-02T08:10:44.251647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.251712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:44.251724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:44.251728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:44.252249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 964 sessionId:  describe result for acl check
2025-10-02T08:10:44.252286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:44.252293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:44.252294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:44.252299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533868201635828:11397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:44.252798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533868201635828:11397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:44.255750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533868201635828:11397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:44.260880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533868201635828:11397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:44.260899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533868201635828:11397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:44.260902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533868201635828:11397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:44.260910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:44.270956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:44.271446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:44.271639Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:44.271648Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:44.271655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:44.271702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:44.271733Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533868201636210:11396]
2025-10-02T08:10:44.272182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:44.272341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:44.272370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:44.272577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:44.272609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.272613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.272614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.272615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.272616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.272619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.272627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.272629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.272631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.272633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.272637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.272641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.272645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.272648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.272650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.272653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.272657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.272659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.272662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.272665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.272675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:44.281562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:44.283851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:44.283876Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:44.283878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:44.283883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:44.283890Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 963 [1:7556533868201636210:11396]
2025-10-02T08:10:44.283902Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:44.283921Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:44.283923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.283926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.283928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.283947Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:44.283952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:44.283960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:44.284033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.284044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.284047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:44.284050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:44.284117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:44.284126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.284141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.284152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:44.284170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533868201636204:11396]
2025-10-02T08:10:44.284177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533868201636204:11396]
2025-10-02T08:10:44.284185Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:44.284199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201636106:11397], now have 1 active actors on pipe
2025-10-02T08:10:44.284204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:44.284209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:44.284212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:44.284224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:44.284227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:44.284261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533868661700392:2378], now have 1 active actors on pipe
2025-10-02T08:10:44.284282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 963
2025-10-02T08:10:44.284286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533868201636204:11396]
2025-10-02T08:10:44.284289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:44.284310Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:44.284314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.284318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.284293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 963
2025-10-02T08:10:44.284346Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:44.284357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.284361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.284363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:44.284371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.284380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:44.284401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.284443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.284449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.284462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.284498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 964 partition: 0 MaxSeqNo: 17 sessionId: src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0
2025-10-02T08:10:44.284894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d02df-e4730d84-8b62f45c-3eb30045_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:44.287964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0] Write session: try to update token
2025-10-02T08:10:44.287983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:44.306689Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:44.306711Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:44.306714Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:44.306722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533868201636204:11396]
2025-10-02T08:10:44.306727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533868201636204:11396]
2025-10-02T08:10:44.306768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:44.306776Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:44.306779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.306782Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:44.306783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:44.306929Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:44.307395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId: src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:44.310294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:44.341592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533868201636234:10816]
2025-10-02T08:10:44.341715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 963, pipe: [1:7556533868201636234:10816]
2025-10-02T08:10:44.445559Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:44.446246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.446254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.446294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201636234:10816], now have 1 active actors on pipe
2025-10-02T08:10:44.446621Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:44.446676Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:44.447023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533868201636234:10816]
2025-10-02T08:10:44.447043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:44.447099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 964 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0
2025-10-02T08:10:44.447273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 964 sessionId: src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0 is DEAD
2025-10-02T08:10:44.447946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:44.447960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0] Write session will restart in 0.008206s
2025-10-02T08:10:44.447991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0] Write session: Do CDS request
2025-10-02T08:10:44.447999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:44.457420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.457905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:44.457923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 965
2025-10-02T08:10:44.458041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.458090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:44.458101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:44.458105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:44.458610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 965 sessionId:  describe result for acl check
2025-10-02T08:10:44.458650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:44.458656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:44.458658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:44.458663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533868201636632:11405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:44.459196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533868201636632:11405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:44.462957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533868201636632:11405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:44.466230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533868201636632:11405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:44.466248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533868201636632:11405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:44.466252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533868201636632:11405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:44.466260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:44.475465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:44.475991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:44.476429Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:44.476438Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:44.476447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:44.476492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:44.476522Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533868201636954:11402]
2025-10-02T08:10:44.476999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:44.477191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:44.477231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:44.477456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:44.477487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.477491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.477492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.477492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.477493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.477496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.477503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.477505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.477507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.477509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.477513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.477517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.477521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.477524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.477527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.477530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.477532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.477535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.477538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.477541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.477553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:44.486355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:44.488256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:44.488279Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:44.488282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:44.488286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:44.488294Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 964 [1:7556533868201636954:11402]
2025-10-02T08:10:44.488309Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:44.488330Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:44.488339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.488343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.488344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.488364Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:44.488373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:44.488380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:44.488457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.488469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.488471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:44.488474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:44.488547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:44.488555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.488569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.488584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:44.488608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201636856:11405], now have 1 active actors on pipe
2025-10-02T08:10:44.488623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 964
2025-10-02T08:10:44.488625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533868201636948:11402]
2025-10-02T08:10:44.488628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533868201636948:11402]
2025-10-02T08:10:44.488635Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:44.488646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533868661700399:2378], now have 1 active actors on pipe
2025-10-02T08:10:44.488652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:44.488653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:44.488655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:44.488665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:44.488673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:44.488681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.488689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.488730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533868201636948:11402]
2025-10-02T08:10:44.488747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:44.488757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:44.488771Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:44.488784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.488788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.488790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:44.488797Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 964
2025-10-02T08:10:44.488846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.488863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:44.488911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.488971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.488974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.488989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.489019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 965 partition: 0 MaxSeqNo: 17 sessionId: src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0
2025-10-02T08:10:44.489529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc8eb73-3046426d-f714d4a6-74fcb247_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:44.492413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0] Write session: try to update token
2025-10-02T08:10:44.492428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:44.507962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId: src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:44.511513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:44.514662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.514690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.514711Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:44.514714Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:44.514717Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:44.514724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533868201636948:11402]
2025-10-02T08:10:44.514728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533868201636948:11402]
2025-10-02T08:10:44.514771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:44.514780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:44.514784Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:44.514787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.514790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:44.514939Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:44.547411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533868201636978:10816]
2025-10-02T08:10:44.547501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 964, pipe: [1:7556533868201636978:10816]
2025-10-02T08:10:44.663370Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:44.663821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:44.663869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:44.663876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201636978:10816], now have 1 active actors on pipe
2025-10-02T08:10:44.663977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:44.663985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:44.664003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 965 reason: error at write: Disconnected sessionId: src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0
2025-10-02T08:10:44.664100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:44.664160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 965 sessionId: src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0 is DEAD
2025-10-02T08:10:44.664303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:44.664310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0] Write session will restart in 0.005777s
2025-10-02T08:10:44.664343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0] Write session: Do CDS request
2025-10-02T08:10:44.664349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:44.664327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533868201636978:10816]
2025-10-02T08:10:44.671222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.671427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:44.671442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 966
2025-10-02T08:10:44.671566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.671612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:44.671625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:44.671629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:44.672089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 966 sessionId:  describe result for acl check
2025-10-02T08:10:44.672125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:44.672132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:44.672133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:44.672138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533868201637339:11424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:44.672646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533868201637339:11424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:44.675178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533868201637339:11424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:44.678784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533868201637339:11424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:44.678803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533868201637339:11424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:44.678807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533868201637339:11424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:44.678816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:44.686239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:44.686637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:44.686818Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:44.686829Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:44.686839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:44.686885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:44.686924Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533868201637734:11423]
2025-10-02T08:10:44.687517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:44.687709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:44.687753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:44.688045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:44.688100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.688107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.688108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.688110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.688111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.688115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.688125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.688128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.688132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.688136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.688143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.688151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.688156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.688161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.688166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.688172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.688177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.688183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.688187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.688192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.688209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:44.696934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:44.698838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:44.698854Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:44.698857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:44.698859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:44.698864Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 965 [1:7556533868201637734:11423]
2025-10-02T08:10:44.698872Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:44.698884Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:44.698885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.698887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.698888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.698899Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:44.698903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:44.698907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:44.698952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.698958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.698961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:44.698962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:44.699009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:44.699016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.699029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.699041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:44.699059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533868201637728:11423]
2025-10-02T08:10:44.699064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533868201637728:11423]
2025-10-02T08:10:44.699070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:44.699079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:44.699081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:44.699085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:44.699091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:44.699093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:44.699102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201637630:11424], now have 1 active actors on pipe
2025-10-02T08:10:44.699105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533868661700431:2378], now have 1 active actors on pipe
2025-10-02T08:10:44.699114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 965
2025-10-02T08:10:44.699131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533868201637728:11423]
2025-10-02T08:10:44.699143Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:44.699149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:44.699155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.699158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.699200Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:44.699209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.699211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.699213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:44.699219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.699225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:44.699198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 965
2025-10-02T08:10:44.699242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.699278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.699283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.699292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.699320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 966 partition: 0 MaxSeqNo: 17 sessionId: src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0
2025-10-02T08:10:44.699685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a45e57a-b4b197b5-2090d1f1-b22c64a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:44.702321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0] Write session: try to update token
2025-10-02T08:10:44.702336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:44.717053Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:44.717077Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:44.717079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:44.717088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533868201637728:11423]
2025-10-02T08:10:44.717092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533868201637728:11423]
2025-10-02T08:10:44.717134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:44.717141Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:44.717145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.717146Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:44.717147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:44.717295Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:44.717726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId: src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:44.720371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:44.764515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533868201637760:10816]
2025-10-02T08:10:44.764680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 965, pipe: [1:7556533868201637760:10816]
2025-10-02T08:10:44.847797Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:44.848364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.848376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.848408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201637760:10816], now have 1 active actors on pipe
2025-10-02T08:10:44.848550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533868201637760:10816]
2025-10-02T08:10:44.848571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:44.848573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:44.848626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 966 reason: error at write: Disconnected sessionId: src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0
2025-10-02T08:10:44.848634Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:44.848836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 966 sessionId: src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0 is DEAD
2025-10-02T08:10:44.848953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:44.848961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0] Write session will restart in 0.009363s
2025-10-02T08:10:44.848986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0] Write session: Do CDS request
2025-10-02T08:10:44.848996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:44.848878Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:44.861328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.861399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:44.861418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 967
2025-10-02T08:10:44.861630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:44.861662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:44.861671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:44.861674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:44.862108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 967 sessionId:  describe result for acl check
2025-10-02T08:10:44.862158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:44.862165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:44.862167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:44.862172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533868201638276:11431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:44.862740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533868201638276:11431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:44.865749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533868201638276:11431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:44.870661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533868201638276:11431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:44.870678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533868201638276:11431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:44.870682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533868201638276:11431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:44.870690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:44.873902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:44.874359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:44.874503Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:44.874511Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:44.874519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:44.874563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:44.874596Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533868201638488:11429]
2025-10-02T08:10:44.875135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:44.875338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:44.875374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:44.875615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:44.875646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.875652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.875653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.875654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.875654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.875658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.875665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.875677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.875681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.875684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.875690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.875695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:44.875698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.875702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:44.875705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.875708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:44.875711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.875714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.875717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.875721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.875735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:44.884552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:44.886208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:44.886225Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:44.886228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:44.886232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:44.886239Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 966 [1:7556533868201638488:11429]
2025-10-02T08:10:44.886254Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:44.886274Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:44.886277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.886281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.886283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.886301Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:44.886306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:44.886314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:44.886380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.886387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.886390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:44.886393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:44.886459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:44.886468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.886482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:44.886494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:44.886514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201638479:11431], now have 1 active actors on pipe
2025-10-02T08:10:44.886520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533868201638482:11429]
2025-10-02T08:10:44.886523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533868201638482:11429]
2025-10-02T08:10:44.886530Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:44.886532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 966
2025-10-02T08:10:44.886540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:44.886542Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:44.886547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:44.886559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:44.886562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:44.886568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533868661700450:2378], now have 1 active actors on pipe
2025-10-02T08:10:44.886573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.886577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.886619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533868201638482:11429]
2025-10-02T08:10:44.886627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:44.886630Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:44.886641Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e133bbe5-33332da8-82c7bd10-f551124_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:44.886610Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 966
2025-10-02T08:10:44.886648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.886656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.886658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:44.886668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.886680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:44.886728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.886802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.886819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.886835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:44.886878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 967 partition: 0 MaxSeqNo: 17 sessionId: src_id|e133bbe5-33332da8-82c7bd10-f551124_0
2025-10-02T08:10:44.887234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f71133c-7aff7d5b-6bb9d106-c215ee61_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e133bbe5-33332da8-82c7bd10-f551124_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:44.889935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e133bbe5-33332da8-82c7bd10-f551124_0] Write session: try to update token
2025-10-02T08:10:44.889949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e133bbe5-33332da8-82c7bd10-f551124_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:44.898440Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:44.898462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:44.898472Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533868201638482:11429]
2025-10-02T08:10:44.898521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:44.898519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:44.898720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:44.898888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:44.899052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:44.899222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:44.899443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:44.899488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:44.908591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId: src_id|e133bbe5-33332da8-82c7bd10-f551124_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:44.911375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:44.911459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.911472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.911510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:44.911534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:44.911824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:44.911841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:44.912036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.912122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.912233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.912303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.912564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.912575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.912655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.912725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.912798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.912893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.912949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.912957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.913034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.913106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.913210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.913324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.913376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.913384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.913461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.913541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.913618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.913712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.913767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.913775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.913870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.913939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.914005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.914079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.914129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.914138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.914213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.914287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.914363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.914439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.914492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.914500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.914577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.914652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.914722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.914795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.914844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.914852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.914926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.914996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.915076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.915148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.915198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.915204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.915278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.915348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.915419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.915488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.915544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.915552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.915625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:44.915701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:44.915772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:44.915838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:44.915890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:44.915898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:44.915967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:44.916036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:44.916062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:44.916065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:44.916098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:44.916118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:44.916126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:44.916129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:44.916133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:44.916573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:44.916603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:44.916610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:44.916613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:44.916616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:44.916621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:44.917343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:44.917368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:44.917375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:44.917379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:44.917384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:44.917387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:44.917915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:44.917939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:44.917944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:44.917952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:44.917955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:44.919388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:44.919409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:44.919420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392644919
2025-10-02T08:10:44.919546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:44.919561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:44.919569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:44.919572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:44.919576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:44.919580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:44.920167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:44.920190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:44.920195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:44.920199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:44.920203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:44.920208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:44.920739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:44.920766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:44.920773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:44.920776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:44.920782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:44.920787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:44.921369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:44.921394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:44.921404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:44.922602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:44.922624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:44.922629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:44.922633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:44.922642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392644922
2025-10-02T08:10:44.922954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:44.922979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:44.922986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:44.922989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:44.922993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:44.922997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:44.923501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:44.923525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:44.923531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:44.923535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:44.923539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:44.923542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:44.924099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:44.924121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:44.924237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392644924
2025-10-02T08:10:44.926879Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:44.926908Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:44.926915Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:44.926922Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:44.926935Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:44.926937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:44.926940Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:44.926952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533868201638482:11429]
2025-10-02T08:10:44.926957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533868201638482:11429]
2025-10-02T08:10:44.927016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:44.927029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:44.927046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:44.927051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:44.927053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:44.927211Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:44.948839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533868201638515:10816]
2025-10-02T08:10:44.948983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 966, pipe: [1:7556533868201638515:10816]
2025-10-02T08:10:45.077780Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:45.078251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533868201638515:10816], now have 1 active actors on pipe
2025-10-02T08:10:45.078567Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:45.078448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:45.078456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:45.078492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 967 reason: error at write: Disconnected sessionId: src_id|e133bbe5-33332da8-82c7bd10-f551124_0
2025-10-02T08:10:45.078566Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:45.078668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 967 sessionId: src_id|e133bbe5-33332da8-82c7bd10-f551124_0 is DEAD
2025-10-02T08:10:45.078843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533868201638515:10816]
2025-10-02T08:10:45.079081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e133bbe5-33332da8-82c7bd10-f551124_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:45.079095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e133bbe5-33332da8-82c7bd10-f551124_0] Write session will restart in 0.005335s
2025-10-02T08:10:45.079117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e133bbe5-33332da8-82c7bd10-f551124_0] Write session: Do CDS request
2025-10-02T08:10:45.079123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e133bbe5-33332da8-82c7bd10-f551124_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:45.083241Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [c722d362376f3d5a] Result# TEvPutResult {Id# [72075186224037892:966:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:45.083255Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:966:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:45.083331Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:966:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:45.085305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e133bbe5-33332da8-82c7bd10-f551124_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:45.085570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:45.085587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 968
2025-10-02T08:10:45.085842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:45.085884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:45.085895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:45.085899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:45.086429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 968 sessionId:  describe result for acl check
2025-10-02T08:10:45.086466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:45.086483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:45.086484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:45.086490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533872496605857:11438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:45.087022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533872496605857:11438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:45.091734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533872496605857:11438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:45.095623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533872496605857:11438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:45.095645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533872496605857:11438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:45.095648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533872496605857:11438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:45.095656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:45.109154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:45.112493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:45.112687Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:45.112696Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:45.112705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:45.112749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:45.112791Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533872496606537:11437]
2025-10-02T08:10:45.113451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:45.113798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:45.113841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:45.114160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:45.114216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.114221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.114222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.114223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.114224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.114229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.114240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.114243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.114246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.114250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.114261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.114272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.114282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.114292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.114300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.114305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.114314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.114319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.114323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.114328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.114351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:45.123171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:45.125090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:45.125109Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:45.125111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:45.125115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:45.125122Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 967 [1:7556533872496606537:11437]
2025-10-02T08:10:45.125134Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:45.125152Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:45.125154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:45.125157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:45.125160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:45.125174Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:45.125180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:45.125186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:45.125248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.125258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.125261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:45.125263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:45.125335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:45.125343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.125358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.125376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:45.125398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533872496606237:11438], now have 1 active actors on pipe
2025-10-02T08:10:45.125404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533872496606531:11437]
2025-10-02T08:10:45.125404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 967
2025-10-02T08:10:45.125406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533872496606531:11437]
2025-10-02T08:10:45.125421Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:45.125432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533872956667754:2378], now have 1 active actors on pipe
2025-10-02T08:10:45.125443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.125447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.125463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:45.125480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:45.125489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:45.125512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:45.125523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:45.125527Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|206efaa5-3d650709-6feadd1f-888173b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:45.125534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:45.125537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:45.125539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:45.125548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:45.125556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:45.125562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533872496606531:11437]
2025-10-02T08:10:45.125573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:45.125593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:45.125594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:45.125711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.125725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.125759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:45.125802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 968 partition: 0 MaxSeqNo: 17 sessionId: src_id|206efaa5-3d650709-6feadd1f-888173b7_0
2025-10-02T08:10:45.126127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e133bbe5-33332da8-82c7bd10-f551124_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|206efaa5-3d650709-6feadd1f-888173b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:45.128665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|206efaa5-3d650709-6feadd1f-888173b7_0] Write session: try to update token
2025-10-02T08:10:45.128680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|206efaa5-3d650709-6feadd1f-888173b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:45.125637Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 967
2025-10-02T08:10:45.144610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId: src_id|206efaa5-3d650709-6feadd1f-888173b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:45.147151Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:45.147174Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:45.147176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:45.147185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533872496606531:11437]
2025-10-02T08:10:45.147189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533872496606531:11437]
2025-10-02T08:10:45.147237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:45.147245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.147248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:45.147246Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:45.147253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:45.147386Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:45.147652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:45.179206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533872496606561:10816]
2025-10-02T08:10:45.179380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 967, pipe: [1:7556533872496606561:10816]
2025-10-02T08:10:45.314695Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:45.315093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.315112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.315169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533872496606561:10816], now have 1 active actors on pipe
2025-10-02T08:10:45.315359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:45.315374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:45.315380Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:45.315436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 968 reason: error at write: Disconnected sessionId: src_id|206efaa5-3d650709-6feadd1f-888173b7_0
2025-10-02T08:10:45.315601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 968 sessionId: src_id|206efaa5-3d650709-6feadd1f-888173b7_0 is DEAD
2025-10-02T08:10:45.315722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533872496606561:10816]
2025-10-02T08:10:45.315404Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:45.316940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|206efaa5-3d650709-6feadd1f-888173b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:45.316957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|206efaa5-3d650709-6feadd1f-888173b7_0] Write session will restart in 0.008533s
2025-10-02T08:10:45.316988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|206efaa5-3d650709-6feadd1f-888173b7_0] Write session: Do CDS request
2025-10-02T08:10:45.316995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|206efaa5-3d650709-6feadd1f-888173b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:45.329292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|206efaa5-3d650709-6feadd1f-888173b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:45.333123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:45.333144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 969
2025-10-02T08:10:45.333295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:45.333331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:45.333342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:45.333346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:45.334175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 969 sessionId:  describe result for acl check
2025-10-02T08:10:45.334215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:45.334222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:45.334223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:45.334229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533872496607151:11444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:45.334771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533872496607151:11444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:45.338089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533872496607151:11444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:45.342606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533872496607151:11444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:45.342622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533872496607151:11444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:45.342626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533872496607151:11444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:45.342634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:45.345417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:45.347460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:45.347689Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:45.347701Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:45.347712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:45.347765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:45.347805Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533872496607283:11443]
2025-10-02T08:10:45.348491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:45.348691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:45.348736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:45.349065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:45.349115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.349121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.349123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.349124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.349125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.349131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.349141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.349146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.349150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.349154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.349159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.349167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.349173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.349183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.349188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.349193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.349202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.349208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.349218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.349223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.349247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:45.361945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:45.363944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:45.363963Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:45.363966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:45.363970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:45.363976Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 968 [1:7556533872496607283:11443]
2025-10-02T08:10:45.363988Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:45.364006Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:45.364009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:45.364011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:45.364013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:45.364027Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:45.364033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:45.364039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:45.364100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.364115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.364118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:45.364120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:45.364194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:45.364204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.364217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.364227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:45.364250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533872496607273:11444], now have 1 active actors on pipe
2025-10-02T08:10:45.364263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533872496607277:11443]
2025-10-02T08:10:45.364266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 968
2025-10-02T08:10:45.364270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533872496607277:11443]
2025-10-02T08:10:45.364282Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:45.364291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533872956667762:2378], now have 1 active actors on pipe
2025-10-02T08:10:45.364298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:45.364298Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:45.364314Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:45.364317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:45.364322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:45.364329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.364332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.364373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533872496607277:11443]
2025-10-02T08:10:45.364380Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:45.364389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:45.364395Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:45.364406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:45.364409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:45.364415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:45.364424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:45.364396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 968
2025-10-02T08:10:45.364438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:45.364481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:45.364565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.364571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.364584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:45.364618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 969 partition: 0 MaxSeqNo: 17 sessionId: src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0
2025-10-02T08:10:45.365919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|206efaa5-3d650709-6feadd1f-888173b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:45.369422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0] Write session: try to update token
2025-10-02T08:10:45.369450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:45.376596Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:45.376618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:45.376628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533872496607277:11443]
2025-10-02T08:10:45.376670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:45.376861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:45.377005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:45.377141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:45.377280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:45.377462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:45.377498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:45.377885Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:45.395891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId: src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:45.397282Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:45.397299Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:45.397301Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:45.397310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533872496607277:11443]
2025-10-02T08:10:45.397314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533872496607277:11443]
2025-10-02T08:10:45.397355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:45.397362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.397365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:45.397492Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:45.398406Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:45.398420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:45.398675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:45.416277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533872496607309:10816]
2025-10-02T08:10:45.416453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 968, pipe: [1:7556533872496607309:10816]
2025-10-02T08:10:45.555590Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:45.556186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.556204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.556226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533872496607309:10816], now have 1 active actors on pipe
2025-10-02T08:10:45.556357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533872496607309:10816]
2025-10-02T08:10:45.556385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:45.556388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:45.556446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 969 reason: error at write: Disconnected sessionId: src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0
2025-10-02T08:10:45.556466Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:45.556466Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:45.556616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 969 sessionId: src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0 is DEAD
2025-10-02T08:10:45.556890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:45.556903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0] Write session will restart in 0.007384s
2025-10-02T08:10:45.556933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0] Write session: Do CDS request
2025-10-02T08:10:45.556941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:45.565306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:45.565634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:45.565651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 970
2025-10-02T08:10:45.565782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:45.565811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:45.565821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:45.565824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:45.566175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 970 sessionId:  describe result for acl check
2025-10-02T08:10:45.566207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:45.566213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:45.566215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:45.566219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533872496607671:11450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:45.566802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533872496607671:11450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:45.569370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533872496607671:11450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:45.572390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533872496607671:11450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:45.572410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533872496607671:11450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:45.572413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533872496607671:11450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:45.572421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:45.581882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:45.582558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:45.582767Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:45.582777Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:45.582788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:45.582847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:45.582893Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533872496608038:11449]
2025-10-02T08:10:45.583518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:45.583779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:45.583829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:45.584161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:45.584213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.584214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.584215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.584216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.584217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.584222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.584231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.584235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.584240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.584244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.584249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.584256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.584262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.584266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.584271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.584275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.584279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.584284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.584289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.584294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.584309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:45.596051Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 969
2025-10-02T08:10:45.593725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:45.595662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:45.595670Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:45.595687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:45.595691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:45.595697Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 969 [1:7556533872496608038:11449]
2025-10-02T08:10:45.595707Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:45.595721Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:45.595723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:45.595725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:45.595727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:45.595740Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:45.595744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:45.595750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:45.595820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.595821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.595824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:45.595827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:45.595888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:45.595891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.595903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.595915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:45.595932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533872496607931:11450], now have 1 active actors on pipe
2025-10-02T08:10:45.595939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533872496608032:11449]
2025-10-02T08:10:45.595941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533872496608032:11449]
2025-10-02T08:10:45.595948Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:45.595961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:45.595962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:45.595963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:45.595975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:45.595978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:45.596011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533872956667770:2378], now have 1 active actors on pipe
2025-10-02T08:10:45.596014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533872496608032:11449]
2025-10-02T08:10:45.596022Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:45.596028Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:45.596061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 969
2025-10-02T08:10:45.596070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.596073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.596102Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9917992-bdb480b5-5ac52e58-917a6076_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:45.596109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:45.596113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:45.596115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:45.596125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:45.596134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:45.596743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:45.596830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.596837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.596854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:45.596890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 970 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9917992-bdb480b5-5ac52e58-917a6076_0
2025-10-02T08:10:45.600922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a5bfd-75ffbe91-cb34ec98-d5bc6c8a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9917992-bdb480b5-5ac52e58-917a6076_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:45.603828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9917992-bdb480b5-5ac52e58-917a6076_0] Write session: try to update token
2025-10-02T08:10:45.603850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9917992-bdb480b5-5ac52e58-917a6076_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:45.618830Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:45.618853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:45.618855Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:45.618864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533872496608032:11449]
2025-10-02T08:10:45.618868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533872496608032:11449]
2025-10-02T08:10:45.618917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:45.618924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.618926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:45.618926Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:45.618934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:45.619105Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:45.662059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId: src_id|a9917992-bdb480b5-5ac52e58-917a6076_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:45.664583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:45.664653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533872496608080:10816]
2025-10-02T08:10:45.667641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 969, pipe: [1:7556533872496608080:10816]
2025-10-02T08:10:45.777613Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:45.778194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.778208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.778227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533872496608080:10816], now have 1 active actors on pipe
2025-10-02T08:10:45.778426Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:45.778456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533872496608080:10816]
2025-10-02T08:10:45.778483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:45.778548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 970 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9917992-bdb480b5-5ac52e58-917a6076_0
2025-10-02T08:10:45.778726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 970 sessionId: src_id|a9917992-bdb480b5-5ac52e58-917a6076_0 is DEAD
2025-10-02T08:10:45.779090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:45.784962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9917992-bdb480b5-5ac52e58-917a6076_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:45.784977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9917992-bdb480b5-5ac52e58-917a6076_0] Write session will restart in 0.007968s
2025-10-02T08:10:45.785004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9917992-bdb480b5-5ac52e58-917a6076_0] Write session: Do CDS request
2025-10-02T08:10:45.785011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9917992-bdb480b5-5ac52e58-917a6076_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:45.797209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9917992-bdb480b5-5ac52e58-917a6076_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:45.797399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:45.797417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 971
2025-10-02T08:10:45.797559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:45.797601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:45.797611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:45.797616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:45.798039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 971 sessionId:  describe result for acl check
2025-10-02T08:10:45.798070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:45.798072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:45.798073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:45.798079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533872496608613:11469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:45.798658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533872496608613:11469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:45.801176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533872496608613:11469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:45.804262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533872496608613:11469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:45.804275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533872496608613:11469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:45.804278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533872496608613:11469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:45.804286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:45.811272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:45.815456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:45.815669Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:45.815688Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:45.815699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:45.815763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:45.815800Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533872496608829:11468]
2025-10-02T08:10:45.816388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:45.816677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:45.816729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:45.817051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:45.817113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.817114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.817115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.817116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.817117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.817122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.817132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.817136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.817140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.817143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.817148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.817156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:45.817162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.817168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:45.817172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.817178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:45.817184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.817202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.817206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.817211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.817230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:45.825840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:45.827823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:45.827842Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:45.827845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:45.827848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:45.827855Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 970 [1:7556533872496608829:11468]
2025-10-02T08:10:45.827867Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:45.827885Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:45.827888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:45.827891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:45.827893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:45.827910Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:45.827915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:45.827921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:45.827999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.828007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.828009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:45.828011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:45.828062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:45.828070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.828080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:45.828087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:45.828100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533872496608823:11468]
2025-10-02T08:10:45.828101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533872496608823:11468]
2025-10-02T08:10:45.828106Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:45.828116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:45.828129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:45.828135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:45.828141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:45.828143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533872496608735:11469], now have 1 active actors on pipe
2025-10-02T08:10:45.828144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:45.828169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533872496608823:11468]
2025-10-02T08:10:45.828177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:45.828182Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:45.828182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533872956667811:2378], now have 1 active actors on pipe
2025-10-02T08:10:45.828196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.828204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.828236Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:45.828245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:45.828247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:45.828249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:45.828255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:45.828261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:45.828278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:45.828269Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 970
2025-10-02T08:10:45.828342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 970
2025-10-02T08:10:45.828384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.828391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.828404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:45.828444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 971 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0
2025-10-02T08:10:45.828777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9917992-bdb480b5-5ac52e58-917a6076_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:45.831826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0] Write session: try to update token
2025-10-02T08:10:45.831844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:45.847887Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:45.847911Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:45.847914Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:45.847923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533872496608823:11468]
2025-10-02T08:10:45.847931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533872496608823:11468]
2025-10-02T08:10:45.847972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:45.847978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:45.847978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:45.847980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:45.847994Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:45.848022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId: src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:45.848122Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:45.850627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:45.878628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533872496608865:10816]
2025-10-02T08:10:45.878766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 970, pipe: [1:7556533872496608865:10816]
2025-10-02T08:10:45.989138Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:45.989727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:45.989741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:45.989780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533872496608865:10816], now have 1 active actors on pipe
2025-10-02T08:10:45.989875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:45.989884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:45.989936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 971 reason: error at write: Disconnected sessionId: src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0
2025-10-02T08:10:45.990021Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:45.990079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 971 sessionId: src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0 is DEAD
2025-10-02T08:10:45.990223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533872496608865:10816]
2025-10-02T08:10:45.990413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:45.990424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0] Write session will restart in 0.009378s
2025-10-02T08:10:45.990449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0] Write session: Do CDS request
2025-10-02T08:10:45.990459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:45.989999Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:46.001258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.001294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:46.001312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 972
2025-10-02T08:10:46.002040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.002100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:46.002118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:46.002135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:46.002581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 972 sessionId:  describe result for acl check
2025-10-02T08:10:46.002618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:46.002624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:46.002626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:46.002632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533876791576639:11476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:46.003134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533876791576639:11476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:46.005430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533876791576639:11476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:46.012856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533876791576639:11476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:46.012877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533876791576639:11476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:46.012881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533876791576639:11476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:46.012890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:46.016489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:46.021980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:46.022243Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:46.022259Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:46.022271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:46.022344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:46.022398Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533876791576888:11475]
2025-10-02T08:10:46.023233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:46.023536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:46.023595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:46.024033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:46.024104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.024114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.024116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.024117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.024119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.024126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.024138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.024143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.024148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.024153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.024160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.024169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.024177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.024184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.024190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.024212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.024218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.024225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.024231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.024237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.024259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:46.034603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:46.037242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:46.037263Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:46.037266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:46.037270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:46.037278Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 971 [1:7556533876791576888:11475]
2025-10-02T08:10:46.037291Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:46.037313Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:46.037318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.037321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.037323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.037344Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:46.037350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:46.037357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:46.037455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.037458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.037461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:46.037464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:46.037540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:46.037543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.037560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.037574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:46.037592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533876791576882:11475]
2025-10-02T08:10:46.037594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533876791576882:11475]
2025-10-02T08:10:46.037610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:46.037625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:46.037640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:46.037644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:46.037683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533876791576882:11475]
2025-10-02T08:10:46.037686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:46.037826Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:46.037828Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:46.037834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:46.038033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 971
2025-10-02T08:10:46.038038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791576877:11476], now have 1 active actors on pipe
2025-10-02T08:10:46.038055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.038063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.038091Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:46.038100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.038105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.038107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:46.038118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.038130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:46.038146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.038245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533872956667820:2378], now have 1 active actors on pipe
2025-10-02T08:10:46.038382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.038386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.038404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.038442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 972 partition: 0 MaxSeqNo: 17 sessionId: src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0
2025-10-02T08:10:46.040945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8e7f802-69c7b5f0-a83caa80-9ccf499e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:46.042865Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 971
2025-10-02T08:10:46.043777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0] Write session: try to update token
2025-10-02T08:10:46.043794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:46.060399Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:46.060425Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:46.060428Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:46.060437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533876791576882:11475]
2025-10-02T08:10:46.060443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533876791576882:11475]
2025-10-02T08:10:46.060484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:46.060487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:46.060491Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:46.060492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.060494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:46.060643Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:46.061767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId: src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:46.064340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:46.090985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533876791576916:10816]
2025-10-02T08:10:46.091230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 971, pipe: [1:7556533876791576916:10816]
2025-10-02T08:10:46.201749Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:46.202346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.202361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.202398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791576916:10816], now have 1 active actors on pipe
2025-10-02T08:10:46.202524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:46.202530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:46.202571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 972 reason: error at write: Disconnected sessionId: src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0
2025-10-02T08:10:46.202659Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:46.202640Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:46.202742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 972 sessionId: src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0 is DEAD
2025-10-02T08:10:46.202865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533876791576916:10816]
2025-10-02T08:10:46.203067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:46.203077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0] Write session will restart in 0.006285s
2025-10-02T08:10:46.203101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0] Write session: Do CDS request
2025-10-02T08:10:46.203108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:46.210418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.211960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:46.211980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 973
2025-10-02T08:10:46.212121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.212154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:46.212165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:46.212168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:46.212621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 973 sessionId:  describe result for acl check
2025-10-02T08:10:46.212665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:46.212671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:46.212673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:46.212677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533876791577271:11483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:46.213197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533876791577271:11483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:46.215716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533876791577271:11483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:46.218930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533876791577271:11483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:46.218943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533876791577271:11483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:46.218945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533876791577271:11483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:46.218951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:46.235543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:46.239244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:46.239640Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:46.239644Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:46.239656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:46.239732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:46.239765Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533876791577644:11482]
2025-10-02T08:10:46.240440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:46.240614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:46.240654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:46.240986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:46.241025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.241026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.241027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.241029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.241030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.241035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.241046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.241050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.241054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.241057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.241063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.241071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.241077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.241082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.241088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.241094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.241098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.241104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.241109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.241114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.241132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:46.250892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:46.252972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:46.252993Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:46.252995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:46.252998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:46.253005Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 972 [1:7556533876791577644:11482]
2025-10-02T08:10:46.253018Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:46.253035Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:46.253038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.253041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.253043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.253060Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:46.253067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:46.253079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:46.253139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.253150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.253153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:46.253155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:46.253221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:46.253245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.253258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.253273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:46.253278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 972
2025-10-02T08:10:46.253293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791577406:11483], now have 1 active actors on pipe
2025-10-02T08:10:46.253300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533877251635122:2378], now have 1 active actors on pipe
2025-10-02T08:10:46.253308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.253312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.253335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533876791577638:11482]
2025-10-02T08:10:46.253342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533876791577638:11482]
2025-10-02T08:10:46.253355Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:46.253370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:46.253379Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:46.253383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:46.253388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:46.253395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:46.253365Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 972
2025-10-02T08:10:46.253411Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:46.253421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.253425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.253431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:46.253439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.253448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:46.253496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533876791577638:11482]
2025-10-02T08:10:46.253511Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:46.253523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:46.253533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.253570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.253577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.253591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.253641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 973 partition: 0 MaxSeqNo: 17 sessionId: src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0
2025-10-02T08:10:46.254402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f1d69a-5cd899d2-d1c7d48b-3e6687dc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:46.260041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0] Write session: try to update token
2025-10-02T08:10:46.260067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:46.264279Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:46.264301Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:46.264307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533876791577638:11482]
2025-10-02T08:10:46.264342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:46.264354Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:46.264498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:46.264622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:46.264750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:46.264899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:46.265076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:46.265109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:46.280624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId: src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:46.281414Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:46.281430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:46.281433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:46.281442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533876791577638:11482]
2025-10-02T08:10:46.281446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533876791577638:11482]
2025-10-02T08:10:46.281492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:46.281498Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:46.281503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.281505Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:46.281505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:46.281649Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:46.283369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:46.303111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533876791577670:10816]
2025-10-02T08:10:46.303247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 972, pipe: [1:7556533876791577670:10816]
2025-10-02T08:10:46.418905Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:46.419159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.419172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.419191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791577670:10816], now have 1 active actors on pipe
2025-10-02T08:10:46.419284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:46.419291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:46.419347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 973 reason: error at write: Disconnected sessionId: src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0
2025-10-02T08:10:46.419387Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:46.419447Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:46.419521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 973 sessionId: src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0 is DEAD
2025-10-02T08:10:46.419732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:46.419748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0] Write session will restart in 0.006476s
2025-10-02T08:10:46.419778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0] Write session: Do CDS request
2025-10-02T08:10:46.419784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:46.419790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533876791577670:10816]
2025-10-02T08:10:46.427428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.427465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:46.427481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 974
2025-10-02T08:10:46.427747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.427792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:46.427801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:46.427805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:46.428182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 974 sessionId:  describe result for acl check
2025-10-02T08:10:46.428213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:46.428218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:46.428220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:46.428225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533876791578030:11489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:46.428751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533876791578030:11489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:46.431305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533876791578030:11489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:46.434627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533876791578030:11489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:46.434639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533876791578030:11489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:46.434641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533876791578030:11489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:46.434647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:46.441648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:46.441987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:46.442296Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:46.442304Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:46.442312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:46.442364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:46.442391Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533876791578402:11488]
2025-10-02T08:10:46.442801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:46.442920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:46.442944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:46.443128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:46.443155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.443160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.443160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.443161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.443162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.443164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.443171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.443173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.443175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.443177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.443180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.443184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.443188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.443190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.443192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.443195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.443198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.443200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.443214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.443219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.443237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:46.450827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:46.452690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:46.452705Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:46.452707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:46.452709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:46.452713Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 973 [1:7556533876791578402:11488]
2025-10-02T08:10:46.452724Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:46.452740Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:46.452742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.452745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.452746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.452762Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:46.452771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:46.452777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:46.452844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.452850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.452852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:46.452854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:46.452898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:46.452902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.452912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.452922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:46.452933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533876791578396:11488]
2025-10-02T08:10:46.452938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533876791578396:11488]
2025-10-02T08:10:46.452943Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:46.452952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791578316:11489], now have 1 active actors on pipe
2025-10-02T08:10:46.452957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:46.452961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:46.452961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:46.452963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 973
2025-10-02T08:10:46.452968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:46.452970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:46.452973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533877251635129:2378], now have 1 active actors on pipe
2025-10-02T08:10:46.452976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.452978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.453009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533876791578396:11488]
2025-10-02T08:10:46.453018Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:46.453027Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:46.453030Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:46.453035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.453037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.453039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:46.453044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.453051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:46.453071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.453069Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 973
2025-10-02T08:10:46.453143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.453148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.453158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.453188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 974 partition: 0 MaxSeqNo: 17 sessionId: src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0
2025-10-02T08:10:46.453503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8310e33b-3a6cbdbd-25f6f388-2ce4d964_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:46.456203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0] Write session: try to update token
2025-10-02T08:10:46.456221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:46.474144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId: src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:46.476953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:46.477009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.477021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.477056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:46.477080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:46.477115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.477132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.477310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.477392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.477472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.477536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.477978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.477988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.478074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.478165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.478288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.478371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.478419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.478424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.478501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.478568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.478639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.478713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.478766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.478774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.478844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.478910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.478978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.479042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.479104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.479113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.479186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.479252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.479324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.479395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.479458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.479466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.479537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.479602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.479667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.479758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.479808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.479815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.479887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.479949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.480027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.480095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.480146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.480154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.480226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.480289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.480363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.480435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.480490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.480497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.480572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.480641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.480712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.480780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.480845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.480853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.480925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.480991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.481060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.481136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.481184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.481191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.481259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:46.481328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.481350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.481359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:46.481391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:46.481409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:46.481416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:46.481419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:46.481422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:46.481851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:46.481886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:46.481899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:46.481924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:46.481933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:46.481937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:46.482682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:46.482716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:46.482727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:46.482730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:46.482734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:46.482737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:46.483311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:46.483339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:46.483345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:46.483351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:46.483354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:46.485826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:46.485850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:46.485863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392646485
2025-10-02T08:10:46.485987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:46.486005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:46.486011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:46.486014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:46.486020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:46.486023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:46.486565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:46.486589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:46.486599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:46.486603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:46.486606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:46.486610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:46.487122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:46.487147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:46.487156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:46.487167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:46.487171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:46.487174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:46.487714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:46.487743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:46.487749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:46.489069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:46.489091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:46.489099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:46.489103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:46.489112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392646488
2025-10-02T08:10:46.489468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:46.489492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:46.489504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:46.489509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:46.489514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:46.489517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:46.490041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:46.490066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:46.490071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:46.490075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:46.490078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:46.490084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:46.490610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:46.490633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.490742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392646490
2025-10-02T08:10:46.493208Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:46.493231Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:46.493236Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:46.493240Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:46.493250Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:46.493252Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:46.493253Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:46.493259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533876791578396:11488]
2025-10-02T08:10:46.493264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533876791578396:11488]
2025-10-02T08:10:46.493313Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:46.493328Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:46.498284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:46.498305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.498307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:46.498441Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:46.520142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533876791578432:10816]
2025-10-02T08:10:46.520263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 973, pipe: [1:7556533876791578432:10816]
2025-10-02T08:10:46.641030Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:46.641326Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:46.641333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:46.641341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533876791578396:11488]
2025-10-02T08:10:46.641386Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:46.641406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791578432:10816], now have 1 active actors on pipe
2025-10-02T08:10:46.641573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:46.641582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:46.641599Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:46.641610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 974 reason: error at write: Disconnected sessionId: src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0
2025-10-02T08:10:46.641717Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:46.641785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 974 sessionId: src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0 is DEAD
2025-10-02T08:10:46.641951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533876791578432:10816]
2025-10-02T08:10:46.641988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:46.642004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0] Write session will restart in 0.007191s
2025-10-02T08:10:46.642030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0] Write session: Do CDS request
2025-10-02T08:10:46.642038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:46.645864Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [8ab8b8dc558fb712] Result# TEvPutResult {Id# [72075186224037892:973:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:46.645910Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:973:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:46.645963Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:973:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:46.650364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.650433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:46.650448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 975
2025-10-02T08:10:46.650645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.650672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:46.650679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:46.650682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:46.651184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 975 sessionId:  describe result for acl check
2025-10-02T08:10:46.651216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:46.651222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:46.651224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:46.651229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533876791578758:11496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:46.651747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533876791578758:11496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:46.654348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533876791578758:11496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:46.657515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533876791578758:11496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:46.657530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533876791578758:11496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:46.657532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533876791578758:11496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:46.657542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:46.666208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:46.666528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:46.666662Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:46.666668Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:46.666675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:46.666704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:46.666734Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533876791579175:11495]
2025-10-02T08:10:46.667145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:46.667288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:46.667314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:46.667519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:46.667552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.667556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.667557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.667558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.667558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.667561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.667568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.667570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.667572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.667574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.667578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.667582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.667587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.667590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.667592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.667596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.667598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.667600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.667603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.667606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.667616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:46.675637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:46.677278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:46.677295Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:46.677297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:46.677300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:46.677306Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 974 [1:7556533876791579175:11495]
2025-10-02T08:10:46.677318Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:46.677336Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:46.677342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.677345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.677346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.677361Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:46.677375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:46.677381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:46.677432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.677439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.677442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:46.677444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:46.677515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:46.677521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.677533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.677548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:46.677571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791579034:11496], now have 1 active actors on pipe
2025-10-02T08:10:46.677583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533876791579169:11495]
2025-10-02T08:10:46.677585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533876791579169:11495]
2025-10-02T08:10:46.677595Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:46.677602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533877251635139:2378], now have 1 active actors on pipe
2025-10-02T08:10:46.677610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:46.677624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:46.677624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:46.677626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:46.677627Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:46.677654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533876791579169:11495]
2025-10-02T08:10:46.677666Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:46.677641Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 974
2025-10-02T08:10:46.677670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:46.677707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 974
2025-10-02T08:10:46.677716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.677720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.677747Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|875833da-8176f7f4-af1430d1-cd66f160_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:46.677757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.677761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.677769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:46.677776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.677784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:46.677800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.677836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.677841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.677852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.677884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 975 partition: 0 MaxSeqNo: 17 sessionId: src_id|875833da-8176f7f4-af1430d1-cd66f160_0
2025-10-02T08:10:46.678258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|478a0852-4c9ca36c-6a8737c9-e76d0591_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|875833da-8176f7f4-af1430d1-cd66f160_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:46.681507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875833da-8176f7f4-af1430d1-cd66f160_0] Write session: try to update token
2025-10-02T08:10:46.681530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875833da-8176f7f4-af1430d1-cd66f160_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:46.688434Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:46.688454Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:46.688463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533876791579169:11495]
2025-10-02T08:10:46.688499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:46.688502Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:46.688669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:46.688844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:46.689001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:46.689151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:46.689364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:46.689407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:46.697997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId: src_id|875833da-8176f7f4-af1430d1-cd66f160_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:46.700673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:46.700744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.700757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.700790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:46.700826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:46.700887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.700896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.701061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.701124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.701192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.701254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.701304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.701313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.701380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.701446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.701509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.701574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.701620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.701627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.701691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.701757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.701821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.701890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.701935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.701942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.702009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.702083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.702188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.702260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.702309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.702316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.702383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.702450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.702518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.702587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.702637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.702647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.702716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.702781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.702844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.702912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.702959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.702967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.703035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.703106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.703176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.703244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.703295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.703306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.703409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.703507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.703592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.703662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.703720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.703728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.703797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.703855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.703915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.703971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.704031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.704036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.704097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:46.704151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:46.704205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:46.704262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:46.704316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:46.704321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:46.704367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:46.704425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.704442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.704444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:46.704467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:46.704479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:46.704484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:46.704486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:46.704488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:46.704870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:46.704892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:46.704896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:46.704903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:46.704905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:46.704907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:46.705412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:46.705431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:46.705436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:46.705437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:46.705439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:46.705441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:46.705926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:46.705945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:46.705948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:46.705950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:46.705952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:46.707018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:46.707033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:46.707041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392646706
2025-10-02T08:10:46.707169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:46.707182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:46.707188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:46.707190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:46.707193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:46.707194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:46.707602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:46.707620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:46.707623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:46.707625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:46.707627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:46.707629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:46.708049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:46.708068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:46.708074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:46.708080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:46.708082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:46.708084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:46.708534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:46.708552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:46.708556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:46.709589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:46.709603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:46.709607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:46.709610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:46.709617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392646709
2025-10-02T08:10:46.709879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:46.709895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:46.709899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:46.709901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:46.709904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:46.709907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:46.710328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:46.710345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:46.710350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:46.710353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:46.710356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:46.710360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:46.710855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:46.710876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.710956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392646710
2025-10-02T08:10:46.713090Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:46.713113Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:46.713120Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:46.713126Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:46.713136Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:46.713143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:46.713145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:46.713153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533876791579169:11495]
2025-10-02T08:10:46.713156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533876791579169:11495]
2025-10-02T08:10:46.713190Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:46.713208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:46.713224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:46.713234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.713235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:46.713352Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:46.742769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533876791579236:10816]
2025-10-02T08:10:46.742865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 974, pipe: [1:7556533876791579236:10816]
2025-10-02T08:10:46.849038Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:46.849396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791579236:10816], now have 1 active actors on pipe
2025-10-02T08:10:46.849574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533876791579236:10816]
2025-10-02T08:10:46.849604Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:46.849606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:46.849609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:46.849640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 975 reason: error at write: Disconnected sessionId: src_id|875833da-8176f7f4-af1430d1-cd66f160_0
2025-10-02T08:10:46.849781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:46.849850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 975 sessionId: src_id|875833da-8176f7f4-af1430d1-cd66f160_0 is DEAD
2025-10-02T08:10:46.850045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875833da-8176f7f4-af1430d1-cd66f160_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:46.850061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875833da-8176f7f4-af1430d1-cd66f160_0] Write session will restart in 0.008476s
2025-10-02T08:10:46.850090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875833da-8176f7f4-af1430d1-cd66f160_0] Write session: Do CDS request
2025-10-02T08:10:46.850099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875833da-8176f7f4-af1430d1-cd66f160_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:46.854129Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [fbf8deaed900152a] Result# TEvPutResult {Id# [72075186224037892:974:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:46.854165Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:974:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:46.854252Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:974:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:46.860368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875833da-8176f7f4-af1430d1-cd66f160_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.860424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:46.860440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 976
2025-10-02T08:10:46.860580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:46.860608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:46.860618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:46.860621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:46.860992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 976 sessionId:  describe result for acl check
2025-10-02T08:10:46.861022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:46.861027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:46.861028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:46.861032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533876791579587:11515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:46.861492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533876791579587:11515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:46.863893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533876791579587:11515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:46.866870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533876791579587:11515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:46.866885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533876791579587:11515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:46.866887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533876791579587:11515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:46.866894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:46.877354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:46.877783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:46.877934Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:46.877941Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:46.877948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:46.877982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:46.878019Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533876791579989:11513]
2025-10-02T08:10:46.878468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:46.878629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:46.878675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:46.878923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:46.878964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.878969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.878970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.878971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.878972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.878977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.878987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.878995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.878999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.879003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.879008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.879017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:46.879024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.879033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:46.879037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.879045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:46.879049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.879054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.879063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.879068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.879098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:46.887850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:46.890249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:46.890270Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:46.890272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:46.890276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:46.890282Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 975 [1:7556533876791579989:11513]
2025-10-02T08:10:46.890294Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:46.890311Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:46.890314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.890317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.890320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.890335Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:46.890341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:46.890359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:46.890423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.890431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.890434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:46.890437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:46.890499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:46.890507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.890520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:46.890537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:46.890557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533876791579983:11513]
2025-10-02T08:10:46.890564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533876791579983:11513]
2025-10-02T08:10:46.890573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:46.890583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:46.890586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:46.890591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791579820:11515], now have 1 active actors on pipe
2025-10-02T08:10:46.890593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 975
2025-10-02T08:10:46.890598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:46.890612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:46.890614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:46.890620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533877251635181:2378], now have 1 active actors on pipe
2025-10-02T08:10:46.890654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.890665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.890679Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533876791579983:11513]
2025-10-02T08:10:46.890686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:46.890698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:46.890709Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95059c34-11893c42-fa879fd4-326bb87f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:46.890716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:46.890670Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 975
2025-10-02T08:10:46.890720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:46.890722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:46.890732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:46.890741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:46.890768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.890834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:46.890841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:46.890855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:46.890893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 976 partition: 0 MaxSeqNo: 17 sessionId: src_id|95059c34-11893c42-fa879fd4-326bb87f_0
2025-10-02T08:10:46.891218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875833da-8176f7f4-af1430d1-cd66f160_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|95059c34-11893c42-fa879fd4-326bb87f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:46.894139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95059c34-11893c42-fa879fd4-326bb87f_0] Write session: try to update token
2025-10-02T08:10:46.894155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95059c34-11893c42-fa879fd4-326bb87f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:46.908246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId: src_id|95059c34-11893c42-fa879fd4-326bb87f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:46.909403Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:46.909420Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:46.909423Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:46.909430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533876791579983:11513]
2025-10-02T08:10:46.909434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533876791579983:11513]
2025-10-02T08:10:46.909473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:46.909481Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:46.909484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:46.909486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:46.909487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:46.909616Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:46.911034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:46.949743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533876791580015:10816]
2025-10-02T08:10:46.949892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 975, pipe: [1:7556533876791580015:10816]
2025-10-02T08:10:47.048660Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:47.048885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.048897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.048931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533876791580015:10816], now have 1 active actors on pipe
2025-10-02T08:10:47.049174Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:47.049078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:47.049093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:47.049165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 976 reason: error at write: Disconnected sessionId: src_id|95059c34-11893c42-fa879fd4-326bb87f_0
2025-10-02T08:10:47.049340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 976 sessionId: src_id|95059c34-11893c42-fa879fd4-326bb87f_0 is DEAD
2025-10-02T08:10:47.049478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059c34-11893c42-fa879fd4-326bb87f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:47.049487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059c34-11893c42-fa879fd4-326bb87f_0] Write session will restart in 0.009265s
2025-10-02T08:10:47.049508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059c34-11893c42-fa879fd4-326bb87f_0] Write session: Do CDS request
2025-10-02T08:10:47.049514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059c34-11893c42-fa879fd4-326bb87f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:47.049498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533876791580015:10816]
2025-10-02T08:10:47.049757Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:47.060349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95059c34-11893c42-fa879fd4-326bb87f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.060409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:47.060428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 977
2025-10-02T08:10:47.060551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.060581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:47.060591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:47.060595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:47.060965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 977 sessionId:  describe result for acl check
2025-10-02T08:10:47.061001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:47.061003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:47.061004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:47.061009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533881086547776:11521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:47.061488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533881086547776:11521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:47.064393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533881086547776:11521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:47.067476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533881086547776:11521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:47.067492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533881086547776:11521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:47.067494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533881086547776:11521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:47.067500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:47.074592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:47.075025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:47.075180Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:47.075187Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:47.075194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:47.075225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:47.075253Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533881086548049:11520]
2025-10-02T08:10:47.075720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:47.075888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:47.075917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:47.076140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:47.076187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.076192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.076193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.076194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.076195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.076198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.076205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.076207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.076209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.076211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.076215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.076220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.076223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.076226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.076229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.076232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.076234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.076237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.076240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.076243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.076253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:47.085439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:47.087611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:47.087630Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:47.087633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:47.087637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:47.087643Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 976 [1:7556533881086548049:11520]
2025-10-02T08:10:47.087656Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:47.087677Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:47.087689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.087692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.087695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.087711Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:47.087716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:47.087723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:47.087787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.087797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.087800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:47.087802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:47.087865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:47.087873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.087886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.087902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:47.087922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086547981:11521], now have 1 active actors on pipe
2025-10-02T08:10:47.087933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533881086548043:11520]
2025-10-02T08:10:47.087936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533881086548043:11520]
2025-10-02T08:10:47.087943Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:47.087959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533881546602486:2378], now have 1 active actors on pipe
2025-10-02T08:10:47.087966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:47.087968Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:47.087969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:47.087982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:47.087985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:47.088018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.088029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.088042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533881086548043:11520]
2025-10-02T08:10:47.088050Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:47.088046Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 976
2025-10-02T08:10:47.088073Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2af7676-48277a22-928a9b55-f86ad458_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:47.088085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.088091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.088092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:47.088095Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:47.088100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.088108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:47.088132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.088299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 976
2025-10-02T08:10:47.088347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.088354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.088366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.088401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 977 partition: 0 MaxSeqNo: 17 sessionId: src_id|a2af7676-48277a22-928a9b55-f86ad458_0
2025-10-02T08:10:47.088709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95059c34-11893c42-fa879fd4-326bb87f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a2af7676-48277a22-928a9b55-f86ad458_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:47.091294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af7676-48277a22-928a9b55-f86ad458_0] Write session: try to update token
2025-10-02T08:10:47.091312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af7676-48277a22-928a9b55-f86ad458_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:47.105187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId: src_id|a2af7676-48277a22-928a9b55-f86ad458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:47.106640Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:47.106664Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:47.106666Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:47.106678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533881086548043:11520]
2025-10-02T08:10:47.106682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533881086548043:11520]
2025-10-02T08:10:47.106723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:47.106726Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:47.106732Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:47.106735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.106737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:47.106882Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:47.107663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:47.149894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533881086548075:10816]
2025-10-02T08:10:47.150028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 976, pipe: [1:7556533881086548075:10816]
2025-10-02T08:10:47.241263Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:47.241899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.241913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.241944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086548075:10816], now have 1 active actors on pipe
2025-10-02T08:10:47.242059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:47.242072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:47.242145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 977 reason: error at write: Disconnected sessionId: src_id|a2af7676-48277a22-928a9b55-f86ad458_0
2025-10-02T08:10:47.242149Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:47.242330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 977 sessionId: src_id|a2af7676-48277a22-928a9b55-f86ad458_0 is DEAD
2025-10-02T08:10:47.242375Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:47.242456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533881086548075:10816]
2025-10-02T08:10:47.242550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af7676-48277a22-928a9b55-f86ad458_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:47.242566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af7676-48277a22-928a9b55-f86ad458_0] Write session will restart in 0.009647s
2025-10-02T08:10:47.242591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af7676-48277a22-928a9b55-f86ad458_0] Write session: Do CDS request
2025-10-02T08:10:47.242597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af7676-48277a22-928a9b55-f86ad458_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:47.253388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af7676-48277a22-928a9b55-f86ad458_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.253461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:47.253479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 978
2025-10-02T08:10:47.253643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.253682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:47.253694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:47.253698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:47.254125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 978 sessionId:  describe result for acl check
2025-10-02T08:10:47.254162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:47.254164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:47.254165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:47.254170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533881086548537:11528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:47.254654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533881086548537:11528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:47.257170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533881086548537:11528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:47.260836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533881086548537:11528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:47.260849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533881086548537:11528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:47.260851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533881086548537:11528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:47.260857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:47.267761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:47.268255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:47.268377Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:47.268384Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:47.268391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:47.268423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:47.268451Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533881086548815:11527]
2025-10-02T08:10:47.268896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:47.269046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:47.269073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:47.269278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:47.269308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.269313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.269313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.269314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.269315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.269318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.269325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.269327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.269329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.269331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.269335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.269339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.269343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.269346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.269348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.269351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.269353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.269356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.269358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.269361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.269373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:47.277241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:47.278659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:47.278678Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:47.278681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:47.278685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:47.278691Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 977 [1:7556533881086548815:11527]
2025-10-02T08:10:47.278703Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:47.278721Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:47.278725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.278728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.278730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.278746Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:47.278756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:47.278766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:47.278815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.278822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.278825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:47.278828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:47.278894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:47.278901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.278914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.278926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:47.278944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533881086548809:11527]
2025-10-02T08:10:47.278950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533881086548809:11527]
2025-10-02T08:10:47.278964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:47.278979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:47.278999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:47.279004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:47.279038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533881086548809:11527]
2025-10-02T08:10:47.279040Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:47.279043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:47.279045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:47.279050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:47.279119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 977
2025-10-02T08:10:47.279139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086548772:11528], now have 1 active actors on pipe
2025-10-02T08:10:47.279225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.279230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.279247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533881546602492:2378], now have 1 active actors on pipe
2025-10-02T08:10:47.279260Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:47.279267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.279270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.279273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:47.279282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.279293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:47.279591Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 977
2025-10-02T08:10:47.279308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.279408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.279411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.279424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.279457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 978 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0
2025-10-02T08:10:47.279808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2af7676-48277a22-928a9b55-f86ad458_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:47.282489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0] Write session: try to update token
2025-10-02T08:10:47.282506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:47.298342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId: src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:47.299284Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:47.299298Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:47.299300Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:47.299307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533881086548809:11527]
2025-10-02T08:10:47.299311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533881086548809:11527]
2025-10-02T08:10:47.299354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:47.299364Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:47.299365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.299367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:47.299369Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:47.299501Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:47.300872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:47.342959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533881086548839:10816]
2025-10-02T08:10:47.343067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 977, pipe: [1:7556533881086548839:10816]
2025-10-02T08:10:47.442412Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:47.442960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.442975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.443015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086548839:10816], now have 1 active actors on pipe
2025-10-02T08:10:47.443138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533881086548839:10816]
2025-10-02T08:10:47.443176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:47.443182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:47.443231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 978 reason: error at write: Disconnected sessionId: src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0
2025-10-02T08:10:47.443240Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:47.443311Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:47.443423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 978 sessionId: src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0 is DEAD
2025-10-02T08:10:47.443597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:47.443614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0] Write session will restart in 0.007157s
2025-10-02T08:10:47.443645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0] Write session: Do CDS request
2025-10-02T08:10:47.443652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:47.452321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.452396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:47.452414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 979
2025-10-02T08:10:47.452543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.452575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:47.452585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:47.452589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:47.453335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 979 sessionId:  describe result for acl check
2025-10-02T08:10:47.453371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:47.453377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:47.453379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:47.453384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533881086549165:11534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:47.453865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533881086549165:11534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:47.456500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533881086549165:11534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:47.460407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533881086549165:11534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:47.460424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533881086549165:11534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:47.460426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533881086549165:11534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:47.460432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:47.467060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:47.470072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:47.470229Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:47.470237Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:47.470245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:47.470279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:47.470306Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533881086549591:11533]
2025-10-02T08:10:47.470736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:47.470947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:47.471003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:47.471317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:47.471362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.471371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.471372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.471373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.471375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.471380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.471401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.471410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.471414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.471418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.471423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.471431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.471442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.471447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.471451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.471461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.471471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.471480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.471489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.471496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.471519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:47.479680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:47.481606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:47.481627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:47.481629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:47.481632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:47.481638Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 978 [1:7556533881086549591:11533]
2025-10-02T08:10:47.481649Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:47.481665Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:47.481673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.481675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.481677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.481691Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:47.481701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:47.481707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:47.481783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.481794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.481797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:47.481800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:47.481856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:47.481863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.481878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.481895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:47.481918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086549439:11534], now have 1 active actors on pipe
2025-10-02T08:10:47.481923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533881086549582:11533]
2025-10-02T08:10:47.481923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 978
2025-10-02T08:10:47.481926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533881086549582:11533]
2025-10-02T08:10:47.481933Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:47.481943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533881546602498:2378], now have 1 active actors on pipe
2025-10-02T08:10:47.481945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:47.481948Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:47.481950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.481955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.481969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:47.481988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:47.481995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:47.482001Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 978
2025-10-02T08:10:47.482032Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:47.482043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.482054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.482060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:47.482071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.482082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:47.482091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533881086549582:11533]
2025-10-02T08:10:47.482101Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:47.482110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:47.482135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.482188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.482195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.482205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.482235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 979 partition: 0 MaxSeqNo: 17 sessionId: src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0
2025-10-02T08:10:47.482589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5a4eb1-89ba3afc-918f464a-e7b6de63_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:47.485557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0] Write session: try to update token
2025-10-02T08:10:47.485575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:47.499880Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:47.499899Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:47.499900Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:47.499908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533881086549582:11533]
2025-10-02T08:10:47.499911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533881086549582:11533]
2025-10-02T08:10:47.499947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:47.499952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.499953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:47.499953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:47.499959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:47.500075Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:47.500613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId: src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:47.503631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:47.543131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533881086549615:10816]
2025-10-02T08:10:47.543278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 978, pipe: [1:7556533881086549615:10816]
2025-10-02T08:10:47.636418Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:47.637247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.637262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.637298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086549615:10816], now have 1 active actors on pipe
2025-10-02T08:10:47.637484Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:47.637571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533881086549615:10816]
2025-10-02T08:10:47.637598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:47.637605Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:47.637662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 979 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0
2025-10-02T08:10:47.637986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 979 sessionId: src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0 is DEAD
2025-10-02T08:10:47.638073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:47.638086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0] Write session will restart in 0.007031s
2025-10-02T08:10:47.638109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0] Write session: Do CDS request
2025-10-02T08:10:47.638115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:47.646407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.646482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:47.646496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 980
2025-10-02T08:10:47.646668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.646695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:47.646703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:47.646706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:47.647047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 980 sessionId:  describe result for acl check
2025-10-02T08:10:47.647085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:47.647091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:47.647092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:47.647098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533881086549958:11541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:47.647548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533881086549958:11541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:47.649862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533881086549958:11541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:47.659554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533881086549958:11541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:47.659576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533881086549958:11541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:47.659580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533881086549958:11541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:47.659588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:47.672661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:47.673150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:47.673341Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:47.673352Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:47.673363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:47.673419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:47.673461Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533881086550364:11540]
2025-10-02T08:10:47.674116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:47.674366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:47.674413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:47.674719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:47.674769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.674776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.674777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.674778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.674779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.674784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.674795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.674799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.674804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.674808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.674814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.674821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.674827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.674833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.674842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.674848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.674852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.674858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.674870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.674875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.674895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:47.683618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:47.685228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:47.685253Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:47.685256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:47.685260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:47.685268Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 979 [1:7556533881086550364:11540]
2025-10-02T08:10:47.685280Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:47.685299Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:47.685301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.685304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.685307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.685323Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:47.685333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:47.685340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:47.685409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.685417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.685421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:47.685424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:47.685489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:47.685501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.685515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.685529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:47.685553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086550155:11541], now have 1 active actors on pipe
2025-10-02T08:10:47.685560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533881086550358:11540]
2025-10-02T08:10:47.685563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533881086550358:11540]
2025-10-02T08:10:47.685569Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:47.685568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 979
2025-10-02T08:10:47.685578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533881546602507:2378], now have 1 active actors on pipe
2025-10-02T08:10:47.685586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:47.685590Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:47.685666Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 979
2025-10-02T08:10:47.685594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:47.685601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:47.685604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:47.685610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.685615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.685654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533881086550358:11540]
2025-10-02T08:10:47.685663Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:47.685673Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:47.685678Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:47.685684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.685689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.685691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:47.685700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.685709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:47.685750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.685791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.685799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.685812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.685846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 980 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0
2025-10-02T08:10:47.686237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f78f0959-369838dd-d7e72dfd-4f22f096_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:47.689479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0] Write session: try to update token
2025-10-02T08:10:47.689505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:47.704287Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:47.704308Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:47.704311Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:47.704318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533881086550358:11540]
2025-10-02T08:10:47.704323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533881086550358:11540]
2025-10-02T08:10:47.704368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:47.704376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.704386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:47.704387Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:47.704394Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:47.704572Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:47.706932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId: src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:47.709616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:47.745948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533881086550401:10816]
2025-10-02T08:10:47.746392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 979, pipe: [1:7556533881086550401:10816]
2025-10-02T08:10:47.842130Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:47.842555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.842569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.842606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086550401:10816], now have 1 active actors on pipe
2025-10-02T08:10:47.842725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:47.842732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:47.842781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 980 reason: error at write: Disconnected sessionId: src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0
2025-10-02T08:10:47.842845Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:47.842835Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:47.842950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 980 sessionId: src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0 is DEAD
2025-10-02T08:10:47.843111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:47.843127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0] Write session will restart in 0.006343s
2025-10-02T08:10:47.843116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533881086550401:10816]
2025-10-02T08:10:47.843153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0] Write session: Do CDS request
2025-10-02T08:10:47.843161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:47.852942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.853220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:47.853236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 981
2025-10-02T08:10:47.853388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:47.853412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:47.853425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:47.853428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:47.853797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 981 sessionId:  describe result for acl check
2025-10-02T08:10:47.853831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:47.853835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:47.853837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:47.853842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533881086550827:11559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:47.854340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533881086550827:11559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:47.857093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533881086550827:11559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:47.859456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533881086550827:11559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:47.859474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533881086550827:11559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:47.859477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533881086550827:11559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:47.859485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:47.869238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:47.869688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:47.869901Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:47.869912Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:47.869921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:47.869970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:47.870008Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533881086551184:11558]
2025-10-02T08:10:47.870633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:47.870842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:47.870883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:47.871181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:47.871229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.871235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.871236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.871237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.871238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.871243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.871254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.871257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.871261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.871270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.871275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.871287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:47.871297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.871306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:47.871315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.871322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:47.871332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.871341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.871349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.871354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.871378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:47.880234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:47.882275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:47.882295Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:47.882297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:47.882301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:47.882308Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 980 [1:7556533881086551184:11558]
2025-10-02T08:10:47.882320Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:47.882335Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:47.882337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.882340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.882342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.882359Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:47.882369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:47.882378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:47.882440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.882450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.882454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:47.882456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:47.882513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:47.882519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.882532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:47.882547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:47.882566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533881086551178:11558]
2025-10-02T08:10:47.882573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533881086551178:11558]
2025-10-02T08:10:47.882584Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:47.882593Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:47.882597Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:47.882598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086551058:11559], now have 1 active actors on pipe
2025-10-02T08:10:47.882600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 980
2025-10-02T08:10:47.882606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:47.882618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:47.882623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:47.882628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533881546602549:2378], now have 1 active actors on pipe
2025-10-02T08:10:47.882660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.882663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.882676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533881086551178:11558]
2025-10-02T08:10:47.882683Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:47.882705Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:47.882711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:47.882715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:47.882717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:47.882700Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 980
2025-10-02T08:10:47.882723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:47.882726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:47.882735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:47.882755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.882804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:47.882812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:47.882824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:47.882861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 981 partition: 0 MaxSeqNo: 17 sessionId: src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0
2025-10-02T08:10:47.883252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e3bbaa4-3c10a57c-d584d712-80a828a0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:47.886471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0] Write session: try to update token
2025-10-02T08:10:47.886493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:47.901076Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:47.901099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:47.901101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:47.901109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533881086551178:11558]
2025-10-02T08:10:47.901115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533881086551178:11558]
2025-10-02T08:10:47.901156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:47.901160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:47.901163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:47.901165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:47.901165Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:47.901308Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:47.905443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId: src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:47.907959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:47.943505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533881086551210:10816]
2025-10-02T08:10:47.943607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 980, pipe: [1:7556533881086551210:10816]
2025-10-02T08:10:48.038746Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:48.039447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.039461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.039493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533881086551210:10816], now have 1 active actors on pipe
2025-10-02T08:10:48.039597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:48.039612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:48.039657Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:48.039672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 981 reason: error at write: Disconnected sessionId: src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0
2025-10-02T08:10:48.039749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:48.039851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 981 sessionId: src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0 is DEAD
2025-10-02T08:10:48.039879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533881086551210:10816]
2025-10-02T08:10:48.040007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:48.040020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0] Write session will restart in 0.006654s
2025-10-02T08:10:48.040044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0] Write session: Do CDS request
2025-10-02T08:10:48.040049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:48.048492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.048534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:48.048551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 982
2025-10-02T08:10:48.048777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.048834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:48.048844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:48.048847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:48.049362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 982 sessionId:  describe result for acl check
2025-10-02T08:10:48.049418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:48.049427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:48.049429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:48.049436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533885381518903:11566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:48.050058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533885381518903:11566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:48.053334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533885381518903:11566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:48.056077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533885381518903:11566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:48.056093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533885381518903:11566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:48.056096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533885381518903:11566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:48.056104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:48.064191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:48.064525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:48.064647Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:48.064654Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:48.064661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:48.064689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:48.064719Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533885381519252:11565]
2025-10-02T08:10:48.065332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:48.065593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:48.065651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:48.065960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:48.066025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.066031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.066032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.066033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.066034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.066038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.066048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.066055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.066059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.066067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.066072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.066083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.066089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.066097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.066102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.066107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.066111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.066119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.066127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.066136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.066156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:48.074435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:48.076273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:48.076292Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:48.076295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:48.076299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:48.076306Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 981 [1:7556533885381519252:11565]
2025-10-02T08:10:48.076316Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:48.076332Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:48.076335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.076338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.076340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.076354Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:48.076359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:48.076364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:48.076418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.076426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.076430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:48.076432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:48.076494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:48.076501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.076513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.076524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:48.076546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381519158:11566], now have 1 active actors on pipe
2025-10-02T08:10:48.076554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 981
2025-10-02T08:10:48.076556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533885381519246:11565]
2025-10-02T08:10:48.076558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533885381519246:11565]
2025-10-02T08:10:48.076569Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:48.076582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533885841569861:2378], now have 1 active actors on pipe
2025-10-02T08:10:48.076582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:48.076585Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:48.076594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:48.076607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:48.076613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:48.076619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.076623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.076623Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 981
2025-10-02T08:10:48.076660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533885381519246:11565]
2025-10-02T08:10:48.076667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:48.076670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:48.076680Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:48.076687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.076690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.076692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:48.076700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.076708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:48.076746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.076816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.076832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.076860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.076906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 982 partition: 0 MaxSeqNo: 17 sessionId: src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0
2025-10-02T08:10:48.077299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a266f2b-fcd5198f-3b8ece22-c2bfd000_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:48.080434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0] Write session: try to update token
2025-10-02T08:10:48.080454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:48.094752Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:48.094774Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:48.094777Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:48.094786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533885381519246:11565]
2025-10-02T08:10:48.094790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533885381519246:11565]
2025-10-02T08:10:48.094832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:48.094835Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:48.094839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.094840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:48.094842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:48.094978Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:48.096861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId: src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:48.099880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:48.128844Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:10:48.128872Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-10-02T08:10:48.140126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533885381519281:10816]
2025-10-02T08:10:48.140238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 981, pipe: [1:7556533885381519281:10816]
2025-10-02T08:10:48.231011Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:48.231749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.231765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.231817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381519281:10816], now have 1 active actors on pipe
2025-10-02T08:10:48.231928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533885381519281:10816]
2025-10-02T08:10:48.231945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:48.231948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:48.231991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 982 reason: error at write: Disconnected sessionId: src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0
2025-10-02T08:10:48.232051Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:48.232051Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:48.232071Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-10-02T08:10:48.232135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 982 sessionId: src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0 is DEAD
2025-10-02T08:10:48.232311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:48.232328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0] Write session will restart in 0.006950s
2025-10-02T08:10:48.232363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0] Write session: Do CDS request
2025-10-02T08:10:48.232368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:48.240391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.240499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:48.240518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 983
2025-10-02T08:10:48.240683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.240720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:48.240730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:48.240734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:48.241134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 983 sessionId:  describe result for acl check
2025-10-02T08:10:48.241167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:48.241173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:48.241174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:48.241180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533885381519694:11574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:48.241671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533885381519694:11574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:48.244483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533885381519694:11574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:48.247791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533885381519694:11574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:48.247807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533885381519694:11574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:48.247810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533885381519694:11574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:48.247818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:48.255212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:48.255616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:48.256064Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:48.256074Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:48.256084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:48.256131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:48.256169Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533885381520032:11573]
2025-10-02T08:10:48.256623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:48.256776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:48.256819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:48.257069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:48.257114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.257120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.257121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.257122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.257123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.257127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.257137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.257140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.257144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.257147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.257152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.257159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.257165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.257169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.257173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.257178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.257182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.257186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.257205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.257214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.257232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:48.265416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:48.266907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:48.266928Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:48.266931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:48.266935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:48.266943Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 982 [1:7556533885381520032:11573]
2025-10-02T08:10:48.266956Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:48.266974Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:48.266976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.266980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.266982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.266999Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:48.267009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:48.267016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:48.267081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.267089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.267092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:48.267095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:48.267162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:48.267168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.267182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.267198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:48.267213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533885381520026:11573]
2025-10-02T08:10:48.267219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533885381520026:11573]
2025-10-02T08:10:48.267231Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:48.267243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:48.267257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:48.267259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:48.267266Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:48.267269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:48.267269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 982
2025-10-02T08:10:48.267269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381519958:11574], now have 1 active actors on pipe
2025-10-02T08:10:48.267300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533885381520026:11573]
2025-10-02T08:10:48.267303Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:48.267309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533885841569869:2378], now have 1 active actors on pipe
2025-10-02T08:10:48.267314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.267318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.267359Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:48.267371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.267374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.267376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:48.267385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.267396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:48.267414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.267440Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:48.267461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.267463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.267475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.267510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 983 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0
2025-10-02T08:10:48.267530Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 982
2025-10-02T08:10:48.267741Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:10:48.267918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfa9d73-421ab89f-90dd9e7e-1b29e830_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:48.267955Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 7 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:10:48.267995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:10:48.271178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0] Write session: try to update token
2025-10-02T08:10:48.271202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:48.285943Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:48.285963Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:48.285965Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:48.285973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533885381520026:11573]
2025-10-02T08:10:48.285976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533885381520026:11573]
2025-10-02T08:10:48.286002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId: src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:48.286010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:48.286014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.286016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:48.286029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:48.286046Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:48.286138Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:48.288503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:48.332144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533885381520058:10816]
2025-10-02T08:10:48.332300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 982, pipe: [1:7556533885381520058:10816]
2025-10-02T08:10:48.430161Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:48.430920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.430938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.430979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381520058:10816], now have 1 active actors on pipe
2025-10-02T08:10:48.431130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533885381520058:10816]
2025-10-02T08:10:48.431188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:48.431204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:48.431211Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:48.431255Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:48.431709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:48.431722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0] Write session will restart in 0.007961s
2025-10-02T08:10:48.431749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0] Write session: Do CDS request
2025-10-02T08:10:48.431757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:48.431286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 983 reason: error at write: Disconnected sessionId: src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0
2025-10-02T08:10:48.431588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 983 sessionId: src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0 is DEAD
2025-10-02T08:10:48.449269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.449445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:48.449466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 984
2025-10-02T08:10:48.449562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.449593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:48.449611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:48.449619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:48.450054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 984 sessionId:  describe result for acl check
2025-10-02T08:10:48.450084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:48.450089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:48.450091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:48.450096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533885381520694:11581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:48.450601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533885381520694:11581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:48.453956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533885381520694:11581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:48.458762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:48.459046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533885381520694:11581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:48.459062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533885381520694:11581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:48.459066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533885381520694:11581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:48.459074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:48.459143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:48.459299Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:48.459314Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:48.459324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:48.459370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:48.459409Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533885381520812:11580]
2025-10-02T08:10:48.460004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:48.460193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:48.460231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:48.460447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:48.460481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.460486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.460486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.460487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.460488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.460491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.460498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.460500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.460503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.460505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.460508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.460513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.460516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.460519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.460521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.460524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.460527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.460529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.460532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.460535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.460552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:48.470681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:48.472421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:48.472438Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:48.472440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:48.472443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:48.472447Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 983 [1:7556533885381520812:11580]
2025-10-02T08:10:48.472458Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:48.472472Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:48.472474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.472477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.472478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.472491Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:48.472501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:48.472507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:48.472561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.472568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.472573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:48.472576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:48.472630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:48.472635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.472648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.472665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:48.472684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533885381520801:11580]
2025-10-02T08:10:48.472689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533885381520801:11580]
2025-10-02T08:10:48.472696Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:48.472698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 983
2025-10-02T08:10:48.472706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381520808:11581], now have 1 active actors on pipe
2025-10-02T08:10:48.472706Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:48.472709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:48.472714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533885841569878:2378], now have 1 active actors on pipe
2025-10-02T08:10:48.472718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:48.472727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:48.472729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:48.472734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.472737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.472773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533885381520801:11580]
2025-10-02T08:10:48.472785Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:48.472795Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:48.472825Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 983
2025-10-02T08:10:48.472852Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:48.472863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.472867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.472869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:48.472877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.472886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:48.472927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.472976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.472981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.472992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.473023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 984 partition: 0 MaxSeqNo: 17 sessionId: src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0
2025-10-02T08:10:48.473373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4426cd-83590a77-a6dc3b12-43f05acf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:48.476165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0] Write session: try to update token
2025-10-02T08:10:48.476180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:48.490485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId: src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:48.491929Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:48.491943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:48.491946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:48.491954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533885381520801:11580]
2025-10-02T08:10:48.491957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533885381520801:11580]
2025-10-02T08:10:48.491995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:48.492006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.492008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:48.492020Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:48.492036Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:48.492151Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:48.493155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:48.531276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533885381520840:10816]
2025-10-02T08:10:48.531452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 983, pipe: [1:7556533885381520840:10816]
2025-10-02T08:10:48.637688Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:48.637975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.637990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.638028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381520840:10816], now have 1 active actors on pipe
2025-10-02T08:10:48.638272Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:48.638241Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:48.638570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:48.638631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 984 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0
2025-10-02T08:10:48.638734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533885381520840:10816]
2025-10-02T08:10:48.638789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 984 sessionId: src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0 is DEAD
2025-10-02T08:10:48.639186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:48.639201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0] Write session will restart in 0.006358s
2025-10-02T08:10:48.639226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0] Write session: Do CDS request
2025-10-02T08:10:48.639233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:48.646377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.646495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:48.646514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 985
2025-10-02T08:10:48.646782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.646824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:48.646835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:48.646838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:48.647286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 985 sessionId:  describe result for acl check
2025-10-02T08:10:48.647325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:48.647331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:48.647333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:48.647339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533885381521167:11588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:48.647819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533885381521167:11588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:48.650294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533885381521167:11588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:48.653371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533885381521167:11588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:48.653390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533885381521167:11588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:48.653393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533885381521167:11588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:48.653401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:48.666209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:48.670036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:48.670301Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:48.670313Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:48.670328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:48.670385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:48.670427Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533885381521612:11587]
2025-10-02T08:10:48.671188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:48.671368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:48.671413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:48.671768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:48.671823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.671830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.671831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.671832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.671834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.671839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.671851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.671855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.671860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.671865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.671870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.671879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.671885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.671891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.671899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.671910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.671916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.671926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.671932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.671937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.671963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:48.680636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:48.682288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:48.682315Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:48.682317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:48.682321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:48.682328Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 984 [1:7556533885381521612:11587]
2025-10-02T08:10:48.682342Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:48.682360Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:48.682368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.682372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.682373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.682392Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:48.682401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:48.682407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:48.682470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.682478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.682481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:48.682484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:48.682550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:48.682558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.682571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.682586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:48.682608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381521373:11588], now have 1 active actors on pipe
2025-10-02T08:10:48.682609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 984
2025-10-02T08:10:48.682618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533885381521599:11587]
2025-10-02T08:10:48.682621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533885381521599:11587]
2025-10-02T08:10:48.682635Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:48.682645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533885841569886:2378], now have 1 active actors on pipe
2025-10-02T08:10:48.682648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:48.682651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:48.682658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:48.682672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:48.682679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:48.682686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.682693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.682737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533885381521599:11587]
2025-10-02T08:10:48.682747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:48.682751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:48.682762Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:48.682732Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 984
2025-10-02T08:10:48.682768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.682771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.682773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:48.682781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.682793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:48.682838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.682940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.682954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.682979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.683020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 985 partition: 0 MaxSeqNo: 17 sessionId: src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0
2025-10-02T08:10:48.683403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5657e70-ab1ef688-478ca0a7-9b970d74_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:48.686589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0] Write session: try to update token
2025-10-02T08:10:48.686613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:48.701843Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:48.701943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:48.701952Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:48.701961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533885381521599:11587]
2025-10-02T08:10:48.701970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533885381521599:11587]
2025-10-02T08:10:48.702015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:48.702014Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:48.702019Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:48.702026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.702029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:48.702171Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:48.706934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId: src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:48.709730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:48.739162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533885381521636:10816]
2025-10-02T08:10:48.739318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 984, pipe: [1:7556533885381521636:10816]
2025-10-02T08:10:48.839689Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:48.840321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.840333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.840366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381521636:10816], now have 1 active actors on pipe
2025-10-02T08:10:48.840471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:48.840478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:48.840631Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:48.840744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 985 reason: error at write: Disconnected sessionId: src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0
2025-10-02T08:10:48.840817Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:48.840946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 985 sessionId: src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0 is DEAD
2025-10-02T08:10:48.841102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533885381521636:10816]
2025-10-02T08:10:48.841129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:48.841144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0] Write session will restart in 0.006189s
2025-10-02T08:10:48.841174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0] Write session: Do CDS request
2025-10-02T08:10:48.841182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:48.846560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:48.847677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:48.847891Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:48.847901Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:48.847910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:48.847954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:48.848006Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533885381521732:11605]
2025-10-02T08:10:48.848532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:48.848704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.848760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:48.848837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:48.849194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:48.849246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.849253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.849254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.849255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.849256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.849261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.849271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.849274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.849278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.849282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.849286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:48.849288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.849291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 986
2025-10-02T08:10:48.849296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:48.849302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.849307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:48.849311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.849315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:48.849318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.849323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.849327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.849331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.849346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:48.849521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:48.849585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:48.849595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:48.849601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:48.850086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 986 sessionId:  describe result for acl check
2025-10-02T08:10:48.850116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:48.850118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:48.850120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:48.850127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533885381521748:11607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:48.850746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533885381521748:11607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:48.852758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533885381521748:11607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:48.857270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533885381521748:11607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:48.857295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533885381521748:11607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:48.857299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533885381521748:11607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:48.857310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:48.857833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:48.859523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:48.859545Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:48.859548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:48.859551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:48.859558Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 985 [1:7556533885381521732:11605]
2025-10-02T08:10:48.859569Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:48.859584Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:48.859587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.859589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.859591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.859606Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:48.859611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:48.859618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:48.859663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.859672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.859674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:48.859675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:48.859735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:48.859745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.859758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:48.859768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:48.859788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533885841569927:2378], now have 1 active actors on pipe
2025-10-02T08:10:48.859800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381521777:11607], now have 1 active actors on pipe
2025-10-02T08:10:48.859806Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533885381521726:11605]
2025-10-02T08:10:48.859808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533885381521726:11605]
2025-10-02T08:10:48.859823Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:48.859828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 985
2025-10-02T08:10:48.859835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:48.859848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:48.859850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:48.859850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 985
2025-10-02T08:10:48.859883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533885381521726:11605]
2025-10-02T08:10:48.859885Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:48.859903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:48.859916Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:48.859921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:48.859943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.859962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.859996Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e508164-25fe5021-83fb6da3-474da92e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:48.860011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.860016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.860018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:48.860030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.860041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:48.860070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.860115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.860123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.860137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:48.860172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 986 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e508164-25fe5021-83fb6da3-474da92e_0
2025-10-02T08:10:48.860586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8dd4877-d7397c07-410fc43-3c7b36b6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e508164-25fe5021-83fb6da3-474da92e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:48.863444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e508164-25fe5021-83fb6da3-474da92e_0] Write session: try to update token
2025-10-02T08:10:48.863465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e508164-25fe5021-83fb6da3-474da92e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:48.878103Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:48.878127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:48.878134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533885381521726:11605]
2025-10-02T08:10:48.878173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:48.878181Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:48.878347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:48.878495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:48.878651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:48.878767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId: src_id|3e508164-25fe5021-83fb6da3-474da92e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:48.878806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:48.879057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:48.879106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:48.881367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:48.881444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.881461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.881493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:48.881519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:48.881583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:48.881597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:48.881758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.881823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.881893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.881958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.882160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.882173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.882245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.882307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.882374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.882442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.882547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.882557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.882621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.882688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.882758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.882823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.882868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.882876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.882942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.883001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.883065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.883129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.883179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.883187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.883253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.883317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.883383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.883448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.883500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.883509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.883573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.883638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.883723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.883789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.883838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.883845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.883912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.883974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.884044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.884107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.884153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.884162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.884228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.884289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.884354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.884417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.884469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.884477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.884541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.884603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.884667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.884728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.884774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.884781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.884871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:48.884934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:48.884999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:48.885063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:48.885112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:48.885118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:48.885154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:48.885215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:48.885238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:48.885245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:48.885273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:48.885289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:48.885296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:48.885299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:48.885301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:48.885709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:48.885736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:48.885742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:48.885750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:48.885754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:48.885758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:48.886412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:48.886437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:48.886443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:48.886446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:48.886449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:48.886452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:48.886933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:48.886957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:48.886965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:48.886973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:48.886976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:48.889718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:48.889737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:48.889750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392648889
2025-10-02T08:10:48.889972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:48.889991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:48.889996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:48.889999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:48.890003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:48.890006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:48.890496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:48.890520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:48.890525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:48.890535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:48.890538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:48.890541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:48.891062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:48.891087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:48.891094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:48.891097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:48.891101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:48.891104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:48.891607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:48.891632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:48.891642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:48.892858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:48.892878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:48.892883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:48.892888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:48.892897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392648892
2025-10-02T08:10:48.893209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:48.893233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:48.893239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:48.893247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:48.893250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:48.893255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:48.893709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:48.893731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:48.893737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:48.893741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:48.893744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:48.893748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:48.894217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:48.894241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:48.894340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392648894
2025-10-02T08:10:48.895143Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:48.895169Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:48.895182Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:48.895198Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:48.896910Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:48.896923Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:48.896925Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:48.896933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533885381521726:11605]
2025-10-02T08:10:48.896938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533885381521726:11605]
2025-10-02T08:10:48.896999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:48.896998Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:48.897004Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:48.897008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:48.897010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:48.897152Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:48.941400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533885381521811:10816]
2025-10-02T08:10:48.941593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 985, pipe: [1:7556533885381521811:10816]
2025-10-02T08:10:49.032650Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:49.033026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533885381521811:10816], now have 1 active actors on pipe
2025-10-02T08:10:49.033159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533885381521811:10816]
2025-10-02T08:10:49.033190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:49.033197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:49.033226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 986 reason: error at write: Disconnected sessionId: src_id|3e508164-25fe5021-83fb6da3-474da92e_0
2025-10-02T08:10:49.033256Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:49.033302Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:49.033416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 986 sessionId: src_id|3e508164-25fe5021-83fb6da3-474da92e_0 is DEAD
2025-10-02T08:10:49.033588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e508164-25fe5021-83fb6da3-474da92e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:49.033602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e508164-25fe5021-83fb6da3-474da92e_0] Write session will restart in 0.007097s
2025-10-02T08:10:49.033640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e508164-25fe5021-83fb6da3-474da92e_0] Write session: Do CDS request
2025-10-02T08:10:49.033647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e508164-25fe5021-83fb6da3-474da92e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:49.038659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:49.039915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:49.040050Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:49.040058Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:49.040064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:49.040098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:49.040137Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533889676489167:11612]
2025-10-02T08:10:49.040545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:49.040693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:49.040723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:49.040940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:49.040974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.040978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.040979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.040980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.040982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.040985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.040991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.040993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.040995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.040996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.041000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.041004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.041008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.041011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.041014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.041016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.041018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.041021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.041023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.041026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.041035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:49.042346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e508164-25fe5021-83fb6da3-474da92e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.042402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:49.042415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 987
2025-10-02T08:10:49.042600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.042625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:49.042628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:49.042631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:49.042995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 987 sessionId:  describe result for acl check
2025-10-02T08:10:49.043036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:49.043044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:49.043046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:49.043051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533889676489183:11614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:49.043586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533889676489183:11614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:49.045727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533889676489183:11614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:49.048755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533889676489183:11614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:49.048776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533889676489183:11614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:49.048780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533889676489183:11614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:49.048791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:49.049314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:49.050918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:49.050936Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:49.050938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:49.050941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:49.050946Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 986 [1:7556533889676489167:11612]
2025-10-02T08:10:49.050955Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:49.050970Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:49.050977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.050979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.050980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.050993Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:49.051001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:49.051005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:49.051049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.051055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.051057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:49.051059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:49.051108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:49.051115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.051124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.051135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:49.051154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533889676489161:11612]
2025-10-02T08:10:49.051160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533889676489161:11612]
2025-10-02T08:10:49.051168Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:49.051181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489211:11614], now have 1 active actors on pipe
2025-10-02T08:10:49.051182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 986
2025-10-02T08:10:49.051192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:49.051192Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:49.051196Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:49.051204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:49.051211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:49.051216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533890136537232:2378], now have 1 active actors on pipe
2025-10-02T08:10:49.051243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.051249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.051260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533889676489161:11612]
2025-10-02T08:10:49.051268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:49.051276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:49.051244Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 986
2025-10-02T08:10:49.051287Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:49.051291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.051294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.051295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:49.051301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.051309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:49.051328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.051362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.051368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.051379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.051414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 987 partition: 0 MaxSeqNo: 17 sessionId: src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0
2025-10-02T08:10:49.051764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e508164-25fe5021-83fb6da3-474da92e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:49.054381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0] Write session: try to update token
2025-10-02T08:10:49.054399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:49.067439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId: src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:49.069519Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:49.069540Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:49.069543Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:49.069552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533889676489161:11612]
2025-10-02T08:10:49.069556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533889676489161:11612]
2025-10-02T08:10:49.069597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:49.069603Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:49.069607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.069609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:49.069619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:49.069741Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:49.069975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:49.133387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533889676489229:10816]
2025-10-02T08:10:49.133513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 986, pipe: [1:7556533889676489229:10816]
2025-10-02T08:10:49.219978Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:49.220421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.220437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.220478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489229:10816], now have 1 active actors on pipe
2025-10-02T08:10:49.220620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:49.220640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:49.220690Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:49.220703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 987 reason: error at write: Disconnected sessionId: src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0
2025-10-02T08:10:49.220925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 987 sessionId: src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0 is DEAD
2025-10-02T08:10:49.220973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533889676489229:10816]
2025-10-02T08:10:49.220758Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:49.225871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:49.225891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0] Write session will restart in 0.009156s
2025-10-02T08:10:49.225921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0] Write session: Do CDS request
2025-10-02T08:10:49.225928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:49.227006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:49.228508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:49.228717Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:49.228727Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:49.228738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:49.228789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:49.228846Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533889676489288:11619]
2025-10-02T08:10:49.229515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:49.229704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:49.229747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:49.230061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:49.230106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.230112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.230114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.230115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.230116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.230121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.230147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.230152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.230156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.230160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.230166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.230173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.230184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.230189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.230198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.230203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.230208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.230213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.230218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.230228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.230247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:49.236472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.239232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:49.240523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:49.240548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 988
2025-10-02T08:10:49.240889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.240957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:49.240969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:49.240974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:49.241046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:49.241065Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:49.241068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:49.241071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:49.241078Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 987 [1:7556533889676489288:11619]
2025-10-02T08:10:49.241088Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:49.241106Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:49.241116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.241119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.241121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.241137Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:49.241142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:49.241149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:49.241209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.241219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.241223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:49.241226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:49.241282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:49.241290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.241300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.241307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:49.241325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533889676489282:11619]
2025-10-02T08:10:49.241331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533889676489282:11619]
2025-10-02T08:10:49.241337Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:49.241349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:49.241368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:49.241377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:49.241387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533890136537238:2378], now have 1 active actors on pipe
2025-10-02T08:10:49.241412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533889676489282:11619]
2025-10-02T08:10:49.241419Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:49.241490Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:49.241499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:49.241505Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:49.241507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 988 sessionId:  describe result for acl check
2025-10-02T08:10:49.241537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:49.241546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:49.241548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:49.241552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533889676489306:11621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:49.241572Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 987
2025-10-02T08:10:49.242070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533889676489306:11621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:49.244705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533889676489306:11621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:49.251001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533889676489306:11621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:49.251017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533889676489306:11621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:49.251020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533889676489306:11621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:49.251040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:49.251214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 987
2025-10-02T08:10:49.251230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489344:11621], now have 1 active actors on pipe
2025-10-02T08:10:49.251235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.251240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.251263Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5913f0a-6de76509-28484a27-19c83903_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:49.251279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.251284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.251288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:49.251300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.251320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:49.251343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.251378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.251384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.251393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.251422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 988 partition: 0 MaxSeqNo: 17 sessionId: src_id|e5913f0a-6de76509-28484a27-19c83903_0
2025-10-02T08:10:49.251785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86dff311-605347ca-2b1e93ba-8a8f3706_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e5913f0a-6de76509-28484a27-19c83903_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:49.255252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5913f0a-6de76509-28484a27-19c83903_0] Write session: try to update token
2025-10-02T08:10:49.255276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5913f0a-6de76509-28484a27-19c83903_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:49.252906Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:49.252921Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:49.252927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533889676489282:11619]
2025-10-02T08:10:49.252961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:49.252985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:49.253150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:49.253298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:49.253437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:49.253573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:49.253758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:49.253791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:49.269768Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:49.269789Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:49.269792Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:49.269803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533889676489282:11619]
2025-10-02T08:10:49.269809Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533889676489282:11619]
2025-10-02T08:10:49.269855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:49.269855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:49.269862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:49.269874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.269877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:49.270022Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:49.279424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId: src_id|e5913f0a-6de76509-28484a27-19c83903_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:49.282395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:49.320796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533889676489350:10816]
2025-10-02T08:10:49.320978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 987, pipe: [1:7556533889676489350:10816]
2025-10-02T08:10:49.413714Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:49.414112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.414130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.414150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489350:10816], now have 1 active actors on pipe
2025-10-02T08:10:49.414234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:49.414240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:49.414297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 988 reason: error at write: Disconnected sessionId: src_id|e5913f0a-6de76509-28484a27-19c83903_0
2025-10-02T08:10:49.414399Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:49.414388Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:49.414484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 988 sessionId: src_id|e5913f0a-6de76509-28484a27-19c83903_0 is DEAD
2025-10-02T08:10:49.414613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533889676489350:10816]
2025-10-02T08:10:49.414689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5913f0a-6de76509-28484a27-19c83903_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:49.414706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5913f0a-6de76509-28484a27-19c83903_0] Write session will restart in 0.005069s
2025-10-02T08:10:49.414737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5913f0a-6de76509-28484a27-19c83903_0] Write session: Do CDS request
2025-10-02T08:10:49.414745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5913f0a-6de76509-28484a27-19c83903_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:49.420328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:49.421476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:49.421483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:49.421489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 989
2025-10-02T08:10:49.421529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5913f0a-6de76509-28484a27-19c83903_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.421651Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:49.421662Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:49.421671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:49.421718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:49.421757Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533889676489413:11625]
2025-10-02T08:10:49.421767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.421803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:49.421816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:49.421820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:49.422187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 989 sessionId:  describe result for acl check
2025-10-02T08:10:49.422218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:49.422220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:49.422221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:49.422226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533889676489417:11627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:49.422292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:49.422450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:49.422489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:49.422724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533889676489417:11627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:49.422769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:49.422824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.422829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.422830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.422831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.422832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.422836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.422845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.422848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.422851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.422854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.422859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.422864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.422869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.422873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.422877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.422881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.422885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.422889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.422893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.422897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.422912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:49.424431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533889676489417:11627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:49.429246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533889676489417:11627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:49.429264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533889676489417:11627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:49.429267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533889676489417:11627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:49.429274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:49.431075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:49.433086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:49.433106Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:49.433108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:49.433111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:49.433117Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 988 [1:7556533889676489413:11625]
2025-10-02T08:10:49.433128Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:49.433145Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:49.433153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.433156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.433158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.433175Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:49.433179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:49.433189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:49.433250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.433257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.433260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:49.433262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:49.433323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:49.433332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.433344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.433355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:49.433372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489461:11627], now have 1 active actors on pipe
2025-10-02T08:10:49.433375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 988
2025-10-02T08:10:49.433385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533889676489406:11625]
2025-10-02T08:10:49.433387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533889676489406:11625]
2025-10-02T08:10:49.433399Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:49.433406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533890136537244:2378], now have 1 active actors on pipe
2025-10-02T08:10:49.433411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.433413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.433432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:49.433434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:49.433438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:49.433448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:49.433450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:49.433495Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7f25483-4752701-62b16336-2823c8ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:49.433504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.433508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.433509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:49.433519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.433495Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 988
2025-10-02T08:10:49.433530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:49.433544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533889676489406:11625]
2025-10-02T08:10:49.433556Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:49.433580Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:49.433591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.433673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.433687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.433711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.433766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 989 partition: 0 MaxSeqNo: 17 sessionId: src_id|a7f25483-4752701-62b16336-2823c8ee_0
2025-10-02T08:10:49.434130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5913f0a-6de76509-28484a27-19c83903_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a7f25483-4752701-62b16336-2823c8ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:49.437191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f25483-4752701-62b16336-2823c8ee_0] Write session: try to update token
2025-10-02T08:10:49.437208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f25483-4752701-62b16336-2823c8ee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:49.451924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId: src_id|a7f25483-4752701-62b16336-2823c8ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:49.452023Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:49.452040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:49.452042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:49.452050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533889676489406:11625]
2025-10-02T08:10:49.452054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533889676489406:11625]
2025-10-02T08:10:49.452095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:49.452102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:49.452106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.452108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:49.452111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:49.452259Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:49.454733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:49.514828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533889676489482:10816]
2025-10-02T08:10:49.514959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 988, pipe: [1:7556533889676489482:10816]
2025-10-02T08:10:49.592561Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:49.592867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.592878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.592916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489482:10816], now have 1 active actors on pipe
2025-10-02T08:10:49.593035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533889676489482:10816]
2025-10-02T08:10:49.593061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:49.593066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:49.593166Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:49.593108Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:49.593145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 989 reason: error at write: Disconnected sessionId: src_id|a7f25483-4752701-62b16336-2823c8ee_0
2025-10-02T08:10:49.593326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 989 sessionId: src_id|a7f25483-4752701-62b16336-2823c8ee_0 is DEAD
2025-10-02T08:10:49.593412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f25483-4752701-62b16336-2823c8ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:49.593419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f25483-4752701-62b16336-2823c8ee_0] Write session will restart in 0.007609s
2025-10-02T08:10:49.593439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f25483-4752701-62b16336-2823c8ee_0] Write session: Do CDS request
2025-10-02T08:10:49.593444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f25483-4752701-62b16336-2823c8ee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:49.598443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:49.599561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:49.599732Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:49.599740Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:49.599758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:49.599810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:49.599850Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533889676489549:11633]
2025-10-02T08:10:49.600336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:49.600513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:49.600560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:49.600905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:49.600954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.600964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.600965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.600966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.600967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.600972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.600982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.600990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.600992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.600994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.600998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.601002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.601005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.601009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.601011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.601014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.601017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.601020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.601023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.601025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.601038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:49.602413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f25483-4752701-62b16336-2823c8ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.602656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:49.602674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 990
2025-10-02T08:10:49.602814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.602852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:49.602863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:49.602872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:49.603351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 990 sessionId:  describe result for acl check
2025-10-02T08:10:49.603378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:49.603379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:49.603380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:49.603387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533889676489565:11635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:49.603941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533889676489565:11635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:49.606529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533889676489565:11635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:49.609687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:49.610369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533889676489565:11635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:49.610383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533889676489565:11635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:49.610388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533889676489565:11635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:49.610410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:49.611353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:49.611372Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:49.611375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:49.611380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:49.611388Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 989 [1:7556533889676489549:11633]
2025-10-02T08:10:49.611402Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:49.611425Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:49.611433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.611437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.611445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.611463Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:49.611474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:49.611484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:49.611562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.611568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.611572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:49.611575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:49.611653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:49.611663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.611673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 989
2025-10-02T08:10:49.611678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.611689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:49.611731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489597:11635], now have 1 active actors on pipe
2025-10-02T08:10:49.611739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533890136537254:2378], now have 1 active actors on pipe
2025-10-02T08:10:49.611745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.611749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.611773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533889676489543:11633]
2025-10-02T08:10:49.611781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533889676489543:11633]
2025-10-02T08:10:49.611790Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:49.611763Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 989
2025-10-02T08:10:49.611809Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:49.611810Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:49.611814Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:49.611829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:49.611833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:49.611851Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d488f64f-418a0585-9861d19-1b2ca017_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:49.611865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.611869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.611871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:49.611884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.611897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:49.611952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533889676489543:11633]
2025-10-02T08:10:49.611964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:49.611976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.611977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:49.612025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.612033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.612048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.612082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 990 partition: 0 MaxSeqNo: 17 sessionId: src_id|d488f64f-418a0585-9861d19-1b2ca017_0
2025-10-02T08:10:49.612479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7f25483-4752701-62b16336-2823c8ee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d488f64f-418a0585-9861d19-1b2ca017_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:49.615708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d488f64f-418a0585-9861d19-1b2ca017_0] Write session: try to update token
2025-10-02T08:10:49.615730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d488f64f-418a0585-9861d19-1b2ca017_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:49.622924Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:49.622948Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:49.622962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533889676489543:11633]
2025-10-02T08:10:49.623012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:49.623027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:49.623193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:49.623349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:49.623514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:49.623674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:49.623928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:49.623970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:49.631790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId: src_id|d488f64f-418a0585-9861d19-1b2ca017_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:49.634921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:49.635015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.635034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.635074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:49.635099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:49.635174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.635190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.635409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.635481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.635550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.635621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.635669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.635678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.635771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.635836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.635919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.635998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.636055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.636061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.636133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.636205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.636275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.636348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.636398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.636404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.636474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.636538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.636609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.636693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.636758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.636766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.636867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.636944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.637030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.637105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.637161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.637167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.637242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.637319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.637402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.637482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.637548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.637556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.637641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.637717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.637793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.637883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.637943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.637950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.638039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.638117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.638201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.638290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.638342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.638345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.638430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.638505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.638583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.638661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.638720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.638724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.638812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:49.638890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:49.638968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:49.639049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:49.639106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:49.639109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:49.639191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:49.639270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.639289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.639294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:49.639337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:49.639354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:49.639357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:49.639360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:49.639364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:49.639824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:49.639846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:49.639854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:49.639858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:49.639861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:49.639865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:49.640905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:49.640950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:49.640962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:49.640967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:49.640971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:49.640977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:49.641453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:49.641474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:49.641479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:49.641482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:49.641487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:49.643845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:49.643863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:49.643874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392649643
2025-10-02T08:10:49.644064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:49.644078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:49.644083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:49.644123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:49.644132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:49.644135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:49.644606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:49.644625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:49.644629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:49.644632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:49.644635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:49.644639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:49.645199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:49.645224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:49.645232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:49.645234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:49.645237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:49.645239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:49.645697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:49.645719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:49.645724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:49.646768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:49.646786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:49.646791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:49.646795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:49.646802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392649646
2025-10-02T08:10:49.647105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:49.647124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:49.647129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:49.647131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:49.647134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:49.647136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:49.647559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:49.647578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:49.647584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:49.647589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:49.647592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:49.647596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:49.648037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:49.648056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.648136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392649647
2025-10-02T08:10:49.650429Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:49.650453Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:49.650460Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:49.650467Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:49.650478Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:49.650481Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:49.650483Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:49.650494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533889676489543:11633]
2025-10-02T08:10:49.650498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533889676489543:11633]
2025-10-02T08:10:49.650558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:49.650568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.650570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:49.650583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:49.650594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:49.650705Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:49.693006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533889676489614:10816]
2025-10-02T08:10:49.693138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 989, pipe: [1:7556533889676489614:10816]
2025-10-02T08:10:49.781674Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:49.782048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489614:10816], now have 1 active actors on pipe
2025-10-02T08:10:49.782258Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:49.782263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533889676489614:10816]
2025-10-02T08:10:49.782286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:49.782313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 990 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d488f64f-418a0585-9861d19-1b2ca017_0
2025-10-02T08:10:49.782342Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:49.782501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 990 sessionId: src_id|d488f64f-418a0585-9861d19-1b2ca017_0 is DEAD
2025-10-02T08:10:49.782687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d488f64f-418a0585-9861d19-1b2ca017_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:49.782697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d488f64f-418a0585-9861d19-1b2ca017_0] Write session will restart in 0.007023s
2025-10-02T08:10:49.782716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d488f64f-418a0585-9861d19-1b2ca017_0] Write session: Do CDS request
2025-10-02T08:10:49.782722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d488f64f-418a0585-9861d19-1b2ca017_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:49.786162Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [d3024b3ab70027da] Result# TEvPutResult {Id# [72075186224037892:989:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:49.786180Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:989:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:49.786238Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:989:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:49.787985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:49.789096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:49.789269Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:49.789283Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:49.789295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:49.789351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:49.789393Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533889676489695:11640]
2025-10-02T08:10:49.789941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:49.790144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:49.790187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:49.790483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:49.790529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.790536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.790537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.790538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.790539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.790545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.790555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.790558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.790561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.790564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.790569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.790575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.790580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.790585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.790589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.790594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.790598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.790602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.790606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.790612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.790629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:49.791315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d488f64f-418a0585-9861d19-1b2ca017_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.791448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:49.791459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 991
2025-10-02T08:10:49.791622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.791653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:49.791664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:49.791668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:49.792060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 991 sessionId:  describe result for acl check
2025-10-02T08:10:49.792094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:49.792100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:49.792102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:49.792107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533889676489711:11642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:49.792596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533889676489711:11642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:49.794962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533889676489711:11642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:49.797654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533889676489711:11642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:49.797665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533889676489711:11642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:49.797668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533889676489711:11642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:49.797673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:49.800845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:49.802348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:49.802361Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:49.802362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:49.802365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:49.802369Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 990 [1:7556533889676489695:11640]
2025-10-02T08:10:49.802377Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:49.802390Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:49.802392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.802394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.802395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.802407Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:49.802411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:49.802415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:49.802454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.802455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.802457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:49.802459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:49.802517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:49.802525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.802533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.802540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:49.802552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489742:11642], now have 1 active actors on pipe
2025-10-02T08:10:49.802561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533889676489689:11640]
2025-10-02T08:10:49.802563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533889676489689:11640]
2025-10-02T08:10:49.802567Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:49.802576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:49.802581Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:49.802584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:49.802584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:49.802585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:49.802589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533890136537273:2378], now have 1 active actors on pipe
2025-10-02T08:10:49.802611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533889676489689:11640]
2025-10-02T08:10:49.802623Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:49.802626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:49.802662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 990
2025-10-02T08:10:49.802674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.802676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.802696Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:49.802702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.802705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.802708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:49.802717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.802661Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 990
2025-10-02T08:10:49.802725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:49.802743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.802789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.802798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.802814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.802840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 991 partition: 0 MaxSeqNo: 17 sessionId: src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0
2025-10-02T08:10:49.803131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d488f64f-418a0585-9861d19-1b2ca017_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:49.805954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0] Write session: try to update token
2025-10-02T08:10:49.805969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:49.819917Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:49.819935Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:49.819937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:49.819944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533889676489689:11640]
2025-10-02T08:10:49.819949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533889676489689:11640]
2025-10-02T08:10:49.819986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:49.819991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:49.819991Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:49.819997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.819999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:49.820122Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:49.834941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId: src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:49.837208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:49.882424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533889676489805:10816]
2025-10-02T08:10:49.882561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 990, pipe: [1:7556533889676489805:10816]
2025-10-02T08:10:49.953590Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:49.953796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.953808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.953823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489805:10816], now have 1 active actors on pipe
2025-10-02T08:10:49.953942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:49.953955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:49.954007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 991 reason: error at write: Disconnected sessionId: src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0
2025-10-02T08:10:49.954009Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:49.954047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:49.954168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 991 sessionId: src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0 is DEAD
2025-10-02T08:10:49.954217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533889676489805:10816]
2025-10-02T08:10:49.954332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:49.954342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0] Write session will restart in 0.007425s
2025-10-02T08:10:49.954359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0] Write session: Do CDS request
2025-10-02T08:10:49.954364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:49.959403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:49.960545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:49.960706Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:49.960715Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:49.960725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:49.960771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:49.960815Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533889676489875:11659]
2025-10-02T08:10:49.961692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:49.961878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:49.961909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:49.962121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:49.962169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.962176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.962176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.962179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.962181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.962185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.962197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.962199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.962202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.962204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.962208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.962212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:49.962216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.962219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:49.962221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.962225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:49.962227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.962230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.962232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.962235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.962247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:49.963319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.963421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:49.963433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 992
2025-10-02T08:10:49.963570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:49.963596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:49.963612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:49.963618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:49.963967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 992 sessionId:  describe result for acl check
2025-10-02T08:10:49.963998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:49.964004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:49.964005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:49.964008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533889676489891:11661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:49.964446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533889676489891:11661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:49.966391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533889676489891:11661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:49.970305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533889676489891:11661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:49.970323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533889676489891:11661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:49.970326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533889676489891:11661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:49.970334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:49.970679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:49.972290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:49.972308Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:49.972309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:49.972312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:49.972317Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 991 [1:7556533889676489875:11659]
2025-10-02T08:10:49.972327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:49.972341Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:49.972343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.972345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.972346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.972359Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:49.972362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:49.972368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:49.972409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.972410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.972412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:49.972413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:49.972457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:49.972459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.972467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:49.972474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:49.972491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533889676489920:11661], now have 1 active actors on pipe
2025-10-02T08:10:49.972495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 991
2025-10-02T08:10:49.972501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533889676489869:11659]
2025-10-02T08:10:49.972503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533889676489869:11659]
2025-10-02T08:10:49.972509Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:49.972515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533890136537301:2378], now have 1 active actors on pipe
2025-10-02T08:10:49.972520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:49.972521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:49.972525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:49.972531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:49.972533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:49.972539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.972543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.972577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533889676489869:11659]
2025-10-02T08:10:49.972588Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:49.972599Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:49.972603Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:49.972609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:49.972612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:49.972614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:49.972589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 991
2025-10-02T08:10:49.972620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:49.972625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:49.972657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.972722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:49.972729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:49.972739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:49.972765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 992 partition: 0 MaxSeqNo: 17 sessionId: src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0
2025-10-02T08:10:49.973161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f772baf-d0d8b34e-cdb49d93-42d63c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:49.975967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0] Write session: try to update token
2025-10-02T08:10:49.975985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:49.990513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId: src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:49.990580Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:49.990583Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:49.990584Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:49.990592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533889676489869:11659]
2025-10-02T08:10:49.990594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533889676489869:11659]
2025-10-02T08:10:49.990634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:49.990646Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:49.990649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:49.990651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:49.990651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:49.990784Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:49.992983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:50.054495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533893971457231:10816]
2025-10-02T08:10:50.054617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 991, pipe: [1:7556533893971457231:10816]
2025-10-02T08:10:50.119011Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:50.119333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.119349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.119387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457231:10816], now have 1 active actors on pipe
2025-10-02T08:10:50.119483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533893971457231:10816]
2025-10-02T08:10:50.119505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:50.119507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:50.119558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 992 reason: error at write: Disconnected sessionId: src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0
2025-10-02T08:10:50.119624Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:50.119623Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:50.119745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 992 sessionId: src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0 is DEAD
2025-10-02T08:10:50.119884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:50.119894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0] Write session will restart in 0.005305s
2025-10-02T08:10:50.119915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0] Write session: Do CDS request
2025-10-02T08:10:50.119920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:50.125762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:50.126294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.126374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:50.126389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 993
2025-10-02T08:10:50.126511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.126549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:50.126553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:50.126556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:50.127044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 993 sessionId:  describe result for acl check
2025-10-02T08:10:50.127048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:50.127081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:50.127089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:50.127091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:50.127096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533893971457304:11668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:50.127222Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:50.127238Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:50.127248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:50.127299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:50.127349Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533893971457306:11666]
2025-10-02T08:10:50.127591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533893971457304:11668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:50.127971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:50.128173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:50.128224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:50.128526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:50.128575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.128583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.128585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.128586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.128587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.128592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.128603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.128607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.128611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.128615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.128620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.128627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.128633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.128638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.128645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.128650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.128653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.128657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.128661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.128665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.128682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:50.133086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533893971457304:11668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:50.136922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533893971457304:11668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:50.136940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533893971457304:11668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:50.136944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533893971457304:11668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:50.136954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:50.137472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:50.139056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:50.139071Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:50.139073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:50.139076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:50.139081Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 992 [1:7556533893971457306:11666]
2025-10-02T08:10:50.139090Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:50.139104Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:50.139106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.139109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.139110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.139124Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:50.139128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:50.139133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:50.139180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.139185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.139190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:50.139192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:50.139241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:50.139247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.139257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.139267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:50.139281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533893971457297:11666]
2025-10-02T08:10:50.139286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533893971457297:11666]
2025-10-02T08:10:50.139291Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:50.139299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:50.139312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:50.139318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:50.139325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 992
2025-10-02T08:10:50.139344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:50.139351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457351:11668], now have 1 active actors on pipe
2025-10-02T08:10:50.139352Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:50.139354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533893971457297:11666]
2025-10-02T08:10:50.139356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:50.139359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:50.139375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533894431504606:2378], now have 1 active actors on pipe
2025-10-02T08:10:50.139385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.139388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.139408Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:50.139417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.139420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.139421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:50.139427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.139435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:50.139450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.139442Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 992
2025-10-02T08:10:50.139497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.139503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.139514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.139546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 993 partition: 0 MaxSeqNo: 17 sessionId: src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0
2025-10-02T08:10:50.139873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab2b910a-6439fbda-869e34c4-5d1e49f1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:50.142629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0] Write session: try to update token
2025-10-02T08:10:50.142648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:50.157539Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:50.157553Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:50.157555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:50.157562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533893971457297:11666]
2025-10-02T08:10:50.157566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533893971457297:11666]
2025-10-02T08:10:50.157613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:50.157617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.157619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:50.157624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:50.157630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:50.157819Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:50.157880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId: src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:50.160299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:50.219821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533893971457366:10816]
2025-10-02T08:10:50.219904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 992, pipe: [1:7556533893971457366:10816]
2025-10-02T08:10:50.289118Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:50.289473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.289490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.289529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457366:10816], now have 1 active actors on pipe
2025-10-02T08:10:50.289626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:50.289634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:50.289681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 993 reason: error at write: Disconnected sessionId: src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0
2025-10-02T08:10:50.289781Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:50.289790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:50.289861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 993 sessionId: src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0 is DEAD
2025-10-02T08:10:50.289994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:50.290004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0] Write session will restart in 0.008957s
2025-10-02T08:10:50.290037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0] Write session: Do CDS request
2025-10-02T08:10:50.290043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:50.290026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533893971457366:10816]
2025-10-02T08:10:50.295105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:50.296338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:50.296543Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:50.296555Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:50.296565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:50.296615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:50.296653Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533893971457439:11672]
2025-10-02T08:10:50.297253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:50.297473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:50.297527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:50.297812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:50.297856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.297861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.297863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.297864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.297864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.297870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.297880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.297883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.297887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.297890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.297896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.297902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.297912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.297916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.297921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.297926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.297934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.297938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.297943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.297948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.297969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:50.300381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.300477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:50.300489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 994
2025-10-02T08:10:50.300623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.300654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:50.300659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:50.300667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:50.301096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 994 sessionId:  describe result for acl check
2025-10-02T08:10:50.301133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:50.301139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:50.301140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:50.301147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533893971457455:11674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:50.301709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533893971457455:11674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:50.303746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533893971457455:11674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:50.306508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:50.306748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533893971457455:11674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:50.306761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533893971457455:11674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:50.306764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533893971457455:11674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:50.306773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:50.308085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:50.308100Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:50.308102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:50.308106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:50.308112Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 993 [1:7556533893971457439:11672]
2025-10-02T08:10:50.308123Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:50.308143Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:50.308149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.308152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.308155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.308170Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:50.308180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:50.308188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:50.308246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.308252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.308255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:50.308258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:50.308351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 993
2025-10-02T08:10:50.308383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:50.308392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.308405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.308421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:50.308443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457486:11674], now have 1 active actors on pipe
2025-10-02T08:10:50.308450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533894431504613:2378], now have 1 active actors on pipe
2025-10-02T08:10:50.308422Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 993
2025-10-02T08:10:50.308454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.308458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.308474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533893971457432:11672]
2025-10-02T08:10:50.308475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533893971457432:11672]
2025-10-02T08:10:50.308486Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:50.308494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:50.308499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:50.308503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:50.308512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:50.308518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:50.308538Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:50.308548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.308553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.308559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:50.308567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.308579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:50.308613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533893971457432:11672]
2025-10-02T08:10:50.308626Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:50.308634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:50.308644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.308705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.308711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.308724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.308761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 994 partition: 0 MaxSeqNo: 17 sessionId: src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0
2025-10-02T08:10:50.309122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6d9fc3-9e1ad8f6-b4876578-aa2acf1c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:50.311798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0] Write session: try to update token
2025-10-02T08:10:50.311814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:50.320367Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:50.320387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:50.320396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533893971457432:11672]
2025-10-02T08:10:50.320424Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:50.320436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:50.320610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:50.320754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:50.320934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:50.321079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:50.321270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:50.321309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:50.329791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId: src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:50.332516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:50.332609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.332619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.332647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:50.332669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:50.332707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.332717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.332906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.332981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.333061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.333140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.333198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.333212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.333289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.333362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.333436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.333513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.333563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.333570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.333647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.333722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.333794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.333862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.333914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.333921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.333983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.334041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.334094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.334150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.334191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.334196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.334255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.334321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.334390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.334449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.334491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.334496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.334555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.334609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.334668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.334725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.334766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.334771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.334832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.334886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.334952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.335020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.335068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.335075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.335134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.335187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.335242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.335299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.335345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.335350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.335407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.335460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.335520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.335576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.335615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.335620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.335678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.335746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.335802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.335857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.335897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.335902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.335957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:50.336009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.336024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.336029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:50.336052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:50.336065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:50.336070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:50.336072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:50.336074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:50.336421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:50.336443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:50.336451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:50.336454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:50.336456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:50.336457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:50.337169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:50.337187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:50.337193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:50.337199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:50.337200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:50.337203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:50.337706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:50.337724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:50.337731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:50.337733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:50.337735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:50.339556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:50.339572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:50.339582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392650339
2025-10-02T08:10:50.339750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:50.339763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:50.339767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:50.339773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:50.339775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:50.339778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:50.340209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:50.340224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:50.340227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:50.340229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:50.340231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:50.340234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:50.340653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:50.340673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:50.340683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:50.340686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:50.340690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:50.340693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:50.341156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:50.341177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:50.341182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:50.342173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:50.342189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:50.342193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:50.342195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:50.342201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392650342
2025-10-02T08:10:50.342453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:50.342467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:50.342471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:50.342473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:50.342476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:50.342477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:50.342861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:50.342877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:50.342880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:50.342882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:50.342885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:50.342887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:50.343284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:50.343301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.343376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392650343
2025-10-02T08:10:50.348045Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:50.348068Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:50.348072Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:50.348078Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:50.348088Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:50.348090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:50.348091Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:50.348099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533893971457432:11672]
2025-10-02T08:10:50.348101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533893971457432:11672]
2025-10-02T08:10:50.348160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:50.348160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:50.348166Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:50.348167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.348168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:50.348283Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:50.390360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533893971457502:10816]
2025-10-02T08:10:50.390521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 993, pipe: [1:7556533893971457502:10816]
2025-10-02T08:10:50.482885Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:50.483284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457502:10816], now have 1 active actors on pipe
2025-10-02T08:10:50.483542Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:50.483600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:50.483640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 994 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0
2025-10-02T08:10:50.483829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 994 sessionId: src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0 is DEAD
2025-10-02T08:10:50.483895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533893971457502:10816]
2025-10-02T08:10:50.484063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:50.484081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0] Write session will restart in 0.007796s
2025-10-02T08:10:50.484065Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:50.484125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0] Write session: Do CDS request
2025-10-02T08:10:50.484132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:50.488420Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [fe4af3054886f4a3] Result# TEvPutResult {Id# [72075186224037892:993:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:50.488448Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:993:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:50.488515Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:993:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:50.492467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:50.493552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.493666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:50.493883Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:50.493892Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:50.493900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:50.493953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:50.493990Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533893971457583:11678]
2025-10-02T08:10:50.494025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:50.494034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 995
2025-10-02T08:10:50.494163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.494198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:50.494207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:50.494212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:50.494591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:50.494594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 995 sessionId:  describe result for acl check
2025-10-02T08:10:50.494624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:50.494631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:50.494633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:50.494638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533893971457588:11680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:50.494817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:50.494872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:50.495135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533893971457588:11680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:50.495229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:50.495285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.495292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.495293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.495295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.495296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.495301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.495311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.495315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.495318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.495327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.495332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.495340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.495346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.495351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.495361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.495366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.495370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.495376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.495381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.495386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.495409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:50.497326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533893971457588:11680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:50.503514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533893971457588:11680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:50.503531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533893971457588:11680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:50.503535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533893971457588:11680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:50.503544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:50.504152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:50.505757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:50.505773Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:50.505776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:50.505781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:50.505788Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 994 [1:7556533893971457583:11678]
2025-10-02T08:10:50.505802Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:50.505820Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:50.505824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.505827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.505830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.505847Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:50.505857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:50.505866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:50.505930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.505937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.505940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:50.505947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:50.506013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:50.506019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.506035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.506052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:50.506053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 994
2025-10-02T08:10:50.506075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457631:11680], now have 1 active actors on pipe
2025-10-02T08:10:50.506083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533894431504619:2378], now have 1 active actors on pipe
2025-10-02T08:10:50.506089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.506094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.506110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533893971457577:11678]
2025-10-02T08:10:50.506112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533893971457577:11678]
2025-10-02T08:10:50.506127Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:50.506143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:50.506142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:50.506146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:50.506161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:50.506168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:50.506184Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:50.506194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.506197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.506184Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 994
2025-10-02T08:10:50.506198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:50.506207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.506215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:50.506251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533893971457577:11678]
2025-10-02T08:10:50.506267Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:50.506279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.506281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:50.506324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.506333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.506351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.506393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 995 partition: 0 MaxSeqNo: 17 sessionId: src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0
2025-10-02T08:10:50.506816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dddf6c6-f1c9d8b-845c595d-53d492b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:50.510108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0] Write session: try to update token
2025-10-02T08:10:50.510131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:50.518006Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:50.518024Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:50.518035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533893971457577:11678]
2025-10-02T08:10:50.518078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:50.518082Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:50.518266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:50.518432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:50.518582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:50.518736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:50.518946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:50.518988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:50.525942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId: src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:50.528469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:50.528558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.528580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.528613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:50.528637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:50.528765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.528781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.528984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.529069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.529142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.529215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.529273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.529283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.529360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.529435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.529507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.529578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.529629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.529642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.529719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.529789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.529858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.529934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.529991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.529999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.530071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.530136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.530207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.530275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.530324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.530331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.530423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.530491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.530565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.530632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.530680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.530688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.530759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.530828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.530895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.530961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.531012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.531019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.531088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.531154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.531225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.531290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.531339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.531347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.531417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.531486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.531553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.531615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.531668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.531678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.531760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.531824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.531890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.531957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.532005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.532013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.532080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:50.532146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:50.532213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:50.532281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:50.532332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:50.532340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:50.532381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:50.532444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.532466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.532473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:50.532504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:50.532521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:50.532529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:50.532532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:50.532535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:50.533000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:50.533034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:50.533040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:50.533044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:50.533048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:50.533053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:50.533708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:50.533741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:50.533754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:50.533757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:50.533760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:50.533763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:50.534361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:50.534394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:50.534406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:50.534409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:50.534413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:50.535856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:50.535884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:50.535896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392650535
2025-10-02T08:10:50.536063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:50.536086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:50.536097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:50.536102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:50.536112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:50.536116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:50.536657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:50.536687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:50.536695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:50.536705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:50.536708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:50.536713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:50.537275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:50.537307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:50.537317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:50.537321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:50.537325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:50.537328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:50.537864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:50.537893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:50.537900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:50.539117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:50.539144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:50.539152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:50.539155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:50.539164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392650538
2025-10-02T08:10:50.539490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:50.539517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:50.539525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:50.539533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:50.539537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:50.539540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:50.540049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:50.540079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:50.540085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:50.540089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:50.540092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:50.540096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:50.540566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:50.540591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.540695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392650540
2025-10-02T08:10:50.541535Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:50.541559Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:50.541567Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:50.541574Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:50.545126Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:50.545143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:50.545145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:50.545153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533893971457577:11678]
2025-10-02T08:10:50.545158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533893971457577:11678]
2025-10-02T08:10:50.545202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:50.545206Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:50.545209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.545213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:50.545213Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:50.545355Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:50.583892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533893971457653:10816]
2025-10-02T08:10:50.584087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 994, pipe: [1:7556533893971457653:10816]
2025-10-02T08:10:50.704406Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:50.704825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457653:10816], now have 1 active actors on pipe
2025-10-02T08:10:50.704979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533893971457653:10816]
2025-10-02T08:10:50.705010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:50.705017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:50.705038Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:50.705045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 995 reason: error at write: Disconnected sessionId: src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0
2025-10-02T08:10:50.705242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 995 sessionId: src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0 is DEAD
2025-10-02T08:10:50.705646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:50.705656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0] Write session will restart in 0.005185s
2025-10-02T08:10:50.705679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0] Write session: Do CDS request
2025-10-02T08:10:50.705686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:50.705060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:50.711014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:50.712331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:50.712397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.712527Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:50.712533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:50.712540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 996
2025-10-02T08:10:50.712541Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:50.712552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:50.712599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:50.712643Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533893971457736:11685]
2025-10-02T08:10:50.712693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.712723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:50.712733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:50.712737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:50.713127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 996 sessionId:  describe result for acl check
2025-10-02T08:10:50.713159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:50.713165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:50.713167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:50.713173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533893971457741:11687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:50.713352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:50.713583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:50.713628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:50.713648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533893971457741:11687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:50.713964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:50.714007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.714012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.714014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.714015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.714016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.714021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.714032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.714037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.714041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.714045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.714050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.714058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.714069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.714075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.714080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.714086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.714091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.714102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.714107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.714113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.714135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:50.715915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533893971457741:11687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:50.722600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533893971457741:11687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:50.722615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533893971457741:11687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:50.722619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533893971457741:11687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:50.722628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:50.722953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:50.724557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:50.724570Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:50.724572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:50.724575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:50.724581Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 995 [1:7556533893971457736:11685]
2025-10-02T08:10:50.724590Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:50.724608Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:50.724611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.724613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.724615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.724631Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:50.724636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:50.724643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:50.724698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.724704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.724706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:50.724708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:50.724755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:50.724761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.724772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.724778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:50.724790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533893971457730:11685]
2025-10-02T08:10:50.724795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533893971457730:11685]
2025-10-02T08:10:50.724816Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:50.724831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:50.724849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:50.724853Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:50.724856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:50.724856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:50.724865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457783:11687], now have 1 active actors on pipe
2025-10-02T08:10:50.724899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533893971457730:11685]
2025-10-02T08:10:50.724908Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:50.724915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533894431504628:2378], now have 1 active actors on pipe
2025-10-02T08:10:50.724969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 995
2025-10-02T08:10:50.725007Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:50.725095Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 995
2025-10-02T08:10:50.725121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.725132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.725158Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6046880-600d767f-97ff16cb-d7908a69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:50.725165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.725168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.725170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:50.725178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.725189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:50.725212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.725286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.725289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.725303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.725337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 996 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6046880-600d767f-97ff16cb-d7908a69_0
2025-10-02T08:10:50.725752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|750ad7a5-da04031a-6da70a7f-4ebb5915_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6046880-600d767f-97ff16cb-d7908a69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:50.728994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6046880-600d767f-97ff16cb-d7908a69_0] Write session: try to update token
2025-10-02T08:10:50.729016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6046880-600d767f-97ff16cb-d7908a69_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:50.744957Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:50.744980Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:50.744983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:50.744999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533893971457730:11685]
2025-10-02T08:10:50.745005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533893971457730:11685]
2025-10-02T08:10:50.745064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:50.745063Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:50.745071Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:50.745073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.745076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:50.745255Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:50.746094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId: src_id|c6046880-600d767f-97ff16cb-d7908a69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:50.749358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:50.805101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533893971457798:10816]
2025-10-02T08:10:50.805274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 995, pipe: [1:7556533893971457798:10816]
2025-10-02T08:10:50.899890Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:50.900220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.900228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.900264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457798:10816], now have 1 active actors on pipe
2025-10-02T08:10:50.900494Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:50.900395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533893971457798:10816]
2025-10-02T08:10:50.900414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:50.900416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:50.900455Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:50.900465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 996 reason: error at write: Disconnected sessionId: src_id|c6046880-600d767f-97ff16cb-d7908a69_0
2025-10-02T08:10:50.900659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 996 sessionId: src_id|c6046880-600d767f-97ff16cb-d7908a69_0 is DEAD
2025-10-02T08:10:50.901074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6046880-600d767f-97ff16cb-d7908a69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:50.901089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6046880-600d767f-97ff16cb-d7908a69_0] Write session will restart in 0.006970s
2025-10-02T08:10:50.901122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6046880-600d767f-97ff16cb-d7908a69_0] Write session: Do CDS request
2025-10-02T08:10:50.901130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6046880-600d767f-97ff16cb-d7908a69_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:50.908263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:50.909988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:50.910215Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:50.910222Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:50.910233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:50.910294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:50.910329Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533893971457927:11704]
2025-10-02T08:10:50.910986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:50.911281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:50.911334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:50.911641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:50.911720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.911721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.911722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.911723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.911725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.911731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.911741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.911745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.911749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.911753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.911759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.911767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:50.911772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.911777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:50.911784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.911788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:50.911792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.911797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.911804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.911809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.911828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:50.913315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6046880-600d767f-97ff16cb-d7908a69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.913670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:50.913683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 997
2025-10-02T08:10:50.913850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:50.913878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:50.913882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:50.913886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:50.914342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 997 sessionId:  describe result for acl check
2025-10-02T08:10:50.914376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:50.914377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:50.914379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:50.914384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533893971457944:11706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:50.914950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533893971457944:11706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:50.919325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533893971457944:11706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:50.924077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533893971457944:11706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:50.924091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533893971457944:11706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:50.924095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533893971457944:11706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:50.924104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:50.924719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:50.926729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:50.926745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:50.926748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:50.926751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:50.926758Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 996 [1:7556533893971457927:11704]
2025-10-02T08:10:50.926772Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:50.926790Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:50.926796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.926800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.926803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.926821Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:50.926831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:50.926841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:50.926902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.926908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.926912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:50.926915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:50.927124Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 996
2025-10-02T08:10:50.926980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:50.926986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.926999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:50.927010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:50.927030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533893971457973:11706], now have 1 active actors on pipe
2025-10-02T08:10:50.927033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533894431504665:2378], now have 1 active actors on pipe
2025-10-02T08:10:50.927039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533893971457921:11704]
2025-10-02T08:10:50.927041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533893971457921:11704]
2025-10-02T08:10:50.927043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 996
2025-10-02T08:10:50.927052Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:50.927063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.927068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.927087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:50.927100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:50.927102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:50.927145Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65013609-6c51e07f-f4154be8-4e1160fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:50.927150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:50.927153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:50.927153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:50.927156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:50.927158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:50.927167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:50.927175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:50.927182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533893971457921:11704]
2025-10-02T08:10:50.927187Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:50.927193Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:50.927216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.927294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:50.927300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:50.927325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:50.927370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 997 partition: 0 MaxSeqNo: 17 sessionId: src_id|65013609-6c51e07f-f4154be8-4e1160fd_0
2025-10-02T08:10:50.928286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6046880-600d767f-97ff16cb-d7908a69_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|65013609-6c51e07f-f4154be8-4e1160fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:50.931651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65013609-6c51e07f-f4154be8-4e1160fd_0] Write session: try to update token
2025-10-02T08:10:50.931676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65013609-6c51e07f-f4154be8-4e1160fd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:50.947149Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:50.947167Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:50.947170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:50.947180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533893971457921:11704]
2025-10-02T08:10:50.947185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533893971457921:11704]
2025-10-02T08:10:50.947227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:50.947233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:50.947236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:50.947405Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:50.949244Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:50.949254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:50.965220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId: src_id|65013609-6c51e07f-f4154be8-4e1160fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:50.968546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:51.000764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533898266425283:10816]
2025-10-02T08:10:51.001048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 996, pipe: [1:7556533898266425283:10816]
2025-10-02T08:10:51.115384Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:51.115726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.115738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.115779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425283:10816], now have 1 active actors on pipe
2025-10-02T08:10:51.115894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:51.115915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:51.115994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 997 reason: error at write: Disconnected sessionId: src_id|65013609-6c51e07f-f4154be8-4e1160fd_0
2025-10-02T08:10:51.116027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:51.116183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 997 sessionId: src_id|65013609-6c51e07f-f4154be8-4e1160fd_0 is DEAD
2025-10-02T08:10:51.116444Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:51.116478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533898266425283:10816]
2025-10-02T08:10:51.116943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65013609-6c51e07f-f4154be8-4e1160fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:51.116959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65013609-6c51e07f-f4154be8-4e1160fd_0] Write session will restart in 0.008558s
2025-10-02T08:10:51.116990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65013609-6c51e07f-f4154be8-4e1160fd_0] Write session: Do CDS request
2025-10-02T08:10:51.116997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65013609-6c51e07f-f4154be8-4e1160fd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:51.123006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:51.124412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:51.124651Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:51.124662Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:51.124671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:51.124719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:51.124766Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533898266425366:11711]
2025-10-02T08:10:51.125488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:51.125721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:51.125770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:51.126110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:51.126157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.126163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.126165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.126166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.126167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.126172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.126183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.126187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.126191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.126195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.126201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.126208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.126214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.126220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.126225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.126229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.126236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.126241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.126250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.126255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.126272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:51.129371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65013609-6c51e07f-f4154be8-4e1160fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.133073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:51.133091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 998
2025-10-02T08:10:51.134297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.134346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:51.134360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:51.134365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:51.134862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 998 sessionId:  describe result for acl check
2025-10-02T08:10:51.134908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:51.134910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:51.134912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:51.134920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533898266425383:11713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:51.135423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:51.135438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533898266425383:11713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:51.137187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:51.137205Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:51.137207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:51.137212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:51.137218Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 997 [1:7556533898266425366:11711]
2025-10-02T08:10:51.137230Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:51.137247Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:51.137251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.137254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.137256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.137272Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:51.137278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:51.137285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:51.137397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.137405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.137408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:51.137410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:51.137472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:51.137479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.137496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.137513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:51.137534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533898266425360:11711]
2025-10-02T08:10:51.137541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533898266425360:11711]
2025-10-02T08:10:51.137547Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:51.137561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:51.137580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:51.137587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:51.137622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533898266425360:11711]
2025-10-02T08:10:51.137624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:51.137645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533898266425383:11713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:51.137650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533898726471974:2378], now have 1 active actors on pipe
2025-10-02T08:10:51.137656Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:51.137658Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:51.137664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:51.137839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 997
2025-10-02T08:10:51.149219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533898266425383:11713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:51.149248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533898266425383:11713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:51.149251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533898266425383:11713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:51.149260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:51.149481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 997
2025-10-02T08:10:51.149492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425423:11713], now have 1 active actors on pipe
2025-10-02T08:10:51.149499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.149504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.149537Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:51.149551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.149559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.149562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:51.149582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.149603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:51.149626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.149708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.149718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.149742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.149780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 998 partition: 0 MaxSeqNo: 17 sessionId: src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0
2025-10-02T08:10:51.150140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65013609-6c51e07f-f4154be8-4e1160fd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:51.153092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0] Write session: try to update token
2025-10-02T08:10:51.153110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:51.155123Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:51.155141Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:51.155149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533898266425360:11711]
2025-10-02T08:10:51.155190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:51.155190Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:51.155364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:51.155521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:51.155665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:51.155823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:51.156036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:51.156078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:51.167612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId: src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:51.170235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:51.170316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.170328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.170363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:51.170391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:51.170448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.170460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.170626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.170701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.170778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.170841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.170889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.170894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.170968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.171024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.171088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.171158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.171212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.171215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.171289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.171349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.171427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.171494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.171550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.171553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.171626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.171681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.171754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.171818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.171876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.171878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.171947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.172002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.172066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.172132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.172175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.172178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.172250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.172312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.172374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.172433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.172478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.172481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.172547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.172604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.172673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.172738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.172782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.172784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.172869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.172924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.172991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.173054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.173105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.173113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.173184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.173251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.173325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.173390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.173439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.173455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.173528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:51.173590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:51.173654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:51.173731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:51.173782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:51.173785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:51.173828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:51.173917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.173936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.173939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:51.173973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:51.173993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:51.173999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:51.174003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:51.174006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:51.174450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:51.174471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:51.174478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:51.174481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:51.174487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:51.174491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:51.175510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:51.175539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:51.175547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:51.175551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:51.175553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:51.175555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:51.176087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:51.176110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:51.176116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:51.176119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:51.176123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:51.177539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:51.177555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:51.177570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392651177
2025-10-02T08:10:51.177768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:51.177783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:51.177794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:51.177798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:51.177803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:51.177806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:51.178367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:51.178391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:51.178403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:51.178408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:51.178417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:51.178420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:51.178959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:51.178984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:51.178990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:51.178994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:51.179000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:51.179003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:51.179529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:51.179542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:51.179549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:51.180942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:51.180966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:51.180971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:51.180975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:51.180984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392651180
2025-10-02T08:10:51.181319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:51.181345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:51.181351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:51.181359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:51.181363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:51.181368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:51.181862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:51.181888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:51.181894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:51.181899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:51.181902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:51.181907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:51.182375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:51.182389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.182475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392651182
2025-10-02T08:10:51.183227Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:51.183235Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:51.183239Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:51.183243Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:51.185104Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:51.185114Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:51.185116Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:51.185126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533898266425360:11711]
2025-10-02T08:10:51.185130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533898266425360:11711]
2025-10-02T08:10:51.185185Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:51.185191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:51.185195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:51.185200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.185202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:51.185351Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:51.216733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533898266425437:10816]
2025-10-02T08:10:51.216876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 997, pipe: [1:7556533898266425437:10816]
2025-10-02T08:10:51.323452Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:51.323897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425437:10816], now have 1 active actors on pipe
2025-10-02T08:10:51.324035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:51.324046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:51.324077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 998 reason: error at write: Disconnected sessionId: src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0
2025-10-02T08:10:51.324199Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:51.324302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 998 sessionId: src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0 is DEAD
2025-10-02T08:10:51.324463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:51.324480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0] Write session will restart in 0.005846s
2025-10-02T08:10:51.324507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0] Write session: Do CDS request
2025-10-02T08:10:51.324514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:51.324483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533898266425437:10816]
2025-10-02T08:10:51.324612Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:51.331327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.331414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:51.331433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 999
2025-10-02T08:10:51.331597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.331633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:51.331650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:51.331654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:51.332168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 999 sessionId:  describe result for acl check
2025-10-02T08:10:51.332214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:51.332219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:51.332221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:51.332227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533898266425517:11719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:51.332264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:51.332640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:51.332729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533898266425517:11719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:51.332915Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:51.332932Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:51.332948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:51.333011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:51.333065Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533898266425525:11717]
2025-10-02T08:10:51.333766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:51.333994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:51.334041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:51.334431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:51.334500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.334506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.334508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.334509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.334510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.334517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.334528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.334533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.334537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.334541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.334548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.334556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.334563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.334569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.334580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.334589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.334594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.334599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.334604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.334610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.334631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:51.334842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533898266425517:11719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:51.341403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533898266425517:11719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:51.341424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533898266425517:11719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:51.341428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533898266425517:11719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:51.341436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:51.342994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:51.344981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:51.344999Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:51.345001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:51.345005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:51.345014Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 998 [1:7556533898266425525:11717]
2025-10-02T08:10:51.345026Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:51.345042Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:51.345046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.345051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.345053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.345068Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:51.345075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:51.345081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:51.345147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.345168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.345171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:51.345174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:51.345237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:51.345246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.345261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.345272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:51.345300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425568:11719], now have 1 active actors on pipe
2025-10-02T08:10:51.345306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533898266425516:11717]
2025-10-02T08:10:51.345305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 998
2025-10-02T08:10:51.345308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533898266425516:11717]
2025-10-02T08:10:51.345324Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:51.345332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533898726471981:2378], now have 1 active actors on pipe
2025-10-02T08:10:51.345335Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:51.345336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.345338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:51.345341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.345359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:51.345373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:51.345375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:51.345372Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 998
2025-10-02T08:10:51.345417Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:51.345430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.345434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.345436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:51.345444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.345452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:51.345461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533898266425516:11717]
2025-10-02T08:10:51.345470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:51.345489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:51.345504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.345548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.345557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.345571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.345613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 999 partition: 0 MaxSeqNo: 17 sessionId: src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0
2025-10-02T08:10:51.345951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed9d1268-84761b88-7b02231d-4adf1fee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:51.348523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0] Write session: try to update token
2025-10-02T08:10:51.348541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:51.362876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId: src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:51.363555Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:51.363580Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:51.363584Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:51.363594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533898266425516:11717]
2025-10-02T08:10:51.363600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533898266425516:11717]
2025-10-02T08:10:51.363660Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:51.363663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:51.363671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.363674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:51.363674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:51.363847Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:51.365693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:51.424583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533898266425583:10816]
2025-10-02T08:10:51.424678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 998, pipe: [1:7556533898266425583:10816]
2025-10-02T08:10:51.501682Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:51.501952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.501967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.502006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425583:10816], now have 1 active actors on pipe
2025-10-02T08:10:51.502115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:51.502127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:51.502189Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:51.502189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 999 reason: error at write: Disconnected sessionId: src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0
2025-10-02T08:10:51.502226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:51.502378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 999 sessionId: src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0 is DEAD
2025-10-02T08:10:51.502462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533898266425583:10816]
2025-10-02T08:10:51.502523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:51.502534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0] Write session will restart in 0.007749s
2025-10-02T08:10:51.502575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0] Write session: Do CDS request
2025-10-02T08:10:51.502582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:51.506175Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:10:51.507581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:51.508705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:51.508861Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:51.508871Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:51.508879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:51.508920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:51.508960Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533898266425672:11723]
2025-10-02T08:10:51.509533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:51.509785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:51.509841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:51.510177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:51.510240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.510248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.510252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.510253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.510254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.510261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.510282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.510293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.510297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.510302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.510307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.510315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.510321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.510327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.510338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.510343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.510348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.510354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.510360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.510372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.510395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:51.511350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.511459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:51.511473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1000
2025-10-02T08:10:51.511653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.511685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:51.511696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:51.511700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:51.512145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1000 sessionId:  describe result for acl check
2025-10-02T08:10:51.512185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:51.512192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:51.512194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:51.512200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533898266425688:11725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:51.512738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533898266425688:11725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:51.514922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533898266425688:11725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:51.518270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533898266425688:11725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:51.518284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533898266425688:11725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:51.518287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533898266425688:11725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:51.518296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:51.518773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:51.520232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:51.520247Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:51.520249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:51.520252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:51.520256Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 999 [1:7556533898266425672:11723]
2025-10-02T08:10:51.520266Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:51.520281Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:51.520284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.520287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.520290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.520306Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:51.520309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:51.520313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:51.520352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.520359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.520362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:51.520364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:51.520409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:51.520416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.520424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.520437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:51.520444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 999
2025-10-02T08:10:51.520453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425722:11725], now have 1 active actors on pipe
2025-10-02T08:10:51.520460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533898266425666:11723]
2025-10-02T08:10:51.520462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533898266425666:11723]
2025-10-02T08:10:51.520468Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:51.520478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533898726471988:2378], now have 1 active actors on pipe
2025-10-02T08:10:51.520483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.520491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.520504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:51.520518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:51.520525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:51.520543Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:51.520552Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:51.520563Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47997a59-5a21503c-37b1af2f-bd23346a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:51.520576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.520578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.520580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:51.520585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.520597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:51.520604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533898266425666:11723]
2025-10-02T08:10:51.520614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:51.520630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.520632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:51.520607Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 999
2025-10-02T08:10:51.520693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.520700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.520710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.520733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1000 partition: 0 MaxSeqNo: 17 sessionId: src_id|47997a59-5a21503c-37b1af2f-bd23346a_0
2025-10-02T08:10:51.521099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4193c-f51bb071-b3295e13-88ff21c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47997a59-5a21503c-37b1af2f-bd23346a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:51.524107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47997a59-5a21503c-37b1af2f-bd23346a_0] Write session: try to update token
2025-10-02T08:10:51.524123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47997a59-5a21503c-37b1af2f-bd23346a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:51.538444Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:51.538467Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:51.538469Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:51.538478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533898266425666:11723]
2025-10-02T08:10:51.538482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533898266425666:11723]
2025-10-02T08:10:51.538520Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:51.538524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:51.538526Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:51.538531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.538533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:51.538664Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:51.546296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId: src_id|47997a59-5a21503c-37b1af2f-bd23346a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:51.549220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:51.602780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533898266425741:10816]
2025-10-02T08:10:51.602906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 999, pipe: [1:7556533898266425741:10816]
2025-10-02T08:10:51.678519Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:51.678940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.678959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.678988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425741:10816], now have 1 active actors on pipe
2025-10-02T08:10:51.679103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533898266425741:10816]
2025-10-02T08:10:51.679113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:51.679117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:51.679189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1000 reason: error at write: Disconnected sessionId: src_id|47997a59-5a21503c-37b1af2f-bd23346a_0
2025-10-02T08:10:51.679258Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:51.679310Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:51.679435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1000 sessionId: src_id|47997a59-5a21503c-37b1af2f-bd23346a_0 is DEAD
2025-10-02T08:10:51.679548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47997a59-5a21503c-37b1af2f-bd23346a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:51.679562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47997a59-5a21503c-37b1af2f-bd23346a_0] Write session will restart in 0.009936s
2025-10-02T08:10:51.679589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47997a59-5a21503c-37b1af2f-bd23346a_0] Write session: Do CDS request
2025-10-02T08:10:51.679596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47997a59-5a21503c-37b1af2f-bd23346a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:51.685627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:51.687052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:51.687238Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:51.687247Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:51.687256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:51.687305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:51.687352Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533898266425830:11730]
2025-10-02T08:10:51.688037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:51.688242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:51.688282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:51.688594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:51.688637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.688645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.688646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.688647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.688649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.688654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.688665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.688670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.688674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.688679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.688684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.688692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.688698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.688704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.688709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.688714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.688719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.688724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.688729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.688738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.688757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:51.690356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47997a59-5a21503c-37b1af2f-bd23346a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.690444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:51.690458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1001
2025-10-02T08:10:51.690659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.690695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:51.690708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:51.690712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:51.691145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1001 sessionId:  describe result for acl check
2025-10-02T08:10:51.691187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:51.691196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:51.691198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:51.691205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533898266425846:11732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:51.691752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533898266425846:11732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:51.694423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533898266425846:11732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:51.697520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533898266425846:11732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:51.697538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533898266425846:11732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:51.697541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533898266425846:11732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:51.697543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:51.697549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:51.699192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:51.699215Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:51.699218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:51.699222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:51.699229Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1000 [1:7556533898266425830:11730]
2025-10-02T08:10:51.699246Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:51.699263Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:51.699275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.699278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.699281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.699297Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:51.699302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:51.699316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:51.699374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.699387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.699390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:51.699392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:51.699459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:51.699469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.699483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.699494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:51.699516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533898266425824:11730]
2025-10-02T08:10:51.699525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533898266425824:11730]
2025-10-02T08:10:51.699532Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:51.699547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:51.699555Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:51.699556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1000
2025-10-02T08:10:51.699559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:51.699567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:51.699572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:51.699584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425877:11732], now have 1 active actors on pipe
2025-10-02T08:10:51.699624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533898726472001:2378], now have 1 active actors on pipe
2025-10-02T08:10:51.699634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533898266425824:11730]
2025-10-02T08:10:51.699644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:51.699657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.699660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.699662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:51.699699Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:51.699688Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1000
2025-10-02T08:10:51.699726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.699733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.699735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:51.699746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.699756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:51.699794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.699859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.699868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.699880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.699913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1001 partition: 0 MaxSeqNo: 17 sessionId: src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0
2025-10-02T08:10:51.700329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47997a59-5a21503c-37b1af2f-bd23346a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:51.703723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0] Write session: try to update token
2025-10-02T08:10:51.703745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:51.717441Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:51.717463Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:51.717466Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:51.717475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533898266425824:11730]
2025-10-02T08:10:51.717480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533898266425824:11730]
2025-10-02T08:10:51.717526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:51.717528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:51.717533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.717535Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:51.717537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:51.717704Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:51.724362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId: src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:51.726881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:51.779423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533898266425892:10816]
2025-10-02T08:10:51.779544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1000, pipe: [1:7556533898266425892:10816]
2025-10-02T08:10:51.862235Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:51.862559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.862577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.862597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266425892:10816], now have 1 active actors on pipe
2025-10-02T08:10:51.862722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:51.862731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:51.862781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1001 reason: error at write: Disconnected sessionId: src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0
2025-10-02T08:10:51.862846Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:51.862895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:51.862940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1001 sessionId: src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0 is DEAD
2025-10-02T08:10:51.863095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533898266425892:10816]
2025-10-02T08:10:51.864920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:51.864937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0] Write session will restart in 0.006997s
2025-10-02T08:10:51.864980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0] Write session: Do CDS request
2025-10-02T08:10:51.864987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:51.869954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:51.871429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:51.871639Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:51.871649Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:51.871656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:51.871698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:51.871743Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533898266425981:11736]
2025-10-02T08:10:51.872608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:51.872867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:51.872929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:51.873272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:51.873343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.873351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.873353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.873354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.873356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.873362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.873376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.873380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.873385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.873389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.873396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.873404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:51.873411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.873416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:51.873421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.873426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:51.873431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.873436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.873441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.873447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.873468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:51.873972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.874518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:51.874532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1002
2025-10-02T08:10:51.874702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:51.874740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:51.874746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:51.874759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:51.875224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1002 sessionId:  describe result for acl check
2025-10-02T08:10:51.875254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:51.875256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:51.875258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:51.875263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533898266425998:11738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:51.875787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533898266425998:11738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:51.878605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533898266425998:11738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:51.881934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533898266425998:11738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:51.881948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533898266425998:11738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:51.881951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533898266425998:11738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:51.881959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:51.886368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:51.888158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:51.888176Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:51.888179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:51.888182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:51.888188Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1001 [1:7556533898266425981:11736]
2025-10-02T08:10:51.888203Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:51.888222Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:51.888230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.888233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.888236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.888253Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:51.888263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:51.888269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:51.888335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.888343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.888346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:51.888349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:51.888418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:51.888426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.888440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:51.888452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:51.888471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533898266425975:11736]
2025-10-02T08:10:51.888476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533898266425975:11736]
2025-10-02T08:10:51.888484Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:51.888496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:51.888506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:51.888509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:51.888510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1001
2025-10-02T08:10:51.888513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:51.888515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:51.888524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266426029:11738], now have 1 active actors on pipe
2025-10-02T08:10:51.888558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533898266425975:11736]
2025-10-02T08:10:51.888568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:51.888573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533898726472020:2378], now have 1 active actors on pipe
2025-10-02T08:10:51.888581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.888583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:51.888585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.888624Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:51.888635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:51.888643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:51.888645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:51.888655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:51.888667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:51.888691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.888742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:51.888748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:51.888759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:51.888794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1002 partition: 0 MaxSeqNo: 17 sessionId: src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0
2025-10-02T08:10:51.888672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1001
2025-10-02T08:10:51.889379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e7e80d-d9bdb372-403fac1f-8ef59827_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:51.892615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0] Write session: try to update token
2025-10-02T08:10:51.892635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:51.908182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:51.908203Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:51.908206Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:51.908214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533898266425975:11736]
2025-10-02T08:10:51.908217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533898266425975:11736]
2025-10-02T08:10:51.908258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:51.908260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:51.908264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:51.908266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:51.908266Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:51.908418Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:51.941967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId: src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:51.944618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:51.963444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533898266426092:10816]
2025-10-02T08:10:51.963559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1001, pipe: [1:7556533898266426092:10816]
2025-10-02T08:10:52.053386Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:52.053789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.053800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.053819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533898266426092:10816], now have 1 active actors on pipe
2025-10-02T08:10:52.053922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533898266426092:10816]
2025-10-02T08:10:52.053950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:52.053956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:52.054000Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:52.054014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1002 reason: error at write: Disconnected sessionId: src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0
2025-10-02T08:10:52.054020Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:52.054196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1002 sessionId: src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0 is DEAD
2025-10-02T08:10:52.054224Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:10:52.054357Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 10 consumer shared/user session shared/user_1_10_9309877639626385662_v1 is DEAD
2025-10-02T08:10:52.054387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:52.054400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0] Write session will restart in 0.008818s
2025-10-02T08:10:52.054428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0] Write session: Do CDS request
2025-10-02T08:10:52.054435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:52.054511Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:10:52.054531Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533803777084186:10810] disconnected; active server actors: 1
2025-10-02T08:10:52.054544Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533803777084186:10810] client user disconnected session shared/user_1_10_9309877639626385662_v1
2025-10-02T08:10:52.054635Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:10:52.054641Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:10:52.054648Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.007145s
2025-10-02T08:10:52.059147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:52.060295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:52.060474Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:52.060482Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:52.060490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:52.060537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:52.060573Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533902561393478:11755]
2025-10-02T08:10:52.061115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:52.061323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:52.061360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:52.061620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:52.061661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.061666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.061666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.061667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.061668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.061673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.061681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.061684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.061688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.061691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.061696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.061702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.061707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.061712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.061715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.061719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.061722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.061726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.061734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.061740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.061755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:52.063205Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:10:52.063381Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:10:52.063389Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 11
2025-10-02T08:10:52.063557Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 11 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:10:52.063598Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:10:52.063682Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 auth for : user
2025-10-02T08:10:52.063850Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 Handle describe topics response
2025-10-02T08:10:52.063882Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 auth is DEAD
2025-10-02T08:10:52.063889Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:10:52.064106Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:10:52.064195Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_11_15278267780770473840_v1
2025-10-02T08:10:52.064208Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:10:52.064280Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:10:52.064265Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533902561393495:11757] connected; active server actors: 1
2025-10-02T08:10:52.064345Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533902561393495:11757] session shared/user_1_11_15278267780770473840_v1
2025-10-02T08:10:52.064354Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:10:52.064353Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:10:52.064364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:10:52.064376Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_11_15278267780770473840_v1" (Sender=[1:7556533902561393492:11757], Pipe=[1:7556533902561393495:11757], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:10:52.064380Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:10:52.064395Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 got read request: guid# 11edb95a-661b3fce-e2f41378-65fb3c2d
2025-10-02T08:10:52.064391Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:10:52.064398Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_11_15278267780770473840_v1" (Sender=[1:7556533902561393492:11757], Pipe=[1:7556533902561393495:11757], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:10:52.064410Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_11_15278267780770473840_v1" sender [1:7556533902561393492:11757] lock partition 0 for ReadingSession "shared/user_1_11_15278267780770473840_v1" (Sender=[1:7556533902561393492:11757], Pipe=[1:7556533902561393495:11757], Partitions=[], ActiveFamilyCount=1) generation 1 step 11
2025-10-02T08:10:52.064424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:10:52.064429Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-02T08:10:52.064624Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 11 Session: "shared/user_1_11_15278267780770473840_v1" ClientId: "user" PipeClient { RawX1: 7556533902561393495 RawX2: 4503603922349549 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:10:52.064643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:10:52.065279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.065286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:52.065295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1003
2025-10-02T08:10:52.065482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.065511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:52.065514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:52.065518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:52.065843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1003 sessionId:  describe result for acl check
2025-10-02T08:10:52.065874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:52.065880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:52.065882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:52.065887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533902561393503:11761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:52.066382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533902561393503:11761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:52.068484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533902561393503:11761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:52.069288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:52.070927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:52.070946Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:52.070948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:52.070951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:52.070957Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1002 [1:7556533902561393478:11755]
2025-10-02T08:10:52.070966Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:52.070970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533902561393503:11761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:52.070975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533902561393503:11761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:52.070978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533902561393503:11761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:52.070984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:52.070985Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:52.070987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.070990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.070993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.071008Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:52.071017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:52.071023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:52.071078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.071085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.071088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:52.071091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:52.071147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:52.071153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.071166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.071184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:52.071202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561393497:11760], now have 1 active actors on pipe
2025-10-02T08:10:52.071209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561393534:11761], now have 1 active actors on pipe
2025-10-02T08:10:52.071212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533903021439347:2378], now have 1 active actors on pipe
2025-10-02T08:10:52.071218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533902561393472:11755]
2025-10-02T08:10:52.071220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533902561393472:11755]
2025-10-02T08:10:52.071226Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:52.071232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1002, pipe: [1:7556533902561393497:11760]
2025-10-02T08:10:52.071238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:52.071244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1002
2025-10-02T08:10:52.071246Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:52.071249Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:52.071252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:52.071222Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1002
2025-10-02T08:10:52.071255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:52.071286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.071293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.071302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_11_15278267780770473840_v1 on pipe: [1:7556533902561393497:11760]
2025-10-02T08:10:52.071332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.071337Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_11_15278267780770473840_v1:1 with generation 1002
2025-10-02T08:10:52.071338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.071344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533902561393472:11755]
2025-10-02T08:10:52.071352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:52.071375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.071383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.071387Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:52.071388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:52.071402Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_11_15278267780770473840_v1
2025-10-02T08:10:52.071408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.071433Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2188db4-644bcbb4-94089410-74559fab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:52.071445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:10:52.071456Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:52.072974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:10:52.073001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:10:52.073008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.073011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.073013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:52.073020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.073029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:52.073034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:10:52.073047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:10:52.073065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.073103Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392652070 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:10:52.073116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:10:52.073127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.073135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.073141Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 sending to client partition status
2025-10-02T08:10:52.073146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.073171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1003 partition: 0 MaxSeqNo: 17 sessionId: src_id|e2188db4-644bcbb4-94089410-74559fab_0
2025-10-02T08:10:52.073564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ca92df-54dc60c1-c4556e82-2ec4496a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e2188db4-644bcbb4-94089410-74559fab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:52.076158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2188db4-644bcbb4-94089410-74559fab_0] Write session: try to update token
2025-10-02T08:10:52.076169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2188db4-644bcbb4-94089410-74559fab_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:52.088594Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:52.088612Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:52.088614Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:52.088621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533902561393472:11755]
2025-10-02T08:10:52.088625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533902561393472:11755]
2025-10-02T08:10:52.088665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:52.088671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.088673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:52.088835Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:52.090018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId: src_id|e2188db4-644bcbb4-94089410-74559fab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:52.090637Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:52.090653Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:52.092625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:52.229501Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:52.229952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.229966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.230099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:52.230109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:52.230167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1003 reason: error at write: Disconnected sessionId: src_id|e2188db4-644bcbb4-94089410-74559fab_0
2025-10-02T08:10:52.230237Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:52.230350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1003 sessionId: src_id|e2188db4-644bcbb4-94089410-74559fab_0 is DEAD
2025-10-02T08:10:52.230494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533902561393497:11760]
2025-10-02T08:10:52.230530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2188db4-644bcbb4-94089410-74559fab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:52.230547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2188db4-644bcbb4-94089410-74559fab_0] Write session will restart in 0.008392s
2025-10-02T08:10:52.230576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2188db4-644bcbb4-94089410-74559fab_0] Write session: Do CDS request
2025-10-02T08:10:52.230583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2188db4-644bcbb4-94089410-74559fab_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:52.231137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_11_15278267780770473840_v1
2025-10-02T08:10:52.231157Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:52.231177Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_11_15278267780770473840_v1
2025-10-02T08:10:52.236546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:52.237962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:52.238155Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:52.238164Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:52.238175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:52.238220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:52.238262Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533902561393645:11766]
2025-10-02T08:10:52.238851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:52.239029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:52.239070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:52.239385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:52.239433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.239434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.239435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.239436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.239437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.239441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.239451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.239454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.239457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.239460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.239465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.239471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.239479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.239485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.239489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.239494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.239497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.239501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.239505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.239509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.239526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:52.240452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2188db4-644bcbb4-94089410-74559fab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.240495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:52.240507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1004
2025-10-02T08:10:52.240708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.240737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:52.240745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:52.240748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:52.241249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1004 sessionId:  describe result for acl check
2025-10-02T08:10:52.241303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:52.241310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:52.241314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:52.241319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533902561393661:11768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:52.241844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533902561393661:11768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:52.243791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533902561393661:11768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:52.247157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533902561393661:11768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:52.247169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533902561393661:11768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:52.247171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533902561393661:11768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:52.247178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:52.247580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:52.249060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:52.249072Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:52.249074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:52.249076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:52.249080Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1003 [1:7556533902561393645:11766]
2025-10-02T08:10:52.249087Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:52.249101Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:52.249103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.249105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.249107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.249119Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:52.249122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:52.249127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:52.249191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.249199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.249202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:52.249205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:52.249260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:52.249265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.249274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.249282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:52.249301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533902561393639:11766]
2025-10-02T08:10:52.249304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533902561393639:11766]
2025-10-02T08:10:52.249311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:52.249313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1003
2025-10-02T08:10:52.249324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561393692:11768], now have 1 active actors on pipe
2025-10-02T08:10:52.249323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:52.249326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:52.249333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:52.249427Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1003
2025-10-02T08:10:52.249346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:52.249364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:52.249369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533903021439355:2378], now have 1 active actors on pipe
2025-10-02T08:10:52.249373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.249377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.249417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533902561393639:11766]
2025-10-02T08:10:52.249423Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:52.249430Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:52.249434Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:52.249439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.249441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.249442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:52.249448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.249454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:52.249483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.249573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.249581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.249597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.249638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1004 partition: 0 MaxSeqNo: 17 sessionId: src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0
2025-10-02T08:10:52.250040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2188db4-644bcbb4-94089410-74559fab_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:52.253294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0] Write session: try to update token
2025-10-02T08:10:52.253320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:52.267131Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:52.267151Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:52.267153Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:52.267162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533902561393639:11766]
2025-10-02T08:10:52.267167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533902561393639:11766]
2025-10-02T08:10:52.267207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:52.267214Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:52.267217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.267220Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:52.267221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:52.267354Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:52.269887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId: src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:52.272366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:52.330802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533902561393710:11760]
2025-10-02T08:10:52.330907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1003, pipe: [1:7556533902561393710:11760]
2025-10-02T08:10:52.419651Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:52.419999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.420014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.420052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561393710:11760], now have 1 active actors on pipe
2025-10-02T08:10:52.420161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:52.420171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:52.420339Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:52.420233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1004 reason: error at write: Disconnected sessionId: src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0
2025-10-02T08:10:52.420442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1004 sessionId: src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0 is DEAD
2025-10-02T08:10:52.420497Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:52.420567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533902561393710:11760]
2025-10-02T08:10:52.420983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:52.420997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0] Write session will restart in 0.008824s
2025-10-02T08:10:52.421020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0] Write session: Do CDS request
2025-10-02T08:10:52.421025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:52.427501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:52.428897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:52.429062Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:52.429071Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:52.429080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:52.429121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:52.429163Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533902561393807:11772]
2025-10-02T08:10:52.429801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:52.429990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:52.430029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:52.430334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:52.430378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.430384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.430385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.430386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.430388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.430392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.430403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.430407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.430410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.430414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.430420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.430427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.430432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.430437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.430441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.430446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.430451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.430457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.430469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.430474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.430497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:52.431405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.431535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:52.431546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1005
2025-10-02T08:10:52.431685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.431722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:52.431730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:52.431733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:52.432106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1005 sessionId:  describe result for acl check
2025-10-02T08:10:52.432140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:52.432147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:52.432148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:52.432165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533902561393823:11774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:52.432628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533902561393823:11774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:52.434527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533902561393823:11774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:52.438776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:52.440235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:52.440249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:52.440251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:52.440254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:52.440258Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1004 [1:7556533902561393807:11772]
2025-10-02T08:10:52.440267Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:52.440282Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:52.440284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.440287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.440289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.440305Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:52.440310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:52.440315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:52.440359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.440368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.440371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:52.440374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:52.440423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:52.440429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.440437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.440444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:52.440454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533902561393801:11772]
2025-10-02T08:10:52.440458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533902561393801:11772]
2025-10-02T08:10:52.440466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:52.440477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:52.440493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:52.440495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:52.440498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:52.440503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:52.440527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533903021439362:2378], now have 1 active actors on pipe
2025-10-02T08:10:52.440533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533902561393801:11772]
2025-10-02T08:10:52.440539Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:52.440553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:52.440572Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1004
2025-10-02T08:10:52.440817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533902561393823:11774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:52.440828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533902561393823:11774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:52.440831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533902561393823:11774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:52.440841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:52.441122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1004
2025-10-02T08:10:52.441133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561393860:11774], now have 1 active actors on pipe
2025-10-02T08:10:52.441137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.441141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.441162Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b712ec14-61267290-a7e36d07-eb701a67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:52.441172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.441175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.441176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:52.441184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.441197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:52.441208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.441238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.441244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.441253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.441280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1005 partition: 0 MaxSeqNo: 17 sessionId: src_id|b712ec14-61267290-a7e36d07-eb701a67_0
2025-10-02T08:10:52.441583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe41de47-8d1ce4ca-c76bc777-98b74368_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b712ec14-61267290-a7e36d07-eb701a67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:52.444316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b712ec14-61267290-a7e36d07-eb701a67_0] Write session: try to update token
2025-10-02T08:10:52.444330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b712ec14-61267290-a7e36d07-eb701a67_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:52.458640Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:52.458660Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:52.458670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533902561393801:11772]
2025-10-02T08:10:52.458715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:52.458719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:52.458920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:52.459089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:52.459252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:52.459409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:52.459725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:52.459763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:52.460108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId: src_id|b712ec14-61267290-a7e36d07-eb701a67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:52.462802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:52.462901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.462911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.462939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:52.462958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:52.463035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.463051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.463225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.463292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.463375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.463452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.463497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.463509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.463583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.463658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.463737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.463806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.463852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.463860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.463930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.463999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.464063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.464132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.464180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.464187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.464257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.464341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.464406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.464469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.464517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.464525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.464589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.464656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.464721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.464790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.464859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.464867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.464949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.465011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.465076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.465144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.465197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.465205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.465273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.465336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.465405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.465475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.465528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.465535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.465603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.465665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.465732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.465801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.465852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.465859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.465925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.465985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.466049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.466112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.466167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.466175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.466241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:52.466305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:52.466372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:52.466437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:52.466483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:52.466492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:52.466534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:52.466605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.466629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.466636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:52.466666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:52.466684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:52.466692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:52.466696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:52.466699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:52.467144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:52.467174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:52.467185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:52.467192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:52.467196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:52.467199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:52.467675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:52.467698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:52.467704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:52.467708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:52.467711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:52.467727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:52.468448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:52.468471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:52.468478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:52.468481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:52.468487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:52.470919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:52.470943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:52.470956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392652470
2025-10-02T08:10:52.471116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:52.471133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:52.471141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:52.471144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:52.471149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:52.471152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:52.471680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:52.471705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:52.471711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:52.471729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:52.471733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:52.471738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:52.472196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:52.472219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:52.472229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:52.472238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:52.472242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:52.472247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:52.472779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:52.472865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:52.472877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:52.474039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:52.474057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:52.474062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:52.474066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:52.474075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392652473
2025-10-02T08:10:52.474391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:52.474413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:52.474419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:52.474423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:52.474426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:52.474431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:52.474917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:52.474939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:52.474946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:52.474951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:52.474954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:52.474958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:52.475433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:52.475454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.475560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392652475
2025-10-02T08:10:52.476340Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:52.476358Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:52.476364Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:52.476370Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:52.477996Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:52.478012Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:52.478014Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:52.478025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533902561393801:11772]
2025-10-02T08:10:52.478029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533902561393801:11772]
2025-10-02T08:10:52.478085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:52.478084Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:52.478090Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:52.478095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.478097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:52.478233Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:52.520942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533902561393882:11760]
2025-10-02T08:10:52.522442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1004, pipe: [1:7556533902561393882:11760]
2025-10-02T08:10:52.644759Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:52.645204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561393882:11760], now have 1 active actors on pipe
2025-10-02T08:10:52.649201Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:52.651944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:52.652045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1005 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b712ec14-61267290-a7e36d07-eb701a67_0
2025-10-02T08:10:52.652276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1005 sessionId: src_id|b712ec14-61267290-a7e36d07-eb701a67_0 is DEAD
2025-10-02T08:10:52.652443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533902561393882:11760]
2025-10-02T08:10:52.652583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:52.653803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b712ec14-61267290-a7e36d07-eb701a67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:52.653820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b712ec14-61267290-a7e36d07-eb701a67_0] Write session will restart in 0.006647s
2025-10-02T08:10:52.653843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b712ec14-61267290-a7e36d07-eb701a67_0] Write session: Do CDS request
2025-10-02T08:10:52.653849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b712ec14-61267290-a7e36d07-eb701a67_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:52.661442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b712ec14-61267290-a7e36d07-eb701a67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.665336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:52.665353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1006
2025-10-02T08:10:52.668928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.668974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:52.668978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:52.668986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:52.670118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1006 sessionId:  describe result for acl check
2025-10-02T08:10:52.670154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:52.670161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:52.670163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:52.670169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533902561393978:11780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:52.670843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:52.670945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533902561393978:11780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:52.672548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:52.672752Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:52.672763Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:52.672786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:52.672869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:52.672932Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533902561393997:11779]
2025-10-02T08:10:52.673539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:52.673761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:52.673830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:52.674127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:52.674188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.674194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.674195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.674196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.674200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.674205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.674227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.674235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.674241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.674244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.674250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.674257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.674262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.674271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.674275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.674279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.674287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.674293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.674301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.674305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.674325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:52.674519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533902561393978:11780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:52.690734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533902561393978:11780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:52.690752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533902561393978:11780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:52.690756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533902561393978:11780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:52.690767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:52.690909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:52.692594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:52.692610Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:52.692613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:52.692618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:52.692626Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1005 [1:7556533902561393997:11779]
2025-10-02T08:10:52.692638Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:52.692653Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:52.692656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.692660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.692662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.692678Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:52.692682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:52.692695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:52.692757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.692766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.692769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:52.692771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:52.692969Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1005
2025-10-02T08:10:52.693637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b712ec14-61267290-a7e36d07-eb701a67_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|84c5068-c5c47791-907bc49d-d4200b14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:52.692849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:52.692856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.692870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.692882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:52.692900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561394032:11780], now have 1 active actors on pipe
2025-10-02T08:10:52.692904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533903021439370:2378], now have 1 active actors on pipe
2025-10-02T08:10:52.692909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533902561393982:11779]
2025-10-02T08:10:52.692911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533902561393982:11779]
2025-10-02T08:10:52.692921Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:52.692933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:52.692945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:52.692949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:52.692980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533902561393982:11779]
2025-10-02T08:10:52.692982Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:52.692991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:52.692994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:52.692999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:52.693017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1005
2025-10-02T08:10:52.693033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.693037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.693059Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84c5068-c5c47791-907bc49d-d4200b14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:52.693067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.693070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.693072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:52.693080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.693088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:52.693101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.693135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.693136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.693147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.693174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1006 partition: 0 MaxSeqNo: 17 sessionId: src_id|84c5068-c5c47791-907bc49d-d4200b14_0
2025-10-02T08:10:52.699850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c5068-c5c47791-907bc49d-d4200b14_0] Write session: try to update token
2025-10-02T08:10:52.699879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c5068-c5c47791-907bc49d-d4200b14_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:52.713867Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:52.713889Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:52.713891Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:52.713901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533902561393982:11779]
2025-10-02T08:10:52.713906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533902561393982:11779]
2025-10-02T08:10:52.713954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:52.713964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.713967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:52.714106Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:52.716940Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:52.716956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:52.730260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId: src_id|84c5068-c5c47791-907bc49d-d4200b14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:52.733033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:52.753162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533902561394046:11760]
2025-10-02T08:10:52.753424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1005, pipe: [1:7556533902561394046:11760]
2025-10-02T08:10:52.855509Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:52.855791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.855804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.855825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561394046:11760], now have 1 active actors on pipe
2025-10-02T08:10:52.856981Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:52.857199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533902561394046:11760]
2025-10-02T08:10:52.857220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:52.857270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1006 reason: status is not ok: tablet will be restarted right now sessionId: src_id|84c5068-c5c47791-907bc49d-d4200b14_0
2025-10-02T08:10:52.857132Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:52.857435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1006 sessionId: src_id|84c5068-c5c47791-907bc49d-d4200b14_0 is DEAD
2025-10-02T08:10:52.860937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c5068-c5c47791-907bc49d-d4200b14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:52.860957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c5068-c5c47791-907bc49d-d4200b14_0] Write session will restart in 0.009405s
2025-10-02T08:10:52.860992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c5068-c5c47791-907bc49d-d4200b14_0] Write session: Do CDS request
2025-10-02T08:10:52.861000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c5068-c5c47791-907bc49d-d4200b14_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:52.871448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c5068-c5c47791-907bc49d-d4200b14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.876760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:52.876777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1007
2025-10-02T08:10:52.877069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:52.877149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:52.877166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:52.877173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:52.878193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1007 sessionId:  describe result for acl check
2025-10-02T08:10:52.878243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:52.878254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:52.878256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:52.878263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533902561394117:11786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:52.879932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533902561394117:11786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:52.882618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:52.887117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:52.887483Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:52.887502Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:52.887517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:52.887617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:52.887674Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533902561394167:11785]
2025-10-02T08:10:52.888019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533902561394117:11786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:52.888443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:52.888765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:52.888853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:52.889227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:52.889273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.889282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.889283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.889284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.889286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.889292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.889302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.889306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.889310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.889314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.889322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.889334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:52.889344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.889349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:52.889358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.889363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:52.889367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.889373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.889377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.889383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.889404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:52.903185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533902561394117:11786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:52.903202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533902561394117:11786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:52.903205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533902561394117:11786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:52.903214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:52.906597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:52.908390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:52.908409Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:52.908411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:52.908414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:52.908421Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1006 [1:7556533902561394167:11785]
2025-10-02T08:10:52.908432Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:52.908449Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:52.908452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.908455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.908457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.908472Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:52.908476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:52.908483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:52.908543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.908554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.908558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:52.908560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:52.908620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:52.908623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.908636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:52.908648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:52.908666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533902561394146:11785]
2025-10-02T08:10:52.908668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533902561394146:11785]
2025-10-02T08:10:52.908678Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:52.908690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:52.908703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:52.908706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:52.908736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533902561394146:11785]
2025-10-02T08:10:52.908741Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:52.908859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:52.908862Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:52.908867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:52.910727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1006
2025-10-02T08:10:52.910750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561394205:11786], now have 1 active actors on pipe
2025-10-02T08:10:52.910755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533903021439389:2378], now have 1 active actors on pipe
2025-10-02T08:10:52.910821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.910832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.910856Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:52.910872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:52.910881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:52.910884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:52.910907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:52.910926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:52.910949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.911037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:52.911046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:52.911058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:52.911099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1007 partition: 0 MaxSeqNo: 17 sessionId: src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0
2025-10-02T08:10:52.911631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c5068-c5c47791-907bc49d-d4200b14_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:52.909504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1006
2025-10-02T08:10:52.914974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0] Write session: try to update token
2025-10-02T08:10:52.914998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:52.934423Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:52.934449Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:52.934453Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:52.934466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533902561394146:11785]
2025-10-02T08:10:52.934473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533902561394146:11785]
2025-10-02T08:10:52.934533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:52.934553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:52.934556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:52.934688Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:52.934701Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:52.934885Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:52.939795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId: src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:52.943242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:52.983517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533902561394233:11760]
2025-10-02T08:10:52.985754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1006, pipe: [1:7556533902561394233:11760]
2025-10-02T08:10:53.078938Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:53.079232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.079249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.079291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533902561394233:11760], now have 1 active actors on pipe
2025-10-02T08:10:53.079395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533902561394233:11760]
2025-10-02T08:10:53.079427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:53.079433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:53.079479Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:53.079496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1007 reason: error at write: Disconnected sessionId: src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0
2025-10-02T08:10:53.079493Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:53.079654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1007 sessionId: src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0 is DEAD
2025-10-02T08:10:53.079841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:53.079855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0] Write session will restart in 0.009761s
2025-10-02T08:10:53.079881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0] Write session: Do CDS request
2025-10-02T08:10:53.079887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:53.085373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:53.086704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:53.086855Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:53.086865Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:53.086874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:53.086917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:53.086968Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533906856361654:11805]
2025-10-02T08:10:53.087565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:53.087752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:53.087815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:53.088132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:53.088188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.088193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.088194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.088196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.088197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.088202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.088211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.088215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.088219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.088222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.088227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.088236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.088241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.088250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.088254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.088259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.088262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.088267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.088275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.088280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.088303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:53.091367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.091459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:53.091480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1008
2025-10-02T08:10:53.091738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.091772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:53.091781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:53.091785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:53.092295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1008 sessionId:  describe result for acl check
2025-10-02T08:10:53.092335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:53.092342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:53.092344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:53.092350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533906856361671:11807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:53.092841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533906856361671:11807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:53.095298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533906856361671:11807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:53.096250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:53.098208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:53.098224Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:53.098226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:53.098230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:53.098234Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1007 [1:7556533906856361654:11805]
2025-10-02T08:10:53.098244Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:53.098260Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:53.098262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.098264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.098265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.098282Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:53.098287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:53.098292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:53.098320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533906856361671:11807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:53.098338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533906856361671:11807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:53.098341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533906856361671:11807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:53.098343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.098345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.098348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:53.098350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:53.098351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:53.098414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:53.098423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.098433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.098440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:53.098456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533907316406716:2378], now have 1 active actors on pipe
2025-10-02T08:10:53.098462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533906856361648:11805]
2025-10-02T08:10:53.098465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533906856361648:11805]
2025-10-02T08:10:53.098472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:53.098485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:53.098497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:53.098499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:53.098502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:53.098502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:53.098532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533906856361648:11805]
2025-10-02T08:10:53.098538Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:53.098510Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1007
2025-10-02T08:10:53.098547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:53.098649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1007
2025-10-02T08:10:53.098661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856361702:11807], now have 1 active actors on pipe
2025-10-02T08:10:53.098665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.098671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.098699Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:53.098713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.098723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.098725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:53.098736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.098755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:53.098777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.098822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.098830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.098842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.098878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1008 partition: 0 MaxSeqNo: 17 sessionId: src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0
2025-10-02T08:10:53.099194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdb3d86-3341aab4-603c8ff1-2da28ef5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:53.102118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0] Write session: try to update token
2025-10-02T08:10:53.102134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:53.109272Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:53.109293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:53.109301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533906856361648:11805]
2025-10-02T08:10:53.109345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:53.109347Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:53.109546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:53.109695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:53.109843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:53.109994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:53.110377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:53.110423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:53.118126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId: src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:53.121061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:53.121140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.121154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.121190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:53.121224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:53.121306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.121334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.121602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.121691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.121783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.121870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.121932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.121944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.122040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.122124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.122213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.122294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.122360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.122369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.122459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.122542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.122625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.122714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.122851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.122880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.122954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.123019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.123088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.123153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.123202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.123211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.123274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.123338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.123434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.123500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.123551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.123564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.123628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.123687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.123760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.123824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.123870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.123881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.123944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.124003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.124069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.124127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.124179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.124186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.124250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.124308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.124364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.124425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.124467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.124474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.124541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.124599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.124660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.124719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.124760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.124767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.124846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:53.124904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:53.124967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:53.125026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:53.125070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:53.125077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:53.125140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:53.125199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.125220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.125229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:53.125258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:53.125274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:53.125279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:53.125281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:53.125282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:53.125661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:53.125685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:53.125691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:53.125695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:53.125698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:53.125701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:53.126369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:53.126393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:53.126399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:53.126403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:53.126406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:53.126408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:53.127002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:53.127020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:53.127023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:53.127028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:53.127030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:53.128181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:53.128199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:53.128207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392653128
2025-10-02T08:10:53.128310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:53.128323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:53.128326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:53.128329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:53.128331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:53.128335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:53.128871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:53.128888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:53.128892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:53.128895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:53.128897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:53.128903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:53.129359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:53.129375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:53.129381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:53.129386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:53.129388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:53.129390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:53.129819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:53.129835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:53.129841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:53.130866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:53.130881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:53.130886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:53.130889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:53.130895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392653130
2025-10-02T08:10:53.131163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:53.131178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:53.131182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:53.131187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:53.131189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:53.131191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:53.131628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:53.131645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:53.131649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:53.131652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:53.131654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:53.131657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:53.132111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:53.132126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.132199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392653132
2025-10-02T08:10:53.134409Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:53.134443Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:53.134450Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:53.134457Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:53.134467Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:53.134476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:53.134478Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:53.134486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533906856361648:11805]
2025-10-02T08:10:53.134493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533906856361648:11805]
2025-10-02T08:10:53.134547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:53.134557Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:53.134566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:53.134573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.134575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:53.134705Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:53.179756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533906856361718:11760]
2025-10-02T08:10:53.179881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1007, pipe: [1:7556533906856361718:11760]
2025-10-02T08:10:53.274957Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:53.275267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856361718:11760], now have 1 active actors on pipe
2025-10-02T08:10:53.275355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:53.275361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:53.275390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1008 reason: error at write: Disconnected sessionId: src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0
2025-10-02T08:10:53.275497Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:53.275769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:53.275783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0] Write session will restart in 0.008054s
2025-10-02T08:10:53.275805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0] Write session: Do CDS request
2025-10-02T08:10:53.275811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:53.275505Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:53.275578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1008 sessionId: src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0 is DEAD
2025-10-02T08:10:53.275737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533906856361718:11760]
2025-10-02T08:10:53.279171Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [bb89969fecb9e383] Result# TEvPutResult {Id# [72075186224037892:1007:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:53.279250Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1007:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:53.279301Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1007:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:53.283201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:53.284606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:53.284761Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:53.284768Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:53.284775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:53.284826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:53.284864Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533906856361826:11811]
2025-10-02T08:10:53.285262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:53.285415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.285428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:53.285453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:53.285596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:53.285613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1009
2025-10-02T08:10:53.285657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:53.285688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.285694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.285695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.285696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.285696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.285701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.285711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.285714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.285719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.285722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.285726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.285730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.285733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.285736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.285738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.285743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.285745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.285747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.285750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.285753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.285761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.285763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:53.285788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:53.285801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:53.285806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:53.286131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1009 sessionId:  describe result for acl check
2025-10-02T08:10:53.286166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:53.286172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:53.286175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:53.286179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533906856361842:11813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:53.286654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533906856361842:11813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:53.288746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533906856361842:11813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:53.293204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533906856361842:11813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:53.293219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533906856361842:11813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:53.293221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533906856361842:11813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:53.293230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:53.293822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:53.295301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:53.295315Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:53.295317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:53.295322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:53.295328Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1008 [1:7556533906856361826:11811]
2025-10-02T08:10:53.295337Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:53.295350Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:53.295352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.295353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.295355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.295367Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:53.295370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:53.295374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:53.295425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.295432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.295435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:53.295437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:53.295487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:53.295493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.295503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.295512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:53.295532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533906856361820:11811]
2025-10-02T08:10:53.295537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533906856361820:11811]
2025-10-02T08:10:53.295544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:53.295553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1008
2025-10-02T08:10:53.295554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:53.295556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856361874:11813], now have 1 active actors on pipe
2025-10-02T08:10:53.295557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:53.295564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:53.295575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:53.295577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:53.295583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533907316406723:2378], now have 1 active actors on pipe
2025-10-02T08:10:53.295612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.295621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.295634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533906856361820:11811]
2025-10-02T08:10:53.295644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:53.295657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:53.295645Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1008
2025-10-02T08:10:53.295677Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|110da31c-f85ab328-574d56ef-eb9416f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:53.295686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.295689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.295691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:53.295699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.295711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:53.295751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.295792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.295797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.295809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.295844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1009 partition: 0 MaxSeqNo: 17 sessionId: src_id|110da31c-f85ab328-574d56ef-eb9416f4_0
2025-10-02T08:10:53.296216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69b5de9-48c3f7e3-c92b063-a89dacd7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|110da31c-f85ab328-574d56ef-eb9416f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:53.299329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110da31c-f85ab328-574d56ef-eb9416f4_0] Write session: try to update token
2025-10-02T08:10:53.299349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110da31c-f85ab328-574d56ef-eb9416f4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:53.312717Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:53.312734Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:53.312736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:53.312742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533906856361820:11811]
2025-10-02T08:10:53.312749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533906856361820:11811]
2025-10-02T08:10:53.312786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:53.312792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.312795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:53.312834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:53.312849Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:53.312983Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:53.315674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId: src_id|110da31c-f85ab328-574d56ef-eb9416f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:53.318518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:53.375820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533906856361889:11760]
2025-10-02T08:10:53.375956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1008, pipe: [1:7556533906856361889:11760]
2025-10-02T08:10:53.445591Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:53.445862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.445875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.445914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856361889:11760], now have 1 active actors on pipe
2025-10-02T08:10:53.446029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533906856361889:11760]
2025-10-02T08:10:53.446083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:53.446090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:53.446138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1009 reason: error at write: Disconnected sessionId: src_id|110da31c-f85ab328-574d56ef-eb9416f4_0
2025-10-02T08:10:53.446173Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:53.446155Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:53.446336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1009 sessionId: src_id|110da31c-f85ab328-574d56ef-eb9416f4_0 is DEAD
2025-10-02T08:10:53.446538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110da31c-f85ab328-574d56ef-eb9416f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:53.446555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110da31c-f85ab328-574d56ef-eb9416f4_0] Write session will restart in 0.007021s
2025-10-02T08:10:53.446595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110da31c-f85ab328-574d56ef-eb9416f4_0] Write session: Do CDS request
2025-10-02T08:10:53.446602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110da31c-f85ab328-574d56ef-eb9416f4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:53.453605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:53.455045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:53.455220Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:53.455230Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:53.455239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:53.455282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:53.455318Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533906856361994:11817]
2025-10-02T08:10:53.455454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110da31c-f85ab328-574d56ef-eb9416f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.455501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:53.455513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1010
2025-10-02T08:10:53.455654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.455678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:53.455685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:53.455688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:53.455991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1010 sessionId:  describe result for acl check
2025-10-02T08:10:53.455997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:53.456015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:53.456018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:53.456019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:53.456022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533906856361999:11819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:53.456184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:53.456226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:53.456374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533906856361999:11819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:53.456531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:53.456569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.456575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.456578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.456579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.456580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.456585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.456596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.456604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.456609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.456613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.456618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.456625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.456631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.456636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.456640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.456646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.456649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.456654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.456658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.456663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.456683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:53.458092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533906856361999:11819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:53.464187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533906856361999:11819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:53.464202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533906856361999:11819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:53.464206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533906856361999:11819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:53.464215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:53.464546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:53.466239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:53.466255Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:53.466257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:53.466261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:53.466268Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1009 [1:7556533906856361994:11817]
2025-10-02T08:10:53.466279Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:53.466295Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:53.466298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.466300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.466302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.466317Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:53.466326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:53.466332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:53.466389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.466396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.466399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:53.466402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:53.466463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:53.466470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.466484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.466497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:53.466511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533906856361987:11817]
2025-10-02T08:10:53.466513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533906856361987:11817]
2025-10-02T08:10:53.466520Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:53.466523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1009
2025-10-02T08:10:53.466532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856362041:11819], now have 1 active actors on pipe
2025-10-02T08:10:53.466535Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:53.466538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:53.466544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:53.466557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:53.466560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:53.466565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533907316406730:2378], now have 1 active actors on pipe
2025-10-02T08:10:53.466570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.466574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.466611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533906856361987:11817]
2025-10-02T08:10:53.466627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:53.466644Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c762d27-bb98475a-521549c4-f9562a8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:53.466626Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1009
2025-10-02T08:10:53.466645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:53.466653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.466656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.466658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:53.466666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.466673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:53.466708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.466751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.466757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.466768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.466799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1010 partition: 0 MaxSeqNo: 17 sessionId: src_id|2c762d27-bb98475a-521549c4-f9562a8a_0
2025-10-02T08:10:53.467189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110da31c-f85ab328-574d56ef-eb9416f4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2c762d27-bb98475a-521549c4-f9562a8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:53.470422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c762d27-bb98475a-521549c4-f9562a8a_0] Write session: try to update token
2025-10-02T08:10:53.470444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c762d27-bb98475a-521549c4-f9562a8a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:53.484040Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:53.484059Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:53.484061Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:53.484068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533906856361987:11817]
2025-10-02T08:10:53.484072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533906856361987:11817]
2025-10-02T08:10:53.484110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:53.484117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.484121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:53.484131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:53.484146Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:53.484260Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:53.486044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId: src_id|2c762d27-bb98475a-521549c4-f9562a8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:53.488796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:53.546374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533906856362059:11760]
2025-10-02T08:10:53.546552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1009, pipe: [1:7556533906856362059:11760]
2025-10-02T08:10:53.641762Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:53.642064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.642081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.642120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856362059:11760], now have 1 active actors on pipe
2025-10-02T08:10:53.642299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:53.642316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:53.642345Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:53.642428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1010 reason: error at write: Disconnected sessionId: src_id|2c762d27-bb98475a-521549c4-f9562a8a_0
2025-10-02T08:10:53.642459Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:53.642609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533906856362059:11760]
2025-10-02T08:10:53.642656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1010 sessionId: src_id|2c762d27-bb98475a-521549c4-f9562a8a_0 is DEAD
2025-10-02T08:10:53.643692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c762d27-bb98475a-521549c4-f9562a8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:53.643705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c762d27-bb98475a-521549c4-f9562a8a_0] Write session will restart in 0.005994s
2025-10-02T08:10:53.643757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c762d27-bb98475a-521549c4-f9562a8a_0] Write session: Do CDS request
2025-10-02T08:10:53.643764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c762d27-bb98475a-521549c4-f9562a8a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:53.651253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:53.651394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c762d27-bb98475a-521549c4-f9562a8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.651415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:53.651429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1011
2025-10-02T08:10:53.652749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:53.652992Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:53.653007Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:53.653021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:53.653086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:53.653138Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533906856362171:11824]
2025-10-02T08:10:53.653894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:53.653920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.653956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:53.653962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:53.653966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:53.654148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:53.654203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:53.654473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1011 sessionId:  describe result for acl check
2025-10-02T08:10:53.654515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:53.654521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:53.654523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:53.654529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533906856362181:11826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:53.654580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:53.654622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.654627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.654629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.654631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.654632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.654638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.654650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.654655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.654659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.654668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.654674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.654682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.654689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.654693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.654699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.654704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.654713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.654718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.654724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.654730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.654750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:53.655101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533906856362181:11826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:53.659077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533906856362181:11826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:53.667044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533906856362181:11826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:53.667062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533906856362181:11826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:53.667066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533906856362181:11826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:53.667084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:53.668909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:53.670786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:53.670806Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:53.670808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:53.670815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:53.670821Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1010 [1:7556533906856362171:11824]
2025-10-02T08:10:53.670835Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:53.670852Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:53.670855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.670858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.670859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.670875Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:53.670881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:53.670887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:53.670953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.670965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.670968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:53.670970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:53.671034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:53.671043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.671057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.671067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:53.671088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856362218:11826], now have 1 active actors on pipe
2025-10-02T08:10:53.671091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1010
2025-10-02T08:10:53.671097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533907316406738:2378], now have 1 active actors on pipe
2025-10-02T08:10:53.671104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533906856362164:11824]
2025-10-02T08:10:53.671106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533906856362164:11824]
2025-10-02T08:10:53.671119Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:53.671131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.671141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.671146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:53.671151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:53.671162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:53.671179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:53.671188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:53.671191Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1010
2025-10-02T08:10:53.671232Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:53.671251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.671258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.671259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:53.671270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.671280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:53.671288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533906856362164:11824]
2025-10-02T08:10:53.671297Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:53.671314Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:53.671328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.671416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.671419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.671433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.671472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1011 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0
2025-10-02T08:10:53.671859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c762d27-bb98475a-521549c4-f9562a8a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:53.674942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0] Write session: try to update token
2025-10-02T08:10:53.674958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:53.693575Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:53.693596Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:53.693599Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:53.693609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533906856362164:11824]
2025-10-02T08:10:53.693613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533906856362164:11824]
2025-10-02T08:10:53.693650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:53.693649Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:53.693657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.693657Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:53.693659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:53.693826Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:53.701776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId: src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:53.705076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:53.742954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533906856362233:11760]
2025-10-02T08:10:53.743146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1010, pipe: [1:7556533906856362233:11760]
2025-10-02T08:10:53.832331Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:53.832679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.832696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.832731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856362233:11760], now have 1 active actors on pipe
2025-10-02T08:10:53.833027Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:53.833269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533906856362233:11760]
2025-10-02T08:10:53.833292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:53.833341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1011 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0
2025-10-02T08:10:53.833826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:53.833838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0] Write session will restart in 0.009506s
2025-10-02T08:10:53.833860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0] Write session: Do CDS request
2025-10-02T08:10:53.833866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:53.833525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1011 sessionId: src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0 is DEAD
2025-10-02T08:10:53.833182Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:53.843865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:53.845444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.844201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:53.844354Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:53.844357Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:53.844366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:53.844402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:53.844438Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533906856362341:11830]
2025-10-02T08:10:53.845029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:53.845945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:53.845993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:53.846291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:53.846328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.846329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.846331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.846333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.846334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.846339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.846347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.846351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.846354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.846357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.846363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.846369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:53.846374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.846378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:53.846382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.846387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:53.846392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.846397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.846401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.846405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.846420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:53.846421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:53.846427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1012
2025-10-02T08:10:53.848918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:53.848992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:53.848999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:53.849005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:53.849526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1012 sessionId:  describe result for acl check
2025-10-02T08:10:53.849556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:53.849558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:53.849559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:53.849565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533906856362358:11832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:53.850095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533906856362358:11832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:53.853700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533906856362358:11832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:53.856659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:53.858477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:53.858496Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:53.858498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:53.858502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:53.858509Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1011 [1:7556533906856362341:11830]
2025-10-02T08:10:53.858522Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:53.858539Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:53.858542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.858545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.858547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.858563Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:53.858568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:53.858574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:53.858634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.858636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.858639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:53.858642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:53.858711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:53.858713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.858728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:53.858743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:53.858759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533906856362335:11830]
2025-10-02T08:10:53.858761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533906856362335:11830]
2025-10-02T08:10:53.858769Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:53.858783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:53.858788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:53.858792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:53.858798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:53.858801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:53.858832Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533906856362335:11830]
2025-10-02T08:10:53.858836Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:53.858926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:53.859112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533906856362358:11832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:53.859118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533906856362358:11832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:53.859122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533906856362358:11832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:53.859131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:53.859236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533907316406757:2378], now have 1 active actors on pipe
2025-10-02T08:10:53.859861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1011
2025-10-02T08:10:53.859871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856362396:11832], now have 1 active actors on pipe
2025-10-02T08:10:53.859925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.859934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.859957Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca8061da-35291105-b16676a5-f8fce7fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:53.859964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:53.859968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:53.859970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:53.859979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:53.859990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:53.860006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.860300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:53.860309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:53.860325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:53.860352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1012 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca8061da-35291105-b16676a5-f8fce7fc_0
2025-10-02T08:10:53.860737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b333987-951c4ad4-2c98e725-6ec3c50b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca8061da-35291105-b16676a5-f8fce7fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:53.861124Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1011
2025-10-02T08:10:53.863428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8061da-35291105-b16676a5-f8fce7fc_0] Write session: try to update token
2025-10-02T08:10:53.863445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8061da-35291105-b16676a5-f8fce7fc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:53.880932Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:53.880949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:53.880953Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:53.880961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533906856362335:11830]
2025-10-02T08:10:53.880964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533906856362335:11830]
2025-10-02T08:10:53.881004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:53.881011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:53.881013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:53.881165Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:53.883704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:53.883711Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:53.886953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId: src_id|ca8061da-35291105-b16676a5-f8fce7fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:53.889732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:53.936865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533906856362416:11760]
2025-10-02T08:10:53.937117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1011, pipe: [1:7556533906856362416:11760]
2025-10-02T08:10:54.030940Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:54.031248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.031259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.031295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533906856362416:11760], now have 1 active actors on pipe
2025-10-02T08:10:54.031645Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:54.031974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8061da-35291105-b16676a5-f8fce7fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:54.031984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8061da-35291105-b16676a5-f8fce7fc_0] Write session will restart in 0.005294s
2025-10-02T08:10:54.032007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8061da-35291105-b16676a5-f8fce7fc_0] Write session: Do CDS request
2025-10-02T08:10:54.032014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8061da-35291105-b16676a5-f8fce7fc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:54.031426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:54.031431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:54.031479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1012 reason: error at write: Disconnected sessionId: src_id|ca8061da-35291105-b16676a5-f8fce7fc_0
2025-10-02T08:10:54.031642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1012 sessionId: src_id|ca8061da-35291105-b16676a5-f8fce7fc_0 is DEAD
2025-10-02T08:10:54.031915Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:54.032119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533906856362416:11760]
2025-10-02T08:10:54.038384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8061da-35291105-b16676a5-f8fce7fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.038355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:54.038483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:54.038486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1013
2025-10-02T08:10:54.038726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.038747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:54.038751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:54.038754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:54.039083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1013 sessionId:  describe result for acl check
2025-10-02T08:10:54.039105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:54.039107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:54.039108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:54.039112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533911151329862:11851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:54.039532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533911151329862:11851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:54.039540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:54.039689Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:54.039699Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:54.039708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:54.039770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:54.039803Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533911151329867:11845]
2025-10-02T08:10:54.040328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:54.040514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:54.040559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:54.040814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:54.040855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.040861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.040861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.040864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.040865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.040869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.040878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.040882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.040885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.040889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.040893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.040897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.040900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.040904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.040910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.040915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.040922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.040926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.040930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.040934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.040951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:54.041232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533911151329862:11851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:54.047102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533911151329862:11851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:54.047117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533911151329862:11851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:54.047121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533911151329862:11851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:54.047129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:54.048968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:54.050481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:54.050493Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:54.050495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:54.050499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:54.050503Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1012 [1:7556533911151329867:11845]
2025-10-02T08:10:54.050512Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:54.050525Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:54.050526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.050528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.050529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.050541Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:54.050544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:54.050549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:54.050593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.050594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.050596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:54.050598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:54.050644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:54.050651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.050659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.050666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:54.050678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533911151329856:11845]
2025-10-02T08:10:54.050683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533911151329856:11845]
2025-10-02T08:10:54.050688Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:54.050699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151329907:11851], now have 1 active actors on pipe
2025-10-02T08:10:54.050701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1012
2025-10-02T08:10:54.050708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:54.050709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:54.050715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:54.050716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:54.050721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533911611374082:2378], now have 1 active actors on pipe
2025-10-02T08:10:54.050722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:54.050749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.050754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.050765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533911151329856:11845]
2025-10-02T08:10:54.050773Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:54.050781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:54.050792Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:54.050796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.050798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.050799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:54.050804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.050814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:54.050830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.050823Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1012
2025-10-02T08:10:54.050876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.050880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.050889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.050914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1013 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0
2025-10-02T08:10:54.051211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8061da-35291105-b16676a5-f8fce7fc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:54.053662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0] Write session: try to update token
2025-10-02T08:10:54.053677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:54.067359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId: src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:54.068585Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:54.068598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:54.068601Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:54.068608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533911151329856:11845]
2025-10-02T08:10:54.068614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533911151329856:11845]
2025-10-02T08:10:54.068655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:54.068666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.068669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:54.068669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:54.068673Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:54.068829Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:54.069840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:54.132540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533911151329923:11760]
2025-10-02T08:10:54.132676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1012, pipe: [1:7556533911151329923:11760]
2025-10-02T08:10:54.199283Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:54.199481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.199491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.199521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151329923:11760], now have 1 active actors on pipe
2025-10-02T08:10:54.199657Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:54.199696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:54.199774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1013 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0
2025-10-02T08:10:54.199878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533911151329923:11760]
2025-10-02T08:10:54.199833Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:54.199959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1013 sessionId: src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0 is DEAD
2025-10-02T08:10:54.200117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:54.200127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0] Write session will restart in 0.009942s
2025-10-02T08:10:54.200147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0] Write session: Do CDS request
2025-10-02T08:10:54.200153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:54.205483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:54.206591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:54.206725Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:54.206734Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:54.206742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:54.206772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:54.206800Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533911151330035:11856]
2025-10-02T08:10:54.207280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:54.207421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:54.207451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:54.207658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:54.207691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.207701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.207702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.207703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.207704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.207710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.207720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.207733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.207737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.207740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.207745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.207750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.207755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.207757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.207760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.207762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.207764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.207767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.207771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.207773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.207782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:54.211353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.211416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:54.211430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1014
2025-10-02T08:10:54.211801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.211837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:54.211841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:54.211845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:54.212409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1014 sessionId:  describe result for acl check
2025-10-02T08:10:54.212448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:54.212454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:54.212456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:54.212462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533911151330052:11858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:54.212983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533911151330052:11858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:54.215146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533911151330052:11858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:54.216024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:54.217629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:54.217645Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:54.217647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:54.217651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:54.217659Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1013 [1:7556533911151330035:11856]
2025-10-02T08:10:54.217669Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:54.217685Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:54.217695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.217698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.217700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.217715Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:54.217719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:54.217725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:54.217771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.217776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.217778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:54.217779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:54.217823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:54.217828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.217838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.217850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:54.217870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533911611374091:2378], now have 1 active actors on pipe
2025-10-02T08:10:54.217880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533911151330029:11856]
2025-10-02T08:10:54.217882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533911151330029:11856]
2025-10-02T08:10:54.217888Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:54.217903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:54.217916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:54.217924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:54.217926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:54.217930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:54.217953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533911151330029:11856]
2025-10-02T08:10:54.217956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:54.217966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:54.217952Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1013
2025-10-02T08:10:54.218176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533911151330052:11858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:54.218190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533911151330052:11858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:54.218193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533911151330052:11858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:54.218214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:54.218424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1013
2025-10-02T08:10:54.218431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330090:11858], now have 1 active actors on pipe
2025-10-02T08:10:54.218436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.218442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.218465Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:54.218471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.218475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.218477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:54.218486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.218497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:54.218512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.218551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.218559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.218576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.218607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1014 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0
2025-10-02T08:10:54.218926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d5140dd-26ee62c6-645d50d2-b21b6fa5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:54.221500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0] Write session: try to update token
2025-10-02T08:10:54.221518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:54.229520Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:54.229541Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:54.229547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533911151330029:11856]
2025-10-02T08:10:54.229581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:54.229607Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:54.229740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:54.229878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:54.230007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:54.230141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:54.230404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:54.230439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:54.235140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId: src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:54.237700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:54.237756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.237769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.237806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:54.237830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:54.237873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.237886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.238022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.238084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.238151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.238208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.238411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.238418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.238480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.238533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.238587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.238644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.238683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.238688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.238746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.238801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.238859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.238914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.238954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.238959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.239015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.239070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.239126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.239179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.239221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.239226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.239277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.239326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.239382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.239439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.239480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.239485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.239545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.239598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.239651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.239707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.239766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.239772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.239829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.239883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.239942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.240001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.240041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.240047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.240108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.240162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.240219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.240278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.240337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.240343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.240407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.240472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.240541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.240609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.240821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.240829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.240904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:54.240961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:54.241019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:54.241080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:54.241133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:54.241139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:54.241172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:54.241228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.241251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.241258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:54.241284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:54.241298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:54.241303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:54.241305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:54.241307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:54.241672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:54.241692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:54.241699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:54.241702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:54.241703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:54.241707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:54.242187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:54.242204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:54.242208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:54.242210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:54.242212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:54.242214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:54.242679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:54.242697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:54.242700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:54.242702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:54.242704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:54.243909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:54.243924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:54.243935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392654243
2025-10-02T08:10:54.244032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:54.244040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:54.244043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:54.244045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:54.244049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:54.244051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:54.244559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:54.244577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:54.244581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:54.244583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:54.244585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:54.244586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:54.245025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:54.245043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:54.245047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:54.245049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:54.245051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:54.245053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:54.245477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:54.245497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:54.245504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:54.246521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:54.246535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:54.246539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:54.246540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:54.246547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392654246
2025-10-02T08:10:54.246813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:54.246835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:54.246845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:54.246848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:54.246851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:54.246856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:54.247273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:54.247288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:54.247292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:54.247294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:54.247296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:54.247298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:54.247682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:54.247697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.247795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392654247
2025-10-02T08:10:54.248474Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:54.248493Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:54.248498Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:54.248503Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:54.250086Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:54.250099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:54.250100Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:54.250107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533911151330029:11856]
2025-10-02T08:10:54.250110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533911151330029:11856]
2025-10-02T08:10:54.250158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:54.250163Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:54.250165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.250168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:54.250169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:54.250300Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:54.299943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533911151330108:11760]
2025-10-02T08:10:54.300051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1013, pipe: [1:7556533911151330108:11760]
2025-10-02T08:10:54.383472Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:54.383897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330108:11760], now have 1 active actors on pipe
2025-10-02T08:10:54.384022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:54.384035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:54.384065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1014 reason: error at write: Disconnected sessionId: src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0
2025-10-02T08:10:54.384077Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:54.384254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1014 sessionId: src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0 is DEAD
2025-10-02T08:10:54.384213Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:54.384408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:54.384423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0] Write session will restart in 0.006698s
2025-10-02T08:10:54.384447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0] Write session: Do CDS request
2025-10-02T08:10:54.384455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:54.384452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533911151330108:11760]
2025-10-02T08:10:54.391029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:54.391437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:54.391615Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:54.391625Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:54.391634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:54.391679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:54.391708Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533911151330268:11862]
2025-10-02T08:10:54.392136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:54.392349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.392399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:54.392448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:54.392460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1015
2025-10-02T08:10:54.392471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:54.392603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.392630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:54.392635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:54.392643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:54.392738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:54.392815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.392820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.392821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.392822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.392824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.392829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.392840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.392843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.392847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.392851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.392856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.392863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.392868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.392873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.392877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.392881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.392885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.392891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.392899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.392902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.392914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:54.392995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1015 sessionId:  describe result for acl check
2025-10-02T08:10:54.393029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:54.393031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:54.393032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:54.393037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533911151330282:11864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:54.393542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533911151330282:11864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:54.395648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533911151330282:11864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:54.400848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533911151330282:11864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:54.400866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533911151330282:11864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:54.400869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533911151330282:11864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:54.400881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:54.401348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:54.402909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:54.402930Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:54.402932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:54.402936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:54.402942Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1014 [1:7556533911151330268:11862]
2025-10-02T08:10:54.402954Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:54.402970Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:54.402978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.402981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.402988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.403004Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:54.403016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:54.403022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:54.403079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.403088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.403091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:54.403094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:54.403153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:54.403162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.403173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.403183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:54.403205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330315:11864], now have 1 active actors on pipe
2025-10-02T08:10:54.403211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533911151330262:11862]
2025-10-02T08:10:54.403217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533911151330262:11862]
2025-10-02T08:10:54.403217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1014
2025-10-02T08:10:54.403224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:54.403231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533911611374097:2378], now have 1 active actors on pipe
2025-10-02T08:10:54.403234Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:54.403236Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:54.403240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:54.403252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:54.403258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:54.403268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.403272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.403309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533911151330262:11862]
2025-10-02T08:10:54.403318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:54.403287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1014
2025-10-02T08:10:54.403328Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:54.403331Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:54.403336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.403341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.403342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:54.403355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.403362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:54.403403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.403476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.403482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.403496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.403532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1015 partition: 0 MaxSeqNo: 17 sessionId: src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0
2025-10-02T08:10:54.403889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1609ef-e39fae9-53b52899-5fc156e2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:54.406930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0] Write session: try to update token
2025-10-02T08:10:54.406948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:54.422846Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:54.422867Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:54.422869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:54.422877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533911151330262:11862]
2025-10-02T08:10:54.422882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533911151330262:11862]
2025-10-02T08:10:54.422926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:54.422933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.422936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:54.422943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:54.422957Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:54.423077Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:54.423444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId: src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:54.426086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:54.484868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533911151330336:11760]
2025-10-02T08:10:54.484973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1014, pipe: [1:7556533911151330336:11760]
2025-10-02T08:10:54.556909Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:54.557145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.557156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.557189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330336:11760], now have 1 active actors on pipe
2025-10-02T08:10:54.557316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:54.557327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:54.557395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1015 reason: error at write: Disconnected sessionId: src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0
2025-10-02T08:10:54.557401Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:54.557525Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:54.557576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1015 sessionId: src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0 is DEAD
2025-10-02T08:10:54.557657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533911151330336:11760]
2025-10-02T08:10:54.557958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:54.557972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0] Write session will restart in 0.009803s
2025-10-02T08:10:54.557998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0] Write session: Do CDS request
2025-10-02T08:10:54.558005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:54.563717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:54.564167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:54.564347Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:54.564360Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:54.564372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:54.564429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:54.564474Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533911151330482:11870]
2025-10-02T08:10:54.565085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:54.565262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:54.565311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:54.565613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:54.565685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.565692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.565693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.565695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.565696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.565700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.565711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.565722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.565730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.565733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.565738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.565750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.565759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.565769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.565777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.565782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.565786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.565791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.565799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.565809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.565831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:54.569405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.569582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:54.569597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1016
2025-10-02T08:10:54.572680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.572741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:54.572747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:54.572752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:54.573311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1016 sessionId:  describe result for acl check
2025-10-02T08:10:54.573376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:54.573383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:54.573385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:54.573397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533911151330498:11872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:54.573948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:54.574042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533911151330498:11872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:54.575662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:54.575686Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:54.575689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:54.575692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:54.575699Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1015 [1:7556533911151330482:11870]
2025-10-02T08:10:54.575711Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:54.575742Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:54.575745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.575748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.575749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.575765Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:54.575770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:54.575777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:54.575844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.575856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.575859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:54.575861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:54.575926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:54.575935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.575949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.575961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:54.575984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533911611374105:2378], now have 1 active actors on pipe
2025-10-02T08:10:54.575997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533911151330476:11870]
2025-10-02T08:10:54.575999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533911151330476:11870]
2025-10-02T08:10:54.576005Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:54.576016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:54.576016Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:54.575995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1015
2025-10-02T08:10:54.576019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:54.576030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:54.576034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:54.576072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533911151330476:11870]
2025-10-02T08:10:54.576088Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:54.576096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:54.576488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533911151330498:11872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:54.582760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533911151330498:11872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:54.582781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533911151330498:11872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:54.582786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533911151330498:11872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:54.582795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:54.582997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1015
2025-10-02T08:10:54.583001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330538:11872], now have 1 active actors on pipe
2025-10-02T08:10:54.583008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.583014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.583040Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a91351f2-699f95d2-e60630c2-a1d26674_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:54.583061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.583066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.583068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:54.583080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.583100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:54.583124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.583170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.583185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.583209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.583252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1016 partition: 0 MaxSeqNo: 17 sessionId: src_id|a91351f2-699f95d2-e60630c2-a1d26674_0
2025-10-02T08:10:54.583601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9242e281-5bdf35ce-5974728-a97ea4ac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a91351f2-699f95d2-e60630c2-a1d26674_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:54.586631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a91351f2-699f95d2-e60630c2-a1d26674_0] Write session: try to update token
2025-10-02T08:10:54.586657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a91351f2-699f95d2-e60630c2-a1d26674_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:54.586734Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:54.586754Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:54.586767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533911151330476:11870]
2025-10-02T08:10:54.586804Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:54.586806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:54.586970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:54.587112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:54.587245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:54.587371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:54.587641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:54.587680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:54.601951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId: src_id|a91351f2-699f95d2-e60630c2-a1d26674_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:54.603514Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:54.603535Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:54.603538Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:54.603548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533911151330476:11870]
2025-10-02T08:10:54.603552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533911151330476:11870]
2025-10-02T08:10:54.603597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:54.603602Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:54.603609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:54.603610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.603613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:54.603768Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:54.604786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:54.657889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533911151330548:11760]
2025-10-02T08:10:54.657993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1015, pipe: [1:7556533911151330548:11760]
2025-10-02T08:10:54.747662Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:54.747968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.747987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.748007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330548:11760], now have 1 active actors on pipe
2025-10-02T08:10:54.748135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533911151330548:11760]
2025-10-02T08:10:54.748164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:54.748171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:54.748225Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:54.748230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1016 reason: error at write: Disconnected sessionId: src_id|a91351f2-699f95d2-e60630c2-a1d26674_0
2025-10-02T08:10:54.748259Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:54.748405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1016 sessionId: src_id|a91351f2-699f95d2-e60630c2-a1d26674_0 is DEAD
2025-10-02T08:10:54.748971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a91351f2-699f95d2-e60630c2-a1d26674_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:54.748986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a91351f2-699f95d2-e60630c2-a1d26674_0] Write session will restart in 0.009531s
2025-10-02T08:10:54.749015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a91351f2-699f95d2-e60630c2-a1d26674_0] Write session: Do CDS request
2025-10-02T08:10:54.749023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a91351f2-699f95d2-e60630c2-a1d26674_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:54.755345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:54.755801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:54.755967Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:54.755979Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:54.755988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:54.756038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:54.756076Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533911151330696:11877]
2025-10-02T08:10:54.756661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:54.756851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:54.756894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:54.757179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:54.757234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.757240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.757241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.757242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.757243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.757248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.757257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.757262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.757265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.757268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.757273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.757280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.757286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.757293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.757297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.757301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.757308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.757317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.757321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.757325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.757345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:54.759318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a91351f2-699f95d2-e60630c2-a1d26674_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.759564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:54.759576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1017
2025-10-02T08:10:54.759756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.759791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:54.759800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:54.759803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:54.760224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1017 sessionId:  describe result for acl check
2025-10-02T08:10:54.760259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:54.760266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:54.760267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:54.760273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533911151330712:11879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:54.760788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533911151330712:11879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:54.762927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533911151330712:11879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:54.765717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:54.765742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533911151330712:11879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:54.765764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533911151330712:11879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:54.765778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533911151330712:11879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:54.765788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:54.767368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:54.767385Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:54.767388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:54.767392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:54.767398Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1016 [1:7556533911151330696:11877]
2025-10-02T08:10:54.767409Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:54.767426Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:54.767429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.767435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.767437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.767451Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:54.767456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:54.767462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:54.767516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.767525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.767528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:54.767530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:54.767591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:54.767599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.767610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.767623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:54.767641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533911611374111:2378], now have 1 active actors on pipe
2025-10-02T08:10:54.767652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533911151330690:11877]
2025-10-02T08:10:54.767654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533911151330690:11877]
2025-10-02T08:10:54.767659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1016
2025-10-02T08:10:54.767664Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:54.767675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330743:11879], now have 1 active actors on pipe
2025-10-02T08:10:54.767683Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:54.767685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:54.767692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:54.767697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:54.767700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:54.767706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.767710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.767764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533911151330690:11877]
2025-10-02T08:10:54.767739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1016
2025-10-02T08:10:54.767774Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:54.767782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:54.767788Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|748ecc16-ed60818d-b2728645-32cf7c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:54.767794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.767797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.767800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:54.767808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.767816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:54.767857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.767904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.767910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.767923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.767956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1017 partition: 0 MaxSeqNo: 17 sessionId: src_id|748ecc16-ed60818d-b2728645-32cf7c6_0
2025-10-02T08:10:54.768337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a91351f2-699f95d2-e60630c2-a1d26674_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|748ecc16-ed60818d-b2728645-32cf7c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:54.771699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748ecc16-ed60818d-b2728645-32cf7c6_0] Write session: try to update token
2025-10-02T08:10:54.771741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748ecc16-ed60818d-b2728645-32cf7c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:54.786537Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:54.786556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:54.786558Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:54.786567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533911151330690:11877]
2025-10-02T08:10:54.786570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533911151330690:11877]
2025-10-02T08:10:54.786612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:54.786611Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:54.786618Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:54.786618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.786623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:54.786774Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:54.795068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId: src_id|748ecc16-ed60818d-b2728645-32cf7c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:54.797677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:54.848328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533911151330758:11760]
2025-10-02T08:10:54.848507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1016, pipe: [1:7556533911151330758:11760]
2025-10-02T08:10:54.937906Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:54.938311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.938323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.938344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330758:11760], now have 1 active actors on pipe
2025-10-02T08:10:54.939118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533911151330758:11760]
2025-10-02T08:10:54.939153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:54.939156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:54.939208Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:54.939214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1017 reason: error at write: Disconnected sessionId: src_id|748ecc16-ed60818d-b2728645-32cf7c6_0
2025-10-02T08:10:54.939414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1017 sessionId: src_id|748ecc16-ed60818d-b2728645-32cf7c6_0 is DEAD
2025-10-02T08:10:54.939812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:54.940971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748ecc16-ed60818d-b2728645-32cf7c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:54.940982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748ecc16-ed60818d-b2728645-32cf7c6_0] Write session will restart in 0.006542s
2025-10-02T08:10:54.941010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748ecc16-ed60818d-b2728645-32cf7c6_0] Write session: Do CDS request
2025-10-02T08:10:54.941017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748ecc16-ed60818d-b2728645-32cf7c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:54.948390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|748ecc16-ed60818d-b2728645-32cf7c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.948959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:54.948980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1018
2025-10-02T08:10:54.949184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:54.949218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:54.949225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:54.949228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:54.949739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1018 sessionId:  describe result for acl check
2025-10-02T08:10:54.949784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:54.949791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:54.949793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:54.949800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533911151330898:11885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:54.950341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533911151330898:11885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:54.954136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533911151330898:11885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:54.963048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533911151330898:11885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:54.963070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533911151330898:11885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:54.963074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533911151330898:11885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:54.963086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:54.969020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:54.970082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:54.970335Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:54.970346Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:54.970358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:54.970411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:54.970475Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533911151330958:11884]
2025-10-02T08:10:54.971189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:54.971464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:54.971506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:54.971886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:54.971935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.971936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.971937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.971939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.971940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.971945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.971957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.971961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.971966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.971969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.971979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.971987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:54.971994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.971999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:54.972004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.972008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:54.972012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.972017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.972021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.972026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.972046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:54.981060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:54.982874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:54.982881Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:54.982884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:54.982888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:54.982895Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1017 [1:7556533911151330958:11884]
2025-10-02T08:10:54.982908Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:54.982927Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:54.982931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.982934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.982936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.982952Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:54.982957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:54.982964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:54.983035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.983037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.983039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:54.983042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:54.983112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:54.983115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:54.983127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:54.983136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:54.983152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533911151330952:11884]
2025-10-02T08:10:54.983154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533911151330952:11884]
2025-10-02T08:10:54.983169Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:54.983181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:54.983194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:54.983196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:54.983228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533911151330952:11884]
2025-10-02T08:10:54.983231Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:54.983943Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1017
2025-10-02T08:10:54.983445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:54.983453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:54.983459Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:54.984105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1017
2025-10-02T08:10:54.984117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533911151330938:11885], now have 1 active actors on pipe
2025-10-02T08:10:54.984122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533911611374129:2378], now have 1 active actors on pipe
2025-10-02T08:10:54.984229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.984238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.984261Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b981c88b-6baff3ca-a4db505e-45178412_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:54.984268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:54.984271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:54.984274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:54.984284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:54.984295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:54.984311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.984403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:54.984407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:54.984419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:54.984448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1018 partition: 0 MaxSeqNo: 17 sessionId: src_id|b981c88b-6baff3ca-a4db505e-45178412_0
2025-10-02T08:10:54.984925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|748ecc16-ed60818d-b2728645-32cf7c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b981c88b-6baff3ca-a4db505e-45178412_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:54.988761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b981c88b-6baff3ca-a4db505e-45178412_0] Write session: try to update token
2025-10-02T08:10:54.988786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b981c88b-6baff3ca-a4db505e-45178412_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:55.005442Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:55.005468Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:55.005471Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:55.005483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533911151330952:11884]
2025-10-02T08:10:55.005488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533911151330952:11884]
2025-10-02T08:10:55.005547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:55.005555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.005558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:55.005740Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:55.008887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:55.008913Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:55.017140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId: src_id|b981c88b-6baff3ca-a4db505e-45178412_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:55.025037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:55.069805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533915446298291:11760]
2025-10-02T08:10:55.071996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1017, pipe: [1:7556533915446298291:11760]
2025-10-02T08:10:55.161300Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:55.161733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.161746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.161770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446298291:11760], now have 1 active actors on pipe
2025-10-02T08:10:55.161885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:55.161895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:55.161958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1018 reason: error at write: Disconnected sessionId: src_id|b981c88b-6baff3ca-a4db505e-45178412_0
2025-10-02T08:10:55.161989Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:55.162030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:55.162137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1018 sessionId: src_id|b981c88b-6baff3ca-a4db505e-45178412_0 is DEAD
2025-10-02T08:10:55.162273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533915446298291:11760]
2025-10-02T08:10:55.162336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b981c88b-6baff3ca-a4db505e-45178412_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:55.162361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b981c88b-6baff3ca-a4db505e-45178412_0] Write session will restart in 0.008140s
2025-10-02T08:10:55.162391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b981c88b-6baff3ca-a4db505e-45178412_0] Write session: Do CDS request
2025-10-02T08:10:55.162399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b981c88b-6baff3ca-a4db505e-45178412_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:55.168028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:55.168468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:55.168603Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:55.168611Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:55.168620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:55.168659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:55.168695Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533915446298472:11903]
2025-10-02T08:10:55.169196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:55.169360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:55.169387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:55.169603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:55.169638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.169642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.169643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.169643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.169644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.169647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.169653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.169655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.169657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.169659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.169663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.169667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.169670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.169673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.169675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.169678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.169680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.169682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.169685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.169688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.169697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:55.171346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b981c88b-6baff3ca-a4db505e-45178412_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.171400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:55.171417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1019
2025-10-02T08:10:55.171557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.171590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:55.171601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:55.171605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:55.171973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1019 sessionId:  describe result for acl check
2025-10-02T08:10:55.172006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:55.172010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:55.172012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:55.172016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533915446298488:11905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:55.172408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533915446298488:11905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:55.174317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533915446298488:11905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:55.179110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533915446298488:11905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:55.179125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533915446298488:11905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:55.179131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533915446298488:11905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:55.179146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:55.179795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:55.181372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:55.181387Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:55.181389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:55.181393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:55.181399Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1018 [1:7556533915446298472:11903]
2025-10-02T08:10:55.181411Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:55.181427Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:55.181429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.181431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.181432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.181444Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:55.181448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:55.181453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:55.181505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.181515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.181518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:55.181520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:55.181589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:55.181597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.181610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.181622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:55.181640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533915446298466:11903]
2025-10-02T08:10:55.181646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533915446298466:11903]
2025-10-02T08:10:55.181653Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:55.181664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:55.181681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:55.181680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:55.181685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:55.181687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:55.181693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1018
2025-10-02T08:10:55.181696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446298516:11905], now have 1 active actors on pipe
2025-10-02T08:10:55.181726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533915906341455:2378], now have 1 active actors on pipe
2025-10-02T08:10:55.181733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533915446298466:11903]
2025-10-02T08:10:55.181741Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:55.181752Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:55.181753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.181756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.181796Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:55.181807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.181815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.181816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:55.181824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.181835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:55.181801Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1018
2025-10-02T08:10:55.181860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.181921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.181941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.181977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.182037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1019 partition: 0 MaxSeqNo: 17 sessionId: src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0
2025-10-02T08:10:55.182664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b981c88b-6baff3ca-a4db505e-45178412_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:55.185816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0] Write session: try to update token
2025-10-02T08:10:55.185838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:55.201922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId: src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:55.202253Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:55.202269Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:55.202271Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:55.202281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533915446298466:11903]
2025-10-02T08:10:55.202284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533915446298466:11903]
2025-10-02T08:10:55.202321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:55.202334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.202336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:55.202336Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:55.202343Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:55.202487Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:55.205066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:55.262559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533915446298532:11760]
2025-10-02T08:10:55.262689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1018, pipe: [1:7556533915446298532:11760]
2025-10-02T08:10:55.342222Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:55.342673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.342691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.342743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446298532:11760], now have 1 active actors on pipe
2025-10-02T08:10:55.342923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533915446298532:11760]
2025-10-02T08:10:55.342960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:55.342970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:55.342995Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:55.343043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1019 reason: error at write: Disconnected sessionId: src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0
2025-10-02T08:10:55.343069Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:55.343228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1019 sessionId: src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0 is DEAD
2025-10-02T08:10:55.343408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:55.343421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0] Write session will restart in 0.005564s
2025-10-02T08:10:55.343449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0] Write session: Do CDS request
2025-10-02T08:10:55.343455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:55.350342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.350346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:55.350440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:55.350456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1020
2025-10-02T08:10:55.350611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.350654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:55.350664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:55.350668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:55.351061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:55.351135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1020 sessionId:  describe result for acl check
2025-10-02T08:10:55.351172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:55.351180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:55.351185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:55.351191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533915446298688:11911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:55.351203Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:55.351212Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:55.351219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:55.351256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:55.351297Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533915446298689:11909]
2025-10-02T08:10:55.351694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533915446298688:11911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:55.351796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:55.352071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:55.352141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:55.352499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:55.352551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.352560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.352561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.352563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.352564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.352570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.352580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.352584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.352588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.352593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.352604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.352612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.352623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.352629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.352634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.352639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.352649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.352659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.352664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.352669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.352692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:55.353844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533915446298688:11911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:55.360445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533915446298688:11911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:55.360471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533915446298688:11911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:55.360474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533915446298688:11911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:55.360483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:55.360926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:55.362870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:55.362883Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:55.362886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:55.362890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:55.362896Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1019 [1:7556533915446298689:11909]
2025-10-02T08:10:55.362908Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:55.362924Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:55.362928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.362930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.362931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.362950Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:55.362956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:55.362962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:55.363019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.363027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.363031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:55.363034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:55.363109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:55.363115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.363125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.363136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:55.363156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446298733:11911], now have 1 active actors on pipe
2025-10-02T08:10:55.363163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1019
2025-10-02T08:10:55.363166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533915446298680:11909]
2025-10-02T08:10:55.363167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533915446298680:11909]
2025-10-02T08:10:55.363173Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:55.363184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533915906341461:2378], now have 1 active actors on pipe
2025-10-02T08:10:55.363188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:55.363188Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:55.363191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:55.363197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:55.363199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:55.363204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.363209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.363248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533915446298680:11909]
2025-10-02T08:10:55.363258Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:55.363274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:55.363275Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:55.363281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.363287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.363289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:55.363297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.363310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:55.363292Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1019
2025-10-02T08:10:55.363349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.363454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.363459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.363472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.363506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1020 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0
2025-10-02T08:10:55.363868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856213cf-9cae5e4a-3523b2f5-d0f1dca3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:55.367025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0] Write session: try to update token
2025-10-02T08:10:55.367045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:55.384046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId: src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:55.384050Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:55.384055Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:55.384057Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:55.384064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533915446298680:11909]
2025-10-02T08:10:55.384068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533915446298680:11909]
2025-10-02T08:10:55.384112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:55.384118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.384120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:55.384131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:55.384151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:55.384279Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:55.386463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:55.443306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533915446298748:11760]
2025-10-02T08:10:55.443552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1019, pipe: [1:7556533915446298748:11760]
2025-10-02T08:10:55.521021Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:55.521315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.521331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.521381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446298748:11760], now have 1 active actors on pipe
2025-10-02T08:10:55.521560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533915446298748:11760]
2025-10-02T08:10:55.521590Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:55.521608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:55.521638Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:55.521682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1020 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0
2025-10-02T08:10:55.521879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1020 sessionId: src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0 is DEAD
2025-10-02T08:10:55.522036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:55.522049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0] Write session will restart in 0.005047s
2025-10-02T08:10:55.522076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0] Write session: Do CDS request
2025-10-02T08:10:55.522084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:55.528238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.528308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:55.528323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1021
2025-10-02T08:10:55.528561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.528599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:55.528620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:55.528624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:55.528959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1021 sessionId:  describe result for acl check
2025-10-02T08:10:55.528987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:55.528988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:55.528990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:55.528996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533915446298896:11916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:55.529424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533915446298896:11916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:55.529865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:55.530742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:55.530875Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:55.530882Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:55.530888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:55.530918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:55.530975Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533915446298928:11915]
2025-10-02T08:10:55.531401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:55.531551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:55.531579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:55.531687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533915446298896:11916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:55.531846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:55.531896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.531902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.531905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.531906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.531907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.531911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.531919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.531922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.531925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.531927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.531932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.531938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.531943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.531947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.531951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.531960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.531963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.531968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.531971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.531978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.531993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:55.538118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533915446298896:11916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:55.538139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533915446298896:11916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:55.538143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533915446298896:11916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:55.538152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:55.540417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:55.542459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:55.542482Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:55.542485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:55.542490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:55.542498Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1020 [1:7556533915446298928:11915]
2025-10-02T08:10:55.542513Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:55.542534Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:55.542546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.542550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.542553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.542576Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:55.542583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:55.542597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:55.542689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.542699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.542703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:55.542706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:55.542800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:55.542809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.542827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.542845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:55.542860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1020
2025-10-02T08:10:55.542876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446298958:11916], now have 1 active actors on pipe
2025-10-02T08:10:55.542886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533915906341467:2378], now have 1 active actors on pipe
2025-10-02T08:10:55.542894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533915446298911:11915]
2025-10-02T08:10:55.542902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533915446298911:11915]
2025-10-02T08:10:55.542918Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:55.542933Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:55.542936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.542941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.542943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:55.542964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:55.542947Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1020
2025-10-02T08:10:55.542984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:55.542993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:55.543046Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:55.543060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.543065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.543069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:55.543080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.543091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:55.543112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533915446298911:11915]
2025-10-02T08:10:55.543126Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:55.543137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:55.543159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.543241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.543249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.543269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.543314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1021 partition: 0 MaxSeqNo: 17 sessionId: src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0
2025-10-02T08:10:55.543706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1094d1-e9e06e86-7d2b67cf-bb2cd0d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:55.546819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0] Write session: try to update token
2025-10-02T08:10:55.546837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:55.561627Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:55.561654Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:55.561658Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:55.561670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533915446298911:11915]
2025-10-02T08:10:55.561677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533915446298911:11915]
2025-10-02T08:10:55.561734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:55.561742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:55.561749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.561750Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:55.561752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:55.561928Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:55.562698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId: src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:55.565356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:55.621976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533915446298976:11760]
2025-10-02T08:10:55.622181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1020, pipe: [1:7556533915446298976:11760]
2025-10-02T08:10:55.726596Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:55.727140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.727162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.727224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446298976:11760], now have 1 active actors on pipe
2025-10-02T08:10:55.727621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533915446298976:11760]
2025-10-02T08:10:55.727656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:55.727659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:55.727680Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:55.727713Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:55.727750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1021 reason: error at write: Disconnected sessionId: src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0
2025-10-02T08:10:55.727974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1021 sessionId: src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0 is DEAD
2025-10-02T08:10:55.728824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:55.728839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0] Write session will restart in 0.008887s
2025-10-02T08:10:55.728869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0] Write session: Do CDS request
2025-10-02T08:10:55.728877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:55.739425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.739524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:55.739547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1022
2025-10-02T08:10:55.739712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.739783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:55.739797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:55.739802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:55.740261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1022 sessionId:  describe result for acl check
2025-10-02T08:10:55.740293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:55.740299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:55.740300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:55.740316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533915446299121:11923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:55.740894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533915446299121:11923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:55.741923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:55.742808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:55.742965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533915446299121:11923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:55.742993Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:55.743004Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:55.743017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:55.743099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:55.743141Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533915446299157:11922]
2025-10-02T08:10:55.743797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:55.743974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:55.744019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:55.744324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:55.744361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.744366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.744367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.744368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.744370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.744374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.744384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.744388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.744392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.744397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.744403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.744410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.744415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.744420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.744424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.744432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.744436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.744440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.744442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.744445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.744462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:55.751360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533915446299121:11923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:55.751378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533915446299121:11923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:55.751381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533915446299121:11923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:55.751389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:55.756533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:55.758058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:55.758077Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:55.758081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:55.758085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:55.758094Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1021 [1:7556533915446299157:11922]
2025-10-02T08:10:55.758106Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:55.758123Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:55.758134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.758136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.758139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.758155Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:55.758165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:55.758174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:55.758234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.758241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.758244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:55.758246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:55.758309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:55.758319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.758334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.758347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:55.758363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1021
2025-10-02T08:10:55.758364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446299185:11923], now have 1 active actors on pipe
2025-10-02T08:10:55.758370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533915446299146:11922]
2025-10-02T08:10:55.758372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533915446299146:11922]
2025-10-02T08:10:55.758381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:55.758389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533915906341477:2378], now have 1 active actors on pipe
2025-10-02T08:10:55.758394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.758398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.758399Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:55.758403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:55.758413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:55.758428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:55.758431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:55.758472Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:55.758479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.758483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.758486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:55.758494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.758503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:55.758510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533915446299146:11922]
2025-10-02T08:10:55.758518Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:55.758525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:55.758541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.758647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.758656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.758670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.758711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1022 partition: 0 MaxSeqNo: 17 sessionId: src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0
2025-10-02T08:10:55.758714Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1021
2025-10-02T08:10:55.759070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3f86d4-ba35aae8-548db4e1-71699648_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:55.761968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0] Write session: try to update token
2025-10-02T08:10:55.761988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:55.779871Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:55.779896Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:55.779898Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:55.779908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533915446299146:11922]
2025-10-02T08:10:55.779913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533915446299146:11922]
2025-10-02T08:10:55.779967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:55.779975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.779978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:55.780169Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:55.780269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:55.780284Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:55.785981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId: src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:55.788636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:55.827821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533915446299199:11760]
2025-10-02T08:10:55.836755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1021, pipe: [1:7556533915446299199:11760]
2025-10-02T08:10:55.934493Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:55.934840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.934853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.934896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446299199:11760], now have 1 active actors on pipe
2025-10-02T08:10:55.935044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533915446299199:11760]
2025-10-02T08:10:55.935077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:55.935079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:55.935131Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:55.935165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1022 reason: error at write: Disconnected sessionId: src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0
2025-10-02T08:10:55.935200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:55.935355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1022 sessionId: src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0 is DEAD
2025-10-02T08:10:55.935681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:55.935692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0] Write session will restart in 0.007277s
2025-10-02T08:10:55.935722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0] Write session: Do CDS request
2025-10-02T08:10:55.935729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:55.944378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.944462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:55.944485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1023
2025-10-02T08:10:55.944600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:55.944643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:55.944648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:55.944651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:55.945143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1023 sessionId:  describe result for acl check
2025-10-02T08:10:55.945181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:55.945184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:55.945185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:55.945191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533915446299368:11931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:55.945461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:55.945750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533915446299368:11931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:55.946244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:55.946414Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:55.946424Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:55.946434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:55.946489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:55.946523Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533915446299380:11929]
2025-10-02T08:10:55.947070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:55.947292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:55.947324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:55.947560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:55.947596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.947600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.947601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.947602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.947602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.947606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.947613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.947616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.947618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.947620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.947623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.947628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:55.947632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.947635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:55.947640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.947642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:55.947644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.947648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.947650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.947653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.947663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:55.948120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533915446299368:11931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:55.954068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533915446299368:11931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:55.954087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533915446299368:11931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:55.954103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533915446299368:11931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:55.954114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:55.956467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:55.958379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:55.958396Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:55.958399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:55.958404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:55.958411Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1022 [1:7556533915446299380:11929]
2025-10-02T08:10:55.958429Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:55.958449Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:55.958457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.958461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.958463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.958482Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:55.958493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:55.958501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:55.958572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.958579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.958583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:55.958585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:55.958755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1022
2025-10-02T08:10:55.958766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:55.958769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.958784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:55.958806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:55.958834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533915446299420:11931], now have 1 active actors on pipe
2025-10-02T08:10:55.958842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533915906341496:2378], now have 1 active actors on pipe
2025-10-02T08:10:55.958848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.958855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.958833Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1022
2025-10-02T08:10:55.958879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533915446299369:11929]
2025-10-02T08:10:55.958885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533915446299369:11929]
2025-10-02T08:10:55.958894Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:55.958906Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:55.958908Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:55.958914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:55.958930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:55.958939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:55.958963Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:55.958975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:55.958985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:55.958987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:55.958999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:55.959013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:55.959058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533915446299369:11929]
2025-10-02T08:10:55.959070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:55.959084Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:55.959086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.959132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:55.959138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:55.959152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:55.959188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1023 partition: 0 MaxSeqNo: 17 sessionId: src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0
2025-10-02T08:10:55.959581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9890d5ce-a7e2022c-39bfc238-8a06e59f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:55.962755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0] Write session: try to update token
2025-10-02T08:10:55.962775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:55.979527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId: src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:55.979865Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:55.979883Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:55.979885Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:55.979894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533915446299369:11929]
2025-10-02T08:10:55.979899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533915446299369:11929]
2025-10-02T08:10:55.979948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:55.979961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:55.979964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:55.979968Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:55.979976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:55.980112Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:55.982604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:56.035130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533919741266730:11760]
2025-10-02T08:10:56.035289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1022, pipe: [1:7556533919741266730:11760]
2025-10-02T08:10:56.144196Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:56.144663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.144674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.144725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741266730:11760], now have 1 active actors on pipe
2025-10-02T08:10:56.145040Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:56.145063Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:56.145391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533919741266730:11760]
2025-10-02T08:10:56.145420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:56.145478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1023 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0
2025-10-02T08:10:56.145655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1023 sessionId: src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0 is DEAD
2025-10-02T08:10:56.145946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:56.145959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0] Write session will restart in 0.005859s
2025-10-02T08:10:56.145989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0] Write session: Do CDS request
2025-10-02T08:10:56.145996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:56.153624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.153698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:56.153715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1024
2025-10-02T08:10:56.153871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:56.154016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.154042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:56.154047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:56.154050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:56.154754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:56.154786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1024 sessionId:  describe result for acl check
2025-10-02T08:10:56.154808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:56.154810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:56.154812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:56.154818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533919741266936:11950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:56.155052Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:56.155056Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:56.155066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:56.155113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:56.155157Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533919741266937:11948]
2025-10-02T08:10:56.155347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533919741266936:11950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:56.155646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:56.155876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:56.155920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:56.156187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:56.156227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.156232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.156233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.156234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.156235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.156239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.156246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.156248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.156251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.156253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.156257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.156262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.156266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.156269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.156271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.156274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.156276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.156279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.156281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.156284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.156294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:56.158073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533919741266936:11950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:56.165965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533919741266936:11950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:56.165984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533919741266936:11950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:56.165988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533919741266936:11950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:56.166006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:56.166042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:56.167855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:56.167872Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:56.167875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:56.167882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:56.167889Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1023 [1:7556533919741266937:11948]
2025-10-02T08:10:56.167904Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:56.167919Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:56.167923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.167926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.167930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.167946Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:56.167951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:56.167958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:56.168026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.168038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.168041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:56.168043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:56.168097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:56.168104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.168114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.168120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:56.168131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533919741266929:11948]
2025-10-02T08:10:56.168133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533919741266929:11948]
2025-10-02T08:10:56.168137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:56.168146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:56.168154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:56.168159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:56.168161Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:56.168162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:56.168166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1023
2025-10-02T08:10:56.168171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741266979:11950], now have 1 active actors on pipe
2025-10-02T08:10:56.168199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533920201308822:2378], now have 1 active actors on pipe
2025-10-02T08:10:56.168205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533919741266929:11948]
2025-10-02T08:10:56.168214Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:56.168218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.168221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.168254Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:56.168254Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:56.168263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.168266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.168269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:56.168275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.168282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:56.168297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.168269Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1023
2025-10-02T08:10:56.168366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.168373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.168390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.168417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1024 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0
2025-10-02T08:10:56.168842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a2be8c-2d9964da-c4a68e5-37f511e9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:56.172111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0] Write session: try to update token
2025-10-02T08:10:56.172131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:56.187672Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:56.187691Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:56.187694Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:56.187702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533919741266929:11948]
2025-10-02T08:10:56.187707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533919741266929:11948]
2025-10-02T08:10:56.187766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:56.187775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.187775Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:56.187777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:56.187781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:56.187905Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:56.193608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId: src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:56.197332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:56.245592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533919741266994:11760]
2025-10-02T08:10:56.245729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1023, pipe: [1:7556533919741266994:11760]
2025-10-02T08:10:56.338543Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:56.338909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.338925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.338955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741266994:11760], now have 1 active actors on pipe
2025-10-02T08:10:56.339181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533919741266994:11760]
2025-10-02T08:10:56.339213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:56.339216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:56.339235Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:56.339223Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:56.339294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1024 reason: error at write: Disconnected sessionId: src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0
2025-10-02T08:10:56.339484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1024 sessionId: src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0 is DEAD
2025-10-02T08:10:56.339685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:56.339702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0] Write session will restart in 0.006848s
2025-10-02T08:10:56.339730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0] Write session: Do CDS request
2025-10-02T08:10:56.339759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:56.347488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:56.348315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:56.348449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.348485Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:56.348493Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:56.348502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:56.348514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:56.348524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1025
2025-10-02T08:10:56.348541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:56.348581Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533919741267159:11954]
2025-10-02T08:10:56.348691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.348720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:56.348729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:56.348732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:56.349159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1025 sessionId:  describe result for acl check
2025-10-02T08:10:56.349197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:56.349203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:56.349204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:56.349210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533919741267164:11956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:56.349233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:56.349394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:56.349434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:56.349718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533919741267164:11956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:56.349731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:56.349774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.349780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.349782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.349783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.349784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.349789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.349799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.349802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.349806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.349810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.349815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.349825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.349839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.349847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.349851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.349856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.349865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.349870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.349874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.349879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.349900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:56.352018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533919741267164:11956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:56.358539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533919741267164:11956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:56.358560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533919741267164:11956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:56.358563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533919741267164:11956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:56.358574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:56.362442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:56.364328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:56.364350Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:56.364353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:56.364357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:56.364364Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1024 [1:7556533919741267159:11954]
2025-10-02T08:10:56.364375Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:56.364395Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:56.364398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.364401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.364402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.364420Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:56.364430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:56.364435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:56.364509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.364519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.364522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:56.364524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:56.364588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:56.364596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.364609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.364620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:56.364635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533919741267153:11954]
2025-10-02T08:10:56.364641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533919741267153:11954]
2025-10-02T08:10:56.364649Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:56.364660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:56.364678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:56.364680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1024
2025-10-02T08:10:56.364682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:56.364693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741267207:11956], now have 1 active actors on pipe
2025-10-02T08:10:56.364694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:56.364699Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:56.364724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533920201308829:2378], now have 1 active actors on pipe
2025-10-02T08:10:56.364726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533919741267153:11954]
2025-10-02T08:10:56.364730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:56.364737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.364745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.364786Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:56.364796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.364878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:56.364949Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1024
2025-10-02T08:10:56.365194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.365203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:56.365213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.365236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:56.365275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.365332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.365343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.365366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.365407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1025 partition: 0 MaxSeqNo: 17 sessionId: src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0
2025-10-02T08:10:56.365787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf79a878-e2f8a77c-3a356ff9-51f137ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:56.368850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0] Write session: try to update token
2025-10-02T08:10:56.368869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:56.383387Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:56.383405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:56.383408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:56.383417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533919741267153:11954]
2025-10-02T08:10:56.383422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533919741267153:11954]
2025-10-02T08:10:56.383465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:56.383475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.383484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:56.383483Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:56.383490Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:56.383631Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:56.386942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId: src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:56.389776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:56.439117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533919741267222:11760]
2025-10-02T08:10:56.439241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1024, pipe: [1:7556533919741267222:11760]
2025-10-02T08:10:56.526828Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:56.527308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.527323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.527367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741267222:11760], now have 1 active actors on pipe
2025-10-02T08:10:56.527495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533919741267222:11760]
2025-10-02T08:10:56.527549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:56.527557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:56.527575Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:56.527695Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:56.527727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1025 reason: error at write: Disconnected sessionId: src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0
2025-10-02T08:10:56.527933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1025 sessionId: src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0 is DEAD
2025-10-02T08:10:56.528109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:56.528119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0] Write session will restart in 0.007038s
2025-10-02T08:10:56.528147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0] Write session: Do CDS request
2025-10-02T08:10:56.528166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:56.535005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:56.535744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:56.536338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.536410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:56.536422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1026
2025-10-02T08:10:56.536543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.536570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:56.536580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:56.536583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:56.536987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1026 sessionId:  describe result for acl check
2025-10-02T08:10:56.537015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:56.537021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:56.537023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:56.537028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533919741267394:11962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:56.537493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533919741267394:11962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:56.539335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533919741267394:11962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:56.539577Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:56.539601Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:56.539630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:56.539785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:56.539843Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533919741267414:11960]
2025-10-02T08:10:56.540532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:56.540767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:56.540841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:56.541177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:56.541238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.541248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.541250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.541251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.541253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.541260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.541271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.541275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.541279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.541283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.541290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.541298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.541304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.541310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.541314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.541321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.541326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.541331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.541337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.541342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.541366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:56.542261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533919741267394:11962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:56.542272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533919741267394:11962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:56.542276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533919741267394:11962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:56.542284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:56.551083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:56.553161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:56.553186Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:56.553190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:56.553195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:56.553205Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1025 [1:7556533919741267414:11960]
2025-10-02T08:10:56.553223Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:56.553247Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:56.553251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.553255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.553257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.553282Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:56.553305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:56.553316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:56.553428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.553441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.553445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:56.553448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:56.553568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:56.553582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.553601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.553614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:56.553645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1025
2025-10-02T08:10:56.553648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741267440:11962], now have 1 active actors on pipe
2025-10-02T08:10:56.553652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533920201308838:2378], now have 1 active actors on pipe
2025-10-02T08:10:56.553662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533919741267386:11960]
2025-10-02T08:10:56.553670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533919741267386:11960]
2025-10-02T08:10:56.553765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:56.553768Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:56.553771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:56.553791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.553759Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1025
2025-10-02T08:10:56.553797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.553830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:56.553849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:56.553852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:56.553925Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:56.553944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.553950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.553952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:56.553965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.553984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:56.554003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533919741267386:11960]
2025-10-02T08:10:56.554020Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:56.554033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:56.554061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.554228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.554242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.554263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.554316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1026 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0
2025-10-02T08:10:56.554761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96da8eb8-f1bf75ad-f207bd04-4f486568_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:56.557338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0] Write session: try to update token
2025-10-02T08:10:56.557358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:56.572864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId: src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:56.573122Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:56.573139Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:56.573142Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:56.573154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533919741267386:11960]
2025-10-02T08:10:56.573164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533919741267386:11960]
2025-10-02T08:10:56.573230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:56.573245Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:56.573248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.573251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:56.573251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:56.573437Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:56.575635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:56.627514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533919741267460:11760]
2025-10-02T08:10:56.627590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1025, pipe: [1:7556533919741267460:11760]
2025-10-02T08:10:56.717913Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:56.718239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.718255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.718302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741267460:11760], now have 1 active actors on pipe
2025-10-02T08:10:56.718464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533919741267460:11760]
2025-10-02T08:10:56.718499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:56.718502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:56.718559Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:56.718575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1026 reason: error at write: Disconnected sessionId: src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0
2025-10-02T08:10:56.718586Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:56.718756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1026 sessionId: src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0 is DEAD
2025-10-02T08:10:56.718897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:56.718907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0] Write session will restart in 0.007472s
2025-10-02T08:10:56.718943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0] Write session: Do CDS request
2025-10-02T08:10:56.718951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:56.727360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.727473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:56.727494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1027
2025-10-02T08:10:56.727695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.727733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:56.727750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:56.727754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:56.728213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1027 sessionId:  describe result for acl check
2025-10-02T08:10:56.728255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:56.728260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:56.728262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:56.728269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533919741267599:11968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:56.728781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533919741267599:11968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:56.730955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533919741267599:11968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:56.730968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:56.731529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:56.731693Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:56.731703Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:56.731711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:56.731765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:56.731798Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533919741267658:11967]
2025-10-02T08:10:56.732228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:56.732421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:56.732474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:56.732780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:56.732838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.732846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.732847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.732848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.732849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.732854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.732864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.732867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.732872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.732876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.732882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.732889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.732896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.732901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.732909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.732914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.732919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.732924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.732932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.732936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.732958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:56.738538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533919741267599:11968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:56.738552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533919741267599:11968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:56.738556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533919741267599:11968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:56.738565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:56.742118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:56.743756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:56.743769Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:56.743771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:56.743776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:56.743780Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1026 [1:7556533919741267658:11967]
2025-10-02T08:10:56.743790Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:56.743804Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:56.743806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.743808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.743809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.743821Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:56.743824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:56.743829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:56.743870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.743877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.743879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:56.743882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:56.743932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:56.743939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.743947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.743953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:56.743966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533919741267643:11967]
2025-10-02T08:10:56.743971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533919741267643:11967]
2025-10-02T08:10:56.743976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:56.743985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:56.743998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:56.743998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:56.744001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:56.744001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:56.744012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741267676:11968], now have 1 active actors on pipe
2025-10-02T08:10:56.744043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533920201308846:2378], now have 1 active actors on pipe
2025-10-02T08:10:56.744050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533919741267643:11967]
2025-10-02T08:10:56.744055Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:56.744060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.744063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.744067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:56.744099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1026
2025-10-02T08:10:56.744102Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:56.744108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.744114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.744115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:56.744122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.744129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:56.744141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.744175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.744111Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1026
2025-10-02T08:10:56.744180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.744189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.744215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1027 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0
2025-10-02T08:10:56.744513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5b0325-b9ace98f-79fe17cc-36b68c98_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:56.747075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0] Write session: try to update token
2025-10-02T08:10:56.747091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:56.763249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId: src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:56.763720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:56.763735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:56.763747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:56.763756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533919741267643:11967]
2025-10-02T08:10:56.763761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533919741267643:11967]
2025-10-02T08:10:56.763798Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:56.763801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:56.763808Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:56.763808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.763813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:56.763954Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:56.765874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:56.818507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533919741267691:11760]
2025-10-02T08:10:56.818620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1026, pipe: [1:7556533919741267691:11760]
2025-10-02T08:10:56.900473Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:56.900767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.900780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.900838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741267691:11760], now have 1 active actors on pipe
2025-10-02T08:10:56.900945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:56.900956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:56.901015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1027 reason: error at write: Disconnected sessionId: src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0
2025-10-02T08:10:56.901015Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:56.901076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:56.901182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1027 sessionId: src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0 is DEAD
2025-10-02T08:10:56.901280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533919741267691:11760]
2025-10-02T08:10:56.901353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:56.901366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0] Write session will restart in 0.008828s
2025-10-02T08:10:56.901406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0] Write session: Do CDS request
2025-10-02T08:10:56.901414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:56.908969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:56.909911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:56.910084Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:56.910094Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:56.910103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:56.910142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:56.910174Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533919741267872:11973]
2025-10-02T08:10:56.910731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:56.910880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:56.910915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:56.911179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:56.911215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.911220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.911221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.911222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.911222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.911227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.911235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.911238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.911241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.911244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.911249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.911255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:56.911259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.911267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:56.911271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.911275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:56.911277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.911281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.911288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.911292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.911307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:56.911403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.911489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:56.911497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1028
2025-10-02T08:10:56.911655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:56.911680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:56.911687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:56.911690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:56.911977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1028 sessionId:  describe result for acl check
2025-10-02T08:10:56.912011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:56.912016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:56.912017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:56.912020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533919741267888:11976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:56.912321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533919741267888:11976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:56.913750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533919741267888:11976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:56.919202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533919741267888:11976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:56.919214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533919741267888:11976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:56.919219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533919741267888:11976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:56.919240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:56.923072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:56.924508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:56.924520Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:56.924522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:56.924524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:56.924529Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1027 [1:7556533919741267872:11973]
2025-10-02T08:10:56.924536Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:56.924548Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:56.924550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.924552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.924555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.924568Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:56.924571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:56.924576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:56.924626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.924634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.924636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:56.924638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:56.924687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:56.924692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.924700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:56.924707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:56.924721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533919741267860:11973]
2025-10-02T08:10:56.924725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533919741267860:11973]
2025-10-02T08:10:56.924730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:56.924739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:56.924744Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:56.924747Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:56.924750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:56.924751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:56.924758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533919741267921:11976], now have 1 active actors on pipe
2025-10-02T08:10:56.924760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533920201308865:2378], now have 1 active actors on pipe
2025-10-02T08:10:56.924763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1027
2025-10-02T08:10:56.924788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533919741267860:11973]
2025-10-02T08:10:56.924798Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:56.924821Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:56.924821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.924825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.924862Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:56.924870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:56.924873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:56.924874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:56.924880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:56.924886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:56.924845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1027
2025-10-02T08:10:56.924911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.924965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:56.924981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:56.925005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:56.925046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1028 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0
2025-10-02T08:10:56.925418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9096346-d181ea97-20aa7551-b2f5dc14_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:56.928705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0] Write session: try to update token
2025-10-02T08:10:56.928724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:56.944053Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:56.944071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:56.944072Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:56.944082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533919741267860:11973]
2025-10-02T08:10:56.944085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533919741267860:11973]
2025-10-02T08:10:56.944122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:56.944129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:56.944131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:56.944148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:56.944157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:56.944262Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:56.946284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId: src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:56.948890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:57.001300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533924036235232:11760]
2025-10-02T08:10:57.001451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1027, pipe: [1:7556533924036235232:11760]
2025-10-02T08:10:57.079366Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:57.079593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.079612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.079656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036235232:11760], now have 1 active actors on pipe
2025-10-02T08:10:57.079735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:57.079752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:57.079802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1028 reason: error at write: Disconnected sessionId: src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0
2025-10-02T08:10:57.079862Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:57.079964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1028 sessionId: src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0 is DEAD
2025-10-02T08:10:57.080026Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:57.080089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:57.080099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0] Write session will restart in 0.008105s
2025-10-02T08:10:57.080103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533924036235232:11760]
2025-10-02T08:10:57.080137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0] Write session: Do CDS request
2025-10-02T08:10:57.080144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:57.087698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:57.088443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:57.088673Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:57.088693Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:57.088706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:57.088779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:57.088856Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533924036235406:11981]
2025-10-02T08:10:57.089390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:57.089444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:57.089457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1029
2025-10-02T08:10:57.089551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:57.089654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:57.089693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:57.089702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:57.089705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:57.089790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:57.089854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:57.090081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1029 sessionId:  describe result for acl check
2025-10-02T08:10:57.090112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:57.090114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:57.090116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:57.090121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533924036235417:11983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:57.090218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:57.090304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.090313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.090314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.090315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.090316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.090322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.090331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.090335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.090339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.090348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.090355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.090363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.090375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.090380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.090386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.090397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.090402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.090413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.090418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.090424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.090445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:57.090663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533924036235417:11983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:57.097192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533924036235417:11983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:57.099519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:57.100780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533924036235417:11983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:57.100794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533924036235417:11983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:57.100807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533924036235417:11983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:57.100816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:57.100911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:57.100924Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:57.100927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:57.100929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:57.100933Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1028 [1:7556533924036235406:11981]
2025-10-02T08:10:57.100942Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:57.100955Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:57.100960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.100962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.100964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.100977Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:57.100980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:57.100985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:57.101033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.101038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.101041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:57.101042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:57.101098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:57.101105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.101118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.101136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:57.101152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533924496276170:2378], now have 1 active actors on pipe
2025-10-02T08:10:57.101160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533924036235400:11981]
2025-10-02T08:10:57.101161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533924036235400:11981]
2025-10-02T08:10:57.101173Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:57.101185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:57.101198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:57.101204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:57.101183Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1028
2025-10-02T08:10:57.101229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533924036235400:11981]
2025-10-02T08:10:57.101234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:57.101237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036235454:11983], now have 1 active actors on pipe
2025-10-02T08:10:57.101237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1028
2025-10-02T08:10:57.101262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.101263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:57.101267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:57.101269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.101275Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:57.101297Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:57.101307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.101313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.101318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:57.101324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.101331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:57.101342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:57.101372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.101376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.101385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:57.101410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1029 partition: 0 MaxSeqNo: 17 sessionId: src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0
2025-10-02T08:10:57.101769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d687ed7-49b1b4b4-a75b8b-e3fca1eb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:57.104876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0] Write session: try to update token
2025-10-02T08:10:57.104896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:57.117389Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:57.117405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:57.117416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533924036235400:11981]
2025-10-02T08:10:57.117462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:57.117490Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:57.117626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:57.117769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:57.117898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:57.118026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:57.118211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:57.118249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:57.121137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId: src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:57.123513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:57.123618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.123635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.123660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:57.123682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:57.123755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.123768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.123924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.123983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.124050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.124125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.124398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.124407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.124469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.124522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.124579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.124647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.124692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.124697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.124758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.124838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.124897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.124957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.125002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.125011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.125083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.125146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.125226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.125286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.125326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.125331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.125388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.125440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.125496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.125563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.125613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.125620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.125691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.125758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.125819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.125881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.125925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.125935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.125996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.126053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.126126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.126191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.126237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.126243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.126302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.126360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.126420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.126478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.126519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.126524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.126587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.126652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.126723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.126786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.126833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.126840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.126900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:57.126958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:57.127030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:57.127097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:57.127144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:57.127153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:57.127190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:57.127256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.127278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.127285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:57.127313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:57.127330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:57.127337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:57.127339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:57.127342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:57.127782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:57.127810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:57.127820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:57.127824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:57.127831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:57.127834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:57.128331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:57.128358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:57.128369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:57.128375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:57.128381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:57.128383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:57.129021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:57.129050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:57.129056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:57.129059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:57.129063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:57.131498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:57.131525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:57.131536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392657131
2025-10-02T08:10:57.131654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:57.131672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:57.131682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:57.131691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:57.131696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:57.131704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:57.132200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:57.132222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:57.132226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:57.132229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:57.132231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:57.132233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:57.132731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:57.132756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:57.132765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:57.132768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:57.132771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:57.132776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:57.133295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:57.133327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:57.133340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:57.134545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:57.134568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:57.134573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:57.134578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:57.134588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392657134
2025-10-02T08:10:57.134906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:57.134933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:57.134943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:57.134947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:57.134956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:57.134959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:57.135486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:57.135512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:57.135523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:57.135531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:57.135535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:57.135539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:57.136040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:57.136064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.136172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392657135
2025-10-02T08:10:57.137030Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:57.137059Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:57.137066Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:57.137076Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:57.138769Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:57.138784Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:57.138786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:57.138794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533924036235400:11981]
2025-10-02T08:10:57.138799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533924036235400:11981]
2025-10-02T08:10:57.138862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:57.138875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.138872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:57.138877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:57.138893Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:57.139007Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:57.180796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533924036235500:11760]
2025-10-02T08:10:57.181098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1028, pipe: [1:7556533924036235500:11760]
2025-10-02T08:10:57.282228Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:57.282649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036235500:11760], now have 1 active actors on pipe
2025-10-02T08:10:57.282838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533924036235500:11760]
2025-10-02T08:10:57.282869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:57.282872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:57.282898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1029 reason: error at write: Disconnected sessionId: src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0
2025-10-02T08:10:57.282914Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:57.282966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:57.283092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1029 sessionId: src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0 is DEAD
2025-10-02T08:10:57.283262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:57.283270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0] Write session will restart in 0.009370s
2025-10-02T08:10:57.283295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0] Write session: Do CDS request
2025-10-02T08:10:57.283302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:57.292261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:57.293029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:57.293207Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:57.293217Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:57.293226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:57.293273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:57.293322Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533924036235686:11999]
2025-10-02T08:10:57.294005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:57.294157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:57.294196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:57.294343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:57.294427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:57.294436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1030
2025-10-02T08:10:57.294493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:57.294536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.294542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.294543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.294544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.294546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.294551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.294562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.294566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.294570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.294574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.294580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.294584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:57.294587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.294593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.294598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.294603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.294608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.294613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.294619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.294623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:57.294624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.294628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:57.294629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.294631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:57.294647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:57.295020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1030 sessionId:  describe result for acl check
2025-10-02T08:10:57.295051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:57.295052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:57.295053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:57.295058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533924036235703:12001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:57.295542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533924036235703:12001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:57.297836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533924036235703:12001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:57.303429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533924036235703:12001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:57.303445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533924036235703:12001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:57.303448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533924036235703:12001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:57.303457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:57.306821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:57.308525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:57.308545Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:57.308547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:57.308551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:57.308559Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1029 [1:7556533924036235686:11999]
2025-10-02T08:10:57.308571Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:57.308587Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:57.308591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.308594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.308596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.308614Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:57.308624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:57.308637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:57.308706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.308714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.308717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:57.308719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:57.308789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:57.308797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.308831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.308849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:57.308871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036235735:12001], now have 1 active actors on pipe
2025-10-02T08:10:57.308884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533924036235680:11999]
2025-10-02T08:10:57.308886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533924036235680:11999]
2025-10-02T08:10:57.308890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1029
2025-10-02T08:10:57.308893Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:57.308903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:57.308905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:57.308907Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:57.308919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:57.308922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:57.308928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533924496276199:2378], now have 1 active actors on pipe
2025-10-02T08:10:57.308934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.308938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.308979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533924036235680:11999]
2025-10-02T08:10:57.308989Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:57.309005Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9127a812-c78910ad-10377fe1-f8ae6470_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:57.309011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.309011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:57.309016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.309018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:57.309028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.309037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:57.308977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1029
2025-10-02T08:10:57.309086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:57.309186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.309194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.309221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:57.309265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1030 partition: 0 MaxSeqNo: 17 sessionId: src_id|9127a812-c78910ad-10377fe1-f8ae6470_0
2025-10-02T08:10:57.309646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b601f0e-b001c536-7782b92f-d99a81ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9127a812-c78910ad-10377fe1-f8ae6470_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:57.313108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9127a812-c78910ad-10377fe1-f8ae6470_0] Write session: try to update token
2025-10-02T08:10:57.313133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9127a812-c78910ad-10377fe1-f8ae6470_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:57.329542Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:57.329569Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:57.329571Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:57.329581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533924036235680:11999]
2025-10-02T08:10:57.329585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533924036235680:11999]
2025-10-02T08:10:57.329626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:57.329627Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:57.329633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:57.329633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.329635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:57.329767Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:57.330748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId: src_id|9127a812-c78910ad-10377fe1-f8ae6470_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:57.334008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:57.383252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533924036235749:11760]
2025-10-02T08:10:57.383381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1029, pipe: [1:7556533924036235749:11760]
2025-10-02T08:10:57.485298Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:57.485580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.485596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.485633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036235749:11760], now have 1 active actors on pipe
2025-10-02T08:10:57.486365Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:57.486639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533924036235749:11760]
2025-10-02T08:10:57.486659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:57.486708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1030 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9127a812-c78910ad-10377fe1-f8ae6470_0
2025-10-02T08:10:57.486865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1030 sessionId: src_id|9127a812-c78910ad-10377fe1-f8ae6470_0 is DEAD
2025-10-02T08:10:57.487057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9127a812-c78910ad-10377fe1-f8ae6470_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:57.487075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9127a812-c78910ad-10377fe1-f8ae6470_0] Write session will restart in 0.009645s
2025-10-02T08:10:57.487103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9127a812-c78910ad-10377fe1-f8ae6470_0] Write session: Do CDS request
2025-10-02T08:10:57.487113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9127a812-c78910ad-10377fe1-f8ae6470_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:57.485932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:57.499129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9127a812-c78910ad-10377fe1-f8ae6470_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:57.499383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:57.499405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1031
2025-10-02T08:10:57.499579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:57.499615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:57.499627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:57.499632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:57.500125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1031 sessionId:  describe result for acl check
2025-10-02T08:10:57.500157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:57.500159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:57.500162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:57.500167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533924036235869:12006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:57.500688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533924036235869:12006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:57.503414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533924036235869:12006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:57.503915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:57.504297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:57.504448Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:57.504454Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:57.504461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:57.504494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:57.504529Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533924036235965:12005]
2025-10-02T08:10:57.505011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:57.505490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:57.505566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:57.505988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:57.506043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.506044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.506045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.506046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.506047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.506054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.506065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.506069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.506074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.506077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.506084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.506093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.506100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.506105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.506110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.506116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.506120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.506130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.506136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.506141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.506162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:57.506994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533924036235869:12006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:57.507008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533924036235869:12006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:57.507012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533924036235869:12006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:57.507022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:57.524610Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1030
2025-10-02T08:10:57.521960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:57.523838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:57.523848Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:57.523852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:57.523857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:57.523866Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1030 [1:7556533924036235965:12005]
2025-10-02T08:10:57.523884Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:57.523907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:57.523913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.523917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.523920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.523948Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:57.523958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:57.523971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:57.524072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.524074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.524078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:57.524081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:57.524181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:57.524184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.524202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.524216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:57.524236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533924036235951:12005]
2025-10-02T08:10:57.524238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533924036235951:12005]
2025-10-02T08:10:57.524248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:57.524265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:57.524283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:57.524287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:57.524297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1030
2025-10-02T08:10:57.524302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:57.524307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:57.524337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036235982:12006], now have 1 active actors on pipe
2025-10-02T08:10:57.524341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533924036235951:12005]
2025-10-02T08:10:57.524344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:57.524351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533924496276206:2378], now have 1 active actors on pipe
2025-10-02T08:10:57.524357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.524362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.524503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:57.524544Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:57.524551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.524556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.524559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:57.524569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.524582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:57.524603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:57.524733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.524741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.524766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:57.524831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1031 partition: 0 MaxSeqNo: 17 sessionId: src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0
2025-10-02T08:10:57.525263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9127a812-c78910ad-10377fe1-f8ae6470_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:57.528704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0] Write session: try to update token
2025-10-02T08:10:57.528727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:57.575452Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:57.575479Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:57.575483Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:57.575495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533924036235951:12005]
2025-10-02T08:10:57.575505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533924036235951:12005]
2025-10-02T08:10:57.575562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:57.575571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.575574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:57.575643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:57.575651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:57.575782Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:57.591978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533924036235996:11760]
2025-10-02T08:10:57.593629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1030, pipe: [1:7556533924036235996:11760]
2025-10-02T08:10:57.604258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId: src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:57.607512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:57.770845Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:57.771325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036235996:11760], now have 1 active actors on pipe
2025-10-02T08:10:57.771366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.771378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.773776Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:57.773935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:57.774021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1031 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0
2025-10-02T08:10:57.774239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1031 sessionId: src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0 is DEAD
2025-10-02T08:10:57.774334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533924036235996:11760]
2025-10-02T08:10:57.773594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:57.777749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:57.777762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0] Write session will restart in 0.006929s
2025-10-02T08:10:57.777793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0] Write session: Do CDS request
2025-10-02T08:10:57.777799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:57.791522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:57.792150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:57.792169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1032
2025-10-02T08:10:57.792292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:57.792322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:57.792328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:57.792332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:57.793707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1032 sessionId:  describe result for acl check
2025-10-02T08:10:57.793755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:57.793757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:57.793759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:57.793766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533924036236107:12013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:57.795982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533924036236107:12013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:57.804619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533924036236107:12013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:57.822391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533924036236107:12013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:57.822420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533924036236107:12013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:57.822424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533924036236107:12013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:57.822528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:57.825915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:57.834640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:57.834886Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:57.834890Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:57.834899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:57.834954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:57.834987Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533924036236220:12012]
2025-10-02T08:10:57.835637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:57.835983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:57.836048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:57.836392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:57.836450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.836456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.836457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.836458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.836459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.836464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.836474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.836478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.836482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.836485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.836490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.836497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:57.836502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.836507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:57.836512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.836516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:57.836523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.836527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.836532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.836537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.836561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:57.846075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:57.847891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:57.847910Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:57.847913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:57.847917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:57.847925Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1031 [1:7556533924036236220:12012]
2025-10-02T08:10:57.847939Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:57.847957Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:57.847961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.847964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.847966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.847984Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:57.847990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:57.848008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:57.848080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.848090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.848094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:57.848096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:57.848179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:57.848190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.848204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:57.848217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:57.848235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036236199:12013], now have 1 active actors on pipe
2025-10-02T08:10:57.848242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533924036236214:12012]
2025-10-02T08:10:57.848245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533924036236214:12012]
2025-10-02T08:10:57.848256Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:57.848264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533924496276216:2378], now have 1 active actors on pipe
2025-10-02T08:10:57.848272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:57.848273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1031
2025-10-02T08:10:57.848286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:57.848289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:57.848311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:57.848313Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:57.848323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533924036236214:12012]
2025-10-02T08:10:57.848326Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:57.848329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:57.848333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.848337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.848381Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:57.848390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:57.848394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:57.848396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:57.848405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:57.848417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:57.848436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:57.848567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:57.848571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:57.848587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:57.848618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1032 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0
2025-10-02T08:10:57.848540Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1031
2025-10-02T08:10:57.849014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e85469-9445c51b-aa7bb6c0-f28e8713_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:57.851974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0] Write session: try to update token
2025-10-02T08:10:57.851993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:57.871734Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:57.871765Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:57.871768Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:57.871776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533924036236214:12012]
2025-10-02T08:10:57.871781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533924036236214:12012]
2025-10-02T08:10:57.871829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:57.871835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:57.871839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:57.871858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:57.871873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:57.871978Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:57.874263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533924036236248:11760]
2025-10-02T08:10:57.874422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1031, pipe: [1:7556533924036236248:11760]
2025-10-02T08:10:57.907379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId: src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:57.910178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:58.032196Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:58.032637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533924036236248:11760], now have 1 active actors on pipe
2025-10-02T08:10:58.032674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.032686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.032848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533924036236248:11760]
2025-10-02T08:10:58.032874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:58.032881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:58.032939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1032 reason: error at write: Disconnected sessionId: src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0
2025-10-02T08:10:58.032939Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:58.032977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:58.033124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1032 sessionId: src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0 is DEAD
2025-10-02T08:10:58.033528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:58.033540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0] Write session will restart in 0.007519s
2025-10-02T08:10:58.033564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0] Write session: Do CDS request
2025-10-02T08:10:58.033569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:58.040595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:58.041464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:58.041629Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:58.041638Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:58.041647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:58.041686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:58.041723Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533928331203739:12019]
2025-10-02T08:10:58.042396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.042379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:58.042453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:58.042461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1033
2025-10-02T08:10:58.042578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:58.042646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:58.042657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.042680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:58.042685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:58.042688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:58.043012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:58.043045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1033 sessionId:  describe result for acl check
2025-10-02T08:10:58.043059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.043061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.043062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.043063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.043066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.043074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:58.043076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:58.043078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:58.043082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533928331203751:12021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:58.043083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.043094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.043098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.043101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.043105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.043111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.043119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.043127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.043137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.043141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.043146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.043151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.043157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.043167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.043174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.043194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:58.043579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533928331203751:12021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:58.046009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533928331203751:12021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:58.051102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533928331203751:12021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:58.051117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533928331203751:12021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:58.051119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533928331203751:12021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:58.051126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:58.051756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:58.053531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:58.053552Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:58.053555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:58.053559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:58.053566Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1032 [1:7556533928331203739:12019]
2025-10-02T08:10:58.053578Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:58.053598Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:58.053608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.053617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.053623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.053641Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:58.053651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:58.053658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:58.053727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.053735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.053738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:58.053740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:58.053813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:58.053821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.053835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.053851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:58.053859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1032
2025-10-02T08:10:58.053882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331203784:12021], now have 1 active actors on pipe
2025-10-02T08:10:58.053889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533928791243535:2378], now have 1 active actors on pipe
2025-10-02T08:10:58.053895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.053899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.053917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533928331203733:12019]
2025-10-02T08:10:58.053924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533928331203733:12019]
2025-10-02T08:10:58.053936Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:58.053952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:58.053955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:58.053958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:58.053973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:58.053979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:58.053995Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bae466e3-6b56858-b295ba2b-b58fb385_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:58.054007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.054014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.054016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:58.054030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.054043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:58.054020Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1032
2025-10-02T08:10:58.054088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533928331203733:12019]
2025-10-02T08:10:58.054099Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:58.054106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:58.054124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.054169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.054179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.054197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.054244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1033 partition: 0 MaxSeqNo: 17 sessionId: src_id|bae466e3-6b56858-b295ba2b-b58fb385_0
2025-10-02T08:10:58.054648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e07a5aa-7a2da49-984f8809-da2d14a0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bae466e3-6b56858-b295ba2b-b58fb385_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:58.057978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae466e3-6b56858-b295ba2b-b58fb385_0] Write session: try to update token
2025-10-02T08:10:58.058003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae466e3-6b56858-b295ba2b-b58fb385_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:58.065297Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:58.065318Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.065328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533928331203733:12019]
2025-10-02T08:10:58.065367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:58.065374Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:58.065550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:58.065704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.065854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.065994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.066180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:58.066223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:58.075730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId: src_id|bae466e3-6b56858-b295ba2b-b58fb385_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:58.078300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:58.078398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.078412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.078443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:58.078476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:58.078616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.078627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.078776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.078839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.078906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.078967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.079020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.079030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.079105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.079166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.079231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.079297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.079345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.079354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.079420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.079480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.079549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.079611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.079662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.079669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.079734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.079811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.079873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.079937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.079982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.079989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.080055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.080111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.080172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.080237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.080280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.080289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.080353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.080419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.080481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.080540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.080588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.080595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.080660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.080719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.080786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.080868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.080914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.080921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.080989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.081054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.081122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.081190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.081232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.081239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.081304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.081370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.081433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.081498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.081547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.081554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.081618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.081675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.081738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.081801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.081842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.081849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.081912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:58.081984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.082016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.082023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:58.082055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:58.082072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:58.082080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:58.082084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:58.082087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:58.082530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:58.082558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:58.082564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:58.082568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:58.082572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:58.082575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:58.083053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:58.083075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:58.083080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:58.083083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:58.083087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:58.083090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:58.083599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:58.083623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:58.083628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:58.083632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:58.083635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:58.084879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:58.084896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:58.084909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392658084
2025-10-02T08:10:58.085065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:58.085080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:58.085086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:58.085089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:58.085096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:58.085101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:58.085564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:58.085587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:58.085593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:58.085597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:58.085600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:58.085604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:58.086130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:58.086154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:58.086163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:58.086166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:58.086170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:58.086174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:58.086664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:58.086689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:58.086694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:58.087822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:58.087839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:58.087845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:58.087850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:58.087859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392658087
2025-10-02T08:10:58.088162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:58.088190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:58.088196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:58.088199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:58.088203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:58.088208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:58.088690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:58.088714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:58.088719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:58.088723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:58.088727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:58.088730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:58.089207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:58.089228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.089341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392658089
2025-10-02T08:10:58.091640Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:58.091666Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:58.091671Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:58.091675Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:58.091684Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:58.091686Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.091688Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:58.091694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533928331203733:12019]
2025-10-02T08:10:58.091697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533928331203733:12019]
2025-10-02T08:10:58.091769Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:58.091772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:58.091775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.091777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:58.091784Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:58.091909Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:58.132799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533928331203802:11760]
2025-10-02T08:10:58.132958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1032, pipe: [1:7556533928331203802:11760]
2025-10-02T08:10:58.232885Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:58.233492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331203802:11760], now have 1 active actors on pipe
2025-10-02T08:10:58.233618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533928331203802:11760]
2025-10-02T08:10:58.233639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:58.233642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:58.233665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1033 reason: error at write: Disconnected sessionId: src_id|bae466e3-6b56858-b295ba2b-b58fb385_0
2025-10-02T08:10:58.233681Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:58.233744Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:58.233840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1033 sessionId: src_id|bae466e3-6b56858-b295ba2b-b58fb385_0 is DEAD
2025-10-02T08:10:58.234008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae466e3-6b56858-b295ba2b-b58fb385_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:58.234022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae466e3-6b56858-b295ba2b-b58fb385_0] Write session will restart in 0.006296s
2025-10-02T08:10:58.234044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae466e3-6b56858-b295ba2b-b58fb385_0] Write session: Do CDS request
2025-10-02T08:10:58.234049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae466e3-6b56858-b295ba2b-b58fb385_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:58.237535Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [471a567b4e6bf400] Result# TEvPutResult {Id# [72075186224037892:1032:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:58.237546Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1032:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:58.237602Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1032:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:58.241344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae466e3-6b56858-b295ba2b-b58fb385_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.241426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:58.241436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1034
2025-10-02T08:10:58.241649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.241674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:58.241681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:58.241684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:58.241965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1034 sessionId:  describe result for acl check
2025-10-02T08:10:58.241988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:58.241993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:58.241996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:58.241999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533928331204015:12039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:58.242415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533928331204015:12039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:58.242746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:58.243301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:58.243429Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:58.243436Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:58.243442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:58.243471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:58.243496Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533928331204045:12038]
2025-10-02T08:10:58.243874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:58.244013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:58.244036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:58.244076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533928331204015:12039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:58.244223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:58.244252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.244256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.244257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.244258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.244258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.244261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.244266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.244269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.244270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.244274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.244276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.244280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.244284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.244287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.244289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.244292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.244294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.244296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.244299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.244301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.244309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:58.250104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533928331204015:12039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:58.250116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533928331204015:12039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:58.250118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533928331204015:12039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:58.250124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:58.252261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:58.253748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:58.253761Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:58.253763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:58.253765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:58.253769Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1033 [1:7556533928331204045:12038]
2025-10-02T08:10:58.253776Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:58.253789Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:58.253790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.253792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.253794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.253805Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:58.253808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:58.253813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:58.253854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.253856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.253858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:58.253859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:58.253912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:58.253918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.253925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.253932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:58.253944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331204072:12039], now have 1 active actors on pipe
2025-10-02T08:10:58.253953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533928331204029:12038]
2025-10-02T08:10:58.253954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533928331204029:12038]
2025-10-02T08:10:58.253959Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:58.253959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1033
2025-10-02T08:10:58.253965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533928791243566:2378], now have 1 active actors on pipe
2025-10-02T08:10:58.253970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:58.253977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:58.253977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:58.253979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:58.253981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:58.253984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.253987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.254016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533928331204029:12038]
2025-10-02T08:10:58.254025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:58.254033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:58.254034Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62a362df-47a57734-80e7acdc-e7d7a374_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:58.254038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.254041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.254042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:58.254048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.254054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:58.254037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1033
2025-10-02T08:10:58.254077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.254110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.254115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.254123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.254152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1034 partition: 0 MaxSeqNo: 17 sessionId: src_id|62a362df-47a57734-80e7acdc-e7d7a374_0
2025-10-02T08:10:58.254539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae466e3-6b56858-b295ba2b-b58fb385_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|62a362df-47a57734-80e7acdc-e7d7a374_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:58.257614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62a362df-47a57734-80e7acdc-e7d7a374_0] Write session: try to update token
2025-10-02T08:10:58.257636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62a362df-47a57734-80e7acdc-e7d7a374_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:58.270394Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:58.270413Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.270415Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:58.270421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533928331204029:12038]
2025-10-02T08:10:58.270424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533928331204029:12038]
2025-10-02T08:10:58.270463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:58.270469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.270476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:58.270479Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:58.270485Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:58.270606Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:58.273534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId: src_id|62a362df-47a57734-80e7acdc-e7d7a374_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:58.275970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:58.334030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533928331204086:11760]
2025-10-02T08:10:58.334151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1033, pipe: [1:7556533928331204086:11760]
2025-10-02T08:10:58.402560Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:58.403025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.403044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.403087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331204086:11760], now have 1 active actors on pipe
2025-10-02T08:10:58.403202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:58.403209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:58.403264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1034 reason: error at write: Disconnected sessionId: src_id|62a362df-47a57734-80e7acdc-e7d7a374_0
2025-10-02T08:10:58.403321Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:58.403350Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:58.403452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1034 sessionId: src_id|62a362df-47a57734-80e7acdc-e7d7a374_0 is DEAD
2025-10-02T08:10:58.403620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a362df-47a57734-80e7acdc-e7d7a374_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:58.403634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a362df-47a57734-80e7acdc-e7d7a374_0] Write session will restart in 0.009368s
2025-10-02T08:10:58.403622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533928331204086:11760]
2025-10-02T08:10:58.403655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a362df-47a57734-80e7acdc-e7d7a374_0] Write session: Do CDS request
2025-10-02T08:10:58.403674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a362df-47a57734-80e7acdc-e7d7a374_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:58.410608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:58.411325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:58.411489Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:58.411498Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:58.411506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:58.411541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:58.411571Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533928331204271:12044]
2025-10-02T08:10:58.412032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:58.412193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:58.412239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:58.412433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:58.412461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.412466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.412466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.412467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.412467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.412470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.412477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.412479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.412481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.412483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.412487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.412491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.412495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.412498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.412501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.412503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.412505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.412509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.412511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.412513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.412524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:58.414434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62a362df-47a57734-80e7acdc-e7d7a374_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.414417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:58.414428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1035
2025-10-02T08:10:58.414734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.414788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:58.414798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:58.414802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:58.415253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1035 sessionId:  describe result for acl check
2025-10-02T08:10:58.415294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:58.415300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:58.415302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:58.415308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533928331204288:12046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:58.415861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533928331204288:12046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:58.418166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533928331204288:12046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:58.420542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:58.421134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533928331204288:12046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:58.421139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533928331204288:12046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:58.421142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533928331204288:12046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:58.421149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:58.422318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:58.422333Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:58.422335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:58.422338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:58.422343Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1034 [1:7556533928331204271:12044]
2025-10-02T08:10:58.422352Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:58.422368Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:58.422371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.422375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.422377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.422396Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:58.422403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:58.422411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:58.422485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.422496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.422500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:58.422502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:58.422620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1034
2025-10-02T08:10:58.422707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:58.422718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.422734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.422708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1034
2025-10-02T08:10:58.422746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:58.422773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331204319:12046], now have 1 active actors on pipe
2025-10-02T08:10:58.422783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533928791243573:2378], now have 1 active actors on pipe
2025-10-02T08:10:58.422789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.422792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.422815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533928331204265:12044]
2025-10-02T08:10:58.422821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533928331204265:12044]
2025-10-02T08:10:58.422832Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:58.422843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:58.422850Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:58.422853Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:58.422858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:58.422860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:58.422876Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|528689ee-1d83f20-7dac5493-6218e5b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:58.422886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.422889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.422891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:58.422899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.422907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:58.422939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533928331204265:12044]
2025-10-02T08:10:58.422949Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:58.422958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.422961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:58.423217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.423227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.423245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.423282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1035 partition: 0 MaxSeqNo: 17 sessionId: src_id|528689ee-1d83f20-7dac5493-6218e5b1_0
2025-10-02T08:10:58.423605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62a362df-47a57734-80e7acdc-e7d7a374_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|528689ee-1d83f20-7dac5493-6218e5b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:58.426653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|528689ee-1d83f20-7dac5493-6218e5b1_0] Write session: try to update token
2025-10-02T08:10:58.426671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|528689ee-1d83f20-7dac5493-6218e5b1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:58.433887Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:58.433908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.433921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533928331204265:12044]
2025-10-02T08:10:58.433963Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:58.433977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:58.434173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:58.434348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.434519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.434682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.434918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:58.434967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:58.442400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId: src_id|528689ee-1d83f20-7dac5493-6218e5b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:58.445711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:58.445804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.445820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.445870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:58.445893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:58.445972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.445990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.446212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.446296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.446381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.446462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.446717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.446731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.446821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.446908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.446987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.447251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.447315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.447326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.447409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.447502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.447583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.447668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.447737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.447758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.447840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.447917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.448002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.448084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.448143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.448151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.448230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.448302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.448379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.448459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.448520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.448528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.448609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.448683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.448759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.448867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.449033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.449054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.449142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.449216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.449289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.449366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.449416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.449428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.449503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.449571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.449639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.449714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.449762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.449769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.449835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.449899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.449971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.450039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.450089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.450097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.450170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.450227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.450287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.450347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.450395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.450403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.450467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:58.450529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.450547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.450553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:58.450579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:58.450592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:58.450598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:58.450600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:58.450602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:58.450991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:58.451022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:58.451028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:58.451033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:58.451041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:58.451044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:58.451708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:58.451731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:58.451736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:58.451738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:58.451740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:58.451744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:58.452211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:58.452254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:58.452263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:58.452266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:58.452268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:58.453506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:58.453529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:58.453540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392658453
2025-10-02T08:10:58.453659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:58.453673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:58.453678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:58.453682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:58.453686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:58.453689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:58.454174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:58.454199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:58.454204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:58.454210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:58.454213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:58.454216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:58.454694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:58.454716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:58.454726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:58.454733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:58.454738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:58.454741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:58.455183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:58.455204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:58.455209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:58.456273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:58.456290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:58.456294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:58.456297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:58.456303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392658455
2025-10-02T08:10:58.456578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:58.456595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:58.456599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:58.456601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:58.456603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:58.456606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:58.457102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:58.457125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:58.457132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:58.457136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:58.457139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:58.457145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:58.457635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:58.457658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.457757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392658457
2025-10-02T08:10:58.460181Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:58.460209Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:58.460216Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:58.460222Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:58.460233Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:58.460241Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.460243Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:58.460250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533928331204265:12044]
2025-10-02T08:10:58.460254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533928331204265:12044]
2025-10-02T08:10:58.460301Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:58.460316Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:58.460326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:58.460335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.460337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:58.460476Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:58.504028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533928331204339:11760]
2025-10-02T08:10:58.504138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1034, pipe: [1:7556533928331204339:11760]
2025-10-02T08:10:58.604254Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:58.604616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331204339:11760], now have 1 active actors on pipe
2025-10-02T08:10:58.604779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:58.604791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:58.604814Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:58.604840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1035 reason: error at write: Disconnected sessionId: src_id|528689ee-1d83f20-7dac5493-6218e5b1_0
2025-10-02T08:10:58.604929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:58.605027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1035 sessionId: src_id|528689ee-1d83f20-7dac5493-6218e5b1_0 is DEAD
2025-10-02T08:10:58.605062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533928331204339:11760]
2025-10-02T08:10:58.605292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528689ee-1d83f20-7dac5493-6218e5b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:58.605301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528689ee-1d83f20-7dac5493-6218e5b1_0] Write session will restart in 0.007351s
2025-10-02T08:10:58.605320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528689ee-1d83f20-7dac5493-6218e5b1_0] Write session: Do CDS request
2025-10-02T08:10:58.605325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528689ee-1d83f20-7dac5493-6218e5b1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:58.614379Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0a9800ac53214bd9] Result# TEvPutResult {Id# [72075186224037892:1034:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:58.614430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|528689ee-1d83f20-7dac5493-6218e5b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.614795Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1034:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:58.614796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:58.614803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1036
2025-10-02T08:10:58.614961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.615009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:58.615022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:58.615027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:58.615316Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1034:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:58.615567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1036 sessionId:  describe result for acl check
2025-10-02T08:10:58.615615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:58.615624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:58.615626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:58.615634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533928331204455:12051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:58.616309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533928331204455:12051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:58.620917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533928331204455:12051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:58.623553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:58.624226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:58.624405Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:58.624418Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:58.624429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:58.624479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:58.624524Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533928331204565:12050]
2025-10-02T08:10:58.624531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533928331204455:12051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:58.624539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533928331204455:12051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:58.624542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533928331204455:12051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:58.624550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:58.625143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:58.625431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:58.625481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:58.625775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:58.625834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.625840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.625841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.625842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.625843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.625847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.625856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.625860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.625864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.625868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.625873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.625880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.625886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.625891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.625896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.625901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.625905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.625909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.625914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.625920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.625939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:58.642078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:58.643685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:58.643707Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:58.643710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:58.643714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:58.643721Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1035 [1:7556533928331204565:12050]
2025-10-02T08:10:58.643735Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:58.643769Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:58.643772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.643775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.643777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.643795Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:58.643803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:58.643816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:58.643884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.643892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.643895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:58.643898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:58.643976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:58.643984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.643998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.644012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:58.644031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533928331204559:12050]
2025-10-02T08:10:58.644038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533928331204559:12050]
2025-10-02T08:10:58.644047Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:58.644063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:58.644080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:58.644087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:58.644089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:58.644094Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:58.644103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1035
2025-10-02T08:10:58.644123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331204570:12051], now have 1 active actors on pipe
2025-10-02T08:10:58.644131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533928331204559:12050]
2025-10-02T08:10:58.644135Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:58.644312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:58.644331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.644336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.644352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533928791243582:2378], now have 1 active actors on pipe
2025-10-02T08:10:58.644375Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:58.644386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.644394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.644396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:58.644405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.644418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:58.644436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.644617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.644627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.644643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.644682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1036 partition: 0 MaxSeqNo: 17 sessionId: src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0
2025-10-02T08:10:58.644827Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1035
2025-10-02T08:10:58.645103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528689ee-1d83f20-7dac5493-6218e5b1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:58.648755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0] Write session: try to update token
2025-10-02T08:10:58.648782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:58.680865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId: src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:58.684369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:58.684884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.684902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.684943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:58.684969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:58.688920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.688950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.689211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.689293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.689392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.689473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.689534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.689539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.689635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.689710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.689788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.689868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.689922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.689929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.690024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.690095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.690168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.690257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.690310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.690318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.690403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.690478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.690550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.690624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.690682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.690685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.690772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.690845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.690924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.691001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.691293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.691297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.691384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.691459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.691537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.691616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.691671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.691674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.691780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.691853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.691942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.692026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.692087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.692090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.692176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.692251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.692330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.692407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.692461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.692465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.692548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.692633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.692708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.692786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.693121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.693132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.693220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.693294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.693376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.693462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.693524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.693528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.693616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:58.693696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.693726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.693731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:58.693773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:58.693791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:58.693794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:58.693798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:58.693802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:58.694296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:58.694315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:58.694323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:58.694327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:58.694331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:58.694334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:58.694899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:58.694912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:58.694918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:58.694922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:58.694926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:58.694935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:58.695638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:58.695653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:58.695659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:58.695664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:58.695668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:58.697616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:58.697642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:58.697656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392658697
2025-10-02T08:10:58.697803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:58.697813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:58.697819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:58.697822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:58.697829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:58.697833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:58.698441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:58.698460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:58.698465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:58.698469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:58.698476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:58.698480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:58.699097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:58.699109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:58.699116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:58.699120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:58.699125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:58.699128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:58.699743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:58.699770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:58.699776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:58.701589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:58.701614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:58.701623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:58.701627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:58.701640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392658701
2025-10-02T08:10:58.702022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:58.702035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:58.702041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:58.702046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:58.702051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:58.702055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:58.702786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:58.702806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:58.702814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:58.702818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:58.702827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:58.702831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:58.703477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:58.703490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.703627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392658703
2025-10-02T08:10:58.706705Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:58.706747Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:58.706757Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:58.706766Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:58.706782Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:58.706786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.706789Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:58.706799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533928331204559:12050]
2025-10-02T08:10:58.706805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533928331204559:12050]
2025-10-02T08:10:58.707612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533928331204597:11760]
2025-10-02T08:10:58.708871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:58.708879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:58.709163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1035, pipe: [1:7556533928331204597:11760]
2025-10-02T08:10:58.713960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:58.713986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.713990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:58.714205Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:58.860761Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:58.861282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331204597:11760], now have 1 active actors on pipe
2025-10-02T08:10:58.861304Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:58.861313Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.861327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533928331204559:12050]
2025-10-02T08:10:58.861410Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:58.861659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:58.861678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:58.861712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1036 reason: error at write: Disconnected sessionId: src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0
2025-10-02T08:10:58.861739Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:58.861716Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:58.861877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1036 sessionId: src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0 is DEAD
2025-10-02T08:10:58.862031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:58.862043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0] Write session will restart in 0.006892s
2025-10-02T08:10:58.862071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0] Write session: Do CDS request
2025-10-02T08:10:58.862078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:58.862087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533928331204597:11760]
2025-10-02T08:10:58.867002Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7a617631f5fa032f] Result# TEvPutResult {Id# [72075186224037892:1035:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:10:58.867063Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1035:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:58.867131Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1035:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:10:58.870389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.870772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:58.870791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1037
2025-10-02T08:10:58.870946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:58.870979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:58.870998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:58.871006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:58.871401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1037 sessionId:  describe result for acl check
2025-10-02T08:10:58.871450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:58.871458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:58.871460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:58.871466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533928331204748:12058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:58.872079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533928331204748:12058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:58.874573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:58.875105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533928331204748:12058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:58.875448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:58.875627Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:58.875637Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:58.875648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:58.875688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:58.875727Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533928331204819:12057]
2025-10-02T08:10:58.876463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:58.876635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:58.876674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:58.877047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:58.877181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.877188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.877189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.877189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.877190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.877194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.877213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.877217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.877221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.877224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.877231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.877238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:58.877242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.877244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:58.877247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.877250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:58.877252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.877255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.877258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.877261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.877272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:58.878093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533928331204748:12058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:58.878107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533928331204748:12058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:58.878110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533928331204748:12058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:58.878117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:58.886320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:58.888345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:58.888363Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:58.888364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:58.888371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:58.888376Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1036 [1:7556533928331204819:12057]
2025-10-02T08:10:58.888386Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:58.888405Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:58.888409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.888412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.888414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.888432Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:58.888444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:58.888456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:58.888525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.888532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.888536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:58.888540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:58.888611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:58.888619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.888633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:58.888651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:58.888661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1036
2025-10-02T08:10:58.888673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331204840:12058], now have 1 active actors on pipe
2025-10-02T08:10:58.888677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533928791243601:2378], now have 1 active actors on pipe
2025-10-02T08:10:58.888685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533928331204807:12057]
2025-10-02T08:10:58.888687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533928331204807:12057]
2025-10-02T08:10:58.888701Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:58.888712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.888724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.888729Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:58.888738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:58.888744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:58.888763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:58.888771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:58.888838Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:58.888850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.888776Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1036
2025-10-02T08:10:58.888854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.888860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:58.888871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.888885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:58.888896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533928331204807:12057]
2025-10-02T08:10:58.888907Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:58.888926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:58.888944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.889047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.889054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.889069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:58.889112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1037 partition: 0 MaxSeqNo: 17 sessionId: src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0
2025-10-02T08:10:58.889554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a20b24-9d92e31b-c6aa41e2-566d481d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:58.892954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0] Write session: try to update token
2025-10-02T08:10:58.892973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:58.900525Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:10:58.900547Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.900557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533928331204807:12057]
2025-10-02T08:10:58.900602Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:10:58.900604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:10:58.900790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:10:58.900972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.901124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.901279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:10:58.901505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:10:58.901549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:10:58.909087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId: src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:58.912013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:58.912076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.912091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.912134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:10:58.912156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:58.912217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:58.912222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:58.912382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.912449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.912515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.912585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.912640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.912647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.912722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.912785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.912881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.912957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.913011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.913017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.913091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.913162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.913240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.913307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.913355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.913361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.913431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.913501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.913564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.913630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.913680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.913685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.913752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.913817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.913881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.913945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.913991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.914002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.914079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.914141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.914212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.914290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.914340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.914345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.914415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.914477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.914568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.914641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.914692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.914697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.914769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.914838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.914908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.914980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.915037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.915046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.915124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.915192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.915267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.915348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.915403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.915410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.915484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:10:58.915554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:10:58.915627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:10:58.915697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:10:58.915764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:10:58.915770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:10:58.915814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:10:58.915882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:58.915902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:58.915907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:10:58.915942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:10:58.915960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:10:58.915965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:10:58.915967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:10:58.915968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:10:58.916369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:10:58.916392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:10:58.916401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:10:58.916407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:10:58.916409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:10:58.916412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:10:58.917035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:10:58.917055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:10:58.917060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:10:58.917062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:10:58.917065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:10:58.917068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:10:58.917736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:10:58.917759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:10:58.917764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:10:58.917766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:10:58.917768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:10:58.919038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:10:58.919058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:10:58.919070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392658918
2025-10-02T08:10:58.919186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:10:58.919198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:10:58.919201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:10:58.919204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:10:58.919207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:10:58.919213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:10:58.919705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:10:58.919723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:10:58.919727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:10:58.919729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:10:58.919732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:10:58.919734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:10:58.920218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:10:58.920236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:10:58.920242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:10:58.920244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:10:58.920247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:10:58.920249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:10:58.920746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:10:58.920766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:10:58.920771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:10:58.922026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:10:58.922044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:10:58.922050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:10:58.922053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:10:58.922059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392658921
2025-10-02T08:10:58.922331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:10:58.922348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:10:58.922352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:10:58.922355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:10:58.922357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:10:58.922360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:10:58.922821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:10:58.922839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:10:58.922844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:10:58.922847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:10:58.922849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:10:58.922852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:10:58.923306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:10:58.923323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:58.923411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392658923
2025-10-02T08:10:58.924214Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:10:58.924230Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:10:58.924234Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:10:58.924238Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:10:58.926120Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:58.926131Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:58.926133Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:58.926145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533928331204807:12057]
2025-10-02T08:10:58.926148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533928331204807:12057]
2025-10-02T08:10:58.926219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:58.926222Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:58.926231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:58.926231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:58.926234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:58.926389Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:58.962273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533928331204874:11760]
2025-10-02T08:10:58.962415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1036, pipe: [1:7556533928331204874:11760]
2025-10-02T08:10:59.069264Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:59.069770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533928331204874:11760], now have 1 active actors on pipe
2025-10-02T08:10:59.069957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533928331204874:11760]
2025-10-02T08:10:59.069998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:59.070010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:59.070042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1037 reason: error at write: Disconnected sessionId: src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0
2025-10-02T08:10:59.070079Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:59.070112Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:59.070245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1037 sessionId: src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0 is DEAD
2025-10-02T08:10:59.070410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:59.070423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0] Write session will restart in 0.007995s
2025-10-02T08:10:59.070449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0] Write session: Do CDS request
2025-10-02T08:10:59.070457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:59.078909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:59.079429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.079514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:59.079525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1038
2025-10-02T08:10:59.079671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.079704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:59.079714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:59.079718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:59.080146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:59.080149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1038 sessionId:  describe result for acl check
2025-10-02T08:10:59.080185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:59.080196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:59.080198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:59.080205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533932626172365:12067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:59.080442Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:59.080469Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:59.080500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:59.080650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533932626172365:12067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:59.080673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:59.080733Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533932626172367:12064]
2025-10-02T08:10:59.081361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:59.081607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:59.081660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:59.081942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:59.081985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.081989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.081990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.081991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.081991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.081996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.082003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.082005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.082007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.082009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.082013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.082018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.082022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.082025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.082028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.082031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.082033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.082036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.082039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.082042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.082054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:59.082536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533932626172365:12067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:59.089470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533932626172365:12067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:59.089494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533932626172365:12067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:59.089498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533932626172365:12067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:59.089507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:59.090389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:59.092165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:59.092187Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:59.092190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:59.092195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:59.092204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1037 [1:7556533932626172367:12064]
2025-10-02T08:10:59.092219Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:59.092240Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:59.092243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.092247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.092249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.092270Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:59.092277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:59.092285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:59.092360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.092374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.092378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:59.092381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:59.092468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:59.092477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.092493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.092511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:59.092538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533932626172356:12064]
2025-10-02T08:10:59.092545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533932626172356:12064]
2025-10-02T08:10:59.092547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1037
2025-10-02T08:10:59.092554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:59.092570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626172411:12067], now have 1 active actors on pipe
2025-10-02T08:10:59.092585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:59.092605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:59.092613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:59.092621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533933086210907:2378], now have 1 active actors on pipe
2025-10-02T08:10:59.092631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.092636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.092683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533932626172356:12064]
2025-10-02T08:10:59.092689Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:59.092705Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:59.092715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.092719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.092721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:59.092728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:59.092729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.092738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:59.092739Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:59.092745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:59.092764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.092797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.092820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.092835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.092869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1038 partition: 0 MaxSeqNo: 17 sessionId: src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0
2025-10-02T08:10:59.093281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ef7611-9af9a468-a01fa52e-e78a1e48_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:59.093567Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1037
2025-10-02T08:10:59.096453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0] Write session: try to update token
2025-10-02T08:10:59.096468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:59.113874Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:59.113904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:59.113907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:59.113920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533932626172356:12064]
2025-10-02T08:10:59.113933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533932626172356:12064]
2025-10-02T08:10:59.113983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:59.113988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:59.113992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.113995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:59.113995Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:59.114158Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:59.117728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId: src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:59.121009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:59.170139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533932626172425:11760]
2025-10-02T08:10:59.170327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1037, pipe: [1:7556533932626172425:11760]
2025-10-02T08:10:59.270127Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:59.271108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.271133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.271180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626172425:11760], now have 1 active actors on pipe
2025-10-02T08:10:59.271359Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:59.271747Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:59.272115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533932626172425:11760]
2025-10-02T08:10:59.272147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:10:59.272212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1038 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0
2025-10-02T08:10:59.272437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1038 sessionId: src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0 is DEAD
2025-10-02T08:10:59.273033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:10:59.273046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0] Write session will restart in 0.009160s
2025-10-02T08:10:59.273086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0] Write session: Do CDS request
2025-10-02T08:10:59.273094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:59.281537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:59.283175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:59.283370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.283381Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:59.283393Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:59.283404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:59.283454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:59.283496Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533932626172657:12079]
2025-10-02T08:10:59.283501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:59.283508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1039
2025-10-02T08:10:59.283692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.283723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:59.283727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:59.283729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:59.284057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1039 sessionId:  describe result for acl check
2025-10-02T08:10:59.284085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:59.284091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:59.284093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:59.284097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533932626172663:12085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:59.284197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:59.284460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:59.284495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533932626172663:12085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:59.284511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:59.284848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:59.284901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.284907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.284908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.284909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.284911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.284915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.284925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.284929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.284932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.284935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.284941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.284948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.284955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.284959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.284963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.284968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.284972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.284976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.284980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.284985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.285005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:59.286890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533932626172663:12085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:59.294242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533932626172663:12085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:59.294258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533932626172663:12085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:59.294261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533932626172663:12085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:59.294268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:59.295043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:59.302661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:59.302693Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:59.302710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:59.302716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:59.302752Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1038 [1:7556533932626172657:12079]
2025-10-02T08:10:59.302769Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:59.302795Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:59.302798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.302801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.302803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.302834Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:59.302839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:59.302847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:59.303006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.303017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.303020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:59.303023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:59.303107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:59.303117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.303134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.303152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:59.303176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533933086210934:2378], now have 1 active actors on pipe
2025-10-02T08:10:59.303190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533932626172651:12079]
2025-10-02T08:10:59.303193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533932626172651:12079]
2025-10-02T08:10:59.303204Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:59.303213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1038
2025-10-02T08:10:59.303215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626172702:12085], now have 1 active actors on pipe
2025-10-02T08:10:59.303223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:59.303225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:59.303230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:59.303238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:59.303242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:59.303282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.303293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.303306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533932626172651:12079]
2025-10-02T08:10:59.303324Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:59.303330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:59.303359Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:59.303372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.303382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.303383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:59.303393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.303401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:59.303326Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1038
2025-10-02T08:10:59.303435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.303504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.303518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.303545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.303595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1039 partition: 0 MaxSeqNo: 17 sessionId: src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0
2025-10-02T08:10:59.304170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc16e3a5-90ca8fef-4a392fdd-b13b89d8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:59.311398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0] Write session: try to update token
2025-10-02T08:10:59.311416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:59.322020Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:59.322040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:59.322042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:59.322053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533932626172651:12079]
2025-10-02T08:10:59.322060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533932626172651:12079]
2025-10-02T08:10:59.322106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:59.322115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.322117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:59.322117Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:59.322122Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:59.322292Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:59.337730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId: src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:59.340232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:59.373413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533932626172716:11760]
2025-10-02T08:10:59.373576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1038, pipe: [1:7556533932626172716:11760]
2025-10-02T08:10:59.461855Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:59.462603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.462617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.462637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626172716:11760], now have 1 active actors on pipe
2025-10-02T08:10:59.462736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:59.462743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:59.462796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1039 reason: error at write: Disconnected sessionId: src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0
2025-10-02T08:10:59.462864Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:59.462936Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:59.462956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1039 sessionId: src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0 is DEAD
2025-10-02T08:10:59.463124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533932626172716:11760]
2025-10-02T08:10:59.463200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:59.463212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0] Write session will restart in 0.009237s
2025-10-02T08:10:59.463238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0] Write session: Do CDS request
2025-10-02T08:10:59.463244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:59.473480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.473551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:59.473566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1040
2025-10-02T08:10:59.473757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.473792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:59.473801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:59.473805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:59.474349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1040 sessionId:  describe result for acl check
2025-10-02T08:10:59.474398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:59.474399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:59.474401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:59.474406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533932626172912:12093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:59.474867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533932626172912:12093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:59.475139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:59.475709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:59.475916Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:59.475928Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:59.475936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:59.475973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:59.476012Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533932626172928:12091]
2025-10-02T08:10:59.476469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:59.476674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:59.476721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:59.477042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:59.477086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.477092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.477093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.477094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.477095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.477101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.477110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.477114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.477118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.477121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.477126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.477133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.477139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.477143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.477148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.477158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.477162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.477167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.477171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.477176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.477196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:59.477709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533932626172912:12093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:59.484197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533932626172912:12093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:59.484217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533932626172912:12093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:59.484221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533932626172912:12093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:59.484230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:59.486412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:59.488568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:59.488584Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:59.488586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:59.488589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:59.488595Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1039 [1:7556533932626172928:12091]
2025-10-02T08:10:59.488603Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:59.488618Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:59.488620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.488622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.488623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.488637Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:59.488641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:59.488647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:59.488700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.488708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.488711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:59.488712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:59.488763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:59.488769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.488779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.488786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:59.488818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533932626172911:12091]
2025-10-02T08:10:59.488822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533932626172911:12091]
2025-10-02T08:10:59.488829Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:59.488842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:59.488859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:59.488860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1039
2025-10-02T08:10:59.488866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:59.488867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:59.488873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:59.488877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626172966:12093], now have 1 active actors on pipe
2025-10-02T08:10:59.488906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533933086210942:2378], now have 1 active actors on pipe
2025-10-02T08:10:59.488912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533932626172911:12091]
2025-10-02T08:10:59.488914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:59.488919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.488921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:59.488922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.488955Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e041866-c601b341-d3d639f8-d9b62041_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:59.488963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.488966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.488968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:59.488975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.488984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:59.489009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.489002Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1039
2025-10-02T08:10:59.489112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.489121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.489138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.489176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1040 partition: 0 MaxSeqNo: 17 sessionId: src_id|1e041866-c601b341-d3d639f8-d9b62041_0
2025-10-02T08:10:59.489591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dbb1bf-ddef15b5-34d7cd3c-6a238a3b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1e041866-c601b341-d3d639f8-d9b62041_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:59.492970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e041866-c601b341-d3d639f8-d9b62041_0] Write session: try to update token
2025-10-02T08:10:59.492990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e041866-c601b341-d3d639f8-d9b62041_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:59.509385Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:59.509403Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:59.509405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:59.509413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533932626172911:12091]
2025-10-02T08:10:59.509418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533932626172911:12091]
2025-10-02T08:10:59.509462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:59.509470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.509472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:59.509489Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:59.509498Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:59.509621Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:59.513235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId: src_id|1e041866-c601b341-d3d639f8-d9b62041_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:59.516270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:59.563367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533932626172981:11760]
2025-10-02T08:10:59.563552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1039, pipe: [1:7556533932626172981:11760]
2025-10-02T08:10:59.651769Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:59.652020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.652032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.652067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626172981:11760], now have 1 active actors on pipe
2025-10-02T08:10:59.652228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:59.652257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:59.652257Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:59.652329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1040 reason: error at write: Disconnected sessionId: src_id|1e041866-c601b341-d3d639f8-d9b62041_0
2025-10-02T08:10:59.652399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:59.652534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533932626172981:11760]
2025-10-02T08:10:59.652537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1040 sessionId: src_id|1e041866-c601b341-d3d639f8-d9b62041_0 is DEAD
2025-10-02T08:10:59.652746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e041866-c601b341-d3d639f8-d9b62041_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:59.652759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e041866-c601b341-d3d639f8-d9b62041_0] Write session will restart in 0.006596s
2025-10-02T08:10:59.652790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e041866-c601b341-d3d639f8-d9b62041_0] Write session: Do CDS request
2025-10-02T08:10:59.652796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e041866-c601b341-d3d639f8-d9b62041_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:59.660385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e041866-c601b341-d3d639f8-d9b62041_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.660432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:59.660452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1041
2025-10-02T08:10:59.660605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.660631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:59.660646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:59.660649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:59.661030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1041 sessionId:  describe result for acl check
2025-10-02T08:10:59.661059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:59.661065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:59.661067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:59.661071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533932626173166:12099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:59.661560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533932626173166:12099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:59.662747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:59.663900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:59.664208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533932626173166:12099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:59.664270Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:59.664284Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:59.664297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:59.664360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:59.664407Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533932626173202:12098]
2025-10-02T08:10:59.665153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:59.665390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:59.665445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:59.665721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:59.665762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.665762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.665763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.665764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.665765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.665769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.665777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.665779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.665782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.665784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.665788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.665793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.665800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.665802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.665805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.665808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.665811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.665814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.665816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.665819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.665831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:59.671085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533932626173166:12099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:59.671109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533932626173166:12099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:59.671113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533932626173166:12099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:59.671123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:59.674814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:59.676647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:59.676665Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:59.676668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:59.676671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:59.676676Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1040 [1:7556533932626173202:12098]
2025-10-02T08:10:59.676685Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:59.676699Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:59.676701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.676703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.676705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.676718Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:59.676721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:59.676727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:59.676816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.676818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.676825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:59.676828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:59.676895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:59.676907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.676916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.676923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:59.676936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533932626173187:12098]
2025-10-02T08:10:59.676938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533932626173187:12098]
2025-10-02T08:10:59.676946Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:59.676955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:59.676964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:59.676965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:59.676973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626173229:12099], now have 1 active actors on pipe
2025-10-02T08:10:59.676982Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:59.676987Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:59.676991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1040
2025-10-02T08:10:59.677001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533933086210950:2378], now have 1 active actors on pipe
2025-10-02T08:10:59.677003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533932626173187:12098]
2025-10-02T08:10:59.677006Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:59.677011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:59.677017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.677020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.677048Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68291c60-67262aec-93f55cb7-42e66a17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:59.677053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.677055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.677057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:59.677063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.677070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:59.677085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.677179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.677185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.677212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.677261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1041 partition: 0 MaxSeqNo: 17 sessionId: src_id|68291c60-67262aec-93f55cb7-42e66a17_0
2025-10-02T08:10:59.677310Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1040
2025-10-02T08:10:59.677612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e041866-c601b341-d3d639f8-d9b62041_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|68291c60-67262aec-93f55cb7-42e66a17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:59.680479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68291c60-67262aec-93f55cb7-42e66a17_0] Write session: try to update token
2025-10-02T08:10:59.680495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68291c60-67262aec-93f55cb7-42e66a17_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:59.698732Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:59.698755Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:59.698757Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:59.698767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533932626173187:12098]
2025-10-02T08:10:59.698772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533932626173187:12098]
2025-10-02T08:10:59.698815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:59.698822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.698822Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:59.698825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:59.698829Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:59.699020Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:59.699202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId: src_id|68291c60-67262aec-93f55cb7-42e66a17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:59.702173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:59.753452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533932626173245:11760]
2025-10-02T08:10:59.753735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1040, pipe: [1:7556533932626173245:11760]
2025-10-02T08:10:59.843854Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:10:59.844171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.844186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.844231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626173245:11760], now have 1 active actors on pipe
2025-10-02T08:10:59.844768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:10:59.844779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:10:59.844786Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:10:59.844843Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:10:59.844851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1041 reason: error at write: Disconnected sessionId: src_id|68291c60-67262aec-93f55cb7-42e66a17_0
2025-10-02T08:10:59.845022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1041 sessionId: src_id|68291c60-67262aec-93f55cb7-42e66a17_0 is DEAD
2025-10-02T08:10:59.845136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533932626173245:11760]
2025-10-02T08:10:59.845767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68291c60-67262aec-93f55cb7-42e66a17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:10:59.845784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68291c60-67262aec-93f55cb7-42e66a17_0] Write session will restart in 0.008774s
2025-10-02T08:10:59.845817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68291c60-67262aec-93f55cb7-42e66a17_0] Write session: Do CDS request
2025-10-02T08:10:59.845825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68291c60-67262aec-93f55cb7-42e66a17_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:10:59.856397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68291c60-67262aec-93f55cb7-42e66a17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.856754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:10:59.856772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1042
2025-10-02T08:10:59.857007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:10:59.857043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:10:59.857052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:10:59.857055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:10:59.857541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1042 sessionId:  describe result for acl check
2025-10-02T08:10:59.857576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:10:59.857583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:10:59.857584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:10:59.857589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533932626173426:12105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:10:59.858062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533932626173426:12105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:10:59.860119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:10:59.861216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:10:59.861391Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:10:59.861402Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:10:59.861413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:10:59.861460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:10:59.861490Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533932626173464:12104]
2025-10-02T08:10:59.862191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:10:59.862385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:10:59.862432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:10:59.862771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:10:59.862831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.862838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.862839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.862840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.862841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.862847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.862857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.862861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.862865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.862868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.862873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.862880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:10:59.862896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.862901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:10:59.862905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.862910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:10:59.862914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.862918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.862922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.862927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.862946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:10:59.863320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533932626173426:12105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:10:59.869535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533932626173426:12105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:10:59.869556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533932626173426:12105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:10:59.869559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533932626173426:12105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:10:59.869568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:10:59.871940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:10:59.873748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:10:59.873767Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:10:59.873770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:10:59.873774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:10:59.873781Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1041 [1:7556533932626173464:12104]
2025-10-02T08:10:59.873794Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:10:59.873811Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:10:59.873814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.873818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.873821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.873840Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:10:59.873845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:10:59.873852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:10:59.873925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.873932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.873935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:10:59.873937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:10:59.874008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:10:59.874017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.874033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:10:59.874045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:10:59.874066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626173490:12105], now have 1 active actors on pipe
2025-10-02T08:10:59.874075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1041
2025-10-02T08:10:59.874079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533932626173458:12104]
2025-10-02T08:10:59.874081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533932626173458:12104]
2025-10-02T08:10:59.874089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:10:59.874101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:10:59.874102Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:10:59.874105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:10:59.874120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:10:59.874126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:10:59.874132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533933086210969:2378], now have 1 active actors on pipe
2025-10-02T08:10:59.874136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.874140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.874184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533932626173458:12104]
2025-10-02T08:10:59.874192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:10:59.874206Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:10:59.874212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:10:59.874176Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1041
2025-10-02T08:10:59.874212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:10:59.874218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:10:59.874220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:10:59.874231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:10:59.874239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:10:59.874289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.874365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:10:59.874372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:10:59.874385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:10:59.874422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1042 partition: 0 MaxSeqNo: 17 sessionId: src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0
2025-10-02T08:10:59.874813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68291c60-67262aec-93f55cb7-42e66a17_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:10:59.878271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0] Write session: try to update token
2025-10-02T08:10:59.878297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:10:59.899078Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:10:59.899101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:10:59.899104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:10:59.899113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533932626173458:12104]
2025-10-02T08:10:59.899119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533932626173458:12104]
2025-10-02T08:10:59.899156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:10:59.899166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:10:59.899168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:10:59.899175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:10:59.899181Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:10:59.899520Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:10:59.904267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId: src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:10:59.907169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:10:59.944826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533932626173518:11760]
2025-10-02T08:10:59.945083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1041, pipe: [1:7556533932626173518:11760]
2025-10-02T08:11:00.049601Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:00.049969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.049982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.050027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533932626173518:11760], now have 1 active actors on pipe
2025-10-02T08:11:00.050147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533932626173518:11760]
2025-10-02T08:11:00.050170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:00.050173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:00.050228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1042 reason: error at write: Disconnected sessionId: src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0
2025-10-02T08:11:00.050304Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:00.050410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1042 sessionId: src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0 is DEAD
2025-10-02T08:11:00.050815Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:00.052194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:00.052213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0] Write session will restart in 0.007089s
2025-10-02T08:11:00.052248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0] Write session: Do CDS request
2025-10-02T08:11:00.052257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:00.058601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:00.059682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:00.059932Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:00.059945Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:00.059957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:00.060034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:00.060089Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533936921141016:12111]
2025-10-02T08:11:00.060469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.060529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:00.060544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1043
2025-10-02T08:11:00.060715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.060758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:00.060762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:00.060768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:00.060772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:00.061002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:00.061062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:00.061141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1043 sessionId:  describe result for acl check
2025-10-02T08:11:00.061172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:00.061179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:00.061180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:00.061185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533936921141027:12113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:00.061470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:00.061534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.061540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.061541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.061543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.061544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.061550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.061559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.061562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.061565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.061568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.061574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.061581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.061587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.061591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.061595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.061600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.061604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.061609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.061613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.061618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.061637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:00.061674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533936921141027:12113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:00.063662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533936921141027:12113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:00.069902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533936921141027:12113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:00.069923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533936921141027:12113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:00.069927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533936921141027:12113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:00.069950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:00.070387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:00.072126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:00.072145Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:00.072147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:00.072151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:00.072157Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1042 [1:7556533936921141016:12111]
2025-10-02T08:11:00.072169Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:00.072192Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:00.072202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.072205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.072207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.072223Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:00.072229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:00.072235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:00.072297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.072304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.072308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:00.072310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:00.072380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:00.072387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.072400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.072417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:00.072419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1042
2025-10-02T08:11:00.072440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921141063:12113], now have 1 active actors on pipe
2025-10-02T08:11:00.072449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533937381178275:2378], now have 1 active actors on pipe
2025-10-02T08:11:00.072454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.072458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.072476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533936921141010:12111]
2025-10-02T08:11:00.072478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533936921141010:12111]
2025-10-02T08:11:00.072489Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:00.072502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:00.072503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:00.072505Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:00.072518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:00.072521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:00.072536Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:00.072547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.072521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1042
2025-10-02T08:11:00.072551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.072557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:00.072565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.072574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:00.072610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533936921141010:12111]
2025-10-02T08:11:00.072622Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:00.072628Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:00.072639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.072701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.072714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.072738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.072780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1043 partition: 0 MaxSeqNo: 17 sessionId: src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0
2025-10-02T08:11:00.077392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5259c2ad-87cacf01-93b5d9aa-e02adefe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:00.081109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0] Write session: try to update token
2025-10-02T08:11:00.081137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:00.092090Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:00.092111Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:00.092114Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:00.092124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533936921141010:12111]
2025-10-02T08:11:00.092129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533936921141010:12111]
2025-10-02T08:11:00.092173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:00.092175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:00.092186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.092188Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:00.092189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:00.092387Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:00.102564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId: src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:00.105215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:00.150116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533936921141079:11760]
2025-10-02T08:11:00.150242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1042, pipe: [1:7556533936921141079:11760]
2025-10-02T08:11:00.233969Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:00.234417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.234430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.234448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921141079:11760], now have 1 active actors on pipe
2025-10-02T08:11:00.234578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:00.234592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:00.234655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1043 reason: error at write: Disconnected sessionId: src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0
2025-10-02T08:11:00.235015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:00.235025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0] Write session will restart in 0.005572s
2025-10-02T08:11:00.235051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0] Write session: Do CDS request
2025-10-02T08:11:00.235057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:00.234864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1043 sessionId: src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0 is DEAD
2025-10-02T08:11:00.234888Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:00.235050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533936921141079:11760]
2025-10-02T08:11:00.234654Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:00.241374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.241889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:00.241906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1044
2025-10-02T08:11:00.242114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.242152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:00.242161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:00.242166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:00.242748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1044 sessionId:  describe result for acl check
2025-10-02T08:11:00.242781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:00.242785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:00.242787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:00.242791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533936921141221:12119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:00.243288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533936921141221:12119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:00.245986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533936921141221:12119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:00.246272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:00.247708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:00.247908Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:00.247919Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:00.247931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:00.247990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:00.248031Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533936921141313:12118]
2025-10-02T08:11:00.248620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:00.248847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:00.248899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:00.249197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:00.249267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.249277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.249278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.249279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.249280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.249286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.249297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.249300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.249304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.249311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.249317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.249324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.249330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.249334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.249339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.249343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.249349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.249353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.249357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.249362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.249381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:00.249840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533936921141221:12119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:00.249855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533936921141221:12119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:00.249858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533936921141221:12119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:00.249867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:00.257898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:00.259605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:00.259620Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:00.259622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:00.259626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:00.259632Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1043 [1:7556533936921141313:12118]
2025-10-02T08:11:00.259645Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:00.259660Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:00.259667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.259669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.259671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.259683Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:00.259690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:00.259695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:00.259748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.259753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.259765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:00.259768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:00.259818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:00.259823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.259831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.259838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:00.259850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533936921141297:12118]
2025-10-02T08:11:00.259855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533936921141297:12118]
2025-10-02T08:11:00.259860Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:00.259869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:00.259885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:00.259887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:00.259894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921141331:12119], now have 1 active actors on pipe
2025-10-02T08:11:00.259904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1043
2025-10-02T08:11:00.259905Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:00.259909Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:00.259926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533936921141297:12118]
2025-10-02T08:11:00.259929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:00.259932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:00.259934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533937381178281:2378], now have 1 active actors on pipe
2025-10-02T08:11:00.259938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.259940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.259977Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:00.259986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.259989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.259990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:00.259997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.260005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:00.260023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.260001Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1043
2025-10-02T08:11:00.260077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.260082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.260091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.260119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1044 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0
2025-10-02T08:11:00.260438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fac653-14756dcc-3ecdfb43-22bd170e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:00.263190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0] Write session: try to update token
2025-10-02T08:11:00.263205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:00.278018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId: src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:00.278361Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:00.278365Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:00.278367Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:00.278377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533936921141297:12118]
2025-10-02T08:11:00.278381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533936921141297:12118]
2025-10-02T08:11:00.278431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:00.278437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.278439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:00.278507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:00.278514Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:00.278661Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:00.281326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:00.335441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533936921141380:11760]
2025-10-02T08:11:00.335591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1043, pipe: [1:7556533936921141380:11760]
2025-10-02T08:11:00.417607Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:00.417916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.417930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.417971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921141380:11760], now have 1 active actors on pipe
2025-10-02T08:11:00.418108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533936921141380:11760]
2025-10-02T08:11:00.418137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:00.418144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:00.418203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1044 reason: error at write: Disconnected sessionId: src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0
2025-10-02T08:11:00.418211Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:00.418255Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:00.418383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1044 sessionId: src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0 is DEAD
2025-10-02T08:11:00.418545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:00.418554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0] Write session will restart in 0.008181s
2025-10-02T08:11:00.418578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0] Write session: Do CDS request
2025-10-02T08:11:00.418584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:00.427504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:00.428473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.428581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:00.428595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1045
2025-10-02T08:11:00.428596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:00.428741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.428771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:00.428781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:00.428785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:00.428786Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:00.428791Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:00.428819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:00.428888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:00.428929Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533936921141587:12136]
2025-10-02T08:11:00.429339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1045 sessionId:  describe result for acl check
2025-10-02T08:11:00.429379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:00.429386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:00.429391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:00.429396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533936921141591:12138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:00.429514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:00.429733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:00.429780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:00.429925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533936921141591:12138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:00.430073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:00.430136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.430142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.430143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.430144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.430145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.430150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.430159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.430163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.430166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.430170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.430175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.430182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.430187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.430192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.430196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.430200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.430204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.430208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.430212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.430216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.430233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:00.432215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533936921141591:12138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:00.436908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533936921141591:12138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:00.436924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533936921141591:12138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:00.436927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533936921141591:12138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:00.436935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:00.438646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:00.440403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:00.440419Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:00.440421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:00.440423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:00.440427Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1044 [1:7556533936921141587:12136]
2025-10-02T08:11:00.440436Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:00.440450Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:00.440452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.440454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.440456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.440470Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:00.440473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:00.440478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:00.440525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.440534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.440536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:00.440537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:00.440591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:00.440598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.440611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.440626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:00.440651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533936921141580:12136]
2025-10-02T08:11:00.440657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533936921141580:12136]
2025-10-02T08:11:00.440665Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:00.440675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:00.440678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:00.440679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:00.440691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:00.440694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1044
2025-10-02T08:11:00.440698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:00.440708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921141634:12138], now have 1 active actors on pipe
2025-10-02T08:11:00.440712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533937381178310:2378], now have 1 active actors on pipe
2025-10-02T08:11:00.440743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.440751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.440765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533936921141580:12136]
2025-10-02T08:11:00.440769Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:00.440767Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1044
2025-10-02T08:11:00.440793Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:00.440817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:00.440825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.440828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.440830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:00.440839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.440849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:00.440877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.440945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.440955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.440973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.441015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1045 partition: 0 MaxSeqNo: 17 sessionId: src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0
2025-10-02T08:11:00.441617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3c2d5c-6582695b-abcb3a70-df048697_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:00.445243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0] Write session: try to update token
2025-10-02T08:11:00.445266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:00.459710Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:00.459729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:00.459731Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:00.459738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533936921141580:12136]
2025-10-02T08:11:00.459741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533936921141580:12136]
2025-10-02T08:11:00.459790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:00.459795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.459797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:00.459798Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:00.459805Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:00.459924Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:00.465274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId: src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:00.468180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:00.518198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533936921141650:11760]
2025-10-02T08:11:00.518316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1044, pipe: [1:7556533936921141650:11760]
2025-10-02T08:11:00.606110Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:00.606346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.606356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.606388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921141650:11760], now have 1 active actors on pipe
2025-10-02T08:11:00.606495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:00.606506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:00.606558Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:00.606567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1045 reason: error at write: Disconnected sessionId: src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0
2025-10-02T08:11:00.606605Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:00.606733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1045 sessionId: src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0 is DEAD
2025-10-02T08:11:00.606816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533936921141650:11760]
2025-10-02T08:11:00.606901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:00.606917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0] Write session will restart in 0.005171s
2025-10-02T08:11:00.606947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0] Write session: Do CDS request
2025-10-02T08:11:00.606955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:00.613463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.613584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:00.613603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1046
2025-10-02T08:11:00.613792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.613833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:00.613842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:00.613845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:00.614015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:00.614189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1046 sessionId:  describe result for acl check
2025-10-02T08:11:00.614219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:00.614223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:00.614224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:00.614228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533936921141861:12144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:00.614634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533936921141861:12144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:00.615357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:00.615509Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:00.615518Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:00.615527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:00.615564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:00.615596Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533936921141869:12142]
2025-10-02T08:11:00.616014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:00.616178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:00.616246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:00.616576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:00.616632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.616638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.616640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.616641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.616642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.616648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.616658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.616667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.616671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.616675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.616684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.616692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.616698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.616707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.616712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.616722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.616731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.616737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.616742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.616747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.616767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:00.617319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533936921141861:12144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:00.622920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533936921141861:12144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:00.622938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533936921141861:12144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:00.622942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533936921141861:12144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:00.622951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:00.624877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:00.626545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:00.626560Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:00.626563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:00.626566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:00.626572Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1045 [1:7556533936921141869:12142]
2025-10-02T08:11:00.626584Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:00.626600Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:00.626603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.626606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.626608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.626623Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:00.626628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:00.626636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:00.626693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.626699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.626702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:00.626706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:00.626767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:00.626774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.626788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.626803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:00.626818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1045
2025-10-02T08:11:00.626823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921141909:12144], now have 1 active actors on pipe
2025-10-02T08:11:00.626829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533936921141856:12142]
2025-10-02T08:11:00.626831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533936921141856:12142]
2025-10-02T08:11:00.626838Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:00.626846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533937381178318:2378], now have 1 active actors on pipe
2025-10-02T08:11:00.626848Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:00.626852Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:00.626854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.626857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.626875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:00.626892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:00.626897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:00.626936Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:00.626945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.626949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.626918Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1045
2025-10-02T08:11:00.626954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:00.626962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.626970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:00.626976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533936921141856:12142]
2025-10-02T08:11:00.626987Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:00.626999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:00.627015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.627089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.627094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.627107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.627138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1046 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0
2025-10-02T08:11:00.627540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d894574d-c5cc4d8f-d69e01c0-a898a561_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:00.630855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0] Write session: try to update token
2025-10-02T08:11:00.630882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:00.644697Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:00.644718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:00.644720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:00.644728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533936921141856:12142]
2025-10-02T08:11:00.644736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533936921141856:12142]
2025-10-02T08:11:00.644775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:00.644775Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:00.644779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:00.644785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.644787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:00.644986Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:00.647505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId: src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:00.650022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:00.707147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533936921141924:11760]
2025-10-02T08:11:00.707269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1045, pipe: [1:7556533936921141924:11760]
2025-10-02T08:11:00.780936Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:00.781225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.781237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.781271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921141924:11760], now have 1 active actors on pipe
2025-10-02T08:11:00.781413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:00.781426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:00.781486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1046 reason: error at write: Disconnected sessionId: src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0
2025-10-02T08:11:00.781491Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:00.781498Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:00.781661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1046 sessionId: src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0 is DEAD
2025-10-02T08:11:00.781745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533936921141924:11760]
2025-10-02T08:11:00.781893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:00.781907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0] Write session will restart in 0.006302s
2025-10-02T08:11:00.781932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0] Write session: Do CDS request
2025-10-02T08:11:00.781938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:00.789207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:00.789442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.789513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:00.789527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1047
2025-10-02T08:11:00.789730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.789754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:00.789769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:00.789775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:00.790089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1047 sessionId:  describe result for acl check
2025-10-02T08:11:00.790112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:00.790117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:00.790118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:00.790122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533936921142134:12151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:00.790171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:00.790328Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:00.790335Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:00.790342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:00.790380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:00.790424Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533936921142136:12149]
2025-10-02T08:11:00.790474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533936921142134:12151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:00.790886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:00.791048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:00.791091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:00.791402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:00.791448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.791453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.791454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.791454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.791455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.791458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.791464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.791466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.791468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.791471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.791474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.791478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.791481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.791484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.791487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.791490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.791492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.791495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.791497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.791500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.791510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:00.792236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533936921142134:12151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:00.798658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533936921142134:12151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:00.798676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533936921142134:12151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:00.798679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533936921142134:12151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:00.798687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:00.799842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:00.801588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:00.801608Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:00.801610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:00.801613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:00.801621Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1046 [1:7556533936921142136:12149]
2025-10-02T08:11:00.801632Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:00.801651Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:00.801654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.801657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.801659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.801675Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:00.801687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:00.801694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:00.801767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.801776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.801783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:00.801790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:00.801867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:00.801877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.801890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.801902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:00.801904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1046
2025-10-02T08:11:00.801921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921142182:12151], now have 1 active actors on pipe
2025-10-02T08:11:00.801932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533937381178324:2378], now have 1 active actors on pipe
2025-10-02T08:11:00.801937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.801946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.801963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533936921142127:12149]
2025-10-02T08:11:00.801972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533936921142127:12149]
2025-10-02T08:11:00.801984Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:00.801998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:00.801986Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1046
2025-10-02T08:11:00.801999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:00.802001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:00.802018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:00.802021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:00.802038Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:00.802044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.802049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.802051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:00.802060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.802070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:00.802105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533936921142127:12149]
2025-10-02T08:11:00.802121Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:00.802129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:00.802139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.802196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.802204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.802222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.802262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1047 partition: 0 MaxSeqNo: 17 sessionId: src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0
2025-10-02T08:11:00.802585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0b8d8f-7a2b6a63-c1e9c5a0-c2daf31_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:00.805361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0] Write session: try to update token
2025-10-02T08:11:00.805377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:00.813293Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:00.813310Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:00.813319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533936921142127:12149]
2025-10-02T08:11:00.813356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:00.813369Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:00.813547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:00.813711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:00.813843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:00.813962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:00.814141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:00.814181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:00.820342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId: src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:00.823023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:00.823100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.823112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.823151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:00.823175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:00.823220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.823237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.823459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.823529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.823601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.823665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.824035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.824048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.824117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.824179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.824243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.824310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.824356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.824364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.824429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.824533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.824596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.824659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.824704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.824712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.824777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.824857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.824923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.824986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.825036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.825043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.825109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.825171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.825267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.825332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.825377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.825384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.825466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.825527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.825589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.825658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.825722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.825729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.825791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.825849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.825917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.825979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.826033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.826041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.826105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.826168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.826226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.826287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.826639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.826648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.826712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.826768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.826824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.826882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.826925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.826933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.826994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:00.827053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:00.827113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:00.827175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:00.827291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:00.827298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:00.827340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:00.827406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.827430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.827433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:00.827463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:00.827481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:00.827488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:00.827491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:00.827494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:00.827911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:00.827937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:00.827943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:00.827946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:00.827949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:00.827953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:00.828449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:00.828474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:00.828484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:00.828487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:00.828490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:00.828493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:00.829075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:00.829101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:00.829107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:00.829110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:00.829113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:00.830354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:00.830373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:00.830387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392660829
2025-10-02T08:11:00.830522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:00.830537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:00.830541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:00.830546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:00.830555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:00.830558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:00.831036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:00.831061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:00.831071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:00.831080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:00.831088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:00.831092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:00.831534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:00.831556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:00.831570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:00.831578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:00.831582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:00.831586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:00.832062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:00.832083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:00.832093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:00.833150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:00.833169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:00.833177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:00.833180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:00.833189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392660833
2025-10-02T08:11:00.833474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:00.833494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:00.833501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:00.833504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:00.833508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:00.833511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:00.833938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:00.833959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:00.833968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:00.833972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:00.833981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:00.833991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:00.834411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:00.834430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.834525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392660834
2025-10-02T08:11:00.835281Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:00.835302Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:00.835310Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:00.835324Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:00.836924Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:00.836938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:00.836940Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:00.836951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533936921142127:12149]
2025-10-02T08:11:00.836954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533936921142127:12149]
2025-10-02T08:11:00.836999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:00.837011Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:00.837011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:00.837015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.837018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:00.837150Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:00.881744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533936921142203:11760]
2025-10-02T08:11:00.881895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1046, pipe: [1:7556533936921142203:11760]
2025-10-02T08:11:00.974368Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:00.974664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921142203:11760], now have 1 active actors on pipe
2025-10-02T08:11:00.974783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533936921142203:11760]
2025-10-02T08:11:00.974837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:00.974842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:00.974860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1047 reason: error at write: Disconnected sessionId: src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0
2025-10-02T08:11:00.974885Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:00.974937Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:00.975005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1047 sessionId: src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0 is DEAD
2025-10-02T08:11:00.975163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:00.975173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0] Write session will restart in 0.009698s
2025-10-02T08:11:00.975191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0] Write session: Do CDS request
2025-10-02T08:11:00.975197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:00.982628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:00.983722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:00.983887Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:00.983895Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:00.983901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:00.983934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:00.983962Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533936921142428:12156]
2025-10-02T08:11:00.984383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:00.984570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:00.984596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:00.984790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:00.984834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.984839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.984839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.984840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.984841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.984844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.984850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.984852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.984854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.984856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.984860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.984865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:00.984872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.984875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:00.984877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.984880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:00.984882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.984885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.984888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.984890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.984900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:00.986333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.986372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:00.986383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1048
2025-10-02T08:11:00.986536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:00.986557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:00.986563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:00.986566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:00.986930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1048 sessionId:  describe result for acl check
2025-10-02T08:11:00.986966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:00.986971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:00.986973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:00.986978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533936921142445:12158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:00.987491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533936921142445:12158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:00.989614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533936921142445:12158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:00.992247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533936921142445:12158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:00.992267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533936921142445:12158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:00.992271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533936921142445:12158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:00.992281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:00.992848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:00.994396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:00.994411Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:00.994413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:00.994415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:00.994420Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1047 [1:7556533936921142428:12156]
2025-10-02T08:11:00.994429Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:00.994440Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:00.994442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.994444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.994446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.994459Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:00.994465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:00.994471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:00.994529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.994536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.994538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:00.994540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:00.994590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:00.994597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:00.994608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:00.994619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:00.994626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1047
2025-10-02T08:11:00.994641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533936921142473:12158], now have 1 active actors on pipe
2025-10-02T08:11:00.994648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533937381178345:2378], now have 1 active actors on pipe
2025-10-02T08:11:00.994655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533936921142422:12156]
2025-10-02T08:11:00.994657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533936921142422:12156]
2025-10-02T08:11:00.994668Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:00.994680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.994686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.994687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:00.994692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:00.994699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:00.994708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:00.994713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:00.994717Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1047
2025-10-02T08:11:00.994746Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:00.994755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:00.994758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:00.994759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:00.994768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:00.994774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:00.994779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533936921142422:12156]
2025-10-02T08:11:00.994786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:00.994797Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:00.994813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.994884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:00.994891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:00.994903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:00.994937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1048 partition: 0 MaxSeqNo: 17 sessionId: src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0
2025-10-02T08:11:00.995252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93b4b1b-8fdf8f12-c116624b-ff858828_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:00.997848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0] Write session: try to update token
2025-10-02T08:11:00.997866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:01.012608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId: src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:01.012872Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:01.012893Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.012895Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:01.012904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533936921142422:12156]
2025-10-02T08:11:01.012910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533936921142422:12156]
2025-10-02T08:11:01.012953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:01.012956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:01.012964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.012965Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:01.012966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:01.013142Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:01.015199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:01.074773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533941216109785:11760]
2025-10-02T08:11:01.074903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1047, pipe: [1:7556533941216109785:11760]
2025-10-02T08:11:01.144742Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:01.145114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.145128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.145166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216109785:11760], now have 1 active actors on pipe
2025-10-02T08:11:01.145286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:01.145299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:01.145350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1048 reason: error at write: Disconnected sessionId: src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0
2025-10-02T08:11:01.145411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:01.145522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1048 sessionId: src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0 is DEAD
2025-10-02T08:11:01.145630Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:01.145653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:01.145665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0] Write session will restart in 0.006674s
2025-10-02T08:11:01.145690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0] Write session: Do CDS request
2025-10-02T08:11:01.145697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:01.145690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533941216109785:11760]
2025-10-02T08:11:01.153425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.153447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:01.153554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:01.153569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1049
2025-10-02T08:11:01.153738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.153784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:01.153797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:01.153800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:01.154195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1049 sessionId:  describe result for acl check
2025-10-02T08:11:01.154227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:01.154233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:01.154234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:01.154244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533941216110000:12165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:01.154436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:01.154612Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:01.154623Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:01.154633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:01.154682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:01.154719Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533941216110002:12163]
2025-10-02T08:11:01.154745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533941216110000:12165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:01.155291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:01.155489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:01.155538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:01.155896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:01.155950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.155956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.155957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.155959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.155960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.155965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.155974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.155980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.155984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.155988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.155993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.155999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.156007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.156012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.156016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.156024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.156028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.156032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.156043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.156048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.156070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:01.156640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533941216110000:12165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:01.163054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533941216110000:12165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:01.163073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533941216110000:12165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:01.163078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533941216110000:12165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:01.163086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:01.164162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:01.165869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:01.165891Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:01.165897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:01.165901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:01.165907Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1048 [1:7556533941216110002:12163]
2025-10-02T08:11:01.165919Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:01.165935Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:01.165938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.165941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.165944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.165961Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:01.165967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:01.165979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:01.166036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.166042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.166044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:01.166046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:01.166108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:01.166117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.166130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.166146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:01.166165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1048
2025-10-02T08:11:01.166168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216110047:12165], now have 1 active actors on pipe
2025-10-02T08:11:01.166173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533941216109993:12163]
2025-10-02T08:11:01.166174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533941216109993:12163]
2025-10-02T08:11:01.166183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:01.166189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533941676145648:2378], now have 1 active actors on pipe
2025-10-02T08:11:01.166194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.166196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.166201Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:01.166204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:01.166211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:01.166224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:01.166227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:01.166266Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:01.166276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.166279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.166281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:01.166289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.166297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:01.166305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533941216109993:12163]
2025-10-02T08:11:01.166310Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:01.166319Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:01.166330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.166436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.166449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.166471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.166511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1049 partition: 0 MaxSeqNo: 17 sessionId: src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0
2025-10-02T08:11:01.166893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323d16a6-fe65f4db-72d4100f-3c52a8c4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:01.166256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1048
2025-10-02T08:11:01.169968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0] Write session: try to update token
2025-10-02T08:11:01.169987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:01.177320Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:01.177347Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.177356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533941216109993:12163]
2025-10-02T08:11:01.177399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:01.177398Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:01.177585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:01.177736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.177925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.178074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.178485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:01.178531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:01.184417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId: src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:01.186879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:01.186963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.186976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.187013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:01.187039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:01.187096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.187110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.187272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.187339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.187475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.187546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.187601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.187611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.187683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.187749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.187829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.187914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.187961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.187967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.188046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.188109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.188177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.188243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.188289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.188296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.188364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.188426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.188485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.188544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.188589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.188596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.188670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.188727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.188791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.188878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.188943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.188949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.189009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.189070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.189130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.189201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.189322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.189325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.189440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.189509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.189596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.189667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.189710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.189718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.189787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.189852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.189923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.189996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.190043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.190051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.190116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.190178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.190240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.190308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.190354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.190361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.190428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.190489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.190571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.190630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.190766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.190774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.190812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:01.190869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.190887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.190892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:01.190918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:01.190931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:01.190936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:01.190938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:01.190942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:01.191382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:01.191407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:01.191411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:01.191413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:01.191416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:01.191418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:01.191995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:01.192018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:01.192024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:01.192028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:01.192033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:01.192036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:01.192696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:01.192726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:01.192735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:01.192738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:01.192740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:01.195057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:01.195082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:01.195096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392661195
2025-10-02T08:11:01.195233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:01.195253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:01.195264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:01.195272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:01.195276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:01.195284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:01.195804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:01.195833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:01.195840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:01.195844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:01.195846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:01.195850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:01.196329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:01.196357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:01.196368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:01.196378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:01.196387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:01.196390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:01.196881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:01.196903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:01.196908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:01.197981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:01.197996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:01.198000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:01.198004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:01.198013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392661197
2025-10-02T08:11:01.198301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:01.198317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:01.198321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:01.198323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:01.198325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:01.198328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:01.198756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:01.198781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:01.198787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:01.198791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:01.198793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:01.198796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:01.199216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:01.199232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.199660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392661199
2025-10-02T08:11:01.200413Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:01.200438Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:01.200446Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:01.200450Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:01.201988Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:01.202001Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.202003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:01.202011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533941216109993:12163]
2025-10-02T08:11:01.202013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533941216109993:12163]
2025-10-02T08:11:01.202050Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:01.202061Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:01.202068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:01.202076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.202077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:01.202193Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:01.245765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533941216110070:11760]
2025-10-02T08:11:01.245887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1048, pipe: [1:7556533941216110070:11760]
2025-10-02T08:11:01.333424Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:01.333648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216110070:11760], now have 1 active actors on pipe
2025-10-02T08:11:01.333791Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:01.333834Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:01.334011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:01.334035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1049 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0
2025-10-02T08:11:01.334178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1049 sessionId: src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0 is DEAD
2025-10-02T08:11:01.334307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533941216110070:11760]
2025-10-02T08:11:01.334370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:01.334387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0] Write session will restart in 0.006403s
2025-10-02T08:11:01.334413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0] Write session: Do CDS request
2025-10-02T08:11:01.334420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:01.340848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:01.341954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:01.342076Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:01.342083Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:01.342090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:01.342122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:01.342149Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533941216110296:12175]
2025-10-02T08:11:01.342387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.342592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:01.342635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:01.342640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1050
2025-10-02T08:11:01.342752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.342770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:01.342776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:01.342779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:01.342853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:01.342882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:01.343086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:01.343118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.343123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.343123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.343124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.343125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.343128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.343133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.343136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.343138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.343140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.343143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.343148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.343151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.343154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.343160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.343163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.343165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.343168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.343171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.343174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.343184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:01.343368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1050 sessionId:  describe result for acl check
2025-10-02T08:11:01.343386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:01.343390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:01.343391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:01.343394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533941216110312:12177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:01.343745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533941216110312:12177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:01.345709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533941216110312:12177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:01.351133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:01.351575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533941216110312:12177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:01.351588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533941216110312:12177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:01.351590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533941216110312:12177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:01.351595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:01.352671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:01.352685Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:01.352686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:01.352689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:01.352693Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1049 [1:7556533941216110296:12175]
2025-10-02T08:11:01.352699Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:01.352710Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:01.352712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.352714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.352715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.352727Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:01.352730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:01.352735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:01.352772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.352777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.352779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:01.352781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:01.352848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:01.352856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.352864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.352870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:01.352883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216110348:12177], now have 1 active actors on pipe
2025-10-02T08:11:01.352885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533941676145667:2378], now have 1 active actors on pipe
2025-10-02T08:11:01.352890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533941216110290:12175]
2025-10-02T08:11:01.352892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533941216110290:12175]
2025-10-02T08:11:01.352899Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:01.352912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:01.352915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:01.352918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:01.352923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:01.352924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:01.352913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1049
2025-10-02T08:11:01.352946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533941216110290:12175]
2025-10-02T08:11:01.352952Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:01.352959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:01.352999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1049
2025-10-02T08:11:01.353012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.353016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.353038Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:01.353047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.353050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.353052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:01.353058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.353069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:01.353082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.353159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.353167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.353182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.353242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1050 partition: 0 MaxSeqNo: 17 sessionId: src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0
2025-10-02T08:11:01.353554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a36dea-98bf0cb8-eba40778-58c10f40_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:01.356348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0] Write session: try to update token
2025-10-02T08:11:01.356362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:01.363665Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:01.363686Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.363693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533941216110290:12175]
2025-10-02T08:11:01.363731Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:01.363735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:01.363933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:01.364071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.364224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.364367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.364773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:01.364838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:01.371085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId: src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:01.373464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:01.373560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.373573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.373605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:01.373626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:01.373673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.373688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.373847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.373912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.373985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.374047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.374089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.374097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.374169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.374253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.374315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.374373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.374417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.374424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.374491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.374566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.374626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.374685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.374726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.374733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.374799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.374859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.374915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.374976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.375017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.375023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.375083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.375141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.375199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.375259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.375303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.375309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.375371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.375429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.375486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.375557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.375606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.375612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.375675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.375735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.375807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.375870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.375910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.375916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.375980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.376040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.376101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.376164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.376305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.376313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.376381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.376438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.376496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.376556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.376613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.376620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.376682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.376745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.376816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.376874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.376919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.376927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.376964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:01.377024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.377047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.377053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:01.377083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:01.377098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:01.377105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:01.377108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:01.377111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:01.377484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:01.377512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:01.377522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:01.377526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:01.377530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:01.377537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:01.378203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:01.378229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:01.378234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:01.378237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:01.378242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:01.378245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:01.378700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:01.378723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:01.378730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:01.378733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:01.378736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:01.379847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:01.379863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:01.379871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392661379
2025-10-02T08:11:01.380016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:01.380028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:01.380031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:01.380033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:01.380036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:01.380038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:01.380474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:01.380494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:01.380497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:01.380499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:01.380501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:01.380503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:01.380980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:01.381003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:01.381011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:01.381015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:01.381018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:01.381021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:01.381518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:01.381539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:01.381544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:01.382636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:01.382651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:01.382658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:01.382660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:01.382666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392661382
2025-10-02T08:11:01.382955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:01.382975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:01.382980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:01.382983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:01.382985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:01.382987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:01.383382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:01.383399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:01.383403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:01.383405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:01.383407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:01.383410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:01.383817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:01.383832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.383907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392661383
2025-10-02T08:11:01.384585Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:01.384604Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:01.384608Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:01.384612Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:01.386068Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:01.386080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.386084Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:01.386088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533941216110290:12175]
2025-10-02T08:11:01.386091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533941216110290:12175]
2025-10-02T08:11:01.386132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:01.386139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.386141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:01.386145Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:01.386151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:01.386263Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:01.434686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533941216110391:11760]
2025-10-02T08:11:01.434780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1049, pipe: [1:7556533941216110391:11760]
2025-10-02T08:11:01.519494Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:01.519800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216110391:11760], now have 1 active actors on pipe
2025-10-02T08:11:01.519907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:01.519912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:01.519932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1050 reason: error at write: Disconnected sessionId: src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0
2025-10-02T08:11:01.520005Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:01.520036Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:01.520066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1050 sessionId: src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0 is DEAD
2025-10-02T08:11:01.520209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:01.520191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533941216110391:11760]
2025-10-02T08:11:01.520217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0] Write session will restart in 0.008693s
2025-10-02T08:11:01.520243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0] Write session: Do CDS request
2025-10-02T08:11:01.520249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:01.527101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:01.527920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:01.528040Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:01.528048Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:01.528055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:01.528084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:01.528109Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533941216110612:12187]
2025-10-02T08:11:01.528513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:01.528637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:01.528662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:01.528870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:01.528905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.528909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.528910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.528911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.528911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.528914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.528920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.528922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.528924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.528926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.528930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.528935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.528938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.528941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.528944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.528946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.528949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.528952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.528954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.528956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.528966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:01.530265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.530349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:01.530364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1051
2025-10-02T08:11:01.530486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.530508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:01.530511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:01.530513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:01.530897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1051 sessionId:  describe result for acl check
2025-10-02T08:11:01.530931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:01.530936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:01.530937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:01.530941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533941216110628:12189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:01.531327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533941216110628:12189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:01.533379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533941216110628:12189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:01.536021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533941216110628:12189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:01.536034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533941216110628:12189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:01.536037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533941216110628:12189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:01.536045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:01.536657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:01.538270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:01.538285Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:01.538287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:01.538290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:01.538294Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1050 [1:7556533941216110612:12187]
2025-10-02T08:11:01.538301Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:01.538315Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:01.538317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.538318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.538319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.538330Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:01.538334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:01.538338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:01.538390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.538397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.538400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:01.538402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:01.538459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:01.538466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.538477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.538486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1050
2025-10-02T08:11:01.538488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:01.538503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216110659:12189], now have 1 active actors on pipe
2025-10-02T08:11:01.538506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533941676145684:2378], now have 1 active actors on pipe
2025-10-02T08:11:01.538509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.538512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.538524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533941216110606:12187]
2025-10-02T08:11:01.538530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533941216110606:12187]
2025-10-02T08:11:01.538535Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:01.538544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:01.538555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:01.538554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:01.538556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:01.538557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:01.538568Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|602204da-63e92668-cf6c2962-7afedf9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:01.538571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.538547Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1050
2025-10-02T08:11:01.538574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.538575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:01.538580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.538586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:01.538609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533941216110606:12187]
2025-10-02T08:11:01.538618Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:01.538625Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:01.538629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.538694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.538702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.538719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.538762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1051 partition: 0 MaxSeqNo: 17 sessionId: src_id|602204da-63e92668-cf6c2962-7afedf9d_0
2025-10-02T08:11:01.539011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe8ccc9-b0b84d1-1fc6d203-1cfd3b38_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|602204da-63e92668-cf6c2962-7afedf9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:01.541726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602204da-63e92668-cf6c2962-7afedf9d_0] Write session: try to update token
2025-10-02T08:11:01.541737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602204da-63e92668-cf6c2962-7afedf9d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:01.548912Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:01.548929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.548936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533941216110606:12187]
2025-10-02T08:11:01.548971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:01.548975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:01.549121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:01.549270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.549409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.549543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:01.549782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:01.549819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:01.555486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId: src_id|602204da-63e92668-cf6c2962-7afedf9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:01.557965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:01.558021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.558030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.558069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:01.558088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:01.558136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.558153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.558341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.558428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.558509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.558577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.558623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.558632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.558704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.558767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.558836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.558904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.558948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.558955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.559027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.559093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.559149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.559216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.559255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.559260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.559317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.559379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.559437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.559494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.559535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.559540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.559599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.559667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.559728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.559808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.559852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.559858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.559919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.559977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.560039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.560098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.560140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.560144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.560203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.560259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.560319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.560376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.560417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.560422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.560484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.560542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.560600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.560659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.560698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.560703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.560764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.560846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.560920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.560994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.561042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.561049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.561122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:01.561194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:01.561275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:01.561347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:01.561395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:01.561402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:01.561445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:01.561510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.561532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.561535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:01.561569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:01.561588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:01.561595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:01.561598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:01.561605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:01.562053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:01.562078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:01.562087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:01.562093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:01.562095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:01.562097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:01.562538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:01.562558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:01.562562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:01.562564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:01.562566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:01.562568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:01.563040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:01.563060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:01.563068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:01.563069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:01.563071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:01.570448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:01.570470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:01.570481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392661570
2025-10-02T08:11:01.570629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:01.570644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:01.570650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:01.570652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:01.570655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:01.570657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:01.571089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:01.571107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:01.571112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:01.571119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:01.571121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:01.571122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:01.571541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:01.571560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:01.571567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:01.571575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:01.571582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:01.571585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:01.572020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:01.572038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:01.572042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:01.573097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:01.573113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:01.573118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:01.573120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:01.573127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392661572
2025-10-02T08:11:01.573404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:01.573421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:01.573426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:01.573428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:01.573431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:01.573434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:01.573867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:01.573884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:01.573888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:01.573896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:01.573898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:01.573901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:01.574322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:01.574341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.574483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392661574
2025-10-02T08:11:01.578059Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:01.578089Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:01.578095Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:01.578100Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:01.579750Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:01.579782Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.579784Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:01.579794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533941216110606:12187]
2025-10-02T08:11:01.579803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533941216110606:12187]
2025-10-02T08:11:01.579853Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:01.579865Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:01.579866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:01.579871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.579873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:01.580000Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:01.620541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533941216110687:11760]
2025-10-02T08:11:01.620639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1050, pipe: [1:7556533941216110687:11760]
2025-10-02T08:11:01.721760Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:01.722130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216110687:11760], now have 1 active actors on pipe
2025-10-02T08:11:01.722254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533941216110687:11760]
2025-10-02T08:11:01.722297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:01.722301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:01.722330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1051 reason: error at write: Disconnected sessionId: src_id|602204da-63e92668-cf6c2962-7afedf9d_0
2025-10-02T08:11:01.722377Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:01.722457Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:01.722528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1051 sessionId: src_id|602204da-63e92668-cf6c2962-7afedf9d_0 is DEAD
2025-10-02T08:11:01.722659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602204da-63e92668-cf6c2962-7afedf9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:01.722668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602204da-63e92668-cf6c2962-7afedf9d_0] Write session will restart in 0.005343s
2025-10-02T08:11:01.722689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602204da-63e92668-cf6c2962-7afedf9d_0] Write session: Do CDS request
2025-10-02T08:11:01.722696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602204da-63e92668-cf6c2962-7afedf9d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:01.729270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602204da-63e92668-cf6c2962-7afedf9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.729363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:01.729381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1052
2025-10-02T08:11:01.729495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.729528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:01.729537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:01.729542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:01.729738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:01.729894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1052 sessionId:  describe result for acl check
2025-10-02T08:11:01.729926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:01.729933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:01.729934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:01.729940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533941216110908:12196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:01.730392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:01.730461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533941216110908:12196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:01.730548Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:01.730558Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:01.730568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:01.730616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:01.730652Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533941216110913:12194]
2025-10-02T08:11:01.731271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:01.731405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:01.731446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:01.731746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:01.731836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.731843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.731844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.731845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.731845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.731851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.731860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.731864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.731868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.731876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.731881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.731892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.731902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.731911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.731920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.731930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.731939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.731948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.731957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.731963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.731981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:01.732470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533941216110908:12196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:01.738085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533941216110908:12196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:01.738105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533941216110908:12196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:01.738108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533941216110908:12196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:01.738118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:01.740045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:01.741622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:01.741642Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:01.741645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:01.741649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:01.741655Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1051 [1:7556533941216110913:12194]
2025-10-02T08:11:01.741667Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:01.741684Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:01.741692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.741695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.741697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.741713Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:01.741723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:01.741734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:01.741793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.741801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.741804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:01.741807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:01.741874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:01.741882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.741896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.741913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:01.741934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216110957:12196], now have 1 active actors on pipe
2025-10-02T08:11:01.741942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533941676145693:2378], now have 1 active actors on pipe
2025-10-02T08:11:01.741948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533941216110903:12194]
2025-10-02T08:11:01.741948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1051
2025-10-02T08:11:01.741950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533941216110903:12194]
2025-10-02T08:11:01.741957Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:01.741969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:01.741982Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:01.741988Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:01.741989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:01.741992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:01.741999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.741957Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1051
2025-10-02T08:11:01.742003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.742041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533941216110903:12194]
2025-10-02T08:11:01.742054Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:01.742067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:01.742074Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:01.742080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.742085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.742088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:01.742098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.742107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:01.742149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.742190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.742198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.742210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.742246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1052 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0
2025-10-02T08:11:01.742569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602204da-63e92668-cf6c2962-7afedf9d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:01.745048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0] Write session: try to update token
2025-10-02T08:11:01.745065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:01.757662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId: src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:01.759112Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:01.759133Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.759136Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:01.759144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533941216110903:12194]
2025-10-02T08:11:01.759148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533941216110903:12194]
2025-10-02T08:11:01.759181Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:01.759188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:01.759192Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:01.759193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.759195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:01.759326Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:01.760264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:01.822249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533941216110970:11760]
2025-10-02T08:11:01.822356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1051, pipe: [1:7556533941216110970:11760]
2025-10-02T08:11:01.906763Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:01.907074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.907088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.907126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216110970:11760], now have 1 active actors on pipe
2025-10-02T08:11:01.907266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:01.907279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:01.907327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1052 reason: error at write: Disconnected sessionId: src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0
2025-10-02T08:11:01.907335Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:01.907375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:01.907506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1052 sessionId: src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0 is DEAD
2025-10-02T08:11:01.907622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:01.907631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0] Write session will restart in 0.006913s
2025-10-02T08:11:01.907623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533941216110970:11760]
2025-10-02T08:11:01.907650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0] Write session: Do CDS request
2025-10-02T08:11:01.907655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:01.914760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:01.915336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.915428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:01.915443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1053
2025-10-02T08:11:01.915570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:01.915609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:01.915619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:01.915623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:01.915639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:01.915797Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:01.915805Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:01.915813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:01.915851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:01.915890Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533941216111193:12200]
2025-10-02T08:11:01.915980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1053 sessionId:  describe result for acl check
2025-10-02T08:11:01.916011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:01.916018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:01.916020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:01.916024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533941216111196:12202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:01.916363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:01.916490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:01.916498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533941216111196:12202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:01.916526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:01.916783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:01.916845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.916851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.916852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.916854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.916855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.916860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.916871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.916875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.916879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.916882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.916887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.916895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:01.916901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.916911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:01.916917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.916925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:01.916929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.916934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.916940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.916951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.916970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:01.918176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533941216111196:12202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:01.923363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533941216111196:12202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:01.923381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533941216111196:12202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:01.923387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533941216111196:12202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:01.923396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:01.924391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:01.925983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:01.926002Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:01.926004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:01.926007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:01.926012Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1052 [1:7556533941216111193:12200]
2025-10-02T08:11:01.926022Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:01.926036Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:01.926039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.926042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.926044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.926059Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:01.926064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:01.926070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:01.926130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.926138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.926140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:01.926143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:01.926200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:01.926206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.926217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:01.926227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:01.926245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533941216111252:12202], now have 1 active actors on pipe
2025-10-02T08:11:01.926246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1052
2025-10-02T08:11:01.926252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533941676145712:2378], now have 1 active actors on pipe
2025-10-02T08:11:01.926258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533941216111185:12200]
2025-10-02T08:11:01.926260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533941216111185:12200]
2025-10-02T08:11:01.926271Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:01.926280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:01.926282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.926282Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:01.926285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.926301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:01.926317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:01.926294Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1052
2025-10-02T08:11:01.926323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:01.926361Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:01.926371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:01.926374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:01.926375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:01.926383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:01.926395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:01.926407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533941216111185:12200]
2025-10-02T08:11:01.926418Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:01.926425Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:01.926444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.926494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:01.926501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:01.926515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:01.926548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1053 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0
2025-10-02T08:11:01.926851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f28b013-8b0843f-bf0c9bbb-7537c3ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:01.929306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0] Write session: try to update token
2025-10-02T08:11:01.929324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:01.942654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId: src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:01.943713Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:01.943733Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:01.943736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:01.943744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533941216111185:12200]
2025-10-02T08:11:01.943749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533941216111185:12200]
2025-10-02T08:11:01.943785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:01.943795Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:01.943800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:01.943807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:01.943813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:01.943978Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:01.945080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:02.007637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533945511078561:11760]
2025-10-02T08:11:02.007739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1052, pipe: [1:7556533945511078561:11760]
2025-10-02T08:11:02.074078Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:02.074325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.074334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.074366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511078561:11760], now have 1 active actors on pipe
2025-10-02T08:11:02.074470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:02.074483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:02.074510Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:02.074545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1053 reason: error at write: Disconnected sessionId: src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0
2025-10-02T08:11:02.074593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:02.074701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533945511078561:11760]
2025-10-02T08:11:02.074732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1053 sessionId: src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0 is DEAD
2025-10-02T08:11:02.074886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:02.074895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0] Write session will restart in 0.007536s
2025-10-02T08:11:02.074915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0] Write session: Do CDS request
2025-10-02T08:11:02.074919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:02.080819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:02.081782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:02.081973Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:02.081982Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:02.081988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:02.082022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:02.082062Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533945511078786:12207]
2025-10-02T08:11:02.082462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:02.082583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:02.082608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:02.082807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:02.082835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.082838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.082838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.082839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.082840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.082843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.082849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.082851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.082854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.082856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.082860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.082867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.082872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.082877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.082883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.082888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.082893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.082898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.082903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.082905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.082915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:02.083308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.083381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:02.083389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1054
2025-10-02T08:11:02.083501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.083520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:02.083524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:02.083527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:02.083795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1054 sessionId:  describe result for acl check
2025-10-02T08:11:02.083827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:02.083831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:02.083832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:02.083836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533945511078802:12210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:02.084184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533945511078802:12210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:02.086251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533945511078802:12210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:02.090341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533945511078802:12210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:02.090355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533945511078802:12210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:02.090358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533945511078802:12210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:02.090366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:02.091008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:02.092402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:02.092416Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:02.092418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:02.092421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:02.092425Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1053 [1:7556533945511078786:12207]
2025-10-02T08:11:02.092433Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:02.092445Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:02.092447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.092448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.092450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.092462Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:02.092465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:02.092470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:02.092513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.092519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.092522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:02.092524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:02.092569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:02.092574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.092582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.092589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:02.092603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511078834:12210], now have 1 active actors on pipe
2025-10-02T08:11:02.092607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1053
2025-10-02T08:11:02.092608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533945511078778:12207]
2025-10-02T08:11:02.092609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533945511078778:12207]
2025-10-02T08:11:02.092615Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:02.092619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533945971113017:2378], now have 1 active actors on pipe
2025-10-02T08:11:02.092623Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:02.092625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:02.092626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:02.092632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:02.092634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:02.092640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.092643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.092672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533945511078778:12207]
2025-10-02T08:11:02.092678Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:02.092688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:02.092688Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a642609e-efb3e19-89b6fd97-c8347667_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:02.092693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.092695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.092696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:02.092702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.092707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:02.092677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1053
2025-10-02T08:11:02.092735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.092789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.092797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.092827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.092856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1054 partition: 0 MaxSeqNo: 17 sessionId: src_id|a642609e-efb3e19-89b6fd97-c8347667_0
2025-10-02T08:11:02.093161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f586be6-5a5c6fcf-1d3078e3-d72194a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a642609e-efb3e19-89b6fd97-c8347667_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:02.095806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a642609e-efb3e19-89b6fd97-c8347667_0] Write session: try to update token
2025-10-02T08:11:02.095821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a642609e-efb3e19-89b6fd97-c8347667_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:02.108518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId: src_id|a642609e-efb3e19-89b6fd97-c8347667_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:02.109536Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:02.109554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:02.109556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:02.109564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533945511078778:12207]
2025-10-02T08:11:02.109568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533945511078778:12207]
2025-10-02T08:11:02.109608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:02.109620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.109623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:02.109718Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:02.109729Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:02.109749Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:02.110936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:02.175025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533945511078848:11760]
2025-10-02T08:11:02.175139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1053, pipe: [1:7556533945511078848:11760]
2025-10-02T08:11:02.243414Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:02.243672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.243682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.243712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511078848:11760], now have 1 active actors on pipe
2025-10-02T08:11:02.243826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:02.243838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:02.243893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1054 reason: error at write: Disconnected sessionId: src_id|a642609e-efb3e19-89b6fd97-c8347667_0
2025-10-02T08:11:02.243940Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:02.244039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1054 sessionId: src_id|a642609e-efb3e19-89b6fd97-c8347667_0 is DEAD
2025-10-02T08:11:02.244171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533945511078848:11760]
2025-10-02T08:11:02.244190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a642609e-efb3e19-89b6fd97-c8347667_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:02.244202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a642609e-efb3e19-89b6fd97-c8347667_0] Write session will restart in 0.005025s
2025-10-02T08:11:02.244226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a642609e-efb3e19-89b6fd97-c8347667_0] Write session: Do CDS request
2025-10-02T08:11:02.244219Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:02.244233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a642609e-efb3e19-89b6fd97-c8347667_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:02.250269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a642609e-efb3e19-89b6fd97-c8347667_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.250349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:02.250360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1055
2025-10-02T08:11:02.250455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.250475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:02.250482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:02.250484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:02.250518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:02.250765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1055 sessionId:  describe result for acl check
2025-10-02T08:11:02.250785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:02.250789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:02.250791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:02.250793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533945511079074:12216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:02.251131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533945511079074:12216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:02.251445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:02.251545Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:02.251554Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:02.251561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:02.251592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:02.251616Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533945511079081:12214]
2025-10-02T08:11:02.251995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:02.252147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:02.252186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:02.252392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:02.252422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.252426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.252427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.252428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.252428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.252432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.252438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.252440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.252442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.252444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.252447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.252454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.252457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.252460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.252463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.252465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.252468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.252470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.252474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.252477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.252487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:02.252990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533945511079074:12216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:02.257977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533945511079074:12216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:02.257987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533945511079074:12216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:02.257989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533945511079074:12216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:02.257995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:02.260066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:02.261534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:02.261548Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:02.261551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:02.261554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:02.261561Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1054 [1:7556533945511079081:12214]
2025-10-02T08:11:02.261577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:02.261593Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:02.261600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.261602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.261605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.261620Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:02.261629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:02.261635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:02.261690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.261696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.261699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:02.261701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:02.261754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:02.261761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.261772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.261788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:02.261805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533945511079068:12214]
2025-10-02T08:11:02.261811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533945511079068:12214]
2025-10-02T08:11:02.261817Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:02.261828Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:02.261830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533945971113023:2378], now have 1 active actors on pipe
2025-10-02T08:11:02.261833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511079121:12216], now have 1 active actors on pipe
2025-10-02T08:11:02.261833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1054
2025-10-02T08:11:02.261839Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:02.261840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:02.261854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:02.261861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:02.261887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.261894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.261905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533945511079068:12214]
2025-10-02T08:11:02.261911Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:02.261875Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1054
2025-10-02T08:11:02.261918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:02.261927Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:02.261931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.261933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.261934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:02.261940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.261949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:02.261971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.262012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.262017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.262025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.262055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1055 partition: 0 MaxSeqNo: 17 sessionId: src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0
2025-10-02T08:11:02.262320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a642609e-efb3e19-89b6fd97-c8347667_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:02.264760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0] Write session: try to update token
2025-10-02T08:11:02.264771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:02.277377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId: src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:02.278916Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:02.278935Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:02.278937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:02.278943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533945511079068:12214]
2025-10-02T08:11:02.278946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533945511079068:12214]
2025-10-02T08:11:02.278977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:02.278980Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:02.278983Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:02.278986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.278987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:02.279115Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:02.279621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:02.344501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533945511079138:11760]
2025-10-02T08:11:02.344619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1054, pipe: [1:7556533945511079138:11760]
2025-10-02T08:11:02.407056Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:02.407380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.407391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.407421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511079138:11760], now have 1 active actors on pipe
2025-10-02T08:11:02.407511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:02.407516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:02.407554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1055 reason: error at write: Disconnected sessionId: src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0
2025-10-02T08:11:02.407628Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:02.407698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1055 sessionId: src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0 is DEAD
2025-10-02T08:11:02.407665Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:02.407819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533945511079138:11760]
2025-10-02T08:11:02.407920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:02.407932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0] Write session will restart in 0.007021s
2025-10-02T08:11:02.407961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0] Write session: Do CDS request
2025-10-02T08:11:02.407968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:02.416350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.416391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:02.416409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1056
2025-10-02T08:11:02.416511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:02.416557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.416597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:02.416602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:02.416606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:02.417050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1056 sessionId:  describe result for acl check
2025-10-02T08:11:02.417096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:02.417105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:02.417108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:02.417113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533945511079405:12234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:02.417645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533945511079405:12234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:02.417838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:02.418025Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:02.418034Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:02.418043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:02.418093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:02.418129Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533945511079412:12232]
2025-10-02T08:11:02.418688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:02.418862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:02.418903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:02.419182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:02.419219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.419224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.419225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.419225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.419226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.419230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.419236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.419238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.419240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.419242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.419246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.419250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.419254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.419256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.419259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.419262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.419264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.419267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.419269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.419272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.419283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:02.419600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533945511079405:12234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:02.425103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533945511079405:12234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:02.425122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533945511079405:12234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:02.425126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533945511079405:12234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:02.425134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:02.426836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:02.428186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:02.428204Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:02.428207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:02.428210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:02.428216Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1055 [1:7556533945511079412:12232]
2025-10-02T08:11:02.428231Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:02.428251Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:02.428258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.428260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.428262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.428276Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:02.428280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:02.428287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:02.428443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.428452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.428455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:02.428457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:02.428508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:02.428513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.428522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.428532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:02.428545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533945511079398:12232]
2025-10-02T08:11:02.428549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533945511079398:12232]
2025-10-02T08:11:02.428556Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:02.428566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511079450:12234], now have 1 active actors on pipe
2025-10-02T08:11:02.428567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:02.428568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1055
2025-10-02T08:11:02.428571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:02.428574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533945971113052:2378], now have 1 active actors on pipe
2025-10-02T08:11:02.428578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:02.428585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:02.428586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:02.428609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.428615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.428624Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533945511079398:12232]
2025-10-02T08:11:02.428629Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:02.428647Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:02.428649Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:02.428657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.428660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.428666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:02.428633Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1055
2025-10-02T08:11:02.428674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.428685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:02.428707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.428740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.428745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.428754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.428780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1056 partition: 0 MaxSeqNo: 17 sessionId: src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0
2025-10-02T08:11:02.429136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ce2352-82a359fc-7d67aecf-f39f72ef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:02.431524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0] Write session: try to update token
2025-10-02T08:11:02.431539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:02.444273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId: src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:02.445691Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:02.445705Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:02.445706Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:02.445713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533945511079398:12232]
2025-10-02T08:11:02.445717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533945511079398:12232]
2025-10-02T08:11:02.445746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:02.445755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.445757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:02.445779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:02.445797Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:02.445892Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:02.446722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:02.507830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533945511079466:11760]
2025-10-02T08:11:02.507918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1055, pipe: [1:7556533945511079466:11760]
2025-10-02T08:11:02.574094Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:02.574330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.574340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.574370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511079466:11760], now have 1 active actors on pipe
2025-10-02T08:11:02.574496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:02.574508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:02.574534Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:02.574571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1056 reason: error at write: Disconnected sessionId: src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0
2025-10-02T08:11:02.574604Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:02.574733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533945511079466:11760]
2025-10-02T08:11:02.574775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1056 sessionId: src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0 is DEAD
2025-10-02T08:11:02.574992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:02.575007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0] Write session will restart in 0.008930s
2025-10-02T08:11:02.575043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0] Write session: Do CDS request
2025-10-02T08:11:02.575050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:02.582215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:02.583073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:02.583204Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:02.583210Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:02.583217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:02.583247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:02.583273Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533945511079696:12238]
2025-10-02T08:11:02.583682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:02.583836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:02.583865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:02.584056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:02.584081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.584086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.584086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.584087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.584088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.584091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.584097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.584099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.584101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.584103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.584107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.584111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.584114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.584117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.584119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.584122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.584124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.584127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.584129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.584131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.584141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:02.586227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:02.586239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1057
2025-10-02T08:11:02.586257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.586572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.586603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:02.586611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:02.586615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:02.587048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1057 sessionId:  describe result for acl check
2025-10-02T08:11:02.587085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:02.587091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:02.587093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:02.587097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533945511079712:12240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:02.587472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533945511079712:12240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:02.589587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533945511079712:12240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:02.591920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:02.592145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533945511079712:12240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:02.592157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533945511079712:12240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:02.592162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533945511079712:12240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:02.592170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:02.593425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:02.593437Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:02.593439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:02.593441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:02.593445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1056 [1:7556533945511079696:12238]
2025-10-02T08:11:02.593453Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:02.593464Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:02.593466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.593468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.593469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.593481Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:02.593485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:02.593489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:02.593530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.593535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.593537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:02.593539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:02.593583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:02.593589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.593596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.593602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:02.593618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533945971113061:2378], now have 1 active actors on pipe
2025-10-02T08:11:02.593626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533945511079690:12238]
2025-10-02T08:11:02.593627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533945511079690:12238]
2025-10-02T08:11:02.593633Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:02.593642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511079743:12240], now have 1 active actors on pipe
2025-10-02T08:11:02.593643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1056
2025-10-02T08:11:02.593645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:02.593648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:02.593651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:02.593659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:02.593661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:02.593683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.593689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.593699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533945511079690:12238]
2025-10-02T08:11:02.593704Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:02.593715Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:02.593722Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:02.593726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.593729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.593730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:02.593735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.593742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:02.593701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1056
2025-10-02T08:11:02.593758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.593789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.593793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.593802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.593850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1057 partition: 0 MaxSeqNo: 17 sessionId: src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0
2025-10-02T08:11:02.594162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b8a231-e8a82232-ddb3a065-de9e6d84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:02.596472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0] Write session: try to update token
2025-10-02T08:11:02.596483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:02.608959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId: src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:02.610509Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:02.610525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:02.610526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:02.610533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533945511079690:12238]
2025-10-02T08:11:02.610537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533945511079690:12238]
2025-10-02T08:11:02.610568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:02.610574Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:02.610577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.610578Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:02.610579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:02.610702Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:02.611234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:02.674770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533945511079762:11760]
2025-10-02T08:11:02.674894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1056, pipe: [1:7556533945511079762:11760]
2025-10-02T08:11:02.739863Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:02.740128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.740138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.740169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511079762:11760], now have 1 active actors on pipe
2025-10-02T08:11:02.740264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533945511079762:11760]
2025-10-02T08:11:02.740278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:02.740279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:02.740314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1057 reason: error at write: Disconnected sessionId: src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0
2025-10-02T08:11:02.740379Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:02.740385Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:02.740470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1057 sessionId: src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0 is DEAD
2025-10-02T08:11:02.740611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:02.740620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0] Write session will restart in 0.009248s
2025-10-02T08:11:02.740645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0] Write session: Do CDS request
2025-10-02T08:11:02.740652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:02.746523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:02.747412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:02.747566Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:02.747573Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:02.747579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:02.747616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:02.747642Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533945511079992:12245]
2025-10-02T08:11:02.748118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:02.748247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:02.748273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:02.748473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:02.748504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.748508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.748508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.748509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.748509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.748512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.748521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.748524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.748527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.748530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.748536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.748546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.748554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.748557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.748559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.748562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.748564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.748567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.748569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.748571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.748581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:02.751368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.751428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:02.751440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1058
2025-10-02T08:11:02.751587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.751613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:02.751621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:02.751624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:02.751991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1058 sessionId:  describe result for acl check
2025-10-02T08:11:02.752022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:02.752027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:02.752029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:02.752034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533945511080008:12247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:02.752435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533945511080008:12247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:02.754106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533945511080008:12247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:02.755723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:02.756219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533945511080008:12247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:02.756229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533945511080008:12247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:02.756231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533945511080008:12247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:02.756235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:02.757149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:02.757162Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:02.757164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:02.757167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:02.757171Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1057 [1:7556533945511079992:12245]
2025-10-02T08:11:02.757180Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:02.757193Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:02.757200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.757203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.757205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.757217Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:02.757224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:02.757230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:02.757272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.757278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.757280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:02.757281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:02.757318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:02.757323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.757330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.757342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:02.757351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1057
2025-10-02T08:11:02.757354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511080040:12247], now have 1 active actors on pipe
2025-10-02T08:11:02.757356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533945971113067:2378], now have 1 active actors on pipe
2025-10-02T08:11:02.757360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533945511079986:12245]
2025-10-02T08:11:02.757361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533945511079986:12245]
2025-10-02T08:11:02.757366Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:02.757373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.757377Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:02.757379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.757380Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:02.757390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:02.757402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:02.757406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:02.757429Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59c72741-b2e062be-eb4cd611-64b801ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:02.757436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.757439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.757440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:02.757445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.757411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1057
2025-10-02T08:11:02.757453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:02.757460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533945511079986:12245]
2025-10-02T08:11:02.757464Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:02.757474Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:02.757482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.757521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.757526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.757535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.757559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1058 partition: 0 MaxSeqNo: 17 sessionId: src_id|59c72741-b2e062be-eb4cd611-64b801ac_0
2025-10-02T08:11:02.757842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c5d696-635b7cfc-92585c51-5bf46fce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59c72741-b2e062be-eb4cd611-64b801ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:02.760316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c72741-b2e062be-eb4cd611-64b801ac_0] Write session: try to update token
2025-10-02T08:11:02.760330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c72741-b2e062be-eb4cd611-64b801ac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:02.773319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId: src_id|59c72741-b2e062be-eb4cd611-64b801ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:02.773391Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:02.773403Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:02.773404Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:02.773410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533945511079986:12245]
2025-10-02T08:11:02.773414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533945511079986:12245]
2025-10-02T08:11:02.773449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:02.773458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.773459Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:02.773460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:02.773463Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:02.773593Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:02.775621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:02.840630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533945511080054:11760]
2025-10-02T08:11:02.840768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1057, pipe: [1:7556533945511080054:11760]
2025-10-02T08:11:02.898482Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:02.898710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.898719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.898747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511080054:11760], now have 1 active actors on pipe
2025-10-02T08:11:02.898833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:02.898844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:02.898872Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:02.898892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1058 reason: error at write: Disconnected sessionId: src_id|59c72741-b2e062be-eb4cd611-64b801ac_0
2025-10-02T08:11:02.898960Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:02.899025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1058 sessionId: src_id|59c72741-b2e062be-eb4cd611-64b801ac_0 is DEAD
2025-10-02T08:11:02.899095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533945511080054:11760]
2025-10-02T08:11:02.899187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c72741-b2e062be-eb4cd611-64b801ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:02.899201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c72741-b2e062be-eb4cd611-64b801ac_0] Write session will restart in 0.006464s
2025-10-02T08:11:02.899223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c72741-b2e062be-eb4cd611-64b801ac_0] Write session: Do CDS request
2025-10-02T08:11:02.899228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c72741-b2e062be-eb4cd611-64b801ac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:02.905079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:02.905858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:02.905973Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:02.905981Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:02.905990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:02.906026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:02.906050Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533945511080287:12251]
2025-10-02T08:11:02.906475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:02.906596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:02.906618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:02.906805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:02.906836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.906839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.906840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.906841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.906841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.906844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.906851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.906853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.906855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.906857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.906861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.906865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:02.906868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.906871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:02.906873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.906876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:02.906878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.906881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.906883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.906885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.906894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:02.907336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c72741-b2e062be-eb4cd611-64b801ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.907400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:02.907406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1059
2025-10-02T08:11:02.907616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:02.907635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:02.907642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:02.907645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:02.907995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1059 sessionId:  describe result for acl check
2025-10-02T08:11:02.908026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:02.908032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:02.908033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:02.908038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533945511080303:12253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:02.908500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533945511080303:12253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:02.910341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533945511080303:12253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:02.913633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533945511080303:12253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:02.913645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533945511080303:12253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:02.913647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533945511080303:12253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:02.913653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:02.914157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:02.915567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:02.915579Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:02.915581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:02.915583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:02.915586Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1058 [1:7556533945511080287:12251]
2025-10-02T08:11:02.915593Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:02.915604Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:02.915605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.915607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.915608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.915618Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:02.915621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:02.915625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:02.915663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.915668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.915671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:02.915672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:02.915713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:02.915718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.915726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:02.915735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:02.915744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1058
2025-10-02T08:11:02.915749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511080334:12253], now have 1 active actors on pipe
2025-10-02T08:11:02.915751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533945971113086:2378], now have 1 active actors on pipe
2025-10-02T08:11:02.915755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533945511080281:12251]
2025-10-02T08:11:02.915757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533945511080281:12251]
2025-10-02T08:11:02.915765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:02.915780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:02.915782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.915784Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:02.915786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.915800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:02.915814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:02.915816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:02.915841Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:02.915849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:02.915851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:02.915853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:02.915859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:02.915810Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1058
2025-10-02T08:11:02.915867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:02.915879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533945511080281:12251]
2025-10-02T08:11:02.915887Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:02.915894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:02.915903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.915938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:02.915946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:02.915962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:02.915989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1059 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0
2025-10-02T08:11:02.916331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c72741-b2e062be-eb4cd611-64b801ac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:02.918726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0] Write session: try to update token
2025-10-02T08:11:02.918739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:02.931340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId: src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:02.932575Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:02.932592Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:02.932593Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:02.932599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533945511080281:12251]
2025-10-02T08:11:02.932603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533945511080281:12251]
2025-10-02T08:11:02.932640Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:02.932643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:02.932649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:02.932651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:02.932656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:02.932777Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:02.933934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:02.999375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533945511080360:11760]
2025-10-02T08:11:02.999459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1058, pipe: [1:7556533945511080360:11760]
2025-10-02T08:11:03.061029Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:03.061453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.061465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.061492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533945511080360:11760], now have 1 active actors on pipe
2025-10-02T08:11:03.061585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533945511080360:11760]
2025-10-02T08:11:03.061597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:03.061600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:03.061655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1059 reason: error at write: Disconnected sessionId: src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0
2025-10-02T08:11:03.061671Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:03.061822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1059 sessionId: src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0 is DEAD
2025-10-02T08:11:03.062018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:03.062031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0] Write session will restart in 0.008004s
2025-10-02T08:11:03.062054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0] Write session: Do CDS request
2025-10-02T08:11:03.062059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:03.062097Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:03.069182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:03.070026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:03.070132Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:03.070139Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:03.070145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:03.070169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:03.070193Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533949806047890:12258]
2025-10-02T08:11:03.070695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:03.070864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:03.070889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:03.071070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:03.071098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.071102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.071103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.071103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.071104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.071107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.071113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.071115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.071117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.071119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.071123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.071127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.071130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.071133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.071135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.071137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.071143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.071146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.071148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.071150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.071160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:03.071322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.071375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:03.071382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1060
2025-10-02T08:11:03.071503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.071524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:03.071531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:03.071533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:03.071859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1060 sessionId:  describe result for acl check
2025-10-02T08:11:03.071893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:03.071898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:03.071900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:03.071905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533949806047906:12260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:03.072374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533949806047906:12260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:03.074270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533949806047906:12260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:03.078186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533949806047906:12260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:03.078201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533949806047906:12260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:03.078204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533949806047906:12260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:03.078211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:03.078770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:03.080293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:03.080311Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:03.080314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:03.080317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:03.080323Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1059 [1:7556533949806047890:12258]
2025-10-02T08:11:03.080334Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:03.080347Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:03.080355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.080358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.080360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.080375Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:03.080383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:03.080390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:03.080453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.080462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.080464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:03.080467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:03.080537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:03.080546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.080547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1059
2025-10-02T08:11:03.080559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.080570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:03.080589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806047938:12260], now have 1 active actors on pipe
2025-10-02T08:11:03.080598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533950266080390:2378], now have 1 active actors on pipe
2025-10-02T08:11:03.080602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.080607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.080623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533949806047884:12258]
2025-10-02T08:11:03.080631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533949806047884:12258]
2025-10-02T08:11:03.080638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:03.080643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:03.080645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:03.080610Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1059
2025-10-02T08:11:03.080654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:03.080671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:03.080678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:03.080691Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c195ce23-e089968f-5050e6da-c87bef07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:03.080701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.080708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.080710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:03.080719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.080733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:03.080770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533949806047884:12258]
2025-10-02T08:11:03.080783Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:03.080788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:03.080795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.080851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.080859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.080873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.080913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1060 partition: 0 MaxSeqNo: 17 sessionId: src_id|c195ce23-e089968f-5050e6da-c87bef07_0
2025-10-02T08:11:03.081219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff03ba75-e5d6a97a-db1cda68-9554144b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c195ce23-e089968f-5050e6da-c87bef07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:03.083742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c195ce23-e089968f-5050e6da-c87bef07_0] Write session: try to update token
2025-10-02T08:11:03.083760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c195ce23-e089968f-5050e6da-c87bef07_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:03.090438Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:03.090459Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:03.090468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533949806047884:12258]
2025-10-02T08:11:03.090507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:03.090518Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:03.090660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:03.090797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:03.090923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:03.091057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:03.091230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:03.091267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:03.098502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId: src_id|c195ce23-e089968f-5050e6da-c87bef07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:03.100766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:03.100853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.100867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.100901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:03.100931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:03.100999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.101016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.101190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.101259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.101328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.101399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.101619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.101632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.101704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.101767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.101832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.101903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.102104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.102115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.102180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.102243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.102313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.102377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.102420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.102430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.102501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.102566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.102632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.102700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.102764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.102772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.102836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.102894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.102959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.103021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.103086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.103093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.103160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.103226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.103291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.103355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.103402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.103409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.103478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.103544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.103614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.103683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.103736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.103743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.103824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.103888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.103955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.104020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.104065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.104072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.104136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.104200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.104263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.104329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.104394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.104401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.104467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.104525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.104588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.104651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.104695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.104701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.104751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:03.104830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.104853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.104859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:03.104890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:03.104907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:03.104914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:03.104917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:03.104919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:03.105316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:03.105342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:03.105352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:03.105359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:03.105362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:03.105370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:03.105859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:03.105882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:03.105888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:03.105890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:03.105891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:03.105893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:03.106283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:03.106299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:03.106302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:03.106304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:03.106306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:03.108192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:03.108207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:03.108216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392663107
2025-10-02T08:11:03.108332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:03.108342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:03.108347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:03.108349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:03.108351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:03.108354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:03.108760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:03.108775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:03.108779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:03.108786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:03.108789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:03.108791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:03.109223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:03.109239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:03.109245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:03.109247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:03.109249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:03.109251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:03.109661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:03.109676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:03.109680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:03.110593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:03.110608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:03.110611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:03.110614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:03.110618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392663110
2025-10-02T08:11:03.110855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:03.110870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:03.110875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:03.110881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:03.110883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:03.110886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:03.111249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:03.111264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:03.111267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:03.111269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:03.111271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:03.111274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:03.111650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:03.111665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.111728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392663111
2025-10-02T08:11:03.113699Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:03.113721Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:03.113726Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:03.113731Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:03.113739Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:03.113741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:03.113742Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:03.113748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533949806047884:12258]
2025-10-02T08:11:03.113753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533949806047884:12258]
2025-10-02T08:11:03.113785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:03.113793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:03.113806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:03.113808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.113809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:03.113928Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:03.161685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533949806047956:11760]
2025-10-02T08:11:03.161809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1059, pipe: [1:7556533949806047956:11760]
2025-10-02T08:11:03.245060Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:03.245464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806047956:11760], now have 1 active actors on pipe
2025-10-02T08:11:03.245694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533949806047956:11760]
2025-10-02T08:11:03.245710Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:03.245715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:03.245717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:03.245740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1060 reason: error at write: Disconnected sessionId: src_id|c195ce23-e089968f-5050e6da-c87bef07_0
2025-10-02T08:11:03.245900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1060 sessionId: src_id|c195ce23-e089968f-5050e6da-c87bef07_0 is DEAD
2025-10-02T08:11:03.246024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195ce23-e089968f-5050e6da-c87bef07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:03.246032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195ce23-e089968f-5050e6da-c87bef07_0] Write session will restart in 0.009246s
2025-10-02T08:11:03.246057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195ce23-e089968f-5050e6da-c87bef07_0] Write session: Do CDS request
2025-10-02T08:11:03.246065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195ce23-e089968f-5050e6da-c87bef07_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:03.246154Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:03.249744Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [26e399d111652101] Result# TEvPutResult {Id# [72075186224037892:1059:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:03.249800Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1059:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:03.249865Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1059:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:03.256327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c195ce23-e089968f-5050e6da-c87bef07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.256468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:03.256481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1061
2025-10-02T08:11:03.256628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.256660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:03.256664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:03.256667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:03.256899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:03.257033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1061 sessionId:  describe result for acl check
2025-10-02T08:11:03.257067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:03.257073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:03.257074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:03.257079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533949806048197:12267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:03.257549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533949806048197:12267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:03.257903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:03.258122Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:03.258139Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:03.258153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:03.258214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:03.258264Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533949806048212:12265]
2025-10-02T08:11:03.258958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:03.259062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533949806048197:12267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:03.259162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:03.259226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:03.259532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:03.259586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.259595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.259596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.259597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.259598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.259604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.259613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.259617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.259620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.259624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.259629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.259636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.259641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.259646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.259650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.259655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.259659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.259664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.259669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.259674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.259694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:03.264716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533949806048197:12267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:03.264733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533949806048197:12267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:03.264736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533949806048197:12267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:03.264744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:03.270265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:03.271616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:03.271628Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:03.271631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:03.271633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:03.271638Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1060 [1:7556533949806048212:12265]
2025-10-02T08:11:03.271647Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:03.271659Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:03.271661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.271663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.271664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.271676Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:03.271680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:03.271684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:03.271737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.271742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.271744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:03.271746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:03.271877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1060
2025-10-02T08:11:03.271917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:03.271925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.271937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.271952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:03.271972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806048246:12267], now have 1 active actors on pipe
2025-10-02T08:11:03.271979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533950266080398:2378], now have 1 active actors on pipe
2025-10-02T08:11:03.271983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.271988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.271956Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1060
2025-10-02T08:11:03.272003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533949806048192:12265]
2025-10-02T08:11:03.272010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533949806048192:12265]
2025-10-02T08:11:03.272021Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:03.272037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:03.272036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:03.272040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:03.272051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:03.272054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:03.272072Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:03.272083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.272086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.272089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:03.272099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.272111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:03.272139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533949806048192:12265]
2025-10-02T08:11:03.272148Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:03.272160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.272164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:03.272211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.272218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.272231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.272260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1061 partition: 0 MaxSeqNo: 17 sessionId: src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0
2025-10-02T08:11:03.272612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c195ce23-e089968f-5050e6da-c87bef07_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:03.275236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0] Write session: try to update token
2025-10-02T08:11:03.275256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:03.283129Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:03.283141Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:03.283148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533949806048192:12265]
2025-10-02T08:11:03.283182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:03.283201Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:03.283331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:03.283459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:03.283598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:03.283725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:03.283926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:03.283952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:03.290247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId: src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:03.292656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:03.292728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.292736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.292770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:03.292791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:03.292844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.292859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.293030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.293109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.293177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.293258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.293463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.293475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.293545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.293623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.293689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.293759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.293806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.293813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.293877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.293936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.294000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.294065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.294114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.294122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.294186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.294255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.294318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.294381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.294430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.294437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.294496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.294551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.294611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.294687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.294734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.294741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.294812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.294874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.294938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.295002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.295049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.295056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.295120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.295179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.295245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.295308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.295354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.295365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.295429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.295486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.295548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.295618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.295662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.295671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.295734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.295812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.295880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.295944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.295990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.295997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.296064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:03.296125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:03.296186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:03.296248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:03.296295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:03.296303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:03.296343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:03.296408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.296430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.296436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:03.296467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:03.296483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:03.296490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:03.296494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:03.296497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:03.296916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:03.296944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:03.296955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:03.296961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:03.296969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:03.296972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:03.297542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:03.297567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:03.297574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:03.297577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:03.297580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:03.297584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:03.298067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:03.298091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:03.298098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:03.298106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:03.298111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:03.301679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:03.301708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:03.301722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392663301
2025-10-02T08:11:03.301875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:03.301897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:03.301904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:03.301907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:03.301914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:03.301917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:03.302379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:03.302406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:03.302418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:03.302427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:03.302430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:03.302433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:03.302893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:03.302917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:03.302927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:03.302935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:03.302938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:03.302942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:03.303390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:03.303416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:03.303426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:03.304505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:03.304526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:03.304532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:03.304535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:03.304544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392663304
2025-10-02T08:11:03.304846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:03.304865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:03.304874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:03.304881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:03.304884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:03.304888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:03.305305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:03.305324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:03.305329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:03.305333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:03.305337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:03.305341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:03.305755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:03.305772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.305871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392663305
2025-10-02T08:11:03.306633Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:03.306653Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:03.306665Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:03.306677Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:03.308167Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:03.308185Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:03.308187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:03.308197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533949806048192:12265]
2025-10-02T08:11:03.308200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533949806048192:12265]
2025-10-02T08:11:03.308252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:03.308261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.308260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:03.308263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:03.308267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:03.308387Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:03.345970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533949806048266:11760]
2025-10-02T08:11:03.346094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1060, pipe: [1:7556533949806048266:11760]
2025-10-02T08:11:03.454542Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:03.454906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806048266:11760], now have 1 active actors on pipe
2025-10-02T08:11:03.455004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:03.455018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:03.455043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1061 reason: error at write: Disconnected sessionId: src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0
2025-10-02T08:11:03.455066Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:03.455115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:03.455235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1061 sessionId: src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0 is DEAD
2025-10-02T08:11:03.455362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533949806048266:11760]
2025-10-02T08:11:03.455442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:03.455460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0] Write session will restart in 0.009016s
2025-10-02T08:11:03.455487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0] Write session: Do CDS request
2025-10-02T08:11:03.455494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:03.464344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:03.465362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.465399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:03.465532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:03.465545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1062
2025-10-02T08:11:03.465624Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:03.465636Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:03.465661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:03.465700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.465723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:03.465731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:03.465736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:03.465739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:03.465755Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533949806048543:12283]
2025-10-02T08:11:03.466106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1062 sessionId:  describe result for acl check
2025-10-02T08:11:03.466137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:03.466145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:03.466147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:03.466152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533949806048547:12285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:03.466318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:03.466477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:03.466506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:03.466638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533949806048547:12285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:03.466694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:03.466721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.466725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.466726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.466726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.466727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.466730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.466736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.466738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.466740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.466742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.466745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.466749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.466753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.466756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.466759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.466761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.466764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.466767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.466769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.466771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.466786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:03.468501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533949806048547:12285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:03.473875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533949806048547:12285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:03.473891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533949806048547:12285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:03.473894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533949806048547:12285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:03.473903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:03.474880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:03.476289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:03.476301Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:03.476303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:03.476306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:03.476310Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1061 [1:7556533949806048543:12283]
2025-10-02T08:11:03.476317Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:03.476329Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:03.476331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.476333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.476335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.476346Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:03.476349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:03.476354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:03.476399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.476405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.476407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:03.476409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:03.476451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:03.476456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.476464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.476471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:03.476481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533949806048536:12283]
2025-10-02T08:11:03.476486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533949806048536:12283]
2025-10-02T08:11:03.476491Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:03.476500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:03.476511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:03.476517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:03.476517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:03.476520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:03.476523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806048588:12285], now have 1 active actors on pipe
2025-10-02T08:11:03.476526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1061
2025-10-02T08:11:03.476529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533950266080428:2378], now have 1 active actors on pipe
2025-10-02T08:11:03.476548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533949806048536:12283]
2025-10-02T08:11:03.476552Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:03.476556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.476558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:03.476559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.476586Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:03.476594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.476596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.476597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:03.476604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.476610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:03.476583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1061
2025-10-02T08:11:03.476630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.476665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.476676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.476698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.476736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1062 partition: 0 MaxSeqNo: 17 sessionId: src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0
2025-10-02T08:11:03.477195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614a2d3-894da04f-4a525a19-6215c4ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:03.480273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0] Write session: try to update token
2025-10-02T08:11:03.480297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:03.493212Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:03.493233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:03.493235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:03.493244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533949806048536:12283]
2025-10-02T08:11:03.493249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533949806048536:12283]
2025-10-02T08:11:03.493290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:03.493298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.493305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:03.493305Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:03.493311Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:03.493448Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:03.497682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId: src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:03.500625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:03.555412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533949806048606:11760]
2025-10-02T08:11:03.555565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1061, pipe: [1:7556533949806048606:11760]
2025-10-02T08:11:03.642286Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:03.642564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.642573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.642589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806048606:11760], now have 1 active actors on pipe
2025-10-02T08:11:03.642740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533949806048606:11760]
2025-10-02T08:11:03.642777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:03.642813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:03.642825Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:03.642892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1062 reason: error at write: Disconnected sessionId: src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0
2025-10-02T08:11:03.643124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1062 sessionId: src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0 is DEAD
2025-10-02T08:11:03.643363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:03.643380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0] Write session will restart in 0.009899s
2025-10-02T08:11:03.643408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0] Write session: Do CDS request
2025-10-02T08:11:03.643418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:03.643442Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:03.649992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:03.650832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:03.650941Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:03.650948Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:03.650953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:03.650978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:03.651004Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533949806048852:6522]
2025-10-02T08:11:03.651436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:03.651576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:03.651599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:03.651786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:03.651814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.651818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.651819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.651819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.651820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.651822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.651829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.651831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.651833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.651835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.651838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.651842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.651846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.651849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.651851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.651853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.651855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.651858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.651860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.651862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.651873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:03.654452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.654450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:03.654456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1063
2025-10-02T08:11:03.654643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.654662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:03.654668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:03.654670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:03.654958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1063 sessionId:  describe result for acl check
2025-10-02T08:11:03.654979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:03.654980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:03.654981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:03.654984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533949806048868:6516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:03.655330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533949806048868:6516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:03.656928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533949806048868:6516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:03.659169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:03.659618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533949806048868:6516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:03.659633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533949806048868:6516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:03.659636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533949806048868:6516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:03.659645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:03.660638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:03.660651Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:03.660652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:03.660655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:03.660659Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1062 [1:7556533949806048852:6522]
2025-10-02T08:11:03.660665Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:03.660674Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:03.660679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.660681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.660683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.660693Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:03.660699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:03.660704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:03.660740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.660745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.660747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:03.660749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:03.660792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:03.660797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.660825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.660840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:03.660859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806048899:6516], now have 1 active actors on pipe
2025-10-02T08:11:03.660868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533949806048846:6522]
2025-10-02T08:11:03.660870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533949806048846:6522]
2025-10-02T08:11:03.660876Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:03.660883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1062
2025-10-02T08:11:03.660884Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:03.660886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:03.660886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533950266080437:2378], now have 1 active actors on pipe
2025-10-02T08:11:03.660892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.660899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.660913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:03.660928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:03.660932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:03.660919Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1062
2025-10-02T08:11:03.660958Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:03.660967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.660969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.660970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:03.660976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.660981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:03.660986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533949806048846:6522]
2025-10-02T08:11:03.660992Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:03.660999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:03.661009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.661050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.661055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.661066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.661096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1063 partition: 0 MaxSeqNo: 17 sessionId: src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0
2025-10-02T08:11:03.661457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caeb455-84dff9e8-a5d2a838-6bc8d336_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:03.664552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0] Write session: try to update token
2025-10-02T08:11:03.664577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:03.677477Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:03.677494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:03.677497Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:03.677505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533949806048846:6522]
2025-10-02T08:11:03.677510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533949806048846:6522]
2025-10-02T08:11:03.677548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:03.677550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:03.677554Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:03.677556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.677558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:03.677707Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:03.680567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId: src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:03.682945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:03.742791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533949806048913:11760]
2025-10-02T08:11:03.742876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1062, pipe: [1:7556533949806048913:11760]
2025-10-02T08:11:03.802305Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:03.802507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.802518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.802563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806048913:11760], now have 1 active actors on pipe
2025-10-02T08:11:03.802649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:03.802656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:03.802702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1063 reason: error at write: Disconnected sessionId: src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0
2025-10-02T08:11:03.802708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:03.802886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1063 sessionId: src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0 is DEAD
2025-10-02T08:11:03.803001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:03.803013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0] Write session will restart in 0.005990s
2025-10-02T08:11:03.802990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533949806048913:11760]
2025-10-02T08:11:03.803031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0] Write session: Do CDS request
2025-10-02T08:11:03.803036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:03.803514Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:03.810394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.810499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:03.810510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1064
2025-10-02T08:11:03.810633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.810663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:03.810668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:03.810671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:03.810888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:03.811018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1064 sessionId:  describe result for acl check
2025-10-02T08:11:03.811047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:03.811052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:03.811054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:03.811059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533949806049154:6502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:03.811520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533949806049154:6502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:03.812037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:03.812148Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:03.812155Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:03.812160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:03.812188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:03.812219Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533949806049169:6504]
2025-10-02T08:11:03.812603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:03.812743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:03.812768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:03.812981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:03.813011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.813015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.813015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.813016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.813016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.813020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.813025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.813027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.813029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.813031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.813034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.813038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.813041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.813047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.813050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.813052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.813058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.813060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.813063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.813065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.813066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533949806049154:6502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:03.813075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:03.818699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533949806049154:6502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:03.818715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533949806049154:6502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:03.818718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533949806049154:6502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:03.818724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:03.820509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:03.821941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:03.821951Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:03.821953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:03.821956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:03.821960Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1063 [1:7556533949806049169:6504]
2025-10-02T08:11:03.821968Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:03.821980Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:03.821981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.821983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.821984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.821996Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:03.822000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:03.822005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:03.822044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.822051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.822054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:03.822057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:03.822111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:03.822118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.822126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.822133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:03.822145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533949806049150:6504]
2025-10-02T08:11:03.822146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533949806049150:6504]
2025-10-02T08:11:03.822153Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:03.822162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806049203:6502], now have 1 active actors on pipe
2025-10-02T08:11:03.822165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1063
2025-10-02T08:11:03.822167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:03.822168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:03.822171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:03.822174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:03.822176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:03.822199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533949806049150:6504]
2025-10-02T08:11:03.822200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:03.822203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:03.822204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533950266080454:2378], now have 1 active actors on pipe
2025-10-02T08:11:03.822207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.822209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.822240Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:03.822248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.822250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.822251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:03.822257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.822263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:03.822243Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1063
2025-10-02T08:11:03.822280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.822312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.822316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.822326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.822355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1064 partition: 0 MaxSeqNo: 17 sessionId: src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0
2025-10-02T08:11:03.822755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b913b8-63dd55ae-7edee3f2-6d529965_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:03.825945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0] Write session: try to update token
2025-10-02T08:11:03.825967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:03.838508Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:03.838524Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:03.838527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:03.838535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533949806049150:6504]
2025-10-02T08:11:03.838539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533949806049150:6504]
2025-10-02T08:11:03.838581Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:03.838583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:03.838586Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:03.838590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.838592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:03.838751Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:03.842156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId: src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:03.844629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:03.903036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533949806049216:11760]
2025-10-02T08:11:03.903158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1063, pipe: [1:7556533949806049216:11760]
2025-10-02T08:11:03.967929Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:03.968169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.968178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.968209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806049216:11760], now have 1 active actors on pipe
2025-10-02T08:11:03.968342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533949806049216:11760]
2025-10-02T08:11:03.968361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:03.968368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:03.968418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1064 reason: error at write: Disconnected sessionId: src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0
2025-10-02T08:11:03.968446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:03.968543Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:03.968586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1064 sessionId: src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0 is DEAD
2025-10-02T08:11:03.968737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:03.968748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0] Write session will restart in 0.006548s
2025-10-02T08:11:03.968772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0] Write session: Do CDS request
2025-10-02T08:11:03.968777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:03.976196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:03.976383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.976449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:03.976459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1065
2025-10-02T08:11:03.976559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:03.976586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:03.976596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:03.976599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:03.977046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1065 sessionId:  describe result for acl check
2025-10-02T08:11:03.977078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:03.977083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:03.977085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:03.977090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533949806049476:6481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:03.977288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:03.977445Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:03.977455Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:03.977463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:03.977506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:03.977535Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533949806049478:6487]
2025-10-02T08:11:03.977574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533949806049476:6481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:03.978013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:03.978145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:03.978179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:03.978384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:03.978416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.978420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.978421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.978421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.978422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.978425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.978431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.978433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.978435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.978437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.978440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.978444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:03.978447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.978450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:03.978452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.978455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:03.978457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.978460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.978462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.978465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.978476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:03.979561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533949806049476:6481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:03.985236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533949806049476:6481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:03.985252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533949806049476:6481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:03.985256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533949806049476:6481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:03.985265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:03.986200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:03.987701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:03.987713Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:03.987715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:03.987717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:03.987721Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1064 [1:7556533949806049478:6487]
2025-10-02T08:11:03.987730Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:03.987742Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:03.987744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.987746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.987747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.987759Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:03.987763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:03.987767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:03.987819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.987825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.987828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:03.987830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:03.987873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:03.987878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:03.987887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:03.987894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:03.987906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533949806049469:6487]
2025-10-02T08:11:03.987912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533949806049469:6487]
2025-10-02T08:11:03.987919Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:03.987928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1064
2025-10-02T08:11:03.987932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533949806049520:6481], now have 1 active actors on pipe
2025-10-02T08:11:03.987932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:03.987935Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:03.987940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:03.987951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:03.987954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:03.987959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533950266080462:2378], now have 1 active actors on pipe
2025-10-02T08:11:03.987963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.987967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.988006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533949806049469:6487]
2025-10-02T08:11:03.988015Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:03.988023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:03.988028Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70c1c07c-12ed26c8-4632db6a-775289e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:03.988035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:03.988038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:03.988040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:03.988001Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1064
2025-10-02T08:11:03.988051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:03.988063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:03.988103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.988148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:03.988153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:03.988163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:03.988191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1065 partition: 0 MaxSeqNo: 17 sessionId: src_id|70c1c07c-12ed26c8-4632db6a-775289e_0
2025-10-02T08:11:03.988520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eec7cf-ad5610d0-cd971cf8-427b9579_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|70c1c07c-12ed26c8-4632db6a-775289e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:03.991312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c1c07c-12ed26c8-4632db6a-775289e_0] Write session: try to update token
2025-10-02T08:11:03.991328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c1c07c-12ed26c8-4632db6a-775289e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:04.005017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId: src_id|70c1c07c-12ed26c8-4632db6a-775289e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:04.005791Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:04.005800Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:04.005802Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:04.005808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533949806049469:6487]
2025-10-02T08:11:04.005811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533949806049469:6487]
2025-10-02T08:11:04.005842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:04.005850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.005851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:04.005974Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:04.005981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:04.005987Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:04.007348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:04.068446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533954101016829:11760]
2025-10-02T08:11:04.068531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1064, pipe: [1:7556533954101016829:11760]
2025-10-02T08:11:04.130662Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:04.130938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.130950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.130982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101016829:11760], now have 1 active actors on pipe
2025-10-02T08:11:04.131161Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:04.131213Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:04.131373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533954101016829:11760]
2025-10-02T08:11:04.131394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:04.131441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1065 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70c1c07c-12ed26c8-4632db6a-775289e_0
2025-10-02T08:11:04.131594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1065 sessionId: src_id|70c1c07c-12ed26c8-4632db6a-775289e_0 is DEAD
2025-10-02T08:11:04.131772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c1c07c-12ed26c8-4632db6a-775289e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:04.131792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c1c07c-12ed26c8-4632db6a-775289e_0] Write session will restart in 0.007547s
2025-10-02T08:11:04.131817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c1c07c-12ed26c8-4632db6a-775289e_0] Write session: Do CDS request
2025-10-02T08:11:04.131824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c1c07c-12ed26c8-4632db6a-775289e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:04.138811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:04.139579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:04.139704Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:04.139711Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:04.139718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:04.139747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:04.139775Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533954101017078:6477]
2025-10-02T08:11:04.140223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:04.140342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:04.140366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:04.140372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c1c07c-12ed26c8-4632db6a-775289e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.140468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:04.140477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1066
2025-10-02T08:11:04.140548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:04.140573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.140577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.140577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.140578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.140579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.140581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.140588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.140590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.140594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.140597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.140601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.140604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:04.140605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.140608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:04.140611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:04.140612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.140616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.140619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.140621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.140624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.140626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.140628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.140630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.140633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.140643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:04.140915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1066 sessionId:  describe result for acl check
2025-10-02T08:11:04.140941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:04.140942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:04.140943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:04.140947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533954101017094:6475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:04.141420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533954101017094:6475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:04.143387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533954101017094:6475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:04.148339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533954101017094:6475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:04.148353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533954101017094:6475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:04.148355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533954101017094:6475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:04.148362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:04.148900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:04.150356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:04.150373Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:04.150376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:04.150379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:04.150385Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1065 [1:7556533954101017078:6477]
2025-10-02T08:11:04.150397Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:04.150409Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:04.150415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.150417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.150419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.150431Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:04.150440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:04.150445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:04.150499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.150506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.150510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:04.150512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:04.150573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:04.150578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.150587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.150597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:04.150611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1065
2025-10-02T08:11:04.150614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101017125:6475], now have 1 active actors on pipe
2025-10-02T08:11:04.150619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533954101017072:6477]
2025-10-02T08:11:04.150620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533954101017072:6477]
2025-10-02T08:11:04.150626Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:04.150632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533954561047766:2378], now have 1 active actors on pipe
2025-10-02T08:11:04.150634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:04.150637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:04.150639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.150643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.150657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:04.150668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:04.150673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:04.150676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1065
2025-10-02T08:11:04.150704Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:04.150711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.150714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.150715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:04.150721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.150728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:04.150734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533954101017072:6477]
2025-10-02T08:11:04.150739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:04.150743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:04.150762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.150809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.150817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.150837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.150871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1066 partition: 0 MaxSeqNo: 17 sessionId: src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0
2025-10-02T08:11:04.151197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c1c07c-12ed26c8-4632db6a-775289e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:04.153750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0] Write session: try to update token
2025-10-02T08:11:04.153764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:04.168146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId: src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:04.168830Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:04.168843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:04.168846Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:04.168855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533954101017072:6477]
2025-10-02T08:11:04.168861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533954101017072:6477]
2025-10-02T08:11:04.168892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:04.168904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:04.168912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.168915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:04.168919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:04.169048Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:04.170817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:04.231793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533954101017139:11760]
2025-10-02T08:11:04.231925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1065, pipe: [1:7556533954101017139:11760]
2025-10-02T08:11:04.297144Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:04.297440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.297449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.297479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101017139:11760], now have 1 active actors on pipe
2025-10-02T08:11:04.297596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:04.297606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:04.297640Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:04.297681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1066 reason: error at write: Disconnected sessionId: src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0
2025-10-02T08:11:04.297737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:04.297884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1066 sessionId: src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0 is DEAD
2025-10-02T08:11:04.297898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533954101017139:11760]
2025-10-02T08:11:04.298028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:04.298038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0] Write session will restart in 0.005659s
2025-10-02T08:11:04.298060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0] Write session: Do CDS request
2025-10-02T08:11:04.298067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:04.306358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:04.306449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.306579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:04.306594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1067
2025-10-02T08:11:04.306711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.306738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:04.306748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:04.306752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:04.307223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1067 sessionId:  describe result for acl check
2025-10-02T08:11:04.307256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:04.307263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:04.307265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:04.307270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533954101017387:6470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:04.307684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:04.307793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533954101017387:6470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:04.307940Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:04.307952Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:04.307966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:04.308030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:04.308077Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533954101017391:6473]
2025-10-02T08:11:04.308844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:04.309059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:04.309107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:04.309457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:04.309508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.309524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.309525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.309526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.309528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.309534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.309545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.309550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.309555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.309559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.309565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.309574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.309581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.309587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.309592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.309599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.309604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.309613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.309619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.309624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.309647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:04.309718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533954101017387:6470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:04.316127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533954101017387:6470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:04.316146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533954101017387:6470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:04.316151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533954101017387:6470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:04.316160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:04.318447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:04.320530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:04.320545Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:04.320547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:04.320550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:04.320556Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1066 [1:7556533954101017391:6473]
2025-10-02T08:11:04.320568Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:04.320590Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:04.320593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.320597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.320599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.320623Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:04.320630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:04.320639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:04.320737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.320748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.320752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:04.320756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:04.320852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:04.320861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.320873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.320881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:04.320901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101017434:6470], now have 1 active actors on pipe
2025-10-02T08:11:04.320906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1066
2025-10-02T08:11:04.320914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533954101017380:6473]
2025-10-02T08:11:04.320916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533954101017380:6473]
2025-10-02T08:11:04.320923Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:04.320934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:04.320935Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:04.320938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:04.320952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:04.320954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:04.320960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533954561047772:2378], now have 1 active actors on pipe
2025-10-02T08:11:04.320965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.320968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.321011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533954101017380:6473]
2025-10-02T08:11:04.321026Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:04.321039Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:04.321041Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:04.321047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.321050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.321033Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1066
2025-10-02T08:11:04.321052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:04.321062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.321069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:04.321107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.321189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.321197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.321208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.321241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1067 partition: 0 MaxSeqNo: 17 sessionId: src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0
2025-10-02T08:11:04.321644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442c2e2-e29b03bd-5277ba28-2218e40e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:04.324239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0] Write session: try to update token
2025-10-02T08:11:04.324256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:04.338841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId: src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:04.338956Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:04.338975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:04.338978Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:04.338990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533954101017380:6473]
2025-10-02T08:11:04.338997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533954101017380:6473]
2025-10-02T08:11:04.339055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:04.339075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.339083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:04.339193Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:04.339212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:04.339261Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:04.341256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:04.398166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533954101017448:11760]
2025-10-02T08:11:04.398322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1066, pipe: [1:7556533954101017448:11760]
2025-10-02T08:11:04.474301Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:04.474843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.474872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.474908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101017448:11760], now have 1 active actors on pipe
2025-10-02T08:11:04.474996Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:04.475039Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:04.475135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:04.475197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0
2025-10-02T08:11:04.475241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533954101017448:11760]
2025-10-02T08:11:04.475386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1067 sessionId: src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0 is DEAD
2025-10-02T08:11:04.475617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:04.475633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0] Write session will restart in 0.009482s
2025-10-02T08:11:04.475656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0] Write session: Do CDS request
2025-10-02T08:11:04.475662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:04.484026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:04.485527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:04.485729Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:04.485737Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:04.485747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:04.485798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:04.485840Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533954101017745:6426]
2025-10-02T08:11:04.486385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.486457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:04.486471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:04.486477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1068
2025-10-02T08:11:04.486652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.486654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:04.486685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:04.486690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:04.486692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:04.486695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:04.486977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:04.487018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.487024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.487025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.487026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.487028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.487032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.487041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1068 sessionId:  describe result for acl check
2025-10-02T08:11:04.487042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.487047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.487050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.487054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.487059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.487066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.487070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:04.487072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:04.487072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.487073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:04.487077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.487078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533954101017758:6431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:04.487085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.487090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.487095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.487100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.487104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.487109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.487125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:04.487543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533954101017758:6431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:04.489963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533954101017758:6431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:04.494918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533954101017758:6431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:04.494933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533954101017758:6431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:04.494936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533954101017758:6431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:04.494945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:04.495095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:04.496627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:04.496638Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:04.496640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:04.496642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:04.496647Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1067 [1:7556533954101017745:6426]
2025-10-02T08:11:04.496654Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:04.496668Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:04.496670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.496672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.496673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.496686Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:04.496690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:04.496694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:04.496737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.496745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.496747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:04.496748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:04.496791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:04.496797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.496828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.496844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:04.496863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533954101017739:6426]
2025-10-02T08:11:04.496867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533954101017739:6426]
2025-10-02T08:11:04.496873Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:04.496876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1067
2025-10-02T08:11:04.496883Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:04.496885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101017790:6431], now have 1 active actors on pipe
2025-10-02T08:11:04.496886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:04.496891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:04.496903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:04.496906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:04.496911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533954561047800:2378], now have 1 active actors on pipe
2025-10-02T08:11:04.496915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.496919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.496956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533954101017739:6426]
2025-10-02T08:11:04.496968Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:04.496982Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:04.496983Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:04.496987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.496991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.496993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:04.497001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.496973Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1067
2025-10-02T08:11:04.497010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:04.497050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.497109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.497119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.497132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.497166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1068 partition: 0 MaxSeqNo: 17 sessionId: src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0
2025-10-02T08:11:04.497569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7d2187-99395cb0-723ab57e-cbfe29c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:04.500794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0] Write session: try to update token
2025-10-02T08:11:04.500845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:04.514057Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:04.514075Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:04.514077Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:04.514084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533954101017739:6426]
2025-10-02T08:11:04.514088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533954101017739:6426]
2025-10-02T08:11:04.514125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:04.514130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.514132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:04.514151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:04.514158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:04.514278Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:04.518031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId: src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:04.520629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:04.575287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533954101017804:11760]
2025-10-02T08:11:04.575430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1067, pipe: [1:7556533954101017804:11760]
2025-10-02T08:11:04.651484Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:04.651871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.651884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.651921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101017804:11760], now have 1 active actors on pipe
2025-10-02T08:11:04.652062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533954101017804:11760]
2025-10-02T08:11:04.652086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:04.652091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:04.652132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1068 reason: error at write: Disconnected sessionId: src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0
2025-10-02T08:11:04.652160Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:04.652202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:04.652319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1068 sessionId: src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0 is DEAD
2025-10-02T08:11:04.652503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:04.652524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0] Write session will restart in 0.007960s
2025-10-02T08:11:04.652548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0] Write session: Do CDS request
2025-10-02T08:11:04.652554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:04.661376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:04.661432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.661495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:04.661504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1069
2025-10-02T08:11:04.661697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.661732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:04.661759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:04.661766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:04.662131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1069 sessionId:  describe result for acl check
2025-10-02T08:11:04.662169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:04.662175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:04.662176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:04.662181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533954101018063:6423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:04.662662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:04.662723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533954101018063:6423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:04.662969Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:04.662981Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:04.662992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:04.663062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:04.663097Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533954101018068:6415]
2025-10-02T08:11:04.663502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:04.663679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:04.663741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:04.664077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:04.664130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.664138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.664139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.664140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.664141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.664147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.664155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.664159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.664162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.664166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.664171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.664177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.664183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.664194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.664198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.664207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.664216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.664220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.664230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.664238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.664259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:04.664798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533954101018063:6423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:04.671164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533954101018063:6423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:04.671180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533954101018063:6423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:04.671183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533954101018063:6423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:04.671192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:04.672087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:04.673723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:04.673735Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:04.673737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:04.673739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:04.673744Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1068 [1:7556533954101018068:6415]
2025-10-02T08:11:04.673753Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:04.673766Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:04.673768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.673770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.673771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.673784Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:04.673787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:04.673791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:04.673835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.673841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.673843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:04.673844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:04.673892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:04.673897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.673905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.673911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:04.673922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533954101018056:6415]
2025-10-02T08:11:04.673927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533954101018056:6415]
2025-10-02T08:11:04.673931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:04.673941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:04.673953Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:04.673957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:04.673959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:04.673963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:04.673969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101018110:6423], now have 1 active actors on pipe
2025-10-02T08:11:04.673982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1068
2025-10-02T08:11:04.673992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533954561047810:2378], now have 1 active actors on pipe
2025-10-02T08:11:04.673998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533954101018056:6415]
2025-10-02T08:11:04.674004Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:04.674008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.674012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:04.674015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.674047Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:04.674055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.674057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.674058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:04.674032Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1068
2025-10-02T08:11:04.674064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.674070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:04.674083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.674129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.674138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.674157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.674197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1069 partition: 0 MaxSeqNo: 17 sessionId: src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0
2025-10-02T08:11:04.674583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2530d162-bbb62bf2-dcce0ad7-ad2b1969_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:04.677664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0] Write session: try to update token
2025-10-02T08:11:04.677684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:04.691533Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:04.691553Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:04.691555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:04.691564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533954101018056:6415]
2025-10-02T08:11:04.691569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533954101018056:6415]
2025-10-02T08:11:04.691607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:04.691613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.691615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:04.691626Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:04.691633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:04.691741Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:04.695740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId: src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:04.698452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:04.752484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533954101018124:11760]
2025-10-02T08:11:04.752586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1068, pipe: [1:7556533954101018124:11760]
2025-10-02T08:11:04.819224Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:04.819576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.819589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.819625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101018124:11760], now have 1 active actors on pipe
2025-10-02T08:11:04.819725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:04.819733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:04.819796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1069 reason: error at write: Disconnected sessionId: src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0
2025-10-02T08:11:04.819841Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:04.819821Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:04.819993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1069 sessionId: src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0 is DEAD
2025-10-02T08:11:04.820136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:04.820150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0] Write session will restart in 0.006724s
2025-10-02T08:11:04.820146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533954101018124:11760]
2025-10-02T08:11:04.820176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0] Write session: Do CDS request
2025-10-02T08:11:04.820184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:04.827118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:04.828173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:04.828318Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:04.828324Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:04.828331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:04.828368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:04.828389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.828396Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533954101018379:6419]
2025-10-02T08:11:04.828445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:04.828454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1070
2025-10-02T08:11:04.828591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:04.828618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:04.828625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:04.828628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:04.828879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:04.828908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1070 sessionId:  describe result for acl check
2025-10-02T08:11:04.828931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:04.828935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:04.828936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:04.828940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533954101018385:6418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:04.829038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:04.829083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:04.829307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533954101018385:6418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:04.829360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:04.829404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.829409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.829410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.829411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.829412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.829417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.829426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.829433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.829436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.829439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.829443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.829449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:04.829460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.829464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:04.829469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.829475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:04.829479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.829487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.829498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.829503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.829524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:04.830973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533954101018385:6418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:04.835386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533954101018385:6418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:04.835397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533954101018385:6418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:04.835399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533954101018385:6418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:04.835405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:04.836910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:04.838379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:04.838390Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:04.838392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:04.838394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:04.838398Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1069 [1:7556533954101018379:6419]
2025-10-02T08:11:04.838406Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:04.838417Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:04.838419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.838421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.838423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.838434Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:04.838442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:04.838447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:04.838491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.838496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.838498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:04.838500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:04.838655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1069
2025-10-02T08:11:04.838543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:04.838550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.838557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:04.838564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:04.838576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101018427:6418], now have 1 active actors on pipe
2025-10-02T08:11:04.838580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533954101018373:6419]
2025-10-02T08:11:04.838582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533954101018373:6419]
2025-10-02T08:11:04.838587Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:04.838588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1069
2025-10-02T08:11:04.838594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:04.838597Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:04.838600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:04.838602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:04.838603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:04.838607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533954561047829:2378], now have 1 active actors on pipe
2025-10-02T08:11:04.838610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.838612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.838641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533954101018373:6419]
2025-10-02T08:11:04.838647Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:04.838657Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:04.838657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:04.838661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:04.838663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:04.838665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:04.838670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:04.838676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:04.838701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.838735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.838736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.838744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:04.838771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1070 partition: 0 MaxSeqNo: 17 sessionId: src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0
2025-10-02T08:11:04.839133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd1bcfc-381859c3-90bcb2e4-9cb8b99f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:04.842060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0] Write session: try to update token
2025-10-02T08:11:04.842076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:04.855403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId: src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:04.855986Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:04.856001Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:04.856003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:04.856010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533954101018373:6419]
2025-10-02T08:11:04.856013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533954101018373:6419]
2025-10-02T08:11:04.856048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:04.856058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:04.856059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:04.856103Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:04.856113Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:04.856190Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:04.858061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:04.920367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533954101018440:11760]
2025-10-02T08:11:04.920440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1069, pipe: [1:7556533954101018440:11760]
2025-10-02T08:11:04.991895Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:04.992241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:04.992262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:04.992309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533954101018440:11760], now have 1 active actors on pipe
2025-10-02T08:11:04.992431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533954101018440:11760]
2025-10-02T08:11:04.992460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:04.992462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:04.992517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1070 reason: error at write: Disconnected sessionId: src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0
2025-10-02T08:11:04.992568Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:04.992589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:04.992744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1070 sessionId: src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0 is DEAD
2025-10-02T08:11:04.992942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:04.992953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0] Write session will restart in 0.008620s
2025-10-02T08:11:04.992982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0] Write session: Do CDS request
2025-10-02T08:11:04.992990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:05.002473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.002550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:05.002567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1071
2025-10-02T08:11:05.002767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.002815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:05.002825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:05.002828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:05.003281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1071 sessionId:  describe result for acl check
2025-10-02T08:11:05.003312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:05.003314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:05.003316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:05.003320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533958395985990:6407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:05.003818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533958395985990:6407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:05.006028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:05.006062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533958395985990:6407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:05.006850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:05.007015Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:05.007028Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:05.007039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:05.007088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:05.007127Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533958395986037:6408]
2025-10-02T08:11:05.007742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:05.007982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:05.008042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:05.008405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:05.008464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.008471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.008472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.008474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.008475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.008481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.008491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.008495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.008499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.008503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.008511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.008526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.008532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.008537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.008543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.008549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.008556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.008562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.008567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.008574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.008594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:05.008922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533958395985990:6407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:05.008935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533958395985990:6407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:05.008939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533958395985990:6407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:05.008948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:05.017439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:05.019173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:05.019193Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:05.019196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:05.019200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:05.019208Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1070 [1:7556533958395986037:6408]
2025-10-02T08:11:05.019219Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:05.019239Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:05.019246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.019250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.019252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.019269Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:05.019278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:05.019285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:05.019354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.019372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.019379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:05.019382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:05.019450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:05.019458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.019472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.019489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:05.019509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533958395986021:6408]
2025-10-02T08:11:05.019516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533958395986021:6408]
2025-10-02T08:11:05.019523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:05.019538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395986054:6407], now have 1 active actors on pipe
2025-10-02T08:11:05.019540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:05.019542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1070
2025-10-02T08:11:05.019545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:05.019546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:05.019560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:05.019562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:05.019568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533954561047837:2378], now have 1 active actors on pipe
2025-10-02T08:11:05.019600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.019604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.019617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533958395986021:6408]
2025-10-02T08:11:05.019628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:05.019634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:05.019653Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4128687-f780847e-e298c61-23d94048_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:05.019664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.019646Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1070
2025-10-02T08:11:05.019668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.019670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:05.019680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.019688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:05.019715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.019759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.019766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.019779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.019831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1071 partition: 0 MaxSeqNo: 17 sessionId: src_id|d4128687-f780847e-e298c61-23d94048_0
2025-10-02T08:11:05.020258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc5b5f9-6a577ca-6cf535fa-5ed82f9c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d4128687-f780847e-e298c61-23d94048_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:05.023424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4128687-f780847e-e298c61-23d94048_0] Write session: try to update token
2025-10-02T08:11:05.023444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4128687-f780847e-e298c61-23d94048_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:05.036930Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:05.036944Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:05.036946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:05.036954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533958395986021:6408]
2025-10-02T08:11:05.036957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533958395986021:6408]
2025-10-02T08:11:05.036991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:05.036996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.036997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:05.037011Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:05.037022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:05.037120Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:05.039700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId: src_id|d4128687-f780847e-e298c61-23d94048_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:05.042547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:05.092452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533958395986069:11760]
2025-10-02T08:11:05.092570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1070, pipe: [1:7556533958395986069:11760]
2025-10-02T08:11:05.166488Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:05.166856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.166872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.166916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395986069:11760], now have 1 active actors on pipe
2025-10-02T08:11:05.167040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:05.167048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:05.167114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1071 reason: error at write: Disconnected sessionId: src_id|d4128687-f780847e-e298c61-23d94048_0
2025-10-02T08:11:05.167159Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:05.167155Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:05.167307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1071 sessionId: src_id|d4128687-f780847e-e298c61-23d94048_0 is DEAD
2025-10-02T08:11:05.167447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533958395986069:11760]
2025-10-02T08:11:05.167500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4128687-f780847e-e298c61-23d94048_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:05.167514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4128687-f780847e-e298c61-23d94048_0] Write session will restart in 0.005325s
2025-10-02T08:11:05.167539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4128687-f780847e-e298c61-23d94048_0] Write session: Do CDS request
2025-10-02T08:11:05.167545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4128687-f780847e-e298c61-23d94048_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:05.174368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4128687-f780847e-e298c61-23d94048_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.174432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:05.174445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1072
2025-10-02T08:11:05.174577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.174604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:05.174613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:05.174616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:05.175017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1072 sessionId:  describe result for acl check
2025-10-02T08:11:05.175050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:05.175057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:05.175058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:05.175062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533958395986307:6390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:05.175504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533958395986307:6390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:05.176571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:05.177500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533958395986307:6390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:05.177915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:05.178096Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:05.178105Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:05.178115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:05.178157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:05.178194Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533958395986359:6389]
2025-10-02T08:11:05.178801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:05.178991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:05.179045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:05.179403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:05.179452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.179458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.179459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.179460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.179461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.179466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.179475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.179479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.179482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.179486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.179491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.179499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.179508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.179514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.179521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.179528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.179535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.179540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.179544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.179549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.179567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:05.180284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533958395986307:6390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:05.180298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533958395986307:6390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:05.180301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533958395986307:6390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:05.180307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:05.187677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:05.189236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:05.189249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:05.189251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:05.189253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:05.189259Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1071 [1:7556533958395986359:6389]
2025-10-02T08:11:05.189266Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:05.189280Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:05.189282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.189284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.189286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.189297Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:05.189301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:05.189307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:05.189356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.189362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.189364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:05.189365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:05.189418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:05.189424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.189436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.189452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:05.189471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533958395986339:6389]
2025-10-02T08:11:05.189476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533958395986339:6389]
2025-10-02T08:11:05.189481Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:05.189491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395986377:6390], now have 1 active actors on pipe
2025-10-02T08:11:05.189494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:05.189497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:05.189501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1071
2025-10-02T08:11:05.189503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:05.189515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:05.189520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:05.189526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533958856015140:2378], now have 1 active actors on pipe
2025-10-02T08:11:05.189534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.189536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.189576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533958395986339:6389]
2025-10-02T08:11:05.189589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:05.189607Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:05.189607Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb59f541-40964e3e-ed0398e5-830df01e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:05.189611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.189614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.189616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:05.189622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.189630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:05.189642Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1071
2025-10-02T08:11:05.189667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.189737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.189743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.189757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.189799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1072 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb59f541-40964e3e-ed0398e5-830df01e_0
2025-10-02T08:11:05.190199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4128687-f780847e-e298c61-23d94048_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb59f541-40964e3e-ed0398e5-830df01e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:05.193404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb59f541-40964e3e-ed0398e5-830df01e_0] Write session: try to update token
2025-10-02T08:11:05.193423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb59f541-40964e3e-ed0398e5-830df01e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:05.208292Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:05.208308Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:05.208310Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:05.208317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533958395986339:6389]
2025-10-02T08:11:05.208322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533958395986339:6389]
2025-10-02T08:11:05.208359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:05.208364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.208365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:05.208374Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:05.208381Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:05.208496Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:05.209123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId: src_id|fb59f541-40964e3e-ed0398e5-830df01e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:05.211725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:05.268019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533958395986391:11760]
2025-10-02T08:11:05.268182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1071, pipe: [1:7556533958395986391:11760]
2025-10-02T08:11:05.350487Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:05.350821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.350835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.350876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395986391:11760], now have 1 active actors on pipe
2025-10-02T08:11:05.351015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533958395986391:11760]
2025-10-02T08:11:05.351036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:05.351041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:05.351098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1072 reason: error at write: Disconnected sessionId: src_id|fb59f541-40964e3e-ed0398e5-830df01e_0
2025-10-02T08:11:05.351159Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:05.351268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1072 sessionId: src_id|fb59f541-40964e3e-ed0398e5-830df01e_0 is DEAD
2025-10-02T08:11:05.351332Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:05.351460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb59f541-40964e3e-ed0398e5-830df01e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:05.351476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb59f541-40964e3e-ed0398e5-830df01e_0] Write session will restart in 0.009269s
2025-10-02T08:11:05.351507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb59f541-40964e3e-ed0398e5-830df01e_0] Write session: Do CDS request
2025-10-02T08:11:05.351513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb59f541-40964e3e-ed0398e5-830df01e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:05.361230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:05.362288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:05.362434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb59f541-40964e3e-ed0398e5-830df01e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.362457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:05.362466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1073
2025-10-02T08:11:05.362527Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:05.362540Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:05.362551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:05.362610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:05.362651Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533958395986653:6378]
2025-10-02T08:11:05.362698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.362741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:05.362751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:05.362755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:05.363100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1073 sessionId:  describe result for acl check
2025-10-02T08:11:05.363128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:05.363133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:05.363135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:05.363139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533958395986657:6377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:05.363247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:05.363443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:05.363479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:05.363531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533958395986657:6377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:05.363756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:05.363817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.363823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.363824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.363824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.363825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.363830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.363839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.363843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.363852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.363859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.363864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.363878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.363889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.363894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.363898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.363903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.363912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.363917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.363926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.363930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.363946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:05.365745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533958395986657:6377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:05.370834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533958395986657:6377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:05.370855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533958395986657:6377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:05.370859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533958395986657:6377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:05.370875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:05.372466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:05.374302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:05.374320Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:05.374323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:05.374326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:05.374333Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1072 [1:7556533958395986653:6378]
2025-10-02T08:11:05.374345Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:05.374363Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:05.374366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.374369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.374371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.374386Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:05.374394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:05.374401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:05.374466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.374476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.374479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:05.374483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:05.374554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:05.374561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.374577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.374600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:05.374616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1072
2025-10-02T08:11:05.374618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395986700:6377], now have 1 active actors on pipe
2025-10-02T08:11:05.374621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533958856015147:2378], now have 1 active actors on pipe
2025-10-02T08:11:05.374627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533958395986646:6378]
2025-10-02T08:11:05.374629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533958395986646:6378]
2025-10-02T08:11:05.374640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:05.374649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.374658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.374658Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:05.374662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:05.374676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:05.374689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:05.374697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:05.374738Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:05.374750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.374755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.374715Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1072
2025-10-02T08:11:05.374761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:05.374771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.374780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:05.374787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533958395986646:6378]
2025-10-02T08:11:05.374801Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:05.374816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:05.374843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.374879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.374886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.374900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.374938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1073 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0
2025-10-02T08:11:05.375360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb59f541-40964e3e-ed0398e5-830df01e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:05.378489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0] Write session: try to update token
2025-10-02T08:11:05.378512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:05.393035Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:05.393055Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:05.393057Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:05.393066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533958395986646:6378]
2025-10-02T08:11:05.393072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533958395986646:6378]
2025-10-02T08:11:05.393114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:05.393121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.393123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:05.393122Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:05.393129Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:05.393277Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:05.395508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId: src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:05.398316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:05.451374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533958395986714:11760]
2025-10-02T08:11:05.451508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1072, pipe: [1:7556533958395986714:11760]
2025-10-02T08:11:05.534221Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:05.534451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.534462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.534496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395986714:11760], now have 1 active actors on pipe
2025-10-02T08:11:05.534625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:05.534628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:05.534696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1073 reason: error at write: Disconnected sessionId: src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0
2025-10-02T08:11:05.534776Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:05.534762Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:05.534900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1073 sessionId: src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0 is DEAD
2025-10-02T08:11:05.535074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533958395986714:11760]
2025-10-02T08:11:05.535101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:05.535117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0] Write session will restart in 0.006618s
2025-10-02T08:11:05.535148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0] Write session: Do CDS request
2025-10-02T08:11:05.535155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:05.543484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.543529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:05.543544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1074
2025-10-02T08:11:05.543767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.543812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:05.543817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:05.543821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:05.544260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1074 sessionId:  describe result for acl check
2025-10-02T08:11:05.544296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:05.544303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:05.544305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:05.544310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533958395987002:6352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:05.544853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533958395987002:6352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:05.545557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:05.546768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:05.546990Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:05.547000Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:05.547010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:05.547064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:05.547092Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533958395987036:6355]
2025-10-02T08:11:05.547265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533958395987002:6352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:05.547599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:05.547774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:05.547843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:05.548173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:05.548225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.548231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.548232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.548234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.548235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.548240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.548251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.548256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.548260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.548265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.548270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.548278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.548284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.548289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.548298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.548310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.548315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.548320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.548326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.548336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.548356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:05.553339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533958395987002:6352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:05.553353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533958395987002:6352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:05.553355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533958395987002:6352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:05.553361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:05.556688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:05.558292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:05.558309Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:05.558312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:05.558316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:05.558326Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1073 [1:7556533958395987036:6355]
2025-10-02T08:11:05.558338Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:05.558356Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:05.558364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.558369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.558371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.558389Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:05.558402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:05.558411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:05.558533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.558542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.558544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:05.558547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:05.558620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:05.558627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.558641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.558657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:05.558678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1073
2025-10-02T08:11:05.558680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395987063:6352], now have 1 active actors on pipe
2025-10-02T08:11:05.558684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533958856015177:2378], now have 1 active actors on pipe
2025-10-02T08:11:05.558689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533958395987019:6355]
2025-10-02T08:11:05.558691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533958395987019:6355]
2025-10-02T08:11:05.558704Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:05.558714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.558718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.558735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:05.558748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:05.558756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:05.558760Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1073
2025-10-02T08:11:05.558797Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:05.558809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.558812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.558815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:05.558814Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:05.558817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:05.558823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.558831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:05.558843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533958395987019:6355]
2025-10-02T08:11:05.558850Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:05.558852Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:05.558873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.558915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.558929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.558959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.559002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1074 partition: 0 MaxSeqNo: 17 sessionId: src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0
2025-10-02T08:11:05.559587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b22853-cff7c962-4134a8e0-2dc4a452_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:05.562895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0] Write session: try to update token
2025-10-02T08:11:05.562919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:05.576752Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:05.576773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:05.576776Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:05.576785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533958395987019:6355]
2025-10-02T08:11:05.576790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533958395987019:6355]
2025-10-02T08:11:05.576846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:05.576850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:05.576858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.576859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:05.576860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:05.577003Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:05.580244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId: src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:05.583388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:05.635156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533958395987082:11760]
2025-10-02T08:11:05.635301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1073, pipe: [1:7556533958395987082:11760]
2025-10-02T08:11:05.712304Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:05.712581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.712591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.712624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395987082:11760], now have 1 active actors on pipe
2025-10-02T08:11:05.712789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533958395987082:11760]
2025-10-02T08:11:05.712840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:05.712856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:05.712948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1074 reason: error at write: Disconnected sessionId: src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0
2025-10-02T08:11:05.712974Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:05.713046Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:05.713175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1074 sessionId: src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0 is DEAD
2025-10-02T08:11:05.713362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:05.713377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0] Write session will restart in 0.007278s
2025-10-02T08:11:05.713416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0] Write session: Do CDS request
2025-10-02T08:11:05.713423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:05.722452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.722546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:05.722571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1075
2025-10-02T08:11:05.722964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.723008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:05.723017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:05.723020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:05.723428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1075 sessionId:  describe result for acl check
2025-10-02T08:11:05.723462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:05.723464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:05.723465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:05.723471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533958395987247:6336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:05.724065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533958395987247:6336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:05.727844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533958395987247:6336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:05.728688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:05.730270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:05.730473Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:05.730485Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:05.730495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:05.730550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:05.730592Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533958395987378:6331]
2025-10-02T08:11:05.731076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533958395987247:6336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:05.731091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533958395987247:6336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:05.731095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533958395987247:6336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:05.731105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:05.731236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:05.731407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:05.731454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:05.731761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:05.731826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.731833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.731834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.731835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.731836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.731842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.731852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.731857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.731861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.731865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.731871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.731878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.731889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.731895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.731899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.731912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.731921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.731926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.731931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.731940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.731963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:05.741195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:05.742772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:05.742788Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:05.742790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:05.742794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:05.742799Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1074 [1:7556533958395987378:6331]
2025-10-02T08:11:05.742808Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:05.742822Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:05.742828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.742830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.742832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.742843Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:05.742847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:05.742852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:05.742904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.742912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.742917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:05.742919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:05.742971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:05.742979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.742990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.743001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:05.743022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533958395987370:6331]
2025-10-02T08:11:05.743029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533958395987370:6331]
2025-10-02T08:11:05.743036Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:05.743047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:05.743048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1074
2025-10-02T08:11:05.743049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395987383:6336], now have 1 active actors on pipe
2025-10-02T08:11:05.743054Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:05.743056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:05.743068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:05.743071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:05.743076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533958856015184:2378], now have 1 active actors on pipe
2025-10-02T08:11:05.743081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.743085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.743122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533958395987370:6331]
2025-10-02T08:11:05.743133Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:05.743142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:05.743146Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:05.743152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.743156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.743158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:05.743165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.743178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:05.743215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.743256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.743263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.743221Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1074
2025-10-02T08:11:05.743286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.743329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1075 partition: 0 MaxSeqNo: 17 sessionId: src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0
2025-10-02T08:11:05.743698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8479e798-7eb69a4e-23dceaa8-ff820a1a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:05.746626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0] Write session: try to update token
2025-10-02T08:11:05.746647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:05.755370Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:05.755385Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:05.755397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533958395987370:6331]
2025-10-02T08:11:05.755450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:05.755453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:05.755663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:05.755845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:05.756007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:05.756168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:05.756407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:05.756459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:05.761933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId: src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:05.764922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:05.765003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.765019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.765068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:05.765095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:05.765184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.765206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.765388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.765465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.765533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.765601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.765661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.765671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.765741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.765806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.765882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.765953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.766004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.766014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.766084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.766166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.766238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.766309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.766357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.766370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.766441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.766506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.766570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.766638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.766684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.766693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.766761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.766829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.766898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.766963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.767008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.767021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.767087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.767151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.767220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.767299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.767344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.767353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.767421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.767485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.767586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.767655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.767704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.767713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.767781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.767857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.767923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.767994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.768043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.768051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.768119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.768183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.768250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.768317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.768360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.768368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.768435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:05.768499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:05.768567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:05.768630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:05.768673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:05.768676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:05.768722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:05.768785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.768828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.768840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:05.768872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:05.768891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:05.768900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:05.768903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:05.768907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:05.769316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:05.769347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:05.769353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:05.769356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:05.769360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:05.769363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:05.770043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:05.770067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:05.770073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:05.770076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:05.770081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:05.770085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:05.770568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:05.770589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:05.770594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:05.770604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:05.770607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:05.772909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:05.772935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:05.772947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392665772
2025-10-02T08:11:05.773123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:05.773137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:05.773143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:05.773147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:05.773152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:05.773155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:05.773636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:05.773665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:05.773672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:05.773676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:05.773679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:05.773685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:05.774148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:05.774168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:05.774176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:05.774180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:05.774184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:05.774188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:05.774630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:05.774651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:05.774656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:05.775745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:05.775763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:05.775768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:05.775775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:05.775783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392665775
2025-10-02T08:11:05.776071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:05.776092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:05.776098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:05.776103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:05.776106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:05.776110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:05.776542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:05.776563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:05.776568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:05.776572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:05.776577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:05.776581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:05.777040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:05.777059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.777179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392665776
2025-10-02T08:11:05.781230Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:05.781254Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:05.781263Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:05.781271Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:05.783008Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:05.783027Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:05.783029Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:05.783043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533958395987370:6331]
2025-10-02T08:11:05.783049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533958395987370:6331]
2025-10-02T08:11:05.783120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:05.783124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:05.783130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.783132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:05.783134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:05.783273Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:05.812779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533958395987418:11760]
2025-10-02T08:11:05.812862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1074, pipe: [1:7556533958395987418:11760]
2025-10-02T08:11:05.936176Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:05.936518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395987418:11760], now have 1 active actors on pipe
2025-10-02T08:11:05.936615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:05.936625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:05.936655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1075 reason: error at write: Disconnected sessionId: src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0
2025-10-02T08:11:05.936713Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:05.936837Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:05.936916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1075 sessionId: src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0 is DEAD
2025-10-02T08:11:05.937048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:05.937062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0] Write session will restart in 0.005826s
2025-10-02T08:11:05.937045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533958395987418:11760]
2025-10-02T08:11:05.937091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0] Write session: Do CDS request
2025-10-02T08:11:05.937099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:05.944379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.944564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:05.944583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1076
2025-10-02T08:11:05.944729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:05.944769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:05.944786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:05.944790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:05.945301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1076 sessionId:  describe result for acl check
2025-10-02T08:11:05.945339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:05.945347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:05.945349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:05.945354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533958395987608:6322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:05.945853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533958395987608:6322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:05.949165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533958395987608:6322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:05.953021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:05.954887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:05.955087Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:05.955106Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:05.955118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:05.955176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:05.955242Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533958395987728:6323]
2025-10-02T08:11:05.955893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:05.956171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:05.956223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:05.956523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:05.956591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.956600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.956602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.956603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.956604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.956610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.956620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.956623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.956627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.956630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.956636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.956642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:05.956649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.956654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:05.956658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.956663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:05.956667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.956672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.956676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.956681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.956698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:05.957902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533958395987608:6322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:05.957924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533958395987608:6322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:05.957928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533958395987608:6322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:05.957937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:05.966347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:05.968225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:05.968243Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:05.968246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:05.968252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:05.968266Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1075 [1:7556533958395987728:6323]
2025-10-02T08:11:05.968282Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:05.968305Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:05.968307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.968310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.968311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.968328Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:05.968332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:05.968340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:05.968419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.968431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.968435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:05.968438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:05.968509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:05.968515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.968526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:05.968535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:05.968554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533958395987722:6323]
2025-10-02T08:11:05.968561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533958395987722:6323]
2025-10-02T08:11:05.968570Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:05.968591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:05.968595Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:05.968600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:05.968605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1075
2025-10-02T08:11:05.968607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:05.968611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:05.968626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533958395987745:6322], now have 1 active actors on pipe
2025-10-02T08:11:05.968675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533958856015204:2378], now have 1 active actors on pipe
2025-10-02T08:11:05.968685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.968690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.968708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533958395987722:6323]
2025-10-02T08:11:05.968717Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:05.968696Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1075
2025-10-02T08:11:05.968733Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:05.968749Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:05.968757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:05.968764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:05.968766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:05.968779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:05.968793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:05.968844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.968920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:05.968926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:05.968937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:05.968975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1076 partition: 0 MaxSeqNo: 17 sessionId: src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0
2025-10-02T08:11:05.969387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc84f43-f5e17cdd-770a6bfe-f0617800_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:05.972793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0] Write session: try to update token
2025-10-02T08:11:05.972844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:05.991568Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:05.991587Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:05.991590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:05.991600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533958395987722:6323]
2025-10-02T08:11:05.991605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533958395987722:6323]
2025-10-02T08:11:05.991653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:05.991660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:05.991663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:05.991675Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:05.991691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:05.991834Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:05.992782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId: src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:05.996226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:06.037075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533962690955055:11760]
2025-10-02T08:11:06.037208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1075, pipe: [1:7556533962690955055:11760]
2025-10-02T08:11:06.131398Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:06.131658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.131675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.131711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690955055:11760], now have 1 active actors on pipe
2025-10-02T08:11:06.131854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:06.131868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:06.131943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1076 reason: error at write: Disconnected sessionId: src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0
2025-10-02T08:11:06.131991Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:06.132153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1076 sessionId: src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0 is DEAD
2025-10-02T08:11:06.132338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:06.132350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0] Write session will restart in 0.009956s
2025-10-02T08:11:06.132377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0] Write session: Do CDS request
2025-10-02T08:11:06.132368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533962690955055:11760]
2025-10-02T08:11:06.132385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:06.132621Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:06.143487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.143567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:06.143581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1077
2025-10-02T08:11:06.143753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.143799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:06.143810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:06.143813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:06.143815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:06.144319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1077 sessionId:  describe result for acl check
2025-10-02T08:11:06.144364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:06.144372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:06.144373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:06.144380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533962690955328:6317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:06.144855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533962690955328:6317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:06.145584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:06.145795Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:06.145803Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:06.145811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:06.145863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:06.145908Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533962690955337:6313]
2025-10-02T08:11:06.146444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:06.146627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:06.146669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:06.146913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:06.146963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.146964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.146966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.146967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.146968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.146973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.146982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.146986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.146990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.146993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.146999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.147012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.147022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.147028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.147036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.147041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.147046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.147051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.147055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.147060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.147089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:06.147278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533962690955328:6317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:06.154564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533962690955328:6317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:06.154582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533962690955328:6317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:06.154586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533962690955328:6317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:06.154596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:06.155969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:06.157904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:06.157925Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:06.157927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:06.157931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:06.157937Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1076 [1:7556533962690955337:6313]
2025-10-02T08:11:06.157950Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:06.157968Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:06.157971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.157974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.157977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.157993Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:06.157998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:06.158006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:06.158071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.158079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.158082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:06.158085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:06.158151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:06.158158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.158173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.158190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:06.158213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533962690955320:6313]
2025-10-02T08:11:06.158223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533962690955320:6313]
2025-10-02T08:11:06.158231Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:06.158244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1076
2025-10-02T08:11:06.158247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690955374:6317], now have 1 active actors on pipe
2025-10-02T08:11:06.158255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:06.158262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:06.158267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:06.158267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:06.158270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:06.158275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533963150982509:2378], now have 1 active actors on pipe
2025-10-02T08:11:06.158309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.158317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.158331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533962690955320:6313]
2025-10-02T08:11:06.158339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:06.158350Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:06.158366Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:06.158377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.158382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.158325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1076
2025-10-02T08:11:06.158388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:06.158397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.158406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:06.158438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.158503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.158510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.158523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.158563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1077 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0
2025-10-02T08:11:06.158969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c60ef-d5fa938-4d6a8132-e3e18146_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:06.162042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0] Write session: try to update token
2025-10-02T08:11:06.162064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:06.177493Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:06.177514Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:06.177517Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:06.177528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533962690955320:6313]
2025-10-02T08:11:06.177533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533962690955320:6313]
2025-10-02T08:11:06.177575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:06.177577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:06.177580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:06.177585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.177588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:06.177741Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:06.180089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId: src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:06.183165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:06.232622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533962690955388:11760]
2025-10-02T08:11:06.232779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1076, pipe: [1:7556533962690955388:11760]
2025-10-02T08:11:06.323023Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:06.323330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.323344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.323381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690955388:11760], now have 1 active actors on pipe
2025-10-02T08:11:06.323562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533962690955388:11760]
2025-10-02T08:11:06.323590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:06.323597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:06.323603Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:06.323675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1077 reason: error at write: Disconnected sessionId: src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0
2025-10-02T08:11:06.323661Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:06.323903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1077 sessionId: src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0 is DEAD
2025-10-02T08:11:06.324064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:06.324077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0] Write session will restart in 0.007890s
2025-10-02T08:11:06.324108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0] Write session: Do CDS request
2025-10-02T08:11:06.324116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:06.333461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.333533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:06.333550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1078
2025-10-02T08:11:06.333651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:06.333710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.333739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:06.333748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:06.333753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:06.334135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1078 sessionId:  describe result for acl check
2025-10-02T08:11:06.334164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:06.334170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:06.334172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:06.334176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533962690955660:6297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:06.334679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533962690955660:6297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:06.335064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:06.335213Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:06.335222Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:06.335232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:06.335283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:06.335322Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533962690955667:6307]
2025-10-02T08:11:06.335924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:06.336102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:06.336212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:06.336524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:06.336568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.336575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.336576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.336577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.336578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.336583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.336592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.336596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.336600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.336604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.336613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.336620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.336630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.336634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.336643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.336647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.336652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.336657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.336662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.336667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.336690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:06.336982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533962690955660:6297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:06.343310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533962690955660:6297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:06.343327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533962690955660:6297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:06.343330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533962690955660:6297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:06.343338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:06.346254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:06.347899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:06.347911Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:06.347915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:06.347918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:06.347925Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1077 [1:7556533962690955667:6307]
2025-10-02T08:11:06.347939Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:06.347954Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:06.347962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.347965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.347967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.347982Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:06.347988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:06.347995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:06.348052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.348059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.348062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:06.348064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:06.348125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:06.348134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.348148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.348166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:06.348188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690955708:6297], now have 1 active actors on pipe
2025-10-02T08:11:06.348194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1077
2025-10-02T08:11:06.348195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533963150982517:2378], now have 1 active actors on pipe
2025-10-02T08:11:06.348201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533962690955653:6307]
2025-10-02T08:11:06.348203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533962690955653:6307]
2025-10-02T08:11:06.348214Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:06.348230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:06.348232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:06.348240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:06.348247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:06.348250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:06.348261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.348270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.348241Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1077
2025-10-02T08:11:06.348309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533962690955653:6307]
2025-10-02T08:11:06.348320Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:06.348340Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:06.348343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:06.348350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.348354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.348356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:06.348366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.348374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:06.348416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.348490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.348496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.348509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.348546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1078 partition: 0 MaxSeqNo: 17 sessionId: src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0
2025-10-02T08:11:06.348980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14947e-e9c26403-3e0482d9-912ffd62_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:06.352229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0] Write session: try to update token
2025-10-02T08:11:06.352253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:06.366883Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:06.366899Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:06.366901Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:06.366916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533962690955653:6307]
2025-10-02T08:11:06.366920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533962690955653:6307]
2025-10-02T08:11:06.366963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:06.366964Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:06.366970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.366971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:06.366972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:06.367119Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:06.370086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId: src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:06.372785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:06.423655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533962690955721:11760]
2025-10-02T08:11:06.423832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1077, pipe: [1:7556533962690955721:11760]
2025-10-02T08:11:06.515595Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:06.515903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.515918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.515955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690955721:11760], now have 1 active actors on pipe
2025-10-02T08:11:06.516138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:06.516420Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:06.516670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533962690955721:11760]
2025-10-02T08:11:06.516688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:06.516738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1078 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0
2025-10-02T08:11:06.516938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1078 sessionId: src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0 is DEAD
2025-10-02T08:11:06.517133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:06.517147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0] Write session will restart in 0.009035s
2025-10-02T08:11:06.517180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0] Write session: Do CDS request
2025-10-02T08:11:06.517188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:06.527234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:06.527481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.527532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:06.527542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1079
2025-10-02T08:11:06.527687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.527716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:06.527725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:06.527728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:06.528128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1079 sessionId:  describe result for acl check
2025-10-02T08:11:06.528158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:06.528159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:06.528161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:06.528166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533962690956010:6270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:06.528740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:06.528929Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:06.528938Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:06.528948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:06.528992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:06.529028Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533962690956015:6274]
2025-10-02T08:11:06.529696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:06.529775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533962690956010:6270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:06.529902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:06.529947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:06.530271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:06.530341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.530351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.530352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.530354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.530355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.530362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.530373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.530378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.530382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.530386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.530391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.530399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.530405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.530415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.530420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.530424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.530429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.530434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.530443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.530448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.530468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:06.532557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533962690956010:6270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:06.539026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:06.540900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:06.540918Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:06.540920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:06.540923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:06.540928Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1078 [1:7556533962690956015:6274]
2025-10-02T08:11:06.540941Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:06.540958Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:06.540961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.540964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.540966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.540984Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:06.540988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:06.540994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:06.541057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.541067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.541070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:06.541073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:06.541139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:06.541148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.541161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.541173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:06.541190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533962690956004:6274]
2025-10-02T08:11:06.541192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533962690956004:6274]
2025-10-02T08:11:06.541200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:06.541213Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:06.541217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:06.541219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:06.541231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:06.541240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:06.541251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533963150982528:2378], now have 1 active actors on pipe
2025-10-02T08:11:06.541290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533962690956004:6274]
2025-10-02T08:11:06.541302Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:06.541323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:06.541654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533962690956010:6270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:06.541670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533962690956010:6270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:06.541674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533962690956010:6270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:06.541684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:06.541909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690956064:6270], now have 1 active actors on pipe
2025-10-02T08:11:06.541970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1078
2025-10-02T08:11:06.542093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.542104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.542126Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:06.542138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.542146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.542148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:06.542156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.542173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:06.542193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.542245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.542251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.542262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.542291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1079 partition: 0 MaxSeqNo: 17 sessionId: src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0
2025-10-02T08:11:06.542703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bd364a0-4b26cdc9-fc2cb42c-7e92e4bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:06.541309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1078
2025-10-02T08:11:06.546204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0] Write session: try to update token
2025-10-02T08:11:06.546249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:06.560448Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:06.560467Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:06.560468Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:06.560475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533962690956004:6274]
2025-10-02T08:11:06.560478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533962690956004:6274]
2025-10-02T08:11:06.560511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:06.560520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.560525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:06.560529Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:06.560534Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:06.560654Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:06.564935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId: src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:06.568075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:06.616687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533962690956099:11760]
2025-10-02T08:11:06.616880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1078, pipe: [1:7556533962690956099:11760]
2025-10-02T08:11:06.698960Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:06.699318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.699330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.699358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690956099:11760], now have 1 active actors on pipe
2025-10-02T08:11:06.699439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533962690956099:11760]
2025-10-02T08:11:06.699456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:06.699457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:06.699502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1079 reason: error at write: Disconnected sessionId: src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0
2025-10-02T08:11:06.699586Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:06.699635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1079 sessionId: src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0 is DEAD
2025-10-02T08:11:06.699903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:06.699912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0] Write session will restart in 0.006279s
2025-10-02T08:11:06.699929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0] Write session: Do CDS request
2025-10-02T08:11:06.699935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:06.700269Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:06.707431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.707469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:06.707484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1080
2025-10-02T08:11:06.707687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.707718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:06.707727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:06.707731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:06.708124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1080 sessionId:  describe result for acl check
2025-10-02T08:11:06.708171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:06.708172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:06.708173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:06.708176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533962690956361:6250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:06.708607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533962690956361:6250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:06.709417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:06.710696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533962690956361:6250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:06.710951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:06.711195Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:06.711204Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:06.711210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:06.711256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:06.711283Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533962690956405:6253]
2025-10-02T08:11:06.711717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:06.711910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:06.711952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:06.712246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:06.712302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.712308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.712309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.712310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.712311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.712315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.712325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.712328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.712331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.712334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.712339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.712346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.712351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.712361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.712368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.712372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.712377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.712381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.712386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.712390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.712410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:06.713343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533962690956361:6250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:06.713357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533962690956361:6250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:06.713361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533962690956361:6250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:06.713369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:06.721136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:06.722708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:06.722730Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:06.722734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:06.722738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:06.722746Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1079 [1:7556533962690956405:6253]
2025-10-02T08:11:06.722761Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:06.722778Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:06.722781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.722783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.722785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.722801Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:06.722807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:06.722814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:06.722878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.722886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.722888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:06.722890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:06.722942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:06.722948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.722959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.722968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:06.722983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533962690956378:6253]
2025-10-02T08:11:06.722988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533962690956378:6253]
2025-10-02T08:11:06.722994Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:06.723006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:06.723022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:06.723030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:06.723039Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:06.723041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690956424:6250], now have 1 active actors on pipe
2025-10-02T08:11:06.723042Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:06.723051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1079
2025-10-02T08:11:06.723073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533962690956378:6253]
2025-10-02T08:11:06.723086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:06.723097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.723097Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:06.723102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.723117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533963150982555:2378], now have 1 active actors on pipe
2025-10-02T08:11:06.723157Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9270d34b-4638e858-c73e7787-aca64933_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:06.723168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.723172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.723178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:06.723187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.723151Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1079
2025-10-02T08:11:06.723196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:06.723226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.723264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.723271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.723284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.723319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1080 partition: 0 MaxSeqNo: 17 sessionId: src_id|9270d34b-4638e858-c73e7787-aca64933_0
2025-10-02T08:11:06.723752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4a8838-1bf39731-48ba0c8-f94c1e57_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9270d34b-4638e858-c73e7787-aca64933_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:06.727102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9270d34b-4638e858-c73e7787-aca64933_0] Write session: try to update token
2025-10-02T08:11:06.727125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9270d34b-4638e858-c73e7787-aca64933_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:06.741771Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:06.741788Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:06.741791Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:06.741798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533962690956378:6253]
2025-10-02T08:11:06.741801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533962690956378:6253]
2025-10-02T08:11:06.741844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:06.741847Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:06.741854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:06.741856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.741858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:06.741993Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:06.742831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId: src_id|9270d34b-4638e858-c73e7787-aca64933_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:06.745504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:06.799452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533962690956439:11760]
2025-10-02T08:11:06.799598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1079, pipe: [1:7556533962690956439:11760]
2025-10-02T08:11:06.875711Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:06.876002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.876013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.876047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690956439:11760], now have 1 active actors on pipe
2025-10-02T08:11:06.876196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533962690956439:11760]
2025-10-02T08:11:06.876241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:06.876249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:06.876308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1080 reason: error at write: Disconnected sessionId: src_id|9270d34b-4638e858-c73e7787-aca64933_0
2025-10-02T08:11:06.876351Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:06.876436Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:06.876512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1080 sessionId: src_id|9270d34b-4638e858-c73e7787-aca64933_0 is DEAD
2025-10-02T08:11:06.876703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9270d34b-4638e858-c73e7787-aca64933_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:06.876730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9270d34b-4638e858-c73e7787-aca64933_0] Write session will restart in 0.005982s
2025-10-02T08:11:06.876762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9270d34b-4638e858-c73e7787-aca64933_0] Write session: Do CDS request
2025-10-02T08:11:06.876770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9270d34b-4638e858-c73e7787-aca64933_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:06.884443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9270d34b-4638e858-c73e7787-aca64933_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.884456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:06.884470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1081
2025-10-02T08:11:06.884745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:06.884789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:06.884813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:06.884817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:06.885203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1081 sessionId:  describe result for acl check
2025-10-02T08:11:06.885233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:06.885240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:06.885242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:06.885248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533962690956702:6237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:06.885740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533962690956702:6237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:06.885913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:06.887502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:06.887681Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:06.887692Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:06.887702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:06.887750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:06.887761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533962690956702:6237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:06.887788Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533962690956736:6238]
2025-10-02T08:11:06.888467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:06.888669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:06.888719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:06.889005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:06.889057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.889063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.889064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.889065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.889066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.889071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.889081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.889085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.889093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.889097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.889103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.889114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:06.889124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.889135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:06.889143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.889148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:06.889156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.889162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.889166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.889171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.889194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:06.894472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533962690956702:6237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:06.894488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533962690956702:6237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:06.894491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533962690956702:6237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:06.894500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:06.897461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:06.898968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:06.898983Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:06.898986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:06.898989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:06.898996Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1080 [1:7556533962690956736:6238]
2025-10-02T08:11:06.899008Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:06.899023Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:06.899025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.899028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.899030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.899048Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:06.899058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:06.899065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:06.899126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.899134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.899137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:06.899139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:06.899197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:06.899204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.899216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:06.899231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:06.899252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690956764:6237], now have 1 active actors on pipe
2025-10-02T08:11:06.899253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1080
2025-10-02T08:11:06.899262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533963150982573:2378], now have 1 active actors on pipe
2025-10-02T08:11:06.899268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533962690956714:6238]
2025-10-02T08:11:06.899270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533962690956714:6238]
2025-10-02T08:11:06.899281Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:06.899291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.899295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:06.899296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.899333Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1080
2025-10-02T08:11:06.899298Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:06.899313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:06.899326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:06.899329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:06.899366Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|870f54de-153526f0-6c2a7262-dc4a1619_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:06.899371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:06.899375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:06.899377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:06.899387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:06.899394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:06.899401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533962690956714:6238]
2025-10-02T08:11:06.899409Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:06.899420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:06.899430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.899484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:06.899491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:06.899503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:06.899540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1081 partition: 0 MaxSeqNo: 17 sessionId: src_id|870f54de-153526f0-6c2a7262-dc4a1619_0
2025-10-02T08:11:06.899872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9270d34b-4638e858-c73e7787-aca64933_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|870f54de-153526f0-6c2a7262-dc4a1619_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:06.902664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870f54de-153526f0-6c2a7262-dc4a1619_0] Write session: try to update token
2025-10-02T08:11:06.902676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870f54de-153526f0-6c2a7262-dc4a1619_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:06.916530Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:06.916548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:06.916550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:06.916560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533962690956714:6238]
2025-10-02T08:11:06.916566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533962690956714:6238]
2025-10-02T08:11:06.916600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:06.916605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:06.916607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:06.916616Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:06.916622Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:06.916749Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:06.918801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId: src_id|870f54de-153526f0-6c2a7262-dc4a1619_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:06.921478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:06.976616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533962690956790:11760]
2025-10-02T08:11:06.976730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1080, pipe: [1:7556533962690956790:11760]
2025-10-02T08:11:07.050606Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:07.050878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.050888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.050921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533962690956790:11760], now have 1 active actors on pipe
2025-10-02T08:11:07.051056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:07.051066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:07.051096Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:07.051130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1081 reason: error at write: Disconnected sessionId: src_id|870f54de-153526f0-6c2a7262-dc4a1619_0
2025-10-02T08:11:07.051132Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:07.051312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533962690956790:11760]
2025-10-02T08:11:07.051319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1081 sessionId: src_id|870f54de-153526f0-6c2a7262-dc4a1619_0 is DEAD
2025-10-02T08:11:07.051510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870f54de-153526f0-6c2a7262-dc4a1619_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:07.051524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870f54de-153526f0-6c2a7262-dc4a1619_0] Write session will restart in 0.007721s
2025-10-02T08:11:07.051554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870f54de-153526f0-6c2a7262-dc4a1619_0] Write session: Do CDS request
2025-10-02T08:11:07.051562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870f54de-153526f0-6c2a7262-dc4a1619_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:07.060426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870f54de-153526f0-6c2a7262-dc4a1619_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.060466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:07.060480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1082
2025-10-02T08:11:07.060741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.060773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:07.060782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:07.060787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:07.061106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:07.061112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1082 sessionId:  describe result for acl check
2025-10-02T08:11:07.061131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:07.061132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:07.061133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:07.061138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533966985924363:6217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:07.061558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533966985924363:6217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:07.062588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:07.062747Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:07.062756Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:07.062763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:07.062813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:07.062856Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533966985924386:5295]
2025-10-02T08:11:07.063350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:07.063484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:07.063495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533966985924363:6217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:07.063509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:07.063712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:07.063747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.063751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.063752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.063752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.063753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.063756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.063763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.063765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.063767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.063769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.063772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.063776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.063780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.063783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.063785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.063787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.063790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.063806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.063810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.063813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.063825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:07.069861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533966985924363:6217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:07.069877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533966985924363:6217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:07.069881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533966985924363:6217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:07.069890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:07.071923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:07.073589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:07.073607Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:07.073609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:07.073613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:07.073619Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1081 [1:7556533966985924386:5295]
2025-10-02T08:11:07.073630Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:07.073646Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:07.073649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.073652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.073654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.073670Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:07.073679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:07.073685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:07.073745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.073756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.073759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:07.073762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:07.073826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:07.073834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.073847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.073862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:07.073880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1081
2025-10-02T08:11:07.073883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985924413:6217], now have 1 active actors on pipe
2025-10-02T08:11:07.073889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533966985924361:5295]
2025-10-02T08:11:07.073891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533966985924361:5295]
2025-10-02T08:11:07.073898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:07.073906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533967445949878:2378], now have 1 active actors on pipe
2025-10-02T08:11:07.073917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.073916Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:07.073920Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:07.073923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.073940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:07.073957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:07.073965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:07.073962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1081
2025-10-02T08:11:07.074005Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e8c4556-f97111f4-da939b56-17c52e27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:07.074016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.074019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.074021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:07.074032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.074045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:07.074057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533966985924361:5295]
2025-10-02T08:11:07.074072Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:07.074087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:07.074109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.074151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.074158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.074173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.074209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1082 partition: 0 MaxSeqNo: 17 sessionId: src_id|4e8c4556-f97111f4-da939b56-17c52e27_0
2025-10-02T08:11:07.074555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870f54de-153526f0-6c2a7262-dc4a1619_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4e8c4556-f97111f4-da939b56-17c52e27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:07.076936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8c4556-f97111f4-da939b56-17c52e27_0] Write session: try to update token
2025-10-02T08:11:07.076949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8c4556-f97111f4-da939b56-17c52e27_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:07.090531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId: src_id|4e8c4556-f97111f4-da939b56-17c52e27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:07.091079Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:07.091091Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:07.091093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:07.091099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533966985924361:5295]
2025-10-02T08:11:07.091102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533966985924361:5295]
2025-10-02T08:11:07.091132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:07.091141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.091142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:07.091143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:07.091149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:07.091263Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:07.093009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:07.151703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533966985924430:11760]
2025-10-02T08:11:07.151829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1081, pipe: [1:7556533966985924430:11760]
2025-10-02T08:11:07.221857Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:07.222226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.222239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.222270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985924430:11760], now have 1 active actors on pipe
2025-10-02T08:11:07.222395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:07.222409Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:07.222419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:07.222486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1082 reason: error at write: Disconnected sessionId: src_id|4e8c4556-f97111f4-da939b56-17c52e27_0
2025-10-02T08:11:07.222544Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:07.222614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533966985924430:11760]
2025-10-02T08:11:07.222668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1082 sessionId: src_id|4e8c4556-f97111f4-da939b56-17c52e27_0 is DEAD
2025-10-02T08:11:07.222957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8c4556-f97111f4-da939b56-17c52e27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:07.222972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8c4556-f97111f4-da939b56-17c52e27_0] Write session will restart in 0.009427s
2025-10-02T08:11:07.223003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8c4556-f97111f4-da939b56-17c52e27_0] Write session: Do CDS request
2025-10-02T08:11:07.223011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8c4556-f97111f4-da939b56-17c52e27_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:07.233562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8c4556-f97111f4-da939b56-17c52e27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.233572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:07.233585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1083
2025-10-02T08:11:07.233896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:07.234711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.234751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:07.234761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:07.234764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:07.235187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1083 sessionId:  describe result for acl check
2025-10-02T08:11:07.235210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:07.235222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:07.235224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:07.235226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:07.235232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533966985924711:6212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:07.235368Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:07.235377Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:07.235386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:07.235436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:07.235488Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533966985924713:6214]
2025-10-02T08:11:07.235805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533966985924711:6212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:07.236097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:07.236256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:07.236294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:07.236586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:07.236629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.236634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.236636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.236636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.236637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.236642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.236651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.236655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.236659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.236663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.236668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.236675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.236680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.236686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.236690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.236695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.236699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.236709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.236713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.236718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.236737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:07.237355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533966985924711:6212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:07.243394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533966985924711:6212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:07.243409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533966985924711:6212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:07.243412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533966985924711:6212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:07.243421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:07.245031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:07.246656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:07.246673Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:07.246675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:07.246677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:07.246683Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1082 [1:7556533966985924713:6214]
2025-10-02T08:11:07.246693Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:07.246706Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:07.246708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.246711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.246712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.246726Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:07.246730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:07.246735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:07.246784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.246790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.246793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:07.246795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:07.246845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:07.246851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.246860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.246868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:07.246880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533966985924704:6214]
2025-10-02T08:11:07.246885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533966985924704:6214]
2025-10-02T08:11:07.246892Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:07.246903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:07.246912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:07.246915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:07.246921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:07.246922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1082
2025-10-02T08:11:07.246926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:07.246935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985924758:6212], now have 1 active actors on pipe
2025-10-02T08:11:07.246966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533967445949884:2378], now have 1 active actors on pipe
2025-10-02T08:11:07.246976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.246978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.246989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533966985924704:6214]
2025-10-02T08:11:07.246994Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:07.247001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:07.247014Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:07.247020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.247023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.247026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:07.247034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.247011Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1082
2025-10-02T08:11:07.247047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:07.247072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.247117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.247123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.247132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.247159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1083 partition: 0 MaxSeqNo: 17 sessionId: src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0
2025-10-02T08:11:07.247472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e8c4556-f97111f4-da939b56-17c52e27_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:07.249827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0] Write session: try to update token
2025-10-02T08:11:07.249839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:07.263466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId: src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:07.265691Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:07.265710Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:07.265713Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:07.265721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533966985924704:6214]
2025-10-02T08:11:07.265726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533966985924704:6214]
2025-10-02T08:11:07.265768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:07.265770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:07.265774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:07.265776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.265779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:07.265925Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:07.266079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:07.322697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533966985924773:11760]
2025-10-02T08:11:07.322783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1082, pipe: [1:7556533966985924773:11760]
2025-10-02T08:11:07.413777Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:07.414333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.414349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.414389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985924773:11760], now have 1 active actors on pipe
2025-10-02T08:11:07.414506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:07.414519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:07.414578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1083 reason: error at write: Disconnected sessionId: src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0
2025-10-02T08:11:07.414623Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:07.414752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1083 sessionId: src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0 is DEAD
2025-10-02T08:11:07.414930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533966985924773:11760]
2025-10-02T08:11:07.414973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:07.414991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0] Write session will restart in 0.005237s
2025-10-02T08:11:07.415035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0] Write session: Do CDS request
2025-10-02T08:11:07.415042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:07.415205Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:07.421432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.421481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:07.421501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1084
2025-10-02T08:11:07.421773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.421821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:07.421826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:07.421830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:07.422299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1084 sessionId:  describe result for acl check
2025-10-02T08:11:07.422330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:07.422332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:07.422333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:07.422338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533966985924985:6207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:07.422839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533966985924985:6207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:07.425489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533966985924985:6207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:07.425998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:07.427155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:07.427340Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:07.427352Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:07.427362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:07.427409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:07.427448Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533966985925086:6204]
2025-10-02T08:11:07.427899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533966985924985:6207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:07.427911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533966985924985:6207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:07.427913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533966985924985:6207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:07.427921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:07.428076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:07.428249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:07.428293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:07.428596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:07.428646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.428651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.428653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.428654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.428655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.428660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.428669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.428673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.428677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.428680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.428685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.428696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.428706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.428711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.428720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.428725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.428729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.428734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.428742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.428747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.428766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:07.437295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:07.439207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:07.439228Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:07.439231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:07.439236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:07.439243Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1083 [1:7556533966985925086:6204]
2025-10-02T08:11:07.439255Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:07.439273Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:07.439275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.439279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.439281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.439297Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:07.439302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:07.439309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:07.439371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.439381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.439384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:07.439386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:07.439448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:07.439456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.439469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.439481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:07.439498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985925091:6207], now have 1 active actors on pipe
2025-10-02T08:11:07.439509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533966985925076:6204]
2025-10-02T08:11:07.439512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533966985925076:6204]
2025-10-02T08:11:07.439518Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:07.439518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1083
2025-10-02T08:11:07.439532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533967445949891:2378], now have 1 active actors on pipe
2025-10-02T08:11:07.439532Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:07.439535Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:07.439540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:07.439554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:07.439557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:07.439565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.439569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.439606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533966985925076:6204]
2025-10-02T08:11:07.439614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:07.439627Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:07.439633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.439637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.439638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:07.439641Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:07.439616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1083
2025-10-02T08:11:07.439649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.439657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:07.439693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.439770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.439779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.439793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.439840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1084 partition: 0 MaxSeqNo: 17 sessionId: src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0
2025-10-02T08:11:07.440276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eaedcfc-c814ffd8-7d8e6aa8-60272314_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:07.443551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0] Write session: try to update token
2025-10-02T08:11:07.443575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:07.458997Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:07.459015Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:07.459018Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:07.459026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533966985925076:6204]
2025-10-02T08:11:07.459031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533966985925076:6204]
2025-10-02T08:11:07.459075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:07.459079Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:07.459082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.459084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:07.459085Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:07.459255Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:07.460842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId: src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:07.463482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:07.515227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533966985925123:11760]
2025-10-02T08:11:07.515356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1083, pipe: [1:7556533966985925123:11760]
2025-10-02T08:11:07.606162Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:07.606446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.606460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.606495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985925123:11760], now have 1 active actors on pipe
2025-10-02T08:11:07.606598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:07.606609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:07.606665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1084 reason: error at write: Disconnected sessionId: src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0
2025-10-02T08:11:07.606662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:07.606692Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:07.606899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1084 sessionId: src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0 is DEAD
2025-10-02T08:11:07.606975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533966985925123:11760]
2025-10-02T08:11:07.607078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:07.607089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0] Write session will restart in 0.006233s
2025-10-02T08:11:07.607115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0] Write session: Do CDS request
2025-10-02T08:11:07.607122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:07.614395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.614449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:07.614469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1085
2025-10-02T08:11:07.614891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.614932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:07.614947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:07.614951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:07.615403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1085 sessionId:  describe result for acl check
2025-10-02T08:11:07.615432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:07.615437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:07.615439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:07.615443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533966985925435:6160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:07.615916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533966985925435:6160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:07.616622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:07.618000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533966985925435:6160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:07.618423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:07.618698Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:07.618710Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:07.618721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:07.618777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:07.618811Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533966985925477:6161]
2025-10-02T08:11:07.619414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:07.619633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:07.619686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:07.619974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:07.620016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.620021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.620022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.620023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.620024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.620029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.620038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.620044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.620047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.620050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.620055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.620061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.620072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.620080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.620084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.620092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.620099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.620104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.620112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.620117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.620136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:07.621159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533966985925435:6160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:07.621172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533966985925435:6160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:07.621176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533966985925435:6160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:07.621184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:07.628210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:07.629809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:07.629831Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:07.629837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:07.629840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:07.629847Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1084 [1:7556533966985925477:6161]
2025-10-02T08:11:07.629860Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:07.629886Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:07.629889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.629892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.629894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.629910Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:07.629915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:07.629927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:07.629990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.629998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.630001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:07.630003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:07.630068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:07.630075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.630090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.630107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:07.630129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985925495:6160], now have 1 active actors on pipe
2025-10-02T08:11:07.630141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533966985925452:6161]
2025-10-02T08:11:07.630147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533966985925452:6161]
2025-10-02T08:11:07.630152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1084
2025-10-02T08:11:07.630159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:07.630169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533967445949922:2378], now have 1 active actors on pipe
2025-10-02T08:11:07.630169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:07.630172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:07.630180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:07.630195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:07.630202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:07.630209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.630217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.630256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533966985925452:6161]
2025-10-02T08:11:07.630263Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:07.630236Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1084
2025-10-02T08:11:07.630272Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:07.630279Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d623718-52cd03f9-f6e7b255-c5789f22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:07.630285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.630289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.630292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:07.630303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.630312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:07.630360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.630436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.630443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.630457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.630492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1085 partition: 0 MaxSeqNo: 17 sessionId: src_id|d623718-52cd03f9-f6e7b255-c5789f22_0
2025-10-02T08:11:07.631000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2435ba8f-160a995d-f8c133b3-a6c5acb2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d623718-52cd03f9-f6e7b255-c5789f22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:07.634262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d623718-52cd03f9-f6e7b255-c5789f22_0] Write session: try to update token
2025-10-02T08:11:07.634285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d623718-52cd03f9-f6e7b255-c5789f22_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:07.640760Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:07.640781Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:07.640791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533966985925452:6161]
2025-10-02T08:11:07.640852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:07.641032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:07.641183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:07.641326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:07.641353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:07.641476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:07.641684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:07.641727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:07.650429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId: src_id|d623718-52cd03f9-f6e7b255-c5789f22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:07.653121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:07.653186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.653198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.653230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:07.653252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:07.653295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.653311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.653455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.653512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.653575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.653649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.654000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.654014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.654109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.654194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.654264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.654324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.654366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.654371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.654433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.654492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.654559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.654639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.654691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.654699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.654768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.654828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.654888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.654950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.655057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.655064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.655128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.655189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.655252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.655321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.655375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.655382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.655469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.655532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.655602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.655685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.655732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.655739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.655819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.655884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.655954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.656021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.656077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.656084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.656153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.656213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.656274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.656342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.656388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.656395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.656475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.656535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.656599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.656667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.656716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.656723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.656792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.656892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.656961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.657025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.657072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.657078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.657137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:07.657207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.657230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.657237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:07.657269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:07.657286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:07.657296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:07.657300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:07.657303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:07.657713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:07.657739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:07.657743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:07.657745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:07.657747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:07.657749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:07.658422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:07.658448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:07.658455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:07.658462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:07.658466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:07.658473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:07.659064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:07.659088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:07.659098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:07.659106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:07.659109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:07.660305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:07.660321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:07.660333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392667660
2025-10-02T08:11:07.660450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:07.660463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:07.660468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:07.660471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:07.660475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:07.660478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:07.660948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:07.660967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:07.660978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:07.660986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:07.660989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:07.660992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:07.661440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:07.661464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:07.661471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:07.661474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:07.661478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:07.661481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:07.661980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:07.662001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:07.662006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:07.663010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:07.663024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:07.663028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:07.663031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:07.663040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392667662
2025-10-02T08:11:07.663318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:07.663334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:07.663341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:07.663343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:07.663345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:07.663347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:07.663771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:07.663788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:07.663792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:07.663794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:07.663809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:07.663812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:07.664336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:07.664357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.664436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392667664
2025-10-02T08:11:07.666680Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:07.666706Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:07.666715Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:07.666724Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:07.666739Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:07.666741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:07.666743Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:07.666751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533966985925452:6161]
2025-10-02T08:11:07.666754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533966985925452:6161]
2025-10-02T08:11:07.666809Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:07.666820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:07.666824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.666826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:07.666831Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:07.666950Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:07.707225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533966985925512:11760]
2025-10-02T08:11:07.707369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1084, pipe: [1:7556533966985925512:11760]
2025-10-02T08:11:07.801717Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:07.802135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985925512:11760], now have 1 active actors on pipe
2025-10-02T08:11:07.802616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:07.802398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533966985925512:11760]
2025-10-02T08:11:07.802423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:07.802426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:07.802450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1085 reason: error at write: Disconnected sessionId: src_id|d623718-52cd03f9-f6e7b255-c5789f22_0
2025-10-02T08:11:07.802893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d623718-52cd03f9-f6e7b255-c5789f22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:07.802908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d623718-52cd03f9-f6e7b255-c5789f22_0] Write session will restart in 0.005688s
2025-10-02T08:11:07.802520Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:07.802697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1085 sessionId: src_id|d623718-52cd03f9-f6e7b255-c5789f22_0 is DEAD
2025-10-02T08:11:07.802933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d623718-52cd03f9-f6e7b255-c5789f22_0] Write session: Do CDS request
2025-10-02T08:11:07.802940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d623718-52cd03f9-f6e7b255-c5789f22_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:07.805802Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f659f77d64e24b7d] Result# TEvPutResult {Id# [72075186224037892:1084:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:07.805826Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1084:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:07.805909Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1084:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:07.809334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d623718-52cd03f9-f6e7b255-c5789f22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.809392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:07.809405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1086
2025-10-02T08:11:07.809630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:07.809671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:07.809680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:07.809684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:07.810040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1086 sessionId:  describe result for acl check
2025-10-02T08:11:07.810079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:07.810085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:07.810088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:07.810092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533966985925627:6155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:07.810653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533966985925627:6155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:07.812857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533966985925627:6155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:07.816020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533966985925627:6155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:07.816035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533966985925627:6155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:07.816038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533966985925627:6155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:07.816045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:07.816567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:07.818133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:07.818306Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:07.818315Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:07.818324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:07.818368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:07.818406Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533966985925841:6154]
2025-10-02T08:11:07.818852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:07.819046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:07.819085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:07.819377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:07.819427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.819433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.819434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.819435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.819437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.819442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.819452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.819459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.819464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.819467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.819473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.819481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:07.819488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.819498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:07.819506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.819511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:07.819516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.819522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.819527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.819531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.819549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:07.828197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:07.830241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:07.830263Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:07.830265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:07.830269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:07.830275Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1085 [1:7556533966985925841:6154]
2025-10-02T08:11:07.830288Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:07.830306Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:07.830309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.830313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.830315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.830332Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:07.830340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:07.830347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:07.830412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.830422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.830425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:07.830427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:07.830494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:07.830501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.830516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:07.830536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:07.830542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1085
2025-10-02T08:11:07.830555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985925830:6155], now have 1 active actors on pipe
2025-10-02T08:11:07.830558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533967445949928:2378], now have 1 active actors on pipe
2025-10-02T08:11:07.830563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.830567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.830584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533966985925835:6154]
2025-10-02T08:11:07.830586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533966985925835:6154]
2025-10-02T08:11:07.830597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:07.830610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:07.830610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:07.830613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:07.830625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:07.830629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:07.830643Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:07.830654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.830658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.830660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:07.830669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.830679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:07.830651Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1085
2025-10-02T08:11:07.830723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533966985925835:6154]
2025-10-02T08:11:07.830739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:07.830752Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:07.830830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.830914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.830922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.830935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:07.830975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1086 partition: 0 MaxSeqNo: 17 sessionId: src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0
2025-10-02T08:11:07.831318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d623718-52cd03f9-f6e7b255-c5789f22_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:07.834252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0] Write session: try to update token
2025-10-02T08:11:07.834273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:07.841623Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:07.841637Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:07.841646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533966985925835:6154]
2025-10-02T08:11:07.841688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:07.841698Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:07.841866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:07.842009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:07.842160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:07.842308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:07.842516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:07.842560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:07.850134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId: src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:07.852628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:07.852708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.852718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.852745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:07.852766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:07.852837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:07.852849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:07.853018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.853080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.853142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.853203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.853363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.853371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.853433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.853489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.853549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.853618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.853664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.853669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.853731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.853785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.853842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.853905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.853946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.853951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.854013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.854069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.854142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.854215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.854265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.854272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.854337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.854391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.854446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.854503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.854544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.854549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.854606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.854661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.854717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.854772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.854814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.854819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.854876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.854932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.854991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.855048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.855107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.855112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.855175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.855228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.855289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.855350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.855396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.855400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.855458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.855513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.855568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.855628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.855673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.855678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.855735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:07.855789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:07.855864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:07.855931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:07.855975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:07.855984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:07.856022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:07.856076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:07.856093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:07.856098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:07.856125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:07.856138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:07.856141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:07.856143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:07.856145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:07.856489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:07.856509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:07.856519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:07.856524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:07.856527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:07.856529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:07.857084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:07.857103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:07.857108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:07.857111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:07.857113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:07.857117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:07.857562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:07.857580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:07.857585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:07.857587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:07.857589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:07.858722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:07.858735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:07.858744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392667858
2025-10-02T08:11:07.858883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:07.858892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:07.858895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:07.858898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:07.858900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:07.858902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:07.859315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:07.859332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:07.859336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:07.859338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:07.859341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:07.859343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:07.859733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:07.859749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:07.859757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:07.859759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:07.859762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:07.859764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:07.860206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:07.860227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:07.860233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:07.861237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:07.861251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:07.861255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:07.861260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:07.861266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392667861
2025-10-02T08:11:07.861599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:07.861622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:07.861627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:07.861630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:07.861634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:07.861637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:07.862132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:07.862160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:07.862166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:07.862170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:07.862175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:07.862178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:07.862641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:07.862666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:07.862762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392667862
2025-10-02T08:11:07.863520Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:07.863540Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:07.863551Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:07.863558Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:07.865183Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:07.865198Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:07.865199Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:07.865207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533966985925835:6154]
2025-10-02T08:11:07.865210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533966985925835:6154]
2025-10-02T08:11:07.865264Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:07.865268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:07.865272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:07.865274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:07.865277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:07.865403Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:07.902283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533966985925873:11760]
2025-10-02T08:11:07.902509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1085, pipe: [1:7556533966985925873:11760]
2025-10-02T08:11:08.000931Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:08.001339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533966985925873:11760], now have 1 active actors on pipe
2025-10-02T08:11:08.001466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533966985925873:11760]
2025-10-02T08:11:08.001495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:08.001497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:08.001527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1086 reason: error at write: Disconnected sessionId: src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0
2025-10-02T08:11:08.001588Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:08.001751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1086 sessionId: src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0 is DEAD
2025-10-02T08:11:08.001926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:08.001937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0] Write session will restart in 0.007321s
2025-10-02T08:11:08.001896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:08.001972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0] Write session: Do CDS request
2025-10-02T08:11:08.001979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:08.010420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.010484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:08.010498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1087
2025-10-02T08:11:08.010690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.010717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:08.010724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:08.010728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:08.011090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1087 sessionId:  describe result for acl check
2025-10-02T08:11:08.011115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:08.011116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:08.011117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:08.011120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533971280893458:6135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:08.011481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533971280893458:6135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:08.012272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:08.013752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533971280893458:6135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:08.013816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:08.014041Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:08.014051Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:08.014060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:08.014112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:08.014149Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533971280893493:6136]
2025-10-02T08:11:08.014710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:08.014882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:08.014920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:08.015150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:08.015180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.015184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.015185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.015185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.015186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.015189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.015195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.015198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.015200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.015202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.015205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.015209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.015213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.015216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.015218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.015221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.015223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.015227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.015229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.015233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.015246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:08.020139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533971280893458:6135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:08.020155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533971280893458:6135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:08.020159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533971280893458:6135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:08.020168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:08.023202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:08.024701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:08.024720Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:08.024723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:08.024726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:08.024733Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1086 [1:7556533971280893493:6136]
2025-10-02T08:11:08.024741Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:08.024753Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:08.024755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.024757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.024759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.024771Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:08.024776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:08.024783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:08.024861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.024869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.024871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:08.024874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:08.024941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:08.024948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.024961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.024977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:08.024999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533971280893475:6136]
2025-10-02T08:11:08.025009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533971280893475:6136]
2025-10-02T08:11:08.025016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:08.025028Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:08.025029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533971740917245:2378], now have 1 active actors on pipe
2025-10-02T08:11:08.025031Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:08.025037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:08.025042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1086
2025-10-02T08:11:08.025049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:08.025052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:08.025057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280893518:6135], now have 1 active actors on pipe
2025-10-02T08:11:08.025067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1086
2025-10-02T08:11:08.025090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.025099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.025113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533971280893475:6136]
2025-10-02T08:11:08.025116Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:08.025128Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:08.025152Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:08.025164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.025168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.025172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:08.025180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.025195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:08.025252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.025327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.025335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.025351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.025394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1087 partition: 0 MaxSeqNo: 17 sessionId: src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0
2025-10-02T08:11:08.025808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadc1e77-116b67ed-9e8350a-2c44ee73_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:08.029082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0] Write session: try to update token
2025-10-02T08:11:08.029106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:08.042145Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:08.042165Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:08.042168Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:08.042177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533971280893475:6136]
2025-10-02T08:11:08.042181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533971280893475:6136]
2025-10-02T08:11:08.042225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:08.042229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:08.042236Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:08.042237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.042239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:08.042387Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:08.045592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId: src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:08.048425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:08.101450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533971280893533:11760]
2025-10-02T08:11:08.101577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1086, pipe: [1:7556533971280893533:11760]
2025-10-02T08:11:08.175036Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:08.175337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.175348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.175389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280893533:11760], now have 1 active actors on pipe
2025-10-02T08:11:08.175498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533971280893533:11760]
2025-10-02T08:11:08.175519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:08.175521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:08.175582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1087 reason: error at write: Disconnected sessionId: src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0
2025-10-02T08:11:08.175611Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:08.175661Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:08.175754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1087 sessionId: src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0 is DEAD
2025-10-02T08:11:08.175974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:08.175990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0] Write session will restart in 0.005503s
2025-10-02T08:11:08.176020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0] Write session: Do CDS request
2025-10-02T08:11:08.176027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:08.182432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.182545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:08.182559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1088
2025-10-02T08:11:08.182755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.182787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:08.182797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:08.182800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:08.183163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1088 sessionId:  describe result for acl check
2025-10-02T08:11:08.183194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:08.183200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:08.183201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:08.183205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533971280893782:6105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:08.183675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533971280893782:6105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:08.185135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:08.185888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533971280893782:6105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:08.186458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:08.186597Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:08.186605Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:08.186615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:08.186662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:08.186700Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533971280893855:6115]
2025-10-02T08:11:08.187260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:08.187476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:08.187527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:08.187853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:08.187905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.187910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.187911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.187912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.187913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.187918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.187926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.187934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.187937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.187943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.187948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.187956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.187961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.187970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.187978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.187983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.187990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.187994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.187999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.188007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.188029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:08.188117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533971280893782:6105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:08.188127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533971280893782:6105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:08.188130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533971280893782:6105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:08.188137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:08.196072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:08.197631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:08.197645Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:08.197647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:08.197650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:08.197654Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1087 [1:7556533971280893855:6115]
2025-10-02T08:11:08.197663Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:08.197675Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:08.197677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.197679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.197680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.197692Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:08.197695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:08.197700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:08.197745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.197750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.197752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:08.197754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:08.197800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:08.197805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.197813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.197825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:08.197841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280893873:6105], now have 1 active actors on pipe
2025-10-02T08:11:08.197848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533971280893838:6115]
2025-10-02T08:11:08.197849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533971280893838:6115]
2025-10-02T08:11:08.197856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1087
2025-10-02T08:11:08.197857Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:08.197866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533971740917251:2378], now have 1 active actors on pipe
2025-10-02T08:11:08.197868Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:08.197871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:08.197871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:08.197882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:08.197885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:08.197892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.197895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.197930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533971280893838:6115]
2025-10-02T08:11:08.197937Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:08.197946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:08.197955Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:08.197960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.197963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.197965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:08.197972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.197984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:08.197968Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1087
2025-10-02T08:11:08.198018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.198076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.198080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.198090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.198118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1088 partition: 0 MaxSeqNo: 17 sessionId: src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0
2025-10-02T08:11:08.198922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c392c50-c66b5c4a-c8b86e6d-81ac9463_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:08.201600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0] Write session: try to update token
2025-10-02T08:11:08.201615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:08.208744Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:08.208759Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:08.208768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533971280893838:6115]
2025-10-02T08:11:08.208827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:08.208860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:08.209005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:08.209150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:08.209295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:08.209436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:08.209632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:08.209677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:08.215910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId: src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:08.218387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:08.218460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.218474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.218508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:08.218532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:08.218582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.218590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.218730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.218788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.218850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.218918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.218961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.218969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.219036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.219092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.219152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.219214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.219257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.219265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.219328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.219385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.219447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.219508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.219552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.219558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.219624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.219684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.219744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.219818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.219863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.219868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.219924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.219978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.220040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.220100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.220141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.220147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.220210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.220266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.220324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.220385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.220426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.220432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.220498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.220557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.220622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.220682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.220724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.220730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.220792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.220870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.220933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.220996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.221041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.221051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.221117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.221175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.221233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.221292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.221341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.221347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.221409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.221465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.221530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.221593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.221642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.221647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.221683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:08.221748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.221769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.221774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:08.221804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:08.221819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:08.221826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:08.221828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:08.221831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:08.222211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:08.222235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:08.222241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:08.222249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:08.222252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:08.222255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:08.222723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:08.222744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:08.222749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:08.222752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:08.222755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:08.222757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:08.223228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:08.223249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:08.223254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:08.223259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:08.223264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:08.225322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:08.225340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:08.225356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392668225
2025-10-02T08:11:08.225493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:08.225507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:08.225513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:08.225516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:08.225520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:08.225523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:08.225973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:08.225995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:08.226000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:08.226004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:08.226006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:08.226009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:08.226440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:08.226459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:08.226467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:08.226470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:08.226473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:08.226476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:08.226906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:08.226925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:08.226932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:08.227937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:08.227951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:08.227956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:08.227960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:08.227970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392668227
2025-10-02T08:11:08.228235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:08.228254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:08.228260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:08.228263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:08.228266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:08.228271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:08.228671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:08.228691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:08.228696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:08.228699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:08.228704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:08.228708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:08.229221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:08.229244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.229348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392668228
2025-10-02T08:11:08.233070Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:08.233090Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:08.233097Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:08.233104Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:08.234740Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:08.234753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:08.234755Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:08.234766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533971280893838:6115]
2025-10-02T08:11:08.234773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533971280893838:6115]
2025-10-02T08:11:08.234832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:08.234835Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:08.234840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.234841Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:08.234842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:08.234988Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:08.275506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533971280893899:11760]
2025-10-02T08:11:08.275613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1087, pipe: [1:7556533971280893899:11760]
2025-10-02T08:11:08.367383Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:08.367819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280893899:11760], now have 1 active actors on pipe
2025-10-02T08:11:08.368166Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:08.368401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:08.368412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0] Write session will restart in 0.008737s
2025-10-02T08:11:08.368437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0] Write session: Do CDS request
2025-10-02T08:11:08.368443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:08.367965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533971280893899:11760]
2025-10-02T08:11:08.368032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:08.368035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:08.368059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1088 reason: error at write: Disconnected sessionId: src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0
2025-10-02T08:11:08.368115Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:08.368230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1088 sessionId: src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0 is DEAD
2025-10-02T08:11:08.381411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.381504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:08.381526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1089
2025-10-02T08:11:08.381794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.381829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:08.381836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:08.381841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:08.382294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1089 sessionId:  describe result for acl check
2025-10-02T08:11:08.382336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:08.382344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:08.382345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:08.382351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533971280894186:6104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:08.382967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:08.383066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533971280894186:6104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:08.384406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:08.384613Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:08.384617Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:08.384627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:08.384679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:08.384711Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533971280894213:6110]
2025-10-02T08:11:08.385314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:08.385515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:08.385556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:08.385681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533971280894186:6104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:08.385793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:08.385830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.385836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.385837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.385838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.385838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.385841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.385848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.385850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.385852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.385854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.385858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.385862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.385866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.385869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.385871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.385874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.385877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.385880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.385882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.385885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.385896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:08.391177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533971280894186:6104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:08.391198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533971280894186:6104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:08.391203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533971280894186:6104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:08.391212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:08.394575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:08.396373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:08.396395Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:08.396398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:08.396401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:08.396408Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1088 [1:7556533971280894213:6110]
2025-10-02T08:11:08.396418Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:08.396435Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:08.396437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.396440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.396442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.396458Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:08.396463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:08.396469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:08.396528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.396537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.396540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:08.396542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:08.396610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:08.396619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.396632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.396642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:08.396665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280894240:6104], now have 1 active actors on pipe
2025-10-02T08:11:08.396676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533971280894190:6110]
2025-10-02T08:11:08.396678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533971280894190:6110]
2025-10-02T08:11:08.396681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1088
2025-10-02T08:11:08.396686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:08.396696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533971740917274:2378], now have 1 active actors on pipe
2025-10-02T08:11:08.396698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:08.396702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:08.396707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:08.396719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:08.396727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:08.396733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.396737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.396777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533971280894190:6110]
2025-10-02T08:11:08.396785Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:08.396742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1088
2025-10-02T08:11:08.396795Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:08.396825Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|556773b1-6be7004e-87a8d53a-86643e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:08.396831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.396835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.396836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:08.396845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.396858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:08.396908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.397020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.397034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.397058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.397113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1089 partition: 0 MaxSeqNo: 17 sessionId: src_id|556773b1-6be7004e-87a8d53a-86643e6_0
2025-10-02T08:11:08.397513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f060b4-685e7ad-24cec794-2a01d9c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|556773b1-6be7004e-87a8d53a-86643e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:08.401176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556773b1-6be7004e-87a8d53a-86643e6_0] Write session: try to update token
2025-10-02T08:11:08.401199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556773b1-6be7004e-87a8d53a-86643e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:08.415550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId: src_id|556773b1-6be7004e-87a8d53a-86643e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:08.416606Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:08.416626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:08.416629Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:08.416637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533971280894190:6110]
2025-10-02T08:11:08.416642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533971280894190:6110]
2025-10-02T08:11:08.416689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:08.416690Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:08.416695Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:08.416701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.416703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:08.416911Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:08.418453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:08.468072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533971280894254:11760]
2025-10-02T08:11:08.468177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1088, pipe: [1:7556533971280894254:11760]
2025-10-02T08:11:08.563273Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:08.563690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.563705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.563742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280894254:11760], now have 1 active actors on pipe
2025-10-02T08:11:08.563816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:08.563823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:08.563875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1089 reason: error at write: Disconnected sessionId: src_id|556773b1-6be7004e-87a8d53a-86643e6_0
2025-10-02T08:11:08.563999Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:08.564066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1089 sessionId: src_id|556773b1-6be7004e-87a8d53a-86643e6_0 is DEAD
2025-10-02T08:11:08.563995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:08.564237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533971280894254:11760]
2025-10-02T08:11:08.564285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556773b1-6be7004e-87a8d53a-86643e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:08.564299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556773b1-6be7004e-87a8d53a-86643e6_0] Write session will restart in 0.005590s
2025-10-02T08:11:08.564335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556773b1-6be7004e-87a8d53a-86643e6_0] Write session: Do CDS request
2025-10-02T08:11:08.564342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556773b1-6be7004e-87a8d53a-86643e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:08.571439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556773b1-6be7004e-87a8d53a-86643e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.571489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:08.571505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1090
2025-10-02T08:11:08.571746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.571782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:08.571789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:08.571798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:08.572326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1090 sessionId:  describe result for acl check
2025-10-02T08:11:08.572361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:08.572363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:08.572365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:08.572370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533971280894296:6096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:08.572932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533971280894296:6096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:08.576101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533971280894296:6096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:08.578958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533971280894296:6096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:08.578972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533971280894296:6096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:08.578975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533971280894296:6096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:08.578982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:08.579875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:08.581244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:08.581444Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:08.581454Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:08.581464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:08.581511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:08.581545Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533971280894589:6093]
2025-10-02T08:11:08.582200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:08.582354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:08.582391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:08.582689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:08.582731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.582736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.582737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.582738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.582739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.582744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.582756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.582761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.582765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.582769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.582774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.582782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.582792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.582797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.582806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.582811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.582820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.582826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.582837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.582846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.582866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:08.591020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:08.592907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:08.592926Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:08.592928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:08.592932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:08.592939Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1089 [1:7556533971280894589:6093]
2025-10-02T08:11:08.592950Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:08.592967Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:08.592970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.592973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.592975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.592990Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:08.592997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:08.593004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:08.593064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.593072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.593076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:08.593079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:08.593148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:08.593155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.593170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.593188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:08.593210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533971280894583:6093]
2025-10-02T08:11:08.593216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533971280894583:6093]
2025-10-02T08:11:08.593223Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:08.593236Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:08.593245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280894570:6096], now have 1 active actors on pipe
2025-10-02T08:11:08.593246Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:08.593251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:08.593265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:08.593273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:08.593278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533971740917283:2378], now have 1 active actors on pipe
2025-10-02T08:11:08.593361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1089
2025-10-02T08:11:08.593308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533971280894583:6093]
2025-10-02T08:11:08.593323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:08.593352Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:08.593368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1089
2025-10-02T08:11:08.593432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.593436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.593467Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8231335-1955cb7-80695f6d-698e3516_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:08.593473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.593477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.593479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:08.593489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.593498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:08.593514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.593536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.593538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.593549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.593578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1090 partition: 0 MaxSeqNo: 17 sessionId: src_id|b8231335-1955cb7-80695f6d-698e3516_0
2025-10-02T08:11:08.593988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556773b1-6be7004e-87a8d53a-86643e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b8231335-1955cb7-80695f6d-698e3516_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:08.597179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8231335-1955cb7-80695f6d-698e3516_0] Write session: try to update token
2025-10-02T08:11:08.597200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8231335-1955cb7-80695f6d-698e3516_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:08.604786Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:08.604814Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:08.604822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533971280894583:6093]
2025-10-02T08:11:08.604859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:08.604862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:08.605044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:08.605195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:08.605340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:08.605479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:08.605678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:08.605713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:08.617132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId: src_id|b8231335-1955cb7-80695f6d-698e3516_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:08.619784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:08.620166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.620182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.620218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:08.620346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:08.620403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.620410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.620550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.620615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.620681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.620746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.620962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.620974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.621048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.621115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.621186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.621251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.621302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.621309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.621384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.621444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.621507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.621573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.621622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.621630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.621701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.621772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.621839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.621908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.621966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.621973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.622045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.622110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.622170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.622240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.622292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.622300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.622365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.622432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.622504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.622568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.622613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.622619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.622687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.622745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.622812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.622873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.622922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.622929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.623002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.623067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.623134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.623198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.623245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.623252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.623400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.623464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.623527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.623594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.623645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.623651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.623720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:08.623779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:08.623856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:08.623920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:08.623966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:08.623977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:08.624041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:08.624102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.624122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.624128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:08.624158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:08.624177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:08.624184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:08.624187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:08.624190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:08.624578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:08.624604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:08.624616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:08.624619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:08.624622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:08.624630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:08.625247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:08.625273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:08.625279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:08.625283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:08.625288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:08.625291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:08.625863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:08.625890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:08.625896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:08.625901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:08.625904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:08.627181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:08.627197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:08.627206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392668626
2025-10-02T08:11:08.627371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:08.627383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:08.627387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:08.627389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:08.627392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:08.627394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:08.627906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:08.627931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:08.627938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:08.627941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:08.627944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:08.627949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:08.628378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:08.628396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:08.628406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:08.628411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:08.628415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:08.628418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:08.628935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:08.628957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:08.628963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:08.630135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:08.630152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:08.630158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:08.630162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:08.630171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392668629
2025-10-02T08:11:08.630491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:08.630514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:08.630520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:08.630523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:08.630527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:08.630530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:08.631091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:08.631111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:08.631117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:08.631122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:08.631125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:08.631129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:08.631639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:08.631662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.631764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392668631
2025-10-02T08:11:08.634334Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:08.634360Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:08.634366Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:08.634373Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:08.634384Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:08.634386Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:08.634388Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:08.634396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533971280894583:6093]
2025-10-02T08:11:08.634400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533971280894583:6093]
2025-10-02T08:11:08.634464Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:08.634478Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:08.634479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:08.634483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.634485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:08.634642Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:08.664146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533971280894656:11760]
2025-10-02T08:11:08.664277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1089, pipe: [1:7556533971280894656:11760]
2025-10-02T08:11:08.772946Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:08.773340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280894656:11760], now have 1 active actors on pipe
2025-10-02T08:11:08.773522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:08.773530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:08.773557Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:08.773560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1090 reason: error at write: Disconnected sessionId: src_id|b8231335-1955cb7-80695f6d-698e3516_0
2025-10-02T08:11:08.773722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1090 sessionId: src_id|b8231335-1955cb7-80695f6d-698e3516_0 is DEAD
2025-10-02T08:11:08.773837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533971280894656:11760]
2025-10-02T08:11:08.773804Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:08.773903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8231335-1955cb7-80695f6d-698e3516_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:08.773917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8231335-1955cb7-80695f6d-698e3516_0] Write session will restart in 0.009925s
2025-10-02T08:11:08.773945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8231335-1955cb7-80695f6d-698e3516_0] Write session: Do CDS request
2025-10-02T08:11:08.773952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8231335-1955cb7-80695f6d-698e3516_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:08.777648Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [97f5c240b9e88e95] Result# TEvPutResult {Id# [72075186224037892:1089:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:08.777706Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1089:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:08.777748Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1089:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:08.785411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8231335-1955cb7-80695f6d-698e3516_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.785516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:08.785533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1091
2025-10-02T08:11:08.785682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.785711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:08.785720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:08.785724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:08.786199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1091 sessionId:  describe result for acl check
2025-10-02T08:11:08.786227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:08.786229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:08.786230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:08.786235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533971280894943:6066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:08.786711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533971280894943:6066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:08.787372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:08.789049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:08.789099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533971280894943:6066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:08.789257Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:08.789267Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:08.789278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:08.789333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:08.789376Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533971280894980:6067]
2025-10-02T08:11:08.789961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:08.790155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:08.790201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:08.790599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:08.790641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.790646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.790648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.790649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.790650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.790655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.790665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.790668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.790672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.790676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.790681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.790688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.790693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.790696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.790699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.790701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.790703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.790706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.790709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.790712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.790725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:08.795704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533971280894943:6066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:08.795723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533971280894943:6066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:08.795727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533971280894943:6066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:08.795735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:08.799158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:08.800926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:08.800947Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:08.800950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:08.800954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:08.800960Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1090 [1:7556533971280894980:6067]
2025-10-02T08:11:08.800971Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:08.800988Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:08.800991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.800994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.800997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.801012Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:08.801017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:08.801024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:08.801086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.801096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.801100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:08.801102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:08.801172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:08.801179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.801193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.801205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:08.801223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533971280894960:6067]
2025-10-02T08:11:08.801230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533971280894960:6067]
2025-10-02T08:11:08.801238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:08.801247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1090
2025-10-02T08:11:08.801248Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:08.801251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:08.801252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280895006:6066], now have 1 active actors on pipe
2025-10-02T08:11:08.801258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:08.801272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:08.801275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:08.801281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533971740917312:2378], now have 1 active actors on pipe
2025-10-02T08:11:08.801286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.801290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.801331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533971280894960:6067]
2025-10-02T08:11:08.801341Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:08.801356Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb068c1-653b798d-bd9e608b-7a2377de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:08.801364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:08.801367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.801371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.801373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:08.801382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.801395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:08.801337Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1090
2025-10-02T08:11:08.801449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.801541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.801549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.801566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.801608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1091 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb068c1-653b798d-bd9e608b-7a2377de_0
2025-10-02T08:11:08.802012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8231335-1955cb7-80695f6d-698e3516_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb068c1-653b798d-bd9e608b-7a2377de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:08.805161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb068c1-653b798d-bd9e608b-7a2377de_0] Write session: try to update token
2025-10-02T08:11:08.805185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb068c1-653b798d-bd9e608b-7a2377de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:08.819706Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:08.819727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:08.819730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:08.819738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533971280894960:6067]
2025-10-02T08:11:08.819742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533971280894960:6067]
2025-10-02T08:11:08.819785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:08.819791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.819794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:08.819814Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:08.819821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:08.819958Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:08.822260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId: src_id|bb068c1-653b798d-bd9e608b-7a2377de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:08.824916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:08.874098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533971280895019:11760]
2025-10-02T08:11:08.874269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1090, pipe: [1:7556533971280895019:11760]
2025-10-02T08:11:08.958882Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:08.959349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.959358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.959400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280895019:11760], now have 1 active actors on pipe
2025-10-02T08:11:08.959672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:08.959691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:08.959729Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:08.959781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1091 reason: error at write: Disconnected sessionId: src_id|bb068c1-653b798d-bd9e608b-7a2377de_0
2025-10-02T08:11:08.960010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1091 sessionId: src_id|bb068c1-653b798d-bd9e608b-7a2377de_0 is DEAD
2025-10-02T08:11:08.960055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533971280895019:11760]
2025-10-02T08:11:08.960064Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:08.960195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb068c1-653b798d-bd9e608b-7a2377de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:08.960207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb068c1-653b798d-bd9e608b-7a2377de_0] Write session will restart in 0.008084s
2025-10-02T08:11:08.960235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb068c1-653b798d-bd9e608b-7a2377de_0] Write session: Do CDS request
2025-10-02T08:11:08.960242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb068c1-653b798d-bd9e608b-7a2377de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:08.973404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb068c1-653b798d-bd9e608b-7a2377de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.973484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:08.973504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1092
2025-10-02T08:11:08.973638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:08.973676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:08.973682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:08.973686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:08.973997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:08.974193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1092 sessionId:  describe result for acl check
2025-10-02T08:11:08.974229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:08.974236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:08.974238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:08.974244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533971280895333:6055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:08.974814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533971280895333:6055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:08.976318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:08.976672Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:08.976682Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:08.976694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:08.976758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:08.976828Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533971280895350:6062]
2025-10-02T08:11:08.977189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533971280895333:6055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:08.977538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:08.977774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:08.977839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:08.978195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:08.978261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.978267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.978268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.978270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.978271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.978278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.978288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.978292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.978296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.978299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.978307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.978319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:08.978331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.978336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:08.978346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.978356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:08.978363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.978374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.978379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.978384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.978408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:08.985707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533971280895333:6055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:08.985730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533971280895333:6055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:08.985734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533971280895333:6055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:08.985746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:08.988706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:08.991176Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1091
2025-10-02T08:11:08.990625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:08.990646Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:08.990649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:08.990653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:08.990662Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1091 [1:7556533971280895350:6062]
2025-10-02T08:11:08.990680Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:08.990706Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:08.990710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.990713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.990717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.990740Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:08.990748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:08.990756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:08.990847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.990849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.990853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:08.990856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:08.990950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:08.990953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:08.990970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:08.990981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:08.991004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533971280895327:6062]
2025-10-02T08:11:08.991006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533971280895327:6062]
2025-10-02T08:11:08.991015Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:08.991030Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:08.991033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:08.991034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:08.991049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:08.991052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:08.991065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533971740917331:2378], now have 1 active actors on pipe
2025-10-02T08:11:08.991068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533971280895376:6055], now have 1 active actors on pipe
2025-10-02T08:11:08.991141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1091
2025-10-02T08:11:08.991147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533971280895327:6062]
2025-10-02T08:11:08.991150Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:08.991159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.991164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.991218Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54c97008-11de4d7f-5861bce4-c0559dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:08.991224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:08.991226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:08.991231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:08.991233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:08.991246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:08.991259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:08.991278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.991372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:08.991374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:08.991388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:08.991426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1092 partition: 0 MaxSeqNo: 17 sessionId: src_id|54c97008-11de4d7f-5861bce4-c0559dec_0
2025-10-02T08:11:08.991895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb068c1-653b798d-bd9e608b-7a2377de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|54c97008-11de4d7f-5861bce4-c0559dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:08.995301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c97008-11de4d7f-5861bce4-c0559dec_0] Write session: try to update token
2025-10-02T08:11:08.995325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c97008-11de4d7f-5861bce4-c0559dec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:09.016167Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:09.016191Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:09.016194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:09.016205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533971280895327:6062]
2025-10-02T08:11:09.016209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533971280895327:6062]
2025-10-02T08:11:09.016267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:09.016276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.016279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:09.016279Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:09.016287Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:09.016469Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:09.019104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId: src_id|54c97008-11de4d7f-5861bce4-c0559dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:09.022271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:09.060448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533975575862686:11760]
2025-10-02T08:11:09.060822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1091, pipe: [1:7556533975575862686:11760]
2025-10-02T08:11:09.188688Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:09.189103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.189123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.189163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575862686:11760], now have 1 active actors on pipe
2025-10-02T08:11:09.189359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533975575862686:11760]
2025-10-02T08:11:09.189397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:09.189400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:09.189462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1092 reason: error at write: Disconnected sessionId: src_id|54c97008-11de4d7f-5861bce4-c0559dec_0
2025-10-02T08:11:09.189596Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:09.189670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1092 sessionId: src_id|54c97008-11de4d7f-5861bce4-c0559dec_0 is DEAD
2025-10-02T08:11:09.189784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c97008-11de4d7f-5861bce4-c0559dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:09.189793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c97008-11de4d7f-5861bce4-c0559dec_0] Write session will restart in 0.007154s
2025-10-02T08:11:09.189827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c97008-11de4d7f-5861bce4-c0559dec_0] Write session: Do CDS request
2025-10-02T08:11:09.189837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c97008-11de4d7f-5861bce4-c0559dec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:09.190348Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:09.201438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c97008-11de4d7f-5861bce4-c0559dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:09.201517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:09.201533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1093
2025-10-02T08:11:09.201745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:09.201780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:09.201790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:09.201794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:09.202267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1093 sessionId:  describe result for acl check
2025-10-02T08:11:09.202306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:09.202308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:09.202310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:09.202315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533975575862888:6035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:09.202911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533975575862888:6035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:09.206836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533975575862888:6035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:09.207646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:09.209695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:09.209937Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:09.209947Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:09.209959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:09.210020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:09.210060Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533975575863020:6043]
2025-10-02T08:11:09.210702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:09.211060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:09.211117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:09.211470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:09.211536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.211537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.211539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.211540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.211541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.211547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.211558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.211562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.211567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.211571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.211576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.211584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.211591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.211606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.211617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.211622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.211626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.211632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.211637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.211642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.211662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:09.212458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533975575862888:6035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:09.212473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533975575862888:6035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:09.212476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533975575862888:6035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:09.212485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:09.221030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:09.223184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:09.223208Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:09.223211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:09.223216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:09.223224Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1092 [1:7556533975575863020:6043]
2025-10-02T08:11:09.223238Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:09.223265Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:09.223268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.223271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.223279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.223298Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:09.223309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:09.223316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:09.223398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.223408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.223411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:09.223413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:09.223486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:09.223498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.223511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.223523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:09.223545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575863036:6035], now have 1 active actors on pipe
2025-10-02T08:11:09.223544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1092
2025-10-02T08:11:09.223555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533975575863012:6043]
2025-10-02T08:11:09.223557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533975575863012:6043]
2025-10-02T08:11:09.223565Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:09.223576Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:09.223577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533976035884635:2378], now have 1 active actors on pipe
2025-10-02T08:11:09.223583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.223587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.223594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:09.223605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:09.223618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:09.223621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:09.223663Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|395b02d1-5e187964-82e43741-1aef30a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:09.223674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.223679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.223686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:09.223694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.223703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:09.223712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533975575863012:6043]
2025-10-02T08:11:09.223715Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:09.223718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:09.223675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1092
2025-10-02T08:11:09.223743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:09.223832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.223840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.223852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:09.223880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1093 partition: 0 MaxSeqNo: 17 sessionId: src_id|395b02d1-5e187964-82e43741-1aef30a4_0
2025-10-02T08:11:09.224289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c97008-11de4d7f-5861bce4-c0559dec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|395b02d1-5e187964-82e43741-1aef30a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:09.227428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|395b02d1-5e187964-82e43741-1aef30a4_0] Write session: try to update token
2025-10-02T08:11:09.227447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|395b02d1-5e187964-82e43741-1aef30a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:09.246587Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:09.246616Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:09.246620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:09.246631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533975575863012:6043]
2025-10-02T08:11:09.246636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533975575863012:6043]
2025-10-02T08:11:09.246690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:09.246689Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:09.246696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:09.246705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.246707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:09.246921Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:09.255937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId: src_id|395b02d1-5e187964-82e43741-1aef30a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:09.259344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:09.289309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533975575863051:11760]
2025-10-02T08:11:09.289466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1092, pipe: [1:7556533975575863051:11760]
2025-10-02T08:11:09.390114Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:09.390376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.390389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.390410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575863051:11760], now have 1 active actors on pipe
2025-10-02T08:11:09.390533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:09.390541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:09.390594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1093 reason: error at write: Disconnected sessionId: src_id|395b02d1-5e187964-82e43741-1aef30a4_0
2025-10-02T08:11:09.390665Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:09.390780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1093 sessionId: src_id|395b02d1-5e187964-82e43741-1aef30a4_0 is DEAD
2025-10-02T08:11:09.390903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533975575863051:11760]
2025-10-02T08:11:09.391077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395b02d1-5e187964-82e43741-1aef30a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:09.391085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395b02d1-5e187964-82e43741-1aef30a4_0] Write session will restart in 0.007588s
2025-10-02T08:11:09.391108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395b02d1-5e187964-82e43741-1aef30a4_0] Write session: Do CDS request
2025-10-02T08:11:09.391117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395b02d1-5e187964-82e43741-1aef30a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:09.391962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:09.400469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|395b02d1-5e187964-82e43741-1aef30a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:09.401133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:09.401151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1094
2025-10-02T08:11:09.401451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:09.401486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:09.401497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:09.401501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:09.402183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1094 sessionId:  describe result for acl check
2025-10-02T08:11:09.402224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:09.402229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:09.402230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:09.402236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533975575863329:6027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:09.403044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533975575863329:6027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:09.405540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:09.406497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533975575863329:6027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:09.410705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:09.410947Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:09.410958Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:09.410970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:09.411028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:09.411030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533975575863329:6027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:09.411038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533975575863329:6027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:09.411043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533975575863329:6027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:09.411052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:09.411071Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533975575863384:6015]
2025-10-02T08:11:09.411723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:09.412380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:09.412434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:09.412780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:09.412843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.412849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.412851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.412852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.412853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.412859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.412870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.412874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.412888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.412891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.412897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.412905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.412913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.412918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.412925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.412932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.412937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.412942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.412946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.412952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.412970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:09.431665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:09.433461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:09.433482Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:09.433484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:09.433488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:09.433495Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1093 [1:7556533975575863384:6015]
2025-10-02T08:11:09.433511Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:09.433531Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:09.433534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.433537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.433539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.433557Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:09.433562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:09.433569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:09.433635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.433649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.433651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:09.433653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:09.433722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:09.433730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.433744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.433761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:09.433787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533975575863363:6015]
2025-10-02T08:11:09.433789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533975575863363:6015]
2025-10-02T08:11:09.433797Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:09.433799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1093
2025-10-02T08:11:09.433811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575863389:6027], now have 1 active actors on pipe
2025-10-02T08:11:09.433819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:09.433821Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:09.433827Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:09.433833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:09.433836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:09.433845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533976035884642:2378], now have 1 active actors on pipe
2025-10-02T08:11:09.433849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.433853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.433898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533975575863363:6015]
2025-10-02T08:11:09.433910Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:09.433923Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:09.433929Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:09.433936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.433939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.433941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:09.433951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.433961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:09.433994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:09.434159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.434167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.434181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:09.434217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1094 partition: 0 MaxSeqNo: 17 sessionId: src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0
2025-10-02T08:11:09.433926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1093
2025-10-02T08:11:09.437112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|395b02d1-5e187964-82e43741-1aef30a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:09.440615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0] Write session: try to update token
2025-10-02T08:11:09.440642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:09.454934Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:09.454959Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:09.454961Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:09.454971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533975575863363:6015]
2025-10-02T08:11:09.454974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533975575863363:6015]
2025-10-02T08:11:09.455009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:09.455016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.455018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:09.455160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:09.455181Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:09.455183Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:09.468911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId: src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:09.472009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:09.491050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533975575863421:11760]
2025-10-02T08:11:09.491266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1093, pipe: [1:7556533975575863421:11760]
2025-10-02T08:11:09.601204Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:09.601752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.601765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.601794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575863421:11760], now have 1 active actors on pipe
2025-10-02T08:11:09.602122Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:09.602128Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:09.603019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:09.603031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0] Write session will restart in 0.005461s
2025-10-02T08:11:09.603057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0] Write session: Do CDS request
2025-10-02T08:11:09.603065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:09.602562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533975575863421:11760]
2025-10-02T08:11:09.602590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:09.602642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1094 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0
2025-10-02T08:11:09.602850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1094 sessionId: src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0 is DEAD
2025-10-02T08:11:09.610011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:09.610098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:09.610119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1095
2025-10-02T08:11:09.610313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:09.610349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:09.610360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:09.610364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:09.610876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1095 sessionId:  describe result for acl check
2025-10-02T08:11:09.610927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:09.610934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:09.610936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:09.610943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533975575863596:6020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:09.611623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533975575863596:6020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:09.617160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:09.617907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533975575863596:6020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:09.618798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:09.619022Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:09.619034Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:09.619044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:09.619103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:09.619141Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533975575863762:6021]
2025-10-02T08:11:09.619798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:09.620091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:09.620143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:09.620448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:09.620506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.620512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.620513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.620514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.620515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.620521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.620531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.620535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.620540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.620543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.620549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.620557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.620563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.620569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.620573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.620579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.620585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.620590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.620594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.620598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.620616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:09.621780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533975575863596:6020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:09.621801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533975575863596:6020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:09.621804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533975575863596:6020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:09.621816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:09.629779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:09.631701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:09.631718Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:09.631722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:09.631727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:09.631739Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1094 [1:7556533975575863762:6021]
2025-10-02T08:11:09.631756Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:09.631779Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:09.631791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.631795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.631797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.631831Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:09.631838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:09.631846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:09.631929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.631937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.631940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:09.631943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:09.632034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:09.632042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.632059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.632078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:09.632105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575863779:6020], now have 1 active actors on pipe
2025-10-02T08:11:09.632118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533975575863746:6021]
2025-10-02T08:11:09.632125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533975575863746:6021]
2025-10-02T08:11:09.632135Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:09.632149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533976035884650:2378], now have 1 active actors on pipe
2025-10-02T08:11:09.632151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1094
2025-10-02T08:11:09.632162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:09.632170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:09.632178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:09.632181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:09.632181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:09.632189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.632195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.632244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533975575863746:6021]
2025-10-02T08:11:09.632233Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1094
2025-10-02T08:11:09.632258Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:09.632266Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:09.632275Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:09.632283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.632287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.632289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:09.632302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.632312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:09.632360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:09.632461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.632469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.632484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:09.632529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1095 partition: 0 MaxSeqNo: 17 sessionId: src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0
2025-10-02T08:11:09.632955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e53cc-338a45e-1549b41c-a577f5a0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:09.636172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0] Write session: try to update token
2025-10-02T08:11:09.636193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:09.650739Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:09.650761Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:09.650764Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:09.650771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533975575863746:6021]
2025-10-02T08:11:09.650778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533975575863746:6021]
2025-10-02T08:11:09.650823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:09.650832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.650835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:09.650846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:09.650854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:09.651001Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:09.654199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId: src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:09.657130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:09.702455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533975575863831:11760]
2025-10-02T08:11:09.702568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1094, pipe: [1:7556533975575863831:11760]
2025-10-02T08:11:09.796033Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:09.796368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.796375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.796409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575863831:11760], now have 1 active actors on pipe
2025-10-02T08:11:09.796549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533975575863831:11760]
2025-10-02T08:11:09.796567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:09.796570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:09.796615Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:09.796624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1095 reason: error at write: Disconnected sessionId: src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0
2025-10-02T08:11:09.796987Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:09.797634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:09.797646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0] Write session will restart in 0.007111s
2025-10-02T08:11:09.797669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0] Write session: Do CDS request
2025-10-02T08:11:09.797678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:09.797875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1095 sessionId: src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0 is DEAD
2025-10-02T08:11:09.806468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:09.806438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:09.806451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1096
2025-10-02T08:11:09.806768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:09.806792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:09.806799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:09.806801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:09.807230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1096 sessionId:  describe result for acl check
2025-10-02T08:11:09.807267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:09.807273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:09.807275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:09.807280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533975575864056:5981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:09.807784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533975575864056:5981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:09.810468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533975575864056:5981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:09.811742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:09.813389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:09.813618Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:09.813635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:09.813644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:09.813693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:09.813740Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533975575864169:5967]
2025-10-02T08:11:09.813980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533975575864056:5981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:09.813998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533975575864056:5981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:09.814017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533975575864056:5981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:09.814026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:09.814324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:09.814509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:09.814553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:09.814833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:09.814884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.814890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.814891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.814892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.814893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.814899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.814908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.814912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.814917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.814920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.814925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.814932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:09.814938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.814942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:09.814946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.814950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:09.814955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.814960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.814964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.814969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.814988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:09.823392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:09.825203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:09.825226Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:09.825229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:09.825233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:09.825241Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1095 [1:7556533975575864169:5967]
2025-10-02T08:11:09.825253Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:09.825268Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:09.825280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.825283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.825286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.825301Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:09.825306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:09.825313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:09.825375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.825382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.825385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:09.825388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:09.825455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:09.825463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.825476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:09.825493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:09.825514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533975575864163:5967]
2025-10-02T08:11:09.825520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533975575864163:5967]
2025-10-02T08:11:09.825521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1095
2025-10-02T08:11:09.825529Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:09.825539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:09.825541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575864174:5981], now have 1 active actors on pipe
2025-10-02T08:11:09.825545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533976035884678:2378], now have 1 active actors on pipe
2025-10-02T08:11:09.825549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:09.825552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:09.825565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:09.825567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:09.825574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.825582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.825620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533975575864163:5967]
2025-10-02T08:11:09.825628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:09.825624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1095
2025-10-02T08:11:09.825643Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:09.825649Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:09.825654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.825658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.825660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:09.825668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.825676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:09.825718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:09.825799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.825806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.825818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:09.825856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1096 partition: 0 MaxSeqNo: 17 sessionId: src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0
2025-10-02T08:11:09.826232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa0743e-46e4bb71-13a4556a-dd314d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:09.829113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0] Write session: try to update token
2025-10-02T08:11:09.829128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:09.841875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:09.841891Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:09.841897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533975575864163:5967]
2025-10-02T08:11:09.841934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:09.841949Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:09.842086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:09.842214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:09.842345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:09.842476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:09.842659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:09.842690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:09.843333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId: src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:09.845870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:09.845970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.845984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.846010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:09.846029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:09.846186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:09.846201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:09.846381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.846447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.846527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.846595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.846643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.846652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.846720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.846794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.846860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.846928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.846970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.846977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.847057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.847119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.847181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.847244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.847289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.847295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.847361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.847424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.847489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.847553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.847598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.847605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.847670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.847733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.847798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.847884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.847932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.847939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.848004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.848065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.848129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.848195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.848245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.848252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.848316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.848384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.848452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.848516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.848560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.848573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.848637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.848699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.848763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.848850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.848898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.848905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.848972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.849034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.849098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.849165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.849216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.849223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.849287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:09.849348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:09.849414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:09.849475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:09.849519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:09.849526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:09.849562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:09.849627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:09.849649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:09.849655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:09.849685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:09.849701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:09.849709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:09.849712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:09.849716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:09.850158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:09.850183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:09.850193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:09.850199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:09.850202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:09.850209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:09.850925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:09.850950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:09.850956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:09.850959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:09.850963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:09.850968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:09.851592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:09.851614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:09.851625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:09.851628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:09.851632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:09.853975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:09.853992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:09.854009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392669853
2025-10-02T08:11:09.854191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:09.854207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:09.854215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:09.854218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:09.854222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:09.854226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:09.854716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:09.854737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:09.854746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:09.854756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:09.854763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:09.854767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:09.855211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:09.855233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:09.855242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:09.855246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:09.855253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:09.855256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:09.855737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:09.855757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:09.855761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:09.856905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:09.856920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:09.856925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:09.856929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:09.856938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392669856
2025-10-02T08:11:09.857244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:09.857263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:09.857269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:09.857272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:09.857276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:09.857279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:09.857738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:09.857760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:09.857769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:09.857773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:09.857776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:09.857780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:09.858240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:09.858257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:09.858365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392669858
2025-10-02T08:11:09.859258Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:09.859291Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:09.859299Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:09.859306Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:09.860850Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:09.860863Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:09.860865Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:09.860872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533975575864163:5967]
2025-10-02T08:11:09.860876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533975575864163:5967]
2025-10-02T08:11:09.860931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:09.860935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:09.860938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:09.861001Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:09.861017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:09.861061Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:09.896539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533975575864207:11760]
2025-10-02T08:11:09.896655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1095, pipe: [1:7556533975575864207:11760]
2025-10-02T08:11:09.998843Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:09.999170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533975575864207:11760], now have 1 active actors on pipe
2025-10-02T08:11:09.999280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:09.999292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:09.999323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1096 reason: error at write: Disconnected sessionId: src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0
2025-10-02T08:11:09.999350Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:09.999447Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:09.999521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1096 sessionId: src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0 is DEAD
2025-10-02T08:11:09.999656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:09.999666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0] Write session will restart in 0.008024s
2025-10-02T08:11:09.999689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0] Write session: Do CDS request
2025-10-02T08:11:09.999695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:09.999697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533975575864207:11760]
2025-10-02T08:11:10.009414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.009469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:10.009484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1097
2025-10-02T08:11:10.009666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.009707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:10.009717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:10.009720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:10.010138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1097 sessionId:  describe result for acl check
2025-10-02T08:11:10.010177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:10.010179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:10.010180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:10.010185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533979870831821:5964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:10.010409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:10.010663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533979870831821:5964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:10.011970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:10.012159Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:10.012168Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:10.012177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:10.012223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:10.012255Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533979870831844:5962]
2025-10-02T08:11:10.012425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533979870831821:5964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:10.012856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:10.013015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:10.013052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:10.013342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:10.013379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.013383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.013384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.013385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.013385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.013389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.013396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.013398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.013400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.013402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.013405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.013409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.013412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.013415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.013417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.013430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.013432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.013435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.013438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.013440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.013451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:10.018745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533979870831821:5964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:10.018763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533979870831821:5964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:10.018766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533979870831821:5964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:10.018776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:10.021825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:10.023249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:10.023271Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:10.023275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:10.023281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:10.023288Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1096 [1:7556533979870831844:5962]
2025-10-02T08:11:10.023299Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:10.023316Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:10.023324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.023327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.023329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.023346Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:10.023352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:10.023357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:10.023527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.023538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.023541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:10.023544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:10.023610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:10.023618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.023630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.023645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:10.023666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870831871:5964], now have 1 active actors on pipe
2025-10-02T08:11:10.023673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1096
2025-10-02T08:11:10.023674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533976035884699:2378], now have 1 active actors on pipe
2025-10-02T08:11:10.023680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533979870831822:5962]
2025-10-02T08:11:10.023682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533979870831822:5962]
2025-10-02T08:11:10.023693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:10.023706Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:10.023710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.023714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.023714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:10.023729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:10.023748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:10.023755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:10.023733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1096
2025-10-02T08:11:10.023798Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22041289-dab0f035-b358a4d2-e64adece_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:10.023820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.023828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.023830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:10.023840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.023853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:10.023871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533979870831822:5962]
2025-10-02T08:11:10.023883Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:10.023897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:10.023915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.024001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.024009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.024027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.024064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1097 partition: 0 MaxSeqNo: 17 sessionId: src_id|22041289-dab0f035-b358a4d2-e64adece_0
2025-10-02T08:11:10.024466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7c70b6-30cb82e-8bbb10b8-e4f9d867_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|22041289-dab0f035-b358a4d2-e64adece_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:10.027534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22041289-dab0f035-b358a4d2-e64adece_0] Write session: try to update token
2025-10-02T08:11:10.027551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22041289-dab0f035-b358a4d2-e64adece_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:10.039348Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:10.039373Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:10.039383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533979870831822:5962]
2025-10-02T08:11:10.039425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:10.039537Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:10.039601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:10.039741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:10.039894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:10.040035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:10.040241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:10.040286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:10.044081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId: src_id|22041289-dab0f035-b358a4d2-e64adece_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:10.047054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:10.047169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.047187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.047235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:10.047265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:10.047341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.047362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.047592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.047673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.047769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.047866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.048093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.048118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.048199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.048273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.048351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.048520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.048576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.048585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.048666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.048738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.048799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.048876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.048923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.048930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.049003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.049067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.049130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.049196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.049242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.049249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.049319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.049380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.049445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.049511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.049558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.049566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.049634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.049697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.049760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.049821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.049865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.049872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.049938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.050000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.050070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.050133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.050177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.050184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.050251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.050312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.050380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.050448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.050494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.050501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.050567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.050628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.050693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.050757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.050802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.050810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.050876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:10.050937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:10.051000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:10.051062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:10.051108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:10.051116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:10.051181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:10.051242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.051263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.051269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:10.051299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:10.051315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:10.051322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:10.051325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:10.051327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:10.051713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:10.051740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:10.051746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:10.051749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:10.051753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:10.051756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:10.052362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:10.052385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:10.052391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:10.052394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:10.052396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:10.052399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:10.052936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:10.052956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:10.052963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:10.052966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:10.052969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:10.054150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:10.054166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:10.054178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392670054
2025-10-02T08:11:10.054290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:10.054302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:10.054306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:10.054310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:10.054314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:10.054318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:10.054812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:10.054834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:10.054839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:10.054842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:10.054846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:10.054849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:10.055292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:10.055315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:10.055321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:10.055323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:10.055328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:10.055331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:10.055799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:10.055827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:10.055832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:10.056990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:10.057006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:10.057011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:10.057013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:10.057021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392670056
2025-10-02T08:11:10.057347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:10.057370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:10.057378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:10.057386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:10.057389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:10.057392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:10.057857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:10.057878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:10.057884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:10.057889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:10.057894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:10.057898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:10.058349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:10.058369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.058468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392670058
2025-10-02T08:11:10.060830Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:10.060853Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:10.060859Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:10.060866Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:10.060876Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:10.060878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:10.060881Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:10.060887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533979870831822:5962]
2025-10-02T08:11:10.060891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533979870831822:5962]
2025-10-02T08:11:10.060945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:10.060960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:10.060961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:10.060965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.060967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:10.061099Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:10.099787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533979870831888:11760]
2025-10-02T08:11:10.099943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1096, pipe: [1:7556533979870831888:11760]
2025-10-02T08:11:10.203931Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:10.204344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870831888:11760], now have 1 active actors on pipe
2025-10-02T08:11:10.204556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533979870831888:11760]
2025-10-02T08:11:10.204578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:10.204581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:10.204606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1097 reason: error at write: Disconnected sessionId: src_id|22041289-dab0f035-b358a4d2-e64adece_0
2025-10-02T08:11:10.204632Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:10.205004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22041289-dab0f035-b358a4d2-e64adece_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:10.204766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1097 sessionId: src_id|22041289-dab0f035-b358a4d2-e64adece_0 is DEAD
2025-10-02T08:11:10.205028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22041289-dab0f035-b358a4d2-e64adece_0] Write session will restart in 0.007170s
2025-10-02T08:11:10.205058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22041289-dab0f035-b358a4d2-e64adece_0] Write session: Do CDS request
2025-10-02T08:11:10.205065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22041289-dab0f035-b358a4d2-e64adece_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:10.207511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:10.208190Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [577cb43306b24d80] Result# TEvPutResult {Id# [72075186224037892:1096:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:10.208202Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1096:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:10.208310Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1096:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:10.217420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22041289-dab0f035-b358a4d2-e64adece_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.217798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:10.217814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1098
2025-10-02T08:11:10.219285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.219323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:10.219328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:10.219332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:10.219485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:10.219803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1098 sessionId:  describe result for acl check
2025-10-02T08:11:10.219849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:10.219854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:10.219855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:10.219860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533979870832205:5944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:10.220242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533979870832205:5944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:10.221217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:10.221400Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:10.221407Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:10.221414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:10.221451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:10.221479Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533979870832212:5945]
2025-10-02T08:11:10.222153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:10.222385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:10.222435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:10.222696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:10.222753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.222759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.222760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.222761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.222761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.222766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.222775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.222778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.222781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.222784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.222789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.222796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.222801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.222805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.222809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.222814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.222818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.222823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.222828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.222833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.222850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:10.223067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533979870832205:5944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:10.229233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533979870832205:5944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:10.229262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533979870832205:5944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:10.229266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533979870832205:5944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:10.229275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:10.231710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:10.233468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:10.233487Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:10.233489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:10.233493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:10.233500Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1097 [1:7556533979870832212:5945]
2025-10-02T08:11:10.233511Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:10.233529Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:10.233531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.233534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.233536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.233550Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:10.233556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:10.233563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:10.233626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.233633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.233636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:10.233638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:10.233713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:10.233722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.233736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.233746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:10.233767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870832251:5944], now have 1 active actors on pipe
2025-10-02T08:11:10.233777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533979870832199:5945]
2025-10-02T08:11:10.233783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533979870832199:5945]
2025-10-02T08:11:10.233794Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:10.233805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533980330852002:2378], now have 1 active actors on pipe
2025-10-02T08:11:10.233810Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:10.233815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:10.233815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.233819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.233834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:10.233851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:10.233851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1097
2025-10-02T08:11:10.233857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:10.233903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1097
2025-10-02T08:11:10.233903Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:10.233915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.233919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.233921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:10.233931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.233939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:10.233946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533979870832199:5945]
2025-10-02T08:11:10.233954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:10.233967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:10.233982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.234056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.234076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.234106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.234164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1098 partition: 0 MaxSeqNo: 17 sessionId: src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0
2025-10-02T08:11:10.234755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22041289-dab0f035-b358a4d2-e64adece_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:10.237972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0] Write session: try to update token
2025-10-02T08:11:10.237995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:10.254620Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:10.254639Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:10.254641Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:10.254650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533979870832199:5945]
2025-10-02T08:11:10.254658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533979870832199:5945]
2025-10-02T08:11:10.254700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:10.254706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:10.254711Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:10.254714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.254717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:10.254860Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:10.261045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId: src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:10.264296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:10.304593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533979870832266:11760]
2025-10-02T08:11:10.304744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1097, pipe: [1:7556533979870832266:11760]
2025-10-02T08:11:10.385079Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:10.385365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.385380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.385426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870832266:11760], now have 1 active actors on pipe
2025-10-02T08:11:10.385613Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:10.385627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:10.385637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:10.385690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1098 reason: error at write: Disconnected sessionId: src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0
2025-10-02T08:11:10.385773Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:10.385903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1098 sessionId: src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0 is DEAD
2025-10-02T08:11:10.386084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:10.386101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0] Write session will restart in 0.006990s
2025-10-02T08:11:10.386093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533979870832266:11760]
2025-10-02T08:11:10.386131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0] Write session: Do CDS request
2025-10-02T08:11:10.386138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:10.394352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.394489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:10.394507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1099
2025-10-02T08:11:10.394671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.394702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:10.394710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:10.394713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:10.395135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1099 sessionId:  describe result for acl check
2025-10-02T08:11:10.395169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:10.395175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:10.395176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:10.395181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533979870832563:5934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:10.395631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533979870832563:5934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:10.396638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:10.397608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533979870832563:5934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:10.398098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:10.398267Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:10.398274Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:10.398281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:10.398313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:10.398339Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533979870832610:5930]
2025-10-02T08:11:10.398770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:10.398894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:10.398917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:10.399092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:10.399118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.399122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.399123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.399124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.399124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.399127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.399133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.399136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.399138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.399139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.399143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.399147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.399150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.399153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.399155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.399158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.399160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.399162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.399164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.399167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.399176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:10.402921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533979870832563:5934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:10.402934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533979870832563:5934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:10.402937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533979870832563:5934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:10.402945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:10.406987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:10.408352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:10.408370Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:10.408372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:10.408375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:10.408381Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1098 [1:7556533979870832610:5930]
2025-10-02T08:11:10.408393Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:10.408409Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:10.408411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.408415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.408416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.408430Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:10.408435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:10.408441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:10.408497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.408505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.408508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:10.408510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:10.408571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:10.408579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.408591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.408603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:10.408623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870832627:5934], now have 1 active actors on pipe
2025-10-02T08:11:10.408624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1098
2025-10-02T08:11:10.408633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533979870832587:5930]
2025-10-02T08:11:10.408635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533979870832587:5930]
2025-10-02T08:11:10.408646Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:10.408658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533980330852008:2378], now have 1 active actors on pipe
2025-10-02T08:11:10.408659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:10.408662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:10.408664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.408668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.408685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:10.408722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:10.408729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:10.408722Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1098
2025-10-02T08:11:10.408768Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b010f147-aa05f27f-9b15bee-df619db4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:10.408779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.408787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.408789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:10.408798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.408833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:10.408841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533979870832587:5930]
2025-10-02T08:11:10.408849Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:10.408855Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:10.408878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.408958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.408965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.408979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.409017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1099 partition: 0 MaxSeqNo: 17 sessionId: src_id|b010f147-aa05f27f-9b15bee-df619db4_0
2025-10-02T08:11:10.409368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a107af00-ad6dd4da-81ab8223-ba1f82b1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b010f147-aa05f27f-9b15bee-df619db4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:10.412189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b010f147-aa05f27f-9b15bee-df619db4_0] Write session: try to update token
2025-10-02T08:11:10.412210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b010f147-aa05f27f-9b15bee-df619db4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:10.426066Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:10.426081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:10.426083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:10.426089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533979870832587:5930]
2025-10-02T08:11:10.426092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533979870832587:5930]
2025-10-02T08:11:10.426132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:10.426137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.426138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:10.426138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:10.426143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:10.426260Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:10.428044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId: src_id|b010f147-aa05f27f-9b15bee-df619db4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:10.430761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:10.486332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533979870832646:11760]
2025-10-02T08:11:10.486469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1098, pipe: [1:7556533979870832646:11760]
2025-10-02T08:11:10.565435Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:10.565776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.565791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.565831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870832646:11760], now have 1 active actors on pipe
2025-10-02T08:11:10.565967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:10.565979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:10.566048Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:10.566053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1099 reason: error at write: Disconnected sessionId: src_id|b010f147-aa05f27f-9b15bee-df619db4_0
2025-10-02T08:11:10.566267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1099 sessionId: src_id|b010f147-aa05f27f-9b15bee-df619db4_0 is DEAD
2025-10-02T08:11:10.566321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533979870832646:11760]
2025-10-02T08:11:10.566602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b010f147-aa05f27f-9b15bee-df619db4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:10.566613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b010f147-aa05f27f-9b15bee-df619db4_0] Write session will restart in 0.009954s
2025-10-02T08:11:10.566652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b010f147-aa05f27f-9b15bee-df619db4_0] Write session: Do CDS request
2025-10-02T08:11:10.566660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b010f147-aa05f27f-9b15bee-df619db4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:10.566094Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:10.577438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b010f147-aa05f27f-9b15bee-df619db4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.577694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:10.579196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:10.579395Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:10.579403Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:10.579412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:10.579469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:10.579505Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533979870832961:5927]
2025-10-02T08:11:10.580174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:10.580359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:10.580392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:10.580609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:10.580645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.580650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.580650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.580651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.580652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.580655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.580661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.580664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.580666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.580668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.580672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.580677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.580680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.580684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.580690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.580693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.580695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.580698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.580704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.580707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.580722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:10.581206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:10.581217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1100
2025-10-02T08:11:10.581431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.581495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:10.581509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:10.581517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:10.582029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1100 sessionId:  describe result for acl check
2025-10-02T08:11:10.582084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:10.582086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:10.582088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:10.582095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533979870832977:5924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:10.582943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533979870832977:5924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:10.585216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533979870832977:5924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:10.588386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533979870832977:5924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:10.588404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533979870832977:5924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:10.588410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533979870832977:5924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:10.588418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:10.589024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:10.590632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:10.590657Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:10.590659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:10.590663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:10.590669Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1099 [1:7556533979870832961:5927]
2025-10-02T08:11:10.590683Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:10.590699Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:10.590702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.590706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.590707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.590724Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:10.590735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:10.590742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:10.590822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.590832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.590835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:10.590837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:10.590899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:10.590909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.590922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.590933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:10.590947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1099
2025-10-02T08:11:10.590956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870833008:5924], now have 1 active actors on pipe
2025-10-02T08:11:10.590959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533980330852017:2378], now have 1 active actors on pipe
2025-10-02T08:11:10.590964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533979870832955:5927]
2025-10-02T08:11:10.590966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533979870832955:5927]
2025-10-02T08:11:10.590979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:10.590993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:10.590996Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:10.590997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.591002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.591021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:10.591034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:10.591044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:10.591017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1099
2025-10-02T08:11:10.591084Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55606e54-2fd1c649-be15c0ac-436e192a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:10.591097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.591101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.591104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:10.591114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.591128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:10.591141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533979870832955:5927]
2025-10-02T08:11:10.591155Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:10.591168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:10.591186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.591276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.591287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.591308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.591346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1100 partition: 0 MaxSeqNo: 17 sessionId: src_id|55606e54-2fd1c649-be15c0ac-436e192a_0
2025-10-02T08:11:10.591766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b010f147-aa05f27f-9b15bee-df619db4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|55606e54-2fd1c649-be15c0ac-436e192a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:10.594842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55606e54-2fd1c649-be15c0ac-436e192a_0] Write session: try to update token
2025-10-02T08:11:10.594863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55606e54-2fd1c649-be15c0ac-436e192a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:10.611624Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:10.611646Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:10.611648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:10.611656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533979870832955:5927]
2025-10-02T08:11:10.611661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533979870832955:5927]
2025-10-02T08:11:10.611698Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:10.611702Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:10.611705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:10.611712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.611714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:10.611869Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:10.616774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId: src_id|55606e54-2fd1c649-be15c0ac-436e192a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:10.620059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:10.666610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533979870833028:11760]
2025-10-02T08:11:10.666753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1099, pipe: [1:7556533979870833028:11760]
2025-10-02T08:11:10.767664Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:10.768088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.768105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.768124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870833028:11760], now have 1 active actors on pipe
2025-10-02T08:11:10.768244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:10.768251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:10.768300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1100 reason: error at write: Disconnected sessionId: src_id|55606e54-2fd1c649-be15c0ac-436e192a_0
2025-10-02T08:11:10.768378Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:10.768400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:10.768496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1100 sessionId: src_id|55606e54-2fd1c649-be15c0ac-436e192a_0 is DEAD
2025-10-02T08:11:10.768654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533979870833028:11760]
2025-10-02T08:11:10.768826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55606e54-2fd1c649-be15c0ac-436e192a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:10.768837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55606e54-2fd1c649-be15c0ac-436e192a_0] Write session will restart in 0.009769s
2025-10-02T08:11:10.768864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55606e54-2fd1c649-be15c0ac-436e192a_0] Write session: Do CDS request
2025-10-02T08:11:10.768869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55606e54-2fd1c649-be15c0ac-436e192a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:10.779456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55606e54-2fd1c649-be15c0ac-436e192a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.779632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:10.779646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1101
2025-10-02T08:11:10.779789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.779824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:10.779829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:10.779832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:10.780313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1101 sessionId:  describe result for acl check
2025-10-02T08:11:10.780359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:10.780367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:10.780369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:10.780402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533979870833361:5894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:10.781007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533979870833361:5894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:10.782735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:10.784185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533979870833361:5894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:10.784631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:10.784834Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:10.784836Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:10.784845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:10.784892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:10.784927Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533979870833412:5893]
2025-10-02T08:11:10.785357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:10.785544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:10.785588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:10.785913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:10.785943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.785944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.785944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.785945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.785946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.785952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.785961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.785965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.785969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.785972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.785977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.785985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.785990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.785996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.786000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.786005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.786009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.786014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.786018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.786022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.786039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:10.786765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533979870833361:5894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:10.786775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533979870833361:5894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:10.786779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533979870833361:5894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:10.786786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:10.794539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:10.796296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:10.796314Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:10.796318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:10.796322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:10.796328Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1100 [1:7556533979870833412:5893]
2025-10-02T08:11:10.796338Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:10.796355Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:10.796358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.796361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.796363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.796379Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:10.796385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:10.796391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:10.796457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.796465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.796468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:10.796470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:10.796539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:10.796551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.796564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.796576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:10.796590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533979870833386:5893]
2025-10-02T08:11:10.796592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533979870833386:5893]
2025-10-02T08:11:10.796599Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:10.796613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870833429:5894], now have 1 active actors on pipe
2025-10-02T08:11:10.796621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:10.796620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:10.796623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1100
2025-10-02T08:11:10.796624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:10.796634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:10.796797Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1100
2025-10-02T08:11:10.796639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:10.796644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533980330852045:2378], now have 1 active actors on pipe
2025-10-02T08:11:10.796675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.796679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.796691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533979870833386:5893]
2025-10-02T08:11:10.796700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:10.796724Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ddbe571-e61a3189-8de1440-400592ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:10.796729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.796733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.796734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:10.796735Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:10.796742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.796749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:10.796771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.796917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.796922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.796941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.796976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1101 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ddbe571-e61a3189-8de1440-400592ae_0
2025-10-02T08:11:10.797432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55606e54-2fd1c649-be15c0ac-436e192a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ddbe571-e61a3189-8de1440-400592ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:10.801068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ddbe571-e61a3189-8de1440-400592ae_0] Write session: try to update token
2025-10-02T08:11:10.801094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ddbe571-e61a3189-8de1440-400592ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:10.817320Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:10.817344Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:10.817347Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:10.817355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533979870833386:5893]
2025-10-02T08:11:10.817360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533979870833386:5893]
2025-10-02T08:11:10.817404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:10.817412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.817419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:10.817420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:10.817426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:10.817569Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:10.823282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId: src_id|4ddbe571-e61a3189-8de1440-400592ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:10.826665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:10.868813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533979870833443:11760]
2025-10-02T08:11:10.868978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1100, pipe: [1:7556533979870833443:11760]
2025-10-02T08:11:10.961883Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:10.962462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.962476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.962496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870833443:11760], now have 1 active actors on pipe
2025-10-02T08:11:10.962809Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:10.962622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533979870833443:11760]
2025-10-02T08:11:10.962643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:10.962646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:10.962698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1101 reason: error at write: Disconnected sessionId: src_id|4ddbe571-e61a3189-8de1440-400592ae_0
2025-10-02T08:11:10.962768Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:10.962907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1101 sessionId: src_id|4ddbe571-e61a3189-8de1440-400592ae_0 is DEAD
2025-10-02T08:11:10.964949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ddbe571-e61a3189-8de1440-400592ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:10.964967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ddbe571-e61a3189-8de1440-400592ae_0] Write session will restart in 0.006640s
2025-10-02T08:11:10.965004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ddbe571-e61a3189-8de1440-400592ae_0] Write session: Do CDS request
2025-10-02T08:11:10.965012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ddbe571-e61a3189-8de1440-400592ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:10.974615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ddbe571-e61a3189-8de1440-400592ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.976162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:10.977003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:10.977032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1102
2025-10-02T08:11:10.977238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:10.977295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:10.977307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:10.977312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:10.977697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:10.978014Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:10.978032Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:10.978046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:10.978127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:10.978183Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533979870833778:5879]
2025-10-02T08:11:10.978925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:10.979317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1102 sessionId:  describe result for acl check
2025-10-02T08:11:10.979358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:10.979360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:10.979363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:10.979369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533979870833786:5870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:10.979422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:10.979470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:10.979798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:10.979867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.979868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.979869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.979871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.979872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.979878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.979891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.979895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.979899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.979903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.979910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.979918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:10.979924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.979929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:10.979934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.979939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:10.979943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.979948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.979952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.979958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.979978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:10.980553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533979870833786:5870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:10.984266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533979870833786:5870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:10.989047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:10.989476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533979870833786:5870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:10.989489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533979870833786:5870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:10.989493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533979870833786:5870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:10.989501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:10.992903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ddbe571-e61a3189-8de1440-400592ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:10.996176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0] Write session: try to update token
2025-10-02T08:11:10.996196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:10.991668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:10.991690Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:10.991693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:10.991698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:10.991706Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1101 [1:7556533979870833778:5879]
2025-10-02T08:11:10.991720Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:10.991743Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:10.991746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.991750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.991752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.991774Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:10.991781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:10.991789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:10.991885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.991887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.991891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:10.991894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:10.991979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:10.991982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:10.991999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:10.992012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:10.992027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1101
2025-10-02T08:11:10.992037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533979870833821:5870], now have 1 active actors on pipe
2025-10-02T08:11:10.992041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533980330852064:2378], now have 1 active actors on pipe
2025-10-02T08:11:10.992048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533979870833770:5879]
2025-10-02T08:11:10.992052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533979870833770:5879]
2025-10-02T08:11:10.992067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:10.992077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.992082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.992083Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:10.992087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:10.992105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:10.992121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:10.992125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:10.992182Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:10.992190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:10.992194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:10.992196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:10.992208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:10.992218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:10.992225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533979870833770:5879]
2025-10-02T08:11:10.992236Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:10.992254Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:10.992267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.992361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:10.992369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:10.992393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:10.992434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1102 partition: 0 MaxSeqNo: 17 sessionId: src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0
2025-10-02T08:11:10.997152Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1101
2025-10-02T08:11:11.010733Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:11.010759Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:11.010763Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:11.010777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533979870833770:5879]
2025-10-02T08:11:11.010784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533979870833770:5879]
2025-10-02T08:11:11.010841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:11.010859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.010863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:11.010910Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:11.010917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:11.011038Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:11.014841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId: src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:11.017718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:11.060820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533984165801132:11760]
2025-10-02T08:11:11.060949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1101, pipe: [1:7556533984165801132:11760]
2025-10-02T08:11:11.156816Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:11.157134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.157147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.157167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165801132:11760], now have 1 active actors on pipe
2025-10-02T08:11:11.157261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533984165801132:11760]
2025-10-02T08:11:11.157284Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:11:11.157404Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:11.157459Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 11 consumer shared/user session shared/user_1_11_15278267780770473840_v1 is DEAD
2025-10-02T08:11:11.157567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:11.157622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1102 reason: status is not ok: tablet will be restarted right now sessionId: src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0
2025-10-02T08:11:11.157677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:11.157717Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533902561393495:11757] disconnected; active server actors: 1
2025-10-02T08:11:11.157721Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533902561393495:11757] client user disconnected session shared/user_1_11_15278267780770473840_v1
2025-10-02T08:11:11.157700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1102 sessionId: src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0 is DEAD
2025-10-02T08:11:11.157899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:11.157910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0] Write session will restart in 0.006198s
2025-10-02T08:11:11.157932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0] Write session: Do CDS request
2025-10-02T08:11:11.157938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:11.160927Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:11:11.161129Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:11:11.161136Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:11:11.161145Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.009717s
2025-10-02T08:11:11.166266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.167067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:11.167086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1103
2025-10-02T08:11:11.167241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.167282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:11.167288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:11.167291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:11.167703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1103 sessionId:  describe result for acl check
2025-10-02T08:11:11.167729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:11.167731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:11.167732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:11.167737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533984165801390:5850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:11.168462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533984165801390:5850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:11.171233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533984165801390:5850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:11.172279Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:11:11.172528Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:11:11.172536Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 12
2025-10-02T08:11:11.172696Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 12 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:11:11.172738Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:11:11.172823Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 auth for : user
2025-10-02T08:11:11.173152Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 Handle describe topics response
2025-10-02T08:11:11.173186Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 auth is DEAD
2025-10-02T08:11:11.173194Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:11:11.173439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:11.173466Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:11:11.173707Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_12_6011130484365189452_v1
2025-10-02T08:11:11.173718Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:11:11.173687Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533984165801485:5851] connected; active server actors: 1
2025-10-02T08:11:11.173781Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:11:11.173784Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556533984165801485:5851] session shared/user_1_12_6011130484365189452_v1
2025-10-02T08:11:11.173799Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:11:11.173808Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:11:11.173814Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_12_6011130484365189452_v1" (Sender=[1:7556533984165801480:5851], Pipe=[1:7556533984165801485:5851], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:11:11.173823Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:11:11.173843Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:11:11.173854Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_12_6011130484365189452_v1" (Sender=[1:7556533984165801480:5851], Pipe=[1:7556533984165801485:5851], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:11:11.173868Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_12_6011130484365189452_v1" sender [1:7556533984165801480:5851] lock partition 0 for ReadingSession "shared/user_1_12_6011130484365189452_v1" (Sender=[1:7556533984165801480:5851], Pipe=[1:7556533984165801485:5851], Partitions=[], ActiveFamilyCount=1) generation 1 step 12
2025-10-02T08:11:11.173884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:11:11.173897Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000048s
2025-10-02T08:11:11.174173Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 12 Session: "shared/user_1_12_6011130484365189452_v1" ClientId: "user" PipeClient { RawX1: 7556533984165801485 RawX2: 4503603922343643 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:11:11.174200Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:11:11.174207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:11:11.174270Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 got read request: guid# 88ddb9f7-9023d3f-d03f76b0-57e744c0
2025-10-02T08:11:11.177146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:11.177341Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:11.177348Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:11.177357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:11.177398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:11.177432Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533984165801494:5844]
2025-10-02T08:11:11.177561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533984165801390:5850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:11.177574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533984165801390:5850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:11.177578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533984165801390:5850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:11.177587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:11.177967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:11.178126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:11.178158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:11.178361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:11.178389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.178394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.178395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.178396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.178396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.178400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.178407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.178409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.178411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.178413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.178418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.178422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.178426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.178429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.178431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.178436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.178439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.178442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.178444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.178447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.178459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:11.186832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:11.188587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:11.188606Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:11.188609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:11.188612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:11.188619Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1102 [1:7556533984165801494:5844]
2025-10-02T08:11:11.188631Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:11.188649Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:11.188658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.188661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.188663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.188679Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:11.188688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:11.188694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:11.188755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.188764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.188768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:11.188770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:11.188858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:11.188869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.188883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.188901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:11.188914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1102, pipe: [1:7556533984165801490:5853]
2025-10-02T08:11:11.188923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165801490:5853], now have 1 active actors on pipe
2025-10-02T08:11:11.188929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.188932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.188936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1102
2025-10-02T08:11:11.188943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_12_6011130484365189452_v1 on pipe: [1:7556533984165801490:5853]
2025-10-02T08:11:11.188959Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_12_6011130484365189452_v1:1 with generation 1102
2025-10-02T08:11:11.188959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165801499:5850], now have 1 active actors on pipe
2025-10-02T08:11:11.188965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533984165801483:5844]
2025-10-02T08:11:11.188967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533984165801483:5844]
2025-10-02T08:11:11.188978Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:11.188986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533984625819369:2378], now have 1 active actors on pipe
2025-10-02T08:11:11.188995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:11.188998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:11.189009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:11.189011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:11.189012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:11.189017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.189007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1102
2025-10-02T08:11:11.189018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.189029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.189034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.189036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:11.189049Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_12_6011130484365189452_v1
2025-10-02T08:11:11.189051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.189101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533984165801483:5844]
2025-10-02T08:11:11.189112Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:11.189127Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28238fad-c2b7702b-388837bb-35f0ee4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:11.189127Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:11.189137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:11:11.189141Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:11.190637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:11:11.190663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:11:11.190670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.190674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.190682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:11.190691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.190705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:11.190715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:11:11.190727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:11:11.190747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.190780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.190788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.190804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.190813Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392671188 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:11:11.190826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:11:11.190842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1103 partition: 0 MaxSeqNo: 17 sessionId: src_id|28238fad-c2b7702b-388837bb-35f0ee4_0
2025-10-02T08:11:11.190865Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 sending to client partition status
2025-10-02T08:11:11.191356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b47daf-df172e6b-53b8c46-4c40de4e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|28238fad-c2b7702b-388837bb-35f0ee4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:11.194424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28238fad-c2b7702b-388837bb-35f0ee4_0] Write session: try to update token
2025-10-02T08:11:11.194440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28238fad-c2b7702b-388837bb-35f0ee4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:11.207440Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:11.207459Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:11.207465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:11.207474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533984165801483:5844]
2025-10-02T08:11:11.207481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533984165801483:5844]
2025-10-02T08:11:11.207526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:11.207536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.207536Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:11.207538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:11.207542Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:11.207672Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:11.220226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId: src_id|28238fad-c2b7702b-388837bb-35f0ee4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:11.224276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:11.357720Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:11.358047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.358064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.358196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:11.358207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:11.358271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_12_6011130484365189452_v1
2025-10-02T08:11:11.358278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1103 reason: error at write: Disconnected sessionId: src_id|28238fad-c2b7702b-388837bb-35f0ee4_0
2025-10-02T08:11:11.358285Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:11.358282Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:11.358474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1103 sessionId: src_id|28238fad-c2b7702b-388837bb-35f0ee4_0 is DEAD
2025-10-02T08:11:11.358600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28238fad-c2b7702b-388837bb-35f0ee4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:11.358610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28238fad-c2b7702b-388837bb-35f0ee4_0] Write session will restart in 0.009193s
2025-10-02T08:11:11.358595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533984165801490:5853]
2025-10-02T08:11:11.358616Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_12_6011130484365189452_v1
2025-10-02T08:11:11.358635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28238fad-c2b7702b-388837bb-35f0ee4_0] Write session: Do CDS request
2025-10-02T08:11:11.358641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28238fad-c2b7702b-388837bb-35f0ee4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:11.369365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28238fad-c2b7702b-388837bb-35f0ee4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.369385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:11.369403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1104
2025-10-02T08:11:11.369608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.369658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:11.369668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:11.369672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:11.370057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1104 sessionId:  describe result for acl check
2025-10-02T08:11:11.370087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:11.370094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:11.370096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:11.370100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533984165801837:5849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:11.370621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533984165801837:5849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:11.370904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:11.372504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533984165801837:5849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:11.372546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:11.372731Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:11.372743Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:11.372753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:11.372820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:11.372858Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533984165801872:5852]
2025-10-02T08:11:11.373457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:11.373630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:11.373676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:11.373977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:11.374030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.374031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.374032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.374033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.374034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.374039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.374050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.374054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.374057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.374061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.374069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.374075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.374089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.374094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.374099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.374104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.374108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.374113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.374122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.374130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.374147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:11.379072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533984165801837:5849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:11.379086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533984165801837:5849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:11.379088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533984165801837:5849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:11.379095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:11.382242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:11.384113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:11.384131Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:11.384134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:11.384138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:11.384145Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1103 [1:7556533984165801872:5852]
2025-10-02T08:11:11.384157Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:11.384175Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:11.384177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.384180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.384182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.384200Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:11.384209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:11.384215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:11.384274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.384283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.384287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:11.384289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:11.384340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:11.384345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.384358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.384368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:11.384390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165801898:5849], now have 1 active actors on pipe
2025-10-02T08:11:11.384400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533984165801849:5852]
2025-10-02T08:11:11.384404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1103
2025-10-02T08:11:11.384407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533984165801849:5852]
2025-10-02T08:11:11.384421Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:11.384434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:11.384437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533984625819377:2378], now have 1 active actors on pipe
2025-10-02T08:11:11.384444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:11.384445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:11.384456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:11.384458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:11.384465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.384468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.384435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1103
2025-10-02T08:11:11.384508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533984165801849:5852]
2025-10-02T08:11:11.384518Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:11.384525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:11.384531Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca6df557-986bf314-5f63ac8f-55c43593_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:11.384536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.384541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.384542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:11.384552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.384565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:11.384610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.384654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.384663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.384678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.384711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1104 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca6df557-986bf314-5f63ac8f-55c43593_0
2025-10-02T08:11:11.385079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28238fad-c2b7702b-388837bb-35f0ee4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca6df557-986bf314-5f63ac8f-55c43593_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:11.387600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6df557-986bf314-5f63ac8f-55c43593_0] Write session: try to update token
2025-10-02T08:11:11.387614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6df557-986bf314-5f63ac8f-55c43593_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:11.401682Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:11.401701Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:11.401703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:11.401710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533984165801849:5852]
2025-10-02T08:11:11.401713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533984165801849:5852]
2025-10-02T08:11:11.401746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:11.401751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.401753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:11.401773Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:11.401789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:11.401889Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:11.405630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId: src_id|ca6df557-986bf314-5f63ac8f-55c43593_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:11.408332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:11.458632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533984165801912:5853]
2025-10-02T08:11:11.458733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1103, pipe: [1:7556533984165801912:5853]
2025-10-02T08:11:11.537364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:11.537781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6df557-986bf314-5f63ac8f-55c43593_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:11.537792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6df557-986bf314-5f63ac8f-55c43593_0] Write session will restart in 0.005726s
2025-10-02T08:11:11.537815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6df557-986bf314-5f63ac8f-55c43593_0] Write session: Do CDS request
2025-10-02T08:11:11.537821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6df557-986bf314-5f63ac8f-55c43593_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:11.536792Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:11.537074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.537082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.537121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165801912:5853], now have 1 active actors on pipe
2025-10-02T08:11:11.537247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533984165801912:5853]
2025-10-02T08:11:11.537263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:11.537266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:11.537324Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:11.537326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1104 reason: error at write: Disconnected sessionId: src_id|ca6df557-986bf314-5f63ac8f-55c43593_0
2025-10-02T08:11:11.537518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1104 sessionId: src_id|ca6df557-986bf314-5f63ac8f-55c43593_0 is DEAD
2025-10-02T08:11:11.544309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6df557-986bf314-5f63ac8f-55c43593_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.544387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:11.544406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1105
2025-10-02T08:11:11.544525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.544563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:11.544573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:11.544577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:11.544975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1105 sessionId:  describe result for acl check
2025-10-02T08:11:11.545011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:11.545019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:11.545020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:11.545024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533984165802147:5826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:11.545526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533984165802147:5826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:11.548581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533984165802147:5826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:11.549647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:11.551048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:11.551240Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:11.551248Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:11.551258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:11.551294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:11.551325Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533984165802271:5831]
2025-10-02T08:11:11.551539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533984165802147:5826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:11.551551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533984165802147:5826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:11.551554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533984165802147:5826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:11.551562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:11.551886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:11.552061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:11.552104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:11.552392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:11.552427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.552433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.552433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.552435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.552436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.552440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.552449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.552453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.552457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.552460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.552466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.552472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.552483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.552489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.552496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.552499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.552501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.552508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.552511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.552514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.552528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:11.560286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:11.561812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:11.561829Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:11.561832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:11.561835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:11.561840Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1104 [1:7556533984165802271:5831]
2025-10-02T08:11:11.561850Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:11.561864Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:11.561866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.561869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.561871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.561885Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:11.561888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:11.561894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:11.561942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.561949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.561951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:11.561953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:11.562008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:11.562015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.562027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.562041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:11.562056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533984165802265:5831]
2025-10-02T08:11:11.562059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533984165802265:5831]
2025-10-02T08:11:11.562065Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:11.562077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:11.562090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:11.562092Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:11.562094Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:11.562097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:11.562100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1104
2025-10-02T08:11:11.562108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165802276:5826], now have 1 active actors on pipe
2025-10-02T08:11:11.562139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533984625819386:2378], now have 1 active actors on pipe
2025-10-02T08:11:11.562145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533984165802265:5831]
2025-10-02T08:11:11.562151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:11.562198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1104
2025-10-02T08:11:11.562724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6df557-986bf314-5f63ac8f-55c43593_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:11.562158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.562161Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:11.562167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.562204Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:11.562210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.562213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.562215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:11.562225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.562233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:11.562254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.562292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.562295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.562307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.562342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1105 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0
2025-10-02T08:11:11.565371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0] Write session: try to update token
2025-10-02T08:11:11.565384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:11.581023Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:11.581043Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:11.581045Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:11.581053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533984165802265:5831]
2025-10-02T08:11:11.581057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533984165802265:5831]
2025-10-02T08:11:11.581098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:11.581106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.581108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:11.581536Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:11.581593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId: src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:11.584265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:11.584333Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:11.584339Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:11.640869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533984165802305:5853]
2025-10-02T08:11:11.641088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1104, pipe: [1:7556533984165802305:5853]
2025-10-02T08:11:11.719292Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:11.719685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.719701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.719739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165802305:5853], now have 1 active actors on pipe
2025-10-02T08:11:11.719867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:11.719879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:11.719938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1105 reason: error at write: Disconnected sessionId: src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0
2025-10-02T08:11:11.719940Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:11.719945Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:11.720095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1105 sessionId: src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0 is DEAD
2025-10-02T08:11:11.720205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533984165802305:5853]
2025-10-02T08:11:11.720385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:11.720395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0] Write session will restart in 0.006993s
2025-10-02T08:11:11.720421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0] Write session: Do CDS request
2025-10-02T08:11:11.720426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:11.728399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.728478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:11.728494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1106
2025-10-02T08:11:11.728617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.728648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:11.728658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:11.728661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:11.729144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1106 sessionId:  describe result for acl check
2025-10-02T08:11:11.729174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:11.729176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:11.729177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:11.729181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533984165802581:5820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:11.729736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533984165802581:5820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:11.731805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533984165802581:5820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:11.733247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:11.733617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:11.733776Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:11.733783Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:11.733792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:11.733829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:11.733865Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533984165802665:5811]
2025-10-02T08:11:11.734308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533984165802581:5820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:11.734320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533984165802581:5820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:11.734323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533984165802581:5820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:11.734330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:11.734427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:11.734599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:11.734662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:11.735026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:11.735084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.735093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.735094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.735096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.735097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.735103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.735113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.735117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.735121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.735124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.735130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.735137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.735143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.735149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.735153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.735159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.735163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.735169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.735173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.735178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.735195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:11.743293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:11.745400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1105
2025-10-02T08:11:11.745018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:11.745038Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:11.745041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:11.745045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:11.745053Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1105 [1:7556533984165802665:5811]
2025-10-02T08:11:11.745064Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:11.745079Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:11.745082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.745085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.745086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.745103Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:11.745107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:11.745113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:11.745174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.745176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.745179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:11.745181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:11.745234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:11.745236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.745249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.745262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:11.745278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533984165802659:5811]
2025-10-02T08:11:11.745282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533984165802659:5811]
2025-10-02T08:11:11.745288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:11.745301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165802670:5820], now have 1 active actors on pipe
2025-10-02T08:11:11.745309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:11.745320Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:11.745323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:11.745323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:11.745326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:11.745335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533984625819393:2378], now have 1 active actors on pipe
2025-10-02T08:11:11.745365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533984165802659:5811]
2025-10-02T08:11:11.745368Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:11.745369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:11.745407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1105
2025-10-02T08:11:11.745461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.745465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.745492Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:11.745498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.745502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.745503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:11.745511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.745519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:11.745534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.745608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.745614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.745636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.745679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1106 partition: 0 MaxSeqNo: 17 sessionId: src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0
2025-10-02T08:11:11.746033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec037aac-37989f7e-8cfc7c3e-74e426c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:11.748751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0] Write session: try to update token
2025-10-02T08:11:11.748771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:11.767210Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:11.767232Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:11.767234Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:11.767242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533984165802659:5811]
2025-10-02T08:11:11.767246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533984165802659:5811]
2025-10-02T08:11:11.767284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:11.767291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.767292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:11.767427Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:11.767517Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:11.767527Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:11.783737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId: src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:11.786273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:11.820628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533984165802732:5853]
2025-10-02T08:11:11.820746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1105, pipe: [1:7556533984165802732:5853]
2025-10-02T08:11:11.914118Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:11.914692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.914700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.914720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165802732:5853], now have 1 active actors on pipe
2025-10-02T08:11:11.915223Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:11.915346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533984165802732:5853]
2025-10-02T08:11:11.915371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:11.915373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:11.915436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1106 reason: error at write: Disconnected sessionId: src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0
2025-10-02T08:11:11.915451Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:11.915612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1106 sessionId: src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0 is DEAD
2025-10-02T08:11:11.916898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:11.916911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0] Write session will restart in 0.007540s
2025-10-02T08:11:11.916938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0] Write session: Do CDS request
2025-10-02T08:11:11.916945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:11.925331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.925792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:11.925811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1107
2025-10-02T08:11:11.925937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:11.925978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:11.925983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:11.925987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:11.926850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1107 sessionId:  describe result for acl check
2025-10-02T08:11:11.926885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:11.926891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:11.926893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:11.926899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533984165802913:5786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:11.927426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533984165802913:5786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:11.934345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533984165802913:5786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:11.938368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:11.938887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:11.939193Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:11.939198Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:11.939211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:11.939273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:11.939306Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533984165803103:5787]
2025-10-02T08:11:11.939937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:11.940437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:11.940474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:11.940704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:11.940739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.940743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.940744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.940745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.940746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.940749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.940756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.940758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.940760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.940762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.940765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.940770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:11.940774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.940777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:11.940780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.940783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:11.940785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.940788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.940791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.940794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.940829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:11.941103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533984165802913:5786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:11.941121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533984165802913:5786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:11.941126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533984165802913:5786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:11.941135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:11.949680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:11.951372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:11.951380Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:11.951383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:11.951388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:11.951396Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1106 [1:7556533984165803103:5787]
2025-10-02T08:11:11.951410Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:11.951427Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:11.951431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.951434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.951436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.951453Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:11.951459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:11.951466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:11.951532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.951534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.951537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:11.951540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:11.951611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:11.951614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.951629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:11.951643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:11.951659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533984165803088:5787]
2025-10-02T08:11:11.951661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533984165803088:5787]
2025-10-02T08:11:11.951670Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:11.951682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:11.951697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:11.951700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:11.951734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533984165803088:5787]
2025-10-02T08:11:11.951737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:11.951848Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:11.951851Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:11.951856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:11.952700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1106
2025-10-02T08:11:11.952727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533984165803123:5786], now have 1 active actors on pipe
2025-10-02T08:11:11.952736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533984625819434:2378], now have 1 active actors on pipe
2025-10-02T08:11:11.952817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1106
2025-10-02T08:11:11.952927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.952938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.952974Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f357c511-f327d79c-b0ad4e20-256911a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:11.952987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:11.952996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:11.953003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:11.953014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:11.953031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:11.953057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.953091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:11.953100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:11.953113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:11.953143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1107 partition: 0 MaxSeqNo: 17 sessionId: src_id|f357c511-f327d79c-b0ad4e20-256911a8_0
2025-10-02T08:11:11.953565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bde2d48-223d6793-2faebfe6-e35d8e1c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f357c511-f327d79c-b0ad4e20-256911a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:11.956509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f357c511-f327d79c-b0ad4e20-256911a8_0] Write session: try to update token
2025-10-02T08:11:11.956526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f357c511-f327d79c-b0ad4e20-256911a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:11.970424Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:11.970443Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:11.970446Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:11.970455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533984165803088:5787]
2025-10-02T08:11:11.970459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533984165803088:5787]
2025-10-02T08:11:11.970509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:11.970516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:11.970518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:11.970511Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:11.970526Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:11.970656Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:11.984055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId: src_id|f357c511-f327d79c-b0ad4e20-256911a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:11.986765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:12.015754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533988460770434:5853]
2025-10-02T08:11:12.015987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1106, pipe: [1:7556533988460770434:5853]
2025-10-02T08:11:12.120201Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:12.120747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.120762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.120783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460770434:5853], now have 1 active actors on pipe
2025-10-02T08:11:12.120974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533988460770434:5853]
2025-10-02T08:11:12.120999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:12.121011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:12.121076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1107 reason: error at write: Disconnected sessionId: src_id|f357c511-f327d79c-b0ad4e20-256911a8_0
2025-10-02T08:11:12.121464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f357c511-f327d79c-b0ad4e20-256911a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:12.121472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f357c511-f327d79c-b0ad4e20-256911a8_0] Write session will restart in 0.008059s
2025-10-02T08:11:12.121496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f357c511-f327d79c-b0ad4e20-256911a8_0] Write session: Do CDS request
2025-10-02T08:11:12.121503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f357c511-f327d79c-b0ad4e20-256911a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:12.121281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1107 sessionId: src_id|f357c511-f327d79c-b0ad4e20-256911a8_0 is DEAD
2025-10-02T08:11:12.122241Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:12.124954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:12.133243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f357c511-f327d79c-b0ad4e20-256911a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:12.137733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:12.137761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1108
2025-10-02T08:11:12.138327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:12.138368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:12.138374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:12.138378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:12.139037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1108 sessionId:  describe result for acl check
2025-10-02T08:11:12.139074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:12.139075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:12.139077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:12.139082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533988460770759:5756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:12.139465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533988460770759:5756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:12.140280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:12.143057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:12.143228Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:12.143237Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:12.143246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:12.143291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:12.143318Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533988460770789:5768]
2025-10-02T08:11:12.143750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:12.144196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:12.144260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:12.144489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533988460770759:5756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:12.144581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:12.144625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.144627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.144628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.144629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.144630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.144636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.144645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.144649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.144653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.144656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.144662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.144668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.144674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.144679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.144683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.144688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.144693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.144698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.144705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.144710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.144728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:12.157891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:12.158789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533988460770759:5756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:12.158806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533988460770759:5756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:12.158810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533988460770759:5756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:12.158819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:12.159649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:12.159666Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:12.159668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:12.159672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:12.159680Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1107 [1:7556533988460770789:5768]
2025-10-02T08:11:12.159691Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:12.159708Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:12.159710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.159713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.159716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.159731Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:12.159737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:12.159742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:12.159802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.159804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.159807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:12.159810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:12.159887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:12.159889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.160217Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1107
2025-10-02T08:11:12.159904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.159917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:12.159934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533988460770769:5768]
2025-10-02T08:11:12.159936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533988460770769:5768]
2025-10-02T08:11:12.159943Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:12.159957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460770815:5756], now have 1 active actors on pipe
2025-10-02T08:11:12.159963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:12.159966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:12.159969Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:12.159978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:12.159981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:12.160014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533988920786739:2378], now have 1 active actors on pipe
2025-10-02T08:11:12.160017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533988460770769:5768]
2025-10-02T08:11:12.160025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:12.160057Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:12.160064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1107
2025-10-02T08:11:12.160158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.160167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.160203Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:12.160211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.160216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.160218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:12.160228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.160239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:12.160312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:12.160357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.160359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.160380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:12.160412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1108 partition: 0 MaxSeqNo: 17 sessionId: src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0
2025-10-02T08:11:12.160930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f357c511-f327d79c-b0ad4e20-256911a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:12.163583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0] Write session: try to update token
2025-10-02T08:11:12.163600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:12.180644Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:12.180667Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:12.180677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533988460770769:5768]
2025-10-02T08:11:12.180727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:12.180738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:12.180768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId: src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:12.181074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:12.181237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:12.181390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:12.181542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:12.181865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:12.181901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:12.183542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:12.183654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.183664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.183698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:12.183724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:12.184065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.184068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.184245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.184319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.184382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.184445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.184488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.184492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.184572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.184633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.184692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.184763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.184826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.184829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.184906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.184975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.185044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.185121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.185171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.185181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.185256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.185336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.185395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.185457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.185501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.185504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.185573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.185630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.185691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.185760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.185804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.185807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.185877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.185937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.186023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.186088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.186138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.186142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.186211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.186272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.186353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.186421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.186465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.186468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.186540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.186604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.186666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.186725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.186774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.186777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.186856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.186912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.186971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.187034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.187081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.187084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.187150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:12.187209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:12.187272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:12.187346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:12.187393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:12.187396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:12.187434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:12.187512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.187535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.187542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:12.187574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:12.187592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:12.187600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:12.187603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:12.187606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:12.188045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:12.188074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:12.188081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:12.188090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:12.188093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:12.188097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:12.188598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:12.188623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:12.188630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:12.188636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:12.188640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:12.188642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:12.189264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:12.189295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:12.189301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:12.189305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:12.189308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:12.191748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:12.191769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:12.191781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392672191
2025-10-02T08:11:12.191983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:12.192002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:12.192008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:12.192014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:12.192019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:12.192022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:12.192556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:12.192582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:12.192588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:12.192593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:12.192597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:12.192601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:12.193125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:12.193148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:12.193155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:12.193158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:12.193162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:12.193165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:12.193720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:12.193746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:12.193753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:12.194995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:12.195028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:12.195034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:12.195038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:12.195048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392672194
2025-10-02T08:11:12.195403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:12.195432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:12.195439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:12.195442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:12.195447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:12.195451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:12.195977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:12.196007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:12.196015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:12.196024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:12.196028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:12.196036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:12.196575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:12.196596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.196706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392672196
2025-10-02T08:11:12.201224Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:12.201282Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:12.201291Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:12.201299Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:12.202998Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:12.203016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:12.203018Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:12.203030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533988460770769:5768]
2025-10-02T08:11:12.203034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533988460770769:5768]
2025-10-02T08:11:12.203082Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:12.203097Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:12.203098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:12.203104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.203106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:12.203252Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:12.224864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533988460770839:5853]
2025-10-02T08:11:12.225015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1107, pipe: [1:7556533988460770839:5853]
2025-10-02T08:11:12.354942Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:12.355346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460770839:5853], now have 1 active actors on pipe
2025-10-02T08:11:12.355597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533988460770839:5853]
2025-10-02T08:11:12.355625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:12.355628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:12.355657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1108 reason: error at write: Disconnected sessionId: src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0
2025-10-02T08:11:12.355670Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:12.355843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1108 sessionId: src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0 is DEAD
2025-10-02T08:11:12.356291Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:12.356389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:12.356408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0] Write session will restart in 0.005322s
2025-10-02T08:11:12.356432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0] Write session: Do CDS request
2025-10-02T08:11:12.356438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:12.363317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:12.363627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:12.363645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1109
2025-10-02T08:11:12.363851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:12.363893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:12.363898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:12.363902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:12.364432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1109 sessionId:  describe result for acl check
2025-10-02T08:11:12.364464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:12.364466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:12.364468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:12.364474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533988460770874:5731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:12.365040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533988460770874:5731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:12.369123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533988460770874:5731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:12.375133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533988460770874:5731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:12.375166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533988460770874:5731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:12.375170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533988460770874:5731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:12.375179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:12.400833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:12.401301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:12.401506Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:12.401510Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:12.401521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:12.401572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:12.401607Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533988460771316:5741]
2025-10-02T08:11:12.402251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:12.402502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:12.402543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:12.402857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:12.402908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.402910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.402911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.402912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.402913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.402919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.402929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.402933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.402936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.402940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.402947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.402955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.402961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.402966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.402971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.402976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.402982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.402987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.402991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.402995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.403013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:12.414399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:12.415983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:12.415991Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:12.415994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:12.415998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:12.416006Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1108 [1:7556533988460771316:5741]
2025-10-02T08:11:12.416018Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:12.416037Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:12.416040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.416044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.416046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.416061Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:12.416066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:12.416073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:12.416144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.416147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.416150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:12.416152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:12.416242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:12.416245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.416260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.416273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:12.416288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533988460771310:5741]
2025-10-02T08:11:12.416290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533988460771310:5741]
2025-10-02T08:11:12.416297Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:12.416310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:12.416324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:12.416327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:12.416360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533988460771310:5741]
2025-10-02T08:11:12.416363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:12.416622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:12.416631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:12.416636Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:12.417023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1108
2025-10-02T08:11:12.417037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460770918:5731], now have 1 active actors on pipe
2025-10-02T08:11:12.417040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533988920786745:2378], now have 1 active actors on pipe
2025-10-02T08:11:12.417051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.417055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.417081Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|baff5454-6352567e-14cfd5b-cf6e6893_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:12.417088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.417092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.417095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:12.417105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.417116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:12.417132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:12.416941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1108
2025-10-02T08:11:12.423462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94694899-8b3af137-ebcd8f4e-4f4af918_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|baff5454-6352567e-14cfd5b-cf6e6893_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:12.422978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.422997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.423037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:12.423091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1109 partition: 0 MaxSeqNo: 17 sessionId: src_id|baff5454-6352567e-14cfd5b-cf6e6893_0
2025-10-02T08:11:12.426269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baff5454-6352567e-14cfd5b-cf6e6893_0] Write session: try to update token
2025-10-02T08:11:12.426291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baff5454-6352567e-14cfd5b-cf6e6893_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:12.445682Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:12.445703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:12.445706Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:12.445714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533988460771310:5741]
2025-10-02T08:11:12.445719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533988460771310:5741]
2025-10-02T08:11:12.445759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:12.445766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.445768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:12.445890Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:12.448901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:12.448915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:12.449706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId: src_id|baff5454-6352567e-14cfd5b-cf6e6893_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:12.452444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:12.456073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533988460771341:5853]
2025-10-02T08:11:12.456309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1108, pipe: [1:7556533988460771341:5853]
2025-10-02T08:11:12.595758Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:12.596327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.596346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.596368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460771341:5853], now have 1 active actors on pipe
2025-10-02T08:11:12.597122Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:12.597469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:12.597525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|baff5454-6352567e-14cfd5b-cf6e6893_0
2025-10-02T08:11:12.597492Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:12.597705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1109 sessionId: src_id|baff5454-6352567e-14cfd5b-cf6e6893_0 is DEAD
2025-10-02T08:11:12.597758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533988460771341:5853]
2025-10-02T08:11:12.599810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baff5454-6352567e-14cfd5b-cf6e6893_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:12.599832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baff5454-6352567e-14cfd5b-cf6e6893_0] Write session will restart in 0.009315s
2025-10-02T08:11:12.599859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baff5454-6352567e-14cfd5b-cf6e6893_0] Write session: Do CDS request
2025-10-02T08:11:12.599867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baff5454-6352567e-14cfd5b-cf6e6893_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:12.617248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baff5454-6352567e-14cfd5b-cf6e6893_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:12.617384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:12.617405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1110
2025-10-02T08:11:12.617534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:12.617560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:12.617566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:12.617570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:12.618075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1110 sessionId:  describe result for acl check
2025-10-02T08:11:12.618105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:12.618107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:12.618108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:12.618111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533988460771581:5735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:12.618699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533988460771581:5735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:12.622142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533988460771581:5735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:12.625933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533988460771581:5735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:12.625951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533988460771581:5735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:12.625954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533988460771581:5735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:12.625962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:12.630729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:12.631149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:12.631304Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:12.631308Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:12.631316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:12.631356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:12.631386Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533988460771815:5732]
2025-10-02T08:11:12.632036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:12.632942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:12.632986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:12.633277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:12.633314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.633316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.633316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.633318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.633319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.633323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.633333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.633337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.633340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.633343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.633348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.633355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.633360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.633365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.633369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.633374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.633379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.633384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.633388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.633392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.633409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:12.643850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:12.645665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:12.645669Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:12.645671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:12.645674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:12.645678Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1109 [1:7556533988460771815:5732]
2025-10-02T08:11:12.645685Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:12.645702Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:12.645704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.645707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.645710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.645726Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:12.645731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:12.645737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:12.645785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.645787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.645789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:12.645791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:12.645849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:12.645851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.645859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.645866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:12.645878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533988460771809:5732]
2025-10-02T08:11:12.645879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533988460771809:5732]
2025-10-02T08:11:12.645884Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:12.645893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:12.645901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:12.645903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:12.645903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:12.645907Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:12.645930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533988460771809:5732]
2025-10-02T08:11:12.645931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:12.645938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460771771:5735], now have 1 active actors on pipe
2025-10-02T08:11:12.645963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533988920786754:2378], now have 1 active actors on pipe
2025-10-02T08:11:12.645963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1109
2025-10-02T08:11:12.646022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.646027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.646049Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:12.646052Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45fa6df5-3005d561-471a45a-5689d9d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:12.646059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.646062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.646064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:12.646074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.646083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:12.646099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:12.646136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.646138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.646087Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1109
2025-10-02T08:11:12.646151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:12.646203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1110 partition: 0 MaxSeqNo: 17 sessionId: src_id|45fa6df5-3005d561-471a45a-5689d9d7_0
2025-10-02T08:11:12.646561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baff5454-6352567e-14cfd5b-cf6e6893_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45fa6df5-3005d561-471a45a-5689d9d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:12.649248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fa6df5-3005d561-471a45a-5689d9d7_0] Write session: try to update token
2025-10-02T08:11:12.649265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fa6df5-3005d561-471a45a-5689d9d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:12.663503Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:12.663522Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:12.663525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:12.663533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533988460771809:5732]
2025-10-02T08:11:12.663538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533988460771809:5732]
2025-10-02T08:11:12.663579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:12.663586Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:12.663592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.663593Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:12.663594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:12.663733Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:12.664766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId: src_id|45fa6df5-3005d561-471a45a-5689d9d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:12.667520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:12.700913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533988460771843:5853]
2025-10-02T08:11:12.701189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1109, pipe: [1:7556533988460771843:5853]
2025-10-02T08:11:12.804739Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:12.805479Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:12.805031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.805047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.805944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fa6df5-3005d561-471a45a-5689d9d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:12.805958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fa6df5-3005d561-471a45a-5689d9d7_0] Write session will restart in 0.007241s
2025-10-02T08:11:12.805084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460771843:5853], now have 1 active actors on pipe
2025-10-02T08:11:12.805278Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:12.805523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533988460771843:5853]
2025-10-02T08:11:12.805981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fa6df5-3005d561-471a45a-5689d9d7_0] Write session: Do CDS request
2025-10-02T08:11:12.805533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:12.805988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fa6df5-3005d561-471a45a-5689d9d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:12.805577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1110 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45fa6df5-3005d561-471a45a-5689d9d7_0
2025-10-02T08:11:12.805747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1110 sessionId: src_id|45fa6df5-3005d561-471a45a-5689d9d7_0 is DEAD
2025-10-02T08:11:12.814291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fa6df5-3005d561-471a45a-5689d9d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:12.814343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:12.814359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1111
2025-10-02T08:11:12.814515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:12.814549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:12.814553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:12.814555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:12.815289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1111 sessionId:  describe result for acl check
2025-10-02T08:11:12.815330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:12.815336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:12.815337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:12.815342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533988460772082:5688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:12.815946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533988460772082:5688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:12.818739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533988460772082:5688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:12.824975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533988460772082:5688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:12.824995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533988460772082:5688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:12.824998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533988460772082:5688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:12.825006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:12.825471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:12.826041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:12.826204Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:12.826208Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:12.826216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:12.826259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:12.826288Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533988460772327:5694]
2025-10-02T08:11:12.826842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:12.827104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:12.827151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:12.827476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:12.827540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.827548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.827549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.827550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.827551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.827557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.827567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.827571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.827575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.827579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.827584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.827592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:12.827604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.827610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:12.827616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.827622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:12.827626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.827631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.827640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.827645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.827664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:12.838245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:12.840181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:12.840199Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:12.840201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:12.840205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:12.840212Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1110 [1:7556533988460772327:5694]
2025-10-02T08:11:12.840223Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:12.840238Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:12.840241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.840243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.840245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.840261Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:12.840266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:12.840272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:12.840327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.840329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.840331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:12.840334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:12.840399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:12.840402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.840414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:12.840423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:12.840439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460772317:5688], now have 1 active actors on pipe
2025-10-02T08:11:12.840445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533988460772320:5694]
2025-10-02T08:11:12.840447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533988460772320:5694]
2025-10-02T08:11:12.840453Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:12.840464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:12.840464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:12.840467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:12.840476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:12.840478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:12.840483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533988920786778:2378], now have 1 active actors on pipe
2025-10-02T08:11:12.840513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533988460772320:5694]
2025-10-02T08:11:12.840523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:12.840558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1110
2025-10-02T08:11:12.840558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:12.840560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1110
2025-10-02T08:11:12.840844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.840855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.840885Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb52013e-a9765f96-3891faaa-843d11cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:12.840898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:12.840901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:12.840911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:12.840926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:12.840939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:12.840958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:12.840993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:12.840999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:12.841020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:12.841049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1111 partition: 0 MaxSeqNo: 17 sessionId: src_id|eb52013e-a9765f96-3891faaa-843d11cd_0
2025-10-02T08:11:12.842716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fa6df5-3005d561-471a45a-5689d9d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eb52013e-a9765f96-3891faaa-843d11cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:12.845744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb52013e-a9765f96-3891faaa-843d11cd_0] Write session: try to update token
2025-10-02T08:11:12.845768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb52013e-a9765f96-3891faaa-843d11cd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:12.860436Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:12.860455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:12.860458Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:12.860467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533988460772320:5694]
2025-10-02T08:11:12.860475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533988460772320:5694]
2025-10-02T08:11:12.860518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:12.860517Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:12.860522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:12.860524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:12.860526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:12.860663Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:12.865903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId: src_id|eb52013e-a9765f96-3891faaa-843d11cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:12.868679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:12.905626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533988460772380:5853]
2025-10-02T08:11:12.905877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1110, pipe: [1:7556533988460772380:5853]
2025-10-02T08:11:13.008056Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:13.008488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.008504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.008546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533988460772380:5853], now have 1 active actors on pipe
2025-10-02T08:11:13.009161Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:13.009497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:13.009552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1111 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb52013e-a9765f96-3891faaa-843d11cd_0
2025-10-02T08:11:13.009729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1111 sessionId: src_id|eb52013e-a9765f96-3891faaa-843d11cd_0 is DEAD
2025-10-02T08:11:13.009878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb52013e-a9765f96-3891faaa-843d11cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:13.009889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb52013e-a9765f96-3891faaa-843d11cd_0] Write session will restart in 0.007233s
2025-10-02T08:11:13.009880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533988460772380:5853]
2025-10-02T08:11:13.009907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb52013e-a9765f96-3891faaa-843d11cd_0] Write session: Do CDS request
2025-10-02T08:11:13.009916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb52013e-a9765f96-3891faaa-843d11cd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:13.009050Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:13.018256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb52013e-a9765f96-3891faaa-843d11cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.018352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:13.018368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1112
2025-10-02T08:11:13.018496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.018527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:13.018535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:13.018539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:13.018901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1112 sessionId:  describe result for acl check
2025-10-02T08:11:13.018937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:13.018944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:13.018945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:13.018950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533992755740067:5647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:13.019421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533992755740067:5647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:13.021629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:13.021799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533992755740067:5647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:13.021945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:13.022096Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:13.022104Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:13.022112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:13.022155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:13.022190Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533992755740142:5642]
2025-10-02T08:11:13.022648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:13.022799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:13.022825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:13.023029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:13.023058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.023062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.023062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.023063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.023063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.023067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.023073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.023075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.023077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.023079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.023082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.023087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.023094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.023097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.023101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.023103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.023106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.023108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.023111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.023114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.023124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:13.027655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533992755740067:5647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:13.027671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533992755740067:5647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:13.027675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533992755740067:5647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:13.027683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:13.032250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:13.033925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:13.033943Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:13.033945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:13.033948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:13.033954Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1111 [1:7556533992755740142:5642]
2025-10-02T08:11:13.033966Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:13.033981Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:13.033987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.033989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.033990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.034003Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:13.034008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:13.034013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:13.034070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.034077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.034080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:13.034082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:13.034163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:13.034168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.034181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.034191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:13.034193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1111
2025-10-02T08:11:13.034205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755740169:5647], now have 1 active actors on pipe
2025-10-02T08:11:13.034212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.034215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.034225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533993215754104:2378], now have 1 active actors on pipe
2025-10-02T08:11:13.034232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533992755740134:5642]
2025-10-02T08:11:13.034234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533992755740134:5642]
2025-10-02T08:11:13.034242Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:13.034254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:13.034258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:13.034261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:13.034262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:13.034264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:13.034274Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:13.034282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.034284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.034285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:13.034291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.034300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:13.034329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533992755740134:5642]
2025-10-02T08:11:13.034337Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:13.034342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:13.034349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.034381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.034386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.034398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.034436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1112 partition: 0 MaxSeqNo: 17 sessionId: src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0
2025-10-02T08:11:13.034309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1111
2025-10-02T08:11:13.036020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb52013e-a9765f96-3891faaa-843d11cd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:13.038526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0] Write session: try to update token
2025-10-02T08:11:13.038544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:13.053687Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:13.053713Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:13.053716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:13.053725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533992755740134:5642]
2025-10-02T08:11:13.053729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533992755740134:5642]
2025-10-02T08:11:13.053763Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:13.053765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:13.053771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.053773Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:13.053773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:13.053937Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:13.060050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId: src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:13.062680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:13.109343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533992755740184:5853]
2025-10-02T08:11:13.109513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1111, pipe: [1:7556533992755740184:5853]
2025-10-02T08:11:13.195885Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:13.196224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.196243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.196305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755740184:5853], now have 1 active actors on pipe
2025-10-02T08:11:13.196412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:13.196423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:13.196479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1112 reason: error at write: Disconnected sessionId: src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0
2025-10-02T08:11:13.196541Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:13.196539Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:13.196661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1112 sessionId: src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0 is DEAD
2025-10-02T08:11:13.196839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:13.196849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0] Write session will restart in 0.009677s
2025-10-02T08:11:13.196851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533992755740184:5853]
2025-10-02T08:11:13.196873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0] Write session: Do CDS request
2025-10-02T08:11:13.196892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:13.207322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.207369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:13.207386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1113
2025-10-02T08:11:13.207551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.207594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:13.207607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:13.207611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:13.208115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1113 sessionId:  describe result for acl check
2025-10-02T08:11:13.208153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:13.208159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:13.208161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:13.208166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533992755740560:5652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:13.208674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533992755740560:5652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:13.210562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533992755740560:5652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:13.210911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:13.211494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:13.211668Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:13.211679Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:13.211689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:13.211736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:13.211774Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533992755740650:5651]
2025-10-02T08:11:13.212405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:13.212581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:13.212619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:13.212898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:13.212946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.212954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.212955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.212956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.212957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.212962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.212971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.212975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.212978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.212981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.212986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.212992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.212997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.213002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.213005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.213009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.213013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.213018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.213021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.213026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.213042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:13.213637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533992755740560:5652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:13.213651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533992755740560:5652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:13.213654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533992755740560:5652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:13.213662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:13.221395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:13.223076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:13.223098Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:13.223101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:13.223105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:13.223113Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1112 [1:7556533992755740650:5651]
2025-10-02T08:11:13.223124Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:13.223140Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:13.223143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.223146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.223148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.223164Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:13.223175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:13.223182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:13.223246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.223254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.223257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:13.223260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:13.223327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:13.223335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.223347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.223364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:13.223387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755740668:5652], now have 1 active actors on pipe
2025-10-02T08:11:13.223398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533992755740637:5651]
2025-10-02T08:11:13.223400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533992755740637:5651]
2025-10-02T08:11:13.223407Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:13.223419Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:13.223420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533993215754111:2378], now have 1 active actors on pipe
2025-10-02T08:11:13.223422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1112
2025-10-02T08:11:13.223428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:13.223429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:13.223442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:13.223445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:13.223479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.223488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.223456Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1112
2025-10-02T08:11:13.223501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533992755740637:5651]
2025-10-02T08:11:13.223512Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:13.223522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:13.223545Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:13.223556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.223559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.223566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:13.223575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.223588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:13.223615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.223664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.223671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.223684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.223722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1113 partition: 0 MaxSeqNo: 17 sessionId: src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0
2025-10-02T08:11:13.224145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cb0ef17-4eb3049d-1c83dd99-ec38de40_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:13.226675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0] Write session: try to update token
2025-10-02T08:11:13.226694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:13.241061Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:13.241085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:13.241088Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:13.241097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533992755740637:5651]
2025-10-02T08:11:13.241102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533992755740637:5651]
2025-10-02T08:11:13.241150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:13.241155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:13.241161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:13.241161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.241163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:13.241310Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:13.241948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId: src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:13.244460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:13.297252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533992755740681:5853]
2025-10-02T08:11:13.297399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1112, pipe: [1:7556533992755740681:5853]
2025-10-02T08:11:13.382084Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:13.382505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.382516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.382550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755740681:5853], now have 1 active actors on pipe
2025-10-02T08:11:13.382669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:13.382682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:13.382744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1113 reason: error at write: Disconnected sessionId: src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0
2025-10-02T08:11:13.382747Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:13.382832Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:13.382961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533992755740681:5853]
2025-10-02T08:11:13.382968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1113 sessionId: src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0 is DEAD
2025-10-02T08:11:13.383132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:13.383141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0] Write session will restart in 0.007030s
2025-10-02T08:11:13.383168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0] Write session: Do CDS request
2025-10-02T08:11:13.383176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:13.391331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.391417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:13.391435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1114
2025-10-02T08:11:13.391523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.391551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:13.391559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:13.391563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:13.392057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1114 sessionId:  describe result for acl check
2025-10-02T08:11:13.392102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:13.392104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:13.392105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:13.392110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533992755741028:5637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:13.392674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533992755741028:5637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:13.396417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533992755741028:5637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:13.401771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533992755741028:5637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:13.401790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533992755741028:5637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:13.401793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533992755741028:5637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:13.401802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:13.403942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:13.404560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:13.404772Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:13.404780Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:13.404789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:13.404873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:13.404910Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533992755741156:5635]
2025-10-02T08:11:13.405501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:13.405656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:13.405686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:13.405894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:13.405926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.405932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.405932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.405933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.405934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.405937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.405943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.405945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.405947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.405949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.405953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.405957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.405960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.405963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.405966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.405968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.405972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.405974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.405976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.405981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.405996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:13.416120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:13.417662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:13.417686Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:13.417689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:13.417693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:13.417700Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1113 [1:7556533992755741156:5635]
2025-10-02T08:11:13.417713Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:13.417730Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:13.417739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.417742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.417744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.417759Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:13.417768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:13.417775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:13.417837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.417846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.417849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:13.417851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:13.417974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1113
2025-10-02T08:11:13.418086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:13.418095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.418079Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1113
2025-10-02T08:11:13.418108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.418120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:13.418138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755741111:5637], now have 1 active actors on pipe
2025-10-02T08:11:13.418145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533993215754118:2378], now have 1 active actors on pipe
2025-10-02T08:11:13.418150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.418154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.418169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533992755741150:5635]
2025-10-02T08:11:13.418175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533992755741150:5635]
2025-10-02T08:11:13.418186Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:13.418198Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:13.418208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:13.418209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:13.418222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:13.418229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:13.418244Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:13.418254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.418257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.418258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:13.418267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.418280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:13.418317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533992755741150:5635]
2025-10-02T08:11:13.418328Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:13.418337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:13.418340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.418390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.418396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.418409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.418449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1114 partition: 0 MaxSeqNo: 17 sessionId: src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0
2025-10-02T08:11:13.418814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|371fdb3-61ba8b4e-7cc691eb-d33573e3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:13.421406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0] Write session: try to update token
2025-10-02T08:11:13.421424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:13.435342Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:13.435363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:13.435373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533992755741150:5635]
2025-10-02T08:11:13.435426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:13.435455Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:13.435619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:13.435783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:13.435959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:13.436121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:13.436339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:13.436383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:13.436563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId: src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:13.439245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:13.439313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.439326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.439357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:13.439382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:13.439432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.439445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.439634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.439704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.439774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.439857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.439966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.439979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.440058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.440125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.440195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.440274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.440324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.440333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.440409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.440476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.440547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.440614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.440667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.440675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.440749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.440838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.440913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.440978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.441023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.441027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.441098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.441163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.441228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.441294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.441338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.441341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.441414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.441483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.441547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.441615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.441662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.441664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.441737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.441797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.441862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.441929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.441975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.441980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.442050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.442110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.442171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.442235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.442408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.442411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.442484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.442544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.442610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.442674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.442715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.442717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.442790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.442852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.442917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.442983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.443030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.443033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.443082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:13.443149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.443167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.443170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:13.443200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:13.443213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:13.443216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:13.443220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:13.443223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:13.443683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:13.443701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:13.443708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:13.443715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:13.443718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:13.443722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:13.444397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:13.444413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:13.444420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:13.444423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:13.444427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:13.444431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:13.445254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:13.445289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:13.445297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:13.445300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:13.445303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:13.447619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:13.447641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:13.447651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392673447
2025-10-02T08:11:13.447801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:13.447821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:13.447839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:13.447842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:13.447847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:13.447850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:13.448284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:13.448307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:13.448312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:13.448315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:13.448318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:13.448320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:13.448726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:13.448744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:13.448749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:13.448752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:13.448754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:13.448755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:13.449206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:13.449224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:13.449228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:13.450225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:13.450241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:13.450244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:13.450246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:13.450253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392673449
2025-10-02T08:11:13.450520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:13.450536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:13.450541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:13.450554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:13.450561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:13.450563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:13.450980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:13.450998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:13.451001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:13.451007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:13.451009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:13.451012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:13.451438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:13.451454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.451528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392673451
2025-10-02T08:11:13.452260Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:13.452288Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:13.452294Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:13.452297Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:13.454035Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:13.454050Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:13.454052Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:13.454063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533992755741150:5635]
2025-10-02T08:11:13.454066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533992755741150:5635]
2025-10-02T08:11:13.454123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:13.454135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.454139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:13.454137Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:13.454146Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:13.454280Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:13.483076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533992755741192:5853]
2025-10-02T08:11:13.483214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1113, pipe: [1:7556533992755741192:5853]
2025-10-02T08:11:13.591984Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:13.592859Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:13.594761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:13.594775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0] Write session will restart in 0.009168s
2025-10-02T08:11:13.594798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0] Write session: Do CDS request
2025-10-02T08:11:13.594804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:13.592403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755741192:5853], now have 1 active actors on pipe
2025-10-02T08:11:13.592919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533992755741192:5853]
2025-10-02T08:11:13.593067Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:13.594442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:13.594469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1114 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0
2025-10-02T08:11:13.594632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1114 sessionId: src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0 is DEAD
2025-10-02T08:11:13.605311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.605389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:13.605414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1115
2025-10-02T08:11:13.605503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.605528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:13.605536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:13.605539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:13.605950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1115 sessionId:  describe result for acl check
2025-10-02T08:11:13.605985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:13.605986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:13.605988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:13.605992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533992755741443:5616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:13.606399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533992755741443:5616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:13.610158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533992755741443:5616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:13.614665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:13.614849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533992755741443:5616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:13.614865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533992755741443:5616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:13.614869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533992755741443:5616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:13.614888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:13.615804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:13.616154Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:13.616169Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:13.616186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:13.616246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:13.616297Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533992755741672:5624]
2025-10-02T08:11:13.616921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:13.617173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:13.617238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:13.617573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:13.617627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.617633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.617634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.617634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.617635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.617639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.617646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.617648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.617650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.617653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.617657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.617662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.617666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.617669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.617672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.617675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.617677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.617681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.617683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.617688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.617700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:13.626458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:13.628012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:13.628019Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:13.628023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:13.628026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:13.628034Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1114 [1:7556533992755741672:5624]
2025-10-02T08:11:13.628046Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:13.628067Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:13.628070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.628073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.628076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.628094Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:13.628099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:13.628109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:13.628172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.628174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.628176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:13.628178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:13.628232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:13.628235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.628245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.628252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:13.628264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533992755741660:5624]
2025-10-02T08:11:13.628265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533992755741660:5624]
2025-10-02T08:11:13.628270Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:13.628280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:13.628289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:13.628292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:13.628302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755741667:5616], now have 1 active actors on pipe
2025-10-02T08:11:13.628302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:13.628306Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:13.628317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1114
2025-10-02T08:11:13.628337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533992755741660:5624]
2025-10-02T08:11:13.628339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:13.628342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:13.628345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533993215754128:2378], now have 1 active actors on pipe
2025-10-02T08:11:13.628350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.628354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.628400Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93458615-82760835-8532dd62-8808e67e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:13.628406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.628410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.628412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:13.628423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.628434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:13.628454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.628522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.628525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.628549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.628588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1115 partition: 0 MaxSeqNo: 17 sessionId: src_id|93458615-82760835-8532dd62-8808e67e_0
2025-10-02T08:11:13.628458Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1114
2025-10-02T08:11:13.628994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1167169d-18da7b65-89ba9c3e-99df92e8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|93458615-82760835-8532dd62-8808e67e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:13.631721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93458615-82760835-8532dd62-8808e67e_0] Write session: try to update token
2025-10-02T08:11:13.631739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93458615-82760835-8532dd62-8808e67e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:13.646491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId: src_id|93458615-82760835-8532dd62-8808e67e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:13.647518Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:13.647541Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:13.647544Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:13.647552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533992755741660:5624]
2025-10-02T08:11:13.647556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533992755741660:5624]
2025-10-02T08:11:13.647595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:13.647598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:13.647605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.647608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:13.647608Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:13.647753Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:13.649159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:13.694754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533992755741698:5853]
2025-10-02T08:11:13.695226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1114, pipe: [1:7556533992755741698:5853]
2025-10-02T08:11:13.811127Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:13.811619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.811635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.811675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755741698:5853], now have 1 active actors on pipe
2025-10-02T08:11:13.811846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533992755741698:5853]
2025-10-02T08:11:13.811883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:13.811891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:13.811959Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:13.811954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1115 reason: error at write: Disconnected sessionId: src_id|93458615-82760835-8532dd62-8808e67e_0
2025-10-02T08:11:13.812162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1115 sessionId: src_id|93458615-82760835-8532dd62-8808e67e_0 is DEAD
2025-10-02T08:11:13.812321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93458615-82760835-8532dd62-8808e67e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:13.812330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93458615-82760835-8532dd62-8808e67e_0] Write session will restart in 0.007376s
2025-10-02T08:11:13.812351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93458615-82760835-8532dd62-8808e67e_0] Write session: Do CDS request
2025-10-02T08:11:13.812357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93458615-82760835-8532dd62-8808e67e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:13.812545Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:13.824484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93458615-82760835-8532dd62-8808e67e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.824682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:13.824817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:13.824826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1116
2025-10-02T08:11:13.824988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:13.825029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:13.825034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:13.825037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:13.825403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1116 sessionId:  describe result for acl check
2025-10-02T08:11:13.825406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:13.825437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:13.825443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:13.825444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:13.825449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533992755742141:5610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:13.825576Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:13.825595Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:13.825608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:13.825670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:13.825711Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533992755742143:5596]
2025-10-02T08:11:13.825971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533992755742141:5610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:13.826348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:13.826566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:13.826612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:13.826927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:13.826975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.826981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.826981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.826983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.826984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.826989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.826997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.827001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.827004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.827007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.827013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.827019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:13.827025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.827030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:13.827039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.827043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:13.827048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.827052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.827057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.827062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.827080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:13.830874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533992755742141:5610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:13.835957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533992755742141:5610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:13.835975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533992755742141:5610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:13.835978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533992755742141:5610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:13.835986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:13.840290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:13.842955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:13.842978Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:13.842981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:13.842984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:13.842992Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1115 [1:7556533992755742143:5596]
2025-10-02T08:11:13.843004Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:13.843021Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:13.843029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.843032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.843034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.843049Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:13.843058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:13.843068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:13.843130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.843137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.843141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:13.843144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:13.843294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:13.843303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.843318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:13.843336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:13.843293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1115
2025-10-02T08:11:13.843358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755742187:5610], now have 1 active actors on pipe
2025-10-02T08:11:13.843366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533993215754135:2378], now have 1 active actors on pipe
2025-10-02T08:11:13.843379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533992755742134:5596]
2025-10-02T08:11:13.843385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533992755742134:5596]
2025-10-02T08:11:13.843397Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:13.843413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:13.843414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:13.843423Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:13.843428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:13.843430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:13.843465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533992755742134:5596]
2025-10-02T08:11:13.843475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:13.843482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:13.843523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1115
2025-10-02T08:11:13.843534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.843542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.843565Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:13.843575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.843584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.843590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:13.843600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.843613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:13.843634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.843671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.843677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.843689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:13.843720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1116 partition: 0 MaxSeqNo: 17 sessionId: src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0
2025-10-02T08:11:13.844105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93458615-82760835-8532dd62-8808e67e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:13.846860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0] Write session: try to update token
2025-10-02T08:11:13.846877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:13.855322Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:13.855346Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:13.855354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533992755742134:5596]
2025-10-02T08:11:13.855398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:13.855405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:13.855584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:13.855742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:13.855919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:13.856073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:13.856268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:13.856309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:13.861836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId: src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:13.869135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:13.869209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.869216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.869249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:13.869262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:13.869322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:13.869324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:13.869500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.869565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.869638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.869701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.869743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.869747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.869822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.869888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.869949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.870017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.870061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.870067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.870137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.870196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.870254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.870317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.870358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.870363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.870436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.870512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.870581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.870645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.870691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.870694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.870767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.870844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.870919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.870989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.871034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.871041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.871112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.871178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.871244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.871314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.871367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.871374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.871443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.871515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.871590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.871669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.871726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.871729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.871806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.871887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.871958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.872027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.872075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.872078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.872146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.872208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.872272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.872339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.872387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.872390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.872461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:13.872525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:13.872588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:13.872649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:13.872690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:13.872693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:13.872731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:13.872786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:13.872952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:13.872963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:13.872994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:13.873013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:13.873020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:13.873023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:13.873026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:13.873539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:13.873571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:13.873582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:13.873587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:13.873590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:13.873594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:13.874112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:13.874135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:13.874139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:13.874141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:13.874143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:13.874146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:13.874639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:13.874657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:13.874660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:13.874662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:13.874664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:13.882967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:13.882994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:13.883007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392673880
2025-10-02T08:11:13.883137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:13.883155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:13.883161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:13.883168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:13.883172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:13.883175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:13.883913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:13.883937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:13.883947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:13.883951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:13.883954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:13.883957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:13.884530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:13.884555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:13.884565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:13.884568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:13.884571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:13.884574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:13.885101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:13.885131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:13.885137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:13.886285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:13.886303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:13.886308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:13.886312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:13.886319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392673885
2025-10-02T08:11:13.886580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:13.886599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:13.886604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:13.886606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:13.886608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:13.886610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:13.887050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:13.887068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:13.887071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:13.887073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:13.887076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:13.887078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:13.887478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:13.887494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:13.887585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392673887
2025-10-02T08:11:13.890574Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:13.890591Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:13.890595Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:13.890598Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:13.892021Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:13.892032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:13.892034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:13.892040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533992755742134:5596]
2025-10-02T08:11:13.892042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533992755742134:5596]
2025-10-02T08:11:13.892081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:13.892080Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:13.892083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:13.892085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:13.892086Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:13.892196Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:13.912127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533992755742246:5853]
2025-10-02T08:11:13.912247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1115, pipe: [1:7556533992755742246:5853]
2025-10-02T08:11:14.027687Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:14.027992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533992755742246:5853], now have 1 active actors on pipe
2025-10-02T08:11:14.028102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533992755742246:5853]
2025-10-02T08:11:14.028136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:14.028139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:14.028158Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:14.028177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1116 reason: error at write: Disconnected sessionId: src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0
2025-10-02T08:11:14.028220Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:14.028392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1116 sessionId: src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0 is DEAD
2025-10-02T08:11:14.028576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:14.028587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0] Write session will restart in 0.007530s
2025-10-02T08:11:14.028620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0] Write session: Do CDS request
2025-10-02T08:11:14.028627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:14.037263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.037299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:14.037315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1117
2025-10-02T08:11:14.037462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.037485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:14.037502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:14.037508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:14.037840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1117 sessionId:  describe result for acl check
2025-10-02T08:11:14.037866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:14.037871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:14.037872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:14.037878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533997050709988:5563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:14.038283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533997050709988:5563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:14.038480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:14.039706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:14.039910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:14.039921Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:14.039934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:14.039996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:14.040033Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533997050710018:5564]
2025-10-02T08:11:14.040591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533997050709988:5563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:14.040667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:14.040859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:14.040910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:14.041211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:14.041261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.041267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.041268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.041269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.041270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.041275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.041285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.041289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.041293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.041296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.041302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.041310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.041315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.041320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.041329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.041334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.041338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.041348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.041358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.041363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.041380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:14.047570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533997050709988:5563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:14.047586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533997050709988:5563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:14.047589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533997050709988:5563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:14.047597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:14.049757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:14.051374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:14.051392Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:14.051395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:14.051399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:14.051405Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1116 [1:7556533997050710018:5564]
2025-10-02T08:11:14.051417Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:14.051436Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:14.051444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.051447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.051450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.051466Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:14.051476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:14.051482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:14.051552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.051560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.051567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:14.051569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:14.051654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:14.051661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.051675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.051676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1116
2025-10-02T08:11:14.051686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:14.051707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050710045:5563], now have 1 active actors on pipe
2025-10-02T08:11:14.051718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.051722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.051740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533997510721474:2378], now have 1 active actors on pipe
2025-10-02T08:11:14.051751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533997050709999:5564]
2025-10-02T08:11:14.051758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533997050709999:5564]
2025-10-02T08:11:14.051765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:14.051779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:14.051758Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1116
2025-10-02T08:11:14.051789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:14.051792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:14.051792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:14.051795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:14.051810Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2132b168-58e1e61d-81618e23-f792627f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:14.051817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.051825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.051841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:14.051852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.051863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:14.051896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533997050709999:5564]
2025-10-02T08:11:14.051905Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:14.051911Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:14.051921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.051974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.051980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.051994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.052043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1117 partition: 0 MaxSeqNo: 17 sessionId: src_id|2132b168-58e1e61d-81618e23-f792627f_0
2025-10-02T08:11:14.052391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea336e5a-c5b55f1d-e51d3afb-e978bb33_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2132b168-58e1e61d-81618e23-f792627f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:14.055149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2132b168-58e1e61d-81618e23-f792627f_0] Write session: try to update token
2025-10-02T08:11:14.055165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2132b168-58e1e61d-81618e23-f792627f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:14.062839Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:14.062861Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:14.062872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556533997050709999:5564]
2025-10-02T08:11:14.062914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:14.062913Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:14.063102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:14.063254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:14.063405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:14.063571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:14.063795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:14.063850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:14.068902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId: src_id|2132b168-58e1e61d-81618e23-f792627f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:14.071892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:14.072033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.072048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.072083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:14.072109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:14.072163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.072181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.072356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.072420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.072487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.072566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.072820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.072832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.072907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.072968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.073033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.073105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.073152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.073161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.073239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.073307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.073371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.073441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.073493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.073504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.073576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.073643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.073710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.073779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.073831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.073837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.073919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.073983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.074047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.074112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.074164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.074171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.074241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.074306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.074378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.074449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.074495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.074501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.074571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.074635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.074702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.074770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.074816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.074822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.074893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.074959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.075025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.075091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.075136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.075143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.075209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.075274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.075338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.075404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.075453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.075460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.075526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:14.075594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:14.075660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:14.075724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:14.075772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:14.075780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:14.075822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:14.075907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.075931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.075938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:14.075972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:14.075989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:14.075997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:14.076000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:14.076003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:14.076405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:14.076433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:14.076444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:14.076447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:14.076450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:14.076454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:14.077097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:14.077123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:14.077130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:14.077132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:14.077136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:14.077140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:14.077733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:14.077760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:14.077766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:14.077769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:14.077773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:14.079033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:14.079047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:14.079055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392674078
2025-10-02T08:11:14.079197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:14.079210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:14.079216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:14.079218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:14.079220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:14.079222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:14.079693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:14.079713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:14.079717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:14.079719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:14.079721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:14.079723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:14.080215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:14.080237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:14.080244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:14.080248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:14.080252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:14.080255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:14.080734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:14.080758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:14.080763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:14.081905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:14.081921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:14.081928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:14.081931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:14.081940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392674081
2025-10-02T08:11:14.082242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:14.082262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:14.082272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:14.082279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:14.082282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:14.082285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:14.082741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:14.082760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:14.082764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:14.082772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:14.082775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:14.082779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:14.083235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:14.083254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.083357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392674083
2025-10-02T08:11:14.084104Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:14.084125Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:14.084136Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:14.084143Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:14.085827Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:14.085842Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:14.085844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:14.085857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533997050709999:5564]
2025-10-02T08:11:14.085862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533997050709999:5564]
2025-10-02T08:11:14.085913Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:14.085919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:14.085923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.085925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:14.085928Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:14.086061Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:14.128204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533997050710068:5853]
2025-10-02T08:11:14.128347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1116, pipe: [1:7556533997050710068:5853]
2025-10-02T08:11:14.218064Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:14.218473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050710068:5853], now have 1 active actors on pipe
2025-10-02T08:11:14.218591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:14.218603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:14.218634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1117 reason: error at write: Disconnected sessionId: src_id|2132b168-58e1e61d-81618e23-f792627f_0
2025-10-02T08:11:14.218703Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:14.218723Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:14.218825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1117 sessionId: src_id|2132b168-58e1e61d-81618e23-f792627f_0 is DEAD
2025-10-02T08:11:14.218959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533997050710068:5853]
2025-10-02T08:11:14.219155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2132b168-58e1e61d-81618e23-f792627f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:14.219165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2132b168-58e1e61d-81618e23-f792627f_0] Write session will restart in 0.007343s
2025-10-02T08:11:14.219206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2132b168-58e1e61d-81618e23-f792627f_0] Write session: Do CDS request
2025-10-02T08:11:14.219214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2132b168-58e1e61d-81618e23-f792627f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:14.227302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2132b168-58e1e61d-81618e23-f792627f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.228480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:14.228498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1118
2025-10-02T08:11:14.228734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.228782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:14.228792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:14.228796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:14.229304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1118 sessionId:  describe result for acl check
2025-10-02T08:11:14.229340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:14.229346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:14.229348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:14.229353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533997050710427:5558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:14.229860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533997050710427:5558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:14.232403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533997050710427:5558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:14.234147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:14.235037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:14.235207Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:14.235217Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:14.235226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:14.235270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:14.235306Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533997050710544:5557]
2025-10-02T08:11:14.235413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533997050710427:5558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:14.235426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533997050710427:5558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:14.235429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533997050710427:5558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:14.235437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:14.236001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:14.236173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:14.236220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:14.236519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:14.236567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.236573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.236575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.236576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.236577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.236583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.236593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.236602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.236611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.236615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.236620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.236632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.236642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.236652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.236656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.236665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.236669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.236674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.236682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.236687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.236706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:14.244574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:14.246432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:14.246455Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:14.246457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:14.246461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:14.246467Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1117 [1:7556533997050710544:5557]
2025-10-02T08:11:14.246477Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:14.246492Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:14.246496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.246498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.246500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.246514Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:14.246524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:14.246530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:14.246593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.246600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.246604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:14.246606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:14.246681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:14.246688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.246703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.246721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:14.246740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1117
2025-10-02T08:11:14.246744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050710549:5558], now have 1 active actors on pipe
2025-10-02T08:11:14.246748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533997510721480:2378], now have 1 active actors on pipe
2025-10-02T08:11:14.246753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533997050710538:5557]
2025-10-02T08:11:14.246756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533997050710538:5557]
2025-10-02T08:11:14.246767Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:14.246776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.246781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:14.246784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.246785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:14.246803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:14.246821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:14.246828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:14.246867Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:14.246851Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1117
2025-10-02T08:11:14.246878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.246887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.246889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:14.246898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.246910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:14.246921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533997050710538:5557]
2025-10-02T08:11:14.246925Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:14.246935Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:14.246960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.247062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.247069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.247084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.247125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1118 partition: 0 MaxSeqNo: 17 sessionId: src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0
2025-10-02T08:11:14.247565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2132b168-58e1e61d-81618e23-f792627f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:14.250330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0] Write session: try to update token
2025-10-02T08:11:14.250348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:14.265444Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:14.265473Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:14.265475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:14.265484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533997050710538:5557]
2025-10-02T08:11:14.265488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533997050710538:5557]
2025-10-02T08:11:14.265530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:14.265548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.265551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:14.265691Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:14.265703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId: src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:14.266648Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:14.266655Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:14.268505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:14.319221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533997050710574:5853]
2025-10-02T08:11:14.319436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1117, pipe: [1:7556533997050710574:5853]
2025-10-02T08:11:14.410289Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:14.410584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.410599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.410647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050710574:5853], now have 1 active actors on pipe
2025-10-02T08:11:14.410776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533997050710574:5853]
2025-10-02T08:11:14.410811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:14.410813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:14.410869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1118 reason: error at write: Disconnected sessionId: src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0
2025-10-02T08:11:14.410882Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:14.410921Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:14.411040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1118 sessionId: src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0 is DEAD
2025-10-02T08:11:14.411188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:14.411194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0] Write session will restart in 0.006541s
2025-10-02T08:11:14.411211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0] Write session: Do CDS request
2025-10-02T08:11:14.411216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:14.419306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.419464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:14.419484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1119
2025-10-02T08:11:14.419784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.419847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:14.419856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:14.419860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:14.420239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1119 sessionId:  describe result for acl check
2025-10-02T08:11:14.420282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:14.420289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:14.420291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:14.420296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533997050710987:5545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:14.420775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533997050710987:5545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:14.423251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:14.423356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533997050710987:5545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:14.423571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:14.423743Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:14.423754Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:14.423763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:14.423815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:14.423869Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533997050711049:5547]
2025-10-02T08:11:14.424439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:14.424614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:14.424654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:14.424956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:14.425011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.425017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.425018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.425019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.425021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.425026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.425035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.425038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.425048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.425051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.425056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.425067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.425076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.425082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.425086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.425090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.425098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.425103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.425107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.425112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.425129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:14.425952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533997050710987:5545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:14.425967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533997050710987:5545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:14.425970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533997050710987:5545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:14.425979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:14.433228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:14.435037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:14.435057Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:14.435060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:14.435064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:14.435071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1118 [1:7556533997050711049:5547]
2025-10-02T08:11:14.435084Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:14.435103Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:14.435106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.435108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.435110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.435127Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:14.435132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:14.435139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:14.435208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.435221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.435224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:14.435226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:14.435294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:14.435303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.435316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.435332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:14.435351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050711070:5545], now have 1 active actors on pipe
2025-10-02T08:11:14.435362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533997510721487:2378], now have 1 active actors on pipe
2025-10-02T08:11:14.435367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.435372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.435389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533997050711037:5547]
2025-10-02T08:11:14.435391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533997050711037:5547]
2025-10-02T08:11:14.435404Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:14.435420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:14.435422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:14.435432Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:14.435435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:14.435438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:14.435452Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8597969b-504784a5-a2c95061-f325085b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:14.435430Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1118
2025-10-02T08:11:14.435464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.435472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.435473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:14.435482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.435486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1118
2025-10-02T08:11:14.435495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:14.435535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533997050711037:5547]
2025-10-02T08:11:14.435548Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:14.435564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:14.435569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.435658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.435666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.435679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.435719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1119 partition: 0 MaxSeqNo: 17 sessionId: src_id|8597969b-504784a5-a2c95061-f325085b_0
2025-10-02T08:11:14.436087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44efa7e4-fa051803-a4ae640d-3b94f5bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8597969b-504784a5-a2c95061-f325085b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:14.438733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8597969b-504784a5-a2c95061-f325085b_0] Write session: try to update token
2025-10-02T08:11:14.438747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8597969b-504784a5-a2c95061-f325085b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:14.453297Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:14.453324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:14.453327Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:14.453336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533997050711037:5547]
2025-10-02T08:11:14.453341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533997050711037:5547]
2025-10-02T08:11:14.453389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:14.453400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.453406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:14.453552Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:14.454207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId: src_id|8597969b-504784a5-a2c95061-f325085b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:14.456939Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:14.456959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:14.457142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:14.511197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533997050711089:5853]
2025-10-02T08:11:14.511323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1118, pipe: [1:7556533997050711089:5853]
2025-10-02T08:11:14.610270Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:14.610616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.610638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.610686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050711089:5853], now have 1 active actors on pipe
2025-10-02T08:11:14.610791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:14.610803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:14.610852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1119 reason: error at write: Disconnected sessionId: src_id|8597969b-504784a5-a2c95061-f325085b_0
2025-10-02T08:11:14.610866Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:14.610912Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:14.611044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1119 sessionId: src_id|8597969b-504784a5-a2c95061-f325085b_0 is DEAD
2025-10-02T08:11:14.611194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8597969b-504784a5-a2c95061-f325085b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:14.611203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8597969b-504784a5-a2c95061-f325085b_0] Write session will restart in 0.009400s
2025-10-02T08:11:14.611200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533997050711089:5853]
2025-10-02T08:11:14.611225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8597969b-504784a5-a2c95061-f325085b_0] Write session: Do CDS request
2025-10-02T08:11:14.611232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8597969b-504784a5-a2c95061-f325085b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:14.621264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8597969b-504784a5-a2c95061-f325085b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.621340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:14.621361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1120
2025-10-02T08:11:14.621479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.621508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:14.621517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:14.621520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:14.621622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:14.621845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1120 sessionId:  describe result for acl check
2025-10-02T08:11:14.621881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:14.621887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:14.621889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:14.621894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533997050711543:5526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:14.622133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:14.622281Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:14.622291Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:14.622299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:14.622340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:14.622375Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533997050711545:5522]
2025-10-02T08:11:14.622565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533997050711543:5526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:14.622966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:14.623143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:14.623185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:14.623453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:14.623507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.623512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.623513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.623514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.623515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.623520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.623529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.623532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.623535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.623539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.623544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.623554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.623559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.623568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.623572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.623576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.623579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.623584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.623588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.623597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.623613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:14.624466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533997050711543:5526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:14.630238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533997050711543:5526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:14.630251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533997050711543:5526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:14.630253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533997050711543:5526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:14.630259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:14.631091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:14.632691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:14.632705Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:14.632707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:14.632709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:14.632714Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1119 [1:7556533997050711545:5522]
2025-10-02T08:11:14.632721Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:14.632732Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:14.632734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.632735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.632736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.632747Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:14.632749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:14.632754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:14.632797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.632822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.632829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:14.632831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:14.632879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:14.632887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.632899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.632907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:14.632919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050711590:5526], now have 1 active actors on pipe
2025-10-02T08:11:14.632927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533997050711537:5522]
2025-10-02T08:11:14.632929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533997050711537:5522]
2025-10-02T08:11:14.632931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1119
2025-10-02T08:11:14.632934Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:14.632939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533997510721496:2378], now have 1 active actors on pipe
2025-10-02T08:11:14.632943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:14.632944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:14.632945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:14.632952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:14.632953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:14.632958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.632961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.632990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533997050711537:5522]
2025-10-02T08:11:14.632996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:14.633003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:14.633007Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6664083-750429da-b35676ab-8fe6ffa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:14.633011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.632995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1119
2025-10-02T08:11:14.633014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.633015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:14.633022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.633027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:14.633053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.633089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.633094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.633103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.633133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1120 partition: 0 MaxSeqNo: 17 sessionId: src_id|f6664083-750429da-b35676ab-8fe6ffa1_0
2025-10-02T08:11:14.633422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8597969b-504784a5-a2c95061-f325085b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f6664083-750429da-b35676ab-8fe6ffa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:14.635969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6664083-750429da-b35676ab-8fe6ffa1_0] Write session: try to update token
2025-10-02T08:11:14.635983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6664083-750429da-b35676ab-8fe6ffa1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:14.650513Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:14.650540Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:14.650542Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:14.650551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533997050711537:5522]
2025-10-02T08:11:14.650555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533997050711537:5522]
2025-10-02T08:11:14.650595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:14.650599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:14.650607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.650609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:14.650609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:14.650754Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:14.651072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId: src_id|f6664083-750429da-b35676ab-8fe6ffa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:14.653754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:14.711380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533997050711611:5853]
2025-10-02T08:11:14.711472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1119, pipe: [1:7556533997050711611:5853]
2025-10-02T08:11:14.790287Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:14.790579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.790596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.790636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050711611:5853], now have 1 active actors on pipe
2025-10-02T08:11:14.790753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:14.790767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:14.790841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1120 reason: error at write: Disconnected sessionId: src_id|f6664083-750429da-b35676ab-8fe6ffa1_0
2025-10-02T08:11:14.790863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:14.791511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6664083-750429da-b35676ab-8fe6ffa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:14.791521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6664083-750429da-b35676ab-8fe6ffa1_0] Write session will restart in 0.007234s
2025-10-02T08:11:14.791542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6664083-750429da-b35676ab-8fe6ffa1_0] Write session: Do CDS request
2025-10-02T08:11:14.791548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6664083-750429da-b35676ab-8fe6ffa1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:14.790875Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:14.791094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1120 sessionId: src_id|f6664083-750429da-b35676ab-8fe6ffa1_0 is DEAD
2025-10-02T08:11:14.791249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533997050711611:5853]
2025-10-02T08:11:14.800427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6664083-750429da-b35676ab-8fe6ffa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.800498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:14.800519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1121
2025-10-02T08:11:14.800703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:14.800737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:14.800743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:14.800746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:14.801304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1121 sessionId:  describe result for acl check
2025-10-02T08:11:14.801346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:14.801348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:14.801350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:14.801355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556533997050711832:5517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:14.801933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556533997050711832:5517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:14.806077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556533997050711832:5517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:14.811172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556533997050711832:5517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:14.811193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556533997050711832:5517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:14.811197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556533997050711832:5517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:14.811206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:14.813732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:14.816753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:14.817020Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:14.817024Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:14.817034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:14.817093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:14.817138Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556533997050712099:5518]
2025-10-02T08:11:14.817632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:14.817868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:14.817932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:14.818279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:14.818341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.818342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.818343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.818345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.818346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.818351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.818361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.818365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.818369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.818373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.818379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.818387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:14.818393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.818399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:14.818403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.818409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:14.818413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.818418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.818423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.818429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.818449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:14.827362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:14.829447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:14.829467Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:14.829469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:14.829473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:14.829479Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1120 [1:7556533997050712099:5518]
2025-10-02T08:11:14.829489Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:14.829506Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:14.829508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.829510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.829512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.829528Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:14.829532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:14.829538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:14.829607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.829614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.829617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:14.829619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:14.829682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:14.829688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.829703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:14.829719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:14.829741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556533997050712093:5518]
2025-10-02T08:11:14.829747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556533997050712093:5518]
2025-10-02T08:11:14.829753Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:14.829766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:14.829778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:14.829782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:14.829784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:14.829788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1120
2025-10-02T08:11:14.829793Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:14.829796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050712078:5517], now have 1 active actors on pipe
2025-10-02T08:11:14.829835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556533997050712093:5518]
2025-10-02T08:11:14.829847Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:14.829855Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:14.829856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533997510721502:2378], now have 1 active actors on pipe
2025-10-02T08:11:14.829862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.829866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.829918Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:14.829930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:14.829934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:14.829936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:14.829911Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1120
2025-10-02T08:11:14.829945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:14.829957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:14.829981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.830013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.830018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.830028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:14.830065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1121 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0
2025-10-02T08:11:14.830566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6664083-750429da-b35676ab-8fe6ffa1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:14.833451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0] Write session: try to update token
2025-10-02T08:11:14.833470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:14.851632Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:14.851658Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:14.851661Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:14.851669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556533997050712093:5518]
2025-10-02T08:11:14.851674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556533997050712093:5518]
2025-10-02T08:11:14.851718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:14.851728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:14.851728Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:14.851734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:14.851738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:14.851915Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:14.852768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId: src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:14.855574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:14.924298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556533997050712138:5853]
2025-10-02T08:11:14.927159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1120, pipe: [1:7556533997050712138:5853]
2025-10-02T08:11:14.996475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:14.996492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0] Write session will restart in 0.008389s
2025-10-02T08:11:14.996519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0] Write session: Do CDS request
2025-10-02T08:11:14.996526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:14.994551Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:14.994990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:14.995002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:14.995051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556533997050712138:5853], now have 1 active actors on pipe
2025-10-02T08:11:14.995695Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:14.996039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556533997050712138:5853]
2025-10-02T08:11:14.996058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:14.996107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1121 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0
2025-10-02T08:11:14.996286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1121 sessionId: src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0 is DEAD
2025-10-02T08:11:14.995369Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:15.007353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.007454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:15.007486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1122
2025-10-02T08:11:15.009281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.009333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:15.009344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:15.009349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:15.009854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1122 sessionId:  describe result for acl check
2025-10-02T08:11:15.009893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:15.009899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:15.009901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:15.009906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534001345679773:5482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:15.010418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534001345679773:5482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:15.012522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534001345679773:5482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:15.018734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:15.019780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:15.019781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534001345679773:5482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:15.019789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534001345679773:5482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:15.019794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534001345679773:5482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:15.019802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:15.020004Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:15.020032Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:15.020043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:15.020095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:15.020136Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534001345679955:5481]
2025-10-02T08:11:15.020735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:15.021041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:15.021102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:15.021505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:15.021565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.021573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.021575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.021576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.021577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.021583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.021593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.021597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.021601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.021604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.021610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.021617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.021622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.021627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.021631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.021635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.021640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.021644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.021649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.021654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.021672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:15.034135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:15.036216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:15.036225Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:15.036228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:15.036232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:15.036239Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1121 [1:7556534001345679955:5481]
2025-10-02T08:11:15.036252Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:15.036270Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:15.036273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.036276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.036277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.036296Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:15.036301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:15.036308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:15.036378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.036380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.036383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:15.036385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:15.036472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:15.036475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.036492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.036504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:15.036521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534001345679945:5481]
2025-10-02T08:11:15.036523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534001345679945:5481]
2025-10-02T08:11:15.036539Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:15.036553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:15.036569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:15.036572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:15.036609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534001345679945:5481]
2025-10-02T08:11:15.036612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:15.036621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345679953:5482], now have 1 active actors on pipe
2025-10-02T08:11:15.036670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1121
2025-10-02T08:11:15.036689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.036694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.036697Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:15.036700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:15.036707Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:15.036721Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:15.036728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.036732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.036734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:15.036744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.036753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:15.036771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.037071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.037091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.037108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556533997510721545:2378], now have 1 active actors on pipe
2025-10-02T08:11:15.037125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.037165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1122 partition: 0 MaxSeqNo: 17 sessionId: src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0
2025-10-02T08:11:15.037521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1121
2025-10-02T08:11:15.037695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e28ebc8-e62e6c12-29ab89f-27f682c3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:15.040623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0] Write session: try to update token
2025-10-02T08:11:15.040641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:15.058742Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:15.058769Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:15.058773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:15.058782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534001345679945:5481]
2025-10-02T08:11:15.058786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534001345679945:5481]
2025-10-02T08:11:15.058831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:15.058839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.058841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:15.058842Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:15.058848Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:15.058996Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:15.060671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId: src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:15.063520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:15.097176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534001345679986:5853]
2025-10-02T08:11:15.097411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1121, pipe: [1:7556534001345679986:5853]
2025-10-02T08:11:15.210962Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:15.211435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.211457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.211507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345679986:5853], now have 1 active actors on pipe
2025-10-02T08:11:15.211645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534001345679986:5853]
2025-10-02T08:11:15.211668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:15.211675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:15.211880Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:15.211744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1122 reason: error at write: Disconnected sessionId: src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0
2025-10-02T08:11:15.211972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1122 sessionId: src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0 is DEAD
2025-10-02T08:11:15.212162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:15.212173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0] Write session will restart in 0.008874s
2025-10-02T08:11:15.212198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0] Write session: Do CDS request
2025-10-02T08:11:15.212207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:15.212198Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:15.222433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.222600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:15.222622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1123
2025-10-02T08:11:15.222777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.222811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:15.222817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:15.222821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:15.223337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1123 sessionId:  describe result for acl check
2025-10-02T08:11:15.223379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:15.223381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:15.223383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:15.223388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534001345680350:5453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:15.223969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534001345680350:5453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:15.226733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534001345680350:5453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:15.227273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:15.228170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:15.228356Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:15.228367Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:15.228376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:15.228422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:15.228581Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534001345680472:5464]
2025-10-02T08:11:15.229241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:15.229453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:15.229497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534001345680350:5453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:15.229500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:15.229510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534001345680350:5453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:15.229513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534001345680350:5453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:15.229522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:15.229812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:15.229856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.229862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.229863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.229865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.229866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.229873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.229884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.229888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.229893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.229897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.229902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.229909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.229915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.229921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.229927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.229932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.229937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.229942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.229948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.229953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.229972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:15.238482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:15.240458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:15.240480Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:15.240483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:15.240487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:15.240495Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1122 [1:7556534001345680472:5464]
2025-10-02T08:11:15.240508Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:15.240526Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:15.240530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.240534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.240536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.240553Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:15.240564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:15.240572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:15.240638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.240646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.240650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:15.240653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:15.240726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:15.240741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.240757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.240771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:15.240790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345680483:5453], now have 1 active actors on pipe
2025-10-02T08:11:15.240795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534001805688847:2378], now have 1 active actors on pipe
2025-10-02T08:11:15.240822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534001345680462:5464]
2025-10-02T08:11:15.240824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534001345680462:5464]
2025-10-02T08:11:15.240832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1122
2025-10-02T08:11:15.240833Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:15.240846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:15.240846Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:15.240850Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:15.240861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:15.240865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:15.240875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.240885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.240932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1122
2025-10-02T08:11:15.240931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534001345680462:5464]
2025-10-02T08:11:15.240941Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:15.240962Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:15.240968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.240968Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:15.240972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.240975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:15.240986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.240995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:15.241036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.241114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.241122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.241136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.241176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1123 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0
2025-10-02T08:11:15.241598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e19c37-a620fc10-2acae9e8-9cb21d27_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:15.244171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0] Write session: try to update token
2025-10-02T08:11:15.244183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:15.259849Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:15.259868Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:15.259870Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:15.259876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534001345680462:5464]
2025-10-02T08:11:15.259880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534001345680462:5464]
2025-10-02T08:11:15.259915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:15.259919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.259921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:15.259929Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:15.259934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:15.260051Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:15.260522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId: src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:15.263236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:15.311975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534001345680502:5853]
2025-10-02T08:11:15.312094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1122, pipe: [1:7556534001345680502:5853]
2025-10-02T08:11:15.394181Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:15.394553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.394568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.394609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345680502:5853], now have 1 active actors on pipe
2025-10-02T08:11:15.394730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:15.394739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:15.394790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1123 reason: error at write: Disconnected sessionId: src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0
2025-10-02T08:11:15.394899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:15.394885Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:15.394991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1123 sessionId: src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0 is DEAD
2025-10-02T08:11:15.395122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534001345680502:5853]
2025-10-02T08:11:15.395158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:15.395168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0] Write session will restart in 0.007861s
2025-10-02T08:11:15.395195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0] Write session: Do CDS request
2025-10-02T08:11:15.395200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:15.404316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.404455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:15.404472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1124
2025-10-02T08:11:15.404600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.404638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:15.404647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:15.404650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:15.405067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1124 sessionId:  describe result for acl check
2025-10-02T08:11:15.405097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:15.405102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:15.405104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:15.405109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534001345680879:5440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:15.405602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534001345680879:5440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:15.407727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534001345680879:5440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:15.408505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:15.409423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:15.409557Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:15.409565Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:15.409572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:15.409602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:15.409628Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534001345680991:5442]
2025-10-02T08:11:15.410093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:15.410216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:15.410243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:15.410433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:15.410462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.410467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.410467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.410468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.410469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.410472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.410478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.410480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.410482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.410485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.410488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.410493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.410496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.410499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.410502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.410504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.410507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.410510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.410512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.410515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.410527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:15.410673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534001345680879:5440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:15.410687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534001345680879:5440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:15.410690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534001345680879:5440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:15.410703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:15.418808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:15.420822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:15.420842Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:15.420845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:15.420849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:15.420856Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1123 [1:7556534001345680991:5442]
2025-10-02T08:11:15.420868Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:15.420886Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:15.420889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.420891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.420893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.420909Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:15.420919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:15.420927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:15.420998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.421008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.421011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:15.421013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:15.421079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:15.421086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.421101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.421118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:15.421136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534001345680985:5442]
2025-10-02T08:11:15.421141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534001345680985:5442]
2025-10-02T08:11:15.421151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:15.421162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345681008:5440], now have 1 active actors on pipe
2025-10-02T08:11:15.421170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:15.421175Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:15.421179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:15.421179Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:15.421180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1123
2025-10-02T08:11:15.421181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:15.421185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534001805688854:2378], now have 1 active actors on pipe
2025-10-02T08:11:15.421210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534001345680985:5442]
2025-10-02T08:11:15.421220Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:15.421225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.421234Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:15.421235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.421266Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:15.421276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.421278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.421279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:15.421286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.421292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:15.421309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.421294Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1123
2025-10-02T08:11:15.421358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.421363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.421372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.421402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1124 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0
2025-10-02T08:11:15.421738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be2242-4f688e96-12dc43fa-ac3a1626_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:15.424380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0] Write session: try to update token
2025-10-02T08:11:15.424398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:15.438874Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:15.438894Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:15.438896Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:15.438904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534001345680985:5442]
2025-10-02T08:11:15.438907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534001345680985:5442]
2025-10-02T08:11:15.438946Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:15.438949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:15.438950Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:15.438956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.438959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:15.439100Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:15.440088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId: src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:15.443369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:15.495236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534001345681026:5853]
2025-10-02T08:11:15.495330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1123, pipe: [1:7556534001345681026:5853]
2025-10-02T08:11:15.575173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:15.575512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.575525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.575562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345681026:5853], now have 1 active actors on pipe
2025-10-02T08:11:15.575629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:15.575635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:15.575684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1124 reason: error at write: Disconnected sessionId: src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0
2025-10-02T08:11:15.575797Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:15.575796Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:15.575891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1124 sessionId: src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0 is DEAD
2025-10-02T08:11:15.576011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534001345681026:5853]
2025-10-02T08:11:15.576068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:15.576079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0] Write session will restart in 0.008687s
2025-10-02T08:11:15.576105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0] Write session: Do CDS request
2025-10-02T08:11:15.576112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:15.586242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.586469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:15.586487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1125
2025-10-02T08:11:15.586639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.586669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:15.586678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:15.586686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:15.587059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1125 sessionId:  describe result for acl check
2025-10-02T08:11:15.587096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:15.587102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:15.587104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:15.587109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534001345681477:5434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:15.587628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534001345681477:5434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:15.587739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:15.588646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:15.588825Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:15.588834Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:15.588844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:15.588889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:15.588931Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534001345681503:5435]
2025-10-02T08:11:15.589618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:15.589802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:15.589831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534001345681477:5434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:15.589842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:15.590180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:15.590225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.590231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.590233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.590234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.590235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.590240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.590250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.590254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.590258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.590262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.590267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.590284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.590292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.590303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.590307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.590313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.590319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.590324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.590329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.590335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.590360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:15.596665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534001345681477:5434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:15.596680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534001345681477:5434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:15.596682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534001345681477:5434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:15.596689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:15.598699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:15.600402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:15.600416Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:15.600417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:15.600420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:15.600424Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1124 [1:7556534001345681503:5435]
2025-10-02T08:11:15.600431Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:15.600443Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:15.600445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.600447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.600448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.600459Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:15.600462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:15.600467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:15.600513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.600518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.600520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:15.600522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:15.600567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:15.600573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.600581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.600589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:15.600606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534001345681483:5435]
2025-10-02T08:11:15.600610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534001345681483:5435]
2025-10-02T08:11:15.600616Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:15.600624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:15.600632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:15.600634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:15.600641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345681534:5434], now have 1 active actors on pipe
2025-10-02T08:11:15.600658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1124
2025-10-02T08:11:15.600660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:15.600663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:15.600667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534001345681483:5435]
2025-10-02T08:11:15.600670Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:15.600687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534001805688864:2378], now have 1 active actors on pipe
2025-10-02T08:11:15.600690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:15.600691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.600696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.600719Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:15.600731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.600735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.600737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:15.600747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.600754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:15.600765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.600774Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1124
2025-10-02T08:11:15.600828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.600835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.600848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.600885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1125 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0
2025-10-02T08:11:15.601190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff297018-17efca1c-7c4f49d6-79cafe04_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:15.603686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0] Write session: try to update token
2025-10-02T08:11:15.603699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:15.617106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId: src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:15.618757Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:15.618775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:15.618777Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:15.618785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534001345681483:5435]
2025-10-02T08:11:15.618789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534001345681483:5435]
2025-10-02T08:11:15.618834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:15.618833Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:15.618839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:15.618844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.618846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:15.618980Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:15.619693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:15.676001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534001345681552:5853]
2025-10-02T08:11:15.676137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1124, pipe: [1:7556534001345681552:5853]
2025-10-02T08:11:15.760009Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:15.760295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.760306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.760337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345681552:5853], now have 1 active actors on pipe
2025-10-02T08:11:15.760459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:15.760469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:15.760511Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:15.760549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1125 reason: error at write: Disconnected sessionId: src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0
2025-10-02T08:11:15.760613Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:15.760761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1125 sessionId: src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0 is DEAD
2025-10-02T08:11:15.760776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534001345681552:5853]
2025-10-02T08:11:15.760949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:15.760959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0] Write session will restart in 0.009686s
2025-10-02T08:11:15.760984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0] Write session: Do CDS request
2025-10-02T08:11:15.760991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:15.772320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.772497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:15.772510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1126
2025-10-02T08:11:15.772701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.772732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:15.772741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:15.772745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:15.773109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1126 sessionId:  describe result for acl check
2025-10-02T08:11:15.773142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:15.773147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:15.773149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:15.773154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534001345682002:5413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:15.773637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534001345682002:5413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:15.773717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:15.774894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:15.775067Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:15.775081Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:15.775094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:15.775140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:15.775177Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534001345682035:5408]
2025-10-02T08:11:15.775756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534001345682002:5413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:15.775807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:15.776030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:15.776082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:15.776397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:15.776451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.776456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.776458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.776459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.776461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.776466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.776475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.776484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.776488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.776491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.776495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.776502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.776509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.776518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.776527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.776533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.776542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.776547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.776559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.776569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.776587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:15.781925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534001345682002:5413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:15.781948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534001345682002:5413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:15.781951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534001345682002:5413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:15.781959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:15.784902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:15.786673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:15.786690Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:15.786692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:15.786695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:15.786699Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1125 [1:7556534001345682035:5408]
2025-10-02T08:11:15.786710Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:15.786725Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:15.786727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.786728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.786730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.786742Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:15.786745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:15.786749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:15.786795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.786801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.786803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:15.786805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:15.786867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:15.786874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.786883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.786891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:15.786903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534001345682012:5408]
2025-10-02T08:11:15.786904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534001345682012:5408]
2025-10-02T08:11:15.786909Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:15.786917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345682062:5413], now have 1 active actors on pipe
2025-10-02T08:11:15.786924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:15.786930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:15.786932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:15.786933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:15.786934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:15.786940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1125
2025-10-02T08:11:15.786962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534001805688871:2378], now have 1 active actors on pipe
2025-10-02T08:11:15.786971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.786975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.786989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534001345682012:5408]
2025-10-02T08:11:15.787001Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:15.787007Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:15.787024Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:15.787033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.787035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.787036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:15.787043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.787064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:15.787022Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1125
2025-10-02T08:11:15.787082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.787164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.787171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.787181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.787210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1126 partition: 0 MaxSeqNo: 17 sessionId: src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0
2025-10-02T08:11:15.787528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec6cf423-163bfd3c-11329209-141e4bc5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:15.790146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0] Write session: try to update token
2025-10-02T08:11:15.790165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:15.804350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId: src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:15.804940Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:15.804954Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:15.804957Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:15.804968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534001345682012:5408]
2025-10-02T08:11:15.804972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534001345682012:5408]
2025-10-02T08:11:15.805005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:15.805012Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:15.805015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.805016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:15.805017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:15.805208Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:15.807168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:15.860836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534001345682075:5853]
2025-10-02T08:11:15.860982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1125, pipe: [1:7556534001345682075:5853]
2025-10-02T08:11:15.943928Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:15.944288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.944302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.944339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345682075:5853], now have 1 active actors on pipe
2025-10-02T08:11:15.944533Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:15.944557Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:15.944887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534001345682075:5853]
2025-10-02T08:11:15.944910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:15.944957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1126 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0
2025-10-02T08:11:15.945118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1126 sessionId: src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0 is DEAD
2025-10-02T08:11:15.945320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:15.945342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0] Write session will restart in 0.009638s
2025-10-02T08:11:15.945369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0] Write session: Do CDS request
2025-10-02T08:11:15.945376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:15.956349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.956487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:15.956502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1127
2025-10-02T08:11:15.956685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:15.956714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:15.956719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:15.956722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:15.957264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1127 sessionId:  describe result for acl check
2025-10-02T08:11:15.957298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:15.957304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:15.957305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:15.957310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534001345682516:5401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:15.957900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534001345682516:5401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:15.960062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:15.960987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:15.961152Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:15.961161Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:15.961169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:15.961214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:15.961247Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534001345682585:5410]
2025-10-02T08:11:15.961821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:15.962269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534001345682516:5401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:15.962357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:15.962403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:15.962684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:15.962746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.962753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.962754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.962754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.962755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.962760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.962770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.962774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.962777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.962781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.962786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.962794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:15.962804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.962812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:15.962834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.962839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:15.962843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.962847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.962855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.962860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.962883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:15.969139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534001345682516:5401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:15.969156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534001345682516:5401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:15.969159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534001345682516:5401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:15.969167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:15.971486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:15.973302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:15.973326Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:15.973328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:15.973331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:15.973337Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1126 [1:7556534001345682585:5410]
2025-10-02T08:11:15.973350Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:15.973366Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:15.973369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.973372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.973374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.973389Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:15.973394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:15.973399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:15.973459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.973468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.973471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:15.973474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:15.973535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:15.973543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:15.973556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:15.973571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:15.973593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534001345682611:5401], now have 1 active actors on pipe
2025-10-02T08:11:15.973607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534001345682575:5410]
2025-10-02T08:11:15.973615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534001345682575:5410]
2025-10-02T08:11:15.973627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:15.973635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:15.973643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:15.973649Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:15.973659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:15.973666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:15.973672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534001805688903:2378], now have 1 active actors on pipe
2025-10-02T08:11:15.973704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534001345682575:5410]
2025-10-02T08:11:15.973716Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:15.973726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:15.973698Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1126
2025-10-02T08:11:15.973960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1126
2025-10-02T08:11:15.974115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.974124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.974149Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:15.974160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.974164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.974170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:15.974197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:15.974211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:15.974230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.974409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.974415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.974431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:15.974634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1127 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0
2025-10-02T08:11:15.974988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7fffcc8-a26d0ca-dd7b3988-dd5ffe1f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:15.977474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0] Write session: try to update token
2025-10-02T08:11:15.977486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:15.984793Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:15.984830Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:15.984839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534001345682575:5410]
2025-10-02T08:11:15.984879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:15.984882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:15.985053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:15.985193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:15.985334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:15.985475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:15.985668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:15.985710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:15.991186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId: src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:15.993773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:15.993890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.993907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.993942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:15.993970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:15.994029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:15.994036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:15.994214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.994293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.994374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.994441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.994490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.994499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.994576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.994646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.994717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.994788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.994839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.994846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.994920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.994986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.995054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.995117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.995169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.995176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.995246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.995324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.995393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.995461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.995507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.995514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.995576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.995640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.995710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.995778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.995828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.995848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.995917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.995981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.996052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.996127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.996182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.996189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.996262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.996328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.996400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.996475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.996531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.996539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.996610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.996673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.996743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.996839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.996889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.996892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.996962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.997030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.997099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.997166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.997216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.997223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.997293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:15.997359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:15.997428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:15.997497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:15.997548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:15.997554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:15.997596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:15.997667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:15.997691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:15.997698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:15.997730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:15.997747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:15.997755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:15.997758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:15.997761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:15.998198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:15.998227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:15.998233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:15.998237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:15.998240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:15.998243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:15.998748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:15.998768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:15.998773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:15.998776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:15.998779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:15.998784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:15.999392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:15.999414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:15.999420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:15.999424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:15.999427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:16.000753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:16.000776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:16.000788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392676000
2025-10-02T08:11:16.000920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:16.000937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:16.000943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:16.000948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:16.000956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:16.000960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:16.001429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:16.001455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:16.001481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:16.001491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:16.001494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:16.001498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:16.001985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:16.002012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:16.002019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:16.002028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:16.002031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:16.002035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:16.002532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:16.002556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:16.002565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:16.003738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:16.003760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:16.003765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:16.003772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:16.003785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392676003
2025-10-02T08:11:16.004093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:16.004121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:16.004132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:16.004136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:16.004139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:16.004143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:16.004611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:16.004639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:16.004652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:16.004656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:16.004659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:16.004667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:16.005164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:16.005189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.005296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392676005
2025-10-02T08:11:16.006088Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:16.006109Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:16.006123Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:16.006131Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:16.007746Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:16.007761Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:16.007763Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:16.007773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534001345682575:5410]
2025-10-02T08:11:16.007776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534001345682575:5410]
2025-10-02T08:11:16.007834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:16.007844Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:16.007850Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:16.007853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.007856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:16.007991Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:16.045135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534005640649953:5853]
2025-10-02T08:11:16.045263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1126, pipe: [1:7556534005640649953:5853]
2025-10-02T08:11:16.153044Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:16.153429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640649953:5853], now have 1 active actors on pipe
2025-10-02T08:11:16.153589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:16.153600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:16.153629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1127 reason: error at write: Disconnected sessionId: src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0
2025-10-02T08:11:16.153643Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:16.153695Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:16.153817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1127 sessionId: src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0 is DEAD
2025-10-02T08:11:16.153957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:16.153949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534005640649953:5853]
2025-10-02T08:11:16.153970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0] Write session will restart in 0.006498s
2025-10-02T08:11:16.154004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0] Write session: Do CDS request
2025-10-02T08:11:16.154011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:16.161574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:16.164935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:16.164951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1128
2025-10-02T08:11:16.165114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:16.165153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:16.165162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:16.165166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:16.165594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1128 sessionId:  describe result for acl check
2025-10-02T08:11:16.165621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:16.165627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:16.165628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:16.165633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534005640650374:5386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:16.166332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534005640650374:5386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:16.168516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534005640650374:5386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:16.169037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:16.169897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:16.170054Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:16.170065Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:16.170075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:16.170120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:16.170158Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534005640650450:5384]
2025-10-02T08:11:16.170801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:16.171059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:16.171119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:16.171430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:16.171500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.171502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.171503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.171504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.171505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.171510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.171519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.171523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.171526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.171529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.171535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.171541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.171547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.171552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.171556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.171561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.171566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.171570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.171575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.171580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.171596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:16.171608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534005640650374:5386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:16.171614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534005640650374:5386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:16.171617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534005640650374:5386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:16.171626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:16.180370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:16.182194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:16.182205Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:16.182207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:16.182210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:16.182217Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1127 [1:7556534005640650450:5384]
2025-10-02T08:11:16.182229Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:16.182248Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:16.182250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.182253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.182255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.182272Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:16.182284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:16.182290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:16.182355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.182362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.182366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:16.182369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:16.182438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:16.182446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.182459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.182471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:16.182487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534005640650438:5384]
2025-10-02T08:11:16.182490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534005640650438:5384]
2025-10-02T08:11:16.182497Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:16.182509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:16.182522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:16.182524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:16.182534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640650464:5386], now have 1 active actors on pipe
2025-10-02T08:11:16.182544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:16.182547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:16.182566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534005640650438:5384]
2025-10-02T08:11:16.182569Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:16.182574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534006100656216:2378], now have 1 active actors on pipe
2025-10-02T08:11:16.182614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1127
2025-10-02T08:11:16.182700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:16.182785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.182795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.182827Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:16.182836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.182841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.182843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:16.182856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.182868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:16.182886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:16.183014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.183017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.183032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:16.183077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1128 partition: 0 MaxSeqNo: 17 sessionId: src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0
2025-10-02T08:11:16.183853Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1127
2025-10-02T08:11:16.185011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5e3ce0-6a91af19-49c4e4d2-392a52fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:16.187758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0] Write session: try to update token
2025-10-02T08:11:16.187779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:16.206223Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:16.206245Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:16.206248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:16.206256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534005640650438:5384]
2025-10-02T08:11:16.206261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534005640650438:5384]
2025-10-02T08:11:16.206317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:16.206323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.206325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:16.206467Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:16.207982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:16.207996Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:16.210837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId: src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:16.213563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:16.254112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534005640650482:5853]
2025-10-02T08:11:16.254213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1127, pipe: [1:7556534005640650482:5853]
2025-10-02T08:11:16.363718Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:16.364122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.364134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.364168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640650482:5853], now have 1 active actors on pipe
2025-10-02T08:11:16.364273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:16.364282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:16.364341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1128 reason: error at write: Disconnected sessionId: src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0
2025-10-02T08:11:16.364423Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:16.364526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1128 sessionId: src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0 is DEAD
2025-10-02T08:11:16.364603Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:16.364686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:16.364698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0] Write session will restart in 0.005247s
2025-10-02T08:11:16.364706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534005640650482:5853]
2025-10-02T08:11:16.364726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0] Write session: Do CDS request
2025-10-02T08:11:16.364741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:16.371313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:16.371359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:16.371374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1129
2025-10-02T08:11:16.371528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:16.371553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:16.371562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:16.371565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:16.371963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1129 sessionId:  describe result for acl check
2025-10-02T08:11:16.371993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:16.371998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:16.371999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:16.372003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534005640650763:5365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:16.372431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534005640650763:5365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:16.374555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534005640650763:5365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:16.377111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534005640650763:5365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:16.377124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534005640650763:5365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:16.377126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534005640650763:5365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:16.377133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:16.377170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:16.377988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:16.378156Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:16.378166Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:16.378174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:16.378212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:16.378260Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534005640650987:5364]
2025-10-02T08:11:16.378763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:16.378915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:16.378962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:16.379197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:16.379233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.379240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.379241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.379242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.379243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.379247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.379254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.379256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.379259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.379261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.379265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.379270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.379275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.379279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.379281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.379284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.379287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.379290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.379293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.379296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.379307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:16.388186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:16.390354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:16.390376Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:16.390379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:16.390384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:16.390392Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1128 [1:7556534005640650987:5364]
2025-10-02T08:11:16.390409Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:16.390432Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:16.390442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.390446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.390448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.390468Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:16.390483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:16.390497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:16.390580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.390589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.390593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:16.390596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:16.390684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:16.390693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.390709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.390727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:16.390748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640650980:5365], now have 1 active actors on pipe
2025-10-02T08:11:16.390752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534006100656223:2378], now have 1 active actors on pipe
2025-10-02T08:11:16.390760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534005640650975:5364]
2025-10-02T08:11:16.390762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534005640650975:5364]
2025-10-02T08:11:16.390785Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:16.390799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:16.390813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:16.390819Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:16.390821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:16.390824Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:16.390862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534005640650975:5364]
2025-10-02T08:11:16.390871Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:16.390894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:16.390860Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1128
2025-10-02T08:11:16.390922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1128
2025-10-02T08:11:16.390938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.390947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.390977Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:16.390986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.390990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.390993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:16.391004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.391015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:16.391037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:16.391073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.391084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.391109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:16.391156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1129 partition: 0 MaxSeqNo: 17 sessionId: src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0
2025-10-02T08:11:16.391530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47818f65-e4bc1efe-ef8fbe06-ecd1cafc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:16.394010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0] Write session: try to update token
2025-10-02T08:11:16.394024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:16.407811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId: src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:16.408616Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:16.408635Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:16.408637Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:16.408646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534005640650975:5364]
2025-10-02T08:11:16.408655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534005640650975:5364]
2025-10-02T08:11:16.408700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:16.408713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.408713Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:16.408715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:16.408719Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:16.408899Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:16.410591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:16.464948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534005640651011:5853]
2025-10-02T08:11:16.465010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1128, pipe: [1:7556534005640651011:5853]
2025-10-02T08:11:16.547021Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:16.547348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.547361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.547398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640651011:5853], now have 1 active actors on pipe
2025-10-02T08:11:16.547547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:16.547556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:16.547606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1129 reason: error at write: Disconnected sessionId: src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0
2025-10-02T08:11:16.547660Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:16.547674Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:16.547783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1129 sessionId: src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0 is DEAD
2025-10-02T08:11:16.547952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534005640651011:5853]
2025-10-02T08:11:16.547976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:16.547987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0] Write session will restart in 0.008597s
2025-10-02T08:11:16.548011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0] Write session: Do CDS request
2025-10-02T08:11:16.548017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:16.557302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:16.557387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:16.557400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1130
2025-10-02T08:11:16.557521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:16.557548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:16.557557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:16.557561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:16.557983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1130 sessionId:  describe result for acl check
2025-10-02T08:11:16.558010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:16.558016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:16.558017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:16.558023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534005640651447:5351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:16.558524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534005640651447:5351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:16.560548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:16.560826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534005640651447:5351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:16.561561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:16.561729Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:16.561740Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:16.561750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:16.561797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:16.561832Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534005640651517:5350]
2025-10-02T08:11:16.562459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:16.562653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:16.562696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:16.562984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:16.563041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.563047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.563048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.563049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.563050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.563055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.563064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.563068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.563072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.563079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.563084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.563096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.563104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.563111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.563121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.563126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.563132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.563136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.563142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.563147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.563165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:16.563560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534005640651447:5351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:16.563572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534005640651447:5351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:16.563575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534005640651447:5351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:16.563584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:16.571871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:16.573700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:16.573720Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:16.573723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:16.573727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:16.573734Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1129 [1:7556534005640651517:5350]
2025-10-02T08:11:16.573746Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:16.573765Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:16.573770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.573773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.573775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.573793Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:16.573798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:16.573807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:16.573872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.573885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.573889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:16.573891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:16.573961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:16.573972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.573987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.574001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:16.574042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640651534:5351], now have 1 active actors on pipe
2025-10-02T08:11:16.574049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1129
2025-10-02T08:11:16.574056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534005640651501:5350]
2025-10-02T08:11:16.574059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534005640651501:5350]
2025-10-02T08:11:16.574071Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:16.574079Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:16.574081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:16.574084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534006100656231:2378], now have 1 active actors on pipe
2025-10-02T08:11:16.574092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:16.574106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:16.574114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:16.574098Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1129
2025-10-02T08:11:16.574121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.574129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.574176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534005640651501:5350]
2025-10-02T08:11:16.574190Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:16.574209Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad4c356-b41c978c-3657232c-61b4a450_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:16.574212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:16.574219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.574223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.574230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:16.574240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.574254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:16.574300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:16.574344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.574349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.574364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:16.574405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1130 partition: 0 MaxSeqNo: 17 sessionId: src_id|ad4c356-b41c978c-3657232c-61b4a450_0
2025-10-02T08:11:16.574712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b314f54-e86f8a53-a6363f74-7a01b722_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ad4c356-b41c978c-3657232c-61b4a450_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:16.577243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4c356-b41c978c-3657232c-61b4a450_0] Write session: try to update token
2025-10-02T08:11:16.577259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4c356-b41c978c-3657232c-61b4a450_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:16.591059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId: src_id|ad4c356-b41c978c-3657232c-61b4a450_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:16.591826Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:16.591853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:16.591855Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:16.591865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534005640651501:5350]
2025-10-02T08:11:16.591868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534005640651501:5350]
2025-10-02T08:11:16.591909Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:16.591911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:16.591916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:16.591919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.591920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:16.592062Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:16.593618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:16.648282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534005640651551:5853]
2025-10-02T08:11:16.648407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1129, pipe: [1:7556534005640651551:5853]
2025-10-02T08:11:16.747218Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:16.747685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.747698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.747739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640651551:5853], now have 1 active actors on pipe
2025-10-02T08:11:16.747856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:16.747865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:16.747923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1130 reason: error at write: Disconnected sessionId: src_id|ad4c356-b41c978c-3657232c-61b4a450_0
2025-10-02T08:11:16.747958Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:16.748135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1130 sessionId: src_id|ad4c356-b41c978c-3657232c-61b4a450_0 is DEAD
2025-10-02T08:11:16.748110Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:16.748275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4c356-b41c978c-3657232c-61b4a450_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:16.748285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4c356-b41c978c-3657232c-61b4a450_0] Write session will restart in 0.005559s
2025-10-02T08:11:16.748304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4c356-b41c978c-3657232c-61b4a450_0] Write session: Do CDS request
2025-10-02T08:11:16.748310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4c356-b41c978c-3657232c-61b4a450_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:16.748299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534005640651551:5853]
2025-10-02T08:11:16.755340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4c356-b41c978c-3657232c-61b4a450_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:16.755372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:16.755388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1131
2025-10-02T08:11:16.755599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:16.755639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:16.755643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:16.755646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:16.756142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1131 sessionId:  describe result for acl check
2025-10-02T08:11:16.756174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:16.756176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:16.756177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:16.756183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534005640651866:5337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:16.756730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534005640651866:5337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:16.759711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534005640651866:5337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:16.765870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534005640651866:5337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:16.765893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534005640651866:5337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:16.765896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534005640651866:5337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:16.765906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:16.770012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:16.770398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:16.770604Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:16.770617Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:16.770629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:16.770680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:16.770735Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534005640652062:5338]
2025-10-02T08:11:16.771530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:16.771728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:16.771769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:16.772152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:16.772212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.772219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.772220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.772222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.772223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.772229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.772242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.772246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.772251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.772255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.772261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.772274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:16.772286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.772293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:16.772303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.772309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:16.772315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.772326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.772332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.772342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.772366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:16.782638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:16.785518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1130
2025-10-02T08:11:16.784920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:16.784937Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:16.784943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:16.784948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:16.784959Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1130 [1:7556534005640652062:5338]
2025-10-02T08:11:16.784978Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:16.785006Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:16.785010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.785025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.785028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.785058Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:16.785066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:16.785076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:16.785172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.785176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.785180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:16.785184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:16.785286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:16.785290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.785309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:16.785322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:16.785370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1130
2025-10-02T08:11:16.787449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640652024:5337], now have 1 active actors on pipe
2025-10-02T08:11:16.787486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534005640652056:5338]
2025-10-02T08:11:16.787490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534005640652056:5338]
2025-10-02T08:11:16.787512Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:16.787529Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:16.787533Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:16.787545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534006100656239:2378], now have 1 active actors on pipe
2025-10-02T08:11:16.787564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:16.787597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:16.787609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:16.787622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.787633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.787717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534005640652056:5338]
2025-10-02T08:11:16.787733Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:16.787746Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:16.787762Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7940487a-6f479644-a242dad0-7ddae9a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:16.787774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.787780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.787783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:16.787800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.787820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:16.787908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:16.788035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.788046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.788068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:16.788126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1131 partition: 0 MaxSeqNo: 17 sessionId: src_id|7940487a-6f479644-a242dad0-7ddae9a5_0
2025-10-02T08:11:16.788650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad4c356-b41c978c-3657232c-61b4a450_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7940487a-6f479644-a242dad0-7ddae9a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:16.792433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7940487a-6f479644-a242dad0-7ddae9a5_0] Write session: try to update token
2025-10-02T08:11:16.792457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7940487a-6f479644-a242dad0-7ddae9a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:16.809356Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:16.809381Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:16.809395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534005640652056:5338]
2025-10-02T08:11:16.809451Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:16.809456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:16.809692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:16.809898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:16.810090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:16.810279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:16.810556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:16.810619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:16.823576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId: src_id|7940487a-6f479644-a242dad0-7ddae9a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:16.827067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:16.827188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.827205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.827291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:16.827321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:16.827388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:16.827405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:16.827649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.827738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.827819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.827939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.828446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.828460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.828548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.828626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.828705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.828794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.828871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.828881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.828972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.829047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.829123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.829205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.829319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.829328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.829430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.829515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.829608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.829693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.829758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.829767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.829859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.829945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.830032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.830118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.830192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.830200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.830289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.830371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.830456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.830554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.830616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.830624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.830724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.830820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.830931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.831046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.831125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.831136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.831246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.831346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.831433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.831516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.831579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.831588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.831673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.831752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.831837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.831933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.831997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.832005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.832095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:16.832175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:16.832254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:16.832353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:16.832413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:16.832420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:16.832512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:16.832597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:16.832625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:16.832632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:16.832677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:16.832700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:16.832708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:16.832712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:16.832719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:16.833318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:16.833355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:16.833365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:16.833374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:16.833378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:16.833382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:16.834041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:16.834057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:16.834064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:16.834067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:16.834071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:16.834075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:16.834906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:16.834928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:16.834935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:16.834939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:16.834943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:16.836778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:16.836788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:16.836822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392676836
2025-10-02T08:11:16.836994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:16.837002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:16.837010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:16.837014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:16.837018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:16.837022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:16.837637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:16.837651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:16.837657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:16.837663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:16.837667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:16.837671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:16.838400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:16.838419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:16.838434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:16.838437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:16.838441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:16.838445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:16.839075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:16.839088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:16.839097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:16.840745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:16.840768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:16.840775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:16.840780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:16.840791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392676840
2025-10-02T08:11:16.841169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:16.841184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:16.841191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:16.841195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:16.841200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:16.841204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:16.841787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:16.841800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:16.841807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:16.841812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:16.841816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:16.841824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:16.842408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:16.842418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:16.842536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392676842
2025-10-02T08:11:16.848494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534005640652086:5853]
2025-10-02T08:11:16.848730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1130, pipe: [1:7556534005640652086:5853]
2025-10-02T08:11:16.854660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534005640652086:5853], now have 1 active actors on pipe
2025-10-02T08:11:16.854687Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:16.854736Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:16.854746Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:16.854757Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:16.854771Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:16.854774Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:16.854777Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:16.854788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534005640652056:5338]
2025-10-02T08:11:16.854795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534005640652056:5338]
2025-10-02T08:11:16.854898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:16.854910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:16.854913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:16.855035Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:16.855052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:16.855090Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:17.004100Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:17.004557Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:17.004789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:17.004781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:17.004834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1131 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7940487a-6f479644-a242dad0-7ddae9a5_0
2025-10-02T08:11:17.005001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1131 sessionId: src_id|7940487a-6f479644-a242dad0-7ddae9a5_0 is DEAD
2025-10-02T08:11:17.005145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534005640652086:5853]
2025-10-02T08:11:17.005205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7940487a-6f479644-a242dad0-7ddae9a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:17.005217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7940487a-6f479644-a242dad0-7ddae9a5_0] Write session will restart in 0.006575s
2025-10-02T08:11:17.005243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7940487a-6f479644-a242dad0-7ddae9a5_0] Write session: Do CDS request
2025-10-02T08:11:17.005250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7940487a-6f479644-a242dad0-7ddae9a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:17.007405Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [01929756c34b7c12] Result# TEvPutResult {Id# [72075186224037892:1130:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:17.007427Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1130:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:17.007474Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1130:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:17.013287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7940487a-6f479644-a242dad0-7ddae9a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.013568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:17.013586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1132
2025-10-02T08:11:17.013693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.013723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:17.013731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:17.013734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:17.014083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1132 sessionId:  describe result for acl check
2025-10-02T08:11:17.014113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:17.014121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:17.014122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:17.014126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534009935619869:5314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:17.014473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534009935619869:5314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:17.015673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534009935619869:5314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:17.015765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:17.016652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:17.016775Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:17.016784Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:17.016790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:17.016842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:17.016870Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534009935619940:5316]
2025-10-02T08:11:17.017292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:17.017450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:17.017496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:17.017731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:17.017765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.017773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.017774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.017775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.017776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.017781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.017790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.017793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.017797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.017801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.017812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.017817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.017820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.017828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.017830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.017833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.017836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.017838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.017841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.017844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.017854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:17.018144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534009935619869:5314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:17.018156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534009935619869:5314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:17.018159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534009935619869:5314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:17.018166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:17.025686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:17.027519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:17.027533Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:17.027535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:17.027538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:17.027542Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1131 [1:7556534009935619940:5316]
2025-10-02T08:11:17.027552Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:17.027563Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:17.027571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.027572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.027574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.027585Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:17.027590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:17.027597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:17.027645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.027652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.027654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:17.027656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:17.027706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:17.027713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.027721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.027728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:17.027740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534009935619916:5316]
2025-10-02T08:11:17.027746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534009935619916:5316]
2025-10-02T08:11:17.027751Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:17.027760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:17.027769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:17.027770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:17.027775Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:17.027777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935619957:5314], now have 1 active actors on pipe
2025-10-02T08:11:17.027778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:17.027780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534010395623568:2378], now have 1 active actors on pipe
2025-10-02T08:11:17.027791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1131
2025-10-02T08:11:17.027802Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534009935619916:5316]
2025-10-02T08:11:17.027804Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:17.027806Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:17.027807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.027810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.027839Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:17.027860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.027863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.027865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:17.027873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.027882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:17.027901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.027893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1131
2025-10-02T08:11:17.027938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.027944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.027953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.027987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1132 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0
2025-10-02T08:11:17.028354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7940487a-6f479644-a242dad0-7ddae9a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:17.031319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0] Write session: try to update token
2025-10-02T08:11:17.031336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:17.044721Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:17.044739Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:17.044741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:17.044749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534009935619916:5316]
2025-10-02T08:11:17.044754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534009935619916:5316]
2025-10-02T08:11:17.044789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:17.044793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:17.044794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:17.044817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.044820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:17.044971Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:17.045840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId: src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:17.048493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:17.105480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534009935619974:5853]
2025-10-02T08:11:17.105587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1131, pipe: [1:7556534009935619974:5853]
2025-10-02T08:11:17.177157Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:17.177357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.177367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.177397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935619974:5853], now have 1 active actors on pipe
2025-10-02T08:11:17.177523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:17.177533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:17.177568Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:17.177601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1132 reason: error at write: Disconnected sessionId: src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0
2025-10-02T08:11:17.177668Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:17.177786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534009935619974:5853]
2025-10-02T08:11:17.177788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1132 sessionId: src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0 is DEAD
2025-10-02T08:11:17.177915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:17.177924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0] Write session will restart in 0.009720s
2025-10-02T08:11:17.177942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0] Write session: Do CDS request
2025-10-02T08:11:17.177947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:17.187498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:17.188246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:17.188305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.188374Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:17.188382Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:17.188389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:17.188391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:17.188395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1133
2025-10-02T08:11:17.188419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:17.188443Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534009935620447:5293]
2025-10-02T08:11:17.188512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.188534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:17.188537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:17.188540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:17.188865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1133 sessionId:  describe result for acl check
2025-10-02T08:11:17.188895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:17.188901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:17.188903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:17.188906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:17.188908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534009935620452:5299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:17.189056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:17.189092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:17.189318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534009935620452:5299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:17.189353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:17.189400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.189405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.189407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.189408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.189409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.189413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.189421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.189425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.189428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.189431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.189436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.189442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.189448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.189458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.189466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.189475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.189483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.189488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.189496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.189499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.189511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:17.191236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534009935620452:5299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:17.196849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534009935620452:5299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:17.196864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534009935620452:5299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:17.196867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534009935620452:5299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:17.196876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:17.197351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:17.198993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:17.199008Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:17.199011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:17.199014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:17.199019Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1132 [1:7556534009935620447:5293]
2025-10-02T08:11:17.199031Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:17.199045Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:17.199047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.199050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.199052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.199066Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:17.199075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:17.199081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:17.199140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.199147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.199150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:17.199152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:17.199212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:17.199219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.199231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.199245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:17.199265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935620495:5299], now have 1 active actors on pipe
2025-10-02T08:11:17.199272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534010395623584:2378], now have 1 active actors on pipe
2025-10-02T08:11:17.199278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534009935620441:5293]
2025-10-02T08:11:17.199278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1132
2025-10-02T08:11:17.199282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534009935620441:5293]
2025-10-02T08:11:17.199289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:17.199297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:17.199300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:17.199304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:17.199313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:17.199315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:17.199321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.199325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.199363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534009935620441:5293]
2025-10-02T08:11:17.199374Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:17.199381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:17.199393Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:17.199403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.199412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.199414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:17.199422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.199322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1132
2025-10-02T08:11:17.199434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:17.199473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.199519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.199526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.199539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.199574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1133 partition: 0 MaxSeqNo: 17 sessionId: src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0
2025-10-02T08:11:17.199889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf0956-7e77e378-27e4f777-93f7bc2a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:17.202629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0] Write session: try to update token
2025-10-02T08:11:17.202648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:17.216554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId: src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:17.217480Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:17.217494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:17.217497Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:17.217503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534009935620441:5293]
2025-10-02T08:11:17.217508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534009935620441:5293]
2025-10-02T08:11:17.217548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:17.217559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.217562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:17.217651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:17.217661Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:17.217703Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:17.218854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:17.278026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534009935620511:5853]
2025-10-02T08:11:17.278147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1132, pipe: [1:7556534009935620511:5853]
2025-10-02T08:11:17.352881Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:17.353282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.353293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.353327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935620511:5853], now have 1 active actors on pipe
2025-10-02T08:11:17.353476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534009935620511:5853]
2025-10-02T08:11:17.353483Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:17.353505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:17.353574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1133 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0
2025-10-02T08:11:17.353614Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:17.353755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1133 sessionId: src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0 is DEAD
2025-10-02T08:11:17.353879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:17.353884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0] Write session will restart in 0.008771s
2025-10-02T08:11:17.353901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0] Write session: Do CDS request
2025-10-02T08:11:17.353906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:17.364249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.364364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:17.364381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1134
2025-10-02T08:11:17.364480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.364508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:17.364517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:17.364524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:17.364984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1134 sessionId:  describe result for acl check
2025-10-02T08:11:17.365029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:17.365032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:17.365033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:17.365038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534009935620962:5291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:17.365537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534009935620962:5291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:17.366863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:17.367620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534009935620962:5291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:17.367771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:17.367959Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:17.367972Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:17.367982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:17.368045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:17.368084Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534009935621013:5287]
2025-10-02T08:11:17.368648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:17.368883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:17.368929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:17.369209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:17.369257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.369262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.369263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.369264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.369265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.369269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.369278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.369282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.369291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.369294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.369299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.369305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.369317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.369321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.369325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.369329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.369333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.369337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.369341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.369349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.369368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:17.370116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534009935620962:5291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:17.370128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534009935620962:5291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:17.370131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534009935620962:5291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:17.370138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:17.377166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:17.378788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:17.378802Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:17.378803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:17.378806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:17.378810Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1133 [1:7556534009935621013:5287]
2025-10-02T08:11:17.378820Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:17.378832Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:17.378834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.378836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.378837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.378850Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:17.378853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:17.378858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:17.378902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.378903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.378905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:17.378906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:17.378953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:17.378958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.378967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.378973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:17.378986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935621035:5291], now have 1 active actors on pipe
2025-10-02T08:11:17.378995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534009935621002:5287]
2025-10-02T08:11:17.378996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534009935621002:5287]
2025-10-02T08:11:17.379001Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:17.378997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1133
2025-10-02T08:11:17.379009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:17.379013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:17.379016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:17.379017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:17.379018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:17.379023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.379026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.379036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534010395623591:2378], now have 1 active actors on pipe
2025-10-02T08:11:17.379060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534009935621002:5287]
2025-10-02T08:11:17.379070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:17.379081Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ba447c5-26228158-5bdc57f3-412f840a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:17.379083Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:17.379085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.379088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.379090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:17.379096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.379106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:17.379131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.379189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.379195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.379158Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1133
2025-10-02T08:11:17.379210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.379241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1134 partition: 0 MaxSeqNo: 17 sessionId: src_id|7ba447c5-26228158-5bdc57f3-412f840a_0
2025-10-02T08:11:17.379569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99e8343b-74ada1cc-3cc09a3b-85d0323d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7ba447c5-26228158-5bdc57f3-412f840a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:17.382023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ba447c5-26228158-5bdc57f3-412f840a_0] Write session: try to update token
2025-10-02T08:11:17.382035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ba447c5-26228158-5bdc57f3-412f840a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:17.395497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId: src_id|7ba447c5-26228158-5bdc57f3-412f840a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:17.396968Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:17.396982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:17.396984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:17.396990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534009935621002:5287]
2025-10-02T08:11:17.396995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534009935621002:5287]
2025-10-02T08:11:17.397028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:17.397036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.397038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:17.397056Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:17.397072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:17.397168Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:17.397874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:17.453654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534009935621050:5853]
2025-10-02T08:11:17.453803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1133, pipe: [1:7556534009935621050:5853]
2025-10-02T08:11:17.533758Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:17.534105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.534118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.534152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935621050:5853], now have 1 active actors on pipe
2025-10-02T08:11:17.534253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534009935621050:5853]
2025-10-02T08:11:17.534270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:17.534271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:17.534311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1134 reason: error at write: Disconnected sessionId: src_id|7ba447c5-26228158-5bdc57f3-412f840a_0
2025-10-02T08:11:17.534363Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:17.534384Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:17.534451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1134 sessionId: src_id|7ba447c5-26228158-5bdc57f3-412f840a_0 is DEAD
2025-10-02T08:11:17.534571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ba447c5-26228158-5bdc57f3-412f840a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:17.534579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ba447c5-26228158-5bdc57f3-412f840a_0] Write session will restart in 0.008227s
2025-10-02T08:11:17.534604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ba447c5-26228158-5bdc57f3-412f840a_0] Write session: Do CDS request
2025-10-02T08:11:17.534611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ba447c5-26228158-5bdc57f3-412f840a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:17.544264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ba447c5-26228158-5bdc57f3-412f840a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.544314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:17.544327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1135
2025-10-02T08:11:17.544497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.544532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:17.544541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:17.544545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:17.545030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1135 sessionId:  describe result for acl check
2025-10-02T08:11:17.545060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:17.545064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:17.545067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:17.545072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534009935621494:5284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:17.545581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534009935621494:5284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:17.547423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:17.547665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534009935621494:5284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:17.548679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:17.548868Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:17.548877Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:17.548886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:17.548932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:17.548965Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534009935621564:5283]
2025-10-02T08:11:17.549643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:17.549804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:17.549838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:17.550139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:17.550174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.550179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.550180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.550182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.550183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.550187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.550197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.550201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.550204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.550208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.550213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.550219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.550225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.550230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.550234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.550239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.550243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.550248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.550252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.550257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.550275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:17.550291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534009935621494:5284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:17.550301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534009935621494:5284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:17.550304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534009935621494:5284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:17.550315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:17.558443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:17.560358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:17.560379Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:17.560382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:17.560386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:17.560392Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1134 [1:7556534009935621564:5283]
2025-10-02T08:11:17.560405Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:17.560422Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:17.560426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.560429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.560431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.560447Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:17.560453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:17.560460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:17.560529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.560538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.560541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:17.560543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:17.560613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:17.560622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.560636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.560649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:17.560668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534009935621548:5283]
2025-10-02T08:11:17.560675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534009935621548:5283]
2025-10-02T08:11:17.560682Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:17.560695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:17.560698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:17.560702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:17.560712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:17.560713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1134
2025-10-02T08:11:17.560714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:17.560725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935621579:5284], now have 1 active actors on pipe
2025-10-02T08:11:17.560734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534010395623597:2378], now have 1 active actors on pipe
2025-10-02T08:11:17.560766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534009935621548:5283]
2025-10-02T08:11:17.560782Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:17.560791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.560796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:17.560796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.560829Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1134
2025-10-02T08:11:17.560906Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:17.560919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.560923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.560926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:17.560936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.560945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:17.560968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.561005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.561015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.561028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.561077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1135 partition: 0 MaxSeqNo: 17 sessionId: src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0
2025-10-02T08:11:17.561422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ba447c5-26228158-5bdc57f3-412f840a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:17.564027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0] Write session: try to update token
2025-10-02T08:11:17.564040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:17.577549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId: src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:17.578346Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:17.578359Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:17.578361Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:17.578368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534009935621548:5283]
2025-10-02T08:11:17.578371Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534009935621548:5283]
2025-10-02T08:11:17.578403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:17.578409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.578411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:17.578439Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:17.578453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:17.578539Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:17.580250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:17.634361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534009935621597:5853]
2025-10-02T08:11:17.634502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1134, pipe: [1:7556534009935621597:5853]
2025-10-02T08:11:17.714231Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:17.714616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.714626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.714656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935621597:5853], now have 1 active actors on pipe
2025-10-02T08:11:17.714764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:17.714774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:17.714786Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:17.714837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1135 reason: error at write: Disconnected sessionId: src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0
2025-10-02T08:11:17.714844Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:17.715044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1135 sessionId: src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0 is DEAD
2025-10-02T08:11:17.715052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534009935621597:5853]
2025-10-02T08:11:17.715173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:17.715183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0] Write session will restart in 0.007322s
2025-10-02T08:11:17.715201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0] Write session: Do CDS request
2025-10-02T08:11:17.715206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:17.723295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.723351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:17.723364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1136
2025-10-02T08:11:17.723529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.723560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:17.723567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:17.723570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:17.723961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1136 sessionId:  describe result for acl check
2025-10-02T08:11:17.723994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:17.724001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:17.724002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:17.724006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534009935622042:5248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:17.724495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534009935622042:5248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:17.726146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:17.726151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534009935622042:5248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:17.726937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:17.727069Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:17.727076Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:17.727084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:17.727118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:17.727141Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534009935622112:5254]
2025-10-02T08:11:17.727534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:17.727655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:17.727680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:17.727889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:17.727920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.727924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.727925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.727926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.727926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.727929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.727935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.727938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.727940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.727942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.727945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.727949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.727952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.727955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.727958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.727960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.727962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.727965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.727968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.727970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.727981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:17.728162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534009935622042:5248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:17.728177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534009935622042:5248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:17.728180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534009935622042:5248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:17.728196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:17.736011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:17.737624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:17.737639Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:17.737641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:17.737645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:17.737650Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1135 [1:7556534009935622112:5254]
2025-10-02T08:11:17.737663Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:17.737679Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:17.737682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.737685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.737688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.737703Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:17.737707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:17.737715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:17.737766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.737773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.737777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:17.737780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:17.737837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:17.737844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.737857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.737874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:17.737873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1135
2025-10-02T08:11:17.737895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935622129:5248], now have 1 active actors on pipe
2025-10-02T08:11:17.737902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534010395623605:2378], now have 1 active actors on pipe
2025-10-02T08:11:17.737906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.737915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.737931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534009935622095:5254]
2025-10-02T08:11:17.737937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534009935622095:5254]
2025-10-02T08:11:17.737948Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:17.737963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:17.737968Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:17.737972Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:17.737981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:17.737987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:17.737962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1135
2025-10-02T08:11:17.738001Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:17.738010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.738014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.738019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:17.738030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.738041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:17.738076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534009935622095:5254]
2025-10-02T08:11:17.738087Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:17.738104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.738117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:17.738149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.738155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.738168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.738204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1136 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0
2025-10-02T08:11:17.738531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d3b711-ef34cdac-afcfe86f-cd3366c4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:17.740967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0] Write session: try to update token
2025-10-02T08:11:17.740980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:17.748711Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:17.748729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:17.748738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534009935622095:5254]
2025-10-02T08:11:17.748779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:17.748796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:17.748959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:17.749107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:17.749258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:17.749398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:17.749595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:17.749641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:17.754065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId: src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:17.756416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:17.756471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.756482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.756508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:17.756527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:17.756572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.756585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.756735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.756811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.756876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.756950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.757258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.757272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.757349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.757413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.757482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.757574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.757621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.757629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.757702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.757769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.757838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.757903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.757951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.757959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.758028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.758092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.758162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.758234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.758283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.758290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.758358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.758427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.758495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.758569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.758617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.758625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.758692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.758755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.758822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.758891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.758937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.758944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.759014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.759079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.759154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.759224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.759276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.759286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.759356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.759425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.759493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.759562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.759607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.759614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.759685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.759755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.759824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.759911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.759961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.759968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.760034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:17.760098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:17.760166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:17.760230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:17.760276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:17.760283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:17.760326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:17.760397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.760420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.760427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:17.760463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:17.760479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:17.760486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:17.760489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:17.760496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:17.760939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:17.760968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:17.760975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:17.760981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:17.760984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:17.760988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:17.761551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:17.761572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:17.761576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:17.761579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:17.761581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:17.761583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:17.762033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:17.762050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:17.762053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:17.762055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:17.762057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:17.763226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:17.763241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:17.763250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392677762
2025-10-02T08:11:17.763390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:17.763412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:17.763420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:17.763422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:17.763424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:17.763428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:17.763876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:17.763891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:17.763895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:17.763897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:17.763899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:17.763902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:17.764312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:17.764328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:17.764334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:17.764340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:17.764342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:17.764344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:17.764782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:17.764796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:17.764812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:17.765833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:17.765849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:17.765864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:17.765871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:17.765879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392677765
2025-10-02T08:11:17.766143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:17.766157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:17.766161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:17.766167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:17.766170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:17.766172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:17.766590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:17.766606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:17.766609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:17.766611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:17.766616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:17.766619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:17.767027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:17.767041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.767119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392677766
2025-10-02T08:11:17.769032Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:17.769055Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:17.769061Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:17.769067Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:17.770575Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:17.770587Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:17.770589Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:17.770595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534009935622095:5254]
2025-10-02T08:11:17.770598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534009935622095:5254]
2025-10-02T08:11:17.770645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:17.770652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.770654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:17.770657Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:17.770664Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:17.770775Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:17.815295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534009935622150:5853]
2025-10-02T08:11:17.815422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1135, pipe: [1:7556534009935622150:5853]
2025-10-02T08:11:17.901873Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:17.902638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935622150:5853], now have 1 active actors on pipe
2025-10-02T08:11:17.902702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534009935622150:5853]
2025-10-02T08:11:17.902719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:17.902723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:17.902745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1136 reason: error at write: Disconnected sessionId: src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0
2025-10-02T08:11:17.902830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:17.902905Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:17.902908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1136 sessionId: src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0 is DEAD
2025-10-02T08:11:17.903171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:17.903179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0] Write session will restart in 0.007950s
2025-10-02T08:11:17.903202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0] Write session: Do CDS request
2025-10-02T08:11:17.903207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:17.912298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.912394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:17.912412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1137
2025-10-02T08:11:17.912539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:17.912562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:17.912569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:17.912572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:17.913044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1137 sessionId:  describe result for acl check
2025-10-02T08:11:17.913075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:17.913076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:17.913078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:17.913081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534009935622629:5238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:17.913187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:17.913433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534009935622629:5238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:17.914000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:17.914149Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:17.914156Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:17.914162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:17.914191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:17.914217Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534009935622649:5236]
2025-10-02T08:11:17.914699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:17.914812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:17.914835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:17.914916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534009935622629:5238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:17.915060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:17.915088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.915092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.915093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.915094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.915094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.915097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.915103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.915105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.915107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.915109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.915112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.915116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:17.915119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.915122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:17.915124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.915126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:17.915128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.915130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.915133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.915135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.915144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:17.920951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534009935622629:5238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:17.920960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534009935622629:5238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:17.920962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534009935622629:5238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:17.920967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:17.926259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:17.927989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:17.928002Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:17.928003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:17.928006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:17.928011Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1136 [1:7556534009935622649:5236]
2025-10-02T08:11:17.928019Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:17.928032Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:17.928033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.928035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.928036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.928049Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:17.928052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:17.928058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:17.928101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.928107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.928110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:17.928112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:17.928162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:17.928167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.928176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:17.928182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:17.928194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534009935622630:5236]
2025-10-02T08:11:17.928196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534009935622630:5236]
2025-10-02T08:11:17.928201Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:17.928210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:17.928218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:17.928220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:17.928221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1136
2025-10-02T08:11:17.928222Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:17.928225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:17.928227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534009935622682:5238], now have 1 active actors on pipe
2025-10-02T08:11:17.928252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534010395623625:2378], now have 1 active actors on pipe
2025-10-02T08:11:17.928254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534009935622630:5236]
2025-10-02T08:11:17.928259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:17.928263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:17.928264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.928267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.928298Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:17.928305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:17.928308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:17.928309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:17.928316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:17.928322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:17.928310Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1136
2025-10-02T08:11:17.928337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.928368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:17.928373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:17.928382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:17.928410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1137 partition: 0 MaxSeqNo: 17 sessionId: src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0
2025-10-02T08:11:17.928737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4253dc-e433cc74-795578bc-6d3e0028_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:17.933087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0] Write session: try to update token
2025-10-02T08:11:17.933103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:17.946638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId: src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:17.947096Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:17.947117Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:17.947119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:17.947125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534009935622630:5236]
2025-10-02T08:11:17.947129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534009935622630:5236]
2025-10-02T08:11:17.947162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:17.947167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:17.947168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:17.947218Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:17.947227Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:17.947298Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:17.949325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:18.003012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534014230590003:5853]
2025-10-02T08:11:18.003099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1136, pipe: [1:7556534014230590003:5853]
2025-10-02T08:11:18.073863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:18.074132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:18.074142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0] Write session will restart in 0.008969s
2025-10-02T08:11:18.074166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0] Write session: Do CDS request
2025-10-02T08:11:18.074174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:18.073212Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:18.073565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.073572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.073612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230590003:5853], now have 1 active actors on pipe
2025-10-02T08:11:18.073721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:18.073724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:18.073789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1137 reason: error at write: Disconnected sessionId: src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0
2025-10-02T08:11:18.073814Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:18.073977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1137 sessionId: src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0 is DEAD
2025-10-02T08:11:18.074108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534014230590003:5853]
2025-10-02T08:11:18.084428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.084533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:18.084559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1138
2025-10-02T08:11:18.084720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.084763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:18.084771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:18.084775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:18.085309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1138 sessionId:  describe result for acl check
2025-10-02T08:11:18.085370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:18.085377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:18.085379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:18.085386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534014230590453:5188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:18.086035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534014230590453:5188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:18.088474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534014230590453:5188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:18.091306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:18.092753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:18.093139Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:18.093149Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:18.093163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:18.093223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:18.093265Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534014230590557:5182]
2025-10-02T08:11:18.093265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534014230590453:5188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:18.093273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534014230590453:5188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:18.093277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534014230590453:5188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:18.093286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:18.093862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:18.094072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:18.094140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:18.094496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:18.094561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.094567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.094569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.094570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.094571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.094576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.094587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.094591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.094596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.094600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.094605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.094612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.094618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.094623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.094630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.094635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.094641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.094648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.094652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.094659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.094679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:18.104840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:18.106567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:18.106593Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:18.106596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:18.106600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:18.106608Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1137 [1:7556534014230590557:5182]
2025-10-02T08:11:18.106627Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:18.106646Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:18.106649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.106653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.106655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.106672Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:18.106678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:18.106685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:18.106758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.106772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.106775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:18.106778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:18.106908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1137
2025-10-02T08:11:18.107003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:18.107015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.107033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.107049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:18.107034Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1137
2025-10-02T08:11:18.107075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230590562:5188], now have 1 active actors on pipe
2025-10-02T08:11:18.107084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534014690590952:2378], now have 1 active actors on pipe
2025-10-02T08:11:18.107089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.107094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.107112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534014230590549:5182]
2025-10-02T08:11:18.107118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534014230590549:5182]
2025-10-02T08:11:18.107131Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:18.107148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:18.107151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:18.107161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:18.107176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:18.107179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:18.107207Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:18.107219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.107222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.107225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:18.107234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.107245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:18.107289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534014230590549:5182]
2025-10-02T08:11:18.107302Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:18.107311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:18.107320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.107380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.107389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.107405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.107451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1138 partition: 0 MaxSeqNo: 17 sessionId: src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0
2025-10-02T08:11:18.107916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442f7dc6-543fb6ba-79ca27d0-60444e6a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:18.111070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0] Write session: try to update token
2025-10-02T08:11:18.111098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:18.121394Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:18.121413Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:18.121423Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534014230590549:5182]
2025-10-02T08:11:18.121468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:18.121470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:18.121684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:18.121850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:18.122011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:18.122161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:18.122395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:18.122444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:18.127434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId: src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:18.129073Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:11:18.129105Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-02T08:11:18.129462Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:11:18.129776Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 8 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:11:18.129846Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:11:18.130751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:18.130816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.130834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.130869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:18.130894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:18.130965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.130985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.131186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.131255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.131321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.131398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.131565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.131574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.131647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.131711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.131783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.131882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.131930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.131937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.132006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.132070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.132131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.132196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.132266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.132272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.132340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.132406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.132473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.132539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.132586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.132592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.132658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.132721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.132787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.132881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.132934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.132942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.133023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.133086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.133156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.133222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.133268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.133274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.133341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.133405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.133503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.133572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.133697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.133705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.133773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.133836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.133902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.133968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.134015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.134021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.134087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.134151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.134216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.134281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.134334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.134341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.134407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:18.134471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:18.134537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:18.134607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:18.134653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:18.134660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:18.134700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:18.134770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.134790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.134793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:18.134821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:18.134836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:18.134843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:18.134846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:18.134848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:18.135260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:18.135281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:18.135292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:18.135298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:18.135301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:18.135303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:18.136097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:18.136121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:18.136128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:18.136135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:18.136137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:18.136139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:18.136707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:18.136731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:18.136741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:18.136747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:18.136750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:18.138742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:18.138759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:18.138771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392678138
2025-10-02T08:11:18.138868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:18.138878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:18.138882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:18.138884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:18.138889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:18.138892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:18.139363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:18.139383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:18.139386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:18.139389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:18.139390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:18.139393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:18.139809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:18.139826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:18.139832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:18.139834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:18.139836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:18.139839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:18.140298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:18.140316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:18.140320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:18.141339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:18.141353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:18.141356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:18.141359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:18.141364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392678141
2025-10-02T08:11:18.141644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:18.141660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:18.141664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:18.141665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:18.141667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:18.141669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:18.142067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:18.142082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:18.142086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:18.142097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:18.142103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:18.142105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:18.142515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:18.142530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.142601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392678142
2025-10-02T08:11:18.145856Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:18.145872Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:18.145876Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:18.145881Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:18.147410Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:18.147419Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:18.147420Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:18.147427Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534014230590549:5182]
2025-10-02T08:11:18.147429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534014230590549:5182]
2025-10-02T08:11:18.147478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:18.147486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.147488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:18.147488Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:18.147494Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:18.147612Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:18.172976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534014230590596:5853]
2025-10-02T08:11:18.173069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1137, pipe: [1:7556534014230590596:5853]
2025-10-02T08:11:18.274871Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:18.275174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230590596:5853], now have 1 active actors on pipe
2025-10-02T08:11:18.275279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:18.275284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:18.275302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1138 reason: error at write: Disconnected sessionId: src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0
2025-10-02T08:11:18.275382Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:18.275419Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:18.275443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1138 sessionId: src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0 is DEAD
2025-10-02T08:11:18.275440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T08:11:18.275583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534014230590596:5853]
2025-10-02T08:11:18.275595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:18.275601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0] Write session will restart in 0.005654s
2025-10-02T08:11:18.275620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0] Write session: Do CDS request
2025-10-02T08:11:18.275625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:18.282244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.282423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:18.282436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1139
2025-10-02T08:11:18.282523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.282550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:18.282559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:18.282562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:18.282867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1139 sessionId:  describe result for acl check
2025-10-02T08:11:18.282890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:18.282891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:18.282892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:18.282895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534014230590952:5178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:18.283326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534014230590952:5178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:18.286044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534014230590952:5178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:18.286718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:18.287688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:18.287942Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:18.287950Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:18.287958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:18.288007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:18.288042Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534014230591117:5169]
2025-10-02T08:11:18.288250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534014230590952:5178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:18.288259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534014230590952:5178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:18.288261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534014230590952:5178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:18.288266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:18.288581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:18.288723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:18.288757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:18.289035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:18.289067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.289072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.289072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.289073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.289073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.289076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.289082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.289084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.289086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.289088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.289092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.289095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.289100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.289102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.289104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.289107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.289109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.289112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.289114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.289117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.289127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:18.296400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:18.297786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:18.297800Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:18.297802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:18.297805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:18.297810Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1138 [1:7556534014230591117:5169]
2025-10-02T08:11:18.297817Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:18.297831Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:18.297837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.297839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.297841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.297853Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:18.297860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:18.297864Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:18.297909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.297914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.297917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:18.297918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:18.297970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:18.297978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.297989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.298001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:18.298017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534014690590964:2378], now have 1 active actors on pipe
2025-10-02T08:11:18.298027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534014230591109:5169]
2025-10-02T08:11:18.298030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534014230591109:5169]
2025-10-02T08:11:18.298042Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:18.298054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230591122:5178], now have 1 active actors on pipe
2025-10-02T08:11:18.298057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1138
2025-10-02T08:11:18.298059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:18.298061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:18.298065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:18.298077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:18.298080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:18.298076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1138
2025-10-02T08:11:18.298108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.298116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.298128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534014230591109:5169]
2025-10-02T08:11:18.298138Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:18.298143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:18.298180Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:18.298190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.298194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.298198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:18.298206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.298217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:18.298269Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:11:18.298295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.298388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.298396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.298411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.298442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1139 partition: 0 MaxSeqNo: 17 sessionId: src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0
2025-10-02T08:11:18.298471Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 9 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:11:18.298497Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:11:18.298756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1082f-e2abfa6f-93fb502e-d834aa43_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:18.301376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0] Write session: try to update token
2025-10-02T08:11:18.301395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:18.314719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId: src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:18.315394Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:18.315405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:18.315407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:18.315414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534014230591109:5169]
2025-10-02T08:11:18.315417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534014230591109:5169]
2025-10-02T08:11:18.315448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:18.315456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.315458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:18.315462Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:18.315474Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:18.315579Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:18.317296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:18.375773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534014230591149:5853]
2025-10-02T08:11:18.375921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1138, pipe: [1:7556534014230591149:5853]
2025-10-02T08:11:18.439503Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:18.439789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.439799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.439832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230591149:5853], now have 1 active actors on pipe
2025-10-02T08:11:18.439953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:18.439965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:18.440017Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:18.440026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1139 reason: error at write: Disconnected sessionId: src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0
2025-10-02T08:11:18.440074Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:18.440213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1139 sessionId: src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0 is DEAD
2025-10-02T08:11:18.440246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534014230591149:5853]
2025-10-02T08:11:18.440349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:18.440356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0] Write session will restart in 0.006972s
2025-10-02T08:11:18.440382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0] Write session: Do CDS request
2025-10-02T08:11:18.440389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:18.448345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.448523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:18.448540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1140
2025-10-02T08:11:18.448678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.448708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:18.448717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:18.448721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:18.449098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1140 sessionId:  describe result for acl check
2025-10-02T08:11:18.449145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:18.449150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:18.449151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:18.449156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534014230591625:5172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:18.449564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534014230591625:5172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:18.451463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534014230591625:5172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:18.451786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:18.452095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:18.452229Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:18.452236Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:18.452242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:18.452278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:18.452313Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534014230591671:5174]
2025-10-02T08:11:18.452710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:18.452878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:18.452935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:18.453247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:18.453295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.453300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.453301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.453303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.453304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.453309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.453319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.453326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.453330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.453337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.453342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.453352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.453360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.453365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.453368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.453373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.453378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.453381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.453386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.453390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.453408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:18.453839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534014230591625:5172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:18.453849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534014230591625:5172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:18.453852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534014230591625:5172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:18.453860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:18.461555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:18.463157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:18.463171Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:18.463173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:18.463175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:18.463181Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1139 [1:7556534014230591671:5174]
2025-10-02T08:11:18.463189Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:18.463208Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:18.463213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.463215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.463217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.463228Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:18.463231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:18.463235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:18.463296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.463301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.463303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:18.463305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:18.463357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:18.463362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.463371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.463377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:18.463394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230591688:5172], now have 1 active actors on pipe
2025-10-02T08:11:18.463396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1139
2025-10-02T08:11:18.463402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534014230591657:5174]
2025-10-02T08:11:18.463403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534014230591657:5174]
2025-10-02T08:11:18.463408Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:18.463417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:18.463417Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:18.463423Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:18.463429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:18.463431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:18.463436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.463438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.463448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534014690590973:2378], now have 1 active actors on pipe
2025-10-02T08:11:18.463478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534014230591657:5174]
2025-10-02T08:11:18.463491Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:18.463497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:18.463509Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:18.463516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.463519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.463520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:18.463525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.463532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:18.463505Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1139
2025-10-02T08:11:18.463565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.463619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.463624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.463634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.463665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1140 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0
2025-10-02T08:11:18.464094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1189c56a-ce91afe5-1b48bec1-653129b6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:18.466716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0] Write session: try to update token
2025-10-02T08:11:18.466734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:18.480476Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:18.480488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:18.480489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:18.480496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534014230591657:5174]
2025-10-02T08:11:18.480499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534014230591657:5174]
2025-10-02T08:11:18.480530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:18.480535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.480538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:18.480539Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:18.480544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:18.480656Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:18.480942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId: src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:18.483325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:18.540634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534014230591704:5853]
2025-10-02T08:11:18.540736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1139, pipe: [1:7556534014230591704:5853]
2025-10-02T08:11:18.605241Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:18.605499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.605516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.605552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230591704:5853], now have 1 active actors on pipe
2025-10-02T08:11:18.605668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534014230591704:5853]
2025-10-02T08:11:18.605702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:18.605710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:18.605770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1140 reason: error at write: Disconnected sessionId: src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0
2025-10-02T08:11:18.605770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:18.605741Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:18.605945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1140 sessionId: src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0 is DEAD
2025-10-02T08:11:18.606080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:18.606090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0] Write session will restart in 0.006259s
2025-10-02T08:11:18.606116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0] Write session: Do CDS request
2025-10-02T08:11:18.606123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:18.613323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.613359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:18.613379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1141
2025-10-02T08:11:18.613531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.613567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:18.613577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:18.613581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:18.613978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1141 sessionId:  describe result for acl check
2025-10-02T08:11:18.614029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:18.614035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:18.614038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:18.614043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534014230592060:5152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:18.614568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534014230592060:5152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:18.617383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534014230592060:5152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:18.619281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:18.619676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:18.619890Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:18.619898Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:18.619908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:18.619946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:18.619974Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534014230592228:5151]
2025-10-02T08:11:18.620055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534014230592060:5152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:18.620064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534014230592060:5152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:18.620066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534014230592060:5152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:18.620072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:18.620419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:18.620571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:18.620601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:18.620792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:18.620839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.620844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.620844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.620845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.620846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.620849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.620855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.620857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.620859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.620861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.620865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.620869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.620873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.620876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.620878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.620883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.620887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.620891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.620895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.620901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.620921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:18.630634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:18.632494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:18.632514Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:18.632516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:18.632520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:18.632527Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1140 [1:7556534014230592228:5151]
2025-10-02T08:11:18.632538Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:18.632556Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:18.632559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.632562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.632563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.632581Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:18.632591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:18.632598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:18.632668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.632674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.632677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:18.632679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:18.632746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:18.632753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.632767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.632781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:18.632828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534014690590981:2378], now have 1 active actors on pipe
2025-10-02T08:11:18.632836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1140
2025-10-02T08:11:18.632841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534014230592222:5151]
2025-10-02T08:11:18.632843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534014230592222:5151]
2025-10-02T08:11:18.632850Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:18.632858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230592233:5152], now have 1 active actors on pipe
2025-10-02T08:11:18.632860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:18.632863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:18.632865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:18.632878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:18.632881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:18.632887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.632892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.632933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534014230592222:5151]
2025-10-02T08:11:18.632905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1140
2025-10-02T08:11:18.632941Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:18.632943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:18.632956Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71b77644-993faa6-e7db918c-7450a6f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:18.632962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.632970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.632972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:18.632981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.632992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:18.633038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.633082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.633088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.633101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.633144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1141 partition: 0 MaxSeqNo: 17 sessionId: src_id|71b77644-993faa6-e7db918c-7450a6f1_0
2025-10-02T08:11:18.633493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4a3f57-482b7ba-ab87f03a-fb6e0fa0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|71b77644-993faa6-e7db918c-7450a6f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:18.635916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b77644-993faa6-e7db918c-7450a6f1_0] Write session: try to update token
2025-10-02T08:11:18.635930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b77644-993faa6-e7db918c-7450a6f1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:18.649343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId: src_id|71b77644-993faa6-e7db918c-7450a6f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:18.651781Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:18.651799Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:18.651801Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:18.651810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534014230592222:5151]
2025-10-02T08:11:18.651814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534014230592222:5151]
2025-10-02T08:11:18.651848Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:18.651861Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:18.651871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:18.651879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.651885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:18.652015Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:18.652766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:18.705994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534014230592260:5853]
2025-10-02T08:11:18.706083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1140, pipe: [1:7556534014230592260:5853]
2025-10-02T08:11:18.776641Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:18.777111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.777121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.777153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230592260:5853], now have 1 active actors on pipe
2025-10-02T08:11:18.777270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534014230592260:5853]
2025-10-02T08:11:18.777294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:18.777296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:18.777331Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:18.777343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1141 reason: error at write: Disconnected sessionId: src_id|71b77644-993faa6-e7db918c-7450a6f1_0
2025-10-02T08:11:18.777384Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:18.777497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1141 sessionId: src_id|71b77644-993faa6-e7db918c-7450a6f1_0 is DEAD
2025-10-02T08:11:18.777693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b77644-993faa6-e7db918c-7450a6f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:18.777701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b77644-993faa6-e7db918c-7450a6f1_0] Write session will restart in 0.005578s
2025-10-02T08:11:18.777724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b77644-993faa6-e7db918c-7450a6f1_0] Write session: Do CDS request
2025-10-02T08:11:18.777731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b77644-993faa6-e7db918c-7450a6f1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:18.784234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b77644-993faa6-e7db918c-7450a6f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.784303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:18.784317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1142
2025-10-02T08:11:18.784391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.784412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:18.784418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:18.784421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:18.784714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1142 sessionId:  describe result for acl check
2025-10-02T08:11:18.784738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:18.784743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:18.784744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:18.784747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534014230592656:5128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:18.785109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534014230592656:5128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:18.787391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534014230592656:5128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:18.788660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:18.789549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:18.789718Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:18.789726Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:18.789733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:18.789767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:18.789827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534014230592656:5128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:18.789837Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534014230592784:5147]
2025-10-02T08:11:18.789839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534014230592656:5128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:18.789842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534014230592656:5128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:18.789849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:18.790445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:18.790739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:18.790803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:18.791071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:18.791106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.791112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.791113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.791114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.791118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.791122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.791130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.791137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.791139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.791141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.791146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.791151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.791155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.791159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.791161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.791165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.791167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.791170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.791173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.791177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.791187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:18.798677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:18.800476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:18.800491Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:18.800493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:18.800497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:18.800503Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1141 [1:7556534014230592784:5147]
2025-10-02T08:11:18.800514Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:18.800531Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:18.800539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.800542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.800544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.800559Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:18.800566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:18.800579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:18.800647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.800654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.800659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:18.800661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:18.800723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:18.800730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.800740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.800748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:18.800767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534014230592778:5147]
2025-10-02T08:11:18.800773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534014230592778:5147]
2025-10-02T08:11:18.800781Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:18.800792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:18.800797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230592789:5128], now have 1 active actors on pipe
2025-10-02T08:11:18.800819Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:18.800821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1141
2025-10-02T08:11:18.800831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:18.800844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:18.800849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:18.800855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534014690590988:2378], now have 1 active actors on pipe
2025-10-02T08:11:18.800874Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1141
2025-10-02T08:11:18.800893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.800906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.800925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534014230592778:5147]
2025-10-02T08:11:18.800939Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:18.800943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:18.800982Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:18.800995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.800999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.801001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:18.801014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.801024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:18.801048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.801126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.801129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.801142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.801183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1142 partition: 0 MaxSeqNo: 17 sessionId: src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0
2025-10-02T08:11:18.801560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b77644-993faa6-e7db918c-7450a6f1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:18.804205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0] Write session: try to update token
2025-10-02T08:11:18.804219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:18.817219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId: src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:18.817741Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:18.817758Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:18.817761Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:18.817769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534014230592778:5147]
2025-10-02T08:11:18.817773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534014230592778:5147]
2025-10-02T08:11:18.817811Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:18.817817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:18.817820Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:18.817823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.817825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:18.817976Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:18.819352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:18.877534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534014230592814:5853]
2025-10-02T08:11:18.877671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1141, pipe: [1:7556534014230592814:5853]
2025-10-02T08:11:18.946498Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:18.946977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.946991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.947034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230592814:5853], now have 1 active actors on pipe
2025-10-02T08:11:18.947177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534014230592814:5853]
2025-10-02T08:11:18.947210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:18.947217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:18.947222Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:18.947231Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:18.947298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1142 reason: error at write: Disconnected sessionId: src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0
2025-10-02T08:11:18.947485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1142 sessionId: src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0 is DEAD
2025-10-02T08:11:18.947607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:18.947615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0] Write session will restart in 0.007401s
2025-10-02T08:11:18.947638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0] Write session: Do CDS request
2025-10-02T08:11:18.947643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:18.956287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.956363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:18.956381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1143
2025-10-02T08:11:18.956542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:18.956578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:18.956588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:18.956591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:18.957078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1143 sessionId:  describe result for acl check
2025-10-02T08:11:18.957110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:18.957112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:18.957113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:18.957117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534014230593283:5137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:18.957699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534014230593283:5137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:18.958899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:18.960131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534014230593283:5137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:18.960227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:18.960542Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:18.960550Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:18.960559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:18.960606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:18.960641Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534014230593347:5140]
2025-10-02T08:11:18.961125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:18.961273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:18.961302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:18.961550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:18.961590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.961597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.961598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.961599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.961600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.961603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.961610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.961612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.961614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.961616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.961620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.961625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:18.961629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.961632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:18.961634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.961637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:18.961639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.961642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.961646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.961649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.961664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:18.966137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534014230593283:5137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:18.966147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534014230593283:5137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:18.966149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534014230593283:5137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:18.966156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:18.969391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:18.971107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:18.971117Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:18.971119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:18.971122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:18.971128Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1142 [1:7556534014230593347:5140]
2025-10-02T08:11:18.971139Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:18.971157Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:18.971166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.971171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.971173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.971187Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:18.971194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:18.971200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:18.971249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.971255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.971258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:18.971260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:18.971314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:18.971319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.971327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:18.971334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:18.971351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534014230593367:5137], now have 1 active actors on pipe
2025-10-02T08:11:18.971361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534014230593324:5140]
2025-10-02T08:11:18.971361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1142
2025-10-02T08:11:18.971366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534014230593324:5140]
2025-10-02T08:11:18.971376Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:18.971385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534014690591006:2378], now have 1 active actors on pipe
2025-10-02T08:11:18.971394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:18.971390Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:18.971402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:18.971406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:18.971408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:18.971413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.971416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.971403Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1142
2025-10-02T08:11:18.971445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534014230593324:5140]
2025-10-02T08:11:18.971454Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:18.971461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:18.971474Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:18.971480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:18.971487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:18.971488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:18.971495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:18.971502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:18.971527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.971608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:18.971613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:18.971623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:18.971655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1143 partition: 0 MaxSeqNo: 17 sessionId: src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0
2025-10-02T08:11:18.972056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b721f9c9-6e362efb-108b06d0-bc1d75a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:18.974314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0] Write session: try to update token
2025-10-02T08:11:18.974326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:18.987028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId: src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:18.988592Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:18.988609Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:18.988611Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:18.988620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534014230593324:5140]
2025-10-02T08:11:18.988625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534014230593324:5140]
2025-10-02T08:11:18.988669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:18.988680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:18.988682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:18.988753Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:18.988768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:18.988844Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:18.989778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:19.050377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534018525560684:5853]
2025-10-02T08:11:19.050602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1142, pipe: [1:7556534018525560684:5853]
2025-10-02T08:11:19.114448Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:19.114838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.114850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.114894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525560684:5853], now have 1 active actors on pipe
2025-10-02T08:11:19.115051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534018525560684:5853]
2025-10-02T08:11:19.115087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:19.115089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:19.115173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1143 reason: error at write: Disconnected sessionId: src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0
2025-10-02T08:11:19.115143Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:19.115368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1143 sessionId: src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0 is DEAD
2025-10-02T08:11:19.115571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:19.115582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0] Write session will restart in 0.005678s
2025-10-02T08:11:19.115601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0] Write session: Do CDS request
2025-10-02T08:11:19.115608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:19.115723Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:19.122255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.122401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:19.122416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1144
2025-10-02T08:11:19.122701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.122741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:19.122751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:19.122755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:19.123109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1144 sessionId:  describe result for acl check
2025-10-02T08:11:19.123142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:19.123148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:19.123150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:19.123154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534018525561032:5098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:19.123530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534018525561032:5098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:19.126108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534018525561032:5098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:19.128127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:19.129248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:19.129389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534018525561032:5098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:19.129397Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:19.129400Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:19.129404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534018525561032:5098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:19.129408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:19.129408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534018525561032:5098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:19.129417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:19.129440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:19.129478Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534018525561243:5107]
2025-10-02T08:11:19.130135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:19.130393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:19.130435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:19.130738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:19.130774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.130781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.130782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.130783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.130784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.130788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.130797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.130801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.130805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.130809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.130814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.130821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.130832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.130836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.130840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.130850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.130854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.130866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.130876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.130881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.130898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:19.138861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:19.140481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:19.140498Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:19.140500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:19.140503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:19.140509Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1143 [1:7556534018525561243:5107]
2025-10-02T08:11:19.140519Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:19.140533Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:19.140542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.140545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.140547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.140563Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:19.140567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:19.140574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:19.140631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.140639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.140642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:19.140645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:19.140710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:19.140719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.140731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.140743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:19.140765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525561248:5098], now have 1 active actors on pipe
2025-10-02T08:11:19.140773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534018985558333:2378], now have 1 active actors on pipe
2025-10-02T08:11:19.140778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534018525561237:5107]
2025-10-02T08:11:19.140780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534018525561237:5107]
2025-10-02T08:11:19.140790Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:19.140819Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:19.140822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:19.140829Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:19.140836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:19.140839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:19.140863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534018525561237:5107]
2025-10-02T08:11:19.140871Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:19.140873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:19.140847Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1143
2025-10-02T08:11:19.140915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1143
2025-10-02T08:11:19.140944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.140953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.140973Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:19.140987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.140995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.140997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:19.141005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.141012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:19.141031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.141058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.141065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.141076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.141112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1144 partition: 0 MaxSeqNo: 17 sessionId: src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0
2025-10-02T08:11:19.141502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef00cfad-f89a041d-f7542f1b-53ebd04a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:19.144392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0] Write session: try to update token
2025-10-02T08:11:19.144405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:19.157782Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:19.157801Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:19.157804Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:19.157811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534018525561237:5107]
2025-10-02T08:11:19.157815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534018525561237:5107]
2025-10-02T08:11:19.157855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:19.157861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.157863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:19.157866Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:19.157873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:19.157990Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:19.160676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId: src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:19.163091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:19.215419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534018525561274:5853]
2025-10-02T08:11:19.215513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1143, pipe: [1:7556534018525561274:5853]
2025-10-02T08:11:19.298394Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:19.298804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.298818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.298861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525561274:5853], now have 1 active actors on pipe
2025-10-02T08:11:19.298954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:19.298959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:19.298974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534018525561274:5853]
2025-10-02T08:11:19.299010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1144 reason: error at write: Disconnected sessionId: src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0
2025-10-02T08:11:19.299037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:19.299167Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:19.299195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1144 sessionId: src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0 is DEAD
2025-10-02T08:11:19.299348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:19.299360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0] Write session will restart in 0.008570s
2025-10-02T08:11:19.299383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0] Write session: Do CDS request
2025-10-02T08:11:19.299388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:19.309188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.309265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:19.309279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1145
2025-10-02T08:11:19.309440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.309465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:19.309474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:19.309477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:19.309917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1145 sessionId:  describe result for acl check
2025-10-02T08:11:19.309944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:19.309951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:19.309952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:19.309958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534018525561760:5093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:19.310352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534018525561760:5093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:19.310709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:19.312000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:19.312128Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:19.312137Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:19.312144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:19.312175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:19.312203Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534018525561794:5092]
2025-10-02T08:11:19.312589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:19.312634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534018525561760:5093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:19.312716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:19.312746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:19.312973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:19.313010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.313014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.313015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.313016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.313017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.313020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.313026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.313029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.313031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.313033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.313036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.313040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.313044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.313047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.313050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.313053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.313055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.313058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.313060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.313063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.313073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:19.317633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534018525561760:5093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:19.317647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534018525561760:5093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:19.317650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534018525561760:5093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:19.317656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:19.320862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:19.322614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:19.322627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:19.322629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:19.322633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:19.322639Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1144 [1:7556534018525561794:5092]
2025-10-02T08:11:19.322650Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:19.322668Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:19.322674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.322677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.322678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.322692Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:19.322699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:19.322706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:19.322763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.322768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.322770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:19.322772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:19.322880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1144
2025-10-02T08:11:19.322923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:19.322928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.322937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.322950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:19.322973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525561821:5093], now have 1 active actors on pipe
2025-10-02T08:11:19.322979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534018985558340:2378], now have 1 active actors on pipe
2025-10-02T08:11:19.322984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.322989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.322951Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1144
2025-10-02T08:11:19.323006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534018525561772:5092]
2025-10-02T08:11:19.323010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534018525561772:5092]
2025-10-02T08:11:19.323022Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:19.323033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:19.323040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:19.323044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:19.323046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:19.323050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:19.323065Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:19.323076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.323080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.323082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:19.323093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.323103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:19.323135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534018525561772:5092]
2025-10-02T08:11:19.323144Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:19.323153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.323161Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:19.323237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.323245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.323256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.323286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1145 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0
2025-10-02T08:11:19.323579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75cd2307-f0409bf5-7342bc1c-fddd5bac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:19.326543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0] Write session: try to update token
2025-10-02T08:11:19.326564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:19.333272Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:19.333294Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:19.333304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534018525561772:5092]
2025-10-02T08:11:19.333353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:19.333361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:19.333550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:19.333718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:19.333882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:19.334063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:19.334289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:19.334332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:19.342407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId: src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:19.346035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:19.346136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.346166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.346219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:19.346261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:19.346331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.346349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.346523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.346592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.346660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.346734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.346911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.346924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.346996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.347063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.347131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.347202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.347251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.347257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.347318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.347373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.347427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.347480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.347519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.347524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.347579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.347635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.347691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.347752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.347794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.347800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.347864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.347916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.347970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.348024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.348065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.348070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.348127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.348179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.348236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.348297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.348342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.348346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.348405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.348459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.348516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.348574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.348616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.348621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.348678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.348733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.348786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.348860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.348903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.348908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.348967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.349021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.349076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.349133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.349175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.349180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.349238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.349293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.349354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.349410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.349451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.349457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.349504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:19.349553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.349571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.349573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:19.349599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:19.349611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:19.349616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:19.349619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:19.349620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:19.349961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:19.349983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:19.349990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:19.349992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:19.349994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:19.349995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:19.350678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:19.350695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:19.350699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:19.350701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:19.350704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:19.350706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:19.351127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:19.351144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:19.351148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:19.351150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:19.351152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:19.352301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:19.352320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:19.352328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392679352
2025-10-02T08:11:19.352510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:19.352521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:19.352524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:19.352526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:19.352529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:19.352531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:19.352944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:19.352959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:19.352962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:19.352964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:19.352968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:19.352970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:19.353401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:19.353418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:19.353422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:19.353424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:19.353427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:19.353429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:19.353847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:19.353863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:19.353866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:19.354796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:19.354811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:19.354817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:19.354819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:19.354825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392679354
2025-10-02T08:11:19.355076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:19.355091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:19.355094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:19.355098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:19.355100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:19.355102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:19.355490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:19.355505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:19.355509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:19.355512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:19.355514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:19.355516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:19.355905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:19.355918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.355988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392679355
2025-10-02T08:11:19.358070Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:19.358090Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:19.358094Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:19.358099Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:19.358108Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:19.358113Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:19.358118Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:19.358124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534018525561772:5092]
2025-10-02T08:11:19.358128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534018525561772:5092]
2025-10-02T08:11:19.358187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:19.358194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.358196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:19.358194Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:19.358200Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:19.358310Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:19.399246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534018525561845:5853]
2025-10-02T08:11:19.399353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1144, pipe: [1:7556534018525561845:5853]
2025-10-02T08:11:19.489563Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:19.489858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525561845:5853], now have 1 active actors on pipe
2025-10-02T08:11:19.489964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534018525561845:5853]
2025-10-02T08:11:19.489981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:19.489983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:19.490002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1145 reason: error at write: Disconnected sessionId: src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0
2025-10-02T08:11:19.490036Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:19.490053Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:19.490151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1145 sessionId: src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0 is DEAD
2025-10-02T08:11:19.490328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:19.490341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0] Write session will restart in 0.005968s
2025-10-02T08:11:19.490362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0] Write session: Do CDS request
2025-10-02T08:11:19.490368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:19.493218Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [70c640d892fc49b9] Result# TEvPutResult {Id# [72075186224037892:1144:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:19.493230Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1144:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:19.493276Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1144:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:19.497261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:19.497295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.497274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1146
2025-10-02T08:11:19.497535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.497559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:19.497565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:19.497567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:19.497935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1146 sessionId:  describe result for acl check
2025-10-02T08:11:19.497961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:19.497966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:19.497967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:19.497970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534018525562207:5070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:19.498361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534018525562207:5070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:19.500429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534018525562207:5070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:19.502730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:19.502966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:19.502967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534018525562207:5070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:19.502971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534018525562207:5070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:19.502973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534018525562207:5070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:19.502978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:19.503107Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:19.503113Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:19.503119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:19.503150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:19.503179Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534018525562394:5075]
2025-10-02T08:11:19.503549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:19.503683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:19.503719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:19.504009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:19.504049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.504054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.504055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.504056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.504057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.504060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.504066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.504068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.504070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.504072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.504075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.504079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.504083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.504086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.504088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.504090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.504093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.504095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.504098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.504100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.504112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:19.511329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:19.512843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:19.512855Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:19.512857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:19.512859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:19.512864Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1145 [1:7556534018525562394:5075]
2025-10-02T08:11:19.512872Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:19.512886Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:19.512888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.512890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.512893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.512906Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:19.512909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:19.512914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:19.512962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.512967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.512969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:19.512970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:19.513015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:19.513021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.513028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.513035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:19.513047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525562392:5070], now have 1 active actors on pipe
2025-10-02T08:11:19.513052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534018525562384:5075]
2025-10-02T08:11:19.513053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534018525562384:5075]
2025-10-02T08:11:19.513058Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:19.513067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:19.513070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1145
2025-10-02T08:11:19.513072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:19.513075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:19.513076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:19.513077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:19.513081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534018985558347:2378], now have 1 active actors on pipe
2025-10-02T08:11:19.513084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.513086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.513116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534018525562384:5075]
2025-10-02T08:11:19.513125Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:19.513133Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:19.513136Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:19.513140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.513143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.513144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:19.513149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.513155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:19.513177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.513165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1145
2025-10-02T08:11:19.513215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.513219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.513227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.513257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1146 partition: 0 MaxSeqNo: 17 sessionId: src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0
2025-10-02T08:11:19.513557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e3f3e8-7557782-6ba1a6e4-d35de06b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:19.516164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0] Write session: try to update token
2025-10-02T08:11:19.516176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:19.523425Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:19.523442Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:19.523448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534018525562384:5075]
2025-10-02T08:11:19.523474Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:19.523482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:19.523639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:19.523775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:19.523920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:19.524059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:19.524253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:19.524292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:19.531927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId: src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:19.534320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:19.534372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.534384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.534414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:19.534435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:19.534471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.534486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.534632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.534690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.534760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.534847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.534900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.534910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.534982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.535038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.535093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.535150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.535188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.535193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.535253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.535317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.535395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.535475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.535518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.535524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.535584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.535642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.535699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.535755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.535806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.535814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.535905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.535986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.536050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.536106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.536143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.536149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.536208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.536260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.536315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.536381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.536436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.536445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.536526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.536592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.536653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.536708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.536746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.536751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.536829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.536883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.536959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.537043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.537095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.537103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.537166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.537223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.537276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.537331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.537370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.537376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.537436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:19.537512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:19.537600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:19.537677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:19.537720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:19.537726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:19.537756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:19.537809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.537826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.537831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:19.537856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:19.537871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:19.537876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:19.537878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:19.537880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:19.538269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:19.538289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:19.538293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:19.538299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:19.538301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:19.538303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:19.538781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:19.538799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:19.538803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:19.538805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:19.538807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:19.538809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:19.539325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:19.539342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:19.539346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:19.539348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:19.539351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:19.541384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:19.541402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:19.541411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392679541
2025-10-02T08:11:19.541513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:19.541524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:19.541527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:19.541532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:19.541538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:19.541542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:19.541956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:19.541973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:19.541977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:19.541979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:19.541981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:19.541983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:19.542445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:19.542462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:19.542469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:19.542474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:19.542477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:19.542480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:19.542929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:19.542948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:19.542955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:19.543935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:19.543950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:19.543954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:19.543956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:19.543964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392679543
2025-10-02T08:11:19.544249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:19.544263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:19.544267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:19.544273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:19.544275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:19.544281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:19.544709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:19.544723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:19.544726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:19.544728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:19.544730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:19.544732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:19.545224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:19.545248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.545321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392679545
2025-10-02T08:11:19.548796Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:19.548851Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:19.548860Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:19.548864Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:19.550366Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:19.550378Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:19.550380Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:19.550390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534018525562384:5075]
2025-10-02T08:11:19.550393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534018525562384:5075]
2025-10-02T08:11:19.550426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:19.550435Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:19.550438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:19.550442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.550445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:19.550567Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:19.590194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534018525562429:5853]
2025-10-02T08:11:19.590290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1145, pipe: [1:7556534018525562429:5853]
2025-10-02T08:11:19.679079Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:19.679370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525562429:5853], now have 1 active actors on pipe
2025-10-02T08:11:19.679495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:19.679502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:19.679520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1146 reason: error at write: Disconnected sessionId: src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0
2025-10-02T08:11:19.679593Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:19.679558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:19.679667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1146 sessionId: src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0 is DEAD
2025-10-02T08:11:19.679764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534018525562429:5853]
2025-10-02T08:11:19.679831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:19.679839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0] Write session will restart in 0.007298s
2025-10-02T08:11:19.679868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0] Write session: Do CDS request
2025-10-02T08:11:19.679873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:19.688256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.688377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:19.688391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1147
2025-10-02T08:11:19.688503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.688530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:19.688538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:19.688541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:19.688895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1147 sessionId:  describe result for acl check
2025-10-02T08:11:19.688926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:19.688932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:19.688934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:19.688939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534018525562886:5057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:19.689387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534018525562886:5057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:19.691041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:19.691483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534018525562886:5057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:19.691966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:19.692120Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:19.692128Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:19.692134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:19.692163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:19.692188Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534018525562967:5059]
2025-10-02T08:11:19.692570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:19.692715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:19.692752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:19.692987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:19.693022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.693026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.693026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.693027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.693027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.693031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.693037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.693039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.693041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.693043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.693047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.693051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.693055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.693057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.693060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.693062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.693064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.693067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.693069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.693072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.693083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:19.694979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534018525562886:5057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:19.694988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534018525562886:5057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:19.694990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534018525562886:5057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:19.694997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:19.700585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:19.702093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:19.702108Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:19.702110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:19.702113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:19.702118Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1146 [1:7556534018525562967:5059]
2025-10-02T08:11:19.702126Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:19.702139Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:19.702141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.702143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.702144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.702156Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:19.702165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:19.702170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:19.702222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.702227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.702229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:19.702230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:19.702273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:19.702281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.702289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.702295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:19.702307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534018525562951:5059]
2025-10-02T08:11:19.702309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534018525562951:5059]
2025-10-02T08:11:19.702316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:19.702324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:19.702331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:19.702336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:19.702338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:19.702340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:19.702351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1146
2025-10-02T08:11:19.702365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525562984:5057], now have 1 active actors on pipe
2025-10-02T08:11:19.702371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534018985558355:2378], now have 1 active actors on pipe
2025-10-02T08:11:19.702372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534018525562951:5059]
2025-10-02T08:11:19.702378Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:19.702383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.702386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.702413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:19.702414Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:19.702418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.702420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.702421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:19.702427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.702434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:19.702446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.702442Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1146
2025-10-02T08:11:19.702485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.702489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.702498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.702523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1147 partition: 0 MaxSeqNo: 17 sessionId: src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0
2025-10-02T08:11:19.702840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5486700-65b17cc4-bae80e32-a3f35d18_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:19.705230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Write session: try to update token
2025-10-02T08:11:19.705244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:19.718904Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:19.718921Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:19.718924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:19.718930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534018525562951:5059]
2025-10-02T08:11:19.718934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534018525562951:5059]
2025-10-02T08:11:19.718962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:19.718962Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:19.718966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:19.718968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.718969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:19.719092Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:19.720145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId: src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:19.722417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:19.779637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534018525562999:5853]
2025-10-02T08:11:19.779713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1146, pipe: [1:7556534018525562999:5853]
2025-10-02T08:11:19.844335Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:19.844545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.844556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.844588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525562999:5853], now have 1 active actors on pipe
2025-10-02T08:11:19.844708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534018525562999:5853]
2025-10-02T08:11:19.844730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:19.844735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:19.844754Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:19.844785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1147 reason: error at write: Disconnected sessionId: src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0
2025-10-02T08:11:19.844845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:19.844961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1147 sessionId: src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0 is DEAD
2025-10-02T08:11:19.845117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 142 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:11:19.845152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:19.845155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Write session will restart in 0.009282s
2025-10-02T08:11:19.845175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Write session: Do CDS request
2025-10-02T08:11:19.845179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:19.855344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.855399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:19.855410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1148
2025-10-02T08:11:19.855513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:19.855533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:19.855540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:19.855543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:19.855792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1148 sessionId:  describe result for acl check
2025-10-02T08:11:19.855816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:19.855821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:19.855822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:19.855825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534018525563496:5042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:19.856053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:19.856165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534018525563496:5042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:19.856908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:19.857069Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:19.857076Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:19.857083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:19.857112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:19.857135Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534018525563518:5038]
2025-10-02T08:11:19.857491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:19.857618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:19.857658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:19.857820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534018525563496:5042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:19.857856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:19.857882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.857886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.857886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.857887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.857889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.857892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.857898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.857900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.857902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.857904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.857907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.857911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:19.857915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.857917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:19.857919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.857922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:19.857924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.857926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.857928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.857930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.857940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:19.863179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534018525563496:5042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:19.863189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534018525563496:5042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:19.863192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534018525563496:5042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:19.863197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:19.865173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:19.866481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:19.866491Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:19.866493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:19.866495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:19.866498Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1147 [1:7556534018525563518:5038]
2025-10-02T08:11:19.866505Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:19.866515Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:19.866520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.866521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.866523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.866533Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:19.866540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:19.866545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:19.866630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.866634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.866636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:19.866638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:19.866679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:19.866684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.866691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:19.866697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:19.866707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1147
2025-10-02T08:11:19.866709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525563551:5042], now have 1 active actors on pipe
2025-10-02T08:11:19.866713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534018525563498:5038]
2025-10-02T08:11:19.866715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534018525563498:5038]
2025-10-02T08:11:19.866719Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:19.866724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534018985558361:2378], now have 1 active actors on pipe
2025-10-02T08:11:19.866729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:19.866729Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:19.866732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:19.866736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:19.866737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:19.866742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.866744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.866769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534018525563498:5038]
2025-10-02T08:11:19.866774Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:19.866776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:19.866784Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:19.866790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:19.866792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:19.866792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:19.866798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:19.866803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:19.866749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1147
2025-10-02T08:11:19.866826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.866864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:19.866868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:19.866876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:19.866897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1148 partition: 0 MaxSeqNo: 17 sessionId: src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0
2025-10-02T08:11:19.867182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b37957d6-b7c53d24-855a69e5-5ea9816_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:19.869835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0] Write session: try to update token
2025-10-02T08:11:19.869851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:19.882993Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:19.883009Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:19.883011Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:19.883018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534018525563498:5038]
2025-10-02T08:11:19.883022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534018525563498:5038]
2025-10-02T08:11:19.883051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:19.883059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:19.883060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:19.883065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:19.883070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:19.883177Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:19.883279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId: src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:19.885538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:19.945007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534018525563566:5853]
2025-10-02T08:11:19.945087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1147, pipe: [1:7556534018525563566:5853]
2025-10-02T08:11:20.007642Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:20.007901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.007911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.007941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534018525563566:5853], now have 1 active actors on pipe
2025-10-02T08:11:20.008047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534018525563566:5853]
2025-10-02T08:11:20.008076Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:20.008076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:20.008078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:20.008128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1148 reason: error at write: Disconnected sessionId: src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0
2025-10-02T08:11:20.008149Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:20.008286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1148 sessionId: src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0 is DEAD
2025-10-02T08:11:20.008416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:20.008424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0] Write session will restart in 0.008372s
2025-10-02T08:11:20.008444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0] Write session: Do CDS request
2025-10-02T08:11:20.008450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:20.018377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.018426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:20.018439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1149
2025-10-02T08:11:20.018654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.018682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:20.018691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:20.018694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:20.018995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1149 sessionId:  describe result for acl check
2025-10-02T08:11:20.019018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:20.019021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:20.019022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:20.019026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534022820531366:5032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:20.019404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534022820531366:5032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:20.019705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:20.020903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:20.021045Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:20.021052Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:20.021058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:20.021091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:20.021116Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534022820531400:5033]
2025-10-02T08:11:20.021145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534022820531366:5032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:20.021514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:20.021641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:20.021666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:20.021867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:20.021901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.021901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.021902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.021903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.021903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.021906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.021912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.021914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.021916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.021918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.021921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.021925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.021933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.021937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.021943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.021945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.021947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.021950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.021952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.021954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.021965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:20.026262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534022820531366:5032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:20.026278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534022820531366:5032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:20.026281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534022820531366:5032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:20.026289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:20.029329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:20.030874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:20.030889Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:20.030891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:20.030894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:20.030900Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1148 [1:7556534022820531400:5033]
2025-10-02T08:11:20.030911Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:20.030924Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:20.030927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.030930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.030931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.030945Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:20.030955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:20.030961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:20.031112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.031121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.031124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:20.031127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:20.031186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:20.031193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.031206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.031221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:20.031241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1148
2025-10-02T08:11:20.031242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820531427:5032], now have 1 active actors on pipe
2025-10-02T08:11:20.031248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534022820531378:5033]
2025-10-02T08:11:20.031250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534022820531378:5033]
2025-10-02T08:11:20.031257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:20.031265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534023280525678:2378], now have 1 active actors on pipe
2025-10-02T08:11:20.031266Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:20.031269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:20.031276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.031281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.031292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:20.031304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:20.031309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:20.031342Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:20.031349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.031354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.031355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:20.031361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.031313Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1148
2025-10-02T08:11:20.031369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:20.031379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534022820531378:5033]
2025-10-02T08:11:20.031385Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:20.031402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:20.031408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.031464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.031469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.031477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.031506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1149 partition: 0 MaxSeqNo: 17 sessionId: src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0
2025-10-02T08:11:20.031848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a575be1-754e0323-a5ca44f7-e6d27afc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:20.034709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0] Write session: try to update token
2025-10-02T08:11:20.034727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:20.043002Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:20.043016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:20.043023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534022820531378:5033]
2025-10-02T08:11:20.043058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:20.043062Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:20.043203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:20.043331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:20.043468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:20.043596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:20.043779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:20.043818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:20.049674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId: src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:20.052155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:20.052212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.052222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.052248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:20.052265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:20.052443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.052458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.052616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.052680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.052750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.052831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.052877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.052885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.052958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.053020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.053088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.053158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.053200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.053207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.053276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.053337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.053399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.053469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.053513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.053521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.053583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.053642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.053710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.053772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.053815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.053822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.053890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.053951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.054010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.054085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.054127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.054132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.054188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.054245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.054307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.054365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.054407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.054412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.054470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.054525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.054588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.054647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.054687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.054692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.054750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.054814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.054873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.054930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.054969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.054974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.055033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.055098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.055168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.055227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.055267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.055272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.055328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.055383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.055441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.055495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.055535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.055540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.055571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:20.055623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.055639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.055644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:20.055669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:20.055683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:20.055690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:20.055692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:20.055694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:20.056077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:20.056098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:20.056102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:20.056104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:20.056106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:20.056108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:20.056676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:20.056695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:20.056700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:20.056701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:20.056703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:20.056706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:20.057201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:20.057217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:20.057221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:20.057223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:20.057225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:20.058471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:20.058489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:20.058500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392680058
2025-10-02T08:11:20.058648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:20.058663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:20.058667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:20.058670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:20.058674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:20.058679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:20.059104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:20.059123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:20.059127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:20.059131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:20.059133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:20.059135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:20.059577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:20.059595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:20.059601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:20.059606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:20.059608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:20.059610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:20.060031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:20.060045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:20.060051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:20.061072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:20.061086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:20.061089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:20.061091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:20.061097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392680060
2025-10-02T08:11:20.061369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:20.061385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:20.061389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:20.061393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:20.061395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:20.061397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:20.061820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:20.061835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:20.061839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:20.061845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:20.061847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:20.061850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:20.062248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:20.062262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.062329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392680062
2025-10-02T08:11:20.063040Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:20.063053Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:20.063057Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:20.063060Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:20.064725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:20.064737Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:20.064740Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:20.064749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534022820531378:5033]
2025-10-02T08:11:20.064754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534022820531378:5033]
2025-10-02T08:11:20.064798Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:20.064820Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:20.064824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:20.064829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.064831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:20.064960Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:20.109587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534022820531466:5853]
2025-10-02T08:11:20.111250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1148, pipe: [1:7556534022820531466:5853]
2025-10-02T08:11:20.189546Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:20.189855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820531466:5853], now have 1 active actors on pipe
2025-10-02T08:11:20.189933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534022820531466:5853]
2025-10-02T08:11:20.189949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:20.189951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:20.189968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1149 reason: error at write: Disconnected sessionId: src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0
2025-10-02T08:11:20.190017Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:20.190042Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:20.190119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1149 sessionId: src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0 is DEAD
2025-10-02T08:11:20.190281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:20.190297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0] Write session will restart in 0.008116s
2025-10-02T08:11:20.190319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0] Write session: Do CDS request
2025-10-02T08:11:20.190324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:20.199238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.199362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:20.199375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1150
2025-10-02T08:11:20.199518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.199543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:20.199550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:20.199552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:20.199796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1150 sessionId:  describe result for acl check
2025-10-02T08:11:20.199817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:20.199821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:20.199823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:20.199825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534022820531980:4998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:20.200148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534022820531980:4998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:20.200792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:20.201897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534022820531980:4998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:20.202077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:20.202209Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:20.202217Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:20.202222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:20.202253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:20.202277Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534022820532025:4994]
2025-10-02T08:11:20.202688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:20.202827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:20.202860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:20.203064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:20.203091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.203095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.203096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.203096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.203097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.203101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.203107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.203108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.203110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.203112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.203115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.203120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.203123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.203131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.203135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.203138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.203140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.203143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.203145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.203148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.203158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:20.207486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534022820531980:4998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:20.207500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534022820531980:4998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:20.207503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534022820531980:4998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:20.207511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:20.210319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:20.211792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:20.211803Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:20.211804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:20.211807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:20.211811Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1149 [1:7556534022820532025:4994]
2025-10-02T08:11:20.211819Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:20.211828Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:20.211830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.211832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.211833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.211844Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:20.211851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:20.211865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:20.211906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.211911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.211913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:20.211915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:20.211982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:20.211988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.211990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1149
2025-10-02T08:11:20.211996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.212002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:20.212015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820532044:4998], now have 1 active actors on pipe
2025-10-02T08:11:20.212017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534023280525707:2378], now have 1 active actors on pipe
2025-10-02T08:11:20.212020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.212022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.212035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534022820532003:4994]
2025-10-02T08:11:20.212037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534022820532003:4994]
2025-10-02T08:11:20.212047Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:20.212056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:20.212064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:20.212068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:20.212068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:20.212071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:20.212079Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|547184aa-c028d69d-dda67361-c8674724_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:20.212083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.212085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.212086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:20.212092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.212098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:20.212049Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1149
2025-10-02T08:11:20.212119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534022820532003:4994]
2025-10-02T08:11:20.212128Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:20.212140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.212142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:20.212178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.212183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.212191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.212215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1150 partition: 0 MaxSeqNo: 17 sessionId: src_id|547184aa-c028d69d-dda67361-c8674724_0
2025-10-02T08:11:20.212489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b50a4-21f61b43-c05042ea-8ddfa46b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|547184aa-c028d69d-dda67361-c8674724_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:20.215120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547184aa-c028d69d-dda67361-c8674724_0] Write session: try to update token
2025-10-02T08:11:20.215133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547184aa-c028d69d-dda67361-c8674724_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:20.227335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId: src_id|547184aa-c028d69d-dda67361-c8674724_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:20.228738Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:20.228755Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:20.228757Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:20.228765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534022820532003:4994]
2025-10-02T08:11:20.228768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534022820532003:4994]
2025-10-02T08:11:20.228815Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:20.228819Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:20.228820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:20.228828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.228830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:20.228987Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:20.229820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:20.290131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534022820532059:5853]
2025-10-02T08:11:20.290252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1149, pipe: [1:7556534022820532059:5853]
2025-10-02T08:11:20.364289Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:20.364480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.364489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.364518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820532059:5853], now have 1 active actors on pipe
2025-10-02T08:11:20.364617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:20.364626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:20.364679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1150 reason: error at write: Disconnected sessionId: src_id|547184aa-c028d69d-dda67361-c8674724_0
2025-10-02T08:11:20.364727Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:20.364884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1150 sessionId: src_id|547184aa-c028d69d-dda67361-c8674724_0 is DEAD
2025-10-02T08:11:20.365028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547184aa-c028d69d-dda67361-c8674724_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:20.365038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547184aa-c028d69d-dda67361-c8674724_0] Write session will restart in 0.006932s
2025-10-02T08:11:20.365072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547184aa-c028d69d-dda67361-c8674724_0] Write session: Do CDS request
2025-10-02T08:11:20.365080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547184aa-c028d69d-dda67361-c8674724_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:20.365063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534022820532059:5853]
2025-10-02T08:11:20.365135Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:20.373303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547184aa-c028d69d-dda67361-c8674724_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.373304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:20.373316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1151
2025-10-02T08:11:20.373549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.373580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:20.373585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:20.373588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:20.374042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1151 sessionId:  describe result for acl check
2025-10-02T08:11:20.374073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:20.374078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:20.374080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:20.374084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534022820532535:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:20.374425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534022820532535:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:20.375796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:20.376469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534022820532535:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:20.376879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:20.377004Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:20.377011Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:20.377018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:20.377049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:20.377073Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534022820532600:4971]
2025-10-02T08:11:20.377461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:20.377602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:20.377637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:20.377851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:20.377878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.377882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.377882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.377883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.377883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.377887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.377893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.377895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.377897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.377899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.377902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.377906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.377910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.377915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.377917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.377920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.377925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.377928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.377930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.377932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.377943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:20.382173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534022820532535:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:20.382183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534022820532535:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:20.382185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534022820532535:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:20.382192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:20.385089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:20.386524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:20.386535Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:20.386537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:20.386540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:20.386544Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1150 [1:7556534022820532600:4971]
2025-10-02T08:11:20.386550Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:20.386562Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:20.386567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.386569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.386570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.386581Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:20.386585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:20.386590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:20.386630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.386635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.386637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:20.386639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:20.386681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:20.386685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.386692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.386702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:20.386717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534022820532584:4971]
2025-10-02T08:11:20.386722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534022820532584:4971]
2025-10-02T08:11:20.386727Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:20.386731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1150
2025-10-02T08:11:20.386737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820532618:4967], now have 1 active actors on pipe
2025-10-02T08:11:20.386739Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:20.386742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:20.386744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534023280525714:2378], now have 1 active actors on pipe
2025-10-02T08:11:20.386748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:20.386755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:20.386756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:20.386760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.386762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.386786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534022820532584:4971]
2025-10-02T08:11:20.386795Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:20.386807Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:20.386815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.386816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:20.386818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.386821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:20.386826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.386832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:20.386800Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1150
2025-10-02T08:11:20.386860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.386901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.386905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.386914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.386942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1151 partition: 0 MaxSeqNo: 17 sessionId: src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0
2025-10-02T08:11:20.387254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547184aa-c028d69d-dda67361-c8674724_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:20.389729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0] Write session: try to update token
2025-10-02T08:11:20.389744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:20.396720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:20.396736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:20.396743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534022820532584:4971]
2025-10-02T08:11:20.396774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:20.396817Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:20.396971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:20.397120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:20.397267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:20.397404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:20.397607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:20.397645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:20.403496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId: src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:20.405719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:20.405781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.405794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.405819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:20.405836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:20.405871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.405883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.406034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.406099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.406204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.406299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.406565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.406574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.406659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.406759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.406819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.406876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.406913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.406918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.406979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.407031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.407086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.407161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.407211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.407219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.407295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.407354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.407408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.407461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.407504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.407509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.407566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.407630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.407712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.407785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.407826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.407833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.407908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.407959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.408013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.408068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.408109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.408115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.408196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.408278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.408348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.408407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.408446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.408451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.408512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.408564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.408621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.408719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.408770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.408777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.408856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.408908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.408965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.409019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.409059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.409064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.409124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:20.409228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:20.409309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:20.409371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:20.409412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:20.409417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:20.409448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:20.409499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.409514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.409520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:20.409543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:20.409555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:20.409560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:20.409562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:20.409564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:20.409978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:20.410000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:20.410005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:20.410007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:20.410010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:20.410012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:20.410571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:20.410592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:20.410598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:20.410600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:20.410602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:20.410604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:20.411077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:20.411094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:20.411098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:20.411102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:20.411104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:20.413045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:20.413060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:20.413071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392680412
2025-10-02T08:11:20.413196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:20.413205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:20.413209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:20.413212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:20.413224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:20.413230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:20.413629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:20.413646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:20.413653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:20.413655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:20.413661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:20.413664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:20.414070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:20.414087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:20.414094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:20.414096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:20.414100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:20.414102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:20.414542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:20.414559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:20.414566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:20.415549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:20.415563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:20.415568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:20.415570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:20.415576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392680415
2025-10-02T08:11:20.415834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:20.415849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:20.415853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:20.415855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:20.415867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:20.415875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:20.416278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:20.416296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:20.416300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:20.416303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:20.416305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:20.416307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:20.416713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:20.416727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.416798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392680416
2025-10-02T08:11:20.420002Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:20.420019Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:20.420023Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:20.420027Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:20.421483Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:20.421496Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:20.421497Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:20.421506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534022820532584:4971]
2025-10-02T08:11:20.421510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534022820532584:4971]
2025-10-02T08:11:20.421551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:20.421558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.421559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:20.421561Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:20.421566Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:20.421680Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:20.465229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534022820532640:5853]
2025-10-02T08:11:20.465341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1150, pipe: [1:7556534022820532640:5853]
2025-10-02T08:11:20.546236Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:20.546536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820532640:5853], now have 1 active actors on pipe
2025-10-02T08:11:20.546632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:20.546638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:20.546657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1151 reason: error at write: Disconnected sessionId: src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0
2025-10-02T08:11:20.546719Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:20.546809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1151 sessionId: src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0 is DEAD
2025-10-02T08:11:20.546791Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:20.546931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534022820532640:5853]
2025-10-02T08:11:20.546966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:20.546974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0] Write session will restart in 0.008175s
2025-10-02T08:11:20.546992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0] Write session: Do CDS request
2025-10-02T08:11:20.546998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:20.556286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.556281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:20.556295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1152
2025-10-02T08:11:20.556535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.556558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:20.556564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:20.556567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:20.556924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1152 sessionId:  describe result for acl check
2025-10-02T08:11:20.556955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:20.556960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:20.556961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:20.556964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534022820533095:4948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:20.557371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534022820533095:4948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:20.559323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534022820533095:4948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:20.559344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:20.560584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:20.560730Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:20.560737Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:20.560744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:20.560776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:20.560821Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534022820533187:4957]
2025-10-02T08:11:20.561282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:20.561431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:20.561461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:20.561566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534022820533095:4948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:20.561576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534022820533095:4948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:20.561578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534022820533095:4948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:20.561584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:20.561654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:20.561680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.561684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.561685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.561685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.561686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.561689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.561695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.561697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.561699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.561701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.561704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.561709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.561712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.561715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.561717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.561720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.561722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.561725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.561727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.561730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.561741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:20.569348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:20.570966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:20.570979Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:20.570981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:20.570984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:20.570991Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1151 [1:7556534022820533187:4957]
2025-10-02T08:11:20.570999Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:20.571013Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:20.571014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.571016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.571018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.571030Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:20.571033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:20.571038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:20.571084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.571091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.571094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:20.571095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:20.571144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:20.571149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.571157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.571164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:20.571186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534022820533171:4957]
2025-10-02T08:11:20.571191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534022820533171:4957]
2025-10-02T08:11:20.571197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:20.571204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:20.571215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:20.571216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:20.571243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820533198:4948], now have 1 active actors on pipe
2025-10-02T08:11:20.571245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1151
2025-10-02T08:11:20.571248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534022820533171:4957]
2025-10-02T08:11:20.571250Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:20.571251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:20.571254Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:20.571259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:20.571270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534023280525722:2378], now have 1 active actors on pipe
2025-10-02T08:11:20.571274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.571278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.571305Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8456864-e3473c78-5bd8b660-e0309484_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:20.571315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.571318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.571319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:20.571327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.571337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:20.571349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.571391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.571396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.571409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.571357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1151
2025-10-02T08:11:20.571437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1152 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8456864-e3473c78-5bd8b660-e0309484_0
2025-10-02T08:11:20.571729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b1608c-1fdf1f01-e9f92e5b-dd339cea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8456864-e3473c78-5bd8b660-e0309484_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:20.574159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8456864-e3473c78-5bd8b660-e0309484_0] Write session: try to update token
2025-10-02T08:11:20.574172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8456864-e3473c78-5bd8b660-e0309484_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:20.587310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId: src_id|d8456864-e3473c78-5bd8b660-e0309484_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:20.588274Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:20.588287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:20.588289Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:20.588295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534022820533171:4957]
2025-10-02T08:11:20.588298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534022820533171:4957]
2025-10-02T08:11:20.588330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:20.588332Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:20.588335Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:20.588339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.588340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:20.588461Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:20.589987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:20.646970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534022820533221:5853]
2025-10-02T08:11:20.647047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1151, pipe: [1:7556534022820533221:5853]
2025-10-02T08:11:20.712540Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:20.712775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.712784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.712835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820533221:5853], now have 1 active actors on pipe
2025-10-02T08:11:20.712977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534022820533221:5853]
2025-10-02T08:11:20.713009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:20.713016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:20.713070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1152 reason: error at write: Disconnected sessionId: src_id|d8456864-e3473c78-5bd8b660-e0309484_0
2025-10-02T08:11:20.713054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:20.713235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1152 sessionId: src_id|d8456864-e3473c78-5bd8b660-e0309484_0 is DEAD
2025-10-02T08:11:20.713416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8456864-e3473c78-5bd8b660-e0309484_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:20.713436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8456864-e3473c78-5bd8b660-e0309484_0] Write session will restart in 0.008198s
2025-10-02T08:11:20.713458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8456864-e3473c78-5bd8b660-e0309484_0] Write session: Do CDS request
2025-10-02T08:11:20.713464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8456864-e3473c78-5bd8b660-e0309484_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:20.713787Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:20.723351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8456864-e3473c78-5bd8b660-e0309484_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.723417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:20.723430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1153
2025-10-02T08:11:20.723531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.723552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:20.723559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:20.723562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:20.723880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1153 sessionId:  describe result for acl check
2025-10-02T08:11:20.723904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:20.723908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:20.723909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:20.723913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534022820533721:4941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:20.724247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534022820533721:4941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:20.725925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534022820533721:4941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:20.726468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:20.726758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:20.726857Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:20.726864Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:20.726870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:20.726895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:20.726923Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534022820533768:4942]
2025-10-02T08:11:20.727299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:20.727430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:20.727453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:20.727629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:20.727653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.727657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.727658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.727658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.727659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.727662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.727668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.727670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.727672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.727673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.727677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.727681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.727688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.727691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.727693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.727695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.727698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.727700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.727703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.727706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.727716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:20.727913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534022820533721:4941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:20.727923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534022820533721:4941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:20.727925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534022820533721:4941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:20.727931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:20.733939Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 11 CurrentSessionLifetimeMs: 241428 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:11:20.735361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:20.736839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:20.736850Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:20.736851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:20.736853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:20.736858Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1152 [1:7556534022820533768:4942]
2025-10-02T08:11:20.736865Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:20.736877Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:20.736879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.736881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.736882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.736895Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:20.736898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:20.736902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:20.736946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.736951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.736954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:20.736955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:20.736998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:20.737003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.737012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.737018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:20.737029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534022820533762:4942]
2025-10-02T08:11:20.737034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534022820533762:4942]
2025-10-02T08:11:20.737039Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:20.737049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:20.737060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:20.737064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:20.737065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:20.737069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:20.737090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820533784:4941], now have 1 active actors on pipe
2025-10-02T08:11:20.737096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534022820533762:4942]
2025-10-02T08:11:20.737098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:20.737101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534023280525729:2378], now have 1 active actors on pipe
2025-10-02T08:11:20.737101Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:20.737109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1152
2025-10-02T08:11:20.737111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.737114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.737136Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:20.737144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.737146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.737148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:20.737154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.737160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:20.737176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.737140Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1152
2025-10-02T08:11:20.737211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.737215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.737228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.737255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1153 partition: 0 MaxSeqNo: 17 sessionId: src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0
2025-10-02T08:11:20.737594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8456864-e3473c78-5bd8b660-e0309484_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:20.740420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0] Write session: try to update token
2025-10-02T08:11:20.740432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:20.753120Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:20.753135Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:20.753137Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:20.753144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534022820533762:4942]
2025-10-02T08:11:20.753147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534022820533762:4942]
2025-10-02T08:11:20.753178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:20.753183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.753184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:20.753185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:20.753188Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:20.753312Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:20.753770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId: src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:20.756165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:20.813381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534022820533799:5853]
2025-10-02T08:11:20.813488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1152, pipe: [1:7556534022820533799:5853]
2025-10-02T08:11:20.877894Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:20.878160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.878169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.878201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820533799:5853], now have 1 active actors on pipe
2025-10-02T08:11:20.878327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534022820533799:5853]
2025-10-02T08:11:20.878352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:20.878359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:20.878372Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:20.878420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1153 reason: error at write: Disconnected sessionId: src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0
2025-10-02T08:11:20.878435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:20.878599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1153 sessionId: src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0 is DEAD
2025-10-02T08:11:20.878789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:20.878802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0] Write session will restart in 0.005712s
2025-10-02T08:11:20.878825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0] Write session: Do CDS request
2025-10-02T08:11:20.878830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:20.885297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.885328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:20.885340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1154
2025-10-02T08:11:20.885557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:20.885588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:20.885593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:20.885595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:20.885894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1154 sessionId:  describe result for acl check
2025-10-02T08:11:20.885931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:20.885936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:20.885937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:20.885941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534022820534216:4934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:20.886295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534022820534216:4934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:20.888426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534022820534216:4934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:20.888800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:20.889960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:20.890100Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:20.890107Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:20.890113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:20.890147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:20.890184Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534022820534345:4935]
2025-10-02T08:11:20.890573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:20.890678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:20.890702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:20.890784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534022820534216:4934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:20.890794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534022820534216:4934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:20.890796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534022820534216:4934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:20.890801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:20.890881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:20.890908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.890912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.890912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.890913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.890913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.890916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.890922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.890924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.890926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.890928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.890931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.890935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:20.890940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.890942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:20.890946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.890949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:20.890951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.890953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.890955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.890958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.890968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:20.898308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:20.899821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:20.899830Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:20.899832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:20.899835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:20.899840Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1153 [1:7556534022820534345:4935]
2025-10-02T08:11:20.899848Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:20.899871Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:20.899872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.899874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.899875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.899886Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:20.899890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:20.899894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:20.899935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.899940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.899943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:20.899944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:20.899989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:20.899995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.900001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:20.900008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:20.900023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534022820534335:4935]
2025-10-02T08:11:20.900028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534022820534335:4935]
2025-10-02T08:11:20.900034Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:20.900042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820534357:4934], now have 1 active actors on pipe
2025-10-02T08:11:20.900046Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:20.900048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:20.900052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:20.900059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:20.900061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:20.900065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534023280525748:2378], now have 1 active actors on pipe
2025-10-02T08:11:20.900067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1153
2025-10-02T08:11:20.900086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.900092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.900101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534022820534335:4935]
2025-10-02T08:11:20.900107Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:20.900123Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:20.900126Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|808e888c-224fd00c-7f91eaa7-c458678a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:20.900132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:20.900135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:20.900137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:20.900145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:20.900105Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1153
2025-10-02T08:11:20.900153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:20.900286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.900330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:20.900335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:20.900344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:20.900373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1154 partition: 0 MaxSeqNo: 17 sessionId: src_id|808e888c-224fd00c-7f91eaa7-c458678a_0
2025-10-02T08:11:20.900705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0ced6a-dfe4ae3e-ec7ce449-6b389155_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|808e888c-224fd00c-7f91eaa7-c458678a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:20.903639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808e888c-224fd00c-7f91eaa7-c458678a_0] Write session: try to update token
2025-10-02T08:11:20.903654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808e888c-224fd00c-7f91eaa7-c458678a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:20.915915Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:20.915930Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:20.915932Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:20.915938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534022820534335:4935]
2025-10-02T08:11:20.915941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534022820534335:4935]
2025-10-02T08:11:20.915972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:20.915974Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:20.915977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:20.915980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:20.915982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:20.916110Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:20.917979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId: src_id|808e888c-224fd00c-7f91eaa7-c458678a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:20.920431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:20.978236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534022820534389:5853]
2025-10-02T08:11:20.978332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1153, pipe: [1:7556534022820534389:5853]
2025-10-02T08:11:21.041575Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:21.041851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.041861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.041891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534022820534389:5853], now have 1 active actors on pipe
2025-10-02T08:11:21.042016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534022820534389:5853]
2025-10-02T08:11:21.042045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:21.042051Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:21.042053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:21.042130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1154 reason: error at write: Disconnected sessionId: src_id|808e888c-224fd00c-7f91eaa7-c458678a_0
2025-10-02T08:11:21.042143Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:21.042310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1154 sessionId: src_id|808e888c-224fd00c-7f91eaa7-c458678a_0 is DEAD
2025-10-02T08:11:21.042477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e888c-224fd00c-7f91eaa7-c458678a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:21.042490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e888c-224fd00c-7f91eaa7-c458678a_0] Write session will restart in 0.005078s
2025-10-02T08:11:21.042512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e888c-224fd00c-7f91eaa7-c458678a_0] Write session: Do CDS request
2025-10-02T08:11:21.042517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e888c-224fd00c-7f91eaa7-c458678a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:21.048226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808e888c-224fd00c-7f91eaa7-c458678a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.048304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:21.048314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1155
2025-10-02T08:11:21.048473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.048494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:21.048501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:21.048504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:21.048822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1155 sessionId:  describe result for acl check
2025-10-02T08:11:21.048852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:21.048859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:21.048860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:21.048864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534027115502008:4917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:21.049220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534027115502008:4917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:21.051281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534027115502008:4917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:21.053713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534027115502008:4917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:21.053730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534027115502008:4917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:21.053733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534027115502008:4917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:21.053741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:21.055385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:21.055663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:21.055881Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:21.055890Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:21.055901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:21.055954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:21.055989Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534027115502240:4925]
2025-10-02T08:11:21.056403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:21.056557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:21.056590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:21.056826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:21.056866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.056871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.056872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.056873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.056874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.056879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.056890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.056897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.056902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.056906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.056914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.056921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.056926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.056931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.056938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.056943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.056947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.056953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.056957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.056966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.056985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:21.064399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:21.066164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:21.066184Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:21.066187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:21.066190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:21.066196Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1154 [1:7556534027115502240:4925]
2025-10-02T08:11:21.066208Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:21.066225Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:21.066233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.066236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.066238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.066253Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:21.066263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:21.066271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:21.066325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.066333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.066335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:21.066338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:21.066400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:21.066406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.066419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.066434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:21.066440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1154
2025-10-02T08:11:21.066452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115502223:4917], now have 1 active actors on pipe
2025-10-02T08:11:21.066455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534027575493053:2378], now have 1 active actors on pipe
2025-10-02T08:11:21.066461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.066470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.066485Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534027115502234:4925]
2025-10-02T08:11:21.066490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534027115502234:4925]
2025-10-02T08:11:21.066501Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:21.066517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:21.066519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:21.066523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:21.066534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:21.066540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:21.066554Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:21.066563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.066570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.066572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:21.066510Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1154
2025-10-02T08:11:21.066580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.066590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:21.066616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534027115502234:4925]
2025-10-02T08:11:21.066624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:21.066637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.066640Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:21.066724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.066729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.066740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.066770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1155 partition: 0 MaxSeqNo: 17 sessionId: src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0
2025-10-02T08:11:21.067112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e888c-224fd00c-7f91eaa7-c458678a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:21.070085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0] Write session: try to update token
2025-10-02T08:11:21.070101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:21.082436Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:21.082453Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:21.082455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:21.082462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534027115502234:4925]
2025-10-02T08:11:21.082465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534027115502234:4925]
2025-10-02T08:11:21.082494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:21.082494Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:21.082498Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:21.082498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.082499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:21.082620Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:21.084635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId: src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:21.087335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:21.142053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534027115502303:5853]
2025-10-02T08:11:21.142110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1154, pipe: [1:7556534027115502303:5853]
2025-10-02T08:11:21.210614Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:21.210900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.210910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.210949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115502303:5853], now have 1 active actors on pipe
2025-10-02T08:11:21.211053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:21.211058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:21.211096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1155 reason: error at write: Disconnected sessionId: src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0
2025-10-02T08:11:21.211135Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:21.211175Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:21.211259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1155 sessionId: src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0 is DEAD
2025-10-02T08:11:21.211398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534027115502303:5853]
2025-10-02T08:11:21.211436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:21.211449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0] Write session will restart in 0.006505s
2025-10-02T08:11:21.211470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0] Write session: Do CDS request
2025-10-02T08:11:21.211475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:21.219356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.219429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:21.219442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1156
2025-10-02T08:11:21.219575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.219608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:21.219616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:21.219618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:21.219928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1156 sessionId:  describe result for acl check
2025-10-02T08:11:21.219950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:21.219954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:21.219956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:21.219959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534027115502711:4861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:21.220319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534027115502711:4861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:21.222492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534027115502711:4861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:21.224241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:21.224498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:21.224618Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:21.224627Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:21.224635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:21.224671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:21.224700Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534027115502855:4857]
2025-10-02T08:11:21.225132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534027115502711:4861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:21.225144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534027115502711:4861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:21.225146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534027115502711:4861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:21.225152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:21.225413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:21.225612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:21.225654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:21.225914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:21.225949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.225954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.225954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.225955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.225955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.225959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.225965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.225967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.225969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.225971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.225975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.225979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.225983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.225987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.225993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.225996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.225998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.226000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.226006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.226008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.226018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:21.233396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:21.234770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:21.234785Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:21.234787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:21.234790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:21.234794Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1155 [1:7556534027115502855:4857]
2025-10-02T08:11:21.234803Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:21.234818Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:21.234823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.234826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.234827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.234837Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:21.234844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:21.234849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:21.234895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.234900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.234902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:21.234904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:21.234952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:21.234958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.234965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.234976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:21.234989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534027115502849:4857]
2025-10-02T08:11:21.234994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534027115502849:4857]
2025-10-02T08:11:21.235000Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:21.235011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:21.235012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:21.235014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:21.235022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:21.235024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:21.235028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1155
2025-10-02T08:11:21.235031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115502860:4861], now have 1 active actors on pipe
2025-10-02T08:11:21.235052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534027575493082:2378], now have 1 active actors on pipe
2025-10-02T08:11:21.235059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.235062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.235073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534027115502849:4857]
2025-10-02T08:11:21.235079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:21.235098Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7634a934-70a29ac3-85e37054-801c9db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:21.235099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:21.235108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.235111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.235113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:21.235121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.235103Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1155
2025-10-02T08:11:21.235133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:21.235151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.235196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.235201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.235211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.235242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1156 partition: 0 MaxSeqNo: 17 sessionId: src_id|7634a934-70a29ac3-85e37054-801c9db_0
2025-10-02T08:11:21.235650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fd7e57-3a4bfa8-412ed04-84872836_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7634a934-70a29ac3-85e37054-801c9db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:21.238467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7634a934-70a29ac3-85e37054-801c9db_0] Write session: try to update token
2025-10-02T08:11:21.238483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7634a934-70a29ac3-85e37054-801c9db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:21.251278Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:21.251300Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:21.251303Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:21.251311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534027115502849:4857]
2025-10-02T08:11:21.251315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534027115502849:4857]
2025-10-02T08:11:21.251353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:21.251353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:21.251358Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:21.251359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.251361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:21.251491Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:21.253343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId: src_id|7634a934-70a29ac3-85e37054-801c9db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:21.255575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:21.311569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534027115502886:5853]
2025-10-02T08:11:21.311689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1155, pipe: [1:7556534027115502886:5853]
2025-10-02T08:11:21.379878Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:21.380155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.380173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.380212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115502886:5853], now have 1 active actors on pipe
2025-10-02T08:11:21.380313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:21.380320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:21.380370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1156 reason: error at write: Disconnected sessionId: src_id|7634a934-70a29ac3-85e37054-801c9db_0
2025-10-02T08:11:21.380375Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:21.380413Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:21.380533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1156 sessionId: src_id|7634a934-70a29ac3-85e37054-801c9db_0 is DEAD
2025-10-02T08:11:21.380645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534027115502886:5853]
2025-10-02T08:11:21.380725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7634a934-70a29ac3-85e37054-801c9db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:21.380732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7634a934-70a29ac3-85e37054-801c9db_0] Write session will restart in 0.006724s
2025-10-02T08:11:21.380752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7634a934-70a29ac3-85e37054-801c9db_0] Write session: Do CDS request
2025-10-02T08:11:21.380757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7634a934-70a29ac3-85e37054-801c9db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:21.388345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7634a934-70a29ac3-85e37054-801c9db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.388415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:21.388427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1157
2025-10-02T08:11:21.388542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.388571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:21.388579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:21.388582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:21.388905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1157 sessionId:  describe result for acl check
2025-10-02T08:11:21.388928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:21.388932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:21.388933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:21.388936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534027115503356:4851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:21.389267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534027115503356:4851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:21.390967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534027115503356:4851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:21.391121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:21.392228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:21.392470Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:21.392480Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:21.392488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:21.392530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:21.392556Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534027115503450:4852]
2025-10-02T08:11:21.393000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534027115503356:4851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:21.393012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534027115503356:4851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:21.393016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534027115503356:4851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:21.393023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:21.393088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:21.393243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:21.393291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:21.393753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:21.393822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.393829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.393830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.393831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.393832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.393837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.393845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.393853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.393856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.393864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.393870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.393882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.393892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.393901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.393909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.393918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.393922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.393930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.393939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.393947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.393966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:21.401358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:21.402991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:21.403009Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:21.403011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:21.403015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:21.403021Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1156 [1:7556534027115503450:4852]
2025-10-02T08:11:21.403032Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:21.403053Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:21.403060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.403063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.403066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.403083Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:21.403093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:21.403103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:21.403167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.403174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.403178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:21.403180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:21.403241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:21.403248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.403262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.403276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:21.403293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1156
2025-10-02T08:11:21.403300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115503455:4851], now have 1 active actors on pipe
2025-10-02T08:11:21.403303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534027575493089:2378], now have 1 active actors on pipe
2025-10-02T08:11:21.403309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534027115503434:4852]
2025-10-02T08:11:21.403317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534027115503434:4852]
2025-10-02T08:11:21.403330Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:21.403344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.403352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.403352Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:21.403355Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:21.403370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:21.403385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:21.403392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:21.403362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1156
2025-10-02T08:11:21.403426Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:21.403434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.403436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.403441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:21.403447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.403456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:21.403469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534027115503434:4852]
2025-10-02T08:11:21.403479Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:21.403487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:21.403497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.403537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.403543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.403552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.403582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1157 partition: 0 MaxSeqNo: 17 sessionId: src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0
2025-10-02T08:11:21.403887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7634a934-70a29ac3-85e37054-801c9db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:21.406521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0] Write session: try to update token
2025-10-02T08:11:21.406534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:21.419510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId: src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:21.419672Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:21.419684Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:21.419686Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:21.419692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534027115503434:4852]
2025-10-02T08:11:21.419694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534027115503434:4852]
2025-10-02T08:11:21.419732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:21.419741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.419746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:21.419846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:21.419860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:21.419888Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:21.421984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:21.481014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534027115503481:5853]
2025-10-02T08:11:21.481115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1156, pipe: [1:7556534027115503481:5853]
2025-10-02T08:11:21.549898Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:21.550230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.550245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.550289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115503481:5853], now have 1 active actors on pipe
2025-10-02T08:11:21.550422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:21.550429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:21.550442Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:21.550482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1157 reason: error at write: Disconnected sessionId: src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0
2025-10-02T08:11:21.550479Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:21.550649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1157 sessionId: src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0 is DEAD
2025-10-02T08:11:21.550673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534027115503481:5853]
2025-10-02T08:11:21.550791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:21.550798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0] Write session will restart in 0.008443s
2025-10-02T08:11:21.550823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0] Write session: Do CDS request
2025-10-02T08:11:21.550830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:21.560340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.560405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:21.560416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1158
2025-10-02T08:11:21.560534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.560570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:21.560578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:21.560581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:21.560944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1158 sessionId:  describe result for acl check
2025-10-02T08:11:21.560982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:21.560984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:21.560985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:21.560991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534027115503987:4831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:21.561389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534027115503987:4831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:21.562850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:21.563298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534027115503987:4831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:21.564196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:21.564466Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:21.564477Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:21.564488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:21.564541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:21.564577Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534027115504042:4843]
2025-10-02T08:11:21.565123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:21.565303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:21.565347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:21.565656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:21.565710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.565715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.565717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.565718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.565719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.565724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.565727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534027115503987:4831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:21.565732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534027115503987:4831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:21.565736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.565736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534027115503987:4831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:21.565740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.565743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:21.565743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.565747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.565751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.565759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.565765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.565769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.565773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.565776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.565778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.565781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.565784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.565786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.565798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:21.574067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:21.575633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:21.575650Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:21.575652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:21.575655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:21.575661Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1157 [1:7556534027115504042:4843]
2025-10-02T08:11:21.575672Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:21.575686Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:21.575688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.575691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.575694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.575706Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:21.575709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:21.575715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:21.575767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.575774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.575776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:21.575778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:21.575827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:21.575834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.575845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.575855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:21.575884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115504054:4831], now have 1 active actors on pipe
2025-10-02T08:11:21.575895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534027115504026:4843]
2025-10-02T08:11:21.575897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534027115504026:4843]
2025-10-02T08:11:21.575900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1157
2025-10-02T08:11:21.575904Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:21.575914Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:21.575915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:21.575924Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:21.575928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:21.575931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:21.575937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534027575493097:2378], now have 1 active actors on pipe
2025-10-02T08:11:21.575941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.575945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.575976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534027115504026:4843]
2025-10-02T08:11:21.575985Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:21.575996Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:21.575999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:21.576003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.576006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.576007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:21.576014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.576020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:21.576041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.576016Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1157
2025-10-02T08:11:21.576101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.576105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.576115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.576144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1158 partition: 0 MaxSeqNo: 17 sessionId: src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0
2025-10-02T08:11:21.576480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33807b8f-89166703-a5d5aacb-5b4a6b6d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:21.579274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0] Write session: try to update token
2025-10-02T08:11:21.579294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:21.588990Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:21.589010Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:21.589026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534027115504026:4843]
2025-10-02T08:11:21.589069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:21.589068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:21.589251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:21.589380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:21.589506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:21.589648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:21.589998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:21.590037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:21.595356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId: src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:21.598167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:21.598256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.598273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.598310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:21.598333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:21.598616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.598649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.598874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.598953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.599038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.599123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.599182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.599194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.599282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.599381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.599462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.599554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.599606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.599618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.599697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.599774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.599854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.599952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.600005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.600014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.600099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.600182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.600264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.600344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.600399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.600408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.600490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.600574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.600658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.600739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.600821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.600829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.600911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.600988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.601074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.601165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.601228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.601237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.601322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.601394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.601466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.601539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.601589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.601597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.601669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.601737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.601799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.601855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.601895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.601900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.601958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.602010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.602065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.602121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.602160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.602165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.602223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:21.602278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:21.602338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:21.602393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:21.602431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:21.602436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:21.602467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:21.602523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.602538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.602545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:21.602567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:21.602578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:21.602583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:21.602585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:21.602587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:21.602925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:21.602943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:21.602948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:21.602953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:21.602955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:21.602957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:21.603514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:21.603530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:21.603535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:21.603538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:21.603543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:21.603545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:21.603952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:21.603966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:21.603969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:21.603972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:21.603976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:21.605097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:21.605117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:21.605128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392681604
2025-10-02T08:11:21.605327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:21.605342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:21.605348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:21.605353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:21.605356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:21.605359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:21.605839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:21.605862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:21.605866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:21.605870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:21.605875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:21.605878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:21.606355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:21.606371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:21.606375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:21.606378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:21.606380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:21.606382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:21.606787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:21.606803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:21.606806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:21.607727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:21.607740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:21.607743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:21.607745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:21.607751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392681607
2025-10-02T08:11:21.607999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:21.608012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:21.608014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:21.608016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:21.608018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:21.608021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:21.608390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:21.608405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:21.608408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:21.608412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:21.608414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:21.608418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:21.608788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:21.608815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.608884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392681608
2025-10-02T08:11:21.609547Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:21.609561Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:21.609564Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:21.609567Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:21.610990Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:21.611000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:21.611002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:21.611009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534027115504026:4843]
2025-10-02T08:11:21.611011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534027115504026:4843]
2025-10-02T08:11:21.611055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:21.611062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.611063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:21.611075Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:21.611090Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:21.611181Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:21.651053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534027115504084:5853]
2025-10-02T08:11:21.651191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1157, pipe: [1:7556534027115504084:5853]
2025-10-02T08:11:21.741158Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:21.741449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115504084:5853], now have 1 active actors on pipe
2025-10-02T08:11:21.741580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:21.741603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:21.741637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1158 reason: error at write: Disconnected sessionId: src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0
2025-10-02T08:11:21.741706Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:21.741700Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:21.741838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1158 sessionId: src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0 is DEAD
2025-10-02T08:11:21.741954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:21.741966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0] Write session will restart in 0.005664s
2025-10-02T08:11:21.741989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0] Write session: Do CDS request
2025-10-02T08:11:21.741995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:21.742003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534027115504084:5853]
2025-10-02T08:11:21.748291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.748480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:21.748492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1159
2025-10-02T08:11:21.748627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.748659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:21.748668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:21.748671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:21.749081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1159 sessionId:  describe result for acl check
2025-10-02T08:11:21.749116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:21.749125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:21.749126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:21.749131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534027115504443:4826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:21.749610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534027115504443:4826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:21.752034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534027115504443:4826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:21.754220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:21.754663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534027115504443:4826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:21.754675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534027115504443:4826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:21.754678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534027115504443:4826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:21.754685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:21.755895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:21.756076Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:21.756085Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:21.756094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:21.756139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:21.756201Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534027115504651:4829]
2025-10-02T08:11:21.756824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:21.757029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:21.757070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:21.757337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:21.757386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.757392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.757393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.757394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.757394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.757399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.757408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.757411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.757414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.757417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.757422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.757428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.757441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.757449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.757453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.757457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.757461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.757467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.757475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.757479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.757494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:21.765264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:21.766854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:21.766870Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:21.766873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:21.766877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:21.766883Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1158 [1:7556534027115504651:4829]
2025-10-02T08:11:21.766896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:21.766912Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:21.766915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.766917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.766919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.766935Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:21.766939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:21.766945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:21.767005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.767013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.767016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:21.767018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:21.767077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:21.767085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.767097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.767107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:21.767127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534027115504639:4829]
2025-10-02T08:11:21.767133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534027115504639:4829]
2025-10-02T08:11:21.767139Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:21.767151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115504647:4826], now have 1 active actors on pipe
2025-10-02T08:11:21.767160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1158
2025-10-02T08:11:21.767163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:21.767171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:21.767174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:21.767177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:21.767180Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:21.767204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534027575493103:2378], now have 1 active actors on pipe
2025-10-02T08:11:21.767210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534027115504639:4829]
2025-10-02T08:11:21.767216Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:21.767221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.767225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.767235Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:21.767283Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44994591-5375cff2-2001fa84-c9c83e31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:21.767292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.767296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.767297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:21.767305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.767313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:21.767282Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1158
2025-10-02T08:11:21.767337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.767369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.767375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.767386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.767425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1159 partition: 0 MaxSeqNo: 17 sessionId: src_id|44994591-5375cff2-2001fa84-c9c83e31_0
2025-10-02T08:11:21.767789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c479f0-23dc42f7-95f21246-3f3f337e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|44994591-5375cff2-2001fa84-c9c83e31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:21.770837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44994591-5375cff2-2001fa84-c9c83e31_0] Write session: try to update token
2025-10-02T08:11:21.770856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44994591-5375cff2-2001fa84-c9c83e31_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:21.784271Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:21.784290Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:21.784292Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:21.784315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534027115504639:4829]
2025-10-02T08:11:21.784319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534027115504639:4829]
2025-10-02T08:11:21.784359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:21.784361Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:21.784365Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:21.784369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.784371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:21.784507Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:21.786378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId: src_id|44994591-5375cff2-2001fa84-c9c83e31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:21.788850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:21.841990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534027115504675:5853]
2025-10-02T08:11:21.842106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1158, pipe: [1:7556534027115504675:5853]
2025-10-02T08:11:21.923331Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:21.923684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.923696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.923731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115504675:5853], now have 1 active actors on pipe
2025-10-02T08:11:21.923813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:21.923824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:21.923912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1159 reason: error at write: Disconnected sessionId: src_id|44994591-5375cff2-2001fa84-c9c83e31_0
2025-10-02T08:11:21.923909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:21.924075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1159 sessionId: src_id|44994591-5375cff2-2001fa84-c9c83e31_0 is DEAD
2025-10-02T08:11:21.924216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534027115504675:5853]
2025-10-02T08:11:21.924238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44994591-5375cff2-2001fa84-c9c83e31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:21.924252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44994591-5375cff2-2001fa84-c9c83e31_0] Write session will restart in 0.008594s
2025-10-02T08:11:21.924272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44994591-5375cff2-2001fa84-c9c83e31_0] Write session: Do CDS request
2025-10-02T08:11:21.924281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44994591-5375cff2-2001fa84-c9c83e31_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:21.924635Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:21.934362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44994591-5375cff2-2001fa84-c9c83e31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.934454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:21.934467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1160
2025-10-02T08:11:21.934628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:21.934668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:21.934675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:21.934679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:21.935182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1160 sessionId:  describe result for acl check
2025-10-02T08:11:21.935222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:21.935229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:21.935230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:21.935235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534027115505184:4809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:21.935727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534027115505184:4809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:21.937020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:21.937586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534027115505184:4809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:21.938498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:21.938649Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:21.938658Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:21.938666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:21.938706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:21.938742Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534027115505236:4813]
2025-10-02T08:11:21.939308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:21.939503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:21.939545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:21.939787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534027115505184:4809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:21.939796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534027115505184:4809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:21.939798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534027115505184:4809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:21.939802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:21.939940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:21.940005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.940011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.940012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.940013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.940014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.940018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.940028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.940032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.940036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.940040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.940045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.940052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:21.940058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.940063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:21.940067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.940072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:21.940079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.940084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.940090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.940097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.940116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:21.947750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:21.949302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:21.949318Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:21.949321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:21.949325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:21.949331Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1159 [1:7556534027115505236:4813]
2025-10-02T08:11:21.949343Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:21.949360Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:21.949362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.949366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.949368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.949382Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:21.949386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:21.949393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:21.949457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.949465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.949468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:21.949470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:21.949532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:21.949540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.949553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:21.949569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:21.949591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534027115505247:4809], now have 1 active actors on pipe
2025-10-02T08:11:21.949599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1159
2025-10-02T08:11:21.949601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534027115505219:4813]
2025-10-02T08:11:21.949604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534027115505219:4813]
2025-10-02T08:11:21.949615Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:21.949631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:21.949632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534027575493123:2378], now have 1 active actors on pipe
2025-10-02T08:11:21.949640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:21.949641Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:21.949653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:21.949656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:21.949663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.949672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.949710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534027115505219:4813]
2025-10-02T08:11:21.949717Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:21.949725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:21.949695Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1159
2025-10-02T08:11:21.949732Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|947029f9-c26446ae-3bbee199-96c8d874_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:21.949742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:21.949746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:21.949748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:21.949756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:21.949764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:21.949809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.949849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:21.949857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:21.949870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:21.949908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1160 partition: 0 MaxSeqNo: 17 sessionId: src_id|947029f9-c26446ae-3bbee199-96c8d874_0
2025-10-02T08:11:21.950286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44994591-5375cff2-2001fa84-c9c83e31_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|947029f9-c26446ae-3bbee199-96c8d874_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:21.953361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|947029f9-c26446ae-3bbee199-96c8d874_0] Write session: try to update token
2025-10-02T08:11:21.953386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|947029f9-c26446ae-3bbee199-96c8d874_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:21.966786Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:21.966803Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:21.966805Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:21.966812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534027115505219:4813]
2025-10-02T08:11:21.966815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534027115505219:4813]
2025-10-02T08:11:21.966849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:21.966855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:21.966856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:21.966862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:21.966868Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:21.966994Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:21.969447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId: src_id|947029f9-c26446ae-3bbee199-96c8d874_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:21.971794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:22.024242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534031410472574:5853]
2025-10-02T08:11:22.024344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1159, pipe: [1:7556534031410472574:5853]
2025-10-02T08:11:22.097166Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:22.097457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.097472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.097508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410472574:5853], now have 1 active actors on pipe
2025-10-02T08:11:22.097630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534031410472574:5853]
2025-10-02T08:11:22.097653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:22.097655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:22.097683Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:22.097707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1160 reason: error at write: Disconnected sessionId: src_id|947029f9-c26446ae-3bbee199-96c8d874_0
2025-10-02T08:11:22.097683Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:22.097869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1160 sessionId: src_id|947029f9-c26446ae-3bbee199-96c8d874_0 is DEAD
2025-10-02T08:11:22.098026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|947029f9-c26446ae-3bbee199-96c8d874_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:22.098036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|947029f9-c26446ae-3bbee199-96c8d874_0] Write session will restart in 0.007495s
2025-10-02T08:11:22.098061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|947029f9-c26446ae-3bbee199-96c8d874_0] Write session: Do CDS request
2025-10-02T08:11:22.098068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|947029f9-c26446ae-3bbee199-96c8d874_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:22.106412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|947029f9-c26446ae-3bbee199-96c8d874_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.106479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:22.106495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1161
2025-10-02T08:11:22.106738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.106779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:22.106788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:22.106791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:22.107115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1161 sessionId:  describe result for acl check
2025-10-02T08:11:22.107140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:22.107144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:22.107146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:22.107149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534031410473009:4781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:22.107649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534031410473009:4781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:22.110289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534031410473009:4781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:22.111044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:22.112311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:22.112568Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:22.112576Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:22.112584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:22.112620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:22.112647Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534031410473139:4782]
2025-10-02T08:11:22.113005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534031410473009:4781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:22.113016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534031410473009:4781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:22.113018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534031410473009:4781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:22.113024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:22.113198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:22.113356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:22.113399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:22.113683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:22.113737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.113743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.113744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.113745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.113746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.113751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.113760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.113764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.113767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.113771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.113775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.113782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.113787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.113791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.113795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.113800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.113803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.113807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.113812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.113816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.113833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:22.121363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:22.123046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:22.123063Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:22.123065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:22.123068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:22.123073Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1160 [1:7556534031410473139:4782]
2025-10-02T08:11:22.123084Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:22.123096Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:22.123098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.123100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.123102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.123113Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:22.123116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:22.123121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:22.123166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.123174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.123176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:22.123178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:22.123225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:22.123231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.123238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.123247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:22.123258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534031410473130:4782]
2025-10-02T08:11:22.123262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534031410473130:4782]
2025-10-02T08:11:22.123269Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:22.123277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410473144:4781], now have 1 active actors on pipe
2025-10-02T08:11:22.123280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1160
2025-10-02T08:11:22.123286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:22.123288Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:22.123290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:22.123293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:22.123296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:22.123300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.123302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.123334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534031870460428:2378], now have 1 active actors on pipe
2025-10-02T08:11:22.123339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534031410473130:4782]
2025-10-02T08:11:22.123345Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:22.123353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:22.123354Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:22.123359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.123361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.123362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:22.123368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.123374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:22.123395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.123430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.123435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.123443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.123393Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1160
2025-10-02T08:11:22.123470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1161 partition: 0 MaxSeqNo: 17 sessionId: src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0
2025-10-02T08:11:22.123854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|947029f9-c26446ae-3bbee199-96c8d874_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:22.126838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0] Write session: try to update token
2025-10-02T08:11:22.126857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:22.139973Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:22.139991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:22.139993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:22.139999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534031410473130:4782]
2025-10-02T08:11:22.140005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534031410473130:4782]
2025-10-02T08:11:22.140039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:22.140044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.140045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:22.140049Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:22.140054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:22.140169Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:22.141644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId: src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:22.144245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:22.197842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534031410473205:5853]
2025-10-02T08:11:22.197967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1160, pipe: [1:7556534031410473205:5853]
2025-10-02T08:11:22.268017Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:22.268311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.268321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.268356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410473205:5853], now have 1 active actors on pipe
2025-10-02T08:11:22.268444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534031410473205:5853]
2025-10-02T08:11:22.268459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:22.268460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:22.268500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1161 reason: error at write: Disconnected sessionId: src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0
2025-10-02T08:11:22.268550Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:22.268651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1161 sessionId: src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0 is DEAD
2025-10-02T08:11:22.268615Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:22.268791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:22.268823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0] Write session will restart in 0.009355s
2025-10-02T08:11:22.268851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0] Write session: Do CDS request
2025-10-02T08:11:22.268859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:22.279303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.279380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:22.279395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1162
2025-10-02T08:11:22.279481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.279502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:22.279505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:22.279508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:22.279821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1162 sessionId:  describe result for acl check
2025-10-02T08:11:22.279849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:22.279854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:22.279855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:22.279860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534031410473724:4739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:22.280355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534031410473724:4739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:22.280843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:22.281711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:22.282014Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:22.282022Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:22.282031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:22.282073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:22.282075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534031410473724:4739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:22.282101Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534031410473761:4740]
2025-10-02T08:11:22.282515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:22.282629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:22.282656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:22.282868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:22.282914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.282920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.282921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.282921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.282922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.282926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.282934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.282937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.282940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.282942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.282947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.282953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.282960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.282964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.282969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.282975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.282978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.282982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.282986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.282990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.283008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:22.288007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534031410473724:4739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:22.288021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534031410473724:4739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:22.288023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534031410473724:4739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:22.288030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:22.291462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:22.293301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:22.293318Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:22.293320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:22.293323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:22.293330Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1161 [1:7556534031410473761:4740]
2025-10-02T08:11:22.293340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:22.293355Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:22.293357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.293360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.293362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.293376Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:22.293381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:22.293387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:22.293435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.293440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.293443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:22.293445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:22.293502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:22.293510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.293521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.293530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:22.293540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1161
2025-10-02T08:11:22.293547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410473788:4739], now have 1 active actors on pipe
2025-10-02T08:11:22.293554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534031870460456:2378], now have 1 active actors on pipe
2025-10-02T08:11:22.293559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534031410473742:4740]
2025-10-02T08:11:22.293561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534031410473742:4740]
2025-10-02T08:11:22.293577Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:22.293585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.293587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:22.293589Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:22.293590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.293608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:22.293625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:22.293630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:22.293649Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1161
2025-10-02T08:11:22.293666Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:22.293676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.293679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.293680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:22.293688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.293695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:22.293701Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534031410473742:4740]
2025-10-02T08:11:22.293710Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:22.293720Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:22.293738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.293809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.293816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.293829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.293858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1162 partition: 0 MaxSeqNo: 17 sessionId: src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0
2025-10-02T08:11:22.294190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcbcdd4a-ae9e2b72-ab42de93-c018d6ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:22.296754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0] Write session: try to update token
2025-10-02T08:11:22.296768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:22.310686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId: src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:22.312410Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:22.312429Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:22.312430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:22.312437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534031410473742:4740]
2025-10-02T08:11:22.312440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534031410473742:4740]
2025-10-02T08:11:22.312471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:22.312476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.312477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:22.312492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:22.312498Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:22.312620Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:22.313349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:22.368864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534031410473804:5853]
2025-10-02T08:11:22.368951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1161, pipe: [1:7556534031410473804:5853]
2025-10-02T08:11:22.442425Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:22.442757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.442770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.442808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410473804:5853], now have 1 active actors on pipe
2025-10-02T08:11:22.442910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534031410473804:5853]
2025-10-02T08:11:22.442931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:22.442938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:22.442987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1162 reason: error at write: Disconnected sessionId: src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0
2025-10-02T08:11:22.443003Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:22.443066Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:22.443158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1162 sessionId: src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0 is DEAD
2025-10-02T08:11:22.443307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:22.443317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0] Write session will restart in 0.007018s
2025-10-02T08:11:22.443339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0] Write session: Do CDS request
2025-10-02T08:11:22.443346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:22.451458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.451609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:22.451638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1163
2025-10-02T08:11:22.451815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.451850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:22.451856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:22.451860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:22.452320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1163 sessionId:  describe result for acl check
2025-10-02T08:11:22.452359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:22.452365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:22.452367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:22.452371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534031410474196:4730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:22.452854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534031410474196:4730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:22.454955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534031410474196:4730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:22.457496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:22.457798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534031410474196:4730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:22.457815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534031410474196:4730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:22.457817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534031410474196:4730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:22.457825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:22.458589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:22.458806Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:22.458815Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:22.458823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:22.458857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:22.458884Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534031410474378:4736]
2025-10-02T08:11:22.459289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:22.459426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:22.459451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:22.459654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:22.459686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.459689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.459690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.459691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.459692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.459694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.459701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.459703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.459705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.459707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.459711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.459715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.459718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.459721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.459723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.459726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.459728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.459730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.459733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.459736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.459745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:22.468456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:22.470096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:22.470114Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:22.470117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:22.470120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:22.470127Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1162 [1:7556534031410474378:4736]
2025-10-02T08:11:22.470139Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:22.470155Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:22.470158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.470160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.470163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.470177Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:22.470183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:22.470189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:22.470258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.470267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.470270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:22.470273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:22.470359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:22.470366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.470380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.470396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:22.470418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410474373:4730], now have 1 active actors on pipe
2025-10-02T08:11:22.470430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534031410474366:4736]
2025-10-02T08:11:22.470432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534031410474366:4736]
2025-10-02T08:11:22.470441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:22.470441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1162
2025-10-02T08:11:22.470450Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:22.470453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:22.470455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534031870460464:2378], now have 1 active actors on pipe
2025-10-02T08:11:22.470464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:22.470478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:22.470481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:22.470488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.470497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.470539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534031410474366:4736]
2025-10-02T08:11:22.470546Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:22.470530Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1162
2025-10-02T08:11:22.470557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:22.470561Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:22.470568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.470572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.470574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:22.470583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.470593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:22.470636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.470688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.470694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.470707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.470749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1163 partition: 0 MaxSeqNo: 17 sessionId: src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0
2025-10-02T08:11:22.471099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e0cd5a1-a2c34c48-8c04933e-29d13961_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:22.474095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0] Write session: try to update token
2025-10-02T08:11:22.474113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:22.488498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId: src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:22.489976Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:22.489995Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:22.489997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:22.490004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534031410474366:4736]
2025-10-02T08:11:22.490008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534031410474366:4736]
2025-10-02T08:11:22.490051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:22.490062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.490064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:22.490072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:22.490077Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:22.490196Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:22.490851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:22.542926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534031410474407:5853]
2025-10-02T08:11:22.543059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1162, pipe: [1:7556534031410474407:5853]
2025-10-02T08:11:22.626616Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:22.627074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.627090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.627130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410474407:5853], now have 1 active actors on pipe
2025-10-02T08:11:22.627250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534031410474407:5853]
2025-10-02T08:11:22.627282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:22.627290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:22.627327Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:22.627348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1163 reason: error at write: Disconnected sessionId: src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0
2025-10-02T08:11:22.627349Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:22.627529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1163 sessionId: src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0 is DEAD
2025-10-02T08:11:22.627661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:22.627671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0] Write session will restart in 0.006373s
2025-10-02T08:11:22.627696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0] Write session: Do CDS request
2025-10-02T08:11:22.627703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:22.635344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.635420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:22.635435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1164
2025-10-02T08:11:22.635535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.635560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:22.635572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:22.635574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:22.635950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1164 sessionId:  describe result for acl check
2025-10-02T08:11:22.635979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:22.635981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:22.635982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:22.635987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534031410474746:4717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:22.636466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534031410474746:4717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:22.639259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534031410474746:4717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:22.642787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534031410474746:4717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:22.642803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534031410474746:4717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:22.642806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534031410474746:4717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:22.642813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:22.644368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:22.644797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:22.644991Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:22.645003Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:22.645012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:22.645063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:22.645099Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534031410474985:4715]
2025-10-02T08:11:22.645694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:22.645874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:22.645917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:22.646205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:22.646254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.646260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.646262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.646263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.646264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.646269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.646279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.646286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.646290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.646298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.646305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.646311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.646316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.646321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.646329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.646334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.646342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.646347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.646355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.646359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.646381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:22.654887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:22.656711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:22.656729Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:22.656731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:22.656734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:22.656738Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1163 [1:7556534031410474985:4715]
2025-10-02T08:11:22.656745Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:22.656757Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:22.656759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.656761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.656763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.656778Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:22.656788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:22.656796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:22.656866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.656874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.656876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:22.656877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:22.656923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:22.656925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.656937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.656951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:22.656970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534031410474979:4715]
2025-10-02T08:11:22.656972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534031410474979:4715]
2025-10-02T08:11:22.656978Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:22.656986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1163
2025-10-02T08:11:22.656991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:22.656994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:22.656996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410474975:4717], now have 1 active actors on pipe
2025-10-02T08:11:22.657000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534031870460473:2378], now have 1 active actors on pipe
2025-10-02T08:11:22.657006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:22.657019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:22.657025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:22.657031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.657035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.657068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534031410474979:4715]
2025-10-02T08:11:22.657074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:22.657082Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:22.657087Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:22.657092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.657094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.657096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:22.657101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.657108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:22.657085Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1163
2025-10-02T08:11:22.657129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.657171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.657177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.657188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.657222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1164 partition: 0 MaxSeqNo: 17 sessionId: src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0
2025-10-02T08:11:22.657544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32d1e94-764f3ca0-edb8ed15-70c050c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:22.660156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0] Write session: try to update token
2025-10-02T08:11:22.660168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:22.673341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId: src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:22.675991Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:22.676008Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:22.676010Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:22.676017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534031410474979:4715]
2025-10-02T08:11:22.676021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534031410474979:4715]
2025-10-02T08:11:22.676050Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:22.676052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:22.676058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.676059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:22.676061Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:22.676180Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:22.676184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:22.727223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534031410475012:5853]
2025-10-02T08:11:22.727334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1163, pipe: [1:7556534031410475012:5853]
2025-10-02T08:11:22.799857Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:22.800102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.800114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.800145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410475012:5853], now have 1 active actors on pipe
2025-10-02T08:11:22.800255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534031410475012:5853]
2025-10-02T08:11:22.800276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:22.800281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:22.800309Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:22.800341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1164 reason: error at write: Disconnected sessionId: src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0
2025-10-02T08:11:22.800501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1164 sessionId: src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0 is DEAD
2025-10-02T08:11:22.800714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:22.800731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0] Write session will restart in 0.007084s
2025-10-02T08:11:22.800758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0] Write session: Do CDS request
2025-10-02T08:11:22.800736Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:22.800769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:22.809430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.809466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:22.809483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1165
2025-10-02T08:11:22.809927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.809965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:22.809970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:22.809973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:22.810370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1165 sessionId:  describe result for acl check
2025-10-02T08:11:22.810405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:22.810411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:22.810413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:22.810418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534031410475479:4688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:22.810924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534031410475479:4688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:22.813188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534031410475479:4688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:22.814759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:22.815003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:22.815219Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:22.815228Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:22.815235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:22.815277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:22.815314Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534031410475583:4683]
2025-10-02T08:11:22.815338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534031410475479:4688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:22.815350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534031410475479:4688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:22.815354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534031410475479:4688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:22.815376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:22.815788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:22.815942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:22.815977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:22.816177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:22.816204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.816208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.816209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.816209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.816210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.816214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.816223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.816227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.816230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.816233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.816238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.816245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:22.816249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.816252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:22.816254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.816256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:22.816260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.816262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.816265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.816268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.816286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:22.824750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:22.826297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:22.826311Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:22.826313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:22.826315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:22.826319Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1164 [1:7556534031410475583:4683]
2025-10-02T08:11:22.826327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:22.826338Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:22.826340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.826342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.826344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.826358Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:22.826363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:22.826370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:22.826422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.826430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.826433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:22.826435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:22.826491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:22.826498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.826509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:22.826523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:22.826540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1164
2025-10-02T08:11:22.826562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410475588:4688], now have 1 active actors on pipe
2025-10-02T08:11:22.826571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534031870460479:2378], now have 1 active actors on pipe
2025-10-02T08:11:22.826576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534031410475576:4683]
2025-10-02T08:11:22.826582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534031410475576:4683]
2025-10-02T08:11:22.826603Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:22.826616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.826617Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:22.826620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:22.826624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.826642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:22.826660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:22.826667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:22.826659Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1164
2025-10-02T08:11:22.826705Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1195685c-7e5e0751-d5200fff-449d878f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:22.826715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.826719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.826725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:22.826732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.826740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:22.826747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534031410475576:4683]
2025-10-02T08:11:22.826758Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:22.826775Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:22.826787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.826867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.826875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.826888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:22.826919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1165 partition: 0 MaxSeqNo: 17 sessionId: src_id|1195685c-7e5e0751-d5200fff-449d878f_0
2025-10-02T08:11:22.827210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd2fef2f-bfacf126-9985c6bf-3361dc42_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1195685c-7e5e0751-d5200fff-449d878f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:22.829773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1195685c-7e5e0751-d5200fff-449d878f_0] Write session: try to update token
2025-10-02T08:11:22.829787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1195685c-7e5e0751-d5200fff-449d878f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:22.837631Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:22.837652Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:22.837659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534031410475576:4683]
2025-10-02T08:11:22.837697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:22.837714Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:22.837873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:22.838016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:22.838147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:22.838276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:22.838466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:22.838506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:22.842397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId: src_id|1195685c-7e5e0751-d5200fff-449d878f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:22.844842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:22.844940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.844956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.844988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:22.845014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:22.845168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:22.845185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:22.845404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.845492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.845576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.845648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.846010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.846024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.846098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.846164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.846231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.846302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.846352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.846360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.846434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.846502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.846567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.846630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.846672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.846679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.846745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.846811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.846882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.846949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.847001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.847008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.847074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.847140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.847227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.847296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.847346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.847354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.847424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.847490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.847564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.847631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.847677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.847685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.847759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.847840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.847922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.847992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.848035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.848046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.848118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.848186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.848272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.848337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.848381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.848387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.848450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.848513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.848575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.848640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.848685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.848692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.848759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:22.848844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:22.848910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:22.848980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:22.849031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:22.849038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:22.849071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:22.849134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:22.849156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:22.849162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:22.849188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:22.849201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:22.849206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:22.849209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:22.849212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:22.849564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:22.849584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:22.849590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:22.849594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:22.849595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:22.849597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:22.850233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:22.850251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:22.850257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:22.850263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:22.850265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:22.850266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:22.850729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:22.850751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:22.850759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:22.850761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:22.850763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:22.851928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:22.851943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:22.851953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392682851
2025-10-02T08:11:22.852053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:22.852065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:22.852072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:22.852075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:22.852079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:22.852087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:22.852634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:22.852660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:22.852671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:22.852679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:22.852682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:22.852685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:22.853186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:22.853209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:22.853216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:22.853223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:22.853226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:22.853230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:22.853701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:22.853726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:22.853731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:22.854851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:22.854874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:22.854879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:22.854888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:22.854898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392682854
2025-10-02T08:11:22.855198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:22.855225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:22.855237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:22.855244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:22.855247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:22.855254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:22.855728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:22.855754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:22.855764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:22.855767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:22.855775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:22.855779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:22.856295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:22.856320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:22.856419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392682856
2025-10-02T08:11:22.857231Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:22.857252Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:22.857259Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:22.857265Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:22.858964Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:22.858982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:22.858984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:22.858995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534031410475576:4683]
2025-10-02T08:11:22.858999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534031410475576:4683]
2025-10-02T08:11:22.859045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:22.859054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:22.859058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:22.859059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:22.859060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:22.859199Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:22.900301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534031410475622:5853]
2025-10-02T08:11:22.900416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1164, pipe: [1:7556534031410475622:5853]
2025-10-02T08:11:22.986145Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:22.986434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534031410475622:5853], now have 1 active actors on pipe
2025-10-02T08:11:22.986549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:22.986554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:22.986573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1165 reason: error at write: Disconnected sessionId: src_id|1195685c-7e5e0751-d5200fff-449d878f_0
2025-10-02T08:11:22.986578Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:22.986632Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:22.986705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1165 sessionId: src_id|1195685c-7e5e0751-d5200fff-449d878f_0 is DEAD
2025-10-02T08:11:22.986823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1195685c-7e5e0751-d5200fff-449d878f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:22.986832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1195685c-7e5e0751-d5200fff-449d878f_0] Write session will restart in 0.006281s
2025-10-02T08:11:22.986850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1195685c-7e5e0751-d5200fff-449d878f_0] Write session: Do CDS request
2025-10-02T08:11:22.986855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1195685c-7e5e0751-d5200fff-449d878f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:22.986851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534031410475622:5853]
2025-10-02T08:11:22.994241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1195685c-7e5e0751-d5200fff-449d878f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.994398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:22.994420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1166
2025-10-02T08:11:22.994517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:22.994538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:22.994545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:22.994547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:22.994866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1166 sessionId:  describe result for acl check
2025-10-02T08:11:22.994890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:22.994892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:22.994893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:22.994896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534031410476009:4693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:22.995253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534031410476009:4693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:22.998021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534031410476009:4693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:23.000446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:23.001716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:23.001871Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:23.001881Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:23.001890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:23.001935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:23.001967Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534035705443501:4692]
2025-10-02T08:11:23.001971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534031410476009:4693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:23.001976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534031410476009:4693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:23.001979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534031410476009:4693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:23.001984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:23.002534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:23.002707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:23.002751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:23.003043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:23.003098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.003105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.003107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.003108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.003109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.003114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.003123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.003126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.003138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.003141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.003146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.003157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.003167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.003174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.003178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.003183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.003186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.003191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.003197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.003202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.003224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:23.011004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:23.012647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:23.012669Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:23.012672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:23.012675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:23.012681Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1165 [1:7556534035705443501:4692]
2025-10-02T08:11:23.012693Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:23.012710Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:23.012717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.012719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.012721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.012736Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:23.012745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:23.012752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:23.012837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.012846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.012850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:23.012852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:23.012918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:23.012929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.012944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.012956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:23.012958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1165
2025-10-02T08:11:23.012974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705443506:4693], now have 1 active actors on pipe
2025-10-02T08:11:23.012979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534031870460502:2378], now have 1 active actors on pipe
2025-10-02T08:11:23.012984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.012993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.013010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534035705443495:4692]
2025-10-02T08:11:23.013017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534035705443495:4692]
2025-10-02T08:11:23.013027Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:23.013044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:23.013045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:23.013058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:23.013060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:23.013063Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:23.013076Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5a10599-d47baf60-563e8596-70c65865_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:23.013086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.013047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1165
2025-10-02T08:11:23.013090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.013092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:23.013101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.013110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:23.013142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534035705443495:4692]
2025-10-02T08:11:23.013154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:23.013173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.013174Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:23.013232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.013243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.013256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.013289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1166 partition: 0 MaxSeqNo: 17 sessionId: src_id|a5a10599-d47baf60-563e8596-70c65865_0
2025-10-02T08:11:23.013585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1195685c-7e5e0751-d5200fff-449d878f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a5a10599-d47baf60-563e8596-70c65865_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:23.016052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a10599-d47baf60-563e8596-70c65865_0] Write session: try to update token
2025-10-02T08:11:23.016066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a10599-d47baf60-563e8596-70c65865_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:23.023694Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:23.023712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:23.023721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534035705443495:4692]
2025-10-02T08:11:23.023753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:23.023774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:23.023941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:23.024141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:23.024327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:23.024534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:23.024898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:23.024965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:23.030123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId: src_id|a5a10599-d47baf60-563e8596-70c65865_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:23.032495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:23.032566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.032579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.032610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:23.032640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:23.032692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.032708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.032884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.032960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.033039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.033118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.033245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.033260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.033342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.033423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.033499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.033573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.033620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.033628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.033705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.033776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.033851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.033933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.033987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.033996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.034075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.034155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.034229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.034311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.034363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.034370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.034447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.034523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.034606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.034683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.034735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.034743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.034828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.034911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.034993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.035073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.035128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.035136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.035217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.035297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.035384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.035460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.035513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.035521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.035599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.035679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.035761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.035842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.035904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.035911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.035993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.036080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.036161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.036238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.036297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.036306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.036384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:23.036476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:23.036554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:23.036637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:23.036686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:23.036694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:23.036734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:23.036820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.036847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.036850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:23.036884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:23.036898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:23.036901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:23.036907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:23.036909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:23.037437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:23.037473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:23.037482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:23.037485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:23.037488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:23.037491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:23.038200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:23.038229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:23.038235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:23.038238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:23.038241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:23.038246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:23.038751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:23.038773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:23.038778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:23.038781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:23.038784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:23.039987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:23.040002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:23.040010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392683040
2025-10-02T08:11:23.040136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:23.040146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:23.040149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:23.040151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:23.040153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:23.040155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:23.040549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:23.040565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:23.040569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:23.040571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:23.040575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:23.040581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:23.040985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:23.041001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:23.041009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:23.041010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:23.041013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:23.041015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:23.041399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:23.041417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:23.041420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:23.042345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:23.042363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:23.042366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:23.042368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:23.042374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392683042
2025-10-02T08:11:23.042650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:23.042667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:23.042674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:23.042678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:23.042683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:23.042685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:23.043067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:23.043082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:23.043087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:23.043089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:23.043095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:23.043098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:23.043474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:23.043489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.043562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392683043
2025-10-02T08:11:23.044237Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:23.044249Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:23.044253Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:23.044256Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:23.045632Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:23.045644Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:23.045645Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:23.045652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534035705443495:4692]
2025-10-02T08:11:23.045654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534035705443495:4692]
2025-10-02T08:11:23.045697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:23.045703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.045704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:23.045707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:23.045710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:23.045816Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:23.087149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534035705443544:5853]
2025-10-02T08:11:23.087219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1165, pipe: [1:7556534035705443544:5853]
2025-10-02T08:11:23.169898Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:23.170184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705443544:5853], now have 1 active actors on pipe
2025-10-02T08:11:23.170332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:23.170341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:23.170364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1166 reason: error at write: Disconnected sessionId: src_id|a5a10599-d47baf60-563e8596-70c65865_0
2025-10-02T08:11:23.170411Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:23.170413Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:23.170544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1166 sessionId: src_id|a5a10599-d47baf60-563e8596-70c65865_0 is DEAD
2025-10-02T08:11:23.170684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534035705443544:5853]
2025-10-02T08:11:23.170708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a10599-d47baf60-563e8596-70c65865_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:23.170716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a10599-d47baf60-563e8596-70c65865_0] Write session will restart in 0.007979s
2025-10-02T08:11:23.170734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a10599-d47baf60-563e8596-70c65865_0] Write session: Do CDS request
2025-10-02T08:11:23.170739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a10599-d47baf60-563e8596-70c65865_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:23.180248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a10599-d47baf60-563e8596-70c65865_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.180304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:23.180320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1167
2025-10-02T08:11:23.180598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.180627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:23.180633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:23.180636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:23.180919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1167 sessionId:  describe result for acl check
2025-10-02T08:11:23.180940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:23.180946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:23.180947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:23.180949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534035705444034:4676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:23.181203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534035705444034:4676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:23.183942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534035705444034:4676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:23.185590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:23.185927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:23.186131Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:23.186141Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:23.186151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:23.186200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:23.186235Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534035705444193:4680]
2025-10-02T08:11:23.186813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:23.186961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:23.186997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:23.187275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:23.187321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.187326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.187328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.187329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.187330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.187335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.187345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.187349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.187353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.187361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.187366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.187377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.187382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.187387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.187391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.187396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.187402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.187407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.187414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.187419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.187441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:23.187729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534035705444034:4676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:23.187739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534035705444034:4676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:23.187743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534035705444034:4676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:23.187750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:23.195146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:23.196541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:23.196559Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:23.196562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:23.196565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:23.196571Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1166 [1:7556534035705444193:4680]
2025-10-02T08:11:23.196581Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:23.196595Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:23.196598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.196600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.196604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.196617Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:23.196627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:23.196634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:23.196688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.196695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.196698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:23.196700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:23.196761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:23.196768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.196779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.196793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:23.196835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705444209:4676], now have 1 active actors on pipe
2025-10-02T08:11:23.196848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534035705444187:4680]
2025-10-02T08:11:23.196850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534035705444187:4680]
2025-10-02T08:11:23.196861Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:23.196868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534036165427806:2378], now have 1 active actors on pipe
2025-10-02T08:11:23.196874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:23.196874Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:23.196877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:23.196886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:23.196889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:23.196915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534035705444187:4680]
2025-10-02T08:11:23.196922Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:23.196925Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1166
2025-10-02T08:11:23.196960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1166
2025-10-02T08:11:23.196965Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:23.196972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.196975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.197002Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:23.197012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.197016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.197018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:23.197026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.197038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:23.197056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.197086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.197091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.197102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.197137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1167 partition: 0 MaxSeqNo: 17 sessionId: src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0
2025-10-02T08:11:23.197462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a10599-d47baf60-563e8596-70c65865_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:23.199998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0] Write session: try to update token
2025-10-02T08:11:23.200014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:23.213471Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:23.213490Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:23.213492Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:23.213499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534035705444187:4680]
2025-10-02T08:11:23.213502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534035705444187:4680]
2025-10-02T08:11:23.213538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:23.213544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.213545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:23.213562Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:23.213576Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:23.213678Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:23.215963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId: src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:23.218366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:23.270999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534035705444248:5853]
2025-10-02T08:11:23.271098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1166, pipe: [1:7556534035705444248:5853]
2025-10-02T08:11:23.353765Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:23.354056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.354066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.354105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705444248:5853], now have 1 active actors on pipe
2025-10-02T08:11:23.354208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:23.354220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:23.354306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1167 reason: error at write: Disconnected sessionId: src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0
2025-10-02T08:11:23.354353Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:23.354547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1167 sessionId: src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0 is DEAD
2025-10-02T08:11:23.354636Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:23.354677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:23.354687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0] Write session will restart in 0.009541s
2025-10-02T08:11:23.354710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0] Write session: Do CDS request
2025-10-02T08:11:23.354717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:23.354714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534035705444248:5853]
2025-10-02T08:11:23.365251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.365345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:23.365362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1168
2025-10-02T08:11:23.365484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.365507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:23.365512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:23.365515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:23.365864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1168 sessionId:  describe result for acl check
2025-10-02T08:11:23.365898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:23.365904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:23.365905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:23.365910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534035705444844:4641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:23.366259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:23.366346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534035705444844:4641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:23.366903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:23.367028Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:23.367035Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:23.367041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:23.367070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:23.367093Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534035705444867:4657]
2025-10-02T08:11:23.367621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:23.367780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:23.367808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:23.367937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534035705444844:4641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:23.368018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:23.368051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.368057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.368058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.368059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.368060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.368064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.368072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.368075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.368079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.368082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.368086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.368092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.368096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.368100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.368103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.368108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.368111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.368115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.368118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.368122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.368138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:23.373760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534035705444844:4641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:23.373784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534035705444844:4641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:23.373788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534035705444844:4641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:23.373796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:23.375681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:23.377343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:23.377366Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:23.377368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:23.377372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:23.377379Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1167 [1:7556534035705444867:4657]
2025-10-02T08:11:23.377391Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:23.377406Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:23.377409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.377413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.377414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.377431Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:23.377436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:23.377444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:23.377506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.377515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.377518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:23.377521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:23.377582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:23.377590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.377606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.377623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:23.377634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1167
2025-10-02T08:11:23.377646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705444898:4641], now have 1 active actors on pipe
2025-10-02T08:11:23.377649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534036165427834:2378], now have 1 active actors on pipe
2025-10-02T08:11:23.377655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534035705444847:4657]
2025-10-02T08:11:23.377662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534035705444847:4657]
2025-10-02T08:11:23.377672Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:23.377685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.377685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:23.377689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:23.377694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.377712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:23.377728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:23.377735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:23.377777Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:23.377788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.377792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.377799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:23.377766Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1167
2025-10-02T08:11:23.377808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.377820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:23.377833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534035705444847:4657]
2025-10-02T08:11:23.377845Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:23.377856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:23.377880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.377976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.377986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.378000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.378035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1168 partition: 0 MaxSeqNo: 17 sessionId: src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0
2025-10-02T08:11:23.378339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a172694b-4fc9200c-db7c061b-1ef12b95_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:23.380779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0] Write session: try to update token
2025-10-02T08:11:23.380792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:23.394449Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:23.394467Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:23.394469Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:23.394478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534035705444847:4657]
2025-10-02T08:11:23.394482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534035705444847:4657]
2025-10-02T08:11:23.394520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:23.394526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.394528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:23.394529Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:23.394533Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:23.394651Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:23.394957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId: src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:23.397373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:23.454796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534035705444913:5853]
2025-10-02T08:11:23.454915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1167, pipe: [1:7556534035705444913:5853]
2025-10-02T08:11:23.520656Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:23.520890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.520902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.520932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705444913:5853], now have 1 active actors on pipe
2025-10-02T08:11:23.521020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:23.521026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:23.521063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1168 reason: error at write: Disconnected sessionId: src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0
2025-10-02T08:11:23.521145Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:23.521172Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:23.521189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1168 sessionId: src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0 is DEAD
2025-10-02T08:11:23.521297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534035705444913:5853]
2025-10-02T08:11:23.521340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:23.521347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0] Write session will restart in 0.006624s
2025-10-02T08:11:23.521372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0] Write session: Do CDS request
2025-10-02T08:11:23.521377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:23.529248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.529419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:23.529432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1169
2025-10-02T08:11:23.529539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.529560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:23.529563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:23.529566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:23.529953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1169 sessionId:  describe result for acl check
2025-10-02T08:11:23.529999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:23.530001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:23.530003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:23.530008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534035705445348:4649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:23.530395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534035705445348:4649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:23.532655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534035705445348:4649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:23.534916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534035705445348:4649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:23.534930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534035705445348:4649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:23.534933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534035705445348:4649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:23.534940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:23.535001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:23.535666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:23.535826Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:23.535835Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:23.535843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:23.535893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:23.535925Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534035705445556:4651]
2025-10-02T08:11:23.536391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:23.536542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:23.536567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:23.536749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:23.536779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.536780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.536781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.536782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.536783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.536787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.536796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.536837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.536846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.536849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.536854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.536861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.536867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.536871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.536880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.536887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.536891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.536896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.536902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.536907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.536925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:23.544255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:23.545777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:23.545789Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:23.545790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:23.545793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:23.545797Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1168 [1:7556534035705445556:4651]
2025-10-02T08:11:23.545804Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:23.545814Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:23.545816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.545818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.545819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.545830Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:23.545833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:23.545838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:23.545880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.545882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.545888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:23.545891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:23.545937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:23.545943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.545950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.545957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:23.545970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705445548:4649], now have 1 active actors on pipe
2025-10-02T08:11:23.545974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534035705445544:4651]
2025-10-02T08:11:23.545975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534035705445544:4651]
2025-10-02T08:11:23.545980Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:23.545986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534036165427841:2378], now have 1 active actors on pipe
2025-10-02T08:11:23.545991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:23.545993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:23.545995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1168
2025-10-02T08:11:23.545997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:23.545998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:23.546000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:23.546021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534035705445544:4651]
2025-10-02T08:11:23.546029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:23.546033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.546036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.546035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1168
2025-10-02T08:11:23.546066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:23.546072Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:23.546077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.546080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.546081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:23.546089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.546095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:23.546111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.546142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.546146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.546155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.546191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1169 partition: 0 MaxSeqNo: 17 sessionId: src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0
2025-10-02T08:11:23.546545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d8dc35-bf9f8d1-d2fadf4f-d6730528_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:23.548978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0] Write session: try to update token
2025-10-02T08:11:23.548992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:23.561066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId: src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:23.561765Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:23.561777Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:23.561779Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:23.561785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534035705445544:4651]
2025-10-02T08:11:23.561792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534035705445544:4651]
2025-10-02T08:11:23.561821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:23.561822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:23.561824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:23.561826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.561827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:23.561950Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:23.563414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:23.621694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534035705445585:5853]
2025-10-02T08:11:23.621812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1168, pipe: [1:7556534035705445585:5853]
2025-10-02T08:11:23.684875Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:23.685319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.685328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.685357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705445585:5853], now have 1 active actors on pipe
2025-10-02T08:11:23.685440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534035705445585:5853]
2025-10-02T08:11:23.685455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:23.685456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:23.685492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1169 reason: error at write: Disconnected sessionId: src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0
2025-10-02T08:11:23.685561Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:23.685595Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:23.685648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1169 sessionId: src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0 is DEAD
2025-10-02T08:11:23.685800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:23.685810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0] Write session will restart in 0.008661s
2025-10-02T08:11:23.685834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0] Write session: Do CDS request
2025-10-02T08:11:23.685841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:23.695257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.695310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:23.695324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1170
2025-10-02T08:11:23.695440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.695460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:23.695467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:23.695470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:23.695732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1170 sessionId:  describe result for acl check
2025-10-02T08:11:23.695755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:23.695761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:23.695762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:23.695768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534035705446180:4615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:23.696147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534035705446180:4615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:23.696478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:23.697107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:23.697234Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:23.697242Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:23.697248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:23.697280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:23.697305Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534035705446209:4620]
2025-10-02T08:11:23.697717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:23.697852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:23.697891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:23.698093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534035705446180:4615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:23.698130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:23.698163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.698167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.698168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.698168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.698169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.698172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.698177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.698180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.698182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.698183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.698187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.698191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.698195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.698197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.698199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.698202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.698204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.698206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.698208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.698211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.698221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:23.703662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534035705446180:4615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:23.703676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534035705446180:4615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:23.703679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534035705446180:4615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:23.703687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:23.705800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:23.707236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:23.707249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:23.707250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:23.707253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:23.707257Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1169 [1:7556534035705446209:4620]
2025-10-02T08:11:23.707265Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:23.707277Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:23.707279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.707281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.707282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.707293Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:23.707298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:23.707302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:23.707345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.707350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.707353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:23.707354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:23.707411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:23.707418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.707429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.707443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:23.707462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534035705446194:4620]
2025-10-02T08:11:23.707468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534035705446194:4620]
2025-10-02T08:11:23.707474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:23.707483Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:23.707487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705446240:4615], now have 1 active actors on pipe
2025-10-02T08:11:23.707492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:23.707493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:23.707497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1169
2025-10-02T08:11:23.707504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:23.707506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:23.707513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534036165427849:2378], now have 1 active actors on pipe
2025-10-02T08:11:23.707541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.707549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.707561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534035705446194:4620]
2025-10-02T08:11:23.707569Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:23.707572Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:23.707590Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:23.707600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.707568Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1169
2025-10-02T08:11:23.707603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.707605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:23.707612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.707619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:23.707645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.707708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.707714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.707725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.707756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1170 partition: 0 MaxSeqNo: 17 sessionId: src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0
2025-10-02T08:11:23.708040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d620fb3d-f480ca73-a4f70a5a-1380685c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:23.710374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0] Write session: try to update token
2025-10-02T08:11:23.710387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:23.722147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId: src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:23.724337Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:23.724353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:23.724355Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:23.724361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534035705446194:4620]
2025-10-02T08:11:23.724365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534035705446194:4620]
2025-10-02T08:11:23.724397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:23.724402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.724404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:23.724406Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:23.724411Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:23.724525Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:23.724638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:23.785551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534035705446255:5853]
2025-10-02T08:11:23.785671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1169, pipe: [1:7556534035705446255:5853]
2025-10-02T08:11:23.848643Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:23.849002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.849013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.849044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705446255:5853], now have 1 active actors on pipe
2025-10-02T08:11:23.849204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534035705446255:5853]
2025-10-02T08:11:23.849223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:23.849225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:23.849228Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:23.849266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1170 reason: error at write: Disconnected sessionId: src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0
2025-10-02T08:11:23.849242Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:23.849407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1170 sessionId: src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0 is DEAD
2025-10-02T08:11:23.849545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:23.849553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0] Write session will restart in 0.009958s
2025-10-02T08:11:23.849569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0] Write session: Do CDS request
2025-10-02T08:11:23.849574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:23.860105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:23.860227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.860363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:23.860370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1171
2025-10-02T08:11:23.860470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:23.860495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:23.860502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:23.860504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:23.860780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1171 sessionId:  describe result for acl check
2025-10-02T08:11:23.860814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:23.860815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:23.860816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:23.860819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534035705446862:4609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:23.860854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:23.860978Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:23.860986Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:23.860993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:23.861024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:23.861049Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534035705446864:4613]
2025-10-02T08:11:23.861156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534035705446862:4609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:23.861423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:23.861564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:23.861598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:23.861909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:23.861952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.861956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.861957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.861958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.861959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.861964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.861972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.861975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.861979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.861982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.861989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.861995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:23.862001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.862007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:23.862009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.862012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:23.862014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.862017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.862019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.862021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.862032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:23.862761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534035705446862:4609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:23.868324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534035705446862:4609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:23.868336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534035705446862:4609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:23.868338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534035705446862:4609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:23.868344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:23.869361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:23.870968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:23.870982Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:23.870984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:23.870988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:23.870993Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1170 [1:7556534035705446864:4613]
2025-10-02T08:11:23.871003Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:23.871017Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:23.871018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.871020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.871022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.871034Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:23.871037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:23.871042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:23.871080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.871087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.871089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:23.871091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:23.871132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:23.871138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.871146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:23.871156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:23.871170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705446910:4609], now have 1 active actors on pipe
2025-10-02T08:11:23.871181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534035705446855:4613]
2025-10-02T08:11:23.871183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534035705446855:4613]
2025-10-02T08:11:23.871182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1170
2025-10-02T08:11:23.871188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:23.871193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534036165427855:2378], now have 1 active actors on pipe
2025-10-02T08:11:23.871198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:23.871200Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:23.871203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:23.871205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:23.871206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:23.871212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.871214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.871240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534035705446855:4613]
2025-10-02T08:11:23.871245Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:23.871253Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:23.871255Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:23.871259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:23.871262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:23.871264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:23.871270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:23.871246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1170
2025-10-02T08:11:23.871276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:23.871311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.871348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:23.871353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:23.871361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:23.871387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1171 partition: 0 MaxSeqNo: 17 sessionId: src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0
2025-10-02T08:11:23.871725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90dadb4c-a2abf7be-ea604f49-1ddacec5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:23.874096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0] Write session: try to update token
2025-10-02T08:11:23.874108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:23.886699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId: src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:23.887052Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:23.887065Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:23.887066Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:23.887073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534035705446855:4613]
2025-10-02T08:11:23.887076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534035705446855:4613]
2025-10-02T08:11:23.887108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:23.887116Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:23.887119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:23.887120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:23.887120Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:23.887243Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:23.889044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:23.949383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534035705446925:5853]
2025-10-02T08:11:23.949486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1170, pipe: [1:7556534035705446925:5853]
2025-10-02T08:11:24.011287Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:24.011479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.011489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.011518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534035705446925:5853], now have 1 active actors on pipe
2025-10-02T08:11:24.011574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:24.011579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:24.011616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1171 reason: error at write: Disconnected sessionId: src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0
2025-10-02T08:11:24.011704Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:24.011751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1171 sessionId: src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0 is DEAD
2025-10-02T08:11:24.011725Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:24.011840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534035705446925:5853]
2025-10-02T08:11:24.011950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:24.011961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0] Write session will restart in 0.009225s
2025-10-02T08:11:24.011985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0] Write session: Do CDS request
2025-10-02T08:11:24.011991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:24.022293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.022298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:24.022364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:24.022377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1172
2025-10-02T08:11:24.022466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.022492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:24.022499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:24.022501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:24.022821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1172 sessionId:  describe result for acl check
2025-10-02T08:11:24.022833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:24.022849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:24.022850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:24.022851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:24.022854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534040000414843:4599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:24.022948Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:24.022957Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:24.022965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:24.022997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:24.023033Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534040000414845:4601]
2025-10-02T08:11:24.023220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534040000414843:4599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:24.023409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:24.023536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:24.023569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:24.023793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:24.023833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.023837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.023838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.023839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.023839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.023843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.023849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.023851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.023853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.023855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.023859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.023866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.023870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.023883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.023887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.023891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.023898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.023902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.023907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.023911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.023930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:24.024876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534040000414843:4599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:24.030304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534040000414843:4599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:24.030316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534040000414843:4599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:24.030319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534040000414843:4599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:24.030325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:24.031126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:24.032546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:24.032558Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:24.032559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:24.032562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:24.032566Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1171 [1:7556534040000414845:4601]
2025-10-02T08:11:24.032572Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:24.032582Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:24.032584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.032585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.032587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.032597Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:24.032600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:24.032604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:24.032642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.032649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.032652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:24.032653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:24.032695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:24.032701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.032708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.032714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:24.032726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000414890:4599], now have 1 active actors on pipe
2025-10-02T08:11:24.032730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534040000414836:4601]
2025-10-02T08:11:24.032736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534040000414836:4601]
2025-10-02T08:11:24.032739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1171
2025-10-02T08:11:24.032741Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:24.032745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534040460395172:2378], now have 1 active actors on pipe
2025-10-02T08:11:24.032747Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:24.032749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:24.032750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:24.032757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:24.032758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:24.032763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.032766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.032789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534040000414836:4601]
2025-10-02T08:11:24.032796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:24.032797Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:24.032770Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1171
2025-10-02T08:11:24.032822Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c90e7da8-af639126-84812650-95bdc44f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:24.032831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.032836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.032840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:24.032849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.032861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:24.032898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.032943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.032951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.032962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.032991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1172 partition: 0 MaxSeqNo: 17 sessionId: src_id|c90e7da8-af639126-84812650-95bdc44f_0
2025-10-02T08:11:24.033297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dac8cdd8-59050b8f-6a69873a-5d21fa07_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c90e7da8-af639126-84812650-95bdc44f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:24.035614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90e7da8-af639126-84812650-95bdc44f_0] Write session: try to update token
2025-10-02T08:11:24.035624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90e7da8-af639126-84812650-95bdc44f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:24.048398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId: src_id|c90e7da8-af639126-84812650-95bdc44f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:24.048870Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:24.048884Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:24.048886Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:24.048894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534040000414836:4601]
2025-10-02T08:11:24.048899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534040000414836:4601]
2025-10-02T08:11:24.048935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:24.048938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:24.048944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.048945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:24.048946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:24.049099Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:24.050933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:24.112197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534040000414905:5853]
2025-10-02T08:11:24.112302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1171, pipe: [1:7556534040000414905:5853]
2025-10-02T08:11:24.187608Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:24.187862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.187884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.187931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000414905:5853], now have 1 active actors on pipe
2025-10-02T08:11:24.188044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534040000414905:5853]
2025-10-02T08:11:24.188073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:24.188075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:24.188109Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:24.188127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1172 reason: error at write: Disconnected sessionId: src_id|c90e7da8-af639126-84812650-95bdc44f_0
2025-10-02T08:11:24.188132Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:24.188311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1172 sessionId: src_id|c90e7da8-af639126-84812650-95bdc44f_0 is DEAD
2025-10-02T08:11:24.188476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90e7da8-af639126-84812650-95bdc44f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:24.188486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90e7da8-af639126-84812650-95bdc44f_0] Write session will restart in 0.005820s
2025-10-02T08:11:24.188511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90e7da8-af639126-84812650-95bdc44f_0] Write session: Do CDS request
2025-10-02T08:11:24.188518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90e7da8-af639126-84812650-95bdc44f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:24.195292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90e7da8-af639126-84812650-95bdc44f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.195345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:24.195362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1173
2025-10-02T08:11:24.195570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.195602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:24.195611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:24.195615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:24.196048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1173 sessionId:  describe result for acl check
2025-10-02T08:11:24.196084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:24.196091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:24.196093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:24.196098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534040000415317:4577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:24.196599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534040000415317:4577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:24.198671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534040000415317:4577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:24.200860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534040000415317:4577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:24.200871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534040000415317:4577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:24.200874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534040000415317:4577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:24.200882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:24.201525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:24.201826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:24.201986Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:24.201996Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:24.202005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:24.202051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:24.202088Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534040000415556:4581]
2025-10-02T08:11:24.202659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:24.202821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:24.202861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:24.203147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:24.203199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.203206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.203207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.203208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.203209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.203214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.203223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.203227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.203230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.203232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.203237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.203244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.203250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.203260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.203264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.203269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.203278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.203282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.203291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.203300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.203319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:24.210795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:24.212540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:24.212557Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:24.212559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:24.212563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:24.212569Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1172 [1:7556534040000415556:4581]
2025-10-02T08:11:24.212580Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:24.212599Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:24.212607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.212610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.212612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.212629Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:24.212639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:24.212644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:24.212707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.212715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.212718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:24.212722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:24.212781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:24.212789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.212820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.212837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:24.212858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534040460395178:2378], now have 1 active actors on pipe
2025-10-02T08:11:24.212866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000415547:4577], now have 1 active actors on pipe
2025-10-02T08:11:24.212866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1172
2025-10-02T08:11:24.212872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534040000415550:4581]
2025-10-02T08:11:24.212879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534040000415550:4581]
2025-10-02T08:11:24.212889Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:24.212898Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:24.212907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:24.212907Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:24.212920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:24.212927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:24.212933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.212937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.212900Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1172
2025-10-02T08:11:24.212976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534040000415550:4581]
2025-10-02T08:11:24.212987Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:24.212990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:24.213006Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78a58bde-e93580f0-1527927-2464f563_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:24.213017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.213021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.213029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:24.213037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.213046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:24.213079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.213123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.213129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.213141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.213179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1173 partition: 0 MaxSeqNo: 17 sessionId: src_id|78a58bde-e93580f0-1527927-2464f563_0
2025-10-02T08:11:24.213482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90e7da8-af639126-84812650-95bdc44f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|78a58bde-e93580f0-1527927-2464f563_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:24.215889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a58bde-e93580f0-1527927-2464f563_0] Write session: try to update token
2025-10-02T08:11:24.215906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a58bde-e93580f0-1527927-2464f563_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:24.229088Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:24.229104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:24.229106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:24.229113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534040000415550:4581]
2025-10-02T08:11:24.229116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534040000415550:4581]
2025-10-02T08:11:24.229143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:24.229145Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:24.229148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:24.229148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.229150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:24.229270Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:24.252615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId: src_id|78a58bde-e93580f0-1527927-2464f563_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:24.254888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:24.288335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534040000415617:5853]
2025-10-02T08:11:24.288441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1172, pipe: [1:7556534040000415617:5853]
2025-10-02T08:11:24.366958Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:24.367391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.367406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.367425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000415617:5853], now have 1 active actors on pipe
2025-10-02T08:11:24.367481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534040000415617:5853]
2025-10-02T08:11:24.367496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:24.367499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:24.367541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1173 reason: error at write: Disconnected sessionId: src_id|78a58bde-e93580f0-1527927-2464f563_0
2025-10-02T08:11:24.367610Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:24.367615Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:24.367690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1173 sessionId: src_id|78a58bde-e93580f0-1527927-2464f563_0 is DEAD
2025-10-02T08:11:24.367798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a58bde-e93580f0-1527927-2464f563_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:24.367807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a58bde-e93580f0-1527927-2464f563_0] Write session will restart in 0.005019s
2025-10-02T08:11:24.367824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a58bde-e93580f0-1527927-2464f563_0] Write session: Do CDS request
2025-10-02T08:11:24.367828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a58bde-e93580f0-1527927-2464f563_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:24.374210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a58bde-e93580f0-1527927-2464f563_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.374325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:24.374339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1174
2025-10-02T08:11:24.374425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.374454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:24.374462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:24.374465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:24.374775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1174 sessionId:  describe result for acl check
2025-10-02T08:11:24.374807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:24.374814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:24.374815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:24.374820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534040000416059:4555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:24.375252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534040000416059:4555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:24.377312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534040000416059:4555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:24.379524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:24.379779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:24.379796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534040000416059:4555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:24.379801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534040000416059:4555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:24.379803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534040000416059:4555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:24.379808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:24.379935Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:24.379944Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:24.379953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:24.380001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:24.380035Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534040000416266:4552]
2025-10-02T08:11:24.380434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:24.380565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:24.380600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:24.380947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:24.380991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.380995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.380996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.380997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.380997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.381001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.381006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.381008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.381010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.381012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.381015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.381019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.381023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.381026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.381028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.381030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.381032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.381035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.381037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.381039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.381050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:24.388462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:24.389776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:24.389790Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:24.389791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:24.389794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:24.389799Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1173 [1:7556534040000416266:4552]
2025-10-02T08:11:24.389806Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:24.389820Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:24.389825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.389827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.389829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.389840Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:24.389843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:24.389847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:24.389890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.389895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.389897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:24.389899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:24.389942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:24.389947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.389955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.389962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:24.389978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534040000416256:4552]
2025-10-02T08:11:24.389979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534040000416256:4552]
2025-10-02T08:11:24.389983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:24.389993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000416264:4555], now have 1 active actors on pipe
2025-10-02T08:11:24.389999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1173
2025-10-02T08:11:24.390000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534040460395207:2378], now have 1 active actors on pipe
2025-10-02T08:11:24.390004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:24.390004Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:24.390006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:24.390011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:24.390013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:24.390037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.390043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.390052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534040000416256:4552]
2025-10-02T08:11:24.390059Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:24.390067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:24.390075Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e05e4da-2490717f-682b57f6-66abd03d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:24.390078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.390080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.390081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:24.390087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.390095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:24.390053Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1173
2025-10-02T08:11:24.390114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.390181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.390186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.390196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.390221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1174 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e05e4da-2490717f-682b57f6-66abd03d_0
2025-10-02T08:11:24.390500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a58bde-e93580f0-1527927-2464f563_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e05e4da-2490717f-682b57f6-66abd03d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:24.399008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e05e4da-2490717f-682b57f6-66abd03d_0] Write session: try to update token
2025-10-02T08:11:24.399024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e05e4da-2490717f-682b57f6-66abd03d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:24.409357Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:24.409371Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:24.409373Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:24.409380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534040000416256:4552]
2025-10-02T08:11:24.409383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534040000416256:4552]
2025-10-02T08:11:24.409420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:24.409426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.409428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:24.409436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:24.409453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:24.409602Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:24.412839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId: src_id|2e05e4da-2490717f-682b57f6-66abd03d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:24.419864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:24.467516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534040000416296:5853]
2025-10-02T08:11:24.467641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1173, pipe: [1:7556534040000416296:5853]
2025-10-02T08:11:24.535018Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:24.535396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.535410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.535429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000416296:5853], now have 1 active actors on pipe
2025-10-02T08:11:24.535594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534040000416296:5853]
2025-10-02T08:11:24.535607Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:24.535617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:24.535619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:24.535668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1174 reason: error at write: Disconnected sessionId: src_id|2e05e4da-2490717f-682b57f6-66abd03d_0
2025-10-02T08:11:24.535638Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:24.535813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1174 sessionId: src_id|2e05e4da-2490717f-682b57f6-66abd03d_0 is DEAD
2025-10-02T08:11:24.536025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e05e4da-2490717f-682b57f6-66abd03d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:24.536042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e05e4da-2490717f-682b57f6-66abd03d_0] Write session will restart in 0.007297s
2025-10-02T08:11:24.536071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e05e4da-2490717f-682b57f6-66abd03d_0] Write session: Do CDS request
2025-10-02T08:11:24.536079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e05e4da-2490717f-682b57f6-66abd03d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:24.544474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e05e4da-2490717f-682b57f6-66abd03d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.544469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:24.544486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1175
2025-10-02T08:11:24.544739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.544769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:24.544776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:24.544778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:24.545135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1175 sessionId:  describe result for acl check
2025-10-02T08:11:24.545165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:24.545171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:24.545173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:24.545181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534040000416779:4534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:24.545649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534040000416779:4534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:24.547957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534040000416779:4534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:24.549866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:24.550223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:24.550353Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:24.550363Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:24.550369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:24.550399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:24.550424Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534040000416948:4532]
2025-10-02T08:11:24.550732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534040000416779:4534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:24.550743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534040000416779:4534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:24.550746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534040000416779:4534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:24.550753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:24.550811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:24.550942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:24.550970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:24.551155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:24.551181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.551185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.551185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.551186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.551187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.551189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.551196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.551198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.551200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.551202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.551205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.551209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.551215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.551218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.551220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.551223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.551225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.551227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.551229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.551232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.551241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:24.558602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:24.560188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:24.560205Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:24.560207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:24.560210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:24.560214Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1174 [1:7556534040000416948:4532]
2025-10-02T08:11:24.560222Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:24.560235Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:24.560241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.560243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.560244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.560256Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:24.560263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:24.560267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:24.560311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.560316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.560318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:24.560320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:24.560363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:24.560368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.560376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.560383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:24.560396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534040460395213:2378], now have 1 active actors on pipe
2025-10-02T08:11:24.560404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534040000416942:4532]
2025-10-02T08:11:24.560406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534040000416942:4532]
2025-10-02T08:11:24.560411Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:24.560419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:24.560428Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:24.560430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1174
2025-10-02T08:11:24.560431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:24.560431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:24.560433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:24.560436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000416953:4534], now have 1 active actors on pipe
2025-10-02T08:11:24.560458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534040000416942:4532]
2025-10-02T08:11:24.560465Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:24.560470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.560471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:24.560472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.560467Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1174
2025-10-02T08:11:24.560500Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:24.560507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.560509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.560511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:24.560517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.560522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:24.560547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.560575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.560579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.560587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.560612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1175 partition: 0 MaxSeqNo: 17 sessionId: src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0
2025-10-02T08:11:24.560938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e05e4da-2490717f-682b57f6-66abd03d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:24.563454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0] Write session: try to update token
2025-10-02T08:11:24.563469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:24.576245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId: src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:24.577294Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:24.577308Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:24.577309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:24.577315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534040000416942:4532]
2025-10-02T08:11:24.577318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534040000416942:4532]
2025-10-02T08:11:24.577350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:24.577355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.577356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:24.577373Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:24.577379Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:24.577493Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:24.578834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:24.635974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534040000416982:5853]
2025-10-02T08:11:24.636101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1174, pipe: [1:7556534040000416982:5853]
2025-10-02T08:11:24.700047Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:24.700336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.700346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.700381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000416982:5853], now have 1 active actors on pipe
2025-10-02T08:11:24.700485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:24.700490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:24.700528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1175 reason: error at write: Disconnected sessionId: src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0
2025-10-02T08:11:24.700572Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:24.700624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:24.700686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1175 sessionId: src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0 is DEAD
2025-10-02T08:11:24.700825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:24.700830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0] Write session will restart in 0.005360s
2025-10-02T08:11:24.700824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534040000416982:5853]
2025-10-02T08:11:24.700849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0] Write session: Do CDS request
2025-10-02T08:11:24.700853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:24.707190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.707273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:24.707286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1176
2025-10-02T08:11:24.707376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.707403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:24.707411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:24.707415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:24.707832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1176 sessionId:  describe result for acl check
2025-10-02T08:11:24.707860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:24.707866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:24.707867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:24.707871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534040000417350:4522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:24.708231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534040000417350:4522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:24.710095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534040000417350:4522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:24.711890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534040000417350:4522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:24.711904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534040000417350:4522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:24.711906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534040000417350:4522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:24.711912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:24.714467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:24.714719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:24.714831Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:24.714837Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:24.714843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:24.714868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:24.714891Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534040000417638:4523]
2025-10-02T08:11:24.715258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:24.715402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:24.715424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:24.715612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:24.715655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.715660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.715661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.715663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.715664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.715668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.715678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.715685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.715689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.715693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.715698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.715705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.715715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.715720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.715724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.715728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.715732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.715739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.715744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.715752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.715770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:24.725574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:24.727079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:24.727095Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:24.727097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:24.727101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:24.727107Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1175 [1:7556534040000417638:4523]
2025-10-02T08:11:24.727118Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:24.727134Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:24.727137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.727140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.727143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.727161Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:24.727171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:24.727179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:24.727228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.727235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.727238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:24.727240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:24.727301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:24.727307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.727319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.727330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:24.727346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534040000417632:4523]
2025-10-02T08:11:24.727352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534040000417632:4523]
2025-10-02T08:11:24.727360Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:24.727374Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:24.727377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:24.727383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:24.727394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1175
2025-10-02T08:11:24.727399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:24.727402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:24.727412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000417602:4522], now have 1 active actors on pipe
2025-10-02T08:11:24.727421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534040460395222:2378], now have 1 active actors on pipe
2025-10-02T08:11:24.727449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.727457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.727470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534040000417632:4523]
2025-10-02T08:11:24.727477Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:24.727480Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1175
2025-10-02T08:11:24.727498Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:24.727501Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:24.727508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.727512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.727513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:24.727522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.727530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:24.727554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.727607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.727613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.727623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.727651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1176 partition: 0 MaxSeqNo: 17 sessionId: src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0
2025-10-02T08:11:24.728018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978a1ca7-b51d0f22-ec029bbd-fe829046_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:24.731205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0] Write session: try to update token
2025-10-02T08:11:24.731228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:24.743682Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:24.743699Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:24.743700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:24.743707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534040000417632:4523]
2025-10-02T08:11:24.743710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534040000417632:4523]
2025-10-02T08:11:24.743741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:24.743746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.743747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:24.743767Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:24.743781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:24.743863Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:24.746606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId: src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:24.748882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:24.800864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534040000417663:5853]
2025-10-02T08:11:24.800975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1175, pipe: [1:7556534040000417663:5853]
2025-10-02T08:11:24.866101Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:24.866472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.866484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.866521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000417663:5853], now have 1 active actors on pipe
2025-10-02T08:11:24.866626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:24.866631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:24.866648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534040000417663:5853]
2025-10-02T08:11:24.866676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1176 reason: error at write: Disconnected sessionId: src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0
2025-10-02T08:11:24.866701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:24.866849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1176 sessionId: src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0 is DEAD
2025-10-02T08:11:24.866865Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:24.866972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:24.866981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0] Write session will restart in 0.009214s
2025-10-02T08:11:24.867000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0] Write session: Do CDS request
2025-10-02T08:11:24.867005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:24.877302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.877333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:24.877345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1177
2025-10-02T08:11:24.877485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:24.877513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:24.877519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:24.877524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:24.877807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1177 sessionId:  describe result for acl check
2025-10-02T08:11:24.877832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:24.877836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:24.877838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:24.877841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534040000418246:4513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:24.878174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534040000418246:4513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:24.879566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:24.879962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534040000418246:4513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:24.880282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:24.880401Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:24.880408Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:24.880414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:24.880444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:24.880468Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534040000418313:4514]
2025-10-02T08:11:24.880900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:24.881055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:24.881088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:24.881311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:24.881344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.881348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.881349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.881349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.881350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.881353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.881358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.881360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.881362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.881364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.881367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.881371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:24.881374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.881377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:24.881379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.881385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:24.881387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.881390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.881392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.881394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.881404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:24.885797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534040000418246:4513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:24.885810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534040000418246:4513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:24.885813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534040000418246:4513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:24.885820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:24.888656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:24.889947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:24.889962Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:24.889964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:24.889967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:24.889973Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1176 [1:7556534040000418313:4514]
2025-10-02T08:11:24.889983Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:24.889996Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:24.889998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.890001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.890003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.890016Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:24.890026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:24.890033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:24.890079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.890084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.890087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:24.890089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:24.890138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:24.890143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.890154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:24.890169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:24.890189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000418331:4513], now have 1 active actors on pipe
2025-10-02T08:11:24.890190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1176
2025-10-02T08:11:24.890198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534040000418298:4514]
2025-10-02T08:11:24.890200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534040000418298:4514]
2025-10-02T08:11:24.890211Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:24.890217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534040460395229:2378], now have 1 active actors on pipe
2025-10-02T08:11:24.890221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.890222Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:24.890224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:24.890224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.890242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:24.890258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:24.890261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:24.890269Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1176
2025-10-02T08:11:24.890293Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:24.890303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:24.890306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:24.890308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:24.890315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:24.890322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:24.890327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534040000418298:4514]
2025-10-02T08:11:24.890335Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:24.890351Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:24.890354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.890378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:24.890383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:24.890392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:24.890419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1177 partition: 0 MaxSeqNo: 17 sessionId: src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0
2025-10-02T08:11:24.890723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6310e19b-d692c3e6-c0d81321-f9a06de6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:24.893528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0] Write session: try to update token
2025-10-02T08:11:24.893542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:24.906133Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:24.906147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:24.906149Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:24.906155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534040000418298:4514]
2025-10-02T08:11:24.906158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534040000418298:4514]
2025-10-02T08:11:24.906192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:24.906202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:24.906208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:24.906208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:24.906212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:24.906351Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:24.909297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId: src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:24.911541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:24.966699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534040000418345:5853]
2025-10-02T08:11:24.966795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1176, pipe: [1:7556534040000418345:5853]
2025-10-02T08:11:25.030094Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:25.030549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.030564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.030599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534040000418345:5853], now have 1 active actors on pipe
2025-10-02T08:11:25.030690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:25.030704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:25.030745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1177 reason: error at write: Disconnected sessionId: src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0
2025-10-02T08:11:25.030815Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:25.030817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:25.030886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1177 sessionId: src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0 is DEAD
2025-10-02T08:11:25.030984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534040000418345:5853]
2025-10-02T08:11:25.031057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:25.031070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0] Write session will restart in 0.006463s
2025-10-02T08:11:25.031093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0] Write session: Do CDS request
2025-10-02T08:11:25.031099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:25.038455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.038449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:25.038463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1178
2025-10-02T08:11:25.038713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.038747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:25.038756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:25.038760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:25.039115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1178 sessionId:  describe result for acl check
2025-10-02T08:11:25.039148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:25.039154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:25.039156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:25.039161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534044295386071:4494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:25.039644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534044295386071:4494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:25.041457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534044295386071:4494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:25.043590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534044295386071:4494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:25.043606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534044295386071:4494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:25.043608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534044295386071:4494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:25.043615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:25.044366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:25.044615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:25.044719Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:25.044726Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:25.044732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:25.044758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:25.044781Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534044295386311:4498]
2025-10-02T08:11:25.045197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:25.045333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:25.045368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:25.045718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:25.045758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.045762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.045763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.045763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.045764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.045767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.045773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.045775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.045777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.045779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.045782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.045787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.045790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.045793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.045795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.045797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.045801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.045803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.045809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.045812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.045823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:25.053283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:25.054718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:25.054733Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:25.054736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:25.054738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:25.054743Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1177 [1:7556534044295386311:4498]
2025-10-02T08:11:25.054751Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:25.054765Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:25.054767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.054769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.054770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.054781Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:25.054784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:25.054789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:25.054829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.054837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.054839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:25.054840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:25.054879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:25.054885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.054892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.054899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:25.054904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1177
2025-10-02T08:11:25.054914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295386301:4494], now have 1 active actors on pipe
2025-10-02T08:11:25.054919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534044755362546:2378], now have 1 active actors on pipe
2025-10-02T08:11:25.054923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534044295386305:4498]
2025-10-02T08:11:25.054924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534044295386305:4498]
2025-10-02T08:11:25.054929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:25.054936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.054938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.054938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:25.054940Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:25.054951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:25.054961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:25.054963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:25.054989Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1be3374e-db884ebd-70700bdb-56e3c042_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:25.054996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.054998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.055000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:25.055005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.055012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:25.055021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534044295386305:4498]
2025-10-02T08:11:25.055026Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:25.054999Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1177
2025-10-02T08:11:25.055029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:25.055043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.055074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.055080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.055088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.055113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1178 partition: 0 MaxSeqNo: 17 sessionId: src_id|1be3374e-db884ebd-70700bdb-56e3c042_0
2025-10-02T08:11:25.055421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d9092f-fe79926f-d856f45e-2b80ec55_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1be3374e-db884ebd-70700bdb-56e3c042_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:25.058058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1be3374e-db884ebd-70700bdb-56e3c042_0] Write session: try to update token
2025-10-02T08:11:25.058071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1be3374e-db884ebd-70700bdb-56e3c042_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:25.069639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId: src_id|1be3374e-db884ebd-70700bdb-56e3c042_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:25.071153Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:25.071170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:25.071172Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:25.071182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534044295386305:4498]
2025-10-02T08:11:25.071185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534044295386305:4498]
2025-10-02T08:11:25.071221Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:25.071223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:25.071229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.071231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:25.071232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:25.071400Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:25.072887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:25.131103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534044295386338:5853]
2025-10-02T08:11:25.131226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1177, pipe: [1:7556534044295386338:5853]
2025-10-02T08:11:25.197055Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:25.197459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.197471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.197502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295386338:5853], now have 1 active actors on pipe
2025-10-02T08:11:25.197603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:25.197609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:25.197649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1178 reason: error at write: Disconnected sessionId: src_id|1be3374e-db884ebd-70700bdb-56e3c042_0
2025-10-02T08:11:25.197738Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:25.197795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1178 sessionId: src_id|1be3374e-db884ebd-70700bdb-56e3c042_0 is DEAD
2025-10-02T08:11:25.197966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1be3374e-db884ebd-70700bdb-56e3c042_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:25.197980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1be3374e-db884ebd-70700bdb-56e3c042_0] Write session will restart in 0.008806s
2025-10-02T08:11:25.197980Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:25.198002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1be3374e-db884ebd-70700bdb-56e3c042_0] Write session: Do CDS request
2025-10-02T08:11:25.198008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1be3374e-db884ebd-70700bdb-56e3c042_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:25.198268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534044295386338:5853]
2025-10-02T08:11:25.208292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1be3374e-db884ebd-70700bdb-56e3c042_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.208331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:25.208346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1179
2025-10-02T08:11:25.208473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.208503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:25.208512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:25.208515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:25.208888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1179 sessionId:  describe result for acl check
2025-10-02T08:11:25.208919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:25.208925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:25.208926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:25.208931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534044295386946:4490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:25.209356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534044295386946:4490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:25.210944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:25.211222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:25.211255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534044295386946:4490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:25.211339Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:25.211347Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:25.211356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:25.211397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:25.211423Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534044295386984:4489]
2025-10-02T08:11:25.211803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:25.211909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:25.211934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:25.212143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:25.212175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.212179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.212180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.212180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.212181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.212184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.212190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.212192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.212194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.212195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.212198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.212202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.212206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.212208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.212211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.212213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.212216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.212219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.212221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.212223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.212233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:25.216757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534044295386946:4490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:25.216769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534044295386946:4490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:25.216771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534044295386946:4490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:25.216776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:25.219677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:25.221266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:25.221283Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:25.221284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:25.221288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:25.221292Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1178 [1:7556534044295386984:4489]
2025-10-02T08:11:25.221298Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:25.221311Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:25.221313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.221316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.221317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.221327Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:25.221330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:25.221335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:25.221375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.221381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.221383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:25.221385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:25.221432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:25.221438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.221445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.221451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:25.221462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534044295386977:4489]
2025-10-02T08:11:25.221467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534044295386977:4489]
2025-10-02T08:11:25.221472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:25.221478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1178
2025-10-02T08:11:25.221480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295387010:4490], now have 1 active actors on pipe
2025-10-02T08:11:25.221482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:25.221484Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:25.221486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:25.221495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:25.221497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:25.221500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534044755362553:2378], now have 1 active actors on pipe
2025-10-02T08:11:25.221504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.221510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.221537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534044295386977:4489]
2025-10-02T08:11:25.221547Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:25.221558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:25.221561Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42569c02-50658c69-c5b39124-cbd8cd85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:25.221565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.221567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.221568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:25.221574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.221580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:25.221606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.221589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1178
2025-10-02T08:11:25.221658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.221663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.221671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.221705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1179 partition: 0 MaxSeqNo: 17 sessionId: src_id|42569c02-50658c69-c5b39124-cbd8cd85_0
2025-10-02T08:11:25.221997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1be3374e-db884ebd-70700bdb-56e3c042_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|42569c02-50658c69-c5b39124-cbd8cd85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:25.224443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42569c02-50658c69-c5b39124-cbd8cd85_0] Write session: try to update token
2025-10-02T08:11:25.224455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42569c02-50658c69-c5b39124-cbd8cd85_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:25.236853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId: src_id|42569c02-50658c69-c5b39124-cbd8cd85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:25.237471Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:25.237486Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:25.237488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:25.237495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534044295386977:4489]
2025-10-02T08:11:25.237498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534044295386977:4489]
2025-10-02T08:11:25.237532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:25.237543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.237544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:25.237545Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:25.237551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:25.237667Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:25.239226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:25.298488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534044295387061:5853]
2025-10-02T08:11:25.298579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1178, pipe: [1:7556534044295387061:5853]
2025-10-02T08:11:25.360171Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:25.360456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.360466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.360497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295387061:5853], now have 1 active actors on pipe
2025-10-02T08:11:25.360623Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:25.360661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:25.360681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:25.360737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1179 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42569c02-50658c69-c5b39124-cbd8cd85_0
2025-10-02T08:11:25.360865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534044295387061:5853]
2025-10-02T08:11:25.360968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1179 sessionId: src_id|42569c02-50658c69-c5b39124-cbd8cd85_0 is DEAD
2025-10-02T08:11:25.361096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42569c02-50658c69-c5b39124-cbd8cd85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:25.361102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42569c02-50658c69-c5b39124-cbd8cd85_0] Write session will restart in 0.005538s
2025-10-02T08:11:25.361122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42569c02-50658c69-c5b39124-cbd8cd85_0] Write session: Do CDS request
2025-10-02T08:11:25.361128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42569c02-50658c69-c5b39124-cbd8cd85_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:25.367339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42569c02-50658c69-c5b39124-cbd8cd85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.367716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:25.367733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1180
2025-10-02T08:11:25.367830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.367867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:25.367888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:25.367891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:25.368230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1180 sessionId:  describe result for acl check
2025-10-02T08:11:25.368264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:25.368268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:25.368270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:25.368273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534044295387470:4461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:25.368697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534044295387470:4461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:25.370847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534044295387470:4461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:25.373046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:25.373875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:25.374008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534044295387470:4461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:25.374018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534044295387470:4461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:25.374020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534044295387470:4461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:25.374027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:25.374091Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:25.374101Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:25.374110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:25.374188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:25.374222Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534044295387718:4464]
2025-10-02T08:11:25.374657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:25.374806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:25.374848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:25.375057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:25.375083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.375087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.375088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.375089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.375089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.375093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.375099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.375101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.375103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.375105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.375109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.375117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.375126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.375131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.375134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.375144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.375147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.375149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.375152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.375154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.375164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:25.383006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:25.384588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:25.384613Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:25.384616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:25.384621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:25.384628Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1179 [1:7556534044295387718:4464]
2025-10-02T08:11:25.384641Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:25.384660Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:25.384669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.384672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.384675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.384693Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:25.384698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:25.384705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:25.384780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.384790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.384794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:25.384797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:25.384887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:25.384896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.384913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.384930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:25.384930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1179
2025-10-02T08:11:25.384957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295387720:4461], now have 1 active actors on pipe
2025-10-02T08:11:25.384965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534044755362582:2378], now have 1 active actors on pipe
2025-10-02T08:11:25.384970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.384975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.384994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534044295387711:4464]
2025-10-02T08:11:25.385001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534044295387711:4464]
2025-10-02T08:11:25.385017Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:25.385038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:25.385050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:25.385058Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:25.385058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:25.385061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:25.385031Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1179
2025-10-02T08:11:25.385077Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:25.385091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.385099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.385101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:25.385110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.385124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:25.385166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534044295387711:4464]
2025-10-02T08:11:25.385178Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:25.385186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:25.385203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.385255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.385262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.385281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.385321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1180 partition: 0 MaxSeqNo: 17 sessionId: src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0
2025-10-02T08:11:25.385663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42569c02-50658c69-c5b39124-cbd8cd85_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:25.388325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0] Write session: try to update token
2025-10-02T08:11:25.388339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:25.401324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId: src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:25.402553Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:25.402574Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:25.402583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534044295387711:4464]
2025-10-02T08:11:25.402629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:25.402729Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:25.402831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:25.402996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:25.403150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:25.403306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:25.403521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:25.403566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:25.404014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:25.404094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.404106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.404129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:25.404150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:25.404200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.404214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.404385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.404460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.404529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.404599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.404648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.404657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.404729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.404818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.404888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.404955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.404995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.404999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.405069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.405131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.405195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.405261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.405303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.405306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.405377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.405443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.405511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.405579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.405623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.405626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.405696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.405758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.405827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.405894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.405938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.405941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.406011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.406072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.406138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.406199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.406243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.406246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.406318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.406381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.406446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.406526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.406579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.406588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.406660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.406725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.406799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.406867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.406920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.406929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.407002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.407067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.407142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.407211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.407259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.407266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.407337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:25.407406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:25.407480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:25.407553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:25.407599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:25.407605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:25.407644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:25.407708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.407734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.407740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:25.407775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:25.407790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:25.407798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:25.407801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:25.407803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:25.408241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:25.408270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:25.408280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:25.408283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:25.408286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:25.408289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:25.409004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:25.409026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:25.409033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:25.409036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:25.409040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:25.409043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:25.409646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:25.409671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:25.409676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:25.409680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:25.409683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:25.411022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:25.411042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:25.411053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392685410
2025-10-02T08:11:25.411174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:25.411191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:25.411199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:25.411206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:25.411209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:25.411212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:25.411761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:25.411788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:25.411793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:25.411797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:25.411800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:25.411809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:25.412338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:25.412365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:25.412373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:25.412376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:25.412379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:25.412382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:25.412898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:25.412921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:25.412931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:25.414134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:25.414154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:25.414159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:25.414163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:25.414171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392685414
2025-10-02T08:11:25.414485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:25.414507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:25.414517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:25.414524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:25.414527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:25.414531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:25.415027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:25.415050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:25.415055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:25.415059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:25.415062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:25.415066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:25.415546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:25.415572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.415669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392685415
2025-10-02T08:11:25.416492Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:25.416513Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:25.416521Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:25.416529Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:25.418307Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:25.418324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:25.418326Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:25.418333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534044295387711:4464]
2025-10-02T08:11:25.418337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534044295387711:4464]
2025-10-02T08:11:25.418376Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:25.418389Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:25.418391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:25.418396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.418398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:25.418535Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:25.460831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534044295387756:5853]
2025-10-02T08:11:25.460945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1179, pipe: [1:7556534044295387756:5853]
2025-10-02T08:11:25.554153Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:25.554564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295387756:5853], now have 1 active actors on pipe
2025-10-02T08:11:25.554696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:25.554704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:25.554731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1180 reason: error at write: Disconnected sessionId: src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0
2025-10-02T08:11:25.554796Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:25.554858Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:25.554930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1180 sessionId: src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0 is DEAD
2025-10-02T08:11:25.555111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534044295387756:5853]
2025-10-02T08:11:25.555274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:25.555281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0] Write session will restart in 0.006876s
2025-10-02T08:11:25.555298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0] Write session: Do CDS request
2025-10-02T08:11:25.555303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:25.563399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.563478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:25.563506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1181
2025-10-02T08:11:25.563685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.563722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:25.563726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:25.563730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:25.564160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1181 sessionId:  describe result for acl check
2025-10-02T08:11:25.564194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:25.564195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:25.564197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:25.564202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534044295388161:4451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:25.564737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534044295388161:4451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:25.567024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534044295388161:4451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:25.569780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534044295388161:4451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:25.569795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534044295388161:4451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:25.569798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534044295388161:4451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:25.569807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:25.571254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:25.572116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:25.572256Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:25.572265Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:25.572275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:25.572317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:25.572348Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534044295388425:4446]
2025-10-02T08:11:25.572861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:25.573026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:25.573054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:25.573268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:25.573308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.573312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.573313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.573314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.573314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.573318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.573325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.573327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.573329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.573331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.573336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.573344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.573349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.573355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.573359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.573364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.573368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.573374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.573378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.573381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.573392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:25.582200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:25.583833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:25.583853Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:25.583856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:25.583860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:25.583866Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1180 [1:7556534044295388425:4446]
2025-10-02T08:11:25.583879Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:25.583907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:25.583910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.583913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.583915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.583932Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:25.583938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:25.583945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:25.584012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.584024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.584027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:25.584030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:25.584094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:25.584105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.584119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.584131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:25.584151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295388404:4451], now have 1 active actors on pipe
2025-10-02T08:11:25.584153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1180
2025-10-02T08:11:25.584159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534044755362590:2378], now have 1 active actors on pipe
2025-10-02T08:11:25.584166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534044295388419:4446]
2025-10-02T08:11:25.584169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534044295388419:4446]
2025-10-02T08:11:25.584185Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:25.584200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.584205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.584223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:25.584241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:25.584249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:25.584269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:25.584278Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:25.584290Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:25.584301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.584306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.584308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:25.584316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.584329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:25.584339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534044295388419:4446]
2025-10-02T08:11:25.584352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:25.584360Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:25.584378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.584433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.584441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.584455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.584494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1181 partition: 0 MaxSeqNo: 17 sessionId: src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0
2025-10-02T08:11:25.584939Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1180
2025-10-02T08:11:25.585126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4d5d42-aa775b9-4be6e567-ed2f9125_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:25.587865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0] Write session: try to update token
2025-10-02T08:11:25.587897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:25.603949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId: src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:25.604599Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:25.604616Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:25.604619Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:25.604628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534044295388419:4446]
2025-10-02T08:11:25.604632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534044295388419:4446]
2025-10-02T08:11:25.604676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:25.604682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.604685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:25.604747Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:25.604762Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:25.604851Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:25.608841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:25.655370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534044295388453:5853]
2025-10-02T08:11:25.655459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1180, pipe: [1:7556534044295388453:5853]
2025-10-02T08:11:25.754356Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:25.754929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.754940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.754986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295388453:5853], now have 1 active actors on pipe
2025-10-02T08:11:25.755364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:25.755193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534044295388453:5853]
2025-10-02T08:11:25.755212Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:25.755215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:25.755217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:25.755287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1181 reason: error at write: Disconnected sessionId: src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0
2025-10-02T08:11:25.755489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1181 sessionId: src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0 is DEAD
2025-10-02T08:11:25.755879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:25.755911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0] Write session will restart in 0.005340s
2025-10-02T08:11:25.755948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0] Write session: Do CDS request
2025-10-02T08:11:25.755956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:25.762460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.762501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:25.762518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1182
2025-10-02T08:11:25.766469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.766534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:25.766539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:25.766543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:25.767073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1182 sessionId:  describe result for acl check
2025-10-02T08:11:25.767110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:25.767112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:25.767113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:25.767118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534044295388725:4433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:25.767768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534044295388725:4433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:25.772760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534044295388725:4433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:25.777450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534044295388725:4433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:25.777470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534044295388725:4433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:25.777473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534044295388725:4433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:25.777483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:25.786466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:25.787851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:25.788065Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:25.788081Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:25.788092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:25.788147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:25.788190Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534044295389123:4441]
2025-10-02T08:11:25.788846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:25.791771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:25.791833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:25.792252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:25.792293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.792294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.792295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.792297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.792298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.792304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.792313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.792317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.792321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.792325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.792331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.792338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.792344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.792349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.792353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.792358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.792362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.792367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.792371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.792391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.792411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:25.801903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:25.803430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:25.803445Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:25.803448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:25.803452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:25.803458Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1181 [1:7556534044295389123:4441]
2025-10-02T08:11:25.803470Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:25.803485Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:25.803488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.803490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.803492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.803508Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:25.803512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:25.803518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:25.803575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.803582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.803585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:25.803588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:25.803647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:25.803653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.803664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.803676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:25.803691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1181
2025-10-02T08:11:25.803693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295388923:4433], now have 1 active actors on pipe
2025-10-02T08:11:25.803698Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534044295389117:4441]
2025-10-02T08:11:25.803700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534044295389117:4441]
2025-10-02T08:11:25.803707Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:25.803719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:25.803730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:25.803733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:25.803738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534044755362596:2378], now have 1 active actors on pipe
2025-10-02T08:11:25.803765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534044295389117:4441]
2025-10-02T08:11:25.803764Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:25.803767Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:25.803768Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:25.803772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.803774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:25.803776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.803818Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:25.803829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:25.803832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:25.803834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:25.803841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:25.803849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:25.803868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.803921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.803927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.803939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:25.803971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1182 partition: 0 MaxSeqNo: 17 sessionId: src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0
2025-10-02T08:11:25.804150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1181
2025-10-02T08:11:25.804292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc31bebb-377cec4f-d8e52066-e1b67eb3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:25.807214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0] Write session: try to update token
2025-10-02T08:11:25.807230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:25.820204Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:25.820226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:25.820228Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:25.820235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534044295389117:4441]
2025-10-02T08:11:25.820239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534044295389117:4441]
2025-10-02T08:11:25.820267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:25.820270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:25.820277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:25.820284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.820286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:25.820412Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:25.826383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId: src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:25.829323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:25.855594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534044295389148:5853]
2025-10-02T08:11:25.857233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1181, pipe: [1:7556534044295389148:5853]
2025-10-02T08:11:25.975936Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:25.976374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:25.976392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:25.976426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295389148:5853], now have 1 active actors on pipe
2025-10-02T08:11:25.976544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534044295389148:5853]
2025-10-02T08:11:25.976567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:25.976569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:25.976617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1182 reason: error at write: Disconnected sessionId: src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0
2025-10-02T08:11:25.976669Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:25.976738Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:25.976826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1182 sessionId: src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0 is DEAD
2025-10-02T08:11:25.977007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:25.977025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0] Write session will restart in 0.007450s
2025-10-02T08:11:25.977060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0] Write session: Do CDS request
2025-10-02T08:11:25.977067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:25.988157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.988475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:25.988494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1183
2025-10-02T08:11:25.988695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:25.988758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:25.988772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:25.988778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:25.989427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1183 sessionId:  describe result for acl check
2025-10-02T08:11:25.989926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:25.989941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:25.989944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:25.989951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534044295389700:4408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:25.990540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534044295389700:4408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:25.993095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534044295389700:4408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:25.993674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:25.995005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:25.995172Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:25.995182Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:25.995191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:25.995251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:25.995286Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534044295389825:4412]
2025-10-02T08:11:25.995964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:25.996129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:25.996161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534044295389700:4408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:25.996168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:25.996175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534044295389700:4408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:25.996178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534044295389700:4408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:25.996186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:25.996474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:25.996515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.996520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.996521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.996522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.996523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.996528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.996538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.996542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.996546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.996550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.996556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.996563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:25.996569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.996574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:25.996578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.996584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:25.996588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.996593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:25.996604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.996609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:25.996632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:26.004958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:26.007111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:26.007138Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:26.007140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:26.007143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:26.007152Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1182 [1:7556534044295389825:4412]
2025-10-02T08:11:26.007166Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:26.007185Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:26.007187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.007190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.007193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.007210Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:26.007215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:26.007222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:26.007292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.007302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.007305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:26.007308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:26.007382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:26.007392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.007411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.007422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:26.007439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534044295389815:4412]
2025-10-02T08:11:26.007446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534044295389815:4412]
2025-10-02T08:11:26.007454Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:26.007467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534044295389836:4408], now have 1 active actors on pipe
2025-10-02T08:11:26.007475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:26.007488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:26.007496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:26.007504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:26.007516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:26.007532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534044755362614:2378], now have 1 active actors on pipe
2025-10-02T08:11:26.007541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534044295389815:4412]
2025-10-02T08:11:26.007544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:26.007547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:26.007584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1182
2025-10-02T08:11:26.007668Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1182
2025-10-02T08:11:26.007606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.007619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.007641Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:26.007648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.007651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.007653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:26.007663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.007674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:26.007689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.007718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.007720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.007734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.007762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1183 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0
2025-10-02T08:11:26.008194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0531b9-1a34d4be-832a11a2-850f8ad3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:26.011389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0] Write session: try to update token
2025-10-02T08:11:26.011408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:26.025558Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:26.025579Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:26.025581Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:26.025588Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534044295389815:4412]
2025-10-02T08:11:26.025591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534044295389815:4412]
2025-10-02T08:11:26.025628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:26.025633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.025635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:26.025639Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:26.025645Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:26.025763Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:26.028337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId: src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:26.031389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:26.076750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534048590357152:5853]
2025-10-02T08:11:26.076893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1182, pipe: [1:7556534048590357152:5853]
2025-10-02T08:11:26.156366Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:26.156600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.156611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.156644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590357152:5853], now have 1 active actors on pipe
2025-10-02T08:11:26.157098Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:26.156759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534048590357152:5853]
2025-10-02T08:11:26.156787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:26.156790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:26.156860Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:26.156866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1183 reason: error at write: Disconnected sessionId: src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0
2025-10-02T08:11:26.157072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1183 sessionId: src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0 is DEAD
2025-10-02T08:11:26.161100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:26.161119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0] Write session will restart in 0.005731s
2025-10-02T08:11:26.161153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0] Write session: Do CDS request
2025-10-02T08:11:26.161161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:26.168587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:26.168605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1184
2025-10-02T08:11:26.168651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:26.168976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:26.169009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:26.169019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:26.169022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:26.169432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1184 sessionId:  describe result for acl check
2025-10-02T08:11:26.169463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:26.169470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:26.169472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:26.169476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534048590357621:4414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:26.170094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534048590357621:4414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:26.173991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534048590357621:4414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:26.174568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:26.175337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:26.175630Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:26.175641Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:26.175653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:26.175709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:26.175739Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534048590357820:4419]
2025-10-02T08:11:26.176164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:26.176315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:26.176348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:26.176580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:26.176621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.176627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.176628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.176628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.176629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.176632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.176638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.176640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.176642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.176644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.176648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.176652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.176655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.176659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.176661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.176664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.176666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.176672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.176679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.176683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.176700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:26.177159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534048590357621:4414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:26.177170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534048590357621:4414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:26.177173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534048590357621:4414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:26.177181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:26.184526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:26.186337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:26.186357Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:26.186359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:26.186363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:26.186369Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1183 [1:7556534048590357820:4419]
2025-10-02T08:11:26.186382Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:26.186398Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:26.186401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.186404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.186407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.186422Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:26.186427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:26.186435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:26.186494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.186504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.186507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:26.186510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:26.186575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:26.186583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.186597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.186616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:26.186638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590357837:4414], now have 1 active actors on pipe
2025-10-02T08:11:26.186639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1183
2025-10-02T08:11:26.186646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534049050329919:2378], now have 1 active actors on pipe
2025-10-02T08:11:26.186654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534048590357810:4419]
2025-10-02T08:11:26.186656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534048590357810:4419]
2025-10-02T08:11:26.186668Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:26.186677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.186681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.186681Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:26.186684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:26.186699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:26.186713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:26.186720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:26.186737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1183
2025-10-02T08:11:26.186762Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aff12805-36ba8e17-88c62e79-3d428057_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:26.186774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.186779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.186781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:26.186790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.186799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:26.186807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534048590357810:4419]
2025-10-02T08:11:26.186815Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:26.186831Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:26.186849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.186931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.186939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.186953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.186995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1184 partition: 0 MaxSeqNo: 17 sessionId: src_id|aff12805-36ba8e17-88c62e79-3d428057_0
2025-10-02T08:11:26.187404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c314b1c-fd30b39c-b385fe00-622ec2f2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aff12805-36ba8e17-88c62e79-3d428057_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:26.190665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff12805-36ba8e17-88c62e79-3d428057_0] Write session: try to update token
2025-10-02T08:11:26.190682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff12805-36ba8e17-88c62e79-3d428057_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:26.204737Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:26.204759Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:26.204762Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:26.204770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534048590357810:4419]
2025-10-02T08:11:26.204775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534048590357810:4419]
2025-10-02T08:11:26.204836Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:26.204840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:26.204842Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:26.204847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.204849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:26.205001Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:26.205204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId: src_id|aff12805-36ba8e17-88c62e79-3d428057_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:26.207916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:26.257055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534048590357851:5853]
2025-10-02T08:11:26.257191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1183, pipe: [1:7556534048590357851:5853]
2025-10-02T08:11:26.347712Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:26.348157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.348167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.348209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590357851:5853], now have 1 active actors on pipe
2025-10-02T08:11:26.348565Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:26.348648Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:26.348731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534048590357851:5853]
2025-10-02T08:11:26.348747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:26.348814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aff12805-36ba8e17-88c62e79-3d428057_0
2025-10-02T08:11:26.349031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1184 sessionId: src_id|aff12805-36ba8e17-88c62e79-3d428057_0 is DEAD
2025-10-02T08:11:26.349789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff12805-36ba8e17-88c62e79-3d428057_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:26.349800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff12805-36ba8e17-88c62e79-3d428057_0] Write session will restart in 0.008488s
2025-10-02T08:11:26.349824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff12805-36ba8e17-88c62e79-3d428057_0] Write session: Do CDS request
2025-10-02T08:11:26.349832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff12805-36ba8e17-88c62e79-3d428057_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:26.359464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff12805-36ba8e17-88c62e79-3d428057_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:26.359961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:26.359976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1185
2025-10-02T08:11:26.360148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:26.360210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:26.360224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:26.360230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:26.360721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1185 sessionId:  describe result for acl check
2025-10-02T08:11:26.360761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:26.360770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:26.360773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:26.360780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534048590358198:4381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:26.361445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534048590358198:4381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:26.366166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534048590358198:4381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:26.373630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534048590358198:4381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:26.373652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534048590358198:4381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:26.373655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534048590358198:4381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:26.373664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:26.381291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:26.382907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:26.383107Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:26.383110Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:26.383120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:26.383169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:26.383202Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534048590358560:4376]
2025-10-02T08:11:26.383913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:26.384116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:26.384168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:26.384496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:26.384549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.384558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.384559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.384561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.384562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.384568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.384579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.384584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.384589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.384593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.384599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.384607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.384614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.384620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.384625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.384638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.384643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.384653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.384659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.384669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.384689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:26.396370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff12805-36ba8e17-88c62e79-3d428057_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:26.393389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:26.395025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:26.395031Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:26.395033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:26.395037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:26.395043Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1184 [1:7556534048590358560:4376]
2025-10-02T08:11:26.395055Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:26.395072Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:26.395075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.395078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.395080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.395096Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:26.395101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:26.395107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:26.395169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.395171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.395176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:26.395178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:26.395248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:26.395250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.395264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.395276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:26.395291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534048590358554:4376]
2025-10-02T08:11:26.395294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534048590358554:4376]
2025-10-02T08:11:26.395310Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:26.395324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:26.395338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:26.395341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:26.395361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:26.395364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:26.395373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534048590358554:4376]
2025-10-02T08:11:26.395376Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:26.395421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1184
2025-10-02T08:11:26.395430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590358466:4381], now have 1 active actors on pipe
2025-10-02T08:11:26.395436Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:26.395688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.395692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.395708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534049050329947:2378], now have 1 active actors on pipe
2025-10-02T08:11:26.395722Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:26.395728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.395732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.395735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:26.395743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.395753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:26.395767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.395871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.395873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.395898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.395934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1185 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0
2025-10-02T08:11:26.396976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1184
2025-10-02T08:11:26.399296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0] Write session: try to update token
2025-10-02T08:11:26.399316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:26.418733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId: src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:26.420459Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:26.420476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:26.420484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534048590358554:4376]
2025-10-02T08:11:26.420520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:26.420528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:26.420679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:26.420841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:26.420975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:26.421102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:26.421288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:26.421325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:26.421369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:26.421448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.421460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.421486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:26.421507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:26.421553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.421564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.421726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.421787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.421849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.421913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.422303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.422316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.422383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.422441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.422504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.422581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.422628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.422635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.422704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.422767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.422831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.422892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.422941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.422948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.423017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.423083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.423147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.423211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.423262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.423269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.423339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.423400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.423466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.423528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.423571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.423579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.423645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.423709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.423774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.423841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.423903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.423910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.423980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.424041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.424105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.424169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.424219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.424227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.424291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.424355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.424419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.424487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.424536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.424543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.424607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.424665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.424731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.424797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.424882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.424890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.424957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:26.425034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:26.425097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:26.425175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:26.425220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:26.425224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:26.425265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:26.425327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.425347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.425349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:26.425381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:26.425399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:26.425406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:26.425410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:26.425414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:26.425784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:26.425809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:26.425819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:26.425823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:26.425826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:26.425830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:26.426616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:26.426639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:26.426650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:26.426653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:26.426656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:26.426659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:26.427114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:26.427137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:26.427147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:26.427151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:26.427154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:26.429356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:26.429376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:26.429388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392686428
2025-10-02T08:11:26.429680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:26.429698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:26.429708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:26.429711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:26.429719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:26.429724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:26.430177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:26.430199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:26.430208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:26.430212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:26.430217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:26.430221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:26.430726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:26.430749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:26.430760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:26.430767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:26.430771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:26.430774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:26.431198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:26.431219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:26.431229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:26.432321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:26.432339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:26.432345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:26.432349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:26.432361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392686432
2025-10-02T08:11:26.432683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:26.432705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:26.432712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:26.432716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:26.432720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:26.432724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:26.433212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:26.433233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:26.433238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:26.433248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:26.433257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:26.433260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:26.433701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:26.433720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.433821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392686433
2025-10-02T08:11:26.435942Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:26.435967Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:26.435975Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:26.435981Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:26.437628Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:26.437638Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:26.437640Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:26.437649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534048590358554:4376]
2025-10-02T08:11:26.437652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534048590358554:4376]
2025-10-02T08:11:26.437717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:26.437720Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:26.437726Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:26.437728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.437730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:26.437879Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:26.448446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534048590358592:5853]
2025-10-02T08:11:26.448618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1184, pipe: [1:7556534048590358592:5853]
2025-10-02T08:11:26.575949Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:26.576226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590358592:5853], now have 1 active actors on pipe
2025-10-02T08:11:26.576336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534048590358592:5853]
2025-10-02T08:11:26.576358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:26.576365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:26.576389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1185 reason: error at write: Disconnected sessionId: src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0
2025-10-02T08:11:26.576523Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:26.576568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1185 sessionId: src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0 is DEAD
2025-10-02T08:11:26.576558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:26.576681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:26.576695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0] Write session will restart in 0.007535s
2025-10-02T08:11:26.576719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0] Write session: Do CDS request
2025-10-02T08:11:26.576725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:26.585309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:26.585367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:26.585380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1186
2025-10-02T08:11:26.585485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:26.585507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:26.585514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:26.585516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:26.585876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1186 sessionId:  describe result for acl check
2025-10-02T08:11:26.585907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:26.585912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:26.585914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:26.585917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534048590358994:4372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:26.586419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534048590358994:4372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:26.594044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534048590358994:4372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:26.596845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:26.597947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534048590358994:4372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:26.597963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534048590358994:4372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:26.597966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534048590358994:4372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:26.597975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:26.598774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:26.598991Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:26.599004Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:26.599014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:26.599073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:26.599112Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534048590359272:4373]
2025-10-02T08:11:26.599698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:26.599922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:26.599969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:26.600261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:26.600323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.600330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.600332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.600333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.600334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.600340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.600350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.600353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.600358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.600362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.600367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.600374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.600379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.600385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.600389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.600394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.600399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.600410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.600414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.600418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.600437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:26.612053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:26.613972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:26.613995Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:26.613998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:26.614002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:26.614012Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1185 [1:7556534048590359272:4373]
2025-10-02T08:11:26.614024Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:26.614043Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:26.614046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.614049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.614051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.614068Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:26.614107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:26.614118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:26.614184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.614193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.614196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:26.614199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:26.614272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:26.614280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.614295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.614306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:26.614325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534048590359260:4373]
2025-10-02T08:11:26.614332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534048590359260:4373]
2025-10-02T08:11:26.614340Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:26.614353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:26.614354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590359268:4372], now have 1 active actors on pipe
2025-10-02T08:11:26.614362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:26.614363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:26.614375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:26.614378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:26.614385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534049050329957:2378], now have 1 active actors on pipe
2025-10-02T08:11:26.614419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534048590359260:4373]
2025-10-02T08:11:26.614420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1185
2025-10-02T08:11:26.614430Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:26.614440Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:26.614447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.614451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.614485Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:26.614492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.614496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.614498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:26.614506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.614515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:26.614538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.614625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.614628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.614647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.614688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1186 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0
2025-10-02T08:11:26.615054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ded243-3ff8911f-9e08192e-6048a7fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:26.614588Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1185
2025-10-02T08:11:26.617755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0] Write session: try to update token
2025-10-02T08:11:26.617769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:26.632763Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:26.632782Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:26.632785Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:26.632793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534048590359260:4373]
2025-10-02T08:11:26.632797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534048590359260:4373]
2025-10-02T08:11:26.632858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:26.632860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:26.632864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.632866Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:26.632867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:26.633013Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:26.645699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId: src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:26.649495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:26.676340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534048590359302:5853]
2025-10-02T08:11:26.676601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1185, pipe: [1:7556534048590359302:5853]
2025-10-02T08:11:26.783930Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:26.783037Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:26.783469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.783476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.783492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590359302:5853], now have 1 active actors on pipe
2025-10-02T08:11:26.784077Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:26.784147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:26.784221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1186 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0
2025-10-02T08:11:26.784392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1186 sessionId: src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0 is DEAD
2025-10-02T08:11:26.784396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534048590359302:5853]
2025-10-02T08:11:26.785052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:26.785068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0] Write session will restart in 0.007631s
2025-10-02T08:11:26.785099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0] Write session: Do CDS request
2025-10-02T08:11:26.785106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:26.797321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:26.797845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:26.797869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1187
2025-10-02T08:11:26.798062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:26.798096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:26.798103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:26.798108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:26.799105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1187 sessionId:  describe result for acl check
2025-10-02T08:11:26.799146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:26.799148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:26.799150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:26.799157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534048590359554:4366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:26.799775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534048590359554:4366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:26.817795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534048590359554:4366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:26.825781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534048590359554:4366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:26.825804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534048590359554:4366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:26.825808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534048590359554:4366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:26.825817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:26.844256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:26.844857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:26.845043Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:26.845056Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:26.845067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:26.845112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:26.845152Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534048590359981:4367]
2025-10-02T08:11:26.845836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:26.846073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:26.846119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:26.846459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:26.846498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.846500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.846501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.846502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.846503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.846508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.846519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.846523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.846527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.846531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.846537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.846545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:26.846551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.846556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:26.846561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.846566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:26.846570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.846576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.846581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.846587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.846607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:26.857534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:26.859290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:26.859311Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:26.859314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:26.859317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:26.859324Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1186 [1:7556534048590359981:4367]
2025-10-02T08:11:26.859338Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:26.859357Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:26.859360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.859363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.859366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.859382Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:26.859388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:26.859395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:26.859465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.859467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.859471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:26.859474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:26.859548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:26.859551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.859568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:26.859582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:26.859599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534048590359975:4367]
2025-10-02T08:11:26.859601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534048590359975:4367]
2025-10-02T08:11:26.859619Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:26.859632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:26.859648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:26.859651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:26.859736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:26.859747Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:26.859764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1186
2025-10-02T08:11:26.860005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534048590359975:4367]
2025-10-02T08:11:26.860018Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:26.860029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590359720:4366], now have 1 active actors on pipe
2025-10-02T08:11:26.860043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534049050329964:2378], now have 1 active actors on pipe
2025-10-02T08:11:26.860048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.860053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.860073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:26.860099Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:26.860113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:26.860118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:26.860120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:26.860128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:26.860138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:26.860912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a40ccff-ded10fbf-3b74806b-ac20f034_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:26.863520Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1186
2025-10-02T08:11:26.863711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0] Write session: try to update token
2025-10-02T08:11:26.863728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:26.860157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.860361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:26.860369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:26.860407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:26.860446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1187 partition: 0 MaxSeqNo: 17 sessionId: src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0
2025-10-02T08:11:26.884299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534048590360004:5853]
2025-10-02T08:11:26.889041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1186, pipe: [1:7556534048590360004:5853]
2025-10-02T08:11:26.889068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534048590360004:5853], now have 1 active actors on pipe
2025-10-02T08:11:26.896545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId: src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:26.898313Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:26.898319Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:26.898322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:26.898331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534048590359975:4367]
2025-10-02T08:11:26.898336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534048590359975:4367]
2025-10-02T08:11:26.898391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:26.898400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:26.898402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:26.898563Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:26.899949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:26.900253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:26.900270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:27.071828Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:27.072291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.072314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.072529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534048590360004:5853]
2025-10-02T08:11:27.072558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:27.072560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:27.072614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1187 reason: error at write: Disconnected sessionId: src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0
2025-10-02T08:11:27.072651Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:27.072785Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:27.072798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1187 sessionId: src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0 is DEAD
2025-10-02T08:11:27.076922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:27.076932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0] Write session will restart in 0.009990s
2025-10-02T08:11:27.076960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0] Write session: Do CDS request
2025-10-02T08:11:27.076969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:27.088376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.089097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:27.089120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1188
2025-10-02T08:11:27.092788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.092860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:27.092871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:27.092876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:27.094831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1188 sessionId:  describe result for acl check
2025-10-02T08:11:27.094876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:27.094877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:27.094879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:27.094885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534052885327576:4348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:27.095410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534052885327576:4348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:27.102421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534052885327576:4348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:27.110753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534052885327576:4348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:27.110773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534052885327576:4348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:27.110777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534052885327576:4348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:27.110785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:27.120688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:27.121345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:27.121533Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:27.121536Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:27.121547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:27.121593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:27.121631Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534052885328000:4346]
2025-10-02T08:11:27.122272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:27.122520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:27.122569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:27.122872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:27.122931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.122932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.122933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.122934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.122935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.122941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.122952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.122955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.122959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.122963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.122969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.122976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.122983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.122988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.122992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.122997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.123002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.123008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.123012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.123018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.123040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:27.132729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:27.134547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:27.134571Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:27.134573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:27.134577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:27.134585Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1187 [1:7556534052885328000:4346]
2025-10-02T08:11:27.134598Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:27.134617Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:27.134620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.134624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.134626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.134644Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:27.134649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:27.134660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:27.135390Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1187
2025-10-02T08:11:27.134730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.134732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.134736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:27.134739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:27.134807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:27.134810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.134825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.134836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:27.134853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534052885327993:4346]
2025-10-02T08:11:27.134855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534052885327993:4346]
2025-10-02T08:11:27.134862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:27.134875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885327832:4348], now have 1 active actors on pipe
2025-10-02T08:11:27.134876Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:27.134880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:27.134883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:27.134895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:27.134898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:27.134903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534053345297282:2378], now have 1 active actors on pipe
2025-10-02T08:11:27.134933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1187
2025-10-02T08:11:27.134934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534052885327993:4346]
2025-10-02T08:11:27.134938Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:27.134970Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:27.134971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.134975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.135000Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:27.135007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.135011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.135013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:27.135022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.135033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:27.135049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.135077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.135079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.135090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.135118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1188 partition: 0 MaxSeqNo: 17 sessionId: src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0
2025-10-02T08:11:27.135829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff85c21-65c65f90-ea875380-4d6da3ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:27.138558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0] Write session: try to update token
2025-10-02T08:11:27.138581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:27.149613Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:27.149637Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:27.149648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534052885327993:4346]
2025-10-02T08:11:27.149693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:27.149876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:27.150029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:27.150136Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:27.150172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:27.150314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:27.150532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:27.150567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:27.165706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId: src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:27.167258Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:27.167264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:27.167266Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:27.167277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534052885327993:4346]
2025-10-02T08:11:27.167280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534052885327993:4346]
2025-10-02T08:11:27.167329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:27.167328Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:27.167335Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:27.167337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.167339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:27.167490Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:27.168543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:27.171366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534052885328025:5853]
2025-10-02T08:11:27.171499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1187, pipe: [1:7556534052885328025:5853]
2025-10-02T08:11:27.304937Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:27.305571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.305582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.305599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885328025:5853], now have 1 active actors on pipe
2025-10-02T08:11:27.305728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:27.305750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:27.305757Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:27.305825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1188 reason: error at write: Disconnected sessionId: src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0
2025-10-02T08:11:27.305850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:27.305981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534052885328025:5853]
2025-10-02T08:11:27.305998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1188 sessionId: src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0 is DEAD
2025-10-02T08:11:27.306152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:27.306161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0] Write session will restart in 0.006607s
2025-10-02T08:11:27.306181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0] Write session: Do CDS request
2025-10-02T08:11:27.306187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:27.314515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.314607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:27.314653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1189
2025-10-02T08:11:27.314783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.314829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:27.314840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:27.314856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:27.315292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1189 sessionId:  describe result for acl check
2025-10-02T08:11:27.315330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:27.315332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:27.315337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:27.315343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534052885328062:4337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:27.315953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534052885328062:4337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:27.321523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534052885328062:4337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:27.325014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534052885328062:4337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:27.325031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534052885328062:4337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:27.325034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534052885328062:4337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:27.325041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:27.332979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:27.333381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:27.333564Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:27.333576Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:27.333586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:27.333632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:27.333693Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534052885328708:4340]
2025-10-02T08:11:27.334321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:27.334494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:27.334536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:27.334842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:27.334883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.334889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.334890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.334891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.334892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.334897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.334908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.334913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.334922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.334926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.334931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.334942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.334949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.334954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.334963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.334969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.334978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.334983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.334988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.334998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.335018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:27.339364Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:11:27.345232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:27.346944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:27.346963Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:27.346965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:27.346968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:27.346973Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1188 [1:7556534052885328708:4340]
2025-10-02T08:11:27.346981Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:27.346993Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:27.346996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.346999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.347001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.347015Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:27.347020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:27.347026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:27.347085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.347095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.347098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:27.347100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:27.347153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:27.347161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.347170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.347176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:27.347188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534052885328702:4340]
2025-10-02T08:11:27.347189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534052885328702:4340]
2025-10-02T08:11:27.347194Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:27.347203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:27.347209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:27.347211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:27.347212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:27.347212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:27.347220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885328514:4337], now have 1 active actors on pipe
2025-10-02T08:11:27.347245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534053345297289:2378], now have 1 active actors on pipe
2025-10-02T08:11:27.347251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534052885328702:4340]
2025-10-02T08:11:27.347256Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:27.347263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:27.347288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1188
2025-10-02T08:11:27.347316Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1188
2025-10-02T08:11:27.347369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.347375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.347397Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:27.347407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.347413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.347414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:27.347420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.347427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:27.347442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.347483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.347487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.347497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.347525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1189 partition: 0 MaxSeqNo: 17 sessionId: src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0
2025-10-02T08:11:27.347836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|919e6e15-af49d889-fcc5a70d-4dbffeb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:27.350324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0] Write session: try to update token
2025-10-02T08:11:27.350342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:27.364909Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:27.364925Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:27.364926Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:27.364933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534052885328702:4340]
2025-10-02T08:11:27.364936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534052885328702:4340]
2025-10-02T08:11:27.364971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:27.364980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.364982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:27.364982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:27.364988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:27.365424Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:27.381725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId: src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:27.384311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:27.405891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534052885328771:5853]
2025-10-02T08:11:27.406011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1188, pipe: [1:7556534052885328771:5853]
2025-10-02T08:11:27.504102Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:27.504465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.504478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.504499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885328771:5853], now have 1 active actors on pipe
2025-10-02T08:11:27.504623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534052885328771:5853]
2025-10-02T08:11:27.504659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:27.504672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:27.504738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1189 reason: error at write: Disconnected sessionId: src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0
2025-10-02T08:11:27.504745Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:27.504958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1189 sessionId: src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0 is DEAD
2025-10-02T08:11:27.505005Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:27.505131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:27.505139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0] Write session will restart in 0.009567s
2025-10-02T08:11:27.505165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0] Write session: Do CDS request
2025-10-02T08:11:27.505172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:27.517258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.517307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:27.517326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1190
2025-10-02T08:11:27.517456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.517498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:27.517507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:27.517511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:27.517931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1190 sessionId:  describe result for acl check
2025-10-02T08:11:27.517969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:27.517975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:27.517976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:27.517981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534052885329334:4303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:27.518516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534052885329334:4303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:27.521049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534052885329334:4303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:27.521927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:27.523373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:27.523559Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:27.523567Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:27.523575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:27.523625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:27.523674Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534052885329454:4301]
2025-10-02T08:11:27.523930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534052885329334:4303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:27.523941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534052885329334:4303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:27.523945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534052885329334:4303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:27.523952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:27.524316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:27.524483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:27.524526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:27.524827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:27.524876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.524881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.524882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.524883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.524885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.524889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.524899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.524903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.524907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.524910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.524915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.524922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.524932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.524937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.524941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.524946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.524951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.524956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.524960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.524965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.524983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:27.533045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:27.535037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:27.535055Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:27.535058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:27.535062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:27.535068Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1189 [1:7556534052885329454:4301]
2025-10-02T08:11:27.535081Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:27.535098Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:27.535107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.535110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.535112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.535127Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:27.535132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:27.535143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:27.535205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.535212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.535215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:27.535219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:27.535282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:27.535292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.535306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.535318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:27.535336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885329459:4303], now have 1 active actors on pipe
2025-10-02T08:11:27.535339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534053345297319:2378], now have 1 active actors on pipe
2025-10-02T08:11:27.535345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534052885329448:4301]
2025-10-02T08:11:27.535347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534052885329448:4301]
2025-10-02T08:11:27.535351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1189
2025-10-02T08:11:27.535354Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:27.535366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:27.535365Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:27.535368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:27.535396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:27.535403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:27.535410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.535414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.535412Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1189
2025-10-02T08:11:27.535455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534052885329448:4301]
2025-10-02T08:11:27.535463Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:27.535466Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:27.535477Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:27.535486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.535490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.535492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:27.535502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.535514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:27.535554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.535597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.535603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.535616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.535654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1190 partition: 0 MaxSeqNo: 17 sessionId: src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0
2025-10-02T08:11:27.536026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8048afd2-1be751d4-bba68023-7c7ac2cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:27.538871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0] Write session: try to update token
2025-10-02T08:11:27.538884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:27.556591Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:27.556622Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:27.556626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:27.556638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534052885329448:4301]
2025-10-02T08:11:27.556646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534052885329448:4301]
2025-10-02T08:11:27.556703Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:27.556712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:27.556720Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:27.556722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.556726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:27.557329Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:27.558626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId: src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:27.562201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:27.604570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534052885329485:5853]
2025-10-02T08:11:27.604692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1189, pipe: [1:7556534052885329485:5853]
2025-10-02T08:11:27.701567Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:27.701842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.701854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.701888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885329485:5853], now have 1 active actors on pipe
2025-10-02T08:11:27.702055Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:27.702193Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:27.702365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:27.702415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0
2025-10-02T08:11:27.702581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1190 sessionId: src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0 is DEAD
2025-10-02T08:11:27.702717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:27.702727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0] Write session will restart in 0.006535s
2025-10-02T08:11:27.702751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0] Write session: Do CDS request
2025-10-02T08:11:27.702758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:27.702741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534052885329485:5853]
2025-10-02T08:11:27.712269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.712687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:27.712706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1191
2025-10-02T08:11:27.712850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.712882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:27.712887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:27.712890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:27.716120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1191 sessionId:  describe result for acl check
2025-10-02T08:11:27.716161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:27.716163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:27.716165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:27.716171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534052885329923:4286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:27.716728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534052885329923:4286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:27.720784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534052885329923:4286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:27.723715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534052885329923:4286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:27.723735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534052885329923:4286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:27.723738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534052885329923:4286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:27.723747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:27.724472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:27.729050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:27.729388Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:27.729400Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:27.729412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:27.729476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:27.729521Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534052885330176:4279]
2025-10-02T08:11:27.730190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:27.730435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:27.730495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:27.730800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:27.730862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.730871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.730873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.730874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.730875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.730880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.730890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.730894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.730898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.730902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.730908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.730916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.730923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.730928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.730931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.730935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.730938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.730941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.730944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.730947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.730958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:27.742006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:27.744042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:27.744060Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:27.744062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:27.744065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:27.744071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1190 [1:7556534052885330176:4279]
2025-10-02T08:11:27.744084Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:27.744103Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:27.744107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.744110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.744113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.744129Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:27.744134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:27.744141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:27.744208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.744218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.744221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:27.744223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:27.744289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:27.744297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.744312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.744325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:27.744347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885330166:4286], now have 1 active actors on pipe
2025-10-02T08:11:27.744359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534052885330170:4279]
2025-10-02T08:11:27.744360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1190
2025-10-02T08:11:27.744367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534052885330170:4279]
2025-10-02T08:11:27.744376Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:27.744385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:27.744389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:27.744394Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:27.744403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:27.744406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:27.744412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534053345297328:2378], now have 1 active actors on pipe
2025-10-02T08:11:27.744422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.744426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.744469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534052885330170:4279]
2025-10-02T08:11:27.744481Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:27.744495Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:27.744498Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf6452b1-b3045af5-112ff831-702a5275_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:27.744507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.744511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.744512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:27.744523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.744531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:27.744578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.744628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.744636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.744649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.744693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1191 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf6452b1-b3045af5-112ff831-702a5275_0
2025-10-02T08:11:27.745093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780fa64c-ce0adb9f-60086619-4f60f79d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf6452b1-b3045af5-112ff831-702a5275_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:27.745048Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1190
2025-10-02T08:11:27.747741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6452b1-b3045af5-112ff831-702a5275_0] Write session: try to update token
2025-10-02T08:11:27.747756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6452b1-b3045af5-112ff831-702a5275_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:27.764396Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:27.764416Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:27.764418Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:27.764428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534052885330170:4279]
2025-10-02T08:11:27.764432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534052885330170:4279]
2025-10-02T08:11:27.764480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:27.764487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.764489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:27.764490Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:27.764496Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:27.764744Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:27.783486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId: src_id|bf6452b1-b3045af5-112ff831-702a5275_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:27.786276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:27.803468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534052885330202:5853]
2025-10-02T08:11:27.803622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1190, pipe: [1:7556534052885330202:5853]
2025-10-02T08:11:27.907259Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:27.907979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.907990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.908013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885330202:5853], now have 1 active actors on pipe
2025-10-02T08:11:27.910295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6452b1-b3045af5-112ff831-702a5275_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:27.910313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6452b1-b3045af5-112ff831-702a5275_0] Write session will restart in 0.009847s
2025-10-02T08:11:27.910341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6452b1-b3045af5-112ff831-702a5275_0] Write session: Do CDS request
2025-10-02T08:11:27.910349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6452b1-b3045af5-112ff831-702a5275_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:27.908776Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:27.909207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534052885330202:5853]
2025-10-02T08:11:27.909228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:27.909288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1191 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bf6452b1-b3045af5-112ff831-702a5275_0
2025-10-02T08:11:27.909486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1191 sessionId: src_id|bf6452b1-b3045af5-112ff831-702a5275_0 is DEAD
2025-10-02T08:11:27.909461Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:27.922612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6452b1-b3045af5-112ff831-702a5275_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.923782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:27.923801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1192
2025-10-02T08:11:27.925149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:27.925215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:27.925222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:27.925229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:27.925922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1192 sessionId:  describe result for acl check
2025-10-02T08:11:27.925963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:27.925965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:27.925967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:27.925973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534052885330533:4257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:27.926681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534052885330533:4257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:27.939223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534052885330533:4257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:27.947282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534052885330533:4257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:27.947301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534052885330533:4257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:27.947305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534052885330533:4257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:27.947315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:27.953947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:27.954397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:27.954591Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:27.954594Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:27.954605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:27.954656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:27.954691Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534052885330897:4258]
2025-10-02T08:11:27.955338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:27.955617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:27.955667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:27.955989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:27.956046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.956055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.956056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.956058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.956059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.956064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.956075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.956079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.956083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.956086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.956092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.956100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:27.956106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.956112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:27.956116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.956121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:27.956126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.956137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.956141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.956146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.956165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:27.965231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:27.967079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:27.967103Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:27.967107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:27.967111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:27.967118Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1191 [1:7556534052885330897:4258]
2025-10-02T08:11:27.967131Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:27.967150Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:27.967159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.967163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.967166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.967183Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:27.967193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:27.967206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:27.967281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.967293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.967299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:27.967301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:27.967378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:27.967387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.967401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:27.967414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:27.967437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534052885330891:4258]
2025-10-02T08:11:27.967443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534052885330891:4258]
2025-10-02T08:11:27.967451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:27.967466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534052885330829:4257], now have 1 active actors on pipe
2025-10-02T08:11:27.967470Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:27.967473Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:27.967473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1191
2025-10-02T08:11:27.967477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:27.967486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:27.967488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:27.967492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534053345297348:2378], now have 1 active actors on pipe
2025-10-02T08:11:27.967518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534052885330891:4258]
2025-10-02T08:11:27.967524Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:27.967684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:27.968007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1191
2025-10-02T08:11:27.968131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.968139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.968160Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|298d272d-a5a63aea-e495526-cc41182b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:27.968168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:27.968171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:27.968173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:27.968180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:27.968189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:27.968205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.968247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:27.968252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:27.968261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:27.968289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1192 partition: 0 MaxSeqNo: 17 sessionId: src_id|298d272d-a5a63aea-e495526-cc41182b_0
2025-10-02T08:11:27.968742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6452b1-b3045af5-112ff831-702a5275_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|298d272d-a5a63aea-e495526-cc41182b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:27.972202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|298d272d-a5a63aea-e495526-cc41182b_0] Write session: try to update token
2025-10-02T08:11:27.972232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|298d272d-a5a63aea-e495526-cc41182b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:27.980081Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:27.980096Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:27.980102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534052885330891:4258]
2025-10-02T08:11:27.980132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:27.980350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:27.980513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:27.980670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:27.980735Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:27.980796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:27.981010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:27.981036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:27.994695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId: src_id|298d272d-a5a63aea-e495526-cc41182b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:27.997309Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:27.997332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:27.997334Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:27.997343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534052885330891:4258]
2025-10-02T08:11:27.997347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534052885330891:4258]
2025-10-02T08:11:27.997392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:27.997398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:27.997400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:27.997436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:27.997444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:27.997528Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:27.998665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:28.012902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534057180298229:5853]
2025-10-02T08:11:28.013327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1191, pipe: [1:7556534057180298229:5853]
2025-10-02T08:11:28.145185Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:28.145793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.145802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.145826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180298229:5853], now have 1 active actors on pipe
2025-10-02T08:11:28.146047Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:28.146476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:28.146536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1192 reason: status is not ok: tablet will be restarted right now sessionId: src_id|298d272d-a5a63aea-e495526-cc41182b_0
2025-10-02T08:11:28.146701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1192 sessionId: src_id|298d272d-a5a63aea-e495526-cc41182b_0 is DEAD
2025-10-02T08:11:28.146828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534057180298229:5853]
2025-10-02T08:11:28.147097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|298d272d-a5a63aea-e495526-cc41182b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:28.147117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|298d272d-a5a63aea-e495526-cc41182b_0] Write session will restart in 0.007420s
2025-10-02T08:11:28.147147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|298d272d-a5a63aea-e495526-cc41182b_0] Write session: Do CDS request
2025-10-02T08:11:28.147158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|298d272d-a5a63aea-e495526-cc41182b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:28.148923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:28.156822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|298d272d-a5a63aea-e495526-cc41182b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:28.156981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:28.156999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1193
2025-10-02T08:11:28.157249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:28.157279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:28.157284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:28.157288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:28.160169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1193 sessionId:  describe result for acl check
2025-10-02T08:11:28.160211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:28.160213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:28.160215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:28.160221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534057180298524:4244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:28.160848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534057180298524:4244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:28.167820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534057180298524:4244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:28.173064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534057180298524:4244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:28.173084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534057180298524:4244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:28.173087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534057180298524:4244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:28.173096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:28.196771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:28.198389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:28.198690Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:28.198695Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:28.198707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:28.198769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:28.198804Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534057180298924:4245]
2025-10-02T08:11:28.199481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:28.199883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:28.199950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:28.200264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:28.200305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.200307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.200308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.200310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.200311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.200316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.200327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.200331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.200335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.200339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.200345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.200352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.200358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.200364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.200371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.200376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.200381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.200386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.200390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.200395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.200414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:28.210790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:28.212530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:28.212537Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:28.212539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:28.212543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:28.212551Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1192 [1:7556534057180298924:4245]
2025-10-02T08:11:28.212565Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:28.212584Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:28.212587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.212591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.212593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.212613Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:28.212618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:28.212626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:28.212693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.212695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.212698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:28.212701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:28.212783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:28.212786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.212815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.212825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:28.212845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534057180298918:4245]
2025-10-02T08:11:28.212847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534057180298918:4245]
2025-10-02T08:11:28.212854Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:28.212870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:28.212877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:28.212880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:28.212882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:28.212885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:28.212925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180298702:4244], now have 1 active actors on pipe
2025-10-02T08:11:28.212965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534057180298918:4245]
2025-10-02T08:11:28.212967Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:28.212972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534057640264652:2378], now have 1 active actors on pipe
2025-10-02T08:11:28.213583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1192
2025-10-02T08:11:28.213705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|298d272d-a5a63aea-e495526-cc41182b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9a18389-135099a0-54779563-567e69f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:28.213027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1192
2025-10-02T08:11:28.213070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:28.213214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.213220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.213251Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9a18389-135099a0-54779563-567e69f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:28.213258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.213262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.213264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:28.213275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.213286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:28.213304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:28.213323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.213325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.213335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:28.213361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1193 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9a18389-135099a0-54779563-567e69f8_0
2025-10-02T08:11:28.216771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a18389-135099a0-54779563-567e69f8_0] Write session: try to update token
2025-10-02T08:11:28.216792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a18389-135099a0-54779563-567e69f8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:28.229120Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:28.229146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:28.229155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534057180298918:4245]
2025-10-02T08:11:28.229201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:28.229378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:28.229529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:28.229672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:28.229813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:28.230023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:28.230070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:28.232894Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:28.238034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId: src_id|a9a18389-135099a0-54779563-567e69f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:28.240837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:28.241468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.241488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.241529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:28.241559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:28.241694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.241708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.241851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.241911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.241972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.242035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.242078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.242081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.242145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.242198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.242262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.242357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.242416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.242418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.242482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.242538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.242622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.242673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.242728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.242729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.242791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.242844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.242935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.243018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.243070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.243072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.243131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.243182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.243239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.243295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.243350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.243351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.243414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.243466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.243519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.243577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.243630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.243634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.243695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.243745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.243800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.243853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.243919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.243922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.243983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.244036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.244089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.244143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.244263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.244265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.244325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.244378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.244432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.244486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.244524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.244526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.244584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:28.244638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:28.244693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:28.244749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:28.245003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:28.245008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:28.245048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:28.245112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.245129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.245131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:28.245166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:28.245178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:28.245185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:28.245188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:28.245190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:28.245612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:28.245645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:28.245653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:28.245657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:28.245659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:28.245662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:28.246228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:28.246256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:28.246262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:28.246265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:28.246268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:28.246270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:28.246806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:28.246829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:28.246835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:28.246838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:28.246840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:28.247227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534057180298948:5853]
2025-10-02T08:11:28.247402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1192, pipe: [1:7556534057180298948:5853]
2025-10-02T08:11:28.249129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:28.249152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:28.249165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392688249
2025-10-02T08:11:28.249316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:28.249334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:28.249340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:28.249343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:28.249348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:28.249352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:28.249830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:28.249856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:28.249861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:28.249865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:28.249868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:28.249872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:28.250323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:28.250350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:28.250361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:28.250364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:28.250367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:28.250370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:28.250895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:28.250919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:28.250924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:28.252075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:28.252092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:28.252096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:28.252099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:28.252105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392688251
2025-10-02T08:11:28.252385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:28.252409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:28.252418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:28.252422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:28.252425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:28.252428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:28.252890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:28.252908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:28.252912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:28.252914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:28.252916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:28.252917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:28.253368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:28.253386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.253500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392688253
2025-10-02T08:11:28.256056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180298948:5853], now have 1 active actors on pipe
2025-10-02T08:11:28.256068Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:28.256079Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:28.256082Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:28.256086Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:28.257745Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:28.257758Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:28.257760Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:28.257770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534057180298918:4245]
2025-10-02T08:11:28.257774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534057180298918:4245]
2025-10-02T08:11:28.257817Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:28.257822Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:28.257833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:28.257838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.257840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:28.257977Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:28.410404Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:28.410994Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:28.412708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:28.412745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1193 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9a18389-135099a0-54779563-567e69f8_0
2025-10-02T08:11:28.411700Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:28.412936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1193 sessionId: src_id|a9a18389-135099a0-54779563-567e69f8_0 is DEAD
2025-10-02T08:11:28.413110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534057180298948:5853]
2025-10-02T08:11:28.413304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a18389-135099a0-54779563-567e69f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:28.413315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a18389-135099a0-54779563-567e69f8_0] Write session will restart in 0.009999s
2025-10-02T08:11:28.413337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a18389-135099a0-54779563-567e69f8_0] Write session: Do CDS request
2025-10-02T08:11:28.413344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a18389-135099a0-54779563-567e69f8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:28.425724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a18389-135099a0-54779563-567e69f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:28.426547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:28.426568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1194
2025-10-02T08:11:28.426800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:28.426837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:28.426846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:28.426850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:28.428336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1194 sessionId:  describe result for acl check
2025-10-02T08:11:28.428381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:28.428382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:28.428384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:28.428389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534057180299253:4204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:28.428911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534057180299253:4204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:28.434385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534057180299253:4204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:28.441864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534057180299253:4204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:28.441885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534057180299253:4204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:28.441889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534057180299253:4204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:28.441897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:28.451936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:28.452402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:28.452597Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:28.452601Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:28.452610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:28.452654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:28.452689Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534057180299684:4207]
2025-10-02T08:11:28.453343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:28.453657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:28.453696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:28.454006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:28.454056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.454056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.454057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.454059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.454059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.454064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.454075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.454078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.454082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.454086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.454091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.454098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.454103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.454108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.454112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.454117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.454121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.454125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.454129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.454134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.454156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:28.475379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:28.476852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:28.476858Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:28.476860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:28.476864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:28.476874Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1193 [1:7556534057180299684:4207]
2025-10-02T08:11:28.476886Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:28.476903Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:28.476906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.476909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.476911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.476927Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:28.476933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:28.476939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:28.477295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.477298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.477301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:28.477303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:28.477373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:28.477376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.477391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.477404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:28.477422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180299613:4204], now have 1 active actors on pipe
2025-10-02T08:11:28.477428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534057180299678:4207]
2025-10-02T08:11:28.477430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534057180299678:4207]
2025-10-02T08:11:28.477437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:28.477449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:28.477461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:28.477464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:28.477465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:28.477468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:28.477501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534057180299678:4207]
2025-10-02T08:11:28.477504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:28.477509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534057640264671:2378], now have 1 active actors on pipe
2025-10-02T08:11:28.477517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:28.477552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1193
2025-10-02T08:11:28.477709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.477714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.477737Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3780c320-2940a9dd-2d402d70-82625df6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:28.477752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.477755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.477756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:28.477764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.477774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:28.477792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:28.477889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.477901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.477922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:28.477955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1194 partition: 0 MaxSeqNo: 17 sessionId: src_id|3780c320-2940a9dd-2d402d70-82625df6_0
2025-10-02T08:11:28.478493Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1193
2025-10-02T08:11:28.479393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a18389-135099a0-54779563-567e69f8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3780c320-2940a9dd-2d402d70-82625df6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:28.481875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3780c320-2940a9dd-2d402d70-82625df6_0] Write session: try to update token
2025-10-02T08:11:28.481889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3780c320-2940a9dd-2d402d70-82625df6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:28.505845Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:28.505865Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:28.505868Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:28.505879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534057180299678:4207]
2025-10-02T08:11:28.505888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534057180299678:4207]
2025-10-02T08:11:28.505932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:28.505939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.505941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:28.506083Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:28.509382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:28.509399Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:28.517470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534057180299713:5853]
2025-10-02T08:11:28.517522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId: src_id|3780c320-2940a9dd-2d402d70-82625df6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:28.520197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:28.520367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1193, pipe: [1:7556534057180299713:5853]
2025-10-02T08:11:28.661011Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:28.661600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.661619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.661645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180299713:5853], now have 1 active actors on pipe
2025-10-02T08:11:28.661755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534057180299713:5853]
2025-10-02T08:11:28.661782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:28.661790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:28.661844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1194 reason: error at write: Disconnected sessionId: src_id|3780c320-2940a9dd-2d402d70-82625df6_0
2025-10-02T08:11:28.661872Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:28.662032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1194 sessionId: src_id|3780c320-2940a9dd-2d402d70-82625df6_0 is DEAD
2025-10-02T08:11:28.664959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3780c320-2940a9dd-2d402d70-82625df6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:28.664981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3780c320-2940a9dd-2d402d70-82625df6_0] Write session will restart in 0.007560s
2025-10-02T08:11:28.665013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3780c320-2940a9dd-2d402d70-82625df6_0] Write session: Do CDS request
2025-10-02T08:11:28.665024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3780c320-2940a9dd-2d402d70-82625df6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:28.664982Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:28.677388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3780c320-2940a9dd-2d402d70-82625df6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:28.681772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:28.681793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1195
2025-10-02T08:11:28.681961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:28.681999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:28.682005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:28.682009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:28.682574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1195 sessionId:  describe result for acl check
2025-10-02T08:11:28.682620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:28.682622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:28.682624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:28.682631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534057180300072:4184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:28.683322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534057180300072:4184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:28.687557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534057180300072:4184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:28.693889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534057180300072:4184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:28.693907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534057180300072:4184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:28.693910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534057180300072:4184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:28.693920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:28.703145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:28.704758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:28.704993Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:28.704997Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:28.705007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:28.705061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:28.705094Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534057180300415:4185]
2025-10-02T08:11:28.705738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:28.705969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:28.706057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:28.706760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:28.706911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.706921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.706922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.706923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.706925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.706932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.706942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.706945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.706957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.706960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.706967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.706975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.706980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.706986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.706992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.706997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.707002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.707008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.707013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.707018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.707041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:28.719163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:28.720924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:28.720942Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:28.720944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:28.720948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:28.720955Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1194 [1:7556534057180300415:4185]
2025-10-02T08:11:28.720976Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:28.721010Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:28.721018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.721021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.721024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.721041Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:28.721053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:28.721060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:28.721134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.721142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.721146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:28.721147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:28.721222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:28.721232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.721243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.721250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:28.721263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534057180300409:4185]
2025-10-02T08:11:28.721266Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534057180300409:4185]
2025-10-02T08:11:28.721272Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:28.721285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180300242:4184], now have 1 active actors on pipe
2025-10-02T08:11:28.721289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:28.721297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:28.721300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:28.721304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:28.721308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:28.721330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534057640264689:2378], now have 1 active actors on pipe
2025-10-02T08:11:28.721334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534057180300409:4185]
2025-10-02T08:11:28.721336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:28.721342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:28.721359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1194
2025-10-02T08:11:28.721445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.721450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.721475Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:28.721482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.721486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.721489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:28.721499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.721510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:28.721524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:28.721505Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1194
2025-10-02T08:11:28.721596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.721605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.721624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:28.721663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1195 partition: 0 MaxSeqNo: 17 sessionId: src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0
2025-10-02T08:11:28.722034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3780c320-2940a9dd-2d402d70-82625df6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:28.725583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0] Write session: try to update token
2025-10-02T08:11:28.725609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:28.734300Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:28.734317Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:28.734326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534057180300409:4185]
2025-10-02T08:11:28.734362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:28.734373Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:28.734546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:28.734713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:28.734854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:28.735013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:28.735219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:28.735262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:28.752606Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:28.752627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:28.752630Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:28.752642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534057180300409:4185]
2025-10-02T08:11:28.752647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534057180300409:4185]
2025-10-02T08:11:28.752685Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:28.752688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:28.752690Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:28.752695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.752697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:28.752760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId: src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:28.752861Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:28.755533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:28.764706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534057180300439:5853]
2025-10-02T08:11:28.764930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1194, pipe: [1:7556534057180300439:5853]
2025-10-02T08:11:28.895286Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:28.895891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.895926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.895949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180300439:5853], now have 1 active actors on pipe
2025-10-02T08:11:28.896899Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:28.897022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534057180300439:5853]
2025-10-02T08:11:28.897048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:28.897111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1195 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0
2025-10-02T08:11:28.897290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1195 sessionId: src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0 is DEAD
2025-10-02T08:11:28.897537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:28.897562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0] Write session will restart in 0.005748s
2025-10-02T08:11:28.897589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0] Write session: Do CDS request
2025-10-02T08:11:28.897597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:28.898459Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:28.904759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:28.905208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:28.905229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1196
2025-10-02T08:11:28.905425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:28.905460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:28.905471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:28.905475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:28.905927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1196 sessionId:  describe result for acl check
2025-10-02T08:11:28.905959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:28.905965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:28.905967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:28.905971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534057180300777:4180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:28.906452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534057180300777:4180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:28.909435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534057180300777:4180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:28.912463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534057180300777:4180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:28.912480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534057180300777:4180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:28.912483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534057180300777:4180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:28.912491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:28.915572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:28.916914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:28.917086Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:28.917094Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:28.917101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:28.917137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:28.917165Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534057180301136:4179]
2025-10-02T08:11:28.917732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:28.917866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:28.917893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:28.918135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:28.918170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.918175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.918175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.918176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.918177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.918180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.918186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.918188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.918191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.918192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.918196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.918201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:28.918204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.918208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:28.918210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.918213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:28.918216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.918218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.918221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.918224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.918245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:28.926457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:28.928150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:28.928167Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:28.928168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:28.928171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:28.928176Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1195 [1:7556534057180301136:4179]
2025-10-02T08:11:28.928186Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:28.928202Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:28.928210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.928213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.928215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.928234Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:28.928243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:28.928251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:28.928308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.928313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.928315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:28.928317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:28.928388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:28.928395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.928405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:28.928412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:28.928432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534057180301130:4179]
2025-10-02T08:11:28.928439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534057180301130:4179]
2025-10-02T08:11:28.928444Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:28.928455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180301061:4180], now have 1 active actors on pipe
2025-10-02T08:11:28.928458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1195
2025-10-02T08:11:28.928462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:28.928470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:28.928472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:28.928473Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:28.928476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:28.928502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534057640264708:2378], now have 1 active actors on pipe
2025-10-02T08:11:28.928506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.928508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.928520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534057180301130:4179]
2025-10-02T08:11:28.928527Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:28.928548Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7688efab-f93c72d5-d2753f83-f0762f47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:28.928553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:28.928556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:28.928557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:28.928564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:28.928572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:28.928578Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:28.928594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:28.928592Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1195
2025-10-02T08:11:28.928672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:28.928680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:28.928699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:28.928734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1196 partition: 0 MaxSeqNo: 17 sessionId: src_id|7688efab-f93c72d5-d2753f83-f0762f47_0
2025-10-02T08:11:28.929085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef7c3fa1-207ce4fb-9c330321-6e66203_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7688efab-f93c72d5-d2753f83-f0762f47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:28.932093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7688efab-f93c72d5-d2753f83-f0762f47_0] Write session: try to update token
2025-10-02T08:11:28.932113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7688efab-f93c72d5-d2753f83-f0762f47_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:28.946594Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:28.946615Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:28.946617Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:28.946626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534057180301130:4179]
2025-10-02T08:11:28.946629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534057180301130:4179]
2025-10-02T08:11:28.946669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:28.946675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:28.946677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:28.946724Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:28.946736Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:28.946829Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:28.959435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId: src_id|7688efab-f93c72d5-d2753f83-f0762f47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:28.962129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:28.997403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534057180301172:5853]
2025-10-02T08:11:28.997729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1195, pipe: [1:7556534057180301172:5853]
2025-10-02T08:11:29.097446Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:29.098093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.098112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.098137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534057180301172:5853], now have 1 active actors on pipe
2025-10-02T08:11:29.098264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534057180301172:5853]
2025-10-02T08:11:29.098294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:29.098297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:29.098356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1196 reason: error at write: Disconnected sessionId: src_id|7688efab-f93c72d5-d2753f83-f0762f47_0
2025-10-02T08:11:29.098372Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:29.098527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1196 sessionId: src_id|7688efab-f93c72d5-d2753f83-f0762f47_0 is DEAD
2025-10-02T08:11:29.098944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7688efab-f93c72d5-d2753f83-f0762f47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:29.098956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7688efab-f93c72d5-d2753f83-f0762f47_0] Write session will restart in 0.007939s
2025-10-02T08:11:29.098980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7688efab-f93c72d5-d2753f83-f0762f47_0] Write session: Do CDS request
2025-10-02T08:11:29.098989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7688efab-f93c72d5-d2753f83-f0762f47_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:29.099301Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:29.109077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7688efab-f93c72d5-d2753f83-f0762f47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:29.109475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:29.109492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1197
2025-10-02T08:11:29.110592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:29.110634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:29.110643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:29.110647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:29.112053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1197 sessionId:  describe result for acl check
2025-10-02T08:11:29.112092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:29.112093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:29.112095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:29.112099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534061475268821:4160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:29.112784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534061475268821:4160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:29.118794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534061475268821:4160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:29.125042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534061475268821:4160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:29.125062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534061475268821:4160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:29.125065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534061475268821:4160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:29.125074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:29.126429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:29.127860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:29.128099Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:29.128109Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:29.128119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:29.128179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:29.128214Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534061475269169:4162]
2025-10-02T08:11:29.128907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:29.129132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:29.129197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:29.129612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:29.129660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.129666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.129668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.129669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.129670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.129675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.129686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.129689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.129693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.129697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.129703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.129711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.129716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.129724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.129727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.129730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.129733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.129737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.129740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.129746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.129770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:29.140031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:29.141887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:29.141908Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:29.141912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:29.141916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:29.141922Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1196 [1:7556534061475269169:4162]
2025-10-02T08:11:29.141932Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:29.141948Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:29.141950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.141952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.141954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.141966Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:29.141971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:29.141978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:29.142039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.142046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.142048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:29.142050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:29.142119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:29.142127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.142138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.142153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:29.142174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534061475269163:4162]
2025-10-02T08:11:29.142181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534061475269163:4162]
2025-10-02T08:11:29.142194Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:29.142211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:29.142229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:29.142232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:29.142268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:29.142269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534061475269163:4162]
2025-10-02T08:11:29.142272Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:29.142281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:29.142297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:29.142375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534061475269158:4160], now have 1 active actors on pipe
2025-10-02T08:11:29.142375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1196
2025-10-02T08:11:29.142389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534061935232011:2378], now have 1 active actors on pipe
2025-10-02T08:11:29.142397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.142402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.142430Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:29.142448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.142453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.142456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:29.142466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.142483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:29.142504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:29.142551Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1196
2025-10-02T08:11:29.142596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.142605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.142622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:29.142664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1197 partition: 0 MaxSeqNo: 17 sessionId: src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0
2025-10-02T08:11:29.143033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7688efab-f93c72d5-d2753f83-f0762f47_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:29.145643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0] Write session: try to update token
2025-10-02T08:11:29.145659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:29.161309Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:29.161332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:29.161335Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:29.161345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534061475269163:4162]
2025-10-02T08:11:29.161350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534061475269163:4162]
2025-10-02T08:11:29.161395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:29.161398Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:29.161402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.161404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:29.161405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:29.161566Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:29.163149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId: src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:29.165948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:29.198398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534061475269195:5853]
2025-10-02T08:11:29.198507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1196, pipe: [1:7556534061475269195:5853]
2025-10-02T08:11:29.303841Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:29.304507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.304527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.304568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534061475269195:5853], now have 1 active actors on pipe
2025-10-02T08:11:29.304913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:29.304745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:29.304759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:29.304822Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:29.304848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1197 reason: error at write: Disconnected sessionId: src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0
2025-10-02T08:11:29.305046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1197 sessionId: src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0 is DEAD
2025-10-02T08:11:29.305184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534061475269195:5853]
2025-10-02T08:11:29.309013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:29.309026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0] Write session will restart in 0.006219s
2025-10-02T08:11:29.309050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0] Write session: Do CDS request
2025-10-02T08:11:29.309057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:29.317416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:29.320934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:29.320953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1198
2025-10-02T08:11:29.321798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:29.321841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:29.321846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:29.321850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:29.322295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1198 sessionId:  describe result for acl check
2025-10-02T08:11:29.322337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:29.322344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:29.322345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:29.322350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534061475269737:4143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:29.322937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534061475269737:4143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:29.328117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534061475269737:4143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:29.333316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534061475269737:4143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:29.333335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534061475269737:4143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:29.333338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534061475269737:4143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:29.333348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:29.337141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:29.338494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:29.338694Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:29.338697Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:29.338707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:29.338757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:29.338791Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534061475269894:4144]
2025-10-02T08:11:29.339382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:29.339608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:29.339649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:29.339941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:29.339982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.339982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.339983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.339984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.339985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.339990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.339999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.340003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.340006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.340009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.340015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.340021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.340026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.340030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.340034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.340038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.340042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.340046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.340050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.340054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.340070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:29.349291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:29.351179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:29.351202Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:29.351204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:29.351208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:29.351214Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1197 [1:7556534061475269894:4144]
2025-10-02T08:11:29.351226Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:29.351242Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:29.351246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.351248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.351250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.351266Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:29.351270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:29.351277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:29.351344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.351346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.351349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:29.351352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:29.351418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:29.351421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.351437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.351448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:29.351465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534061475269888:4144]
2025-10-02T08:11:29.351467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534061475269888:4144]
2025-10-02T08:11:29.351480Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:29.351492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:29.351506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:29.351509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:29.351544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534061475269888:4144]
2025-10-02T08:11:29.351547Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:29.351780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:29.351789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:29.351795Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:29.351894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1197
2025-10-02T08:11:29.351919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534061475269873:4143], now have 1 active actors on pipe
2025-10-02T08:11:29.352268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1197
2025-10-02T08:11:29.352404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.352415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.352433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534061935232017:2378], now have 1 active actors on pipe
2025-10-02T08:11:29.352456Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:29.352468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.352472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.352474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:29.352484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.352495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:29.352513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:29.352555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.352557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.352570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:29.352599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1198 partition: 0 MaxSeqNo: 17 sessionId: src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0
2025-10-02T08:11:29.353760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c1867-ddb193b4-a6c67b6d-57de220c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:29.356494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0] Write session: try to update token
2025-10-02T08:11:29.356513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:29.373089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId: src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:29.376305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:29.376439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.376460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.376506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:29.376532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:29.376716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.376721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.376923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.377007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.377089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.377169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.377244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.377254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.377342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.377425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.377513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.377588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.377641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.377643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.377720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.377782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.377849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.377920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.377980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.377982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.378054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.378122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.378193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.378269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.378322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.378326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.378410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.378595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.378678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.378807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.378870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.378873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.378960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.379035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.379106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.379173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.379226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.379228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.379306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.379377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.379447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.379522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.379638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.379640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.379717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.379781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.379849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.379938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.379999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.380003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.380086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.380151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.380218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.380291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.380349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.380354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.380442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:29.380515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:29.380586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:29.380655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:29.380705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:29.380707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:29.380758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:29.380911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.380935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.380938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:29.380983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:29.381002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:29.381006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:29.381010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:29.381014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:29.381440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:29.381480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:29.381490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:29.381494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:29.381497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:29.381501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:29.382022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:29.382049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:29.382055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:29.382060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:29.382064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:29.382068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:29.382910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:29.382942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:29.382951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:29.382955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:29.382959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:29.384410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:29.384434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:29.384449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392689384
2025-10-02T08:11:29.384765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:29.384782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:29.384789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:29.384795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:29.385103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:29.385114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:29.385721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:29.385745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:29.385753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:29.385759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:29.385762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:29.385767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:29.386422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:29.386448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:29.386457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:29.386461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:29.386465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:29.386469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:29.386975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:29.387003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:29.387015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:29.388377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:29.388401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:29.388409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:29.388413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:29.388424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392689388
2025-10-02T08:11:29.390419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:29.390451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:29.390462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:29.390467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:29.390472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:29.390552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:29.391208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:29.391229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:29.391242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:29.391248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:29.391252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:29.391255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:29.391827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:29.391840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.391949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392689391
2025-10-02T08:11:29.392863Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:29.392876Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:29.392883Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:29.392893Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:29.395072Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:29.395090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:29.395092Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:29.395099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534061475269888:4144]
2025-10-02T08:11:29.395105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534061475269888:4144]
2025-10-02T08:11:29.395166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:29.395171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.395173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:29.395340Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:29.396919Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:29.396925Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:29.404768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534061475269925:5853]
2025-10-02T08:11:29.405051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1197, pipe: [1:7556534061475269925:5853]
2025-10-02T08:11:29.548220Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:29.548636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534061475269925:5853], now have 1 active actors on pipe
2025-10-02T08:11:29.549621Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:29.549731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:29.549747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0] Write session will restart in 0.007757s
2025-10-02T08:11:29.549775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0] Write session: Do CDS request
2025-10-02T08:11:29.549784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:29.548952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:29.548964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:29.548988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1198 reason: error at write: Disconnected sessionId: src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0
2025-10-02T08:11:29.549064Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:29.549141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1198 sessionId: src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0 is DEAD
2025-10-02T08:11:29.549257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534061475269925:5853]
2025-10-02T08:11:29.558845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:29.565014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:29.565042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1199
2025-10-02T08:11:29.565302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:29.565348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:29.565364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:29.565368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:29.565784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1199 sessionId:  describe result for acl check
2025-10-02T08:11:29.565810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:29.565811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:29.565813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:29.565818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534061475270386:4106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:29.566364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534061475270386:4106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:29.573258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534061475270386:4106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:29.577380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534061475270386:4106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:29.577399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534061475270386:4106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:29.577402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534061475270386:4106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:29.577411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:29.578950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:29.580618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:29.580791Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:29.580796Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:29.580823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:29.580870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:29.580903Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534061475270671:4105]
2025-10-02T08:11:29.581546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:29.581749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:29.581782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:29.582091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:29.582126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.582127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.582128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.582129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.582130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.582135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.582144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.582148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.582152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.582156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.582161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.582168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.582173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.582178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.582182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.582187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.582191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.582196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.582200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.582205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.582223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:29.594519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:29.596114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:29.596121Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:29.596124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:29.596127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:29.596135Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1198 [1:7556534061475270671:4105]
2025-10-02T08:11:29.596148Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:29.596165Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:29.596169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.596172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.596174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.596190Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:29.596195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:29.596202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:29.596269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.596274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.596277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:29.596279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:29.596347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:29.596349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.596363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.596374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:29.596390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534061475270663:4105]
2025-10-02T08:11:29.596392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534061475270663:4105]
2025-10-02T08:11:29.596402Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:29.596415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:29.596426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:29.596429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:29.596430Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:29.596434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:29.596468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534061475270653:4106], now have 1 active actors on pipe
2025-10-02T08:11:29.596471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534061935232046:2378], now have 1 active actors on pipe
2025-10-02T08:11:29.596474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534061475270663:4105]
2025-10-02T08:11:29.596483Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:29.596492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1198
2025-10-02T08:11:29.596523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:29.596839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.596847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.596880Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:29.596889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.596894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.596896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:29.596908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.596919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:29.596937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:29.597136Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1198
2025-10-02T08:11:29.597490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.597507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.597534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:29.597574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1199 partition: 0 MaxSeqNo: 17 sessionId: src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0
2025-10-02T08:11:29.598029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca33480-4779bfd4-bd1e7ec0-aef30e71_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:29.600950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0] Write session: try to update token
2025-10-02T08:11:29.600968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:29.622632Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:29.622650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:29.622652Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:29.622659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534061475270663:4105]
2025-10-02T08:11:29.622662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534061475270663:4105]
2025-10-02T08:11:29.622697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:29.622704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.622706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:29.622846Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:29.624955Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:29.624972Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:29.636087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId: src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:29.639848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:29.649515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534061475270698:5853]
2025-10-02T08:11:29.649662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1198, pipe: [1:7556534061475270698:5853]
2025-10-02T08:11:29.781773Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:29.782218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.782227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.782267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534061475270698:5853], now have 1 active actors on pipe
2025-10-02T08:11:29.782586Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:29.782938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:29.782992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1199 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0
2025-10-02T08:11:29.783136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534061475270698:5853]
2025-10-02T08:11:29.783185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1199 sessionId: src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0 is DEAD
2025-10-02T08:11:29.785587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:29.785604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0] Write session will restart in 0.006617s
2025-10-02T08:11:29.785634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0] Write session: Do CDS request
2025-10-02T08:11:29.785647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:29.784912Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:29.796678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:29.797074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:29.797098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1200
2025-10-02T08:11:29.797354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:29.797419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:29.797425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:29.797430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:29.798536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1200 sessionId:  describe result for acl check
2025-10-02T08:11:29.798583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:29.798585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:29.798586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:29.798593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534061475270959:4097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:29.799201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534061475270959:4097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:29.808923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534061475270959:4097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:29.821648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534061475270959:4097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:29.821670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534061475270959:4097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:29.821675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534061475270959:4097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:29.821683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:29.844996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:29.847231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:29.847446Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:29.847449Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:29.847459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:29.847507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:29.847541Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534061475271405:4098]
2025-10-02T08:11:29.848266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:29.848586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:29.848633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:29.848970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:29.849018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.849019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.849020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.849022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.849022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.849028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.849039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.849044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.849047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.849052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.849057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.849066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:29.849072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.849078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:29.849084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.849090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:29.849095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.849101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.849107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.849113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.849135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:29.865802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:29.867935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:29.867954Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:29.867957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:29.867961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:29.867968Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1199 [1:7556534061475271405:4098]
2025-10-02T08:11:29.867982Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:29.868001Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:29.868004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.868007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.868008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.868026Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:29.868032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:29.868039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:29.868106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.868114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.868117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:29.868120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:29.868184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:29.868190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.868205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:29.868221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:29.868244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534061475271399:4098]
2025-10-02T08:11:29.868250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534061475271399:4098]
2025-10-02T08:11:29.868261Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:29.868279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:29.868292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:29.868295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:29.868304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:29.868306Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:29.868332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534061475271399:4098]
2025-10-02T08:11:29.868335Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:29.868360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534061475271209:4097], now have 1 active actors on pipe
2025-10-02T08:11:29.868375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:29.868406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1199
2025-10-02T08:11:29.868417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534061935232055:2378], now have 1 active actors on pipe
2025-10-02T08:11:29.868782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.868789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.868830Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:29.868839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:29.868843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:29.868845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:29.868855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:29.868866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:29.868881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:29.868993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:29.868995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:29.869009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:29.869039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1200 partition: 0 MaxSeqNo: 17 sessionId: src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0
2025-10-02T08:11:29.869576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b685f3ba-598c3a07-e462afd9-fabdc179_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:29.869082Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1199
2025-10-02T08:11:29.873088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0] Write session: try to update token
2025-10-02T08:11:29.873110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:29.883850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534061475271429:5853]
2025-10-02T08:11:29.884276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1199, pipe: [1:7556534061475271429:5853]
2025-10-02T08:11:29.884301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534061475271429:5853], now have 1 active actors on pipe
2025-10-02T08:11:29.911524Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:29.911547Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:29.911550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:29.911561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534061475271399:4098]
2025-10-02T08:11:29.911566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534061475271399:4098]
2025-10-02T08:11:29.911615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:29.911622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:29.911625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:29.911788Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:29.915472Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:29.915495Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:29.921200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId: src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:29.924119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:30.064083Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:30.064349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.064360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.064529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:30.064543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:30.064627Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:30.064977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:30.064986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0] Write session will restart in 0.007656s
2025-10-02T08:11:30.065012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0] Write session: Do CDS request
2025-10-02T08:11:30.065030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:30.064601Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:30.064610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1200 reason: error at write: Disconnected sessionId: src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0
2025-10-02T08:11:30.064792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1200 sessionId: src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0 is DEAD
2025-10-02T08:11:30.064974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534061475271429:5853]
2025-10-02T08:11:30.084529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:30.084934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:30.084956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1201
2025-10-02T08:11:30.085179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:30.085224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:30.085230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:30.085233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:30.086257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1201 sessionId:  describe result for acl check
2025-10-02T08:11:30.086313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:30.086319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:30.086321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:30.086327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534065770239151:4080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:30.086874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534065770239151:4080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:30.092739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534065770239151:4080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:30.113297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534065770239151:4080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:30.113316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534065770239151:4080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:30.113320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534065770239151:4080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:30.113330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:30.118813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:30.119365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:30.119632Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:30.119635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:30.119644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:30.119687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:30.119715Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534065770239450:4087]
2025-10-02T08:11:30.120216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:30.120472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:30.120507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:30.120727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:30.120753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.120753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.120754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.120755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.120755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.120759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.120766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.120769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.120771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.120773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.120777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.120782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.120787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.120790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.120793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.120797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.120818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.120824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.120829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.120833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.120851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:30.132385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:30.134255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:30.134265Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:30.134268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:30.134272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:30.134281Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1200 [1:7556534065770239450:4087]
2025-10-02T08:11:30.134296Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:30.134312Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:30.134316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.134320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.134322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.134340Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:30.134345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:30.134353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:30.134442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.134445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.134448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:30.134450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:30.134551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:30.134555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.134570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.134580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:30.134601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534065770239444:4087]
2025-10-02T08:11:30.134603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534065770239444:4087]
2025-10-02T08:11:30.134614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:30.134628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:30.134641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:30.134643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:30.134661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534065770239428:4080], now have 1 active actors on pipe
2025-10-02T08:11:30.134666Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:30.134670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:30.134698Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534065770239444:4087]
2025-10-02T08:11:30.134702Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:30.134707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534066230199372:2378], now have 1 active actors on pipe
2025-10-02T08:11:30.134730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1200
2025-10-02T08:11:30.134993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:30.135261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.135271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.135298Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:30.135307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.135311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.135313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:30.135324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.135336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:30.135353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:30.135514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1200
2025-10-02T08:11:30.135473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.135479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.135493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:30.135526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1201 partition: 0 MaxSeqNo: 17 sessionId: src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0
2025-10-02T08:11:30.136961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fb0c26f-ff3f1a39-9475e60a-2b98fe61_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:30.140783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0] Write session: try to update token
2025-10-02T08:11:30.144868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:30.166244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534065770239474:5853]
2025-10-02T08:11:30.167291Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:30.167308Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:30.167311Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:30.167319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534065770239444:4087]
2025-10-02T08:11:30.167328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534065770239444:4087]
2025-10-02T08:11:30.167373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:30.167381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.167383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:30.167553Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:30.169040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:30.169047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:30.169268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1200, pipe: [1:7556534065770239474:5853]
2025-10-02T08:11:30.185441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId: src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:30.188100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:30.346271Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:30.346687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534065770239474:5853], now have 1 active actors on pipe
2025-10-02T08:11:30.346709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.346715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.347089Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:30.346896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:30.346905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:30.346967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1201 reason: error at write: Disconnected sessionId: src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0
2025-10-02T08:11:30.347141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1201 sessionId: src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0 is DEAD
2025-10-02T08:11:30.347386Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:30.347724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534065770239474:5853]
2025-10-02T08:11:30.349069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:30.349086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0] Write session will restart in 0.009807s
2025-10-02T08:11:30.349116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0] Write session: Do CDS request
2025-10-02T08:11:30.349123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:30.361551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:30.365324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:30.365344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1202
2025-10-02T08:11:30.365566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:30.365627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:30.365637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:30.365642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:30.366135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1202 sessionId:  describe result for acl check
2025-10-02T08:11:30.366171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:30.366173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:30.366174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:30.366180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534065770239776:4068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:30.366706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534065770239776:4068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:30.370002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534065770239776:4068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:30.377331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534065770239776:4068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:30.377354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534065770239776:4068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:30.377358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534065770239776:4068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:30.377367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:30.381365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:30.383666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:30.383850Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:30.383860Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:30.383870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:30.383933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:30.383979Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534065770240185:4069]
2025-10-02T08:11:30.384450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:30.384707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:30.384746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:30.384988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:30.385034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.385040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.385041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.385043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.385044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.385049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.385060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.385064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.385067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.385071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.385078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.385085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.385091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.385096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.385102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.385119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.385128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.385134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.385142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.385148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.385169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:30.397261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:30.399438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:30.399462Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:30.399465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:30.399470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:30.399479Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1201 [1:7556534065770240185:4069]
2025-10-02T08:11:30.399491Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:30.399508Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:30.399518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.399522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.399524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.399542Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:30.399553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:30.399560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:30.399630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.399639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.399643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:30.399646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:30.399713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:30.399723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.399739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.399750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:30.399770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534065770240135:4068], now have 1 active actors on pipe
2025-10-02T08:11:30.399777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534065770240179:4069]
2025-10-02T08:11:30.399779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534065770240179:4069]
2025-10-02T08:11:30.399788Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:30.399802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:30.399816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:30.399820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:30.399826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534066230199380:2378], now have 1 active actors on pipe
2025-10-02T08:11:30.399858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534065770240179:4069]
2025-10-02T08:11:30.399861Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:30.399921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1201
2025-10-02T08:11:30.399951Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:30.399954Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:30.399959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:30.400076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.400081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.400109Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:30.400117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.400121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.400123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:30.400133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.400144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:30.400160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:30.400213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.400216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.400231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:30.400262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1202 partition: 0 MaxSeqNo: 17 sessionId: src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0
2025-10-02T08:11:30.400742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786bbe5b-b701d081-d94c6f01-297f1bb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:30.404280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0] Write session: try to update token
2025-10-02T08:11:30.404309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:30.400938Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1201
2025-10-02T08:11:30.424125Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:30.424150Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:30.424153Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:30.424162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534065770240179:4069]
2025-10-02T08:11:30.424167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534065770240179:4069]
2025-10-02T08:11:30.424206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:30.424207Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:30.424214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.424214Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:30.424217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:30.424367Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:30.432653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId: src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:30.435752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:30.447713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534065770240209:5853]
2025-10-02T08:11:30.447916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1201, pipe: [1:7556534065770240209:5853]
2025-10-02T08:11:30.583422Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:30.583859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.583876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.583931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534065770240209:5853], now have 1 active actors on pipe
2025-10-02T08:11:30.584148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:30.584166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:30.584638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:30.584656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0] Write session will restart in 0.006370s
2025-10-02T08:11:30.584696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0] Write session: Do CDS request
2025-10-02T08:11:30.584704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:30.584231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1202 reason: error at write: Disconnected sessionId: src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0
2025-10-02T08:11:30.584446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1202 sessionId: src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0 is DEAD
2025-10-02T08:11:30.584637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534065770240209:5853]
2025-10-02T08:11:30.584652Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:11:30.584260Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:30.585484Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:30.588903Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 12 consumer shared/user session shared/user_1_12_6011130484365189452_v1 is DEAD
2025-10-02T08:11:30.589776Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533984165801485:5851] disconnected; active server actors: 1
2025-10-02T08:11:30.589794Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556533984165801485:5851] client user disconnected session shared/user_1_12_6011130484365189452_v1
2025-10-02T08:11:30.592509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:30.593226Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:11:30.593243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:30.593262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1203
2025-10-02T08:11:30.593387Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:11:30.593394Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:11:30.593404Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.005933s
2025-10-02T08:11:30.593404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:30.593438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:30.593448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:30.593452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:30.593881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1203 sessionId:  describe result for acl check
2025-10-02T08:11:30.593913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:30.593918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:30.593920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:30.593925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534065770240293:4011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:30.594367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534065770240293:4011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:30.596551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534065770240293:4011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:30.600370Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:11:30.600477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534065770240293:4011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:30.600495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534065770240293:4011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:30.600499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534065770240293:4011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:30.600508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:30.600547Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:11:30.600558Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 13
2025-10-02T08:11:30.600748Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 13 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:11:30.600816Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:11:30.600877Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 auth for : user
2025-10-02T08:11:30.601016Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 Handle describe topics response
2025-10-02T08:11:30.601045Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 auth is DEAD
2025-10-02T08:11:30.601055Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:11:30.601307Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:11:30.601403Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_13_10264811666538442874_v1
2025-10-02T08:11:30.601413Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:11:30.601487Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:11:30.601471Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534065770240598:4007] connected; active server actors: 1
2025-10-02T08:11:30.601542Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:11:30.601589Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 got read request: guid# 69a525a7-f6c9f237-9e6b7f14-4aa66994
2025-10-02T08:11:30.601681Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534065770240598:4007] session shared/user_1_13_10264811666538442874_v1
2025-10-02T08:11:30.601699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:11:30.601708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:11:30.601713Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_13_10264811666538442874_v1" (Sender=[1:7556534065770240574:4007], Pipe=[1:7556534065770240598:4007], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:11:30.601726Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:11:30.601739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:11:30.601751Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_13_10264811666538442874_v1" (Sender=[1:7556534065770240574:4007], Pipe=[1:7556534065770240598:4007], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:11:30.601761Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_13_10264811666538442874_v1" sender [1:7556534065770240574:4007] lock partition 0 for ReadingSession "shared/user_1_13_10264811666538442874_v1" (Sender=[1:7556534065770240574:4007], Pipe=[1:7556534065770240598:4007], Partitions=[], ActiveFamilyCount=1) generation 1 step 13
2025-10-02T08:11:30.601784Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:11:30.601792Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000045s
2025-10-02T08:11:30.602017Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 13 Session: "shared/user_1_13_10264811666538442874_v1" ClientId: "user" PipeClient { RawX1: 7556534065770240598 RawX2: 4503603922341799 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:11:30.602042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:11:30.611174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:30.612665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:30.612980Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:30.612993Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:30.613006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:30.613061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:30.613099Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534065770240967:4016]
2025-10-02T08:11:30.613689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:30.613922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:30.613967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:30.614274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:30.614324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.614331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.614332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.614333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.614335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.614340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.614351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.614356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.614360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.614367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.614373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.614380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.614385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.614389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.614395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.614404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.614408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.614411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.614419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.614423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.614438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:30.622929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:30.624908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:30.624928Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:30.624930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:30.624934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:30.624940Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1202 [1:7556534065770240967:4016]
2025-10-02T08:11:30.624955Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:30.624972Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:30.624975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.624978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.624979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.624996Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:30.625001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:30.625008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:30.625070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.625078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.625080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:30.625082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:30.625135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:30.625141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.625151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.625161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:30.625177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534065770240961:4016]
2025-10-02T08:11:30.625182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534065770240961:4016]
2025-10-02T08:11:30.625188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:30.625198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:30.625209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:30.625215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:30.625229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:30.625241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:30.625247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534065770240621:3998], now have 1 active actors on pipe
2025-10-02T08:11:30.625249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1202, pipe: [1:7556534065770240621:3998]
2025-10-02T08:11:30.625250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534065770240577:4011], now have 1 active actors on pipe
2025-10-02T08:11:30.625251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534065770240961:4016]
2025-10-02T08:11:30.625253Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:30.625265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1202
2025-10-02T08:11:30.625267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.625269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.625271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:30.625277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_13_10264811666538442874_v1 on pipe: [1:7556534065770240621:3998]
2025-10-02T08:11:30.625312Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_13_10264811666538442874_v1:1 with generation 1202
2025-10-02T08:11:30.625312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534066230199410:2378], now have 1 active actors on pipe
2025-10-02T08:11:30.625315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.625317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.625325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.625328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.625330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:30.625340Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_13_10264811666538442874_v1
2025-10-02T08:11:30.625341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.625367Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:30.625377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:11:30.625379Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:30.625448Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1202
2025-10-02T08:11:30.627221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:11:30.627244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:11:30.627249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.627254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.627256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:30.627264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.627273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:30.627277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:11:30.627286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:11:30.627301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:30.627345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.627355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.627369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:30.627382Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392690624 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:11:30.627392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:11:30.627408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1203 partition: 0 MaxSeqNo: 17 sessionId: src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0
2025-10-02T08:11:30.627419Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 sending to client partition status
2025-10-02T08:11:30.627861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a3b3dd-badf4f08-eb046264-1656c84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:30.630729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0] Write session: try to update token
2025-10-02T08:11:30.630749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:30.644058Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:30.644078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:30.644079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:30.644089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534065770240961:4016]
2025-10-02T08:11:30.644092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534065770240961:4016]
2025-10-02T08:11:30.644127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:30.644139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.644141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:30.644142Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:30.644149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:30.644281Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:30.645791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId: src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:30.648589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:30.794680Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:30.795172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.795191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.795653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_13_10264811666538442874_v1
2025-10-02T08:11:30.795673Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:30.796143Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:30.796189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534065770240621:3998]
2025-10-02T08:11:30.796224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:30.796281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1203 reason: status is not ok: tablet will be restarted right now sessionId: src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0
2025-10-02T08:11:30.796282Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_13_10264811666538442874_v1
2025-10-02T08:11:30.796498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1203 sessionId: src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0 is DEAD
2025-10-02T08:11:30.797077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:30.797101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0] Write session will restart in 0.009358s
2025-10-02T08:11:30.797130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0] Write session: Do CDS request
2025-10-02T08:11:30.797136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:30.807533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:30.808012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:30.808040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1204
2025-10-02T08:11:30.808192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:30.808220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:30.808231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:30.808235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:30.808680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1204 sessionId:  describe result for acl check
2025-10-02T08:11:30.808715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:30.808716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:30.808718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:30.808722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534065770241364:3987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:30.809390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534065770241364:3987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:30.814463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534065770241364:3987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:30.822028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534065770241364:3987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:30.822054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534065770241364:3987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:30.822058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534065770241364:3987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:30.822068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:30.826331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:30.828286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:30.828469Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:30.828471Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:30.828478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:30.828515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:30.828542Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534065770241711:3989]
2025-10-02T08:11:30.829036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:30.829235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:30.829275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:30.829523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:30.829553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.829554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.829555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.829556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.829556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.829560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.829567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.829569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.829571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.829574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.829577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.829582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:30.829586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.829589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:30.829592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.829595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:30.829598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.829601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.829604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.829607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.829618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:30.839213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:30.840907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:30.840913Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:30.840915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:30.840917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:30.840923Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1203 [1:7556534065770241711:3989]
2025-10-02T08:11:30.840932Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:30.840946Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:30.840948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.840951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.840953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.840970Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:30.840975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:30.840982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:30.841044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.841046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.841049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:30.841052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:30.841120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:30.841122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.841136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:30.841146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:30.841162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534065770241705:3989]
2025-10-02T08:11:30.841164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534065770241705:3989]
2025-10-02T08:11:30.841171Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:30.841184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:30.841196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:30.841200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:30.841211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534065770241674:3987], now have 1 active actors on pipe
2025-10-02T08:11:30.841218Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:30.841220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:30.841242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534065770241705:3989]
2025-10-02T08:11:30.841245Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:30.841252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534066230199417:2378], now have 1 active actors on pipe
2025-10-02T08:11:30.841298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1203
2025-10-02T08:11:30.841378Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:30.841478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.841490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.841516Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:30.841523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:30.841527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:30.841529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:30.841538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:30.841549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:30.841567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:30.841635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:30.841640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:30.841653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:30.841681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1204 partition: 0 MaxSeqNo: 17 sessionId: src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0
2025-10-02T08:11:30.841966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1203
2025-10-02T08:11:30.842295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|183f8ee4-9f5e74eb-8defac26-36feabb6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:30.845993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0] Write session: try to update token
2025-10-02T08:11:30.846024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:30.861768Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:30.861787Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:30.861789Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:30.861796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534065770241705:3989]
2025-10-02T08:11:30.861803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534065770241705:3989]
2025-10-02T08:11:30.861851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:30.861858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:30.861860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:30.861860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:30.861864Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:30.862002Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:30.880412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId: src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:30.883007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:30.895726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534065770241737:3998]
2025-10-02T08:11:30.895959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1203, pipe: [1:7556534065770241737:3998]
2025-10-02T08:11:31.017346Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:31.017876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.017892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.017909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534065770241737:3998], now have 1 active actors on pipe
2025-10-02T08:11:31.018313Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:31.018368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:31.018459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1204 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0
2025-10-02T08:11:31.018662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1204 sessionId: src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0 is DEAD
2025-10-02T08:11:31.018670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534065770241737:3998]
2025-10-02T08:11:31.018637Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:31.019821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:31.019833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0] Write session will restart in 0.005846s
2025-10-02T08:11:31.019861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0] Write session: Do CDS request
2025-10-02T08:11:31.019869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:31.029424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:31.029849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:31.029868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1205
2025-10-02T08:11:31.031645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:31.031711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:31.031718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:31.031723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:31.032507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1205 sessionId:  describe result for acl check
2025-10-02T08:11:31.032558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:31.032561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:31.032563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:31.032570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534070065209382:3970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:31.033269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534070065209382:3970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:31.038263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534070065209382:3970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:31.044243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534070065209382:3970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:31.044265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534070065209382:3970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:31.044268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534070065209382:3970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:31.044279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:31.058361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:31.062887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:31.063182Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:31.063195Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:31.063208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:31.063270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:31.063324Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534070065209759:3973]
2025-10-02T08:11:31.064126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:31.064426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:31.064473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:31.064876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:31.064935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.064942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.064944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.064945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.064948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.064954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.064966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.064976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.064981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.064990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.065000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.065014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.065026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.065037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.065047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.065058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.065068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.065079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.065085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.065096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.065119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:31.076502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:31.078591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:31.078617Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:31.078621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:31.078626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:31.078635Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1204 [1:7556534070065209759:3973]
2025-10-02T08:11:31.078652Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:31.078674Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:31.078678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.078683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.078686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.078707Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:31.078714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:31.078724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:31.078813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.078816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.078820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:31.078824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:31.078911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:31.078915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.078934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.078948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:31.078970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534070065209752:3973]
2025-10-02T08:11:31.078973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534070065209752:3973]
2025-10-02T08:11:31.078989Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:31.079004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:31.079024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:31.079028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:31.079073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534070065209752:3973]
2025-10-02T08:11:31.079076Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:31.079186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:31.079189Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:31.079195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:31.080984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1204
2025-10-02T08:11:31.080879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1204
2025-10-02T08:11:31.080932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534070065209612:3970], now have 1 active actors on pipe
2025-10-02T08:11:31.080938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534070525166734:2378], now have 1 active actors on pipe
2025-10-02T08:11:31.080946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.080953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.080985Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:31.080996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.081001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.081004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:31.081015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.081032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:31.081053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:31.081089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.081105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.081120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:31.081153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1205 partition: 0 MaxSeqNo: 17 sessionId: src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0
2025-10-02T08:11:31.085409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ab3baf-740153a4-77d15bfe-db6c34a2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:31.088676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0] Write session: try to update token
2025-10-02T08:11:31.088706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:31.109583Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:31.109611Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:31.109614Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:31.109626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534070065209752:3973]
2025-10-02T08:11:31.109632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534070065209752:3973]
2025-10-02T08:11:31.109694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:31.109702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.109705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:31.109707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:31.109716Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:31.109875Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:31.117251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId: src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:31.120565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:31.120907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534070065209785:3998]
2025-10-02T08:11:31.121060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1204, pipe: [1:7556534070065209785:3998]
2025-10-02T08:11:31.274909Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:31.275751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.275763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.275793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534070065209785:3998], now have 1 active actors on pipe
2025-10-02T08:11:31.276644Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:31.277011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534070065209785:3998]
2025-10-02T08:11:31.277039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:31.277094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1205 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0
2025-10-02T08:11:31.277121Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:31.277730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:31.277740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0] Write session will restart in 0.007606s
2025-10-02T08:11:31.277764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0] Write session: Do CDS request
2025-10-02T08:11:31.277773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:31.277270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1205 sessionId: src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0 is DEAD
2025-10-02T08:11:31.286757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:31.287020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:31.287046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1206
2025-10-02T08:11:31.287544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:31.287585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:31.287591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:31.287594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:31.288321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1206 sessionId:  describe result for acl check
2025-10-02T08:11:31.288361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:31.288363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:31.288364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:31.288369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534070065210066:3943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:31.288954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534070065210066:3943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:31.293489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534070065210066:3943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:31.301973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534070065210066:3943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:31.301998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534070065210066:3943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:31.302002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534070065210066:3943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:31.302011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:31.324124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:31.324741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:31.324985Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:31.325001Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:31.325012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:31.325080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:31.325132Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534070065210503:3947]
2025-10-02T08:11:31.325776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:31.326831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:31.326901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:31.327267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:31.327332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.327334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.327335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.327336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.327338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.327345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.327357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.327362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.327366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.327370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.327379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.327388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.327394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.327400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.327406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.327413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.327417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.327423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.327428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.327434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.327455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:31.338751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:31.340459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:31.340487Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:31.340490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:31.340494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:31.340502Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1205 [1:7556534070065210503:3947]
2025-10-02T08:11:31.340516Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:31.340536Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:31.340539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.340542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.340545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.340562Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:31.340569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:31.340576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:31.340655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.340671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.340675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:31.340678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:31.340841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1205
2025-10-02T08:11:31.340938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:31.340955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.340971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.340986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:31.340932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1205
2025-10-02T08:11:31.341007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534070065210149:3943], now have 1 active actors on pipe
2025-10-02T08:11:31.341015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534070525166740:2378], now have 1 active actors on pipe
2025-10-02T08:11:31.341021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.341025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.341051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534070065210497:3947]
2025-10-02T08:11:31.341060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534070065210497:3947]
2025-10-02T08:11:31.341074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:31.341088Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:31.341091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:31.341099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:31.341106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:31.341109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:31.341127Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:31.341135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.341138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.341141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:31.341150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.341164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:31.341211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534070065210497:3947]
2025-10-02T08:11:31.341227Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:31.341237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:31.341241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:31.341292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.341300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.341313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:31.341348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1206 partition: 0 MaxSeqNo: 17 sessionId: src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0
2025-10-02T08:11:31.341719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1019ad5c-fbaa811c-32665d0e-84f8d960_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:31.344784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0] Write session: try to update token
2025-10-02T08:11:31.344838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:31.353160Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:31.353184Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:31.353195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534070065210497:3947]
2025-10-02T08:11:31.353237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:31.353247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:31.353429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:31.353587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:31.353742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:31.353893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:31.354226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:31.354274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:31.365655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId: src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:31.368390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:31.368462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.368470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.368505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:31.368528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:31.368579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.368600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.368782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.368861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.368963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.369039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.369416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.369422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.369497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.369566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.369672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.369781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.369828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.369831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.369912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.369979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.370043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.370107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.370158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.370161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.370232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.370298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.370367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.370436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.370484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.370486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.370570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.370633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.370697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.370759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.370821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.370826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.370899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.370962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.371033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.371100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.371145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.371148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.371223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.371286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.371353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.371707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.371769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.371771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.371846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.371927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.372000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.372072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.372119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.372123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.372197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.372264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.372330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.372400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.372451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.372455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.372531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:31.372597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:31.372667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:31.372756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:31.372816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:31.372820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:31.372864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:31.372931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.372950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.372952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:31.372985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:31.372999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:31.373002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:31.373005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:31.373008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:31.373522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:31.373543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:31.373550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:31.373553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:31.373556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:31.373560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:31.374418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:31.374433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:31.374440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:31.374443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:31.374447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:31.374450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:31.375037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:31.375052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:31.375060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:31.375064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:31.375067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:31.376933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:31.376957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:31.376969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392691376
2025-10-02T08:11:31.376987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534070065210529:3998]
2025-10-02T08:11:31.377105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:31.377114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:31.377120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:31.377123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:31.377127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:31.377130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:31.377169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1205, pipe: [1:7556534070065210529:3998]
2025-10-02T08:11:31.377755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:31.377772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:31.377779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:31.377783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:31.377786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:31.377790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:31.378318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:31.378330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:31.378341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:31.378344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:31.378347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:31.378352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:31.378867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:31.378879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:31.378884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:31.380124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:31.380132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:31.380137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:31.380141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:31.380150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392691380
2025-10-02T08:11:31.380488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:31.380500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:31.380506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:31.380509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:31.380513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:31.380518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:31.381213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:31.381243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:31.381249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:31.381252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:31.381257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:31.381267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:31.381764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:31.381786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.381884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392691381
2025-10-02T08:11:31.382750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534070065210529:3998], now have 1 active actors on pipe
2025-10-02T08:11:31.382765Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:31.382779Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:31.382787Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:31.382794Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:31.384561Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:31.384577Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:31.384580Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:31.384590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534070065210497:3947]
2025-10-02T08:11:31.384594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534070065210497:3947]
2025-10-02T08:11:31.384651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:31.384665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:31.384667Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:31.384669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.384671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:31.385031Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:31.540180Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:31.540967Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:31.541995Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:31.542333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534070065210529:3998]
2025-10-02T08:11:31.542349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:31.542377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0
2025-10-02T08:11:31.542565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1206 sessionId: src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0 is DEAD
2025-10-02T08:11:31.542931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:31.542939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0] Write session will restart in 0.005649s
2025-10-02T08:11:31.542968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0] Write session: Do CDS request
2025-10-02T08:11:31.542975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:31.552200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:31.552537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:31.552553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1207
2025-10-02T08:11:31.552713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:31.552743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:31.552748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:31.552751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:31.553951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1207 sessionId:  describe result for acl check
2025-10-02T08:11:31.553985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:31.553986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:31.553988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:31.553993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534070065210622:3944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:31.554389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534070065210622:3944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:31.559709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534070065210622:3944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:31.565622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534070065210622:3944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:31.565643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534070065210622:3944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:31.565645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534070065210622:3944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:31.565651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:31.575061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:31.577322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:31.577693Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:31.577709Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:31.577722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:31.577798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:31.577840Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534070065211271:3945]
2025-10-02T08:11:31.578480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:31.578694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:31.578748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:31.579055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:31.579122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.579131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.579133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.579134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.579135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.579140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.579150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.579153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.579157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.579161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.579166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.579174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.579179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.579184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.579191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.579195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.579199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.579205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.579209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.579214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.579231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:31.591391Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1206
2025-10-02T08:11:31.589318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:31.591030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:31.591036Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:31.591037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:31.591040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:31.591045Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1206 [1:7556534070065211271:3945]
2025-10-02T08:11:31.591053Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:31.591066Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:31.591068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.591070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.591071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.591084Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:31.591087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:31.591093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:31.591155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.591156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.591158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:31.591160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:31.591214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:31.591216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.591225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.591232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:31.591244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534070065211265:3945]
2025-10-02T08:11:31.591245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534070065211265:3945]
2025-10-02T08:11:31.591252Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:31.591262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:31.591273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:31.591276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:31.591286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:31.591290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:31.591306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1206
2025-10-02T08:11:31.591315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534070065211042:3944], now have 1 active actors on pipe
2025-10-02T08:11:31.591318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534070525166747:2378], now have 1 active actors on pipe
2025-10-02T08:11:31.591321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534070065211265:3945]
2025-10-02T08:11:31.591325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:31.591326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:31.591332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.591335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.591374Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:31.591382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.591386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.591388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:31.591396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.591405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:31.591423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:31.591472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.591474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.591487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:31.591518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1207 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0
2025-10-02T08:11:31.592172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8729c1bd-ec33a10b-31f57f7a-359c478f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:31.594905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0] Write session: try to update token
2025-10-02T08:11:31.594924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:31.614825Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:31.614853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:31.614856Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:31.614867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534070065211265:3945]
2025-10-02T08:11:31.614872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534070065211265:3945]
2025-10-02T08:11:31.614920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:31.614927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.614926Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:31.614930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:31.614932Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:31.615084Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:31.622047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId: src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:31.624940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:31.644025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534070065211322:3998]
2025-10-02T08:11:31.644914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1206, pipe: [1:7556534070065211322:3998]
2025-10-02T08:11:31.772524Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:31.773229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.773247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.773270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534070065211322:3998], now have 1 active actors on pipe
2025-10-02T08:11:31.773465Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:31.773811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534070065211322:3998]
2025-10-02T08:11:31.773836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:31.773889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1207 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0
2025-10-02T08:11:31.774102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1207 sessionId: src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0 is DEAD
2025-10-02T08:11:31.774331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:31.774349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0] Write session will restart in 0.009752s
2025-10-02T08:11:31.774399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0] Write session: Do CDS request
2025-10-02T08:11:31.774411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:31.775693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:31.785900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:31.787096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:31.787117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1208
2025-10-02T08:11:31.787255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:31.787283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:31.787288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:31.787292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:31.787946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1208 sessionId:  describe result for acl check
2025-10-02T08:11:31.787975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:31.787977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:31.787979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:31.787985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534070065211536:3920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:31.788557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534070065211536:3920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:31.794520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534070065211536:3920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:31.798273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534070065211536:3920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:31.798292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534070065211536:3920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:31.798295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534070065211536:3920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:31.798305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:31.805370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:31.807395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:31.807607Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:31.807611Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:31.807622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:31.807683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:31.807719Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534070065212045:3914]
2025-10-02T08:11:31.808361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:31.810421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:31.810515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:31.810866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:31.810906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.810908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.810909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.810910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.810912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.810917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.810928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.810931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.810935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.810938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.810944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.810952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:31.810957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.810963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:31.810967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.810971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:31.810975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.810980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.810984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.810988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.811005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:31.819830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:31.821813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:31.821840Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:31.821843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:31.821847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:31.821853Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1207 [1:7556534070065212045:3914]
2025-10-02T08:11:31.821868Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:31.821887Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:31.821891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.821894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.821897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.821916Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:31.821921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:31.821927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:31.822005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.822007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.822010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:31.822012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:31.822099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:31.822102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.822117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:31.822130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:31.822149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534070065212039:3914]
2025-10-02T08:11:31.822152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534070065212039:3914]
2025-10-02T08:11:31.822166Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:31.822179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:31.822194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:31.822197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:31.822235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534070065212039:3914]
2025-10-02T08:11:31.822238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:31.822442Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:31.822453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:31.822459Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:31.823111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1207
2025-10-02T08:11:31.823125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534070065211869:3920], now have 1 active actors on pipe
2025-10-02T08:11:31.823130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534070525166778:2378], now have 1 active actors on pipe
2025-10-02T08:11:31.823285Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1207
2025-10-02T08:11:31.823367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.823379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.823413Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5769f338-57630a65-79d799b5-dd2a979_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:31.823424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:31.823431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:31.823434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:31.823447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:31.823461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:31.823482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:31.823527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.823530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.823543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:31.823582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1208 partition: 0 MaxSeqNo: 17 sessionId: src_id|5769f338-57630a65-79d799b5-dd2a979_0
2025-10-02T08:11:31.824100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5d8cd6-b0217c4a-c8f8f9b5-aa17f6fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5769f338-57630a65-79d799b5-dd2a979_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:31.827709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5769f338-57630a65-79d799b5-dd2a979_0] Write session: try to update token
2025-10-02T08:11:31.827737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5769f338-57630a65-79d799b5-dd2a979_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:31.846020Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:31.846042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:31.846045Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:31.846054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534070065212039:3914]
2025-10-02T08:11:31.846062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534070065212039:3914]
2025-10-02T08:11:31.846106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:31.846114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:31.846116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:31.846272Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:31.847899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId: src_id|5769f338-57630a65-79d799b5-dd2a979_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:31.848937Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:31.848952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:31.850865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:31.877399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534070065212069:3998]
2025-10-02T08:11:31.877729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1207, pipe: [1:7556534070065212069:3998]
2025-10-02T08:11:32.000191Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:31.998897Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:31.999476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:31.999486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:31.999529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534070065212069:3998], now have 1 active actors on pipe
2025-10-02T08:11:31.999677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534070065212069:3998]
2025-10-02T08:11:31.999693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:31.999695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:31.999763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1208 reason: error at write: Disconnected sessionId: src_id|5769f338-57630a65-79d799b5-dd2a979_0
2025-10-02T08:11:31.999972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1208 sessionId: src_id|5769f338-57630a65-79d799b5-dd2a979_0 is DEAD
2025-10-02T08:11:32.000019Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:32.001286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769f338-57630a65-79d799b5-dd2a979_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:32.001304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769f338-57630a65-79d799b5-dd2a979_0] Write session will restart in 0.009765s
2025-10-02T08:11:32.001336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769f338-57630a65-79d799b5-dd2a979_0] Write session: Do CDS request
2025-10-02T08:11:32.001344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769f338-57630a65-79d799b5-dd2a979_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:32.013004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5769f338-57630a65-79d799b5-dd2a979_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:32.015856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:32.015876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1209
2025-10-02T08:11:32.016126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:32.016157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:32.016162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:32.016167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:32.016628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1209 sessionId:  describe result for acl check
2025-10-02T08:11:32.016654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:32.016656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:32.016662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:32.016667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534074360179679:3912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:32.017202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534074360179679:3912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:32.033943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534074360179679:3912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:32.050305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534074360179679:3912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:32.050328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534074360179679:3912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:32.050331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534074360179679:3912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:32.050340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:32.053178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:32.055553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:32.055773Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:32.055784Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:32.055794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:32.055839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:32.055879Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534074360180101:3903]
2025-10-02T08:11:32.056650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:32.056889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:32.056937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:32.057164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:32.057190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.057191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.057191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.057192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.057193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.057197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.057204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.057206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.057209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.057211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.057215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.057220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.057225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.057228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.057231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.057234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.057236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.057240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.057243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.057246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.057257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:32.074965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:32.077072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:32.077080Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:32.077082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:32.077086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:32.077093Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1208 [1:7556534074360180101:3903]
2025-10-02T08:11:32.077106Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:32.077129Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:32.077133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:32.077136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:32.077138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:32.077155Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:32.077160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:32.077167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:32.077239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.077241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.077244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:32.077248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:32.077327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:32.077330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.077344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.077355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:32.077371Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534074360180094:3903]
2025-10-02T08:11:32.077374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534074360180094:3903]
2025-10-02T08:11:32.077382Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:32.077397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:32.077410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:32.077413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:32.077450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534074360180094:3903]
2025-10-02T08:11:32.077453Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:32.077767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:32.077778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:32.077783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:32.078344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1208
2025-10-02T08:11:32.078360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534074360180081:3912], now have 1 active actors on pipe
2025-10-02T08:11:32.078365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534070525166800:2378], now have 1 active actors on pipe
2025-10-02T08:11:32.078683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.078698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.078727Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:32.078735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:32.078740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:32.078742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:32.078753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:32.078766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:32.078784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:32.078913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.078920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.078933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:32.078962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1209 partition: 0 MaxSeqNo: 17 sessionId: src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0
2025-10-02T08:11:32.079463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5769f338-57630a65-79d799b5-dd2a979_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:32.079562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1208
2025-10-02T08:11:32.083050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0] Write session: try to update token
2025-10-02T08:11:32.083077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:32.100911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534074360180123:3998]
2025-10-02T08:11:32.102114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1208, pipe: [1:7556534074360180123:3998]
2025-10-02T08:11:32.102143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534074360180123:3998], now have 1 active actors on pipe
2025-10-02T08:11:32.128262Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:32.128284Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:32.128286Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:32.128296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534074360180094:3903]
2025-10-02T08:11:32.128301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534074360180094:3903]
2025-10-02T08:11:32.128348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:32.128356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.128359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:32.128518Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:32.133197Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:32.133217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:32.140830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId: src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:32.143867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:32.304783Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:32.305424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.305439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.306136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:32.306144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:32.306201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1209 reason: error at write: Disconnected sessionId: src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0
2025-10-02T08:11:32.306386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1209 sessionId: src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0 is DEAD
2025-10-02T08:11:32.306523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534074360180123:3998]
2025-10-02T08:11:32.306661Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:32.308877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:32.309454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:32.309469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0] Write session will restart in 0.006408s
2025-10-02T08:11:32.309499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0] Write session: Do CDS request
2025-10-02T08:11:32.309509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:32.317441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:32.317849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:32.317876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1210
2025-10-02T08:11:32.318141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:32.318177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:32.318183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:32.318189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:32.320320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1210 sessionId:  describe result for acl check
2025-10-02T08:11:32.320370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:32.320372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:32.320374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:32.320380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534074360180388:3905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:32.320933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534074360180388:3905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:32.338498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534074360180388:3905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:32.354699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534074360180388:3905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:32.354721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534074360180388:3905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:32.354726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534074360180388:3905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:32.354737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:32.362130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:32.362725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:32.362914Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:32.362918Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:32.362931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:32.362992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:32.363034Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534074360180857:3908]
2025-10-02T08:11:32.363713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:32.364025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:32.364071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:32.364389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:32.364444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.364445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.364446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.364447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.364448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.364453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.364463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.364467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.364470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.364473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.364480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.364486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.364491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.364496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.364500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.364504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.364508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.364513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.364516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.364521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.364538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:32.376122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:32.378484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:32.378491Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:32.378494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:32.378497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:32.378505Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1209 [1:7556534074360180857:3908]
2025-10-02T08:11:32.378519Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:32.378539Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:32.378543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:32.378546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:32.378548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:32.378567Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:32.378573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:32.378581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:32.378655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.378657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.378661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:32.378663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:32.378743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:32.378746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.378759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.378771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:32.378790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534074360180851:3908]
2025-10-02T08:11:32.378792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534074360180851:3908]
2025-10-02T08:11:32.378799Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:32.378812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:32.378826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:32.378829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:32.378867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534074360180851:3908]
2025-10-02T08:11:32.378869Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:32.379113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:32.379125Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:32.379131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:32.379824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1209
2025-10-02T08:11:32.379839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534074360180836:3905], now have 1 active actors on pipe
2025-10-02T08:11:32.379842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534074820134105:2378], now have 1 active actors on pipe
2025-10-02T08:11:32.380316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.380328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.380366Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:32.380378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:32.380382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:32.380384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:32.380397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:32.380410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:32.380430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:32.380103Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1209
2025-10-02T08:11:32.380547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.380552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.380567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:32.380600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1210 partition: 0 MaxSeqNo: 17 sessionId: src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0
2025-10-02T08:11:32.381403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df3854-8b1e87c7-2feec6d2-af1b59ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:32.385147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0] Write session: try to update token
2025-10-02T08:11:32.385176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:32.407053Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:32.407078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:32.407081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:32.407090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534074360180851:3908]
2025-10-02T08:11:32.407095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534074360180851:3908]
2025-10-02T08:11:32.407137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:32.407144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.407147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:32.407292Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:32.409112Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:32.409119Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:32.409524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534074360180883:3998]
2025-10-02T08:11:32.412675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1209, pipe: [1:7556534074360180883:3998]
2025-10-02T08:11:32.436889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId: src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:32.439817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:32.575356Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:32.574424Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:32.574713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534074360180883:3998], now have 1 active actors on pipe
2025-10-02T08:11:32.574743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.574748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.575554Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:32.575947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:32.575997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1210 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0
2025-10-02T08:11:32.576154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1210 sessionId: src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0 is DEAD
2025-10-02T08:11:32.576284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534074360180883:3998]
2025-10-02T08:11:32.576633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:32.576641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0] Write session will restart in 0.005689s
2025-10-02T08:11:32.576667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0] Write session: Do CDS request
2025-10-02T08:11:32.576673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:32.585254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:32.585540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:32.585556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1211
2025-10-02T08:11:32.585688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:32.585713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:32.585718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:32.585720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:32.586035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1211 sessionId:  describe result for acl check
2025-10-02T08:11:32.586059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:32.586060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:32.586062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:32.586066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534074360180917:3886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:32.586635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534074360180917:3886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:32.602954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534074360180917:3886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:32.617764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534074360180917:3886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:32.617792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534074360180917:3886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:32.617796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534074360180917:3886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:32.617807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:32.624142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:32.627061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:32.627302Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:32.627305Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:32.627316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:32.627365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:32.627397Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534074360181627:3891]
2025-10-02T08:11:32.628121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:32.628331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:32.628370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:32.628708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:32.628764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.628765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.628766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.628767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.628768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.628774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.628785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.628789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.628794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.628799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.628820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.628829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.628836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.628843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.628847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.628853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.628858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.628864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.628870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.628876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.628896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:32.640601Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1210
2025-10-02T08:11:32.637806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:32.639486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:32.639494Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:32.639496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:32.639500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:32.639507Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1210 [1:7556534074360181627:3891]
2025-10-02T08:11:32.639519Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:32.639536Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:32.639561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:32.639565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:32.639567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:32.639585Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:32.639592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:32.639600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:32.640150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.640153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.640157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:32.640160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:32.640230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:32.640234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.640250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.640266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:32.640286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534074360181621:3891]
2025-10-02T08:11:32.640289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534074360181621:3891]
2025-10-02T08:11:32.640296Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:32.640311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:32.640329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:32.640333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:32.640356Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:32.640359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:32.640494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1210
2025-10-02T08:11:32.640733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534074360181603:3886], now have 1 active actors on pipe
2025-10-02T08:11:32.640736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534074820134113:2378], now have 1 active actors on pipe
2025-10-02T08:11:32.640742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.640746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.640766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534074360181621:3891]
2025-10-02T08:11:32.640779Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:32.640796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:32.640829Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1850d19e-894b366f-fe9a00db-25aca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:32.640835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:32.640839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:32.640841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:32.640850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:32.640861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:32.640890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:32.640995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.641000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.641024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:32.641080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1211 partition: 0 MaxSeqNo: 17 sessionId: src_id|1850d19e-894b366f-fe9a00db-25aca_0
2025-10-02T08:11:32.648929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4420adc9-5ce43894-3efaf264-cc5dea36_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1850d19e-894b366f-fe9a00db-25aca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:32.652127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1850d19e-894b366f-fe9a00db-25aca_0] Write session: try to update token
2025-10-02T08:11:32.652149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1850d19e-894b366f-fe9a00db-25aca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:32.665463Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:32.665489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:32.665491Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:32.665500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534074360181621:3891]
2025-10-02T08:11:32.665504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534074360181621:3891]
2025-10-02T08:11:32.665553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:32.665561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.665563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:32.665727Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:32.668127Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:32.668137Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:32.673480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534074360181679:3998]
2025-10-02T08:11:32.678954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1210, pipe: [1:7556534074360181679:3998]
2025-10-02T08:11:32.693596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId: src_id|1850d19e-894b366f-fe9a00db-25aca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:32.696478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:32.874388Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:32.875016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534074360181679:3998], now have 1 active actors on pipe
2025-10-02T08:11:32.875025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.875031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.876303Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:32.876663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534074360181679:3998]
2025-10-02T08:11:32.876687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:32.876745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1211 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1850d19e-894b366f-fe9a00db-25aca_0
2025-10-02T08:11:32.876996Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:32.877449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1850d19e-894b366f-fe9a00db-25aca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:32.877459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1850d19e-894b366f-fe9a00db-25aca_0] Write session will restart in 0.007511s
2025-10-02T08:11:32.877484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1850d19e-894b366f-fe9a00db-25aca_0] Write session: Do CDS request
2025-10-02T08:11:32.877491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1850d19e-894b366f-fe9a00db-25aca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:32.877118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1211 sessionId: src_id|1850d19e-894b366f-fe9a00db-25aca_0 is DEAD
2025-10-02T08:11:32.887979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1850d19e-894b366f-fe9a00db-25aca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:32.889079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:32.889102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1212
2025-10-02T08:11:32.893030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:32.893089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:32.893095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:32.893098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:32.893661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1212 sessionId:  describe result for acl check
2025-10-02T08:11:32.893700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:32.893702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:32.893704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:32.893709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534074360182091:3841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:32.894284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534074360182091:3841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:32.900587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534074360182091:3841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:32.910217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534074360182091:3841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:32.910240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534074360182091:3841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:32.910243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534074360182091:3841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:32.910253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:32.916165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:32.916975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:32.917193Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:32.917197Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:32.917209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:32.917263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:32.917304Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534074360182410:3844]
2025-10-02T08:11:32.917975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:32.918302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:32.918354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:32.918687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:32.918736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.918737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.918739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.918740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.918742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.918748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.918760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.918765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.918768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.918771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.918777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.918785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:32.918791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.918796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:32.918801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.918806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:32.918811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.918816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.918821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.918827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.918846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:32.931478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:32.934044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:32.934052Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:32.934054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:32.934058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:32.934066Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1211 [1:7556534074360182410:3844]
2025-10-02T08:11:32.934083Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:32.934103Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:32.934107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:32.934110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:32.934112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:32.934130Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:32.934136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:32.934143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:32.934221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.934223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.934227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:32.934230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:32.934310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:32.934313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.934330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:32.934344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:32.934363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534074360182404:3844]
2025-10-02T08:11:32.934365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534074360182404:3844]
2025-10-02T08:11:32.934374Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:32.934391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:32.934406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:32.934409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:32.934451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534074360182404:3844]
2025-10-02T08:11:32.934454Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:32.934705Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:32.934718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:32.934723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:32.935806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1850d19e-894b366f-fe9a00db-25aca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f048bd35-7ce6486-4651381-d4f556d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:32.934931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1211
2025-10-02T08:11:32.934951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534074360182389:3841], now have 1 active actors on pipe
2025-10-02T08:11:32.934956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534074820134143:2378], now have 1 active actors on pipe
2025-10-02T08:11:32.934963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.934969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.934999Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f048bd35-7ce6486-4651381-d4f556d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:32.935007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:32.935012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:32.935014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:32.935028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:32.935043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:32.935062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:32.935158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:32.935160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:32.935174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:32.935206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1212 partition: 0 MaxSeqNo: 17 sessionId: src_id|f048bd35-7ce6486-4651381-d4f556d4_0
2025-10-02T08:11:32.935654Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1211
2025-10-02T08:11:32.938890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f048bd35-7ce6486-4651381-d4f556d4_0] Write session: try to update token
2025-10-02T08:11:32.938908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f048bd35-7ce6486-4651381-d4f556d4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:32.962400Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:32.962422Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:32.962426Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:32.962435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534074360182404:3844]
2025-10-02T08:11:32.962441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534074360182404:3844]
2025-10-02T08:11:32.962491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:32.962498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:32.962501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:32.962673Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:32.964973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:32.964988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:32.970552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId: src_id|f048bd35-7ce6486-4651381-d4f556d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:32.973534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:32.980916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534074360182434:3998]
2025-10-02T08:11:32.984876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1211, pipe: [1:7556534074360182434:3998]
2025-10-02T08:11:33.115888Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:33.116211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.116221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.116268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534074360182434:3998], now have 1 active actors on pipe
2025-10-02T08:11:33.117432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:33.117454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:33.117528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1212 reason: error at write: Disconnected sessionId: src_id|f048bd35-7ce6486-4651381-d4f556d4_0
2025-10-02T08:11:33.117717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1212 sessionId: src_id|f048bd35-7ce6486-4651381-d4f556d4_0 is DEAD
2025-10-02T08:11:33.117884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534074360182434:3998]
2025-10-02T08:11:33.117950Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:33.117875Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:33.119544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f048bd35-7ce6486-4651381-d4f556d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:33.119554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f048bd35-7ce6486-4651381-d4f556d4_0] Write session will restart in 0.005886s
2025-10-02T08:11:33.119581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f048bd35-7ce6486-4651381-d4f556d4_0] Write session: Do CDS request
2025-10-02T08:11:33.119588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f048bd35-7ce6486-4651381-d4f556d4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:33.129561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f048bd35-7ce6486-4651381-d4f556d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:33.132999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:33.133021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1213
2025-10-02T08:11:33.134140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:33.134173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:33.134179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:33.134185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:33.140231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1213 sessionId:  describe result for acl check
2025-10-02T08:11:33.140272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:33.140273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:33.140274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:33.140279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534078655150032:3807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:33.140709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534078655150032:3807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:33.145447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534078655150032:3807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:33.152155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534078655150032:3807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:33.152178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534078655150032:3807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:33.152181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534078655150032:3807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:33.152190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:33.170099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:33.172079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:33.172268Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:33.172278Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:33.172288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:33.172335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:33.172377Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534078655150476:3815]
2025-10-02T08:11:33.172880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:33.173781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:33.173843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:33.174194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:33.174247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.174248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.174249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.174251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.174252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.174257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.174266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.174270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.174273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.174278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.174284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.174291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.174298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.174303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.174307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.174312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.174316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.174321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.174326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.174331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.174352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:33.186076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:33.187829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:33.187838Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:33.187842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:33.187846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:33.187853Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1212 [1:7556534078655150476:3815]
2025-10-02T08:11:33.187871Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:33.187893Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:33.187897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:33.187900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:33.187903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:33.187934Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:33.187941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:33.187949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:33.188025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.188029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.188032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:33.188035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:33.188116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:33.188119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.188136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.188150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:33.188170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534078655150469:3815]
2025-10-02T08:11:33.188172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534078655150469:3815]
2025-10-02T08:11:33.188181Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:33.188195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:33.188211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:33.188215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:33.188257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534078655150469:3815]
2025-10-02T08:11:33.188259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:33.188878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:33.188880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:33.188886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:33.189240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1212
2025-10-02T08:11:33.189263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534078655150198:3807], now have 1 active actors on pipe
2025-10-02T08:11:33.189266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534079115101462:2378], now have 1 active actors on pipe
2025-10-02T08:11:33.189271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.189276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.189303Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:33.189313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:33.189317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:33.189319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:33.189329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:33.189344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:33.189363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:33.193018Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1212
2025-10-02T08:11:33.193307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.193328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.193373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:33.193420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1213 partition: 0 MaxSeqNo: 17 sessionId: src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0
2025-10-02T08:11:33.193951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f048bd35-7ce6486-4651381-d4f556d4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:33.197369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0] Write session: try to update token
2025-10-02T08:11:33.197392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:33.217601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534078655150500:3998]
2025-10-02T08:11:33.219223Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:33.219245Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:33.219247Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:33.219256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534078655150469:3815]
2025-10-02T08:11:33.219261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534078655150469:3815]
2025-10-02T08:11:33.219305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:33.219312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.219314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:33.219469Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:33.220992Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:33.221005Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:33.221183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1212, pipe: [1:7556534078655150500:3998]
2025-10-02T08:11:33.223718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId: src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:33.226498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:33.370633Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:33.370951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534078655150500:3998], now have 1 active actors on pipe
2025-10-02T08:11:33.370969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.370975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.371237Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:33.371783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534078655150500:3998]
2025-10-02T08:11:33.371801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:33.371854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0
2025-10-02T08:11:33.372069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1213 sessionId: src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0 is DEAD
2025-10-02T08:11:33.372467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:33.372476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0] Write session will restart in 0.005611s
2025-10-02T08:11:33.372500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0] Write session: Do CDS request
2025-10-02T08:11:33.372511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:33.372965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:33.385285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:33.387004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:33.387023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1214
2025-10-02T08:11:33.390250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:33.390302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:33.390307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:33.390312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:33.390885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1214 sessionId:  describe result for acl check
2025-10-02T08:11:33.390915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:33.390916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:33.390918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:33.390922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534078655150688:3801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:33.391616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534078655150688:3801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:33.406012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534078655150688:3801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:33.419663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534078655150688:3801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:33.419690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534078655150688:3801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:33.419694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534078655150688:3801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:33.419704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:33.427468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:33.428055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:33.428527Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:33.428544Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:33.428561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:33.428640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:33.428685Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534078655151235:3805]
2025-10-02T08:11:33.429539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:33.429783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:33.429832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:33.430157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:33.430211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.430220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.430222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.430223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.430224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.430230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.430241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.430250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.430254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.430258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.430264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.430272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.430283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.430293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.430302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.430307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.430315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.430321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.430329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.430335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.430354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:33.443258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:33.445458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:33.445480Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:33.445482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:33.445486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:33.445494Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1213 [1:7556534078655151235:3805]
2025-10-02T08:11:33.445506Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:33.445525Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:33.445528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:33.445532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:33.445534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:33.445551Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:33.445556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:33.445563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:33.445639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.445642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.445645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:33.445647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:33.445724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:33.445726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.445740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.445751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:33.445767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534078655151229:3805]
2025-10-02T08:11:33.445769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534078655151229:3805]
2025-10-02T08:11:33.445780Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:33.445793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:33.445805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:33.445808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:33.445817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534078655151205:3801], now have 1 active actors on pipe
2025-10-02T08:11:33.445823Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:33.445826Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:33.445855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534078655151229:3805]
2025-10-02T08:11:33.445858Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:33.445862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534079115101468:2378], now have 1 active actors on pipe
2025-10-02T08:11:33.445941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1213
2025-10-02T08:11:33.445997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:33.446694Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1213
2025-10-02T08:11:33.446849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.446868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.446906Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:33.446920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:33.446929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:33.446931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:33.446942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:33.446959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:33.446982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:33.447246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.447259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.447278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:33.447320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1214 partition: 0 MaxSeqNo: 17 sessionId: src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0
2025-10-02T08:11:33.453170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3505c709-f0abfb5f-be5ab2de-38efedce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:33.456152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0] Write session: try to update token
2025-10-02T08:11:33.456181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:33.469296Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:33.469323Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:33.469334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534078655151229:3805]
2025-10-02T08:11:33.469386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:33.469589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534078655151259:3998]
2025-10-02T08:11:33.469590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:33.469754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:33.469908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:33.470059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:33.470322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:33.470362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:33.470499Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:33.471051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1213, pipe: [1:7556534078655151259:3998]
2025-10-02T08:11:33.471065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534078655151259:3998], now have 1 active actors on pipe
2025-10-02T08:11:33.481085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId: src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:33.483852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:33.488017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.488048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.488075Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:33.488078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:33.488080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:33.488092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534078655151229:3805]
2025-10-02T08:11:33.488095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534078655151229:3805]
2025-10-02T08:11:33.488165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:33.488169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:33.488176Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:33.488184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.488186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:33.488401Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:33.641867Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:33.642283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:33.642321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:33.645209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:33.645221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:33.645245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1214 reason: error at write: Disconnected sessionId: src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0
2025-10-02T08:11:33.645256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534078655151259:3998]
2025-10-02T08:11:33.645411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1214 sessionId: src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0 is DEAD
2025-10-02T08:11:33.643795Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:33.649156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:33.649168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0] Write session will restart in 0.006514s
2025-10-02T08:11:33.649194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0] Write session: Do CDS request
2025-10-02T08:11:33.649201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:33.661263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:33.662182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:33.662205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1215
2025-10-02T08:11:33.664937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:33.664995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:33.665000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:33.665005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:33.668388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1215 sessionId:  describe result for acl check
2025-10-02T08:11:33.668419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:33.668421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:33.668423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:33.668428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534078655151589:3782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:33.669035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534078655151589:3782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:33.686252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534078655151589:3782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:33.697980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534078655151589:3782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:33.698001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534078655151589:3782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:33.698004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534078655151589:3782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:33.698013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:33.703666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:33.704990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:33.705214Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:33.705220Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:33.705231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:33.705290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:33.705329Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534078655152033:3783]
2025-10-02T08:11:33.705974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:33.706305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:33.706347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:33.706686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:33.706731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.706733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.706734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.706735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.706736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.706741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.706751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.706755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.706759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.706762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.706768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.706775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.706781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.706786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.706790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.706795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.706799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.706804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.706808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.706814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.706833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:33.716359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:33.720611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:33.720640Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:33.720643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:33.720646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:33.720654Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1214 [1:7556534078655152033:3783]
2025-10-02T08:11:33.720669Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:33.720689Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:33.720692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:33.720695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:33.720697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:33.720718Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:33.720723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:33.720731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:33.720839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.720842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.720845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:33.720849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:33.720926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:33.720937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.720952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.720965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:33.720984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534078655152011:3782], now have 1 active actors on pipe
2025-10-02T08:11:33.720988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534079115101491:2378], now have 1 active actors on pipe
2025-10-02T08:11:33.720994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534078655152026:3783]
2025-10-02T08:11:33.720996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534078655152026:3783]
2025-10-02T08:11:33.721008Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:33.721021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:33.721024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:33.721027Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:33.721034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:33.721037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:33.721071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534078655152026:3783]
2025-10-02T08:11:33.721086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:33.721092Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:33.721130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1214
2025-10-02T08:11:33.721136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.721140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.721165Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:33.721171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:33.721175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:33.721177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:33.721185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:33.721194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:33.721211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:33.721231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.721233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.721245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:33.721283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1215 partition: 0 MaxSeqNo: 17 sessionId: src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0
2025-10-02T08:11:33.721218Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1214
2025-10-02T08:11:33.721952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcaffc64-9d90722c-b68d6994-30ac442c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:33.724519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0] Write session: try to update token
2025-10-02T08:11:33.724534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:33.741381Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:33.741409Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:33.741413Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:33.741421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534078655152026:3783]
2025-10-02T08:11:33.741426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534078655152026:3783]
2025-10-02T08:11:33.741478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:33.741486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.741488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:33.741493Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:33.741501Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:33.741647Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:33.753621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534078655152066:3998]
2025-10-02T08:11:33.755484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1214, pipe: [1:7556534078655152066:3998]
2025-10-02T08:11:33.760873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId: src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:33.763700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:33.901288Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:33.901731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534078655152066:3998], now have 1 active actors on pipe
2025-10-02T08:11:33.901740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.901746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.901911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534078655152066:3998]
2025-10-02T08:11:33.901940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:33.901943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:33.901984Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:33.902014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1215 reason: error at write: Disconnected sessionId: src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0
2025-10-02T08:11:33.902195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1215 sessionId: src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0 is DEAD
2025-10-02T08:11:33.902354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:33.902365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0] Write session will restart in 0.005518s
2025-10-02T08:11:33.902390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0] Write session: Do CDS request
2025-10-02T08:11:33.902401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:33.902638Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:33.909372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:33.914800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:33.914818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1216
2025-10-02T08:11:33.915067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:33.915098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:33.915103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:33.915106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:33.915730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1216 sessionId:  describe result for acl check
2025-10-02T08:11:33.915765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:33.915771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:33.915774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:33.915779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534078655152372:3746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:33.916327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534078655152372:3746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:33.923021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534078655152372:3746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:33.928382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534078655152372:3746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:33.928405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534078655152372:3746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:33.928408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534078655152372:3746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:33.928417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:33.949582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:33.957687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:33.957933Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:33.957945Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:33.957955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:33.958010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:33.958050Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534078655152803:3755]
2025-10-02T08:11:33.958567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:33.958788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:33.958835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:33.959113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:33.959157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.959163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.959164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.959165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.959167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.959172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.959182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.959186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.959190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.959194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.959199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.959206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:33.959216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.959222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:33.959230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.959236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:33.959241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.959246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.959253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.959257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.959271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:33.968500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:33.970127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:33.970148Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:33.970151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:33.970156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:33.970162Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1215 [1:7556534078655152803:3755]
2025-10-02T08:11:33.970175Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:33.970193Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:33.970195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:33.970199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:33.970201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:33.970217Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:33.970222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:33.970228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:33.970293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.970302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.970305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:33.970308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:33.970377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:33.970386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.970400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:33.970413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:33.970428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534078655152797:3755]
2025-10-02T08:11:33.970430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534078655152797:3755]
2025-10-02T08:11:33.970437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:33.970451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534078655152557:3746], now have 1 active actors on pipe
2025-10-02T08:11:33.970458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:33.970458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:33.970462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:33.970474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:33.970478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:33.970516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534079115101507:2378], now have 1 active actors on pipe
2025-10-02T08:11:33.970519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534078655152797:3755]
2025-10-02T08:11:33.970521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:33.970561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1215
2025-10-02T08:11:33.970616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:33.970730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.970734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.970757Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4236431c-51884f74-44bf4539-5f77494f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:33.970763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:33.970767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:33.970769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:33.970779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:33.970787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:33.970802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:33.970859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:33.970861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:33.970872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:33.970902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1216 partition: 0 MaxSeqNo: 17 sessionId: src_id|4236431c-51884f74-44bf4539-5f77494f_0
2025-10-02T08:11:33.971114Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1215
2025-10-02T08:11:33.972147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b982ad7e-cdc57f29-cdc77e38-f2d19401_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4236431c-51884f74-44bf4539-5f77494f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:33.974844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4236431c-51884f74-44bf4539-5f77494f_0] Write session: try to update token
2025-10-02T08:11:33.974859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4236431c-51884f74-44bf4539-5f77494f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:33.995363Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:33.995386Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:33.995388Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:33.995397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534078655152797:3755]
2025-10-02T08:11:33.995402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534078655152797:3755]
2025-10-02T08:11:33.995447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:33.995453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:33.995455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:33.995593Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:33.997690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId: src_id|4236431c-51884f74-44bf4539-5f77494f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:33.997858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:33.997864Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:34.000355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:34.002644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534082950120135:3998]
2025-10-02T08:11:34.002830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1215, pipe: [1:7556534082950120135:3998]
2025-10-02T08:11:34.158972Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:34.159482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.159490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.159511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534082950120135:3998], now have 1 active actors on pipe
2025-10-02T08:11:34.161039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:34.160608Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:34.160981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:34.161032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1216 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4236431c-51884f74-44bf4539-5f77494f_0
2025-10-02T08:11:34.161223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1216 sessionId: src_id|4236431c-51884f74-44bf4539-5f77494f_0 is DEAD
2025-10-02T08:11:34.161336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534082950120135:3998]
2025-10-02T08:11:34.161941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4236431c-51884f74-44bf4539-5f77494f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:34.161950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4236431c-51884f74-44bf4539-5f77494f_0] Write session will restart in 0.005037s
2025-10-02T08:11:34.161990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4236431c-51884f74-44bf4539-5f77494f_0] Write session: Do CDS request
2025-10-02T08:11:34.161996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4236431c-51884f74-44bf4539-5f77494f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:34.170529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:34.170547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1217
2025-10-02T08:11:34.171238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4236431c-51884f74-44bf4539-5f77494f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:34.172239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:34.172277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:34.172282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:34.172286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:34.173656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1217 sessionId:  describe result for acl check
2025-10-02T08:11:34.173687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:34.173688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:34.173690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:34.173697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534082950120357:3736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:34.174214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534082950120357:3736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:34.182600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534082950120357:3736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:34.192008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534082950120357:3736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:34.192028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534082950120357:3736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:34.192032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534082950120357:3736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:34.192040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:34.233036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:34.233912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:34.234112Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:34.234116Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:34.234129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:34.234190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:34.234230Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534082950120878:3735]
2025-10-02T08:11:34.234899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:34.235178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:34.235224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:34.235551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:34.235613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.235615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.235616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.235618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.235619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.235624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.235635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.235639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.235643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.235648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.235654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.235662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.235668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.235674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.235678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.235684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.235689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.235695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.235700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.235708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.235730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:34.247039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:34.249240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:34.249249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:34.249252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:34.249255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:34.249262Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1216 [1:7556534082950120878:3735]
2025-10-02T08:11:34.249275Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:34.249293Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:34.249296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:34.249300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:34.249302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:34.249320Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:34.249325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:34.249331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:34.249401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.249403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.249406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:34.249409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:34.249482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:34.249486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.249500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.249512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:34.249530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534082950120870:3735]
2025-10-02T08:11:34.249532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534082950120870:3735]
2025-10-02T08:11:34.249545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:34.249558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:34.249572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:34.249575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:34.249611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534082950120870:3735]
2025-10-02T08:11:34.249614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:34.250161Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1216
2025-10-02T08:11:34.250033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:34.250044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:34.250050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:34.250584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534083410068825:2378], now have 1 active actors on pipe
2025-10-02T08:11:34.250588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534082950120511:3736], now have 1 active actors on pipe
2025-10-02T08:11:34.250615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1216
2025-10-02T08:11:34.250876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.250886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.250913Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62c3d83f-36519388-e395fcb3-909a767b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:34.250922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:34.250926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:34.250928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:34.250939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:34.250953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:34.250983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:34.251113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.251119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.251132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:34.251165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1217 partition: 0 MaxSeqNo: 17 sessionId: src_id|62c3d83f-36519388-e395fcb3-909a767b_0
2025-10-02T08:11:34.253070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4236431c-51884f74-44bf4539-5f77494f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|62c3d83f-36519388-e395fcb3-909a767b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:34.256170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3d83f-36519388-e395fcb3-909a767b_0] Write session: try to update token
2025-10-02T08:11:34.256192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3d83f-36519388-e395fcb3-909a767b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:34.264141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534082950120900:3998]
2025-10-02T08:11:34.264422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1216, pipe: [1:7556534082950120900:3998]
2025-10-02T08:11:34.264449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534082950120900:3998], now have 1 active actors on pipe
2025-10-02T08:11:34.267156Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:34.267176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:34.267184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534082950120870:3735]
2025-10-02T08:11:34.267226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:34.267414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:34.267559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.267705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.267850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.268066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:34.268101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:34.268821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:34.287955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId: src_id|62c3d83f-36519388-e395fcb3-909a767b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:34.290961Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:34.290968Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:34.290972Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:34.290986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534082950120870:3735]
2025-10-02T08:11:34.290991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534082950120870:3735]
2025-10-02T08:11:34.291047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:34.291058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.291061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:34.291343Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:34.291817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:34.292090Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:34.292106Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:34.436967Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:34.437294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.437307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.437836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534082950120900:3998]
2025-10-02T08:11:34.437956Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:34.438828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:34.438893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1217 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62c3d83f-36519388-e395fcb3-909a767b_0
2025-10-02T08:11:34.439092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1217 sessionId: src_id|62c3d83f-36519388-e395fcb3-909a767b_0 is DEAD
2025-10-02T08:11:34.439410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3d83f-36519388-e395fcb3-909a767b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:34.439423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3d83f-36519388-e395fcb3-909a767b_0] Write session will restart in 0.009435s
2025-10-02T08:11:34.439445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3d83f-36519388-e395fcb3-909a767b_0] Write session: Do CDS request
2025-10-02T08:11:34.439451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3d83f-36519388-e395fcb3-909a767b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:34.439783Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:34.450731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3d83f-36519388-e395fcb3-909a767b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:34.451033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:34.451051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1218
2025-10-02T08:11:34.451238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:34.451266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:34.451272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:34.451275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:34.451627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1218 sessionId:  describe result for acl check
2025-10-02T08:11:34.451651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:34.451655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:34.451657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:34.451662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534082950121231:3709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:34.452395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534082950121231:3709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:34.456339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534082950121231:3709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:34.467149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534082950121231:3709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:34.467170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534082950121231:3709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:34.467174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534082950121231:3709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:34.467183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:34.480476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:34.482595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:34.482787Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:34.482789Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:34.482797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:34.482836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:34.482870Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534082950121646:3707]
2025-10-02T08:11:34.483376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:34.483596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:34.483629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:34.483872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:34.483903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.483903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.483904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.483905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.483905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.483909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.483928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.483931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.483934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.483938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.483943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.483950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.483956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.483961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.483966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.483970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.483975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.483980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.483984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.483989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.484000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:34.493612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:34.495668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:34.495690Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:34.495693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:34.495697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:34.495704Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1217 [1:7556534082950121646:3707]
2025-10-02T08:11:34.495717Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:34.495734Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:34.495738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:34.495741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:34.495743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:34.495760Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:34.495766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:34.495773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:34.495842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.495845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.495847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:34.495850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:34.495935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:34.495937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.495951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.495963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:34.495979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534082950121640:3707]
2025-10-02T08:11:34.495981Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534082950121640:3707]
2025-10-02T08:11:34.495994Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:34.496005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:34.496019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:34.496022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:34.496058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534082950121640:3707]
2025-10-02T08:11:34.496060Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:34.496148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:34.496151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:34.496155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:34.496333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1217
2025-10-02T08:11:34.496361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534082950121512:3709], now have 1 active actors on pipe
2025-10-02T08:11:34.496366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534083410068833:2378], now have 1 active actors on pipe
2025-10-02T08:11:34.496373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.496379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.496406Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:34.496415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:34.496420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:34.496433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:34.496445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:34.496458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:34.496478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:34.496661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.496666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.496684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:34.496722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1218 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0
2025-10-02T08:11:34.496893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1217
2025-10-02T08:11:34.499178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3d83f-36519388-e395fcb3-909a767b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:34.504165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0] Write session: try to update token
2025-10-02T08:11:34.504191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:34.509261Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:34.509287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:34.509297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534082950121640:3707]
2025-10-02T08:11:34.509341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:34.509362Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:34.509523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:34.509688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.509865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.510012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.510222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:34.510259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:34.528699Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:34.528729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:34.528732Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:34.528745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534082950121640:3707]
2025-10-02T08:11:34.528750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534082950121640:3707]
2025-10-02T08:11:34.528818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:34.528826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.528829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:34.528916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:34.528935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:34.528989Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:34.529175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId: src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:34.533234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:34.538396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534082950121675:3998]
2025-10-02T08:11:34.545057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1217, pipe: [1:7556534082950121675:3998]
2025-10-02T08:11:34.700034Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:34.700724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.700746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.700769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534082950121675:3998], now have 1 active actors on pipe
2025-10-02T08:11:34.700914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:34.700917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:34.700976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1218 reason: error at write: Disconnected sessionId: src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0
2025-10-02T08:11:34.701167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1218 sessionId: src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0 is DEAD
2025-10-02T08:11:34.701427Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:34.701072Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:34.702609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:34.702620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0] Write session will restart in 0.006658s
2025-10-02T08:11:34.702656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0] Write session: Do CDS request
2025-10-02T08:11:34.702662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:34.702356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534082950121675:3998]
2025-10-02T08:11:34.710479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:34.710620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:34.710641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1219
2025-10-02T08:11:34.710817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:34.710851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:34.710856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:34.710860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:34.711305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1219 sessionId:  describe result for acl check
2025-10-02T08:11:34.711330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:34.711331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:34.711333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:34.711338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534082950122039:3663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:34.711934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534082950122039:3663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:34.716461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534082950122039:3663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:34.723066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534082950122039:3663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:34.723086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534082950122039:3663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:34.723090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534082950122039:3663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:34.723098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:34.734597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:34.736243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:34.736458Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:34.736468Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:34.736478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:34.736527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:34.736564Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534082950122436:3682]
2025-10-02T08:11:34.737229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:34.737448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:34.737486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:34.737782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:34.737833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.737834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.737835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.737836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.737837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.737842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.737852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.737856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.737860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.737864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.737870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.737877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:34.737883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.737888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:34.737893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.737898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:34.737902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.737906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.737911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.737916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.737935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:34.748423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:34.750734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:34.750755Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:34.750758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:34.750762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:34.750769Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1218 [1:7556534082950122436:3682]
2025-10-02T08:11:34.750781Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:34.750798Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:34.750801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:34.750804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:34.750807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:34.750822Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:34.750827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:34.750834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:34.750904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.750912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.750916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:34.750919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:34.750989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:34.750998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.751013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:34.751031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:34.751050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534082950122325:3663], now have 1 active actors on pipe
2025-10-02T08:11:34.751056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534082950122430:3682]
2025-10-02T08:11:34.751066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534082950122430:3682]
2025-10-02T08:11:34.751074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:34.751084Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:34.751086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:34.751095Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:34.751101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:34.751103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:34.751109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534083410068841:2378], now have 1 active actors on pipe
2025-10-02T08:11:34.751143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534082950122430:3682]
2025-10-02T08:11:34.751159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:34.751169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:34.751207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1218
2025-10-02T08:11:34.751218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.751221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.751250Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:34.751261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:34.751265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:34.751268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:34.751279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:34.751293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:34.751310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:34.751306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1218
2025-10-02T08:11:34.751376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.751383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.751401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:34.751435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1219 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0
2025-10-02T08:11:34.751827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c7425d-8ebb655c-d04251f7-2351c9b5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:34.755138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0] Write session: try to update token
2025-10-02T08:11:34.755157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:34.764530Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:34.764556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:34.764563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534082950122430:3682]
2025-10-02T08:11:34.764604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:34.764833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:34.765004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.765213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.765385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:34.765615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:34.765664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:34.768436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:34.788688Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:34.788715Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:34.788718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:34.788728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534082950122430:3682]
2025-10-02T08:11:34.788733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534082950122430:3682]
2025-10-02T08:11:34.788782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:34.788781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:34.788788Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:34.788790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:34.788792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:34.788972Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:34.793194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId: src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:34.796034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:34.802839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534082950122484:3998]
2025-10-02T08:11:34.803055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1218, pipe: [1:7556534082950122484:3998]
2025-10-02T08:11:34.936974Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:34.937275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:34.937285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:34.937305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534082950122484:3998], now have 1 active actors on pipe
2025-10-02T08:11:34.940020Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:34.940449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:34.940519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1219 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0
2025-10-02T08:11:34.940734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1219 sessionId: src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0 is DEAD
2025-10-02T08:11:34.940864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534082950122484:3998]
2025-10-02T08:11:34.941222Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:34.941696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:34.941707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0] Write session will restart in 0.009419s
2025-10-02T08:11:34.941729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0] Write session: Do CDS request
2025-10-02T08:11:34.941734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:34.953531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:34.955426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:34.955448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1220
2025-10-02T08:11:34.955811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:34.955850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:34.955855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:34.955860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:34.956297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1220 sessionId:  describe result for acl check
2025-10-02T08:11:34.956330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:34.956332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:34.956334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:34.956341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534082950122503:3666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:34.956923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534082950122503:3666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:34.964844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534082950122503:3666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:34.986635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534082950122503:3666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:34.986659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534082950122503:3666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:34.986662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534082950122503:3666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:34.986672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:35.024011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:35.024472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:35.024687Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:35.024691Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:35.024702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:35.024758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:35.024821Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534087245090536:3665]
2025-10-02T08:11:35.025478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:35.026392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:35.026448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:35.026801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:35.026855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.026856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.026857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.026859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.026860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.026866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.026876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.026880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.026884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.026888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.026894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.026902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.026908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.026913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.026918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.026923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.026928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.026933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.026938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.026942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.026963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:35.039070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:35.041023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:35.041031Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:35.041033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:35.041037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:35.041044Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1219 [1:7556534087245090536:3665]
2025-10-02T08:11:35.041058Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:35.041080Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:35.041084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:35.041087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:35.041089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:35.041108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:35.041114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:35.041121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:35.042440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1219
2025-10-02T08:11:35.041197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.041214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.041217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:35.041220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:35.041288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:35.041291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.041305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.041316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:35.041335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534087245090530:3665]
2025-10-02T08:11:35.041338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534087245090530:3665]
2025-10-02T08:11:35.041350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:35.041365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:35.041378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:35.041380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:35.041416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534087245090530:3665]
2025-10-02T08:11:35.041419Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:35.041463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534087245090552:3998]
2025-10-02T08:11:35.041593Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:35.041595Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:35.041601Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:35.042553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1219
2025-10-02T08:11:35.042566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534082950122843:3666], now have 1 active actors on pipe
2025-10-02T08:11:35.042570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534083410068883:2378], now have 1 active actors on pipe
2025-10-02T08:11:35.042865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:35.042878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:35.042894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534087245090552:3998], now have 1 active actors on pipe
2025-10-02T08:11:35.042921Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8859a594-cfd20304-d6497616-9581a1a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:35.042931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:35.042935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:35.042937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:35.042950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:35.042965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:35.042985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:35.043009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1219, pipe: [1:7556534087245090552:3998]
2025-10-02T08:11:35.043606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a81a656-55d2e236-63d068c7-e16b2d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8859a594-cfd20304-d6497616-9581a1a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:35.046867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8859a594-cfd20304-d6497616-9581a1a7_0] Write session: try to update token
2025-10-02T08:11:35.046885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8859a594-cfd20304-d6497616-9581a1a7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:35.043119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:35.043125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:35.043138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:35.043170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1220 partition: 0 MaxSeqNo: 17 sessionId: src_id|8859a594-cfd20304-d6497616-9581a1a7_0
2025-10-02T08:11:35.086551Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:35.086579Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:35.086584Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:35.086600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534087245090530:3665]
2025-10-02T08:11:35.086608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534087245090530:3665]
2025-10-02T08:11:35.086672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:35.086683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.086686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:35.086902Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:35.089233Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:35.089253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:35.095887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId: src_id|8859a594-cfd20304-d6497616-9581a1a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:35.099055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:35.388972Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:35.392909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8859a594-cfd20304-d6497616-9581a1a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:35.392927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8859a594-cfd20304-d6497616-9581a1a7_0] Write session will restart in 0.007189s
2025-10-02T08:11:35.392958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8859a594-cfd20304-d6497616-9581a1a7_0] Write session: Do CDS request
2025-10-02T08:11:35.392965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8859a594-cfd20304-d6497616-9581a1a7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:35.389699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:35.389717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:35.390643Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:35.391025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534087245090552:3998]
2025-10-02T08:11:35.391045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:35.391099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1220 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8859a594-cfd20304-d6497616-9581a1a7_0
2025-10-02T08:11:35.391318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1220 sessionId: src_id|8859a594-cfd20304-d6497616-9581a1a7_0 is DEAD
2025-10-02T08:11:35.397192Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:35.402213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8859a594-cfd20304-d6497616-9581a1a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:35.402475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:35.402493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1221
2025-10-02T08:11:35.407758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:35.407815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:35.407820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:35.407823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:35.408575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1221 sessionId:  describe result for acl check
2025-10-02T08:11:35.408615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:35.408617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:35.408619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:35.408625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534087245090858:3645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:35.409170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534087245090858:3645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:35.414940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534087245090858:3645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:35.429584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534087245090858:3645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:35.429610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534087245090858:3645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:35.429614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534087245090858:3645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:35.429624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:35.463986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:35.477082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:35.477361Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:35.477365Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:35.477375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:35.477446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:35.477487Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534087245091311:3647]
2025-10-02T08:11:35.478164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:35.481694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:35.481780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:35.482179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:35.482236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.482238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.482240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.482241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.482243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.482249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.482260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.482264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.482268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.482272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.482279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.482288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.482294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.482300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.482306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.482311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.482316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.482321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.482327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.482333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.482353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:35.489201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534087245091325:3998]
2025-10-02T08:11:35.497725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:35.506979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:35.507008Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:35.507013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:35.507017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:35.507026Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1220 [1:7556534087245091311:3647]
2025-10-02T08:11:35.507042Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:35.507063Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:35.507067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:35.507070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:35.507073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:35.507092Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:35.507098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:35.507104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:35.507211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.507214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.507218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:35.507221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:35.507297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:35.507300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.507315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.507329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:35.507347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534087245091304:3647]
2025-10-02T08:11:35.507349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534087245091304:3647]
2025-10-02T08:11:35.507362Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:35.507375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:35.507391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:35.507394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:35.507437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534087245091304:3647]
2025-10-02T08:11:35.507439Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:35.507592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:35.507595Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:35.507600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:35.512973Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1220
2025-10-02T08:11:35.514688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1220
2025-10-02T08:11:35.514722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534087245090999:3645], now have 1 active actors on pipe
2025-10-02T08:11:35.514730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534087245091325:3998], now have 1 active actors on pipe
2025-10-02T08:11:35.514737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534087705036189:2378], now have 1 active actors on pipe
2025-10-02T08:11:35.514755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1220, pipe: [1:7556534087245091325:3998]
2025-10-02T08:11:35.517683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:35.517706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:35.517754Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:35.517765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:35.517769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:35.517773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:35.517787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:35.517806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:35.517830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:35.517991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:35.517997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:35.518014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:35.518058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1221 partition: 0 MaxSeqNo: 17 sessionId: src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0
2025-10-02T08:11:35.518539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8859a594-cfd20304-d6497616-9581a1a7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:35.521694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0] Write session: try to update token
2025-10-02T08:11:35.521718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:35.542559Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:35.542584Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:35.542587Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:35.542597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534087245091304:3647]
2025-10-02T08:11:35.542603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534087245091304:3647]
2025-10-02T08:11:35.542651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:35.542658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.542661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:35.542821Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:35.544985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:35.545000Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:35.557248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId: src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:35.560571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:35.786148Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:35.787011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:35.787023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:35.788872Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:35.798764Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:35.799492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:35.799548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1221 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0
2025-10-02T08:11:35.799753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1221 sessionId: src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0 is DEAD
2025-10-02T08:11:35.799884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534087245091325:3998]
2025-10-02T08:11:35.804918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:35.804937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0] Write session will restart in 0.007976s
2025-10-02T08:11:35.804965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0] Write session: Do CDS request
2025-10-02T08:11:35.804973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:35.814986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:35.815341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:35.815374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1222
2025-10-02T08:11:35.815575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:35.815618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:35.815624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:35.815630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:35.818987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1222 sessionId:  describe result for acl check
2025-10-02T08:11:35.819046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:35.819050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:35.819052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:35.819059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534087245091677:3619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:35.819756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534087245091677:3619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:35.835457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534087245091677:3619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:35.851788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534087245091677:3619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:35.851809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534087245091677:3619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:35.851813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534087245091677:3619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:35.851822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:35.860343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:35.861174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:35.861396Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:35.861400Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:35.861411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:35.861468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:35.861515Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534087245092113:3625]
2025-10-02T08:11:35.862145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:35.862954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:35.863009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:35.863334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:35.863379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.863381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.863382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.863383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.863384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.863390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.863402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.863407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.863411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.863416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.863423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.863431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:35.863437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.863443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:35.863448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.863453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:35.863457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.863461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.863465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.863470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.863489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:35.876961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:35.879659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:35.879668Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:35.879672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:35.879676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:35.879683Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1221 [1:7556534087245092113:3625]
2025-10-02T08:11:35.879699Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:35.879717Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:35.879720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:35.879723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:35.879725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:35.879743Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:35.879748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:35.879757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:35.879829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.879831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.879834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:35.879837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:35.879919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:35.879922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.879951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:35.879965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:35.879984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534087245092100:3625]
2025-10-02T08:11:35.879986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534087245092100:3625]
2025-10-02T08:11:35.879995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:35.880009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534087245092085:3619], now have 1 active actors on pipe
2025-10-02T08:11:35.880011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:35.880015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:35.880017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:35.880031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:35.880034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:35.880039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534087705036211:2378], now have 1 active actors on pipe
2025-10-02T08:11:35.880075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534087245092100:3625]
2025-10-02T08:11:35.880078Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:35.880131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1221
2025-10-02T08:11:35.880163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:35.880399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:35.880414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:35.880442Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:35.880449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:35.880453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:35.880455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:35.880465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:35.880475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:35.880508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:35.880543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:35.880545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:35.880558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:35.880591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1222 partition: 0 MaxSeqNo: 17 sessionId: src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0
2025-10-02T08:11:35.881224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a129e099-2ad8fd18-4c690069-b3d360a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:35.881998Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1221
2025-10-02T08:11:35.884273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0] Write session: try to update token
2025-10-02T08:11:35.884293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:35.901479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534087245092152:3998]
2025-10-02T08:11:35.903843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534087245092152:3998], now have 1 active actors on pipe
2025-10-02T08:11:35.903881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1221, pipe: [1:7556534087245092152:3998]
2025-10-02T08:11:35.909455Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:35.909477Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:35.909480Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:35.909489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534087245092100:3625]
2025-10-02T08:11:35.909493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534087245092100:3625]
2025-10-02T08:11:35.909537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:35.909545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:35.909548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:35.909697Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:35.912913Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:35.912936Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:35.918078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId: src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:35.920980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:36.076142Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:36.076762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.076771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.077297Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:36.077719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:36.077779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1222 reason: status is not ok: tablet will be restarted right now sessionId: src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0
2025-10-02T08:11:36.077973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1222 sessionId: src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0 is DEAD
2025-10-02T08:11:36.078139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534087245092152:3998]
2025-10-02T08:11:36.077752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:36.081023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:36.081034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0] Write session will restart in 0.006624s
2025-10-02T08:11:36.081058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0] Write session: Do CDS request
2025-10-02T08:11:36.081065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:36.099263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:36.101534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:36.101562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1223
2025-10-02T08:11:36.102318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:36.102362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:36.102369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:36.102374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:36.105019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1223 sessionId:  describe result for acl check
2025-10-02T08:11:36.105066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:36.105068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:36.105070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:36.105077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534091540059948:3566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:36.106476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534091540059948:3566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:36.121424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534091540059948:3566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:36.134582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534091540059948:3566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:36.134603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534091540059948:3566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:36.134606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534091540059948:3566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:36.134616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:36.135696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:36.136119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:36.136292Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:36.136295Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:36.136304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:36.136347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:36.136381Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534091540060218:3586]
2025-10-02T08:11:36.137038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:36.137407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:36.137451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:36.137767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:36.137807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.137809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.137810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.137811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.137813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.137818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.137830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.137835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.137839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.137843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.137849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.137855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.137861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.137866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.137871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.137877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.137882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.137888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.137894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.137899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.137920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:36.149182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:36.151287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:36.151296Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:36.151298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:36.151302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:36.151309Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1222 [1:7556534091540060218:3586]
2025-10-02T08:11:36.151322Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:36.151341Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:36.151344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:36.151348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:36.151350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:36.151367Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:36.151372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:36.151380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:36.151451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.151454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.151457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:36.151460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:36.151534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:36.151537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.151552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.151565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:36.151581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534091540060206:3586]
2025-10-02T08:11:36.151584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534091540060206:3586]
2025-10-02T08:11:36.151595Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:36.151609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:36.151624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:36.151627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:36.151659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534091540060206:3586]
2025-10-02T08:11:36.151662Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:36.153063Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1222
2025-10-02T08:11:36.152024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:36.152034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:36.152041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:36.152595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1222
2025-10-02T08:11:36.152606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534091540060209:3566], now have 1 active actors on pipe
2025-10-02T08:11:36.152611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534092000003537:2378], now have 1 active actors on pipe
2025-10-02T08:11:36.153331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.153345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.153378Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:36.153389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:36.153394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:36.153397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:36.153410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:36.153423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:36.153441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:36.154066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633d2c7c-14f15004-3fbf735c-f07a0758_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:36.157876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0] Write session: try to update token
2025-10-02T08:11:36.157901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:36.153574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.153580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.153595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:36.153627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1223 partition: 0 MaxSeqNo: 17 sessionId: src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0
2025-10-02T08:11:36.177449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534091540060240:3998]
2025-10-02T08:11:36.177695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1222, pipe: [1:7556534091540060240:3998]
2025-10-02T08:11:36.177711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534091540060240:3998], now have 1 active actors on pipe
2025-10-02T08:11:36.185784Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:36.185807Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:36.185809Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:36.185818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534091540060206:3586]
2025-10-02T08:11:36.185823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534091540060206:3586]
2025-10-02T08:11:36.185870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:36.185876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.185878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:36.186034Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:36.189084Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:36.189105Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:36.201719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId: src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:36.214912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:36.370282Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:36.371383Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:36.370746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.370762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.372872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:36.372893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0] Write session will restart in 0.008511s
2025-10-02T08:11:36.372923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0] Write session: Do CDS request
2025-10-02T08:11:36.372933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:36.371716Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:36.372082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:36.372138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1223 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0
2025-10-02T08:11:36.372338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1223 sessionId: src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0 is DEAD
2025-10-02T08:11:36.372471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534091540060240:3998]
2025-10-02T08:11:36.385320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:36.389219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:36.389242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1224
2025-10-02T08:11:36.389714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:36.389756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:36.389761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:36.389765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:36.391341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1224 sessionId:  describe result for acl check
2025-10-02T08:11:36.391368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:36.391370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:36.391372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:36.391376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534091540060648:3561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:36.391882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534091540060648:3561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:36.401252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534091540060648:3561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:36.407514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534091540060648:3561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:36.407535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534091540060648:3561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:36.407539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534091540060648:3561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:36.407549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:36.414574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:36.415087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:36.415269Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:36.415272Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:36.415280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:36.415315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:36.415342Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534091540060997:3564]
2025-10-02T08:11:36.415856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:36.416129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:36.416176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:36.416435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:36.416462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.416463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.416464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.416464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.416466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.416469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.416477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.416479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.416482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.416484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.416488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.416492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.416497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.416500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.416503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.416506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.416508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.416511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.416516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.416519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.416529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:36.433355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:36.435878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:36.435900Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:36.435902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:36.435906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:36.435913Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1223 [1:7556534091540060997:3564]
2025-10-02T08:11:36.435943Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:36.435964Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:36.435967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:36.435969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:36.435971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:36.435990Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:36.435996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:36.436002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:36.436076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.436078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.436081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:36.436084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:36.436161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:36.436164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.436178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.436189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:36.436207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534091540060991:3564]
2025-10-02T08:11:36.436208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534091540060991:3564]
2025-10-02T08:11:36.436217Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:36.436228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:36.436241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:36.436243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:36.436252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534091540060919:3561], now have 1 active actors on pipe
2025-10-02T08:11:36.436275Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:36.436278Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:36.436284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534091540060991:3564]
2025-10-02T08:11:36.436287Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:36.436301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534092000003545:2378], now have 1 active actors on pipe
2025-10-02T08:11:36.436333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1223
2025-10-02T08:11:36.436541Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1223
2025-10-02T08:11:36.436457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:36.436639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.436653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.436694Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:36.436701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:36.436705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:36.436707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:36.436717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:36.436729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:36.436755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:36.436799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.436814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.436827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:36.436865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1224 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0
2025-10-02T08:11:36.440241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8817aa2c-318faf03-33001b4f-f0bb146d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:36.443911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0] Write session: try to update token
2025-10-02T08:11:36.443953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:36.462037Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:36.462060Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:36.462063Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:36.462073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534091540060991:3564]
2025-10-02T08:11:36.462079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534091540060991:3564]
2025-10-02T08:11:36.462124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:36.462132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.462134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:36.462288Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:36.463378Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:36.463386Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:36.477301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534091540061022:3998]
2025-10-02T08:11:36.478034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1223, pipe: [1:7556534091540061022:3998]
2025-10-02T08:11:36.502716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId: src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:36.505571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:36.641703Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:36.639309Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:36.639918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534091540061022:3998], now have 1 active actors on pipe
2025-10-02T08:11:36.639941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.639948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.640872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534091540061022:3998]
2025-10-02T08:11:36.640894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:36.640897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:36.640952Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:36.640957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1224 reason: error at write: Disconnected sessionId: src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0
2025-10-02T08:11:36.641138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1224 sessionId: src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0 is DEAD
2025-10-02T08:11:36.644915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:36.644924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0] Write session will restart in 0.005104s
2025-10-02T08:11:36.644953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0] Write session: Do CDS request
2025-10-02T08:11:36.644961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:36.654766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:36.654898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:36.654916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1225
2025-10-02T08:11:36.655061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:36.655094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:36.655099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:36.655104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:36.658647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1225 sessionId:  describe result for acl check
2025-10-02T08:11:36.658696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:36.658697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:36.658698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:36.658702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534091540061329:3545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:36.659254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534091540061329:3545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:36.664204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534091540061329:3545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:36.669136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534091540061329:3545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:36.669156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534091540061329:3545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:36.669159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534091540061329:3545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:36.669168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:36.690531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:36.693389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:36.693632Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:36.693636Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:36.693648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:36.693714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:36.693754Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534091540061787:3553]
2025-10-02T08:11:36.694406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:36.694669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:36.694720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:36.695052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:36.695115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.695116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.695117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.695118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.695119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.695125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.695137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.695141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.695145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.695149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.695155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.695162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.695168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.695174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.695178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.695184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.695189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.695194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.695203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.695207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.695243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:36.704601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:36.706551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:36.706574Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:36.706578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:36.706582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:36.706590Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1224 [1:7556534091540061787:3553]
2025-10-02T08:11:36.706603Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:36.706625Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:36.706628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:36.706631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:36.706633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:36.706651Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:36.706657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:36.706664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:36.706740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.706742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.706745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:36.706748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:36.707279Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1224
2025-10-02T08:11:36.707703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9076c6-1404ff5f-72a4f963-a1dcc51f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:36.706823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:36.706833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.706850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.706862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:36.706880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534091540061781:3553]
2025-10-02T08:11:36.706882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534091540061781:3553]
2025-10-02T08:11:36.706901Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:36.706916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:36.706931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:36.706934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:36.706968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534091540061781:3553]
2025-10-02T08:11:36.706971Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:36.706992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534091540061440:3545], now have 1 active actors on pipe
2025-10-02T08:11:36.707007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534092000003554:2378], now have 1 active actors on pipe
2025-10-02T08:11:36.707034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1224
2025-10-02T08:11:36.707050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.707054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.707058Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:36.707062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:36.707068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:36.707080Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:36.707087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:36.707091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:36.707093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:36.707105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:36.707115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:36.707132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:36.707202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.707204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.707218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:36.707248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1225 partition: 0 MaxSeqNo: 17 sessionId: src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0
2025-10-02T08:11:36.710961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0] Write session: try to update token
2025-10-02T08:11:36.710979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:36.735550Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:36.735572Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:36.735584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534091540061781:3553]
2025-10-02T08:11:36.735632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:36.735837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:36.736010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:36.736179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:36.736338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:36.736552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:36.736602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:36.737569Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:36.740749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534091540061812:3998]
2025-10-02T08:11:36.741214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534091540061812:3998], now have 1 active actors on pipe
2025-10-02T08:11:36.741246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1224, pipe: [1:7556534091540061812:3998]
2025-10-02T08:11:36.745484Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:36.745505Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:36.745509Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:36.745519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534091540061781:3553]
2025-10-02T08:11:36.745523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534091540061781:3553]
2025-10-02T08:11:36.745566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:36.745573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.745575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:36.745742Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:36.749133Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:36.749150Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:36.752866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId: src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:36.757922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:36.901333Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:36.902029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:36.902039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:36.905445Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:36.908409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:36.908420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0] Write session will restart in 0.007647s
2025-10-02T08:11:36.908444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0] Write session: Do CDS request
2025-10-02T08:11:36.908451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:36.907620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534091540061812:3998]
2025-10-02T08:11:36.908215Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:36.907652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:36.907707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1225 reason: status is not ok: tablet will be restarted right now sessionId: src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0
2025-10-02T08:11:36.907898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1225 sessionId: src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0 is DEAD
2025-10-02T08:11:36.919459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:36.919779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:36.919798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1226
2025-10-02T08:11:36.919944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:36.919975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:36.919980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:36.919982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:36.920489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1226 sessionId:  describe result for acl check
2025-10-02T08:11:36.920525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:36.920526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:36.920530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:36.920536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534091540062125:3517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:36.921106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534091540062125:3517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:36.937421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534091540062125:3517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:36.946859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534091540062125:3517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:36.946876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534091540062125:3517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:36.946881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534091540062125:3517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:36.946888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:36.960616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:36.986248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:36.988747Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:36.988762Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:36.988780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:36.988907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:36.988943Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534091540062606:3516]
2025-10-02T08:11:36.989623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:36.989930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:36.989989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:36.990299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:36.990341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.990343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.990344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.990345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.990346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.990351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.990362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.990367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.990370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.990374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.990379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.990386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:36.990392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.990397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:36.990401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.990406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:36.990410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.990415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:36.990420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.990425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:36.990444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:37.002592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:37.004764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:37.004782Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:37.004784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:37.004788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:37.004795Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1225 [1:7556534091540062606:3516]
2025-10-02T08:11:37.004891Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:37.004914Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:37.004917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:37.004920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:37.004922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:37.004939Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:37.004944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:37.004951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:37.005012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.005013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.005016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:37.005018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:37.005087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:37.005090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.005105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.005116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:37.005134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534091540062600:3516]
2025-10-02T08:11:37.005137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534091540062600:3516]
2025-10-02T08:11:37.005143Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:37.005156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:37.005158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534091540062442:3517], now have 1 active actors on pipe
2025-10-02T08:11:37.005159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:37.005166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:37.005177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:37.005180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:37.005185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534092000003575:2378], now have 1 active actors on pipe
2025-10-02T08:11:37.005221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534091540062600:3516]
2025-10-02T08:11:37.005224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:37.005265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1225
2025-10-02T08:11:37.005380Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:37.005409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:37.005419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:37.005446Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:37.005452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:37.005460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:37.005461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:37.005473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:37.005483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:37.005499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:37.005654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:37.005661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:37.005676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:37.005707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1226 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0
2025-10-02T08:11:37.006115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425d7fbc-f6c1da54-7e5a4c72-3fc4182b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:37.006322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1225
2025-10-02T08:11:37.009359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0] Write session: try to update token
2025-10-02T08:11:37.009378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:37.007414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534095835029924:3998]
2025-10-02T08:11:37.007609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1225, pipe: [1:7556534095835029924:3998]
2025-10-02T08:11:37.007622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534095835029924:3998], now have 1 active actors on pipe
2025-10-02T08:11:37.036470Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:37.036492Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:37.036495Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:37.036507Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534091540062600:3516]
2025-10-02T08:11:37.036512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534091540062600:3516]
2025-10-02T08:11:37.036558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:37.036566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.036568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:37.036732Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:37.038628Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:37.038645Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:37.047927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId: src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:37.053642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:37.215021Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:37.215397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:37.215413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:37.217338Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:37.217803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534095835029924:3998]
2025-10-02T08:11:37.217843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:37.217908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1226 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0
2025-10-02T08:11:37.218090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1226 sessionId: src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0 is DEAD
2025-10-02T08:11:37.221103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:37.221115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0] Write session will restart in 0.006011s
2025-10-02T08:11:37.221139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0] Write session: Do CDS request
2025-10-02T08:11:37.221146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:37.219287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:37.228353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:37.229177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:37.229198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1227
2025-10-02T08:11:37.229375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:37.229405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:37.229411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:37.229416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:37.235662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1227 sessionId:  describe result for acl check
2025-10-02T08:11:37.235734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:37.235736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:37.235737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:37.235743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534095835029978:3478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:37.236350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534095835029978:3478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:37.250072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534095835029978:3478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:37.273480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534095835029978:3478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:37.273507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534095835029978:3478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:37.273511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534095835029978:3478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:37.273523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:37.308666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:37.312940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:37.313194Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:37.313198Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:37.313211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:37.313279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:37.313317Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534095835030701:3480]
2025-10-02T08:11:37.313952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:37.320981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:37.321065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:37.321459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:37.321507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:37.321508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:37.321509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:37.321510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.321511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.321517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:37.321528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:37.321532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:37.321536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.321540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.321547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:37.321555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:37.321561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:37.321567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:37.321573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:37.321578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:37.321583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.321588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.321594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.321599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.321622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:37.321665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534095835030712:3998]
2025-10-02T08:11:37.343729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:37.345617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:37.345624Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:37.345627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:37.345630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:37.345638Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1226 [1:7556534095835030701:3480]
2025-10-02T08:11:37.345648Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:37.345664Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:37.345667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:37.345670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:37.345672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:37.345686Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:37.345691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:37.345698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:37.345760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.345762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.345764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:37.345766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:37.345844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:37.345848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.345861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.345871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:37.345887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534095835030695:3480]
2025-10-02T08:11:37.345888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534095835030695:3480]
2025-10-02T08:11:37.345898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:37.345909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:37.345922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:37.345925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:37.345957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534095835030695:3480]
2025-10-02T08:11:37.345959Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:37.346353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:37.346363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:37.346369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:37.346791Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1226
2025-10-02T08:11:37.349052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1226
2025-10-02T08:11:37.349075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534095835030459:3478], now have 1 active actors on pipe
2025-10-02T08:11:37.349080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534095835030712:3998], now have 1 active actors on pipe
2025-10-02T08:11:37.349085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534096294970901:2378], now have 1 active actors on pipe
2025-10-02T08:11:37.349116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1226, pipe: [1:7556534095835030712:3998]
2025-10-02T08:11:37.349409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:37.349420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:37.349456Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:37.349508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:37.349525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:37.349528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:37.349540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:37.349557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:37.349576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:37.349620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:37.349623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:37.349636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:37.349667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1227 partition: 0 MaxSeqNo: 17 sessionId: src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0
2025-10-02T08:11:37.352914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c02635f-b91501a-122cc0a7-1a0ad839_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:37.355706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0] Write session: try to update token
2025-10-02T08:11:37.355722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:37.389944Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:37.389966Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:37.389969Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:37.389978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534095835030695:3480]
2025-10-02T08:11:37.389982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534095835030695:3480]
2025-10-02T08:11:37.390027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:37.390034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.390036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:37.390192Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:37.392885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId: src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:37.393113Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:37.393130Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:37.396083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:37.637667Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:37.638200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:37.638207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:37.638725Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:37.638442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:37.638448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:37.638496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1227 reason: error at write: Disconnected sessionId: src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0
2025-10-02T08:11:37.638688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1227 sessionId: src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0 is DEAD
2025-10-02T08:11:37.638892Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:37.639676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534095835030712:3998]
2025-10-02T08:11:37.643728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:37.643748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0] Write session will restart in 0.006158s
2025-10-02T08:11:37.643776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0] Write session: Do CDS request
2025-10-02T08:11:37.643800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:37.654536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:37.659267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:37.659284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1228
2025-10-02T08:11:37.659555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:37.659603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:37.659610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:37.659613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:37.665281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1228 sessionId:  describe result for acl check
2025-10-02T08:11:37.665337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:37.665339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:37.665341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:37.665347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534095835031123:3456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:37.665929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534095835031123:3456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:37.683662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534095835031123:3456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:37.697813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534095835031123:3456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:37.697836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534095835031123:3456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:37.697839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534095835031123:3456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:37.697849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:37.726247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:37.729072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:37.729315Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:37.729318Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:37.729328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:37.729383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:37.729424Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534095835031498:3461]
2025-10-02T08:11:37.730092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:37.730411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:37.730461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:37.730783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:37.730825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:37.730826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:37.730827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:37.730828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.730829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.730834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:37.730844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:37.730848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:37.730852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.730856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.730861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:37.730868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:37.730874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:37.730879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:37.730886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:37.730891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:37.730896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.730901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.730906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.730911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.730929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:37.741401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534095835031512:3998]
2025-10-02T08:11:37.746933Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1227
2025-10-02T08:11:37.743566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:37.745606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:37.745613Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:37.745616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:37.745620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:37.745628Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1227 [1:7556534095835031498:3461]
2025-10-02T08:11:37.745639Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:37.745662Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:37.745665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:37.745668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:37.745671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:37.745689Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:37.745694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:37.745701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:37.745775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.745777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.745780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:37.745782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:37.745857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:37.745860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.745875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:37.745887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:37.745905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534095835031491:3461]
2025-10-02T08:11:37.745907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534095835031491:3461]
2025-10-02T08:11:37.745915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:37.745930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:37.745944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:37.745947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:37.745982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534095835031491:3461]
2025-10-02T08:11:37.745985Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:37.746105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:37.746107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:37.746114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:37.748872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1227, pipe: [1:7556534095835031512:3998]
2025-10-02T08:11:37.748904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534095835031512:3998], now have 1 active actors on pipe
2025-10-02T08:11:37.748914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534095835031377:3456], now have 1 active actors on pipe
2025-10-02T08:11:37.748919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534096294970911:2378], now have 1 active actors on pipe
2025-10-02T08:11:37.748952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1227
2025-10-02T08:11:37.749339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:37.749350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:37.749379Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:37.749389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:37.749394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:37.749397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:37.749409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:37.749423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:37.749443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:37.749562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:37.749567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:37.749582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:37.749617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1228 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0
2025-10-02T08:11:37.753380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2873f56-d8622b37-e074866b-ef6dea5a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:37.761558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0] Write session: try to update token
2025-10-02T08:11:37.761597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:37.785296Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:37.785317Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:37.785319Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:37.785329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534095835031491:3461]
2025-10-02T08:11:37.785334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534095835031491:3461]
2025-10-02T08:11:37.785376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:37.785382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:37.785385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:37.785550Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:37.788490Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:37.788500Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:37.824884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId: src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:37.827905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:38.081312Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:38.088919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.088944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.094144Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:38.094198Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:38.094577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534095835031512:3998]
2025-10-02T08:11:38.094596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:38.094646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1228 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0
2025-10-02T08:11:38.094837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1228 sessionId: src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0 is DEAD
2025-10-02T08:11:38.096034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:38.096043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0] Write session will restart in 0.008295s
2025-10-02T08:11:38.096067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0] Write session: Do CDS request
2025-10-02T08:11:38.096075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:38.112049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:38.116983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:38.117003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1229
2025-10-02T08:11:38.117252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:38.117281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:38.117286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:38.117291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:38.118368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1229 sessionId:  describe result for acl check
2025-10-02T08:11:38.118402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:38.118404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:38.118405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:38.118411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534100129999211:3411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:38.124308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534100129999211:3411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:38.157425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534100129999211:3411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:38.173510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534100129999211:3411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:38.173533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534100129999211:3411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:38.173537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534100129999211:3411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:38.173547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:38.188943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534100129999631:3998]
2025-10-02T08:11:38.190489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:38.200910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:38.201186Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:38.201189Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:38.201201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:38.201254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:38.201290Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534100129999639:3410]
2025-10-02T08:11:38.201913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:38.204991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:38.205088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:38.205505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:38.205554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.205555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.205557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.205558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.205560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.205567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.205579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.205583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.205588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.205591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.205598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.205606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.205612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.205618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.205623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.205629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.205634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.205640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.205646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.205668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.205691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:38.230184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:38.232481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:38.232489Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:38.232491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:38.232495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:38.232503Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1228 [1:7556534100129999639:3410]
2025-10-02T08:11:38.232522Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:38.232542Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:38.232545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:38.232549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:38.232551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:38.232567Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:38.232572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:38.232580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:38.232652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.232654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.232657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:38.232660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:38.232744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:38.232746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.232765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.232778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:38.232797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534100129999632:3410]
2025-10-02T08:11:38.234629Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1228
2025-10-02T08:11:38.235621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1228, pipe: [1:7556534100129999631:3998]
2025-10-02T08:11:38.235657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1228
2025-10-02T08:11:38.239743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534100129999632:3410]
2025-10-02T08:11:38.239779Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:38.239828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:38.239853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:38.239856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:38.239872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534100129999631:3998], now have 1 active actors on pipe
2025-10-02T08:11:38.239877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534100589938251:2378], now have 1 active actors on pipe
2025-10-02T08:11:38.239881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534100129999564:3411], now have 1 active actors on pipe
2025-10-02T08:11:38.239900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.239904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.239976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534100129999632:3410]
2025-10-02T08:11:38.239982Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:38.239999Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:38.240007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:38.240011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:38.240013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:38.240026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:38.240040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:38.240076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:38.240847Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:38.240861Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:38.240869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:38.242306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5e1a18-9c45e720-fceb44be-a9ea93d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:38.241731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.241745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.241776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:38.241820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1229 partition: 0 MaxSeqNo: 17 sessionId: src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0
2025-10-02T08:11:38.246457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0] Write session: try to update token
2025-10-02T08:11:38.246482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:38.258600Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:38.258622Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:38.258633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534100129999632:3410]
2025-10-02T08:11:38.258683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:38.258915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:38.259067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:38.259215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:38.259366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:38.259979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:38.260020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:38.260527Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:38.294278Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:38.294304Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:38.294307Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:38.294318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534100129999632:3410]
2025-10-02T08:11:38.294322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534100129999632:3410]
2025-10-02T08:11:38.294364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:38.294371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.294374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:38.294565Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:38.295289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId: src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:38.297051Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:38.297076Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:38.297952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:38.523532Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:38.523835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.523845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.525044Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:38.525522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:38.525586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1229 reason: status is not ok: tablet will be restarted right now sessionId: src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0
2025-10-02T08:11:38.525736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534100129999631:3998]
2025-10-02T08:11:38.525758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1229 sessionId: src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0 is DEAD
2025-10-02T08:11:38.525318Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:38.529374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:38.529389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0] Write session will restart in 0.009346s
2025-10-02T08:11:38.529415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0] Write session: Do CDS request
2025-10-02T08:11:38.529423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:38.541218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:38.541552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:38.541568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1230
2025-10-02T08:11:38.541733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:38.541795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:38.541800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:38.541805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:38.546127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1230 sessionId:  describe result for acl check
2025-10-02T08:11:38.546172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:38.546173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:38.546175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:38.546180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534100129999987:3383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:38.546865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534100129999987:3383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:38.553707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534100129999987:3383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:38.570287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534100129999987:3383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:38.570306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534100129999987:3383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:38.570309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534100129999987:3383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:38.570318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:38.586338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:38.589609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:38.589824Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:38.589828Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:38.589837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:38.589885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:38.590026Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534100130000430:3380]
2025-10-02T08:11:38.590717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:38.591105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:38.591153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:38.591442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:38.591489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.591490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.591491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.591492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.591493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.591498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.591508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.591511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.591515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.591518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.591523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.591530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.591536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.591541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.591545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.591549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.591553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.591558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.591562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.591566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.591583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:38.602687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:38.604853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:38.604869Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:38.604871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:38.604875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:38.604882Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1229 [1:7556534100130000430:3380]
2025-10-02T08:11:38.604896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:38.604916Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:38.604919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:38.604922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:38.604924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:38.604940Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:38.604945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:38.604955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:38.605026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.605028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.605031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:38.605034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:38.605094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:38.605096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.605110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.605121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:38.605137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534100130000423:3380]
2025-10-02T08:11:38.605139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534100130000423:3380]
2025-10-02T08:11:38.605152Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:38.605164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:38.607895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1229
2025-10-02T08:11:38.605177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:38.605180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:38.605213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534100130000423:3380]
2025-10-02T08:11:38.605215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:38.605302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:38.605304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:38.605310Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:38.607458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1229
2025-10-02T08:11:38.607475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534100130000212:3383], now have 1 active actors on pipe
2025-10-02T08:11:38.607480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534100589938260:2378], now have 1 active actors on pipe
2025-10-02T08:11:38.607675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.607683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.607717Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:38.607726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:38.607731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:38.607734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:38.607747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:38.607763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:38.607784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:38.608147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.608150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.608166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:38.608199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1230 partition: 0 MaxSeqNo: 17 sessionId: src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0
2025-10-02T08:11:38.608667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537566bd-fcb46e16-86fc6bd9-52ca7e11_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:38.611889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0] Write session: try to update token
2025-10-02T08:11:38.611909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:38.629538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534100130000452:3998]
2025-10-02T08:11:38.630020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534100130000452:3998], now have 1 active actors on pipe
2025-10-02T08:11:38.630247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1229, pipe: [1:7556534100130000452:3998]
2025-10-02T08:11:38.632665Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:38.632686Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:38.632689Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:38.632699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534100130000423:3380]
2025-10-02T08:11:38.632704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534100130000423:3380]
2025-10-02T08:11:38.632753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:38.632761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.632763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:38.632946Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:38.636953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:38.636972Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:38.643154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId: src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:38.645844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:38.831327Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:38.831975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.831984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.833282Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:38.833045Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:38.833432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:38.833482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1230 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0
2025-10-02T08:11:38.833639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1230 sessionId: src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0 is DEAD
2025-10-02T08:11:38.833765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534100130000452:3998]
2025-10-02T08:11:38.836938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:38.836950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0] Write session will restart in 0.009889s
2025-10-02T08:11:38.836976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0] Write session: Do CDS request
2025-10-02T08:11:38.836983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:38.848621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:38.850187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:38.850204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1231
2025-10-02T08:11:38.851325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:38.851363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:38.851369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:38.851372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:38.852959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1231 sessionId:  describe result for acl check
2025-10-02T08:11:38.853006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:38.853009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:38.853011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:38.853016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534100130000824:3376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:38.853518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534100130000824:3376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:38.859647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534100130000824:3376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:38.870796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534100130000824:3376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:38.870818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534100130000824:3376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:38.870821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534100130000824:3376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:38.870831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:38.895087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:38.895629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:38.895810Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:38.895814Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:38.895822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:38.895865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:38.895977Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534100130001226:3367]
2025-10-02T08:11:38.896591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:38.896847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:38.896890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:38.897167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:38.897199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.897200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.897201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.897202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.897204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.897208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.897217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.897221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.897224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.897227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.897232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.897239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:38.897243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.897248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:38.897252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.897257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:38.897261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.897266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.897270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.897274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.897293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:38.909102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:38.912513Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1230
2025-10-02T08:11:38.911271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:38.911293Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:38.911296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:38.911299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:38.911305Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1230 [1:7556534100130001226:3367]
2025-10-02T08:11:38.911317Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:38.911336Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:38.911338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:38.911341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:38.911343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:38.911360Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:38.911365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:38.911371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:38.911439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.911441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.911443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:38.912989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43e5c29c-e43e6f86-b5c617f5-cc6b61e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:38.911446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:38.911508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:38.911511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.911525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:38.911536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:38.911551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534100130001220:3367]
2025-10-02T08:11:38.911553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534100130001220:3367]
2025-10-02T08:11:38.911563Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:38.911575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:38.911588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:38.911591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:38.911625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534100130001220:3367]
2025-10-02T08:11:38.911627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:38.911737Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:38.911738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:38.911743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:38.911858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534100130000957:3376], now have 1 active actors on pipe
2025-10-02T08:11:38.911889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1230
2025-10-02T08:11:38.911946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.911952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.911982Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:38.911998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:38.912002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:38.912005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:38.912017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:38.912028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:38.912067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:38.912089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534100589938269:2378], now have 1 active actors on pipe
2025-10-02T08:11:38.912103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:38.912105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:38.912117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:38.912150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1231 partition: 0 MaxSeqNo: 17 sessionId: src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0
2025-10-02T08:11:38.916108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0] Write session: try to update token
2025-10-02T08:11:38.916124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:38.936640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534100130001250:3998]
2025-10-02T08:11:38.936860Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:38.936876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:38.936878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:38.936886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534100130001220:3367]
2025-10-02T08:11:38.936891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534100130001220:3367]
2025-10-02T08:11:38.936936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:38.936942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:38.936944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:38.937105Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:38.942910Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:38.942918Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:38.943226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1230, pipe: [1:7556534100130001250:3998]
2025-10-02T08:11:38.944782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId: src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:38.947555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:39.098819Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:39.099369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534100130001250:3998], now have 1 active actors on pipe
2025-10-02T08:11:39.099381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.099386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.100017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:39.101473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:39.101484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0] Write session will restart in 0.006916s
2025-10-02T08:11:39.101505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0] Write session: Do CDS request
2025-10-02T08:11:39.101511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:39.100631Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:39.100867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534100130001250:3998]
2025-10-02T08:11:39.100889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:39.100953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1231 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0
2025-10-02T08:11:39.101138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1231 sessionId: src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0 is DEAD
2025-10-02T08:11:39.113354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:39.117401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:39.117420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1232
2025-10-02T08:11:39.117603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:39.117632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:39.117636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:39.117639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:39.118172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1232 sessionId:  describe result for acl check
2025-10-02T08:11:39.118202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:39.118204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:39.118205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:39.118211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534104424968937:3369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:39.118870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534104424968937:3369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:39.122579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534104424968937:3369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:39.140660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534104424968937:3369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:39.140685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534104424968937:3369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:39.140688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534104424968937:3369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:39.140698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:39.152199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:39.154695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:39.154892Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:39.154895Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:39.154902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:39.154936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:39.154960Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534104424969341:3371]
2025-10-02T08:11:39.155365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:39.155605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:39.155659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:39.155960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:39.155999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.156000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.156001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.156002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.156004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.156008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.156017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.156021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.156025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.156028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.156033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.156040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.156045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.156050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.156054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.156059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.156062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.156067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.156071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.156075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.156094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:39.174703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:39.176599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:39.176619Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:39.176621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:39.176625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:39.176634Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1231 [1:7556534104424969341:3371]
2025-10-02T08:11:39.176644Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:39.176660Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:39.176663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.176666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.176668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.176683Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:39.176688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:39.176695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:39.176758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.176767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.176770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:39.176773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:39.177063Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1231
2025-10-02T08:11:39.176932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:39.176950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.176964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.176977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:39.176985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534104424969105:3369], now have 1 active actors on pipe
2025-10-02T08:11:39.176988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534104884905586:2378], now have 1 active actors on pipe
2025-10-02T08:11:39.177005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534104424969335:3371]
2025-10-02T08:11:39.177010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534104424969335:3371]
2025-10-02T08:11:39.177021Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:39.177034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:39.177047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:39.177050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:39.177072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:39.177076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:39.177083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534104424969335:3371]
2025-10-02T08:11:39.177086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:39.177091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:39.177127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1231
2025-10-02T08:11:39.177300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.177315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.177342Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4505eb-436d64ed-e0e7924b-352eead2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:39.177356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.177360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.177361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:39.177370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.177380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:39.177400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:39.177494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.177499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.177511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:39.177542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1232 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4505eb-436d64ed-e0e7924b-352eead2_0
2025-10-02T08:11:39.177943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2f251f8-e6634394-56e04b86-3d717bfb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4505eb-436d64ed-e0e7924b-352eead2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:39.180677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4505eb-436d64ed-e0e7924b-352eead2_0] Write session: try to update token
2025-10-02T08:11:39.180693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4505eb-436d64ed-e0e7924b-352eead2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:39.201309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534104424969388:3998]
2025-10-02T08:11:39.201491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1231, pipe: [1:7556534104424969388:3998]
2025-10-02T08:11:39.201495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534104424969388:3998], now have 1 active actors on pipe
2025-10-02T08:11:39.217008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId: src_id|c4505eb-436d64ed-e0e7924b-352eead2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:39.219859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:39.219928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.219936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.219982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:39.220003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:39.220648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.220666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.220865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.220934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.221004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.221071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.221120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.221125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.221202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.221266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.221330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.221399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.221442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.221446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.221528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.221591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.221653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.221718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.221760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.221763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.221841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.221904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.221976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.222047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.222091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.222094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.222170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.222238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.222306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.222371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.222417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.222420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.222493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.222556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.222621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.222691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.222736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.222739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.222815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.222876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.222943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.223009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.223052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.223055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.223128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.223195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.223263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.223331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.223374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.223377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.223449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.223516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.223619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.223693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.223744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.223747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.223826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:39.223899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:39.223982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:39.224056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:39.224108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:39.224111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:39.224155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:39.224224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.224243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.224246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:39.224283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:39.224294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:39.224297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:39.224300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:39.224303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:39.224752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:39.224768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:39.224775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:39.224779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:39.224782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:39.224785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:39.227765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:39.227800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:39.227809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:39.227813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:39.227817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:39.227820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:39.228490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:39.228513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:39.228519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:39.228524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:39.228526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:39.242238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:39.242266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:39.242280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392699241
2025-10-02T08:11:39.242427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:39.242438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:39.242444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:39.242448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:39.242451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:39.242455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:39.243169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:39.243185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:39.243195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:39.243197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:39.243200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:39.243203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:39.243658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:39.243671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:39.243679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:39.243683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:39.243689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:39.243694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:39.244968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:39.244986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:39.244992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:39.246606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:39.246612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:39.246617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:39.246620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:39.246628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392699246
2025-10-02T08:11:39.247083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:39.247106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:39.247112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:39.247115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:39.247117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:39.247120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:39.247644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:39.247656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:39.247663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:39.247667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:39.247670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:39.247674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:39.248342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:39.248360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.248446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392699248
2025-10-02T08:11:39.249268Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:39.249284Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:39.249290Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:39.249298Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:39.251576Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:39.251578Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:39.251580Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:39.251587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534104424969335:3371]
2025-10-02T08:11:39.251591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534104424969335:3371]
2025-10-02T08:11:39.251629Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:39.251634Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:39.251651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:39.251656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.251659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:39.251808Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:39.404248Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:39.407745Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:39.409572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:39.409606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1232 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4505eb-436d64ed-e0e7924b-352eead2_0
2025-10-02T08:11:39.409784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1232 sessionId: src_id|c4505eb-436d64ed-e0e7924b-352eead2_0 is DEAD
2025-10-02T08:11:39.409929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534104424969388:3998]
2025-10-02T08:11:39.411730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4505eb-436d64ed-e0e7924b-352eead2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:39.411748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4505eb-436d64ed-e0e7924b-352eead2_0] Write session will restart in 0.007778s
2025-10-02T08:11:39.411777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4505eb-436d64ed-e0e7924b-352eead2_0] Write session: Do CDS request
2025-10-02T08:11:39.411785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4505eb-436d64ed-e0e7924b-352eead2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:39.412950Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:39.425249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4505eb-436d64ed-e0e7924b-352eead2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:39.429269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:39.429296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1233
2025-10-02T08:11:39.430574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:39.430624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:39.430631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:39.430638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:39.431197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1233 sessionId:  describe result for acl check
2025-10-02T08:11:39.431247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:39.431248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:39.431250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:39.431256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534104424969705:3309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:39.431781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534104424969705:3309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:39.461997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534104424969705:3309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:39.480003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534104424969705:3309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:39.480026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534104424969705:3309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:39.480030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534104424969705:3309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:39.480040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:39.488112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:39.488273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:39.488687Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:39.488690Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:39.488698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:39.488732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:39.488761Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534104424970174:3308]
2025-10-02T08:11:39.489345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:39.491184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:39.491249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:39.491569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:39.491637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.491638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.491639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.491641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.491642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.491647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.491655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.491658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.491662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.491665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.491671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.491677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.491683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.491687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.491690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.491695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.491699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.491703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.491706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.491710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.491729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:39.502429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:39.504141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:39.504165Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:39.504168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:39.504172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:39.504179Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1232 [1:7556534104424970174:3308]
2025-10-02T08:11:39.504193Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:39.504213Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:39.504217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.504220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.504222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.504239Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:39.504244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:39.504252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:39.504329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.504332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.504335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:39.504337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:39.504406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:39.504408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.504423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.504434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:39.504452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534104424970167:3308]
2025-10-02T08:11:39.504454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534104424970167:3308]
2025-10-02T08:11:39.504463Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:39.504476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:39.504489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:39.504491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:39.504529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534104424970167:3308]
2025-10-02T08:11:39.504531Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:39.505896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1232
2025-10-02T08:11:39.504777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:39.504786Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:39.504792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:39.505382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1232
2025-10-02T08:11:39.505397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534104424970144:3309], now have 1 active actors on pipe
2025-10-02T08:11:39.505401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534104884905615:2378], now have 1 active actors on pipe
2025-10-02T08:11:39.505491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.505503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.505534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:39.505543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.505548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.505550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:39.505562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.505578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:39.505597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:39.507582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.507600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.507642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:39.507692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1233 partition: 0 MaxSeqNo: 17 sessionId: src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0
2025-10-02T08:11:39.508838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4505eb-436d64ed-e0e7924b-352eead2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:39.511601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534104424970211:3998]
2025-10-02T08:11:39.511749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0] Write session: try to update token
2025-10-02T08:11:39.511765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:39.511768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1232, pipe: [1:7556534104424970211:3998]
2025-10-02T08:11:39.511791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534104424970211:3998], now have 1 active actors on pipe
2025-10-02T08:11:39.529287Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:39.529309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:39.529313Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:39.529322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534104424970167:3308]
2025-10-02T08:11:39.529326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534104424970167:3308]
2025-10-02T08:11:39.529381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:39.529394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.529397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:39.529403Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:39.529412Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:39.529560Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:39.540863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId: src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:39.543723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:39.702267Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:39.702809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.702818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.704116Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:39.705483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:39.705492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0] Write session will restart in 0.006120s
2025-10-02T08:11:39.705515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0] Write session: Do CDS request
2025-10-02T08:11:39.705520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:39.704368Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:39.704948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534104424970211:3998]
2025-10-02T08:11:39.704983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:39.705038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1233 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0
2025-10-02T08:11:39.705216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1233 sessionId: src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0 is DEAD
2025-10-02T08:11:39.712884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:39.713318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:39.713334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1234
2025-10-02T08:11:39.713686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:39.713717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:39.713722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:39.713725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:39.714876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1234 sessionId:  describe result for acl check
2025-10-02T08:11:39.714907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:39.714909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:39.714910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:39.714916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534104424970278:3319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:39.715402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:39.715518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534104424970278:3319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:39.716278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:39.716466Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:39.716470Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:39.716480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:39.716524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:39.716579Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534104424970297:3315]
2025-10-02T08:11:39.717183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:39.717394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:39.717435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:39.717694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:39.717727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.717730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.717731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.717732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.717733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.717737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.717745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.717748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.717751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.717754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.717758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.717764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.717769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.717779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.717783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.717788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.717791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.717795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.717799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.717805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.717823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:39.718282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534104424970278:3319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:39.724572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534104424970278:3319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:39.724588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534104424970278:3319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:39.724592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534104424970278:3319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:39.724601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:39.727537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:39.729169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:39.729175Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:39.729177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:39.729181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:39.729187Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1233 [1:7556534104424970297:3315]
2025-10-02T08:11:39.729198Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:39.729214Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:39.729217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.729221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.729222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.729241Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:39.729245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:39.729251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:39.729309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.729311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.729314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:39.729317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:39.729381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:39.729384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.729397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.729407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:39.729424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534104424970276:3315]
2025-10-02T08:11:39.729426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534104424970276:3315]
2025-10-02T08:11:39.729438Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:39.729450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:39.729462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:39.729466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:39.729500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534104424970276:3315]
2025-10-02T08:11:39.729502Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:39.729700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:39.729712Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:39.729717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:39.730567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1233
2025-10-02T08:11:39.730578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534104424970328:3319], now have 1 active actors on pipe
2025-10-02T08:11:39.730582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534104884905624:2378], now have 1 active actors on pipe
2025-10-02T08:11:39.730849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.730854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.730885Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8419b57-dada5bfa-8688168f-b5db1397_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:39.730893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.730899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.730901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:39.730911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.730922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:39.730939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:39.731468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46bad0-ab089a51-d1bdc247-c3e4eff8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c8419b57-dada5bfa-8688168f-b5db1397_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:39.730729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1233
2025-10-02T08:11:39.731083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.731091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.731108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:39.731138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1234 partition: 0 MaxSeqNo: 17 sessionId: src_id|c8419b57-dada5bfa-8688168f-b5db1397_0
2025-10-02T08:11:39.734097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8419b57-dada5bfa-8688168f-b5db1397_0] Write session: try to update token
2025-10-02T08:11:39.734113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8419b57-dada5bfa-8688168f-b5db1397_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:39.751508Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:39.751530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:39.751532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:39.751542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534104424970276:3315]
2025-10-02T08:11:39.751547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534104424970276:3315]
2025-10-02T08:11:39.751598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:39.751603Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:39.751607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.751612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:39.751622Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:39.751775Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:39.754074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId: src_id|c8419b57-dada5bfa-8688168f-b5db1397_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:39.756927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:39.805022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534104424970342:3998]
2025-10-02T08:11:39.805246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1233, pipe: [1:7556534104424970342:3998]
2025-10-02T08:11:39.904162Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:39.904562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.904579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.904621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534104424970342:3998], now have 1 active actors on pipe
2025-10-02T08:11:39.905840Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:39.906094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:39.906151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1234 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8419b57-dada5bfa-8688168f-b5db1397_0
2025-10-02T08:11:39.906323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1234 sessionId: src_id|c8419b57-dada5bfa-8688168f-b5db1397_0 is DEAD
2025-10-02T08:11:39.906456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534104424970342:3998]
2025-10-02T08:11:39.907024Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:39.909125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8419b57-dada5bfa-8688168f-b5db1397_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:39.909137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8419b57-dada5bfa-8688168f-b5db1397_0] Write session will restart in 0.005999s
2025-10-02T08:11:39.909162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8419b57-dada5bfa-8688168f-b5db1397_0] Write session: Do CDS request
2025-10-02T08:11:39.909169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8419b57-dada5bfa-8688168f-b5db1397_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:39.914182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:39.915169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:39.915333Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:39.915346Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:39.915355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:39.915399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:39.915432Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534104424970402:3311]
2025-10-02T08:11:39.915872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:39.916290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8419b57-dada5bfa-8688168f-b5db1397_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:39.916450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:39.916464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1235
2025-10-02T08:11:39.916590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:39.916617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:39.916629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:39.916638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:39.916973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:39.917036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:39.917053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1235 sessionId:  describe result for acl check
2025-10-02T08:11:39.917090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:39.917098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:39.917100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:39.917105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534104424970412:3304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:39.917471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:39.917530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.917536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.917538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.917539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.917540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.917547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.917556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.917560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.917563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.917567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.917573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.917581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:39.917586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.917591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:39.917593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534104424970412:3304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:39.917596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.917600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:39.917604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.917609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.917613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.917618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.917635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:39.919927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534104424970412:3304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:39.925410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534104424970412:3304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:39.925431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534104424970412:3304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:39.925436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534104424970412:3304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:39.925445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:39.926105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:39.927657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:39.927673Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:39.927675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:39.927678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:39.927684Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1234 [1:7556534104424970402:3311]
2025-10-02T08:11:39.927697Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:39.927714Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:39.927717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.927720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.927723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.927738Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:39.927747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:39.927755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:39.927814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.927823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.927826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:39.927828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:39.927884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:39.927890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.927898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:39.927905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:39.927923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534104424970449:3304], now have 1 active actors on pipe
2025-10-02T08:11:39.927933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534104424970396:3311]
2025-10-02T08:11:39.927934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534104424970396:3311]
2025-10-02T08:11:39.927939Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:39.927959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1234
2025-10-02T08:11:39.927961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:39.927962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:39.927964Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:39.927972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:39.927975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:39.927980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534104884905630:2378], now have 1 active actors on pipe
2025-10-02T08:11:39.927984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.927987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.928044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534104424970396:3311]
2025-10-02T08:11:39.928053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:39.928074Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:39.928075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:39.928085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:39.928088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:39.928091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:39.928099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:39.928111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:39.928021Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1234
2025-10-02T08:11:39.928151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:39.928218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:39.928232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:39.928256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:39.928294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1235 partition: 0 MaxSeqNo: 17 sessionId: src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0
2025-10-02T08:11:39.928625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8419b57-dada5bfa-8688168f-b5db1397_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:39.931436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0] Write session: try to update token
2025-10-02T08:11:39.931454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:39.952721Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:39.952738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:39.952740Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:39.952747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534104424970396:3311]
2025-10-02T08:11:39.952750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534104424970396:3311]
2025-10-02T08:11:39.952783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:39.952792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:39.952793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:39.952855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:39.952860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:39.952941Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:39.958984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId: src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:39.961587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:40.005754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534108719937761:3998]
2025-10-02T08:11:40.007759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1234, pipe: [1:7556534108719937761:3998]
2025-10-02T08:11:40.096484Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:40.096793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.096825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.096868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719937761:3998], now have 1 active actors on pipe
2025-10-02T08:11:40.096994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534108719937761:3998]
2025-10-02T08:11:40.097023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:40.097030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:40.097105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1235 reason: error at write: Disconnected sessionId: src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0
2025-10-02T08:11:40.097294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1235 sessionId: src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0 is DEAD
2025-10-02T08:11:40.097317Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:40.097707Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:40.101013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:40.101024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0] Write session will restart in 0.006660s
2025-10-02T08:11:40.101052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0] Write session: Do CDS request
2025-10-02T08:11:40.101059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:40.103321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:40.104147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:40.104383Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:40.104394Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:40.104404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:40.104471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:40.104514Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534108719937821:3288]
2025-10-02T08:11:40.105117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:40.105321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:40.105363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:40.105648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:40.105694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.105700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.105701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.105702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.105703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.105710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.105721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.105728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.105732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.105736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.105741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.105752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.105762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.105766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.105771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.105777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.105787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.105792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.105796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.105801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.105820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:40.113232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:40.114014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:40.115562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:40.115579Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:40.115582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:40.115587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:40.115593Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1235 [1:7556534108719937821:3288]
2025-10-02T08:11:40.115604Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:40.115621Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:40.115624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:40.115626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:40.115632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:40.115649Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:40.115654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:40.115660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:40.115721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.115729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.115732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:40.115735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:40.115802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:40.115808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.115821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.115837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:40.115857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534108719937815:3288]
2025-10-02T08:11:40.115863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534108719937815:3288]
2025-10-02T08:11:40.115873Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:40.115887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:40.115890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534109179872946:2378], now have 1 active actors on pipe
2025-10-02T08:11:40.115899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:40.115899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:40.115913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:40.115919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:40.115965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534108719937815:3288]
2025-10-02T08:11:40.115975Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:40.115985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:40.115966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1235
2025-10-02T08:11:40.117026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:40.117051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1236
2025-10-02T08:11:40.117239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:40.117279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:40.117288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:40.117292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:40.118147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1236 sessionId:  describe result for acl check
2025-10-02T08:11:40.118192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:40.118194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:40.118195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:40.118200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534108719937857:3290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:40.118732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534108719937857:3290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:40.120838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534108719937857:3290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:40.125629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534108719937857:3290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:40.125648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534108719937857:3290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:40.125652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534108719937857:3290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:40.125661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:40.126045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1235
2025-10-02T08:11:40.126381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719937890:3290], now have 1 active actors on pipe
2025-10-02T08:11:40.126388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.126395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.126413Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:40.126415Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:40.126422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534108719937815:3288]
2025-10-02T08:11:40.126453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:40.126469Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:40.126478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:40.126482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:40.126484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:40.126495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:40.126509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:40.126526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:40.126700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:40.126840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:40.126975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:40.127107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:40.127303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:40.127336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:40.127361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:40.127432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.127437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.127454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:40.127511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1236 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0
2025-10-02T08:11:40.128904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81366c79-dfe3580-35aa462d-53f2d2f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:40.132131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0] Write session: try to update token
2025-10-02T08:11:40.132149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:40.143549Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:40.143574Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:40.143577Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:40.143588Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534108719937815:3288]
2025-10-02T08:11:40.143596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534108719937815:3288]
2025-10-02T08:11:40.143646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:40.143654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.143656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:40.143856Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:40.144870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:40.144877Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:40.162969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId: src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:40.166034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:40.206479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534108719937913:3998]
2025-10-02T08:11:40.207802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1235, pipe: [1:7556534108719937913:3998]
2025-10-02T08:11:40.301755Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:40.302220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.302238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.302260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719937913:3998], now have 1 active actors on pipe
2025-10-02T08:11:40.302427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:40.302445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:40.302486Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:40.302524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1236 reason: error at write: Disconnected sessionId: src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0
2025-10-02T08:11:40.302708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1236 sessionId: src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0 is DEAD
2025-10-02T08:11:40.302771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534108719937913:3998]
2025-10-02T08:11:40.304941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:40.307844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:40.307856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0] Write session will restart in 0.009097s
2025-10-02T08:11:40.307885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0] Write session: Do CDS request
2025-10-02T08:11:40.307892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:40.313804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:40.315499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:40.315706Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:40.315709Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:40.315720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:40.315775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:40.315815Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534108719937998:3243]
2025-10-02T08:11:40.316512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:40.316714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:40.316757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:40.317106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:40.317143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.317144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.317145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.317146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.317147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.317153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.317163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.317168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.317175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.317179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.317185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.317193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.317199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.317204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.317209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.317215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.317219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.317225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.317229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.317235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.317256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:40.321326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:40.321528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:40.321553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1237
2025-10-02T08:11:40.321736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:40.321812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:40.321824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:40.321837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:40.322409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1237 sessionId:  describe result for acl check
2025-10-02T08:11:40.322461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:40.322468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:40.322480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:40.322486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534108719938014:3238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:40.323002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534108719938014:3238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:40.331278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534108719938014:3238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:40.341028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534108719938014:3238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:40.341053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534108719938014:3238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:40.341057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534108719938014:3238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:40.341068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:40.341656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:40.343633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:40.343652Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:40.343655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:40.343659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:40.343664Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1236 [1:7556534108719937998:3243]
2025-10-02T08:11:40.343676Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:40.343693Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:40.343697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:40.343700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:40.343702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:40.343718Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:40.343725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:40.343732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:40.343793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.343801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.343804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:40.343806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:40.343875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:40.343889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.343907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.343927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:40.343966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719938045:3238], now have 1 active actors on pipe
2025-10-02T08:11:40.343976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534108719937992:3243]
2025-10-02T08:11:40.343979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534108719937992:3243]
2025-10-02T08:11:40.343986Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:40.344000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534109179872974:2378], now have 1 active actors on pipe
2025-10-02T08:11:40.344012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:40.344030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:40.344037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:40.344071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534108719937992:3243]
2025-10-02T08:11:40.344077Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:40.344094Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:40.344105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:40.344112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:40.344125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1236
2025-10-02T08:11:40.344587Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1236
2025-10-02T08:11:40.344918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.344933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.344965Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:40.344973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:40.344982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:40.344985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:40.344995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:40.345013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:40.345035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:40.345068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.345074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.345087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:40.345127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1237 partition: 0 MaxSeqNo: 17 sessionId: src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0
2025-10-02T08:11:40.348921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b69b5ed-c93f1711-9dfaecfd-de7a7e33_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:40.351876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0] Write session: try to update token
2025-10-02T08:11:40.351896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:40.369857Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:40.369880Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:40.369883Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:40.369893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534108719937992:3243]
2025-10-02T08:11:40.369897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534108719937992:3243]
2025-10-02T08:11:40.369943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:40.369951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.369953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:40.370104Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:40.373633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:40.373639Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:40.377918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId: src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:40.381184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:40.404688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534108719938059:3998]
2025-10-02T08:11:40.406790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1236, pipe: [1:7556534108719938059:3998]
2025-10-02T08:11:40.596138Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:40.605342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.605368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.605416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719938059:3998], now have 1 active actors on pipe
2025-10-02T08:11:40.606242Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:40.606562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:40.606626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1237 reason: status is not ok: tablet will be restarted right now sessionId: src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0
2025-10-02T08:11:40.606825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1237 sessionId: src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0 is DEAD
2025-10-02T08:11:40.607031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534108719938059:3998]
2025-10-02T08:11:40.609055Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:40.611649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:40.611662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0] Write session will restart in 0.008862s
2025-10-02T08:11:40.611696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0] Write session: Do CDS request
2025-10-02T08:11:40.611704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:40.618179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:40.618579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:40.618791Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:40.618802Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:40.618813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:40.618865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:40.618913Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534108719938130:3218]
2025-10-02T08:11:40.619617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:40.621248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:40.621309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:40.621696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:40.621748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.621749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.621750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.621751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.621752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.621760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.621771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.621775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.621779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.621782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.621789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.621797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.621804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.621809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.621816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.621821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.621826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.621831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.621837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.621843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.621866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:40.629268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:40.629658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:40.629678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1238
2025-10-02T08:11:40.632956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:40.633029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:40.633036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:40.633042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:40.633617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1238 sessionId:  describe result for acl check
2025-10-02T08:11:40.633650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:40.633652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:40.633655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:40.633661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534108719938147:3229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:40.634219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534108719938147:3229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:40.637672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534108719938147:3229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:40.639647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:40.641304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:40.641312Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:40.641315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:40.641319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:40.641328Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1237 [1:7556534108719938130:3218]
2025-10-02T08:11:40.641340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:40.641362Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:40.641366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:40.641369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:40.641371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:40.641388Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:40.641393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:40.641399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:40.641478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.641481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.641484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:40.641486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:40.641565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:40.641568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.641583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.641596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:40.641613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534108719938124:3218]
2025-10-02T08:11:40.641615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534108719938124:3218]
2025-10-02T08:11:40.641622Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:40.641637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:40.641655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:40.641658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:40.641694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534108719938124:3218]
2025-10-02T08:11:40.641696Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:40.642523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:40.642535Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:40.642541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:40.643649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534109179872984:2378], now have 1 active actors on pipe
2025-10-02T08:11:40.643738Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1237
2025-10-02T08:11:40.658951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534108719938147:3229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:40.658974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534108719938147:3229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:40.658980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534108719938147:3229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:40.658990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:40.659861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1237
2025-10-02T08:11:40.659880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719938189:3229], now have 1 active actors on pipe
2025-10-02T08:11:40.659941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.659969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.660000Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:40.660010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:40.660015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:40.660019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:40.660032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:40.660051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:40.660074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:40.660199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.660202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.660220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:40.660247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1238 partition: 0 MaxSeqNo: 17 sessionId: src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0
2025-10-02T08:11:40.664949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20625e39-2c4531f3-67b994e5-f6025bf0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:40.668383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0] Write session: try to update token
2025-10-02T08:11:40.668406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:40.676448Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:40.676473Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:40.676476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:40.676487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534108719938124:3218]
2025-10-02T08:11:40.676492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534108719938124:3218]
2025-10-02T08:11:40.676538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:40.676548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.676551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:40.676707Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:40.679045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:40.679068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:40.708921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534108719938199:3998]
2025-10-02T08:11:40.716783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1237, pipe: [1:7556534108719938199:3998]
2025-10-02T08:11:40.719166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId: src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:40.722764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:40.846894Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:40.844980Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:40.845291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719938199:3998], now have 1 active actors on pipe
2025-10-02T08:11:40.845300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.845308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.846215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534108719938199:3998]
2025-10-02T08:11:40.846385Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:40.846661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:40.846713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1238 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0
2025-10-02T08:11:40.846894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1238 sessionId: src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0 is DEAD
2025-10-02T08:11:40.849104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:40.849122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0] Write session will restart in 0.008771s
2025-10-02T08:11:40.849154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0] Write session: Do CDS request
2025-10-02T08:11:40.849162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:40.856060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:40.856365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:40.856514Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:40.856517Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:40.856527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:40.856574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:40.856614Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534108719938267:3214]
2025-10-02T08:11:40.857243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:40.857776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:40.857807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:40.858141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:40.858182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.858183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.858184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.858185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.858189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.858194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.858204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.858207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.858211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.858215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.858222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.858229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:40.858233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.858238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:40.858241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.858243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:40.858248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.858250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.858252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.858255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.858266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:40.861359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:40.861771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:40.861787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1239
2025-10-02T08:11:40.861949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:40.861979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:40.861984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:40.861988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:40.862522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1239 sessionId:  describe result for acl check
2025-10-02T08:11:40.862549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:40.862550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:40.862552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:40.862558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534108719938283:3205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:40.863131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534108719938283:3205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:40.867031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534108719938283:3205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:40.867439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:40.869657Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1238
2025-10-02T08:11:40.869100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:40.869114Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:40.869116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:40.869118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:40.869123Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1238 [1:7556534108719938267:3214]
2025-10-02T08:11:40.869133Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:40.869146Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:40.869148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:40.869150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:40.869153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:40.869165Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:40.869168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:40.869173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:40.869223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.869224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.869227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:40.869228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:40.869288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:40.869290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.869302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:40.869313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:40.869330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534108719938261:3214]
2025-10-02T08:11:40.869331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534108719938261:3214]
2025-10-02T08:11:40.869337Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:40.869352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:40.869363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:40.869366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:40.869398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534108719938261:3214]
2025-10-02T08:11:40.869400Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:40.869422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:40.869423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534109179872990:2378], now have 1 active actors on pipe
2025-10-02T08:11:40.869424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:40.869429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:40.877841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534108719938283:3205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:40.877862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534108719938283:3205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:40.877865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534108719938283:3205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:40.877874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:40.879694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1238
2025-10-02T08:11:40.879709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719938322:3205], now have 1 active actors on pipe
2025-10-02T08:11:40.879717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.879724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.879752Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:40.879763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:40.879767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:40.879770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:40.879784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:40.879800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:40.879818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:40.880512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:40.880518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:40.880540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:40.880575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1239 partition: 0 MaxSeqNo: 17 sessionId: src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0
2025-10-02T08:11:40.881430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8fedccf-9c1c74a1-6f6a47f2-2a478a0e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:40.885824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0] Write session: try to update token
2025-10-02T08:11:40.885851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:40.889820Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:40.889841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:40.889843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:40.889852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534108719938261:3214]
2025-10-02T08:11:40.889856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534108719938261:3214]
2025-10-02T08:11:40.889900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:40.889906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:40.889908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:40.890058Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:40.890064Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:40.890070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:40.933194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId: src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:40.935745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:40.945752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534108719938328:3998]
2025-10-02T08:11:40.946010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1238, pipe: [1:7556534108719938328:3998]
2025-10-02T08:11:41.046109Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:41.046492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.046501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.046524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534108719938328:3998], now have 1 active actors on pipe
2025-10-02T08:11:41.047309Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:41.047610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:41.047671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1239 reason: status is not ok: tablet will be restarted right now sessionId: src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0
2025-10-02T08:11:41.047870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1239 sessionId: src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0 is DEAD
2025-10-02T08:11:41.048029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534108719938328:3998]
2025-10-02T08:11:41.049019Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:41.049094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:41.049114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0] Write session will restart in 0.009715s
2025-10-02T08:11:41.049147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0] Write session: Do CDS request
2025-10-02T08:11:41.049155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:41.061354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:41.065717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:41.065733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1240
2025-10-02T08:11:41.066116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:41.066465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:41.066632Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:41.066636Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:41.066646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:41.066686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:41.066723Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534113014905694:3192]
2025-10-02T08:11:41.067447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:41.067703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:41.067739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:41.068071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:41.068110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.068111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.068112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.068113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.068114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.068120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.068131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.068135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.068140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.068144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.068149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.068157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.068163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.068168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.068172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.068177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.068182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.068187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.068193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.068200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.068219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:41.074338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:41.074397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:41.074403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:41.074409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:41.075005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1240 sessionId:  describe result for acl check
2025-10-02T08:11:41.075043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:41.075045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:41.075047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:41.075052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534113014905710:3195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:41.075640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534113014905710:3195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:41.081271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:41.083007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:41.083015Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:41.083018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:41.083021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:41.083027Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1239 [1:7556534113014905694:3192]
2025-10-02T08:11:41.083041Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:41.083058Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:41.083061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:41.083065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:41.083067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:41.083084Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:41.083089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:41.083096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:41.083159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.083161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.083164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:41.083168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:41.083230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:41.083233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.083248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.083260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:41.083277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534113014905687:3192]
2025-10-02T08:11:41.083279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534113014905687:3192]
2025-10-02T08:11:41.083287Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:41.083300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:41.083315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:41.083318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:41.083352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534113014905687:3192]
2025-10-02T08:11:41.083354Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:41.084907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1239
2025-10-02T08:11:41.084075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:41.084086Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:41.084093Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:41.085281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534113474840307:2378], now have 1 active actors on pipe
2025-10-02T08:11:41.086743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534113014905710:3195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:41.097264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534113014905710:3195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:41.097285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534113014905710:3195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:41.097288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534113014905710:3195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:41.097297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:41.100953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1239
2025-10-02T08:11:41.100954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534113014905750:3195], now have 1 active actors on pipe
2025-10-02T08:11:41.101035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.101054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.101096Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57548834-a31cacb8-d1712f5a-7af43df8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:41.101117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:41.101132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:41.101135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:41.101151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:41.101179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:41.101210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:41.101270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.101278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.101295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:41.101345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1240 partition: 0 MaxSeqNo: 17 sessionId: src_id|57548834-a31cacb8-d1712f5a-7af43df8_0
2025-10-02T08:11:41.101972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48ad4400-d18f968f-7a6f495e-10ac2081_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|57548834-a31cacb8-d1712f5a-7af43df8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:41.105513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57548834-a31cacb8-d1712f5a-7af43df8_0] Write session: try to update token
2025-10-02T08:11:41.105541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57548834-a31cacb8-d1712f5a-7af43df8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:41.108605Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:41.108626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:41.108629Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:41.108638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534113014905687:3192]
2025-10-02T08:11:41.108642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534113014905687:3192]
2025-10-02T08:11:41.108698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:41.108708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.108711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:41.108892Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:41.108905Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:41.108911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:41.133899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId: src_id|57548834-a31cacb8-d1712f5a-7af43df8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:41.137360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:41.147736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534113014905768:3998]
2025-10-02T08:11:41.148097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1239, pipe: [1:7556534113014905768:3998]
2025-10-02T08:11:41.280279Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:41.285524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.285547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.285570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534113014905768:3998], now have 1 active actors on pipe
2025-10-02T08:11:41.286435Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:41.286715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:41.286766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1240 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57548834-a31cacb8-d1712f5a-7af43df8_0
2025-10-02T08:11:41.286938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1240 sessionId: src_id|57548834-a31cacb8-d1712f5a-7af43df8_0 is DEAD
2025-10-02T08:11:41.287057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534113014905768:3998]
2025-10-02T08:11:41.287777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57548834-a31cacb8-d1712f5a-7af43df8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:41.287785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57548834-a31cacb8-d1712f5a-7af43df8_0] Write session will restart in 0.005710s
2025-10-02T08:11:41.287809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57548834-a31cacb8-d1712f5a-7af43df8_0] Write session: Do CDS request
2025-10-02T08:11:41.287821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57548834-a31cacb8-d1712f5a-7af43df8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:41.288325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:41.296543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57548834-a31cacb8-d1712f5a-7af43df8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:41.296862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:41.296880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1241
2025-10-02T08:11:41.297066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:41.297103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:41.297109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:41.297112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:41.297776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1241 sessionId:  describe result for acl check
2025-10-02T08:11:41.297806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:41.297808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:41.297809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:41.297814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534113014905805:3178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:41.298296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534113014905805:3178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:41.308482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:41.308639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:41.308821Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:41.308824Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:41.308835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:41.308876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:41.308908Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534113014905877:3177]
2025-10-02T08:11:41.309524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:41.310066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:41.310098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:41.310414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:41.310445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.310446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.310447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.310448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.310449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.310453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.310462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.310465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.310469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.310472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.310477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.310483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.310488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.310494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.310497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.310501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.310504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.310508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.310512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.310516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.310533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:41.311042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534113014905805:3178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:41.321490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534113014905805:3178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:41.321510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534113014905805:3178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:41.321522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534113014905805:3178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:41.321533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:41.327788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:41.330360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1240
2025-10-02T08:11:41.329826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:41.329847Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:41.329850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:41.329853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:41.329859Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1240 [1:7556534113014905877:3177]
2025-10-02T08:11:41.329870Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:41.329885Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:41.329888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:41.329890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:41.329892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:41.329913Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:41.329918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:41.329924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:41.329986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.329987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.329990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:41.329992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:41.330063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:41.330065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.330078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.330087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:41.330106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534113014905903:3178], now have 1 active actors on pipe
2025-10-02T08:11:41.330113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534113014905871:3177]
2025-10-02T08:11:41.330114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534113014905871:3177]
2025-10-02T08:11:41.330123Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:41.330131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534113474840327:2378], now have 1 active actors on pipe
2025-10-02T08:11:41.330134Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:41.330138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:41.330139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:41.330152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:41.330155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:41.330190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534113014905871:3177]
2025-10-02T08:11:41.330200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:41.330204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:41.330368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1240
2025-10-02T08:11:41.330499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.330506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.330534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:41.330543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:41.330546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:41.330548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:41.330557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:41.330568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:41.330583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:41.330794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.330798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.330814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:41.331136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1241 partition: 0 MaxSeqNo: 17 sessionId: src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0
2025-10-02T08:11:41.332074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57548834-a31cacb8-d1712f5a-7af43df8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:41.335648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0] Write session: try to update token
2025-10-02T08:11:41.335666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:41.357006Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:41.357027Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:41.357031Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:41.357039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534113014905871:3177]
2025-10-02T08:11:41.357043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534113014905871:3177]
2025-10-02T08:11:41.357087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:41.357094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.357096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:41.357254Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:41.360842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId: src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:41.363809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:41.368900Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:41.368917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:41.387314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534113014905942:3998]
2025-10-02T08:11:41.392100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1240, pipe: [1:7556534113014905942:3998]
2025-10-02T08:11:41.665293Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:41.666060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.666070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.666113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534113014905942:3998], now have 1 active actors on pipe
2025-10-02T08:11:41.667742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:41.673550Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:41.673879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534113014905942:3998]
2025-10-02T08:11:41.673901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:41.673963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0
2025-10-02T08:11:41.674172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1241 sessionId: src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0 is DEAD
2025-10-02T08:11:41.676791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:41.676821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0] Write session will restart in 0.005473s
2025-10-02T08:11:41.676854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0] Write session: Do CDS request
2025-10-02T08:11:41.676862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:41.687015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:41.696894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:41.696912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1242
2025-10-02T08:11:41.697347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:41.697385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:41.697392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:41.697396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:41.702253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1242 sessionId:  describe result for acl check
2025-10-02T08:11:41.702305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:41.702307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:41.702309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:41.702315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534113014906014:3144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:41.702861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534113014906014:3144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:41.713660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534113014906014:3144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:41.714810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:41.720999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:41.721264Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:41.721268Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:41.721279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:41.721341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:41.721380Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534113014906060:3138]
2025-10-02T08:11:41.722105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:41.722563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:41.722616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:41.722956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:41.723002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.723003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.723004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.723006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.723007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.723013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.723024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.723028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.723032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.723036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.723043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.723050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.723057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.723062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.723067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.723072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.723077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.723082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.723086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.723092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.723114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:41.739464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:41.741289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:41.741308Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:41.741311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:41.741315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:41.741324Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1241 [1:7556534113014906060:3138]
2025-10-02T08:11:41.741336Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:41.741358Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:41.741361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:41.741364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:41.741366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:41.741386Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:41.741391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:41.741397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:41.741467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.741470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.741474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:41.741476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:41.741543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:41.741545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.741561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.741573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:41.741590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534113014906044:3138]
2025-10-02T08:11:41.741592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534113014906044:3138]
2025-10-02T08:11:41.741600Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:41.741612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:41.741624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:41.741627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:41.741666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534113014906044:3138]
2025-10-02T08:11:41.741667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:41.741895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:41.741902Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:41.741908Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:41.742766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534113014906014:3144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:41.742773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534113014906014:3144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:41.742777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534113014906014:3144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:41.742785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:41.742889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534113474840346:2378], now have 1 active actors on pipe
2025-10-02T08:11:41.744990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1241
2025-10-02T08:11:41.745005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534113014906082:3144], now have 1 active actors on pipe
2025-10-02T08:11:41.745297Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1241
2025-10-02T08:11:41.745374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.745384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.745413Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:41.745422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:41.745426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:41.745429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:41.745441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:41.745456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:41.745475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:41.745512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.745515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.745536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:41.745567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1242 partition: 0 MaxSeqNo: 17 sessionId: src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0
2025-10-02T08:11:41.749578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d4c03d-39fc83f2-54a11b97-5904dc87_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:41.752681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0] Write session: try to update token
2025-10-02T08:11:41.752702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:41.772873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534113014906088:3998]
2025-10-02T08:11:41.773151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1241, pipe: [1:7556534113014906088:3998]
2025-10-02T08:11:41.773170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534113014906088:3998], now have 1 active actors on pipe
2025-10-02T08:11:41.783380Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:41.783404Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:41.783407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:41.783417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534113014906044:3138]
2025-10-02T08:11:41.783421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534113014906044:3138]
2025-10-02T08:11:41.783468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:41.783476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.783479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:41.783638Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:41.784938Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:41.784952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:41.810155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId: src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:41.812981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:41.940359Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:41.940728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.940738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.941414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534113014906088:3998]
2025-10-02T08:11:41.941443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:41.941446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:41.942062Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:41.942464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1242 reason: error at write: Disconnected sessionId: src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0
2025-10-02T08:11:41.942800Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:41.942879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:41.942888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0] Write session will restart in 0.008725s
2025-10-02T08:11:41.942911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0] Write session: Do CDS request
2025-10-02T08:11:41.942918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:41.942632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1242 sessionId: src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0 is DEAD
2025-10-02T08:11:41.953338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:41.953448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:41.953464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1243
2025-10-02T08:11:41.953627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:41.953663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:41.953668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:41.953671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:41.954356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1243 sessionId:  describe result for acl check
2025-10-02T08:11:41.954385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:41.954386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:41.954388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:41.954392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534113014906153:3122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:41.954751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534113014906153:3122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:41.956202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:41.958348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:41.958359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534113014906153:3122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:41.958504Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:41.958511Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:41.958519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:41.958551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:41.958579Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534113014906188:3121]
2025-10-02T08:11:41.958997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:41.959262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:41.959291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:41.959495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:41.959525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.959525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.959526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.959527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.959528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.959533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.959540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.959543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.959545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.959547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.959550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.959555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:41.959558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.959561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:41.959564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.959567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:41.959569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.959572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.959576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.959578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.959590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:41.969703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534113014906153:3122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:41.969724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534113014906153:3122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:41.969727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534113014906153:3122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:41.969736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:41.970759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:41.972313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:41.972318Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:41.972321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:41.972325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:41.972330Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1242 [1:7556534113014906188:3121]
2025-10-02T08:11:41.972339Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:41.972354Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:41.972356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:41.972358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:41.972359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:41.972371Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:41.972375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:41.972381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:41.972430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.972431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.972433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:41.972435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:41.972500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:41.972503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.972516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:41.972526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:41.972542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534113014906177:3121]
2025-10-02T08:11:41.972544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534113014906177:3121]
2025-10-02T08:11:41.972550Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:41.972561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:41.972569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:41.972571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:41.972575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:41.972579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:41.972588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534113014906213:3122], now have 1 active actors on pipe
2025-10-02T08:11:41.972620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534113014906177:3121]
2025-10-02T08:11:41.972625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:41.972659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1242
2025-10-02T08:11:41.972736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:41.972898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534113474840354:2378], now have 1 active actors on pipe
2025-10-02T08:11:41.972910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.972915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.972941Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0d31498-978cdd46-3007736e-7cc52944_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:41.972949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:41.972954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:41.972956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:41.972966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:41.972977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:41.972992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:41.973024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:41.973025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:41.973036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:41.973069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1243 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0d31498-978cdd46-3007736e-7cc52944_0
2025-10-02T08:11:41.973572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38d09bd-cab763ab-3f1170e9-fc6f5c71_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0d31498-978cdd46-3007736e-7cc52944_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:41.976287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31498-978cdd46-3007736e-7cc52944_0] Write session: try to update token
2025-10-02T08:11:41.976307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31498-978cdd46-3007736e-7cc52944_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:41.976898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1242
2025-10-02T08:11:41.996205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:41.996223Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:41.996225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:41.996232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534113014906177:3121]
2025-10-02T08:11:41.996236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534113014906177:3121]
2025-10-02T08:11:41.996273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:41.996279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:41.996280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:41.996292Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:41.996300Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:41.996405Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:42.027376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId: src_id|a0d31498-978cdd46-3007736e-7cc52944_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:42.030049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:42.041576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534117309873525:3998]
2025-10-02T08:11:42.041782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1242, pipe: [1:7556534117309873525:3998]
2025-10-02T08:11:42.141132Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:42.141649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.141659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.141681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309873525:3998], now have 1 active actors on pipe
2025-10-02T08:11:42.145141Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:42.145494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534117309873525:3998]
2025-10-02T08:11:42.145514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:42.145574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1243 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0d31498-978cdd46-3007736e-7cc52944_0
2025-10-02T08:11:42.145745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1243 sessionId: src_id|a0d31498-978cdd46-3007736e-7cc52944_0 is DEAD
2025-10-02T08:11:42.145226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:42.148959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31498-978cdd46-3007736e-7cc52944_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:42.148972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31498-978cdd46-3007736e-7cc52944_0] Write session will restart in 0.006192s
2025-10-02T08:11:42.149014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31498-978cdd46-3007736e-7cc52944_0] Write session: Do CDS request
2025-10-02T08:11:42.149022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31498-978cdd46-3007736e-7cc52944_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:42.159013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31498-978cdd46-3007736e-7cc52944_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:42.159211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:42.159232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1244
2025-10-02T08:11:42.159379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:42.159412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:42.159418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:42.159432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:42.159813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1244 sessionId:  describe result for acl check
2025-10-02T08:11:42.159854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:42.159860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:42.159862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:42.159868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534117309873578:3113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:42.160460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534117309873578:3113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:42.164655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534117309873578:3113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:42.165892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:42.174965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:42.175201Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:42.175206Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:42.175216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:42.175267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:42.175305Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534117309873646:3108]
2025-10-02T08:11:42.176022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:42.176790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534117309873578:3113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:42.176826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534117309873578:3113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:42.176830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534117309873578:3113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:42.176840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:42.176965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:42.177010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:42.177322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:42.177356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.177358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.177359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.177361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.177362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.177368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.177378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.177382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.177386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.177390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.177395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.177403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.177411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.177417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.177421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.177427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.177431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.177437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.177442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.177447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.177466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:42.187026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:42.188635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:42.188655Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:42.188658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:42.188662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:42.188669Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1243 [1:7556534117309873646:3108]
2025-10-02T08:11:42.188682Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:42.188700Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:42.188703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.188707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.188712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.188730Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:42.188734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:42.188741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:42.188831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.188834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.188837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:42.188839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:42.188901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:42.188904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.188919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.188931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:42.188948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534117309873639:3108]
2025-10-02T08:11:42.188950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534117309873639:3108]
2025-10-02T08:11:42.188956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:42.188969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:42.188978Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:42.188981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:42.188983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:42.188986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:42.188995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309873655:3113], now have 1 active actors on pipe
2025-10-02T08:11:42.189032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534117769807671:2378], now have 1 active actors on pipe
2025-10-02T08:11:42.189035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534117309873639:3108]
2025-10-02T08:11:42.189037Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:42.189037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1243
2025-10-02T08:11:42.189185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:42.189207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.189212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.189243Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:42.189250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.189254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.189256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:42.189265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.189275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:42.189290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:42.189151Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1243
2025-10-02T08:11:42.189323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.189330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.189341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:42.189376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1244 partition: 0 MaxSeqNo: 17 sessionId: src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0
2025-10-02T08:11:42.189734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31498-978cdd46-3007736e-7cc52944_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:42.192279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0] Write session: try to update token
2025-10-02T08:11:42.192293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:42.206215Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:42.206238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:42.206248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534117309873639:3108]
2025-10-02T08:11:42.206291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:42.206470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:42.206653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:42.206793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:42.206932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:42.207127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:42.207167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:42.207333Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:42.213215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId: src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:42.216044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:42.216200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.216214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.216248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:42.216268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:42.216591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.216600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.216836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.216957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.217052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.217132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.217183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.217189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.217283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.217358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.217436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.217507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.217566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.217569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.217654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.217714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.217774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.217837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.217899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.217902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.217975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.218042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.218118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.218187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.218230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.218233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.218303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.218367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.218432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.218498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.218545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.218549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.218621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.218682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.218745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.218829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.218872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.218874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.218943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.219005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.219073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.219138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.219181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.219183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.219254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.219316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.219381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.219447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.219490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.219493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.219581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.219643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.219708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.219770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.219830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.219834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.219916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:42.219994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:42.220058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:42.220124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:42.220167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:42.220169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:42.220215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:42.220279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.220299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.220304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:42.220336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:42.220348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:42.220351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:42.220354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:42.220357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:42.220782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:42.220798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:42.221032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:42.221043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:42.221047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:42.221050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:42.221708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:42.221722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:42.221729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:42.221732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:42.221735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:42.221739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:42.222399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:42.222414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:42.222420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:42.222423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:42.222425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:42.224944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:42.224967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:42.224979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392702224
2025-10-02T08:11:42.225100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:42.225115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:42.225121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:42.225125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:42.225129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:42.225132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:42.225677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:42.225702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:42.225708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:42.225713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:42.225717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:42.225720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:42.226246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:42.226268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:42.226278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:42.226282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:42.226286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:42.226289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:42.226783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:42.226807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:42.226815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:42.227981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:42.227998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:42.228004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:42.228007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:42.228017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392702227
2025-10-02T08:11:42.228359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:42.228372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:42.228378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:42.228381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:42.228384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:42.228389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:42.228927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:42.228949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:42.228955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:42.228962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:42.228966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:42.228971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:42.229407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:42.229430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.229516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392702229
2025-10-02T08:11:42.233091Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:42.233112Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:42.233118Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:42.233124Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:42.234688Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:42.234703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:42.234705Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:42.234715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534117309873639:3108]
2025-10-02T08:11:42.234718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534117309873639:3108]
2025-10-02T08:11:42.234766Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:42.234774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:42.234776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:42.234781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.234783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:42.234933Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:42.248869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534117309873686:3998]
2025-10-02T08:11:42.249094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1243, pipe: [1:7556534117309873686:3998]
2025-10-02T08:11:42.388488Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:42.389472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309873686:3998], now have 1 active actors on pipe
2025-10-02T08:11:42.390835Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:42.390520Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:42.390949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534117309873686:3998]
2025-10-02T08:11:42.390969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:42.390997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1244 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0
2025-10-02T08:11:42.391325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:42.391336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0] Write session will restart in 0.007651s
2025-10-02T08:11:42.391360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0] Write session: Do CDS request
2025-10-02T08:11:42.391367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:42.391180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1244 sessionId: src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0 is DEAD
2025-10-02T08:11:42.400339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:42.400095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:42.400887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:42.400901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1245
2025-10-02T08:11:42.401063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:42.401090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:42.401095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:42.401098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:42.401572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1245 sessionId:  describe result for acl check
2025-10-02T08:11:42.401594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:42.401596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:42.401597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:42.401602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534117309873811:3088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:42.402020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:42.402060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534117309873811:3088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:42.402223Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:42.402227Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:42.402237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:42.402295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:42.402325Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534117309873817:3093]
2025-10-02T08:11:42.402881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:42.403104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:42.403149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:42.403476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:42.403514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.403515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.403517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.403520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.403521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.403527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.403536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.403539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.403543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.403546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.403551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.403558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.403563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.403568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.403573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.403577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.403580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.403585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.403591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.403595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.403612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:42.411133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534117309873811:3088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:42.413273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:42.414977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:42.414992Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:42.414994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:42.414997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:42.415001Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1244 [1:7556534117309873817:3093]
2025-10-02T08:11:42.415009Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:42.415022Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:42.415023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.415025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.415026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.415037Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:42.415040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:42.415045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:42.415089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.415095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.415097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:42.415099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:42.415156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:42.415163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.415176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.415190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:42.415209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534117309873803:3093]
2025-10-02T08:11:42.415215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534117309873803:3093]
2025-10-02T08:11:42.415222Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:42.415236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534117769807693:2378], now have 1 active actors on pipe
2025-10-02T08:11:42.415245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:42.415257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:42.415264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:42.415297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534117309873803:3093]
2025-10-02T08:11:42.415303Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:42.415333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:42.415341Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:42.415346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:42.415778Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1244
2025-10-02T08:11:42.421235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534117309873811:3088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:42.421253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534117309873811:3088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:42.421257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534117309873811:3088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:42.421266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:42.422516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fc1067-ac33563e-6902de95-4bbb39ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:42.421984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1244
2025-10-02T08:11:42.421996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309873865:3088], now have 1 active actors on pipe
2025-10-02T08:11:42.422002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.422007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.422038Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:42.422047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.422052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.422054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:42.422065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.422077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:42.422090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:42.422121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.422122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.422134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:42.422158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1245 partition: 0 MaxSeqNo: 17 sessionId: src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0
2025-10-02T08:11:42.425376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0] Write session: try to update token
2025-10-02T08:11:42.425398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:42.431105Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:42.431127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:42.431135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534117309873803:3093]
2025-10-02T08:11:42.431175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:42.431369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:42.431516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:42.431662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:42.431809Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:42.432019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:42.432051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:42.432266Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:42.452018Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:42.452039Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:42.452047Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:42.452056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534117309873803:3093]
2025-10-02T08:11:42.452059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534117309873803:3093]
2025-10-02T08:11:42.452097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:42.452102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.452104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:42.452253Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:42.456864Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:42.456893Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:42.470296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId: src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:42.474185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:42.495609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534117309873872:3998]
2025-10-02T08:11:42.496244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1244, pipe: [1:7556534117309873872:3998]
2025-10-02T08:11:42.632213Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:42.632915Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:42.632497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.632518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.632538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309873872:3998], now have 1 active actors on pipe
2025-10-02T08:11:42.632782Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:42.633081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:42.633139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1245 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0
2025-10-02T08:11:42.633325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1245 sessionId: src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0 is DEAD
2025-10-02T08:11:42.633501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:42.633486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534117309873872:3998]
2025-10-02T08:11:42.633516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0] Write session will restart in 0.007273s
2025-10-02T08:11:42.633562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0] Write session: Do CDS request
2025-10-02T08:11:42.633568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:42.642473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:42.645073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:42.645100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1246
2025-10-02T08:11:42.648718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:42.648959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:42.649016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:42.649021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:42.649024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:42.650018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1246 sessionId:  describe result for acl check
2025-10-02T08:11:42.650057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:42.650059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:42.650061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:42.650067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534117309873960:3077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:42.650748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:42.650926Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:42.650930Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:42.650938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:42.650977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:42.651010Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534117309873963:3074]
2025-10-02T08:11:42.651501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534117309873960:3077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:42.651667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:42.651937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:42.651985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:42.652296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:42.652334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.652341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.652342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.652343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.652345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.652351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.652364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.652368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.652372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.652375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.652379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.652386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.652391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.652396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.652401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.652406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.652410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.652414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.652418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.652422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.652439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:42.656941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534117309873960:3077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:42.664780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:42.664896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534117309873960:3077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:42.664913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534117309873960:3077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:42.664917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534117309873960:3077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:42.664927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:42.668082Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1245
2025-10-02T08:11:42.666616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:42.666639Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:42.666641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:42.666645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:42.666651Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1245 [1:7556534117309873963:3074]
2025-10-02T08:11:42.666664Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:42.666682Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:42.666686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.666689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.666692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.666713Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:42.666718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:42.666725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:42.666789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.666791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.666794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:42.666796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:42.666934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:42.666939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.666963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.666987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:42.667007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534117309873953:3074]
2025-10-02T08:11:42.667009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534117309873953:3074]
2025-10-02T08:11:42.667024Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:42.667038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:42.667051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:42.667054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:42.667091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534117309873953:3074]
2025-10-02T08:11:42.667094Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:42.667419Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:42.667422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:42.667431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:42.668234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1245
2025-10-02T08:11:42.668246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309874008:3077], now have 1 active actors on pipe
2025-10-02T08:11:42.668250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534117769807711:2378], now have 1 active actors on pipe
2025-10-02T08:11:42.668317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.668329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.668351Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:42.668360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.668364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.668366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:42.668376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.668388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:42.668404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:42.668480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.668485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.669059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52706a-95c04e8e-e3c67caa-cb92b070_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:42.668497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:42.668527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1246 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0
2025-10-02T08:11:42.671815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0] Write session: try to update token
2025-10-02T08:11:42.672110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:42.689198Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:42.689220Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:42.689223Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:42.689237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534117309873953:3074]
2025-10-02T08:11:42.689244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534117309873953:3074]
2025-10-02T08:11:42.689289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:42.689295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.689298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:42.689436Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:42.692865Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:42.692876Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:42.721066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId: src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:42.723906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:42.733850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534117309874026:3998]
2025-10-02T08:11:42.734695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1245, pipe: [1:7556534117309874026:3998]
2025-10-02T08:11:42.871401Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:42.871707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.871721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.871741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309874026:3998], now have 1 active actors on pipe
2025-10-02T08:11:42.872002Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:42.872073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:42.872974Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:42.872190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1246 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0
2025-10-02T08:11:42.872428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1246 sessionId: src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0 is DEAD
2025-10-02T08:11:42.872513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534117309874026:3998]
2025-10-02T08:11:42.873912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:42.873924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0] Write session will restart in 0.008414s
2025-10-02T08:11:42.873957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0] Write session: Do CDS request
2025-10-02T08:11:42.873963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:42.885084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:42.885239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:42.885380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:42.885416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1247
2025-10-02T08:11:42.885800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:42.885856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:42.885866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:42.885870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:42.887341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1247 sessionId:  describe result for acl check
2025-10-02T08:11:42.887383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:42.887385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:42.887387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:42.887393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534117309874118:3054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:42.887486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:42.887681Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:42.887692Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:42.887702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:42.887762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:42.887799Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534117309874120:3061]
2025-10-02T08:11:42.888425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:42.888999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:42.889053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:42.889374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:42.889441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.889448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.889449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.889450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.889451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.889457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.889466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.889469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.889472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.889475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.889480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.889488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:42.889493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.889497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:42.889501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.889505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:42.889509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.889513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.889517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.889520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.889539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:42.889567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534117309874118:3054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:42.892884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534117309874118:3054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:42.900067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534117309874118:3054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:42.900087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534117309874118:3054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:42.900090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534117309874118:3054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:42.900100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:42.903335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:42.904991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:42.905013Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:42.905016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:42.905023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:42.905030Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1246 [1:7556534117309874120:3061]
2025-10-02T08:11:42.905043Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:42.905059Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:42.905066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.905068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.905071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.905086Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:42.905091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:42.905097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:42.905163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.905165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.905169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:42.905171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:42.905237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:42.905240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.905256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:42.905268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:42.905284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534117309874110:3061]
2025-10-02T08:11:42.905286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534117309874110:3061]
2025-10-02T08:11:42.905292Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:42.905306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309874166:3054], now have 1 active actors on pipe
2025-10-02T08:11:42.905312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:42.905322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:42.905325Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:42.905329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:42.905331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:42.905370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534117769807723:2378], now have 1 active actors on pipe
2025-10-02T08:11:42.905372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534117309874110:3061]
2025-10-02T08:11:42.905375Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:42.905417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1246
2025-10-02T08:11:42.905468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:42.905814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.905821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.905849Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:42.905856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:42.905860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:42.905862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:42.905873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:42.905883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:42.905899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:42.905959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:42.905962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:42.905973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:42.906002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1247 partition: 0 MaxSeqNo: 17 sessionId: src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0
2025-10-02T08:11:42.906371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4ae4b5f-f0767673-20dbfe00-5c496a88_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:42.906431Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1246
2025-10-02T08:11:42.909191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0] Write session: try to update token
2025-10-02T08:11:42.909206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:42.928349Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:42.928373Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:42.928376Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:42.928385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534117309874110:3061]
2025-10-02T08:11:42.928390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534117309874110:3061]
2025-10-02T08:11:42.928434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:42.928440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:42.928443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:42.928585Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:42.929144Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:42.929149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:42.932164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId: src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:42.934771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:42.972812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534117309874179:3998]
2025-10-02T08:11:42.977015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1246, pipe: [1:7556534117309874179:3998]
2025-10-02T08:11:43.089702Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:43.090007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.090021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.090064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534117309874179:3998], now have 1 active actors on pipe
2025-10-02T08:11:43.091945Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:43.092181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:43.092247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534117309874179:3998]
2025-10-02T08:11:43.092255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1247 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0
2025-10-02T08:11:43.092423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1247 sessionId: src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0 is DEAD
2025-10-02T08:11:43.092905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:43.092914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0] Write session will restart in 0.005516s
2025-10-02T08:11:43.092936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0] Write session: Do CDS request
2025-10-02T08:11:43.092944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:43.092956Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:43.099692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.099749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:43.099762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1248
2025-10-02T08:11:43.100032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.100055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:43.100058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:43.100061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:43.100070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:43.101184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1248 sessionId:  describe result for acl check
2025-10-02T08:11:43.101228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:43.101229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:43.101230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:43.101235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534121604841562:3049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:43.101537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:43.101686Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:43.101689Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:43.101693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534121604841562:3049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:43.101696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:43.101731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:43.101755Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534121604841565:3041]
2025-10-02T08:11:43.102266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:43.102491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:43.102548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:43.102845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:43.102886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.102887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.102888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.102889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.102890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.102894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.102904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.102907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.102910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.102914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.102919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.102926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.102930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.102934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.102939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.102943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.102947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.102950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.102956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.102960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.102975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:43.112010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534121604841562:3049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:43.113009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:43.115085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:43.115092Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:43.115094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:43.115098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:43.115104Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1247 [1:7556534121604841565:3041]
2025-10-02T08:11:43.115115Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:43.115133Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:43.115136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.115139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.115143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.115163Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:43.115168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:43.115175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:43.115243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.115245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.115247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:43.115249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:43.115322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:43.115324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.115336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.115348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:43.115366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534121604841556:3041]
2025-10-02T08:11:43.115368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534121604841556:3041]
2025-10-02T08:11:43.115375Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:43.115390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:43.115402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:43.115404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:43.115443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534121604841556:3041]
2025-10-02T08:11:43.115445Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:43.115720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534122064775041:2378], now have 1 active actors on pipe
2025-10-02T08:11:43.115885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:43.115898Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:43.115903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:43.115896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1247
2025-10-02T08:11:43.116715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534121604841562:3049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:43.116733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534121604841562:3049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:43.116738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534121604841562:3049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:43.116747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:43.117023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1247
2025-10-02T08:11:43.117034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604841615:3049], now have 1 active actors on pipe
2025-10-02T08:11:43.117041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.117046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.117080Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d582a78-213e80df-f3686184-3a663efc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:43.117095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.117099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.117101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:43.117114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.117126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:43.117141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.117185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.117187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.117200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.117227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1248 partition: 0 MaxSeqNo: 17 sessionId: src_id|3d582a78-213e80df-f3686184-3a663efc_0
2025-10-02T08:11:43.117705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad81620-96876056-5f4e5c1c-19ce65b5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3d582a78-213e80df-f3686184-3a663efc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:43.121173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d582a78-213e80df-f3686184-3a663efc_0] Write session: try to update token
2025-10-02T08:11:43.121199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d582a78-213e80df-f3686184-3a663efc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:43.134809Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:43.134830Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:43.134832Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:43.134840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534121604841556:3041]
2025-10-02T08:11:43.134844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534121604841556:3041]
2025-10-02T08:11:43.134886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:43.134894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.134897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:43.135035Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:43.135636Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:43.135653Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:43.149435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId: src_id|3d582a78-213e80df-f3686184-3a663efc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:43.152485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:43.195507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534121604841636:3998]
2025-10-02T08:11:43.197280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1247, pipe: [1:7556534121604841636:3998]
2025-10-02T08:11:43.276181Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:43.276497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.276505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.276523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604841636:3998], now have 1 active actors on pipe
2025-10-02T08:11:43.277201Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:43.276749Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:43.277023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:43.277074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1248 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d582a78-213e80df-f3686184-3a663efc_0
2025-10-02T08:11:43.277252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1248 sessionId: src_id|3d582a78-213e80df-f3686184-3a663efc_0 is DEAD
2025-10-02T08:11:43.277410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534121604841636:3998]
2025-10-02T08:11:43.277497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d582a78-213e80df-f3686184-3a663efc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:43.277513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d582a78-213e80df-f3686184-3a663efc_0] Write session will restart in 0.007366s
2025-10-02T08:11:43.277540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d582a78-213e80df-f3686184-3a663efc_0] Write session: Do CDS request
2025-10-02T08:11:43.277548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d582a78-213e80df-f3686184-3a663efc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:43.288876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d582a78-213e80df-f3686184-3a663efc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.289568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:43.289597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1249
2025-10-02T08:11:43.289734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.289777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:43.289782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:43.289786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:43.291478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:43.291923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1249 sessionId:  describe result for acl check
2025-10-02T08:11:43.291966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:43.291968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:43.291969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:43.291974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534121604841724:3044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:43.292530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534121604841724:3044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:43.295929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:43.296213Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:43.296217Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:43.296228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:43.296289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:43.296328Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534121604841732:3046]
2025-10-02T08:11:43.297020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:43.297419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:43.297471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:43.297816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:43.297879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.297881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.297882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.297883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.297884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.297890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.297900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.297903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.297907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.297910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.297917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.297924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.297930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.297935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.297939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.297944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.297949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.297954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.297958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.297963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.297985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:43.306143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534121604841724:3044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:43.318131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534121604841724:3044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:43.318152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534121604841724:3044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:43.318156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534121604841724:3044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:43.318165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:43.318467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:43.320113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:43.320132Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:43.320138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:43.320145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:43.320152Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1248 [1:7556534121604841732:3046]
2025-10-02T08:11:43.320164Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:43.320181Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:43.320183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.320186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.320188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.320203Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:43.320209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:43.320215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:43.320279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.320288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.320291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:43.320293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:43.320364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:43.320371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.320379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1248
2025-10-02T08:11:43.320386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.320400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:43.320423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604841771:3044], now have 1 active actors on pipe
2025-10-02T08:11:43.320431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534122064775047:2378], now have 1 active actors on pipe
2025-10-02T08:11:43.320437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.320441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.320458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534121604841717:3046]
2025-10-02T08:11:43.320464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534121604841717:3046]
2025-10-02T08:11:43.320479Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:43.320496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:43.320500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:43.320503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:43.320515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:43.320522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:43.320490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1248
2025-10-02T08:11:43.320537Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:43.320547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.320550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.320552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:43.320559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.320569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:43.320602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534121604841717:3046]
2025-10-02T08:11:43.320614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:43.320628Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:43.320634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.320683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.320691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.320704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.320740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1249 partition: 0 MaxSeqNo: 17 sessionId: src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0
2025-10-02T08:11:43.321963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d582a78-213e80df-f3686184-3a663efc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:43.325110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0] Write session: try to update token
2025-10-02T08:11:43.325129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:43.344286Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:43.344311Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:43.344313Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:43.344323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534121604841717:3046]
2025-10-02T08:11:43.344330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534121604841717:3046]
2025-10-02T08:11:43.344374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:43.344375Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:43.344380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.344382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:43.344382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:43.344546Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:43.347606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId: src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:43.350288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:43.376881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534121604841787:3998]
2025-10-02T08:11:43.377042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1248, pipe: [1:7556534121604841787:3998]
2025-10-02T08:11:43.489723Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:43.490110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.490120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.490162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604841787:3998], now have 1 active actors on pipe
2025-10-02T08:11:43.491280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534121604841787:3998]
2025-10-02T08:11:43.491315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:43.491318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:43.491349Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:43.491392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1249 reason: error at write: Disconnected sessionId: src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0
2025-10-02T08:11:43.491575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1249 sessionId: src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0 is DEAD
2025-10-02T08:11:43.491939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:43.491966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0] Write session will restart in 0.009934s
2025-10-02T08:11:43.491996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0] Write session: Do CDS request
2025-10-02T08:11:43.492020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:43.492629Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:43.499730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:43.501257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:43.501452Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:43.501464Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:43.501474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:43.501527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:43.501568Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534121604841913:2984]
2025-10-02T08:11:43.502223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:43.502492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:43.502543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:43.502861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:43.502913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.502920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.502921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.502922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.502923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.502928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.502938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.502942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.502946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.502949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.502955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.502962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.502968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.502972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.502976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.502981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.502986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.503271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.502992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.503005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.503011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.503033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:43.503454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:43.503466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1250
2025-10-02T08:11:43.503569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.503598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:43.503608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:43.503611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:43.504123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1250 sessionId:  describe result for acl check
2025-10-02T08:11:43.504157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:43.504163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:43.504165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:43.504170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534121604841929:2978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:43.504670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534121604841929:2978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:43.506716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534121604841929:2978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:43.516000Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1249
2025-10-02T08:11:43.513434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:43.515120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:43.515126Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:43.515128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:43.515132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:43.515139Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1249 [1:7556534121604841913:2984]
2025-10-02T08:11:43.515151Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:43.515172Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:43.515176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.515179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.515181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.515199Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:43.515204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:43.515210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:43.515271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.515273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.515276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:43.515278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:43.515351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:43.515354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.515368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.515381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:43.515397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534121604841907:2984]
2025-10-02T08:11:43.515400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534121604841907:2984]
2025-10-02T08:11:43.515406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:43.515420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:43.515425Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:43.515429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:43.515435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:43.515437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:43.515447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534122064775076:2378], now have 1 active actors on pipe
2025-10-02T08:11:43.515481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534121604841907:2984]
2025-10-02T08:11:43.515484Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:43.515675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:43.515829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534121604841929:2978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:43.515835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534121604841929:2978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:43.515838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534121604841929:2978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:43.515846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:43.516221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1249
2025-10-02T08:11:43.516238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604841962:2978], now have 1 active actors on pipe
2025-10-02T08:11:43.516244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.516248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.516270Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7570304-c71f211d-8ebb58c9-cb920869_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:43.516277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.516281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.516283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:43.516291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.516303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:43.516318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.516596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.516607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.516628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.516656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1250 partition: 0 MaxSeqNo: 17 sessionId: src_id|e7570304-c71f211d-8ebb58c9-cb920869_0
2025-10-02T08:11:43.520635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c00cb6-5bffac5e-92a9b52d-12e8b753_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e7570304-c71f211d-8ebb58c9-cb920869_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:43.523647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7570304-c71f211d-8ebb58c9-cb920869_0] Write session: try to update token
2025-10-02T08:11:43.523668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7570304-c71f211d-8ebb58c9-cb920869_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:43.538825Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:43.538851Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:43.538854Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:43.538878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534121604841907:2984]
2025-10-02T08:11:43.538884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534121604841907:2984]
2025-10-02T08:11:43.538929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:43.538937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.538939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:43.539026Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:43.539032Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:43.539094Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:43.543006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId: src_id|e7570304-c71f211d-8ebb58c9-cb920869_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:43.546265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:43.591219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534121604841976:3998]
2025-10-02T08:11:43.591337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1249, pipe: [1:7556534121604841976:3998]
2025-10-02T08:11:43.695328Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:43.695655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.695673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.695718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604841976:3998], now have 1 active actors on pipe
2025-10-02T08:11:43.695994Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:43.696266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7570304-c71f211d-8ebb58c9-cb920869_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:43.696277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7570304-c71f211d-8ebb58c9-cb920869_0] Write session will restart in 0.006935s
2025-10-02T08:11:43.696297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7570304-c71f211d-8ebb58c9-cb920869_0] Write session: Do CDS request
2025-10-02T08:11:43.696303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7570304-c71f211d-8ebb58c9-cb920869_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:43.695847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534121604841976:3998]
2025-10-02T08:11:43.695883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:43.695885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:43.695942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1250 reason: error at write: Disconnected sessionId: src_id|e7570304-c71f211d-8ebb58c9-cb920869_0
2025-10-02T08:11:43.695998Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:43.696113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1250 sessionId: src_id|e7570304-c71f211d-8ebb58c9-cb920869_0 is DEAD
2025-10-02T08:11:43.702227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:43.703462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:43.703658Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:43.703669Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:43.703680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:43.703740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:43.703776Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534121604842073:2967]
2025-10-02T08:11:43.704283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7570304-c71f211d-8ebb58c9-cb920869_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.704393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:43.704421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:43.704428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1251
2025-10-02T08:11:43.704563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.704595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:43.704604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:43.704608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:43.704644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:43.704705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:43.704963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1251 sessionId:  describe result for acl check
2025-10-02T08:11:43.704997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:43.705003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:43.705004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:43.705009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534121604842084:2944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:43.705058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:43.705129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.705135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.705137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.705139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.705140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.705146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.705157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.705163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.705167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.705171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.705181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.705189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.705195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.705205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.705210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.705216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.705224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.705228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.705237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.705242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.705266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:43.705510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534121604842084:2944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:43.707650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534121604842084:2944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:43.712647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534121604842084:2944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:43.712663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534121604842084:2944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:43.712667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534121604842084:2944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:43.712675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:43.713173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:43.714543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:43.714559Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:43.714561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:43.714564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:43.714569Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1250 [1:7556534121604842073:2967]
2025-10-02T08:11:43.714579Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:43.714596Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:43.714599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.714602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.714604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.714620Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:43.714632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:43.714638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:43.714680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.714686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.714689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:43.714690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:43.714758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:43.714763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.714772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.714782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:43.714791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1250
2025-10-02T08:11:43.714798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604842120:2944], now have 1 active actors on pipe
2025-10-02T08:11:43.714801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534122064775084:2378], now have 1 active actors on pipe
2025-10-02T08:11:43.714805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.714809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.714827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534121604842067:2967]
2025-10-02T08:11:43.714840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534121604842067:2967]
2025-10-02T08:11:43.714852Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:43.714863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:43.714865Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:43.714869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:43.714877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:43.714879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:43.714863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1250
2025-10-02T08:11:43.714897Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:43.714907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.714910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.714911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:43.714916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.714923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:43.714955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534121604842067:2967]
2025-10-02T08:11:43.714964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:43.714971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:43.714977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.715027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.715032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.715042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.715072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1251 partition: 0 MaxSeqNo: 17 sessionId: src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0
2025-10-02T08:11:43.715402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7570304-c71f211d-8ebb58c9-cb920869_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:43.718133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0] Write session: try to update token
2025-10-02T08:11:43.718152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:43.734626Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:43.734657Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:43.734660Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:43.734670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534121604842067:2967]
2025-10-02T08:11:43.734676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534121604842067:2967]
2025-10-02T08:11:43.734720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:43.734727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.734730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:43.734732Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:43.734738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:43.734881Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:43.746078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId: src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:43.748895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:43.796054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534121604842134:3998]
2025-10-02T08:11:43.796177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1250, pipe: [1:7556534121604842134:3998]
2025-10-02T08:11:43.873132Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:43.873472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.873484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.873502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604842134:3998], now have 1 active actors on pipe
2025-10-02T08:11:43.873602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:43.873616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:43.873621Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:43.873689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1251 reason: error at write: Disconnected sessionId: src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0
2025-10-02T08:11:43.873721Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:43.873834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534121604842134:3998]
2025-10-02T08:11:43.873888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1251 sessionId: src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0 is DEAD
2025-10-02T08:11:43.877078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:43.877088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0] Write session will restart in 0.005463s
2025-10-02T08:11:43.877115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0] Write session: Do CDS request
2025-10-02T08:11:43.877123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:43.879616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:43.880894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:43.881113Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:43.881124Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:43.881135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:43.881211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:43.881263Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534121604842228:2943]
2025-10-02T08:11:43.881874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:43.882089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:43.882135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:43.882450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:43.882496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.882502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.882503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.882504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.882505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.882510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.882520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.882524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.882532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.882536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.882541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.882548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:43.882554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.882562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:43.882566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.882571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:43.882575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.882579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.882583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.882587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.882605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:43.883272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.884185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:43.884198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1252
2025-10-02T08:11:43.884338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:43.884370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:43.884382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:43.884386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:43.884845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1252 sessionId:  describe result for acl check
2025-10-02T08:11:43.884888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:43.884890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:43.884892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:43.884897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534121604842244:2931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:43.885438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534121604842244:2931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:43.887686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534121604842244:2931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:43.890715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534121604842244:2931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:43.890742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534121604842244:2931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:43.890746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534121604842244:2931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:43.890754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:43.890817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:43.892319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:43.892333Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:43.892334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:43.892337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:43.892342Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1251 [1:7556534121604842228:2943]
2025-10-02T08:11:43.892351Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:43.892367Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:43.892369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.892372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.892374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.892389Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:43.892392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:43.892397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:43.892436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.892442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.892446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:43.892448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:43.892505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:43.892517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.892529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:43.892538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:43.892551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534121604842222:2943]
2025-10-02T08:11:43.892552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534121604842222:2943]
2025-10-02T08:11:43.892557Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:43.892564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1251
2025-10-02T08:11:43.892567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604842275:2931], now have 1 active actors on pipe
2025-10-02T08:11:43.892573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:43.892573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:43.892577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:43.892580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:43.892582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:43.892585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534122064775090:2378], now have 1 active actors on pipe
2025-10-02T08:11:43.892588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.892590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.892625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534121604842222:2943]
2025-10-02T08:11:43.892636Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:43.892643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:43.892649Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:43.892657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:43.892668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:43.892669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:43.892676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:43.892685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:43.892652Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1251
2025-10-02T08:11:43.892710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.892756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:43.892762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:43.892776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:43.892828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1252 partition: 0 MaxSeqNo: 17 sessionId: src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0
2025-10-02T08:11:43.893215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86f499-1ff61e2f-167d8671-9959e3e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:43.895778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0] Write session: try to update token
2025-10-02T08:11:43.895795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:43.910669Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:43.910693Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:43.910695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:43.910703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534121604842222:2943]
2025-10-02T08:11:43.910711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534121604842222:2943]
2025-10-02T08:11:43.910753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:43.910755Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:43.910761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:43.910762Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:43.910763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:43.910906Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:43.914120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId: src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:43.916590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:43.974185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534121604842289:3998]
2025-10-02T08:11:43.974418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1251, pipe: [1:7556534121604842289:3998]
2025-10-02T08:11:44.055703Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:44.058327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.058350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.058393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534121604842289:3998], now have 1 active actors on pipe
2025-10-02T08:11:44.059436Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:44.060715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:44.060726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0] Write session will restart in 0.005850s
2025-10-02T08:11:44.060752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0] Write session: Do CDS request
2025-10-02T08:11:44.060759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:44.058873Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:44.059181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:44.059236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1252 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0
2025-10-02T08:11:44.059398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1252 sessionId: src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0 is DEAD
2025-10-02T08:11:44.059539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534121604842289:3998]
2025-10-02T08:11:44.069362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.072024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:44.072047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1253
2025-10-02T08:11:44.072516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.072569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:44.072577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:44.072580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:44.073110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1253 sessionId:  describe result for acl check
2025-10-02T08:11:44.073145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:44.073146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:44.073148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:44.073154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534125899809672:2926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:44.073676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534125899809672:2926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:44.074311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:44.075910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:44.076127Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:44.076145Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:44.076155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:44.076207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:44.076244Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534125899809687:2932]
2025-10-02T08:11:44.076893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:44.078888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:44.078950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:44.079286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:44.079335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.079341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.079342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.079343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.079344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.079350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.079361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.079365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.079368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.079372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.079378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.079387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.079393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.079399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.079404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.079409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.079422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.079446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.079451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.079456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.079475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:44.081699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534125899809672:2926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:44.093995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534125899809672:2926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:44.094018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534125899809672:2926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:44.094023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534125899809672:2926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:44.094031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:44.098867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:44.100670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:44.100692Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:44.100695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:44.100699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:44.100706Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1252 [1:7556534125899809687:2932]
2025-10-02T08:11:44.100721Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:44.100740Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:44.100743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:44.100749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:44.100751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:44.100767Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:44.100772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:44.100778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:44.100951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.100960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.100963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:44.100966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:44.101036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:44.101039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.101052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.101063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:44.101080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534125899809675:2932]
2025-10-02T08:11:44.101082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534125899809675:2932]
2025-10-02T08:11:44.101095Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:44.101109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:44.101123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:44.101126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:44.101165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534125899809675:2932]
2025-10-02T08:11:44.101167Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:44.101324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:44.101339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:44.101345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:44.101594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1252
2025-10-02T08:11:44.101454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1252
2025-10-02T08:11:44.101471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534125899809727:2926], now have 1 active actors on pipe
2025-10-02T08:11:44.101476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534126359742407:2378], now have 1 active actors on pipe
2025-10-02T08:11:44.101480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.101485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.101512Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31deae7f-8b73afa3-f55760e-e945da1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:44.101518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:44.101522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:44.101524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:44.101533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:44.101545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:44.101560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:44.101589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.101591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.101603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:44.101633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1253 partition: 0 MaxSeqNo: 17 sessionId: src_id|31deae7f-8b73afa3-f55760e-e945da1_0
2025-10-02T08:11:44.102104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e245b8-e7f558db-a25a6ff5-4b4a48b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|31deae7f-8b73afa3-f55760e-e945da1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:44.104874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31deae7f-8b73afa3-f55760e-e945da1_0] Write session: try to update token
2025-10-02T08:11:44.104888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31deae7f-8b73afa3-f55760e-e945da1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:44.123125Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:44.123149Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:44.123151Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:44.123160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534125899809675:2932]
2025-10-02T08:11:44.123165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534125899809675:2932]
2025-10-02T08:11:44.123215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:44.123214Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:44.123220Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:44.123221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.123224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:44.123376Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:44.125149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId: src_id|31deae7f-8b73afa3-f55760e-e945da1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:44.127832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:44.159549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534125899809754:3998]
2025-10-02T08:11:44.159775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1252, pipe: [1:7556534125899809754:3998]
2025-10-02T08:11:44.275881Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:44.276316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.276325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.276366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534125899809754:3998], now have 1 active actors on pipe
2025-10-02T08:11:44.276606Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:44.277141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:44.276918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534125899809754:3998]
2025-10-02T08:11:44.276945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:44.276998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1253 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31deae7f-8b73afa3-f55760e-e945da1_0
2025-10-02T08:11:44.277167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1253 sessionId: src_id|31deae7f-8b73afa3-f55760e-e945da1_0 is DEAD
2025-10-02T08:11:44.279911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31deae7f-8b73afa3-f55760e-e945da1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:44.279923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31deae7f-8b73afa3-f55760e-e945da1_0] Write session will restart in 0.009469s
2025-10-02T08:11:44.279948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31deae7f-8b73afa3-f55760e-e945da1_0] Write session: Do CDS request
2025-10-02T08:11:44.279954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31deae7f-8b73afa3-f55760e-e945da1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:44.286808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:44.288297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:44.288496Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:44.288499Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:44.288509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:44.288557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:44.288592Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534125899809851:2921]
2025-10-02T08:11:44.289235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:44.289497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:44.289562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:44.289933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:44.289977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.289978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.289979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.289980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.289981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.289986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.289995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.289998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.290001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.290004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.290009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.290015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.290021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.290025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.290031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.290036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.290041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.290046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.290050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.290054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.290069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:44.293404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31deae7f-8b73afa3-f55760e-e945da1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.297167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:44.297186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1254
2025-10-02T08:11:44.300122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.300172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:44.300178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:44.300183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:44.300573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1254 sessionId:  describe result for acl check
2025-10-02T08:11:44.300603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:44.300604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:44.300606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:44.300610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534125899809868:2920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:44.301188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534125899809868:2920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:44.305343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534125899809868:2920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:44.307889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:44.309633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:44.309654Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:44.309657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:44.309660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:44.309669Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1253 [1:7556534125899809851:2921]
2025-10-02T08:11:44.309682Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:44.309702Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:44.309706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:44.309709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:44.309712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:44.309729Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:44.309734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:44.309741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:44.309810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.309812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.309816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:44.309819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:44.309886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:44.309889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.309904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.309917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:44.309933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534125899809845:2921]
2025-10-02T08:11:44.309937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534125899809845:2921]
2025-10-02T08:11:44.309954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:44.309967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:44.309983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:44.309986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:44.310002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:44.310006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:44.310021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534125899809845:2921]
2025-10-02T08:11:44.310024Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:44.310063Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:44.310211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534126359742414:2378], now have 1 active actors on pipe
2025-10-02T08:11:44.312054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1253
2025-10-02T08:11:44.319198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534125899809868:2920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:44.319224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534125899809868:2920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:44.319228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534125899809868:2920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:44.319238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:44.321026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31deae7f-8b73afa3-f55760e-e945da1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:44.320144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1253
2025-10-02T08:11:44.320166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534125899809907:2920], now have 1 active actors on pipe
2025-10-02T08:11:44.320182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.320188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.320217Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:44.320225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:44.320230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:44.320236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:44.320248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:44.320262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:44.320281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:44.320328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.320330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.323730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0] Write session: try to update token
2025-10-02T08:11:44.320344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:44.323745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:44.320371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1254 partition: 0 MaxSeqNo: 17 sessionId: src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0
2025-10-02T08:11:44.335057Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:44.335080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:44.335083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:44.335097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534125899809845:2921]
2025-10-02T08:11:44.335100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534125899809845:2921]
2025-10-02T08:11:44.335150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:44.335153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:44.335158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.335160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:44.335161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:44.335312Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:44.343697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId: src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:44.346838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:44.377173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534125899809915:3998]
2025-10-02T08:11:44.377391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1253, pipe: [1:7556534125899809915:3998]
2025-10-02T08:11:44.482977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:44.483583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:44.483593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0] Write session will restart in 0.006972s
2025-10-02T08:11:44.483615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0] Write session: Do CDS request
2025-10-02T08:11:44.483623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:44.482240Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:44.482608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.482614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.482645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534125899809915:3998], now have 1 active actors on pipe
2025-10-02T08:11:44.483034Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:44.483292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534125899809915:3998]
2025-10-02T08:11:44.483307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:44.483355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1254 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0
2025-10-02T08:11:44.483453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1254 sessionId: src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0 is DEAD
2025-10-02T08:11:44.491288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.491540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:44.491568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1255
2025-10-02T08:11:44.491919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.491977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:44.491989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:44.491994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:44.492481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1255 sessionId:  describe result for acl check
2025-10-02T08:11:44.492525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:44.492527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:44.492529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:44.492535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534125899809969:2904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:44.493162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534125899809969:2904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:44.497504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:44.498816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534125899809969:2904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:44.500032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:44.500251Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:44.500262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:44.500272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:44.500325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:44.500356Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534125899810064:2899]
2025-10-02T08:11:44.500972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:44.501208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:44.501246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:44.501565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:44.501627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.501635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.501636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.501637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.501638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.501643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.501653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.501656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.501660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.501663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.501669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.501676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.501682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.501686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.501690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.501695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.501699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.501705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.501711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.501716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.501733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:44.502364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534125899809969:2904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:44.502380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534125899809969:2904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:44.502383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534125899809969:2904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:44.502391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:44.515404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:44.517074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:44.517097Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:44.517100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:44.517104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:44.517111Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1254 [1:7556534125899810064:2899]
2025-10-02T08:11:44.517122Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:44.517138Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:44.517141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:44.517144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:44.517146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:44.517163Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:44.517169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:44.517175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:44.517237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.517239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.517241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:44.517243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:44.517309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:44.517311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.517325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.517336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:44.517353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534125899810039:2899]
2025-10-02T08:11:44.517355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534125899810039:2899]
2025-10-02T08:11:44.517369Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:44.517383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:44.517397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:44.517400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:44.517434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534125899810039:2899]
2025-10-02T08:11:44.517437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:44.518148Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1254
2025-10-02T08:11:44.518524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9415802e-9d4acc3a-e8997b6-657ebd04_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:44.517707Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:44.517723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:44.517730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:44.517837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1254
2025-10-02T08:11:44.517851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534125899810084:2904], now have 1 active actors on pipe
2025-10-02T08:11:44.517890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534126359742434:2378], now have 1 active actors on pipe
2025-10-02T08:11:44.517896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.517903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.517929Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:44.517937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:44.517941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:44.517943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:44.517955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:44.517966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:44.517983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:44.518100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.518102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.518115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:44.518152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1255 partition: 0 MaxSeqNo: 17 sessionId: src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0
2025-10-02T08:11:44.521249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0] Write session: try to update token
2025-10-02T08:11:44.521262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:44.538501Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:44.538527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:44.538529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:44.538537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534125899810039:2899]
2025-10-02T08:11:44.538543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534125899810039:2899]
2025-10-02T08:11:44.538584Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:44.538590Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:44.538590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:44.538597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.538602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:44.538755Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:44.551407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId: src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:44.554509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:44.584280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534125899810118:3998]
2025-10-02T08:11:44.584402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1254, pipe: [1:7556534125899810118:3998]
2025-10-02T08:11:44.726964Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:44.727405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.727421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.727442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534125899810118:3998], now have 1 active actors on pipe
2025-10-02T08:11:44.727558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:44.727567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:44.727622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1255 reason: error at write: Disconnected sessionId: src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0
2025-10-02T08:11:44.727947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:44.727956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0] Write session will restart in 0.008303s
2025-10-02T08:11:44.727989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0] Write session: Do CDS request
2025-10-02T08:11:44.727996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:44.727797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1255 sessionId: src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0 is DEAD
2025-10-02T08:11:44.728089Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:44.728511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534125899810118:3998]
2025-10-02T08:11:44.728896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:44.742456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.741492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:44.742506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:44.742512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1256
2025-10-02T08:11:44.742678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.742704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:44.742708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:44.742711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:44.743525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:44.743710Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:44.743714Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:44.743723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:44.743779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:44.743815Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534125899810227:2880]
2025-10-02T08:11:44.743820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1256 sessionId:  describe result for acl check
2025-10-02T08:11:44.743847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:44.743849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:44.743850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:44.743856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534125899810230:2879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:44.744376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534125899810230:2879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:44.744416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:44.745866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:44.745932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:44.746265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:44.746307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.746308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.746308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.746309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.746311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.746316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.746325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.746329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.746333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.746337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.746342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.746350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.746356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.746362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.746366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.746371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.746376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.746381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.746386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.746391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.746411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:44.756783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534125899810230:2879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:44.761470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:44.763123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:44.763131Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:44.763134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:44.763138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:44.763145Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1255 [1:7556534125899810227:2880]
2025-10-02T08:11:44.763158Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:44.763176Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:44.763182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:44.763185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:44.763187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:44.763206Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:44.763211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:44.763217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:44.763284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.763286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.763289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:44.763291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:44.763413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:44.763416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.763430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.763445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:44.763461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534125899810217:2880]
2025-10-02T08:11:44.763463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534125899810217:2880]
2025-10-02T08:11:44.763475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:44.763490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:44.763503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:44.763506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:44.763543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534125899810217:2880]
2025-10-02T08:11:44.763545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:44.765163Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1255
2025-10-02T08:11:44.763678Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:44.763691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:44.763696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:44.771268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534126359742452:2378], now have 1 active actors on pipe
2025-10-02T08:11:44.774457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534125899810230:2879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:44.774480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534125899810230:2879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:44.774483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534125899810230:2879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:44.774491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:44.774781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1255
2025-10-02T08:11:44.774804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534125899810280:2879], now have 1 active actors on pipe
2025-10-02T08:11:44.774813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.774822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.774850Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5f89f06-316f964a-431611d9-fba2e272_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:44.774863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:44.774871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:44.774873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:44.774885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:44.774901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:44.774921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:44.774955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.774958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.774970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:44.774996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1256 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5f89f06-316f964a-431611d9-fba2e272_0
2025-10-02T08:11:44.775350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4506d9fc-306a1f6c-2bb9591f-a88df71d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5f89f06-316f964a-431611d9-fba2e272_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:44.778102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f89f06-316f964a-431611d9-fba2e272_0] Write session: try to update token
2025-10-02T08:11:44.778124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f89f06-316f964a-431611d9-fba2e272_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:44.786831Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:44.786850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:44.786853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:44.786863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534125899810217:2880]
2025-10-02T08:11:44.786868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534125899810217:2880]
2025-10-02T08:11:44.786915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:44.786924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.786931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:44.787070Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:44.788065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:44.788077Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:44.805381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId: src_id|b5f89f06-316f964a-431611d9-fba2e272_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:44.808102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:44.828771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534125899810286:3998]
2025-10-02T08:11:44.828996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1255, pipe: [1:7556534125899810286:3998]
2025-10-02T08:11:44.944852Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:44.945245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f89f06-316f964a-431611d9-fba2e272_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:44.945263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f89f06-316f964a-431611d9-fba2e272_0] Write session will restart in 0.007374s
2025-10-02T08:11:44.945299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f89f06-316f964a-431611d9-fba2e272_0] Write session: Do CDS request
2025-10-02T08:11:44.945307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f89f06-316f964a-431611d9-fba2e272_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:44.943469Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:44.943776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:44.943785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:44.943804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534125899810286:3998], now have 1 active actors on pipe
2025-10-02T08:11:44.944197Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:44.944493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534125899810286:3998]
2025-10-02T08:11:44.944507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:44.944558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1256 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b5f89f06-316f964a-431611d9-fba2e272_0
2025-10-02T08:11:44.944757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1256 sessionId: src_id|b5f89f06-316f964a-431611d9-fba2e272_0 is DEAD
2025-10-02T08:11:44.965359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f89f06-316f964a-431611d9-fba2e272_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.968254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:44.968292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1257
2025-10-02T08:11:44.968464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:44.968496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:44.968502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:44.968507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:44.972292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1257 sessionId:  describe result for acl check
2025-10-02T08:11:44.972329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:44.972333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:44.972335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:44.972340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534125899810378:2873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:44.972863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534125899810378:2873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:44.982466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:44.982991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:44.983179Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:44.983183Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:44.983193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:44.983242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:44.983282Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534125899810404:2875]
2025-10-02T08:11:44.983953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:44.984368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:44.984410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:44.984719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:44.984770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.984772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.984773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.984774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.984775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.984781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.984792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.984796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.984815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.984819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.984826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.984835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:44.984841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.984847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:44.984853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.984858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:44.984863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.984869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:44.984874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.984878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:44.984900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:44.991790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534125899810378:2873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:45.001782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:45.004497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534125899810378:2873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:45.004506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534125899810378:2873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:45.004510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534125899810378:2873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:45.004521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:45.009180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:45.009201Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:45.009204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:45.009208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:45.009217Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1256 [1:7556534125899810404:2875]
2025-10-02T08:11:45.009230Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:45.009271Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:45.009275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.009278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.009281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.009303Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:45.009311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:45.009318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:45.009399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.009402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.009405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:45.009408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:45.009485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:45.009488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.009504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.009518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:45.009538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534125899810397:2875]
2025-10-02T08:11:45.009541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534125899810397:2875]
2025-10-02T08:11:45.009556Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:45.009570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:45.009585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:45.009589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:45.009625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534125899810397:2875]
2025-10-02T08:11:45.009628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:45.009764Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:45.009767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:45.009773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:45.010336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1256
2025-10-02T08:11:45.010348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194777733:2873], now have 1 active actors on pipe
2025-10-02T08:11:45.010352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534126359742459:2378], now have 1 active actors on pipe
2025-10-02T08:11:45.011020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.011026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.011055Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:45.011064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.011068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.011070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:45.011082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.011095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:45.011114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.011347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.011351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.011370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.011406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1257 partition: 0 MaxSeqNo: 17 sessionId: src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0
2025-10-02T08:11:45.013167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f89f06-316f964a-431611d9-fba2e272_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:45.010692Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1256
2025-10-02T08:11:45.024955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0] Write session: try to update token
2025-10-02T08:11:45.024989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:45.042912Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:45.042930Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:45.042933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:45.042949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534125899810397:2875]
2025-10-02T08:11:45.042954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534125899810397:2875]
2025-10-02T08:11:45.042999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:45.043007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.043010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:45.043176Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:45.044869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534130194777749:3998]
2025-10-02T08:11:45.044951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:45.044957Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:45.045086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1256, pipe: [1:7556534130194777749:3998]
2025-10-02T08:11:45.064254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId: src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:45.067152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:45.247344Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:45.247680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194777749:3998], now have 1 active actors on pipe
2025-10-02T08:11:45.247710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.247716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.249324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:45.249335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0] Write session will restart in 0.006911s
2025-10-02T08:11:45.249361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0] Write session: Do CDS request
2025-10-02T08:11:45.249369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:45.248417Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:45.248686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534130194777749:3998]
2025-10-02T08:11:45.248703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:45.248750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1257 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0
2025-10-02T08:11:45.248959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1257 sessionId: src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0 is DEAD
2025-10-02T08:11:45.252981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:45.258477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:45.260996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:45.261018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1258
2025-10-02T08:11:45.261270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:45.261305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:45.261312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:45.261317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:45.263516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:45.263954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1258 sessionId:  describe result for acl check
2025-10-02T08:11:45.264004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:45.264006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:45.264014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:45.264020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534130194777870:2848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:45.264565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534130194777870:2848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:45.268601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:45.268834Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:45.268838Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:45.268848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:45.268903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:45.268949Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534130194777890:2846]
2025-10-02T08:11:45.269624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:45.269885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:45.269925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:45.270236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:45.270274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.270275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.270276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.270277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.270279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.270284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.270294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.270299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.270303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.270307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.270312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.270320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.270325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.270331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.270336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.270342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.270347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.270352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.270357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.270365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.270385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:45.275483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534130194777870:2848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:45.286288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534130194777870:2848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:45.286307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534130194777870:2848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:45.286311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534130194777870:2848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:45.286321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:45.286426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:45.288302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:45.288307Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:45.288309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:45.288312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:45.288317Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1257 [1:7556534130194777890:2846]
2025-10-02T08:11:45.288325Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:45.288341Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:45.288343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.288346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.288347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.288364Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:45.288367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:45.288372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:45.288423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.288424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.288426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:45.288428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:45.288493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:45.288495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.288508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.288519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:45.288535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534130194777862:2846]
2025-10-02T08:11:45.288537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534130194777862:2846]
2025-10-02T08:11:45.288543Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:45.288555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194777916:2848], now have 1 active actors on pipe
2025-10-02T08:11:45.288559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:45.288563Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:45.288563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:45.288576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:45.288579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:45.288584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534130654709777:2378], now have 1 active actors on pipe
2025-10-02T08:11:45.288614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534130194777862:2846]
2025-10-02T08:11:45.288623Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:45.288631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:45.288667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1257
2025-10-02T08:11:45.288687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.288690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.288721Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d580e1f-26cd3316-273372fd-d5c545a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:45.288729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.288732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.288734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:45.288742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.288751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:45.288769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.288894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.288898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.288919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.288965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1258 partition: 0 MaxSeqNo: 17 sessionId: src_id|d580e1f-26cd3316-273372fd-d5c545a1_0
2025-10-02T08:11:45.290524Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1257
2025-10-02T08:11:45.293041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7edda3c9-599de221-629c9d0d-4b857a3e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d580e1f-26cd3316-273372fd-d5c545a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:45.296719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d580e1f-26cd3316-273372fd-d5c545a1_0] Write session: try to update token
2025-10-02T08:11:45.296748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d580e1f-26cd3316-273372fd-d5c545a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:45.323255Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:45.323273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:45.323280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534130194777862:2846]
2025-10-02T08:11:45.323320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:45.323487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:45.323621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.323753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.323885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.324217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:45.324268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:45.325111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:45.344068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId: src_id|d580e1f-26cd3316-273372fd-d5c545a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:45.347209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:45.348444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.348465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.350750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:45.350767Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:45.350770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:45.350772Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:45.350782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534130194777862:2846]
2025-10-02T08:11:45.350786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534130194777862:2846]
2025-10-02T08:11:45.350832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:45.350841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.350846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:45.351003Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:45.351049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:45.351142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534130194777930:3998]
2025-10-02T08:11:45.351210Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:45.351216Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:45.351278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1257, pipe: [1:7556534130194777930:3998]
2025-10-02T08:11:45.508924Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:45.509231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.509242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.509419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.509486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.509552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.509623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.509678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.509684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.509760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.509817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.509876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.509945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.509985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.509988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.510061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.510115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.510169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.510234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.510273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.510276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.510346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.510411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.510472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.510535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.510583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.510586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.510652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.510707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.510768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.510831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.510879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.510882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.510954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.511016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.511122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.511197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.511270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.511273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.511350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.511413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.511503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.511569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.511626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.511629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.511696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.511752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.511814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.511870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.511936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.511939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.512024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.512088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.512145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.512200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.512256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.512258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.512332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.512385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.512449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.512507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.512547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.512549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.512595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194777930:3998], now have 1 active actors on pipe
2025-10-02T08:11:45.513029Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:45.513562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:45.513586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1258 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d580e1f-26cd3316-273372fd-d5c545a1_0
2025-10-02T08:11:45.513746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1258 sessionId: src_id|d580e1f-26cd3316-273372fd-d5c545a1_0 is DEAD
2025-10-02T08:11:45.513839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534130194777930:3998]
2025-10-02T08:11:45.515338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d580e1f-26cd3316-273372fd-d5c545a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:45.515351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d580e1f-26cd3316-273372fd-d5c545a1_0] Write session will restart in 0.006720s
2025-10-02T08:11:45.515373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d580e1f-26cd3316-273372fd-d5c545a1_0] Write session: Do CDS request
2025-10-02T08:11:45.515379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d580e1f-26cd3316-273372fd-d5c545a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:45.512845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:45.525041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:45.525320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d580e1f-26cd3316-273372fd-d5c545a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:45.525697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:45.525711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1259
2025-10-02T08:11:45.525862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:45.525892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:45.525898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:45.525902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:45.527307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:45.527559Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:45.527564Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:45.527576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:45.527639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:45.527684Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534130194778057:2813]
2025-10-02T08:11:45.528601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:45.528967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1259 sessionId:  describe result for acl check
2025-10-02T08:11:45.529004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:45.529006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:45.529007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:45.529013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534130194778065:2798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:45.529067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:45.529113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:45.529458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:45.529501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.529503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.529505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.529506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.529508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.529515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.529527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.529532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.529536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.529540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.529547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.529561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.529568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.529573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.529576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.529581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.529586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.529591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.529596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.529601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.529627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:45.530230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534130194778065:2798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:45.533194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534130194778065:2798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:45.542966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534130194778065:2798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:45.542980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534130194778065:2798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:45.542982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534130194778065:2798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:45.542987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:45.546732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:45.548567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:45.548585Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:45.548588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:45.548592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:45.548599Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1258 [1:7556534130194778057:2813]
2025-10-02T08:11:45.548612Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:45.548628Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:45.548632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.548635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.548637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.548651Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:45.548656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:45.548663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:45.548721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.548723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.548726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:45.548729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:45.548787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:45.548790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.548821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.548833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:45.548844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1258
2025-10-02T08:11:45.548851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194778118:2798], now have 1 active actors on pipe
2025-10-02T08:11:45.548854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534130654709782:2378], now have 1 active actors on pipe
2025-10-02T08:11:45.548860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534130194778043:2813]
2025-10-02T08:11:45.548862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534130194778043:2813]
2025-10-02T08:11:45.548874Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:45.548883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.548886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:45.548887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.548888Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:45.548904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:45.548919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:45.548922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:45.548963Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|979b5511-457c518b-ac888b19-affe202_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:45.548969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.548972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.548974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:45.548983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.548992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:45.548999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534130194778043:2813]
2025-10-02T08:11:45.549006Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:45.549029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.549033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:45.549110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.549112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.549126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.549159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1259 partition: 0 MaxSeqNo: 17 sessionId: src_id|979b5511-457c518b-ac888b19-affe202_0
2025-10-02T08:11:45.549846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d580e1f-26cd3316-273372fd-d5c545a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|979b5511-457c518b-ac888b19-affe202_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:45.551092Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1258
2025-10-02T08:11:45.552940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979b5511-457c518b-ac888b19-affe202_0] Write session: try to update token
2025-10-02T08:11:45.552961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979b5511-457c518b-ac888b19-affe202_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:45.560942Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:45.560958Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:45.560966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534130194778043:2813]
2025-10-02T08:11:45.561003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:45.561004Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:45.561167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:45.561300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.561428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.561558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.561816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:45.561844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:45.574755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId: src_id|979b5511-457c518b-ac888b19-affe202_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:45.577377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:45.577448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.577465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.577502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:45.577524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:45.577573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.577582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.577758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.577836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.577902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.577969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.578148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.578160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.578234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.578295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.578377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.578444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.578483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.578486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.578557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.578608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.578671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.578737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.578788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.578795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.578867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.578929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.578991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.579063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.579111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.579118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.579188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.579255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.579331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.579398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.579450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.579458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.579531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.579593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.579655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.579720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.579768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.579776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.579852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.579911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.579989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.580052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.580101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.580107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.580178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.580243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.580309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.580371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.580416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.580423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.580485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.580550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.580617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.580678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.580726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.580734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.580799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:45.580887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:45.580951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:45.581015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:45.581075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:45.581078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:45.581140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:45.581203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.581221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.581224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:45.581256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:45.581270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:45.581273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:45.581276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:45.581278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:45.581728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:45.581750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:45.581756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:45.581761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:45.581764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:45.581767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:45.582403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:45.582430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:45.582437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:45.582440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:45.582443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:45.582446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:45.583015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:45.583041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:45.583052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:45.583056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:45.583063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:45.590673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:45.590701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:45.590719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392705590
2025-10-02T08:11:45.590864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:45.590879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:45.590886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:45.590888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:45.590891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:45.590893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:45.591327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:45.591347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:45.591353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:45.591357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:45.591360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:45.591364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:45.591824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:45.591843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:45.591852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:45.591856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:45.591860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:45.591862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:45.592298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:45.592318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:45.592331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:45.593405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:45.593423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:45.593428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:45.593432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:45.593440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392705593
2025-10-02T08:11:45.593737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:45.593765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:45.593770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:45.593773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:45.593777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:45.593783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:45.594244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:45.594267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:45.594274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:45.594279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:45.594283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:45.594286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:45.594748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:45.594769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.594865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392705594
2025-10-02T08:11:45.600173Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:45.600199Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:45.600207Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:45.600214Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:45.600226Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:45.600230Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:45.600232Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:45.600245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534130194778043:2813]
2025-10-02T08:11:45.600254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534130194778043:2813]
2025-10-02T08:11:45.600297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:45.600318Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:45.600331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:45.600340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.600342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:45.600481Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:45.614187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534130194778143:3998]
2025-10-02T08:11:45.614347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1258, pipe: [1:7556534130194778143:3998]
2025-10-02T08:11:45.743953Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:45.744264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194778143:3998], now have 1 active actors on pipe
2025-10-02T08:11:45.744371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534130194778143:3998]
2025-10-02T08:11:45.744385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:45.744388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:45.744409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1259 reason: error at write: Disconnected sessionId: src_id|979b5511-457c518b-ac888b19-affe202_0
2025-10-02T08:11:45.744725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b5511-457c518b-ac888b19-affe202_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:45.744736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b5511-457c518b-ac888b19-affe202_0] Write session will restart in 0.009711s
2025-10-02T08:11:45.744759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b5511-457c518b-ac888b19-affe202_0] Write session: Do CDS request
2025-10-02T08:11:45.744765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b5511-457c518b-ac888b19-affe202_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:45.744487Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:45.744512Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:45.744575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1259 sessionId: src_id|979b5511-457c518b-ac888b19-affe202_0 is DEAD
2025-10-02T08:11:45.748098Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [54d67592672afdf2] Result# TEvPutResult {Id# [72075186224037892:1258:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:45.748146Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1258:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:45.748208Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1258:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:45.752842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:45.753894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:45.754049Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:45.754058Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:45.754067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:45.754108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:45.754136Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534130194778261:2764]
2025-10-02T08:11:45.754741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:45.754927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:45.754970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:45.755272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:45.755313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.755319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.755320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.755321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.755324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.755329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.755339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.755343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.755347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.755351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.755357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.755363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.755369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.755374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.755383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.755387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.755391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.755418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979b5511-457c518b-ac888b19-affe202_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:45.755396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.755404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.755409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.755430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:45.755772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:45.755781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1260
2025-10-02T08:11:45.755951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:45.755992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:45.755999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:45.756001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:45.756346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1260 sessionId:  describe result for acl check
2025-10-02T08:11:45.756378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:45.756383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:45.756385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:45.756390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534130194778277:2757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:45.756911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534130194778277:2757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:45.759398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534130194778277:2757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:45.764023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534130194778277:2757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:45.764039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534130194778277:2757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:45.764046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534130194778277:2757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:45.764054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:45.764538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:45.766033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:45.766049Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:45.766051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:45.766054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:45.766059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1259 [1:7556534130194778261:2764]
2025-10-02T08:11:45.766070Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:45.766085Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:45.766087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.766091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.766092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.766108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:45.766118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:45.766125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:45.766187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.766197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.766200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:45.766202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:45.766265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:45.766274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.766286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.766297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:45.766315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1259
2025-10-02T08:11:45.766319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194778309:2757], now have 1 active actors on pipe
2025-10-02T08:11:45.766322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534130654709814:2378], now have 1 active actors on pipe
2025-10-02T08:11:45.766328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534130194778255:2764]
2025-10-02T08:11:45.766330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534130194778255:2764]
2025-10-02T08:11:45.766342Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:45.766351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.766353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:45.766355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.766356Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:45.766372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:45.766389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:45.766395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:45.766433Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd867587-e011891e-c721656b-a246908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:45.766400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1259
2025-10-02T08:11:45.766446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.766453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.766455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:45.766463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.766471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:45.766480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534130194778255:2764]
2025-10-02T08:11:45.766489Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:45.766511Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:45.766521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.766555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.766566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.766588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.766626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1260 partition: 0 MaxSeqNo: 17 sessionId: src_id|bd867587-e011891e-c721656b-a246908_0
2025-10-02T08:11:45.767027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979b5511-457c518b-ac888b19-affe202_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bd867587-e011891e-c721656b-a246908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:45.770528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd867587-e011891e-c721656b-a246908_0] Write session: try to update token
2025-10-02T08:11:45.770552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd867587-e011891e-c721656b-a246908_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:45.776648Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:45.776663Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:45.776669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534130194778255:2764]
2025-10-02T08:11:45.776710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:45.776723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:45.776920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:45.777076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.777236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.777383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:45.777685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:45.777729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:45.793466Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:45.793486Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:45.793488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:45.793497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534130194778255:2764]
2025-10-02T08:11:45.793501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534130194778255:2764]
2025-10-02T08:11:45.793547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:45.793550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:45.793553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.793555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:45.793558Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:45.793700Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:45.794753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId: src_id|bd867587-e011891e-c721656b-a246908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:45.797239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:45.844571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534130194778323:3998]
2025-10-02T08:11:45.844711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1259, pipe: [1:7556534130194778323:3998]
2025-10-02T08:11:45.941653Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:45.941935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.941948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.941969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194778323:3998], now have 1 active actors on pipe
2025-10-02T08:11:45.942167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534130194778323:3998]
2025-10-02T08:11:45.942172Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:45.942195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:45.942260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1260 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd867587-e011891e-c721656b-a246908_0
2025-10-02T08:11:45.942423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1260 sessionId: src_id|bd867587-e011891e-c721656b-a246908_0 is DEAD
2025-10-02T08:11:45.942813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd867587-e011891e-c721656b-a246908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:45.942832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd867587-e011891e-c721656b-a246908_0] Write session will restart in 0.009923s
2025-10-02T08:11:45.942859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd867587-e011891e-c721656b-a246908_0] Write session: Do CDS request
2025-10-02T08:11:45.942868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd867587-e011891e-c721656b-a246908_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:45.942944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:45.957411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd867587-e011891e-c721656b-a246908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:45.957788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:45.957803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1261
2025-10-02T08:11:45.960982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:45.961054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:45.961061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:45.961067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:45.961572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1261 sessionId:  describe result for acl check
2025-10-02T08:11:45.961605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:45.961607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:45.961609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:45.961616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534130194778432:2747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:45.962409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534130194778432:2747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:45.968457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:45.970897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:45.971117Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:45.971128Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:45.971138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:45.971201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:45.971235Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534130194778456:2739]
2025-10-02T08:11:45.971715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:45.972002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:45.972067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:45.972457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:45.972525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.972531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.972532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.972533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.972535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.972540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.972549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.972553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.972556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.972559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.972565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.972572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:45.972578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.972583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:45.972587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.972591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:45.972599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.972604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.972608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.972611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.972628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:45.973206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534130194778432:2747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:45.984033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534130194778432:2747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:45.984054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534130194778432:2747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:45.984057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534130194778432:2747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:45.984068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:45.984455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:45.986250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:45.986258Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:45.986262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:45.986266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:45.986274Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1260 [1:7556534130194778456:2739]
2025-10-02T08:11:45.986288Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:45.986307Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:45.986311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.986314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.986316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.986334Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:45.986340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:45.986346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:45.986420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.986423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.986426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:45.986429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:45.986639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:45.986643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:45.986659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:45.986674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:45.986699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534130194778441:2739]
2025-10-02T08:11:45.986701Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534130194778441:2739]
2025-10-02T08:11:45.986719Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:45.986737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:45.986751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:45.986754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:45.986766Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:45.986771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:45.986794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534130194778441:2739]
2025-10-02T08:11:45.986797Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:45.986846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1260
2025-10-02T08:11:45.986854Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:45.986868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534130194778482:2747], now have 1 active actors on pipe
2025-10-02T08:11:45.988004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534130654709821:2378], now have 1 active actors on pipe
2025-10-02T08:11:45.988025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.988031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.988060Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:45.988068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:45.988072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:45.988074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:45.988085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:45.988100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:45.988120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.989071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:45.989080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:45.989104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:45.989148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1261 partition: 0 MaxSeqNo: 17 sessionId: src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0
2025-10-02T08:11:45.989965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1260
2025-10-02T08:11:45.990179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd867587-e011891e-c721656b-a246908_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:45.993637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0] Write session: try to update token
2025-10-02T08:11:45.993664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:46.010054Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:46.010075Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:46.010077Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:46.010086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534130194778441:2739]
2025-10-02T08:11:46.010090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534130194778441:2739]
2025-10-02T08:11:46.010136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:46.010147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.010149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:46.010298Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:46.013107Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:46.013123Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:46.026905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId: src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:46.029606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:46.045493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534134489745796:3998]
2025-10-02T08:11:46.045701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1260, pipe: [1:7556534134489745796:3998]
2025-10-02T08:11:46.189941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:46.187769Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:46.188129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.188136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.188153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534134489745796:3998], now have 1 active actors on pipe
2025-10-02T08:11:46.189027Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:46.189289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534134489745796:3998]
2025-10-02T08:11:46.189302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:46.189342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1261 reason: status is not ok: tablet will be restarted right now sessionId: src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0
2025-10-02T08:11:46.189511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1261 sessionId: src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0 is DEAD
2025-10-02T08:11:46.193194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:46.193211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0] Write session will restart in 0.009805s
2025-10-02T08:11:46.193247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0] Write session: Do CDS request
2025-10-02T08:11:46.193255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:46.204432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:46.205205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:46.205219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1262
2025-10-02T08:11:46.208982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:46.209051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:46.209061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:46.209067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:46.210443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1262 sessionId:  describe result for acl check
2025-10-02T08:11:46.210480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:46.210481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:46.210483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:46.210489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534134489745827:2741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:46.211023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534134489745827:2741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:46.217809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534134489745827:2741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:46.225758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:46.227880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:46.228110Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:46.228113Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:46.228123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:46.228174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:46.228237Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534134489745957:2737]
2025-10-02T08:11:46.228902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:46.229654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:46.229704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:46.230038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:46.230078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.230081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.230082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.230084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.230085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.230090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.230101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.230104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.230108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.230112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.230118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.230126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.230132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.230137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.230142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.230147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.230151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.230157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.230164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.230170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.230190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:46.230471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534134489745827:2741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:46.230480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534134489745827:2741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:46.230483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534134489745827:2741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:46.230493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:46.241530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:46.243250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:46.243264Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:46.243268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:46.243270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:46.243275Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1261 [1:7556534134489745957:2737]
2025-10-02T08:11:46.243285Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:46.243300Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:46.243302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:46.243305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:46.243307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:46.243320Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:46.243324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:46.243329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:46.243383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.243384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.243386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:46.243391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:46.243448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:46.243450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.243459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.243466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:46.243478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534134489745950:2737]
2025-10-02T08:11:46.243479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534134489745950:2737]
2025-10-02T08:11:46.243485Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:46.243496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:46.243505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:46.243506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:46.243537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534134489745950:2737]
2025-10-02T08:11:46.243539Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:46.243548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534134489745970:2741], now have 1 active actors on pipe
2025-10-02T08:11:46.243587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:46.243590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1261
2025-10-02T08:11:46.243592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:46.243598Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:46.243640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534134949677139:2378], now have 1 active actors on pipe
2025-10-02T08:11:46.243665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.243671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.243708Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:46.243718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:46.243732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:46.243735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:46.243747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:46.244352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582f96d-7117a00e-9e5bac1a-2466e52b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:46.243758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:46.243928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1261
2025-10-02T08:11:46.243782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:46.243822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.243824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.243845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:46.243881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1262 partition: 0 MaxSeqNo: 17 sessionId: src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0
2025-10-02T08:11:46.247870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0] Write session: try to update token
2025-10-02T08:11:46.247893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:46.267511Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:46.267528Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:46.267531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:46.267546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534134489745950:2737]
2025-10-02T08:11:46.267550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534134489745950:2737]
2025-10-02T08:11:46.267595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:46.267601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.267603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:46.267748Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:46.273139Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:46.273154Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:46.289041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534134489745988:3998]
2025-10-02T08:11:46.293256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1261, pipe: [1:7556534134489745988:3998]
2025-10-02T08:11:46.355355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId: src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:46.358148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:46.498539Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:46.498912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534134489745988:3998], now have 1 active actors on pipe
2025-10-02T08:11:46.498923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.498929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.499207Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:46.499209Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:46.499516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:46.499578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1262 reason: status is not ok: tablet will be restarted right now sessionId: src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0
2025-10-02T08:11:46.499761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1262 sessionId: src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0 is DEAD
2025-10-02T08:11:46.499938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534134489745988:3998]
2025-10-02T08:11:46.501324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:46.501341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0] Write session will restart in 0.006227s
2025-10-02T08:11:46.501376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0] Write session: Do CDS request
2025-10-02T08:11:46.501384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:46.506330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:46.507709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:46.507899Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:46.507903Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:46.507913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:46.507960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:46.508017Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534134489746104:2714]
2025-10-02T08:11:46.508692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:46.508980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:46.509056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:46.509525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:46.509404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:46.509476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.509477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.509478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.509479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.509484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.509490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.509500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.509503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.509507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.509510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.509516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.509523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.509529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.509535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.509539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.509544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.509548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.509553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.509558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.509562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.509582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:46.509941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:46.509966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1263
2025-10-02T08:11:46.510102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:46.510135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:46.510142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:46.510147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:46.510665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1263 sessionId:  describe result for acl check
2025-10-02T08:11:46.510706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:46.510709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:46.510711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:46.510718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534134489746120:2716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:46.511379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534134489746120:2716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:46.526727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534134489746120:2716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:46.528009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:46.530290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:46.530312Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:46.530316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:46.530321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:46.530330Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1262 [1:7556534134489746104:2714]
2025-10-02T08:11:46.530346Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:46.530369Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:46.530373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:46.530377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:46.530380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:46.530401Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:46.530407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:46.530417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:46.530507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.530526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.530533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:46.530537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:46.530611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:46.530622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.530641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.530661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:46.530690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534134489746098:2714]
2025-10-02T08:11:46.531339Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1262
2025-10-02T08:11:46.531345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534134489746098:2714]
2025-10-02T08:11:46.531361Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:46.531388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:46.531407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:46.531410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:46.531424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534134949677148:2378], now have 1 active actors on pipe
2025-10-02T08:11:46.531465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534134489746098:2714]
2025-10-02T08:11:46.531468Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:46.531820Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:46.531826Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:46.531834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:46.544040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534134489746120:2716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:46.544060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534134489746120:2716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:46.544064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534134489746120:2716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:46.544075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:46.548952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1262
2025-10-02T08:11:46.548982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534134489746164:2716], now have 1 active actors on pipe
2025-10-02T08:11:46.552865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.552881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.553894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a4d0b9-e35c5738-ab02fc8f-2c6febf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:46.552928Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:46.552949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:46.552956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:46.552960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:46.552979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:46.553002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:46.553028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:46.553356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.553359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.553378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:46.553416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1263 partition: 0 MaxSeqNo: 17 sessionId: src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0
2025-10-02T08:11:46.558636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0] Write session: try to update token
2025-10-02T08:11:46.558655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:46.564875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:46.564894Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:46.564897Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:46.564908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534134489746098:2714]
2025-10-02T08:11:46.564923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534134489746098:2714]
2025-10-02T08:11:46.564985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:46.564993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.565000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:46.565006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:46.565013Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:46.565180Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:46.599499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId: src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:46.602271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:46.602331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534134489746185:3998]
2025-10-02T08:11:46.604973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1262, pipe: [1:7556534134489746185:3998]
2025-10-02T08:11:46.745842Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:46.746320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.746333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.746361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534134489746185:3998], now have 1 active actors on pipe
2025-10-02T08:11:46.747506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:46.747514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:46.747587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1263 reason: error at write: Disconnected sessionId: src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0
2025-10-02T08:11:46.747797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1263 sessionId: src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0 is DEAD
2025-10-02T08:11:46.748147Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:46.748514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534134489746185:3998]
2025-10-02T08:11:46.750739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:46.754219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:46.754236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0] Write session will restart in 0.007316s
2025-10-02T08:11:46.754267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0] Write session: Do CDS request
2025-10-02T08:11:46.754276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:46.759719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:46.761611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:46.761809Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:46.761821Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:46.761830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:46.761874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:46.761913Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534134489746331:2683]
2025-10-02T08:11:46.762627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:46.762881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:46.762920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:46.763252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:46.763297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.763306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.763307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.763309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.763310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.763315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.763325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.763329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.763333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.763337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.763343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.763350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:46.763357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.763362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:46.763367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.763373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:46.763377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.763382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.763390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.763395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.763417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:46.768488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:46.770931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:46.770951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1264
2025-10-02T08:11:46.771854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:46.771900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:46.771909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:46.771914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:46.772396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1264 sessionId:  describe result for acl check
2025-10-02T08:11:46.772430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:46.772438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:46.772440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:46.772449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534134489746347:2673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:46.773004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534134489746347:2673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:46.780505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:46.780893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534134489746347:2673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:46.782632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:46.782648Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:46.782651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:46.782655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:46.782661Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1263 [1:7556534134489746331:2683]
2025-10-02T08:11:46.782672Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:46.782686Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:46.782690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:46.782693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:46.782695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:46.782710Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:46.782716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:46.782725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:46.782785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.782794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.782797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:46.782800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:46.782861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:46.782871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.782884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:46.782898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:46.782914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534134489746324:2683]
2025-10-02T08:11:46.782921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534134489746324:2683]
2025-10-02T08:11:46.782928Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:46.782939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:46.782954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:46.782962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:46.782971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534134949677178:2378], now have 1 active actors on pipe
2025-10-02T08:11:46.782998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534134489746324:2683]
2025-10-02T08:11:46.783000Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:46.783045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:46.783058Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:46.783063Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:46.783256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1263
2025-10-02T08:11:46.791311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534134489746347:2673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:46.791329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534134489746347:2673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:46.791332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534134489746347:2673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:46.791342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:46.792152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1263
2025-10-02T08:11:46.792174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534134489746387:2673], now have 1 active actors on pipe
2025-10-02T08:11:46.792269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.792278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.792305Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89816e33-3ddc9a57-618b2721-8689ad84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:46.792314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:46.792321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:46.792323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:46.792336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:46.792351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:46.792371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:46.792478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.792483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.792494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:46.792518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1264 partition: 0 MaxSeqNo: 17 sessionId: src_id|89816e33-3ddc9a57-618b2721-8689ad84_0
2025-10-02T08:11:46.793970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d36a153-3cb4e604-abcaedc7-52d27fde_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|89816e33-3ddc9a57-618b2721-8689ad84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:46.797191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89816e33-3ddc9a57-618b2721-8689ad84_0] Write session: try to update token
2025-10-02T08:11:46.797216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89816e33-3ddc9a57-618b2721-8689ad84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:46.807740Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:46.807755Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:46.807765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534134489746324:2683]
2025-10-02T08:11:46.807805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:46.808113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:46.808259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:46.808398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:46.808530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:46.808861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:46.808909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:46.809735Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:46.816318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId: src_id|89816e33-3ddc9a57-618b2721-8689ad84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:46.818846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:46.819725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.819742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.819779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:46.819805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:46.819882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:46.819889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:46.820076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.820137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.820196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.820258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.820307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.820312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.820379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.820433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.820491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.820553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.820595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.820598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.820666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.820724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.820780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.820860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.820908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.820911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.820984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.821047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.821106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.821172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.821212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.821215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.821282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.821338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.821421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.821484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.821530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.821536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.821602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.821658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.821716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.821775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.821836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.821841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.821910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.821967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.822032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.822094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.822137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.822139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.822207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.822264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.822324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.822384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.822443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.822446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.822513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.822579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.822648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.822711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.822835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.822846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.822918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:46.822982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:46.823040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:46.823098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:46.823140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:46.823143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:46.823183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:46.823253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:46.823274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:46.823278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:46.823308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:46.823319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:46.823323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:46.823325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:46.823328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:46.823751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:46.823766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:46.823772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:46.823776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:46.823778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:46.823782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:46.824615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:46.824638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:46.824646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:46.824649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:46.824653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:46.824656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:46.825169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:46.825188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:46.825193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:46.825198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:46.825203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:46.827775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:46.827792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:46.827804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392706827
2025-10-02T08:11:46.827927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:46.827940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:46.827945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:46.827951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:46.827956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:46.827960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:46.828487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:46.828510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:46.828515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:46.828519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:46.828523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:46.828528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:46.829080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:46.829099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:46.829106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:46.829113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:46.829117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:46.829120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:46.829577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:46.829597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:46.829606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:46.830700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:46.830716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:46.830721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:46.830727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:46.830735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392706830
2025-10-02T08:11:46.831021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:46.831039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:46.831045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:46.831048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:46.831053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:46.831056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:46.831536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:46.831556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:46.831562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:46.831567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:46.831570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:46.831575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:46.832043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:46.832058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:46.832153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392706831
2025-10-02T08:11:46.832926Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:46.832945Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:46.832953Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:46.832960Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:46.834564Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:46.834576Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:46.834577Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:46.834587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534134489746324:2683]
2025-10-02T08:11:46.834591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534134489746324:2683]
2025-10-02T08:11:46.834656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:46.834667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:46.834669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:46.834687Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:46.834693Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:46.834803Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:46.849576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534134489746399:3998]
2025-10-02T08:11:46.849803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1263, pipe: [1:7556534134489746399:3998]
2025-10-02T08:11:46.996027Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:46.996399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534134489746399:3998], now have 1 active actors on pipe
2025-10-02T08:11:46.996663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:46.996671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:46.996695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1264 reason: error at write: Disconnected sessionId: src_id|89816e33-3ddc9a57-618b2721-8689ad84_0
2025-10-02T08:11:46.997043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89816e33-3ddc9a57-618b2721-8689ad84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:46.997061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89816e33-3ddc9a57-618b2721-8689ad84_0] Write session will restart in 0.006411s
2025-10-02T08:11:46.996995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:46.997091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89816e33-3ddc9a57-618b2721-8689ad84_0] Write session: Do CDS request
2025-10-02T08:11:46.997099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89816e33-3ddc9a57-618b2721-8689ad84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:46.996790Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:46.996873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1264 sessionId: src_id|89816e33-3ddc9a57-618b2721-8689ad84_0 is DEAD
2025-10-02T08:11:46.997039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534134489746399:3998]
2025-10-02T08:11:47.004445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89816e33-3ddc9a57-618b2721-8689ad84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.004571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:47.004594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1265
2025-10-02T08:11:47.004785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.004838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:47.004843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:47.004847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:47.005248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1265 sessionId:  describe result for acl check
2025-10-02T08:11:47.005283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:47.005285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:47.005288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:47.005294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534138784713789:2655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:47.005813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534138784713789:2655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:47.007431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:47.008554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534138784713789:2655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:47.008665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:47.008865Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:47.008880Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:47.008890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:47.008944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:47.008979Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534138784713837:2654]
2025-10-02T08:11:47.009580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:47.009834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:47.009880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:47.010183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:47.010237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.010243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.010244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.010245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.010246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.010251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.010260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.010264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.010267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.010271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.010276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.010283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.010293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.010298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.010305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.010314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.010318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.010327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.010333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.010337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.010360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:47.016483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534138784713789:2655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:47.016506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534138784713789:2655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:47.016509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534138784713789:2655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:47.016519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:47.019922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:47.021737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:47.021752Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:47.021755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:47.021758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:47.021764Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1264 [1:7556534138784713837:2654]
2025-10-02T08:11:47.021775Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:47.021791Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:47.021795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.021801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.021803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.021818Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:47.021823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:47.021828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:47.021896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.021904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.021907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:47.021909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:47.021973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:47.021980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.021993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.022009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:47.022030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534138784713827:2654]
2025-10-02T08:11:47.022036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534138784713827:2654]
2025-10-02T08:11:47.022043Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:47.022056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:47.022059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:47.022062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:47.022073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:47.022075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:47.022087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784713863:2655], now have 1 active actors on pipe
2025-10-02T08:11:47.022095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534134949677197:2378], now have 1 active actors on pipe
2025-10-02T08:11:47.022126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534138784713827:2654]
2025-10-02T08:11:47.022137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:47.022148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:47.022183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1264
2025-10-02T08:11:47.022195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.022202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.022224Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:47.022543Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1264
2025-10-02T08:11:47.022237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.022880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.022883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:47.022893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.022905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:47.022943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.022994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.023017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.023032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.023063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1265 partition: 0 MaxSeqNo: 17 sessionId: src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0
2025-10-02T08:11:47.024969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89816e33-3ddc9a57-618b2721-8689ad84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:47.028790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0] Write session: try to update token
2025-10-02T08:11:47.029774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:47.044394Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:47.044411Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:47.044413Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:47.044422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534138784713827:2654]
2025-10-02T08:11:47.044427Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534138784713827:2654]
2025-10-02T08:11:47.044471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:47.044478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.044483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:47.044616Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:47.045638Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:47.045652Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:47.067647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId: src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:47.070359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:47.096416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534138784713879:3998]
2025-10-02T08:11:47.096513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1264, pipe: [1:7556534138784713879:3998]
2025-10-02T08:11:47.190348Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:47.190694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.190707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.190728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784713879:3998], now have 1 active actors on pipe
2025-10-02T08:11:47.190876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:47.190887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:47.190953Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:47.190964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1265 reason: error at write: Disconnected sessionId: src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0
2025-10-02T08:11:47.191148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1265 sessionId: src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0 is DEAD
2025-10-02T08:11:47.191236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534138784713879:3998]
2025-10-02T08:11:47.191382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:47.191399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0] Write session will restart in 0.007333s
2025-10-02T08:11:47.191429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0] Write session: Do CDS request
2025-10-02T08:11:47.191440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:47.192917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:47.201033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.201416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:47.201432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1266
2025-10-02T08:11:47.201650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.201713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:47.201730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:47.201736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:47.201770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:47.202239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1266 sessionId:  describe result for acl check
2025-10-02T08:11:47.202289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:47.202291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:47.202293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:47.202300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534138784714014:2663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:47.202942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534138784714014:2663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:47.203178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:47.203444Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:47.203460Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:47.203474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:47.203548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:47.203612Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534138784714019:2665]
2025-10-02T08:11:47.204333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:47.206701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:47.206782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:47.207177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:47.207235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.207237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.207238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.207240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.207241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.207249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.207261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.207267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.207271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.207276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.207285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.207298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.207306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.207312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.207316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.207321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.207325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.207330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.207341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.207346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.207368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:47.211034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534138784714014:2663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:47.217001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534138784714014:2663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:47.217022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534138784714014:2663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:47.217027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534138784714014:2663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:47.217048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:47.220358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:47.222417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:47.222438Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:47.222441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:47.222445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:47.222454Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1265 [1:7556534138784714019:2665]
2025-10-02T08:11:47.222475Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:47.222498Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:47.222508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.222512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.222516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.222536Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:47.222547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:47.222555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:47.222637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.222646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.222650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:47.222654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:47.222738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:47.222745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.222763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.222777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:47.222801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534138784714008:2665]
2025-10-02T08:11:47.222807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534138784714008:2665]
2025-10-02T08:11:47.222817Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:47.222838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:47.222850Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:47.222860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:47.222863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:47.222863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:47.222875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784714061:2663], now have 1 active actors on pipe
2025-10-02T08:11:47.222919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534138784714008:2665]
2025-10-02T08:11:47.222933Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:47.222943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534139244644502:2378], now have 1 active actors on pipe
2025-10-02T08:11:47.222955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:47.222992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1265
2025-10-02T08:11:47.222993Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1265
2025-10-02T08:11:47.223118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.223128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.223157Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13703820-6f451e78-8c59941b-a0907f4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:47.223176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.223184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.223187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:47.223198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.223213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:47.223238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.223271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.223277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.223292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.223328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1266 partition: 0 MaxSeqNo: 17 sessionId: src_id|13703820-6f451e78-8c59941b-a0907f4a_0
2025-10-02T08:11:47.223728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55ceebb-25340e3c-1aea3bad-e640dce1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|13703820-6f451e78-8c59941b-a0907f4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:47.227006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13703820-6f451e78-8c59941b-a0907f4a_0] Write session: try to update token
2025-10-02T08:11:47.227025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13703820-6f451e78-8c59941b-a0907f4a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:47.234420Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:47.234435Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:47.234442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534138784714008:2665]
2025-10-02T08:11:47.234486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:47.234653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:47.234780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.234903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.235042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.235228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:47.235257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:47.235404Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:47.246761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId: src_id|13703820-6f451e78-8c59941b-a0907f4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:47.250034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:47.251484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.251504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.251544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:47.251584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:47.251778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.251784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.252015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.252095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.252171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.252248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.252303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.252308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.252399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.252469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.252540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.252615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.252665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.252667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.252754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.252850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.252929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.253008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.253068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.253071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.253156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.253229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.253664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.254051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.254107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.254109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.254198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.254273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.254561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.254632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.254680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.254682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.254757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.254828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.254907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.254985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.255036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.255038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.255126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.255190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.255258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.255322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.255372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.255374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.255446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.255515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.255578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.255644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.255697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.255699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.255775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.255837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.255903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.255985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.256044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.256046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.256121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.256183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.256250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.256315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.256367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.256369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.256422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:47.256493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.256512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.256515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:47.256551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:47.256566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:47.256569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:47.256571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:47.256573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:47.257089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:47.257114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:47.257124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:47.257127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:47.257132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:47.257136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:47.267457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:47.267509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:47.267525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:47.267529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:47.267534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:47.267538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:47.268203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:47.268222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:47.268230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:47.268235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:47.268238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:47.276057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:47.276093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:47.276113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392707276
2025-10-02T08:11:47.276268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:47.276283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:47.276291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:47.276297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:47.276305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:47.276308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:47.277515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:47.277560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:47.277569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:47.277574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:47.277578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:47.277585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:47.278141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:47.278172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:47.278181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:47.278185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:47.278189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:47.278194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:47.278733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:47.278762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:47.278768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:47.280046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:47.280068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:47.280076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:47.280081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:47.280090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392707279
2025-10-02T08:11:47.280434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:47.280449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:47.280454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:47.280458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:47.280463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:47.280467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:47.281097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:47.281121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:47.281127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:47.281131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:47.281135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:47.281139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:47.281662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:47.281674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.281787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392707281
2025-10-02T08:11:47.285635Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:47.285683Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:47.285698Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:47.285710Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:47.287502Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:47.287516Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:47.287518Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:47.287530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534138784714008:2665]
2025-10-02T08:11:47.287535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534138784714008:2665]
2025-10-02T08:11:47.287606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:47.287613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.287615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:47.287628Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:47.287653Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:47.287760Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:47.291758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534138784714082:3998]
2025-10-02T08:11:47.292194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1265, pipe: [1:7556534138784714082:3998]
2025-10-02T08:11:47.439513Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:47.439903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784714082:3998], now have 1 active actors on pipe
2025-10-02T08:11:47.440307Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:47.440121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534138784714082:3998]
2025-10-02T08:11:47.440527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13703820-6f451e78-8c59941b-a0907f4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:47.440157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:47.440541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13703820-6f451e78-8c59941b-a0907f4a_0] Write session will restart in 0.005546s
2025-10-02T08:11:47.440159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:47.440188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1266 reason: error at write: Disconnected sessionId: src_id|13703820-6f451e78-8c59941b-a0907f4a_0
2025-10-02T08:11:47.440197Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:47.440375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1266 sessionId: src_id|13703820-6f451e78-8c59941b-a0907f4a_0 is DEAD
2025-10-02T08:11:47.440565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13703820-6f451e78-8c59941b-a0907f4a_0] Write session: Do CDS request
2025-10-02T08:11:47.440572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13703820-6f451e78-8c59941b-a0907f4a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:47.447460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13703820-6f451e78-8c59941b-a0907f4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.447449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:47.447466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1267
2025-10-02T08:11:47.448038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.448090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:47.448100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:47.448117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:47.448530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1267 sessionId:  describe result for acl check
2025-10-02T08:11:47.448563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:47.448565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:47.448566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:47.448571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534138784714159:2647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:47.449179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534138784714159:2647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:47.451488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534138784714159:2647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:47.458082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:47.458481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534138784714159:2647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:47.458488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534138784714159:2647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:47.458491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534138784714159:2647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:47.458500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:47.459802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:47.460046Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:47.460056Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:47.460066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:47.460118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:47.460251Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534138784714245:2656]
2025-10-02T08:11:47.460782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:47.460991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:47.461024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:47.461243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:47.461285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.461290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.461290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.461291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.461291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.461295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.461302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.461304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.461306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.461308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.461312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.461316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.461320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.461323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.461325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.461329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.461331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.461334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.461336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.461339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.461352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:47.469579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:47.471089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:47.471103Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:47.471105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:47.471108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:47.471113Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1266 [1:7556534138784714245:2656]
2025-10-02T08:11:47.471121Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:47.471135Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:47.471141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.471143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.471144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.471155Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:47.471158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:47.471164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:47.471218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.471226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.471229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:47.471231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:47.471278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:47.471284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.471294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.471301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:47.471317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534138784714233:2656]
2025-10-02T08:11:47.471321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534138784714233:2656]
2025-10-02T08:11:47.471327Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:47.471336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:47.471347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:47.471353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:47.471357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:47.471361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784714240:2647], now have 1 active actors on pipe
2025-10-02T08:11:47.471361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:47.471373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1266
2025-10-02T08:11:47.471387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534139244644509:2378], now have 1 active actors on pipe
2025-10-02T08:11:47.471388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534138784714233:2656]
2025-10-02T08:11:47.471390Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:47.471394Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:47.471395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.471398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.471428Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:47.471439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.471445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.471451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:47.471458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.471470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:47.471491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.471550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.471556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.471568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.471608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1267 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0
2025-10-02T08:11:47.471907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13703820-6f451e78-8c59941b-a0907f4a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:47.471470Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1266
2025-10-02T08:11:47.478440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0] Write session: try to update token
2025-10-02T08:11:47.478459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:47.489451Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:47.489474Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:47.489477Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:47.489501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534138784714233:2656]
2025-10-02T08:11:47.489505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534138784714233:2656]
2025-10-02T08:11:47.489548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:47.489562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.489564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:47.489563Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:47.489570Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:47.489715Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:47.493206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId: src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:47.495819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:47.540306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534138784714274:3998]
2025-10-02T08:11:47.540412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1266, pipe: [1:7556534138784714274:3998]
2025-10-02T08:11:47.632981Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:47.633227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.633234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.633271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784714274:3998], now have 1 active actors on pipe
2025-10-02T08:11:47.634808Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:47.635087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:47.635138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1267 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0
2025-10-02T08:11:47.635291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1267 sessionId: src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0 is DEAD
2025-10-02T08:11:47.635438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534138784714274:3998]
2025-10-02T08:11:47.635711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:47.635718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0] Write session will restart in 0.005289s
2025-10-02T08:11:47.635741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0] Write session: Do CDS request
2025-10-02T08:11:47.635746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:47.634994Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:47.642754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:47.644565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:47.644738Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:47.644746Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:47.644754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:47.644792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:47.644848Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534138784714432:2629]
2025-10-02T08:11:47.645641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.645490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:47.645716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:47.645753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:47.645950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:47.645961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1268
2025-10-02T08:11:47.645996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:47.646045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.646050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.646051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.646052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.646053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.646059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.646063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.646067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.646071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.646074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.646077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.646082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.646084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:47.646088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:47.646089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.646091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:47.646094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.646099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.646105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.646109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.646113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.646117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.646121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.646125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.646143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:47.646449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1268 sessionId:  describe result for acl check
2025-10-02T08:11:47.646474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:47.646476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:47.646477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:47.646481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534138784714448:2621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:47.647068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534138784714448:2621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:47.653138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534138784714448:2621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:47.654515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:47.656109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:47.656120Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:47.656124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:47.656127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:47.656133Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1267 [1:7556534138784714432:2629]
2025-10-02T08:11:47.656144Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:47.656157Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:47.656161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.656164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.656165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.656177Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:47.656185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:47.656190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:47.656248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.656254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.656258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:47.656261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:47.656328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:47.656336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.656348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.656361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:47.656380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534138784714410:2629]
2025-10-02T08:11:47.656388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534138784714410:2629]
2025-10-02T08:11:47.656394Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:47.656406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534139244644530:2378], now have 1 active actors on pipe
2025-10-02T08:11:47.656407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:47.656410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:47.656413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:47.656426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:47.656429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:47.656458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534138784714410:2629]
2025-10-02T08:11:47.656470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:47.656479Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:47.656494Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1267
2025-10-02T08:11:47.656589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534138784714448:2621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:47.656604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534138784714448:2621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:47.656607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534138784714448:2621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:47.656615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:47.656793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1267
2025-10-02T08:11:47.656816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784714484:2621], now have 1 active actors on pipe
2025-10-02T08:11:47.656822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.656826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.656849Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28510f71-bdd7a653-81a47aef-61dc9327_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:47.656860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.656863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.656865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:47.656873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.656888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:47.656901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.656931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.656937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.656948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.656981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1268 partition: 0 MaxSeqNo: 17 sessionId: src_id|28510f71-bdd7a653-81a47aef-61dc9327_0
2025-10-02T08:11:47.660899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4edf45-98d43662-1b808c5a-94887bd7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|28510f71-bdd7a653-81a47aef-61dc9327_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:47.663632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28510f71-bdd7a653-81a47aef-61dc9327_0] Write session: try to update token
2025-10-02T08:11:47.663649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28510f71-bdd7a653-81a47aef-61dc9327_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:47.667616Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:47.667631Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:47.667638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534138784714410:2629]
2025-10-02T08:11:47.667674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:47.667675Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:47.667832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:47.667988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.668111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.668254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.668789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:47.668848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:47.679275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId: src_id|28510f71-bdd7a653-81a47aef-61dc9327_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:47.681921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:47.681985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.682001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.682030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:47.682050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:47.682254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.682263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.682431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.682492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.682563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.682647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.682700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.682712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.682797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.682862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.682922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.682979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.683023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.683034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.683109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.683182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.683268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.683350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.683398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.683406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.683475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.683540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.683603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.683668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.683715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.683723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.683808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.683885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.683960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.684043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.684087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.684094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.684165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.684225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.684294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.684376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.684435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.684445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.684522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.684583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.684649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.684712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.684755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.684762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.685293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.685362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.685429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.685495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.685540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.685547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.685619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.685684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.685753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.685819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.685878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.685885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.685956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.686021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.686086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.686154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.686199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.686201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.686238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:47.686309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.686333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.686340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:47.686372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:47.686388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:47.686395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:47.686398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:47.686403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:47.686865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:47.686897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:47.686909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:47.686918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:47.686923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:47.686929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:47.687697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:47.687722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:47.687728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:47.687732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:47.687735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:47.687739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:47.688317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:47.688343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:47.688349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:47.688353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:47.688357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:47.689651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:47.689675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:47.689689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392707689
2025-10-02T08:11:47.689863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:47.689884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:47.689889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:47.689893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:47.689898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:47.689901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:47.690384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:47.690403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:47.690407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:47.690411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:47.690413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:47.690415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:47.690826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:47.690844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:47.690851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:47.690854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:47.690857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:47.690860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:47.691353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:47.691378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:47.691383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:47.692491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:47.692507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:47.692512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:47.692516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:47.692524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392707692
2025-10-02T08:11:47.692834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:47.692852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:47.692862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:47.692865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:47.692870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:47.692878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:47.693299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:47.693321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:47.693326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:47.693331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:47.693335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:47.693339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:47.693813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:47.693830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.693937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392707692
2025-10-02T08:11:47.694731Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:47.694754Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:47.694761Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:47.694769Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:47.696428Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:47.696439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:47.696441Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:47.696448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534138784714410:2629]
2025-10-02T08:11:47.696452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534138784714410:2629]
2025-10-02T08:11:47.696492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:47.696496Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:47.696510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:47.696514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.696516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:47.696646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:47.735361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534138784714512:3998]
2025-10-02T08:11:47.735452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1267, pipe: [1:7556534138784714512:3998]
2025-10-02T08:11:47.841240Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:47.841640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784714512:3998], now have 1 active actors on pipe
2025-10-02T08:11:47.841851Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:47.842112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:47.842144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28510f71-bdd7a653-81a47aef-61dc9327_0
2025-10-02T08:11:47.842192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534138784714512:3998]
2025-10-02T08:11:47.842313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1268 sessionId: src_id|28510f71-bdd7a653-81a47aef-61dc9327_0 is DEAD
2025-10-02T08:11:47.841940Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:47.842642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28510f71-bdd7a653-81a47aef-61dc9327_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:47.842654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28510f71-bdd7a653-81a47aef-61dc9327_0] Write session will restart in 0.005750s
2025-10-02T08:11:47.842678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28510f71-bdd7a653-81a47aef-61dc9327_0] Write session: Do CDS request
2025-10-02T08:11:47.842683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28510f71-bdd7a653-81a47aef-61dc9327_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:47.849921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28510f71-bdd7a653-81a47aef-61dc9327_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.850205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:47.850221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1269
2025-10-02T08:11:47.853173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:47.853220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:47.853226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:47.853230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:47.853702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1269 sessionId:  describe result for acl check
2025-10-02T08:11:47.853743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:47.853745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:47.853746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:47.853751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534138784714622:2610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:47.855075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534138784714622:2610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:47.857308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534138784714622:2610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:47.857562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:47.860479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:47.860685Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:47.860704Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:47.860716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:47.860776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:47.860836Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534138784714669:2615]
2025-10-02T08:11:47.861477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:47.861768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:47.861823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:47.862141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:47.862201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.862203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.862204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.862205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.862206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.862211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.862222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.862226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.862230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.862235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.862241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.862249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:47.862255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.862261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:47.862266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.862271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:47.862278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.862285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.862290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.862295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.862319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:47.865025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534138784714622:2610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:47.865040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534138784714622:2610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:47.865044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534138784714622:2610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:47.865053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:47.877343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:47.879190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:47.879215Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:47.879218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:47.879222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:47.879230Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1268 [1:7556534138784714669:2615]
2025-10-02T08:11:47.879243Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:47.879259Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:47.879262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.879266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.879269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.879289Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:47.879300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:47.879307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:47.879375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.879384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.879388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:47.879391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:47.879462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:47.879470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.879486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:47.879504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:47.879524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784714685:2610], now have 1 active actors on pipe
2025-10-02T08:11:47.879536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534138784714653:2615]
2025-10-02T08:11:47.879538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534138784714653:2615]
2025-10-02T08:11:47.879541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1268
2025-10-02T08:11:47.879545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:47.879557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534139244644545:2378], now have 1 active actors on pipe
2025-10-02T08:11:47.879562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:47.879566Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:47.879567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:47.879583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:47.879590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:47.879597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.879605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.879646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534138784714653:2615]
2025-10-02T08:11:47.879658Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:47.879669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:47.879679Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4707e65d-61b93280-797d27c-90dc5911_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:47.879690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.879693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.879696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:47.879706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.879715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:47.879752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.879848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.879856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.879870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:47.879913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1269 partition: 0 MaxSeqNo: 17 sessionId: src_id|4707e65d-61b93280-797d27c-90dc5911_0
2025-10-02T08:11:47.880278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28510f71-bdd7a653-81a47aef-61dc9327_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4707e65d-61b93280-797d27c-90dc5911_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:47.882875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4707e65d-61b93280-797d27c-90dc5911_0] Write session: try to update token
2025-10-02T08:11:47.882891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4707e65d-61b93280-797d27c-90dc5911_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:47.884941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1268
2025-10-02T08:11:47.895139Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:47.895163Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:47.895172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534138784714653:2615]
2025-10-02T08:11:47.895221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:47.895395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:47.895549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.895702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.895847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:47.896062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:47.896104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:47.897678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId: src_id|4707e65d-61b93280-797d27c-90dc5911_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:47.898136Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:47.900359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:47.900471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.900487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.900520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:47.900543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:47.900935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:47.900961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:47.901225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.901313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.901408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.901492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.901555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.901566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.901650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.901733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.901831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.901916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.901981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.901991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.902086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.902166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.902248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.902327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.902386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.902397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.902484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.902567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.902664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.902759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.902825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.902834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.902937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.903020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.903108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.903203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.903268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.903278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.903379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.903455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.903537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.903619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.903681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.903690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.903778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.903854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.903942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.904044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.904108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.904117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.904209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.904289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.904370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.904453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.904514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.904523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.904609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.904689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.904771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.904993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.905109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.905112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.905200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:47.905268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:47.905343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:47.905431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:47.905498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:47.905501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:47.905561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:47.905649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:47.905673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:47.905677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:47.905723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:47.905739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:47.905743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:47.905746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:47.905749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:47.906198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:47.906223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:47.906231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:47.906235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:47.906238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:47.906242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:47.906857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:47.906876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:47.906882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:47.906886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:47.906891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:47.906894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:47.907462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:47.907476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:47.907481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:47.907486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:47.907493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:47.909032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:47.909043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:47.909059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392707908
2025-10-02T08:11:47.909244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:47.909251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:47.909257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:47.909261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:47.909269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:47.909273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:47.909905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:47.909919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:47.909925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:47.909929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:47.909937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:47.910263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:47.910899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:47.910914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:47.910922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:47.910928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:47.910932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:47.910936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:47.911444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:47.911457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:47.911464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:47.912878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:47.912897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:47.912903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:47.912910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:47.912921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392707912
2025-10-02T08:11:47.913295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:47.913309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:47.913317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:47.913323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:47.913327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:47.913331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:47.913916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:47.913930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:47.913936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:47.913940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:47.913944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:47.913948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:47.914454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:47.914466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:47.914592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392707914
2025-10-02T08:11:47.915777Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:47.915796Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:47.915803Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:47.915810Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:47.918107Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:47.918111Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:47.918112Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:47.918123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534138784714653:2615]
2025-10-02T08:11:47.918127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534138784714653:2615]
2025-10-02T08:11:47.918207Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:47.918214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:47.918218Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:47.918220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:47.918223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:47.918397Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:47.942755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534138784714708:3998]
2025-10-02T08:11:47.943028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1268, pipe: [1:7556534138784714708:3998]
2025-10-02T08:11:48.095337Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:48.095776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534138784714708:3998], now have 1 active actors on pipe
2025-10-02T08:11:48.095919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534138784714708:3998]
2025-10-02T08:11:48.095954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:48.095961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:48.095995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1269 reason: error at write: Disconnected sessionId: src_id|4707e65d-61b93280-797d27c-90dc5911_0
2025-10-02T08:11:48.096060Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:48.096215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1269 sessionId: src_id|4707e65d-61b93280-797d27c-90dc5911_0 is DEAD
2025-10-02T08:11:48.096415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4707e65d-61b93280-797d27c-90dc5911_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:48.096427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4707e65d-61b93280-797d27c-90dc5911_0] Write session will restart in 0.005134s
2025-10-02T08:11:48.096448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4707e65d-61b93280-797d27c-90dc5911_0] Write session: Do CDS request
2025-10-02T08:11:48.096454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4707e65d-61b93280-797d27c-90dc5911_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:48.096412Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:48.103217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4707e65d-61b93280-797d27c-90dc5911_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.103345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:48.103364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1270
2025-10-02T08:11:48.103565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.103601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:48.103612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:48.103622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:48.104073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1270 sessionId:  describe result for acl check
2025-10-02T08:11:48.104107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:48.104109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:48.104111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:48.104116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534143079682128:2574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:48.104674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534143079682128:2574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:48.104724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:48.106054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:48.106401Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:48.106414Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:48.106428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:48.106494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:48.106552Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534143079682156:2598]
2025-10-02T08:11:48.106964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534143079682128:2574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:48.107250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:48.107446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:48.107507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:48.107871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:48.107913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.107915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.107916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.107918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.107919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.107925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.107935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.107939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.107943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.107946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.107953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.107960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.107966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.107980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.107985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.107990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.107995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.108007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.108012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.108017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.108039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:48.113624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534143079682128:2574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:48.113642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534143079682128:2574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:48.113646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534143079682128:2574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:48.113656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:48.116738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:48.118386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:48.118407Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:48.118410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:48.118414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:48.118421Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1269 [1:7556534143079682156:2598]
2025-10-02T08:11:48.118433Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:48.118450Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:48.118454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.118457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.118459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.118475Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:48.118481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:48.118488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:48.118550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.118563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.118568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:48.118574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:48.118642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:48.118652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.118667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.118680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:48.118703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079682182:2574], now have 1 active actors on pipe
2025-10-02T08:11:48.118716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534143079682132:2598]
2025-10-02T08:11:48.118718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534143079682132:2598]
2025-10-02T08:11:48.118726Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:48.118736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534143539611864:2378], now have 1 active actors on pipe
2025-10-02T08:11:48.118736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1269
2025-10-02T08:11:48.118739Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:48.118743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:48.118750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:48.118763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:48.118766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:48.118773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.118778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.118822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534143079682132:2598]
2025-10-02T08:11:48.118841Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:48.118851Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:48.118862Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:48.118874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.118878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.118880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:48.118889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.118899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:48.118936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.119002Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1269
2025-10-02T08:11:48.119237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.119250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.119279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.119329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1270 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0
2025-10-02T08:11:48.119682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4707e65d-61b93280-797d27c-90dc5911_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:48.122315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0] Write session: try to update token
2025-10-02T08:11:48.122332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:48.129194Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:11:48.129331Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 10 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:11:48.129372Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-02T08:11:48.129694Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:11:48.130795Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 11 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:11:48.130819Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:11:48.136887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId: src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:48.137903Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:48.137920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:48.137924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:48.137938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534143079682132:2598]
2025-10-02T08:11:48.137943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534143079682132:2598]
2025-10-02T08:11:48.137990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:48.137997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:48.138001Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:48.138006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.138008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:48.138178Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:48.140096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:48.196156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534143079682213:3998]
2025-10-02T08:11:48.196285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1269, pipe: [1:7556534143079682213:3998]
2025-10-02T08:11:48.283567Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:48.283917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.283931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.283979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079682213:3998], now have 1 active actors on pipe
2025-10-02T08:11:48.284082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534143079682213:3998]
2025-10-02T08:11:48.284106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:48.284107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:48.284155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1270 reason: error at write: Disconnected sessionId: src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0
2025-10-02T08:11:48.284216Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:48.284228Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:48.284343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1270 sessionId: src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0 is DEAD
2025-10-02T08:11:48.284603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:48.284614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0] Write session will restart in 0.008457s
2025-10-02T08:11:48.284643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0] Write session: Do CDS request
2025-10-02T08:11:48.284650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:48.291370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:48.292848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:48.293116Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:48.293132Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:48.293145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:48.293211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:48.293280Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534143079682347:2586]
2025-10-02T08:11:48.293850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:48.294085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:48.294128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:48.294483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.294412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:48.294461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.294462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.294463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.294464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.294465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.294471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.294479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.294483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.294486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.294489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.294494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.294501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.294507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.294513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.294516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:48.294517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.294521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.294521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1271
2025-10-02T08:11:48.294525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.294530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.294534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.294539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.294555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:48.294755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.294794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:48.294805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:48.294808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:48.295183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1271 sessionId:  describe result for acl check
2025-10-02T08:11:48.295216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:48.295222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:48.295224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:48.295229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534143079682363:2583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:48.295698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534143079682363:2583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:48.298209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534143079682363:2583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:48.302804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534143079682363:2583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:48.302821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534143079682363:2583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:48.302825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534143079682363:2583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:48.302835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:48.303139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:48.304789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:48.304826Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:48.304829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:48.304833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:48.304839Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1270 [1:7556534143079682347:2586]
2025-10-02T08:11:48.304851Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:48.304868Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:48.304875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.304878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.304881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.304898Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:48.304908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:48.304914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:48.304984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.304990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.304993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:48.304996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:48.305074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:48.305084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.305099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.305111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:48.305129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079682395:2583], now have 1 active actors on pipe
2025-10-02T08:11:48.305141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534143079682341:2586]
2025-10-02T08:11:48.305144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534143079682341:2586]
2025-10-02T08:11:48.305149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1270
2025-10-02T08:11:48.305151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:48.305160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534143539611874:2378], now have 1 active actors on pipe
2025-10-02T08:11:48.305161Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:48.305164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:48.305167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:48.305181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:48.305190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:48.305196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.305200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.305202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1270
2025-10-02T08:11:48.305241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534143079682341:2586]
2025-10-02T08:11:48.305249Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:48.305251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:48.305263Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:48.305269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.305279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.305281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:48.305289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.305302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:48.305352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.305401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.305408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.305420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.305467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1271 partition: 0 MaxSeqNo: 17 sessionId: src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0
2025-10-02T08:11:48.305859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb159e05-9ce90199-e6e604ee-e3632fe0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:48.308504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0] Write session: try to update token
2025-10-02T08:11:48.308519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:48.323362Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:48.323388Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:48.323391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:48.323399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534143079682341:2586]
2025-10-02T08:11:48.323403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534143079682341:2586]
2025-10-02T08:11:48.323449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:48.323456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.323458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:48.323462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId: src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:48.323610Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:48.325693Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:48.325710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:48.326060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:48.384092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534143079682409:3998]
2025-10-02T08:11:48.384188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1270, pipe: [1:7556534143079682409:3998]
2025-10-02T08:11:48.459907Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:48.460296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.460307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.460347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079682409:3998], now have 1 active actors on pipe
2025-10-02T08:11:48.460746Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:48.460568Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:48.460897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:48.460944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1271 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0
2025-10-02T08:11:48.461088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1271 sessionId: src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0 is DEAD
2025-10-02T08:11:48.461184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534143079682409:3998]
2025-10-02T08:11:48.461346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:48.461361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0] Write session will restart in 0.008680s
2025-10-02T08:11:48.461389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0] Write session: Do CDS request
2025-10-02T08:11:48.461395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:48.467791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:48.469244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:48.469425Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:48.469434Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:48.469443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:48.469488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:48.469531Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534143079682543:2572]
2025-10-02T08:11:48.470009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:48.470200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:48.470238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:48.470506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:48.470546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.470547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.470548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.470549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.470550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.470554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.470565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.470568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.470572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.470575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.470580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.470586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.470592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.470596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.470603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.470613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.470617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.470622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.470631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.470635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.470653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:48.471299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.471525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:48.471536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1272
2025-10-02T08:11:48.471691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.471716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:48.471722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:48.471725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:48.472141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1272 sessionId:  describe result for acl check
2025-10-02T08:11:48.472176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:48.472182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:48.472184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:48.472188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534143079682559:2565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:48.472648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534143079682559:2565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:48.474562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534143079682559:2565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:48.477912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534143079682559:2565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:48.477925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534143079682559:2565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:48.477928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534143079682559:2565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:48.477939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:48.478418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:48.479992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:48.480005Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:48.480007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:48.480010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:48.480017Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1271 [1:7556534143079682543:2572]
2025-10-02T08:11:48.480027Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:48.480045Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:48.480047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.480050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.480055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.480073Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:48.480081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:48.480087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:48.480142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.480148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.480151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:48.480154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:48.480215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:48.480221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.480234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.480249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:48.480266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079682590:2565], now have 1 active actors on pipe
2025-10-02T08:11:48.480267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1271
2025-10-02T08:11:48.480272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534143539611881:2378], now have 1 active actors on pipe
2025-10-02T08:11:48.480278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534143079682537:2572]
2025-10-02T08:11:48.480280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534143079682537:2572]
2025-10-02T08:11:48.480291Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:48.480303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.480303Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:48.480306Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:48.480309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.480325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:48.480341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:48.480347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:48.480385Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:48.480395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.480401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.480403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:48.480412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.480423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:48.480378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1271
2025-10-02T08:11:48.480432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534143079682537:2572]
2025-10-02T08:11:48.480440Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:48.480446Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:48.480462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.480537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.480543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.480556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.480589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1272 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0
2025-10-02T08:11:48.480933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3347e69d-4e107c29-bb75e2f0-e92a50a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:48.483530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0] Write session: try to update token
2025-10-02T08:11:48.483545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:48.497584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId: src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:48.498502Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:48.498515Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:48.498517Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:48.498526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534143079682537:2572]
2025-10-02T08:11:48.498531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534143079682537:2572]
2025-10-02T08:11:48.498574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:48.498578Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:48.498582Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:48.498584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.498587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:48.498729Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:48.500557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:48.562289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534143079682607:3998]
2025-10-02T08:11:48.562414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1271, pipe: [1:7556534143079682607:3998]
2025-10-02T08:11:48.662158Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:48.663000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.663018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.663058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079682607:3998], now have 1 active actors on pipe
2025-10-02T08:11:48.663249Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:48.663353Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:48.663527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534143079682607:3998]
2025-10-02T08:11:48.663549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:48.663602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1272 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0
2025-10-02T08:11:48.663764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1272 sessionId: src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0 is DEAD
2025-10-02T08:11:48.663889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:48.663898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0] Write session will restart in 0.007203s
2025-10-02T08:11:48.663924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0] Write session: Do CDS request
2025-10-02T08:11:48.663929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:48.670672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:48.671952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:48.672156Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:48.672169Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:48.672179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:48.672231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:48.672267Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534143079682759:2535]
2025-10-02T08:11:48.672927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:48.673080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.673237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:48.673313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:48.673674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:48.673760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.673761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.673762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.673763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.673764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.673771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.673781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.673785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.673789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.673792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.673799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.673807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.673814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.673818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.673823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.673827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.673834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.673838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.673843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.673847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.673864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:48.673918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:48.673924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1273
2025-10-02T08:11:48.674187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.674234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:48.674239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:48.674266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:48.674648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1273 sessionId:  describe result for acl check
2025-10-02T08:11:48.674686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:48.674688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:48.674690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:48.674695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534143079682775:2530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:48.675240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534143079682775:2530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:48.679884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534143079682775:2530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:48.682354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:48.684152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:48.684169Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:48.684171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:48.684175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:48.684180Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1272 [1:7556534143079682759:2535]
2025-10-02T08:11:48.684191Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:48.684205Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:48.684209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.684211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.684213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.684231Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:48.684235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:48.684241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:48.684304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.684315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.684318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:48.684323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:48.684473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:48.684485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.684497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.684508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:48.684529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534143539611889:2378], now have 1 active actors on pipe
2025-10-02T08:11:48.684541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534143079682753:2535]
2025-10-02T08:11:48.684543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534143079682753:2535]
2025-10-02T08:11:48.684551Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:48.684560Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:48.684563Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:48.684522Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1272
2025-10-02T08:11:48.684564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:48.684577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:48.684580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:48.684613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534143079682753:2535]
2025-10-02T08:11:48.684625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:48.684644Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:48.684928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534143079682775:2530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:48.684942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534143079682775:2530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:48.684945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534143079682775:2530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:48.684952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:48.685301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1272
2025-10-02T08:11:48.685309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079682812:2530], now have 1 active actors on pipe
2025-10-02T08:11:48.685323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.685327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.685351Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:48.685357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.685360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.685362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:48.685371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.685381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:48.685397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.685425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.685427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.685438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.685462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1273 partition: 0 MaxSeqNo: 17 sessionId: src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0
2025-10-02T08:11:48.685815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8c429a6-ee35dd6b-b62fb1f0-a3075a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:48.688601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0] Write session: try to update token
2025-10-02T08:11:48.688619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:48.695812Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:48.695829Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:48.695837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534143079682753:2535]
2025-10-02T08:11:48.695877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:48.695883Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:48.696078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:48.696248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:48.696410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:48.696572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:48.696821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:48.696862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:48.704757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId: src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:48.707747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:48.707814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.707821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.707852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:48.707870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:48.707926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.707928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.708108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.708174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.708241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.708329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.708382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.708386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.708464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.708530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.708599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.708670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.708717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.708720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.708799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.708944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.709016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.709085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.709196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.709199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.709281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.709355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.709427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.709500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.709551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.709553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.709632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.709702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.709776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.709847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.709895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.709898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.709976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.710044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.710120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.710193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.710240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.710242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.710318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.710387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.710461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.710532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.710587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.710590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.710665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.710736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.710808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.710882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.710934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.710939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.711020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.711086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.711156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.711227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.711284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.711287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.711421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.711502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.711578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.711650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.711696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.711698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.711756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:48.711817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.711834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.711836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:48.711866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:48.711879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:48.711883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:48.711885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:48.711888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:48.712390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:48.712420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:48.712427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:48.712431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:48.712433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:48.712437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:48.713050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:48.713073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:48.713081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:48.713084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:48.713086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:48.713088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:48.713738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:48.713764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:48.713769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:48.713772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:48.713775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:48.715169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:48.715191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:48.715201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392708714
2025-10-02T08:11:48.715326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:48.715341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:48.715346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:48.715349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:48.715354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:48.715356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:48.715920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:48.715943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:48.715949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:48.715952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:48.715954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:48.715958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:48.716622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:48.716644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:48.716651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:48.716653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:48.716659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:48.716664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:48.717225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:48.717247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:48.717253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:48.718479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:48.718496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:48.718501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:48.718505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:48.718512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392708716
2025-10-02T08:11:48.718842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:48.718864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:48.718870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:48.718874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:48.718877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:48.718880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:48.719373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:48.719395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:48.719400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:48.719409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:48.719412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:48.719415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:48.719972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:48.720008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.720101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392708720
2025-10-02T08:11:48.722749Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:48.722776Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:48.722784Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:48.722791Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:48.722802Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:48.722805Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:48.722807Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:48.722818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534143079682753:2535]
2025-10-02T08:11:48.722821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534143079682753:2535]
2025-10-02T08:11:48.722867Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:48.722879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:48.722888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:48.722897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.722899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:48.723036Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:48.764950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534143079682848:3998]
2025-10-02T08:11:48.765127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1272, pipe: [1:7556534143079682848:3998]
2025-10-02T08:11:48.866277Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:48.866713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079682848:3998], now have 1 active actors on pipe
2025-10-02T08:11:48.867239Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:48.867735Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:48.868213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534143079682848:3998]
2025-10-02T08:11:48.868243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:48.868273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0
2025-10-02T08:11:48.868453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1273 sessionId: src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0 is DEAD
2025-10-02T08:11:48.869284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:48.869300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0] Write session will restart in 0.008035s
2025-10-02T08:11:48.869324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0] Write session: Do CDS request
2025-10-02T08:11:48.869330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:48.872785Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f2e23b84932da168] Result# TEvPutResult {Id# [72075186224037892:1272:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:48.872844Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1272:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:48.872917Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1272:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:48.877927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:48.878449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.878530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:48.878539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1274
2025-10-02T08:11:48.878673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:48.878704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:48.878713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:48.878717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:48.879099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1274 sessionId:  describe result for acl check
2025-10-02T08:11:48.879131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:48.879133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:48.879134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:48.879139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534143079682989:2504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:48.879658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:48.879793Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:48.879795Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:48.879803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:48.879846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:48.879878Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534143079682992:2506]
2025-10-02T08:11:48.880314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:48.880354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534143079682989:2504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:48.880503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:48.880528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:48.880731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:48.880758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.880758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.880759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.880760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.880760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.880765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.880771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.880773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.880775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.880777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.880780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.880784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:48.880787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.880790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:48.880792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.880795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:48.880798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.880818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.880820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.880823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.880832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:48.888750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534143079682989:2504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:48.889637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:48.891050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:48.891068Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:48.891070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:48.891073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:48.891079Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1273 [1:7556534143079682992:2506]
2025-10-02T08:11:48.891089Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:48.891105Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:48.891108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.891111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.891114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.891130Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:48.891135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:48.891140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:48.891189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.891196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.891199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:48.891202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:48.891253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:48.891259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.891272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:48.891285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:48.891305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534143539611917:2378], now have 1 active actors on pipe
2025-10-02T08:11:48.891315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534143079682981:2506]
2025-10-02T08:11:48.891321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534143079682981:2506]
2025-10-02T08:11:48.891335Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:48.891350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:48.891367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:48.891372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:48.891373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:48.891375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:48.891402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534143079682981:2506]
2025-10-02T08:11:48.891409Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:48.891413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:48.891425Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1273
2025-10-02T08:11:48.893954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534143079682989:2504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:48.893966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534143079682989:2504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:48.893970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534143079682989:2504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:48.893979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:48.894361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1273
2025-10-02T08:11:48.894371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079683044:2504], now have 1 active actors on pipe
2025-10-02T08:11:48.894376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.894381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.894405Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:48.894414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.894418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.894420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:48.894430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.894442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:48.894458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.894491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.894493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.894504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:48.894527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1274 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0
2025-10-02T08:11:48.895482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22cd257-a583e42a-7155eb6e-1175a2b0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:48.899003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0] Write session: try to update token
2025-10-02T08:11:48.899031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:48.915913Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:48.915930Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:48.915940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534143079682981:2506]
2025-10-02T08:11:48.915993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:48.916004Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:48.916161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:48.916306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:48.916444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:48.916586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:48.917132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:48.917187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:48.923370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId: src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:48.926144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:48.926265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.926278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.926312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:48.926342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:48.926389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:48.926407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:48.926585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.926667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.926751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.926829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.927116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.927131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.927210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.927281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.927353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.927431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.927480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.927487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.927561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.927632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.927706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.927770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.927815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.927818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.927896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.927968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.928055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.928125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.928175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.928177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.928253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.928318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.928384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.928449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.928493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.928496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.928572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.928639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.928707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.928778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.928849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.928852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.928933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.928998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.929070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.929135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.929178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.929181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.929252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.929314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.929377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.929445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.929517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.929520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.929591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.929654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.929717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.929784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.929825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.929828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.929899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:48.929961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:48.930026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:48.930089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:48.930144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:48.930147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:48.930190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:48.930252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:48.930272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:48.930274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:48.930307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:48.930319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:48.930323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:48.930326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:48.930329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:48.930790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:48.930808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:48.930814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:48.930818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:48.930822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:48.930825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:48.931434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:48.931451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:48.931457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:48.931463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:48.931467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:48.931471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:48.932283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:48.932296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:48.932302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:48.932306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:48.932309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:48.934075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:48.934097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:48.934137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392708933
2025-10-02T08:11:48.934263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:48.934276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:48.934281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:48.934285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:48.934290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:48.934294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:48.934802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:48.934826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:48.934835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:48.934839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:48.934842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:48.934847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:48.935348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:48.935361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:48.935369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:48.935373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:48.935376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:48.935379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:48.935881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:48.935893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:48.935898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:48.938809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:48.938829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:48.938836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:48.938840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:48.938848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392708938
2025-10-02T08:11:48.939178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:48.939192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:48.939200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:48.939203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:48.939207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:48.939210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:48.939718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:48.939731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:48.939736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:48.939740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:48.939743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:48.939746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:48.940293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:48.940304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:48.940418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392708940
2025-10-02T08:11:48.941296Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:48.941308Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:48.941314Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:48.941320Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:48.943114Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:48.943117Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:48.943118Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:48.943130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534143079682981:2506]
2025-10-02T08:11:48.943133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534143079682981:2506]
2025-10-02T08:11:48.943194Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:48.943201Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:48.943491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:48.943501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:48.943503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:48.943648Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:48.968285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534143079683061:3998]
2025-10-02T08:11:48.968508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1273, pipe: [1:7556534143079683061:3998]
2025-10-02T08:11:49.093006Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:49.093399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534143079683061:3998], now have 1 active actors on pipe
2025-10-02T08:11:49.093592Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:49.094187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:49.094832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534143079683061:3998]
2025-10-02T08:11:49.094858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:49.094886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1274 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0
2025-10-02T08:11:49.095127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1274 sessionId: src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0 is DEAD
2025-10-02T08:11:49.095330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:49.095350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0] Write session will restart in 0.006143s
2025-10-02T08:11:49.095376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0] Write session: Do CDS request
2025-10-02T08:11:49.095382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:49.102553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:49.102578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1275
2025-10-02T08:11:49.102580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:49.102633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.102930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.102968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:49.102977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:49.102980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:49.103068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:49.103262Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:49.103272Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:49.103293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:49.103326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1275 sessionId:  describe result for acl check
2025-10-02T08:11:49.103354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:49.103361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:49.103361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:49.103363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:49.103376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534147374650549:2470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:49.103392Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534147374650547:2481]
2025-10-02T08:11:49.103814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534147374650549:2470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:49.103973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:49.104197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:49.104250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:49.104570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:49.104619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.104627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.104628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.104629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.104630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.104636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.104645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.104649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.104653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.104657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.104662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.104670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.104676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.104681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.104685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.104690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.104694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.104699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.104703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.104708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.104729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:49.106658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534147374650549:2470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:49.112626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534147374650549:2470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:49.112645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534147374650549:2470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:49.112649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534147374650549:2470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:49.112660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:49.113112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:49.114798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:49.114814Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:49.114817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:49.114820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:49.114826Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1274 [1:7556534147374650547:2481]
2025-10-02T08:11:49.114840Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:49.114857Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:49.114864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.114867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.114869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.114884Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:49.114889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:49.114895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:49.114949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.114961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.114964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:49.114966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:49.115026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:49.115033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.115047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.115062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:49.115080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374650592:2470], now have 1 active actors on pipe
2025-10-02T08:11:49.115090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534147374650539:2481]
2025-10-02T08:11:49.115092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534147374650539:2481]
2025-10-02T08:11:49.115099Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:49.115111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:49.115114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:49.115115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:49.115127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:49.115130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:49.115136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534147834579235:2378], now have 1 active actors on pipe
2025-10-02T08:11:49.115167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534147374650539:2481]
2025-10-02T08:11:49.115171Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:49.115179Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:49.115181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1274
2025-10-02T08:11:49.115193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.115197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.115221Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:49.115227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.115230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.115231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:49.115201Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1274
2025-10-02T08:11:49.115239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.115252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:49.115278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.115318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.115324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.115336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.115367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1275 partition: 0 MaxSeqNo: 17 sessionId: src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0
2025-10-02T08:11:49.115722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1487b2c-17c66d7c-a16e5fbe-e0909bd9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:49.118936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0] Write session: try to update token
2025-10-02T08:11:49.118955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:49.134388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId: src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:49.135039Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:49.135055Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:49.135058Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:49.135066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534147374650539:2481]
2025-10-02T08:11:49.135071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534147374650539:2481]
2025-10-02T08:11:49.135117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:49.135117Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:49.135123Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:49.135129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.135134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:49.135301Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:49.137035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:49.195109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534147374650620:3998]
2025-10-02T08:11:49.195219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1274, pipe: [1:7556534147374650620:3998]
2025-10-02T08:11:49.274144Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:49.274426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.274437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.274468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374650620:3998], now have 1 active actors on pipe
2025-10-02T08:11:49.274576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534147374650620:3998]
2025-10-02T08:11:49.274684Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:49.274729Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:49.275028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:49.275082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1275 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0
2025-10-02T08:11:49.275242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1275 sessionId: src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0 is DEAD
2025-10-02T08:11:49.275372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:49.275377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0] Write session will restart in 0.006170s
2025-10-02T08:11:49.275395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0] Write session: Do CDS request
2025-10-02T08:11:49.275402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:49.282428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.282466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:49.282482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1276
2025-10-02T08:11:49.282646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.282677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:49.282685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:49.282688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:49.282797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:49.282979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1276 sessionId:  describe result for acl check
2025-10-02T08:11:49.283007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:49.283013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:49.283014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:49.283020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534147374650805:2462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:49.283190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:49.283301Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:49.283308Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:49.283314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:49.283342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:49.283369Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534147374650807:2465]
2025-10-02T08:11:49.283387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534147374650805:2462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:49.283785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:49.284016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:49.284072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:49.284387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:49.284441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.284446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.284447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.284448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.284449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.284454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.284462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.284465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.284468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.284476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.284481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.284491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.284500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.284508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.284516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.284520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.284523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.284532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.284538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.284546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.284563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:49.285975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534147374650805:2462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:49.291307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534147374650805:2462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:49.291321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534147374650805:2462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:49.291323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534147374650805:2462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:49.291329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:49.292415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:49.294019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:49.294036Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:49.294041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:49.294044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:49.294050Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1275 [1:7556534147374650807:2465]
2025-10-02T08:11:49.294061Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:49.294079Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:49.294086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.294089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.294091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.294106Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:49.294115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:49.294122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:49.294181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.294188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.294191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:49.294193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:49.294251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:49.294262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.294277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.294290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:49.294298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1275
2025-10-02T08:11:49.294307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374650852:2462], now have 1 active actors on pipe
2025-10-02T08:11:49.294310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534147834579241:2378], now have 1 active actors on pipe
2025-10-02T08:11:49.294316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534147374650799:2465]
2025-10-02T08:11:49.294318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534147374650799:2465]
2025-10-02T08:11:49.294329Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:49.294339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.294348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.294347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:49.294351Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:49.294365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:49.294383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:49.294389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:49.294427Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:49.294391Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1275
2025-10-02T08:11:49.294437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.294440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.294442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:49.294449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.294457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:49.294463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534147374650799:2465]
2025-10-02T08:11:49.294474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:49.294485Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:49.294507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.294537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.294541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.294553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.294588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1276 partition: 0 MaxSeqNo: 17 sessionId: src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0
2025-10-02T08:11:49.294887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98fbb3a-6a1f30d3-ec77d2c0-36b4245f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:49.297418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0] Write session: try to update token
2025-10-02T08:11:49.297434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:49.310525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId: src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:49.311467Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:49.311484Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:49.311487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:49.311495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534147374650799:2465]
2025-10-02T08:11:49.311499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534147374650799:2465]
2025-10-02T08:11:49.311540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:49.311551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:49.311555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.311557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:49.311566Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:49.311697Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:49.313035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:49.374821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534147374650865:3998]
2025-10-02T08:11:49.374957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1275, pipe: [1:7556534147374650865:3998]
2025-10-02T08:11:49.443183Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:49.443505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.443517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.443550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374650865:3998], now have 1 active actors on pipe
2025-10-02T08:11:49.443671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534147374650865:3998]
2025-10-02T08:11:49.443695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:49.443702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:49.443723Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:49.443764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1276 reason: error at write: Disconnected sessionId: src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0
2025-10-02T08:11:49.443782Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:49.443927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1276 sessionId: src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0 is DEAD
2025-10-02T08:11:49.444061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:49.444070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0] Write session will restart in 0.007462s
2025-10-02T08:11:49.444091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0] Write session: Do CDS request
2025-10-02T08:11:49.444096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:49.451368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:49.451877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:49.452043Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:49.452052Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:49.452062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:49.452122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:49.452159Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534147374651051:2458]
2025-10-02T08:11:49.452342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.452437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:49.452448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1277
2025-10-02T08:11:49.452546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.452580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:49.452589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:49.452592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:49.452768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:49.452962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:49.452972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1277 sessionId:  describe result for acl check
2025-10-02T08:11:49.452997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:49.453000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:49.453005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:49.453007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:49.453012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534147374651060:2453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:49.453274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:49.453311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.453317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.453318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.453319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.453321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.453326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.453335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.453339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.453343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.453346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.453351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.453358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.453367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.453372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.453381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.453386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.453392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.453401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.453406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.453411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.453434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:49.453485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534147374651060:2453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:49.455542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534147374651060:2453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:49.461853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:49.462083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534147374651060:2453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:49.462093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534147374651060:2453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:49.462096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534147374651060:2453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:49.462102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:49.463291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:49.463303Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:49.463304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:49.463307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:49.463312Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1276 [1:7556534147374651051:2458]
2025-10-02T08:11:49.463320Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:49.463332Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:49.463334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.463336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.463337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.463349Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:49.463352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:49.463359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:49.463402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.463410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.463412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:49.463414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:49.463459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:49.463466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.463474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.463481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:49.463492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534147374651045:2458]
2025-10-02T08:11:49.463498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534147374651045:2458]
2025-10-02T08:11:49.463503Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:49.463504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1276
2025-10-02T08:11:49.463514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374651098:2453], now have 1 active actors on pipe
2025-10-02T08:11:49.463517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:49.463520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:49.463522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:49.463534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:49.463536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:49.463541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534147834579247:2378], now have 1 active actors on pipe
2025-10-02T08:11:49.463545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.463549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.463581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534147374651045:2458]
2025-10-02T08:11:49.463591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:49.463602Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:49.463589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1276
2025-10-02T08:11:49.463602Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:49.463612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.463614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.463616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:49.463623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.463630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:49.463665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.463705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.463715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.463732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.463763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1277 partition: 0 MaxSeqNo: 17 sessionId: src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0
2025-10-02T08:11:49.464062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a982c20-135b511e-7a26c1e3-567c9ddb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:49.466397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0] Write session: try to update token
2025-10-02T08:11:49.466416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:49.480209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId: src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:49.480289Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:49.480307Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:49.480308Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:49.480315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534147374651045:2458]
2025-10-02T08:11:49.480318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534147374651045:2458]
2025-10-02T08:11:49.480348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:49.480357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.480359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:49.480363Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:49.480368Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:49.480479Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:49.482907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:49.543758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534147374651118:3998]
2025-10-02T08:11:49.543873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1276, pipe: [1:7556534147374651118:3998]
2025-10-02T08:11:49.615604Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:49.616080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.616096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.616135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374651118:3998], now have 1 active actors on pipe
2025-10-02T08:11:49.616424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:49.616289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534147374651118:3998]
2025-10-02T08:11:49.616319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:49.616325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:49.616331Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:49.616453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1277 reason: error at write: Disconnected sessionId: src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0
2025-10-02T08:11:49.616649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1277 sessionId: src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0 is DEAD
2025-10-02T08:11:49.616784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:49.616794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0] Write session will restart in 0.006773s
2025-10-02T08:11:49.616841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0] Write session: Do CDS request
2025-10-02T08:11:49.616848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:49.624329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.624383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:49.624397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1278
2025-10-02T08:11:49.624567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.624601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:49.624611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:49.624615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:49.624632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:49.624993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1278 sessionId:  describe result for acl check
2025-10-02T08:11:49.625024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:49.625033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:49.625034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:49.625039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534147374651307:2429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:49.625267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:49.625414Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:49.625426Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:49.625436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:49.625481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:49.625507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534147374651307:2429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:49.625533Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534147374651309:2441]
2025-10-02T08:11:49.626084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:49.626260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:49.626301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:49.626600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:49.626651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.626657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.626658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.626660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.626661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.626665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.626674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.626678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.626682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.626686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.626690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.626697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.626702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.626707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.626711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.626716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.626720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.626724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.626729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.626733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.626752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:49.627544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534147374651307:2429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:49.635138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534147374651307:2429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:49.635153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534147374651307:2429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:49.635156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534147374651307:2429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:49.635163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:49.636076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:49.637733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:49.637748Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:49.637750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:49.637754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:49.637760Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1277 [1:7556534147374651309:2441]
2025-10-02T08:11:49.637772Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:49.637789Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:49.637792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.637795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.637797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.637812Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:49.637817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:49.637829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:49.637899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.637908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.637911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:49.637913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:49.637974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:49.637982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.637995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.638012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:49.638033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534147374651301:2441]
2025-10-02T08:11:49.638039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534147374651301:2441]
2025-10-02T08:11:49.638047Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:49.638054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1277
2025-10-02T08:11:49.638056Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:49.638059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:49.638063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374651353:2429], now have 1 active actors on pipe
2025-10-02T08:11:49.638071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:49.638083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:49.638086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:49.638091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534147834579255:2378], now have 1 active actors on pipe
2025-10-02T08:11:49.638094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.638097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.638134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534147374651301:2441]
2025-10-02T08:11:49.638144Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:49.638153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:49.638160Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:49.638165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.638168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.638170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:49.638179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.638191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:49.638231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.638274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.638280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.638293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.638302Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1277
2025-10-02T08:11:49.638327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1278 partition: 0 MaxSeqNo: 17 sessionId: src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0
2025-10-02T08:11:49.638641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f41efa3-3e07081b-46d44b47-5ba72f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:49.641259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0] Write session: try to update token
2025-10-02T08:11:49.641277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:49.654043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId: src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:49.656644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:49.657683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.657705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.657724Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:49.657727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:49.657729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:49.657736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534147374651301:2441]
2025-10-02T08:11:49.657741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534147374651301:2441]
2025-10-02T08:11:49.657779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:49.657788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:49.657791Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:49.657794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.657797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:49.657926Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:49.733219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534147374651385:3998]
2025-10-02T08:11:49.735065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1277, pipe: [1:7556534147374651385:3998]
2025-10-02T08:11:49.792602Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:49.792928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:49.792984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:49.792988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374651385:3998], now have 1 active actors on pipe
2025-10-02T08:11:49.793435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:49.793520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:49.793532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:49.793550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1278 reason: error at write: Disconnected sessionId: src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0
2025-10-02T08:11:49.793687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1278 sessionId: src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0 is DEAD
2025-10-02T08:11:49.793710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534147374651385:3998]
2025-10-02T08:11:49.793835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:49.793844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0] Write session will restart in 0.005290s
2025-10-02T08:11:49.793867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0] Write session: Do CDS request
2025-10-02T08:11:49.793873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:49.800276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.800129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:49.800320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:49.800325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1279
2025-10-02T08:11:49.800471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.800502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:49.800511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:49.800514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:49.800572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:49.800712Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:49.800718Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:49.800725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:49.800757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:49.800784Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534147374651602:2394]
2025-10-02T08:11:49.800890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1279 sessionId:  describe result for acl check
2025-10-02T08:11:49.800920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:49.800922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:49.800923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:49.800928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534147374651605:2392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:49.801289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:49.801377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534147374651605:2392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:49.801478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:49.801526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:49.801816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:49.801860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.801867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.801868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.801869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.801871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.801875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.801885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.801888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.801893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.801897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.801901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.801908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.801915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.801920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.801924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.801929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.801933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.801938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.801943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.801952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.801970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:49.802989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534147374651605:2392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:49.809315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534147374651605:2392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:49.809340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534147374651605:2392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:49.809344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534147374651605:2392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:49.809352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:49.809703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:49.811335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:49.811352Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:49.811354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:49.811358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:49.811364Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1278 [1:7556534147374651602:2394]
2025-10-02T08:11:49.811374Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:49.811389Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:49.811398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.811401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.811402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.811417Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:49.811422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:49.811428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:49.811487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.811494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.811498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:49.811500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:49.811561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:49.811568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.811581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.811594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:49.811600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1278
2025-10-02T08:11:49.811615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374651644:2392], now have 1 active actors on pipe
2025-10-02T08:11:49.811623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534147834579283:2378], now have 1 active actors on pipe
2025-10-02T08:11:49.811628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.811632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.811648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534147374651594:2394]
2025-10-02T08:11:49.811655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534147374651594:2394]
2025-10-02T08:11:49.811668Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:49.811684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:49.811685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:49.811688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:49.811703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:49.811680Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1278
2025-10-02T08:11:49.811712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:49.811727Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eff83b41-283de09d-1680205e-cf7663f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:49.811733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.811737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.811738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:49.811746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.811758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:49.811795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534147374651594:2394]
2025-10-02T08:11:49.811807Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:49.811823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.811828Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:49.811921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.811929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.811943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.811993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1279 partition: 0 MaxSeqNo: 17 sessionId: src_id|eff83b41-283de09d-1680205e-cf7663f8_0
2025-10-02T08:11:49.812331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479b72ab-701e0eab-6b5fb6e9-c5574806_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eff83b41-283de09d-1680205e-cf7663f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:49.815073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eff83b41-283de09d-1680205e-cf7663f8_0] Write session: try to update token
2025-10-02T08:11:49.815089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eff83b41-283de09d-1680205e-cf7663f8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:49.828835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId: src_id|eff83b41-283de09d-1680205e-cf7663f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:49.829532Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:49.829548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:49.829551Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:49.829560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534147374651594:2394]
2025-10-02T08:11:49.829566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534147374651594:2394]
2025-10-02T08:11:49.830365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:49.830367Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:49.830374Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:49.830379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.830384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:49.830529Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:49.831504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:49.893964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534147374651658:3998]
2025-10-02T08:11:49.894082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1278, pipe: [1:7556534147374651658:3998]
2025-10-02T08:11:49.967770Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:49.968109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.968119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.968150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374651658:3998], now have 1 active actors on pipe
2025-10-02T08:11:49.968275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534147374651658:3998]
2025-10-02T08:11:49.968301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:49.968303Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:49.968308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:49.968373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1279 reason: error at write: Disconnected sessionId: src_id|eff83b41-283de09d-1680205e-cf7663f8_0
2025-10-02T08:11:49.968364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:49.968525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1279 sessionId: src_id|eff83b41-283de09d-1680205e-cf7663f8_0 is DEAD
2025-10-02T08:11:49.968753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eff83b41-283de09d-1680205e-cf7663f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:49.968761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eff83b41-283de09d-1680205e-cf7663f8_0] Write session will restart in 0.007089s
2025-10-02T08:11:49.968787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eff83b41-283de09d-1680205e-cf7663f8_0] Write session: Do CDS request
2025-10-02T08:11:49.968794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eff83b41-283de09d-1680205e-cf7663f8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:49.975386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:49.975907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:49.976077Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:49.976084Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:49.976091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:49.976127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:49.976153Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534147374651852:2387]
2025-10-02T08:11:49.976570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:49.976741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:49.976779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:49.976997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:49.977027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.977031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.977032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.977032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.977033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.977036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.977042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.977045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.977047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.977051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.977056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.977062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:49.977068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.977073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:49.977077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.977080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:49.977083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.977085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.977088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.977091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.977101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:49.977340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eff83b41-283de09d-1680205e-cf7663f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.980855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:49.980873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1280
2025-10-02T08:11:49.981045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:49.981090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:49.981100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:49.981103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:49.981607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1280 sessionId:  describe result for acl check
2025-10-02T08:11:49.981645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:49.981651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:49.981656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:49.981661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534147374651869:2380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:49.982164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534147374651869:2380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:49.983691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534147374651869:2380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:49.985236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:49.986641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534147374651869:2380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:49.986656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534147374651869:2380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:49.986660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534147374651869:2380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:49.986668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:49.986908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:49.986926Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:49.986928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:49.986932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:49.986936Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1279 [1:7556534147374651852:2387]
2025-10-02T08:11:49.986947Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:49.986964Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:49.986973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.986981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.986983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.986997Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:49.987001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:49.987010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:49.987066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.987072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.987075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:49.987077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:49.987133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:49.987139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:49.987151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:49.987159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1279
2025-10-02T08:11:49.987165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:49.987187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534147374651897:2380], now have 1 active actors on pipe
2025-10-02T08:11:49.987194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534147834579289:2378], now have 1 active actors on pipe
2025-10-02T08:11:49.987198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.987219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.987238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534147374651846:2387]
2025-10-02T08:11:49.987244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534147374651846:2387]
2025-10-02T08:11:49.987255Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:49.987252Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1279
2025-10-02T08:11:49.987271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:49.987272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:49.987285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:49.987288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:49.987291Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:49.987301Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:49.987308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:49.987311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:49.987314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:49.987323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:49.987332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:49.987361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534147374651846:2387]
2025-10-02T08:11:49.987369Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:49.987384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:49.987385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.987432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:49.987435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:49.987447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:49.987477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1280 partition: 0 MaxSeqNo: 17 sessionId: src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0
2025-10-02T08:11:49.987754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eff83b41-283de09d-1680205e-cf7663f8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:49.990555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0] Write session: try to update token
2025-10-02T08:11:49.990574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:50.005240Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:50.005259Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.005262Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:50.005270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534147374651846:2387]
2025-10-02T08:11:50.005277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534147374651846:2387]
2025-10-02T08:11:50.005316Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:50.005318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:50.005325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.005327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:50.005328Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:50.005482Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:50.006938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId: src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:50.009679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:50.068575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534151669619207:3998]
2025-10-02T08:11:50.068700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1279, pipe: [1:7556534151669619207:3998]
2025-10-02T08:11:50.149404Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:50.149739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.149752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.149790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669619207:3998], now have 1 active actors on pipe
2025-10-02T08:11:50.149901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534151669619207:3998]
2025-10-02T08:11:50.149925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:50.149928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:50.149978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1280 reason: error at write: Disconnected sessionId: src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0
2025-10-02T08:11:50.150011Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:50.150034Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:50.150139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1280 sessionId: src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0 is DEAD
2025-10-02T08:11:50.150274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:50.150284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0] Write session will restart in 0.008490s
2025-10-02T08:11:50.150321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0] Write session: Do CDS request
2025-10-02T08:11:50.150327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:50.158088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:50.158770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:50.158913Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:50.158922Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:50.158930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:50.158962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:50.158994Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534151669619412:2374]
2025-10-02T08:11:50.159672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:50.159836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:50.159866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:50.160184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:50.160219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.160224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.160226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.160226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.160228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.160232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.160241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.160245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.160245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.160249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.160257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.160262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.160268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.160274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.160279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.160286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.160292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.160300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.160305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.160314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.160319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.160335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:50.160337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:50.160347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1281
2025-10-02T08:11:50.160468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.160497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:50.160505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:50.160508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:50.160878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1281 sessionId:  describe result for acl check
2025-10-02T08:11:50.160904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:50.160906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:50.160907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:50.160912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534151669619428:2368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:50.161371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534151669619428:2368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:50.163509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534151669619428:2368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:50.168072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534151669619428:2368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:50.168087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534151669619428:2368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:50.168090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534151669619428:2368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:50.168099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:50.168624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:50.170289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:50.170305Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:50.170307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:50.170310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:50.170315Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1280 [1:7556534151669619412:2374]
2025-10-02T08:11:50.170323Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:50.170334Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:50.170336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.170338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.170339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.170351Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:50.170354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:50.170359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:50.170401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.170407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.170410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:50.170412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:50.170464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:50.170471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.170482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.170493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:50.170511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534151669619406:2374]
2025-10-02T08:11:50.170516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534151669619406:2374]
2025-10-02T08:11:50.170523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:50.170527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1280
2025-10-02T08:11:50.170533Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:50.170536Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:50.170546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669619462:2368], now have 1 active actors on pipe
2025-10-02T08:11:50.170558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:50.170573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:50.170579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:50.170584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534152129546606:2378], now have 1 active actors on pipe
2025-10-02T08:11:50.170588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.170593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.170632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534151669619406:2374]
2025-10-02T08:11:50.170607Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1280
2025-10-02T08:11:50.170640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:50.170650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:50.170653Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:50.170660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.170665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.170668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:50.170677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.170686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:50.170721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.170766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.170777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.170796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.170834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1281 partition: 0 MaxSeqNo: 17 sessionId: src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0
2025-10-02T08:11:50.171172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d448a2a-361a03ea-7e69ea74-e603a5fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:50.173887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0] Write session: try to update token
2025-10-02T08:11:50.173901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:50.188435Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:50.188453Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.188455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:50.188464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534151669619406:2374]
2025-10-02T08:11:50.188468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534151669619406:2374]
2025-10-02T08:11:50.188505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:50.188508Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:50.188511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.188513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:50.188517Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:50.188646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:50.189166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId: src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:50.192075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:50.250343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534151669619478:3998]
2025-10-02T08:11:50.250469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1280, pipe: [1:7556534151669619478:3998]
2025-10-02T08:11:50.327207Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:50.327626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.327641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.327678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669619478:3998], now have 1 active actors on pipe
2025-10-02T08:11:50.327795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:50.327808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:50.327870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1281 reason: error at write: Disconnected sessionId: src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0
2025-10-02T08:11:50.327903Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:50.327996Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:50.328044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1281 sessionId: src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0 is DEAD
2025-10-02T08:11:50.328203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:50.328213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0] Write session will restart in 0.007109s
2025-10-02T08:11:50.328236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0] Write session: Do CDS request
2025-10-02T08:11:50.328224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534151669619478:3998]
2025-10-02T08:11:50.328244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:50.335101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:50.335636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:50.335749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:50.335755Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:50.335762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:50.335788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:50.335812Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534151669619672:2355]
2025-10-02T08:11:50.336215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:50.336293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.336336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:50.336342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1282
2025-10-02T08:11:50.336402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:50.336451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:50.336510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.336530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:50.336536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:50.336538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:50.336721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:50.336763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.336767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.336768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.336769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.336769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.336773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.336773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1282 sessionId:  describe result for acl check
2025-10-02T08:11:50.336779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.336781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.336783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.336785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.336789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.336789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:50.336791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:50.336792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:50.336793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.336795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534151669619684:2330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:50.336797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.336799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.336818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.336824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.336828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.336833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.336837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.336842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.336860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:50.337150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534151669619684:2330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:50.339195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534151669619684:2330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:50.344561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:50.345318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534151669619684:2330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:50.345338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534151669619684:2330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:50.345342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534151669619684:2330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:50.345355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:50.346214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:50.346230Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:50.346233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:50.346238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:50.346245Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1281 [1:7556534151669619672:2355]
2025-10-02T08:11:50.346257Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:50.346277Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:50.346283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.346286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.346291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.346305Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:50.346314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:50.346323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:50.346385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.346391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.346394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:50.346395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:50.346461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:50.346469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.346480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.346490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:50.346509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534151669619666:2355]
2025-10-02T08:11:50.346515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534151669619666:2355]
2025-10-02T08:11:50.346516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1281
2025-10-02T08:11:50.346523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:50.346535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669619719:2330], now have 1 active actors on pipe
2025-10-02T08:11:50.346538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:50.346542Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:50.346544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534152129546613:2378], now have 1 active actors on pipe
2025-10-02T08:11:50.346551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:50.346562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:50.346568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:50.346575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.346583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.346622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534151669619666:2355]
2025-10-02T08:11:50.346630Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:50.346613Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1281
2025-10-02T08:11:50.346646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:50.346646Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f619233-9ddb8973-e42c5330-dbae449f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:50.346653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.346656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.346657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:50.346665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.346672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:50.346714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.346805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.346811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.346822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.346857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1282 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f619233-9ddb8973-e42c5330-dbae449f_0
2025-10-02T08:11:50.347185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d22e7d37-f97495d1-767eb5ac-9f54617a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f619233-9ddb8973-e42c5330-dbae449f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:50.350029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619233-9ddb8973-e42c5330-dbae449f_0] Write session: try to update token
2025-10-02T08:11:50.350045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619233-9ddb8973-e42c5330-dbae449f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:50.357378Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:50.357401Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.357413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534151669619666:2355]
2025-10-02T08:11:50.357456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:50.357456Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:50.357635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:50.357790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.357939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.358093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.358310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:50.358355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:50.364604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId: src_id|8f619233-9ddb8973-e42c5330-dbae449f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:50.367093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:50.367153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.367162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.367192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:50.367218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:50.367276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.367299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.367456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.367516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.367581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.367650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.367756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.367764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.367831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.367886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.367953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.368029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.368077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.368086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.368161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.368225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.368285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.368345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.368388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.368394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.368463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.368521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.368586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.368648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.368698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.368705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.368770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.368917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.368992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.369061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.369116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.369123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.369202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.369270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.369348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.369426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.369483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.369489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.369557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.369625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.369690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.369752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.369794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.369799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.369867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.369927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.369988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.370047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.370093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.370104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.370168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.370228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.370289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.370350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.370396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.370401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.370464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.370524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.370584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.370650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.370698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.370704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.370740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:50.370798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.370814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.370819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:50.370845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:50.370859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:50.370865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:50.370867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:50.370868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:50.371254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:50.371278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:50.371290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:50.371295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:50.371301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:50.371304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:50.371916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:50.371939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:50.371944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:50.371946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:50.371948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:50.371950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:50.372453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:50.372475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:50.372480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:50.372484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:50.372487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:50.373787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:50.373806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:50.373815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392710373
2025-10-02T08:11:50.373916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:50.373925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:50.373935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:50.373937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:50.373941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:50.373943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:50.374413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:50.374435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:50.374440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:50.374442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:50.374444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:50.374447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:50.374913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:50.374932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:50.374939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:50.374942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:50.374945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:50.374947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:50.375414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:50.375433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:50.375436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:50.376553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:50.376573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:50.376577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:50.376580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:50.376585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392710376
2025-10-02T08:11:50.376902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:50.376919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:50.376925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:50.376927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:50.376929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:50.376931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:50.377369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:50.377386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:50.377395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:50.377399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:50.377405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:50.377408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:50.377855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:50.377871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.377957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392710377
2025-10-02T08:11:50.378679Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:50.378693Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:50.378699Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:50.378704Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:50.380267Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:50.380279Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.380280Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:50.380290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534151669619666:2355]
2025-10-02T08:11:50.380293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534151669619666:2355]
2025-10-02T08:11:50.380332Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:50.380340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:50.380343Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:50.380344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.380346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:50.380476Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:50.428495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534151669619742:3998]
2025-10-02T08:11:50.428592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1281, pipe: [1:7556534151669619742:3998]
2025-10-02T08:11:50.523769Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:50.524132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669619742:3998], now have 1 active actors on pipe
2025-10-02T08:11:50.524259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534151669619742:3998]
2025-10-02T08:11:50.524282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:50.524288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:50.524308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1282 reason: error at write: Disconnected sessionId: src_id|8f619233-9ddb8973-e42c5330-dbae449f_0
2025-10-02T08:11:50.524386Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:50.524470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1282 sessionId: src_id|8f619233-9ddb8973-e42c5330-dbae449f_0 is DEAD
2025-10-02T08:11:50.524593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619233-9ddb8973-e42c5330-dbae449f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:50.524605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619233-9ddb8973-e42c5330-dbae449f_0] Write session will restart in 0.005993s
2025-10-02T08:11:50.524495Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:50.524634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619233-9ddb8973-e42c5330-dbae449f_0] Write session: Do CDS request
2025-10-02T08:11:50.524642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619233-9ddb8973-e42c5330-dbae449f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:50.532381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619233-9ddb8973-e42c5330-dbae449f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.532409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:50.532426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1283
2025-10-02T08:11:50.532599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:50.532740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.532773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:50.532797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:50.532842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:50.533228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1283 sessionId:  describe result for acl check
2025-10-02T08:11:50.533263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:50.533264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:50.533266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:50.533272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534151669619942:2336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:50.533883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:50.534064Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:50.534076Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:50.534087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:50.534147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:50.534184Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534151669619945:2350]
2025-10-02T08:11:50.534791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:50.534845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534151669619942:2336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:50.535220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:50.535278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:50.535600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:50.535654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.535665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.535667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.535668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.535669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.535674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.535684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.535687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.535691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.535695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.535704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.535712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.535717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.535722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.535726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.535732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.535736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.535741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.535747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.535752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.535770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:50.536868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534151669619942:2336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:50.543168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534151669619942:2336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:50.543186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534151669619942:2336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:50.543189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534151669619942:2336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:50.543200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:50.543974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:50.545600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:50.545622Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:50.545625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:50.545631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:50.545638Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1282 [1:7556534151669619945:2350]
2025-10-02T08:11:50.545650Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:50.545670Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:50.545680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.545682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.545685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.545704Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:50.545714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:50.545724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:50.545794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.545803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.545805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:50.545808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:50.545872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:50.545880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.545892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.545906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:50.545914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1282
2025-10-02T08:11:50.545929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669619988:2336], now have 1 active actors on pipe
2025-10-02T08:11:50.545937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534152129546619:2378], now have 1 active actors on pipe
2025-10-02T08:11:50.545942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.545946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.545961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534151669619936:2350]
2025-10-02T08:11:50.545970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534151669619936:2350]
2025-10-02T08:11:50.545982Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:50.545995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:50.545998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:50.546004Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:50.546012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:50.546017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:50.545994Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1282
2025-10-02T08:11:50.546032Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|287c089-3afab985-aabf382b-9318853_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:50.546043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.546047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.546048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:50.546057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.546066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:50.546102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534151669619936:2350]
2025-10-02T08:11:50.546116Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:50.546126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:50.546138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.546177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.546183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.546203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.546239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1283 partition: 0 MaxSeqNo: 17 sessionId: src_id|287c089-3afab985-aabf382b-9318853_0
2025-10-02T08:11:50.546527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f619233-9ddb8973-e42c5330-dbae449f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|287c089-3afab985-aabf382b-9318853_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:50.549424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287c089-3afab985-aabf382b-9318853_0] Write session: try to update token
2025-10-02T08:11:50.549443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287c089-3afab985-aabf382b-9318853_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:50.556889Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:50.556910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.556919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534151669619936:2350]
2025-10-02T08:11:50.556960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:50.556962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:50.557145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:50.557298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.557447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.557599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.558016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:50.558063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:50.565909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId: src_id|287c089-3afab985-aabf382b-9318853_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:50.568595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:50.568659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.568672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.568707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:50.568736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:50.568787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.568823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.568993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.569053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.569132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.569196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.569261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.569269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.569338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.569396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.569459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.569525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.569571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.569579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.569642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.569703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.569772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.569829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.569874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.569881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.569946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.570018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.570084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.570146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.570200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.570210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.570273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.570329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.570391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.570457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.570502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.570510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.570572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.570630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.570692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.570752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.570795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.570803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.570866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.570923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.570988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.571066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.571110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.571117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.571182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.571259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.571320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.571380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.571425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.571432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.571495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.571555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.571617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.571678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.571743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.571750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.571812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.571871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.571930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.571998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.572045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.572050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.572106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:50.572169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.572191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.572197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:50.572231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:50.572249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:50.572255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:50.572258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:50.572260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:50.572632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:50.572656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:50.572666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:50.572673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:50.572676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:50.572679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:50.573170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:50.573195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:50.573201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:50.573204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:50.573207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:50.573210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:50.573730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:50.573751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:50.573756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:50.573765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:50.573768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:50.574964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:50.574980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:50.574993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392710574
2025-10-02T08:11:50.575121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:50.575134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:50.575139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:50.575144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:50.575148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:50.575151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:50.575591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:50.575611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:50.575616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:50.575624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:50.575627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:50.575632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:50.576096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:50.576117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:50.576123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:50.576126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:50.576135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:50.576138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:50.576601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:50.576623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:50.576630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:50.577818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:50.577834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:50.577839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:50.577842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:50.577852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392710577
2025-10-02T08:11:50.578153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:50.578173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:50.578179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:50.578185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:50.578190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:50.578194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:50.578695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:50.578716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:50.578722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:50.578726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:50.578729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:50.578734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:50.579232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:50.579252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.579356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392710578
2025-10-02T08:11:50.581761Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:50.581788Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:50.581796Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:50.581805Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:50.581817Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:50.581819Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.581821Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:50.581830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534151669619936:2350]
2025-10-02T08:11:50.581834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534151669619936:2350]
2025-10-02T08:11:50.581886Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:50.581901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:50.581908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:50.581912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.581914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:50.582054Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:50.624571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534151669620005:3998]
2025-10-02T08:11:50.624657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1282, pipe: [1:7556534151669620005:3998]
2025-10-02T08:11:50.716298Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:50.716631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669620005:3998], now have 1 active actors on pipe
2025-10-02T08:11:50.716751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:50.716757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:50.716785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1283 reason: error at write: Disconnected sessionId: src_id|287c089-3afab985-aabf382b-9318853_0
2025-10-02T08:11:50.716913Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:50.716932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:50.717014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1283 sessionId: src_id|287c089-3afab985-aabf382b-9318853_0 is DEAD
2025-10-02T08:11:50.717158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287c089-3afab985-aabf382b-9318853_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:50.717170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287c089-3afab985-aabf382b-9318853_0] Write session will restart in 0.007305s
2025-10-02T08:11:50.717195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287c089-3afab985-aabf382b-9318853_0] Write session: Do CDS request
2025-10-02T08:11:50.717204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287c089-3afab985-aabf382b-9318853_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:50.717202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534151669620005:3998]
2025-10-02T08:11:50.721938Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7b8a4c46000b931e] Result# TEvPutResult {Id# [72075186224037892:1282:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:50.721962Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1282:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:50.722007Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1282:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:50.725347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287c089-3afab985-aabf382b-9318853_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.725528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:50.725543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1284
2025-10-02T08:11:50.725690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.725729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:50.725735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:50.725738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:50.726083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1284 sessionId:  describe result for acl check
2025-10-02T08:11:50.726112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:50.726117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:50.726118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:50.726123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534151669620196:2310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:50.726605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534151669620196:2310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:50.726984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:50.727727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:50.727877Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:50.727888Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:50.727905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:50.727950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:50.727996Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534151669620232:2331]
2025-10-02T08:11:50.728427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534151669620196:2310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:50.728459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:50.728642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:50.728679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:50.728975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:50.729017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.729022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.729023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.729024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.729025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.729030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.729038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.729042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.729046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.729050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.729056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.729067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.729076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.729080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.729085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.729089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.729099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.729104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.729112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.729117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.729138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:50.733733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534151669620196:2310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:50.733752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534151669620196:2310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:50.733755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534151669620196:2310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:50.733764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:50.736915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:50.738602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:50.738625Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:50.738628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:50.738633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:50.738642Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1283 [1:7556534151669620232:2331]
2025-10-02T08:11:50.738655Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:50.738676Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:50.738685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.738689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.738691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.738713Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:50.738719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:50.738729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:50.738812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.738822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.738827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:50.738831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:50.738910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:50.738920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.738938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.738952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:50.738978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669620259:2310], now have 1 active actors on pipe
2025-10-02T08:11:50.738989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534152129546627:2378], now have 1 active actors on pipe
2025-10-02T08:11:50.738999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534151669620213:2331]
2025-10-02T08:11:50.739005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534151669620213:2331]
2025-10-02T08:11:50.739022Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:50.739042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:50.739043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:50.739047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:50.739060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:50.739063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:50.739070Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1283
2025-10-02T08:11:50.739103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534151669620213:2331]
2025-10-02T08:11:50.739112Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:50.739115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:50.739173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1283
2025-10-02T08:11:50.739228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.739237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.739272Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33704413-3b8a5733-7a98e696-b96c5030_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:50.739285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.739289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.739291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:50.739305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.739317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:50.739332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.739375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.739381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.739399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.739426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1284 partition: 0 MaxSeqNo: 17 sessionId: src_id|33704413-3b8a5733-7a98e696-b96c5030_0
2025-10-02T08:11:50.739819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287c089-3afab985-aabf382b-9318853_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|33704413-3b8a5733-7a98e696-b96c5030_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:50.742525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33704413-3b8a5733-7a98e696-b96c5030_0] Write session: try to update token
2025-10-02T08:11:50.742545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33704413-3b8a5733-7a98e696-b96c5030_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:50.750104Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:50.750127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.750137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534151669620213:2331]
2025-10-02T08:11:50.750179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:50.750185Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:50.750367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:50.750513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.750660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.750806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:50.751095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:50.751136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:50.760197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId: src_id|33704413-3b8a5733-7a98e696-b96c5030_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:50.763968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:50.764051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.764064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.764097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:50.764116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:50.764177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.764185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.764358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.764431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.764506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.764577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.764626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.764635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.764714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.764785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.764875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.764951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.765002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.765012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.765090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.765158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.765230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.765311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.765362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.765371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.765444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.765516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.765589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.765670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.765722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.765733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.765804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.765880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.765949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.766021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.766070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.766078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.766155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.766225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.766296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.766368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.766419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.766427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.766499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.766571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.766647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.766721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.766775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.766783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.766856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.766930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.767003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.767074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.767120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.767127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.767203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.767274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.767345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.767416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.767465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.767474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.767548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:50.767615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:50.767680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:50.767750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:50.767801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:50.767810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:50.767867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:50.767931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.767957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.767964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:50.768012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:50.768038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:50.768050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:50.768059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:50.768064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:50.768681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:50.768715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:50.768728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:50.768732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:50.768736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:50.768739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:50.769382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:50.769410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:50.769422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:50.769430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:50.769434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:50.769439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:50.769965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:50.769990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:50.769994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:50.769996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:50.769999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:50.771160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:50.771176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:50.771185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392710770
2025-10-02T08:11:50.771304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:50.771314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:50.771317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:50.771319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:50.771322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:50.771324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:50.771743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:50.771761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:50.771765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:50.771767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:50.771769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:50.771772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:50.772213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:50.772232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:50.772236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:50.772239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:50.772242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:50.772244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:50.772671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:50.772689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:50.772692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:50.773721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:50.773737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:50.773741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:50.773743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:50.773761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392710773
2025-10-02T08:11:50.774029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:50.774047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:50.774051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:50.774053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:50.774056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:50.774058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:50.774482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:50.774499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:50.774503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:50.774509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:50.774511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:50.774514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:50.774937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:50.774953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.775021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392710774
2025-10-02T08:11:50.777357Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:50.777387Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:50.777394Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:50.777403Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:50.777415Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:50.777422Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.777427Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:50.777435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534151669620213:2331]
2025-10-02T08:11:50.777442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534151669620213:2331]
2025-10-02T08:11:50.777506Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:50.777519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:50.777526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:50.777530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.777531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:50.777691Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:50.817113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534151669620312:3998]
2025-10-02T08:11:50.817245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1283, pipe: [1:7556534151669620312:3998]
2025-10-02T08:11:50.910691Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:50.911004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669620312:3998], now have 1 active actors on pipe
2025-10-02T08:11:50.911180Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:50.911321Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:50.911419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534151669620312:3998]
2025-10-02T08:11:50.911514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:50.911527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:50.911555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1284 reason: error at write: Disconnected sessionId: src_id|33704413-3b8a5733-7a98e696-b96c5030_0
2025-10-02T08:11:50.911741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1284 sessionId: src_id|33704413-3b8a5733-7a98e696-b96c5030_0 is DEAD
2025-10-02T08:11:50.911920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33704413-3b8a5733-7a98e696-b96c5030_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:50.911929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33704413-3b8a5733-7a98e696-b96c5030_0] Write session will restart in 0.007654s
2025-10-02T08:11:50.911955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33704413-3b8a5733-7a98e696-b96c5030_0] Write session: Do CDS request
2025-10-02T08:11:50.911960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33704413-3b8a5733-7a98e696-b96c5030_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:50.914974Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7641ec0fb7939bb4] Result# TEvPutResult {Id# [72075186224037892:1283:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:50.915008Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1283:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:50.915044Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1283:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:50.920351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33704413-3b8a5733-7a98e696-b96c5030_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.920424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:50.920438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1285
2025-10-02T08:11:50.920462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:50.920582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:50.920618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:50.920628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:50.920631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:50.921031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1285 sessionId:  describe result for acl check
2025-10-02T08:11:50.921061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:50.921062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:50.921064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:50.921069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534151669620518:7408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:50.921306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:50.921529Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:50.921540Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:50.921542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534151669620518:7408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:50.921551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:50.921613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:50.921654Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534151669620521:7404]
2025-10-02T08:11:50.922269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:50.922445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:50.922504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:50.922801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:50.922864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.922870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.922872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.922873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.922874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.922880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.922889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.922897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.922901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.922905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.922915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.922921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:50.922930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.922935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:50.922939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.922944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:50.922948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.922953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.922957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.922961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.922980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:50.923435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534151669620518:7408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:50.929861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534151669620518:7408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:50.929880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534151669620518:7408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:50.929884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534151669620518:7408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:50.929892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:50.931342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:50.933177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:50.933196Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:50.933199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:50.933203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:50.933209Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1284 [1:7556534151669620521:7404]
2025-10-02T08:11:50.933221Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:50.933239Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:50.933242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.933246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.933248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.933266Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:50.933271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:50.933278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:50.933343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.933353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.933356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:50.933359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:50.933429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:50.933437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.933453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:50.933469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:50.933492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534151669620566:7408], now have 1 active actors on pipe
2025-10-02T08:11:50.933500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534152129546656:2378], now have 1 active actors on pipe
2025-10-02T08:11:50.933506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534151669620511:7404]
2025-10-02T08:11:50.933508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534151669620511:7404]
2025-10-02T08:11:50.933518Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:50.933526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1284
2025-10-02T08:11:50.933536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:50.933550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:50.933553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:50.933555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:50.933562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:50.933556Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1284
2025-10-02T08:11:50.933591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.933600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.933614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534151669620511:7404]
2025-10-02T08:11:50.933625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:50.933638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:50.933667Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c27df355-9cfd3594-b8831249-99390f19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:50.933677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:50.933681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:50.933687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:50.933697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:50.933711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:50.933738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.933808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:50.933815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:50.933830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:50.933871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1285 partition: 0 MaxSeqNo: 17 sessionId: src_id|c27df355-9cfd3594-b8831249-99390f19_0
2025-10-02T08:11:50.934203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33704413-3b8a5733-7a98e696-b96c5030_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c27df355-9cfd3594-b8831249-99390f19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:50.936911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c27df355-9cfd3594-b8831249-99390f19_0] Write session: try to update token
2025-10-02T08:11:50.936929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c27df355-9cfd3594-b8831249-99390f19_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:50.951717Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:50.951741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:50.951744Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:50.951759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534151669620511:7404]
2025-10-02T08:11:50.951766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534151669620511:7404]
2025-10-02T08:11:50.951807Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:50.951808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:50.951815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:50.951817Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:50.951817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:50.951956Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:50.953062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId: src_id|c27df355-9cfd3594-b8831249-99390f19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:50.956064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:51.011665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534155964587875:3998]
2025-10-02T08:11:51.011805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1284, pipe: [1:7556534155964587875:3998]
2025-10-02T08:11:51.091263Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:51.091635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.091649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.091686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964587875:3998], now have 1 active actors on pipe
2025-10-02T08:11:51.091789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534155964587875:3998]
2025-10-02T08:11:51.091813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:51.091819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:51.091887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1285 reason: error at write: Disconnected sessionId: src_id|c27df355-9cfd3594-b8831249-99390f19_0
2025-10-02T08:11:51.091887Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:51.091898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:51.092054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1285 sessionId: src_id|c27df355-9cfd3594-b8831249-99390f19_0 is DEAD
2025-10-02T08:11:51.092187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c27df355-9cfd3594-b8831249-99390f19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:51.092198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c27df355-9cfd3594-b8831249-99390f19_0] Write session will restart in 0.005755s
2025-10-02T08:11:51.092226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c27df355-9cfd3594-b8831249-99390f19_0] Write session: Do CDS request
2025-10-02T08:11:51.092233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c27df355-9cfd3594-b8831249-99390f19_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:51.098552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:51.099214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:51.099257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c27df355-9cfd3594-b8831249-99390f19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.099355Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:51.099362Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:51.099369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:51.099397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:51.099425Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534155964588079:7394]
2025-10-02T08:11:51.099687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:51.099698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1286
2025-10-02T08:11:51.099832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.099847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:51.099859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:51.099863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:51.099866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:51.100041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:51.100090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:51.100174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1286 sessionId:  describe result for acl check
2025-10-02T08:11:51.100203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:51.100208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:51.100209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:51.100214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534155964588090:7393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:51.100381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:51.100423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.100429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.100430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.100431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.100432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.100437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.100446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.100454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.100460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.100467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.100472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.100483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.100493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.100502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.100509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.100516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.100524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.100531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.100535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.100544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.100564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:51.100663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534155964588090:7393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:51.102638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534155964588090:7393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:51.107432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534155964588090:7393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:51.107444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534155964588090:7393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:51.107447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534155964588090:7393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:51.107453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:51.107957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:51.109524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:51.109543Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:51.109546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:51.109550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:51.109555Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1285 [1:7556534155964588079:7394]
2025-10-02T08:11:51.109565Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:51.109580Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:51.109582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.109585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.109587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.109605Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:51.109614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:51.109621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:51.109685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.109692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.109695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:51.109698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:51.109762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:51.109769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.109783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.109788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1285
2025-10-02T08:11:51.109798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:51.109816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964588126:7393], now have 1 active actors on pipe
2025-10-02T08:11:51.109825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.109829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.109850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534156424513973:2378], now have 1 active actors on pipe
2025-10-02T08:11:51.109856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534155964588073:7394]
2025-10-02T08:11:51.109858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534155964588073:7394]
2025-10-02T08:11:51.109863Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:51.109878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:51.109859Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1285
2025-10-02T08:11:51.109895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:51.109902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:51.109905Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:51.109908Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:51.109916Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:51.109925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.109933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.109935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:51.109943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.109956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:51.109992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534155964588073:7394]
2025-10-02T08:11:51.110003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:51.110015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:51.110024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.110073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.110081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.110094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.110128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1286 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0
2025-10-02T08:11:51.110457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c27df355-9cfd3594-b8831249-99390f19_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:51.113257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0] Write session: try to update token
2025-10-02T08:11:51.113273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:51.121228Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:51.121251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:51.121264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534155964588073:7394]
2025-10-02T08:11:51.121309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:51.121307Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:51.121478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:51.121621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.121766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.121907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.122102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:51.122149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:51.129146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId: src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:51.131822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:51.131896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.131911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.131944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:51.131970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:51.132039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.132049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.132206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.132275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.132336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.132398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.132632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.132641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.132706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.132763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.132848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.132924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.132977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.132985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.133062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.133136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.133210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.133286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.133331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.133339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.133403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.133462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.133524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.133585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.133631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.133637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.133702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.133760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.133821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.133885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.133930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.133935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.133999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.134058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.134120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.134180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.134229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.134234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.134296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.134356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.134420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.134489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.134542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.134550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.134617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.134676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.134737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.134797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.134839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.134847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.134908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.134974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.135047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.135107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.135150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.135158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.135221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.135279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.135337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.135397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.135444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.135450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.135492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:51.135552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.135570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.135575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:51.135602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:51.135616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:51.135621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:51.135623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:51.135625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:51.136031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:51.136052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:51.136056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:51.136059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:51.136061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:51.136063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:51.136649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:51.136668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:51.136672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:51.136679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:51.136682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:51.136684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:51.137231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:51.137252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:51.137262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:51.137266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:51.137268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:51.138374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:51.138393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:51.138405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392711138
2025-10-02T08:11:51.138557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:51.138571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:51.138576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:51.138581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:51.138585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:51.138588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:51.139033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:51.139052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:51.139058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:51.139066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:51.139069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:51.139073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:51.139534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:51.139553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:51.139558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:51.139562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:51.139564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:51.139566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:51.140027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:51.140047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:51.140053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:51.141139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:51.141154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:51.141159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:51.141163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:51.141170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392711141
2025-10-02T08:11:51.141457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:51.141477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:51.141486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:51.141489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:51.141492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:51.141496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:51.141947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:51.141968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:51.141974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:51.141977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:51.141980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:51.141983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:51.142429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:51.142448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.142553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392711142
2025-10-02T08:11:51.143278Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:51.143297Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:51.143304Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:51.143311Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:51.144852Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:51.144863Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:51.144865Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:51.144874Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534155964588073:7394]
2025-10-02T08:11:51.144877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534155964588073:7394]
2025-10-02T08:11:51.144922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:51.144923Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:51.144928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.144928Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:51.144930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:51.145048Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:51.191886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534155964588161:3998]
2025-10-02T08:11:51.192018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1285, pipe: [1:7556534155964588161:3998]
2025-10-02T08:11:51.284294Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:51.284595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964588161:3998], now have 1 active actors on pipe
2025-10-02T08:11:51.284722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534155964588161:3998]
2025-10-02T08:11:51.284750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:51.284752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:51.284778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1286 reason: error at write: Disconnected sessionId: src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0
2025-10-02T08:11:51.284972Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:51.284864Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:51.284981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1286 sessionId: src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0 is DEAD
2025-10-02T08:11:51.285376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:51.285396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0] Write session will restart in 0.009909s
2025-10-02T08:11:51.285425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0] Write session: Do CDS request
2025-10-02T08:11:51.285433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:51.293606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:51.294211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:51.294387Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:51.294396Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:51.294406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:51.294449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:51.294546Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534155964588367:7382]
2025-10-02T08:11:51.295212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:51.295392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:51.295430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:51.295740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:51.295783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.295787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.295788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.295789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.295790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.295796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.295805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.295810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.295814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.295823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.295829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.295837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.295849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.295855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.295859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.295865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.295870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.295880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.295885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.295891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.295914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:51.296399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.296482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:51.296505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1287
2025-10-02T08:11:51.296885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.296938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:51.296948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:51.296953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:51.297409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1287 sessionId:  describe result for acl check
2025-10-02T08:11:51.297443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:51.297444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:51.297445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:51.297449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534155964588383:7354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:51.297860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534155964588383:7354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:51.299905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534155964588383:7354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:51.303404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534155964588383:7354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:51.303418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534155964588383:7354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:51.303422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534155964588383:7354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:51.303431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:51.303958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:51.305563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:51.305586Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:51.305590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:51.305593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:51.305600Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1286 [1:7556534155964588367:7382]
2025-10-02T08:11:51.305610Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:51.305627Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:51.305630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.305632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.305635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.305651Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:51.305656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:51.305662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:51.305722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.305732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.305735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:51.305738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:51.305798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:51.305807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.305819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.305829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:51.305849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534155964588361:7382]
2025-10-02T08:11:51.305856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534155964588361:7382]
2025-10-02T08:11:51.305862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:51.305874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:51.305881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1286
2025-10-02T08:11:51.305891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:51.305883Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:51.305896Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:51.305897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:51.305907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964588414:7354], now have 1 active actors on pipe
2025-10-02T08:11:51.305935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534156424513980:2378], now have 1 active actors on pipe
2025-10-02T08:11:51.305943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534155964588361:7382]
2025-10-02T08:11:51.305945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:51.305952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.305960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.305998Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:51.306008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.306011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.306013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:51.306021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.306030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:51.306044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:51.306116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.306101Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1286
2025-10-02T08:11:51.306192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.306198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.306212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.306247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1287 partition: 0 MaxSeqNo: 17 sessionId: src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0
2025-10-02T08:11:51.306616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec52b592-424829c1-fb050a1e-aaf6a351_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:51.309208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0] Write session: try to update token
2025-10-02T08:11:51.309223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:51.323595Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:51.323618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:51.323620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:51.323629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534155964588361:7382]
2025-10-02T08:11:51.323632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534155964588361:7382]
2025-10-02T08:11:51.323673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:51.323677Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:51.323680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.323683Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:51.323683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:51.323829Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:51.332278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId: src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:51.334865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:51.384922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534155964588429:3998]
2025-10-02T08:11:51.385046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1286, pipe: [1:7556534155964588429:3998]
2025-10-02T08:11:51.477682Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:51.478028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.478042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.478062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964588429:3998], now have 1 active actors on pipe
2025-10-02T08:11:51.478199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534155964588429:3998]
2025-10-02T08:11:51.478229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:51.478236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:51.478281Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:51.478300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1287 reason: error at write: Disconnected sessionId: src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0
2025-10-02T08:11:51.478293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:51.478506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1287 sessionId: src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0 is DEAD
2025-10-02T08:11:51.478848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:51.478862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0] Write session will restart in 0.006069s
2025-10-02T08:11:51.478898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0] Write session: Do CDS request
2025-10-02T08:11:51.478905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:51.486355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:51.486421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.486483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:51.486492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1288
2025-10-02T08:11:51.486736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.486770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:51.486775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:51.486777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:51.486977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:51.487130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1288 sessionId:  describe result for acl check
2025-10-02T08:11:51.487142Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:51.487162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:51.487163Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:51.487163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:51.487165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:51.487169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534155964588639:7343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:51.487172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:51.487218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:51.487253Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534155964588638:7349]
2025-10-02T08:11:51.487621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534155964588639:7343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:51.487791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:51.487948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:51.487994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:51.488229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:51.488259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.488264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.488265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.488265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.488266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.488269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.488275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.488277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.488280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.488283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.488288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.488295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.488300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.488304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.488308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.488312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.488316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.488320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.488324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.488329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.488346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:51.489634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534155964588639:7343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:51.496111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534155964588639:7343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:51.496132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534155964588639:7343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:51.496135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534155964588639:7343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:51.496145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:51.496467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:51.498046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:51.498061Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:51.498063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:51.498066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:51.498071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1287 [1:7556534155964588638:7349]
2025-10-02T08:11:51.498079Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:51.498092Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:51.498094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.498096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.498098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.498109Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:51.498113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:51.498117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:51.498159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.498165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.498168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:51.498170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:51.498218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:51.498223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.498232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.498239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:51.498252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534155964588630:7349]
2025-10-02T08:11:51.498258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534155964588630:7349]
2025-10-02T08:11:51.498262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:51.498271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:51.498284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:51.498289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:51.498295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1287
2025-10-02T08:11:51.498307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:51.498317Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:51.498325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964588684:7343], now have 1 active actors on pipe
2025-10-02T08:11:51.498328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534155964588630:7349]
2025-10-02T08:11:51.498331Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:51.498344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534156424513986:2378], now have 1 active actors on pipe
2025-10-02T08:11:51.498352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.498355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.498378Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:51.498387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.498389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.498390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:51.498397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.498403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:51.498419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.498453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:51.498545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.498565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.498588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.498634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1288 partition: 0 MaxSeqNo: 17 sessionId: src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0
2025-10-02T08:11:51.498861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1287
2025-10-02T08:11:51.499041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9b20b1-3e058be8-554478fe-308c21b9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:51.502108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0] Write session: try to update token
2025-10-02T08:11:51.502125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:51.508688Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:51.508708Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:51.508716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534155964588630:7349]
2025-10-02T08:11:51.508757Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:51.508759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:51.508968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:51.509136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.509287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.509431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.509622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:51.509661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:51.520064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId: src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:51.522853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:51.522921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.522934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.522970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:51.522994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:51.523049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.523072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.523246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.523312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.523395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.523478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.523531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.523539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.523616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.523680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.523749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.523826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.523874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.523882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.523961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.524039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.524110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.524190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.524240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.524246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.524318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.524384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.524460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.524529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.524576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.524584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.524656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.524722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.524791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.524878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.524926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.524933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.525008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.525074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.525146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.525217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.525263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.525271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.525342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.525415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.525487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.525562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.525616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.525623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.525690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.525757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.525824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.525892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.525937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.525944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.526048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.526113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.526189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.526271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.526324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.526331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.526417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.526491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.526596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.526698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.526752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.526759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.526829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:51.526895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.526922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.526928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:51.526960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:51.526978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:51.526984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:51.526987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:51.526990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:51.527448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:51.527483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:51.527495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:51.527499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:51.527502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:51.527508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:51.528163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:51.528193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:51.528199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:51.528202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:51.528205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:51.528209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:51.528839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:51.528863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:51.528868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:51.528871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:51.528872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:51.530087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:51.530103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:51.530116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392711529
2025-10-02T08:11:51.530265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:51.530275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:51.530281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:51.530283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:51.530286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:51.530288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:51.530762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:51.530786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:51.530792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:51.530795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:51.530799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:51.530802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:51.531266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:51.531292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:51.531300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:51.531308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:51.531311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:51.531315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:51.531783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:51.531806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:51.531812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:51.532912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:51.532928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:51.532933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:51.532937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:51.532946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392711532
2025-10-02T08:11:51.533232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:51.533255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:51.533261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:51.533264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:51.533270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:51.533273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:51.533734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:51.533757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:51.533763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:51.533767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:51.533770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:51.533773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:51.534236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:51.534258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.534371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392711534
2025-10-02T08:11:51.536782Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:51.536828Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:51.536835Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:51.536843Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:51.536859Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:51.536868Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:51.536870Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:51.536881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534155964588630:7349]
2025-10-02T08:11:51.536884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534155964588630:7349]
2025-10-02T08:11:51.536938Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:51.536965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:51.536967Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:51.536969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.536971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:51.537103Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:51.578437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534155964588706:3998]
2025-10-02T08:11:51.578538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1287, pipe: [1:7556534155964588706:3998]
2025-10-02T08:11:51.677921Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:51.678342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964588706:3998], now have 1 active actors on pipe
2025-10-02T08:11:51.678507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:51.678516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:51.678544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1288 reason: error at write: Disconnected sessionId: src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0
2025-10-02T08:11:51.678679Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:51.678694Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:51.678731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1288 sessionId: src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0 is DEAD
2025-10-02T08:11:51.678906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:51.678922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0] Write session will restart in 0.006323s
2025-10-02T08:11:51.678949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0] Write session: Do CDS request
2025-10-02T08:11:51.678956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:51.678949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534155964588706:3998]
2025-10-02T08:11:51.682599Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [5eb05d0015a07c23] Result# TEvPutResult {Id# [72075186224037892:1287:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:51.682655Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1287:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:51.682727Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1287:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:51.686400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.686858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:51.686875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1289
2025-10-02T08:11:51.687045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.687071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:51.687077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:51.687080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:51.687396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1289 sessionId:  describe result for acl check
2025-10-02T08:11:51.687422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:51.687429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:51.687430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:51.687435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534155964588906:7336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:51.687844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534155964588906:7336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:51.688574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:51.689334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:51.689550Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:51.689562Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:51.689574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:51.689638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:51.689681Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534155964588941:7338]
2025-10-02T08:11:51.690196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:51.690303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534155964588906:7336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:51.690397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:51.690435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:51.690695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:51.690758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.690761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.690762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.690763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.690764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.690769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.690779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.690782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.690785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.690789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.690794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.690800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.690805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.690810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.690814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.690818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.690822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.690825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.690829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.690833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.690860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:51.695889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534155964588906:7336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:51.695907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534155964588906:7336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:51.695911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534155964588906:7336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:51.695920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:51.703805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:51.705418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:51.705434Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:51.705436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:51.705439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:51.705445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1288 [1:7556534155964588941:7338]
2025-10-02T08:11:51.705489Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:51.705506Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:51.705511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.705514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.705515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.705529Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:51.705532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:51.705537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:51.705589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.705597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.705599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:51.705601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:51.705660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:51.705661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.705671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.705699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:51.705714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534155964588922:7338]
2025-10-02T08:11:51.705715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534155964588922:7338]
2025-10-02T08:11:51.705720Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:51.705734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:51.705744Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:51.705746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:51.705748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:51.705748Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:51.705757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964588969:7336], now have 1 active actors on pipe
2025-10-02T08:11:51.705772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1288
2025-10-02T08:11:51.705790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534156424513995:2378], now have 1 active actors on pipe
2025-10-02T08:11:51.705797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534155964588922:7338]
2025-10-02T08:11:51.705804Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:51.705809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.705814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.705815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:51.705853Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:51.705881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.705884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.705885Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1288
2025-10-02T08:11:51.705885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:51.705895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.705904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:51.705922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.706065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.706080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.706114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.706171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1289 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0
2025-10-02T08:11:51.706589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfe2cf5-10cb648a-2fa1c6f0-4351fe41_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:51.709967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0] Write session: try to update token
2025-10-02T08:11:51.709993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:51.723898Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:51.723917Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:51.723919Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:51.723928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534155964588922:7338]
2025-10-02T08:11:51.723932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534155964588922:7338]
2025-10-02T08:11:51.723977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:51.723978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:51.723993Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:51.724000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.724003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:51.724149Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:51.731094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId: src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:51.733778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:51.779173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534155964588986:3998]
2025-10-02T08:11:51.779339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1288, pipe: [1:7556534155964588986:3998]
2025-10-02T08:11:51.863820Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:51.864058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.864068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.864085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964588986:3998], now have 1 active actors on pipe
2025-10-02T08:11:51.864185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534155964588986:3998]
2025-10-02T08:11:51.864206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:51.864211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:51.864260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1289 reason: error at write: Disconnected sessionId: src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0
2025-10-02T08:11:51.864285Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:51.864291Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:51.864404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1289 sessionId: src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0 is DEAD
2025-10-02T08:11:51.864553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:51.864562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0] Write session will restart in 0.008968s
2025-10-02T08:11:51.864586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0] Write session: Do CDS request
2025-10-02T08:11:51.864593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:51.872465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:51.872715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:51.872932Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:51.872942Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:51.872953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:51.873000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:51.873036Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534155964589233:7267]
2025-10-02T08:11:51.873668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:51.873863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:51.873904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:51.874204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:51.874245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.874251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.874252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.874253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.874254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.874260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.874271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.874274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.874278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.874282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.874288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.874302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:51.874312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.874318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:51.874323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.874322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.874326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:51.874329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:51.874330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1290
2025-10-02T08:11:51.874334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.874339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.874344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.874350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.874369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:51.874541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:51.874576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:51.874585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:51.874588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:51.874938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1290 sessionId:  describe result for acl check
2025-10-02T08:11:51.874966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:51.874972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:51.874974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:51.874978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534155964589249:7256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:51.875455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534155964589249:7256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:51.877271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534155964589249:7256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:51.882590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:51.882649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534155964589249:7256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:51.882664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534155964589249:7256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:51.882667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534155964589249:7256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:51.882681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:51.884112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:51.884131Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:51.884133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:51.884137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:51.884143Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1289 [1:7556534155964589233:7267]
2025-10-02T08:11:51.884155Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:51.884171Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:51.884174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.884178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.884179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.884195Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:51.884206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:51.884213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:51.884273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.884281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.884284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:51.884286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:51.884344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:51.884351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.884365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:51.884383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:51.884404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964589278:7256], now have 1 active actors on pipe
2025-10-02T08:11:51.884406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1289
2025-10-02T08:11:51.884414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534156424514025:2378], now have 1 active actors on pipe
2025-10-02T08:11:51.884420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534155964589227:7267]
2025-10-02T08:11:51.884422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534155964589227:7267]
2025-10-02T08:11:51.884433Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:51.884443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.884443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:51.884445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:51.884447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.884462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:51.884474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:51.884445Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1289
2025-10-02T08:11:51.884484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:51.884523Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|363725fe-e7f99e47-dc91f642-2761c118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:51.884535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.884543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.884545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:51.884553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.884565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:51.884581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534155964589227:7267]
2025-10-02T08:11:51.884593Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:51.884613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:51.884621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.884698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.884705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.884718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:51.884754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1290 partition: 0 MaxSeqNo: 17 sessionId: src_id|363725fe-e7f99e47-dc91f642-2761c118_0
2025-10-02T08:11:51.885145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba754c81-b1436e9d-72044c46-2eae7f6e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|363725fe-e7f99e47-dc91f642-2761c118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:51.888167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|363725fe-e7f99e47-dc91f642-2761c118_0] Write session: try to update token
2025-10-02T08:11:51.888190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|363725fe-e7f99e47-dc91f642-2761c118_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:51.895019Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:51.895043Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:51.895051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534155964589227:7267]
2025-10-02T08:11:51.895087Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:51.895091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:51.895261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:51.895389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.895506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.895629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:51.895802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:51.895842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:51.903896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId: src_id|363725fe-e7f99e47-dc91f642-2761c118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:51.906462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:51.906553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.906570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.906604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:51.906634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:51.906707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:51.906731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:51.906899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.906967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.907035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.907104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.907486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.907499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.907569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.907629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.907692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.907755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.907797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.907803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.907864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.907929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.908004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.908069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.908116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.908123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.908187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.908246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.908305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.908368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.908418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.908425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.908495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.908558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.908617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.908680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.908728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.908734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.908797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.908937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.909005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.909075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.909121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.909125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.909196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.909263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.909343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.909413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.909467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.909475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.909551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.909614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.909680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.909747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.909806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.909813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.909880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.909942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.910005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.910079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.910122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.910131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.910203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:51.910268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:51.910331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:51.910397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:51.910444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:51.910452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:51.910515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:51.910582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:51.910605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:51.910608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:51.910638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:51.910655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:51.910663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:51.910666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:51.910669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:51.911069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:51.911104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:51.911110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:51.911112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:51.911114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:51.911116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:51.911589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:51.911615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:51.911620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:51.911623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:51.911626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:51.911628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:51.912107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:51.912133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:51.912142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:51.912146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:51.912149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:51.913488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:51.913521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:51.913536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392711913
2025-10-02T08:11:51.913927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:51.913958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:51.913966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:51.913970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:51.913974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:51.913977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:51.914752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:51.914788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:51.914800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:51.914810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:51.914814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:51.914821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:51.915483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:51.915527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:51.915537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:51.915547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:51.915556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:51.915559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:51.916293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:51.916333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:51.916343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:51.917710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:51.917731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:51.917737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:51.917741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:51.917754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392711917
2025-10-02T08:11:51.918121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:51.918147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:51.918155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:51.918158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:51.918161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:51.918165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:51.918678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:51.918703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:51.918713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:51.918720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:51.918727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:51.918732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:51.919231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:51.919256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:51.919351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392711918
2025-10-02T08:11:51.922376Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:51.922415Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:51.922422Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:51.922429Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:51.922443Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:51.922446Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:51.922448Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:51.922457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534155964589227:7267]
2025-10-02T08:11:51.922464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534155964589227:7267]
2025-10-02T08:11:51.922519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:51.922534Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:51.922579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:51.922590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:51.922592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:51.922773Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:51.964527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534155964589298:3998]
2025-10-02T08:11:51.964652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1289, pipe: [1:7556534155964589298:3998]
2025-10-02T08:11:52.061261Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:52.061675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534155964589298:3998], now have 1 active actors on pipe
2025-10-02T08:11:52.061956Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:52.061895Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:52.062110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534155964589298:3998]
2025-10-02T08:11:52.062142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:52.062169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1290 reason: status is not ok: tablet will be restarted right now sessionId: src_id|363725fe-e7f99e47-dc91f642-2761c118_0
2025-10-02T08:11:52.062357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1290 sessionId: src_id|363725fe-e7f99e47-dc91f642-2761c118_0 is DEAD
2025-10-02T08:11:52.062518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363725fe-e7f99e47-dc91f642-2761c118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:52.062533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363725fe-e7f99e47-dc91f642-2761c118_0] Write session will restart in 0.005923s
2025-10-02T08:11:52.062561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363725fe-e7f99e47-dc91f642-2761c118_0] Write session: Do CDS request
2025-10-02T08:11:52.062569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363725fe-e7f99e47-dc91f642-2761c118_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:52.066142Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0d2f9bf613038f17] Result# TEvPutResult {Id# [72075186224037892:1289:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:52.066154Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1289:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:52.066209Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1289:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:52.069355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|363725fe-e7f99e47-dc91f642-2761c118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.069432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:52.069446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1291
2025-10-02T08:11:52.069602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.069633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:52.069643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:52.069647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:52.070061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1291 sessionId:  describe result for acl check
2025-10-02T08:11:52.070094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:52.070096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:52.070098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:52.070103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534160259556777:7257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:52.070564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534160259556777:7257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:52.072062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:52.072348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534160259556777:7257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:52.072759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:52.072909Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:52.072918Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:52.072925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:52.072970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:52.072996Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534160259556835:7262]
2025-10-02T08:11:52.073425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:52.073607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:52.073664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:52.074040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:52.074102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.074108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.074109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.074110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.074111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.074115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.074125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.074128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.074131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.074135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.074141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.074148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.074153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.074160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.074164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.074169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.074172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.074177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.074180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.074185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.074203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:52.074802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534160259556777:7257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:52.074814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534160259556777:7257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:52.074816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534160259556777:7257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:52.074823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:52.082231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:52.083767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:52.083786Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:52.083789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:52.083793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:52.083799Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1290 [1:7556534160259556835:7262]
2025-10-02T08:11:52.083814Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:52.083831Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:52.083841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.083844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.083845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.083861Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:52.083870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:52.083875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:52.083939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.083949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.083952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:52.083954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:52.084029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:52.084038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.084050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.084059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:52.084076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259556854:7257], now have 1 active actors on pipe
2025-10-02T08:11:52.084083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534160259556820:7262]
2025-10-02T08:11:52.084084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534160259556820:7262]
2025-10-02T08:11:52.084092Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:52.084100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534160719481342:2378], now have 1 active actors on pipe
2025-10-02T08:11:52.084104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:52.084107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:52.084107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:52.084113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1290
2025-10-02T08:11:52.084119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:52.084122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:52.084156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.084165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.084177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534160259556820:7262]
2025-10-02T08:11:52.084188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:52.084198Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:52.084220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:52.084231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.084234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.084236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:52.084243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.084250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:52.084270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.084246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1290
2025-10-02T08:11:52.084322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.084329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.084341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.084369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1291 partition: 0 MaxSeqNo: 17 sessionId: src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0
2025-10-02T08:11:52.084739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|363725fe-e7f99e47-dc91f642-2761c118_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:52.087881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0] Write session: try to update token
2025-10-02T08:11:52.087900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:52.101159Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:52.101179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:52.101182Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:52.101191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534160259556820:7262]
2025-10-02T08:11:52.101199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534160259556820:7262]
2025-10-02T08:11:52.101248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:52.101254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:52.101260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:52.101264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.101266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:52.101442Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:52.103790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId: src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:52.106349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:52.162187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534160259556882:3998]
2025-10-02T08:11:52.162311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1290, pipe: [1:7556534160259556882:3998]
2025-10-02T08:11:52.235950Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:52.236223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.236233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.236268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259556882:3998], now have 1 active actors on pipe
2025-10-02T08:11:52.236395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:52.236406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:52.236438Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:52.236474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1291 reason: error at write: Disconnected sessionId: src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0
2025-10-02T08:11:52.236481Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:52.236650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1291 sessionId: src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0 is DEAD
2025-10-02T08:11:52.236673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534160259556882:3998]
2025-10-02T08:11:52.236833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:52.236844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0] Write session will restart in 0.007599s
2025-10-02T08:11:52.236868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0] Write session: Do CDS request
2025-10-02T08:11:52.236874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:52.244254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:52.245063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:52.245221Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:52.245228Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:52.245236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:52.245272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:52.245327Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534160259557098:7248]
2025-10-02T08:11:52.245353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.245432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:52.245445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1292
2025-10-02T08:11:52.245581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.245602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:52.245608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:52.245611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:52.245908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:52.245945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1292 sessionId:  describe result for acl check
2025-10-02T08:11:52.245976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:52.245981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:52.245983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:52.245988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534160259557104:7238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:52.246068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:52.246102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:52.246359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:52.246398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.246403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.246404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.246404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.246405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.246409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.246417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.246421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.246424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.246427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.246431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.246436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534160259557104:7238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:52.246437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.246442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.246446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.246449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.246453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.246456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.246461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.246464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.246468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.246483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:52.248547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534160259557104:7238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:52.254186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534160259557104:7238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:52.254206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534160259557104:7238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:52.254210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534160259557104:7238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:52.254223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:52.254622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:52.256020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:52.256033Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:52.256035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:52.256039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:52.256044Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1291 [1:7556534160259557098:7248]
2025-10-02T08:11:52.256055Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:52.256072Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:52.256075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.256078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.256080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.256094Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:52.256100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:52.256111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:52.256166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.256172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.256175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:52.256177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:52.256234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:52.256242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.256254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.256270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:52.256292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259557146:7238], now have 1 active actors on pipe
2025-10-02T08:11:52.256292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1291
2025-10-02T08:11:52.256302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534160259557092:7248]
2025-10-02T08:11:52.256304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534160259557092:7248]
2025-10-02T08:11:52.256314Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:52.256326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534160719481349:2378], now have 1 active actors on pipe
2025-10-02T08:11:52.256329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:52.256332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:52.256335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.256338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.256355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:52.256373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:52.256380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:52.256367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1291
2025-10-02T08:11:52.256416Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:52.256427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.256430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.256438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:52.256446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.256458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:52.256469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534160259557092:7248]
2025-10-02T08:11:52.256476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:52.256485Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:52.256505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.256545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.256552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.256565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.256601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1292 partition: 0 MaxSeqNo: 17 sessionId: src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0
2025-10-02T08:11:52.256929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62193583-58b26f7c-7e0c4cc1-704f38d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:52.259723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0] Write session: try to update token
2025-10-02T08:11:52.259736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:52.273807Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:52.273828Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:52.273831Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:52.273838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534160259557092:7248]
2025-10-02T08:11:52.273843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534160259557092:7248]
2025-10-02T08:11:52.273884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:52.273890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.273889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:52.273892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:52.273895Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:52.274032Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:52.277086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId: src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:52.280046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:52.336725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534160259557163:3998]
2025-10-02T08:11:52.336844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1291, pipe: [1:7556534160259557163:3998]
2025-10-02T08:11:52.409963Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:52.410339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.410359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.410398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259557163:3998], now have 1 active actors on pipe
2025-10-02T08:11:52.410564Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:52.410603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:52.410677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1292 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0
2025-10-02T08:11:52.410839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1292 sessionId: src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0 is DEAD
2025-10-02T08:11:52.410987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:52.410993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0] Write session will restart in 0.006663s
2025-10-02T08:11:52.411012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0] Write session: Do CDS request
2025-10-02T08:11:52.411017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:52.411097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534160259557163:3998]
2025-10-02T08:11:52.411164Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:52.418397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.418440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:52.418457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1293
2025-10-02T08:11:52.418688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.418718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:52.418736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:52.418739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:52.419123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1293 sessionId:  describe result for acl check
2025-10-02T08:11:52.419150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:52.419152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:52.419153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:52.419170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534160259557367:7225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:52.419652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534160259557367:7225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:52.420582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:52.421937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:52.422106Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:52.422116Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:52.422126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:52.422171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:52.422206Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534160259557403:7234]
2025-10-02T08:11:52.422831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:52.423288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534160259557367:7225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:52.423373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:52.423417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:52.423722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:52.423769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.423775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.423776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.423777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.423779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.423784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.423794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.423802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.423806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.423810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.423820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.423832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.423843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.423852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.423861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.423870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.423879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.423885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.423894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.423904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.423930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:52.429660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534160259557367:7225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:52.429679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534160259557367:7225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:52.429682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534160259557367:7225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:52.429692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:52.431663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:52.433281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:52.433303Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:52.433305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:52.433308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:52.433313Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1292 [1:7556534160259557403:7234]
2025-10-02T08:11:52.433321Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:52.433339Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:52.433342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.433345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.433347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.433363Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:52.433369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:52.433374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:52.433504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.433516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.433519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:52.433522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:52.433580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:52.433586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.433595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.433602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:52.433618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534160259557386:7234]
2025-10-02T08:11:52.433623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534160259557386:7234]
2025-10-02T08:11:52.433629Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:52.433639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:52.433646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:52.433649Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:52.433651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:52.433653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:52.433662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534160719481357:2378], now have 1 active actors on pipe
2025-10-02T08:11:52.433668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259557431:7225], now have 1 active actors on pipe
2025-10-02T08:11:52.433675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1292
2025-10-02T08:11:52.433693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534160259557386:7234]
2025-10-02T08:11:52.433702Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:52.433707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.433710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.433714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:52.433742Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12c78885-27e565e8-b9d14330-b9219eb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:52.433751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.433753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.433754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:52.433761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.433727Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1292
2025-10-02T08:11:52.433768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:52.433791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.433824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.433829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.433839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.433869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1293 partition: 0 MaxSeqNo: 17 sessionId: src_id|12c78885-27e565e8-b9d14330-b9219eb8_0
2025-10-02T08:11:52.434310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d182ee0-5f0e3c7a-4ab947dd-193163ee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|12c78885-27e565e8-b9d14330-b9219eb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:52.437593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c78885-27e565e8-b9d14330-b9219eb8_0] Write session: try to update token
2025-10-02T08:11:52.437612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c78885-27e565e8-b9d14330-b9219eb8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:52.451057Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:52.451079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:52.451082Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:52.451090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534160259557386:7234]
2025-10-02T08:11:52.451098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534160259557386:7234]
2025-10-02T08:11:52.451141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:52.451143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:52.451152Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:52.451152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.451155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:52.451303Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:52.457192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId: src_id|12c78885-27e565e8-b9d14330-b9219eb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:52.459585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:52.511276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534160259557444:3998]
2025-10-02T08:11:52.511428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1292, pipe: [1:7556534160259557444:3998]
2025-10-02T08:11:52.583643Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:52.583881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.583892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.583908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259557444:3998], now have 1 active actors on pipe
2025-10-02T08:11:52.584026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:52.584041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:52.584088Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:52.584100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1293 reason: error at write: Disconnected sessionId: src_id|12c78885-27e565e8-b9d14330-b9219eb8_0
2025-10-02T08:11:52.584150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:52.584254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1293 sessionId: src_id|12c78885-27e565e8-b9d14330-b9219eb8_0 is DEAD
2025-10-02T08:11:52.584286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534160259557444:3998]
2025-10-02T08:11:52.584416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c78885-27e565e8-b9d14330-b9219eb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:52.584421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c78885-27e565e8-b9d14330-b9219eb8_0] Write session will restart in 0.008314s
2025-10-02T08:11:52.584441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c78885-27e565e8-b9d14330-b9219eb8_0] Write session: Do CDS request
2025-10-02T08:11:52.584446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c78885-27e565e8-b9d14330-b9219eb8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:52.591375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:52.591885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:52.592010Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:52.592026Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:52.592032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:52.592060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:52.592086Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534160259557668:7198]
2025-10-02T08:11:52.592510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:52.592638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:52.592680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:52.592909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:52.592943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.592948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.592948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.592949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.592949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.592952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.592958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.592960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.592962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.592964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.592967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.592972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.592975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.592978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.592980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.592982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.592984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.592987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.592989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.592992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.593001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:52.594419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12c78885-27e565e8-b9d14330-b9219eb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.594468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:52.594479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1294
2025-10-02T08:11:52.594697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.594725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:52.594733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:52.594736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:52.595104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1294 sessionId:  describe result for acl check
2025-10-02T08:11:52.595139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:52.595144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:52.595145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:52.595150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534160259557684:7201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:52.595659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534160259557684:7201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:52.598012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534160259557684:7201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:52.600277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:52.600664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534160259557684:7201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:52.600677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534160259557684:7201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:52.600680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534160259557684:7201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:52.600698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:52.601777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:52.601792Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:52.601793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:52.601796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:52.601799Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1293 [1:7556534160259557668:7198]
2025-10-02T08:11:52.601807Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:52.601818Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:52.601824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.601825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.601827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.601840Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:52.601845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:52.601851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:52.601896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.601903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.601905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:52.601907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:52.601949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:52.601959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.601967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.601973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:52.601980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1293
2025-10-02T08:11:52.601985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259557716:7201], now have 1 active actors on pipe
2025-10-02T08:11:52.601989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534160259557662:7198]
2025-10-02T08:11:52.601991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534160259557662:7198]
2025-10-02T08:11:52.601996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:52.602002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534160719481363:2378], now have 1 active actors on pipe
2025-10-02T08:11:52.602006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.602008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.602012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:52.602015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:52.602021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:52.602028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:52.602030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:52.602062Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:52.602074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.602078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.602079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:52.602089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.602100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:52.602078Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1293
2025-10-02T08:11:52.602106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534160259557662:7198]
2025-10-02T08:11:52.602114Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:52.602115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:52.602141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.602179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.602183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.602195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.602221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1294 partition: 0 MaxSeqNo: 17 sessionId: src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0
2025-10-02T08:11:52.602603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12c78885-27e565e8-b9d14330-b9219eb8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:52.605743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0] Write session: try to update token
2025-10-02T08:11:52.605764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:52.618957Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:52.618979Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:52.618981Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:52.618989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534160259557662:7198]
2025-10-02T08:11:52.618993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534160259557662:7198]
2025-10-02T08:11:52.619031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:52.619037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.619037Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:52.619039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:52.619043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:52.619193Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:52.622354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId: src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:52.625290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:52.684383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534160259557733:3998]
2025-10-02T08:11:52.684517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1293, pipe: [1:7556534160259557733:3998]
2025-10-02T08:11:52.750491Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:52.750749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.750761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.750801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259557733:3998], now have 1 active actors on pipe
2025-10-02T08:11:52.750929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534160259557733:3998]
2025-10-02T08:11:52.750956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:52.750964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:52.751031Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:52.751038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1294 reason: error at write: Disconnected sessionId: src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0
2025-10-02T08:11:52.751054Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:52.751221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1294 sessionId: src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0 is DEAD
2025-10-02T08:11:52.751407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:52.751422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0] Write session will restart in 0.008358s
2025-10-02T08:11:52.751450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0] Write session: Do CDS request
2025-10-02T08:11:52.751456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:52.759309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:52.760502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:52.760638Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:52.760646Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:52.760652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:52.760684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:52.760718Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534160259557955:7195]
2025-10-02T08:11:52.761167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:52.761305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.761338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:52.761363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:52.761459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:52.761478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1295
2025-10-02T08:11:52.761570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:52.761586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.761607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:52.761608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.761609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.761610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.761611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.761612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.761616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.761618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:52.761622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:52.761624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.761628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.761631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.761635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.761641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.761647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.761653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.761657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.761660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.761664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.761668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.761673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.761677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.761682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.761695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:52.761933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1295 sessionId:  describe result for acl check
2025-10-02T08:11:52.761959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:52.761963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:52.761964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:52.761967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534160259557971:7186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:52.762325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534160259557971:7186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:52.764550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534160259557971:7186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:52.768967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534160259557971:7186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:52.768986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534160259557971:7186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:52.768988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534160259557971:7186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:52.768997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:52.769382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:52.770862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:52.770879Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:52.770882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:52.770885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:52.770891Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1294 [1:7556534160259557955:7195]
2025-10-02T08:11:52.770901Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:52.770916Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:52.770919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.770922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.770924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.770941Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:52.770952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:52.770959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:52.771033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.771041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.771044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:52.771046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:52.771106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:52.771114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.771127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.771144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:52.771157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1294
2025-10-02T08:11:52.771166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259558004:7186], now have 1 active actors on pipe
2025-10-02T08:11:52.771170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534160719481372:2378], now have 1 active actors on pipe
2025-10-02T08:11:52.771176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534160259557949:7195]
2025-10-02T08:11:52.771178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534160259557949:7195]
2025-10-02T08:11:52.771189Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:52.771198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.771203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:52.771205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.771206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:52.771223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:52.771241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:52.771249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:52.771280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1294
2025-10-02T08:11:52.771290Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:52.771301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.771305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.771307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:52.771315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.771322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:52.771330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534160259557949:7195]
2025-10-02T08:11:52.771336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:52.771342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:52.771363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.771408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.771419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.771434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.771472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1295 partition: 0 MaxSeqNo: 17 sessionId: src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0
2025-10-02T08:11:52.771885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d4feaf-3c3dac77-a9067e7d-b6b03ee5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:52.774940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0] Write session: try to update token
2025-10-02T08:11:52.774962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:52.787920Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:52.787943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:52.787946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:52.787953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534160259557949:7195]
2025-10-02T08:11:52.787959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534160259557949:7195]
2025-10-02T08:11:52.788008Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:52.788013Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:52.788014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:52.788025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.788032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:52.788166Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:52.790868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId: src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:52.793217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:52.858428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534160259558031:3998]
2025-10-02T08:11:52.859985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1294, pipe: [1:7556534160259558031:3998]
2025-10-02T08:11:52.921112Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:52.921504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.921517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.921553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259558031:3998], now have 1 active actors on pipe
2025-10-02T08:11:52.921676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:52.921687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:52.921737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1295 reason: error at write: Disconnected sessionId: src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0
2025-10-02T08:11:52.921748Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:52.921766Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:52.921908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1295 sessionId: src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0 is DEAD
2025-10-02T08:11:52.922021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534160259558031:3998]
2025-10-02T08:11:52.922047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:52.922053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0] Write session will restart in 0.007216s
2025-10-02T08:11:52.922079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0] Write session: Do CDS request
2025-10-02T08:11:52.922086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:52.928837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:52.930394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.930497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:52.930513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1296
2025-10-02T08:11:52.930693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:52.930725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:52.930734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:52.930737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:52.931111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1296 sessionId:  describe result for acl check
2025-10-02T08:11:52.931143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:52.931149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:52.931150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:52.931156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534160259558279:7144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:52.931614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534160259558279:7144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:52.933394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534160259558279:7144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:52.933750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:52.933968Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:52.933979Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:52.933989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:52.934055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:52.934091Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534160259558309:7140]
2025-10-02T08:11:52.934654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:52.934877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:52.934945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:52.935267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:52.935333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.935339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.935341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.935342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.935343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.935348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.935356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.935360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.935364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.935367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.935373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.935380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:52.935392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.935398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:52.935407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.935412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:52.935417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.935447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.935453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.935462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.935479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:52.936217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534160259558279:7144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:52.936232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534160259558279:7144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:52.936235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534160259558279:7144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:52.936243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:52.943594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:52.945181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:52.945199Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:52.945203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:52.945206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:52.945211Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1295 [1:7556534160259558309:7140]
2025-10-02T08:11:52.945221Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:52.945234Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:52.945236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.945238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.945240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.945253Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:52.945256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:52.945262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:52.945313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.945320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.945323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:52.945325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:52.945374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:52.945380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.945390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:52.945397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:52.945410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534160259558271:7140]
2025-10-02T08:11:52.945414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534160259558271:7140]
2025-10-02T08:11:52.945421Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:52.945435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:52.945443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:52.945447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:52.945452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:52.945459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:52.945472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534160259558326:7144], now have 1 active actors on pipe
2025-10-02T08:11:52.945472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1295
2025-10-02T08:11:52.945502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534160719481401:2378], now have 1 active actors on pipe
2025-10-02T08:11:52.945513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.945515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.945528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534160259558271:7140]
2025-10-02T08:11:52.945536Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:52.945554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:52.945564Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:52.945570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:52.945573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:52.945575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:52.945585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:52.945594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:52.945577Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1295
2025-10-02T08:11:52.945621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.945667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:52.945673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:52.945683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:52.945714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1296 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0
2025-10-02T08:11:52.946084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af34fd30-e9f76ffe-76346d4b-c5b0c0cf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:52.949271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0] Write session: try to update token
2025-10-02T08:11:52.949295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:52.963455Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:52.963479Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:52.963481Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:52.963488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534160259558271:7140]
2025-10-02T08:11:52.963493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534160259558271:7140]
2025-10-02T08:11:52.963534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:52.963537Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:52.963541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:52.963542Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:52.963543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:52.963695Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:52.965922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId: src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:52.968446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:53.022277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534164554525635:3998]
2025-10-02T08:11:53.022394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1295, pipe: [1:7556534164554525635:3998]
2025-10-02T08:11:53.093823Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:53.094171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.094182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.094216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554525635:3998], now have 1 active actors on pipe
2025-10-02T08:11:53.094340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:53.094352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:53.094410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1296 reason: error at write: Disconnected sessionId: src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0
2025-10-02T08:11:53.094479Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:53.094557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1296 sessionId: src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0 is DEAD
2025-10-02T08:11:53.094564Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:53.094670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:53.094676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0] Write session will restart in 0.006502s
2025-10-02T08:11:53.094694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0] Write session: Do CDS request
2025-10-02T08:11:53.094698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:53.094700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534164554525635:3998]
2025-10-02T08:11:53.102366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.102466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:53.102481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1297
2025-10-02T08:11:53.102534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:53.102604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.102644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:53.102655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:53.102662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:53.102952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1297 sessionId:  describe result for acl check
2025-10-02T08:11:53.102977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:53.102983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:53.102985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:53.102989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534164554525861:7131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:53.103358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534164554525861:7131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:53.103417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:53.103560Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:53.103568Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:53.103577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:53.103620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:53.103664Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534164554525866:7128]
2025-10-02T08:11:53.104245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:53.104390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:53.104428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:53.104706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:53.104746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.104752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.104753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.104754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.104755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.104759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.104767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.104770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.104778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.104781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.104790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.104816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.104821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.104825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.104829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.104833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.104837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.104841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.104845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.104849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.104865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:53.104878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534164554525861:7131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:53.111446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534164554525861:7131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:53.111463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534164554525861:7131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:53.111466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534164554525861:7131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:53.111479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:53.112248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:53.113845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:53.113861Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:53.113864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:53.113867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:53.113875Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1296 [1:7556534164554525866:7128]
2025-10-02T08:11:53.113887Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:53.113902Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:53.113904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.113907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.113909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.113922Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:53.113931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:53.113941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:53.113998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.114005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.114007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:53.114010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:53.114066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:53.114073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.114084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.114098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:53.114103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1296
2025-10-02T08:11:53.114120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554525909:7131], now have 1 active actors on pipe
2025-10-02T08:11:53.114132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534165014448717:2378], now have 1 active actors on pipe
2025-10-02T08:11:53.114137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.114140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.114156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534164554525854:7128]
2025-10-02T08:11:53.114158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534164554525854:7128]
2025-10-02T08:11:53.114169Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:53.114182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:53.114185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:53.114188Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:53.114195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:53.114197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:53.114210Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:53.114216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.114219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.114221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:53.114230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.114200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1296
2025-10-02T08:11:53.114242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:53.114275Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534164554525854:7128]
2025-10-02T08:11:53.114289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:53.114304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:53.114305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.114342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.114354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.114390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.114432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1297 partition: 0 MaxSeqNo: 17 sessionId: src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0
2025-10-02T08:11:53.114795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f66504f-de5d795e-1c6d00e1-89cfa25a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:53.117756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0] Write session: try to update token
2025-10-02T08:11:53.117772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:53.124236Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:53.124259Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.124267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534164554525854:7128]
2025-10-02T08:11:53.124311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:53.124319Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:53.124478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:53.124613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.124747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.124900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.125070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:53.125107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:53.132335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId: src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:53.134670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:53.134746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.134758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.134788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:53.134815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:53.134994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.135012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.135175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.135234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.135311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.135371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.135541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.135550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.135614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.135672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.135732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.135809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.135859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.135865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.135931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.136002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.136074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.136135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.136186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.136193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.136277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.136336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.136398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.136460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.136506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.136513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.136578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.136637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.136702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.136760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.136820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.136827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.136891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.136947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.137009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.137066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.137114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.137121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.137183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.137243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.137305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.137364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.137411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.137418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.137478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.137535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.137598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.137659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.137700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.137706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.137769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.137833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.137892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.137954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.137996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.138002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.138063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.138119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.138179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.138241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.138285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.138291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.138344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:53.138406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.138426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.138432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:53.138458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:53.138474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:53.138481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:53.138484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:53.138491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:53.138872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:53.138897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:53.138907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:53.138911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:53.138914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:53.138918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:53.139473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:53.139498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:53.139503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:53.139507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:53.139510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:53.139512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:53.139955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:53.139977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:53.139986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:53.140002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:53.140005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:53.141173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:53.141191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:53.141203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392713141
2025-10-02T08:11:53.141314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:53.141328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:53.141336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:53.141341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:53.141344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:53.141347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:53.141817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:53.141840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:53.141849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:53.141856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:53.141859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:53.141862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:53.142305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:53.142328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:53.142342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:53.142349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:53.142352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:53.142355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:53.142810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:53.142832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:53.142843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:53.144067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:53.144086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:53.144090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:53.144092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:53.144100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392713144
2025-10-02T08:11:53.144361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:53.144382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:53.144392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:53.144398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:53.144401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:53.144402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:53.144894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:53.144917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:53.144921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:53.144926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:53.144929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:53.144933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:53.145397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:53.145416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.145506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392713145
2025-10-02T08:11:53.147754Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:53.147775Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:53.147779Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:53.147783Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:53.147791Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:53.147793Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.147794Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:53.147803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534164554525854:7128]
2025-10-02T08:11:53.147810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534164554525854:7128]
2025-10-02T08:11:53.147858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:53.147872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:53.147886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:53.147895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.147897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:53.148028Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:53.196884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534164554525937:3998]
2025-10-02T08:11:53.197013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1296, pipe: [1:7556534164554525937:3998]
2025-10-02T08:11:53.292309Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:53.292702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554525937:3998], now have 1 active actors on pipe
2025-10-02T08:11:53.292914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534164554525937:3998]
2025-10-02T08:11:53.292940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:53.292942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:53.292966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1297 reason: error at write: Disconnected sessionId: src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0
2025-10-02T08:11:53.293010Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:53.293017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:53.293160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1297 sessionId: src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0 is DEAD
2025-10-02T08:11:53.293291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:53.293300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0] Write session will restart in 0.005241s
2025-10-02T08:11:53.293322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0] Write session: Do CDS request
2025-10-02T08:11:53.293330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:53.297091Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [bc9100fcab300d28] Result# TEvPutResult {Id# [72075186224037892:1296:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:53.297099Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1296:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:53.297155Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1296:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:53.299340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.299424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:53.299439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1298
2025-10-02T08:11:53.299560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.299588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:53.299596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:53.299600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:53.300174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1298 sessionId:  describe result for acl check
2025-10-02T08:11:53.300210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:53.300216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:53.300218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:53.300222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534164554526087:7114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:53.300734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534164554526087:7114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:53.302915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534164554526087:7114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:53.303639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:53.304548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:53.304715Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:53.304727Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:53.304737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:53.304862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:53.304903Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534164554526199:7122]
2025-10-02T08:11:53.305390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:53.305581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:53.305626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:53.305750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534164554526087:7114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:53.305764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534164554526087:7114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:53.305777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534164554526087:7114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:53.305785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:53.305961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:53.305997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.306004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.306005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.306006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.306007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.306012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.306021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.306025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.306029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.306032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.306037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.306044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.306056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.306061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.306067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.306071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.306075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.306080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.306084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.306088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.306107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:53.314153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:53.315680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:53.315702Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:53.315705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:53.315708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:53.315714Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1297 [1:7556534164554526199:7122]
2025-10-02T08:11:53.315727Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:53.315743Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:53.315746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.315749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.315750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.315766Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:53.315770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:53.315777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:53.315832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.315843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.315846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:53.315848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:53.315907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:53.315914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.315927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.315938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:53.315961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554526211:7114], now have 1 active actors on pipe
2025-10-02T08:11:53.315971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534164554526192:7122]
2025-10-02T08:11:53.315973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534164554526192:7122]
2025-10-02T08:11:53.315979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:53.315979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1297
2025-10-02T08:11:53.315986Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:53.315989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:53.316004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:53.316017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:53.316020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:53.316075Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1297
2025-10-02T08:11:53.316026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534165014448725:2378], now have 1 active actors on pipe
2025-10-02T08:11:53.316040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.316044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.316081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534164554526192:7122]
2025-10-02T08:11:53.316084Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:53.316097Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:53.316101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.316106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.316108Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:53.316109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:53.316118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.316124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:53.316162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.316365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.316380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.316403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.316464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1298 partition: 0 MaxSeqNo: 17 sessionId: src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0
2025-10-02T08:11:53.316825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b4bfcf-a54a777b-a64bf014-d6ea0d1a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:53.319277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0] Write session: try to update token
2025-10-02T08:11:53.319291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:53.326895Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:53.326918Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.326926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534164554526192:7122]
2025-10-02T08:11:53.326969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:53.326971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:53.327138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:53.327284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.327429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.327571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.327769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:53.327815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:53.332614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId: src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:53.335114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:53.335179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.335191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.335228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:53.335253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:53.335312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.335326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.335470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.335531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.335589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.335655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.335704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.335713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.335778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.335832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.335893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.335956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.336102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.336112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.336171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.336228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.336283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.336350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.336389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.336395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.336455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.336514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.336583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.336657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.336701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.336706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.336767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.336843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.336902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.336957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.337003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.337007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.337066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.337121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.337178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.337234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.337279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.337284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.337344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.337399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.337458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.337515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.337556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.337561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.337627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.337700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.337768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.337836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.337883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.337889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.337949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.338004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.338062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.338119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.338164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.338171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.338234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.338291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.338345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.338402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.338443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.338449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.338479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:53.338528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.338545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.338547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:53.338578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:53.338594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:53.338600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:53.338601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:53.338603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:53.338947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:53.338970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:53.338976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:53.338978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:53.338980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:53.338983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:53.339595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:53.339617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:53.339621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:53.339623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:53.339625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:53.339628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:53.340068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:53.340089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:53.340094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:53.340100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:53.340103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:53.341220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:53.341236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:53.341247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392713341
2025-10-02T08:11:53.341375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:53.341382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:53.341385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:53.341388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:53.341391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:53.341393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:53.341845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:53.341855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:53.341859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:53.341862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:53.341864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:53.341866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:53.342312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:53.342321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:53.342330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:53.342332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:53.342336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:53.342339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:53.342781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:53.342790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:53.342793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:53.343788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:53.343793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:53.343800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:53.343803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:53.343809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392713343
2025-10-02T08:11:53.344088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:53.344095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:53.344099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:53.344101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:53.344103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:53.344106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:53.344543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:53.344552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:53.344556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:53.344558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:53.344560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:53.344563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:53.345081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:53.345103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.345187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392713344
2025-10-02T08:11:53.345925Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:53.345944Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:53.345952Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:53.345958Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:53.347491Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:53.347508Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.347510Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:53.347520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534164554526192:7122]
2025-10-02T08:11:53.347523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534164554526192:7122]
2025-10-02T08:11:53.347564Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:53.347577Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:53.347578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:53.347582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.347584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:53.347714Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:53.392962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534164554526237:3998]
2025-10-02T08:11:53.393081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1297, pipe: [1:7556534164554526237:3998]
2025-10-02T08:11:53.486206Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:53.486510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554526237:3998], now have 1 active actors on pipe
2025-10-02T08:11:53.486623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:53.486632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:53.486653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1298 reason: error at write: Disconnected sessionId: src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0
2025-10-02T08:11:53.486789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1298 sessionId: src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0 is DEAD
2025-10-02T08:11:53.486757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:53.486801Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:53.486918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534164554526237:3998]
2025-10-02T08:11:53.486994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:53.487007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0] Write session will restart in 0.008170s
2025-10-02T08:11:53.487029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0] Write session: Do CDS request
2025-10-02T08:11:53.487036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:53.495532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:53.496375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.496386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:53.496422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:53.496436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1299
2025-10-02T08:11:53.496546Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:53.496556Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:53.496565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:53.496610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:53.496631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.496646Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534164554526467:7110]
2025-10-02T08:11:53.496659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:53.496664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:53.496668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:53.497060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1299 sessionId:  describe result for acl check
2025-10-02T08:11:53.497091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:53.497098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:53.497100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:53.497105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534164554526471:7107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:53.497285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:53.497464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:53.497499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:53.497601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534164554526471:7107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:53.497808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:53.497850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.497855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.497856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.497857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.497858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.497862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.497872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.497876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.497879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.497883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.497888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.497895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.497900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.497905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.497909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.497914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.497919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.497924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.497932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.497937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.497954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:53.499180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534164554526471:7107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:53.505488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534164554526471:7107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:53.505503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534164554526471:7107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:53.505506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534164554526471:7107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:53.505512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:53.505821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:53.507186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:53.507196Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:53.507197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:53.507200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:53.507204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1298 [1:7556534164554526467:7110]
2025-10-02T08:11:53.507211Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:53.507222Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:53.507223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.507226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.507227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.507238Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:53.507245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:53.507249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:53.507289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.507295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.507297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:53.507299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:53.507341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:53.507347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.507354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.507361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:53.507377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1298
2025-10-02T08:11:53.507379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554526514:7107], now have 1 active actors on pipe
2025-10-02T08:11:53.507381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534165014448732:2378], now have 1 active actors on pipe
2025-10-02T08:11:53.507385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534164554526460:7110]
2025-10-02T08:11:53.507387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534164554526460:7110]
2025-10-02T08:11:53.507391Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:53.507401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.507403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.507404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:53.507407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:53.507415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:53.507422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:53.507424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:53.507453Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:53.507459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.507462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.507463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:53.507468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.507475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:53.507479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534164554526460:7110]
2025-10-02T08:11:53.507485Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:53.507492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:53.507499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.507478Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1298
2025-10-02T08:11:53.507553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.507559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.507569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.507613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1299 partition: 0 MaxSeqNo: 17 sessionId: src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0
2025-10-02T08:11:53.507894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e077a1de-b8fc4e48-18c78beb-75cbd10a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:53.510437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0] Write session: try to update token
2025-10-02T08:11:53.510452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:53.517928Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:53.517955Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.517963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534164554526460:7110]
2025-10-02T08:11:53.518003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:53.518003Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:53.518171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:53.518305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.518434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.518570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.518765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:53.518806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:53.524475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId: src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:53.526717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:53.526800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.526813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.526839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:53.526858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:53.526919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.526942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.527142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.527203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.527264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.527320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.527363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.527371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.527432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.527484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.527540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.527600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.527712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.527718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.527777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.527829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.527880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.527935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.527975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.527982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.528079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.528141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.528194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.528248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.528288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.528295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.528352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.528404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.528458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.528511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.528553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.528558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.528616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.528667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.529051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.529459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.529530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.529538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.529607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.529672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.529747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.529805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.529931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.529939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.530006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.530064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.530121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.530183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.530231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.530238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.530298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.530350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.530410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.530468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.530509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.530514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.530579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.530637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.530695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.530754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.530796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.530801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.530831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:53.530882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.530897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.530900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:53.530925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:53.530939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:53.530944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:53.530947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:53.530949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:53.531319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:53.531342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:53.531349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:53.531352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:53.531354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:53.531356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:53.531882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:53.531901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:53.531905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:53.531907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:53.531911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:53.531913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:53.532435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:53.532461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:53.532471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:53.532474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:53.532477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:53.538832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:53.538859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:53.538872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392713538
2025-10-02T08:11:53.538999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:53.539023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:53.539029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:53.539033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:53.539037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:53.539041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:53.539560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:53.539574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:53.539580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:53.539585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:53.539588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:53.539592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:53.540042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:53.540055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:53.540066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:53.540070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:53.540099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:53.540102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:53.540575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:53.540587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:53.540593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:53.541788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:53.541811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:53.541816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:53.541820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:53.541829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392713541
2025-10-02T08:11:53.542109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:53.542129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:53.542133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:53.542138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:53.542141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:53.542143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:53.542643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:53.542668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:53.542672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:53.542675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:53.542678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:53.542680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:53.543156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:53.543177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.543302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392713542
2025-10-02T08:11:53.546700Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:53.546719Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:53.546726Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:53.546730Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:53.548232Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:53.548247Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.548248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:53.548256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534164554526460:7110]
2025-10-02T08:11:53.548259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534164554526460:7110]
2025-10-02T08:11:53.548303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:53.548311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.548312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:53.548318Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:53.548328Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:53.548441Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:53.587026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534164554526542:3998]
2025-10-02T08:11:53.587127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1298, pipe: [1:7556534164554526542:3998]
2025-10-02T08:11:53.687966Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:53.688329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554526542:3998], now have 1 active actors on pipe
2025-10-02T08:11:53.688455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:53.688465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:53.688491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1299 reason: error at write: Disconnected sessionId: src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0
2025-10-02T08:11:53.688536Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:53.688583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:53.688659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1299 sessionId: src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0 is DEAD
2025-10-02T08:11:53.688870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534164554526542:3998]
2025-10-02T08:11:53.688882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:53.688898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0] Write session will restart in 0.008292s
2025-10-02T08:11:53.688925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0] Write session: Do CDS request
2025-10-02T08:11:53.688932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:53.696949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:53.698033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:53.698228Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:53.698238Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:53.698248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:53.698298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:53.698350Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534164554526776:7089]
2025-10-02T08:11:53.698817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.698883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:53.698895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1300
2025-10-02T08:11:53.698908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:53.699055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.699082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:53.699087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:53.699091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:53.699096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:53.699129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:53.699408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:53.699421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1300 sessionId:  describe result for acl check
2025-10-02T08:11:53.699444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:53.699445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:53.699447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:53.699451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534164554526788:7093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:53.699461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.699462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.699463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.699464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.699465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.699469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.699478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.699481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.699484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.699492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.699497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.699508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.699517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.699526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.699533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.699537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.699545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.699550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.699558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.699562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.699582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:53.699920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534164554526788:7093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:53.702181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534164554526788:7093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:53.706902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534164554526788:7093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:53.706924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534164554526788:7093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:53.706928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534164554526788:7093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:53.706941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:53.707413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:53.708951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:53.708966Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:53.708969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:53.708973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:53.708979Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1299 [1:7556534164554526776:7089]
2025-10-02T08:11:53.708991Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:53.709007Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:53.709014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.709017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.709022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.709037Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:53.709042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:53.709048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:53.709103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.709110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.709113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:53.709115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:53.709181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:53.709188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.709200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.709217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:53.709235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534164554526769:7089]
2025-10-02T08:11:53.709241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534164554526769:7089]
2025-10-02T08:11:53.709248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:53.709258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:53.709263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534165014448741:2378], now have 1 active actors on pipe
2025-10-02T08:11:53.709267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554526824:7093], now have 1 active actors on pipe
2025-10-02T08:11:53.709269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:53.709275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:53.709288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:53.709295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:53.709326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534164554526769:7089]
2025-10-02T08:11:53.709332Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:53.709339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:53.709367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1299
2025-10-02T08:11:53.709382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.709390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.709412Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:53.709422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.709425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.709427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:53.709436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.709448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:53.709465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.709545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.709557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.709580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.709615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1300 partition: 0 MaxSeqNo: 17 sessionId: src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0
2025-10-02T08:11:53.710340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56fd7a7f-ea8d43b8-f8d56f88-7bbf3b6b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:53.709302Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1299
2025-10-02T08:11:53.713652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0] Write session: try to update token
2025-10-02T08:11:53.713675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:53.719431Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:53.719452Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.719461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534164554526769:7089]
2025-10-02T08:11:53.719500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:53.719499Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:53.719674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:53.719819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.719960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.720114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.720323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:53.720365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:53.735489Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:53.735512Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.735514Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:53.735523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534164554526769:7089]
2025-10-02T08:11:53.735527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534164554526769:7089]
2025-10-02T08:11:53.735568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:53.735572Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:53.735578Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:53.735580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.735588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:53.735726Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:53.742427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId: src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:53.745560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:53.789248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534164554526840:3998]
2025-10-02T08:11:53.789437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1299, pipe: [1:7556534164554526840:3998]
2025-10-02T08:11:53.881706Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:53.882018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.882033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.882053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554526840:3998], now have 1 active actors on pipe
2025-10-02T08:11:53.882262Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:53.882345Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:53.883358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:53.883423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0
2025-10-02T08:11:53.883600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1300 sessionId: src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0 is DEAD
2025-10-02T08:11:53.883753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534164554526840:3998]
2025-10-02T08:11:53.883804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:53.883833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0] Write session will restart in 0.007325s
2025-10-02T08:11:53.883863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0] Write session: Do CDS request
2025-10-02T08:11:53.883870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:53.891489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:53.891928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:53.892134Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:53.892145Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:53.892156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:53.892206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:53.892242Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534164554527085:7065]
2025-10-02T08:11:53.892324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.892889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:53.892949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:53.892962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1301
2025-10-02T08:11:53.893070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:53.893110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:53.893399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:53.893448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.893455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.893456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.893457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.893458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.893463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.893473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.893477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.893481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.893485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.893490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.893497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:53.893505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.893513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:53.893517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.893521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:53.893526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.893536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.893542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.893552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.893570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:53.893623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:53.893653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:53.893666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:53.893669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:53.893983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1301 sessionId:  describe result for acl check
2025-10-02T08:11:53.894012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:53.894018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:53.894020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:53.894024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534164554527101:7070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:53.894495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534164554527101:7070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:53.896683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534164554527101:7070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:53.900969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534164554527101:7070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:53.900985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534164554527101:7070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:53.900988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534164554527101:7070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:53.900996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:53.901824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:53.903444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:53.903462Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:53.903465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:53.903468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:53.903473Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1300 [1:7556534164554527085:7065]
2025-10-02T08:11:53.903482Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:53.903499Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:53.903501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.903504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.903506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.903520Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:53.903526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:53.903531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:53.903582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.903589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.903593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:53.903595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:53.903649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:53.903655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.903666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:53.903677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:53.903696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534164554527079:7065]
2025-10-02T08:11:53.903701Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534164554527079:7065]
2025-10-02T08:11:53.903711Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:53.903722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:53.903726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554527147:7070], now have 1 active actors on pipe
2025-10-02T08:11:53.903725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1300
2025-10-02T08:11:53.903733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:53.903742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:53.903746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:53.903748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:53.903752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534165014448747:2378], now have 1 active actors on pipe
2025-10-02T08:11:53.903778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534164554527079:7065]
2025-10-02T08:11:53.903786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:53.903863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:53.903897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.903912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.903938Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:53.903950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.903955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.903962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:53.903974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.903937Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1300
2025-10-02T08:11:53.903990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:53.904028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.904069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.904075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.904087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:53.904120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1301 partition: 0 MaxSeqNo: 17 sessionId: src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0
2025-10-02T08:11:53.904516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba22e12-2c88c6f7-c4883a1b-63114878_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:53.907521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0] Write session: try to update token
2025-10-02T08:11:53.907539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:53.914268Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:53.914293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.914302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534164554527079:7065]
2025-10-02T08:11:53.914343Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:53.914345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:53.914521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:53.914671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.914813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.914960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:53.915147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:53.915186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:53.926578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId: src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:53.929154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:53.929219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.929227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.929262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:53.929286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:53.929339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:53.929356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:53.929539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.929603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.929666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.929736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.929779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.929787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.929847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.929898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.929953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.930008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.930049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.930055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.930471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.930530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.930594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.930651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.930692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.930698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.930766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.930823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.930884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.930939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.930981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.930987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.931044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.931097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.931162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.931223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.931265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.931270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.931329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.931379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.931433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.931489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.931534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.931539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.931598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.931652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.931705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.931758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.931793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.931795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.931863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.931913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.931965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.932034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.932077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.932079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.932135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.932186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.932242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.932293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.932354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.932356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.932413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:53.932460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:53.932511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:53.932563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:53.932607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:53.932612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:53.932657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:53.932700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:53.932712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:53.932714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:53.932744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:53.932754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:53.932756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:53.932758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:53.932760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:53.933183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:53.933213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:53.933219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:53.933224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:53.933227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:53.933229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:53.933853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:53.933875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:53.933881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:53.933883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:53.933886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:53.933890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:53.934416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:53.934441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:53.934446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:53.934450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:53.934452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:53.935537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:53.935556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:53.935565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392713935
2025-10-02T08:11:53.935658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:53.935669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:53.935672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:53.935676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:53.935679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:53.935681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:53.936165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:53.936182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:53.936186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:53.936189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:53.936190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:53.936193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:53.936588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:53.936604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:53.936611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:53.936613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:53.936616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:53.936618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:53.937142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:53.937167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:53.937171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:53.938145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:53.938160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:53.938164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:53.938166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:53.938173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392713937
2025-10-02T08:11:53.938434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:53.938452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:53.938456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:53.938458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:53.938462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:53.938464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:53.938905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:53.938923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:53.938926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:53.938929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:53.938933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:53.938935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:53.939359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:53.939383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:53.939461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392713939
2025-10-02T08:11:53.941563Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:53.941584Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:53.941588Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:53.941593Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:53.941601Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:53.941603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:53.941604Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:53.941608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534164554527079:7065]
2025-10-02T08:11:53.941611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534164554527079:7065]
2025-10-02T08:11:53.941657Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:53.941669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:53.941672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:53.941672Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:53.941673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:53.941795Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:53.983795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534164554527172:3998]
2025-10-02T08:11:53.983923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1300, pipe: [1:7556534164554527172:3998]
2025-10-02T08:11:54.080666Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:54.081001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534164554527172:3998], now have 1 active actors on pipe
2025-10-02T08:11:54.081115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:54.081129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:54.081157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1301 reason: error at write: Disconnected sessionId: src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0
2025-10-02T08:11:54.081194Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:54.081300Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:54.081321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1301 sessionId: src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0 is DEAD
2025-10-02T08:11:54.081491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534164554527172:3998]
2025-10-02T08:11:54.081721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:54.081735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0] Write session will restart in 0.006837s
2025-10-02T08:11:54.081764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0] Write session: Do CDS request
2025-10-02T08:11:54.081770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:54.084630Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [d239863490a3a7f8] Result# TEvPutResult {Id# [72075186224037892:1300:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:54.084671Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1300:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:54.084720Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1300:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:54.089436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.089520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:54.089551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1302
2025-10-02T08:11:54.089692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.089733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:54.089750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:54.089754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:54.090394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1302 sessionId:  describe result for acl check
2025-10-02T08:11:54.090440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:54.090451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:54.090452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:54.090457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534168849494704:7026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:54.090531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:54.090985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534168849494704:7026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:54.091418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:54.091569Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:54.091577Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:54.091586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:54.091623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:54.091661Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534168849494715:7023]
2025-10-02T08:11:54.092187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:54.092395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:54.092437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:54.092719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:54.092764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.092770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.092771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.092772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.092776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.092780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.092787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.092789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.092791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.092793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.092797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.092814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.092818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.092822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.092829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.092835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.092839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.092843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.092847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.092851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.092869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:54.093320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534168849494704:7026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:54.107064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:54.109260Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1301
2025-10-02T08:11:54.108787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:54.108831Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:54.108834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:54.108839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:54.108847Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1301 [1:7556534168849494715:7023]
2025-10-02T08:11:54.108862Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:54.108885Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:54.108889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.108893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.108895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.108914Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:54.108920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:54.108929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:54.109010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.109013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.109016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:54.109019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:54.109104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:54.109108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.109122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.109134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:54.109156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534169309416085:2378], now have 1 active actors on pipe
2025-10-02T08:11:54.109163Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534168849494703:7023]
2025-10-02T08:11:54.109166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534168849494703:7023]
2025-10-02T08:11:54.109183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:54.109197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:54.109209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:54.109212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:54.109211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:54.109216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:54.109254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534168849494703:7023]
2025-10-02T08:11:54.109258Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:54.109264Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:54.110300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534168849494704:7026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:54.110328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534168849494704:7026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:54.110332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534168849494704:7026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:54.110347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:54.110536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1301
2025-10-02T08:11:54.110557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849494763:7026], now have 1 active actors on pipe
2025-10-02T08:11:54.110564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.110570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.110596Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:54.110608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.110613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.110615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:54.110626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.110641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:54.110659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.110699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.110701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.110726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.110765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1302 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0
2025-10-02T08:11:54.111832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb3364e4-ca7644d5-f5fda3e0-39deec87_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:54.114859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0] Write session: try to update token
2025-10-02T08:11:54.114876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:54.122032Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:54.122051Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.122059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534168849494703:7023]
2025-10-02T08:11:54.122099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:54.122100Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:54.122270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:54.122416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.122573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.122721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.122930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:54.122972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:54.133571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId: src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:54.135883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:54.135969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.135982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.136019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:54.136045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:54.136126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.136154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.136392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.136459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.136530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.136597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.136656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.136661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.136743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.136839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.136912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.136987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.137039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.137042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.137121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.137187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.137254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.137322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.137366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.137370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.137446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.137511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.137578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.137719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.137770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.137774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.137853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.137938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.138003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.138066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.138118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.138120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.138191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.138247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.138309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.138369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.138417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.138420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.138496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.138571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.138645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.138716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.138769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.138775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.138854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.138923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.138993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.139060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.139112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.139115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.139191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.139254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.139321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.139388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.139444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.139448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.139532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.139604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.139670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.139738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.139810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.139813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.142046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:54.142146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.142167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.142170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:54.142211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:54.142231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:54.142234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:54.142237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:54.142241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:54.142677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:54.142698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:54.142705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:54.142712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:54.142716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:54.142718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:54.143330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:54.143348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:54.143355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:54.143358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:54.143362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:54.143366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:54.144216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:54.144250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:54.144257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:54.144261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:54.144264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:54.145701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:54.145728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:54.145742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392714145
2025-10-02T08:11:54.145870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:54.145888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:54.145901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:54.145910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:54.145916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:54.145925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:54.146569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:54.146596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:54.146603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:54.146607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:54.146610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:54.146614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:54.147176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:54.147205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:54.147220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:54.147229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:54.147233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:54.147237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:54.147825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:54.147856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:54.147862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:54.149236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:54.149260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:54.149267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:54.149271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:54.149281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392714149
2025-10-02T08:11:54.150741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:54.150812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:54.150837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:54.150841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:54.150847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:54.150851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:54.151494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:54.151529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:54.151537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:54.151540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:54.151544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:54.151548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:54.153202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:54.153232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.153338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392714153
2025-10-02T08:11:54.154149Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:54.154162Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.154164Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:54.154175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534168849494703:7023]
2025-10-02T08:11:54.154183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534168849494703:7023]
2025-10-02T08:11:54.154221Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:54.154224Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:54.154236Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:54.154237Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:54.154244Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:54.154251Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:54.154262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:54.154266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.154269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:54.154391Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:54.181472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534168849494783:3998]
2025-10-02T08:11:54.181595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1301, pipe: [1:7556534168849494783:3998]
2025-10-02T08:11:54.300505Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:54.300900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849494783:3998], now have 1 active actors on pipe
2025-10-02T08:11:54.301024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:54.301031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:54.301060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1302 reason: error at write: Disconnected sessionId: src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0
2025-10-02T08:11:54.301117Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:54.301230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1302 sessionId: src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0 is DEAD
2025-10-02T08:11:54.301390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534168849494783:3998]
2025-10-02T08:11:54.301421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:54.301415Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:11:54.301443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0] Write session will restart in 0.007382s
2025-10-02T08:11:54.301472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0] Write session: Do CDS request
2025-10-02T08:11:54.301483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:54.301504Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 13 consumer shared/user session shared/user_1_13_10264811666538442874_v1 is DEAD
2025-10-02T08:11:54.301690Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534065770240598:4007] disconnected; active server actors: 1
2025-10-02T08:11:54.301710Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534065770240598:4007] client user disconnected session shared/user_1_13_10264811666538442874_v1
2025-10-02T08:11:54.301737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:54.301774Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:11:54.301897Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:11:54.301903Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:11:54.301909Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.009806s
2025-10-02T08:11:54.305256Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [668255ce67bb8767] Result# TEvPutResult {Id# [72075186224037892:1301:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:54.305350Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1301:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:54.305464Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1301:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:54.310332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.310411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:54.310427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1303
2025-10-02T08:11:54.310559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.310588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:54.310598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:54.310602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:54.310962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1303 sessionId:  describe result for acl check
2025-10-02T08:11:54.310990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:54.310996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:54.310998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:54.311003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534168849495013:7006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:54.311464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534168849495013:7006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:54.311568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:54.312151Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:11:54.312281Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:11:54.312291Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 14
2025-10-02T08:11:54.312452Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 14 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:11:54.312499Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:11:54.312615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:54.312672Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 auth for : user
2025-10-02T08:11:54.312752Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 Handle describe topics response
2025-10-02T08:11:54.312762Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:54.312766Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:54.312774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:54.312775Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 auth is DEAD
2025-10-02T08:11:54.312787Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:11:54.312857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:54.312893Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534168849495049:7003]
2025-10-02T08:11:54.313037Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:11:54.313149Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_14_17293831545318464354_v1
2025-10-02T08:11:54.313166Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:11:54.313269Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:11:54.313370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:54.313438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534168849495013:7006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:54.313457Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:11:54.313515Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 got read request: guid# 38e81fa1-b7e754d4-134bdd45-c8405615
2025-10-02T08:11:54.313506Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534168849495052:6998] connected; active server actors: 1
2025-10-02T08:11:54.313555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:54.313588Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534168849495052:6998] session shared/user_1_14_17293831545318464354_v1
2025-10-02T08:11:54.313599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:54.313603Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:11:54.313616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:11:54.313624Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_14_17293831545318464354_v1" (Sender=[1:7556534168849495039:6998], Pipe=[1:7556534168849495052:6998], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:11:54.313631Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:11:54.313644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:11:54.313655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_14_17293831545318464354_v1" (Sender=[1:7556534168849495039:6998], Pipe=[1:7556534168849495052:6998], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:11:54.313668Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_14_17293831545318464354_v1" sender [1:7556534168849495039:6998] lock partition 0 for ReadingSession "shared/user_1_14_17293831545318464354_v1" (Sender=[1:7556534168849495039:6998], Pipe=[1:7556534168849495052:6998], Partitions=[], ActiveFamilyCount=1) generation 1 step 14
2025-10-02T08:11:54.313681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:11:54.313686Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000035s
2025-10-02T08:11:54.313850Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 14 Session: "shared/user_1_14_17293831545318464354_v1" ClientId: "user" PipeClient { RawX1: 7556534168849495052 RawX2: 4503603922344790 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:11:54.313893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:54.313930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.313935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.313937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.313938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.313939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.313944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.313953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.313960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.313965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.313974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.313984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.314025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.314035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.314040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.314049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.314054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.314058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.314064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.314072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.314077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.314100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:54.314139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:11:54.318641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534168849495013:7006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:54.318657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534168849495013:7006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:54.318660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534168849495013:7006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:54.318668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:54.321778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:54.323163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:54.323177Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:54.323179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:54.323182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:54.323187Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1302 [1:7556534168849495049:7003]
2025-10-02T08:11:54.323194Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:54.323205Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:54.323207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.323209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.323210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.323225Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:54.323289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:54.323301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:54.323342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.323347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.323349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:54.323351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:54.323393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:54.323398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.323406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.323418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:54.323436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1302
2025-10-02T08:11:54.323438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849495073:6995], now have 1 active actors on pipe
2025-10-02T08:11:54.323442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849495082:7006], now have 1 active actors on pipe
2025-10-02T08:11:54.323447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534168849495023:7003]
2025-10-02T08:11:54.323448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534168849495023:7003]
2025-10-02T08:11:54.323455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:54.323458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1302, pipe: [1:7556534168849495073:6995]
2025-10-02T08:11:54.323463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534169309416093:2378], now have 1 active actors on pipe
2025-10-02T08:11:54.323469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:54.323478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:54.323481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:54.323481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:54.323484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:54.323491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.323494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.323506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.323507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.323513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_14_17293831545318464354_v1 on pipe: [1:7556534168849495073:6995]
2025-10-02T08:11:54.323542Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_14_17293831545318464354_v1:1 with generation 1302
2025-10-02T08:11:54.323553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534168849495023:7003]
2025-10-02T08:11:54.323556Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:54.323559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:54.323569Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:54.323578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.323538Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1302
2025-10-02T08:11:54.323584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.323589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:54.323597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.323604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:54.323612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.323616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.323618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:54.323630Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_14_17293831545318464354_v1
2025-10-02T08:11:54.323635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.323671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.323685Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:54.323785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.323792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.323804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.323841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1303 partition: 0 MaxSeqNo: 17 sessionId: src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0
2025-10-02T08:11:54.324202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce0f50f-f548e8c9-ed1c094-2d8ebb02_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:54.324853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:11:54.324881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:11:54.324888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.324891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.324892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.324899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:11:54.324921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:11:54.324990Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392714323 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:11:54.325005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:11:54.325036Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 sending to client partition status
2025-10-02T08:11:54.327222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0] Write session: try to update token
2025-10-02T08:11:54.327243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:54.333884Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:54.333900Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.333907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534168849495023:7003]
2025-10-02T08:11:54.333952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:54.333958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:54.334111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:54.334234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.334353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.334469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.334634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:54.334673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:54.343808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId: src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:54.346181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:54.346240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.346250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.346275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:54.346296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:54.346340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.346357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.346536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.346598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.346660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.346735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.346785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.346804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.346870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.346929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.346992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.347056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.347104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.347112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.347177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.347238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.347300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.347361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.347415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.347422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.347486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.347550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.347613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.347674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.347720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.347727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.347790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.347850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.347911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.347970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.348025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.348032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.348094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.348153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.348216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.348279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.348331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.348339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.348397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.348457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.348521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.348583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.348627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.348635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.348698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.348753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.348836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.348898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.348941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.348947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.349023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.349081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.349140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.349199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.349247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.349254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.349318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.349374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.349435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.349492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.349534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.349541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.349595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:54.349653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.349674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.349682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:54.349710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:54.349726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:54.349729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:54.349732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:54.349735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:54.350112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:54.350141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:54.350151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:54.350155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:54.350162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:54.350165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:54.350649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:54.350673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:54.350679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:54.350684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:54.350687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:54.350690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:54.351200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:54.351223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:54.351228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:54.351231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:54.351236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:54.352508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:54.352525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:54.352536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392714352
2025-10-02T08:11:54.352717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:54.352731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:54.352736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:54.352739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:54.352742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:54.352746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:54.353238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:54.353261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:54.353266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:54.353269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:54.353273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:54.353281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:54.353776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:54.353796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:54.353802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:54.353810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:54.353813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:54.353816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:54.354301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:54.354349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:54.354360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:54.355481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:54.355498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:54.355504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:54.355507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:54.355514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392714355
2025-10-02T08:11:54.355790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:54.355813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:54.355818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:54.355822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:54.355827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:54.355831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:54.356290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:54.356311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:54.356316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:54.356319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:54.356323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:54.356326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:54.356795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:54.356833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.356928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392714356
2025-10-02T08:11:54.359231Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:54.359269Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:54.359280Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:54.359290Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:54.359307Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:54.359314Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.359316Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:54.359323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534168849495023:7003]
2025-10-02T08:11:54.359327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534168849495023:7003]
2025-10-02T08:11:54.359383Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:54.359394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:54.359398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.359399Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:54.359400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:54.359536Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:54.506763Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:54.507266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:54.507279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:54.507305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1303 reason: error at write: Disconnected sessionId: src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0
2025-10-02T08:11:54.507357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_14_17293831545318464354_v1
2025-10-02T08:11:54.507376Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:54.507465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1303 sessionId: src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0 is DEAD
2025-10-02T08:11:54.507624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534168849495073:6995]
2025-10-02T08:11:54.507647Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_14_17293831545318464354_v1
2025-10-02T08:11:54.507686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:54.507703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0] Write session will restart in 0.008399s
2025-10-02T08:11:54.507731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0] Write session: Do CDS request
2025-10-02T08:11:54.507738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:54.507713Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:54.511465Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [00eab159f52e42af] Result# TEvPutResult {Id# [72075186224037892:1302:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:54.511481Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1302:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:54.511576Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1302:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:54.518325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.518353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:54.518370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1304
2025-10-02T08:11:54.518545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.518575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:54.518581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:54.518584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:54.518849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:54.519047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1304 sessionId:  describe result for acl check
2025-10-02T08:11:54.519077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:54.519081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:54.519082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:54.519086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534168849495345:6991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:54.519577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534168849495345:6991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:54.519790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:54.519971Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:54.519981Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:54.519992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:54.520071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:54.520108Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534168849495352:6994]
2025-10-02T08:11:54.520654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:54.520840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:54.520898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:54.521225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:54.521271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.521277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.521278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.521279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.521280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.521285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.521294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.521298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.521302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.521306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.521311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.521318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.521323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.521328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.521333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.521338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.521342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.521351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.521356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.521361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.521381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:54.522481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534168849495345:6991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:54.527898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534168849495345:6991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:54.527917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534168849495345:6991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:54.527921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534168849495345:6991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:54.527930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:54.529327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:54.531012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:54.531026Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:54.531028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:54.531031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:54.531035Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1303 [1:7556534168849495352:6994]
2025-10-02T08:11:54.531043Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:54.531055Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:54.531058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.531060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.531061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.531072Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:54.531076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:54.531081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:54.531346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.531356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.531359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:54.531361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:54.531461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1303
2025-10-02T08:11:54.531471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:54.531472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.531481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.531487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:54.531505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849495392:6991], now have 1 active actors on pipe
2025-10-02T08:11:54.531514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534169309416101:2378], now have 1 active actors on pipe
2025-10-02T08:11:54.531518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.531521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.531534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534168849495339:6994]
2025-10-02T08:11:54.531535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534168849495339:6994]
2025-10-02T08:11:54.531543Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:54.531552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:54.531559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:54.531562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:54.531565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:54.531565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:54.531577Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:54.531585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.531588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.531590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:54.531596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.531563Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1303
2025-10-02T08:11:54.531602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:54.531633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534168849495339:6994]
2025-10-02T08:11:54.531644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:54.531655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:54.531657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.531698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.531703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.531713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.531743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1304 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0
2025-10-02T08:11:54.532074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c92c88-422fcc0f-75d438da-aa8fa27_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:54.535212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0] Write session: try to update token
2025-10-02T08:11:54.535233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:54.542033Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:54.542054Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.542062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534168849495339:6994]
2025-10-02T08:11:54.542098Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:54.542105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:54.542282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:54.542430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.542572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.542723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.542920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:54.542961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:54.551681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId: src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:54.554532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:54.554630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.554646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.554686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:54.554708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:54.554763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.554787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.554956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.555020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.555083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.555154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.555208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.555217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.555287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.555348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.555410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.555483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.555532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.555539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.555606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.555668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.555730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.555790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.555833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.555841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.555905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.555968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.556045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.556110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.556155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.556163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.556227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.556293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.556353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.556417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.556464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.556471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.556534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.556596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.556659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.556723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.556775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.556783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.556865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.556924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.556988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.557051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.557096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.557104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.557172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.557234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.557297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.557364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.557411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.557418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.557481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.557540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.557603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.557666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.557710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.557716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.557781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.557840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.557901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.557960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.558007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.558015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.558082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:54.558148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.558171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.558178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:54.558208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:54.558225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:54.558232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:54.558236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:54.558239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:54.558637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:54.558665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:54.558676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:54.558681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:54.558684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:54.558691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:54.559186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:54.559211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:54.559221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:54.559229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:54.559232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:54.559239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:54.559773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:54.559797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:54.559802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:54.559810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:54.559813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:54.561041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:54.561062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:54.561075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392714560
2025-10-02T08:11:54.561288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:54.561306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:54.561311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:54.561315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:54.561319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:54.561322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:54.561767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:54.561788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:54.561796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:54.561804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:54.561808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:54.561811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:54.562255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:54.562278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:54.562284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:54.562287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:54.562290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:54.562293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:54.562767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:54.562789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:54.562794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:54.563832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:54.563850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:54.563855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:54.563861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:54.563871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392714563
2025-10-02T08:11:54.564217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:54.564239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:54.564244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:54.564247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:54.564251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:54.564254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:54.564710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:54.564732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:54.564737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:54.564741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:54.564743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:54.564746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:54.565277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:54.565297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.565386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392714564
2025-10-02T08:11:54.567629Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:54.567657Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:54.567662Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:54.567666Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:54.567674Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:54.567675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.567677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:54.567682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534168849495339:6994]
2025-10-02T08:11:54.567685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534168849495339:6994]
2025-10-02T08:11:54.567730Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:54.567740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:54.567742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:54.567743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.567746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:54.567876Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:54.607953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534168849495411:6995]
2025-10-02T08:11:54.608072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1303, pipe: [1:7556534168849495411:6995]
2025-10-02T08:11:54.708556Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:54.709172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849495411:6995], now have 1 active actors on pipe
2025-10-02T08:11:54.709499Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:54.709482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:54.709874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:54.709913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1304 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0
2025-10-02T08:11:54.709965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534168849495411:6995]
2025-10-02T08:11:54.710091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1304 sessionId: src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0 is DEAD
2025-10-02T08:11:54.710257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:54.710269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0] Write session will restart in 0.007447s
2025-10-02T08:11:54.710293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0] Write session: Do CDS request
2025-10-02T08:11:54.710300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:54.719103Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [cb81ac6e83c54e52] Result# TEvPutResult {Id# [72075186224037892:1303:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:54.719118Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1303:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:54.719204Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1303:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:54.721316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.721598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:54.721619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1305
2025-10-02T08:11:54.721784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.721837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:54.721848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:54.721853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:54.722653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1305 sessionId:  describe result for acl check
2025-10-02T08:11:54.722709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:54.722716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:54.722718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:54.722724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534168849495549:6972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:54.723346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534168849495549:6972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:54.726679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534168849495549:6972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:54.727683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:54.730435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:54.730602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534168849495549:6972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:54.730620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534168849495549:6972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:54.730624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534168849495549:6972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:54.730633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:54.730657Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:54.730662Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:54.730678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:54.730729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:54.730774Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534168849495691:6971]
2025-10-02T08:11:54.731494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:54.731730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:54.731772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:54.732111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:54.732158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.732165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.732166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.732168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.732169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.732174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.732185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.732189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.732193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.732197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.732203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.732211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.732218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.732227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.732235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.732240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.732249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.732254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.732259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.732269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.732290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:54.741120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:54.742959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:54.742984Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:54.742989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:54.742993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:54.743001Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1304 [1:7556534168849495691:6971]
2025-10-02T08:11:54.743015Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:54.743038Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:54.743041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.743049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.743052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.743075Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:54.743087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:54.743096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:54.743183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.743195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.743199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:54.743202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:54.743489Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1304
2025-10-02T08:11:54.743294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:54.743307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.743322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.743334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:54.743357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849495695:6972], now have 1 active actors on pipe
2025-10-02T08:11:54.743365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534168849495685:6971]
2025-10-02T08:11:54.743368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534168849495685:6971]
2025-10-02T08:11:54.743384Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:54.743394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1304
2025-10-02T08:11:54.743395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534169309416108:2378], now have 1 active actors on pipe
2025-10-02T08:11:54.743405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:54.743408Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:54.743413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:54.743419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:54.743422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:54.743471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.743475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.743491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534168849495685:6971]
2025-10-02T08:11:54.743498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:54.743518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:54.743529Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:54.743536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.743541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.743543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:54.743555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.743565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:54.743594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.743642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.743647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.743682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.743722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1305 partition: 0 MaxSeqNo: 17 sessionId: src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0
2025-10-02T08:11:54.744104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3f2e62-90ccc1da-6448fd64-cbe85ef7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:54.747163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0] Write session: try to update token
2025-10-02T08:11:54.747186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:54.762575Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:54.762598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.762600Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:54.762608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534168849495685:6971]
2025-10-02T08:11:54.762615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534168849495685:6971]
2025-10-02T08:11:54.762653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:54.762658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.762660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:54.762793Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:54.764860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:54.764882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:54.766709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId: src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:54.769835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:54.810198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534168849495723:6995]
2025-10-02T08:11:54.810324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1304, pipe: [1:7556534168849495723:6995]
2025-10-02T08:11:54.891826Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:54.892111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.892123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.892154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849495723:6995], now have 1 active actors on pipe
2025-10-02T08:11:54.892214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534168849495723:6995]
2025-10-02T08:11:54.892230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:54.892232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:54.892271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1305 reason: error at write: Disconnected sessionId: src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0
2025-10-02T08:11:54.892302Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:54.892413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1305 sessionId: src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0 is DEAD
2025-10-02T08:11:54.892408Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:54.892602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:54.892614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0] Write session will restart in 0.009729s
2025-10-02T08:11:54.892653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0] Write session: Do CDS request
2025-10-02T08:11:54.892660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:54.903476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.903528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:54.903548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1306
2025-10-02T08:11:54.903772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:54.903804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:54.903809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:54.903811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:54.904306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1306 sessionId:  describe result for acl check
2025-10-02T08:11:54.904339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:54.904345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:54.904348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:54.904352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534168849495915:6953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:54.904917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534168849495915:6953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:54.907262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534168849495915:6953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:54.907458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:54.908309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:54.908475Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:54.908488Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:54.908496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:54.908534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:54.908569Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534168849496009:6969]
2025-10-02T08:11:54.909245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:54.909433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:54.909475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:54.909770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:54.909813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.909818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.909819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.909820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.909822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.909826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.909835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.909839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.909842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.909851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.909861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.909871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:54.909880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.909888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:54.909909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.909918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:54.909923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.909929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.909938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.909943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.909967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:54.910496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534168849495915:6953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:54.910507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534168849495915:6953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:54.910511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534168849495915:6953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:54.910518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:54.918865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:54.920468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:54.920491Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:54.920493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:54.920497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:54.920502Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1305 [1:7556534168849496009:6969]
2025-10-02T08:11:54.920512Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:54.920527Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:54.920530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.920533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.920535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.920551Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:54.920557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:54.920563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:54.920629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.920638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.920641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:54.920644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:54.920704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:54.920712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.920725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:54.920738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:54.920760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849496025:6953], now have 1 active actors on pipe
2025-10-02T08:11:54.920772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534168849495993:6969]
2025-10-02T08:11:54.920774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534168849495993:6969]
2025-10-02T08:11:54.920785Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:54.920797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534169309416115:2378], now have 1 active actors on pipe
2025-10-02T08:11:54.920822Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:54.920835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:54.920860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:54.920879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:54.920887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:54.920919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534168849495993:6969]
2025-10-02T08:11:54.920931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:54.920955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:54.920933Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1305
2025-10-02T08:11:54.920980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1305
2025-10-02T08:11:54.921084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.921099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.921126Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1837d4b9-30d2323-24f4f4b-b841c232_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:54.921139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.921147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.921149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:54.921159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.921174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:54.921189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.921215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.921217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.921241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:54.921273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1306 partition: 0 MaxSeqNo: 17 sessionId: src_id|1837d4b9-30d2323-24f4f4b-b841c232_0
2025-10-02T08:11:54.921855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da9c686c-adf090a3-63074a21-47e5d9e2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1837d4b9-30d2323-24f4f4b-b841c232_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:54.925064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1837d4b9-30d2323-24f4f4b-b841c232_0] Write session: try to update token
2025-10-02T08:11:54.925084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1837d4b9-30d2323-24f4f4b-b841c232_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:54.933619Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:54.933645Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.933658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534168849495993:6969]
2025-10-02T08:11:54.933700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:54.933704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:54.933884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:54.934028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.934176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.934319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:54.934500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:54.934544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:54.945052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId: src_id|1837d4b9-30d2323-24f4f4b-b841c232_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:54.947632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:54.947709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.947721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.947753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:54.947777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:54.947835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:54.947853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:54.948031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.948097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.948164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.948228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.948274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.948283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.948353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.948414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.948478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.948541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.948584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.948591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.948658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.948722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.948787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.948869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.948913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.948921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.948989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.949054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.949117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.949182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.949233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.949241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.949306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.949369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.949437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.949503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.949550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.949559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.949628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.949692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.949756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.949824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.949876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.949883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.949950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.950012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.950082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.950146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.950194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.950202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.950268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.950330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.950389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.950451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.950492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.950495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.950562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.950638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.950697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.950755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.950805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.950808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.950875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:54.950934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:54.950997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:54.951056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:54.951095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:54.951098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:54.951143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:54.951206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:54.951224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:54.951227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:54.951258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:54.951283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:54.951289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:54.951292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:54.951295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:54.951697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:54.951729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:54.951735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:54.951738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:54.951741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:54.951746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:54.952770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:54.952796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:54.952814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:54.952817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:54.952821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:54.952824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:54.953292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:54.953317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:54.953322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:54.953326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:54.953329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:54.954572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:54.954590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:54.954601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392714954
2025-10-02T08:11:54.954992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:54.955008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:54.955013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:54.955016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:54.955020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:54.955023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:54.955465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:54.955486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:54.955493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:54.955498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:54.955501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:54.955505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:54.955959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:54.955981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:54.955992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:54.956004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:54.956008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:54.956011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:54.956480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:54.956503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:54.956507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:54.957664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:54.957684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:54.957689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:54.957693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:54.957702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392714957
2025-10-02T08:11:54.958169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:54.958191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:54.958196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:54.958200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:54.958204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:54.958208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:54.958776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:54.958802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:54.958808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:54.958811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:54.958816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:54.958821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:54.959288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:54.959309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:54.959408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392714959
2025-10-02T08:11:54.960207Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:54.960227Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:54.960234Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:54.960244Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:54.961902Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:54.961919Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:54.961921Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:54.961928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534168849495993:6969]
2025-10-02T08:11:54.961932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534168849495993:6969]
2025-10-02T08:11:54.962001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:54.962013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:54.962015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:54.962012Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:54.962022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:54.962146Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:54.992474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534168849496071:6995]
2025-10-02T08:11:54.992643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1305, pipe: [1:7556534168849496071:6995]
2025-10-02T08:11:55.111938Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:55.112326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534168849496071:6995], now have 1 active actors on pipe
2025-10-02T08:11:55.112429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534168849496071:6995]
2025-10-02T08:11:55.112452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:55.112454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:55.112475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1306 reason: error at write: Disconnected sessionId: src_id|1837d4b9-30d2323-24f4f4b-b841c232_0
2025-10-02T08:11:55.112526Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:55.112519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:55.112619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1306 sessionId: src_id|1837d4b9-30d2323-24f4f4b-b841c232_0 is DEAD
2025-10-02T08:11:55.112788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1837d4b9-30d2323-24f4f4b-b841c232_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:55.112828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1837d4b9-30d2323-24f4f4b-b841c232_0] Write session will restart in 0.009633s
2025-10-02T08:11:55.112855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1837d4b9-30d2323-24f4f4b-b841c232_0] Write session: Do CDS request
2025-10-02T08:11:55.112861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1837d4b9-30d2323-24f4f4b-b841c232_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:55.123390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1837d4b9-30d2323-24f4f4b-b841c232_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.123436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:55.123460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1307
2025-10-02T08:11:55.123599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.123644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:55.123656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:55.123660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:55.124104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1307 sessionId:  describe result for acl check
2025-10-02T08:11:55.124142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:55.124143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:55.124144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:55.124150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534173144463609:6875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:55.124421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:55.124720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534173144463609:6875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:55.125603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:55.125854Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:55.125867Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:55.125878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:55.125941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:55.125986Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534173144463628:6896]
2025-10-02T08:11:55.126648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:55.126856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:55.126906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:55.127025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534173144463609:6875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:55.127220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:55.127289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.127296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.127297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.127298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.127299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.127304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.127314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.127317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.127320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.127331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.127337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.127344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.127354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.127362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.127371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.127375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.127379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.127383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.127388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.127392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.127409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:55.133917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534173144463609:6875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:55.133941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534173144463609:6875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:55.133945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534173144463609:6875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:55.133954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:55.136271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:55.138600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:55.138625Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:55.138628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:55.138633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:55.138641Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1306 [1:7556534173144463628:6896]
2025-10-02T08:11:55.138655Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:55.138677Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:55.138681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.138684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.138687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.138707Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:55.138717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:55.138731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:55.138815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.138823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.138827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:55.138829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:55.138908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:55.138917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.138933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.138949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:55.138975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534173144463610:6896]
2025-10-02T08:11:55.138982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534173144463610:6896]
2025-10-02T08:11:55.138990Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:55.138996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1306
2025-10-02T08:11:55.139011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144463661:6875], now have 1 active actors on pipe
2025-10-02T08:11:55.139011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:55.139015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:55.139026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:55.139044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:55.139053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:55.139059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534173604383454:2378], now have 1 active actors on pipe
2025-10-02T08:11:55.139069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.139074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.139135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534173144463610:6896]
2025-10-02T08:11:55.139150Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:55.139174Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:55.139181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:55.139186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.139190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.139192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:55.139204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.139215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:55.139261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.139192Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1306
2025-10-02T08:11:55.139370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.139378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.139396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.139440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1307 partition: 0 MaxSeqNo: 17 sessionId: src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0
2025-10-02T08:11:55.139785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1837d4b9-30d2323-24f4f4b-b841c232_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:55.142885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0] Write session: try to update token
2025-10-02T08:11:55.142906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:55.158838Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:55.158874Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:55.158877Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:55.158893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534173144463610:6896]
2025-10-02T08:11:55.158898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534173144463610:6896]
2025-10-02T08:11:55.158952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:55.158965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.158969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:55.158978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:55.158987Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:55.159137Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:55.159935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId: src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:55.162589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:55.212632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534173144463688:6995]
2025-10-02T08:11:55.212798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1306, pipe: [1:7556534173144463688:6995]
2025-10-02T08:11:55.309493Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:55.309855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.309872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.309926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144463688:6995], now have 1 active actors on pipe
2025-10-02T08:11:55.310083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:55.310103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:55.310164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1307 reason: error at write: Disconnected sessionId: src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0
2025-10-02T08:11:55.310202Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:55.310323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1307 sessionId: src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0 is DEAD
2025-10-02T08:11:55.310308Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:55.310519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:55.310528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0] Write session will restart in 0.008890s
2025-10-02T08:11:55.310493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534173144463688:6995]
2025-10-02T08:11:55.310555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0] Write session: Do CDS request
2025-10-02T08:11:55.310562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:55.320406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.320482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:55.320502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1308
2025-10-02T08:11:55.320674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.320703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:55.320715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:55.320718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:55.321147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1308 sessionId:  describe result for acl check
2025-10-02T08:11:55.321193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:55.321195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:55.321196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:55.321201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534173144463931:6861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:55.321689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534173144463931:6861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:55.321795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:55.322849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:55.323028Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:55.323040Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:55.323047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:55.323088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:55.323121Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534173144463957:6860]
2025-10-02T08:11:55.323506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534173144463931:6861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:55.323665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:55.323869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:55.323912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:55.324205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:55.324244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.324245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.324246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.324247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.324248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.324253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.324261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.324264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.324267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.324270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.324275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.324281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.324286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.324291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.324295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.324299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.324303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.324308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.324312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.324316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.324333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:55.330470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534173144463931:6861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:55.330487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534173144463931:6861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:55.330490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534173144463931:6861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:55.330496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:55.332716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:55.334361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:55.334380Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:55.334383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:55.334386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:55.334394Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1307 [1:7556534173144463957:6860]
2025-10-02T08:11:55.334406Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:55.334423Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:55.334427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.334430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.334432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.334448Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:55.334453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:55.334459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:55.334527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.334537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.334540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:55.334543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:55.334606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:55.334615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.334628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.334640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:55.334662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1307
2025-10-02T08:11:55.334665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144463984:6861], now have 1 active actors on pipe
2025-10-02T08:11:55.334671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534173144463932:6860]
2025-10-02T08:11:55.334673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534173144463932:6860]
2025-10-02T08:11:55.334684Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:55.334694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534173604383460:2378], now have 1 active actors on pipe
2025-10-02T08:11:55.334698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:55.334699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.334702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:55.334704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.334722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:55.334737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:55.334746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:55.334749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1307
2025-10-02T08:11:55.334785Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:55.334796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.334800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.334801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:55.334811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.334819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:55.334833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534173144463932:6860]
2025-10-02T08:11:55.334842Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:55.334857Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:55.334877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.334954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.334970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.334993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.335031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1308 partition: 0 MaxSeqNo: 17 sessionId: src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0
2025-10-02T08:11:55.335422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855bf72b-bb19ef5e-5afcce19-5ca8e8c0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:55.338639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0] Write session: try to update token
2025-10-02T08:11:55.338657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:55.353173Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:55.353200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:55.353202Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:55.353209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534173144463932:6860]
2025-10-02T08:11:55.353213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534173144463932:6860]
2025-10-02T08:11:55.353247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:55.353252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.353254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:55.353266Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:55.353273Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:55.353393Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:55.354328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId: src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:55.357080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:55.410783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534173144463997:6995]
2025-10-02T08:11:55.410923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1307, pipe: [1:7556534173144463997:6995]
2025-10-02T08:11:55.495854Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:55.496227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.496241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.496281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144463997:6995], now have 1 active actors on pipe
2025-10-02T08:11:55.496428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534173144463997:6995]
2025-10-02T08:11:55.496463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:55.496472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:55.496531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1308 reason: error at write: Disconnected sessionId: src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0
2025-10-02T08:11:55.496682Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:55.496694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1308 sessionId: src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0 is DEAD
2025-10-02T08:11:55.496609Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:55.497030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:55.497041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0] Write session will restart in 0.009139s
2025-10-02T08:11:55.497066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0] Write session: Do CDS request
2025-10-02T08:11:55.497074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:55.506702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:55.507367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.507405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:55.507419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1309
2025-10-02T08:11:55.507595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.507625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:55.507630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:55.507633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:55.508081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1309 sessionId:  describe result for acl check
2025-10-02T08:11:55.508120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:55.508122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:55.508124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:55.508128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534173144464248:6845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:55.508261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:55.508425Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:55.508437Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:55.508446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:55.508489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:55.508522Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534173144464250:6850]
2025-10-02T08:11:55.508564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534173144464248:6845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:55.509145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:55.509384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:55.509435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:55.509782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:55.509837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.509843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.509844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.509846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.509847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.509853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.509862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.509869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.509873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.509877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.509887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.509898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.509907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.509916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.509920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.509925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.509933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.509938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.509943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.509952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.509974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:55.510963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534173144464248:6845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:55.517520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534173144464248:6845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:55.517540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534173144464248:6845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:55.517543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534173144464248:6845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:55.517552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:55.518536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:55.520143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:55.520160Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:55.520163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:55.520167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:55.520175Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1308 [1:7556534173144464250:6850]
2025-10-02T08:11:55.520185Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:55.520203Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:55.520208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.520211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.520213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.520228Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:55.520232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:55.520238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:55.520299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.520306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.520310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:55.520312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:55.520378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:55.520387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.520401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.520414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:55.520433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144464295:6845], now have 1 active actors on pipe
2025-10-02T08:11:55.520438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1308
2025-10-02T08:11:55.520440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534173144464241:6850]
2025-10-02T08:11:55.520442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534173144464241:6850]
2025-10-02T08:11:55.520451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:55.520461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534173604383467:2378], now have 1 active actors on pipe
2025-10-02T08:11:55.520461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:55.520464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:55.520466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:55.520480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:55.520483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:55.520490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.520493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.520532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534173144464241:6850]
2025-10-02T08:11:55.520544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:55.520554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:55.520558Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:55.520566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.520569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.520571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:55.520579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.520587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:55.520561Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1308
2025-10-02T08:11:55.520621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.520692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.520699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.520712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.520744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1309 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0
2025-10-02T08:11:55.521071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b44bd-999a8fab-7bbed939-dc6d4798_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:55.523935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0] Write session: try to update token
2025-10-02T08:11:55.523950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:55.538399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId: src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:55.539017Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:55.539036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:55.539039Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:55.539049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534173144464241:6850]
2025-10-02T08:11:55.539055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534173144464241:6850]
2025-10-02T08:11:55.539107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:55.539108Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:55.539115Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:55.539121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.539127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:55.539318Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:55.541224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:55.596661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534173144464313:6995]
2025-10-02T08:11:55.596821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1308, pipe: [1:7556534173144464313:6995]
2025-10-02T08:11:55.678997Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:55.679205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.679216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.679246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144464313:6995], now have 1 active actors on pipe
2025-10-02T08:11:55.679366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534173144464313:6995]
2025-10-02T08:11:55.679393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:55.679407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:55.679426Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:55.679538Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:55.679804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:55.679814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0] Write session will restart in 0.007677s
2025-10-02T08:11:55.679835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0] Write session: Do CDS request
2025-10-02T08:11:55.679841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:55.679474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1309 reason: error at write: Disconnected sessionId: src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0
2025-10-02T08:11:55.679656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1309 sessionId: src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0 is DEAD
2025-10-02T08:11:55.688225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.688369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:55.688390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1310
2025-10-02T08:11:55.688550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.688581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:55.688590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:55.688593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:55.688970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1310 sessionId:  describe result for acl check
2025-10-02T08:11:55.689006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:55.689012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:55.689014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:55.689019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534173144464558:6827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:55.689536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534173144464558:6827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:55.689716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:55.690991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:55.691176Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:55.691189Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:55.691198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:55.691245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:55.691282Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534173144464587:6838]
2025-10-02T08:11:55.691826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:55.692017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:55.692061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:55.692092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534173144464558:6827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:55.692334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:55.692393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.692400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.692401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.692402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.692403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.692408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.692417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.692420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.692424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.692428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.692433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.692440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.692444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.692449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.692457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.692461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.692465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.692469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.692474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.692479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.692495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:55.698842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534173144464558:6827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:55.698865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534173144464558:6827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:55.698869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534173144464558:6827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:55.698878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:55.700988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:55.702807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:55.702824Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:55.702827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:55.702829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:55.702835Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1309 [1:7556534173144464587:6838]
2025-10-02T08:11:55.702842Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:55.702856Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:55.702858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.702861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.702862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.702877Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:55.702882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:55.702887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:55.702932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.702939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.702941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:55.702943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:55.702990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:55.702997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.703007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.703014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:55.703031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534173144464564:6838]
2025-10-02T08:11:55.703037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534173144464564:6838]
2025-10-02T08:11:55.703044Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:55.703053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:55.703061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:55.703063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:55.703087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:55.703092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144464614:6827], now have 1 active actors on pipe
2025-10-02T08:11:55.703095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534173144464564:6838]
2025-10-02T08:11:55.703097Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:55.703100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:55.703100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534173604383475:2378], now have 1 active actors on pipe
2025-10-02T08:11:55.703102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1309
2025-10-02T08:11:55.703109Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:55.703127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.703130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.703150Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2980994-c922ad76-f3b05858-3026065f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:55.703161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.703163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.703164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:55.703170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.703176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:55.703189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.703273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.703281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.703291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.703318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1310 partition: 0 MaxSeqNo: 17 sessionId: src_id|a2980994-c922ad76-f3b05858-3026065f_0
2025-10-02T08:11:55.703484Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1309
2025-10-02T08:11:55.703641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3b6cd7-83a4d4d0-197ec2ae-65a5fbc4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a2980994-c922ad76-f3b05858-3026065f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:55.706157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2980994-c922ad76-f3b05858-3026065f_0] Write session: try to update token
2025-10-02T08:11:55.706174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2980994-c922ad76-f3b05858-3026065f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:55.719260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId: src_id|a2980994-c922ad76-f3b05858-3026065f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:55.721557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:55.721754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.721767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.721794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:55.721816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:55.721864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.721879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.722030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.722099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.722156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.722215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.722264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.722272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.722329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.722396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.722461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.722517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.722562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.722571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.722628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.722678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.722732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.722786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.722822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.722824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.722882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.722940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.723003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.723068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.723112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.723121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.723185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.723248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.723303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.723360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.723406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.723413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.723479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.723533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.723594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.723656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.723699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.723705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.723763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.723817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.723876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.723941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.723985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.723994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.724068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.724131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.724193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.724259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.724297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.724310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.724374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.724443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.724510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.724574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.724629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.724639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.724700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:55.724759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:55.724829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:55.724887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:55.724932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:55.724939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:55.725016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:55.725081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.725104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.725107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:55.725137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:55.725154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:55.725162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:55.725171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:55.725176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:55.725526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:55.725554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:55.725560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:55.725564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:55.725566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:55.725570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:55.726003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:55.726025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:55.726031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:55.726035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:55.726038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:55.726043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:55.726499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:55.726521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:55.726526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:55.726529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:55.726532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:55.727672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:55.727690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:55.727703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392715727
2025-10-02T08:11:55.727870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:55.727883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:55.727889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:55.727893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:55.727897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:55.727908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:55.728348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:55.728370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:55.728376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:55.728379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:55.728382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:55.728385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:55.728864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:55.728903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:55.728939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:55.728947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:55.728952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:55.728960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:55.729487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:55.729514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:55.729519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:55.730735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:55.730753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:55.730759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:55.730764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:55.730772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392715730
2025-10-02T08:11:55.731092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:55.731120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:55.731126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:55.731129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:55.731132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:55.731136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:55.731648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:55.731674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:55.731679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:55.731683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:55.731686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:55.731690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:55.732179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:55.732203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.732313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392715732
2025-10-02T08:11:55.734585Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:55.734610Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:55.734615Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:55.734624Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:55.734635Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:55.734637Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:55.734639Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:55.734647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534173144464564:6838]
2025-10-02T08:11:55.734651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534173144464564:6838]
2025-10-02T08:11:55.734703Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:55.734714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:55.734719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.734720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:55.734726Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:55.734859Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:55.779404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534173144464632:6995]
2025-10-02T08:11:55.779523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1309, pipe: [1:7556534173144464632:6995]
2025-10-02T08:11:55.871367Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:55.871812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144464632:6995], now have 1 active actors on pipe
2025-10-02T08:11:55.872194Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:55.872418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2980994-c922ad76-f3b05858-3026065f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:55.872429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2980994-c922ad76-f3b05858-3026065f_0] Write session will restart in 0.006231s
2025-10-02T08:11:55.872450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2980994-c922ad76-f3b05858-3026065f_0] Write session: Do CDS request
2025-10-02T08:11:55.872008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534173144464632:6995]
2025-10-02T08:11:55.872039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:55.872042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:55.872069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1310 reason: error at write: Disconnected sessionId: src_id|a2980994-c922ad76-f3b05858-3026065f_0
2025-10-02T08:11:55.872076Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:55.872253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1310 sessionId: src_id|a2980994-c922ad76-f3b05858-3026065f_0 is DEAD
2025-10-02T08:11:55.872455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2980994-c922ad76-f3b05858-3026065f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:55.876627Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f705bac135be3be7] Result# TEvPutResult {Id# [72075186224037892:1309:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:55.876636Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1309:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:55.876746Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1309:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:55.881274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2980994-c922ad76-f3b05858-3026065f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.881343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:55.881359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1311
2025-10-02T08:11:55.881485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:55.881515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:55.881525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:55.881528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:55.881964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1311 sessionId:  describe result for acl check
2025-10-02T08:11:55.881993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:55.881999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:55.882001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:55.882006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534173144464788:6831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:55.882480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534173144464788:6831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:55.885735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534173144464788:6831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:55.890002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:55.890428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534173144464788:6831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:55.890444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534173144464788:6831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:55.890447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534173144464788:6831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:55.890455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:55.891765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:55.891945Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:55.891955Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:55.891968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:55.892027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:55.892070Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534173144464925:6828]
2025-10-02T08:11:55.892654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:55.892845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:55.892877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:55.893116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:55.893175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.893181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.893182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.893183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.893184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.893187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.893195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.893197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.893200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.893202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.893206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.893210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:55.893215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.893218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:55.893221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.893224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:55.893227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.893230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.893236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.893241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.893262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:55.903393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:55.905164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:55.905192Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:55.905196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:55.905202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:55.905212Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1310 [1:7556534173144464925:6828]
2025-10-02T08:11:55.905228Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:55.905253Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:55.905261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.905266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.905269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.905288Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:55.905301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:55.905310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:55.905575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.905587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.905591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:55.905594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:55.905689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:55.905699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.905717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:55.905734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:55.905748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1310
2025-10-02T08:11:55.905762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144464921:6831], now have 1 active actors on pipe
2025-10-02T08:11:55.905766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534173604383481:2378], now have 1 active actors on pipe
2025-10-02T08:11:55.905774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534173144464913:6828]
2025-10-02T08:11:55.905777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534173144464913:6828]
2025-10-02T08:11:55.905794Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:55.905806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.905814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.905828Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:55.905838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:55.905845Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:55.905854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:55.905859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:55.905917Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28313dd3-6149e2d1-64918f17-b35638cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:55.905933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:55.905938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:55.905941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:55.905907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1310
2025-10-02T08:11:55.905954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:55.905971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:55.905986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534173144464913:6828]
2025-10-02T08:11:55.906004Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:55.906017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:55.906049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.906151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:55.906161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:55.906178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:55.906225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1311 partition: 0 MaxSeqNo: 17 sessionId: src_id|28313dd3-6149e2d1-64918f17-b35638cb_0
2025-10-02T08:11:55.906626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2980994-c922ad76-f3b05858-3026065f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|28313dd3-6149e2d1-64918f17-b35638cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:55.909916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28313dd3-6149e2d1-64918f17-b35638cb_0] Write session: try to update token
2025-10-02T08:11:55.909938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28313dd3-6149e2d1-64918f17-b35638cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:55.926744Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:55.926778Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:55.926782Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:55.926794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534173144464913:6828]
2025-10-02T08:11:55.926800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534173144464913:6828]
2025-10-02T08:11:55.926859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:55.926866Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:55.926873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:55.926873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:55.926875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:55.927063Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:55.929405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId: src_id|28313dd3-6149e2d1-64918f17-b35638cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:55.932548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:55.979766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534173144464964:6995]
2025-10-02T08:11:55.981532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1310, pipe: [1:7556534173144464964:6995]
2025-10-02T08:11:56.067073Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:56.067633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.067651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.067703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534173144464964:6995], now have 1 active actors on pipe
2025-10-02T08:11:56.067877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:56.067904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:56.067970Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:56.067986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1311 reason: error at write: Disconnected sessionId: src_id|28313dd3-6149e2d1-64918f17-b35638cb_0
2025-10-02T08:11:56.068017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:56.068162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1311 sessionId: src_id|28313dd3-6149e2d1-64918f17-b35638cb_0 is DEAD
2025-10-02T08:11:56.068292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28313dd3-6149e2d1-64918f17-b35638cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:56.068304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28313dd3-6149e2d1-64918f17-b35638cb_0] Write session will restart in 0.006664s
2025-10-02T08:11:56.068327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28313dd3-6149e2d1-64918f17-b35638cb_0] Write session: Do CDS request
2025-10-02T08:11:56.068334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28313dd3-6149e2d1-64918f17-b35638cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:56.068328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534173144464964:6995]
2025-10-02T08:11:56.076362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28313dd3-6149e2d1-64918f17-b35638cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.076386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:56.076413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1312
2025-10-02T08:11:56.076578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.076616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:56.076625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:56.076628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:56.077114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1312 sessionId:  describe result for acl check
2025-10-02T08:11:56.077155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:56.077157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:56.077158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:56.077164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534177439432536:6791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:56.077492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:56.077707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534177439432536:6791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:56.078860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:56.079063Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:56.079075Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:56.079096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:56.079145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:56.079196Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534177439432556:6794]
2025-10-02T08:11:56.079794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:56.079997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:56.080044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:56.080256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:56.080299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.080306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.080307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.080307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.080308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.080311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.080317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.080320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.080322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.080324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.080328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.080336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.080341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.080346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.080351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.080356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.080361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.080366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.080370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.080374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.080387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:56.080459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534177439432536:6791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:56.086644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534177439432536:6791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:56.086666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534177439432536:6791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:56.086669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534177439432536:6791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:56.086679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:56.088763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:56.090616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:56.090635Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:56.090638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:56.090643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:56.090650Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1311 [1:7556534177439432556:6794]
2025-10-02T08:11:56.090663Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:56.090686Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:56.090690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.090694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.090697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.090715Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:56.090727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:56.090735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:56.090810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.090818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.090822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:56.090825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:56.090978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1311
2025-10-02T08:11:56.090998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:56.091001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.091016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.091034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:56.091061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439432587:6791], now have 1 active actors on pipe
2025-10-02T08:11:56.091069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534177899350820:2378], now have 1 active actors on pipe
2025-10-02T08:11:56.091075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.091079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.091055Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1311
2025-10-02T08:11:56.091103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534177439432537:6794]
2025-10-02T08:11:56.091110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534177439432537:6794]
2025-10-02T08:11:56.091123Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:56.091139Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:56.091142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:56.091150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:56.091156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:56.091159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:56.091185Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:56.091199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.091208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.091211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:56.091224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.091238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:56.091282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534177439432537:6794]
2025-10-02T08:11:56.091293Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:56.091305Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:56.091308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.091375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.091382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.091396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.091434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1312 partition: 0 MaxSeqNo: 17 sessionId: src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0
2025-10-02T08:11:56.091784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28313dd3-6149e2d1-64918f17-b35638cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:56.094416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0] Write session: try to update token
2025-10-02T08:11:56.094436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:56.107583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId: src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:56.108472Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:56.108513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:56.108516Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:56.108525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534177439432537:6794]
2025-10-02T08:11:56.108529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534177439432537:6794]
2025-10-02T08:11:56.108572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:56.108582Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:56.108589Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:56.108591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.108594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:56.108751Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:56.110660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:56.168536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534177439432614:6995]
2025-10-02T08:11:56.168614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1311, pipe: [1:7556534177439432614:6995]
2025-10-02T08:11:56.249101Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:56.249525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.249543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.249597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439432614:6995], now have 1 active actors on pipe
2025-10-02T08:11:56.249693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:56.249705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:56.249776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1312 reason: error at write: Disconnected sessionId: src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0
2025-10-02T08:11:56.249824Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:56.249846Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:56.249968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1312 sessionId: src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0 is DEAD
2025-10-02T08:11:56.250161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534177439432614:6995]
2025-10-02T08:11:56.250369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:56.250380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0] Write session will restart in 0.005466s
2025-10-02T08:11:56.250403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0] Write session: Do CDS request
2025-10-02T08:11:56.250410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:56.258062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.258160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:56.258181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1313
2025-10-02T08:11:56.258346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.258379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:56.258389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:56.258393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:56.259025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1313 sessionId:  describe result for acl check
2025-10-02T08:11:56.259059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:56.259065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:56.259066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:56.259072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534177439432838:6754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:56.259663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534177439432838:6754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:56.261768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:56.262155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534177439432838:6754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:56.263371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:56.263581Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:56.263594Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:56.263605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:56.263651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:56.263697Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534177439432903:6753]
2025-10-02T08:11:56.264370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:56.264633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:56.264684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:56.265045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:56.265100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.265107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.265108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.265110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.265111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.265116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.265128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.265133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.265137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.265141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.265147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.265156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.265169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.265175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.265181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.265186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.265192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.265196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.265202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.265208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.265234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:56.265810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534177439432838:6754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:56.265824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534177439432838:6754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:56.265828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534177439432838:6754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:56.265837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:56.273446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:56.275399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:56.275423Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:56.275426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:56.275431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:56.275439Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1312 [1:7556534177439432903:6753]
2025-10-02T08:11:56.275454Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:56.275477Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:56.275482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.275486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.275488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.275508Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:56.275515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:56.275523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:56.275600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.275610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.275613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:56.275617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:56.275706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:56.275714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.275729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.275744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:56.275754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1312
2025-10-02T08:11:56.275773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439432920:6754], now have 1 active actors on pipe
2025-10-02T08:11:56.275786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534177439432886:6753]
2025-10-02T08:11:56.275789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534177439432886:6753]
2025-10-02T08:11:56.275799Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:56.275808Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:56.275812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:56.275817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.275823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.275840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534177899350827:2378], now have 1 active actors on pipe
2025-10-02T08:11:56.275854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:56.275874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:56.275881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:56.275869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1312
2025-10-02T08:11:56.275931Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|273ab9da-621d9985-d743b54e-def00f7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:56.275944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.275948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.275952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:56.275963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.275976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:56.275996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534177439432886:6753]
2025-10-02T08:11:56.276020Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:56.276036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:56.276055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.276150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.276160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.276181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.276218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1313 partition: 0 MaxSeqNo: 17 sessionId: src_id|273ab9da-621d9985-d743b54e-def00f7e_0
2025-10-02T08:11:56.276649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaf06807-bdbe1a7a-76dc5e07-6600b287_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|273ab9da-621d9985-d743b54e-def00f7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:56.279884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|273ab9da-621d9985-d743b54e-def00f7e_0] Write session: try to update token
2025-10-02T08:11:56.279903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|273ab9da-621d9985-d743b54e-def00f7e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:56.290089Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:56.290105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:56.290112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534177439432886:6753]
2025-10-02T08:11:56.290144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:56.290161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:56.290293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:56.290423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:56.290545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:56.290663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:56.290841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:56.290878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:56.302922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId: src_id|273ab9da-621d9985-d743b54e-def00f7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:56.305381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:56.305470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.305483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.305511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:56.305530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:56.305602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.305630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.305891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.305977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.306062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.306146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.306806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.306823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.306913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.306990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.307075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.307164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.307224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.307240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.307326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.307400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.307477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.307552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.307610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.307618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.307708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.307788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.307869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.307951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.308027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.308035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.308118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.308195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.308273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.308352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.308409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.308416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.308500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.308583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.308661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.308743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.308958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.308968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.309052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.309126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.309203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.309304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.309368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.309376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.309461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.309541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.309618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.309705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.309768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.309775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.309862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.309937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.310011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.310091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.310151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.310159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.310249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.310328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.310405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.310483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.310542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.310550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.310642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:56.310733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.310762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.310770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:56.310818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:56.310841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:56.310849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:56.310852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:56.310855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:56.311387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:56.311419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:56.311429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:56.311436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:56.311440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:56.311443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:56.312054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:56.312086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:56.312094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:56.312099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:56.312102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:56.312110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:56.312683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:56.312714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:56.312720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:56.312725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:56.312728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:56.314277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:56.314302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:56.314317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392716313
2025-10-02T08:11:56.314760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:56.314772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:56.314780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:56.314783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:56.314793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:56.314797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:56.315379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:56.315398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:56.315405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:56.315409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:56.315413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:56.315417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:56.316074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:56.316094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:56.316104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:56.316107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:56.316112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:56.316116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:56.316715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:56.316737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:56.316743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:56.318341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:56.318366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:56.318373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:56.318378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:56.318389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392716317
2025-10-02T08:11:56.318763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:56.318784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:56.318791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:56.318795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:56.318801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:56.318805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:56.319352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:56.319368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:56.319374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:56.319381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:56.319385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:56.319390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:56.319998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:56.320031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.320158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392716320
2025-10-02T08:11:56.323326Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:56.323369Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:56.323379Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:56.323391Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:56.323406Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:56.323410Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:56.323413Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:56.323424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534177439432886:6753]
2025-10-02T08:11:56.323429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534177439432886:6753]
2025-10-02T08:11:56.323534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:56.323545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.323548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:56.323724Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:56.324867Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:56.324882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:56.350281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534177439432934:6995]
2025-10-02T08:11:56.350410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1312, pipe: [1:7556534177439432934:6995]
2025-10-02T08:11:56.473917Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:56.474504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439432934:6995], now have 1 active actors on pipe
2025-10-02T08:11:56.474767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534177439432934:6995]
2025-10-02T08:11:56.474797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:56.474799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:56.474825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1313 reason: error at write: Disconnected sessionId: src_id|273ab9da-621d9985-d743b54e-def00f7e_0
2025-10-02T08:11:56.474846Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:56.475030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1313 sessionId: src_id|273ab9da-621d9985-d743b54e-def00f7e_0 is DEAD
2025-10-02T08:11:56.475179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273ab9da-621d9985-d743b54e-def00f7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:56.475192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273ab9da-621d9985-d743b54e-def00f7e_0] Write session will restart in 0.009509s
2025-10-02T08:11:56.475214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273ab9da-621d9985-d743b54e-def00f7e_0] Write session: Do CDS request
2025-10-02T08:11:56.475221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273ab9da-621d9985-d743b54e-def00f7e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:56.476137Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:56.480190Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [bca1237fa4dd6078] Result# TEvPutResult {Id# [72075186224037892:1312:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:56.480213Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1312:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:56.480278Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1312:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:56.486370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|273ab9da-621d9985-d743b54e-def00f7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.486492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:56.486511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1314
2025-10-02T08:11:56.486689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.486720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:56.486731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:56.486735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:56.487316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1314 sessionId:  describe result for acl check
2025-10-02T08:11:56.487357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:56.487360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:56.487361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:56.487368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534177439433098:6740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:56.488078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534177439433098:6740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:56.490737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534177439433098:6740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:56.494198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:56.494236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534177439433098:6740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:56.494243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534177439433098:6740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:56.494246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534177439433098:6740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:56.494256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:56.495772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:56.496168Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:56.496178Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:56.496192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:56.496257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:56.496305Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534177439433235:6742]
2025-10-02T08:11:56.497040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:56.497258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:56.497299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:56.497632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:56.497688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.497694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.497695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.497696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.497697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.497702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.497714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.497717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.497721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.497724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.497730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.497739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.497745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.497750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.497758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.497764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.497774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.497779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.497789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.497795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.497820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:56.506885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:56.508954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:56.508974Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:56.508978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:56.508983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:56.508993Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1313 [1:7556534177439433235:6742]
2025-10-02T08:11:56.509009Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:56.509033Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:56.509037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.509041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.509048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.509069Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:56.509076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:56.509086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:56.509164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.509166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.509170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:56.509173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:56.509264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:56.509268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.509285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.509298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:56.509321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439433229:6740], now have 1 active actors on pipe
2025-10-02T08:11:56.509329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534177439433223:6742]
2025-10-02T08:11:56.509331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534177439433223:6742]
2025-10-02T08:11:56.509347Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:56.509359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534177899350835:2378], now have 1 active actors on pipe
2025-10-02T08:11:56.509369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:56.509384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:56.509387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:56.509429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534177439433223:6742]
2025-10-02T08:11:56.509435Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:56.509489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1313
2025-10-02T08:11:56.509489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:56.509492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:56.509499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:56.509512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.509523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.509485Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1313
2025-10-02T08:11:56.509569Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c1bd491-859e3925-f27c3845-992468bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:56.509585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.509595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.509597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:56.509608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.509623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:56.509649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.509683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.509690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.509703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.509738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1314 partition: 0 MaxSeqNo: 17 sessionId: src_id|2c1bd491-859e3925-f27c3845-992468bd_0
2025-10-02T08:11:56.510147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273ab9da-621d9985-d743b54e-def00f7e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2c1bd491-859e3925-f27c3845-992468bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:56.513316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1bd491-859e3925-f27c3845-992468bd_0] Write session: try to update token
2025-10-02T08:11:56.513336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1bd491-859e3925-f27c3845-992468bd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:56.520731Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:56.520750Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:56.520761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534177439433223:6742]
2025-10-02T08:11:56.520827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:56.520831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:56.521030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:56.521239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:56.521403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:56.521568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:56.521791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:56.521843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:56.527188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId: src_id|2c1bd491-859e3925-f27c3845-992468bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:56.529833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:56.529911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.529920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.529954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:56.529975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:56.530037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.530044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.530207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.530276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.530346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.530425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.530474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.530484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.530557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.530625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.530692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.530762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.530810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.530817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.530891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.530960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.531023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.531095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.531147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.531155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.531226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.531289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.531354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.531423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.531473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.531480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.531549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.531617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.531687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.531758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.531817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.531820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.531891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.531960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.532057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.532127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.532178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.532193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.532263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.532325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.532393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.532454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.532503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.532506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.532581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.532639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.532699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.532770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.532850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.532856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.532923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.532986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.533067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.533137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.533185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.533188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.533257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:56.533319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:56.533380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:56.533442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:56.533485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:56.533488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:56.533527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:56.533591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.533609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.533612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:56.533646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:56.533660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:56.533664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:56.533667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:56.533669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:56.534093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:56.534112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:56.534120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:56.534123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:56.534126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:56.534129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:56.534634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:56.534666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:56.534676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:56.534678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:56.534681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:56.534684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:56.535315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:56.535341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:56.535347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:56.535350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:56.535354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:56.536855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:56.536873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:56.536888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392716536
2025-10-02T08:11:56.537012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:56.537023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:56.537028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:56.537032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:56.537035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:56.537038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:56.537498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:56.537505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:56.537510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:56.537512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:56.537514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:56.537518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:56.537952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:56.537969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:56.537976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:56.537978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:56.537980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:56.537982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:56.538436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:56.538460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:56.538464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:56.539622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:56.539642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:56.539648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:56.539655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:56.539664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392716539
2025-10-02T08:11:56.539983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:56.540023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:56.540034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:56.540037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:56.540040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:56.540042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:56.540519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:56.540548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:56.540558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:56.540562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:56.540565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:56.540568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:56.541877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:56.541905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.542012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392716541
2025-10-02T08:11:56.542805Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:56.542825Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:56.542831Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:56.542839Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:56.544494Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:56.544511Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:56.544513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:56.544520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534177439433223:6742]
2025-10-02T08:11:56.544524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534177439433223:6742]
2025-10-02T08:11:56.544567Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:56.544583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:56.544583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:56.544587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.544590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:56.544730Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:56.575156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534177439433270:6995]
2025-10-02T08:11:56.575368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1313, pipe: [1:7556534177439433270:6995]
2025-10-02T08:11:56.685929Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:56.686335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439433270:6995], now have 1 active actors on pipe
2025-10-02T08:11:56.686536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534177439433270:6995]
2025-10-02T08:11:56.686567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:56.686570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:56.686573Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:56.686563Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:56.686616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1314 reason: error at write: Disconnected sessionId: src_id|2c1bd491-859e3925-f27c3845-992468bd_0
2025-10-02T08:11:56.686823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1314 sessionId: src_id|2c1bd491-859e3925-f27c3845-992468bd_0 is DEAD
2025-10-02T08:11:56.686986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1bd491-859e3925-f27c3845-992468bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:56.686997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1bd491-859e3925-f27c3845-992468bd_0] Write session will restart in 0.007383s
2025-10-02T08:11:56.687022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1bd491-859e3925-f27c3845-992468bd_0] Write session: Do CDS request
2025-10-02T08:11:56.687028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1bd491-859e3925-f27c3845-992468bd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:56.695327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1bd491-859e3925-f27c3845-992468bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.695426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:56.695443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1315
2025-10-02T08:11:56.695557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.695581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:56.695589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:56.695592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:56.695973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1315 sessionId:  describe result for acl check
2025-10-02T08:11:56.696019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:56.696025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:56.696027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:56.696034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534177439433527:6716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:56.696349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:56.696599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534177439433527:6716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:56.697585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:56.697887Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:56.697899Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:56.697913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:56.697984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:56.698034Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534177439433553:6714]
2025-10-02T08:11:56.698622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:56.698691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534177439433527:6716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:56.698823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:56.698885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:56.699212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:56.699270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.699276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.699277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.699278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.699279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.699285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.699293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.699297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.699301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.699304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.699310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.699317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.699323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.699327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.699332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.699336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.699341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.699345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.699349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.699354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.699377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:56.704151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534177439433527:6716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:56.704167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534177439433527:6716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:56.704171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534177439433527:6716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:56.704180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:56.707276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:56.709062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:56.709087Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:56.709090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:56.709095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:56.709103Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1314 [1:7556534177439433553:6714]
2025-10-02T08:11:56.709122Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:56.709145Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:56.709157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.709161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.709164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.709186Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:56.709200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:56.709209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:56.709291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.709300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.709304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:56.709307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:56.709398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:56.709406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.709423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.709441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:56.709470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439433585:6716], now have 1 active actors on pipe
2025-10-02T08:11:56.709480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1314
2025-10-02T08:11:56.709485Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534177439433531:6714]
2025-10-02T08:11:56.709488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534177439433531:6714]
2025-10-02T08:11:56.709502Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:56.709519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:56.709522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:56.709528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534177899350843:2378], now have 1 active actors on pipe
2025-10-02T08:11:56.709538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:56.709552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:56.709556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:56.709566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.709577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.709562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1314
2025-10-02T08:11:56.709630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534177439433531:6714]
2025-10-02T08:11:56.709644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:56.709657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:56.709671Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:56.709680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.709691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.709694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:56.709706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.709722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:56.709778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.709894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.709911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.709939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.709985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1315 partition: 0 MaxSeqNo: 17 sessionId: src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0
2025-10-02T08:11:56.710345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1bd491-859e3925-f27c3845-992468bd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:56.713814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0] Write session: try to update token
2025-10-02T08:11:56.713834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:56.726591Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:56.726608Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:56.726611Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:56.726618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534177439433531:6714]
2025-10-02T08:11:56.726622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534177439433531:6714]
2025-10-02T08:11:56.726656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:56.726659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:56.726661Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:56.726669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.726671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:56.726815Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:56.730401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId: src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:56.732878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:56.786493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534177439433600:6995]
2025-10-02T08:11:56.786614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1314, pipe: [1:7556534177439433600:6995]
2025-10-02T08:11:56.864957Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:56.865488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.865507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.865563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439433600:6995], now have 1 active actors on pipe
2025-10-02T08:11:56.865710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:56.865722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:56.865903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:56.865791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1315 reason: error at write: Disconnected sessionId: src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0
2025-10-02T08:11:56.866001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1315 sessionId: src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0 is DEAD
2025-10-02T08:11:56.866188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534177439433600:6995]
2025-10-02T08:11:56.866260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:56.866271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0] Write session will restart in 0.006547s
2025-10-02T08:11:56.866295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0] Write session: Do CDS request
2025-10-02T08:11:56.866302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:56.866305Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:56.874399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.874498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:56.874525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1316
2025-10-02T08:11:56.874646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:56.874691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:56.874702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:56.874706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:56.875190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1316 sessionId:  describe result for acl check
2025-10-02T08:11:56.875225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:56.875231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:56.875233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:56.875239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534177439433757:6690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:56.875764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534177439433757:6690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:56.878868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534177439433757:6690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:56.879985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:56.881282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:56.881450Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:56.881461Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:56.881469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:56.881511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:56.881546Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534177439433893:6695]
2025-10-02T08:11:56.882213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:56.882445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534177439433757:6690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:56.882457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534177439433757:6690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:56.882460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534177439433757:6690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:56.882468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:56.882567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:56.882604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:56.882907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:56.882943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.882950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.882951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.882952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.882953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.882957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.882967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.882970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.882974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.882977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.882983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.882989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:56.882994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.882999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:56.883003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.883008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:56.883012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.883017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.883021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.883026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.883043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:56.891009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:56.892936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:56.892952Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:56.892954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:56.892956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:56.892962Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1315 [1:7556534177439433893:6695]
2025-10-02T08:11:56.892970Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:56.892985Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:56.892987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.892989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.892990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.893003Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:56.893006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:56.893011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:56.893060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.893061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.893064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:56.893066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:56.893113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:56.893115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.893125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:56.893138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:56.893151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534177439433887:6695]
2025-10-02T08:11:56.893152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534177439433887:6695]
2025-10-02T08:11:56.893157Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:56.893168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439433902:6690], now have 1 active actors on pipe
2025-10-02T08:11:56.893173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:56.893173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:56.893175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1315
2025-10-02T08:11:56.893177Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:56.893181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:56.893182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:56.893186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534177899350850:2378], now have 1 active actors on pipe
2025-10-02T08:11:56.893212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.893220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.893231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534177439433887:6695]
2025-10-02T08:11:56.893236Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:56.893243Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:56.893253Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:56.893263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:56.893266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:56.893267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:56.893272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:56.893280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:56.893298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.893361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:56.893371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:56.893388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:56.893275Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1315
2025-10-02T08:11:56.893415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1316 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0
2025-10-02T08:11:56.893743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696a2b47-d9fee61a-38ea3643-ad1cc4ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:56.896676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0] Write session: try to update token
2025-10-02T08:11:56.896694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:56.912673Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:56.912692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:56.912696Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:56.912708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534177439433887:6695]
2025-10-02T08:11:56.912717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534177439433887:6695]
2025-10-02T08:11:56.912763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:56.912769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:56.912771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:56.912780Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:56.912789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:56.912958Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:56.913697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId: src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:56.916733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:56.966224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534177439433925:6995]
2025-10-02T08:11:56.966335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1315, pipe: [1:7556534177439433925:6995]
2025-10-02T08:11:57.049583Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:57.049916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.049930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.049975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534177439433925:6995], now have 1 active actors on pipe
2025-10-02T08:11:57.050069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:57.050075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:57.050135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1316 reason: error at write: Disconnected sessionId: src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0
2025-10-02T08:11:57.050181Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:57.050221Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:57.050333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1316 sessionId: src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0 is DEAD
2025-10-02T08:11:57.050462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534177439433925:6995]
2025-10-02T08:11:57.050490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:57.050499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0] Write session will restart in 0.007290s
2025-10-02T08:11:57.050537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0] Write session: Do CDS request
2025-10-02T08:11:57.050545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:57.061288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.061319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:57.061420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:57.061435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1317
2025-10-02T08:11:57.061604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.061658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:57.061670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:57.061673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:57.062037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1317 sessionId:  describe result for acl check
2025-10-02T08:11:57.062078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:57.062079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:57.062080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:57.062085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534181734401523:6619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:57.062554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534181734401523:6619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:57.062871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:57.063049Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:57.063057Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:57.063075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:57.063124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:57.063169Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534181734401533:6620]
2025-10-02T08:11:57.063786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:57.063983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:57.064047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:57.064364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:57.064399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.064400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.064401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.064402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.064403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.064408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.064413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534181734401523:6619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:57.064418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.064422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.064426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.064431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.064437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.064445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.064451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.064457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.064463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.064469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.064473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.064478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.064483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.064488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.064508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:57.070676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534181734401523:6619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:57.070691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534181734401523:6619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:57.070704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534181734401523:6619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:57.070713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:57.072550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:57.074482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:57.074496Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:57.074499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:57.074502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:57.074511Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1316 [1:7556534181734401533:6620]
2025-10-02T08:11:57.074522Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:57.074537Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:57.074543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.074546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.074549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.074566Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:57.074574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:57.074589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:57.074651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.074657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.074660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:57.074663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:57.074726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:57.074735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.074747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.074758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:57.074764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1316
2025-10-02T08:11:57.074776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734401568:6619], now have 1 active actors on pipe
2025-10-02T08:11:57.074782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.074785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.074800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534181734401516:6620]
2025-10-02T08:11:57.074807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534181734401516:6620]
2025-10-02T08:11:57.074818Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:57.074829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534182194318189:2378], now have 1 active actors on pipe
2025-10-02T08:11:57.074838Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:57.074842Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:57.074843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:57.074855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:57.074858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:57.074874Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:57.074881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.074884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.074886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:57.074895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.074907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:57.074884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1316
2025-10-02T08:11:57.074938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534181734401516:6620]
2025-10-02T08:11:57.074950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:57.074955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:57.074965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.075020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.075025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.075039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.075074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1317 partition: 0 MaxSeqNo: 17 sessionId: src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0
2025-10-02T08:11:57.075478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf1ec551-fa7b8451-4aedc289-a4f3f56b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:57.078691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0] Write session: try to update token
2025-10-02T08:11:57.078713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:57.093222Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:57.093242Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:57.093244Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:57.093253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534181734401516:6620]
2025-10-02T08:11:57.093258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534181734401516:6620]
2025-10-02T08:11:57.093297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:57.093304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.093307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:57.093451Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:57.096974Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:57.096989Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:57.099237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId: src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:57.102376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:57.150546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534181734401583:6995]
2025-10-02T08:11:57.150670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1316, pipe: [1:7556534181734401583:6995]
2025-10-02T08:11:57.245925Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:57.246338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.246354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.246379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734401583:6995], now have 1 active actors on pipe
2025-10-02T08:11:57.246556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:57.246570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:57.246674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1317 reason: error at write: Disconnected sessionId: src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0
2025-10-02T08:11:57.246681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:57.246891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1317 sessionId: src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0 is DEAD
2025-10-02T08:11:57.247080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:57.247094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0] Write session will restart in 0.009003s
2025-10-02T08:11:57.247131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0] Write session: Do CDS request
2025-10-02T08:11:57.247138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:57.247118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534181734401583:6995]
2025-10-02T08:11:57.247500Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:57.257366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.257390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:57.257408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1318
2025-10-02T08:11:57.257570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.257605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:57.257611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:57.257614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:57.257724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:57.257990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1318 sessionId:  describe result for acl check
2025-10-02T08:11:57.258021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:57.258028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:57.258029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:57.258035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534181734401864:6596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:57.258543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534181734401864:6596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:57.258879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:57.259040Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:57.259049Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:57.259059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:57.259098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:57.259133Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534181734401873:6603]
2025-10-02T08:11:57.259609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:57.259763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:57.259792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:57.260023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:57.260065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.260069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.260070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.260071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.260072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.260075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.260082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.260084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.260086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.260088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.260092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.260098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.260102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.260105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.260108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.260115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.260117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.260120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.260123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.260126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.260138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:57.261084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534181734401864:6596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:57.267648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534181734401864:6596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:57.267667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534181734401864:6596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:57.267671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534181734401864:6596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:57.267680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:57.268365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:57.270366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:57.270387Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:57.270390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:57.270394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:57.270402Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1317 [1:7556534181734401873:6603]
2025-10-02T08:11:57.270415Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:57.270433Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:57.270437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.270440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.270443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.270459Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:57.270464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:57.270470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:57.270526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.270536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.270541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:57.270543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:57.270600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:57.270602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.270612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.270619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:57.270632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534181734401859:6603]
2025-10-02T08:11:57.270633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534181734401859:6603]
2025-10-02T08:11:57.270638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:57.270647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:57.270653Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:57.270656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:57.270656Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:57.270658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:57.270665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734401912:6596], now have 1 active actors on pipe
2025-10-02T08:11:57.270684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1317
2025-10-02T08:11:57.270695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534182194318196:2378], now have 1 active actors on pipe
2025-10-02T08:11:57.270697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534181734401859:6603]
2025-10-02T08:11:57.270702Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:57.270707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.270709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:57.270710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.270741Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:57.270749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.270752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.270754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:57.270760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.270767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:57.270782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.270790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1317
2025-10-02T08:11:57.270852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.270866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.270901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.270951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1318 partition: 0 MaxSeqNo: 17 sessionId: src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0
2025-10-02T08:11:57.271339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c53ae8-6d9cb97b-368a1e71-86b5e794_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:57.274414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0] Write session: try to update token
2025-10-02T08:11:57.274429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:57.291733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId: src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:57.294385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:57.295856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.295882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.295904Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:57.295907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:57.295909Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:57.295920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534181734401859:6603]
2025-10-02T08:11:57.295925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534181734401859:6603]
2025-10-02T08:11:57.295966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:57.295975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:57.295980Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:57.295982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.295984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:57.296137Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:57.347160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534181734401926:6995]
2025-10-02T08:11:57.347303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1317, pipe: [1:7556534181734401926:6995]
2025-10-02T08:11:57.445790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:57.446057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:57.446079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0] Write session will restart in 0.006675s
2025-10-02T08:11:57.446104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0] Write session: Do CDS request
2025-10-02T08:11:57.446112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:57.445190Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:57.445452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:57.445485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734401926:6995], now have 1 active actors on pipe
2025-10-02T08:11:57.445525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:57.445608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:57.445610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:57.445630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1318 reason: error at write: Disconnected sessionId: src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0
2025-10-02T08:11:57.445761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1318 sessionId: src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0 is DEAD
2025-10-02T08:11:57.446165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534181734401926:6995]
2025-10-02T08:11:57.458235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.458400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:57.458423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1319
2025-10-02T08:11:57.458476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:57.458620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.458668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:57.458677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:57.458681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:57.459074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1319 sessionId:  describe result for acl check
2025-10-02T08:11:57.459107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:57.459109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:57.459110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:57.459115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534181734402198:6587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:57.459627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534181734402198:6587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:57.461645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:57.461893Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:57.461908Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:57.461918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:57.461973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:57.462012Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534181734402219:6593]
2025-10-02T08:11:57.462276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534181734402198:6587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:57.462767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:57.462952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:57.462994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:57.463300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:57.463358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.463368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.463369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.463370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.463371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.463376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.463385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.463389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.463392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.463396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.463403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.463409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.463415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.463420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.463424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.463428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.463432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.463437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.463442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.463446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.463464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:57.467004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534181734402198:6587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:57.467018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534181734402198:6587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:57.467021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534181734402198:6587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:57.467030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:57.472567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:57.474363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:57.474386Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:57.474388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:57.474392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:57.474399Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1318 [1:7556534181734402219:6593]
2025-10-02T08:11:57.474412Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:57.474430Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:57.474439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.474442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.474445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.474460Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:57.474471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:57.474480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:57.474545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.474553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.474557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:57.474559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:57.474628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:57.474636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.474650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.474666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:57.474692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534181734402192:6593]
2025-10-02T08:11:57.474694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534181734402192:6593]
2025-10-02T08:11:57.474706Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:57.474720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:57.474738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:57.474746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:57.474760Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:57.474770Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:57.474779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534181734402192:6593]
2025-10-02T08:11:57.474781Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:57.474830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1318
2025-10-02T08:11:57.474839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734402246:6587], now have 1 active actors on pipe
2025-10-02T08:11:57.474853Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:57.474894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.474907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.474925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534182194318204:2378], now have 1 active actors on pipe
2025-10-02T08:11:57.474947Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:57.474957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.474965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.474967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:57.474958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1318
2025-10-02T08:11:57.474979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.474994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:57.475013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.475049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.475055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.475069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.475108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1319 partition: 0 MaxSeqNo: 17 sessionId: src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0
2025-10-02T08:11:57.475461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559abbda-60ecdea4-cdb6a9a2-48f402d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:57.478388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0] Write session: try to update token
2025-10-02T08:11:57.478404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:57.496875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:57.496895Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:57.496898Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:57.496908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534181734402192:6593]
2025-10-02T08:11:57.496912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534181734402192:6593]
2025-10-02T08:11:57.496961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:57.496968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.496970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:57.497132Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:57.498993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId: src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:57.500962Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:57.500975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:57.501991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:57.546328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534181734402264:6995]
2025-10-02T08:11:57.546487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1318, pipe: [1:7556534181734402264:6995]
2025-10-02T08:11:57.643207Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:57.643510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.643525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.643566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734402264:6995], now have 1 active actors on pipe
2025-10-02T08:11:57.643714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534181734402264:6995]
2025-10-02T08:11:57.643743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:57.643749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:57.643759Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:57.643809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1319 reason: error at write: Disconnected sessionId: src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0
2025-10-02T08:11:57.643813Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:57.643984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1319 sessionId: src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0 is DEAD
2025-10-02T08:11:57.644175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:57.644200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0] Write session will restart in 0.006118s
2025-10-02T08:11:57.644233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0] Write session: Do CDS request
2025-10-02T08:11:57.644240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:57.651426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.651495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:57.651508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1320
2025-10-02T08:11:57.651777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.651809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:57.651814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:57.651817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:57.652308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1320 sessionId:  describe result for acl check
2025-10-02T08:11:57.652339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:57.652346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:57.652348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:57.652352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534181734402502:6562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:57.652962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534181734402502:6562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:57.654651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:57.655332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534181734402502:6562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:57.655834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:57.656022Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:57.656032Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:57.656040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:57.656087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:57.656122Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534181734402569:6566]
2025-10-02T08:11:57.656538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:57.656722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:57.656761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:57.657092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:57.657161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.657167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.657168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.657169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.657170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.657175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.657186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.657190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.657194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.657196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.657202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.657210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.657216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.657220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.657226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.657231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.657235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.657240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.657245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.657250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.657268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:57.657788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534181734402502:6562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:57.657798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534181734402502:6562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:57.657801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534181734402502:6562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:57.657810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:57.665491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:57.667060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:57.667076Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:57.667079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:57.667083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:57.667090Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1319 [1:7556534181734402569:6566]
2025-10-02T08:11:57.667102Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:57.667119Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:57.667123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.667127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.667130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.667147Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:57.667155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:57.667165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:57.667231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.667237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.667242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:57.667245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:57.667315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:57.667324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.667338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.667350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:57.667368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734402586:6562], now have 1 active actors on pipe
2025-10-02T08:11:57.667374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534181734402551:6566]
2025-10-02T08:11:57.667376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534181734402551:6566]
2025-10-02T08:11:57.667383Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:57.667393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1319
2025-10-02T08:11:57.667393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:57.667394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:57.667397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:57.667408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:57.667411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:57.667417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534182194318212:2378], now have 1 active actors on pipe
2025-10-02T08:11:57.667421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.667425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.667466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534181734402551:6566]
2025-10-02T08:11:57.667478Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:57.667486Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1319
2025-10-02T08:11:57.667494Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:57.667499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:57.667506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.667510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.667514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:57.667524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.667533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:57.667574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.667611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.667618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.667631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.667669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1320 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0
2025-10-02T08:11:57.668066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa97432d-27e73900-e7ddc9df-f9e149a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:57.671183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0] Write session: try to update token
2025-10-02T08:11:57.671200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:57.679421Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:57.679447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:57.679456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534181734402551:6566]
2025-10-02T08:11:57.679499Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:57.679504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:57.679692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:57.679849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:57.679995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:57.680159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:57.680374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:57.680426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:57.688515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId: src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:57.691182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:57.691263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.691277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.691310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:57.691333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:57.691409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.691428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.691592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.691657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.691727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.691795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.692018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.692031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.692104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.692163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.692227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.692293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.692338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.692346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.692414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.692483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.692549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.692615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.692661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.692669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.692736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.692834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.692904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.692969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.693014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.693022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.693090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.693155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.693221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.693288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.693336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.693343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.693414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.693478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.693544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.693609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.693656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.693663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.693733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.693795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.693861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.693931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.693980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.693988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.694054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.694115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.694185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.694254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.694309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.694316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.694387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.694453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.694520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.694585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.694630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.694637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.694705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:57.694765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:57.694831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:57.694899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:57.694943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:57.694951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:57.695013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:57.695078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.695103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.695112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:57.695142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:57.695157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:57.695161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:57.695165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:57.695168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:57.695588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:57.695619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:57.695631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:57.695635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:57.695640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:57.695644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:57.696330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:57.696359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:57.696365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:57.696374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:57.696377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:57.696383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:57.696968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:57.696993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:57.696999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:57.697003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:57.697006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:57.698232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:57.698254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:57.698269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392717697
2025-10-02T08:11:57.698443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:57.698461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:57.698467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:57.698475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:57.698479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:57.698484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:57.698950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:57.698976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:57.698982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:57.698986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:57.698989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:57.698993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:57.699473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:57.699499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:57.699514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:57.699523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:57.699530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:57.699534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:57.700023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:57.700048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:57.700059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:57.701212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:57.701233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:57.701239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:57.701243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:57.701252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392717700
2025-10-02T08:11:57.701589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:57.701615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:57.701627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:57.701634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:57.701637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:57.701645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:57.702110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:57.702136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:57.702145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:57.702150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:57.702158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:57.702161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:57.702627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:57.702651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.702756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392717702
2025-10-02T08:11:57.705097Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:57.705127Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:57.705139Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:57.705152Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:57.705170Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:57.705176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:57.705181Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:57.705192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534181734402551:6566]
2025-10-02T08:11:57.705200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534181734402551:6566]
2025-10-02T08:11:57.705236Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:57.705248Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:57.705275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:57.705284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.705286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:57.705419Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:57.743938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534181734402603:6995]
2025-10-02T08:11:57.744055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1319, pipe: [1:7556534181734402603:6995]
2025-10-02T08:11:57.855740Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:57.856153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734402603:6995], now have 1 active actors on pipe
2025-10-02T08:11:57.856316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:57.856324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:57.856351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1320 reason: error at write: Disconnected sessionId: src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0
2025-10-02T08:11:57.856408Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:57.856412Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:57.856520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1320 sessionId: src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0 is DEAD
2025-10-02T08:11:57.856650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534181734402603:6995]
2025-10-02T08:11:57.856791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:57.856824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0] Write session will restart in 0.006051s
2025-10-02T08:11:57.856853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0] Write session: Do CDS request
2025-10-02T08:11:57.856860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:57.860966Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [c7b2a96ae047aaf2] Result# TEvPutResult {Id# [72075186224037892:1319:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:57.861018Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1319:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:57.861141Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [b026ee2187e0e134] Result# TEvPutResult {Id# [72075186224037892:1319:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:57.861182Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1319:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:57.865467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.865619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:57.865632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1321
2025-10-02T08:11:57.865895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:57.865945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:57.865955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:57.865959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:57.866532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1321 sessionId:  describe result for acl check
2025-10-02T08:11:57.866573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:57.866576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:57.866578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:57.866583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534181734402817:6552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:57.867143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534181734402817:6552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:57.871661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534181734402817:6552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:57.872294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:57.873472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:57.873663Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:57.873673Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:57.873683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:57.873736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:57.873773Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534181734402919:6554]
2025-10-02T08:11:57.874316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534181734402817:6552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:57.874330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534181734402817:6552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:57.874334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534181734402817:6552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:57.874343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:57.874389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:57.874577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:57.874617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:57.874909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:57.874957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.874963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.874964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.874966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.874967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.874971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.874980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.874983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.874987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.874991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.874997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.875004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:57.875009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.875015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:57.875018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.875023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:57.875027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.875033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.875040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.875046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.875069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:57.883306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:57.885026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:57.885042Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:57.885044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:57.885048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:57.885054Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1320 [1:7556534181734402919:6554]
2025-10-02T08:11:57.885067Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:57.885085Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:57.885089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.885095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.885097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.885113Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:57.885124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:57.885131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:57.885201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.885209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.885213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:57.885216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:57.885281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:57.885291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.885305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:57.885320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:57.885341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534181734402909:6554]
2025-10-02T08:11:57.885343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534181734402909:6554]
2025-10-02T08:11:57.885350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:57.885355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1320
2025-10-02T08:11:57.885365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734402925:6552], now have 1 active actors on pipe
2025-10-02T08:11:57.885372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:57.885373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:57.885376Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:57.885387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:57.885389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:57.885396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534182194318220:2378], now have 1 active actors on pipe
2025-10-02T08:11:57.885401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.885405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.885448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534181734402909:6554]
2025-10-02T08:11:57.885461Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:57.885467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:57.885477Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:57.885454Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1320
2025-10-02T08:11:57.885483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:57.885492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:57.885494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:57.885505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:57.885513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:57.885562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.885632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:57.885640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:57.885654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:57.885695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1321 partition: 0 MaxSeqNo: 17 sessionId: src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0
2025-10-02T08:11:57.886084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1b43bc3-7f13a24b-a8e91f9a-c93a79be_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:57.889282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0] Write session: try to update token
2025-10-02T08:11:57.889307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:57.903299Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:57.903316Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:57.903318Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:57.903327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534181734402909:6554]
2025-10-02T08:11:57.903332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534181734402909:6554]
2025-10-02T08:11:57.903373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:57.903375Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:57.903380Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:57.903381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:57.903383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:57.903533Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:57.906496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId: src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:57.909392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:57.956952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534181734402949:6995]
2025-10-02T08:11:57.957095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1320, pipe: [1:7556534181734402949:6995]
2025-10-02T08:11:58.039467Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:58.039748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.039759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.039797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534181734402949:6995], now have 1 active actors on pipe
2025-10-02T08:11:58.039978Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:58.040062Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:58.040286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534181734402949:6995]
2025-10-02T08:11:58.040310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:58.040359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1321 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0
2025-10-02T08:11:58.040523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1321 sessionId: src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0 is DEAD
2025-10-02T08:11:58.042152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:58.042171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0] Write session will restart in 0.009998s
2025-10-02T08:11:58.042206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0] Write session: Do CDS request
2025-10-02T08:11:58.042214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:58.050549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:58.051621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:58.051766Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:58.051773Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:58.051780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:58.051814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:58.051841Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534186029370534:6517]
2025-10-02T08:11:58.052305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:58.052505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:58.052558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:58.052929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:58.052969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.052976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.052977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.052978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.052979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.052984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.052993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.052997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.053001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.053004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.053009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.053016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.053021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.053026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.053030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.053035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.053039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.053044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.053048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.053053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.053070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:58.053401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.053470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:58.053482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1322
2025-10-02T08:11:58.053677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.053700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:58.053708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:58.053710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:58.053963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1322 sessionId:  describe result for acl check
2025-10-02T08:11:58.053985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:58.053991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:58.053992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:58.053996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534186029370550:6507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:58.054455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534186029370550:6507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:58.056768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534186029370550:6507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:58.060489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534186029370550:6507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:58.060501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534186029370550:6507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:58.060504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534186029370550:6507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:58.060512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:58.061077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:58.062502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:58.062515Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:58.062517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:58.062520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:58.062525Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1321 [1:7556534186029370534:6517]
2025-10-02T08:11:58.062535Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:58.062548Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:58.062555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.062558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.062560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.062573Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:58.062581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:58.062587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:58.062636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.062645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.062647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:58.062649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:58.062706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:58.062714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.062724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.062730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:58.062745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1321
2025-10-02T08:11:58.062747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029370595:6507], now have 1 active actors on pipe
2025-10-02T08:11:58.062750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534186489285537:2378], now have 1 active actors on pipe
2025-10-02T08:11:58.062754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534186029370528:6517]
2025-10-02T08:11:58.062756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534186029370528:6517]
2025-10-02T08:11:58.062767Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:58.062780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.062787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.062787Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:58.062790Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:58.062806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:58.062823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:58.062829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:58.062793Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1321
2025-10-02T08:11:58.062865Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:58.062873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.062875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.062877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:58.062884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.062895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:58.062906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534186029370528:6517]
2025-10-02T08:11:58.062915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:58.062926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:58.062943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.062994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.063004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.063028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.063065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1322 partition: 0 MaxSeqNo: 17 sessionId: src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0
2025-10-02T08:11:58.063440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46d6046-8a4b4aa4-4a093367-19bbf393_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:58.066649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0] Write session: try to update token
2025-10-02T08:11:58.066670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:58.080487Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:58.080506Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:58.080509Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:58.080516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534186029370528:6517]
2025-10-02T08:11:58.080521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534186029370528:6517]
2025-10-02T08:11:58.080565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:58.080565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:58.080570Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:58.080576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.080578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:58.080728Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:58.083118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId: src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:58.085574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:58.140264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534186029370616:6995]
2025-10-02T08:11:58.140405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1321, pipe: [1:7556534186029370616:6995]
2025-10-02T08:11:58.218739Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:58.219094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.219106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.219140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029370616:6995], now have 1 active actors on pipe
2025-10-02T08:11:58.219295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:58.219308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:58.219321Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:58.219377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1322 reason: error at write: Disconnected sessionId: src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0
2025-10-02T08:11:58.219375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:58.219573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1322 sessionId: src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0 is DEAD
2025-10-02T08:11:58.219578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534186029370616:6995]
2025-10-02T08:11:58.219769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:58.219784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0] Write session will restart in 0.005792s
2025-10-02T08:11:58.219812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0] Write session: Do CDS request
2025-10-02T08:11:58.219818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:58.227409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.227481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:58.227498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1323
2025-10-02T08:11:58.227716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.227762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:58.227770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:58.227775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:58.228163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1323 sessionId:  describe result for acl check
2025-10-02T08:11:58.228200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:58.228205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:58.228207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:58.228212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534186029370905:6479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:58.228245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:58.228681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534186029370905:6479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:58.229444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:58.229624Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:58.229633Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:58.229642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:58.229684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:58.229792Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534186029370925:6483]
2025-10-02T08:11:58.230402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:58.230611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:58.230652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534186029370905:6479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:58.230657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:58.230954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:58.231027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.231035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.231036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.231037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.231038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.231044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.231054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.231063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.231067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.231071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.231076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.231088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.231099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.231109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.231117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.231123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.231132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.231137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.231152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.231157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.231175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:58.237588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534186029370905:6479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:58.237605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534186029370905:6479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:58.237610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534186029370905:6479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:58.237620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:58.239618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:58.241366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:58.241386Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:58.241388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:58.241392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:58.241399Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1322 [1:7556534186029370925:6483]
2025-10-02T08:11:58.241412Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:58.241431Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:58.241434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.241437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.241439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.241456Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:58.241468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:58.241479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:58.241545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.241553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.241558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:58.241560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:58.241628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:58.241636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.241651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.241670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:58.241683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1322
2025-10-02T08:11:58.241694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029370956:6479], now have 1 active actors on pipe
2025-10-02T08:11:58.241697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534186489285565:2378], now have 1 active actors on pipe
2025-10-02T08:11:58.241703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534186029370904:6483]
2025-10-02T08:11:58.241706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534186029370904:6483]
2025-10-02T08:11:58.241718Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:58.241731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.241735Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:58.241738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:58.241739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.241758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:58.241776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:58.241779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:58.241764Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1322
2025-10-02T08:11:58.241825Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:58.241836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.241840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.241843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:58.241851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.241859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:58.241866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534186029370904:6483]
2025-10-02T08:11:58.241872Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:58.241886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:58.241901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.241969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.241978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.241992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.242030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1323 partition: 0 MaxSeqNo: 17 sessionId: src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0
2025-10-02T08:11:58.242383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc41966-b4680e19-ce3eb8bd-9ffd0515_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:58.245426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0] Write session: try to update token
2025-10-02T08:11:58.245448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:58.261106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId: src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:58.261331Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:58.261345Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:58.261348Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:58.261356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534186029370904:6483]
2025-10-02T08:11:58.261361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534186029370904:6483]
2025-10-02T08:11:58.261405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:58.261419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.261422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:58.261416Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:58.261436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:58.261571Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:58.263827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:58.319942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534186029370978:6995]
2025-10-02T08:11:58.320049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1322, pipe: [1:7556534186029370978:6995]
2025-10-02T08:11:58.398370Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:58.398628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.398639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.398672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029370978:6995], now have 1 active actors on pipe
2025-10-02T08:11:58.398836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:58.398846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:58.398888Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:58.398912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1323 reason: error at write: Disconnected sessionId: src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0
2025-10-02T08:11:58.398886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:58.399090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1323 sessionId: src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0 is DEAD
2025-10-02T08:11:58.399150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534186029370978:6995]
2025-10-02T08:11:58.399299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:58.399316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0] Write session will restart in 0.006533s
2025-10-02T08:11:58.399343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0] Write session: Do CDS request
2025-10-02T08:11:58.399351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:58.407447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.407473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:58.407489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1324
2025-10-02T08:11:58.407760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.407811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:58.407820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:58.407824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:58.408196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1324 sessionId:  describe result for acl check
2025-10-02T08:11:58.408225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:58.408234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:58.408235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:58.408240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534186029371244:6457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:58.408689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534186029371244:6457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:58.409146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:58.411327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534186029371244:6457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:58.411642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:58.411827Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:58.411836Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:58.411846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:58.411891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:58.411944Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534186029371285:6464]
2025-10-02T08:11:58.412581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:58.412774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:58.412831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:58.413151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:58.413199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.413204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.413206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.413207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.413208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.413213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.413223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.413227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.413231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.413235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.413240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.413246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.413253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.413258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.413267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.413272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.413276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.413282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.413286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.413298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.413318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:58.414043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534186029371244:6457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:58.414056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534186029371244:6457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:58.414060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534186029371244:6457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:58.414069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:58.422100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:58.423657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:58.423674Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:58.423676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:58.423679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:58.423684Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1323 [1:7556534186029371285:6464]
2025-10-02T08:11:58.423693Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:58.423709Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:58.423711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.423715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.423717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.423731Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:58.423736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:58.423743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:58.423799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.423805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.423808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:58.423809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:58.423882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:58.423890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.423900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.423907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:58.423919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534186029371257:6464]
2025-10-02T08:11:58.423924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534186029371257:6464]
2025-10-02T08:11:58.423935Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:58.423948Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:58.423961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:58.423966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:58.423988Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:58.423994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534186029371257:6464]
2025-10-02T08:11:58.423995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:58.423999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:58.424006Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:58.424079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1323
2025-10-02T08:11:58.424102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029371306:6457], now have 1 active actors on pipe
2025-10-02T08:11:58.424152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.424169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.424194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534186489285571:2378], now have 1 active actors on pipe
2025-10-02T08:11:58.424224Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:58.424240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.424248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.424250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:58.424261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.424224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1323
2025-10-02T08:11:58.424276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:58.424306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.424373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.424380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.424393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.424442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1324 partition: 0 MaxSeqNo: 17 sessionId: src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0
2025-10-02T08:11:58.424775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ea9e54-8898748b-eb0d94c0-5c0d0c0c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:58.427433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0] Write session: try to update token
2025-10-02T08:11:58.427455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:58.443200Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:58.443216Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:58.443218Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:58.443228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534186029371257:6464]
2025-10-02T08:11:58.443231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534186029371257:6464]
2025-10-02T08:11:58.443268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:58.443273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.443274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:58.443286Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:58.443293Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:58.443400Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:58.447854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId: src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:58.450589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:58.499127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534186029371319:6995]
2025-10-02T08:11:58.499217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1323, pipe: [1:7556534186029371319:6995]
2025-10-02T08:11:58.585488Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:58.585809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.585829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.585870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029371319:6995], now have 1 active actors on pipe
2025-10-02T08:11:58.586012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534186029371319:6995]
2025-10-02T08:11:58.586044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:58.586046Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:58.586046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:58.586111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1324 reason: error at write: Disconnected sessionId: src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0
2025-10-02T08:11:58.586171Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:58.586300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1324 sessionId: src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0 is DEAD
2025-10-02T08:11:58.586505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:58.586520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0] Write session will restart in 0.006140s
2025-10-02T08:11:58.586552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0] Write session: Do CDS request
2025-10-02T08:11:58.586558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:58.594486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.594456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:58.594483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1325
2025-10-02T08:11:58.594720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.594777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:58.594788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:58.594791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:58.595235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1325 sessionId:  describe result for acl check
2025-10-02T08:11:58.595284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:58.595290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:58.595292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:58.595297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534186029371565:6444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:58.595776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534186029371565:6444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:58.597652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:58.598647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534186029371565:6444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:58.599456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:58.599673Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:58.599685Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:58.599696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:58.599773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:58.599812Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534186029371637:6445]
2025-10-02T08:11:58.600451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:58.600721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:58.600764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:58.601084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:58.601139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.601145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.601146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.601147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.601148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.601154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.601164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.601168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.601172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.601175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.601181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.601186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.601190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.601193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.601196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.601199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.601202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.601205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.601209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.601212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.601226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:58.601504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534186029371565:6444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:58.601516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534186029371565:6444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:58.601520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534186029371565:6444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:58.601530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:58.609955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:58.611502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:58.611519Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:58.611521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:58.611524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:58.611530Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1324 [1:7556534186029371637:6445]
2025-10-02T08:11:58.611539Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:58.611555Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:58.611557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.611559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.611561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.611573Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:58.611577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:58.611582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:58.611635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.611638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.611640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:58.611642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:58.611712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:58.611720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.611730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.611737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:58.611751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534186029371620:6445]
2025-10-02T08:11:58.611753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534186029371620:6445]
2025-10-02T08:11:58.611757Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:58.611770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029371653:6444], now have 1 active actors on pipe
2025-10-02T08:11:58.611775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:58.611776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:58.611780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:58.611782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1324
2025-10-02T08:11:58.611784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:58.611786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:58.611790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534186489285578:2378], now have 1 active actors on pipe
2025-10-02T08:11:58.611820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.611823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.611834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534186029371620:6445]
2025-10-02T08:11:58.611845Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:58.611913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1324
2025-10-02T08:11:58.611864Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:58.611865Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:58.611870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.611872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.611873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:58.611880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.611887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:58.611976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.612032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.612033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.612044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.612073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1325 partition: 0 MaxSeqNo: 17 sessionId: src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0
2025-10-02T08:11:58.612994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a4e29b-4e0991d5-13b70d91-3d9fd4f4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:58.616274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0] Write session: try to update token
2025-10-02T08:11:58.616296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:58.630758Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:58.630778Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:58.630781Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:58.630791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534186029371620:6445]
2025-10-02T08:11:58.630797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534186029371620:6445]
2025-10-02T08:11:58.630845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:58.630853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.630855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:58.630868Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:58.630881Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:58.631017Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:58.636608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId: src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:58.639238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:58.686002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534186029371670:6995]
2025-10-02T08:11:58.686119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1324, pipe: [1:7556534186029371670:6995]
2025-10-02T08:11:58.782480Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:58.782807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.782820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.782842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029371670:6995], now have 1 active actors on pipe
2025-10-02T08:11:58.782962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:58.782972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:58.783045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1325 reason: error at write: Disconnected sessionId: src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0
2025-10-02T08:11:58.783058Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:58.783092Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:58.783287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1325 sessionId: src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0 is DEAD
2025-10-02T08:11:58.783339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534186029371670:6995]
2025-10-02T08:11:58.783375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:58.783386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0] Write session will restart in 0.005167s
2025-10-02T08:11:58.783415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0] Write session: Do CDS request
2025-10-02T08:11:58.783422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:58.789429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.789409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:58.789425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1326
2025-10-02T08:11:58.789777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.789805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:58.789808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:58.789811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:58.790136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1326 sessionId:  describe result for acl check
2025-10-02T08:11:58.790162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:58.790163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:58.790164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:58.790167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534186029371899:6405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:58.790522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534186029371899:6405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:58.792695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534186029371899:6405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:58.793223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:58.794422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:58.794574Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:58.794580Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:58.794588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:58.794629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:58.794661Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534186029371987:6413]
2025-10-02T08:11:58.795163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:58.795346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:58.795363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534186029371899:6405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:58.795373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534186029371899:6405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:58.795375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534186029371899:6405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:58.795377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:58.795381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:58.795600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:58.795636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.795642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.795643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.795644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.795645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.795650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.795660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.795663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.795667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.795671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.795675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.795681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.795686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.795689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.795691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.795694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.795696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.795699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.795701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.795704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.795714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:58.803683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:58.805244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:58.805259Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:58.805262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:58.805265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:58.805269Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1325 [1:7556534186029371987:6413]
2025-10-02T08:11:58.805279Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:58.805293Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:58.805299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.805301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.805303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.805316Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:58.805323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:58.805328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:58.805375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.805383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.805386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:58.805388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:58.805436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:58.805442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.805450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.805460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:58.805473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534186029371977:6413]
2025-10-02T08:11:58.805483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534186029371977:6413]
2025-10-02T08:11:58.805490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:58.805503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:58.805504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:58.805507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1325
2025-10-02T08:11:58.805508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:58.805517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:58.805519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:58.805529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029371998:6405], now have 1 active actors on pipe
2025-10-02T08:11:58.805533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534186489285587:2378], now have 1 active actors on pipe
2025-10-02T08:11:58.805567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.805576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.805588Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534186029371977:6413]
2025-10-02T08:11:58.805595Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:58.805581Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1325
2025-10-02T08:11:58.805609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:58.805617Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af3723ac-20eba83-3b15576c-ad6867d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:58.805621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:58.805624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:58.805626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:58.805632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:58.805639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:58.805700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.805761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.805766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.805776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:58.805806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1326 partition: 0 MaxSeqNo: 17 sessionId: src_id|af3723ac-20eba83-3b15576c-ad6867d3_0
2025-10-02T08:11:58.806142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6322ba8-c93496b4-5148f2a6-908c916c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|af3723ac-20eba83-3b15576c-ad6867d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:58.809224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3723ac-20eba83-3b15576c-ad6867d3_0] Write session: try to update token
2025-10-02T08:11:58.809239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3723ac-20eba83-3b15576c-ad6867d3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:58.824297Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:58.824317Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:58.824320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:58.824328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534186029371977:6413]
2025-10-02T08:11:58.824337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534186029371977:6413]
2025-10-02T08:11:58.824380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:58.824385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.824385Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:58.824388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:58.824391Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:58.824522Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:58.834891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId: src_id|af3723ac-20eba83-3b15576c-ad6867d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:58.837530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:58.883173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534186029372019:6995]
2025-10-02T08:11:58.883299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1325, pipe: [1:7556534186029372019:6995]
2025-10-02T08:11:58.977249Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:58.977599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:58.977614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:58.977635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029372019:6995], now have 1 active actors on pipe
2025-10-02T08:11:58.977895Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:58.977960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:58.977919Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:58.978029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1326 reason: status is not ok: tablet will be restarted right now sessionId: src_id|af3723ac-20eba83-3b15576c-ad6867d3_0
2025-10-02T08:11:58.978196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1326 sessionId: src_id|af3723ac-20eba83-3b15576c-ad6867d3_0 is DEAD
2025-10-02T08:11:58.978311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534186029372019:6995]
2025-10-02T08:11:58.978374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3723ac-20eba83-3b15576c-ad6867d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:11:58.978387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3723ac-20eba83-3b15576c-ad6867d3_0] Write session will restart in 0.007625s
2025-10-02T08:11:58.978416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3723ac-20eba83-3b15576c-ad6867d3_0] Write session: Do CDS request
2025-10-02T08:11:58.978424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3723ac-20eba83-3b15576c-ad6867d3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:58.987550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3723ac-20eba83-3b15576c-ad6867d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.987560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:58.987577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1327
2025-10-02T08:11:58.987797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:58.987836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:58.987843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:58.987846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:58.988305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1327 sessionId:  describe result for acl check
2025-10-02T08:11:58.988341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:58.988350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:58.988352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:58.988357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534186029372252:6392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:58.988918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534186029372252:6392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:58.991234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534186029372252:6392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:58.991257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:58.992617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:58.992790Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:58.992798Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:58.992821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:58.992875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:58.992909Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534186029372333:6391]
2025-10-02T08:11:58.993571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:58.993775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:58.993827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:58.994204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534186029372252:6392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:58.994216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534186029372252:6392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:58.994217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:58.994219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534186029372252:6392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:58.994227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:58.994256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.994262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.994264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.994265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.994266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.994273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.994283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.994292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.994297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.994301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.994307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.994319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:58.994329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.994335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:58.994339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.994345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:58.994350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.994355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:58.994364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.994370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:58.994389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:59.002149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:59.003727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:59.003745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:59.003748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:59.003752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:59.003761Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1326 [1:7556534186029372333:6391]
2025-10-02T08:11:59.003773Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:59.003791Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:59.003793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.003797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.003798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.003815Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:59.003820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:59.003832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:59.003892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.003898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.003901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:59.003903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:59.003967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:59.003973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.003982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.003989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:59.004002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534186029372317:6391]
2025-10-02T08:11:59.004007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534186029372317:6391]
2025-10-02T08:11:59.004027Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:59.004041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534186029372345:6392], now have 1 active actors on pipe
2025-10-02T08:11:59.004043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1326
2025-10-02T08:11:59.004048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:59.004051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:59.004053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:59.004066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:59.004069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:59.004075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534186489285594:2378], now have 1 active actors on pipe
2025-10-02T08:11:59.004079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.004083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.004127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534186029372317:6391]
2025-10-02T08:11:59.004135Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:59.004142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:59.004149Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5999527e-c7ff23f1-de05ddf-9417c581_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:59.004123Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1326
2025-10-02T08:11:59.004156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.004164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.004166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:59.004176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.004188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:59.004312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.004387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.004394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.004408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.004444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1327 partition: 0 MaxSeqNo: 17 sessionId: src_id|5999527e-c7ff23f1-de05ddf-9417c581_0
2025-10-02T08:11:59.004788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3723ac-20eba83-3b15576c-ad6867d3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5999527e-c7ff23f1-de05ddf-9417c581_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:59.007282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5999527e-c7ff23f1-de05ddf-9417c581_0] Write session: try to update token
2025-10-02T08:11:59.007297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5999527e-c7ff23f1-de05ddf-9417c581_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:59.022140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId: src_id|5999527e-c7ff23f1-de05ddf-9417c581_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:59.022582Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:59.022601Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:59.022604Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:59.022613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534186029372317:6391]
2025-10-02T08:11:59.022618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534186029372317:6391]
2025-10-02T08:11:59.022667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:59.022680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.022688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:59.022745Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:59.022757Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:59.022892Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:59.025039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:59.102056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534190324339674:6995]
2025-10-02T08:11:59.104286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1326, pipe: [1:7556534190324339674:6995]
2025-10-02T08:11:59.164673Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:59.164969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.164980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.165016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324339674:6995], now have 1 active actors on pipe
2025-10-02T08:11:59.165159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:59.165170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:59.165195Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:59.165238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1327 reason: error at write: Disconnected sessionId: src_id|5999527e-c7ff23f1-de05ddf-9417c581_0
2025-10-02T08:11:59.165412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1327 sessionId: src_id|5999527e-c7ff23f1-de05ddf-9417c581_0 is DEAD
2025-10-02T08:11:59.165499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534190324339674:6995]
2025-10-02T08:11:59.165597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5999527e-c7ff23f1-de05ddf-9417c581_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:59.165611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5999527e-c7ff23f1-de05ddf-9417c581_0] Write session will restart in 0.007291s
2025-10-02T08:11:59.165576Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:59.165634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5999527e-c7ff23f1-de05ddf-9417c581_0] Write session: Do CDS request
2025-10-02T08:11:59.165640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5999527e-c7ff23f1-de05ddf-9417c581_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:59.174438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5999527e-c7ff23f1-de05ddf-9417c581_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.174477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:59.174492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1328
2025-10-02T08:11:59.174650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.174678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:59.174686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:59.174690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:59.175088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1328 sessionId:  describe result for acl check
2025-10-02T08:11:59.175115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:59.175121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:59.175123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:59.175128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534190324339984:6325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:59.175594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534190324339984:6325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:59.176573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:59.177324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534190324339984:6325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:59.178030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:59.178211Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:59.178223Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:59.178234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:59.178290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:59.178327Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534190324340027:6332]
2025-10-02T08:11:59.178930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:59.179175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:59.179223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:59.179667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:59.179714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.179721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.179722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.179724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.179725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.179730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.179740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.179744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.179748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.179752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.179757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.179764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.179829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.179840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.179845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.179851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.179855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.179859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.179865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.179870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.179890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:59.179948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534190324339984:6325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:59.179963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534190324339984:6325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:59.179969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534190324339984:6325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:59.179977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:59.187777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:59.189329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:59.189344Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:59.189346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:59.189349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:59.189353Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1327 [1:7556534190324340027:6332]
2025-10-02T08:11:59.189362Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:59.189376Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:59.189378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.189380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.189382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.189395Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:59.189406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:59.189412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:59.189462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.189467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.189469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:59.189472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:59.189535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:59.189542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.189556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.189571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:59.189595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324340044:6325], now have 1 active actors on pipe
2025-10-02T08:11:59.189603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534190324340007:6332]
2025-10-02T08:11:59.189604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534190324340007:6332]
2025-10-02T08:11:59.189610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:59.189618Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:59.189620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:59.189622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:59.189634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:59.189636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:59.189641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534190784252932:2378], now have 1 active actors on pipe
2025-10-02T08:11:59.189673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534190324340007:6332]
2025-10-02T08:11:59.189680Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:59.189686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1327
2025-10-02T08:11:59.189701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.189707Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:59.189709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.189731Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:59.189737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.189743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.189745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:59.189754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.189763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:59.189778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.189811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.189818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.189803Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1327
2025-10-02T08:11:59.189830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.189861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1328 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0
2025-10-02T08:11:59.190191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5999527e-c7ff23f1-de05ddf-9417c581_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:59.192959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0] Write session: try to update token
2025-10-02T08:11:59.192975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:59.200540Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:59.200561Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:59.200570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534190324340007:6332]
2025-10-02T08:11:59.200617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:59.200632Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:59.200855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:59.201037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:59.201220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:59.201395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:59.201785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:59.201828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:59.208124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId: src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:59.210762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:59.210853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.210866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.210898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:59.210920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:59.210958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.210971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.211129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.211206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.211278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.211340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.211603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.211614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.211679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.211734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.211795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.211860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.211903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.211911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.211976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.212045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.212103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.212164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.212207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.212216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.212279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.212337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.212394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.212451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.212493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.212499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.212566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.212629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.212688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.212747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.212788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.212797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.212886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.212943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.213001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.213063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.213106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.213113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.213177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.213234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.213297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.213358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.213400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.213407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.213469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.213526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.213583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.213642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.213684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.213690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.213752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.213812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.213873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.213933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.213979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.213986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.214047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.214105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.214163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.214222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.214266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.214272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.214310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:59.214387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.214410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.214416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:59.214445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:59.214460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:59.214463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:59.214466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:59.214469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:59.214841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:59.214869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:59.214875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:59.214878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:59.214881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:59.214884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:59.215446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:59.215468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:59.215473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:59.215480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:59.215484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:59.215487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:59.215993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:59.216024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:59.216033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:59.216037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:59.216041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:59.218267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:59.218290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:59.218303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392719217
2025-10-02T08:11:59.218460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:59.218473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:59.218478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:59.218482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:59.218486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:59.218490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:59.218926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:59.218945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:59.218951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:59.218954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:59.218957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:59.218961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:59.219432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:59.219452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:59.219460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:59.219463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:59.219467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:59.219471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:59.219919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:59.219939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:59.219944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:59.221084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:59.221100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:59.221108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:59.221111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:59.221122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392719221
2025-10-02T08:11:59.221429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:59.221446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:59.221452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:59.221455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:59.221458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:59.221461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:59.221912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:59.221931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:59.221936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:59.221939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:59.221943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:59.221946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:59.222419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:59.222435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.222533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392719222
2025-10-02T08:11:59.226413Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:59.226434Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:59.226442Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:59.226448Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:59.228070Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:59.228083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:59.228087Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:59.228096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534190324340007:6332]
2025-10-02T08:11:59.228102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534190324340007:6332]
2025-10-02T08:11:59.228153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:59.228160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:59.228165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.228165Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:59.228167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:59.228294Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:59.265632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534190324340066:6995]
2025-10-02T08:11:59.265739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1327, pipe: [1:7556534190324340066:6995]
2025-10-02T08:11:59.380508Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:59.380898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324340066:6995], now have 1 active actors on pipe
2025-10-02T08:11:59.380991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534190324340066:6995]
2025-10-02T08:11:59.381011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:59.381013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:59.381034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1328 reason: error at write: Disconnected sessionId: src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0
2025-10-02T08:11:59.381114Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:59.381120Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:59.381187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1328 sessionId: src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0 is DEAD
2025-10-02T08:11:59.381484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:59.381502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0] Write session will restart in 0.008428s
2025-10-02T08:11:59.381521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0] Write session: Do CDS request
2025-10-02T08:11:59.381526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:59.390255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:59.391269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.391332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:59.391340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1329
2025-10-02T08:11:59.391464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.391486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:59.391495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:59.391497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:59.391567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:59.391714Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:59.391724Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:59.391731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:59.391760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1329 sessionId:  describe result for acl check
2025-10-02T08:11:59.391768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:59.391780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:59.391785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:59.391786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:59.391789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534190324340360:6301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:59.391798Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534190324340358:6303]
2025-10-02T08:11:59.392193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534190324340360:6301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:59.392435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:59.392596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:59.392631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:59.392938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:59.392975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.392984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.392985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.392986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.392987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.392991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.393000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.393004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.393007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.393011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.393015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.393021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.393027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.393031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.393035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.393039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.393043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.393048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.393052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.393057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.393075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:59.394231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534190324340360:6301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:59.399967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534190324340360:6301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:59.399982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534190324340360:6301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:59.399985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534190324340360:6301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:59.399994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:59.400840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:59.402342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:59.402354Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:59.402357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:59.402359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:59.402364Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1328 [1:7556534190324340358:6303]
2025-10-02T08:11:59.402372Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:59.402386Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:59.402388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.402391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.402392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.402406Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:59.402411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:59.402419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:59.402476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.402484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.402487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:59.402489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:59.402551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:59.402560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.402571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.402583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:59.402601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324340403:6301], now have 1 active actors on pipe
2025-10-02T08:11:59.402608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1328
2025-10-02T08:11:59.402613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534190324340350:6303]
2025-10-02T08:11:59.402615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534190324340350:6303]
2025-10-02T08:11:59.402622Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:59.402629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534190784252938:2378], now have 1 active actors on pipe
2025-10-02T08:11:59.402633Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:59.402637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:59.402641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:59.402655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:59.402661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:59.402669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.402674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.402720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534190324340350:6303]
2025-10-02T08:11:59.402736Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:59.402752Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:59.402762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.402737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1328
2025-10-02T08:11:59.402765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.402767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:59.402775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.402777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:59.402783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:59.402813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.402872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.402880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.402901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.402947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1329 partition: 0 MaxSeqNo: 17 sessionId: src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0
2025-10-02T08:11:59.403319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab44e70-4a0fa916-387cc008-9652c01d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:59.405954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0] Write session: try to update token
2025-10-02T08:11:59.405973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:59.414219Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:11:59.414235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:59.414243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534190324340350:6303]
2025-10-02T08:11:59.414285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:11:59.414466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:11:59.414611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:59.414756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:59.414902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:11:59.415247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:11:59.415277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:11:59.415410Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:11:59.426244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId: src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:59.428964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:59.429037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.429051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.429082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:11:59.429107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:11:59.429157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.429172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.429345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.429408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.429475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.429542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.429590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.429598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.429667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.429730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.429795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.429862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.429907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.429914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.429980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.430037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.430097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.430150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.430188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.430196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.430254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.430308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.430363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.430428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.430472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.430477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.430536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.430591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.430646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.430701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.430768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.430773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.430831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.430886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.430950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.431006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.431050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.431057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.431122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.431178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.431235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.431290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.431335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.431344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.431406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.431466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.431528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.431591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.431633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.431639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.431703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.431761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.431813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.431867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.431907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.431912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.431977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:11:59.432043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:11:59.432102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:11:59.432157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:11:59.432201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:11:59.432208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:11:59.432257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:11:59.432306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.432322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.432327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:11:59.432353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:11:59.432369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:11:59.432376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:11:59.432379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:11:59.432381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:11:59.432753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:11:59.432776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:11:59.432785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:11:59.432787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:11:59.432789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:11:59.432791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:11:59.433262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:11:59.433283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:11:59.433289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:11:59.433293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:11:59.433296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:11:59.433301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:11:59.434330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:11:59.434359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:11:59.434365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:11:59.434370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:11:59.434373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:11:59.435521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:11:59.435538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:11:59.435548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392719435
2025-10-02T08:11:59.435690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:11:59.435702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:11:59.435707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:11:59.435711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:11:59.435714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:11:59.435717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:11:59.436176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:11:59.436195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:11:59.436199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:11:59.436203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:11:59.436207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:11:59.436210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:11:59.436618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:11:59.436636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:11:59.436643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:11:59.436645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:11:59.436659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:11:59.436662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:11:59.437116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:11:59.437134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:11:59.437138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:11:59.438186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:11:59.438204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:11:59.438209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:11:59.438213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:11:59.438221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392719438
2025-10-02T08:11:59.438525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:11:59.438545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:11:59.438550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:11:59.438553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:11:59.438557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:11:59.438560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:11:59.439017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:11:59.439045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:11:59.439051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:11:59.439055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:11:59.439059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:11:59.439063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:11:59.439499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:11:59.439516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.439586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392719439
2025-10-02T08:11:59.441834Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:11:59.441859Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:11:59.441865Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:11:59.441874Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:11:59.441885Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:59.441892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:59.441894Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:59.441903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534190324340350:6303]
2025-10-02T08:11:59.441908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534190324340350:6303]
2025-10-02T08:11:59.441961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:59.441981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:59.441984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:59.441988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.441990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:59.442125Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:59.481172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534190324340421:6995]
2025-10-02T08:11:59.481319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1328, pipe: [1:7556534190324340421:6995]
2025-10-02T08:11:59.573496Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:59.573863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324340421:6995], now have 1 active actors on pipe
2025-10-02T08:11:59.574057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534190324340421:6995]
2025-10-02T08:11:59.574081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:59.574083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:59.574109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1329 reason: error at write: Disconnected sessionId: src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0
2025-10-02T08:11:59.574199Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:59.574230Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:59.574452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:59.574467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0] Write session will restart in 0.009052s
2025-10-02T08:11:59.574494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0] Write session: Do CDS request
2025-10-02T08:11:59.574282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1329 sessionId: src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0 is DEAD
2025-10-02T08:11:59.574500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:59.578721Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1328:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:59.578732Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [cfed3faa3186d62e] Result# TEvPutResult {Id# [72075186224037892:1328:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:11:59.578778Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1328:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:11:59.584387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:59.584402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1330
2025-10-02T08:11:59.584413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.584723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.584760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:59.584771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:59.584775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:59.585186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1330 sessionId:  describe result for acl check
2025-10-02T08:11:59.585218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:59.585223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:59.585225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:59.585230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534190324340586:6287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:59.585680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534190324340586:6287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:59.587680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534190324340586:6287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:59.590984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534190324340586:6287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:59.591001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534190324340586:6287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:59.591005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534190324340586:6287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:59.591013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:59.593435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:59.594666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:59.594904Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:59.594912Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:59.594922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:59.594977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:59.595018Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534190324340760:6291]
2025-10-02T08:11:59.595574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:59.595750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:59.595790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:59.596075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:59.596121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.596126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.596127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.596129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.596130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.596134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.596143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.596146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.596150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.596154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.596158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.596169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.596174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.596183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.596190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.596195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.596202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.596207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.596211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.596215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.596235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:59.604090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:59.605990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:59.606012Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:59.606015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:59.606023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:59.606029Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1329 [1:7556534190324340760:6291]
2025-10-02T08:11:59.606042Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:59.606060Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:59.606063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.606069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.606071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.606085Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:59.606090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:59.606097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:59.606159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.606169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.606171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:59.606173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:59.606240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:59.606248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.606263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.606272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:59.606294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324340723:6287], now have 1 active actors on pipe
2025-10-02T08:11:59.606304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534190324340754:6291]
2025-10-02T08:11:59.606306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534190324340754:6291]
2025-10-02T08:11:59.606315Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:59.606317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1329
2025-10-02T08:11:59.606327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534190784252944:2378], now have 1 active actors on pipe
2025-10-02T08:11:59.606326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:59.606329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:59.606334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:59.606345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:59.606348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:59.606355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.606363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.606404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534190324340754:6291]
2025-10-02T08:11:59.606411Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:59.606421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:59.606427Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b958773-dd96e1b-61928f80-89f495e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:59.606434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.606404Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1329
2025-10-02T08:11:59.606437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.606439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:59.606449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.606457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:59.606497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.606574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.606583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.606597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.606626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1330 partition: 0 MaxSeqNo: 17 sessionId: src_id|7b958773-dd96e1b-61928f80-89f495e6_0
2025-10-02T08:11:59.607030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46ae9e8-23f7e72d-c3edba81-593ad425_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7b958773-dd96e1b-61928f80-89f495e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:59.609930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b958773-dd96e1b-61928f80-89f495e6_0] Write session: try to update token
2025-10-02T08:11:59.609950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b958773-dd96e1b-61928f80-89f495e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:59.624411Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:59.624430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:59.624433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:59.624441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534190324340754:6291]
2025-10-02T08:11:59.624446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534190324340754:6291]
2025-10-02T08:11:59.624478Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:59.624483Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:59.624487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:59.624493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.624495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:59.624646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:59.625088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId: src_id|7b958773-dd96e1b-61928f80-89f495e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:59.627638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:59.674192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534190324340786:6995]
2025-10-02T08:11:59.674299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1329, pipe: [1:7556534190324340786:6995]
2025-10-02T08:11:59.757039Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:59.757415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.757437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.757479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324340786:6995], now have 1 active actors on pipe
2025-10-02T08:11:59.757618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534190324340786:6995]
2025-10-02T08:11:59.757642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:59.757649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:59.757702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1330 reason: error at write: Disconnected sessionId: src_id|7b958773-dd96e1b-61928f80-89f495e6_0
2025-10-02T08:11:59.757760Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:59.757764Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:59.757882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1330 sessionId: src_id|7b958773-dd96e1b-61928f80-89f495e6_0 is DEAD
2025-10-02T08:11:59.758044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b958773-dd96e1b-61928f80-89f495e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:59.758055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b958773-dd96e1b-61928f80-89f495e6_0] Write session will restart in 0.008567s
2025-10-02T08:11:59.758081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b958773-dd96e1b-61928f80-89f495e6_0] Write session: Do CDS request
2025-10-02T08:11:59.758089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b958773-dd96e1b-61928f80-89f495e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:59.767485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b958773-dd96e1b-61928f80-89f495e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.767572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:59.767587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1331
2025-10-02T08:11:59.767755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.767783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:59.767792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:59.767795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:59.768144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1331 sessionId:  describe result for acl check
2025-10-02T08:11:59.768173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:59.768174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:59.768175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:59.768179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534190324341068:6272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:59.768635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534190324341068:6272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:59.769223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:59.770639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:59.770846Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:59.770856Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:59.770868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:59.770939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:59.770976Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534190324341104:6273]
2025-10-02T08:11:59.771047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534190324341068:6272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:59.771555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:59.771775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:59.771845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:59.772194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:59.772240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.772247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.772248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.772250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.772251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.772256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.772266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.772270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.772274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.772278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.772284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.772292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.772298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.772303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.772308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.772313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.772317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.772322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.772327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.772333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.772352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:59.777205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534190324341068:6272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:59.777222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534190324341068:6272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:59.777226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534190324341068:6272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:59.777235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:59.780330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:59.781989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:59.782001Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:59.782003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:59.782005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:59.782010Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1330 [1:7556534190324341104:6273]
2025-10-02T08:11:59.782018Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:59.782030Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:59.782032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.782035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.782037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.782051Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:59.782056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:59.782062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:59.782115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.782122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.782125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:59.782127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:59.782186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:59.782193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.782204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.782218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:59.782238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534190324341085:6273]
2025-10-02T08:11:59.782245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534190324341085:6273]
2025-10-02T08:11:59.782253Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:59.782265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324341130:6272], now have 1 active actors on pipe
2025-10-02T08:11:59.782273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:59.782273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:59.782276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:59.782280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1330
2025-10-02T08:11:59.782284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:59.782286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:59.782293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534190784252953:2378], now have 1 active actors on pipe
2025-10-02T08:11:59.782321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.782325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.782338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534190324341085:6273]
2025-10-02T08:11:59.782346Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:59.782333Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1330
2025-10-02T08:11:59.782361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:59.782370Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:59.782376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.782379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.782381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:59.782391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.782404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:59.782432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.782467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.782473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.782485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.782522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1331 partition: 0 MaxSeqNo: 17 sessionId: src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0
2025-10-02T08:11:59.782931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b958773-dd96e1b-61928f80-89f495e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:59.786473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0] Write session: try to update token
2025-10-02T08:11:59.786500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:59.799019Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:59.799037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:59.799040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:59.799048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534190324341085:6273]
2025-10-02T08:11:59.799052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534190324341085:6273]
2025-10-02T08:11:59.799094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:59.799101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.799103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:59.799238Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:59.800871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:59.800887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:59.816573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId: src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:59.819576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:11:59.858041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534190324341144:6995]
2025-10-02T08:11:59.858201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1330, pipe: [1:7556534190324341144:6995]
2025-10-02T08:11:59.938977Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:11:59.939253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.939267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.939284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324341144:6995], now have 1 active actors on pipe
2025-10-02T08:11:59.939367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534190324341144:6995]
2025-10-02T08:11:59.939385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:11:59.939386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:11:59.939428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1331 reason: error at write: Disconnected sessionId: src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0
2025-10-02T08:11:59.939510Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:11:59.939510Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:11:59.939599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1331 sessionId: src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0 is DEAD
2025-10-02T08:11:59.939836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:11:59.939849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0] Write session will restart in 0.005974s
2025-10-02T08:11:59.939875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0] Write session: Do CDS request
2025-10-02T08:11:59.939884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:11:59.947861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.947941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:11:59.947958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1332
2025-10-02T08:11:59.948106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:11:59.948162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:11:59.948174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:11:59.948178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:11:59.948673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1332 sessionId:  describe result for acl check
2025-10-02T08:11:59.948703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:11:59.948705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:11:59.948706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:11:59.948710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534190324341424:6248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:11:59.949222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534190324341424:6248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:11:59.950963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:11:59.951778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534190324341424:6248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:11:59.952105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:11:59.952269Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:11:59.952281Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:11:59.952295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:11:59.952332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:11:59.952371Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534190324341468:6252]
2025-10-02T08:11:59.952875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:11:59.953159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:11:59.953218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:11:59.953554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:11:59.953603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.953610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.953611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.953612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.953613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.953619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.953628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.953632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.953636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.953640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.953645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.953651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:11:59.953656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.953662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:11:59.953666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.953671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:11:59.953675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.953680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.953685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.953690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.953706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:11:59.954601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534190324341424:6248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:11:59.954615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534190324341424:6248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:11:59.954619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534190324341424:6248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:11:59.954627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:11:59.961369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:11:59.962931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:11:59.962947Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:11:59.962949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:11:59.962952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:11:59.962956Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1331 [1:7556534190324341468:6252]
2025-10-02T08:11:59.962964Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:11:59.962976Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:11:59.962978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.962980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.962982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.962996Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:11:59.963001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:11:59.963007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:11:59.963057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.963063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.963065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:11:59.963068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:11:59.963114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:11:59.963124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.963132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:11:59.963139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:11:59.963150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534190324341454:6252]
2025-10-02T08:11:59.963152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534190324341454:6252]
2025-10-02T08:11:59.963156Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:11:59.963165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534190324341488:6248], now have 1 active actors on pipe
2025-10-02T08:11:59.963171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:11:59.963174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1331
2025-10-02T08:11:59.963174Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:11:59.963178Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:11:59.963179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:11:59.963181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:11:59.963186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534190784252959:2378], now have 1 active actors on pipe
2025-10-02T08:11:59.963206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534190324341454:6252]
2025-10-02T08:11:59.963210Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:11:59.963214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.963216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:11:59.963216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.963243Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:11:59.963254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:11:59.963257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:11:59.963258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:11:59.963264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:11:59.963269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:11:59.963285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.963259Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1331
2025-10-02T08:11:59.963320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:11:59.963325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:11:59.963333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:11:59.963358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1332 partition: 0 MaxSeqNo: 17 sessionId: src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0
2025-10-02T08:11:59.963646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c20ae-74ea9084-b2f83297-a7ebb70_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:11:59.966412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0] Write session: try to update token
2025-10-02T08:11:59.966426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:11:59.980132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId: src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:11:59.980541Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:11:59.980554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:11:59.980557Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:11:59.980565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534190324341454:6252]
2025-10-02T08:11:59.980569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534190324341454:6252]
2025-10-02T08:11:59.980610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:11:59.980617Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:11:59.980620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:11:59.980622Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:11:59.980623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:11:59.980763Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:11:59.982761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:00.039782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534194619308797:6995]
2025-10-02T08:12:00.039920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1331, pipe: [1:7556534194619308797:6995]
2025-10-02T08:12:00.121546Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:00.122355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.122374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.122413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619308797:6995], now have 1 active actors on pipe
2025-10-02T08:12:00.122608Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:00.122665Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:00.122885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534194619308797:6995]
2025-10-02T08:12:00.122914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:00.122967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1332 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0
2025-10-02T08:12:00.123111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1332 sessionId: src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0 is DEAD
2025-10-02T08:12:00.123374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:00.123389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0] Write session will restart in 0.005457s
2025-10-02T08:12:00.123432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0] Write session: Do CDS request
2025-10-02T08:12:00.123440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:00.130536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.130825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:00.130844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1333
2025-10-02T08:12:00.131059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.131092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:00.131097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:00.131100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:00.131545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1333 sessionId:  describe result for acl check
2025-10-02T08:12:00.131575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:00.131582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:00.131584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:00.131588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534194619309053:6222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:00.132298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534194619309053:6222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:00.135103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:00.136438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534194619309053:6222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:00.136693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:00.136889Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:00.136893Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:00.136903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:00.136953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:00.136983Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534194619309129:6219]
2025-10-02T08:12:00.137559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:00.137823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:00.137860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:00.138160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:00.138193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.138194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.138196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.138197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.138198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.138204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.138213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.138217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.138221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.138225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.138230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.138238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.138244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.138250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.138255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.138260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.138265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.138270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.138274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.138280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.138300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:00.149273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534194619309053:6222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:00.149291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534194619309053:6222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:00.149295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534194619309053:6222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:00.149304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:00.150992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:00.152633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:00.152656Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:00.152659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:00.152662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:00.152669Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1332 [1:7556534194619309129:6219]
2025-10-02T08:12:00.152680Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:00.152697Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:00.152699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.152702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.152704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.152722Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:00.152733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:00.152739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:00.152823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.152836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.152839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:00.152841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:00.152898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:00.152907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.152920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.152934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:00.152955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619309155:6222], now have 1 active actors on pipe
2025-10-02T08:12:00.152963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534195079220276:2378], now have 1 active actors on pipe
2025-10-02T08:12:00.152969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534194619309122:6219]
2025-10-02T08:12:00.152971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534194619309122:6219]
2025-10-02T08:12:00.152985Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:00.153009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:00.153028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:00.153035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:00.153065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:00.153067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534194619309122:6219]
2025-10-02T08:12:00.153070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:00.153077Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:00.153083Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:00.153107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1332
2025-10-02T08:12:00.153065Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1332
2025-10-02T08:12:00.155423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.155448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.155491Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60a55d82-5fb29042-91c106b8-a929c437_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:00.155507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.155516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.155519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:00.155530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.155549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:00.155572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.156066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.156075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.156095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.156169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1333 partition: 0 MaxSeqNo: 17 sessionId: src_id|60a55d82-5fb29042-91c106b8-a929c437_0
2025-10-02T08:12:00.156857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a84e8673-9ff92d70-cdc1aa6f-8af3b383_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|60a55d82-5fb29042-91c106b8-a929c437_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:00.160481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a55d82-5fb29042-91c106b8-a929c437_0] Write session: try to update token
2025-10-02T08:12:00.160507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a55d82-5fb29042-91c106b8-a929c437_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:00.195950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId: src_id|60a55d82-5fb29042-91c106b8-a929c437_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:00.199135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:00.199383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.199399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.199437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:00.199467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:00.199557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.199566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.199746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.199837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.199909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.199983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.200096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.200102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.200180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.200247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.200329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.200398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.200444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.200447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.200520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.200584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.200651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.200721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.200779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.200782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.200884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.200953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.201020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.201084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.201127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.201129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.201204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.201272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.201342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.201417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.201468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.201471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.201552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.201621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.201691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.201766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.201814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.201817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.201900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.201967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.202043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.202112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.202160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.202163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.202238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.202296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.202357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.202419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.202469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.202473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.202558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.202626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.202692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.202760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.202811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.202814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.202891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.202959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.203034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.203106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.203154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.203158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.205357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:00.205443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.205464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.205467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:00.205506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:00.205522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:00.205526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:00.205530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:00.205534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:00.206006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:00.206029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:00.206038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:00.206042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:00.206045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:00.206048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:00.206769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:00.206787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:00.206797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:00.206801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:00.206805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:00.206809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:00.207425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:00.207442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:00.207449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:00.207455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:00.207458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:00.210012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:00.210037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:00.210050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392720209
2025-10-02T08:12:00.210207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:00.210224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:00.210230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:00.210234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:00.210238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:00.210243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:00.210693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:00.210715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:00.210719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:00.210722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:00.210726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:00.210748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:00.211193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:00.211213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:00.211218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:00.211220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:00.211222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:00.211225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:00.211693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:00.211714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:00.211719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:00.212792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:00.212868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:00.212879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:00.212883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:00.212893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392720212
2025-10-02T08:12:00.213238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:00.213263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:00.213269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:00.213275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:00.213279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:00.213283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:00.213836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:00.213859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:00.213869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:00.213872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:00.213875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:00.213882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:00.214444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:00.214465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.214543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392720214
2025-10-02T08:12:00.218084Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:00.218096Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:00.218098Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:00.218107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534194619309122:6219]
2025-10-02T08:12:00.218111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534194619309122:6219]
2025-10-02T08:12:00.218166Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:00.218169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:00.218175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:00.218179Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:00.218183Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:00.218187Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:00.218194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:00.218201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.218202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:00.218330Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:00.223116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534194619309208:6995]
2025-10-02T08:12:00.223210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1332, pipe: [1:7556534194619309208:6995]
2025-10-02T08:12:00.363405Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:00.370308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619309208:6995], now have 1 active actors on pipe
2025-10-02T08:12:00.370352Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:00.370354Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:00.370362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534194619309122:6219]
2025-10-02T08:12:00.370458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:00.370546Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:00.370868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534194619309208:6995]
2025-10-02T08:12:00.370896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:00.370922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1333 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60a55d82-5fb29042-91c106b8-a929c437_0
2025-10-02T08:12:00.371098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1333 sessionId: src_id|60a55d82-5fb29042-91c106b8-a929c437_0 is DEAD
2025-10-02T08:12:00.371314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a55d82-5fb29042-91c106b8-a929c437_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:00.371335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a55d82-5fb29042-91c106b8-a929c437_0] Write session will restart in 0.006901s
2025-10-02T08:12:00.371375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a55d82-5fb29042-91c106b8-a929c437_0] Write session: Do CDS request
2025-10-02T08:12:00.371384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a55d82-5fb29042-91c106b8-a929c437_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:00.371404Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:00.374569Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7ea096a325b6b0cb] Result# TEvPutResult {Id# [72075186224037892:1332:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:00.374618Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1332:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:00.374665Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1332:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:00.381327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a55d82-5fb29042-91c106b8-a929c437_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.381741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:00.381757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1334
2025-10-02T08:12:00.381943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.381979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:00.381987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:00.381991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:00.382435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1334 sessionId:  describe result for acl check
2025-10-02T08:12:00.382483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:00.382491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:00.382493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:00.382499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534194619309497:6172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:00.383046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534194619309497:6172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:00.383838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:00.385762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534194619309497:6172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:00.385789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:00.385982Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:00.385995Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:00.386006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:00.386060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:00.386095Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534194619309535:6176]
2025-10-02T08:12:00.386657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:00.386950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:00.387012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:00.387361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:00.387425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.387432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.387433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.387434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.387436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.387441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.387451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.387456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.387459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.387463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.387468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.387476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.387482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.387487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.387492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.387497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.387502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.387506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.387516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.387522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.387545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:00.392536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534194619309497:6172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:00.392551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534194619309497:6172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:00.392554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534194619309497:6172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:00.392562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:00.395527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:00.397129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:00.397149Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:00.397152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:00.397156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:00.397165Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1333 [1:7556534194619309535:6176]
2025-10-02T08:12:00.397176Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:00.397193Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:00.397195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.397199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.397201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.397218Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:00.397222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:00.397229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:00.397296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.397306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.397309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:00.397312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:00.397452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1333
2025-10-02T08:12:00.397499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:00.397503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.397519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.397533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:00.397553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619309561:6172], now have 1 active actors on pipe
2025-10-02T08:12:00.397568Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1333
2025-10-02T08:12:00.397556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534195079220306:2378], now have 1 active actors on pipe
2025-10-02T08:12:00.397561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.397566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.397584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534194619309515:6176]
2025-10-02T08:12:00.397587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534194619309515:6176]
2025-10-02T08:12:00.397602Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:00.397614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:00.397630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:00.397632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:00.397640Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:00.397643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:00.397647Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0783599-923db65a-b9771959-98552f90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:00.397654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.397658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.397660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:00.397669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.397679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:00.397712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534194619309515:6176]
2025-10-02T08:12:00.397722Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:00.397727Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:00.397742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.397811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.397819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.397833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.397871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1334 partition: 0 MaxSeqNo: 17 sessionId: src_id|e0783599-923db65a-b9771959-98552f90_0
2025-10-02T08:12:00.398212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a55d82-5fb29042-91c106b8-a929c437_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e0783599-923db65a-b9771959-98552f90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:00.401414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0783599-923db65a-b9771959-98552f90_0] Write session: try to update token
2025-10-02T08:12:00.401436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0783599-923db65a-b9771959-98552f90_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:00.409934Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:00.409947Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:00.409955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534194619309515:6176]
2025-10-02T08:12:00.410001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:00.410004Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:00.410157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:00.410308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:00.410449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:00.410590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:00.410780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:00.410819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:00.419634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId: src_id|e0783599-923db65a-b9771959-98552f90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:00.422418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:00.422514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.422529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.422564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:00.422584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:00.422658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.422665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.422856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.422936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.423001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.423070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.423113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.423122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.423193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.423265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.423335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.423415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.423589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.423598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.423670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.423733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.423795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.423862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.423910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.423918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.424004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.424100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.424169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.424239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.424285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.424292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.424360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.424419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.424490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.424576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.424640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.424649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.424724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.424789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.424879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.424945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.424989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.424997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.425066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.425134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.425197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.425271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.425339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.425348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.425438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.425520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.425589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.425657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.425721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.425729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.425798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.425864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.425956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.426041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.426090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.426097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.426166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:00.426226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:00.426282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:00.426349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:00.426395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:00.426402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:00.426462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:00.426531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.426554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.426560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:00.426594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:00.426610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:00.426618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:00.426621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:00.426624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:00.427035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:00.427063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:00.427069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:00.427077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:00.427082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:00.427085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:00.427545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:00.427568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:00.427573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:00.427575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:00.427579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:00.427581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:00.428071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:00.428098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:00.428107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:00.428110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:00.428112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:00.429289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:00.429309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:00.429321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392720428
2025-10-02T08:12:00.429537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:00.429550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:00.429554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:00.429557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:00.429561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:00.429563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:00.430047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:00.430066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:00.430071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:00.430073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:00.430075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:00.430079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:00.430518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:00.430540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:00.430544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:00.430546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:00.430549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:00.430551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:00.430997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:00.431016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:00.431020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:00.432103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:00.432120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:00.432124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:00.432126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:00.432133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392720431
2025-10-02T08:12:00.432430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:00.432450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:00.432455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:00.432458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:00.432460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:00.432463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:00.432914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:00.432938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:00.432943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:00.432951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:00.432954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:00.432957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:00.433438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:00.433459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.433561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392720433
2025-10-02T08:12:00.435944Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:00.435968Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:00.435975Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:00.435983Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:00.435995Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:00.435997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:00.436000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:00.436008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534194619309515:6176]
2025-10-02T08:12:00.436011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534194619309515:6176]
2025-10-02T08:12:00.436095Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:00.436097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:00.436102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.436104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:00.436114Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:00.436232Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:00.470858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534194619309575:6995]
2025-10-02T08:12:00.471005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1333, pipe: [1:7556534194619309575:6995]
2025-10-02T08:12:00.572950Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:00.573341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619309575:6995], now have 1 active actors on pipe
2025-10-02T08:12:00.573644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:00.573478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534194619309575:6995]
2025-10-02T08:12:00.573504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:00.573506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:00.573533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1334 reason: error at write: Disconnected sessionId: src_id|e0783599-923db65a-b9771959-98552f90_0
2025-10-02T08:12:00.573565Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:00.573711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1334 sessionId: src_id|e0783599-923db65a-b9771959-98552f90_0 is DEAD
2025-10-02T08:12:00.574107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0783599-923db65a-b9771959-98552f90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:00.574123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0783599-923db65a-b9771959-98552f90_0] Write session will restart in 0.006875s
2025-10-02T08:12:00.574152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0783599-923db65a-b9771959-98552f90_0] Write session: Do CDS request
2025-10-02T08:12:00.574160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0783599-923db65a-b9771959-98552f90_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:00.582529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0783599-923db65a-b9771959-98552f90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.582575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:00.582598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1335
2025-10-02T08:12:00.582884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.582937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:00.582950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:00.582961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:00.583614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1335 sessionId:  describe result for acl check
2025-10-02T08:12:00.583661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:00.583668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:00.583671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:00.583677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534194619309598:6169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:00.584241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534194619309598:6169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:00.586927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534194619309598:6169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:00.596697Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0d81ca9639ea5c1f] Result# TEvPutResult {Id# [72075186224037892:1333:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:00.596774Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1333:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:00.596883Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1333:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:00.597286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534194619309598:6169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:00.597300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534194619309598:6169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:00.597304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534194619309598:6169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:00.597314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:00.604070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:00.605369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:00.605579Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:00.605587Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:00.605598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:00.605667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:00.605700Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534194619309921:6170]
2025-10-02T08:12:00.606325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:00.606486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:00.606524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:00.606739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:00.606777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.606782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.606783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.606784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.606785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.606790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.606800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.606804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.606808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.606811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.606816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.606824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.606830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.606835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.606839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.606845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.606849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.606854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.606861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.606866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.606888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:00.614964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:00.616752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:00.616771Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:00.616774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:00.616777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:00.616784Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1334 [1:7556534194619309921:6170]
2025-10-02T08:12:00.616796Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:00.616832Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:00.616835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.616838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.616840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.616857Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:00.616864Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:00.616873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:00.616946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.616954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.616957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:00.616960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:00.617024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:00.617031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.617045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.617059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:00.617080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534194619309915:6170]
2025-10-02T08:12:00.617086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534194619309915:6170]
2025-10-02T08:12:00.617093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:00.617105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534195079220313:2378], now have 1 active actors on pipe
2025-10-02T08:12:00.617107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:00.617111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:00.617113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:00.617118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1334
2025-10-02T08:12:00.617128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:00.617135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:00.617140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619309774:6169], now have 1 active actors on pipe
2025-10-02T08:12:00.617175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.617183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.617196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534194619309915:6170]
2025-10-02T08:12:00.617210Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:00.617217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:00.617196Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1334
2025-10-02T08:12:00.617238Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|728cc099-c2493859-aed94670-2a237b0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:00.617249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.617256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.617263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:00.617273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.617282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:00.617318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.617396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.617403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.617417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.617460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1335 partition: 0 MaxSeqNo: 17 sessionId: src_id|728cc099-c2493859-aed94670-2a237b0e_0
2025-10-02T08:12:00.617970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0783599-923db65a-b9771959-98552f90_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|728cc099-c2493859-aed94670-2a237b0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:00.621421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728cc099-c2493859-aed94670-2a237b0e_0] Write session: try to update token
2025-10-02T08:12:00.621449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728cc099-c2493859-aed94670-2a237b0e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:00.634720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:00.634736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:00.634739Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:00.634747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534194619309915:6170]
2025-10-02T08:12:00.634751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534194619309915:6170]
2025-10-02T08:12:00.634789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:00.634790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:00.634797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.634800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:00.634801Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:00.634932Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:00.642470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId: src_id|728cc099-c2493859-aed94670-2a237b0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:00.645404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:00.673126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534194619309947:6995]
2025-10-02T08:12:00.673269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1334, pipe: [1:7556534194619309947:6995]
2025-10-02T08:12:00.780747Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:00.781158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.781173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.781194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619309947:6995], now have 1 active actors on pipe
2025-10-02T08:12:00.781899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728cc099-c2493859-aed94670-2a237b0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:00.781911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728cc099-c2493859-aed94670-2a237b0e_0] Write session will restart in 0.007737s
2025-10-02T08:12:00.781939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728cc099-c2493859-aed94670-2a237b0e_0] Write session: Do CDS request
2025-10-02T08:12:00.781946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728cc099-c2493859-aed94670-2a237b0e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:00.782090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:00.781337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534194619309947:6995]
2025-10-02T08:12:00.781361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:00.781363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:00.781411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1335 reason: error at write: Disconnected sessionId: src_id|728cc099-c2493859-aed94670-2a237b0e_0
2025-10-02T08:12:00.781415Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:00.781574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1335 sessionId: src_id|728cc099-c2493859-aed94670-2a237b0e_0 is DEAD
2025-10-02T08:12:00.791469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728cc099-c2493859-aed94670-2a237b0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.791477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:00.791497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1336
2025-10-02T08:12:00.791692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.791723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:00.791732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:00.791735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:00.792115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1336 sessionId:  describe result for acl check
2025-10-02T08:12:00.792149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:00.792155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:00.792156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:00.792161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534194619310228:6148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:00.792657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534194619310228:6148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:00.795050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534194619310228:6148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:00.796462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:00.798495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:00.798681Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:00.798691Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:00.798700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:00.798748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:00.798783Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534194619310285:6146]
2025-10-02T08:12:00.799154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534194619310228:6148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:00.799166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534194619310228:6148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:00.799170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534194619310228:6148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:00.799178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:00.799416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:00.799599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:00.799638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:00.800053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:00.800105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.800111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.800112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.800113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.800114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.800119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.800129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.800133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.800136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.800138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.800142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.800147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.800150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.800153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.800156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.800159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.800162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.800164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.800166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.800170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.800180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:00.808403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:00.809905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:00.809920Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:00.809922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:00.809924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:00.809929Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1335 [1:7556534194619310285:6146]
2025-10-02T08:12:00.809938Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:00.809951Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:00.809952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.809954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.809956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.809981Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:00.809986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:00.809993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:00.810045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.810051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.810053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:00.810055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:00.810101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:00.810103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.810113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.810120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:00.810133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534194619310279:6146]
2025-10-02T08:12:00.810135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534194619310279:6146]
2025-10-02T08:12:00.810141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:00.810153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:00.810168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:00.810176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:00.810201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534194619310279:6146]
2025-10-02T08:12:00.810208Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:00.810217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619310290:6148], now have 1 active actors on pipe
2025-10-02T08:12:00.810223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:00.810230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:00.810240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:00.810248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1335
2025-10-02T08:12:00.810278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.810284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.810296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534195079220322:2378], now have 1 active actors on pipe
2025-10-02T08:12:00.810309Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:00.810320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.810324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.810327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:00.810335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.810346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:00.810361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.810378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1335
2025-10-02T08:12:00.810397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.810403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.810412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.810439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1336 partition: 0 MaxSeqNo: 17 sessionId: src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0
2025-10-02T08:12:00.810734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728cc099-c2493859-aed94670-2a237b0e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:00.813635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0] Write session: try to update token
2025-10-02T08:12:00.813654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:00.830374Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:00.830398Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:00.830401Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:00.830413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534194619310279:6146]
2025-10-02T08:12:00.830420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534194619310279:6146]
2025-10-02T08:12:00.830471Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:00.830477Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:00.830479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:00.830488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.830490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:00.830657Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:00.833180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId: src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:00.836118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:00.881488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534194619310317:6995]
2025-10-02T08:12:00.881925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1335, pipe: [1:7556534194619310317:6995]
2025-10-02T08:12:00.974902Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:00.975208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.975222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.975257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619310317:6995], now have 1 active actors on pipe
2025-10-02T08:12:00.975353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534194619310317:6995]
2025-10-02T08:12:00.975375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:00.975377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:00.975424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1336 reason: error at write: Disconnected sessionId: src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0
2025-10-02T08:12:00.975520Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:00.975584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1336 sessionId: src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0 is DEAD
2025-10-02T08:12:00.975568Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:00.975900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:00.975910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0] Write session will restart in 0.007553s
2025-10-02T08:12:00.975936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0] Write session: Do CDS request
2025-10-02T08:12:00.975943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:00.984402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.984559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:00.984575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1337
2025-10-02T08:12:00.984784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:00.984841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:00.984845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:00.984849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:00.985187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1337 sessionId:  describe result for acl check
2025-10-02T08:12:00.985219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:00.985225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:00.985226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:00.985231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534194619310610:6138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:00.985727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534194619310610:6138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:00.986082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:00.987644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534194619310610:6138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:00.987716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:00.987975Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:00.987985Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:00.987995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:00.988066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:00.988107Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534194619310644:6137]
2025-10-02T08:12:00.988746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:00.988991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:00.989044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:00.989274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:00.989309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.989316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.989317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.989318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.989331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.989337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.989346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.989355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.989359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.989361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.989365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.989369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:00.989373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.989375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:00.989378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.989384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:00.989388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.989393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.989397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.989402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.989420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:00.992772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534194619310610:6138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:00.992789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534194619310610:6138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:00.992792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534194619310610:6138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:00.992812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:00.997792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:00.999173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:00.999188Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:00.999191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:00.999194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:00.999199Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1336 [1:7556534194619310644:6137]
2025-10-02T08:12:00.999208Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:00.999227Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:00.999235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.999238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.999240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.999256Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:00.999263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:00.999268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:00.999314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.999320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.999322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:00.999324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:00.999373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:00.999379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:00.999387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:00.999394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:00.999411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534194619310668:6138], now have 1 active actors on pipe
2025-10-02T08:12:00.999420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534194619310623:6137]
2025-10-02T08:12:00.999421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534194619310623:6137]
2025-10-02T08:12:00.999429Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:00.999438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1336
2025-10-02T08:12:00.999440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:00.999440Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:00.999443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:00.999448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:00.999450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:00.999455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534195079220329:2378], now have 1 active actors on pipe
2025-10-02T08:12:00.999459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.999462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.999502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534194619310623:6137]
2025-10-02T08:12:00.999515Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:00.999523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:00.999534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afc387d-7d590dcc-45b5b39-7b85b549_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:00.999539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:00.999544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:00.999546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:00.999553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:00.999561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:00.999526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1336
2025-10-02T08:12:00.999595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.999653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:00.999658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:00.999668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:00.999699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1337 partition: 0 MaxSeqNo: 17 sessionId: src_id|afc387d-7d590dcc-45b5b39-7b85b549_0
2025-10-02T08:12:01.000005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f9525d-319ea6da-a748e3a5-9e61f6ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|afc387d-7d590dcc-45b5b39-7b85b549_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:01.002796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afc387d-7d590dcc-45b5b39-7b85b549_0] Write session: try to update token
2025-10-02T08:12:01.002816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afc387d-7d590dcc-45b5b39-7b85b549_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:01.017732Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:01.017753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:01.017756Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:01.017764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534194619310623:6137]
2025-10-02T08:12:01.017770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534194619310623:6137]
2025-10-02T08:12:01.017811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:01.017818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.017825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:01.017826Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:01.017834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:01.017966Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:01.018132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId: src_id|afc387d-7d590dcc-45b5b39-7b85b549_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:01.020779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:01.075560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534198914277979:6995]
2025-10-02T08:12:01.075656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1336, pipe: [1:7556534198914277979:6995]
2025-10-02T08:12:01.171187Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:01.171460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.171474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.171513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914277979:6995], now have 1 active actors on pipe
2025-10-02T08:12:01.171815Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:01.171896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:01.172127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534198914277979:6995]
2025-10-02T08:12:01.172153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:01.172208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1337 reason: status is not ok: tablet will be restarted right now sessionId: src_id|afc387d-7d590dcc-45b5b39-7b85b549_0
2025-10-02T08:12:01.172379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1337 sessionId: src_id|afc387d-7d590dcc-45b5b39-7b85b549_0 is DEAD
2025-10-02T08:12:01.172531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc387d-7d590dcc-45b5b39-7b85b549_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:01.172551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc387d-7d590dcc-45b5b39-7b85b549_0] Write session will restart in 0.008902s
2025-10-02T08:12:01.172574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc387d-7d590dcc-45b5b39-7b85b549_0] Write session: Do CDS request
2025-10-02T08:12:01.172580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc387d-7d590dcc-45b5b39-7b85b549_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:01.182541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afc387d-7d590dcc-45b5b39-7b85b549_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:01.185044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:01.185061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1338
2025-10-02T08:12:01.185939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:01.185977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:01.185982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:01.185985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:01.186468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1338 sessionId:  describe result for acl check
2025-10-02T08:12:01.186498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:01.186500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:01.186501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:01.186507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534198914278186:6101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:01.186973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534198914278186:6101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:01.193358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534198914278186:6101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:01.195962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:01.197012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:01.197329Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:01.197342Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:01.197354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:01.197412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:01.197457Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534198914278343:6100]
2025-10-02T08:12:01.198114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:01.198402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534198914278186:6101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:01.198416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534198914278186:6101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:01.198419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534198914278186:6101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:01.198427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:01.198609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:01.198654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:01.198973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:01.199022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.199028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.199029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.199030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.199031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.199037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.199047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.199051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.199054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.199058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.199063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.199070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.199076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.199081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.199093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.199099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.199118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.199123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.199128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.199133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.199158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:01.207681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:01.209281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:01.209297Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:01.209298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:01.209300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:01.209306Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1337 [1:7556534198914278343:6100]
2025-10-02T08:12:01.209314Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:01.209328Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:01.209330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.209332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.209334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.209347Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:01.209351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:01.209356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:01.209400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.209406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.209408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:01.209409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:01.209456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:01.209462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.209471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.209478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:01.209489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534198914278337:6100]
2025-10-02T08:12:01.209491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534198914278337:6100]
2025-10-02T08:12:01.209496Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:01.209507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:01.209519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:01.209524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:01.209525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:01.209527Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:01.209536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914278352:6101], now have 1 active actors on pipe
2025-10-02T08:12:01.209543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1337
2025-10-02T08:12:01.209568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534199374187646:2378], now have 1 active actors on pipe
2025-10-02T08:12:01.209574Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534198914278337:6100]
2025-10-02T08:12:01.209579Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:01.209583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.209585Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:01.209586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.209615Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:01.209624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.209627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.209628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:01.209634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.209640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:01.209657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:01.209651Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1337
2025-10-02T08:12:01.209706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.209711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.209726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:01.209759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1338 partition: 0 MaxSeqNo: 17 sessionId: src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0
2025-10-02T08:12:01.210117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc387d-7d590dcc-45b5b39-7b85b549_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:01.213413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0] Write session: try to update token
2025-10-02T08:12:01.213438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:01.227461Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:01.227485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:01.227487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:01.227495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534198914278337:6100]
2025-10-02T08:12:01.227498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534198914278337:6100]
2025-10-02T08:12:01.227539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:01.227542Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:01.227546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.227546Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:01.227548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:01.227702Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:01.235099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId: src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:01.237995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:01.273901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534198914278398:6995]
2025-10-02T08:12:01.274030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1337, pipe: [1:7556534198914278398:6995]
2025-10-02T08:12:01.373278Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:01.373642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.373657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.373676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914278398:6995], now have 1 active actors on pipe
2025-10-02T08:12:01.373814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534198914278398:6995]
2025-10-02T08:12:01.373835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:01.373837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:01.373905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:01.373886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1338 reason: error at write: Disconnected sessionId: src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0
2025-10-02T08:12:01.374011Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:01.374050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1338 sessionId: src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0 is DEAD
2025-10-02T08:12:01.379863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:01.379881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0] Write session will restart in 0.005565s
2025-10-02T08:12:01.379913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0] Write session: Do CDS request
2025-10-02T08:12:01.379920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:01.386496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:01.387801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:01.387980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:01.388204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:01.388215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1339
2025-10-02T08:12:01.388233Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:01.388242Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:01.388252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:01.388319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:01.388360Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534198914278708:6057]
2025-10-02T08:12:01.388384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:01.388442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:01.388454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:01.388458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:01.388881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1339 sessionId:  describe result for acl check
2025-10-02T08:12:01.388911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:01.388913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:01.388914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:01.388919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534198914278713:6051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:01.388995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:01.389181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:01.389220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:01.389412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534198914278713:6051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:01.389524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:01.389570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.389576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.389577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.389578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.389579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.389585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.389594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.389597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.389601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.389604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.389609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.389616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.389626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.389631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.389635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.389639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.389644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.389648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.389653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.389658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.389678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:01.392639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534198914278713:6051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:01.397798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:01.399187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534198914278713:6051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:01.399214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534198914278713:6051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:01.399218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534198914278713:6051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:01.399227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:01.399414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:01.399437Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:01.399439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:01.399443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:01.399449Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1338 [1:7556534198914278708:6057]
2025-10-02T08:12:01.399461Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:01.399477Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:01.399480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.399482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.399484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.399500Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:01.399511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:01.399517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:01.399577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.399586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.399589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:01.399591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:01.399650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:01.399659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.399665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1338
2025-10-02T08:12:01.399671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.399681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:01.399705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914278755:6051], now have 1 active actors on pipe
2025-10-02T08:12:01.399714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.399718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.399730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534199374187675:2378], now have 1 active actors on pipe
2025-10-02T08:12:01.399739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534198914278702:6057]
2025-10-02T08:12:01.399741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534198914278702:6057]
2025-10-02T08:12:01.399747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:01.399728Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1338
2025-10-02T08:12:01.399754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:01.399757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:01.399762Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:01.399770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:01.399772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:01.399786Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:01.399795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.399799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.399800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:01.399808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.399821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:01.399861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534198914278702:6057]
2025-10-02T08:12:01.399874Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:01.399878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:01.399884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:01.399930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.399937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.399949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:01.399983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1339 partition: 0 MaxSeqNo: 17 sessionId: src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0
2025-10-02T08:12:01.400388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47c991fb-17751e05-b4d3d269-a90e6f3e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:01.403768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0] Write session: try to update token
2025-10-02T08:12:01.403787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:01.410746Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:01.410769Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:01.410778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534198914278702:6057]
2025-10-02T08:12:01.410807Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:01.410818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:01.410996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:01.411141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:01.411284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:01.411432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:01.411626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:01.411668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:01.419326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId: src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:01.421902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:01.422018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.422031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.422066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:01.422094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:01.422160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.422175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.422357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.422435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.422518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.422603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.422806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.422818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.422895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.422967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.423090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.423261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.423321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.423333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.423429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.423517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.423597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.423686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.423771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.423784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.423891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.424005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.424130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.424274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.424348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.424361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.424456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.424574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.424725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.424910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.424979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.424991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.425151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.425259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.425357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.425547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.425651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.425666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.425770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.425848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.425928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.426027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.426084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.426096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.426268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.426428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.426584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.426742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.426831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.426846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.426992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.427150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.427316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.427481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.427568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.427582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.427737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.427816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.427893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.427983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.428078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.428088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.428158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:01.428233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.428259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.428266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:01.428300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:01.428320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:01.428328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:01.428333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:01.428336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:01.428866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:01.428898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:01.428910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:01.428919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:01.428922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:01.428925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:01.429691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:01.429724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:01.429732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:01.429736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:01.429741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:01.429744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:01.430343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:01.430359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:01.430367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:01.430370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:01.430374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:01.431645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:01.431666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:01.431676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392721431
2025-10-02T08:12:01.431800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:01.431809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:01.431813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:01.431815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:01.431819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:01.431821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:01.432300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:01.432318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:01.432323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:01.432326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:01.432329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:01.432333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:01.432782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:01.432819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:01.432829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:01.432833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:01.432837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:01.432840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:01.433287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:01.433307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:01.433314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:01.434395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:01.434415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:01.434419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:01.434421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:01.434428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392721434
2025-10-02T08:12:01.434720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:01.434737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:01.434743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:01.434745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:01.434748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:01.434750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:01.435242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:01.435266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:01.435272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:01.435276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:01.435279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:01.435284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:01.435819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:01.435843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.435944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392721435
2025-10-02T08:12:01.438517Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:01.438543Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:01.438550Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:01.438558Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:01.438573Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:01.438579Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:01.438581Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:01.438591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534198914278702:6057]
2025-10-02T08:12:01.438600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534198914278702:6057]
2025-10-02T08:12:01.438662Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:01.438675Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:01.438680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:01.438684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.438686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:01.438831Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:01.475694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534198914278770:6995]
2025-10-02T08:12:01.475908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1338, pipe: [1:7556534198914278770:6995]
2025-10-02T08:12:01.585073Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:01.585465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914278770:6995], now have 1 active actors on pipe
2025-10-02T08:12:01.585936Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:01.585834Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:01.586145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:01.586174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1339 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0
2025-10-02T08:12:01.586337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1339 sessionId: src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0 is DEAD
2025-10-02T08:12:01.586450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534198914278770:6995]
2025-10-02T08:12:01.586678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:01.586693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0] Write session will restart in 0.007413s
2025-10-02T08:12:01.586720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0] Write session: Do CDS request
2025-10-02T08:12:01.586727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:01.593113Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [3d2d85d48a6d9027] Result# TEvPutResult {Id# [72075186224037892:1338:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:01.593177Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1338:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:01.593245Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1338:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:01.595398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:01.595771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:01.595784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1340
2025-10-02T08:12:01.595944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:01.595979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:01.595984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:01.595987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:01.596964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1340 sessionId:  describe result for acl check
2025-10-02T08:12:01.596998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:01.596999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:01.597001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:01.597006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534198914278935:6037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:01.597512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534198914278935:6037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:01.605913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534198914278935:6037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:01.607824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:01.609426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:01.609601Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:01.609613Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:01.609622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:01.609671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:01.609710Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534198914279121:6039]
2025-10-02T08:12:01.610040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534198914278935:6037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:01.610053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534198914278935:6037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:01.610057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534198914278935:6037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:01.610065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:01.610242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:01.610399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:01.610449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:01.610716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:01.610755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.610759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.610760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.610761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.610761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.610765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.610771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.610773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.610776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.610778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.610781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.610786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.610789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.610792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.610794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.610797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.610802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.610806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.610808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.610813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.610823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:01.620471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:01.622283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:01.622302Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:01.622305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:01.622308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:01.622316Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1339 [1:7556534198914279121:6039]
2025-10-02T08:12:01.622327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:01.622343Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:01.622349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.622357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.622358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.622374Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:01.622383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:01.622390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:01.622455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.622463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.622467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:01.622470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:01.622536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:01.622543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.622559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.622576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:01.622599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914279126:6037], now have 1 active actors on pipe
2025-10-02T08:12:01.622604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1339
2025-10-02T08:12:01.622609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534198914279115:6039]
2025-10-02T08:12:01.622612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534198914279115:6039]
2025-10-02T08:12:01.622623Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:01.622637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534199374187682:2378], now have 1 active actors on pipe
2025-10-02T08:12:01.622637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:01.622641Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:01.622648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:01.622662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:01.622669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:01.622676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.622680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.622722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534198914279115:6039]
2025-10-02T08:12:01.622730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:01.622749Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:01.622720Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1339
2025-10-02T08:12:01.622759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.622761Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:01.622763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.622766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:01.622775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.622784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:01.622828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:01.622911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.622917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.622929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:01.622970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1340 partition: 0 MaxSeqNo: 17 sessionId: src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0
2025-10-02T08:12:01.623383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f91d2b-dbc19b30-3ae6090-93791c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:01.626769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0] Write session: try to update token
2025-10-02T08:12:01.626793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:01.640561Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:01.640586Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:01.640588Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:01.640597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534198914279115:6039]
2025-10-02T08:12:01.640601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534198914279115:6039]
2025-10-02T08:12:01.640645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:01.640653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.640660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:01.640661Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:01.640668Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:01.640817Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:01.643966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId: src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:01.646793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:01.685803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534198914279154:6995]
2025-10-02T08:12:01.685929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1339, pipe: [1:7556534198914279154:6995]
2025-10-02T08:12:01.797471Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:01.797905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.797918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.797954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914279154:6995], now have 1 active actors on pipe
2025-10-02T08:12:01.798061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534198914279154:6995]
2025-10-02T08:12:01.798083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:01.798090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:01.798138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1340 reason: error at write: Disconnected sessionId: src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0
2025-10-02T08:12:01.798150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:01.798249Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:01.798307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1340 sessionId: src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0 is DEAD
2025-10-02T08:12:01.798479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:01.798494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0] Write session will restart in 0.009555s
2025-10-02T08:12:01.798531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0] Write session: Do CDS request
2025-10-02T08:12:01.798537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:01.808666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:01.809367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:01.809734Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:01.809747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1341
2025-10-02T08:12:01.809937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:01.809966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:01.809976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:01.809979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:01.810285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:01.810438Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:01.810446Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:01.810455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:01.810492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:01.810530Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534198914279472:6012]
2025-10-02T08:12:01.810537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1341 sessionId:  describe result for acl check
2025-10-02T08:12:01.810564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:01.810572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:01.810574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:01.810580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534198914279475:6017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:01.811074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534198914279475:6017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:01.811210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:01.811401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:01.811464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:01.811777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:01.811819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.811825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.811826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.811828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.811829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.811834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.811844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.811852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.811856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.811864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.811869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.811880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:01.811890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.811899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:01.811904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.811913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:01.811921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.811926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.811931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.811940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.811958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:01.813127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534198914279475:6017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:01.818073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534198914279475:6017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:01.818088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534198914279475:6017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:01.818091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534198914279475:6017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:01.818100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:01.821588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:01.823398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:01.823420Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:01.823424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:01.823427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:01.823434Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1340 [1:7556534198914279472:6012]
2025-10-02T08:12:01.823446Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:01.823463Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:01.823467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.823469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.823471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.823488Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:01.823499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:01.823505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:01.823568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.823575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.823578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:01.823580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:01.823645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:01.823652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.823665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:01.823681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:01.823702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1340
2025-10-02T08:12:01.823705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914279518:6017], now have 1 active actors on pipe
2025-10-02T08:12:01.823712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534198914279464:6012]
2025-10-02T08:12:01.823714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534198914279464:6012]
2025-10-02T08:12:01.823722Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:01.823735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:01.823736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:01.823740Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:01.823748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:01.823751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:01.823757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534199374187692:2378], now have 1 active actors on pipe
2025-10-02T08:12:01.823762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.823766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.823807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534198914279464:6012]
2025-10-02T08:12:01.823815Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:01.823825Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:01.823815Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1340
2025-10-02T08:12:01.823835Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a45653b-ffc69b48-51c6320d-296bae74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:01.823841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.823846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.823847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:01.823856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.823865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:01.823905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:01.824005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.824010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.824036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:01.824073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1341 partition: 0 MaxSeqNo: 17 sessionId: src_id|a45653b-ffc69b48-51c6320d-296bae74_0
2025-10-02T08:12:01.824479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5624f1e6-bea5ced5-7f3bbbbc-6b656427_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a45653b-ffc69b48-51c6320d-296bae74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:01.827855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45653b-ffc69b48-51c6320d-296bae74_0] Write session: try to update token
2025-10-02T08:12:01.827884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45653b-ffc69b48-51c6320d-296bae74_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:01.835267Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:01.835282Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:01.835293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534198914279464:6012]
2025-10-02T08:12:01.835334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:01.835339Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:01.835503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:01.835646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:01.835784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:01.835928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:01.836126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:01.836165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:01.847074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId: src_id|a45653b-ffc69b48-51c6320d-296bae74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:01.850270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:01.850377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.850395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.850437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:01.850484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:01.853657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:01.853685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:01.853910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.853996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.854086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.854175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.854247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.854260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.854355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.854446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.854529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.854611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.854670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.854676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.854754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.854821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.854892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.854971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.855021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.855026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.855103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.855174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.855251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.855329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.855393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.855401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.855493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.855576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.855669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.855759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.855817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.855820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.855919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.855996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.856090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.856169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.856231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.856234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.856327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.856397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.856469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.856543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.856601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.856604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.856683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.856749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.856895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.856972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.857041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.857049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.857142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.857224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.857305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.857388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.857451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.857458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.857543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:01.857625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:01.857701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:01.857788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:01.857848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:01.857855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:01.857923Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:01.857931Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:01.857933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:01.857944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534198914279464:6012]
2025-10-02T08:12:01.857953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534198914279464:6012]
2025-10-02T08:12:01.858029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:01.858067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:01.858075Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:01.858113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:01.858139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:01.858141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:01.858184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:01.858207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:01.858211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:01.858220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:01.858223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:01.858677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:01.858709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:01.858722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:01.858731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:01.858734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:01.858738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:01.859380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:01.859408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:01.859415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:01.859419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:01.859425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:01.859429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:01.860075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:01.860098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:01.860112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:01.860116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:01.860119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:01.861574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:01.861597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:01.861614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392721861
2025-10-02T08:12:01.861803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:01.861819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:01.861824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:01.861828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:01.861833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:01.861837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:01.862367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:01.862391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:01.862397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:01.862405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:01.862408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:01.862414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:01.862951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:01.862975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:01.862981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:01.862984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:01.862989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:01.862992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:01.863517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:01.863540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:01.863547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:01.864790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:01.864820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:01.864830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:01.864834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:01.864846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392721864
2025-10-02T08:12:01.865230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:01.865253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:01.865267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:01.865271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:01.865279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:01.865287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:01.865905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:01.865930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:01.865937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:01.865940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:01.865946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:01.865950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:01.866487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:01.866508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:01.866606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392721866
2025-10-02T08:12:01.867475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:01.867493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:01.867495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:01.867671Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:01.898323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534198914279533:6995]
2025-10-02T08:12:01.898522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1340, pipe: [1:7556534198914279533:6995]
2025-10-02T08:12:02.018185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45653b-ffc69b48-51c6320d-296bae74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:02.018204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45653b-ffc69b48-51c6320d-296bae74_0] Write session will restart in 0.009237s
2025-10-02T08:12:02.018231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45653b-ffc69b48-51c6320d-296bae74_0] Write session: Do CDS request
2025-10-02T08:12:02.018238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45653b-ffc69b48-51c6320d-296bae74_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:02.017671Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:02.016328Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:02.016879Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:02.016908Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:02.016916Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:02.016923Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:02.016947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534198914279533:6995], now have 1 active actors on pipe
2025-10-02T08:12:02.017282Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:02.017746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534198914279533:6995]
2025-10-02T08:12:02.017767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:02.017805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a45653b-ffc69b48-51c6320d-296bae74_0
2025-10-02T08:12:02.018006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1341 sessionId: src_id|a45653b-ffc69b48-51c6320d-296bae74_0 is DEAD
2025-10-02T08:12:02.028439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a45653b-ffc69b48-51c6320d-296bae74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.029111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:02.029131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1342
2025-10-02T08:12:02.029335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.029383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:02.029391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:02.029396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:02.029901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1342 sessionId:  describe result for acl check
2025-10-02T08:12:02.029941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:02.029944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:02.029945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:02.029951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534203209247036:5996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:02.030502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534203209247036:5996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:02.033040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534203209247036:5996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:02.038683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:02.039003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:02.039226Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:02.039230Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:02.039240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:02.039287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:02.039325Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534203209247173:6000]
2025-10-02T08:12:02.039973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:02.040000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534203209247036:5996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:02.040017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534203209247036:5996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:02.040061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534203209247036:5996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:02.040070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:02.040431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:02.040479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:02.040798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:02.040861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.040866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.040868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.040869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.040870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.040876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.040887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.040891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.040894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.040898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.040904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.040912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.040918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.040923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.040928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.040933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.040937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.040942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.040946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.040951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.040971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:02.050976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:02.052538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:02.052557Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:02.052560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:02.052564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:02.052572Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1341 [1:7556534203209247173:6000]
2025-10-02T08:12:02.052584Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:02.052603Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:02.052606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.052609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.052611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.052629Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:02.052635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:02.052641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:02.052705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.052714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.052717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:02.052721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:02.052787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:02.052795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.052834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.052853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:02.052861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1341
2025-10-02T08:12:02.052873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209247180:5996], now have 1 active actors on pipe
2025-10-02T08:12:02.052878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534203669154994:2378], now have 1 active actors on pipe
2025-10-02T08:12:02.052884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534203209247167:6000]
2025-10-02T08:12:02.052886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534203209247167:6000]
2025-10-02T08:12:02.052894Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:02.052907Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:02.052908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:02.052911Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:02.052923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:02.052926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:02.052933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.052943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.052992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534203209247167:6000]
2025-10-02T08:12:02.053001Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:02.053009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:02.053016Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:02.053022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.053026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.053028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:02.053037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.052997Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1341
2025-10-02T08:12:02.053049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:02.053089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.053256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.053267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.053298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.053337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1342 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0
2025-10-02T08:12:02.054380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a45653b-ffc69b48-51c6320d-296bae74_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:02.057721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0] Write session: try to update token
2025-10-02T08:12:02.057753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:02.074654Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:02.074674Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:02.074677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:02.074685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534203209247167:6000]
2025-10-02T08:12:02.074690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534203209247167:6000]
2025-10-02T08:12:02.074734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:02.074741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.074743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:02.074893Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:02.078990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:02.079012Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:02.086022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId: src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:02.088632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:02.117497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534203209247205:6995]
2025-10-02T08:12:02.117649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1341, pipe: [1:7556534203209247205:6995]
2025-10-02T08:12:02.227866Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:02.228339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.228357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.228376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209247205:6995], now have 1 active actors on pipe
2025-10-02T08:12:02.228426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:02.228433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:02.228480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1342 reason: error at write: Disconnected sessionId: src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0
2025-10-02T08:12:02.228591Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:02.228689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1342 sessionId: src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0 is DEAD
2025-10-02T08:12:02.228856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:02.228863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0] Write session will restart in 0.007489s
2025-10-02T08:12:02.228889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0] Write session: Do CDS request
2025-10-02T08:12:02.228896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:02.228990Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:02.229378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534203209247205:6995]
2025-10-02T08:12:02.241355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.241443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:02.241455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1343
2025-10-02T08:12:02.245072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.245134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:02.245140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:02.245144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:02.245683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1343 sessionId:  describe result for acl check
2025-10-02T08:12:02.245720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:02.245722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:02.245723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:02.245729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534203209247458:5955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:02.246369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534203209247458:5955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:02.250558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534203209247458:5955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:02.251349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:02.252231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:02.252381Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:02.252384Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:02.252392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:02.252432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:02.252455Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534203209247597:5970]
2025-10-02T08:12:02.252721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534203209247458:5955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:02.252728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534203209247458:5955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:02.252731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534203209247458:5955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:02.252738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:02.253018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:02.253184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:02.253215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:02.253464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:02.253519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.253525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.253527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.253528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.253529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.253534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.253542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.253545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.253549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.253552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.253558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.253564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.253569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.253574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.253577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.253582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.253586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.253590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.253595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.253599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.253616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:02.262009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:02.263513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:02.263531Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:02.263533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:02.263536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:02.263541Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1342 [1:7556534203209247597:5970]
2025-10-02T08:12:02.263551Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:02.263570Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:02.263574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.263579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.263581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.263597Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:02.263602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:02.263608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:02.263657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.263664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.263666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:02.263668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:02.263715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:02.263722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.263731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.263739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:02.263752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534203209247587:5970]
2025-10-02T08:12:02.263757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534203209247587:5970]
2025-10-02T08:12:02.263763Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:02.263773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:02.263783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:02.263785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1342
2025-10-02T08:12:02.263786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:02.263787Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:02.263788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:02.263796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209247602:5955], now have 1 active actors on pipe
2025-10-02T08:12:02.263799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534203669155015:2378], now have 1 active actors on pipe
2025-10-02T08:12:02.263821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534203209247587:5970]
2025-10-02T08:12:02.263833Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:02.263838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.263842Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:02.263842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.263880Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:02.263888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.263891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.263892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:02.263899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.263905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:02.263922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.263948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.263913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1342
2025-10-02T08:12:02.263953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.263963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.263996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1343 partition: 0 MaxSeqNo: 17 sessionId: src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0
2025-10-02T08:12:02.264357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f05e0f-5e5c55d-28d91d8-88c921ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:02.267136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0] Write session: try to update token
2025-10-02T08:12:02.267150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:02.281837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId: src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:02.282650Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:02.282670Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:02.282672Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:02.282678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534203209247587:5970]
2025-10-02T08:12:02.282681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534203209247587:5970]
2025-10-02T08:12:02.282721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:02.282728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.282733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:02.282735Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:02.282738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:02.282865Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:02.284595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:02.329097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534203209247637:6995]
2025-10-02T08:12:02.329391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1342, pipe: [1:7556534203209247637:6995]
2025-10-02T08:12:02.426247Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:02.426634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.426650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.426690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209247637:6995], now have 1 active actors on pipe
2025-10-02T08:12:02.426912Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:02.426914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534203209247637:6995]
2025-10-02T08:12:02.426934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:02.426937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:02.426934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:02.427028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1343 reason: error at write: Disconnected sessionId: src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0
2025-10-02T08:12:02.427230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1343 sessionId: src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0 is DEAD
2025-10-02T08:12:02.427472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:02.427489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0] Write session will restart in 0.009710s
2025-10-02T08:12:02.427514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0] Write session: Do CDS request
2025-10-02T08:12:02.427520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:02.438381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.438491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:02.438515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1344
2025-10-02T08:12:02.438646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.438714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:02.438720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:02.438724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:02.439125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1344 sessionId:  describe result for acl check
2025-10-02T08:12:02.439151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:02.439156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:02.439157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:02.439160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534203209247939:5951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:02.439657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534203209247939:5951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:02.441735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:02.442902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534203209247939:5951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:02.443544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:02.443812Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:02.443828Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:02.443842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:02.443908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:02.443952Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534203209247990:5950]
2025-10-02T08:12:02.444607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:02.444911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:02.444991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:02.445402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:02.445454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.445467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.445468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.445469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.445470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.445477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.445489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.445494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.445498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.445502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.445510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.445519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.445526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.445531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.445536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.445541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.445546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.445552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.445558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.445563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.445586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:02.449822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534203209247939:5951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:02.449842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534203209247939:5951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:02.449846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534203209247939:5951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:02.449856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:02.457278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:02.459589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:02.459616Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:02.459619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:02.459623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:02.459635Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1343 [1:7556534203209247990:5950]
2025-10-02T08:12:02.459651Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:02.459673Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:02.459685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.459688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.459690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.459710Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:02.459722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:02.459732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:02.459832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.459843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.459847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:02.459851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:02.459937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:02.459946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.459964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.459982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:02.459984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1343
2025-10-02T08:12:02.460012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209248007:5951], now have 1 active actors on pipe
2025-10-02T08:12:02.460040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534203209247970:5950]
2025-10-02T08:12:02.460043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534203209247970:5950]
2025-10-02T08:12:02.460069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:02.460088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.460093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.460109Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:02.460113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534203669155045:2378], now have 1 active actors on pipe
2025-10-02T08:12:02.460120Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:02.460122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:02.460138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:02.460142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:02.460112Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1343
2025-10-02T08:12:02.460200Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:02.460218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.460223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.460225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:02.460235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.460244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:02.460264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534203209247970:5950]
2025-10-02T08:12:02.460276Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:02.460288Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:02.460307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.460384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.460393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.460412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.460456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1344 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0
2025-10-02T08:12:02.460936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2872fa71-2bc2c417-f1a8ffc3-e7d2ee48_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:02.464088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0] Write session: try to update token
2025-10-02T08:12:02.464105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:02.480054Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:02.480074Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:02.480076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:02.480086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534203209247970:5950]
2025-10-02T08:12:02.480090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534203209247970:5950]
2025-10-02T08:12:02.480133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:02.480136Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:02.480140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.480141Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:02.480142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:02.480282Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:02.484380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId: src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:02.487258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:02.527094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534203209248020:6995]
2025-10-02T08:12:02.527205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1343, pipe: [1:7556534203209248020:6995]
2025-10-02T08:12:02.627150Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:02.627474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.627488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.627523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209248020:6995], now have 1 active actors on pipe
2025-10-02T08:12:02.627681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:02.627690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:02.627743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1344 reason: error at write: Disconnected sessionId: src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0
2025-10-02T08:12:02.627743Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:02.627869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:02.627949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1344 sessionId: src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0 is DEAD
2025-10-02T08:12:02.628042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534203209248020:6995]
2025-10-02T08:12:02.628148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:02.628160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0] Write session will restart in 0.006643s
2025-10-02T08:12:02.628185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0] Write session: Do CDS request
2025-10-02T08:12:02.628191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:02.636367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.636461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:02.636474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1345
2025-10-02T08:12:02.636667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.636697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:02.636708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:02.636712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:02.637067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1345 sessionId:  describe result for acl check
2025-10-02T08:12:02.637092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:02.637097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:02.637099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:02.637102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534203209248330:5923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:02.637493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534203209248330:5923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:02.638856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:02.639908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534203209248330:5923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:02.640248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:02.640425Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:02.640437Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:02.640446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:02.640487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:02.640523Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534203209248374:5925]
2025-10-02T08:12:02.641227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:02.641617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:02.641691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:02.642068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:02.642113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.642119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.642120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.642121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.642122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.642128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.642137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.642141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.642144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.642148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.642153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.642165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.642175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.642180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.642189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.642199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.642208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.642213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.642218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.642224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.642241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:02.642890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534203209248330:5923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:02.642905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534203209248330:5923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:02.642909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534203209248330:5923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:02.642917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:02.650517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:02.652226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:02.652243Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:02.652246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:02.652250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:02.652257Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1344 [1:7556534203209248374:5925]
2025-10-02T08:12:02.652270Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:02.652291Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:02.652294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.652297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.652299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.652316Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:02.652322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:02.652330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:02.652396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.652404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.652407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:02.652410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:02.652478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:02.652488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.652501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.652512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:02.652529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534203209248356:5925]
2025-10-02T08:12:02.652536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534203209248356:5925]
2025-10-02T08:12:02.652545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:02.652559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209248393:5923], now have 1 active actors on pipe
2025-10-02T08:12:02.652560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1344
2025-10-02T08:12:02.652572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:02.652579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:02.652582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:02.652585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:02.652589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:02.652621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.652630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.652645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534203209248356:5925]
2025-10-02T08:12:02.652654Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:02.652664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534203669155054:2378], now have 1 active actors on pipe
2025-10-02T08:12:02.652665Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:02.652688Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:02.652698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.652702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.652707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:02.652717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.652700Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1344
2025-10-02T08:12:02.652731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:02.652755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.652871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.652878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.652893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.652939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1345 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0
2025-10-02T08:12:02.653332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f77606d-403fd2ec-bdc26594-dd787b7a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:02.656571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0] Write session: try to update token
2025-10-02T08:12:02.656593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:02.672070Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:02.672084Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:02.672086Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:02.672093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534203209248356:5925]
2025-10-02T08:12:02.672096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534203209248356:5925]
2025-10-02T08:12:02.672131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:02.672136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.672141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:02.672171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:02.672193Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:02.672265Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:02.672509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId: src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:02.675063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:02.727786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534203209248411:6995]
2025-10-02T08:12:02.727946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1344, pipe: [1:7556534203209248411:6995]
2025-10-02T08:12:02.815878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:02.815915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:02.815952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0] Write session will restart in 0.006470s
2025-10-02T08:12:02.815981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0] Write session: Do CDS request
2025-10-02T08:12:02.815989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:02.814625Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:02.814923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.814930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.814966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209248411:6995], now have 1 active actors on pipe
2025-10-02T08:12:02.815338Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:02.815376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:02.815439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1345 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0
2025-10-02T08:12:02.815581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1345 sessionId: src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0 is DEAD
2025-10-02T08:12:02.815808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534203209248411:6995]
2025-10-02T08:12:02.823426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.823854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:02.823875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1346
2025-10-02T08:12:02.824058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:02.824095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:02.824106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:02.824110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:02.824551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1346 sessionId:  describe result for acl check
2025-10-02T08:12:02.824585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:02.824587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:02.824589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:02.824595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534203209248451:5898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:02.825210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534203209248451:5898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:02.827873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534203209248451:5898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:02.830425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534203209248451:5898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:02.830437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534203209248451:5898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:02.830451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534203209248451:5898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:02.830460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:02.836350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:02.837909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:02.838124Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:02.838133Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:02.838143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:02.838192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:02.838230Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534203209248772:5910]
2025-10-02T08:12:02.838941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:02.839133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:02.839171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:02.839467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:02.839508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.839513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.839514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.839516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.839517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.839522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.839533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.839541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.839545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.839550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.839559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.839566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:02.839572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.839579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:02.839587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.839594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:02.839603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.839612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.839617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.839622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.839645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:02.850322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:02.852089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:02.852109Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:02.852112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:02.852116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:02.852123Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1345 [1:7556534203209248772:5910]
2025-10-02T08:12:02.852136Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:02.852156Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:02.852159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.852163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.852166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.852182Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:02.852188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:02.852195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:02.852264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.852276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.852280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:02.852283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:02.852355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:02.852368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.852382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:02.852394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:02.852413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209248633:5898], now have 1 active actors on pipe
2025-10-02T08:12:02.852423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534203669155061:2378], now have 1 active actors on pipe
2025-10-02T08:12:02.852430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534203209248766:5910]
2025-10-02T08:12:02.852432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534203209248766:5910]
2025-10-02T08:12:02.852435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1345
2025-10-02T08:12:02.852443Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:02.852454Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:02.852461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:02.852511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1345
2025-10-02T08:12:02.852475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:02.852484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:02.852491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.852496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.852499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:02.852539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534203209248766:5910]
2025-10-02T08:12:02.852542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:02.852551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:02.852558Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:02.852564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:02.852568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:02.852570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:02.852582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:02.852592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:02.852644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.852739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:02.852751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:02.852769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:02.852833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1346 partition: 0 MaxSeqNo: 17 sessionId: src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0
2025-10-02T08:12:02.853536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2779a3-6d0b399-34e977c2-a94adf01_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:02.856686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0] Write session: try to update token
2025-10-02T08:12:02.856708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:02.871363Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:02.871382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:02.871384Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:02.871393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534203209248766:5910]
2025-10-02T08:12:02.871398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534203209248766:5910]
2025-10-02T08:12:02.871445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:02.871446Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:02.871452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:02.871452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:02.871453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:02.871598Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:02.880203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId: src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:02.882788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:02.913132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534203209248798:6995]
2025-10-02T08:12:02.914960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1345, pipe: [1:7556534203209248798:6995]
2025-10-02T08:12:03.009253Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:03.009553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.009566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.009587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534203209248798:6995], now have 1 active actors on pipe
2025-10-02T08:12:03.009767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534203209248798:6995]
2025-10-02T08:12:03.009811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:03.009813Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:03.009817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:03.009884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1346 reason: error at write: Disconnected sessionId: src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0
2025-10-02T08:12:03.009935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:03.010081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1346 sessionId: src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0 is DEAD
2025-10-02T08:12:03.010221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:03.010231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0] Write session will restart in 0.008843s
2025-10-02T08:12:03.010258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0] Write session: Do CDS request
2025-10-02T08:12:03.010264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:03.020459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.020569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:03.020603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1347
2025-10-02T08:12:03.020750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.020779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:03.020784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:03.020798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:03.021303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1347 sessionId:  describe result for acl check
2025-10-02T08:12:03.021341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:03.021347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:03.021350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:03.021364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534207504216407:5886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:03.021939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534207504216407:5886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:03.021984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:03.023544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:03.023738Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:03.023754Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:03.023765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:03.023826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:03.023873Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534207504216438:5885]
2025-10-02T08:12:03.024261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534207504216407:5886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:03.024574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:03.024790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:03.024865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:03.025104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:03.025139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.025145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.025146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.025146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.025149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.025153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.025159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.025161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.025163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.025165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.025169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.025174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.025178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.025181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.025183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.025186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.025188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.025191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.025194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.025196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.025209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:03.030135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534207504216407:5886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:03.030153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534207504216407:5886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:03.030156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534207504216407:5886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:03.030165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:03.033211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:03.034744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:03.034768Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:03.034772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:03.034775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:03.034782Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1346 [1:7556534207504216438:5885]
2025-10-02T08:12:03.034796Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:03.034813Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:03.034816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.034820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.034822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.034838Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:03.034850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:03.034857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:03.034928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.034936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.034939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:03.034942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:03.035010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:03.035019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.035033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.035045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:03.035064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504216465:5886], now have 1 active actors on pipe
2025-10-02T08:12:03.035071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534207504216416:5885]
2025-10-02T08:12:03.035073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534207504216416:5885]
2025-10-02T08:12:03.035080Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:03.035093Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:03.035094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:03.035094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1346
2025-10-02T08:12:03.035104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:03.035108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:03.035111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:03.035117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534207964122364:2378], now have 1 active actors on pipe
2025-10-02T08:12:03.035122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.035126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.035167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534207504216416:5885]
2025-10-02T08:12:03.035181Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:03.035189Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:03.035169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1346
2025-10-02T08:12:03.035196Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:03.035205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.035209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.035211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:03.035221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.035230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:03.035274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.035322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.035329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.035343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.035378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1347 partition: 0 MaxSeqNo: 17 sessionId: src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0
2025-10-02T08:12:03.035762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fea7f8-e4340fc7-d89fada6-5ddc1e9b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:03.039393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0] Write session: try to update token
2025-10-02T08:12:03.039417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:03.054627Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:03.054650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:03.054653Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:03.054662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534207504216416:5885]
2025-10-02T08:12:03.054667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534207504216416:5885]
2025-10-02T08:12:03.054714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:03.054720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.054723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:03.054877Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:03.056888Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:03.056920Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:03.059585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId: src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:03.062615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:03.109873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534207504216481:6995]
2025-10-02T08:12:03.110056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1346, pipe: [1:7556534207504216481:6995]
2025-10-02T08:12:03.192178Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:03.192534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.192550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.192586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504216481:6995], now have 1 active actors on pipe
2025-10-02T08:12:03.192744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:03.192757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:03.192847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1347 reason: error at write: Disconnected sessionId: src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0
2025-10-02T08:12:03.193021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1347 sessionId: src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0 is DEAD
2025-10-02T08:12:03.193151Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:03.193211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:03.193224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0] Write session will restart in 0.005355s
2025-10-02T08:12:03.193214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534207504216481:6995]
2025-10-02T08:12:03.193251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0] Write session: Do CDS request
2025-10-02T08:12:03.193261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:03.193373Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:03.201932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.202395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:03.202414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1348
2025-10-02T08:12:03.202619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.202656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:03.202666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:03.202670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:03.203052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1348 sessionId:  describe result for acl check
2025-10-02T08:12:03.203081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:03.203086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:03.203089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:03.203094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534207504216778:5871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:03.203812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534207504216778:5871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:03.206906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:03.209043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:03.209417Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:03.209429Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:03.209442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:03.209499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:03.209543Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534207504216842:5874]
2025-10-02T08:12:03.210278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:03.211019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534207504216778:5871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:03.211117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:03.211160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:03.211481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:03.211515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.211517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.211518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.211519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.211520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.211526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.211536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.211540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.211546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.211549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.211556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.211564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.211570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.211575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.211579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.211584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.211587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.211591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.211596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.211601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.211622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:03.220087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534207504216778:5871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:03.220108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534207504216778:5871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:03.220112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534207504216778:5871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:03.220121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:03.224069Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1347
2025-10-02T08:12:03.221591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:03.223670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:03.223678Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:03.223680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:03.223690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:03.223699Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1347 [1:7556534207504216842:5874]
2025-10-02T08:12:03.223714Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:03.223735Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:03.223739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.223743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.223745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.223764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:03.223769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:03.223776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:03.223837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.223839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.223841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:03.223844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:03.223915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:03.223918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.223935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.223947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:03.223968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534207504216832:5874]
2025-10-02T08:12:03.223970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534207504216832:5874]
2025-10-02T08:12:03.223979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:03.223990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:03.223994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504216868:5871], now have 1 active actors on pipe
2025-10-02T08:12:03.223994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:03.223995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1347
2025-10-02T08:12:03.224003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:03.224020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:03.224040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:03.224047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534207964122386:2378], now have 1 active actors on pipe
2025-10-02T08:12:03.224053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.224057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.224111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534207504216832:5874]
2025-10-02T08:12:03.224114Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:03.224116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:03.224131Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:03.224138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.224142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.224144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:03.224154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.224164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:03.224207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.224314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.224320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.224345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.224399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1348 partition: 0 MaxSeqNo: 17 sessionId: src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0
2025-10-02T08:12:03.224840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f59dc0-2b94b504-b78f08a9-52101537_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:03.228175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0] Write session: try to update token
2025-10-02T08:12:03.228194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:03.248631Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:03.248657Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:03.248660Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:03.248672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534207504216832:5874]
2025-10-02T08:12:03.248679Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534207504216832:5874]
2025-10-02T08:12:03.248734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:03.248734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:03.248740Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:03.248742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.248748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:03.248951Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:03.270454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId: src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:03.272990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:03.293523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534207504216913:6995]
2025-10-02T08:12:03.293640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1347, pipe: [1:7556534207504216913:6995]
2025-10-02T08:12:03.400165Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:03.400488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.400505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.400527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504216913:6995], now have 1 active actors on pipe
2025-10-02T08:12:03.400623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:03.400636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:03.400696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1348 reason: error at write: Disconnected sessionId: src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0
2025-10-02T08:12:03.400786Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:03.400889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1348 sessionId: src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0 is DEAD
2025-10-02T08:12:03.401043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:03.401055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0] Write session will restart in 0.006185s
2025-10-02T08:12:03.401081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0] Write session: Do CDS request
2025-10-02T08:12:03.401088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:03.401102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534207504216913:6995]
2025-10-02T08:12:03.401306Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:03.408372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.408433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:03.408446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1349
2025-10-02T08:12:03.408614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.408642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:03.408645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:03.408648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:03.409228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1349 sessionId:  describe result for acl check
2025-10-02T08:12:03.409268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:03.409277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:03.409279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:03.409286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534207504217130:5808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:03.409913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534207504217130:5808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:03.413081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534207504217130:5808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:03.414974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:03.416639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:03.416841Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:03.416850Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:03.416863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:03.416918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:03.417032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534207504217130:5808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:03.417047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534207504217130:5808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:03.417050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534207504217130:5808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:03.417062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:03.417072Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534207504217280:5806]
2025-10-02T08:12:03.417653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:03.417870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:03.417913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:03.418154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:03.418199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.418204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.418205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.418206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.418207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.418213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.418223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.418227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.418232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.418236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.418242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.418251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.418261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.418266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.418271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.418276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.418285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.418290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.418294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.418300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.418325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:03.427049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:03.428778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:03.428797Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:03.428836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:03.428841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:03.428849Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1348 [1:7556534207504217280:5806]
2025-10-02T08:12:03.428868Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:03.428894Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:03.428902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.428906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.428908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.428928Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:03.428939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:03.428946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:03.429019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.429027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.429031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:03.429034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:03.429111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:03.429119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.429133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.429144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:03.429168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1348
2025-10-02T08:12:03.429169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504217285:5808], now have 1 active actors on pipe
2025-10-02T08:12:03.429177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534207504217274:5806]
2025-10-02T08:12:03.429179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534207504217274:5806]
2025-10-02T08:12:03.429193Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:03.429205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534207964122414:2378], now have 1 active actors on pipe
2025-10-02T08:12:03.429210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.429213Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:03.429214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.429216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:03.429232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:03.429250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:03.429257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:03.429308Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa452a9d-12155786-818110f1-19fb122_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:03.429318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.429283Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1348
2025-10-02T08:12:03.429325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.429331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:03.429342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.429354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:03.429365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534207504217274:5806]
2025-10-02T08:12:03.429377Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:03.429393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:03.429407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.429516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.429525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.429541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.429590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1349 partition: 0 MaxSeqNo: 17 sessionId: src_id|aa452a9d-12155786-818110f1-19fb122_0
2025-10-02T08:12:03.429984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a72c68-e3b85a27-2e45bfec-15edb51f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aa452a9d-12155786-818110f1-19fb122_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:03.433121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa452a9d-12155786-818110f1-19fb122_0] Write session: try to update token
2025-10-02T08:12:03.433150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa452a9d-12155786-818110f1-19fb122_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:03.447653Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:03.447679Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:03.447681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:03.447693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534207504217274:5806]
2025-10-02T08:12:03.447696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534207504217274:5806]
2025-10-02T08:12:03.447739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:03.447745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.447747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:03.447747Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:03.447753Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:03.447913Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:03.449853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId: src_id|aa452a9d-12155786-818110f1-19fb122_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:03.452748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:03.501424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534207504217310:6995]
2025-10-02T08:12:03.501933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1348, pipe: [1:7556534207504217310:6995]
2025-10-02T08:12:03.586218Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:03.586660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.586676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.586729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504217310:6995], now have 1 active actors on pipe
2025-10-02T08:12:03.586916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534207504217310:6995]
2025-10-02T08:12:03.586961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:03.586970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:03.587006Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:03.587062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1349 reason: error at write: Disconnected sessionId: src_id|aa452a9d-12155786-818110f1-19fb122_0
2025-10-02T08:12:03.587062Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:03.587233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1349 sessionId: src_id|aa452a9d-12155786-818110f1-19fb122_0 is DEAD
2025-10-02T08:12:03.587442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa452a9d-12155786-818110f1-19fb122_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:03.587454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa452a9d-12155786-818110f1-19fb122_0] Write session will restart in 0.005493s
2025-10-02T08:12:03.587483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa452a9d-12155786-818110f1-19fb122_0] Write session: Do CDS request
2025-10-02T08:12:03.587490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa452a9d-12155786-818110f1-19fb122_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:03.594391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa452a9d-12155786-818110f1-19fb122_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.594456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:03.594476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1350
2025-10-02T08:12:03.594625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.594665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:03.594675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:03.594684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:03.595107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1350 sessionId:  describe result for acl check
2025-10-02T08:12:03.595149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:03.595157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:03.595159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:03.595165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534207504217509:5801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:03.595655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534207504217509:5801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:03.601207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534207504217509:5801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:03.602631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:03.603823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:03.604000Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:03.604011Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:03.604022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:03.604089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:03.604128Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534207504217678:5803]
2025-10-02T08:12:03.604311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534207504217509:5801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:03.604327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534207504217509:5801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:03.604330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534207504217509:5801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:03.604339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:03.604721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:03.604922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:03.604973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:03.605260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:03.605335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.605341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.605342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.605343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.605344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.605349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.605358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.605362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.605365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.605368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.605373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.605385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.605394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.605399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.605404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.605409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.605413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.605421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.605429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.605434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.605458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:03.613610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:03.615478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:03.615498Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:03.615501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:03.615504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:03.615509Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1349 [1:7556534207504217678:5803]
2025-10-02T08:12:03.615523Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:03.615539Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:03.615542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.615544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.615546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.615560Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:03.615565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:03.615571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:03.615636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.615644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.615646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:03.615648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:03.615711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:03.615718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.615729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.615738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:03.615757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534207504217672:5803]
2025-10-02T08:12:03.615763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534207504217672:5803]
2025-10-02T08:12:03.615771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:03.615781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:03.615783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:03.615787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504217683:5801], now have 1 active actors on pipe
2025-10-02T08:12:03.615789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1349
2025-10-02T08:12:03.615794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:03.615805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:03.615811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:03.615817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534207964122420:2378], now have 1 active actors on pipe
2025-10-02T08:12:03.615855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.615862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.615875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534207504217672:5803]
2025-10-02T08:12:03.615888Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:03.615895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:03.615918Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:03.615934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.615943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.615944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:03.615954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.615966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:03.615934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1349
2025-10-02T08:12:03.616001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.616058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.616065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.616079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.616119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1350 partition: 0 MaxSeqNo: 17 sessionId: src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0
2025-10-02T08:12:03.616483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa452a9d-12155786-818110f1-19fb122_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:03.619605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0] Write session: try to update token
2025-10-02T08:12:03.619629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:03.632991Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:03.633008Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:03.633010Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:03.633018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534207504217672:5803]
2025-10-02T08:12:03.633022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534207504217672:5803]
2025-10-02T08:12:03.633062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:03.633066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:03.633068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.633070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:03.633072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:03.633211Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:03.636914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId: src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:03.639795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:03.686247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534207504217711:6995]
2025-10-02T08:12:03.686366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1349, pipe: [1:7556534207504217711:6995]
2025-10-02T08:12:03.770788Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:03.771143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.771163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.771198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504217711:6995], now have 1 active actors on pipe
2025-10-02T08:12:03.771316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534207504217711:6995]
2025-10-02T08:12:03.771348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:03.771351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:03.771447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1350 reason: error at write: Disconnected sessionId: src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0
2025-10-02T08:12:03.771481Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:03.771446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:03.771613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1350 sessionId: src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0 is DEAD
2025-10-02T08:12:03.771841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:03.771852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0] Write session will restart in 0.008708s
2025-10-02T08:12:03.771882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0] Write session: Do CDS request
2025-10-02T08:12:03.771890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:03.781508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.781610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:03.781626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1351
2025-10-02T08:12:03.781951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.781987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:03.781993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:03.781996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:03.782490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1351 sessionId:  describe result for acl check
2025-10-02T08:12:03.782533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:03.782535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:03.782536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:03.782541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534207504218032:5784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:03.783099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534207504218032:5784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:03.784633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:03.785448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534207504218032:5784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:03.786851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:03.787072Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:03.787081Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:03.787090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:03.787137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:03.787177Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534207504218078:5770]
2025-10-02T08:12:03.787784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:03.787989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:03.788037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:03.788326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:03.788387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.788403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.788404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.788405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.788406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.788411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.788421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.788425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.788430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.788434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.788440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.788447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.788457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.788463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.788471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.788477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.788481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.788486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.788491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.788500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.788520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:03.793668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534207504218032:5784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:03.793688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534207504218032:5784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:03.793693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534207504218032:5784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:03.793701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:03.796885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:03.800037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:03.800057Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:03.800061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:03.800065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:03.800073Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1350 [1:7556534207504218078:5770]
2025-10-02T08:12:03.800087Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:03.800107Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:03.800110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.800114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.800117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.800134Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:03.800146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:03.800153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:03.800220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.800228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.800231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:03.800234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:03.800306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:03.800315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.800328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.800341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:03.800363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504218095:5784], now have 1 active actors on pipe
2025-10-02T08:12:03.800373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1350
2025-10-02T08:12:03.800374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534207504218062:5770]
2025-10-02T08:12:03.800377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534207504218062:5770]
2025-10-02T08:12:03.800384Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:03.800395Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:03.800398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:03.800406Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:03.800413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:03.800416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:03.800422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534207964122429:2378], now have 1 active actors on pipe
2025-10-02T08:12:03.800429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.800433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.800475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534207504218062:5770]
2025-10-02T08:12:03.800483Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:03.800497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:03.800474Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1350
2025-10-02T08:12:03.800498Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|545ca582-71f17310-a711cce5-af34e1fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:03.800504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.800508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.800509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:03.800518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.800528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:03.800583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.800655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.800663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.800677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.800720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1351 partition: 0 MaxSeqNo: 17 sessionId: src_id|545ca582-71f17310-a711cce5-af34e1fa_0
2025-10-02T08:12:03.801107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd19fe6e-e61c701e-bf3a0da7-5e55e70a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|545ca582-71f17310-a711cce5-af34e1fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:03.810488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545ca582-71f17310-a711cce5-af34e1fa_0] Write session: try to update token
2025-10-02T08:12:03.810514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545ca582-71f17310-a711cce5-af34e1fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:03.818457Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:03.818475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:03.818477Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:03.818484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534207504218062:5770]
2025-10-02T08:12:03.818487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534207504218062:5770]
2025-10-02T08:12:03.818521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:03.818522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:03.818526Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:03.818526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.818528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:03.818822Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:03.835547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId: src_id|545ca582-71f17310-a711cce5-af34e1fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:03.838042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:03.871605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534207504218108:6995]
2025-10-02T08:12:03.871747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1350, pipe: [1:7556534207504218108:6995]
2025-10-02T08:12:03.955017Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:03.955372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.955387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.955407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504218108:6995], now have 1 active actors on pipe
2025-10-02T08:12:03.955525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534207504218108:6995]
2025-10-02T08:12:03.955547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:03.955552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:03.955605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1351 reason: error at write: Disconnected sessionId: src_id|545ca582-71f17310-a711cce5-af34e1fa_0
2025-10-02T08:12:03.955606Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:03.955628Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:03.955768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1351 sessionId: src_id|545ca582-71f17310-a711cce5-af34e1fa_0 is DEAD
2025-10-02T08:12:03.955932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545ca582-71f17310-a711cce5-af34e1fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:03.955947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545ca582-71f17310-a711cce5-af34e1fa_0] Write session will restart in 0.005161s
2025-10-02T08:12:03.956048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545ca582-71f17310-a711cce5-af34e1fa_0] Write session: Do CDS request
2025-10-02T08:12:03.956057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545ca582-71f17310-a711cce5-af34e1fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:03.962477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545ca582-71f17310-a711cce5-af34e1fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.962605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:03.962620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1352
2025-10-02T08:12:03.962783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:03.962816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:03.962826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:03.962830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:03.963246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1352 sessionId:  describe result for acl check
2025-10-02T08:12:03.963278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:03.963280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:03.963281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:03.963285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534207504218343:5769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:03.963792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534207504218343:5769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:03.966335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534207504218343:5769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:03.968426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:03.970047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:03.970316Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:03.970326Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:03.970336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:03.970384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:03.970418Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534207504218474:5776]
2025-10-02T08:12:03.970508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534207504218343:5769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:03.970522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534207504218343:5769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:03.970526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534207504218343:5769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:03.970534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:03.971025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:03.971174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:03.971207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:03.971493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:03.971529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.971534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.971535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.971536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.971538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.971542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.971551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.971555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.971558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.971562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.971567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.971573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:03.971584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.971589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:03.971598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.971603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:03.971607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.971611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.971621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.971626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.971648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:03.979685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:03.981728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:03.981749Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:03.981751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:03.981754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:03.981761Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1351 [1:7556534207504218474:5776]
2025-10-02T08:12:03.981772Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:03.981791Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:03.981793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.981796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.981797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.981815Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:03.981819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:03.981826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:03.981890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.981898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.981902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:03.981904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:03.981968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:03.981975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:03.981986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:03.981993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:03.982008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534207504218468:5776]
2025-10-02T08:12:03.982015Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534207504218468:5776]
2025-10-02T08:12:03.982025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:03.982039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:03.982041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:03.982045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:03.982059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:03.982063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:03.982075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534207504218479:5769], now have 1 active actors on pipe
2025-10-02T08:12:03.982087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534207964122435:2378], now have 1 active actors on pipe
2025-10-02T08:12:03.982094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1351
2025-10-02T08:12:03.982126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534207504218468:5776]
2025-10-02T08:12:03.982137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:03.982145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.982099Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1351
2025-10-02T08:12:03.982151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.982153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:03.982220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:03.982233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:03.982236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:03.982237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:03.982246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:03.982256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:03.982275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.982318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:03.982325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:03.982338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:03.982379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1352 partition: 0 MaxSeqNo: 17 sessionId: src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0
2025-10-02T08:12:03.982708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545ca582-71f17310-a711cce5-af34e1fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:03.985680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0] Write session: try to update token
2025-10-02T08:12:03.985699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:04.000375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId: src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:04.000920Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:04.000935Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:04.000937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:04.000946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534207504218468:5776]
2025-10-02T08:12:04.000955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534207504218468:5776]
2025-10-02T08:12:04.000997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:04.001003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.001005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:04.001048Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:04.001063Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:04.001189Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:04.003165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:04.055887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534211799185800:6995]
2025-10-02T08:12:04.056057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1351, pipe: [1:7556534211799185800:6995]
2025-10-02T08:12:04.143334Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:04.143587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.143600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.143632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799185800:6995], now have 1 active actors on pipe
2025-10-02T08:12:04.143765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:04.143779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:04.143812Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:04.143859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1352 reason: error at write: Disconnected sessionId: src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0
2025-10-02T08:12:04.143872Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:04.144041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1352 sessionId: src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0 is DEAD
2025-10-02T08:12:04.144084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534211799185800:6995]
2025-10-02T08:12:04.144179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:04.144188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0] Write session will restart in 0.009753s
2025-10-02T08:12:04.144225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0] Write session: Do CDS request
2025-10-02T08:12:04.144233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:04.155315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.155489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:04.155507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1353
2025-10-02T08:12:04.155661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.155683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:04.155706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:04.155716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:04.155720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:04.156115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1353 sessionId:  describe result for acl check
2025-10-02T08:12:04.156146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:04.156156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:04.156157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:04.156162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534211799186139:5760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:04.156641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534211799186139:5760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:04.157275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:04.157436Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:04.157446Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:04.157455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:04.157499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:04.157536Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534211799186149:5758]
2025-10-02T08:12:04.158146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:04.158319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:04.158357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:04.158648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:04.158689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.158695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.158696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.158697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.158698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.158706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.158716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.158720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.158724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.158727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.158732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.158740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.158745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.158750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.158754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.158760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.158768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.158773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.158778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.158783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.158802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:04.158949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534211799186139:5760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:04.165023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534211799186139:5760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:04.165040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534211799186139:5760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:04.165044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534211799186139:5760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:04.165052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:04.167214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:04.168896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:04.168912Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:04.168914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:04.168919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:04.168926Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1352 [1:7556534211799186149:5758]
2025-10-02T08:12:04.168938Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:04.168955Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:04.168958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.168961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.168963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.168978Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:04.168987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:04.168994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:04.169057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.169065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.169067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:04.169070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:04.169136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:04.169143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.169156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.169174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:04.169196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534212259089752:2378], now have 1 active actors on pipe
2025-10-02T08:12:04.169207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534211799186132:5758]
2025-10-02T08:12:04.169218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534211799186132:5758]
2025-10-02T08:12:04.169224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:04.169237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799186186:5760], now have 1 active actors on pipe
2025-10-02T08:12:04.169240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1352
2025-10-02T08:12:04.169242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:04.169246Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:04.169248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:04.169264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:04.169270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:04.169277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.169280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.169293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1352
2025-10-02T08:12:04.169317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534211799186132:5758]
2025-10-02T08:12:04.169325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:04.169337Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:04.169338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:04.169343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.169347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.169349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:04.169356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.169364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:04.169458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.169560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.169573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.169595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.169637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1353 partition: 0 MaxSeqNo: 17 sessionId: src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0
2025-10-02T08:12:04.169999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd8742dd-89e3efd6-b8ebff5-d1c2ce54_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:04.172727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0] Write session: try to update token
2025-10-02T08:12:04.172742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:04.186595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId: src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:04.186823Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:04.186836Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:04.186838Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:04.186844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534211799186132:5758]
2025-10-02T08:12:04.186847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534211799186132:5758]
2025-10-02T08:12:04.186880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:04.186888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.186890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:04.186903Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:04.186909Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:04.187011Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:04.189188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:04.244325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534211799186215:6995]
2025-10-02T08:12:04.244440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1352, pipe: [1:7556534211799186215:6995]
2025-10-02T08:12:04.320145Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:04.320381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.320394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.320426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799186215:6995], now have 1 active actors on pipe
2025-10-02T08:12:04.320647Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:04.320733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534211799186215:6995]
2025-10-02T08:12:04.320741Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:04.320792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:04.320876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1353 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0
2025-10-02T08:12:04.321042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1353 sessionId: src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0 is DEAD
2025-10-02T08:12:04.321192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:04.321201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0] Write session will restart in 0.006522s
2025-10-02T08:12:04.321228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0] Write session: Do CDS request
2025-10-02T08:12:04.321235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:04.329284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.329286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:04.329299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1354
2025-10-02T08:12:04.329455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.329481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:04.329489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:04.329492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:04.329918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1354 sessionId:  describe result for acl check
2025-10-02T08:12:04.329947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:04.329948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:04.329949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:04.329953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534211799186525:5723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:04.330344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534211799186525:5723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:04.332348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534211799186525:5723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:04.332481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:04.334008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:04.334195Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:04.334204Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:04.334214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:04.334264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:04.334408Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534211799186612:5719]
2025-10-02T08:12:04.334931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:04.335165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:04.335202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:04.335360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534211799186525:5723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:04.335373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534211799186525:5723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:04.335377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534211799186525:5723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:04.335386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:04.335419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:04.335455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.335460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.335461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.335462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.335463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.335467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.335476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.335479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.335482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.335490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.335495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.335505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.335516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.335521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.335529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.335534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.335541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.335544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.335549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.335552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.335562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:04.347404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:04.348900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:04.348917Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:04.348920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:04.348924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:04.348931Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1353 [1:7556534211799186612:5719]
2025-10-02T08:12:04.348942Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:04.348959Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:04.348961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.348965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.348967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.348982Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:04.348993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:04.349005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:04.349074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.349085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.349088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:04.349090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:04.349158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:04.349166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.349179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.349195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:04.349215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534211799186596:5719]
2025-10-02T08:12:04.349221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534211799186596:5719]
2025-10-02T08:12:04.349230Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:04.349242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:04.349243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:04.349251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:04.349256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:04.349260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:04.349270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534212259089759:2378], now have 1 active actors on pipe
2025-10-02T08:12:04.349272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1353
2025-10-02T08:12:04.349280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799186624:5723], now have 1 active actors on pipe
2025-10-02T08:12:04.349310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.349317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.349330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534211799186596:5719]
2025-10-02T08:12:04.349336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:04.349312Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1353
2025-10-02T08:12:04.349359Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|274fb1e4-c237b89e-99375915-bba3dfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:04.349369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.349373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.349375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:04.349384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.349385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:04.349392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:04.349415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.349516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.349524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.349538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.349576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1354 partition: 0 MaxSeqNo: 17 sessionId: src_id|274fb1e4-c237b89e-99375915-bba3dfe_0
2025-10-02T08:12:04.349913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbaa0cd-342ab24a-dfe90dc2-63c69fa7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|274fb1e4-c237b89e-99375915-bba3dfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:04.352955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274fb1e4-c237b89e-99375915-bba3dfe_0] Write session: try to update token
2025-10-02T08:12:04.352976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274fb1e4-c237b89e-99375915-bba3dfe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:04.365372Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:04.365390Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:04.365400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534211799186596:5719]
2025-10-02T08:12:04.365448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:04.365452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:04.365638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:04.365793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:04.365945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:04.366090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:04.366295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:04.366339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:04.371166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId: src_id|274fb1e4-c237b89e-99375915-bba3dfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:04.373797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:04.373867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.373878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.373910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:04.373934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:04.373988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.374005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.374168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.374236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.374307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.374372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.374537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.374548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.374619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.374717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.374783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.374883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.375069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.375078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.375144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.375205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.375267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.375328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.375390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.375398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.375460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.375522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.375585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.375651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.375710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.375722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.375797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.375861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.375923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.375984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.376038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.376047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.376110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.376170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.376237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.376301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.376410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.376418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.376478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.376537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.376601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.376664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.376728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.376735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.376830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.376897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.376959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.377022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.377082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.377090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.377158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.377217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.377281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.377345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.377393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.377404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.377468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:04.377527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:04.377587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:04.377649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:04.377708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:04.377718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:04.377779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:04.377842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.377867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.377869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:04.377899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:04.377916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:04.377923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:04.377926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:04.377929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:04.378390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:04.378417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:04.378427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:04.378430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:04.378434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:04.378441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:04.379000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:04.379024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:04.379031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:04.379040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:04.379047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:04.379051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:04.379588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:04.379615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:04.379625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:04.379632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:04.379635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:04.382013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:04.382035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:04.382051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392724381
2025-10-02T08:12:04.382202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:04.382218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:04.382224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:04.382227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:04.382231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:04.382234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:04.382701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:04.382725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:04.382737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:04.382742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:04.382747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:04.382751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:04.383197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:04.383217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:04.383225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:04.383228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:04.383231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:04.383234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:04.383687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:04.383711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:04.383717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:04.384851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:04.384872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:04.384877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:04.384881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:04.384890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392724384
2025-10-02T08:12:04.385194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:04.385217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:04.385224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:04.385230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:04.385239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:04.385242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:04.385734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:04.385754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:04.385766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:04.385770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:04.385773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:04.385782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:04.386267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:04.386288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.386383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392724384
2025-10-02T08:12:04.388735Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:04.388763Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:04.388769Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:04.388776Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:04.388790Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:04.388818Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:04.388820Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:04.388826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534211799186596:5719]
2025-10-02T08:12:04.388833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534211799186596:5719]
2025-10-02T08:12:04.388882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:04.388895Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:04.388904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:04.388908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.388910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:04.389034Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:04.420958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534211799186652:6995]
2025-10-02T08:12:04.421113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1353, pipe: [1:7556534211799186652:6995]
2025-10-02T08:12:04.535898Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:04.536313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799186652:6995], now have 1 active actors on pipe
2025-10-02T08:12:04.536463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534211799186652:6995]
2025-10-02T08:12:04.536484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:04.536491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:04.536518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1354 reason: error at write: Disconnected sessionId: src_id|274fb1e4-c237b89e-99375915-bba3dfe_0
2025-10-02T08:12:04.536541Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:04.536863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274fb1e4-c237b89e-99375915-bba3dfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:04.536697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1354 sessionId: src_id|274fb1e4-c237b89e-99375915-bba3dfe_0 is DEAD
2025-10-02T08:12:04.536882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274fb1e4-c237b89e-99375915-bba3dfe_0] Write session will restart in 0.005275s
2025-10-02T08:12:04.536920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274fb1e4-c237b89e-99375915-bba3dfe_0] Write session: Do CDS request
2025-10-02T08:12:04.536927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274fb1e4-c237b89e-99375915-bba3dfe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:04.537008Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:04.540919Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [ec16348cecadc114] Result# TEvPutResult {Id# [72075186224037892:1353:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:04.540924Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1353:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:04.540983Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1353:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:04.543346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|274fb1e4-c237b89e-99375915-bba3dfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.543420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:04.543432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1355
2025-10-02T08:12:04.543584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.543606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:04.543614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:04.543616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:04.543943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1355 sessionId:  describe result for acl check
2025-10-02T08:12:04.543971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:04.543972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:04.543973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:04.543977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534211799186745:5704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:04.544387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534211799186745:5704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:04.547421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534211799186745:5704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:04.550894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534211799186745:5704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:04.550912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534211799186745:5704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:04.550930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534211799186745:5704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:04.550938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:04.551764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:04.553069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:04.553247Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:04.553258Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:04.553269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:04.553321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:04.553358Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534211799187041:5687]
2025-10-02T08:12:04.553921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:04.554141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:04.554190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:04.554485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:04.554616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.554622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.554623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.554625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.554626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.554631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.554642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.554650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.554654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.554657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.554663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.554674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.554684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.554692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.554697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.554706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.554714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.554718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.554727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.554736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.554757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:04.565575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:04.567403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:04.567419Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:04.567422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:04.567426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:04.567432Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1354 [1:7556534211799187041:5687]
2025-10-02T08:12:04.567444Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:04.567459Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:04.567462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.567465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.567467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.567484Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:04.567491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:04.567502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:04.567566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.567575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.567577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:04.567580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:04.567641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:04.567647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.567660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.567672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:04.567691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1354
2025-10-02T08:12:04.567694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799187023:5704], now have 1 active actors on pipe
2025-10-02T08:12:04.567699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534211799187035:5687]
2025-10-02T08:12:04.567702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534211799187035:5687]
2025-10-02T08:12:04.567715Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:04.567728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534212259089788:2378], now have 1 active actors on pipe
2025-10-02T08:12:04.567732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.567736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:04.567739Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:04.567741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.567760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:04.567778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:04.567785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:04.567802Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1354
2025-10-02T08:12:04.567826Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11081e79-e47be0a3-f4055606-8e153ef1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:04.567837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.567840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.567842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:04.567851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.567859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:04.567866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534211799187035:5687]
2025-10-02T08:12:04.567875Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:04.567881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:04.567896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.567962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.567969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.567982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.568020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1355 partition: 0 MaxSeqNo: 17 sessionId: src_id|11081e79-e47be0a3-f4055606-8e153ef1_0
2025-10-02T08:12:04.568358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|274fb1e4-c237b89e-99375915-bba3dfe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|11081e79-e47be0a3-f4055606-8e153ef1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:04.571268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11081e79-e47be0a3-f4055606-8e153ef1_0] Write session: try to update token
2025-10-02T08:12:04.571289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11081e79-e47be0a3-f4055606-8e153ef1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:04.585112Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:04.585129Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:04.585132Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:04.585140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534211799187035:5687]
2025-10-02T08:12:04.585144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534211799187035:5687]
2025-10-02T08:12:04.585185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:04.585196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.585198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:04.585197Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:04.585203Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:04.585347Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:04.586570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId: src_id|11081e79-e47be0a3-f4055606-8e153ef1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:04.589010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:04.636519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534211799187067:6995]
2025-10-02T08:12:04.636657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1354, pipe: [1:7556534211799187067:6995]
2025-10-02T08:12:04.717442Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:04.717709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.717722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.717760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799187067:6995], now have 1 active actors on pipe
2025-10-02T08:12:04.717882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534211799187067:6995]
2025-10-02T08:12:04.717901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:04.717907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:04.717982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1355 reason: error at write: Disconnected sessionId: src_id|11081e79-e47be0a3-f4055606-8e153ef1_0
2025-10-02T08:12:04.718036Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:04.718139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1355 sessionId: src_id|11081e79-e47be0a3-f4055606-8e153ef1_0 is DEAD
2025-10-02T08:12:04.718320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11081e79-e47be0a3-f4055606-8e153ef1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:04.718331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11081e79-e47be0a3-f4055606-8e153ef1_0] Write session will restart in 0.008924s
2025-10-02T08:12:04.718359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11081e79-e47be0a3-f4055606-8e153ef1_0] Write session: Do CDS request
2025-10-02T08:12:04.718369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11081e79-e47be0a3-f4055606-8e153ef1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:04.718652Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:04.728268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:04.728428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11081e79-e47be0a3-f4055606-8e153ef1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.728505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:04.728512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1356
2025-10-02T08:12:04.728671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.728699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:04.728707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:04.728710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:04.729127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1356 sessionId:  describe result for acl check
2025-10-02T08:12:04.729161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:04.729170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:04.729172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:04.729177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534211799187413:5692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:04.729606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534211799187413:5692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:04.729717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:04.729881Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:04.729891Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:04.729903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:04.729949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:04.730040Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534211799187422:5699]
2025-10-02T08:12:04.730607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:04.730772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:04.730810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:04.731034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:04.731069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.731070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.731070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.731071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.731071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.731075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.731081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.731083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.731085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.731087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.731090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.731095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.731098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.731101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.731103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.731106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.731109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.731111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.731114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.731116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.731127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:04.731299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534211799187413:5692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:04.736966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534211799187413:5692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:04.736983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534211799187413:5692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:04.736986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534211799187413:5692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:04.736995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:04.738803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:04.740252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:04.740267Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:04.740269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:04.740273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:04.740280Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1355 [1:7556534211799187422:5699]
2025-10-02T08:12:04.740291Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:04.740307Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:04.740314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.740316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.740319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.740336Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:04.740344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:04.740353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:04.740410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.740417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.740420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:04.740423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:04.740482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:04.740487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.740498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.740513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:04.740526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1355
2025-10-02T08:12:04.740535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799187464:5692], now have 1 active actors on pipe
2025-10-02T08:12:04.740538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534212259089797:2378], now have 1 active actors on pipe
2025-10-02T08:12:04.740544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534211799187407:5699]
2025-10-02T08:12:04.740545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534211799187407:5699]
2025-10-02T08:12:04.740557Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:04.740569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.740569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:04.740572Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:04.740577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.740595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:04.740612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:04.740617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:04.740616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1355
2025-10-02T08:12:04.740655Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:04.740664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.740673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.740675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:04.740684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.740696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:04.740705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534211799187407:5699]
2025-10-02T08:12:04.740716Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:04.740730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:04.740748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.740869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.740881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.740894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.740928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1356 partition: 0 MaxSeqNo: 17 sessionId: src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0
2025-10-02T08:12:04.741283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11081e79-e47be0a3-f4055606-8e153ef1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:04.744334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0] Write session: try to update token
2025-10-02T08:12:04.744352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:04.757821Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:04.757839Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:04.757841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:04.757848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534211799187407:5699]
2025-10-02T08:12:04.757852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534211799187407:5699]
2025-10-02T08:12:04.757891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:04.757895Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:04.757901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:04.757902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.757903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:04.758089Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:04.760578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId: src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:04.763154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:04.818263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534211799187477:6995]
2025-10-02T08:12:04.818421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1355, pipe: [1:7556534211799187477:6995]
2025-10-02T08:12:04.898112Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:04.898513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.898526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.898560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799187477:6995], now have 1 active actors on pipe
2025-10-02T08:12:04.898659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534211799187477:6995]
2025-10-02T08:12:04.898681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:04.898683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:04.898749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1356 reason: error at write: Disconnected sessionId: src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0
2025-10-02T08:12:04.898804Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:04.898940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1356 sessionId: src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0 is DEAD
2025-10-02T08:12:04.899033Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:04.899124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:04.899136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0] Write session will restart in 0.007611s
2025-10-02T08:12:04.899164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0] Write session: Do CDS request
2025-10-02T08:12:04.899171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:04.908356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.908424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:04.908440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1357
2025-10-02T08:12:04.908610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:04.908633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:04.908637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:04.908640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:04.909233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1357 sessionId:  describe result for acl check
2025-10-02T08:12:04.909262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:04.909264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:04.909265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:04.909270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534211799187800:5683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:04.909769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534211799187800:5683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:04.911334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:04.911989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534211799187800:5683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:04.912708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:04.912870Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:04.912873Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:04.912883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:04.912922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:04.912963Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534211799187854:5680]
2025-10-02T08:12:04.913532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:04.913719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:04.913754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:04.914021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:04.914058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.914063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.914064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.914065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.914066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.914069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.914078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.914081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.914085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.914087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.914092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.914098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:04.914108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.914113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:04.914116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.914121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:04.914124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.914128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.914132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.914136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.914152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:04.914863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534211799187800:5683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:04.914877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534211799187800:5683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:04.914879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534211799187800:5683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:04.914887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:04.922153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:04.923933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:04.923954Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:04.923957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:04.923961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:04.923968Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1356 [1:7556534211799187854:5680]
2025-10-02T08:12:04.923980Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:04.923998Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:04.924000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.924003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.924005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.924021Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:04.924044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:04.924056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:04.924122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.924130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.924133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:04.924136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:04.924202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:04.924209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.924222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:04.924235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:04.924258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799187871:5683], now have 1 active actors on pipe
2025-10-02T08:12:04.924261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1356
2025-10-02T08:12:04.924268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534211799187836:5680]
2025-10-02T08:12:04.924270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534211799187836:5680]
2025-10-02T08:12:04.924282Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:04.924295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534212259089804:2378], now have 1 active actors on pipe
2025-10-02T08:12:04.924296Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:04.924299Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:04.924306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.924311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.924325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:04.924342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:04.924350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:04.924350Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1356
2025-10-02T08:12:04.924392Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:04.924402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:04.924405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:04.924407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:04.924415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:04.924422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:04.924430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534211799187836:5680]
2025-10-02T08:12:04.924441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:04.924457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:04.924475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.924554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:04.924562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:04.924577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:04.924615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1357 partition: 0 MaxSeqNo: 17 sessionId: src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0
2025-10-02T08:12:04.924972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799a0bcc-8631c8dd-f1d0749f-a97391f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:04.928046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0] Write session: try to update token
2025-10-02T08:12:04.928063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:04.944944Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:04.944965Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:04.944967Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:04.944977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534211799187836:5680]
2025-10-02T08:12:04.944982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534211799187836:5680]
2025-10-02T08:12:04.945029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:04.945036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:04.945039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:04.945058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId: src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:04.945193Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:04.946759Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:04.946765Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:04.948073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:04.980254Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:12:04.998995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534211799187884:6995]
2025-10-02T08:12:04.999120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1356, pipe: [1:7556534211799187884:6995]
2025-10-02T08:12:05.079747Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:05.080007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.080025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.080077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534211799187884:6995], now have 1 active actors on pipe
2025-10-02T08:12:05.080189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:05.080203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:05.080234Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:05.080273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1357 reason: error at write: Disconnected sessionId: src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0
2025-10-02T08:12:05.080378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:05.080437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1357 sessionId: src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0 is DEAD
2025-10-02T08:12:05.080477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534211799187884:6995]
2025-10-02T08:12:05.080538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:05.080547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0] Write session will restart in 0.009717s
2025-10-02T08:12:05.080573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0] Write session: Do CDS request
2025-10-02T08:12:05.080578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:05.091334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.091458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:05.091474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1358
2025-10-02T08:12:05.091635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.091666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:05.091675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:05.091679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:05.091895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:05.092068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1358 sessionId:  describe result for acl check
2025-10-02T08:12:05.092102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:05.092113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:05.092117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:05.092131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534216094155529:5667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:05.092626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534216094155529:5667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:05.093524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:05.093706Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:05.093716Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:05.093725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:05.093770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:05.093804Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534216094155545:5676]
2025-10-02T08:12:05.094385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:05.094541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:05.094583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:05.094704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534216094155529:5667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:05.094870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:05.094917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.094918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.094919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.094920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.094921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.094925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.094934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.094938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.094941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.094945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.094949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.094956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.094961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.094966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.094970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.094974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.094979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.094984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.094988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.094993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.095013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:05.100870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534216094155529:5667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:05.100888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534216094155529:5667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:05.100891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534216094155529:5667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:05.100900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:05.102680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:05.104476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:05.104492Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:05.104495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:05.104497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:05.104503Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1357 [1:7556534216094155545:5676]
2025-10-02T08:12:05.104517Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:05.104532Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:05.104536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.104539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.104540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.104556Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:05.104560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:05.104566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:05.104624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.104632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.104635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:05.104637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:05.104694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:05.104701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.104714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.104723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:05.104740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094155576:5667], now have 1 active actors on pipe
2025-10-02T08:12:05.104747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534216554057121:2378], now have 1 active actors on pipe
2025-10-02T08:12:05.104750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1357
2025-10-02T08:12:05.104752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534216094155523:5676]
2025-10-02T08:12:05.104754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534216094155523:5676]
2025-10-02T08:12:05.104761Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:05.104772Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:05.104773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:05.104774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:05.104784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:05.104786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:05.104793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.104798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.104855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534216094155523:5676]
2025-10-02T08:12:05.104857Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1357
2025-10-02T08:12:05.104866Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:05.104875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:05.104880Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:05.104886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.104889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.104890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:05.104905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.104914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:05.104954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.105031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.105038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.105051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.105086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1358 partition: 0 MaxSeqNo: 17 sessionId: src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0
2025-10-02T08:12:05.105530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90539b59-6bb170eb-2b70c029-adebe9b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:05.108843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0] Write session: try to update token
2025-10-02T08:12:05.108867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:05.124666Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:05.124685Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:05.124687Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:05.124697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534216094155523:5676]
2025-10-02T08:12:05.124701Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534216094155523:5676]
2025-10-02T08:12:05.124740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:05.124744Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:05.124746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.124748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:05.124749Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:05.124895Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:05.125489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId: src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:05.128302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:05.180770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534216094155591:6995]
2025-10-02T08:12:05.181626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1357, pipe: [1:7556534216094155591:6995]
2025-10-02T08:12:05.261095Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:05.261461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.261474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.261511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094155591:6995], now have 1 active actors on pipe
2025-10-02T08:12:05.261761Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:05.261814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:05.261895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1358 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0
2025-10-02T08:12:05.262082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1358 sessionId: src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0 is DEAD
2025-10-02T08:12:05.262214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:05.262227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0] Write session will restart in 0.007865s
2025-10-02T08:12:05.262251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0] Write session: Do CDS request
2025-10-02T08:12:05.262256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:05.262272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534216094155591:6995]
2025-10-02T08:12:05.262386Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:05.271483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.271616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:05.271637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1359
2025-10-02T08:12:05.271880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.271943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:05.271956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:05.271963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:05.272605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1359 sessionId:  describe result for acl check
2025-10-02T08:12:05.272650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:05.272661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:05.272663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:05.272669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534216094155885:5645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:05.273655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534216094155885:5645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:05.276649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:05.276729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534216094155885:5645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:05.278791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:05.279053Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:05.279069Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:05.279082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:05.279149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:05.279203Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534216094155984:5657]
2025-10-02T08:12:05.280077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:05.280384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:05.280425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534216094155885:5645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:05.280433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534216094155885:5645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:05.280437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534216094155885:5645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:05.280447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:05.280450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:05.280876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:05.280944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.280953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.280954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.280955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.280957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.280964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.280977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.280982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.280986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.280991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.280998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.281009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.281016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.281022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.281029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.281042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.281047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.281053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.281060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.281072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.281096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:05.289848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:05.292596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:05.292618Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:05.292620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:05.292625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:05.292656Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1358 [1:7556534216094155984:5657]
2025-10-02T08:12:05.292673Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:05.292696Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:05.292707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.292711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.292714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.292738Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:05.292746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:05.292754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:05.292853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.292862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.292866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:05.292870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:05.292973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:05.292981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.292997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.293010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:05.293239Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1358
2025-10-02T08:12:05.293040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534216094155968:5657]
2025-10-02T08:12:05.293048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534216094155968:5657]
2025-10-02T08:12:05.293059Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:05.293075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094155995:5645], now have 1 active actors on pipe
2025-10-02T08:12:05.293086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:05.293091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:05.293097Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:05.293102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:05.293106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:05.293149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534216554057128:2378], now have 1 active actors on pipe
2025-10-02T08:12:05.293152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534216094155968:5657]
2025-10-02T08:12:05.293165Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:05.293176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:05.293218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1358
2025-10-02T08:12:05.293246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.293251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.293281Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:05.293290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.293296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.293298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:05.293312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.293326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:05.293348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.293392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.293395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.293410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.293444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1359 partition: 0 MaxSeqNo: 17 sessionId: src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0
2025-10-02T08:12:05.293985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf9d06-7da7f0dc-6b5fb176-47677a0a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:05.298029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0] Write session: try to update token
2025-10-02T08:12:05.298049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:05.312378Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:05.312400Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:05.312407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:05.312416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534216094155968:5657]
2025-10-02T08:12:05.312420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534216094155968:5657]
2025-10-02T08:12:05.312466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:05.312483Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:05.312488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.312490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:05.312491Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:05.312660Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:05.317739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId: src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:05.320500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:05.363079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534216094156027:6995]
2025-10-02T08:12:05.363261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1358, pipe: [1:7556534216094156027:6995]
2025-10-02T08:12:05.448056Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:05.448460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.448477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.448500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094156027:6995], now have 1 active actors on pipe
2025-10-02T08:12:05.448568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534216094156027:6995]
2025-10-02T08:12:05.448590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:05.448597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:05.448653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1359 reason: error at write: Disconnected sessionId: src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0
2025-10-02T08:12:05.448691Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:05.448695Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:05.448853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1359 sessionId: src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0 is DEAD
2025-10-02T08:12:05.449030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:05.449042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0] Write session will restart in 0.009325s
2025-10-02T08:12:05.449077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0] Write session: Do CDS request
2025-10-02T08:12:05.449084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:05.459411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.459456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:05.459475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1360
2025-10-02T08:12:05.459663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.459695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:05.459706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:05.459710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:05.460262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1360 sessionId:  describe result for acl check
2025-10-02T08:12:05.460311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:05.460320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:05.460321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:05.460327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534216094156343:5600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:05.460887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534216094156343:5600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:05.464631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:05.465349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534216094156343:5600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:05.466410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:05.466633Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:05.466647Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:05.466659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:05.466710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:05.466754Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534216094156433:5597]
2025-10-02T08:12:05.467327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:05.467573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:05.467616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:05.467941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:05.467988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.467993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.467994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.467995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.467996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.468000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.468007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.468009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.468011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.468014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.468018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.468023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.468028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.468041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.468044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.468047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.468050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.468053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.468059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.468061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.468074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:05.468326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534216094156343:5600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:05.468344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534216094156343:5600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:05.468348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534216094156343:5600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:05.468355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:05.476352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:05.478155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:05.478173Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:05.478176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:05.478181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:05.478189Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1359 [1:7556534216094156433:5597]
2025-10-02T08:12:05.478203Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:05.478220Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:05.478223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.478226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.478227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.478242Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:05.478247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:05.478254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:05.478315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.478322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.478325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:05.478327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:05.478399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:05.478407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.478421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.478437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:05.478459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094156449:5600], now have 1 active actors on pipe
2025-10-02T08:12:05.478463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1359
2025-10-02T08:12:05.478472Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534216094156417:5597]
2025-10-02T08:12:05.478474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534216094156417:5597]
2025-10-02T08:12:05.478483Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:05.478494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:05.478496Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:05.478501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:05.478514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:05.478521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:05.478529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.478538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.478551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534216554057156:2378], now have 1 active actors on pipe
2025-10-02T08:12:05.478588Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534216094156417:5597]
2025-10-02T08:12:05.478598Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:05.478610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:05.478618Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:05.478625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.478630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.478632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:05.478595Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1359
2025-10-02T08:12:05.478643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.478656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:05.478706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.478760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.478766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.478779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.478823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1360 partition: 0 MaxSeqNo: 17 sessionId: src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0
2025-10-02T08:12:05.479242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ed705a-c29f8b39-14889de1-7dc452e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:05.482428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0] Write session: try to update token
2025-10-02T08:12:05.482448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:05.495845Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:05.495865Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:05.495868Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:05.495878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534216094156417:5597]
2025-10-02T08:12:05.495888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534216094156417:5597]
2025-10-02T08:12:05.495930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:05.495936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.495938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:05.495943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:05.495949Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:05.496112Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:05.500080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId: src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:05.502579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:05.548886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534216094156468:6995]
2025-10-02T08:12:05.549013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1359, pipe: [1:7556534216094156468:6995]
2025-10-02T08:12:05.630671Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:05.631070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.631084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.631131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094156468:6995], now have 1 active actors on pipe
2025-10-02T08:12:05.631309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534216094156468:6995]
2025-10-02T08:12:05.631346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:05.631348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:05.631348Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:05.631418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1360 reason: error at write: Disconnected sessionId: src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0
2025-10-02T08:12:05.631459Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:05.631601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1360 sessionId: src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0 is DEAD
2025-10-02T08:12:05.631779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:05.631803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0] Write session will restart in 0.008862s
2025-10-02T08:12:05.631830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0] Write session: Do CDS request
2025-10-02T08:12:05.631837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:05.642401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.642454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:05.642474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1361
2025-10-02T08:12:05.642631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.642665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:05.642672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:05.642682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:05.643136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1361 sessionId:  describe result for acl check
2025-10-02T08:12:05.643169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:05.643174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:05.643175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:05.643180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534216094156807:5593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:05.643691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534216094156807:5593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:05.645236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:05.646078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534216094156807:5593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:05.647214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:05.647466Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:05.647478Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:05.647489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:05.647540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:05.647585Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534216094156853:5595]
2025-10-02T08:12:05.648274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:05.648555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:05.648595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:05.649035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:05.649093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.649098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.649098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.649100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.649100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.649117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.649124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.649126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.649129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.649131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.649136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.649141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.649146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.649149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.649152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.649155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.649157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.649160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.649161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534216094156807:5593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:05.649163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.649166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.649167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534216094156807:5593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:05.649170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534216094156807:5593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:05.649177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:05.649179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:05.658205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:05.659977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:05.659996Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:05.659999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:05.660004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:05.660011Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1360 [1:7556534216094156853:5595]
2025-10-02T08:12:05.660026Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:05.660059Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:05.660063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.660066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.660069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.660087Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:05.660093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:05.660101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:05.660175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.660184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.660188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:05.660191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:05.660270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:05.660279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.660293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.660308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:05.660322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1360
2025-10-02T08:12:05.660336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094156867:5593], now have 1 active actors on pipe
2025-10-02T08:12:05.660344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534216094156835:5595]
2025-10-02T08:12:05.660346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534216094156835:5595]
2025-10-02T08:12:05.660358Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:05.660372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534216554057164:2378], now have 1 active actors on pipe
2025-10-02T08:12:05.660377Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:05.660381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:05.660385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.660389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.660408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:05.660425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:05.660433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:05.660484Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:05.660495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.660499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.660502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:05.660478Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1360
2025-10-02T08:12:05.660513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.660527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:05.660534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534216094156835:5595]
2025-10-02T08:12:05.660542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:05.660548Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:05.660576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.660673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.660684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.660699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.660753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1361 partition: 0 MaxSeqNo: 17 sessionId: src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0
2025-10-02T08:12:05.661180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda703f6-4ddeb536-7766c18e-fd34e2a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:05.664591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0] Write session: try to update token
2025-10-02T08:12:05.664609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:05.672044Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:05.672062Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:05.672089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534216094156835:5595]
2025-10-02T08:12:05.672142Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:05.672147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:05.672348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:05.672553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:05.672723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:05.672914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:05.673179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:05.673230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:05.682703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId: src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:05.685803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:05.685901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.685912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.685956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:05.685988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:05.686104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.686107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.686312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.686399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.686487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.686576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.686638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.686655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.686944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.687025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.687103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.687185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.687246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.687254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.687407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.687574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.687818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.687909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.687965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.687974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.688067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.688294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.688520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.688598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.688719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.688728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.688829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.688937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.689014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.689089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.689148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.689156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.689241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.689323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.689400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.689477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.689557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.689566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.689654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.689725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.689802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.689883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.689963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.689972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.690063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.690143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.690225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.690307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.690374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.690387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.690518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.690598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.690683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.690765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.690826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.690836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.690919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.690997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.691074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.691160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.691222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.691229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.691306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:05.691394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.691421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.691428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:05.691473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:05.691492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:05.691500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:05.691504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:05.691507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:05.691937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:05.691966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:05.691971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:05.691974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:05.691976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:05.691978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:05.692709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:05.692741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:05.692750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:05.692758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:05.692762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:05.692766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:05.693540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:05.693563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:05.693568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:05.693571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:05.693573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:05.696059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:05.696079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:05.696092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392725695
2025-10-02T08:12:05.696228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:05.696244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:05.696251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:05.696255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:05.696261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:05.696264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:05.696833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:05.696858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:05.696863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:05.696866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:05.696869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:05.696873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:05.697412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:05.697436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:05.697446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:05.697449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:05.697452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:05.697455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:05.697990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:05.698017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:05.698022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:05.699211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:05.699232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:05.699236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:05.699239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:05.699248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392725698
2025-10-02T08:12:05.699578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:05.699606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:05.699613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:05.699616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:05.699620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:05.699627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:05.700258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:05.700284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:05.700289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:05.700292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:05.700295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:05.700298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:05.700860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:05.700890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.701002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392725700
2025-10-02T08:12:05.703744Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:05.703775Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:05.703781Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:05.703787Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:05.703799Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:05.703801Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:05.703803Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:05.703811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534216094156835:5595]
2025-10-02T08:12:05.703815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534216094156835:5595]
2025-10-02T08:12:05.703901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:05.703914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.703917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:05.704010Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:05.704028Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:05.704079Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:05.731638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534216094156889:6995]
2025-10-02T08:12:05.731737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1360, pipe: [1:7556534216094156889:6995]
2025-10-02T08:12:05.840778Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:05.841381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094156889:6995], now have 1 active actors on pipe
2025-10-02T08:12:05.841521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:05.841529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:05.841558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1361 reason: error at write: Disconnected sessionId: src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0
2025-10-02T08:12:05.841710Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:05.841756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1361 sessionId: src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0 is DEAD
2025-10-02T08:12:05.841753Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:05.841919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:05.841930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0] Write session will restart in 0.006549s
2025-10-02T08:12:05.841951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0] Write session: Do CDS request
2025-10-02T08:12:05.841956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:05.841964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534216094156889:6995]
2025-10-02T08:12:05.846587Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [10ce3542744f91fd] Result# TEvPutResult {Id# [72075186224037892:1360:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:05.846627Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1360:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:05.846869Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1360:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:05.849488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.849558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:05.849582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1362
2025-10-02T08:12:05.849707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:05.849736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:05.849744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:05.849748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:05.850368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1362 sessionId:  describe result for acl check
2025-10-02T08:12:05.850408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:05.850412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:05.850414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:05.850419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534216094157031:5578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:05.850942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534216094157031:5578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:05.854153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534216094157031:5578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:05.857510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534216094157031:5578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:05.857527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534216094157031:5578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:05.857531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534216094157031:5578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:05.857539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:05.858244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:05.859756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:05.859934Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:05.859946Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:05.859954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:05.859998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:05.860051Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534216094157286:5577]
2025-10-02T08:12:05.860668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:05.860859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:05.860902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:05.861194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:05.861232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.861237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.861239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.861240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.861241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.861246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.861256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.861260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.861265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.861269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.861274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.861282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:05.861292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.861297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:05.861301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.861306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:05.861311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.861321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.861326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.861336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.861355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:05.872950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:05.874721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:05.874740Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:05.874743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:05.874747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:05.874753Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1361 [1:7556534216094157286:5577]
2025-10-02T08:12:05.874766Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:05.874784Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:05.874787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.874790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.874792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.874809Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:05.874813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:05.874820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:05.874890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.874900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.874904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:05.874906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:05.874977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:05.874985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.874999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:05.875016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:05.875021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1361
2025-10-02T08:12:05.875040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094157268:5578], now have 1 active actors on pipe
2025-10-02T08:12:05.875051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.875055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.875068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534216554057170:2378], now have 1 active actors on pipe
2025-10-02T08:12:05.875079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534216094157280:5577]
2025-10-02T08:12:05.875082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534216094157280:5577]
2025-10-02T08:12:05.875093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:05.875111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:05.875117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:05.875120Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:05.875130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:05.875133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:05.875150Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:05.875160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.875164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.875166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:05.875175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.875185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:05.875167Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1361
2025-10-02T08:12:05.875226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534216094157280:5577]
2025-10-02T08:12:05.875234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:05.875242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:05.875246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.875298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.875311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.875333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:05.875383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1362 partition: 0 MaxSeqNo: 17 sessionId: src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0
2025-10-02T08:12:05.875753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d10c3ae-87cdf972-498e0a7e-91e24a0b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:05.879004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0] Write session: try to update token
2025-10-02T08:12:05.879026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:05.887239Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:05.887260Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:05.887271Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534216094157280:5577]
2025-10-02T08:12:05.887311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:05.887334Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:05.887487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:05.887632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:05.887780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:05.887922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:05.888139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:05.888178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:05.896772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId: src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:05.899175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:05.899261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.899275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.899302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:05.899326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:05.899369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:05.899380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:05.899539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.899598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.899660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.899725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.899770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.899779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.899843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.899926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.899985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.900059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.900101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.900110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.900172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.900270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.900332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.900392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.900439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.900447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.900511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.900574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.900638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.900722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.900765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.900772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.900849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.900911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.900974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.901040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.901103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.901111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.901170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.901234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.901297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.901361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.901417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.901425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.901490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.901553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.901612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.901669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.901714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.901719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.901779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.901833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.901889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.901946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.901985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.901990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.902049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.902104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.902161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.902221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.902263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.902270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.902343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:05.902406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:05.902470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:05.902538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:05.902583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:05.902592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:05.902651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:05.902710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:05.902731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:05.902736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:05.902762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:05.902778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:05.902785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:05.902788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:05.902790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:05.903149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:05.903173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:05.903177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:05.903179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:05.903181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:05.903182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:05.903827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:05.903848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:05.903858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:05.903862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:05.903870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:05.903873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:05.904375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:05.904400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:05.904410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:05.904418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:05.904420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:05.905549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:05.905566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:05.905575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392725905
2025-10-02T08:12:05.905718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:05.905728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:05.905731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:05.905734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:05.905736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:05.905738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:05.906158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:05.906172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:05.906177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:05.906179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:05.906182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:05.906184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:05.906620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:05.906636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:05.906642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:05.906644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:05.906646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:05.906648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:05.907062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:05.907077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:05.907080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:05.908050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:05.908063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:05.908069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:05.908072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:05.908078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392725907
2025-10-02T08:12:05.908313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:05.908326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:05.908331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:05.908334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:05.908336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:05.908340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:05.908744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:05.908762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:05.908766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:05.908768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:05.908771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:05.908773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:05.909196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:05.909213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:05.909286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392725909
2025-10-02T08:12:05.911322Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:05.911350Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:05.911357Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:05.911363Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:05.911374Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:05.911381Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:05.911382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:05.911389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534216094157280:5577]
2025-10-02T08:12:05.911395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534216094157280:5577]
2025-10-02T08:12:05.911438Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:05.911448Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:05.911450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:05.911454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:05.911455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:05.911571Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:05.942066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534216094157313:6995]
2025-10-02T08:12:05.942180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1361, pipe: [1:7556534216094157313:6995]
2025-10-02T08:12:06.046828Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:06.047240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534216094157313:6995], now have 1 active actors on pipe
2025-10-02T08:12:06.047382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:06.047394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:06.047425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1362 reason: error at write: Disconnected sessionId: src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0
2025-10-02T08:12:06.047461Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:06.047530Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:06.047602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1362 sessionId: src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0 is DEAD
2025-10-02T08:12:06.047791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:06.047799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0] Write session will restart in 0.008108s
2025-10-02T08:12:06.047773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534216094157313:6995]
2025-10-02T08:12:06.047817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0] Write session: Do CDS request
2025-10-02T08:12:06.047822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:06.050282Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6026e05c85254c9a] Result# TEvPutResult {Id# [72075186224037892:1361:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:06.050296Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1361:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:06.050352Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1361:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:06.057243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.057346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:06.057361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1363
2025-10-02T08:12:06.057504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.057528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:06.057535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:06.057538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:06.057900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1363 sessionId:  describe result for acl check
2025-10-02T08:12:06.057920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:06.057924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:06.057925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:06.057929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534220389124916:5566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:06.058266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534220389124916:5566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:06.060072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534220389124916:5566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:06.060092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:06.061565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:06.061699Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:06.061706Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:06.061712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:06.061753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:06.061779Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534220389125000:5569]
2025-10-02T08:12:06.062154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:06.062276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:06.062301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:06.062482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:06.062508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.062512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.062513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.062514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.062515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.062518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.062524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.062526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.062527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.062529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.062532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.062537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.062540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.062542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.062545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.062548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.062550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.062552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.062555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.062558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.062568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:06.062732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534220389124916:5566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:06.062746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534220389124916:5566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:06.062749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534220389124916:5566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:06.062756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:06.070089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:06.071581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:06.071593Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:06.071595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:06.071597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:06.071602Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1362 [1:7556534220389125000:5569]
2025-10-02T08:12:06.071610Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:06.071623Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:06.071625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.071627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.071628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.071640Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:06.071643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:06.071648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:06.071690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.071696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.071699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:06.071701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:06.071745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:06.071750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.071757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.071763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:06.071775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534220389124984:5569]
2025-10-02T08:12:06.071780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534220389124984:5569]
2025-10-02T08:12:06.071786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:06.071795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389125017:5566], now have 1 active actors on pipe
2025-10-02T08:12:06.071794Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:06.071797Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:06.071803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:06.071811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:06.071812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:06.071816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534220849024475:2378], now have 1 active actors on pipe
2025-10-02T08:12:06.071833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1362
2025-10-02T08:12:06.071840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534220389124984:5569]
2025-10-02T08:12:06.071846Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:06.071849Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:06.071851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.071855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.071899Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:06.071910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.071914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.071915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:06.071923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.071930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:06.071945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.071899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1362
2025-10-02T08:12:06.071988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.071993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.072003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.072041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1363 partition: 0 MaxSeqNo: 17 sessionId: src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0
2025-10-02T08:12:06.072342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a24bca-424a8d4d-aa53c1e2-4e9f7bdc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:06.074945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0] Write session: try to update token
2025-10-02T08:12:06.074959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:06.087537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId: src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:06.088724Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:06.088737Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:06.088739Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:06.088745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534220389124984:5569]
2025-10-02T08:12:06.088748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534220389124984:5569]
2025-10-02T08:12:06.088779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:06.088782Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:06.088784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.088785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:06.088786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:06.088923Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:06.090211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:06.147930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534220389125032:6995]
2025-10-02T08:12:06.148031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1362, pipe: [1:7556534220389125032:6995]
2025-10-02T08:12:06.222214Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:06.222578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.222589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.222622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389125032:6995], now have 1 active actors on pipe
2025-10-02T08:12:06.222774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534220389125032:6995]
2025-10-02T08:12:06.222794Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:06.222801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:06.222803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:06.222854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1363 reason: error at write: Disconnected sessionId: src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0
2025-10-02T08:12:06.222876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:06.223009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1363 sessionId: src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0 is DEAD
2025-10-02T08:12:06.223201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:06.223214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0] Write session will restart in 0.006207s
2025-10-02T08:12:06.223237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0] Write session: Do CDS request
2025-10-02T08:12:06.223242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:06.230300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.230366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:06.230380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1364
2025-10-02T08:12:06.230526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.230555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:06.230564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:06.230567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:06.231024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1364 sessionId:  describe result for acl check
2025-10-02T08:12:06.231058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:06.231064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:06.231065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:06.231071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534220389125329:5532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:06.231573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534220389125329:5532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:06.233929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534220389125329:5532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:06.234462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:06.235716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:06.235877Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:06.235887Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:06.235896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:06.235940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:06.235975Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534220389125437:5537]
2025-10-02T08:12:06.236046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534220389125329:5532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:06.236056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534220389125329:5532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:06.236058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534220389125329:5532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:06.236065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:06.236518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:06.236695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:06.236735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:06.237032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:06.237082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.237088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.237089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.237090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.237091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.237096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.237105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.237109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.237113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.237117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.237122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.237129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.237139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.237148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.237156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.237164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.237172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.237180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.237188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.237194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.237213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:06.245403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:06.246754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:06.246771Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:06.246773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:06.246777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:06.246782Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1363 [1:7556534220389125437:5537]
2025-10-02T08:12:06.246791Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:06.246807Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:06.246808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.246811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.246813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.246826Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:06.246833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:06.246839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:06.246889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.246895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.246897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:06.246899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:06.246949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:06.246955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.246964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.246974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:06.246990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534220389125424:5537]
2025-10-02T08:12:06.246996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534220389125424:5537]
2025-10-02T08:12:06.247003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:06.247013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389125442:5532], now have 1 active actors on pipe
2025-10-02T08:12:06.247014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:06.247017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:06.247023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:06.247031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:06.247037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:06.247043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534220849024494:2378], now have 1 active actors on pipe
2025-10-02T08:12:06.247048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1363
2025-10-02T08:12:06.247079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.247087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.247100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534220389125424:5537]
2025-10-02T08:12:06.247111Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:06.247115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:06.247116Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1363
2025-10-02T08:12:06.247139Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:06.247154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.247158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.247160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:06.247168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.247176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:06.247201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.247232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.247238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.247247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.247281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1364 partition: 0 MaxSeqNo: 17 sessionId: src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0
2025-10-02T08:12:06.247638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb13ac-7172e6a8-e286d4b8-9ed2e3f7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:06.250844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0] Write session: try to update token
2025-10-02T08:12:06.250865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:06.263970Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:06.263989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:06.263991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:06.264000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534220389125424:5537]
2025-10-02T08:12:06.264009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534220389125424:5537]
2025-10-02T08:12:06.264044Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:06.264048Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:06.264053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:06.264059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.264065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:06.264188Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:06.268487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId: src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:06.271096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:06.323018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534220389125468:6995]
2025-10-02T08:12:06.323147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1363, pipe: [1:7556534220389125468:6995]
2025-10-02T08:12:06.396286Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:06.396579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.396596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.396634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389125468:6995], now have 1 active actors on pipe
2025-10-02T08:12:06.396687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534220389125468:6995]
2025-10-02T08:12:06.396741Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:06.396820Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:06.396852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:06.396900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0
2025-10-02T08:12:06.397046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1364 sessionId: src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0 is DEAD
2025-10-02T08:12:06.397347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:06.397358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0] Write session will restart in 0.008197s
2025-10-02T08:12:06.397381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0] Write session: Do CDS request
2025-10-02T08:12:06.397387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:06.406367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.406491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:06.406508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1365
2025-10-02T08:12:06.406671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.406699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:06.406707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:06.406710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:06.406927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:06.407075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1365 sessionId:  describe result for acl check
2025-10-02T08:12:06.407105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:06.407110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:06.407111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:06.407117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534220389125861:5485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:06.407565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534220389125861:5485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:06.408209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:06.408425Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:06.408432Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:06.408440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:06.408477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:06.408504Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534220389125875:5487]
2025-10-02T08:12:06.408918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:06.409056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:06.409094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:06.409121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534220389125861:5485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:06.409285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:06.409313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.409317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.409318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.409318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.409319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.409322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.409329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.409331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.409333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.409335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.409339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.409344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.409348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.409351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.409354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.409358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.409360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.409364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.409367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.409370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.409380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:06.415007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534220389125861:5485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:06.415019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534220389125861:5485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:06.415022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534220389125861:5485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:06.415028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:06.416840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:06.418386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:06.418398Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:06.418400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:06.418402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:06.418406Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1364 [1:7556534220389125875:5487]
2025-10-02T08:12:06.418414Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:06.418426Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:06.418428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.418430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.418431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.418444Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:06.418448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:06.418452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:06.418491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.418497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.418499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:06.418501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:06.418544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:06.418550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.418558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.418565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:06.418577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534220389125856:5487]
2025-10-02T08:12:06.418581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534220389125856:5487]
2025-10-02T08:12:06.418587Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:06.418595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389125906:5485], now have 1 active actors on pipe
2025-10-02T08:12:06.418600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:06.418608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:06.418607Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:06.418611Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:06.418614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:06.418618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534220849024502:2378], now have 1 active actors on pipe
2025-10-02T08:12:06.418622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1364
2025-10-02T08:12:06.418638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534220389125856:5487]
2025-10-02T08:12:06.418644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:06.418652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:06.418652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.418654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.418684Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:06.418694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.418696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.418698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:06.418703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.418710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:06.418733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.418692Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1364
2025-10-02T08:12:06.418761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.418767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.418778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.418815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1365 partition: 0 MaxSeqNo: 17 sessionId: src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0
2025-10-02T08:12:06.419116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c8e745-9cb83079-faa7af9a-e31244e1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:06.421794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0] Write session: try to update token
2025-10-02T08:12:06.421809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:06.435583Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:06.435603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:06.435606Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:06.435614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534220389125856:5487]
2025-10-02T08:12:06.435617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534220389125856:5487]
2025-10-02T08:12:06.435651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:06.435658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.435660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:06.435677Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:06.435681Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:06.435790Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:06.439669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId: src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:06.442512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:06.497088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534220389125926:6995]
2025-10-02T08:12:06.497185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1364, pipe: [1:7556534220389125926:6995]
2025-10-02T08:12:06.565155Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:06.565829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.565843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.565883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389125926:6995], now have 1 active actors on pipe
2025-10-02T08:12:06.565985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534220389125926:6995]
2025-10-02T08:12:06.566005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:06.566011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:06.566062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1365 reason: error at write: Disconnected sessionId: src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0
2025-10-02T08:12:06.566112Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:06.566190Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:06.566239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1365 sessionId: src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0 is DEAD
2025-10-02T08:12:06.566695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:06.566705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0] Write session will restart in 0.007839s
2025-10-02T08:12:06.566730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0] Write session: Do CDS request
2025-10-02T08:12:06.566736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:06.575285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.575409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:06.575423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1366
2025-10-02T08:12:06.575564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.575595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:06.575607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:06.575610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:06.576021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1366 sessionId:  describe result for acl check
2025-10-02T08:12:06.576061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:06.576068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:06.576070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:06.576074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534220389126288:5473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:06.576516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534220389126288:5473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:06.577688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:06.578104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:06.578164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534220389126288:5473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:06.578304Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:06.578317Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:06.578328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:06.578385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:06.578423Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534220389126315:5474]
2025-10-02T08:12:06.579103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:06.579270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:06.579305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:06.579538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:06.579566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.579570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.579571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.579571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.579572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.579575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.579581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.579583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.579585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.579587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.579590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.579595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.579602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.579605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.579607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.579616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.579619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.579625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.579633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.579636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.579652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:06.584454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534220389126288:5473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:06.584468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534220389126288:5473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:06.584471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534220389126288:5473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:06.584478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:06.588380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:06.590167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:06.590184Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:06.590186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:06.590195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:06.590201Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1365 [1:7556534220389126315:5474]
2025-10-02T08:12:06.590212Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:06.590226Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:06.590237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.590240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.590242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.590261Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:06.590269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:06.590275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:06.590336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.590344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.590347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:06.590350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:06.590409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:06.590416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.590429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.590442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:06.590465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389126341:5473], now have 1 active actors on pipe
2025-10-02T08:12:06.590466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1365
2025-10-02T08:12:06.590473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534220849024530:2378], now have 1 active actors on pipe
2025-10-02T08:12:06.590479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534220389126308:5474]
2025-10-02T08:12:06.590481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534220389126308:5474]
2025-10-02T08:12:06.590492Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:06.590500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.590509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.590510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:06.590514Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:06.590528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:06.590541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:06.590548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:06.590533Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1365
2025-10-02T08:12:06.590584Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:06.590595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.590599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.590605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:06.590612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.590620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:06.590631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534220389126308:5474]
2025-10-02T08:12:06.590638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:06.590654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:06.590668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.590720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.590728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.590742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.590779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1366 partition: 0 MaxSeqNo: 17 sessionId: src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0
2025-10-02T08:12:06.591161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab239-e1b99dc3-a8a9d7ce-c6e21fd0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:06.595646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0] Write session: try to update token
2025-10-02T08:12:06.595660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:06.608967Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:06.608988Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:06.608990Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:06.609002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534220389126308:5474]
2025-10-02T08:12:06.609006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534220389126308:5474]
2025-10-02T08:12:06.609047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:06.609054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:06.609058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.609059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:06.609061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:06.609572Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:06.609782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId: src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:06.612027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:06.666043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534220389126356:6995]
2025-10-02T08:12:06.666141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1365, pipe: [1:7556534220389126356:6995]
2025-10-02T08:12:06.739584Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:06.739823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.739834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.739866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389126356:6995], now have 1 active actors on pipe
2025-10-02T08:12:06.740027Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:06.740047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534220389126356:6995]
2025-10-02T08:12:06.740065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:06.740093Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:06.740131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1366 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0
2025-10-02T08:12:06.740293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1366 sessionId: src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0 is DEAD
2025-10-02T08:12:06.740399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:06.740409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0] Write session will restart in 0.009309s
2025-10-02T08:12:06.740437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0] Write session: Do CDS request
2025-10-02T08:12:06.740443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:06.751285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.751379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:06.751390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:06.751392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1367
2025-10-02T08:12:06.751470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.751499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:06.751508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:06.751511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:06.751916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1367 sessionId:  describe result for acl check
2025-10-02T08:12:06.751957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:06.751965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:06.751967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:06.751973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534220389126725:5452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:06.752381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534220389126725:5452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:06.752699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:06.752894Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:06.752902Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:06.752910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:06.752947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:06.752973Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534220389126733:5467]
2025-10-02T08:12:06.753341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:06.753482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:06.753509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:06.753713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:06.753744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.753750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.753750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.753752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.753752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.753756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.753761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.753763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.753765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.753767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.753770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.753774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.753777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.753780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.753783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.753785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.753787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.753790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.753792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.753795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.753804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:06.754554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534220389126725:5452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:06.761031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534220389126725:5452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:06.761048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534220389126725:5452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:06.761051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534220389126725:5452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:06.761059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:06.765180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:06.766719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:06.766732Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:06.766733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:06.766735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:06.766740Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1366 [1:7556534220389126733:5467]
2025-10-02T08:12:06.766746Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:06.766759Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:06.766763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.766766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.766767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.766778Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:06.766781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:06.766786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:06.766828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.766833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.766835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:06.766837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:06.766899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:06.766905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.766914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.766921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:06.766932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389126772:5452], now have 1 active actors on pipe
2025-10-02T08:12:06.766941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534220389126719:5467]
2025-10-02T08:12:06.766943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534220389126719:5467]
2025-10-02T08:12:06.766943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1366
2025-10-02T08:12:06.766948Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:06.766956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:06.766959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:06.766961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:06.766968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:06.766969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:06.766973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534220849024538:2378], now have 1 active actors on pipe
2025-10-02T08:12:06.766977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.766980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.767010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534220389126719:5467]
2025-10-02T08:12:06.767020Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:06.767023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:06.767031Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|106849b0-a265f709-9a00ef6-d79b8db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:06.767039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.767044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.767045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:06.767052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.767059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:06.767034Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1366
2025-10-02T08:12:06.767090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.767133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.767142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.767161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.767192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1367 partition: 0 MaxSeqNo: 17 sessionId: src_id|106849b0-a265f709-9a00ef6-d79b8db6_0
2025-10-02T08:12:06.767466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa32d7de-3ee197ae-82031c64-45df9b1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|106849b0-a265f709-9a00ef6-d79b8db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:06.769847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106849b0-a265f709-9a00ef6-d79b8db6_0] Write session: try to update token
2025-10-02T08:12:06.769860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106849b0-a265f709-9a00ef6-d79b8db6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:06.783508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId: src_id|106849b0-a265f709-9a00ef6-d79b8db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:06.785885Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:06.785901Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:06.785902Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:06.785909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534220389126719:5467]
2025-10-02T08:12:06.785913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534220389126719:5467]
2025-10-02T08:12:06.785944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:06.785949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.785950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:06.785963Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:06.785977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:06.786007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:06.786078Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:06.840153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534220389126786:6995]
2025-10-02T08:12:06.840268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1366, pipe: [1:7556534220389126786:6995]
2025-10-02T08:12:06.909721Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:06.910079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.910093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.910132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389126786:6995], now have 1 active actors on pipe
2025-10-02T08:12:06.910248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534220389126786:6995]
2025-10-02T08:12:06.910269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:06.910271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:06.910327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1367 reason: error at write: Disconnected sessionId: src_id|106849b0-a265f709-9a00ef6-d79b8db6_0
2025-10-02T08:12:06.910368Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:06.910370Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:06.910479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1367 sessionId: src_id|106849b0-a265f709-9a00ef6-d79b8db6_0 is DEAD
2025-10-02T08:12:06.910625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106849b0-a265f709-9a00ef6-d79b8db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:06.910634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106849b0-a265f709-9a00ef6-d79b8db6_0] Write session will restart in 0.009920s
2025-10-02T08:12:06.910654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106849b0-a265f709-9a00ef6-d79b8db6_0] Write session: Do CDS request
2025-10-02T08:12:06.910659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106849b0-a265f709-9a00ef6-d79b8db6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:06.920651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:06.921234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106849b0-a265f709-9a00ef6-d79b8db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.921377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:06.921389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1368
2025-10-02T08:12:06.921456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:06.921477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:06.921481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:06.921484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:06.921812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1368 sessionId:  describe result for acl check
2025-10-02T08:12:06.921841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:06.921844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:06.921845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:06.921850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534220389127154:5444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:06.921934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:06.922074Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:06.922082Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:06.922088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:06.922120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:06.922144Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534220389127156:5450]
2025-10-02T08:12:06.922219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534220389127154:5444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:06.922521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:06.922696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:06.922739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:06.922934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:06.922960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.922964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.922965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.922966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.922967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.922970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.922975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.922977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.922979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.922981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.922985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.922989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:06.922992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.923006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:06.923008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.923011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:06.923014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.923017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.923019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.923022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.923032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:06.923468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534220389127154:5444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:06.928866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534220389127154:5444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:06.928877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534220389127154:5444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:06.928880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534220389127154:5444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:06.928898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:06.930974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:06.932475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:06.932487Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:06.932489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:06.932492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:06.932498Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1367 [1:7556534220389127156:5450]
2025-10-02T08:12:06.932505Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:06.932517Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:06.932519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.932520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.932522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.932533Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:06.932537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:06.932541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:06.932579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.932584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.932586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:06.932588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:06.932630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:06.932635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.932642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:06.932648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:06.932658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534220389127147:5450]
2025-10-02T08:12:06.932662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534220389127147:5450]
2025-10-02T08:12:06.932670Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:06.932680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:06.932683Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:06.932685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:06.932694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1367
2025-10-02T08:12:06.932696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:06.932698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:06.932708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534220389127202:5444], now have 1 active actors on pipe
2025-10-02T08:12:06.932711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534220849024544:2378], now have 1 active actors on pipe
2025-10-02T08:12:06.932738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.932746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.932757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534220389127147:5450]
2025-10-02T08:12:06.932767Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:06.932783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:06.932789Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:06.932795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:06.932798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:06.932765Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1367
2025-10-02T08:12:06.932816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:06.932830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:06.932842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:06.932872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.932911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.932916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.932925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:06.932950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1368 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0
2025-10-02T08:12:06.933292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106849b0-a265f709-9a00ef6-d79b8db6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:06.935743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0] Write session: try to update token
2025-10-02T08:12:06.935756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:06.948903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId: src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:06.951581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:06.951946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:06.951968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:06.951985Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:06.951991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:06.951994Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:06.952001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534220389127147:5450]
2025-10-02T08:12:06.952004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534220389127147:5450]
2025-10-02T08:12:06.952050Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:06.952061Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:06.952063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:06.952068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:06.952070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:06.952204Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:07.010637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534224684094511:6995]
2025-10-02T08:12:07.010767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1367, pipe: [1:7556534224684094511:6995]
2025-10-02T08:12:07.078977Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:07.079352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:07.079385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:07.079394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684094511:6995], now have 1 active actors on pipe
2025-10-02T08:12:07.079470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:07.079478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:07.079491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1368 reason: error at write: Disconnected sessionId: src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0
2025-10-02T08:12:07.079608Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:07.079603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1368 sessionId: src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0 is DEAD
2025-10-02T08:12:07.079736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:07.079750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0] Write session will restart in 0.009434s
2025-10-02T08:12:07.079745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534224684094511:6995]
2025-10-02T08:12:07.079780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0] Write session: Do CDS request
2025-10-02T08:12:07.079788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:07.090393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.090412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:07.090428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1369
2025-10-02T08:12:07.090588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.090617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:07.090625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:07.090628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:07.090853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:07.090986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1369 sessionId:  describe result for acl check
2025-10-02T08:12:07.091016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:07.091021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:07.091023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:07.091028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534224684094882:5409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:07.091454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534224684094882:5409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:07.092461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:07.092673Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:07.092682Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:07.092691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:07.092736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:07.092770Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534224684094902:5426]
2025-10-02T08:12:07.093294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:07.093414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:07.093439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:07.093519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534224684094882:5409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:07.093627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:07.093655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.093658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.093659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.093660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.093660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.093663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.093669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.093671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.093673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.093675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.093678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.093683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.093686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.093688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.093690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.093693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.093695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.093698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.093700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.093702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.093713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:07.099444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534224684094882:5409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:07.099456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534224684094882:5409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:07.099460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534224684094882:5409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:07.099467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:07.103140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:07.104619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:07.104633Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:07.104635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:07.104637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:07.104642Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1368 [1:7556534224684094902:5426]
2025-10-02T08:12:07.104649Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:07.104664Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:07.104669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.104672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.104673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.104684Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:07.104687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:07.104692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:07.104734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.104739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.104741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:07.104743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:07.104818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:07.104828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.104841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.104852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:07.104869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534224684094876:5426]
2025-10-02T08:12:07.104872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534224684094876:5426]
2025-10-02T08:12:07.104879Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:07.104890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:07.104897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:07.104899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684094929:5409], now have 1 active actors on pipe
2025-10-02T08:12:07.104902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1368
2025-10-02T08:12:07.104904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:07.104916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:07.104919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:07.104924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534225143991861:2378], now have 1 active actors on pipe
2025-10-02T08:12:07.104955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.104964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.104979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534224684094876:5426]
2025-10-02T08:12:07.104983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:07.105003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:07.105009Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e4f374a-f3ec837c-604f3365-4578debe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:07.105016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.105019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.105022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:07.104987Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1368
2025-10-02T08:12:07.105033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.105042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:07.105067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.105109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.105116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.105130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.105170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1369 partition: 0 MaxSeqNo: 17 sessionId: src_id|4e4f374a-f3ec837c-604f3365-4578debe_0
2025-10-02T08:12:07.105536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f7515eb-ee1c6db9-478101de-fd6751a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4e4f374a-f3ec837c-604f3365-4578debe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:07.108153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4f374a-f3ec837c-604f3365-4578debe_0] Write session: try to update token
2025-10-02T08:12:07.108173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4f374a-f3ec837c-604f3365-4578debe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:07.122145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId: src_id|4e4f374a-f3ec837c-604f3365-4578debe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:07.123627Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:07.123650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:07.123652Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:07.123661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534224684094876:5426]
2025-10-02T08:12:07.123665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534224684094876:5426]
2025-10-02T08:12:07.123705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:07.123716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.123718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:07.123718Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:07.123723Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:07.123853Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:07.124450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:07.180096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534224684094944:6995]
2025-10-02T08:12:07.180178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1368, pipe: [1:7556534224684094944:6995]
2025-10-02T08:12:07.270825Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:07.271252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.271267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.271307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684094944:6995], now have 1 active actors on pipe
2025-10-02T08:12:07.271399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:07.271408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:07.271457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1369 reason: error at write: Disconnected sessionId: src_id|4e4f374a-f3ec837c-604f3365-4578debe_0
2025-10-02T08:12:07.271513Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:07.271516Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:07.271602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1369 sessionId: src_id|4e4f374a-f3ec837c-604f3365-4578debe_0 is DEAD
2025-10-02T08:12:07.271728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4f374a-f3ec837c-604f3365-4578debe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:07.271737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4f374a-f3ec837c-604f3365-4578debe_0] Write session will restart in 0.006819s
2025-10-02T08:12:07.271754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4f374a-f3ec837c-604f3365-4578debe_0] Write session: Do CDS request
2025-10-02T08:12:07.271759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4f374a-f3ec837c-604f3365-4578debe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:07.271749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534224684094944:6995]
2025-10-02T08:12:07.279275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4f374a-f3ec837c-604f3365-4578debe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.279339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:07.279355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1370
2025-10-02T08:12:07.279472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.279500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:07.279504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:07.279506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:07.279914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1370 sessionId:  describe result for acl check
2025-10-02T08:12:07.279951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:07.279953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:07.279955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:07.279959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534224684095294:5382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:07.280359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534224684095294:5382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:07.282108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:07.282274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534224684095294:5382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:07.283553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:07.283766Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:07.283777Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:07.283786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:07.283841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:07.283875Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534224684095368:5392]
2025-10-02T08:12:07.284456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:07.284655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:07.284713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:07.284751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534224684095294:5382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:07.284760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534224684095294:5382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:07.284762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534224684095294:5382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:07.284768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:07.285026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:07.285090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.285099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.285100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.285101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.285103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.285108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.285118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.285122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.285126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.285129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.285134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.285141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.285147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.285152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.285156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.285162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.285166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.285170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.285175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.285180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.285198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:07.292651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:07.294260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:07.294277Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:07.294280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:07.294282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:07.294287Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1369 [1:7556534224684095368:5392]
2025-10-02T08:12:07.294295Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:07.294307Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:07.294309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.294311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.294313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.294324Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:07.294328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:07.294332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:07.294379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.294386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.294388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:07.294390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:07.294433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:07.294438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.294447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.294456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:07.294472Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534224684095352:5392]
2025-10-02T08:12:07.294476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534224684095352:5392]
2025-10-02T08:12:07.294483Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:07.294493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684095379:5382], now have 1 active actors on pipe
2025-10-02T08:12:07.294493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:07.294496Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:07.294503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:07.294507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1369
2025-10-02T08:12:07.294511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:07.294512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:07.294516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534225143991868:2378], now have 1 active actors on pipe
2025-10-02T08:12:07.294539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.294545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.294555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534224684095352:5392]
2025-10-02T08:12:07.294563Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:07.294570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:07.294580Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7735222-b288f14e-73838bcd-4ad025ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:07.294586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.294591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.294593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:07.294600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.294608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:07.294623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.294600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1369
2025-10-02T08:12:07.294666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.294671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.294679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.294708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1370 partition: 0 MaxSeqNo: 17 sessionId: src_id|c7735222-b288f14e-73838bcd-4ad025ae_0
2025-10-02T08:12:07.295048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4f374a-f3ec837c-604f3365-4578debe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c7735222-b288f14e-73838bcd-4ad025ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:07.297514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7735222-b288f14e-73838bcd-4ad025ae_0] Write session: try to update token
2025-10-02T08:12:07.297532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7735222-b288f14e-73838bcd-4ad025ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:07.310494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId: src_id|c7735222-b288f14e-73838bcd-4ad025ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:07.312786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:07.313077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.313103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.313125Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:07.313127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:07.313129Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:07.313136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534224684095352:5392]
2025-10-02T08:12:07.313141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534224684095352:5392]
2025-10-02T08:12:07.313176Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:07.313188Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:07.313192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:07.313198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.313200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:07.313327Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:07.372103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534224684095398:6995]
2025-10-02T08:12:07.372202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1369, pipe: [1:7556534224684095398:6995]
2025-10-02T08:12:07.459554Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:07.459993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:07.460051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684095398:6995], now have 1 active actors on pipe
2025-10-02T08:12:07.460053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:07.460137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:07.460147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:07.460165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1370 reason: error at write: Disconnected sessionId: src_id|c7735222-b288f14e-73838bcd-4ad025ae_0
2025-10-02T08:12:07.460272Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:07.460301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1370 sessionId: src_id|c7735222-b288f14e-73838bcd-4ad025ae_0 is DEAD
2025-10-02T08:12:07.460451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534224684095398:6995]
2025-10-02T08:12:07.460489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7735222-b288f14e-73838bcd-4ad025ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:07.460500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7735222-b288f14e-73838bcd-4ad025ae_0] Write session will restart in 0.008509s
2025-10-02T08:12:07.460523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7735222-b288f14e-73838bcd-4ad025ae_0] Write session: Do CDS request
2025-10-02T08:12:07.460533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7735222-b288f14e-73838bcd-4ad025ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:07.470304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7735222-b288f14e-73838bcd-4ad025ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.470371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:07.470389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1371
2025-10-02T08:12:07.470537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.470550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:07.470581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:07.470591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:07.470595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:07.470968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1371 sessionId:  describe result for acl check
2025-10-02T08:12:07.471003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:07.471010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:07.471011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:07.471019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534224684095803:5358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:07.471505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534224684095803:5358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:07.471894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:07.472055Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:07.472065Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:07.472072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:07.472105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:07.472132Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534224684095812:5363]
2025-10-02T08:12:07.472639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:07.472858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:07.472923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:07.473093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534224684095803:5358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:07.473244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:07.473313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.473319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.473320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.473322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.473323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.473328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.473338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.473343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.473348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.473352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.473361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.473372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.473383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.473397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.473405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.473415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.473420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.473426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.473431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.473436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.473455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:07.479360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534224684095803:5358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:07.479373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534224684095803:5358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:07.479376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534224684095803:5358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:07.479383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:07.481326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:07.482592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:07.482603Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:07.482605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:07.482608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:07.482613Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1370 [1:7556534224684095812:5363]
2025-10-02T08:12:07.482622Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:07.482633Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:07.482635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.482636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.482638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.482650Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:07.482657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:07.482661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:07.482701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.482707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.482709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:07.482711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:07.482754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:07.482760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.482768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.482775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:07.482787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684095847:5358], now have 1 active actors on pipe
2025-10-02T08:12:07.482795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534224684095797:5363]
2025-10-02T08:12:07.482798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534224684095797:5363]
2025-10-02T08:12:07.482804Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:07.482813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534225143991874:2378], now have 1 active actors on pipe
2025-10-02T08:12:07.482814Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:07.482817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:07.482817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1370
2025-10-02T08:12:07.482818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:07.482830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:07.482837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:07.482844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.482847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.482877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534224684095797:5363]
2025-10-02T08:12:07.482883Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:07.482858Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1370
2025-10-02T08:12:07.482890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:07.482894Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:07.482898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.482900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.482901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:07.482906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.482912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:07.482941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.482975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.482980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.482989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.483015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1371 partition: 0 MaxSeqNo: 17 sessionId: src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0
2025-10-02T08:12:07.483332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7735222-b288f14e-73838bcd-4ad025ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:07.486358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0] Write session: try to update token
2025-10-02T08:12:07.486381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:07.500104Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:07.500121Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:07.500122Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:07.500129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534224684095797:5363]
2025-10-02T08:12:07.500132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534224684095797:5363]
2025-10-02T08:12:07.500162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:07.500166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.500168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:07.500169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:07.500173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:07.500284Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:07.502693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId: src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:07.505284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:07.560510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534224684095871:6995]
2025-10-02T08:12:07.560614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1370, pipe: [1:7556534224684095871:6995]
2025-10-02T08:12:07.625854Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:07.626112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.626122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.626152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684095871:6995], now have 1 active actors on pipe
2025-10-02T08:12:07.626232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534224684095871:6995]
2025-10-02T08:12:07.626281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:07.626292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:07.626321Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:07.626356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1371 reason: error at write: Disconnected sessionId: src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0
2025-10-02T08:12:07.626359Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:07.626489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1371 sessionId: src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0 is DEAD
2025-10-02T08:12:07.626623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:07.626631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0] Write session will restart in 0.005921s
2025-10-02T08:12:07.626652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0] Write session: Do CDS request
2025-10-02T08:12:07.626656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:07.633174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.633270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:07.633280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1372
2025-10-02T08:12:07.633385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.633405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:07.633411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:07.633414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:07.633832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1372 sessionId:  describe result for acl check
2025-10-02T08:12:07.633861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:07.633866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:07.633868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:07.633872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534224684096147:5339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:07.634209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534224684096147:5339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:07.636253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534224684096147:5339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:07.637843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:07.639037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:07.639164Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:07.639171Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:07.639176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:07.639204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:07.639235Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534224684096278:5336]
2025-10-02T08:12:07.639593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534224684096147:5339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:07.639603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534224684096147:5339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:07.639605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534224684096147:5339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:07.639609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:07.639644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:07.639791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:07.639829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:07.640083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:07.640120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.640124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.640125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.640126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.640126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.640130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.640136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.640138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.640140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.640142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.640146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.640150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.640154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.640157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.640163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.640167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.640169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.640172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.640174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.640177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.640190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:07.647848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:07.649275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:07.649286Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:07.649288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:07.649290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:07.649295Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1371 [1:7556534224684096278:5336]
2025-10-02T08:12:07.649302Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:07.649313Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:07.649315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.649317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.649319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.649332Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:07.649335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:07.649339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:07.649384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.649390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.649392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:07.649394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:07.649439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:07.649445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.649453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.649459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:07.649474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534224684096272:5336]
2025-10-02T08:12:07.649478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534224684096272:5336]
2025-10-02T08:12:07.649484Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:07.649493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:07.649504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:07.649506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:07.649509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:07.649509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:07.649509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1371
2025-10-02T08:12:07.649517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684096283:5339], now have 1 active actors on pipe
2025-10-02T08:12:07.649519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534225143991905:2378], now have 1 active actors on pipe
2025-10-02T08:12:07.649542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534224684096272:5336]
2025-10-02T08:12:07.649554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:07.649559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.649561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.649568Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:07.649591Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:07.649599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.649602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.649603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:07.649609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.649619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:07.649634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.649611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1371
2025-10-02T08:12:07.649672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.649677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.649685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.649716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1372 partition: 0 MaxSeqNo: 17 sessionId: src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0
2025-10-02T08:12:07.650025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f96c2b6-f15e1a2b-5c81444d-681bb6fd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:07.652568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0] Write session: try to update token
2025-10-02T08:12:07.652579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:07.666508Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:07.666527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:07.666529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:07.666536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534224684096272:5336]
2025-10-02T08:12:07.666539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534224684096272:5336]
2025-10-02T08:12:07.666576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:07.666582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.666585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:07.666595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:07.666600Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:07.666849Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:07.667037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId: src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:07.669440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:07.726423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534224684096313:6995]
2025-10-02T08:12:07.726585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1371, pipe: [1:7556534224684096313:6995]
2025-10-02T08:12:07.790371Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:07.790644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.790654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.790684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684096313:6995], now have 1 active actors on pipe
2025-10-02T08:12:07.790816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534224684096313:6995]
2025-10-02T08:12:07.790841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:07.790848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:07.790872Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:07.790907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1372 reason: error at write: Disconnected sessionId: src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0
2025-10-02T08:12:07.790906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:07.791060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1372 sessionId: src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0 is DEAD
2025-10-02T08:12:07.791223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:07.791232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0] Write session will restart in 0.006878s
2025-10-02T08:12:07.791253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0] Write session: Do CDS request
2025-10-02T08:12:07.791259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:07.799273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.799395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:07.799408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1373
2025-10-02T08:12:07.799523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.799561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:07.799573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:07.799576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:07.799995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1373 sessionId:  describe result for acl check
2025-10-02T08:12:07.800023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:07.800029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:07.800031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:07.800035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534224684096664:5296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:07.800524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534224684096664:5296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:07.801953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:07.802676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534224684096664:5296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:07.803335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:07.803481Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:07.803489Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:07.803496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:07.803527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:07.803552Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534224684096724:5301]
2025-10-02T08:12:07.803952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:07.804091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:07.804122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:07.804307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:07.804332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.804337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.804338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.804339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.804340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.804344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.804352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.804359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.804363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.804369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.804373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.804383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.804392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.804396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.804406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.804411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.804420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.804428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.804434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.804437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.804446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:07.804766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534224684096664:5296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:07.804777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534224684096664:5296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:07.804780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534224684096664:5296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:07.804786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:07.811622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:07.813097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:07.813109Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:07.813111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:07.813113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:07.813117Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1372 [1:7556534224684096724:5301]
2025-10-02T08:12:07.813124Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:07.813133Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:07.813135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.813136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.813138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.813148Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:07.813152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:07.813156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:07.813194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.813200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.813202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:07.813203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:07.813257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:07.813265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.813276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.813290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:07.813310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684096741:5296], now have 1 active actors on pipe
2025-10-02T08:12:07.813318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1372
2025-10-02T08:12:07.813320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534224684096702:5301]
2025-10-02T08:12:07.813321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534224684096702:5301]
2025-10-02T08:12:07.813327Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:07.813333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534225143991911:2378], now have 1 active actors on pipe
2025-10-02T08:12:07.813334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:07.813336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:07.813340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:07.813351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:07.813357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:07.813363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.813371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.813404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534224684096702:5301]
2025-10-02T08:12:07.813411Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:07.813413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:07.813372Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1372
2025-10-02T08:12:07.813422Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:07.813431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.813438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.813440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:07.813448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.813460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:07.813494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.813537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.813543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.813554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.813588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1373 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0
2025-10-02T08:12:07.813856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0d4d56-5ad29c50-c6859cfa-b79f615_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:07.816125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0] Write session: try to update token
2025-10-02T08:12:07.816138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:07.829461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId: src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:07.829482Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:07.829485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:07.829487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:07.829493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534224684096702:5301]
2025-10-02T08:12:07.829496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534224684096702:5301]
2025-10-02T08:12:07.829532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:07.829543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.829545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:07.829595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:07.829608Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:07.829671Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:07.831946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:07.890736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534224684096754:6995]
2025-10-02T08:12:07.890864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1372, pipe: [1:7556534224684096754:6995]
2025-10-02T08:12:07.952502Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:07.952829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.952843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.952870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684096754:6995], now have 1 active actors on pipe
2025-10-02T08:12:07.952970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534224684096754:6995]
2025-10-02T08:12:07.952993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:07.952995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:07.953040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1373 reason: error at write: Disconnected sessionId: src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0
2025-10-02T08:12:07.953050Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:07.953026Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:07.953207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1373 sessionId: src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0 is DEAD
2025-10-02T08:12:07.953359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:07.953370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0] Write session will restart in 0.008593s
2025-10-02T08:12:07.953396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0] Write session: Do CDS request
2025-10-02T08:12:07.953402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:07.963397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.963412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:07.963428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1374
2025-10-02T08:12:07.963529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:07.963586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:07.963617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:07.963627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:07.963630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:07.963917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1374 sessionId:  describe result for acl check
2025-10-02T08:12:07.963940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:07.963945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:07.963946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:07.963949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534224684097136:5275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:07.964390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534224684097136:5275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:07.964907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:07.965052Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:07.965060Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:07.965067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:07.965104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:07.965133Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534224684097146:5271]
2025-10-02T08:12:07.965512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:07.965630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:07.965654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:07.965840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:07.965870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.965871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.965872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.965873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.965873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.965877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.965882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.965884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.965886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.965888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.965891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.965895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:07.965899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.965902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:07.965904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.965906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:07.965910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.965912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.965915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.965917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.965927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:07.966205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534224684097136:5275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:07.972406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534224684097136:5275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:07.972420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534224684097136:5275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:07.972423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534224684097136:5275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:07.972431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:07.973437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:07.974955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:07.974966Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:07.974968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:07.974970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:07.974974Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1373 [1:7556534224684097146:5271]
2025-10-02T08:12:07.974980Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:07.974992Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:07.974994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.974995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.974996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.975007Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:07.975010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:07.975014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:07.975051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.975056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.975058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:07.975061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:07.975100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:07.975105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.975112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:07.975118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:07.975132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534224684097130:5271]
2025-10-02T08:12:07.975136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534224684097130:5271]
2025-10-02T08:12:07.975141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:07.975149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:07.975153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:07.975155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:07.975158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1373
2025-10-02T08:12:07.975161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:07.975162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:07.975169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534224684097181:5275], now have 1 active actors on pipe
2025-10-02T08:12:07.975189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534225143991918:2378], now have 1 active actors on pipe
2025-10-02T08:12:07.975195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.975197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.975207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534224684097130:5271]
2025-10-02T08:12:07.975221Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:07.975238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:07.975247Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a47d86e-d61ed533-4308481-9e4dda40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:07.975252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:07.975258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:07.975259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:07.975265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:07.975273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:07.975256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1373
2025-10-02T08:12:07.975295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.975325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:07.975330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:07.975340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:07.975367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1374 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a47d86e-d61ed533-4308481-9e4dda40_0
2025-10-02T08:12:07.975643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9079fe6-c017357a-c7c618aa-f31e2530_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a47d86e-d61ed533-4308481-9e4dda40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:07.977908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a47d86e-d61ed533-4308481-9e4dda40_0] Write session: try to update token
2025-10-02T08:12:07.977921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a47d86e-d61ed533-4308481-9e4dda40_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:07.989969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId: src_id|1a47d86e-d61ed533-4308481-9e4dda40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:07.991731Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:07.991747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:07.991748Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:07.991754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534224684097130:5271]
2025-10-02T08:12:07.991757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534224684097130:5271]
2025-10-02T08:12:07.991788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:07.991796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:07.991798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:07.991812Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:07.991829Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:07.991929Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:07.992266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:08.053073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534228979064490:6995]
2025-10-02T08:12:08.053173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1373, pipe: [1:7556534228979064490:6995]
2025-10-02T08:12:08.115514Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:08.115919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.115931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.115962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979064490:6995], now have 1 active actors on pipe
2025-10-02T08:12:08.116049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:08.116056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:08.116096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1374 reason: error at write: Disconnected sessionId: src_id|1a47d86e-d61ed533-4308481-9e4dda40_0
2025-10-02T08:12:08.116131Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:08.116226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1374 sessionId: src_id|1a47d86e-d61ed533-4308481-9e4dda40_0 is DEAD
2025-10-02T08:12:08.116204Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:08.116337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534228979064490:6995]
2025-10-02T08:12:08.116379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a47d86e-d61ed533-4308481-9e4dda40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:08.116388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a47d86e-d61ed533-4308481-9e4dda40_0] Write session will restart in 0.005721s
2025-10-02T08:12:08.116412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a47d86e-d61ed533-4308481-9e4dda40_0] Write session: Do CDS request
2025-10-02T08:12:08.116418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a47d86e-d61ed533-4308481-9e4dda40_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:08.123275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a47d86e-d61ed533-4308481-9e4dda40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.123303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:08.123314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1375
2025-10-02T08:12:08.123449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.123469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:08.123476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:08.123479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:08.123786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1375 sessionId:  describe result for acl check
2025-10-02T08:12:08.123813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:08.123817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:08.123818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:08.123821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534228979064815:5267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:08.124176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534228979064815:5267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:08.125763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:08.125826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534228979064815:5267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:08.127108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:08.127230Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:08.127237Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:08.127243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:08.127275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:08.127302Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534228979064902:5268]
2025-10-02T08:12:08.127892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534228979064815:5267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:08.127902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534228979064815:5267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:08.127904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534228979064815:5267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:08.127909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:08.127977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:08.128100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:08.128127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:08.128376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:08.128400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.128404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.128405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.128405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.128406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.128408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.128414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.128416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.128418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.128420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.128423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.128427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.128430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.128436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.128439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.128441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.128443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.128446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.128448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.128450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.128460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:08.135877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:08.137674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:08.137688Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:08.137690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:08.137692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:08.137697Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1374 [1:7556534228979064902:5268]
2025-10-02T08:12:08.137703Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:08.137715Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:08.137716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.137718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.137719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.137729Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:08.137732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:08.137737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:08.137773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.137779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.137781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:08.137782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:08.137835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:08.137843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.137853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.137867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:08.137880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1374
2025-10-02T08:12:08.137885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979064908:5267], now have 1 active actors on pipe
2025-10-02T08:12:08.137888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534229438959234:2378], now have 1 active actors on pipe
2025-10-02T08:12:08.137893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534228979064886:5268]
2025-10-02T08:12:08.137894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534228979064886:5268]
2025-10-02T08:12:08.137903Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:08.137915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:08.137917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.137918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:08.137920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.137935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:08.137954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:08.137956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:08.137962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1374
2025-10-02T08:12:08.137994Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:08.138004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.138007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.138009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:08.138016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.138028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:08.138034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534228979064886:5268]
2025-10-02T08:12:08.138040Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:08.138050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:08.138067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.138131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.138137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.138150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.138185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1375 partition: 0 MaxSeqNo: 17 sessionId: src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0
2025-10-02T08:12:08.138452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a47d86e-d61ed533-4308481-9e4dda40_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:08.140631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0] Write session: try to update token
2025-10-02T08:12:08.140643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:08.151994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId: src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:08.154130Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:08.154146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:08.154147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:08.154153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534228979064886:5268]
2025-10-02T08:12:08.154156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534228979064886:5268]
2025-10-02T08:12:08.154187Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:08.154187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:08.154190Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:08.154192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.154195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:08.154341Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:08.154342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:08.216385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534228979064947:6995]
2025-10-02T08:12:08.216500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1374, pipe: [1:7556534228979064947:6995]
2025-10-02T08:12:08.276267Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:08.276533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.276543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.276574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979064947:6995], now have 1 active actors on pipe
2025-10-02T08:12:08.276696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:08.276703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:08.276741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1375 reason: error at write: Disconnected sessionId: src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0
2025-10-02T08:12:08.276783Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:08.276829Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:08.276901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1375 sessionId: src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0 is DEAD
2025-10-02T08:12:08.277063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:08.277080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0] Write session will restart in 0.008811s
2025-10-02T08:12:08.277067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534228979064947:6995]
2025-10-02T08:12:08.277119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0] Write session: Do CDS request
2025-10-02T08:12:08.277126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:08.287182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:08.287220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.287262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:08.287272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1376
2025-10-02T08:12:08.287409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.287442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:08.287450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:08.287453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:08.287749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1376 sessionId:  describe result for acl check
2025-10-02T08:12:08.287771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:08.287775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:08.287776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:08.287779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534228979065329:5258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:08.288128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534228979065329:5258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:08.288506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:08.288625Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:08.288635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:08.288641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:08.288671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:08.288693Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534228979065339:5259]
2025-10-02T08:12:08.289129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:08.289308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:08.289346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:08.289551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:08.289588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.289593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.289594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.289594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.289595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.289598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.289603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.289606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.289607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.289610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.289614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.289618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.289621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.289625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.289626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.289629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.289631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.289634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.289636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.289638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.289648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:08.289668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534228979065329:5258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:08.295025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534228979065329:5258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:08.295035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534228979065329:5258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:08.295037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534228979065329:5258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:08.295043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:08.297393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:08.298917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:08.298931Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:08.298933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:08.298937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:08.298942Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1375 [1:7556534228979065339:5259]
2025-10-02T08:12:08.298953Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:08.298971Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:08.298978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.298980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.298982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.298997Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:08.299005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:08.299015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:08.299063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.299070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.299073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:08.299075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:08.299131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:08.299137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.299147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.299150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1375
2025-10-02T08:12:08.299157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:08.299174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979065377:5258], now have 1 active actors on pipe
2025-10-02T08:12:08.299181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534229438959241:2378], now have 1 active actors on pipe
2025-10-02T08:12:08.299185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.299189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.299205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534228979065323:5259]
2025-10-02T08:12:08.299210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534228979065323:5259]
2025-10-02T08:12:08.299228Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:08.299231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:08.299234Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:08.299242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:08.299258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:08.299266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:08.299282Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:08.299226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1375
2025-10-02T08:12:08.299291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.299300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.299305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:08.299312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.299320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:08.299355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534228979065323:5259]
2025-10-02T08:12:08.299366Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:08.299379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.299383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:08.299427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.299433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.299449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.299481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1376 partition: 0 MaxSeqNo: 17 sessionId: src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0
2025-10-02T08:12:08.299782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a0a735-3c78fcaf-4ceb7b6b-6c172a5e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:08.302075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0] Write session: try to update token
2025-10-02T08:12:08.302087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:08.314163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId: src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:08.315340Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:08.315355Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:08.315357Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:08.315363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534228979065323:5259]
2025-10-02T08:12:08.315365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534228979065323:5259]
2025-10-02T08:12:08.315399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:08.315408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.315409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:08.315515Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:08.315527Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:08.315531Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:08.316277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:08.377154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534228979065391:6995]
2025-10-02T08:12:08.377260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1375, pipe: [1:7556534228979065391:6995]
2025-10-02T08:12:08.445681Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:08.445883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.445893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.445921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979065391:6995], now have 1 active actors on pipe
2025-10-02T08:12:08.446028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534228979065391:6995]
2025-10-02T08:12:08.446124Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:08.446130Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:08.446319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:08.446358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0
2025-10-02T08:12:08.446492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1376 sessionId: src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0 is DEAD
2025-10-02T08:12:08.446756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:08.446772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0] Write session will restart in 0.005116s
2025-10-02T08:12:08.446796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0] Write session: Do CDS request
2025-10-02T08:12:08.446802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:08.453229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.453336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:08.453350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1377
2025-10-02T08:12:08.453521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.453550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:08.453559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:08.453562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:08.453918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1377 sessionId:  describe result for acl check
2025-10-02T08:12:08.453949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:08.453955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:08.453956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:08.453960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534228979065715:5232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:08.454620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534228979065715:5232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:08.456667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:08.457934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534228979065715:5232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:08.458167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:08.458285Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:08.458291Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:08.458298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:08.458327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:08.458349Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534228979065811:5233]
2025-10-02T08:12:08.458725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:08.458843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:08.458869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:08.459047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:08.459072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.459076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.459077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.459078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.459078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.459081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.459086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.459088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.459090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.459092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.459095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.459100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.459106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.459109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.459111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.459114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.459116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.459118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.459120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.459123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.459133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:08.464223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534228979065715:5232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:08.464234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534228979065715:5232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:08.464236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534228979065715:5232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:08.464241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:08.466356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:08.467882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:08.467894Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:08.467896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:08.467898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:08.467902Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1376 [1:7556534228979065811:5233]
2025-10-02T08:12:08.467909Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:08.467919Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:08.467920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.467922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.467923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.467934Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:08.467937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:08.467942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:08.467975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.467980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.467982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:08.467985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:08.468025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:08.468029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.468037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.468053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1376
2025-10-02T08:12:08.468054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:08.468066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979065853:5232], now have 1 active actors on pipe
2025-10-02T08:12:08.468074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.468075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.468085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534229438959248:2378], now have 1 active actors on pipe
2025-10-02T08:12:08.468092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534228979065794:5233]
2025-10-02T08:12:08.468093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534228979065794:5233]
2025-10-02T08:12:08.468101Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:08.468112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:08.468113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:08.468115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:08.468123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:08.468124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:08.468133Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:08.468141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.468143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.468121Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1376
2025-10-02T08:12:08.468144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:08.468149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.468154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:08.468174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534228979065794:5233]
2025-10-02T08:12:08.468181Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:08.468189Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:08.468196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.468239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.468245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.468256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.468279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1377 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0
2025-10-02T08:12:08.468612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0a2e66b-e05f8c14-7d7f41f2-cc94d1fc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:08.471621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0] Write session: try to update token
2025-10-02T08:12:08.471638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:08.484013Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:08.484031Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:08.484032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:08.484037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534228979065794:5233]
2025-10-02T08:12:08.484056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534228979065794:5233]
2025-10-02T08:12:08.484086Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:08.484088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:08.484091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:08.484093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.484096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:08.484226Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:08.485788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId: src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:08.488110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:08.546121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534228979065870:6995]
2025-10-02T08:12:08.546212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1376, pipe: [1:7556534228979065870:6995]
2025-10-02T08:12:08.611182Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:08.611476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.611489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.611529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979065870:6995], now have 1 active actors on pipe
2025-10-02T08:12:08.611671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:08.611685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:08.611735Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:08.611752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1377 reason: error at write: Disconnected sessionId: src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0
2025-10-02T08:12:08.611762Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:08.611912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1377 sessionId: src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0 is DEAD
2025-10-02T08:12:08.611998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534228979065870:6995]
2025-10-02T08:12:08.612079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:08.612087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0] Write session will restart in 0.005179s
2025-10-02T08:12:08.612110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0] Write session: Do CDS request
2025-10-02T08:12:08.612117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:08.618195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.618299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:08.618314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1378
2025-10-02T08:12:08.618436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.618465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:08.618470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:08.618473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:08.618902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1378 sessionId:  describe result for acl check
2025-10-02T08:12:08.618933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:08.618939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:08.618940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:08.618944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534228979066161:5212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:08.619432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534228979066161:5212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:08.622486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534228979066161:5212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:08.624486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:08.624754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:08.624906Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:08.624914Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:08.624921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:08.624960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:08.624991Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534228979066295:5210]
2025-10-02T08:12:08.625006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534228979066161:5212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:08.625017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534228979066161:5212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:08.625020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534228979066161:5212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:08.625026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:08.625481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:08.625612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:08.625639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:08.625820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:08.625845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.625849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.625849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.625850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.625851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.625854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.625860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.625862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.625864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.625866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.625869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.625874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.625877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.625880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.625882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.625885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.625887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.625890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.625892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.625894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.625903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:08.633188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:08.634706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:08.634720Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:08.634721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:08.634724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:08.634729Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1377 [1:7556534228979066295:5210]
2025-10-02T08:12:08.634736Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:08.634748Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:08.634750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.634752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.634753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.634765Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:08.634768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:08.634773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:08.634817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.634824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.634828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:08.634830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:08.634888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:08.634895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.634908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.634922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:08.634933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1377
2025-10-02T08:12:08.634943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979066300:5212], now have 1 active actors on pipe
2025-10-02T08:12:08.634946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534229438959279:2378], now have 1 active actors on pipe
2025-10-02T08:12:08.634952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534228979066289:5210]
2025-10-02T08:12:08.634954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534228979066289:5210]
2025-10-02T08:12:08.634963Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:08.634971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:08.634974Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:08.634975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.634978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.634994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:08.635011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:08.635018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:08.635055Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:08.635065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.635029Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1377
2025-10-02T08:12:08.635070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.635072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:08.635080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.635088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:08.635101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534228979066289:5210]
2025-10-02T08:12:08.635115Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:08.635129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:08.635145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.635209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.635214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.635224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.635254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1378 partition: 0 MaxSeqNo: 17 sessionId: src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0
2025-10-02T08:12:08.635549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9ab6d7-5abb479a-a2bd20cc-3180d57f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:08.638388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0] Write session: try to update token
2025-10-02T08:12:08.638405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:08.651888Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:08.651906Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:08.651908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:08.651914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534228979066289:5210]
2025-10-02T08:12:08.651918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534228979066289:5210]
2025-10-02T08:12:08.651956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:08.651962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.651964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:08.651964Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:08.651968Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:08.652109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId: src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:08.652119Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:08.654584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:08.712047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534228979066330:6995]
2025-10-02T08:12:08.712182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1377, pipe: [1:7556534228979066330:6995]
2025-10-02T08:12:08.778411Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:08.778705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.778714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.778745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979066330:6995], now have 1 active actors on pipe
2025-10-02T08:12:08.778841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534228979066330:6995]
2025-10-02T08:12:08.778857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:08.778858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:08.778894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1378 reason: error at write: Disconnected sessionId: src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0
2025-10-02T08:12:08.778986Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:08.778983Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:08.779043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1378 sessionId: src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0 is DEAD
2025-10-02T08:12:08.779270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:08.779281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0] Write session will restart in 0.007116s
2025-10-02T08:12:08.779308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0] Write session: Do CDS request
2025-10-02T08:12:08.779315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:08.787366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.787608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:08.787629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1379
2025-10-02T08:12:08.787802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.787843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:08.787864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:08.787872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:08.788384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1379 sessionId:  describe result for acl check
2025-10-02T08:12:08.788420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:08.788426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:08.788428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:08.788433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534228979066670:5200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:08.788943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534228979066670:5200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:08.791284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:08.791391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534228979066670:5200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:08.793002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:08.793171Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:08.793181Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:08.793190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:08.793238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:08.793272Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534228979066751:5196]
2025-10-02T08:12:08.793736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534228979066670:5200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:08.793749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534228979066670:5200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:08.793753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534228979066670:5200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:08.793759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:08.793803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:08.794003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:08.794043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:08.794305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:08.794352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.794358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.794359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.794360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.794361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.794365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.794373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.794377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.794380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.794383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.794388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.794394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.794399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.794403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.794406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.794410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.794414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.794418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.794421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.794425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.794440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:08.806117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:08.807609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:08.807626Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:08.807628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:08.807632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:08.807639Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1378 [1:7556534228979066751:5196]
2025-10-02T08:12:08.807652Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:08.807671Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:08.807673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.807677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.807678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.807696Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:08.807702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:08.807708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:08.808022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.808035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.808038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:08.808050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:08.808123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:08.808131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.808146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.808156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:08.808179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979066756:5200], now have 1 active actors on pipe
2025-10-02T08:12:08.808190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534228979066735:5196]
2025-10-02T08:12:08.808193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534228979066735:5196]
2025-10-02T08:12:08.808200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:08.808204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1378
2025-10-02T08:12:08.808212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:08.808213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534229438959286:2378], now have 1 active actors on pipe
2025-10-02T08:12:08.808216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:08.808222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:08.808235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:08.808244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:08.808252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.808256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.808303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534228979066735:5196]
2025-10-02T08:12:08.808311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:08.808326Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e566a591-abea8f47-f3b294b3-7be6627_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:08.808336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.808338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:08.808340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.808342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:08.808351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.808310Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1378
2025-10-02T08:12:08.808360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:08.808405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.808486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.808493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.808508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.808546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1379 partition: 0 MaxSeqNo: 17 sessionId: src_id|e566a591-abea8f47-f3b294b3-7be6627_0
2025-10-02T08:12:08.808911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150bfaf0-2c31bd2f-76d4239a-d3231846_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e566a591-abea8f47-f3b294b3-7be6627_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:08.811484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e566a591-abea8f47-f3b294b3-7be6627_0] Write session: try to update token
2025-10-02T08:12:08.811503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e566a591-abea8f47-f3b294b3-7be6627_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:08.825091Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:08.825108Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:08.825110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:08.825117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534228979066735:5196]
2025-10-02T08:12:08.825124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534228979066735:5196]
2025-10-02T08:12:08.825161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:08.825167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.825168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:08.825172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:08.825178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:08.825293Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:08.826056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId: src_id|e566a591-abea8f47-f3b294b3-7be6627_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:08.828673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:08.878936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534228979066781:6995]
2025-10-02T08:12:08.879078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1378, pipe: [1:7556534228979066781:6995]
2025-10-02T08:12:08.961721Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:08.962027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.962038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.962070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979066781:6995], now have 1 active actors on pipe
2025-10-02T08:12:08.962197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534228979066781:6995]
2025-10-02T08:12:08.962226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:08.962228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:08.962266Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:08.962285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1379 reason: error at write: Disconnected sessionId: src_id|e566a591-abea8f47-f3b294b3-7be6627_0
2025-10-02T08:12:08.962331Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:08.962470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1379 sessionId: src_id|e566a591-abea8f47-f3b294b3-7be6627_0 is DEAD
2025-10-02T08:12:08.962654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e566a591-abea8f47-f3b294b3-7be6627_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:08.962667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e566a591-abea8f47-f3b294b3-7be6627_0] Write session will restart in 0.009692s
2025-10-02T08:12:08.962692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e566a591-abea8f47-f3b294b3-7be6627_0] Write session: Do CDS request
2025-10-02T08:12:08.962699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e566a591-abea8f47-f3b294b3-7be6627_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:08.973244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e566a591-abea8f47-f3b294b3-7be6627_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.973271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:08.973286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1380
2025-10-02T08:12:08.973447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:08.973469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:08.973472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:08.973475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:08.973782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1380 sessionId:  describe result for acl check
2025-10-02T08:12:08.973805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:08.973806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:08.973807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:08.973810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534228979067163:5165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:08.974180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534228979067163:5165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:08.974345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:08.975706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534228979067163:5165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:08.975910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:08.976088Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:08.976098Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:08.976108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:08.976154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:08.976187Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534228979067199:5183]
2025-10-02T08:12:08.976696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:08.976866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:08.976908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:08.977125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:08.977156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.977160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.977160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.977161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.977162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.977165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.977170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.977174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.977177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.977180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.977185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.977193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:08.977198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.977202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:08.977206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.977210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:08.977213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.977217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.977221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.977225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.977242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:08.977989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534228979067163:5165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:08.977999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534228979067163:5165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:08.978002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534228979067163:5165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:08.978009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:08.987701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:08.989125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:08.989139Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:08.989140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:08.989142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:08.989147Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1379 [1:7556534228979067199:5183]
2025-10-02T08:12:08.989155Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:08.989167Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:08.989169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.989171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.989172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.989185Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:08.989188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:08.989195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:08.989236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.989238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.989240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:08.989242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:08.989291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:08.989297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:08.989307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:08.989313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:08.989326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534228979067173:5183]
2025-10-02T08:12:08.989332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534228979067173:5183]
2025-10-02T08:12:08.989337Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:08.989348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534228979067220:5165], now have 1 active actors on pipe
2025-10-02T08:12:08.989353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:08.989355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:08.989356Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:08.989362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:08.989364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:08.989366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1379
2025-10-02T08:12:08.989388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534229438959292:2378], now have 1 active actors on pipe
2025-10-02T08:12:08.989394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.989397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.989406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534228979067173:5183]
2025-10-02T08:12:08.989416Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:08.989424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:08.989438Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:08.989462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:08.989470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:08.989471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:08.989481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:08.989488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:08.989475Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1379
2025-10-02T08:12:08.989512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.989557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:08.989562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:08.989572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:08.989599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1380 partition: 0 MaxSeqNo: 17 sessionId: src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0
2025-10-02T08:12:08.989845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e566a591-abea8f47-f3b294b3-7be6627_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:08.992396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0] Write session: try to update token
2025-10-02T08:12:08.992412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:09.005902Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:09.005921Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:09.005923Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:09.005932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534228979067173:5183]
2025-10-02T08:12:09.005935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534228979067173:5183]
2025-10-02T08:12:09.005973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:09.005975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:09.005980Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:09.005980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.005982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:09.006118Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:09.009714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId: src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:09.012251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:09.062214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534233274034529:6995]
2025-10-02T08:12:09.062319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1379, pipe: [1:7556534233274034529:6995]
2025-10-02T08:12:09.131466Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:09.131746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.131756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.131794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274034529:6995], now have 1 active actors on pipe
2025-10-02T08:12:09.131900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534233274034529:6995]
2025-10-02T08:12:09.131921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:09.131926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:09.131946Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:09.131984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1380 reason: error at write: Disconnected sessionId: src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0
2025-10-02T08:12:09.132023Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:09.132138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1380 sessionId: src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0 is DEAD
2025-10-02T08:12:09.132289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:09.132298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0] Write session will restart in 0.005073s
2025-10-02T08:12:09.132322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0] Write session: Do CDS request
2025-10-02T08:12:09.132329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:09.138209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.138334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:09.138348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1381
2025-10-02T08:12:09.138467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.138491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:09.138494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:09.138497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:09.138812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1381 sessionId:  describe result for acl check
2025-10-02T08:12:09.138835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:09.138838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:09.138839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:09.138842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534233274034793:5159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:09.139196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534233274034793:5159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:09.142042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534233274034793:5159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:09.144187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:09.145686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:09.145867Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:09.145876Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:09.145882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:09.145894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534233274034793:5159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:09.145899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534233274034793:5159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:09.145901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534233274034793:5159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:09.145907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:09.145916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:09.145936Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534233274034954:5161]
2025-10-02T08:12:09.146378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:09.146510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:09.146534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:09.146710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:09.146736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.146736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.146737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.146738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.146738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.146741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.146747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.146749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.146751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.146753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.146756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.146760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.146763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.146766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.146768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.146771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.146773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.146775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.146779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.146781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.146791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:09.154386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:09.155792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:09.155805Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:09.155807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:09.155810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:09.155815Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1380 [1:7556534233274034954:5161]
2025-10-02T08:12:09.155824Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:09.155835Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:09.155837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.155839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.155840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.155853Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:09.155856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:09.155860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:09.155902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.155904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.155906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:09.155908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:09.155956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:09.155962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.155970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.155977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:09.155988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534233274034948:5161]
2025-10-02T08:12:09.155989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534233274034948:5161]
2025-10-02T08:12:09.155996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:09.156004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274034959:5159], now have 1 active actors on pipe
2025-10-02T08:12:09.156004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1380
2025-10-02T08:12:09.156010Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:09.156012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:09.156013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:09.156020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:09.156021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:09.156025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534233733926609:2378], now have 1 active actors on pipe
2025-10-02T08:12:09.156060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.156066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.156077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534233274034948:5161]
2025-10-02T08:12:09.156082Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:09.156093Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:09.156102Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:09.156109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.156111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.156112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:09.156119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.156096Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1380
2025-10-02T08:12:09.156126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:09.156148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.156179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.156183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.156192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.156219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1381 partition: 0 MaxSeqNo: 17 sessionId: src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0
2025-10-02T08:12:09.156510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66d96cb-5d06a63d-3dfa3d86-23878ccb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:09.159035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0] Write session: try to update token
2025-10-02T08:12:09.159048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:09.172073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId: src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:09.172422Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:09.172431Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:09.172433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:09.172440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534233274034948:5161]
2025-10-02T08:12:09.172444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534233274034948:5161]
2025-10-02T08:12:09.172474Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:09.172478Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:09.172480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:09.172484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.172485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:09.172609Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:09.174689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:09.232191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534233274034998:6995]
2025-10-02T08:12:09.232296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1380, pipe: [1:7556534233274034998:6995]
2025-10-02T08:12:09.312830Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:09.313098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.313108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.313138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274034998:6995], now have 1 active actors on pipe
2025-10-02T08:12:09.313239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534233274034998:6995]
2025-10-02T08:12:09.313261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:09.313263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:09.313317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1381 reason: error at write: Disconnected sessionId: src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0
2025-10-02T08:12:09.313345Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:09.313487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1381 sessionId: src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0 is DEAD
2025-10-02T08:12:09.313659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:09.313669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0] Write session will restart in 0.007089s
2025-10-02T08:12:09.313693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0] Write session: Do CDS request
2025-10-02T08:12:09.313702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:09.313827Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:09.322196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.322267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:09.322281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1382
2025-10-02T08:12:09.322480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.322507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:09.322514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:09.322516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:09.322840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1382 sessionId:  describe result for acl check
2025-10-02T08:12:09.322861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:09.322862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:09.322863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:09.322866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534233274035378:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:09.323202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534233274035378:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:09.323890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:09.325194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534233274035378:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:09.325236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:09.325469Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:09.325478Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:09.325487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:09.325530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:09.325561Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534233274035421:5111]
2025-10-02T08:12:09.326077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:09.326214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:09.326252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:09.326462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:09.326491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.326495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.326496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.326497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.326497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.326500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.326505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.326507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.326509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.326511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.326515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.326519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.326522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.326525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.326527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.326530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.326533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.326536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.326542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.326544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.326554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:09.330837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534233274035378:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:09.330848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534233274035378:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:09.330850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534233274035378:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:09.330857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:09.333889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:09.335222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:09.335234Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:09.335238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:09.335240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:09.335244Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1381 [1:7556534233274035421:5111]
2025-10-02T08:12:09.335251Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:09.335264Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:09.335266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.335268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.335270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.335282Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:09.335286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:09.335290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:09.335328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.335334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.335336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:09.335338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:09.335391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:09.335397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.335408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.335423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:09.335443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274035442:5115], now have 1 active actors on pipe
2025-10-02T08:12:09.335445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1381
2025-10-02T08:12:09.335452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534233274035395:5111]
2025-10-02T08:12:09.335455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534233274035395:5111]
2025-10-02T08:12:09.335463Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:09.335474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534233733926616:2378], now have 1 active actors on pipe
2025-10-02T08:12:09.335474Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:09.335476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:09.335485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:09.335496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:09.335504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:09.335511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.335518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.335551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534233274035395:5111]
2025-10-02T08:12:09.335558Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:09.335564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:09.335570Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:09.335526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1381
2025-10-02T08:12:09.335576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.335579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.335581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:09.335588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.335596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:09.335627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.335690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.335697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.335710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.335744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1382 partition: 0 MaxSeqNo: 17 sessionId: src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0
2025-10-02T08:12:09.336025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfdf0d1d-3caf2159-f1f7f791-a0609202_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:09.338468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0] Write session: try to update token
2025-10-02T08:12:09.338482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:09.345358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:09.345374Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:09.345383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534233274035395:5111]
2025-10-02T08:12:09.345421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:09.345432Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:09.345595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:09.345734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:09.345870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:09.346007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:09.346188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:09.346230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:09.351145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId: src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:09.353736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:09.353809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.353822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.353863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:09.353886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:09.353937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.353952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.354128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.354187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.354250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.354310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.354655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.354669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.354852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.354913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.354973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.355033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.355074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.355081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.355143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.355198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.355260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.355320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.355378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.355385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.355445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.355502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.355559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.355654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.355697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.355704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.355767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.355824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.355883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.355943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.355985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.355992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.356064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.356121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.356179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.356241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.356286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.356292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.356354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.356410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.356475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.356536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.356576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.356583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.356646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.356701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.356760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.356836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.356955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.356964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.357029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.357087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.357147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.357215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.357260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.357267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.357331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:09.357391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:09.357492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:09.357553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:09.357596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:09.357603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:09.357640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:09.357706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.357730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.357737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:09.357768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:09.357785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:09.357792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:09.357797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:09.357804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:09.358190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:09.358212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:09.358223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:09.358230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:09.358232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:09.358236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:09.358742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:09.358764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:09.358770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:09.358773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:09.358776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:09.358784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:09.359280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:09.359302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:09.359311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:09.359319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:09.359327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:09.361401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:09.361417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:09.361427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392729361
2025-10-02T08:12:09.361566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:09.361583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:09.361592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:09.361599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:09.361602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:09.361609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:09.362047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:09.362068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:09.362077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:09.362081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:09.362084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:09.362093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:09.362527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:09.362550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:09.362559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:09.362564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:09.362568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:09.362572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:09.363005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:09.363024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:09.363029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:09.364031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:09.364055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:09.364062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:09.364067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:09.364074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392729363
2025-10-02T08:12:09.364349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:09.364366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:09.364371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:09.364374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:09.364377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:09.364381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:09.364843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:09.364862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:09.364867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:09.364870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:09.364873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:09.364876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:09.365304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:09.365322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.365498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392729365
2025-10-02T08:12:09.366222Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:09.366251Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:09.366258Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:09.366265Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:09.367805Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:09.367820Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:09.367821Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:09.367831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534233274035395:5111]
2025-10-02T08:12:09.367835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534233274035395:5111]
2025-10-02T08:12:09.367874Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:09.367885Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:09.367888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:09.367892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.367894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:09.368023Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:09.413445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534233274035462:6995]
2025-10-02T08:12:09.413580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1381, pipe: [1:7556534233274035462:6995]
2025-10-02T08:12:09.491929Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:09.492188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274035462:6995], now have 1 active actors on pipe
2025-10-02T08:12:09.492346Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:09.492391Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:09.492441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:09.492450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:09.492470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1382 reason: error at write: Disconnected sessionId: src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0
2025-10-02T08:12:09.492551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534233274035462:6995]
2025-10-02T08:12:09.492581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1382 sessionId: src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0 is DEAD
2025-10-02T08:12:09.492688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:09.492697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0] Write session will restart in 0.009251s
2025-10-02T08:12:09.492715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0] Write session: Do CDS request
2025-10-02T08:12:09.492720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:09.503234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.503303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:09.503316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1383
2025-10-02T08:12:09.503399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.503419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:09.503425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:09.503428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:09.503703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1383 sessionId:  describe result for acl check
2025-10-02T08:12:09.503725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:09.503729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:09.503730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:09.503734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534233274035880:5058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:09.504096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534233274035880:5058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:09.504524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:09.505543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534233274035880:5058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:09.506263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:09.506386Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:09.506392Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:09.506399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:09.506428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:09.506452Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534233274035922:5061]
2025-10-02T08:12:09.506828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:09.506986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:09.507010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:09.507187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:09.507211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.507215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.507215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.507216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.507217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.507219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.507225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.507227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.507229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.507231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.507235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.507239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.507242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.507245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.507247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.507250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.507252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.507254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.507261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.507264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.507273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:09.507739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534233274035880:5058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:09.507750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534233274035880:5058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:09.507752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534233274035880:5058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:09.507757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:09.514514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:09.515954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:09.515970Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:09.515971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:09.515973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:09.515978Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1382 [1:7556534233274035922:5061]
2025-10-02T08:12:09.515985Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:09.515997Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:09.516004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.516006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.516008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.516020Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:09.516024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:09.516029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:09.516086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.516094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.516096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:09.516098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:09.516151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:09.516157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.516168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.516180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:09.516195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534233274035896:5061]
2025-10-02T08:12:09.516202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534233274035896:5061]
2025-10-02T08:12:09.516207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:09.516216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274035939:5058], now have 1 active actors on pipe
2025-10-02T08:12:09.516219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:09.516220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1382
2025-10-02T08:12:09.516222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:09.516229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:09.516229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:09.516231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:09.516234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534233733926623:2378], now have 1 active actors on pipe
2025-10-02T08:12:09.516253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534233274035896:5061]
2025-10-02T08:12:09.516261Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:09.516265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.516267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.516268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:09.516296Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:09.516306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.516276Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1382
2025-10-02T08:12:09.516310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.516316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:09.516324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.516331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:09.516346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.516374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.516379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.516387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.516421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1383 partition: 0 MaxSeqNo: 17 sessionId: src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0
2025-10-02T08:12:09.516688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3470bc63-89b81cca-26f3ba7d-cb3a32f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:09.519178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0] Write session: try to update token
2025-10-02T08:12:09.519193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:09.532786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId: src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:09.533129Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:09.533143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:09.533146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:09.533153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534233274035896:5061]
2025-10-02T08:12:09.533157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534233274035896:5061]
2025-10-02T08:12:09.533192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:09.533205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.533207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:09.533232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:09.533237Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:09.533337Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:09.535107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:09.592647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534233274035957:6995]
2025-10-02T08:12:09.592748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1382, pipe: [1:7556534233274035957:6995]
2025-10-02T08:12:09.671059Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:09.671331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.671343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.671378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274035957:6995], now have 1 active actors on pipe
2025-10-02T08:12:09.671508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534233274035957:6995]
2025-10-02T08:12:09.671530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:09.671532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:09.671579Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:09.671581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1383 reason: error at write: Disconnected sessionId: src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0
2025-10-02T08:12:09.671587Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:09.671714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1383 sessionId: src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0 is DEAD
2025-10-02T08:12:09.671842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:09.671861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0] Write session will restart in 0.006773s
2025-10-02T08:12:09.671880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0] Write session: Do CDS request
2025-10-02T08:12:09.671885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:09.679194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.679260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:09.679273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1384
2025-10-02T08:12:09.679393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.679419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:09.679426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:09.679429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:09.679900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1384 sessionId:  describe result for acl check
2025-10-02T08:12:09.679924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:09.679929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:09.679931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:09.679935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534233274036277:5048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:09.680286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534233274036277:5048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:09.682539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534233274036277:5048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:09.683701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:09.685067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:09.685263Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:09.685274Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:09.685282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:09.685311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534233274036277:5048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:09.685322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:09.685335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534233274036277:5048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:09.685342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534233274036277:5048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:09.685347Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534233274036398:5049]
2025-10-02T08:12:09.685349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:09.685909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:09.686042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:09.686073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:09.686326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:09.686362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.686367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.686368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.686369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.686370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.686375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.686384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.686387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.686391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.686394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.686399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.686405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.686415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.686419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.686423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.686429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.686436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.686440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.686444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.686452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.686467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:09.693629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:09.695033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:09.695049Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:09.695051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:09.695054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:09.695059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1383 [1:7556534233274036398:5049]
2025-10-02T08:12:09.695068Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:09.695082Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:09.695089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.695091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.695093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.695105Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:09.695113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:09.695123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:09.695177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.695184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.695186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:09.695188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:09.695241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:09.695247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.695257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.695272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:09.695281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1383
2025-10-02T08:12:09.695292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274036403:5048], now have 1 active actors on pipe
2025-10-02T08:12:09.695295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534233733926654:2378], now have 1 active actors on pipe
2025-10-02T08:12:09.695304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534233274036391:5049]
2025-10-02T08:12:09.695310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534233274036391:5049]
2025-10-02T08:12:09.695321Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:09.695331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:09.695333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:09.695335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.695340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.695356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:09.695368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:09.695370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:09.695398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3acce825-bd007ab8-16f9668f-aa74adca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:09.695407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.695410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.695412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:09.695363Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1383
2025-10-02T08:12:09.695420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.695430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:09.695440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534233274036391:5049]
2025-10-02T08:12:09.695451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:09.695458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:09.695475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.695516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.695522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.695533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.695565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1384 partition: 0 MaxSeqNo: 17 sessionId: src_id|3acce825-bd007ab8-16f9668f-aa74adca_0
2025-10-02T08:12:09.695864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c13bd0-64e6b7f8-6249c862-115511c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3acce825-bd007ab8-16f9668f-aa74adca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:09.698098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3acce825-bd007ab8-16f9668f-aa74adca_0] Write session: try to update token
2025-10-02T08:12:09.698110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3acce825-bd007ab8-16f9668f-aa74adca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:09.710913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId: src_id|3acce825-bd007ab8-16f9668f-aa74adca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:09.711768Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:09.711787Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:09.711789Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:09.711797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534233274036391:5049]
2025-10-02T08:12:09.711801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534233274036391:5049]
2025-10-02T08:12:09.711840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:09.711847Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:09.711852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.711852Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:09.711854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:09.711992Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:09.713381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:09.771832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534233274036432:6995]
2025-10-02T08:12:09.771936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1383, pipe: [1:7556534233274036432:6995]
2025-10-02T08:12:09.842742Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:09.843039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.843049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.843079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274036432:6995], now have 1 active actors on pipe
2025-10-02T08:12:09.843205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534233274036432:6995]
2025-10-02T08:12:09.843244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:09.843250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:09.843317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1384 reason: error at write: Disconnected sessionId: src_id|3acce825-bd007ab8-16f9668f-aa74adca_0
2025-10-02T08:12:09.843299Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:09.843456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1384 sessionId: src_id|3acce825-bd007ab8-16f9668f-aa74adca_0 is DEAD
2025-10-02T08:12:09.843506Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:09.843575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acce825-bd007ab8-16f9668f-aa74adca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:09.843580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acce825-bd007ab8-16f9668f-aa74adca_0] Write session will restart in 0.009612s
2025-10-02T08:12:09.843597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acce825-bd007ab8-16f9668f-aa74adca_0] Write session: Do CDS request
2025-10-02T08:12:09.843602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acce825-bd007ab8-16f9668f-aa74adca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:09.854240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3acce825-bd007ab8-16f9668f-aa74adca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.854308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:09.854325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1385
2025-10-02T08:12:09.854418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:09.854438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:09.854443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:09.854446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:09.854801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1385 sessionId:  describe result for acl check
2025-10-02T08:12:09.854834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:09.854840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:09.854841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:09.854845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534233274036829:5017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:09.854902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:09.855250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534233274036829:5017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:09.856441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:09.856586Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:09.856594Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:09.856602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:09.856639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:09.856670Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534233274036853:5021]
2025-10-02T08:12:09.857121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534233274036829:5017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:09.857218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:09.857381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:09.857425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:09.857851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:09.857912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.857918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.857919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.857920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.857921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.857926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.857934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.857938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.857941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.857944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.857949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.857960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:09.857970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.857978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:09.857984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.857988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:09.857992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.857999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.858003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.858011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.858027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:09.862428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534233274036829:5017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:09.862441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534233274036829:5017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:09.862444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534233274036829:5017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:09.862451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:09.865577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:09.867365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:09.867378Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:09.867380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:09.867383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:09.867388Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1384 [1:7556534233274036853:5021]
2025-10-02T08:12:09.867398Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:09.867413Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:09.867415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.867418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.867420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.867434Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:09.867438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:09.867444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:09.867493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.867500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.867503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:09.867505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:09.867559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:09.867566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.867576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:09.867593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:09.867613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274036880:5017], now have 1 active actors on pipe
2025-10-02T08:12:09.867617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1384
2025-10-02T08:12:09.867622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534233274036828:5021]
2025-10-02T08:12:09.867624Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534233274036828:5021]
2025-10-02T08:12:09.867634Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:09.867642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534233733926661:2378], now have 1 active actors on pipe
2025-10-02T08:12:09.867648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:09.867648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.867650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:09.867652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.867666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:09.867683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:09.867689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:09.867720Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|641a9eed-704d4dd7-dc920559-62610ada_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:09.867730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:09.867733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:09.867735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:09.867743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:09.867689Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1384
2025-10-02T08:12:09.867754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:09.867765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534233274036828:5021]
2025-10-02T08:12:09.867772Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:09.867778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:09.867797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.867841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:09.867847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:09.867858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:09.867892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1385 partition: 0 MaxSeqNo: 17 sessionId: src_id|641a9eed-704d4dd7-dc920559-62610ada_0
2025-10-02T08:12:09.868222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acce825-bd007ab8-16f9668f-aa74adca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|641a9eed-704d4dd7-dc920559-62610ada_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:09.870618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641a9eed-704d4dd7-dc920559-62610ada_0] Write session: try to update token
2025-10-02T08:12:09.870633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641a9eed-704d4dd7-dc920559-62610ada_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:09.883836Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:09.883856Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:09.883858Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:09.883867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534233274036828:5021]
2025-10-02T08:12:09.883871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534233274036828:5021]
2025-10-02T08:12:09.883911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:09.883914Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:09.883919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:09.883919Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:09.883921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:09.884040Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:09.884789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId: src_id|641a9eed-704d4dd7-dc920559-62610ada_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:09.887316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:09.943401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534233274036895:6995]
2025-10-02T08:12:09.943532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1384, pipe: [1:7556534233274036895:6995]
2025-10-02T08:12:10.019945Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:10.020237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.020252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.020288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534233274036895:6995], now have 1 active actors on pipe
2025-10-02T08:12:10.020408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:10.020417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:10.020470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1385 reason: error at write: Disconnected sessionId: src_id|641a9eed-704d4dd7-dc920559-62610ada_0
2025-10-02T08:12:10.020561Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:10.020644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1385 sessionId: src_id|641a9eed-704d4dd7-dc920559-62610ada_0 is DEAD
2025-10-02T08:12:10.020795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641a9eed-704d4dd7-dc920559-62610ada_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:10.020815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641a9eed-704d4dd7-dc920559-62610ada_0] Write session will restart in 0.007405s
2025-10-02T08:12:10.020794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534233274036895:6995]
2025-10-02T08:12:10.020839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641a9eed-704d4dd7-dc920559-62610ada_0] Write session: Do CDS request
2025-10-02T08:12:10.020848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641a9eed-704d4dd7-dc920559-62610ada_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:10.021283Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:10.029212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641a9eed-704d4dd7-dc920559-62610ada_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.029396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:10.029411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1386
2025-10-02T08:12:10.029513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.029540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:10.029548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:10.029551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:10.029898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1386 sessionId:  describe result for acl check
2025-10-02T08:12:10.029924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:10.029929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:10.029931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:10.029935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534237569004553:5004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:10.030387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534237569004553:5004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:10.031844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:10.032101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534237569004553:5004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:10.033046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:10.033158Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:10.033164Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:10.033170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:10.033201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:10.033223Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534237569004624:5003]
2025-10-02T08:12:10.033585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:10.033744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:10.033788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:10.034025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:10.034055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.034060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.034061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.034061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.034062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.034065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.034070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.034072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.034074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.034076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.034079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.034083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.034088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.034093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.034096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.034104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.034107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.034111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.034115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.034123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.034139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:10.034185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534237569004553:5004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:10.034196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534237569004553:5004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:10.034198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534237569004553:5004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:10.034202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:10.041442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:10.043022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:10.043034Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:10.043035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:10.043038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:10.043042Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1385 [1:7556534237569004624:5003]
2025-10-02T08:12:10.043049Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:10.043060Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:10.043066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.043068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.043069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.043080Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:10.043083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:10.043088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:10.043133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.043141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.043143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:10.043144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:10.043196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:10.043203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.043213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.043228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:10.043246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534237569004608:5003]
2025-10-02T08:12:10.043252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534237569004608:5003]
2025-10-02T08:12:10.043252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1385
2025-10-02T08:12:10.043258Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:10.043269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569004640:5004], now have 1 active actors on pipe
2025-10-02T08:12:10.043268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:10.043271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:10.043280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:10.043292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:10.043294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:10.043300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.043308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.043322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534238028893963:2378], now have 1 active actors on pipe
2025-10-02T08:12:10.043347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534237569004608:5003]
2025-10-02T08:12:10.043358Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:10.043369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:10.043372Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:10.043378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.043382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.043384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:10.043393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.043401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:10.043360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1385
2025-10-02T08:12:10.043445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.043510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.043518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.043530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.043567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1386 partition: 0 MaxSeqNo: 17 sessionId: src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0
2025-10-02T08:12:10.043882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641a9eed-704d4dd7-dc920559-62610ada_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:10.046542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0] Write session: try to update token
2025-10-02T08:12:10.046557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:10.058911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId: src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:10.059744Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:10.059758Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:10.059759Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:10.059765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534237569004608:5003]
2025-10-02T08:12:10.059768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534237569004608:5003]
2025-10-02T08:12:10.059799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:10.059806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.059807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:10.059924Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:10.059953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:10.059969Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:10.061401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:10.121045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534237569004656:6995]
2025-10-02T08:12:10.121163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1385, pipe: [1:7556534237569004656:6995]
2025-10-02T08:12:10.182671Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:10.182978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.182989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.183020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569004656:6995], now have 1 active actors on pipe
2025-10-02T08:12:10.183111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:10.183129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:10.183194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1386 reason: error at write: Disconnected sessionId: src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0
2025-10-02T08:12:10.183243Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:10.183340Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:10.183364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1386 sessionId: src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0 is DEAD
2025-10-02T08:12:10.183518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:10.183523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0] Write session will restart in 0.005371s
2025-10-02T08:12:10.183517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534237569004656:6995]
2025-10-02T08:12:10.183541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0] Write session: Do CDS request
2025-10-02T08:12:10.183546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:10.190273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.190444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:10.190459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1387
2025-10-02T08:12:10.190589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.190628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:10.190637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:10.190641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:10.191124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1387 sessionId:  describe result for acl check
2025-10-02T08:12:10.191155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:10.191161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:10.191163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:10.191168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534237569004953:4988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:10.191615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534237569004953:4988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:10.194290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534237569004953:4988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:10.196238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:10.198016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:10.198198Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:10.198208Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:10.198217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:10.198263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:10.198300Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534237569005104:4989]
2025-10-02T08:12:10.198467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534237569004953:4988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:10.198478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534237569004953:4988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:10.198480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534237569004953:4988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:10.198486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:10.198911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:10.199067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:10.199104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:10.199464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:10.199508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.199513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.199514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.199515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.199516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.199521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.199530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.199534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.199538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.199541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.199546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.199553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.199564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.199569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.199576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.199581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.199587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.199596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.199600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.199608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.199626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:10.207126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:10.208650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:10.208669Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:10.208672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:10.208676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:10.208682Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1386 [1:7556534237569005104:4989]
2025-10-02T08:12:10.208693Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:10.208708Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:10.208711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.208714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.208716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.208731Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:10.208741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:10.208749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:10.208819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.208830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.208834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:10.208836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:10.208904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:10.208912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.208923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.208939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:10.208960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569005109:4988], now have 1 active actors on pipe
2025-10-02T08:12:10.208965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1386
2025-10-02T08:12:10.208970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534237569005098:4989]
2025-10-02T08:12:10.208971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534237569005098:4989]
2025-10-02T08:12:10.208983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:10.208994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534238028893983:2378], now have 1 active actors on pipe
2025-10-02T08:12:10.208999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:10.209002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:10.209002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:10.209013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:10.209015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:10.209022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.209026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.209035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1386
2025-10-02T08:12:10.209062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534237569005098:4989]
2025-10-02T08:12:10.209073Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:10.209079Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:10.209086Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:10.209091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.209095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.209097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:10.209112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.209124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:10.209167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.209225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.209232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.209243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.209279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1387 partition: 0 MaxSeqNo: 17 sessionId: src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0
2025-10-02T08:12:10.209608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3371105c-cdb84f12-9d08d4e7-dd989bdf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:10.212217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0] Write session: try to update token
2025-10-02T08:12:10.212229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:10.223496Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:10.223523Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:10.223535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534237569005098:4989]
2025-10-02T08:12:10.223575Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:10.223587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:10.223958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:10.224247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:10.224516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:10.224762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:10.225150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:10.225218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:10.225897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId: src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:10.228103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:10.228178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.228188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.228215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:10.228234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:10.228274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.228291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.228446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.228506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.228581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.228649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.228859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.228868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.228935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.229003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.229069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.229134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.229182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.229188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.229251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.229316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.229374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.229432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.229479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.229487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.229552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.229613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.229677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.229742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.229786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.229792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.229858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.229932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.229994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.230050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.230089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.230094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.230149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.230203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.230257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.230312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.230356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.230362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.230420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.230471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.230530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.230588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.230627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.230632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.230688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.230744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.230798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.230851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.230905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.230907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.230971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.231030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.231092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.231157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.231201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.231208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.231276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.231341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.231403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.231470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.231521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.231529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.231565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:10.231630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.231651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.231658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:10.231687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:10.231702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:10.231709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:10.231712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:10.231719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:10.232145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:10.232173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:10.232189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:10.232192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:10.232195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:10.232197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:10.232819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:10.232917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:10.232923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:10.232926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:10.232929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:10.232932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:10.233400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:10.233413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:10.233420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:10.233423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:10.233426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:10.237179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:10.237201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:10.237212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392730237
2025-10-02T08:12:10.237402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:10.237425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:10.237432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:10.237435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:10.237440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:10.237443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:10.237909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:10.237934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:10.237940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:10.237943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:10.237948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:10.237953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:10.238454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:10.238479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:10.238489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:10.238493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:10.238500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:10.238503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:10.238974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:10.238998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:10.239002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:10.240085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:10.240104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:10.240109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:10.240113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:10.240124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392730239
2025-10-02T08:12:10.240408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:10.240432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:10.240443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:10.240447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:10.240452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:10.240458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:10.240928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:10.240948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:10.240954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:10.240957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:10.240960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:10.240965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:10.241427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:10.241450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.241553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392730241
2025-10-02T08:12:10.242315Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:10.242334Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:10.242338Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:10.242343Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:10.243722Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:10.243734Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:10.243735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:10.243739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534237569005098:4989]
2025-10-02T08:12:10.243741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534237569005098:4989]
2025-10-02T08:12:10.243782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:10.243785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:10.243789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:10.243790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.243791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:10.243908Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:10.283866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534237569005144:6995]
2025-10-02T08:12:10.283991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1386, pipe: [1:7556534237569005144:6995]
2025-10-02T08:12:10.369020Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:10.369311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569005144:6995], now have 1 active actors on pipe
2025-10-02T08:12:10.369423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534237569005144:6995]
2025-10-02T08:12:10.369496Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:10.369451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:10.369458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:10.369471Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:10.369494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1387 reason: error at write: Disconnected sessionId: src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0
2025-10-02T08:12:10.369803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:10.369812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0] Write session will restart in 0.006509s
2025-10-02T08:12:10.369828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0] Write session: Do CDS request
2025-10-02T08:12:10.369834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:10.369643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1387 sessionId: src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0 is DEAD
2025-10-02T08:12:10.377274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.377341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:10.377356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1388
2025-10-02T08:12:10.377468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.377498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:10.377502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:10.377506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:10.378082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1388 sessionId:  describe result for acl check
2025-10-02T08:12:10.378110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:10.378116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:10.378118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:10.378122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534237569005442:4974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:10.378627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534237569005442:4974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:10.381648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534237569005442:4974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:10.383474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:10.385121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:10.385294Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:10.385306Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:10.385315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:10.385360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:10.385501Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534237569005581:4979]
2025-10-02T08:12:10.385581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534237569005442:4974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:10.385597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534237569005442:4974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:10.385600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534237569005442:4974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:10.385608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:10.386064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:10.386237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:10.386278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:10.386544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:10.386585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.386590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.386591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.386592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.386592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.386597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.386606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.386610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.386614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.386617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.386621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.386628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.386632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.386637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.386640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.386644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.386648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.386652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.386656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.386660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.386678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:10.394131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:10.395554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:10.395567Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:10.395568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:10.395571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:10.395575Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1387 [1:7556534237569005581:4979]
2025-10-02T08:12:10.395584Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:10.395594Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:10.395596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.395598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.395599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.395610Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:10.395613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:10.395618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:10.395663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.395670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.395673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:10.395675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:10.395732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:10.395739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.395749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.395760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:10.395776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569005586:4974], now have 1 active actors on pipe
2025-10-02T08:12:10.395777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1387
2025-10-02T08:12:10.395786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534237569005575:4979]
2025-10-02T08:12:10.395790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534237569005575:4979]
2025-10-02T08:12:10.395801Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:10.395812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534238028893989:2378], now have 1 active actors on pipe
2025-10-02T08:12:10.395813Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:10.395815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:10.395818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:10.395830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:10.395833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:10.395840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.395845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.395881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534237569005575:4979]
2025-10-02T08:12:10.395890Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:10.395898Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:10.395902Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:10.395908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.395886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1387
2025-10-02T08:12:10.395911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.395913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:10.395921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.395929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:10.395957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.396005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.396012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.396026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.396074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1388 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0
2025-10-02T08:12:10.396381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728b03d5-af6faa0d-b35f5a15-5fcb02d5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:10.398911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0] Write session: try to update token
2025-10-02T08:12:10.398928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:10.412109Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:10.412128Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:10.412129Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:10.412135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534237569005575:4979]
2025-10-02T08:12:10.412138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534237569005575:4979]
2025-10-02T08:12:10.412164Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:10.412167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:10.412168Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:10.412172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.412173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:10.412289Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:10.412671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId: src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:10.415183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:10.469707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534237569005613:6995]
2025-10-02T08:12:10.469803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1387, pipe: [1:7556534237569005613:6995]
2025-10-02T08:12:10.541428Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:10.541768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.541781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.541818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569005613:6995], now have 1 active actors on pipe
2025-10-02T08:12:10.541929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:10.541941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:10.541977Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:10.542004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1388 reason: error at write: Disconnected sessionId: src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0
2025-10-02T08:12:10.542030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:10.542162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1388 sessionId: src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0 is DEAD
2025-10-02T08:12:10.542240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534237569005613:6995]
2025-10-02T08:12:10.542300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:10.542309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0] Write session will restart in 0.007686s
2025-10-02T08:12:10.542331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0] Write session: Do CDS request
2025-10-02T08:12:10.542337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:10.551222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.551314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:10.551328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1389
2025-10-02T08:12:10.551427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.551447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:10.551453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:10.551455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:10.551760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1389 sessionId:  describe result for acl check
2025-10-02T08:12:10.551782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:10.551786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:10.551787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:10.551790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534237569006013:4950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:10.552201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534237569006013:4950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:10.553846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:10.554006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534237569006013:4950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:10.555250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:10.555389Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:10.555397Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:10.555403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:10.555433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:10.555458Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534237569006085:4947]
2025-10-02T08:12:10.555882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:10.555988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:10.556022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:10.556286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:10.556323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.556329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.556330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.556331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.556331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.556333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534237569006013:4950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:10.556336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.556338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534237569006013:4950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:10.556340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534237569006013:4950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:10.556345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.556345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:10.556348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.556352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.556355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.556360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.556367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.556376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.556384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.556388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.556394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.556402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.556410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.556419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.556428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.556445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:10.563661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:10.565198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:10.565215Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:10.565217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:10.565220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:10.565226Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1388 [1:7556534237569006085:4947]
2025-10-02T08:12:10.565237Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:10.565253Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:10.565256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.565258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.565260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.565275Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:10.565286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:10.565292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:10.565357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.565364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.565367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:10.565370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:10.565431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:10.565439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.565452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.565467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:10.565487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569006097:4950], now have 1 active actors on pipe
2025-10-02T08:12:10.565496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534237569006068:4947]
2025-10-02T08:12:10.565498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534237569006068:4947]
2025-10-02T08:12:10.565504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:10.565515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:10.565520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:10.565524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:10.565537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:10.565539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:10.565545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534238028893996:2378], now have 1 active actors on pipe
2025-10-02T08:12:10.565549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.565553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.565590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534237569006068:4947]
2025-10-02T08:12:10.565612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:10.565626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:10.565630Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4eebb928-3e17229e-82b594fe-771ae78c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:10.565636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.565639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.565641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:10.565649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.565616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1388
2025-10-02T08:12:10.565660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:10.565699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.565734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1388
2025-10-02T08:12:10.565763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.565772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.565793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.565841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1389 partition: 0 MaxSeqNo: 17 sessionId: src_id|4eebb928-3e17229e-82b594fe-771ae78c_0
2025-10-02T08:12:10.566178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3fc12e-fdbe4144-1a8d2618-7c942431_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4eebb928-3e17229e-82b594fe-771ae78c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:10.568745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eebb928-3e17229e-82b594fe-771ae78c_0] Write session: try to update token
2025-10-02T08:12:10.568759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eebb928-3e17229e-82b594fe-771ae78c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:10.576081Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:10.576101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:10.576111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534237569006068:4947]
2025-10-02T08:12:10.576150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:10.576167Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:10.576317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:10.576460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:10.576599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:10.576727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:10.576928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:10.576963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:10.581460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId: src_id|4eebb928-3e17229e-82b594fe-771ae78c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:10.583692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:10.583755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.583767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.583790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:10.583808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:10.583847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.583862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.583996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.584065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.584120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.584174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.584214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.584220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.584279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.584331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.584388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.584445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.584483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.584489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.584558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.584611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.584668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.584724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.584765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.584770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.584848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.584908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.584965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.585020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.585058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.585063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.585121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.585177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.585234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.585291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.585334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.585340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.585398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.585452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.585508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.585566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.585619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.585625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.585680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.585733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.585790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.585845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.585891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.585896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.585954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.586008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.586066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.586121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.586161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.586167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.586224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.586277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.586332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.586387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.586426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.586431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.586487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:10.586543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:10.586598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:10.586655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:10.586703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:10.586708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:10.586736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:10.586785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.586800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.586805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:10.586828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:10.586841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:10.586843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:10.586845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:10.586847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:10.587186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:10.587207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:10.587212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:10.587214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:10.587216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:10.587218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:10.587802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:10.587820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:10.587826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:10.587828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:10.587830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:10.587832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:10.588319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:10.588337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:10.588340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:10.588342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:10.588344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:10.590853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:10.590872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:10.590881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392730590
2025-10-02T08:12:10.590986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:10.590997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:10.591000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:10.591002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:10.591005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:10.591007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:10.591532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:10.591552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:10.591555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:10.591557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:10.591559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:10.591561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:10.592033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:10.592060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:10.592066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:10.592072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:10.592074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:10.592076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:10.592478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:10.592495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:10.592499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:10.593542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:10.593558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:10.593564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:10.593567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:10.593572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392730593
2025-10-02T08:12:10.593832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:10.593848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:10.593851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:10.593854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:10.593856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:10.593858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:10.594277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:10.594294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:10.594297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:10.594301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:10.594303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:10.594305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:10.594704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:10.594721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.594795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392730594
2025-10-02T08:12:10.595504Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:10.595524Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:10.595529Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:10.595533Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:10.597072Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:10.597084Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:10.597085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:10.597090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534237569006068:4947]
2025-10-02T08:12:10.597092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534237569006068:4947]
2025-10-02T08:12:10.597136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:10.597142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.597143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:10.597268Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:10.597284Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:10.597298Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:10.642230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534237569006124:6995]
2025-10-02T08:12:10.642332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1388, pipe: [1:7556534237569006124:6995]
2025-10-02T08:12:10.727047Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:10.727345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569006124:6995], now have 1 active actors on pipe
2025-10-02T08:12:10.727545Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:10.727746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534237569006124:6995]
2025-10-02T08:12:10.727774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:10.727752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:10.727805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1389 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4eebb928-3e17229e-82b594fe-771ae78c_0
2025-10-02T08:12:10.727941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1389 sessionId: src_id|4eebb928-3e17229e-82b594fe-771ae78c_0 is DEAD
2025-10-02T08:12:10.728095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eebb928-3e17229e-82b594fe-771ae78c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:10.728107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eebb928-3e17229e-82b594fe-771ae78c_0] Write session will restart in 0.008518s
2025-10-02T08:12:10.728131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eebb928-3e17229e-82b594fe-771ae78c_0] Write session: Do CDS request
2025-10-02T08:12:10.728137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eebb928-3e17229e-82b594fe-771ae78c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:10.737191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eebb928-3e17229e-82b594fe-771ae78c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.737261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:10.737277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1390
2025-10-02T08:12:10.737379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.737402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:10.737405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:10.737408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:10.737688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1390 sessionId:  describe result for acl check
2025-10-02T08:12:10.737715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:10.737717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:10.737718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:10.737721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534237569006500:4911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:10.738072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534237569006500:4911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:10.739756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534237569006500:4911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:10.739992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:10.741959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:10.742134Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:10.742143Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:10.742152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:10.742163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534237569006500:4911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:10.742168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534237569006500:4911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:10.742170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534237569006500:4911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:10.742174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:10.742197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:10.742235Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534237569006576:4916]
2025-10-02T08:12:10.742768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:10.742938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:10.742977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:10.743244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:10.743291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.743297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.743298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.743298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.743299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.743304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.743313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.743316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.743319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.743323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.743327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.743333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.743339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.743343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.743346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.743351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.743355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.743358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.743362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.743366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.743382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:10.751047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:10.753156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:10.753174Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:10.753176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:10.753179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:10.753185Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1389 [1:7556534237569006576:4916]
2025-10-02T08:12:10.753197Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:10.753214Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:10.753217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.753219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.753221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.753237Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:10.753242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:10.753248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:10.753316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.753329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.753332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:10.753334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:10.753398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:10.753404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.753416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.753430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:10.753450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534237569006562:4916]
2025-10-02T08:12:10.753456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534237569006562:4916]
2025-10-02T08:12:10.753466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:10.753473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1389
2025-10-02T08:12:10.753478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:10.753482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:10.753483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569006580:4911], now have 1 active actors on pipe
2025-10-02T08:12:10.753491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:10.753507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:10.753514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:10.753521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534238028894027:2378], now have 1 active actors on pipe
2025-10-02T08:12:10.753525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.753534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.753573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534237569006562:4916]
2025-10-02T08:12:10.753585Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:10.753594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:10.753604Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:10.753610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.753614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.753584Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1389
2025-10-02T08:12:10.753616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:10.753624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.753632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:10.753668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.753727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.753733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.753746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.753785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1390 partition: 0 MaxSeqNo: 17 sessionId: src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0
2025-10-02T08:12:10.754090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eebb928-3e17229e-82b594fe-771ae78c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:10.756515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0] Write session: try to update token
2025-10-02T08:12:10.756526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:10.769281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId: src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:10.770641Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:10.770658Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:10.770660Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:10.770667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534237569006562:4916]
2025-10-02T08:12:10.770670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534237569006562:4916]
2025-10-02T08:12:10.770704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:10.770709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.770711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:10.770716Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:10.770722Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:10.770833Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:10.771620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:10.828141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534237569006609:6995]
2025-10-02T08:12:10.828248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1389, pipe: [1:7556534237569006609:6995]
2025-10-02T08:12:10.897293Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:10.897535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.897546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.897578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569006609:6995], now have 1 active actors on pipe
2025-10-02T08:12:10.897694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534237569006609:6995]
2025-10-02T08:12:10.897711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:10.897714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:10.897760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1390 reason: error at write: Disconnected sessionId: src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0
2025-10-02T08:12:10.897829Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:10.897830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:10.897905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1390 sessionId: src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0 is DEAD
2025-10-02T08:12:10.898045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:10.898052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0] Write session will restart in 0.009661s
2025-10-02T08:12:10.898072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0] Write session: Do CDS request
2025-10-02T08:12:10.898077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:10.909388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.909484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:10.909501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1391
2025-10-02T08:12:10.909614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:10.909650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:10.909659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:10.909662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:10.910122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1391 sessionId:  describe result for acl check
2025-10-02T08:12:10.910152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:10.910158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:10.910160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:10.910165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534237569007004:4903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:10.910637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534237569007004:4903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:10.911723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:10.912786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534237569007004:4903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:10.913488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:10.913780Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:10.913796Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:10.913809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:10.913878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:10.913915Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534237569007051:4905]
2025-10-02T08:12:10.914516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:10.914724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:10.914777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:10.915066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:10.915111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.915117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.915118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.915119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.915120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.915125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.915134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.915137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.915141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.915144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.915149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.915155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:10.915162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.915166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:10.915170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.915174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:10.915178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.915182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.915186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.915195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.915211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:10.915406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534237569007004:4903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:10.915420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534237569007004:4903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:10.915422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534237569007004:4903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:10.915431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:10.922859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:10.924438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:10.924454Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:10.924456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:10.924459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:10.924464Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1390 [1:7556534237569007051:4905]
2025-10-02T08:12:10.924475Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:10.924490Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:10.924492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.924495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.924498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.924511Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:10.924516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:10.924522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:10.924578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.924585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.924587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:10.924589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:10.924647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:10.924653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.924665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:10.924679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:10.924695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1390
2025-10-02T08:12:10.924698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569007068:4903], now have 1 active actors on pipe
2025-10-02T08:12:10.924704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534237569007029:4905]
2025-10-02T08:12:10.924706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534237569007029:4905]
2025-10-02T08:12:10.924713Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:10.924723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.924723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:10.924727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.924726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:10.924741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:10.924753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:10.924755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:10.924761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534238028894033:2378], now have 1 active actors on pipe
2025-10-02T08:12:10.924792Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:10.924819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:10.924821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:10.924823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:10.924832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:10.924844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:10.924851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534237569007029:4905]
2025-10-02T08:12:10.924854Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:10.924858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:10.924836Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1390
2025-10-02T08:12:10.924873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.924946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:10.924953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:10.924964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:10.925001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1391 partition: 0 MaxSeqNo: 17 sessionId: src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0
2025-10-02T08:12:10.925330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bdd364-2d000adc-37f24e9d-ee3f332e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:10.927771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0] Write session: try to update token
2025-10-02T08:12:10.927787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:10.941630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId: src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:10.942304Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:10.942320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:10.942322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:10.942329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534237569007029:4905]
2025-10-02T08:12:10.942333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534237569007029:4905]
2025-10-02T08:12:10.942370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:10.942375Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:10.942380Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:10.942381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:10.942382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:10.942516Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:10.944137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:10.998092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534237569007083:6995]
2025-10-02T08:12:10.998214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1390, pipe: [1:7556534237569007083:6995]
2025-10-02T08:12:11.073831Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:11.074098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.074108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.074139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534237569007083:6995], now have 1 active actors on pipe
2025-10-02T08:12:11.074193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:11.074197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:11.074243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1391 reason: error at write: Disconnected sessionId: src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0
2025-10-02T08:12:11.074325Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:11.074344Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:11.074391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1391 sessionId: src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0 is DEAD
2025-10-02T08:12:11.074509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534237569007083:6995]
2025-10-02T08:12:11.074565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:11.074576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0] Write session will restart in 0.006488s
2025-10-02T08:12:11.074604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0] Write session: Do CDS request
2025-10-02T08:12:11.074611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:11.082163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.082227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:11.082238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1392
2025-10-02T08:12:11.082335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.082355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:11.082362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:11.082365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:11.082777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1392 sessionId:  describe result for acl check
2025-10-02T08:12:11.082809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:11.082815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:11.082816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:11.082820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534241863974714:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:11.083282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534241863974714:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:11.085931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534241863974714:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:11.086415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:11.088165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:11.088337Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:11.088348Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:11.088357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:11.088408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:11.088443Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534241863974824:4892]
2025-10-02T08:12:11.088453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534241863974714:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:11.088458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534241863974714:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:11.088460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534241863974714:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:11.088466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:11.089069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:11.089248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:11.089292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:11.089580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:11.089635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.089642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.089643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.089644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.089645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.089651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.089661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.089664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.089668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.089672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.089678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.089684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.089690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.089695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.089700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.089705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.089709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.089714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.089722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.089727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.089748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:11.096967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:11.098439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:11.098457Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:11.098460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:11.098464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:11.098469Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1391 [1:7556534241863974824:4892]
2025-10-02T08:12:11.098479Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:11.098494Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:11.098497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.098500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.098502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.098516Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:11.098525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:11.098531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:11.098586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.098593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.098595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:11.098598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:11.098654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:11.098661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.098673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.098685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1391
2025-10-02T08:12:11.098689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:11.098705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863974829:4891], now have 1 active actors on pipe
2025-10-02T08:12:11.098708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534242323861350:2378], now have 1 active actors on pipe
2025-10-02T08:12:11.098718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534241863974814:4892]
2025-10-02T08:12:11.098720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534241863974814:4892]
2025-10-02T08:12:11.098730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:11.098745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.098746Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:11.098749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:11.098751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.098737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1391
2025-10-02T08:12:11.098769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:11.098786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:11.098789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:11.098820Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:11.098830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.098833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.098835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:11.098842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.098854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:11.098874Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534241863974814:4892]
2025-10-02T08:12:11.098881Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:11.098896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.098901Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:11.098921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.098926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.098940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.098976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1392 partition: 0 MaxSeqNo: 17 sessionId: src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0
2025-10-02T08:12:11.099312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7337a1a-c899a112-80b26db5-460dc1a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:11.101974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0] Write session: try to update token
2025-10-02T08:12:11.101991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:11.115618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId: src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:11.115715Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:11.115728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:11.115729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:11.115736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534241863974814:4892]
2025-10-02T08:12:11.115740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534241863974814:4892]
2025-10-02T08:12:11.115769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:11.115776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.115778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:11.115834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:11.115846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:11.115894Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:11.117964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:11.174740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534241863974856:6995]
2025-10-02T08:12:11.174859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1391, pipe: [1:7556534241863974856:6995]
2025-10-02T08:12:11.244673Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:11.244954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.244966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.244997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863974856:6995], now have 1 active actors on pipe
2025-10-02T08:12:11.245113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534241863974856:6995]
2025-10-02T08:12:11.245139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:11.245145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:11.245208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1392 reason: error at write: Disconnected sessionId: src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0
2025-10-02T08:12:11.245224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:11.245363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1392 sessionId: src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0 is DEAD
2025-10-02T08:12:11.245388Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:11.245482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:11.245492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0] Write session will restart in 0.009692s
2025-10-02T08:12:11.245518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0] Write session: Do CDS request
2025-10-02T08:12:11.245525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:11.256322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.256565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:11.256631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1393
2025-10-02T08:12:11.256741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.256775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:11.256783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:11.256787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:11.257269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1393 sessionId:  describe result for acl check
2025-10-02T08:12:11.257304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:11.257306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:11.257307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:11.257311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534241863975259:4886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:11.257788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534241863975259:4886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:11.259241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:11.259564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534241863975259:4886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:11.261521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:11.261735Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:11.261744Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:11.261752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:11.261793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:11.261828Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534241863975317:4885]
2025-10-02T08:12:11.261951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534241863975259:4886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:11.261964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534241863975259:4886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:11.261967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534241863975259:4886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:11.261974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:11.262225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:11.262662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:11.262704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:11.262910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:11.262935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.262939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.262940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.262941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.262941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.262944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.262951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.262953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.262955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.262957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.262961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.262968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.262972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.262974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.262976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.262979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.262984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.262987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.262989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.262992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.263002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:11.270508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:11.272081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:11.272096Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:11.272098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:11.272101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:11.272106Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1392 [1:7556534241863975317:4885]
2025-10-02T08:12:11.272113Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:11.272128Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:11.272129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.272132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.272133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.272145Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:11.272147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:11.272154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:11.272197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.272202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.272205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:11.272206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:11.272252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:11.272257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.272265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.272277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:11.272291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534241863975300:4885]
2025-10-02T08:12:11.272293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534241863975300:4885]
2025-10-02T08:12:11.272299Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:11.272311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:11.272313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863975322:4886], now have 1 active actors on pipe
2025-10-02T08:12:11.272314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1392
2025-10-02T08:12:11.272318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:11.272322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:11.272326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:11.272327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:11.272331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534242323861356:2378], now have 1 active actors on pipe
2025-10-02T08:12:11.272356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.272363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.272373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534241863975300:4885]
2025-10-02T08:12:11.272383Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:11.272389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:11.272404Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:11.272411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.272414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.272415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:11.272421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.272403Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1392
2025-10-02T08:12:11.272427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:11.272444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.272476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.272481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.272490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.272518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1393 partition: 0 MaxSeqNo: 17 sessionId: src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0
2025-10-02T08:12:11.272792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6ad59a-105bb42a-b410c7cb-cd0c5284_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:11.275306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0] Write session: try to update token
2025-10-02T08:12:11.275323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:11.289299Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:11.289322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:11.289324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:11.289332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534241863975300:4885]
2025-10-02T08:12:11.289336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534241863975300:4885]
2025-10-02T08:12:11.289379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:11.289388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.289391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:11.289390Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:11.289396Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:11.289544Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:11.290026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId: src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:11.292530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:11.345246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534241863975349:6995]
2025-10-02T08:12:11.345329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1392, pipe: [1:7556534241863975349:6995]
2025-10-02T08:12:11.414047Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:11.414306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.414319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.414349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863975349:6995], now have 1 active actors on pipe
2025-10-02T08:12:11.414459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534241863975349:6995]
2025-10-02T08:12:11.414482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:11.414484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:11.414539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1393 reason: error at write: Disconnected sessionId: src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0
2025-10-02T08:12:11.414588Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:11.414725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1393 sessionId: src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0 is DEAD
2025-10-02T08:12:11.414845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:11.414853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0] Write session will restart in 0.008498s
2025-10-02T08:12:11.414870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0] Write session: Do CDS request
2025-10-02T08:12:11.414878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:11.415460Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:11.424264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.424325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:11.424342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1394
2025-10-02T08:12:11.424490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.424522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:11.424529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:11.424531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:11.424894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1394 sessionId:  describe result for acl check
2025-10-02T08:12:11.424923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:11.424929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:11.424931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:11.424947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534241863975750:4871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:11.425424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534241863975750:4871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:11.426881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:11.427581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534241863975750:4871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:11.428630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:11.428762Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:11.428769Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:11.428776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:11.428828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:11.428854Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534241863975798:4869]
2025-10-02T08:12:11.429246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:11.429408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:11.429437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:11.429623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:11.429655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.429660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.429661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.429662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.429662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.429665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.429671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.429673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.429675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.429677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.429680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.429684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.429687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.429690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.429693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.429696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.429698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.429700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.429703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.429705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.429714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:11.429820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534241863975750:4871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:11.429833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534241863975750:4871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:11.429835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534241863975750:4871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:11.429842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:11.437569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:11.439130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:11.439143Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:11.439144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:11.439146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:11.439152Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1393 [1:7556534241863975798:4869]
2025-10-02T08:12:11.439159Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:11.439172Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:11.439174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.439176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.439177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.439189Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:11.439192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:11.439197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:11.439243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.439249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.439253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:11.439256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:11.439302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:11.439308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.439317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.439328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:11.439344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863975815:4871], now have 1 active actors on pipe
2025-10-02T08:12:11.439353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534241863975781:4869]
2025-10-02T08:12:11.439356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1393
2025-10-02T08:12:11.439357Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534241863975781:4869]
2025-10-02T08:12:11.439363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:11.439371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:11.439373Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:11.439384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:11.439385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:11.439387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:11.439391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534242323861362:2378], now have 1 active actors on pipe
2025-10-02T08:12:11.439396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.439399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.439426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534241863975781:4869]
2025-10-02T08:12:11.439436Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:11.439449Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:11.439454Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:11.439456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.439459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.439460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:11.439465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.439471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:11.439495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.439546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.439552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.439562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.439532Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1393
2025-10-02T08:12:11.439605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1394 partition: 0 MaxSeqNo: 17 sessionId: src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0
2025-10-02T08:12:11.440022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b0a40-d2cb013d-73e88832-f5ecb8e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:11.443947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0] Write session: try to update token
2025-10-02T08:12:11.443965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:11.457137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId: src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:11.459657Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:11.459677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:11.459679Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:11.459688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534241863975781:4869]
2025-10-02T08:12:11.459692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534241863975781:4869]
2025-10-02T08:12:11.459701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:11.459728Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:11.459735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:11.459739Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:11.459741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.459743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:11.459879Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:11.514731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534241863975830:6995]
2025-10-02T08:12:11.514840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1393, pipe: [1:7556534241863975830:6995]
2025-10-02T08:12:11.592719Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:11.593271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.593284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.593318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863975830:6995], now have 1 active actors on pipe
2025-10-02T08:12:11.593583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:11.593437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:11.593445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:11.593493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1394 reason: error at write: Disconnected sessionId: src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0
2025-10-02T08:12:11.593548Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:11.593644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1394 sessionId: src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0 is DEAD
2025-10-02T08:12:11.593802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534241863975830:6995]
2025-10-02T08:12:11.594018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:11.594039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0] Write session will restart in 0.006092s
2025-10-02T08:12:11.594064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0] Write session: Do CDS request
2025-10-02T08:12:11.594070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:11.601340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.601371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:11.601387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1395
2025-10-02T08:12:11.601526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.601563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:11.601572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:11.601576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:11.602099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1395 sessionId:  describe result for acl check
2025-10-02T08:12:11.602132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:11.602139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:11.602141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:11.602145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534241863976156:4839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:11.602616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534241863976156:4839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:11.605323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534241863976156:4839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:11.608240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534241863976156:4839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:11.608254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534241863976156:4839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:11.608257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534241863976156:4839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:11.608265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:11.608328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:11.610142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:11.610288Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:11.610297Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:11.610304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:11.610335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:11.610376Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534241863976322:4841]
2025-10-02T08:12:11.610919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:11.611079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:11.611118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:11.611420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:11.611468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.611475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.611476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.611477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.611478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.611482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.611492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.611496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.611500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.611503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.611508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.611515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.611520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.611530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.611539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.611548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.611553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.611558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.611563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.611571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.611591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:11.620298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:11.621927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:11.621945Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:11.621947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:11.621952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:11.621958Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1394 [1:7556534241863976322:4841]
2025-10-02T08:12:11.621969Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:11.621985Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:11.621993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.621997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.621999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.622013Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:11.622016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:11.622022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:11.622073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.622082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.622084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:11.622086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:11.622135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:11.622144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.622156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.622167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:11.622182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534241863976310:4841]
2025-10-02T08:12:11.622186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534241863976310:4841]
2025-10-02T08:12:11.622195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:11.622201Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:11.622204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:11.622214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863976314:4839], now have 1 active actors on pipe
2025-10-02T08:12:11.622215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1394
2025-10-02T08:12:11.622224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:11.622238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:11.622244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:11.622251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534242323861369:2378], now have 1 active actors on pipe
2025-10-02T08:12:11.622285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.622293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.622307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534241863976310:4841]
2025-10-02T08:12:11.622319Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:11.622332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:11.622348Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:11.622361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.622368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.622370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:11.622336Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1394
2025-10-02T08:12:11.622378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.622391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:11.622420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.622460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.622466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.622478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.622514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1395 partition: 0 MaxSeqNo: 17 sessionId: src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0
2025-10-02T08:12:11.622843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a87fdf-d5df2c7c-b417cfd4-2938c9da_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:11.625486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0] Write session: try to update token
2025-10-02T08:12:11.625502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:11.639496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId: src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:11.641788Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:11.641808Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:11.641810Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:11.641817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534241863976310:4841]
2025-10-02T08:12:11.641821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534241863976310:4841]
2025-10-02T08:12:11.641864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:11.641875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.641882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:11.642023Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:11.642176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:11.642254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:11.642269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:11.693897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534241863976356:6995]
2025-10-02T08:12:11.694001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1394, pipe: [1:7556534241863976356:6995]
2025-10-02T08:12:11.774154Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:11.774563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.774577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.774616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863976356:6995], now have 1 active actors on pipe
2025-10-02T08:12:11.774735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534241863976356:6995]
2025-10-02T08:12:11.774756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:11.774758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:11.774805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1395 reason: error at write: Disconnected sessionId: src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0
2025-10-02T08:12:11.774815Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:11.774848Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:11.774975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1395 sessionId: src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0 is DEAD
2025-10-02T08:12:11.775108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:11.775116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0] Write session will restart in 0.009116s
2025-10-02T08:12:11.775134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0] Write session: Do CDS request
2025-10-02T08:12:11.775139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:11.785294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.785352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:11.785370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1396
2025-10-02T08:12:11.785493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.785538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:11.785549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:11.785552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:11.785953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1396 sessionId:  describe result for acl check
2025-10-02T08:12:11.785982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:11.785994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:11.785996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:11.786001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534241863976699:4812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:11.786466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534241863976699:4812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:11.789509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534241863976699:4812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:11.790401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:11.792352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:11.792533Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:11.792545Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:11.792565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:11.792590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534241863976699:4812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:11.792596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534241863976699:4812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:11.792599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534241863976699:4812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:11.792606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:11.792622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:11.792659Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534241863976814:4820]
2025-10-02T08:12:11.793258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:11.793411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:11.793455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:11.793744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:11.793791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.793798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.793799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.793800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.793801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.793807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.793817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.793821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.793829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.793837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.793843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.793855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.793865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.793874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.793883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.793891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.793897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.793906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.793916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.793925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.793946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:11.802494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:11.804061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:11.804082Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:11.804084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:11.804088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:11.804095Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1395 [1:7556534241863976814:4820]
2025-10-02T08:12:11.804106Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:11.804127Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:11.804137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.804140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.804142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.804157Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:11.804162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:11.804169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:11.804230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.804239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.804242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:11.804244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:11.804375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1395
2025-10-02T08:12:11.804464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:11.804435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1395
2025-10-02T08:12:11.804473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.804485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.804496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:11.804522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863976819:4812], now have 1 active actors on pipe
2025-10-02T08:12:11.804532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534242323861401:2378], now have 1 active actors on pipe
2025-10-02T08:12:11.804536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.804540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.804564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534241863976808:4820]
2025-10-02T08:12:11.804571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534241863976808:4820]
2025-10-02T08:12:11.804583Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:11.804599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:11.804616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:11.804617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:11.804620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:11.804625Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:11.804636Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:11.804643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:11.804646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:11.804648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:11.804657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:11.804666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:11.804704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534241863976808:4820]
2025-10-02T08:12:11.804716Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:11.804726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:11.804728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.804842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.804851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.804868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:11.804910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1396 partition: 0 MaxSeqNo: 17 sessionId: src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0
2025-10-02T08:12:11.805228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f51ba0-afb5c7ed-1ee711b-30811883_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:11.807640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0] Write session: try to update token
2025-10-02T08:12:11.807655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:11.819939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId: src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:11.822407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:11.823340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:11.823361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:11.823378Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:11.823380Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:11.823382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:11.823387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534241863976808:4820]
2025-10-02T08:12:11.823392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534241863976808:4820]
2025-10-02T08:12:11.823433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:11.823436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:11.823440Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:11.823440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.823442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:11.823557Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:11.875166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534241863976844:6995]
2025-10-02T08:12:11.875305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1395, pipe: [1:7556534241863976844:6995]
2025-10-02T08:12:11.971264Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:11.971717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:11.971768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:11.971773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863976844:6995], now have 1 active actors on pipe
2025-10-02T08:12:11.971890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:11.971901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:11.971926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1396 reason: error at write: Disconnected sessionId: src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0
2025-10-02T08:12:11.971991Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:11.972087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1396 sessionId: src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0 is DEAD
2025-10-02T08:12:11.972235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534241863976844:6995]
2025-10-02T08:12:11.972487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:11.972499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0] Write session will restart in 0.005737s
2025-10-02T08:12:11.972525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0] Write session: Do CDS request
2025-10-02T08:12:11.972534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:11.979306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.979382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:11.979398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1397
2025-10-02T08:12:11.979529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:11.979571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:11.979580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:11.979584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:11.980043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1397 sessionId:  describe result for acl check
2025-10-02T08:12:11.980092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:11.980098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:11.980100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:11.980105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534241863977106:4802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:11.980616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534241863977106:4802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:11.983912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534241863977106:4802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:11.987131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534241863977106:4802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:11.987149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534241863977106:4802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:11.987153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534241863977106:4802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:11.987160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:11.989618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:11.989935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:11.990123Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:11.990133Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:11.990142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:11.990187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:11.990224Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534241863977306:4806]
2025-10-02T08:12:11.990808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:11.990981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:11.991022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:11.991287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:11.991325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.991330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.991331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.991331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.991332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.991335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.991342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.991344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.991346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.991348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.991352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.991357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:11.991360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.991363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:11.991368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.991371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:11.991373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.991376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:11.991378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.991381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:11.991391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:12.000628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:12.002664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:12.002679Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:12.002681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:12.002684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:12.002689Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1396 [1:7556534241863977306:4806]
2025-10-02T08:12:12.002701Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:12.002713Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:12.002721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.002723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.002725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.002740Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:12.002751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:12.002756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:12.002810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.002816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.002818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:12.002821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:12.002875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:12.002882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.002894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.002906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:12.002925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534241863977300:4806]
2025-10-02T08:12:12.002931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534241863977300:4806]
2025-10-02T08:12:12.002940Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:12.002950Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:12.002950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534241863977291:4802], now have 1 active actors on pipe
2025-10-02T08:12:12.002952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1396
2025-10-02T08:12:12.002958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:12.002960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:12.002970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:12.002972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:12.002977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534242323861409:2378], now have 1 active actors on pipe
2025-10-02T08:12:12.003006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.003014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.003026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534241863977300:4806]
2025-10-02T08:12:12.003038Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:12.003048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:12.003059Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:12.003069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.003072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.003042Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1396
2025-10-02T08:12:12.003074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:12.003082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.003090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:12.003118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.003157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.003164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.003175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.003209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1397 partition: 0 MaxSeqNo: 17 sessionId: src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0
2025-10-02T08:12:12.003525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f875a79a-f57cad4a-6afc2b25-b9e639ed_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:12.005870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0] Write session: try to update token
2025-10-02T08:12:12.005883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:12.018528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId: src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:12.020958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:12.021450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.021468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.021483Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:12.021488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:12.021490Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:12.021495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534241863977300:4806]
2025-10-02T08:12:12.021498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534241863977300:4806]
2025-10-02T08:12:12.021530Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:12.021534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:12.021538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.021540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:12.021541Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:12.021650Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:12.072266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534246158944626:6995]
2025-10-02T08:12:12.072366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1396, pipe: [1:7556534246158944626:6995]
2025-10-02T08:12:12.147096Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:12.147332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:12.147370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158944626:6995], now have 1 active actors on pipe
2025-10-02T08:12:12.147372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:12.147463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:12.147474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:12.147511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1397 reason: error at write: Disconnected sessionId: src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0
2025-10-02T08:12:12.147553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:12.147652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1397 sessionId: src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0 is DEAD
2025-10-02T08:12:12.147769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:12.147779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0] Write session will restart in 0.007876s
2025-10-02T08:12:12.147775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534246158944626:6995]
2025-10-02T08:12:12.147801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0] Write session: Do CDS request
2025-10-02T08:12:12.147810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:12.157217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.157218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:12.157235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1398
2025-10-02T08:12:12.157415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.157445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:12.157454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:12.157458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:12.157848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1398 sessionId:  describe result for acl check
2025-10-02T08:12:12.157881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:12.157886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:12.157887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:12.157891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534246158945014:4794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:12.158350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534246158945014:4794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:12.159871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:12.160184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534246158945014:4794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:12.161432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:12.161589Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:12.161598Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:12.161606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:12.161648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:12.161683Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534246158945085:4784]
2025-10-02T08:12:12.162280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:12.162429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:12.162466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534246158945014:4794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:12.162467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:12.162479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534246158945014:4794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:12.162482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534246158945014:4794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:12.162489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:12.162740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:12.162778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.162788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.162789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.162790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.162791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.162796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.162806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.162810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.162814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.162818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.162823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.162830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.162839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.162845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.162853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.162858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.162866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.162875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.162879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.162888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.162910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:12.171166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:12.173026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:12.173039Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:12.173041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:12.173044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:12.173049Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1397 [1:7556534246158945085:4784]
2025-10-02T08:12:12.173055Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:12.173068Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:12.173074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.173076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.173077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.173088Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:12.173092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:12.173098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:12.173137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.173142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.173144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:12.173145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:12.173189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:12.173197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.173204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.173211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:12.173222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534246158945069:4784]
2025-10-02T08:12:12.173224Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534246158945069:4784]
2025-10-02T08:12:12.173228Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:12.173238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158945096:4794], now have 1 active actors on pipe
2025-10-02T08:12:12.173240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:12.173243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:12.173243Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:12.173248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1397
2025-10-02T08:12:12.173250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:12.173252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:12.173255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534246618828726:2378], now have 1 active actors on pipe
2025-10-02T08:12:12.173275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.173278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.173288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534246158945069:4784]
2025-10-02T08:12:12.173293Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:12.173309Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:12.173310Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:12.173314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.173317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.173318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:12.173324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.173330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:12.173344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.173316Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1397
2025-10-02T08:12:12.173388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.173394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.173402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.173429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1398 partition: 0 MaxSeqNo: 17 sessionId: src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0
2025-10-02T08:12:12.173708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89ff731-148a90df-69bee6aa-d61a81c2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:12.176021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0] Write session: try to update token
2025-10-02T08:12:12.176032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:12.187703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId: src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:12.190303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:12.190894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.190914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.190931Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:12.190936Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:12.190938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:12.190944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534246158945069:4784]
2025-10-02T08:12:12.190947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534246158945069:4784]
2025-10-02T08:12:12.190981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:12.190992Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:12.190992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:12.191000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.191002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:12.191118Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:12.247876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534246158945129:6995]
2025-10-02T08:12:12.248009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1397, pipe: [1:7556534246158945129:6995]
2025-10-02T08:12:12.316650Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:12.317023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:12.317055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:12.317059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158945129:6995], now have 1 active actors on pipe
2025-10-02T08:12:12.317147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:12.317153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:12.317170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1398 reason: error at write: Disconnected sessionId: src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0
2025-10-02T08:12:12.317267Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:12.317317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1398 sessionId: src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0 is DEAD
2025-10-02T08:12:12.317433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:12.317455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0] Write session will restart in 0.005336s
2025-10-02T08:12:12.317434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534246158945129:6995]
2025-10-02T08:12:12.317476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0] Write session: Do CDS request
2025-10-02T08:12:12.317485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:12.324282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.324373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:12.324394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1399
2025-10-02T08:12:12.324489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.324519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:12.324529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:12.324532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:12.325046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1399 sessionId:  describe result for acl check
2025-10-02T08:12:12.325081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:12.325083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:12.325085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:12.325089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534246158945413:4786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:12.325617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534246158945413:4786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:12.328583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534246158945413:4786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:12.331538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:12.331623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534246158945413:4786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:12.331636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534246158945413:4786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:12.331638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534246158945413:4786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:12.331643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:12.333303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:12.333486Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:12.333493Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:12.333500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:12.333532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:12.333558Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534246158945600:4789]
2025-10-02T08:12:12.333950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:12.334079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:12.334104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:12.334283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:12.334314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.334320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.334321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.334321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.334322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.334326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.334335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.334343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.334346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.334353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.334358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.334368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.334377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.334384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.334388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.334393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.334400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.334405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.334413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.334417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.334441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:12.342213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:12.343745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:12.343760Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:12.343765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:12.343769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:12.343773Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1398 [1:7556534246158945600:4789]
2025-10-02T08:12:12.343781Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:12.343794Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:12.343796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.343798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.343799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.343810Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:12.343813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:12.343818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:12.343869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.343876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.343878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:12.343881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:12.343945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:12.343953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.343987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1398
2025-10-02T08:12:12.344036Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1398
2025-10-02T08:12:12.344196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.344218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:12.344243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158945595:4786], now have 1 active actors on pipe
2025-10-02T08:12:12.344251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534246618828734:2378], now have 1 active actors on pipe
2025-10-02T08:12:12.344256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.344261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.344282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534246158945588:4789]
2025-10-02T08:12:12.344288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534246158945588:4789]
2025-10-02T08:12:12.344305Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:12.344320Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:12.344323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:12.344336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:12.344338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:12.344338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:12.344353Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:12.344365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.344375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.344380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:12.344389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.344405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:12.344438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534246158945588:4789]
2025-10-02T08:12:12.344449Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:12.344455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:12.344461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.344511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.344518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.344531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.344571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1399 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0
2025-10-02T08:12:12.344935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47ff7c6-229f318e-2954189d-6a3ae17f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:12.347758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0] Write session: try to update token
2025-10-02T08:12:12.347772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:12.362214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId: src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:12.363420Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:12.363441Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:12.363443Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:12.363452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534246158945588:4789]
2025-10-02T08:12:12.363457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534246158945588:4789]
2025-10-02T08:12:12.363497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:12.363509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.363516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:12.363525Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:12.363545Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:12.363651Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:12.364738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:12.417377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534246158945627:6995]
2025-10-02T08:12:12.417498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1398, pipe: [1:7556534246158945627:6995]
2025-10-02T08:12:12.491316Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:12.491656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.491668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.491698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158945627:6995], now have 1 active actors on pipe
2025-10-02T08:12:12.491779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534246158945627:6995]
2025-10-02T08:12:12.491794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:12.491795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:12.491835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1399 reason: error at write: Disconnected sessionId: src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0
2025-10-02T08:12:12.491892Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:12.491907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:12.491969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1399 sessionId: src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0 is DEAD
2025-10-02T08:12:12.492121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:12.492128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0] Write session will restart in 0.009815s
2025-10-02T08:12:12.492150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0] Write session: Do CDS request
2025-10-02T08:12:12.492156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:12.503341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.503597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:12.503621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1400
2025-10-02T08:12:12.503788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.503833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:12.503844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:12.503859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:12.504394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1400 sessionId:  describe result for acl check
2025-10-02T08:12:12.504428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:12.504433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:12.504435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:12.504440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534246158946015:4767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:12.504996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534246158946015:4767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:12.507755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534246158946015:4767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:12.509474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:12.509822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:12.510118Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:12.510133Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:12.510146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:12.510207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:12.510248Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534246158946091:4766]
2025-10-02T08:12:12.510784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534246158946015:4767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:12.510798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534246158946015:4767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:12.510801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534246158946015:4767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:12.510809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:12.510931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:12.511094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:12.511137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:12.511467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:12.511525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.511531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.511532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.511534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.511535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.511541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.511551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.511558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.511566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.511570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.511580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.511591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.511601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.511607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.511615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.511621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.511630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.511639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.511648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.511657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.511680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:12.520221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:12.522352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:12.522372Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:12.522375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:12.522380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:12.522387Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1399 [1:7556534246158946091:4766]
2025-10-02T08:12:12.522399Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:12.522418Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:12.522421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.522423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.522425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.522443Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:12.522449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:12.522457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:12.522531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.522539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.522543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:12.522546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:12.522624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:12.522632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.522647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.522661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:12.522682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158946096:4767], now have 1 active actors on pipe
2025-10-02T08:12:12.522681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1399
2025-10-02T08:12:12.522685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534246618828740:2378], now have 1 active actors on pipe
2025-10-02T08:12:12.522692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534246158946085:4766]
2025-10-02T08:12:12.522694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534246158946085:4766]
2025-10-02T08:12:12.522706Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:12.522720Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:12.522723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:12.522728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.522734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.522754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:12.522770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:12.522773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:12.522817Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:12.522830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.522835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.522837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:12.522847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.522817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1399
2025-10-02T08:12:12.522857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:12.522871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534246158946085:4766]
2025-10-02T08:12:12.522887Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:12.522900Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:12.522925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.522976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.522985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.522999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.523037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1400 partition: 0 MaxSeqNo: 17 sessionId: src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0
2025-10-02T08:12:12.523416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45dfb7-9bb9db4e-fab32378-706a7900_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:12.526292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0] Write session: try to update token
2025-10-02T08:12:12.526305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:12.542165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId: src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:12.543389Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:12.543405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:12.543406Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:12.543413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534246158946085:4766]
2025-10-02T08:12:12.543420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534246158946085:4766]
2025-10-02T08:12:12.543451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:12.543459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.543461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:12.543465Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:12.543478Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:12.543585Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:12.544651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:12.603274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534246158946137:6995]
2025-10-02T08:12:12.605385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1399, pipe: [1:7556534246158946137:6995]
2025-10-02T08:12:12.671373Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:12.671713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.671724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.671760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158946137:6995], now have 1 active actors on pipe
2025-10-02T08:12:12.671876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:12.671892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:12.671965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1400 reason: error at write: Disconnected sessionId: src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0
2025-10-02T08:12:12.671974Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:12.672024Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:12.672153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1400 sessionId: src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0 is DEAD
2025-10-02T08:12:12.672316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:12.672325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0] Write session will restart in 0.006645s
2025-10-02T08:12:12.672350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0] Write session: Do CDS request
2025-10-02T08:12:12.672357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:12.672279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534246158946137:6995]
2025-10-02T08:12:12.680310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.680372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:12.680388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1401
2025-10-02T08:12:12.680512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.680539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:12.680548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:12.680551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:12.681059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1401 sessionId:  describe result for acl check
2025-10-02T08:12:12.681090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:12.681095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:12.681096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:12.681101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534246158946473:4732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:12.681531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534246158946473:4732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:12.689517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534246158946473:4732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:12.692918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:12.693752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:12.694010Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:12.694015Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:12.694025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:12.694073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:12.694106Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534246158946620:4731]
2025-10-02T08:12:12.694287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534246158946473:4732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:12.694294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534246158946473:4732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:12.694297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534246158946473:4732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:12.694305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:12.694708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:12.694892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:12.694936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:12.695196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:12.695236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.695241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.695243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.695244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.695245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.695250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.695260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.695264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.695268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.695272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.695277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.695285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.695291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.695297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.695308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.695318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.695323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.695331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.695335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.695351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.695375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:12.704916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:12.706518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:12.706534Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:12.706536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:12.706541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:12.706547Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1400 [1:7556534246158946620:4731]
2025-10-02T08:12:12.706558Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:12.706577Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:12.706580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.706582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.706584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.706599Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:12.706605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:12.706612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:12.706678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.706687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.706690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:12.706692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:12.706758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:12.706765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.706777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.706791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:12.706810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534246158946614:4731]
2025-10-02T08:12:12.706815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534246158946614:4731]
2025-10-02T08:12:12.706823Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:12.706831Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:12.706831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1400
2025-10-02T08:12:12.706837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:12.706838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534246618828748:2378], now have 1 active actors on pipe
2025-10-02T08:12:12.706841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158946625:4732], now have 1 active actors on pipe
2025-10-02T08:12:12.706848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:12.706860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:12.706867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:12.706874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.706879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.706919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534246158946614:4731]
2025-10-02T08:12:12.706929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:12.706938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:12.706949Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:12.706960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.706965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.706972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:12.706940Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1400
2025-10-02T08:12:12.706981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.706989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:12.707026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.707112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.707118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.707131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.707169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1401 partition: 0 MaxSeqNo: 17 sessionId: src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0
2025-10-02T08:12:12.707538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15469ff3-dd8064be-e088d94a-546aa3fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:12.710441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0] Write session: try to update token
2025-10-02T08:12:12.710455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:12.724506Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:12.724521Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:12.724528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534246158946614:4731]
2025-10-02T08:12:12.724575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:12.724590Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:12.724757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:12.724933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:12.725094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:12.725262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:12.725501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:12.725550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:12.725950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId: src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:12.728760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:12.728855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.728868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.728900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:12.728922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:12.728973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.728985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.729187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.729265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.729339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.729419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.729480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.729490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.729589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.729674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.729762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.729939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.729998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.730009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.730098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.730163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.730231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.730299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.730347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.730349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.730430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.730498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.730582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.730656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.730706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.730708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.730782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.730846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.730920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.731002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.731067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.731070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.731159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.731228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.731310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.731390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.731445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.731448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.731538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.731616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.731697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.731776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.731829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.731832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.731926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.732006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.732101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.732186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.732242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.732244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.732335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.732412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.732498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.732584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.732644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.732647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.732741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:12.733024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:12.733114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:12.733208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:12.733264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:12.733271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:12.733314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:12.733377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.733394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.733398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:12.733438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:12.733459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:12.733465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:12.733468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:12.733471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:12.733930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:12.733956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:12.733962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:12.733965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:12.733967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:12.733969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:12.734736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:12.734760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:12.734768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:12.734772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:12.734775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:12.734778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:12.735303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:12.735329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:12.735335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:12.735342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:12.735345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:12.738787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:12.738813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:12.738830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392732738
2025-10-02T08:12:12.739081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:12.739098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:12.739107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:12.739115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:12.739119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:12.739123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:12.739707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:12.739733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:12.739739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:12.739743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:12.739747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:12.739752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:12.740342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:12.740367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:12.740375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:12.740379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:12.740382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:12.740386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:12.740986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:12.741012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:12.741018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:12.742221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:12.742239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:12.742246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:12.742250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:12.742261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392732741
2025-10-02T08:12:12.742564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:12.742584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:12.742595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:12.742601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:12.742610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:12.742613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:12.743072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:12.743094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:12.743104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:12.743108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:12.743116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:12.743121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:12.743574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:12.743597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.743701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392732743
2025-10-02T08:12:12.745884Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:12.745904Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:12.745916Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:12.745928Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:12.747513Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:12.747525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:12.747526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:12.747538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534246158946614:4731]
2025-10-02T08:12:12.747548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534246158946614:4731]
2025-10-02T08:12:12.747597Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:12.747604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:12.747608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.747610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:12.747610Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:12.747732Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:12.772674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534246158946670:6995]
2025-10-02T08:12:12.772761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1400, pipe: [1:7556534246158946670:6995]
2025-10-02T08:12:12.877680Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:12.877960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158946670:6995], now have 1 active actors on pipe
2025-10-02T08:12:12.878069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:12.878082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:12.878112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1401 reason: error at write: Disconnected sessionId: src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0
2025-10-02T08:12:12.878127Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:12.878214Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:12.878264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1401 sessionId: src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0 is DEAD
2025-10-02T08:12:12.878379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:12.878385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0] Write session will restart in 0.009564s
2025-10-02T08:12:12.878402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0] Write session: Do CDS request
2025-10-02T08:12:12.878409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:12.878449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534246158946670:6995]
2025-10-02T08:12:12.889242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.889345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:12.889356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1402
2025-10-02T08:12:12.889442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:12.889463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:12.889469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:12.889472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:12.889847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1402 sessionId:  describe result for acl check
2025-10-02T08:12:12.889878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:12.889883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:12.889883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:12.889887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534246158947095:4711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:12.890325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534246158947095:4711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:12.890963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:12.892266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534246158947095:4711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:12.893007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:12.893139Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:12.893148Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:12.893156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:12.893192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:12.893218Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534246158947142:4710]
2025-10-02T08:12:12.893730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:12.893871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:12.893908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:12.894112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:12.894144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.894150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.894151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.894152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.894153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.894157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.894167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.894173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.894176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.894178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.894181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.894189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:12.894196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.894199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:12.894205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.894207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:12.894210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.894214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.894218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.894223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.894234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:12.894938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534246158947095:4711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:12.894948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534246158947095:4711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:12.894951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534246158947095:4711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:12.894959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:12.902157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:12.903749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:12.903765Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:12.903767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:12.903769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:12.903774Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1401 [1:7556534246158947142:4710]
2025-10-02T08:12:12.903782Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:12.903794Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:12.903798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.903800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.903801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.903813Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:12.903817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:12.903821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:12.903865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.903871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.903873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:12.903874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:12.903921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:12.903926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.903934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:12.903940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:12.903953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534246158947113:4710]
2025-10-02T08:12:12.903957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534246158947113:4710]
2025-10-02T08:12:12.903962Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:12.903970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:12.903979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:12.903985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:12.904004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1401
2025-10-02T08:12:12.904008Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:12.904010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158947159:4711], now have 1 active actors on pipe
2025-10-02T08:12:12.904011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:12.904012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534246158947113:4710]
2025-10-02T08:12:12.904013Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:12.904018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:12.904028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534246618828778:2378], now have 1 active actors on pipe
2025-10-02T08:12:12.904031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.904034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.904066Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:12.904075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:12.904080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:12.904083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:12.904089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:12.904098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:12.904107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.904109Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1401
2025-10-02T08:12:12.904198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:12.904203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:12.904213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:12.904245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1402 partition: 0 MaxSeqNo: 17 sessionId: src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0
2025-10-02T08:12:12.904525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5b5d07-1666bd38-6ed09cc8-5427acd1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:12.907037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0] Write session: try to update token
2025-10-02T08:12:12.907050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:12.920613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId: src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:12.921404Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:12.921416Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:12.921418Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:12.921424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534246158947113:4710]
2025-10-02T08:12:12.921427Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534246158947113:4710]
2025-10-02T08:12:12.921458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:12.921463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:12.921464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:12.921464Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:12.921470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:12.921589Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:12.923145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:12.978672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534246158947176:6995]
2025-10-02T08:12:12.978821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1401, pipe: [1:7556534246158947176:6995]
2025-10-02T08:12:13.060200Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:13.060597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.060609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.060657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534246158947176:6995], now have 1 active actors on pipe
2025-10-02T08:12:13.061256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:13.062221Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534168849495052:6998] disconnected; active server actors: 1
2025-10-02T08:12:13.062236Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534168849495052:6998] client user disconnected session shared/user_1_14_17293831545318464354_v1
2025-10-02T08:12:13.062365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:13.062377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0] Write session will restart in 0.005764s
2025-10-02T08:12:13.062403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0] Write session: Do CDS request
2025-10-02T08:12:13.062411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:13.060857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:13.060865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:13.060933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1402 reason: error at write: Disconnected sessionId: src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0
2025-10-02T08:12:13.061137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1402 sessionId: src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0 is DEAD
2025-10-02T08:12:13.061405Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:13.061820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534246158947176:6995]
2025-10-02T08:12:13.061842Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:12:13.061983Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 14 consumer shared/user session shared/user_1_14_17293831545318464354_v1 is DEAD
2025-10-02T08:12:13.065003Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:12:13.065159Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:12:13.065168Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:12:13.065176Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.008801s
2025-10-02T08:12:13.069301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.072995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:13.073021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1403
2025-10-02T08:12:13.075218Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:12:13.076932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.076989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:13.076996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:13.077005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:13.077061Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:12:13.077063Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 15
2025-10-02T08:12:13.079230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1403 sessionId:  describe result for acl check
2025-10-02T08:12:13.079268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:13.079269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:13.079271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:13.079276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534250453914508:4700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:13.080442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534250453914508:4700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:13.080968Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 15 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:12:13.081042Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:12:13.081186Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 auth for : user
2025-10-02T08:12:13.081375Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 Handle describe topics response
2025-10-02T08:12:13.081398Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 auth is DEAD
2025-10-02T08:12:13.081403Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:12:13.081876Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_15_4450069362050815167_v1
2025-10-02T08:12:13.081886Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:12:13.081956Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:12:13.081728Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:12:13.082315Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534250453914523:4686] connected; active server actors: 1
2025-10-02T08:12:13.084939Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:12:13.085031Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 got read request: guid# e6ddca78-f5b53e60-e5f27c2c-c299e3a1
2025-10-02T08:12:13.086734Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534250453914523:4686] session shared/user_1_15_4450069362050815167_v1
2025-10-02T08:12:13.086758Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:12:13.086769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:12:13.086776Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_15_4450069362050815167_v1" (Sender=[1:7556534250453914492:4686], Pipe=[1:7556534250453914523:4686], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:12:13.086780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:12:13.086798Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:12:13.086807Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_15_4450069362050815167_v1" (Sender=[1:7556534250453914492:4686], Pipe=[1:7556534250453914523:4686], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:12:13.086817Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_15_4450069362050815167_v1" sender [1:7556534250453914492:4686] lock partition 0 for ReadingSession "shared/user_1_15_4450069362050815167_v1" (Sender=[1:7556534250453914492:4686], Pipe=[1:7556534250453914523:4686], Partitions=[], ActiveFamilyCount=1) generation 1 step 15
2025-10-02T08:12:13.086840Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:12:13.086849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000047s
2025-10-02T08:12:13.087289Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 15 Session: "shared/user_1_15_4450069362050815167_v1" ClientId: "user" PipeClient { RawX1: 7556534250453914523 RawX2: 4503603922342478 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:12:13.087317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:12:13.089872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534250453914508:4700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:13.093640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534250453914508:4700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:13.093655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534250453914508:4700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:13.093659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534250453914508:4700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:13.093669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:13.104591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:13.106659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:13.106919Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:13.106930Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:13.106940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:13.106992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:13.107032Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534250453914955:4687]
2025-10-02T08:12:13.107674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:13.107859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:13.107898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:13.108220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:13.108488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.108495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.108496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.108497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.108499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.108505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.108515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.108520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.108523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.108527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.108533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.108541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.108547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.108552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.108555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.108561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.108565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.108575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.108580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.108585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.108603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:13.116624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:13.118300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:13.118318Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:13.118320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:13.118323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:13.118331Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1402 [1:7556534250453914955:4687]
2025-10-02T08:12:13.118343Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:13.118359Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:13.118364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.118367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.118369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.118384Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:13.118393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:13.118399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:13.118458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.118464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.118467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:13.118469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:13.118528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:13.118534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.118547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.118563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:13.118576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1402
2025-10-02T08:12:13.118586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453914722:4654], now have 1 active actors on pipe
2025-10-02T08:12:13.118589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453914775:4700], now have 1 active actors on pipe
2025-10-02T08:12:13.118594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534250453914949:4687]
2025-10-02T08:12:13.118595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1402, pipe: [1:7556534250453914722:4654]
2025-10-02T08:12:13.118601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534250453914949:4687]
2025-10-02T08:12:13.118609Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:13.118693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1402
2025-10-02T08:12:13.118616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534250913796083:2378], now have 1 active actors on pipe
2025-10-02T08:12:13.118620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.118624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.118641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:13.118651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:13.118653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:13.118654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:13.118655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:13.118695Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:13.118702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.118705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.118709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:13.118717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.118725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:13.118732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.118734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.118740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_15_4450069362050815167_v1 on pipe: [1:7556534250453914722:4654]
2025-10-02T08:12:13.118754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534250453914949:4687]
2025-10-02T08:12:13.118763Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_15_4450069362050815167_v1:1 with generation 1402
2025-10-02T08:12:13.118765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:13.118788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:13.118790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.118812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.118817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.118819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:13.118832Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_15_4450069362050815167_v1
2025-10-02T08:12:13.118834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.118864Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:13.118883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.118889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.118923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.118977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1403 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0
2025-10-02T08:12:13.119383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fad56d-54134eae-f2bb3fed-fc1df6d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:13.122194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0] Write session: try to update token
2025-10-02T08:12:13.122213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:13.122831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:12:13.122863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:12:13.122871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.122873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.122875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.122882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:12:13.122901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:12:13.122968Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392733118 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:12:13.122984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:12:13.123014Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 sending to client partition status
2025-10-02T08:12:13.137296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId: src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:13.139305Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:13.139324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:13.139327Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:13.139336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534250453914949:4687]
2025-10-02T08:12:13.139340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534250453914949:4687]
2025-10-02T08:12:13.139381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:13.139389Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:13.139391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.139393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:13.139394Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:13.139527Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:13.140008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:13.286688Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:13.287120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.287134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.287260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:13.287275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:13.287340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1403 reason: error at write: Disconnected sessionId: src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0
2025-10-02T08:12:13.287367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_15_4450069362050815167_v1
2025-10-02T08:12:13.287376Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:13.287376Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:13.287513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1403 sessionId: src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0 is DEAD
2025-10-02T08:12:13.287681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:13.287690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0] Write session will restart in 0.006960s
2025-10-02T08:12:13.287678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534250453914722:4654]
2025-10-02T08:12:13.287713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0] Write session: Do CDS request
2025-10-02T08:12:13.287698Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_15_4450069362050815167_v1
2025-10-02T08:12:13.287720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:13.296262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.296282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:13.296298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1404
2025-10-02T08:12:13.296458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.296489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:13.296498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:13.296501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:13.297054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1404 sessionId:  describe result for acl check
2025-10-02T08:12:13.297094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:13.297096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:13.297098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:13.297103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534250453915318:4639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:13.297592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534250453915318:4639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:13.301459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534250453915318:4639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:13.302366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:13.304574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:13.304852Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:13.304865Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:13.304876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:13.304927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:13.304964Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534250453915466:4644]
2025-10-02T08:12:13.305057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534250453915318:4639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:13.305067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534250453915318:4639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:13.305069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534250453915318:4639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:13.305075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:13.305524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:13.305687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:13.305718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:13.305917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:13.305957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.305963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.305963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.305964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.305965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.305971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.305977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.305979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.305981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.305983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.305987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.305991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.305995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.305998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.306001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.306004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.306010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.306013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.306017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.306023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.306039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:13.313770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:13.315364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:13.315385Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:13.315388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:13.315392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:13.315400Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1403 [1:7556534250453915466:4644]
2025-10-02T08:12:13.315412Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:13.315429Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:13.315431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.315434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.315437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.315457Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:13.315462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:13.315468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:13.315522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.315528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.315531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:13.315534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:13.315587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:13.315593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.315606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.315622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:13.315636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1403
2025-10-02T08:12:13.315643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453915471:4639], now have 1 active actors on pipe
2025-10-02T08:12:13.315651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534250453915460:4644]
2025-10-02T08:12:13.315653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534250453915460:4644]
2025-10-02T08:12:13.315663Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:13.315674Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:13.315676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.315680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.315682Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:13.315693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534250913796104:2378], now have 1 active actors on pipe
2025-10-02T08:12:13.315704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:13.315722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:13.315728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:13.315735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1403
2025-10-02T08:12:13.315768Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f4937d4-5c98d402-aead3183-166c8360_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:13.315778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.315781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.315783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:13.315792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.315803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:13.315813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534250453915460:4644]
2025-10-02T08:12:13.315823Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:13.315834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:13.315861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.315934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.315939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.315955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.315998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1404 partition: 0 MaxSeqNo: 17 sessionId: src_id|2f4937d4-5c98d402-aead3183-166c8360_0
2025-10-02T08:12:13.316341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f0da51-1f568a65-bbbd2775-55046d19_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2f4937d4-5c98d402-aead3183-166c8360_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:13.318734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4937d4-5c98d402-aead3183-166c8360_0] Write session: try to update token
2025-10-02T08:12:13.318750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4937d4-5c98d402-aead3183-166c8360_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:13.331907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId: src_id|2f4937d4-5c98d402-aead3183-166c8360_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:13.333739Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:13.333759Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:13.333761Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:13.333770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534250453915460:4644]
2025-10-02T08:12:13.333775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534250453915460:4644]
2025-10-02T08:12:13.333815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:13.333824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:13.333827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.333830Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:13.333830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:13.333968Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:13.334538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:13.387594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534250453915498:4654]
2025-10-02T08:12:13.387726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1403, pipe: [1:7556534250453915498:4654]
2025-10-02T08:12:13.470747Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:13.471113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.471123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.471158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453915498:4654], now have 1 active actors on pipe
2025-10-02T08:12:13.471269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534250453915498:4654]
2025-10-02T08:12:13.471298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:13.471304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:13.471332Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:13.471362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1404 reason: error at write: Disconnected sessionId: src_id|2f4937d4-5c98d402-aead3183-166c8360_0
2025-10-02T08:12:13.471424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:13.471543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1404 sessionId: src_id|2f4937d4-5c98d402-aead3183-166c8360_0 is DEAD
2025-10-02T08:12:13.471688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4937d4-5c98d402-aead3183-166c8360_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:13.471693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4937d4-5c98d402-aead3183-166c8360_0] Write session will restart in 0.008367s
2025-10-02T08:12:13.471713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4937d4-5c98d402-aead3183-166c8360_0] Write session: Do CDS request
2025-10-02T08:12:13.471718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4937d4-5c98d402-aead3183-166c8360_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:13.481216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4937d4-5c98d402-aead3183-166c8360_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.481276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:13.481290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1405
2025-10-02T08:12:13.481417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.481454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:13.481463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:13.481467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:13.481907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1405 sessionId:  describe result for acl check
2025-10-02T08:12:13.481932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:13.481938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:13.481940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:13.481944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534250453915858:4630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:13.482422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534250453915858:4630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:13.485239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534250453915858:4630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:13.485962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:13.487782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:13.488042Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:13.488050Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:13.488066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:13.488115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534250453915858:4630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:13.488125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534250453915858:4630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:13.488127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534250453915858:4630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:13.488130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:13.488133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:13.488159Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534250453915969:4633]
2025-10-02T08:12:13.488653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:13.488820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:13.488857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:13.489092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:13.489136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.489141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.489142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.489143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.489144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.489149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.489159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.489164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.489172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.489176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.489181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.489191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.489201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.489206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.489211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.489219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.489223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.489227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.489232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.489238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.489257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:13.497352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:13.498945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:13.498962Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:13.498964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:13.498968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:13.498974Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1404 [1:7556534250453915969:4633]
2025-10-02T08:12:13.498985Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:13.499001Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:13.499004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.499007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.499008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.499026Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:13.499035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:13.499040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:13.499097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.499103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.499106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:13.499108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:13.499174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:13.499180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.499193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.499208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:13.499226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534250453915961:4633]
2025-10-02T08:12:13.499231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534250453915961:4633]
2025-10-02T08:12:13.499241Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:13.499254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1404
2025-10-02T08:12:13.499255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:13.499257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453915974:4630], now have 1 active actors on pipe
2025-10-02T08:12:13.499258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:13.499265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:13.499278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:13.499280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:13.499285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534250913796111:2378], now have 1 active actors on pipe
2025-10-02T08:12:13.499314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.499322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.499334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534250453915961:4633]
2025-10-02T08:12:13.499344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:13.499359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:13.499373Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:13.499381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.499390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.499392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:13.499357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1404
2025-10-02T08:12:13.499414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.499426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:13.499454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.499515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.499521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.499533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.499585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1405 partition: 0 MaxSeqNo: 17 sessionId: src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0
2025-10-02T08:12:13.499912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4937d4-5c98d402-aead3183-166c8360_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:13.508678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0] Write session: try to update token
2025-10-02T08:12:13.508696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:13.519313Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:13.519329Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:13.519331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:13.519339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534250453915961:4633]
2025-10-02T08:12:13.519344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534250453915961:4633]
2025-10-02T08:12:13.519384Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:13.519388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:13.519394Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:13.519395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.519397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:13.519548Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:13.523849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId: src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:13.547988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:13.571430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534250453916004:4654]
2025-10-02T08:12:13.571584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1404, pipe: [1:7556534250453916004:4654]
2025-10-02T08:12:13.657847Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:13.658245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.658259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.658280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453916004:4654], now have 1 active actors on pipe
2025-10-02T08:12:13.658409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534250453916004:4654]
2025-10-02T08:12:13.658430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:13.658432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:13.658472Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:13.658484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1405 reason: error at write: Disconnected sessionId: src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0
2025-10-02T08:12:13.658537Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:13.658669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1405 sessionId: src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0 is DEAD
2025-10-02T08:12:13.658816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:13.658823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0] Write session will restart in 0.007618s
2025-10-02T08:12:13.658851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0] Write session: Do CDS request
2025-10-02T08:12:13.658858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:13.667245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.667385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:13.667398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1406
2025-10-02T08:12:13.667509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.667537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:13.667548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:13.667556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:13.668014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1406 sessionId:  describe result for acl check
2025-10-02T08:12:13.668050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:13.668067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:13.668068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:13.668073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534250453916343:4589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:13.668581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534250453916343:4589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:13.672291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534250453916343:4589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:13.675027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534250453916343:4589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:13.675041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534250453916343:4589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:13.675044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534250453916343:4589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:13.675052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:13.675101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:13.676828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:13.676996Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:13.677006Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:13.677014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:13.677060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:13.677094Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534250453916513:4594]
2025-10-02T08:12:13.677612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:13.677777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:13.677812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:13.678075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:13.678111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.678116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.678117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.678117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.678118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.678122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.678130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.678134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.678137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.678140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.678144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.678151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.678156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.678160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.678163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.678167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.678170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.678174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.678177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.678182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.678196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:13.686451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:13.688505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:13.688525Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:13.688527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:13.688531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:13.688537Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1405 [1:7556534250453916513:4594]
2025-10-02T08:12:13.688548Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:13.688571Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:13.688574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.688577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.688578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.688594Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:13.688600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:13.688607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:13.688675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.688682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.688685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:13.688687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:13.688753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:13.688760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.688773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.688787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:13.688827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453916506:4589], now have 1 active actors on pipe
2025-10-02T08:12:13.688838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534250453916501:4594]
2025-10-02T08:12:13.688838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1405
2025-10-02T08:12:13.688840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534250453916501:4594]
2025-10-02T08:12:13.688848Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:13.688861Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:13.688862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534250913796119:2378], now have 1 active actors on pipe
2025-10-02T08:12:13.688867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:13.688870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:13.688881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:13.688883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:13.688890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.688893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.688941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534250453916501:4594]
2025-10-02T08:12:13.688955Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:13.688966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:13.688969Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:13.688947Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1405
2025-10-02T08:12:13.688976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.688980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.688982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:13.688993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.689003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:13.689056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.689137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.689144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.689158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.689191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1406 partition: 0 MaxSeqNo: 17 sessionId: src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0
2025-10-02T08:12:13.689503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc9c34e-c3182443-9a8f1e91-c4944413_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:13.691931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0] Write session: try to update token
2025-10-02T08:12:13.691945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:13.705715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId: src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:13.707292Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:13.707306Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:13.707309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:13.707317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534250453916501:4594]
2025-10-02T08:12:13.707321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534250453916501:4594]
2025-10-02T08:12:13.707365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:13.707365Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:13.707371Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:13.707377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.707380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:13.707526Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:13.708844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:13.758745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534250453916542:4654]
2025-10-02T08:12:13.758864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1405, pipe: [1:7556534250453916542:4654]
2025-10-02T08:12:13.833880Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:13.834165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.834176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.834208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453916542:4654], now have 1 active actors on pipe
2025-10-02T08:12:13.834288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534250453916542:4654]
2025-10-02T08:12:13.834305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:13.834311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:13.834355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1406 reason: error at write: Disconnected sessionId: src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0
2025-10-02T08:12:13.834401Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:13.834425Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:13.834492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1406 sessionId: src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0 is DEAD
2025-10-02T08:12:13.834663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:13.834672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0] Write session will restart in 0.008577s
2025-10-02T08:12:13.834698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0] Write session: Do CDS request
2025-10-02T08:12:13.834704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:13.844299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.844329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:13.844340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1407
2025-10-02T08:12:13.844479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:13.844500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:13.844507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:13.844510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:13.844907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1407 sessionId:  describe result for acl check
2025-10-02T08:12:13.844935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:13.844940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:13.844942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:13.844946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534250453916933:4565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:13.845406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534250453916933:4565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:13.847488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534250453916933:4565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:13.847752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:13.849646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:13.849829Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:13.849839Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:13.849849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:13.849904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:13.849937Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534250453917024:4566]
2025-10-02T08:12:13.850139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534250453916933:4565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:13.850149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534250453916933:4565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:13.850151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534250453916933:4565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:13.850156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:13.850480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:13.850634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:13.850731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:13.850998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:13.851050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.851055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.851056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.851057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.851058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.851063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.851072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.851076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.851079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.851082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.851087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.851093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:13.851100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.851104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:13.851108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.851117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:13.851121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.851130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.851134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.851142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.851160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:13.858674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:13.860237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:13.860249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:13.860251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:13.860253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:13.860258Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1406 [1:7556534250453917024:4566]
2025-10-02T08:12:13.860267Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:13.860281Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:13.860283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.860285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.860286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.860297Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:13.860300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:13.860304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:13.860347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.860352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.860354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:13.860357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:13.860404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:13.860409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.860418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:13.860424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:13.860440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534250453917010:4566]
2025-10-02T08:12:13.860445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534250453917010:4566]
2025-10-02T08:12:13.860451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:13.860460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453917029:4565], now have 1 active actors on pipe
2025-10-02T08:12:13.860464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1406
2025-10-02T08:12:13.860465Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:13.860469Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:13.860469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:13.860477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:13.860480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:13.860487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534250913796148:2378], now have 1 active actors on pipe
2025-10-02T08:12:13.860506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.860512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.860523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534250453917010:4566]
2025-10-02T08:12:13.860532Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:13.860545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:13.860551Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:13.860556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:13.860558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:13.860559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:13.860568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:13.860578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:13.860585Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1406
2025-10-02T08:12:13.860596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.860645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:13.860651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:13.860663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:13.860695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1407 partition: 0 MaxSeqNo: 17 sessionId: src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0
2025-10-02T08:12:13.861004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e09b0e-70e112c0-3d5970ed-9755d142_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:13.863386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0] Write session: try to update token
2025-10-02T08:12:13.863398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:13.875973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId: src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:13.879705Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:13.879717Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:13.879719Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:13.879725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534250453917010:4566]
2025-10-02T08:12:13.879729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534250453917010:4566]
2025-10-02T08:12:13.879758Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:13.879762Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:13.879763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:13.879768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:13.879770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:13.879899Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:13.880415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:13.934402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534250453917056:4654]
2025-10-02T08:12:13.934505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1406, pipe: [1:7556534250453917056:4654]
2025-10-02T08:12:14.010196Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:14.010526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.010539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.010578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534250453917056:4654], now have 1 active actors on pipe
2025-10-02T08:12:14.010682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534250453917056:4654]
2025-10-02T08:12:14.010699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:14.010701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:14.010776Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:14.010738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1407 reason: error at write: Disconnected sessionId: src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0
2025-10-02T08:12:14.010755Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:14.010869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1407 sessionId: src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0 is DEAD
2025-10-02T08:12:14.011022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:14.011033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0] Write session will restart in 0.009871s
2025-10-02T08:12:14.011052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0] Write session: Do CDS request
2025-10-02T08:12:14.011058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:14.022246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.022345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:14.022357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1408
2025-10-02T08:12:14.022472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.022494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:14.022502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:14.022504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:14.022682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:14.022783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1408 sessionId:  describe result for acl check
2025-10-02T08:12:14.022805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:14.022809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:14.022810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:14.022814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534254748884798:4540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:14.023143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534254748884798:4540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:14.024368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:14.024507Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:14.024514Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:14.024523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:14.024560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534254748884798:4540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:14.024574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:14.024606Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534254748884819:4545]
2025-10-02T08:12:14.025121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:14.025263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:14.025301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:14.025503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:14.025531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.025532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.025533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.025533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.025534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.025538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.025543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.025545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.025547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.025549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.025552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.025556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.025559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.025562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.025564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.025566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.025569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.025572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.025574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.025577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.025588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:14.026067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534254748884798:4540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:14.026076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534254748884798:4540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:14.026078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534254748884798:4540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:14.026083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:14.032962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:14.034587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:14.034599Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:14.034602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:14.034604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:14.034608Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1407 [1:7556534254748884819:4545]
2025-10-02T08:12:14.034617Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:14.034630Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:14.034631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.034634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.034635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.034645Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:14.034653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:14.034657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:14.034732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.034738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.034741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:14.034743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:14.034788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:14.034793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.034802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.034808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:14.034820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534254748884792:4545]
2025-10-02T08:12:14.034825Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534254748884792:4545]
2025-10-02T08:12:14.034831Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:14.034841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:14.034843Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:14.034846Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:14.034853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:14.034854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:14.034860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534255208763450:2378], now have 1 active actors on pipe
2025-10-02T08:12:14.034860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1407
2025-10-02T08:12:14.034863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748884846:4540], now have 1 active actors on pipe
2025-10-02T08:12:14.034888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.034890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.034900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534254748884792:4545]
2025-10-02T08:12:14.034906Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:14.034922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:14.034926Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:14.034929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1407
2025-10-02T08:12:14.034930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.034932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.034933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:14.034939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.034945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:14.034958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.035003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.035010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.035021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.035054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1408 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0
2025-10-02T08:12:14.035324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9144a5-1371981-ff1627a4-8c2ce3f6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:14.037731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0] Write session: try to update token
2025-10-02T08:12:14.037745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:14.051097Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:14.051112Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:14.051113Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:14.051119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534254748884792:4545]
2025-10-02T08:12:14.051123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534254748884792:4545]
2025-10-02T08:12:14.051155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:14.051156Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:14.051159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.051161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:14.051161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:14.051277Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:14.051410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId: src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:14.053961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:14.111047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534254748884861:4654]
2025-10-02T08:12:14.111153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1407, pipe: [1:7556534254748884861:4654]
2025-10-02T08:12:14.176834Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:14.177100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.177114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.177152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748884861:4654], now have 1 active actors on pipe
2025-10-02T08:12:14.177283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534254748884861:4654]
2025-10-02T08:12:14.177312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:14.177319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:14.177355Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:14.177398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1408 reason: error at write: Disconnected sessionId: src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0
2025-10-02T08:12:14.177399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:14.177588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1408 sessionId: src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0 is DEAD
2025-10-02T08:12:14.177721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:14.177730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0] Write session will restart in 0.007259s
2025-10-02T08:12:14.177769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0] Write session: Do CDS request
2025-10-02T08:12:14.177776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:14.186306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.186335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:14.186348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1409
2025-10-02T08:12:14.186489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.186519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:14.186528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:14.186531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:14.186996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1409 sessionId:  describe result for acl check
2025-10-02T08:12:14.187041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:14.187047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:14.187049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:14.187054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534254748885172:4530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:14.187524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534254748885172:4530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:14.191061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534254748885172:4530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:14.194957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:14.195225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:14.195358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534254748885172:4530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:14.195362Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:14.195364Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:14.195370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:14.195371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534254748885172:4530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:14.195374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534254748885172:4530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:14.195383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:14.195398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:14.195421Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534254748885341:4535]
2025-10-02T08:12:14.195818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:14.195931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:14.195954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:14.196150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:14.196177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.196181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.196182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.196183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.196183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.196186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.196192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.196194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.196196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.196198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.196201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.196208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.196212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.196215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.196217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.196220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.196222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.196224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.196230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.196233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.196242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:14.204500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:14.206296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:14.206319Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:14.206321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:14.206324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:14.206330Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1408 [1:7556534254748885341:4535]
2025-10-02T08:12:14.206341Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:14.206358Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:14.206361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.206364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.206366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.206382Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:14.206386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:14.206393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:14.206455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.206465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.206468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:14.206470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:14.206533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:14.206541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.206554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.206569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:14.206590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1408
2025-10-02T08:12:14.206591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748885346:4530], now have 1 active actors on pipe
2025-10-02T08:12:14.206598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534254748885335:4535]
2025-10-02T08:12:14.206600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534254748885335:4535]
2025-10-02T08:12:14.206611Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:14.206623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:14.206641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:14.206648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:14.206654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534255208763471:2378], now have 1 active actors on pipe
2025-10-02T08:12:14.206658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.206662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.206680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:14.206689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:14.206701Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534254748885335:4535]
2025-10-02T08:12:14.206709Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:14.206711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:14.206723Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:14.206733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.206737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.206739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:14.206748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.206760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:14.206741Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1408
2025-10-02T08:12:14.206801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.206861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.206869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.206882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.206919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1409 partition: 0 MaxSeqNo: 17 sessionId: src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0
2025-10-02T08:12:14.207298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf868305-92fb2d28-cee5e40b-276f8e5c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:14.210171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0] Write session: try to update token
2025-10-02T08:12:14.210192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:14.222657Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:14.222672Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:14.222682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534254748885335:4535]
2025-10-02T08:12:14.222719Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:14.222722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:14.222881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:14.223021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:14.223147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:14.223285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:14.223474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:14.223513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:14.224825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId: src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:14.227235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:14.227299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.227316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.227345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:14.227359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:14.227394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.227408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.227585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.227650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.227720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.227785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.227947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.227956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.228023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.228094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.228151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.228214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.228260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.228267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.228331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.228389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.228450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.228513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.228553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.228561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.228619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.228682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.228756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.228839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.228887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.228893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.228965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.229031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.229097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.229163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.229216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.229223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.229299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.229360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.229425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.229495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.229545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.229552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.229624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.229683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.229764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.229839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.229890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.229897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.229973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.230034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.230102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.230169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.230230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.230241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.230314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.230369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.230425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.230484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.230530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.230537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.230606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:14.230667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:14.230722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:14.230787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:14.230837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:14.230847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:14.230893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:14.230982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.231008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.231014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:14.231043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:14.231058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:14.231065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:14.231069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:14.231076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:14.231456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:14.231491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:14.231504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:14.231508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:14.231515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:14.231518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:14.232097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:14.232115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:14.232123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:14.232130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:14.232134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:14.232141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:14.232599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:14.232617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:14.232628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:14.232632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:14.232639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:14.234833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:14.234850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:14.234864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392734234
2025-10-02T08:12:14.234976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:14.234989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:14.234994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:14.234997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:14.235004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:14.235008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:14.235463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:14.235485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:14.235492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:14.235496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:14.235499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:14.235502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:14.235934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:14.235954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:14.235966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:14.235975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:14.235983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:14.235986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:14.236440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:14.236459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:14.236468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:14.237582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:14.237597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:14.237602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:14.237606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:14.237614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392734237
2025-10-02T08:12:14.237880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:14.237896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:14.237905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:14.237908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:14.237912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:14.237916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:14.238325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:14.238345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:14.238354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:14.238362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:14.238365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:14.238371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:14.238811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:14.238830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.238921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392734238
2025-10-02T08:12:14.239632Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:14.239651Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:14.239665Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:14.239672Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:14.241220Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:14.241231Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:14.241233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:14.241242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534254748885335:4535]
2025-10-02T08:12:14.241245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534254748885335:4535]
2025-10-02T08:12:14.241302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:14.241305Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:14.241310Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:14.241310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.241313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:14.241442Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:14.277442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534254748885397:4654]
2025-10-02T08:12:14.277517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1408, pipe: [1:7556534254748885397:4654]
2025-10-02T08:12:14.382874Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:14.383179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748885397:4654], now have 1 active actors on pipe
2025-10-02T08:12:14.383259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:14.383264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:14.383268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534254748885397:4654]
2025-10-02T08:12:14.383283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1409 reason: error at write: Disconnected sessionId: src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0
2025-10-02T08:12:14.383351Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:14.383428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1409 sessionId: src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0 is DEAD
2025-10-02T08:12:14.383459Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:14.383573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:14.383584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0] Write session will restart in 0.009067s
2025-10-02T08:12:14.383608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0] Write session: Do CDS request
2025-10-02T08:12:14.383615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:14.394226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.394282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:14.394293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1410
2025-10-02T08:12:14.394390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.394415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:14.394422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:14.394425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:14.394697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1410 sessionId:  describe result for acl check
2025-10-02T08:12:14.394719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:14.394723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:14.394724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:14.394728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534254748885901:4508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:14.395119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534254748885901:4508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:14.396967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534254748885901:4508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:14.397563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:14.397921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:14.398064Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:14.398077Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:14.398086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:14.398122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:14.398147Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534254748886018:4511]
2025-10-02T08:12:14.398541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:14.398697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:14.398722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:14.398953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:14.398993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.398994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.398995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.398995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.398996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.398999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.399005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.399007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.399008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.399011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.399014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.399018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.399022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.399025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.399027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.399030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.399032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.399034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.399037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.399040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.399050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:14.399415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534254748885901:4508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:14.399423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534254748885901:4508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:14.399425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534254748885901:4508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:14.399431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:14.408225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:14.410169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:14.410189Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:14.410190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:14.410194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:14.410199Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1409 [1:7556534254748886018:4511]
2025-10-02T08:12:14.410210Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:14.410230Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:14.410237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.410239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.410241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.410256Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:14.410266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:14.410276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:14.410333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.410340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.410343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:14.410345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:14.410406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:14.410412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.410424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.410438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:14.410456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1409
2025-10-02T08:12:14.410460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748886035:4508], now have 1 active actors on pipe
2025-10-02T08:12:14.410465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534254748886012:4511]
2025-10-02T08:12:14.410467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534254748886012:4511]
2025-10-02T08:12:14.410474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:14.410484Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:14.410486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534255208763477:2378], now have 1 active actors on pipe
2025-10-02T08:12:14.410492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:14.410493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:14.410504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:14.410512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:14.410518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.410522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.410558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534254748886012:4511]
2025-10-02T08:12:14.410565Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:14.410546Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1409
2025-10-02T08:12:14.410577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:14.410578Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:14.410585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.410587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.410589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:14.410597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.410609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:14.410653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.410701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.410707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.410718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.410767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1410 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0
2025-10-02T08:12:14.411099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5110-54ff5245-f60e4ff9-98b0d6d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:14.413589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0] Write session: try to update token
2025-10-02T08:12:14.413600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:14.426760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId: src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:14.427958Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:14.427977Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:14.427979Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:14.427989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534254748886012:4511]
2025-10-02T08:12:14.427992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534254748886012:4511]
2025-10-02T08:12:14.428037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:14.428040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:14.428045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:14.428047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.428050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:14.428205Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:14.429245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:14.483267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534254748886051:4654]
2025-10-02T08:12:14.483357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1409, pipe: [1:7556534254748886051:4654]
2025-10-02T08:12:14.553722Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:14.553994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.554004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.554034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748886051:4654], now have 1 active actors on pipe
2025-10-02T08:12:14.554129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534254748886051:4654]
2025-10-02T08:12:14.554154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:14.554160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:14.554220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1410 reason: error at write: Disconnected sessionId: src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0
2025-10-02T08:12:14.554297Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:14.554388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1410 sessionId: src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0 is DEAD
2025-10-02T08:12:14.554409Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:14.554521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:14.554528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0] Write session will restart in 0.005043s
2025-10-02T08:12:14.554560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0] Write session: Do CDS request
2025-10-02T08:12:14.554567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:14.560225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.560392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:14.560403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1411
2025-10-02T08:12:14.560538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.560579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:14.560589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:14.560592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:14.561044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1411 sessionId:  describe result for acl check
2025-10-02T08:12:14.561068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:14.561074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:14.561075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:14.561080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534254748886353:4481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:14.561533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534254748886353:4481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:14.563666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534254748886353:4481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:14.566596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534254748886353:4481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:14.566609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534254748886353:4481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:14.566612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534254748886353:4481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:14.566620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:14.568567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:14.569242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:14.569408Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:14.569418Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:14.569427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:14.569474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:14.569511Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534254748886679:4483]
2025-10-02T08:12:14.570122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:14.570344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:14.570382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:14.570777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:14.570818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.570823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.570824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.570825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.570826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.570831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.570839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.570843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.570846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.570849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.570854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.570861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.570866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.570871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.570879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.570884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.570891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.570896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.570905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.570913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.570936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:14.579058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:14.580788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:14.580822Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:14.580826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:14.580830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:14.580837Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1410 [1:7556534254748886679:4483]
2025-10-02T08:12:14.580849Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:14.580866Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:14.580869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.580872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.580874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.580891Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:14.580902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:14.580909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:14.580972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.580980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.580984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:14.580986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:14.581049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:14.581056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.581068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.581079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:14.581099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534254748886673:4483]
2025-10-02T08:12:14.581105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534254748886673:4483]
2025-10-02T08:12:14.581113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1410
2025-10-02T08:12:14.581116Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:14.581129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748886650:4481], now have 1 active actors on pipe
2025-10-02T08:12:14.581137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:14.581140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:14.581141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:14.581154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:14.581160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:14.581195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.581203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.581217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534255208763484:2378], now have 1 active actors on pipe
2025-10-02T08:12:14.581224Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534254748886673:4483]
2025-10-02T08:12:14.581231Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:14.581239Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1410
2025-10-02T08:12:14.581250Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:14.581264Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c279f885-c5cc3d80-7932f898-907caea1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:14.581270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.581274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.581276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:14.581285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.581295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:14.581323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.581369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.581376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.581389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.581430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1411 partition: 0 MaxSeqNo: 17 sessionId: src_id|c279f885-c5cc3d80-7932f898-907caea1_0
2025-10-02T08:12:14.581765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0bac6e-c7d5f28d-8b144214-f311730f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c279f885-c5cc3d80-7932f898-907caea1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:14.584243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c279f885-c5cc3d80-7932f898-907caea1_0] Write session: try to update token
2025-10-02T08:12:14.584258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c279f885-c5cc3d80-7932f898-907caea1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:14.598102Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:14.598119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:14.598121Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:14.598127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534254748886673:4483]
2025-10-02T08:12:14.598130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534254748886673:4483]
2025-10-02T08:12:14.598164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:14.598170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.598172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:14.598172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:14.598176Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:14.598294Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:14.600280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId: src_id|c279f885-c5cc3d80-7932f898-907caea1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:14.602808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:14.685156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534254748886718:4654]
2025-10-02T08:12:14.686988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1410, pipe: [1:7556534254748886718:4654]
2025-10-02T08:12:14.722726Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:14.723018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.723029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.723060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748886718:4654], now have 1 active actors on pipe
2025-10-02T08:12:14.723122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:14.723126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:14.723165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1411 reason: error at write: Disconnected sessionId: src_id|c279f885-c5cc3d80-7932f898-907caea1_0
2025-10-02T08:12:14.723230Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:14.723218Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:14.723313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1411 sessionId: src_id|c279f885-c5cc3d80-7932f898-907caea1_0 is DEAD
2025-10-02T08:12:14.723428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c279f885-c5cc3d80-7932f898-907caea1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:14.723435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c279f885-c5cc3d80-7932f898-907caea1_0] Write session will restart in 0.006199s
2025-10-02T08:12:14.723429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534254748886718:4654]
2025-10-02T08:12:14.723453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c279f885-c5cc3d80-7932f898-907caea1_0] Write session: Do CDS request
2025-10-02T08:12:14.723458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c279f885-c5cc3d80-7932f898-907caea1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:14.730243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c279f885-c5cc3d80-7932f898-907caea1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.730303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:14.730317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1412
2025-10-02T08:12:14.730410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.730430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:14.730437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:14.730439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:14.730717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1412 sessionId:  describe result for acl check
2025-10-02T08:12:14.730741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:14.730745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:14.730746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:14.730750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534254748887089:4411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:14.731147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534254748887089:4411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:14.732999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534254748887089:4411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:14.736010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534254748887089:4411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:14.736023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534254748887089:4411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:14.736026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534254748887089:4411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:14.736033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:14.737109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:14.737629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:14.737786Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:14.737795Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:14.737802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:14.737835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:14.737859Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534254748887364:4428]
2025-10-02T08:12:14.738284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:14.738436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:14.738471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:14.738736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:14.738775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.738781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.738782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.738783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.738784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.738788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.738797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.738801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.738804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.738808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.738812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.738819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.738825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.738829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.738834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.738843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.738847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.738852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.738860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.738864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.738878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:14.746501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:14.747978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:14.747990Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:14.747992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:14.747995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:14.747999Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1411 [1:7556534254748887364:4428]
2025-10-02T08:12:14.748007Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:14.748022Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:14.748024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.748026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.748027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.748038Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:14.748042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:14.748047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:14.748103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.748109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.748111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:14.748113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:14.748168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:14.748175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.748186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.748197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:14.748217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748887343:4411], now have 1 active actors on pipe
2025-10-02T08:12:14.748223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1411
2025-10-02T08:12:14.748226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534254748887358:4428]
2025-10-02T08:12:14.748228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534254748887358:4428]
2025-10-02T08:12:14.748234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:14.748241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534255208763492:2378], now have 1 active actors on pipe
2025-10-02T08:12:14.748241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:14.748243Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:14.748253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:14.748265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:14.748268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:14.748274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.748282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.748314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534254748887358:4428]
2025-10-02T08:12:14.748323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:14.748335Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:14.748336Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1e8be97-192d32b0-80ae205-c4153691_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:14.748342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.748345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.748346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:14.748354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.748361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:14.748325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1411
2025-10-02T08:12:14.748395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.748432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.748439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.748450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.748485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1412 partition: 0 MaxSeqNo: 17 sessionId: src_id|a1e8be97-192d32b0-80ae205-c4153691_0
2025-10-02T08:12:14.748795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c279f885-c5cc3d80-7932f898-907caea1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a1e8be97-192d32b0-80ae205-c4153691_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:14.751072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e8be97-192d32b0-80ae205-c4153691_0] Write session: try to update token
2025-10-02T08:12:14.751086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e8be97-192d32b0-80ae205-c4153691_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:14.763387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId: src_id|a1e8be97-192d32b0-80ae205-c4153691_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:14.765648Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:14.765667Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:14.765669Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:14.765677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534254748887358:4428]
2025-10-02T08:12:14.765681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534254748887358:4428]
2025-10-02T08:12:14.765721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:14.765727Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:14.765731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.765732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:14.765733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:14.765877Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:14.766094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:14.823754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534254748887395:4654]
2025-10-02T08:12:14.823862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1411, pipe: [1:7556534254748887395:4654]
2025-10-02T08:12:14.897373Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:14.897564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.897575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.897604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748887395:4654], now have 1 active actors on pipe
2025-10-02T08:12:14.897708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534254748887395:4654]
2025-10-02T08:12:14.897725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:14.897726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:14.897765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1412 reason: error at write: Disconnected sessionId: src_id|a1e8be97-192d32b0-80ae205-c4153691_0
2025-10-02T08:12:14.897784Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:14.897851Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:14.897893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1412 sessionId: src_id|a1e8be97-192d32b0-80ae205-c4153691_0 is DEAD
2025-10-02T08:12:14.898041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e8be97-192d32b0-80ae205-c4153691_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:14.898050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e8be97-192d32b0-80ae205-c4153691_0] Write session will restart in 0.009574s
2025-10-02T08:12:14.898067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e8be97-192d32b0-80ae205-c4153691_0] Write session: Do CDS request
2025-10-02T08:12:14.898072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e8be97-192d32b0-80ae205-c4153691_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:14.908169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e8be97-192d32b0-80ae205-c4153691_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.908225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:14.908236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1413
2025-10-02T08:12:14.908341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:14.908362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:14.908368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:14.908371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:14.908610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1413 sessionId:  describe result for acl check
2025-10-02T08:12:14.908630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:14.908635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:14.908636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:14.908639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534254748887973:4392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:14.909011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534254748887973:4392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:14.909513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:14.910121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:14.910238Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:14.910246Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:14.910253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:14.910295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:14.910321Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534254748888007:4396]
2025-10-02T08:12:14.910692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:14.910841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:14.910869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:14.911064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:14.911093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.911097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.911098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.911099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.911099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.911102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.911108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.911110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.911112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.911114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.911117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.911121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:14.911127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.911130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:14.911132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.911135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:14.911140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.911143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.911147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.911152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.911166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534254748887973:4392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:14.911170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:14.916410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534254748887973:4392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:14.916423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534254748887973:4392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:14.916425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534254748887973:4392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:14.916433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:14.918290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:14.919705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:14.919715Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:14.919717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:14.919719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:14.919723Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1412 [1:7556534254748888007:4396]
2025-10-02T08:12:14.919729Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:14.919740Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:14.919742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.919744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.919745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.919754Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:14.919757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:14.919764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:14.919801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.919807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.919809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:14.919810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:14.919850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:14.919857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.919864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:14.919871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:14.919883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748888036:4392], now have 1 active actors on pipe
2025-10-02T08:12:14.919891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534254748887990:4396]
2025-10-02T08:12:14.919893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534254748887990:4396]
2025-10-02T08:12:14.919898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:14.919899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1412
2025-10-02T08:12:14.919905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534255208763520:2378], now have 1 active actors on pipe
2025-10-02T08:12:14.919906Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:14.919909Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:14.919911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:14.919919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:14.919921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:14.919927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.919934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.919964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534254748887990:4396]
2025-10-02T08:12:14.919974Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:14.919977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:14.919990Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:14.919994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:14.919997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:14.919998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:14.920004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:14.920014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:14.919979Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1412
2025-10-02T08:12:14.920042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.920087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:14.920091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:14.920100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:14.920125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1413 partition: 0 MaxSeqNo: 17 sessionId: src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0
2025-10-02T08:12:14.920372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e8be97-192d32b0-80ae205-c4153691_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:14.922807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0] Write session: try to update token
2025-10-02T08:12:14.922821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:14.935150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId: src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:14.936029Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:14.936040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:14.936042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:14.936047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534254748887990:4396]
2025-10-02T08:12:14.936050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534254748887990:4396]
2025-10-02T08:12:14.936095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:14.936099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:14.936103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:14.936103Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:14.936104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:14.936224Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:14.937390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:14.997829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534254748888049:4654]
2025-10-02T08:12:14.997941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1412, pipe: [1:7556534254748888049:4654]
2025-10-02T08:12:15.064450Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:15.064677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.064687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.064717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534254748888049:4654], now have 1 active actors on pipe
2025-10-02T08:12:15.064865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:15.064875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:15.064896Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:15.064937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1413 reason: error at write: Disconnected sessionId: src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0
2025-10-02T08:12:15.065006Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:15.065088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1413 sessionId: src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0 is DEAD
2025-10-02T08:12:15.065130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534254748888049:4654]
2025-10-02T08:12:15.065228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:15.065239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0] Write session will restart in 0.008577s
2025-10-02T08:12:15.065265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0] Write session: Do CDS request
2025-10-02T08:12:15.065271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:15.075322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.075355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:15.075368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1414
2025-10-02T08:12:15.075590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.075620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:15.075628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:15.075631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:15.076043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1414 sessionId:  describe result for acl check
2025-10-02T08:12:15.076082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:15.076088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:15.076089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:15.076094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534259043855837:4379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:15.076561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534259043855837:4379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:15.078875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534259043855837:4379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:15.080483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:15.081313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:15.081466Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:15.081479Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:15.081488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:15.081531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:15.081568Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534259043855971:4382]
2025-10-02T08:12:15.081833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534259043855837:4379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:15.081848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534259043855837:4379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:15.081856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534259043855837:4379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:15.081864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:15.082197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:15.082373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:15.082414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:15.082712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:15.082762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.082768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.082769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.082770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.082772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.082777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.082787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.082791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.082795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.082799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.082804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.082811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.082816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.082821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.082825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.082838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.082842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.082847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.082851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.082856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.082874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:15.091452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:15.093135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:15.093150Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:15.093153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:15.093156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:15.093162Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1413 [1:7556534259043855971:4382]
2025-10-02T08:12:15.093174Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:15.093189Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:15.093192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.093195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.093197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.093211Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:15.093221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:15.093227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:15.093290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.093297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.093300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:15.093303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:15.093364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:15.093370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.093383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.093401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:15.093420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534259043855965:4382]
2025-10-02T08:12:15.093426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534259043855965:4382]
2025-10-02T08:12:15.093435Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:15.093446Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:15.093452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043855976:4379], now have 1 active actors on pipe
2025-10-02T08:12:15.093455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:15.093458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1413
2025-10-02T08:12:15.093459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:15.093473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:15.093476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:15.093481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534259503730824:2378], now have 1 active actors on pipe
2025-10-02T08:12:15.093516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.093527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.093540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534259043855965:4382]
2025-10-02T08:12:15.093561Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:15.093568Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:15.093585Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43003398-20831280-9b3b4c00-a39bc728_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:15.093590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.093594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.093563Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1413
2025-10-02T08:12:15.093596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:15.093604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.093613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:15.093638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.093691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.093698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.093709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.093742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1414 partition: 0 MaxSeqNo: 17 sessionId: src_id|43003398-20831280-9b3b4c00-a39bc728_0
2025-10-02T08:12:15.094081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e313d5fd-f6b4f5fc-f74a5168-4643fdde_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|43003398-20831280-9b3b4c00-a39bc728_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:15.096567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43003398-20831280-9b3b4c00-a39bc728_0] Write session: try to update token
2025-10-02T08:12:15.096583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43003398-20831280-9b3b4c00-a39bc728_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:15.110439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId: src_id|43003398-20831280-9b3b4c00-a39bc728_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:15.111545Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:15.111563Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:15.111565Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:15.111573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534259043855965:4382]
2025-10-02T08:12:15.111576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534259043855965:4382]
2025-10-02T08:12:15.111614Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:15.111615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:15.111621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.111623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:15.111625Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:15.111763Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:15.113159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:15.165240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534259043856001:4654]
2025-10-02T08:12:15.165357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1413, pipe: [1:7556534259043856001:4654]
2025-10-02T08:12:15.250071Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:15.250374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.250388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.250424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043856001:4654], now have 1 active actors on pipe
2025-10-02T08:12:15.250539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:15.250550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:15.250577Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:15.250619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1414 reason: error at write: Disconnected sessionId: src_id|43003398-20831280-9b3b4c00-a39bc728_0
2025-10-02T08:12:15.250632Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:15.250787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1414 sessionId: src_id|43003398-20831280-9b3b4c00-a39bc728_0 is DEAD
2025-10-02T08:12:15.250793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534259043856001:4654]
2025-10-02T08:12:15.250905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43003398-20831280-9b3b4c00-a39bc728_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:15.250916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43003398-20831280-9b3b4c00-a39bc728_0] Write session will restart in 0.006179s
2025-10-02T08:12:15.250939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43003398-20831280-9b3b4c00-a39bc728_0] Write session: Do CDS request
2025-10-02T08:12:15.250944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43003398-20831280-9b3b4c00-a39bc728_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:15.258256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43003398-20831280-9b3b4c00-a39bc728_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.258342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:15.258357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1415
2025-10-02T08:12:15.258462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.258490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:15.258499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:15.258502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:15.258863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1415 sessionId:  describe result for acl check
2025-10-02T08:12:15.258889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:15.258892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:15.258894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:15.258898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534259043856446:4349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:15.259356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534259043856446:4349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:15.261657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534259043856446:4349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:15.263345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:15.263597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:15.263741Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:15.263750Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:15.263759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:15.263798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:15.263880Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534259043856643:4350]
2025-10-02T08:12:15.264254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534259043856446:4349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:15.264266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534259043856446:4349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:15.264271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534259043856446:4349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:15.264278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:15.264494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:15.264655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:15.264695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:15.265008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:15.265048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.265054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.265055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.265056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.265057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.265062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.265072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.265080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.265084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.265091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.265096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.265107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.265115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.265124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.265132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.265141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.265145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.265151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.265160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.265170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.265191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:15.272737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:15.274418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:15.274433Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:15.274436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:15.274440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:15.274449Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1414 [1:7556534259043856643:4350]
2025-10-02T08:12:15.274461Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:15.274476Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:15.274480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.274482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.274484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.274498Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:15.274508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:15.274514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:15.274579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.274588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.274592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:15.274596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:15.274658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:15.274665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.274677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.274695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:15.274712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1414
2025-10-02T08:12:15.274717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043856648:4349], now have 1 active actors on pipe
2025-10-02T08:12:15.274721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534259503730843:2378], now have 1 active actors on pipe
2025-10-02T08:12:15.274727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534259043856637:4350]
2025-10-02T08:12:15.274729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534259043856637:4350]
2025-10-02T08:12:15.274739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:15.274752Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:15.274753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.274757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.274761Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:15.274774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:15.274792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:15.274803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:15.274775Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1414
2025-10-02T08:12:15.274839Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:15.274848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.274852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.274854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:15.274862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.274873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:15.274891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534259043856637:4350]
2025-10-02T08:12:15.274902Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:15.274913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:15.274925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.274993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.274999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.275012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.275046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1415 partition: 0 MaxSeqNo: 17 sessionId: src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0
2025-10-02T08:12:15.275367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43003398-20831280-9b3b4c00-a39bc728_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:15.277793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0] Write session: try to update token
2025-10-02T08:12:15.277806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:15.285110Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:15.285128Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:15.285137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534259043856637:4350]
2025-10-02T08:12:15.285173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:15.285175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:15.285341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:15.285487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:15.285624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:15.285759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:15.285941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:15.285980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:15.291585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId: src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:15.294150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:15.294219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.294230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.294271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:15.294324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:15.294394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.294402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.294555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.294617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.294685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.294749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.294794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.294803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.294878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.294940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.295007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.295075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.295120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.295127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.295193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.295255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.295316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.295378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.295419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.295426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.295494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.295561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.295644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.295727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.295805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.295813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.295892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.295964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.296040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.296126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.296183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.296191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.296273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.296342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.296417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.296493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.296566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.296573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.296652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.296727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.296824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.296898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.296950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.296959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.297038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.297110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.297186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.297262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.297313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.297321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.297398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.297460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.297523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.297582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.297632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.297639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.297710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:15.297775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:15.297837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:15.297899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:15.297952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:15.297959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:15.297993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:15.298056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.298078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.298084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:15.298116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:15.298131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:15.298138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:15.298142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:15.298145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:15.298533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:15.298559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:15.298565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:15.298568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:15.298572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:15.298575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:15.299079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:15.299101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:15.299107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:15.299109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:15.299112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:15.299115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:15.299617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:15.299640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:15.299645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:15.299650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:15.299653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:15.301816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:15.301834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:15.301846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392735301
2025-10-02T08:12:15.301979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:15.301994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:15.302000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:15.302003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:15.302007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:15.302011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:15.302505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:15.302526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:15.302532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:15.302535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:15.302539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:15.302543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:15.303002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:15.303022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:15.303030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:15.303038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:15.303044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:15.303047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:15.303528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:15.303549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:15.303556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:15.304699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:15.304717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:15.304722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:15.304728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:15.304736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392735304
2025-10-02T08:12:15.305043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:15.305065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:15.305071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:15.305074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:15.305077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:15.305080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:15.305530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:15.305552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:15.305558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:15.305565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:15.305573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:15.305576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:15.306003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:15.306022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.306134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392735306
2025-10-02T08:12:15.310051Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:15.310073Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:15.310080Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:15.310098Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:15.311612Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:15.311627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:15.311629Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:15.311638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534259043856637:4350]
2025-10-02T08:12:15.311643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534259043856637:4350]
2025-10-02T08:12:15.311694Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:15.311704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:15.311704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:15.311710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.311712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:15.311855Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:15.351141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534259043856680:4654]
2025-10-02T08:12:15.351226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1414, pipe: [1:7556534259043856680:4654]
2025-10-02T08:12:15.442466Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:15.442970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043856680:4654], now have 1 active actors on pipe
2025-10-02T08:12:15.443063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534259043856680:4654]
2025-10-02T08:12:15.443081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:15.443087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:15.443110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1415 reason: error at write: Disconnected sessionId: src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0
2025-10-02T08:12:15.443138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:15.443190Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:15.443274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1415 sessionId: src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0 is DEAD
2025-10-02T08:12:15.443418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:15.443428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0] Write session will restart in 0.006162s
2025-10-02T08:12:15.443450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0] Write session: Do CDS request
2025-10-02T08:12:15.443456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:15.450204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.450328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:15.450343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1416
2025-10-02T08:12:15.450460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.450490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:15.450495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:15.450497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:15.450919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1416 sessionId:  describe result for acl check
2025-10-02T08:12:15.450948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:15.450952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:15.450953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:15.450958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534259043857057:4324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:15.451494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534259043857057:4324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:15.453469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534259043857057:4324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:15.455715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534259043857057:4324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:15.455727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534259043857057:4324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:15.455729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534259043857057:4324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:15.455735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:15.457397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:15.457716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:15.457869Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:15.457879Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:15.457887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:15.457927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:15.457962Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534259043857316:4327]
2025-10-02T08:12:15.458622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:15.458767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:15.458807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:15.459104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:15.459142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.459147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.459148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.459149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.459150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.459155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.459166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.459170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.459174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.459179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.459186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.459198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.459207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.459213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.459225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.459231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.459241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.459247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.459258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.459263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.459280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:15.467462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:15.469492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:15.469507Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:15.469509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:15.469513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:15.469519Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1415 [1:7556534259043857316:4327]
2025-10-02T08:12:15.469535Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:15.469554Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:15.469561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.469564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.469566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.469580Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:15.469590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:15.469601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:15.469654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.469661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.469665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:15.469667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:15.469727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:15.469734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.469746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.469761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:15.469780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534259043857310:4327]
2025-10-02T08:12:15.469789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534259043857310:4327]
2025-10-02T08:12:15.469796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:15.469813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043857298:4324], now have 1 active actors on pipe
2025-10-02T08:12:15.469812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:15.469816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:15.469819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:15.469819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1415
2025-10-02T08:12:15.469834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:15.469837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:15.469842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534259503730850:2378], now have 1 active actors on pipe
2025-10-02T08:12:15.469866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.469874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.469886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534259043857310:4327]
2025-10-02T08:12:15.469893Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:15.469912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:15.469915Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:15.469889Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1415
2025-10-02T08:12:15.469921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.469924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.469926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:15.469933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.469940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:15.469964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.470008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.470014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.470026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.470064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1416 partition: 0 MaxSeqNo: 17 sessionId: src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0
2025-10-02T08:12:15.470331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c581eb1d-4f785097-24111e3f-fa348f6e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:15.472670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0] Write session: try to update token
2025-10-02T08:12:15.472683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:15.486204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId: src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:15.487820Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:15.487835Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:15.487837Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:15.487845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534259043857310:4327]
2025-10-02T08:12:15.487848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534259043857310:4327]
2025-10-02T08:12:15.487882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:15.487888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:15.487891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:15.487894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.487897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:15.488031Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:15.488725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:15.543108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534259043857343:4654]
2025-10-02T08:12:15.543192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1415, pipe: [1:7556534259043857343:4654]
2025-10-02T08:12:15.623910Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:15.624313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.624327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.624366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043857343:4654], now have 1 active actors on pipe
2025-10-02T08:12:15.624463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534259043857343:4654]
2025-10-02T08:12:15.624487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:15.624494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:15.624539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1416 reason: error at write: Disconnected sessionId: src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0
2025-10-02T08:12:15.624548Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:15.624556Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:15.624691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1416 sessionId: src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0 is DEAD
2025-10-02T08:12:15.624833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:15.624841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0] Write session will restart in 0.008952s
2025-10-02T08:12:15.624877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0] Write session: Do CDS request
2025-10-02T08:12:15.624883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:15.635208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.635269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:15.635280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1417
2025-10-02T08:12:15.635372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.635413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:15.635422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:15.635425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:15.635770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1417 sessionId:  describe result for acl check
2025-10-02T08:12:15.635795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:15.635800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:15.635801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:15.635804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534259043857929:4312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:15.636190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534259043857929:4312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:15.637307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:15.637973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:15.638035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534259043857929:4312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:15.638094Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:15.638101Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:15.638108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:15.638145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:15.638172Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534259043857967:4315]
2025-10-02T08:12:15.638585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:15.638750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:15.638789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:15.639049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:15.639087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.639091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.639092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.639093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.639093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.639097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.639103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.639106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.639108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.639110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.639113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.639118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.639122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.639125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.639127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.639130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.639132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.639135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.639137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.639140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.639150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:15.643792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534259043857929:4312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:15.643805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534259043857929:4312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:15.643808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534259043857929:4312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:15.643815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:15.647123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:15.648743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:15.648756Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:15.648757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:15.648760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:15.648765Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1416 [1:7556534259043857967:4315]
2025-10-02T08:12:15.648771Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:15.648782Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:15.648784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.648786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.648787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.648798Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:15.648825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:15.648832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:15.648875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.648882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.648884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:15.648886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:15.648930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:15.648935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.648943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.648949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:15.648963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1416
2025-10-02T08:12:15.648965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043857994:4312], now have 1 active actors on pipe
2025-10-02T08:12:15.648971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534259043857956:4315]
2025-10-02T08:12:15.648972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534259043857956:4315]
2025-10-02T08:12:15.648977Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:15.648984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534259503730858:2378], now have 1 active actors on pipe
2025-10-02T08:12:15.648990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.648993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:15.648996Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:15.648998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.649013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:15.649027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:15.649033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:15.649061Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:15.649069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.649071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.649073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:15.649080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.649044Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1416
2025-10-02T08:12:15.649092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:15.649103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534259043857956:4315]
2025-10-02T08:12:15.649115Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:15.649130Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:15.649149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.649190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.649196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.649206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.649237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1417 partition: 0 MaxSeqNo: 17 sessionId: src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0
2025-10-02T08:12:15.649530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eac65dc-41d3d68d-bd32da78-9eab2bce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:15.651834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0] Write session: try to update token
2025-10-02T08:12:15.651849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:15.663947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId: src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:15.666243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:15.666771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.666788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.666807Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:15.666811Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:15.666813Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:15.666820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534259043857956:4315]
2025-10-02T08:12:15.666823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534259043857956:4315]
2025-10-02T08:12:15.666852Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:15.666862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:15.666868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:15.666873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.666876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:15.667003Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:15.724865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534259043858043:4654]
2025-10-02T08:12:15.724933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1416, pipe: [1:7556534259043858043:4654]
2025-10-02T08:12:15.797569Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:15.798116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:15.798154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:15.798161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043858043:4654], now have 1 active actors on pipe
2025-10-02T08:12:15.798271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534259043858043:4654]
2025-10-02T08:12:15.798287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:15.798289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:15.798306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1417 reason: error at write: Disconnected sessionId: src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0
2025-10-02T08:12:15.798334Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:15.798449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1417 sessionId: src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0 is DEAD
2025-10-02T08:12:15.798580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:15.798587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0] Write session will restart in 0.005031s
2025-10-02T08:12:15.798605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0] Write session: Do CDS request
2025-10-02T08:12:15.798612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:15.804192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.804271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:15.804284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1418
2025-10-02T08:12:15.804408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.804439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:15.804449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:15.804453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:15.804821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1418 sessionId:  describe result for acl check
2025-10-02T08:12:15.804858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:15.804860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:15.804861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:15.804867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534259043858367:4277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:15.805364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534259043858367:4277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:15.807414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534259043858367:4277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:15.809960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534259043858367:4277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:15.809971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534259043858367:4277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:15.809974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534259043858367:4277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:15.809979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:15.810740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:15.811028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:15.811176Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:15.811187Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:15.811195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:15.811243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:15.811273Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534259043858681:4268]
2025-10-02T08:12:15.811899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:15.812073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:15.812119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:15.812410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:15.812459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.812465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.812466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.812467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.812468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.812473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.812482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.812487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.812491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.812496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.812501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.812509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.812516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.812521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.812527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.812531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.812538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.812543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.812548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.812552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.812574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:15.820591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:15.822521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:15.822540Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:15.822543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:15.822547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:15.822553Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1417 [1:7556534259043858681:4268]
2025-10-02T08:12:15.822564Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:15.822577Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:15.822580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.822583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.822585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.822598Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:15.822609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:15.822616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:15.822667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.822674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.822677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:15.822679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:15.822738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:15.822748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.822761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.822774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:15.822802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534259503730869:2378], now have 1 active actors on pipe
2025-10-02T08:12:15.822813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534259043858675:4268]
2025-10-02T08:12:15.822820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534259043858675:4268]
2025-10-02T08:12:15.822822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1417
2025-10-02T08:12:15.822828Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:15.822835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:15.822836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043858672:4277], now have 1 active actors on pipe
2025-10-02T08:12:15.822843Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:15.822844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:15.822859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:15.822862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:15.822869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.822873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.822875Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1417
2025-10-02T08:12:15.822909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534259043858675:4268]
2025-10-02T08:12:15.822918Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:15.822925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:15.822932Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:15.822938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.822942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.822947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:15.822956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.822968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:15.823005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.823074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.823084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.823097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.823136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1418 partition: 0 MaxSeqNo: 17 sessionId: src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0
2025-10-02T08:12:15.823439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91d1101f-d0c05bb3-d80bb63f-75a5285_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:15.825795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0] Write session: try to update token
2025-10-02T08:12:15.825808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:15.837839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId: src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:15.840383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:15.840651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.840670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.840686Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:15.840692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:15.840694Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:15.840699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534259043858675:4268]
2025-10-02T08:12:15.840702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534259043858675:4268]
2025-10-02T08:12:15.840736Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:15.840742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:15.840745Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:15.840746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.840747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:15.840888Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:15.898460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534259043858714:4654]
2025-10-02T08:12:15.898573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1417, pipe: [1:7556534259043858714:4654]
2025-10-02T08:12:15.972573Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:15.972952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:15.972988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043858714:4654], now have 1 active actors on pipe
2025-10-02T08:12:15.972996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:15.973088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:15.973096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:15.973115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1418 reason: error at write: Disconnected sessionId: src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0
2025-10-02T08:12:15.973116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534259043858714:4654]
2025-10-02T08:12:15.973208Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:15.973251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1418 sessionId: src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0 is DEAD
2025-10-02T08:12:15.973381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:15.973391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0] Write session will restart in 0.007677s
2025-10-02T08:12:15.973412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0] Write session: Do CDS request
2025-10-02T08:12:15.973418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:15.982254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.982352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:15.982368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1419
2025-10-02T08:12:15.982499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:15.982532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:15.982542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:15.982545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:15.982861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1419 sessionId:  describe result for acl check
2025-10-02T08:12:15.982891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:15.982897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:15.982899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:15.982903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534259043859160:4270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:15.983372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534259043859160:4270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:15.985396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534259043859160:4270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:15.986881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:15.987566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:15.987726Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:15.987738Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:15.987747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:15.987791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:15.987815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534259043859160:4270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:15.987826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534259043859160:4270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:15.987828Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534259043859347:4271]
2025-10-02T08:12:15.987829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534259043859160:4270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:15.987836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:15.988494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:15.988664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:15.988712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:15.989042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:15.989095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.989101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.989103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.989104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.989105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.989110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.989120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.989128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.989133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.989141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.989146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.989158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:15.989168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.989177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:15.989185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.989191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:15.989200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.989209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.989218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.989227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.989250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:15.996883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:15.998812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:15.998828Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:15.998831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:15.998835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:15.998841Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1418 [1:7556534259043859347:4271]
2025-10-02T08:12:15.998853Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:15.998868Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:15.998877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.998880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.998882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.998899Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:15.998910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:15.998922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:15.998988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.998997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.999000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:15.999003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:15.999064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:15.999072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:15.999087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:15.999105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:15.999125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534259043859341:4271]
2025-10-02T08:12:15.999131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534259043859341:4271]
2025-10-02T08:12:15.999139Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:15.999150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:15.999156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534259043859352:4270], now have 1 active actors on pipe
2025-10-02T08:12:15.999158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1418
2025-10-02T08:12:15.999160Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:15.999165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:15.999177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:15.999180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:15.999185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534259503730894:2378], now have 1 active actors on pipe
2025-10-02T08:12:15.999218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.999229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.999242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534259043859341:4271]
2025-10-02T08:12:15.999257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:15.999231Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1418
2025-10-02T08:12:15.999268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:15.999286Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:15.999297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:15.999301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:15.999303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:15.999313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:15.999326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:15.999360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.999445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:15.999452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:15.999466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:15.999504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1419 partition: 0 MaxSeqNo: 17 sessionId: src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0
2025-10-02T08:12:15.999855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed921570-23ab6810-ee48a1aa-d65d769f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:16.002515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0] Write session: try to update token
2025-10-02T08:12:16.002528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:16.015451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId: src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:16.016150Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:16.016162Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:16.016164Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:16.016171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534259043859341:4271]
2025-10-02T08:12:16.016175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534259043859341:4271]
2025-10-02T08:12:16.016209Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:16.016215Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:16.016218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:16.016224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.016227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:16.016352Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:16.017780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:16.073037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534263338826675:4654]
2025-10-02T08:12:16.073144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1418, pipe: [1:7556534263338826675:4654]
2025-10-02T08:12:16.145731Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:16.146089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.146099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.146134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338826675:4654], now have 1 active actors on pipe
2025-10-02T08:12:16.146286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534263338826675:4654]
2025-10-02T08:12:16.146323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:16.146326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:16.146359Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:16.146388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1419 reason: error at write: Disconnected sessionId: src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0
2025-10-02T08:12:16.146401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:16.146568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1419 sessionId: src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0 is DEAD
2025-10-02T08:12:16.146729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:16.146740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0] Write session will restart in 0.007946s
2025-10-02T08:12:16.146761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0] Write session: Do CDS request
2025-10-02T08:12:16.146766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:16.156311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.156367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:16.156384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1420
2025-10-02T08:12:16.156553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.156587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:16.156591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:16.156593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:16.157004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1420 sessionId:  describe result for acl check
2025-10-02T08:12:16.157030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:16.157031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:16.157033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:16.157038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534263338827203:4259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:16.157503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534263338827203:4259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:16.159607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534263338827203:4259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:16.160753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:16.161130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:16.161321Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:16.161333Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:16.161343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:16.161401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:16.161438Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534263338827311:4256]
2025-10-02T08:12:16.162084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:16.162275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:16.162323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:16.162437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534263338827203:4259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:16.162450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534263338827203:4259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:16.162455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534263338827203:4259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:16.162463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:16.162667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:16.162732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.162739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.162740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.162741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.162742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.162748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.162758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.162762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.162766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.162770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.162776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.162783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.162790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.162801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.162806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.162816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.162820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.162825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.162830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.162839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.162858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:16.170790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:16.172454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:16.172470Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:16.172473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:16.172476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:16.172483Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1419 [1:7556534263338827311:4256]
2025-10-02T08:12:16.172495Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:16.172514Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:16.172521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.172525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.172527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.172542Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:16.172553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:16.172561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:16.172618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.172625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.172628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:16.172631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:16.172700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:16.172708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.172722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.172740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:16.172765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338827322:4259], now have 1 active actors on pipe
2025-10-02T08:12:16.172776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534263338827305:4256]
2025-10-02T08:12:16.172782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534263338827305:4256]
2025-10-02T08:12:16.172790Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:16.172815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1419
2025-10-02T08:12:16.172822Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:16.172826Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:16.172826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534263798698211:2378], now have 1 active actors on pipe
2025-10-02T08:12:16.172836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:16.172850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:16.172859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:16.172890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.172899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.172912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534263338827305:4256]
2025-10-02T08:12:16.172887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1419
2025-10-02T08:12:16.172920Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:16.172928Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:16.172942Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1fa2573-cf40329b-39574040-842bf451_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:16.172948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.172952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.172955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:16.172964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.172977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:16.173005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.173060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.173067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.173080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.173120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1420 partition: 0 MaxSeqNo: 17 sessionId: src_id|c1fa2573-cf40329b-39574040-842bf451_0
2025-10-02T08:12:16.173471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbe43d6-833f70ed-c092e7f1-92c10f54_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c1fa2573-cf40329b-39574040-842bf451_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:16.176013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fa2573-cf40329b-39574040-842bf451_0] Write session: try to update token
2025-10-02T08:12:16.176026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fa2573-cf40329b-39574040-842bf451_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:16.189745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId: src_id|c1fa2573-cf40329b-39574040-842bf451_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:16.190341Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:16.190354Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:16.190357Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:16.190364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534263338827305:4256]
2025-10-02T08:12:16.190368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534263338827305:4256]
2025-10-02T08:12:16.190407Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:16.190411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:16.190419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.190421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:16.190427Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:16.190552Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:16.192355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:16.246595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534263338827357:4654]
2025-10-02T08:12:16.246720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1419, pipe: [1:7556534263338827357:4654]
2025-10-02T08:12:16.321619Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:16.321902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.321922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.321967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338827357:4654], now have 1 active actors on pipe
2025-10-02T08:12:16.322130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534263338827357:4654]
2025-10-02T08:12:16.322149Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:16.322155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:16.322157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:16.322215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1420 reason: error at write: Disconnected sessionId: src_id|c1fa2573-cf40329b-39574040-842bf451_0
2025-10-02T08:12:16.322197Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:16.322379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1420 sessionId: src_id|c1fa2573-cf40329b-39574040-842bf451_0 is DEAD
2025-10-02T08:12:16.322536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fa2573-cf40329b-39574040-842bf451_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:16.322545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fa2573-cf40329b-39574040-842bf451_0] Write session will restart in 0.005503s
2025-10-02T08:12:16.322564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fa2573-cf40329b-39574040-842bf451_0] Write session: Do CDS request
2025-10-02T08:12:16.322569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fa2573-cf40329b-39574040-842bf451_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:16.329260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fa2573-cf40329b-39574040-842bf451_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.329398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:16.329411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1421
2025-10-02T08:12:16.329534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.329564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:16.329574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:16.329577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:16.329994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1421 sessionId:  describe result for acl check
2025-10-02T08:12:16.330027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:16.330033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:16.330035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:16.330040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534263338827716:4237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:16.330533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534263338827716:4237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:16.332544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534263338827716:4237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:16.335325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534263338827716:4237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:16.335339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534263338827716:4237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:16.335342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534263338827716:4237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:16.335350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:16.336204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:16.336491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:16.336660Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:16.336670Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:16.336680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:16.336735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:16.336774Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534263338828001:4238]
2025-10-02T08:12:16.337464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:16.337631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:16.337676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:16.337999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:16.338051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.338057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.338058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.338059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.338060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.338065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.338077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.338086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.338090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.338097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.338103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.338114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.338124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.338134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.338143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.338153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.338163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.338174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.338184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.338194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.338219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:16.346888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:16.348857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:16.348878Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:16.348881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:16.348886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:16.348894Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1420 [1:7556534263338828001:4238]
2025-10-02T08:12:16.348909Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:16.348929Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:16.348938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.348941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.348944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.348961Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:16.348967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:16.348976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:16.349052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.349059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.349062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:16.349065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:16.349133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:16.349140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.349154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.349172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:16.349195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338827992:4237], now have 1 active actors on pipe
2025-10-02T08:12:16.349200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1420
2025-10-02T08:12:16.349204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534263798698218:2378], now have 1 active actors on pipe
2025-10-02T08:12:16.349211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534263338827995:4238]
2025-10-02T08:12:16.349213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534263338827995:4238]
2025-10-02T08:12:16.349227Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:16.349240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:16.349243Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:16.349244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.349250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.349272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:16.349292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:16.349300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:16.349306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1420
2025-10-02T08:12:16.349345Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31f65efd-3b9691fa-621fdae6-cab53956_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:16.349357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.349361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.349368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:16.349378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.349391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:16.349401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534263338827995:4238]
2025-10-02T08:12:16.349415Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:16.349427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:16.349448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.349559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.349569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.349585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.349629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1421 partition: 0 MaxSeqNo: 17 sessionId: src_id|31f65efd-3b9691fa-621fdae6-cab53956_0
2025-10-02T08:12:16.350001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fa2573-cf40329b-39574040-842bf451_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|31f65efd-3b9691fa-621fdae6-cab53956_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:16.352721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f65efd-3b9691fa-621fdae6-cab53956_0] Write session: try to update token
2025-10-02T08:12:16.352736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f65efd-3b9691fa-621fdae6-cab53956_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:16.367763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId: src_id|31f65efd-3b9691fa-621fdae6-cab53956_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:16.367919Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:16.367937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:16.367939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:16.367949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534263338827995:4238]
2025-10-02T08:12:16.367958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534263338827995:4238]
2025-10-02T08:12:16.368007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:16.368016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:16.368019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.368021Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:16.368021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:16.368188Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:16.370533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:16.422248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534263338828027:4654]
2025-10-02T08:12:16.422358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1420, pipe: [1:7556534263338828027:4654]
2025-10-02T08:12:16.526638Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:16.527163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.527180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.527223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338828027:4654], now have 1 active actors on pipe
2025-10-02T08:12:16.527297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534263338828027:4654]
2025-10-02T08:12:16.527325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:16.527335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:16.527394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1421 reason: error at write: Disconnected sessionId: src_id|31f65efd-3b9691fa-621fdae6-cab53956_0
2025-10-02T08:12:16.527425Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:16.527450Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:16.527587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1421 sessionId: src_id|31f65efd-3b9691fa-621fdae6-cab53956_0 is DEAD
2025-10-02T08:12:16.527765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f65efd-3b9691fa-621fdae6-cab53956_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:16.527777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f65efd-3b9691fa-621fdae6-cab53956_0] Write session will restart in 0.007651s
2025-10-02T08:12:16.527805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f65efd-3b9691fa-621fdae6-cab53956_0] Write session: Do CDS request
2025-10-02T08:12:16.527812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f65efd-3b9691fa-621fdae6-cab53956_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:16.536338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f65efd-3b9691fa-621fdae6-cab53956_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.536398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:16.536423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1422
2025-10-02T08:12:16.536622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.536655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:16.536664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:16.536676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:16.537126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1422 sessionId:  describe result for acl check
2025-10-02T08:12:16.537159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:16.537165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:16.537167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:16.537172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534263338828344:4228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:16.537712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534263338828344:4228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:16.540643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534263338828344:4228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:16.543410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534263338828344:4228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:16.543425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534263338828344:4228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:16.543428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534263338828344:4228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:16.543435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:16.547346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:16.547736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:16.547910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:16.547922Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:16.547932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:16.547983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:16.548025Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534263338828678:4229]
2025-10-02T08:12:16.548720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:16.548952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:16.549001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:16.549327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:16.549383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.549390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.549391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.549392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.549393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.549398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.549409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.549413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.549418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.549422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.549427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.549435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.549440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.549445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.549453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.549459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.549464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.549469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.549484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.549495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.549513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:16.558117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:16.560467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:16.560490Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:16.560493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:16.560497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:16.560503Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1421 [1:7556534263338828678:4229]
2025-10-02T08:12:16.560515Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:16.560534Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:16.560537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.560541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.560543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.560564Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:16.560573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:16.560585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:16.560653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.560660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.560662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:16.560665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:16.560735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:16.560745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.560759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.560775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:16.560796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1421
2025-10-02T08:12:16.560819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338828624:4228], now have 1 active actors on pipe
2025-10-02T08:12:16.560831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534263338828672:4229]
2025-10-02T08:12:16.560838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534263338828672:4229]
2025-10-02T08:12:16.560850Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:16.560866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534263798698224:2378], now have 1 active actors on pipe
2025-10-02T08:12:16.560867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:16.560871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:16.560875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.560880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.560900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:16.560922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:16.560925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:16.560969Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:16.560982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.560990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.560992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:16.560949Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1421
2025-10-02T08:12:16.561001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.561015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:16.561029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534263338828672:4229]
2025-10-02T08:12:16.561042Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:16.561075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:16.561085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.561125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.561133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.561147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.561187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1422 partition: 0 MaxSeqNo: 17 sessionId: src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0
2025-10-02T08:12:16.561557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f65efd-3b9691fa-621fdae6-cab53956_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:16.564303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0] Write session: try to update token
2025-10-02T08:12:16.564324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:16.579323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId: src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:16.579394Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:16.579406Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:16.579409Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:16.579420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534263338828672:4229]
2025-10-02T08:12:16.579425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534263338828672:4229]
2025-10-02T08:12:16.579467Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:16.579468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:16.579475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.579477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:16.579478Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:16.579625Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:16.582002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:16.627537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534263338828704:4654]
2025-10-02T08:12:16.627627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1421, pipe: [1:7556534263338828704:4654]
2025-10-02T08:12:16.717341Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:16.717595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.717608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.717650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338828704:4654], now have 1 active actors on pipe
2025-10-02T08:12:16.717841Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:16.717841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534263338828704:4654]
2025-10-02T08:12:16.717864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:16.717933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1422 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0
2025-10-02T08:12:16.718258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:16.718268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0] Write session will restart in 0.008327s
2025-10-02T08:12:16.718227Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:16.718285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0] Write session: Do CDS request
2025-10-02T08:12:16.718294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:16.718128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1422 sessionId: src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0 is DEAD
2025-10-02T08:12:16.727287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.727362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:16.727383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1423
2025-10-02T08:12:16.727508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.727540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:16.727550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:16.727553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:16.727956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1423 sessionId:  describe result for acl check
2025-10-02T08:12:16.727990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:16.727992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:16.727993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:16.727998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534263338829134:4205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:16.728656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534263338829134:4205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:16.731137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534263338829134:4205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:16.733948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534263338829134:4205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:16.733964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534263338829134:4205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:16.733968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534263338829134:4205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:16.733975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:16.741994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:16.743016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:16.743209Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:16.743220Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:16.743232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:16.743286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:16.743331Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534263338829373:4223]
2025-10-02T08:12:16.743968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:16.744182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:16.744231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:16.744553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:16.744608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.744615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.744616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.744617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.744618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.744624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.744633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.744637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.744642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.744649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.744655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.744662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.744667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.744676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.744680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.744690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.744696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.744705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.744710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.744718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.744738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:16.752460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:16.754150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:16.754166Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:16.754168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:16.754170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:16.754174Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1422 [1:7556534263338829373:4223]
2025-10-02T08:12:16.754182Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:16.754193Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:16.754195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.754198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.754199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.754210Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:16.754213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:16.754218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:16.754257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.754264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.754266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:16.754268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:16.754314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:16.754320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.754328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.754335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:16.754349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338829239:4205], now have 1 active actors on pipe
2025-10-02T08:12:16.754354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534263338829367:4223]
2025-10-02T08:12:16.754356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534263338829367:4223]
2025-10-02T08:12:16.754362Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:16.754374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:16.754376Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:16.754380Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:16.754393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:16.754396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:16.754402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534263798698232:2378], now have 1 active actors on pipe
2025-10-02T08:12:16.754435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534263338829367:4223]
2025-10-02T08:12:16.754452Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:16.754489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1422
2025-10-02T08:12:16.754517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:16.754477Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1422
2025-10-02T08:12:16.754561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.754569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.754597Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:16.754611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.754614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.754616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:16.754624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.754638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:16.754655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.754695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.754700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.754711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.754741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1423 partition: 0 MaxSeqNo: 17 sessionId: src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0
2025-10-02T08:12:16.755102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d6953-a064589e-101ea88b-6a5c04b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:16.757996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0] Write session: try to update token
2025-10-02T08:12:16.758010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:16.771636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId: src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:16.771998Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:16.772014Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:16.772017Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:16.772025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534263338829367:4223]
2025-10-02T08:12:16.772030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534263338829367:4223]
2025-10-02T08:12:16.772083Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:16.772090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:16.772096Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:16.772097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.772099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:16.772268Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:16.774291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:16.818001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534263338829413:4654]
2025-10-02T08:12:16.818119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1422, pipe: [1:7556534263338829413:4654]
2025-10-02T08:12:16.909228Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:16.910009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.910021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.910055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338829413:4654], now have 1 active actors on pipe
2025-10-02T08:12:16.910242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:16.910266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:16.910323Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:16.910352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1423 reason: error at write: Disconnected sessionId: src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0
2025-10-02T08:12:16.910580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1423 sessionId: src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0 is DEAD
2025-10-02T08:12:16.910754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:16.910732Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:16.910776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0] Write session will restart in 0.007873s
2025-10-02T08:12:16.910814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0] Write session: Do CDS request
2025-10-02T08:12:16.910803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534263338829413:4654]
2025-10-02T08:12:16.910821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:16.920394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.920345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:16.920366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1424
2025-10-02T08:12:16.920684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:16.920724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:16.920731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:16.920735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:16.921227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1424 sessionId:  describe result for acl check
2025-10-02T08:12:16.921264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:16.921268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:16.921270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:16.921276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534263338829867:4165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:16.921735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534263338829867:4165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:16.924192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534263338829867:4165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:16.927345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:16.927578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534263338829867:4165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:16.927599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534263338829867:4165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:16.927604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534263338829867:4165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:16.927612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:16.928823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:16.929050Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:16.929061Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:16.929073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:16.929130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:16.929182Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534263338830071:4167]
2025-10-02T08:12:16.929887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:16.930131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:16.930182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:16.930541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:16.930604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.930611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.930612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.930613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.930614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.930620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.930632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.930637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.930641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.930646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.930653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.930665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:16.930673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.930678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:16.930682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.930688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:16.930693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.930698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.930704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.930715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.930736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:16.939816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:16.941859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:16.941876Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:16.941880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:16.941885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:16.941893Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1423 [1:7556534263338830071:4167]
2025-10-02T08:12:16.941910Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:16.941933Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:16.941941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.941946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.941948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.941967Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:16.941978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:16.941986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:16.942081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.942089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.942093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:16.942096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:16.942180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:16.942193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.942208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:16.942219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:16.942243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534263338830059:4167]
2025-10-02T08:12:16.942249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534263338830059:4167]
2025-10-02T08:12:16.942260Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:16.942270Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:16.942273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:16.942281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534263338830067:4165], now have 1 active actors on pipe
2025-10-02T08:12:16.942294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:16.942313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:16.942320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:16.942328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534263798698260:2378], now have 1 active actors on pipe
2025-10-02T08:12:16.942370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534263338830059:4167]
2025-10-02T08:12:16.942379Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:16.942368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1423
2025-10-02T08:12:16.942423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1423
2025-10-02T08:12:16.942434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:16.942539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.942550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.942582Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20957a91-6e184978-60607223-7696f27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:16.942595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:16.942603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:16.942606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:16.942619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:16.942636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:16.942654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.942702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:16.942709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:16.942722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:16.942770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1424 partition: 0 MaxSeqNo: 17 sessionId: src_id|20957a91-6e184978-60607223-7696f27_0
2025-10-02T08:12:16.943220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac5ca1-9ff02c42-524fd3ec-14e7b01f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|20957a91-6e184978-60607223-7696f27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:16.946065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20957a91-6e184978-60607223-7696f27_0] Write session: try to update token
2025-10-02T08:12:16.946087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20957a91-6e184978-60607223-7696f27_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:16.960875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:16.960895Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:16.960898Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:16.960907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534263338830059:4167]
2025-10-02T08:12:16.960912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534263338830059:4167]
2025-10-02T08:12:16.960956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:16.960958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:16.960961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:16.960966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:16.960969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:16.961122Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:16.961147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId: src_id|20957a91-6e184978-60607223-7696f27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:16.964381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:17.011077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534267633797391:4654]
2025-10-02T08:12:17.011258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1423, pipe: [1:7556534267633797391:4654]
2025-10-02T08:12:17.096237Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:17.096663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.096674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.096708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633797391:4654], now have 1 active actors on pipe
2025-10-02T08:12:17.096873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534267633797391:4654]
2025-10-02T08:12:17.096897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:17.096908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:17.096912Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:17.096960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1424 reason: error at write: Disconnected sessionId: src_id|20957a91-6e184978-60607223-7696f27_0
2025-10-02T08:12:17.096965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:17.097132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1424 sessionId: src_id|20957a91-6e184978-60607223-7696f27_0 is DEAD
2025-10-02T08:12:17.097281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20957a91-6e184978-60607223-7696f27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:17.097289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20957a91-6e184978-60607223-7696f27_0] Write session will restart in 0.008086s
2025-10-02T08:12:17.097314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20957a91-6e184978-60607223-7696f27_0] Write session: Do CDS request
2025-10-02T08:12:17.097320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20957a91-6e184978-60607223-7696f27_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:17.106330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20957a91-6e184978-60607223-7696f27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.106417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:17.106435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1425
2025-10-02T08:12:17.106578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.106615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:17.106624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:17.106628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:17.107053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1425 sessionId:  describe result for acl check
2025-10-02T08:12:17.107096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:17.107103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:17.107105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:17.107110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534267633797789:4155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:17.107628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534267633797789:4155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:17.110456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534267633797789:4155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:17.113157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534267633797789:4155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:17.113171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534267633797789:4155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:17.113175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534267633797789:4155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:17.113182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:17.115203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:17.115576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:17.115862Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:17.115874Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:17.115884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:17.115935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:17.115970Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534267633798045:4148]
2025-10-02T08:12:17.116678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:17.116859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:17.116899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:17.117213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:17.117256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.117262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.117263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.117264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.117265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.117270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.117281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.117285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.117290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.117294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.117299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.117307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.117313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.117319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.117324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.117329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.117336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.117342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.117352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.117357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.117376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:17.126014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:17.127536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:17.127551Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:17.127554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:17.127557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:17.127564Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1424 [1:7556534267633798045:4148]
2025-10-02T08:12:17.127577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:17.127595Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:17.127598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.127602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.127604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.127619Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:17.127625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:17.127632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:17.127696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.127705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.127708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:17.127710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:17.127774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:17.127781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.127794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.127808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:17.127829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534267633798039:4148]
2025-10-02T08:12:17.127841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534267633798039:4148]
2025-10-02T08:12:17.127854Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:17.127866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:17.127870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:17.127873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1424
2025-10-02T08:12:17.127874Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:17.127884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:17.127887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:17.127897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633798027:4155], now have 1 active actors on pipe
2025-10-02T08:12:17.127901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534268093665578:2378], now have 1 active actors on pipe
2025-10-02T08:12:17.127933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.127941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.127955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534267633798039:4148]
2025-10-02T08:12:17.127963Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:17.127934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1424
2025-10-02T08:12:17.127972Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:17.127986Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:17.127992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.128000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.128002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:17.128013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.128025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:17.128055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.128144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.128152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.128166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.128218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1425 partition: 0 MaxSeqNo: 17 sessionId: src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0
2025-10-02T08:12:17.128525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20957a91-6e184978-60607223-7696f27_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:17.131157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0] Write session: try to update token
2025-10-02T08:12:17.131170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:17.145164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId: src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:17.145915Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:17.145933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:17.145936Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:17.145945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534267633798039:4148]
2025-10-02T08:12:17.145950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534267633798039:4148]
2025-10-02T08:12:17.145989Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:17.145994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:17.146000Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:17.146000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.146003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:17.146150Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:17.147802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:17.196860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534267633798071:4654]
2025-10-02T08:12:17.196960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1424, pipe: [1:7556534267633798071:4654]
2025-10-02T08:12:17.287519Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:17.287996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.288006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.288041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633798071:4654], now have 1 active actors on pipe
2025-10-02T08:12:17.288164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:17.288174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:17.288217Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:17.288222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1425 reason: error at write: Disconnected sessionId: src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0
2025-10-02T08:12:17.288229Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:17.288364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1425 sessionId: src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0 is DEAD
2025-10-02T08:12:17.288422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534267633798071:4654]
2025-10-02T08:12:17.288540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:17.288548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0] Write session will restart in 0.009461s
2025-10-02T08:12:17.288575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0] Write session: Do CDS request
2025-10-02T08:12:17.288581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:17.299198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.299290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:17.299303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1426
2025-10-02T08:12:17.299396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.299416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:17.299424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:17.299427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:17.299701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1426 sessionId:  describe result for acl check
2025-10-02T08:12:17.299721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:17.299722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:17.299723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:17.299726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534267633798690:4128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:17.300091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534267633798690:4128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:17.300224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:17.301045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:17.301173Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:17.301182Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:17.301190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:17.301238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:17.301271Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534267633798719:4132]
2025-10-02T08:12:17.301683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:17.301814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:17.301842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:17.301907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534267633798690:4128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:17.302048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:17.302079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.302083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.302084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.302084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.302085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.302088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.302094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.302096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.302099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.302101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.302104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.302109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.302112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.302115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.302117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.302120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.302122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.302125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.302127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.302130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.302140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:17.306872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534267633798690:4128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:17.306885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534267633798690:4128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:17.306889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534267633798690:4128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:17.306897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:17.310084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:17.311503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:17.311515Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:17.311517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:17.311520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:17.311525Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1425 [1:7556534267633798719:4132]
2025-10-02T08:12:17.311533Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:17.311546Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:17.311547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.311550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.311551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.311563Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:17.311566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:17.311571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:17.311617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.311625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.311628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:17.311631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:17.311729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1425
2025-10-02T08:12:17.311793Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1425
2025-10-02T08:12:17.311932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:17.311941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.311952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.311965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:17.311987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633798750:4128], now have 1 active actors on pipe
2025-10-02T08:12:17.311994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534268093665586:2378], now have 1 active actors on pipe
2025-10-02T08:12:17.311997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.312000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.312022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534267633798700:4132]
2025-10-02T08:12:17.312028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534267633798700:4132]
2025-10-02T08:12:17.312038Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:17.312052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:17.312062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:17.312074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:17.312076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:17.312081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:17.312087Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:17.312091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.312094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.312095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:17.312102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.312114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:17.312149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534267633798700:4132]
2025-10-02T08:12:17.312159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:17.312172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:17.312172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.312262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.312268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.312281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.312319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1426 partition: 0 MaxSeqNo: 17 sessionId: src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0
2025-10-02T08:12:17.312601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58509545-5a9936e1-d1fe2c99-6318cf37_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:17.315089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0] Write session: try to update token
2025-10-02T08:12:17.315101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:17.324205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:17.324224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:17.324232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534267633798700:4132]
2025-10-02T08:12:17.324269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:17.324277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:17.324431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:17.324560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:17.324681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:17.324833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:17.325018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:17.325048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:17.327869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId: src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:17.330207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:17.330260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.330270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.330301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:17.330319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:17.330366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.330378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.330526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.330602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.330668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.330728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.331015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.331026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.331092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.331158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.331223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.331284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.331330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.331336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.331407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.331474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.331532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.331589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.331641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.331650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.331718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.331780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.331843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.331915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.331966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.331971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.332040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.332115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.332187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.332253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.332300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.332306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.332379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.332446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.332511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.332575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.332621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.332626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.332708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.332771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.332857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.332939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.332989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.332996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.333067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.333128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.333200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.333265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.333363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.333369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.333444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.333501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.333556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.333610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.333742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.333748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.333815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:17.333875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:17.333941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:17.334006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:17.334050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:17.334056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:17.334087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:17.334140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.334156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.334161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:17.334194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:17.334212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:17.334218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:17.334220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:17.334221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:17.334596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:17.334618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:17.334626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:17.334628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:17.334631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:17.334633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:17.335195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:17.335220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:17.335229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:17.335234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:17.335237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:17.335239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:17.335701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:17.335722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:17.335735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:17.335741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:17.335742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:17.337909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:17.337925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:17.337934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392737337
2025-10-02T08:12:17.338050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:17.338061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:17.338065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:17.338068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:17.338070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:17.338074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:17.338511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:17.338532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:17.338542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:17.338550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:17.338553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:17.338558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:17.338990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:17.339009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:17.339021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:17.339027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:17.339029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:17.339034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:17.339488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:17.339504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:17.339510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:17.340541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:17.340557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:17.340561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:17.340563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:17.340568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392737340
2025-10-02T08:12:17.340869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:17.340884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:17.340888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:17.340894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:17.340896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:17.340898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:17.341302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:17.341321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:17.341325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:17.341327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:17.341331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:17.341333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:17.341751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:17.341775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.341870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392737341
2025-10-02T08:12:17.345161Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:17.345177Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:17.345183Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:17.345189Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:17.346744Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:17.346756Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:17.346757Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:17.346764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534267633798700:4132]
2025-10-02T08:12:17.346768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534267633798700:4132]
2025-10-02T08:12:17.346815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:17.346817Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:17.346822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.346822Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:17.346823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:17.346955Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:17.388347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534267633798772:4654]
2025-10-02T08:12:17.388433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1425, pipe: [1:7556534267633798772:4654]
2025-10-02T08:12:17.475957Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:17.476270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633798772:4654], now have 1 active actors on pipe
2025-10-02T08:12:17.476398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534267633798772:4654]
2025-10-02T08:12:17.476414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:17.476419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:17.476437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1426 reason: error at write: Disconnected sessionId: src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0
2025-10-02T08:12:17.476483Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:17.476553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:17.476581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1426 sessionId: src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0 is DEAD
2025-10-02T08:12:17.476689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:17.476694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0] Write session will restart in 0.009146s
2025-10-02T08:12:17.476725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0] Write session: Do CDS request
2025-10-02T08:12:17.476731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:17.488227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.488305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:17.488329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1427
2025-10-02T08:12:17.488453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.488490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:17.488499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:17.488502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:17.488873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1427 sessionId:  describe result for acl check
2025-10-02T08:12:17.488909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:17.488914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:17.488916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:17.488920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534267633799205:4114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:17.489309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534267633799205:4114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:17.491392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534267633799205:4114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:17.493801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:17.493995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534267633799205:4114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:17.494005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534267633799205:4114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:17.494007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534267633799205:4114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:17.494013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:17.494684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:17.494826Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:17.494835Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:17.494843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:17.494878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:17.494912Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534267633799428:4112]
2025-10-02T08:12:17.495496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:17.495631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:17.495664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:17.495944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:17.495979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.495984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.495985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.495986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.495987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.495992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.496002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.496009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.496013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.496016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.496020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.496027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.496037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.496045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.496049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.496058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.496077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.496081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.496085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.496093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.496109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:17.503596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:17.505194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:17.505209Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:17.505212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:17.505215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:17.505221Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1426 [1:7556534267633799428:4112]
2025-10-02T08:12:17.505232Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:17.505247Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:17.505254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.505256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.505258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.505272Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:17.505281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:17.505287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:17.505338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.505344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.505346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:17.505349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:17.505404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:17.505410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.505421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.505431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:17.505446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1426
2025-10-02T08:12:17.505452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633799424:4114], now have 1 active actors on pipe
2025-10-02T08:12:17.505455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534268093665592:2378], now have 1 active actors on pipe
2025-10-02T08:12:17.505461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534267633799416:4112]
2025-10-02T08:12:17.505463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534267633799416:4112]
2025-10-02T08:12:17.505474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:17.505483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.505491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.505501Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:17.505507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:17.505508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:17.505519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:17.505522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:17.505555Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:17.505564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.505568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.505570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:17.505541Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1426
2025-10-02T08:12:17.505577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.505588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:17.505599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534267633799416:4112]
2025-10-02T08:12:17.505603Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:17.505605Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:17.505628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.505672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.505679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.505691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.505728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1427 partition: 0 MaxSeqNo: 17 sessionId: src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0
2025-10-02T08:12:17.506044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e4718e-b82fc94-d3b3c1e5-f880fc9e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:17.508355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0] Write session: try to update token
2025-10-02T08:12:17.508366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:17.522301Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:17.522334Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:17.522338Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:17.522355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534267633799416:4112]
2025-10-02T08:12:17.522364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534267633799416:4112]
2025-10-02T08:12:17.522414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:17.522418Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:17.522423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:17.522443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.522452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:17.522645Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:17.530263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId: src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:17.532630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:17.576897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534267633799459:4654]
2025-10-02T08:12:17.577037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1426, pipe: [1:7556534267633799459:4654]
2025-10-02T08:12:17.653881Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:17.654732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.654748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.654767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633799459:4654], now have 1 active actors on pipe
2025-10-02T08:12:17.654898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:17.654908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:17.654961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1427 reason: error at write: Disconnected sessionId: src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0
2025-10-02T08:12:17.655022Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:17.655035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:17.655118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1427 sessionId: src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0 is DEAD
2025-10-02T08:12:17.655275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:17.655284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0] Write session will restart in 0.009425s
2025-10-02T08:12:17.655307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0] Write session: Do CDS request
2025-10-02T08:12:17.655314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:17.655479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534267633799459:4654]
2025-10-02T08:12:17.666377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.666439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:17.666455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1428
2025-10-02T08:12:17.666600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.666657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:17.666667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:17.666671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:17.667128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1428 sessionId:  describe result for acl check
2025-10-02T08:12:17.667162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:17.667168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:17.667169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:17.667175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534267633799959:4088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:17.667635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534267633799959:4088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:17.670602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534267633799959:4088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:17.671609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:17.672960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:17.673242Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:17.673253Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:17.673263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:17.673308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:17.673343Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534267633800113:4090]
2025-10-02T08:12:17.673387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534267633799959:4088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:17.673400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534267633799959:4088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:17.673403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534267633799959:4088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:17.673412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:17.673998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:17.674190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:17.674232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:17.674537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:17.674578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.674584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.674585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.674586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.674587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.674592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.674602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.674606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.674610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.674614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.674619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.674627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.674632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.674638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.674643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.674653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.674658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.674664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.674674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.674679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.674701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:17.686846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:17.689265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:17.689282Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:17.689285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:17.689289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:17.689295Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1427 [1:7556534267633800113:4090]
2025-10-02T08:12:17.689307Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:17.689325Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:17.689327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.689330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.689332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.689347Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:17.689353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:17.689359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:17.689431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.689440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.689443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:17.689445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:17.689511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:17.689518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.689533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.689547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:17.689567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534267633800107:4090]
2025-10-02T08:12:17.689574Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534267633800107:4090]
2025-10-02T08:12:17.689581Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:17.689594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633800118:4088], now have 1 active actors on pipe
2025-10-02T08:12:17.689595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1427
2025-10-02T08:12:17.689602Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:17.689606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:17.689606Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:17.689620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:17.689628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:17.689635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534268093665601:2378], now have 1 active actors on pipe
2025-10-02T08:12:17.689665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.689674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.689686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534267633800107:4090]
2025-10-02T08:12:17.689694Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:17.689710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:17.689723Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10127b54-69440947-f3015f3d-2c2881c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:17.689734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.689739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.689745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:17.689718Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1427
2025-10-02T08:12:17.689755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.689767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:17.689798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.689864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.689871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.689884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.689921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1428 partition: 0 MaxSeqNo: 17 sessionId: src_id|10127b54-69440947-f3015f3d-2c2881c4_0
2025-10-02T08:12:17.690246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e028d8e6-4779ec0e-a2aadfc4-3b8197da_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10127b54-69440947-f3015f3d-2c2881c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:17.692696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10127b54-69440947-f3015f3d-2c2881c4_0] Write session: try to update token
2025-10-02T08:12:17.692708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10127b54-69440947-f3015f3d-2c2881c4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:17.706747Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:17.706769Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:17.706772Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:17.706781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534267633800107:4090]
2025-10-02T08:12:17.706786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534267633800107:4090]
2025-10-02T08:12:17.706828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:17.706834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.706836Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:17.706837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:17.706841Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:17.706979Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:17.711183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId: src_id|10127b54-69440947-f3015f3d-2c2881c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:17.714016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:17.755456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534267633800148:4654]
2025-10-02T08:12:17.755573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1427, pipe: [1:7556534267633800148:4654]
2025-10-02T08:12:17.855477Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:17.855935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.855953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.855996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633800148:4654], now have 1 active actors on pipe
2025-10-02T08:12:17.856116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:17.856121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:17.856172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1428 reason: error at write: Disconnected sessionId: src_id|10127b54-69440947-f3015f3d-2c2881c4_0
2025-10-02T08:12:17.856262Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:17.856253Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:17.856338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1428 sessionId: src_id|10127b54-69440947-f3015f3d-2c2881c4_0 is DEAD
2025-10-02T08:12:17.856501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10127b54-69440947-f3015f3d-2c2881c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:17.856512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10127b54-69440947-f3015f3d-2c2881c4_0] Write session will restart in 0.006166s
2025-10-02T08:12:17.856496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534267633800148:4654]
2025-10-02T08:12:17.856534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10127b54-69440947-f3015f3d-2c2881c4_0] Write session: Do CDS request
2025-10-02T08:12:17.856542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10127b54-69440947-f3015f3d-2c2881c4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:17.864290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10127b54-69440947-f3015f3d-2c2881c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.864403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:17.864419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1429
2025-10-02T08:12:17.864567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:17.864595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:17.864599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:17.864603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:17.865049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1429 sessionId:  describe result for acl check
2025-10-02T08:12:17.865087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:17.865093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:17.865095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:17.865100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534267633800566:4053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:17.865600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534267633800566:4053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:17.867675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534267633800566:4053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:17.870636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534267633800566:4053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:17.870648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534267633800566:4053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:17.870651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534267633800566:4053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:17.870658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:17.871501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:17.872432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:17.872670Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:17.872687Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:17.872695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:17.872745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:17.872778Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534267633800837:4046]
2025-10-02T08:12:17.873257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:17.873414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:17.873453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:17.873714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:17.873768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.873774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.873775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.873776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.873777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.873781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.873790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.873794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.873798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.873802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.873807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.873814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:17.873819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.873824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:17.873828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.873838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:17.873852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.873861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.873865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.873870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.873886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:17.881442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:17.884405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:17.884421Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:17.884423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:17.884427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:17.884432Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1428 [1:7556534267633800837:4046]
2025-10-02T08:12:17.884441Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:17.884454Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:17.884455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.884457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.884459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.884470Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:17.884474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:17.884479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:17.884522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.884527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.884529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:17.884531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:17.884575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:17.884580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.884588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:17.884594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:17.884605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534267633800831:4046]
2025-10-02T08:12:17.884607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534267633800831:4046]
2025-10-02T08:12:17.884612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:17.884619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:17.884628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:17.884632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:17.884634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:17.884637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:17.884638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633800818:4053], now have 1 active actors on pipe
2025-10-02T08:12:17.884642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1428
2025-10-02T08:12:17.884659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534267633800831:4046]
2025-10-02T08:12:17.884663Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:17.884665Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:17.884665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534268093665607:2378], now have 1 active actors on pipe
2025-10-02T08:12:17.884669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.884671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.884704Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:17.884714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:17.884718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:17.884720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:17.884728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:17.884735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:17.884715Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1428
2025-10-02T08:12:17.884747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.884815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:17.884821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:17.884839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:17.884872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1429 partition: 0 MaxSeqNo: 17 sessionId: src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0
2025-10-02T08:12:17.885201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10127b54-69440947-f3015f3d-2c2881c4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:17.887968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0] Write session: try to update token
2025-10-02T08:12:17.887985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:17.901461Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:17.901476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:17.901477Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:17.901484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534267633800831:4046]
2025-10-02T08:12:17.901487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534267633800831:4046]
2025-10-02T08:12:17.901518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:17.901520Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:17.901522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:17.901524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:17.901524Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:17.902280Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:17.909676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId: src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:17.912119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:17.956670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534267633800870:4654]
2025-10-02T08:12:17.956781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1428, pipe: [1:7556534267633800870:4654]
2025-10-02T08:12:18.030530Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:18.030878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.030888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.030904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534267633800870:4654], now have 1 active actors on pipe
2025-10-02T08:12:18.031096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534267633800870:4654]
2025-10-02T08:12:18.031088Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:18.031120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:18.031122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:18.031176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1429 reason: error at write: Disconnected sessionId: src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0
2025-10-02T08:12:18.031197Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:18.031352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1429 sessionId: src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0 is DEAD
2025-10-02T08:12:18.031516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:18.031526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0] Write session will restart in 0.007197s
2025-10-02T08:12:18.031548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0] Write session: Do CDS request
2025-10-02T08:12:18.031554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:18.040264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.040263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:18.040274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1430
2025-10-02T08:12:18.040434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.040455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:18.040462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:18.040464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:18.040722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1430 sessionId:  describe result for acl check
2025-10-02T08:12:18.040749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:18.040753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:18.040754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:18.040757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534271928768691:4049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:18.041139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534271928768691:4049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:18.043354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534271928768691:4049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:18.043862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:18.044584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:18.044717Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:18.044726Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:18.044732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:18.044761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:18.044790Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534271928768822:4048]
2025-10-02T08:12:18.045176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:18.045263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:18.045265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534271928768691:4049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:18.045269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534271928768691:4049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:18.045271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534271928768691:4049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:18.045276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:18.045287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:18.045461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:18.045486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.045490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.045491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.045491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.045492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.045495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.045501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.045503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.045505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.045507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.045510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.045514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.045517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.045520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.045522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.045525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.045527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.045530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.045532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.045534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.045544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:18.056206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:18.057984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:18.057995Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:18.057997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:18.057999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:18.058004Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1429 [1:7556534271928768822:4048]
2025-10-02T08:12:18.058013Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:18.058024Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:18.058026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.058027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.058029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.058041Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:18.058044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:18.058049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:18.058091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.058097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.058099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:18.058100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:18.058150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:18.058154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.058162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.058172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:18.058187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534271928768816:4048]
2025-10-02T08:12:18.058192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534271928768816:4048]
2025-10-02T08:12:18.058197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:18.058206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:18.058216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:18.058219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:18.058221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:18.058222Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:18.058224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1429
2025-10-02T08:12:18.058228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928768833:4049], now have 1 active actors on pipe
2025-10-02T08:12:18.058253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534272388632932:2378], now have 1 active actors on pipe
2025-10-02T08:12:18.058257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534271928768816:4048]
2025-10-02T08:12:18.058262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:18.058269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.058271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:18.058274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.058299Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:18.058309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.058311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.058312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:18.058319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.058324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:18.058337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.058314Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1429
2025-10-02T08:12:18.058367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.058373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.058384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.058426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1430 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0
2025-10-02T08:12:18.058683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1429a43b-6c1eb2dd-32e94323-1dc84d63_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:18.060920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0] Write session: try to update token
2025-10-02T08:12:18.060931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:18.074126Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:18.074143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:18.074145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:18.074151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534271928768816:4048]
2025-10-02T08:12:18.074155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534271928768816:4048]
2025-10-02T08:12:18.074188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:18.074192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.074194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:18.074196Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:18.074201Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:18.074314Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:18.078684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId: src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:18.081122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:18.129728Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:12:18.129753Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-02T08:12:18.131267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534271928768855:4654]
2025-10-02T08:12:18.131366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1429, pipe: [1:7556534271928768855:4654]
2025-10-02T08:12:18.200015Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:18.200315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.200331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.200394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928768855:4654], now have 1 active actors on pipe
2025-10-02T08:12:18.200502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:18.200508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:18.200553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1430 reason: error at write: Disconnected sessionId: src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0
2025-10-02T08:12:18.200625Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:18.200651Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-02T08:12:18.200655Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:18.200710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1430 sessionId: src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0 is DEAD
2025-10-02T08:12:18.200869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:18.200877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0] Write session will restart in 0.009661s
2025-10-02T08:12:18.200896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0] Write session: Do CDS request
2025-10-02T08:12:18.200888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534271928768855:4654]
2025-10-02T08:12:18.200903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:18.211258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.211291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:18.211305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1431
2025-10-02T08:12:18.211450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.211478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:18.211486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:18.211489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:18.211834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1431 sessionId:  describe result for acl check
2025-10-02T08:12:18.211863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:18.211867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:18.211868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:18.211871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534271928769417:4028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:18.212278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534271928769417:4028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:18.213940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534271928769417:4028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:18.215527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:18.215827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:18.215973Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:18.215981Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:18.215991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:18.216027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:18.216055Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534271928769528:4035]
2025-10-02T08:12:18.216317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534271928769417:4028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:18.216326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534271928769417:4028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:18.216329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534271928769417:4028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:18.216334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:18.216464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:18.216579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:18.216606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:18.216862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:18.216902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.216906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.216906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.216907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.216907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.216910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.216916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.216918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.216920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.216922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.216925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.216929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.216932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.216938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.216940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.216943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.216948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.216951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.216953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.216956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.216968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:18.224781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:18.226337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:18.226350Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:18.226351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:18.226353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:18.226357Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1430 [1:7556534271928769528:4035]
2025-10-02T08:12:18.226365Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:18.226376Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:18.226378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.226380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.226381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.226392Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:18.226395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:18.226399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:18.226443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.226449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.226451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:18.226453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:18.226499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:18.226504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.226511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.226518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:18.226529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534271928769522:4035]
2025-10-02T08:12:18.226534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534271928769522:4035]
2025-10-02T08:12:18.226540Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:18.226549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:18.226559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:18.226560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:18.226562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:18.226567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:18.226569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928769533:4028], now have 1 active actors on pipe
2025-10-02T08:12:18.226571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534272388632953:2378], now have 1 active actors on pipe
2025-10-02T08:12:18.226581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1430
2025-10-02T08:12:18.226593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534271928769522:4035]
2025-10-02T08:12:18.226601Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:18.226606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.226608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:18.226608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.226634Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:18.226642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.226645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.226646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:18.226652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.226662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:18.226633Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1430
2025-10-02T08:12:18.226699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.226750Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:12:18.226771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.226778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.226789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.226823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1431 partition: 0 MaxSeqNo: 17 sessionId: src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0
2025-10-02T08:12:18.226959Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 12 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:12:18.227013Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:12:18.227143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e24c6f1-763eb352-98fb242e-4cf56693_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:18.229449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0] Write session: try to update token
2025-10-02T08:12:18.229459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:18.242988Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:18.243008Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:18.243009Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:18.243016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534271928769522:4035]
2025-10-02T08:12:18.243019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534271928769522:4035]
2025-10-02T08:12:18.243049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:18.243059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.243060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:18.243066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:18.243070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:18.243203Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:18.244131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId: src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:18.246667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:18.301244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534271928769562:4654]
2025-10-02T08:12:18.301354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1430, pipe: [1:7556534271928769562:4654]
2025-10-02T08:12:18.365549Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:18.365900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.365912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.365946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928769562:4654], now have 1 active actors on pipe
2025-10-02T08:12:18.366047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534271928769562:4654]
2025-10-02T08:12:18.366074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:18.366076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:18.366152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1431 reason: error at write: Disconnected sessionId: src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0
2025-10-02T08:12:18.366184Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:18.366223Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T08:12:18.366329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1431 sessionId: src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0 is DEAD
2025-10-02T08:12:18.366470Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:18.366485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:18.366498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0] Write session will restart in 0.005276s
2025-10-02T08:12:18.366522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0] Write session: Do CDS request
2025-10-02T08:12:18.366537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:18.373181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.373242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:18.373254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1432
2025-10-02T08:12:18.373362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.373383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:18.373389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:18.373391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:18.373770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1432 sessionId:  describe result for acl check
2025-10-02T08:12:18.373799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:18.373804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:18.373806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:18.373810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534271928769982:4010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:18.374180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534271928769982:4010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:18.376704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534271928769982:4010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:18.379166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534271928769982:4010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:18.379179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534271928769982:4010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:18.379182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534271928769982:4010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:18.379189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:18.379358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:18.380415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:18.380557Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:18.380565Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:18.380572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:18.380610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:18.380646Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534271928770230:4014]
2025-10-02T08:12:18.381089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:18.381264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:18.381285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:18.381466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:18.381487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.381488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.381489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.381490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.381490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.381493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.381501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.381505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.381509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.381512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.381517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.381524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.381535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.381538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.381541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.381543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.381545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.381548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.381550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.381554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.381564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:18.389221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:18.391006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:18.391023Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:18.391026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:18.391030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:18.391036Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1431 [1:7556534271928770230:4014]
2025-10-02T08:12:18.391047Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:18.391065Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:18.391068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.391070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.391071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.391083Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:18.391091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:18.391098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:18.391158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.391160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.391163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:18.391165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:18.391231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:18.391239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.391252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.391265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:18.391288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928770221:4010], now have 1 active actors on pipe
2025-10-02T08:12:18.391297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1431
2025-10-02T08:12:18.391300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534272388632962:2378], now have 1 active actors on pipe
2025-10-02T08:12:18.391306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534271928770223:4014]
2025-10-02T08:12:18.391308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534271928770223:4014]
2025-10-02T08:12:18.391327Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:18.391340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:18.391341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:18.391343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:18.391354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:18.391357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:18.391363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.391367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.391403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534271928770223:4014]
2025-10-02T08:12:18.391410Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:18.391400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1431
2025-10-02T08:12:18.391424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:18.391426Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:18.391432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.391435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.391437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:18.391446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.391454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:18.391499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.391541Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:12:18.391560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.391565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.391574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.391611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1432 partition: 0 MaxSeqNo: 17 sessionId: src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0
2025-10-02T08:12:18.391727Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 13 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:12:18.391763Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:12:18.391912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73caabf6-35cbd3be-491a12dd-4df3d54d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:18.394668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0] Write session: try to update token
2025-10-02T08:12:18.394685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:18.408061Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:18.408090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:18.408091Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:18.408098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534271928770223:4014]
2025-10-02T08:12:18.408101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534271928770223:4014]
2025-10-02T08:12:18.408134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:18.408139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.408141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:18.408143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:18.408148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:18.408261Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:18.408885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId: src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:18.411205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:18.466130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534271928770258:4654]
2025-10-02T08:12:18.466272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1431, pipe: [1:7556534271928770258:4654]
2025-10-02T08:12:18.537150Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:18.537537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.537548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.537579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928770258:4654], now have 1 active actors on pipe
2025-10-02T08:12:18.537690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534271928770258:4654]
2025-10-02T08:12:18.537725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:18.537727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:18.537793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1432 reason: error at write: Disconnected sessionId: src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0
2025-10-02T08:12:18.537777Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:18.537959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1432 sessionId: src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0 is DEAD
2025-10-02T08:12:18.538075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:18.538085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0] Write session will restart in 0.006742s
2025-10-02T08:12:18.538102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0] Write session: Do CDS request
2025-10-02T08:12:18.538106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:18.538421Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:18.546202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.546277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:18.546292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1433
2025-10-02T08:12:18.546382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.546404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:18.546410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:18.546412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:18.546707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1433 sessionId:  describe result for acl check
2025-10-02T08:12:18.546728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:18.546732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:18.546733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:18.546736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534271928770696:4001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:18.547209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534271928770696:4001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:18.549919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534271928770696:4001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:18.552437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:18.552650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534271928770696:4001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:18.552662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534271928770696:4001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:18.552666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534271928770696:4001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:18.552666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:18.552672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:18.552815Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:18.552825Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:18.552835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:18.552883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:18.552916Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534271928770930:4003]
2025-10-02T08:12:18.553348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:18.553486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:18.553512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:18.553703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:18.553733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.553736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.553737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.553738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.553738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.553741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.553747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.553749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.553751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.553752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.553756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.553760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.553763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.553767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.553769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.553772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.553774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.553777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.553779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.553781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.553792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:18.561088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:18.562534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:18.562549Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:18.562550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:18.562553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:18.562557Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1432 [1:7556534271928770930:4003]
2025-10-02T08:12:18.562564Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:18.562577Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:18.562582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.562585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.562586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.562597Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:18.562603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:18.562607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:18.562648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.562653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.562656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:18.562658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:18.562702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:18.562707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.562715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.562721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:18.562733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928770928:4001], now have 1 active actors on pipe
2025-10-02T08:12:18.562737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534271928770920:4003]
2025-10-02T08:12:18.562739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1432
2025-10-02T08:12:18.562743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534271928770920:4003]
2025-10-02T08:12:18.562748Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:18.562754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534272388632970:2378], now have 1 active actors on pipe
2025-10-02T08:12:18.562757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:18.562759Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:18.562761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:18.562772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:18.562781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:18.562787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.562794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.562820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534271928770920:4003]
2025-10-02T08:12:18.562826Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:18.562833Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:18.562837Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:18.562841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.562844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.562845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:18.562852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.562858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:18.562843Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1432
2025-10-02T08:12:18.562879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.562927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.562933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.562944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.562970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1433 partition: 0 MaxSeqNo: 17 sessionId: src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0
2025-10-02T08:12:18.563234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37de588-a1b2a25d-acf5541b-b05e4462_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:18.565856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0] Write session: try to update token
2025-10-02T08:12:18.565873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:18.579832Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:18.579850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:18.579852Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:18.579859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534271928770920:4003]
2025-10-02T08:12:18.579866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534271928770920:4003]
2025-10-02T08:12:18.579900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId: src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:18.579906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:18.579910Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:18.579913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.579915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:18.579916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:18.580105Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:18.582183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:18.637645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534271928770958:4654]
2025-10-02T08:12:18.637777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1432, pipe: [1:7556534271928770958:4654]
2025-10-02T08:12:18.704776Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:18.705156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.705167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.705199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928770958:4654], now have 1 active actors on pipe
2025-10-02T08:12:18.705370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534271928770958:4654]
2025-10-02T08:12:18.705398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:18.705402Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:18.705404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:18.705421Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:18.705472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1433 reason: error at write: Disconnected sessionId: src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0
2025-10-02T08:12:18.705637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1433 sessionId: src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0 is DEAD
2025-10-02T08:12:18.705793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:18.705802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0] Write session will restart in 0.006943s
2025-10-02T08:12:18.705828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0] Write session: Do CDS request
2025-10-02T08:12:18.705834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:18.714253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.714358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:18.714374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1434
2025-10-02T08:12:18.714476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.714507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:18.714516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:18.714524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:18.714865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1434 sessionId:  describe result for acl check
2025-10-02T08:12:18.714892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:18.714897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:18.714899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:18.714903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534271928771392:3981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:18.715422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534271928771392:3981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:18.717650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534271928771392:3981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:18.720180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534271928771392:3981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:18.720193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534271928771392:3981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:18.720196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534271928771392:3981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:18.720203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:18.721829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:18.722111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:18.722304Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:18.722312Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:18.722319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:18.722350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:18.722384Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534271928771633:3985]
2025-10-02T08:12:18.722772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:18.722923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:18.722947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:18.723134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:18.723160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.723163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.723164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.723165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.723166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.723169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.723175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.723177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.723179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.723181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.723184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.723189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.723192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.723196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.723202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.723204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.723206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.723209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.723211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.723218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.723229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:18.730837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:18.732438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:18.732452Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:18.732455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:18.732457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:18.732463Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1433 [1:7556534271928771633:3985]
2025-10-02T08:12:18.732471Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:18.732484Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:18.732486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.732488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.732489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.732501Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:18.732505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:18.732510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:18.732558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.732567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.732570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:18.732572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:18.732627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:18.732634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.732644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.732651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:18.732667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534271928771627:3985]
2025-10-02T08:12:18.732672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534271928771627:3985]
2025-10-02T08:12:18.732677Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:18.732689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:18.732690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:18.732697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:18.732699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:18.732699Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:18.732728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928771614:3981], now have 1 active actors on pipe
2025-10-02T08:12:18.732734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534271928771627:3985]
2025-10-02T08:12:18.732734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1433
2025-10-02T08:12:18.732736Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:18.732739Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:18.732739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534272388632979:2378], now have 1 active actors on pipe
2025-10-02T08:12:18.732750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.732752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.732782Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3150cd4-84b85437-328bad4e-d8822bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:18.732792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.732796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.732823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:18.732830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.732838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:18.732854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.732830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1433
2025-10-02T08:12:18.732895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.732904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.732917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.732948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1434 partition: 0 MaxSeqNo: 17 sessionId: src_id|3150cd4-84b85437-328bad4e-d8822bd_0
2025-10-02T08:12:18.733219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17ce3f1a-5182f804-b32de9ef-97ec64c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3150cd4-84b85437-328bad4e-d8822bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:18.735756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3150cd4-84b85437-328bad4e-d8822bd_0] Write session: try to update token
2025-10-02T08:12:18.735769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3150cd4-84b85437-328bad4e-d8822bd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:18.750845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId: src_id|3150cd4-84b85437-328bad4e-d8822bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:18.751004Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:18.751017Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:18.751019Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:18.751025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534271928771627:3985]
2025-10-02T08:12:18.751028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534271928771627:3985]
2025-10-02T08:12:18.751073Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:18.751076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:18.751081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.751083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:18.751086Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:18.751256Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:18.753285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:18.827322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534271928771672:4654]
2025-10-02T08:12:18.827503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1433, pipe: [1:7556534271928771672:4654]
2025-10-02T08:12:18.876956Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:18.877246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.877256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.877288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928771672:4654], now have 1 active actors on pipe
2025-10-02T08:12:18.877438Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:18.877476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:18.877582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:18.877590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:18.877661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1434 reason: error at write: Disconnected sessionId: src_id|3150cd4-84b85437-328bad4e-d8822bd_0
2025-10-02T08:12:18.877693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534271928771672:4654]
2025-10-02T08:12:18.877792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1434 sessionId: src_id|3150cd4-84b85437-328bad4e-d8822bd_0 is DEAD
2025-10-02T08:12:18.877890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3150cd4-84b85437-328bad4e-d8822bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:18.877895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3150cd4-84b85437-328bad4e-d8822bd_0] Write session will restart in 0.009902s
2025-10-02T08:12:18.877913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3150cd4-84b85437-328bad4e-d8822bd_0] Write session: Do CDS request
2025-10-02T08:12:18.877917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3150cd4-84b85437-328bad4e-d8822bd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:18.889196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3150cd4-84b85437-328bad4e-d8822bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.889274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:18.889287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1435
2025-10-02T08:12:18.889398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:18.889420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:18.889428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:18.889431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:18.889813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1435 sessionId:  describe result for acl check
2025-10-02T08:12:18.889838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:18.889842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:18.889844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:18.889847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534271928772302:3922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:18.890251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534271928772302:3922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:18.891514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:18.891737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534271928772302:3922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:18.892563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:18.892695Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:18.892705Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:18.892711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:18.892741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:18.892768Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534271928772356:3926]
2025-10-02T08:12:18.893178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:18.893309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:18.893333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:18.893515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:18.893542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.893549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.893549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.893550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.893550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.893553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.893559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.893561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.893563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.893565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.893568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.893573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:18.893576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.893579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:18.893581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.893585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:18.893588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.893593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.893596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.893600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.893615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:18.896024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534271928772302:3922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:18.896035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534271928772302:3922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:18.896037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534271928772302:3922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:18.896055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:18.900995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:18.902630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:18.902643Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:18.902645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:18.902647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:18.902652Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1434 [1:7556534271928772356:3926]
2025-10-02T08:12:18.902659Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:18.902671Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:18.902676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.902678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.902679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.902691Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:18.902694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:18.902699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:18.902745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.902750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.902753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:18.902754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:18.902798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:18.902805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.902812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:18.902819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:18.902829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534271928772340:3926]
2025-10-02T08:12:18.902834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534271928772340:3926]
2025-10-02T08:12:18.902839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:18.902847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:18.902856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:18.902861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:18.902881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:18.902887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534272388632986:2378], now have 1 active actors on pipe
2025-10-02T08:12:18.902889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534271928772340:3926]
2025-10-02T08:12:18.902891Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:18.902893Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:18.902894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928772373:3922], now have 1 active actors on pipe
2025-10-02T08:12:18.902899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:18.902902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1434
2025-10-02T08:12:18.902910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.902917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.902940Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30300986-157b445f-d37a2ce6-8af94e51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:18.902953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:18.902957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:18.902960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:18.902969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:18.902976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:18.902995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.902997Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1434
2025-10-02T08:12:18.903053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:18.903060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:18.903074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:18.903103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1435 partition: 0 MaxSeqNo: 17 sessionId: src_id|30300986-157b445f-d37a2ce6-8af94e51_0
2025-10-02T08:12:18.903404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3150cd4-84b85437-328bad4e-d8822bd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|30300986-157b445f-d37a2ce6-8af94e51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:18.905721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30300986-157b445f-d37a2ce6-8af94e51_0] Write session: try to update token
2025-10-02T08:12:18.905733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30300986-157b445f-d37a2ce6-8af94e51_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:18.919121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId: src_id|30300986-157b445f-d37a2ce6-8af94e51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:18.919231Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:18.919246Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:18.919247Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:18.919253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534271928772340:3926]
2025-10-02T08:12:18.919259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534271928772340:3926]
2025-10-02T08:12:18.919291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:18.919299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:18.919300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:18.919346Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:18.919362Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:18.919579Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:18.921391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:18.977608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534271928772393:4654]
2025-10-02T08:12:18.977740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1434, pipe: [1:7556534271928772393:4654]
2025-10-02T08:12:19.043773Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:19.044091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.044105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.044144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534271928772393:4654], now have 1 active actors on pipe
2025-10-02T08:12:19.044226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:19.044232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:19.044280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1435 reason: error at write: Disconnected sessionId: src_id|30300986-157b445f-d37a2ce6-8af94e51_0
2025-10-02T08:12:19.044393Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:19.044422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1435 sessionId: src_id|30300986-157b445f-d37a2ce6-8af94e51_0 is DEAD
2025-10-02T08:12:19.044399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:19.044564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534271928772393:4654]
2025-10-02T08:12:19.044599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30300986-157b445f-d37a2ce6-8af94e51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:19.044610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30300986-157b445f-d37a2ce6-8af94e51_0] Write session will restart in 0.005798s
2025-10-02T08:12:19.044632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30300986-157b445f-d37a2ce6-8af94e51_0] Write session: Do CDS request
2025-10-02T08:12:19.044638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30300986-157b445f-d37a2ce6-8af94e51_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:19.051293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30300986-157b445f-d37a2ce6-8af94e51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.051391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:19.051407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1436
2025-10-02T08:12:19.051523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.051551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:19.051560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:19.051563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:19.051970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1436 sessionId:  describe result for acl check
2025-10-02T08:12:19.052006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:19.052011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:19.052013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:19.052018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534276223740024:3888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:19.052493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534276223740024:3888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:19.054406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534276223740024:3888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:19.057411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534276223740024:3888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:19.057424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534276223740024:3888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:19.057427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534276223740024:3888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:19.057434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:19.060634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:19.061219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:19.061371Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:19.061380Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:19.061390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:19.061429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:19.061467Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534276223740364:3892]
2025-10-02T08:12:19.062044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:19.062196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:19.062232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:19.062501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:19.062535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.062540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.062540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.062541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.062542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.062546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.062554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.062557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.062560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.062567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.062572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.062581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.062590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.062599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.062606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.062610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.062614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.062622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.062629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.062634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.062653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:19.074921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:19.076690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:19.076707Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:19.076709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:19.076713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:19.076719Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1435 [1:7556534276223740364:3892]
2025-10-02T08:12:19.076730Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:19.076746Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:19.076748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.076751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.076753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.076767Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:19.076776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:19.076783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:19.076870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.076877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.076880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:19.076882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:19.076943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:19.076949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.076962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.076978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:19.076997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534276223740358:3892]
2025-10-02T08:12:19.077003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534276223740358:3892]
2025-10-02T08:12:19.077010Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:19.077021Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:19.077025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1435
2025-10-02T08:12:19.077025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223740312:3888], now have 1 active actors on pipe
2025-10-02T08:12:19.077031Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:19.077034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:19.077046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:19.077049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:19.077054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534276683600313:2378], now have 1 active actors on pipe
2025-10-02T08:12:19.077080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.077088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.077100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534276223740358:3892]
2025-10-02T08:12:19.077111Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:19.077129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:19.077139Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:19.077144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.077153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.077154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:19.077122Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1435
2025-10-02T08:12:19.077163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.077174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:19.077201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.077241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.077247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.077258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.077306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1436 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0
2025-10-02T08:12:19.077624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30300986-157b445f-d37a2ce6-8af94e51_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:19.080063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0] Write session: try to update token
2025-10-02T08:12:19.080090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:19.094744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId: src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:19.094845Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:19.094863Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:19.094865Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:19.094873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534276223740358:3892]
2025-10-02T08:12:19.094876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534276223740358:3892]
2025-10-02T08:12:19.094915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:19.094917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:19.094921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.094922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:19.094923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:19.095109Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:19.097167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:19.144528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534276223740388:4654]
2025-10-02T08:12:19.144645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1435, pipe: [1:7556534276223740388:4654]
2025-10-02T08:12:19.231673Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:19.232042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.232053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.232100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223740388:4654], now have 1 active actors on pipe
2025-10-02T08:12:19.232198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:19.232203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:19.232245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1436 reason: error at write: Disconnected sessionId: src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0
2025-10-02T08:12:19.232350Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:19.232368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1436 sessionId: src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0 is DEAD
2025-10-02T08:12:19.232348Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:19.232503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534276223740388:4654]
2025-10-02T08:12:19.232530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:19.232538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0] Write session will restart in 0.005741s
2025-10-02T08:12:19.232572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0] Write session: Do CDS request
2025-10-02T08:12:19.232579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:19.239247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.239299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:19.239311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1437
2025-10-02T08:12:19.239438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.239468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:19.239475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:19.239478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:19.239825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1437 sessionId:  describe result for acl check
2025-10-02T08:12:19.239847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:19.239852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:19.239853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:19.239855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534276223740797:3872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:19.240336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534276223740797:3872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:19.242331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534276223740797:3872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:19.244611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534276223740797:3872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:19.244624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534276223740797:3872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:19.244627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534276223740797:3872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:19.244633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:19.245387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:19.246212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:19.246354Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:19.246363Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:19.246371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:19.246405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:19.246441Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534276223741080:3871]
2025-10-02T08:12:19.246833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:19.246967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:19.246993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:19.247168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:19.247193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.247197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.247197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.247198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.247198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.247201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.247207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.247209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.247211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.247213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.247216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.247220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.247223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.247230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.247232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.247235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.247240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.247243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.247245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.247248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.247257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:19.255049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:19.256573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:19.256587Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:19.256589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:19.256593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:19.256599Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1436 [1:7556534276223741080:3871]
2025-10-02T08:12:19.256610Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:19.256622Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:19.256623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.256626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.256627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.256637Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:19.256645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:19.256650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:19.256692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.256699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.256701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:19.256703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:19.256747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:19.256752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.256759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.256766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:19.256782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223741062:3872], now have 1 active actors on pipe
2025-10-02T08:12:19.256788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534276683600332:2378], now have 1 active actors on pipe
2025-10-02T08:12:19.256792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534276223741074:3871]
2025-10-02T08:12:19.256794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534276223741074:3871]
2025-10-02T08:12:19.256798Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:19.256814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1436
2025-10-02T08:12:19.256824Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:19.256827Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:19.256829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:19.256837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:19.256839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:19.256843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.256851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.256852Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1436
2025-10-02T08:12:19.256879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534276223741074:3871]
2025-10-02T08:12:19.256884Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:19.256886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:19.256895Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:19.256898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.256901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.256902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:19.256910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.256916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:19.256941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.256987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.256992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.257001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.257039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1437 partition: 0 MaxSeqNo: 17 sessionId: src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0
2025-10-02T08:12:19.257323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb3fa4d4-a8501588-1a9c03ed-e03228e8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:19.259869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0] Write session: try to update token
2025-10-02T08:12:19.259885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:19.267719Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:19.267736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:19.267744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534276223741074:3871]
2025-10-02T08:12:19.267786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:19.267787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:19.267957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:19.268128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:19.268269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:19.268408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:19.268591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:19.268639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:19.274934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId: src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:19.277388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:19.277454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.277466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.277498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:19.277521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:19.277579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.277594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.277756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.277817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.277951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.278044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.278378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.278390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.278522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.278590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.278715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.278779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.278891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.278897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.278963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.279022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.279080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.279143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.279187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.279195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.279256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.279312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.279378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.279447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.279575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.279582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.279655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.279722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.279795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.279864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.279988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.279996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.280067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.280139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.280206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.280274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.280386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.280391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.280461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.280527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.280596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.280658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.280710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.280718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.280787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.280866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.280930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.280994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.281167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.281172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.281245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.281304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.281368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.281429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.281488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.281493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.281567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:19.281634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:19.281693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:19.281759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:19.281919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:19.281926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:19.281965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:19.282019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.282040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.282045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:19.282072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:19.282085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:19.282091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:19.282094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:19.282098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:19.282460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:19.282482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:19.282490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:19.282496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:19.282499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:19.282501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:19.283212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:19.283233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:19.283243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:19.283249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:19.283252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:19.283259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:19.283848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:19.283866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:19.283874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:19.283883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:19.283890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:19.285943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:19.285960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:19.285970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392739285
2025-10-02T08:12:19.286067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:19.286078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:19.286089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:19.286091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:19.286095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:19.286097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:19.286504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:19.286522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:19.286525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:19.286531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:19.286533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:19.286536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:19.286981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:19.286998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:19.287004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:19.287010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:19.287012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:19.287016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:19.287438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:19.287453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:19.287459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:19.288486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:19.288502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:19.288505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:19.288507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:19.288513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392739288
2025-10-02T08:12:19.288767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:19.288782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:19.288787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:19.288789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:19.288797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:19.288811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:19.289205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:19.289222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:19.289225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:19.289228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:19.289230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:19.289233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:19.289664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:19.289680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.289747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392739289
2025-10-02T08:12:19.290444Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:19.290461Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:19.290469Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:19.290473Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:19.291921Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:19.291932Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:19.291933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:19.291941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534276223741074:3871]
2025-10-02T08:12:19.291943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534276223741074:3871]
2025-10-02T08:12:19.291974Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:19.291984Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:19.291994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:19.292002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.292003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:19.292154Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:19.332403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534276223741111:4654]
2025-10-02T08:12:19.332511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1436, pipe: [1:7556534276223741111:4654]
2025-10-02T08:12:19.416825Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:19.417129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223741111:4654], now have 1 active actors on pipe
2025-10-02T08:12:19.417220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:19.417226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:19.417246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1437 reason: error at write: Disconnected sessionId: src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0
2025-10-02T08:12:19.417310Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:19.417366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1437 sessionId: src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0 is DEAD
2025-10-02T08:12:19.417496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:19.417505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0] Write session will restart in 0.008706s
2025-10-02T08:12:19.417500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534276223741111:4654]
2025-10-02T08:12:19.417526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0] Write session: Do CDS request
2025-10-02T08:12:19.417531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:19.417596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:19.427205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.427283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:19.427295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1438
2025-10-02T08:12:19.427387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.427409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:19.427412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:19.427414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:19.427785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1438 sessionId:  describe result for acl check
2025-10-02T08:12:19.427819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:19.427825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:19.427826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:19.427831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534276223741724:3846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:19.428363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534276223741724:3846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:19.430103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534276223741724:3846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:19.431041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:19.431356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:19.431543Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:19.431551Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:19.431558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:19.431588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:19.431612Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534276223741794:3850]
2025-10-02T08:12:19.432024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:19.432155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:19.432180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:19.432374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:19.432402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.432406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.432407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.432407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.432408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.432411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.432417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.432420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.432422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.432423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.432423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534276223741724:3846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:19.432427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.432430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534276223741724:3846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:19.432431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.432433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534276223741724:3846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:19.432434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.432437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.432440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.432440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:19.432443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.432445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.432448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.432450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.432453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.432465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:19.440480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:19.442026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:19.442039Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:19.442040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:19.442044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:19.442049Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1437 [1:7556534276223741794:3850]
2025-10-02T08:12:19.442056Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:19.442069Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:19.442075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.442077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.442078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.442091Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:19.442094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:19.442104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:19.442154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.442159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.442161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:19.442163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:19.442212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:19.442217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.442224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.442230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:19.442244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534276223741788:3850]
2025-10-02T08:12:19.442249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534276223741788:3850]
2025-10-02T08:12:19.442255Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:19.442263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:19.442271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:19.442273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:19.442274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:19.442278Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:19.442280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223741808:3846], now have 1 active actors on pipe
2025-10-02T08:12:19.442282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534276683600338:2378], now have 1 active actors on pipe
2025-10-02T08:12:19.442289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1437
2025-10-02T08:12:19.442302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534276223741788:3850]
2025-10-02T08:12:19.442304Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:19.442307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:19.442311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.442313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.442342Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1437
2025-10-02T08:12:19.442341Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:19.442350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.442353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.442354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:19.442360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.442366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:19.442377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.442412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.442413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.442421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.442451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1438 partition: 0 MaxSeqNo: 17 sessionId: src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0
2025-10-02T08:12:19.442736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c5f5cd-43917409-3f0c3052-12202e7f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:19.445165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0] Write session: try to update token
2025-10-02T08:12:19.445176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:19.457944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId: src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:19.459181Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:19.459192Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:19.459194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:19.459200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534276223741788:3850]
2025-10-02T08:12:19.459206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534276223741788:3850]
2025-10-02T08:12:19.459242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:19.459247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.459249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:19.459257Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:19.459265Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:19.459370Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:19.460391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:19.517794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534276223741827:4654]
2025-10-02T08:12:19.517930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1437, pipe: [1:7556534276223741827:4654]
2025-10-02T08:12:19.582727Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:19.583085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.583095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.583127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223741827:4654], now have 1 active actors on pipe
2025-10-02T08:12:19.583177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534276223741827:4654]
2025-10-02T08:12:19.583192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:19.583194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:19.583230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1438 reason: error at write: Disconnected sessionId: src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0
2025-10-02T08:12:19.583301Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:19.583322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:19.583359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1438 sessionId: src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0 is DEAD
2025-10-02T08:12:19.583488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:19.583495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0] Write session will restart in 0.006173s
2025-10-02T08:12:19.583514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0] Write session: Do CDS request
2025-10-02T08:12:19.583519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:19.591170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.591221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:19.591233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1439
2025-10-02T08:12:19.591330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.591352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:19.591358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:19.591361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:19.591693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1439 sessionId:  describe result for acl check
2025-10-02T08:12:19.591723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:19.591725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:19.591726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:19.591731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534276223742255:3830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:19.592127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534276223742255:3830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:19.594128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534276223742255:3830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:19.596652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534276223742255:3830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:19.596667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534276223742255:3830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:19.596669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534276223742255:3830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:19.596673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:19.596940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:19.597877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:19.597987Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:19.597994Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:19.598000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:19.598029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:19.598064Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534276223742511:3839]
2025-10-02T08:12:19.598449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:19.598580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:19.598605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:19.598791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:19.598818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.598823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.598823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.598824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.598825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.598828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.598834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.598836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.598838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.598840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.598843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.598851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.598855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.598858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.598860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.598863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.598865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.598867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.598870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.598873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.598883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:19.606366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:19.608012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:19.608023Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:19.608024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:19.608027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:19.608031Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1438 [1:7556534276223742511:3839]
2025-10-02T08:12:19.608038Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:19.608049Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:19.608055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.608058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.608059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.608084Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:19.608091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:19.608097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:19.608138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.608144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.608147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:19.608149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:19.608190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:19.608195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.608202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.608212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:19.608226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534276223742505:3839]
2025-10-02T08:12:19.608231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534276223742505:3839]
2025-10-02T08:12:19.608236Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:19.608244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:19.608256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:19.608261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:19.608268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:19.608278Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:19.608283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223742502:3830], now have 1 active actors on pipe
2025-10-02T08:12:19.608284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1438
2025-10-02T08:12:19.608285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534276683600344:2378], now have 1 active actors on pipe
2025-10-02T08:12:19.608287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534276223742505:3839]
2025-10-02T08:12:19.608289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:19.608291Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:19.608299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.608302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.608326Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:19.608338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.608341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.608342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:19.608349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.608355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:19.608368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.608368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1438
2025-10-02T08:12:19.608443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.608449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.608463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.608493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1439 partition: 0 MaxSeqNo: 17 sessionId: src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0
2025-10-02T08:12:19.608770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d64c50c3-d3781754-94d84ae0-23c6aecf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:19.611126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0] Write session: try to update token
2025-10-02T08:12:19.611138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:19.623972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId: src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:19.625342Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:19.625359Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:19.625361Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:19.625370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534276223742505:3839]
2025-10-02T08:12:19.625374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534276223742505:3839]
2025-10-02T08:12:19.625415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:19.625425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.625427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:19.625444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:19.625458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:19.625590Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:19.626565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:19.683193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534276223742537:4654]
2025-10-02T08:12:19.683316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1438, pipe: [1:7556534276223742537:4654]
2025-10-02T08:12:19.750308Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:19.750523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.750535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.750570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223742537:4654], now have 1 active actors on pipe
2025-10-02T08:12:19.750688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:19.750698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:19.750763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1439 reason: error at write: Disconnected sessionId: src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0
2025-10-02T08:12:19.750822Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:19.750922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1439 sessionId: src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0 is DEAD
2025-10-02T08:12:19.751051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:19.751059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0] Write session will restart in 0.007253s
2025-10-02T08:12:19.751076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0] Write session: Do CDS request
2025-10-02T08:12:19.751082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:19.751070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534276223742537:4654]
2025-10-02T08:12:19.751521Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:19.759199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.759272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:19.759285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1440
2025-10-02T08:12:19.759396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.759438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:19.759446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:19.759450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:19.759816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1440 sessionId:  describe result for acl check
2025-10-02T08:12:19.759842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:19.759846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:19.759847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:19.759850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534276223743023:3827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:19.760220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534276223743023:3827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:19.762864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534276223743023:3827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:19.765248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:19.765555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:19.765604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534276223743023:3827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:19.765616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534276223743023:3827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:19.765619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534276223743023:3827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:19.765625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:19.765896Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:19.765910Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:19.765922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:19.765984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:19.766023Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534276223743224:3828]
2025-10-02T08:12:19.766652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:19.766809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:19.766847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:19.767075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:19.767122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.767127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.767128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.767128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.767129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.767134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.767143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.767149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.767151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.767153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.767156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.767161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.767165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.767167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.767170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.767172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.767174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.767177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.767179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.767182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.767192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:19.774883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:19.776914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:19.776928Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:19.776930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:19.776933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:19.776937Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1439 [1:7556534276223743224:3828]
2025-10-02T08:12:19.776944Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:19.776957Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:19.776962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.776964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.776965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.776976Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:19.776979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:19.776984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:19.777031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.777036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.777039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:19.777040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:19.777090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:19.777097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.777110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.777121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:19.777133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534276223743212:3828]
2025-10-02T08:12:19.777138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534276223743212:3828]
2025-10-02T08:12:19.777145Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:19.777157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223743220:3827], now have 1 active actors on pipe
2025-10-02T08:12:19.777165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:19.777167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:19.777174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1439
2025-10-02T08:12:19.777175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:19.777175Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:19.777177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:19.777180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534276683600353:2378], now have 1 active actors on pipe
2025-10-02T08:12:19.777203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534276223743212:3828]
2025-10-02T08:12:19.777214Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:19.777224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:19.777224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.777229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.777259Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:19.777267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.777269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.777273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:19.777279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.777288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:19.777288Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1439
2025-10-02T08:12:19.777304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.777360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.777368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.777379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.777412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1440 partition: 0 MaxSeqNo: 17 sessionId: src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0
2025-10-02T08:12:19.777714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2c31b7-49c83672-511b97-2f58cfc9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:19.780308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Write session: try to update token
2025-10-02T08:12:19.780325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:19.793881Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:19.793896Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:19.793898Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:19.793904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534276223743212:3828]
2025-10-02T08:12:19.793907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534276223743212:3828]
2025-10-02T08:12:19.793939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:19.793948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.793947Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:19.793949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:19.793952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:19.793953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId: src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:19.794111Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:19.796524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:19.873030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534276223743261:4654]
2025-10-02T08:12:19.875553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1439, pipe: [1:7556534276223743261:4654]
2025-10-02T08:12:19.935239Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:19.935522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.935538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.935578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223743261:4654], now have 1 active actors on pipe
2025-10-02T08:12:19.935682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534276223743261:4654]
2025-10-02T08:12:19.935691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:19.935696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:19.935757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1440 reason: error at write: Disconnected sessionId: src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0
2025-10-02T08:12:19.935801Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:19.935823Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:19.935939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1440 sessionId: src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0 is DEAD
2025-10-02T08:12:19.936095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 158 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:12:19.936123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:19.936127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Write session will restart in 0.009742s
2025-10-02T08:12:19.936151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Write session: Do CDS request
2025-10-02T08:12:19.936157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:19.947293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.947368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:19.947386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1441
2025-10-02T08:12:19.947504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:19.947535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:19.947544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:19.947548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:19.947925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1441 sessionId:  describe result for acl check
2025-10-02T08:12:19.947960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:19.947965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:19.947967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:19.947972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534276223743796:3788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:19.948507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534276223743796:3788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:19.951533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534276223743796:3788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:19.954455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:19.954842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534276223743796:3788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:19.954855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534276223743796:3788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:19.954859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534276223743796:3788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:19.954867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:19.955640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:19.955771Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:19.955777Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:19.955784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:19.955812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:19.955836Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534276223743963:3789]
2025-10-02T08:12:19.956239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:19.956418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:19.956448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:19.956637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:19.956662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.956667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.956668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.956668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.956669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.956672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.956678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.956679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.956681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.956683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.956686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.956690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:19.956693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.956696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:19.956698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.956701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:19.956703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.956705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.956707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.956710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.956719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:19.967154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:19.968976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:19.968990Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:19.968991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:19.968993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:19.968997Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1440 [1:7556534276223743963:3789]
2025-10-02T08:12:19.969004Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:19.969018Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:19.969019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.969022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.969022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.969035Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:19.969037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:19.969041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:19.969089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.969095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.969096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:19.969098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:19.969160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:19.969167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.969178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:19.969188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:19.969203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534276223743951:3789]
2025-10-02T08:12:19.969208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534276223743951:3789]
2025-10-02T08:12:19.969217Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:19.969225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:19.969227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:19.969232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534276223743959:3788], now have 1 active actors on pipe
2025-10-02T08:12:19.969238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1440
2025-10-02T08:12:19.969243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:19.969255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:19.969261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:19.969265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534276683600361:2378], now have 1 active actors on pipe
2025-10-02T08:12:19.969296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.969304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.969316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534276223743951:3789]
2025-10-02T08:12:19.969279Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1440
2025-10-02T08:12:19.969322Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:19.969325Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:19.969353Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:19.969369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:19.969372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:19.969373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:19.969381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:19.969390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:19.969410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.969453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:19.969460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:19.969472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:19.969504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1441 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0
2025-10-02T08:12:19.969817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b71d493-19de149e-c7bbd0a2-750e0d90_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:19.972595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0] Write session: try to update token
2025-10-02T08:12:19.972613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:19.986420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId: src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:19.986582Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:19.986598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:19.986601Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:19.986608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534276223743951:3789]
2025-10-02T08:12:19.986612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534276223743951:3789]
2025-10-02T08:12:19.986655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:19.986666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:19.986668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:19.986742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:19.986759Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:19.986845Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:19.988713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:20.035938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534280518711290:4654]
2025-10-02T08:12:20.036060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1440, pipe: [1:7556534280518711290:4654]
2025-10-02T08:12:20.135514Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:20.135873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.135888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.135925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518711290:4654], now have 1 active actors on pipe
2025-10-02T08:12:20.136016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:20.136022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:20.136032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534280518711290:4654]
2025-10-02T08:12:20.136061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1441 reason: error at write: Disconnected sessionId: src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0
2025-10-02T08:12:20.136142Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:20.136176Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:20.136235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1441 sessionId: src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0 is DEAD
2025-10-02T08:12:20.136381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:20.136390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0] Write session will restart in 0.007029s
2025-10-02T08:12:20.136410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0] Write session: Do CDS request
2025-10-02T08:12:20.136417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:20.144256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.144315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:20.144327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1442
2025-10-02T08:12:20.144456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.144496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:20.144505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:20.144515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:20.145065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1442 sessionId:  describe result for acl check
2025-10-02T08:12:20.145096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:20.145102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:20.145104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:20.145109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534280518711729:3760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:20.145512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534280518711729:3760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:20.147780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534280518711729:3760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:20.150821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534280518711729:3760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:20.150832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534280518711729:3760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:20.150834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534280518711729:3760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:20.150840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:20.150901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:20.151994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:20.152146Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:20.152153Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:20.152160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:20.152204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:20.152255Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534280518711978:3773]
2025-10-02T08:12:20.152665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:20.152793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:20.152830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:20.153031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:20.153057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.153061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.153062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.153063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.153063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.153067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.153076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.153080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.153084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.153087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.153092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.153099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.153104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.153109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.153112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.153117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.153121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.153126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.153131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.153136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.153151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:20.160745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:20.162292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:20.162305Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:20.162307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:20.162309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:20.162313Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1441 [1:7556534280518711978:3773]
2025-10-02T08:12:20.162321Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:20.162333Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:20.162335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.162337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.162338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.162348Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:20.162351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:20.162357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:20.162404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.162410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.162412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:20.162414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:20.162460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:20.162466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.162473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.162480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:20.162492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534280518711966:3773]
2025-10-02T08:12:20.162493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534280518711966:3773]
2025-10-02T08:12:20.162498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:20.162507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:20.162517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:20.162520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:20.162524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:20.162527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:20.162553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1441
2025-10-02T08:12:20.162562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518711969:3760], now have 1 active actors on pipe
2025-10-02T08:12:20.162565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534280978567700:2378], now have 1 active actors on pipe
2025-10-02T08:12:20.162567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534280518711966:3773]
2025-10-02T08:12:20.162573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:20.162578Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:20.162578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.162582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.162614Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:20.162622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.162596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1441
2025-10-02T08:12:20.162624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.162626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:20.162633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.162639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:20.162654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.162689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.162696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.162707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.162742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1442 partition: 0 MaxSeqNo: 17 sessionId: src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0
2025-10-02T08:12:20.163058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dc8651-b4907dd1-1ebff6be-a4a829e0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:20.165468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0] Write session: try to update token
2025-10-02T08:12:20.165482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:20.178718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId: src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:20.178865Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:20.178876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:20.178881Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:20.178887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534280518711966:3773]
2025-10-02T08:12:20.178890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534280518711966:3773]
2025-10-02T08:12:20.178924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:20.178932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.178934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:20.178935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:20.178941Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:20.179054Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:20.181209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:20.236178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534280518712018:4654]
2025-10-02T08:12:20.236314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1441, pipe: [1:7556534280518712018:4654]
2025-10-02T08:12:20.304628Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:20.305024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.305037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.305074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518712018:4654], now have 1 active actors on pipe
2025-10-02T08:12:20.305209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534280518712018:4654]
2025-10-02T08:12:20.305234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:20.305236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:20.305284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1442 reason: error at write: Disconnected sessionId: src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0
2025-10-02T08:12:20.305268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:20.305347Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:20.305435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1442 sessionId: src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0 is DEAD
2025-10-02T08:12:20.305526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:20.305535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0] Write session will restart in 0.005189s
2025-10-02T08:12:20.305559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0] Write session: Do CDS request
2025-10-02T08:12:20.305566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:20.312287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.312393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:20.312407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1443
2025-10-02T08:12:20.312516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.312537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:20.312545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:20.312547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:20.312942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1443 sessionId:  describe result for acl check
2025-10-02T08:12:20.312980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:20.312988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:20.312989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:20.312994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534280518712389:3747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:20.313502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534280518712389:3747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:20.315684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534280518712389:3747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:20.318368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534280518712389:3747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:20.318381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534280518712389:3747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:20.318385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534280518712389:3747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:20.318391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:20.319900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:20.320872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:20.321054Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:20.321063Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:20.321070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:20.321102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:20.321128Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534280518712706:3749]
2025-10-02T08:12:20.321527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:20.321652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:20.321677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:20.321869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:20.321899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.321900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.321900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.321901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.321902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.321905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.321911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.321913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.321916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.321917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.321921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.321925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.321929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.321932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.321934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.321938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.321940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.321943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.321945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.321948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.321958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:20.330706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:20.332426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:20.332443Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:20.332444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:20.332447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:20.332451Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1442 [1:7556534280518712706:3749]
2025-10-02T08:12:20.332459Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:20.332473Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:20.332475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.332477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.332478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.332491Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:20.332494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:20.332498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:20.332546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.332554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.332556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:20.332557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:20.332603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:20.332610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.332619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.332626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:20.332636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534280518712700:3749]
2025-10-02T08:12:20.332637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534280518712700:3749]
2025-10-02T08:12:20.332643Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:20.332652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:20.332660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:20.332661Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:20.332661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:20.332664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:20.332669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518712682:3747], now have 1 active actors on pipe
2025-10-02T08:12:20.332694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534280978567706:2378], now have 1 active actors on pipe
2025-10-02T08:12:20.332699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1442
2025-10-02T08:12:20.332702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534280518712700:3749]
2025-10-02T08:12:20.332707Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:20.332713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.332715Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:20.332716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.332755Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:20.332760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.332762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.332764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:20.332770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.332777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:20.332790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.332845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.332834Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1442
2025-10-02T08:12:20.332854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.332867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.332912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1443 partition: 0 MaxSeqNo: 17 sessionId: src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0
2025-10-02T08:12:20.333223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b0da9d-1e64ff4e-9fb47c7f-8a5a735e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:20.335699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0] Write session: try to update token
2025-10-02T08:12:20.335710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:20.349077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId: src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:20.350600Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:20.350632Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:20.350634Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:20.350645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534280518712700:3749]
2025-10-02T08:12:20.350650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534280518712700:3749]
2025-10-02T08:12:20.350689Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:20.350700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:20.350701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:20.350709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.350711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:20.350893Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:20.352105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:20.405571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534280518712732:4654]
2025-10-02T08:12:20.405661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1442, pipe: [1:7556534280518712732:4654]
2025-10-02T08:12:20.477716Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:20.478167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.478178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.478209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518712732:4654], now have 1 active actors on pipe
2025-10-02T08:12:20.478377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534280518712732:4654]
2025-10-02T08:12:20.478399Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:20.478406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:20.478409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:20.478467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1443 reason: error at write: Disconnected sessionId: src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0
2025-10-02T08:12:20.478437Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:20.478640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1443 sessionId: src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0 is DEAD
2025-10-02T08:12:20.478938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:20.478949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0] Write session will restart in 0.006072s
2025-10-02T08:12:20.478972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0] Write session: Do CDS request
2025-10-02T08:12:20.478977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:20.486348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.486379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:20.486392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1444
2025-10-02T08:12:20.486515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.486552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:20.486562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:20.486565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:20.486939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1444 sessionId:  describe result for acl check
2025-10-02T08:12:20.486973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:20.486978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:20.486980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:20.486984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534280518713126:3733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:20.487448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534280518713126:3733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:20.489958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534280518713126:3733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:20.493132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534280518713126:3733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:20.493145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534280518713126:3733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:20.493147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534280518713126:3733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:20.493153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:20.496004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:20.496359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:20.496621Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:20.496632Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:20.496642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:20.496690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:20.496725Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534280518713422:3732]
2025-10-02T08:12:20.497340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:20.497494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:20.497527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:20.497804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:20.497842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.497848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.497849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.497850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.497851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.497855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.497865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.497869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.497873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.497879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.497884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.497890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.497900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.497905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.497909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.497918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.497922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.497928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.497932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.497940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.497959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:20.505502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:20.506968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:20.506984Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:20.506986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:20.506989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:20.506996Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1443 [1:7556534280518713422:3732]
2025-10-02T08:12:20.507008Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:20.507022Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:20.507025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.507028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.507030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.507044Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:20.507049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:20.507055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:20.507113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.507120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.507123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:20.507125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:20.507188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:20.507195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.507206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.507219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:20.507231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1443
2025-10-02T08:12:20.507240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518713401:3733], now have 1 active actors on pipe
2025-10-02T08:12:20.507244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534280978567713:2378], now have 1 active actors on pipe
2025-10-02T08:12:20.507250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534280518713416:3732]
2025-10-02T08:12:20.507252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534280518713416:3732]
2025-10-02T08:12:20.507265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:20.507276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.507280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.507280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:20.507283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:20.507298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:20.507315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:20.507322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:20.507353Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dde8155-97b56d83-17b7226a-54a0437e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:20.507321Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1443
2025-10-02T08:12:20.507363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.507366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.507368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:20.507376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.507386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:20.507393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534280518713416:3732]
2025-10-02T08:12:20.507406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:20.507412Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:20.507433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.507474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.507481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.507493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.507527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1444 partition: 0 MaxSeqNo: 17 sessionId: src_id|2dde8155-97b56d83-17b7226a-54a0437e_0
2025-10-02T08:12:20.507837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9ac373-feac3cec-3d3f945d-f86892aa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2dde8155-97b56d83-17b7226a-54a0437e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:20.510348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dde8155-97b56d83-17b7226a-54a0437e_0] Write session: try to update token
2025-10-02T08:12:20.510361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dde8155-97b56d83-17b7226a-54a0437e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:20.523112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId: src_id|2dde8155-97b56d83-17b7226a-54a0437e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:20.523500Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:20.523515Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:20.523518Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:20.523525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534280518713416:3732]
2025-10-02T08:12:20.523529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534280518713416:3732]
2025-10-02T08:12:20.523568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:20.523577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.523579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:20.523592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:20.523606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:20.523721Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:20.525710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:20.578638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534280518713451:4654]
2025-10-02T08:12:20.578765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1443, pipe: [1:7556534280518713451:4654]
2025-10-02T08:12:20.655373Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:20.655726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.655742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.655779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518713451:4654], now have 1 active actors on pipe
2025-10-02T08:12:20.655924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:20.655933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:20.655987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1444 reason: error at write: Disconnected sessionId: src_id|2dde8155-97b56d83-17b7226a-54a0437e_0
2025-10-02T08:12:20.656022Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:20.656053Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:20.656131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1444 sessionId: src_id|2dde8155-97b56d83-17b7226a-54a0437e_0 is DEAD
2025-10-02T08:12:20.656282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534280518713451:4654]
2025-10-02T08:12:20.656315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dde8155-97b56d83-17b7226a-54a0437e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:20.656324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dde8155-97b56d83-17b7226a-54a0437e_0] Write session will restart in 0.008450s
2025-10-02T08:12:20.656346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dde8155-97b56d83-17b7226a-54a0437e_0] Write session: Do CDS request
2025-10-02T08:12:20.656353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dde8155-97b56d83-17b7226a-54a0437e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:20.666214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dde8155-97b56d83-17b7226a-54a0437e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.666295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:20.666314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1445
2025-10-02T08:12:20.666424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.666458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:20.666465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:20.666468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:20.666892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1445 sessionId:  describe result for acl check
2025-10-02T08:12:20.666924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:20.666930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:20.666932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:20.666936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534280518713919:3727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:20.667557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534280518713919:3727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:20.670067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534280518713919:3727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:20.672562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534280518713919:3727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:20.672573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534280518713919:3727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:20.672576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534280518713919:3727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:20.672584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:20.672921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:20.674310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:20.674437Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:20.674444Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:20.674451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:20.674496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:20.674524Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534280518714145:3718]
2025-10-02T08:12:20.674990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:20.675147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:20.675177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:20.675385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:20.675416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.675423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.675424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.675424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.675425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.675428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.675435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.675437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.675439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.675441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.675444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.675449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.675453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.675456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.675458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.675461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.675463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.675466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.675469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.675472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.675486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:20.683038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:20.684662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:20.684678Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:20.684680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:20.684683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:20.684689Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1444 [1:7556534280518714145:3718]
2025-10-02T08:12:20.684700Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:20.684716Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:20.684723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.684726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.684728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.684743Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:20.684753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:20.684759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:20.684838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.684844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.684847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:20.684849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:20.684918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:20.684925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.684936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.684952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:20.684974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518714135:3727], now have 1 active actors on pipe
2025-10-02T08:12:20.684977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534280978567721:2378], now have 1 active actors on pipe
2025-10-02T08:12:20.684980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1444
2025-10-02T08:12:20.684982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534280518714139:3718]
2025-10-02T08:12:20.684984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534280518714139:3718]
2025-10-02T08:12:20.684996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:20.685007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.685012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:20.685014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.685015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:20.685027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:20.685043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:20.685051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:20.685051Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1444
2025-10-02T08:12:20.685087Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0eab64-94e28003-173f024a-62586754_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:20.685097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.685100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.685102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:20.685109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.685119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:20.685132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534280518714139:3718]
2025-10-02T08:12:20.685141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:20.685155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:20.685168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.685211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.685217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.685230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.685269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1445 partition: 0 MaxSeqNo: 17 sessionId: src_id|c0eab64-94e28003-173f024a-62586754_0
2025-10-02T08:12:20.685616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dde8155-97b56d83-17b7226a-54a0437e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c0eab64-94e28003-173f024a-62586754_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:20.688112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0eab64-94e28003-173f024a-62586754_0] Write session: try to update token
2025-10-02T08:12:20.688127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0eab64-94e28003-173f024a-62586754_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:20.701252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId: src_id|c0eab64-94e28003-173f024a-62586754_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:20.701392Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:20.701405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:20.701407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:20.701414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534280518714139:3718]
2025-10-02T08:12:20.701424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534280518714139:3718]
2025-10-02T08:12:20.701457Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:20.701465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:20.701468Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:20.701470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.701472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:20.701605Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:20.703401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:20.756299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534280518714174:4654]
2025-10-02T08:12:20.756414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1444, pipe: [1:7556534280518714174:4654]
2025-10-02T08:12:20.822960Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 14 CurrentSessionLifetimeMs: 301517 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:12:20.831177Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:20.831470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.831481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.831520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518714174:4654], now have 1 active actors on pipe
2025-10-02T08:12:20.831664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534280518714174:4654]
2025-10-02T08:12:20.831693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:20.831694Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:20.831696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:20.831763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1445 reason: error at write: Disconnected sessionId: src_id|c0eab64-94e28003-173f024a-62586754_0
2025-10-02T08:12:20.831785Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:20.831934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1445 sessionId: src_id|c0eab64-94e28003-173f024a-62586754_0 is DEAD
2025-10-02T08:12:20.832107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0eab64-94e28003-173f024a-62586754_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:20.832118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0eab64-94e28003-173f024a-62586754_0] Write session will restart in 0.009982s
2025-10-02T08:12:20.832135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0eab64-94e28003-173f024a-62586754_0] Write session: Do CDS request
2025-10-02T08:12:20.832140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0eab64-94e28003-173f024a-62586754_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:20.843256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0eab64-94e28003-173f024a-62586754_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.843322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:20.843340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1446
2025-10-02T08:12:20.843424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:20.843453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:20.843457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:20.843460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:20.843809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1446 sessionId:  describe result for acl check
2025-10-02T08:12:20.843846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:20.843852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:20.843854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:20.843859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534280518714692:3717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:20.844283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534280518714692:3717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:20.847097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534280518714692:3717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:20.850042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:20.850168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534280518714692:3717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:20.850185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534280518714692:3717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:20.850188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534280518714692:3717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:20.850196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:20.851648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:20.851810Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:20.851818Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:20.851825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:20.851867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:20.851902Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534280518714878:3720]
2025-10-02T08:12:20.852450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:20.852614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:20.852651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:20.852949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:20.852994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.853000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.853001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.853002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.853003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.853007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.853018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.853026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.853030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.853034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.853042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.853050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:20.853056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.853064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:20.853068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.853073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:20.853081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.853085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.853090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.853095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.853114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:20.861402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:20.863302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:20.863316Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:20.863318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:20.863322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:20.863328Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1445 [1:7556534280518714878:3720]
2025-10-02T08:12:20.863339Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:20.863356Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:20.863359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.863361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.863363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.863375Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:20.863379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:20.863384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:20.863431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.863437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.863439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:20.863441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:20.863488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:20.863492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.863500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:20.863510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:20.863525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518714874:3717], now have 1 active actors on pipe
2025-10-02T08:12:20.863536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534280518714866:3720]
2025-10-02T08:12:20.863538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534280518714866:3720]
2025-10-02T08:12:20.863548Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:20.863550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1445
2025-10-02T08:12:20.863558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:20.863560Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:20.863563Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:20.863570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:20.863578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:20.863583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534280978567728:2378], now have 1 active actors on pipe
2025-10-02T08:12:20.863588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.863593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.863633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534280518714866:3720]
2025-10-02T08:12:20.863640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:20.863653Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:20.863659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.863662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:20.863667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.863633Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1445
2025-10-02T08:12:20.863669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:20.863677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.863686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:20.863715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.863755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.863759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.863769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:20.863797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1446 partition: 0 MaxSeqNo: 17 sessionId: src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0
2025-10-02T08:12:20.864107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0eab64-94e28003-173f024a-62586754_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:20.866520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0] Write session: try to update token
2025-10-02T08:12:20.866535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:20.874064Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:20.874084Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:20.874092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534280518714866:3720]
2025-10-02T08:12:20.874127Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:20.874129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:20.874351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:20.874490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:20.874636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:20.874791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:20.874988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:20.875025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:20.879079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId: src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:20.881789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:20.881861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.881875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.881910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:20.881928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:20.881989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:20.881997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:20.882149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.882218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.882290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.882360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.882522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.882537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.882610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.882675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.882747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.882821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.882875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.882885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.882964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.883032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.883103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.883168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.883215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.883223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.883298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.883395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.883475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.883552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.883610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.883618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.883716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.883787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.883862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.883975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.884044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.884052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.884154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.884257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.884333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.884410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.884472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.884481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.884561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.884632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.884714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.884791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.884863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.884871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.884947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.885015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.885089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.885186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.885242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.885249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.885334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.885400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.885471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.885539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.885602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.885610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.885686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:20.885757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:20.885825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:20.885892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:20.886021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:20.886030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:20.886069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:20.886131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:20.886154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:20.886161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:20.886191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:20.886207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:20.886216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:20.886220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:20.886224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:20.886648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:20.886679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:20.886691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:20.886694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:20.886698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:20.886705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:20.887316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:20.887340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:20.887352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:20.887361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:20.887365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:20.887372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:20.887881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:20.887906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:20.887912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:20.887916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:20.887920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:20.889257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:20.889277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:20.889289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392740888
2025-10-02T08:12:20.889452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:20.889468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:20.889475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:20.889479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:20.889483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:20.889487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:20.890024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:20.890049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:20.890054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:20.890060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:20.890068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:20.890072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:20.890562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:20.890586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:20.890596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:20.890604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:20.890608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:20.890611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:20.891168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:20.891194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:20.891199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:20.892427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:20.892448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:20.892454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:20.892457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:20.892466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392740892
2025-10-02T08:12:20.892787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:20.892831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:20.892842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:20.892846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:20.892851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:20.892855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:20.893336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:20.893360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:20.893369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:20.893373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:20.893377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:20.893387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:20.893878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:20.893899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:20.894002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392740893
2025-10-02T08:12:20.894837Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:20.894863Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:20.894871Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:20.894878Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:20.896602Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:20.896617Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:20.896619Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:20.896630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534280518714866:3720]
2025-10-02T08:12:20.896636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534280518714866:3720]
2025-10-02T08:12:20.896684Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:20.896697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:20.896701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:20.896703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:20.896707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:20.896861Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:20.931936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534280518714940:4654]
2025-10-02T08:12:20.932065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1445, pipe: [1:7556534280518714940:4654]
2025-10-02T08:12:21.047185Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:21.047603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534280518714940:4654], now have 1 active actors on pipe
2025-10-02T08:12:21.047735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534280518714940:4654]
2025-10-02T08:12:21.047757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:21.047759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:21.047781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1446 reason: error at write: Disconnected sessionId: src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0
2025-10-02T08:12:21.047817Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:21.047847Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:21.047951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1446 sessionId: src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0 is DEAD
2025-10-02T08:12:21.048111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:21.048121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0] Write session will restart in 0.006783s
2025-10-02T08:12:21.048145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0] Write session: Do CDS request
2025-10-02T08:12:21.048152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:21.056257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.056373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:21.056395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1447
2025-10-02T08:12:21.056506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.056539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:21.056548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:21.056556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:21.056949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1447 sessionId:  describe result for acl check
2025-10-02T08:12:21.056983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:21.056989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:21.056991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:21.056996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534284813682627:3656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:21.057496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534284813682627:3656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:21.060145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534284813682627:3656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:21.063160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534284813682627:3656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:21.063177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534284813682627:3656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:21.063180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534284813682627:3656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:21.063187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:21.067196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:21.067529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:21.067680Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:21.067690Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:21.067699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:21.067742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:21.067776Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534284813682941:3660]
2025-10-02T08:12:21.068379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:21.068554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:21.068592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:21.068898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:21.068947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.068953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.068955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.068956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.068957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.068962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.068971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.068974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.068978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.068981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.068986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.068992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.068997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.069002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.069006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.069010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.069014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.069019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.069023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.069027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.069049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:21.076610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:21.078548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:21.078570Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:21.078572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:21.078576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:21.078583Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1446 [1:7556534284813682941:3660]
2025-10-02T08:12:21.078596Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:21.078613Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:21.078617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.078621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.078623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.078639Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:21.078650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:21.078656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:21.078725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.078735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.078737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:21.078740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:21.078804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:21.078811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.078825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.078842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:21.078864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534284813682935:3660]
2025-10-02T08:12:21.078871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534284813682935:3660]
2025-10-02T08:12:21.078882Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:21.078892Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:21.078895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:21.078902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813682899:3656], now have 1 active actors on pipe
2025-10-02T08:12:21.078902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1446
2025-10-02T08:12:21.078912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:21.078925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:21.078933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:21.078938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534285273535055:2378], now have 1 active actors on pipe
2025-10-02T08:12:21.078972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.078980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.078992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534284813682935:3660]
2025-10-02T08:12:21.079004Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:21.079021Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:21.079030Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ace38e5c-db60d61f-852f6270-18ced407_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:21.079038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.079041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.079043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:21.079052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.079021Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1446
2025-10-02T08:12:21.079061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:21.079094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.079190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.079198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.079214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.079256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1447 partition: 0 MaxSeqNo: 17 sessionId: src_id|ace38e5c-db60d61f-852f6270-18ced407_0
2025-10-02T08:12:21.079565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de2c8a5c-6466d3f1-225f49ea-49b4367_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ace38e5c-db60d61f-852f6270-18ced407_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:21.082266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace38e5c-db60d61f-852f6270-18ced407_0] Write session: try to update token
2025-10-02T08:12:21.082284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace38e5c-db60d61f-852f6270-18ced407_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:21.095805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId: src_id|ace38e5c-db60d61f-852f6270-18ced407_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:21.095874Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:21.095890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:21.095893Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:21.095902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534284813682935:3660]
2025-10-02T08:12:21.095907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534284813682935:3660]
2025-10-02T08:12:21.095951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:21.095954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:21.095961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.095963Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:21.095963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:21.096161Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:21.098585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:21.147964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534284813682965:4654]
2025-10-02T08:12:21.148100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1446, pipe: [1:7556534284813682965:4654]
2025-10-02T08:12:21.235757Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:21.236323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.236339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.236379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813682965:4654], now have 1 active actors on pipe
2025-10-02T08:12:21.236591Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:21.236587Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:21.236683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534284813682965:4654]
2025-10-02T08:12:21.236714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:21.236778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1447 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ace38e5c-db60d61f-852f6270-18ced407_0
2025-10-02T08:12:21.236989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1447 sessionId: src_id|ace38e5c-db60d61f-852f6270-18ced407_0 is DEAD
2025-10-02T08:12:21.237111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace38e5c-db60d61f-852f6270-18ced407_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:21.237120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace38e5c-db60d61f-852f6270-18ced407_0] Write session will restart in 0.005411s
2025-10-02T08:12:21.237146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace38e5c-db60d61f-852f6270-18ced407_0] Write session: Do CDS request
2025-10-02T08:12:21.237153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace38e5c-db60d61f-852f6270-18ced407_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:21.243263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace38e5c-db60d61f-852f6270-18ced407_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.243326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:21.243341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1448
2025-10-02T08:12:21.243476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.243516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:21.243525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:21.243528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:21.243943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1448 sessionId:  describe result for acl check
2025-10-02T08:12:21.243975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:21.243985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:21.243987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:21.243992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534284813683297:3640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:21.244508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534284813683297:3640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:21.247026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534284813683297:3640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:21.249772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534284813683297:3640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:21.249787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534284813683297:3640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:21.249790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534284813683297:3640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:21.249797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:21.254282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:21.255809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:21.256045Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:21.256056Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:21.256065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:21.256127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:21.256164Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534284813683680:3639]
2025-10-02T08:12:21.256799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:21.257014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:21.257053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:21.257342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:21.257382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.257388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.257389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.257390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.257392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.257397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.257406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.257410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.257414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.257418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.257423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.257431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.257436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.257441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.257447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.257452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.257457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.257462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.257467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.257472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.257488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:21.265521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:21.267040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:21.267058Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:21.267061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:21.267065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:21.267071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1447 [1:7556534284813683680:3639]
2025-10-02T08:12:21.267083Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:21.267100Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:21.267108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.267112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.267114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.267129Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:21.267139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:21.267145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:21.267203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.267210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.267214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:21.267217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:21.267280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:21.267287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.267301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.267319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:21.267343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813683580:3640], now have 1 active actors on pipe
2025-10-02T08:12:21.267343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1447
2025-10-02T08:12:21.267349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534284813683674:3639]
2025-10-02T08:12:21.267352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534284813683674:3639]
2025-10-02T08:12:21.267363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:21.267373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534285273535074:2378], now have 1 active actors on pipe
2025-10-02T08:12:21.267376Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:21.267377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.267382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.267382Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:21.267399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:21.267413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:21.267416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:21.267457Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|777716ea-13722297-f8025fe9-3f00b187_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:21.267467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.267471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.267473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:21.267440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1447
2025-10-02T08:12:21.267481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.267493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:21.267508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534284813683674:3639]
2025-10-02T08:12:21.267522Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:21.267533Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:21.267554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.267622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.267630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.267643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.267683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1448 partition: 0 MaxSeqNo: 17 sessionId: src_id|777716ea-13722297-f8025fe9-3f00b187_0
2025-10-02T08:12:21.268034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace38e5c-db60d61f-852f6270-18ced407_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|777716ea-13722297-f8025fe9-3f00b187_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:21.270731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777716ea-13722297-f8025fe9-3f00b187_0] Write session: try to update token
2025-10-02T08:12:21.270750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777716ea-13722297-f8025fe9-3f00b187_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:21.284672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId: src_id|777716ea-13722297-f8025fe9-3f00b187_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:21.286239Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:21.286261Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:21.286264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:21.286273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534284813683674:3639]
2025-10-02T08:12:21.286278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534284813683674:3639]
2025-10-02T08:12:21.286320Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:21.286325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:21.286330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.286333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:21.286335Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:21.286514Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:21.287578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:21.336875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534284813683704:4654]
2025-10-02T08:12:21.336985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1447, pipe: [1:7556534284813683704:4654]
2025-10-02T08:12:21.411158Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:21.411713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.411730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.411769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813683704:4654], now have 1 active actors on pipe
2025-10-02T08:12:21.411917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534284813683704:4654]
2025-10-02T08:12:21.411951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:21.411953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:21.411967Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:21.411997Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:21.412014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1448 reason: error at write: Disconnected sessionId: src_id|777716ea-13722297-f8025fe9-3f00b187_0
2025-10-02T08:12:21.412213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1448 sessionId: src_id|777716ea-13722297-f8025fe9-3f00b187_0 is DEAD
2025-10-02T08:12:21.412358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777716ea-13722297-f8025fe9-3f00b187_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:21.412365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777716ea-13722297-f8025fe9-3f00b187_0] Write session will restart in 0.005910s
2025-10-02T08:12:21.412383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777716ea-13722297-f8025fe9-3f00b187_0] Write session: Do CDS request
2025-10-02T08:12:21.412388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777716ea-13722297-f8025fe9-3f00b187_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:21.419207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777716ea-13722297-f8025fe9-3f00b187_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.419287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:21.419300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1449
2025-10-02T08:12:21.419400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.419421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:21.419428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:21.419430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:21.419776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1449 sessionId:  describe result for acl check
2025-10-02T08:12:21.419799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:21.419800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:21.419801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:21.419804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534284813684089:3623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:21.420213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534284813684089:3623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:21.422410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534284813684089:3623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:21.425751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534284813684089:3623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:21.425772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534284813684089:3623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:21.425775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534284813684089:3623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:21.425783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:21.428839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:21.429211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:21.429374Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:21.429383Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:21.429392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:21.429437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:21.429471Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534284813684406:3630]
2025-10-02T08:12:21.430112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:21.430272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:21.430314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:21.430609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:21.430649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.430655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.430656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.430657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.430659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.430664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.430673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.430677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.430682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.430685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.430691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.430699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.430704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.430715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.430723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.430734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.430742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.430747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.430755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.430765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.430788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:21.438798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:21.440668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:21.440686Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:21.440689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:21.440693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:21.440700Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1448 [1:7556534284813684406:3630]
2025-10-02T08:12:21.440710Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:21.440724Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:21.440732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.440735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.440737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.440751Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:21.440761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:21.440773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:21.440845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.440852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.440855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:21.440857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:21.440923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:21.440932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.440945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.440946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1448
2025-10-02T08:12:21.440956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:21.440974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813684386:3623], now have 1 active actors on pipe
2025-10-02T08:12:21.440979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.440983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.440996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534285273535081:2378], now have 1 active actors on pipe
2025-10-02T08:12:21.441002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534284813684400:3630]
2025-10-02T08:12:21.441004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534284813684400:3630]
2025-10-02T08:12:21.441016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:21.441027Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:21.441031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:21.441035Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:21.441043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:21.441046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:21.441060Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:21.441070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.441039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1448
2025-10-02T08:12:21.441073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.441075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:21.441083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.441091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:21.441123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534284813684400:3630]
2025-10-02T08:12:21.441134Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:21.441137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:21.441149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.441202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.441212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.441225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.441262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1449 partition: 0 MaxSeqNo: 17 sessionId: src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0
2025-10-02T08:12:21.441563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777716ea-13722297-f8025fe9-3f00b187_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:21.444143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0] Write session: try to update token
2025-10-02T08:12:21.444157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:21.451658Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:21.451682Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:21.451690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534284813684400:3630]
2025-10-02T08:12:21.451733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:21.451737Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:21.451908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:21.452056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:21.452210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:21.452356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:21.452549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:21.452585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:21.457133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId: src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:21.459723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:21.459801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.459813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.459843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:21.459867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:21.459932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.459952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.460135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.460242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.460319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.460397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.460635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.460647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.460720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.460786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.460871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.460941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.460988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.460998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.461068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.461133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.461196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.461263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.461311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.461320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.461391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.461463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.461540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.461640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.461697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.461707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.461787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.461860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.461940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.462027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.462084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.462092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.462177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.462246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.462321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.462400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.462526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.462534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.462618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.462689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.462980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.463057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.463133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.463141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.463222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.463294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.463370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.463445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.463501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.463508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.463587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.463656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.463721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.463789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.463847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.463856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.463931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:21.463998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:21.464063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:21.464139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:21.464194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:21.464202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:21.464244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:21.464311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.464335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.464341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:21.464373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:21.464389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:21.464398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:21.464402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:21.464405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:21.464837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:21.464864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:21.464877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:21.464881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:21.464884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:21.464888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:21.465709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:21.465735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:21.465746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:21.465751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:21.465760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:21.465764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:21.466253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:21.466278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:21.466284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:21.466288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:21.466292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:21.467548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:21.467570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:21.467582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392741467
2025-10-02T08:12:21.467753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:21.467768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:21.467774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:21.467777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:21.467782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:21.467790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:21.468319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:21.468344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:21.468356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:21.468359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:21.468362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:21.468366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:21.468902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:21.468924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:21.468933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:21.468942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:21.468945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:21.468949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:21.469453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:21.469479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:21.469485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:21.470729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:21.470752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:21.470761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:21.470767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:21.470778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392741470
2025-10-02T08:12:21.471081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:21.471104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:21.471110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:21.471119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:21.471123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:21.471126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:21.471604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:21.471631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:21.471636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:21.471640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:21.471644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:21.471648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:21.472162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:21.472184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.472292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392741472
2025-10-02T08:12:21.473126Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:21.473148Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:21.473155Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:21.473162Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:21.474932Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:21.474952Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:21.474954Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:21.474964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534284813684400:3630]
2025-10-02T08:12:21.474968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534284813684400:3630]
2025-10-02T08:12:21.475032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:21.475040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:21.475044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.475046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:21.475047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:21.475195Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:21.512023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534284813684437:4654]
2025-10-02T08:12:21.512133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1448, pipe: [1:7556534284813684437:4654]
2025-10-02T08:12:21.627054Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:21.627419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813684437:4654], now have 1 active actors on pipe
2025-10-02T08:12:21.627571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534284813684437:4654]
2025-10-02T08:12:21.627599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:21.627601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:21.627640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1449 reason: error at write: Disconnected sessionId: src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0
2025-10-02T08:12:21.627681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:21.628100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:21.628112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0] Write session will restart in 0.006893s
2025-10-02T08:12:21.628135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0] Write session: Do CDS request
2025-10-02T08:12:21.628142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:21.627675Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:21.627816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1449 sessionId: src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0 is DEAD
2025-10-02T08:12:21.636330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.636399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:21.636420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1450
2025-10-02T08:12:21.636565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.636601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:21.636612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:21.636615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:21.637193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1450 sessionId:  describe result for acl check
2025-10-02T08:12:21.637228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:21.637230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:21.637231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:21.637236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534284813684828:3615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:21.637835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534284813684828:3615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:21.640441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534284813684828:3615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:21.643688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534284813684828:3615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:21.643706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534284813684828:3615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:21.643710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534284813684828:3615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:21.643718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:21.647976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:21.648278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:21.648444Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:21.648455Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:21.648465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:21.648517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:21.648553Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534284813685146:3611]
2025-10-02T08:12:21.649175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:21.649364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:21.649420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:21.649676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:21.649717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.649721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.649722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.649723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.649723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.649727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.649734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.649736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.649738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.649740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.649745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.649749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.649753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.649756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.649761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.649764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.649766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.649769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.649772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.649775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.649785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:21.657915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:21.659501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:21.659517Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:21.659519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:21.659523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:21.659529Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1449 [1:7556534284813685146:3611]
2025-10-02T08:12:21.659539Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:21.659554Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:21.659557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.659561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.659562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.659576Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:21.659581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:21.659586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:21.659654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.659661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.659663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:21.659665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:21.659732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:21.659739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.659751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.659767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:21.659787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813685091:3615], now have 1 active actors on pipe
2025-10-02T08:12:21.659794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534285273535090:2378], now have 1 active actors on pipe
2025-10-02T08:12:21.659794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1449
2025-10-02T08:12:21.659800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534284813685140:3611]
2025-10-02T08:12:21.659802Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534284813685140:3611]
2025-10-02T08:12:21.659839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:21.659858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:21.659860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:21.659860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:21.659874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:21.659877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:21.659883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.659888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.659921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534284813685140:3611]
2025-10-02T08:12:21.659929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:21.659902Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1449
2025-10-02T08:12:21.659942Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:21.659943Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:21.659948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.659952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.659954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:21.659961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.659969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:21.659998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.660047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.660054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.660068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.660112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1450 partition: 0 MaxSeqNo: 17 sessionId: src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0
2025-10-02T08:12:21.660487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eceafdab-b0f40774-212d1e9-1db6f59a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:21.663018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0] Write session: try to update token
2025-10-02T08:12:21.663033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:21.675916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId: src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:21.676604Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:21.676619Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:21.676620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:21.676630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534284813685140:3611]
2025-10-02T08:12:21.676632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534284813685140:3611]
2025-10-02T08:12:21.676664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:21.676669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.676668Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:21.676671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:21.676673Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:21.676798Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:21.678624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:21.730903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534284813685175:4654]
2025-10-02T08:12:21.731038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1449, pipe: [1:7556534284813685175:4654]
2025-10-02T08:12:21.812821Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:21.813422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.813434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.813474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813685175:4654], now have 1 active actors on pipe
2025-10-02T08:12:21.813647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534284813685175:4654]
2025-10-02T08:12:21.813680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:21.813688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:21.813699Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:21.813749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1450 reason: error at write: Disconnected sessionId: src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0
2025-10-02T08:12:21.813913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1450 sessionId: src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0 is DEAD
2025-10-02T08:12:21.814241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:21.814253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0] Write session will restart in 0.005297s
2025-10-02T08:12:21.814276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0] Write session: Do CDS request
2025-10-02T08:12:21.814285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:21.814373Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:21.820454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.820864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:21.820879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1451
2025-10-02T08:12:21.821925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:21.821960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:21.821965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:21.821968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:21.823129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1451 sessionId:  describe result for acl check
2025-10-02T08:12:21.823164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:21.823165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:21.823167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:21.823173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534284813685315:3600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:21.823647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534284813685315:3600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:21.832692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534284813685315:3600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:21.840908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534284813685315:3600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:21.840925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534284813685315:3600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:21.840928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534284813685315:3600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:21.840938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:21.855005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:21.856820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:21.857131Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:21.857145Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:21.857157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:21.857221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:21.857265Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534284813685881:3602]
2025-10-02T08:12:21.857898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:21.858207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:21.858258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:21.858605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:21.858653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.858654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.858655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.858656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.858657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.858663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.858673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.858677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.858680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.858684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.858690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.858697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:21.858702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.858707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:21.858711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.858716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:21.858721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.858726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.858730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.858735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.858752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:21.873548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:21.875779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:21.875797Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:21.875800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:21.875803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:21.875810Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1450 [1:7556534284813685881:3602]
2025-10-02T08:12:21.875821Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:21.875840Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:21.875843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.875845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.875847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.875862Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:21.875867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:21.875874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:21.875942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.875944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.875948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:21.875950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:21.876016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:21.876019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.876032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:21.876042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:21.876056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534284813685875:3602]
2025-10-02T08:12:21.876059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534284813685875:3602]
2025-10-02T08:12:21.876074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:21.876098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:21.876111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:21.876113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:21.876145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534284813685875:3602]
2025-10-02T08:12:21.876148Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:21.876177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534285273535096:2378], now have 1 active actors on pipe
2025-10-02T08:12:21.876214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:21.876218Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:21.876224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:21.876463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1450
2025-10-02T08:12:21.876477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813685575:3600], now have 1 active actors on pipe
2025-10-02T08:12:21.876530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.876534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.876558Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:21.876570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:21.876574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:21.876576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:21.876586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:21.876595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:21.876612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.876663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:21.876672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:21.876683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:21.876711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1451 partition: 0 MaxSeqNo: 17 sessionId: src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0
2025-10-02T08:12:21.876830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1450
2025-10-02T08:12:21.877079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5848e558-69d0b37f-b0f10e73-5c56f755_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:21.879931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0] Write session: try to update token
2025-10-02T08:12:21.879948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:21.898760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId: src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:21.900299Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:21.900302Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:21.900304Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:21.900313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534284813685875:3602]
2025-10-02T08:12:21.900318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534284813685875:3602]
2025-10-02T08:12:21.900366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:21.900366Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:21.900372Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:21.900373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:21.900375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:21.900525Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:21.901354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:21.913424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534284813685907:4654]
2025-10-02T08:12:21.914426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1450, pipe: [1:7556534284813685907:4654]
2025-10-02T08:12:22.040184Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:22.040539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.040553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.040582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534284813685907:4654], now have 1 active actors on pipe
2025-10-02T08:12:22.040639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534284813685907:4654]
2025-10-02T08:12:22.040654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:22.040658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:22.040694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1451 reason: error at write: Disconnected sessionId: src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0
2025-10-02T08:12:22.040752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:22.041117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:22.041141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0] Write session will restart in 0.009351s
2025-10-02T08:12:22.040748Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:22.040904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1451 sessionId: src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0 is DEAD
2025-10-02T08:12:22.041170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0] Write session: Do CDS request
2025-10-02T08:12:22.041178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:22.052305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.052353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:22.052374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1452
2025-10-02T08:12:22.052505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.052545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:22.052551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:22.052553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:22.052947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1452 sessionId:  describe result for acl check
2025-10-02T08:12:22.052975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:22.052981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:22.052982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:22.052986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534289108653806:3570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:22.053388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534289108653806:3570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:22.056102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534289108653806:3570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:22.058167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:22.058502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:22.058537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534289108653806:3570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:22.058541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534289108653806:3570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:22.058543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534289108653806:3570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:22.058548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:22.058679Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:22.058690Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:22.058699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:22.058758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:22.058802Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534289108653942:3574]
2025-10-02T08:12:22.059398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:22.059561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:22.059599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:22.059813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:22.059846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.059852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.059853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.059854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.059855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.059876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.059883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.059885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.059887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.059889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.059893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.059897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.059901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.059904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.059906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.059908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.059910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.059913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.059916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.059918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.059928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:22.067891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:22.069287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:22.069304Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:22.069306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:22.069309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:22.069314Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1451 [1:7556534289108653942:3574]
2025-10-02T08:12:22.069324Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:22.069336Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:22.069338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.069340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.069342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.069354Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:22.069361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:22.069365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:22.069411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.069416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.069418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:22.069420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:22.069469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:22.069474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.069482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.069493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:22.069504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534289108653932:3574]
2025-10-02T08:12:22.069508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534289108653932:3574]
2025-10-02T08:12:22.069514Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:22.069526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:22.069530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1451
2025-10-02T08:12:22.069538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:22.069540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:22.069544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:22.069547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:22.069550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108653940:3570], now have 1 active actors on pipe
2025-10-02T08:12:22.069581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534289568502422:2378], now have 1 active actors on pipe
2025-10-02T08:12:22.069589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534289108653932:3574]
2025-10-02T08:12:22.069597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:22.069604Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:22.069604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.069608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.069611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1451
2025-10-02T08:12:22.069645Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cceed4c4-427952d3-615832c6-e448a48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:22.069658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.069662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.069664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:22.069674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.069680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:22.069701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.069759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.069764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.069774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.069804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1452 partition: 0 MaxSeqNo: 17 sessionId: src_id|cceed4c4-427952d3-615832c6-e448a48_0
2025-10-02T08:12:22.070127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37844b1b-dac65067-9bf6c721-5a9ae4bc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cceed4c4-427952d3-615832c6-e448a48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:22.072665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cceed4c4-427952d3-615832c6-e448a48_0] Write session: try to update token
2025-10-02T08:12:22.072678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cceed4c4-427952d3-615832c6-e448a48_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:22.086830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId: src_id|cceed4c4-427952d3-615832c6-e448a48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:22.087567Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:22.087586Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:22.087588Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:22.087595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534289108653932:3574]
2025-10-02T08:12:22.087599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534289108653932:3574]
2025-10-02T08:12:22.087642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:22.087643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:22.087648Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:22.087653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.087655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:22.087806Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:22.089468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:22.140722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534289108653971:4654]
2025-10-02T08:12:22.140835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1451, pipe: [1:7556534289108653971:4654]
2025-10-02T08:12:22.217483Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:22.217932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.217948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.217986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108653971:4654], now have 1 active actors on pipe
2025-10-02T08:12:22.218084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534289108653971:4654]
2025-10-02T08:12:22.218105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:22.218471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cceed4c4-427952d3-615832c6-e448a48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:22.218484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cceed4c4-427952d3-615832c6-e448a48_0] Write session will restart in 0.005887s
2025-10-02T08:12:22.218107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:22.218154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1452 reason: error at write: Disconnected sessionId: src_id|cceed4c4-427952d3-615832c6-e448a48_0
2025-10-02T08:12:22.218222Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:22.218296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1452 sessionId: src_id|cceed4c4-427952d3-615832c6-e448a48_0 is DEAD
2025-10-02T08:12:22.218510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cceed4c4-427952d3-615832c6-e448a48_0] Write session: Do CDS request
2025-10-02T08:12:22.218520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cceed4c4-427952d3-615832c6-e448a48_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:22.218403Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:22.225298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cceed4c4-427952d3-615832c6-e448a48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.225372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:22.225399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1453
2025-10-02T08:12:22.225511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.225540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:22.225549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:22.225553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:22.225975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1453 sessionId:  describe result for acl check
2025-10-02T08:12:22.226012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:22.226021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:22.226022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:22.226028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534289108654283:3548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:22.226511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534289108654283:3548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:22.229531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534289108654283:3548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:22.233745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534289108654283:3548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:22.233761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534289108654283:3548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:22.233764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534289108654283:3548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:22.233773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:22.242513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:22.243889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:22.244056Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:22.244060Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:22.244068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:22.244135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:22.244169Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534289108654694:3544]
2025-10-02T08:12:22.244857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:22.245028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:22.245064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:22.245365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:22.245407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.245424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.245429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.245431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.245432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.245437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.245447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.245451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.245455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.245458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.245464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.245471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.245477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.245482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.245487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.245492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.245496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.245501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.245506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.245516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.245537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:22.253543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:22.255358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:22.255376Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:22.255378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:22.255382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:22.255389Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1452 [1:7556534289108654694:3544]
2025-10-02T08:12:22.255400Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:22.255414Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:22.255415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.255417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.255418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.255430Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:22.255434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:22.255440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:22.255488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.255497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.255500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:22.255502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:22.255546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:22.255552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.255560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.255570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:22.255587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534289108654688:3544]
2025-10-02T08:12:22.255593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534289108654688:3544]
2025-10-02T08:12:22.255601Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:22.255612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:22.255622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:22.255629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:22.255632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:22.255642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:22.255664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534289108654688:3544]
2025-10-02T08:12:22.255667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:22.255670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:22.255676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108654451:3548], now have 1 active actors on pipe
2025-10-02T08:12:22.255680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534289568502441:2378], now have 1 active actors on pipe
2025-10-02T08:12:22.255682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1452
2025-10-02T08:12:22.255700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.255704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.255728Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e31643f9-21223543-8b509cc7-d3123d8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:22.255741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.255744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.255746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:22.255755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.255764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:22.255784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.255767Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1452
2025-10-02T08:12:22.255826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.255841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.255866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.255906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1453 partition: 0 MaxSeqNo: 17 sessionId: src_id|e31643f9-21223543-8b509cc7-d3123d8e_0
2025-10-02T08:12:22.256242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cceed4c4-427952d3-615832c6-e448a48_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e31643f9-21223543-8b509cc7-d3123d8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:22.258754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e31643f9-21223543-8b509cc7-d3123d8e_0] Write session: try to update token
2025-10-02T08:12:22.258772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e31643f9-21223543-8b509cc7-d3123d8e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:22.273898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId: src_id|e31643f9-21223543-8b509cc7-d3123d8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:22.274375Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:22.274391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:22.274393Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:22.274400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534289108654688:3544]
2025-10-02T08:12:22.274403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534289108654688:3544]
2025-10-02T08:12:22.274437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:22.274445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.274447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:22.274574Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:22.274747Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:22.274766Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:22.276447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:22.316371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534289108654719:4654]
2025-10-02T08:12:22.316490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1452, pipe: [1:7556534289108654719:4654]
2025-10-02T08:12:22.404007Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:22.404227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.404238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.404266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108654719:4654], now have 1 active actors on pipe
2025-10-02T08:12:22.404348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:22.404356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:22.404406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1453 reason: error at write: Disconnected sessionId: src_id|e31643f9-21223543-8b509cc7-d3123d8e_0
2025-10-02T08:12:22.404488Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:22.404503Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:22.404575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1453 sessionId: src_id|e31643f9-21223543-8b509cc7-d3123d8e_0 is DEAD
2025-10-02T08:12:22.404720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e31643f9-21223543-8b509cc7-d3123d8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:22.404729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e31643f9-21223543-8b509cc7-d3123d8e_0] Write session will restart in 0.006754s
2025-10-02T08:12:22.404754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e31643f9-21223543-8b509cc7-d3123d8e_0] Write session: Do CDS request
2025-10-02T08:12:22.404745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534289108654719:4654]
2025-10-02T08:12:22.404775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e31643f9-21223543-8b509cc7-d3123d8e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:22.412304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e31643f9-21223543-8b509cc7-d3123d8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.412325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:22.412354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1454
2025-10-02T08:12:22.412518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.412549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:22.412560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:22.412563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:22.413047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1454 sessionId:  describe result for acl check
2025-10-02T08:12:22.413086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:22.413093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:22.413095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:22.413100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534289108655094:3529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:22.413572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534289108655094:3529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:22.416901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534289108655094:3529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:22.419868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534289108655094:3529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:22.419883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534289108655094:3529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:22.419887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534289108655094:3529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:22.419895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:22.423657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:22.423986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:22.424385Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:22.424401Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:22.424415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:22.424479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:22.424519Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534289108655434:3535]
2025-10-02T08:12:22.425141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:22.425333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:22.425379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:22.425680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:22.425747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.425755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.425756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.425757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.425758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.425763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.425772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.425776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.425779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.425783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.425788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.425795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.425800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.425804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.425813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.425818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.425822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.425826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.425829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.425834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.425857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:22.434043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:22.436101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:22.436135Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:22.436138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:22.436141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:22.436149Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1453 [1:7556534289108655434:3535]
2025-10-02T08:12:22.436166Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:22.436189Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:22.436193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.436196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.436198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.436221Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:22.436239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:22.436255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:22.436361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.436374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.436378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:22.436383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:22.436493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:22.436504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1453
2025-10-02T08:12:22.436507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.436527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.436549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:22.436583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108655398:3529], now have 1 active actors on pipe
2025-10-02T08:12:22.436595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534289568502448:2378], now have 1 active actors on pipe
2025-10-02T08:12:22.436602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.436609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.436634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534289108655428:3535]
2025-10-02T08:12:22.436656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534289108655428:3535]
2025-10-02T08:12:22.436614Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1453
2025-10-02T08:12:22.436667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:22.436672Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:22.436674Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:22.436688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:22.436706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:22.436710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:22.436739Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:22.436754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.436767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.436770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:22.436784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.436828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:22.436894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534289108655428:3535]
2025-10-02T08:12:22.436915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:22.436921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:22.436941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.437004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.437016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.437046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.437091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1454 partition: 0 MaxSeqNo: 17 sessionId: src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0
2025-10-02T08:12:22.437387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e31643f9-21223543-8b509cc7-d3123d8e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:22.440030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0] Write session: try to update token
2025-10-02T08:12:22.440046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:22.453185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId: src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:22.455596Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:22.455609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:22.455618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:22.455620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:22.455625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534289108655428:3535]
2025-10-02T08:12:22.455629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534289108655428:3535]
2025-10-02T08:12:22.455661Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:22.455662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:22.455666Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:22.455667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.455668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:22.455799Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:22.504776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534289108655459:4654]
2025-10-02T08:12:22.504914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1453, pipe: [1:7556534289108655459:4654]
2025-10-02T08:12:22.582275Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:22.582624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.582634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.582664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108655459:4654], now have 1 active actors on pipe
2025-10-02T08:12:22.582772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:22.582778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:22.582819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1454 reason: error at write: Disconnected sessionId: src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0
2025-10-02T08:12:22.582880Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:22.582844Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:22.582970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1454 sessionId: src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0 is DEAD
2025-10-02T08:12:22.583101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:22.583109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0] Write session will restart in 0.009968s
2025-10-02T08:12:22.583114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534289108655459:4654]
2025-10-02T08:12:22.583132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0] Write session: Do CDS request
2025-10-02T08:12:22.583139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:22.594243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.594369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:22.594384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1455
2025-10-02T08:12:22.594537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.594568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:22.594575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:22.594578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:22.594986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1455 sessionId:  describe result for acl check
2025-10-02T08:12:22.595017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:22.595023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:22.595024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:22.595029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534289108656012:3524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:22.595501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534289108656012:3524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:22.598672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534289108656012:3524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:22.600305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:22.601841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:22.602017Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:22.602036Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:22.602045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:22.602086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:22.602131Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534289108656172:3525]
2025-10-02T08:12:22.602222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534289108656012:3524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:22.602234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534289108656012:3524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:22.602236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534289108656012:3524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:22.602242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:22.602745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:22.602914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:22.602950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:22.603235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:22.603274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.603279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.603281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.603282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.603283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.603288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.603298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.603302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.603306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.603310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.603315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.603322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.603328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.603337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.603342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.603352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.603356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.603366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.603370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.603375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.603399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:22.610883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:22.612478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:22.612495Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:22.612497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:22.612501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:22.612507Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1454 [1:7556534289108656172:3525]
2025-10-02T08:12:22.612518Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:22.612536Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:22.612540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.612543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.612545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.612563Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:22.612572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:22.612579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:22.612630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.612637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.612640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:22.612643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:22.612699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:22.612705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.612717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.612729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:22.612748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534289108656166:3525]
2025-10-02T08:12:22.612754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534289108656166:3525]
2025-10-02T08:12:22.612762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:22.612761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1454
2025-10-02T08:12:22.612770Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:22.612772Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:22.612779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108656177:3524], now have 1 active actors on pipe
2025-10-02T08:12:22.612786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:22.612817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:22.612824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:22.612830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534289568502455:2378], now have 1 active actors on pipe
2025-10-02T08:12:22.612834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.612840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.612875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534289108656166:3525]
2025-10-02T08:12:22.612882Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:22.612856Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1454
2025-10-02T08:12:22.612891Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:22.612896Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e5740de-23e726c4-a31d1f24-de416eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:22.612902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.612906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.612909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:22.612917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.612926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:22.612974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.613062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.613071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.613082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.613119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1455 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e5740de-23e726c4-a31d1f24-de416eb_0
2025-10-02T08:12:22.613448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c19d77ad-bc7c1c09-10438218-cb151d9e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e5740de-23e726c4-a31d1f24-de416eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:22.615846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5740de-23e726c4-a31d1f24-de416eb_0] Write session: try to update token
2025-10-02T08:12:22.615862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5740de-23e726c4-a31d1f24-de416eb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:22.628902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId: src_id|2e5740de-23e726c4-a31d1f24-de416eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:22.629900Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:22.629916Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:22.629919Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:22.629928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534289108656166:3525]
2025-10-02T08:12:22.629931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534289108656166:3525]
2025-10-02T08:12:22.629970Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:22.629978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:22.629984Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:22.629986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.629988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:22.630133Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:22.631626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:22.683489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534289108656204:4654]
2025-10-02T08:12:22.683623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1454, pipe: [1:7556534289108656204:4654]
2025-10-02T08:12:22.768299Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:22.768825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.768844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.768880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108656204:4654], now have 1 active actors on pipe
2025-10-02T08:12:22.768972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:22.768979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:22.769027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1455 reason: error at write: Disconnected sessionId: src_id|2e5740de-23e726c4-a31d1f24-de416eb_0
2025-10-02T08:12:22.769058Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:22.769096Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:22.769193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1455 sessionId: src_id|2e5740de-23e726c4-a31d1f24-de416eb_0 is DEAD
2025-10-02T08:12:22.769341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534289108656204:4654]
2025-10-02T08:12:22.769367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5740de-23e726c4-a31d1f24-de416eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:22.769378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5740de-23e726c4-a31d1f24-de416eb_0] Write session will restart in 0.006602s
2025-10-02T08:12:22.769410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5740de-23e726c4-a31d1f24-de416eb_0] Write session: Do CDS request
2025-10-02T08:12:22.769417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5740de-23e726c4-a31d1f24-de416eb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:22.777256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5740de-23e726c4-a31d1f24-de416eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.777330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:22.777347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1456
2025-10-02T08:12:22.777446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.777475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:22.777484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:22.777487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:22.777866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1456 sessionId:  describe result for acl check
2025-10-02T08:12:22.777893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:22.777901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:22.777903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:22.777907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534289108656590:3510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:22.778388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534289108656590:3510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:22.781086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534289108656590:3510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:22.783747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534289108656590:3510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:22.783767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534289108656590:3510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:22.783769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534289108656590:3510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:22.783776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:22.788203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:22.788503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:22.788652Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:22.788661Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:22.788669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:22.788709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:22.788742Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534289108656923:3508]
2025-10-02T08:12:22.789368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:22.789541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:22.789584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:22.789879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:22.789915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.789921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.789922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.789923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.789924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.789929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.789939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.789943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.789947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.789950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.789955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.789963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.789974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.789979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.789989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.789994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.789998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.790003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.790007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.790012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.790033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:22.797766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:22.799238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:22.799261Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:22.799264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:22.799269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:22.799275Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1455 [1:7556534289108656923:3508]
2025-10-02T08:12:22.799288Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:22.799303Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:22.799306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.799309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.799310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.799326Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:22.799338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:22.799348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:22.799415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.799421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.799425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:22.799428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:22.799501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:22.799512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.799525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.799537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:22.799538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1455
2025-10-02T08:12:22.799555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108656855:3510], now have 1 active actors on pipe
2025-10-02T08:12:22.799558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534289568502464:2378], now have 1 active actors on pipe
2025-10-02T08:12:22.799563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.799566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.799582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534289108656917:3508]
2025-10-02T08:12:22.799589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534289108656917:3508]
2025-10-02T08:12:22.799602Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:22.799619Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:22.799622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:22.799629Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:22.799636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:22.799639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:22.799628Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1455
2025-10-02T08:12:22.799653Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:22.799663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.799667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.799669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:22.799677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.799690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:22.799881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534289108656917:3508]
2025-10-02T08:12:22.799898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:22.799903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:22.799920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.799971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.799978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.799992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.800032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1456 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0
2025-10-02T08:12:22.800354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e5740de-23e726c4-a31d1f24-de416eb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:22.802993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0] Write session: try to update token
2025-10-02T08:12:22.803009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:22.811541Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:22.811565Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:22.811573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534289108656917:3508]
2025-10-02T08:12:22.811604Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:22.811612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:22.811794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:22.811936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:22.812071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:22.812215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:22.812394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:22.812435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:22.816562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId: src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:22.819075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:22.819143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.819158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.819191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:22.819211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:22.819443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.819460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.819630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.819692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.819757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.819846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.820236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.820250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.820316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.820378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.820440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.820506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.820550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.820558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.820628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.820689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.820749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.820829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.820873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.820881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.820946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.821011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.821080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.821150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.821205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.821214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.821289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.821356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.821425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.821497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.821565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.821574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.821650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.821737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.821808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.821882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.821951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.821958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.822035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.822103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.822177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.822248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.822316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.822323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.822398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.822465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.822535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.822608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.822661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.822668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.822743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.822808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.822878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.822941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.822993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.823001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.823072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:22.823141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:22.823208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:22.823281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:22.823333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:22.823341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:22.823388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:22.823458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.823482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.823489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:22.823523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:22.823540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:22.823548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:22.823552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:22.823559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:22.823965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:22.823993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:22.824004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:22.824008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:22.824016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:22.824020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:22.824676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:22.824703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:22.824718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:22.824726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:22.824730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:22.824738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:22.825354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:22.825383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:22.825395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:22.825403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:22.825406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:22.833052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:22.833082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:22.833098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392742832
2025-10-02T08:12:22.833273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:22.833293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:22.833305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:22.833316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:22.833326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:22.833329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:22.833829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:22.833854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:22.833860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:22.833864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:22.833872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:22.833879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:22.834354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:22.834378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:22.834394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:22.834401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:22.834406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:22.834409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:22.834875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:22.834897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:22.834903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:22.836030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:22.836053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:22.836058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:22.836069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:22.836091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392742835
2025-10-02T08:12:22.836398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:22.836421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:22.836432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:22.836436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:22.836440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:22.836443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:22.836937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:22.836960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:22.836970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:22.836975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:22.836982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:22.836986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:22.837426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:22.837449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.837550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392742837
2025-10-02T08:12:22.838297Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:22.838319Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:22.838325Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:22.838334Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:22.839808Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:22.839821Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:22.839822Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:22.839831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534289108656917:3508]
2025-10-02T08:12:22.839834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534289108656917:3508]
2025-10-02T08:12:22.839872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:22.839879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:22.839882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.839884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:22.839884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:22.840010Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:22.869331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534289108656954:4654]
2025-10-02T08:12:22.869458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1455, pipe: [1:7556534289108656954:4654]
2025-10-02T08:12:22.967393Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:22.967990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108656954:4654], now have 1 active actors on pipe
2025-10-02T08:12:22.968132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:22.968147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:22.968176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1456 reason: error at write: Disconnected sessionId: src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0
2025-10-02T08:12:22.968215Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:22.968234Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:22.968342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1456 sessionId: src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0 is DEAD
2025-10-02T08:12:22.968503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:22.968512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0] Write session will restart in 0.007315s
2025-10-02T08:12:22.968528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0] Write session: Do CDS request
2025-10-02T08:12:22.968533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:22.968530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534289108656954:4654]
2025-10-02T08:12:22.977185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.977238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:22.977253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1457
2025-10-02T08:12:22.977417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:22.977444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:22.977453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:22.977456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:22.977763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1457 sessionId:  describe result for acl check
2025-10-02T08:12:22.977790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:22.977795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:22.977797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:22.977802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534289108657431:3489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:22.978335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534289108657431:3489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:22.980435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534289108657431:3489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:22.983535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534289108657431:3489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:22.983552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534289108657431:3489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:22.983555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534289108657431:3489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:22.983562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:22.984758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:22.985085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:22.985226Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:22.985235Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:22.985243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:22.985285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:22.985316Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534289108657685:3503]
2025-10-02T08:12:22.985898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:22.986044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:22.986085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:22.986366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:22.986403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.986409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.986410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.986411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.986412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.986417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.986425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.986434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.986438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.986446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.986450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.986461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:22.986466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.986471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:22.986475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.986485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:22.986490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.986498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.986506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.986514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.986532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:22.994424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:22.996019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:22.996036Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:22.996038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:22.996041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:22.996046Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1456 [1:7556534289108657685:3503]
2025-10-02T08:12:22.996055Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:22.996070Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:22.996074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.996076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.996078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.996103Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:22.996107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:22.996113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:22.996171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.996179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.996182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:22.996185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:22.996244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:22.996253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:22.996265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:22.996275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:22.996293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534289108657675:3489], now have 1 active actors on pipe
2025-10-02T08:12:22.996299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534289108657679:3503]
2025-10-02T08:12:22.996301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534289108657679:3503]
2025-10-02T08:12:22.996311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:22.996325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534289568502471:2378], now have 1 active actors on pipe
2025-10-02T08:12:22.996326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:22.996329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:22.996336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:22.996351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:22.996357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:22.996384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534289108657679:3503]
2025-10-02T08:12:22.996391Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:22.996398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:22.996379Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1456
2025-10-02T08:12:22.996513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1456
2025-10-02T08:12:22.996674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.996684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.996704Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9391137f-2f76d36c-d0ebb909-23151515_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:22.996715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:22.996721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:22.996723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:22.996732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:22.996743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:22.996761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.996824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:22.996829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:22.996841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:22.996871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1457 partition: 0 MaxSeqNo: 17 sessionId: src_id|9391137f-2f76d36c-d0ebb909-23151515_0
2025-10-02T08:12:22.997149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba9c505-4b8faf6-3e0e58c-ffdc16ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9391137f-2f76d36c-d0ebb909-23151515_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:22.999650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9391137f-2f76d36c-d0ebb909-23151515_0] Write session: try to update token
2025-10-02T08:12:22.999665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9391137f-2f76d36c-d0ebb909-23151515_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:23.007396Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:23.007424Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:23.007432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534289108657679:3503]
2025-10-02T08:12:23.007474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:23.007478Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:23.007653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:23.007797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:23.007919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:23.008040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:23.008497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:23.008531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:23.012923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId: src_id|9391137f-2f76d36c-d0ebb909-23151515_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:23.015351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:23.015412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.015423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.015449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:23.015468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:23.015524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.015542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.015711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.015773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.015835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.015911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.016150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.016162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.016321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.016384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.016450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.016516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.016567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.016576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.016640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.016705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.016776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.016886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.016940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.016947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.017023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.017093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.017166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.017238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.017292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.017300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.017377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.017457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.017527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.017596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.017699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.017708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.017783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.017849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.017921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.017990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.018043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.018052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.018128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.018194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.018266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.018334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.018389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.018396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.018470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.018528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.018588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.018647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.018699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.018706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.018777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.018842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.018903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.018978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.019031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.019037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.019110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.019172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.019238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.019298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.019350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.019358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.019397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:23.019454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.019477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.019484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:23.019513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:23.019532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:23.019541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:23.019548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:23.019551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:23.019932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:23.019957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:23.019969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:23.019977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:23.019985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:23.019992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:23.020495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:23.020519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:23.020532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:23.020539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:23.020541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:23.020545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:23.021129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:23.021153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:23.021159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:23.021162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:23.021165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:23.022329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:23.022347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:23.022358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392743022
2025-10-02T08:12:23.022521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:23.022536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:23.022541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:23.022544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:23.022549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:23.022556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:23.023051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:23.023073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:23.023078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:23.023081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:23.023084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:23.023089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:23.023537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:23.023556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:23.023561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:23.023566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:23.023571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:23.023574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:23.024016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:23.024036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:23.024041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:23.025168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:23.025185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:23.025190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:23.025193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:23.025200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392743024
2025-10-02T08:12:23.025484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:23.025504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:23.025509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:23.025512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:23.025516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:23.025519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:23.025955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:23.025977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:23.025982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:23.025986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:23.025989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:23.025992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:23.026443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:23.026465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.026568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392743026
2025-10-02T08:12:23.027278Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:23.027297Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:23.027310Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:23.027321Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:23.028932Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:23.028944Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:23.028946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:23.028956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534289108657679:3503]
2025-10-02T08:12:23.028959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534289108657679:3503]
2025-10-02T08:12:23.029011Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:23.029019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:23.029023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.029024Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:23.029025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:23.029159Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:23.068494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534293403625028:4654]
2025-10-02T08:12:23.068591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1456, pipe: [1:7556534293403625028:4654]
2025-10-02T08:12:23.174167Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:23.174534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403625028:4654], now have 1 active actors on pipe
2025-10-02T08:12:23.174642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534293403625028:4654]
2025-10-02T08:12:23.174660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:23.174663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:23.174685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1457 reason: error at write: Disconnected sessionId: src_id|9391137f-2f76d36c-d0ebb909-23151515_0
2025-10-02T08:12:23.174715Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:23.174764Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:23.174839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1457 sessionId: src_id|9391137f-2f76d36c-d0ebb909-23151515_0 is DEAD
2025-10-02T08:12:23.175006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9391137f-2f76d36c-d0ebb909-23151515_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:23.175016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9391137f-2f76d36c-d0ebb909-23151515_0] Write session will restart in 0.005995s
2025-10-02T08:12:23.175039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9391137f-2f76d36c-d0ebb909-23151515_0] Write session: Do CDS request
2025-10-02T08:12:23.175045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9391137f-2f76d36c-d0ebb909-23151515_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:23.182201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9391137f-2f76d36c-d0ebb909-23151515_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.182327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:23.182347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1458
2025-10-02T08:12:23.182465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.182495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:23.182503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:23.182507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:23.182933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1458 sessionId:  describe result for acl check
2025-10-02T08:12:23.182972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:23.182979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:23.182981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:23.182986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534293403625438:3470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:23.183459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534293403625438:3470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:23.186236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534293403625438:3470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:23.189283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534293403625438:3470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:23.189297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534293403625438:3470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:23.189300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534293403625438:3470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:23.189304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:23.192383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:23.192647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:23.192766Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:23.192773Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:23.192780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:23.192819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:23.192845Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534293403625757:3471]
2025-10-02T08:12:23.193239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:23.193353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:23.193384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:23.193570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:23.193595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.193599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.193599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.193600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.193600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.193603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.193609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.193611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.193613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.193615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.193618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.193622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.193626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.193629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.193631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.193633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.193636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.193638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.193641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.193643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.193653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:23.201001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:23.202552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:23.202572Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:23.202575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:23.202578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:23.202584Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1457 [1:7556534293403625757:3471]
2025-10-02T08:12:23.202594Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:23.202609Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:23.202612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.202615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.202617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.202631Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:23.202636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:23.202642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:23.202693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.202701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.202704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:23.202706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:23.202762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:23.202769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.202780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.202791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:23.202811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403625728:3470], now have 1 active actors on pipe
2025-10-02T08:12:23.202821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534293403625751:3471]
2025-10-02T08:12:23.202823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534293403625751:3471]
2025-10-02T08:12:23.202830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1457
2025-10-02T08:12:23.202831Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:23.202841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:23.202841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:23.202844Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:23.202853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:23.202858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:23.202863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534293863469810:2378], now have 1 active actors on pipe
2025-10-02T08:12:23.202867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.202873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.202903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534293403625751:3471]
2025-10-02T08:12:23.202909Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:23.202919Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:23.202926Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9164ccc6-200140cd-364f3401-eb708a67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:23.202937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.202941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.202947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:23.202956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.202928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1457
2025-10-02T08:12:23.202968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:23.203007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.203052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.203056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.203068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.203097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1458 partition: 0 MaxSeqNo: 17 sessionId: src_id|9164ccc6-200140cd-364f3401-eb708a67_0
2025-10-02T08:12:23.203417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9391137f-2f76d36c-d0ebb909-23151515_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9164ccc6-200140cd-364f3401-eb708a67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:23.206088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9164ccc6-200140cd-364f3401-eb708a67_0] Write session: try to update token
2025-10-02T08:12:23.206103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9164ccc6-200140cd-364f3401-eb708a67_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:23.219040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId: src_id|9164ccc6-200140cd-364f3401-eb708a67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:23.220388Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:23.220405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:23.220408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:23.220416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534293403625751:3471]
2025-10-02T08:12:23.220419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534293403625751:3471]
2025-10-02T08:12:23.220459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:23.220458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:23.220464Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:23.220471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.220473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:23.220608Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:23.221465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:23.274831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534293403625795:4654]
2025-10-02T08:12:23.274923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1457, pipe: [1:7556534293403625795:4654]
2025-10-02T08:12:23.355204Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:23.355854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.355870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.355906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403625795:4654], now have 1 active actors on pipe
2025-10-02T08:12:23.355994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:23.356007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:23.356065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1458 reason: error at write: Disconnected sessionId: src_id|9164ccc6-200140cd-364f3401-eb708a67_0
2025-10-02T08:12:23.356122Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:23.356272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1458 sessionId: src_id|9164ccc6-200140cd-364f3401-eb708a67_0 is DEAD
2025-10-02T08:12:23.356413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9164ccc6-200140cd-364f3401-eb708a67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:23.356420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9164ccc6-200140cd-364f3401-eb708a67_0] Write session will restart in 0.009661s
2025-10-02T08:12:23.356445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9164ccc6-200140cd-364f3401-eb708a67_0] Write session: Do CDS request
2025-10-02T08:12:23.356450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9164ccc6-200140cd-364f3401-eb708a67_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:23.356549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534293403625795:4654]
2025-10-02T08:12:23.356606Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:23.367237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9164ccc6-200140cd-364f3401-eb708a67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.367278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:23.367296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1459
2025-10-02T08:12:23.367397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.367427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:23.367437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:23.367444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:23.367859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1459 sessionId:  describe result for acl check
2025-10-02T08:12:23.367888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:23.367894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:23.367895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:23.367899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534293403626404:3455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:23.368389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534293403626404:3455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:23.370418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534293403626404:3455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:23.372062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:23.372363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:23.372586Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:23.372599Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:23.372611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:23.372674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:23.372686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534293403626404:3455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:23.372700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534293403626404:3455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:23.372707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534293403626404:3455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:23.372711Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534293403626509:3452]
2025-10-02T08:12:23.372715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:23.373302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:23.373490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:23.373533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:23.373811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:23.373870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.373880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.373881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.373882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.373883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.373888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.373896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.373899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.373902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.373905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.373911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.373917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.373922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.373926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.373930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.373935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.373939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.373943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.373952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.373961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.373981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:23.381752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:23.383443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:23.383466Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:23.383468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:23.383472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:23.383478Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1458 [1:7556534293403626509:3452]
2025-10-02T08:12:23.383490Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:23.383510Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:23.383517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.383519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.383521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.383537Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:23.383541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:23.383554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:23.383634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.383641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.383648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:23.383650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:23.383712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:23.383722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.383734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.383743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:23.383760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403626514:3455], now have 1 active actors on pipe
2025-10-02T08:12:23.383762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1458
2025-10-02T08:12:23.383767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534293863469817:2378], now have 1 active actors on pipe
2025-10-02T08:12:23.383772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534293403626503:3452]
2025-10-02T08:12:23.383774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534293403626503:3452]
2025-10-02T08:12:23.383784Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:23.383794Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:23.383798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.383802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.383812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:23.383817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:23.383830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:23.383833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:23.383872Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|373c6558-3213b4f9-4b841c60-42a7787c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:23.383883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.383860Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1458
2025-10-02T08:12:23.383891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.383892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:23.383900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.383907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:23.383914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534293403626503:3452]
2025-10-02T08:12:23.383924Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:23.383939Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:23.383960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.384013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.384019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.384031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.384067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1459 partition: 0 MaxSeqNo: 17 sessionId: src_id|373c6558-3213b4f9-4b841c60-42a7787c_0
2025-10-02T08:12:23.384398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9164ccc6-200140cd-364f3401-eb708a67_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|373c6558-3213b4f9-4b841c60-42a7787c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:23.386955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|373c6558-3213b4f9-4b841c60-42a7787c_0] Write session: try to update token
2025-10-02T08:12:23.386969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|373c6558-3213b4f9-4b841c60-42a7787c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:23.399855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId: src_id|373c6558-3213b4f9-4b841c60-42a7787c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:23.400716Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:23.400734Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:23.400736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:23.400744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534293403626503:3452]
2025-10-02T08:12:23.400749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534293403626503:3452]
2025-10-02T08:12:23.400786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:23.400790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.400792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:23.400820Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:23.400837Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:23.400930Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:23.402390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:23.456579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534293403626541:4654]
2025-10-02T08:12:23.456683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1458, pipe: [1:7556534293403626541:4654]
2025-10-02T08:12:23.541529Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:23.541814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.541826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.541859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403626541:4654], now have 1 active actors on pipe
2025-10-02T08:12:23.541952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:23.541965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:23.542033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1459 reason: error at write: Disconnected sessionId: src_id|373c6558-3213b4f9-4b841c60-42a7787c_0
2025-10-02T08:12:23.542124Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:23.542191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1459 sessionId: src_id|373c6558-3213b4f9-4b841c60-42a7787c_0 is DEAD
2025-10-02T08:12:23.542316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373c6558-3213b4f9-4b841c60-42a7787c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:23.542326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373c6558-3213b4f9-4b841c60-42a7787c_0] Write session will restart in 0.006303s
2025-10-02T08:12:23.542349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373c6558-3213b4f9-4b841c60-42a7787c_0] Write session: Do CDS request
2025-10-02T08:12:23.542354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373c6558-3213b4f9-4b841c60-42a7787c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:23.542345Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:23.542362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534293403626541:4654]
2025-10-02T08:12:23.549173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|373c6558-3213b4f9-4b841c60-42a7787c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.549268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:23.549282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1460
2025-10-02T08:12:23.549387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.549413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:23.549419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:23.549422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:23.549822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1460 sessionId:  describe result for acl check
2025-10-02T08:12:23.549848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:23.549849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:23.549850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:23.549854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534293403626934:3439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:23.550288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534293403626934:3439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:23.552398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534293403626934:3439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:23.555105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534293403626934:3439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:23.555113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534293403626934:3439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:23.555115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534293403626934:3439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:23.555119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:23.558958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:23.559197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:23.559303Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:23.559309Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:23.559315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:23.559342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:23.559367Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534293403627268:3438]
2025-10-02T08:12:23.559753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:23.559862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:23.559885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:23.560074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:23.560122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.560127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.560128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.560128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.560129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.560132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.560137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.560139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.560141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.560143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.560147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.560151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.560154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.560157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.560159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.560162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.560164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.560167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.560169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.560171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.560182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:23.567558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:23.568957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:23.568967Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:23.568968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:23.568971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:23.568975Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1459 [1:7556534293403627268:3438]
2025-10-02T08:12:23.568983Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:23.568996Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:23.568998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.569000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.569001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.569012Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:23.569015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:23.569021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:23.569060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.569066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.569068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:23.569070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:23.569113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:23.569118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.569128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.569134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:23.569147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534293403627262:3438]
2025-10-02T08:12:23.569152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534293403627262:3438]
2025-10-02T08:12:23.569159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:23.569170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:23.569171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:23.569176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:23.569182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:23.569184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:23.569192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534293863469824:2378], now have 1 active actors on pipe
2025-10-02T08:12:23.569196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1459
2025-10-02T08:12:23.569197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403627195:3439], now have 1 active actors on pipe
2025-10-02T08:12:23.569228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.569235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.569248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534293403627262:3438]
2025-10-02T08:12:23.569258Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:23.569268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:23.569287Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:23.569297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.569300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.569301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:23.569280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1459
2025-10-02T08:12:23.569310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.569322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:23.569347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.569381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.569385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.569395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.569425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1460 partition: 0 MaxSeqNo: 17 sessionId: src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0
2025-10-02T08:12:23.569730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|373c6558-3213b4f9-4b841c60-42a7787c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:23.572270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0] Write session: try to update token
2025-10-02T08:12:23.572286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:23.585828Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:23.585843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:23.585846Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:23.585853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534293403627262:3438]
2025-10-02T08:12:23.585857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534293403627262:3438]
2025-10-02T08:12:23.585896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:23.585906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.585912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:23.585962Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:23.585975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:23.586031Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:23.586061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId: src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:23.588406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:23.642413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534293403627294:4654]
2025-10-02T08:12:23.642488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1459, pipe: [1:7556534293403627294:4654]
2025-10-02T08:12:23.725172Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:23.725434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.725443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.725475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403627294:4654], now have 1 active actors on pipe
2025-10-02T08:12:23.725586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534293403627294:4654]
2025-10-02T08:12:23.725617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:23.725624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:23.725680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1460 reason: error at write: Disconnected sessionId: src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0
2025-10-02T08:12:23.725701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:23.725812Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:23.725854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1460 sessionId: src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0 is DEAD
2025-10-02T08:12:23.725970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:23.725978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0] Write session will restart in 0.005488s
2025-10-02T08:12:23.726003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0] Write session: Do CDS request
2025-10-02T08:12:23.726009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:23.732240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.732309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:23.732321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1461
2025-10-02T08:12:23.732431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.732459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:23.732467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:23.732470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:23.732775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1461 sessionId:  describe result for acl check
2025-10-02T08:12:23.732799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:23.733122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:23.733124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:23.733128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534293403627653:3427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:23.733502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534293403627653:3427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:23.735904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534293403627653:3427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:23.738826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534293403627653:3427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:23.738835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534293403627653:3427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:23.738837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534293403627653:3427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:23.738843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:23.744124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:23.744454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:23.744610Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:23.744621Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:23.744631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:23.744679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:23.744713Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534293403628026:3423]
2025-10-02T08:12:23.745340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:23.745527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:23.745571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:23.745853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:23.745909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.745915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.745916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.745917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.745918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.745922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.745930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.745933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.745936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.745939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.745944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.745950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.745955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.745959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.745963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.745967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.745971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.745975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.745978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.745982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.745998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:23.753469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:23.754893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:23.754908Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:23.754911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:23.754914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:23.754920Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1460 [1:7556534293403628026:3423]
2025-10-02T08:12:23.754931Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:23.754945Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:23.754946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.754948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.754949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.754960Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:23.754966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:23.754971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:23.755014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.755021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.755023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:23.755025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:23.755081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:23.755087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.755099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.755106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:23.755122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534293863469832:2378], now have 1 active actors on pipe
2025-10-02T08:12:23.755128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403627917:3427], now have 1 active actors on pipe
2025-10-02T08:12:23.755132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534293403628020:3423]
2025-10-02T08:12:23.755133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534293403628020:3423]
2025-10-02T08:12:23.755140Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:23.755150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:23.755150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:23.755153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:23.755161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:23.755163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:23.755170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.755174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.755208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534293403628020:3423]
2025-10-02T08:12:23.755183Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1460
2025-10-02T08:12:23.755215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:23.755228Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:23.755230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:23.755233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.755236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.755237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:23.755242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.755252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:23.755282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.755325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1460
2025-10-02T08:12:23.755365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.755369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.755379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.755410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1461 partition: 0 MaxSeqNo: 17 sessionId: src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0
2025-10-02T08:12:23.755688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e3db36c-4c88b375-9bf79f5c-e7021c33_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:23.758180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0] Write session: try to update token
2025-10-02T08:12:23.758198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:23.765534Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:23.765551Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:23.765561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534293403628020:3423]
2025-10-02T08:12:23.765596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:23.765652Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:23.765751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:23.765876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:23.766013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:23.766141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:23.766310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:23.766347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:23.770692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId: src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:23.773001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:23.773078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.773087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.773119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:23.773140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:23.773189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.773194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.773324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.773385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.773439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.773495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.773535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.773542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.773603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.773661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.773716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.773770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.774151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.774162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.774225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.774277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.774377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.774435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.774473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.774478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.774534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.774593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.774662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.774725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.774770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.774774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.774843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.774910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.774975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.775063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.775110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.775117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.775196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.775255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.775327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.775394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.775458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.775464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.775532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.775600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.775666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.775735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.775781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.775786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.775856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.775940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.776004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.776070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.776136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.776141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.776215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.776272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.776325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.776390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.776455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.776462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.776530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:23.776596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:23.776658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:23.776719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:23.776771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:23.776777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:23.776828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:23.776891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.776913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.776919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:23.776948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:23.776966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:23.776973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:23.776975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:23.776978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:23.777372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:23.777395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:23.777400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:23.777407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:23.777408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:23.777411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:23.777865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:23.777882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:23.777886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:23.777888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:23.777890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:23.777892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:23.778304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:23.778319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:23.778322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:23.778324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:23.778326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:23.779429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:23.779443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:23.779451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392743779
2025-10-02T08:12:23.779699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:23.779710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:23.779713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:23.779715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:23.779718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:23.779720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:23.780238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:23.780255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:23.780260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:23.780264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:23.780267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:23.780271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:23.780727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:23.780745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:23.780751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:23.780753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:23.780755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:23.780757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:23.781258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:23.781278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:23.781283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:23.782393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:23.782408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:23.782412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:23.782416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:23.782421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392743782
2025-10-02T08:12:23.782682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:23.782698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:23.782703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:23.782706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:23.782711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:23.782720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:23.783161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:23.783178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:23.783182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:23.783185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:23.783188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:23.783190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:23.783629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:23.783645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.783714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392743783
2025-10-02T08:12:23.784420Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:23.784433Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:23.784437Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:23.784441Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:23.786017Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:23.786027Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:23.786028Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:23.786035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534293403628020:3423]
2025-10-02T08:12:23.786038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534293403628020:3423]
2025-10-02T08:12:23.786079Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:23.786085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:23.786090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.786090Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:23.786091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:23.786222Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:23.825764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534293403628058:4654]
2025-10-02T08:12:23.825856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1460, pipe: [1:7556534293403628058:4654]
2025-10-02T08:12:23.911192Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:23.911509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403628058:4654], now have 1 active actors on pipe
2025-10-02T08:12:23.911626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534293403628058:4654]
2025-10-02T08:12:23.911644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:23.911646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:23.911669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1461 reason: error at write: Disconnected sessionId: src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0
2025-10-02T08:12:23.911673Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:23.911794Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:23.911824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1461 sessionId: src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0 is DEAD
2025-10-02T08:12:23.911957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:23.911966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0] Write session will restart in 0.005905s
2025-10-02T08:12:23.911990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0] Write session: Do CDS request
2025-10-02T08:12:23.911997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:23.919243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.919309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:23.919322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1462
2025-10-02T08:12:23.919412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:23.919439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:23.919448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:23.919451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:23.919871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1462 sessionId:  describe result for acl check
2025-10-02T08:12:23.919896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:23.919901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:23.919902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:23.919905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534293403628445:3418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:23.920274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534293403628445:3418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:23.922761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534293403628445:3418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:23.925289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534293403628445:3418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:23.925302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534293403628445:3418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:23.925305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534293403628445:3418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:23.925312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:23.928234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:23.929592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:23.929748Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:23.929754Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:23.929761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:23.929790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:23.929814Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534293403628786:3419]
2025-10-02T08:12:23.930200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:23.930338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:23.930364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:23.930549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:23.930573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.930577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.930578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.930578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.930579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.930582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.930588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.930590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.930592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.930594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.930598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.930605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:23.930608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.930615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:23.930617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.930620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:23.930622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.930625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.930627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.930629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.930640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:23.938029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:23.939628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:23.939640Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:23.939641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:23.939644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:23.939648Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1461 [1:7556534293403628786:3419]
2025-10-02T08:12:23.939655Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:23.939667Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:23.939669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.939670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.939672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.939683Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:23.939689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:23.939693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:23.939733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.939738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.939740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:23.939742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:23.939784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:23.939790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.939801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:23.939816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:23.939835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534293403628780:3419]
2025-10-02T08:12:23.939840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534293403628780:3419]
2025-10-02T08:12:23.939848Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:23.939862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:23.939875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1461
2025-10-02T08:12:23.939878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:23.939880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:23.939881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:23.939882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:23.939890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534293403628711:3418], now have 1 active actors on pipe
2025-10-02T08:12:23.939915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534293403628780:3419]
2025-10-02T08:12:23.939922Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:23.939927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534293863469841:2378], now have 1 active actors on pipe
2025-10-02T08:12:23.939934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.939938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.939975Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73ec19c8-19db831-daf7df90-fed32eed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:23.939984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:23.939991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:23.939993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:23.940001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:23.940011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:23.940016Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:23.940029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.940130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:23.940137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:23.940110Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1461
2025-10-02T08:12:23.940158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:23.940194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1462 partition: 0 MaxSeqNo: 17 sessionId: src_id|73ec19c8-19db831-daf7df90-fed32eed_0
2025-10-02T08:12:23.940490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85b0d79-daa7aff4-c4f446b1-a824c737_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|73ec19c8-19db831-daf7df90-fed32eed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:23.942966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ec19c8-19db831-daf7df90-fed32eed_0] Write session: try to update token
2025-10-02T08:12:23.942980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ec19c8-19db831-daf7df90-fed32eed_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:23.955968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId: src_id|73ec19c8-19db831-daf7df90-fed32eed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:23.957107Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:23.957118Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:23.957120Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:23.957126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534293403628780:3419]
2025-10-02T08:12:23.957130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534293403628780:3419]
2025-10-02T08:12:23.957162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:23.957162Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:23.957167Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:23.957172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:23.957175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:23.957305Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:23.958446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:24.013993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534297698596112:4654]
2025-10-02T08:12:24.014101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1461, pipe: [1:7556534297698596112:4654]
2025-10-02T08:12:24.082352Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:24.082616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.082625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.082653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698596112:4654], now have 1 active actors on pipe
2025-10-02T08:12:24.082703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:24.082710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:24.082742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1462 reason: error at write: Disconnected sessionId: src_id|73ec19c8-19db831-daf7df90-fed32eed_0
2025-10-02T08:12:24.082820Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:24.082976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ec19c8-19db831-daf7df90-fed32eed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:24.082981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ec19c8-19db831-daf7df90-fed32eed_0] Write session will restart in 0.009476s
2025-10-02T08:12:24.083014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ec19c8-19db831-daf7df90-fed32eed_0] Write session: Do CDS request
2025-10-02T08:12:24.083020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ec19c8-19db831-daf7df90-fed32eed_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:24.082840Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:24.082878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1462 sessionId: src_id|73ec19c8-19db831-daf7df90-fed32eed_0 is DEAD
2025-10-02T08:12:24.082978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534297698596112:4654]
2025-10-02T08:12:24.093199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73ec19c8-19db831-daf7df90-fed32eed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.093229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:24.093240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1463
2025-10-02T08:12:24.093373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.093393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:24.093399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:24.093402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:24.093738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1463 sessionId:  describe result for acl check
2025-10-02T08:12:24.093758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:24.093762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:24.093763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:24.093766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534297698596673:3385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:24.094117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534297698596673:3385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:24.096046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534297698596673:3385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:24.098945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534297698596673:3385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:24.098958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534297698596673:3385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:24.098961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534297698596673:3385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:24.098967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:24.100686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:24.100997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:24.101122Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:24.101128Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:24.101134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:24.101163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:24.101193Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534297698596864:3381]
2025-10-02T08:12:24.101574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:24.101725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:24.101754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:24.101941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:24.101969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.101969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.101970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.101971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.101971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.101974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.101980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.101982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.101983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.101985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.101988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.101992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.101995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.101998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.102000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.102003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.102005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.102007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.102009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.102012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.102023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:24.109371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:24.110871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:24.110885Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:24.110888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:24.110892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:24.110897Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1462 [1:7556534297698596864:3381]
2025-10-02T08:12:24.110904Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:24.110916Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:24.110918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.110920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.110921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.110931Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:24.110934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:24.110938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:24.110982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.110989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.110992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:24.110994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:24.111041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:24.111046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.111054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.111060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:24.111074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698596854:3385], now have 1 active actors on pipe
2025-10-02T08:12:24.111078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534297698596858:3381]
2025-10-02T08:12:24.111080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534297698596858:3381]
2025-10-02T08:12:24.111086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:24.111096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:24.111097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:24.111105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:24.111110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:24.111113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:24.111118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534298158437160:2378], now have 1 active actors on pipe
2025-10-02T08:12:24.111122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.111130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.111165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534297698596858:3381]
2025-10-02T08:12:24.111177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:24.111184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:24.111191Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:24.111195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.111198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.111199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:24.111173Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1462
2025-10-02T08:12:24.111207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.111214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:24.111220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1462
2025-10-02T08:12:24.111243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.111264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.111268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.111276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.111316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1463 partition: 0 MaxSeqNo: 17 sessionId: src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0
2025-10-02T08:12:24.111616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73ec19c8-19db831-daf7df90-fed32eed_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:24.114081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0] Write session: try to update token
2025-10-02T08:12:24.114096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:24.121429Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:24.121441Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:24.121448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534297698596858:3381]
2025-10-02T08:12:24.121482Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:24.121487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:24.121647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:24.121778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:24.121908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:24.122032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:24.122208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:24.122246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:24.127787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId: src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:24.129949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:24.130005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.130016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.130047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:24.130071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:24.130121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.130138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.130290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.130349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.130409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.130468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.130660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.130669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.130732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.130789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.130849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.130911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.130954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.130962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.131027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.131085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.131140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.131198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.131236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.131243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.131306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.131368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.131435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.131503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.131553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.131559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.131634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.131695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.131760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.131831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.131884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.131890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.131966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.132031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.132108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.132175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.132220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.132227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.132301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.132363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.132436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.132505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.132553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.132559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.132634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.132698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.132766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.132852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.132899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.132906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.132979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.133039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.133099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.133160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.133206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.133214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.133281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:24.133343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:24.133404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:24.133465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:24.133515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:24.133522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:24.133557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:24.133618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.133640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.133647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:24.133674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:24.133689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:24.133694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:24.133696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:24.133699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:24.134070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:24.134093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:24.134100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:24.134103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:24.134106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:24.134109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:24.134654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:24.134676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:24.134682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:24.134686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:24.134690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:24.134693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:24.135125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:24.135144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:24.135149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:24.135153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:24.135156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:24.136325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:24.136340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:24.136351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392744135
2025-10-02T08:12:24.136485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:24.136498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:24.136503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:24.136505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:24.136509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:24.136513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:24.136973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:24.136994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:24.136999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:24.137003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:24.137007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:24.137011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:24.137427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:24.137443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:24.137451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:24.137454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:24.137457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:24.137459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:24.137884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:24.137906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:24.137913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:24.139043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:24.139061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:24.139066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:24.139070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:24.139077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392744139
2025-10-02T08:12:24.139383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:24.139404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:24.139409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:24.139413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:24.139420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:24.139423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:24.139886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:24.139909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:24.139918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:24.139925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:24.139929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:24.139937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:24.140402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:24.140422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.140516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392744140
2025-10-02T08:12:24.141219Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:24.141241Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:24.141245Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:24.141248Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:24.142643Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:24.142654Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:24.142655Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:24.142661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534297698596858:3381]
2025-10-02T08:12:24.142664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534297698596858:3381]
2025-10-02T08:12:24.142709Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:24.142717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:24.142719Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:24.142720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.142721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:24.142842Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:24.183126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534297698596902:4654]
2025-10-02T08:12:24.183219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1462, pipe: [1:7556534297698596902:4654]
2025-10-02T08:12:24.266841Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:24.267133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698596902:4654], now have 1 active actors on pipe
2025-10-02T08:12:24.267234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:24.267239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:24.267259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1463 reason: error at write: Disconnected sessionId: src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0
2025-10-02T08:12:24.267353Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:24.267410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1463 sessionId: src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0 is DEAD
2025-10-02T08:12:24.267550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:24.267560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0] Write session will restart in 0.008316s
2025-10-02T08:12:24.267549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534297698596902:4654]
2025-10-02T08:12:24.267569Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:24.267583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0] Write session: Do CDS request
2025-10-02T08:12:24.267588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:24.277187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.277295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:24.277308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1464
2025-10-02T08:12:24.277445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.277472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:24.277480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:24.277491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:24.277878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1464 sessionId:  describe result for acl check
2025-10-02T08:12:24.277909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:24.277914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:24.277915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:24.277918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534297698597422:3342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:24.278354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534297698597422:3342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:24.280370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534297698597422:3342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:24.283091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534297698597422:3342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:24.283103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534297698597422:3342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:24.283106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534297698597422:3342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:24.283113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:24.283426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:24.284791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:24.284942Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:24.284952Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:24.284961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:24.284997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:24.285021Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534297698597648:3352]
2025-10-02T08:12:24.285420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:24.285567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:24.285595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:24.285789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:24.285815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.285820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.285821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.285822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.285823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.285828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.285837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.285841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.285844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.285846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.285850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.285854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.285857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.285860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.285862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.285864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.285866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.285869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.285871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.285873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.285887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:24.293478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:24.295219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:24.295230Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:24.295231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:24.295234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:24.295238Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1463 [1:7556534297698597648:3352]
2025-10-02T08:12:24.295246Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:24.295258Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:24.295259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.295261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.295262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.295273Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:24.295276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:24.295280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:24.295320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.295325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.295327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:24.295328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:24.295376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:24.295381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.295389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.295395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:24.295406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534297698597642:3352]
2025-10-02T08:12:24.295410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534297698597642:3352]
2025-10-02T08:12:24.295416Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:24.295426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698597639:3342], now have 1 active actors on pipe
2025-10-02T08:12:24.295427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:24.295429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:24.295430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:24.295437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:24.295438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:24.295442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534298158437188:2378], now have 1 active actors on pipe
2025-10-02T08:12:24.295448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1463
2025-10-02T08:12:24.295464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.295472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.295482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534297698597642:3352]
2025-10-02T08:12:24.295490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:24.295515Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93342cb9-727cd600-113061a1-3d13fe5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:24.295515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:24.295521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.295525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.295527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:24.295536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.295544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:24.295525Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1463
2025-10-02T08:12:24.295567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.295613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.295619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.295632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.295667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1464 partition: 0 MaxSeqNo: 17 sessionId: src_id|93342cb9-727cd600-113061a1-3d13fe5c_0
2025-10-02T08:12:24.295981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a61f5-66a8cd09-76f6801c-f7185ea2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|93342cb9-727cd600-113061a1-3d13fe5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:24.298451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93342cb9-727cd600-113061a1-3d13fe5c_0] Write session: try to update token
2025-10-02T08:12:24.298468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93342cb9-727cd600-113061a1-3d13fe5c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:24.311882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId: src_id|93342cb9-727cd600-113061a1-3d13fe5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:24.312317Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:24.312332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:24.312334Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:24.312341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534297698597642:3352]
2025-10-02T08:12:24.312345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534297698597642:3352]
2025-10-02T08:12:24.312385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:24.312391Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:24.312395Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:24.312396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.312398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:24.312519Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:24.314388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:24.367957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534297698597672:4654]
2025-10-02T08:12:24.368066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1463, pipe: [1:7556534297698597672:4654]
2025-10-02T08:12:24.443912Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:24.444286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.444296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.444327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698597672:4654], now have 1 active actors on pipe
2025-10-02T08:12:24.444451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534297698597672:4654]
2025-10-02T08:12:24.444470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:24.444475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:24.444520Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:24.444522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1464 reason: error at write: Disconnected sessionId: src_id|93342cb9-727cd600-113061a1-3d13fe5c_0
2025-10-02T08:12:24.444602Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:24.444675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1464 sessionId: src_id|93342cb9-727cd600-113061a1-3d13fe5c_0 is DEAD
2025-10-02T08:12:24.444813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93342cb9-727cd600-113061a1-3d13fe5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:24.444823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93342cb9-727cd600-113061a1-3d13fe5c_0] Write session will restart in 0.009142s
2025-10-02T08:12:24.444849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93342cb9-727cd600-113061a1-3d13fe5c_0] Write session: Do CDS request
2025-10-02T08:12:24.444855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93342cb9-727cd600-113061a1-3d13fe5c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:24.455243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93342cb9-727cd600-113061a1-3d13fe5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.455284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:24.455295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1465
2025-10-02T08:12:24.455411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.455433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:24.455440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:24.455442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:24.455771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1465 sessionId:  describe result for acl check
2025-10-02T08:12:24.455795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:24.455800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:24.455801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:24.455804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534297698598263:3327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:24.456181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534297698598263:3327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:24.458322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534297698598263:3327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:24.459977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:24.461190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:24.461356Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:24.461364Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:24.461371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:24.461402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:24.461428Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534297698598400:3336]
2025-10-02T08:12:24.461514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534297698598263:3327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:24.461523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534297698598263:3327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:24.461526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534297698598263:3327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:24.461532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:24.461826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:24.461945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:24.461977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:24.462183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:24.462225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.462230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.462232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.462232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.462233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.462237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.462246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.462250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.462253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.462257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.462263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.462270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.462276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.462280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.462284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.462288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.462291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.462295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.462299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.462303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.462320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:24.469661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:24.470958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:24.470970Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:24.470973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:24.470976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:24.470981Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1464 [1:7556534297698598400:3336]
2025-10-02T08:12:24.470988Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:24.470999Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:24.471002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.471005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.471006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.471014Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:24.471018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:24.471026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:24.471063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.471068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.471071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:24.471072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:24.471111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:24.471118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.471126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.471132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:24.471143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534297698598394:3336]
2025-10-02T08:12:24.471148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534297698598394:3336]
2025-10-02T08:12:24.471152Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:24.471160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698598405:3327], now have 1 active actors on pipe
2025-10-02T08:12:24.471163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:24.471165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1464
2025-10-02T08:12:24.471166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:24.471169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:24.471176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:24.471177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:24.471181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534298158437194:2378], now have 1 active actors on pipe
2025-10-02T08:12:24.471184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.471186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.471210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534297698598394:3336]
2025-10-02T08:12:24.471221Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:24.471230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:24.471236Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:24.471240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.471242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.471243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:24.471249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.471259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:24.471277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.471247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1464
2025-10-02T08:12:24.471503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.471510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.471525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.471555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1465 partition: 0 MaxSeqNo: 17 sessionId: src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0
2025-10-02T08:12:24.471799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93342cb9-727cd600-113061a1-3d13fe5c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:24.474098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0] Write session: try to update token
2025-10-02T08:12:24.474109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:24.486086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId: src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:24.487702Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:24.487715Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:24.487717Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:24.487724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534297698598394:3336]
2025-10-02T08:12:24.487726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534297698598394:3336]
2025-10-02T08:12:24.487760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:24.487765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.487766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:24.487767Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:24.487771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:24.487894Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:24.488286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:24.544576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534297698598433:4654]
2025-10-02T08:12:24.544681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1464, pipe: [1:7556534297698598433:4654]
2025-10-02T08:12:24.612879Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:24.613269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.613279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.613310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698598433:4654], now have 1 active actors on pipe
2025-10-02T08:12:24.613399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534297698598433:4654]
2025-10-02T08:12:24.613423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:24.613425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:24.613474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1465 reason: error at write: Disconnected sessionId: src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0
2025-10-02T08:12:24.613483Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:24.613504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:24.613617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1465 sessionId: src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0 is DEAD
2025-10-02T08:12:24.613772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:24.613783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0] Write session will restart in 0.005089s
2025-10-02T08:12:24.613810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0] Write session: Do CDS request
2025-10-02T08:12:24.613817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:24.620204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.620272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:24.620285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1466
2025-10-02T08:12:24.620398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.620425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:24.620434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:24.620437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:24.620734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1466 sessionId:  describe result for acl check
2025-10-02T08:12:24.620758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:24.620760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:24.620760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:24.620764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534297698598815:3303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:24.621148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534297698598815:3303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:24.623419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534297698598815:3303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:24.625889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534297698598815:3303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:24.625902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534297698598815:3303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:24.625905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534297698598815:3303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:24.625910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:24.628095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:24.629390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:24.629512Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:24.629521Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:24.629529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:24.629573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:24.629602Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534297698599171:3305]
2025-10-02T08:12:24.630016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:24.630158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:24.630183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:24.630369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:24.630398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.630402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.630403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.630403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.630404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.630407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.630413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.630415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.630417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.630419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.630423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.630427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.630431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.630433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.630435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.630439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.630445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.630448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.630450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.630453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.630462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:24.638206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:24.640063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:24.640076Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:24.640078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:24.640081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:24.640095Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1465 [1:7556534297698599171:3305]
2025-10-02T08:12:24.640104Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:24.640119Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:24.640122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.640125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.640126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.640139Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:24.640150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:24.640155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:24.640206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.640214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.640217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:24.640220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:24.640279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:24.640285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.640296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.640310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:24.640327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534297698599165:3305]
2025-10-02T08:12:24.640333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534297698599165:3305]
2025-10-02T08:12:24.640339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:24.640355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1465
2025-10-02T08:12:24.640355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:24.640368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:24.640368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:24.640370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:24.640371Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:24.640379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698599114:3303], now have 1 active actors on pipe
2025-10-02T08:12:24.640400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534298158437202:2378], now have 1 active actors on pipe
2025-10-02T08:12:24.640406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534297698599165:3305]
2025-10-02T08:12:24.640413Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:24.640418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:24.640419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.640422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.640459Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:24.640470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.640473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.640475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:24.640446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1465
2025-10-02T08:12:24.640482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.640490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:24.640509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.640535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.640542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.640552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.640584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1466 partition: 0 MaxSeqNo: 17 sessionId: src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0
2025-10-02T08:12:24.640871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fabece-dcd83c5c-585e5c9d-ec38a738_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:24.643326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0] Write session: try to update token
2025-10-02T08:12:24.643340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:24.655947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId: src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:24.657023Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:24.657036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:24.657038Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:24.657047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534297698599165:3305]
2025-10-02T08:12:24.657051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534297698599165:3305]
2025-10-02T08:12:24.657092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:24.657093Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:24.657100Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:24.657102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.657104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:24.657238Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:24.658333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:24.713513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534297698599198:4654]
2025-10-02T08:12:24.713607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1465, pipe: [1:7556534297698599198:4654]
2025-10-02T08:12:24.783040Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:24.783384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.783395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.783428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698599198:4654], now have 1 active actors on pipe
2025-10-02T08:12:24.783558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:24.783572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:24.783627Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:24.783637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1466 reason: error at write: Disconnected sessionId: src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0
2025-10-02T08:12:24.783646Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:24.783807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1466 sessionId: src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0 is DEAD
2025-10-02T08:12:24.783940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:24.783952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0] Write session will restart in 0.005828s
2025-10-02T08:12:24.783938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534297698599198:4654]
2025-10-02T08:12:24.783977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0] Write session: Do CDS request
2025-10-02T08:12:24.783983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:24.791267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.791381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:24.791396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1467
2025-10-02T08:12:24.791500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.791524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:24.791527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:24.791533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:24.791949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1467 sessionId:  describe result for acl check
2025-10-02T08:12:24.791983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:24.791989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:24.791991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:24.791997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534297698599576:3280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:24.792486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534297698599576:3280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:24.794423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534297698599576:3280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:24.797571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534297698599576:3280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:24.797585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534297698599576:3280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:24.797588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534297698599576:3280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:24.797594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:24.802675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:24.803035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:24.803176Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:24.803183Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:24.803191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:24.803223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:24.803256Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534297698599938:3263]
2025-10-02T08:12:24.803939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:24.804100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:24.804133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:24.804435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:24.804473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.804479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.804480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.804481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.804482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.804486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.804496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.804499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.804503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.804507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.804512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.804518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:24.804524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.804529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:24.804537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.804542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:24.804546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.804557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.804561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.804566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.804589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:24.812305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:24.813899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:24.813914Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:24.813917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:24.813920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:24.813926Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1466 [1:7556534297698599938:3263]
2025-10-02T08:12:24.813939Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:24.813954Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:24.813957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.813960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.813962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.813977Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:24.813981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:24.813988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:24.814043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.814051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.814054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:24.814057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:24.814122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:24.814129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.814141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:24.814153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:24.814174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698599853:3280], now have 1 active actors on pipe
2025-10-02T08:12:24.814184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534297698599932:3263]
2025-10-02T08:12:24.814186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534297698599932:3263]
2025-10-02T08:12:24.814192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1466
2025-10-02T08:12:24.814192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:24.814199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534298158437208:2378], now have 1 active actors on pipe
2025-10-02T08:12:24.814200Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:24.814205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:24.814206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:24.814219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:24.814222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:24.814228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.814231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.814263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534297698599932:3263]
2025-10-02T08:12:24.814274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:24.814280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:24.814288Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:24.814293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:24.814297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:24.814300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:24.814308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:24.814320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:24.814284Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1466
2025-10-02T08:12:24.814361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.814441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.814448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.814459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:24.814499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1467 partition: 0 MaxSeqNo: 17 sessionId: src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0
2025-10-02T08:12:24.814810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ddf2df-6b09b75c-4fa3e5d3-31a5855_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:24.817498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0] Write session: try to update token
2025-10-02T08:12:24.817514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:24.830147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId: src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:24.830862Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:24.830877Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:24.830879Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:24.830887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534297698599932:3263]
2025-10-02T08:12:24.830891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534297698599932:3263]
2025-10-02T08:12:24.830924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:24.830934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:24.830934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:24.830940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:24.830942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:24.831068Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:24.832762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:24.884033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534297698599962:4654]
2025-10-02T08:12:24.884142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1466, pipe: [1:7556534297698599962:4654]
2025-10-02T08:12:24.981404Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:24.981989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:24.982000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:24.982035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698599962:4654], now have 1 active actors on pipe
2025-10-02T08:12:24.982135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:24.982144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:24.982197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1467 reason: error at write: Disconnected sessionId: src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0
2025-10-02T08:12:24.982240Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:24.982253Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:24.982343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1467 sessionId: src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0 is DEAD
2025-10-02T08:12:24.982485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:24.982490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0] Write session will restart in 0.006918s
2025-10-02T08:12:24.982508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0] Write session: Do CDS request
2025-10-02T08:12:24.982514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:24.982507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534297698599962:4654]
2025-10-02T08:12:24.990214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.990259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:24.990272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1468
2025-10-02T08:12:24.990478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:24.990515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:24.990525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:24.990528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:24.990955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1468 sessionId:  describe result for acl check
2025-10-02T08:12:24.990994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:24.990996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:24.990997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:24.991003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534297698600405:3275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:24.991497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534297698600405:3275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:24.993518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534297698600405:3275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:24.996754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534297698600405:3275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:24.996767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534297698600405:3275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:24.996770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534297698600405:3275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:24.996777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:25.000039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:25.000387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:25.000533Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:25.000540Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:25.000546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:25.000579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:25.000603Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534301993567997:3276]
2025-10-02T08:12:25.001037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:25.001167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:25.001204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:25.001399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:25.001432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.001437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.001437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.001438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.001439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.001442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.001448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.001450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.001452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.001454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.001457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.001461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.001465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.001467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.001470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.001473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.001476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.001479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.001481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.001483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.001493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:25.009117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:25.010652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:25.010667Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:25.010669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:25.010673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:25.010678Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1467 [1:7556534301993567997:3276]
2025-10-02T08:12:25.010688Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:25.010707Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:25.010714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.010717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.010719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.010732Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:25.010741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:25.010747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:25.010801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.010807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.010810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:25.010812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:25.010868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:25.010875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.010887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.010903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:25.010920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1467
2025-10-02T08:12:25.010924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534298158437215:2378], now have 1 active actors on pipe
2025-10-02T08:12:25.010927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534297698600670:3275], now have 1 active actors on pipe
2025-10-02T08:12:25.010933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534297698600695:3276]
2025-10-02T08:12:25.010936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534297698600695:3276]
2025-10-02T08:12:25.010947Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:25.010959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.010964Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:25.010967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:25.010968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.010985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:25.011002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:25.011009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:25.011003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1467
2025-10-02T08:12:25.011045Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:25.011054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.011059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.011065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:25.011072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.011083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:25.011093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534297698600695:3276]
2025-10-02T08:12:25.011104Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:25.011113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:25.011130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.011161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.011167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.011179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.011214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1468 partition: 0 MaxSeqNo: 17 sessionId: src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0
2025-10-02T08:12:25.011513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cbfecd6-327c3ee5-f560bff0-fc6f026d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:25.013966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0] Write session: try to update token
2025-10-02T08:12:25.013980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:25.026669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId: src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:25.027944Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:25.027960Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:25.027962Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:25.027970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534297698600695:3276]
2025-10-02T08:12:25.027974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534297698600695:3276]
2025-10-02T08:12:25.028007Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:25.028015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:25.028016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:25.028021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.028023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:25.028164Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:25.029100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:25.083678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534301993568036:4654]
2025-10-02T08:12:25.083810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1467, pipe: [1:7556534301993568036:4654]
2025-10-02T08:12:25.154858Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:25.155246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.155264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.155304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993568036:4654], now have 1 active actors on pipe
2025-10-02T08:12:25.155420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534301993568036:4654]
2025-10-02T08:12:25.155440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:25.155445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:25.155496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1468 reason: error at write: Disconnected sessionId: src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0
2025-10-02T08:12:25.155536Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:25.155617Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:25.155665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1468 sessionId: src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0 is DEAD
2025-10-02T08:12:25.155792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:25.155800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0] Write session will restart in 0.007858s
2025-10-02T08:12:25.155825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0] Write session: Do CDS request
2025-10-02T08:12:25.155831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:25.165231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.165276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:25.165289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1469
2025-10-02T08:12:25.165527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.165563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:25.165572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:25.165575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:25.165974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1469 sessionId:  describe result for acl check
2025-10-02T08:12:25.165999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:25.166001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:25.166003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:25.166007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534301993568525:3228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:25.166673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534301993568525:3228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:25.168671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534301993568525:3228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:25.172034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534301993568525:3228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:25.172051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534301993568525:3228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:25.172054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534301993568525:3228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:25.172062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:25.175012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:25.176632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:25.176766Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:25.176773Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:25.176780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:25.176829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:25.176862Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534301993568798:3239]
2025-10-02T08:12:25.177301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:25.177473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:25.177511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:25.177714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:25.177744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.177751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.177752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.177753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.177754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.177758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.177767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.177771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.177774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.177778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.177783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.177790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.177795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.177800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.177804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.177808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.177812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.177816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.177821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.177829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.177841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:25.186445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:25.188182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:25.188200Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:25.188203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:25.188206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:25.188213Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1468 [1:7556534301993568798:3239]
2025-10-02T08:12:25.188225Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:25.188240Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:25.188244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.188247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.188250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.188264Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:25.188276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:25.188283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:25.188354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.188361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.188365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:25.188367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:25.188431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:25.188439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.188452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.188467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:25.188486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534301993568792:3239]
2025-10-02T08:12:25.188493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534301993568792:3239]
2025-10-02T08:12:25.188500Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:25.188510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:25.188511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1468
2025-10-02T08:12:25.188514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993568745:3228], now have 1 active actors on pipe
2025-10-02T08:12:25.188520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:25.188523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:25.188538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:25.188542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:25.188547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534302453404553:2378], now have 1 active actors on pipe
2025-10-02T08:12:25.188551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.188556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.188609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534301993568792:3239]
2025-10-02T08:12:25.188628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:25.188638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:25.188643Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:25.188649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.188655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.188657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:25.188665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.188673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:25.188710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.188775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.188787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.188624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1468
2025-10-02T08:12:25.188827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.188872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1469 partition: 0 MaxSeqNo: 17 sessionId: src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0
2025-10-02T08:12:25.189226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c84ef7-93872f1-4837b187-e3ab9ac2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:25.191810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0] Write session: try to update token
2025-10-02T08:12:25.191826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:25.206112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId: src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:25.206788Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:25.206802Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:25.206803Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:25.206810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534301993568792:3239]
2025-10-02T08:12:25.206814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534301993568792:3239]
2025-10-02T08:12:25.206855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:25.206859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:25.206862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:25.206867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.206869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:25.206996Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:25.208780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:25.255777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534301993568839:4654]
2025-10-02T08:12:25.255901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1468, pipe: [1:7556534301993568839:4654]
2025-10-02T08:12:25.339349Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:25.339989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.340001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.340031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993568839:4654], now have 1 active actors on pipe
2025-10-02T08:12:25.340159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534301993568839:4654]
2025-10-02T08:12:25.340182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:25.340185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:25.340240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1469 reason: error at write: Disconnected sessionId: src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0
2025-10-02T08:12:25.340277Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:25.340294Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:25.340398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1469 sessionId: src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0 is DEAD
2025-10-02T08:12:25.340585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:25.340597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0] Write session will restart in 0.005924s
2025-10-02T08:12:25.340622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0] Write session: Do CDS request
2025-10-02T08:12:25.340628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:25.347288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.347387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:25.347401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1470
2025-10-02T08:12:25.347539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.347579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:25.347584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:25.347587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:25.348037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1470 sessionId:  describe result for acl check
2025-10-02T08:12:25.348070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:25.348076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:25.348078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:25.348083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534301993569137:3212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:25.348594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534301993569137:3212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:25.350706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534301993569137:3212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:25.354034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534301993569137:3212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:25.354049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534301993569137:3212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:25.354052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534301993569137:3212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:25.354059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:25.362661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:25.364206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:25.364332Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:25.364340Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:25.364347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:25.364377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:25.364402Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534301993569580:3220]
2025-10-02T08:12:25.364854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:25.365004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:25.365039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:25.365275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:25.365325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.365331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.365332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.365334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.365335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.365339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.365349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.365352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.365355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.365358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.365363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.365369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.365374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.365378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.365382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.365386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.365389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.365393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.365398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.365403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.365422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:25.373429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:25.374975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:25.374996Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:25.375000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:25.375004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:25.375011Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1469 [1:7556534301993569580:3220]
2025-10-02T08:12:25.375024Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:25.375040Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:25.375043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.375047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.375049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.375065Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:25.375076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:25.375083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:25.375156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.375163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.375166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:25.375169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:25.375234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:25.375242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.375258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.375271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:25.375289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993569314:3212], now have 1 active actors on pipe
2025-10-02T08:12:25.375293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1469
2025-10-02T08:12:25.375296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534301993569574:3220]
2025-10-02T08:12:25.375298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534301993569574:3220]
2025-10-02T08:12:25.375307Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:25.375315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534302453404560:2378], now have 1 active actors on pipe
2025-10-02T08:12:25.375318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:25.375322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:25.375327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:25.375342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:25.375350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:25.375357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.375365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.375407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534301993569574:3220]
2025-10-02T08:12:25.375416Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:25.375426Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:25.375433Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce2abc50-8df20dc1-509a6350-8408d540_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:25.375444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.375447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.375449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:25.375414Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1469
2025-10-02T08:12:25.375459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.375473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:25.375518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.375569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.375577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.375591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.375631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1470 partition: 0 MaxSeqNo: 17 sessionId: src_id|ce2abc50-8df20dc1-509a6350-8408d540_0
2025-10-02T08:12:25.375975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7862793-86ca3c48-92667c3f-4b1bdc55_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ce2abc50-8df20dc1-509a6350-8408d540_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:25.378859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2abc50-8df20dc1-509a6350-8408d540_0] Write session: try to update token
2025-10-02T08:12:25.378880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2abc50-8df20dc1-509a6350-8408d540_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:25.395330Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:25.395353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:25.395355Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:25.395363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534301993569574:3220]
2025-10-02T08:12:25.395368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534301993569574:3220]
2025-10-02T08:12:25.395406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId: src_id|ce2abc50-8df20dc1-509a6350-8408d540_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:25.395417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:25.395423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.395425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:25.395616Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:25.396860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:25.396867Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:25.398177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:25.440110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534301993569606:4654]
2025-10-02T08:12:25.440243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1469, pipe: [1:7556534301993569606:4654]
2025-10-02T08:12:25.528084Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:25.528530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.528544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.528585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993569606:4654], now have 1 active actors on pipe
2025-10-02T08:12:25.529201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2abc50-8df20dc1-509a6350-8408d540_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:25.529213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2abc50-8df20dc1-509a6350-8408d540_0] Write session will restart in 0.009529s
2025-10-02T08:12:25.528902Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:25.529237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2abc50-8df20dc1-509a6350-8408d540_0] Write session: Do CDS request
2025-10-02T08:12:25.529244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2abc50-8df20dc1-509a6350-8408d540_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:25.528770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534301993569606:4654]
2025-10-02T08:12:25.528795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:25.528798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:25.528833Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:25.528883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1470 reason: error at write: Disconnected sessionId: src_id|ce2abc50-8df20dc1-509a6350-8408d540_0
2025-10-02T08:12:25.529058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1470 sessionId: src_id|ce2abc50-8df20dc1-509a6350-8408d540_0 is DEAD
2025-10-02T08:12:25.540380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2abc50-8df20dc1-509a6350-8408d540_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.540410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:25.540425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1471
2025-10-02T08:12:25.540607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.540641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:25.540648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:25.540651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:25.541151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1471 sessionId:  describe result for acl check
2025-10-02T08:12:25.541183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:25.541189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:25.541190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:25.541194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534301993570115:3202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:25.541662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534301993570115:3202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:25.546166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534301993570115:3202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:25.548597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:25.548922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534301993570115:3202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:25.548932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534301993570115:3202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:25.548935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534301993570115:3202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:25.548943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:25.550502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:25.550673Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:25.550684Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:25.550693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:25.550737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:25.550773Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534301993570353:3209]
2025-10-02T08:12:25.551406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:25.551598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:25.551638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:25.551931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:25.551972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.551977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.551978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.551980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.551981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.551986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.551995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.552003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.552006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.552010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.552019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.552026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.552037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.552041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.552045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.552050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.552058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.552063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.552067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.552075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.552102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:25.560036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:25.561792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:25.561805Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:25.561807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:25.561810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:25.561818Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1470 [1:7556534301993570353:3209]
2025-10-02T08:12:25.561829Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:25.561846Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:25.561849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.561852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.561853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.561869Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:25.561879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:25.561889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:25.561958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.561964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.561967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:25.561970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:25.562029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:25.562035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.562047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.562063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:25.562067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1470
2025-10-02T08:12:25.562085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993570348:3202], now have 1 active actors on pipe
2025-10-02T08:12:25.562092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534302453404566:2378], now have 1 active actors on pipe
2025-10-02T08:12:25.562097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534301993570341:3209]
2025-10-02T08:12:25.562103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534301993570341:3209]
2025-10-02T08:12:25.562119Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:25.562132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.562139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.562143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:25.562147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:25.562157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:25.562172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:25.562178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:25.562164Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1470
2025-10-02T08:12:25.562220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|519c0745-e627a08a-6200200b-e352b286_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:25.562230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.562234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.562236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:25.562244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.562257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:25.562269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534301993570341:3209]
2025-10-02T08:12:25.562281Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:25.562292Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:25.562310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.562387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.562395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.562407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.562441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1471 partition: 0 MaxSeqNo: 17 sessionId: src_id|519c0745-e627a08a-6200200b-e352b286_0
2025-10-02T08:12:25.562781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2abc50-8df20dc1-509a6350-8408d540_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|519c0745-e627a08a-6200200b-e352b286_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:25.565256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|519c0745-e627a08a-6200200b-e352b286_0] Write session: try to update token
2025-10-02T08:12:25.565272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|519c0745-e627a08a-6200200b-e352b286_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:25.578552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId: src_id|519c0745-e627a08a-6200200b-e352b286_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:25.580470Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:25.580487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:25.580489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:25.580499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534301993570341:3209]
2025-10-02T08:12:25.580503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534301993570341:3209]
2025-10-02T08:12:25.580549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:25.580561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.580564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:25.580565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:25.580572Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:25.580706Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:25.581196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:25.629023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534301993570379:4654]
2025-10-02T08:12:25.629150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1470, pipe: [1:7556534301993570379:4654]
2025-10-02T08:12:25.713673Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:25.714287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.714300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.714338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993570379:4654], now have 1 active actors on pipe
2025-10-02T08:12:25.714530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:25.714536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:25.714586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1471 reason: error at write: Disconnected sessionId: src_id|519c0745-e627a08a-6200200b-e352b286_0
2025-10-02T08:12:25.714595Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:25.714738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1471 sessionId: src_id|519c0745-e627a08a-6200200b-e352b286_0 is DEAD
2025-10-02T08:12:25.714894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519c0745-e627a08a-6200200b-e352b286_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:25.714907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519c0745-e627a08a-6200200b-e352b286_0] Write session will restart in 0.009508s
2025-10-02T08:12:25.714942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519c0745-e627a08a-6200200b-e352b286_0] Write session: Do CDS request
2025-10-02T08:12:25.714950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519c0745-e627a08a-6200200b-e352b286_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:25.714945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534301993570379:4654]
2025-10-02T08:12:25.714611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:25.725282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|519c0745-e627a08a-6200200b-e352b286_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.725324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:25.725340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1472
2025-10-02T08:12:25.725491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.725521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:25.725530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:25.725534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:25.725964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1472 sessionId:  describe result for acl check
2025-10-02T08:12:25.726005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:25.726014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:25.726016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:25.726021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534301993570830:3182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:25.726524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534301993570830:3182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:25.729665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534301993570830:3182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:25.733361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534301993570830:3182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:25.733373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534301993570830:3182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:25.733376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534301993570830:3182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:25.733383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:25.736642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:25.738313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:25.738471Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:25.738478Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:25.738485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:25.738529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:25.738578Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534301993571130:3196]
2025-10-02T08:12:25.739052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:25.739251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:25.739296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:25.739564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:25.739620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.739621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.739622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.739623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.739624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.739629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.739638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.739641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.739644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.739648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.739653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.739660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.739665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.739669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.739673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.739677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.739681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.739685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.739688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.739692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.739709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:25.747861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:25.749587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:25.749603Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:25.749605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:25.749608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:25.749612Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1471 [1:7556534301993571130:3196]
2025-10-02T08:12:25.749620Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:25.749634Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:25.749636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.749638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.749641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.749653Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:25.749656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:25.749661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:25.749707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.749713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.749716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:25.749718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:25.749838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1471
2025-10-02T08:12:25.749923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1471
2025-10-02T08:12:25.750080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:25.750091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.750105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.750120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:25.750143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993571078:3182], now have 1 active actors on pipe
2025-10-02T08:12:25.750150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534302453404574:2378], now have 1 active actors on pipe
2025-10-02T08:12:25.750155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.750159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.750183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534301993571124:3196]
2025-10-02T08:12:25.750190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534301993571124:3196]
2025-10-02T08:12:25.750201Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:25.750214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:25.750225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:25.750228Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:25.750232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:25.750235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:25.750251Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:25.750265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.750268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.750270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:25.750280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.750291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:25.750329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534301993571124:3196]
2025-10-02T08:12:25.750341Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:25.750349Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:25.750357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.750455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.750466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.750488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.750522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1472 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0
2025-10-02T08:12:25.750866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519c0745-e627a08a-6200200b-e352b286_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:25.753588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0] Write session: try to update token
2025-10-02T08:12:25.753608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:25.766440Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:25.766458Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:25.766464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534301993571124:3196]
2025-10-02T08:12:25.766501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:25.766513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:25.766733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:25.766874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:25.767010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:25.767170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:25.767393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:25.767430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:25.767941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId: src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:25.770509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:25.770569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.770581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.770614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:25.770634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:25.770687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.770696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.770866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.770939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.771006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.771079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.771123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.771131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.771195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.771258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.771320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.771389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.771436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.771444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.771513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.771571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.771628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.771687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.771730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.771737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.771817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.771881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.771950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.772022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.772071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.772078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.772159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.772224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.772292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.772363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.772412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.772418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.772493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.772565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.772637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.772729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.772780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.772786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.772879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.772946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.773017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.773086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.773137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.773144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.773216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.773279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.773351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.773424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.773475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.773483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.773563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.773621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.773682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.773742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.773791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.773799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.773871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:25.773935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:25.773996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:25.774058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:25.774121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:25.774128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:25.774170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:25.774236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.774258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.774264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:25.774294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:25.774309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:25.774317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:25.774320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:25.774327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:25.774716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:25.774743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:25.774753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:25.774757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:25.774760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:25.774764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:25.775448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:25.775469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:25.775475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:25.775478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:25.775481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:25.775484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:25.776012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:25.776032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:25.776037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:25.776044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:25.776048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:25.778106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:25.778126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:25.778139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392745777
2025-10-02T08:12:25.778273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:25.778285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:25.778288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:25.778290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:25.778293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:25.778295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:25.778765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:25.778783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:25.778787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:25.778790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:25.778792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:25.778794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:25.779217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:25.779234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:25.779244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:25.779252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:25.779257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:25.779265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:25.779670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:25.779689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:25.779695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:25.780738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:25.780753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:25.780760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:25.780763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:25.780768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392745780
2025-10-02T08:12:25.781078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:25.781095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:25.781099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:25.781104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:25.781107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:25.781111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:25.781518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:25.781535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:25.781540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:25.781547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:25.781549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:25.781552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:25.782009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:25.782026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.782118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392745782
2025-10-02T08:12:25.785401Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:25.785422Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:25.785429Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:25.785435Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:25.787003Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:25.787015Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:25.787017Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:25.787027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534301993571124:3196]
2025-10-02T08:12:25.787030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534301993571124:3196]
2025-10-02T08:12:25.787075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:25.787078Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:25.787082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.787084Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:25.787085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:25.787226Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:25.815361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534301993571164:4654]
2025-10-02T08:12:25.815465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1471, pipe: [1:7556534301993571164:4654]
2025-10-02T08:12:25.916681Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:25.916983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993571164:4654], now have 1 active actors on pipe
2025-10-02T08:12:25.917059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:25.917067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:25.917092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1472 reason: error at write: Disconnected sessionId: src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0
2025-10-02T08:12:25.917177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:25.917202Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:25.917259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1472 sessionId: src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0 is DEAD
2025-10-02T08:12:25.917428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:25.917437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0] Write session will restart in 0.005936s
2025-10-02T08:12:25.917455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0] Write session: Do CDS request
2025-10-02T08:12:25.917460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:25.917438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534301993571164:4654]
2025-10-02T08:12:25.924302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.924344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:25.924359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1473
2025-10-02T08:12:25.924603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:25.924644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:25.924654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:25.924657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:25.925067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1473 sessionId:  describe result for acl check
2025-10-02T08:12:25.925103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:25.925105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:25.925106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:25.925111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534301993571552:3170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:25.925596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534301993571552:3170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:25.928838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534301993571552:3170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:25.932041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534301993571552:3170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:25.932058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534301993571552:3170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:25.932061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534301993571552:3170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:25.932069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:25.937065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:25.937437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:25.937598Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:25.937609Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:25.937618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:25.937666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:25.937702Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534301993571914:3166]
2025-10-02T08:12:25.938317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:25.938486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:25.938525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:25.938834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:25.938874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.938880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.938881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.938883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.938884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.938889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.938899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.938903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.938907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.938911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.938916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.938923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:25.938929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.938934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:25.938938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.938944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:25.938948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.938953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.938960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.938965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.938990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:25.947079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:25.949104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:25.949121Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:25.949123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:25.949126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:25.949133Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1472 [1:7556534301993571914:3166]
2025-10-02T08:12:25.949144Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:25.949162Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:25.949166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.949169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.949171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.949186Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:25.949192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:25.949199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:25.949265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.949274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.949277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:25.949279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:25.949346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:25.949354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.949367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:25.949380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:25.949405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534301993571851:3170], now have 1 active actors on pipe
2025-10-02T08:12:25.949416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534301993571908:3166]
2025-10-02T08:12:25.949418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534301993571908:3166]
2025-10-02T08:12:25.949421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1472
2025-10-02T08:12:25.949425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:25.949435Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:25.949439Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:25.949444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:25.949457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:25.949464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:25.949472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534302453404581:2378], now have 1 active actors on pipe
2025-10-02T08:12:25.949477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.949480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.949516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534301993571908:3166]
2025-10-02T08:12:25.949528Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:25.949539Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:25.949544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:25.949545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:25.949546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:25.949548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:25.949554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:25.949557Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1472
2025-10-02T08:12:25.949561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:25.949583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.949664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.949672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.949686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:25.949718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1473 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0
2025-10-02T08:12:25.950030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1e3f90-dc69eb44-b3109b34-6ef8241d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:25.952895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0] Write session: try to update token
2025-10-02T08:12:25.952910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:25.966718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId: src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:25.969330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:25.969442Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:25.969461Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:25.969464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:25.969473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534301993571908:3166]
2025-10-02T08:12:25.969477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534301993571908:3166]
2025-10-02T08:12:25.969513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:25.969523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:25.969525Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:25.969530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:25.969547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:25.969558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:25.969564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:25.969700Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:26.017594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534306288539234:4654]
2025-10-02T08:12:26.017686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1472, pipe: [1:7556534306288539234:4654]
2025-10-02T08:12:26.104130Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:26.104443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288539234:4654], now have 1 active actors on pipe
2025-10-02T08:12:26.104666Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:26.104777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:26.104787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:26.104856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1473 reason: error at write: Disconnected sessionId: src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0
2025-10-02T08:12:26.104997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1473 sessionId: src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0 is DEAD
2025-10-02T08:12:26.105173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:26.105180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0] Write session will restart in 0.007184s
2025-10-02T08:12:26.105214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0] Write session: Do CDS request
2025-10-02T08:12:26.105219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:26.105250Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:26.105535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534306288539234:4654]
2025-10-02T08:12:26.113265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.113333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:26.113348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1474
2025-10-02T08:12:26.113482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.113510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:26.113514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:26.113521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:26.113984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1474 sessionId:  describe result for acl check
2025-10-02T08:12:26.114012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:26.114013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:26.114015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:26.114019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534306288539630:3139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:26.114487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534306288539630:3139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:26.116536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534306288539630:3139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:26.119024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534306288539630:3139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:26.119042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534306288539630:3139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:26.119045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534306288539630:3139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:26.119051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:26.124526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:26.126077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:26.126253Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:26.126262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:26.126272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:26.126319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:26.126355Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534306288540017:3140]
2025-10-02T08:12:26.127005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:26.127182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:26.127219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:26.127512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:26.127553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.127559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.127560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.127561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.127563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.127567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.127577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.127581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.127585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.127593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.127598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.127605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.127615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.127621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.127629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.127639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.127647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.127653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.127661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.127667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.127688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:26.135475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:26.137249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:26.137261Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:26.137263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:26.137266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:26.137270Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1473 [1:7556534306288540017:3140]
2025-10-02T08:12:26.137277Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:26.137289Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:26.137291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.137293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.137294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.137306Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:26.137309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:26.137314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:26.137356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.137364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.137366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:26.137367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:26.137425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:26.137427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.137439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.137449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:26.137463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534306288540011:3140]
2025-10-02T08:12:26.137465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534306288540011:3140]
2025-10-02T08:12:26.137472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:26.137485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288539835:3139], now have 1 active actors on pipe
2025-10-02T08:12:26.137486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:26.137488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1473
2025-10-02T08:12:26.137491Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:26.137512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:26.137523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:26.137525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:26.137531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.137535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.137576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534306748371896:2378], now have 1 active actors on pipe
2025-10-02T08:12:26.137585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534306288540011:3140]
2025-10-02T08:12:26.137593Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:26.137606Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:26.137607Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce04031c-884a8ddb-8518b84-1271ec52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:26.137612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.137616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.137618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:26.137626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.137634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:26.137687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.137762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.137768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.137781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.137776Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1473
2025-10-02T08:12:26.137814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1474 partition: 0 MaxSeqNo: 17 sessionId: src_id|ce04031c-884a8ddb-8518b84-1271ec52_0
2025-10-02T08:12:26.138161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ffb3a2-6892d859-be7101b-43eda5ef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ce04031c-884a8ddb-8518b84-1271ec52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:26.140629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce04031c-884a8ddb-8518b84-1271ec52_0] Write session: try to update token
2025-10-02T08:12:26.140644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce04031c-884a8ddb-8518b84-1271ec52_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:26.154295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId: src_id|ce04031c-884a8ddb-8518b84-1271ec52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:26.156110Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:26.156124Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:26.156127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:26.156135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534306288540011:3140]
2025-10-02T08:12:26.156142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534306288540011:3140]
2025-10-02T08:12:26.156180Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:26.156185Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:26.156186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:26.156192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.156194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:26.156339Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:26.156822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:26.205510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534306288540050:4654]
2025-10-02T08:12:26.205636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1473, pipe: [1:7556534306288540050:4654]
2025-10-02T08:12:26.290282Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:26.290715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.290724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.290756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288540050:4654], now have 1 active actors on pipe
2025-10-02T08:12:26.290844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534306288540050:4654]
2025-10-02T08:12:26.290868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:26.290870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:26.290902Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:26.290930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1474 reason: error at write: Disconnected sessionId: src_id|ce04031c-884a8ddb-8518b84-1271ec52_0
2025-10-02T08:12:26.290985Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:26.291095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1474 sessionId: src_id|ce04031c-884a8ddb-8518b84-1271ec52_0 is DEAD
2025-10-02T08:12:26.291233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce04031c-884a8ddb-8518b84-1271ec52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:26.291244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce04031c-884a8ddb-8518b84-1271ec52_0] Write session will restart in 0.006094s
2025-10-02T08:12:26.291270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce04031c-884a8ddb-8518b84-1271ec52_0] Write session: Do CDS request
2025-10-02T08:12:26.291276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce04031c-884a8ddb-8518b84-1271ec52_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:26.298173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce04031c-884a8ddb-8518b84-1271ec52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.298252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:26.298264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1475
2025-10-02T08:12:26.298344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.298370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:26.298378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:26.298381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:26.298708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1475 sessionId:  describe result for acl check
2025-10-02T08:12:26.298733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:26.298738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:26.298739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:26.298743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534306288540422:3110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:26.299099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534306288540422:3110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:26.301607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534306288540422:3110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:26.304791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534306288540422:3110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:26.304820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534306288540422:3110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:26.304823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534306288540422:3110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:26.304835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:26.309313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:26.310601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:26.310731Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:26.310738Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:26.310745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:26.310776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:26.310800Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534306288540816:3115]
2025-10-02T08:12:26.311212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:26.311345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:26.311371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:26.311645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:26.311679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.311683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.311684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.311684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.311685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.311688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.311694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.311696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.311698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.311700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.311703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.311708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.311712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.311714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.311717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.311720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.311724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.311729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.311737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.311742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.311762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:26.319300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:26.320920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:26.320934Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:26.320937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:26.320940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:26.320946Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1474 [1:7556534306288540816:3115]
2025-10-02T08:12:26.320956Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:26.320971Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:26.320977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.320980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.320982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.320993Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:26.321001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:26.321007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:26.321055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.321060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.321062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:26.321064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:26.321110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:26.321115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.321122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.321128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:26.321142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534306288540810:3115]
2025-10-02T08:12:26.321146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534306288540810:3115]
2025-10-02T08:12:26.321151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:26.321163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:26.321175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1474
2025-10-02T08:12:26.321178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:26.321180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:26.321181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:26.321184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:26.321202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288540710:3110], now have 1 active actors on pipe
2025-10-02T08:12:26.321206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534306748371933:2378], now have 1 active actors on pipe
2025-10-02T08:12:26.321226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534306288540810:3115]
2025-10-02T08:12:26.321238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:26.321246Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:26.321248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.321251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.321288Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb30c2b4-fdb61888-e86950af-401a4582_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:26.321298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.321301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.321306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:26.321312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.321280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1474
2025-10-02T08:12:26.321318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:26.321338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.321366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.321371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.321379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.321405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1475 partition: 0 MaxSeqNo: 17 sessionId: src_id|cb30c2b4-fdb61888-e86950af-401a4582_0
2025-10-02T08:12:26.321782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce04031c-884a8ddb-8518b84-1271ec52_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cb30c2b4-fdb61888-e86950af-401a4582_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:26.324203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb30c2b4-fdb61888-e86950af-401a4582_0] Write session: try to update token
2025-10-02T08:12:26.324217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb30c2b4-fdb61888-e86950af-401a4582_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:26.337419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId: src_id|cb30c2b4-fdb61888-e86950af-401a4582_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:26.337697Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:26.337710Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:26.337712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:26.337718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534306288540810:3115]
2025-10-02T08:12:26.337721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534306288540810:3115]
2025-10-02T08:12:26.337754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:26.337754Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:26.337759Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:26.337763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.337765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:26.337892Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:26.339980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:26.390893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534306288540840:4654]
2025-10-02T08:12:26.392956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1474, pipe: [1:7556534306288540840:4654]
2025-10-02T08:12:26.481812Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:26.482407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.482417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.482460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288540840:4654], now have 1 active actors on pipe
2025-10-02T08:12:26.483338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534306288540840:4654]
2025-10-02T08:12:26.483363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:26.483365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:26.483423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1475 reason: error at write: Disconnected sessionId: src_id|cb30c2b4-fdb61888-e86950af-401a4582_0
2025-10-02T08:12:26.483453Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:26.483585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1475 sessionId: src_id|cb30c2b4-fdb61888-e86950af-401a4582_0 is DEAD
2025-10-02T08:12:26.484996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb30c2b4-fdb61888-e86950af-401a4582_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:26.485008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb30c2b4-fdb61888-e86950af-401a4582_0] Write session will restart in 0.009640s
2025-10-02T08:12:26.485033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb30c2b4-fdb61888-e86950af-401a4582_0] Write session: Do CDS request
2025-10-02T08:12:26.485041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb30c2b4-fdb61888-e86950af-401a4582_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:26.487785Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:26.496702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb30c2b4-fdb61888-e86950af-401a4582_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.496835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:26.496851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1476
2025-10-02T08:12:26.500903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.500945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:26.500949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:26.500952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:26.501301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1476 sessionId:  describe result for acl check
2025-10-02T08:12:26.501321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:26.501323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:26.501324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:26.501328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534306288541166:3081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:26.501695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534306288541166:3081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:26.504556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534306288541166:3081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:26.510499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534306288541166:3081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:26.510517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534306288541166:3081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:26.510519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534306288541166:3081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:26.510527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:26.525422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:26.527180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:26.527489Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:26.527512Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:26.527524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:26.527581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:26.527621Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534306288541596:3089]
2025-10-02T08:12:26.528144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:26.528299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:26.528337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:26.528605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:26.528646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.528651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.528652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.528653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.528654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.528659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.528667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.528671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.528674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.528677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.528681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.528688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.528694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.528698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.528704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.528713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.528717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.528721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.528729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.528734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.528755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:26.536406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:26.537900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:26.537918Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:26.537921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:26.537925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:26.537931Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1475 [1:7556534306288541596:3089]
2025-10-02T08:12:26.537942Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:26.537959Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:26.537966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.537970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.537973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.537990Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:26.537999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:26.538009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:26.538070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.538079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.538082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:26.538084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:26.538146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:26.538154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.538167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.538183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:26.538204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288541232:3081], now have 1 active actors on pipe
2025-10-02T08:12:26.538210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1475
2025-10-02T08:12:26.538211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534306748371940:2378], now have 1 active actors on pipe
2025-10-02T08:12:26.538217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534306288541590:3089]
2025-10-02T08:12:26.538220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534306288541590:3089]
2025-10-02T08:12:26.538231Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:26.538256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:26.538257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.538261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.538264Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:26.538277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:26.538290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:26.538299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:26.538301Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1475
2025-10-02T08:12:26.538341Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:26.538350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.538358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.538360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:26.538368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.538380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:26.538396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534306288541590:3089]
2025-10-02T08:12:26.538410Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:26.538440Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:26.538444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.538480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.538489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.538502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.538537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1476 partition: 0 MaxSeqNo: 17 sessionId: src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0
2025-10-02T08:12:26.538841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb30c2b4-fdb61888-e86950af-401a4582_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:26.541335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0] Write session: try to update token
2025-10-02T08:12:26.541349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:26.555826Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:26.555844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:26.555847Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:26.555856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534306288541590:3089]
2025-10-02T08:12:26.555860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534306288541590:3089]
2025-10-02T08:12:26.555905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:26.555905Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:26.555912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:26.555917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.555920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:26.556069Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:26.558509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId: src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:26.561480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:26.583371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534306288541623:4654]
2025-10-02T08:12:26.583485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1475, pipe: [1:7556534306288541623:4654]
2025-10-02T08:12:26.694353Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:26.694770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.694781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.694812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288541623:4654], now have 1 active actors on pipe
2025-10-02T08:12:26.694945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534306288541623:4654]
2025-10-02T08:12:26.695019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:26.695029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:26.695036Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:26.695090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1476 reason: error at write: Disconnected sessionId: src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0
2025-10-02T08:12:26.695187Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:26.695261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1476 sessionId: src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0 is DEAD
2025-10-02T08:12:26.695388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:26.695397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0] Write session will restart in 0.006323s
2025-10-02T08:12:26.695420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0] Write session: Do CDS request
2025-10-02T08:12:26.695426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:26.703438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.703442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:26.703457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1477
2025-10-02T08:12:26.703616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.703646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:26.703655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:26.703658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:26.704173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1477 sessionId:  describe result for acl check
2025-10-02T08:12:26.704207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:26.704214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:26.704216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:26.704222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534306288542019:3057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:26.704710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534306288542019:3057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:26.707186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534306288542019:3057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:26.710596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534306288542019:3057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:26.710609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534306288542019:3057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:26.710612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534306288542019:3057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:26.710622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:26.715624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:26.715903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:26.716053Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:26.716063Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:26.716072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:26.716123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:26.716162Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534306288542385:3063]
2025-10-02T08:12:26.716818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:26.716996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:26.717037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:26.717331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:26.717374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.717380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.717381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.717382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.717383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.717387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.717397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.717401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.717409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.717417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.717427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.717438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.717448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.717457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.717466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.717475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.717484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.717493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.717502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.717510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.717533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:26.725440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:26.727290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:26.727310Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:26.727312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:26.727316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:26.727323Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1476 [1:7556534306288542385:3063]
2025-10-02T08:12:26.727336Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:26.727354Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:26.727358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.727360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.727363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.727380Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:26.727385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:26.727391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:26.727452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.727461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.727464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:26.727466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:26.727529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:26.727541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.727555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.727567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:26.727585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288542312:3057], now have 1 active actors on pipe
2025-10-02T08:12:26.727589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534306748371948:2378], now have 1 active actors on pipe
2025-10-02T08:12:26.727595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534306288542379:3063]
2025-10-02T08:12:26.727597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534306288542379:3063]
2025-10-02T08:12:26.727604Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:26.727607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1476
2025-10-02T08:12:26.727614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:26.727616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:26.727622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:26.727637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:26.727644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:26.727651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.727655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.727693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534306288542379:3063]
2025-10-02T08:12:26.727705Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:26.727719Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a395574c-30e5eb5-41bd28e-77f023a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:26.727726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.727729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.727731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:26.727730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:26.727740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.727753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:26.727726Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1476
2025-10-02T08:12:26.727793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.727878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.727885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.727897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.727932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1477 partition: 0 MaxSeqNo: 17 sessionId: src_id|a395574c-30e5eb5-41bd28e-77f023a4_0
2025-10-02T08:12:26.728285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1059f980-d35e9d8d-df029cea-61f6fa13_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a395574c-30e5eb5-41bd28e-77f023a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:26.730844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a395574c-30e5eb5-41bd28e-77f023a4_0] Write session: try to update token
2025-10-02T08:12:26.730861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a395574c-30e5eb5-41bd28e-77f023a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:26.744596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId: src_id|a395574c-30e5eb5-41bd28e-77f023a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:26.745639Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:26.745656Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:26.745658Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:26.745668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534306288542379:3063]
2025-10-02T08:12:26.745673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534306288542379:3063]
2025-10-02T08:12:26.745710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:26.745715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:26.745722Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:26.745722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.745724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:26.745861Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:26.747121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:26.795351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534306288542413:4654]
2025-10-02T08:12:26.795450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1476, pipe: [1:7556534306288542413:4654]
2025-10-02T08:12:26.886203Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:26.886895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.886908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.886940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288542413:4654], now have 1 active actors on pipe
2025-10-02T08:12:26.887096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:26.887108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:26.887129Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:26.887160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1477 reason: error at write: Disconnected sessionId: src_id|a395574c-30e5eb5-41bd28e-77f023a4_0
2025-10-02T08:12:26.887251Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:26.887301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1477 sessionId: src_id|a395574c-30e5eb5-41bd28e-77f023a4_0 is DEAD
2025-10-02T08:12:26.887463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534306288542413:4654]
2025-10-02T08:12:26.887487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a395574c-30e5eb5-41bd28e-77f023a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:26.887500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a395574c-30e5eb5-41bd28e-77f023a4_0] Write session will restart in 0.006222s
2025-10-02T08:12:26.887523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a395574c-30e5eb5-41bd28e-77f023a4_0] Write session: Do CDS request
2025-10-02T08:12:26.887528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a395574c-30e5eb5-41bd28e-77f023a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:26.895271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a395574c-30e5eb5-41bd28e-77f023a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.895308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:26.895320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1478
2025-10-02T08:12:26.895473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:26.895501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:26.895509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:26.895513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:26.895835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1478 sessionId:  describe result for acl check
2025-10-02T08:12:26.895861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:26.895866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:26.895868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:26.895871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534306288542836:3039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:26.896255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534306288542836:3039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:26.898545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534306288542836:3039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:26.901235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534306288542836:3039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:26.901249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534306288542836:3039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:26.901252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534306288542836:3039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:26.901264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:26.904870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:26.906498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:26.906682Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:26.906694Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:26.906705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:26.906759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:26.906798Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534306288543171:3038]
2025-10-02T08:12:26.907411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:26.907596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:26.907641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:26.907914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:26.907961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.907967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.907968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.907969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.907970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.907974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.907984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.907987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.907990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.907994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.907999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.908005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:26.908010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.908014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:26.908018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.908028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:26.908031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.908039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.908043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.908048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.908070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:26.915753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:26.917375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:26.917394Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:26.917397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:26.917400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:26.917406Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1477 [1:7556534306288543171:3038]
2025-10-02T08:12:26.917418Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:26.917434Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:26.917436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.917439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.917441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.917455Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:26.917459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:26.917467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:26.917530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.917539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.917541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:26.917544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:26.917604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:26.917611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.917623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:26.917634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:26.917653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534306288543165:3038]
2025-10-02T08:12:26.917659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534306288543165:3038]
2025-10-02T08:12:26.917667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:26.917677Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:26.917681Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:26.917681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1477
2025-10-02T08:12:26.917683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288543087:3039], now have 1 active actors on pipe
2025-10-02T08:12:26.917689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534306748371955:2378], now have 1 active actors on pipe
2025-10-02T08:12:26.917694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:26.917707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:26.917710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:26.917716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.917719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.917754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534306288543165:3038]
2025-10-02T08:12:26.917762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:26.917767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:26.917744Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1477
2025-10-02T08:12:26.917774Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:26.917784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.917787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.917788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:26.917797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.917804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:26.917844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.917912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.917919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.917932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:26.917966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1478 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0
2025-10-02T08:12:26.918309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a395574c-30e5eb5-41bd28e-77f023a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:26.920841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0] Write session: try to update token
2025-10-02T08:12:26.920857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:26.928376Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:26.928393Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:26.928399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534306288543165:3038]
2025-10-02T08:12:26.928436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:26.928450Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:26.928621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:26.928759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:26.928916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:26.929059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:26.929251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:26.929292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:26.934482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId: src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:26.936773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:26.936857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.936872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.936903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:26.936928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:26.936991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:26.937006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:26.937163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.937214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.937284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.937346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.937589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.937597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.937655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.937707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.937788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.937846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.937893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.937900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.937958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.938015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.938075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.938128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.938170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.938176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.938280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.938377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.938441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.938504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.938555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.938561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.938630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.938687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.938755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.938824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.938872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.938880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.938949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.939010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.939087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.939163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.939210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.939217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.939287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.939352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.939423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.939485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.939530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.939535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.939604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.939662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.939726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.939794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.939855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.939861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.939935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.939988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.940041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.940108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.940154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.940161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.940227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:26.940285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:26.940342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:26.940400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:26.940452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:26.940457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:26.940487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:26.940537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:26.940553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:26.940556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:26.940581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:26.940594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:26.940596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:26.940598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:26.940599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:26.940970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:26.940988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:26.940993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:26.940995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:26.940997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:26.940999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:26.941582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:26.941600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:26.941604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:26.941606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:26.941608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:26.941610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:26.942006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:26.942022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:26.942025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:26.942029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:26.942036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:26.943089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:26.943102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:26.943111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392746942
2025-10-02T08:12:26.943248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:26.943258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:26.943261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:26.943263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:26.943266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:26.943268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:26.943662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:26.943679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:26.943683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:26.943685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:26.943688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:26.943692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:26.944081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:26.944104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:26.944109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:26.944111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:26.944113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:26.944115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:26.944507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:26.944526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:26.944532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:26.945549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:26.945562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:26.945567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:26.945569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:26.945575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392746945
2025-10-02T08:12:26.945852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:26.945865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:26.945869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:26.945871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:26.945873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:26.945877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:26.946271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:26.946287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:26.946292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:26.946296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:26.946298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:26.946300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:26.946741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:26.946755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:26.946825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392746946
2025-10-02T08:12:26.947489Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:26.947500Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:26.947505Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:26.947509Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:26.948992Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:26.949002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:26.949003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:26.949010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534306288543165:3038]
2025-10-02T08:12:26.949013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534306288543165:3038]
2025-10-02T08:12:26.949070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:26.949080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:26.949081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:26.949101Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:26.949105Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:26.949207Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:26.987841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534306288543205:4654]
2025-10-02T08:12:26.987953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1477, pipe: [1:7556534306288543205:4654]
2025-10-02T08:12:27.082075Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:27.082457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534306288543205:4654], now have 1 active actors on pipe
2025-10-02T08:12:27.082592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534306288543205:4654]
2025-10-02T08:12:27.082613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:27.082619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:27.082640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1478 reason: error at write: Disconnected sessionId: src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0
2025-10-02T08:12:27.082703Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:27.082800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1478 sessionId: src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0 is DEAD
2025-10-02T08:12:27.083008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:27.083024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0] Write session will restart in 0.007446s
2025-10-02T08:12:27.083050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0] Write session: Do CDS request
2025-10-02T08:12:27.083057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:27.084876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:27.091510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.091502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:27.091518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1479
2025-10-02T08:12:27.091809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.091845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:27.091853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:27.091857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:27.092264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1479 sessionId:  describe result for acl check
2025-10-02T08:12:27.092293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:27.092297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:27.092298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:27.092302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534310583510911:3025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:27.092685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534310583510911:3025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:27.095413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534310583510911:3025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:27.098465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534310583510911:3025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:27.098480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534310583510911:3025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:27.098483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534310583510911:3025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:27.098494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:27.102864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:27.104765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:27.105016Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:27.105042Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:27.105056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:27.105130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:27.105186Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534310583511263:3027]
2025-10-02T08:12:27.105885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:27.106117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:27.106170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:27.106501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:27.106544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.106550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.106552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.106553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.106554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.106560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.106569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.106578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.106582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.106590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.106596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.106609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.106615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.106620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.106625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.106631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.106635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.106640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.106645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.106651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.106668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:27.114592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:27.116133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:27.116149Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:27.116151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:27.116155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:27.116161Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1478 [1:7556534310583511263:3027]
2025-10-02T08:12:27.116172Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:27.116187Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:27.116191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.116194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.116196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.116212Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:27.116217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:27.116223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:27.116278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.116287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.116290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:27.116293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:27.116353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:27.116362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.116374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.116390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1478
2025-10-02T08:12:27.116481Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1478
2025-10-02T08:12:27.116393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:27.116411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583511176:3025], now have 1 active actors on pipe
2025-10-02T08:12:27.116414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534311043339260:2378], now have 1 active actors on pipe
2025-10-02T08:12:27.116420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.116423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.116439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534310583511257:3027]
2025-10-02T08:12:27.116442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534310583511257:3027]
2025-10-02T08:12:27.116453Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:27.116467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:27.116481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:27.116471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:27.116483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:27.116487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:27.116497Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:27.116504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.116507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.116509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:27.116518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.116526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:27.116558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534310583511257:3027]
2025-10-02T08:12:27.116568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:27.116583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:27.116584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.116645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.116658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.116672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.116709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1479 partition: 0 MaxSeqNo: 17 sessionId: src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0
2025-10-02T08:12:27.117051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e65a7e9-c7be695b-84a480b6-a3dcb7ef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:27.119621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0] Write session: try to update token
2025-10-02T08:12:27.119635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:27.126770Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:27.126787Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:27.126794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534310583511257:3027]
2025-10-02T08:12:27.126834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:27.126837Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:27.127002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:27.127139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.127267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.127414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.127733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:27.127775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:27.132738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId: src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:27.135006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:27.135474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.135485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.135513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:27.135527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:27.135573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.135578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.135705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.135763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.135819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.135873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.135916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.135926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.135994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.136051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.136119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.136183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.136224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.136231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.136296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.136351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.136406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.136463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.136507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.136513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.136576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.136645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.136711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.136782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.136876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.136883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.136970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.137053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.137130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.137202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.137245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.137252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.137328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.137390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.137462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.137542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.137598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.137607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.137695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.137763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.137841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.137915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.137963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.137969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.138051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.138119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.138185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.138281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.138332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.138340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.138410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.138465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.138568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.138632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.138694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.138700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.138769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.138840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.138901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.138960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.139008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.139014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.139050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:27.139111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.139133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.139138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:27.139169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:27.139185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:27.139192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:27.139195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:27.139199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:27.139597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:27.139621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:27.139628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:27.139631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:27.139634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:27.139638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:27.140118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:27.140138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:27.140144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:27.140147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:27.140151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:27.140154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:27.140603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:27.140624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:27.140630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:27.140632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:27.140635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:27.147894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:27.147922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:27.147936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392747147
2025-10-02T08:12:27.148074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:27.148099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:27.148106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:27.148109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:27.148120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:27.148128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:27.148539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:27.148564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:27.148570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:27.148575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:27.148580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:27.148583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:27.149009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:27.149034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:27.149043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:27.149047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:27.149050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:27.149053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:27.149503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:27.149533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:27.149539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:27.150572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:27.150590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:27.150595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:27.150603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:27.150611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392747150
2025-10-02T08:12:27.150871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:27.150891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:27.150896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:27.150899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:27.150904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:27.150909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:27.151316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:27.151348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:27.151353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:27.151357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:27.151359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:27.151362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:27.151763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:27.151780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.151851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392747151
2025-10-02T08:12:27.155116Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:27.155142Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:27.155148Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:27.155153Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:27.156616Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:27.156631Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:27.156633Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:27.156643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534310583511257:3027]
2025-10-02T08:12:27.156646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534310583511257:3027]
2025-10-02T08:12:27.156691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:27.156703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:27.156706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:27.156707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.156708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:27.156864Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:27.182941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534310583511324:4654]
2025-10-02T08:12:27.183032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1478, pipe: [1:7556534310583511324:4654]
2025-10-02T08:12:27.291098Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:27.291444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583511324:4654], now have 1 active actors on pipe
2025-10-02T08:12:27.291542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534310583511324:4654]
2025-10-02T08:12:27.291674Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:27.291778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:27.291817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1479 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0
2025-10-02T08:12:27.291996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1479 sessionId: src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0 is DEAD
2025-10-02T08:12:27.292285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:27.292297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0] Write session will restart in 0.009782s
2025-10-02T08:12:27.292320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0] Write session: Do CDS request
2025-10-02T08:12:27.292327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:27.292053Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:27.305337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.307415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:27.307430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1480
2025-10-02T08:12:27.307575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.307608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:27.307618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:27.307622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:27.308283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1480 sessionId:  describe result for acl check
2025-10-02T08:12:27.308323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:27.308330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:27.308331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:27.308337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534310583511749:2997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:27.308937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534310583511749:2997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:27.312607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534310583511749:2997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:27.316247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534310583511749:2997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:27.316263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534310583511749:2997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:27.316267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534310583511749:2997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:27.316275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:27.326154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:27.326939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:27.327218Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:27.327235Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:27.327248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:27.327324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:27.327363Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534310583512184:2998]
2025-10-02T08:12:27.328002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:27.328194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:27.328233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:27.328469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:27.328509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.328517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.328518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.328518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.328519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.328524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.328534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.328537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.328540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.328543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.328549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.328561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.328566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.328570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.328573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.328578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.328581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.328585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.328593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.328598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.328621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:27.341594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:27.343217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:27.343239Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:27.343243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:27.343247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:27.343254Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1479 [1:7556534310583512184:2998]
2025-10-02T08:12:27.343268Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:27.343286Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:27.343290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.343292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.343294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.343311Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:27.343316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:27.343323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:27.343389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.343391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.343394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:27.343397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:27.343480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:27.343483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.343497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.343506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:27.343527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583511914:2997], now have 1 active actors on pipe
2025-10-02T08:12:27.343534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534310583512178:2998]
2025-10-02T08:12:27.343536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534310583512178:2998]
2025-10-02T08:12:27.343545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:27.343557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534311043339300:2378], now have 1 active actors on pipe
2025-10-02T08:12:27.343563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:27.343570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:27.343573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:27.343576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:27.343579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:27.343611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534310583512178:2998]
2025-10-02T08:12:27.343614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:27.343670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1479
2025-10-02T08:12:27.343759Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:27.343854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.343868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.343894Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:27.343901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.343906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.343909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:27.343921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.343932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:27.343952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.344114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.344123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.344137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.344168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1480 partition: 0 MaxSeqNo: 17 sessionId: src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0
2025-10-02T08:12:27.344068Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1479
2025-10-02T08:12:27.344956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e044b7-5020c80a-d49a1bd5-ea3a193c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:27.347689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0] Write session: try to update token
2025-10-02T08:12:27.347705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:27.367311Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:27.367331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:27.367334Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:27.367341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534310583512178:2998]
2025-10-02T08:12:27.367347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534310583512178:2998]
2025-10-02T08:12:27.367385Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:27.367388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:27.367391Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:27.367394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.367397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:27.367534Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:27.374743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId: src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:27.377603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:27.391873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534310583512208:4654]
2025-10-02T08:12:27.392035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1479, pipe: [1:7556534310583512208:4654]
2025-10-02T08:12:27.512966Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:27.513666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.513691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.513737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583512208:4654], now have 1 active actors on pipe
2025-10-02T08:12:27.514371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:27.514382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0] Write session will restart in 0.006112s
2025-10-02T08:12:27.514407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0] Write session: Do CDS request
2025-10-02T08:12:27.513887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534310583512208:4654]
2025-10-02T08:12:27.514413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:27.513921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:27.513924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:27.513994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1480 reason: error at write: Disconnected sessionId: src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0
2025-10-02T08:12:27.514192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1480 sessionId: src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0 is DEAD
2025-10-02T08:12:27.515080Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:27.515699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:27.521420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.521477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:27.521493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1481
2025-10-02T08:12:27.521639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.521680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:27.521688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:27.521691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:27.522043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1481 sessionId:  describe result for acl check
2025-10-02T08:12:27.522073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:27.522079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:27.522080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:27.522085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534310583512557:2981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:27.522555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534310583512557:2981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:27.525142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534310583512557:2981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:27.528441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534310583512557:2981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:27.528456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534310583512557:2981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:27.528459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534310583512557:2981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:27.528468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:27.534092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:27.534381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:27.534534Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:27.534544Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:27.534553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:27.534594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:27.534628Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534310583513046:2977]
2025-10-02T08:12:27.535242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:27.535406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:27.535441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:27.535718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:27.535756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.535761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.535762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.535763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.535764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.535768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.535777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.535780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.535784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.535786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.535792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.535798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.535802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.535806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.535810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.535815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.535819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.535824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.535828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.535832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.535847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:27.543539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:27.545405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:27.545424Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:27.545426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:27.545428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:27.545433Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1480 [1:7556534310583513046:2977]
2025-10-02T08:12:27.545440Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:27.545454Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:27.545456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.545458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.545459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.545472Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:27.545475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:27.545484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:27.545532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.545539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.545541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:27.545542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:27.545583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:27.545589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.545597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.545607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:27.545620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583512896:2981], now have 1 active actors on pipe
2025-10-02T08:12:27.545628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534310583513040:2977]
2025-10-02T08:12:27.545629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534310583513040:2977]
2025-10-02T08:12:27.545634Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:27.545637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1480
2025-10-02T08:12:27.545642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:27.545646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:27.545649Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:27.545650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:27.545652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:27.545655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534311043339307:2378], now have 1 active actors on pipe
2025-10-02T08:12:27.545659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.545661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.545690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534310583513040:2977]
2025-10-02T08:12:27.545702Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:27.545716Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:27.545707Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1480
2025-10-02T08:12:27.545724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.545726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.545728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:27.545731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:27.545734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.545740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:27.545771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.545814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.545819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.545828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.545870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1481 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0
2025-10-02T08:12:27.546194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bac5dab-9dbc17da-661f40e7-d0794dc2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:27.549016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0] Write session: try to update token
2025-10-02T08:12:27.549031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:27.563245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId: src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:27.564160Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:27.564179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:27.564181Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:27.564191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534310583513040:2977]
2025-10-02T08:12:27.564195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534310583513040:2977]
2025-10-02T08:12:27.564238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:27.564248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.564254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:27.564260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:27.564277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:27.564399Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:27.565964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:27.614033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534310583513075:4654]
2025-10-02T08:12:27.614190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1480, pipe: [1:7556534310583513075:4654]
2025-10-02T08:12:27.708207Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:27.708696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.708710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.708751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583513075:4654], now have 1 active actors on pipe
2025-10-02T08:12:27.708984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:27.708883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:27.708896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:27.708956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1481 reason: error at write: Disconnected sessionId: src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0
2025-10-02T08:12:27.709134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1481 sessionId: src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0 is DEAD
2025-10-02T08:12:27.709212Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:27.709403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534310583513075:4654]
2025-10-02T08:12:27.709476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:27.709495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0] Write session will restart in 0.009849s
2025-10-02T08:12:27.709529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0] Write session: Do CDS request
2025-10-02T08:12:27.709537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:27.720573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.720659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:27.720679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1482
2025-10-02T08:12:27.720871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.720909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:27.720918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:27.720921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:27.721315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1482 sessionId:  describe result for acl check
2025-10-02T08:12:27.721360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:27.721362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:27.721364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:27.721369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534310583513671:2968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:27.721764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534310583513671:2968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:27.724267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534310583513671:2968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:27.727039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534310583513671:2968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:27.727055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534310583513671:2968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:27.727059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534310583513671:2968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:27.727068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:27.728041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:27.728486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:27.728650Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:27.728659Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:27.728669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:27.728713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:27.728747Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534310583513922:2972]
2025-10-02T08:12:27.729370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:27.729829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:27.729874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:27.730103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:27.730172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.730177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.730177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.730178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.730178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.730182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.730190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.730192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.730194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.730196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.730200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.730204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.730208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.730211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.730213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.730216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.730218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.730221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.730223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.730226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.730237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:27.738286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:27.740015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:27.740030Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:27.740032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:27.740035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:27.740039Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1481 [1:7556534310583513922:2972]
2025-10-02T08:12:27.740047Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:27.740061Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:27.740063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.740065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.740066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.740078Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:27.740081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:27.740086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:27.740151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.740158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.740160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:27.740162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:27.740231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:27.740240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.740251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.740262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:27.740279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583513907:2968], now have 1 active actors on pipe
2025-10-02T08:12:27.740289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534310583513910:2972]
2025-10-02T08:12:27.740291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534310583513910:2972]
2025-10-02T08:12:27.740298Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:27.740310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:27.740310Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:27.740314Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:27.740327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:27.740330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:27.740335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534311043339315:2378], now have 1 active actors on pipe
2025-10-02T08:12:27.740339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.740343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.740382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534310583513910:2972]
2025-10-02T08:12:27.740397Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:27.740409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:27.740412Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e198b77-50248e0e-5e4a2240-c802d754_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:27.740418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.740424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.740426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:27.740434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.740442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:27.740411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1481
2025-10-02T08:12:27.740484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1481
2025-10-02T08:12:27.740492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.740568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.740576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.740592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.740631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1482 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e198b77-50248e0e-5e4a2240-c802d754_0
2025-10-02T08:12:27.740989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9dd5805-db8a17fe-c4af42ea-5bd161f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e198b77-50248e0e-5e4a2240-c802d754_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:27.743690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e198b77-50248e0e-5e4a2240-c802d754_0] Write session: try to update token
2025-10-02T08:12:27.743710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e198b77-50248e0e-5e4a2240-c802d754_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:27.751046Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:27.751064Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:27.751071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534310583513910:2972]
2025-10-02T08:12:27.751103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:27.751113Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:27.751261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:27.751381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.751504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.751627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.751809Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:27.751845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:27.758160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId: src_id|8e198b77-50248e0e-5e4a2240-c802d754_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:27.760775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:27.760861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.760872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.760899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:27.760919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:27.760971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.760985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.761158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.761224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.761288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.761353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.761755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.761784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.761853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.761917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.761985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.762057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.762106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.762115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.762183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.762244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.762308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.762368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.762412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.762419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.762489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.762557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.762636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.762708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.762761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.762767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.762847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.762922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.762997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.763071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.763125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.763134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.763215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.763288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.763364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.763444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.763494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.763497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.763578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.763644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.763716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.763814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.763865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.763869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.763949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.764017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.764087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.764173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.764223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.764226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.764309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.764367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.764427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.764490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.764540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.764542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.764619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.764684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.764743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.764946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.765001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.765007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.765055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:27.765134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.765159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.765166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:27.765197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:27.765214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:27.765222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:27.765225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:27.765228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:27.765637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:27.765661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:27.765666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:27.765669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:27.765671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:27.765673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:27.766232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:27.766250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:27.766254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:27.766257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:27.766259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:27.766261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:27.766833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:27.766854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:27.766858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:27.766861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:27.766863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:27.768023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:27.768045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:27.768056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392747767
2025-10-02T08:12:27.768250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:27.768271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:27.768279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:27.768283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:27.768288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:27.768291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:27.768772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:27.768785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:27.768794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:27.768895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:27.768907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:27.768910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:27.769366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:27.769387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:27.769397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:27.769405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:27.769409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:27.769412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:27.769912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:27.769936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:27.769945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:27.771109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:27.771132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:27.771138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:27.771142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:27.771152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392747771
2025-10-02T08:12:27.771465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:27.771487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:27.771496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:27.771499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:27.771510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:27.771513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:27.772010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:27.772035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:27.772041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:27.772044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:27.772048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:27.772052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:27.772506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:27.772527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.772627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392747772
2025-10-02T08:12:27.774576Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:27.774595Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:27.774601Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:27.774608Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:27.776199Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:27.776214Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:27.776216Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:27.776226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534310583513910:2972]
2025-10-02T08:12:27.776230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534310583513910:2972]
2025-10-02T08:12:27.776276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:27.776283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.776284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:27.776290Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:27.776296Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:27.776421Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:27.809594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534310583513963:4654]
2025-10-02T08:12:27.809673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1481, pipe: [1:7556534310583513963:4654]
2025-10-02T08:12:27.911848Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:27.912178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583513963:4654], now have 1 active actors on pipe
2025-10-02T08:12:27.912277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534310583513963:4654]
2025-10-02T08:12:27.912293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:27.912295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:27.912313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1482 reason: error at write: Disconnected sessionId: src_id|8e198b77-50248e0e-5e4a2240-c802d754_0
2025-10-02T08:12:27.912357Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:27.912430Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:27.912465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1482 sessionId: src_id|8e198b77-50248e0e-5e4a2240-c802d754_0 is DEAD
2025-10-02T08:12:27.912632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e198b77-50248e0e-5e4a2240-c802d754_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:27.912642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e198b77-50248e0e-5e4a2240-c802d754_0] Write session will restart in 0.008102s
2025-10-02T08:12:27.912666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e198b77-50248e0e-5e4a2240-c802d754_0] Write session: Do CDS request
2025-10-02T08:12:27.912672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e198b77-50248e0e-5e4a2240-c802d754_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:27.917779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:27.918343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:27.918506Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:27.918515Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:27.918525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:27.918569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:27.918610Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534310583514027:2950]
2025-10-02T08:12:27.919233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:27.919390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:27.919428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:27.919713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:27.919751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.919757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.919758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.919759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.919760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.919765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.919777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.919783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.919787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.919796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.919802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.919808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:27.919814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.919823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:27.919828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.919833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:27.919841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.919848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.919856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.919862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.919885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:27.922300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e198b77-50248e0e-5e4a2240-c802d754_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.922402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:27.922416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1483
2025-10-02T08:12:27.922565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:27.922603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:27.922615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:27.922619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:27.923038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1483 sessionId:  describe result for acl check
2025-10-02T08:12:27.923066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:27.923072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:27.923074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:27.923079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534310583514043:2958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:27.923561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534310583514043:2958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:27.926126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534310583514043:2958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:27.927569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:27.928799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534310583514043:2958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:27.928829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534310583514043:2958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:27.928833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534310583514043:2958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:27.928840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:27.929033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:27.929047Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:27.929049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:27.929053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:27.929058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1482 [1:7556534310583514027:2950]
2025-10-02T08:12:27.929067Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:27.929082Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:27.929092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.929094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.929097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.929113Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:27.929122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:27.929127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:27.929227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.929235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.929238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:27.929240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:27.929303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:27.929310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.929323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:27.929340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:27.929340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1482
2025-10-02T08:12:27.929360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534310583514074:2958], now have 1 active actors on pipe
2025-10-02T08:12:27.929366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534311043339324:2378], now have 1 active actors on pipe
2025-10-02T08:12:27.929371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.929375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.929388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534310583514021:2950]
2025-10-02T08:12:27.929395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534310583514021:2950]
2025-10-02T08:12:27.929405Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:27.929420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:27.929422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:27.929425Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:27.929390Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1482
2025-10-02T08:12:27.929433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:27.929440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:27.929456Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:27.929461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.929464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.929467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:27.929475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.929487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:27.929529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534310583514021:2950]
2025-10-02T08:12:27.929540Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:27.929545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:27.929554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.929644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.929651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.929663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:27.929696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1483 partition: 0 MaxSeqNo: 17 sessionId: src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0
2025-10-02T08:12:27.930020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e198b77-50248e0e-5e4a2240-c802d754_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:27.932631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0] Write session: try to update token
2025-10-02T08:12:27.932646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:27.940059Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:27.940078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:27.940108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534310583514021:2950]
2025-10-02T08:12:27.940151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:27.940156Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:27.940324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:27.940458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.940588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.940720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:27.940935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:27.940973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:27.947542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId: src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:27.950156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:27.950227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.950241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.950272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:27.950296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:27.950354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:27.950367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:27.950535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.950603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.950679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.950744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.950803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.950812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.950881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.950947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.951012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.951080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.951123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.951132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.951202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.951267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.951329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.951394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.951438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.951443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.951510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.951577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.951643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.951712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.951772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.951781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.951859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.951935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.952012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.952089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.952185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.952193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.952276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.952346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.952422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.952497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.952553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.952561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.952647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.952712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.952785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.952873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.952926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.952933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.953012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.953083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.953155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.953223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.953269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.953276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.953346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.953399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.953459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.953517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.953577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.953584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.953659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:27.953720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:27.953775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:27.953849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:27.953897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:27.953903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:27.953941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:27.953990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:27.954008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:27.954010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:27.954036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:27.954046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:27.954050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:27.954052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:27.954056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:27.954415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:27.954436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:27.954440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:27.954443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:27.954445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:27.954447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:27.954999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:27.955023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:27.955026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:27.955028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:27.955030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:27.955032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:27.955466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:27.955487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:27.955497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:27.955504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:27.955507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:27.956743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:27.956763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:27.956775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392747956
2025-10-02T08:12:27.956943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:27.956956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:27.956960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:27.956962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:27.956965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:27.956967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:27.957515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:27.957538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:27.957544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:27.957547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:27.957551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:27.957554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:27.958040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:27.958069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:27.958076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:27.958082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:27.958091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:27.958094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:27.958526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:27.958542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:27.958546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:27.959585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:27.959600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:27.959604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:27.959606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:27.959613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392747959
2025-10-02T08:12:27.959860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:27.959874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:27.959878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:27.959880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:27.959882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:27.959885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:27.960344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:27.960365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:27.960371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:27.960374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:27.960377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:27.960385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:27.960848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:27.960870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:27.960964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392747960
2025-10-02T08:12:27.961773Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:27.961790Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:27.961795Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:27.961800Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:27.963474Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:27.963492Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:27.963493Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:27.963507Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534310583514021:2950]
2025-10-02T08:12:27.963511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534310583514021:2950]
2025-10-02T08:12:27.963560Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:27.963568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:27.963572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:27.963575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:27.963576Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:27.963722Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:28.012368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534314878481391:4654]
2025-10-02T08:12:28.012491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1482, pipe: [1:7556534314878481391:4654]
2025-10-02T08:12:28.104138Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:28.104510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481391:4654], now have 1 active actors on pipe
2025-10-02T08:12:28.104614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:28.104620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:28.104644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1483 reason: error at write: Disconnected sessionId: src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0
2025-10-02T08:12:28.104685Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:28.104742Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:28.104823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1483 sessionId: src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0 is DEAD
2025-10-02T08:12:28.104985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534314878481391:4654]
2025-10-02T08:12:28.105011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:28.105021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0] Write session will restart in 0.005136s
2025-10-02T08:12:28.105045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0] Write session: Do CDS request
2025-10-02T08:12:28.105051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:28.110159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:28.110574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:28.110803Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:28.110812Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:28.110824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:28.110879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:28.110928Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534314878481450:2954]
2025-10-02T08:12:28.111300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.111338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:28.111349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1484
2025-10-02T08:12:28.111517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.111535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:28.111543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:28.111548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:28.111552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:28.111737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:28.111783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:28.111895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1484 sessionId:  describe result for acl check
2025-10-02T08:12:28.111926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:28.111927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:28.111929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:28.111934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534314878481461:2952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:28.112084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:28.112134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.112140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.112141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.112142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.112146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.112152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.112160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.112162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.112164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.112166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.112170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.112174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.112178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.112181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.112183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.112185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.112187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.112190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.112192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.112197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.112214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:28.112405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534314878481461:2952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:28.114525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534314878481461:2952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:28.119753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534314878481461:2952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:28.119767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534314878481461:2952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:28.119774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534314878481461:2952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:28.119783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:28.120282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:28.121922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:28.121940Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:28.121943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:28.121946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:28.121951Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1483 [1:7556534314878481450:2954]
2025-10-02T08:12:28.121959Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:28.121972Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:28.121974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.121978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.121979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.121993Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:28.121996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:28.122000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:28.122045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.122054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.122056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:28.122058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:28.122111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:28.122116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.122127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.122134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:28.122151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534314878481444:2954]
2025-10-02T08:12:28.122152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534314878481444:2954]
2025-10-02T08:12:28.122158Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:28.122169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481498:2952], now have 1 active actors on pipe
2025-10-02T08:12:28.122171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:28.122174Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:28.122174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1483
2025-10-02T08:12:28.122178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:28.122186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:28.122187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:28.122191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534315338306628:2378], now have 1 active actors on pipe
2025-10-02T08:12:28.122218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.122228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.122238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534314878481444:2954]
2025-10-02T08:12:28.122240Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:28.122261Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74020de6-174daafa-7245ca3c-cbeee694_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:28.122266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.122267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:28.122273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.122280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:28.122291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.122243Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1483
2025-10-02T08:12:28.122299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:28.122331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.122401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.122407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.122418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.122444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1484 partition: 0 MaxSeqNo: 17 sessionId: src_id|74020de6-174daafa-7245ca3c-cbeee694_0
2025-10-02T08:12:28.122785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1247e4b-dbb8e42b-2ff814af-6fe45976_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74020de6-174daafa-7245ca3c-cbeee694_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:28.125608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74020de6-174daafa-7245ca3c-cbeee694_0] Write session: try to update token
2025-10-02T08:12:28.125626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74020de6-174daafa-7245ca3c-cbeee694_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:28.139740Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:28.139766Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:28.139769Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:28.139778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534314878481444:2954]
2025-10-02T08:12:28.139782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534314878481444:2954]
2025-10-02T08:12:28.139824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:28.139829Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:28.139831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.139833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:28.139834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:28.139973Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:28.142117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId: src_id|74020de6-174daafa-7245ca3c-cbeee694_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:28.144797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:28.204910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534314878481533:4654]
2025-10-02T08:12:28.205096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1483, pipe: [1:7556534314878481533:4654]
2025-10-02T08:12:28.287816Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:28.288181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.288191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.288228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481533:4654], now have 1 active actors on pipe
2025-10-02T08:12:28.288632Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:28.288983Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:28.289010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534314878481533:4654]
2025-10-02T08:12:28.289207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:28.289269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1484 reason: status is not ok: tablet will be restarted right now sessionId: src_id|74020de6-174daafa-7245ca3c-cbeee694_0
2025-10-02T08:12:28.289442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1484 sessionId: src_id|74020de6-174daafa-7245ca3c-cbeee694_0 is DEAD
2025-10-02T08:12:28.290388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74020de6-174daafa-7245ca3c-cbeee694_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:28.290399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74020de6-174daafa-7245ca3c-cbeee694_0] Write session will restart in 0.006865s
2025-10-02T08:12:28.290421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74020de6-174daafa-7245ca3c-cbeee694_0] Write session: Do CDS request
2025-10-02T08:12:28.290428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74020de6-174daafa-7245ca3c-cbeee694_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:28.298219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74020de6-174daafa-7245ca3c-cbeee694_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.298348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:28.298365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1485
2025-10-02T08:12:28.298479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.298514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:28.298519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:28.298523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:28.298984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1485 sessionId:  describe result for acl check
2025-10-02T08:12:28.299060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:28.299062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:28.299064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:28.299069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534314878481605:2876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:28.299591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534314878481605:2876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:28.301972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534314878481605:2876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:28.302674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:28.303314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:28.303494Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:28.303503Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:28.303513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:28.303565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:28.303607Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534314878481655:2871]
2025-10-02T08:12:28.304212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:28.304440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:28.304482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:28.304794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:28.304860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.304866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.304868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.304869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.304870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.304875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.304885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.304893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.304896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.304900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.304903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534314878481605:2876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:28.304908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.304914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534314878481605:2876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:28.304915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.304918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534314878481605:2876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:28.304920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.304925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.304927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:28.304929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.304933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.304938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.304943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.304947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.304952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.304972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:28.314935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:28.316516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:28.316523Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:28.316525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:28.316528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:28.316537Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1484 [1:7556534314878481655:2871]
2025-10-02T08:12:28.316550Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:28.316568Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:28.316571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.316574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.316576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.316591Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:28.316597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:28.316604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:28.316668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.316673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.316676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:28.316681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:28.316750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:28.316753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.316766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.316776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:28.316791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534314878481645:2871]
2025-10-02T08:12:28.316793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534314878481645:2871]
2025-10-02T08:12:28.316818Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:28.316835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:28.316847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:28.316849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:28.316887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481668:2876], now have 1 active actors on pipe
2025-10-02T08:12:28.316890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534314878481645:2871]
2025-10-02T08:12:28.316892Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:28.316939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1484
2025-10-02T08:12:28.316953Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:28.316957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:28.316963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:28.317881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74020de6-174daafa-7245ca3c-cbeee694_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:28.319013Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1484
2025-10-02T08:12:28.320638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0] Write session: try to update token
2025-10-02T08:12:28.320656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:28.317083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534315338306668:2378], now have 1 active actors on pipe
2025-10-02T08:12:28.317179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.317184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.317209Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:28.317216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.317220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.317223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:28.317233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.317245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:28.317259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.317286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.317288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.317300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.317330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1485 partition: 0 MaxSeqNo: 17 sessionId: src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0
2025-10-02T08:12:28.335826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId: src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:28.337208Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:28.337224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:28.337226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:28.337235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534314878481645:2871]
2025-10-02T08:12:28.337240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534314878481645:2871]
2025-10-02T08:12:28.337287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:28.337299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.337302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:28.337438Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:28.337826Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:28.337847Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:28.338598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:28.389226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534314878481687:4654]
2025-10-02T08:12:28.389388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1484, pipe: [1:7556534314878481687:4654]
2025-10-02T08:12:28.476412Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:28.476930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.476943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.476982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481687:4654], now have 1 active actors on pipe
2025-10-02T08:12:28.477058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:28.477061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:28.477108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1485 reason: error at write: Disconnected sessionId: src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0
2025-10-02T08:12:28.477213Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:28.477258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1485 sessionId: src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0 is DEAD
2025-10-02T08:12:28.477381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534314878481687:4654]
2025-10-02T08:12:28.477642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:28.477649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0] Write session will restart in 0.009162s
2025-10-02T08:12:28.477670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0] Write session: Do CDS request
2025-10-02T08:12:28.477679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:28.477219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:28.485397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:28.488121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:28.488290Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:28.488300Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:28.488309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:28.488361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:28.488393Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534314878481748:2867]
2025-10-02T08:12:28.489021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:28.489233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.489338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:28.489394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:28.489525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:28.489536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1486
2025-10-02T08:12:28.489650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.489676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:28.489685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:28.489688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:28.489699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:28.489753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.489759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.489761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.489762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.489763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.489768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.489777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.489781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.489785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.489788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.489795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.489802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.489807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.489812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.489816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.489821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.489829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.489834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.489839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.489849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.489866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:28.490016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1486 sessionId:  describe result for acl check
2025-10-02T08:12:28.490046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:28.490051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:28.490054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:28.490058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534314878481763:2862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:28.490530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534314878481763:2862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:28.492520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534314878481763:2862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:28.498268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534314878481763:2862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:28.498284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534314878481763:2862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:28.498287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534314878481763:2862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:28.498306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:28.498802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:28.500383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:28.500404Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:28.500407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:28.500411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:28.500418Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1485 [1:7556534314878481748:2867]
2025-10-02T08:12:28.500431Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:28.500447Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:28.500450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.500455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.500457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.500472Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:28.500486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:28.500492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:28.500550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.500554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.500558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:28.500560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:28.500732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:28.500735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.500748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.500762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:28.500779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534314878481742:2867]
2025-10-02T08:12:28.500780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534314878481742:2867]
2025-10-02T08:12:28.500787Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:28.500823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:28.500837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:28.500840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:28.500876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534314878481742:2867]
2025-10-02T08:12:28.500879Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:28.500977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:28.500979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:28.500984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:28.501127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1485
2025-10-02T08:12:28.501143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481796:2862], now have 1 active actors on pipe
2025-10-02T08:12:28.501156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.501161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.501183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534315338306677:2378], now have 1 active actors on pipe
2025-10-02T08:12:28.501198Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7258cf9-c570229e-f19c2897-7f34a68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:28.501207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.501211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.501213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:28.501226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.501244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:28.501261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.501524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.501530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.501556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.501588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1486 partition: 0 MaxSeqNo: 17 sessionId: src_id|e7258cf9-c570229e-f19c2897-7f34a68_0
2025-10-02T08:12:28.503785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f669e1-58ad06c4-e2b686ea-6e5c84b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e7258cf9-c570229e-f19c2897-7f34a68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:28.501358Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1485
2025-10-02T08:12:28.506432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7258cf9-c570229e-f19c2897-7f34a68_0] Write session: try to update token
2025-10-02T08:12:28.506447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7258cf9-c570229e-f19c2897-7f34a68_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:28.520635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId: src_id|e7258cf9-c570229e-f19c2897-7f34a68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:28.523299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:28.523382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.523395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.525576Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:28.525595Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:28.525597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:28.525605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534314878481742:2867]
2025-10-02T08:12:28.525609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534314878481742:2867]
2025-10-02T08:12:28.525656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:28.525655Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:28.525661Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:28.525672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:28.525679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.525682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:28.525830Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:28.528956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:28.577196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534314878481817:4654]
2025-10-02T08:12:28.578022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1485, pipe: [1:7556534314878481817:4654]
2025-10-02T08:12:28.675613Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:28.675928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.675937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.676120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.676181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.676242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.676302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.676350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.676355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.676430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.676487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.676544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.676605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.676645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.676648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.676718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.676772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.676965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.677030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.677070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.677073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.677151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.677216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.677284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.677361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.677409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.677412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.677491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.677556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.677649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.677730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.677790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.677799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.677880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.677951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.678022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.678096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.678157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.678165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.678239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.678306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.678386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.678457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.678593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.678604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.678681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.678748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.678820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.678915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.678972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.678976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.679052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.679111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.679167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.679229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.679298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.679304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.679377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:28.679436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:28.679493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:28.679567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:28.679624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:28.679632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:28.679700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481817:4654], now have 1 active actors on pipe
2025-10-02T08:12:28.680104Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:28.680370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7258cf9-c570229e-f19c2897-7f34a68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:28.680380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7258cf9-c570229e-f19c2897-7f34a68_0] Write session will restart in 0.005458s
2025-10-02T08:12:28.679829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:28.680402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7258cf9-c570229e-f19c2897-7f34a68_0] Write session: Do CDS request
2025-10-02T08:12:28.679840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:28.680409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7258cf9-c570229e-f19c2897-7f34a68_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:28.679869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1486 reason: error at write: Disconnected sessionId: src_id|e7258cf9-c570229e-f19c2897-7f34a68_0
2025-10-02T08:12:28.680020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1486 sessionId: src_id|e7258cf9-c570229e-f19c2897-7f34a68_0 is DEAD
2025-10-02T08:12:28.680143Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:28.680168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534314878481817:4654]
2025-10-02T08:12:28.685680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:28.686069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:28.686219Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:28.686228Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:28.686236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:28.686276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:28.686313Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534314878481882:2854]
2025-10-02T08:12:28.686913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:28.687082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:28.687123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:28.687252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7258cf9-c570229e-f19c2897-7f34a68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.687418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:28.687462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.687463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.687464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.687466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.687467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.687471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.687481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.687484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.687488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.687491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.687496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.687503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.687509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.687514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.687520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.687524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.687528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.687533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.687537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.687542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.687554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:28.687559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1487
2025-10-02T08:12:28.687559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:28.687675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.687706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:28.687715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:28.687718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:28.688064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1487 sessionId:  describe result for acl check
2025-10-02T08:12:28.688103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:28.688109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:28.688111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:28.688116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534314878481898:2838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:28.688606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534314878481898:2838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:28.690519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534314878481898:2838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:28.694974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534314878481898:2838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:28.694988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534314878481898:2838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:28.694991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534314878481898:2838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:28.694999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:28.695548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:28.697175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:28.697191Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:28.697194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:28.697198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:28.697204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1486 [1:7556534314878481882:2854]
2025-10-02T08:12:28.697214Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:28.697227Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:28.697230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.697233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.697236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.697250Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:28.697259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:28.697265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:28.697325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.697332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.697335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:28.697337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:28.697396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:28.697402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.697414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.697425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:28.697447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481930:2838], now have 1 active actors on pipe
2025-10-02T08:12:28.697460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1486
2025-10-02T08:12:28.697462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534314878481876:2854]
2025-10-02T08:12:28.697464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534314878481876:2854]
2025-10-02T08:12:28.697470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:28.697478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534315338306686:2378], now have 1 active actors on pipe
2025-10-02T08:12:28.697482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:28.697484Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:28.697486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:28.697500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:28.697502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:28.697508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.697513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.697521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1486
2025-10-02T08:12:28.697549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534314878481876:2854]
2025-10-02T08:12:28.697552Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:28.697556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:28.697566Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:28.697572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.697575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.697577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:28.697587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.697594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:28.697636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.697693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.697706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.697728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.697767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1487 partition: 0 MaxSeqNo: 17 sessionId: src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0
2025-10-02T08:12:28.698096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7258cf9-c570229e-f19c2897-7f34a68_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:28.700650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0] Write session: try to update token
2025-10-02T08:12:28.700669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:28.713997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId: src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:28.714693Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:28.714708Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:28.714710Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:28.714719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534314878481876:2854]
2025-10-02T08:12:28.714723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534314878481876:2854]
2025-10-02T08:12:28.714764Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:28.714766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:28.714771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.714774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:28.714777Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:28.714915Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:28.716894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:28.780371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534314878481949:4654]
2025-10-02T08:12:28.780496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1486, pipe: [1:7556534314878481949:4654]
2025-10-02T08:12:28.847443Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:28.847740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.847752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.847790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878481949:4654], now have 1 active actors on pipe
2025-10-02T08:12:28.847907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534314878481949:4654]
2025-10-02T08:12:28.847931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:28.847938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:28.847960Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:28.848001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1487 reason: error at write: Disconnected sessionId: src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0
2025-10-02T08:12:28.847992Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:28.848182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1487 sessionId: src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0 is DEAD
2025-10-02T08:12:28.848323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:28.848334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0] Write session will restart in 0.005980s
2025-10-02T08:12:28.848359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0] Write session: Do CDS request
2025-10-02T08:12:28.848366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:28.852756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:28.853411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:28.853542Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:28.853549Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:28.853557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:28.853597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:28.853639Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534314878482013:2834]
2025-10-02T08:12:28.854174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:28.854359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:28.854397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:28.854687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:28.854733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.854739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.854740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.854742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.854743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.854750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.854759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.854767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.854771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.854778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.854783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.854794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:28.854802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.854808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:28.854814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.854818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:28.854822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.854830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.854840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.854848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.854870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:28.855316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.855344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:28.855353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1488
2025-10-02T08:12:28.855486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:28.855509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:28.855516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:28.855519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:28.855831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1488 sessionId:  describe result for acl check
2025-10-02T08:12:28.855855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:28.855861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:28.855862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:28.855866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534314878482029:2832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:28.856253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534314878482029:2832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:28.858088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534314878482029:2832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:28.861724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534314878482029:2832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:28.861739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534314878482029:2832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:28.861742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534314878482029:2832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:28.861751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:28.862299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:28.863689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:28.863702Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:28.863704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:28.863707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:28.863712Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1487 [1:7556534314878482013:2834]
2025-10-02T08:12:28.863720Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:28.863732Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:28.863734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.863736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.863737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.863749Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:28.863751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:28.863756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:28.863799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.863806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.863809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:28.863811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:28.863861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:28.863868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.863875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:28.863882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:28.863898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534314878482007:2834]
2025-10-02T08:12:28.863902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534314878482007:2834]
2025-10-02T08:12:28.863907Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:28.863918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878482062:2832], now have 1 active actors on pipe
2025-10-02T08:12:28.863919Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:28.863922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:28.863925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:28.863933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:28.863935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:28.863937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1487
2025-10-02T08:12:28.863938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534315338306693:2378], now have 1 active actors on pipe
2025-10-02T08:12:28.863966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.863974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.863987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534314878482007:2834]
2025-10-02T08:12:28.863995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:28.864008Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:28.864020Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5db4b96-72117950-d20d273d-1158211d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:28.863998Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1487
2025-10-02T08:12:28.864026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:28.864033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:28.864035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:28.864043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:28.864053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:28.864077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.864154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:28.864167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:28.864190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:28.864224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1488 partition: 0 MaxSeqNo: 17 sessionId: src_id|e5db4b96-72117950-d20d273d-1158211d_0
2025-10-02T08:12:28.864564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edcb0ef-1109a061-30bcb795-313ae8d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e5db4b96-72117950-d20d273d-1158211d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:28.867055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5db4b96-72117950-d20d273d-1158211d_0] Write session: try to update token
2025-10-02T08:12:28.867071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5db4b96-72117950-d20d273d-1158211d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:28.881070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId: src_id|e5db4b96-72117950-d20d273d-1158211d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:28.881248Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:28.881264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:28.881266Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:28.881273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534314878482007:2834]
2025-10-02T08:12:28.881277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534314878482007:2834]
2025-10-02T08:12:28.881321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:28.881330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:28.881333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:28.881337Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:28.881350Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:28.881466Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:28.883923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:28.948309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534314878482078:4654]
2025-10-02T08:12:28.948405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1487, pipe: [1:7556534314878482078:4654]
2025-10-02T08:12:29.028290Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:29.028730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.028744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.028784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534314878482078:4654], now have 1 active actors on pipe
2025-10-02T08:12:29.028876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534314878482078:4654]
2025-10-02T08:12:29.028896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:29.028903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:29.028953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1488 reason: error at write: Disconnected sessionId: src_id|e5db4b96-72117950-d20d273d-1158211d_0
2025-10-02T08:12:29.028983Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:29.029082Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:29.029125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1488 sessionId: src_id|e5db4b96-72117950-d20d273d-1158211d_0 is DEAD
2025-10-02T08:12:29.029284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5db4b96-72117950-d20d273d-1158211d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:29.029291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5db4b96-72117950-d20d273d-1158211d_0] Write session will restart in 0.006923s
2025-10-02T08:12:29.029314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5db4b96-72117950-d20d273d-1158211d_0] Write session: Do CDS request
2025-10-02T08:12:29.029319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5db4b96-72117950-d20d273d-1158211d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:29.033918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:29.034661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:29.034852Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:29.034861Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:29.034871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:29.034924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:29.034971Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534319173449451:2828]
2025-10-02T08:12:29.035576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:29.035758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:29.035799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:29.036085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:29.036148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.036154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.036155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.036157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.036158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.036162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.036173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.036177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.036181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.036184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.036189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.036197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.036202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.036207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.036211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.036216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.036220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.036227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.036236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.036239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.036251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:29.037217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5db4b96-72117950-d20d273d-1158211d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.037304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:29.037318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1489
2025-10-02T08:12:29.037423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.037448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:29.037453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:29.037457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:29.037791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1489 sessionId:  describe result for acl check
2025-10-02T08:12:29.037814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:29.037816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:29.037817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:29.037822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534319173449467:2821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:29.038316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534319173449467:2821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:29.040349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534319173449467:2821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:29.043790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534319173449467:2821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:29.043808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534319173449467:2821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:29.043812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534319173449467:2821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:29.043823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:29.044481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:29.046232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:29.046248Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:29.046251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:29.046256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:29.046263Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1488 [1:7556534319173449451:2828]
2025-10-02T08:12:29.046274Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:29.046291Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:29.046294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.046297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.046299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.046319Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:29.046324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:29.046331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:29.046397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.046403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.046406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:29.046408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:29.046469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:29.046476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.046487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.046506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:29.046527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173449500:2821], now have 1 active actors on pipe
2025-10-02T08:12:29.046528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1488
2025-10-02T08:12:29.046535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534319633273996:2378], now have 1 active actors on pipe
2025-10-02T08:12:29.046541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534319173449445:2828]
2025-10-02T08:12:29.046543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534319173449445:2828]
2025-10-02T08:12:29.046554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:29.046564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.046570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:29.046573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:29.046577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.046592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:29.046606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:29.046609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:29.046600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1488
2025-10-02T08:12:29.046652Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:29.046662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.046667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.046669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:29.046676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.046689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:29.046705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534319173449445:2828]
2025-10-02T08:12:29.046717Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:29.046730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:29.046745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.046812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.046819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.046831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.046866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1489 partition: 0 MaxSeqNo: 17 sessionId: src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0
2025-10-02T08:12:29.047198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5db4b96-72117950-d20d273d-1158211d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:29.050147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0] Write session: try to update token
2025-10-02T08:12:29.050162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:29.064721Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:29.064741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:29.064743Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:29.064752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534319173449445:2828]
2025-10-02T08:12:29.064757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534319173449445:2828]
2025-10-02T08:12:29.064798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:29.064815Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:29.064822Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:29.064822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.064824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:29.064971Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:29.067811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId: src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:29.070465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:29.128969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534319173449514:4654]
2025-10-02T08:12:29.129047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1488, pipe: [1:7556534319173449514:4654]
2025-10-02T08:12:29.212602Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:29.212876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.212891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.212929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173449514:4654], now have 1 active actors on pipe
2025-10-02T08:12:29.213167Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:29.213601Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:29.213863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:29.213916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1489 reason: status is not ok: tablet will be restarted right now sessionId: src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0
2025-10-02T08:12:29.214081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1489 sessionId: src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0 is DEAD
2025-10-02T08:12:29.214217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:29.214227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0] Write session will restart in 0.009395s
2025-10-02T08:12:29.214249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0] Write session: Do CDS request
2025-10-02T08:12:29.214256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:29.214245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534319173449514:4654]
2025-10-02T08:12:29.218493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:29.219145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:29.219301Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:29.219310Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:29.219319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:29.219362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:29.219399Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534319173449600:2807]
2025-10-02T08:12:29.219960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:29.220138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:29.220178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:29.220546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:29.220589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.220594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.220596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.220597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.220598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.220606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.220620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.220624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.220632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.220635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.220640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.220647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.220652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.220657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.220661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.220666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.220670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.220675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.220679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.220684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.220702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:29.224358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.224640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:29.224658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1490
2025-10-02T08:12:29.224763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.224791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:29.224815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:29.224819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:29.225246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1490 sessionId:  describe result for acl check
2025-10-02T08:12:29.225275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:29.225284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:29.225286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:29.225291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534319173449617:2803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:29.225771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534319173449617:2803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:29.227746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534319173449617:2803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:29.228684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:29.230319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:29.230336Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:29.230339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:29.230342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:29.230348Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1489 [1:7556534319173449600:2807]
2025-10-02T08:12:29.230359Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:29.230381Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:29.230383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.230386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.230388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.230402Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:29.230407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:29.230414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:29.230472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.230474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.230477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:29.230479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:29.230542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:29.230545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.230557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.230570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:29.230587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534319633274016:2378], now have 1 active actors on pipe
2025-10-02T08:12:29.230593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534319173449594:2807]
2025-10-02T08:12:29.230596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534319173449594:2807]
2025-10-02T08:12:29.230607Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:29.230619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:29.230622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:29.230625Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:29.230632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:29.230634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:29.230664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534319173449594:2807]
2025-10-02T08:12:29.230670Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:29.230679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:29.231160Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1489
2025-10-02T08:12:29.236180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534319173449617:2803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:29.236201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534319173449617:2803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:29.236205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534319173449617:2803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:29.236214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:29.236584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1489
2025-10-02T08:12:29.236610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173449668:2803], now have 1 active actors on pipe
2025-10-02T08:12:29.236624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.236638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.236672Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:29.236693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.236698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.236700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:29.236712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.236729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:29.236748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.236781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.236784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.236798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.236842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1490 partition: 0 MaxSeqNo: 17 sessionId: src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0
2025-10-02T08:12:29.237260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ecb7c3-d849e7d2-73888143-ef31838f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:29.239920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0] Write session: try to update token
2025-10-02T08:12:29.239935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:29.241345Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:29.241363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:29.241371Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534319173449594:2807]
2025-10-02T08:12:29.241411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:29.241415Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:29.241663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:29.241830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:29.241990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:29.242146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:29.242344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:29.242385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:29.256940Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:29.256960Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:29.256962Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:29.256972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534319173449594:2807]
2025-10-02T08:12:29.256977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534319173449594:2807]
2025-10-02T08:12:29.257016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:29.257018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:29.257022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:29.257025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.257028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:29.257141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId: src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:29.257155Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:29.259458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:29.314383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534319173449690:4654]
2025-10-02T08:12:29.314512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1489, pipe: [1:7556534319173449690:4654]
2025-10-02T08:12:29.406171Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:29.406572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.406585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.406604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173449690:4654], now have 1 active actors on pipe
2025-10-02T08:12:29.406720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534319173449690:4654]
2025-10-02T08:12:29.406743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:29.406745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:29.406796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1490 reason: error at write: Disconnected sessionId: src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0
2025-10-02T08:12:29.406865Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:29.406976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1490 sessionId: src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0 is DEAD
2025-10-02T08:12:29.407037Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:29.407077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:29.407085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0] Write session will restart in 0.009446s
2025-10-02T08:12:29.407106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0] Write session: Do CDS request
2025-10-02T08:12:29.407112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:29.411855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:29.412502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:29.412756Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:29.412767Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:29.412778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:29.412847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:29.412884Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534319173449771:2785]
2025-10-02T08:12:29.413523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:29.413688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:29.413728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:29.414019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:29.414066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.414073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.414074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.414076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.414077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.414081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.414091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.414096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.414100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.414103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.414109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.414116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.414122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.414128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.414132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.414137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.414142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.414147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.414154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.414159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.414178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:29.417230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.417296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:29.417312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1491
2025-10-02T08:12:29.417430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.417459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:29.417468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:29.417471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:29.417851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1491 sessionId:  describe result for acl check
2025-10-02T08:12:29.417886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:29.417891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:29.417892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:29.417897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534319173449787:2789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:29.418338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534319173449787:2789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:29.420181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534319173449787:2789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:29.421851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:29.422753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534319173449787:2789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:29.422766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534319173449787:2789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:29.422770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534319173449787:2789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:29.422777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:29.423454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:29.423469Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:29.423472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:29.423475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:29.423482Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1490 [1:7556534319173449771:2785]
2025-10-02T08:12:29.423492Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:29.423506Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:29.423513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.423516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.423518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.423532Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:29.423542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:29.423549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:29.423605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.423614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.423618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:29.423620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:29.423680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:29.423686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.423698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.423713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1490
2025-10-02T08:12:29.423714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:29.423732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173449818:2789], now have 1 active actors on pipe
2025-10-02T08:12:29.423735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534319633274045:2378], now have 1 active actors on pipe
2025-10-02T08:12:29.423739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.423742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.423757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534319173449765:2785]
2025-10-02T08:12:29.423763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534319173449765:2785]
2025-10-02T08:12:29.423775Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:29.423791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:29.423791Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:29.423794Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:29.423807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:29.423814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:29.423790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1490
2025-10-02T08:12:29.423827Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:29.423837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.423840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.423842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:29.423849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.423859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:29.423893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534319173449765:2785]
2025-10-02T08:12:29.423904Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:29.423915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:29.423923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.423969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.423976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.423989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.424023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1491 partition: 0 MaxSeqNo: 17 sessionId: src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0
2025-10-02T08:12:29.424325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b7d89a-50e0c345-9a7977a0-ef82aa4a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:29.426846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0] Write session: try to update token
2025-10-02T08:12:29.426861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:29.440970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId: src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:29.441389Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:29.441405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:29.441408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:29.441416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534319173449765:2785]
2025-10-02T08:12:29.441422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534319173449765:2785]
2025-10-02T08:12:29.441464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:29.441465Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:29.441470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:29.441477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.441479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:29.441620Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:29.443809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:29.506901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534319173449835:4654]
2025-10-02T08:12:29.507029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1490, pipe: [1:7556534319173449835:4654]
2025-10-02T08:12:29.591863Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:29.592168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.592182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.592219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173449835:4654], now have 1 active actors on pipe
2025-10-02T08:12:29.592318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534319173449835:4654]
2025-10-02T08:12:29.592340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:29.592342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:29.592389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1491 reason: error at write: Disconnected sessionId: src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0
2025-10-02T08:12:29.592444Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:29.592472Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:29.592541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1491 sessionId: src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0 is DEAD
2025-10-02T08:12:29.592698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:29.592712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0] Write session will restart in 0.006012s
2025-10-02T08:12:29.592740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0] Write session: Do CDS request
2025-10-02T08:12:29.592747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:29.597585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:29.598106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:29.598253Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:29.598262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:29.598273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:29.598314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:29.598348Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534319173449915:2767]
2025-10-02T08:12:29.599027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:29.599186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:29.599226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:29.599529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:29.599579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.599581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.599582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.599583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.599584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.599589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.599600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.599604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.599608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.599612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.599617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.599625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.599631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.599638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.599644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.599650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.599654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.599659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.599664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.599669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.599687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:29.600426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.600527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:29.600538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1492
2025-10-02T08:12:29.600693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.600723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:29.600732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:29.600736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:29.601096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1492 sessionId:  describe result for acl check
2025-10-02T08:12:29.601122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:29.601128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:29.601129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:29.601134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534319173449931:2770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:29.601619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534319173449931:2770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:29.603537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534319173449931:2770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:29.606766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534319173449931:2770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:29.606783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534319173449931:2770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:29.606787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534319173449931:2770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:29.606796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:29.607301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:29.608723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:29.608743Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:29.608746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:29.608749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:29.608754Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1491 [1:7556534319173449915:2767]
2025-10-02T08:12:29.608764Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:29.608779Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:29.608786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.608789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.608791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.608824Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:29.608837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:29.608843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:29.608889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.608897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.608900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:29.608903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:29.608971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:29.608978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.608990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.609003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:29.609010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1491
2025-10-02T08:12:29.609026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173449963:2770], now have 1 active actors on pipe
2025-10-02T08:12:29.609029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534319633274051:2378], now have 1 active actors on pipe
2025-10-02T08:12:29.609035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534319173449909:2767]
2025-10-02T08:12:29.609037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534319173449909:2767]
2025-10-02T08:12:29.609048Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:29.609057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.609060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.609061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:29.609064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:29.609076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:29.609089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:29.609096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:29.609080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1491
2025-10-02T08:12:29.609131Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:29.609142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.609147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.609149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:29.609157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.609169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:29.609185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534319173449909:2767]
2025-10-02T08:12:29.609195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:29.609217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:29.609221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.609248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.609255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.609267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.609300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1492 partition: 0 MaxSeqNo: 17 sessionId: src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0
2025-10-02T08:12:29.609677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd6db6b-310f17c0-393c8b48-edc36510_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:29.612797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0] Write session: try to update token
2025-10-02T08:12:29.612835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:29.620205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:29.620222Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:29.620229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534319173449909:2767]
2025-10-02T08:12:29.620262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:29.620285Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:29.620405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:29.620526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:29.620648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:29.620787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:29.621017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:29.621060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:29.629309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId: src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:29.632253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:29.632319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.632332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.632372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:29.632402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:29.632458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.632466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.632637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.632703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.632771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.632859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.632905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.632914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.632985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.633048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.633114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.633178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.633222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.633228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.633296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.633363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.633431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.633496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.633544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.633554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.633624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.633694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.633760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.633825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.633872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.633877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.633956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.634029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.634102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.634164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.634266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.634272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.634339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.634404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.634473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.634544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.634589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.634594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.634668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.634737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.634800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.634867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.634921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.634928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.635002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.635063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.635126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.635187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.635239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.635245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.635310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.635366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.635431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.635487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.635535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.635540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.635607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:29.635661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:29.635720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:29.635772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:29.635819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:29.635826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:29.635879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:29.635942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.635963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.635970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:29.635999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:29.636013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:29.636022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:29.636028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:29.636030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:29.636385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:29.636406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:29.636410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:29.636412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:29.636414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:29.636416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:29.636836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:29.636854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:29.636858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:29.636860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:29.636862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:29.636864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:29.637250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:29.637266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:29.637270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:29.637272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:29.637274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:29.643112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:29.643139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:29.643152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392749643
2025-10-02T08:12:29.643412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:29.643439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:29.643449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:29.643454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:29.643463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:29.643468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:29.643921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:29.643947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:29.643953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:29.643957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:29.643959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:29.643963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:29.644438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:29.644465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:29.644476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:29.644486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:29.644490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:29.644495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:29.644943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:29.644962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:29.644966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:29.646031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:29.646048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:29.646053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:29.646057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:29.646066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392749645
2025-10-02T08:12:29.646328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:29.646343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:29.646347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:29.646353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:29.646356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:29.646360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:29.646744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:29.646760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:29.646765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:29.646769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:29.646771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:29.646774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:29.647142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:29.647156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.647223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392749647
2025-10-02T08:12:29.649297Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:29.649314Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:29.649318Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:29.649322Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:29.649329Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:29.649331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:29.649332Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:29.649337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534319173449909:2767]
2025-10-02T08:12:29.649340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534319173449909:2767]
2025-10-02T08:12:29.649376Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:29.649387Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:29.649396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:29.649398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.649400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:29.649514Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:29.692230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534319173449980:4654]
2025-10-02T08:12:29.692364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1491, pipe: [1:7556534319173449980:4654]
2025-10-02T08:12:29.775912Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:29.776223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173449980:4654], now have 1 active actors on pipe
2025-10-02T08:12:29.776338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:29.776349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:29.776371Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:29.776378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1492 reason: error at write: Disconnected sessionId: src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0
2025-10-02T08:12:29.776447Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:29.776587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534319173449980:4654]
2025-10-02T08:12:29.776608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1492 sessionId: src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0 is DEAD
2025-10-02T08:12:29.776705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:29.776722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0] Write session will restart in 0.007225s
2025-10-02T08:12:29.776749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0] Write session: Do CDS request
2025-10-02T08:12:29.776755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:29.780280Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [603d40ada983dddc] Result# TEvPutResult {Id# [72075186224037892:1491:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:29.780310Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1491:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:29.780352Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1491:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:29.783275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:29.783700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:29.783855Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:29.783864Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:29.783873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:29.783934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:29.783970Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534319173450064:2762]
2025-10-02T08:12:29.784544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:29.784738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:29.784779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:29.785087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:29.785140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.785146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.785147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.785148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.785149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.785154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.785163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.785167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.785171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.785175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.785181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.785187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.785192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.785202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.785207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.785212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.785216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.785221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.785230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.785235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.785256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:29.785267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.785308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:29.785315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1493
2025-10-02T08:12:29.785471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.785501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:29.785512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:29.785519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:29.785888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1493 sessionId:  describe result for acl check
2025-10-02T08:12:29.785921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:29.785926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:29.785928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:29.785933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534319173450080:2752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:29.786335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534319173450080:2752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:29.788433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534319173450080:2752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:29.792422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534319173450080:2752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:29.792439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534319173450080:2752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:29.792442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534319173450080:2752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:29.792450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:29.794366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:29.796024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:29.796036Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:29.796038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:29.796041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:29.796045Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1492 [1:7556534319173450064:2762]
2025-10-02T08:12:29.796053Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:29.796066Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:29.796069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.796071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.796072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.796084Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:29.796088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:29.796094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:29.796164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.796170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.796173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:29.796176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:29.796225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:29.796230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.796239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.796245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:29.796258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534319173450058:2762]
2025-10-02T08:12:29.796262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534319173450058:2762]
2025-10-02T08:12:29.796268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:29.796283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1492
2025-10-02T08:12:29.796284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:29.796287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:29.796287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:29.796300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:29.796302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:29.796311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173450112:2752], now have 1 active actors on pipe
2025-10-02T08:12:29.796340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534319633274060:2378], now have 1 active actors on pipe
2025-10-02T08:12:29.796349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534319173450058:2762]
2025-10-02T08:12:29.796355Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:29.796362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:29.796362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.796366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.796367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1492
2025-10-02T08:12:29.796403Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:29.796415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.796418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.796420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:29.796428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.796435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:29.796455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.796498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.796508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.796532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.796570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1493 partition: 0 MaxSeqNo: 17 sessionId: src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0
2025-10-02T08:12:29.796921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77c76b7-7ea4c970-9c0df785-8243d1b9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:29.799800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0] Write session: try to update token
2025-10-02T08:12:29.799817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:29.813102Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:29.813120Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:29.813122Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:29.813132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534319173450058:2762]
2025-10-02T08:12:29.813136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534319173450058:2762]
2025-10-02T08:12:29.813174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:29.813183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.813185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:29.813236Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:29.813250Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:29.813300Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:29.813457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId: src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:29.815856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:29.876572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534319173450128:4654]
2025-10-02T08:12:29.876700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1492, pipe: [1:7556534319173450128:4654]
2025-10-02T08:12:29.948553Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:29.948943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.948958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.948999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173450128:4654], now have 1 active actors on pipe
2025-10-02T08:12:29.949147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534319173450128:4654]
2025-10-02T08:12:29.949170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:29.949176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:29.949211Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:29.949247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1493 reason: error at write: Disconnected sessionId: src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0
2025-10-02T08:12:29.949227Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:29.949399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1493 sessionId: src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0 is DEAD
2025-10-02T08:12:29.949544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:29.949551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0] Write session will restart in 0.008381s
2025-10-02T08:12:29.949577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0] Write session: Do CDS request
2025-10-02T08:12:29.949584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:29.955106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:29.955670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:29.955823Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:29.955832Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:29.955842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:29.955886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:29.955925Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534319173450207:2734]
2025-10-02T08:12:29.956516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:29.956716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:29.956761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:29.957055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:29.957108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.957114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.957115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.957115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.957116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.957121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.957129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.957136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.957139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.957143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.957148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.957153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:29.957158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.957164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:29.957167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.957171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:29.957174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.957179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.957182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.957186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.957201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:29.959225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.959355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:29.959368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1494
2025-10-02T08:12:29.959470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:29.959491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:29.959494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:29.959497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:29.959834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1494 sessionId:  describe result for acl check
2025-10-02T08:12:29.959868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:29.959873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:29.959874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:29.959880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534319173450223:2738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:29.960328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534319173450223:2738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:29.962235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534319173450223:2738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:29.964459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534319173450223:2738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:29.964474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534319173450223:2738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:29.964478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534319173450223:2738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:29.964485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:29.965020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:29.966389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:29.966400Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:29.966402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:29.966404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:29.966407Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1493 [1:7556534319173450207:2734]
2025-10-02T08:12:29.966415Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:29.966427Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:29.966428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.966430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.966432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.966443Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:29.966446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:29.966450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:29.966489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.966495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.966497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:29.966498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:29.966538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:29.966545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.966552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:29.966560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:29.966571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534319173450201:2734]
2025-10-02T08:12:29.966576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534319173450201:2734]
2025-10-02T08:12:29.966581Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:29.966588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:29.966598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:29.966603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:29.966609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:29.966612Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:29.966619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1493
2025-10-02T08:12:29.966629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534319173450252:2738], now have 1 active actors on pipe
2025-10-02T08:12:29.966631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534319173450201:2734]
2025-10-02T08:12:29.966633Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:29.966635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:29.966636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534319633274067:2378], now have 1 active actors on pipe
2025-10-02T08:12:29.966639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.966641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.966669Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:29.966676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:29.966679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:29.966680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:29.966685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:29.966692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:29.966706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.966693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1493
2025-10-02T08:12:29.966735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:29.966739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:29.966753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:29.966779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1494 partition: 0 MaxSeqNo: 17 sessionId: src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0
2025-10-02T08:12:29.967036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20f9d97-4464f2b4-521d8d73-f4dcd18e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:29.969609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0] Write session: try to update token
2025-10-02T08:12:29.969625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:29.983055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId: src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:29.983370Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:29.983383Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:29.983385Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:29.983391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534319173450201:2734]
2025-10-02T08:12:29.983397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534319173450201:2734]
2025-10-02T08:12:29.983432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:29.983444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:29.983447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:29.983459Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:29.983476Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:29.983577Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:29.985423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:30.049118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534323468417564:4654]
2025-10-02T08:12:30.049259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1493, pipe: [1:7556534323468417564:4654]
2025-10-02T08:12:30.118459Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:30.118704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.118716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.118750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468417564:4654], now have 1 active actors on pipe
2025-10-02T08:12:30.118860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534323468417564:4654]
2025-10-02T08:12:30.118887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:30.118890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:30.118945Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:30.118946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1494 reason: error at write: Disconnected sessionId: src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0
2025-10-02T08:12:30.118957Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:30.119127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1494 sessionId: src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0 is DEAD
2025-10-02T08:12:30.119280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:30.119287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0] Write session will restart in 0.007028s
2025-10-02T08:12:30.119312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0] Write session: Do CDS request
2025-10-02T08:12:30.119318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:30.124533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:30.125274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:30.125416Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:30.125424Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:30.125433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:30.125474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:30.125510Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534323468417644:2731]
2025-10-02T08:12:30.125998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:30.126159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:30.126187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:30.126396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:30.126429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.126437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.126438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.126439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.126440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.126445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.126456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.126460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.126463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.126467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.126472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.126478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.126481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.126484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.126489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.126493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.126495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.126498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.126501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.126504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.126515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:30.127510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:30.127521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1495
2025-10-02T08:12:30.127659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.127877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.127906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:30.127922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:30.127928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:30.128367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1495 sessionId:  describe result for acl check
2025-10-02T08:12:30.128412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:30.128419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:30.128421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:30.128427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534323468417660:2723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:30.128969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534323468417660:2723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:30.131082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534323468417660:2723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:30.134369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534323468417660:2723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:30.134385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534323468417660:2723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:30.134389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534323468417660:2723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:30.134398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:30.135082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:30.136642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:30.136662Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:30.136665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:30.136669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:30.136676Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1494 [1:7556534323468417644:2731]
2025-10-02T08:12:30.136687Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:30.136704Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:30.136707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.136710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.136714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.136730Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:30.136740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:30.136746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:30.136829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.136837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.136840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:30.136845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:30.136909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:30.136915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.136929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.136942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:30.136961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468417691:2723], now have 1 active actors on pipe
2025-10-02T08:12:30.136967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534323468417638:2731]
2025-10-02T08:12:30.136969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534323468417638:2731]
2025-10-02T08:12:30.136976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:30.136985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534323928241384:2378], now have 1 active actors on pipe
2025-10-02T08:12:30.136987Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:30.136991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:30.136992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:30.137006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:30.137009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:30.137040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534323468417638:2731]
2025-10-02T08:12:30.137043Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:30.137050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1494
2025-10-02T08:12:30.137027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1494
2025-10-02T08:12:30.137056Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:30.137062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.137067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.137097Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d627b9d-4be38adc-edf92270-4769f89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:30.137110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.137118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.137120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:30.137128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.137136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:30.137150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.137206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.137220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.137243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.137287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1495 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d627b9d-4be38adc-edf92270-4769f89_0
2025-10-02T08:12:30.137665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1243d0c9-29ffc0ee-2c678f2d-fb72169c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d627b9d-4be38adc-edf92270-4769f89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:30.140327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d627b9d-4be38adc-edf92270-4769f89_0] Write session: try to update token
2025-10-02T08:12:30.140343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d627b9d-4be38adc-edf92270-4769f89_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:30.154545Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:30.154562Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:30.154572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534323468417638:2731]
2025-10-02T08:12:30.154621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:30.154628Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:30.154787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:30.154921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:30.155047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId: src_id|8d627b9d-4be38adc-edf92270-4769f89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:30.155057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:30.155178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:30.155360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:30.155401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:30.157659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:30.157735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.157764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.157801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:30.157835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:30.157886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.157898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.158066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.158129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.158195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.158263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.158313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.158322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.158398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.158459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.158517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.158581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.158632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.158640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.158704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.158772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.158849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.158921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.158971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.158977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.159057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.159127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.159200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.159277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.159333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.159341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.159426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.159496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.159573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.159647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.159700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.159707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.159788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.159859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.159930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.160006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.160059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.160071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.160170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.160241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.160319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.160405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.160458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.160465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.160549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.160613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.160681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.160745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.160826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.160833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.160910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.160976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.161043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.161121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.161174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.161182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.161263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:30.161330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:30.161393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:30.161463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:30.161530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:30.161533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:30.161572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:30.161637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.161655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.161657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:30.161689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:30.161703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:30.161707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:30.161711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:30.161714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:30.162114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:30.162131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:30.162137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:30.162140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:30.162143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:30.162147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:30.162857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:30.162871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:30.162878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:30.162882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:30.162885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:30.162888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:30.163376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:30.163387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:30.163393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:30.163397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:30.163402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:30.164672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:30.164696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:30.164711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392750164
2025-10-02T08:12:30.164843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:30.164857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:30.164863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:30.164867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:30.164872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:30.164875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:30.165409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:30.165432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:30.165439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:30.165442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:30.165446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:30.165450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:30.165910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:30.165930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:30.165939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:30.165944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:30.165955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:30.165960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:30.166429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:30.166452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:30.166457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:30.167639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:30.167658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:30.167663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:30.167667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:30.167677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392750167
2025-10-02T08:12:30.167980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:30.168000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:30.168006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:30.168010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:30.168014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:30.168017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:30.168500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:30.168522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:30.168529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:30.168539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:30.168543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:30.168547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:30.169026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:30.169045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.169155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392750168
2025-10-02T08:12:30.169911Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:30.169934Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:30.169941Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:30.169949Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:30.171582Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:30.171608Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:30.171610Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:30.171619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534323468417638:2731]
2025-10-02T08:12:30.171627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534323468417638:2731]
2025-10-02T08:12:30.171688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:30.171688Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:30.171695Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:30.171698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.171700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:30.171844Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:30.219082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534323468417716:4654]
2025-10-02T08:12:30.219219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1494, pipe: [1:7556534323468417716:4654]
2025-10-02T08:12:30.316683Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:30.317038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468417716:4654], now have 1 active actors on pipe
2025-10-02T08:12:30.317159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534323468417716:4654]
2025-10-02T08:12:30.317175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:30.317181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:30.317199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1495 reason: error at write: Disconnected sessionId: src_id|8d627b9d-4be38adc-edf92270-4769f89_0
2025-10-02T08:12:30.317281Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:30.317269Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:30.317345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1495 sessionId: src_id|8d627b9d-4be38adc-edf92270-4769f89_0 is DEAD
2025-10-02T08:12:30.317471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d627b9d-4be38adc-edf92270-4769f89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:30.317480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d627b9d-4be38adc-edf92270-4769f89_0] Write session will restart in 0.009063s
2025-10-02T08:12:30.317503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d627b9d-4be38adc-edf92270-4769f89_0] Write session: Do CDS request
2025-10-02T08:12:30.317509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d627b9d-4be38adc-edf92270-4769f89_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:30.322236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:30.322790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:30.322938Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:30.322947Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:30.322956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:30.322999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:30.323034Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534323468417841:2691]
2025-10-02T08:12:30.323636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:30.323799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:30.323837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:30.324128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:30.324169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.324175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.324176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.324177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.324179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.324183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.324194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.324202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.324207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.324215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.324221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.324232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.324241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.324251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.324259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.324265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.324274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.324279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.324294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.324299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.324320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:30.327386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d627b9d-4be38adc-edf92270-4769f89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.327510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:30.327524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1496
2025-10-02T08:12:30.327669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.327698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:30.327707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:30.327710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:30.328094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1496 sessionId:  describe result for acl check
2025-10-02T08:12:30.328134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:30.328140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:30.328141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:30.328145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534323468417857:2684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:30.328730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534323468417857:2684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:30.330373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534323468417857:2684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:30.331658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:30.333163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:30.333179Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:30.333182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:30.333185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:30.333191Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1495 [1:7556534323468417841:2691]
2025-10-02T08:12:30.333199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534323468417857:2684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:30.333202Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:30.333205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534323468417857:2684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:30.333208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534323468417857:2684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:30.333216Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:30.333216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:30.333218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.333221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.333222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.333237Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:30.333241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:30.333248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:30.333304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.333313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.333315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:30.333318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:30.333419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:30.333432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.333442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.333452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:30.333469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534323928241391:2378], now have 1 active actors on pipe
2025-10-02T08:12:30.333472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468417885:2684], now have 1 active actors on pipe
2025-10-02T08:12:30.333478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534323468417835:2691]
2025-10-02T08:12:30.333479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534323468417835:2691]
2025-10-02T08:12:30.333458Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1495
2025-10-02T08:12:30.333486Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:30.333497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:30.333501Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:30.333503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:30.333508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:30.333511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:30.333516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1495
2025-10-02T08:12:30.333543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534323468417835:2691]
2025-10-02T08:12:30.333554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:30.333560Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:30.333560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.333564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.333597Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:30.333606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.333609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.333610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:30.333617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.333627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:30.333639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.333665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.333671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.333681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.333709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1496 partition: 0 MaxSeqNo: 17 sessionId: src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0
2025-10-02T08:12:30.334049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d627b9d-4be38adc-edf92270-4769f89_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:30.337327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0] Write session: try to update token
2025-10-02T08:12:30.337349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:30.351057Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:30.351079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:30.351081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:30.351090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534323468417835:2691]
2025-10-02T08:12:30.351094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534323468417835:2691]
2025-10-02T08:12:30.351131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:30.351135Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:30.351139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:30.351145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.351148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:30.351286Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:30.354535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId: src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:30.357366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:30.417229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534323468417908:4654]
2025-10-02T08:12:30.417329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1495, pipe: [1:7556534323468417908:4654]
2025-10-02T08:12:30.491062Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:30.491880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.491896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.491932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468417908:4654], now have 1 active actors on pipe
2025-10-02T08:12:30.492028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:30.492036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:30.492086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1496 reason: error at write: Disconnected sessionId: src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0
2025-10-02T08:12:30.492172Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:30.492174Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:30.492261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1496 sessionId: src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0 is DEAD
2025-10-02T08:12:30.492447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534323468417908:4654]
2025-10-02T08:12:30.492678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:30.492690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0] Write session will restart in 0.008265s
2025-10-02T08:12:30.492720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0] Write session: Do CDS request
2025-10-02T08:12:30.492727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:30.497708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:30.498455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:30.498615Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:30.498626Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:30.498635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:30.498675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:30.498714Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534323468417991:2648]
2025-10-02T08:12:30.499353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:30.499537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:30.499577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:30.499868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:30.499917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.499924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.499925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.499926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.499927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.499932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.499942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.499946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.499950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.499953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.499958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.499965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.499970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.499975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.499979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.499984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.499988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.499993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.499997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.500002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.500019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:30.502286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.502441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:30.502460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1497
2025-10-02T08:12:30.502619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.502663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:30.502673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:30.502679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:30.503140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1497 sessionId:  describe result for acl check
2025-10-02T08:12:30.503208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:30.503217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:30.503219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:30.503225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534323468418007:2649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:30.503765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534323468418007:2649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:30.505964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534323468418007:2649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:30.508955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534323468418007:2649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:30.508971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534323468418007:2649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:30.508973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534323468418007:2649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:30.508984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:30.510532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:30.512290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:30.512311Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:30.512313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:30.512318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:30.512327Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1496 [1:7556534323468417991:2648]
2025-10-02T08:12:30.512343Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:30.512366Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:30.512374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.512378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.512386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.512408Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:30.512418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:30.512427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:30.512511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.512518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.512523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:30.512525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:30.512623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:30.512635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.512652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.512665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:30.512679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1496
2025-10-02T08:12:30.512690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468418039:2649], now have 1 active actors on pipe
2025-10-02T08:12:30.512694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534323928241419:2378], now have 1 active actors on pipe
2025-10-02T08:12:30.512702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534323468417985:2648]
2025-10-02T08:12:30.512704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534323468417985:2648]
2025-10-02T08:12:30.512719Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:30.512730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.512738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.512740Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:30.512744Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:30.512764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:30.512784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:30.512790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:30.512861Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:30.512874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.512880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.512882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:30.512894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.512909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:30.512920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534323468417985:2648]
2025-10-02T08:12:30.512930Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:30.512944Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:30.512959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.512953Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1496
2025-10-02T08:12:30.513023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.513029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.513049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.513084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1497 partition: 0 MaxSeqNo: 17 sessionId: src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0
2025-10-02T08:12:30.513465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8abdfd-71b8732a-5342eec4-1d6354e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:30.516672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0] Write session: try to update token
2025-10-02T08:12:30.516692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:30.530929Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:30.530960Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:30.530963Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:30.530976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534323468417985:2648]
2025-10-02T08:12:30.530982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534323468417985:2648]
2025-10-02T08:12:30.531035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:30.531033Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:30.531042Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:30.531049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.531052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:30.531225Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:30.533927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId: src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:30.536707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:30.592865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534323468418058:4654]
2025-10-02T08:12:30.592998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1496, pipe: [1:7556534323468418058:4654]
2025-10-02T08:12:30.679372Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:30.679708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.679721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.679754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468418058:4654], now have 1 active actors on pipe
2025-10-02T08:12:30.679948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:30.679970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:30.680062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1497 reason: error at write: Disconnected sessionId: src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0
2025-10-02T08:12:30.680142Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:30.680288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1497 sessionId: src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0 is DEAD
2025-10-02T08:12:30.680403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:30.680388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534323468418058:4654]
2025-10-02T08:12:30.680426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0] Write session will restart in 0.007526s
2025-10-02T08:12:30.680452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0] Write session: Do CDS request
2025-10-02T08:12:30.680465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:30.680153Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:30.685424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:30.686102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:30.686263Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:30.686273Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:30.686282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:30.686333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:30.686369Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534323468418146:2643]
2025-10-02T08:12:30.686785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:30.686953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:30.686985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:30.687178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:30.687204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.687209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.687209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.687210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.687211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.687214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.687220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.687222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.687224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.687226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.687230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.687234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.687238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.687241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.687243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.687246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.687248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.687252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.687254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.687257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.687267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:30.689290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.689376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:30.689395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1498
2025-10-02T08:12:30.689530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.689567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:30.689580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:30.689582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:30.689971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1498 sessionId:  describe result for acl check
2025-10-02T08:12:30.690000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:30.690005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:30.690006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:30.690011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534323468418162:2628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:30.690473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534323468418162:2628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:30.692812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534323468418162:2628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:30.695486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:30.695977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534323468418162:2628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:30.695989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534323468418162:2628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:30.695994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534323468418162:2628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:30.696008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:30.697003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:30.697020Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:30.697022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:30.697026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:30.697032Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1497 [1:7556534323468418146:2643]
2025-10-02T08:12:30.697041Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:30.697057Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:30.697066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.697070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.697071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.697086Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:30.697091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:30.697097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:30.697160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.697167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.697170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:30.697173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:30.697220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:30.697227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.697235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.697242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:30.697253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534323468418140:2643]
2025-10-02T08:12:30.697258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534323468418140:2643]
2025-10-02T08:12:30.697264Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:30.697274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534323928241428:2378], now have 1 active actors on pipe
2025-10-02T08:12:30.697281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:30.697283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:30.697284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:30.697291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:30.697293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:30.697297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468418193:2628], now have 1 active actors on pipe
2025-10-02T08:12:30.697297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1497
2025-10-02T08:12:30.697321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.697326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.697337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534323468418140:2643]
2025-10-02T08:12:30.697347Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:30.697358Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:30.697366Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bff784-f977a756-c27cd7da-31aab915_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:30.697370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.697372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.697373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:30.697380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.697389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:30.697408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.697441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.697447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.697398Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1497
2025-10-02T08:12:30.697456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.697485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1498 partition: 0 MaxSeqNo: 17 sessionId: src_id|4bff784-f977a756-c27cd7da-31aab915_0
2025-10-02T08:12:30.697805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecee643-4773106e-375f8cbd-d6918cdd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4bff784-f977a756-c27cd7da-31aab915_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:30.700590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bff784-f977a756-c27cd7da-31aab915_0] Write session: try to update token
2025-10-02T08:12:30.700602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bff784-f977a756-c27cd7da-31aab915_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:30.715227Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:30.715248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:30.715251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:30.715259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534323468418140:2643]
2025-10-02T08:12:30.715263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534323468418140:2643]
2025-10-02T08:12:30.715297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:30.715301Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:30.715306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:30.715312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.715321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:30.715459Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:30.716093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId: src_id|4bff784-f977a756-c27cd7da-31aab915_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:30.718822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:30.780758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534323468418212:4654]
2025-10-02T08:12:30.780907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1497, pipe: [1:7556534323468418212:4654]
2025-10-02T08:12:30.849080Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:30.849360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.849371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.849411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468418212:4654], now have 1 active actors on pipe
2025-10-02T08:12:30.849534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534323468418212:4654]
2025-10-02T08:12:30.849564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:30.849571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:30.849634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1498 reason: error at write: Disconnected sessionId: src_id|4bff784-f977a756-c27cd7da-31aab915_0
2025-10-02T08:12:30.849735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:30.849789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1498 sessionId: src_id|4bff784-f977a756-c27cd7da-31aab915_0 is DEAD
2025-10-02T08:12:30.849853Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:30.849972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bff784-f977a756-c27cd7da-31aab915_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:30.849981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bff784-f977a756-c27cd7da-31aab915_0] Write session will restart in 0.008862s
2025-10-02T08:12:30.850006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bff784-f977a756-c27cd7da-31aab915_0] Write session: Do CDS request
2025-10-02T08:12:30.850012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bff784-f977a756-c27cd7da-31aab915_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:30.854263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:30.854912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:30.855052Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:30.855059Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:30.855066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:30.855111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:30.855144Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534323468418299:2601]
2025-10-02T08:12:30.855560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:30.855767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:30.855821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:30.856115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:30.856172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.856176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.856180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.856181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.856182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.856187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.856197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.856204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.856208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.856215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.856221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.856228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:30.856234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.856238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:30.856242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.856247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:30.856251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.856256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.856261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.856267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.856287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:30.860295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bff784-f977a756-c27cd7da-31aab915_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.860628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:30.860645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1499
2025-10-02T08:12:30.860819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:30.860877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:30.860887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:30.860892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:30.861347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1499 sessionId:  describe result for acl check
2025-10-02T08:12:30.861401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:30.861408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:30.861410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:30.861415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534323468418316:2604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:30.861978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534323468418316:2604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:30.864263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534323468418316:2604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:30.864419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:30.865876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:30.865892Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:30.865895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:30.865898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:30.865904Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1498 [1:7556534323468418299:2601]
2025-10-02T08:12:30.865915Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:30.865931Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:30.865934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.865938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.865940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.865955Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:30.865960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:30.865965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:30.866023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.866032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.866035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:30.866039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:30.866097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:30.866108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.866120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:30.866133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:30.866155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534323928241434:2378], now have 1 active actors on pipe
2025-10-02T08:12:30.866167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534323468418293:2601]
2025-10-02T08:12:30.866169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534323468418293:2601]
2025-10-02T08:12:30.866180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:30.866191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:30.866193Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:30.866197Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:30.866205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:30.866207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:30.866189Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1498
2025-10-02T08:12:30.866237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534323468418293:2601]
2025-10-02T08:12:30.866248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:30.866268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:30.867135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534323468418316:2604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:30.867148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534323468418316:2604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:30.867152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534323468418316:2604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:30.867159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:30.867370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1498
2025-10-02T08:12:30.867384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468418356:2604], now have 1 active actors on pipe
2025-10-02T08:12:30.867389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.867394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.867416Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d306c1-6f24ad2-6154199c-1c67034f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:30.867424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:30.867427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:30.867431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:30.867441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:30.867451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:30.867468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.867503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:30.867509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:30.867519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:30.867546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1499 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d306c1-6f24ad2-6154199c-1c67034f_0
2025-10-02T08:12:30.867928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bff784-f977a756-c27cd7da-31aab915_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d306c1-6f24ad2-6154199c-1c67034f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:30.871219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d306c1-6f24ad2-6154199c-1c67034f_0] Write session: try to update token
2025-10-02T08:12:30.871239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d306c1-6f24ad2-6154199c-1c67034f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:30.884147Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:30.884165Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:30.884167Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:30.884175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534323468418293:2601]
2025-10-02T08:12:30.884180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534323468418293:2601]
2025-10-02T08:12:30.884221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:30.884224Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:30.884227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:30.884230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:30.884232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:30.884359Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:30.893400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId: src_id|2d306c1-6f24ad2-6154199c-1c67034f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:30.896546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:30.949706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534323468418363:4654]
2025-10-02T08:12:30.949833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1498, pipe: [1:7556534323468418363:4654]
2025-10-02T08:12:31.042776Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:31.043143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.043155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.043174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534323468418363:4654], now have 1 active actors on pipe
2025-10-02T08:12:31.043292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534323468418363:4654]
2025-10-02T08:12:31.043322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:31.043331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:31.043380Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:31.043393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1499 reason: error at write: Disconnected sessionId: src_id|2d306c1-6f24ad2-6154199c-1c67034f_0
2025-10-02T08:12:31.043422Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:31.043567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1499 sessionId: src_id|2d306c1-6f24ad2-6154199c-1c67034f_0 is DEAD
2025-10-02T08:12:31.043779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d306c1-6f24ad2-6154199c-1c67034f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:31.043793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d306c1-6f24ad2-6154199c-1c67034f_0] Write session will restart in 0.009558s
2025-10-02T08:12:31.043822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d306c1-6f24ad2-6154199c-1c67034f_0] Write session: Do CDS request
2025-10-02T08:12:31.043830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d306c1-6f24ad2-6154199c-1c67034f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:31.050234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:31.051143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:31.051293Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:31.051301Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:31.051309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:31.051344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:31.051382Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534327763385750:2595]
2025-10-02T08:12:31.052079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:31.052296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:31.052332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:31.052640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:31.052676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.052681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.052682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.052683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.052684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.052689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.052699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.052703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.052706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.052710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.052719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.052726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.052736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.052741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.052746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.052751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.052755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.052760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.052765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.052771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.052793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:31.054326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d306c1-6f24ad2-6154199c-1c67034f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.054453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:31.054473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1500
2025-10-02T08:12:31.054678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.054718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:31.054730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:31.054735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:31.055197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1500 sessionId:  describe result for acl check
2025-10-02T08:12:31.055238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:31.055247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:31.055249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:31.055255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534327763385766:2594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:31.055865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534327763385766:2594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:31.058261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534327763385766:2594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:31.061387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534327763385766:2594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:31.061403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534327763385766:2594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:31.061406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534327763385766:2594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:31.061415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:31.065579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:31.067171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:31.067192Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:31.067196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:31.067200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:31.067206Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1499 [1:7556534327763385750:2595]
2025-10-02T08:12:31.067216Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:31.067233Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:31.067236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.067239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.067242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.067257Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:31.067262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:31.067269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:31.067330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.067338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.067341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:31.067345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:31.067409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:31.067420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.067433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.067446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:31.067460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534327763385744:2595]
2025-10-02T08:12:31.067466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534327763385744:2595]
2025-10-02T08:12:31.067473Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:31.067486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:31.067505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:31.067512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:31.067518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:31.067521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:31.067542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1499
2025-10-02T08:12:31.067547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763385798:2594], now have 1 active actors on pipe
2025-10-02T08:12:31.067551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534327763385744:2595]
2025-10-02T08:12:31.067553Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:31.067559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.067562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.067573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:31.067589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534328223208737:2378], now have 1 active actors on pipe
2025-10-02T08:12:31.067609Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1959adb-a7df2849-8f867d75-693e5c41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:31.067617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.067621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.067623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:31.067633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.067640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:31.067658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.067715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.067721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.067732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.067767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1500 partition: 0 MaxSeqNo: 17 sessionId: src_id|b1959adb-a7df2849-8f867d75-693e5c41_0
2025-10-02T08:12:31.067719Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1499
2025-10-02T08:12:31.068128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d306c1-6f24ad2-6154199c-1c67034f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b1959adb-a7df2849-8f867d75-693e5c41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:31.071028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1959adb-a7df2849-8f867d75-693e5c41_0] Write session: try to update token
2025-10-02T08:12:31.071046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1959adb-a7df2849-8f867d75-693e5c41_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:31.086305Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:31.086324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:31.086326Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:31.086335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534327763385744:2595]
2025-10-02T08:12:31.086339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534327763385744:2595]
2025-10-02T08:12:31.086382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:31.086388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.086390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:31.086392Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:31.086400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:31.086534Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:31.087941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId: src_id|b1959adb-a7df2849-8f867d75-693e5c41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:31.090597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:31.143242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534327763385812:4654]
2025-10-02T08:12:31.143441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1499, pipe: [1:7556534327763385812:4654]
2025-10-02T08:12:31.242949Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:31.243204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.243219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.243252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763385812:4654], now have 1 active actors on pipe
2025-10-02T08:12:31.243338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534327763385812:4654]
2025-10-02T08:12:31.243358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:31.243364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:31.243414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1500 reason: error at write: Disconnected sessionId: src_id|b1959adb-a7df2849-8f867d75-693e5c41_0
2025-10-02T08:12:31.243448Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:31.243492Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:31.243578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1500 sessionId: src_id|b1959adb-a7df2849-8f867d75-693e5c41_0 is DEAD
2025-10-02T08:12:31.243890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1959adb-a7df2849-8f867d75-693e5c41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:31.243900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1959adb-a7df2849-8f867d75-693e5c41_0] Write session will restart in 0.009027s
2025-10-02T08:12:31.243927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1959adb-a7df2849-8f867d75-693e5c41_0] Write session: Do CDS request
2025-10-02T08:12:31.243934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1959adb-a7df2849-8f867d75-693e5c41_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:31.249595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:31.250533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:31.250686Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:31.250707Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:31.250716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:31.250752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:31.250793Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534327763385920:2567]
2025-10-02T08:12:31.251526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:31.251726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:31.251759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:31.252068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:31.252113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.252118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.252119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.252120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.252121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.252126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.252136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.252139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.252143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.252147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.252152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.252159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.252164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.252174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.252178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.252183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.252187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.252192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.252196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.252201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.252220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:31.254354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1959adb-a7df2849-8f867d75-693e5c41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.254499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:31.254509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1501
2025-10-02T08:12:31.254635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.254671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:31.254680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:31.254683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:31.255155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1501 sessionId:  describe result for acl check
2025-10-02T08:12:31.255193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:31.255199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:31.255201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:31.255206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534327763385936:2571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:31.255722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534327763385936:2571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:31.257989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534327763385936:2571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:31.261354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:31.261885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534327763385936:2571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:31.261893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534327763385936:2571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:31.261897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534327763385936:2571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:31.261907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:31.263167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:31.263173Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:31.263177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:31.263182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:31.263191Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1500 [1:7556534327763385920:2567]
2025-10-02T08:12:31.263205Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:31.263226Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:31.263230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.263234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.263236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.263258Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:31.263264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:31.263271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:31.263346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.263347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.263351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:31.263354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:31.263534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:31.263542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.263560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.263589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:31.263621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763385967:2571], now have 1 active actors on pipe
2025-10-02T08:12:31.263630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534328223208758:2378], now have 1 active actors on pipe
2025-10-02T08:12:31.263638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534327763385914:2567]
2025-10-02T08:12:31.263640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534327763385914:2567]
2025-10-02T08:12:31.263587Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1500
2025-10-02T08:12:31.263649Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:31.263663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:31.263666Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:31.263674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:31.263694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:31.263703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:31.263710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1500
2025-10-02T08:12:31.263749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.263760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.263773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534327763385914:2567]
2025-10-02T08:12:31.263789Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:31.263813Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:31.263827Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:31.263838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.263849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.263851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:31.263865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.263884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:31.263981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.264084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.264095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.264126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.264175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1501 partition: 0 MaxSeqNo: 17 sessionId: src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0
2025-10-02T08:12:31.264568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1959adb-a7df2849-8f867d75-693e5c41_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:31.267363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0] Write session: try to update token
2025-10-02T08:12:31.267385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:31.283074Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:31.283092Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:31.283094Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:31.283103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534327763385914:2567]
2025-10-02T08:12:31.283108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534327763385914:2567]
2025-10-02T08:12:31.283146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:31.283151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.283153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:31.283153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:31.283158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:31.283215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId: src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:31.283306Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:31.286242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:31.343456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534327763386010:4654]
2025-10-02T08:12:31.343594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1500, pipe: [1:7556534327763386010:4654]
2025-10-02T08:12:31.429755Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:31.429972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.429986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.430020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763386010:4654], now have 1 active actors on pipe
2025-10-02T08:12:31.430144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:31.430152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:31.430203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1501 reason: error at write: Disconnected sessionId: src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0
2025-10-02T08:12:31.430308Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:31.430377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1501 sessionId: src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0 is DEAD
2025-10-02T08:12:31.430329Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:31.430542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534327763386010:4654]
2025-10-02T08:12:31.430572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:31.430587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0] Write session will restart in 0.008321s
2025-10-02T08:12:31.430614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0] Write session: Do CDS request
2025-10-02T08:12:31.430620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:31.436475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:31.437601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:31.437795Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:31.437804Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:31.437813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:31.437852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:31.437893Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534327763386115:2550]
2025-10-02T08:12:31.438545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:31.438766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:31.438813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:31.439120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:31.439175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.439183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.439184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.439185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.439186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.439192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.439202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.439206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.439213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.439217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.439223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.439230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.439236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.439241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.439247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.439252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.439256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.439261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.439266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.439272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.439291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:31.440304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.440358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:31.440372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1502
2025-10-02T08:12:31.440543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.440581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:31.440592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:31.440595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:31.441080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1502 sessionId:  describe result for acl check
2025-10-02T08:12:31.441120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:31.441125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:31.441127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:31.441131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534327763386131:2476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:31.441681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534327763386131:2476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:31.444265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534327763386131:2476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:31.447501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534327763386131:2476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:31.447517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534327763386131:2476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:31.447519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534327763386131:2476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:31.447526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:31.447784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:31.449375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:31.449400Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:31.449403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:31.449406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:31.449413Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1501 [1:7556534327763386115:2550]
2025-10-02T08:12:31.449424Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:31.449440Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:31.449443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.449446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.449449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.449465Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:31.449480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:31.449486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:31.449544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.449556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.449560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:31.449562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:31.449669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1501
2025-10-02T08:12:31.449684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:31.449687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.449701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.449715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:31.449748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763386159:2476], now have 1 active actors on pipe
2025-10-02T08:12:31.449758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534328223208786:2378], now have 1 active actors on pipe
2025-10-02T08:12:31.449763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.449770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.449788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534327763386109:2550]
2025-10-02T08:12:31.449797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534327763386109:2550]
2025-10-02T08:12:31.449804Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:31.449770Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1501
2025-10-02T08:12:31.449811Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:31.449818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:31.449820Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:31.449833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:31.449836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:31.449851Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d67e688-ec016f01-49cd8f88-100249c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:31.449864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.449867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.449869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:31.449877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.449893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:31.449943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534327763386109:2550]
2025-10-02T08:12:31.449958Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:31.449965Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:31.449977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.450040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.450051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.450066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.450102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1502 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d67e688-ec016f01-49cd8f88-100249c2_0
2025-10-02T08:12:31.450397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5986bb15-7bc76bbc-b3ff3859-26ccdb01_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d67e688-ec016f01-49cd8f88-100249c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:31.452979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d67e688-ec016f01-49cd8f88-100249c2_0] Write session: try to update token
2025-10-02T08:12:31.452996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d67e688-ec016f01-49cd8f88-100249c2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:31.467119Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:31.467144Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:31.467156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534327763386109:2550]
2025-10-02T08:12:31.467205Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:31.467212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:31.467402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:31.467568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:31.467720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:31.467882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:31.468129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:31.468175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:31.468628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId: src_id|5d67e688-ec016f01-49cd8f88-100249c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:31.471576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:31.471655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.471673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.471711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:31.471736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:31.471781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.471794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.471992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.472076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.472167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.472242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.472412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.472426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.472500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.472565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.472638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.472711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.472771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.472780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.472867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.472936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.473001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.473080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.473127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.473136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.473204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.473280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.473357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.473434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.473490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.473499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.473585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.473665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.473747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.473838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.473909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.473919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.474001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.474073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.474148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.474234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.474294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.474305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.474390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.474467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.474682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.474765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.474825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.474834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.474915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.474987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.475066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.475144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.475194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.475197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.475278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.475337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.475399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.475464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.475517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.475520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.475602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:31.475666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:31.475728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:31.475792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:31.475838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:31.475842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:31.475893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:31.475957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.475976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.475979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:31.476014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:31.476029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:31.476032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:31.476036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:31.476039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:31.476457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:31.476479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:31.476489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:31.476493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:31.476497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:31.476501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:31.477398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:31.477427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:31.477434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:31.477436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:31.477440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:31.477444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:31.477951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:31.477966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:31.477973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:31.477977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:31.477980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:31.480299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:31.480309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:31.480323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392751480
2025-10-02T08:12:31.480444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:31.480455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:31.480464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:31.480468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:31.480473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:31.480476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:31.481339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:31.481368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:31.481374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:31.481378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:31.481381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:31.481387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:31.481887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:31.481908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:31.481918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:31.481926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:31.481931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:31.481936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:31.482424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:31.482449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:31.482455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:31.483674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:31.483691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:31.483697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:31.483704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:31.483713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392751483
2025-10-02T08:12:31.484024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:31.484049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:31.484056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:31.484060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:31.484064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:31.484067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:31.484581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:31.484603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:31.484609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:31.484618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:31.484621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:31.484626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:31.485149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:31.485169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.485272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392751485
2025-10-02T08:12:31.489247Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:31.489274Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:31.489283Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:31.489290Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:31.491062Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:31.491079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:31.491081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:31.491093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534327763386109:2550]
2025-10-02T08:12:31.491097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534327763386109:2550]
2025-10-02T08:12:31.491141Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:31.491155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:31.491162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:31.491168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.491176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:31.491434Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:31.530926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534327763386180:4654]
2025-10-02T08:12:31.531242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1501, pipe: [1:7556534327763386180:4654]
2025-10-02T08:12:31.641017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d67e688-ec016f01-49cd8f88-100249c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:31.641035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d67e688-ec016f01-49cd8f88-100249c2_0] Write session will restart in 0.008073s
2025-10-02T08:12:31.641072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d67e688-ec016f01-49cd8f88-100249c2_0] Write session: Do CDS request
2025-10-02T08:12:31.641080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d67e688-ec016f01-49cd8f88-100249c2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:31.641047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:31.641348Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:12:31.641338Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534250453914523:4686] disconnected; active server actors: 1
2025-10-02T08:12:31.641346Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534250453914523:4686] client user disconnected session shared/user_1_15_4450069362050815167_v1
2025-10-02T08:12:31.641493Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:12:31.641498Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:12:31.641505Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.007663s
2025-10-02T08:12:31.639638Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:31.640024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763386180:4654], now have 1 active actors on pipe
2025-10-02T08:12:31.640269Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:31.640581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:31.640608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1502 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d67e688-ec016f01-49cd8f88-100249c2_0
2025-10-02T08:12:31.640775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1502 sessionId: src_id|5d67e688-ec016f01-49cd8f88-100249c2_0 is DEAD
2025-10-02T08:12:31.640980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534327763386180:4654]
2025-10-02T08:12:31.640991Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:12:31.641077Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 15 consumer shared/user session shared/user_1_15_4450069362050815167_v1 is DEAD
2025-10-02T08:12:31.650472Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:12:31.650482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d67e688-ec016f01-49cd8f88-100249c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.650543Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:12:31.650569Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 16
2025-10-02T08:12:31.650661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:31.650665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1503
2025-10-02T08:12:31.651010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.651043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:31.651048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:31.651052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:31.651094Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 16 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:12:31.651136Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:12:31.651235Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 auth for : user
2025-10-02T08:12:31.651555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1503 sessionId:  describe result for acl check
2025-10-02T08:12:31.651580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:31.651582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:31.651584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:31.651590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534327763386209:2518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:31.652314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534327763386209:2518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:31.652584Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 Handle describe topics response
2025-10-02T08:12:31.652609Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 auth is DEAD
2025-10-02T08:12:31.652632Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:12:31.652965Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:12:31.653345Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_16_8168592115197028269_v1
2025-10-02T08:12:31.653356Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:12:31.653420Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:12:31.653615Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:12:31.653705Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 got read request: guid# cacc0d49-d677547b-df0af458-8dde0c38
2025-10-02T08:12:31.655330Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534327763386221:2520] connected; active server actors: 1
2025-10-02T08:12:31.655483Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534327763386221:2520] session shared/user_1_16_8168592115197028269_v1
2025-10-02T08:12:31.655494Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:12:31.655504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:12:31.655511Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_16_8168592115197028269_v1" (Sender=[1:7556534327763386199:2520], Pipe=[1:7556534327763386221:2520], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:12:31.655514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:12:31.655524Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:12:31.655531Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_16_8168592115197028269_v1" (Sender=[1:7556534327763386199:2520], Pipe=[1:7556534327763386221:2520], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:12:31.655541Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_16_8168592115197028269_v1" sender [1:7556534327763386199:2520] lock partition 0 for ReadingSession "shared/user_1_16_8168592115197028269_v1" (Sender=[1:7556534327763386199:2520], Pipe=[1:7556534327763386221:2520], Partitions=[], ActiveFamilyCount=1) generation 1 step 16
2025-10-02T08:12:31.655552Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:12:31.655555Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-10-02T08:12:31.656036Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 16 Session: "shared/user_1_16_8168592115197028269_v1" ClientId: "user" PipeClient { RawX1: 7556534327763386221 RawX2: 4503603922340312 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:12:31.656065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:12:31.658760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534327763386209:2518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:31.660298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:31.661986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:31.662199Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:31.662209Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:31.662219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:31.662265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:31.662307Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534327763386321:2519]
2025-10-02T08:12:31.662977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:31.663002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534327763386209:2518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:31.663010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534327763386209:2518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:31.663014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534327763386209:2518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:31.663023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:31.663163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:31.663215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:31.663549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:31.663596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.663603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.663607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.663609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.663610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.663615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.663626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.663630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.663635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.663638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.663645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.663659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.663666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.663672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.663677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.663687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.663692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.663697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.663702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.663707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.663733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:31.672822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:31.674600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:31.674627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:31.674629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:31.674634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:31.674642Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1502 [1:7556534327763386321:2519]
2025-10-02T08:12:31.674655Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:31.674674Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:31.674682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.674685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.674688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.674707Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:31.674717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:31.674726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:31.674815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.674826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.674829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:31.674831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:31.674909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:31.674917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.674933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.674949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:31.674984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763386330:2518], now have 1 active actors on pipe
2025-10-02T08:12:31.674993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763386238:2513], now have 1 active actors on pipe
2025-10-02T08:12:31.675001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534327763386313:2519]
2025-10-02T08:12:31.675005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1502, pipe: [1:7556534327763386238:2513]
2025-10-02T08:12:31.675009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534327763386313:2519]
2025-10-02T08:12:31.675021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1502
2025-10-02T08:12:31.675022Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:31.675032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534328223208795:2378], now have 1 active actors on pipe
2025-10-02T08:12:31.675041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:31.675056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:31.675063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:31.675074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.675082Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:31.675082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.675087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:31.675094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_16_8168592115197028269_v1 on pipe: [1:7556534327763386238:2513]
2025-10-02T08:12:31.675125Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_16_8168592115197028269_v1:1 with generation 1502
2025-10-02T08:12:31.675152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534327763386313:2519]
2025-10-02T08:12:31.675168Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:31.675178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.675185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.675187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:31.675197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.675207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.675209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:31.675225Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_16_8168592115197028269_v1
2025-10-02T08:12:31.675232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.675298Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:31.675308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:12:31.675312Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:31.675281Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1502
2025-10-02T08:12:31.678341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d67e688-ec016f01-49cd8f88-100249c2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:31.677567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:12:31.677598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:12:31.677605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.677610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.677612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:31.677621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.677634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:31.677641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:12:31.677652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:12:31.677669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.677727Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392751674 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:12:31.677738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:12:31.677775Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 sending to client partition status
2025-10-02T08:12:31.677905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.677909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.677927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.677958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1503 partition: 0 MaxSeqNo: 17 sessionId: src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0
2025-10-02T08:12:31.681777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0] Write session: try to update token
2025-10-02T08:12:31.681803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:31.688909Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:31.688924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:31.688933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534327763386313:2519]
2025-10-02T08:12:31.688977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:31.689155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:31.689285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:31.689406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:31.689524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:31.689696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:31.689729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:31.689866Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:31.703303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId: src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:31.705201Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:31.705206Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:31.705209Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:31.705218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534327763386313:2519]
2025-10-02T08:12:31.705223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534327763386313:2519]
2025-10-02T08:12:31.705276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:31.705281Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:31.705283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.705286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:31.705288Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:31.705431Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:31.706104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:31.846217Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:31.846545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.846559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.846686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534327763386238:2513]
2025-10-02T08:12:31.846718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:31.846721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:31.846754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_16_8168592115197028269_v1
2025-10-02T08:12:31.846769Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:31.846782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1503 reason: error at write: Disconnected sessionId: src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0
2025-10-02T08:12:31.846882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:31.846931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1503 sessionId: src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0 is DEAD
2025-10-02T08:12:31.847032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:31.847038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0] Write session will restart in 0.006850s
2025-10-02T08:12:31.847060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0] Write session: Do CDS request
2025-10-02T08:12:31.847066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:31.847055Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_16_8168592115197028269_v1
2025-10-02T08:12:31.853260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:31.854149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:31.854356Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:31.854365Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:31.854375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:31.854428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:31.854469Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534327763386456:2501]
2025-10-02T08:12:31.855105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:31.855302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:31.855362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.855354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:31.855420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:31.855431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1504
2025-10-02T08:12:31.855609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:31.855645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:31.855654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:31.855658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:31.855659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:31.855708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.855715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.855716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.855717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.855718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.855723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.855732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.855736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.855753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.855756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.855765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.855776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:31.855785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.855794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:31.855804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.855813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:31.855818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.855826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.855844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.855852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.855875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:31.856038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1504 sessionId:  describe result for acl check
2025-10-02T08:12:31.856068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:31.856073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:31.856075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:31.856080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534327763386470:2499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:31.856573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534327763386470:2499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:31.858495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534327763386470:2499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:31.864061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534327763386470:2499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:31.864091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534327763386470:2499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:31.864095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534327763386470:2499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:31.864112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:31.864637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:31.866301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:31.866320Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:31.866323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:31.866327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:31.866333Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1503 [1:7556534327763386456:2501]
2025-10-02T08:12:31.866344Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:31.866358Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:31.866360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.866362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.866364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.866378Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:31.866381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:31.866386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:31.866447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.866454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.866457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:31.866459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:31.866507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:31.866516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.866525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:31.866532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:31.866543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534327763386450:2501]
2025-10-02T08:12:31.866544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534327763386450:2501]
2025-10-02T08:12:31.866551Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:31.866564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:31.866566Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:31.866569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:31.866578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:31.866586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:31.866595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763386504:2499], now have 1 active actors on pipe
2025-10-02T08:12:31.866604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534328223208802:2378], now have 1 active actors on pipe
2025-10-02T08:12:31.866623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1503
2025-10-02T08:12:31.866634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534327763386450:2501]
2025-10-02T08:12:31.866637Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:31.866696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:31.866697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.866702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.866692Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1503
2025-10-02T08:12:31.866728Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:31.866741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:31.866744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:31.866746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:31.866753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:31.866761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:31.866778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.866817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:31.866824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:31.866836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:31.866882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1504 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0
2025-10-02T08:12:31.867233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ceb8776-bd046a08-8b4cfe52-6a043b42_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:31.870189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0] Write session: try to update token
2025-10-02T08:12:31.870204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:31.884354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId: src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:31.885955Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:31.885972Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:31.885974Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:31.885982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534327763386450:2501]
2025-10-02T08:12:31.885985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534327763386450:2501]
2025-10-02T08:12:31.886020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:31.886025Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:31.886030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:31.886031Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:31.886031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:31.886156Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:31.886942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:31.947098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534327763386520:2513]
2025-10-02T08:12:31.947298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1503, pipe: [1:7556534327763386520:2513]
2025-10-02T08:12:32.026685Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:32.026998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.027012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.027056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534327763386520:2513], now have 1 active actors on pipe
2025-10-02T08:12:32.027162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534327763386520:2513]
2025-10-02T08:12:32.027179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:32.027181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:32.027233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1504 reason: error at write: Disconnected sessionId: src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0
2025-10-02T08:12:32.027270Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:32.027279Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:32.027395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1504 sessionId: src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0 is DEAD
2025-10-02T08:12:32.027581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:32.027592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0] Write session will restart in 0.008090s
2025-10-02T08:12:32.027615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0] Write session: Do CDS request
2025-10-02T08:12:32.027636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:32.034901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:32.035890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:32.036112Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:32.036116Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:32.036126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:32.036181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:32.036217Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534332058353916:2491]
2025-10-02T08:12:32.036784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:32.036999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:32.037059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:32.037395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:32.037462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.037471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.037473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.037474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.037475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.037480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.037491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.037496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.037499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.037503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.037509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.037521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.037531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.037537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.037541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.037547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.037551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.037556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.037560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.037566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.037594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:32.041285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.041377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:32.041405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1505
2025-10-02T08:12:32.041510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.041539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:32.041549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:32.041553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:32.041992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1505 sessionId:  describe result for acl check
2025-10-02T08:12:32.042027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:32.042033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:32.042035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:32.042040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534332058353932:2495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:32.042616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534332058353932:2495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:32.046489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:32.046522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534332058353932:2495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:32.048282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:32.048296Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:32.048298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:32.048301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:32.048305Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1504 [1:7556534332058353916:2491]
2025-10-02T08:12:32.048313Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:32.048329Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:32.048331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.048333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.048334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.048346Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:32.048349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:32.048354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:32.048402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.048409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.048411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:32.048413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:32.048467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:32.048472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.048481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.048489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:32.048500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534332058353910:2491]
2025-10-02T08:12:32.048504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534332058353910:2491]
2025-10-02T08:12:32.048510Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:32.048520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:32.048523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:32.048526Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:32.048531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:32.048533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:32.048540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534332518176105:2378], now have 1 active actors on pipe
2025-10-02T08:12:32.048576Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1504
2025-10-02T08:12:32.048570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534332058353910:2491]
2025-10-02T08:12:32.048578Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:32.048586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:32.054132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534332058353932:2495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:32.054148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534332058353932:2495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:32.054151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534332058353932:2495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:32.054162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:32.054391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1504
2025-10-02T08:12:32.054411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058353974:2495], now have 1 active actors on pipe
2025-10-02T08:12:32.054437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.054446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.054472Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|162e120f-89843972-684e0f32-df8838d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:32.054486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.054490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.054493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:32.054503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.054517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:32.054539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.054610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.054625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.054652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.054696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1505 partition: 0 MaxSeqNo: 17 sessionId: src_id|162e120f-89843972-684e0f32-df8838d7_0
2025-10-02T08:12:32.055029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9aabd8f-d59c59fa-949a1abb-e286a11e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|162e120f-89843972-684e0f32-df8838d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:32.057830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162e120f-89843972-684e0f32-df8838d7_0] Write session: try to update token
2025-10-02T08:12:32.057847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162e120f-89843972-684e0f32-df8838d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:32.060584Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:32.060605Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:32.060614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534332058353910:2491]
2025-10-02T08:12:32.060658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:32.060673Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:32.060872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:32.061027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:32.061181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:32.061323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:32.061587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:32.061623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:32.076557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId: src_id|162e120f-89843972-684e0f32-df8838d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:32.078340Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:32.078363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:32.078366Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:32.078378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534332058353910:2491]
2025-10-02T08:12:32.078384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534332058353910:2491]
2025-10-02T08:12:32.078435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:32.078434Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:32.078441Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:32.078451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.078457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:32.078606Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:32.079507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:32.127331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534332058353979:2513]
2025-10-02T08:12:32.127502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1504, pipe: [1:7556534332058353979:2513]
2025-10-02T08:12:32.231468Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:32.231714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.231727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.231748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058353979:2513], now have 1 active actors on pipe
2025-10-02T08:12:32.231890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:32.231901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:32.231960Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:32.231963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1505 reason: error at write: Disconnected sessionId: src_id|162e120f-89843972-684e0f32-df8838d7_0
2025-10-02T08:12:32.232157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1505 sessionId: src_id|162e120f-89843972-684e0f32-df8838d7_0 is DEAD
2025-10-02T08:12:32.232231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534332058353979:2513]
2025-10-02T08:12:32.232320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162e120f-89843972-684e0f32-df8838d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:32.232331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162e120f-89843972-684e0f32-df8838d7_0] Write session will restart in 0.006353s
2025-10-02T08:12:32.232353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162e120f-89843972-684e0f32-df8838d7_0] Write session: Do CDS request
2025-10-02T08:12:32.232363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162e120f-89843972-684e0f32-df8838d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:32.231998Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:32.237520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:32.238380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:32.238539Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:32.238548Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:32.238557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:32.238601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:32.238639Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534332058354085:2486]
2025-10-02T08:12:32.239205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:32.239638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:32.239680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:32.239946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:32.239992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.239998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.239999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.240000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.240001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.240004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.240011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.240013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.240016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.240018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.240022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.240026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.240029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.240032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.240037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.240041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.240045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.240049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.240053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.240057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.240071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:32.240228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162e120f-89843972-684e0f32-df8838d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.240354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:32.240362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1506
2025-10-02T08:12:32.240454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.240491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:32.240500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:32.240504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:32.240745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1506 sessionId:  describe result for acl check
2025-10-02T08:12:32.240772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:32.240774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:32.240775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:32.240779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534332058354112:2483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:32.241181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534332058354112:2483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:32.242483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534332058354112:2483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:32.248493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534332058354112:2483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:32.248509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534332058354112:2483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:32.248512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534332058354112:2483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:32.248520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:32.249089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:32.250478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:32.250491Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:32.250493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:32.250495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:32.250500Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1505 [1:7556534332058354085:2486]
2025-10-02T08:12:32.250508Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:32.250520Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:32.250522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.250525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.250526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.250537Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:32.250542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:32.250546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:32.250586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.250593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.250595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:32.250596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:32.250644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:32.250655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.250666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.250678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:32.250694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058354144:2483], now have 1 active actors on pipe
2025-10-02T08:12:32.250703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1505
2025-10-02T08:12:32.250704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534332058354079:2486]
2025-10-02T08:12:32.250706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534332058354079:2486]
2025-10-02T08:12:32.250712Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:32.250718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:32.250719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534332518176125:2378], now have 1 active actors on pipe
2025-10-02T08:12:32.250726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:32.250726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:32.250737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:32.250740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:32.250745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.250756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.250787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534332058354079:2486]
2025-10-02T08:12:32.250797Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:32.250807Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:32.250784Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1505
2025-10-02T08:12:32.250810Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:32.250815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.250818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.250820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:32.250827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.250835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:32.250869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.250919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.250926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.250937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.250967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1506 partition: 0 MaxSeqNo: 17 sessionId: src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0
2025-10-02T08:12:32.251237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162e120f-89843972-684e0f32-df8838d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:32.253859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0] Write session: try to update token
2025-10-02T08:12:32.253874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:32.267044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId: src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:32.269037Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:32.269056Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:32.269059Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:32.269067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534332058354079:2486]
2025-10-02T08:12:32.269071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534332058354079:2486]
2025-10-02T08:12:32.269111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:32.269116Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:32.269121Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:32.269123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.269125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:32.269251Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:32.269897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:32.333898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534332058354161:2513]
2025-10-02T08:12:32.333974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1505, pipe: [1:7556534332058354161:2513]
2025-10-02T08:12:32.420331Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:32.420766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.420776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.420908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058354161:2513], now have 1 active actors on pipe
2025-10-02T08:12:32.421356Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:32.421706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:32.421771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1506 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0
2025-10-02T08:12:32.421849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534332058354161:2513]
2025-10-02T08:12:32.421967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1506 sessionId: src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0 is DEAD
2025-10-02T08:12:32.422295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:32.422307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0] Write session will restart in 0.006974s
2025-10-02T08:12:32.422332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0] Write session: Do CDS request
2025-10-02T08:12:32.422342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:32.423879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:32.433179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.433133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:32.433618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:32.433967Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:32.433971Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:32.433982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:32.434037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:32.434073Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534332058354300:2447]
2025-10-02T08:12:32.434681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:32.434980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:32.435023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:32.435313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:32.435352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.435354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.435354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.435356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.435356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.435362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.435371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.435375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.435378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.435381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.435386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.435392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.435398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.435402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.435407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.435411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.435415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.435419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.435422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.435427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.435444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:32.435943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:32.435955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1507
2025-10-02T08:12:32.436133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.436160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:32.436165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:32.436168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:32.436914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1507 sessionId:  describe result for acl check
2025-10-02T08:12:32.436952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:32.436954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:32.436955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:32.436960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534332058354316:2445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:32.437476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534332058354316:2445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:32.450442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:32.452299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:32.452307Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:32.452310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:32.452313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:32.452320Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1506 [1:7556534332058354300:2447]
2025-10-02T08:12:32.452333Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:32.452351Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:32.452355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.452358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.452361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.452377Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:32.452382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:32.452389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:32.452453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.452456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.452459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:32.452462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:32.452535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:32.452538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.452554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.452566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:32.452586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534332518176132:2378], now have 1 active actors on pipe
2025-10-02T08:12:32.452593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534332058354293:2447]
2025-10-02T08:12:32.452596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534332058354293:2447]
2025-10-02T08:12:32.452604Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:32.452618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:32.452633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:32.452637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:32.452670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534332058354293:2447]
2025-10-02T08:12:32.452673Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:32.452745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:32.452748Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:32.452755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:32.456899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1506
2025-10-02T08:12:32.459596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534332058354316:2445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:32.469602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534332058354316:2445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:32.469625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534332058354316:2445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:32.469628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534332058354316:2445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:32.469639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:32.470065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1506
2025-10-02T08:12:32.470066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058354352:2445], now have 1 active actors on pipe
2025-10-02T08:12:32.470075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.470082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.470112Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:32.470124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.470136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.470140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:32.470153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.470171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:32.470189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.470250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.470255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.470292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.470335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1507 partition: 0 MaxSeqNo: 17 sessionId: src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0
2025-10-02T08:12:32.470688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e41f0f3-5e20f799-72a8eab2-58e77be4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:32.473411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0] Write session: try to update token
2025-10-02T08:12:32.473427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:32.475550Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:32.475575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:32.475577Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:32.475589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534332058354293:2447]
2025-10-02T08:12:32.475594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534332058354293:2447]
2025-10-02T08:12:32.475643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:32.475643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:32.475650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:32.475654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.475657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:32.475811Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:32.495574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId: src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:32.498231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:32.523766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534332058354365:2513]
2025-10-02T08:12:32.524954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1506, pipe: [1:7556534332058354365:2513]
2025-10-02T08:12:32.624483Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:32.623589Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:32.624016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.624025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.624044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058354365:2513], now have 1 active actors on pipe
2025-10-02T08:12:32.624333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534332058354365:2513]
2025-10-02T08:12:32.624351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:32.624351Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:32.624353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:32.624829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1507 reason: error at write: Disconnected sessionId: src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0
2025-10-02T08:12:32.625309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:32.625321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0] Write session will restart in 0.005624s
2025-10-02T08:12:32.625354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0] Write session: Do CDS request
2025-10-02T08:12:32.625365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:32.625003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1507 sessionId: src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0 is DEAD
2025-10-02T08:12:32.632351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.632604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:32.632621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1508
2025-10-02T08:12:32.632840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.632887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:32.632897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:32.632901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:32.633525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1508 sessionId:  describe result for acl check
2025-10-02T08:12:32.633556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:32.633558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:32.633560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:32.633565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534332058354451:2434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:32.634066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534332058354451:2434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:32.635943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:32.636716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:32.636721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534332058354451:2434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:32.636941Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:32.636951Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:32.636961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:32.637009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:32.637042Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534332058354497:2438]
2025-10-02T08:12:32.637757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:32.638120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:32.638175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:32.638872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:32.638949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.638955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.638957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.638958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.638959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.638965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.638976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.638980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.638986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.638989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.638996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.639003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.639009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.639015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.639020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.639025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.639029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.639034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.639045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.639051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.639076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:32.645786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534332058354451:2434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:32.645817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534332058354451:2434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:32.645821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534332058354451:2434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:32.645830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:32.650340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:32.651983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:32.651990Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:32.651993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:32.651996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:32.652003Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1507 [1:7556534332058354497:2438]
2025-10-02T08:12:32.652020Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:32.652037Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:32.652039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.652041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.652043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.652060Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:32.652065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:32.652070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:32.652140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.652142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.652145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:32.652147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:32.652208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:32.652211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.652225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.652237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:32.652252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534332058354490:2438]
2025-10-02T08:12:32.652254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534332058354490:2438]
2025-10-02T08:12:32.652260Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:32.652272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:32.652284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:32.652287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:32.652318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534332058354490:2438]
2025-10-02T08:12:32.652322Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:32.652553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:32.652561Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:32.652565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:32.652918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058354523:2434], now have 1 active actors on pipe
2025-10-02T08:12:32.652925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534332518176161:2378], now have 1 active actors on pipe
2025-10-02T08:12:32.652948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1507
2025-10-02T08:12:32.653015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.653022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.653051Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:32.653059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.653063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.653065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:32.653076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.653090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:32.653127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.653186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.653196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.653217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.653255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1508 partition: 0 MaxSeqNo: 17 sessionId: src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0
2025-10-02T08:12:32.653592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a47c288-5fa66bc-4c7a9d63-4b43ab0b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:32.656196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0] Write session: try to update token
2025-10-02T08:12:32.656217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:32.652984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1507
2025-10-02T08:12:32.672503Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:32.672527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:32.672530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:32.672539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534332058354490:2438]
2025-10-02T08:12:32.672543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534332058354490:2438]
2025-10-02T08:12:32.672586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:32.672594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.672605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:32.672621Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:32.672626Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:32.672745Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:32.674902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId: src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:32.677722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:32.724314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534332058354540:2513]
2025-10-02T08:12:32.724518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1507, pipe: [1:7556534332058354540:2513]
2025-10-02T08:12:32.831975Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:32.832353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.832371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.832415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058354540:2513], now have 1 active actors on pipe
2025-10-02T08:12:32.833315Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:32.833384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534332058354540:2513]
2025-10-02T08:12:32.833415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:32.833418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:32.833428Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:32.833481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1508 reason: error at write: Disconnected sessionId: src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0
2025-10-02T08:12:32.833651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1508 sessionId: src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0 is DEAD
2025-10-02T08:12:32.833815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:32.833826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0] Write session will restart in 0.005645s
2025-10-02T08:12:32.833855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0] Write session: Do CDS request
2025-10-02T08:12:32.833863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:32.840718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:32.840884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.840973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:32.840987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1509
2025-10-02T08:12:32.841164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:32.841191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:32.841196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:32.841200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:32.841623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1509 sessionId:  describe result for acl check
2025-10-02T08:12:32.841652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:32.841653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:32.841655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:32.841661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534332058354653:2424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:32.841762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:32.842015Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:32.842019Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:32.842043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:32.842114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:32.842149Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534332058354655:2420]
2025-10-02T08:12:32.842158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534332058354653:2424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:32.842806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:32.843044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:32.843082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:32.843397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:32.843451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.843452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.843454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.843455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.843456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.843462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.843472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.843477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.843481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.843486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.843491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.843499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:32.843505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.843511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:32.843517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.843522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:32.843527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.843532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.843537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.843543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.843565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:32.844328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534332058354653:2424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:32.850324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534332058354653:2424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:32.850344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534332058354653:2424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:32.850348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534332058354653:2424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:32.850357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:32.852565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:32.854388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:32.854412Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:32.854416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:32.854419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:32.854428Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1508 [1:7556534332058354655:2420]
2025-10-02T08:12:32.854443Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:32.854464Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:32.854474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.854478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.854480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.854500Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:32.854513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:32.854521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:32.854595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.854602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.854606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:32.854608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:32.854680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:32.854690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.854708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:32.854726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:32.854750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058354699:2424], now have 1 active actors on pipe
2025-10-02T08:12:32.854761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534332058354646:2420]
2025-10-02T08:12:32.854763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534332058354646:2420]
2025-10-02T08:12:32.854775Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:32.854790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534332518176169:2378], now have 1 active actors on pipe
2025-10-02T08:12:32.854798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:32.854811Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:32.854812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:32.854815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:32.854815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:32.854854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534332058354646:2420]
2025-10-02T08:12:32.854867Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:32.854874Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:32.854915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1508
2025-10-02T08:12:32.854929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.854933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.854955Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:32.854964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:32.854968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:32.854969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:32.854979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:32.854989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:32.855006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.855086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:32.855093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:32.855106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:32.855141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1509 partition: 0 MaxSeqNo: 17 sessionId: src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0
2025-10-02T08:12:32.856420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8308ec0-ce1c5c8c-d08476ab-8facc229_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:32.859405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0] Write session: try to update token
2025-10-02T08:12:32.859425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:32.855311Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1508
2025-10-02T08:12:32.874807Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:32.874832Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:32.874835Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:32.874844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534332058354646:2420]
2025-10-02T08:12:32.874849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534332058354646:2420]
2025-10-02T08:12:32.874895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:32.874900Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:32.874903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:32.874906Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:32.874907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:32.875068Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:32.878995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId: src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:32.881639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:32.933728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534332058354715:2513]
2025-10-02T08:12:32.933881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1508, pipe: [1:7556534332058354715:2513]
2025-10-02T08:12:33.025136Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:33.025397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.025408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.025444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534332058354715:2513], now have 1 active actors on pipe
2025-10-02T08:12:33.025543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534332058354715:2513]
2025-10-02T08:12:33.025558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:33.025559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:33.025599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1509 reason: error at write: Disconnected sessionId: src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0
2025-10-02T08:12:33.025708Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:33.025752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1509 sessionId: src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0 is DEAD
2025-10-02T08:12:33.025698Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:33.025943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:33.025954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0] Write session will restart in 0.007544s
2025-10-02T08:12:33.025979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0] Write session: Do CDS request
2025-10-02T08:12:33.025986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:33.032512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:33.033664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:33.033837Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:33.033845Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:33.033866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:33.033916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:33.033956Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534336353322121:2417]
2025-10-02T08:12:33.034275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.034378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:33.034395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1510
2025-10-02T08:12:33.034529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.034554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:33.034562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:33.034564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:33.034598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:33.034761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:33.034799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:33.034989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1510 sessionId:  describe result for acl check
2025-10-02T08:12:33.035030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:33.035036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:33.035039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:33.035044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534336353322132:2413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:33.035095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:33.035138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.035143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.035146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.035147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.035148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.035153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.035162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.035166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.035174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.035178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.035183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.035194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.035205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.035210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.035218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.035223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.035232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.035237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.035242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.035248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.035272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:33.035578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534336353322132:2413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:33.038148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534336353322132:2413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:33.042840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534336353322132:2413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:33.042859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534336353322132:2413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:33.042863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534336353322132:2413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:33.042872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:33.043647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:33.045297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:33.045315Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:33.045318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:33.045322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:33.045329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1509 [1:7556534336353322121:2417]
2025-10-02T08:12:33.045340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:33.045356Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:33.045358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.045365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.045367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.045381Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:33.045393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:33.045399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:33.045460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.045467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.045470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:33.045474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:33.045536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:33.045547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.045559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.045575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:33.045591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1509
2025-10-02T08:12:33.045597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322168:2413], now have 1 active actors on pipe
2025-10-02T08:12:33.045600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534336813143471:2378], now have 1 active actors on pipe
2025-10-02T08:12:33.045606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534336353322115:2417]
2025-10-02T08:12:33.045609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534336353322115:2417]
2025-10-02T08:12:33.045621Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:33.045634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.045638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:33.045641Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:33.045643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.045660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:33.045648Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1509
2025-10-02T08:12:33.045678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:33.045686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:33.045727Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de31bce4-5827a072-66250e40-267c929d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:33.045738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.045746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.045749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:33.045757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.045770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:33.045787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534336353322115:2417]
2025-10-02T08:12:33.045799Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:33.045812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:33.045829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.045878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.045890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.045908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.045944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1510 partition: 0 MaxSeqNo: 17 sessionId: src_id|de31bce4-5827a072-66250e40-267c929d_0
2025-10-02T08:12:33.046249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a021f865-ea4ddec6-a1123d67-1d9ce198_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de31bce4-5827a072-66250e40-267c929d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:33.049036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de31bce4-5827a072-66250e40-267c929d_0] Write session: try to update token
2025-10-02T08:12:33.049055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de31bce4-5827a072-66250e40-267c929d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:33.064301Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:33.064321Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:33.064324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:33.064333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534336353322115:2417]
2025-10-02T08:12:33.064338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534336353322115:2417]
2025-10-02T08:12:33.064387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:33.064389Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:33.064394Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:33.064400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.064402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:33.064548Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:33.066191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId: src_id|de31bce4-5827a072-66250e40-267c929d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:33.069006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:33.125784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534336353322185:2513]
2025-10-02T08:12:33.125890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1509, pipe: [1:7556534336353322185:2513]
2025-10-02T08:12:33.208857Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:33.209281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.209297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.209338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322185:2513], now have 1 active actors on pipe
2025-10-02T08:12:33.209492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534336353322185:2513]
2025-10-02T08:12:33.209518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:33.209525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:33.209583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1510 reason: error at write: Disconnected sessionId: src_id|de31bce4-5827a072-66250e40-267c929d_0
2025-10-02T08:12:33.209727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1510 sessionId: src_id|de31bce4-5827a072-66250e40-267c929d_0 is DEAD
2025-10-02T08:12:33.210075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de31bce4-5827a072-66250e40-267c929d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:33.210085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de31bce4-5827a072-66250e40-267c929d_0] Write session will restart in 0.005643s
2025-10-02T08:12:33.210104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de31bce4-5827a072-66250e40-267c929d_0] Write session: Do CDS request
2025-10-02T08:12:33.210109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de31bce4-5827a072-66250e40-267c929d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:33.210486Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:33.214368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:33.217300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de31bce4-5827a072-66250e40-267c929d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.217917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:33.217936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1511
2025-10-02T08:12:33.218039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.218065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:33.218073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:33.218076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:33.218443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1511 sessionId:  describe result for acl check
2025-10-02T08:12:33.218476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:33.218484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:33.218485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:33.218490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534336353322213:2404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:33.218972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534336353322213:2404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:33.221258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534336353322213:2404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:33.226346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:33.227332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534336353322213:2404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:33.227347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534336353322213:2404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:33.227353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534336353322213:2404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:33.227363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:33.227905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:33.228208Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:33.228218Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:33.228230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:33.228294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:33.228341Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534336353322338:2405]
2025-10-02T08:12:33.228959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:33.229224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:33.229273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:33.229540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:33.229601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.229608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.229609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.229611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.229612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.229617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.229627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.229630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.229639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.229646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.229655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.229663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.229673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.229678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.229683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.229693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.229698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.229703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.229710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.229717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.229729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:33.238004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:33.239453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:33.239470Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:33.239472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:33.239476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:33.239521Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1510 [1:7556534336353322338:2405]
2025-10-02T08:12:33.239534Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:33.239555Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:33.239561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.239563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.239565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.239579Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:33.239585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:33.239590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:33.239641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.239646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.239648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:33.239650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:33.239706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:33.239716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.239726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.239741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:33.239765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322331:2404], now have 1 active actors on pipe
2025-10-02T08:12:33.239772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534336353322324:2405]
2025-10-02T08:12:33.239778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534336353322324:2405]
2025-10-02T08:12:33.239786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:33.239792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1510
2025-10-02T08:12:33.239801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:33.239813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:33.239819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:33.239825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534336813143492:2378], now have 1 active actors on pipe
2025-10-02T08:12:33.239810Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:33.239829Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:33.239829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.239833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.239872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534336353322324:2405]
2025-10-02T08:12:33.239883Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:33.239891Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:33.239900Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:33.239908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.239911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.239913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:33.239919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.239929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:33.239960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.240064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.240076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.240091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.240063Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1510
2025-10-02T08:12:33.240184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1511 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0
2025-10-02T08:12:33.240620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de31bce4-5827a072-66250e40-267c929d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:33.243180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0] Write session: try to update token
2025-10-02T08:12:33.243193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:33.263714Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:33.263743Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:33.263748Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:33.263760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534336353322324:2405]
2025-10-02T08:12:33.263766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534336353322324:2405]
2025-10-02T08:12:33.263821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:33.263830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.263833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:33.264007Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:33.264856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId: src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:33.265187Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:33.265202Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:33.268091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:33.309561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534336353322374:2513]
2025-10-02T08:12:33.309752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1510, pipe: [1:7556534336353322374:2513]
2025-10-02T08:12:33.404638Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:33.404980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.404990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.405024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322374:2513], now have 1 active actors on pipe
2025-10-02T08:12:33.406868Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:33.407112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:33.407101Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:33.407176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1511 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0
2025-10-02T08:12:33.407359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1511 sessionId: src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0 is DEAD
2025-10-02T08:12:33.407499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534336353322374:2513]
2025-10-02T08:12:33.409373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:33.409383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0] Write session will restart in 0.009552s
2025-10-02T08:12:33.409411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0] Write session: Do CDS request
2025-10-02T08:12:33.409418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:33.420618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.420920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:33.420939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1512
2025-10-02T08:12:33.421097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.421133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:33.421138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:33.421143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:33.421592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1512 sessionId:  describe result for acl check
2025-10-02T08:12:33.421632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:33.421635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:33.421636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:33.421642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534336353322407:2373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:33.422227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534336353322407:2373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:33.425229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534336353322407:2373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:33.432853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:33.433270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534336353322407:2373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:33.433277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534336353322407:2373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:33.433281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534336353322407:2373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:33.433309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:33.438448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:33.438673Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:33.438683Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:33.438694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:33.438746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:33.438779Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534336353322540:2375]
2025-10-02T08:12:33.439349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:33.439580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:33.439622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:33.439899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:33.439952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.439955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.439956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.439956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.439957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.439962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.439971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.439974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.439977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.439980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.439985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.439991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.439997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.440001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.440005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.440009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.440013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.440018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.440022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.440026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.440044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:33.451396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:33.453186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:33.453209Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:33.453212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:33.453216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:33.453222Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1511 [1:7556534336353322540:2375]
2025-10-02T08:12:33.453235Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:33.453254Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:33.453256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.453259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.453261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.453281Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:33.453293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:33.453300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:33.453377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.453385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.453387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:33.453390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:33.453452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:33.453459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.453474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.453484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:33.453503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534336353322527:2375]
2025-10-02T08:12:33.453510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534336353322527:2375]
2025-10-02T08:12:33.453518Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:33.453533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322535:2373], now have 1 active actors on pipe
2025-10-02T08:12:33.453545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:33.453545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:33.453549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:33.453558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:33.453561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:33.453599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534336813143498:2378], now have 1 active actors on pipe
2025-10-02T08:12:33.453601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534336353322527:2375]
2025-10-02T08:12:33.453604Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:33.453641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1511
2025-10-02T08:12:33.453687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:33.453728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.453736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.453764Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af9674f2-5185d889-ef506cc8-622b0465_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:33.453772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.453776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.453778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:33.453789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.453798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:33.453815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.454148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.454158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.454178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.454223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1512 partition: 0 MaxSeqNo: 17 sessionId: src_id|af9674f2-5185d889-ef506cc8-622b0465_0
2025-10-02T08:12:33.454330Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1511
2025-10-02T08:12:33.457053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecaf829-adc74c71-d07d0b25-27a91b01_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|af9674f2-5185d889-ef506cc8-622b0465_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:33.459970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9674f2-5185d889-ef506cc8-622b0465_0] Write session: try to update token
2025-10-02T08:12:33.459986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9674f2-5185d889-ef506cc8-622b0465_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:33.477176Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:33.477197Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:33.477200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:33.477210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534336353322527:2375]
2025-10-02T08:12:33.477214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534336353322527:2375]
2025-10-02T08:12:33.477262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:33.477265Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:33.477269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:33.477270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.477273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:33.477402Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:33.486537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId: src_id|af9674f2-5185d889-ef506cc8-622b0465_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:33.489422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:33.504413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534336353322580:2513]
2025-10-02T08:12:33.504496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1511, pipe: [1:7556534336353322580:2513]
2025-10-02T08:12:33.615397Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:33.615752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.615764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.615803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322580:2513], now have 1 active actors on pipe
2025-10-02T08:12:33.617023Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:33.616919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:33.616931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:33.616998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1512 reason: error at write: Disconnected sessionId: src_id|af9674f2-5185d889-ef506cc8-622b0465_0
2025-10-02T08:12:33.617046Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:33.617217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1512 sessionId: src_id|af9674f2-5185d889-ef506cc8-622b0465_0 is DEAD
2025-10-02T08:12:33.617351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534336353322580:2513]
2025-10-02T08:12:33.617507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9674f2-5185d889-ef506cc8-622b0465_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:33.617517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9674f2-5185d889-ef506cc8-622b0465_0] Write session will restart in 0.006453s
2025-10-02T08:12:33.617542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9674f2-5185d889-ef506cc8-622b0465_0] Write session: Do CDS request
2025-10-02T08:12:33.617548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9674f2-5185d889-ef506cc8-622b0465_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:33.625287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9674f2-5185d889-ef506cc8-622b0465_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.625615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:33.625632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1513
2025-10-02T08:12:33.625747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.625772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:33.625777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:33.625781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:33.626233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1513 sessionId:  describe result for acl check
2025-10-02T08:12:33.626257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:33.626259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:33.626260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:33.626266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534336353322674:2327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:33.626728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534336353322674:2327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:33.629457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:33.630939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:33.631028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534336353322674:2327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:33.631189Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:33.631198Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:33.631208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:33.631264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:33.631300Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534336353322730:2344]
2025-10-02T08:12:33.631962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:33.632223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:33.632272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:33.632590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:33.632633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.632640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.632641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.632641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.632643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.632648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.632658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.632662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.632666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.632672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.632677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.632685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.632691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.632696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.632701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.632706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.632710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.632720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.632724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.632733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.632752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:33.638461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534336353322674:2327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:33.638482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534336353322674:2327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:33.638487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534336353322674:2327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:33.638498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:33.641166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:33.642844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:33.642865Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:33.642868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:33.642871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:33.642878Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1512 [1:7556534336353322730:2344]
2025-10-02T08:12:33.642891Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:33.642909Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:33.642912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.642915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.642919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.642935Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:33.642945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:33.642951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:33.643017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.643024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.643027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:33.643029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:33.643092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:33.643099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.643113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.643129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:33.643151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322756:2327], now have 1 active actors on pipe
2025-10-02T08:12:33.643162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534336353322722:2344]
2025-10-02T08:12:33.643168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534336353322722:2344]
2025-10-02T08:12:33.643179Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:33.643188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534336813143530:2378], now have 1 active actors on pipe
2025-10-02T08:12:33.643196Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:33.643199Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:33.643205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:33.643217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:33.643223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:33.643261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534336353322722:2344]
2025-10-02T08:12:33.643264Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:33.643283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:33.643307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1512
2025-10-02T08:12:33.643320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.643323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.643348Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:33.643355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.643364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.643366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:33.643376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.643388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:33.643406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.643442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.643449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.643462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.643496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1513 partition: 0 MaxSeqNo: 17 sessionId: src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0
2025-10-02T08:12:33.643840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9674f2-5185d889-ef506cc8-622b0465_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:33.643262Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1512
2025-10-02T08:12:33.646634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0] Write session: try to update token
2025-10-02T08:12:33.646654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:33.657207Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:33.657227Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:33.657236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534336353322722:2344]
2025-10-02T08:12:33.657278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:33.657277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:33.657455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:33.657602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:33.657753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:33.657902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:33.658108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:33.658152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:33.665533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId: src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:33.668291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:33.668502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.668516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.668548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:33.668573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:33.668653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.668661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.668834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.668905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.668969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.669042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.669086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.669089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.669237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.669300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.669357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.669418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.669457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.669459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.669522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.669580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.669636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.669703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.669747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.669749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.669811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.669871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.669933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.669996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.670040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.670042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.670143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.670216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.670282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.670347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.670397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.670399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.670492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.670556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.670622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.670690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.670743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.670749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.670822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.670882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.670956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.671025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.671070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.671074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.671150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.671217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.671284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.671351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.671401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.671403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.671482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.671539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.671595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.671654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.671701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.671704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.671782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:33.671843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:33.671899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:33.671961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:33.672009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:33.672010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:33.672045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:33.672098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.672127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.672129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:33.672158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:33.672169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:33.672176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:33.672178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:33.672180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:33.672601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:33.672616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:33.672622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:33.672624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:33.672626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:33.672629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:33.673438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:33.673465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:33.673470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:33.673473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:33.673475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:33.673477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:33.673990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:33.674017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:33.674024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:33.674027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:33.674029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:33.675296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:33.675321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:33.675334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392753675
2025-10-02T08:12:33.675443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:33.675455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:33.675459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:33.675461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:33.675464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:33.675466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:33.675948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:33.675968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:33.675973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:33.675975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:33.675977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:33.675980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:33.676477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:33.676496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:33.676501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:33.676503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:33.676506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:33.676508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:33.677000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:33.677024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:33.677030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:33.678154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:33.678166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:33.678174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:33.678177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:33.678184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392753678
2025-10-02T08:12:33.678479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:33.678498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:33.678502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:33.678504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:33.678507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:33.678509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:33.678994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:33.679005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:33.679009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:33.679011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:33.679013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:33.679016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:33.679472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:33.679480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.679562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392753679
2025-10-02T08:12:33.680335Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:33.680348Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:33.680357Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:33.680362Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:33.682259Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:33.682273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:33.682274Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:33.682281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534336353322722:2344]
2025-10-02T08:12:33.682284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534336353322722:2344]
2025-10-02T08:12:33.682335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:33.682342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.682344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:33.682366Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:33.682382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:33.682485Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:33.717607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534336353322781:2513]
2025-10-02T08:12:33.717698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1512, pipe: [1:7556534336353322781:2513]
2025-10-02T08:12:33.819352Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:33.819765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322781:2513], now have 1 active actors on pipe
2025-10-02T08:12:33.819888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:33.819897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:33.819909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534336353322781:2513]
2025-10-02T08:12:33.819924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1513 reason: error at write: Disconnected sessionId: src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0
2025-10-02T08:12:33.820077Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:33.820101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1513 sessionId: src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0 is DEAD
2025-10-02T08:12:33.820485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:33.820496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0] Write session will restart in 0.005372s
2025-10-02T08:12:33.820531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0] Write session: Do CDS request
2025-10-02T08:12:33.820539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:33.820035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:33.828666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.828748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:33.828775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1514
2025-10-02T08:12:33.828904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:33.828932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:33.828943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:33.828947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:33.829358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1514 sessionId:  describe result for acl check
2025-10-02T08:12:33.829388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:33.829394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:33.829396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:33.829401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534336353322822:2328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:33.830079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534336353322822:2328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:33.832693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534336353322822:2328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:33.833739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:33.834705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:33.834974Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:33.834987Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:33.834999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:33.835057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:33.835098Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534336353322933:2337]
2025-10-02T08:12:33.835152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534336353322822:2328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:33.835167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534336353322822:2328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:33.835171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534336353322822:2328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:33.835179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:33.835722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:33.835915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:33.835972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:33.836301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:33.836371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.836381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.836381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.836382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.836383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.836389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.836399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.836403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.836406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.836409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.836415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.836422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:33.836429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.836433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:33.836437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.836442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:33.836445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.836450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.836454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.836458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.836477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:33.848036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:33.850023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:33.850049Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:33.850052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:33.850056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:33.850064Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1513 [1:7556534336353322933:2337]
2025-10-02T08:12:33.850076Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:33.850095Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:33.850099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.850102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.850104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.850122Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:33.850128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:33.850136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:33.850209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.850213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.850216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:33.850221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:33.850299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:33.850302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.850317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:33.850329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:33.850344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534336353322927:2337]
2025-10-02T08:12:33.850346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534336353322927:2337]
2025-10-02T08:12:33.850359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:33.850372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:33.850389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:33.850391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:33.850428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534336353322927:2337]
2025-10-02T08:12:33.850430Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:33.850454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322938:2328], now have 1 active actors on pipe
2025-10-02T08:12:33.850482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1513
2025-10-02T08:12:33.850487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:33.850492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:33.850498Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:33.850751Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1513
2025-10-02T08:12:33.850657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534336813143537:2378], now have 1 active actors on pipe
2025-10-02T08:12:33.850668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.850672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.850697Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:33.850707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:33.850711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:33.850713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:33.850721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:33.850730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:33.850745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.850776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:33.850778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:33.850790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:33.850818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1514 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0
2025-10-02T08:12:33.851236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2eae86c-6e3fdff-336e72b2-3553bb4c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:33.854062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0] Write session: try to update token
2025-10-02T08:12:33.854081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:33.875563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId: src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:33.875904Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:33.875908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:33.875910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:33.875916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534336353322927:2337]
2025-10-02T08:12:33.875923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534336353322927:2337]
2025-10-02T08:12:33.875964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:33.875970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:33.875971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:33.875972Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:33.875977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:33.876158Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:33.878084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:33.920982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534336353322965:2513]
2025-10-02T08:12:33.921087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1513, pipe: [1:7556534336353322965:2513]
2025-10-02T08:12:34.022429Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:34.022828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.022838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.022880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534336353322965:2513], now have 1 active actors on pipe
2025-10-02T08:12:34.024133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:34.024144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0] Write session will restart in 0.008835s
2025-10-02T08:12:34.024170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0] Write session: Do CDS request
2025-10-02T08:12:34.024178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:34.023137Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:34.023451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:34.023504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1514 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0
2025-10-02T08:12:34.023696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1514 sessionId: src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0 is DEAD
2025-10-02T08:12:34.023841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534336353322965:2513]
2025-10-02T08:12:34.025371Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:34.037479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.041258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:34.041285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1515
2025-10-02T08:12:34.044741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:34.044952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.045013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:34.045020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:34.045025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:34.045722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1515 sessionId:  describe result for acl check
2025-10-02T08:12:34.045756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:34.045758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:34.045760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:34.045766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534340648290382:2308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:34.046368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534340648290382:2308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:34.046908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:34.047176Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:34.047192Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:34.047205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:34.047284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:34.047335Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534340648290389:2320]
2025-10-02T08:12:34.047954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:34.048237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:34.048302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:34.048612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:34.048672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.048681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.048683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.048684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.048685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.048690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.048700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.048704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.048707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.048711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.048716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.048723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.048729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.048734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.048738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.048743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.048747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.048751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.048763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.048768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.048788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:34.058401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:34.060784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:34.060793Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:34.060797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:34.062530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534340648290382:2308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:34.063820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:34.063839Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1514 [1:7556534340648290389:2320]
2025-10-02T08:12:34.063857Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:34.063878Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:34.063882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.063886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.063888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.063925Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:34.063933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:34.063941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:34.064026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.064028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.064031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:34.064034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:34.064133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:34.064136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.064154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.064169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:34.064195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534340648290376:2320]
2025-10-02T08:12:34.064197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534340648290376:2320]
2025-10-02T08:12:34.064206Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:34.064222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534341108110840:2378], now have 1 active actors on pipe
2025-10-02T08:12:34.064232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:34.064247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:34.064251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:34.064297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534340648290376:2320]
2025-10-02T08:12:34.064300Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:34.064336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:34.064338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:34.064345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:34.064791Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1514
2025-10-02T08:12:34.068697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534340648290382:2308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:34.068716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534340648290382:2308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:34.068718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534340648290382:2308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:34.068727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:34.069655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1514
2025-10-02T08:12:34.069679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648290438:2308], now have 1 active actors on pipe
2025-10-02T08:12:34.069733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.069739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.069777Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:34.069784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.069788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.069790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:34.069803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.069817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:34.069836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.069909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.069918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.069929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.069954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1515 partition: 0 MaxSeqNo: 17 sessionId: src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0
2025-10-02T08:12:34.070284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333d7a-6026b875-a3f0fb2e-7734f0f4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:34.073322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0] Write session: try to update token
2025-10-02T08:12:34.073347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:34.090500Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:34.090526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:34.090528Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:34.090538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534340648290376:2320]
2025-10-02T08:12:34.090542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534340648290376:2320]
2025-10-02T08:12:34.090589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:34.090595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.090597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:34.090599Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:34.090606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:34.090743Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:34.093627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId: src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:34.096547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:34.124892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534340648290444:2513]
2025-10-02T08:12:34.125174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1514, pipe: [1:7556534340648290444:2513]
2025-10-02T08:12:34.249875Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:34.250282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.250296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.250335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648290444:2513], now have 1 active actors on pipe
2025-10-02T08:12:34.251143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:34.251157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:34.251215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1515 reason: error at write: Disconnected sessionId: src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0
2025-10-02T08:12:34.251229Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:34.251383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1515 sessionId: src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0 is DEAD
2025-10-02T08:12:34.251449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534340648290444:2513]
2025-10-02T08:12:34.251727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:34.251738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0] Write session will restart in 0.009936s
2025-10-02T08:12:34.251762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0] Write session: Do CDS request
2025-10-02T08:12:34.251770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:34.251914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:34.260619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:34.262370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:34.262567Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:34.262578Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:34.262588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:34.262647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:34.262686Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534340648290581:10663]
2025-10-02T08:12:34.263355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:34.263385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.263619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:34.265203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:34.265216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1516
2025-10-02T08:12:34.268353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.268405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:34.268416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:34.268421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:34.268895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:34.269258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1516 sessionId:  describe result for acl check
2025-10-02T08:12:34.269299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:34.269301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:34.269310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:34.269312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:34.269320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534340648290593:10659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:34.269359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.269368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.269373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.269374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.269375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.269381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.269390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.269394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.269397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.269400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.269407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.269414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.269420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.269425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.269437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.269442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.269446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.269451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.269456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.269460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.269479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:34.269827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534340648290593:10659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:34.272218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534340648290593:10659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:34.277473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534340648290593:10659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:34.277489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534340648290593:10659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:34.277493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534340648290593:10659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:34.277502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:34.279264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:34.280942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:34.280949Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:34.280952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:34.280955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:34.280961Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1515 [1:7556534340648290581:10663]
2025-10-02T08:12:34.280974Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:34.280992Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:34.280995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.280997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.281002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.281017Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:34.281023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:34.281029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:34.281092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.281094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.281098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:34.281100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:34.281171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:34.281173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.281189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.281202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:34.281221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648290630:10659], now have 1 active actors on pipe
2025-10-02T08:12:34.281228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534340648290574:10663]
2025-10-02T08:12:34.281230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534340648290574:10663]
2025-10-02T08:12:34.281244Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:34.281254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534341108110861:2378], now have 1 active actors on pipe
2025-10-02T08:12:34.281262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:34.281277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:34.281280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:34.281313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534340648290574:10663]
2025-10-02T08:12:34.281316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:34.281342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:34.281345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:34.281350Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:34.281357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1515
2025-10-02T08:12:34.281394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.281403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.281431Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:34.281439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.281443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.281446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:34.281456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.281468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:34.281485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.281570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.281573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.281586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.281615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1516 partition: 0 MaxSeqNo: 17 sessionId: src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0
2025-10-02T08:12:34.282905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1515
2025-10-02T08:12:34.285115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc7df31-4fe4e7aa-2745f7d5-7ef9733c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:34.287924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0] Write session: try to update token
2025-10-02T08:12:34.287942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:34.310950Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:34.310978Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:34.310985Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:34.311001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534340648290574:10663]
2025-10-02T08:12:34.311006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534340648290574:10663]
2025-10-02T08:12:34.311066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:34.311077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.311080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:34.311100Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:34.311111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:34.311258Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:34.335797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId: src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:34.338931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:34.351732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534340648290643:2513]
2025-10-02T08:12:34.351869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1515, pipe: [1:7556534340648290643:2513]
2025-10-02T08:12:34.476939Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:34.478041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.478051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.478078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648290643:2513], now have 1 active actors on pipe
2025-10-02T08:12:34.478846Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:34.479306Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:34.479697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534340648290643:2513]
2025-10-02T08:12:34.479717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:34.479789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1516 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0
2025-10-02T08:12:34.479983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1516 sessionId: src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0 is DEAD
2025-10-02T08:12:34.480416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:34.480432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0] Write session will restart in 0.007455s
2025-10-02T08:12:34.480458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0] Write session: Do CDS request
2025-10-02T08:12:34.480465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:34.491217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.493402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:34.493423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1517
2025-10-02T08:12:34.494539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:34.495653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:34.495833Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:34.495836Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:34.495846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:34.495889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:34.495921Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534340648290785:10630]
2025-10-02T08:12:34.496384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:34.496557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:34.496583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:34.496874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:34.496907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.496908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.496909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.496910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.496910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.496913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.496919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.496922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.496924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.496926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.496929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.496934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.496939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.496942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.496944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.496948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.496950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.496953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.496957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.496960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.496972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:34.497598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.497652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:34.497658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:34.497663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:34.498119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1517 sessionId:  describe result for acl check
2025-10-02T08:12:34.498148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:34.498149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:34.498151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:34.498157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534340648290801:10633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:34.498756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534340648290801:10633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:34.505348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534340648290801:10633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:34.509841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:34.511618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:34.511641Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:34.511644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:34.511648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:34.511655Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1516 [1:7556534340648290785:10630]
2025-10-02T08:12:34.511666Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:34.511683Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:34.511687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.511690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.511692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.511711Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:34.511717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:34.511724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:34.511787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.511789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.511792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:34.511794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:34.511871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:34.511873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.511888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.511899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:34.511915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534340648290778:10630]
2025-10-02T08:12:34.511917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534340648290778:10630]
2025-10-02T08:12:34.511925Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:34.511938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:34.511954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:34.511957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:34.511973Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:34.511977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:34.511988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534340648290778:10630]
2025-10-02T08:12:34.511991Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:34.512011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534341108110869:2378], now have 1 active actors on pipe
2025-10-02T08:12:34.512176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:34.512477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534340648290801:10633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:34.512483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534340648290801:10633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:34.512487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534340648290801:10633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:34.512495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:34.514412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1516
2025-10-02T08:12:34.514426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648290839:10633], now have 1 active actors on pipe
2025-10-02T08:12:34.514435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.514441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.514467Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2905b0ed-46a391b0-d4c0027-ad490560_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:34.514478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.514483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.514486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:34.514500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.514515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:34.514534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.514599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.514608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.514622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.514652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1517 partition: 0 MaxSeqNo: 17 sessionId: src_id|2905b0ed-46a391b0-d4c0027-ad490560_0
2025-10-02T08:12:34.515084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa487b3-6d1bf7c4-e215c649-62c09c4c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2905b0ed-46a391b0-d4c0027-ad490560_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:34.515372Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1516
2025-10-02T08:12:34.518077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2905b0ed-46a391b0-d4c0027-ad490560_0] Write session: try to update token
2025-10-02T08:12:34.518094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2905b0ed-46a391b0-d4c0027-ad490560_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:34.537435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId: src_id|2905b0ed-46a391b0-d4c0027-ad490560_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:34.540610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:34.542487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.542515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.542540Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:34.542543Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:34.542546Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:34.542555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534340648290778:10630]
2025-10-02T08:12:34.542559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534340648290778:10630]
2025-10-02T08:12:34.542615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:34.542631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.542633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:34.542795Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:34.543052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:34.543072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:34.580885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534340648290869:2513]
2025-10-02T08:12:34.581003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1516, pipe: [1:7556534340648290869:2513]
2025-10-02T08:12:34.702154Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:34.701055Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:34.701687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:34.701745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:34.701752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648290869:2513], now have 1 active actors on pipe
2025-10-02T08:12:34.702248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:34.702251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:34.702276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1517 reason: error at write: Disconnected sessionId: src_id|2905b0ed-46a391b0-d4c0027-ad490560_0
2025-10-02T08:12:34.702426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1517 sessionId: src_id|2905b0ed-46a391b0-d4c0027-ad490560_0 is DEAD
2025-10-02T08:12:34.702575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534340648290869:2513]
2025-10-02T08:12:34.704901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2905b0ed-46a391b0-d4c0027-ad490560_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:34.704918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2905b0ed-46a391b0-d4c0027-ad490560_0] Write session will restart in 0.009885s
2025-10-02T08:12:34.704944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2905b0ed-46a391b0-d4c0027-ad490560_0] Write session: Do CDS request
2025-10-02T08:12:34.704953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2905b0ed-46a391b0-d4c0027-ad490560_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:34.716399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2905b0ed-46a391b0-d4c0027-ad490560_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.716483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:34.716501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1518
2025-10-02T08:12:34.716657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.716704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:34.716716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:34.716720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:34.717068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:34.717401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1518 sessionId:  describe result for acl check
2025-10-02T08:12:34.717448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:34.717454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:34.717456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:34.717462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534340648291006:10616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:34.717977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534340648291006:10616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:34.717979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:34.718160Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:34.718176Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:34.718187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:34.718255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:34.718299Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534340648291010:10623]
2025-10-02T08:12:34.718881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:34.719242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:34.719295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:34.719638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:34.719678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.719679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.719681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.719682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.719683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.719688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.719697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.719701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.719705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.719708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.719713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.719720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.719725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.719730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.719734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.719738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.719742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.719747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.719752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.719757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.719776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:34.720614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534340648291006:10616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:34.728384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534340648291006:10616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:34.728405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534340648291006:10616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:34.728409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534340648291006:10616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:34.728419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:34.730644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:34.732735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:34.732754Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:34.732757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:34.732760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:34.732768Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1517 [1:7556534340648291010:10623]
2025-10-02T08:12:34.732781Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:34.732798Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:34.732816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.732822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.732825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.732843Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:34.732848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:34.732855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:34.732923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.732930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.732933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:34.732935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:34.732995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:34.732998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.733014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.733028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:34.733029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1517
2025-10-02T08:12:34.733047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648291053:10616], now have 1 active actors on pipe
2025-10-02T08:12:34.733054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534340648291000:10623]
2025-10-02T08:12:34.733056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534340648291000:10623]
2025-10-02T08:12:34.733062Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:34.733071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.733075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.733081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:34.733082Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:34.733089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534341108110900:2378], now have 1 active actors on pipe
2025-10-02T08:12:34.733097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:34.733109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:34.733112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:34.733155Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:34.733160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.733164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.733165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:34.733177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.733186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:34.733193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534340648291000:10623]
2025-10-02T08:12:34.733203Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:34.733217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:34.733234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.733497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.733505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.733531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.733571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1518 partition: 0 MaxSeqNo: 17 sessionId: src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0
2025-10-02T08:12:34.733939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2905b0ed-46a391b0-d4c0027-ad490560_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:34.733265Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1517
2025-10-02T08:12:34.736619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0] Write session: try to update token
2025-10-02T08:12:34.736634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:34.753938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId: src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:34.756531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:34.756978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.756997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.757031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:34.757057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:34.758271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.758279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.758447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.758503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.758562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.758623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.758663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.758667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.758751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.758810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.758870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.758946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.758994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.759003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.759075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.759135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.759203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.759262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.759309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.759320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.759389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.759462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.759533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.759604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.759657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.759665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.759745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.759814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.759886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.759961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.760011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.760018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.760091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.760173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.760248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.760328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.760377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.760380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.760459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.760525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.760593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.760660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.760711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.760714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.760792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.760888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.760963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.761032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.761078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.761084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.761156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.761214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.761284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.761349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.761401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.761403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.761481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:34.761542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:34.761605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:34.761669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:34.761716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:34.761719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:34.761779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:34.761846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.761866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.761869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:34.761899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:34.761912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:34.761915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:34.761919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:34.761921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:34.762313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:34.762329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:34.762334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:34.762338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:34.762341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:34.762344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:34.762894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:34.762907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:34.762914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:34.762917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:34.762920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:34.762924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:34.763481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:34.763492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:34.763497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:34.763501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:34.763505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:34.764782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:34.764789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:34.764999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392754764
2025-10-02T08:12:34.765121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:34.765128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:34.765133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:34.765138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:34.765142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:34.765145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:34.765635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:34.765645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:34.765650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:34.765654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:34.765658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:34.765662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:34.766218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:34.766231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:34.766239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:34.766243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:34.766246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:34.766250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:34.766717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:34.766727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:34.766732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:34.767930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:34.767937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:34.767945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:34.767949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:34.767958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392754767
2025-10-02T08:12:34.768275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:34.768285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:34.768290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:34.768294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:34.768298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:34.768301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:34.768792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:34.768987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:34.769001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:34.769004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:34.769008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:34.769011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:34.769550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:34.769560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.769699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392754769
2025-10-02T08:12:34.772312Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:34.772347Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:34.772354Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:34.772362Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:34.772374Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:34.772377Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:34.772381Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:34.772390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534340648291000:10623]
2025-10-02T08:12:34.772395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534340648291000:10623]
2025-10-02T08:12:34.772492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:34.772499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.772501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:34.772656Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:34.772925Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:34.772935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:34.802594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534340648291071:2513]
2025-10-02T08:12:34.802813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1517, pipe: [1:7556534340648291071:2513]
2025-10-02T08:12:34.932929Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:34.933320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648291071:2513], now have 1 active actors on pipe
2025-10-02T08:12:34.933676Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:34.933973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534340648291071:2513]
2025-10-02T08:12:34.933988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:34.934016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1518 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0
2025-10-02T08:12:34.934415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:34.934429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0] Write session will restart in 0.006210s
2025-10-02T08:12:34.934454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0] Write session: Do CDS request
2025-10-02T08:12:34.934226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1518 sessionId: src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0 is DEAD
2025-10-02T08:12:34.934461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:34.934683Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:34.940658Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [3efa0ff964a80032] Result# TEvPutResult {Id# [72075186224037892:1517:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:34.940671Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1517:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:34.940711Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2343d2fea519a4b5] Result# TEvPutResult {Id# [72075186224037892:1517:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:34.940729Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1517:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:34.943360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.944023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:34.944043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1519
2025-10-02T08:12:34.944702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:34.944752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:34.944764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:34.944768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:34.945181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1519 sessionId:  describe result for acl check
2025-10-02T08:12:34.945223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:34.945225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:34.945227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:34.945232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534340648291196:10605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:34.945777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534340648291196:10605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:34.947054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:34.948416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:34.948741Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:34.948757Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:34.948768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:34.948860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:34.948903Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534340648291224:10607]
2025-10-02T08:12:34.949672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:34.949928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:34.949987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:34.950302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:34.950349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.950350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.950351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.950354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.950355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.950360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.950370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.950374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.950377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.950380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.950386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.950393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:34.950398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.950403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:34.950407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.950412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:34.950416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.950421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.950426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.950430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.950452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:34.952624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534340648291196:10605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:34.961389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:34.963988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:34.964020Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:34.964023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:34.964028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:34.964036Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1518 [1:7556534340648291224:10607]
2025-10-02T08:12:34.964050Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:34.964076Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:34.964080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.964084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.964087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.964120Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:34.964127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:34.964135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:34.964217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.964228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.964231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:34.964234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:34.964312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:34.964321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.964339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:34.964356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:34.964375Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534340648291206:10607]
2025-10-02T08:12:34.964381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534340648291206:10607]
2025-10-02T08:12:34.964390Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:34.964410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:34.964429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:34.964438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:34.964451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534341108110908:2378], now have 1 active actors on pipe
2025-10-02T08:12:34.964494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534340648291206:10607]
2025-10-02T08:12:34.964504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:34.964599Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:34.964618Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:34.964628Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:34.965689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534340648291196:10605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:34.965698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534340648291196:10605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:34.965703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534340648291196:10605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:34.965713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:34.964792Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1518
2025-10-02T08:12:34.970089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1518
2025-10-02T08:12:34.970126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534340648291258:10605], now have 1 active actors on pipe
2025-10-02T08:12:34.970135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.970144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.970183Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:34.970199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:34.970216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:34.970232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:34.970250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:34.970270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:34.970293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.970774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:34.970785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:34.970807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:34.971345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3c2a161-e3cbf411-63a161e2-902a467c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:34.970860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1519 partition: 0 MaxSeqNo: 17 sessionId: src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0
2025-10-02T08:12:34.974450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Write session: try to update token
2025-10-02T08:12:34.974473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:34.992997Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:34.993022Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:34.993026Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:34.993036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534340648291206:10607]
2025-10-02T08:12:34.993041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534340648291206:10607]
2025-10-02T08:12:34.993094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:34.993101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:34.993103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:34.993262Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:34.996891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:34.996905Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:34.999553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId: src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:35.002617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:35.033996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534344943258562:2513]
2025-10-02T08:12:35.037107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1518, pipe: [1:7556534344943258562:2513]
2025-10-02T08:12:35.210753Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:35.211080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.211089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.211135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534344943258562:2513], now have 1 active actors on pipe
2025-10-02T08:12:35.212033Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:35.213067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:35.217153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:35.217168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Write session will restart in 0.008442s
2025-10-02T08:12:35.217197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Write session: Do CDS request
2025-10-02T08:12:35.217205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:35.212721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:35.212733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:35.212816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1519 reason: error at write: Disconnected sessionId: src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0
2025-10-02T08:12:35.212990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1519 sessionId: src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0 is DEAD
2025-10-02T08:12:35.213145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534344943258562:2513]
2025-10-02T08:12:35.229314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:35.233343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:35.233360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1520
2025-10-02T08:12:35.234874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:35.236749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:35.236965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:35.236968Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:35.236972Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:35.236982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:35.237002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:35.237008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:35.237011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:35.237030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:35.237065Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534344943258698:10591]
2025-10-02T08:12:35.237734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:35.238192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:35.238231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:35.238537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:35.238569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.238570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.238571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.238572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.238573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.238579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.238589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.238592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.238596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.238600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.238605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.238612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.238618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.238623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.238627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.238631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.238635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.238640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.238644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.238649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.238667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:35.238942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1520 sessionId:  describe result for acl check
2025-10-02T08:12:35.238966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:35.238967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:35.238969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:35.238973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534344943258711:10583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:35.239454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534344943258711:10583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:35.258914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:35.260716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:35.260738Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:35.260742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:35.260748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:35.260756Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1519 [1:7556534344943258698:10591]
2025-10-02T08:12:35.260769Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:35.260790Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:35.260792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:35.260796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:35.260798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:35.261532Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:35.261548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:35.261556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:35.261771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.261780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.261784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:35.261786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:35.261848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:35.261855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.261869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.261886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:35.261907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534344943258690:10591]
2025-10-02T08:12:35.261914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534344943258690:10591]
2025-10-02T08:12:35.261922Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:35.261935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:35.261939Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:35.261945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:35.261953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:35.261956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:35.261967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534345403078225:2378], now have 1 active actors on pipe
2025-10-02T08:12:35.262007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534344943258690:10591]
2025-10-02T08:12:35.262016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:35.262197Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:35.263784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534344943258711:10583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:35.263034Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1519
2025-10-02T08:12:35.283312Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:35.283331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:35.283333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:35.283342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534344943258690:10591]
2025-10-02T08:12:35.283346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534344943258690:10591]
2025-10-02T08:12:35.283383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:35.283389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.283391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:35.283531Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:35.284872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:35.284879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:35.289309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534344943258711:10583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:35.289328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534344943258711:10583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:35.289332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534344943258711:10583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:35.289341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:35.290247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1519
2025-10-02T08:12:35.313129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534344943258771:2513]
2025-10-02T08:12:35.322432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1519, pipe: [1:7556534344943258771:2513]
2025-10-02T08:12:35.452055Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:35.452384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534344943258767:10583], now have 1 active actors on pipe
2025-10-02T08:12:35.452394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.452401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.452441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534344943258771:2513], now have 1 active actors on pipe
2025-10-02T08:12:35.452785Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:35.452877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1520 reason: status is not ok: tablet will be restarted right now sessionId: 
2025-10-02T08:12:35.453069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1520 sessionId:  is DEAD
2025-10-02T08:12:35.453341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534344943258771:2513]
2025-10-02T08:12:35.453646Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:35.456935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:35.456949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Write session will restart in 0.017576s
2025-10-02T08:12:35.456980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Write session: Do CDS request
2025-10-02T08:12:35.456988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:35.475267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:35.477503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:35.478326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:35.478343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1521
2025-10-02T08:12:35.478509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:35.478723Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:35.478726Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:35.478735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:35.478780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:35.478821Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534344943258906:10577]
2025-10-02T08:12:35.479569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:35.480062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:35.480148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:35.480495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:35.480555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.480557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.480558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.480559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.480561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.480567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.480579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.480582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.480586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.480589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.480596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.480605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.480612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.480617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.480622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.480627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.480632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.480636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.480641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.480649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.480668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:35.481313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:35.481363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:35.481368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:35.481373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:35.481931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1521 sessionId:  describe result for acl check
2025-10-02T08:12:35.481969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:35.481972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:35.481974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:35.481979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534344943258921:10571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:35.482558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534344943258921:10571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:35.486279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534344943258921:10571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:35.490290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534344943258921:10571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:35.490309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534344943258921:10571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:35.490313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534344943258921:10571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:35.490322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:35.491949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:35.494407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:35.494428Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:35.494431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:35.494435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:35.494444Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1520 [1:7556534344943258906:10577]
2025-10-02T08:12:35.494457Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:35.494480Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:35.494483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:35.494487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:35.494490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:35.494509Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:35.494514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:35.494522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:35.494599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.494601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.494604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:35.494607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:35.494696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:35.494698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.494713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.494724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:35.494743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534344943258898:10577]
2025-10-02T08:12:35.494744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534344943258898:10577]
2025-10-02T08:12:35.494751Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:35.494769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:35.494783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:35.494786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:35.494796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534344943258953:10571], now have 1 active actors on pipe
2025-10-02T08:12:35.494800Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:35.494804Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:35.494836Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534344943258898:10577]
2025-10-02T08:12:35.494842Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:35.494847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534345403078233:2378], now have 1 active actors on pipe
2025-10-02T08:12:35.494900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1520
2025-10-02T08:12:35.494970Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:35.495389Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1520
2025-10-02T08:12:35.495618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.495631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.495677Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdf11169-91f7091e-61259bbb-7017065e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:35.495685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:35.495689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:35.495691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:35.495703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:35.495714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:35.495733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:35.495762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.495765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.495778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:35.495808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1521 partition: 0 MaxSeqNo: 17 sessionId: src_id|cdf11169-91f7091e-61259bbb-7017065e_0
2025-10-02T08:12:35.496396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd7a96f-3d91b3fc-987ecd5c-d88f0265_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cdf11169-91f7091e-61259bbb-7017065e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:35.499690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf11169-91f7091e-61259bbb-7017065e_0] Write session: try to update token
2025-10-02T08:12:35.499708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf11169-91f7091e-61259bbb-7017065e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:35.518181Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:35.518203Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:35.518205Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:35.518215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534344943258898:10577]
2025-10-02T08:12:35.518220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534344943258898:10577]
2025-10-02T08:12:35.518269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:35.518276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.518279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:35.518451Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:35.518523Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:35.518535Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:35.519029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId: src_id|cdf11169-91f7091e-61259bbb-7017065e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:35.522485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:35.569718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534344943258984:2513]
2025-10-02T08:12:35.572724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1520, pipe: [1:7556534344943258984:2513]
2025-10-02T08:12:35.688496Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:35.688871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.688881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.690808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf11169-91f7091e-61259bbb-7017065e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:35.690835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf11169-91f7091e-61259bbb-7017065e_0] Write session will restart in 0.006271s
2025-10-02T08:12:35.690859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf11169-91f7091e-61259bbb-7017065e_0] Write session: Do CDS request
2025-10-02T08:12:35.690866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf11169-91f7091e-61259bbb-7017065e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:35.688923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534344943258984:2513], now have 1 active actors on pipe
2025-10-02T08:12:35.690176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:35.690179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:35.690248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1521 reason: error at write: Disconnected sessionId: src_id|cdf11169-91f7091e-61259bbb-7017065e_0
2025-10-02T08:12:35.690290Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:35.690427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1521 sessionId: src_id|cdf11169-91f7091e-61259bbb-7017065e_0 is DEAD
2025-10-02T08:12:35.690566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534344943258984:2513]
2025-10-02T08:12:35.690155Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:35.701357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf11169-91f7091e-61259bbb-7017065e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:35.701586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:35.702061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:35.702065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1522
2025-10-02T08:12:35.702218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:35.702246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:35.702251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:35.702254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:35.702801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1522 sessionId:  describe result for acl check
2025-10-02T08:12:35.702837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:35.702839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:35.702841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:35.702846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534344943259149:10544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:35.703453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534344943259149:10544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:35.703525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:35.703745Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:35.703758Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:35.703769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:35.703822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:35.703863Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534344943259154:10536]
2025-10-02T08:12:35.704633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:35.704962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:35.705024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:35.705364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:35.705426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.705427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.705428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.705429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.705430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.705436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.705447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.705451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.705454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.705458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.705465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.705472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.705478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.705483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.705488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.705493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.705497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.705501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.705508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.705513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.705533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:35.715343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534344943259149:10544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:35.716988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:35.718839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:35.718859Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:35.718861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:35.718864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:35.718869Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1521 [1:7556534344943259154:10536]
2025-10-02T08:12:35.718877Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:35.718893Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:35.718895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:35.718900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:35.718901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:35.718915Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:35.718918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:35.718923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:35.718977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.718983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.718985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:35.718987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:35.719039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:35.719052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.719066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.719082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:35.719105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534344943259142:10536]
2025-10-02T08:12:35.719111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534344943259142:10536]
2025-10-02T08:12:35.719117Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:35.719130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:35.719148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:35.719156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:35.719191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534344943259142:10536]
2025-10-02T08:12:35.719199Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:35.719216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:35.719224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534345403078263:2378], now have 1 active actors on pipe
2025-10-02T08:12:35.719230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:35.719237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:35.719733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1521
2025-10-02T08:12:35.722059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534344943259149:10544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:35.722075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534344943259149:10544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:35.722078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534344943259149:10544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:35.722085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:35.722624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1521
2025-10-02T08:12:35.722642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534344943259201:10544], now have 1 active actors on pipe
2025-10-02T08:12:35.722695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.722703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.722725Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:35.722736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:35.722740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:35.722747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:35.722757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:35.722773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:35.722791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:35.722857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.722863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.722874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:35.722896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1522 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0
2025-10-02T08:12:35.726168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf11169-91f7091e-61259bbb-7017065e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:35.729588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0] Write session: try to update token
2025-10-02T08:12:35.729612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:35.745913Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:35.745935Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:35.745938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:35.745947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534344943259142:10536]
2025-10-02T08:12:35.745953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534344943259142:10536]
2025-10-02T08:12:35.745999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:35.746008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.746010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:35.746172Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:35.746876Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:35.746905Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:35.762234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId: src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:35.765414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:35.790266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534344943259211:2513]
2025-10-02T08:12:35.790421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1521, pipe: [1:7556534344943259211:2513]
2025-10-02T08:12:35.906592Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:35.906976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.906985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.907007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534344943259211:2513], now have 1 active actors on pipe
2025-10-02T08:12:35.907293Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:35.907584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534344943259211:2513]
2025-10-02T08:12:35.907602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:35.907658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1522 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0
2025-10-02T08:12:35.907822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1522 sessionId: src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0 is DEAD
2025-10-02T08:12:35.908173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:35.908180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0] Write session will restart in 0.008772s
2025-10-02T08:12:35.908205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0] Write session: Do CDS request
2025-10-02T08:12:35.908216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:35.907403Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:35.921270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:35.922335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:35.922822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:35.923021Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:35.923025Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:35.923037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:35.923086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:35.923139Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534344943259349:10541]
2025-10-02T08:12:35.923861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:35.924300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:35.924347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:35.924707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:35.924758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.924760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.924761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.924762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.924764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.924770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.924781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.924786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.924791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.924795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.924814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.924823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:35.924830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.924835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:35.924841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.924847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:35.924854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.924859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.924864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.924870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.924893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:35.925100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:35.925118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1523
2025-10-02T08:12:35.925274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:35.925301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:35.925306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:35.925310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:35.926001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1523 sessionId:  describe result for acl check
2025-10-02T08:12:35.926036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:35.926038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:35.926040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:35.926046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534344943259365:10539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:35.926607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534344943259365:10539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:35.932753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534344943259365:10539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:35.942768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:35.943958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534344943259365:10539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:35.943976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534344943259365:10539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:35.943980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534344943259365:10539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:35.943990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:35.944603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:35.944610Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:35.944613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:35.944618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:35.944624Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1522 [1:7556534344943259349:10541]
2025-10-02T08:12:35.944639Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:35.944657Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:35.944672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:35.944675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:35.944677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:35.944694Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:35.944699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:35.944707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:35.944784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.944787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.944790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:35.944793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:35.945686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:35.945690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.945708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:35.945723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:35.945743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534344943259396:10539], now have 1 active actors on pipe
2025-10-02T08:12:35.945751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534344943259343:10541]
2025-10-02T08:12:35.945754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534344943259343:10541]
2025-10-02T08:12:35.945762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:35.945772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534345403078269:2378], now have 1 active actors on pipe
2025-10-02T08:12:35.945781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:35.945796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:35.945799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:35.945838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534344943259343:10541]
2025-10-02T08:12:35.945844Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:35.945879Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:35.945883Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:35.945889Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:35.945894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1522
2025-10-02T08:12:35.946747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.946767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.946810Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:35.946820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:35.946825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:35.946827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:35.946839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:35.946860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:35.946879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:35.946371Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1522
2025-10-02T08:12:35.949739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:35.949758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:35.949796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:35.949839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1523 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0
2025-10-02T08:12:35.950249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab60003-a77e97b2-a2288b3c-1d2af2b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:35.953288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0] Write session: try to update token
2025-10-02T08:12:35.953307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:35.973251Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:35.973276Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:35.973279Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:35.973289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534344943259343:10541]
2025-10-02T08:12:35.973294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534344943259343:10541]
2025-10-02T08:12:35.973345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:35.973352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:35.973355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:35.973527Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:35.976885Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:35.976922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:35.985855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId: src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:35.998160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:36.008912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534349238226706:2513]
2025-10-02T08:12:36.012880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1522, pipe: [1:7556534349238226706:2513]
2025-10-02T08:12:36.149835Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:36.150414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.150432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.150450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534349238226706:2513], now have 1 active actors on pipe
2025-10-02T08:12:36.150736Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:36.151119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534349238226706:2513]
2025-10-02T08:12:36.151148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:36.151202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1523 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0
2025-10-02T08:12:36.151381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1523 sessionId: src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0 is DEAD
2025-10-02T08:12:36.151814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:36.151826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0] Write session will restart in 0.008358s
2025-10-02T08:12:36.151852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0] Write session: Do CDS request
2025-10-02T08:12:36.151861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:36.155117Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:36.161376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:36.163621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:36.163641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1524
2025-10-02T08:12:36.163780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:36.163812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:36.163822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:36.163826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:36.164489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1524 sessionId:  describe result for acl check
2025-10-02T08:12:36.164523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:36.164524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:36.164525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:36.164530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534349238226831:10524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:36.165141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534349238226831:10524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:36.166756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:36.168713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:36.168978Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:36.168990Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:36.169002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:36.169061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:36.169099Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534349238226856:10528]
2025-10-02T08:12:36.169869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:36.170220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:36.170270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:36.170688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:36.170744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.170746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.170746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.170747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.170748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.170754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.170764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.170767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.170772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.170776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.170782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.170789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.170794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.170799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.170803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.170808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.170812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.170816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.170822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.170827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.170842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:36.171344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534349238226831:10524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:36.182500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534349238226831:10524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:36.182519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534349238226831:10524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:36.182523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534349238226831:10524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:36.182534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:36.182556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:36.184309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:36.184332Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:36.184335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:36.184340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:36.184347Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1523 [1:7556534349238226856:10528]
2025-10-02T08:12:36.184361Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:36.184382Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:36.184385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.184388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.184390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.184407Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:36.184412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:36.184419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:36.184486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.184489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.184493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:36.184496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:36.184567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:36.184570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.184584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.184596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:36.184613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534349238226848:10528]
2025-10-02T08:12:36.184615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534349238226848:10528]
2025-10-02T08:12:36.184630Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:36.184643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:36.184658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:36.184662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:36.184699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534349238226848:10528]
2025-10-02T08:12:36.184702Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:36.184989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:36.185005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:36.185011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:36.185138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1523
2025-10-02T08:12:36.185439Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1523
2025-10-02T08:12:36.185738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534349238226893:10524], now have 1 active actors on pipe
2025-10-02T08:12:36.185751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534349698045586:2378], now have 1 active actors on pipe
2025-10-02T08:12:36.185757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.185764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.185793Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:36.185801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.185805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.185808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:36.185818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.185828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:36.185848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:36.186560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.186576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.186601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:36.186646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1524 partition: 0 MaxSeqNo: 17 sessionId: src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0
2025-10-02T08:12:36.186979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e2ce74-2c794523-6da00635-2e2901b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:36.189778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0] Write session: try to update token
2025-10-02T08:12:36.189796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:36.206689Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:36.206712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:36.206715Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:36.206724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534349238226848:10528]
2025-10-02T08:12:36.206729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534349238226848:10528]
2025-10-02T08:12:36.206777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:36.206784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.206790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:36.206945Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:36.208648Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:36.208669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:36.216283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId: src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:36.219594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:36.250893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534349238226911:2513]
2025-10-02T08:12:36.251022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1523, pipe: [1:7556534349238226911:2513]
2025-10-02T08:12:36.368173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:36.369167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.369184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.369233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534349238226911:2513], now have 1 active actors on pipe
2025-10-02T08:12:36.373962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:36.373976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0] Write session will restart in 0.006850s
2025-10-02T08:12:36.373126Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:36.374001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0] Write session: Do CDS request
2025-10-02T08:12:36.373534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534349238226911:2513]
2025-10-02T08:12:36.373557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:36.374010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:36.373610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1524 reason: status is not ok: tablet will be restarted right now sessionId: src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0
2025-10-02T08:12:36.373796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1524 sessionId: src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0 is DEAD
2025-10-02T08:12:36.374218Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:36.383318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:36.385513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:36.385534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1525
2025-10-02T08:12:36.386335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:36.386380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:36.386386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:36.386391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:36.390544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1525 sessionId:  describe result for acl check
2025-10-02T08:12:36.390602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:36.390604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:36.390606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:36.390613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534349238226959:10520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:36.391203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534349238226959:10520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:36.402260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534349238226959:10520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:36.411864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:36.412147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:36.412345Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:36.412350Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:36.412361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:36.412414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:36.412449Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534349238227094:10519]
2025-10-02T08:12:36.413124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:36.413722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:36.413780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:36.414105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:36.414238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.414239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.414240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.414241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.414243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.414249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.414259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.414266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.414270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.414273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.414280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.414287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.414292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.414298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.414303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.414322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.414326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.414330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.414335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.414339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.414361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:36.414761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534349238226959:10520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:36.414767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534349238226959:10520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:36.414771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534349238226959:10520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:36.414779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:36.436095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:36.437890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:36.437909Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:36.437912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:36.437917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:36.437925Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1524 [1:7556534349238227094:10519]
2025-10-02T08:12:36.437938Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:36.437958Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:36.437961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.437965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.437967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.437987Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:36.437994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:36.438001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:36.438073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.438075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.438079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:36.438082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:36.438156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:36.438159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.438174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.438189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:36.438205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534349238227087:10519]
2025-10-02T08:12:36.438207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534349238227087:10519]
2025-10-02T08:12:36.438215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:36.438228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:36.438243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:36.438246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:36.438280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534349238227087:10519]
2025-10-02T08:12:36.438282Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:36.438543Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:36.438546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:36.438551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:36.438721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534349238227109:10520], now have 1 active actors on pipe
2025-10-02T08:12:36.438758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1524
2025-10-02T08:12:36.438763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534349698045593:2378], now have 1 active actors on pipe
2025-10-02T08:12:36.439430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.439437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.439480Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:36.439489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.439494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.439497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:36.439511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.439523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:36.439540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:36.440959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.440966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.440998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:36.441040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1525 partition: 0 MaxSeqNo: 17 sessionId: src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0
2025-10-02T08:12:36.441352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1524
2025-10-02T08:12:36.443727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beae9d03-b1f1190d-2bcfb278-7303da84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:36.446740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0] Write session: try to update token
2025-10-02T08:12:36.446760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:36.469860Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:36.469879Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:36.469888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534349238227087:10519]
2025-10-02T08:12:36.469935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:36.470125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:36.470263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:36.470407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:36.470538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:36.470731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:36.470762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:36.471324Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:36.475502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534349238227127:2513]
2025-10-02T08:12:36.480902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId: src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:36.483821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:36.483957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.483979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.484000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534349238227127:2513], now have 1 active actors on pipe
2025-10-02T08:12:36.484027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:36.484061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1524, pipe: [1:7556534349238227127:2513]
2025-10-02T08:12:36.484077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:36.484153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.484161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.484343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.484416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.484490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.484566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.484618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.484630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.484709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.484781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.484881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.484963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.485013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.485021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.485145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.485214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.485284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.485352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.485403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.485415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.485496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.485584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.485665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.485749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.485817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.485821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.485907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.485984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.486062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.486140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.486194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.486198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.486290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.486372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.486461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.486546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.486608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.486611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.486701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.486804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.486889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.486969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.487032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.487036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.487127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.487209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.487294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.487378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.487436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.487439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.487526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.487601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.487679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.487758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.487822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.487825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.487919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:36.487992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:36.488070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:36.488165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:36.488226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:36.488230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:36.488286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:36.488366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.488387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.488390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:36.488432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:36.488447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:36.488452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:36.488456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:36.488459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:36.489223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:36.489262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:36.489272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:36.489276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:36.489279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:36.489282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:36.489949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:36.489971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:36.489977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:36.489980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:36.489983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:36.489991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:36.490603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:36.490621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:36.490628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:36.490631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:36.490634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:36.493492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:36.493520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:36.493537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392756492
2025-10-02T08:12:36.493714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:36.493725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:36.493732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:36.493736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:36.493741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:36.493746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:36.494271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:36.494303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:36.494310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:36.494316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:36.494321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:36.494326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:36.494854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:36.494881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:36.494888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:36.494891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:36.494895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:36.494898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:36.495402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:36.495418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:36.495424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:36.496697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:36.496724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:36.496733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:36.496739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:36.496749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392756492
2025-10-02T08:12:36.497104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:36.497137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:36.497144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:36.497150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:36.497154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:36.497156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:36.497695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:36.497724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:36.497730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:36.497733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:36.497737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:36.497743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:36.498295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:36.498308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.498418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392756496
2025-10-02T08:12:36.503979Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:36.504012Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:36.504020Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:36.504031Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:36.506051Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:36.506070Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:36.506073Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:36.506093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534349238227087:10519]
2025-10-02T08:12:36.506099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534349238227087:10519]
2025-10-02T08:12:36.506160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:36.506168Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:36.506179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:36.506185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.506187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:36.506363Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:36.666429Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:36.670642Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:36.672101Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:36.672398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:36.672441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1525 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0
2025-10-02T08:12:36.672623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1525 sessionId: src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0 is DEAD
2025-10-02T08:12:36.672786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534349238227127:2513]
2025-10-02T08:12:36.676981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:36.676996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0] Write session will restart in 0.008246s
2025-10-02T08:12:36.677022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0] Write session: Do CDS request
2025-10-02T08:12:36.677030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:36.689315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:36.689935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:36.689956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1526
2025-10-02T08:12:36.693301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:36.693386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:36.693394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:36.693401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:36.693439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:36.695990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:36.696236Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:36.696240Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:36.696249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:36.696297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:36.696330Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534349238227299:10504]
2025-10-02T08:12:36.700010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1526 sessionId:  describe result for acl check
2025-10-02T08:12:36.700050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:36.700052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:36.700053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:36.700059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534349238227305:10503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:36.700635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534349238227305:10503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:36.705291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:36.705775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:36.705839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:36.706220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:36.706271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.706273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.706274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.706275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.706277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.706283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.706294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.706298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.706302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.706306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.706312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.706321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.706328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.706333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.706338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.706344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.706349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.706355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.706361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.706367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.706390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:36.714393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534349238227305:10503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:36.721907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:36.723987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:36.723994Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:36.723997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:36.724001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:36.724008Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1525 [1:7556534349238227299:10504]
2025-10-02T08:12:36.724021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:36.724040Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:36.724044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.724047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.724049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.724067Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:36.724073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:36.724080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:36.724175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.724179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.724182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:36.724184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:36.724260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:36.724263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.724277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.724288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:36.724306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534349238227291:10504]
2025-10-02T08:12:36.724309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534349238227291:10504]
2025-10-02T08:12:36.724332Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:36.724345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:36.724361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:36.724364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:36.724403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534349238227291:10504]
2025-10-02T08:12:36.724406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:36.724433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534349698045602:2378], now have 1 active actors on pipe
2025-10-02T08:12:36.724434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:36.724437Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:36.724445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:36.725310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534349238227305:10503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:36.725325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534349238227305:10503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:36.725329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534349238227305:10503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:36.725337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:36.725985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1525
2025-10-02T08:12:36.726000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534349238227364:10503], now have 1 active actors on pipe
2025-10-02T08:12:36.726065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.726073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.726110Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:36.726120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.726125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.726128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:36.726138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.726151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:36.726169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:36.726274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.726278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.726290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:36.726317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1526 partition: 0 MaxSeqNo: 17 sessionId: src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0
2025-10-02T08:12:36.729310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa9341e-4e300ccd-3de056d7-370b9bf8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:36.732219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0] Write session: try to update token
2025-10-02T08:12:36.732246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:36.729056Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1525
2025-10-02T08:12:36.758084Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:36.758107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:36.758110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:36.758120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534349238227291:10504]
2025-10-02T08:12:36.758123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534349238227291:10504]
2025-10-02T08:12:36.758171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:36.758178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.758181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:36.758342Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:36.761035Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:36.761050Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:36.761144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId: src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:36.764212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:36.775486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534349238227376:2513]
2025-10-02T08:12:36.775676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1525, pipe: [1:7556534349238227376:2513]
2025-10-02T08:12:36.932267Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:36.932633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.932640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.932659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534349238227376:2513], now have 1 active actors on pipe
2025-10-02T08:12:36.935244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:36.935258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0] Write session will restart in 0.005754s
2025-10-02T08:12:36.935284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0] Write session: Do CDS request
2025-10-02T08:12:36.935291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:36.933397Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:36.933690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534349238227376:2513]
2025-10-02T08:12:36.933708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:36.933758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1526 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0
2025-10-02T08:12:36.933944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1526 sessionId: src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0 is DEAD
2025-10-02T08:12:36.936914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:36.945246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:36.945743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:36.945761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1527
2025-10-02T08:12:36.945871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:36.945895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:36.945903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:36.945907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:36.949546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1527 sessionId:  describe result for acl check
2025-10-02T08:12:36.949592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:36.949594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:36.949595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:36.949601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534349238227523:10485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:36.950101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534349238227523:10485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:36.953718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:36.954895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534349238227523:10485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:36.956264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:36.956472Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:36.956475Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:36.956486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:36.956539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:36.956572Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534349238227560:10486]
2025-10-02T08:12:36.957224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:36.958099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:36.958143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:36.958462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:36.958503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.958504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.958505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.958506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.958507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.958513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.958523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.958527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.958531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.958534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.958540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.958548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:36.958554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.958559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:36.958563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.958568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:36.958575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.958580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.958585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.958589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.958608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:36.969579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534349238227523:10485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:36.969598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534349238227523:10485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:36.969602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534349238227523:10485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:36.969612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:36.975067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:36.978772Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1526
2025-10-02T08:12:36.977250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:36.977270Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:36.977273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:36.977276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:36.977284Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1526 [1:7556534349238227560:10486]
2025-10-02T08:12:36.977296Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:36.977328Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:36.977332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.977335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.977337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.977354Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:36.977360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:36.977366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:36.977434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.977436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.977439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:36.977441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:36.977519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:36.977525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:36.977549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:36.977578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:36.977606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534349238227543:10486]
2025-10-02T08:12:36.977608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534349238227543:10486]
2025-10-02T08:12:36.977629Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:36.977654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:36.977673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:36.977677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:36.977729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534349238227543:10486]
2025-10-02T08:12:36.977734Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:36.977944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1526
2025-10-02T08:12:36.977960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534349238227576:10485], now have 1 active actors on pipe
2025-10-02T08:12:36.977966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534349698045630:2378], now have 1 active actors on pipe
2025-10-02T08:12:36.977973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.977980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.978010Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:36.978019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:36.978024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:36.978027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:36.978038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:36.978051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:36.978070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:36.978159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:36.978162Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:36.978168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:36.980541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:36.980563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:36.980611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:36.980654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1527 partition: 0 MaxSeqNo: 17 sessionId: src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0
2025-10-02T08:12:36.981054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db01d7-da196b7e-3e4530c8-2e76e383_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:36.983791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0] Write session: try to update token
2025-10-02T08:12:36.983812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:37.004520Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:37.004546Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:37.004549Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:37.004559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534349238227543:10486]
2025-10-02T08:12:37.004564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534349238227543:10486]
2025-10-02T08:12:37.004613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:37.004620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.004622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:37.004787Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:37.006266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId: src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:37.008874Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:37.008892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:37.009329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:37.034279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534353533194886:2513]
2025-10-02T08:12:37.034467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1526, pipe: [1:7556534353533194886:2513]
2025-10-02T08:12:37.200166Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:37.201077Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:37.201617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:37.201634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0] Write session will restart in 0.007951s
2025-10-02T08:12:37.201656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0] Write session: Do CDS request
2025-10-02T08:12:37.201662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:37.200672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.200687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.200730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534353533194886:2513], now have 1 active actors on pipe
2025-10-02T08:12:37.201266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:37.201269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:37.201326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1527 reason: error at write: Disconnected sessionId: src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0
2025-10-02T08:12:37.201493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1527 sessionId: src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0 is DEAD
2025-10-02T08:12:37.201770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:37.202035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534353533194886:2513]
2025-10-02T08:12:37.210686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:37.211783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:37.211810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1528
2025-10-02T08:12:37.212581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:37.212615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:37.212621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:37.212625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:37.213897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1528 sessionId:  describe result for acl check
2025-10-02T08:12:37.213943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:37.213951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:37.213953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:37.213958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534353533195029:10472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:37.214531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534353533195029:10472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:37.215606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:37.217494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:37.217749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:37.217753Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:37.217774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:37.217839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:37.217881Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534353533195052:10474]
2025-10-02T08:12:37.218464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:37.218736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:37.218792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:37.219111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:37.219171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.219172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.219174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.219175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.219177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.219183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.219195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.219199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.219203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.219209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.219215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.219223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.219228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.219234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.219239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.219245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.219249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.219255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.219259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.219264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.219284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:37.219663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534353533195029:10472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:37.229988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534353533195029:10472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:37.230009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534353533195029:10472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:37.230013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534353533195029:10472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:37.230023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:37.237776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:37.239726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:37.239753Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:37.239756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:37.239760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:37.239767Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1527 [1:7556534353533195052:10474]
2025-10-02T08:12:37.239779Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:37.239797Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:37.239800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:37.239807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:37.239809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:37.239827Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:37.239831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:37.239838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:37.239903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.239905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.239908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:37.239911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:37.239980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:37.239983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.240000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.240012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:37.240028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534353533195037:10474]
2025-10-02T08:12:37.240030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534353533195037:10474]
2025-10-02T08:12:37.240044Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:37.240056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:37.240071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:37.240073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:37.240110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534353533195037:10474]
2025-10-02T08:12:37.240128Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:37.240340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:37.240354Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:37.240362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:37.240426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1527
2025-10-02T08:12:37.240440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534353533195083:10472], now have 1 active actors on pipe
2025-10-02T08:12:37.240513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534353993012947:2378], now have 1 active actors on pipe
2025-10-02T08:12:37.240525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.240530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.240556Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79371932-a1558944-4f93188c-7a873d8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:37.240563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:37.240567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:37.240569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:37.240579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:37.240591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:37.240608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:37.240708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.240716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.240729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:37.240766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1528 partition: 0 MaxSeqNo: 17 sessionId: src_id|79371932-a1558944-4f93188c-7a873d8b_0
2025-10-02T08:12:37.241134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591f144b-91afbc72-6b8e6a99-b7cebca3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79371932-a1558944-4f93188c-7a873d8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:37.243905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1527
2025-10-02T08:12:37.244006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79371932-a1558944-4f93188c-7a873d8b_0] Write session: try to update token
2025-10-02T08:12:37.244024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79371932-a1558944-4f93188c-7a873d8b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:37.267212Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:37.267237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:37.267248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534353533195037:10474]
2025-10-02T08:12:37.267297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:37.267483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:37.267652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:37.267809Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:37.267979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:37.268301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:37.268352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:37.268511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId: src_id|79371932-a1558944-4f93188c-7a873d8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:37.270358Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:37.272204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:37.272642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.272660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.272699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:37.272763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:37.273362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.273370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.273573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.273649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.273721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.273794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.273850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.273855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.273931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.274001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.274076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.274154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.274196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.274200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.274280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.274341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.274404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.274466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.274508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.274511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.274591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.274662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.274738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.274830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.274885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.274888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.274972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.275040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.275114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.275189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.275241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.275245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.275328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.275401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.275477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.275553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.275610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.275627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.275709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.275778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.275878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.275952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.275998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.276002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.276089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.276177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.276249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.276322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.276370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.276372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.276451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.276516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.276579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.276647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.276702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.276705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.276790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:37.278414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:37.278501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:37.278581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:37.278644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:37.278648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:37.278702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:37.278782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:37.278799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:37.278801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:37.278833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:37.278856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:37.278860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:37.278863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:37.278866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:37.279319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:37.279352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:37.279359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:37.279362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:37.279365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:37.279370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:37.279916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:37.279930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:37.279936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:37.279941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:37.279944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:37.279948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:37.280596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:37.280610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:37.280616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:37.280619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:37.280623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:37.283174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:37.283204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:37.283219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392757282
2025-10-02T08:12:37.283345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:37.284382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:37.284403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:37.284411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:37.284416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:37.284419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:37.285073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:37.285087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:37.285094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:37.285098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:37.285104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:37.285108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:37.285709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:37.285724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:37.285732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:37.285736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:37.285740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:37.285744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:37.286321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:37.286334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:37.286340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:37.288444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:37.288467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:37.288473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:37.288480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:37.288494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392757288
2025-10-02T08:12:37.288851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:37.288873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:37.288880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:37.288886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:37.288890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:37.288893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:37.289426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:37.289452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:37.289458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:37.289462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:37.289466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:37.289469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:37.289977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:37.289994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:37.290109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392757289
2025-10-02T08:12:37.290976Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:37.290990Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:37.291000Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:37.291008Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:37.293309Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:37.293319Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:37.293320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:37.293328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534353533195037:10474]
2025-10-02T08:12:37.293332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534353533195037:10474]
2025-10-02T08:12:37.293402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:37.293408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.293407Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:37.293410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:37.293427Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:37.293573Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:37.301624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534353533195116:2513]
2025-10-02T08:12:37.301989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1527, pipe: [1:7556534353533195116:2513]
2025-10-02T08:12:37.528231Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:37.528637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534353533195116:2513], now have 1 active actors on pipe
2025-10-02T08:12:37.530003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:37.529335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534353533195116:2513]
2025-10-02T08:12:37.529358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:37.529361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:37.529386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1528 reason: error at write: Disconnected sessionId: src_id|79371932-a1558944-4f93188c-7a873d8b_0
2025-10-02T08:12:37.529574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1528 sessionId: src_id|79371932-a1558944-4f93188c-7a873d8b_0 is DEAD
2025-10-02T08:12:37.533088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79371932-a1558944-4f93188c-7a873d8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:37.533101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79371932-a1558944-4f93188c-7a873d8b_0] Write session will restart in 0.009136s
2025-10-02T08:12:37.533128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79371932-a1558944-4f93188c-7a873d8b_0] Write session: Do CDS request
2025-10-02T08:12:37.533136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79371932-a1558944-4f93188c-7a873d8b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:37.537794Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:37.545534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79371932-a1558944-4f93188c-7a873d8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:37.545953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:37.545973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1529
2025-10-02T08:12:37.548031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:37.548076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:37.548082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:37.548086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:37.549405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1529 sessionId:  describe result for acl check
2025-10-02T08:12:37.549458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:37.549460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:37.549462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:37.549467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534353533195155:10462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:37.549987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534353533195155:10462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:37.560038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:37.560931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:37.561124Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:37.561129Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:37.561139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:37.561186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:37.561223Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534353533195290:10458]
2025-10-02T08:12:37.561918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:37.562713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:37.562761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:37.563092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:37.563130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.563131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.563132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.563134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.563136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.563142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.563168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.563172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.563176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.563180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.563187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.563195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.563200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.563205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.563209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.563214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.563219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.563224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.563229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.563235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.563253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:37.564256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534353533195155:10462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:37.575029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534353533195155:10462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:37.575049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534353533195155:10462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:37.575052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534353533195155:10462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:37.575063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:37.581945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:37.583907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:37.583914Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:37.583917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:37.583922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:37.583928Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1528 [1:7556534353533195290:10458]
2025-10-02T08:12:37.583941Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:37.583962Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:37.583965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:37.583969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:37.583971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:37.583989Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:37.583995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:37.584003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:37.584076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.584078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.584082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:37.584085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:37.584174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:37.584176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.584191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.584202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:37.584220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534353533195278:10458]
2025-10-02T08:12:37.584222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534353533195278:10458]
2025-10-02T08:12:37.584238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:37.584251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:37.584265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:37.584267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:37.584302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534353533195278:10458]
2025-10-02T08:12:37.584304Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:37.585089Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1528
2025-10-02T08:12:37.584572Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:37.584586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:37.584594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:37.584877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1528
2025-10-02T08:12:37.584893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534353533195319:10462], now have 1 active actors on pipe
2025-10-02T08:12:37.584897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534353993012955:2378], now have 1 active actors on pipe
2025-10-02T08:12:37.585165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.585172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.585199Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:37.585207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:37.585211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:37.585214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:37.585227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:37.585239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:37.585255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:37.585983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.585994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.586024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:37.586064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1529 partition: 0 MaxSeqNo: 17 sessionId: src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0
2025-10-02T08:12:37.589060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79371932-a1558944-4f93188c-7a873d8b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:37.592082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0] Write session: try to update token
2025-10-02T08:12:37.592104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:37.628944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534353533195333:2513]
2025-10-02T08:12:37.629179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1528, pipe: [1:7556534353533195333:2513]
2025-10-02T08:12:37.629204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534353533195333:2513], now have 1 active actors on pipe
2025-10-02T08:12:37.634069Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:37.634092Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:37.634095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:37.634109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534353533195278:10458]
2025-10-02T08:12:37.634113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534353533195278:10458]
2025-10-02T08:12:37.634156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:37.634163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.634165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:37.634318Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:37.636682Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:37.636696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:37.643503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId: src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:37.646448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:37.920822Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:37.921238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.921253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.921788Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:37.922087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534353533195333:2513]
2025-10-02T08:12:37.922119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:37.922173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1529 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0
2025-10-02T08:12:37.922347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1529 sessionId: src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0 is DEAD
2025-10-02T08:12:37.925010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:37.925024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0] Write session will restart in 0.006035s
2025-10-02T08:12:37.925050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0] Write session: Do CDS request
2025-10-02T08:12:37.925058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:37.925575Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:37.937249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:37.941902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:37.941925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1530
2025-10-02T08:12:37.944961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:37.945018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:37.945024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:37.945029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:37.946654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1530 sessionId:  describe result for acl check
2025-10-02T08:12:37.946693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:37.946695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:37.946697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:37.946703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534353533195477:10432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:37.947397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534353533195477:10432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:37.951874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534353533195477:10432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:37.958069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:37.960699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534353533195477:10432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:37.960715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534353533195477:10432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:37.960718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534353533195477:10432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:37.960726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:37.966357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:37.966746Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:37.966749Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:37.966760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:37.966816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:37.966848Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534353533195565:10436]
2025-10-02T08:12:37.967434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:37.967758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:37.967795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:37.968066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:37.968098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.968099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.968100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.968101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.968102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.968129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.968139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.968143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.968146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.968149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.968154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.968160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:37.968165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.968170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:37.968173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.968177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:37.968181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.968185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.968189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.968193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.968211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:37.979198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:37.983744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:37.983756Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:37.983762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:37.983770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:37.983779Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1529 [1:7556534353533195565:10436]
2025-10-02T08:12:37.983798Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:37.983827Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:37.983831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:37.983835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:37.983840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:37.983861Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:37.983867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:37.983890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:37.984013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.984015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.984020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:37.984026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:37.984110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:37.984113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:37.984143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:37.984156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:37.984174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534353533195552:10436]
2025-10-02T08:12:37.984189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534353533195552:10436]
2025-10-02T08:12:37.984466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:37.984483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:37.984495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:37.984502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:37.984538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534353533195552:10436]
2025-10-02T08:12:37.984544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:37.984859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:37.984876Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:37.984881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:37.985469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1529
2025-10-02T08:12:37.985482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534353533195560:10432], now have 1 active actors on pipe
2025-10-02T08:12:37.985487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534353993012987:2378], now have 1 active actors on pipe
2025-10-02T08:12:37.985622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.985632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.985659Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:37.985667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:37.985673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:37.985676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:37.985690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:37.985705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:37.985723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:37.985825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:37.985832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:37.985847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:37.985893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1530 partition: 0 MaxSeqNo: 17 sessionId: src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0
2025-10-02T08:12:37.991564Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1529
2025-10-02T08:12:37.992088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b18e75-797e4fb3-75e5d38d-ef5b2929_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:38.008982Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:38.009005Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:38.009008Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:38.009022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534353533195552:10436]
2025-10-02T08:12:38.009027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534353533195552:10436]
2025-10-02T08:12:38.009075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:38.009083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.009086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:38.009646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:38.013195Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:38.013209Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:38.017673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0] Write session: try to update token
2025-10-02T08:12:38.017700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:38.020997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534357828162888:2513]
2025-10-02T08:12:38.021505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1529, pipe: [1:7556534357828162888:2513]
2025-10-02T08:12:38.101145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId: src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:38.104184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:38.211907Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:38.219601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534357828162888:2513], now have 1 active actors on pipe
2025-10-02T08:12:38.219644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.219650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.220167Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:38.220454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:38.220502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1530 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0
2025-10-02T08:12:38.220657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1530 sessionId: src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0 is DEAD
2025-10-02T08:12:38.220834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534357828162888:2513]
2025-10-02T08:12:38.224139Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:38.225322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:38.225334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0] Write session will restart in 0.009337s
2025-10-02T08:12:38.225367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0] Write session: Do CDS request
2025-10-02T08:12:38.225373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:38.236328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:38.237112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:38.237134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1531
2025-10-02T08:12:38.237810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:38.237850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:38.237856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:38.237859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:38.238440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1531 sessionId:  describe result for acl check
2025-10-02T08:12:38.238493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:38.238494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:38.238496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:38.238501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534357828162931:10419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:38.239015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534357828162931:10419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:38.247819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534357828162931:10419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:38.249744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:38.252568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:38.252820Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:38.252825Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:38.252837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:38.252900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:38.252942Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534357828163075:10421]
2025-10-02T08:12:38.253581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:38.253869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:38.253919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:38.254263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:38.254312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.254313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.254314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.254315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.254316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.254322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.254333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.254337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.254341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.254345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.254351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.254359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.254364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.254370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.254375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.254380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.254384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.254388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.254394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.254399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.254418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:38.260039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534357828162931:10419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:38.260057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534357828162931:10419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:38.260061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534357828162931:10419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:38.260070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:38.268484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:38.271521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:38.271540Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:38.271542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:38.271546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:38.271553Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1530 [1:7556534357828163075:10421]
2025-10-02T08:12:38.271565Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:38.271584Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:38.271587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:38.271590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:38.271592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:38.271609Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:38.271615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:38.271621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:38.271690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.271692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.271695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:38.271697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:38.271765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:38.271768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.271783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.271794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:38.271809Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534357828163062:10421]
2025-10-02T08:12:38.271811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534357828163062:10421]
2025-10-02T08:12:38.271823Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:38.271836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:38.271850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:38.271852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:38.271886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534357828163062:10421]
2025-10-02T08:12:38.271888Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:38.272059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:38.272062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:38.272067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:38.272668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1530
2025-10-02T08:12:38.272682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534357828163091:10419], now have 1 active actors on pipe
2025-10-02T08:12:38.272686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534358287980303:2378], now have 1 active actors on pipe
2025-10-02T08:12:38.273941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44089a11-2e9b4a91-737db292-fdfec5ed_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|61994962-65e2adbb-39f60755-7cfea316_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:38.273041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.273058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.273088Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61994962-65e2adbb-39f60755-7cfea316_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:38.273098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:38.273101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:38.273105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:38.273114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:38.273125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:38.273140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:38.273187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.273189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.273200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:38.273251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1531 partition: 0 MaxSeqNo: 17 sessionId: src_id|61994962-65e2adbb-39f60755-7cfea316_0
2025-10-02T08:12:38.276762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61994962-65e2adbb-39f60755-7cfea316_0] Write session: try to update token
2025-10-02T08:12:38.276777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61994962-65e2adbb-39f60755-7cfea316_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:38.274141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1530
2025-10-02T08:12:38.306479Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:38.306500Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:38.306503Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:38.306510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534357828163062:10421]
2025-10-02T08:12:38.306516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534357828163062:10421]
2025-10-02T08:12:38.306559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:38.306567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.306569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:38.306714Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:38.307455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId: src_id|61994962-65e2adbb-39f60755-7cfea316_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:38.308953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:38.308969Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:38.310492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:38.321966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534357828163117:2513]
2025-10-02T08:12:38.325064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1530, pipe: [1:7556534357828163117:2513]
2025-10-02T08:12:38.484414Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:38.484740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.484750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.484773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534357828163117:2513], now have 1 active actors on pipe
2025-10-02T08:12:38.485920Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:38.487223Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:38.487524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:38.487535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534357828163117:2513]
2025-10-02T08:12:38.487579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61994962-65e2adbb-39f60755-7cfea316_0
2025-10-02T08:12:38.487740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1531 sessionId: src_id|61994962-65e2adbb-39f60755-7cfea316_0 is DEAD
2025-10-02T08:12:38.488066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61994962-65e2adbb-39f60755-7cfea316_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:38.488076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61994962-65e2adbb-39f60755-7cfea316_0] Write session will restart in 0.005992s
2025-10-02T08:12:38.488103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61994962-65e2adbb-39f60755-7cfea316_0] Write session: Do CDS request
2025-10-02T08:12:38.488110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61994962-65e2adbb-39f60755-7cfea316_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:38.501187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61994962-65e2adbb-39f60755-7cfea316_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:38.502694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:38.502709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1532
2025-10-02T08:12:38.502861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:38.502883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:38.502887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:38.502890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:38.504639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1532 sessionId:  describe result for acl check
2025-10-02T08:12:38.504684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:38.504686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:38.504687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:38.504692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534357828163257:10394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:38.505210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534357828163257:10394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:38.510567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:38.513074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534357828163257:10394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:38.515712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:38.515932Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:38.515937Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:38.515948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:38.516000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:38.516036Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534357828163298:10397]
2025-10-02T08:12:38.516701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:38.517176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:38.517222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:38.517529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:38.517573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.517575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.517575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.517578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.517580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.517585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.517595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.517598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.517602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.517605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.517610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.517617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.517622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.517627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.517632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.517636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.517640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.517645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.517652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.517657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.517674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:38.522999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534357828163257:10394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:38.523016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534357828163257:10394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:38.523052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534357828163257:10394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:38.523062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:38.531642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:38.533565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:38.533589Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:38.533591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:38.533595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:38.533601Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1531 [1:7556534357828163298:10397]
2025-10-02T08:12:38.533613Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:38.533633Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:38.533636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:38.533639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:38.533641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:38.533658Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:38.533668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:38.533674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:38.533744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.533752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.533755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:38.533758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:38.533830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:38.533838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.533852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.533867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:38.533899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534357828163275:10397]
2025-10-02T08:12:38.533905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534357828163275:10397]
2025-10-02T08:12:38.533917Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:38.533935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:38.533955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:38.533962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:38.533997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534357828163275:10397]
2025-10-02T08:12:38.534005Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:38.534107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:38.534115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:38.534120Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:38.534280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1531
2025-10-02T08:12:38.534298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534357828163320:10394], now have 1 active actors on pipe
2025-10-02T08:12:38.534318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534358287980311:2378], now have 1 active actors on pipe
2025-10-02T08:12:38.534324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.534330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.534356Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6d5abb9-984318fa-c4661b47-4f420684_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:38.534365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:38.534369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:38.534371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:38.534382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:38.534394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:38.534411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:38.535236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.535250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.535277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:38.535315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1532 partition: 0 MaxSeqNo: 17 sessionId: src_id|d6d5abb9-984318fa-c4661b47-4f420684_0
2025-10-02T08:12:38.534872Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1531
2025-10-02T08:12:38.537077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61994962-65e2adbb-39f60755-7cfea316_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d6d5abb9-984318fa-c4661b47-4f420684_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:38.539864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d5abb9-984318fa-c4661b47-4f420684_0] Write session: try to update token
2025-10-02T08:12:38.539880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d5abb9-984318fa-c4661b47-4f420684_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:38.557719Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:38.557740Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:38.557742Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:38.557754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534357828163275:10397]
2025-10-02T08:12:38.557758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534357828163275:10397]
2025-10-02T08:12:38.557802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:38.557808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.557811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:38.557962Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:38.557973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:38.557993Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:38.569789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId: src_id|d6d5abb9-984318fa-c4661b47-4f420684_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:38.572479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:38.590945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534357828163339:2513]
2025-10-02T08:12:38.591064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1531, pipe: [1:7556534357828163339:2513]
2025-10-02T08:12:38.711493Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:38.711973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.711984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.712003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534357828163339:2513], now have 1 active actors on pipe
2025-10-02T08:12:38.713116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d5abb9-984318fa-c4661b47-4f420684_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:38.713066Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:38.713128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d5abb9-984318fa-c4661b47-4f420684_0] Write session will restart in 0.007487s
2025-10-02T08:12:38.713164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d5abb9-984318fa-c4661b47-4f420684_0] Write session: Do CDS request
2025-10-02T08:12:38.713171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d5abb9-984318fa-c4661b47-4f420684_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:38.712380Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:38.712683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534357828163339:2513]
2025-10-02T08:12:38.712698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:38.712747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1532 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6d5abb9-984318fa-c4661b47-4f420684_0
2025-10-02T08:12:38.712923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1532 sessionId: src_id|d6d5abb9-984318fa-c4661b47-4f420684_0 is DEAD
2025-10-02T08:12:38.722316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d5abb9-984318fa-c4661b47-4f420684_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:38.723411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:38.723432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1533
2025-10-02T08:12:38.723605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:38.723634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:38.723640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:38.723645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:38.724161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1533 sessionId:  describe result for acl check
2025-10-02T08:12:38.724194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:38.724196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:38.724198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:38.724204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534357828163358:10369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:38.724741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534357828163358:10369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:38.728100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534357828163358:10369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:38.735818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534357828163358:10369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:38.735844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534357828163358:10369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:38.735847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534357828163358:10369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:38.735856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:38.736894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:38.738860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:38.739077Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:38.739081Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:38.739093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:38.739145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:38.739180Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534357828163537:10379]
2025-10-02T08:12:38.739833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:38.745244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:38.745333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:38.745789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:38.745840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.745841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.745842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.745843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.745845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.745851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.745861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.745864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.745868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.745871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.745878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.745886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:38.745895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.745900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:38.745904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.745909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:38.745913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.745918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.745923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.745928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.745946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:38.766273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:38.768061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:38.768087Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:38.768090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:38.768094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:38.768102Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1532 [1:7556534357828163537:10379]
2025-10-02T08:12:38.768114Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:38.768147Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:38.768151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:38.768154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:38.768157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:38.768175Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:38.768181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:38.768188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:38.772596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d5abb9-984318fa-c4661b47-4f420684_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b80ed758-b50a115a-b1854739-b4aa0081_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:38.768263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.768274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.768278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:38.768281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:38.768363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:38.768366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.768381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:38.768392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:38.768410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534357828163531:10379]
2025-10-02T08:12:38.768412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534357828163531:10379]
2025-10-02T08:12:38.768426Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:38.768443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:38.768458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:38.768461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:38.768506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534357828163531:10379]
2025-10-02T08:12:38.768509Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:38.768652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:38.768655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:38.768661Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:38.769391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1532
2025-10-02T08:12:38.769407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534357828163525:10369], now have 1 active actors on pipe
2025-10-02T08:12:38.769412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534358287980320:2378], now have 1 active actors on pipe
2025-10-02T08:12:38.770037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.770045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.770088Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b80ed758-b50a115a-b1854739-b4aa0081_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:38.770098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:38.770103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:38.770105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:38.770119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:38.770132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:38.770153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:38.770237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.770240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.770255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:38.770289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1533 partition: 0 MaxSeqNo: 17 sessionId: src_id|b80ed758-b50a115a-b1854739-b4aa0081_0
2025-10-02T08:12:38.775517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80ed758-b50a115a-b1854739-b4aa0081_0] Write session: try to update token
2025-10-02T08:12:38.775535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80ed758-b50a115a-b1854739-b4aa0081_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:38.769576Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1532
2025-10-02T08:12:38.803988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId: src_id|b80ed758-b50a115a-b1854739-b4aa0081_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:38.807533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:38.808479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.808501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.808539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:38.808566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:38.808754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:38.808760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:38.809036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.809128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.809214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.809368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.809429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.809435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.809582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.809716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.809850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.809930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.809979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.809982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.810070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.810137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.810202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.810288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.810340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.810347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.810422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.810497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.810575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.810659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.810822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.810826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.810906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.810976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.811051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.811124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.811176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.811179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.811299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.811438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.811522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.811600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.811657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.811660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.811749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.811819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.811897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.811969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.812018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.812021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.812108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.812195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.812271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.812344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.812480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.812484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.812563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.812630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.812694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.812879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534357828163559:2513]
2025-10-02T08:12:38.813351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1532, pipe: [1:7556534357828163559:2513]
2025-10-02T08:12:38.814065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.814130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.814134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.814313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:38.814455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:38.814569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:38.814640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:38.814696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:38.814699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:38.814751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534357828163559:2513], now have 1 active actors on pipe
2025-10-02T08:12:38.814759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:38.814833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:38.814852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:38.814855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:38.814891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:38.814908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:38.814912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:38.814915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:38.814919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:38.815377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:38.815396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:38.815406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:38.815410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:38.815413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:38.815417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:38.815968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:38.815981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:38.815988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:38.815992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:38.815995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:38.816002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:38.816756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:38.816771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:38.816778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:38.816782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:38.816785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:38.818648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:38.818677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:38.818692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392758818
2025-10-02T08:12:38.818952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:38.818965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:38.818971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:38.818975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:38.818979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:38.818983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:38.819577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:38.819594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:38.819600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:38.819603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:38.819607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:38.819611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:38.820316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:38.820331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:38.820339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:38.820342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:38.820347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:38.820350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:38.821236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:38.821263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:38.821270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:38.822649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:38.822659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:38.822664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:38.822671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:38.822681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392758822
2025-10-02T08:12:38.823053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:38.823067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:38.823076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:38.823081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:38.823085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:38.823089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:38.823668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:38.823682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:38.823688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:38.823693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:38.823696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:38.823702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:38.824305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:38.824318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:38.824462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392758824
2025-10-02T08:12:38.829245Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:38.829270Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:38.829278Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:38.829285Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:38.831327Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:38.831331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:38.831333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:38.831345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534357828163531:10379]
2025-10-02T08:12:38.831350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534357828163531:10379]
2025-10-02T08:12:38.831414Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:38.831421Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:38.831424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:38.831429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:38.831432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:38.831619Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:39.082598Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:39.083596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:39.085032Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:39.085472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534357828163559:2513]
2025-10-02T08:12:39.085493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:39.085521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1533 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b80ed758-b50a115a-b1854739-b4aa0081_0
2025-10-02T08:12:39.085717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1533 sessionId: src_id|b80ed758-b50a115a-b1854739-b4aa0081_0 is DEAD
2025-10-02T08:12:39.086159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80ed758-b50a115a-b1854739-b4aa0081_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:39.086169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80ed758-b50a115a-b1854739-b4aa0081_0] Write session will restart in 0.007326s
2025-10-02T08:12:39.086195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80ed758-b50a115a-b1854739-b4aa0081_0] Write session: Do CDS request
2025-10-02T08:12:39.086202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80ed758-b50a115a-b1854739-b4aa0081_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:39.095594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80ed758-b50a115a-b1854739-b4aa0081_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:39.095899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:39.095917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1534
2025-10-02T08:12:39.096053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:39.096080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:39.096085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:39.096088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:39.096650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1534 sessionId:  describe result for acl check
2025-10-02T08:12:39.096687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:39.096689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:39.096691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:39.096697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534362123131051:10331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:39.097234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534362123131051:10331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:39.098990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:39.101510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:39.101786Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:39.101790Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:39.101802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:39.101856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:39.101898Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534362123131088:10346]
2025-10-02T08:12:39.102603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:39.102974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:39.103019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:39.103364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:39.103405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.103406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.103407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.103408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.103410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.103415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.103425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.103428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.103432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.103435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.103441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.103449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.103455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.103460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.103464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.103469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.103474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.103479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.103484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.103489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.103509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:39.104043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534362123131051:10331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:39.111648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534362123131051:10331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:39.111667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534362123131051:10331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:39.111671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534362123131051:10331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:39.111680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:39.116455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:39.118421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:39.118427Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:39.118430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:39.118435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:39.118444Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1533 [1:7556534362123131088:10346]
2025-10-02T08:12:39.118458Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:39.118478Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:39.118481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:39.118484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:39.118487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:39.118506Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:39.118513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:39.118521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:39.118595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.118597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.118600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:39.118603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:39.118684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:39.118687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.118703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.118716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:39.118734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534362123131070:10346]
2025-10-02T08:12:39.118736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534362123131070:10346]
2025-10-02T08:12:39.118750Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:39.118763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:39.118778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:39.118781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:39.118817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534362123131070:10346]
2025-10-02T08:12:39.118819Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:39.119212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:39.119216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:39.119221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:39.119879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1533
2025-10-02T08:12:39.119544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1533
2025-10-02T08:12:39.119561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534362123131114:10331], now have 1 active actors on pipe
2025-10-02T08:12:39.119566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534362582947648:2378], now have 1 active actors on pipe
2025-10-02T08:12:39.120174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:39.120189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:39.120221Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|badb7437-b088d26c-fa906c5d-381e2240_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:39.120240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:39.120245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:39.120248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:39.120259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:39.120277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:39.120297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:39.120695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:39.120704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:39.120724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:39.120770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1534 partition: 0 MaxSeqNo: 17 sessionId: src_id|badb7437-b088d26c-fa906c5d-381e2240_0
2025-10-02T08:12:39.121249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80ed758-b50a115a-b1854739-b4aa0081_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|badb7437-b088d26c-fa906c5d-381e2240_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:39.124340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|badb7437-b088d26c-fa906c5d-381e2240_0] Write session: try to update token
2025-10-02T08:12:39.124359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|badb7437-b088d26c-fa906c5d-381e2240_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:39.167809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId: src_id|badb7437-b088d26c-fa906c5d-381e2240_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:39.171230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:39.172162Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:39.172180Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:39.172183Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:39.172191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534362123131070:10346]
2025-10-02T08:12:39.172196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534362123131070:10346]
2025-10-02T08:12:39.172239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:39.172250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.172252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:39.172429Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:39.172704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:39.172715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:39.188938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534362123131128:2513]
2025-10-02T08:12:39.189490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1533, pipe: [1:7556534362123131128:2513]
2025-10-02T08:12:39.369847Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:39.370573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:39.370587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:39.370607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534362123131128:2513], now have 1 active actors on pipe
2025-10-02T08:12:39.371644Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:39.371993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:39.372051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1534 reason: status is not ok: tablet will be restarted right now sessionId: src_id|badb7437-b088d26c-fa906c5d-381e2240_0
2025-10-02T08:12:39.372240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1534 sessionId: src_id|badb7437-b088d26c-fa906c5d-381e2240_0 is DEAD
2025-10-02T08:12:39.372363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534362123131128:2513]
2025-10-02T08:12:39.372646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badb7437-b088d26c-fa906c5d-381e2240_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:39.372659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badb7437-b088d26c-fa906c5d-381e2240_0] Write session will restart in 0.007330s
2025-10-02T08:12:39.372684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badb7437-b088d26c-fa906c5d-381e2240_0] Write session: Do CDS request
2025-10-02T08:12:39.372694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badb7437-b088d26c-fa906c5d-381e2240_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:39.371393Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:39.385211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|badb7437-b088d26c-fa906c5d-381e2240_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:39.385501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:39.385516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1535
2025-10-02T08:12:39.386606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:39.386651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:39.386656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:39.386660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:39.388637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1535 sessionId:  describe result for acl check
2025-10-02T08:12:39.388671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:39.388672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:39.388674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:39.388679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534362123131303:10327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:39.389221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534362123131303:10327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:39.389832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:39.390460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:39.390649Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:39.390652Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:39.390663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:39.390708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:39.390756Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534362123131314:10329]
2025-10-02T08:12:39.391519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:39.393161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:39.393223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:39.393768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:39.393807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.393808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.393809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.393811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.393813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.393819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.393831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.393835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.393839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.393842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.393848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.393856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.393862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.393868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.393876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.393882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.393886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.393891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.393896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.393901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.393924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:39.408284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:39.410140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:39.410148Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:39.410151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:39.410155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:39.410163Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1534 [1:7556534362123131314:10329]
2025-10-02T08:12:39.410178Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:39.410196Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:39.410200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:39.410203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:39.410206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:39.410223Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:39.410229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:39.410236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:39.410352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.410355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.410359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:39.410362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:39.410437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:39.410440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.410457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.410469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:39.410488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534362123131301:10329]
2025-10-02T08:12:39.410490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534362123131301:10329]
2025-10-02T08:12:39.410502Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:39.410517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:39.410532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:39.410535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:39.410573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534362123131301:10329]
2025-10-02T08:12:39.410576Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:39.411251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:39.411262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:39.411268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:39.412555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534362123131303:10327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:39.412622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534362582947668:2378], now have 1 active actors on pipe
2025-10-02T08:12:39.413266Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1534
2025-10-02T08:12:39.433280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534362123131303:10327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:39.433301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534362123131303:10327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:39.433305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534362123131303:10327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:39.433315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:39.436232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1534
2025-10-02T08:12:39.436259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534362123131361:10327], now have 1 active actors on pipe
2025-10-02T08:12:39.436370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:39.436380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:39.436412Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:39.436423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:39.436428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:39.436431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:39.436444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:39.436461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:39.436481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:39.436607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:39.436616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:39.436631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:39.436664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1535 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0
2025-10-02T08:12:39.441056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|badb7437-b088d26c-fa906c5d-381e2240_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:39.443913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0] Write session: try to update token
2025-10-02T08:12:39.443933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:39.469897Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:39.469921Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:39.469924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:39.469933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534362123131301:10329]
2025-10-02T08:12:39.469938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534362123131301:10329]
2025-10-02T08:12:39.469982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:39.469990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.469993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:39.470160Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:39.472958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534362123131367:2513]
2025-10-02T08:12:39.473038Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:39.473043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:39.473171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1534, pipe: [1:7556534362123131367:2513]
2025-10-02T08:12:39.507202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId: src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:39.510296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:39.798633Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:39.798976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534362123131367:2513], now have 1 active actors on pipe
2025-10-02T08:12:39.799013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:39.799020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:39.801625Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:39.804638Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:39.805049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:39.805109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1535 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0
2025-10-02T08:12:39.805293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1535 sessionId: src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0 is DEAD
2025-10-02T08:12:39.805422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534362123131367:2513]
2025-10-02T08:12:39.809063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:39.809079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0] Write session will restart in 0.006305s
2025-10-02T08:12:39.809110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0] Write session: Do CDS request
2025-10-02T08:12:39.809119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:39.821278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:39.822611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:39.822634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1536
2025-10-02T08:12:39.823071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:39.823106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:39.823112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:39.823118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:39.830041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1536 sessionId:  describe result for acl check
2025-10-02T08:12:39.830095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:39.830097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:39.830099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:39.830105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534362123131422:10302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:39.830673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534362123131422:10302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:39.843143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:39.844051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534362123131422:10302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:39.846447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:39.846687Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:39.846692Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:39.846704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:39.846759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:39.846794Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534362123131570:10307]
2025-10-02T08:12:39.847438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:39.848101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:39.848168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:39.848620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:39.848672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.848674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.848675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.848676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.848678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.848683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.848695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.848698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.848701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.848705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.848711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.848719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:39.848727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.848731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:39.848738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.848743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:39.848747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.848752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.848757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.848762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.848778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:39.876649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:39.878938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:39.878948Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:39.878952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:39.878956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:39.878963Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1535 [1:7556534362123131570:10307]
2025-10-02T08:12:39.878975Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:39.878997Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:39.879001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:39.879004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:39.879007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:39.879026Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:39.879032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:39.879039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:39.879120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.879122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.879125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:39.879127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:39.879203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:39.879206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.879220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:39.879232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:39.879249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534362123131559:10307]
2025-10-02T08:12:39.879251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534362123131559:10307]
2025-10-02T08:12:39.879257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:39.879270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:39.879284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:39.879287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:39.879323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534362123131559:10307]
2025-10-02T08:12:39.879325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:39.879461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:39.879463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:39.879468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:39.879924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534362582947677:2378], now have 1 active actors on pipe
2025-10-02T08:12:39.880173Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1535
2025-10-02T08:12:39.882804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7fd07f-6b835000-cb27c39-6a6f614d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|306d4bdb-9051616d-a50567db-9965a17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:39.880490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534362123131422:10302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:39.880504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534362123131422:10302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:39.880508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534362123131422:10302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:39.880517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:39.882081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1535
2025-10-02T08:12:39.882092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534362123131602:10302], now have 1 active actors on pipe
2025-10-02T08:12:39.882160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:39.882166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:39.882194Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|306d4bdb-9051616d-a50567db-9965a17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:39.882204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:39.882209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:39.882211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:39.882224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:39.882240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:39.882260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:39.882334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:39.882337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:39.882350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:39.882384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1536 partition: 0 MaxSeqNo: 17 sessionId: src_id|306d4bdb-9051616d-a50567db-9965a17_0
2025-10-02T08:12:39.892268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306d4bdb-9051616d-a50567db-9965a17_0] Write session: try to update token
2025-10-02T08:12:39.892294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306d4bdb-9051616d-a50567db-9965a17_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:39.904636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534362123131608:2513]
2025-10-02T08:12:39.909224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1535, pipe: [1:7556534362123131608:2513]
2025-10-02T08:12:39.909263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534362123131608:2513], now have 1 active actors on pipe
2025-10-02T08:12:39.933214Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:39.933241Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:39.933246Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:39.933258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534362123131559:10307]
2025-10-02T08:12:39.933264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534362123131559:10307]
2025-10-02T08:12:39.933319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:39.933328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:39.933331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:39.933517Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:39.936927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId: src_id|306d4bdb-9051616d-a50567db-9965a17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:39.938910Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:39.938935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:39.940342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:40.156858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306d4bdb-9051616d-a50567db-9965a17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:40.156871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306d4bdb-9051616d-a50567db-9965a17_0] Write session will restart in 0.005712s
2025-10-02T08:12:40.156908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306d4bdb-9051616d-a50567db-9965a17_0] Write session: Do CDS request
2025-10-02T08:12:40.156916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306d4bdb-9051616d-a50567db-9965a17_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:40.153794Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:40.154069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.154077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.156090Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:40.156392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:40.156449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1536 reason: status is not ok: tablet will be restarted right now sessionId: src_id|306d4bdb-9051616d-a50567db-9965a17_0
2025-10-02T08:12:40.156634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1536 sessionId: src_id|306d4bdb-9051616d-a50567db-9965a17_0 is DEAD
2025-10-02T08:12:40.156771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534362123131608:2513]
2025-10-02T08:12:40.159390Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:40.166361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306d4bdb-9051616d-a50567db-9965a17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:40.166930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:40.166957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1537
2025-10-02T08:12:40.172994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:40.173062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:40.173068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:40.173073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:40.181182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1537 sessionId:  describe result for acl check
2025-10-02T08:12:40.181230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:40.181232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:40.181234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:40.181239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534366418099084:10277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:40.181981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534366418099084:10277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:40.186593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:40.187108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:40.187305Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:40.187309Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:40.187323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:40.187366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:40.187401Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534366418099121:10287]
2025-10-02T08:12:40.188058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:40.188506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:40.188553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:40.188882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:40.188934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.188935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.188937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.188938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.188939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.188945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.188955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.188959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.188963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.188966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.188971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.188979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.188984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.188990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.188995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.189000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.189004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.189009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.189016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.189021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.189040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:40.198260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534366418099084:10277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:40.203175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:40.204978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:40.204984Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:40.204987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:40.204991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:40.204999Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1536 [1:7556534366418099121:10287]
2025-10-02T08:12:40.205012Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:40.205032Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:40.205035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:40.205039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:40.205042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:40.205065Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:40.205071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:40.205079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:40.205151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.205153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.205156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:40.205159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:40.205323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:40.205326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.205341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.205355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:40.205373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534366418099113:10287]
2025-10-02T08:12:40.205379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534366418099113:10287]
2025-10-02T08:12:40.205386Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:40.205401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:40.205414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:40.205418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:40.205454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534366418099113:10287]
2025-10-02T08:12:40.205456Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:40.206002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:40.206014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:40.206020Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:40.206643Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1536
2025-10-02T08:12:40.209546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534366877915004:2378], now have 1 active actors on pipe
2025-10-02T08:12:40.212676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534366418099084:10277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:40.212690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534366418099084:10277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:40.212693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534366418099084:10277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:40.212702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:40.213403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534366418099163:10277], now have 1 active actors on pipe
2025-10-02T08:12:40.213427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1536
2025-10-02T08:12:40.213495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.213503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.213534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:40.213543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:40.213549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:40.213552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:40.213752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:40.213768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:40.213787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:40.213929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.213935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.213948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:40.213974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1537 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0
2025-10-02T08:12:40.217086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306d4bdb-9051616d-a50567db-9965a17_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:40.220107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0] Write session: try to update token
2025-10-02T08:12:40.220145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:40.233961Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:40.233981Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:40.233984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:40.233993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534366418099113:10287]
2025-10-02T08:12:40.233998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534366418099113:10287]
2025-10-02T08:12:40.234041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:40.234047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.234050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:40.234222Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:40.237191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:40.237203Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:40.257687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534366418099171:2513]
2025-10-02T08:12:40.257953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1536, pipe: [1:7556534366418099171:2513]
2025-10-02T08:12:40.262713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId: src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:40.265740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:40.426272Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:40.426549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534366418099171:2513], now have 1 active actors on pipe
2025-10-02T08:12:40.426580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.426586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.427442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534366418099171:2513]
2025-10-02T08:12:40.427473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:40.427476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:40.427540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1537 reason: error at write: Disconnected sessionId: src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0
2025-10-02T08:12:40.427715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1537 sessionId: src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0 is DEAD
2025-10-02T08:12:40.427792Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:40.427870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:40.427881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0] Write session will restart in 0.005689s
2025-10-02T08:12:40.427905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0] Write session: Do CDS request
2025-10-02T08:12:40.427914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:40.427996Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:40.435827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:40.436004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:40.436020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1538
2025-10-02T08:12:40.436382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:40.436413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:40.436419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:40.436422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:40.436881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:40.437242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1538 sessionId:  describe result for acl check
2025-10-02T08:12:40.437276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:40.437283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:40.437285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:40.437289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534366418099352:10251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:40.437793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534366418099352:10251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:40.440501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:40.440715Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:40.440725Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:40.440735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:40.440782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:40.440835Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534366418099357:10256]
2025-10-02T08:12:40.441450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:40.441840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:40.441885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:40.442184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:40.442233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.442239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.442240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.442241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.442242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.442247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.442256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.442259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.442263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.442266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.442271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.442277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.442283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.442287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.442292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.442296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.442300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.442305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.442309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.442313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.442330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:40.447863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534366418099352:10251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:40.453965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:40.455634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:40.455659Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:40.455661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:40.455665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:40.455672Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1537 [1:7556534366418099357:10256]
2025-10-02T08:12:40.455685Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:40.455703Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:40.455706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:40.455709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:40.455712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:40.455729Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:40.455740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:40.455747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:40.455824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.455833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.455836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:40.455840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:40.455907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:40.455915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.455929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.455944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:40.456525Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1537
2025-10-02T08:12:40.455960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534366418099347:10256]
2025-10-02T08:12:40.455967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534366418099347:10256]
2025-10-02T08:12:40.455976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:40.455989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:40.456002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:40.456005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:40.456038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534366418099347:10256]
2025-10-02T08:12:40.456040Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:40.456283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:40.456286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:40.456291Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:40.456729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534366877915023:2378], now have 1 active actors on pipe
2025-10-02T08:12:40.456993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534366418099352:10251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:40.457008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534366418099352:10251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:40.457011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534366418099352:10251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:40.457019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:40.457474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1537
2025-10-02T08:12:40.457490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534366418099405:10251], now have 1 active actors on pipe
2025-10-02T08:12:40.457496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.457501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.457523Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|946f74db-ab07c727-84cb2538-49e1166b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:40.457535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:40.457543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:40.457545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:40.457555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:40.457572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:40.457588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:40.457665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.457672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.457684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:40.457719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1538 partition: 0 MaxSeqNo: 17 sessionId: src_id|946f74db-ab07c727-84cb2538-49e1166b_0
2025-10-02T08:12:40.460695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca517f8c-e5954a4-4a7492e9-65d9030_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|946f74db-ab07c727-84cb2538-49e1166b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:40.463609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946f74db-ab07c727-84cb2538-49e1166b_0] Write session: try to update token
2025-10-02T08:12:40.463630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946f74db-ab07c727-84cb2538-49e1166b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:40.474018Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:40.474045Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:40.474055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534366418099347:10256]
2025-10-02T08:12:40.474102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:40.474294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:40.474443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:40.474581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:40.474725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:40.474930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:40.474971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:40.476190Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:40.487329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId: src_id|946f74db-ab07c727-84cb2538-49e1166b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:40.490276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:40.494080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.494101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.496696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:40.496716Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:40.496718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:40.496721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:40.496731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534366418099347:10256]
2025-10-02T08:12:40.496734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534366418099347:10256]
2025-10-02T08:12:40.496782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:40.496790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.496793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:40.497024Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:40.497574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:40.502883Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:40.502902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:40.528966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534366418099414:2513]
2025-10-02T08:12:40.529484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1537, pipe: [1:7556534366418099414:2513]
2025-10-02T08:12:40.685459Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:40.685829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.685836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.686021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.686083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.686149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.686214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.686255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.686260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.686337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.686401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.686463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.686527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.686569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.686572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.686651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.686711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.686773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.686836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.686879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.686884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.687001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.687063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.687133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.687196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.687244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.687247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.687323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.687417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.687478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.687557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.687615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.687617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.687698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.687776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.687849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.687922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.687977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.687980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.688061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.688151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.688226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.688301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.688354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.688356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.688443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.688514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.688589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.688664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.688712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.688715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.688786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.688867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.688929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.689000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.689051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.689069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.689251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:40.689310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:40.689370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:40.689448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:40.689557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:40.689559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:40.689609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534366418099414:2513], now have 1 active actors on pipe
2025-10-02T08:12:40.690332Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:40.690648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:40.690677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1538 reason: status is not ok: tablet will be restarted right now sessionId: src_id|946f74db-ab07c727-84cb2538-49e1166b_0
2025-10-02T08:12:40.690827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534366418099414:2513]
2025-10-02T08:12:40.690875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1538 sessionId: src_id|946f74db-ab07c727-84cb2538-49e1166b_0 is DEAD
2025-10-02T08:12:40.692138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:40.692904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f74db-ab07c727-84cb2538-49e1166b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:40.692921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f74db-ab07c727-84cb2538-49e1166b_0] Write session will restart in 0.009280s
2025-10-02T08:12:40.692954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f74db-ab07c727-84cb2538-49e1166b_0] Write session: Do CDS request
2025-10-02T08:12:40.692963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f74db-ab07c727-84cb2538-49e1166b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:40.703959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:40.705196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946f74db-ab07c727-84cb2538-49e1166b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:40.705265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:40.705278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1539
2025-10-02T08:12:40.705386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:40.705413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:40.705422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:40.705426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:40.706041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:40.706083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1539 sessionId:  describe result for acl check
2025-10-02T08:12:40.706105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:40.706107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:40.706108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:40.706113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534366418099593:10236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:40.706216Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:40.706219Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:40.706228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:40.706276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:40.706306Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534366418099594:10244]
2025-10-02T08:12:40.706590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534366418099593:10236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:40.706890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:40.707217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:40.707273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:40.707596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:40.707633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.707639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.707640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.707641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.707643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.707648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.707658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.707661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.707665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.707670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.707675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.707681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.707687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.707692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.707700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.707704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.707708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.707712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.707720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.707725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.707742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:40.717922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:40.719586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:40.719607Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:40.719608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:40.719611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:40.719617Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1538 [1:7556534366418099594:10244]
2025-10-02T08:12:40.719626Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:40.719642Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:40.719649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:40.719651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:40.719653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:40.719669Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:40.719672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:40.719677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:40.719730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.719736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.719739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:40.719740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:40.719807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:40.719816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.719829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.719845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:40.719867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534366418099585:10244]
2025-10-02T08:12:40.719873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534366418099585:10244]
2025-10-02T08:12:40.719879Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:40.719899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534366877915032:2378], now have 1 active actors on pipe
2025-10-02T08:12:40.719909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:40.719926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:40.719932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:40.719967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534366418099585:10244]
2025-10-02T08:12:40.719973Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:40.720001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:40.720009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:40.720015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:40.721621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534366418099593:10236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:40.720957Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1538
2025-10-02T08:12:40.737411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534366418099593:10236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:40.737432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534366418099593:10236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:40.737436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534366418099593:10236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:40.737445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:40.737827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1538
2025-10-02T08:12:40.737850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534366418099647:10236], now have 1 active actors on pipe
2025-10-02T08:12:40.737907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.737913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.737939Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:40.737950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:40.737959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:40.737962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:40.737974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:40.737989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:40.738008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:40.741460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946f74db-ab07c727-84cb2538-49e1166b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:40.740960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.740977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.741020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:40.741073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1539 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0
2025-10-02T08:12:40.744345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0] Write session: try to update token
2025-10-02T08:12:40.744365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:40.743516Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:40.743530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:40.743532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:40.743539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534366418099585:10244]
2025-10-02T08:12:40.743542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534366418099585:10244]
2025-10-02T08:12:40.743579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:40.743584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.743585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:40.743598Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:40.743604Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:40.743713Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:40.767912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId: src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:40.770940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:40.790838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534366418099653:2513]
2025-10-02T08:12:40.797031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1538, pipe: [1:7556534366418099653:2513]
2025-10-02T08:12:40.893692Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:40.894263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.894271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.894292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534366418099653:2513], now have 1 active actors on pipe
2025-10-02T08:12:40.894940Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:40.896109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:40.896138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0] Write session will restart in 0.006389s
2025-10-02T08:12:40.896163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0] Write session: Do CDS request
2025-10-02T08:12:40.896169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:40.895214Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:40.895493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534366418099653:2513]
2025-10-02T08:12:40.895511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:40.895559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1539 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0
2025-10-02T08:12:40.895728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1539 sessionId: src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0 is DEAD
2025-10-02T08:12:40.903857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:40.904257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:40.904274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1540
2025-10-02T08:12:40.904443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:40.904479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:40.904483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:40.904488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:40.905072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1540 sessionId:  describe result for acl check
2025-10-02T08:12:40.905100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:40.905102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:40.905103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:40.905110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534366418099692:10224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:40.905987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534366418099692:10224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:40.917400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:40.921136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:40.921398Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:40.921402Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:40.921413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:40.921474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:40.921509Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534366418099848:10220]
2025-10-02T08:12:40.922119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:40.926214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534366418099692:10224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:40.926350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:40.926406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:40.926765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:40.926800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.926801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.926803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.926804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.926805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.926811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.926821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.926824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.926830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.926833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.926839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.926846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:40.926853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.926858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:40.926862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.926866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:40.926872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.926876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.926881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.926884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.926902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:40.946065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534366418099692:10224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:40.946083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534366418099692:10224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:40.946087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534366418099692:10224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:40.946097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:40.946322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:40.948034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:40.948056Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:40.948058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:40.948062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:40.948071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1539 [1:7556534366418099848:10220]
2025-10-02T08:12:40.948087Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:40.948103Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:40.948106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:40.948111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:40.948112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:40.948141Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:40.948151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:40.948157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:40.948224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.948231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.948234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:40.948236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:40.948296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:40.948303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.948317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:40.948328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:40.948343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534366418099837:10220]
2025-10-02T08:12:40.948349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534366418099837:10220]
2025-10-02T08:12:40.948359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:40.948372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:40.948385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:40.948388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:40.948403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:40.948406Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:40.948418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534366418099837:10220]
2025-10-02T08:12:40.948422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:40.948462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1539
2025-10-02T08:12:40.948470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534366418099874:10224], now have 1 active actors on pipe
2025-10-02T08:12:40.948475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:40.948575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.948588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.948606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534366877915038:2378], now have 1 active actors on pipe
2025-10-02T08:12:40.948621Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|943c2851-8984bc9e-318ab7d5-824e66de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:40.948629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:40.948633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:40.948635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:40.948644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:40.948654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:40.948672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:40.948706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.948708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.948719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:40.948752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1540 partition: 0 MaxSeqNo: 17 sessionId: src_id|943c2851-8984bc9e-318ab7d5-824e66de_0
2025-10-02T08:12:40.948912Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1539
2025-10-02T08:12:40.949125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cb2872-c558538a-c2337d54-5f402bb1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|943c2851-8984bc9e-318ab7d5-824e66de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:40.951964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943c2851-8984bc9e-318ab7d5-824e66de_0] Write session: try to update token
2025-10-02T08:12:40.951983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943c2851-8984bc9e-318ab7d5-824e66de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:40.969725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:40.969748Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:40.969757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534366418099837:10220]
2025-10-02T08:12:40.969802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:40.969984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:40.970119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:40.970258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:40.970396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:40.970610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:40.970645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:40.970729Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:40.990123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId: src_id|943c2851-8984bc9e-318ab7d5-824e66de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:40.993124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:40.994437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:40.994461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:40.994481Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:40.994483Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:40.994486Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:40.994494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534366418099837:10220]
2025-10-02T08:12:40.994498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534366418099837:10220]
2025-10-02T08:12:40.994547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:40.994552Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:40.994554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:40.994560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:40.994562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:40.994709Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:40.997023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534366418099888:2513]
2025-10-02T08:12:40.999020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1539, pipe: [1:7556534366418099888:2513]
2025-10-02T08:12:41.172747Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:41.173026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:41.173054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534366418099888:2513], now have 1 active actors on pipe
2025-10-02T08:12:41.173077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:41.173157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:41.173164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:41.173182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1540 reason: error at write: Disconnected sessionId: src_id|943c2851-8984bc9e-318ab7d5-824e66de_0
2025-10-02T08:12:41.173309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1540 sessionId: src_id|943c2851-8984bc9e-318ab7d5-824e66de_0 is DEAD
2025-10-02T08:12:41.173761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534366418099888:2513]
2025-10-02T08:12:41.173969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943c2851-8984bc9e-318ab7d5-824e66de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:41.173981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943c2851-8984bc9e-318ab7d5-824e66de_0] Write session will restart in 0.008773s
2025-10-02T08:12:41.174001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943c2851-8984bc9e-318ab7d5-824e66de_0] Write session: Do CDS request
2025-10-02T08:12:41.174006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943c2851-8984bc9e-318ab7d5-824e66de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:41.178494Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:41.184010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:41.185818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:41.186018Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:41.186030Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:41.186040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:41.186093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:41.186135Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534370713067373:10209]
2025-10-02T08:12:41.186830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:41.187128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:41.187179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:41.187483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:41.187549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.187556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.187557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.187558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.187560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.187566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.187574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.187578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.187581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.187584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.187590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.187597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.187603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.187607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.187611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.187615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.187624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.187628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.187638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.187642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.187660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:41.189208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943c2851-8984bc9e-318ab7d5-824e66de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:41.192976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:41.192999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1541
2025-10-02T08:12:41.193151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:41.193182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:41.193187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:41.193191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:41.196565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1541 sessionId:  describe result for acl check
2025-10-02T08:12:41.196612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:41.196613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:41.196615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:41.196622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534370713067389:10205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:41.197197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534370713067389:10205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:41.199766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534370713067389:10205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:41.202676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:41.204140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:41.204157Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:41.204160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:41.204163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:41.204168Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1540 [1:7556534370713067373:10209]
2025-10-02T08:12:41.204179Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:41.204195Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:41.204198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:41.204201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:41.204203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:41.204220Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:41.204232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:41.204238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:41.204299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.204302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.204304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:41.204306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:41.204417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:41.204420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.204432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.204445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:41.204463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534371172882351:2378], now have 1 active actors on pipe
2025-10-02T08:12:41.204469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534370713067367:10209]
2025-10-02T08:12:41.204470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534370713067367:10209]
2025-10-02T08:12:41.204477Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:41.204488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:41.204501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:41.204504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:41.204538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534370713067367:10209]
2025-10-02T08:12:41.204540Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:41.204563Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:41.204566Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:41.204572Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:41.207568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534370713067389:10205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:41.207580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534370713067389:10205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:41.207584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534370713067389:10205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:41.207591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:41.208706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1540
2025-10-02T08:12:41.208728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534370713067428:10205], now have 1 active actors on pipe
2025-10-02T08:12:41.208735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.208742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.208768Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:41.208782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:41.208790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:41.208793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:41.208822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:41.207116Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1540
2025-10-02T08:12:41.208840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:41.208860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:41.209069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.209077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.209091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:41.209124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1541 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0
2025-10-02T08:12:41.209529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943c2851-8984bc9e-318ab7d5-824e66de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:41.212313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0] Write session: try to update token
2025-10-02T08:12:41.212328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:41.235284Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:41.235311Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:41.235313Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:41.235322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534370713067367:10209]
2025-10-02T08:12:41.235328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534370713067367:10209]
2025-10-02T08:12:41.235378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:41.235384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.235387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:41.235436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:41.235458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:41.235557Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:41.235856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId: src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:41.238698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:41.273697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534370713067459:2513]
2025-10-02T08:12:41.276971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1540, pipe: [1:7556534370713067459:2513]
2025-10-02T08:12:41.391149Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:41.395906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:41.391472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.391485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.391529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534370713067459:2513], now have 1 active actors on pipe
2025-10-02T08:12:41.395729Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:41.395999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534370713067459:2513]
2025-10-02T08:12:41.396022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:41.396098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1541 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0
2025-10-02T08:12:41.396303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1541 sessionId: src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0 is DEAD
2025-10-02T08:12:41.397625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:41.397636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0] Write session will restart in 0.006112s
2025-10-02T08:12:41.397666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0] Write session: Do CDS request
2025-10-02T08:12:41.397674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:41.410300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:41.411267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:41.411289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1542
2025-10-02T08:12:41.411487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:41.411520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:41.411526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:41.411530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:41.412025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1542 sessionId:  describe result for acl check
2025-10-02T08:12:41.412056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:41.412058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:41.412060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:41.412066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534370713067487:10179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:41.412628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534370713067487:10179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:41.432641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534370713067487:10179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:41.443009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:41.449311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:41.449579Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:41.449582Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:41.449592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:41.449645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:41.449683Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534370713067678:10174]
2025-10-02T08:12:41.450471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:41.450822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:41.450872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:41.451243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:41.451293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.451294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.451296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.451298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.451299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.451305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.451315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.451318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.451322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.451325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.451332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.451339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.451346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.451353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.451361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.451366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.451370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.451374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.451382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.451387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.451407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:41.455218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534370713067487:10179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:41.455236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534370713067487:10179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:41.455243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534370713067487:10179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:41.455254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:41.474434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:41.476697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:41.476708Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:41.476711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:41.476714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:41.476723Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1541 [1:7556534370713067678:10174]
2025-10-02T08:12:41.476737Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:41.476760Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:41.476763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:41.476767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:41.476770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:41.476788Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:41.476794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:41.476869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:41.477952Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1541
2025-10-02T08:12:41.478108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a2feb6-f8aba126-890cb7fe-9249a40c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d14045b-a6c914e1-f41f0496-40ede667_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:41.481313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14045b-a6c914e1-f41f0496-40ede667_0] Write session: try to update token
2025-10-02T08:12:41.481338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14045b-a6c914e1-f41f0496-40ede667_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:41.476952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.476971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.476975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:41.476978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:41.477062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:41.477065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.477081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.477093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:41.477113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534370713067672:10174]
2025-10-02T08:12:41.477115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534370713067672:10174]
2025-10-02T08:12:41.477123Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:41.477137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:41.477150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:41.477153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:41.477165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534370713067694:10179], now have 1 active actors on pipe
2025-10-02T08:12:41.477167Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:41.477170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:41.477205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534370713067672:10174]
2025-10-02T08:12:41.477208Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:41.477213Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:41.477260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1541
2025-10-02T08:12:41.477414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534371172882384:2378], now have 1 active actors on pipe
2025-10-02T08:12:41.477502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.477508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.477537Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d14045b-a6c914e1-f41f0496-40ede667_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:41.477546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:41.477551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:41.477553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:41.477566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:41.477578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:41.477602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:41.477668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.477672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.477686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:41.477720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1542 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d14045b-a6c914e1-f41f0496-40ede667_0
2025-10-02T08:12:41.496100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534370713067706:2513]
2025-10-02T08:12:41.496632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1541, pipe: [1:7556534370713067706:2513]
2025-10-02T08:12:41.496652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534370713067706:2513], now have 1 active actors on pipe
2025-10-02T08:12:41.518419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId: src_id|8d14045b-a6c914e1-f41f0496-40ede667_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:41.521551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:41.521726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.521743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.521780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:41.521802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:41.521970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.521976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.522158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.522225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.522300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.522377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.522424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.522429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.522511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.522577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.522647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.522720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.522766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.522770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.522846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.522912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.522986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.523068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.523117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.523120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.523193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.523274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.523353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.523435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.523489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.523492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.523582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.523654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.523729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.523809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.523864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.523867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.523956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.524027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.524101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.524194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.524254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.524258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.524348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.524466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.524585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.524661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.524711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.524715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.524821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.524899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.524980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.525061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.525114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.525121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.525211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.525281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.525354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.525423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.525483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.525486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.525574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:41.525649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:41.525723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:41.525795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:41.525847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:41.525850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:41.525901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:41.525976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:41.525996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:41.525999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:41.526038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:41.526054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:41.526058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:41.526062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:41.526065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:41.526522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:41.526544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:41.526551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:41.526555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:41.526559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:41.526562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:41.527227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:41.527246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:41.527254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:41.527257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:41.527263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:41.527267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:41.527901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:41.527917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:41.527923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:41.527929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:41.527932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:41.529796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:41.529823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:41.529842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392761526
2025-10-02T08:12:41.530026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:41.530034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:41.530040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:41.530044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:41.530050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:41.530055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:41.530609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:41.530624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:41.530631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:41.530637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:41.530641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:41.530645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:41.531195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:41.531211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:41.531221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:41.531225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:41.531231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:41.531235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:41.531784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:41.531797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:41.531802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:41.533445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:41.533470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:41.533477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:41.533481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:41.533492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392761526
2025-10-02T08:12:41.533821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:41.533833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:41.533839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:41.533843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:41.533847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:41.533851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:41.534402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:41.534415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:41.534422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:41.534426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:41.534432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:41.534437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:41.535003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:41.535016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:41.535170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392761526
2025-10-02T08:12:41.536076Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:41.536092Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:41.536100Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:41.536106Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:41.538498Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:41.538519Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:41.538521Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:41.538536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534370713067672:10174]
2025-10-02T08:12:41.538540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534370713067672:10174]
2025-10-02T08:12:41.538580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:41.538585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.538587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:41.538757Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:41.539988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:41.539997Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:41.813979Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:41.812871Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:41.814674Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:41.814681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534370713067706:2513]
2025-10-02T08:12:41.814709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:41.814741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1542 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d14045b-a6c914e1-f41f0496-40ede667_0
2025-10-02T08:12:41.814909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1542 sessionId: src_id|8d14045b-a6c914e1-f41f0496-40ede667_0 is DEAD
2025-10-02T08:12:41.816999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14045b-a6c914e1-f41f0496-40ede667_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:41.817007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14045b-a6c914e1-f41f0496-40ede667_0] Write session will restart in 0.005404s
2025-10-02T08:12:41.817030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14045b-a6c914e1-f41f0496-40ede667_0] Write session: Do CDS request
2025-10-02T08:12:41.817037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14045b-a6c914e1-f41f0496-40ede667_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:41.825214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14045b-a6c914e1-f41f0496-40ede667_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:41.828723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:41.828754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1543
2025-10-02T08:12:41.829127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:41.829174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:41.829180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:41.829184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:41.833806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1543 sessionId:  describe result for acl check
2025-10-02T08:12:41.833848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:41.833850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:41.833862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:41.833867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534370713067890:10165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:41.834819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534370713067890:10165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:41.843909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:41.845085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:41.845371Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:41.845378Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:41.845399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:41.845489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:41.845529Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534370713067924:10154]
2025-10-02T08:12:41.846248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:41.846564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:41.846621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:41.846981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:41.847016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.847018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.847019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.847020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.847022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.847027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.847037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.847041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.847046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.847049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.847054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.847062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:41.847068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.847073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:41.847077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.847082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:41.847087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.847092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.847097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.847102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.847123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:41.847772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534370713067890:10165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:41.865763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534370713067890:10165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:41.865781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534370713067890:10165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:41.865784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534370713067890:10165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:41.865794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:41.866891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:41.868649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:41.868655Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:41.868657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:41.868661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:41.868670Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1542 [1:7556534370713067924:10154]
2025-10-02T08:12:41.868681Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:41.868699Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:41.868702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:41.868706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:41.868708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:41.868723Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:41.868728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:41.868735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:41.868799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.870678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.870682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:41.870685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:41.870771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:41.870775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.870792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:41.870805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:41.870825Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534370713067909:10154]
2025-10-02T08:12:41.870827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534370713067909:10154]
2025-10-02T08:12:41.870837Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:41.870853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:41.870868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:41.870871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:41.870905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534370713067909:10154]
2025-10-02T08:12:41.870907Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:41.871045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:41.871052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:41.871057Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:41.871760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1542
2025-10-02T08:12:41.871773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534370713067954:10165], now have 1 active actors on pipe
2025-10-02T08:12:41.871778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534371172882394:2378], now have 1 active actors on pipe
2025-10-02T08:12:41.871903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.871914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.871942Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:41.871951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:41.871956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:41.871959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:41.871969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:41.871984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:41.872004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:41.872542Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1542
2025-10-02T08:12:41.872699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14045b-a6c914e1-f41f0496-40ede667_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:41.876072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0] Write session: try to update token
2025-10-02T08:12:41.876091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:41.872167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:41.872175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:41.872191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:41.872223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1543 partition: 0 MaxSeqNo: 17 sessionId: src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0
2025-10-02T08:12:41.917349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534370713067971:2513]
2025-10-02T08:12:41.919087Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:41.919093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:41.919095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:41.919104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534370713067909:10154]
2025-10-02T08:12:41.919110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534370713067909:10154]
2025-10-02T08:12:41.919149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:41.919160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:41.919163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:41.919316Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:41.921165Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:41.921178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:41.921314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1542, pipe: [1:7556534370713067971:2513]
2025-10-02T08:12:41.930329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId: src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:41.933072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:42.104152Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:42.104479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534370713067971:2513], now have 1 active actors on pipe
2025-10-02T08:12:42.104487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.104491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.104853Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:42.105023Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:42.105244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534370713067971:2513]
2025-10-02T08:12:42.105278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:42.105333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1543 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0
2025-10-02T08:12:42.105750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:42.105762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0] Write session will restart in 0.009435s
2025-10-02T08:12:42.105788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0] Write session: Do CDS request
2025-10-02T08:12:42.105798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:42.105535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1543 sessionId: src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0 is DEAD
2025-10-02T08:12:42.114992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:42.116380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:42.116583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:42.116562Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:42.116570Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:42.116579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:42.116618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:42.116647Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534375008035447:10155]
2025-10-02T08:12:42.117180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:42.117195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1544
2025-10-02T08:12:42.117273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:42.117326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:42.117361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:42.117374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:42.117378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:42.117628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:42.117672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:42.117853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1544 sessionId:  describe result for acl check
2025-10-02T08:12:42.117880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:42.117881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:42.117883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:42.117888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534375008035458:10158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:42.117957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:42.117997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.117998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.117999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.118000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.118002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.118008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.118017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.118021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.118025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.118028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.118034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.118041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.118046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.118051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.118055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.118060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.118064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.118069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.118074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.118079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.118096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:42.118384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534375008035458:10158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:42.121931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534375008035458:10158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:42.128976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:42.130788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:42.130810Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:42.130815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:42.130820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:42.130827Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1543 [1:7556534375008035447:10155]
2025-10-02T08:12:42.130841Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:42.130860Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:42.130865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.130868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.130870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.130887Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:42.130893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:42.130900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:42.130972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.130974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.130977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:42.130979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:42.131056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:42.131059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.131074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.131088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:42.131105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534375008035440:10155]
2025-10-02T08:12:42.131107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534375008035440:10155]
2025-10-02T08:12:42.131114Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:42.131128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:42.131143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:42.131147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:42.131150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:42.131154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:42.131180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534375008035440:10155]
2025-10-02T08:12:42.131183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:42.131192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534375467849700:2378], now have 1 active actors on pipe
2025-10-02T08:12:42.134084Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1543
2025-10-02T08:12:42.141096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6316533-f8666e88-1243dd0a-d1d0a5c3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:42.143877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0] Write session: try to update token
2025-10-02T08:12:42.143894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:42.133346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:42.135284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534375008035458:10158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:42.135292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534375008035458:10158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:42.135296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534375008035458:10158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:42.135305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:42.137451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1543
2025-10-02T08:12:42.137466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534375008035504:10158], now have 1 active actors on pipe
2025-10-02T08:12:42.137524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.137531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.137560Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:42.137571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.137575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.137578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:42.137592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.137607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:42.137626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:42.137700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.137703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.137715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:42.137746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1544 partition: 0 MaxSeqNo: 17 sessionId: src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0
2025-10-02T08:12:42.174180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId: src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:42.177243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:42.177487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.177495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.177529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:42.177549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:42.177698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.177701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.177882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.177957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.178024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.178097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.178148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.178152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.178231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.178298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.178367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.178440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.178488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.178491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.178571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.178636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.178702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.178771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.178821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.178825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.178904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.179003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.179083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.179167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.179222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.179240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.179330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.179402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.179483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.179561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.179637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.179640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.179728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.179805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.179886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.179964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.180017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.180020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.180114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.180201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.180282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.180358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.180413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.180417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.180501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.180575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.180655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.180735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.180787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.180793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.185053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.185144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.185212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.185281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.185338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.185342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.185443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:42.185513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:42.185584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:42.185658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:42.185710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:42.185714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:42.185763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:42.185838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.185858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.185861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:42.185895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:42.185908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:42.185912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:42.185915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:42.185918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:42.186384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:42.186410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:42.186417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:42.186420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:42.186424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:42.186427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:42.187096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:42.187115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:42.187123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:42.187126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:42.187130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:42.187133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:42.187795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:42.187813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:42.188168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:42.188187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:42.188190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:42.189644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:42.189667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:42.189679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392762189
2025-10-02T08:12:42.189844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:42.189853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:42.189859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:42.189863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:42.189867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:42.189874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:42.190390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:42.190403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:42.190409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:42.190415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:42.190419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:42.190423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:42.190952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:42.190964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:42.190972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:42.190976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:42.190980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:42.190983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:42.191509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:42.191524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:42.191543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:42.192975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:42.192989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:42.192994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:42.192998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:42.193007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392762192
2025-10-02T08:12:42.193331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:42.193344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:42.193350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:42.193355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:42.193359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:42.193364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:42.193855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:42.193868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:42.193873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:42.193877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:42.193879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:42.193883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:42.194382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:42.194392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.194514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392762193
2025-10-02T08:12:42.195460Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:42.195480Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:42.195487Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:42.195493Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:42.197325Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:42.197328Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:42.197329Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:42.197339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534375008035440:10155]
2025-10-02T08:12:42.197343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534375008035440:10155]
2025-10-02T08:12:42.197405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:42.197410Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:42.197415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:42.197421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.197423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:42.197579Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:42.209024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534375008035518:2513]
2025-10-02T08:12:42.209315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1543, pipe: [1:7556534375008035518:2513]
2025-10-02T08:12:42.357830Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:42.358227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534375008035518:2513], now have 1 active actors on pipe
2025-10-02T08:12:42.359692Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:42.359746Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:42.361236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:42.361281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1544 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0
2025-10-02T08:12:42.361469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1544 sessionId: src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0 is DEAD
2025-10-02T08:12:42.361666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534375008035518:2513]
2025-10-02T08:12:42.362701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:42.362713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0] Write session will restart in 0.009983s
2025-10-02T08:12:42.362745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0] Write session: Do CDS request
2025-10-02T08:12:42.362752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:42.374971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:42.375336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:42.375353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1545
2025-10-02T08:12:42.381049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:42.381104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:42.381110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:42.381115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:42.381619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1545 sessionId:  describe result for acl check
2025-10-02T08:12:42.381656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:42.381659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:42.381661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:42.381665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534375008035746:10113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:42.382148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534375008035746:10113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:42.383536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:42.385278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:42.385469Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:42.385473Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:42.385481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:42.385525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:42.385560Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534375008035770:10112]
2025-10-02T08:12:42.386175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:42.386518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:42.386550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:42.386997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:42.387044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.387045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.387047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.387048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.387049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.387056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.387066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.387071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.387075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.387079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.387085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.387093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.387098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.387104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.387108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.387114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.387118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.387124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.387129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.387134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.387156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:42.389201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534375008035746:10113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:42.401330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:42.401594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534375008035746:10113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:42.401601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534375008035746:10113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:42.401604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534375008035746:10113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:42.401611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:42.403053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:42.403060Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:42.403062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:42.403066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:42.403072Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1544 [1:7556534375008035770:10112]
2025-10-02T08:12:42.403085Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:42.403102Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:42.403119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.403122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.403124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.403140Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:42.403145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:42.403156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:42.403223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.403232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.403235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:42.403238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:42.403300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:42.403310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.403325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.403345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:42.403362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534375008035759:10112]
2025-10-02T08:12:42.403364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534375008035759:10112]
2025-10-02T08:12:42.403376Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:42.403390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:42.403403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:42.403406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:42.403443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534375008035759:10112]
2025-10-02T08:12:42.403445Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:42.405839Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:42.405852Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:42.405859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:42.407153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac746bf-64f0647d-5d2a2c08-c435a023_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:42.406542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1544
2025-10-02T08:12:42.406572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534375008035804:10113], now have 1 active actors on pipe
2025-10-02T08:12:42.406577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534375467849741:2378], now have 1 active actors on pipe
2025-10-02T08:12:42.406583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.406589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.406614Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:42.406623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.406628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.406631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:42.406651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.406664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:42.406682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:42.406764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.406768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.406782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:42.406820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1545 partition: 0 MaxSeqNo: 17 sessionId: src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0
2025-10-02T08:12:42.407104Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1544
2025-10-02T08:12:42.409903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0] Write session: try to update token
2025-10-02T08:12:42.409920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:42.433810Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:42.433838Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:42.433841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:42.433851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534375008035759:10112]
2025-10-02T08:12:42.433856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534375008035759:10112]
2025-10-02T08:12:42.433902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:42.433915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.433916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:42.433918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:42.433922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:42.434064Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:42.434404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId: src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:42.437446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:42.466176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534375008035822:2513]
2025-10-02T08:12:42.466653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1544, pipe: [1:7556534375008035822:2513]
2025-10-02T08:12:42.578397Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:42.578895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.578906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.578951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534375008035822:2513], now have 1 active actors on pipe
2025-10-02T08:12:42.580196Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:42.579992Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:42.580347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534375008035822:2513]
2025-10-02T08:12:42.580369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:42.580424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1545 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0
2025-10-02T08:12:42.580596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1545 sessionId: src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0 is DEAD
2025-10-02T08:12:42.580984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:42.580993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0] Write session will restart in 0.009563s
2025-10-02T08:12:42.581020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0] Write session: Do CDS request
2025-10-02T08:12:42.581026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:42.592045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:42.593077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:42.593100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1546
2025-10-02T08:12:42.593298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:42.593329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:42.593334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:42.593338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:42.593796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1546 sessionId:  describe result for acl check
2025-10-02T08:12:42.593828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:42.593829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:42.593831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:42.593836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534375008035840:10095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:42.594344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534375008035840:10095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:42.611790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534375008035840:10095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:42.635840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:42.642133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:42.642379Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:42.642383Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:42.642394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:42.642450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:42.642490Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534375008036039:10092]
2025-10-02T08:12:42.643149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:42.644992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534375008035840:10095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:42.645011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534375008035840:10095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:42.645014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534375008035840:10095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:42.645023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:42.645178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:42.645233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:42.645622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:42.645673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.645674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.645676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.645677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.645680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.645685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.645697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.645700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.645708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.645712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.645718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.645726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.645732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.645737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.645747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.645753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.645757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.645762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.645767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.645771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.645791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:42.680673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534375008036059:2513]
2025-10-02T08:12:42.682101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:42.683891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:42.683898Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:42.683902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:42.683905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:42.683913Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1545 [1:7556534375008036039:10092]
2025-10-02T08:12:42.683933Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:42.683952Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:42.683955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.683958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.683960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.683977Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:42.683982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:42.683988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:42.684057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.684059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.684065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:42.684067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:42.684154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:42.684156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.684168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.684178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:42.684193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534375008036032:10092]
2025-10-02T08:12:42.684195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534375008036032:10092]
2025-10-02T08:12:42.684201Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:42.684214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:42.684226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:42.684229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:42.684263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534375008036032:10092]
2025-10-02T08:12:42.684265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:42.684559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:42.684569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:42.684575Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:42.685273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534375467849749:2378], now have 1 active actors on pipe
2025-10-02T08:12:42.685284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534375008036048:10095], now have 1 active actors on pipe
2025-10-02T08:12:42.685287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534375008036059:2513], now have 1 active actors on pipe
2025-10-02T08:12:42.685305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1545
2025-10-02T08:12:42.685321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1545, pipe: [1:7556534375008036059:2513]
2025-10-02T08:12:42.685659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.685672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.685717Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:42.685727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.685732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.685735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:42.685752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.685765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:42.685785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:42.685946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.685955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.685972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:42.686005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1546 partition: 0 MaxSeqNo: 17 sessionId: src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0
2025-10-02T08:12:42.687250Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1545
2025-10-02T08:12:42.688924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6753d12d-c7741df3-98ab85ba-36f4c912_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:42.691977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0] Write session: try to update token
2025-10-02T08:12:42.691995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:42.717131Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:42.717153Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:42.717156Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:42.717167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534375008036032:10092]
2025-10-02T08:12:42.717172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534375008036032:10092]
2025-10-02T08:12:42.717218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:42.717224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.717226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:42.717394Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:42.719733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:42.719742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:42.735066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId: src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:42.744179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:42.876794Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:42.877387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.877395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.878243Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:42.878585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:42.878633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1546 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0
2025-10-02T08:12:42.878804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1546 sessionId: src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0 is DEAD
2025-10-02T08:12:42.878061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:42.880993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:42.881007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0] Write session will restart in 0.008217s
2025-10-02T08:12:42.881037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0] Write session: Do CDS request
2025-10-02T08:12:42.881044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:42.878975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534375008036059:2513]
2025-10-02T08:12:42.893356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:42.893702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:42.893719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1547
2025-10-02T08:12:42.897607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:42.897656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:42.897662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:42.897668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:42.898139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1547 sessionId:  describe result for acl check
2025-10-02T08:12:42.898168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:42.898170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:42.898172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:42.898177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534375008036105:10061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:42.898911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534375008036105:10061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:42.942513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:42.943669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:42.943910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:42.943915Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:42.943928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:42.943988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:42.944033Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534375008036286:10058]
2025-10-02T08:12:42.944745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:42.945641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534375008036105:10061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:42.946711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:42.946772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:42.947171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:42.947226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.947228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.947229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.947230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.947232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.947238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.947249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.947254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.947258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.947262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.947268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.947276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:42.947283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.947288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:42.947293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.947298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:42.947306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.947311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.947316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.947320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.947343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:42.973304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534375008036105:10061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:42.973324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534375008036105:10061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:42.973327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534375008036105:10061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:42.973336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:42.978079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534375008036316:2513]
2025-10-02T08:12:42.985575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:42.987458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:42.987466Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:42.987469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:42.987473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:42.987481Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1546 [1:7556534375008036286:10058]
2025-10-02T08:12:42.987494Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:42.987513Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:42.987516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.987518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.987520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.987538Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:42.987543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:42.987549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:42.988501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.988505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.988509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:42.988511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:42.988601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:42.988605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:42.988619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:42.988631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:42.988648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534375008036280:10058]
2025-10-02T08:12:42.988651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534375008036280:10058]
2025-10-02T08:12:42.988736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:42.988738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:42.988869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1546
2025-10-02T08:12:42.988896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1546, pipe: [1:7556534375008036316:2513]
2025-10-02T08:12:42.989710Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1546
2025-10-02T08:12:42.993608Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:42.993663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:42.993690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:42.993695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:42.993712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534375008036312:10061], now have 1 active actors on pipe
2025-10-02T08:12:42.993718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534375008036316:2513], now have 1 active actors on pipe
2025-10-02T08:12:42.993722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534375467849761:2378], now have 1 active actors on pipe
2025-10-02T08:12:42.993729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.993736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.993803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534375008036280:10058]
2025-10-02T08:12:42.993813Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:42.993833Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:42.993842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:42.993847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:42.993850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:42.993864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:42.993880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:42.993924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:42.994116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:42.994510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:42.994517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:42.994543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:42.994582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1547 partition: 0 MaxSeqNo: 17 sessionId: src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0
2025-10-02T08:12:42.996188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce983e2-5cacce29-7ac4e7bb-57ea8b3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:42.999183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0] Write session: try to update token
2025-10-02T08:12:42.999203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:43.027638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId: src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:43.030619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:43.031156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.031172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.031210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:43.031229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:43.031390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.031395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.031575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.031644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.031719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.031787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.031839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.031845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.031938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.032004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.032071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.032158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.032202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.032206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.032279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.032342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.032404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.032471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.032515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.032518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.032591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.032666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.032741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.032840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.032890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.032892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.032980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.033058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.033139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.033222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.033278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.033281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.033371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.033445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.033523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.033599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.033666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.033669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.033754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.033826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.033905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.033980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.034033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.034038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.034126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.034197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.034278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.034354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.034406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.034412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.034492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.034554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.034617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.034688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.034751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.034753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.034833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:43.034902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:43.034967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:43.035048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:43.035122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:43.035124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:43.035193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:43.035731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.035764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.035767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:43.035802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:43.035818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:43.035821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:43.035824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:43.035827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:43.036305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:43.036326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:43.036333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:43.036336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:43.036339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:43.036342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:43.036940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:43.036956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:43.036964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:43.036969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:43.036972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:43.036975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:43.037621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:43.037635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:43.037640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:43.037644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:43.037647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:43.040436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:43.040465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:43.040483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392763040
2025-10-02T08:12:43.040731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:43.040741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:43.040748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:43.040751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:43.040755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:43.040758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:43.041397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:43.041407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:43.041413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:43.041416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:43.041418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:43.041421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:43.041912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:43.041922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:43.041927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:43.041930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:43.041935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:43.041938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:43.042366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:43.042380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:43.042383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:43.043481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:43.043489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:43.043494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:43.043497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:43.043519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392763042
2025-10-02T08:12:43.043802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:43.043811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:43.043816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:43.043819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:43.043822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:43.043828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:43.044321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:43.044333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:43.044338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:43.044342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:43.044347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:43.044350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:43.045298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:43.045319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.045408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392763045
2025-10-02T08:12:43.048185Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:43.048204Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:43.048211Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:43.048218Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:43.048231Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:43.048233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:43.048235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:43.048246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534375008036280:10058]
2025-10-02T08:12:43.048250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534375008036280:10058]
2025-10-02T08:12:43.048343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:43.048349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.048351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:43.048531Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:43.048789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:43.048796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:43.224120Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:43.226324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:43.226337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0] Write session will restart in 0.006479s
2025-10-02T08:12:43.226362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0] Write session: Do CDS request
2025-10-02T08:12:43.226368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:43.225351Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:43.225282Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:43.225661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:43.225690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1547 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0
2025-10-02T08:12:43.225865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1547 sessionId: src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0 is DEAD
2025-10-02T08:12:43.225994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534375008036316:2513]
2025-10-02T08:12:43.232410Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [5c693f194652c99a] Result# TEvPutResult {Id# [72075186224037892:1546:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:43.232508Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1546:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:43.232569Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1546:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:43.236643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:43.236990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:43.237007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1548
2025-10-02T08:12:43.240410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:43.240933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:43.240976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:43.240981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:43.240985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:43.241428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1548 sessionId:  describe result for acl check
2025-10-02T08:12:43.241459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:43.241460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:43.241461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:43.241467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534379303003818:10039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:43.241978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534379303003818:10039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:43.242126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:43.242290Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:43.242293Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:43.242302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:43.242342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:43.242377Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534379303003821:10047]
2025-10-02T08:12:43.242956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:43.243148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:43.243181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:43.243463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:43.243497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.243498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.243499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.243500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.243501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.243506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.243515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.243518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.243522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.243525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.243531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.243539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.243544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.243548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.243553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.243557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.243560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.243565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.243569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.243576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.243593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:43.254508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:43.255134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534379303003818:10039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:43.256281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:43.256287Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:43.256290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:43.256293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:43.256301Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1547 [1:7556534379303003821:10047]
2025-10-02T08:12:43.256312Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:43.256329Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:43.256332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.256335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.256337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.256353Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:43.256358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:43.256365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:43.256424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.256427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.256430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:43.256432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:43.256500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:43.256502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.256515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.256525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:43.256541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534379303003812:10047]
2025-10-02T08:12:43.256543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534379303003812:10047]
2025-10-02T08:12:43.256551Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:43.256564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:43.256571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:43.256574Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:43.256579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:43.256582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:43.256618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534379762817078:2378], now have 1 active actors on pipe
2025-10-02T08:12:43.256621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534379303003812:10047]
2025-10-02T08:12:43.256624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:43.256635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:43.257289Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1547
2025-10-02T08:12:43.266192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534379303003818:10039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:43.266214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534379303003818:10039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:43.266217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534379303003818:10039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:43.266235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:43.266614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534379303003875:10039], now have 1 active actors on pipe
2025-10-02T08:12:43.266616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1547
2025-10-02T08:12:43.266651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.266658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.266687Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:43.266696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.266701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.266704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:43.266716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.266732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:43.266749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:43.266793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.266796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.266811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:43.266841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1548 partition: 0 MaxSeqNo: 17 sessionId: src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0
2025-10-02T08:12:43.269053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecddf54f-d8658494-418a9f82-7ddbb14f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:43.271775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0] Write session: try to update token
2025-10-02T08:12:43.271791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:43.294695Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:43.294722Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:43.294725Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:43.294735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534379303003812:10047]
2025-10-02T08:12:43.294739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534379303003812:10047]
2025-10-02T08:12:43.294780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:43.294786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.294788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:43.294938Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:43.296848Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:43.296854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:43.318540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId: src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:43.322154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:43.328888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534379303003909:2513]
2025-10-02T08:12:43.329126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1547, pipe: [1:7556534379303003909:2513]
2025-10-02T08:12:43.457305Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:43.457613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.457627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.457648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534379303003909:2513], now have 1 active actors on pipe
2025-10-02T08:12:43.461083Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:43.461468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534379303003909:2513]
2025-10-02T08:12:43.461496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:43.461551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0
2025-10-02T08:12:43.461719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1548 sessionId: src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0 is DEAD
2025-10-02T08:12:43.462187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:43.462206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0] Write session will restart in 0.005557s
2025-10-02T08:12:43.462236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0] Write session: Do CDS request
2025-10-02T08:12:43.462246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:43.462432Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:43.471445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:43.473325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:43.473346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1549
2025-10-02T08:12:43.477212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:43.477410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:43.477453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:43.477458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:43.477462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:43.477910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:43.478099Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:43.478103Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:43.478113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:43.478158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:43.478192Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534379303004119:9995]
2025-10-02T08:12:43.478877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:43.479180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1549 sessionId:  describe result for acl check
2025-10-02T08:12:43.479203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:43.479205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:43.479206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:43.479211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534379303004124:9978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:43.479697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534379303004124:9978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:43.480249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:43.480296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:43.480701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:43.480746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.480747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.480748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.480749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.480750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.480756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.480767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.480771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.480776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.480780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.480785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.480794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.480818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.480823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.480827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.480831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.480835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.480839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.480843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.480847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.480866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:43.491664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:43.493552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:43.493572Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:43.493574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:43.493579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:43.493586Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1548 [1:7556534379303004119:9995]
2025-10-02T08:12:43.493598Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:43.493617Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:43.493621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.493624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.493626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.493644Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:43.493649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:43.493655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:43.493717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.493719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.493722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:43.493725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:43.493791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:43.493794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.493808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.493821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:43.493837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534379303004113:9995]
2025-10-02T08:12:43.493839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534379303004113:9995]
2025-10-02T08:12:43.493850Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:43.493862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:43.493878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:43.493881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:43.493914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534379303004113:9995]
2025-10-02T08:12:43.493916Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:43.494282Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:43.494290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:43.494295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:43.494873Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1548
2025-10-02T08:12:43.495695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534379303004124:9978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:43.495756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534379762817107:2378], now have 1 active actors on pipe
2025-10-02T08:12:43.507493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973280ec-ec1c1df0-fbe0242e-47ab4a5a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:43.505963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534379303004124:9978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:43.505982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534379303004124:9978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:43.505986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534379303004124:9978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:43.505995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:43.506835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1548
2025-10-02T08:12:43.506849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534379303004173:9978], now have 1 active actors on pipe
2025-10-02T08:12:43.506905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.506911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.506938Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:43.506947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.506952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.506954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:43.506966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.506980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:43.506999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:43.507066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.507069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.507081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:43.507105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1549 partition: 0 MaxSeqNo: 17 sessionId: src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0
2025-10-02T08:12:43.510499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0] Write session: try to update token
2025-10-02T08:12:43.510522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:43.526866Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:43.526889Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:43.526892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:43.526902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534379303004113:9995]
2025-10-02T08:12:43.526907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534379303004113:9995]
2025-10-02T08:12:43.526948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:43.526955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.526957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:43.527159Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:43.527791Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:43.527796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:43.535651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId: src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:43.538923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:43.560996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534379303004181:2513]
2025-10-02T08:12:43.568638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1548, pipe: [1:7556534379303004181:2513]
2025-10-02T08:12:43.679254Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:43.679702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.679712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.679754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534379303004181:2513], now have 1 active actors on pipe
2025-10-02T08:12:43.683207Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:43.681424Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:43.681808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534379303004181:2513]
2025-10-02T08:12:43.681829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:43.681881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1549 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0
2025-10-02T08:12:43.682063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1549 sessionId: src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0 is DEAD
2025-10-02T08:12:43.684308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:43.684318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0] Write session will restart in 0.009360s
2025-10-02T08:12:43.684344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0] Write session: Do CDS request
2025-10-02T08:12:43.684351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:43.695624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:43.695987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:43.696008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1550
2025-10-02T08:12:43.696243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:43.696276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:43.696281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:43.696284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:43.697535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1550 sessionId:  describe result for acl check
2025-10-02T08:12:43.697572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:43.697574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:43.697576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:43.697581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534379303004373:9979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:43.698095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534379303004373:9979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:43.699434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:43.700612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:43.700819Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:43.700823Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:43.700836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:43.700891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:43.700925Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534379303004388:9980]
2025-10-02T08:12:43.701594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:43.702432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:43.702485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:43.702835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:43.702876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.702878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.702879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.702880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.702881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.702887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.702897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.702901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.702905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.702908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.702914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.702922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.702928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.702933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.702938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.702942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.702946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.702951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.702955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.702960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.702981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:43.712939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534379303004373:9979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:43.717744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:43.719624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:43.719632Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:43.719635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:43.719640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:43.719647Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1549 [1:7556534379303004388:9980]
2025-10-02T08:12:43.719660Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:43.719680Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:43.719683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.719687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.719690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.719707Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:43.719712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:43.719718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:43.719793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.719795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.719798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:43.719800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:43.719872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:43.719876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.719891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.719903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:43.719919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534379303004371:9980]
2025-10-02T08:12:43.719921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534379303004371:9980]
2025-10-02T08:12:43.719928Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:43.719941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:43.719954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:43.719956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:43.719990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534379303004371:9980]
2025-10-02T08:12:43.719992Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:43.720922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:43.720935Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:43.720940Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:43.721514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534379762817114:2378], now have 1 active actors on pipe
2025-10-02T08:12:43.722628Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1549
2025-10-02T08:12:43.725655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534379303004373:9979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:43.725677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534379303004373:9979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:43.725681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534379303004373:9979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:43.725691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:43.726534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534379303004433:9979], now have 1 active actors on pipe
2025-10-02T08:12:43.726558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1549
2025-10-02T08:12:43.726653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.726662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.726690Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:43.726701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.726705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.726708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:43.726721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.726736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:43.726757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:43.726906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.726912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.726926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:43.726954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1550 partition: 0 MaxSeqNo: 17 sessionId: src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0
2025-10-02T08:12:43.729102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83dbbff-af2ed20-552b2127-23c8f0ef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:43.732060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0] Write session: try to update token
2025-10-02T08:12:43.732077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:43.750979Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:43.751004Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:43.751007Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:43.751016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534379303004371:9980]
2025-10-02T08:12:43.751020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534379303004371:9980]
2025-10-02T08:12:43.751068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:43.751076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.751078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:43.751256Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:43.752017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:43.752024Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:43.758087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId: src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:43.761007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:43.784867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534379303004440:2513]
2025-10-02T08:12:43.788933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1549, pipe: [1:7556534379303004440:2513]
2025-10-02T08:12:43.912045Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:43.912376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.912384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.912406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534379303004440:2513], now have 1 active actors on pipe
2025-10-02T08:12:43.913168Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:43.913262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:43.913325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1550 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0
2025-10-02T08:12:43.913492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534379303004440:2513]
2025-10-02T08:12:43.913493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1550 sessionId: src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0 is DEAD
2025-10-02T08:12:43.917041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:43.917055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0] Write session will restart in 0.006357s
2025-10-02T08:12:43.917080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0] Write session: Do CDS request
2025-10-02T08:12:43.917100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:43.921172Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:43.925316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:43.925637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:43.925657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1551
2025-10-02T08:12:43.925813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:43.925846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:43.925851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:43.925854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:43.926420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1551 sessionId:  describe result for acl check
2025-10-02T08:12:43.926454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:43.926455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:43.926457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:43.926462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534379303004451:9964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:43.926983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534379303004451:9964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:43.937249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534379303004451:9964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:43.952236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:43.952528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:43.952710Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:43.952715Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:43.952725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:43.952765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:43.952984Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534379303004667:9961]
2025-10-02T08:12:43.953636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534379303004451:9964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:43.953645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534379303004451:9964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:43.953649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534379303004451:9964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:43.953658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:43.953696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:43.954384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:43.954444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:43.955547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:43.955662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.955669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.955670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.955676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.955677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.955683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.955693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.955698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.955701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.955706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.955714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.955722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:43.955729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.955735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:43.955739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.955744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:43.955749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.955755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.955761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.955772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.955794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:43.971384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:43.973424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:43.973449Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:43.973452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:43.973457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:43.973464Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1550 [1:7556534379303004667:9961]
2025-10-02T08:12:43.973478Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:43.973497Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:43.973500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.973504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.973506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.973524Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:43.973530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:43.973537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:43.973609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.973611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.973613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:43.973616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:43.973686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:43.973689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:43.973706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:43.973718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:43.973737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534379303004660:9961]
2025-10-02T08:12:43.973739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534379303004660:9961]
2025-10-02T08:12:43.973752Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:43.973766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:43.973781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:43.973783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:43.973818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534379303004660:9961]
2025-10-02T08:12:43.973821Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:43.973920Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:43.973923Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:43.973930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:43.974574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1550
2025-10-02T08:12:43.974589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534379303004673:9964], now have 1 active actors on pipe
2025-10-02T08:12:43.974593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534379762817121:2378], now have 1 active actors on pipe
2025-10-02T08:12:43.974653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.974659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.974686Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:43.974698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:43.974702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:43.974705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:43.974716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:43.974731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:43.974750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:43.974825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:43.974828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:43.974842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:43.974876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1551 partition: 0 MaxSeqNo: 17 sessionId: src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0
2025-10-02T08:12:43.975779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa79412-40ea0f69-d336eb33-7fab5334_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:43.978788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0] Write session: try to update token
2025-10-02T08:12:43.978811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:43.979886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1550
2025-10-02T08:12:44.009868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId: src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:44.012664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:44.014927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.014946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.016588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:44.016602Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:44.016605Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:44.016610Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:44.016618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534379303004660:9961]
2025-10-02T08:12:44.016622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534379303004660:9961]
2025-10-02T08:12:44.016663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:44.016669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.016671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:44.016837Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:44.016939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:44.017042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534383597971993:2513]
2025-10-02T08:12:44.020857Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:44.020876Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:44.024320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1550, pipe: [1:7556534383597971993:2513]
2025-10-02T08:12:44.213626Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:44.214233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.214242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.214440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.214515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.214590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.214666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.214753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.214758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.214845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.214923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.214996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.215084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.215129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.215132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.215219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.215285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.215355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.215427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.215474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.215477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.215564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.215644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.215733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.215822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.215879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.215883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.215978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.216061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.216162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.216248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.216302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.216305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.216404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.216486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.216570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.216662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.216719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.216725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.220927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.221023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.221104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.221182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.221239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.221246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.221342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.221414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.221496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.221605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.221666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.221670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.221750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.221814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.221879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.221951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.222008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.222011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.222094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:44.222160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:44.222220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:44.222291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:44.222373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:44.222376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:44.222427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534383597971993:2513], now have 1 active actors on pipe
2025-10-02T08:12:44.230529Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:44.233109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:44.233121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0] Write session will restart in 0.006946s
2025-10-02T08:12:44.233147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0] Write session: Do CDS request
2025-10-02T08:12:44.233155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:44.229435Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:44.229785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534383597971993:2513]
2025-10-02T08:12:44.229808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:44.229838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1551 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0
2025-10-02T08:12:44.230026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1551 sessionId: src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0 is DEAD
2025-10-02T08:12:44.241446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:44.248887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:44.248907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1552
2025-10-02T08:12:44.249192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:44.249218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:44.249225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:44.249229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:44.253149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1552 sessionId:  describe result for acl check
2025-10-02T08:12:44.253190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:44.253192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:44.253194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:44.253199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534383597972027:9956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:44.254020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534383597972027:9956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:44.278283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534383597972027:9956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:44.281944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:44.282772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:44.282926Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:44.282929Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:44.282936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:44.282967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:44.282992Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534383597972225:9958]
2025-10-02T08:12:44.283414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:44.284399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:44.284437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:44.284664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:44.284690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.284691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.284691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.284692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.284693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.284697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.284704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.284707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.284709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.284711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.284715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.284722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.284725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.284728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.284731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.284734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.284736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.284741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.284744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.284746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.284757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:44.285069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534383597972027:9956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:44.285076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534383597972027:9956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:44.285080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534383597972027:9956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:44.285101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:44.295528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:44.297412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:44.297436Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:44.297439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:44.297442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:44.297449Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1551 [1:7556534383597972225:9958]
2025-10-02T08:12:44.297461Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:44.299122Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1551
2025-10-02T08:12:44.299516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98367d5a-1dc41584-87bf14bc-6979c5c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:44.297478Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:44.297487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:44.297491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:44.297493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:44.297510Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:44.297515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:44.297522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:44.297588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.297591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.297594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:44.297596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:44.297668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:44.297671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.297685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.297699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:44.297715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534383597972219:9958]
2025-10-02T08:12:44.297718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534383597972219:9958]
2025-10-02T08:12:44.297731Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:44.297745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:44.297761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:44.297764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:44.297800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534383597972219:9958]
2025-10-02T08:12:44.297801Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:44.297890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:44.297893Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:44.297898Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:44.298473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1551
2025-10-02T08:12:44.298485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534383597972241:9956], now have 1 active actors on pipe
2025-10-02T08:12:44.298489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534384057784438:2378], now have 1 active actors on pipe
2025-10-02T08:12:44.298545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.298550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.298574Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:44.298581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:44.298584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:44.298587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:44.298597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:44.298608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:44.298624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:44.298693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.298695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.298706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:44.298737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1552 partition: 0 MaxSeqNo: 17 sessionId: src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0
2025-10-02T08:12:44.302433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0] Write session: try to update token
2025-10-02T08:12:44.302451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:44.319239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId: src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:44.321886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:44.322598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.322625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.322657Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:44.322660Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:44.322662Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:44.322672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534383597972219:9958]
2025-10-02T08:12:44.322676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534383597972219:9958]
2025-10-02T08:12:44.322734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:44.322750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.322752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:44.322813Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:44.322834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:44.322907Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:44.329934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534383597972259:2513]
2025-10-02T08:12:44.331540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1551, pipe: [1:7556534383597972259:2513]
2025-10-02T08:12:44.491394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:44.491407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0] Write session will restart in 0.007729s
2025-10-02T08:12:44.491432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0] Write session: Do CDS request
2025-10-02T08:12:44.491439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:44.492540Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:44.489245Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:44.489678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:44.489702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534383597972259:2513], now have 1 active actors on pipe
2025-10-02T08:12:44.489766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:44.490770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:44.490774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:44.490794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1552 reason: error at write: Disconnected sessionId: src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0
2025-10-02T08:12:44.490918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1552 sessionId: src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0 is DEAD
2025-10-02T08:12:44.491074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534383597972259:2513]
2025-10-02T08:12:44.500667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:44.501130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:44.501149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1553
2025-10-02T08:12:44.502082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:44.502115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:44.502131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:44.502135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:44.504274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1553 sessionId:  describe result for acl check
2025-10-02T08:12:44.504311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:44.504313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:44.504315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:44.504320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534383597972494:9891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:44.504841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534383597972494:9891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:44.511976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:44.512372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:44.512583Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:44.512593Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:44.512604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:44.512650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:44.512690Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534383597972520:9906]
2025-10-02T08:12:44.513348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:44.513735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:44.513784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:44.514092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:44.514151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.514159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.514160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.514161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.514164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.514169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.514179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.514183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.514187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.514190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.514196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.514203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.514214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.514220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.514225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.514229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.514236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.514245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.514249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.514253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.514270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:44.515464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534383597972494:9891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:44.523965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534383597972494:9891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:44.523987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534383597972494:9891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:44.523995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534383597972494:9891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:44.524004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:44.528647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:44.530550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:44.530557Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:44.530560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:44.530564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:44.530571Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1552 [1:7556534383597972520:9906]
2025-10-02T08:12:44.530584Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:44.530603Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:44.530606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:44.530609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:44.530611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:44.530626Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:44.530631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:44.530638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:44.530702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.530705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.530708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:44.530710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:44.530785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:44.530788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.530802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.530816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:44.530833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534383597972510:9906]
2025-10-02T08:12:44.530835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534383597972510:9906]
2025-10-02T08:12:44.530848Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:44.530861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:44.530874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:44.530877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:44.530915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534383597972510:9906]
2025-10-02T08:12:44.530917Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:44.531182Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:44.531192Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:44.531199Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:44.531718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1552
2025-10-02T08:12:44.531732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534383597972550:9891], now have 1 active actors on pipe
2025-10-02T08:12:44.531737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534384057784468:2378], now have 1 active actors on pipe
2025-10-02T08:12:44.532469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.532482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.532514Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|245debc2-c667b052-bbcf0bab-457d45bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:44.532524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:44.532528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:44.532531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:44.532543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:44.532556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:44.532576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:44.532002Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1552
2025-10-02T08:12:44.532687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.532693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.532708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:44.532738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1553 partition: 0 MaxSeqNo: 17 sessionId: src_id|245debc2-c667b052-bbcf0bab-457d45bc_0
2025-10-02T08:12:44.533205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9f6cbf-8f20be88-e51e5f8b-26ea2a09_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|245debc2-c667b052-bbcf0bab-457d45bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:44.536585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245debc2-c667b052-bbcf0bab-457d45bc_0] Write session: try to update token
2025-10-02T08:12:44.536603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245debc2-c667b052-bbcf0bab-457d45bc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:44.555896Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:44.555921Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:44.555924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:44.555934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534383597972510:9906]
2025-10-02T08:12:44.555939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534383597972510:9906]
2025-10-02T08:12:44.555984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:44.555991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.555994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:44.556166Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:44.556633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:44.556639Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:44.575720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId: src_id|245debc2-c667b052-bbcf0bab-457d45bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:44.579229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:44.583647Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:12:44.590041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534383597972569:2513]
2025-10-02T08:12:44.590287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1552, pipe: [1:7556534383597972569:2513]
2025-10-02T08:12:44.722492Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:44.723000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.723007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.723029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534383597972569:2513], now have 1 active actors on pipe
2025-10-02T08:12:44.723605Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:44.723904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534383597972569:2513]
2025-10-02T08:12:44.723920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:44.723966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1553 reason: status is not ok: tablet will be restarted right now sessionId: src_id|245debc2-c667b052-bbcf0bab-457d45bc_0
2025-10-02T08:12:44.724144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1553 sessionId: src_id|245debc2-c667b052-bbcf0bab-457d45bc_0 is DEAD
2025-10-02T08:12:44.724468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245debc2-c667b052-bbcf0bab-457d45bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:44.724475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245debc2-c667b052-bbcf0bab-457d45bc_0] Write session will restart in 0.006658s
2025-10-02T08:12:44.724499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245debc2-c667b052-bbcf0bab-457d45bc_0] Write session: Do CDS request
2025-10-02T08:12:44.724508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245debc2-c667b052-bbcf0bab-457d45bc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:44.723389Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:44.733468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245debc2-c667b052-bbcf0bab-457d45bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:44.733747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:44.733764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1554
2025-10-02T08:12:44.733932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:44.733960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:44.733965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:44.733969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:44.734377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1554 sessionId:  describe result for acl check
2025-10-02T08:12:44.734403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:44.734404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:44.734406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:44.734411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534383597972586:9885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:44.734917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534383597972586:9885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:44.746350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534383597972586:9885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:44.770139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534383597972586:9885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:44.770163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534383597972586:9885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:44.770166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534383597972586:9885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:44.770175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:44.770528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:44.773138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:44.773379Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:44.773382Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:44.773393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:44.773443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:44.773484Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534383597972808:9886]
2025-10-02T08:12:44.774124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:44.775361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:44.775425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:44.775769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:44.775820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.775821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.775822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.775824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.775825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.775831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.775841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.775844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.775847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.775851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.775857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.775864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:44.775869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.775875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:44.775879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.775884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:44.775888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.775892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.775897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.775901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.775920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:44.788282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:44.790548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:44.790556Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:44.790560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:44.790564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:44.790572Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1553 [1:7556534383597972808:9886]
2025-10-02T08:12:44.790588Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:44.790608Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:44.790612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:44.790615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:44.790618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:44.790637Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:44.790643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:44.790650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:44.790725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.790727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.790730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:44.790733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:44.790814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:44.790816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.790834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:44.790846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:44.790862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534383597972795:9886]
2025-10-02T08:12:44.790864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534383597972795:9886]
2025-10-02T08:12:44.790876Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:44.790889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:44.790904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:44.790907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:44.790944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534383597972795:9886]
2025-10-02T08:12:44.790947Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:44.792675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1553
2025-10-02T08:12:44.792902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245debc2-c667b052-bbcf0bab-457d45bc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb590c51-faeec612-2a149b94-a748cad4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:44.796071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb590c51-faeec612-2a149b94-a748cad4_0] Write session: try to update token
2025-10-02T08:12:44.796091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb590c51-faeec612-2a149b94-a748cad4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:44.791222Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:44.791235Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:44.791241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:44.791471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1553
2025-10-02T08:12:44.791493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534383597972800:9885], now have 1 active actors on pipe
2025-10-02T08:12:44.791498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534384057784476:2378], now have 1 active actors on pipe
2025-10-02T08:12:44.791506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.791511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.791542Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb590c51-faeec612-2a149b94-a748cad4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:44.791551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:44.791556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:44.791559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:44.791571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:44.791587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:44.791605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:44.792216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:44.792223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:44.792247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:44.792285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1554 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb590c51-faeec612-2a149b94-a748cad4_0
2025-10-02T08:12:44.825011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534383597972830:2513]
2025-10-02T08:12:44.827916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1553, pipe: [1:7556534383597972830:2513]
2025-10-02T08:12:44.827938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534383597972830:2513], now have 1 active actors on pipe
2025-10-02T08:12:44.844268Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:44.844294Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:44.844297Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:44.844307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534383597972795:9886]
2025-10-02T08:12:44.844311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534383597972795:9886]
2025-10-02T08:12:44.844362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:44.844370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:44.844372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:44.844539Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:44.848973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:44.848997Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:44.853153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId: src_id|bb590c51-faeec612-2a149b94-a748cad4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:44.856190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:45.028579Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:45.028989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.029006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.029812Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:45.030142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:45.030200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb590c51-faeec612-2a149b94-a748cad4_0
2025-10-02T08:12:45.030385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1554 sessionId: src_id|bb590c51-faeec612-2a149b94-a748cad4_0 is DEAD
2025-10-02T08:12:45.030529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534383597972830:2513]
2025-10-02T08:12:45.030884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:45.036919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb590c51-faeec612-2a149b94-a748cad4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:45.036937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb590c51-faeec612-2a149b94-a748cad4_0] Write session will restart in 0.008881s
2025-10-02T08:12:45.036971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb590c51-faeec612-2a149b94-a748cad4_0] Write session: Do CDS request
2025-10-02T08:12:45.036979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb590c51-faeec612-2a149b94-a748cad4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:45.045626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:45.047834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:45.048195Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:45.048209Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:45.048223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:45.048286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:45.048331Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534387892940334:9869]
2025-10-02T08:12:45.049059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:45.049399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:45.049455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:45.049806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:45.049859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.049866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.049868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.049869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.049871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.049877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.049888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.049892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.049896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.049901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.049908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.049916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.049923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.049928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.049934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.049939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.049944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.049949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.049955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.049960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.049990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:45.057294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb590c51-faeec612-2a149b94-a748cad4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:45.061183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:45.061206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1555
2025-10-02T08:12:45.061413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:45.061443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:45.061450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:45.061454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:45.065401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1555 sessionId:  describe result for acl check
2025-10-02T08:12:45.065466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:45.065469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:45.065471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:45.065477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534387892940350:9871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:45.066073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534387892940350:9871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:45.081482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534387892940350:9871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:45.090474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534387892940350:9871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:45.090497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534387892940350:9871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:45.090501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534387892940350:9871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:45.090511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:45.126695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:45.129412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:45.129436Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:45.129439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:45.129442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:45.129449Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1554 [1:7556534387892940334:9869]
2025-10-02T08:12:45.129462Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:45.129484Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:45.129487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:45.129490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:45.129493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:45.129511Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:45.129516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:45.129523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:45.129605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.129610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.129613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:45.129615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:45.129693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:45.129695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.129711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.129723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:45.129742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534387892940327:9869]
2025-10-02T08:12:45.129744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534387892940327:9869]
2025-10-02T08:12:45.129752Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:45.129769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:45.129784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:45.129788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:45.129817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534387892940384:2513]
2025-10-02T08:12:45.129831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534387892940327:9869]
2025-10-02T08:12:45.129834Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:45.129873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:45.129876Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:45.129882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:45.130332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1554
2025-10-02T08:12:45.130350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534387892940379:9871], now have 1 active actors on pipe
2025-10-02T08:12:45.130354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534388352751780:2378], now have 1 active actors on pipe
2025-10-02T08:12:45.130467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.130476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.130491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534387892940384:2513], now have 1 active actors on pipe
2025-10-02T08:12:45.130509Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:45.130526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:45.130530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:45.130532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:45.130542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:45.130579Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1554
2025-10-02T08:12:45.130555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:45.130573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:45.130596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1554, pipe: [1:7556534387892940384:2513]
2025-10-02T08:12:45.132049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.132067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.132103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:45.132164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1555 partition: 0 MaxSeqNo: 17 sessionId: src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0
2025-10-02T08:12:45.136946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb590c51-faeec612-2a149b94-a748cad4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:45.140113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0] Write session: try to update token
2025-10-02T08:12:45.140156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:45.159406Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:45.159432Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:45.159434Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:45.159445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534387892940327:9869]
2025-10-02T08:12:45.159450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534387892940327:9869]
2025-10-02T08:12:45.159498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:45.159506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.159508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:45.159682Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:45.161036Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:45.161054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:45.180847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId: src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:45.184037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:45.386428Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:45.386755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.386767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.389136Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:45.389434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:45.389487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1555 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0
2025-10-02T08:12:45.389634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1555 sessionId: src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0 is DEAD
2025-10-02T08:12:45.389757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:45.389747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534387892940384:2513]
2025-10-02T08:12:45.390320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:45.390330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0] Write session will restart in 0.008402s
2025-10-02T08:12:45.390349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0] Write session: Do CDS request
2025-10-02T08:12:45.390356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:45.400334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:45.400965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:45.400983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1556
2025-10-02T08:12:45.401681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:45.401716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:45.401720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:45.401722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:45.402077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:45.402490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1556 sessionId:  describe result for acl check
2025-10-02T08:12:45.402525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:45.402531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:45.402533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:45.402538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534387892940624:9842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:45.403085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534387892940624:9842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:45.405206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:45.405478Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:45.405481Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:45.405489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:45.405532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:45.405577Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534387892940633:8944]
2025-10-02T08:12:45.406034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:45.406356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:45.406384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:45.406602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:45.406628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.406629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.406630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.406630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.406631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.406634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.406641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.406643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.406645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.406647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.406651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.406655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.406659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.406663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.406665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.406668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.406670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.406673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.406676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.406684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.406696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:45.409740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534387892940624:9842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:45.418987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:45.420682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:45.420690Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:45.420693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:45.420698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:45.420704Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1555 [1:7556534387892940633:8944]
2025-10-02T08:12:45.420719Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:45.420737Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:45.420741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:45.420745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:45.420747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:45.420764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:45.420769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:45.420775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:45.420862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.420864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.420867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:45.420871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:45.420936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:45.420938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.420953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.420965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:45.420983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534387892940616:8944]
2025-10-02T08:12:45.420985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534387892940616:8944]
2025-10-02T08:12:45.420996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:45.421010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:45.421024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:45.421027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:45.421062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534387892940616:8944]
2025-10-02T08:12:45.421064Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:45.421450Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:45.421462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:45.421468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:45.422307Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1555
2025-10-02T08:12:45.430154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534388352751801:2378], now have 1 active actors on pipe
2025-10-02T08:12:45.430538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534387892940624:9842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:45.430547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534387892940624:9842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:45.430551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534387892940624:9842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:45.430560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:45.431431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1555
2025-10-02T08:12:45.431445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534387892940680:9842], now have 1 active actors on pipe
2025-10-02T08:12:45.431514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.431522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.431549Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:45.431559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:45.431564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:45.431566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:45.431577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:45.431596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:45.431615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:45.431717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.431721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.431733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:45.431759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1556 partition: 0 MaxSeqNo: 17 sessionId: src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0
2025-10-02T08:12:45.432183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2422f05-f6d3956b-56eb592-45eb9f69_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:45.435006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0] Write session: try to update token
2025-10-02T08:12:45.435027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:45.472369Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:45.472393Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:45.472395Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:45.472404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534387892940616:8944]
2025-10-02T08:12:45.472408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534387892940616:8944]
2025-10-02T08:12:45.472453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:45.472461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.472463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:45.472628Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:45.476968Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:45.476975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:45.488831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId: src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:45.492239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:45.496689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534387892940702:2513]
2025-10-02T08:12:45.501673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1555, pipe: [1:7556534387892940702:2513]
2025-10-02T08:12:45.626515Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:45.626881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.626896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.626918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534387892940702:2513], now have 1 active actors on pipe
2025-10-02T08:12:45.628918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:45.628941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:45.629009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1556 reason: error at write: Disconnected sessionId: src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0
2025-10-02T08:12:45.629320Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:45.629252Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:45.629277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1556 sessionId: src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0 is DEAD
2025-10-02T08:12:45.629586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534387892940702:2513]
2025-10-02T08:12:45.637101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:45.637114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0] Write session will restart in 0.007627s
2025-10-02T08:12:45.637154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0] Write session: Do CDS request
2025-10-02T08:12:45.637162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:45.644486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:45.646477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:45.646685Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:45.646688Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:45.646699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:45.646750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:45.646785Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534387892940921:9828]
2025-10-02T08:12:45.647455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:45.647739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:45.647773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:45.648084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:45.648125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.648126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.648127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.648142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.648143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.648149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.648159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.648164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.648168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.648172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.648178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.648186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.648192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.648199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.648203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.648208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.648213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.648218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.648223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.648229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.648251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:45.649280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:45.649753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:45.649768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1557
2025-10-02T08:12:45.649938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:45.649967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:45.649972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:45.649975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:45.650433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1557 sessionId:  describe result for acl check
2025-10-02T08:12:45.650467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:45.650469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:45.650471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:45.650476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534387892940937:9825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:45.650958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534387892940937:9825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:45.659970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534387892940937:9825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:45.662185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:45.663867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:45.663886Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:45.663888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:45.663892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:45.663899Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1556 [1:7556534387892940921:9828]
2025-10-02T08:12:45.663910Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:45.663927Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:45.663932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:45.663935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:45.663938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:45.663952Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:45.663958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:45.663965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:45.663989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534387892940937:9825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:45.663997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534387892940937:9825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:45.664012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534387892940937:9825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:45.664022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:45.664028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.664030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.664034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:45.664037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:45.664177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:45.664180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.664193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.664206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:45.664226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534387892940914:9828]
2025-10-02T08:12:45.664228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534387892940914:9828]
2025-10-02T08:12:45.664234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:45.664247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:45.664261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:45.664264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:45.664294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534387892940914:9828]
2025-10-02T08:12:45.664296Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:45.664503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:45.664517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:45.664523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:45.665287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1556
2025-10-02T08:12:45.665826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46375c46-b24d630c-b12c6e59-cd69d9dc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:45.664981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534388352751830:2378], now have 1 active actors on pipe
2025-10-02T08:12:45.665137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534387892940968:9825], now have 1 active actors on pipe
2025-10-02T08:12:45.665140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1556
2025-10-02T08:12:45.665192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.665198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.665226Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:45.665234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:45.665239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:45.665242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:45.665253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:45.665265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:45.665290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:45.665337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.665339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.665360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:45.665387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1557 partition: 0 MaxSeqNo: 17 sessionId: src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0
2025-10-02T08:12:45.668797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0] Write session: try to update token
2025-10-02T08:12:45.668866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:45.690863Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:45.690889Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:45.690892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:45.690946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534387892940914:9828]
2025-10-02T08:12:45.690953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534387892940914:9828]
2025-10-02T08:12:45.691005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:45.691012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.691015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:45.691218Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:45.691283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId: src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:45.691420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:45.691429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:45.694255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:45.729661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534387892940984:2513]
2025-10-02T08:12:45.729929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1556, pipe: [1:7556534387892940984:2513]
2025-10-02T08:12:45.883977Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:45.884374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.884389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.884430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534387892940984:2513], now have 1 active actors on pipe
2025-10-02T08:12:45.884731Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:45.885093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:45.885157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1557 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0
2025-10-02T08:12:45.885286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534387892940984:2513]
2025-10-02T08:12:45.885331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1557 sessionId: src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0 is DEAD
2025-10-02T08:12:45.885511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:45.889007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:45.889022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0] Write session will restart in 0.009751s
2025-10-02T08:12:45.889048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0] Write session: Do CDS request
2025-10-02T08:12:45.889055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:45.900354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:45.900682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:45.900703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1558
2025-10-02T08:12:45.900903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:45.900938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:45.900952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:45.900960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:45.901873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1558 sessionId:  describe result for acl check
2025-10-02T08:12:45.901913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:45.901920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:45.901922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:45.901928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534387892941111:9812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:45.902599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534387892941111:9812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:45.907703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534387892941111:9812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:45.907862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:45.909810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:45.910040Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:45.910053Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:45.910063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:45.910114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:45.910156Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534387892941221:9816]
2025-10-02T08:12:45.910836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:45.911211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:45.911257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:45.911552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:45.911605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.911606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.911607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.911608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.911609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.911614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.911624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.911630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.911634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.911637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.911642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.911650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:45.911656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.911660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:45.911664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.911669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:45.911673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.911678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.911681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.911687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.911704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:45.925160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:45.926795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:45.926801Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:45.926805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:45.926808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:45.926815Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1557 [1:7556534387892941221:9816]
2025-10-02T08:12:45.926829Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:45.926847Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:45.926851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:45.926854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:45.926860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:45.926877Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:45.926882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:45.926889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:45.926951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.926953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.926956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:45.926958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:45.927030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:45.927035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.927049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:45.927061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:45.927080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534387892941210:9816]
2025-10-02T08:12:45.927084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534387892941210:9816]
2025-10-02T08:12:45.927091Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:45.927104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:45.927117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:45.927120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:45.927153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534387892941210:9816]
2025-10-02T08:12:45.927155Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:45.927391Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:45.927403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:45.927408Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:45.928303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534387892941111:9812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:45.928310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534387892941111:9812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:45.928313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534387892941111:9812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:45.928321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:45.928426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534388352751839:2378], now have 1 active actors on pipe
2025-10-02T08:12:45.929373Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1557
2025-10-02T08:12:45.929619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534387892941249:9812], now have 1 active actors on pipe
2025-10-02T08:12:45.929642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1557
2025-10-02T08:12:45.929714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.929722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.929747Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11b87723-23bf103c-361e8abb-a96bcf15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:45.929755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:45.929760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:45.929763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:45.929773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:45.929788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:45.929803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:45.929917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:45.929923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:45.929936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:45.929963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1558 partition: 0 MaxSeqNo: 17 sessionId: src_id|11b87723-23bf103c-361e8abb-a96bcf15_0
2025-10-02T08:12:45.930340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0a68fb-fa004d28-e9cf93f-88c7998b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|11b87723-23bf103c-361e8abb-a96bcf15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:45.933087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b87723-23bf103c-361e8abb-a96bcf15_0] Write session: try to update token
2025-10-02T08:12:45.933107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b87723-23bf103c-361e8abb-a96bcf15_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:45.955153Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:45.955174Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:45.955177Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:45.955186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534387892941210:9816]
2025-10-02T08:12:45.955190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534387892941210:9816]
2025-10-02T08:12:45.955228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:45.955235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:45.955238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:45.955373Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:45.957065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:45.957079Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:45.958949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId: src_id|11b87723-23bf103c-361e8abb-a96bcf15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:45.961744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:45.988878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534387892941258:2513]
2025-10-02T08:12:45.991128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1557, pipe: [1:7556534387892941258:2513]
2025-10-02T08:12:46.115435Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:46.115700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.115707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.115742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534387892941258:2513], now have 1 active actors on pipe
2025-10-02T08:12:46.116084Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:46.116318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534387892941258:2513]
2025-10-02T08:12:46.116330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:46.116371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1558 reason: status is not ok: tablet will be restarted right now sessionId: src_id|11b87723-23bf103c-361e8abb-a96bcf15_0
2025-10-02T08:12:46.116502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1558 sessionId: src_id|11b87723-23bf103c-361e8abb-a96bcf15_0 is DEAD
2025-10-02T08:12:46.116739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:46.117004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b87723-23bf103c-361e8abb-a96bcf15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:46.117015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b87723-23bf103c-361e8abb-a96bcf15_0] Write session will restart in 0.006577s
2025-10-02T08:12:46.117040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b87723-23bf103c-361e8abb-a96bcf15_0] Write session: Do CDS request
2025-10-02T08:12:46.117046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b87723-23bf103c-361e8abb-a96bcf15_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:46.124993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b87723-23bf103c-361e8abb-a96bcf15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:46.125535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:46.125555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1559
2025-10-02T08:12:46.126671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:46.126705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:46.126710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:46.126713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:46.127024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:46.127218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1559 sessionId:  describe result for acl check
2025-10-02T08:12:46.127257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:46.127262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:46.127265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:46.127270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534392187908763:9804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:46.127776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534392187908763:9804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:46.129133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:46.129347Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:46.129356Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:46.129368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:46.129426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:46.129470Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534392187908776:9803]
2025-10-02T08:12:46.130100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:46.130351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:46.130407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:46.130737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:46.130774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.130775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.130778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.130779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.130780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.130785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.130794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.130797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.130800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.130803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.130807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.130814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.130820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.130824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.130828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.130832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.130836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.130840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.130845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.130849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.130866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:46.132315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534392187908763:9804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:46.140650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534392187908763:9804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:46.140672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534392187908763:9804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:46.140677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534392187908763:9804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:46.140688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:46.142224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:46.144514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1558
2025-10-02T08:12:46.143923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:46.143941Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:46.143942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:46.143945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:46.143950Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1558 [1:7556534392187908776:9803]
2025-10-02T08:12:46.143959Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:46.143972Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:46.143974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:46.143976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:46.144729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b87723-23bf103c-361e8abb-a96bcf15_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:46.143978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:46.143992Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:46.143996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:46.144001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:46.144044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.144046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.144048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:46.144050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:46.144103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:46.144105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.144114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.144120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:46.144145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534392187908759:9803]
2025-10-02T08:12:46.144147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534392187908759:9803]
2025-10-02T08:12:46.144154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:46.144164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:46.144166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:46.144169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:46.144173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:46.144174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:46.144182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534392187908811:9804], now have 1 active actors on pipe
2025-10-02T08:12:46.144187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1558
2025-10-02T08:12:46.144225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534392647719144:2378], now have 1 active actors on pipe
2025-10-02T08:12:46.144228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534392187908759:9803]
2025-10-02T08:12:46.144236Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:46.144242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.144246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.144247Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:46.144288Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:46.144292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:46.144295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:46.144296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:46.144302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:46.144309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:46.144324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:46.144360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.144361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.144370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:46.144399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1559 partition: 0 MaxSeqNo: 17 sessionId: src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0
2025-10-02T08:12:46.147499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0] Write session: try to update token
2025-10-02T08:12:46.147515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:46.166281Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:46.166299Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:46.166302Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:46.166311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534392187908759:9803]
2025-10-02T08:12:46.166320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534392187908759:9803]
2025-10-02T08:12:46.166362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:46.166363Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:46.166368Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:46.166368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.166370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:46.166521Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:46.167565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId: src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:46.170432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:46.220909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534392187908825:2513]
2025-10-02T08:12:46.221174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1558, pipe: [1:7556534392187908825:2513]
2025-10-02T08:12:46.350609Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:46.350973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.350988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.351032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534392187908825:2513], now have 1 active actors on pipe
2025-10-02T08:12:46.351393Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:46.351717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534392187908825:2513]
2025-10-02T08:12:46.351735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:46.351789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1559 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0
2025-10-02T08:12:46.351960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1559 sessionId: src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0 is DEAD
2025-10-02T08:12:46.353147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:46.353158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0] Write session will restart in 0.006021s
2025-10-02T08:12:46.353183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0] Write session: Do CDS request
2025-10-02T08:12:46.353193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:46.353020Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:46.363856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:46.365330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:46.365349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1560
2025-10-02T08:12:46.365955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:46.365997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:46.366002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:46.366006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:46.366420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1560 sessionId:  describe result for acl check
2025-10-02T08:12:46.366448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:46.366449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:46.366451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:46.366456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534392187909036:9770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:46.366914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534392187909036:9770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:46.368082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:46.369309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:46.369493Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:46.369496Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:46.369506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:46.369549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:46.369583Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534392187909071:9778]
2025-10-02T08:12:46.370145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:46.370389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:46.370426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:46.370779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:46.370828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.370829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.370830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.370831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.370832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.370838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.370847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.370850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.370854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.370857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.370863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.370870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.370875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.370879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.370883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.370888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.370892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.370896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.370901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.370905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.370923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:46.371437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534392187909036:9770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:46.384467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534392187909036:9770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:46.384494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534392187909036:9770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:46.384497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534392187909036:9770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:46.384507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:46.394167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:46.395931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:46.395939Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:46.395942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:46.395946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:46.395954Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1559 [1:7556534392187909071:9778]
2025-10-02T08:12:46.395971Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:46.395992Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:46.395997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:46.396000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:46.396003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:46.396023Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:46.396028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:46.396036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:46.396117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.396118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.396122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:46.396124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:46.396255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:46.396257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.396272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.396286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:46.396303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534392187909052:9778]
2025-10-02T08:12:46.396307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534392187909052:9778]
2025-10-02T08:12:46.396323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:46.396337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:46.396351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:46.396353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:46.396393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534392187909052:9778]
2025-10-02T08:12:46.396395Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:46.396537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:46.396540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:46.396546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:46.396983Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1559
2025-10-02T08:12:46.397065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1559
2025-10-02T08:12:46.397091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534392187909098:9770], now have 1 active actors on pipe
2025-10-02T08:12:46.397095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534392647719162:2378], now have 1 active actors on pipe
2025-10-02T08:12:46.397182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.397187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.397221Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:46.397227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:46.397231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:46.397233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:46.397244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:46.397257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:46.397276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:46.397346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.397347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.397359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:46.397389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1560 partition: 0 MaxSeqNo: 17 sessionId: src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0
2025-10-02T08:12:46.404935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68ce3a4-31af1768-e0043a6f-3b11b5d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:46.408072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0] Write session: try to update token
2025-10-02T08:12:46.408094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:46.443916Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:46.443940Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:46.443943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:46.443952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534392187909052:9778]
2025-10-02T08:12:46.443957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534392187909052:9778]
2025-10-02T08:12:46.444001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:46.444014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.444017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:46.444422Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:46.444439Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:46.444582Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:46.449494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId: src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:46.452600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:46.452676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534392187909113:2513]
2025-10-02T08:12:46.452900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1559, pipe: [1:7556534392187909113:2513]
2025-10-02T08:12:46.611651Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:46.612089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.612104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.612126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534392187909113:2513], now have 1 active actors on pipe
2025-10-02T08:12:46.612989Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:46.613324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534392187909113:2513]
2025-10-02T08:12:46.613344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:46.613514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1560 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0
2025-10-02T08:12:46.613689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1560 sessionId: src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0 is DEAD
2025-10-02T08:12:46.613382Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:46.620930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:46.620951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0] Write session will restart in 0.005793s
2025-10-02T08:12:46.620990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0] Write session: Do CDS request
2025-10-02T08:12:46.621001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:46.628710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:46.629147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:46.629270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:46.629276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1561
2025-10-02T08:12:46.629602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:46.629887Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:46.629892Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:46.629903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:46.629957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:46.629992Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534392187909372:9741]
2025-10-02T08:12:46.630740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:46.630966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:46.631003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:46.631336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:46.631371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.631373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.631374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.631376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.631377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.631382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.631393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.631397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.631401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.631405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.631411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.631418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.631424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.631430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.631435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.631440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.631445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.631454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.631459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.631465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.631485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:46.632941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:46.632986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:46.632992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:46.632997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:46.634088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1561 sessionId:  describe result for acl check
2025-10-02T08:12:46.634134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:46.634136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:46.634137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:46.634143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534392187909387:9744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:46.634756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534392187909387:9744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:46.639084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534392187909387:9744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:46.646673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:46.648579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:46.648600Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:46.648604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:46.648608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:46.648616Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1560 [1:7556534392187909372:9741]
2025-10-02T08:12:46.648628Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:46.648647Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:46.648650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:46.648653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:46.648655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:46.648673Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:46.648677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:46.648684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:46.651928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1560
2025-10-02T08:12:46.648748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.648757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.648761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:46.648763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:46.649494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:46.649498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.649514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.649528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:46.649548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534392647719191:2378], now have 1 active actors on pipe
2025-10-02T08:12:46.649554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534392187909365:9741]
2025-10-02T08:12:46.649558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534392187909365:9741]
2025-10-02T08:12:46.649569Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:46.649584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:46.649598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:46.649601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:46.649648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534392187909365:9741]
2025-10-02T08:12:46.649650Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:46.649710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:46.649712Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:46.649718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:46.655053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534392187909387:9744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:46.655073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534392187909387:9744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:46.655080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534392187909387:9744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:46.655089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:46.655476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1560
2025-10-02T08:12:46.655487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534392187909424:9744], now have 1 active actors on pipe
2025-10-02T08:12:46.655587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.655597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.655629Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|859c0444-e1976d65-2d042354-6c92e5e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:46.655646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:46.655651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:46.655654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:46.655666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:46.655681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:46.655700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:46.655967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.655972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.655993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:46.656028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1561 partition: 0 MaxSeqNo: 17 sessionId: src_id|859c0444-e1976d65-2d042354-6c92e5e5_0
2025-10-02T08:12:46.660318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42c8311-410eeb20-3e856cf-1a3c62ab_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|859c0444-e1976d65-2d042354-6c92e5e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:46.663231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859c0444-e1976d65-2d042354-6c92e5e5_0] Write session: try to update token
2025-10-02T08:12:46.663257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859c0444-e1976d65-2d042354-6c92e5e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:46.694179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId: src_id|859c0444-e1976d65-2d042354-6c92e5e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:46.694484Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:46.694488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:46.694491Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:46.694500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534392187909365:9741]
2025-10-02T08:12:46.694505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534392187909365:9741]
2025-10-02T08:12:46.694557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:46.694565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.694568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:46.694728Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:46.696902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:46.696909Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:46.697444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:46.715003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534392187909433:2513]
2025-10-02T08:12:46.715271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1560, pipe: [1:7556534392187909433:2513]
2025-10-02T08:12:46.904592Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:46.904940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.904952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.904972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534392187909433:2513], now have 1 active actors on pipe
2025-10-02T08:12:46.905797Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:46.906087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:46.906139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1561 reason: status is not ok: tablet will be restarted right now sessionId: src_id|859c0444-e1976d65-2d042354-6c92e5e5_0
2025-10-02T08:12:46.906299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1561 sessionId: src_id|859c0444-e1976d65-2d042354-6c92e5e5_0 is DEAD
2025-10-02T08:12:46.906430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534392187909433:2513]
2025-10-02T08:12:46.909004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859c0444-e1976d65-2d042354-6c92e5e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:46.909016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859c0444-e1976d65-2d042354-6c92e5e5_0] Write session will restart in 0.005704s
2025-10-02T08:12:46.909042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859c0444-e1976d65-2d042354-6c92e5e5_0] Write session: Do CDS request
2025-10-02T08:12:46.909053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859c0444-e1976d65-2d042354-6c92e5e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:46.908875Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:46.916392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859c0444-e1976d65-2d042354-6c92e5e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:46.916710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:46.916730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1562
2025-10-02T08:12:46.916929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:46.916960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:46.916966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:46.916971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:46.917762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1562 sessionId:  describe result for acl check
2025-10-02T08:12:46.917807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:46.917814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:46.917816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:46.917822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534392187909479:9731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:46.918381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534392187909479:9731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:46.929778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534392187909479:9731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:46.931588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:46.943233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:46.943666Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:46.943671Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:46.943684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:46.943754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:46.943793Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534392187909685:9733]
2025-10-02T08:12:46.944488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:46.945398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534392187909479:9731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:46.945406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534392187909479:9731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:46.945410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534392187909479:9731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:46.945419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:46.945572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:46.945621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:46.946103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:46.946164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.946165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.946166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.946167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.946169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.946174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.946185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.946189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.946192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.946196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.946202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.946210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:46.946218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.946225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:46.946229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.946233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:46.946238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.946243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.946247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.946252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.946270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:46.966812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:46.968889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:46.968914Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:46.968917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:46.968921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:46.968928Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1561 [1:7556534392187909685:9733]
2025-10-02T08:12:46.968943Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:46.968966Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:46.968969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:46.968972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:46.968974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:46.968994Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:46.968999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:46.969007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:46.969092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.969095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.969098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:46.969101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:46.969174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:46.969177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.969193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:46.969206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:46.969223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534392187909674:9733]
2025-10-02T08:12:46.969225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534392187909674:9733]
2025-10-02T08:12:46.969240Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:46.969254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:46.969269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:46.969272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:46.969308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534392187909674:9733]
2025-10-02T08:12:46.969311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:46.969383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:46.969386Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:46.969391Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:46.970049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1561
2025-10-02T08:12:46.970066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534392187909694:9731], now have 1 active actors on pipe
2025-10-02T08:12:46.970071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534392647719200:2378], now have 1 active actors on pipe
2025-10-02T08:12:46.970268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1561
2025-10-02T08:12:46.970556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.970568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.970604Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:46.970612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:46.970618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:46.970620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:46.970632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:46.970647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:46.970668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:46.971429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859c0444-e1976d65-2d042354-6c92e5e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:46.974498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0] Write session: try to update token
2025-10-02T08:12:46.974519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:46.970775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:46.970781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:46.970796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:46.970830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1562 partition: 0 MaxSeqNo: 17 sessionId: src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0
2025-10-02T08:12:46.999493Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:46.999522Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:46.999526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:46.999534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534392187909674:9733]
2025-10-02T08:12:46.999539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534392187909674:9733]
2025-10-02T08:12:46.999588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:46.999597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:46.999600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:46.999765Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:47.000948Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:47.000956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:47.007549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534396482877012:2513]
2025-10-02T08:12:47.009035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1561, pipe: [1:7556534396482877012:2513]
2025-10-02T08:12:47.010363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId: src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:47.013448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:47.178562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:47.176914Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:47.177442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534396482877012:2513], now have 1 active actors on pipe
2025-10-02T08:12:47.177453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.177460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.178861Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:47.179169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534396482877012:2513]
2025-10-02T08:12:47.179207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:47.179259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1562 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0
2025-10-02T08:12:47.179455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1562 sessionId: src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0 is DEAD
2025-10-02T08:12:47.179791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:47.179803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0] Write session will restart in 0.006141s
2025-10-02T08:12:47.179828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0] Write session: Do CDS request
2025-10-02T08:12:47.179834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:47.188398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:47.189298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:47.189316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1563
2025-10-02T08:12:47.189442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:47.189472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:47.189478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:47.189481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:47.193656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1563 sessionId:  describe result for acl check
2025-10-02T08:12:47.193705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:47.193706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:47.193709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:47.193715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534396482877049:9719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:47.194276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534396482877049:9719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:47.205881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:47.210558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:47.210852Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:47.210858Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:47.210871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:47.210942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:47.210987Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534396482877251:9722]
2025-10-02T08:12:47.211694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:47.213049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534396482877049:9719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:47.213176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:47.213230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:47.213788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:47.213867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.213871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.213873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.213874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.213876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.213882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.213894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.213899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.213904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.213908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.213915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.213925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.213932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.213937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.213945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.213951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.213956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.213963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.213968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.213973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.213994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:47.236631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:47.238639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:47.238647Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:47.238650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:47.238655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:47.238662Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1562 [1:7556534396482877251:9722]
2025-10-02T08:12:47.238678Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:47.238698Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:47.238702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:47.238706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:47.238708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:47.238731Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:47.238738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:47.238745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:47.238824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.238828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.238832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:47.238835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:47.238915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:47.238918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.238932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.238943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:47.238963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534396482877244:9722]
2025-10-02T08:12:47.238965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534396482877244:9722]
2025-10-02T08:12:47.238980Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:47.238996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:47.239011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:47.239013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:47.239057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534396482877244:9722]
2025-10-02T08:12:47.239061Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:47.239360Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:47.239374Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:47.239381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:47.240226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1562
2025-10-02T08:12:47.240731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534396482877049:9719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:47.240748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534396482877049:9719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:47.240752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534396482877049:9719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:47.240762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:47.241251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534396942686505:2378], now have 1 active actors on pipe
2025-10-02T08:12:47.241701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1562
2025-10-02T08:12:47.241714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534396482877283:9719], now have 1 active actors on pipe
2025-10-02T08:12:47.241786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.241794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.241820Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:47.241831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:47.241837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:47.241839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:47.241851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:47.241867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:47.241886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:47.242485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ae30dc-f8faef6e-e76ae670-9ea95db6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:47.245753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0] Write session: try to update token
2025-10-02T08:12:47.245776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:47.241998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.242003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.242018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:47.242048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1563 partition: 0 MaxSeqNo: 17 sessionId: src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0
2025-10-02T08:12:47.275990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534396482877292:2513]
2025-10-02T08:12:47.281008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1562, pipe: [1:7556534396482877292:2513]
2025-10-02T08:12:47.281039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534396482877292:2513], now have 1 active actors on pipe
2025-10-02T08:12:47.282033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId: src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:47.285124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:47.285361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.285377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.285413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:47.285432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:47.285584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.285589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.285765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.285831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.285903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.285974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.286018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.286023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.286099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.286165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.286236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.286313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.286385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.286389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.286484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.286567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.286635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.286697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.286742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.286744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.286812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.286880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.286947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.287012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.287059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.287063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.287137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.287200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.287267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.287336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.287405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.287407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.287482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.287543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.287608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.287676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.287722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.287723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.287796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.287860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.287933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.288000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.288048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.288049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.288122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.288204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.288271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.288338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.288401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.288403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.288475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.288529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.288588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.288650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.288695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.288697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.289318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:47.289405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:47.289475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:47.289554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:47.289616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:47.289619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:47.289679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:47.289744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:47.289762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:47.289765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:47.289796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:47.289808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:47.289811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:47.289814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:47.289817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:47.290286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:47.290318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:47.290325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:47.290329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:47.290333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:47.290336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:47.291078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:47.291093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:47.291103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:47.291108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:47.291112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:47.291115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:47.291641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:47.291654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:47.291672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:47.291676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:47.291680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:47.301163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:47.301197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:47.301216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392767300
2025-10-02T08:12:47.301361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:47.301374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:47.301381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:47.301386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:47.301391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:47.301395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:47.302005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:47.302021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:47.302028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:47.302034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:47.302038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:47.302042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:47.302561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:47.302591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:47.302598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:47.302602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:47.302606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:47.302612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:47.303275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:47.303308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:47.303322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:47.304680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:47.304702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:47.304708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:47.304712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:47.304722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392767304
2025-10-02T08:12:47.305099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:47.305132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:47.305138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:47.305142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:47.305146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:47.305149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:47.305732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:47.305758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:47.305766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:47.305770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:47.305777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:47.305781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:47.306317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:47.306341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:47.306450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392767306
2025-10-02T08:12:47.309062Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:47.309093Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:47.309099Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:47.309105Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:47.309118Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:47.309120Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:47.309123Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:47.309133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534396482877244:9722]
2025-10-02T08:12:47.309139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534396482877244:9722]
2025-10-02T08:12:47.311460Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:47.311469Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:47.314622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:47.314651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.314654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:47.314822Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:47.464043Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:47.464441Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:47.464449Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:47.464459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534396482877244:9722]
2025-10-02T08:12:47.464512Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:47.464715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:47.464730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:47.464762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1563 reason: error at write: Disconnected sessionId: src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0
2025-10-02T08:12:47.464762Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:47.464923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:47.465000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1563 sessionId: src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0 is DEAD
2025-10-02T08:12:47.465084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534396482877292:2513]
2025-10-02T08:12:47.465353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:47.465366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0] Write session will restart in 0.007553s
2025-10-02T08:12:47.465385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0] Write session: Do CDS request
2025-10-02T08:12:47.465391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:47.470779Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [fff7b34bf95a1da5] Result# TEvPutResult {Id# [72075186224037892:1562:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:47.470835Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1562:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:47.470990Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1562:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:47.474290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:47.474390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:47.474409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1564
2025-10-02T08:12:47.474547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:47.474574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:47.474579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:47.474583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:47.475412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1564 sessionId:  describe result for acl check
2025-10-02T08:12:47.475449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:47.475456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:47.475458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:47.475464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534396482877436:9685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:47.475985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534396482877436:9685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:47.482816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534396482877436:9685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:47.483782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:47.487369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:47.487608Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:47.487621Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:47.487632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:47.487687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:47.487732Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534396482877563:9688]
2025-10-02T08:12:47.488227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534396482877436:9685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:47.488248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534396482877436:9685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:47.488252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534396482877436:9685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:47.488262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:47.488390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:47.488699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:47.488760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:47.489291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:47.489357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.489359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.489360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.489362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.489364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.489369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.489380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.489384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.489388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.489392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.489397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.489405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.489411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.489417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.489422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.489430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.489434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.489440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.489446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.489451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.489472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:47.499503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:47.501653Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1563
2025-10-02T08:12:47.501034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:47.501055Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:47.501059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:47.501064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:47.501072Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1563 [1:7556534396482877563:9688]
2025-10-02T08:12:47.501087Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:47.501107Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:47.501109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:47.501112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:47.501114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:47.501128Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:47.501132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:47.501138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:47.501202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.501204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.501208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:47.501211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:47.501282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:47.501285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.501300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.501312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:47.501332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534396482877549:9688]
2025-10-02T08:12:47.501333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534396482877549:9688]
2025-10-02T08:12:47.501341Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:47.501354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:47.501370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:47.501373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:47.501400Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:47.501404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:47.501415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534396482877568:9685], now have 1 active actors on pipe
2025-10-02T08:12:47.501419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534396482877549:9688]
2025-10-02T08:12:47.501422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:47.501438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534396942686525:2378], now have 1 active actors on pipe
2025-10-02T08:12:47.501474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1563
2025-10-02T08:12:47.501576Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:47.501759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.501763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.501789Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:47.501794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:47.501798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:47.501802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:47.501813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:47.501824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:47.501838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:47.501971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.501983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.501996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:47.502029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1564 partition: 0 MaxSeqNo: 17 sessionId: src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0
2025-10-02T08:12:47.502528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624cb58d-c6c7e338-b0e3a8c9-a840f2ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:47.505400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0] Write session: try to update token
2025-10-02T08:12:47.505418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:47.523264Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:47.523291Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:47.523294Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:47.523304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534396482877549:9688]
2025-10-02T08:12:47.523307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534396482877549:9688]
2025-10-02T08:12:47.523354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:47.523366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.523368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:47.523514Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:47.525031Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:47.525050Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:47.527028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId: src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:47.530026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:47.565555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534396482877606:2513]
2025-10-02T08:12:47.619153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1563, pipe: [1:7556534396482877606:2513]
2025-10-02T08:12:47.679868Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:47.680375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.680386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.680440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534396482877606:2513], now have 1 active actors on pipe
2025-10-02T08:12:47.680822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534396482877606:2513]
2025-10-02T08:12:47.680848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:47.680851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:47.680874Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:47.680921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1564 reason: error at write: Disconnected sessionId: src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0
2025-10-02T08:12:47.681113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1564 sessionId: src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0 is DEAD
2025-10-02T08:12:47.682033Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:47.684903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:47.684915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0] Write session will restart in 0.005140s
2025-10-02T08:12:47.684942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0] Write session: Do CDS request
2025-10-02T08:12:47.684948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:47.696368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:47.697108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:47.697125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1565
2025-10-02T08:12:47.697543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:47.697570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:47.697573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:47.697577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:47.698055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1565 sessionId:  describe result for acl check
2025-10-02T08:12:47.698075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:47.698076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:47.698077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:47.698081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534396482877767:9640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:47.698499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534396482877767:9640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:47.703588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:47.705279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534396482877767:9640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:47.705926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:47.706093Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:47.706096Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:47.706108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:47.706155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:47.706189Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534396482877881:9641]
2025-10-02T08:12:47.706639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:47.706907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:47.706962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:47.707278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:47.707333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.707334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.707335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.707336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.707337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.707343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.707352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.707356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.707360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.707363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.707369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.707377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:47.707383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.707389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:47.707393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.707399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:47.707404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.707409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.707413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.707418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.707436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:47.716587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534396482877767:9640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:47.716609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534396482877767:9640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:47.716616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534396482877767:9640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:47.716625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:47.717849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:47.719598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:47.719615Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:47.719619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:47.719623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:47.719629Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1564 [1:7556534396482877881:9641]
2025-10-02T08:12:47.719642Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:47.719661Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:47.719665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:47.719669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:47.719671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:47.719689Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:47.719694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:47.719701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:47.719776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.719786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.719790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:47.719793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:47.719874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:47.719882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.719898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:47.719918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:47.719940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534396482877870:9641]
2025-10-02T08:12:47.719942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534396482877870:9641]
2025-10-02T08:12:47.719958Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:47.719971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:47.719986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:47.719992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:47.720033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534396482877870:9641]
2025-10-02T08:12:47.720035Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:47.720036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:47.720041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:47.720048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:47.720129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1564
2025-10-02T08:12:47.720163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534396482877904:9640], now have 1 active actors on pipe
2025-10-02T08:12:47.720290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.720303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.720319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534396942686556:2378], now have 1 active actors on pipe
2025-10-02T08:12:47.720336Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:47.720345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:47.720349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:47.720351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:47.720365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:47.720385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:47.720403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:47.720508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.720533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.720549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:47.720588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1565 partition: 0 MaxSeqNo: 17 sessionId: src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0
2025-10-02T08:12:47.723740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1e2d4f4-7635b46e-90cb8c47-33bf7dcb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:47.720960Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1564
2025-10-02T08:12:47.726773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0] Write session: try to update token
2025-10-02T08:12:47.726791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:47.755665Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:47.755692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:47.755695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:47.755705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534396482877870:9641]
2025-10-02T08:12:47.755714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534396482877870:9641]
2025-10-02T08:12:47.755766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:47.755774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:47.755773Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:47.755776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:47.755779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:47.755938Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:47.763487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId: src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:47.766547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:47.781086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534396482877918:2513]
2025-10-02T08:12:47.781395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1564, pipe: [1:7556534396482877918:2513]
2025-10-02T08:12:47.959842Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:47.960191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:47.960200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:47.960241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534396482877918:2513], now have 1 active actors on pipe
2025-10-02T08:12:47.961170Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:47.961484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:47.961550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1565 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0
2025-10-02T08:12:47.961716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1565 sessionId: src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0 is DEAD
2025-10-02T08:12:47.961853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534396482877918:2513]
2025-10-02T08:12:47.962122Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:47.964890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:47.964901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0] Write session will restart in 0.008951s
2025-10-02T08:12:47.964930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0] Write session: Do CDS request
2025-10-02T08:12:47.964937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:47.977805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:47.978102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:47.978121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1566
2025-10-02T08:12:47.978296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:47.978319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:47.978324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:47.978327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:47.978710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1566 sessionId:  describe result for acl check
2025-10-02T08:12:47.978745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:47.978747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:47.978749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:47.978754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534396482877951:9620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:47.979296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534396482877951:9620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:47.992980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534396482877951:9620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:47.998805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:48.005031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:48.005284Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:48.005288Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:48.005298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:48.005358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:48.005392Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534400777845473:9619]
2025-10-02T08:12:48.005998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:48.006424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534396482877951:9620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:48.006439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534396482877951:9620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:48.006443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534396482877951:9620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:48.006452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:48.006576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:48.006614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:48.006925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:48.006960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.006961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.006962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.006963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.006964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.006968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.006978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.006982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.006985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.006988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.006994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.007001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.007007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.007012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.007016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.007021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.007026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.007033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.007037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.007042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.007060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:48.017605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:48.019542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:48.019569Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:48.019571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:48.019575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:48.019582Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1565 [1:7556534400777845473:9619]
2025-10-02T08:12:48.019595Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:48.019614Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:48.019623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:48.019626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:48.019628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:48.019662Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:48.019672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:48.019679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:48.019755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.019763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.019766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:48.019769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:48.019838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:48.019846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.019862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.019879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:48.019901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534396482878162:9619]
2025-10-02T08:12:48.019907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534396482878162:9619]
2025-10-02T08:12:48.019915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:48.019922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1565
2025-10-02T08:12:48.019928Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:48.019931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534400777845482:9620], now have 1 active actors on pipe
2025-10-02T08:12:48.019932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:48.019937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534396942686564:2378], now have 1 active actors on pipe
2025-10-02T08:12:48.019943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:48.019956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:48.019963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:48.019970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.019975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.020024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534396482878162:9619]
2025-10-02T08:12:48.020034Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:48.020041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:48.020051Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:48.020057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:48.020066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:48.020068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:48.020078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:48.020092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:48.020149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:48.020251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.020268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.020295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:48.020351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1566 partition: 0 MaxSeqNo: 17 sessionId: src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0
2025-10-02T08:12:48.020739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd71eaf5-ec20bd61-b61a67d2-6efc1aae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:48.020890Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1565
2025-10-02T08:12:48.024085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0] Write session: try to update token
2025-10-02T08:12:48.024106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:48.049865Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:48.049893Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:48.049895Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:48.049905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534396482878162:9619]
2025-10-02T08:12:48.049910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534396482878162:9619]
2025-10-02T08:12:48.049962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:48.049971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.049974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:48.050156Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:48.050606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId: src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:48.050606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:48.050612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:48.053692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:48.062852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534400777845503:2513]
2025-10-02T08:12:48.062967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1565, pipe: [1:7556534400777845503:2513]
2025-10-02T08:12:48.129854Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:12:48.129884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-02T08:12:48.208179Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:48.208485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.208495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.208537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534400777845503:2513], now have 1 active actors on pipe
2025-10-02T08:12:48.209310Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:48.209332Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-02T08:12:48.209550Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:48.209924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534400777845503:2513]
2025-10-02T08:12:48.209942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:48.210001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1566 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0
2025-10-02T08:12:48.210171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1566 sessionId: src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0 is DEAD
2025-10-02T08:12:48.212943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:48.212969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0] Write session will restart in 0.007171s
2025-10-02T08:12:48.213000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0] Write session: Do CDS request
2025-10-02T08:12:48.213010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:48.224166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:48.225195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:48.225216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1567
2025-10-02T08:12:48.225489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:48.225526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:48.225534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:48.225537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:48.229168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1567 sessionId:  describe result for acl check
2025-10-02T08:12:48.229216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:48.229217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:48.229218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:48.229224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534400777845665:9588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:48.229831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534400777845665:9588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:48.233537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:48.235706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:48.235851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534400777845665:9588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:48.235905Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:48.235909Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:48.235920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:48.235968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:48.236002Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534400777845752:9591]
2025-10-02T08:12:48.236743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:48.237090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:48.237132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:48.237420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:48.237459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.237460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.237461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.237462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.237464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.237469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.237478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.237481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.237484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.237487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.237492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.237499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.237504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.237509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.237512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.237516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.237520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.237524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.237528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.237532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.237547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:48.248457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534400777845665:9588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:48.248478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534400777845665:9588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:48.248482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534400777845665:9588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:48.248491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:48.249632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:48.251441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:48.251447Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:48.251450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:48.251455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:48.251462Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1566 [1:7556534400777845752:9591]
2025-10-02T08:12:48.251474Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:48.251493Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:48.251496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:48.251499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:48.251501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:48.251520Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:48.251526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:48.251532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:48.251600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.251602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.251605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:48.251607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:48.251666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:48.251669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.251683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.251693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:48.251711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534400777845746:9591]
2025-10-02T08:12:48.251714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534400777845746:9591]
2025-10-02T08:12:48.251722Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:48.251737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:48.251749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:48.251751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:48.251783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534400777845746:9591]
2025-10-02T08:12:48.251785Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:48.252857Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1566
2025-10-02T08:12:48.252089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:48.252099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:48.252104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:48.252936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534401237653870:2378], now have 1 active actors on pipe
2025-10-02T08:12:48.254537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1566
2025-10-02T08:12:48.254558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534400777845778:9588], now have 1 active actors on pipe
2025-10-02T08:12:48.254646Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:12:48.257308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.257330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.257365Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:48.257375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:48.257380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:48.257383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:48.257397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:48.257414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:48.257433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:48.257532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.257508Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 14 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:12:48.257561Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:12:48.257539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.257553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:48.257586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1567 partition: 0 MaxSeqNo: 17 sessionId: src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0
2025-10-02T08:12:48.264777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f4e2de-713ad133-6206bf29-b005c9fc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:48.268726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0] Write session: try to update token
2025-10-02T08:12:48.268762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:48.277450Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:48.277478Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:48.277481Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:48.277490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534400777845746:9591]
2025-10-02T08:12:48.277497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534400777845746:9591]
2025-10-02T08:12:48.277545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:48.277553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.277556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:48.277706Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:48.278475Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:48.278482Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:48.309588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534400777845797:2513]
2025-10-02T08:12:48.309748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1566, pipe: [1:7556534400777845797:2513]
2025-10-02T08:12:48.318866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId: src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:48.321702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:48.483096Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:48.483640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534400777845797:2513], now have 1 active actors on pipe
2025-10-02T08:12:48.483650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.483657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.484076Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:48.484470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:48.484549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1567 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0
2025-10-02T08:12:48.484739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1567 sessionId: src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0 is DEAD
2025-10-02T08:12:48.484881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534400777845797:2513]
2025-10-02T08:12:48.485147Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:48.488971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:48.488991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0] Write session will restart in 0.008489s
2025-10-02T08:12:48.489026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0] Write session: Do CDS request
2025-10-02T08:12:48.489034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:48.498339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:48.499201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:48.499223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1568
2025-10-02T08:12:48.499340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:48.499372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:48.499382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:48.499385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:48.499746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1568 sessionId:  describe result for acl check
2025-10-02T08:12:48.499783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:48.499785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:48.499787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:48.499792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534400777845854:9560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:48.500457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534400777845854:9560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:48.508972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:48.509413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:48.509656Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:48.509661Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:48.509673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:48.509735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:48.509775Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534400777846062:9573]
2025-10-02T08:12:48.510323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534400777845854:9560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:48.510455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:48.510969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:48.511027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:48.511540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:48.511601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.511602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.511603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.511605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.511606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.511611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.511621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.511625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.511629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.511632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.511638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.511645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.511651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.511656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.511661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.511665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.511670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.511676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.511681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.511685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.511718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:48.525759Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1567
2025-10-02T08:12:48.522726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534400777845854:9560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:48.522748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534400777845854:9560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:48.522752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534400777845854:9560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:48.522761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:48.522926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:48.524513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:48.524518Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:48.524524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:48.524528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:48.524534Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1567 [1:7556534400777846062:9573]
2025-10-02T08:12:48.524545Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:48.524562Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:48.524565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:48.524568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:48.524569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:48.524584Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:48.524589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:48.524594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:48.524655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.524657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.524659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:48.524662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:48.524729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:48.524732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.524745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.524757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:48.524773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534400777846052:9573]
2025-10-02T08:12:48.524775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534400777846052:9573]
2025-10-02T08:12:48.524790Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:48.524819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:48.524832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:48.524835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:48.524866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534400777846052:9573]
2025-10-02T08:12:48.524868Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:48.524876Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:48.524879Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:48.524885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:48.525386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1567
2025-10-02T08:12:48.525399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534400777846088:9560], now have 1 active actors on pipe
2025-10-02T08:12:48.525403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534401237653892:2378], now have 1 active actors on pipe
2025-10-02T08:12:48.525408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.525414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.525442Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:48.525450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:48.525454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:48.525456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:48.525467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:48.525477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:48.525493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:48.525600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.525606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.525629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:48.525676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1568 partition: 0 MaxSeqNo: 17 sessionId: src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0
2025-10-02T08:12:48.528959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5836f40-f7723ed8-6cddccc2-42d26fc1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:48.532952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0] Write session: try to update token
2025-10-02T08:12:48.532982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:48.542579Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:48.542607Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:48.542617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534400777846052:9573]
2025-10-02T08:12:48.542662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:48.542846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:48.543000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:48.543141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:48.543283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:48.543475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:48.543523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:48.544592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:48.574981Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:48.575005Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:48.575009Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:48.575019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534400777846052:9573]
2025-10-02T08:12:48.575029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534400777846052:9573]
2025-10-02T08:12:48.575075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:48.575087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.575087Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:48.575090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:48.575091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:48.575251Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:48.581442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534400777846102:2513]
2025-10-02T08:12:48.582899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1567, pipe: [1:7556534400777846102:2513]
2025-10-02T08:12:48.623753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId: src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:48.626544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:48.732467Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:48.732946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534400777846102:2513], now have 1 active actors on pipe
2025-10-02T08:12:48.732970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.732977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.733907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:48.733919Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:48.734217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534400777846102:2513]
2025-10-02T08:12:48.734245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:48.734297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1568 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0
2025-10-02T08:12:48.734482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1568 sessionId: src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0 is DEAD
2025-10-02T08:12:48.736379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:48.736396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0] Write session will restart in 0.007745s
2025-10-02T08:12:48.736429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0] Write session: Do CDS request
2025-10-02T08:12:48.736436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:48.745453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:48.746214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:48.746238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1569
2025-10-02T08:12:48.746500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:48.746530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:48.746535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:48.746539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:48.747075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1569 sessionId:  describe result for acl check
2025-10-02T08:12:48.747110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:48.747112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:48.747114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:48.747120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534400777846324:9528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:48.747625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534400777846324:9528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:48.752823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534400777846324:9528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:48.755948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:48.758660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:48.758875Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:48.758879Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:48.758888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:48.758941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:48.758980Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534400777846403:9526]
2025-10-02T08:12:48.760009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534400777846324:9528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:48.760027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534400777846324:9528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:48.760030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534400777846324:9528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:48.760040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:48.760833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:48.761107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:48.761186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:48.761558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:48.761609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.761616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.761618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.761619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.761620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.761626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.761638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.761642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.761645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.761649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.761655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.761662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:48.761669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.761675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:48.761680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.761685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:48.761690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.761696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.761701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.761707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.761729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:48.779118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:48.780943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:48.780962Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:48.780969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:48.780972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:48.780982Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1568 [1:7556534400777846403:9526]
2025-10-02T08:12:48.780993Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:48.781010Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:48.781014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:48.781018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:48.781020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:48.781038Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:48.781048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:48.781054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:48.781119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.781126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.781130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:48.781132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:48.781198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:48.781205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.781219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:48.781231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:48.781250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534400777846408:9528], now have 1 active actors on pipe
2025-10-02T08:12:48.781253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534401237653923:2378], now have 1 active actors on pipe
2025-10-02T08:12:48.781253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1568
2025-10-02T08:12:48.781258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534400777846391:9526]
2025-10-02T08:12:48.781260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534400777846391:9526]
2025-10-02T08:12:48.781267Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:48.781278Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:48.781281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:48.781281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:48.781295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:48.781298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:48.781306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.781310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.781348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534400777846391:9526]
2025-10-02T08:12:48.781351Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:48.781367Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:48.781379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:48.781382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:48.781384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:48.781393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:48.781401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:48.781425Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:48.781436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:48.781529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.781540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.781556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:48.781599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1569 partition: 0 MaxSeqNo: 17 sessionId: src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0
2025-10-02T08:12:48.782209Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1568
2025-10-02T08:12:48.789065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921a4a0-d5b5faa4-e2dcf97f-4a03f07a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:48.791931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0] Write session: try to update token
2025-10-02T08:12:48.791952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:48.825149Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:48.825174Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:48.825176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:48.825186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534400777846391:9526]
2025-10-02T08:12:48.825191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534400777846391:9526]
2025-10-02T08:12:48.825232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:48.825239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:48.825241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:48.825465Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:48.826829Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:48.826848Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:48.833911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534400777846434:2513]
2025-10-02T08:12:48.834145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1568, pipe: [1:7556534400777846434:2513]
2025-10-02T08:12:48.837748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId: src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:48.845613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:48.982604Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:48.982934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534400777846434:2513], now have 1 active actors on pipe
2025-10-02T08:12:48.982944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:48.982951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:48.986541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:48.986555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0] Write session will restart in 0.008959s
2025-10-02T08:12:48.986580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0] Write session: Do CDS request
2025-10-02T08:12:48.986586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:48.985547Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:48.985924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534400777846434:2513]
2025-10-02T08:12:48.985945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:48.986001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1569 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0
2025-10-02T08:12:48.986181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1569 sessionId: src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0 is DEAD
2025-10-02T08:12:48.987880Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:48.996348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:49.000880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:49.000899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1570
2025-10-02T08:12:49.001321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:49.001362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:49.001368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:49.001372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:49.002051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1570 sessionId:  describe result for acl check
2025-10-02T08:12:49.002091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:49.002093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:49.002095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:49.002101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534405072813766:9508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:49.002637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534405072813766:9508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:49.022192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534405072813766:9508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:49.023140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:49.029327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:49.029596Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:49.029601Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:49.029611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:49.029668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:49.029704Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534405072813994:9510]
2025-10-02T08:12:49.030390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:49.030822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:49.030876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:49.031229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:49.031276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.031277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.031278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.031280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.031281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.031287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.031299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.031303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.031308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.031312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.031318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.031326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.031332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.031338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.031343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.031349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.031354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.031361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.031366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.031371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.031391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:49.034621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534405072813766:9508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:49.034641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534405072813766:9508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:49.034645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534405072813766:9508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:49.034655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:49.043180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:49.045066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:49.045073Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:49.045076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:49.045079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:49.045086Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1569 [1:7556534405072813994:9510]
2025-10-02T08:12:49.045097Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:49.045116Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:49.045120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.045122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.045124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.045144Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:49.045149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:49.045156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:49.045226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.045227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.045230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:49.045233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:49.045306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:49.045309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.045323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.045333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:49.045350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534405072813982:9510]
2025-10-02T08:12:49.045352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534405072813982:9510]
2025-10-02T08:12:49.045360Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:49.045372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:49.045387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:49.045389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:49.045421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:49.045426Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:49.045431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534405072814010:9508], now have 1 active actors on pipe
2025-10-02T08:12:49.045433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534405072813982:9510]
2025-10-02T08:12:49.045436Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:49.045451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534401237653931:2378], now have 1 active actors on pipe
2025-10-02T08:12:49.045595Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:49.045761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1569
2025-10-02T08:12:49.045956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.045972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.046000Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|853574e2-4d9d8cd7-874727c6-1e517294_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:49.046008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.046013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.046015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:49.046027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.046040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:49.046056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:49.046091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.046093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.046105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:49.046136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1570 partition: 0 MaxSeqNo: 17 sessionId: src_id|853574e2-4d9d8cd7-874727c6-1e517294_0
2025-10-02T08:12:49.046368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1569
2025-10-02T08:12:49.048955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18d0e2ab-aff45a4e-8c9ef73f-4906eecd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|853574e2-4d9d8cd7-874727c6-1e517294_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:49.053688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|853574e2-4d9d8cd7-874727c6-1e517294_0] Write session: try to update token
2025-10-02T08:12:49.053709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|853574e2-4d9d8cd7-874727c6-1e517294_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:49.075579Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:49.075602Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:49.075612Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:49.075621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534405072813982:9510]
2025-10-02T08:12:49.075625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534405072813982:9510]
2025-10-02T08:12:49.075679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:49.075686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.075691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:49.075691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:49.075698Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:49.075864Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:49.084153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId: src_id|853574e2-4d9d8cd7-874727c6-1e517294_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:49.087094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:49.087168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534405072814024:2513]
2025-10-02T08:12:49.087644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1569, pipe: [1:7556534405072814024:2513]
2025-10-02T08:12:49.230218Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:49.230844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.230856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.230880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534405072814024:2513], now have 1 active actors on pipe
2025-10-02T08:12:49.231858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|853574e2-4d9d8cd7-874727c6-1e517294_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:49.231870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|853574e2-4d9d8cd7-874727c6-1e517294_0] Write session will restart in 0.009262s
2025-10-02T08:12:49.231171Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:49.231914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|853574e2-4d9d8cd7-874727c6-1e517294_0] Write session: Do CDS request
2025-10-02T08:12:49.231489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:49.231540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1570 reason: status is not ok: tablet will be restarted right now sessionId: src_id|853574e2-4d9d8cd7-874727c6-1e517294_0
2025-10-02T08:12:49.231921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|853574e2-4d9d8cd7-874727c6-1e517294_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:49.231703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1570 sessionId: src_id|853574e2-4d9d8cd7-874727c6-1e517294_0 is DEAD
2025-10-02T08:12:49.231949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534405072814024:2513]
2025-10-02T08:12:49.233057Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:49.244673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|853574e2-4d9d8cd7-874727c6-1e517294_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:49.249232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:49.249261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1571
2025-10-02T08:12:49.249480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:49.249520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:49.249527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:49.249531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:49.252326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1571 sessionId:  describe result for acl check
2025-10-02T08:12:49.252377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:49.252379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:49.252380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:49.252386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534405072814185:9491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:49.252983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534405072814185:9491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:49.258493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534405072814185:9491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:49.258558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:49.260252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:49.260501Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:49.260505Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:49.260517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:49.260570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:49.260606Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534405072814288:9496]
2025-10-02T08:12:49.261364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:49.262530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:49.262594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:49.263007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:49.263052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.263053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.263054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.263055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.263057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.263062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.263071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.263078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.263082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.263085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.263090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.263097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.263103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.263107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.263112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.263116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.263120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.263125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.263129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.263133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.263153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:49.263528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534405072814185:9491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:49.263535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534405072814185:9491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:49.263538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534405072814185:9491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:49.263547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:49.279238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:49.281778Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1570
2025-10-02T08:12:49.282622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|853574e2-4d9d8cd7-874727c6-1e517294_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:49.281130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:49.281154Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:49.281157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:49.281162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:49.281170Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1570 [1:7556534405072814288:9496]
2025-10-02T08:12:49.281182Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:49.281202Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:49.281205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.281208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.281210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.281233Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:49.281237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:49.281244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:49.281312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.281315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.281317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:49.281320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:49.281389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:49.281392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.281408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.281422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:49.281437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534405072814270:9496]
2025-10-02T08:12:49.281439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534405072814270:9496]
2025-10-02T08:12:49.281447Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:49.281460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:49.281477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:49.281480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:49.281490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534405072814304:9491], now have 1 active actors on pipe
2025-10-02T08:12:49.281512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:49.281523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:49.281526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534405072814270:9496]
2025-10-02T08:12:49.281529Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:49.281546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534405532621235:2378], now have 1 active actors on pipe
2025-10-02T08:12:49.281575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1570
2025-10-02T08:12:49.281691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:49.281864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.281870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.281898Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:49.281905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.281908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.281910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:49.281920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.281930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:49.281950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:49.282024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.282027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.282038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:49.282068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1571 partition: 0 MaxSeqNo: 17 sessionId: src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0
2025-10-02T08:12:49.285980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0] Write session: try to update token
2025-10-02T08:12:49.285999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:49.302338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId: src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:49.305411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:49.306875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.306907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.306930Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:49.306935Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:49.306938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:49.306945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534405072814270:9496]
2025-10-02T08:12:49.306951Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534405072814270:9496]
2025-10-02T08:12:49.307000Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:49.307006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:49.307014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.307015Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:49.307016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:49.307185Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:49.330967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534405072814321:2513]
2025-10-02T08:12:49.331058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1570, pipe: [1:7556534405072814321:2513]
2025-10-02T08:12:49.460983Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:49.461666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:49.461714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534405072814321:2513], now have 1 active actors on pipe
2025-10-02T08:12:49.461717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:49.463169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534405072814321:2513]
2025-10-02T08:12:49.463182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:49.463184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:49.463204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1571 reason: error at write: Disconnected sessionId: src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0
2025-10-02T08:12:49.463355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1571 sessionId: src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0 is DEAD
2025-10-02T08:12:49.463531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:49.463539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0] Write session will restart in 0.009285s
2025-10-02T08:12:49.463564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0] Write session: Do CDS request
2025-10-02T08:12:49.463572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:49.463539Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:49.477409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:49.479917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:49.479937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1572
2025-10-02T08:12:49.480177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:49.480206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:49.480212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:49.480216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:49.480755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1572 sessionId:  describe result for acl check
2025-10-02T08:12:49.480784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:49.480786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:49.480788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:49.480794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534405072814373:9479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:49.481390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534405072814373:9479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:49.498253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534405072814373:9479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:49.514979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534405072814373:9479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:49.515005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534405072814373:9479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:49.515008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534405072814373:9479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:49.515018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:49.516836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:49.518096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:49.518350Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:49.518353Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:49.518364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:49.518421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:49.518455Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534405072814607:9475]
2025-10-02T08:12:49.519116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:49.519434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:49.519473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:49.519776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:49.519820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.519821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.519822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.519824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.519825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.519830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.519841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.519844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.519848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.519862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.519868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.519875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.519881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.519886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.519891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.519895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.519899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.519903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.519907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.519912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.519928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:49.533860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:49.537634Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1571
2025-10-02T08:12:49.536023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:49.536045Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:49.536048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:49.536052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:49.536058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1571 [1:7556534405072814607:9475]
2025-10-02T08:12:49.536072Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:49.536093Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:49.536097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.536099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.536102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.536120Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:49.536125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:49.536133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:49.536219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.536222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.536225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:49.536227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:49.536274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:49.536276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.536287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.536294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:49.536306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534405072814600:9475]
2025-10-02T08:12:49.536308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534405072814600:9475]
2025-10-02T08:12:49.536313Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:49.536323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:49.536331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:49.536333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:49.536360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534405072814600:9475]
2025-10-02T08:12:49.536362Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:49.536486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:49.536489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:49.536493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:49.541085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1571
2025-10-02T08:12:49.541120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534405072814598:9479], now have 1 active actors on pipe
2025-10-02T08:12:49.541127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534405532621255:2378], now have 1 active actors on pipe
2025-10-02T08:12:49.543117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.543141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.543177Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:49.543189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.543194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.543197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:49.543213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.543231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:49.543254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:49.543351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.543354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.543369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:49.543405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1572 partition: 0 MaxSeqNo: 17 sessionId: src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0
2025-10-02T08:12:49.545243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46dd7722-a37f85ee-505cd256-dda1efc5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:49.557307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0] Write session: try to update token
2025-10-02T08:12:49.557337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:49.564911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534405072814630:2513]
2025-10-02T08:12:49.565401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1571, pipe: [1:7556534405072814630:2513]
2025-10-02T08:12:49.565435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534405072814630:2513], now have 1 active actors on pipe
2025-10-02T08:12:49.571956Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:49.571977Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:49.571979Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:49.571985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534405072814600:9475]
2025-10-02T08:12:49.571989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534405072814600:9475]
2025-10-02T08:12:49.572025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:49.572030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.572032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:49.572170Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:49.573006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:49.573027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:49.595865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId: src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:49.598766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:49.734003Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:49.735191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.735201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.735782Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:49.736109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:49.736184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1572 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0
2025-10-02T08:12:49.736346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1572 sessionId: src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0 is DEAD
2025-10-02T08:12:49.736505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534405072814630:2513]
2025-10-02T08:12:49.740893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:49.740906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0] Write session will restart in 0.005009s
2025-10-02T08:12:49.740930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0] Write session: Do CDS request
2025-10-02T08:12:49.740937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:49.741232Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:49.749373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:49.750079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:49.750109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1573
2025-10-02T08:12:49.750331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:49.750366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:49.750373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:49.750378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:49.752852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:49.753233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1573 sessionId:  describe result for acl check
2025-10-02T08:12:49.753269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:49.753271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:49.753273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:49.753280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534405072814916:9442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:49.754036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534405072814916:9442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:49.759348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:49.759650Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:49.759655Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:49.759668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:49.759733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:49.759778Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534405072814933:9447]
2025-10-02T08:12:49.760560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:49.763172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:49.763261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:49.763732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:49.763812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.763813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.763815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.763816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.763817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.763825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.763845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.763849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.763853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.763856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.763865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.763873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:49.763880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.763885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:49.763891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.763900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:49.763904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.763909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.763914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.763919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.763943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:49.765705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534405072814916:9442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:49.779626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534405072814916:9442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:49.779649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534405072814916:9442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:49.779652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534405072814916:9442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:49.779661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:49.783078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:49.784857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:49.784879Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:49.784882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:49.784886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:49.784892Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1572 [1:7556534405072814933:9447]
2025-10-02T08:12:49.784903Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:49.784921Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:49.784924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.784927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.784929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.784946Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:49.784955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:49.784963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:49.785027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.785029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.785033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:49.785035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:49.785100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:49.785103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.785118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:49.785129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:49.785147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534405072814910:9447]
2025-10-02T08:12:49.785148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534405072814910:9447]
2025-10-02T08:12:49.785163Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:49.785176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:49.785189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:49.785192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:49.785229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534405072814910:9447]
2025-10-02T08:12:49.785231Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:49.785242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:49.785247Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:49.785253Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:49.785980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1572
2025-10-02T08:12:49.785997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534405072814960:9442], now have 1 active actors on pipe
2025-10-02T08:12:49.786000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534405532621276:2378], now have 1 active actors on pipe
2025-10-02T08:12:49.786077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.786085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.786108Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:49.786114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.786121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.786123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:49.786133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.786143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:49.786161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:49.786316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.786322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.786335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:49.786365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1573 partition: 0 MaxSeqNo: 17 sessionId: src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0
2025-10-02T08:12:49.786747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49856fa6-5a1f7c96-74c017b5-7f3dff68_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:49.785764Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1572
2025-10-02T08:12:49.789799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0] Write session: try to update token
2025-10-02T08:12:49.789818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:49.815370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId: src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:49.820901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:49.821197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.821209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.821246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:49.821275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:49.821460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:49.821463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:49.821685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.821766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.821836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.821915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.821958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.821963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.822040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.822100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.822163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.822227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.822268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.822272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.822343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.822402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.822459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.822518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.822582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.822585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.822656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.822729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.822796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.822868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.822915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.822918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.823000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.823066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.823138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.823210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.823256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.823259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.823344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.823410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.823478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.823549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.823596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.823599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.823678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.823748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.823821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.823890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.823941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.823944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.824028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.824089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.824206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.824278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.824326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.824329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.824405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.824463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.824526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.824593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.824642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.824645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.824723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:49.824783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:49.824862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:49.824929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:49.825126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:49.825146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:49.825221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:49.825284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:49.825303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:49.825306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:49.825338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:49.825353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:49.825357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:49.825360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:49.825363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:49.825770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:49.825785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:49.825792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:49.825796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:49.825799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:49.825802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:49.826263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:49.826275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:49.826281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:49.826285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:49.826289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:49.826293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:49.827144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:49.827158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:49.827164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:49.827168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:49.827171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:49.829740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:49.829770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:49.829783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392769829
2025-10-02T08:12:49.830040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:49.830055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:49.830060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:49.830064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:49.830067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:49.830071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:49.830550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:49.830573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:49.830581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:49.830585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:49.830589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:49.830593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:49.831152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:49.831177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:49.831183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:49.831187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:49.831191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:49.831195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:49.831707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:49.831730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:49.831735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:49.832928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:49.832948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:49.832956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:49.832960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:49.832970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392769832
2025-10-02T08:12:49.833286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:49.833296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:49.833304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:49.833307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:49.833311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:49.833314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:49.833764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:49.833774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:49.833779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:49.833783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:49.833787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:49.833790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:49.833817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534405072814974:2513]
2025-10-02T08:12:49.834128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1572, pipe: [1:7556534405072814974:2513]
2025-10-02T08:12:49.834266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:49.834276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:49.834385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392769834
2025-10-02T08:12:49.840308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534405072814974:2513], now have 1 active actors on pipe
2025-10-02T08:12:49.840335Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:49.840355Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:49.840362Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:49.840371Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:49.840382Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:49.840384Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:49.840387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:49.840393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534405072814910:9447]
2025-10-02T08:12:49.840398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534405072814910:9447]
2025-10-02T08:12:49.840468Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:49.840479Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:49.840481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:49.840486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:49.840489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:49.840642Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:50.010855Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:50.012896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:50.012297Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:50.012614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:50.012643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1573 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0
2025-10-02T08:12:50.012855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1573 sessionId: src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0 is DEAD
2025-10-02T08:12:50.013047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534405072814974:2513]
2025-10-02T08:12:50.016913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:50.016930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0] Write session will restart in 0.006655s
2025-10-02T08:12:50.016957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0] Write session: Do CDS request
2025-10-02T08:12:50.016964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:50.029319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:50.029046Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [730f171d3464f9ac] Result# TEvPutResult {Id# [72075186224037892:1572:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:50.029165Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1572:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:50.029212Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1572:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:50.032719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:50.032738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1574
2025-10-02T08:12:50.036894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:50.036948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:50.036953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:50.036959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:50.037449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1574 sessionId:  describe result for acl check
2025-10-02T08:12:50.037479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:50.037481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:50.037483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:50.037489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534409367782317:9411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:50.038608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534409367782317:9411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:50.055887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534409367782317:9411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:50.066140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:50.066613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534409367782317:9411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:50.066621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534409367782317:9411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:50.066625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534409367782317:9411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:50.066633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:50.068176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:50.068377Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:50.068380Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:50.068409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:50.068459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:50.068500Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534409367782554:9431]
2025-10-02T08:12:50.069237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:50.069530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:50.069582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:50.069938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:50.069979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.069981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.069982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.069983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.069984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.069990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.070001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.070006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.070010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.070014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.070020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.070028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.070035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.070041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.070045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.070051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.070056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.070062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.070066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.070072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.070092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:50.088296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:50.091812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1573
2025-10-02T08:12:50.090935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:50.090961Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:50.090964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:50.090969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:50.090975Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1573 [1:7556534409367782554:9431]
2025-10-02T08:12:50.090989Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:50.091010Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:50.091013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.091016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.091019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.091037Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:50.091042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:50.091049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:50.091123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.091125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.091128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:50.091132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:50.091207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:50.091210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.091226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.091238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:50.091258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534409367782541:9431]
2025-10-02T08:12:50.091260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534409367782541:9431]
2025-10-02T08:12:50.091328Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:50.091332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:50.092638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:50.092667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:50.092689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:50.092696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:50.092710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534409367782549:9411], now have 1 active actors on pipe
2025-10-02T08:12:50.092715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534409827588587:2378], now have 1 active actors on pipe
2025-10-02T08:12:50.092760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534409367782541:9431]
2025-10-02T08:12:50.092765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:50.092775Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:50.092824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1573
2025-10-02T08:12:50.092957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.092964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.092994Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:50.093003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.093008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.093010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:50.093022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.093035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:50.093055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:50.093098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.093111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.093123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:50.093166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1574 partition: 0 MaxSeqNo: 17 sessionId: src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0
2025-10-02T08:12:50.094690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d780e5-dd3e783b-afe85b8a-401e1b9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:50.097635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0] Write session: try to update token
2025-10-02T08:12:50.097654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:50.112897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534409367782577:2513]
2025-10-02T08:12:50.113137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1573, pipe: [1:7556534409367782577:2513]
2025-10-02T08:12:50.113153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534409367782577:2513], now have 1 active actors on pipe
2025-10-02T08:12:50.116890Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:50.116909Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:50.116918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534409367782541:9431]
2025-10-02T08:12:50.116961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:50.117155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:50.117312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:50.117453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:50.117595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:50.117784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:50.117816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:50.117975Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:50.128334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId: src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:50.131470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:50.132339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.132349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.132389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:50.132407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:50.132550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.132554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.132730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.132831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.132906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.132989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.133034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.133038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.133167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.133237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.133305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.133383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.133446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.133449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.133535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.133601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.133670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.133744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.133789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.133793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.133869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.133941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.134012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.134087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.134137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.134141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.134234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.134313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.134408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.134488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.134537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.134540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.134621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.134698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.134773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.134858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.134910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.134913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.134998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.135068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.135143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.135226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.135276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.135280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.135361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.135430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.135505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.135584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.135634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.135637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.135724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.135790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.135854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.135925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.135977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.135980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.136063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.136130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.136215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.136285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.136360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.136368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.136414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:50.136483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.136504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.136509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:50.136546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:50.136560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:50.136564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:50.136567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:50.136570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:50.138175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:50.138216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:50.138225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:50.138229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:50.138233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:50.138236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:50.138812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:50.138825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:50.138831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:50.138834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:50.138838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:50.138841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:50.139382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:50.139396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:50.139401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:50.139406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:50.139409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:50.140792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:50.140821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:50.140833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392770138
2025-10-02T08:12:50.140956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:50.140980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:50.140986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:50.140989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:50.140993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:50.140997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:50.141617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:50.141632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:50.141638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:50.141641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:50.141644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:50.141648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:50.142291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:50.142304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:50.142313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:50.142317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:50.142321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:50.142324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:50.142834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:50.142846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:50.142853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:50.144110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:50.144117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:50.144126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:50.144193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:50.144205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392770143
2025-10-02T08:12:50.144509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:50.144521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:50.144527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:50.144530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:50.144533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:50.144538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:50.145111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:50.145139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:50.145145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:50.145150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:50.145154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:50.145158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:50.145652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:50.145662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.145777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392770145
2025-10-02T08:12:50.146599Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:50.146614Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:50.146624Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:50.146630Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:50.153307Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:50.153337Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:50.153340Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:50.153355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534409367782541:9431]
2025-10-02T08:12:50.153360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534409367782541:9431]
2025-10-02T08:12:50.153425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:50.153434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.153437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:50.153687Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:50.157179Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:50.157198Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:50.335795Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:50.336332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:50.336335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:50.336350Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:50.336366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1574 reason: error at write: Disconnected sessionId: src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0
2025-10-02T08:12:50.336556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1574 sessionId: src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0 is DEAD
2025-10-02T08:12:50.336703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534409367782577:2513]
2025-10-02T08:12:50.336979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:50.336990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0] Write session will restart in 0.006051s
2025-10-02T08:12:50.337017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0] Write session: Do CDS request
2025-10-02T08:12:50.337024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:50.336905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:50.344368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:50.346484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:50.346507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1575
2025-10-02T08:12:50.346732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:50.346763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:50.346769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:50.346774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:50.347394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1575 sessionId:  describe result for acl check
2025-10-02T08:12:50.347421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:50.347422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:50.347423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:50.347428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534409367782825:9422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:50.347854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534409367782825:9422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:50.348770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:50.351488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:50.351596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534409367782825:9422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:50.351765Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:50.351769Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:50.351779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:50.351840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:50.351878Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534409367782854:9423]
2025-10-02T08:12:50.352826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:50.353401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:50.353457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:50.353816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:50.353861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.353862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.353863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.353864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.353866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.353873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.353883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.353887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.353890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.353894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.353900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.353908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.353914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.353920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.353925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.353930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.353934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.353940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.353945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.353951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.353971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:50.359606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534409367782825:9422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:50.359622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534409367782825:9422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:50.359625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534409367782825:9422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:50.359631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:50.363473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:50.365298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:50.365316Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:50.365318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:50.365322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:50.365327Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1574 [1:7556534409367782854:9423]
2025-10-02T08:12:50.365337Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:50.365353Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:50.365356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.365359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.365360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.365375Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:50.365379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:50.365385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:50.365460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.365462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.365464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:50.365466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:50.365524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:50.365526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.365536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.365543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:50.365557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534409367782833:9423]
2025-10-02T08:12:50.365559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534409367782833:9423]
2025-10-02T08:12:50.365565Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:50.365575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:50.365583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:50.365585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:50.365619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534409367782833:9423]
2025-10-02T08:12:50.365621Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:50.365632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534409367782891:9422], now have 1 active actors on pipe
2025-10-02T08:12:50.365634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:50.365637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:50.365643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1574
2025-10-02T08:12:50.365645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:50.365655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534409827588609:2378], now have 1 active actors on pipe
2025-10-02T08:12:50.365662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.365666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.365696Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:50.365702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.365708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.365710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:50.365722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.365732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:50.365747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:50.365930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.365933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.365945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:50.365987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1575 partition: 0 MaxSeqNo: 17 sessionId: src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0
2025-10-02T08:12:50.366413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aaeb4ec-6f13afc3-3dc2ec9b-67cbb322_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:50.366311Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1574
2025-10-02T08:12:50.368998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0] Write session: try to update token
2025-10-02T08:12:50.369014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:50.379838Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:50.379870Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:50.379882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534409367782833:9423]
2025-10-02T08:12:50.379939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:50.380195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:50.380367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:50.380533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:50.380705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:50.380937Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:50.380969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:50.381012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:50.396963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId: src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:50.399589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:50.400019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.400035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.400074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:50.400101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:50.400182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.400185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.400369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.400445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.400509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.400574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.400621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.400625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.400699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.400762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.400855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.400924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.400967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.400970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.401046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.401106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.401166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.401228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.401283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.401286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.401359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.401432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.401503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.401576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.401627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.401630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.401713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.401780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.401853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.401931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.401980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.401983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.402068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.402140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.402219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.402295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.402370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.402372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.402453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.402525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.402603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.402675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.402727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.402730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.402813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.402882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.402974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.403043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.403093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.403097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.403177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.403239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.403300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.403367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.403419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.403422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.403498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.403560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.403621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.403688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.403780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.403784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.403848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:50.403911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.403930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.403932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:50.403963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:50.403975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:50.403978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:50.403981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:50.403984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:50.404418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:50.404436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:50.404442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:50.404446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:50.404449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:50.404452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:50.405133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:50.405156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:50.405163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:50.405166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:50.405170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:50.405173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:50.405862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:50.405875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:50.405881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:50.405885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:50.405888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:50.407175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:50.407183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:50.407196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392770405
2025-10-02T08:12:50.407319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:50.407326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:50.407331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:50.407334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:50.407338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:50.407342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:50.407871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:50.407888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:50.407895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:50.407899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:50.407903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:50.407907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:50.408601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:50.408616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:50.408624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:50.408627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:50.408631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:50.408634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:50.409355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:50.409384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:50.409390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:50.410625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:50.410633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:50.410640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:50.410645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:50.410656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392770408
2025-10-02T08:12:50.411055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:50.411067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:50.411075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:50.411078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:50.411082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:50.411086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:50.411694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:50.411708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:50.411714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:50.411718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:50.411721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:50.411725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:50.412247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:50.412257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.412356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392770408
2025-10-02T08:12:50.415044Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:50.415077Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:50.415087Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:50.415094Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:50.415107Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:50.415109Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:50.415111Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:50.415118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534409367782833:9423]
2025-10-02T08:12:50.415122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534409367782833:9423]
2025-10-02T08:12:50.415186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:50.415193Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:50.415204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:50.415209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.415211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:50.415364Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:50.438238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534409367782907:2513]
2025-10-02T08:12:50.438508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1574, pipe: [1:7556534409367782907:2513]
2025-10-02T08:12:50.569833Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:50.570221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534409367782907:2513], now have 1 active actors on pipe
2025-10-02T08:12:50.571168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:50.571179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0] Write session will restart in 0.005951s
2025-10-02T08:12:50.571205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0] Write session: Do CDS request
2025-10-02T08:12:50.571211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:50.570783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:50.570792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:50.570822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1575 reason: error at write: Disconnected sessionId: src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0
2025-10-02T08:12:50.570995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1575 sessionId: src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0 is DEAD
2025-10-02T08:12:50.571268Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:50.571553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534409367782907:2513]
2025-10-02T08:12:50.576610Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:50.577625Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7db76ace4d25d8cc] Result# TEvPutResult {Id# [72075186224037892:1574:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:50.577682Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1574:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:50.577718Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1574:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:50.578360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:50.578433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:50.578446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1576
2025-10-02T08:12:50.578573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:50.578613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:50.578624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:50.578634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:50.579052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1576 sessionId:  describe result for acl check
2025-10-02T08:12:50.579084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:50.579086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:50.579088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:50.579093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534409367782952:9409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:50.579575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534409367782952:9409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:50.585972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534409367782952:9409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:50.589991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:50.593045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:50.593282Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:50.593292Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:50.593302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:50.593349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:50.593395Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534409367783190:9403]
2025-10-02T08:12:50.594008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:50.595012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:50.595068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:50.595404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:50.595447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.595453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.595454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.595455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.595457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.595461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.595471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.595475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.595478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.595481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.595487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.595495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.595501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.595505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.595509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.595514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.595518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.595523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.595528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.595532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.595553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:50.597624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534409367782952:9409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:50.597647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534409367782952:9409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:50.597650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534409367782952:9409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:50.597660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:50.607688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:50.610908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22804a1-45f1a13c-d956b22c-411d2cfc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:50.609420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:50.609439Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:50.609443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:50.609447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:50.609455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1575 [1:7556534409367783190:9403]
2025-10-02T08:12:50.609470Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:50.609490Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:50.609494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.609498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.609501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.609519Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:50.609525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:50.609532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:50.609609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.609612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.609617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:50.609623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:50.609695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:50.609698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.609712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.609723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:50.609739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534409367783181:9403]
2025-10-02T08:12:50.609741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534409367783181:9403]
2025-10-02T08:12:50.609754Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:50.609768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:50.609784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:50.609787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:50.609823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534409367783181:9403]
2025-10-02T08:12:50.609825Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:50.609919Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:50.609922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:50.609927Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:50.610251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1575
2025-10-02T08:12:50.610271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534409367783206:9409], now have 1 active actors on pipe
2025-10-02T08:12:50.610276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534409827588615:2378], now have 1 active actors on pipe
2025-10-02T08:12:50.610305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.610311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.610338Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:50.610347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.610352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.610355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:50.610367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.610379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:50.610399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:50.610434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.610445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.610459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:50.610494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1576 partition: 0 MaxSeqNo: 17 sessionId: src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0
2025-10-02T08:12:50.613096Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1575
2025-10-02T08:12:50.613909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0] Write session: try to update token
2025-10-02T08:12:50.613928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:50.630489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId: src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:50.633300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:50.633550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.633559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.633593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:50.633611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:50.633670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.633673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.633835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.633892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.633954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.634019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.634066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.634069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.634137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.634194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.634263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.634324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.634369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.634371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.634456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.634513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.634574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.634627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.634668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.634670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.634739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.634808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.634890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.634965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.635013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.635017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.635107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.635182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.635260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.635336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.635390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.635397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.635486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.635562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.635643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.635730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.635790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.635794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.635882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.635952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.636024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.636099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.636160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.636165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.636241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.636307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.636376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.636449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.636498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.636500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.636575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.636635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.636692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.636754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.636830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.636833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.636906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:50.636967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:50.637023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:50.637092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:50.637146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:50.637169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:50.637233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:50.637308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.637332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.637339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:50.637371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:50.637385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:50.637391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:50.637393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:50.637394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:50.637801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:50.637835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:50.637847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:50.637851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:50.637855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:50.637858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:50.638392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:50.638421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:50.638427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:50.638433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:50.638436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:50.638439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:50.639158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:50.639174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:50.639179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:50.639183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:50.639186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:50.640518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:50.640542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:50.640554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392770639
2025-10-02T08:12:50.640834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:50.640845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:50.640854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:50.640858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:50.640863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:50.640866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:50.641417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:50.641431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:50.641437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:50.641441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:50.641444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:50.641448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:50.642059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:50.642073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:50.642083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:50.642087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:50.642093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:50.642096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:50.642614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:50.642628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:50.642634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:50.643833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:50.643842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:50.643848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:50.643853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:50.643862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392770642
2025-10-02T08:12:50.644201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:50.644214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:50.644221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:50.644225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:50.644230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:50.644233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:50.644857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:50.644885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:50.644890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:50.644894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:50.644898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:50.644902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:50.645453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:50.645464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.645578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392770644
2025-10-02T08:12:50.647986Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:50.648004Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:50.648011Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:50.648021Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:50.648032Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:50.648035Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:50.648037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:50.648047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534409367783181:9403]
2025-10-02T08:12:50.648051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534409367783181:9403]
2025-10-02T08:12:50.648137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:50.648154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.648157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:50.648311Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:50.649095Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:50.649113Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:50.672592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534409367783222:2513]
2025-10-02T08:12:50.672844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1575, pipe: [1:7556534409367783222:2513]
2025-10-02T08:12:50.798803Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:50.799228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534409367783222:2513], now have 1 active actors on pipe
2025-10-02T08:12:50.799473Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:50.799782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534409367783222:2513]
2025-10-02T08:12:50.799809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:50.799834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1576 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0
2025-10-02T08:12:50.800183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:50.800190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0] Write session will restart in 0.009907s
2025-10-02T08:12:50.800214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0] Write session: Do CDS request
2025-10-02T08:12:50.800221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:50.800050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1576 sessionId: src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0 is DEAD
2025-10-02T08:12:50.804636Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [358cbf95d1c2d4a1] Result# TEvPutResult {Id# [72075186224037892:1575:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:50.804700Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1575:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:50.804763Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1575:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:50.801064Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:50.811286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:50.811364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:50.811383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1577
2025-10-02T08:12:50.811511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:50.811546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:50.811553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:50.811557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:50.811859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1577 sessionId:  describe result for acl check
2025-10-02T08:12:50.811883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:50.811891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:50.811893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:50.811897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534409367783501:9347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:50.812327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534409367783501:9347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:50.812733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:50.813998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534409367783501:9347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:50.814560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:50.814915Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:50.814929Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:50.814939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:50.814989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:50.815014Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534409367783542:9353]
2025-10-02T08:12:50.815424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:50.815643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:50.815680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:50.815896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:50.815924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.815928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.815929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.815930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.815931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.815934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.815941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.815943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.815945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.815947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.815952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.815956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:50.815960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.815963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:50.815966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.815969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:50.815971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.815974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.815976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.815979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.815990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:50.816724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534409367783501:9347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:50.816739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534409367783501:9347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:50.816743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534409367783501:9347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:50.816751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:50.824546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:50.826148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:50.826173Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:50.826176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:50.826181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:50.826188Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1576 [1:7556534409367783542:9353]
2025-10-02T08:12:50.826201Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:50.826220Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:50.826225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.826228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.826231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.826247Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:50.826253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:50.826260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:50.826317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.826328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.826330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:50.826332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:50.826405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:50.826413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.826427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:50.826443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:50.826465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534409367783559:9347], now have 1 active actors on pipe
2025-10-02T08:12:50.826471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1576
2025-10-02T08:12:50.826476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534409367783511:9353]
2025-10-02T08:12:50.826479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534409367783511:9353]
2025-10-02T08:12:50.826486Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:50.826503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:50.826503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:50.826509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:50.826518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:50.826521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:50.826528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534409827588637:2378], now have 1 active actors on pipe
2025-10-02T08:12:50.826538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.826543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.826586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534409367783511:9353]
2025-10-02T08:12:50.826604Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:50.826619Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:50.826620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:50.826631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:50.826635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:50.826638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:50.826649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:50.826638Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1576
2025-10-02T08:12:50.826665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:50.826920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:50.826980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.826988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.827003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:50.827039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1577 partition: 0 MaxSeqNo: 17 sessionId: src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0
2025-10-02T08:12:50.827404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db81027a-9cd831da-c873c8a2-cd0d08e0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:50.830272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0] Write session: try to update token
2025-10-02T08:12:50.830291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:50.845138Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:50.845166Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:50.845169Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:50.845179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534409367783511:9353]
2025-10-02T08:12:50.845183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534409367783511:9353]
2025-10-02T08:12:50.845232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:50.845232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:50.845238Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:50.845242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:50.845244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:50.845396Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:50.845904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId: src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:50.848839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:50.899790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534409367783574:2513]
2025-10-02T08:12:50.899912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1576, pipe: [1:7556534409367783574:2513]
2025-10-02T08:12:50.993026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:50.993042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0] Write session will restart in 0.009331s
2025-10-02T08:12:50.993067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0] Write session: Do CDS request
2025-10-02T08:12:50.993073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:50.992908Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:50.989731Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:50.990132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:50.990141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:50.990188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534409367783574:2513], now have 1 active actors on pipe
2025-10-02T08:12:50.990740Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:50.991088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:50.991142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1577 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0
2025-10-02T08:12:50.991309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1577 sessionId: src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0 is DEAD
2025-10-02T08:12:50.991430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534409367783574:2513]
2025-10-02T08:12:51.006217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:51.006554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:51.006575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1578
2025-10-02T08:12:51.006707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:51.006741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:51.006746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:51.006750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:51.010216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1578 sessionId:  describe result for acl check
2025-10-02T08:12:51.010265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:51.010266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:51.010268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:51.010272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534413662751085:9318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:51.010947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534413662751085:9318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:51.015120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:51.023515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:51.023746Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:51.023750Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:51.023761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:51.023809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:51.023847Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534413662751138:9313]
2025-10-02T08:12:51.024519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:51.025290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534413662751085:9318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:51.026653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:51.026738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:51.027156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:51.027248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.027249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.027251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.027254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.027255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.027264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.027277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.027282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.027287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.027291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.027300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.027310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.027322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.027328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.027335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.027340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.027344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.027349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.027355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.027360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.027378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:51.044029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534413662751085:9318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:51.044060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534413662751085:9318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:51.044064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534413662751085:9318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:51.044161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:51.045197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:51.046797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:51.046802Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:51.046805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:51.046809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:51.046819Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1577 [1:7556534413662751138:9313]
2025-10-02T08:12:51.046830Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:51.046845Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:51.046849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.046851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.046853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.046871Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:51.046876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:51.046883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:51.046947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.046949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.046952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:51.046954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:51.047014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:51.047017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.047031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.047042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:51.047058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534413662751121:9313]
2025-10-02T08:12:51.047060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534413662751121:9313]
2025-10-02T08:12:51.047066Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:51.047077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:51.047092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:51.047094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:51.047130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534413662751121:9313]
2025-10-02T08:12:51.047133Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:51.048886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:51.048890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:51.048897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:51.049078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1577
2025-10-02T08:12:51.049104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534413662751164:9318], now have 1 active actors on pipe
2025-10-02T08:12:51.049111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.049116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.049144Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db951482-4af3acf5-c7ace679-a2b5be7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:51.049153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.049157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.049159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:51.049171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.049185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:51.049196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534409827588653:2378], now have 1 active actors on pipe
2025-10-02T08:12:51.049207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:51.049231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.049233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.049245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:51.049275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1578 partition: 0 MaxSeqNo: 17 sessionId: src_id|db951482-4af3acf5-c7ace679-a2b5be7_0
2025-10-02T08:12:51.049496Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1577
2025-10-02T08:12:51.049623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd75fa6-1cbab1aa-eb73b5cd-fa7be57e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|db951482-4af3acf5-c7ace679-a2b5be7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:51.052891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db951482-4af3acf5-c7ace679-a2b5be7_0] Write session: try to update token
2025-10-02T08:12:51.052908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db951482-4af3acf5-c7ace679-a2b5be7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:51.072262Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:51.072290Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:51.072292Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:51.072301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534413662751121:9313]
2025-10-02T08:12:51.072305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534413662751121:9313]
2025-10-02T08:12:51.072357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:51.072362Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:51.072364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.072366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:51.072369Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:51.072518Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:51.077337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId: src_id|db951482-4af3acf5-c7ace679-a2b5be7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:51.080255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:51.091818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534413662751178:2513]
2025-10-02T08:12:51.092358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1577, pipe: [1:7556534413662751178:2513]
2025-10-02T08:12:51.229195Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:51.229537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.229544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.229586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534413662751178:2513], now have 1 active actors on pipe
2025-10-02T08:12:51.230509Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:51.229864Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:51.230137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:51.230180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1578 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db951482-4af3acf5-c7ace679-a2b5be7_0
2025-10-02T08:12:51.230312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1578 sessionId: src_id|db951482-4af3acf5-c7ace679-a2b5be7_0 is DEAD
2025-10-02T08:12:51.230417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534413662751178:2513]
2025-10-02T08:12:51.232075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db951482-4af3acf5-c7ace679-a2b5be7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:51.232086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db951482-4af3acf5-c7ace679-a2b5be7_0] Write session will restart in 0.008796s
2025-10-02T08:12:51.232114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db951482-4af3acf5-c7ace679-a2b5be7_0] Write session: Do CDS request
2025-10-02T08:12:51.232121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db951482-4af3acf5-c7ace679-a2b5be7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:51.242488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db951482-4af3acf5-c7ace679-a2b5be7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:51.242996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:51.243016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1579
2025-10-02T08:12:51.243121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:51.243154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:51.243159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:51.243163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:51.243631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1579 sessionId:  describe result for acl check
2025-10-02T08:12:51.243657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:51.243659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:51.243660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:51.243673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534413662751400:9322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:51.244473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534413662751400:9322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:51.248559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:51.249815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534413662751400:9322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:51.250710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:51.250869Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:51.250878Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:51.250888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:51.250933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:51.250961Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534413662751459:9319]
2025-10-02T08:12:51.251399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:51.251564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:51.251595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:51.251803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:51.251835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.251840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.251840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.251841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.251842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.251845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.251854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.251858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.251861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.251865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.251870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.251877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.251882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.251887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.251891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.251896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.251900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.251905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.251914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.251918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.251930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:51.263991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534413662751400:9322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:51.264011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534413662751400:9322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:51.264018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534413662751400:9322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:51.264028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:51.264363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:51.265838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:51.265860Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:51.265863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:51.265867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:51.265873Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1578 [1:7556534413662751459:9319]
2025-10-02T08:12:51.265881Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:51.265895Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:51.265897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.265899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.265900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.265912Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:51.265916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:51.265920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:51.265966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.265973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.265976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:51.265978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:51.266029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:51.266033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.266043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.266049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:51.266061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534413662751443:9319]
2025-10-02T08:12:51.266064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534413662751443:9319]
2025-10-02T08:12:51.266069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:51.266077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:51.266086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:51.266088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:51.266095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534413662751475:9322], now have 1 active actors on pipe
2025-10-02T08:12:51.266103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:51.266106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:51.266119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534413662751443:9319]
2025-10-02T08:12:51.266121Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:51.266124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534414122555956:2378], now have 1 active actors on pipe
2025-10-02T08:12:51.266155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1578
2025-10-02T08:12:51.266240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:51.266929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1578
2025-10-02T08:12:51.267034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.267047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.267075Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:51.267083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.267087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.267089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:51.267099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.267112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:51.267128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:51.267709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db951482-4af3acf5-c7ace679-a2b5be7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:51.270533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0] Write session: try to update token
2025-10-02T08:12:51.270551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:51.267258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.267265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.267284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:51.267315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1579 partition: 0 MaxSeqNo: 17 sessionId: src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0
2025-10-02T08:12:51.314739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId: src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:51.317823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:51.321080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.321110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.321150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:51.321184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:51.322362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.322379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.322564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.322628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.322696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.322765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.322813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.322818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.322897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.322962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.323028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.323100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.323146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.323149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.323228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.323288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.323350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.323412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.323454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.323460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.323538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.323613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.323687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.323760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.323816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.323819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.323937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.324011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.324089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.324180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.324241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.324244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.324335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.324412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.324494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.324574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.324631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.324635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.324720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.324788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.324891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.324968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.325046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.325050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.325135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.325203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.325279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.325361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.325524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.325531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.325606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.325672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.325734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.325808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.325864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.325867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.325955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.326023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.326088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.326157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.326211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.326214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.326284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:51.326350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.326370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.326373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:51.326408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:51.326426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:51.326431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:51.326434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:51.326437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:51.326872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:51.326895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:51.326903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:51.326907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:51.326910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:51.326913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:51.327453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:51.327470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:51.327481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:51.327484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:51.327487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:51.327491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:51.328209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:51.328227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:51.328233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:51.328236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:51.328242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:51.331892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534413662751493:2513]
2025-10-02T08:12:51.333013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1578, pipe: [1:7556534413662751493:2513]
2025-10-02T08:12:51.340219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:51.340259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:51.340282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392771340
2025-10-02T08:12:51.340418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:51.340438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:51.340446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:51.340450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:51.340454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:51.340461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:51.341174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:51.341207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:51.341214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:51.341218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:51.341221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:51.341225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:51.341739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:51.341757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:51.341768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:51.341773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:51.341777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:51.341780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:51.342287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:51.342304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:51.342310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:51.343519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:51.343530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:51.343537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:51.343541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:51.343552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392771343
2025-10-02T08:12:51.343906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:51.343923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:51.343931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:51.343935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:51.343942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:51.343947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:51.344473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:51.344489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:51.344498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:51.344502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:51.344506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:51.344513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:51.348582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:51.348617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.348749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392771343
2025-10-02T08:12:51.351263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534413662751493:2513], now have 1 active actors on pipe
2025-10-02T08:12:51.351289Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:51.351306Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:51.351315Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:51.351324Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:51.351337Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:51.351339Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:51.351342Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:51.351349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534413662751443:9319]
2025-10-02T08:12:51.351353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534413662751443:9319]
2025-10-02T08:12:51.352887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:51.352893Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:51.359045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:51.359073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.359076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:51.359260Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:51.550066Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:51.550428Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:51.550432Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:51.550443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534413662751443:9319]
2025-10-02T08:12:51.551522Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:51.550665Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:51.551812Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:51.552263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:51.552291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1579 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0
2025-10-02T08:12:51.552465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1579 sessionId: src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0 is DEAD
2025-10-02T08:12:51.552609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534413662751493:2513]
2025-10-02T08:12:51.553105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:51.553122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0] Write session will restart in 0.007754s
2025-10-02T08:12:51.553151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0] Write session: Do CDS request
2025-10-02T08:12:51.553157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:51.565977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:51.572460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:51.572482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1580
2025-10-02T08:12:51.572674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:51.572704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:51.572711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:51.572715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:51.573201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1580 sessionId:  describe result for acl check
2025-10-02T08:12:51.573244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:51.573245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:51.573247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:51.573252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534413662751550:9308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:51.573784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534413662751550:9308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:51.575825Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6373c48745486c9a] Result# TEvPutResult {Id# [72075186224037892:1578:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:51.575928Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1578:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:51.576032Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1578:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:51.597940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:51.598117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534413662751550:9308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:51.600013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:51.600226Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:51.600236Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:51.600246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:51.600296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:51.600333Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534413662751799:9306]
2025-10-02T08:12:51.600867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534413662751550:9308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:51.600881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534413662751550:9308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:51.600884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534413662751550:9308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:51.600892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:51.600936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:51.601224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:51.601278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:51.601581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:51.601636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.601642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.601643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.601644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.601645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.601651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.601660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.601665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.601668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.601671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.601677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.601683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.601693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.601698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.601706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.601711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.601715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.601719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.601724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.601728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.601746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:51.611685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:51.613620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:51.613627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:51.613630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:51.613634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:51.613641Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1579 [1:7556534413662751799:9306]
2025-10-02T08:12:51.613654Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:51.613672Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:51.613675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.613678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.613680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.613697Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:51.613701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:51.613707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:51.613772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.613774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.613777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:51.613780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:51.613850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:51.613853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.613867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.613881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:51.613897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534413662751782:9306]
2025-10-02T08:12:51.613899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534413662751782:9306]
2025-10-02T08:12:51.613912Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:51.613923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:51.613937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:51.613940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:51.613970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534413662751782:9306]
2025-10-02T08:12:51.613973Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:51.614194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:51.614205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:51.614210Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:51.615726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1579
2025-10-02T08:12:51.615753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534413662751805:9308], now have 1 active actors on pipe
2025-10-02T08:12:51.615758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534414122555976:2378], now have 1 active actors on pipe
2025-10-02T08:12:51.615904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.615910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.615943Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:51.615953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.615963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.615967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:51.615980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.615995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:51.616015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:51.614935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1579
2025-10-02T08:12:51.616522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.616532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.616553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:51.616586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1580 partition: 0 MaxSeqNo: 17 sessionId: src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0
2025-10-02T08:12:51.618969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4998c77f-65cf0aa3-912ab69f-b12303a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:51.621775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0] Write session: try to update token
2025-10-02T08:12:51.621796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:51.647467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId: src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:51.650501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:51.653362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.653389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.655188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:51.655226Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:51.655229Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:51.655232Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:51.655240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534413662751782:9306]
2025-10-02T08:12:51.655245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534413662751782:9306]
2025-10-02T08:12:51.655300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:51.655312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.655314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:51.655469Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:51.657201Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:51.657217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:51.660392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534413662751832:2513]
2025-10-02T08:12:51.660435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:51.661064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1579, pipe: [1:7556534413662751832:2513]
2025-10-02T08:12:51.871791Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:51.872092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.872107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.872301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.872374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.872446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.872522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.872583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.872593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.872669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.872744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.872836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.872911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.872955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.872958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.873045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.873116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.873187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.873257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.873306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.873314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.873389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.873471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.873553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.873639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.873700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.873708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.873795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.873874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.873956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.874041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.874103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.874117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.874203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.874287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.874372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.874456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.874513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.874521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.874608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.874688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.874771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.874858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.874922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.874929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.875013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.875089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.875172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.875258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.875315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.875324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.875404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.875473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.875544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.875623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.875683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.875690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.875772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.875843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.875913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.875991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.876054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.876062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.876112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534413662751832:2513], now have 1 active actors on pipe
2025-10-02T08:12:51.876717Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:51.877122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:51.877159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1580 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0
2025-10-02T08:12:51.877368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1580 sessionId: src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0 is DEAD
2025-10-02T08:12:51.877507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534413662751832:2513]
2025-10-02T08:12:51.877657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:51.877668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0] Write session will restart in 0.005321s
2025-10-02T08:12:51.877569Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:51.877693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0] Write session: Do CDS request
2025-10-02T08:12:51.878436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:51.885215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:51.885464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:51.885480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1581
2025-10-02T08:12:51.885583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:51.885636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:51.885641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:51.885645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:51.886586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1581 sessionId:  describe result for acl check
2025-10-02T08:12:51.886612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:51.886614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:51.886615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:51.886620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534413662751915:9279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:51.887713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534413662751915:9279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:51.899634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534413662751915:9279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:51.903129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:51.905108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:51.905314Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:51.905317Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:51.905327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:51.905377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:51.905410Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534413662752158:9280]
2025-10-02T08:12:51.906050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:51.906331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:51.906390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:51.906713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:51.906758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.906759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.906761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.906762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.906763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.906768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.906778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.906781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.906784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.906788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.906794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.906801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:51.906808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.906813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:51.906817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.906822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:51.906825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.906830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.906834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.906839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.906858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:51.910157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534413662751915:9279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:51.910176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534413662751915:9279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:51.910179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534413662751915:9279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:51.910188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:51.924305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:51.925909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:51.925935Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:51.925938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:51.925942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:51.925948Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1580 [1:7556534413662752158:9280]
2025-10-02T08:12:51.925960Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:51.925977Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:51.925980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.925983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.925986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.926002Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:51.926007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:51.926013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:51.926078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.926080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.926083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:51.926086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:51.926155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:51.926157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.926171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:51.926184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:51.926208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534413662752151:9280]
2025-10-02T08:12:51.926216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534413662752151:9280]
2025-10-02T08:12:51.926789Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1580
2025-10-02T08:12:51.926229Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:51.926246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:51.926259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:51.926263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:51.926269Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:51.926274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:51.926294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534413662752151:9280]
2025-10-02T08:12:51.926298Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:51.926322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534413662752174:9279], now have 1 active actors on pipe
2025-10-02T08:12:51.926327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:51.926349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1580
2025-10-02T08:12:51.926353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534414122555999:2378], now have 1 active actors on pipe
2025-10-02T08:12:51.926452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.926456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.926480Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:51.926487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.926491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.926493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:51.926502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.926512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:51.926529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:51.926568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.926570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.926583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:51.926613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1581 partition: 0 MaxSeqNo: 17 sessionId: src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0
2025-10-02T08:12:51.927029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ab5bb6-71c6c50e-c832accc-bcc3ef4a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:51.929721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0] Write session: try to update token
2025-10-02T08:12:51.929738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:51.952449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId: src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:51.955276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:51.955352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.955360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.955396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:51.955416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:51.955753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:51.955760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:51.955939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.956001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.956080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.956159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.956203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.956221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.956295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.956374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.956458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.956528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.956578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.956589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.956660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.956723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.956790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.956918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.956966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.956978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.957046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.957123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.957203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.957281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.957334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.957341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.957421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.957501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.957580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.957656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.957712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.957720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.957802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.957872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.957951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.958028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.958082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.958090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.958171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.958244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.958322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.958402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.958462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.958470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.958556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.958628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.958710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.958785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.958841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.958849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.958922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.958982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.959046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.959114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.959168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.959176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.959252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:51.959314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:51.959378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:51.959450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:51.959506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:51.959513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:51.959582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:51.959651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:51.959673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:51.959676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:51.959709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:51.959726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:51.959734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:51.959737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:51.959740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:51.960135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:51.960174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:51.960180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:51.960184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:51.960188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:51.960193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:51.960720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:51.960746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:51.960752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:51.960756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:51.960759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:51.960762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:51.961463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:51.961478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:51.961485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:51.961489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:51.961492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:51.962850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:51.962859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:51.962872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392771962
2025-10-02T08:12:51.962986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:51.963008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:51.963014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:51.963019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:51.963023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:51.963029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:51.963523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:51.963548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:51.963559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:51.963563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:51.963567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:51.963570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:51.964175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:51.964198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:51.964212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:51.964216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:51.964220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:51.964229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:51.964708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:51.964731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:51.964738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:51.965965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:51.965987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:51.965992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:51.965999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:51.966007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392771964
2025-10-02T08:12:51.966355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:51.966366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:51.966372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:51.966375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:51.966381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:51.966384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:51.966914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:51.966926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:51.966933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:51.966937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:51.966940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:51.966944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:51.967400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:51.967409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:51.967511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392771966
2025-10-02T08:12:51.970177Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:51.970208Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:51.970215Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:51.970223Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:51.970254Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:51.970261Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:51.970264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:51.970271Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534413662752151:9280]
2025-10-02T08:12:51.970274Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534413662752151:9280]
2025-10-02T08:12:51.970321Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:51.970335Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:51.977172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:51.977198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:51.977200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:51.977375Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:51.977539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534413662752189:2513]
2025-10-02T08:12:51.977653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1580, pipe: [1:7556534413662752189:2513]
2025-10-02T08:12:52.127159Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:52.127573Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:52.127577Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:52.127589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534413662752151:9280]
2025-10-02T08:12:52.127630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534413662752189:2513], now have 1 active actors on pipe
2025-10-02T08:12:52.129021Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:52.129341Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:52.129456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:52.129468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:52.129499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1581 reason: error at write: Disconnected sessionId: src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0
2025-10-02T08:12:52.129769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:52.129782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0] Write session will restart in 0.008811s
2025-10-02T08:12:52.129815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0] Write session: Do CDS request
2025-10-02T08:12:52.129823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:52.129702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534413662752189:2513]
2025-10-02T08:12:52.129735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1581 sessionId: src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0 is DEAD
2025-10-02T08:12:52.135748Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:52.141341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:52.143203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:52.143222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1582
2025-10-02T08:12:52.146429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:52.146478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:52.146483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:52.146488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:52.147614Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [71c45064eddc5678] Result# TEvPutResult {Id# [72075186224037892:1580:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:52.147642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1582 sessionId:  describe result for acl check
2025-10-02T08:12:52.147670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:52.147671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:52.147673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:52.147679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534417957719736:9252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:52.147776Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1580:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:52.147955Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1580:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:52.148319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534417957719736:9252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:52.150085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:52.153219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:52.153375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534417957719736:9252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:52.153438Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:52.153443Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:52.153454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:52.153527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:52.153572Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534417957719764:9257]
2025-10-02T08:12:52.154256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:52.155022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:52.155077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:52.155405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:52.155449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.155464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.155466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.155467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.155468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.155474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.155485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.155489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.155494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.155498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.155503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.155511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.155518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.155523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.155527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.155533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.155537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.155543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.155552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.155558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.155577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:52.171425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534417957719736:9252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:52.171456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534417957719736:9252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:52.171460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534417957719736:9252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:52.171471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:52.173518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:52.175082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:52.175088Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:52.175091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:52.175095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:52.175102Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1581 [1:7556534417957719764:9257]
2025-10-02T08:12:52.175115Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:52.175133Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:52.175136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:52.175139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:52.175140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:52.175158Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:52.175164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:52.175171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:52.175241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.175247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.175250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:52.175253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:52.175326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:52.175329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.175344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.175356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:52.175373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534417957719744:9257]
2025-10-02T08:12:52.175374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534417957719744:9257]
2025-10-02T08:12:52.175386Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:52.175399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:52.175411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:52.175414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:52.175445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534417957719744:9257]
2025-10-02T08:12:52.175447Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:52.175627Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:52.175630Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:52.175635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:52.175760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1581
2025-10-02T08:12:52.175778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534417957719790:9252], now have 1 active actors on pipe
2025-10-02T08:12:52.175799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.175804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.175832Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f02312-663b54a5-c432370c-7663d148_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:52.175850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:52.175855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:52.175857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:52.175869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:52.175880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:52.175891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534418417523313:2378], now have 1 active actors on pipe
2025-10-02T08:12:52.175902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:52.176469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.176482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.176504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:52.176539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1582 partition: 0 MaxSeqNo: 17 sessionId: src_id|7f02312-663b54a5-c432370c-7663d148_0
2025-10-02T08:12:52.180414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d1c8ad-c2bd209d-9e68efaf-43fe2b55_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7f02312-663b54a5-c432370c-7663d148_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:52.180061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1581
2025-10-02T08:12:52.183179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f02312-663b54a5-c432370c-7663d148_0] Write session: try to update token
2025-10-02T08:12:52.183199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f02312-663b54a5-c432370c-7663d148_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:52.204512Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:52.204537Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:52.204540Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:52.204549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534417957719744:9257]
2025-10-02T08:12:52.204553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534417957719744:9257]
2025-10-02T08:12:52.204595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:52.204600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.204607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:52.204744Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:52.209382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:52.209399Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:52.229987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534417957719806:2513]
2025-10-02T08:12:52.230157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1581, pipe: [1:7556534417957719806:2513]
2025-10-02T08:12:52.230734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId: src_id|7f02312-663b54a5-c432370c-7663d148_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:52.233580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:52.387570Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:52.388189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534417957719806:2513], now have 1 active actors on pipe
2025-10-02T08:12:52.388200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.388206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.388586Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:52.389542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f02312-663b54a5-c432370c-7663d148_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:52.389554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f02312-663b54a5-c432370c-7663d148_0] Write session will restart in 0.007631s
2025-10-02T08:12:52.389582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f02312-663b54a5-c432370c-7663d148_0] Write session: Do CDS request
2025-10-02T08:12:52.389589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f02312-663b54a5-c432370c-7663d148_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:52.389615Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:52.388968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:52.389037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1582 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f02312-663b54a5-c432370c-7663d148_0
2025-10-02T08:12:52.389198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1582 sessionId: src_id|7f02312-663b54a5-c432370c-7663d148_0 is DEAD
2025-10-02T08:12:52.389334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534417957719806:2513]
2025-10-02T08:12:52.401202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f02312-663b54a5-c432370c-7663d148_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:52.402988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:52.403000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1583
2025-10-02T08:12:52.403184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:52.403212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:52.403218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:52.403221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:52.403670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1583 sessionId:  describe result for acl check
2025-10-02T08:12:52.403704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:52.403706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:52.403708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:52.403713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534417957720067:9238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:52.404262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534417957720067:9238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:52.407924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:52.409995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:52.410238Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:52.410242Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:52.410254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:52.410307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:52.410343Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534417957720092:9230]
2025-10-02T08:12:52.411086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:52.412186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:52.412241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:52.412606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:52.412647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.412648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.412649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.412650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.412651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.412657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.412667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.412671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.412676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.412680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.412686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.412695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.412701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.412707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.412712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.412718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.412723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.412731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.412736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.412742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.412762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:52.418057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534417957720067:9238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:52.424625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534417957720067:9238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:52.424640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534417957720067:9238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:52.424643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534417957720067:9238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:52.424654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:52.427953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:52.429792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:52.429799Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:52.429803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:52.429807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:52.429815Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1582 [1:7556534417957720092:9230]
2025-10-02T08:12:52.429829Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:52.429850Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:52.429854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:52.429858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:52.429860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:52.429878Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:52.429888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:52.429895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:52.429962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.429965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.429969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:52.429972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:52.430043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:52.430047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.430062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.430075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:52.430094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534417957720083:9230]
2025-10-02T08:12:52.430097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534417957720083:9230]
2025-10-02T08:12:52.430105Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:52.430119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:52.430134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:52.430137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:52.430173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534417957720083:9230]
2025-10-02T08:12:52.430180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:52.430606Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:52.430614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:52.430620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:52.431009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1582
2025-10-02T08:12:52.431021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534417957720129:9238], now have 1 active actors on pipe
2025-10-02T08:12:52.431026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534418417523332:2378], now have 1 active actors on pipe
2025-10-02T08:12:52.431138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1582
2025-10-02T08:12:52.431450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.431459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.431492Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:52.431500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:52.431504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:52.431506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:52.431517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:52.431530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:52.431548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:52.431656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.431660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.431673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:52.431706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1583 partition: 0 MaxSeqNo: 17 sessionId: src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0
2025-10-02T08:12:52.434850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f02312-663b54a5-c432370c-7663d148_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:52.437680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0] Write session: try to update token
2025-10-02T08:12:52.437696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:52.457858Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:52.457876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:52.457880Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:52.457895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534417957720083:9230]
2025-10-02T08:12:52.457901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534417957720083:9230]
2025-10-02T08:12:52.457954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:52.457962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.457965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:52.458127Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:52.464925Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:52.464944Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:52.469965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId: src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:52.473197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:52.489764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534417957720144:2513]
2025-10-02T08:12:52.490453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1582, pipe: [1:7556534417957720144:2513]
2025-10-02T08:12:52.613802Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:52.614366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.614378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.614421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534417957720144:2513], now have 1 active actors on pipe
2025-10-02T08:12:52.615878Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:52.615887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534417957720144:2513]
2025-10-02T08:12:52.615914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:52.615980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1583 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0
2025-10-02T08:12:52.616178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1583 sessionId: src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0 is DEAD
2025-10-02T08:12:52.616413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:52.616425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0] Write session will restart in 0.006653s
2025-10-02T08:12:52.616449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0] Write session: Do CDS request
2025-10-02T08:12:52.616458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:52.616708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:52.625713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:52.626000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:52.626014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1584
2025-10-02T08:12:52.626122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:52.626148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:52.626154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:52.626158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:52.626765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1584 sessionId:  describe result for acl check
2025-10-02T08:12:52.626792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:52.626795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:52.626797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:52.626803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534417957720190:9233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:52.627595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534417957720190:9233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:52.640116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:52.642743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534417957720190:9233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:52.643466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:52.643687Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:52.643691Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:52.643700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:52.643744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:52.643778Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534417957720434:9234]
2025-10-02T08:12:52.644495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:52.644761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:52.644824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:52.645122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:52.645203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.645204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.645205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.645207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.645208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.645214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.645225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.645229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.645233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.645238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.645243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.645251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.645256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.645262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.645267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.645272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.645276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.645282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.645286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.645291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.645311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:52.652877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534417957720190:9233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:52.652892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534417957720190:9233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:52.652895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534417957720190:9233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:52.652903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:52.653895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:52.655768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:52.655787Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:52.655790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:52.655793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:52.655801Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1583 [1:7556534417957720434:9234]
2025-10-02T08:12:52.655813Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:52.655832Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:52.655835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:52.655838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:52.655840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:52.655857Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:52.655862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:52.655868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:52.655939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.655942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.655946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:52.655948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:52.656014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:52.656016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.656029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.656041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:52.656057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534417957720424:9234]
2025-10-02T08:12:52.656059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534417957720424:9234]
2025-10-02T08:12:52.656066Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:52.656079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:52.656085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:52.656088Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:52.656093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:52.656096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:52.656135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534417957720457:9233], now have 1 active actors on pipe
2025-10-02T08:12:52.656135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1583
2025-10-02T08:12:52.656138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534417957720424:9234]
2025-10-02T08:12:52.656157Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:52.656157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:52.656163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534418417523338:2378], now have 1 active actors on pipe
2025-10-02T08:12:52.656168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.656173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.656223Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:52.656238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:52.656242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:52.656243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:52.656252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:52.656261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:52.656284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:52.656247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1583
2025-10-02T08:12:52.656317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.656323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.656335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:52.656368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1584 partition: 0 MaxSeqNo: 17 sessionId: src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0
2025-10-02T08:12:52.656758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1489cfd7-3e433e9b-de63f63d-6769e10d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:52.659613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0] Write session: try to update token
2025-10-02T08:12:52.659631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:52.676269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId: src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:52.677988Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:52.678007Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:52.678009Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:52.678018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534417957720424:9234]
2025-10-02T08:12:52.678021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534417957720424:9234]
2025-10-02T08:12:52.678065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:52.678074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.678076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:52.678276Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:52.679376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:52.679463Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:52.679470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:52.715853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534417957720474:2513]
2025-10-02T08:12:52.716000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1583, pipe: [1:7556534417957720474:2513]
2025-10-02T08:12:52.831575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:52.831603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0] Write session will restart in 0.009004s
2025-10-02T08:12:52.831629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0] Write session: Do CDS request
2025-10-02T08:12:52.831636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:52.831663Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:52.830715Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:52.831021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.831029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.831071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534417957720474:2513], now have 1 active actors on pipe
2025-10-02T08:12:52.831208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:52.831212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:52.831280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1584 reason: error at write: Disconnected sessionId: src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0
2025-10-02T08:12:52.831315Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:52.831441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1584 sessionId: src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0 is DEAD
2025-10-02T08:12:52.831566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534417957720474:2513]
2025-10-02T08:12:52.845211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:52.845623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:52.845636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1585
2025-10-02T08:12:52.845707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:52.847813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:52.848007Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:52.848017Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:52.848026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:52.848070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:52.848109Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534417957720736:9214]
2025-10-02T08:12:52.848742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:52.848927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:52.848973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:52.848983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:52.848987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:52.849029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:52.849091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:52.849386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1585 sessionId:  describe result for acl check
2025-10-02T08:12:52.849417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:52.849423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:52.849425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:52.849431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534417957720746:9212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:52.849574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:52.849630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.849635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.849637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.849638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.849639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.849645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.849657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.849666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.849671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.849679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.849685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.849698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:52.849709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.849721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:52.849730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.849735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:52.849740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.849745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.849750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.849756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.849780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:52.849937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534417957720746:9212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:52.859481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:52.861256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:52.861264Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:52.861267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:52.861271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:52.861277Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1584 [1:7556534417957720736:9214]
2025-10-02T08:12:52.861291Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:52.861309Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:52.861312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:52.861315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:52.861318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:52.861335Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:52.861341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:52.861348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:52.861419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.861422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.861425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:52.861427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:52.861498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:52.861501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.861516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:52.861538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:52.861557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534418417523347:2378], now have 1 active actors on pipe
2025-10-02T08:12:52.861564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534417957720728:9214]
2025-10-02T08:12:52.861566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534417957720728:9214]
2025-10-02T08:12:52.861576Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:52.861588Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:52.861590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:52.861594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:52.861604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:52.861611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:52.861645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534417957720728:9214]
2025-10-02T08:12:52.861656Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:52.861660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:52.861666Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1584
2025-10-02T08:12:52.862627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534417957720746:9212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:52.870407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534417957720746:9212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:52.870425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534417957720746:9212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:52.870428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534417957720746:9212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:52.870437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:52.870825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1584
2025-10-02T08:12:52.870842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534417957720805:9212], now have 1 active actors on pipe
2025-10-02T08:12:52.870848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.870855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.870882Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:52.870895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:52.870900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:52.870904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:52.870915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:52.870931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:52.870951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:52.870979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:52.870985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:52.870996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:52.871022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1585 partition: 0 MaxSeqNo: 17 sessionId: src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0
2025-10-02T08:12:52.872925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245b772e-8b94212c-e194dc6a-b2f72ef0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:52.873174Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:52.873186Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:52.873193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534417957720728:9214]
2025-10-02T08:12:52.873229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:52.873229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:52.873399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:52.873546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:52.873674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:52.873801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:52.873979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:52.874015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:52.875654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0] Write session: try to update token
2025-10-02T08:12:52.875673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:52.894849Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:52.894866Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:52.894868Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:52.894875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534417957720728:9214]
2025-10-02T08:12:52.894877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534417957720728:9214]
2025-10-02T08:12:52.894913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:52.894920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:52.894921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:52.895072Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:52.898102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:52.898118Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:52.904969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId: src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:52.908017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:52.932081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534417957720829:2513]
2025-10-02T08:12:52.932316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1584, pipe: [1:7556534417957720829:2513]
2025-10-02T08:12:53.052884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:53.050955Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:53.051566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.051575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.051596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534417957720829:2513], now have 1 active actors on pipe
2025-10-02T08:12:53.052262Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:53.052861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:53.052913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1585 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0
2025-10-02T08:12:53.053104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1585 sessionId: src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0 is DEAD
2025-10-02T08:12:53.053228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534417957720829:2513]
2025-10-02T08:12:53.057091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:53.057105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0] Write session will restart in 0.007436s
2025-10-02T08:12:53.057132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0] Write session: Do CDS request
2025-10-02T08:12:53.057139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:53.065306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:53.066131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:53.066150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1586
2025-10-02T08:12:53.066300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:53.066322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:53.066326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:53.066328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:53.066842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1586 sessionId:  describe result for acl check
2025-10-02T08:12:53.066891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:53.066892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:53.066894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:53.066899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534422252688148:9173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:53.067441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534422252688148:9173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:53.073860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534422252688148:9173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:53.079971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534422252688148:9173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:53.079994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534422252688148:9173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:53.079998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534422252688148:9173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:53.080009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:53.083745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:53.086435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:53.086655Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:53.086664Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:53.086674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:53.086725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:53.086769Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534422252688433:9176]
2025-10-02T08:12:53.087416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:53.087711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:53.087767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:53.088113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:53.088183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.088190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.088191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.088193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.088194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.088200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.088210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.088214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.088218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.088221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.088227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.088234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.088240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.088246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.088251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.088256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.088260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.088265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.088271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.088277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.088301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:53.097636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:53.100075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:53.100083Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:53.100085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:53.100089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:53.100095Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1585 [1:7556534422252688433:9176]
2025-10-02T08:12:53.100107Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:53.100125Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:53.100129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:53.100131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:53.100133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:53.100166Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:53.100172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:53.100180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:53.100251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.100253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.100256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:53.100258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:53.100333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:53.100335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.100351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.100362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:53.100379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534422252688427:9176]
2025-10-02T08:12:53.100381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534422252688427:9176]
2025-10-02T08:12:53.100388Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:53.100403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534422252688413:9173], now have 1 active actors on pipe
2025-10-02T08:12:53.100411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:53.100414Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:53.100418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:53.100425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:53.100428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:53.100460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534422712490671:2378], now have 1 active actors on pipe
2025-10-02T08:12:53.100463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534422252688427:9176]
2025-10-02T08:12:53.100466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:53.100508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1585
2025-10-02T08:12:53.100590Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:53.100686Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1585
2025-10-02T08:12:53.100746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.100754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.100780Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:53.100788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:53.100793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:53.100795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:53.100868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:53.100880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:53.100903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:53.100930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.100933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.100945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:53.100977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1586 partition: 0 MaxSeqNo: 17 sessionId: src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0
2025-10-02T08:12:53.101282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6f6991-661b19c0-66f2e053-ee43086a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:53.103826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0] Write session: try to update token
2025-10-02T08:12:53.103841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:53.119676Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:53.119698Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:53.119700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:53.119711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534422252688427:9176]
2025-10-02T08:12:53.119716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534422252688427:9176]
2025-10-02T08:12:53.119759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:53.119765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.119768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:53.119912Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:53.125255Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:53.125273Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:53.127525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId: src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:53.130189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:53.157772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534422252688457:2513]
2025-10-02T08:12:53.160938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1585, pipe: [1:7556534422252688457:2513]
2025-10-02T08:12:53.274786Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:53.275065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.275077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.275118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534422252688457:2513], now have 1 active actors on pipe
2025-10-02T08:12:53.275488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:53.275707Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:53.275735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:53.275791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1586 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0
2025-10-02T08:12:53.275927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534422252688457:2513]
2025-10-02T08:12:53.275966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1586 sessionId: src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0 is DEAD
2025-10-02T08:12:53.276199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:53.276207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0] Write session will restart in 0.005915s
2025-10-02T08:12:53.276228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0] Write session: Do CDS request
2025-10-02T08:12:53.276233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:53.283266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:53.283300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:53.283317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1587
2025-10-02T08:12:53.283471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:53.283502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:53.283516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:53.283520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:53.283925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1587 sessionId:  describe result for acl check
2025-10-02T08:12:53.283961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:53.283963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:53.283964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:53.283969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534422252688688:9154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:53.284389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534422252688688:9154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:53.286855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534422252688688:9154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:53.286929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:53.288240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:53.288418Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:53.288427Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:53.288437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:53.288488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:53.288524Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534422252688754:9152]
2025-10-02T08:12:53.289171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:53.289345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:53.289402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:53.289437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534422252688688:9154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:53.289448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534422252688688:9154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:53.289451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534422252688688:9154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:53.289483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:53.289711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:53.289766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.289772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.289773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.289773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.289774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.289779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.289787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.289790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.289794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.289801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.289806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.289813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.289818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.289826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.289831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.289840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.289848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.289853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.289857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.289862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.289884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:53.297784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:53.299425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:53.299449Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:53.299452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:53.299455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:53.299463Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1586 [1:7556534422252688754:9152]
2025-10-02T08:12:53.299475Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:53.299493Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:53.299495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:53.299499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:53.299501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:53.299519Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:53.299529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:53.299535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:53.299588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.299594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.299597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:53.299599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:53.299652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:53.299657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.299667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.299674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:53.299687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534422252688737:9152]
2025-10-02T08:12:53.299692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534422252688737:9152]
2025-10-02T08:12:53.299699Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:53.299711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:53.299723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:53.299727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:53.299730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:53.299731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:53.299741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534422252688767:9154], now have 1 active actors on pipe
2025-10-02T08:12:53.299743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1586
2025-10-02T08:12:53.299774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534422712490680:2378], now have 1 active actors on pipe
2025-10-02T08:12:53.299783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534422252688737:9152]
2025-10-02T08:12:53.299791Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:53.299802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.299806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.299809Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:53.299843Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:53.299852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:53.299855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:53.299856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:53.299864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:53.299875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:53.299893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:53.299934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.299940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.299954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:53.299991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1587 partition: 0 MaxSeqNo: 17 sessionId: src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0
2025-10-02T08:12:53.300075Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1586
2025-10-02T08:12:53.300397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbf9b33-35ffd905-1af6ea15-64527d5a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:53.303572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0] Write session: try to update token
2025-10-02T08:12:53.303590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:53.317980Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:53.317997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:53.317999Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:53.318008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534422252688737:9152]
2025-10-02T08:12:53.318011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534422252688737:9152]
2025-10-02T08:12:53.318044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:53.318052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.318054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:53.318057Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:53.318065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:53.318180Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:53.319781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId: src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:53.322947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:53.375393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534422252688800:2513]
2025-10-02T08:12:53.375566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1586, pipe: [1:7556534422252688800:2513]
2025-10-02T08:12:53.468647Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:53.469114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.469129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.469176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534422252688800:2513], now have 1 active actors on pipe
2025-10-02T08:12:53.469882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:53.470691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:53.470702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0] Write session will restart in 0.006403s
2025-10-02T08:12:53.470727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0] Write session: Do CDS request
2025-10-02T08:12:53.470733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:53.470012Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:53.470336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:53.470391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1587 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0
2025-10-02T08:12:53.470554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1587 sessionId: src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0 is DEAD
2025-10-02T08:12:53.470728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534422252688800:2513]
2025-10-02T08:12:53.480322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:53.480773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:53.480793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1588
2025-10-02T08:12:53.480968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:53.480999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:53.481008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:53.481013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:53.482336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1588 sessionId:  describe result for acl check
2025-10-02T08:12:53.482375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:53.482377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:53.482379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:53.482385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534422252688938:9145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:53.482925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534422252688938:9145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:53.495835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:53.495899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534422252688938:9145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:53.498466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:53.498695Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:53.498704Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:53.498714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:53.498766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:53.498803Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534422252689091:9147]
2025-10-02T08:12:53.499398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:53.499832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:53.499875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:53.500225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:53.500278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.500279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.500281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.500282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.500283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.500289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.500301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.500306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.500310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.500314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.500319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.500327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.500332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.500337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.500342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.500351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.500355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.500360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.500365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.500370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.500392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:53.511127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534422252688938:9145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:53.511141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534422252688938:9145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:53.511144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534422252688938:9145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:53.511152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:53.511974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:53.513677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:53.513699Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:53.513702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:53.513705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:53.513712Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1587 [1:7556534422252689091:9147]
2025-10-02T08:12:53.513726Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:53.513746Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:53.513750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:53.513753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:53.513755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:53.513773Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:53.513779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:53.513787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:53.513857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.513866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.513870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:53.513873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:53.513948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:53.513956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.513969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.513981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:53.514000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534422252689115:9145], now have 1 active actors on pipe
2025-10-02T08:12:53.514003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534422712490699:2378], now have 1 active actors on pipe
2025-10-02T08:12:53.514006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1587
2025-10-02T08:12:53.514010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534422252689081:9147]
2025-10-02T08:12:53.514012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534422252689081:9147]
2025-10-02T08:12:53.514023Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:53.514036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.514041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.514057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:53.514071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:53.514073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:53.514096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:53.514099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:53.514119Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:53.514125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:53.514129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:53.514131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:53.514139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:53.514148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:53.514156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534422252689081:9147]
2025-10-02T08:12:53.514163Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:53.514194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:53.514196Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:53.514331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.514336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.514360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:53.514403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1588 partition: 0 MaxSeqNo: 17 sessionId: src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0
2025-10-02T08:12:53.514777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96ec7955-383d3b76-4ece6e1a-1d117bb9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:53.514155Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1587
2025-10-02T08:12:53.517516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0] Write session: try to update token
2025-10-02T08:12:53.517534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:53.543691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId: src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:53.545827Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:53.545844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:53.545846Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:53.545856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534422252689081:9147]
2025-10-02T08:12:53.545860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534422252689081:9147]
2025-10-02T08:12:53.545906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:53.545914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.545917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:53.546075Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:53.546748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:53.546842Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:53.546847Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:53.570405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534422252689132:2513]
2025-10-02T08:12:53.570637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1587, pipe: [1:7556534422252689132:2513]
2025-10-02T08:12:53.705521Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:53.705999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.706007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.706055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534422252689132:2513], now have 1 active actors on pipe
2025-10-02T08:12:53.709971Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:53.710741Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:53.711226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534422252689132:2513]
2025-10-02T08:12:53.711250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:53.711314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1588 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0
2025-10-02T08:12:53.711520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1588 sessionId: src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0 is DEAD
2025-10-02T08:12:53.713064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:53.713083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0] Write session will restart in 0.007791s
2025-10-02T08:12:53.713115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0] Write session: Do CDS request
2025-10-02T08:12:53.713122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:53.723329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:53.724690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:53.724709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1589
2025-10-02T08:12:53.724956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:53.724989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:53.724995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:53.724998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:53.725414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1589 sessionId:  describe result for acl check
2025-10-02T08:12:53.725449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:53.725451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:53.725453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:53.725459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534422252689156:9141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:53.725995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534422252689156:9141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:53.738207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534422252689156:9141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:53.755651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534422252689156:9141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:53.755677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534422252689156:9141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:53.755681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534422252689156:9141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:53.755691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:53.756860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:53.759267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:53.759647Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:53.759652Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:53.759673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:53.759733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:53.759782Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534422252689445:9140]
2025-10-02T08:12:53.760522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:53.760996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:53.761050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:53.761403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:53.761440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.761441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.761443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.761444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.761449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.761454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.761464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.761468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.761471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.761475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.761481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.761488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:53.761494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.761499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:53.761504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.761508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:53.761512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.761517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.761522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.761526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.761547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:53.783841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:53.785777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:53.785795Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:53.785799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:53.785802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:53.785809Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1588 [1:7556534422252689445:9140]
2025-10-02T08:12:53.785822Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:53.785841Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:53.785845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:53.785848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:53.785850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:53.785869Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:53.785873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:53.785887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:53.785964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.785966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.785969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:53.785971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:53.786247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:53.786257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.786273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:53.786285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:53.786303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534422252689436:9140]
2025-10-02T08:12:53.786305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534422252689436:9140]
2025-10-02T08:12:53.786318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:53.786333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:53.786346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:53.786349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:53.786385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534422252689436:9140]
2025-10-02T08:12:53.786387Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:53.787361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1588
2025-10-02T08:12:53.786774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:53.786780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:53.786785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:53.787375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1588
2025-10-02T08:12:53.787390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534422252689432:9141], now have 1 active actors on pipe
2025-10-02T08:12:53.787394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534422712490715:2378], now have 1 active actors on pipe
2025-10-02T08:12:53.789024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.789041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.789086Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:53.789097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:53.789103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:53.789106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:53.789124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:53.789140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:53.789164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:53.789979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da873243-7eec9c7e-a6a368c4-f66a7b33_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:53.792908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0] Write session: try to update token
2025-10-02T08:12:53.792925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:53.789511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.789520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.789552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:53.789588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1589 partition: 0 MaxSeqNo: 17 sessionId: src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0
2025-10-02T08:12:53.808986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534422252689467:2513]
2025-10-02T08:12:53.811125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1588, pipe: [1:7556534422252689467:2513]
2025-10-02T08:12:53.811150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534422252689467:2513], now have 1 active actors on pipe
2025-10-02T08:12:53.823580Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:53.823603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:53.823606Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:53.823617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534422252689436:9140]
2025-10-02T08:12:53.823623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534422252689436:9140]
2025-10-02T08:12:53.823674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:53.823678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:53.823682Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:53.823686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:53.823688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:53.823884Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:53.845096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId: src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:53.848469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:53.990753Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:53.991263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:53.991275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:53.992119Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:53.992459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534422252689467:2513]
2025-10-02T08:12:53.992480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:53.992536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1589 reason: status is not ok: tablet will be restarted right now sessionId: src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0
2025-10-02T08:12:53.992714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1589 sessionId: src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0 is DEAD
2025-10-02T08:12:53.992792Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:53.993080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:53.993093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0] Write session will restart in 0.005709s
2025-10-02T08:12:53.993119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0] Write session: Do CDS request
2025-10-02T08:12:53.993125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:54.000540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:54.000595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:54.000611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1590
2025-10-02T08:12:54.000797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:54.000836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:54.000841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:54.000845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:54.001556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1590 sessionId:  describe result for acl check
2025-10-02T08:12:54.001588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:54.001590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:54.001592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:54.001597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534426547656815:9101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:54.002196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534426547656815:9101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:54.012848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534426547656815:9101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:54.024780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534426547656815:9101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:54.024816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534426547656815:9101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:54.024820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534426547656815:9101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:54.024831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:54.028378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:54.029219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:54.029512Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:54.029517Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:54.029531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:54.029596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:54.029644Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534426547657105:9102]
2025-10-02T08:12:54.030410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:54.031272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:54.031324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:54.032089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:54.032169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.032171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.032172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.032174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.032175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.032182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.032195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.032199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.032203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.032207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.032214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.032223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.032228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.032234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.032239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.032244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.032249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.032255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.032259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.032264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.032286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:54.047734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198a3bcd-d4c5902a-131a0303-cd1c41dc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:54.046377Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1589
2025-10-02T08:12:54.043323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:54.045168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:54.045174Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:54.045176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:54.045181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:54.045187Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1589 [1:7556534426547657105:9102]
2025-10-02T08:12:54.045201Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:54.045220Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:54.045224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:54.045227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:54.045229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:54.045249Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:54.045255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:54.045263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:54.045335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.045337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.045340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:54.045343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:54.045422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:54.045424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.045439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.045450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:54.045468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534426547657099:9102]
2025-10-02T08:12:54.045470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534426547657099:9102]
2025-10-02T08:12:54.045483Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:54.045497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:54.045511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:54.045513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:54.045547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534426547657099:9102]
2025-10-02T08:12:54.045549Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:54.045689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:54.045691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:54.045696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:54.046389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1589
2025-10-02T08:12:54.046401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534426547657087:9101], now have 1 active actors on pipe
2025-10-02T08:12:54.046406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534422712490735:2378], now have 1 active actors on pipe
2025-10-02T08:12:54.046465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.046470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.046496Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:54.046505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:54.046509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:54.046511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:54.046523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:54.046534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:54.046552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:54.046626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.046628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.046642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:54.046675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1590 partition: 0 MaxSeqNo: 17 sessionId: src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0
2025-10-02T08:12:54.050320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0] Write session: try to update token
2025-10-02T08:12:54.050335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:54.076608Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:54.076635Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:54.076639Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:54.076650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534426547657099:9102]
2025-10-02T08:12:54.076663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534426547657099:9102]
2025-10-02T08:12:54.076731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:54.076739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.076737Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:54.076742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:54.076747Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:54.076954Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:54.086098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId: src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:54.089102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:54.099740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534426547657138:2513]
2025-10-02T08:12:54.105137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1589, pipe: [1:7556534426547657138:2513]
2025-10-02T08:12:54.268606Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:54.271215Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:54.269105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.269131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.269161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534426547657138:2513], now have 1 active actors on pipe
2025-10-02T08:12:54.270060Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:54.270357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534426547657138:2513]
2025-10-02T08:12:54.270383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:54.270463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1590 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0
2025-10-02T08:12:54.270683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1590 sessionId: src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0 is DEAD
2025-10-02T08:12:54.271811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:54.271823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0] Write session will restart in 0.007666s
2025-10-02T08:12:54.271854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0] Write session: Do CDS request
2025-10-02T08:12:54.271861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:54.281239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:54.281614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:54.281630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1591
2025-10-02T08:12:54.281754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:54.281785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:54.281791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:54.281794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:54.282232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1591 sessionId:  describe result for acl check
2025-10-02T08:12:54.282259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:54.282261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:54.282262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:54.282268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534426547657178:9094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:54.282800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534426547657178:9094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:54.286067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534426547657178:9094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:54.298258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:54.300267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:54.300435Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:54.300438Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:54.300445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:54.300483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:54.300515Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534426547657445:9091]
2025-10-02T08:12:54.300632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534426547657178:9094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:54.300640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534426547657178:9094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:54.300643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534426547657178:9094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:54.300651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:54.301116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:54.301451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:54.301496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:54.301772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:54.301799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.301800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.301801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.301802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.301803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.301807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.301816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.301819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.301822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.301825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.301830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.301836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.301841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.301845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.301848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.301853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.301856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.301861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.301865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.301869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.301884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:54.311349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:54.313201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:54.313214Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:54.313217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:54.313220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:54.313226Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1590 [1:7556534426547657445:9091]
2025-10-02T08:12:54.313238Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:54.313254Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:54.313257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:54.313260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:54.313262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:54.313277Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:54.313282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:54.313289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:54.313350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.313356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.313359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:54.313361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:54.313456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:54.313459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.313471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.313481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:54.313497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534426547657439:9091]
2025-10-02T08:12:54.313499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534426547657439:9091]
2025-10-02T08:12:54.313508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:54.313519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:54.313530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:54.313533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:54.313566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534426547657439:9091]
2025-10-02T08:12:54.313568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:54.313754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:54.313756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:54.313760Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:54.314830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1590
2025-10-02T08:12:54.314849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534426547657450:9094], now have 1 active actors on pipe
2025-10-02T08:12:54.314853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534427007458050:2378], now have 1 active actors on pipe
2025-10-02T08:12:54.315390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.315398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.315430Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:54.315442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:54.315447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:54.315450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:54.315463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:54.315477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:54.315496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:54.315611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.315615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.315628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:54.315660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1591 partition: 0 MaxSeqNo: 17 sessionId: src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0
2025-10-02T08:12:54.317306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5049718-da19b284-f2d7a0c1-13ad4f5e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:54.317327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1590
2025-10-02T08:12:54.320209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0] Write session: try to update token
2025-10-02T08:12:54.320226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:54.337569Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:54.337590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:54.337592Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:54.337601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534426547657439:9091]
2025-10-02T08:12:54.337605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534426547657439:9091]
2025-10-02T08:12:54.337651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:54.337660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.337662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:54.337879Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:54.341247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:54.341256Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:54.352247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId: src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:54.355214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:54.372915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534426547657475:2513]
2025-10-02T08:12:54.374112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1590, pipe: [1:7556534426547657475:2513]
2025-10-02T08:12:54.554097Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:54.555222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.555233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.555257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534426547657475:2513], now have 1 active actors on pipe
2025-10-02T08:12:54.556199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:54.556203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:54.556289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1591 reason: error at write: Disconnected sessionId: src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0
2025-10-02T08:12:54.556474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1591 sessionId: src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0 is DEAD
2025-10-02T08:12:54.556635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534426547657475:2513]
2025-10-02T08:12:54.556684Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:54.560907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:54.560925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0] Write session will restart in 0.007211s
2025-10-02T08:12:54.560954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0] Write session: Do CDS request
2025-10-02T08:12:54.560964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:54.556881Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:54.575207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:54.585705Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:54.585729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1592
2025-10-02T08:12:54.585892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:54.585927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:54.585932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:54.585936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:54.593282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1592 sessionId:  describe result for acl check
2025-10-02T08:12:54.593333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:54.593335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:54.593337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:54.593343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534426547657533:9071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:54.593960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534426547657533:9071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:54.617727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534426547657533:9071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:54.620999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:54.629077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:54.629342Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:54.629347Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:54.629358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:54.629419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:54.629458Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534426547657802:9075]
2025-10-02T08:12:54.630128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:54.630475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534426547657533:9071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:54.630482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534426547657533:9071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:54.630485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534426547657533:9071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:54.630494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:54.636887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:54.636995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:54.637407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:54.637458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.637459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.637460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.637462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.637463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.637470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.637480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.637484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.637488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.637492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.637499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.637508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.637514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.637520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.637524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.637530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.637535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.637540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.637544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.637549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.637575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:54.657128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534426547657822:2513]
2025-10-02T08:12:54.674267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:54.676142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:54.676168Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:54.676172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:54.676176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:54.676186Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1591 [1:7556534426547657802:9075]
2025-10-02T08:12:54.676201Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:54.676223Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:54.676226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:54.676231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:54.676234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:54.676254Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:54.676260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:54.676269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:54.676351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.676354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.676357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:54.676361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:54.676442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:54.676445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.676461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.676473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:54.676493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534426547657795:9075]
2025-10-02T08:12:54.676495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534426547657795:9075]
2025-10-02T08:12:54.676508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:54.676523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:54.676537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:54.676540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:54.676579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534426547657795:9075]
2025-10-02T08:12:54.676582Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:54.676859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:54.676865Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:54.676871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:54.676975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1591
2025-10-02T08:12:54.676990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534426547657808:9071], now have 1 active actors on pipe
2025-10-02T08:12:54.676996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534426547657822:2513], now have 1 active actors on pipe
2025-10-02T08:12:54.677003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.677010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.677040Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:54.677048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:54.677052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:54.677055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:54.677067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:54.677081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:54.677092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534427007458069:2378], now have 1 active actors on pipe
2025-10-02T08:12:54.677106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:54.677132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1591, pipe: [1:7556534426547657822:2513]
2025-10-02T08:12:54.677209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.677211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.677228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:54.677272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1592 partition: 0 MaxSeqNo: 17 sessionId: src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0
2025-10-02T08:12:54.684937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1841f5b0-f23aa963-837cdd82-d1f25038_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:54.681686Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1591
2025-10-02T08:12:54.687948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0] Write session: try to update token
2025-10-02T08:12:54.687965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:54.727595Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:54.727615Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:54.727618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:54.727627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534426547657795:9075]
2025-10-02T08:12:54.727632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534426547657795:9075]
2025-10-02T08:12:54.727676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:54.727683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.727686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:54.727880Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:54.728845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId: src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:54.728912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:54.728918Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:54.732035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:54.901445Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:54.902044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.902053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.906742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:54.906756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0] Write session will restart in 0.008033s
2025-10-02T08:12:54.906780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0] Write session: Do CDS request
2025-10-02T08:12:54.906787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:54.905676Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:54.906177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534426547657822:2513]
2025-10-02T08:12:54.906197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:54.906253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1592 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0
2025-10-02T08:12:54.906433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1592 sessionId: src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0 is DEAD
2025-10-02T08:12:54.905463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:54.919548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:54.921766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:54.921782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1593
2025-10-02T08:12:54.922661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:54.922691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:54.922698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:54.922702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:54.923320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1593 sessionId:  describe result for acl check
2025-10-02T08:12:54.923347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:54.923348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:54.923349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:54.923354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534426547657875:9058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:54.923836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534426547657875:9058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:54.940980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534426547657875:9058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:54.948870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534426547657875:9058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:54.948873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:54.948889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534426547657875:9058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:54.948892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534426547657875:9058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:54.948902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:54.951620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:54.951832Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:54.951835Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:54.951845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:54.951893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:54.951930Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534426547658154:9060]
2025-10-02T08:12:54.952660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:54.953073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:54.953120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:54.953446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:54.953486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.953488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.953490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.953491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.953492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.953498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.953508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.953512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.953516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.953520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.953526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.953534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:54.953539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.953545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:54.953550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.953555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:54.953560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.953565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.953570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.953575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.953595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:54.966321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:54.968091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:54.968096Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:54.968099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:54.968102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:54.968109Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1592 [1:7556534426547658154:9060]
2025-10-02T08:12:54.968121Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:54.968136Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:54.968138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:54.968141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:54.968143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:54.968174Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:54.968180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:54.968186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:54.968261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.968263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.968267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:54.968269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:54.968335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:54.968339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.968353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:54.968366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:54.968383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534426547658141:9060]
2025-10-02T08:12:54.968385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534426547658141:9060]
2025-10-02T08:12:54.968399Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:54.968412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:54.968426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:54.968429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:54.968462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534426547658141:9060]
2025-10-02T08:12:54.968464Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:54.968684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:54.968690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:54.968696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:54.969477Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1592
2025-10-02T08:12:54.972370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1592
2025-10-02T08:12:54.972399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534426547658149:9058], now have 1 active actors on pipe
2025-10-02T08:12:54.972404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534427007458079:2378], now have 1 active actors on pipe
2025-10-02T08:12:54.974260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.974276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.974309Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:54.974319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:54.974324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:54.974327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:54.974340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:54.974357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:54.974381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:54.976291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:54.976309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:54.976344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:54.976408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1593 partition: 0 MaxSeqNo: 17 sessionId: src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0
2025-10-02T08:12:54.976884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe7f5d4-77a798eb-a1a13e90-27b490a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:54.979870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0] Write session: try to update token
2025-10-02T08:12:54.979887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:54.994326Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:54.994349Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:54.994353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:54.994362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534426547658141:9060]
2025-10-02T08:12:54.994373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534426547658141:9060]
2025-10-02T08:12:54.994432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:54.994440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:54.994443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:54.994670Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:54.994754Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:54.994761Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:55.046378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534430842625487:2513]
2025-10-02T08:12:55.046412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId: src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:55.049335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:55.052182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1592, pipe: [1:7556534430842625487:2513]
2025-10-02T08:12:55.160563Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:55.159230Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:55.159624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.159632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.159652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534430842625487:2513], now have 1 active actors on pipe
2025-10-02T08:12:55.160099Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:55.160444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534430842625487:2513]
2025-10-02T08:12:55.160461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:55.160513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1593 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0
2025-10-02T08:12:55.160697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1593 sessionId: src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0 is DEAD
2025-10-02T08:12:55.164901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:55.164915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0] Write session will restart in 0.008732s
2025-10-02T08:12:55.164951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0] Write session: Do CDS request
2025-10-02T08:12:55.164958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:55.176002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:55.176956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:55.176971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1594
2025-10-02T08:12:55.177135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:55.177163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:55.177169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:55.177172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:55.177731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1594 sessionId:  describe result for acl check
2025-10-02T08:12:55.177760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:55.177764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:55.177766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:55.177770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534430842625688:9005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:55.178432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534430842625688:9005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:55.191594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:55.192207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534430842625688:9005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:55.201687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:55.201922Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:55.201926Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:55.201936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:55.201993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:55.202032Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534430842625823:8998]
2025-10-02T08:12:55.202596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:55.203496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:55.203554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:55.203848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:55.203897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.203898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.203899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.203900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.203901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.203906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.203915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.203919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.203922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.203925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.203931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.203938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.203944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.203948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.203952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.203957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.203960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.203965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.203969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.203973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.203991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:55.204732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534430842625688:9005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:55.204743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534430842625688:9005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:55.204746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534430842625688:9005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:55.204756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:55.215188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:55.217121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:55.217128Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:55.217130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:55.217134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:55.217141Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1593 [1:7556534430842625823:8998]
2025-10-02T08:12:55.217154Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:55.217172Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:55.217175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:55.217179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:55.217180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:55.217195Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:55.217200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:55.217207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:55.217272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.217274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.217276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:55.217278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:55.217345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:55.217347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.217360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.217372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:55.217389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534430842625806:8998]
2025-10-02T08:12:55.217391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534430842625806:8998]
2025-10-02T08:12:55.217398Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:55.217410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:55.217423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:55.217426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:55.217458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534430842625806:8998]
2025-10-02T08:12:55.217460Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:55.217857Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:55.217864Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:55.217869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:55.218198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1593
2025-10-02T08:12:55.218210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534430842625839:9005], now have 1 active actors on pipe
2025-10-02T08:12:55.218214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534431302425406:2378], now have 1 active actors on pipe
2025-10-02T08:12:55.220115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.220125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.220168Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b25ca5b-713bc350-62192222-19a07138_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:55.220177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:55.220182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:55.220184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:55.220196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:55.220211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:55.220229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:55.220356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.220361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.220372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:55.220406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1594 partition: 0 MaxSeqNo: 17 sessionId: src_id|7b25ca5b-713bc350-62192222-19a07138_0
2025-10-02T08:12:55.221050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75d0c47-a0a9b63c-12f28a80-2e5c60a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7b25ca5b-713bc350-62192222-19a07138_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:55.223735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b25ca5b-713bc350-62192222-19a07138_0] Write session: try to update token
2025-10-02T08:12:55.223756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b25ca5b-713bc350-62192222-19a07138_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:55.220898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1593
2025-10-02T08:12:55.248775Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:55.248791Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:55.248793Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:55.248816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534430842625806:8998]
2025-10-02T08:12:55.248820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534430842625806:8998]
2025-10-02T08:12:55.248862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:55.248873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.248875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:55.249013Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:55.251704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:55.251714Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:55.258046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId: src_id|7b25ca5b-713bc350-62192222-19a07138_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:55.260840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:55.261031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534430842625855:2513]
2025-10-02T08:12:55.261291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1593, pipe: [1:7556534430842625855:2513]
2025-10-02T08:12:55.409177Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:55.409571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.409580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.409602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534430842625855:2513], now have 1 active actors on pipe
2025-10-02T08:12:55.410262Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:55.410619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534430842625855:2513]
2025-10-02T08:12:55.410654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:55.410710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1594 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b25ca5b-713bc350-62192222-19a07138_0
2025-10-02T08:12:55.411089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b25ca5b-713bc350-62192222-19a07138_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:55.411099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b25ca5b-713bc350-62192222-19a07138_0] Write session will restart in 0.007463s
2025-10-02T08:12:55.411126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b25ca5b-713bc350-62192222-19a07138_0] Write session: Do CDS request
2025-10-02T08:12:55.411134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b25ca5b-713bc350-62192222-19a07138_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:55.410905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1594 sessionId: src_id|7b25ca5b-713bc350-62192222-19a07138_0 is DEAD
2025-10-02T08:12:55.410056Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:55.422775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b25ca5b-713bc350-62192222-19a07138_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:55.425366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:55.425379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1595
2025-10-02T08:12:55.425685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:55.425717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:55.425723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:55.425727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:55.426986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1595 sessionId:  describe result for acl check
2025-10-02T08:12:55.427034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:55.427036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:55.427038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:55.427044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534430842625909:9001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:55.427613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534430842625909:9001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:55.437060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534430842625909:9001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:55.449658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534430842625909:9001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:55.449673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534430842625909:9001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:55.449677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534430842625909:9001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:55.449686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:55.461139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:55.461725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:55.461922Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:55.461926Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:55.461937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:55.461995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:55.462037Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534430842626188:9000]
2025-10-02T08:12:55.462790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:55.463100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:55.463150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:55.463476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:55.463529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.463530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.463532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.463533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.463535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.463540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.463552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.463557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.463561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.463565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.463572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.463580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.463587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.463593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.463599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.463604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.463610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.463615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.463620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.463625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.463646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:55.475198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:55.476958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:55.476965Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:55.476971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:55.476974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:55.476981Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1594 [1:7556534430842626188:9000]
2025-10-02T08:12:55.476993Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:55.477012Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:55.477016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:55.477019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:55.477021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:55.477037Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:55.477043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:55.477049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:55.477118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.477120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.477122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:55.477124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:55.477190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:55.477195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.477207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.477217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:55.477233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534430842626182:9000]
2025-10-02T08:12:55.477236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534430842626182:9000]
2025-10-02T08:12:55.477247Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:55.477260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:55.477274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:55.477277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:55.477309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534430842626182:9000]
2025-10-02T08:12:55.477311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:55.477397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:55.477399Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:55.477404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:55.477755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1594
2025-10-02T08:12:55.477776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534430842626172:9001], now have 1 active actors on pipe
2025-10-02T08:12:55.477781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534431302425425:2378], now have 1 active actors on pipe
2025-10-02T08:12:55.477786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.477791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.477816Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:55.477824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:55.477827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:55.477830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:55.477839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:55.477861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:55.477877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:55.478009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1594
2025-10-02T08:12:55.478290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.478297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.478321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:55.478352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1595 partition: 0 MaxSeqNo: 17 sessionId: src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0
2025-10-02T08:12:55.479152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b25ca5b-713bc350-62192222-19a07138_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:55.481729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0] Write session: try to update token
2025-10-02T08:12:55.481742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:55.489972Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:55.489993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:55.490002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534430842626182:9000]
2025-10-02T08:12:55.490046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:55.490049Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:55.490225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:55.490367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:55.490513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:55.490653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:55.490846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:55.490891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:55.502110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId: src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:55.505303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:55.505429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.505442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.505482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:55.505512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:55.505598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.505609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.505798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.505871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.505945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.506015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.506065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.506077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.506151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.506217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.506283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.506359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.506407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.506417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.506488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.506550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.506616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.506681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.506734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.506743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.506817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.506896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.506979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.507061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.507115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.507125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.507208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.507289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.507369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.507448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.507525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.507534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.507615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.507691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.507770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.507852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.507908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.507916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.507997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.508073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.508168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.508245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.508299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.508310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.508392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.508468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.508548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.508631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.508688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.508696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.508771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.508856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.508928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.509007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.509069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.509078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.509155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.509222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.509290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.509365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.509426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.509434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.509485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:55.509552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:55.509576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:55.509585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:55.509617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:55.509635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:55.509645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:55.509648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:55.509652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:55.509944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534430842626212:2513]
2025-10-02T08:12:55.510118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:55.510147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:55.510159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:55.510166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:55.510169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:55.510173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:55.510657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:55.510683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:55.510689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:55.510692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:55.510695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:55.510699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:55.510803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1594, pipe: [1:7556534430842626212:2513]
2025-10-02T08:12:55.511261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:55.511285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:55.511291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:55.511295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:55.511299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:55.513571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:55.513594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:55.513607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392775512
2025-10-02T08:12:55.513727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:55.513736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:55.513741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:55.513745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:55.513751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:55.513755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:55.514309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:55.514322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:55.514328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:55.514332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:55.514338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:55.514344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:55.514858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:55.514870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:55.514877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:55.514880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:55.514884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:55.514888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:55.515373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:55.515388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:55.515393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:55.516514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:55.516522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:55.516527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:55.516533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:55.516544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392775516
2025-10-02T08:12:55.516848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:55.516862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:55.516868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:55.516873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:55.516876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:55.516882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:55.517342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:55.517369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:55.517374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:55.517378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:55.517382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:55.517386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:55.517876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:55.517887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:55.517992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392775517
2025-10-02T08:12:55.518788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534430842626212:2513], now have 1 active actors on pipe
2025-10-02T08:12:55.518824Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:55.518836Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:55.518843Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:55.518852Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:55.520548Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:55.520551Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:55.520554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:55.520564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534430842626182:9000]
2025-10-02T08:12:55.520568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534430842626182:9000]
2025-10-02T08:12:55.520635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:55.520640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.520642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:55.520709Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:55.520715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:55.520788Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:55.670976Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:55.673446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:55.673458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0] Write session will restart in 0.009654s
2025-10-02T08:12:55.673481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0] Write session: Do CDS request
2025-10-02T08:12:55.673488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:55.672013Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:55.672902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534430842626212:2513]
2025-10-02T08:12:55.672927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:55.672957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1595 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0
2025-10-02T08:12:55.673140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1595 sessionId: src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0 is DEAD
2025-10-02T08:12:55.673005Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:55.684263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:55.684569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:55.684578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1596
2025-10-02T08:12:55.684723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:55.684744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:55.684747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:55.684750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:55.685100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1596 sessionId:  describe result for acl check
2025-10-02T08:12:55.685131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:55.685132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:55.685133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:55.685138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534430842626497:8974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:55.685604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534430842626497:8974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:55.688567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534430842626497:8974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:55.689706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:55.690345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:55.690516Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:55.690525Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:55.690535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:55.690584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:55.690624Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534430842626658:8978]
2025-10-02T08:12:55.691253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:55.691422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:55.691466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:55.691778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:55.691822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.691823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.691824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.691825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.691826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.691830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.691839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.691843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.691847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.691851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.691857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.691863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:55.691868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.691873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:55.691876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534430842626497:8974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:55.691879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.691884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534430842626497:8974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:55.691884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:55.691887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534430842626497:8974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:55.691889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.691893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.691894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:55.691898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.691903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.691922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:55.701787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:55.703347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:55.703360Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:55.703363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:55.703365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:55.703371Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1595 [1:7556534430842626658:8978]
2025-10-02T08:12:55.703380Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:55.703394Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:55.703396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:55.703398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:55.703399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:55.703412Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:55.703416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:55.703421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:55.703475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.703482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.703484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:55.703485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:55.703551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:55.703558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.703571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:55.703586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:55.703607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534430842626652:8978]
2025-10-02T08:12:55.703613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534430842626652:8978]
2025-10-02T08:12:55.703620Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:55.703634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:55.703650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:55.703652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:55.703654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:55.703656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:55.703666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534430842626672:8974], now have 1 active actors on pipe
2025-10-02T08:12:55.703700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534430842626652:8978]
2025-10-02T08:12:55.703707Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:55.703713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534431302425434:2378], now have 1 active actors on pipe
2025-10-02T08:12:55.703749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1595
2025-10-02T08:12:55.703809Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:55.703970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.703980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.704004Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|879c5093-9372455d-46c451ab-e96f34fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:55.704016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:55.704024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:55.704026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:55.704036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:55.704051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:55.704074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:55.704098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.704104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.704116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:55.704159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1596 partition: 0 MaxSeqNo: 17 sessionId: src_id|879c5093-9372455d-46c451ab-e96f34fb_0
2025-10-02T08:12:55.704510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc673c3-fdc52a-85481dfb-5a42c38e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|879c5093-9372455d-46c451ab-e96f34fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:55.703898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1595
2025-10-02T08:12:55.707312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|879c5093-9372455d-46c451ab-e96f34fb_0] Write session: try to update token
2025-10-02T08:12:55.707331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|879c5093-9372455d-46c451ab-e96f34fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:55.720757Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:55.720787Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:55.723278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534430842626652:8978]
2025-10-02T08:12:55.723360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:55.723560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:55.723719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:55.723769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId: src_id|879c5093-9372455d-46c451ab-e96f34fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:55.723860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:55.723994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:55.724195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:55.724225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:55.724290Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:55.726479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:55.726563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.726577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.726613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:55.726646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:55.726690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:55.726696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:55.726920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.727010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.727077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.727141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.727180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.727182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.727249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.727306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.727384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.727474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.727530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.727533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.727625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.727679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.727739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.727799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.727844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.727846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.727911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.727969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.728027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.728087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.728138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.728140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.728224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.728281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.728338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.728393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.728432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.728434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.728496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.728549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.728607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.728666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.728705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.728708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.728773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.728859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.728928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.728993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.729037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.729040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.729142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.729219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.729288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.729355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.729409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.729416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.729490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.729559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.729624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.729699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.729748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.729754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.729831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:55.729904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:55.729978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:55.730110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:55.730160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:55.730166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:55.730203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:55.730273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:55.730297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:55.730302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:55.730338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:55.730356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:55.730363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:55.730366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:55.730371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:55.732133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:55.732183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:55.732198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:55.732205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:55.732208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:55.732212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:55.733384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:55.733435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:55.733445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:55.733453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:55.733459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:55.733462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:55.734346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:55.734370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:55.734376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:55.734379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:55.734381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:55.736521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:55.736538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:55.736549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392775736
2025-10-02T08:12:55.736723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:55.736735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:55.736740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:55.736743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:55.736747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:55.736748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:55.737302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:55.737327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:55.737333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:55.737337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:55.737340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:55.737345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:55.737796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:55.737821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:55.737833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:55.737840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:55.737844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:55.737848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:55.738368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:55.738396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:55.738402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:55.739596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:55.739622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:55.739629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:55.739633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:55.739647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392775739
2025-10-02T08:12:55.739957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:55.739984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:55.739999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:55.740007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:55.740011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:55.740014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:55.740521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:55.740547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:55.740554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:55.740558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:55.740561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:55.740565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:55.741080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:55.741103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:55.741206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392775741
2025-10-02T08:12:55.742013Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:55.742033Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:55.742040Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:55.742049Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:55.744018Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:55.744034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:55.744037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:55.744044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534430842626652:8978]
2025-10-02T08:12:55.744048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534430842626652:8978]
2025-10-02T08:12:55.744114Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:55.744117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:55.744121Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:55.744124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:55.744127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:55.744286Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:55.771498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534430842626700:2513]
2025-10-02T08:12:55.771622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1595, pipe: [1:7556534430842626700:2513]
2025-10-02T08:12:55.963971Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:55.964515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534430842626700:2513], now have 1 active actors on pipe
2025-10-02T08:12:55.969642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:55.969662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:55.969696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1596 reason: error at write: Disconnected sessionId: src_id|879c5093-9372455d-46c451ab-e96f34fb_0
2025-10-02T08:12:55.969924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1596 sessionId: src_id|879c5093-9372455d-46c451ab-e96f34fb_0 is DEAD
2025-10-02T08:12:55.970123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534430842626700:2513]
2025-10-02T08:12:55.970300Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:55.972330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879c5093-9372455d-46c451ab-e96f34fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:55.972343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879c5093-9372455d-46c451ab-e96f34fb_0] Write session will restart in 0.008234s
2025-10-02T08:12:55.972368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879c5093-9372455d-46c451ab-e96f34fb_0] Write session: Do CDS request
2025-10-02T08:12:55.972376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879c5093-9372455d-46c451ab-e96f34fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:55.972879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:55.985201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|879c5093-9372455d-46c451ab-e96f34fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:55.985516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:55.985533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1597
2025-10-02T08:12:55.987054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:55.987092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:55.987098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:55.987101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:55.987870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1597 sessionId:  describe result for acl check
2025-10-02T08:12:55.987899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:55.987901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:55.987903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:55.987908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534430842626745:8966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:55.988486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534430842626745:8966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:56.001966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534430842626745:8966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:56.013683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534430842626745:8966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:56.013700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534430842626745:8966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:56.013703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534430842626745:8966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:56.013712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:56.042176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:56.042706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:56.042907Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:56.042925Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:56.042937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:56.043006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:56.043052Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534435137594435:8958]
2025-10-02T08:12:56.043762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:56.044311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:56.044362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:56.044697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:56.044745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.044746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.044748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.044749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.044750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.044755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.044765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.044768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.044772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.044775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.044782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.044790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.044796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.044820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.044825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.044830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.044834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.044838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.044843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.044848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.044869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:56.062465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:56.064261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:56.064269Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:56.064271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:56.064276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:56.064283Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1596 [1:7556534435137594435:8958]
2025-10-02T08:12:56.064298Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:56.064316Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:56.064319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:56.064323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:56.064324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:56.064342Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:56.064349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:56.064356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:56.064428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.064430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.064433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:56.064435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:56.064512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:56.064514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.064528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.064541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:56.064559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534435137594429:8958]
2025-10-02T08:12:56.064562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534435137594429:8958]
2025-10-02T08:12:56.064577Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:56.064592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:56.064606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:56.064610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:56.064645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534435137594429:8958]
2025-10-02T08:12:56.064647Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:56.064976Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:56.064982Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:56.064988Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:56.066184Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1596
2025-10-02T08:12:56.069134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1596
2025-10-02T08:12:56.069157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534435137594314:8966], now have 1 active actors on pipe
2025-10-02T08:12:56.069163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534431302425441:2378], now have 1 active actors on pipe
2025-10-02T08:12:56.069456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.069465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.069493Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2078093a-5c373978-6bc64fc8-fda50df9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:56.069504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:56.069509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:56.069511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:56.069525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:56.069542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:56.069563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:56.069854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534435137594469:2513]
2025-10-02T08:12:56.069868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.069871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.069890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:56.069928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1597 partition: 0 MaxSeqNo: 17 sessionId: src_id|2078093a-5c373978-6bc64fc8-fda50df9_0
2025-10-02T08:12:56.070119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534435137594469:2513], now have 1 active actors on pipe
2025-10-02T08:12:56.070138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1596, pipe: [1:7556534435137594469:2513]
2025-10-02T08:12:56.075293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879c5093-9372455d-46c451ab-e96f34fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2078093a-5c373978-6bc64fc8-fda50df9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:56.078240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2078093a-5c373978-6bc64fc8-fda50df9_0] Write session: try to update token
2025-10-02T08:12:56.078262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2078093a-5c373978-6bc64fc8-fda50df9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:56.091070Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:56.091088Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:56.091091Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:56.091100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534435137594429:8958]
2025-10-02T08:12:56.091104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534435137594429:8958]
2025-10-02T08:12:56.091150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:56.091156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.091158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:56.091318Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:56.092945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:56.092956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:56.143165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId: src_id|2078093a-5c373978-6bc64fc8-fda50df9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:56.146130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:56.255958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:56.256938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2078093a-5c373978-6bc64fc8-fda50df9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:56.256950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2078093a-5c373978-6bc64fc8-fda50df9_0] Write session will restart in 0.009334s
2025-10-02T08:12:56.257005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2078093a-5c373978-6bc64fc8-fda50df9_0] Write session: Do CDS request
2025-10-02T08:12:56.257020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2078093a-5c373978-6bc64fc8-fda50df9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:56.254446Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:56.255075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.255085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.255237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534435137594469:2513]
2025-10-02T08:12:56.255348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:56.255352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:56.255387Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:56.255418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1597 reason: error at write: Disconnected sessionId: src_id|2078093a-5c373978-6bc64fc8-fda50df9_0
2025-10-02T08:12:56.255619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1597 sessionId: src_id|2078093a-5c373978-6bc64fc8-fda50df9_0 is DEAD
2025-10-02T08:12:56.269255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2078093a-5c373978-6bc64fc8-fda50df9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:56.272421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:56.272436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1598
2025-10-02T08:12:56.272883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:56.272919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:56.272924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:56.272927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:56.274177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1598 sessionId:  describe result for acl check
2025-10-02T08:12:56.274211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:56.274213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:56.274215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:56.274220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534435137594838:8920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:56.274786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534435137594838:8920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:56.282691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:56.283161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534435137594838:8920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:56.284216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:56.284409Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:56.284413Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:56.284423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:56.284467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:56.284502Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534435137594934:8921]
2025-10-02T08:12:56.285400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:56.285751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:56.285795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:56.286144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:56.286183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.286184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.286186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.286187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.286188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.286194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.286204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.286208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.286212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.286216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.286222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.286230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.286236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.286240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.286244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.286250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.286254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.286259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.286264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.286269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.286286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:56.292603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534435137594838:8920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:56.292621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534435137594838:8920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:56.292625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534435137594838:8920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:56.292635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:56.300745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:56.302465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:56.302471Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:56.302474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:56.302478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:56.302486Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1597 [1:7556534435137594934:8921]
2025-10-02T08:12:56.302500Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:56.302523Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:56.302526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:56.302530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:56.302532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:56.302551Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:56.302558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:56.302564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:56.302637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.302639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.302643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:56.302646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:56.302715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:56.302718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.302732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.302745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:56.302762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534435137594918:8921]
2025-10-02T08:12:56.302764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534435137594918:8921]
2025-10-02T08:12:56.302776Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:56.302790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:56.302805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:56.302808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:56.302843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534435137594918:8921]
2025-10-02T08:12:56.302845Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:56.303123Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:56.303129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:56.303135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:56.303327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1597
2025-10-02T08:12:56.303345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534435137594950:8920], now have 1 active actors on pipe
2025-10-02T08:12:56.303351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534435597392769:2378], now have 1 active actors on pipe
2025-10-02T08:12:56.303358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.303363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.303393Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:56.303402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:56.303407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:56.303409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:56.303423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:56.303436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:56.303454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:56.303643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.303646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.303662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:56.303694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1598 partition: 0 MaxSeqNo: 17 sessionId: src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0
2025-10-02T08:12:56.304091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2078093a-5c373978-6bc64fc8-fda50df9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:56.304364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1597
2025-10-02T08:12:56.307157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0] Write session: try to update token
2025-10-02T08:12:56.307175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:56.357078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534435137594964:2513]
2025-10-02T08:12:56.361415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1597, pipe: [1:7556534435137594964:2513]
2025-10-02T08:12:56.361441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534435137594964:2513], now have 1 active actors on pipe
2025-10-02T08:12:56.365571Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:56.365588Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:56.365591Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:56.365601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534435137594918:8921]
2025-10-02T08:12:56.365606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534435137594918:8921]
2025-10-02T08:12:56.365650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:56.365656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.365658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:56.365816Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:56.369118Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:56.369129Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:56.375935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId: src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:56.379089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:56.548985Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:56.549443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.549453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.549831Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:56.550118Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:56.550452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:56.550513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0
2025-10-02T08:12:56.550694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1598 sessionId: src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0 is DEAD
2025-10-02T08:12:56.550838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534435137594964:2513]
2025-10-02T08:12:56.552895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:56.552909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0] Write session will restart in 0.006288s
2025-10-02T08:12:56.552935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0] Write session: Do CDS request
2025-10-02T08:12:56.552942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:56.561219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:56.561684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:56.561697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1599
2025-10-02T08:12:56.562210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:56.562246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:56.562252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:56.562255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:56.562636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1599 sessionId:  describe result for acl check
2025-10-02T08:12:56.562660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:56.562663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:56.562665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:56.562669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534435137595014:8896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:56.563162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534435137595014:8896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:56.572414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534435137595014:8896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:56.581171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534435137595014:8896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:56.581203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534435137595014:8896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:56.581207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534435137595014:8896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:56.581215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:56.583670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:56.583987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:56.584290Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:56.584293Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:56.584305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:56.584357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:56.584391Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534435137595421:8906]
2025-10-02T08:12:56.585081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:56.585310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:56.585347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:56.585646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:56.585682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.585684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.585685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.585686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.585687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.585692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.585703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.585707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.585711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.585715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.585720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.585727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.585733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.585739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.585744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.585749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.585754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.585759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.585763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.585768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.585786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:56.595302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:56.596897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:56.596916Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:56.596919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:56.596923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:56.596930Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1598 [1:7556534435137595421:8906]
2025-10-02T08:12:56.596942Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:56.596960Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:56.596963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:56.596966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:56.596969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:56.596984Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:56.596989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:56.596996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:56.597063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.597072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.597075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:56.597078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:56.597393Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1598
2025-10-02T08:12:56.597141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:56.597150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.597164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.597177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:56.597195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534435137595415:8906]
2025-10-02T08:12:56.597196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534435137595415:8906]
2025-10-02T08:12:56.597207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:56.597218Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:56.597221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:56.597222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534435137595407:8896], now have 1 active actors on pipe
2025-10-02T08:12:56.597230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:56.597245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:56.597248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:56.597255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534435597392788:2378], now have 1 active actors on pipe
2025-10-02T08:12:56.597285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534435137595415:8906]
2025-10-02T08:12:56.597288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:56.597303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1598
2025-10-02T08:12:56.597346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:56.597361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.597366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.597391Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49290e00-d2523486-bb74ac6e-24a255ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:56.597397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:56.597400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:56.597402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:56.597412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:56.597422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:56.597438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:56.597670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.597682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.597719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:56.597761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1599 partition: 0 MaxSeqNo: 17 sessionId: src_id|49290e00-d2523486-bb74ac6e-24a255ed_0
2025-10-02T08:12:56.598961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c67c19e5-5a71b1e4-7b398a79-9c125b25_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|49290e00-d2523486-bb74ac6e-24a255ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:56.601822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49290e00-d2523486-bb74ac6e-24a255ed_0] Write session: try to update token
2025-10-02T08:12:56.601838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49290e00-d2523486-bb74ac6e-24a255ed_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:56.622870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId: src_id|49290e00-d2523486-bb74ac6e-24a255ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:56.624470Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:56.624473Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:56.624476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:56.624486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534435137595415:8906]
2025-10-02T08:12:56.624490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534435137595415:8906]
2025-10-02T08:12:56.624538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:56.624544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.624546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:56.624694Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:56.625574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:56.625962Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:56.625970Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:56.650563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534435137595448:2513]
2025-10-02T08:12:56.651092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1598, pipe: [1:7556534435137595448:2513]
2025-10-02T08:12:56.789505Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:56.789970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.789978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.790020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534435137595448:2513], now have 1 active actors on pipe
2025-10-02T08:12:56.792458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534435137595448:2513]
2025-10-02T08:12:56.792483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:56.792486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:56.792493Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:56.792559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1599 reason: error at write: Disconnected sessionId: src_id|49290e00-d2523486-bb74ac6e-24a255ed_0
2025-10-02T08:12:56.792726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1599 sessionId: src_id|49290e00-d2523486-bb74ac6e-24a255ed_0 is DEAD
2025-10-02T08:12:56.793067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:56.796903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49290e00-d2523486-bb74ac6e-24a255ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:56.796919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49290e00-d2523486-bb74ac6e-24a255ed_0] Write session will restart in 0.005077s
2025-10-02T08:12:56.796949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49290e00-d2523486-bb74ac6e-24a255ed_0] Write session: Do CDS request
2025-10-02T08:12:56.796956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49290e00-d2523486-bb74ac6e-24a255ed_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:56.805288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49290e00-d2523486-bb74ac6e-24a255ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:56.807144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:56.807159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1600
2025-10-02T08:12:56.807401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:56.807437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:56.807443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:56.807448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:56.812429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1600 sessionId:  describe result for acl check
2025-10-02T08:12:56.812479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:56.812481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:56.812483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:56.812489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534435137595590:8900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:56.813111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534435137595590:8900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:56.821887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534435137595590:8900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:56.830612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534435137595590:8900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:56.830630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534435137595590:8900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:56.830634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534435137595590:8900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:56.830643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:56.834513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:56.836344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:56.836546Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:56.836558Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:56.836569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:56.836621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:56.836662Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534435137595894:8897]
2025-10-02T08:12:56.837339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:56.837626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:56.837668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:56.837994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:56.838035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.838037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.838038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.838039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.838040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.838046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.838057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.838061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.838064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.838067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.838072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.838079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:56.838084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.838089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:56.838093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.838098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:56.838102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.838106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.838111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.838116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.838136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:56.847616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:56.849361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:56.849380Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:56.849384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:56.849388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:56.849395Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1599 [1:7556534435137595894:8897]
2025-10-02T08:12:56.849408Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:56.849428Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:56.849431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:56.849434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:56.849437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:56.849454Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:56.850185Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1599
2025-10-02T08:12:56.849460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:56.849477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:56.849547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.849549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.849553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:56.849556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:56.849625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:56.849628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.849643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:56.849656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:56.849674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534435137595887:8897]
2025-10-02T08:12:56.849676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534435137595887:8897]
2025-10-02T08:12:56.849693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:56.849708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:56.849722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:56.849725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:56.849740Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:56.849742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:56.849762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534435137595887:8897]
2025-10-02T08:12:56.849765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:56.849811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1599
2025-10-02T08:12:56.849819Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:56.849820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534435137595877:8900], now have 1 active actors on pipe
2025-10-02T08:12:56.850161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.850168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.850185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534435597392799:2378], now have 1 active actors on pipe
2025-10-02T08:12:56.850200Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c3e202-43c36151-b8247fc-2f612fc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:56.850208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:56.850212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:56.850215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:56.850228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:56.850239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:56.850258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:56.850301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:56.850303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:56.850323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:56.850355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1600 partition: 0 MaxSeqNo: 17 sessionId: src_id|45c3e202-43c36151-b8247fc-2f612fc3_0
2025-10-02T08:12:56.853061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49290e00-d2523486-bb74ac6e-24a255ed_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45c3e202-43c36151-b8247fc-2f612fc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:56.855848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c3e202-43c36151-b8247fc-2f612fc3_0] Write session: try to update token
2025-10-02T08:12:56.855865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c3e202-43c36151-b8247fc-2f612fc3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:56.880866Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:56.880882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:56.880885Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:56.880894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534435137595887:8897]
2025-10-02T08:12:56.880903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534435137595887:8897]
2025-10-02T08:12:56.880950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:56.880961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:56.880963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:56.881101Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:56.884858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:56.884874Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:56.888884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534435137595918:2513]
2025-10-02T08:12:56.889124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1599, pipe: [1:7556534435137595918:2513]
2025-10-02T08:12:56.902813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId: src_id|45c3e202-43c36151-b8247fc-2f612fc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:56.905874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:57.048838Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:57.049450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534435137595918:2513], now have 1 active actors on pipe
2025-10-02T08:12:57.049485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.049490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.053254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534435137595918:2513]
2025-10-02T08:12:57.053292Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:57.053866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c3e202-43c36151-b8247fc-2f612fc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:57.053874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c3e202-43c36151-b8247fc-2f612fc3_0] Write session will restart in 0.009854s
2025-10-02T08:12:57.053896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c3e202-43c36151-b8247fc-2f612fc3_0] Write session: Do CDS request
2025-10-02T08:12:57.053902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c3e202-43c36151-b8247fc-2f612fc3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:57.053333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:57.053402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1600 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45c3e202-43c36151-b8247fc-2f612fc3_0
2025-10-02T08:12:57.053566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1600 sessionId: src_id|45c3e202-43c36151-b8247fc-2f612fc3_0 is DEAD
2025-10-02T08:12:57.056885Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:57.069560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c3e202-43c36151-b8247fc-2f612fc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:57.069959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:57.069977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1601
2025-10-02T08:12:57.070167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:57.070205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:57.070210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:57.070214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:57.071837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1601 sessionId:  describe result for acl check
2025-10-02T08:12:57.071880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:57.071886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:57.071888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:57.071894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534439432563620:8882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:57.072627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:57.072735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534439432563620:8882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:57.074184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:57.074377Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:57.074386Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:57.074397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:57.074457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:57.074496Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534439432563637:8886]
2025-10-02T08:12:57.075134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:57.075360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:57.075405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:57.075736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:57.075774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.075775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.075777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.075778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.075779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.075784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.075795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.075799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.075803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.075807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.075812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.075821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.075826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.075832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.075836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.075841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.075846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.075851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.075856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.075861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.075880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:57.078544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534439432563620:8882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:57.087149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:57.089252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:57.089269Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:57.089271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:57.089275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:57.089282Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1600 [1:7556534439432563637:8886]
2025-10-02T08:12:57.089293Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:57.089310Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:57.089313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.089316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.089318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.089333Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:57.089337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:57.089344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:57.089406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.089807Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1600
2025-10-02T08:12:57.091014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c3e202-43c36151-b8247fc-2f612fc3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:57.089495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.089501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:57.089503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:57.089573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:57.089575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.089589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.089602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:57.089619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534439432563624:8886]
2025-10-02T08:12:57.089621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534439432563624:8886]
2025-10-02T08:12:57.089628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:57.089638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:57.089640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:57.089642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:57.089654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:57.089657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:57.089667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534439892360102:2378], now have 1 active actors on pipe
2025-10-02T08:12:57.089697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534439432563624:8886]
2025-10-02T08:12:57.089704Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:57.089717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:57.090048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534439432563620:8882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:57.090055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534439432563620:8882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:57.090058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534439432563620:8882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:57.090066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:57.090455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1600
2025-10-02T08:12:57.090461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534439432563678:8882], now have 1 active actors on pipe
2025-10-02T08:12:57.090482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.090485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.090507Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:57.090514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.090528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.090529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:57.090539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.090550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:57.090566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:57.090590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.090592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.090603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:57.090627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1601 partition: 0 MaxSeqNo: 17 sessionId: src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0
2025-10-02T08:12:57.093663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0] Write session: try to update token
2025-10-02T08:12:57.093680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:57.114416Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:57.114439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:57.114441Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:57.114451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534439432563624:8886]
2025-10-02T08:12:57.114456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534439432563624:8886]
2025-10-02T08:12:57.114504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:57.114511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.114522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:57.114720Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:57.115511Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:57.115522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:57.124704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId: src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:57.127599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:57.154890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534439432563687:2513]
2025-10-02T08:12:57.155053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1600, pipe: [1:7556534439432563687:2513]
2025-10-02T08:12:57.276982Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:57.277428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.277437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.277458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534439432563687:2513], now have 1 active actors on pipe
2025-10-02T08:12:57.277688Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:57.278083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:57.278138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0
2025-10-02T08:12:57.278318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1601 sessionId: src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0 is DEAD
2025-10-02T08:12:57.278450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534439432563687:2513]
2025-10-02T08:12:57.278375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:57.284894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:57.284909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0] Write session will restart in 0.009999s
2025-10-02T08:12:57.284935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0] Write session: Do CDS request
2025-10-02T08:12:57.284942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:57.296247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:57.296658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:57.296672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1602
2025-10-02T08:12:57.296830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:57.296871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:57.296875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:57.296879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:57.297050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:57.297253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1602 sessionId:  describe result for acl check
2025-10-02T08:12:57.297278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:57.297281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:57.297283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:57.297289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534439432564136:8850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:57.297850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534439432564136:8850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:57.298171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:57.298330Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:57.298333Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:57.298342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:57.298388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:57.298426Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534439432564143:8859]
2025-10-02T08:12:57.299138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:57.299440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:57.299486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:57.299809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:57.299847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.299848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.299849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.299851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.299852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.299857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.299865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.299870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.299874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.299877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.299882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.299890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.299901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.299906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.299910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.299915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.299922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.299928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.299932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.299937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.299956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:57.301138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534439432564136:8850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:57.308511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534439432564136:8850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:57.308524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534439432564136:8850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:57.308527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534439432564136:8850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:57.308536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:57.309517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:57.311022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:57.311028Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:57.311031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:57.311035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:57.311043Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1601 [1:7556534439432564143:8859]
2025-10-02T08:12:57.311056Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:57.311072Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:57.311075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.311079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.311081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.311095Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:57.311101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:57.311107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:57.311174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.311179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.311183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:57.311185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:57.311246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:57.311249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.311261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.311273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:57.311289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534439432564130:8859]
2025-10-02T08:12:57.311291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534439432564130:8859]
2025-10-02T08:12:57.311298Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:57.311310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:57.311324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:57.311327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:57.311356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534439432564130:8859]
2025-10-02T08:12:57.311358Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:57.311845Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:57.311851Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:57.311856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:57.312710Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1601
2025-10-02T08:12:57.312903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534439892360133:2378], now have 1 active actors on pipe
2025-10-02T08:12:57.313017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1601
2025-10-02T08:12:57.313028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534439432564181:8850], now have 1 active actors on pipe
2025-10-02T08:12:57.313610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.313626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.313652Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb567f3-72fee390-3034625-8dce0297_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:57.313660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.313664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.313667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:57.313678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.313691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:57.313709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:57.313830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.313834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.313846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:57.313875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1602 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb567f3-72fee390-3034625-8dce0297_0
2025-10-02T08:12:57.314260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4caf41b4-fa8f77d6-129ee850-7e8f514f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb567f3-72fee390-3034625-8dce0297_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:57.316957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb567f3-72fee390-3034625-8dce0297_0] Write session: try to update token
2025-10-02T08:12:57.316973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb567f3-72fee390-3034625-8dce0297_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:57.332726Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:57.332747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:57.332750Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:57.332759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534439432564130:8859]
2025-10-02T08:12:57.332764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534439432564130:8859]
2025-10-02T08:12:57.332824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:57.332833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.332836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:57.332988Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:57.337040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:57.337058Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:57.350678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId: src_id|fb567f3-72fee390-3034625-8dce0297_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:57.353254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:57.372994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534439432564196:2513]
2025-10-02T08:12:57.373620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1601, pipe: [1:7556534439432564196:2513]
2025-10-02T08:12:57.510848Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:57.511310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.511319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.511361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534439432564196:2513], now have 1 active actors on pipe
2025-10-02T08:12:57.512096Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:57.512505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:57.512562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1602 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fb567f3-72fee390-3034625-8dce0297_0
2025-10-02T08:12:57.512746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1602 sessionId: src_id|fb567f3-72fee390-3034625-8dce0297_0 is DEAD
2025-10-02T08:12:57.512787Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:57.512839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534439432564196:2513]
2025-10-02T08:12:57.512860Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:12:57.512980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb567f3-72fee390-3034625-8dce0297_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:57.512988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb567f3-72fee390-3034625-8dce0297_0] Write session will restart in 0.005823s
2025-10-02T08:12:57.513011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb567f3-72fee390-3034625-8dce0297_0] Write session: Do CDS request
2025-10-02T08:12:57.513017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb567f3-72fee390-3034625-8dce0297_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:57.513071Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:12:57.513175Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:12:57.513180Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:12:57.513187Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.007915s
2025-10-02T08:12:57.512981Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 16 consumer shared/user session shared/user_1_16_8168592115197028269_v1 is DEAD
2025-10-02T08:12:57.513395Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534327763386221:2520] disconnected; active server actors: 1
2025-10-02T08:12:57.513406Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534327763386221:2520] client user disconnected session shared/user_1_16_8168592115197028269_v1
2025-10-02T08:12:57.521201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb567f3-72fee390-3034625-8dce0297_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:57.525121Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:12:57.524996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:57.525012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1603
2025-10-02T08:12:57.525173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:57.525203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:57.525209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:57.525214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:57.525508Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:12:57.525513Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 17
2025-10-02T08:12:57.525854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1603 sessionId:  describe result for acl check
2025-10-02T08:12:57.525881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:57.525883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:57.525884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:57.525890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534439432564250:8825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:57.526405Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 17 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:12:57.526450Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:12:57.526515Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 auth for : user
2025-10-02T08:12:57.526827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534439432564250:8825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:57.529011Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_17_10810090616033483154_v1
2025-10-02T08:12:57.529021Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:12:57.529089Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:12:57.528331Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 Handle describe topics response
2025-10-02T08:12:57.529061Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534439432564411:6131] connected; active server actors: 1
2025-10-02T08:12:57.528364Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 auth is DEAD
2025-10-02T08:12:57.528379Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:12:57.528707Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:12:57.533448Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534439432564411:6131] session shared/user_1_17_10810090616033483154_v1
2025-10-02T08:12:57.533474Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:12:57.533485Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:12:57.533492Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_17_10810090616033483154_v1" (Sender=[1:7556534439432564249:6131], Pipe=[1:7556534439432564411:6131], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:12:57.533496Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:12:57.533511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:12:57.533521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_17_10810090616033483154_v1" (Sender=[1:7556534439432564249:6131], Pipe=[1:7556534439432564411:6131], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:12:57.533532Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_17_10810090616033483154_v1" sender [1:7556534439432564249:6131] lock partition 0 for ReadingSession "shared/user_1_17_10810090616033483154_v1" (Sender=[1:7556534439432564249:6131], Pipe=[1:7556534439432564411:6131], Partitions=[], ActiveFamilyCount=1) generation 1 step 17
2025-10-02T08:12:57.533542Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:12:57.533548Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-02T08:12:57.537109Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 17 Session: "shared/user_1_17_10810090616033483154_v1" ClientId: "user" PipeClient { RawX1: 7556534439432564411 RawX2: 4503603922343923 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:12:57.537139Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:12:57.537227Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 got read request: guid# d8fdce81-61b001ba-e80a6bb6-dab98496
2025-10-02T08:12:57.537250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:12:57.540365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534439432564250:8825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:57.553779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534439432564250:8825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:57.553799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534439432564250:8825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:57.553804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534439432564250:8825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:57.553814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:57.555922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:57.557420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:57.557638Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:57.557643Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:57.557653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:57.557711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:57.557750Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534439432564665:8835]
2025-10-02T08:12:57.558602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:57.558960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:57.559009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:57.559319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:57.559372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.559373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.559374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.559375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.559376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.559381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.559391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.559395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.559398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.559401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.559407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.559414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.559420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.559425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.559430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.559435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.559439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.559444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.559449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.559453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.559475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:57.571551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:57.573369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:57.573386Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:57.573389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:57.573392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:57.573402Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1602 [1:7556534439432564665:8835]
2025-10-02T08:12:57.573415Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:57.573433Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:57.573437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.573440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.573442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.573462Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:57.573467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:57.573475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:57.573542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.573545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.573548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:57.573550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:57.573623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:57.573625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.573639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.573650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:57.573668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534439432564659:8835]
2025-10-02T08:12:57.573670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534439432564659:8835]
2025-10-02T08:12:57.573681Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:57.573693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:57.573706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:57.573709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:57.573744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534439432564659:8835]
2025-10-02T08:12:57.573747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:57.575261Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1602
2025-10-02T08:12:57.574021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1602, pipe: [1:7556534439432564529:8815]
2025-10-02T08:12:57.574043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534439432564529:8815], now have 1 active actors on pipe
2025-10-02T08:12:57.574049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534439432564645:8825], now have 1 active actors on pipe
2025-10-02T08:12:57.574053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534439892360152:2378], now have 1 active actors on pipe
2025-10-02T08:12:57.574059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.574066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.574078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_17_10810090616033483154_v1 on pipe: [1:7556534439432564529:8815]
2025-10-02T08:12:57.574099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.574105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.574108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:57.574130Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_17_10810090616033483154_v1
2025-10-02T08:12:57.574133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.574175Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:57.574258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:57.574260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:57.574265Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:57.574321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1602
2025-10-02T08:12:57.574333Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_17_10810090616033483154_v1:1 with generation 1602
2025-10-02T08:12:57.574962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.574967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.574992Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:57.574999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:12:57.576682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:12:57.576710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:12:57.576718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.576724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.576726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:57.576737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.576749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:57.576759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:12:57.576772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:12:57.576782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:57.576861Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392777573 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:12:57.576872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:12:57.576907Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 sending to client partition status
2025-10-02T08:12:57.577465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.577473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.577502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:57.577536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1603 partition: 0 MaxSeqNo: 17 sessionId: src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0
2025-10-02T08:12:57.580917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb567f3-72fee390-3034625-8dce0297_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:57.583590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0] Write session: try to update token
2025-10-02T08:12:57.583610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:57.607026Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:57.607047Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:57.607050Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:57.607063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534439432564659:8835]
2025-10-02T08:12:57.607071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534439432564659:8835]
2025-10-02T08:12:57.607121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:57.607129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.607131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:57.607278Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:57.607969Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:57.607979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:57.617013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId: src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:57.619676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:57.769121Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:57.769766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.769778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.770574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_17_10810090616033483154_v1
2025-10-02T08:12:57.770591Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:57.770916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534439432564529:8815]
2025-10-02T08:12:57.770935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:57.770992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1603 reason: status is not ok: tablet will be restarted right now sessionId: src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0
2025-10-02T08:12:57.771181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1603 sessionId: src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0 is DEAD
2025-10-02T08:12:57.771310Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_17_10810090616033483154_v1
2025-10-02T08:12:57.773060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:57.773137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:57.773153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0] Write session will restart in 0.009004s
2025-10-02T08:12:57.773180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0] Write session: Do CDS request
2025-10-02T08:12:57.773187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:57.785301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:57.789847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:57.789860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1604
2025-10-02T08:12:57.790047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:57.790076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:57.790082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:57.790086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:57.797273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1604 sessionId:  describe result for acl check
2025-10-02T08:12:57.797317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:57.797319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:57.797321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:57.797326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534439432564902:8813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:57.797889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534439432564902:8813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:57.821765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534439432564902:8813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:57.823865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:57.824302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:57.824538Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:57.824541Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:57.824551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:57.824618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:57.824655Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534439432565148:8816]
2025-10-02T08:12:57.824874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534439432564902:8813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:57.824881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534439432564902:8813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:57.824885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534439432564902:8813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:57.824894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:57.825301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:57.825600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:57.825645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:57.825992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:57.826058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.826059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.826060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.826061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.826062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.826067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.826077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.826080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.826083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.826087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.826101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.826109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:57.826115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.826120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:57.826124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.826128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:57.826132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.826136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.826140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.826145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.826164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:57.838655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1603
2025-10-02T08:12:57.836263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:57.838004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:57.838011Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:57.838013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:57.838017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:57.838025Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1603 [1:7556534439432565148:8816]
2025-10-02T08:12:57.838039Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:57.838056Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:57.838059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.838066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.838068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.838084Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:57.838090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:57.838097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:57.838167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.838169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.838172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:57.838175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:57.838250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:57.838253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.838267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:57.838280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:57.838297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534439432565142:8816]
2025-10-02T08:12:57.838299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534439432565142:8816]
2025-10-02T08:12:57.838307Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:57.838319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:57.838333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:57.838336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:57.838361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:57.838364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:57.838367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1603
2025-10-02T08:12:57.838371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534439432565153:8813], now have 1 active actors on pipe
2025-10-02T08:12:57.838374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534439432565142:8816]
2025-10-02T08:12:57.838377Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:57.838394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534439892360163:2378], now have 1 active actors on pipe
2025-10-02T08:12:57.838398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.838405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.838437Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1c5f24a-f5835c0c-528165c-a9891820_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:57.838443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:57.838447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:57.838449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:57.838458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:57.838465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:57.838483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:57.838531Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:57.838707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:57.838710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:57.838730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:57.838771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1604 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1c5f24a-f5835c0c-528165c-a9891820_0
2025-10-02T08:12:57.841048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822837d3-35ad9bb4-a8b48c93-256a6847_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1c5f24a-f5835c0c-528165c-a9891820_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:57.843668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c5f24a-f5835c0c-528165c-a9891820_0] Write session: try to update token
2025-10-02T08:12:57.843687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c5f24a-f5835c0c-528165c-a9891820_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:57.851745Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:57.851764Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:57.851773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534439432565142:8816]
2025-10-02T08:12:57.851824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:12:57.851836Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:57.852007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:12:57.852164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:57.852308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:57.852440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:12:57.852633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:12:57.852667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:12:57.869563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534439432565178:8815]
2025-10-02T08:12:57.870785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1603, pipe: [1:7556534439432565178:8815]
2025-10-02T08:12:57.870801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534439432565178:8815], now have 1 active actors on pipe
2025-10-02T08:12:57.876627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId: src_id|e1c5f24a-f5835c0c-528165c-a9891820_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:57.877272Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:57.877276Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:57.877282Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:57.877292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534439432565142:8816]
2025-10-02T08:12:57.877296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534439432565142:8816]
2025-10-02T08:12:57.877346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:57.877354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:57.877357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:57.877512Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:57.879663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:57.880889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:57.880903Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:58.028334Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:58.028640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.028649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.028791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534439432565178:8815]
2025-10-02T08:12:58.028816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:58.028817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:58.028871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1604 reason: error at write: Disconnected sessionId: src_id|e1c5f24a-f5835c0c-528165c-a9891820_0
2025-10-02T08:12:58.028937Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:58.029039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1604 sessionId: src_id|e1c5f24a-f5835c0c-528165c-a9891820_0 is DEAD
2025-10-02T08:12:58.030297Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:58.032906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c5f24a-f5835c0c-528165c-a9891820_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:58.032918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c5f24a-f5835c0c-528165c-a9891820_0] Write session will restart in 0.008198s
2025-10-02T08:12:58.032941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c5f24a-f5835c0c-528165c-a9891820_0] Write session: Do CDS request
2025-10-02T08:12:58.032963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c5f24a-f5835c0c-528165c-a9891820_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:58.045345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c5f24a-f5835c0c-528165c-a9891820_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.049193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:58.049206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1605
2025-10-02T08:12:58.049393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.049440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:58.049448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:58.049452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:58.049887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1605 sessionId:  describe result for acl check
2025-10-02T08:12:58.049923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:58.049924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:58.049926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:58.049931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534443727532876:8806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:58.050423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534443727532876:8806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:58.052050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:58.053719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:58.053908Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:58.053919Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:58.053927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:58.053975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:58.054012Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534443727532912:8807]
2025-10-02T08:12:58.054025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534443727532876:8806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:58.054646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:58.054841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:58.054888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:58.055187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:58.055236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.055237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.055238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.055240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.055241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.055246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.055255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.055259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.055262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.055266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.055271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.055278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.055283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.055288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.055292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.055296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.055301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.055305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.055310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.055314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.055331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:58.060980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534443727532876:8806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:58.060998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534443727532876:8806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:58.061001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534443727532876:8806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:58.061011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:58.064013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:58.065972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:58.065990Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:58.065992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:58.065996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:58.066002Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1604 [1:7556534443727532912:8807]
2025-10-02T08:12:58.066015Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:58.066033Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:58.066037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.066040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.066043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.066060Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:58.066065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:58.066072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:58.066134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.066137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.066140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:58.066143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:58.066214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:58.066216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.066233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.066248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:58.066268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727532938:8806], now have 1 active actors on pipe
2025-10-02T08:12:58.066275Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534443727532898:8807]
2025-10-02T08:12:58.066278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534443727532898:8807]
2025-10-02T08:12:58.066285Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:58.066295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534444187327466:2378], now have 1 active actors on pipe
2025-10-02T08:12:58.066301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:58.066317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:58.066320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:58.066353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534443727532898:8807]
2025-10-02T08:12:58.066356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:58.066401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1604
2025-10-02T08:12:58.066455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:58.066458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:58.066464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:58.066527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.066531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.066555Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:58.066563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.066566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.066569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:58.066580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.066589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:58.066609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.066713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.066716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.066732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.066770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1605 partition: 0 MaxSeqNo: 17 sessionId: src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0
2025-10-02T08:12:58.067155Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1604
2025-10-02T08:12:58.068910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c5f24a-f5835c0c-528165c-a9891820_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:58.071682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0] Write session: try to update token
2025-10-02T08:12:58.071701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:58.086465Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:58.086482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:58.086485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:58.086494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534443727532898:8807]
2025-10-02T08:12:58.086498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534443727532898:8807]
2025-10-02T08:12:58.086545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:58.086553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.086555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:58.086707Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:58.086736Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:58.086744Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:58.097530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId: src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:58.100475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:58.128963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534443727532955:8815]
2025-10-02T08:12:58.129188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1604, pipe: [1:7556534443727532955:8815]
2025-10-02T08:12:58.242562Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:58.243818Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:58.244481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:58.244492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0] Write session will restart in 0.008557s
2025-10-02T08:12:58.244517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0] Write session: Do CDS request
2025-10-02T08:12:58.244524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:58.243052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.243067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.243104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727532955:8815], now have 1 active actors on pipe
2025-10-02T08:12:58.243865Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:58.244112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534443727532955:8815]
2025-10-02T08:12:58.244128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:58.244189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1605 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0
2025-10-02T08:12:58.244343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1605 sessionId: src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0 is DEAD
2025-10-02T08:12:58.255207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.256934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:58.256948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1606
2025-10-02T08:12:58.261115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.261174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:58.261180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:58.261185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:58.261704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1606 sessionId:  describe result for acl check
2025-10-02T08:12:58.261738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:58.261739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:58.261742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:58.261747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534443727533203:8773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:58.262257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534443727533203:8773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:58.267135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534443727533203:8773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:58.277073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534443727533203:8773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:58.277090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534443727533203:8773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:58.277095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534443727533203:8773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:58.277104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:58.280693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:58.281063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:58.281240Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:58.281244Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:58.281253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:58.281318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:58.281353Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534443727533438:8788]
2025-10-02T08:12:58.282009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:58.282205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:58.282245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:58.282552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:58.282592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.282599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.282600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.282601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.282602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.282608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.282616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.282620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.282624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.282627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.282631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.282638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.282644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.282649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.282654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.282658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.282662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.282667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.282672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.282676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.282694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:58.293402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:58.295194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:58.295213Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:58.295216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:58.295220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:58.295227Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1605 [1:7556534443727533438:8788]
2025-10-02T08:12:58.295240Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:58.295256Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:58.295260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.295263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.295265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.295282Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:58.295287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:58.295294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:58.295367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.295369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.295373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:58.295375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:58.295450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:58.295453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.295470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.295484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:58.295501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534443727533432:8788]
2025-10-02T08:12:58.295503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534443727533432:8788]
2025-10-02T08:12:58.295511Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:58.295525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:58.295542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:58.295545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:58.295556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727533417:8773], now have 1 active actors on pipe
2025-10-02T08:12:58.295566Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:58.295570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:58.295578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1605
2025-10-02T08:12:58.295589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534443727533432:8788]
2025-10-02T08:12:58.295592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:58.295598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534444187327477:2378], now have 1 active actors on pipe
2025-10-02T08:12:58.295734Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:58.295800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.295815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.295840Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:58.295848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.295852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.295855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:58.295865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.295828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1605
2025-10-02T08:12:58.295875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:58.295899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.296050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.296061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.296085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.296126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1606 partition: 0 MaxSeqNo: 17 sessionId: src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0
2025-10-02T08:12:58.296511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccd5135-d422b9f4-6c7a7fad-4a0ee4da_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:58.299362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0] Write session: try to update token
2025-10-02T08:12:58.299378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:58.318018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId: src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:58.318822Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:58.318840Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:58.318843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:58.318851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534443727533432:8788]
2025-10-02T08:12:58.318856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534443727533432:8788]
2025-10-02T08:12:58.318908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:58.318920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.318923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:58.319087Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:58.319999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:58.320015Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:58.320838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:58.345108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534443727533471:8815]
2025-10-02T08:12:58.345311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1605, pipe: [1:7556534443727533471:8815]
2025-10-02T08:12:58.469976Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:58.470279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.470288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.470331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727533471:8815], now have 1 active actors on pipe
2025-10-02T08:12:58.470513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534443727533471:8815]
2025-10-02T08:12:58.470545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:58.470553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:58.470582Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:58.470621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1606 reason: error at write: Disconnected sessionId: src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0
2025-10-02T08:12:58.470834Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:58.470949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1606 sessionId: src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0 is DEAD
2025-10-02T08:12:58.473664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:58.473676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0] Write session will restart in 0.005352s
2025-10-02T08:12:58.473705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0] Write session: Do CDS request
2025-10-02T08:12:58.473713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:58.484120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.488723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:58.488740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1607
2025-10-02T08:12:58.488992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.489032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:58.489038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:58.489042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:58.490339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1607 sessionId:  describe result for acl check
2025-10-02T08:12:58.490387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:58.490389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:58.490390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:58.490396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534443727533621:8748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:58.490929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534443727533621:8748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:58.501419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534443727533621:8748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:58.512964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534443727533621:8748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:58.512979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534443727533621:8748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:58.512983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534443727533621:8748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:58.512993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:58.530133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:58.534446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:58.534692Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:58.534695Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:58.534710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:58.534762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:58.534795Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534443727533940:8762]
2025-10-02T08:12:58.535467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:58.535788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:58.535831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:58.536142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:58.536196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.536198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.536199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.536200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.536202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.536207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.536219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.536223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.536228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.536233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.536238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.536246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.536253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.536260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.536265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.536271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.536277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.536282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.536292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.536298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.536317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:58.548945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:58.550773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:58.550781Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:58.550784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:58.550788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:58.550794Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1606 [1:7556534443727533940:8762]
2025-10-02T08:12:58.550807Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:58.550825Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:58.550828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.550832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.550834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.550850Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:58.550855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:58.550862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:58.550931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.550933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.550937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:58.550939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:58.551009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:58.551012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.551028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.551041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:58.551058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534443727533933:8762]
2025-10-02T08:12:58.551060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534443727533933:8762]
2025-10-02T08:12:58.551073Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:58.551086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:58.551100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:58.551103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:58.551137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534443727533933:8762]
2025-10-02T08:12:58.551139Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:58.551450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1606
2025-10-02T08:12:58.551485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727533884:8748], now have 1 active actors on pipe
2025-10-02T08:12:58.551491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534444187327519:2378], now have 1 active actors on pipe
2025-10-02T08:12:58.551581Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:58.551583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.551588Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:58.551589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.551595Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:58.551618Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e019d87-276de270-4637813f-574cf6cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:58.551628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.551633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.551635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:58.551648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.551670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:58.551694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.551753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.551756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.551769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.551803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1607 partition: 0 MaxSeqNo: 17 sessionId: src_id|7e019d87-276de270-4637813f-574cf6cb_0
2025-10-02T08:12:58.552360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a58d3a-13e89a2a-ab158247-e606ee16_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7e019d87-276de270-4637813f-574cf6cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:58.552954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1606
2025-10-02T08:12:58.554919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e019d87-276de270-4637813f-574cf6cb_0] Write session: try to update token
2025-10-02T08:12:58.554931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e019d87-276de270-4637813f-574cf6cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:58.571163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId: src_id|7e019d87-276de270-4637813f-574cf6cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:58.571262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534443727533962:8815]
2025-10-02T08:12:58.573118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1606, pipe: [1:7556534443727533962:8815]
2025-10-02T08:12:58.573137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727533962:8815], now have 1 active actors on pipe
2025-10-02T08:12:58.574293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:58.575596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.575612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.575631Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:58.575633Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:58.575635Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:58.575641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534443727533933:8762]
2025-10-02T08:12:58.575645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534443727533933:8762]
2025-10-02T08:12:58.575689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:58.575695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.575696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:58.575828Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:58.575981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:58.575987Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:58.727418Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:58.727962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:58.728037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:58.728130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:58.728137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:58.728160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1607 reason: error at write: Disconnected sessionId: src_id|7e019d87-276de270-4637813f-574cf6cb_0
2025-10-02T08:12:58.728326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1607 sessionId: src_id|7e019d87-276de270-4637813f-574cf6cb_0 is DEAD
2025-10-02T08:12:58.728436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534443727533962:8815]
2025-10-02T08:12:58.728443Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:58.728591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e019d87-276de270-4637813f-574cf6cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:58.728601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e019d87-276de270-4637813f-574cf6cb_0] Write session will restart in 0.008159s
2025-10-02T08:12:58.728623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e019d87-276de270-4637813f-574cf6cb_0] Write session: Do CDS request
2025-10-02T08:12:58.728630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e019d87-276de270-4637813f-574cf6cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:58.738305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e019d87-276de270-4637813f-574cf6cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.738369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:58.738384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1608
2025-10-02T08:12:58.738518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.738564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:58.738573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:58.738576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:58.739086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1608 sessionId:  describe result for acl check
2025-10-02T08:12:58.739117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:58.739124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:58.739125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:58.739130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534443727534328:8740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:58.739625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534443727534328:8740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:58.741915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:58.742950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534443727534328:8740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:58.743176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:58.743541Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:58.743555Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:58.743568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:58.743632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:58.743669Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534443727534412:8743]
2025-10-02T08:12:58.744348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:58.744550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:58.744598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:58.745087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:58.745162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.745168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.745169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.745171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.745172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.745177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.745187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.745191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.745195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.745199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.745210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.745218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.745228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.745233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.745243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.745248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.745256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.745262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.745267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.745271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.745290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:58.748634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534443727534328:8740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:58.748649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534443727534328:8740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:58.748653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534443727534328:8740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:58.748661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:58.754553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:58.756217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:58.756233Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:58.756236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:58.756240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:58.756246Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1607 [1:7556534443727534412:8743]
2025-10-02T08:12:58.756261Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:58.756280Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:58.756287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.756290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.756293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.756310Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:58.756320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:58.756327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:58.756395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.756403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.756407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:58.756409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:58.756476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:58.756484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.756497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.756508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:58.756529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534443727534405:8743]
2025-10-02T08:12:58.756539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534443727534405:8743]
2025-10-02T08:12:58.756547Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:58.756553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1607
2025-10-02T08:12:58.756558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:58.756769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1607
2025-10-02T08:12:58.756560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727534439:8740], now have 1 active actors on pipe
2025-10-02T08:12:58.756562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:58.756569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:58.756582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:58.756585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:58.756590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534444187327528:2378], now have 1 active actors on pipe
2025-10-02T08:12:58.756595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.756599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.756642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534443727534405:8743]
2025-10-02T08:12:58.756650Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:58.756665Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47153b95-91d47918-3460ef5d-900073b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:58.756671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.756674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.756676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:58.756679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:58.756685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.756694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:58.756732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.756851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.756857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.756878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.756915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1608 partition: 0 MaxSeqNo: 17 sessionId: src_id|47153b95-91d47918-3460ef5d-900073b9_0
2025-10-02T08:12:58.760958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e019d87-276de270-4637813f-574cf6cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47153b95-91d47918-3460ef5d-900073b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:58.763774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47153b95-91d47918-3460ef5d-900073b9_0] Write session: try to update token
2025-10-02T08:12:58.763794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47153b95-91d47918-3460ef5d-900073b9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:58.776856Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:58.776873Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:58.776876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:58.776886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534443727534405:8743]
2025-10-02T08:12:58.776890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534443727534405:8743]
2025-10-02T08:12:58.776932Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:58.776935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:58.776938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:58.776945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.776947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:58.777081Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:58.778590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId: src_id|47153b95-91d47918-3460ef5d-900073b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:58.781475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:58.828119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534443727534455:8815]
2025-10-02T08:12:58.828275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1607, pipe: [1:7556534443727534455:8815]
2025-10-02T08:12:58.916976Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:58.917409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.917425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.917465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727534455:8815], now have 1 active actors on pipe
2025-10-02T08:12:58.920996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534443727534455:8815]
2025-10-02T08:12:58.921028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:58.921031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:58.921043Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:58.921100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1608 reason: error at write: Disconnected sessionId: src_id|47153b95-91d47918-3460ef5d-900073b9_0
2025-10-02T08:12:58.921259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1608 sessionId: src_id|47153b95-91d47918-3460ef5d-900073b9_0 is DEAD
2025-10-02T08:12:58.921666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47153b95-91d47918-3460ef5d-900073b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:58.921678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47153b95-91d47918-3460ef5d-900073b9_0] Write session will restart in 0.009099s
2025-10-02T08:12:58.921702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47153b95-91d47918-3460ef5d-900073b9_0] Write session: Do CDS request
2025-10-02T08:12:58.921714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47153b95-91d47918-3460ef5d-900073b9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:58.921772Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:58.932251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47153b95-91d47918-3460ef5d-900073b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.932543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:58.932556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1609
2025-10-02T08:12:58.932735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:58.932766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:58.932771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:58.932775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:58.933371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1609 sessionId:  describe result for acl check
2025-10-02T08:12:58.933402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:58.933403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:58.933408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:58.933412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534443727534475:8721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:58.933820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534443727534475:8721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:58.937578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534443727534475:8721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:58.942388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534443727534475:8721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:58.942403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534443727534475:8721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:58.942406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534443727534475:8721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:58.942415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:58.952699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:58.954167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:58.954364Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:58.954374Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:58.954383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:58.954427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:58.954469Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534443727534918:8725]
2025-10-02T08:12:58.955131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:58.955566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:58.955601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:58.955843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:58.955902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.955908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.955910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.955911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.955912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.955917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.955928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.955932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.955937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.955941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.955947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.955954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:58.955960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.955965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:58.955970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.955980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:58.955985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.955996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.956001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.956011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.956031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:58.967232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:58.969119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:58.969137Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:58.969139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:58.969143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:58.969150Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1608 [1:7556534443727534918:8725]
2025-10-02T08:12:58.969160Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:58.969177Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:58.969179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.969182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.969184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.969201Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:58.969206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:58.969214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:58.969283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.969292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.969295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:58.969298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:58.969369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:58.969377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.969390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:58.969405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:58.969427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534443727534760:8721], now have 1 active actors on pipe
2025-10-02T08:12:58.969437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534443727534911:8725]
2025-10-02T08:12:58.969439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534443727534911:8725]
2025-10-02T08:12:58.969446Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:58.969459Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:58.969465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:58.969471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:58.969478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:58.969481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:58.969487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534444187327536:2378], now have 1 active actors on pipe
2025-10-02T08:12:58.969522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534443727534911:8725]
2025-10-02T08:12:58.969529Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:58.970150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47153b95-91d47918-3460ef5d-900073b9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:58.969541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:58.969576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1608
2025-10-02T08:12:58.969588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.969592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.969614Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:58.969624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:58.969628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:58.969630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:58.969642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:58.969652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:58.969670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.969691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:58.969693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:58.969705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:58.969733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1609 partition: 0 MaxSeqNo: 17 sessionId: src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0
2025-10-02T08:12:58.969578Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1608
2025-10-02T08:12:58.972955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0] Write session: try to update token
2025-10-02T08:12:58.972969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:58.995461Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:58.995483Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:58.995485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:58.995493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534443727534911:8725]
2025-10-02T08:12:58.995498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534443727534911:8725]
2025-10-02T08:12:58.995534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:58.995544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:58.995543Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:58.995550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:58.995550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:58.995694Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:59.000278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId: src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:59.003004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:59.021306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534448022502238:8815]
2025-10-02T08:12:59.021412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1608, pipe: [1:7556534448022502238:8815]
2025-10-02T08:12:59.139800Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:59.140289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.140301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.140336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022502238:8815], now have 1 active actors on pipe
2025-10-02T08:12:59.140520Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:59.140750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:59.140799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1609 reason: status is not ok: tablet will be restarted right now sessionId: src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0
2025-10-02T08:12:59.140970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1609 sessionId: src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0 is DEAD
2025-10-02T08:12:59.141002Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:59.141138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534448022502238:8815]
2025-10-02T08:12:59.141328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:59.141335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0] Write session will restart in 0.006167s
2025-10-02T08:12:59.141363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0] Write session: Do CDS request
2025-10-02T08:12:59.141369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:59.149275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:59.151503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:59.151517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1610
2025-10-02T08:12:59.155226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:59.155282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:59.155287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:59.155306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:59.155768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1610 sessionId:  describe result for acl check
2025-10-02T08:12:59.155803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:59.155804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:59.155806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:59.155811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534448022502652:8717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:59.156344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534448022502652:8717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:59.156905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:59.158130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:59.158333Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:59.158342Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:59.158353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:59.158404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:59.158486Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534448022502678:8715]
2025-10-02T08:12:59.159090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:59.159466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:59.159513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:59.159807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:59.159857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.159858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.159859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.159861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.159862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.159868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.159877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.159880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.159884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.159887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.159892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.159900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.159906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.159910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.159914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.159919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.159923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.159929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.159933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.159937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.159954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:59.159957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534448022502652:8717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:59.169489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534448022502652:8717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:59.169516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534448022502652:8717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:59.169519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534448022502652:8717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:59.169545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:59.169817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:59.171713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:59.171732Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:59.171734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:59.171738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:59.171745Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1609 [1:7556534448022502678:8715]
2025-10-02T08:12:59.171758Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:59.171776Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:59.171779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.171782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.171784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.171800Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:59.171805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:59.171812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:59.171881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.171884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.171886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:59.171889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:59.171961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:59.171964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.171978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.171988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:59.172006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534448022502666:8715]
2025-10-02T08:12:59.172008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534448022502666:8715]
2025-10-02T08:12:59.172019Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:59.172031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:59.172047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:59.172049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:59.172082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534448022502666:8715]
2025-10-02T08:12:59.172084Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:59.172358Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:59.172363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:59.172369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:59.172910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1609
2025-10-02T08:12:59.172922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022502711:8717], now have 1 active actors on pipe
2025-10-02T08:12:59.172925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534448482294841:2378], now have 1 active actors on pipe
2025-10-02T08:12:59.172879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1609
2025-10-02T08:12:59.173037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.173045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.173071Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:59.173078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.173083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.173086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:59.173096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.173108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:59.173125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:59.173443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.173449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.173467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:59.173501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1610 partition: 0 MaxSeqNo: 17 sessionId: src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0
2025-10-02T08:12:59.173843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953346c4-c1dbf3f4-423f2223-7b5c0b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:59.176554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0] Write session: try to update token
2025-10-02T08:12:59.176573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:59.192204Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:59.192221Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:59.192225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:59.192234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534448022502666:8715]
2025-10-02T08:12:59.192238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534448022502666:8715]
2025-10-02T08:12:59.192282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:59.192290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.192292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:59.192463Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:59.193577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId: src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:59.196414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:59.197182Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:59.197195Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:59.241288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534448022502725:8815]
2025-10-02T08:12:59.241482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1609, pipe: [1:7556534448022502725:8815]
2025-10-02T08:12:59.340213Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:59.340554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.340567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.340605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022502725:8815], now have 1 active actors on pipe
2025-10-02T08:12:59.340856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534448022502725:8815]
2025-10-02T08:12:59.340934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:59.340941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:59.340948Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:59.341001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1610 reason: error at write: Disconnected sessionId: src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0
2025-10-02T08:12:59.341137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1610 sessionId: src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0 is DEAD
2025-10-02T08:12:59.341386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:59.341395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0] Write session will restart in 0.006541s
2025-10-02T08:12:59.341414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0] Write session: Do CDS request
2025-10-02T08:12:59.341422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:59.341757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:59.349253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:59.352981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:59.352998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1611
2025-10-02T08:12:59.356954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:59.357004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:59.357009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:59.357013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:59.357451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1611 sessionId:  describe result for acl check
2025-10-02T08:12:59.357482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:59.357488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:59.357490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:59.357494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534448022503157:8665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:59.358115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534448022503157:8665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:59.360018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:59.360793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534448022503157:8665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:59.361229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:59.361406Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:59.361410Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:59.361420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:59.361470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:59.361504Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534448022503215:8666]
2025-10-02T08:12:59.361962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:59.362175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:59.362212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:59.362525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:59.362555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.362556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.362557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.362558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.362559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.362563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.362572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.362576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.362579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.362582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.362587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.362594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.362599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.362604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.362608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.362612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.362615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.362620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.362623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.362627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.362644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:59.369448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534448022503157:8665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:59.369467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534448022503157:8665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:59.369471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534448022503157:8665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:59.369489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:59.371560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:59.373233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:59.373250Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:59.373253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:59.373257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:59.373264Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1610 [1:7556534448022503215:8666]
2025-10-02T08:12:59.373276Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:59.373293Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:59.373300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.373304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.373306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.373325Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:59.373330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:59.373337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:59.373406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.373412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.373416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:59.373419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:59.373482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:59.373488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.373502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.373515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:59.373526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1610
2025-10-02T08:12:59.373535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022503238:8665], now have 1 active actors on pipe
2025-10-02T08:12:59.373538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534448482294872:2378], now have 1 active actors on pipe
2025-10-02T08:12:59.373544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534448022503205:8666]
2025-10-02T08:12:59.373546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534448022503205:8666]
2025-10-02T08:12:59.373559Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:59.373573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.373581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.373601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:59.373619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:59.373626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:59.373656Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:59.373665Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:59.373669Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:59.373675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.373680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.373682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:59.373690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.373703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:59.373715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534448022503205:8666]
2025-10-02T08:12:59.373726Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:59.373753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:59.373763Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:59.373736Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1610
2025-10-02T08:12:59.373859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.373864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.373883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:59.373922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1611 partition: 0 MaxSeqNo: 17 sessionId: src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0
2025-10-02T08:12:59.374279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe3196a-c1a439bd-68c3bfe4-dcd123e8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:59.376932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0] Write session: try to update token
2025-10-02T08:12:59.376944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:59.401859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId: src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:59.404627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:59.405623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.405637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.405668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:12:59.405730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:59.405794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.405814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.405972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.406043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.406113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.406179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.406222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.406227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.406302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.406359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.406419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.406488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.406534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.406538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.406612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.406673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.406733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.406794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.406838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.406841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.406910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.406975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.407044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.407110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.407160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.407162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.407243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.407310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.407385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.407454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.407502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.407505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.407581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.407649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.407721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.407794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.407842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.407845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.407924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.407990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.408063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.408133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.408198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.408204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.408285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.408352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.408426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.408493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.408543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.408546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.408623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.408678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.408735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.408795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.408959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.408963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.409038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:12:59.409100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:12:59.409160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:12:59.409241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:12:59.409294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:12:59.409297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:12:59.409357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:12:59.409416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.409434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.409437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:12:59.409470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:12:59.409483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:12:59.409486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:12:59.409489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:12:59.409492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:12:59.409891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:12:59.409908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:12:59.409915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:12:59.409922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:12:59.409925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:12:59.409928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:12:59.410605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:12:59.410621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:12:59.410630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:12:59.410633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:12:59.410636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:12:59.410640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:12:59.411173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:12:59.411186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:12:59.411192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:12:59.411196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:12:59.411199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:12:59.412559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:12:59.412579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:12:59.412593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392779412
2025-10-02T08:12:59.412869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:12:59.412879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:12:59.412885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:12:59.412888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:12:59.412893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:12:59.412896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:12:59.413402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:12:59.413417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:12:59.413424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:12:59.413429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:12:59.413434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:12:59.413438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:12:59.413945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:12:59.413969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:12:59.413975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:12:59.413979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:12:59.413982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:12:59.413985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:12:59.414466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:12:59.414488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:12:59.414494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:12:59.415710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:12:59.415727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:12:59.415732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:12:59.415736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:12:59.415745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392779415
2025-10-02T08:12:59.416223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:12:59.416237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:12:59.416245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:12:59.416247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:12:59.416251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:12:59.416256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:12:59.416778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:12:59.416789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:12:59.416795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:12:59.416839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:12:59.416843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:12:59.416848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:12:59.417376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:12:59.417387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.417499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392779417
2025-10-02T08:12:59.424618Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:12:59.424659Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:12:59.424668Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:12:59.424676Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:12:59.424707Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:59.424710Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:59.424714Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:59.424722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534448022503205:8666]
2025-10-02T08:12:59.424731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534448022503205:8666]
2025-10-02T08:12:59.424787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:59.424796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:59.432338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:59.432358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.432361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:59.432542Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:59.440963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534448022503264:8815]
2025-10-02T08:12:59.441275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1610, pipe: [1:7556534448022503264:8815]
2025-10-02T08:12:59.611621Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:59.612095Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:12:59.612099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:59.612109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534448022503205:8666]
2025-10-02T08:12:59.612167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022503264:8815], now have 1 active actors on pipe
2025-10-02T08:12:59.612473Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:12:59.612703Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:59.613170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:12:59.613199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1611 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0
2025-10-02T08:12:59.613372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1611 sessionId: src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0 is DEAD
2025-10-02T08:12:59.613510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534448022503264:8815]
2025-10-02T08:12:59.616353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:12:59.616368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0] Write session will restart in 0.007323s
2025-10-02T08:12:59.616395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0] Write session: Do CDS request
2025-10-02T08:12:59.616402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:59.616883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:59.623323Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0fb9091dd68945aa] Result# TEvPutResult {Id# [72075186224037892:1610:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:12:59.623328Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1610:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:59.623429Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1610:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:12:59.625728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:59.627357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:59.627379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1612
2025-10-02T08:12:59.628283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:59.628325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:59.628330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:59.628334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:59.629623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1612 sessionId:  describe result for acl check
2025-10-02T08:12:59.629660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:59.629662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:59.629663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:59.629669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534448022503499:8653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:59.630321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534448022503499:8653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:59.634468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534448022503499:8653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:59.646958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534448022503499:8653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:59.646975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534448022503499:8653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:59.646979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534448022503499:8653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:59.646989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:59.650901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:59.651415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:59.651684Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:59.651688Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:59.651699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:59.651753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:59.651790Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534448022503743:8657]
2025-10-02T08:12:59.652508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:59.652820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:59.652868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:59.653189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:59.653227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.653228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.653229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.653230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.653232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.653237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.653249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.653254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.653258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.653263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.653269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.653276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.653282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.653288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.653293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.653299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.653304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.653310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.653319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.653324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.653345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:59.664303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:59.666077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:59.666084Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:59.666088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:59.666092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:59.666100Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1611 [1:7556534448022503743:8657]
2025-10-02T08:12:59.666116Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:59.666136Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:59.666139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.666142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.666144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.666164Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:59.666169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:59.666178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:59.666255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.666257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.666261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:59.666263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:59.666345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:59.666348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.666363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.666374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:59.666392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534448022503737:8657]
2025-10-02T08:12:59.666394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534448022503737:8657]
2025-10-02T08:12:59.666406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:59.666420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:59.666436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:59.666439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:59.666474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534448022503737:8657]
2025-10-02T08:12:59.666476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:59.666723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:59.666730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:59.666735Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:59.667341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1611
2025-10-02T08:12:59.667358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022503726:8653], now have 1 active actors on pipe
2025-10-02T08:12:59.667362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534448482294888:2378], now have 1 active actors on pipe
2025-10-02T08:12:59.667886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1611
2025-10-02T08:12:59.667941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.667954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.667986Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:59.667996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.668000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.668002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:59.668014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.668027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:59.668046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:59.668195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.668203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.668217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:59.668249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1612 partition: 0 MaxSeqNo: 17 sessionId: src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0
2025-10-02T08:12:59.668993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5466dc1b-faa64a9-add86d91-5b4dc882_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:59.672137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0] Write session: try to update token
2025-10-02T08:12:59.672178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:59.694122Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:59.694137Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:59.694140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:59.694151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534448022503737:8657]
2025-10-02T08:12:59.694157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534448022503737:8657]
2025-10-02T08:12:59.694206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:59.694214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.694217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:59.694373Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:59.697621Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:59.697631Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:59.712305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534448022503767:8815]
2025-10-02T08:12:59.712464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1611, pipe: [1:7556534448022503767:8815]
2025-10-02T08:12:59.723101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId: src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:59.725922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:59.865716Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:12:59.866421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022503767:8815], now have 1 active actors on pipe
2025-10-02T08:12:59.866453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.866459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.869418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:12:59.869426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:12:59.869491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1612 reason: error at write: Disconnected sessionId: src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0
2025-10-02T08:12:59.869686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1612 sessionId: src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0 is DEAD
2025-10-02T08:12:59.869825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534448022503767:8815]
2025-10-02T08:12:59.869996Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:12:59.873030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:12:59.873043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0] Write session will restart in 0.005658s
2025-10-02T08:12:59.873069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0] Write session: Do CDS request
2025-10-02T08:12:59.873077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:12:59.877047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:12:59.884552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:59.885084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:12:59.885099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1613
2025-10-02T08:12:59.886227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:12:59.886270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:12:59.886275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:12:59.886279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:12:59.886917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1613 sessionId:  describe result for acl check
2025-10-02T08:12:59.886954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:12:59.886956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:12:59.886958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:12:59.886964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534448022504038:8640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:12:59.887522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534448022504038:8640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:12:59.893782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534448022504038:8640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:12:59.895551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:12:59.897211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:12:59.897406Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:12:59.897409Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:12:59.897418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:12:59.897466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:12:59.897503Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534448022504233:8645]
2025-10-02T08:12:59.898112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:12:59.898535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:12:59.898591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:12:59.898904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:12:59.898957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.898963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.898964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.898965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.898966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.898971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.898980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.898984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.898987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.898991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.898997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.899004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:12:59.899015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.899019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:12:59.899028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.899033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:12:59.899036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.899041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.899046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.899055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.899075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:12:59.902571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534448022504038:8640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:12:59.902587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534448022504038:8640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:12:59.902591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534448022504038:8640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:12:59.902600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:12:59.907598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:12:59.909721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:12:59.909727Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:12:59.909730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:12:59.909733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:12:59.909739Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1612 [1:7556534448022504233:8645]
2025-10-02T08:12:59.909751Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:12:59.909768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:12:59.909771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.909773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.909775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.909793Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:12:59.909798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:12:59.909805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:12:59.909871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.909873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.909876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:12:59.909878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:12:59.909948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:12:59.909951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.909965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:12:59.909976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:12:59.909993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534448022504227:8645]
2025-10-02T08:12:59.909995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534448022504227:8645]
2025-10-02T08:12:59.910010Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:12:59.910024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:12:59.910035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:12:59.910037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:12:59.910068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:12:59.910072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:12:59.910074Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534448022504227:8645]
2025-10-02T08:12:59.910076Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:12:59.910079Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:12:59.910133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1612
2025-10-02T08:12:59.910141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022504249:8640], now have 1 active actors on pipe
2025-10-02T08:12:59.910146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.910150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.910172Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df1fb803-3fdf8610-a17834ff-b67783da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:12:59.910178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:12:59.910181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:12:59.910182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:12:59.910191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:12:59.910201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:12:59.910209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534448482294896:2378], now have 1 active actors on pipe
2025-10-02T08:12:59.910219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:59.910493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:12:59.910504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:12:59.910518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:12:59.910548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1613 partition: 0 MaxSeqNo: 17 sessionId: src_id|df1fb803-3fdf8610-a17834ff-b67783da_0
2025-10-02T08:12:59.910776Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1612
2025-10-02T08:12:59.910916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd2a1b8-fe40fadd-1f506c6c-220b4e37_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df1fb803-3fdf8610-a17834ff-b67783da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:12:59.913654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df1fb803-3fdf8610-a17834ff-b67783da_0] Write session: try to update token
2025-10-02T08:12:59.913671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df1fb803-3fdf8610-a17834ff-b67783da_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:12:59.932031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId: src_id|df1fb803-3fdf8610-a17834ff-b67783da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:12:59.932833Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:12:59.932845Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:12:59.932848Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:12:59.932855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534448022504227:8645]
2025-10-02T08:12:59.932859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534448022504227:8645]
2025-10-02T08:12:59.932908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:12:59.932918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:12:59.932919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:12:59.933068Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:12:59.933775Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:12:59.933790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:12:59.934919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:12:59.969009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534448022504265:8815]
2025-10-02T08:12:59.969229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1612, pipe: [1:7556534448022504265:8815]
2025-10-02T08:13:00.090573Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:00.090975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.090989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.091030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534448022504265:8815], now have 1 active actors on pipe
2025-10-02T08:13:00.092342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1fb803-3fdf8610-a17834ff-b67783da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:00.092354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1fb803-3fdf8610-a17834ff-b67783da_0] Write session will restart in 0.007643s
2025-10-02T08:13:00.091435Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:00.091804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534448022504265:8815]
2025-10-02T08:13:00.092390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1fb803-3fdf8610-a17834ff-b67783da_0] Write session: Do CDS request
2025-10-02T08:13:00.091821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:00.092397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1fb803-3fdf8610-a17834ff-b67783da_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:00.091874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1613 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df1fb803-3fdf8610-a17834ff-b67783da_0
2025-10-02T08:13:00.092035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1613 sessionId: src_id|df1fb803-3fdf8610-a17834ff-b67783da_0 is DEAD
2025-10-02T08:13:00.092552Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:00.101305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df1fb803-3fdf8610-a17834ff-b67783da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:00.101390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:00.101405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1614
2025-10-02T08:13:00.101607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:00.101639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:00.101644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:00.101648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:00.102088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1614 sessionId:  describe result for acl check
2025-10-02T08:13:00.102130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:00.102141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:00.102143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:00.102148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534452317471895:8615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:00.102699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534452317471895:8615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:00.106055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534452317471895:8615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:00.110912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534452317471895:8615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:00.110931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534452317471895:8615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:00.110935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534452317471895:8615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:00.110944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:00.113016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:00.113871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:00.114165Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:00.114176Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:00.114186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:00.114230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:00.114261Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534452317472032:8625]
2025-10-02T08:13:00.114984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:00.115273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:00.115314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:00.115634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:00.115669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.115670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.115671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.115672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.115674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.115679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.115689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.115693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.115697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.115700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.115706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.115713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.115720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.115725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.115730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.115735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.115739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.115744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.115748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.115753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.115772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:00.130236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:00.131918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:00.131927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:00.131931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:00.131935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:00.131943Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1613 [1:7556534452317472032:8625]
2025-10-02T08:13:00.131958Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:00.131979Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:00.131982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:00.131986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:00.131988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:00.132006Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:00.132011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:00.132019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:00.132094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.132097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.132100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:00.132103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:00.132192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:00.132195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.132210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.132223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:00.132242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534452317472026:8625]
2025-10-02T08:13:00.132244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534452317472026:8625]
2025-10-02T08:13:00.132260Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:00.132273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:00.132289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:00.132292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:00.132332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534452317472026:8625]
2025-10-02T08:13:00.132335Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:00.132433Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:00.132438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:00.132447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:00.132648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534452317472011:8615], now have 1 active actors on pipe
2025-10-02T08:13:00.132653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1613
2025-10-02T08:13:00.132683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534452777262199:2378], now have 1 active actors on pipe
2025-10-02T08:13:00.132691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.132699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.132938Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1613
2025-10-02T08:13:00.132730Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6673238-19de3ce4-49fa368d-6054332_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:00.132746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:00.132751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:00.132754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:00.132767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:00.132779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:00.132799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:00.132884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.132887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.132902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:00.132938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1614 partition: 0 MaxSeqNo: 17 sessionId: src_id|a6673238-19de3ce4-49fa368d-6054332_0
2025-10-02T08:13:00.137134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1fb803-3fdf8610-a17834ff-b67783da_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a6673238-19de3ce4-49fa368d-6054332_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:00.140092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6673238-19de3ce4-49fa368d-6054332_0] Write session: try to update token
2025-10-02T08:13:00.140114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6673238-19de3ce4-49fa368d-6054332_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:00.161107Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:00.161122Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:00.161124Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:00.161133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534452317472026:8625]
2025-10-02T08:13:00.161137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534452317472026:8625]
2025-10-02T08:13:00.161181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:00.161187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.161190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:00.161338Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:00.164674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:00.164690Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:00.172595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId: src_id|a6673238-19de3ce4-49fa368d-6054332_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:00.175522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:00.192092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534452317472058:8815]
2025-10-02T08:13:00.192399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1613, pipe: [1:7556534452317472058:8815]
2025-10-02T08:13:00.313192Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:00.313747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.313764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.313805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534452317472058:8815], now have 1 active actors on pipe
2025-10-02T08:13:00.313984Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:00.314282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:00.314338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1614 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6673238-19de3ce4-49fa368d-6054332_0
2025-10-02T08:13:00.314520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1614 sessionId: src_id|a6673238-19de3ce4-49fa368d-6054332_0 is DEAD
2025-10-02T08:13:00.314660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534452317472058:8815]
2025-10-02T08:13:00.314277Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:00.316896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6673238-19de3ce4-49fa368d-6054332_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:00.316910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6673238-19de3ce4-49fa368d-6054332_0] Write session will restart in 0.006647s
2025-10-02T08:13:00.316941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6673238-19de3ce4-49fa368d-6054332_0] Write session: Do CDS request
2025-10-02T08:13:00.316948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6673238-19de3ce4-49fa368d-6054332_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:00.324326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6673238-19de3ce4-49fa368d-6054332_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:00.337280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:00.337299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1615
2025-10-02T08:13:00.340938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:00.340985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:00.340990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:00.340995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:00.342523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1615 sessionId:  describe result for acl check
2025-10-02T08:13:00.342560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:00.342562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:00.342565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:00.342570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534452317472111:8592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:00.343534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534452317472111:8592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:00.354799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534452317472111:8592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:00.373920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534452317472111:8592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:00.373936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534452317472111:8592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:00.373939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534452317472111:8592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:00.373948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:00.417491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534452317472494:8815]
2025-10-02T08:13:00.441170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:00.443090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:00.443303Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:00.443307Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:00.443317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:00.443365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:00.443403Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534452317472576:8609]
2025-10-02T08:13:00.444091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:00.444467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:00.444512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:00.444978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:00.445027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.445028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.445029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.445030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.445031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.445037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.445047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.445051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.445055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.445060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.445065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.445073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.445079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.445084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.445089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.445095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.445099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.445105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.445110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.445116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.445136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:00.459663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:00.461532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:00.461538Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:00.461540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:00.461543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:00.461549Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1614 [1:7556534452317472576:8609]
2025-10-02T08:13:00.461560Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:00.461575Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:00.461578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:00.461580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:00.461582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:00.461599Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:00.461604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:00.461610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:00.461670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.461672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.461674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:00.461676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:00.461739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:00.461742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.461755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.461771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:00.461787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534452317472570:8609]
2025-10-02T08:13:00.461789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534452317472570:8609]
2025-10-02T08:13:00.461799Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:00.461810Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:00.461824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:00.461826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:00.461854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534452317472570:8609]
2025-10-02T08:13:00.461855Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:00.462296Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:00.462301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:00.462306Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:00.463026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534452317472324:8592], now have 1 active actors on pipe
2025-10-02T08:13:00.463031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534452317472494:8815], now have 1 active actors on pipe
2025-10-02T08:13:00.463034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534452777262210:2378], now have 1 active actors on pipe
2025-10-02T08:13:00.463061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1614, pipe: [1:7556534452317472494:8815]
2025-10-02T08:13:00.463077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1614
2025-10-02T08:13:00.464227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.464241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.464266Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:00.464273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:00.464278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:00.464280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:00.464291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:00.464302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:00.464319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:00.462401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1614
2025-10-02T08:13:00.464503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.464508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.464523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:00.464736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1615 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0
2025-10-02T08:13:00.472913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6673238-19de3ce4-49fa368d-6054332_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:00.475664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0] Write session: try to update token
2025-10-02T08:13:00.475685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:00.498077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId: src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:00.501151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:00.501237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.501247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.501288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:00.501311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:00.501375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.501379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.501810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.501884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.501955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.502025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.502070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.502074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.502155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.502221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.502292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.502361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.502406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.502408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.502487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.502549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.502610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.502674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.502716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.502719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.502790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.502876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.502964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.503047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.503105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.503108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.503201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.503278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.503358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.503441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.503496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.503498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.503918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.503998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.504078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.504174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.504229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.504232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.504322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.504610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.504723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.504816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.504872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.504875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.504969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.505053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.505140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.505224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.505290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.505293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.505377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.505444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.505508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.505581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.505634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.505637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.505724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:00.505791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:00.505861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:00.505935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:00.505989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:00.505991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:00.506035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:00.506104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:00.506124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:00.506126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:00.506162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:00.506176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:00.506181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:00.506184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:00.506187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:00.506624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:00.506642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:00.506649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:00.506652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:00.506655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:00.506659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:00.507356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:00.507372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:00.507379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:00.507382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:00.507385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:00.507390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:00.508031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:00.508045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:00.508051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:00.508055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:00.508057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:00.521667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:00.521705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:00.521725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392780518
2025-10-02T08:13:00.521882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:00.521896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:00.521905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:00.521908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:00.521914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:00.521918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:00.522540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:00.522557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:00.522565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:00.522570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:00.522573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:00.522578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:00.523181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:00.523199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:00.523207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:00.523211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:00.523215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:00.523218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:00.524052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:00.524078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:00.524086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:00.525598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:00.525617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:00.525624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:00.525627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:00.525636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392780524
2025-10-02T08:13:00.526020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:00.526036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:00.526044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:00.526048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:00.526053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:00.526059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:00.526653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:00.526667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:00.526674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:00.526681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:00.526685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:00.526689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:00.527277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:00.527290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:00.527401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392780526
2025-10-02T08:13:00.532274Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:00.532298Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:00.532304Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:00.532311Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:00.541795Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:00.541809Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:00.541818Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:00.541826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534452317472570:8609]
2025-10-02T08:13:00.541830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534452317472570:8609]
2025-10-02T08:13:00.541883Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:00.541890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:00.541895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534452317472570:8609]
2025-10-02T08:13:00.541938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:00.541947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.541949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:00.542107Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:00.545056Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:00.545074Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:00.545085Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:00.768595Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:00.775605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:00.775620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0] Write session will restart in 0.009324s
2025-10-02T08:13:00.775646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0] Write session: Do CDS request
2025-10-02T08:13:00.775652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:00.773963Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:00.774938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:00.774973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1615 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0
2025-10-02T08:13:00.775179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1615 sessionId: src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0 is DEAD
2025-10-02T08:13:00.775330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534452317472494:8815]
2025-10-02T08:13:00.773580Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:00.787321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:00.787839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:00.787852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1616
2025-10-02T08:13:00.788094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:00.788124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:00.788129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:00.788132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:00.789630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1616 sessionId:  describe result for acl check
2025-10-02T08:13:00.789664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:00.789665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:00.789667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:00.789672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534452317472844:8559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:00.790197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534452317472844:8559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:00.823415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534452317472844:8559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:00.842068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:00.842957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:00.843316Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:00.843322Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:00.843343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:00.843452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:00.843509Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534452317473092:8553]
2025-10-02T08:13:00.844338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:00.845301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534452317472844:8559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:00.845324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534452317472844:8559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:00.845328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534452317472844:8559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:00.845339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:00.845482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:00.845558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:00.845921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:00.845985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.845986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.845988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.845989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.845991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.845997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.846007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.846015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.846020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.846023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.846031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.846038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:00.846045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.846050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:00.846055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.846060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:00.846065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.846074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.846081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.846087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.846107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:00.859927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:00.862188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:00.862197Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:00.862200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:00.862205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:00.862213Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1615 [1:7556534452317473092:8553]
2025-10-02T08:13:00.862227Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:00.862248Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:00.862251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:00.862254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:00.862256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:00.862276Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:00.862282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:00.862290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:00.862373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.862378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.862382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:00.862385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:00.862461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:00.862463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.862478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:00.862488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:00.862506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534452317473086:8553]
2025-10-02T08:13:00.862508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534452317473086:8553]
2025-10-02T08:13:00.862523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:00.862538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:00.862553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:00.862557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:00.862598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534452317473086:8553]
2025-10-02T08:13:00.862600Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:00.862856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:00.862863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:00.862870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:00.863477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1615
2025-10-02T08:13:00.863494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534452317473101:8559], now have 1 active actors on pipe
2025-10-02T08:13:00.863498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534452777262252:2378], now have 1 active actors on pipe
2025-10-02T08:13:00.864003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.864013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.864044Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34d5f06a-a41db726-8646bf69-29a03db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:00.864053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:00.864057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:00.864059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:00.864072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:00.864084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:00.864104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:00.864246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:00.864252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:00.864267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:00.864301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1616 partition: 0 MaxSeqNo: 17 sessionId: src_id|34d5f06a-a41db726-8646bf69-29a03db6_0
2025-10-02T08:13:00.864787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f493290-8d5ab589-cfd7cf9e-ec5e40a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|34d5f06a-a41db726-8646bf69-29a03db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:00.863769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1615
2025-10-02T08:13:00.867686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34d5f06a-a41db726-8646bf69-29a03db6_0] Write session: try to update token
2025-10-02T08:13:00.867705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34d5f06a-a41db726-8646bf69-29a03db6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:00.875218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534452317473120:8815]
2025-10-02T08:13:00.875412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1615, pipe: [1:7556534452317473120:8815]
2025-10-02T08:13:00.875436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534452317473120:8815], now have 1 active actors on pipe
2025-10-02T08:13:00.903908Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:00.903931Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:00.903934Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:00.903944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534452317473086:8553]
2025-10-02T08:13:00.903949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534452317473086:8553]
2025-10-02T08:13:00.903999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:00.904006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:00.904009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:00.904183Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:00.909148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:00.909170Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:00.930842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId: src_id|34d5f06a-a41db726-8646bf69-29a03db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:00.933755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:01.092978Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:01.093464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.093473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.094638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:01.094644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:01.094706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1616 reason: error at write: Disconnected sessionId: src_id|34d5f06a-a41db726-8646bf69-29a03db6_0
2025-10-02T08:13:01.094899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1616 sessionId: src_id|34d5f06a-a41db726-8646bf69-29a03db6_0 is DEAD
2025-10-02T08:13:01.095046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534452317473120:8815]
2025-10-02T08:13:01.095848Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:01.096548Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:01.097097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d5f06a-a41db726-8646bf69-29a03db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:01.097110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d5f06a-a41db726-8646bf69-29a03db6_0] Write session will restart in 0.007196s
2025-10-02T08:13:01.097135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d5f06a-a41db726-8646bf69-29a03db6_0] Write session: Do CDS request
2025-10-02T08:13:01.097143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d5f06a-a41db726-8646bf69-29a03db6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:01.105352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34d5f06a-a41db726-8646bf69-29a03db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:01.105673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:01.105686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1617
2025-10-02T08:13:01.105798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:01.105824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:01.105829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:01.105832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:01.106285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1617 sessionId:  describe result for acl check
2025-10-02T08:13:01.106311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:01.106313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:01.106315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:01.106321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534456612440431:8563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:01.106880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534456612440431:8563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:01.109949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534456612440431:8563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:01.113340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534456612440431:8563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:01.113355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534456612440431:8563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:01.113358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534456612440431:8563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:01.113366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:01.137164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:01.138614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:01.138942Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:01.138952Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:01.138963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:01.139018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:01.139056Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534456612440899:8561]
2025-10-02T08:13:01.139665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:01.139908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:01.139961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:01.140307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:01.140352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.140353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.140355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.140356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.140357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.140363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.140374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.140379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.140383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.140387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.140392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.140400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.140407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.140412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.140417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.140422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.140427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.140433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.140438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.140444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.140467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:01.149688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:01.151841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:01.151860Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:01.151862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:01.151865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:01.151873Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1616 [1:7556534456612440899:8561]
2025-10-02T08:13:01.151884Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:01.151898Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:01.151900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.151902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.151904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.151916Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:01.151920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:01.151925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:01.151978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.151987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.151990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:01.151992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:01.152064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:01.152073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.152090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.152103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:01.152123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534456612440666:8563], now have 1 active actors on pipe
2025-10-02T08:13:01.152126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534457072229554:2378], now have 1 active actors on pipe
2025-10-02T08:13:01.152127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1616
2025-10-02T08:13:01.152133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534456612440893:8561]
2025-10-02T08:13:01.152136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534456612440893:8561]
2025-10-02T08:13:01.152146Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:01.152168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.152173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.152189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:01.152203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:01.152210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:01.152211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:01.152214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:01.152253Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:01.152259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.152268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.152270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:01.152278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.152287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:01.152299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534456612440893:8561]
2025-10-02T08:13:01.152312Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:01.152342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:01.152370Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:01.152395Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1616
2025-10-02T08:13:01.152386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.152392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.152408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:01.152443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1617 partition: 0 MaxSeqNo: 17 sessionId: src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0
2025-10-02T08:13:01.152859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d5f06a-a41db726-8646bf69-29a03db6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:01.155569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0] Write session: try to update token
2025-10-02T08:13:01.155587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:01.186153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId: src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:01.188063Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:01.188080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:01.188090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534456612440893:8561]
2025-10-02T08:13:01.188134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:01.188183Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:01.188317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:01.188462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:01.188605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:01.188744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:01.189031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:01.189162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:01.189203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.189220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.189239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:01.189277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:01.189304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:01.189434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.189442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.189615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.189674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.189736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.189800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.189850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.189854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.189931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.189988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.190056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.190127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.190174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.190177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.190257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.190321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.190387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.190453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.190497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.190500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.190578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.190643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.190705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.190768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.190815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.190818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.190901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.190961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.191028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.191100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.191145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.191148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.191222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.191285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.191349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.191414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.191458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.191461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.191537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.191597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.191670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.191741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.191788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.191791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.191867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.191932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.191994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.192062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.192127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.192135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.192229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.192303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.192370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.192433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.192477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.192483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.192563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:01.192636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:01.192720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:01.192888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:01.193061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:01.193068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:01.193105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:01.193183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.193201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.193203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:01.193239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:01.193262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:01.193265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:01.193268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:01.193271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:01.193541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534456612440925:8815]
2025-10-02T08:13:01.193711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:01.193743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:01.193754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:01.193758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:01.193761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:01.193765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:01.194324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:01.194348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:01.194355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:01.194358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:01.194362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:01.194365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:01.194837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:01.194849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:01.194854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:01.194859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:01.194862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:01.196189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:01.196200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:01.196212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392781196
2025-10-02T08:13:01.196437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:01.196443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:01.196448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:01.196451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:01.196455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:01.196461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:01.197119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1616, pipe: [1:7556534456612440925:8815]
2025-10-02T08:13:01.197328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:01.197347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:01.197353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:01.197356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:01.197360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:01.197366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:01.197826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:01.197845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:01.197851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:01.197854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:01.197857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:01.197860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:01.198371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:01.198382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:01.198387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:01.199536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:01.199544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:01.199549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:01.199553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:01.199561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392781197
2025-10-02T08:13:01.199869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:01.199879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:01.199885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:01.199888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:01.199892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:01.199895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:01.200387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:01.200397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:01.200404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:01.200408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:01.200411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:01.200415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:01.201897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:01.201916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.202023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392781201
2025-10-02T08:13:01.202811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534456612440925:8815], now have 1 active actors on pipe
2025-10-02T08:13:01.202817Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:01.202831Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:01.202837Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:01.202843Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:01.218856Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:01.218878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:01.218881Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:01.218891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534456612440893:8561]
2025-10-02T08:13:01.218895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534456612440893:8561]
2025-10-02T08:13:01.218941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:01.218948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.218951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:01.219121Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:01.220991Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:01.221003Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:01.368663Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:01.369284Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:01.369960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:01.369989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1617 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0
2025-10-02T08:13:01.370173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1617 sessionId: src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0 is DEAD
2025-10-02T08:13:01.370308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534456612440925:8815]
2025-10-02T08:13:01.369979Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:01.373299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:01.373309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0] Write session will restart in 0.007910s
2025-10-02T08:13:01.373334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0] Write session: Do CDS request
2025-10-02T08:13:01.373341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:01.384662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:01.385065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:01.385078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1618
2025-10-02T08:13:01.385389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:01.385419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:01.385424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:01.385427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:01.386040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1618 sessionId:  describe result for acl check
2025-10-02T08:13:01.386090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:01.386093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:01.386094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:01.386099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534456612441236:8549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:01.386750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534456612441236:8549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:01.390176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534456612441236:8549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:01.393769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:01.399512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:01.399773Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:01.399778Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:01.399789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:01.399858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:01.399901Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534456612441408:8547]
2025-10-02T08:13:01.400535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:01.401025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:01.401078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:01.401400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:01.401445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.401446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.401447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.401448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.401450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.401456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.401464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.401468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.401471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.401474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.401481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.401488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.401494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.401498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.401502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.401507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.401510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.401514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.401519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.401524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.401541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:01.402349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534456612441236:8549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:01.402360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534456612441236:8549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:01.402364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534456612441236:8549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:01.402373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:01.412716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:01.414468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:01.414474Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:01.414477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:01.414482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:01.414489Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1617 [1:7556534456612441408:8547]
2025-10-02T08:13:01.414501Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:01.414520Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:01.414524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.414527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.414529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.414547Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:01.414554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:01.414561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:01.414630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.414632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.414636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:01.414638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:01.414708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:01.414711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.414724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.414736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:01.414753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534456612441402:8547]
2025-10-02T08:13:01.414755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534456612441402:8547]
2025-10-02T08:13:01.414762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:01.414776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:01.414790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:01.414792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:01.414829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534456612441402:8547]
2025-10-02T08:13:01.414834Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:01.416007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1617
2025-10-02T08:13:01.415146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:01.415152Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:01.415158Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:01.421371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1617
2025-10-02T08:13:01.421396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534456612441428:8549], now have 1 active actors on pipe
2025-10-02T08:13:01.421406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534457072229576:2378], now have 1 active actors on pipe
2025-10-02T08:13:01.422169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.422176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.422205Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:01.422214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.422218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.422221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:01.422233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.422249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:01.422269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:01.422737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.422746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.422768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:01.422805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1618 partition: 0 MaxSeqNo: 17 sessionId: src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0
2025-10-02T08:13:01.423299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d070ce-77b2cc43-fdaf8c1c-3021924f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:01.426562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0] Write session: try to update token
2025-10-02T08:13:01.426583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:01.441516Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:01.441535Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:01.441539Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:01.441547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534456612441402:8547]
2025-10-02T08:13:01.441551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534456612441402:8547]
2025-10-02T08:13:01.441596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:01.441603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.441605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:01.441799Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:01.443300Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:01.443319Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:01.452364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId: src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:01.455386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:01.471127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534456612441479:8815]
2025-10-02T08:13:01.473011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1617, pipe: [1:7556534456612441479:8815]
2025-10-02T08:13:01.601303Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:01.601690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.601702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.601723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534456612441479:8815], now have 1 active actors on pipe
2025-10-02T08:13:01.602275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534456612441479:8815]
2025-10-02T08:13:01.602298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:01.602301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:01.602367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1618 reason: error at write: Disconnected sessionId: src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0
2025-10-02T08:13:01.602585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1618 sessionId: src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0 is DEAD
2025-10-02T08:13:01.602939Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:01.602439Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:01.605499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:01.605509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0] Write session will restart in 0.007311s
2025-10-02T08:13:01.605538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0] Write session: Do CDS request
2025-10-02T08:13:01.605545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:01.614390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:01.615848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:01.615868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1619
2025-10-02T08:13:01.616026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:01.616071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:01.616078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:01.616082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:01.616528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1619 sessionId:  describe result for acl check
2025-10-02T08:13:01.616560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:01.616561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:01.616563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:01.616568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534456612441687:8522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:01.617150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534456612441687:8522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:01.621760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534456612441687:8522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:01.626749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534456612441687:8522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:01.626767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534456612441687:8522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:01.626770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534456612441687:8522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:01.626780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:01.637961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:01.638386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:01.638600Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:01.638609Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:01.638618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:01.638662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:01.638698Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534456612441969:8525]
2025-10-02T08:13:01.639387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:01.639597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:01.639641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:01.639956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:01.640005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.640011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.640012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.640013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.640014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.640021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.640032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.640037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.640041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.640045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.640051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.640058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.640064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.640070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.640078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.640084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.640089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.640096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.640102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.640115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.640137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:01.649402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:01.651363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:01.651382Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:01.651384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:01.651388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:01.651395Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1618 [1:7556534456612441969:8525]
2025-10-02T08:13:01.651407Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:01.651425Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:01.651429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.651432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.651434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.651453Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:01.651461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:01.651469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:01.651543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.651550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.651554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:01.651556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:01.651629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:01.651637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.651652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.651670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:01.651678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1618
2025-10-02T08:13:01.651696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534456612441814:8522], now have 1 active actors on pipe
2025-10-02T08:13:01.651704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534457072229605:2378], now have 1 active actors on pipe
2025-10-02T08:13:01.651709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.651717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.651735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534456612441963:8525]
2025-10-02T08:13:01.651742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534456612441963:8525]
2025-10-02T08:13:01.651756Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:01.651773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:01.651773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:01.651776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:01.651793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:01.651801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:01.651816Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:01.651827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.651835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.651841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:01.651851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.651864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:01.651905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534456612441963:8525]
2025-10-02T08:13:01.651918Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:01.651932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:01.651936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:01.651990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.651997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.652011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:01.652056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1619 partition: 0 MaxSeqNo: 17 sessionId: src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0
2025-10-02T08:13:01.652867Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1618
2025-10-02T08:13:01.653798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbbc34ef-f7ce9bc5-edea2c1b-59b7a56_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:01.656754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0] Write session: try to update token
2025-10-02T08:13:01.656774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:01.668392Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:01.668409Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:01.668419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534456612441963:8525]
2025-10-02T08:13:01.668463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:01.668653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:01.668832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:01.668977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:01.669129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:01.669339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:01.669378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:01.669563Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:01.694424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId: src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:01.694635Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:01.694640Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:01.694642Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:01.694653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534456612441963:8525]
2025-10-02T08:13:01.694657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534456612441963:8525]
2025-10-02T08:13:01.694703Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:01.694704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:01.694708Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:01.694711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.694713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:01.694861Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:01.697357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:01.701978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534456612441996:8815]
2025-10-02T08:13:01.702224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1618, pipe: [1:7556534456612441996:8815]
2025-10-02T08:13:01.867157Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:01.868944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.868968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.869012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534456612441996:8815], now have 1 active actors on pipe
2025-10-02T08:13:01.872263Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:01.872858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:01.872942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1619 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0
2025-10-02T08:13:01.873075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534456612441996:8815]
2025-10-02T08:13:01.873375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:01.873890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:01.873899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0] Write session will restart in 0.009543s
2025-10-02T08:13:01.873925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0] Write session: Do CDS request
2025-10-02T08:13:01.873936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:01.873236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1619 sessionId: src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0 is DEAD
2025-10-02T08:13:01.889307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:01.894138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:01.894160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1620
2025-10-02T08:13:01.896997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:01.897063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:01.897069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:01.897075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:01.898540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1620 sessionId:  describe result for acl check
2025-10-02T08:13:01.898609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:01.898611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:01.898613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:01.898622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534456612442196:8500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:01.899274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534456612442196:8500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:01.919442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534456612442196:8500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:01.941434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534456612442196:8500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:01.941455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534456612442196:8500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:01.941459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534456612442196:8500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:01.941471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:01.946073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:01.947851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:01.948071Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:01.948075Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:01.948085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:01.948128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:01.948196Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534456612442484:8509]
2025-10-02T08:13:01.948834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:01.949167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:01.949230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:01.949620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:01.949674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.949680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.949682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.949684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.949686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.949692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.949707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.949714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.949719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.949723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.949731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.949740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:01.949747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.949759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:01.949765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.949773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:01.949783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.949789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.949795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.949801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.949825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:01.972313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:01.974870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:01.974895Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:01.974898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:01.974904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:01.974913Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1619 [1:7556534456612442484:8509]
2025-10-02T08:13:01.974931Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:01.974959Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:01.974962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.974967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.974970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.974996Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:01.975004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:01.975013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:01.975121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.975124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.975128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:01.975131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:01.975231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:01.975235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:01.975252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:01.975263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:01.975288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534456612442474:8509]
2025-10-02T08:13:01.975290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534456612442474:8509]
2025-10-02T08:13:01.975418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:01.975421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:01.975941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1619
2025-10-02T08:13:01.980064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534456612442498:8815]
2025-10-02T08:13:01.980768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1619, pipe: [1:7556534456612442498:8815]
2025-10-02T08:13:01.980874Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:01.980937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:01.980969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:01.980974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:01.981005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534456612442473:8500], now have 1 active actors on pipe
2025-10-02T08:13:01.981012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534457072229615:2378], now have 1 active actors on pipe
2025-10-02T08:13:01.981019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.981027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.981047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534456612442498:8815], now have 1 active actors on pipe
2025-10-02T08:13:01.981101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534456612442474:8509]
2025-10-02T08:13:01.981110Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:01.981133Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:01.981145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:01.981152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:01.981155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:01.981173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:01.981191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:01.981239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:01.981463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:01.982112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:01.982121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:01.982148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:01.982197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1620 partition: 0 MaxSeqNo: 17 sessionId: src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0
2025-10-02T08:13:01.980927Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1619
2025-10-02T08:13:01.985165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cb9fa8a-9648bc0f-e25b2964-2dae81e3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:01.987954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0] Write session: try to update token
2025-10-02T08:13:01.987973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:02.018211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId: src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:02.021411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:02.029176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.029199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.031118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:02.031153Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:02.031156Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:02.031159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:02.031168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534456612442474:8509]
2025-10-02T08:13:02.031174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534456612442474:8509]
2025-10-02T08:13:02.031222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:02.031229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.031232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:02.031402Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:02.032241Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:02.032253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:02.032991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:02.231851Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:02.232319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.232331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.232530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.232595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.232664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.232733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.232780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.232785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.232884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.232955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.233023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.233100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.233150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.233161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.233241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.233300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.233367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.233436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.233484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.233491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.233569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.233647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.233725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.233804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.233856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.233864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.233949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.234026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.234109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.234187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.234247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.234254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.234335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.234415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.234492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.234570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.234629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.234637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.234717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.234795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.234878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.234957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.235012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.235023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.235107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.235185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.235266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.235346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.235404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.235413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.235489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.235560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.235629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.235699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.235753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.235760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.235835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.235902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.235966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.236040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.236092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.236100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.236394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534456612442498:8815]
2025-10-02T08:13:02.236437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:02.236444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:02.236474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1620 reason: error at write: Disconnected sessionId: src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0
2025-10-02T08:13:02.236659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1620 sessionId: src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0 is DEAD
2025-10-02T08:13:02.236705Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:02.236726Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:02.236816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:02.236829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0] Write session will restart in 0.007566s
2025-10-02T08:13:02.236854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0] Write session: Do CDS request
2025-10-02T08:13:02.236861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:02.249257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:02.249446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:02.249461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1621
2025-10-02T08:13:02.249575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:02.249605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:02.249615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:02.249618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:02.250055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1621 sessionId:  describe result for acl check
2025-10-02T08:13:02.250087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:02.250088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:02.250089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:02.250095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534460907410146:8484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:02.250636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534460907410146:8484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:02.255858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:02.257866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:02.258010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534460907410146:8484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:02.258088Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:02.258092Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:02.258103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:02.258155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:02.258190Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534460907410276:8485]
2025-10-02T08:13:02.258808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:02.259272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:02.259317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:02.259655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:02.259701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.259702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.259703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.259704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.259705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.259711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.259720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.259724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.259728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.259732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.259738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.259745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.259751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.259756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.259760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.259766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.259771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.259776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.259781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.259786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.259807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:02.269198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534460907410146:8484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:02.269215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534460907410146:8484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:02.269218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534460907410146:8484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:02.269228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:02.270864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:02.272777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:02.272790Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:02.272792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:02.272796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:02.272818Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1620 [1:7556534460907410276:8485]
2025-10-02T08:13:02.272830Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:02.272847Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:02.272849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.272852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.272854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.272871Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:02.272876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:02.272883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:02.272945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.272955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.272959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:02.272961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:02.273026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:02.273036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.273049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.273061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:02.273080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534460907410302:8484], now have 1 active actors on pipe
2025-10-02T08:13:02.273083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534461367196920:2378], now have 1 active actors on pipe
2025-10-02T08:13:02.273089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534460907410270:8485]
2025-10-02T08:13:02.273092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534460907410270:8485]
2025-10-02T08:13:02.273098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:02.273105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1620
2025-10-02T08:13:02.273112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:02.273234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1620
2025-10-02T08:13:02.273125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:02.273134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:02.273143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:02.273146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:02.273170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.273174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.273187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534460907410270:8485]
2025-10-02T08:13:02.273194Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:02.273217Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:02.273224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.273228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.273230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:02.273240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.273248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:02.273270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:02.273273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:02.273317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.273320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.273332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:02.273366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1621 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0
2025-10-02T08:13:02.273755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dd52620-ea4bd07c-b0f89b95-9eac7bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:02.276903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0] Write session: try to update token
2025-10-02T08:13:02.276922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:02.301495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId: src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:02.304360Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:02.304381Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:02.304385Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:02.304394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534460907410270:8485]
2025-10-02T08:13:02.304399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534460907410270:8485]
2025-10-02T08:13:02.304449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:02.304456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.304459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:02.304625Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:02.304683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:02.305961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:02.305968Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:02.336349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534460907410323:8815]
2025-10-02T08:13:02.336543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1620, pipe: [1:7556534460907410323:8815]
2025-10-02T08:13:02.466463Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:02.466940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.466948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.466987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534460907410323:8815], now have 1 active actors on pipe
2025-10-02T08:13:02.467458Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:02.467769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534460907410323:8815]
2025-10-02T08:13:02.467785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:02.467836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1621 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0
2025-10-02T08:13:02.468007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1621 sessionId: src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0 is DEAD
2025-10-02T08:13:02.468960Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:02.472898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:02.472910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0] Write session will restart in 0.007282s
2025-10-02T08:13:02.472937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0] Write session: Do CDS request
2025-10-02T08:13:02.472943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:02.485234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:02.485337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:02.485353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1622
2025-10-02T08:13:02.485478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:02.485503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:02.485507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:02.485510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:02.485976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1622 sessionId:  describe result for acl check
2025-10-02T08:13:02.486011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:02.486018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:02.486019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:02.486024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534460907410627:8447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:02.486633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534460907410627:8447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:02.489396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534460907410627:8447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:02.494176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534460907410627:8447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:02.494194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534460907410627:8447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:02.494197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534460907410627:8447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:02.494205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:02.495924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:02.498897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:02.499286Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:02.499290Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:02.499303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:02.499373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:02.499407Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534460907410835:8451]
2025-10-02T08:13:02.500054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:02.500705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:02.500765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:02.501121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:02.501193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.501195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.501196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.501197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.501198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.501204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.501215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.501219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.501223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.501244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.501250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.501258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.501265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.501271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.501275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.501283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.501288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.501293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.501298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.501304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.501323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:02.511618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:02.513330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:02.513354Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:02.513358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:02.513362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:02.513371Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1621 [1:7556534460907410835:8451]
2025-10-02T08:13:02.513385Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:02.513405Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:02.513409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.513412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.513414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.513433Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:02.513438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:02.513446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:02.513524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.513534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.513538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:02.513540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:02.513683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1621
2025-10-02T08:13:02.513781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1621
2025-10-02T08:13:02.514275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:02.514285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.514301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.514316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:02.514337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534460907410822:8447], now have 1 active actors on pipe
2025-10-02T08:13:02.514346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534461367196941:2378], now have 1 active actors on pipe
2025-10-02T08:13:02.514351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.514356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.514381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534460907410828:8451]
2025-10-02T08:13:02.514388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534460907410828:8451]
2025-10-02T08:13:02.514401Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:02.514415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:02.514420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:02.514423Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:02.514433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:02.514438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:02.514454Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:02.514466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.514470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.514472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:02.514483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.514498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:02.514540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534460907410828:8451]
2025-10-02T08:13:02.514552Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:02.514561Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:02.514567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:02.514671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.514680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.514696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:02.514729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1622 partition: 0 MaxSeqNo: 17 sessionId: src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0
2025-10-02T08:13:02.515127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8a92ad-38125f20-b2d657d-14ddbb38_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:02.518346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0] Write session: try to update token
2025-10-02T08:13:02.518367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:02.526164Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:02.526184Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:02.526193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534460907410828:8451]
2025-10-02T08:13:02.526239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:02.526432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:02.526504Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:02.526587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:02.526743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:02.526890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:02.527094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:02.527130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:02.540374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId: src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:02.543224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:02.543364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.543379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.543415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:02.543441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:02.543502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.543508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.543691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.543772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.543852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.543913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.543973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.543983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.544066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.544133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.544205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.544273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.544341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.544346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.544419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.544475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.544534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.544597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.544642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.544645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.544718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.544788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.544884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.544969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.545022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.545035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.545127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.545199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.545276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.545357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.545411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.545420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.545499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.545570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.545641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.545716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.545764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.545766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.545844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.545912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.545990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.546071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.546122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.546125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.546213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.546282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.546361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.546434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.546482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.546486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.546563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.546627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.546696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.546773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.546825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.546830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.546920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:02.546986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:02.547051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:02.547123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:02.547172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:02.547175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:02.547241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:02.547304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.547321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.547323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:02.547358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:02.547371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:02.547374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:02.547378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:02.547381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:02.547803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:02.547822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:02.547828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:02.547831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:02.547835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:02.547838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:02.548590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:02.548606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:02.548612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:02.548616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:02.548620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:02.548623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:02.551504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:02.551538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:02.551547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:02.551552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:02.551555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:02.552933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:02.552954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:02.552968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392782552
2025-10-02T08:13:02.553284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:02.553302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:02.553312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:02.553316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:02.553320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:02.553333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:02.553874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:02.553901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:02.553908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:02.553912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:02.553915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:02.553919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:02.554371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:02.554395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:02.554403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:02.554406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:02.554412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:02.554415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:02.554928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:02.554954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:02.554960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:02.556201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:02.556210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:02.556216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:02.556221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:02.556234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392782555
2025-10-02T08:13:02.556583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:02.556597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:02.556605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:02.556608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:02.556612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:02.556615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:02.557255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:02.557287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:02.557293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:02.557297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:02.557300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:02.557306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:02.557826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:02.557866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.557981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392782557
2025-10-02T08:13:02.560597Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:02.560627Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:02.560635Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:02.560644Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:02.560654Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:02.560656Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:02.560658Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:02.560666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534460907410828:8451]
2025-10-02T08:13:02.560671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534460907410828:8451]
2025-10-02T08:13:02.560756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:02.560761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.560763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:02.560817Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:02.560825Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:02.561020Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:02.567466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534460907410878:8815]
2025-10-02T08:13:02.567960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1621, pipe: [1:7556534460907410878:8815]
2025-10-02T08:13:02.712624Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:02.713151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534460907410878:8815], now have 1 active actors on pipe
2025-10-02T08:13:02.715498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:02.715510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0] Write session will restart in 0.008385s
2025-10-02T08:13:02.715534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0] Write session: Do CDS request
2025-10-02T08:13:02.715541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:02.715133Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:02.715148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:02.715151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:02.715186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1622 reason: error at write: Disconnected sessionId: src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0
2025-10-02T08:13:02.715381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1622 sessionId: src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0 is DEAD
2025-10-02T08:13:02.715505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534460907410878:8815]
2025-10-02T08:13:02.714039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:02.721614Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [97e5368090eff62c] Result# TEvPutResult {Id# [72075186224037892:1621:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:02.721727Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1621:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:02.721857Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [15a5ea575feb6168] Result# TEvPutResult {Id# [72075186224037892:1621:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:02.721947Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1621:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:02.729275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:02.730329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:02.730348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1623
2025-10-02T08:13:02.735744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:02.735808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:02.735814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:02.735819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:02.736477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1623 sessionId:  describe result for acl check
2025-10-02T08:13:02.736503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:02.736505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:02.736506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:02.736510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534460907411184:8422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:02.737115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534460907411184:8422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:02.743181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534460907411184:8422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:02.745325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:02.747590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:02.747798Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:02.747802Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:02.747811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:02.747859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:02.747895Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534460907411377:8431]
2025-10-02T08:13:02.748537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:02.748840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:02.748885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:02.749175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:02.749215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.749216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.749217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.749218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.749220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.749225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.749236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.749239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.749243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.749247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.749253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.749260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.749265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.749270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.749274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.749279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.749283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.749288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.749293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.749297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.749318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:02.751234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534460907411184:8422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:02.751252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534460907411184:8422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:02.751256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534460907411184:8422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:02.751264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:02.759609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:02.761322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:02.761341Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:02.761345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:02.761350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:02.761358Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1622 [1:7556534460907411377:8431]
2025-10-02T08:13:02.761373Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:02.761392Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:02.761396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.761399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.761401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.761418Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:02.761423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:02.761430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:02.761498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.761501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.761504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:02.761506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:02.761572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:02.761575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.761589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.761599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:02.761613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534460907411371:8431]
2025-10-02T08:13:02.761615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534460907411371:8431]
2025-10-02T08:13:02.761632Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:02.761644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:02.761657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:02.761660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:02.761694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534460907411371:8431]
2025-10-02T08:13:02.761694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:02.761697Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:02.761698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:02.761708Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:02.761822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1622
2025-10-02T08:13:02.761844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534460907411394:8422], now have 1 active actors on pipe
2025-10-02T08:13:02.761850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534461367196972:2378], now have 1 active actors on pipe
2025-10-02T08:13:02.761857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.761862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.761890Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:02.761898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.761902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.761905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:02.761917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.761939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:02.761955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:02.762013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.762020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.762033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:02.762035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1622
2025-10-02T08:13:02.762071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1623 partition: 0 MaxSeqNo: 17 sessionId: src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0
2025-10-02T08:13:02.762427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56679c-d9cc60-6e1dd9df-e3c46c9b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:02.765283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0] Write session: try to update token
2025-10-02T08:13:02.765301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:02.783134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId: src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:02.786460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:02.786794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.786814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.786837Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:02.786840Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:02.786843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:02.786850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534460907411371:8431]
2025-10-02T08:13:02.786853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534460907411371:8431]
2025-10-02T08:13:02.786903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:02.786902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:02.786908Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:02.786911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.786913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:02.787052Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:02.815271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534460907411408:8815]
2025-10-02T08:13:02.815725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1622, pipe: [1:7556534460907411408:8815]
2025-10-02T08:13:02.938257Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:02.938789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:02.938834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534460907411408:8815], now have 1 active actors on pipe
2025-10-02T08:13:02.938874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:02.939838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:02.939896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:02.939907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0] Write session will restart in 0.008083s
2025-10-02T08:13:02.939939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0] Write session: Do CDS request
2025-10-02T08:13:02.939945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:02.939548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534460907411408:8815]
2025-10-02T08:13:02.939570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:02.939572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:02.939591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1623 reason: error at write: Disconnected sessionId: src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0
2025-10-02T08:13:02.939753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1623 sessionId: src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0 is DEAD
2025-10-02T08:13:02.949311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:02.949343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:02.949356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1624
2025-10-02T08:13:02.953388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:02.953442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:02.953448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:02.953452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:02.953934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1624 sessionId:  describe result for acl check
2025-10-02T08:13:02.953969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:02.953971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:02.953973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:02.953979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534460907411429:8412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:02.954469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534460907411429:8412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:02.959116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534460907411429:8412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:02.964138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534460907411429:8412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:02.964156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534460907411429:8412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:02.964172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534460907411429:8412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:02.964182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:02.975311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:02.977276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:02.977494Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:02.977497Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:02.977508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:02.977562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:02.977754Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534460907411901:8410]
2025-10-02T08:13:02.978421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:02.978647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:02.978691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:02.979011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:02.979054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.979060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.979061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.979062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.979063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.979067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.979077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.979081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.979085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.979088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.979095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.979105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:02.979111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.979117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:02.979121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.979126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:02.979131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.979136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.979140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.979146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.979170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:02.989795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:02.991408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:02.991429Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:02.991432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:02.991436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:02.991444Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1623 [1:7556534460907411901:8410]
2025-10-02T08:13:02.991462Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:02.991483Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:02.991487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.991490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.991493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.991511Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:02.991521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:02.991530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:02.991595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.991602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.991605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:02.991607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:02.991676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:02.991683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:02.991696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:02.991711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:02.991731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534460907411895:8410]
2025-10-02T08:13:02.991737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534460907411895:8410]
2025-10-02T08:13:02.991746Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:02.991759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:02.991778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1623
2025-10-02T08:13:02.991782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:02.991785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:02.991791Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:02.991795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534460907411663:8412], now have 1 active actors on pipe
2025-10-02T08:13:02.991801Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:02.991826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534460907411895:8410]
2025-10-02T08:13:02.991829Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:02.991834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534461367196978:2378], now have 1 active actors on pipe
2025-10-02T08:13:02.991838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.991842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.991886Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|672b6a2-75004209-9586d936-2d4ae7a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:02.991891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:02.991896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:02.991898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:02.991907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:02.991916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:02.991932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:02.992056Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:02.992957Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1623
2025-10-02T08:13:02.993246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d47584-c25c683d-4d2dee88-e4fc2b4a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|672b6a2-75004209-9586d936-2d4ae7a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:02.992713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:02.992730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:02.992755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:02.992794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1624 partition: 0 MaxSeqNo: 17 sessionId: src_id|672b6a2-75004209-9586d936-2d4ae7a3_0
2025-10-02T08:13:02.996197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|672b6a2-75004209-9586d936-2d4ae7a3_0] Write session: try to update token
2025-10-02T08:13:02.996214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|672b6a2-75004209-9586d936-2d4ae7a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:03.015590Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:03.015615Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:03.015619Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:03.015630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534460907411895:8410]
2025-10-02T08:13:03.015635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534460907411895:8410]
2025-10-02T08:13:03.015687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:03.015697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.015696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:03.015702Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:03.015705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:03.015871Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:03.019667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId: src_id|672b6a2-75004209-9586d936-2d4ae7a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:03.022951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:03.036280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534465202379223:8815]
2025-10-02T08:13:03.036422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1623, pipe: [1:7556534465202379223:8815]
2025-10-02T08:13:03.170852Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:03.171395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.171414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.171459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534465202379223:8815], now have 1 active actors on pipe
2025-10-02T08:13:03.171688Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:03.172112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:03.172200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1624 reason: status is not ok: tablet will be restarted right now sessionId: src_id|672b6a2-75004209-9586d936-2d4ae7a3_0
2025-10-02T08:13:03.172379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1624 sessionId: src_id|672b6a2-75004209-9586d936-2d4ae7a3_0 is DEAD
2025-10-02T08:13:03.172519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534465202379223:8815]
2025-10-02T08:13:03.172479Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:03.172855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|672b6a2-75004209-9586d936-2d4ae7a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:03.172866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|672b6a2-75004209-9586d936-2d4ae7a3_0] Write session will restart in 0.005410s
2025-10-02T08:13:03.172894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|672b6a2-75004209-9586d936-2d4ae7a3_0] Write session: Do CDS request
2025-10-02T08:13:03.172909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|672b6a2-75004209-9586d936-2d4ae7a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:03.179484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|672b6a2-75004209-9586d936-2d4ae7a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:03.179917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:03.179940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1625
2025-10-02T08:13:03.180125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:03.180191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:03.180199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:03.180206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:03.181551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1625 sessionId:  describe result for acl check
2025-10-02T08:13:03.181597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:03.181599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:03.181602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:03.181609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534465202379265:8382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:03.182246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534465202379265:8382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:03.191656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534465202379265:8382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:03.201938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534465202379265:8382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:03.201960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534465202379265:8382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:03.201965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534465202379265:8382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:03.202018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:03.223895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:03.227080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:03.227409Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:03.227433Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:03.227448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:03.227538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:03.227599Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534465202379717:8398]
2025-10-02T08:13:03.228392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:03.228725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:03.228777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:03.229165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:03.229224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.229225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.229226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.229228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.229229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.229236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.229247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.229251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.229255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.229259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.229267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.229275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.229282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.229288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.229294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.229300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.229304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.229309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.229313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.229318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.229339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:03.243869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:03.245579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:03.245612Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:03.245615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:03.245620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:03.245629Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1624 [1:7556534465202379717:8398]
2025-10-02T08:13:03.245643Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:03.245662Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:03.245672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:03.245676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:03.245678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:03.245704Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:03.245710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:03.245718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:03.245790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.245801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.245805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:03.245808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:03.246504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1624
2025-10-02T08:13:03.245889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:03.245898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.245913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.245926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:03.245943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534465202379711:8398]
2025-10-02T08:13:03.245945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534465202379711:8398]
2025-10-02T08:13:03.245954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:03.245966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:03.245980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:03.245983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:03.246017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:03.246019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1624
2025-10-02T08:13:03.246024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:03.246027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534465202379546:8382], now have 1 active actors on pipe
2025-10-02T08:13:03.246031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534465202379711:8398]
2025-10-02T08:13:03.246035Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:03.246047Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:03.246054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534465662164285:2378], now have 1 active actors on pipe
2025-10-02T08:13:03.246058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.246063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.246252Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:03.246259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:03.246262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:03.246265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:03.246276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:03.246286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:03.246319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:03.246582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.246585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.246603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:03.246643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1625 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0
2025-10-02T08:13:03.248922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|672b6a2-75004209-9586d936-2d4ae7a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:03.251832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0] Write session: try to update token
2025-10-02T08:13:03.251854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:03.269054Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:03.269072Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:03.269075Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:03.269084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534465202379711:8398]
2025-10-02T08:13:03.269088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534465202379711:8398]
2025-10-02T08:13:03.269122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:03.269127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.269129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:03.269263Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:03.270254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:03.270262Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:03.276346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534465202379741:8815]
2025-10-02T08:13:03.277606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1624, pipe: [1:7556534465202379741:8815]
2025-10-02T08:13:03.278349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId: src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:03.280999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:03.431262Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:03.431848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534465202379741:8815], now have 1 active actors on pipe
2025-10-02T08:13:03.431883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.431894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.432027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:03.432035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:03.432084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1625 reason: error at write: Disconnected sessionId: src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0
2025-10-02T08:13:03.432155Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:03.432303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1625 sessionId: src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0 is DEAD
2025-10-02T08:13:03.432478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534465202379741:8815]
2025-10-02T08:13:03.432493Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:03.432888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:03.432900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0] Write session will restart in 0.005981s
2025-10-02T08:13:03.432926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0] Write session: Do CDS request
2025-10-02T08:13:03.432933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:03.442685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:03.443045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:03.443062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1626
2025-10-02T08:13:03.443206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:03.443239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:03.443251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:03.443255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:03.443791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1626 sessionId:  describe result for acl check
2025-10-02T08:13:03.443826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:03.443833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:03.443834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:03.443839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534465202380156:8381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:03.444560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534465202380156:8381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:03.450208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:03.450709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534465202380156:8381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:03.451897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:03.452079Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:03.452087Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:03.452094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:03.452130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:03.452156Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534465202380244:8385]
2025-10-02T08:13:03.452679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:03.452886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:03.452918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:03.453155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:03.453193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.453201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.453202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.453202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.453203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.453207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.453214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.453216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.453219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.453221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.453225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.453230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.453234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.453237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.453240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.453243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.453245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.453248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.453251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.453256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.453274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:03.454148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534465202380156:8381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:03.454160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534465202380156:8381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:03.454163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534465202380156:8381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:03.454172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:03.462047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:03.463664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:03.463683Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:03.463687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:03.463691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:03.463698Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1625 [1:7556534465202380244:8385]
2025-10-02T08:13:03.463712Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:03.463730Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:03.463733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:03.463736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:03.463739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:03.463757Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:03.463762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:03.463768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:03.463836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.463844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.463847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:03.463850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:03.463916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:03.463923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.463937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.463948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:03.463973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534465202380260:8381], now have 1 active actors on pipe
2025-10-02T08:13:03.463984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534465202380228:8385]
2025-10-02T08:13:03.463986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534465202380228:8385]
2025-10-02T08:13:03.463994Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:03.463996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1625
2025-10-02T08:13:03.464002Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:03.464003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534465662164304:2378], now have 1 active actors on pipe
2025-10-02T08:13:03.464005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:03.464011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:03.464024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:03.464026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:03.464036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.464040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.464082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534465202380228:8385]
2025-10-02T08:13:03.464094Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:03.464100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:03.464109Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:03.464116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:03.464120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:03.464122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:03.464135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:03.464144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:03.464186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:03.464274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.464281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.464293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:03.464331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1626 partition: 0 MaxSeqNo: 17 sessionId: src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0
2025-10-02T08:13:03.464680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7bd89f-c080e0eb-b62e99b5-8976bfec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:03.464884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1625
2025-10-02T08:13:03.467282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0] Write session: try to update token
2025-10-02T08:13:03.467297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:03.476008Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:03.476031Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:03.476042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534465202380228:8385]
2025-10-02T08:13:03.476089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:03.476092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:03.476295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:03.476463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:03.476622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:03.476783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:03.477027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:03.477078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:03.494570Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:03.494597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:03.494600Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:03.494612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534465202380228:8385]
2025-10-02T08:13:03.494616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534465202380228:8385]
2025-10-02T08:13:03.494662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:03.494668Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:03.494670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.494673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:03.494674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:03.494838Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:03.495237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId: src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:03.498057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:03.567366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534465202380289:8815]
2025-10-02T08:13:03.571377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1625, pipe: [1:7556534465202380289:8815]
2025-10-02T08:13:03.644523Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:03.644827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.644840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.644860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534465202380289:8815], now have 1 active actors on pipe
2025-10-02T08:13:03.644966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534465202380289:8815]
2025-10-02T08:13:03.644993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:03.644995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:03.645099Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:03.645220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1626 reason: error at write: Disconnected sessionId: src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0
2025-10-02T08:13:03.645390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1626 sessionId: src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0 is DEAD
2025-10-02T08:13:03.645356Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:03.648938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:03.648958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0] Write session will restart in 0.008812s
2025-10-02T08:13:03.648987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0] Write session: Do CDS request
2025-10-02T08:13:03.648995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:03.661434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:03.662726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:03.662741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1627
2025-10-02T08:13:03.662936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:03.662968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:03.662973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:03.662977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:03.663452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1627 sessionId:  describe result for acl check
2025-10-02T08:13:03.663491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:03.663493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:03.663494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:03.663500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534465202380593:8349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:03.664055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534465202380593:8349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:03.672567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534465202380593:8349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:03.682101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534465202380593:8349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:03.682123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534465202380593:8349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:03.682127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534465202380593:8349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:03.682136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:03.687258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:03.692857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:03.693102Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:03.693107Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:03.693117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:03.693177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:03.693216Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534465202380815:8350]
2025-10-02T08:13:03.693902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:03.694194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:03.694240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:03.694589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:03.694636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.694638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.694639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.694640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.694641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.694646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.694656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.694661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.694664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.694668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.694674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.694682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.694689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.694694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.694699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.694705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.694709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.694714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.694720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.694725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.694746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:03.715793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:03.717696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:03.717712Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:03.717715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:03.717718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:03.717725Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1626 [1:7556534465202380815:8350]
2025-10-02T08:13:03.717741Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:03.717759Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:03.717763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:03.717766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:03.717768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:03.717783Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:03.717789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:03.717795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:03.717865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.717867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.717870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:03.717873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:03.717942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:03.717944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.717959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.717972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:03.717989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534465202380809:8350]
2025-10-02T08:13:03.717991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534465202380809:8350]
2025-10-02T08:13:03.718003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:03.718018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:03.718033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:03.718036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:03.718075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534465202380809:8350]
2025-10-02T08:13:03.718078Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:03.718515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:03.718519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:03.718539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:03.718690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1626
2025-10-02T08:13:03.718717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534465202380720:8349], now have 1 active actors on pipe
2025-10-02T08:13:03.718788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.718803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.718824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534465662164332:2378], now have 1 active actors on pipe
2025-10-02T08:13:03.718847Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:03.718862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:03.718872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:03.718874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:03.718890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:03.718907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:03.718930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:03.718970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.718976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.718989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:03.719019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1627 partition: 0 MaxSeqNo: 17 sessionId: src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0
2025-10-02T08:13:03.719531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee325df-e9dfbff8-15389037-e4f13c66_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:03.719515Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1626
2025-10-02T08:13:03.723672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0] Write session: try to update token
2025-10-02T08:13:03.723910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:03.744854Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:03.744868Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:03.744871Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:03.744880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534465202380809:8350]
2025-10-02T08:13:03.744884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534465202380809:8350]
2025-10-02T08:13:03.744924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:03.744928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:03.744930Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:03.744935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.744937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:03.745083Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:03.745847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534465202380842:8815]
2025-10-02T08:13:03.746098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1626, pipe: [1:7556534465202380842:8815]
2025-10-02T08:13:03.747012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId: src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:03.750028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:03.901330Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:03.901768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534465202380842:8815], now have 1 active actors on pipe
2025-10-02T08:13:03.901786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.901794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.902511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:03.902558Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:03.902637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534465202380842:8815]
2025-10-02T08:13:03.902661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:03.902724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1627 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0
2025-10-02T08:13:03.902919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1627 sessionId: src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0 is DEAD
2025-10-02T08:13:03.903194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:03.903205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0] Write session will restart in 0.007966s
2025-10-02T08:13:03.903226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0] Write session: Do CDS request
2025-10-02T08:13:03.903231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:03.912509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:03.912602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:03.912620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1628
2025-10-02T08:13:03.912823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:03.912874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:03.912879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:03.912884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:03.914038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1628 sessionId:  describe result for acl check
2025-10-02T08:13:03.914075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:03.914076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:03.914078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:03.914083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534465202381084:8340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:03.914622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534465202381084:8340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:03.923104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534465202381084:8340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:03.926882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534465202381084:8340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:03.926898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534465202381084:8340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:03.926901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534465202381084:8340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:03.926909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:03.938392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:03.939894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:03.940082Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:03.940091Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:03.940100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:03.940144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:03.940189Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534465202381342:8345]
2025-10-02T08:13:03.940905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:03.941125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:03.941167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:03.941508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:03.941549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.941555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.941556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.941557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.941558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.941563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.941573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.941577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.941581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.941584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.941590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.941597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:03.941607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.941612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:03.941619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.941629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:03.941633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.941641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.941648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.941657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.941676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:03.950144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:03.951914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:03.951932Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:03.951934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:03.951938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:03.951945Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1627 [1:7556534465202381342:8345]
2025-10-02T08:13:03.951958Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:03.951977Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:03.951981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:03.951983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:03.951985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:03.952002Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:03.952007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:03.952014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:03.952082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.952091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.952094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:03.952097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:03.952159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:03.952180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.952193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:03.952207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:03.952226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534465202381224:8340], now have 1 active actors on pipe
2025-10-02T08:13:03.952236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534465202381336:8345]
2025-10-02T08:13:03.952238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534465202381336:8345]
2025-10-02T08:13:03.952245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1627
2025-10-02T08:13:03.952245Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:03.952254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534465662164341:2378], now have 1 active actors on pipe
2025-10-02T08:13:03.952256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:03.952260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:03.952262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:03.952274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:03.952277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:03.952284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.952294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.952340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534465202381336:8345]
2025-10-02T08:13:03.952351Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:03.952366Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:03.952369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:03.952376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:03.952380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:03.952385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:03.952394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:03.952407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:03.952744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:03.952858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:03.952867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:03.952882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:03.952918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1628 partition: 0 MaxSeqNo: 17 sessionId: src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0
2025-10-02T08:13:03.955959Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1627
2025-10-02T08:13:03.957148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c399f30c-44e2be8f-f5a84662-1b5dc8c1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:03.960417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0] Write session: try to update token
2025-10-02T08:13:03.960446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:03.974414Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:03.974433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:03.974436Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:03.974445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534465202381336:8345]
2025-10-02T08:13:03.974450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534465202381336:8345]
2025-10-02T08:13:03.974492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:03.974499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:03.974501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:03.974649Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:03.975794Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:03.975804Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:03.987494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId: src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:03.990650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:04.002966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534469497348664:8815]
2025-10-02T08:13:04.003127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1627, pipe: [1:7556534469497348664:8815]
2025-10-02T08:13:04.119481Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:04.119857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.119863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.119878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497348664:8815], now have 1 active actors on pipe
2025-10-02T08:13:04.120256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:04.120024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:04.120033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:04.120064Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:04.120098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1628 reason: error at write: Disconnected sessionId: src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0
2025-10-02T08:13:04.120262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1628 sessionId: src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0 is DEAD
2025-10-02T08:13:04.120292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534469497348664:8815]
2025-10-02T08:13:04.121635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:04.121651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0] Write session will restart in 0.009189s
2025-10-02T08:13:04.121684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0] Write session: Do CDS request
2025-10-02T08:13:04.121692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:04.132517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:04.132640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:04.132659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1629
2025-10-02T08:13:04.132873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:04.132921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:04.132926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:04.132929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:04.133360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1629 sessionId:  describe result for acl check
2025-10-02T08:13:04.133390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:04.133392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:04.133394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:04.133399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534469497349012:8332] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:04.133941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534469497349012:8332] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:04.136351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534469497349012:8332] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:04.139027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:04.140420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:04.140615Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:04.140625Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:04.140635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:04.140697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:04.140732Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534469497349159:8335]
2025-10-02T08:13:04.140850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534469497349012:8332] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:04.140863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534469497349012:8332] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:04.140866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534469497349012:8332] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:04.140875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:04.141382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:04.141553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:04.141589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:04.141886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:04.141926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.141932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.141933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.141934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.141935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.141940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.141949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.141953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.141957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.141961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.141966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.141978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.141983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.141987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.141991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.141995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.141999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.142004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.142009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.142014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.142032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:04.151280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:04.153265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:04.153283Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:04.153286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:04.153289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:04.153295Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1628 [1:7556534469497349159:8335]
2025-10-02T08:13:04.153308Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:04.153327Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:04.153330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.153333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.153335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.153352Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:04.153358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:04.153364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:04.153429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.153440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.153443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:04.153446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:04.153515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:04.153521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.153535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.153552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:04.153579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497349164:8332], now have 1 active actors on pipe
2025-10-02T08:13:04.153580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1628
2025-10-02T08:13:04.153591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534469497349153:8335]
2025-10-02T08:13:04.153599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534469497349153:8335]
2025-10-02T08:13:04.153607Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:04.153624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:04.153644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:04.153651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:04.153657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534469957131646:2378], now have 1 active actors on pipe
2025-10-02T08:13:04.153661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.153665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.153709Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534469497349153:8335]
2025-10-02T08:13:04.153717Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:04.153734Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:04.153745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.153746Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:04.153749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:04.153749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.153751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:04.153754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:04.153759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.153768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:04.153805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:04.154147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.154159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.154136Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1628
2025-10-02T08:13:04.154195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:04.154239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1629 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0
2025-10-02T08:13:04.154679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbeae1e7-cc3f4591-66f8fb3b-90adc713_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:04.157911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0] Write session: try to update token
2025-10-02T08:13:04.158004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:04.180787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId: src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:04.182204Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:04.182219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:04.182221Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:04.182230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534469497349153:8335]
2025-10-02T08:13:04.182235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534469497349153:8335]
2025-10-02T08:13:04.182284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:04.182297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.182299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:04.182457Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:04.183693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:04.183782Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:04.183795Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:04.220028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534469497349191:8815]
2025-10-02T08:13:04.220208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1628, pipe: [1:7556534469497349191:8815]
2025-10-02T08:13:04.336921Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:04.337117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.337129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.337159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497349191:8815], now have 1 active actors on pipe
2025-10-02T08:13:04.337293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534469497349191:8815]
2025-10-02T08:13:04.337324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:04.337333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:04.337391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1629 reason: error at write: Disconnected sessionId: src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0
2025-10-02T08:13:04.337402Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:04.337364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:04.337581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1629 sessionId: src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0 is DEAD
2025-10-02T08:13:04.337807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:04.337819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0] Write session will restart in 0.009844s
2025-10-02T08:13:04.337846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0] Write session: Do CDS request
2025-10-02T08:13:04.337852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:04.349405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:04.349417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:04.349433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1630
2025-10-02T08:13:04.349760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:04.349805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:04.349816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:04.349820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:04.350254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1630 sessionId:  describe result for acl check
2025-10-02T08:13:04.350287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:04.350296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:04.350298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:04.350302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534469497349615:8319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:04.350707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534469497349615:8319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:04.353146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534469497349615:8319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:04.353198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:04.355106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:04.355332Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:04.355348Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:04.355358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:04.355414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:04.355451Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534469497349690:8321]
2025-10-02T08:13:04.356110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:04.356354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:04.356391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:04.356694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:04.356745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.356747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.356748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.356749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.356750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.356755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.356764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.356767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.356770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.356774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.356780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.356787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.356792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.356797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.356822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.356826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.356832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.356837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.356842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.356846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.356863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:04.364953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534469497349615:8319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:04.364976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534469497349615:8319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:04.364980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534469497349615:8319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:04.364990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:04.368157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:04.370300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:04.370322Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:04.370325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:04.370329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:04.370336Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1629 [1:7556534469497349690:8321]
2025-10-02T08:13:04.370349Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:04.370367Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:04.370371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.370373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.370376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.370393Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:04.370398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:04.370405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:04.370472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.370484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.370487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:04.370491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:04.370568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:04.370571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.370741Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1629
2025-10-02T08:13:04.370587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.370600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:04.370619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497349707:8319], now have 1 active actors on pipe
2025-10-02T08:13:04.370627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534469497349674:8321]
2025-10-02T08:13:04.370629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534469497349674:8321]
2025-10-02T08:13:04.370638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:04.370648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:04.370651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:04.370652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:04.370666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:04.370669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:04.370676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534469957131664:2378], now have 1 active actors on pipe
2025-10-02T08:13:04.370713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534469497349674:8321]
2025-10-02T08:13:04.370722Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:04.370770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1629
2025-10-02T08:13:04.370777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:04.370807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.370811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.370844Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:04.370851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.370856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.370858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:04.370870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.370882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:04.370900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:04.371038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.371049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.371065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:04.371105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1630 partition: 0 MaxSeqNo: 17 sessionId: src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0
2025-10-02T08:13:04.371611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b15a663-7c16ef15-e48c83b-33d38e57_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:04.374300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0] Write session: try to update token
2025-10-02T08:13:04.374320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:04.383207Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:04.383235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:04.383245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534469497349674:8321]
2025-10-02T08:13:04.383290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:04.383292Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:04.384190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:04.384341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:04.384474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:04.384604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:04.384780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:04.384851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:04.392507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId: src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:04.395239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:04.395326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.395339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.395368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:04.395393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:04.395439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.395461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.395625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.395709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.395777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.395842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.396000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.396012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.396089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.396149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.396229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.396291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.396334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.396341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.396423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.396512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.396598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.396680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.396762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.396769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.396873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.396947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.397031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.397112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.397167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.397173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.397259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.397340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.397417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.397496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.397552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.397559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.397645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.397729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.397831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.397916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.397971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.397978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.398062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.398140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.398223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.398302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.398357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.398364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.398440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.398504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.398568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.398645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.398700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.398706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.398786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.398855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.398922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.398993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.399047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.399053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.399140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:04.399206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:04.399271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:04.399339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:04.399386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:04.399392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:04.399455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:04.399519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.399542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.399548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:04.399579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:04.399596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:04.399603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:04.399606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:04.399610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:04.400033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:04.400060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:04.400067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:04.400070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:04.400074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:04.400078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:04.400635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:04.400662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:04.400668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:04.400673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:04.400675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:04.400678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:04.401189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:04.401212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:04.401220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:04.401224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:04.401228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:04.403871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:04.403889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:04.403902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392784403
2025-10-02T08:13:04.404045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:04.404059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:04.404065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:04.404068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:04.404072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:04.404078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:04.404554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:04.404580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:04.404588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:04.404594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:04.404597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:04.404602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:04.405168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:04.405195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:04.405206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:04.405210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:04.405214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:04.405217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:04.405787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:04.405817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:04.405824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:04.407170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:04.407193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:04.407198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:04.407203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:04.407212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392784406
2025-10-02T08:13:04.407564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:04.407590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:04.407602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:04.407605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:04.407609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:04.407612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:04.408139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:04.408180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:04.408190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:04.408193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:04.408197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:04.408200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:04.408751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:04.408778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.408899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392784408
2025-10-02T08:13:04.416158Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:04.416210Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:04.416221Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:04.416229Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:04.416243Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:04.416251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:04.416254Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:04.416268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534469497349674:8321]
2025-10-02T08:13:04.416273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534469497349674:8321]
2025-10-02T08:13:04.416317Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:04.416343Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:04.416373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:04.416383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.416385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:04.416565Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:04.437563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534469497349733:8815]
2025-10-02T08:13:04.437723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1629, pipe: [1:7556534469497349733:8815]
2025-10-02T08:13:04.568330Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:04.568765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497349733:8815], now have 1 active actors on pipe
2025-10-02T08:13:04.569133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:04.569143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:04.569172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1630 reason: error at write: Disconnected sessionId: src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0
2025-10-02T08:13:04.569229Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:04.569346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1630 sessionId: src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0 is DEAD
2025-10-02T08:13:04.569347Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:04.569491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534469497349733:8815]
2025-10-02T08:13:04.569686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:04.569695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0] Write session will restart in 0.007443s
2025-10-02T08:13:04.569718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0] Write session: Do CDS request
2025-10-02T08:13:04.569725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:04.579600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:04.580939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:04.580954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1631
2025-10-02T08:13:04.581324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:04.581391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:04.581404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:04.581409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:04.582065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1631 sessionId:  describe result for acl check
2025-10-02T08:13:04.582108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:04.582110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:04.582112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:04.582119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534469497349765:8300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:04.582625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534469497349765:8300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:04.583573Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [c8d0df31bb660d84] Result# TEvPutResult {Id# [72075186224037892:1629:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:04.583611Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1629:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:04.583656Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1629:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:04.586685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534469497349765:8300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:04.590492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534469497349765:8300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:04.590507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534469497349765:8300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:04.590509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534469497349765:8300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:04.590518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:04.595686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:04.596954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:04.597157Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:04.597169Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:04.597179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:04.597225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:04.597260Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534469497350258:8301]
2025-10-02T08:13:04.597929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:04.598113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:04.598153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:04.598465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:04.598513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.598520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.598521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.598523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.598524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.598529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.598539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.598543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.598548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.598552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.598557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.598565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.598571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.598577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.598582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.598588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.598593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.598598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.598603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.598608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.598628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:04.606772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:04.608473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:04.608492Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:04.608495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:04.608499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:04.608506Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1630 [1:7556534469497350258:8301]
2025-10-02T08:13:04.608518Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:04.608534Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:04.608537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.608540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.608541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.608559Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:04.608563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:04.608571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:04.608632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.608641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.608643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:04.608646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:04.608713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:04.608721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.608734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.608753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:04.608776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497350149:8300], now have 1 active actors on pipe
2025-10-02T08:13:04.608784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534469957131671:2378], now have 1 active actors on pipe
2025-10-02T08:13:04.608791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534469497350252:8301]
2025-10-02T08:13:04.608819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534469497350252:8301]
2025-10-02T08:13:04.608839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:04.608862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:04.608867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:04.608871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:04.608881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:04.608884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:04.608920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534469497350252:8301]
2025-10-02T08:13:04.608931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:04.608941Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:04.608898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1630
2025-10-02T08:13:04.609013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1630
2025-10-02T08:13:04.609141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.609149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.609175Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:04.609182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.609190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.609192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:04.609202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.609215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:04.609235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:04.609267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.609273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.609285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:04.609318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1631 partition: 0 MaxSeqNo: 17 sessionId: src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0
2025-10-02T08:13:04.609686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84050e5-fa457740-f84ad9dd-e5a09673_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:04.612395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0] Write session: try to update token
2025-10-02T08:13:04.612410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:04.632251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId: src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:04.633164Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:04.633180Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:04.633183Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:04.633191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534469497350252:8301]
2025-10-02T08:13:04.633194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534469497350252:8301]
2025-10-02T08:13:04.633240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:04.633253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.633255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:04.633276Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:04.633294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:04.633475Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:04.634811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:04.669302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534469497350301:8815]
2025-10-02T08:13:04.669479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1630, pipe: [1:7556534469497350301:8815]
2025-10-02T08:13:04.767552Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:04.768409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.768421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.768452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497350301:8815], now have 1 active actors on pipe
2025-10-02T08:13:04.768532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:04.768539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:04.768578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1631 reason: error at write: Disconnected sessionId: src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0
2025-10-02T08:13:04.768689Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:04.768675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:04.768720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1631 sessionId: src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0 is DEAD
2025-10-02T08:13:04.768877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:04.768888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0] Write session will restart in 0.006901s
2025-10-02T08:13:04.768912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0] Write session: Do CDS request
2025-10-02T08:13:04.768919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:04.768924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534469497350301:8815]
2025-10-02T08:13:04.777400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:04.777489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:04.777505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1632
2025-10-02T08:13:04.777633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:04.777676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:04.777687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:04.777692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:04.778178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1632 sessionId:  describe result for acl check
2025-10-02T08:13:04.778214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:04.778220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:04.778221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:04.778227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534469497350573:8215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:04.778722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534469497350573:8215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:04.782072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534469497350573:8215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:04.786357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534469497350573:8215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:04.786376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534469497350573:8215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:04.786390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534469497350573:8215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:04.786400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:04.788850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:04.789285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:04.789621Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:04.789630Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:04.789638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:04.789680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:04.789716Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534469497350818:8233]
2025-10-02T08:13:04.790345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:04.790535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:04.790567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:04.790778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:04.790812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.790816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.790817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.790818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.790819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.790823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.790830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.790832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.790834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.790836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.790841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.790845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:04.790849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.790852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:04.790856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.790859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:04.790862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.790865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.790867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.790870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.790881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:04.803563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:04.805155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:04.805172Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:04.805175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:04.805178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:04.805184Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1631 [1:7556534469497350818:8233]
2025-10-02T08:13:04.805197Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:04.805221Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:04.805228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.805230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.805233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.805248Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:04.805251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:04.805256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:04.805318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.805324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.805327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:04.805329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:04.805398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:04.805404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.805414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:04.805425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:04.805441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534469497350812:8233]
2025-10-02T08:13:04.805447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534469497350812:8233]
2025-10-02T08:13:04.805456Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:04.805468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1631
2025-10-02T08:13:04.805474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497350799:8215], now have 1 active actors on pipe
2025-10-02T08:13:04.805478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:04.805481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:04.805482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:04.805490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:04.805492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:04.805499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534469957131703:2378], now have 1 active actors on pipe
2025-10-02T08:13:04.805503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.805505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.805549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534469497350812:8233]
2025-10-02T08:13:04.805562Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:04.805573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:04.805576Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74c58730-9d129db1-f20051c3-91dfc64a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:04.805580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:04.805583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:04.805585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:04.805591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:04.805600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1631
2025-10-02T08:13:04.805598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:04.805625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:04.805658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.805664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.805674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:04.805712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1632 partition: 0 MaxSeqNo: 17 sessionId: src_id|74c58730-9d129db1-f20051c3-91dfc64a_0
2025-10-02T08:13:04.806109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eaa6e51-28928b5e-612326cf-8d33762e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74c58730-9d129db1-f20051c3-91dfc64a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:04.809753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c58730-9d129db1-f20051c3-91dfc64a_0] Write session: try to update token
2025-10-02T08:13:04.809784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c58730-9d129db1-f20051c3-91dfc64a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:04.824427Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:04.824446Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:04.824448Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:04.824457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534469497350812:8233]
2025-10-02T08:13:04.824462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534469497350812:8233]
2025-10-02T08:13:04.824510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:04.824513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:04.824519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:04.824519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:04.824521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:04.824679Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:04.842576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId: src_id|74c58730-9d129db1-f20051c3-91dfc64a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:04.845795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:04.870503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534469497350844:8815]
2025-10-02T08:13:04.870877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1631, pipe: [1:7556534469497350844:8815]
2025-10-02T08:13:04.988955Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:04.989362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:04.989370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:04.989392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534469497350844:8815], now have 1 active actors on pipe
2025-10-02T08:13:04.989645Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:04.990004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:04.990062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1632 reason: status is not ok: tablet will be restarted right now sessionId: src_id|74c58730-9d129db1-f20051c3-91dfc64a_0
2025-10-02T08:13:04.990287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:04.990263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1632 sessionId: src_id|74c58730-9d129db1-f20051c3-91dfc64a_0 is DEAD
2025-10-02T08:13:04.990392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534469497350844:8815]
2025-10-02T08:13:04.993857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c58730-9d129db1-f20051c3-91dfc64a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:04.993876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c58730-9d129db1-f20051c3-91dfc64a_0] Write session will restart in 0.009548s
2025-10-02T08:13:04.993919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c58730-9d129db1-f20051c3-91dfc64a_0] Write session: Do CDS request
2025-10-02T08:13:04.993927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c58730-9d129db1-f20051c3-91dfc64a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:05.004439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c58730-9d129db1-f20051c3-91dfc64a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.004844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:05.004858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1633
2025-10-02T08:13:05.005082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.005120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:05.005126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:05.005130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:05.005630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1633 sessionId:  describe result for acl check
2025-10-02T08:13:05.005666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:05.005672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:05.005674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:05.005680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534473792318407:8211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:05.006194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534473792318407:8211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:05.009626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534473792318407:8211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:05.016467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534473792318407:8211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:05.016482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534473792318407:8211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:05.016486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534473792318407:8211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:05.016503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:05.022893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:05.024391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:05.024748Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:05.024758Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:05.024767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:05.024833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:05.024867Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534473792318651:8205]
2025-10-02T08:13:05.025602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:05.025894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:05.025959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:05.026335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:05.026433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.026440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.026441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.026443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.026444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.026451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.026460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.026464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.026467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.026471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.026478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.026486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.026493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.026499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.026504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.026518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.026522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.026527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.026538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.026544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.026568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:05.037711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:05.039725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:05.039751Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:05.039755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:05.039759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:05.039766Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1632 [1:7556534473792318651:8205]
2025-10-02T08:13:05.039781Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:05.039808Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:05.039812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.039815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.039817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.039836Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:05.039842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:05.039850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:05.039930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.039939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.039942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:05.039945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:05.040017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:05.040026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.040044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.040057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:05.040076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534473792318643:8205]
2025-10-02T08:13:05.040078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534473792318643:8205]
2025-10-02T08:13:05.040089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:05.040099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:05.040102Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:05.040106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792318534:8211], now have 1 active actors on pipe
2025-10-02T08:13:05.040108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1632
2025-10-02T08:13:05.040115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:05.040130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:05.040134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:05.040141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534469957131709:2378], now have 1 active actors on pipe
2025-10-02T08:13:05.040188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.040193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.040207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534473792318643:8205]
2025-10-02T08:13:05.040219Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:05.040220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:05.040249Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:05.040262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.040266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.040268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:05.040279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.040292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:05.040323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.040466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.040475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.040493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.040526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1633 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0
2025-10-02T08:13:05.040773Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1632
2025-10-02T08:13:05.041184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c58730-9d129db1-f20051c3-91dfc64a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:05.044541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0] Write session: try to update token
2025-10-02T08:13:05.044564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:05.063531Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:05.063548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:05.063550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:05.063559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534473792318643:8205]
2025-10-02T08:13:05.063563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534473792318643:8205]
2025-10-02T08:13:05.063603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:05.063609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.063611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:05.063762Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:05.063762Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:05.063768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:05.080060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId: src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:05.083756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:05.091366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534473792318675:8815]
2025-10-02T08:13:05.091776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1632, pipe: [1:7556534473792318675:8815]
2025-10-02T08:13:05.214375Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:05.214784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.214791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.214813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792318675:8815], now have 1 active actors on pipe
2025-10-02T08:13:05.215489Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:05.215861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534473792318675:8815]
2025-10-02T08:13:05.215877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:05.215935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1633 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0
2025-10-02T08:13:05.216124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1633 sessionId: src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0 is DEAD
2025-10-02T08:13:05.216592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:05.216600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0] Write session will restart in 0.009774s
2025-10-02T08:13:05.216627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0] Write session: Do CDS request
2025-10-02T08:13:05.216637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:05.216798Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:05.227374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.227898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:05.227909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1634
2025-10-02T08:13:05.228057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.228098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:05.228103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:05.228107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:05.228538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1634 sessionId:  describe result for acl check
2025-10-02T08:13:05.228563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:05.228565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:05.228566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:05.228572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534473792318948:8192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:05.229345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534473792318948:8192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:05.233411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534473792318948:8192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:05.249472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:05.249536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534473792318948:8192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:05.249557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534473792318948:8192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:05.249561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534473792318948:8192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:05.249569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:05.250266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:05.250448Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:05.250452Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:05.250477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:05.250525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:05.250561Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534473792319185:8196]
2025-10-02T08:13:05.251190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:05.251547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:05.251592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:05.251902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:05.251939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.251940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.251941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.251942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.251944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.251949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.251959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.251964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.251967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.251971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.251976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.251984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.251989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.251994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.251998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.252003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.252007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.252011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.252017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.252022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.252040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:05.260954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:05.262631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:05.262636Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:05.262638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:05.262641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:05.262646Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1633 [1:7556534473792319185:8196]
2025-10-02T08:13:05.262655Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:05.262668Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:05.262670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.262673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.262675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.262687Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:05.262690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:05.262695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:05.262744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.262745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.262748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:05.262749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:05.262815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:05.262818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.262831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.262842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:05.262857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534473792319174:8196]
2025-10-02T08:13:05.262858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534473792319174:8196]
2025-10-02T08:13:05.262865Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:05.262878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792319181:8192], now have 1 active actors on pipe
2025-10-02T08:13:05.262881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:05.262885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:05.262887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:05.262898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:05.262901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:05.262935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534474252099013:2378], now have 1 active actors on pipe
2025-10-02T08:13:05.262937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534473792319174:8196]
2025-10-02T08:13:05.262940Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:05.262979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1633
2025-10-02T08:13:05.263066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:05.263505Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1633
2025-10-02T08:13:05.263214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.263223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.263247Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:05.263254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.263258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.263259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:05.263270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.263280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:05.263294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.263325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.263328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.263339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.263367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1634 partition: 0 MaxSeqNo: 17 sessionId: src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0
2025-10-02T08:13:05.263677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c412178-e0d9a075-5f1a83b5-887cb823_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:05.266416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0] Write session: try to update token
2025-10-02T08:13:05.266431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:05.289398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId: src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:05.292436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:05.292528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.292537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.294515Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:05.294530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:05.294533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:05.294542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534473792319174:8196]
2025-10-02T08:13:05.294547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534473792319174:8196]
2025-10-02T08:13:05.294594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:05.294612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:05.294619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.294622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:05.294790Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:05.296133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:05.296297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:05.296302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:05.318063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534473792319210:8815]
2025-10-02T08:13:05.318251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1633, pipe: [1:7556534473792319210:8815]
2025-10-02T08:13:05.441349Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:05.442087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.442103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.442273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.442347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.442428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.442501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.442553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.442562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.442636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.442708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.442794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.442874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.442940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.442952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.443036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.443104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.443171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.443237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.443282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.443290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.443362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.443429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.443516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.443599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.443657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.443666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.443754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.443834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.443913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.444005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.444062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.444068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.444158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.444239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.444310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.444383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.444449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.444457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.444532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.444597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.444668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.444735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.444784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.444790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.444890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.444972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.445049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.445131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.445190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.445200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.445292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.445362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.445434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.445515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.445578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.445586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.445674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:05.445751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:05.445833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:05.445901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:05.445955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:05.445963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:05.446035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792319210:8815], now have 1 active actors on pipe
2025-10-02T08:13:05.446206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534473792319210:8815]
2025-10-02T08:13:05.446274Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:05.446412Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:05.446439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:05.446441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:05.446472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1634 reason: error at write: Disconnected sessionId: src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0
2025-10-02T08:13:05.446660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1634 sessionId: src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0 is DEAD
2025-10-02T08:13:05.446768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:05.446775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0] Write session will restart in 0.009984s
2025-10-02T08:13:05.446794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0] Write session: Do CDS request
2025-10-02T08:13:05.446798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:05.458347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.458485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:05.458498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1635
2025-10-02T08:13:05.458628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.458652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:05.458657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:05.458660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:05.458942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1635 sessionId:  describe result for acl check
2025-10-02T08:13:05.458964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:05.458968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:05.458970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:05.458973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534473792319685:8174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:05.459324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534473792319685:8174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:05.460425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:05.461631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534473792319685:8174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:05.461788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:05.461970Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:05.461980Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:05.461990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:05.462045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:05.462082Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534473792319725:8187]
2025-10-02T08:13:05.462653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:05.462856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:05.462895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:05.463108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:05.463134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.463138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.463139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.463139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.463140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.463144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.463150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.463152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.463154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.463156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.463159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.463163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.463167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.463170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.463173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.463176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.463178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.463181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.463183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.463186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.463195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:05.467929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534473792319685:8174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:05.467951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534473792319685:8174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:05.467956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534473792319685:8174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:05.467964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:05.474562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:05.476026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:05.476044Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:05.476048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:05.476051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:05.476058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1634 [1:7556534473792319725:8187]
2025-10-02T08:13:05.476067Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:05.476082Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:05.476083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.476086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.476087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.476099Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:05.476104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:05.476112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:05.476176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.476182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.476185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:05.476186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:05.476239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:05.476244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.476252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.476259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:05.476272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534473792319709:8187]
2025-10-02T08:13:05.476277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534473792319709:8187]
2025-10-02T08:13:05.476282Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:05.476292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:05.476302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:05.476304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:05.476306Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:05.476307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:05.476314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792319748:8174], now have 1 active actors on pipe
2025-10-02T08:13:05.476334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1634
2025-10-02T08:13:05.476339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534474252099032:2378], now have 1 active actors on pipe
2025-10-02T08:13:05.476341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534473792319709:8187]
2025-10-02T08:13:05.476344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:05.476347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:05.476351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.476354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.476415Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:05.476425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.476428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.476405Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1634
2025-10-02T08:13:05.476430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:05.476439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.476448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:05.476466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.476500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.476506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.476515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.476549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1635 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0
2025-10-02T08:13:05.476881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beaf94f-4903b6b-22e164fd-afa5afc2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:05.479455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0] Write session: try to update token
2025-10-02T08:13:05.479470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:05.494531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId: src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:05.495057Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:05.495075Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:05.495078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:05.495103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534473792319709:8187]
2025-10-02T08:13:05.495114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534473792319709:8187]
2025-10-02T08:13:05.495159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:05.495161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:05.495168Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:05.495172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.495174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:05.495327Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:05.497432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:05.546588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534473792319763:8815]
2025-10-02T08:13:05.546736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1634, pipe: [1:7556534473792319763:8815]
2025-10-02T08:13:05.637221Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:05.638094Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:05.638323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:05.638333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0] Write session will restart in 0.005175s
2025-10-02T08:13:05.638386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0] Write session: Do CDS request
2025-10-02T08:13:05.638394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:05.637761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.637781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.637823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792319763:8815], now have 1 active actors on pipe
2025-10-02T08:13:05.637909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:05.637911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:05.637967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1635 reason: error at write: Disconnected sessionId: src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0
2025-10-02T08:13:05.638137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1635 sessionId: src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0 is DEAD
2025-10-02T08:13:05.638381Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:05.638650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534473792319763:8815]
2025-10-02T08:13:05.644408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.645480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:05.645496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1636
2025-10-02T08:13:05.649157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.649210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:05.649220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:05.649225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:05.649699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1636 sessionId:  describe result for acl check
2025-10-02T08:13:05.649739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:05.649746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:05.649747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:05.649752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534473792320104:8162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:05.650267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534473792320104:8162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:05.652527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534473792320104:8162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:05.655927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534473792320104:8162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:05.655942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534473792320104:8162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:05.655945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534473792320104:8162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:05.655954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:05.659841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:05.661426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:05.661630Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:05.661639Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:05.661648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:05.661702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:05.661738Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534473792320292:8160]
2025-10-02T08:13:05.662434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:05.662641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:05.662688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:05.662967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:05.663018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.663023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.663024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.663025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.663026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.663031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.663040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.663044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.663048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.663051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.663056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.663063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.663068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.663072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.663076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.663081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.663085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.663088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.663092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.663096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.663120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:05.675105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:05.677383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:05.677399Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:05.677402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:05.677406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:05.677412Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1635 [1:7556534473792320292:8160]
2025-10-02T08:13:05.677431Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:05.677447Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:05.677457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.677459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.677461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.677477Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:05.677482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:05.677487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:05.677547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.677559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.677562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:05.677564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:05.677625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:05.677632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.677646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.677658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:05.677675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792320221:8162], now have 1 active actors on pipe
2025-10-02T08:13:05.677682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534473792320286:8160]
2025-10-02T08:13:05.677685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534473792320286:8160]
2025-10-02T08:13:05.677691Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:05.677700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:05.677702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:05.677702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:05.677715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:05.677718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:05.677724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534474252099038:2378], now have 1 active actors on pipe
2025-10-02T08:13:05.677752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534473792320286:8160]
2025-10-02T08:13:05.677759Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:05.677800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1635
2025-10-02T08:13:05.677802Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:05.677847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.677851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.677872Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:05.677878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.677881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.677883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:05.677892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.677900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:05.677915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.677957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.677964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.677990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.678037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1636 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0
2025-10-02T08:13:05.678431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0700ee-125669ae-cfd16b44-f4e2f6fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:05.679506Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1635
2025-10-02T08:13:05.681732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0] Write session: try to update token
2025-10-02T08:13:05.681752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:05.702448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId: src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:05.705011Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:05.705039Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:05.705042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:05.705050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534473792320286:8160]
2025-10-02T08:13:05.705054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534473792320286:8160]
2025-10-02T08:13:05.705104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:05.705112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.705114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:05.705199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:05.705238Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:05.705247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:05.705257Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:05.739741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534473792320341:8815]
2025-10-02T08:13:05.739887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1635, pipe: [1:7556534473792320341:8815]
2025-10-02T08:13:05.858462Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:05.859179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.859197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.859251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792320341:8815], now have 1 active actors on pipe
2025-10-02T08:13:05.859532Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:05.859905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:05.859958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1636 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0
2025-10-02T08:13:05.860173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1636 sessionId: src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0 is DEAD
2025-10-02T08:13:05.860359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534473792320341:8815]
2025-10-02T08:13:05.860542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:05.860557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0] Write session will restart in 0.008835s
2025-10-02T08:13:05.860583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0] Write session: Do CDS request
2025-10-02T08:13:05.860592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:05.859584Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:05.870403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.873718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:05.873735Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1637
2025-10-02T08:13:05.877138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:05.877197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:05.877206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:05.877210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:05.878120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1637 sessionId:  describe result for acl check
2025-10-02T08:13:05.878156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:05.878163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:05.878165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:05.878171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534473792320557:8134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:05.878756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534473792320557:8134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:05.893816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534473792320557:8134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:05.900559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534473792320557:8134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:05.900580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534473792320557:8134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:05.900583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534473792320557:8134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:05.900593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:05.902090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:05.903505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:05.903691Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:05.903700Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:05.903709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:05.903755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:05.903793Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534473792320861:8138]
2025-10-02T08:13:05.904467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:05.904673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:05.904708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:05.905019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:05.905064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.905071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.905072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.905073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.905074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.905079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.905090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.905093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.905097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.905101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.905106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.905113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:05.905118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.905123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:05.905127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.905132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:05.905137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.905141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.905146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.905151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.905171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:05.915624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:05.917701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:05.917723Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:05.917725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:05.917729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:05.917736Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1636 [1:7556534473792320861:8138]
2025-10-02T08:13:05.917749Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:05.917768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:05.917771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.917774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.917777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.917795Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:05.917801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:05.917807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:05.917874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.917876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.917880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:05.917883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:05.917957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:05.917960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.917976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:05.917988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:05.918004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534473792320855:8138]
2025-10-02T08:13:05.918006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534473792320855:8138]
2025-10-02T08:13:05.918023Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:05.918036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:05.918048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:05.918051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:05.918087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534473792320855:8138]
2025-10-02T08:13:05.918089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:05.918212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:05.918217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:05.918224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:05.918313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1636
2025-10-02T08:13:05.918315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792320843:8134], now have 1 active actors on pipe
2025-10-02T08:13:05.918331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.918336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.918364Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:05.918373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:05.918377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:05.918380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:05.918391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:05.918403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:05.918420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.918516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534474252099068:2378], now have 1 active actors on pipe
2025-10-02T08:13:05.918553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:05.918563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:05.918576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:05.918611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1637 partition: 0 MaxSeqNo: 17 sessionId: src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0
2025-10-02T08:13:05.918669Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1636
2025-10-02T08:13:05.919073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7f18e2-c8cc0413-6734402-33f94cc0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:05.922413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0] Write session: try to update token
2025-10-02T08:13:05.922437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:05.943688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId: src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:05.943879Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:05.943896Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:05.943899Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:05.943909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534473792320855:8138]
2025-10-02T08:13:05.943913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534473792320855:8138]
2025-10-02T08:13:05.943949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:05.943952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:05.943958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:05.943960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:05.943962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:05.944114Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:05.946630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:05.960260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534473792320887:8815]
2025-10-02T08:13:05.960484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1636, pipe: [1:7556534473792320887:8815]
2025-10-02T08:13:06.102524Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:06.103124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.103141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.103179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534473792320887:8815], now have 1 active actors on pipe
2025-10-02T08:13:06.103372Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:06.103670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534473792320887:8815]
2025-10-02T08:13:06.103698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:06.103771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0
2025-10-02T08:13:06.104029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1637 sessionId: src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0 is DEAD
2025-10-02T08:13:06.104150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:06.104161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0] Write session will restart in 0.007329s
2025-10-02T08:13:06.104195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0] Write session: Do CDS request
2025-10-02T08:13:06.104204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:06.103399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:06.112374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:06.112465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:06.112481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1638
2025-10-02T08:13:06.112641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:06.112696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:06.112709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:06.112714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:06.116297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1638 sessionId:  describe result for acl check
2025-10-02T08:13:06.116341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:06.116343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:06.116345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:06.116351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534478087288220:8123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:06.116901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534478087288220:8123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:06.121403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534478087288220:8123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:06.130656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534478087288220:8123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:06.130673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534478087288220:8123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:06.130677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534478087288220:8123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:06.130687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:06.148752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:06.150677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:06.150920Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:06.150933Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:06.150944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:06.150997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:06.151045Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534478087288702:8120]
2025-10-02T08:13:06.151717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:06.151977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:06.152018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:06.152336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:06.152379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.152385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.152386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.152387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.152388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.152394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.152404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.152408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.152411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.152415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.152420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.152427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.152438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.152448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.152455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.152461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.152472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.152481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.152490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.152496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.152521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:06.164635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:06.166745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:06.166759Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:06.166762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:06.166765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:06.166770Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1637 [1:7556534478087288702:8120]
2025-10-02T08:13:06.166781Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:06.166795Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:06.166796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.166798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.166800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.166812Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:06.166816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:06.166821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:06.166874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.166880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.166883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:06.166884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:06.167227Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1637
2025-10-02T08:13:06.166935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:06.166941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.166953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.166960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:06.166972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534478087288695:8120]
2025-10-02T08:13:06.166973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534478087288695:8120]
2025-10-02T08:13:06.166979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:06.166989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:06.166997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:06.166999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:06.167026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534478087288695:8120]
2025-10-02T08:13:06.167028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:06.167071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1637
2025-10-02T08:13:06.167079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534478087288453:8123], now have 1 active actors on pipe
2025-10-02T08:13:06.167715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df63d393-1c5c34b3-953a739b-a0c580f4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:06.167078Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:06.167083Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:06.167092Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:06.167119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.167124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.167137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534478547066373:2378], now have 1 active actors on pipe
2025-10-02T08:13:06.167148Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:06.167152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.167155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.167156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:06.167164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.167171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:06.167183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:06.167334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.167339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.167362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:06.167395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1638 partition: 0 MaxSeqNo: 17 sessionId: src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0
2025-10-02T08:13:06.170574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0] Write session: try to update token
2025-10-02T08:13:06.170594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:06.191765Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:06.191780Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:06.191782Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:06.191790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534478087288695:8120]
2025-10-02T08:13:06.191794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534478087288695:8120]
2025-10-02T08:13:06.191832Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:06.191838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:06.191845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.191836Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:06.191847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:06.192018Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:06.195704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId: src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:06.198379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:06.204016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534478087288728:8815]
2025-10-02T08:13:06.204425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1637, pipe: [1:7556534478087288728:8815]
2025-10-02T08:13:06.343415Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:06.343657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.343669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.343689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534478087288728:8815], now have 1 active actors on pipe
2025-10-02T08:13:06.349183Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:06.349248Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:06.349624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534478087288728:8815]
2025-10-02T08:13:06.349643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:06.349701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1638 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0
2025-10-02T08:13:06.349868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1638 sessionId: src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0 is DEAD
2025-10-02T08:13:06.350465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:06.350475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0] Write session will restart in 0.008487s
2025-10-02T08:13:06.350503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0] Write session: Do CDS request
2025-10-02T08:13:06.350510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:06.360326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:06.360391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:06.360407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1639
2025-10-02T08:13:06.360538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:06.360571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:06.360581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:06.360585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:06.361069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1639 sessionId:  describe result for acl check
2025-10-02T08:13:06.361122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:06.361124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:06.361126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:06.361132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534478087288948:8102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:06.361716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534478087288948:8102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:06.365810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534478087288948:8102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:06.376055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534478087288948:8102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:06.376071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534478087288948:8102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:06.376075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534478087288948:8102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:06.376084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:06.383693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:06.385226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:06.385434Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:06.385446Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:06.385457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:06.385518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:06.385562Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534478087289251:8106]
2025-10-02T08:13:06.386197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:06.387265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:06.387324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:06.387653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:06.387725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.387726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.387728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.387729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.387730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.387736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.387748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.387752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.387756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.387760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.387767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.387775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.387781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.387787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.387791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.387797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.387804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.387810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.387815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.387820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.387840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:06.401334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:06.402849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:06.402868Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:06.402871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:06.402876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:06.402883Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1638 [1:7556534478087289251:8106]
2025-10-02T08:13:06.402896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:06.402915Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:06.402925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.402928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.402930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.402947Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:06.402952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:06.402959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:06.403029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.403036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.403039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:06.403041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:06.403106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:06.403117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.403130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.403142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:06.403158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534478087289245:8106]
2025-10-02T08:13:06.403160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534478087289245:8106]
2025-10-02T08:13:06.403167Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:06.403180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:06.403194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:06.403197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:06.403206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534478087289189:8102], now have 1 active actors on pipe
2025-10-02T08:13:06.403217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:06.403220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:06.403238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534478087289245:8106]
2025-10-02T08:13:06.403241Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:06.403246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534478547066393:2378], now have 1 active actors on pipe
2025-10-02T08:13:06.403289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1638
2025-10-02T08:13:06.403345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:06.403401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.403407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.403430Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:06.403436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.403439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.403441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:06.403449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.403460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:06.403474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:06.403600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.403604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.403617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:06.403661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1639 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0
2025-10-02T08:13:06.404011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d433dc-bdf133db-2a8f11e3-ee70719b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:06.405029Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1638
2025-10-02T08:13:06.406562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0] Write session: try to update token
2025-10-02T08:13:06.406576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:06.429360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId: src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:06.432286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:06.432389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.432404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.432439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:06.432467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:06.432515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.432534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.432721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.432795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.432884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.432953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.433243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.433251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.433320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.433383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.433443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.433509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.433552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.433558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.433623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.433679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.433737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.433793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.433843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.433849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.433916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.433982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.434052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.434125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.434175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.434181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.434258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.434326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.434399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.434472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.434523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.434529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.434608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.434673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.434743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.434813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.434863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.434868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.434940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.435005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.435076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.435143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.435192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.435197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.435266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.435329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.435397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.435486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.435655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.435661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.435731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.435788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.435847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.435911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.435959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.435964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.436032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:06.436093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:06.436150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:06.436230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:06.436280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:06.436285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:06.436345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:06.436408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.436429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.436434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:06.436462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:06.436476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:06.436482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:06.436483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:06.436485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:06.436869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:06.436892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:06.436897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:06.436900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:06.436902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:06.436904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:06.437447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:06.437468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:06.437472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:06.437474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:06.437476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:06.437478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:06.437929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:06.437947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:06.437950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:06.437952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:06.437955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:06.439117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:06.439134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:06.439146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392786438
2025-10-02T08:13:06.439284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:06.439297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:06.439302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:06.439305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:06.439310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:06.439313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:06.439892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:06.439914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:06.439918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:06.439922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:06.439924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:06.439927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:06.440410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:06.440434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:06.440444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:06.440447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:06.440452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:06.440456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:06.440979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:06.441003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:06.441009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:06.442201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:06.442219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:06.442225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:06.442229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:06.442237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392786441
2025-10-02T08:13:06.442558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:06.442581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:06.442590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:06.442597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:06.442602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:06.442605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:06.443110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:06.443139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:06.443145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:06.443149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:06.443153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:06.443157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:06.443581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:06.443599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.443676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392786443
2025-10-02T08:13:06.445973Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:06.446009Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:06.446015Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:06.446032Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:06.446061Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:06.446069Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:06.446071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:06.446079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534478087289245:8106]
2025-10-02T08:13:06.446083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534478087289245:8106]
2025-10-02T08:13:06.446120Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:06.446131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:06.447022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:06.447037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.447038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:06.447192Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:06.449615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534478087289288:8815]
2025-10-02T08:13:06.449853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1638, pipe: [1:7556534478087289288:8815]
2025-10-02T08:13:06.591262Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:06.591657Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:06.591670Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:06.591680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534478087289245:8106]
2025-10-02T08:13:06.591721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534478087289288:8815], now have 1 active actors on pipe
2025-10-02T08:13:06.591786Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:06.591871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:06.591880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:06.591907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1639 reason: error at write: Disconnected sessionId: src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0
2025-10-02T08:13:06.591986Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:06.592071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1639 sessionId: src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0 is DEAD
2025-10-02T08:13:06.592099Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:06.592235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:06.592246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0] Write session will restart in 0.006495s
2025-10-02T08:13:06.592249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534478087289288:8815]
2025-10-02T08:13:06.592273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0] Write session: Do CDS request
2025-10-02T08:13:06.592293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:06.595784Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [24a402157d58a3e6] Result# TEvPutResult {Id# [72075186224037892:1638:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:06.595839Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1638:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:06.595931Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1638:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:06.600356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:06.600456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:06.600471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1640
2025-10-02T08:13:06.600683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:06.600718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:06.600724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:06.600733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:06.601259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1640 sessionId:  describe result for acl check
2025-10-02T08:13:06.601315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:06.601316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:06.601318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:06.601323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534478087289526:8085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:06.601929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534478087289526:8085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:06.604667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534478087289526:8085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:06.608198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534478087289526:8085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:06.608218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534478087289526:8085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:06.608221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534478087289526:8085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:06.608230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:06.615558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:06.617932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:06.618246Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:06.618273Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:06.618285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:06.618345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:06.618386Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534478087289815:8086]
2025-10-02T08:13:06.619038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:06.619310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:06.619359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:06.619684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:06.619747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.619755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.619756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.619757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.619758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.619764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.619775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.619779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.619788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.619792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.619803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.619816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.619827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.619836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.619846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.619855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.619865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.619870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.619880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.619885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.619908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:06.631093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:06.633034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:06.633064Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:06.633068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:06.633075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:06.633084Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1639 [1:7556534478087289815:8086]
2025-10-02T08:13:06.633101Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:06.633125Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:06.633130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.633134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.633138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.633160Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:06.633172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:06.633182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:06.633259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.633267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.633271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:06.633274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:06.633356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:06.633363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.633381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.633399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:06.633424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534478087289809:8086]
2025-10-02T08:13:06.633433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534478087289809:8086]
2025-10-02T08:13:06.633443Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:06.633456Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:06.633457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1639
2025-10-02T08:13:06.633460Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:06.633462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534478087289687:8085], now have 1 active actors on pipe
2025-10-02T08:13:06.633470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:06.633485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:06.633489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:06.633497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534478547066401:2378], now have 1 active actors on pipe
2025-10-02T08:13:06.633546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.633560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.633579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534478087289809:8086]
2025-10-02T08:13:06.633589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:06.633617Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:06.633626Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:06.633634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.633639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.633641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:06.633654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.633620Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1639
2025-10-02T08:13:06.633672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:06.634060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:06.637665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.637688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.637734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:06.638114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1640 partition: 0 MaxSeqNo: 17 sessionId: src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0
2025-10-02T08:13:06.638476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ae62b0c-208195f8-d1d3d8ea-7ef43398_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:06.641148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0] Write session: try to update token
2025-10-02T08:13:06.641171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:06.656485Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:06.656509Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:06.656513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:06.656523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534478087289809:8086]
2025-10-02T08:13:06.656527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534478087289809:8086]
2025-10-02T08:13:06.656575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:06.656586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.656588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:06.656587Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:06.656594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:06.656751Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:06.659390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId: src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:06.662416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:06.714422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534478087289855:8815]
2025-10-02T08:13:06.717472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1639, pipe: [1:7556534478087289855:8815]
2025-10-02T08:13:06.807923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:06.807938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0] Write session will restart in 0.007961s
2025-10-02T08:13:06.807963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0] Write session: Do CDS request
2025-10-02T08:13:06.807969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:06.807958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:06.806499Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:06.807036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.807048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.807100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534478087289855:8815], now have 1 active actors on pipe
2025-10-02T08:13:06.807327Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:06.807333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534478087289855:8815]
2025-10-02T08:13:06.807357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:06.807430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1640 reason: status is not ok: tablet will be restarted right now sessionId: src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0
2025-10-02T08:13:06.807610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1640 sessionId: src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0 is DEAD
2025-10-02T08:13:06.817353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:06.817476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:06.817494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1641
2025-10-02T08:13:06.818495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:06.818526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:06.818531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:06.818534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:06.819022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1641 sessionId:  describe result for acl check
2025-10-02T08:13:06.819065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:06.819067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:06.819069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:06.819075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534478087290167:8056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:06.819723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534478087290167:8056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:06.822526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534478087290167:8056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:06.827095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534478087290167:8056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:06.827113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534478087290167:8056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:06.827117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534478087290167:8056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:06.827126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:06.828076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:06.830379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:06.830619Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:06.830629Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:06.830641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:06.830695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:06.830736Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534478087290407:8053]
2025-10-02T08:13:06.831406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:06.831641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:06.831690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:06.832006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:06.832078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.832084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.832085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.832087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.832088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.832094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.832104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.832108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.832112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.832116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.832122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.832130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:06.832136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.832141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:06.832146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.832151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:06.832156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.832161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.832183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.832194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.832213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:06.843086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:06.845446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1640
2025-10-02T08:13:06.844998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:06.845015Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:06.845018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:06.845022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:06.845029Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1640 [1:7556534478087290407:8053]
2025-10-02T08:13:06.845043Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:06.845062Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:06.845065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.845069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.845074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.845089Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:06.845097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:06.845104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:06.845171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.845173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.845176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:06.845179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:06.845251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:06.845254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.845270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:06.845283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:06.845300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534478087290398:8053]
2025-10-02T08:13:06.845302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534478087290398:8053]
2025-10-02T08:13:06.845309Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:06.845325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534478087290397:8056], now have 1 active actors on pipe
2025-10-02T08:13:06.845328Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:06.845331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:06.845331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:06.845344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:06.845346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1640
2025-10-02T08:13:06.845347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:06.845352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534478547066433:2378], now have 1 active actors on pipe
2025-10-02T08:13:06.845387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.845390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.845407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534478087290398:8053]
2025-10-02T08:13:06.845418Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:06.845421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:06.845457Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64052960-75538fac-f07f5d7d-c16420d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:06.845465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:06.845470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:06.845473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:06.845485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:06.845496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:06.845539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:06.845646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:06.845653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:06.845680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:06.845728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1641 partition: 0 MaxSeqNo: 17 sessionId: src_id|64052960-75538fac-f07f5d7d-c16420d0_0
2025-10-02T08:13:06.846130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580bf3c8-23f2f557-fe74dae5-f22a610a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|64052960-75538fac-f07f5d7d-c16420d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:06.848671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64052960-75538fac-f07f5d7d-c16420d0_0] Write session: try to update token
2025-10-02T08:13:06.848685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64052960-75538fac-f07f5d7d-c16420d0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:06.863391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId: src_id|64052960-75538fac-f07f5d7d-c16420d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:06.864639Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:06.864653Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:06.864657Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:06.864665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534478087290398:8053]
2025-10-02T08:13:06.864670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534478087290398:8053]
2025-10-02T08:13:06.864710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:06.864710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:06.864715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:06.864723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:06.864725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:06.864875Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:06.866008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:06.905928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534478087290433:8815]
2025-10-02T08:13:06.906093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1640, pipe: [1:7556534478087290433:8815]
2025-10-02T08:13:07.018521Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:07.019048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.019056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.019096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534478087290433:8815], now have 1 active actors on pipe
2025-10-02T08:13:07.019278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:07.019292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:07.019349Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:07.019357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1641 reason: error at write: Disconnected sessionId: src_id|64052960-75538fac-f07f5d7d-c16420d0_0
2025-10-02T08:13:07.019539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1641 sessionId: src_id|64052960-75538fac-f07f5d7d-c16420d0_0 is DEAD
2025-10-02T08:13:07.019641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534478087290433:8815]
2025-10-02T08:13:07.020033Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:07.020934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64052960-75538fac-f07f5d7d-c16420d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:07.020946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64052960-75538fac-f07f5d7d-c16420d0_0] Write session will restart in 0.008791s
2025-10-02T08:13:07.020974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64052960-75538fac-f07f5d7d-c16420d0_0] Write session: Do CDS request
2025-10-02T08:13:07.020981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64052960-75538fac-f07f5d7d-c16420d0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:07.031302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64052960-75538fac-f07f5d7d-c16420d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.031648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:07.031668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1642
2025-10-02T08:13:07.031784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.031826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:07.031837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:07.031842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:07.032339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1642 sessionId:  describe result for acl check
2025-10-02T08:13:07.032371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:07.032373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:07.032374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:07.032379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534482382258168:8042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:07.032929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534482382258168:8042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:07.035364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534482382258168:8042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:07.035911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:07.037720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:07.037908Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:07.037912Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:07.037922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:07.037966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:07.037999Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534482382258249:8043]
2025-10-02T08:13:07.038694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:07.038950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:07.039026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:07.039377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:07.039446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.039454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.039455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.039456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.039458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.039463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.039473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.039477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.039480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.039483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.039489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.039496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.039502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.039507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.039511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.039516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.039520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.039525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.039530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.039533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.039552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:07.040276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534482382258168:8042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:07.040289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534482382258168:8042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:07.040292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534482382258168:8042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:07.040301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:07.048201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:07.050079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:07.050104Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:07.050107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:07.050111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:07.050119Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1641 [1:7556534482382258249:8043]
2025-10-02T08:13:07.050135Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:07.050154Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:07.050157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.050160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.050162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.050179Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:07.050185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:07.050191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:07.050257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.050265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.050268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:07.050271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:07.050338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:07.050346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.050361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.050379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:07.050404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382258266:8042], now have 1 active actors on pipe
2025-10-02T08:13:07.050408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1641
2025-10-02T08:13:07.050415Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534482382258236:8043]
2025-10-02T08:13:07.050417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534482382258236:8043]
2025-10-02T08:13:07.050425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:07.050434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534482842033735:2378], now have 1 active actors on pipe
2025-10-02T08:13:07.050437Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:07.050441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:07.050448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:07.050456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:07.050459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:07.050466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.050476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.050520Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1641
2025-10-02T08:13:07.050531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534482382258236:8043]
2025-10-02T08:13:07.050540Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:07.050549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:07.050556Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:07.050562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.050565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.050567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:07.050578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.050587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:07.050630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.050705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.050712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.050727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.050765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1642 partition: 0 MaxSeqNo: 17 sessionId: src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0
2025-10-02T08:13:07.051147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64052960-75538fac-f07f5d7d-c16420d0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:07.054007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0] Write session: try to update token
2025-10-02T08:13:07.054026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:07.069139Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:07.069155Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:07.069158Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:07.069167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534482382258236:8043]
2025-10-02T08:13:07.069172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534482382258236:8043]
2025-10-02T08:13:07.069214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:07.069213Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:07.069220Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:07.069220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.069223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:07.069357Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:07.074168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId: src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:07.077121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:07.119440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534482382258281:8815]
2025-10-02T08:13:07.119606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1641, pipe: [1:7556534482382258281:8815]
2025-10-02T08:13:07.222166Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:07.222546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.222566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.222611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382258281:8815], now have 1 active actors on pipe
2025-10-02T08:13:07.223400Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:07.223808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534482382258281:8815]
2025-10-02T08:13:07.223832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:07.223887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1642 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0
2025-10-02T08:13:07.224061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1642 sessionId: src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0 is DEAD
2025-10-02T08:13:07.224232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:07.224244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0] Write session will restart in 0.009538s
2025-10-02T08:13:07.224270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0] Write session: Do CDS request
2025-10-02T08:13:07.224280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:07.223885Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:07.235324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.235484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:07.235509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1643
2025-10-02T08:13:07.235620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.235653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:07.235664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:07.235679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:07.236363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1643 sessionId:  describe result for acl check
2025-10-02T08:13:07.236394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:07.236397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:07.236398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:07.236402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534482382258500:8026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:07.236967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534482382258500:8026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:07.242081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534482382258500:8026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:07.248510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534482382258500:8026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:07.248530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534482382258500:8026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:07.248533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534482382258500:8026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:07.248542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:07.258402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:07.260195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:07.260391Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:07.260394Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:07.260403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:07.260443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:07.260475Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534482382258810:8029]
2025-10-02T08:13:07.261363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:07.261640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:07.261677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:07.262060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:07.262100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.262101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.262103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.262104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.262105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.262111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.262122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.262126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.262130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.262134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.262140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.262148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.262155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.262160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.262165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.262170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.262175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.262180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.262184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.262190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.262211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:07.272367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:07.274211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:07.274216Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:07.274219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:07.274222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:07.274229Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1642 [1:7556534482382258810:8029]
2025-10-02T08:13:07.274241Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:07.274258Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:07.274261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.274264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.274266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.274283Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:07.274289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:07.274295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:07.274355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.274357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.274360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:07.274363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:07.274429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:07.274432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.274447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.274460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:07.274477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534482382258804:8029]
2025-10-02T08:13:07.274479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534482382258804:8029]
2025-10-02T08:13:07.274491Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:07.274504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:07.274517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:07.274520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:07.274552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534482382258804:8029]
2025-10-02T08:13:07.274554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:07.274779Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:07.274786Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:07.274791Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:07.275389Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1642
2025-10-02T08:13:07.275387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1642
2025-10-02T08:13:07.275409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382258700:8026], now have 1 active actors on pipe
2025-10-02T08:13:07.275414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534482842033744:2378], now have 1 active actors on pipe
2025-10-02T08:13:07.275420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.275426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.275459Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:07.275469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.275473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.275475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:07.275487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.275499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:07.275523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.275571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.275576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.275599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.275638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1643 partition: 0 MaxSeqNo: 17 sessionId: src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0
2025-10-02T08:13:07.275984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b625537d-ee160a69-ca6fc22b-b1d0d4d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:07.278949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0] Write session: try to update token
2025-10-02T08:13:07.278964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:07.301354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId: src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:07.304134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:07.304219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.304227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.304261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:07.304282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:07.304339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.304341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.304525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.304663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.304797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.304990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.305060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.305065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.305158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.305233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.305335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.305416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.305467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.305471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.305582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.305718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.305790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.305860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.305913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.305917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.306003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.306095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.306194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.306354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.306420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.306424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.306514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.306596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.306687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.306774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.306829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.306833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.306928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.307012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.307097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.307175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.307232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.307236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.307323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.307398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.307479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.307560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.307621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.307624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.307712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.307788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.307868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.307951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.308002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.308005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.308087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.308179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.308249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.308341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.308394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.308396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.308485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.308551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.308632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.308717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.308777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.308785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.308909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:07.308985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.309004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.309007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:07.309040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:07.309054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:07.309056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:07.309058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:07.309061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:07.309541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:07.309560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:07.309567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:07.309571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:07.309574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:07.309577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:07.310303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:07.310320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:07.310326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:07.310328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:07.310331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:07.310334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:07.310945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:07.310962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:07.310969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:07.310973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:07.310976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:07.313778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:07.313801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:07.313817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392787313
2025-10-02T08:13:07.314014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:07.314024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:07.314030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:07.314033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:07.314038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:07.314041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:07.314574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:07.314588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:07.314595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:07.314599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:07.314603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:07.314608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:07.315169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:07.315183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:07.315193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:07.315197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:07.315375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:07.315390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:07.315979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:07.315998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:07.316003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:07.317308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:07.317317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:07.317325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:07.317329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:07.317341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392787317
2025-10-02T08:13:07.317714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:07.317727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:07.317734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:07.317739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:07.317743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:07.317747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:07.318310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:07.318324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:07.318332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:07.318337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:07.318340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:07.318345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:07.318904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:07.318916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.319026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392787318
2025-10-02T08:13:07.324844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534482382258834:8815]
2025-10-02T08:13:07.325028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1642, pipe: [1:7556534482382258834:8815]
2025-10-02T08:13:07.326785Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:07.326827Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:07.326836Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:07.326847Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:07.326866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382258834:8815], now have 1 active actors on pipe
2025-10-02T08:13:07.326873Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:07.326876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:07.326878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:07.326891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534482382258804:8029]
2025-10-02T08:13:07.326896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534482382258804:8029]
2025-10-02T08:13:07.328934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:07.328949Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:07.334811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:07.334831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.334833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:07.335000Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:07.483116Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:07.483418Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:07.483426Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:07.483434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534482382258804:8029]
2025-10-02T08:13:07.483525Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:07.483638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534482382258834:8815]
2025-10-02T08:13:07.483667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:07.483677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:07.483987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:07.483995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0] Write session will restart in 0.009358s
2025-10-02T08:13:07.484018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0] Write session: Do CDS request
2025-10-02T08:13:07.484025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:07.483703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1643 reason: error at write: Disconnected sessionId: src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0
2025-10-02T08:13:07.483748Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:07.483868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1643 sessionId: src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0 is DEAD
2025-10-02T08:13:07.484130Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:07.488053Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [ee718d55b6851dad] Result# TEvPutResult {Id# [72075186224037892:1642:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:07.488102Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1642:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:07.488133Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1642:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:07.488144Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6f297d59a64ac663] Result# TEvPutResult {Id# [72075186224037892:1642:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:07.494318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.494340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:07.494358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1644
2025-10-02T08:13:07.494519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.494563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:07.494572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:07.494575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:07.495353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1644 sessionId:  describe result for acl check
2025-10-02T08:13:07.495388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:07.495394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:07.495396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:07.495401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534482382258894:8013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:07.495923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534482382258894:8013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:07.503694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534482382258894:8013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:07.511950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534482382258894:8013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:07.511968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534482382258894:8013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:07.511971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534482382258894:8013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:07.511980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:07.512683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:07.514779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:07.514978Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:07.514988Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:07.514998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:07.515048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:07.515083Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534482382259384:8012]
2025-10-02T08:13:07.515745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:07.515983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:07.516025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:07.516344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:07.516389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.516394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.516396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.516397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.516398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.516402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.516413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.516416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.516420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.516423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.516429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.516436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.516442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.516448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.516452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.516457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.516461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.516465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.516470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.516482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.516500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:07.525462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:07.527105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:07.527123Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:07.527126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:07.527129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:07.527136Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1643 [1:7556534482382259384:8012]
2025-10-02T08:13:07.527149Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:07.527166Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:07.527169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.527172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.527175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.527193Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:07.527797Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1643
2025-10-02T08:13:07.527199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:07.527215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:07.527282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.527284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.527287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:07.527289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:07.527361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:07.527364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.527378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.527388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:07.527405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534482382259378:8012]
2025-10-02T08:13:07.527407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534482382259378:8012]
2025-10-02T08:13:07.527424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:07.527438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:07.527453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:07.527456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:07.527484Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:07.527499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:07.527532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534482382259378:8012]
2025-10-02T08:13:07.527536Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:07.527561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382259372:8013], now have 1 active actors on pipe
2025-10-02T08:13:07.527586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:07.527599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1643
2025-10-02T08:13:07.527971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534482842033764:2378], now have 1 active actors on pipe
2025-10-02T08:13:07.527981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.527987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.528022Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:07.528029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.528034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.528036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:07.528047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.528059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:07.528079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.528131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.528133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.528144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.528193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1644 partition: 0 MaxSeqNo: 17 sessionId: src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0
2025-10-02T08:13:07.528542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d920bf-1337ed45-a3e8e323-ec3f9a53_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:07.531397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0] Write session: try to update token
2025-10-02T08:13:07.531412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:07.545162Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:07.545179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:07.545189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534482382259378:8012]
2025-10-02T08:13:07.545232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:07.545234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:07.545425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:07.545565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:07.545694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:07.545821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:07.546029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:07.546059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:07.550007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId: src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:07.552850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:07.554069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.554085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.554121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:07.554160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:07.554320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.554337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.554547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.554643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.554728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.554802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.554850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.554854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.554936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.555013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.555082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.555156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.555203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.555207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.555285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.555346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.555410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.555475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.555528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.555532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.555609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.555683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.555761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.555842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.555897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.555901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.555988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.556062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.556140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.556233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.556295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.556298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.556383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.556459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.556543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.556624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.556681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.556684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.556773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.556869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.556956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.557034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.557087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.557090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.557182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.557255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.557329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.557415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.557471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.557474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.557554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.557620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.557684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.557749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.557801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.557804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.557879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.557944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.558016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.558095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:07.558147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:07.558150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:07.558196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:07.558265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.558283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.558286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:07.558322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:07.558336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:07.558339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:07.558344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:07.558347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:07.558764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:07.558781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:07.558786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:07.558788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:07.558790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:07.558792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:07.559420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:07.559438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:07.559445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:07.559448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:07.559452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:07.559455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:07.560089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:07.560102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:07.560107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:07.560109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:07.560111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:07.561780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:07.561793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:07.561809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392787561
2025-10-02T08:13:07.561970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:07.561981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:07.561989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:07.561993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:07.561997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:07.562001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:07.562733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:07.562749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:07.562755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:07.562759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:07.562763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:07.562767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:07.563368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:07.563381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:07.563389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:07.563392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:07.563396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:07.563399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:07.563909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:07.563940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:07.563946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:07.565588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:07.565614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:07.565624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:07.565629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:07.565639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392787562
2025-10-02T08:13:07.565942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:07.565951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:07.565955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:07.565957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:07.565960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:07.565962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:07.566391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:07.566400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:07.566403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:07.566405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:07.566408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:07.566412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:07.566862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:07.566869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.566948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392787566
2025-10-02T08:13:07.567798Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:07.567813Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:07.567820Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:07.567827Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:07.571680Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:07.571698Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:07.571700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:07.571712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534482382259378:8012]
2025-10-02T08:13:07.571716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534482382259378:8012]
2025-10-02T08:13:07.571762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:07.571772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.571772Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:07.571776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:07.571779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:07.571928Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:07.584037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534482382259417:8815]
2025-10-02T08:13:07.584234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1643, pipe: [1:7556534482382259417:8815]
2025-10-02T08:13:07.731719Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:07.732116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382259417:8815], now have 1 active actors on pipe
2025-10-02T08:13:07.732428Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:07.732355Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:07.732680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534482382259417:8815]
2025-10-02T08:13:07.732699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:07.732719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1644 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0
2025-10-02T08:13:07.732896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1644 sessionId: src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0 is DEAD
2025-10-02T08:13:07.733052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:07.733063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0] Write session will restart in 0.005713s
2025-10-02T08:13:07.733086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0] Write session: Do CDS request
2025-10-02T08:13:07.733093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:07.740290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.740600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:07.740623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1645
2025-10-02T08:13:07.740737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.740769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:07.740773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:07.740777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:07.741205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1645 sessionId:  describe result for acl check
2025-10-02T08:13:07.741233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:07.741238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:07.741239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:07.741243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534482382259696:7978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:07.741762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534482382259696:7978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:07.745365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534482382259696:7978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:07.749377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534482382259696:7978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:07.749401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534482382259696:7978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:07.749405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534482382259696:7978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:07.749413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:07.752901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:07.753718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:07.753910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:07.753923Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:07.753933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:07.753985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:07.754128Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534482382259968:7988]
2025-10-02T08:13:07.754753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:07.757135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:07.757204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:07.757583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:07.757650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.757656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.757658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.757659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.757660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.757666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.757675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.757678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.757682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.757686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.757693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.757701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.757712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.757719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.757727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.757732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.757737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.757742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.757750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.757755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.757780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:07.766567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:07.768745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:07.768770Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:07.768772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:07.768776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:07.768782Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1644 [1:7556534482382259968:7988]
2025-10-02T08:13:07.768792Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:07.768828Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:07.768830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.768833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.768836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.768852Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:07.768857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:07.768863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:07.768925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.768939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.768942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:07.768944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:07.769012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:07.769021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.769036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.769053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:07.769077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382259928:7978], now have 1 active actors on pipe
2025-10-02T08:13:07.769083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1644
2025-10-02T08:13:07.769089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534482382259962:7988]
2025-10-02T08:13:07.769091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534482382259962:7988]
2025-10-02T08:13:07.769102Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:07.769113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534482842033772:2378], now have 1 active actors on pipe
2025-10-02T08:13:07.769126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.769134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.769138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:07.769141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:07.769152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:07.769171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:07.769179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:07.769181Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1644
2025-10-02T08:13:07.769224Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:07.769237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.769242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.769243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:07.769252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.769266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:07.769277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534482382259962:7988]
2025-10-02T08:13:07.769289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:07.769300Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:07.769330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.769377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.769386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.769405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.769438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1645 partition: 0 MaxSeqNo: 17 sessionId: src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0
2025-10-02T08:13:07.769740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98bc11-4e5d8c5d-417ddb6e-ed041e11_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:07.772423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0] Write session: try to update token
2025-10-02T08:13:07.772440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:07.786909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId: src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:07.787615Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:07.787618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:07.787620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:07.787626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534482382259962:7988]
2025-10-02T08:13:07.787630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534482382259962:7988]
2025-10-02T08:13:07.787678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:07.787685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.787687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:07.787763Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:07.787769Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:07.787830Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:07.789668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:07.832649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534482382260009:8815]
2025-10-02T08:13:07.832740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1644, pipe: [1:7556534482382260009:8815]
2025-10-02T08:13:07.940745Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:07.941171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.941182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.941224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382260009:8815], now have 1 active actors on pipe
2025-10-02T08:13:07.941366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:07.941370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:07.941445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1645 reason: error at write: Disconnected sessionId: src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0
2025-10-02T08:13:07.941559Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:07.941627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1645 sessionId: src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0 is DEAD
2025-10-02T08:13:07.941779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534482382260009:8815]
2025-10-02T08:13:07.941970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:07.941982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0] Write session will restart in 0.009772s
2025-10-02T08:13:07.942007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0] Write session: Do CDS request
2025-10-02T08:13:07.942015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:07.941981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:07.953386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.953420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:07.953437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1646
2025-10-02T08:13:07.953873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:07.953908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:07.953919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:07.953925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:07.954425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1646 sessionId:  describe result for acl check
2025-10-02T08:13:07.954469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:07.954474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:07.954476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:07.954480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534482382260261:7968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:07.954959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534482382260261:7968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:07.957339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534482382260261:7968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:07.963533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:07.964918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:07.965061Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:07.965069Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:07.965076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:07.965107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:07.965131Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534482382260547:7970]
2025-10-02T08:13:07.965669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:07.965866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:07.965895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:07.966089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:07.966117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.966118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.966119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.966119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.966120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.966123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.966129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.966131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.966134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.966135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.966139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.966143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:07.966147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.966150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:07.966153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.966155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:07.966159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.966163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.966168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.966172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.966189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:07.969431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534482382260261:7968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:07.969445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534482382260261:7968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:07.969448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534482382260261:7968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:07.969456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:07.974403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:07.976307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:07.976323Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:07.976325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:07.976329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:07.976335Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1645 [1:7556534482382260547:7970]
2025-10-02T08:13:07.976349Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:07.976365Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:07.976368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.976372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.976373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.976389Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:07.976393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:07.976399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:07.976459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.976461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.976464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:07.976466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:07.976533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:07.976536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:07.976552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:07.976563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:07.976580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1645
2025-10-02T08:13:07.976582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534482382260564:7968], now have 1 active actors on pipe
2025-10-02T08:13:07.976588Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534482382260541:7970]
2025-10-02T08:13:07.976590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534482382260541:7970]
2025-10-02T08:13:07.976598Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:07.976606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534482842033800:2378], now have 1 active actors on pipe
2025-10-02T08:13:07.976613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:07.976626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:07.976629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:07.976632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:07.976635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:07.976663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.976667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.976680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534482382260541:7970]
2025-10-02T08:13:07.976689Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:07.976697Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:07.976714Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:07.976720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:07.976878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1645
2025-10-02T08:13:07.976725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:07.976727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:07.976736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:07.976744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:07.976767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.976842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.976845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.976859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:07.976895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1646 partition: 0 MaxSeqNo: 17 sessionId: src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0
2025-10-02T08:13:07.977206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea44d85-dcfa9ac-9fa6d327-147c13_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:07.979744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0] Write session: try to update token
2025-10-02T08:13:07.979759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:07.996531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId: src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:07.999042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:07.999125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.999138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.999174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:07.999196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:07.999237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:07.999260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:07.999428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:07.999493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:07.999564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:07.999631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.000018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.000033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.000102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.000164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.000243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.000310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.000362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.000366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.000435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.000489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.000549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.000605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.000644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.000647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.000715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.000782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.000880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.000948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.000996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.000999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.001077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.001142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.001212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.001280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.001328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.001332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.001409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.001481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.001552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.001621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.001670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.001673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.001751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.001820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.001894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.001968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.002018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.002021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.002100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.002165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.002263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.002333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.002386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.002390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.002463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.002521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.002580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.002648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.002703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.002706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.002778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.002841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.002902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.002967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.003016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.003019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.003081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:08.003142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.003161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.003164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:08.003194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:08.003207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:08.003211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:08.003214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:08.003217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:08.003631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:08.003654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:08.003661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:08.003665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:08.003668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:08.003671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:08.004147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:08.004161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:08.004181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:08.004184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:08.004190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:08.004193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:08.004660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:08.004675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:08.004680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:08.004684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:08.004687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:08.012131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:08.012160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:08.012193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392788008
2025-10-02T08:13:08.012409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:08.012431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:08.012444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:08.012448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:08.012452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:08.012459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:08.013007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:08.013042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:08.013051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:08.013054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:08.013057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:08.013063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:08.013539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:08.013552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:08.013564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:08.013567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:08.013573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:08.013576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:08.014050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:08.014064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:08.014070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:08.015222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:08.015238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:08.015244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:08.015248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:08.015258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392788014
2025-10-02T08:13:08.015566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:08.015591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:08.015600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:08.015609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:08.015613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:08.015617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:08.016117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:08.016142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:08.016147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:08.016151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:08.016154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:08.016158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:08.016675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:08.016697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.016827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392788016
2025-10-02T08:13:08.019255Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:08.019286Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:08.019296Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:08.019304Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:08.019317Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:08.019319Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:08.019323Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:08.019332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534482382260541:7970]
2025-10-02T08:13:08.019337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534482382260541:7970]
2025-10-02T08:13:08.020337Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:08.020352Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:08.020413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:08.020431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.020433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:08.020592Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:08.042078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534486677227874:8815]
2025-10-02T08:13:08.042296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1645, pipe: [1:7556534486677227874:8815]
2025-10-02T08:13:08.179611Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:08.179992Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:08.180000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:08.180010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534482382260541:7970]
2025-10-02T08:13:08.180068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:08.180083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677227874:8815], now have 1 active actors on pipe
2025-10-02T08:13:08.180296Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:08.180323Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:08.180629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:08.180665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1646 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0
2025-10-02T08:13:08.180791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534486677227874:8815]
2025-10-02T08:13:08.180852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1646 sessionId: src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0 is DEAD
2025-10-02T08:13:08.181012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:08.181022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0] Write session will restart in 0.009157s
2025-10-02T08:13:08.181045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0] Write session: Do CDS request
2025-10-02T08:13:08.181058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:08.186635Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [1d034a1270c53236] Result# TEvPutResult {Id# [72075186224037892:1645:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:08.186694Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1645:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:08.186746Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1645:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:08.191344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.191452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:08.191469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1647
2025-10-02T08:13:08.191579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.191611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:08.191621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:08.191625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:08.192089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1647 sessionId:  describe result for acl check
2025-10-02T08:13:08.192130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:08.192137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:08.192139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:08.192144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534486677228119:7957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:08.192686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534486677228119:7957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:08.195406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534486677228119:7957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:08.199294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534486677228119:7957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:08.199309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534486677228119:7957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:08.199312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534486677228119:7957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:08.199321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:08.203045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:08.204091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:08.204286Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:08.204295Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:08.204304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:08.204348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:08.204387Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534486677228415:7952]
2025-10-02T08:13:08.205071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:08.205295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:08.205336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:08.205612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:08.205646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.205647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.205648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.205649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.205650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.205655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.205665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.205669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.205672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.205674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.205680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.205687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.205692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.205697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.205700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.205704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.205708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.205713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.205717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.205721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.205738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:08.216007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:08.217700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:08.217722Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:08.217726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:08.217730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:08.217737Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1646 [1:7556534486677228415:7952]
2025-10-02T08:13:08.217750Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:08.217768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:08.217772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.217775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.217777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.217794Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:08.217806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:08.217813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:08.217874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.217882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.217885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:08.217888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:08.217960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:08.217969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.217984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.218000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:08.218021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534486677228409:7952]
2025-10-02T08:13:08.218028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534486677228409:7952]
2025-10-02T08:13:08.218047Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:08.218064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:08.218064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:08.218068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:08.218084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:08.218092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:08.218112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1646
2025-10-02T08:13:08.218130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677228372:7957], now have 1 active actors on pipe
2025-10-02T08:13:08.218140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534486677228409:7952]
2025-10-02T08:13:08.218143Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:08.218150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.218153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:08.218158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.218174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534487137001105:2378], now have 1 active actors on pipe
2025-10-02T08:13:08.218222Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1346ba3-1494a6fc-f6884120-39dce138_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:08.218234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.218238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.218244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:08.218254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.218268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:08.218297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:08.218362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.218369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.218383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:08.218423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1647 partition: 0 MaxSeqNo: 17 sessionId: src_id|f1346ba3-1494a6fc-f6884120-39dce138_0
2025-10-02T08:13:08.218773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fd01ee-4b16579f-5f2da44f-83efc6c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f1346ba3-1494a6fc-f6884120-39dce138_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:08.218222Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1646
2025-10-02T08:13:08.221564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1346ba3-1494a6fc-f6884120-39dce138_0] Write session: try to update token
2025-10-02T08:13:08.221581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1346ba3-1494a6fc-f6884120-39dce138_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:08.238090Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:08.238115Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:08.238118Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:08.238128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534486677228409:7952]
2025-10-02T08:13:08.238133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534486677228409:7952]
2025-10-02T08:13:08.238180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:08.238189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.238196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:08.238209Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:08.238224Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:08.238339Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:08.244445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId: src_id|f1346ba3-1494a6fc-f6884120-39dce138_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:08.247257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:08.281156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534486677228441:8815]
2025-10-02T08:13:08.281265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1646, pipe: [1:7556534486677228441:8815]
2025-10-02T08:13:08.377828Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:08.378163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.378176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.378197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677228441:8815], now have 1 active actors on pipe
2025-10-02T08:13:08.378475Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:08.378519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534486677228441:8815]
2025-10-02T08:13:08.378547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:08.378553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:08.378599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1647 reason: error at write: Disconnected sessionId: src_id|f1346ba3-1494a6fc-f6884120-39dce138_0
2025-10-02T08:13:08.378735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1647 sessionId: src_id|f1346ba3-1494a6fc-f6884120-39dce138_0 is DEAD
2025-10-02T08:13:08.378919Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:08.378955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1346ba3-1494a6fc-f6884120-39dce138_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:08.378971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1346ba3-1494a6fc-f6884120-39dce138_0] Write session will restart in 0.006023s
2025-10-02T08:13:08.379028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1346ba3-1494a6fc-f6884120-39dce138_0] Write session: Do CDS request
2025-10-02T08:13:08.379037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1346ba3-1494a6fc-f6884120-39dce138_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:08.386460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1346ba3-1494a6fc-f6884120-39dce138_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.386511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:08.386530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1648
2025-10-02T08:13:08.386691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.386722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:08.386732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:08.386736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:08.387196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1648 sessionId:  describe result for acl check
2025-10-02T08:13:08.387236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:08.387242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:08.387243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:08.387247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534486677228786:7930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:08.387732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534486677228786:7930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:08.390752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534486677228786:7930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:08.393906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:08.394207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:08.394390Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:08.394401Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:08.394409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534486677228786:7930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:08.394410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:08.394423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534486677228786:7930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:08.394427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534486677228786:7930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:08.394435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:08.394456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:08.394496Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534486677228976:7943]
2025-10-02T08:13:08.395051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:08.395259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:08.395315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:08.395626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:08.395691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.395697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.395699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.395699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.395701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.395706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.395717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.395721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.395730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.395733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.395743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.395755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.395766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.395772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.395780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.395785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.395792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.395798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.395802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.395811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.395833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:08.404409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:08.406228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:08.406252Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:08.406255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:08.406259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:08.406265Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1647 [1:7556534486677228976:7943]
2025-10-02T08:13:08.406278Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:08.406297Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:08.406300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.406303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.406305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.406323Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:08.406332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:08.406338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:08.406400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.406409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.406412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:08.406414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:08.406479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:08.406486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.406500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.406517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:08.406536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1647
2025-10-02T08:13:08.406540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534487137001124:2378], now have 1 active actors on pipe
2025-10-02T08:13:08.406543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677228981:7930], now have 1 active actors on pipe
2025-10-02T08:13:08.406549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534486677228970:7943]
2025-10-02T08:13:08.406552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534486677228970:7943]
2025-10-02T08:13:08.406564Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:08.406577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.406578Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:08.406582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:08.406586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.406606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:08.406572Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1647
2025-10-02T08:13:08.406624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:08.406632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:08.406676Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:08.406686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.406690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.406692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:08.406702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.406714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:08.406731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534486677228970:7943]
2025-10-02T08:13:08.406743Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:08.406753Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:08.406769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:08.406825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.406832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.406845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:08.406886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1648 partition: 0 MaxSeqNo: 17 sessionId: src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0
2025-10-02T08:13:08.407243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1346ba3-1494a6fc-f6884120-39dce138_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:08.409984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0] Write session: try to update token
2025-10-02T08:13:08.410000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:08.424284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId: src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:08.425709Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:08.425727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:08.425730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:08.425740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534486677228970:7943]
2025-10-02T08:13:08.425746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534486677228970:7943]
2025-10-02T08:13:08.425793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:08.425808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.425808Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:08.425814Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:08.425814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:08.425970Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:08.426960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:08.478787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534486677229018:8815]
2025-10-02T08:13:08.478901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1647, pipe: [1:7556534486677229018:8815]
2025-10-02T08:13:08.578228Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:08.578622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.578638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.578679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677229018:8815], now have 1 active actors on pipe
2025-10-02T08:13:08.579012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534486677229018:8815]
2025-10-02T08:13:08.579043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:08.579050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:08.579103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1648 reason: error at write: Disconnected sessionId: src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0
2025-10-02T08:13:08.579253Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:08.579293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1648 sessionId: src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0 is DEAD
2025-10-02T08:13:08.579438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:08.579130Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:08.579451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0] Write session will restart in 0.006120s
2025-10-02T08:13:08.579504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0] Write session: Do CDS request
2025-10-02T08:13:08.579521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:08.587327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.587403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:08.587420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1649
2025-10-02T08:13:08.587559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.587609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:08.587619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:08.587623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:08.588021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1649 sessionId:  describe result for acl check
2025-10-02T08:13:08.588057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:08.588058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:08.588061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:08.588067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534486677229077:7932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:08.588599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534486677229077:7932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:08.591870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534486677229077:7932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:08.595026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534486677229077:7932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:08.595041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534486677229077:7932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:08.595044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534486677229077:7932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:08.595052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:08.599771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:08.601457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:08.601761Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:08.601771Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:08.601782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:08.601836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:08.601871Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534486677229559:7933]
2025-10-02T08:13:08.602502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:08.602695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:08.602730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:08.602966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:08.603007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.603012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.603014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.603015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.603016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.603020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.603032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.603036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.603040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.603044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.603049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.603056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.603062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.603068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.603072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.603077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.603084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.603094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.603099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.603108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.603138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:08.611122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:08.612621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:08.612640Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:08.612643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:08.612647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:08.612655Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1648 [1:7556534486677229559:7933]
2025-10-02T08:13:08.612667Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:08.612687Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:08.612690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.612693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.612695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.612711Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:08.612716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:08.612722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:08.612772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.612780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.612782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:08.612784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:08.612871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:08.612881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.612890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.612897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:08.612910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534486677229553:7933]
2025-10-02T08:13:08.612912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534486677229553:7933]
2025-10-02T08:13:08.612917Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:08.612929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:08.612938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:08.612941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:08.612929Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:08.612945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:08.612980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677229434:7932], now have 1 active actors on pipe
2025-10-02T08:13:08.612982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1648
2025-10-02T08:13:08.612988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534486677229553:7933]
2025-10-02T08:13:08.612990Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:08.612994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:08.612996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534487137001131:2378], now have 1 active actors on pipe
2025-10-02T08:13:08.613000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.613004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.613073Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1648
2025-10-02T08:13:08.613325Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:08.613343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.613347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.613349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:08.613359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.613370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:08.613397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:08.613466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.613474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.613488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:08.613524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1649 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0
2025-10-02T08:13:08.613884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e08856c-b0e5fee9-b1ae77de-7b04940b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:08.616767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0] Write session: try to update token
2025-10-02T08:13:08.616785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:08.632847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId: src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:08.634223Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:08.634239Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:08.634242Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:08.634250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534486677229553:7933]
2025-10-02T08:13:08.634254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534486677229553:7933]
2025-10-02T08:13:08.634301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:08.634307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.634310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:08.634314Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:08.634320Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:08.634454Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:08.635647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:08.679004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534486677229586:8815]
2025-10-02T08:13:08.679125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1648, pipe: [1:7556534486677229586:8815]
2025-10-02T08:13:08.778063Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:08.778625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.778643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.778674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677229586:8815], now have 1 active actors on pipe
2025-10-02T08:13:08.778866Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:08.779359Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:08.779653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:08.779704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1649 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0
2025-10-02T08:13:08.779862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1649 sessionId: src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0 is DEAD
2025-10-02T08:13:08.780016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:08.780008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534486677229586:8815]
2025-10-02T08:13:08.780031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0] Write session will restart in 0.009918s
2025-10-02T08:13:08.780057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0] Write session: Do CDS request
2025-10-02T08:13:08.780064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:08.791321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.791415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:08.791431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1650
2025-10-02T08:13:08.791581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.791613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:08.791622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:08.791625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:08.792230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1650 sessionId:  describe result for acl check
2025-10-02T08:13:08.792270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:08.792272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:08.792273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:08.792278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534486677230066:7896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:08.792892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534486677230066:7896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:08.795112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:08.796451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534486677230066:7896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:08.797181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:08.797351Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:08.797360Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:08.797370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:08.797421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:08.797455Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534486677230131:7895]
2025-10-02T08:13:08.798112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:08.798372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:08.798418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:08.798736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:08.798785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.798791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.798792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.798793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.798794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.798800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.798810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.798814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.798818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.798822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.798827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.798835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:08.798841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.798847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:08.798851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.798856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:08.798861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.798866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.798873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.798883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.798903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:08.805275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534486677230066:7896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:08.805291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534486677230066:7896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:08.805294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534486677230066:7896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:08.805302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:08.808258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:08.810083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:08.810099Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:08.810101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:08.810104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:08.810110Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1649 [1:7556534486677230131:7895]
2025-10-02T08:13:08.810120Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:08.810137Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:08.810140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.810142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.810144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.810158Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:08.810161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:08.810166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:08.810206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.810213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.810215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:08.810216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:08.810273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:08.810279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.810287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:08.810298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:08.810324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1649
2025-10-02T08:13:08.810331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677230159:7896], now have 1 active actors on pipe
2025-10-02T08:13:08.810337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534486677230114:7895]
2025-10-02T08:13:08.810339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534486677230114:7895]
2025-10-02T08:13:08.810349Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:08.810361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534487137001141:2378], now have 1 active actors on pipe
2025-10-02T08:13:08.810364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:08.810367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:08.810370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.810374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.810389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:08.810399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:08.810404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:08.810398Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1649
2025-10-02T08:13:08.810434Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:08.810443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.810446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.810447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:08.810453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.810459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:08.810464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534486677230114:7895]
2025-10-02T08:13:08.810473Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:08.810486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:08.810497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:08.810587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.810593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.810604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:08.810634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1650 partition: 0 MaxSeqNo: 17 sessionId: src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0
2025-10-02T08:13:08.810927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4d4f1b-b963be11-86eb6e22-28af8492_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:08.813540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0] Write session: try to update token
2025-10-02T08:13:08.813558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:08.821943Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:08.821967Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:08.821976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534486677230114:7895]
2025-10-02T08:13:08.822018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:08.822020Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:08.822235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:08.822393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:08.822538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:08.822690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:08.822892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:08.822934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:08.827982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId: src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:08.830808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:08.830875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.830883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.830919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:08.830941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:08.830975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:08.830988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:08.831158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.831221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.831285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.831356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.831695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.831705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.831773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.831833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.831905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.831972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.832014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.832022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.832090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.832163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.832258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.832332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.832386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.832393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.832472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.832548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.832627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.832699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.832755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.832762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.832860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.832931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.833009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.833083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.833142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.833149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.833226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.833296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.833379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.833460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.833517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.833523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.833609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.833689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.833773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.833855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.833905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.833911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.833986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.834040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.834105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.834171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.834246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.834251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.834322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.834384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.834447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.834512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.834574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.834582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.834688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:08.834757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:08.834814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:08.834876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:08.834930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:08.834951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:08.834994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:08.835059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:08.835075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:08.835081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:08.835111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:08.835129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:08.835136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:08.835140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:08.835143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:08.835533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:08.835555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:08.835559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:08.835562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:08.835564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:08.835565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:08.836252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:08.836271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:08.836276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:08.836278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:08.836280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:08.836282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:08.836877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:08.836897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:08.836901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:08.836905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:08.836907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:08.838082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:08.838099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:08.838112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392788837
2025-10-02T08:13:08.838215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:08.838231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:08.838234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:08.838239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:08.838243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:08.838246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:08.838740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:08.838763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:08.838768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:08.838770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:08.838773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:08.838775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:08.839232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:08.839255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:08.839262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:08.839265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:08.839272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:08.839274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:08.839708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:08.839727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:08.839733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:08.840852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:08.840865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:08.840869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:08.840873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:08.840879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392788840
2025-10-02T08:13:08.841139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:08.841158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:08.841164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:08.841170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:08.841172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:08.841175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:08.841578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:08.841596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:08.841600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:08.841603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:08.841605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:08.841607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:08.842029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:08.842049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:08.842122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392788841
2025-10-02T08:13:08.842816Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:08.842832Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:08.842839Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:08.842845Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:08.844407Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:08.844417Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:08.844419Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:08.844428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534486677230114:7895]
2025-10-02T08:13:08.844432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534486677230114:7895]
2025-10-02T08:13:08.844476Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:08.844486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:08.844486Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:08.844491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:08.844493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:08.844625Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:08.880200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534486677230192:8815]
2025-10-02T08:13:08.880373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1649, pipe: [1:7556534486677230192:8815]
2025-10-02T08:13:08.987022Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:08.987365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534486677230192:8815], now have 1 active actors on pipe
2025-10-02T08:13:08.987499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534486677230192:8815]
2025-10-02T08:13:08.987530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:08.987533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:08.987562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1650 reason: error at write: Disconnected sessionId: src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0
2025-10-02T08:13:08.987586Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:08.987679Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:08.987725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1650 sessionId: src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0 is DEAD
2025-10-02T08:13:08.988053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:08.988060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0] Write session will restart in 0.007961s
2025-10-02T08:13:08.988083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0] Write session: Do CDS request
2025-10-02T08:13:08.988089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:08.997252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.997291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:08.997304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1651
2025-10-02T08:13:08.997447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:08.997476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:08.997486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:08.997489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:08.997882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1651 sessionId:  describe result for acl check
2025-10-02T08:13:08.997914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:08.997915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:08.997916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:08.997919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534486677230572:7866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:08.998361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534486677230572:7866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:09.000611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534486677230572:7866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:09.003520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534486677230572:7866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:09.003534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534486677230572:7866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:09.003537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534486677230572:7866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:09.003545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:09.004669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:09.005945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:09.006121Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:09.006136Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:09.006146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:09.006199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:09.006228Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534490972198041:7865]
2025-10-02T08:13:09.006834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:09.007064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:09.007114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:09.007446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:09.007500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.007511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.007512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.007513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.007515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.007519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.007530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.007534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.007538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.007543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.007549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.007556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.007562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.007567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.007572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.007577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.007581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.007586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.007591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.007596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.007620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:09.016282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:09.018045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:09.018062Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:09.018065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:09.018068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:09.018075Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1650 [1:7556534490972198041:7865]
2025-10-02T08:13:09.018087Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:09.018104Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:09.018106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.018110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.018112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.018128Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:09.018138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:09.018145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:09.018204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.018211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.018214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:09.018217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:09.018281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:09.018290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.018303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.018315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:09.018330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1650
2025-10-02T08:13:09.018334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972198032:7866], now have 1 active actors on pipe
2025-10-02T08:13:09.018340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534490972198035:7865]
2025-10-02T08:13:09.018342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534490972198035:7865]
2025-10-02T08:13:09.018350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:09.018359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.018361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:09.018363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.018364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:09.018383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:09.018396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:09.018405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:09.018410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534487137001170:2378], now have 1 active actors on pipe
2025-10-02T08:13:09.018450Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24308010-458c95f8-2536bd7-33907f4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:09.018464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.018469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.018470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:09.018483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.018491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:09.018810Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1650
2025-10-02T08:13:09.018501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534490972198035:7865]
2025-10-02T08:13:09.018507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:09.018518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:09.018533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.018837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.018844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.018869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.018914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1651 partition: 0 MaxSeqNo: 17 sessionId: src_id|24308010-458c95f8-2536bd7-33907f4d_0
2025-10-02T08:13:09.019281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efb310c0-6b0022f2-3293d57d-c51d0626_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|24308010-458c95f8-2536bd7-33907f4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:09.022430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24308010-458c95f8-2536bd7-33907f4d_0] Write session: try to update token
2025-10-02T08:13:09.022445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24308010-458c95f8-2536bd7-33907f4d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:09.038499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId: src_id|24308010-458c95f8-2536bd7-33907f4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:09.041766Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:09.041788Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:09.041791Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:09.041801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534490972198035:7865]
2025-10-02T08:13:09.041807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534490972198035:7865]
2025-10-02T08:13:09.041856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:09.041860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:09.041869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.041872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:09.041873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:09.042062Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:09.042072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:09.087588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534490972198067:8815]
2025-10-02T08:13:09.087752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1650, pipe: [1:7556534490972198067:8815]
2025-10-02T08:13:09.187886Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:09.188315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.188333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.188374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972198067:8815], now have 1 active actors on pipe
2025-10-02T08:13:09.188523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534490972198067:8815]
2025-10-02T08:13:09.188545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:09.188547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:09.188598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1651 reason: error at write: Disconnected sessionId: src_id|24308010-458c95f8-2536bd7-33907f4d_0
2025-10-02T08:13:09.188636Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:09.188770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1651 sessionId: src_id|24308010-458c95f8-2536bd7-33907f4d_0 is DEAD
2025-10-02T08:13:09.188819Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:09.188933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24308010-458c95f8-2536bd7-33907f4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:09.188945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24308010-458c95f8-2536bd7-33907f4d_0] Write session will restart in 0.008787s
2025-10-02T08:13:09.188973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24308010-458c95f8-2536bd7-33907f4d_0] Write session: Do CDS request
2025-10-02T08:13:09.188980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24308010-458c95f8-2536bd7-33907f4d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:09.199300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24308010-458c95f8-2536bd7-33907f4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:09.199429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:09.199445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1652
2025-10-02T08:13:09.199576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:09.199607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:09.199617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:09.199620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:09.200107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1652 sessionId:  describe result for acl check
2025-10-02T08:13:09.200140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:09.200146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:09.200148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:09.200153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534490972198446:7853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:09.200697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534490972198446:7853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:09.205080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534490972198446:7853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:09.210702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:09.211746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534490972198446:7853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:09.211760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534490972198446:7853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:09.211764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534490972198446:7853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:09.211773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:09.213014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:09.213379Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:09.213391Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:09.213403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:09.213468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:09.213528Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534490972198612:7855]
2025-10-02T08:13:09.214222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:09.214431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:09.214479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:09.214784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:09.214842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.214848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.214849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.214851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.214852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.214857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.214868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.214872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.214876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.214880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.214886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.214908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.214918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.214923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.214928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.214934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.214939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.214944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.214955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.214960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.214984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:09.223423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:09.225228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:09.225246Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:09.225248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:09.225251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:09.225258Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1651 [1:7556534490972198612:7855]
2025-10-02T08:13:09.225266Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:09.225281Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:09.225284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.225286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.225287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.225299Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:09.225303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:09.225307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:09.225352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.225358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.225361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:09.225364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:09.225428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:09.225434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.225448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.225618Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1651
2025-10-02T08:13:09.225463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:09.225487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534490972198600:7855]
2025-10-02T08:13:09.225489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534490972198600:7855]
2025-10-02T08:13:09.225496Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:09.225508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972198608:7853], now have 1 active actors on pipe
2025-10-02T08:13:09.225512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:09.225515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:09.225518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:09.225530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:09.225533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:09.225538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534491431968475:2378], now have 1 active actors on pipe
2025-10-02T08:13:09.225566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534490972198600:7855]
2025-10-02T08:13:09.225568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:09.225573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1651
2025-10-02T08:13:09.225608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:09.225610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.225615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.225638Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62890273-7998df34-c5ba7d86-d6c67824_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:09.225644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.225647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.225650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:09.225658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.225667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:09.225687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.225716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.226053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24308010-458c95f8-2536bd7-33907f4d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|62890273-7998df34-c5ba7d86-d6c67824_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:09.225718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.225729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.225763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1652 partition: 0 MaxSeqNo: 17 sessionId: src_id|62890273-7998df34-c5ba7d86-d6c67824_0
2025-10-02T08:13:09.228786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62890273-7998df34-c5ba7d86-d6c67824_0] Write session: try to update token
2025-10-02T08:13:09.228824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62890273-7998df34-c5ba7d86-d6c67824_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:09.244052Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:09.244072Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:09.244074Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:09.244082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534490972198600:7855]
2025-10-02T08:13:09.244086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534490972198600:7855]
2025-10-02T08:13:09.244132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:09.244138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.244141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:09.244139Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:09.244146Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:09.244299Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:09.257812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId: src_id|62890273-7998df34-c5ba7d86-d6c67824_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:09.260378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:09.288956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534490972198638:8815]
2025-10-02T08:13:09.289143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1651, pipe: [1:7556534490972198638:8815]
2025-10-02T08:13:09.389778Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:09.390217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.390229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.390254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972198638:8815], now have 1 active actors on pipe
2025-10-02T08:13:09.390565Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:09.390584Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:09.391032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534490972198638:8815]
2025-10-02T08:13:09.391062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:09.391114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1652 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62890273-7998df34-c5ba7d86-d6c67824_0
2025-10-02T08:13:09.391300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1652 sessionId: src_id|62890273-7998df34-c5ba7d86-d6c67824_0 is DEAD
2025-10-02T08:13:09.391459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62890273-7998df34-c5ba7d86-d6c67824_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:09.391469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62890273-7998df34-c5ba7d86-d6c67824_0] Write session will restart in 0.008614s
2025-10-02T08:13:09.391506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62890273-7998df34-c5ba7d86-d6c67824_0] Write session: Do CDS request
2025-10-02T08:13:09.391513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62890273-7998df34-c5ba7d86-d6c67824_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:09.401263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62890273-7998df34-c5ba7d86-d6c67824_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:09.401394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:09.401411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1653
2025-10-02T08:13:09.401612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:09.401644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:09.401651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:09.401654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:09.402065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1653 sessionId:  describe result for acl check
2025-10-02T08:13:09.402103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:09.402109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:09.402110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:09.402116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534490972198680:7834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:09.402655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534490972198680:7834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:09.406149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534490972198680:7834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:09.409426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534490972198680:7834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:09.409444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534490972198680:7834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:09.409447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534490972198680:7834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:09.409455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:09.418464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:09.420122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:09.420348Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:09.420360Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:09.420370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:09.420422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:09.420464Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534490972199189:7837]
2025-10-02T08:13:09.421177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:09.421951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:09.422001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:09.422333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:09.422379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.422385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.422387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.422388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.422389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.422395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.422409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.422413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.422423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.422427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.422434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.422446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.422452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.422458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.422464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.422474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.422479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.422489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.422498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.422504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.422529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:09.431436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:09.433916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:09.433950Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:09.433952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:09.433956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:09.433963Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1652 [1:7556534490972199189:7837]
2025-10-02T08:13:09.433978Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:09.433997Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:09.434000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.434003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.434005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.434020Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:09.434031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:09.434038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:09.434110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.434117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.434121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:09.434124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:09.434189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:09.434196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.434210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.434224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:09.434246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1652
2025-10-02T08:13:09.434247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972199077:7834], now have 1 active actors on pipe
2025-10-02T08:13:09.434254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534490972199183:7837]
2025-10-02T08:13:09.434256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534490972199183:7837]
2025-10-02T08:13:09.434268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:09.434279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534491431968493:2378], now have 1 active actors on pipe
2025-10-02T08:13:09.434283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:09.434284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.434286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:09.434288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.434304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:09.434322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:09.434325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:09.434339Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1652
2025-10-02T08:13:09.434365Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:09.434376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.434379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.434381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:09.434389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.434396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:09.434403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534490972199183:7837]
2025-10-02T08:13:09.434410Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:09.434416Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:09.434447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.434518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.434525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.434539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.434578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1653 partition: 0 MaxSeqNo: 17 sessionId: src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0
2025-10-02T08:13:09.434913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62890273-7998df34-c5ba7d86-d6c67824_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:09.437679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0] Write session: try to update token
2025-10-02T08:13:09.437695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:09.454837Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:09.454855Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:09.454857Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:09.454866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534490972199183:7837]
2025-10-02T08:13:09.454871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534490972199183:7837]
2025-10-02T08:13:09.454911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:09.454917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.454917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:09.454920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:09.454924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:09.455067Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:09.458579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId: src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:09.461457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:09.493955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534490972199225:8815]
2025-10-02T08:13:09.494245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1652, pipe: [1:7556534490972199225:8815]
2025-10-02T08:13:09.630304Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:09.630807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.630821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.630860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972199225:8815], now have 1 active actors on pipe
2025-10-02T08:13:09.630966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:09.630976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:09.631051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1653 reason: error at write: Disconnected sessionId: src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0
2025-10-02T08:13:09.631066Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:09.631215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1653 sessionId: src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0 is DEAD
2025-10-02T08:13:09.631376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:09.631386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0] Write session will restart in 0.007491s
2025-10-02T08:13:09.631409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0] Write session: Do CDS request
2025-10-02T08:13:09.631415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:09.631392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534490972199225:8815]
2025-10-02T08:13:09.631100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:09.640373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:09.640481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:09.640496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1654
2025-10-02T08:13:09.640608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:09.640648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:09.640658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:09.640662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:09.641068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1654 sessionId:  describe result for acl check
2025-10-02T08:13:09.641100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:09.641106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:09.641108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:09.641112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534490972199587:7812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:09.641604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534490972199587:7812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:09.643686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534490972199587:7812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:09.647385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534490972199587:7812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:09.647408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534490972199587:7812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:09.647412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534490972199587:7812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:09.647421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:09.648187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:09.649782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:09.650039Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:09.650049Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:09.650057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:09.650109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:09.650142Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534490972199786:7821]
2025-10-02T08:13:09.650857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:09.651046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:09.651081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:09.651401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:09.651436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.651442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.651443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.651444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.651445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.651450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.651460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.651464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.651468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.651472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.651478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.651485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.651490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.651495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.651499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.651509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.651514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.651519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.651523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.651533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.651551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:09.659893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:09.661408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:09.661423Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:09.661426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:09.661429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:09.661436Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1653 [1:7556534490972199786:7821]
2025-10-02T08:13:09.661447Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:09.661464Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:09.661467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.661470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.661472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.661487Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:09.661492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:09.661498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:09.661559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.661566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.661569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:09.661572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:09.661632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:09.661640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.661652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.661664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:09.661682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972199771:7812], now have 1 active actors on pipe
2025-10-02T08:13:09.661688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534490972199780:7821]
2025-10-02T08:13:09.661690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534490972199780:7821]
2025-10-02T08:13:09.661692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1653
2025-10-02T08:13:09.661700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:09.661711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534491431968501:2378], now have 1 active actors on pipe
2025-10-02T08:13:09.661711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:09.661715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:09.661716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:09.661728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:09.661731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:09.661737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.661741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.661774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534490972199780:7821]
2025-10-02T08:13:09.661786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:09.661795Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:09.661800Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:09.661805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.661811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.661813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:09.661825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.661831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:09.661824Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1653
2025-10-02T08:13:09.661863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.661950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.661960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.661973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.662011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1654 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0
2025-10-02T08:13:09.662370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e54aa4-e29e2d20-f62ae95e-b1f3378d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:09.664890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0] Write session: try to update token
2025-10-02T08:13:09.664902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:09.678423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId: src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:09.680905Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:09.680927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:09.680929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:09.680941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534490972199780:7821]
2025-10-02T08:13:09.680945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534490972199780:7821]
2025-10-02T08:13:09.680967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:09.680989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:09.680990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:09.680995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.680995Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:09.680997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:09.681140Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:09.731135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534490972199812:8815]
2025-10-02T08:13:09.731250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1653, pipe: [1:7556534490972199812:8815]
2025-10-02T08:13:09.830382Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:09.830692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.830708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.830977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:09.830751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972199812:8815], now have 1 active actors on pipe
2025-10-02T08:13:09.830842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:09.830844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:09.830902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1654 reason: error at write: Disconnected sessionId: src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0
2025-10-02T08:13:09.831116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1654 sessionId: src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0 is DEAD
2025-10-02T08:13:09.831259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:09.831268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0] Write session will restart in 0.006096s
2025-10-02T08:13:09.831301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0] Write session: Do CDS request
2025-10-02T08:13:09.831308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:09.831442Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:09.831889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534490972199812:8815]
2025-10-02T08:13:09.838260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:09.838337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:09.838352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1655
2025-10-02T08:13:09.838441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:09.838466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:09.838473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:09.838476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:09.838997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1655 sessionId:  describe result for acl check
2025-10-02T08:13:09.839028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:09.839033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:09.839035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:09.839039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534490972200127:7796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:09.839745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534490972200127:7796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:09.842047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534490972200127:7796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:09.844836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534490972200127:7796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:09.844864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534490972200127:7796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:09.844867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534490972200127:7796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:09.844875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:09.846422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:09.847840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:09.848235Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:09.848243Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:09.848255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:09.848307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:09.848344Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534490972200393:7790]
2025-10-02T08:13:09.848799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:09.848987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:09.849024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:09.849288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:09.849331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.849335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.849337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.849338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.849339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.849344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.849355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.849362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.849366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.849370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.849375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.849385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:09.849393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.849402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:09.849406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.849411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:09.849414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.849419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.849423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.849428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.849445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:09.859356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:09.861295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:09.861316Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:09.861318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:09.861322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:09.861329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1654 [1:7556534490972200393:7790]
2025-10-02T08:13:09.861340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:09.861359Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:09.861366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.861368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.861371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.861386Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:09.861394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:09.861400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:09.861458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.861468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.861471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:09.861473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:09.861533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:09.861541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.861551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:09.861566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:09.861586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534490972200387:7790]
2025-10-02T08:13:09.861592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534490972200387:7790]
2025-10-02T08:13:09.861599Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:09.861606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1654
2025-10-02T08:13:09.861614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:09.861617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972200372:7796], now have 1 active actors on pipe
2025-10-02T08:13:09.861618Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:09.861626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:09.861638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:09.861645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:09.861651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534491431968510:2378], now have 1 active actors on pipe
2025-10-02T08:13:09.861656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.861660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.861699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534490972200387:7790]
2025-10-02T08:13:09.861712Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:09.861732Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1654
2025-10-02T08:13:09.861731Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:09.861742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:09.861747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:09.861749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:09.861759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:09.861762Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:09.861768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:09.861804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.861875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:09.861882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:09.861896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:09.861939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1655 partition: 0 MaxSeqNo: 17 sessionId: src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0
2025-10-02T08:13:09.862286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0bd51-41fa2abd-1797f4ee-e59dfeca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:09.872108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0] Write session: try to update token
2025-10-02T08:13:09.872130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:09.882500Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:09.882522Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:09.882525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:09.882535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534490972200387:7790]
2025-10-02T08:13:09.882539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534490972200387:7790]
2025-10-02T08:13:09.882585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:09.882601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:09.882600Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:09.882603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:09.882607Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:09.882744Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:09.887012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId: src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:09.896229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:09.931839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534490972200426:8815]
2025-10-02T08:13:09.931920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1654, pipe: [1:7556534490972200426:8815]
2025-10-02T08:13:10.034744Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:10.035281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.035297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.035318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534490972200426:8815], now have 1 active actors on pipe
2025-10-02T08:13:10.035525Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:10.035542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534490972200426:8815]
2025-10-02T08:13:10.035529Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:10.035561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:10.035627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0
2025-10-02T08:13:10.035800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1655 sessionId: src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0 is DEAD
2025-10-02T08:13:10.035926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:10.035931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0] Write session will restart in 0.009122s
2025-10-02T08:13:10.035962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0] Write session: Do CDS request
2025-10-02T08:13:10.035967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:10.046247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.046331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:10.046349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1656
2025-10-02T08:13:10.046469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.046500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:10.046509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:10.046512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:10.046844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1656 sessionId:  describe result for acl check
2025-10-02T08:13:10.046874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:10.046879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:10.046880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:10.046883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534495267168216:7770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:10.047279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534495267168216:7770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:10.048975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:10.049650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534495267168216:7770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:10.050549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:10.050763Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:10.050772Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:10.050782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:10.050827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:10.050864Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534495267168280:7769]
2025-10-02T08:13:10.051482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:10.051655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:10.051718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:10.052043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:10.052086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.052092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.052093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.052094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.052095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.052101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.052111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.052120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.052124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.052128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.052133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.052144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.052151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.052156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.052163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.052179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.052187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.052193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.052198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.052202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.052221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:10.052392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534495267168216:7770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:10.052404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534495267168216:7770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:10.052408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534495267168216:7770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:10.052415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:10.059748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:10.061326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:10.061342Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:10.061345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:10.061349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:10.061355Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1655 [1:7556534495267168280:7769]
2025-10-02T08:13:10.061367Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:10.061389Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:10.061397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.061400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.061402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.061419Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:10.061429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:10.061436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:10.061493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.061501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.061504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:10.061506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:10.061569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:10.061576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.061588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.061605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:10.061615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1655
2025-10-02T08:13:10.061627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267168297:7770], now have 1 active actors on pipe
2025-10-02T08:13:10.061630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534495726935835:2378], now have 1 active actors on pipe
2025-10-02T08:13:10.061634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.061644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.061660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534495267168264:7769]
2025-10-02T08:13:10.061667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534495267168264:7769]
2025-10-02T08:13:10.061683Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:10.061700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:10.061707Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:10.061710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:10.061719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:10.061690Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1655
2025-10-02T08:13:10.061723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:10.061743Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1478e58e-8578617b-358a9285-34e01da2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:10.061748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.061752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.061754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:10.061764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.061782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:10.061825Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534495267168264:7769]
2025-10-02T08:13:10.061836Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:10.061842Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:10.061857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.061934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.061942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.061955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.061993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1656 partition: 0 MaxSeqNo: 17 sessionId: src_id|1478e58e-8578617b-358a9285-34e01da2_0
2025-10-02T08:13:10.062316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76d7d1f-9050cd1d-1a3323b4-870a4cec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1478e58e-8578617b-358a9285-34e01da2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:10.064993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1478e58e-8578617b-358a9285-34e01da2_0] Write session: try to update token
2025-10-02T08:13:10.065007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1478e58e-8578617b-358a9285-34e01da2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:10.078278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId: src_id|1478e58e-8578617b-358a9285-34e01da2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:10.079246Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:10.079266Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:10.079268Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:10.079276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534495267168264:7769]
2025-10-02T08:13:10.079280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534495267168264:7769]
2025-10-02T08:13:10.079328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:10.079338Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:10.079341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.079343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:10.079344Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:10.079478Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:10.081032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:10.135663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534495267168312:8815]
2025-10-02T08:13:10.135784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1655, pipe: [1:7556534495267168312:8815]
2025-10-02T08:13:10.225766Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:10.226185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.226208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.226254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267168312:8815], now have 1 active actors on pipe
2025-10-02T08:13:10.226365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:10.226373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:10.226432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1656 reason: error at write: Disconnected sessionId: src_id|1478e58e-8578617b-358a9285-34e01da2_0
2025-10-02T08:13:10.226478Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:10.226452Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:10.226635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1656 sessionId: src_id|1478e58e-8578617b-358a9285-34e01da2_0 is DEAD
2025-10-02T08:13:10.226775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1478e58e-8578617b-358a9285-34e01da2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:10.226795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1478e58e-8578617b-358a9285-34e01da2_0] Write session will restart in 0.007309s
2025-10-02T08:13:10.226785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534495267168312:8815]
2025-10-02T08:13:10.226819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1478e58e-8578617b-358a9285-34e01da2_0] Write session: Do CDS request
2025-10-02T08:13:10.226826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1478e58e-8578617b-358a9285-34e01da2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:10.235243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1478e58e-8578617b-358a9285-34e01da2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.235356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:10.235373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1657
2025-10-02T08:13:10.235502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.235548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:10.235557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:10.235577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:10.235991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1657 sessionId:  describe result for acl check
2025-10-02T08:13:10.236025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:10.236027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:10.236028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:10.236034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534495267168664:7757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:10.236588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534495267168664:7757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:10.238821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534495267168664:7757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:10.242424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534495267168664:7757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:10.242453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534495267168664:7757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:10.242458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534495267168664:7757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:10.242466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:10.246334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:10.246741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:10.246910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:10.246918Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:10.246927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:10.246966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:10.246999Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534495267168869:7758]
2025-10-02T08:13:10.247642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:10.247792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:10.247826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:10.248103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:10.248142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.248147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.248148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.248149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.248150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.248155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.248164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.248179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.248183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.248187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.248192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.248198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.248203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.248208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.248212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.248217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.248221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.248226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.248235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.248240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.248257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:10.256216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:10.258111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:10.258126Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:10.258129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:10.258132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:10.258138Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1656 [1:7556534495267168869:7758]
2025-10-02T08:13:10.258152Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:10.258168Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:10.258171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.258174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.258176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.258190Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:10.258195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:10.258201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:10.258258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.258265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.258268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:10.258271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:10.258333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:10.258340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.258353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.258367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:10.258383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534495267168863:7758]
2025-10-02T08:13:10.258390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534495267168863:7758]
2025-10-02T08:13:10.258396Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:10.258407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:10.258410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:10.258412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:10.258424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:10.258430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:10.258439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267168840:7757], now have 1 active actors on pipe
2025-10-02T08:13:10.258442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534495726935843:2378], now have 1 active actors on pipe
2025-10-02T08:13:10.258459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1656
2025-10-02T08:13:10.258471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534495267168863:7758]
2025-10-02T08:13:10.258482Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:10.258490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.258494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.258502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:10.258534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81cebfca-a40d1958-8bc64564-9648da5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:10.258545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.258549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.258551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:10.258559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.258567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:10.258588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.258621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.258627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.258639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.258672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1657 partition: 0 MaxSeqNo: 17 sessionId: src_id|81cebfca-a40d1958-8bc64564-9648da5e_0
2025-10-02T08:13:10.258770Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1656
2025-10-02T08:13:10.259015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1478e58e-8578617b-358a9285-34e01da2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|81cebfca-a40d1958-8bc64564-9648da5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:10.261674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cebfca-a40d1958-8bc64564-9648da5e_0] Write session: try to update token
2025-10-02T08:13:10.261689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cebfca-a40d1958-8bc64564-9648da5e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:10.275754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId: src_id|81cebfca-a40d1958-8bc64564-9648da5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:10.276071Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:10.276083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:10.276085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:10.276095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534495267168863:7758]
2025-10-02T08:13:10.276100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534495267168863:7758]
2025-10-02T08:13:10.276137Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:10.276143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:10.276148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.276150Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:10.276150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:10.276305Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:10.278355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:10.327130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534495267168893:8815]
2025-10-02T08:13:10.327237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1656, pipe: [1:7556534495267168893:8815]
2025-10-02T08:13:10.421825Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:10.422081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.422109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.422156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267168893:8815], now have 1 active actors on pipe
2025-10-02T08:13:10.422270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:10.422277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:10.422339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1657 reason: error at write: Disconnected sessionId: src_id|81cebfca-a40d1958-8bc64564-9648da5e_0
2025-10-02T08:13:10.422426Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:10.422504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1657 sessionId: src_id|81cebfca-a40d1958-8bc64564-9648da5e_0 is DEAD
2025-10-02T08:13:10.422641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534495267168893:8815]
2025-10-02T08:13:10.422659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cebfca-a40d1958-8bc64564-9648da5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:10.422668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cebfca-a40d1958-8bc64564-9648da5e_0] Write session will restart in 0.005272s
2025-10-02T08:13:10.422690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cebfca-a40d1958-8bc64564-9648da5e_0] Write session: Do CDS request
2025-10-02T08:13:10.422698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cebfca-a40d1958-8bc64564-9648da5e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:10.422722Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:10.429798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cebfca-a40d1958-8bc64564-9648da5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.429905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:10.429916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1658
2025-10-02T08:13:10.430131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.430168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:10.430171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:10.430174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:10.430582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1658 sessionId:  describe result for acl check
2025-10-02T08:13:10.430605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:10.430606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:10.430607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:10.430610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534495267169156:7735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:10.431030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534495267169156:7735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:10.434072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534495267169156:7735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:10.437424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534495267169156:7735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:10.437437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534495267169156:7735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:10.437440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534495267169156:7735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:10.437448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:10.444753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:10.446952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:10.447160Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:10.447164Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:10.447173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:10.447219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:10.447253Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534495267169454:7726]
2025-10-02T08:13:10.447933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:10.448094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:10.448137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:10.448481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:10.448527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.448533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.448534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.448536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.448537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.448542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.448553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.448558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.448563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.448567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.448573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.448581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.448587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.448593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.448598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.448603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.448608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.448614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.448620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.448626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.448646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:10.461207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:10.462718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:10.462738Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:10.462741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:10.462745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:10.462751Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1657 [1:7556534495267169454:7726]
2025-10-02T08:13:10.462768Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:10.462786Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:10.462799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.462802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.462804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.462821Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:10.462827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:10.462833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:10.462891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.462893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.462896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:10.462899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:10.462967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:10.462969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.462983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.462997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:10.463013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534495267169448:7726]
2025-10-02T08:13:10.463016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534495267169448:7726]
2025-10-02T08:13:10.463028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:10.463040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:10.463056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:10.463059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:10.463089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534495267169448:7726]
2025-10-02T08:13:10.463092Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:10.463179Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:10.463182Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:10.463187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:10.463348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1657
2025-10-02T08:13:10.463360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267169328:7735], now have 1 active actors on pipe
2025-10-02T08:13:10.463374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534495726935861:2378], now have 1 active actors on pipe
2025-10-02T08:13:10.463379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.463384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.463408Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:10.463414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.463417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.463419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:10.463427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.463437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:10.463448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.463468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.463470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.463479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.463502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1658 partition: 0 MaxSeqNo: 17 sessionId: src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0
2025-10-02T08:13:10.463803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cebfca-a40d1958-8bc64564-9648da5e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:10.463693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1657
2025-10-02T08:13:10.466389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0] Write session: try to update token
2025-10-02T08:13:10.466405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:10.480226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId: src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:10.483731Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:10.483747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:10.483749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:10.483757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534495267169448:7726]
2025-10-02T08:13:10.483762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534495267169448:7726]
2025-10-02T08:13:10.483806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:10.483812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.483814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:10.483963Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:10.484515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:10.484612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:10.484633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:10.522892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534495267169490:8815]
2025-10-02T08:13:10.523046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1657, pipe: [1:7556534495267169490:8815]
2025-10-02T08:13:10.618600Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:10.618885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.618896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.618930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267169490:8815], now have 1 active actors on pipe
2025-10-02T08:13:10.619060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534495267169490:8815]
2025-10-02T08:13:10.619078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:10.619080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:10.619126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1658 reason: error at write: Disconnected sessionId: src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0
2025-10-02T08:13:10.619155Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:10.619197Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:10.619452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:10.619463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0] Write session will restart in 0.005226s
2025-10-02T08:13:10.619487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0] Write session: Do CDS request
2025-10-02T08:13:10.619496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:10.619309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1658 sessionId: src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0 is DEAD
2025-10-02T08:13:10.626294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.626377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:10.626393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1659
2025-10-02T08:13:10.626601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.626637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:10.626642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:10.626646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:10.627051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1659 sessionId:  describe result for acl check
2025-10-02T08:13:10.627086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:10.627098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:10.627099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:10.627104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534495267169763:7729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:10.627619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534495267169763:7729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:10.630807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534495267169763:7729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:10.634431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534495267169763:7729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:10.634449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534495267169763:7729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:10.634452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534495267169763:7729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:10.634459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:10.637215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:10.639209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:10.639456Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:10.639467Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:10.639477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:10.639526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:10.639564Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534495267170054:7731]
2025-10-02T08:13:10.640223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:10.640404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:10.640446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:10.640750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:10.640793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.640798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.640814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.640815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.640816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.640821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.640831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.640835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.640839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.640843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.640849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.640861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.640866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.640871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.640875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.640880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.640890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.640895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.640904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.640909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.640934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:10.648759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:10.650598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:10.650615Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:10.650619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:10.650622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:10.650629Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1658 [1:7556534495267170054:7731]
2025-10-02T08:13:10.650640Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:10.650656Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:10.650663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.650666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.650668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.650683Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:10.650693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:10.650704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:10.650767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.650776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.650779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:10.650781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:10.650843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:10.650850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.650864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.650881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:10.650897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1658
2025-10-02T08:13:10.650903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267170010:7729], now have 1 active actors on pipe
2025-10-02T08:13:10.650906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534495726935868:2378], now have 1 active actors on pipe
2025-10-02T08:13:10.650912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534495267170048:7731]
2025-10-02T08:13:10.650914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534495267170048:7731]
2025-10-02T08:13:10.650927Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:10.650941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.650942Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:10.650945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:10.650945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.650963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:10.650982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:10.650989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:10.651028Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:10.651038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.651046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.651048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:10.651027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1658
2025-10-02T08:13:10.651068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.651081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:10.651088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534495267170048:7731]
2025-10-02T08:13:10.651098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:10.651107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:10.651127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.651181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.651188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.651200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.651237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1659 partition: 0 MaxSeqNo: 17 sessionId: src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0
2025-10-02T08:13:10.651584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a922c7d-61558f1e-b48a677b-643fca2c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:10.654179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0] Write session: try to update token
2025-10-02T08:13:10.654195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:10.668675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId: src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:10.669137Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:10.669153Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:10.669157Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:10.669166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534495267170048:7731]
2025-10-02T08:13:10.669170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534495267170048:7731]
2025-10-02T08:13:10.669218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:10.669225Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:10.669230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.669231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:10.669232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:10.669379Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:10.671428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:10.719294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534495267170078:8815]
2025-10-02T08:13:10.719408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1658, pipe: [1:7556534495267170078:8815]
2025-10-02T08:13:10.818434Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:10.818707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.818720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.818758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267170078:8815], now have 1 active actors on pipe
2025-10-02T08:13:10.818874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534495267170078:8815]
2025-10-02T08:13:10.818904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:10.818906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:10.818969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1659 reason: error at write: Disconnected sessionId: src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0
2025-10-02T08:13:10.818986Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:10.819114Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:10.819119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1659 sessionId: src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0 is DEAD
2025-10-02T08:13:10.819258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:10.819267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0] Write session will restart in 0.008227s
2025-10-02T08:13:10.819291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0] Write session: Do CDS request
2025-10-02T08:13:10.819297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:10.828272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.828426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:10.828439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1660
2025-10-02T08:13:10.828524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:10.828552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:10.828561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:10.828565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:10.828954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1660 sessionId:  describe result for acl check
2025-10-02T08:13:10.828988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:10.828991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:10.828993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:10.828997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534495267170480:7714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:10.829448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534495267170480:7714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:10.832198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534495267170480:7714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:10.834686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:10.836505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:10.836686Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:10.836695Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:10.836705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:10.836760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:10.836797Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534495267170638:7716]
2025-10-02T08:13:10.836976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534495267170480:7714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:10.837002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534495267170480:7714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:10.837006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534495267170480:7714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:10.837014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:10.837426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:10.837639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:10.837696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:10.838018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:10.838073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.838079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.838080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.838081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.838082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.838087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.838097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.838100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.838104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.838107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.838112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.838120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:10.838125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.838130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:10.838134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.838139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:10.838143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.838148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.838153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.838157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.838179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:10.846301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:10.848047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:10.848069Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:10.848071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:10.848075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:10.848082Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1659 [1:7556534495267170638:7716]
2025-10-02T08:13:10.848092Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:10.848108Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:10.848111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.848114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.848116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.848132Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:10.848136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:10.848142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:10.848210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.848217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.848221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:10.848223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:10.848285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:10.848293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.848305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:10.848329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:10.848348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267170643:7714], now have 1 active actors on pipe
2025-10-02T08:13:10.848358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534495726935877:2378], now have 1 active actors on pipe
2025-10-02T08:13:10.848366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534495267170632:7716]
2025-10-02T08:13:10.848368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534495267170632:7716]
2025-10-02T08:13:10.848385Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:10.848403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:10.848450Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1659
2025-10-02T08:13:10.848421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:10.848427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:10.848431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:10.848432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:10.848463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534495267170632:7716]
2025-10-02T08:13:10.848466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:10.848472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:10.848509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1659
2025-10-02T08:13:10.848580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.848590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.848612Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:10.848625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:10.848633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:10.848635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:10.848645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:10.848658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:10.848677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.848701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:10.848708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:10.848719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:10.848752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1660 partition: 0 MaxSeqNo: 17 sessionId: src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0
2025-10-02T08:13:10.849116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32008ceb-b7158ea9-703a2ba1-e5ccc404_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:10.851885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0] Write session: try to update token
2025-10-02T08:13:10.851904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:10.865980Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:10.866005Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:10.866008Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:10.866016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534495267170632:7716]
2025-10-02T08:13:10.866021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534495267170632:7716]
2025-10-02T08:13:10.866064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:10.866065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:10.866070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:10.866071Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:10.866072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:10.866214Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:10.878598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId: src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:10.881273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:10.918966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534495267170699:8815]
2025-10-02T08:13:10.919108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1659, pipe: [1:7556534495267170699:8815]
2025-10-02T08:13:11.000231Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:11.000571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.000582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.000600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534495267170699:8815], now have 1 active actors on pipe
2025-10-02T08:13:11.000742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:11.000754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:11.000770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:11.000838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1660 reason: error at write: Disconnected sessionId: src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0
2025-10-02T08:13:11.000848Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:11.001008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1660 sessionId: src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0 is DEAD
2025-10-02T08:13:11.001012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534495267170699:8815]
2025-10-02T08:13:11.001141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:11.001149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0] Write session will restart in 0.007518s
2025-10-02T08:13:11.001176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0] Write session: Do CDS request
2025-10-02T08:13:11.001183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:11.010283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.010354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:11.010369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1661
2025-10-02T08:13:11.010477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.010505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:11.010514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:11.010518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:11.010896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1661 sessionId:  describe result for acl check
2025-10-02T08:13:11.010922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:11.010928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:11.010930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:11.010934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534499562138399:7690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:11.011394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534499562138399:7690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:11.013960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534499562138399:7690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:11.016335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:11.018073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:11.018243Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:11.018250Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:11.018257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:11.018291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:11.018318Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534499562138560:7692]
2025-10-02T08:13:11.018438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534499562138399:7690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:11.018452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534499562138399:7690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:11.018456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534499562138399:7690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:11.018464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:11.018773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:11.018908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:11.018939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:11.019196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:11.019233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.019238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.019239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.019240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.019241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.019246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.019255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.019259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.019263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.019266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.019274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.019282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.019291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.019295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.019299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.019304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.019308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.019312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.019316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.019321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.019338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:11.027011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:11.028590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:11.028607Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:11.028609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:11.028612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:11.028617Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1660 [1:7556534499562138560:7692]
2025-10-02T08:13:11.028627Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:11.028642Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:11.028645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.028647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.028649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.028665Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:11.028674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:11.028680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:11.028732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.028742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.028745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:11.028747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:11.028821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:11.028831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.028843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.028853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1660
2025-10-02T08:13:11.028854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:11.028872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562138565:7690], now have 1 active actors on pipe
2025-10-02T08:13:11.028875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534500021903201:2378], now have 1 active actors on pipe
2025-10-02T08:13:11.028880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.028884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.028900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534499562138554:7692]
2025-10-02T08:13:11.028908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534499562138554:7692]
2025-10-02T08:13:11.028919Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:11.028936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:11.028938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:11.028941Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:11.028949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:11.028937Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1660
2025-10-02T08:13:11.028952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:11.028967Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23fe3f0a-9233260b-9ffe477b-be18908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:11.028974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.028978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.028980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:11.028989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.028997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:11.029025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534499562138554:7692]
2025-10-02T08:13:11.029039Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:11.029053Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:11.029057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.029132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.029140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.029155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.029189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1661 partition: 0 MaxSeqNo: 17 sessionId: src_id|23fe3f0a-9233260b-9ffe477b-be18908_0
2025-10-02T08:13:11.029488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|657f22f9-bcb13a68-21dee7f-bea49bf1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|23fe3f0a-9233260b-9ffe477b-be18908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:11.031878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fe3f0a-9233260b-9ffe477b-be18908_0] Write session: try to update token
2025-10-02T08:13:11.031908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fe3f0a-9233260b-9ffe477b-be18908_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:11.044904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId: src_id|23fe3f0a-9233260b-9ffe477b-be18908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:11.045793Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:11.045811Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:11.045814Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:11.045821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534499562138554:7692]
2025-10-02T08:13:11.045826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534499562138554:7692]
2025-10-02T08:13:11.045871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:11.045873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:11.045880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.045882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:11.045884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:11.046020Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:11.047487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:11.101288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534499562138592:8815]
2025-10-02T08:13:11.101427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1660, pipe: [1:7556534499562138592:8815]
2025-10-02T08:13:11.181619Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:11.181935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.181948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.181985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562138592:8815], now have 1 active actors on pipe
2025-10-02T08:13:11.182095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534499562138592:8815]
2025-10-02T08:13:11.182117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:11.182120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:11.182167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1661 reason: error at write: Disconnected sessionId: src_id|23fe3f0a-9233260b-9ffe477b-be18908_0
2025-10-02T08:13:11.182229Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:11.182275Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:11.182324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1661 sessionId: src_id|23fe3f0a-9233260b-9ffe477b-be18908_0 is DEAD
2025-10-02T08:13:11.182628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fe3f0a-9233260b-9ffe477b-be18908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:11.182635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fe3f0a-9233260b-9ffe477b-be18908_0] Write session will restart in 0.006737s
2025-10-02T08:13:11.182660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fe3f0a-9233260b-9ffe477b-be18908_0] Write session: Do CDS request
2025-10-02T08:13:11.182666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fe3f0a-9233260b-9ffe477b-be18908_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:11.190247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fe3f0a-9233260b-9ffe477b-be18908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.190311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:11.190326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1662
2025-10-02T08:13:11.190453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.190487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:11.190497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:11.190500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:11.190955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1662 sessionId:  describe result for acl check
2025-10-02T08:13:11.190984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:11.190989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:11.190991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:11.190995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534499562138952:7680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:11.191508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534499562138952:7680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:11.195091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534499562138952:7680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:11.197922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:11.198255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:11.198269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534499562138952:7680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:11.198275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534499562138952:7680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:11.198278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534499562138952:7680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:11.198284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:11.198417Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:11.198427Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:11.198436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:11.198478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:11.198513Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534499562139155:7682]
2025-10-02T08:13:11.199115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:11.199288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:11.199331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:11.199620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:11.199666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.199672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.199673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.199674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.199675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.199680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.199689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.199693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.199696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.199699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.199704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.199711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.199716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.199721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.199725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.199730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.199733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.199738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.199749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.199753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.199770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:11.207425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:11.209415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:11.209434Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:11.209437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:11.209441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:11.209448Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1661 [1:7556534499562139155:7682]
2025-10-02T08:13:11.209460Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:11.209479Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:11.209482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.209485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.209487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.209503Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:11.209509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:11.209516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:11.209589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.209601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.209604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:11.209607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:11.209679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:11.209691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.209704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.209716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:11.209728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1661
2025-10-02T08:13:11.209742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562139153:7680], now have 1 active actors on pipe
2025-10-02T08:13:11.209750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534500021903210:2378], now have 1 active actors on pipe
2025-10-02T08:13:11.209757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534499562139145:7682]
2025-10-02T08:13:11.209758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534499562139145:7682]
2025-10-02T08:13:11.209771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:11.209782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:11.209784Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:11.209786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.209790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.209809Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:11.209830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:11.209837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:11.209837Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1661
2025-10-02T08:13:11.209887Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|485ca180-61414e68-1aa02e68-9d31b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:11.209897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.209901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.209903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:11.209914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.209924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:11.209938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534499562139145:7682]
2025-10-02T08:13:11.209947Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:11.209956Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:11.209983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.210041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.210052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.210068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.210111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1662 partition: 0 MaxSeqNo: 17 sessionId: src_id|485ca180-61414e68-1aa02e68-9d31b56_0
2025-10-02T08:13:11.210478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fe3f0a-9233260b-9ffe477b-be18908_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|485ca180-61414e68-1aa02e68-9d31b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:11.213365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485ca180-61414e68-1aa02e68-9d31b56_0] Write session: try to update token
2025-10-02T08:13:11.213384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485ca180-61414e68-1aa02e68-9d31b56_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:11.227884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId: src_id|485ca180-61414e68-1aa02e68-9d31b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:11.230510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:11.230588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.230602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.230635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:11.230661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:11.230698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.230717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.230885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.230954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.231023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.231087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.231676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.231698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.231802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.231901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.232001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.232106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.232197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.232207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.232306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.232404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.232497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.232606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.232677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.232688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.232792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.232928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.233049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.233169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.233262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.233274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.233388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.233506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.233629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.233759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.233836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.233846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.233966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.234083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.234193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.234319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.234400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.234411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.234528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.234638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.234722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.234795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.234849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.234857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.234938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.235013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.235089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.235169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.235224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.235230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.235306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.235371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.235436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.235510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.235564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.235572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.235649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.235715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.235777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.235850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.235906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.235913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.235970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:11.236032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.236057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.236064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:11.236094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:11.236111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:11.236118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:11.236121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:11.236124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:11.236573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:11.236599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:11.236606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:11.236609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:11.236611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:11.236616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:11.237196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:11.237217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:11.237223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:11.237225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:11.237228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:11.237231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:11.237686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:11.237706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:11.237714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:11.237717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:11.237723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:11.245227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:11.245252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:11.245268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392791245
2025-10-02T08:13:11.245449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:11.245468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:11.245481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:11.245490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:11.245494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:11.245497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:11.246002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:11.246026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:11.246032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:11.246036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:11.246041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:11.246045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:11.246506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:11.246529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:11.246537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:11.246544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:11.246551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:11.246554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:11.247015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:11.247038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:11.247043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:11.248158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:11.248184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:11.248190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:11.248194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:11.248204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392791248
2025-10-02T08:13:11.248515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:11.248535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:11.248540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:11.248543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:11.248547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:11.248550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:11.249030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:11.249051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:11.249056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:11.249061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:11.249064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:11.249067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:11.249541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:11.249562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.249653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392791249
2025-10-02T08:13:11.251976Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:11.252001Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:11.252008Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:11.252017Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:11.252029Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:11.252038Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:11.252040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:11.252049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534499562139145:7682]
2025-10-02T08:13:11.252053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534499562139145:7682]
2025-10-02T08:13:11.252099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:11.252111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:11.257459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:11.257478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.257480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:11.257633Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:11.282485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534499562139184:8815]
2025-10-02T08:13:11.282578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1661, pipe: [1:7556534499562139184:8815]
2025-10-02T08:13:11.394071Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:11.394480Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:11.394492Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:11.394504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534499562139145:7682]
2025-10-02T08:13:11.394568Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:11.394583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562139184:8815], now have 1 active actors on pipe
2025-10-02T08:13:11.394700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:11.394708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:11.394738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1662 reason: error at write: Disconnected sessionId: src_id|485ca180-61414e68-1aa02e68-9d31b56_0
2025-10-02T08:13:11.394790Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:11.394926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1662 sessionId: src_id|485ca180-61414e68-1aa02e68-9d31b56_0 is DEAD
2025-10-02T08:13:11.394914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:11.395078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485ca180-61414e68-1aa02e68-9d31b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:11.395104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485ca180-61414e68-1aa02e68-9d31b56_0] Write session will restart in 0.006246s
2025-10-02T08:13:11.395133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485ca180-61414e68-1aa02e68-9d31b56_0] Write session: Do CDS request
2025-10-02T08:13:11.395111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534499562139184:8815]
2025-10-02T08:13:11.395140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485ca180-61414e68-1aa02e68-9d31b56_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:11.399492Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [91793b3149bcaea2] Result# TEvPutResult {Id# [72075186224037892:1661:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:11.399523Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1661:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:11.399610Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1661:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:11.402280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485ca180-61414e68-1aa02e68-9d31b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.402349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:11.402362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1663
2025-10-02T08:13:11.402489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.402523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:11.402533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:11.402537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:11.403269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1663 sessionId:  describe result for acl check
2025-10-02T08:13:11.403305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:11.403312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:11.403314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:11.403319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534499562139391:7668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:11.403854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534499562139391:7668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:11.406266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534499562139391:7668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:11.409599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534499562139391:7668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:11.409614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534499562139391:7668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:11.409617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534499562139391:7668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:11.409625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:11.414186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:11.415895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:11.416077Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:11.416086Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:11.416096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:11.416138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:11.416182Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534499562139759:7670]
2025-10-02T08:13:11.416835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:11.417039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:11.417080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:11.417386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:11.417444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.417450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.417451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.417453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.417453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.417459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.417469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.417473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.417477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.417480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.417486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.417493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.417500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.417505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.417516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.417522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.417526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.417532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.417537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.417547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.417565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:11.425696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:11.427686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:11.427721Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:11.427727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:11.427731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:11.427740Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1662 [1:7556534499562139759:7670]
2025-10-02T08:13:11.427751Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:11.427768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:11.427776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.427779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.427780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.427795Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:11.427805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:11.427811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:11.427869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.427876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.427879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:11.427882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:11.427947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:11.427955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.427967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.427978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:11.427999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534499562139753:7670]
2025-10-02T08:13:11.428005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534499562139753:7670]
2025-10-02T08:13:11.428010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1662
2025-10-02T08:13:11.428014Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:11.428026Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:11.428028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562139636:7668], now have 1 active actors on pipe
2025-10-02T08:13:11.428034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534500021903229:2378], now have 1 active actors on pipe
2025-10-02T08:13:11.428037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:11.428039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:11.428052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:11.428060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:11.428067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.428075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.428113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534499562139753:7670]
2025-10-02T08:13:11.428120Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:11.428130Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:11.428138Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3006e842-55435cb5-824e225b-575051ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:11.428143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.428148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.428150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:11.428129Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1662
2025-10-02T08:13:11.428158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.428183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:11.428226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.428311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.428318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.428335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.428374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1663 partition: 0 MaxSeqNo: 17 sessionId: src_id|3006e842-55435cb5-824e225b-575051ca_0
2025-10-02T08:13:11.428702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485ca180-61414e68-1aa02e68-9d31b56_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3006e842-55435cb5-824e225b-575051ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:11.431419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3006e842-55435cb5-824e225b-575051ca_0] Write session: try to update token
2025-10-02T08:13:11.431435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3006e842-55435cb5-824e225b-575051ca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:11.438640Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:11.438657Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:11.438666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534499562139753:7670]
2025-10-02T08:13:11.438706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:11.438712Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:11.438878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:11.439026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:11.439168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:11.439306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:11.439499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:11.439538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:11.445736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId: src_id|3006e842-55435cb5-824e225b-575051ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:11.448267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:11.448324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.448337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.448374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:11.448397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:11.448448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.448453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.448597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.448651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.448709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.448772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.448833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.448841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.448913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.448986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.449046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.449107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.449154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.449160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.449229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.449293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.449350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.449410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.449459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.449468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.449534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.449598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.449670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.449745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.449799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.449806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.449884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.449955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.450026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.450095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.450156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.450163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.450238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.450304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.450373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.450454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.450506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.450514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.450584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.450650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.450719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.450790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.450844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.450851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.450928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.450991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.451060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.451128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.451179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.451186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.451260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.451321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.451378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.451439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.451487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.451493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.451566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:11.451631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:11.451697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:11.451761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:11.451810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:11.451816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:11.451853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:11.451915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.451937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.451943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:11.451973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:11.451989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:11.451996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:11.452000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:11.452002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:11.452411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:11.452436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:11.452444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:11.452452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:11.452455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:11.452458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:11.452968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:11.452986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:11.452992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:11.452995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:11.452999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:11.453007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:11.453602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:11.453624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:11.453631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:11.453634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:11.453637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:11.454838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:11.454858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:11.454870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392791454
2025-10-02T08:13:11.455090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:11.455105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:11.455111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:11.455114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:11.455118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:11.455122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:11.455566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:11.455587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:11.455592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:11.455595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:11.455598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:11.455601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:11.456052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:11.456071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:11.456081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:11.456084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:11.456092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:11.456095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:11.456596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:11.456616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:11.456623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:11.457738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:11.457754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:11.457758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:11.457762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:11.457769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392791457
2025-10-02T08:13:11.458077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:11.458093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:11.458102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:11.458106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:11.458109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:11.458114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:11.458546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:11.458568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:11.458573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:11.458576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:11.458579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:11.458582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:11.459059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:11.459078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.459178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392791459
2025-10-02T08:13:11.459871Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:11.459888Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:11.459895Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:11.459902Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:11.461517Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:11.461528Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:11.461531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:11.461537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534499562139753:7670]
2025-10-02T08:13:11.461540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534499562139753:7670]
2025-10-02T08:13:11.461580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:11.461591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:11.461591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:11.461595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.461597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:11.461726Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:11.495488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534499562139802:8815]
2025-10-02T08:13:11.495582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1662, pipe: [1:7556534499562139802:8815]
2025-10-02T08:13:11.599596Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:11.599969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562139802:8815], now have 1 active actors on pipe
2025-10-02T08:13:11.600123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:11.600127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:11.600156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1663 reason: error at write: Disconnected sessionId: src_id|3006e842-55435cb5-824e225b-575051ca_0
2025-10-02T08:13:11.600167Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:11.600268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:11.600516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3006e842-55435cb5-824e225b-575051ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:11.600533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3006e842-55435cb5-824e225b-575051ca_0] Write session will restart in 0.007230s
2025-10-02T08:13:11.600341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1663 sessionId: src_id|3006e842-55435cb5-824e225b-575051ca_0 is DEAD
2025-10-02T08:13:11.600522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534499562139802:8815]
2025-10-02T08:13:11.600561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3006e842-55435cb5-824e225b-575051ca_0] Write session: Do CDS request
2025-10-02T08:13:11.600579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3006e842-55435cb5-824e225b-575051ca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:11.609326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3006e842-55435cb5-824e225b-575051ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.609548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:11.609564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1664
2025-10-02T08:13:11.610227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.610262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:11.610271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:11.610274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:11.610761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1664 sessionId:  describe result for acl check
2025-10-02T08:13:11.610792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:11.610794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:11.610796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:11.610801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534499562140061:7633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:11.611354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534499562140061:7633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:11.614566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534499562140061:7633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:11.620011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534499562140061:7633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:11.620043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534499562140061:7633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:11.620047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534499562140061:7633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:11.620055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:11.621786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:11.624475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:11.624693Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:11.624702Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:11.624712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:11.624763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:11.624818Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534499562140376:7637]
2025-10-02T08:13:11.625513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:11.625854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:11.625895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:11.626210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:11.626254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.626260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.626261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.626262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.626264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.626269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.626280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.626288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.626293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.626297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.626307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.626315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.626326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.626331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.626336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.626342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.626353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.626359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.626369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.626374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.626396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:11.635311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:11.636912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:11.636930Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:11.636933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:11.636937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:11.636946Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1663 [1:7556534499562140376:7637]
2025-10-02T08:13:11.636959Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:11.636978Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:11.636986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.636989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.636992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.637009Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:11.637015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:11.637021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:11.637085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.637094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.637097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:11.637099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:11.637165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:11.637172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.637185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.637199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:11.637220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562140352:7633], now have 1 active actors on pipe
2025-10-02T08:13:11.637227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534499562140367:7637]
2025-10-02T08:13:11.637230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534499562140367:7637]
2025-10-02T08:13:11.637231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1663
2025-10-02T08:13:11.637237Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:11.637248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:11.637248Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:11.637251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:11.637263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:11.637266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:11.637272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534500021903236:2378], now have 1 active actors on pipe
2025-10-02T08:13:11.637278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.637283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.637322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534499562140367:7637]
2025-10-02T08:13:11.637338Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:11.637347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:11.637362Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7344b60-6516a151-9781849a-4b0446e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:11.637369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.637377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.637379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:11.637390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.637398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:11.637440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.637502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.637509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.637524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.637568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1664 partition: 0 MaxSeqNo: 17 sessionId: src_id|a7344b60-6516a151-9781849a-4b0446e6_0
2025-10-02T08:13:11.637383Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1663
2025-10-02T08:13:11.643774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3006e842-55435cb5-824e225b-575051ca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a7344b60-6516a151-9781849a-4b0446e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:11.647087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7344b60-6516a151-9781849a-4b0446e6_0] Write session: try to update token
2025-10-02T08:13:11.647109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7344b60-6516a151-9781849a-4b0446e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:11.657691Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:11.657715Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:11.657718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:11.657727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534499562140367:7637]
2025-10-02T08:13:11.657732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534499562140367:7637]
2025-10-02T08:13:11.657775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:11.657791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.657793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:11.657937Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:11.660346Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:11.660361Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:11.665958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId: src_id|a7344b60-6516a151-9781849a-4b0446e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:11.668857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:11.700834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534499562140400:8815]
2025-10-02T08:13:11.700972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1663, pipe: [1:7556534499562140400:8815]
2025-10-02T08:13:11.794705Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:11.795816Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:11.795366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.795387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.795412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562140400:8815], now have 1 active actors on pipe
2025-10-02T08:13:11.795592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:11.795601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:11.795686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1664 reason: error at write: Disconnected sessionId: src_id|a7344b60-6516a151-9781849a-4b0446e6_0
2025-10-02T08:13:11.795876Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:11.795937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1664 sessionId: src_id|a7344b60-6516a151-9781849a-4b0446e6_0 is DEAD
2025-10-02T08:13:11.796324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534499562140400:8815]
2025-10-02T08:13:11.797064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7344b60-6516a151-9781849a-4b0446e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:11.797075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7344b60-6516a151-9781849a-4b0446e6_0] Write session will restart in 0.009607s
2025-10-02T08:13:11.797103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7344b60-6516a151-9781849a-4b0446e6_0] Write session: Do CDS request
2025-10-02T08:13:11.797110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7344b60-6516a151-9781849a-4b0446e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:11.809316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7344b60-6516a151-9781849a-4b0446e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.809592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:11.809619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1665
2025-10-02T08:13:11.809802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:11.809838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:11.809849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:11.809854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:11.810419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1665 sessionId:  describe result for acl check
2025-10-02T08:13:11.810456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:11.810458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:11.810460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:11.810465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534499562140627:7647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:11.811051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534499562140627:7647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:11.815810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534499562140627:7647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:11.821010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534499562140627:7647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:11.821033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534499562140627:7647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:11.821037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534499562140627:7647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:11.821048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:11.837889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:11.839787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:11.840083Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:11.840109Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:11.840140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:11.840294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:11.840338Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534499562140977:7648]
2025-10-02T08:13:11.840981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:11.841222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:11.841290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:11.841618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:11.841683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.841692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.841693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.841694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.841696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.841702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.841712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.841716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.841720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.841724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.841730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.841737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:11.841742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.841747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:11.841751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.841756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:11.841761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.841766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.841773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.841784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.841818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:11.850923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:11.852618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:11.852638Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:11.852640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:11.852644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:11.852652Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1664 [1:7556534499562140977:7648]
2025-10-02T08:13:11.852665Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:11.852683Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:11.852686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.852689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.852691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.852708Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:11.852719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:11.852725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:11.852798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.852829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.852837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:11.852839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:11.852905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:11.852914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.852929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:11.852948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:11.852967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562140797:7647], now have 1 active actors on pipe
2025-10-02T08:13:11.852975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1664
2025-10-02T08:13:11.852980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534499562140971:7648]
2025-10-02T08:13:11.852982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534499562140971:7648]
2025-10-02T08:13:11.852996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:11.853011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534500021903245:2378], now have 1 active actors on pipe
2025-10-02T08:13:11.853013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:11.853017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:11.853023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:11.853037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:11.853045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:11.853051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.853061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.853110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534499562140971:7648]
2025-10-02T08:13:11.853124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:11.853140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:11.853144Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adba1609-f6121337-61c67080-78c71cf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:11.853152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:11.853156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:11.853158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:11.853168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:11.853177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:11.853213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.853156Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1664
2025-10-02T08:13:11.853292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:11.853303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:11.853329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:11.853385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1665 partition: 0 MaxSeqNo: 17 sessionId: src_id|adba1609-f6121337-61c67080-78c71cf7_0
2025-10-02T08:13:11.853773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7344b60-6516a151-9781849a-4b0446e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|adba1609-f6121337-61c67080-78c71cf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:11.857142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adba1609-f6121337-61c67080-78c71cf7_0] Write session: try to update token
2025-10-02T08:13:11.857163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adba1609-f6121337-61c67080-78c71cf7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:11.874586Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:11.874604Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:11.874606Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:11.874613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534499562140971:7648]
2025-10-02T08:13:11.874620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534499562140971:7648]
2025-10-02T08:13:11.874660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:11.874665Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:11.874668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:11.874669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:11.874670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:11.874807Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:11.877077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId: src_id|adba1609-f6121337-61c67080-78c71cf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:11.879516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:11.920161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534499562141014:8815]
2025-10-02T08:13:11.922734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1664, pipe: [1:7556534499562141014:8815]
2025-10-02T08:13:12.018254Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:12.018888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.018904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.018942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534499562141014:8815], now have 1 active actors on pipe
2025-10-02T08:13:12.019092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534499562141014:8815]
2025-10-02T08:13:12.019133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:12.019143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:12.019162Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:12.019228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1665 reason: error at write: Disconnected sessionId: src_id|adba1609-f6121337-61c67080-78c71cf7_0
2025-10-02T08:13:12.019172Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:12.019407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1665 sessionId: src_id|adba1609-f6121337-61c67080-78c71cf7_0 is DEAD
2025-10-02T08:13:12.019553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adba1609-f6121337-61c67080-78c71cf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:12.019567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adba1609-f6121337-61c67080-78c71cf7_0] Write session will restart in 0.006688s
2025-10-02T08:13:12.019595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adba1609-f6121337-61c67080-78c71cf7_0] Write session: Do CDS request
2025-10-02T08:13:12.019602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adba1609-f6121337-61c67080-78c71cf7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:12.027385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adba1609-f6121337-61c67080-78c71cf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.027484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:12.027500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1666
2025-10-02T08:13:12.027658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.027696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:12.027705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:12.027708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:12.028138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1666 sessionId:  describe result for acl check
2025-10-02T08:13:12.028182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:12.028188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:12.028190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:12.028196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534503857108670:7613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:12.028692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534503857108670:7613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:12.031957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534503857108670:7613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:12.034418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:12.035891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:12.036054Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:12.036062Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:12.036072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:12.036116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:12.036152Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534503857108903:7621]
2025-10-02T08:13:12.036225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534503857108670:7613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:12.036250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534503857108670:7613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:12.036253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534503857108670:7613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:12.036269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:12.036790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:12.036989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:12.037031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:12.037320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:12.037378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.037383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.037384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.037385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.037386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.037390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.037399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.037403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.037405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.037408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.037413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.037419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.037424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.037428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.037432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.037436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.037440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.037444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.037449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.037453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.037471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:12.046148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:12.048033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:12.048047Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:12.048050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:12.048053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:12.048058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1665 [1:7556534503857108903:7621]
2025-10-02T08:13:12.048070Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:12.048090Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:12.048097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.048100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.048102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.048117Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:12.048125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:12.048131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:12.048198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.048205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.048208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:12.048210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:12.048271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:12.048278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.048291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.048307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:12.048320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1665
2025-10-02T08:13:12.048330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857108908:7613], now have 1 active actors on pipe
2025-10-02T08:13:12.048337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534503857108897:7621]
2025-10-02T08:13:12.048339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534503857108897:7621]
2025-10-02T08:13:12.048350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:12.048358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534504316870571:2378], now have 1 active actors on pipe
2025-10-02T08:13:12.048360Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:12.048362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:12.048367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.048371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.048388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:12.048400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:12.048406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:12.048444Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|805ede33-79c122cd-32446c7d-9d015593_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:12.048454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.048458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.048459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:12.048468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.048480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:12.048494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534503857108897:7621]
2025-10-02T08:13:12.048507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:12.048508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:12.048531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.048505Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1665
2025-10-02T08:13:12.048567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.048578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.048600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.048650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1666 partition: 0 MaxSeqNo: 17 sessionId: src_id|805ede33-79c122cd-32446c7d-9d015593_0
2025-10-02T08:13:12.049048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adba1609-f6121337-61c67080-78c71cf7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|805ede33-79c122cd-32446c7d-9d015593_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:12.052468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805ede33-79c122cd-32446c7d-9d015593_0] Write session: try to update token
2025-10-02T08:13:12.052489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805ede33-79c122cd-32446c7d-9d015593_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:12.067975Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:12.067993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:12.067995Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:12.068001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534503857108897:7621]
2025-10-02T08:13:12.068004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534503857108897:7621]
2025-10-02T08:13:12.068038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:12.068040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:12.068043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.068045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:12.068045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:12.068169Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:12.070511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId: src_id|805ede33-79c122cd-32446c7d-9d015593_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:12.073103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:12.119124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534503857108936:8815]
2025-10-02T08:13:12.119295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1665, pipe: [1:7556534503857108936:8815]
2025-10-02T08:13:12.203755Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:12.204052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.204070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.204107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857108936:8815], now have 1 active actors on pipe
2025-10-02T08:13:12.204238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:12.204247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:12.204308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1666 reason: error at write: Disconnected sessionId: src_id|805ede33-79c122cd-32446c7d-9d015593_0
2025-10-02T08:13:12.204458Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:12.204430Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:12.204494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1666 sessionId: src_id|805ede33-79c122cd-32446c7d-9d015593_0 is DEAD
2025-10-02T08:13:12.204641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805ede33-79c122cd-32446c7d-9d015593_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:12.204650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805ede33-79c122cd-32446c7d-9d015593_0] Write session will restart in 0.007589s
2025-10-02T08:13:12.204677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805ede33-79c122cd-32446c7d-9d015593_0] Write session: Do CDS request
2025-10-02T08:13:12.204685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805ede33-79c122cd-32446c7d-9d015593_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:12.204659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534503857108936:8815]
2025-10-02T08:13:12.213370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805ede33-79c122cd-32446c7d-9d015593_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.213453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:12.213480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1667
2025-10-02T08:13:12.213593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.213638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:12.213648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:12.213651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:12.214107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1667 sessionId:  describe result for acl check
2025-10-02T08:13:12.214150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:12.214156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:12.214158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:12.214163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534503857109245:7610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:12.214656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534503857109245:7610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:12.217630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534503857109245:7610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:12.222679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534503857109245:7610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:12.222695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534503857109245:7610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:12.222699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534503857109245:7610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:12.222706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:12.226670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:12.228908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:12.229125Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:12.229144Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:12.229154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:12.229206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:12.229233Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534503857109510:7597]
2025-10-02T08:13:12.229643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:12.229823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:12.229859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:12.230107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:12.230138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.230142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.230143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.230144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.230144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.230147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.230154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.230156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.230158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.230160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.230164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.230168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.230171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.230174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.230193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.230196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.230198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.230201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.230203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.230207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.230226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:12.242489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:12.244500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:12.244522Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:12.244525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:12.244528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:12.244536Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1666 [1:7556534503857109510:7597]
2025-10-02T08:13:12.244549Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:12.244569Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:12.244572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.244575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.244577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.244593Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:12.244605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:12.244612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:12.244682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.244693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.244696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:12.244699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:12.244772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:12.244780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.245039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1666
2025-10-02T08:13:12.245568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805ede33-79c122cd-32446c7d-9d015593_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|731352bd-9c6e0550-520e3b61-e31ef465_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:12.244796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.244832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:12.244852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534503857109504:7597]
2025-10-02T08:13:12.244854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534503857109504:7597]
2025-10-02T08:13:12.244863Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:12.244879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857109453:7610], now have 1 active actors on pipe
2025-10-02T08:13:12.244887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:12.244889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1666
2025-10-02T08:13:12.244889Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:12.244894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:12.244902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:12.244905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:12.244912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534504316870580:2378], now have 1 active actors on pipe
2025-10-02T08:13:12.244947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.244952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.244966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534503857109504:7597]
2025-10-02T08:13:12.244978Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:12.244998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:12.245017Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|731352bd-9c6e0550-520e3b61-e31ef465_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:12.245024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.245028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.245030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:12.245041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.245052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:12.245077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.245163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.245167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.245182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.245223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1667 partition: 0 MaxSeqNo: 17 sessionId: src_id|731352bd-9c6e0550-520e3b61-e31ef465_0
2025-10-02T08:13:12.248666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731352bd-9c6e0550-520e3b61-e31ef465_0] Write session: try to update token
2025-10-02T08:13:12.248683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731352bd-9c6e0550-520e3b61-e31ef465_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:12.264265Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:12.264287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:12.264290Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:12.264299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534503857109504:7597]
2025-10-02T08:13:12.264303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534503857109504:7597]
2025-10-02T08:13:12.264346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:12.264353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.264356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:12.264493Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:12.264929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId: src_id|731352bd-9c6e0550-520e3b61-e31ef465_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:12.268061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:12.268891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:12.268899Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:12.304979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534503857109537:8815]
2025-10-02T08:13:12.305079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1666, pipe: [1:7556534503857109537:8815]
2025-10-02T08:13:12.412289Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:12.412722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.412739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.412777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857109537:8815], now have 1 active actors on pipe
2025-10-02T08:13:12.412936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534503857109537:8815]
2025-10-02T08:13:12.412964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:12.412974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:12.413013Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:12.413045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1667 reason: error at write: Disconnected sessionId: src_id|731352bd-9c6e0550-520e3b61-e31ef465_0
2025-10-02T08:13:12.413035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:12.413207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1667 sessionId: src_id|731352bd-9c6e0550-520e3b61-e31ef465_0 is DEAD
2025-10-02T08:13:12.413423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731352bd-9c6e0550-520e3b61-e31ef465_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:12.413439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731352bd-9c6e0550-520e3b61-e31ef465_0] Write session will restart in 0.007914s
2025-10-02T08:13:12.413470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731352bd-9c6e0550-520e3b61-e31ef465_0] Write session: Do CDS request
2025-10-02T08:13:12.413478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731352bd-9c6e0550-520e3b61-e31ef465_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:12.422425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|731352bd-9c6e0550-520e3b61-e31ef465_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.422467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:12.422485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1668
2025-10-02T08:13:12.422669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.422702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:12.422707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:12.422710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:12.423150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1668 sessionId:  describe result for acl check
2025-10-02T08:13:12.423185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:12.423191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:12.423193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:12.423198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534503857109856:7604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:12.423720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534503857109856:7604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:12.426689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534503857109856:7604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:12.432723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534503857109856:7604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:12.432751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534503857109856:7604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:12.432754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534503857109856:7604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:12.432765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:12.437033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:12.439183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:12.439500Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:12.439513Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:12.439523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:12.439575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:12.439616Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534503857110123:7603]
2025-10-02T08:13:12.440264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:12.440467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:12.440505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:12.440794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:12.440850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.440851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.440852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.440853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.440854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.440860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.440871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.440875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.440879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.440882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.440888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.440896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.440902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.440907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.440912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.440918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.440922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.440927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.440931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.440937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.440956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:12.450671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:12.452702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:12.452726Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:12.452728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:12.452732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:12.452739Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1667 [1:7556534503857110123:7603]
2025-10-02T08:13:12.452752Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:12.452770Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:12.452780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.452783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.452785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.452830Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:12.452846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:12.452853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:12.452918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.452925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.452929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:12.452931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:12.452998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:12.453006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.453020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.453036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:12.453047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1667
2025-10-02T08:13:12.453061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857110051:7604], now have 1 active actors on pipe
2025-10-02T08:13:12.453065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534504316870599:2378], now have 1 active actors on pipe
2025-10-02T08:13:12.453070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.453079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.453097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534503857110117:7603]
2025-10-02T08:13:12.453104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534503857110117:7603]
2025-10-02T08:13:12.453115Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:12.453132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:12.453131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:12.453135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:12.453150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:12.453154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:12.453169Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1082ebf3-30f67d88-698096a5-42ac6007_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:12.453180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.453184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.453191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:12.453202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.453213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:12.453253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534503857110117:7603]
2025-10-02T08:13:12.453265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:12.453271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:12.453282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.453336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.453348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.453372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.453413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1668 partition: 0 MaxSeqNo: 17 sessionId: src_id|1082ebf3-30f67d88-698096a5-42ac6007_0
2025-10-02T08:13:12.453782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|731352bd-9c6e0550-520e3b61-e31ef465_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1082ebf3-30f67d88-698096a5-42ac6007_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:12.456642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1082ebf3-30f67d88-698096a5-42ac6007_0] Write session: try to update token
2025-10-02T08:13:12.456658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1082ebf3-30f67d88-698096a5-42ac6007_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:12.457037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1667
2025-10-02T08:13:12.465738Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:12.465754Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:12.465763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534503857110117:7603]
2025-10-02T08:13:12.465802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:12.465991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:12.466144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:12.466293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:12.466417Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:12.466621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:12.467141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:12.467187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:12.470855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId: src_id|1082ebf3-30f67d88-698096a5-42ac6007_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:12.473734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:12.473887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.473902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.473952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:12.473978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:12.474033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.474054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.474232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.474306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.474386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.474466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.474520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.474531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.474605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.474673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.474744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.474819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.474870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.474878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.474953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.475021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.475092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.475160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.475208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.475215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.475292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.475366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.475450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.475533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.475591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.475599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.475687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.475766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.475846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.475924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.475979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.475986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.476069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.476142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.476241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.476321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.476379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.476388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.476469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.476545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.476628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.476701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.476754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.476761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.476867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.476939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.477012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.477092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.477146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.477150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.477228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.477292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.477354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.477418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.477534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.477537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.477616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:12.477686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:12.477751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:12.477824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:12.477877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:12.477880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:12.477920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:12.477985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.478004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.478007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:12.478038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:12.478048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:12.478052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:12.478055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:12.478058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:12.478491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:12.478509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:12.478519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:12.478523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:12.478526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:12.478529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:12.479119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:12.479134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:12.479141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:12.479144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:12.479147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:12.479151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:12.479668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:12.479682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:12.479689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:12.479693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:12.479700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:12.481088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:12.481110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:12.481121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392792481
2025-10-02T08:13:12.481259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:12.481267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:12.481273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:12.481277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:12.481281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:12.481286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:12.481786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:12.481814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:12.481822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:12.481825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:12.481829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:12.481833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:12.482327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:12.482359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:12.482375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:12.482383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:12.482388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:12.482392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:12.482936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:12.482966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:12.482977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:12.484273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:12.484295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:12.484301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:12.484306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:12.484314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392792484
2025-10-02T08:13:12.484644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:12.484673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:12.484679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:12.484682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:12.484685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:12.484689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:12.485267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:12.485297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:12.485302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:12.485309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:12.485318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:12.485322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:12.485866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:12.485892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.485996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392792485
2025-10-02T08:13:12.486820Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:12.486841Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:12.486848Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:12.486859Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:12.488630Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:12.488648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:12.488649Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:12.488660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534503857110117:7603]
2025-10-02T08:13:12.488663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534503857110117:7603]
2025-10-02T08:13:12.488724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:12.488733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.488736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:12.488767Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:12.488796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:12.488905Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:12.513369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534503857110167:8815]
2025-10-02T08:13:12.513695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1667, pipe: [1:7556534503857110167:8815]
2025-10-02T08:13:12.641550Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:12.641946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857110167:8815], now have 1 active actors on pipe
2025-10-02T08:13:12.642086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534503857110167:8815]
2025-10-02T08:13:12.642134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:12.642144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:12.642178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1668 reason: error at write: Disconnected sessionId: src_id|1082ebf3-30f67d88-698096a5-42ac6007_0
2025-10-02T08:13:12.642182Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:12.642196Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:12.642598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1082ebf3-30f67d88-698096a5-42ac6007_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:12.642613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1082ebf3-30f67d88-698096a5-42ac6007_0] Write session will restart in 0.008753s
2025-10-02T08:13:12.642640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1082ebf3-30f67d88-698096a5-42ac6007_0] Write session: Do CDS request
2025-10-02T08:13:12.642647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1082ebf3-30f67d88-698096a5-42ac6007_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:12.642752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1668 sessionId: src_id|1082ebf3-30f67d88-698096a5-42ac6007_0 is DEAD
2025-10-02T08:13:12.652368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1082ebf3-30f67d88-698096a5-42ac6007_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.652427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:12.652448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1669
2025-10-02T08:13:12.652650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.652691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:12.652697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:12.652703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:12.653266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1669 sessionId:  describe result for acl check
2025-10-02T08:13:12.653307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:12.653309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:12.653312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:12.653317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534503857110518:7581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:12.653917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534503857110518:7581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:12.657140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534503857110518:7581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:12.662936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534503857110518:7581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:12.662961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534503857110518:7581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:12.662965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534503857110518:7581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:12.662976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:12.664412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:12.668699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:12.669163Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:12.669176Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:12.669190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:12.669257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:12.669309Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534503857110751:7582]
2025-10-02T08:13:12.670037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:12.670356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:12.670430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:12.670832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:12.670889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.670891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.670892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.670894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.670895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.670902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.670914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.670919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.670923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.670928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.670936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.670945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.670952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.670959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.670965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.670971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.670976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.670982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.670988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.670994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.671016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:12.684212Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1668
2025-10-02T08:13:12.681386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:12.683646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:12.683655Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:12.683658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:12.683663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:12.683672Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1668 [1:7556534503857110751:7582]
2025-10-02T08:13:12.683690Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:12.683713Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:12.683717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.683721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.683723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.683745Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:12.683753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:12.683762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:12.683842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.683845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.683851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:12.683854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:12.684090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1668
2025-10-02T08:13:12.684666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:12.684681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.684700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.684714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:12.684742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857110731:7581], now have 1 active actors on pipe
2025-10-02T08:13:12.684746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534504316870607:2378], now have 1 active actors on pipe
2025-10-02T08:13:12.684752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.684757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.684784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534503857110745:7582]
2025-10-02T08:13:12.684787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534503857110745:7582]
2025-10-02T08:13:12.684818Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:12.684835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:12.684837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:12.684841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:12.684851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:12.684855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:12.684875Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96c34069-85d771db-d0e92766-17941777_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:12.684884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.684890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.684892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:12.684904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.684917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:12.684961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534503857110745:7582]
2025-10-02T08:13:12.684965Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:12.684977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:12.684977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.685145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.685159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.685184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.685220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1669 partition: 0 MaxSeqNo: 17 sessionId: src_id|96c34069-85d771db-d0e92766-17941777_0
2025-10-02T08:13:12.685648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1082ebf3-30f67d88-698096a5-42ac6007_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|96c34069-85d771db-d0e92766-17941777_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:12.688333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c34069-85d771db-d0e92766-17941777_0] Write session: try to update token
2025-10-02T08:13:12.688351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c34069-85d771db-d0e92766-17941777_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:12.697372Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:12.697402Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:12.697415Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534503857110745:7582]
2025-10-02T08:13:12.697475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:12.697536Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:12.697685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:12.697876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:12.698053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:12.698239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:12.698497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:12.698553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:12.711031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId: src_id|96c34069-85d771db-d0e92766-17941777_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:12.714159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:12.717423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.717457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.717479Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:12.717482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:12.717485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:12.717494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534503857110745:7582]
2025-10-02T08:13:12.717499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534503857110745:7582]
2025-10-02T08:13:12.717564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:12.717578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.717580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:12.717602Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:12.717610Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:12.717773Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:12.742261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534503857110777:8815]
2025-10-02T08:13:12.742436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1668, pipe: [1:7556534503857110777:8815]
2025-10-02T08:13:12.867396Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:12.867856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:12.867895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857110777:8815], now have 1 active actors on pipe
2025-10-02T08:13:12.867905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:12.867985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:12.867995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:12.868011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1669 reason: error at write: Disconnected sessionId: src_id|96c34069-85d771db-d0e92766-17941777_0
2025-10-02T08:13:12.868142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1669 sessionId: src_id|96c34069-85d771db-d0e92766-17941777_0 is DEAD
2025-10-02T08:13:12.868107Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:12.868333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c34069-85d771db-d0e92766-17941777_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:12.868326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534503857110777:8815]
2025-10-02T08:13:12.868346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c34069-85d771db-d0e92766-17941777_0] Write session will restart in 0.008777s
2025-10-02T08:13:12.868374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c34069-85d771db-d0e92766-17941777_0] Write session: Do CDS request
2025-10-02T08:13:12.868385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c34069-85d771db-d0e92766-17941777_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:12.878426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c34069-85d771db-d0e92766-17941777_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.878495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:12.878512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1670
2025-10-02T08:13:12.878724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:12.878749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:12.878756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:12.878759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:12.879131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1670 sessionId:  describe result for acl check
2025-10-02T08:13:12.879169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:12.879175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:12.879176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:12.879181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534503857111220:7564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:12.879631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534503857111220:7564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:12.882845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534503857111220:7564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:12.884224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:12.886336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:12.886555Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:12.886566Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:12.886577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:12.886631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:12.886671Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534503857111357:7548]
2025-10-02T08:13:12.886678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534503857111220:7564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:12.886685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534503857111220:7564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:12.886688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534503857111220:7564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:12.886697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:12.887254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:12.887443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:12.887483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:12.887780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:12.887826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.887831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.887833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.887834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.887835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.887839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.887849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.887853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.887856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.887860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.887865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.887872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:12.887882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.887887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:12.887891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.887902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:12.887907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.887915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.887920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.887928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.887944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:12.896792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:12.898592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:12.898619Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:12.898621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:12.898625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:12.898632Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1669 [1:7556534503857111357:7548]
2025-10-02T08:13:12.898643Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:12.898662Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:12.898665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.898668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.898670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.898687Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:12.898694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:12.898701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:12.898768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.898778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.898781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:12.898784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:12.898853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:12.898862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.898876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:12.898894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:12.898918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857111362:7564], now have 1 active actors on pipe
2025-10-02T08:13:12.898926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1669
2025-10-02T08:13:12.898929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534503857111351:7548]
2025-10-02T08:13:12.898931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534503857111351:7548]
2025-10-02T08:13:12.898939Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:12.898947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:12.898950Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:12.898955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:12.898969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:12.898971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:12.898979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.898983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.898998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534504316870617:2378], now have 1 active actors on pipe
2025-10-02T08:13:12.899029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534503857111351:7548]
2025-10-02T08:13:12.899032Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:12.899030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1669
2025-10-02T08:13:12.899048Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:12.899054Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:12.899059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:12.899062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:12.899064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:12.899074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:12.899083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:12.899120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.899193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:12.899195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:12.899206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:12.899236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1670 partition: 0 MaxSeqNo: 17 sessionId: src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0
2025-10-02T08:13:12.899534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c34069-85d771db-d0e92766-17941777_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:12.902277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0] Write session: try to update token
2025-10-02T08:13:12.902293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:12.917956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId: src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:12.918084Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:12.918099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:12.918102Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:12.918111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534503857111351:7548]
2025-10-02T08:13:12.918116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534503857111351:7548]
2025-10-02T08:13:12.918162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:12.918175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:12.918175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:12.918177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:12.918182Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:12.918337Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:12.920570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:12.970908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534503857111404:8815]
2025-10-02T08:13:12.971186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1669, pipe: [1:7556534503857111404:8815]
2025-10-02T08:13:13.055930Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:13.056320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.056336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.056375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534503857111404:8815], now have 1 active actors on pipe
2025-10-02T08:13:13.056487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534503857111404:8815]
2025-10-02T08:13:13.056516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:13.056518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:13.056581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1670 reason: error at write: Disconnected sessionId: src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0
2025-10-02T08:13:13.056589Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:13.056625Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:13.056782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1670 sessionId: src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0 is DEAD
2025-10-02T08:13:13.056953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:13.056967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0] Write session will restart in 0.006412s
2025-10-02T08:13:13.057005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0] Write session: Do CDS request
2025-10-02T08:13:13.057012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:13.064341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.064458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:13.064473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1671
2025-10-02T08:13:13.064677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.064737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:13.064750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:13.064755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:13.065430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1671 sessionId:  describe result for acl check
2025-10-02T08:13:13.065479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:13.065481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:13.065483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:13.065489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534508152078988:7529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:13.066007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534508152078988:7529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:13.069147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534508152078988:7529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:13.072785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534508152078988:7529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:13.072826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534508152078988:7529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:13.072830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534508152078988:7529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:13.072838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:13.079554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:13.080188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:13.080439Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:13.080453Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:13.080464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:13.080521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:13.080566Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534508152079305:7528]
2025-10-02T08:13:13.081214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:13.082218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:13.082463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:13.082814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:13.082871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.082877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.082878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.082880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.082881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.082887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.082898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.082907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.082911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.082915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.082922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.082934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.082945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.082955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.082966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.082977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.082988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.082998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.083003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.083008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.083028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:13.094185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:13.095734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:13.095754Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:13.095757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:13.095761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:13.095767Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1670 [1:7556534508152079305:7528]
2025-10-02T08:13:13.095780Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:13.095799Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:13.095806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.095810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.095816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.095835Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:13.095840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:13.095848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:13.095914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.095922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.095925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:13.095927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:13.096000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:13.096007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.096020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.096037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:13.096054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534508152079299:7528]
2025-10-02T08:13:13.096056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534508152079299:7528]
2025-10-02T08:13:13.096067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:13.096088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:13.096105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:13.096112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:13.096118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1670
2025-10-02T08:13:13.096119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:13.096121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152079200:7529], now have 1 active actors on pipe
2025-10-02T08:13:13.096124Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:13.096157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534508611837941:2378], now have 1 active actors on pipe
2025-10-02T08:13:13.096168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534508152079299:7528]
2025-10-02T08:13:13.096188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:13.096194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.096198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.096204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:13.096248Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1670
2025-10-02T08:13:13.096435Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:13.096451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.096455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.096458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:13.096468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.096483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:13.096510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.096562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.096569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.096583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.096623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1671 partition: 0 MaxSeqNo: 17 sessionId: src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0
2025-10-02T08:13:13.097004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbcb9c2e-49e32b21-3308f6-c546ea90_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:13.100503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0] Write session: try to update token
2025-10-02T08:13:13.100525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:13.114720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:13.114745Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:13.114747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:13.114757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534508152079299:7528]
2025-10-02T08:13:13.114762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534508152079299:7528]
2025-10-02T08:13:13.114805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:13.114814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.114813Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:13.114817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:13.114819Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:13.114980Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:13.115474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId: src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:13.118057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:13.156438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534508152079331:8815]
2025-10-02T08:13:13.156618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1670, pipe: [1:7556534508152079331:8815]
2025-10-02T08:13:13.252853Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:13.253248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.253269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.253328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152079331:8815], now have 1 active actors on pipe
2025-10-02T08:13:13.253584Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:13.254101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534508152079331:8815]
2025-10-02T08:13:13.254135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:13.254201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1671 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0
2025-10-02T08:13:13.254381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1671 sessionId: src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0 is DEAD
2025-10-02T08:13:13.254788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:13.254803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0] Write session will restart in 0.007753s
2025-10-02T08:13:13.254829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0] Write session: Do CDS request
2025-10-02T08:13:13.254838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:13.256313Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:13.263303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.263661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:13.263693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1672
2025-10-02T08:13:13.263872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.263908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:13.263914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:13.263918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:13.264426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1672 sessionId:  describe result for acl check
2025-10-02T08:13:13.264460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:13.264467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:13.264468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:13.264474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534508152079687:7519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:13.265123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534508152079687:7519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:13.268958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534508152079687:7519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:13.273737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534508152079687:7519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:13.273755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534508152079687:7519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:13.273758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534508152079687:7519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:13.273767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:13.275512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:13.277746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:13.278042Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:13.278054Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:13.278066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:13.278120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:13.278167Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534508152079918:7503]
2025-10-02T08:13:13.278737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:13.278968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:13.279009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:13.279263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:13.279304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.279309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.279310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.279311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.279313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.279318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.279331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.279335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.279352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.279359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.279366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.279379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.279391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.279401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.279410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.279435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.279440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.279449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.279459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.279468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.279492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:13.288057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:13.289925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:13.289947Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:13.289950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:13.289953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:13.289959Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1671 [1:7556534508152079918:7503]
2025-10-02T08:13:13.289972Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:13.289986Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:13.289988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.289990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.289992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.290003Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:13.290007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:13.290012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:13.290075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.290083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.290086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:13.290089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:13.290149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:13.290158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.290172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.290191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:13.290213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534508152079912:7503]
2025-10-02T08:13:13.290215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534508152079912:7503]
2025-10-02T08:13:13.290223Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:13.290233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152079897:7519], now have 1 active actors on pipe
2025-10-02T08:13:13.290240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:13.290248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:13.290247Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:13.290250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:13.290251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:13.290255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534508611837950:2378], now have 1 active actors on pipe
2025-10-02T08:13:13.290264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1671
2025-10-02T08:13:13.290283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534508152079912:7503]
2025-10-02T08:13:13.290295Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:13.290300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.290303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.290318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:13.290334Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:13.290338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.290343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.290344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:13.290350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.290356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:13.290375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.290373Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1671
2025-10-02T08:13:13.290491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.290508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.290547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.290598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1672 partition: 0 MaxSeqNo: 17 sessionId: src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0
2025-10-02T08:13:13.290985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2053a96-1ae8ef0b-9ad2f33c-5e4d5d00_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:13.293863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0] Write session: try to update token
2025-10-02T08:13:13.293884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:13.308576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId: src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:13.311546Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:13.311575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:13.311579Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:13.311590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534508152079912:7503]
2025-10-02T08:13:13.311595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534508152079912:7503]
2025-10-02T08:13:13.311609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:13.311649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:13.311650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:13.311656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:13.311664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.311667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:13.311824Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:13.354072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534508152079944:8815]
2025-10-02T08:13:13.354189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1671, pipe: [1:7556534508152079944:8815]
2025-10-02T08:13:13.465413Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:13.465869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.465885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.465924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152079944:8815], now have 1 active actors on pipe
2025-10-02T08:13:13.466075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534508152079944:8815]
2025-10-02T08:13:13.466108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:13.466110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:13.466170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1672 reason: error at write: Disconnected sessionId: src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0
2025-10-02T08:13:13.466173Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:13.466352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1672 sessionId: src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0 is DEAD
2025-10-02T08:13:13.466336Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:13.466545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:13.466554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0] Write session will restart in 0.009963s
2025-10-02T08:13:13.466577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0] Write session: Do CDS request
2025-10-02T08:13:13.466583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:13.477281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.477353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:13.477370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1673
2025-10-02T08:13:13.477466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.477488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:13.477493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:13.477495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:13.477979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1673 sessionId:  describe result for acl check
2025-10-02T08:13:13.478005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:13.478006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:13.478007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:13.478011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534508152080403:7508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:13.478375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534508152080403:7508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:13.481186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534508152080403:7508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:13.482696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:13.484211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:13.484364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534508152080403:7508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:13.484376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534508152080403:7508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:13.484379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534508152080403:7508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:13.484386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:13.484444Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:13.484453Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:13.484470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:13.484510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:13.484536Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534508152080540:7513]
2025-10-02T08:13:13.484970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:13.485118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:13.485147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:13.485332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:13.485357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.485361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.485361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.485362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.485363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.485365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.485372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.485374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.485375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.485377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.485381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.485385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.485388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.485391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.485393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.485396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.485398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.485401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.485404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.485406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.485416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:13.493448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:13.495105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:13.495121Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:13.495124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:13.495128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:13.495134Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1672 [1:7556534508152080540:7513]
2025-10-02T08:13:13.495146Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:13.495165Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:13.495173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.495176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.495178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.495193Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:13.495202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:13.495209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:13.495271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.495278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.495281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:13.495283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:13.495345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:13.495353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.495366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.495384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:13.495406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152080542:7508], now have 1 active actors on pipe
2025-10-02T08:13:13.495412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1672
2025-10-02T08:13:13.495417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534508152080533:7513]
2025-10-02T08:13:13.495419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534508152080533:7513]
2025-10-02T08:13:13.495427Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:13.495438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:13.495439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534508611837968:2378], now have 1 active actors on pipe
2025-10-02T08:13:13.495441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:13.495448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:13.495463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:13.495470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:13.495476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.495484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.495520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534508152080533:7513]
2025-10-02T08:13:13.495531Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:13.495550Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:13.495553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:13.495560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.495565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.495571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:13.495579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.495522Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1672
2025-10-02T08:13:13.495592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:13.495642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.495691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.495697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.495710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.495747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1673 partition: 0 MaxSeqNo: 17 sessionId: src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0
2025-10-02T08:13:13.496039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90378bc0-7f8a964e-ae330b0c-366830d2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:13.498517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0] Write session: try to update token
2025-10-02T08:13:13.498532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:13.511700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId: src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:13.513871Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:13.513887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:13.513890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:13.513899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534508152080533:7513]
2025-10-02T08:13:13.513903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534508152080533:7513]
2025-10-02T08:13:13.513947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:13.513950Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:13.513953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.513955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:13.513957Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:13.514094Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:13.514457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:13.566066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534508152080569:8815]
2025-10-02T08:13:13.566216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1672, pipe: [1:7556534508152080569:8815]
2025-10-02T08:13:13.651265Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:13.651800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.651812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.651843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152080569:8815], now have 1 active actors on pipe
2025-10-02T08:13:13.651942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534508152080569:8815]
2025-10-02T08:13:13.651956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:13.651961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:13.651997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1673 reason: error at write: Disconnected sessionId: src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0
2025-10-02T08:13:13.652007Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:13.652124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1673 sessionId: src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0 is DEAD
2025-10-02T08:13:13.652076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:13.652282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:13.652293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0] Write session will restart in 0.005090s
2025-10-02T08:13:13.652318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0] Write session: Do CDS request
2025-10-02T08:13:13.652323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:13.658271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.658321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:13.658343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1674
2025-10-02T08:13:13.658454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.658476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:13.658482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:13.658484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:13.658955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1674 sessionId:  describe result for acl check
2025-10-02T08:13:13.658987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:13.658993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:13.658995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:13.659000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534508152080848:7504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:13.659500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534508152080848:7504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:13.662284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534508152080848:7504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:13.665800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534508152080848:7504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:13.665815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534508152080848:7504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:13.665818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534508152080848:7504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:13.665826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:13.669480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:13.669898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:13.670082Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:13.670093Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:13.670103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:13.670146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:13.670297Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534508152081164:7506]
2025-10-02T08:13:13.670973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:13.671180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:13.671233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:13.671516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:13.671561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.671566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.671567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.671568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.671569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.671575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.671585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.671592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.671596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.671600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.671605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.671612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.671618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.671622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.671627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.671636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.671640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.671655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.671663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.671668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.671690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:13.679578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:13.680959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:13.680974Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:13.680977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:13.680980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:13.680987Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1673 [1:7556534508152081164:7506]
2025-10-02T08:13:13.681000Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:13.681016Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:13.681019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.681021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.681023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.681039Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:13.681045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:13.681052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:13.681107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.681114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.681117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:13.681119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:13.681172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:13.681178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.681191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.681207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:13.681228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152081138:7504], now have 1 active actors on pipe
2025-10-02T08:13:13.681238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534508152081158:7506]
2025-10-02T08:13:13.681241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534508152081158:7506]
2025-10-02T08:13:13.681257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:13.681266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1673
2025-10-02T08:13:13.681268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534508611837975:2378], now have 1 active actors on pipe
2025-10-02T08:13:13.681276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:13.681289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:13.681290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:13.681292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:13.681303Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:13.681321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534508152081158:7506]
2025-10-02T08:13:13.681328Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:13.681334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.681339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:13.681341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.681319Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1673
2025-10-02T08:13:13.681584Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:13.681596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.681601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.681603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:13.681610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.681622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:13.681648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.681677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.681683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.681695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.681730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1674 partition: 0 MaxSeqNo: 17 sessionId: src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0
2025-10-02T08:13:13.682042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c62ae1-1a15d9d1-7c86f60e-fdd73943_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:13.684726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0] Write session: try to update token
2025-10-02T08:13:13.684743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:13.697835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId: src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:13.698867Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:13.698887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:13.698890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:13.698900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534508152081158:7506]
2025-10-02T08:13:13.698908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534508152081158:7506]
2025-10-02T08:13:13.698948Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:13.698954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:13.698959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:13.698961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.698963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:13.699118Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:13.700032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:13.751892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534508152081190:8815]
2025-10-02T08:13:13.752005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1673, pipe: [1:7556534508152081190:8815]
2025-10-02T08:13:13.831551Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:13.831983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.832000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.832042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152081190:8815], now have 1 active actors on pipe
2025-10-02T08:13:13.832213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:13.832225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:13.832280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1674 reason: error at write: Disconnected sessionId: src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0
2025-10-02T08:13:13.832296Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:13.832315Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:13.832461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1674 sessionId: src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0 is DEAD
2025-10-02T08:13:13.832627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:13.832638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0] Write session will restart in 0.006103s
2025-10-02T08:13:13.832623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534508152081190:8815]
2025-10-02T08:13:13.832660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0] Write session: Do CDS request
2025-10-02T08:13:13.832667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:13.840465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.840507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:13.840523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1675
2025-10-02T08:13:13.840669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:13.840698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:13.840706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:13.840709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:13.841016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1675 sessionId:  describe result for acl check
2025-10-02T08:13:13.841041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:13.841045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:13.841046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:13.841050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534508152081504:7492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:13.841429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534508152081504:7492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:13.844568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534508152081504:7492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:13.848133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534508152081504:7492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:13.848155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534508152081504:7492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:13.848158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534508152081504:7492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:13.848167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:13.851095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:13.852895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:13.853089Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:13.853101Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:13.853110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:13.853153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:13.853199Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534508152081784:7491]
2025-10-02T08:13:13.853650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:13.853829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:13.853862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:13.854077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:13.854110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.854115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.854116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.854117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.854118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.854122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.854133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.854136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.854143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.854147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.854156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.854160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:13.854166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.854169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:13.854174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.854177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:13.854180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.854183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.854185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.854188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.854199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:13.861698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:13.863202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:13.863218Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:13.863220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:13.863222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:13.863227Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1674 [1:7556534508152081784:7491]
2025-10-02T08:13:13.863236Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:13.863250Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:13.863252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.863254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.863255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.863268Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:13.863271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:13.863276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:13.863319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.863326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.863328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:13.863330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:13.863379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:13.863387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.863398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:13.863412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:13.863433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534508152081778:7491]
2025-10-02T08:13:13.863439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534508152081778:7491]
2025-10-02T08:13:13.863446Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:13.863451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1674
2025-10-02T08:13:13.863455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:13.863459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152081737:7492], now have 1 active actors on pipe
2025-10-02T08:13:13.863459Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:13.863466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:13.863478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:13.863481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:13.863487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534508611837984:2378], now have 1 active actors on pipe
2025-10-02T08:13:13.863491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.863495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.863533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534508152081778:7491]
2025-10-02T08:13:13.863545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:13.863556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:13.863568Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:13.863579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:13.863583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:13.863584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:13.863592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:13.863605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:13.863638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.863593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1674
2025-10-02T08:13:13.863699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:13.863706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:13.863719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:13.863755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1675 partition: 0 MaxSeqNo: 17 sessionId: src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0
2025-10-02T08:13:13.864118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227c1694-3148a3b6-95b3818f-ff7fe32a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:13.867295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0] Write session: try to update token
2025-10-02T08:13:13.867315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:13.880347Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:13.880372Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:13.880374Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:13.880384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534508152081778:7491]
2025-10-02T08:13:13.880389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534508152081778:7491]
2025-10-02T08:13:13.880432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:13.880432Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:13.880437Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:13.880448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:13.880451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:13.880594Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:13.883696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId: src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:13.886188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:13.932620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534508152081810:8815]
2025-10-02T08:13:13.932724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1674, pipe: [1:7556534508152081810:8815]
2025-10-02T08:13:14.020481Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:14.021018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.021029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.021061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534508152081810:8815], now have 1 active actors on pipe
2025-10-02T08:13:14.021153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534508152081810:8815]
2025-10-02T08:13:14.021171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:14.021172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:14.021208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1675 reason: error at write: Disconnected sessionId: src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0
2025-10-02T08:13:14.021249Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:14.021302Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:14.021366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1675 sessionId: src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0 is DEAD
2025-10-02T08:13:14.021533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:14.021546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0] Write session will restart in 0.009788s
2025-10-02T08:13:14.021576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0] Write session: Do CDS request
2025-10-02T08:13:14.021582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:14.032405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.032477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:14.032494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1676
2025-10-02T08:13:14.032655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.032690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:14.032693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:14.032697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:14.033124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1676 sessionId:  describe result for acl check
2025-10-02T08:13:14.033166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:14.033172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:14.033174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:14.033178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534512447049644:7464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:14.033591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534512447049644:7464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:14.035611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:14.035873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534512447049644:7464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:14.037289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:14.037476Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:14.037488Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:14.037498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:14.037548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:14.037582Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534512447049724:7461]
2025-10-02T08:13:14.038041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:14.038205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:14.038259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:14.038400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534512447049644:7464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:14.038412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534512447049644:7464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:14.038415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534512447049644:7464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:14.038422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:14.038563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:14.038610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.038616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.038617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.038618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.038619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.038624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.038633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.038637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.038641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.038644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.038650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.038661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.038671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.038676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.038685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.038690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.038694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.038698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.038707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.038712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.038733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:14.046632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:14.048257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:14.048273Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:14.048276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:14.048279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:14.048285Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1675 [1:7556534512447049724:7461]
2025-10-02T08:13:14.048296Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:14.048310Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:14.048313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.048316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.048318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.048333Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:14.048338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:14.048349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:14.048402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.048409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.048412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:14.048414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:14.048470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:14.048476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.048488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.048499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:14.048515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534512447049708:7461]
2025-10-02T08:13:14.048524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534512447049708:7461]
2025-10-02T08:13:14.048532Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:14.048541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:14.048545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:14.048547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447049735:7464], now have 1 active actors on pipe
2025-10-02T08:13:14.048551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1675
2025-10-02T08:13:14.048552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:14.048563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:14.048567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:14.048573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534512906805287:2378], now have 1 active actors on pipe
2025-10-02T08:13:14.048608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.048613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.048625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534512447049708:7461]
2025-10-02T08:13:14.048634Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:14.048656Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:14.048666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.048667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:14.048669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.048671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:14.048680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.048619Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1675
2025-10-02T08:13:14.048688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:14.048719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.048761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.048767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.048780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.048839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1676 partition: 0 MaxSeqNo: 17 sessionId: src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0
2025-10-02T08:13:14.049221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ffe8be6-b01e070c-40054557-c2e758ed_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:14.052236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0] Write session: try to update token
2025-10-02T08:13:14.052251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:14.066170Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:14.066190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:14.066192Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:14.066200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534512447049708:7461]
2025-10-02T08:13:14.066205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534512447049708:7461]
2025-10-02T08:13:14.066244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:14.066250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.066249Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:14.066254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:14.066257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:14.066379Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:14.067860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId: src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:14.070869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:14.121534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534512447049763:8815]
2025-10-02T08:13:14.121634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1675, pipe: [1:7556534512447049763:8815]
2025-10-02T08:13:14.200597Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:14.201132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.201149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.201187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447049763:8815], now have 1 active actors on pipe
2025-10-02T08:13:14.201322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:14.201335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:14.201401Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:14.201404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1676 reason: error at write: Disconnected sessionId: src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0
2025-10-02T08:13:14.201456Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:14.201564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1676 sessionId: src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0 is DEAD
2025-10-02T08:13:14.201704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534512447049763:8815]
2025-10-02T08:13:14.201741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:14.201755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0] Write session will restart in 0.006761s
2025-10-02T08:13:14.201783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0] Write session: Do CDS request
2025-10-02T08:13:14.201789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:14.209336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.209402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:14.209419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1677
2025-10-02T08:13:14.209589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.209622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:14.209631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:14.209634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:14.210121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1677 sessionId:  describe result for acl check
2025-10-02T08:13:14.210155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:14.210161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:14.210163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:14.210167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534512447050096:7447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:14.210635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534512447050096:7447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:14.213671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534512447050096:7447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:14.217189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534512447050096:7447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:14.217208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534512447050096:7447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:14.217210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534512447050096:7447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:14.217219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:14.220365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:14.220640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:14.220909Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:14.220918Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:14.220929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:14.220976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:14.221012Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534512447050358:7450]
2025-10-02T08:13:14.221651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:14.221841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:14.221882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:14.222195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:14.222229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.222235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.222236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.222237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.222238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.222243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.222253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.222257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.222261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.222265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.222271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.222282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.222288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.222293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.222299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.222305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.222314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.222319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.222327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.222333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.222351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:14.234035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:14.235813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:14.235835Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:14.235838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:14.235843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:14.235849Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1676 [1:7556534512447050358:7450]
2025-10-02T08:13:14.235861Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:14.235877Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:14.235884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.235887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.235889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.235905Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:14.235910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:14.235921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:14.235990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.235997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.236000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:14.236003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:14.236066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:14.236073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.236088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.236106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:14.236126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534512447050352:7450]
2025-10-02T08:13:14.236132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534512447050352:7450]
2025-10-02T08:13:14.236143Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:14.236152Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:14.236155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:14.236163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447050337:7447], now have 1 active actors on pipe
2025-10-02T08:13:14.236171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:14.236195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:14.236198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1676
2025-10-02T08:13:14.236204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:14.236209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534512906805318:2378], now have 1 active actors on pipe
2025-10-02T08:13:14.236242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.236249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.236263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534512447050352:7450]
2025-10-02T08:13:14.236274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:14.236293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:14.236304Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:14.236310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.236319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.236322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:14.236330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.236339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:14.236364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.236404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.236413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.236426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.236458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1677 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0
2025-10-02T08:13:14.236440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1676
2025-10-02T08:13:14.236825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c35668-98e8b9de-d4a64e9c-249cbccd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:14.239850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0] Write session: try to update token
2025-10-02T08:13:14.239869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:14.253452Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:14.253475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:14.253478Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:14.253487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534512447050352:7450]
2025-10-02T08:13:14.253492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534512447050352:7450]
2025-10-02T08:13:14.253537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:14.253544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.253547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:14.253548Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:14.253568Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:14.253691Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:14.255386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId: src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:14.257797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:14.301763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534512447050384:8815]
2025-10-02T08:13:14.301868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1676, pipe: [1:7556534512447050384:8815]
2025-10-02T08:13:14.385513Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:14.385871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.385886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.385924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447050384:8815], now have 1 active actors on pipe
2025-10-02T08:13:14.386047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534512447050384:8815]
2025-10-02T08:13:14.386079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:14.386081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:14.386129Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:14.386143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1677 reason: error at write: Disconnected sessionId: src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0
2025-10-02T08:13:14.386137Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:14.386298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1677 sessionId: src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0 is DEAD
2025-10-02T08:13:14.386377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:14.386383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0] Write session will restart in 0.009672s
2025-10-02T08:13:14.386402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0] Write session: Do CDS request
2025-10-02T08:13:14.386406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:14.397310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.397361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:14.397380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1678
2025-10-02T08:13:14.397530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.397568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:14.397577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:14.397580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:14.398003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1678 sessionId:  describe result for acl check
2025-10-02T08:13:14.398037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:14.398043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:14.398045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:14.398050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534512447050896:7423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:14.398533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534512447050896:7423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:14.400588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534512447050896:7423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:14.402165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:14.402506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:14.402659Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:14.402671Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:14.402681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:14.402726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:14.402759Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534512447050977:7431]
2025-10-02T08:13:14.402849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534512447050896:7423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:14.402863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534512447050896:7423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:14.402867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534512447050896:7423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:14.402874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:14.403319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:14.403497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:14.403543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:14.403824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:14.403871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.403877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.403878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.403879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.403880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.403884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.403893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.403896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.403900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.403903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.403909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.403914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.403920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.403925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.403929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.403937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.403941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.403946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.403950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.403954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.403969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:14.411864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:14.413618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:14.413635Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:14.413637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:14.413640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:14.413646Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1677 [1:7556534512447050977:7431]
2025-10-02T08:13:14.413656Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:14.413672Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:14.413675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.413677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.413684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.413699Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:14.413708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:14.413714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:14.413960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.413971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.413976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:14.413978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:14.414041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:14.414048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.414061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.414077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:14.414098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447050982:7423], now have 1 active actors on pipe
2025-10-02T08:13:14.414108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534512447050971:7431]
2025-10-02T08:13:14.414110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534512447050971:7431]
2025-10-02T08:13:14.414118Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:14.414130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534512906805337:2378], now have 1 active actors on pipe
2025-10-02T08:13:14.414129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1677
2025-10-02T08:13:14.414142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:14.414155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:14.414157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:14.414163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:14.414143Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1677
2025-10-02T08:13:14.414176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:14.414192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.414195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.414207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534512447050971:7431]
2025-10-02T08:13:14.414216Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:14.414218Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:14.414239Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:14.414249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.414252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.414255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:14.414263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.414276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:14.414299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.414348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.414355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.414367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.414403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1678 partition: 0 MaxSeqNo: 17 sessionId: src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0
2025-10-02T08:13:14.414696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a626cb8-6ff745db-c2d09a67-8cd049b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:14.417603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0] Write session: try to update token
2025-10-02T08:13:14.417619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:14.432169Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:14.432200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:14.432201Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:14.432208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534512447050971:7431]
2025-10-02T08:13:14.432216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534512447050971:7431]
2025-10-02T08:13:14.432252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:14.432256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.432258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:14.432270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:14.432276Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:14.432378Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:14.433587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId: src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:14.436372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:14.486077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534512447051021:8815]
2025-10-02T08:13:14.486230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1677, pipe: [1:7556534512447051021:8815]
2025-10-02T08:13:14.577661Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:14.577998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.578012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.578049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447051021:8815], now have 1 active actors on pipe
2025-10-02T08:13:14.578169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534512447051021:8815]
2025-10-02T08:13:14.578192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:14.578193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:14.578245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1678 reason: error at write: Disconnected sessionId: src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0
2025-10-02T08:13:14.578304Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:14.578268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:14.578405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1678 sessionId: src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0 is DEAD
2025-10-02T08:13:14.578649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:14.578667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0] Write session will restart in 0.009113s
2025-10-02T08:13:14.578697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0] Write session: Do CDS request
2025-10-02T08:13:14.578706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:14.589411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.589452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:14.589470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1679
2025-10-02T08:13:14.589685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.589714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:14.589723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:14.589727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:14.590124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1679 sessionId:  describe result for acl check
2025-10-02T08:13:14.590160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:14.590166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:14.590168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:14.590173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534512447051476:7410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:14.590687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534512447051476:7410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:14.593818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534512447051476:7410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:14.596767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:14.597068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534512447051476:7410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:14.597081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534512447051476:7410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:14.597084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534512447051476:7410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:14.597092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:14.597178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:14.597438Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:14.597447Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:14.597458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:14.597502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:14.597529Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534512447051625:7415]
2025-10-02T08:13:14.597987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:14.598175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:14.598228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:14.598567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:14.598622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.598629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.598630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.598631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.598632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.598638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.598648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.598657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.598665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.598669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.598673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.598681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.598691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.598696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.598704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.598709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.598713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.598733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.598738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.598742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.598764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:14.606667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:14.608606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:14.608624Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:14.608627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:14.608630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:14.608637Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1678 [1:7556534512447051625:7415]
2025-10-02T08:13:14.608650Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:14.608670Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:14.608677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.608680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.608682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.608697Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:14.608707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:14.608717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:14.608778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.608787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.608790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:14.608793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:14.608866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:14.608869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.608882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.608895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:14.608918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447051620:7410], now have 1 active actors on pipe
2025-10-02T08:13:14.608924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1678
2025-10-02T08:13:14.608934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534512447051613:7415]
2025-10-02T08:13:14.608936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534512447051613:7415]
2025-10-02T08:13:14.608948Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:14.608957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534512906805343:2378], now have 1 active actors on pipe
2025-10-02T08:13:14.608964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.608967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:14.608970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.608971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:14.608985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:14.609004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:14.609008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:14.609018Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1678
2025-10-02T08:13:14.609045Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:14.609056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.609060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.609061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:14.609070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.609082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:14.609096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534512447051613:7415]
2025-10-02T08:13:14.609109Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:14.609120Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:14.609139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.609213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.609221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.609234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.609271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1679 partition: 0 MaxSeqNo: 17 sessionId: src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0
2025-10-02T08:13:14.609622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b4eba1-131449c4-4ef72389-220b0ea1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:14.612304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0] Write session: try to update token
2025-10-02T08:13:14.612320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:14.626482Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:14.626507Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:14.626510Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:14.626518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534512447051613:7415]
2025-10-02T08:13:14.626522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534512447051613:7415]
2025-10-02T08:13:14.626566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:14.626566Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:14.626572Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:14.626577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.626579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:14.626722Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:14.630742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId: src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:14.633715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:14.678082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534512447051652:8815]
2025-10-02T08:13:14.678188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1678, pipe: [1:7556534512447051652:8815]
2025-10-02T08:13:14.760437Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:14.760878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.760891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.760922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447051652:8815], now have 1 active actors on pipe
2025-10-02T08:13:14.761007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534512447051652:8815]
2025-10-02T08:13:14.761036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:14.761038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:14.761047Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:14.761097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1679 reason: error at write: Disconnected sessionId: src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0
2025-10-02T08:13:14.761117Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:14.761260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1679 sessionId: src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0 is DEAD
2025-10-02T08:13:14.761475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:14.761489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0] Write session will restart in 0.009254s
2025-10-02T08:13:14.761519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0] Write session: Do CDS request
2025-10-02T08:13:14.761526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:14.772421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.772511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:14.772528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1680
2025-10-02T08:13:14.772658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.772690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:14.772698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:14.772701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:14.773197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1680 sessionId:  describe result for acl check
2025-10-02T08:13:14.773235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:14.773241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:14.773242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:14.773248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534512447052124:7398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:14.773747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534512447052124:7398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:14.776827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534512447052124:7398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:14.778222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:14.780023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:14.780188Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:14.780197Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:14.780205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:14.780247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:14.780281Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534512447052251:7406]
2025-10-02T08:13:14.780366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534512447052124:7398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:14.780379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534512447052124:7398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:14.780382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534512447052124:7398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:14.780389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:14.780895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:14.781166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:14.781202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:14.781486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:14.781524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.781530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.781531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.781532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.781533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.781538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.781547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.781551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.781555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.781560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.781566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.781577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.781587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.781592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.781597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.781601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.781605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.781610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.781614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.781624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.781642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:14.789537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:14.791214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:14.791231Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:14.791234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:14.791238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:14.791244Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1679 [1:7556534512447052251:7406]
2025-10-02T08:13:14.791255Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:14.791271Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:14.791275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.791278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.791280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.791295Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:14.791300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:14.791307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:14.791366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.791375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.791378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:14.791381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:14.791449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:14.791456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.791469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.791484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:14.791506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447052256:7398], now have 1 active actors on pipe
2025-10-02T08:13:14.791514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534512906805352:2378], now have 1 active actors on pipe
2025-10-02T08:13:14.791521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534512447052245:7406]
2025-10-02T08:13:14.791522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1679
2025-10-02T08:13:14.791523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534512447052245:7406]
2025-10-02T08:13:14.791535Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:14.791545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:14.791550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:14.791555Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:14.791562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:14.791565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:14.791571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.791575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.791613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534512447052245:7406]
2025-10-02T08:13:14.791593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1679
2025-10-02T08:13:14.791623Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:14.791623Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:14.791636Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:14.791642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.791645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.791648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:14.791656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.791664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:14.791706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.791750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.791757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.791768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.791800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1680 partition: 0 MaxSeqNo: 17 sessionId: src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0
2025-10-02T08:13:14.792198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bec11b-944dc659-b9b46bc2-725afd9e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:14.795419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0] Write session: try to update token
2025-10-02T08:13:14.795438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:14.809725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:14.809750Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:14.809753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:14.809763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534512447052245:7406]
2025-10-02T08:13:14.809766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534512447052245:7406]
2025-10-02T08:13:14.809815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:14.809822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.809825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:14.809824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:14.809831Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:14.809971Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:14.812704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId: src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:14.815397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:14.861457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534512447052282:8815]
2025-10-02T08:13:14.861596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1679, pipe: [1:7556534512447052282:8815]
2025-10-02T08:13:14.941517Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:14.942224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.942237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.942273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447052282:8815], now have 1 active actors on pipe
2025-10-02T08:13:14.942375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:14.942390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:14.942455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1680 reason: error at write: Disconnected sessionId: src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0
2025-10-02T08:13:14.942469Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:14.942629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1680 sessionId: src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0 is DEAD
2025-10-02T08:13:14.942691Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:14.942814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:14.942837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0] Write session will restart in 0.007631s
2025-10-02T08:13:14.942810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534512447052282:8815]
2025-10-02T08:13:14.942870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0] Write session: Do CDS request
2025-10-02T08:13:14.942878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:14.951418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.951648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:14.951665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1681
2025-10-02T08:13:14.951804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:14.951832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:14.951837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:14.951840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:14.952223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1681 sessionId:  describe result for acl check
2025-10-02T08:13:14.952250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:14.952255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:14.952257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:14.952261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534512447052677:7388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:14.952752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534512447052677:7388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:14.955162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534512447052677:7388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:14.957890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534512447052677:7388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:14.957904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534512447052677:7388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:14.957906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534512447052677:7388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:14.957912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:14.960269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:14.960598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:14.960749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:14.960759Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:14.960769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:14.960825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:14.960863Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534512447052887:7386]
2025-10-02T08:13:14.961471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:14.961635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:14.961675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:14.961959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:14.962000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.962005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.962007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.962008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.962009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.962014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.962024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.962028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.962032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.962035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.962042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.962049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:14.962054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.962060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:14.962064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.962069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:14.962073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.962078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.962087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.962092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.962110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:14.970006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:14.971579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:14.971599Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:14.971603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:14.971606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:14.971613Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1680 [1:7556534512447052887:7386]
2025-10-02T08:13:14.971626Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:14.971643Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:14.971646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.971649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.971651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.971667Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:14.971672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:14.971678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:14.971743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.971753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.971756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:14.971760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:14.971825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:14.971834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.971847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:14.971864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:14.971869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1680
2025-10-02T08:13:14.971886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534512447052870:7388], now have 1 active actors on pipe
2025-10-02T08:13:14.971890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534512906805359:2378], now have 1 active actors on pipe
2025-10-02T08:13:14.971894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.971899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.971919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534512447052881:7386]
2025-10-02T08:13:14.971927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534512447052881:7386]
2025-10-02T08:13:14.971935Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:14.971945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:14.971948Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:14.971953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:14.971967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:14.971976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:14.971949Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1680
2025-10-02T08:13:14.971992Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:14.972003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:14.972006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:14.972008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:14.972017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:14.972028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:14.972072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534512447052881:7386]
2025-10-02T08:13:14.972085Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:14.972097Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:14.972098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.972158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:14.972166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:14.972193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:14.972236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1681 partition: 0 MaxSeqNo: 17 sessionId: src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0
2025-10-02T08:13:14.972606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74a3ce-a0290a84-f42d04ed-f127ca43_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:14.975762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0] Write session: try to update token
2025-10-02T08:13:14.975786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:14.989298Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:14.989324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:14.989326Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:14.989335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534512447052881:7386]
2025-10-02T08:13:14.989340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534512447052881:7386]
2025-10-02T08:13:14.989383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:14.989388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:14.989387Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:14.989394Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:14.989397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:14.989541Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:14.991339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId: src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:14.994080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:15.047885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534516742020222:8815]
2025-10-02T08:13:15.049715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1680, pipe: [1:7556534516742020222:8815]
2025-10-02T08:13:15.129008Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:15.129623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.129640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.129686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742020222:8815], now have 1 active actors on pipe
2025-10-02T08:13:15.129771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:15.129778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:15.129846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1681 reason: error at write: Disconnected sessionId: src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0
2025-10-02T08:13:15.129898Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:15.129909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:15.130017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1681 sessionId: src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0 is DEAD
2025-10-02T08:13:15.130194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534516742020222:8815]
2025-10-02T08:13:15.130539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:15.130555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0] Write session will restart in 0.006170s
2025-10-02T08:13:15.130585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0] Write session: Do CDS request
2025-10-02T08:13:15.130594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:15.138422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.138473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:15.138492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1682
2025-10-02T08:13:15.138657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.138686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:15.138696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:15.138699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:15.139074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1682 sessionId:  describe result for acl check
2025-10-02T08:13:15.139102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:15.139104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:15.139104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:15.139108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534516742020590:7363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:15.139553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534516742020590:7363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:15.141889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534516742020590:7363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:15.145605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534516742020590:7363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:15.145624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534516742020590:7363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:15.145627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534516742020590:7363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:15.145636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:15.150580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:15.150985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:15.151145Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:15.151155Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:15.151163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:15.151205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:15.151243Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534516742020851:7362]
2025-10-02T08:13:15.151903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:15.152089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:15.152127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:15.152449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:15.152490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.152496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.152497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.152498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.152500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.152505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.152514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.152523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.152527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.152531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.152536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.152543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.152549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.152554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.152558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.152564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.152568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.152573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.152577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.152582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.152603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:15.160311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:15.161837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:15.161857Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:15.161861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:15.161865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:15.161872Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1681 [1:7556534516742020851:7362]
2025-10-02T08:13:15.161883Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:15.161900Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:15.161905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.161910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.161912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.161927Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:15.161936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:15.161943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:15.162000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.162007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.162011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:15.162014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:15.162072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:15.162081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.162094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.162112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:15.162133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742020806:7363], now have 1 active actors on pipe
2025-10-02T08:13:15.162140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534517201772687:2378], now have 1 active actors on pipe
2025-10-02T08:13:15.162147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534516742020845:7362]
2025-10-02T08:13:15.162154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534516742020845:7362]
2025-10-02T08:13:15.162167Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:15.162177Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:15.162180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.162185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.162186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:15.162202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:15.162224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:15.162233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:15.162234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1681
2025-10-02T08:13:15.162274Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af11e300-9f75f42e-f40cf9be-4955f037_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:15.162288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.162297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.162299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:15.162309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.162317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:15.162338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1681
2025-10-02T08:13:15.162583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534516742020845:7362]
2025-10-02T08:13:15.162600Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:15.162610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:15.162636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.162683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.162691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.162706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.162741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1682 partition: 0 MaxSeqNo: 17 sessionId: src_id|af11e300-9f75f42e-f40cf9be-4955f037_0
2025-10-02T08:13:15.163138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fb2eb4-13cfa5ad-d55c33d9-686f1c80_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|af11e300-9f75f42e-f40cf9be-4955f037_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:15.167542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af11e300-9f75f42e-f40cf9be-4955f037_0] Write session: try to update token
2025-10-02T08:13:15.167564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af11e300-9f75f42e-f40cf9be-4955f037_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:15.180132Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:15.180156Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:15.180159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:15.180168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534516742020845:7362]
2025-10-02T08:13:15.180173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534516742020845:7362]
2025-10-02T08:13:15.180229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:15.180238Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:15.180240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.180242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:15.180252Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:15.180374Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:15.185128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId: src_id|af11e300-9f75f42e-f40cf9be-4955f037_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:15.188292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:15.230544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534516742020875:8815]
2025-10-02T08:13:15.230665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1681, pipe: [1:7556534516742020875:8815]
2025-10-02T08:13:15.318681Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:15.319128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.319138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.319157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742020875:8815], now have 1 active actors on pipe
2025-10-02T08:13:15.319283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534516742020875:8815]
2025-10-02T08:13:15.319317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:15.319319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:15.319388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1682 reason: error at write: Disconnected sessionId: src_id|af11e300-9f75f42e-f40cf9be-4955f037_0
2025-10-02T08:13:15.319431Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:15.319563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1682 sessionId: src_id|af11e300-9f75f42e-f40cf9be-4955f037_0 is DEAD
2025-10-02T08:13:15.319566Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:15.319754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af11e300-9f75f42e-f40cf9be-4955f037_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:15.319768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af11e300-9f75f42e-f40cf9be-4955f037_0] Write session will restart in 0.005057s
2025-10-02T08:13:15.319797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af11e300-9f75f42e-f40cf9be-4955f037_0] Write session: Do CDS request
2025-10-02T08:13:15.319804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af11e300-9f75f42e-f40cf9be-4955f037_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:15.326391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af11e300-9f75f42e-f40cf9be-4955f037_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.326525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:15.326546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1683
2025-10-02T08:13:15.326688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.326735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:15.326745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:15.326749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:15.327143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1683 sessionId:  describe result for acl check
2025-10-02T08:13:15.327170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:15.327177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:15.327179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:15.327184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534516742021179:7350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:15.327672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534516742021179:7350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:15.330255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534516742021179:7350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:15.333670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534516742021179:7350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:15.333684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534516742021179:7350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:15.333686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534516742021179:7350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:15.333692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:15.337732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:15.339357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:15.339517Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:15.339526Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:15.339533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:15.339576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:15.339603Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534516742021486:7348]
2025-10-02T08:13:15.340116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:15.340332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:15.340367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:15.340620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:15.340674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.340679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.340680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.340681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.340681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.340685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.340691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.340693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.340695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.340698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.340702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.340706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.340710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.340713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.340715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.340722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.340726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.340731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.340735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.340740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.340758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:15.348746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:15.350589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:15.350600Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:15.350602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:15.350604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:15.350609Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1682 [1:7556534516742021486:7348]
2025-10-02T08:13:15.350616Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:15.350629Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:15.350634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.350636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.350637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.350649Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:15.350654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:15.350658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:15.350701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.350707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.350709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:15.350712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:15.350766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:15.350773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.350781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.350789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:15.350808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534516742021480:7348]
2025-10-02T08:13:15.350811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534516742021480:7348]
2025-10-02T08:13:15.350818Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:15.350836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534517201772693:2378], now have 1 active actors on pipe
2025-10-02T08:13:15.350839Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:15.350843Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:15.350846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:15.350860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:15.350862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:15.350872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742021413:7350], now have 1 active actors on pipe
2025-10-02T08:13:15.350875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1682
2025-10-02T08:13:15.350900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.350906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.350917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534516742021480:7348]
2025-10-02T08:13:15.350927Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:15.350945Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:15.350949Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:15.350953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.350956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.350958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:15.350964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.350938Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1682
2025-10-02T08:13:15.350970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:15.350984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.351046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.351052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.351061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.351086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1683 partition: 0 MaxSeqNo: 17 sessionId: src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0
2025-10-02T08:13:15.351531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af11e300-9f75f42e-f40cf9be-4955f037_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:15.354347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0] Write session: try to update token
2025-10-02T08:13:15.354365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:15.367848Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:15.367869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:15.367871Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:15.367878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534516742021480:7348]
2025-10-02T08:13:15.367881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534516742021480:7348]
2025-10-02T08:13:15.367923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:15.367932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.367933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:15.367937Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:15.367943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:15.368061Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:15.368510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId: src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:15.371207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:15.419452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534516742021510:8815]
2025-10-02T08:13:15.419568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1682, pipe: [1:7556534516742021510:8815]
2025-10-02T08:13:15.509122Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:15.509458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.509469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.509499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742021510:8815], now have 1 active actors on pipe
2025-10-02T08:13:15.509617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534516742021510:8815]
2025-10-02T08:13:15.509644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:15.509650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:15.509713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1683 reason: error at write: Disconnected sessionId: src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0
2025-10-02T08:13:15.509732Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:15.509823Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:15.509887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1683 sessionId: src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0 is DEAD
2025-10-02T08:13:15.510002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:15.510009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0] Write session will restart in 0.006071s
2025-10-02T08:13:15.510035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0] Write session: Do CDS request
2025-10-02T08:13:15.510041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:15.517212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.517275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:15.517293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1684
2025-10-02T08:13:15.517394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.517422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:15.517431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:15.517434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:15.517883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1684 sessionId:  describe result for acl check
2025-10-02T08:13:15.517908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:15.517912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:15.517913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:15.517916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534516742021881:7329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:15.518299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534516742021881:7329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:15.520480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534516742021881:7329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:15.523173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534516742021881:7329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:15.523186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534516742021881:7329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:15.523189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534516742021881:7329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:15.523194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:15.526560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:15.526957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:15.527141Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:15.527151Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:15.527162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:15.527211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:15.527249Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534516742022133:7330]
2025-10-02T08:13:15.527694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:15.527898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:15.527948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:15.528268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:15.528316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.528322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.528324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.528325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.528326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.528332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.528341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.528345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.528351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.528355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.528360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.528367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.528373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.528378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.528382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.528387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.528391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.528396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.528401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.528406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.528423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:15.536333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:15.537977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:15.537994Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:15.537996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:15.538000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:15.538006Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1683 [1:7556534516742022133:7330]
2025-10-02T08:13:15.538018Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:15.538034Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:15.538041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.538044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.538045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.538061Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:15.538066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:15.538076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:15.538127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.538136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.538138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:15.538140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:15.538200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:15.538208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.538220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.538233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:15.538249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1683
2025-10-02T08:13:15.538255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742022099:7329], now have 1 active actors on pipe
2025-10-02T08:13:15.538261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534516742022127:7330]
2025-10-02T08:13:15.538263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534516742022127:7330]
2025-10-02T08:13:15.538272Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:15.538285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.538288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.538290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:15.538293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:15.538307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534517201772711:2378], now have 1 active actors on pipe
2025-10-02T08:13:15.538318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:15.538334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:15.538341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:15.538378Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:15.538353Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1683
2025-10-02T08:13:15.538388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.538396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.538397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:15.538403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.538411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:15.538422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534516742022127:7330]
2025-10-02T08:13:15.538427Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:15.538434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:15.538448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.538647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.538652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.538662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.538694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1684 partition: 0 MaxSeqNo: 17 sessionId: src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0
2025-10-02T08:13:15.538962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10315a51-b5b3a6f9-67ad850f-6b84c56b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:15.541345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0] Write session: try to update token
2025-10-02T08:13:15.541358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:15.554751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId: src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:15.555967Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:15.555989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:15.555991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:15.555999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534516742022127:7330]
2025-10-02T08:13:15.556002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534516742022127:7330]
2025-10-02T08:13:15.556047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:15.556053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:15.556058Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:15.556060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.556063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:15.556220Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:15.557440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:15.609934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534516742022161:8815]
2025-10-02T08:13:15.610018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1683, pipe: [1:7556534516742022161:8815]
2025-10-02T08:13:15.690204Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:15.690517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.690527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.690557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742022161:8815], now have 1 active actors on pipe
2025-10-02T08:13:15.690810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:15.690821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:15.690854Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:15.690883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1684 reason: error at write: Disconnected sessionId: src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0
2025-10-02T08:13:15.690924Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:15.691033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1684 sessionId: src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0 is DEAD
2025-10-02T08:13:15.691095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534516742022161:8815]
2025-10-02T08:13:15.691210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:15.691223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0] Write session will restart in 0.009498s
2025-10-02T08:13:15.691247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0] Write session: Do CDS request
2025-10-02T08:13:15.691254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:15.702312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.702383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:15.702397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1685
2025-10-02T08:13:15.702510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.702533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:15.702537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:15.702539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:15.703114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1685 sessionId:  describe result for acl check
2025-10-02T08:13:15.703143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:15.703150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:15.703151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:15.703157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534516742022662:7318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:15.703582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534516742022662:7318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:15.705776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534516742022662:7318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:15.706682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:15.708052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:15.708214Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:15.708222Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:15.708231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:15.708272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:15.708307Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534516742022769:7303]
2025-10-02T08:13:15.708358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534516742022662:7318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:15.708370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534516742022662:7318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:15.708372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534516742022662:7318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:15.708377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:15.708889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:15.709047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:15.709080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:15.709346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:15.709389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.709394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.709395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.709396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.709397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.709402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.709411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.709414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.709418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.709422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.709428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.709434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.709440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.709445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.709449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.709453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.709457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.709462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.709466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.709474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.709493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:15.717697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:15.719414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:15.719431Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:15.719434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:15.719438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:15.719443Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1684 [1:7556534516742022769:7303]
2025-10-02T08:13:15.719456Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:15.719472Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:15.719475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.719478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.719480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.719495Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:15.719500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:15.719511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:15.719568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.719575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.719578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:15.719581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:15.719647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:15.719656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.719668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.719682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:15.719704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534516742022763:7303]
2025-10-02T08:13:15.719709Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534516742022763:7303]
2025-10-02T08:13:15.719718Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:15.719730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:15.719734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742022774:7318], now have 1 active actors on pipe
2025-10-02T08:13:15.719737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534517201772720:2378], now have 1 active actors on pipe
2025-10-02T08:13:15.719738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1684
2025-10-02T08:13:15.719743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:15.719744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:15.719757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:15.719760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:15.719791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.719800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.719812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534516742022763:7303]
2025-10-02T08:13:15.719819Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:15.719781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1684
2025-10-02T08:13:15.719821Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:15.719843Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15be5aa0-b9146b99-1056a060-d94b2353_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:15.719853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.719856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.719858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:15.719867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.719879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:15.719910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.719974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.719991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.720015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.720060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1685 partition: 0 MaxSeqNo: 17 sessionId: src_id|15be5aa0-b9146b99-1056a060-d94b2353_0
2025-10-02T08:13:15.720471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93d4d26c-74f4c3ee-99033d48-dfa8668c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15be5aa0-b9146b99-1056a060-d94b2353_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:15.723401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15be5aa0-b9146b99-1056a060-d94b2353_0] Write session: try to update token
2025-10-02T08:13:15.723419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15be5aa0-b9146b99-1056a060-d94b2353_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:15.737503Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:15.737527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:15.737529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:15.737538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534516742022763:7303]
2025-10-02T08:13:15.737542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534516742022763:7303]
2025-10-02T08:13:15.737586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:15.737591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.737594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:15.737593Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:15.737599Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:15.737727Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:15.739391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId: src_id|15be5aa0-b9146b99-1056a060-d94b2353_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:15.741826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:15.791202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534516742022803:8815]
2025-10-02T08:13:15.791272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1684, pipe: [1:7556534516742022803:8815]
2025-10-02T08:13:15.876162Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:15.876491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.876502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.876533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742022803:8815], now have 1 active actors on pipe
2025-10-02T08:13:15.876662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534516742022803:8815]
2025-10-02T08:13:15.876689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:15.876691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:15.876727Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:15.876751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1685 reason: error at write: Disconnected sessionId: src_id|15be5aa0-b9146b99-1056a060-d94b2353_0
2025-10-02T08:13:15.876769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:15.876916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1685 sessionId: src_id|15be5aa0-b9146b99-1056a060-d94b2353_0 is DEAD
2025-10-02T08:13:15.877096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15be5aa0-b9146b99-1056a060-d94b2353_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:15.877112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15be5aa0-b9146b99-1056a060-d94b2353_0] Write session will restart in 0.006443s
2025-10-02T08:13:15.877141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15be5aa0-b9146b99-1056a060-d94b2353_0] Write session: Do CDS request
2025-10-02T08:13:15.877148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15be5aa0-b9146b99-1056a060-d94b2353_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:15.884364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15be5aa0-b9146b99-1056a060-d94b2353_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.884443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:15.884460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1686
2025-10-02T08:13:15.884576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:15.884602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:15.884611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:15.884615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:15.885045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1686 sessionId:  describe result for acl check
2025-10-02T08:13:15.885100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:15.885108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:15.885110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:15.885115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534516742023131:7313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:15.885643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534516742023131:7313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:15.888399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534516742023131:7313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:15.892392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534516742023131:7313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:15.892410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534516742023131:7313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:15.892413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534516742023131:7313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:15.892430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:15.894381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:15.896588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:15.896743Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:15.896753Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:15.896760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:15.896796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:15.896847Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534516742023417:7314]
2025-10-02T08:13:15.897353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:15.897536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:15.897578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:15.897884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:15.897925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.897931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.897932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.897933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.897934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.897939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.897949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.897952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.897957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.897965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.897969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.897976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:15.897981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.897986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:15.897990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.897995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:15.897999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.898004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.898009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.898018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.898035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:15.906417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:15.908115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:15.908132Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:15.908134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:15.908138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:15.908144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1685 [1:7556534516742023417:7314]
2025-10-02T08:13:15.908155Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:15.908168Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:15.908171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.908173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.908186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.908199Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:15.908203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:15.908208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:15.908260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.908266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.908268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:15.908270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:15.908316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:15.908322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.908332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:15.908342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:15.908359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534516742023411:7314]
2025-10-02T08:13:15.908364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534516742023411:7314]
2025-10-02T08:13:15.908373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:15.908385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:15.908397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:15.908396Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:15.908398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1685
2025-10-02T08:13:15.908399Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:15.908401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:15.908408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742023391:7313], now have 1 active actors on pipe
2025-10-02T08:13:15.908434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534517201772727:2378], now have 1 active actors on pipe
2025-10-02T08:13:15.908441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534516742023411:7314]
2025-10-02T08:13:15.908448Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:15.908454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.908458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.908461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:15.908504Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2f1af06-aa3bd062-c1211445-de6a949_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:15.908515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:15.908519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:15.908521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:15.908491Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1685
2025-10-02T08:13:15.908530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:15.908542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:15.908572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.908610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:15.908616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:15.908628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:15.908663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1686 partition: 0 MaxSeqNo: 17 sessionId: src_id|b2f1af06-aa3bd062-c1211445-de6a949_0
2025-10-02T08:13:15.909028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15be5aa0-b9146b99-1056a060-d94b2353_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b2f1af06-aa3bd062-c1211445-de6a949_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:15.911949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f1af06-aa3bd062-c1211445-de6a949_0] Write session: try to update token
2025-10-02T08:13:15.911967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f1af06-aa3bd062-c1211445-de6a949_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:15.924715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId: src_id|b2f1af06-aa3bd062-c1211445-de6a949_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:15.925546Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:15.925561Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:15.925562Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:15.925568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534516742023411:7314]
2025-10-02T08:13:15.925571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534516742023411:7314]
2025-10-02T08:13:15.925604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:15.925609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:15.925614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:15.925671Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:15.925690Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:15.925737Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:15.929050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:15.977013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534516742023445:8815]
2025-10-02T08:13:15.977115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1685, pipe: [1:7556534516742023445:8815]
2025-10-02T08:13:16.063208Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:16.063671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.063689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.063729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534516742023445:8815], now have 1 active actors on pipe
2025-10-02T08:13:16.063844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:16.063860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:16.063925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1686 reason: error at write: Disconnected sessionId: src_id|b2f1af06-aa3bd062-c1211445-de6a949_0
2025-10-02T08:13:16.063977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:16.064129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1686 sessionId: src_id|b2f1af06-aa3bd062-c1211445-de6a949_0 is DEAD
2025-10-02T08:13:16.064286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f1af06-aa3bd062-c1211445-de6a949_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:16.064299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f1af06-aa3bd062-c1211445-de6a949_0] Write session will restart in 0.005060s
2025-10-02T08:13:16.064322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f1af06-aa3bd062-c1211445-de6a949_0] Write session: Do CDS request
2025-10-02T08:13:16.064329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f1af06-aa3bd062-c1211445-de6a949_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:16.064478Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:16.065004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534516742023445:8815]
2025-10-02T08:13:16.070262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f1af06-aa3bd062-c1211445-de6a949_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.070383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:16.070400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1687
2025-10-02T08:13:16.070477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.070505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:16.070514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:16.070517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:16.070880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1687 sessionId:  describe result for acl check
2025-10-02T08:13:16.070910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:16.070916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:16.070917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:16.070923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534521036991022:7292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:16.071488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534521036991022:7292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:16.076913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534521036991022:7292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:16.082615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534521036991022:7292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:16.082642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534521036991022:7292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:16.082645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534521036991022:7292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:16.082653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:16.084671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:16.085137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:16.085308Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:16.085318Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:16.085328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:16.085371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:16.085410Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534521036991369:7294]
2025-10-02T08:13:16.086046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:16.086278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:16.086323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:16.086622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:16.086665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.086670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.086671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.086673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.086674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.086679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.086689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.086694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.086697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.086702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.086706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.086714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.086720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.086730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.086734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.086740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.086748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.086753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.086758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.086764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.086783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:16.095195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:16.097174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:16.097192Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:16.097194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:16.097198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:16.097204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1686 [1:7556534521036991369:7294]
2025-10-02T08:13:16.097215Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:16.097232Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:16.097236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.097238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.097241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.097256Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:16.097262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:16.097268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:16.097327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.097335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.097338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:16.097342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:16.097410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:16.097418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.097431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.097446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:16.097466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534521036991363:7294]
2025-10-02T08:13:16.097481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534521036991363:7294]
2025-10-02T08:13:16.097490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:16.097503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:16.097515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:16.097517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:16.097519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:16.097524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:16.097527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1686
2025-10-02T08:13:16.097529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036991359:7292], now have 1 active actors on pipe
2025-10-02T08:13:16.097560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534521496740030:2378], now have 1 active actors on pipe
2025-10-02T08:13:16.097568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534521036991363:7294]
2025-10-02T08:13:16.097575Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:16.097588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.097592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:16.097592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.097633Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6900a058-da50e8f7-a14af077-5879fa10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:16.097645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.097617Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1686
2025-10-02T08:13:16.097648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.097651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:16.097658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.097665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:16.097688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.097719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.097726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.097738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.097770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1687 partition: 0 MaxSeqNo: 17 sessionId: src_id|6900a058-da50e8f7-a14af077-5879fa10_0
2025-10-02T08:13:16.098094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f1af06-aa3bd062-c1211445-de6a949_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6900a058-da50e8f7-a14af077-5879fa10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:16.100591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900a058-da50e8f7-a14af077-5879fa10_0] Write session: try to update token
2025-10-02T08:13:16.100602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900a058-da50e8f7-a14af077-5879fa10_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:16.114157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId: src_id|6900a058-da50e8f7-a14af077-5879fa10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:16.115602Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:16.115615Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:16.115617Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:16.115626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534521036991363:7294]
2025-10-02T08:13:16.115631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534521036991363:7294]
2025-10-02T08:13:16.115675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:16.115674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:16.115680Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:16.115686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.115689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:16.115823Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:16.116481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:16.164942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534521036991418:8815]
2025-10-02T08:13:16.165077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1686, pipe: [1:7556534521036991418:8815]
2025-10-02T08:13:16.249542Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:16.249900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.249911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.249942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036991418:8815], now have 1 active actors on pipe
2025-10-02T08:13:16.250034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:16.250041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:16.250082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1687 reason: error at write: Disconnected sessionId: src_id|6900a058-da50e8f7-a14af077-5879fa10_0
2025-10-02T08:13:16.250160Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:16.250171Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:16.250208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1687 sessionId: src_id|6900a058-da50e8f7-a14af077-5879fa10_0 is DEAD
2025-10-02T08:13:16.250377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900a058-da50e8f7-a14af077-5879fa10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:16.250386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900a058-da50e8f7-a14af077-5879fa10_0] Write session will restart in 0.005160s
2025-10-02T08:13:16.250402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900a058-da50e8f7-a14af077-5879fa10_0] Write session: Do CDS request
2025-10-02T08:13:16.250406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900a058-da50e8f7-a14af077-5879fa10_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:16.250428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534521036991418:8815]
2025-10-02T08:13:16.256297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900a058-da50e8f7-a14af077-5879fa10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.256383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:16.256394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1688
2025-10-02T08:13:16.256482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.256505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:16.256511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:16.256514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:16.257219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1688 sessionId:  describe result for acl check
2025-10-02T08:13:16.257264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:16.257270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:16.257272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:16.257276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534521036991676:7272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:16.257798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534521036991676:7272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:16.260625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534521036991676:7272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:16.263583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534521036991676:7272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:16.263593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534521036991676:7272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:16.263603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534521036991676:7272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:16.263611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:16.269942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:16.272047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:16.272238Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:16.272246Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:16.272256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:16.272304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:16.272352Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534521036992044:7274]
2025-10-02T08:13:16.273007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:16.273225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:16.273270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:16.273589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:16.273636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.273644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.273645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.273646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.273648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.273653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.273664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.273668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.273673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.273677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.273683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.273691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.273696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.273702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.273707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.273712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.273717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.273723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.273733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.273739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.273761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:16.282706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:16.284614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:16.284627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:16.284629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:16.284631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:16.284636Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1687 [1:7556534521036992044:7274]
2025-10-02T08:13:16.284644Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:16.284658Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:16.284660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.284662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.284663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.284675Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:16.284678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:16.284683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:16.284731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.284736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.284739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:16.284741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:16.284793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:16.284818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.284831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.284847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:16.284868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534521036992038:7274]
2025-10-02T08:13:16.284875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534521036992038:7274]
2025-10-02T08:13:16.284883Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:16.284895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:16.284898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036991870:7272], now have 1 active actors on pipe
2025-10-02T08:13:16.284899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:16.284908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:16.284922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:16.284925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:16.284932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534521496740060:2378], now have 1 active actors on pipe
2025-10-02T08:13:16.284971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534521036992038:7274]
2025-10-02T08:13:16.284979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:16.284997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1687
2025-10-02T08:13:16.285027Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:16.285067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.285080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.285112Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:16.285136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.285144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.285146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:16.285156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.285171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:16.285197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.285237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.285243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.285266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.285305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1688 partition: 0 MaxSeqNo: 17 sessionId: src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0
2025-10-02T08:13:16.285631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900a058-da50e8f7-a14af077-5879fa10_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:16.284974Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1687
2025-10-02T08:13:16.288224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0] Write session: try to update token
2025-10-02T08:13:16.288239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:16.301876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId: src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:16.304376Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:16.304393Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:16.304402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534521036992038:7274]
2025-10-02T08:13:16.304438Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:16.304443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:16.304447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:16.304612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:16.304753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:16.304934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:16.305087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:16.305289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:16.305342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.305355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.305378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:16.305411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:16.305432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:16.305483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.305494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.305660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.305729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.305787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.305849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.306164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.306172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.306233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.306304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.306363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.306429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.306470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.306476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.306539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.306600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.306669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.306733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.306781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.306788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.306862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.306932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.307009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.307087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.307145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.307153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.307237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.307307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.307394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.307470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.307528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.307534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.307618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.307688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.307768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.307846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.307915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.307922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.308007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.308082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.308165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.308257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.308311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.308319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.308397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.308468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.308543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.308618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.308675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.308683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.308784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.308868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.308940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.309011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.309066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.309075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.309152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.309223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.309293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.309363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.309418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.309429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.309465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:16.309531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.309566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.309572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:16.309606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:16.309630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:16.309633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:16.309636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:16.309639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:16.310064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:16.310092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:16.310098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:16.310101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:16.310105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:16.310108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:16.310627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:16.310653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:16.310661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:16.310668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:16.310673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:16.310676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:16.311272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:16.311295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:16.311301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:16.311304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:16.311307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:16.314107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:16.314129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:16.314143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392796313
2025-10-02T08:13:16.314291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:16.314307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:16.314312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:16.314317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:16.314322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:16.314324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:16.314760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:16.314775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:16.314779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:16.314782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:16.314784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:16.314786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:16.315191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:16.315206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:16.315214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:16.315216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:16.315218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:16.315220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:16.315672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:16.315697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:16.315702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:16.316772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:16.316787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:16.316791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:16.316796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:16.316818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392796316
2025-10-02T08:13:16.317094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:16.317112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:16.317117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:16.317120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:16.317124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:16.317128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:16.317532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:16.317547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:16.317551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:16.317553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:16.317555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:16.317557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:16.317995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:16.318014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.318125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392796317
2025-10-02T08:13:16.322598Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:16.322616Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:16.322622Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:16.322626Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:16.324171Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:16.324193Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:16.324194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:16.324201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534521036992038:7274]
2025-10-02T08:13:16.324204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534521036992038:7274]
2025-10-02T08:13:16.324249Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:16.324255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:16.324260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.324261Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:16.324262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:16.324395Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:16.350841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534521036992077:8815]
2025-10-02T08:13:16.350982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1687, pipe: [1:7556534521036992077:8815]
2025-10-02T08:13:16.472051Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:16.472526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036992077:8815], now have 1 active actors on pipe
2025-10-02T08:13:16.472651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534521036992077:8815]
2025-10-02T08:13:16.472674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:16.472680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:16.472704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1688 reason: error at write: Disconnected sessionId: src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0
2025-10-02T08:13:16.472840Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:16.472888Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:16.472891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1688 sessionId: src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0 is DEAD
2025-10-02T08:13:16.473030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:16.473043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0] Write session will restart in 0.005997s
2025-10-02T08:13:16.473067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0] Write session: Do CDS request
2025-10-02T08:13:16.473073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:16.480335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.480414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:16.480427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1689
2025-10-02T08:13:16.480639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.480672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:16.480677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:16.480681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:16.481502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1689 sessionId:  describe result for acl check
2025-10-02T08:13:16.481555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:16.481557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:16.481558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:16.481564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534521036992374:7241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:16.482103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534521036992374:7241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:16.484758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534521036992374:7241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:16.487769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534521036992374:7241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:16.487782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534521036992374:7241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:16.487785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534521036992374:7241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:16.487794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:16.494337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:16.497329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:16.497581Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:16.497591Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:16.497601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:16.497655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:16.497703Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534521036992710:7239]
2025-10-02T08:13:16.498377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:16.498545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:16.498584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:16.498878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:16.498917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.498923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.498924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.498925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.498927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.498932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.498942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.498946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.498950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.498954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.498960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.498972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.498982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.498993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.499002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.499006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.499013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.499022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.499031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.499041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.499064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:16.513945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:16.516110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:16.516126Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:16.516130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:16.516133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:16.516140Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1688 [1:7556534521036992710:7239]
2025-10-02T08:13:16.516151Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:16.516170Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:16.516188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.516191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.516192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.516210Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:16.516220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:16.516226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:16.516288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.516296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.516299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:16.516302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:16.516374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:16.516385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.516399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.516412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:16.516428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036992583:7241], now have 1 active actors on pipe
2025-10-02T08:13:16.516436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534521496740081:2378], now have 1 active actors on pipe
2025-10-02T08:13:16.516439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1688
2025-10-02T08:13:16.516443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534521036992704:7239]
2025-10-02T08:13:16.516445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534521036992704:7239]
2025-10-02T08:13:16.516457Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:16.516472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:16.516473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.516478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.516480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:16.516493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:16.516510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:16.516520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:16.516498Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1688
2025-10-02T08:13:16.516561Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bba49904-50e851a-a39667d8-8b4a03c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:16.516572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.516576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.516583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:16.516592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.516600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:16.516619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534521036992704:7239]
2025-10-02T08:13:16.516627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:16.516644Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:16.516653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.516734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.516741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.516754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.516790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1689 partition: 0 MaxSeqNo: 17 sessionId: src_id|bba49904-50e851a-a39667d8-8b4a03c9_0
2025-10-02T08:13:16.517149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|605e1adf-ecda7c31-a3526b4d-8b33a6b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bba49904-50e851a-a39667d8-8b4a03c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:16.519755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba49904-50e851a-a39667d8-8b4a03c9_0] Write session: try to update token
2025-10-02T08:13:16.519769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba49904-50e851a-a39667d8-8b4a03c9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:16.540697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId: src_id|bba49904-50e851a-a39667d8-8b4a03c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:16.541611Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:16.541625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:16.541633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534521036992704:7239]
2025-10-02T08:13:16.541675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:16.541676Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:16.541890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:16.542042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:16.542240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:16.542412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:16.542609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:16.542650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:16.543119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:16.543198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.543210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.543237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:16.543263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:16.543324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.543337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.543491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.543547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.543602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.543656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.543708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.543715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.543774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.543831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.543907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.543969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.544016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.544023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.544083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.544137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.544205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.544320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.544364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.544373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.544471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.544537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.544607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.544671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.544739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.544746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.544849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.544914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.544984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.545099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.545159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.545166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.545249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.545398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.545514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.545630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.545681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.545688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.545942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.546198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.546453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.546590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.546647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.546655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.546768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.546834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.546902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.546974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.547095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.547101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.547179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.547234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.547301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.547360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.547408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.547413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.547483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:16.547544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:16.547602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:16.547668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:16.547719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:16.547724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:16.547772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:16.547829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.547848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.547849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:16.547890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:16.547907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:16.547911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:16.547914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:16.547917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:16.548298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:16.548321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:16.548332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:16.548335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:16.548338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:16.548343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:16.549067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:16.549089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:16.549094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:16.549096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:16.549099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:16.549101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:16.549622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:16.549640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:16.549647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:16.549650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:16.549652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:16.551727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:16.551745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:16.551754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392796551
2025-10-02T08:13:16.551896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:16.551909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:16.551913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:16.551915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:16.551918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:16.551920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:16.552355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:16.552375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:16.552380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:16.552383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:16.552386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:16.552390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:16.552866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:16.552885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:16.552896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:16.552904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:16.552908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:16.552911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:16.553372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:16.553395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:16.553403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:16.554533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:16.554549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:16.554554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:16.554558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:16.554565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392796554
2025-10-02T08:13:16.554851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:16.554871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:16.554877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:16.554880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:16.554883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:16.554887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:16.555347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:16.555364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:16.555368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:16.555370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:16.555372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:16.555375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:16.555822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:16.555841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.555921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392796555
2025-10-02T08:13:16.558312Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:16.558340Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:16.558347Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:16.558355Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:16.558365Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:16.558367Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:16.558369Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:16.558378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534521036992704:7239]
2025-10-02T08:13:16.558382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534521036992704:7239]
2025-10-02T08:13:16.558433Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:16.558446Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:16.558468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:16.558475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.558476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:16.558621Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:16.573015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534521036992736:8815]
2025-10-02T08:13:16.573112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1688, pipe: [1:7556534521036992736:8815]
2025-10-02T08:13:16.700708Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:16.701119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036992736:8815], now have 1 active actors on pipe
2025-10-02T08:13:16.701271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534521036992736:8815]
2025-10-02T08:13:16.701302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:16.701309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:16.701338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1689 reason: error at write: Disconnected sessionId: src_id|bba49904-50e851a-a39667d8-8b4a03c9_0
2025-10-02T08:13:16.701432Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:16.701517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1689 sessionId: src_id|bba49904-50e851a-a39667d8-8b4a03c9_0 is DEAD
2025-10-02T08:13:16.701648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba49904-50e851a-a39667d8-8b4a03c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:16.701657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba49904-50e851a-a39667d8-8b4a03c9_0] Write session will restart in 0.005475s
2025-10-02T08:13:16.701679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba49904-50e851a-a39667d8-8b4a03c9_0] Write session: Do CDS request
2025-10-02T08:13:16.701684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba49904-50e851a-a39667d8-8b4a03c9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:16.701402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:16.706116Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0fff58de822225bc] Result# TEvPutResult {Id# [72075186224037892:1688:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:16.706143Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1688:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:16.706185Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1688:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:16.708296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba49904-50e851a-a39667d8-8b4a03c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.708331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:16.708344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1690
2025-10-02T08:13:16.708511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.708545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:16.708554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:16.708558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:16.709304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1690 sessionId:  describe result for acl check
2025-10-02T08:13:16.709336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:16.709342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:16.709343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:16.709348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534521036992955:7230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:16.709864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534521036992955:7230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:16.712719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534521036992955:7230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:16.715549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534521036992955:7230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:16.715561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534521036992955:7230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:16.715563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534521036992955:7230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:16.715570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:16.721532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:16.723545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:16.723748Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:16.723754Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:16.723764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:16.723822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:16.723858Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534521036993366:7223]
2025-10-02T08:13:16.724449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:16.724621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:16.724664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:16.724903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:16.724935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.724940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.724940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.724941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.724942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.724945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.724952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.724954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.724956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.724958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.724962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.724967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.724970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.724973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.724975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.724978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.724980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.724983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.724988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.724990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.725000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:16.733409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:16.735242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:16.735262Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:16.735265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:16.735269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:16.735275Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1689 [1:7556534521036993366:7223]
2025-10-02T08:13:16.735287Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:16.735304Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:16.735307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.735310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.735312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.735329Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:16.735339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:16.735347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:16.735413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.735420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.735422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:16.735425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:16.735500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:16.735507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.735521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.735538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:16.735558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1689
2025-10-02T08:13:16.735559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036993214:7230], now have 1 active actors on pipe
2025-10-02T08:13:16.735563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534521496740090:2378], now have 1 active actors on pipe
2025-10-02T08:13:16.735569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534521036993360:7223]
2025-10-02T08:13:16.735571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534521036993360:7223]
2025-10-02T08:13:16.735581Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:16.735591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.735592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:16.735595Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:16.735599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.735617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:16.735635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:16.735638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:16.735639Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1689
2025-10-02T08:13:16.735681Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c961720-bcd78527-b4711699-27579760_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:16.735693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.735696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.735699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:16.735708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.735715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:16.735729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534521036993360:7223]
2025-10-02T08:13:16.735740Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:16.735755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:16.735778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.735823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.735830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.735843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.735880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1690 partition: 0 MaxSeqNo: 17 sessionId: src_id|c961720-bcd78527-b4711699-27579760_0
2025-10-02T08:13:16.736193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba49904-50e851a-a39667d8-8b4a03c9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c961720-bcd78527-b4711699-27579760_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:16.738671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c961720-bcd78527-b4711699-27579760_0] Write session: try to update token
2025-10-02T08:13:16.738684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c961720-bcd78527-b4711699-27579760_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:16.753799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId: src_id|c961720-bcd78527-b4711699-27579760_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:16.754053Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:16.754069Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:16.754071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:16.754079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534521036993360:7223]
2025-10-02T08:13:16.754082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534521036993360:7223]
2025-10-02T08:13:16.754131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:16.754131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:16.754138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:16.754142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.754145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:16.754297Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:16.756313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:16.801394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534521036993395:8815]
2025-10-02T08:13:16.801506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1689, pipe: [1:7556534521036993395:8815]
2025-10-02T08:13:16.904877Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:16.905300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.905315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.905356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036993395:8815], now have 1 active actors on pipe
2025-10-02T08:13:16.905461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:16.905472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:16.905596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:16.905955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c961720-bcd78527-b4711699-27579760_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:16.905966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c961720-bcd78527-b4711699-27579760_0] Write session will restart in 0.008885s
2025-10-02T08:13:16.905991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c961720-bcd78527-b4711699-27579760_0] Write session: Do CDS request
2025-10-02T08:13:16.906002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c961720-bcd78527-b4711699-27579760_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:16.905542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1690 reason: error at write: Disconnected sessionId: src_id|c961720-bcd78527-b4711699-27579760_0
2025-10-02T08:13:16.905732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1690 sessionId: src_id|c961720-bcd78527-b4711699-27579760_0 is DEAD
2025-10-02T08:13:16.906055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534521036993395:8815]
2025-10-02T08:13:16.906495Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:16.916329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c961720-bcd78527-b4711699-27579760_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.916395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:16.916408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1691
2025-10-02T08:13:16.916565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:16.916602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:16.916610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:16.916614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:16.917004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1691 sessionId:  describe result for acl check
2025-10-02T08:13:16.917042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:16.917044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:16.917045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:16.917050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534521036993870:7217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:16.917506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534521036993870:7217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:16.920873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534521036993870:7217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:16.922399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:16.924520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:16.924699Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:16.924710Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:16.924718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:16.924771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:16.924843Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534521036994012:7216]
2025-10-02T08:13:16.924979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534521036993870:7217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:16.924992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534521036993870:7217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:16.924995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534521036993870:7217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:16.925004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:16.925505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:16.925668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:16.925711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:16.926013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:16.926052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.926057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.926059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.926060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.926061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.926066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.926078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.926082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.926087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.926091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.926102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.926109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:16.926120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.926126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:16.926130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.926135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:16.926141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.926146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.926152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.926158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.926178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:16.937762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:16.939388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:16.939404Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:16.939407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:16.939411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:16.939416Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1690 [1:7556534521036994012:7216]
2025-10-02T08:13:16.939428Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:16.939446Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:16.939448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.939452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.939453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.939469Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:16.939474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:16.939481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:16.939543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.939550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.939553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:16.939555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:16.939619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:16.939628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.939641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:16.939653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:16.939674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534521036994017:7217], now have 1 active actors on pipe
2025-10-02T08:13:16.939681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1690
2025-10-02T08:13:16.939685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534521036994006:7216]
2025-10-02T08:13:16.939688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534521036994006:7216]
2025-10-02T08:13:16.939694Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:16.939704Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:16.939705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534521496740097:2378], now have 1 active actors on pipe
2025-10-02T08:13:16.939710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:16.939713Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:16.939723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:16.939726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:16.939732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.939736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.939775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534521036994006:7216]
2025-10-02T08:13:16.939783Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:16.939798Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:16.939808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:16.939812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:16.939816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:16.939786Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1690
2025-10-02T08:13:16.939818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:16.939826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:16.939835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:16.940007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.940343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:16.940351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:16.940367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:16.940407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1691 partition: 0 MaxSeqNo: 17 sessionId: src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0
2025-10-02T08:13:16.940778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c961720-bcd78527-b4711699-27579760_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:16.943441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0] Write session: try to update token
2025-10-02T08:13:16.943457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:16.957658Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:16.957678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:16.957681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:16.957689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534521036994006:7216]
2025-10-02T08:13:16.957693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534521036994006:7216]
2025-10-02T08:13:16.957734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:16.957741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:16.957743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:16.957744Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:16.957750Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:16.957889Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:16.958986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId: src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:16.961514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:17.006158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534525331961342:8815]
2025-10-02T08:13:17.006276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1690, pipe: [1:7556534525331961342:8815]
2025-10-02T08:13:17.098003Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:17.098226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.098235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.098266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331961342:8815], now have 1 active actors on pipe
2025-10-02T08:13:17.098493Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:17.098543Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:17.098709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534525331961342:8815]
2025-10-02T08:13:17.098723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:17.098761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1691 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0
2025-10-02T08:13:17.098894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1691 sessionId: src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0 is DEAD
2025-10-02T08:13:17.099050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:17.099060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0] Write session will restart in 0.009660s
2025-10-02T08:13:17.099086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0] Write session: Do CDS request
2025-10-02T08:13:17.099091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:17.110249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.110346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:17.110360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1692
2025-10-02T08:13:17.110454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.110481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:17.110490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:17.110493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:17.110876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1692 sessionId:  describe result for acl check
2025-10-02T08:13:17.110903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:17.110909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:17.110910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:17.110915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534525331961853:7200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:17.111540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534525331961853:7200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:17.115364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534525331961853:7200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:17.117430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:17.117743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:17.117899Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:17.117909Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:17.117919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:17.117961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:17.117995Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534525331961976:7205]
2025-10-02T08:13:17.118611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:17.118813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534525331961853:7200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:17.118821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534525331961853:7200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:17.118823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534525331961853:7200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:17.118831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:17.118950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:17.118982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:17.119175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:17.119209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.119215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.119216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.119217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.119218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.119222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.119231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.119235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.119237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.119239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.119243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.119247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.119250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.119254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.119256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.119259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.119261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.119264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.119267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.119270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.119280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:17.127439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:17.129265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:17.129281Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:17.129284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:17.129287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:17.129294Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1691 [1:7556534525331961976:7205]
2025-10-02T08:13:17.129305Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:17.129321Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:17.129324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.129328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.129330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.129345Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:17.129350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:17.129356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:17.129409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.129416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.129419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:17.129422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:17.129481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:17.129488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.129501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.129518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:17.129529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1691
2025-10-02T08:13:17.129543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331961985:7200], now have 1 active actors on pipe
2025-10-02T08:13:17.129546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534525791707399:2378], now have 1 active actors on pipe
2025-10-02T08:13:17.129551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.129555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.129570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534525331961970:7205]
2025-10-02T08:13:17.129576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534525331961970:7205]
2025-10-02T08:13:17.129588Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:17.129599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:17.129604Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:17.129607Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:17.129617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:17.129620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:17.129635Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:17.129641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.129644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.129646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:17.129603Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1691
2025-10-02T08:13:17.129654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.129668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:17.129705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534525331961970:7205]
2025-10-02T08:13:17.129719Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:17.129726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:17.129740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.129786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.129793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.129807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.129849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1692 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0
2025-10-02T08:13:17.130203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66ac9b-3f9c82de-bed3436a-31198dc4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:17.132653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0] Write session: try to update token
2025-10-02T08:13:17.132666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:17.145767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId: src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:17.147841Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:17.147856Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:17.147859Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:17.147867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534525331961970:7205]
2025-10-02T08:13:17.147872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534525331961970:7205]
2025-10-02T08:13:17.147906Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:17.147911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:17.147917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:17.147923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.147934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:17.148077Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:17.148279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:17.198660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534525331962029:8815]
2025-10-02T08:13:17.198748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1691, pipe: [1:7556534525331962029:8815]
2025-10-02T08:13:17.281188Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:17.282242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.282254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.282284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331962029:8815], now have 1 active actors on pipe
2025-10-02T08:13:17.282353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:17.282357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:17.282394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1692 reason: error at write: Disconnected sessionId: src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0
2025-10-02T08:13:17.282430Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:17.282505Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:17.282530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1692 sessionId: src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0 is DEAD
2025-10-02T08:13:17.282663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534525331962029:8815]
2025-10-02T08:13:17.282687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:17.282699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0] Write session will restart in 0.009835s
2025-10-02T08:13:17.282720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0] Write session: Do CDS request
2025-10-02T08:13:17.282727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:17.293269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.293305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:17.293319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1693
2025-10-02T08:13:17.293487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.293523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:17.293532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:17.293535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:17.293992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1693 sessionId:  describe result for acl check
2025-10-02T08:13:17.294018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:17.294023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:17.294025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:17.294030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534525331962490:7163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:17.294511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534525331962490:7163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:17.297595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534525331962490:7163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:17.300708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534525331962490:7163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:17.300723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534525331962490:7163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:17.300727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534525331962490:7163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:17.300735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:17.302049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:17.302361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:17.302505Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:17.302514Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:17.302522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:17.302559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:17.302606Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534525331962658:7148]
2025-10-02T08:13:17.303230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:17.303382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:17.303419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:17.303723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:17.303763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.303769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.303770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.303772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.303773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.303778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.303788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.303792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.303796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.303800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.303805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.303812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.303823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.303830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.303839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.303845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.303849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.303858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.303863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.303875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.303894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:17.311692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:17.313214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:17.313228Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:17.313230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:17.313235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:17.313243Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1692 [1:7556534525331962658:7148]
2025-10-02T08:13:17.313256Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:17.313273Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:17.313276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.313279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.313281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.313296Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:17.313302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:17.313308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:17.313367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.313374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.313377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:17.313380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:17.313447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:17.313454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.313468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.313480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:17.313522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1692
2025-10-02T08:13:17.313619Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1692
2025-10-02T08:13:17.313649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331962649:7163], now have 1 active actors on pipe
2025-10-02T08:13:17.313661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534525331962652:7148]
2025-10-02T08:13:17.313663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534525331962652:7148]
2025-10-02T08:13:17.313671Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:17.313680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:17.313683Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:17.313685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534525791707430:2378], now have 1 active actors on pipe
2025-10-02T08:13:17.313693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:17.313707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:17.313723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:17.313729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.313736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.313781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534525331962652:7148]
2025-10-02T08:13:17.313794Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:17.313807Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6af34675-48306877-bee0ec8a-e96cf89a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:17.313811Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:17.313816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.313819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.313821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:17.313830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.313838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:17.313877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.313949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.313956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.313969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.314003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1693 partition: 0 MaxSeqNo: 17 sessionId: src_id|6af34675-48306877-bee0ec8a-e96cf89a_0
2025-10-02T08:13:17.314351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa3ecf7b-e96bc809-2f4a3c3e-f53704a0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6af34675-48306877-bee0ec8a-e96cf89a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:17.316968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af34675-48306877-bee0ec8a-e96cf89a_0] Write session: try to update token
2025-10-02T08:13:17.316986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af34675-48306877-bee0ec8a-e96cf89a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:17.331114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId: src_id|6af34675-48306877-bee0ec8a-e96cf89a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:17.331797Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:17.331812Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:17.331815Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:17.331823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534525331962652:7148]
2025-10-02T08:13:17.331827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534525331962652:7148]
2025-10-02T08:13:17.331875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:17.331886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.331888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:17.331936Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:17.331950Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:17.332065Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:17.334158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:17.383233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534525331962684:8815]
2025-10-02T08:13:17.383511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1692, pipe: [1:7556534525331962684:8815]
2025-10-02T08:13:17.484033Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:17.484473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.484487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.484781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:17.484526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331962684:8815], now have 1 active actors on pipe
2025-10-02T08:13:17.484691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534525331962684:8815]
2025-10-02T08:13:17.484708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:17.484711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:17.484763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1693 reason: error at write: Disconnected sessionId: src_id|6af34675-48306877-bee0ec8a-e96cf89a_0
2025-10-02T08:13:17.484838Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:17.484940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1693 sessionId: src_id|6af34675-48306877-bee0ec8a-e96cf89a_0 is DEAD
2025-10-02T08:13:17.485079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af34675-48306877-bee0ec8a-e96cf89a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:17.485088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af34675-48306877-bee0ec8a-e96cf89a_0] Write session will restart in 0.008655s
2025-10-02T08:13:17.485109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af34675-48306877-bee0ec8a-e96cf89a_0] Write session: Do CDS request
2025-10-02T08:13:17.485114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af34675-48306877-bee0ec8a-e96cf89a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:17.495331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6af34675-48306877-bee0ec8a-e96cf89a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.495337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:17.495352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1694
2025-10-02T08:13:17.495573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.495611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:17.495620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:17.495623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:17.496008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1694 sessionId:  describe result for acl check
2025-10-02T08:13:17.496043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:17.496048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:17.496049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:17.496052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534525331963077:7156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:17.496556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534525331963077:7156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:17.499203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534525331963077:7156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:17.503609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534525331963077:7156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:17.503628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534525331963077:7156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:17.503631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534525331963077:7156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:17.503640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:17.510783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:17.511203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:17.511378Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:17.511386Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:17.511394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:17.511432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:17.511461Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534525331963327:7153]
2025-10-02T08:13:17.511965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:17.512221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:17.512282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:17.512635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:17.512698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.512704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.512706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.512707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.512708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.512715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.512727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.512732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.512736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.512740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.512746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.512755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.512762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.512768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.512773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.512778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.512783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.512788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.512796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.516611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.516655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:17.525639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:17.527280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:17.527295Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:17.527300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:17.527304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:17.527310Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1693 [1:7556534525331963327:7153]
2025-10-02T08:13:17.527327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:17.527345Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:17.527349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.527352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.527354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.527369Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:17.527380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:17.527388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:17.527457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.527463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.527467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:17.527470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:17.527538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:17.527547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.527561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.527575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:17.527595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331963279:7156], now have 1 active actors on pipe
2025-10-02T08:13:17.527602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534525331963321:7153]
2025-10-02T08:13:17.527605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534525331963321:7153]
2025-10-02T08:13:17.527612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:17.527615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1693
2025-10-02T08:13:17.527622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:17.527627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:17.527631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:17.527642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:17.527645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:17.527653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534525791707449:2378], now have 1 active actors on pipe
2025-10-02T08:13:17.527658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.527667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.527710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534525331963321:7153]
2025-10-02T08:13:17.527723Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:17.527728Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1693
2025-10-02T08:13:17.527731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:17.527739Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:17.527749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.527753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.527755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:17.527764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.527773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:17.527823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.527900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.527907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.527921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.527958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1694 partition: 0 MaxSeqNo: 17 sessionId: src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0
2025-10-02T08:13:17.528332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6af34675-48306877-bee0ec8a-e96cf89a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:17.531175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0] Write session: try to update token
2025-10-02T08:13:17.531195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:17.551753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId: src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:17.554637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:17.554709Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:17.554721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:17.554723Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:17.554731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534525331963321:7153]
2025-10-02T08:13:17.554738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534525331963321:7153]
2025-10-02T08:13:17.554767Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:17.554773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.554775Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:17.554782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.554801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:17.554811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.554818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:17.554994Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:17.584696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534525331963351:8815]
2025-10-02T08:13:17.584813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1693, pipe: [1:7556534525331963351:8815]
2025-10-02T08:13:17.698888Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:17.699385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331963351:8815], now have 1 active actors on pipe
2025-10-02T08:13:17.699505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:17.699512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:17.699568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1694 reason: error at write: Disconnected sessionId: src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0
2025-10-02T08:13:17.699598Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:17.699651Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:17.699744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1694 sessionId: src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0 is DEAD
2025-10-02T08:13:17.699915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:17.699927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0] Write session will restart in 0.006050s
2025-10-02T08:13:17.699924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534525331963351:8815]
2025-10-02T08:13:17.699951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0] Write session: Do CDS request
2025-10-02T08:13:17.699959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:17.707323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.707546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:17.707558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1695
2025-10-02T08:13:17.707731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.707760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:17.707769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:17.707772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:17.708282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1695 sessionId:  describe result for acl check
2025-10-02T08:13:17.708309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:17.708313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:17.708315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:17.708320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534525331963667:7145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:17.708753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534525331963667:7145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:17.711410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534525331963667:7145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:17.715218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534525331963667:7145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:17.715230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534525331963667:7145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:17.715234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534525331963667:7145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:17.715242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:17.718703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:17.720795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:17.721021Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:17.721031Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:17.721040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:17.721086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:17.721121Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534525331963987:7141]
2025-10-02T08:13:17.721743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:17.721928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:17.721964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:17.722252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:17.722294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.722299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.722300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.722301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.722302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.722307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.722317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.722325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.722328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.722335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.722341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.722347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.722355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.722364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.722370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.722376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.722384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.722389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.722398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.722405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.722426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:17.732088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:17.733955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:17.733972Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:17.733973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:17.733976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:17.733981Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1694 [1:7556534525331963987:7141]
2025-10-02T08:13:17.733990Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:17.734005Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:17.734007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.734009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.734010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.734025Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:17.734028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:17.734033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:17.734083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.734092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.734095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:17.734096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:17.734148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:17.734156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.734169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.734179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:17.734202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534525331963981:7141]
2025-10-02T08:13:17.734208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534525331963981:7141]
2025-10-02T08:13:17.734214Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:17.734224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:17.734236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:17.734238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:17.734242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:17.734260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1694
2025-10-02T08:13:17.734264Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:17.734271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331963923:7145], now have 1 active actors on pipe
2025-10-02T08:13:17.734274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534525791707457:2378], now have 1 active actors on pipe
2025-10-02T08:13:17.734275Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534525331963981:7141]
2025-10-02T08:13:17.734278Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:17.734280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:17.734290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.734297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.734323Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:17.734332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.734336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.734337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:17.734344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.734351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:17.734367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.734395Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1694
2025-10-02T08:13:17.734431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.734437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.734452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.734484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1695 partition: 0 MaxSeqNo: 17 sessionId: src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0
2025-10-02T08:13:17.734815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7541d1b-67409fc3-9809cfd3-e32f2294_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:17.737382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0] Write session: try to update token
2025-10-02T08:13:17.737395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:17.751138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId: src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:17.751735Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:17.751749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:17.751752Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:17.751761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534525331963981:7141]
2025-10-02T08:13:17.751766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534525331963981:7141]
2025-10-02T08:13:17.751809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:17.751816Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:17.751820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.751822Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:17.751822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:17.751961Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:17.753723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:17.800261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534525331964016:8815]
2025-10-02T08:13:17.800352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1694, pipe: [1:7556534525331964016:8815]
2025-10-02T08:13:17.892140Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:17.892692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.892709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.892750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331964016:8815], now have 1 active actors on pipe
2025-10-02T08:13:17.892854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:17.892865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:17.892917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1695 reason: error at write: Disconnected sessionId: src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0
2025-10-02T08:13:17.893002Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:17.893074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1695 sessionId: src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0 is DEAD
2025-10-02T08:13:17.893086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:17.893230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:17.893212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534525331964016:8815]
2025-10-02T08:13:17.893241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0] Write session will restart in 0.007452s
2025-10-02T08:13:17.893278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0] Write session: Do CDS request
2025-10-02T08:13:17.893285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:17.902583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.902648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:17.902662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1696
2025-10-02T08:13:17.902809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:17.902850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:17.902862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:17.902864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:17.903288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1696 sessionId:  describe result for acl check
2025-10-02T08:13:17.903318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:17.903320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:17.903321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:17.903326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534525331964391:7124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:17.903805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534525331964391:7124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:17.906980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534525331964391:7124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:17.913174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:17.913429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534525331964391:7124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:17.913437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534525331964391:7124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:17.913440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534525331964391:7124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:17.913448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:17.915331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:17.915492Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:17.915496Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:17.915504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:17.915543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:17.915596Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534525331964649:7123]
2025-10-02T08:13:17.916051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:17.916231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:17.916265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:17.916515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:17.916548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.916548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.916549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.916550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.916551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.916554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.916560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.916562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.916564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.916566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.916570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.916574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:17.916578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.916581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:17.916583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.916586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:17.916588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.916591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.916594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.916596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.916607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:17.924412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:17.926362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:17.926378Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:17.926380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:17.926384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:17.926391Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1695 [1:7556534525331964649:7123]
2025-10-02T08:13:17.926403Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:17.926421Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:17.926424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.926427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.926428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.926445Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:17.926450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:17.926456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:17.926523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.926533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.926536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:17.926538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:17.926599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:17.926607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.926620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:17.926635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:17.926656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534525331964637:7123]
2025-10-02T08:13:17.926662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534525331964637:7123]
2025-10-02T08:13:17.926669Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:17.926671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1695
2025-10-02T08:13:17.926683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331964645:7124], now have 1 active actors on pipe
2025-10-02T08:13:17.926684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:17.926688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:17.926696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:17.926709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:17.926718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:17.926724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534525791707464:2378], now have 1 active actors on pipe
2025-10-02T08:13:17.926754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.926762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.926774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534525331964637:7123]
2025-10-02T08:13:17.926787Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:17.926803Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:17.926780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1695
2025-10-02T08:13:17.926816Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3574991-a6c31608-562cbebc-c57700b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:17.926827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:17.926830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:17.926832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:17.926843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:17.926856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:17.926912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.926986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:17.926994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:17.927008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:17.927048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1696 partition: 0 MaxSeqNo: 17 sessionId: src_id|f3574991-a6c31608-562cbebc-c57700b0_0
2025-10-02T08:13:17.927361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2626d49c-17b35710-c7a9ba29-64a720bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f3574991-a6c31608-562cbebc-c57700b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:17.929939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3574991-a6c31608-562cbebc-c57700b0_0] Write session: try to update token
2025-10-02T08:13:17.929957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3574991-a6c31608-562cbebc-c57700b0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:17.943968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId: src_id|f3574991-a6c31608-562cbebc-c57700b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:17.944194Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:17.944209Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:17.944212Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:17.944220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534525331964637:7123]
2025-10-02T08:13:17.944225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534525331964637:7123]
2025-10-02T08:13:17.944266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:17.944260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:17.944272Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:17.944280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:17.944282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:17.944419Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:17.946521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:17.992794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534525331964677:8815]
2025-10-02T08:13:17.992927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1695, pipe: [1:7556534525331964677:8815]
2025-10-02T08:13:18.093855Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:18.094406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.094421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.094459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534525331964677:8815], now have 1 active actors on pipe
2025-10-02T08:13:18.094566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534525331964677:8815]
2025-10-02T08:13:18.094593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:18.094599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:18.094650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1696 reason: error at write: Disconnected sessionId: src_id|f3574991-a6c31608-562cbebc-c57700b0_0
2025-10-02T08:13:18.094675Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:18.094686Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:18.094814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1696 sessionId: src_id|f3574991-a6c31608-562cbebc-c57700b0_0 is DEAD
2025-10-02T08:13:18.094956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3574991-a6c31608-562cbebc-c57700b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:18.094967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3574991-a6c31608-562cbebc-c57700b0_0] Write session will restart in 0.009488s
2025-10-02T08:13:18.094993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3574991-a6c31608-562cbebc-c57700b0_0] Write session: Do CDS request
2025-10-02T08:13:18.094999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3574991-a6c31608-562cbebc-c57700b0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:18.105271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3574991-a6c31608-562cbebc-c57700b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.105342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:18.105357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1697
2025-10-02T08:13:18.105493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.105525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:18.105533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:18.105537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:18.105955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1697 sessionId:  describe result for acl check
2025-10-02T08:13:18.105991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:18.105999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:18.106000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:18.106006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534529626932431:7105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:18.106517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534529626932431:7105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:18.109473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534529626932431:7105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:18.112522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534529626932431:7105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:18.112537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534529626932431:7105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:18.112540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534529626932431:7105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:18.112549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:18.114944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:18.115361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:18.115522Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:18.115533Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:18.115541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:18.115586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:18.115619Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534529626932611:7109]
2025-10-02T08:13:18.116253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:18.116541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:18.116588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:18.116910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:18.116969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.116977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.116978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.116980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.116980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.116985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.116997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.117001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.117004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.117008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.117014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.117021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.117026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.117031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.117035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.117040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.117044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.117050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.117060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.117064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.117082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:18.125129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:18.126727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:18.126745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:18.126748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:18.126751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:18.126756Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1696 [1:7556534529626932611:7109]
2025-10-02T08:13:18.126768Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:18.126784Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:18.126787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.126790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.126792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.126809Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:18.126813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:18.126825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:18.126884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.126892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.126894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:18.126897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:18.126954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:18.126962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.126975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.126990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:18.127013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626932600:7105], now have 1 active actors on pipe
2025-10-02T08:13:18.127023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534529626932605:7109]
2025-10-02T08:13:18.127025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534529626932605:7109]
2025-10-02T08:13:18.127037Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:18.127045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534530086674769:2378], now have 1 active actors on pipe
2025-10-02T08:13:18.127052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:18.127052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:18.127055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:18.127063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:18.127066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:18.127096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534529626932605:7109]
2025-10-02T08:13:18.127099Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:18.127121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:18.127133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1696
2025-10-02T08:13:18.127101Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1696
2025-10-02T08:13:18.127156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.127165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.127187Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:18.127197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.127201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.127202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:18.127211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.127252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:18.127285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.127309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.127315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.127327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.127359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1697 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0
2025-10-02T08:13:18.127668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3574991-a6c31608-562cbebc-c57700b0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:18.129972Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:13:18.129995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-02T08:13:18.130122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0] Write session: try to update token
2025-10-02T08:13:18.130134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:18.130213Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:13:18.130434Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 15 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:13:18.130476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:13:18.142034Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:18.142056Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:18.142065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534529626932605:7109]
2025-10-02T08:13:18.142112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:18.142130Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:18.142293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:18.142441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:18.142582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:18.142723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:18.142918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:18.142958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:18.144153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId: src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:18.146667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:18.146737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.146749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.146785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:18.146802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:18.146857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.146864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.147021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.147082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.147197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.147266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.147310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.147323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.147393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.147452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.147511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.147576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.147620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.147628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.147694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.147752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.147816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.147879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.147920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.147927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.147991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.148056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.148126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.148208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.148267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.148274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.148354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.148423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.148496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.148567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.148636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.148643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.148720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.152018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.152105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.152217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.152277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.152286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.152368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.152439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.152514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.152586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.152635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.152643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.152726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.152796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.152887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.152963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.153019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.153026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.153106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.153170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.153235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.153301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.153358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.153365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.153438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:18.153503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:18.153565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:18.153630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:18.153680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:18.153687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:18.153728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:18.153791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.153814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.153820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:18.153851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:18.153866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:18.153874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:18.153877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:18.153882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:18.154262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:18.154289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:18.154299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:18.154302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:18.154310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:18.154314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:18.154955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:18.154978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:18.154984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:18.154988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:18.154991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:18.154994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:18.155551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:18.155573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:18.155581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:18.155584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:18.155587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:18.156832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:18.156848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:18.156859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392798156
2025-10-02T08:13:18.157020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:18.157035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:18.157040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:18.157044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:18.157047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:18.157050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:18.157525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:18.157546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:18.157552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:18.157555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:18.157559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:18.157562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:18.158024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:18.158044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:18.158050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:18.158054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:18.158058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:18.158061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:18.158493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:18.158516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:18.158520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:18.159617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:18.159634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:18.159639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:18.159644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:18.159651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392798159
2025-10-02T08:13:18.159931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:18.159949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:18.159954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:18.159957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:18.159961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:18.159964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:18.160434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:18.160461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:18.160466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:18.160469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:18.160472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:18.160476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:18.161968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:18.161993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.162089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392798161
2025-10-02T08:13:18.162841Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:18.162862Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:18.162870Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:18.162879Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:18.164543Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:18.164557Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:18.164559Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:18.164565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534529626932605:7109]
2025-10-02T08:13:18.164568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534529626932605:7109]
2025-10-02T08:13:18.164619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:18.164625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:18.164625Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:18.164629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.164630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:18.164772Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:18.194525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534529626932674:8815]
2025-10-02T08:13:18.194728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1696, pipe: [1:7556534529626932674:8815]
2025-10-02T08:13:18.305122Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:18.305477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626932674:8815], now have 1 active actors on pipe
2025-10-02T08:13:18.305605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534529626932674:8815]
2025-10-02T08:13:18.305627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:18.305633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:18.305662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1697 reason: error at write: Disconnected sessionId: src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0
2025-10-02T08:13:18.305683Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:18.305777Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:18.305818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1697 sessionId: src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0 is DEAD
2025-10-02T08:13:18.305927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:18.305937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0] Write session will restart in 0.005376s
2025-10-02T08:13:18.305961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0] Write session: Do CDS request
2025-10-02T08:13:18.305968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:18.312258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.312568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:18.312582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1698
2025-10-02T08:13:18.312769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.312811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:18.312817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:18.312821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:18.313194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1698 sessionId:  describe result for acl check
2025-10-02T08:13:18.313228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:18.313233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:18.313235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:18.313240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534529626932969:7057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:18.313859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534529626932969:7057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:18.316745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534529626932969:7057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:18.330086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534529626932969:7057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:18.330102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534529626932969:7057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:18.330106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534529626932969:7057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:18.330131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:18.338844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:18.340707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:18.340902Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:18.340912Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:18.340923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:18.340981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:18.341011Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534529626933324:7056]
2025-10-02T08:13:18.341418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:18.341592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:18.341632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:18.341843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:18.341873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.341878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.341879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.341880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.341882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.341885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.341894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.341898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.341902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.341905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.341910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.341914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.341917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.341920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.341922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.341925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.341928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.341931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.341933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.341935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.341950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:18.349689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:18.351043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:18.351057Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:18.351059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:18.351062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:18.351067Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1697 [1:7556534529626933324:7056]
2025-10-02T08:13:18.351077Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:18.351090Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:18.351092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.351094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.351095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.351108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:18.351112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:18.351119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:18.351178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.351184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.351186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:18.351188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:18.351244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:18.351251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.351264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.351274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:18.351295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534529626933318:7056]
2025-10-02T08:13:18.351301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534529626933318:7056]
2025-10-02T08:13:18.351308Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:18.351324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:18.351341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:18.351347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:18.351349Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:18.351350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1697
2025-10-02T08:13:18.351352Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:18.351357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626933118:7057], now have 1 active actors on pipe
2025-10-02T08:13:18.351386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534529626933318:7056]
2025-10-02T08:13:18.351393Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:18.351398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534530086674802:2378], now have 1 active actors on pipe
2025-10-02T08:13:18.351402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.351402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:18.351405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.351441Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a4cbf7e-60750c48-efbef075-f4204783_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:18.351453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.351456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.351458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:18.351466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.351475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:18.351497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.351513Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1697
2025-10-02T08:13:18.351570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.351581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.351596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.351633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1698 partition: 0 MaxSeqNo: 17 sessionId: src_id|5a4cbf7e-60750c48-efbef075-f4204783_0
2025-10-02T08:13:18.351923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff5ddece-b2401f87-354e2c5b-c1393b53_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5a4cbf7e-60750c48-efbef075-f4204783_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:18.354603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4cbf7e-60750c48-efbef075-f4204783_0] Write session: try to update token
2025-10-02T08:13:18.354622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4cbf7e-60750c48-efbef075-f4204783_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:18.370293Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:18.370312Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:18.370315Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:18.370323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534529626933318:7056]
2025-10-02T08:13:18.370327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534529626933318:7056]
2025-10-02T08:13:18.370373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:18.370376Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:18.370382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:18.370387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.370390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:18.370523Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:18.371606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId: src_id|5a4cbf7e-60750c48-efbef075-f4204783_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:18.374119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:18.405961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534529626933349:8815]
2025-10-02T08:13:18.406094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1697, pipe: [1:7556534529626933349:8815]
2025-10-02T08:13:18.518233Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:18.519030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.519048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.519089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626933349:8815], now have 1 active actors on pipe
2025-10-02T08:13:18.519439Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:18.519719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4cbf7e-60750c48-efbef075-f4204783_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:18.519727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4cbf7e-60750c48-efbef075-f4204783_0] Write session will restart in 0.006417s
2025-10-02T08:13:18.519333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534529626933349:8815]
2025-10-02T08:13:18.519751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4cbf7e-60750c48-efbef075-f4204783_0] Write session: Do CDS request
2025-10-02T08:13:18.519354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:18.519356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:18.519759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4cbf7e-60750c48-efbef075-f4204783_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:18.519367Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:18.519410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1698 reason: error at write: Disconnected sessionId: src_id|5a4cbf7e-60750c48-efbef075-f4204783_0
2025-10-02T08:13:18.519574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1698 sessionId: src_id|5a4cbf7e-60750c48-efbef075-f4204783_0 is DEAD
2025-10-02T08:13:18.527885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4cbf7e-60750c48-efbef075-f4204783_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.527999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:18.528014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1699
2025-10-02T08:13:18.528622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.528662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:18.528672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:18.528676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:18.529319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1699 sessionId:  describe result for acl check
2025-10-02T08:13:18.529354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:18.529355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:18.529357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:18.529363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534529626933659:7047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:18.529894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534529626933659:7047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:18.532033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534529626933659:7047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:18.536993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534529626933659:7047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:18.537014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534529626933659:7047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:18.537018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534529626933659:7047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:18.537027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:18.551759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:18.552301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:18.552502Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:18.552510Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:18.552529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:18.552581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:18.552621Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534529626934001:7048]
2025-10-02T08:13:18.553305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:18.553502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:18.553544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:18.553838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:18.553874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.553875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.553877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.553878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.553879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.553884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.553894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.553898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.553903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.553907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.553913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.553921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.553941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.553947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.553952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.553957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.553962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.553967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.553972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.553978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.553998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:18.565421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:18.567096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:18.567103Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:18.567106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:18.567110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:18.567118Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1698 [1:7556534529626934001:7048]
2025-10-02T08:13:18.567130Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:18.567148Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:18.567151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.567155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.567157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.567174Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:18.567179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:18.567186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:18.567250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.567253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.567256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:18.567259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:18.567329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:18.567332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.567346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.567359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:18.567378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626933826:7047], now have 1 active actors on pipe
2025-10-02T08:13:18.567384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534529626933995:7048]
2025-10-02T08:13:18.567387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534529626933995:7048]
2025-10-02T08:13:18.567395Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:18.567399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1698
2025-10-02T08:13:18.567404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534530086674821:2378], now have 1 active actors on pipe
2025-10-02T08:13:18.567405Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:18.567409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:18.567411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:18.567426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:18.567428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:18.567435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.567439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.567487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534529626933995:7048]
2025-10-02T08:13:18.567496Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:18.567501Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:18.567511Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47434bc1-c6816925-57461d79-7fa35927_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:18.567517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.567522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.567523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:18.567533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.567541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:18.567573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.567626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.567629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.567642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.567673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1699 partition: 0 MaxSeqNo: 17 sessionId: src_id|47434bc1-c6816925-57461d79-7fa35927_0
2025-10-02T08:13:18.568041Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1698
2025-10-02T08:13:18.568381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a4cbf7e-60750c48-efbef075-f4204783_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47434bc1-c6816925-57461d79-7fa35927_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:18.571192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47434bc1-c6816925-57461d79-7fa35927_0] Write session: try to update token
2025-10-02T08:13:18.571210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47434bc1-c6816925-57461d79-7fa35927_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:18.590650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId: src_id|47434bc1-c6816925-57461d79-7fa35927_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:18.591829Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:18.591847Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:18.591850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:18.591858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534529626933995:7048]
2025-10-02T08:13:18.591862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534529626933995:7048]
2025-10-02T08:13:18.591911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:18.591916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:18.591920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.591922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:18.591937Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:18.592089Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:18.593440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:18.619487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534529626934027:8815]
2025-10-02T08:13:18.619665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1698, pipe: [1:7556534529626934027:8815]
2025-10-02T08:13:18.748068Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:18.748605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.748621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.748660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626934027:8815], now have 1 active actors on pipe
2025-10-02T08:13:18.748833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534529626934027:8815]
2025-10-02T08:13:18.748862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:18.748864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:18.748874Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:18.748927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1699 reason: error at write: Disconnected sessionId: src_id|47434bc1-c6816925-57461d79-7fa35927_0
2025-10-02T08:13:18.748944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:18.749092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1699 sessionId: src_id|47434bc1-c6816925-57461d79-7fa35927_0 is DEAD
2025-10-02T08:13:18.749638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47434bc1-c6816925-57461d79-7fa35927_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:18.749651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47434bc1-c6816925-57461d79-7fa35927_0] Write session will restart in 0.008479s
2025-10-02T08:13:18.749680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47434bc1-c6816925-57461d79-7fa35927_0] Write session: Do CDS request
2025-10-02T08:13:18.749686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47434bc1-c6816925-57461d79-7fa35927_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:18.759331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47434bc1-c6816925-57461d79-7fa35927_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.759420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:18.759432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1700
2025-10-02T08:13:18.759541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.759567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:18.759576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:18.759579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:18.759996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1700 sessionId:  describe result for acl check
2025-10-02T08:13:18.760029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:18.760034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:18.760036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:18.760042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534529626934461:7043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:18.760507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534529626934461:7043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:18.763675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534529626934461:7043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:18.766890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534529626934461:7043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:18.766907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534529626934461:7043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:18.766911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534529626934461:7043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:18.766919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:18.767179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:18.769289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:18.769484Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:18.769496Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:18.769506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:18.769557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:18.769597Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534529626934675:7042]
2025-10-02T08:13:18.770175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:18.770361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:18.770404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:18.770784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:18.770820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.770825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.770826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.770827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.770828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.770833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.770842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.770846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.770849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.770857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.770862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.770869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.770877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.770882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.770885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.770892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.770895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.770900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.770904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.770908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.770926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:18.778507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:18.780267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:18.780280Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:18.780282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:18.780285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:18.780291Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1699 [1:7556534529626934675:7042]
2025-10-02T08:13:18.780300Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:18.780316Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:18.780323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.780327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.780329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.780342Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:18.780347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:18.780353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:18.780408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.780414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.780417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:18.780420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:18.780482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:18.780489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.780499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.780515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:18.780534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626934664:7043], now have 1 active actors on pipe
2025-10-02T08:13:18.780541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534530086674830:2378], now have 1 active actors on pipe
2025-10-02T08:13:18.780542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1699
2025-10-02T08:13:18.780547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534529626934666:7042]
2025-10-02T08:13:18.780553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534529626934666:7042]
2025-10-02T08:13:18.780564Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:18.780578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.780579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:18.780582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:18.780586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.780601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:18.780617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:18.780624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:18.780660Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:18.780623Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1699
2025-10-02T08:13:18.780669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.780677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.780678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:18.780686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.780697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:18.780703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534529626934666:7042]
2025-10-02T08:13:18.780715Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:18.780725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:18.780738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.780822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.780827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.780842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.780880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1700 partition: 0 MaxSeqNo: 17 sessionId: src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0
2025-10-02T08:13:18.781158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47434bc1-c6816925-57461d79-7fa35927_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:18.783661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0] Write session: try to update token
2025-10-02T08:13:18.783674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:18.796890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId: src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:18.797430Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:18.797445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:18.797447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:18.797456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534529626934666:7042]
2025-10-02T08:13:18.797460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534529626934666:7042]
2025-10-02T08:13:18.797502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:18.797507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:18.797512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.797513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:18.797514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:18.797650Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:18.799548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:18.848854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534529626934700:8815]
2025-10-02T08:13:18.848994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1699, pipe: [1:7556534529626934700:8815]
2025-10-02T08:13:18.945999Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:18.946253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.946264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.946298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626934700:8815], now have 1 active actors on pipe
2025-10-02T08:13:18.946450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534529626934700:8815]
2025-10-02T08:13:18.946482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:18.946487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:18.946507Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:18.946489Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:18.946546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1700 reason: error at write: Disconnected sessionId: src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0
2025-10-02T08:13:18.946689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1700 sessionId: src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0 is DEAD
2025-10-02T08:13:18.946814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:18.946824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0] Write session will restart in 0.007952s
2025-10-02T08:13:18.946847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0] Write session: Do CDS request
2025-10-02T08:13:18.946853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:18.956223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.956312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:18.956326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1701
2025-10-02T08:13:18.956423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:18.956449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:18.956457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:18.956460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:18.956771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1701 sessionId:  describe result for acl check
2025-10-02T08:13:18.956796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:18.956798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:18.956807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:18.956812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534529626935151:7030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:18.957189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534529626935151:7030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:18.960196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534529626935151:7030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:18.962798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534529626935151:7030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:18.962808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534529626935151:7030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:18.962810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534529626935151:7030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:18.962816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:18.965088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:18.965424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:18.965564Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:18.965571Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:18.965579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:18.965609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:18.965645Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534529626935345:7031]
2025-10-02T08:13:18.966300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:18.966699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:18.966734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:18.967024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:18.967063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.967064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.967065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.967066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.967067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.967071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.967080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.967084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.967088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.967091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.967096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.967102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:18.967107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.967112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:18.967115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.967120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:18.967124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.967129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.967132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.967137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.967163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:18.975133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:18.976651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:18.976664Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:18.976666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:18.976670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:18.976675Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1700 [1:7556534529626935345:7031]
2025-10-02T08:13:18.976686Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:18.976704Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:18.976710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.976713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.976715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.976729Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:18.976737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:18.976747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:18.976817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.976827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.976830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:18.976832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:18.976890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:18.976897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.976907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:18.976919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:18.976940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534529626935335:7030], now have 1 active actors on pipe
2025-10-02T08:13:18.976947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534530086674837:2378], now have 1 active actors on pipe
2025-10-02T08:13:18.976953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534529626935339:7031]
2025-10-02T08:13:18.976955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534529626935339:7031]
2025-10-02T08:13:18.976964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:18.976975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:18.976982Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:18.976985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:18.976992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:18.976998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:18.977022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534529626935339:7031]
2025-10-02T08:13:18.977027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1700
2025-10-02T08:13:18.977033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:18.977035Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:18.977047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.977050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.977076Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:18.977083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:18.977057Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1700
2025-10-02T08:13:18.977087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:18.977088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:18.977096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:18.977104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:18.977122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.977146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:18.977153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:18.977163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:18.977200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1701 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0
2025-10-02T08:13:18.977496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be35a44-3d7fb8dc-4e02eb36-65ff7a39_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:18.979841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0] Write session: try to update token
2025-10-02T08:13:18.979853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:18.992816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId: src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:18.994096Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:18.994110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:18.994112Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:18.994119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534529626935339:7031]
2025-10-02T08:13:18.994124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534529626935339:7031]
2025-10-02T08:13:18.994165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:18.994170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:18.994172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:18.994194Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:18.994212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:18.994305Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:18.995358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:19.046474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534533921902667:8815]
2025-10-02T08:13:19.046614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1700, pipe: [1:7556534533921902667:8815]
2025-10-02T08:13:19.145199Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:19.145679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.145690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.145725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921902667:8815], now have 1 active actors on pipe
2025-10-02T08:13:19.145882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534533921902667:8815]
2025-10-02T08:13:19.145913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:19.145916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:19.145936Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:19.146280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:19.146291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0] Write session will restart in 0.008273s
2025-10-02T08:13:19.146312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0] Write session: Do CDS request
2025-10-02T08:13:19.146318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:19.145981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1701 reason: error at write: Disconnected sessionId: src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0
2025-10-02T08:13:19.146161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1701 sessionId: src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0 is DEAD
2025-10-02T08:13:19.146018Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:19.155326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.155386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:19.155402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1702
2025-10-02T08:13:19.155531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.155562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:19.155566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:19.155569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:19.155959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1702 sessionId:  describe result for acl check
2025-10-02T08:13:19.155992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:19.155994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:19.155995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:19.156001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534533921903057:7009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:19.156505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534533921903057:7009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:19.159541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534533921903057:7009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:19.163481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534533921903057:7009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:19.163497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534533921903057:7009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:19.163500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534533921903057:7009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:19.163508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:19.166780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:19.167186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:19.167344Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:19.167354Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:19.167363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:19.167408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:19.167448Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534533921903314:7017]
2025-10-02T08:13:19.168056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:19.168248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:19.168281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:19.168619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:19.168668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.168673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.168674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.168674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.168675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.168678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.168685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.168687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.168689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.168691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.168695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.168699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.168702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.168705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.168708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.168711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.168713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.168716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.168718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.168721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.168730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:19.176441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:19.178293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:19.178311Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:19.178313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:19.178317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:19.178323Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1701 [1:7556534533921903314:7017]
2025-10-02T08:13:19.178343Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:19.178359Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:19.178363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.178366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.178368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.178384Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:19.178388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:19.178394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:19.178471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.178480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.178483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:19.178485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:19.178680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:19.178690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.178705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.178718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:19.178740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921903293:7009], now have 1 active actors on pipe
2025-10-02T08:13:19.178748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534534381642141:2378], now have 1 active actors on pipe
2025-10-02T08:13:19.178755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534533921903308:7017]
2025-10-02T08:13:19.178757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534533921903308:7017]
2025-10-02T08:13:19.178763Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:19.178725Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1701
2025-10-02T08:13:19.178773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:19.178779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:19.178782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:19.178794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:19.178797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:19.178829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534533921903308:7017]
2025-10-02T08:13:19.178840Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:19.178859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:19.178881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1701
2025-10-02T08:13:19.178890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.178893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.178910Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a099349-1aa283e0-516d482b-578f4753_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:19.178919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.178922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.178923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:19.178929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.178937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:19.178950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.178968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.178972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.178980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.179004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1702 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a099349-1aa283e0-516d482b-578f4753_0
2025-10-02T08:13:19.179298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4066f85-39521c29-ea0eea65-e4fe7233_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a099349-1aa283e0-516d482b-578f4753_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:19.181944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a099349-1aa283e0-516d482b-578f4753_0] Write session: try to update token
2025-10-02T08:13:19.181959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a099349-1aa283e0-516d482b-578f4753_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:19.189164Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:19.189185Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:19.189194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534533921903308:7017]
2025-10-02T08:13:19.189230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:19.189245Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:19.190254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:19.190402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:19.190554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:19.190694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:19.190900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:19.190951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:19.204782Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:19.204816Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:19.204819Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:19.204827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534533921903308:7017]
2025-10-02T08:13:19.204831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534533921903308:7017]
2025-10-02T08:13:19.204873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:19.204881Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:19.204884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.204886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:19.204887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:19.205023Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:19.218080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId: src_id|1a099349-1aa283e0-516d482b-578f4753_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:19.220615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:19.246441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534533921903367:8815]
2025-10-02T08:13:19.248983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1701, pipe: [1:7556534533921903367:8815]
2025-10-02T08:13:19.339113Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:19.339481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.339492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.339509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921903367:8815], now have 1 active actors on pipe
2025-10-02T08:13:19.339622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534533921903367:8815]
2025-10-02T08:13:19.339642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:19.339648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:19.339692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1702 reason: error at write: Disconnected sessionId: src_id|1a099349-1aa283e0-516d482b-578f4753_0
2025-10-02T08:13:19.339720Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:19.339739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:19.339848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1702 sessionId: src_id|1a099349-1aa283e0-516d482b-578f4753_0 is DEAD
2025-10-02T08:13:19.339998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a099349-1aa283e0-516d482b-578f4753_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:19.339988Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:13:19.340005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a099349-1aa283e0-516d482b-578f4753_0] Write session will restart in 0.006163s
2025-10-02T08:13:19.340042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a099349-1aa283e0-516d482b-578f4753_0] Write session: Do CDS request
2025-10-02T08:13:19.340048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a099349-1aa283e0-516d482b-578f4753_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:19.340075Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 17 consumer shared/user session shared/user_1_17_10810090616033483154_v1 is DEAD
2025-10-02T08:13:19.340245Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534439432564411:6131] disconnected; active server actors: 1
2025-10-02T08:13:19.340270Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534439432564411:6131] client user disconnected session shared/user_1_17_10810090616033483154_v1
2025-10-02T08:13:19.340304Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:13:19.340526Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:13:19.340531Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:13:19.340547Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.009223s
2025-10-02T08:13:19.347236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a099349-1aa283e0-516d482b-578f4753_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.347259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:19.347276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1703
2025-10-02T08:13:19.347460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.347489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:19.347498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:19.347501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:19.348073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1703 sessionId:  describe result for acl check
2025-10-02T08:13:19.348103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:19.348104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:19.348106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:19.348111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534533921903713:6960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:19.348650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534533921903713:6960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:19.350830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534533921903713:6960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:19.351188Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:13:19.351302Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:13:19.351311Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 18
2025-10-02T08:13:19.351555Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 18 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:13:19.351599Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:13:19.351758Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 auth for : user
2025-10-02T08:13:19.351866Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 Handle describe topics response
2025-10-02T08:13:19.351898Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 auth is DEAD
2025-10-02T08:13:19.351904Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:13:19.352127Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:13:19.352242Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_18_7955205124146356881_v1
2025-10-02T08:13:19.352253Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:13:19.352322Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:13:19.352422Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:13:19.352426Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534533921903880:6951] connected; active server actors: 1
2025-10-02T08:13:19.352496Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 got read request: guid# 398de213-591830b5-7a941817-e3aefe8c
2025-10-02T08:13:19.352546Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534533921903880:6951] session shared/user_1_18_7955205124146356881_v1
2025-10-02T08:13:19.352561Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:13:19.352574Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:13:19.352582Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_18_7955205124146356881_v1" (Sender=[1:7556534533921903848:6951], Pipe=[1:7556534533921903880:6951], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:13:19.352585Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:13:19.352595Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:13:19.352606Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_18_7955205124146356881_v1" (Sender=[1:7556534533921903848:6951], Pipe=[1:7556534533921903880:6951], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:13:19.352616Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_18_7955205124146356881_v1" sender [1:7556534533921903848:6951] lock partition 0 for ReadingSession "shared/user_1_18_7955205124146356881_v1" (Sender=[1:7556534533921903848:6951], Pipe=[1:7556534533921903880:6951], Partitions=[], ActiveFamilyCount=1) generation 1 step 18
2025-10-02T08:13:19.352639Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:13:19.352642Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-10-02T08:13:19.352931Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 18 Session: "shared/user_1_18_7955205124146356881_v1" ClientId: "user" PipeClient { RawX1: 7556534533921903880 RawX2: 4503603922344743 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:13:19.352965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:13:19.354675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534533921903713:6960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:19.354687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534533921903713:6960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:19.354689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534533921903713:6960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:19.354694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:19.358738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:19.361558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:19.361863Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:19.361874Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:19.361886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:19.361946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:19.361987Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534533921904031:6962]
2025-10-02T08:13:19.362580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:19.362766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:19.362809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:19.363104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:19.363165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.363171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.363172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.363173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.363174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.363179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.363189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.363192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.363195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.363198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.363204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.363211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.363217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.363222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.363226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.363230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.363235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.363239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.363249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.363255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.363277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:19.375069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:19.377143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:19.377157Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:19.377159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:19.377162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:19.377168Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1702 [1:7556534533921904031:6962]
2025-10-02T08:13:19.377176Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:19.377192Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:19.377194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.377196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.377197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.377210Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:19.377214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:19.377219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:19.377271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.377277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.377280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:19.377281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:19.377333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:19.377339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.377350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.377356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:19.377372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534533921904025:6962]
2025-10-02T08:13:19.377377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534533921904025:6962]
2025-10-02T08:13:19.377383Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:19.377394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:19.377402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:19.377408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:19.377416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921903900:6945], now have 1 active actors on pipe
2025-10-02T08:13:19.377417Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:19.377420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:19.377425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1702, pipe: [1:7556534533921903900:6945]
2025-10-02T08:13:19.377438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1702
2025-10-02T08:13:19.377444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921903949:6960], now have 1 active actors on pipe
2025-10-02T08:13:19.377447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.377450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.377458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_18_7955205124146356881_v1 on pipe: [1:7556534533921903900:6945]
2025-10-02T08:13:19.377470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534533921904025:6962]
2025-10-02T08:13:19.377473Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_18_7955205124146356881_v1:1 with generation 1702
2025-10-02T08:13:19.377479Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:19.377482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534534381642170:2378], now have 1 active actors on pipe
2025-10-02T08:13:19.377484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.377485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.377492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:19.377504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.377511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.377513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:19.377523Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_18_7955205124146356881_v1
2025-10-02T08:13:19.377527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.377514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1702
2025-10-02T08:13:19.377556Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4e6b812-b08eebed-595ee680-55a7274f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:19.377564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:13:19.377566Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:19.379313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:13:19.379333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:13:19.379338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.379342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.379343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:19.379350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.379359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:19.379363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:13:19.379372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:13:19.379385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.379414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.379421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.379437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.379437Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392799377 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:13:19.379447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:13:19.379466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1703 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4e6b812-b08eebed-595ee680-55a7274f_0
2025-10-02T08:13:19.379468Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 sending to client partition status
2025-10-02T08:13:19.379812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a099349-1aa283e0-516d482b-578f4753_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4e6b812-b08eebed-595ee680-55a7274f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:19.382446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e6b812-b08eebed-595ee680-55a7274f_0] Write session: try to update token
2025-10-02T08:13:19.382464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e6b812-b08eebed-595ee680-55a7274f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:19.394345Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:19.394369Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:19.394371Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:19.394379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534533921904025:6962]
2025-10-02T08:13:19.394384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534533921904025:6962]
2025-10-02T08:13:19.394428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:19.394438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.394437Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:19.394443Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:19.394443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:19.394685Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:19.399903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId: src_id|c4e6b812-b08eebed-595ee680-55a7274f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:19.402481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:19.542853Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:19.543601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.543617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.543746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:19.543754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:19.543804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1703 reason: error at write: Disconnected sessionId: src_id|c4e6b812-b08eebed-595ee680-55a7274f_0
2025-10-02T08:13:19.543876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_18_7955205124146356881_v1
2025-10-02T08:13:19.543892Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:19.543973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1703 sessionId: src_id|c4e6b812-b08eebed-595ee680-55a7274f_0 is DEAD
2025-10-02T08:13:19.544127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534533921903900:6945]
2025-10-02T08:13:19.544149Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_18_7955205124146356881_v1
2025-10-02T08:13:19.544350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e6b812-b08eebed-595ee680-55a7274f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:19.544360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e6b812-b08eebed-595ee680-55a7274f_0] Write session will restart in 0.009653s
2025-10-02T08:13:19.544386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e6b812-b08eebed-595ee680-55a7274f_0] Write session: Do CDS request
2025-10-02T08:13:19.544392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e6b812-b08eebed-595ee680-55a7274f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:19.543875Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:19.555310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e6b812-b08eebed-595ee680-55a7274f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.555383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:19.555400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1704
2025-10-02T08:13:19.555547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.555578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:19.555586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:19.555590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:19.556016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1704 sessionId:  describe result for acl check
2025-10-02T08:13:19.556056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:19.556058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:19.556060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:19.556066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534533921904506:6935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:19.556602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534533921904506:6935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:19.558934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534533921904506:6935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:19.567784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534533921904506:6935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:19.567800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534533921904506:6935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:19.567804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534533921904506:6935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:19.567812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:19.568686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:19.571463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:19.571669Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:19.571679Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:19.571689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:19.571735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:19.571773Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534533921904732:6934]
2025-10-02T08:13:19.572387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:19.572587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:19.572622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:19.572898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:19.572942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.572947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.572948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.572949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.572950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.572954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.572964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.572968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.572970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.572973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.572979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.572985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.572990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.572994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.572998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.573002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.573006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.573019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.573030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.573034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.573049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:19.584509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:19.586109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:19.586141Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:19.586144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:19.586148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:19.586157Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1703 [1:7556534533921904732:6934]
2025-10-02T08:13:19.586170Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:19.586187Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:19.586190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.586193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.586196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.586213Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:19.586225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:19.586230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:19.586298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.586306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.586310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:19.586312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:19.586369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:19.586376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.586389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.586407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:19.586428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534533921904726:6934]
2025-10-02T08:13:19.586434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534533921904726:6934]
2025-10-02T08:13:19.586441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:19.586454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921904714:6935], now have 1 active actors on pipe
2025-10-02T08:13:19.586455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:19.586455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1703
2025-10-02T08:13:19.586458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:19.586463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:19.586476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:19.586479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:19.586484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534534381642190:2378], now have 1 active actors on pipe
2025-10-02T08:13:19.586488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.586491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.586531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534533921904726:6934]
2025-10-02T08:13:19.586535Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:19.586550Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:19.586562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.586568Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:19.586568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.586570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:19.586579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.586592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:19.586633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.586683Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1703
2025-10-02T08:13:19.586682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.586697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.586711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.586758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1704 partition: 0 MaxSeqNo: 17 sessionId: src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0
2025-10-02T08:13:19.587054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e6b812-b08eebed-595ee680-55a7274f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:19.589687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0] Write session: try to update token
2025-10-02T08:13:19.589703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:19.603507Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:19.603527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:19.603529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:19.603537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534533921904726:6934]
2025-10-02T08:13:19.603541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534533921904726:6934]
2025-10-02T08:13:19.603568Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:19.603573Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:19.603575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:19.603583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.603585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:19.603724Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:19.604242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId: src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:19.606743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:19.644504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534533921904761:6945]
2025-10-02T08:13:19.644660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1703, pipe: [1:7556534533921904761:6945]
2025-10-02T08:13:19.752411Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:19.752905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.752920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.752959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921904761:6945], now have 1 active actors on pipe
2025-10-02T08:13:19.753157Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:19.753089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:19.753112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:19.753179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1704 reason: error at write: Disconnected sessionId: src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0
2025-10-02T08:13:19.753325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1704 sessionId: src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0 is DEAD
2025-10-02T08:13:19.753433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:19.753443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0] Write session will restart in 0.009061s
2025-10-02T08:13:19.753430Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:19.753466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0] Write session: Do CDS request
2025-10-02T08:13:19.753472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:19.753498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534533921904761:6945]
2025-10-02T08:13:19.763312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.763344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:19.763358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1705
2025-10-02T08:13:19.763557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.763588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:19.763596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:19.763600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:19.764106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1705 sessionId:  describe result for acl check
2025-10-02T08:13:19.764143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:19.764149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:19.764151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:19.764156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534533921905182:6920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:19.764672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534533921905182:6920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:19.767038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534533921905182:6920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:19.770492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534533921905182:6920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:19.770503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534533921905182:6920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:19.770506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534533921905182:6920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:19.770513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:19.774275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:19.774674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:19.774949Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:19.774959Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:19.774968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:19.775022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:19.775057Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534533921905416:6925]
2025-10-02T08:13:19.775529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:19.775709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:19.775735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:19.775947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:19.775978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.775983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.775983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.775984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.775984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.775988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.775994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.775996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.775998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.776000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.776003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.776007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.776011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.776014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.776016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.776019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.776021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.776024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.776026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.776028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.776039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:19.783684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:19.785230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:19.785242Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:19.785246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:19.785250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:19.785256Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1704 [1:7556534533921905416:6925]
2025-10-02T08:13:19.785266Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:19.785284Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:19.785287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.785289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.785291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.785307Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:19.785311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:19.785317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:19.785373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.785379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.785382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:19.785385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:19.785446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:19.785452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.785464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.785480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:19.785498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534533921905410:6925]
2025-10-02T08:13:19.785503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534533921905410:6925]
2025-10-02T08:13:19.785511Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:19.785523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:19.785526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:19.785531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1704
2025-10-02T08:13:19.785532Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:19.785539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:19.785542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:19.785552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921905395:6920], now have 1 active actors on pipe
2025-10-02T08:13:19.785584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534534381642199:2378], now have 1 active actors on pipe
2025-10-02T08:13:19.785591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.785595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.785608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534533921905410:6925]
2025-10-02T08:13:19.785618Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:19.785611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1704
2025-10-02T08:13:19.785634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:19.785644Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:19.785649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.785653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.785656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:19.785665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.785673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:19.785696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.785738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.785744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.785756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.785792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1705 partition: 0 MaxSeqNo: 17 sessionId: src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0
2025-10-02T08:13:19.786086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dc2b5c-550344a-6c1d926e-7f6beef8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:19.788563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Write session: try to update token
2025-10-02T08:13:19.788578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:19.802288Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:19.802309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:19.802311Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:19.802319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534533921905410:6925]
2025-10-02T08:13:19.802324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534533921905410:6925]
2025-10-02T08:13:19.802362Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:19.802364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:19.802371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.802372Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:19.802373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:19.802511Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:19.803058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId: src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:19.805674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:19.853920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534533921905441:6945]
2025-10-02T08:13:19.854037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1704, pipe: [1:7556534533921905441:6945]
2025-10-02T08:13:19.952028Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:19.952614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.952631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.952669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921905441:6945], now have 1 active actors on pipe
2025-10-02T08:13:19.952850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:19.953241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 167 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:13:19.953266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:19.953269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Write session will restart in 0.007227s
2025-10-02T08:13:19.953291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Write session: Do CDS request
2025-10-02T08:13:19.953298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:19.952815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534533921905441:6945]
2025-10-02T08:13:19.952847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:19.952849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:19.952914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1705 reason: error at write: Disconnected sessionId: src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0
2025-10-02T08:13:19.953094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1705 sessionId: src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0 is DEAD
2025-10-02T08:13:19.953164Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:19.961324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.961355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:19.961370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1706
2025-10-02T08:13:19.961574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:19.961610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:19.961619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:19.961623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:19.962151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1706 sessionId:  describe result for acl check
2025-10-02T08:13:19.962193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:19.962202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:19.962203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:19.962208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534533921905784:6911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:19.962738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534533921905784:6911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:19.965814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534533921905784:6911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:19.969331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534533921905784:6911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:19.969348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534533921905784:6911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:19.969351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534533921905784:6911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:19.969359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:19.973141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:19.975212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:19.975362Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:19.975371Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:19.975379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:19.975425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:19.975457Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534533921906098:6913]
2025-10-02T08:13:19.976127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:19.976310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:19.976342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:19.976633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:19.976671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.976676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.976677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.976678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.976680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.976684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.976694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.976698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.976702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.976705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.976710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.976717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:19.976722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.976727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:19.976732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.976737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:19.976741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.976746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.976750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.976754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.976771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:19.984733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:19.986488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:19.986504Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:19.986507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:19.986510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:19.986517Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1705 [1:7556534533921906098:6913]
2025-10-02T08:13:19.986529Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:19.986543Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:19.986547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.986550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.986552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.986566Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:19.986571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:19.986576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:19.986643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.986651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.986653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:19.986656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:19.986714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:19.986723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:19.986735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:19.986747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:19.986762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534533921906090:6913]
2025-10-02T08:13:19.986764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534533921906090:6913]
2025-10-02T08:13:19.986771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:19.986786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534533921906026:6911], now have 1 active actors on pipe
2025-10-02T08:13:19.986795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:19.986796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1705
2025-10-02T08:13:19.986799Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:19.986802Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:19.986807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:19.986810Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:19.986815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534534381642207:2378], now have 1 active actors on pipe
2025-10-02T08:13:19.986839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.986856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.986868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534533921906090:6913]
2025-10-02T08:13:19.986877Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:19.986898Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:19.986899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:19.986908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:19.986912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:19.986914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:19.986922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:19.986929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:19.986945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.986907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1705
2025-10-02T08:13:19.986995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:19.987001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:19.987013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:19.987046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1706 partition: 0 MaxSeqNo: 17 sessionId: src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0
2025-10-02T08:13:19.987401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a97e0bf-70b367c-60fed86d-5e8c12f6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:19.990148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0] Write session: try to update token
2025-10-02T08:13:19.990161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:20.004397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId: src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:20.004522Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:20.004535Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:20.004537Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:20.004545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534533921906090:6913]
2025-10-02T08:13:20.004549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534533921906090:6913]
2025-10-02T08:13:20.004588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:20.004589Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:20.004595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:20.004598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.004600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:20.004764Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:20.007027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:20.053073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534538216873418:6945]
2025-10-02T08:13:20.053229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1705, pipe: [1:7556534538216873418:6945]
2025-10-02T08:13:20.158623Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:20.159113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.159127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.159165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216873418:6945], now have 1 active actors on pipe
2025-10-02T08:13:20.159333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534538216873418:6945]
2025-10-02T08:13:20.159363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:20.159371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:20.159427Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:20.159753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:20.159763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0] Write session will restart in 0.006882s
2025-10-02T08:13:20.159785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0] Write session: Do CDS request
2025-10-02T08:13:20.159792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:20.159435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1706 reason: error at write: Disconnected sessionId: src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0
2025-10-02T08:13:20.159435Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:20.159611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1706 sessionId: src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0 is DEAD
2025-10-02T08:13:20.168332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.168458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:20.168469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1707
2025-10-02T08:13:20.168579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.168613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:20.168621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:20.168624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:20.169008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1707 sessionId:  describe result for acl check
2025-10-02T08:13:20.169034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:20.169035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:20.169036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:20.169039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534538216873816:6892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:20.169437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534538216873816:6892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:20.172224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534538216873816:6892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:20.175436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534538216873816:6892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:20.175447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534538216873816:6892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:20.175449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534538216873816:6892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:20.175455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:20.178786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:20.179206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:20.179385Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:20.179396Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:20.179405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:20.179454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:20.179490Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534538216874075:6900]
2025-10-02T08:13:20.179928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:20.180131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:20.180158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:20.180375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:20.180411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.180418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.180420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.180421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.180422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.180427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.180433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.180436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.180438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.180439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.180443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.180448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.180452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.180457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.180462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.180466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.180470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.180474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.180478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.180482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.180498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:20.189083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:20.190705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:20.190723Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:20.190726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:20.190730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:20.190738Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1706 [1:7556534538216874075:6900]
2025-10-02T08:13:20.190751Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:20.190769Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:20.190772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.190775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.190778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.190794Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:20.190805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:20.190812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:20.190881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.190888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.190892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:20.190894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:20.190962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:20.190970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.190983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.190995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:20.191014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534538216874069:6900]
2025-10-02T08:13:20.191022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534538216874069:6900]
2025-10-02T08:13:20.191030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:20.191043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:20.191058Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:20.191063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:20.191067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:20.191067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:20.191068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1706
2025-10-02T08:13:20.191076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216874054:6892], now have 1 active actors on pipe
2025-10-02T08:13:20.191109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.191117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.191133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534538676609512:2378], now have 1 active actors on pipe
2025-10-02T08:13:20.191140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534538216874069:6900]
2025-10-02T08:13:20.191148Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:20.191158Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:20.191177Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:20.191188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.191191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.191193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:20.191203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.191217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:20.191188Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1706
2025-10-02T08:13:20.191246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.191293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.191301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.191314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.191354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1707 partition: 0 MaxSeqNo: 17 sessionId: src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0
2025-10-02T08:13:20.191708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4d3007-2e336788-dcbdfccb-4baf35f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:20.194636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0] Write session: try to update token
2025-10-02T08:13:20.194654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:20.208630Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:20.208646Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:20.208648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:20.208654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534538216874069:6900]
2025-10-02T08:13:20.208657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534538216874069:6900]
2025-10-02T08:13:20.208692Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:20.208696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:20.208698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:20.208704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.208706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:20.208891Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:20.209695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId: src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:20.212454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:20.270752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534538216874112:6945]
2025-10-02T08:13:20.272523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1706, pipe: [1:7556534538216874112:6945]
2025-10-02T08:13:20.344432Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:20.344911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.344923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.344956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216874112:6945], now have 1 active actors on pipe
2025-10-02T08:13:20.345058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:20.345066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:20.345117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1707 reason: error at write: Disconnected sessionId: src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0
2025-10-02T08:13:20.345142Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:20.345183Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:20.345286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1707 sessionId: src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0 is DEAD
2025-10-02T08:13:20.345426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:20.345436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0] Write session will restart in 0.007782s
2025-10-02T08:13:20.345443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534538216874112:6945]
2025-10-02T08:13:20.345472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0] Write session: Do CDS request
2025-10-02T08:13:20.345478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:20.354326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.354416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:20.354433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1708
2025-10-02T08:13:20.354557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.354586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:20.354595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:20.354598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:20.354976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1708 sessionId:  describe result for acl check
2025-10-02T08:13:20.355009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:20.355015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:20.355016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:20.355021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534538216874521:6869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:20.355516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534538216874521:6869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:20.358206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534538216874521:6869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:20.361908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534538216874521:6869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:20.361921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534538216874521:6869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:20.361924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534538216874521:6869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:20.361932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:20.364505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:20.366508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:20.366658Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:20.366666Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:20.366672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:20.366702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:20.366730Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534538216874795:6867]
2025-10-02T08:13:20.367136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:20.367302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:20.367331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:20.367523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:20.367549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.367553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.367553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.367554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.367555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.367558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.367564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.367566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.367568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.367570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.367574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.367578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.367582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.367584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.367587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.367590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.367592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.367594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.367596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.367599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.367608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:20.376525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:20.378226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:20.378244Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:20.378247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:20.378252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:20.378259Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1707 [1:7556534538216874795:6867]
2025-10-02T08:13:20.378272Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:20.378292Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:20.378295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.378298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.378301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.378317Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:20.378357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:20.378364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:20.378421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.378427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.378431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:20.378434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:20.378493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:20.378499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.378514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.378525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:20.378545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534538216874789:6867]
2025-10-02T08:13:20.378550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534538216874789:6867]
2025-10-02T08:13:20.378557Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:20.378572Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:20.378575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534538676609540:2378], now have 1 active actors on pipe
2025-10-02T08:13:20.378582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:20.378583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:20.378594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:20.378597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:20.378603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216874748:6869], now have 1 active actors on pipe
2025-10-02T08:13:20.378631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534538216874789:6867]
2025-10-02T08:13:20.378645Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:20.378676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1707
2025-10-02T08:13:20.378698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:20.378737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.378746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.378769Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:20.378779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.378783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.378789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:20.378799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.378810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:20.378829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.378867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.378873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.378823Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1707
2025-10-02T08:13:20.378885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.378921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1708 partition: 0 MaxSeqNo: 17 sessionId: src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0
2025-10-02T08:13:20.379249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89237a84-ef4c5784-24dffc2e-53feaabe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:20.381885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0] Write session: try to update token
2025-10-02T08:13:20.381905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:20.396310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId: src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:20.396465Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:20.396480Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:20.396481Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:20.396488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534538216874789:6867]
2025-10-02T08:13:20.396492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534538216874789:6867]
2025-10-02T08:13:20.396540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:20.396554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.396556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:20.396583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:20.396598Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:20.396716Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:20.399256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:20.445765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534538216874821:6945]
2025-10-02T08:13:20.445873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1707, pipe: [1:7556534538216874821:6945]
2025-10-02T08:13:20.531538Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:20.532115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.532128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.532166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216874821:6945], now have 1 active actors on pipe
2025-10-02T08:13:20.532304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534538216874821:6945]
2025-10-02T08:13:20.532329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:20.532331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:20.532388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1708 reason: error at write: Disconnected sessionId: src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0
2025-10-02T08:13:20.532437Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:20.532541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1708 sessionId: src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0 is DEAD
2025-10-02T08:13:20.532588Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:20.532686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:20.532694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0] Write session will restart in 0.005712s
2025-10-02T08:13:20.532719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0] Write session: Do CDS request
2025-10-02T08:13:20.532726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:20.539316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.539364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:20.539379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1709
2025-10-02T08:13:20.539551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.539599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:20.539607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:20.539611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:20.540283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1709 sessionId:  describe result for acl check
2025-10-02T08:13:20.540313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:20.540315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:20.540316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:20.540321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534538216875135:6855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:20.540816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534538216875135:6855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:20.543708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534538216875135:6855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:20.546858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534538216875135:6855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:20.546868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534538216875135:6855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:20.546871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534538216875135:6855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:20.546876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:20.552190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:20.554217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:20.554370Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:20.554378Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:20.554387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:20.554432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:20.554468Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534538216875492:6858]
2025-10-02T08:13:20.554941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:20.555088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:20.555114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:20.555326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:20.555358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.555362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.555363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.555364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.555364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.555368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.555375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.555377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.555379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.555385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.555389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.555394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.555397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.555400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.555405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.555409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.555413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.555418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.555423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.555432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.555454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:20.563348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:20.565243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:20.565256Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:20.565258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:20.565260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:20.565266Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1708 [1:7556534538216875492:6858]
2025-10-02T08:13:20.565273Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:20.565286Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:20.565288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.565290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.565291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.565303Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:20.565308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:20.565316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:20.565364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.565369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.565371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:20.565373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:20.565419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:20.565424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.565433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.565440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:20.565452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534538216875486:6858]
2025-10-02T08:13:20.565457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534538216875486:6858]
2025-10-02T08:13:20.565463Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:20.565474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:20.565486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:20.565490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:20.565500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216875375:6855], now have 1 active actors on pipe
2025-10-02T08:13:20.565501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1708
2025-10-02T08:13:20.565502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:20.565505Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:20.565523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534538216875486:6858]
2025-10-02T08:13:20.565530Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:20.565534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.565537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.565553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:20.565559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534538676609558:2378], now have 1 active actors on pipe
2025-10-02T08:13:20.565570Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:20.565578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.565581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.565587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:20.565595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.565607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:20.565630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.565652Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1708
2025-10-02T08:13:20.565701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.565708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.565718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.565753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1709 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0
2025-10-02T08:13:20.566065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b4f9e6-da18c91e-1ed4e6ab-be2f5cb6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:20.568756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0] Write session: try to update token
2025-10-02T08:13:20.568768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:20.582446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId: src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:20.582696Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:20.582710Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:20.582712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:20.582718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534538216875486:6858]
2025-10-02T08:13:20.582721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534538216875486:6858]
2025-10-02T08:13:20.582753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:20.582762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.582764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:20.582767Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:20.582773Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:20.582896Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:20.584981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:20.632664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534538216875521:6945]
2025-10-02T08:13:20.632781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1708, pipe: [1:7556534538216875521:6945]
2025-10-02T08:13:20.719066Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:20.719343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.719356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.719400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216875521:6945], now have 1 active actors on pipe
2025-10-02T08:13:20.719557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:20.719569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:20.719598Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:20.719674Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:20.719638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1709 reason: error at write: Disconnected sessionId: src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0
2025-10-02T08:13:20.719867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1709 sessionId: src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0 is DEAD
2025-10-02T08:13:20.719925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534538216875521:6945]
2025-10-02T08:13:20.719983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:20.719991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0] Write session will restart in 0.006217s
2025-10-02T08:13:20.720020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0] Write session: Do CDS request
2025-10-02T08:13:20.720027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:20.727367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.727533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:20.727549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1710
2025-10-02T08:13:20.727681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.727706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:20.727713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:20.727715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:20.728155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1710 sessionId:  describe result for acl check
2025-10-02T08:13:20.728198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:20.728199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:20.728201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:20.728206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534538216875844:6842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:20.728706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534538216875844:6842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:20.731971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534538216875844:6842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:20.736229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534538216875844:6842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:20.736245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534538216875844:6842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:20.736248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534538216875844:6842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:20.736257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:20.741400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:20.743669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:20.743868Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:20.743880Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:20.743890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:20.743946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:20.743990Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534538216876182:6844]
2025-10-02T08:13:20.744654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:20.744917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:20.744967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:20.745273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:20.745312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.745318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.745319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.745320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.745321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.745325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.745334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.745337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.745340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.745343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.745347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.745354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.745358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.745362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.745367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.745371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.745374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.745379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.745382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.745387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.745405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:20.753594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:20.755653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:20.755669Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:20.755671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:20.755675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:20.755681Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1709 [1:7556534538216876182:6844]
2025-10-02T08:13:20.755694Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:20.755717Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:20.755723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.755726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.755728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.755743Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:20.755748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:20.755753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:20.755822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.755828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.755831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:20.755834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:20.755897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:20.755908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.755921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.755933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:20.755950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216876085:6842], now have 1 active actors on pipe
2025-10-02T08:13:20.755961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534538216876176:6844]
2025-10-02T08:13:20.755963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534538216876176:6844]
2025-10-02T08:13:20.755969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:20.755977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1709
2025-10-02T08:13:20.755985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:20.755986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:20.755989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:20.756000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:20.756003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:20.756010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534538676609567:2378], now have 1 active actors on pipe
2025-10-02T08:13:20.756015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.756019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.756057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534538216876176:6844]
2025-10-02T08:13:20.756065Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:20.756079Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:20.756085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:20.756089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.756093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.756094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:20.756057Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1709
2025-10-02T08:13:20.756103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.756111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:20.756150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.756214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.756220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.756232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.756267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1710 partition: 0 MaxSeqNo: 17 sessionId: src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0
2025-10-02T08:13:20.756638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0538ab-4a2d66c2-df62f3d5-6a3a91b3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:20.759282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0] Write session: try to update token
2025-10-02T08:13:20.759296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:20.773802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId: src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:20.776422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:20.778143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.778167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.778189Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:20.778191Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:20.778194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:20.778202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534538216876176:6844]
2025-10-02T08:13:20.778206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534538216876176:6844]
2025-10-02T08:13:20.778256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:20.778262Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:20.778268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.778270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:20.778271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:20.778487Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:20.820064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534538216876211:6945]
2025-10-02T08:13:20.820207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1709, pipe: [1:7556534538216876211:6945]
2025-10-02T08:13:20.914734Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:20.915304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:20.915352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:20.915365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216876211:6945], now have 1 active actors on pipe
2025-10-02T08:13:20.915439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:20.915450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:20.915468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1710 reason: error at write: Disconnected sessionId: src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0
2025-10-02T08:13:20.915578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1710 sessionId: src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0 is DEAD
2025-10-02T08:13:20.915570Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:20.915722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:20.915731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0] Write session will restart in 0.006627s
2025-10-02T08:13:20.915754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0] Write session: Do CDS request
2025-10-02T08:13:20.915760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:20.915745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534538216876211:6945]
2025-10-02T08:13:20.923280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.923373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:20.923397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1711
2025-10-02T08:13:20.923517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:20.923546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:20.923551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:20.923554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:20.923961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1711 sessionId:  describe result for acl check
2025-10-02T08:13:20.923989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:20.923990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:20.923992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:20.923998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534538216876529:6813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:20.924612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534538216876529:6813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:20.927482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534538216876529:6813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:20.931227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534538216876529:6813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:20.931239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534538216876529:6813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:20.931241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534538216876529:6813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:20.931248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:20.936937Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 17 CurrentSessionLifetimeMs: 361631 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:13:20.937242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:20.939421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:20.939608Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:20.939620Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:20.939630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:20.939674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:20.939714Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534538216876874:6812]
2025-10-02T08:13:20.940382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:20.940549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:20.940596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:20.940918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:20.940970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.940976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.940977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.940978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.940980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.940984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.940995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.940999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.941004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.941008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.941014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.941022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:20.941030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.941035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:20.941044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.941049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:20.941058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.941063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.941069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.941079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.941099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:20.949230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:20.950820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:20.950840Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:20.950843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:20.950846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:20.950853Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1710 [1:7556534538216876874:6812]
2025-10-02T08:13:20.950865Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:20.950882Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:20.950885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.950888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.950890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.950905Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:20.950910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:20.950917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:20.950973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.950984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.950987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:20.950990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:20.951057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:20.951069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.951081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:20.951095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:20.951115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534538676609573:2378], now have 1 active actors on pipe
2025-10-02T08:13:20.951120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534538216876753:6813], now have 1 active actors on pipe
2025-10-02T08:13:20.951129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534538216876868:6812]
2025-10-02T08:13:20.951136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534538216876868:6812]
2025-10-02T08:13:20.951140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1710
2025-10-02T08:13:20.951144Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:20.951155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:20.951157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:20.951158Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:20.951171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:20.951174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:20.951182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.951187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.951182Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1710
2025-10-02T08:13:20.951226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534538216876868:6812]
2025-10-02T08:13:20.951239Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:20.951254Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:20.951260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:20.951264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:20.951266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:20.951267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:20.951275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:20.951288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:20.951332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.951426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:20.951437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:20.951451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:20.951491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1711 partition: 0 MaxSeqNo: 17 sessionId: src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0
2025-10-02T08:13:20.951801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989d560c-d3fe2e67-4836d841-c4ea71de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:20.954353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0] Write session: try to update token
2025-10-02T08:13:20.954369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:20.968556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId: src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:20.968933Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:20.968949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:20.968952Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:20.968959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534538216876868:6812]
2025-10-02T08:13:20.968963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534538216876868:6812]
2025-10-02T08:13:20.969008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:20.969007Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:20.969021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:20.969022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:20.969023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:20.969163Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:20.971200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:21.016150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534542511844198:6945]
2025-10-02T08:13:21.016277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1710, pipe: [1:7556534542511844198:6945]
2025-10-02T08:13:21.116780Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:21.117298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.117308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.117340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511844198:6945], now have 1 active actors on pipe
2025-10-02T08:13:21.117434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:21.117449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:21.117525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1711 reason: error at write: Disconnected sessionId: src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0
2025-10-02T08:13:21.117658Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:21.117686Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:21.117692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1711 sessionId: src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0 is DEAD
2025-10-02T08:13:21.117855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:21.117866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0] Write session will restart in 0.009277s
2025-10-02T08:13:21.117864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534542511844198:6945]
2025-10-02T08:13:21.117890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0] Write session: Do CDS request
2025-10-02T08:13:21.117897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:21.128338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.128404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:21.128420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1712
2025-10-02T08:13:21.128537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.128568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:21.128577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:21.128581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:21.129176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1712 sessionId:  describe result for acl check
2025-10-02T08:13:21.129210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:21.129214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:21.129215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:21.129234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534542511844632:6799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:21.129755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534542511844632:6799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:21.132770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534542511844632:6799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:21.136372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534542511844632:6799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:21.136383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534542511844632:6799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:21.136387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534542511844632:6799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:21.136395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:21.139800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:21.140179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:21.140348Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:21.140356Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:21.140363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:21.140405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:21.140435Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534542511844865:6798]
2025-10-02T08:13:21.140925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:21.141691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:21.141730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:21.141944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:21.141972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.141977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.141977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.141978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.141979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.141983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.141990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.141992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.141994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.141996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.142001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.142005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.142009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.142011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.142014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.142017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.142019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.142023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.142026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.142029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.142040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:21.149879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:21.151594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:21.151608Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:21.151610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:21.151613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:21.151618Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1711 [1:7556534542511844865:6798]
2025-10-02T08:13:21.151627Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:21.151643Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:21.151644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.151646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.151648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.151661Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:21.151664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:21.151669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:21.151715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.151725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.151727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:21.151728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:21.151777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:21.151783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.151792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.151799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:21.151812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534542511844859:6798]
2025-10-02T08:13:21.151818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534542511844859:6798]
2025-10-02T08:13:21.151824Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:21.151833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:21.151845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:21.151847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:21.151865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1711
2025-10-02T08:13:21.151874Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:21.151877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511844844:6799], now have 1 active actors on pipe
2025-10-02T08:13:21.151878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:21.151880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534542511844859:6798]
2025-10-02T08:13:21.151882Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:21.151885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:21.151900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534542971576876:2378], now have 1 active actors on pipe
2025-10-02T08:13:21.151907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.151909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.151936Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|933929df-7fa01e23-d521f0a-b923e995_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:21.151948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.151955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.151957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:21.151966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.151979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:21.151993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.151982Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1711
2025-10-02T08:13:21.152047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.152052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.152067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.152097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1712 partition: 0 MaxSeqNo: 17 sessionId: src_id|933929df-7fa01e23-d521f0a-b923e995_0
2025-10-02T08:13:21.152420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60fd4eb4-e257032a-fdf40ad5-bc2f034b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|933929df-7fa01e23-d521f0a-b923e995_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:21.155045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|933929df-7fa01e23-d521f0a-b923e995_0] Write session: try to update token
2025-10-02T08:13:21.155061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|933929df-7fa01e23-d521f0a-b923e995_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:21.169369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId: src_id|933929df-7fa01e23-d521f0a-b923e995_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:21.170068Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:21.170081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:21.170083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:21.170089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534542511844859:6798]
2025-10-02T08:13:21.170093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534542511844859:6798]
2025-10-02T08:13:21.170133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:21.170142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.170149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:21.170160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:21.170171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:21.170324Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:21.171908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:21.217868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534542511844889:6945]
2025-10-02T08:13:21.217989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1711, pipe: [1:7556534542511844889:6945]
2025-10-02T08:13:21.299266Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:21.299749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.299762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.299791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511844889:6945], now have 1 active actors on pipe
2025-10-02T08:13:21.299954Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:21.300009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:21.300334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:21.300386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1712 reason: status is not ok: tablet will be restarted right now sessionId: src_id|933929df-7fa01e23-d521f0a-b923e995_0
2025-10-02T08:13:21.300514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1712 sessionId: src_id|933929df-7fa01e23-d521f0a-b923e995_0 is DEAD
2025-10-02T08:13:21.300653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534542511844889:6945]
2025-10-02T08:13:21.300677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933929df-7fa01e23-d521f0a-b923e995_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:21.300688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933929df-7fa01e23-d521f0a-b923e995_0] Write session will restart in 0.005328s
2025-10-02T08:13:21.300712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933929df-7fa01e23-d521f0a-b923e995_0] Write session: Do CDS request
2025-10-02T08:13:21.300718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933929df-7fa01e23-d521f0a-b923e995_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:21.307281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|933929df-7fa01e23-d521f0a-b923e995_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.307386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:21.307400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1713
2025-10-02T08:13:21.307517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.307547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:21.307556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:21.307559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:21.307966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1713 sessionId:  describe result for acl check
2025-10-02T08:13:21.307992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:21.307996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:21.307997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:21.308000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534542511845281:6777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:21.308606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534542511845281:6777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:21.311539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534542511845281:6777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:21.315218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534542511845281:6777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:21.315234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534542511845281:6777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:21.315239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534542511845281:6777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:21.315246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:21.319966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:21.320308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:21.320557Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:21.320564Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:21.320571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:21.320607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:21.320634Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534542511845587:6782]
2025-10-02T08:13:21.321164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:21.321389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:21.321443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:21.321761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:21.321811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.321817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.321818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.321819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.321820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.321825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.321836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.321840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.321844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.321848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.321853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.321862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.321868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.321877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.321882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.321892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.321901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.321906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.321911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.321920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.321939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:21.329643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:21.331091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:21.331107Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:21.331111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:21.331114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:21.331121Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1712 [1:7556534542511845587:6782]
2025-10-02T08:13:21.331132Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:21.331147Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:21.331150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.331153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.331155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.331170Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:21.331175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:21.331187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:21.331244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.331254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.331257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:21.331259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:21.331380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1712
2025-10-02T08:13:21.331510Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1712
2025-10-02T08:13:21.331565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:21.331574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.331586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.331602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:21.331623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511845525:6777], now have 1 active actors on pipe
2025-10-02T08:13:21.331630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534542971576885:2378], now have 1 active actors on pipe
2025-10-02T08:13:21.331635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.331638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.331659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534542511845581:6782]
2025-10-02T08:13:21.331665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534542511845581:6782]
2025-10-02T08:13:21.331675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:21.331690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:21.331693Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:21.331695Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:21.331706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:21.331709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:21.331721Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:21.331731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.331734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.331735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:21.331744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.331752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:21.331793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534542511845581:6782]
2025-10-02T08:13:21.331804Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:21.331816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:21.331821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.331889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.331896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.331907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.331942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1713 partition: 0 MaxSeqNo: 17 sessionId: src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0
2025-10-02T08:13:21.332303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933929df-7fa01e23-d521f0a-b923e995_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:21.335455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0] Write session: try to update token
2025-10-02T08:13:21.335473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:21.349340Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:21.349361Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:21.349364Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:21.349372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534542511845581:6782]
2025-10-02T08:13:21.349376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534542511845581:6782]
2025-10-02T08:13:21.349418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:21.349424Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:21.349428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.349429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:21.349430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:21.349562Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:21.350805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId: src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:21.353182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:21.400657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534542511845620:6945]
2025-10-02T08:13:21.400772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1712, pipe: [1:7556534542511845620:6945]
2025-10-02T08:13:21.487329Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:21.487699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.487711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.487744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511845620:6945], now have 1 active actors on pipe
2025-10-02T08:13:21.487865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:21.487873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:21.487915Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:21.487943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1713 reason: error at write: Disconnected sessionId: src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0
2025-10-02T08:13:21.488014Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:21.488116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1713 sessionId: src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0 is DEAD
2025-10-02T08:13:21.488226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534542511845620:6945]
2025-10-02T08:13:21.488263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:21.488274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0] Write session will restart in 0.008122s
2025-10-02T08:13:21.488299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0] Write session: Do CDS request
2025-10-02T08:13:21.488305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:21.497304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.497363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:21.497377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1714
2025-10-02T08:13:21.497542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.497582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:21.497593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:21.497596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:21.498024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1714 sessionId:  describe result for acl check
2025-10-02T08:13:21.498056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:21.498062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:21.498063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:21.498068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534542511846026:6755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:21.498569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534542511846026:6755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:21.501136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534542511846026:6755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:21.504641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534542511846026:6755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:21.504653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534542511846026:6755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:21.504656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534542511846026:6755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:21.504663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:21.510402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:21.510757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:21.510918Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:21.510927Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:21.510936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:21.510984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:21.511019Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534542511846304:6759]
2025-10-02T08:13:21.511680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:21.511861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:21.511903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:21.512206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:21.512242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.512247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.512248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.512249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.512251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.512255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.512265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.512273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.512282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.512289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.512294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.512301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.512311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.512316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.512324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.512329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.512338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.512343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.512352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.512357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.512381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:21.520101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:21.521806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:21.521824Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:21.521828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:21.521832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:21.521838Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1713 [1:7556534542511846304:6759]
2025-10-02T08:13:21.521849Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:21.521867Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:21.521870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.521873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.521875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.521890Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:21.521894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:21.521901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:21.521957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.521965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.521968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:21.521970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:21.522043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:21.522050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.522064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.522077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:21.522099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511846226:6755], now have 1 active actors on pipe
2025-10-02T08:13:21.522100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1713
2025-10-02T08:13:21.522109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534542511846298:6759]
2025-10-02T08:13:21.522111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534542511846298:6759]
2025-10-02T08:13:21.522124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:21.522137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:21.522143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534542971576926:2378], now have 1 active actors on pipe
2025-10-02T08:13:21.522147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:21.522148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.522151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.522167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:21.522187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:21.522194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:21.522178Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1713
2025-10-02T08:13:21.522233Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:21.522243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.522246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.522248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:21.522257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.522266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:21.522279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534542511846298:6759]
2025-10-02T08:13:21.522291Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:21.522302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:21.522321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.522433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.522443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.522458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.522492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1714 partition: 0 MaxSeqNo: 17 sessionId: src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0
2025-10-02T08:13:21.522799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c85aa6e8-6029cc8f-859103e1-353d1189_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:21.525556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0] Write session: try to update token
2025-10-02T08:13:21.525574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:21.540080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId: src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:21.540970Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:21.540984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:21.540986Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:21.540994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534542511846298:6759]
2025-10-02T08:13:21.540998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534542511846298:6759]
2025-10-02T08:13:21.541041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:21.541047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.541049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:21.541053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:21.541066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:21.541201Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:21.542874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:21.588549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534542511846328:6945]
2025-10-02T08:13:21.588660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1713, pipe: [1:7556534542511846328:6945]
2025-10-02T08:13:21.677758Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:21.678167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.678180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.678219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511846328:6945], now have 1 active actors on pipe
2025-10-02T08:13:21.678302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534542511846328:6945]
2025-10-02T08:13:21.678322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:21.678327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:21.678370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1714 reason: error at write: Disconnected sessionId: src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0
2025-10-02T08:13:21.678443Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:21.678448Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:21.678515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1714 sessionId: src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0 is DEAD
2025-10-02T08:13:21.678675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:21.678686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0] Write session will restart in 0.005958s
2025-10-02T08:13:21.678712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0] Write session: Do CDS request
2025-10-02T08:13:21.678719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:21.686308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.686351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:21.686378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1715
2025-10-02T08:13:21.686538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.686576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:21.686585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:21.686589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:21.686982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1715 sessionId:  describe result for acl check
2025-10-02T08:13:21.687015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:21.687021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:21.687023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:21.687028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534542511846686:6747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:21.687515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534542511846686:6747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:21.690425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534542511846686:6747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:21.693639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534542511846686:6747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:21.693654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534542511846686:6747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:21.693657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534542511846686:6747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:21.693675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:21.697624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:21.699512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:21.699645Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:21.699652Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:21.699658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:21.699689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:21.699713Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534542511847008:6745]
2025-10-02T08:13:21.700108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:21.700285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:21.700341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:21.700549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:21.700575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.700579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.700579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.700580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.700580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.700584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.700590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.700592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.700594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.700596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.700600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.700605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.700609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.700612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.700614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.700616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.700619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.700622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.700624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.700627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.700638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:21.708404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:21.710049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:21.710069Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:21.710072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:21.710076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:21.710082Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1714 [1:7556534542511847008:6745]
2025-10-02T08:13:21.710094Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:21.710112Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:21.710115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.710118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.710120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.710135Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:21.710140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:21.710146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:21.710209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.710219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.710222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:21.710225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:21.710283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:21.710291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.710300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.710306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:21.710318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534542511847002:6745]
2025-10-02T08:13:21.710324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534542511847002:6745]
2025-10-02T08:13:21.710329Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:21.710341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511846916:6747], now have 1 active actors on pipe
2025-10-02T08:13:21.710346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:21.710349Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:21.710351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1714
2025-10-02T08:13:21.710353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:21.710364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:21.710367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:21.710372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534542971576933:2378], now have 1 active actors on pipe
2025-10-02T08:13:21.710401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.710409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.710422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534542511847002:6745]
2025-10-02T08:13:21.710433Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:21.710444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:21.710460Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5574a253-cfca4ad-950cdd5b-7904c515_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:21.710469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.710473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.710475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:21.710483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.710492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:21.710471Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1714
2025-10-02T08:13:21.710525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.710586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.710592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.710603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.710635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1715 partition: 0 MaxSeqNo: 17 sessionId: src_id|5574a253-cfca4ad-950cdd5b-7904c515_0
2025-10-02T08:13:21.710904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10f4116-df7b1d5f-9cc62976-6f57e7a2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5574a253-cfca4ad-950cdd5b-7904c515_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:21.713236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5574a253-cfca4ad-950cdd5b-7904c515_0] Write session: try to update token
2025-10-02T08:13:21.713250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5574a253-cfca4ad-950cdd5b-7904c515_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:21.732863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId: src_id|5574a253-cfca4ad-950cdd5b-7904c515_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:21.734774Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:21.734780Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:21.734783Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:21.734792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534542511847002:6745]
2025-10-02T08:13:21.734798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534542511847002:6745]
2025-10-02T08:13:21.734860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:21.734868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.734870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:21.734904Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:21.734913Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:21.735033Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:21.736042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:21.778501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534542511847036:6945]
2025-10-02T08:13:21.778622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1714, pipe: [1:7556534542511847036:6945]
2025-10-02T08:13:21.881597Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:21.882214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.882230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.882269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511847036:6945], now have 1 active actors on pipe
2025-10-02T08:13:21.882378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534542511847036:6945]
2025-10-02T08:13:21.882398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:21.882400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:21.882455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1715 reason: error at write: Disconnected sessionId: src_id|5574a253-cfca4ad-950cdd5b-7904c515_0
2025-10-02T08:13:21.882507Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:21.882508Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:21.882623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1715 sessionId: src_id|5574a253-cfca4ad-950cdd5b-7904c515_0 is DEAD
2025-10-02T08:13:21.882772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5574a253-cfca4ad-950cdd5b-7904c515_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:21.882781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5574a253-cfca4ad-950cdd5b-7904c515_0] Write session will restart in 0.008680s
2025-10-02T08:13:21.882813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5574a253-cfca4ad-950cdd5b-7904c515_0] Write session: Do CDS request
2025-10-02T08:13:21.882820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5574a253-cfca4ad-950cdd5b-7904c515_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:21.892309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5574a253-cfca4ad-950cdd5b-7904c515_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.892420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:21.892434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1716
2025-10-02T08:13:21.892534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:21.892559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:21.892568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:21.892571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:21.893023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1716 sessionId:  describe result for acl check
2025-10-02T08:13:21.893067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:21.893073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:21.893075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:21.893080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534542511847436:6725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:21.893696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534542511847436:6725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:21.896288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534542511847436:6725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:21.900311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534542511847436:6725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:21.900328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534542511847436:6725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:21.900331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534542511847436:6725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:21.900337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:21.903276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:21.905270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:21.905474Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:21.905483Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:21.905493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:21.905543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:21.905578Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534542511847710:6735]
2025-10-02T08:13:21.906206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:21.906410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:21.906451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:21.906736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:21.906777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.906783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.906784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.906785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.906786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.906791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.906801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.906805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.906809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.906813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.906818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.906826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:21.906835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.906841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:21.906849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.906854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:21.906862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.906867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.906875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.906880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.906897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:21.914602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:21.916169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:21.916195Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:21.916198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:21.916201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:21.916207Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1715 [1:7556534542511847710:6735]
2025-10-02T08:13:21.916220Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:21.916241Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:21.916248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.916251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.916253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.916268Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:21.916278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:21.916287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:21.916345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.916352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.916355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:21.916357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:21.916418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:21.916424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.916437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:21.916453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:21.916475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511847651:6725], now have 1 active actors on pipe
2025-10-02T08:13:21.916483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1715
2025-10-02T08:13:21.916488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534542511847704:6735]
2025-10-02T08:13:21.916490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534542511847704:6735]
2025-10-02T08:13:21.916497Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:21.916506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534542971576941:2378], now have 1 active actors on pipe
2025-10-02T08:13:21.916506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:21.916509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:21.916512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:21.916526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:21.916529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:21.916535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.916539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.916574Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534542511847704:6735]
2025-10-02T08:13:21.916582Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:21.916589Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:21.916597Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:21.916571Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1715
2025-10-02T08:13:21.916604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.916612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.916614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:21.916623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.916635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:21.916674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.916761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.916773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.916796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:21.916851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1716 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0
2025-10-02T08:13:21.917187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5574a253-cfca4ad-950cdd5b-7904c515_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:21.919701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0] Write session: try to update token
2025-10-02T08:13:21.919714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:21.933717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId: src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:21.934452Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:21.934464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:21.934470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534542511847704:6735]
2025-10-02T08:13:21.934506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:21.934534Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:21.934677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:21.934847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:21.935011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:21.935139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:21.935327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:21.935361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:21.936274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:21.936340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.936351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.936374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:21.936395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:21.936449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:21.936454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:21.936589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.936643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.936700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.936758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.936798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.936835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.936908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.936961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.937015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.937091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.937137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.937143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.937235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.937292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.937351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.937412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.937453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.937458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.937537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.937613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.937684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.937752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.937845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.937851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.937929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.937995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.938063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.938140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.938202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.938208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.938281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.938344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.938409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.938478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.938525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.938530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.938603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.938711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.938782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.938849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.938909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.938915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.938986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.939050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.939119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.939225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.939286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.939291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.939360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.939417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.939502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.939560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.939608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.939613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.939686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:21.939757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:21.939823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:21.939988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:21.940050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:21.940055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:21.940086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:21.940141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:21.940157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:21.940162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:21.940204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:21.940218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:21.940224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:21.940227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:21.940229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:21.940635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:21.940658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:21.940668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:21.940670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:21.940673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:21.940675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:21.941183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:21.941205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:21.941214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:21.941217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:21.941220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:21.941223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:21.941910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:21.941932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:21.941936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:21.941940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:21.941945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:21.944146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:21.944162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:21.944172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392801943
2025-10-02T08:13:21.944457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:21.944470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:21.944475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:21.944477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:21.944480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:21.944482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:21.945012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:21.945030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:21.945034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:21.945037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:21.945043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:21.945046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:21.945496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:21.945511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:21.945518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:21.945524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:21.945527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:21.945529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:21.946043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:21.946060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:21.946064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:21.947060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:21.947074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:21.947078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:21.947081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:21.947087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392801946
2025-10-02T08:13:21.947370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:21.947385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:21.947388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:21.947394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:21.947397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:21.947399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:21.947798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:21.947812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:21.947816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:21.947818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:21.947820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:21.947822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:21.948313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:21.948331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:21.948425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392801947
2025-10-02T08:13:21.951775Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:21.951790Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:21.951795Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:21.951799Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:21.953362Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:21.953374Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:21.953375Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:21.953383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534542511847704:6735]
2025-10-02T08:13:21.953386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534542511847704:6735]
2025-10-02T08:13:21.953427Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:21.953432Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:21.953432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:21.953437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:21.953438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:21.953570Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:21.982776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534542511847745:6945]
2025-10-02T08:13:21.982874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1715, pipe: [1:7556534542511847745:6945]
2025-10-02T08:13:22.094036Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:22.094313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534542511847745:6945], now have 1 active actors on pipe
2025-10-02T08:13:22.094446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:22.094460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:22.094492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1716 reason: error at write: Disconnected sessionId: src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0
2025-10-02T08:13:22.094515Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:22.094591Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:22.094690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1716 sessionId: src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0 is DEAD
2025-10-02T08:13:22.094850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534542511847745:6945]
2025-10-02T08:13:22.094883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:22.094897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0] Write session will restart in 0.006514s
2025-10-02T08:13:22.094930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0] Write session: Do CDS request
2025-10-02T08:13:22.094936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:22.102455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.102535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:22.102550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1717
2025-10-02T08:13:22.102718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.102752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:22.102761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:22.102765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:22.103245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1717 sessionId:  describe result for acl check
2025-10-02T08:13:22.103277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:22.103283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:22.103285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:22.103290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534546806815381:6730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:22.103778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534546806815381:6730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:22.106939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534546806815381:6730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:22.110839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534546806815381:6730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:22.110855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534546806815381:6730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:22.110858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534546806815381:6730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:22.110867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:22.115572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:22.117723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:22.118004Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:22.118015Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:22.118026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:22.118080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:22.118115Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534546806815718:6729]
2025-10-02T08:13:22.118726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:22.118887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:22.118913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:22.119132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:22.119164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.119168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.119169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.119170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.119170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.119173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.119180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.119182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.119184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.119186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.119190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.119195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.119198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.119201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.119204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.119207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.119209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.119211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.119214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.119216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.119226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:22.127446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:22.129260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:22.129275Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:22.129276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:22.129279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:22.129284Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1716 [1:7556534546806815718:6729]
2025-10-02T08:13:22.129291Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:22.129304Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:22.129307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.129309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.129310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.129323Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:22.129326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:22.129330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:22.129376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.129382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.129384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:22.129386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:22.129444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:22.129452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.129465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.129475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:22.129492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534546806815712:6729]
2025-10-02T08:13:22.129494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534546806815712:6729]
2025-10-02T08:13:22.129623Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1716
2025-10-02T08:13:22.129501Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:22.129517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:22.129520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:22.129529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806815621:6730], now have 1 active actors on pipe
2025-10-02T08:13:22.129530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1716
2025-10-02T08:13:22.129532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534547266544244:2378], now have 1 active actors on pipe
2025-10-02T08:13:22.129539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:22.129550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:22.129553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:22.129582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.129585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.129597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534546806815712:6729]
2025-10-02T08:13:22.129602Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:22.129609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:22.129622Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:22.129627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.129629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.129631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:22.129638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.129645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:22.129662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.129707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.129709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.129720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.129751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1717 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0
2025-10-02T08:13:22.130163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a44e3b5-1d78c9cb-6c6e4032-d0db5e8c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:22.132777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0] Write session: try to update token
2025-10-02T08:13:22.132794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:22.146597Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:13:22.147651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId: src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:22.148362Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:22.148377Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:22.148379Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:22.148389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534546806815712:6729]
2025-10-02T08:13:22.148393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534546806815712:6729]
2025-10-02T08:13:22.148436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:22.148445Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:22.148448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.148450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:22.148451Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:22.148597Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:22.150441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:22.194798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534546806815742:6945]
2025-10-02T08:13:22.194920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1716, pipe: [1:7556534546806815742:6945]
2025-10-02T08:13:22.280434Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:22.280736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.280746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.280778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806815742:6945], now have 1 active actors on pipe
2025-10-02T08:13:22.280922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534546806815742:6945]
2025-10-02T08:13:22.280943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:22.280945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:22.281020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1717 reason: error at write: Disconnected sessionId: src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0
2025-10-02T08:13:22.281161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1717 sessionId: src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0 is DEAD
2025-10-02T08:13:22.281316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:22.281329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0] Write session will restart in 0.006124s
2025-10-02T08:13:22.281355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0] Write session: Do CDS request
2025-10-02T08:13:22.281314Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:22.281362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:22.281655Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:22.288238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.288339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:22.288351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1718
2025-10-02T08:13:22.288447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.288474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:22.288493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:22.288497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:22.289085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1718 sessionId:  describe result for acl check
2025-10-02T08:13:22.289113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:22.289117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:22.289118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:22.289122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534546806816096:6712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:22.289535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534546806816096:6712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:22.293046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534546806816096:6712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:22.296525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534546806816096:6712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:22.296539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534546806816096:6712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:22.296542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534546806816096:6712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:22.296549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:22.300445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:22.302626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:22.302767Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:22.302774Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:22.302782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:22.302813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:22.302837Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534546806816422:6705]
2025-10-02T08:13:22.303246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:22.303410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:22.303441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:22.303632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:22.303660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.303665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.303665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.303666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.303667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.303670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.303676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.303679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.303681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.303682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.303686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.303690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.303693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.303696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.303698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.303702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.303704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.303707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.303709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.303711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.303721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:22.311686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:22.313468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:22.313485Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:22.313487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:22.313491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:22.313496Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1717 [1:7556534546806816422:6705]
2025-10-02T08:13:22.313503Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:22.313516Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:22.313519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.313521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.313523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.313538Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:22.313542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:22.313549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:22.313596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.313603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.313605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:22.313607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:22.313670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:22.313678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.313689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.313700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:22.313718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806816344:6712], now have 1 active actors on pipe
2025-10-02T08:13:22.313724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534547266544254:2378], now have 1 active actors on pipe
2025-10-02T08:13:22.313730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534546806816416:6705]
2025-10-02T08:13:22.313733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534546806816416:6705]
2025-10-02T08:13:22.313741Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:22.313752Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:22.313754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:22.313757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:22.313769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:22.313771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:22.313794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534546806816416:6705]
2025-10-02T08:13:22.313801Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:22.313822Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:22.313807Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1717
2025-10-02T08:13:22.313835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1717
2025-10-02T08:13:22.313849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.313853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.313879Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:22.313889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.313892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.313894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:22.313903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.313916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:22.313928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.313947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.313953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.313966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.313998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1718 partition: 0 MaxSeqNo: 17 sessionId: src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0
2025-10-02T08:13:22.314360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc0d99e8-aba6c635-a5f4f4d3-7cdb6a2b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:22.316786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0] Write session: try to update token
2025-10-02T08:13:22.316798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:22.325083Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:22.325104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:22.325113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534546806816416:6705]
2025-10-02T08:13:22.325154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:22.325164Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:22.325330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:22.325471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:22.325623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:22.325770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:22.326214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:22.326255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:22.333600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId: src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:22.335966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:22.336060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.336074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.336107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:22.336124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:22.336180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.336196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.336351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.336449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.336550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.336617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.336660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.336668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.336736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.336793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.336880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.336975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.337017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.337024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.337089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.337151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.337206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.337260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.337297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.337301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.337365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.337424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.337486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.337551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.337596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.337599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.337681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.337745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.337847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.337949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.337995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.337997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.338076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.338137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.338201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.338267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.338311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.338316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.338388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.338446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.338513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.338580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.338625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.338627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.338704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.338771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.338836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.338900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.338963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.338965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.339038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.339092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.339148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.339204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.339406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.339408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.339481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:22.339540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:22.339600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:22.339659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:22.339702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:22.339704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:22.339741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:22.339807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.339826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.339828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:22.339857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:22.339870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:22.339873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:22.339876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:22.339879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:22.340395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:22.340410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:22.340417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:22.340421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:22.340424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:22.340427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:22.341012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:22.341026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:22.341032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:22.341035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:22.341038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:22.341042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:22.341544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:22.341567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:22.341572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:22.341576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:22.341579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:22.343925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:22.343942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:22.343954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392802343
2025-10-02T08:13:22.344078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:22.344091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:22.344096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:22.344101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:22.344111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:22.344114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:22.344593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:22.344613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:22.344618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:22.344622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:22.344625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:22.344628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:22.345126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:22.345146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:22.345154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:22.345159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:22.345163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:22.345167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:22.345627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:22.345645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:22.345650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:22.346794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:22.346815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:22.346820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:22.346824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:22.346833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392802346
2025-10-02T08:13:22.347129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:22.347146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:22.347150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:22.347154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:22.347158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:22.347161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:22.347583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:22.347603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:22.347607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:22.347612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:22.347616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:22.347620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:22.348045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:22.348062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.348160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392802347
2025-10-02T08:13:22.348902Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:22.348921Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:22.348928Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:22.348934Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:22.350520Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:22.350532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:22.350534Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:22.350542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534546806816416:6705]
2025-10-02T08:13:22.350545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534546806816416:6705]
2025-10-02T08:13:22.350574Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:22.350587Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:22.350597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:22.350606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.350608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:22.350743Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:22.381128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534546806816488:6945]
2025-10-02T08:13:22.381332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1717, pipe: [1:7556534546806816488:6945]
2025-10-02T08:13:22.505485Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:22.505866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806816488:6945], now have 1 active actors on pipe
2025-10-02T08:13:22.505972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:22.505978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:22.506003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1718 reason: error at write: Disconnected sessionId: src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0
2025-10-02T08:13:22.506098Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:22.506118Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:22.506156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1718 sessionId: src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0 is DEAD
2025-10-02T08:13:22.506272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534546806816488:6945]
2025-10-02T08:13:22.506347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:22.506362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0] Write session will restart in 0.005862s
2025-10-02T08:13:22.506384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0] Write session: Do CDS request
2025-10-02T08:13:22.506390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:22.513226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.513255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:22.513268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1719
2025-10-02T08:13:22.513447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.513477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:22.513487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:22.513489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:22.513908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1719 sessionId:  describe result for acl check
2025-10-02T08:13:22.513935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:22.513941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:22.513942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:22.513947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534546806816835:6672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:22.514334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534546806816835:6672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:22.516471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534546806816835:6672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:22.519268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534546806816835:6672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:22.519279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534546806816835:6672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:22.519282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534546806816835:6672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:22.519289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:22.525182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:22.527285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:22.527478Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:22.527487Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:22.527495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:22.527537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:22.527571Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534546806817189:6682]
2025-10-02T08:13:22.528204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:22.528378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:22.528410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:22.528619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:22.528651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.528655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.528656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.528656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.528657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.528660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.528667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.528669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.528671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.528673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.528677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.528681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.528685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.528687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.528690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.528692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.528695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.528698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.528700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.528702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.528714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:22.537182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:22.538969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:22.538985Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:22.538987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:22.538990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:22.538994Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1718 [1:7556534546806817189:6682]
2025-10-02T08:13:22.539003Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:22.539017Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:22.539019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.539021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.539023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.539034Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:22.539037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:22.539043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:22.539090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.539096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.539098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:22.539100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:22.539145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:22.539150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.539158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.539164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:22.539177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534546806817183:6682]
2025-10-02T08:13:22.539182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534546806817183:6682]
2025-10-02T08:13:22.539188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:22.539196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:22.539204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:22.539205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:22.539211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:22.539212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806817048:6672], now have 1 active actors on pipe
2025-10-02T08:13:22.539213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1718
2025-10-02T08:13:22.539214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:22.539235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534547266544295:2378], now have 1 active actors on pipe
2025-10-02T08:13:22.539237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534546806817183:6682]
2025-10-02T08:13:22.539239Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:22.539242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:22.539243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.539246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.539277Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:22.539281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.539284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.539285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:22.539291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.539296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:22.539309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.539321Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1718
2025-10-02T08:13:22.539346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.539351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.539365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.539420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1719 partition: 0 MaxSeqNo: 17 sessionId: src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0
2025-10-02T08:13:22.539728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2238743f-b6e89cd-cb0f846b-3d6fd42_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:22.542254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0] Write session: try to update token
2025-10-02T08:13:22.542270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:22.555628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId: src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:22.556863Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:22.556876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:22.556878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:22.556887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534546806817183:6682]
2025-10-02T08:13:22.556892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534546806817183:6682]
2025-10-02T08:13:22.556933Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:22.556934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:22.556942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.556944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:22.556945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:22.557075Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:22.558251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:22.606416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534546806817213:6945]
2025-10-02T08:13:22.606541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1718, pipe: [1:7556534546806817213:6945]
2025-10-02T08:13:22.685846Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:22.686338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.686352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.686391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806817213:6945], now have 1 active actors on pipe
2025-10-02T08:13:22.686501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:22.686512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:22.686573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1719 reason: error at write: Disconnected sessionId: src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0
2025-10-02T08:13:22.686633Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:22.686755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1719 sessionId: src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0 is DEAD
2025-10-02T08:13:22.686870Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:22.686886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:22.686896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0] Write session will restart in 0.009528s
2025-10-02T08:13:22.686918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0] Write session: Do CDS request
2025-10-02T08:13:22.686940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:22.686934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534546806817213:6945]
2025-10-02T08:13:22.697309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.697394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:22.697409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1720
2025-10-02T08:13:22.697587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.697626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:22.697639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:22.697643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:22.698081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1720 sessionId:  describe result for acl check
2025-10-02T08:13:22.698127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:22.698135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:22.698137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:22.698142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534546806817636:6676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:22.698645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534546806817636:6676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:22.701718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534546806817636:6676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:22.705482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534546806817636:6676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:22.705497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534546806817636:6676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:22.705500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534546806817636:6676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:22.705509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:22.708412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:22.710613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:22.710790Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:22.710798Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:22.710806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:22.710853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:22.710882Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534546806817899:6673]
2025-10-02T08:13:22.711313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:22.711467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:22.711496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:22.711694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:22.711726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.711732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.711733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.711734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.711735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.711738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.711744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.711746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.711748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.711750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.711754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.711758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.711762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.711765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.711767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.711770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.711772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.711775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.711777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.711780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.711791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:22.719713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:22.721383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:22.721399Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:22.721401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:22.721404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:22.721409Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1719 [1:7556534546806817899:6673]
2025-10-02T08:13:22.721418Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:22.721432Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:22.721435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.721437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.721438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.721451Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:22.721455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:22.721460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:22.721507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.721514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.721516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:22.721518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:22.721575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:22.721580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.721589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.721599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:22.721620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806817838:6676], now have 1 active actors on pipe
2025-10-02T08:13:22.721632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534546806817893:6673]
2025-10-02T08:13:22.721638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534546806817893:6673]
2025-10-02T08:13:22.721644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1719
2025-10-02T08:13:22.721646Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:22.721653Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:22.721656Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:22.721659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:22.721671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:22.721678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:22.721684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534547266544302:2378], now have 1 active actors on pipe
2025-10-02T08:13:22.721689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.721697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.721731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534546806817893:6673]
2025-10-02T08:13:22.721739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:22.721752Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:22.721755Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82999fc-21aff43-3deb571d-e821d180_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:22.721760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.721763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.721764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:22.721771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.721779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:22.721742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1719
2025-10-02T08:13:22.721814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.721851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.721857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.721869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.721907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1720 partition: 0 MaxSeqNo: 17 sessionId: src_id|82999fc-21aff43-3deb571d-e821d180_0
2025-10-02T08:13:22.722220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|865e5791-d11f3a5e-204c058f-fbf80e25_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82999fc-21aff43-3deb571d-e821d180_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:22.724684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82999fc-21aff43-3deb571d-e821d180_0] Write session: try to update token
2025-10-02T08:13:22.724698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82999fc-21aff43-3deb571d-e821d180_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:22.738927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId: src_id|82999fc-21aff43-3deb571d-e821d180_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:22.739909Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:22.739927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:22.739929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:22.739937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534546806817893:6673]
2025-10-02T08:13:22.739942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534546806817893:6673]
2025-10-02T08:13:22.739995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:22.740007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.740009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:22.740105Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:22.740126Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:22.740250Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:22.741741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:22.787139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534546806817927:6945]
2025-10-02T08:13:22.787275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1719, pipe: [1:7556534546806817927:6945]
2025-10-02T08:13:22.875812Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:22.876272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.876285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.876319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806817927:6945], now have 1 active actors on pipe
2025-10-02T08:13:22.876453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:22.876464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:22.876486Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:22.876544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1720 reason: error at write: Disconnected sessionId: src_id|82999fc-21aff43-3deb571d-e821d180_0
2025-10-02T08:13:22.876569Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:22.876741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1720 sessionId: src_id|82999fc-21aff43-3deb571d-e821d180_0 is DEAD
2025-10-02T08:13:22.876899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534546806817927:6945]
2025-10-02T08:13:22.876914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82999fc-21aff43-3deb571d-e821d180_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:22.876925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82999fc-21aff43-3deb571d-e821d180_0] Write session will restart in 0.005031s
2025-10-02T08:13:22.876951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82999fc-21aff43-3deb571d-e821d180_0] Write session: Do CDS request
2025-10-02T08:13:22.876957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82999fc-21aff43-3deb571d-e821d180_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:22.883258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82999fc-21aff43-3deb571d-e821d180_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.883336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:22.883346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1721
2025-10-02T08:13:22.883442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:22.883473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:22.883480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:22.883482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:22.883768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1721 sessionId:  describe result for acl check
2025-10-02T08:13:22.883790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:22.883794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:22.883795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:22.883799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534546806818244:6661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:22.884172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534546806818244:6661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:22.886988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534546806818244:6661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:22.891225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534546806818244:6661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:22.891244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534546806818244:6661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:22.891248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534546806818244:6661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:22.891255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:22.896584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:22.898840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:22.899066Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:22.899077Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:22.899087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:22.899135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:22.899174Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534546806818611:6668]
2025-10-02T08:13:22.899805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:22.899962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:22.899999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:22.900287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:22.900326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.900331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.900333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.900334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.900335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.900340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.900350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.900354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.900357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.900360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.900365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.900371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:22.900376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.900380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:22.900384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.900388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:22.900391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.900395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.900399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.900403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.900419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:22.908280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:22.910130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:22.910144Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:22.910147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:22.910150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:22.910156Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1720 [1:7556534546806818611:6668]
2025-10-02T08:13:22.910166Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:22.910182Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:22.910184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.910187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.910189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.910203Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:22.910208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:22.910214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:22.910267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.910274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.910278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:22.910280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:22.910335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:22.910343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.910353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:22.910367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:22.910386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534546806818605:6668]
2025-10-02T08:13:22.910396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534546806818605:6668]
2025-10-02T08:13:22.910404Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:22.910408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1720
2025-10-02T08:13:22.910412Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:22.910415Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:22.910415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806818502:6661], now have 1 active actors on pipe
2025-10-02T08:13:22.910422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:22.910433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:22.910435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:22.910440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534547266544310:2378], now have 1 active actors on pipe
2025-10-02T08:13:22.910444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.910447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.910481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534546806818605:6668]
2025-10-02T08:13:22.910493Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:22.910498Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:22.910506Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f072a777-8667d69e-fb2de720-4387707e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:22.910512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:22.910519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:22.910521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:22.910530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:22.910542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:22.910526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1720
2025-10-02T08:13:22.910584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.910644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:22.910650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:22.910661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:22.910696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1721 partition: 0 MaxSeqNo: 17 sessionId: src_id|f072a777-8667d69e-fb2de720-4387707e_0
2025-10-02T08:13:22.910998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82999fc-21aff43-3deb571d-e821d180_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f072a777-8667d69e-fb2de720-4387707e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:22.913572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f072a777-8667d69e-fb2de720-4387707e_0] Write session: try to update token
2025-10-02T08:13:22.913589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f072a777-8667d69e-fb2de720-4387707e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:22.927765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId: src_id|f072a777-8667d69e-fb2de720-4387707e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:22.928161Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:22.928176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:22.928178Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:22.928196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534546806818605:6668]
2025-10-02T08:13:22.928200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534546806818605:6668]
2025-10-02T08:13:22.928240Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:22.928246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:22.928251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:22.928254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:22.928257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:22.928422Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:22.930451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:22.977115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534546806818639:6945]
2025-10-02T08:13:22.977230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1720, pipe: [1:7556534546806818639:6945]
2025-10-02T08:13:23.062408Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:23.062891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.062908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.062951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534546806818639:6945], now have 1 active actors on pipe
2025-10-02T08:13:23.063094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:23.063105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:23.063226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:23.063599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f072a777-8667d69e-fb2de720-4387707e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:23.063610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f072a777-8667d69e-fb2de720-4387707e_0] Write session will restart in 0.009171s
2025-10-02T08:13:23.063632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f072a777-8667d69e-fb2de720-4387707e_0] Write session: Do CDS request
2025-10-02T08:13:23.063639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f072a777-8667d69e-fb2de720-4387707e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:23.063175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1721 reason: error at write: Disconnected sessionId: src_id|f072a777-8667d69e-fb2de720-4387707e_0
2025-10-02T08:13:23.063200Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:23.063342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1721 sessionId: src_id|f072a777-8667d69e-fb2de720-4387707e_0 is DEAD
2025-10-02T08:13:23.063500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534546806818639:6945]
2025-10-02T08:13:23.074259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f072a777-8667d69e-fb2de720-4387707e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.074325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:23.074341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1722
2025-10-02T08:13:23.074470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.074506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:23.074511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:23.074514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:23.074968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1722 sessionId:  describe result for acl check
2025-10-02T08:13:23.075004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:23.075010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:23.075012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:23.075017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534551101786337:6651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:23.075513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534551101786337:6651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:23.078611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534551101786337:6651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:23.081648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534551101786337:6651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:23.081665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534551101786337:6651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:23.081668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534551101786337:6651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:23.081676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:23.088797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:23.090927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:23.091094Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:23.091105Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:23.091114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:23.091159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:23.091195Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534551101786620:6654]
2025-10-02T08:13:23.091855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:23.092044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:23.092084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:23.092398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:23.092443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.092449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.092450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.092451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.092452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.092457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.092467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.092471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.092475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.092479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.092484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.092495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.092505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.092514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.092523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.092528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.092533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.092538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.092548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.092558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.092581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:23.100692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:23.102608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:23.102626Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:23.102628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:23.102632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:23.102639Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1721 [1:7556534551101786620:6654]
2025-10-02T08:13:23.102651Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:23.102669Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:23.102671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.102674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.102676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.102690Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:23.102700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:23.102706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:23.102770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.102777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.102779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:23.102782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:23.102849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:23.102856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.102870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.102888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:23.102911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1721
2025-10-02T08:13:23.102924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101786473:6651], now have 1 active actors on pipe
2025-10-02T08:13:23.102927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534551561511613:2378], now have 1 active actors on pipe
2025-10-02T08:13:23.102934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534551101786614:6654]
2025-10-02T08:13:23.102936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534551101786614:6654]
2025-10-02T08:13:23.102948Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:23.102957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.102962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.102979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:23.102992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:23.103001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:23.102995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1721
2025-10-02T08:13:23.103043Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:23.103049Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:23.103052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:23.103053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.103057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.103059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:23.103067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.103075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:23.103083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534551101786614:6654]
2025-10-02T08:13:23.103095Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:23.103127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.103138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:23.103208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.103219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.103233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.103269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1722 partition: 0 MaxSeqNo: 17 sessionId: src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0
2025-10-02T08:13:23.103623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f072a777-8667d69e-fb2de720-4387707e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:23.106300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0] Write session: try to update token
2025-10-02T08:13:23.106316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:23.120263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId: src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:23.121702Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:23.121720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:23.121723Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:23.121731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534551101786614:6654]
2025-10-02T08:13:23.121736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534551101786614:6654]
2025-10-02T08:13:23.121776Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:23.121779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:23.121787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.121789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:23.121790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:23.121928Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:23.122895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:23.163485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534551101786646:6945]
2025-10-02T08:13:23.163726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1721, pipe: [1:7556534551101786646:6945]
2025-10-02T08:13:23.255273Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:23.255713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.255725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.255762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101786646:6945], now have 1 active actors on pipe
2025-10-02T08:13:23.255886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534551101786646:6945]
2025-10-02T08:13:23.255910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:23.255927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:23.255952Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:23.255987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1722 reason: error at write: Disconnected sessionId: src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0
2025-10-02T08:13:23.256017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:23.256193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1722 sessionId: src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0 is DEAD
2025-10-02T08:13:23.256329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:23.256340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0] Write session will restart in 0.008494s
2025-10-02T08:13:23.256365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0] Write session: Do CDS request
2025-10-02T08:13:23.256372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:23.266290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.266346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:23.266361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1723
2025-10-02T08:13:23.266524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.266560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:23.266569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:23.266573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:23.267047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1723 sessionId:  describe result for acl check
2025-10-02T08:13:23.267075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:23.267080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:23.267082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:23.267087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534551101787096:6632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:23.267588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534551101787096:6632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:23.270779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534551101787096:6632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:23.274485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534551101787096:6632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:23.274499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534551101787096:6632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:23.274502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534551101787096:6632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:23.274510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:23.276700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:23.278969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:23.279154Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:23.279164Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:23.279174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:23.279217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:23.279253Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534551101787335:6636]
2025-10-02T08:13:23.279908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:23.280083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:23.280121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:23.280416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:23.280459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.280464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.280465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.280467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.280467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.280472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.280483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.280487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.280491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.280495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.280500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.280507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.280512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.280518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.280522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.280527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.280531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.280536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.280547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.280552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.280571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:23.288455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:23.290055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:23.290076Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:23.290079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:23.290082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:23.290088Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1722 [1:7556534551101787335:6636]
2025-10-02T08:13:23.290099Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:23.290116Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:23.290119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.290122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.290124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.290139Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:23.290144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:23.290151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:23.290210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.290219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.290222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:23.290225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:23.290290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:23.290297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.290311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.290327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:23.290349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101787307:6632], now have 1 active actors on pipe
2025-10-02T08:13:23.290355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1722
2025-10-02T08:13:23.290360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534551101787327:6636]
2025-10-02T08:13:23.290363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534551101787327:6636]
2025-10-02T08:13:23.290370Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:23.290382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:23.290382Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:23.290385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:23.290400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:23.290407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:23.290413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534551561511622:2378], now have 1 active actors on pipe
2025-10-02T08:13:23.290417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.290422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.290459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534551101787327:6636]
2025-10-02T08:13:23.290466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:23.290480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:23.290480Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a28599df-364d265-dd05b1a5-156807d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:23.290486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.290491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.290493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:23.290502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.290463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1722
2025-10-02T08:13:23.290510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:23.290552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.290618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.290625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.290638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.290672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1723 partition: 0 MaxSeqNo: 17 sessionId: src_id|a28599df-364d265-dd05b1a5-156807d_0
2025-10-02T08:13:23.290993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a958d57c-e648a46c-8fb95b54-4ef79c9c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a28599df-364d265-dd05b1a5-156807d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:23.293548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28599df-364d265-dd05b1a5-156807d_0] Write session: try to update token
2025-10-02T08:13:23.293563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28599df-364d265-dd05b1a5-156807d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:23.307582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId: src_id|a28599df-364d265-dd05b1a5-156807d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:23.308358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:23.308372Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:23.308375Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:23.308384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534551101787327:6636]
2025-10-02T08:13:23.308389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534551101787327:6636]
2025-10-02T08:13:23.308434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:23.308440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.308442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:23.308531Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:23.308543Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:23.308582Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:23.310396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:23.356673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534551101787367:6945]
2025-10-02T08:13:23.356846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1722, pipe: [1:7556534551101787367:6945]
2025-10-02T08:13:23.436250Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:23.436418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.436430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.436460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101787367:6945], now have 1 active actors on pipe
2025-10-02T08:13:23.436560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:23.436572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:23.436585Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:23.436629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1723 reason: error at write: Disconnected sessionId: src_id|a28599df-364d265-dd05b1a5-156807d_0
2025-10-02T08:13:23.436601Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:23.436780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1723 sessionId: src_id|a28599df-364d265-dd05b1a5-156807d_0 is DEAD
2025-10-02T08:13:23.436960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28599df-364d265-dd05b1a5-156807d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:23.436972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28599df-364d265-dd05b1a5-156807d_0] Write session will restart in 0.009340s
2025-10-02T08:13:23.436941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534551101787367:6945]
2025-10-02T08:13:23.436995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28599df-364d265-dd05b1a5-156807d_0] Write session: Do CDS request
2025-10-02T08:13:23.437001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28599df-364d265-dd05b1a5-156807d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:23.447243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28599df-364d265-dd05b1a5-156807d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.447360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:23.447374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1724
2025-10-02T08:13:23.447467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.447503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:23.447505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:23.447508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:23.447872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1724 sessionId:  describe result for acl check
2025-10-02T08:13:23.447909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:23.447915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:23.447916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:23.447920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534551101787862:6602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:23.448274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534551101787862:6602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:23.450131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534551101787862:6602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:23.453346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534551101787862:6602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:23.453358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534551101787862:6602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:23.453360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534551101787862:6602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:23.453365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:23.458165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:23.458508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:23.458683Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:23.458693Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:23.458703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:23.458752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:23.458789Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534551101788088:6609]
2025-10-02T08:13:23.459458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:23.459635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:23.459675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:23.459959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:23.460002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.460007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.460008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.460009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.460011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.460016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.460026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.460030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.460034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.460038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.460043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.460051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.460056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.460062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.460067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.460072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.460077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.460082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.460086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.460091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.460110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:23.467714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:23.469264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:23.469283Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:23.469284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:23.469287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:23.469293Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1723 [1:7556534551101788088:6609]
2025-10-02T08:13:23.469301Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:23.469314Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:23.469316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.469318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.469320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.469332Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:23.469336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:23.469342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:23.469386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.469392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.469395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:23.469397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:23.469448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:23.469453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.469462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.469468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:23.469480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534551101788082:6609]
2025-10-02T08:13:23.469485Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534551101788082:6609]
2025-10-02T08:13:23.469491Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:23.469501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:23.469512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:23.469517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:23.469543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101788030:6602], now have 1 active actors on pipe
2025-10-02T08:13:23.469549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534551101788082:6609]
2025-10-02T08:13:23.469551Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:23.469553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:23.469557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:23.469563Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:23.469565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1723
2025-10-02T08:13:23.469570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534551561511654:2378], now have 1 active actors on pipe
2025-10-02T08:13:23.469573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.469576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.469598Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:23.469606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.469608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.469610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:23.469615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.469622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:23.469635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.469672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.469677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.469687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.469684Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1723
2025-10-02T08:13:23.469716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1724 partition: 0 MaxSeqNo: 17 sessionId: src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0
2025-10-02T08:13:23.470023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28599df-364d265-dd05b1a5-156807d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:23.472441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0] Write session: try to update token
2025-10-02T08:13:23.472452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:23.486552Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:23.486575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:23.486578Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:23.486586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534551101788082:6609]
2025-10-02T08:13:23.486591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534551101788082:6609]
2025-10-02T08:13:23.486632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:23.486635Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:23.486638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.486640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:23.486642Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:23.487122Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:23.487518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId: src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:23.490157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:23.537237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534551101788124:6945]
2025-10-02T08:13:23.537374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1723, pipe: [1:7556534551101788124:6945]
2025-10-02T08:13:23.629243Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:23.630109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.630121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.630155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101788124:6945], now have 1 active actors on pipe
2025-10-02T08:13:23.630248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534551101788124:6945]
2025-10-02T08:13:23.630277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:23.630280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:23.630293Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:23.630349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1724 reason: error at write: Disconnected sessionId: src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0
2025-10-02T08:13:23.630389Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:23.630514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1724 sessionId: src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0 is DEAD
2025-10-02T08:13:23.630654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:23.630663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0] Write session will restart in 0.009480s
2025-10-02T08:13:23.630692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0] Write session: Do CDS request
2025-10-02T08:13:23.630698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:23.641263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.641591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:23.641615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1725
2025-10-02T08:13:23.641752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.641786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:23.641794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:23.641797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:23.642143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1725 sessionId:  describe result for acl check
2025-10-02T08:13:23.642165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:23.642166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:23.642167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:23.642177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534551101788591:6581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:23.642646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534551101788591:6581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:23.645852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534551101788591:6581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:23.649843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534551101788591:6581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:23.649863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534551101788591:6581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:23.649866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534551101788591:6581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:23.649872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:23.650720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:23.652964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:23.653112Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:23.653119Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:23.653126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:23.653162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:23.653187Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534551101788820:6591]
2025-10-02T08:13:23.653609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:23.653795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:23.653829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:23.654058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:23.654096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.654101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.654102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.654103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.654105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.654110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.654119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.654121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.654123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.654124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.654128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.654133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.654136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.654139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.654141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.654144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.654146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.654149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.654152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.654154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.654166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:23.665242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:23.666769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:23.666786Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:23.666789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:23.666792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:23.666798Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1724 [1:7556534551101788820:6591]
2025-10-02T08:13:23.666809Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:23.666825Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:23.666833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.666837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.666838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.666852Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:23.666860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:23.666865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:23.666909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.666914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.666917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:23.666919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:23.666981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:23.666988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.666999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.667015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:23.667033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101788801:6581], now have 1 active actors on pipe
2025-10-02T08:13:23.667040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1724
2025-10-02T08:13:23.667041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534551101788814:6591]
2025-10-02T08:13:23.667043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534551101788814:6591]
2025-10-02T08:13:23.667048Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:23.667058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:23.667061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:23.667065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:23.667067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:23.667070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:23.667075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534551561511669:2378], now have 1 active actors on pipe
2025-10-02T08:13:23.667080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.667083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.667124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534551101788814:6591]
2025-10-02T08:13:23.667135Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:23.667151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:23.667156Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:23.667141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1724
2025-10-02T08:13:23.667169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.667176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.667178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:23.667187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.667195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:23.667232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.667299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.667307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.667319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.667350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1725 partition: 0 MaxSeqNo: 17 sessionId: src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0
2025-10-02T08:13:23.667658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaf09f05-d2b0b279-e439a0cf-5f0b5a93_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:23.670122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0] Write session: try to update token
2025-10-02T08:13:23.670136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:23.684109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId: src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:23.684829Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:23.684842Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:23.684844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:23.684850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534551101788814:6591]
2025-10-02T08:13:23.684853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534551101788814:6591]
2025-10-02T08:13:23.684894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:23.684898Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:23.684902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:23.684906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.684908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:23.685045Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:23.686583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:23.730258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534551101788844:6945]
2025-10-02T08:13:23.730393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1724, pipe: [1:7556534551101788844:6945]
2025-10-02T08:13:23.810747Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:23.811508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.811520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.811550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101788844:6945], now have 1 active actors on pipe
2025-10-02T08:13:23.811646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534551101788844:6945]
2025-10-02T08:13:23.811671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:23.811673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:23.811730Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:23.811736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1725 reason: error at write: Disconnected sessionId: src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0
2025-10-02T08:13:23.811905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1725 sessionId: src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0 is DEAD
2025-10-02T08:13:23.812064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:23.812074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0] Write session will restart in 0.006144s
2025-10-02T08:13:23.812107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0] Write session: Do CDS request
2025-10-02T08:13:23.812115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:23.812199Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:23.819282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.819413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:23.819426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1726
2025-10-02T08:13:23.819535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:23.819576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:23.819586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:23.819589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:23.820098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1726 sessionId:  describe result for acl check
2025-10-02T08:13:23.820125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:23.820131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:23.820133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:23.820137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534551101789193:6570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:23.820571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534551101789193:6570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:23.822787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534551101789193:6570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:23.825644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534551101789193:6570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:23.825659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534551101789193:6570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:23.825662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534551101789193:6570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:23.825670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:23.838529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:23.838923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:23.839166Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:23.839176Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:23.839183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:23.839222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:23.839248Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534551101789542:6565]
2025-10-02T08:13:23.839780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:23.839969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:23.840013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:23.840300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:23.840355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.840361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.840362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.840363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.840364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.840369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.840378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.840382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.840385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.840388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.840393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.840400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:23.840406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.840410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:23.840414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.840419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:23.840422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.840427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.840431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.840435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.840452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:23.848604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:23.850137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:23.850162Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:23.850166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:23.850170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:23.850176Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1725 [1:7556534551101789542:6565]
2025-10-02T08:13:23.850190Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:23.850208Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:23.850210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.850213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.850215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.850230Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:23.850235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:23.850248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:23.850314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.850323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.850327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:23.850329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:23.850396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:23.850402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.850418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:23.850435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:23.850457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101789305:6570], now have 1 active actors on pipe
2025-10-02T08:13:23.850468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534551101789536:6565]
2025-10-02T08:13:23.850470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534551101789536:6565]
2025-10-02T08:13:23.850477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1725
2025-10-02T08:13:23.850480Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:23.850492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:23.850494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:23.850500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:23.850506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:23.850509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:23.850515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534551561511678:2378], now have 1 active actors on pipe
2025-10-02T08:13:23.850520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.850523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.850562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534551101789536:6565]
2025-10-02T08:13:23.850576Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:23.850587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:23.850590Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:23.850596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.850601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.850603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:23.850611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.850619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:23.850598Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1725
2025-10-02T08:13:23.850651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.850728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.850734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.850746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:23.850781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1726 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0
2025-10-02T08:13:23.851198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16a3dc9e-a65b7af9-cc5319ee-27e3fce3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:23.853973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0] Write session: try to update token
2025-10-02T08:13:23.853991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:23.862108Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:23.862126Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:23.862134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534551101789536:6565]
2025-10-02T08:13:23.862181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:23.862234Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:23.862363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:23.862519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:23.862696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:23.862843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:23.863050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:23.863091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:23.868534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId: src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:23.871290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:23.871390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.871404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.871438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:23.871463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:23.871527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:23.871543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:23.871708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.871773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.871833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.871902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.872103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.872113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.872205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.872289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.872370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.872439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.872482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.872489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.872554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.872621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.872697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.872790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.872875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.872884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.872963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.873045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.873118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.873198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.873329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.873339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.873428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.873498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.873578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.873655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.873704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.873711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.873801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.873886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.873968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.874042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.874097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.874103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.874182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.874244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.874337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.874427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.874565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.874572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.874653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.874715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.874781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.874863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.874921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.874929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.875011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.875073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.875133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.875194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.875242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.875249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.875335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:23.875415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:23.875493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:23.875554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:23.875598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:23.875605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:23.875645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:23.875709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:23.875732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:23.875738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:23.875770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:23.875788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:23.875797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:23.875804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:23.875812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:23.876234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:23.876257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:23.876262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:23.876265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:23.876268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:23.876271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:23.876941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:23.876966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:23.876978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:23.876982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:23.876986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:23.876989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:23.877460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:23.877478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:23.877488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:23.877492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:23.877494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:23.879363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:23.879378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:23.879387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392803879
2025-10-02T08:13:23.879500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:23.879513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:23.879518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:23.879521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:23.879524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:23.879527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:23.879957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:23.879977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:23.879985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:23.879989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:23.879992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:23.879996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:23.880459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:23.880480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:23.880488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:23.880496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:23.880499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:23.880503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:23.880957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:23.880977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:23.880981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:23.882043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:23.882057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:23.882062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:23.882065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:23.882070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392803881
2025-10-02T08:13:23.882358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:23.882379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:23.882384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:23.882388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:23.882392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:23.882399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:23.882840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:23.882863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:23.882868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:23.882872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:23.882875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:23.882878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:23.883362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:23.883381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:23.883486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392803883
2025-10-02T08:13:23.887086Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:23.887109Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:23.887116Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:23.887122Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:23.888774Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:23.888786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:23.888788Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:23.888814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534551101789536:6565]
2025-10-02T08:13:23.888819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534551101789536:6565]
2025-10-02T08:13:23.888872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:23.888878Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:23.888882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:23.888884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:23.888884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:23.889021Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:23.912019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534551101789576:6945]
2025-10-02T08:13:23.912230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1725, pipe: [1:7556534551101789576:6945]
2025-10-02T08:13:24.018524Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:24.018815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534551101789576:6945], now have 1 active actors on pipe
2025-10-02T08:13:24.018915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534551101789576:6945]
2025-10-02T08:13:24.018930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:24.018935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:24.018952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1726 reason: error at write: Disconnected sessionId: src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0
2025-10-02T08:13:24.019028Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:24.019077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1726 sessionId: src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0 is DEAD
2025-10-02T08:13:24.019074Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:24.019230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:24.019252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0] Write session will restart in 0.008725s
2025-10-02T08:13:24.019277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0] Write session: Do CDS request
2025-10-02T08:13:24.019285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:24.029324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.029386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:24.029402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1727
2025-10-02T08:13:24.029496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.029525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:24.029533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:24.029541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:24.029943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1727 sessionId:  describe result for acl check
2025-10-02T08:13:24.029979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:24.029985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:24.029986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:24.029991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534555396757398:6575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:24.030459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534555396757398:6575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:24.032861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534555396757398:6575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:24.035591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534555396757398:6575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:24.035604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534555396757398:6575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:24.035607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534555396757398:6575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:24.035614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:24.036857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:24.037159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:24.037285Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:24.037292Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:24.037300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:24.037327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:24.037352Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534555396757707:6574]
2025-10-02T08:13:24.037796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:24.037940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:24.037975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:24.038231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:24.038270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.038275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.038276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.038277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.038278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.038282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.038292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.038300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.038303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.038310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.038315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.038326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.038335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.038344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.038351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.038356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.038364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.038369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.038376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.038381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.038401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:24.046205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:24.047638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:24.047652Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:24.047653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:24.047656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:24.047661Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1726 [1:7556534555396757707:6574]
2025-10-02T08:13:24.047669Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:24.047685Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:24.047692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.047696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.047697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.047712Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:24.047719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:24.047723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:24.047766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.047771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.047773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:24.047774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:24.047824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:24.047831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.047842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.047855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:24.047867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534555396757701:6574]
2025-10-02T08:13:24.047872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534555396757701:6574]
2025-10-02T08:13:24.047877Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:24.047889Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:24.047893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396757689:6575], now have 1 active actors on pipe
2025-10-02T08:13:24.047894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1726
2025-10-02T08:13:24.047898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:24.047899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:24.047910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:24.047913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:24.047918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534555856478981:2378], now have 1 active actors on pipe
2025-10-02T08:13:24.047943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.047945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.047955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534555396757701:6574]
2025-10-02T08:13:24.047963Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:24.047971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:24.047984Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:24.047992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.047996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.048000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:24.047967Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1726
2025-10-02T08:13:24.048007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.048016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:24.048041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.048083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.048087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.048097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.048128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1727 partition: 0 MaxSeqNo: 17 sessionId: src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0
2025-10-02T08:13:24.048404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e68f2f3-17d6c8f0-1bb85470-683b0336_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:24.050838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0] Write session: try to update token
2025-10-02T08:13:24.050850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:24.062790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId: src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:24.065282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:24.065462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.065483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.065502Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:24.065512Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:24.065514Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:24.065521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534555396757701:6574]
2025-10-02T08:13:24.065524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534555396757701:6574]
2025-10-02T08:13:24.065565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:24.065573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:24.065576Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:24.065578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.065580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:24.065712Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:24.118851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534555396757734:6945]
2025-10-02T08:13:24.118956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1726, pipe: [1:7556534555396757734:6945]
2025-10-02T08:13:24.205265Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:24.205665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:24.205726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396757734:6945], now have 1 active actors on pipe
2025-10-02T08:13:24.205725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:24.205833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:24.205843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:24.205863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1727 reason: error at write: Disconnected sessionId: src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0
2025-10-02T08:13:24.205950Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:24.205998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1727 sessionId: src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0 is DEAD
2025-10-02T08:13:24.206137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:24.206147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0] Write session will restart in 0.007008s
2025-10-02T08:13:24.206170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0] Write session: Do CDS request
2025-10-02T08:13:24.206176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:24.206385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534555396757734:6945]
2025-10-02T08:13:24.214310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.214325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:24.214344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1728
2025-10-02T08:13:24.214514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.214540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:24.214547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:24.214550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:24.215052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1728 sessionId:  describe result for acl check
2025-10-02T08:13:24.215087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:24.215089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:24.215091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:24.215095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534555396758154:6551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:24.215589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534555396758154:6551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:24.217996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534555396758154:6551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:24.222448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534555396758154:6551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:24.222461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534555396758154:6551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:24.222465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534555396758154:6551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:24.222472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:24.226046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:24.226343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:24.226582Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:24.226594Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:24.226604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:24.226650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:24.226690Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534555396758561:6555]
2025-10-02T08:13:24.227306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:24.227456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:24.227493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:24.227776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:24.227816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.227823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.227824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.227825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.227826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.227830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.227839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.227843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.227846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.227849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.227855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.227861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.227866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.227871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.227876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.227880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.227884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.227888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.227892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.227896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.227912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:24.236181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:24.237880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:24.237898Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:24.237900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:24.237903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:24.237909Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1727 [1:7556534555396758561:6555]
2025-10-02T08:13:24.237918Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:24.237935Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:24.237937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.237940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.237942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.237955Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:24.237962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:24.237968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:24.238023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.238030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.238034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:24.238036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:24.238489Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1727
2025-10-02T08:13:24.238106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:24.238119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.238134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.238144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:24.238163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396758523:6551], now have 1 active actors on pipe
2025-10-02T08:13:24.238169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1727
2025-10-02T08:13:24.238170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534555396758555:6555]
2025-10-02T08:13:24.238172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534555396758555:6555]
2025-10-02T08:13:24.238180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:24.238191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:24.238193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534555856478990:2378], now have 1 active actors on pipe
2025-10-02T08:13:24.238194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:24.238198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:24.238211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:24.238217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:24.238224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.238228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.238272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534555396758555:6555]
2025-10-02T08:13:24.238280Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:24.238291Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:24.238298Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c417a05-ff362e8d-29ab0736-db462a95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:24.238304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.238307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.238309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:24.238317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.238326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:24.238365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.238460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.238466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.238491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.238537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1728 partition: 0 MaxSeqNo: 17 sessionId: src_id|3c417a05-ff362e8d-29ab0736-db462a95_0
2025-10-02T08:13:24.238850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2830a5c3-bbe8f5e5-575daf44-d641ffd3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3c417a05-ff362e8d-29ab0736-db462a95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:24.241540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c417a05-ff362e8d-29ab0736-db462a95_0] Write session: try to update token
2025-10-02T08:13:24.241555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c417a05-ff362e8d-29ab0736-db462a95_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:24.250720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:24.250738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:24.250746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534555396758555:6555]
2025-10-02T08:13:24.250790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:24.250794Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:24.250954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:24.251100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:24.251236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:24.251373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:24.251550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:24.251584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:24.256081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId: src_id|3c417a05-ff362e8d-29ab0736-db462a95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:24.258649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:24.258714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.258724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.258755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:24.258780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:24.258831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.258846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.258990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.259047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.259113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.259188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.259361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.259372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.259445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.259507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.259570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.259633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.259679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.259686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.259756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.259818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.259877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.259933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.259975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.259980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.260043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.260100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.260171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.260264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.260315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.260322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.260394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.260455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.260520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.260587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.260638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.260643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.260714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.260783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.260873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.260943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.260990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.260995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.261065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.261126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.261194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.261274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.261331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.261338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.261412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.261475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.261546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.261613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.261662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.261667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.261738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.261804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.261871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.261930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.262075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.262081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.262155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.262222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.262287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.262351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.262416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.262422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.262455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:24.262509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.262525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.262530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:24.262557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:24.262570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:24.262578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:24.262581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:24.262584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:24.262974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:24.262995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:24.263002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:24.263007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:24.263010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:24.263012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:24.263623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:24.263644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:24.263648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:24.263650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:24.263654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:24.263656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:24.264208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:24.264224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:24.264229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:24.264231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:24.264234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:24.270415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:24.270437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:24.270449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392804270
2025-10-02T08:13:24.270606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:24.270620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:24.270625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:24.270627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:24.270630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:24.270634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:24.271086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:24.271111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:24.271117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:24.271122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:24.271125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:24.271130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:24.271605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:24.271626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:24.271636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:24.271640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:24.271642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:24.271646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:24.272102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:24.272122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:24.272127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:24.273321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:24.273339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:24.273344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:24.273348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:24.273356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392804272
2025-10-02T08:13:24.273669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:24.273691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:24.273701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:24.273710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:24.273714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:24.273717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:24.274167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:24.274184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:24.274191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:24.274193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:24.274196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:24.274198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:24.274595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:24.274611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.274683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392804274
2025-10-02T08:13:24.275391Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:24.275409Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:24.275414Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:24.275421Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:24.276978Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:24.276989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:24.276991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:24.277001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534555396758555:6555]
2025-10-02T08:13:24.277004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534555396758555:6555]
2025-10-02T08:13:24.277065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:24.277065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:24.277071Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:24.277074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.277075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:24.277212Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:24.306743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534555396758594:6945]
2025-10-02T08:13:24.306844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1727, pipe: [1:7556534555396758594:6945]
2025-10-02T08:13:24.410079Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:24.410445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396758594:6945], now have 1 active actors on pipe
2025-10-02T08:13:24.410684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:24.410696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:24.410718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1728 reason: error at write: Disconnected sessionId: src_id|3c417a05-ff362e8d-29ab0736-db462a95_0
2025-10-02T08:13:24.410731Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:24.410868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1728 sessionId: src_id|3c417a05-ff362e8d-29ab0736-db462a95_0 is DEAD
2025-10-02T08:13:24.410981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c417a05-ff362e8d-29ab0736-db462a95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:24.410987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c417a05-ff362e8d-29ab0736-db462a95_0] Write session will restart in 0.007282s
2025-10-02T08:13:24.411006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c417a05-ff362e8d-29ab0736-db462a95_0] Write session: Do CDS request
2025-10-02T08:13:24.411010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c417a05-ff362e8d-29ab0736-db462a95_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:24.411134Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:24.411485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534555396758594:6945]
2025-10-02T08:13:24.419345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c417a05-ff362e8d-29ab0736-db462a95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.419375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:24.419388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1729
2025-10-02T08:13:24.419528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.419557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:24.419565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:24.419568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:24.419985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1729 sessionId:  describe result for acl check
2025-10-02T08:13:24.420015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:24.420020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:24.420022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:24.420027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534555396759064:6528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:24.420612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534555396759064:6528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:24.422918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534555396759064:6528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:24.426041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534555396759064:6528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:24.426055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534555396759064:6528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:24.426057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534555396759064:6528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:24.426168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:24.429237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:24.430219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:24.430373Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:24.430381Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:24.430388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:24.430423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:24.430455Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534555396759455:6519]
2025-10-02T08:13:24.431071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:24.431240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:24.431277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:24.431546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:24.431585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.431591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.431592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.431593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.431594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.431598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.431608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.431612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.431615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.431618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.431623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.431630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.431634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.431638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.431642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.431646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.431650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.431654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.431657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.431666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.431682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:24.439616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:24.441631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:24.441645Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:24.441647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:24.441649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:24.441654Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1728 [1:7556534555396759455:6519]
2025-10-02T08:13:24.441660Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:24.441672Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:24.441675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.441676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.441677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.441689Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:24.441692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:24.441697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:24.441744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.441746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.441748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:24.441749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:24.441796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:24.441803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.441812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.441818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:24.441829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534555396759449:6519]
2025-10-02T08:13:24.441830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534555396759449:6519]
2025-10-02T08:13:24.441835Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:24.441849Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:24.441855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:24.441859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:24.441863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:24.441864Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:24.441871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534555856479008:2378], now have 1 active actors on pipe
2025-10-02T08:13:24.441894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534555396759449:6519]
2025-10-02T08:13:24.441904Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:24.441910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396759396:6528], now have 1 active actors on pipe
2025-10-02T08:13:24.441922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:24.441922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1728
2025-10-02T08:13:24.441938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.441941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.441961Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:24.441969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.441972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.441973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:24.441979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.441953Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1728
2025-10-02T08:13:24.441985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:24.442001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.442033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.442037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.442046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.442076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1729 partition: 0 MaxSeqNo: 17 sessionId: src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0
2025-10-02T08:13:24.442406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c417a05-ff362e8d-29ab0736-db462a95_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:24.445329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0] Write session: try to update token
2025-10-02T08:13:24.445344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:24.452959Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:24.452980Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:24.452989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534555396759449:6519]
2025-10-02T08:13:24.453024Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:24.453033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:24.453200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:24.453376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:24.453551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:24.453726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:24.453920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:24.453960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:24.460254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId: src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:24.462837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:24.462920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.462933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.462965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:24.462990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:24.463055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.463071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.463228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.463293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.463381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.463459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.463503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.463512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.463614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.463679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.463740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.463805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.463851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.463860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.463926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.463996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.464068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.464142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.464211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.464219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.464295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.464365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.464439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.464517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.464569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.464576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.464652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.464723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.464796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.464891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.464946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.464954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.465032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.465101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.465176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.465251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.465305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.465312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.465391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.465463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.465547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.465622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.465675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.465682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.465764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.465860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.465925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.465994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.466055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.466063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.466138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.466278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.466425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.466548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.466602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.466614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.466690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:24.466757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:24.466819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:24.466886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:24.466935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:24.466943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:24.466980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:24.467040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.467064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.467071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:24.467101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:24.467119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:24.467127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:24.467130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:24.467133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:24.467513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:24.467539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:24.467549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:24.467558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:24.467561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:24.467564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:24.468327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:24.468358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:24.468369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:24.468376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:24.468380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:24.468388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:24.469041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:24.469066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:24.469076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:24.469084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:24.469087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:24.470305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:24.470329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:24.470341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392804470
2025-10-02T08:13:24.470455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:24.470470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:24.470476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:24.470485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:24.470494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:24.470502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:24.471034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:24.471058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:24.471070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:24.471073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:24.471077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:24.471080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:24.471569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:24.471596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:24.471606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:24.471615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:24.471618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:24.471622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:24.472098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:24.472125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:24.472135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:24.473302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:24.473323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:24.473330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:24.473335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:24.473344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392804473
2025-10-02T08:13:24.473628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:24.473651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:24.473662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:24.473669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:24.473673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:24.473676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:24.474141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:24.474162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:24.474167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:24.474171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:24.474174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:24.474177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:24.474621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:24.474649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.474756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392804474
2025-10-02T08:13:24.475494Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:24.475519Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:24.475531Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:24.475542Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:24.477255Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:24.477270Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:24.477276Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:24.477283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534555396759449:6519]
2025-10-02T08:13:24.477286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534555396759449:6519]
2025-10-02T08:13:24.477338Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:24.477346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:24.477351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.477352Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:24.477353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:24.477492Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:24.511567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534555396759509:6945]
2025-10-02T08:13:24.511767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1728, pipe: [1:7556534555396759509:6945]
2025-10-02T08:13:24.613466Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:24.613960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396759509:6945], now have 1 active actors on pipe
2025-10-02T08:13:24.614095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:24.614115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:24.614144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1729 reason: error at write: Disconnected sessionId: src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0
2025-10-02T08:13:24.614249Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:24.614430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:24.614440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0] Write session will restart in 0.009209s
2025-10-02T08:13:24.614464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0] Write session: Do CDS request
2025-10-02T08:13:24.614471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:24.614191Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:24.614322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1729 sessionId: src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0 is DEAD
2025-10-02T08:13:24.614504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534555396759509:6945]
2025-10-02T08:13:24.625297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.625336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:24.625353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1730
2025-10-02T08:13:24.625497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.625532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:24.625538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:24.625541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:24.626029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1730 sessionId:  describe result for acl check
2025-10-02T08:13:24.626065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:24.626070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:24.626071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:24.626075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534555396760069:6113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:24.626534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534555396760069:6113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:24.629016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534555396760069:6113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:24.632258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534555396760069:6113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:24.632272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534555396760069:6113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:24.632274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534555396760069:6113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:24.632282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:24.633283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:24.633580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:24.633742Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:24.633751Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:24.633760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:24.633805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:24.633840Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534555396760347:6105]
2025-10-02T08:13:24.634474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:24.634693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:24.634749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:24.635074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:24.635131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.635136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.635137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.635137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.635138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.635141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.635148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.635150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.635152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.635154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.635158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.635166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.635169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.635172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.635175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.635178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.635181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.635184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.635186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.635188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.635201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:24.642884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:24.644560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:24.644575Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:24.644577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:24.644580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:24.644585Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1729 [1:7556534555396760347:6105]
2025-10-02T08:13:24.644593Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:24.644606Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:24.644608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.644610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.644611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.644623Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:24.644628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:24.644633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:24.644681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.644687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.644690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:24.644691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:24.644736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:24.644742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.644750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.644761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:24.644775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396760337:6113], now have 1 active actors on pipe
2025-10-02T08:13:24.644784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534555396760341:6105]
2025-10-02T08:13:24.644786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534555396760341:6105]
2025-10-02T08:13:24.644792Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:24.644813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1729
2025-10-02T08:13:24.644823Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:24.644825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:24.644832Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:24.644836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:24.644838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:24.644844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534555856479039:2378], now have 1 active actors on pipe
2025-10-02T08:13:24.644849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.644852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.644905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534555396760341:6105]
2025-10-02T08:13:24.644914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:24.644915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:24.644929Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71af2734-3c6f8261-2130288f-66db4ef6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:24.644897Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1729
2025-10-02T08:13:24.644935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.644943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.644945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:24.644957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.644969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:24.645015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.645097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.645100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.645115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.645160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1730 partition: 0 MaxSeqNo: 17 sessionId: src_id|71af2734-3c6f8261-2130288f-66db4ef6_0
2025-10-02T08:13:24.645464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca36e78-826a3bcb-9141672b-9fdf5f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|71af2734-3c6f8261-2130288f-66db4ef6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:24.647864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71af2734-3c6f8261-2130288f-66db4ef6_0] Write session: try to update token
2025-10-02T08:13:24.647877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71af2734-3c6f8261-2130288f-66db4ef6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:24.660475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId: src_id|71af2734-3c6f8261-2130288f-66db4ef6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:24.662183Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:24.662203Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:24.662205Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:24.662214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534555396760341:6105]
2025-10-02T08:13:24.662218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534555396760341:6105]
2025-10-02T08:13:24.662262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:24.662267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:24.662272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.662273Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:24.662274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:24.662420Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:24.663305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:24.714813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534555396760371:6945]
2025-10-02T08:13:24.714917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1729, pipe: [1:7556534555396760371:6945]
2025-10-02T08:13:24.797279Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:24.797791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.797801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.797834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396760371:6945], now have 1 active actors on pipe
2025-10-02T08:13:24.797904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:24.797911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:24.797946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534555396760371:6945]
2025-10-02T08:13:24.797948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1730 reason: error at write: Disconnected sessionId: src_id|71af2734-3c6f8261-2130288f-66db4ef6_0
2025-10-02T08:13:24.798030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:24.798080Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:24.798092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1730 sessionId: src_id|71af2734-3c6f8261-2130288f-66db4ef6_0 is DEAD
2025-10-02T08:13:24.798266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71af2734-3c6f8261-2130288f-66db4ef6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:24.798279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71af2734-3c6f8261-2130288f-66db4ef6_0] Write session will restart in 0.005413s
2025-10-02T08:13:24.798303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71af2734-3c6f8261-2130288f-66db4ef6_0] Write session: Do CDS request
2025-10-02T08:13:24.798309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71af2734-3c6f8261-2130288f-66db4ef6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:24.805378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71af2734-3c6f8261-2130288f-66db4ef6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.805494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:24.805511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1731
2025-10-02T08:13:24.805642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.805674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:24.805683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:24.805686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:24.806131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1731 sessionId:  describe result for acl check
2025-10-02T08:13:24.806163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:24.806169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:24.806171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:24.806177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534555396760752:6142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:24.806698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534555396760752:6142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:24.809496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534555396760752:6142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:24.812514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534555396760752:6142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:24.812529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534555396760752:6142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:24.812532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534555396760752:6142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:24.812539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:24.818351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:24.818733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:24.818884Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:24.818892Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:24.818927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:24.818968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:24.819001Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534555396761223:6140]
2025-10-02T08:13:24.819599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:24.819774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:24.819811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:24.820096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:24.820143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.820148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.820149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.820150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.820151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.820155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.820164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.820172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.820176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.820180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.820196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.820203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.820213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.820222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.820230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.820239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.820243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.820256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.820261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.820266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.820285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:24.827806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:24.829752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:24.829770Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:24.829772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:24.829776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:24.829782Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1730 [1:7556534555396761223:6140]
2025-10-02T08:13:24.829794Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:24.829811Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:24.829814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.829818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.829820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.829836Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:24.829841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:24.829847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:24.829906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.829915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.829918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:24.829921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:24.829980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:24.829987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.830000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.830018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:24.830041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396761057:6142], now have 1 active actors on pipe
2025-10-02T08:13:24.830048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1730
2025-10-02T08:13:24.830049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534555856479047:2378], now have 1 active actors on pipe
2025-10-02T08:13:24.830056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534555396761210:6140]
2025-10-02T08:13:24.830058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534555396761210:6140]
2025-10-02T08:13:24.830071Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:24.830087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:24.830102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:24.830108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:24.830116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.830119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.830129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:24.830137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:24.830156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534555396761210:6140]
2025-10-02T08:13:24.830121Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1730
2025-10-02T08:13:24.830163Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:24.830165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:24.830178Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:24.830184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.830188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.830194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:24.830203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.830215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:24.830259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.830340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.830347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.830360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.830398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1731 partition: 0 MaxSeqNo: 17 sessionId: src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0
2025-10-02T08:13:24.830740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71af2734-3c6f8261-2130288f-66db4ef6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:24.833757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0] Write session: try to update token
2025-10-02T08:13:24.833774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:24.847594Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:24.847610Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:24.847611Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:24.847617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534555396761210:6140]
2025-10-02T08:13:24.847621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534555396761210:6140]
2025-10-02T08:13:24.847653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:24.847664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.847667Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:24.847669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:24.847673Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:24.847855Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:24.850206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId: src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:24.852952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:24.898142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534555396761247:6945]
2025-10-02T08:13:24.898255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1730, pipe: [1:7556534555396761247:6945]
2025-10-02T08:13:24.974323Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:24.974825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.974842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.974877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396761247:6945], now have 1 active actors on pipe
2025-10-02T08:13:24.975032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534555396761247:6945]
2025-10-02T08:13:24.975043Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:24.975059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:24.975080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:24.975121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1731 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0
2025-10-02T08:13:24.975282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1731 sessionId: src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0 is DEAD
2025-10-02T08:13:24.975449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:24.975463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0] Write session will restart in 0.005907s
2025-10-02T08:13:24.975486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0] Write session: Do CDS request
2025-10-02T08:13:24.975492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:24.980270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:24.980605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:24.980726Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:24.980733Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:24.980740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:24.980769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:24.980814Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534555396761310:6208]
2025-10-02T08:13:24.981274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:24.981471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:24.981501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:24.981717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:24.981747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.981751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.981752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.981753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.981753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.981757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.981764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.981766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.981768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.981770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.981773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.981777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:24.981781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.981784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:24.981786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.981789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:24.981791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.981794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.981796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.981799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.981810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:24.982276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.982333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:24.982344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1732
2025-10-02T08:13:24.982465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:24.982497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:24.982506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:24.982519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:24.982917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1732 sessionId:  describe result for acl check
2025-10-02T08:13:24.982947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:24.982952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:24.982953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:24.982957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534555396761326:6212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:24.983314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534555396761326:6212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:24.985703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534555396761326:6212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:24.988942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534555396761326:6212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:24.988954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534555396761326:6212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:24.988959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534555396761326:6212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:24.988965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:24.989571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:24.991171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:24.991183Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:24.991184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:24.991187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:24.991192Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1731 [1:7556534555396761310:6208]
2025-10-02T08:13:24.991199Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:24.991210Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:24.991212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.991215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.991216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.991228Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:24.991231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:24.991236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:24.991288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.991295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.991298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:24.991301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:24.991354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:24.991362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:24.991373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:24.991384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1731
2025-10-02T08:13:24.991384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:24.991402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534555396761355:6212], now have 1 active actors on pipe
2025-10-02T08:13:24.991412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534555396761304:6208]
2025-10-02T08:13:24.991414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534555396761304:6208]
2025-10-02T08:13:24.991425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:24.991434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:24.991436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534555856479053:2378], now have 1 active actors on pipe
2025-10-02T08:13:24.991437Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:24.991441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.991445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.991461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:24.991441Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1731
2025-10-02T08:13:24.991477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:24.991484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:24.991518Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|369df625-6eb49f40-7b657338-9649da87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:24.991525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:24.991527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:24.991528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:24.991534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:24.991540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:24.991548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534555396761304:6208]
2025-10-02T08:13:24.991556Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:24.991569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:24.991576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.991636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:24.991645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:24.991661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:24.991690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1732 partition: 0 MaxSeqNo: 17 sessionId: src_id|369df625-6eb49f40-7b657338-9649da87_0
2025-10-02T08:13:24.992030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d33d04b-6bd3c298-493c85a9-fcdeefb4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|369df625-6eb49f40-7b657338-9649da87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:24.995157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|369df625-6eb49f40-7b657338-9649da87_0] Write session: try to update token
2025-10-02T08:13:24.995181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|369df625-6eb49f40-7b657338-9649da87_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:25.002513Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:25.002530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:25.002538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534555396761304:6208]
2025-10-02T08:13:25.002585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:25.002590Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:25.002755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:25.002900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:25.003049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:25.003191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:25.003383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:25.003421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:25.010357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId: src_id|369df625-6eb49f40-7b657338-9649da87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:25.013028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:25.013098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.013116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.013156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:25.013181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:25.013253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.013273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.013461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.013542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.013618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.013686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.013732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.013740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.013815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.013878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.013944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.014009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.014053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.014060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.014137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.014197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.014255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.014316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.014360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.014371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.014438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.014504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.014579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.014654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.014723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.014730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.014809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.014887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.014956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.015030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.015082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.015089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.015160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.015222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.015299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.015376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.015425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.015432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.015501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.015562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.015630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.015702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.015818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.015827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.015899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.015964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.016032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.016098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.016151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.016157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.016257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.016313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.016371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.016426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.016475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.016482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.016555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.016618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.016674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.016731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.017069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.017079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.017120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:25.017193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.017219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.017227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:25.017256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:25.017274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:25.017282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:25.017287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:25.017290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:25.017655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:25.017680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:25.017685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:25.017687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:25.017689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:25.017691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:25.018278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:25.018298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:25.018302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:25.018304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:25.018305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:25.018307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:25.018803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:25.018825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:25.018832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:25.018834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:25.018836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:25.019936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:25.019953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:25.019965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392805019
2025-10-02T08:13:25.020135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:25.020153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:25.020162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:25.020169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:25.020173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:25.020181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:25.020612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:25.020632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:25.020636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:25.020638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:25.020640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:25.020643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:25.021117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:25.021138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:25.021144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:25.021146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:25.021148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:25.021150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:25.021631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:25.021656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:25.021667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:25.022681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:25.022695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:25.022698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:25.022702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:25.022708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392805022
2025-10-02T08:13:25.022979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:25.022996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:25.023000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:25.023003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:25.023005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:25.023007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:25.023415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:25.023434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:25.023438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:25.023441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:25.023443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:25.023446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:25.023862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:25.023880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.023966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392805023
2025-10-02T08:13:25.024701Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:25.024716Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:25.024721Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:25.024726Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:25.026505Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:25.026516Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:25.026517Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:25.026525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534555396761304:6208]
2025-10-02T08:13:25.026527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534555396761304:6208]
2025-10-02T08:13:25.026575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:25.026584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.026586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:25.026584Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:25.026591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:25.026741Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:25.075312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534559691728672:6945]
2025-10-02T08:13:25.076938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1731, pipe: [1:7556534559691728672:6945]
2025-10-02T08:13:25.163468Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:25.163750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691728672:6945], now have 1 active actors on pipe
2025-10-02T08:13:25.163839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:25.163847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:25.163867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1732 reason: error at write: Disconnected sessionId: src_id|369df625-6eb49f40-7b657338-9649da87_0
2025-10-02T08:13:25.163953Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:25.164003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1732 sessionId: src_id|369df625-6eb49f40-7b657338-9649da87_0 is DEAD
2025-10-02T08:13:25.163985Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:25.164136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|369df625-6eb49f40-7b657338-9649da87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:25.164145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|369df625-6eb49f40-7b657338-9649da87_0] Write session will restart in 0.006990s
2025-10-02T08:13:25.164162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|369df625-6eb49f40-7b657338-9649da87_0] Write session: Do CDS request
2025-10-02T08:13:25.164168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|369df625-6eb49f40-7b657338-9649da87_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:25.164168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534559691728672:6945]
2025-10-02T08:13:25.168326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:25.168728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:25.168850Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:25.168857Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:25.168863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:25.168894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:25.168920Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534559691728731:6203]
2025-10-02T08:13:25.169312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:25.169472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:25.169498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:25.169683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:25.169711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.169715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.169716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.169717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.169719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.169722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.169729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.169731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.169732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.169734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.169737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.169741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.169747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.169749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.169752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.169754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.169756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.169759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.169763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.169766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.169775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:25.172224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|369df625-6eb49f40-7b657338-9649da87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.172404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:25.172430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1733
2025-10-02T08:13:25.172581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.172610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:25.172614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:25.172619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:25.172985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1733 sessionId:  describe result for acl check
2025-10-02T08:13:25.173021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:25.173030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:25.173031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:25.173036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534559691728747:6230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:25.173419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534559691728747:6230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:25.175779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534559691728747:6230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:25.177280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:25.178757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534559691728747:6230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:25.178772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534559691728747:6230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:25.178776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534559691728747:6230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:25.178786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:25.178982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:25.178999Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:25.179001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:25.179004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:25.179010Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1732 [1:7556534559691728731:6203]
2025-10-02T08:13:25.179021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:25.179036Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:25.179043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.179046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.179047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.179064Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:25.179075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:25.179081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:25.179131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.179136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.179139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:25.179141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:25.179195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:25.179200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.179213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.179223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:25.179249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534560151446358:2378], now have 1 active actors on pipe
2025-10-02T08:13:25.179257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534559691728725:6203]
2025-10-02T08:13:25.179259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534559691728725:6203]
2025-10-02T08:13:25.179268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:25.179282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:25.179284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:25.179287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:25.179294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:25.179296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:25.179327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534559691728725:6203]
2025-10-02T08:13:25.179333Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:25.179337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:25.179345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691728779:6230], now have 1 active actors on pipe
2025-10-02T08:13:25.179305Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1732
2025-10-02T08:13:25.179355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1732
2025-10-02T08:13:25.179380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.179390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.179423Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:25.179436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.179444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.179447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:25.179459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.179474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:25.179491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.179532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.179538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.179551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.179582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1733 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0
2025-10-02T08:13:25.179941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|369df625-6eb49f40-7b657338-9649da87_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:25.182873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0] Write session: try to update token
2025-10-02T08:13:25.182888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:25.196118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId: src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:25.196939Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:25.196957Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:25.196959Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:25.196975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534559691728725:6203]
2025-10-02T08:13:25.196980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534559691728725:6203]
2025-10-02T08:13:25.197036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:25.197038Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:25.197045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:25.197045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.197048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:25.197221Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:25.199144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:25.264214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534559691728793:6945]
2025-10-02T08:13:25.264345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1732, pipe: [1:7556534559691728793:6945]
2025-10-02T08:13:25.336671Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:25.336990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.337006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.337038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691728793:6945], now have 1 active actors on pipe
2025-10-02T08:13:25.337183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:25.337196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:25.337264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1733 reason: error at write: Disconnected sessionId: src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0
2025-10-02T08:13:25.337293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:25.337452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1733 sessionId: src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0 is DEAD
2025-10-02T08:13:25.337607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:25.337619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0] Write session will restart in 0.005220s
2025-10-02T08:13:25.337644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0] Write session: Do CDS request
2025-10-02T08:13:25.337652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:25.337635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534559691728793:6945]
2025-10-02T08:13:25.337645Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:25.341621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:25.342032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:25.342163Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:25.342175Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:25.342184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:25.342225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:25.342267Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534559691728855:6262]
2025-10-02T08:13:25.342849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:25.343048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:25.343093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:25.343310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:25.343347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.343348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.343348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.343349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.343349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.343353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.343359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.343361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.343363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.343365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.343369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.343373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.343376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.343379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.343382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.343384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.343387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.343389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.343391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.343394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.343407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:25.344319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.344409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:25.344426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1734
2025-10-02T08:13:25.344538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.344571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:25.344584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:25.344589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:25.344972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1734 sessionId:  describe result for acl check
2025-10-02T08:13:25.345007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:25.345014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:25.345016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:25.345020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534559691728871:6267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:25.345434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534559691728871:6267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:25.347174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534559691728871:6267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:25.350846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534559691728871:6267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:25.350862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534559691728871:6267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:25.350867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534559691728871:6267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:25.350874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:25.351498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:25.353092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:25.353109Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:25.353112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:25.353114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:25.353120Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1733 [1:7556534559691728855:6262]
2025-10-02T08:13:25.353129Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:25.353141Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:25.353143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.353145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.353146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.353159Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:25.353163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:25.353168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:25.353212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.353219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.353221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:25.353222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:25.353277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:25.353284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.353294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.353301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:25.353313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691728902:6267], now have 1 active actors on pipe
2025-10-02T08:13:25.353330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534559691728849:6262]
2025-10-02T08:13:25.353329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1733
2025-10-02T08:13:25.353331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534559691728849:6262]
2025-10-02T08:13:25.353338Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:25.353347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:25.353349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:25.353350Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:25.353362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:25.353365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:25.353370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534560151446365:2378], now have 1 active actors on pipe
2025-10-02T08:13:25.353375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.353378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.353415Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534559691728849:6262]
2025-10-02T08:13:25.353417Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:25.353422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:25.353431Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:25.353397Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1733
2025-10-02T08:13:25.353436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.353444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.353446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:25.353454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.353461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:25.353503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.353547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.353556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.353566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.353597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1734 partition: 0 MaxSeqNo: 17 sessionId: src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0
2025-10-02T08:13:25.353895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb65aedb-b62d6901-3712b3d3-1e232c59_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:25.356272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0] Write session: try to update token
2025-10-02T08:13:25.356286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:25.370483Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:25.370502Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:25.370503Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:25.370510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534559691728849:6262]
2025-10-02T08:13:25.370514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534559691728849:6262]
2025-10-02T08:13:25.370551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:25.370557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.370556Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:25.370559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:25.370562Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:25.370684Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:25.370684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId: src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:25.373330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:25.457484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534559691728931:6945]
2025-10-02T08:13:25.459789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1733, pipe: [1:7556534559691728931:6945]
2025-10-02T08:13:25.503784Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:25.504051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.504068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.504108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691728931:6945], now have 1 active actors on pipe
2025-10-02T08:13:25.504261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:25.504272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:25.504329Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:25.504333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1734 reason: error at write: Disconnected sessionId: src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0
2025-10-02T08:13:25.504394Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:25.504495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1734 sessionId: src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0 is DEAD
2025-10-02T08:13:25.504575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534559691728931:6945]
2025-10-02T08:13:25.504656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:25.504670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0] Write session will restart in 0.007000s
2025-10-02T08:13:25.504695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0] Write session: Do CDS request
2025-10-02T08:13:25.504702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:25.513320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.513404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:25.513421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1735
2025-10-02T08:13:25.513464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:25.513703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.513743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:25.513752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:25.513754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:25.514065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:25.514194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1735 sessionId:  describe result for acl check
2025-10-02T08:13:25.514223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:25.514229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:25.514230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:25.514235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534559691729024:6403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:25.514247Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:25.514256Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:25.514266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:25.514316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:25.514351Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534559691729025:6363]
2025-10-02T08:13:25.514748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534559691729024:6403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:25.515000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:25.515216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:25.515267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:25.515570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:25.515624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.515630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.515631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.515632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.515633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.515639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.515647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.515651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.515654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.515657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.515661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.515669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.515674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.515680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.515684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.515688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.515697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.515701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.515706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.515710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.515728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:25.516451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534559691729024:6403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:25.522862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534559691729024:6403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:25.522878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534559691729024:6403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:25.522881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534559691729024:6403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:25.522889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:25.523874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:25.525597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:25.525611Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:25.525613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:25.525617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:25.525623Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1734 [1:7556534559691729025:6363]
2025-10-02T08:13:25.525635Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:25.525648Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:25.525651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.525655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.525656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.525672Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:25.525681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:25.525686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:25.525740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.525747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.525750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:25.525753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:25.525812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:25.525819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.525832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.525843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:25.525856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1734
2025-10-02T08:13:25.525862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691729071:6403], now have 1 active actors on pipe
2025-10-02T08:13:25.525867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534559691729016:6363]
2025-10-02T08:13:25.525869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534559691729016:6363]
2025-10-02T08:13:25.525878Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:25.525886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534560151446396:2378], now have 1 active actors on pipe
2025-10-02T08:13:25.525889Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:25.525891Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:25.525895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.525899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.525914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:25.525928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:25.525934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:25.525973Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:25.525983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.525987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.525993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:25.525954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1734
2025-10-02T08:13:25.526003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.526012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:25.526018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534559691729016:6363]
2025-10-02T08:13:25.526025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:25.526031Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:25.526052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.526119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.526129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.526150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.526187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1735 partition: 0 MaxSeqNo: 17 sessionId: src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0
2025-10-02T08:13:25.526530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174127d7-7ab1fbb8-b0e0f69d-1a033978_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:25.529092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0] Write session: try to update token
2025-10-02T08:13:25.529107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:25.543459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId: src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:25.543686Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:25.543700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:25.543703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:25.543711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534559691729016:6363]
2025-10-02T08:13:25.543716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534559691729016:6363]
2025-10-02T08:13:25.543759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:25.543770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.543772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:25.543771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:25.543778Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:25.543905Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:25.545916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:25.604676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534559691729091:6945]
2025-10-02T08:13:25.604757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1734, pipe: [1:7556534559691729091:6945]
2025-10-02T08:13:25.683374Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:25.683689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.683700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.683732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691729091:6945], now have 1 active actors on pipe
2025-10-02T08:13:25.683845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:25.683851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:25.683896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1735 reason: error at write: Disconnected sessionId: src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0
2025-10-02T08:13:25.683978Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:25.684020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1735 sessionId: src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0 is DEAD
2025-10-02T08:13:25.684059Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:25.684177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:25.684199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0] Write session will restart in 0.009930s
2025-10-02T08:13:25.684182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534559691729091:6945]
2025-10-02T08:13:25.684223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0] Write session: Do CDS request
2025-10-02T08:13:25.684230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:25.690339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:25.691127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:25.691287Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:25.691297Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:25.691305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:25.691343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:25.691382Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534559691729159:6416]
2025-10-02T08:13:25.691948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:25.692171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:25.692223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:25.692513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:25.692564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.692570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.692572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.692572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.692574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.692578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.692588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.692592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.692597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.692600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.692606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.692613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.692618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.692623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.692630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.692634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.692638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.692647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.692652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.692656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.692675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:25.695280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.695389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:25.695403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1736
2025-10-02T08:13:25.695529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.695559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:25.695568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:25.695571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:25.695982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1736 sessionId:  describe result for acl check
2025-10-02T08:13:25.696016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:25.696029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:25.696036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:25.696041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534559691729175:6428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:25.696545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534559691729175:6428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:25.698866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534559691729175:6428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:25.700972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:25.702532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534559691729175:6428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:25.702550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534559691729175:6428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:25.702553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534559691729175:6428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:25.702563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:25.702741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:25.702760Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:25.702764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:25.702768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:25.702775Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1735 [1:7556534559691729159:6416]
2025-10-02T08:13:25.702790Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:25.702809Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:25.702819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.702826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.702829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.702848Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:25.702860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:25.702867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:25.702941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.702950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.702953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:25.702956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:25.703021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:25.703030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.703044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.703061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:25.703089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534560151446412:2378], now have 1 active actors on pipe
2025-10-02T08:13:25.703102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534559691729153:6416]
2025-10-02T08:13:25.703104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534559691729153:6416]
2025-10-02T08:13:25.703114Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:25.703133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:25.703143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1735
2025-10-02T08:13:25.703155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:25.703163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:25.703171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691729207:6428], now have 1 active actors on pipe
2025-10-02T08:13:25.703208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534559691729153:6416]
2025-10-02T08:13:25.703222Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:25.703270Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:25.703272Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:25.703279Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:25.703290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.703295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.703323Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63c2754d-293db041-b78b9db0-ed14443f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:25.703335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.703340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.703341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:25.703353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.703364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:25.703376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.703410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.703412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.703425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.703457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1736 partition: 0 MaxSeqNo: 17 sessionId: src_id|63c2754d-293db041-b78b9db0-ed14443f_0
2025-10-02T08:13:25.703818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0bd47e-1b138c64-88ef1835-a6ce1e4d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63c2754d-293db041-b78b9db0-ed14443f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:25.703921Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1735
2025-10-02T08:13:25.706496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2754d-293db041-b78b9db0-ed14443f_0] Write session: try to update token
2025-10-02T08:13:25.706512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2754d-293db041-b78b9db0-ed14443f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:25.720057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId: src_id|63c2754d-293db041-b78b9db0-ed14443f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:25.721229Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:25.721248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:25.721251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:25.721263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534559691729153:6416]
2025-10-02T08:13:25.721269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534559691729153:6416]
2025-10-02T08:13:25.721328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:25.721343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.721351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:25.721429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:25.721445Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:25.721561Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:25.723018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:25.784414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534559691729223:6945]
2025-10-02T08:13:25.784573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1735, pipe: [1:7556534559691729223:6945]
2025-10-02T08:13:25.858499Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:25.858763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.858778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.858812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691729223:6945], now have 1 active actors on pipe
2025-10-02T08:13:25.858940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:25.858948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:25.858995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1736 reason: error at write: Disconnected sessionId: src_id|63c2754d-293db041-b78b9db0-ed14443f_0
2025-10-02T08:13:25.859094Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:25.859146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1736 sessionId: src_id|63c2754d-293db041-b78b9db0-ed14443f_0 is DEAD
2025-10-02T08:13:25.859133Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:25.859288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2754d-293db041-b78b9db0-ed14443f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:25.859302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2754d-293db041-b78b9db0-ed14443f_0] Write session will restart in 0.007273s
2025-10-02T08:13:25.859300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534559691729223:6945]
2025-10-02T08:13:25.859326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2754d-293db041-b78b9db0-ed14443f_0] Write session: Do CDS request
2025-10-02T08:13:25.859333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2754d-293db041-b78b9db0-ed14443f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:25.865222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:25.865706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:25.865845Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:25.865856Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:25.865863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:25.865894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:25.865926Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534559691729291:6441]
2025-10-02T08:13:25.866341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:25.866482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:25.866514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:25.866703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:25.866740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.866741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.866741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.866742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.866743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.866745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.866751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.866753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.866755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.866757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.866761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.866766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:25.866769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.866771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:25.866774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.866776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:25.866778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.866781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.866783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.866785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.866801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:25.867298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2754d-293db041-b78b9db0-ed14443f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.867333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:25.867347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1737
2025-10-02T08:13:25.867481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:25.867506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:25.867514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:25.867516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:25.867880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1737 sessionId:  describe result for acl check
2025-10-02T08:13:25.867912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:25.867919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:25.867920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:25.867925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534559691729307:6448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:25.868416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534559691729307:6448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:25.870302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534559691729307:6448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:25.874070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534559691729307:6448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:25.874084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534559691729307:6448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:25.874088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534559691729307:6448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:25.874096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:25.874640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:25.876121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:25.876136Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:25.876140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:25.876143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:25.876149Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1736 [1:7556534559691729291:6441]
2025-10-02T08:13:25.876160Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:25.876182Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:25.876200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.876203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.876205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.876219Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:25.876224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:25.876229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:25.876285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.876292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.876297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:25.876300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:25.876358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:25.876365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.876375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:25.876391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:25.876402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1736
2025-10-02T08:13:25.876411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691729339:6448], now have 1 active actors on pipe
2025-10-02T08:13:25.876415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534560151446421:2378], now have 1 active actors on pipe
2025-10-02T08:13:25.876420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534559691729285:6441]
2025-10-02T08:13:25.876421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534559691729285:6441]
2025-10-02T08:13:25.876432Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:25.876440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.876449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.876448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:25.876451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:25.876467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:25.876483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:25.876490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:25.876530Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:25.876539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.876542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.876544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:25.876482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1736
2025-10-02T08:13:25.876551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.876562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:25.876568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534559691729285:6441]
2025-10-02T08:13:25.876576Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:25.876593Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:25.876605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.876639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.876644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.876659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:25.876695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1737 partition: 0 MaxSeqNo: 17 sessionId: src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0
2025-10-02T08:13:25.877016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2754d-293db041-b78b9db0-ed14443f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:25.879572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0] Write session: try to update token
2025-10-02T08:13:25.879583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:25.892894Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:25.892924Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:25.892934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534559691729285:6441]
2025-10-02T08:13:25.892973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:25.892981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:25.893127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:25.893267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:25.893405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:25.893543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:25.893736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:25.893768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:25.894849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId: src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:25.897356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:25.897449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.897458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.897485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:25.897509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:25.897566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:25.897583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:25.897754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.897817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.897877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.897937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.898328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.898341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.898406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.898463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.898523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.898588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.898630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.898637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.898705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.898770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.898829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.898892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.898935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.898942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.899009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.899073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.899148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.899223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.899274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.899282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.899357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.899427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.899500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.899573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.899624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.899630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.899704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.899770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.899840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.899911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.900045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.900052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.900127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.900209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.900282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.900353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.900403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.900410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.900483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.900548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.900616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.900684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.900733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.900740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.900835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.900892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.900950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.901009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.901058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.901065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.901136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:25.901200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:25.901262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:25.901322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:25.901370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:25.901376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:25.901411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:25.901474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:25.901497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:25.901503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:25.901531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:25.901548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:25.901551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:25.901554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:25.901557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:25.901921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:25.901947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:25.901958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:25.901965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:25.901968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:25.901971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:25.902440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:25.902463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:25.902468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:25.902471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:25.902475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:25.902480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:25.903062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:25.903085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:25.903090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:25.903099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:25.903106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:25.905307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:25.905325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:25.905337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392805905
2025-10-02T08:13:25.905479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:25.905493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:25.905498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:25.905501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:25.905506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:25.905515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:25.905965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:25.905985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:25.905990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:25.905994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:25.905997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:25.906001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:25.906437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:25.906458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:25.906466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:25.906471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:25.906474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:25.906478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:25.906904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:25.906924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:25.906928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:25.908036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:25.908053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:25.908060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:25.908064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:25.908072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392805907
2025-10-02T08:13:25.908364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:25.908384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:25.908389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:25.908394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:25.908402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:25.908408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:25.908930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:25.908949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:25.908955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:25.908959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:25.908962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:25.908966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:25.909434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:25.909456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:25.909559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392805909
2025-10-02T08:13:25.913413Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:25.913438Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:25.913447Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:25.913454Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:25.915056Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:25.915071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:25.915074Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:25.915085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534559691729285:6441]
2025-10-02T08:13:25.915089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534559691729285:6441]
2025-10-02T08:13:25.915138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:25.915146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:25.915151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:25.915152Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:25.915154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:25.915287Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:25.959512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534559691729362:6945]
2025-10-02T08:13:25.959591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1736, pipe: [1:7556534559691729362:6945]
2025-10-02T08:13:26.064918Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:26.065268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534559691729362:6945], now have 1 active actors on pipe
2025-10-02T08:13:26.065381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534559691729362:6945]
2025-10-02T08:13:26.065409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:26.065416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:26.065438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1737 reason: error at write: Disconnected sessionId: src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0
2025-10-02T08:13:26.065503Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:26.065488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:26.065597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1737 sessionId: src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0 is DEAD
2025-10-02T08:13:26.065730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:26.065739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0] Write session will restart in 0.007572s
2025-10-02T08:13:26.065760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0] Write session: Do CDS request
2025-10-02T08:13:26.065767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:26.070723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:26.071194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:26.071378Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:26.071387Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:26.071395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:26.071436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:26.071469Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534563986696727:6472]
2025-10-02T08:13:26.072045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:26.072219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:26.072256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:26.072520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:26.072554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.072559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.072560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.072562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.072562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.072566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.072575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.072578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.072581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.072584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.072591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.072596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.072601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.072605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.072609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.072612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.072617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.072621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.072625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.072629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.072644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:26.074331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.074320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:26.074338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1738
2025-10-02T08:13:26.074513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.074539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:26.074560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:26.074568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:26.074945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1738 sessionId:  describe result for acl check
2025-10-02T08:13:26.074979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:26.074985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:26.074987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:26.074991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534563986696743:6489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:26.075459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534563986696743:6489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:26.077589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534563986696743:6489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:26.080090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534563986696743:6489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:26.080101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534563986696743:6489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:26.080104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534563986696743:6489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:26.080119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:26.080161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:26.081773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:26.081789Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:26.081791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:26.081794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:26.081803Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1737 [1:7556534563986696727:6472]
2025-10-02T08:13:26.081815Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:26.081830Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:26.081833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.081835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.081837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.081854Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:26.081858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:26.081864Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:26.081919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.081929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.081932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:26.081934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:26.081993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:26.082000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.082012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.082024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:26.082040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986696775:6489], now have 1 active actors on pipe
2025-10-02T08:13:26.082043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534564446413724:2378], now have 1 active actors on pipe
2025-10-02T08:13:26.082047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1737
2025-10-02T08:13:26.082049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534563986696721:6472]
2025-10-02T08:13:26.082051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534563986696721:6472]
2025-10-02T08:13:26.082057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:26.082066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:26.082067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:26.082069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:26.082078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:26.082079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:26.082085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.082087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.082119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534563986696721:6472]
2025-10-02T08:13:26.082124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:26.082132Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:26.082134Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79bd749-16f8b318-60a48f56-1da8009_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:26.082140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.082142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.082144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:26.082127Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1737
2025-10-02T08:13:26.082153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.082165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:26.082193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.082259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.082265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.082275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.082304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1738 partition: 0 MaxSeqNo: 17 sessionId: src_id|79bd749-16f8b318-60a48f56-1da8009_0
2025-10-02T08:13:26.082617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20231a9c-3212fe59-6ae6d42-4e37ae20_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79bd749-16f8b318-60a48f56-1da8009_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:26.085264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd749-16f8b318-60a48f56-1da8009_0] Write session: try to update token
2025-10-02T08:13:26.085280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd749-16f8b318-60a48f56-1da8009_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:26.100059Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:26.100084Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:26.100088Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:26.100096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534563986696721:6472]
2025-10-02T08:13:26.100101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534563986696721:6472]
2025-10-02T08:13:26.100149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:26.100148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:26.100154Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:26.100161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.100164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:26.100332Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:26.104725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId: src_id|79bd749-16f8b318-60a48f56-1da8009_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:26.107094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:26.165395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534563986696791:6945]
2025-10-02T08:13:26.165530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1737, pipe: [1:7556534563986696791:6945]
2025-10-02T08:13:26.239711Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:26.239974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.239986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.240018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986696791:6945], now have 1 active actors on pipe
2025-10-02T08:13:26.240108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:26.240113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:26.240156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1738 reason: error at write: Disconnected sessionId: src_id|79bd749-16f8b318-60a48f56-1da8009_0
2025-10-02T08:13:26.240273Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:26.240292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1738 sessionId: src_id|79bd749-16f8b318-60a48f56-1da8009_0 is DEAD
2025-10-02T08:13:26.240253Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:26.240431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd749-16f8b318-60a48f56-1da8009_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:26.240439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd749-16f8b318-60a48f56-1da8009_0] Write session will restart in 0.009712s
2025-10-02T08:13:26.240424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534563986696791:6945]
2025-10-02T08:13:26.240462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd749-16f8b318-60a48f56-1da8009_0] Write session: Do CDS request
2025-10-02T08:13:26.240469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd749-16f8b318-60a48f56-1da8009_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:26.245392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:26.246141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:26.246306Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:26.246316Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:26.246325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:26.246370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:26.246414Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534563986696860:6509]
2025-10-02T08:13:26.246952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:26.247148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:26.247192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:26.247466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:26.247525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.247531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.247532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.247533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.247534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.247538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.247548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.247552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.247555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.247558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.247563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.247571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.247576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.247580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.247583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.247587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.247593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.247596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.247600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.247604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.247621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:26.251280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd749-16f8b318-60a48f56-1da8009_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.251285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:26.251299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1739
2025-10-02T08:13:26.251490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.251516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:26.251522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:26.251524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:26.251936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1739 sessionId:  describe result for acl check
2025-10-02T08:13:26.251976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:26.251982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:26.251984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:26.251990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534563986696876:6523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:26.252514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534563986696876:6523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:26.255159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:26.256453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534563986696876:6523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:26.256692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:26.256708Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:26.256710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:26.256715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:26.256720Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1738 [1:7556534563986696860:6509]
2025-10-02T08:13:26.256731Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:26.256745Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:26.256748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.256751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.256753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.256768Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:26.256778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:26.256784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:26.256873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.256879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.256882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:26.256885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:26.256947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:26.256953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.256967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.256985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:26.257009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534564446413733:2378], now have 1 active actors on pipe
2025-10-02T08:13:26.257019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534563986696854:6509]
2025-10-02T08:13:26.257021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534563986696854:6509]
2025-10-02T08:13:26.257033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:26.257046Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:26.257048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:26.257055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:26.257063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:26.257066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:26.257052Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1738
2025-10-02T08:13:26.257097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534563986696854:6509]
2025-10-02T08:13:26.257108Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:26.257114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:26.262060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534563986696876:6523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:26.262078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534563986696876:6523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:26.262082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534563986696876:6523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:26.262091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:26.262313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1738
2025-10-02T08:13:26.262320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986696917:6523], now have 1 active actors on pipe
2025-10-02T08:13:26.262326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.262330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.262351Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb415514-3218de64-6fb2f626-c73efa53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:26.262359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.262369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.262371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:26.262379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.262396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:26.262412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.262453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.262465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.262488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.262528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1739 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb415514-3218de64-6fb2f626-c73efa53_0
2025-10-02T08:13:26.262826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd749-16f8b318-60a48f56-1da8009_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb415514-3218de64-6fb2f626-c73efa53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:26.265395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb415514-3218de64-6fb2f626-c73efa53_0] Write session: try to update token
2025-10-02T08:13:26.265417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb415514-3218de64-6fb2f626-c73efa53_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:26.274463Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:26.274480Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:26.274482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:26.274492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534563986696854:6509]
2025-10-02T08:13:26.274497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534563986696854:6509]
2025-10-02T08:13:26.274533Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:26.274537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:26.274538Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:26.274543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.274545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:26.274691Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:26.278841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId: src_id|fb415514-3218de64-6fb2f626-c73efa53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:26.281396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:26.340420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534563986696924:6945]
2025-10-02T08:13:26.340517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1738, pipe: [1:7556534563986696924:6945]
2025-10-02T08:13:26.405614Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:26.406045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.406061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.406099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986696924:6945], now have 1 active actors on pipe
2025-10-02T08:13:26.406227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534563986696924:6945]
2025-10-02T08:13:26.406254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:26.406257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:26.406310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1739 reason: error at write: Disconnected sessionId: src_id|fb415514-3218de64-6fb2f626-c73efa53_0
2025-10-02T08:13:26.406315Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:26.406485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1739 sessionId: src_id|fb415514-3218de64-6fb2f626-c73efa53_0 is DEAD
2025-10-02T08:13:26.406365Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:26.406638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb415514-3218de64-6fb2f626-c73efa53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:26.406646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb415514-3218de64-6fb2f626-c73efa53_0] Write session will restart in 0.006347s
2025-10-02T08:13:26.406664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb415514-3218de64-6fb2f626-c73efa53_0] Write session: Do CDS request
2025-10-02T08:13:26.406668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb415514-3218de64-6fb2f626-c73efa53_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:26.411235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:26.411821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:26.411995Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:26.412003Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:26.412012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:26.412058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:26.412097Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534563986696996:12280]
2025-10-02T08:13:26.412692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:26.413133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:26.413171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:26.413448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:26.413483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.413487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.413488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.413489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.413490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.413495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.413504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.413511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.413513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.413517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.413522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.413527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.413536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.413544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.413548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.413556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.413560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.413564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.413573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.413577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.413593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:26.414243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb415514-3218de64-6fb2f626-c73efa53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.414300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:26.414311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1740
2025-10-02T08:13:26.414443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.414471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:26.414480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:26.414485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:26.414950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1740 sessionId:  describe result for acl check
2025-10-02T08:13:26.414977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:26.414983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:26.414984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:26.414989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534563986697012:12278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:26.415385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534563986697012:12278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:26.417392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534563986697012:12278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:26.422669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534563986697012:12278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:26.422685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534563986697012:12278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:26.422689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534563986697012:12278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:26.422698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:26.423160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:26.424651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:26.424663Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:26.424664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:26.424667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:26.424672Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1739 [1:7556534563986696996:12280]
2025-10-02T08:13:26.424680Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:26.424695Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:26.424696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.424701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.424703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.424714Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:26.424718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:26.424722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:26.424768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.424774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.424776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:26.424778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:26.424846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:26.424853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.424861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.424872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:26.424887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534563986696990:12280]
2025-10-02T08:13:26.424892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534563986696990:12280]
2025-10-02T08:13:26.424898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:26.424910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:26.424918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1739
2025-10-02T08:13:26.424922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:26.424925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:26.424926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:26.424928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:26.424939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986697044:12278], now have 1 active actors on pipe
2025-10-02T08:13:26.424973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534564446413741:2378], now have 1 active actors on pipe
2025-10-02T08:13:26.424981Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534563986696990:12280]
2025-10-02T08:13:26.424988Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:26.425000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:26.425001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.425005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.424999Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1739
2025-10-02T08:13:26.425043Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:26.425052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.425054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.425056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:26.425062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.425069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:26.425132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.425160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.425161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.425170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.425208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1740 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0
2025-10-02T08:13:26.425531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb415514-3218de64-6fb2f626-c73efa53_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:26.428094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0] Write session: try to update token
2025-10-02T08:13:26.428111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:26.441945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId: src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:26.442244Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:26.442260Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:26.442263Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:26.442273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534563986696990:12280]
2025-10-02T08:13:26.442277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534563986696990:12280]
2025-10-02T08:13:26.442313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:26.442314Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:26.442318Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:26.442321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.442323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:26.442450Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:26.444661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:26.506303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534563986697101:6945]
2025-10-02T08:13:26.506410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1739, pipe: [1:7556534563986697101:6945]
2025-10-02T08:13:26.574743Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:26.575052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.575073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.575115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986697101:6945], now have 1 active actors on pipe
2025-10-02T08:13:26.575211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534563986697101:6945]
2025-10-02T08:13:26.575232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:26.575235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:26.575283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1740 reason: error at write: Disconnected sessionId: src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0
2025-10-02T08:13:26.575316Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:26.575305Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:26.575438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1740 sessionId: src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0 is DEAD
2025-10-02T08:13:26.575573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:26.575582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0] Write session will restart in 0.008544s
2025-10-02T08:13:26.575615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0] Write session: Do CDS request
2025-10-02T08:13:26.575623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:26.580594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:26.581370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:26.581515Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:26.581523Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:26.581531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:26.581573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:26.581613Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534563986697188:12244]
2025-10-02T08:13:26.582093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:26.582313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:26.582368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:26.582663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:26.582704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.582708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.582709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.582712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.582712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.582716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.582722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.582728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.582731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.582733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.582737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.582741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.582745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.582748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.582750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.582752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.582754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.582757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.582759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.582762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.582772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:26.588590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.588727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:26.588746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1741
2025-10-02T08:13:26.588885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.588922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:26.588933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:26.588937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:26.589323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1741 sessionId:  describe result for acl check
2025-10-02T08:13:26.589354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:26.589356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:26.589357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:26.589362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534563986697204:12233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:26.589811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534563986697204:12233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:26.591241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:26.591515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534563986697204:12233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:26.593048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:26.593062Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:26.593067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:26.593070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:26.593076Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1740 [1:7556534563986697188:12244]
2025-10-02T08:13:26.593087Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:26.593108Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:26.593118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.593121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.593123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.593138Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:26.593144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:26.593150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:26.593216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.593223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.593226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:26.593228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:26.593298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:26.593305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.593318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.593336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:26.593357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534564446413782:2378], now have 1 active actors on pipe
2025-10-02T08:13:26.593367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534563986697182:12244]
2025-10-02T08:13:26.593374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534563986697182:12244]
2025-10-02T08:13:26.593383Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:26.593402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:26.593365Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1740
2025-10-02T08:13:26.593413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:26.593420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:26.593421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:26.593423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:26.593458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534563986697182:12244]
2025-10-02T08:13:26.593469Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:26.593475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:26.594219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534563986697204:12233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:26.594232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534563986697204:12233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:26.594235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534563986697204:12233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:26.594243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:26.594451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1740
2025-10-02T08:13:26.594464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986697238:12233], now have 1 active actors on pipe
2025-10-02T08:13:26.594469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.594478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.594506Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:26.594518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.594529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.594531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:26.594540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.594556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:26.594575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.594621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.594628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.594639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.594676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1741 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0
2025-10-02T08:13:26.594975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c01e8ab-318d77a1-31953777-95aff5c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:26.597638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0] Write session: try to update token
2025-10-02T08:13:26.597652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:26.610908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId: src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:26.611416Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:26.611430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:26.611433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:26.611441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534563986697182:12244]
2025-10-02T08:13:26.611444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534563986697182:12244]
2025-10-02T08:13:26.611477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:26.611483Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:26.611486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.611487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:26.611488Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:26.611639Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:26.613637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:26.675329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534563986697251:6945]
2025-10-02T08:13:26.675445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1740, pipe: [1:7556534563986697251:6945]
2025-10-02T08:13:26.750846Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:26.751121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.751140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.751197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986697251:6945], now have 1 active actors on pipe
2025-10-02T08:13:26.751301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534563986697251:6945]
2025-10-02T08:13:26.751317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:26.751319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:26.751368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1741 reason: error at write: Disconnected sessionId: src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0
2025-10-02T08:13:26.751435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:26.751516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1741 sessionId: src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0 is DEAD
2025-10-02T08:13:26.751653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:26.751663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0] Write session will restart in 0.006801s
2025-10-02T08:13:26.751687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0] Write session: Do CDS request
2025-10-02T08:13:26.751696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:26.751895Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:26.756248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:26.756892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:26.757021Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:26.757028Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:26.757035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:26.757074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:26.757109Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534563986697330:12230]
2025-10-02T08:13:26.757686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:26.757910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:26.757967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:26.758230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:26.758268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.758272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.758273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.758274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.758274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.758278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.758284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.758287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.758289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.758291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.758295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.758300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.758304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.758307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.758311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.758315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.758317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.758320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.758322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.758333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.758343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:26.759317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.759399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:26.759414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1742
2025-10-02T08:13:26.759533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.759563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:26.759572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:26.759575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:26.759992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1742 sessionId:  describe result for acl check
2025-10-02T08:13:26.760021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:26.760027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:26.760028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:26.760033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534563986697346:12228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:26.760508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534563986697346:12228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:26.763406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534563986697346:12228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:26.766476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534563986697346:12228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:26.766491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534563986697346:12228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:26.766495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534563986697346:12228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:26.766504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:26.766698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:26.768360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:26.768381Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:26.768384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:26.768388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:26.768394Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1741 [1:7556534563986697330:12230]
2025-10-02T08:13:26.768407Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:26.768424Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:26.768427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.768430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.768432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.768448Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:26.768454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:26.768468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:26.768827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.768839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.768843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:26.768846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:26.768917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:26.768926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.768941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.768953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:26.768961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1741
2025-10-02T08:13:26.768976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986697378:12228], now have 1 active actors on pipe
2025-10-02T08:13:26.768985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534564446413790:2378], now have 1 active actors on pipe
2025-10-02T08:13:26.768990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.768994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.769011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534563986697324:12230]
2025-10-02T08:13:26.769020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534563986697324:12230]
2025-10-02T08:13:26.769033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:26.769050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:26.769062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:26.769068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:26.769071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:26.769074Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:26.769085Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:26.769091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.769099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.769101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:26.769109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.769119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:26.769161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534563986697324:12230]
2025-10-02T08:13:26.769172Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:26.769189Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:26.769190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.769290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.769299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.769315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.769356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1742 partition: 0 MaxSeqNo: 17 sessionId: src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0
2025-10-02T08:13:26.769039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1741
2025-10-02T08:13:26.769659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0644ad-23ef94b0-4e4b3826-5573bdd2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:26.772304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0] Write session: try to update token
2025-10-02T08:13:26.772324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:26.789860Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:26.789885Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:26.789888Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:26.789896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534563986697324:12230]
2025-10-02T08:13:26.789902Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534563986697324:12230]
2025-10-02T08:13:26.789957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:26.789964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.789971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:26.789987Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:26.790018Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:26.790119Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:26.799114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId: src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:26.803248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:26.851420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534563986697395:6945]
2025-10-02T08:13:26.851564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1741, pipe: [1:7556534563986697395:6945]
2025-10-02T08:13:26.921368Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:26.921646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.921657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.921677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986697395:6945], now have 1 active actors on pipe
2025-10-02T08:13:26.921820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534563986697395:6945]
2025-10-02T08:13:26.921848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:26.921850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:26.921921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1742 reason: error at write: Disconnected sessionId: src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0
2025-10-02T08:13:26.921963Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:26.922059Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:26.922077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1742 sessionId: src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0 is DEAD
2025-10-02T08:13:26.922209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:26.922219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0] Write session will restart in 0.005780s
2025-10-02T08:13:26.922243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0] Write session: Do CDS request
2025-10-02T08:13:26.922249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:26.927167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:26.927770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:26.927939Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:26.927947Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:26.927956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:26.927999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:26.928042Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534563986697472:12224]
2025-10-02T08:13:26.928716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:26.928898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:26.928935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:26.929178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.929238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:26.929278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.929283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.929284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.929286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.929287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.929292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.929302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.929306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.929310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.929314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.929319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.929319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:26.929324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1743
2025-10-02T08:13:26.929327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:26.929332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.929337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:26.929346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.929352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:26.929360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.929365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.929375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.929380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.929401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:26.929406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:26.929426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:26.929436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:26.929439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:26.929758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1743 sessionId:  describe result for acl check
2025-10-02T08:13:26.929792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:26.929798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:26.929800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:26.929804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534563986697489:12223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:26.930253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534563986697489:12223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:26.932082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534563986697489:12223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:26.936915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534563986697489:12223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:26.936931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534563986697489:12223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:26.936938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534563986697489:12223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:26.936947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:26.937628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:26.939076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:26.939095Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:26.939097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:26.939099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:26.939104Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1742 [1:7556534563986697472:12224]
2025-10-02T08:13:26.939114Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:26.939127Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:26.939128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.939130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.939132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.939144Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:26.939147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:26.939152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:26.939202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.939208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.939210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:26.939213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:26.939261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:26.939267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.939275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:26.939282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:26.939292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534563986697466:12224]
2025-10-02T08:13:26.939297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534563986697466:12224]
2025-10-02T08:13:26.939302Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:26.939311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:26.939314Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:26.939318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:26.939323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:26.939325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:26.939332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534563986697520:12223], now have 1 active actors on pipe
2025-10-02T08:13:26.939334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1742
2025-10-02T08:13:26.939334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534564446413796:2378], now have 1 active actors on pipe
2025-10-02T08:13:26.939360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534563986697466:12224]
2025-10-02T08:13:26.939371Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:26.939377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.939381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:26.939385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.939416Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30550c7a-60e2c098-98f84f00-da27846_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:26.939424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:26.939427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:26.939428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:26.939401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1742
2025-10-02T08:13:26.939435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:26.939445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:26.939466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.939508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:26.939522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:26.939544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:26.939585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1743 partition: 0 MaxSeqNo: 17 sessionId: src_id|30550c7a-60e2c098-98f84f00-da27846_0
2025-10-02T08:13:26.939931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e1954-7eac221e-ca9c8b6b-97dd79ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|30550c7a-60e2c098-98f84f00-da27846_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:26.942621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30550c7a-60e2c098-98f84f00-da27846_0] Write session: try to update token
2025-10-02T08:13:26.942638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30550c7a-60e2c098-98f84f00-da27846_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:26.957093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId: src_id|30550c7a-60e2c098-98f84f00-da27846_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:26.958123Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:26.958140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:26.958142Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:26.958152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534563986697466:12224]
2025-10-02T08:13:26.958156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534563986697466:12224]
2025-10-02T08:13:26.958203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:26.958214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:26.958215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:26.958219Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:26.958228Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:26.958348Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:26.959729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:27.021904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534568281664834:6945]
2025-10-02T08:13:27.022042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1742, pipe: [1:7556534568281664834:6945]
2025-10-02T08:13:27.112080Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:27.112480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.112493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.112530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281664834:6945], now have 1 active actors on pipe
2025-10-02T08:13:27.112649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534568281664834:6945]
2025-10-02T08:13:27.112681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:27.112687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:27.112741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1743 reason: error at write: Disconnected sessionId: src_id|30550c7a-60e2c098-98f84f00-da27846_0
2025-10-02T08:13:27.112754Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:27.112796Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:27.112932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1743 sessionId: src_id|30550c7a-60e2c098-98f84f00-da27846_0 is DEAD
2025-10-02T08:13:27.113059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30550c7a-60e2c098-98f84f00-da27846_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:27.113069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30550c7a-60e2c098-98f84f00-da27846_0] Write session will restart in 0.005940s
2025-10-02T08:13:27.113094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30550c7a-60e2c098-98f84f00-da27846_0] Write session: Do CDS request
2025-10-02T08:13:27.113100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30550c7a-60e2c098-98f84f00-da27846_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:27.118014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:27.118590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:27.118725Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:27.118733Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:27.118741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:27.118777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:27.118813Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534568281664914:12213]
2025-10-02T08:13:27.119484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:27.119692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:27.119761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:27.120011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:27.120041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.120046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.120047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.120048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.120049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.120054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.120063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.120066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.120078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.120081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.120087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.120095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.120101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.120105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.120109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.120114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.120119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.120123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.120128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.120136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.120153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:27.120225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30550c7a-60e2c098-98f84f00-da27846_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.120297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:27.120306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1744
2025-10-02T08:13:27.120403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.120427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:27.120436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:27.120439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:27.120798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1744 sessionId:  describe result for acl check
2025-10-02T08:13:27.120832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:27.120840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:27.120841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:27.120845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534568281664930:12206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:27.121302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534568281664930:12206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:27.122931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534568281664930:12206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:27.127940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534568281664930:12206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:27.127952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534568281664930:12206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:27.127955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534568281664930:12206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:27.127962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:27.128686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:27.130323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:27.130336Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:27.130340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:27.130343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:27.130349Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1743 [1:7556534568281664914:12213]
2025-10-02T08:13:27.130360Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:27.130374Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:27.130378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.130380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.130382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.130394Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:27.130401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:27.130405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:27.130461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.130468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.130471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:27.130473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:27.130531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:27.130537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.130546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1743
2025-10-02T08:13:27.130549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.130560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:27.130579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281664963:12206], now have 1 active actors on pipe
2025-10-02T08:13:27.130587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.130591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.130602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534568741381099:2378], now have 1 active actors on pipe
2025-10-02T08:13:27.130612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534568281664908:12213]
2025-10-02T08:13:27.130615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534568281664908:12213]
2025-10-02T08:13:27.130625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:27.130639Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:27.130640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:27.130646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:27.130651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:27.130654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:27.130667Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:27.130676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.130679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.130648Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1743
2025-10-02T08:13:27.130680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:27.130689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.130696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:27.130728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534568281664908:12213]
2025-10-02T08:13:27.130738Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:27.130748Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:27.130753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.130843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.130853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.130872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.130906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1744 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0
2025-10-02T08:13:27.131200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30550c7a-60e2c098-98f84f00-da27846_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:27.133780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0] Write session: try to update token
2025-10-02T08:13:27.133798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:27.142867Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:27.142885Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:27.142893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534568281664908:12213]
2025-10-02T08:13:27.142937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:27.142956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:27.143112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:27.143251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:27.143384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:27.143517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:27.143770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:27.143805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:27.147607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId: src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:27.150359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:27.150457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.150471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.150502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:27.150522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:27.150575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.150592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.150749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.150821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.150886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.150949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.150997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.151005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.151071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.151139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.151238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.151335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.151434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.151441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.151507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.151567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.151628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.151693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.151733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.151738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.151798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.151862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.151928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.151999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.152099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.152105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.152199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.152262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.152330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.152398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.152445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.152450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.152520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.152584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.152651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.152724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.152849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.152859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.152931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.152992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.153061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.153136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.153348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.153355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.153427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.153488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.153555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.153622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.153719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.153725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.153797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.153856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.153918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.153979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.154026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.154032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.154100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.154162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.154227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.154286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.154334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.154340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.154371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:27.154425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.154442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.154448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:27.154472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:27.154484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:27.154489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:27.154491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:27.154494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:27.154863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:27.154884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:27.154888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:27.154890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:27.154892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:27.154894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:27.155361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:27.155378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:27.155381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:27.155383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:27.155385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:27.155387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:27.155826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:27.155842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:27.155846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:27.155848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:27.155850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:27.157074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:27.157092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:27.157101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392807157
2025-10-02T08:13:27.157237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:27.157247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:27.157250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:27.157254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:27.157258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:27.157261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:27.157687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:27.157704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:27.157708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:27.157710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:27.157713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:27.157715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:27.158162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:27.158180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:27.158185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:27.158186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:27.158189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:27.158191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:27.158622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:27.158637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:27.158641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:27.159662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:27.159677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:27.159681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:27.159684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:27.159690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392807159
2025-10-02T08:13:27.159952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:27.159968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:27.159972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:27.159974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:27.159976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:27.159979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:27.160396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:27.160413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:27.160417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:27.160421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:27.160424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:27.160426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:27.160861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:27.160875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.160946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392807160
2025-10-02T08:13:27.161654Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:27.161671Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:27.161675Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:27.161678Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:27.163306Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:27.163319Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:27.163320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:27.163327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534568281664908:12213]
2025-10-02T08:13:27.163329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534568281664908:12213]
2025-10-02T08:13:27.163375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:27.163375Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:27.163381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.163382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:27.163383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:27.163513Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:27.212970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534568281664984:6945]
2025-10-02T08:13:27.213139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1743, pipe: [1:7556534568281664984:6945]
2025-10-02T08:13:27.299948Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:27.300267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281664984:6945], now have 1 active actors on pipe
2025-10-02T08:13:27.300399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534568281664984:6945]
2025-10-02T08:13:27.300420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:27.300426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:27.300448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1744 reason: error at write: Disconnected sessionId: src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0
2025-10-02T08:13:27.300512Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:27.300541Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:27.300585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1744 sessionId: src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0 is DEAD
2025-10-02T08:13:27.300748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:27.300758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0] Write session will restart in 0.008726s
2025-10-02T08:13:27.300781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0] Write session: Do CDS request
2025-10-02T08:13:27.300787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:27.306988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:27.307543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:27.307702Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:27.307711Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:27.307721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:27.307771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:27.307814Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534568281665067:12197]
2025-10-02T08:13:27.308447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:27.308611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:27.308650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:27.308967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:27.309020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.309022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.309023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.309024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.309025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.309030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.309039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.309043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.309046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.309049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.309054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.309062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.309067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.309072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.309076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.309081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.309084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.309089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.309094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.309098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.309117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:27.310264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.310377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:27.310390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1745
2025-10-02T08:13:27.310520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.310554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:27.310565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:27.310570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:27.310998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1745 sessionId:  describe result for acl check
2025-10-02T08:13:27.311049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:27.311060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:27.311061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:27.311068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534568281665083:12189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:27.311583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534568281665083:12189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:27.314053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534568281665083:12189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:27.319449Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1744
2025-10-02T08:13:27.316765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534568281665083:12189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:27.316784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534568281665083:12189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:27.316788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534568281665083:12189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:27.316829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:27.317340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:27.319091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:27.319107Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:27.319111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:27.319115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:27.319123Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1744 [1:7556534568281665067:12197]
2025-10-02T08:13:27.319138Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:27.319157Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:27.319161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.319165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.319170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.319188Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:27.319192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:27.319199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:27.319264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.319266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.319269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:27.319271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:27.319344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:27.319347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.319361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.319373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:27.319392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534568741381107:2378], now have 1 active actors on pipe
2025-10-02T08:13:27.319398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534568281665061:12197]
2025-10-02T08:13:27.319400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534568281665061:12197]
2025-10-02T08:13:27.319409Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:27.319423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:27.319437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:27.319440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:27.319443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1744
2025-10-02T08:13:27.319446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281665115:12189], now have 1 active actors on pipe
2025-10-02T08:13:27.319452Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:27.319455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:27.319478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534568281665061:12197]
2025-10-02T08:13:27.319482Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:27.319488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.319494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.319503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:27.319550Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:27.319557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.319561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.319563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:27.319573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.319583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:27.319603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.319642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.319644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.319657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.319697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1745 partition: 0 MaxSeqNo: 17 sessionId: src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0
2025-10-02T08:13:27.320062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d35f91f-ff291bca-bf32dfc0-9963c08d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:27.322703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0] Write session: try to update token
2025-10-02T08:13:27.322718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:27.335260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId: src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:27.337530Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:27.337552Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:27.337554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:27.337563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534568281665061:12197]
2025-10-02T08:13:27.337568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534568281665061:12197]
2025-10-02T08:13:27.337613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:27.337620Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:27.337625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.337625Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:27.337628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:27.337787Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:27.337978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:27.400785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534568281665131:6945]
2025-10-02T08:13:27.400933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1744, pipe: [1:7556534568281665131:6945]
2025-10-02T08:13:27.477522Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:27.477836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.477849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.477890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281665131:6945], now have 1 active actors on pipe
2025-10-02T08:13:27.478022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534568281665131:6945]
2025-10-02T08:13:27.478067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:27.478075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:27.478127Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:27.478154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1745 reason: error at write: Disconnected sessionId: src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0
2025-10-02T08:13:27.478146Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:27.478325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1745 sessionId: src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0 is DEAD
2025-10-02T08:13:27.478473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:27.478482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0] Write session will restart in 0.007343s
2025-10-02T08:13:27.478507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0] Write session: Do CDS request
2025-10-02T08:13:27.478514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:27.485841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:27.486519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:27.486657Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:27.486666Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:27.486677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:27.486746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:27.486790Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534568281665218:12183]
2025-10-02T08:13:27.487282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.487376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:27.487390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1746
2025-10-02T08:13:27.487406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:27.487482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.487515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:27.487523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:27.487527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:27.487600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:27.487640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:27.487793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1746 sessionId:  describe result for acl check
2025-10-02T08:13:27.487816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:27.487821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:27.487822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:27.487825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534568281665229:12181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:27.487877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:27.487906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.487911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.487912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.487913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.487913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.487917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.487924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.487926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.487928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.487930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.487934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.487938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.487942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.487945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.487947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.487950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.487952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.487955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.487958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.487960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.487970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:27.488231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534568281665229:12181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:27.490177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534568281665229:12181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:27.495972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534568281665229:12181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:27.495989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534568281665229:12181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:27.495993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534568281665229:12181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:27.496002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:27.496782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:27.498478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:27.498496Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:27.498501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:27.498505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:27.498512Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1745 [1:7556534568281665218:12183]
2025-10-02T08:13:27.498524Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:27.498545Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:27.498554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.498558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.498559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.498574Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:27.498580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:27.498586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:27.498651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.498658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.498661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:27.498664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:27.498724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:27.498731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.498745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.498762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:27.498766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1745
2025-10-02T08:13:27.498782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281665266:12181], now have 1 active actors on pipe
2025-10-02T08:13:27.498793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534568281665212:12183]
2025-10-02T08:13:27.498795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534568281665212:12183]
2025-10-02T08:13:27.498802Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:27.498815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534568741381126:2378], now have 1 active actors on pipe
2025-10-02T08:13:27.498828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.498835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.498849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:27.498866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:27.498874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:27.498971Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1745
2025-10-02T08:13:27.498915Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:27.498920Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:27.498923Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:27.498927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.498930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.498934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:27.498942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.498950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:27.498957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534568281665212:12183]
2025-10-02T08:13:27.498960Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:27.498963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:27.498981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.499047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.499053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.499075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.499111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1746 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0
2025-10-02T08:13:27.499514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bd93c-f7a795be-1a1f9d9c-59fd0ef2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:27.501957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0] Write session: try to update token
2025-10-02T08:13:27.501970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:27.515966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId: src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:27.518407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:27.518475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.518489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.518517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:27.518531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:27.518573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.518579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.518705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.518757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.518812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.518868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.518970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.518984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.519052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.519114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.519175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.519239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.519285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.519291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.519354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.519414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.519470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.519527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.519569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.519575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.519636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.519701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.519766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.519834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.519885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.519891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.519962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.520026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.520094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.520163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.520321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.520328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.520405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.520470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.520539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.520610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.520658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.520664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.520738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.520816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.520887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.520956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.521006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.521012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.521083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.521156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.521228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.521294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.521343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.521351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.521422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.521482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.521544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.521614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.521672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.521678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.521748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:27.521802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:27.521857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:27.521918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:27.522023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:27.522031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:27.522088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:27.522238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.522254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.522260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:27.522287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:27.522299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:27.522301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:27.522303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:27.522305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:27.522691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:27.522715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:27.522722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:27.522726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:27.522730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:27.522734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:27.523162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:27.523185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:27.523192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:27.523196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:27.523199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:27.523202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:27.523620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:27.523639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:27.523644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:27.523647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:27.523650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:27.531263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:27.531292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:27.531306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392807531
2025-10-02T08:13:27.531506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:27.531526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:27.531535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:27.531543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:27.531547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:27.531550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:27.532055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:27.532084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:27.532095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:27.532099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:27.532102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:27.532105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:27.532541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:27.532562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:27.532569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:27.532577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:27.532580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:27.532584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:27.533084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:27.533109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:27.533114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:27.534196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:27.534218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:27.534223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:27.534230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:27.534239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392807533
2025-10-02T08:13:27.534543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:27.534564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:27.534570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:27.534572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:27.534577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:27.534580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:27.535011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:27.535033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:27.535039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:27.535042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:27.535044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:27.535047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:27.535459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:27.535478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.535560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392807535
2025-10-02T08:13:27.541482Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:27.541513Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:27.541520Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:27.541527Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:27.541537Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:27.541539Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:27.541541Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:27.541548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534568281665212:12183]
2025-10-02T08:13:27.541556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534568281665212:12183]
2025-10-02T08:13:27.541613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:27.541636Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:27.548184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:27.548219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.548222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:27.548382Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:27.578411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534568281665322:6945]
2025-10-02T08:13:27.578532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1745, pipe: [1:7556534568281665322:6945]
2025-10-02T08:13:27.676218Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:27.676522Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:27.676529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:27.676537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534568281665212:12183]
2025-10-02T08:13:27.676600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281665322:6945], now have 1 active actors on pipe
2025-10-02T08:13:27.676600Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:27.676728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:27.676741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:27.676764Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:27.676771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1746 reason: error at write: Disconnected sessionId: src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0
2025-10-02T08:13:27.676894Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:27.676951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1746 sessionId: src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0 is DEAD
2025-10-02T08:13:27.677005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534568281665322:6945]
2025-10-02T08:13:27.677114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:27.677122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0] Write session will restart in 0.007337s
2025-10-02T08:13:27.677146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0] Write session: Do CDS request
2025-10-02T08:13:27.677153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:27.681612Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1745:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:27.681613Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7b50e449acf70b1e] Result# TEvPutResult {Id# [72075186224037892:1745:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:27.681682Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1745:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:27.685226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.685320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:27.685335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1747
2025-10-02T08:13:27.685449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.685474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:27.685478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:27.685482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:27.686057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1747 sessionId:  describe result for acl check
2025-10-02T08:13:27.686079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:27.686081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:27.686082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:27.686088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534568281665408:12117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:27.687370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534568281665408:12117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:27.687957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:27.688755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:27.688929Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:27.688943Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:27.688951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:27.688994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:27.689029Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534568281665448:12122]
2025-10-02T08:13:27.689507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534568281665408:12117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:27.689720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:27.689930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:27.689992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:27.690319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:27.690384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.690391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.690392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.690393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.690395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.690401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.690411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.690414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.690418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.690422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.690428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.690436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.690447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.690457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.690466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.690475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.690480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.690490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.690495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.690500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.690521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:27.695811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534568281665408:12117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:27.695831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534568281665408:12117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:27.695838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534568281665408:12117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:27.695846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:27.698950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:27.700434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:27.700452Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:27.700457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:27.700461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:27.700468Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1746 [1:7556534568281665448:12122]
2025-10-02T08:13:27.700479Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:27.700497Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:27.700500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.700504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.700506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.700523Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:27.700529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:27.700535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:27.700601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.700608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.700612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:27.700615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:27.700678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:27.700685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.700699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.700712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:27.700731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534568281665429:12122]
2025-10-02T08:13:27.700741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534568281665429:12122]
2025-10-02T08:13:27.700748Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:27.700763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:27.700773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:27.700777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:27.700778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1746
2025-10-02T08:13:27.700782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:27.700784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:27.700794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281665476:12117], now have 1 active actors on pipe
2025-10-02T08:13:27.700797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534568741381155:2378], now have 1 active actors on pipe
2025-10-02T08:13:27.700848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.700859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.700872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534568281665429:12122]
2025-10-02T08:13:27.700880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:27.700887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:27.700904Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5aea93c9-286c00d3-837e23c3-fde28268_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:27.700914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.700917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.700920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:27.700893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1746
2025-10-02T08:13:27.700928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.700941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:27.700967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.701032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.701040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.701052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.701091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1747 partition: 0 MaxSeqNo: 17 sessionId: src_id|5aea93c9-286c00d3-837e23c3-fde28268_0
2025-10-02T08:13:27.701398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc23356b-ad3c9aa-37068fbb-f82bda8c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5aea93c9-286c00d3-837e23c3-fde28268_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:27.704088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aea93c9-286c00d3-837e23c3-fde28268_0] Write session: try to update token
2025-10-02T08:13:27.704103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aea93c9-286c00d3-837e23c3-fde28268_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:27.718532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId: src_id|5aea93c9-286c00d3-837e23c3-fde28268_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:27.721011Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:27.721032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:27.721033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:27.721042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534568281665429:12122]
2025-10-02T08:13:27.721045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534568281665429:12122]
2025-10-02T08:13:27.721083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:27.721087Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:27.721093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.721093Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:27.721095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:27.721227Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:27.721464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:27.777110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534568281665491:6945]
2025-10-02T08:13:27.777260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1746, pipe: [1:7556534568281665491:6945]
2025-10-02T08:13:27.858998Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:27.859466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.859479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.859512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281665491:6945], now have 1 active actors on pipe
2025-10-02T08:13:27.859704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:27.859717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:27.859718Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:27.859782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1747 reason: error at write: Disconnected sessionId: src_id|5aea93c9-286c00d3-837e23c3-fde28268_0
2025-10-02T08:13:27.859940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534568281665491:6945]
2025-10-02T08:13:27.859949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1747 sessionId: src_id|5aea93c9-286c00d3-837e23c3-fde28268_0 is DEAD
2025-10-02T08:13:27.863134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aea93c9-286c00d3-837e23c3-fde28268_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:27.863148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aea93c9-286c00d3-837e23c3-fde28268_0] Write session will restart in 0.006349s
2025-10-02T08:13:27.863173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aea93c9-286c00d3-837e23c3-fde28268_0] Write session: Do CDS request
2025-10-02T08:13:27.863180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aea93c9-286c00d3-837e23c3-fde28268_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:27.859994Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:27.869645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:27.870302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aea93c9-286c00d3-837e23c3-fde28268_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.870384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:27.870397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1748
2025-10-02T08:13:27.870520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:27.870552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:27.870560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:27.870563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:27.870710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:27.870845Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:27.870854Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:27.870863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:27.870907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:27.870924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1748 sessionId:  describe result for acl check
2025-10-02T08:13:27.870947Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534568281665583:12099]
2025-10-02T08:13:27.870966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:27.870972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:27.870973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:27.870978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534568281665586:12103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:27.871368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:27.871503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534568281665586:12103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:27.871503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:27.871527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:27.871717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:27.871747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.871751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.871752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.871752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.871753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.871756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.871764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.871767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.871771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.871774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.871778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.871785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:27.871790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.871794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:27.871798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.871803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:27.871807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.871812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.871816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.871821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.871837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:27.873861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534568281665586:12103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:27.879058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534568281665586:12103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:27.879071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534568281665586:12103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:27.879074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534568281665586:12103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:27.879080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:27.879534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:27.881120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:27.881135Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:27.881137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:27.881140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:27.881144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1747 [1:7556534568281665583:12099]
2025-10-02T08:13:27.881152Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:27.881165Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:27.881167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.881169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.881171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.881182Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:27.881189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:27.881194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:27.881240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.881245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.881247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:27.881249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:27.881299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:27.881304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.881313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:27.881324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:27.881339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281665629:12103], now have 1 active actors on pipe
2025-10-02T08:13:27.881347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534568281665574:12099]
2025-10-02T08:13:27.881348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534568281665574:12099]
2025-10-02T08:13:27.881351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1747
2025-10-02T08:13:27.881355Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:27.881364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534568741381164:2378], now have 1 active actors on pipe
2025-10-02T08:13:27.881366Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:27.881368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:27.881371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:27.881380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:27.881381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:27.881386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.881388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.881419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534568281665574:12099]
2025-10-02T08:13:27.881430Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:27.881444Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:27.881452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:27.881455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:27.881456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:27.881461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:27.881463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:27.881470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:27.881495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.881492Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1747
2025-10-02T08:13:27.881564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:27.881582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:27.881613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:27.881651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1748 partition: 0 MaxSeqNo: 17 sessionId: src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0
2025-10-02T08:13:27.882304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aea93c9-286c00d3-837e23c3-fde28268_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:27.885315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0] Write session: try to update token
2025-10-02T08:13:27.885335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:27.901993Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:27.902016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:27.902017Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:27.902024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534568281665574:12099]
2025-10-02T08:13:27.902027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534568281665574:12099]
2025-10-02T08:13:27.902070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:27.902074Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:27.902080Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:27.902082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:27.902084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:27.902214Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:27.903568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId: src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:27.906222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:27.959928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534568281665643:6945]
2025-10-02T08:13:27.960045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1747, pipe: [1:7556534568281665643:6945]
2025-10-02T08:13:28.034844Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:28.035169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.035185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.035224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534568281665643:6945], now have 1 active actors on pipe
2025-10-02T08:13:28.035330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534568281665643:6945]
2025-10-02T08:13:28.035359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:28.035361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:28.035416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1748 reason: error at write: Disconnected sessionId: src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0
2025-10-02T08:13:28.035452Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:28.035549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1748 sessionId: src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0 is DEAD
2025-10-02T08:13:28.035741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:28.035753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0] Write session will restart in 0.007308s
2025-10-02T08:13:28.035775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0] Write session: Do CDS request
2025-10-02T08:13:28.035785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:28.035775Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:28.041133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:28.041880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:28.042033Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:28.042043Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:28.042052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:28.042088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:28.042125Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534572576633033:12087]
2025-10-02T08:13:28.042773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:28.042946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:28.042984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:28.043276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:28.043312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.043317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.043319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.043319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.043320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.043325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.043334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.043337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.043341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.043344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.043349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.043355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.043362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.043367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.043371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.043376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.043379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.043384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.043388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.043393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.043408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:28.044463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.044528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:28.044538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1749
2025-10-02T08:13:28.044699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.044727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:28.044735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:28.044738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:28.045136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1749 sessionId:  describe result for acl check
2025-10-02T08:13:28.045175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:28.045180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:28.045182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:28.045187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534572576633049:12083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:28.045657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534572576633049:12083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:28.047798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534572576633049:12083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:28.050947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534572576633049:12083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:28.050968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534572576633049:12083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:28.050972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534572576633049:12083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:28.050980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:28.051511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:28.052942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:28.052954Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:28.052956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:28.052959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:28.052964Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1748 [1:7556534572576633033:12087]
2025-10-02T08:13:28.052972Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:28.052985Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:28.052988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.052991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.052993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.053011Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:28.053016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:28.053023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:28.053086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.053097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.053100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:28.053102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:28.053165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:28.053172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.053184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.053200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:28.053221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633080:12083], now have 1 active actors on pipe
2025-10-02T08:13:28.053224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1748
2025-10-02T08:13:28.053231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534573036348467:2378], now have 1 active actors on pipe
2025-10-02T08:13:28.053238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534572576633027:12087]
2025-10-02T08:13:28.053240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534572576633027:12087]
2025-10-02T08:13:28.053249Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:28.053258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.053259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:28.053261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:28.053262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.053278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:28.053293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:28.053295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:28.053295Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1748
2025-10-02T08:13:28.053338Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:28.053348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.053351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.053354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:28.053362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.053369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:28.053381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534572576633027:12087]
2025-10-02T08:13:28.053387Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:28.053393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:28.053416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.053512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.053524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.053549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.053599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1749 partition: 0 MaxSeqNo: 17 sessionId: src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0
2025-10-02T08:13:28.053934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c459dfee-f56f8ed4-89664ac3-2d6e57a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:28.056637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0] Write session: try to update token
2025-10-02T08:13:28.056654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:28.070620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId: src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:28.070823Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:28.070841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.070843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:28.070852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534572576633027:12087]
2025-10-02T08:13:28.070856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534572576633027:12087]
2025-10-02T08:13:28.070901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:28.070913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.070915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:28.071058Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:28.072856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:28.072871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:28.073213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:28.135515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534572576633096:6945]
2025-10-02T08:13:28.135621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1748, pipe: [1:7556534572576633096:6945]
2025-10-02T08:13:28.224997Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:28.225372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.225389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.225429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633096:6945], now have 1 active actors on pipe
2025-10-02T08:13:28.225556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534572576633096:6945]
2025-10-02T08:13:28.225627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:28.225634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:28.225689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1749 reason: error at write: Disconnected sessionId: src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0
2025-10-02T08:13:28.225669Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:28.225843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1749 sessionId: src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0 is DEAD
2025-10-02T08:13:28.225995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:28.226005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0] Write session will restart in 0.005178s
2025-10-02T08:13:28.226028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0] Write session: Do CDS request
2025-10-02T08:13:28.226037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:28.226179Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:28.231832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:28.232262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.232357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:28.232369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1750
2025-10-02T08:13:28.232475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.232506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:28.232515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:28.232518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:28.232818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:28.232971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1750 sessionId:  describe result for acl check
2025-10-02T08:13:28.232986Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:28.232991Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:28.233006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:28.233007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:28.233009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:28.233010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:28.233014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534572576633190:12065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:28.233064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:28.233107Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534572576633189:12078]
2025-10-02T08:13:28.233494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534572576633190:12065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:28.233730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:28.233926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:28.233973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:28.234278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:28.234331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.234337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.234338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.234339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.234340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.234346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.234355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.234359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.234363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.234366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.234371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.234378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.234383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.234389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.234397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.234403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.234411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.234416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.234420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.234425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.234442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:28.236060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534572576633190:12065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:28.241638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534572576633190:12065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:28.241658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534572576633190:12065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:28.241662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534572576633190:12065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:28.241671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:28.242708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:28.244273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:28.244290Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:28.244293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:28.244297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:28.244304Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1749 [1:7556534572576633189:12078]
2025-10-02T08:13:28.244317Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:28.244333Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:28.244336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.244339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.244341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.244359Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:28.244364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:28.244371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:28.244433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.244442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.244446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:28.244448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:28.244511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:28.244519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.244532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.244546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1749
2025-10-02T08:13:28.244550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:28.244569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633236:12065], now have 1 active actors on pipe
2025-10-02T08:13:28.244577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534573036348475:2378], now have 1 active actors on pipe
2025-10-02T08:13:28.244581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.244585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.244600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534572576633181:12078]
2025-10-02T08:13:28.244607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534572576633181:12078]
2025-10-02T08:13:28.244619Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:28.244631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:28.244634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:28.244636Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:28.244650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:28.244654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:28.244669Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:28.244680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.244683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.244685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:28.244634Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1749
2025-10-02T08:13:28.244694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.244709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:28.244745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534572576633181:12078]
2025-10-02T08:13:28.244757Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:28.244765Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:28.244774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.244904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.244913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.244926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.244965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1750 partition: 0 MaxSeqNo: 17 sessionId: src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0
2025-10-02T08:13:28.245310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0292a3e-fe89cf0-28ff9bee-11696ce0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:28.247972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0] Write session: try to update token
2025-10-02T08:13:28.247989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:28.263012Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:28.263037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.263040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:28.263049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534572576633181:12078]
2025-10-02T08:13:28.263054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534572576633181:12078]
2025-10-02T08:13:28.263097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:28.263096Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:28.263102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:28.263110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.263113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:28.263251Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:28.263476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId: src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:28.266167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:28.325955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534572576633251:6945]
2025-10-02T08:13:28.326124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1749, pipe: [1:7556534572576633251:6945]
2025-10-02T08:13:28.391403Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:28.391751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.391764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.391799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633251:6945], now have 1 active actors on pipe
2025-10-02T08:13:28.391941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534572576633251:6945]
2025-10-02T08:13:28.391968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:28.391971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:28.392022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1750 reason: error at write: Disconnected sessionId: src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0
2025-10-02T08:13:28.392056Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:28.392209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1750 sessionId: src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0 is DEAD
2025-10-02T08:13:28.392350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:28.392359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0] Write session will restart in 0.006849s
2025-10-02T08:13:28.392378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0] Write session: Do CDS request
2025-10-02T08:13:28.392385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:28.392777Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:28.397473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:28.398155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:28.398335Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:28.398345Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:28.398354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:28.398400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:28.398438Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534572576633345:12056]
2025-10-02T08:13:28.399033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:28.399212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:28.399248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:28.399519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:28.399565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.399570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.399571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.399572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.399573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.399577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.399586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.399589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.399591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.399594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.399599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.399605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.399611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.399615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.399619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.399622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.399626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.399632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.399636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.399640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.399655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:28.400242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.400375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:28.400384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1751
2025-10-02T08:13:28.400508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.400534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:28.400543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:28.400546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:28.400943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1751 sessionId:  describe result for acl check
2025-10-02T08:13:28.400972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:28.400977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:28.400978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:28.400981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534572576633361:12052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:28.401360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534572576633361:12052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:28.402995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534572576633361:12052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:28.406480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534572576633361:12052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:28.406494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534572576633361:12052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:28.406497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534572576633361:12052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:28.406505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:28.406969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:28.408366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:28.408379Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:28.408381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:28.408383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:28.408387Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1750 [1:7556534572576633345:12056]
2025-10-02T08:13:28.408394Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:28.408409Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:28.408412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.408415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.408420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.408433Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:28.408442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:28.408447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:28.408494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.408499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.408501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:28.408503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:28.408598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:28.408603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.408608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1750
2025-10-02T08:13:28.408614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.408625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:28.408644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633394:12052], now have 1 active actors on pipe
2025-10-02T08:13:28.408650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534573036348482:2378], now have 1 active actors on pipe
2025-10-02T08:13:28.408654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.408657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.408672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534572576633339:12056]
2025-10-02T08:13:28.408678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534572576633339:12056]
2025-10-02T08:13:28.408684Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:28.408695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:28.408698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:28.408700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:28.408712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:28.408713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:28.408675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1750
2025-10-02T08:13:28.408724Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:28.408732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.408737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.408738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:28.408745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.408755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:28.408793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534572576633339:12056]
2025-10-02T08:13:28.408820Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:28.408824Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:28.408834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.408880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.408886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.408897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.408930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1751 partition: 0 MaxSeqNo: 17 sessionId: src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0
2025-10-02T08:13:28.409214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a146a17f-bb825c4b-f3c6c0cb-6c64a499_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:28.411650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0] Write session: try to update token
2025-10-02T08:13:28.411664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:28.419386Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:28.419404Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.419412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534572576633339:12056]
2025-10-02T08:13:28.419447Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:28.419454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:28.419622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:28.419768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.419912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.420056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.420273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:28.420311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:28.425252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId: src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:28.427725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:28.427788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.427800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.427827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:28.427847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:28.427896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.427910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.428074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.428130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.428184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.428252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.428344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.428352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.428426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.428482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.428538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.428596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.428635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.428640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.428701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.428756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.428851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.428906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.428948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.428955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.429019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.429078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.429150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.429213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.429258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.429263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.429335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.429397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.429461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.429561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.429607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.429612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.429680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.429737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.429802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.429871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.429918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.429923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.429992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.430059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.430136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.430204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.430249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.430254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.430323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.430390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.430455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.430520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.430567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.430572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.430641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.430694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.430749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.430804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.430850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.430859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.430929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.430986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.431041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.431105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.431156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.431164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.431195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:28.431244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.431262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.431266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:28.431291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:28.431304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:28.431307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:28.431309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:28.431311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:28.431657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:28.431678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:28.431683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:28.431685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:28.431687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:28.431689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:28.432353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:28.432378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:28.432384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:28.432387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:28.432390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:28.432393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:28.432854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:28.432874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:28.432880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:28.432890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:28.432898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:28.433986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:28.434001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:28.434018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392808433
2025-10-02T08:13:28.434180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:28.434189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:28.434193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:28.434198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:28.434200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:28.434202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:28.434639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:28.434657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:28.434664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:28.434668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:28.434671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:28.434672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:28.435082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:28.435098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:28.435104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:28.435110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:28.435112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:28.435114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:28.435521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:28.435541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:28.435546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:28.436559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:28.436575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:28.436580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:28.436583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:28.436594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392808436
2025-10-02T08:13:28.436857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:28.436871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:28.436877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:28.436882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:28.436884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:28.436886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:28.437283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:28.437301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:28.437309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:28.437312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:28.437314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:28.437316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:28.437729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:28.437746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.437818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392808437
2025-10-02T08:13:28.438501Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:28.438520Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:28.438528Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:28.438537Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:28.440066Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:28.440078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.440079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:28.440087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534572576633339:12056]
2025-10-02T08:13:28.440089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534572576633339:12056]
2025-10-02T08:13:28.440123Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:28.440135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:28.440135Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:28.440141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.440142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:28.440277Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:28.492381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534572576633417:6945]
2025-10-02T08:13:28.492511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1750, pipe: [1:7556534572576633417:6945]
2025-10-02T08:13:28.578621Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:28.578909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633417:6945], now have 1 active actors on pipe
2025-10-02T08:13:28.579015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534572576633417:6945]
2025-10-02T08:13:28.579031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:28.579033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:28.579052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1751 reason: error at write: Disconnected sessionId: src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0
2025-10-02T08:13:28.579087Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:28.579104Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:28.579214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1751 sessionId: src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0 is DEAD
2025-10-02T08:13:28.579352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:28.579361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0] Write session will restart in 0.006432s
2025-10-02T08:13:28.579379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0] Write session: Do CDS request
2025-10-02T08:13:28.579384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:28.584377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:28.585012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:28.585156Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:28.585164Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:28.585170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:28.585205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:28.585232Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534572576633556:12029]
2025-10-02T08:13:28.585660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:28.585803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:28.585834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:28.586058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:28.586106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.586112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.586113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.586114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.586114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.586118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.586124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.586126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.586129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.586131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.586134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.586142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.586145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.586148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.586151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.586154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.586156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.586161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.586165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.586170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.586188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:28.587198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.587308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:28.587321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1752
2025-10-02T08:13:28.587417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.587438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:28.587441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:28.587444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:28.587762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1752 sessionId:  describe result for acl check
2025-10-02T08:13:28.587791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:28.587796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:28.587797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:28.587801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534572576633572:12024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:28.588162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534572576633572:12024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:28.589911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534572576633572:12024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:28.593698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534572576633572:12024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:28.593710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534572576633572:12024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:28.593712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534572576633572:12024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:28.593718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:28.594238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:28.595707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:28.595720Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:28.595722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:28.595724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:28.595728Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1751 [1:7556534572576633556:12029]
2025-10-02T08:13:28.595735Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:28.595747Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:28.595749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.595751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.595752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.595765Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:28.595769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:28.595776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:28.595823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.595829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.595830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:28.595832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:28.595877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:28.595882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.595892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.595904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:28.595915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1751
2025-10-02T08:13:28.595925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633601:12024], now have 1 active actors on pipe
2025-10-02T08:13:28.595933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534573036348501:2378], now have 1 active actors on pipe
2025-10-02T08:13:28.595940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534572576633550:12029]
2025-10-02T08:13:28.595941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534572576633550:12029]
2025-10-02T08:13:28.595951Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:28.595963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:28.595964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.595967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.595971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:28.595982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:28.595992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:28.595998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:28.595976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1751
2025-10-02T08:13:28.596027Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:28.596034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.596039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.596040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:28.596046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.596051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:28.596059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534572576633550:12029]
2025-10-02T08:13:28.596066Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:28.596076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:28.596082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.596151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.596159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.596172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.596212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1752 partition: 0 MaxSeqNo: 17 sessionId: src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0
2025-10-02T08:13:28.596461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59530b5a-7e5ee5e3-6b7ea2a6-f1e57c31_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:28.598990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0] Write session: try to update token
2025-10-02T08:13:28.599001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:28.606583Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:28.606598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.606609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534572576633550:12029]
2025-10-02T08:13:28.606646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:28.606673Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:28.606806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:28.606948Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.607091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.607231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.607416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:28.607451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:28.611649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId: src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:28.614239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:28.614300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.614311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.614341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:28.614365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:28.614403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.614417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.614547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.614601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.614661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.614727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.614864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.614874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.614947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.615014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.615072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.615131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.615171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.615177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.615235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.615287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.615341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.615405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.615446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.615451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.615516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.615578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.615642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.615707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.615753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.615763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.615829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.615888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.615950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.616014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.616061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.616066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.616134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.616208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.616274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.616338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.616387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.616392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.616460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.616519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.616587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.616653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.616703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.616711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.616792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.616880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.616944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.617009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.617056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.617061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.617130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.617183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.617239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.617296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.617346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.617351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.617417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.617476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.617535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.617599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.617651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.617657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.617686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:28.617731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.617746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.617751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:28.617775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:28.617787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:28.617793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:28.617795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:28.617797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:28.618152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:28.618172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:28.618176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:28.618178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:28.618180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:28.618181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:28.618661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:28.618676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:28.618680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:28.618682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:28.618683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:28.618686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:28.619101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:28.619118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:28.619122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:28.619124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:28.619126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:28.620212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:28.620227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:28.620234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392808619
2025-10-02T08:13:28.620329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:28.620338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:28.620340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:28.620342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:28.620345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:28.620346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:28.620762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:28.620781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:28.620784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:28.620786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:28.620788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:28.620791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:28.621212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:28.621230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:28.621236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:28.621240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:28.621245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:28.621247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:28.621641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:28.621658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:28.621664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:28.622655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:28.622670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:28.622673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:28.622675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:28.622680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392808622
2025-10-02T08:13:28.622924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:28.622941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:28.622945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:28.622947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:28.622949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:28.622950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:28.623354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:28.623373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:28.623376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:28.623379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:28.623380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:28.623383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:28.623772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:28.623789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.623863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392808623
2025-10-02T08:13:28.624627Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:28.624642Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:28.624645Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:28.624649Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:28.626224Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:28.626237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.626238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:28.626244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534572576633550:12029]
2025-10-02T08:13:28.626250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534572576633550:12029]
2025-10-02T08:13:28.626293Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:28.626305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:28.626308Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:28.626308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.626309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:28.626430Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:28.679212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534572576633634:6945]
2025-10-02T08:13:28.679327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1751, pipe: [1:7556534572576633634:6945]
2025-10-02T08:13:28.758348Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:28.758810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633634:6945], now have 1 active actors on pipe
2025-10-02T08:13:28.758997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534572576633634:6945]
2025-10-02T08:13:28.759020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:28.759022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:28.759047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1752 reason: error at write: Disconnected sessionId: src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0
2025-10-02T08:13:28.759150Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:28.759241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1752 sessionId: src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0 is DEAD
2025-10-02T08:13:28.760892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:28.760906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0] Write session will restart in 0.008322s
2025-10-02T08:13:28.760933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0] Write session: Do CDS request
2025-10-02T08:13:28.760939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:28.762708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:28.767390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:28.768531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:28.768759Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:28.768768Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:28.768778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:28.768852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:28.768911Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534572576633734:12000]
2025-10-02T08:13:28.769598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:28.769790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:28.769838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:28.770194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:28.770241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.770249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.770250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.770251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.770252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.770257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.770267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.770271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.770275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.770278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.770285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.770293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.770298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.770303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.770307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.770315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.770319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.770324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.770329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.770334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.770354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:28.770330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.770394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:28.770404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1753
2025-10-02T08:13:28.770590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.770629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:28.770634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:28.770638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:28.771211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1753 sessionId:  describe result for acl check
2025-10-02T08:13:28.771246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:28.771252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:28.771254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:28.771259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534572576633750:12004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:28.771784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534572576633750:12004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:28.774148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534572576633750:12004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:28.779009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534572576633750:12004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:28.779033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534572576633750:12004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:28.779039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534572576633750:12004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:28.779061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:28.779459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:28.781143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:28.781160Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:28.781163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:28.781166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:28.781173Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1752 [1:7556534572576633734:12000]
2025-10-02T08:13:28.781184Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:28.781201Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:28.781205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.781211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.781213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.781227Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:28.781239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:28.781245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:28.781311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.781317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.781322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:28.781324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:28.781390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:28.781398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.781410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.781422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:28.781440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633782:12004], now have 1 active actors on pipe
2025-10-02T08:13:28.781451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534572576633728:12000]
2025-10-02T08:13:28.781457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534572576633728:12000]
2025-10-02T08:13:28.781469Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:28.781481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534573036348532:2378], now have 1 active actors on pipe
2025-10-02T08:13:28.781487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:28.781491Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:28.781491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:28.781506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:28.781510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:28.781542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534572576633728:12000]
2025-10-02T08:13:28.781554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:28.781565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:28.781597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1752
2025-10-02T08:13:28.781603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.781613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.781636Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:28.781646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.781650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.781655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:28.781663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.781673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:28.781689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.781721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.781726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.781737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.781909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1752
2025-10-02T08:13:28.781770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1753 partition: 0 MaxSeqNo: 17 sessionId: src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0
2025-10-02T08:13:28.782171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d83dc-8d13b62c-d9d15f36-201dca56_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:28.785003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0] Write session: try to update token
2025-10-02T08:13:28.785019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:28.793916Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:28.793938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.793948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534572576633728:12000]
2025-10-02T08:13:28.793992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:28.794009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:28.794184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:28.794336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.794494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.794681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.794886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:28.794932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:28.799935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId: src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:28.802774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:28.802854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.802866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.802895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:28.802915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:28.803031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.803049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.803241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.803324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.803407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.803487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.803542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.803556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.803639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.803716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.803803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.803883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.803946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.803956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.804042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.804113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.804204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.804283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.804335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.804343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.804419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.804499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.804581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.804667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.804726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.804736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.804846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.804932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.805019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.805104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.805170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.805179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.805268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.805348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.805430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.805517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.805575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.805583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.805675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.805755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.805842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.805926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.805983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.805992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.806079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.806160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.806249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.806334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.806402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.806409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.806497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.806570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.806644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.806719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.806777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.806785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.806871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.806951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.807025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.807104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.807169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.807177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.807222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:28.807302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.807328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.807335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:28.807368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:28.807386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:28.807393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:28.807396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:28.807399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:28.807875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:28.807905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:28.807916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:28.807920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:28.807925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:28.807928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:28.808529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:28.808555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:28.808563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:28.808566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:28.808570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:28.808573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:28.809217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:28.809248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:28.809255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:28.809263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:28.809267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:28.810682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:28.810703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:28.810715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392808810
2025-10-02T08:13:28.810844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:28.810858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:28.810863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:28.810867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:28.810871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:28.810875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:28.811421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:28.811445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:28.811451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:28.811455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:28.811458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:28.811461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:28.811999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:28.812024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:28.812032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:28.812036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:28.812045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:28.812048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:28.812594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:28.812619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:28.812625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:28.814035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:28.814056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:28.814062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:28.814065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:28.814076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392808813
2025-10-02T08:13:28.814470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:28.814498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:28.814505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:28.814508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:28.814513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:28.814518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:28.814988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:28.815008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:28.815012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:28.815014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:28.815017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:28.815019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:28.815492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:28.815511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.815586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392808815
2025-10-02T08:13:28.816370Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:28.816393Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:28.816397Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:28.816401Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:28.818140Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:28.818157Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.818159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:28.818166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534572576633728:12000]
2025-10-02T08:13:28.818169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534572576633728:12000]
2025-10-02T08:13:28.818225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:28.818224Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:28.818230Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:28.818233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.818235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:28.818370Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:28.853842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534572576633806:6945]
2025-10-02T08:13:28.853989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1752, pipe: [1:7556534572576633806:6945]
2025-10-02T08:13:28.949429Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:28.949769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633806:6945], now have 1 active actors on pipe
2025-10-02T08:13:28.949882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534572576633806:6945]
2025-10-02T08:13:28.949907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:28.949909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:28.949930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1753 reason: error at write: Disconnected sessionId: src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0
2025-10-02T08:13:28.949939Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:28.949995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:28.950050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1753 sessionId: src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0 is DEAD
2025-10-02T08:13:28.950204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:28.950214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0] Write session will restart in 0.008585s
2025-10-02T08:13:28.950236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0] Write session: Do CDS request
2025-10-02T08:13:28.950242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:28.955573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:28.956316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:28.956477Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:28.956487Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:28.956498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:28.956547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:28.956583Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534572576633908:11997]
2025-10-02T08:13:28.957051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:28.957203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:28.957239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:28.957440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:28.957473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.957477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.957479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.957479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.957480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.957485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.957495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.957502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.957506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.957513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.957518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.957526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:28.957534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.957539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:28.957548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.957552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:28.957557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.957565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.957569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.957577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.957594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:28.960220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.960295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:28.960306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1754
2025-10-02T08:13:28.960409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:28.960444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:28.960452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:28.960455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:28.961021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1754 sessionId:  describe result for acl check
2025-10-02T08:13:28.961053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:28.961058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:28.961059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:28.961063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534572576633924:11995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:28.961488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534572576633924:11995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:28.963376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534572576633924:11995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:28.965169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:28.965639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534572576633924:11995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:28.965651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534572576633924:11995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:28.965654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534572576633924:11995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:28.965662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:28.966620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:28.966636Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:28.966638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:28.966641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:28.966647Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1753 [1:7556534572576633908:11997]
2025-10-02T08:13:28.966656Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:28.966670Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:28.966673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.966675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.966678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.966692Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:28.966702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:28.966707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:28.966763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.966770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.966773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:28.966776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:28.966830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:28.966837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.966849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:28.966865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:28.966874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1753
2025-10-02T08:13:28.966885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534572576633954:11995], now have 1 active actors on pipe
2025-10-02T08:13:28.966892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534573036348541:2378], now have 1 active actors on pipe
2025-10-02T08:13:28.966897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534572576633902:11997]
2025-10-02T08:13:28.966903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534572576633902:11997]
2025-10-02T08:13:28.966915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:28.966926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.966929Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:28.966932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:28.966934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.966950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:28.966967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:28.966934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1753
2025-10-02T08:13:28.966973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:28.967006Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:28.967016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.967019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.967021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:28.967029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.967040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:28.967055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534572576633902:11997]
2025-10-02T08:13:28.967065Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:28.967076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:28.967090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.967160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.967167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.967179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:28.967212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1754 partition: 0 MaxSeqNo: 17 sessionId: src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0
2025-10-02T08:13:28.967510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73e3bb9-80157b37-d75ca8a0-21641a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:28.969989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0] Write session: try to update token
2025-10-02T08:13:28.970002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:28.978760Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:28.978781Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.978788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534572576633902:11997]
2025-10-02T08:13:28.978824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:28.978826Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:28.978981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:28.979113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.979252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.979387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:28.979584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:28.979629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:28.983132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId: src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:28.985717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:28.985795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.985808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.985837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:28.985859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:28.985919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:28.985933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:28.986071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.986124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.986179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.986249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.986533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.986542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.986602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.986657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.986712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.986768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.986811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.986817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.986875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.986928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.986982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.987035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.987077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.987083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.987142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.987201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.987266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.987338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.987394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.987404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.987481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.987549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.987620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.987685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.987732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.987737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.987807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.987867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.987930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.988006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.988071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.988077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.988149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.988222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.988289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.988355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.988401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.988406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.988475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.988534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.988610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.988686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.988738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.988745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.988840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.988903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.988968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.989032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.989087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.989094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.989173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:28.989243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:28.989310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:28.989377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:28.989429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:28.989437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:28.989478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:28.989544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:28.989567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:28.989574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:28.989604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:28.989621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:28.989628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:28.989631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:28.989638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:28.990077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:28.990108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:28.990121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:28.990129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:28.990132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:28.990135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:28.990720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:28.990750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:28.990760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:28.990763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:28.990767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:28.990774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:28.991271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:28.991296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:28.991301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:28.991307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:28.991309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:28.992385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:28.992400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:28.992408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392808992
2025-10-02T08:13:28.992523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:28.992538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:28.992544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:28.992547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:28.992551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:28.992553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:28.992995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:28.993017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:28.993023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:28.993026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:28.993029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:28.993033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:28.993440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:28.993463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:28.993470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:28.993473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:28.993478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:28.993482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:28.993903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:28.993925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:28.993930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:28.994964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:28.994981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:28.994986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:28.994991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:28.995002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392808994
2025-10-02T08:13:28.995285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:28.995304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:28.995310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:28.995313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:28.995319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:28.995322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:28.995736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:28.995761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:28.995766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:28.995770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:28.995773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:28.995775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:28.996225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:28.996241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:28.996315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392808996
2025-10-02T08:13:28.996996Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:28.997011Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:28.997015Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:28.997018Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:28.998499Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:28.998512Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:28.998513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:28.998520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534572576633902:11997]
2025-10-02T08:13:28.998522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534572576633902:11997]
2025-10-02T08:13:28.998571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:28.998567Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:28.998579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:28.998579Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:28.998580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:28.998710Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:29.049932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534576871601273:6945]
2025-10-02T08:13:29.050066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1753, pipe: [1:7556534576871601273:6945]
2025-10-02T08:13:29.132173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:29.132645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871601273:6945], now have 1 active actors on pipe
2025-10-02T08:13:29.132997Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:29.132900Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:29.133210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534576871601273:6945]
2025-10-02T08:13:29.133236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:29.133261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1754 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0
2025-10-02T08:13:29.133438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1754 sessionId: src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0 is DEAD
2025-10-02T08:13:29.136094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:29.136103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0] Write session will restart in 0.007453s
2025-10-02T08:13:29.136128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0] Write session: Do CDS request
2025-10-02T08:13:29.136135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:29.138434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:29.139146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:29.139298Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:29.139304Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:29.139311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:29.139352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:29.139380Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534576871601377:11992]
2025-10-02T08:13:29.139775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:29.139932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:29.139961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:29.140163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:29.140227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.140233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.140233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.140234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.140234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.140237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.140244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.140246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.140248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.140249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.140254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.140258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.140262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.140265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.140267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.140270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.140272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.140275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.140277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.140280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.140290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:29.144335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.144409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:29.144427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1755
2025-10-02T08:13:29.144588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.144629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:29.144639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:29.144644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:29.145109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1755 sessionId:  describe result for acl check
2025-10-02T08:13:29.145146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:29.145159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:29.145162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:29.145169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534576871601393:11989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:29.145653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534576871601393:11989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:29.147567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534576871601393:11989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:29.148059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:29.149535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:29.149554Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:29.149556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:29.149560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:29.149567Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1754 [1:7556534576871601377:11992]
2025-10-02T08:13:29.149577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:29.149596Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:29.149602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.149605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.149606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.149620Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:29.149625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:29.149630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:29.149685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.149694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.149696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:29.149698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:29.149762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:29.149769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.149780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.149794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:29.149813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534576871601371:11992]
2025-10-02T08:13:29.149819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534576871601371:11992]
2025-10-02T08:13:29.149827Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:29.149834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:29.149837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:29.149843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534577331315844:2378], now have 1 active actors on pipe
2025-10-02T08:13:29.149852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:29.149867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:29.149873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:29.149862Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1754
2025-10-02T08:13:29.149908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534576871601371:11992]
2025-10-02T08:13:29.149914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:29.149924Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:29.150012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534576871601393:11989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:29.150029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534576871601393:11989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:29.150033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534576871601393:11989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:29.150040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:29.150214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1754
2025-10-02T08:13:29.150228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871601430:11989], now have 1 active actors on pipe
2025-10-02T08:13:29.150232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.150236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.150258Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:29.150265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.150267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.150269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:29.150278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.150287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:29.150299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.150336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.150342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.150364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.150394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1755 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0
2025-10-02T08:13:29.150692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1fb5eff-a89e9cd9-f90d4178-baad81ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:29.153176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0] Write session: try to update token
2025-10-02T08:13:29.153190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:29.160289Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:29.160309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.160322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534576871601371:11992]
2025-10-02T08:13:29.160367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:29.160384Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:29.160547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:29.160703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.160854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.160980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.161234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:29.161284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:29.166675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId: src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:29.169384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:29.169461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.169475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.169518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:29.169546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:29.169592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.169610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.169801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.169868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.169943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.170014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.170067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.170077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.170148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.170213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.170279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.170356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.170407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.170414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.170482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.170541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.170601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.170663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.170705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.170713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.170778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.170843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.170916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.170992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.171046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.171053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.171131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.171198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.171276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.171346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.171397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.171404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.171489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.171565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.171646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.171727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.171788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.171794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.171887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.171963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.172046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.172131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.172183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.172205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.172282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.172350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.172429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.172505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.172558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.172565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.172643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.172711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.172773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.172858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.172910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.172917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.172990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.173056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.173116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.173181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.173232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.173243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.173281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:29.173346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.173367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.173374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:29.173404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:29.173423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:29.173429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:29.173432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:29.173437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:29.173828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:29.173855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:29.173861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:29.173865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:29.173867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:29.173870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:29.174345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:29.174367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:29.174372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:29.174375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:29.174379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:29.174381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:29.174871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:29.174894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:29.174899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:29.174907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:29.174912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:29.176170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:29.176199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:29.176211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392809175
2025-10-02T08:13:29.176437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:29.176451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:29.176456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:29.176460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:29.176464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:29.176468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:29.177003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:29.177023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:29.177029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:29.177032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:29.177035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:29.177040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:29.177521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:29.177544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:29.177552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:29.177559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:29.177564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:29.177567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:29.178018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:29.178039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:29.178045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:29.179196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:29.179211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:29.179216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:29.179218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:29.179226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392809178
2025-10-02T08:13:29.179508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:29.179526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:29.179532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:29.179539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:29.179542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:29.179547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:29.180002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:29.180022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:29.180026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:29.180029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:29.180032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:29.180049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:29.180516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:29.180536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.180626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392809180
2025-10-02T08:13:29.181396Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:29.181413Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:29.181420Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:29.181427Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:29.183048Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:29.183060Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.183062Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:29.183068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534576871601371:11992]
2025-10-02T08:13:29.183073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534576871601371:11992]
2025-10-02T08:13:29.183127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:29.183133Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:29.183135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.183137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:29.183139Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:29.183271Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:29.232713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534576871601445:6945]
2025-10-02T08:13:29.232865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1754, pipe: [1:7556534576871601445:6945]
2025-10-02T08:13:29.314378Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:29.314709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871601445:6945], now have 1 active actors on pipe
2025-10-02T08:13:29.314813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534576871601445:6945]
2025-10-02T08:13:29.314840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:29.314842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:29.314869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1755 reason: error at write: Disconnected sessionId: src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0
2025-10-02T08:13:29.314898Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:29.314947Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:29.315120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1755 sessionId: src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0 is DEAD
2025-10-02T08:13:29.315180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:29.315192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0] Write session will restart in 0.008064s
2025-10-02T08:13:29.315214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0] Write session: Do CDS request
2025-10-02T08:13:29.315220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:29.321255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:29.322105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:29.322254Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:29.322262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:29.322268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:29.322299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:29.322328Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534576871601550:11978]
2025-10-02T08:13:29.322738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:29.322904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:29.322931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:29.323124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:29.323150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.323157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.323158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.323158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.323159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.323163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.323173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.323176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.323180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.323187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.323191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.323195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.323198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.323201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.323203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.323206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.323208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.323210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.323213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.323215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.323225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:29.324309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.324361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:29.324372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1756
2025-10-02T08:13:29.324531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.324574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:29.324584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:29.324587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:29.324999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1756 sessionId:  describe result for acl check
2025-10-02T08:13:29.325030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:29.325037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:29.325039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:29.325047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534576871601566:11974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:29.325529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534576871601566:11974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:29.328109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534576871601566:11974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:29.330795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534576871601566:11974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:29.330809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534576871601566:11974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:29.330812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534576871601566:11974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:29.330820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:29.331130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:29.332850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:29.332866Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:29.332869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:29.332872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:29.332878Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1755 [1:7556534576871601550:11978]
2025-10-02T08:13:29.332888Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:29.332905Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:29.332909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.332912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.332913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.332929Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:29.332940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:29.332951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:29.333015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.333022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.333025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:29.333028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:29.333087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:29.333094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.333107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.333123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:29.333138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1755
2025-10-02T08:13:29.333145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871601598:11974], now have 1 active actors on pipe
2025-10-02T08:13:29.333148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534577331315852:2378], now have 1 active actors on pipe
2025-10-02T08:13:29.333154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534576871601544:11978]
2025-10-02T08:13:29.333156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534576871601544:11978]
2025-10-02T08:13:29.333170Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:29.333183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.333189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.333206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:29.333222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:29.333228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:29.333239Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:29.333249Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:29.333269Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3530137e-9e791c-b4af3e10-d200c9fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:29.333280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.333287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.333289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:29.333297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.333309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:29.333320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534576871601544:11978]
2025-10-02T08:13:29.333218Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1755
2025-10-02T08:13:29.333333Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:29.333357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:29.333363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.333446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.333455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.333473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.333504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1756 partition: 0 MaxSeqNo: 17 sessionId: src_id|3530137e-9e791c-b4af3e10-d200c9fb_0
2025-10-02T08:13:29.333817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c7006bd-3c209bae-7858cdbf-6897bef8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3530137e-9e791c-b4af3e10-d200c9fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:29.336505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3530137e-9e791c-b4af3e10-d200c9fb_0] Write session: try to update token
2025-10-02T08:13:29.336519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3530137e-9e791c-b4af3e10-d200c9fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:29.350426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId: src_id|3530137e-9e791c-b4af3e10-d200c9fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:29.353335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:29.353438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.353453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.353492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:29.353516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:29.353559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.353575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.353756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.353833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.353911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.353975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.354120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.354131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.354199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.354259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.354327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.354392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.354435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.354442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.354511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.354572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.354634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.354695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.354741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.354748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.354830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.354902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.354971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.355049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.355103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.355111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.355189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.355263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.355338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.355421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.355494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.355502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.355583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.355659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.355747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.355823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.355876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.355883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.355960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.356031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.356113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.356188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.356255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.356265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.356342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.356418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.356495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.356575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.356635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.356643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.356722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.356789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.356889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.356967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.357027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.357037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.357112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.357182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.357247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.357319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.357372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.357379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.357446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:29.357509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.357531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.357538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:29.357567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:29.357583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:29.357586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:29.357588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:29.357591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:29.357993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:29.358026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:29.358035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:29.358038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:29.358041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:29.358044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:29.358520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:29.358546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:29.358551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:29.358555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:29.358557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:29.358561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:29.359195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:29.359220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:29.359226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:29.359229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:29.359232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:29.360506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:29.360527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:29.360537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392809360
2025-10-02T08:13:29.360654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:29.360672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:29.360677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:29.360680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:29.360683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:29.360686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:29.361180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:29.361202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:29.361207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:29.361211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:29.361214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:29.361217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:29.361770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:29.361793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:29.361799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:29.361802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:29.361806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:29.361809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:29.362335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:29.362365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:29.362371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:29.363492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:29.363513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:29.363518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:29.363523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:29.363534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392809363
2025-10-02T08:13:29.363847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:29.363871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:29.363876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:29.363884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:29.363888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:29.363890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:29.364400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:29.364424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:29.364429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:29.364432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:29.364435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:29.364439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:29.364934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:29.364955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.365054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392809364
2025-10-02T08:13:29.367336Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:29.367366Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:29.367371Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:29.367378Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:29.367386Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:29.367387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.367389Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:29.367393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534576871601544:11978]
2025-10-02T08:13:29.367396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534576871601544:11978]
2025-10-02T08:13:29.367450Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:29.367464Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:29.368336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:29.368351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.368352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:29.368484Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:29.414982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534576871601615:6945]
2025-10-02T08:13:29.415103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1755, pipe: [1:7556534576871601615:6945]
2025-10-02T08:13:29.505007Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:29.505390Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:29.505402Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.505411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534576871601544:11978]
2025-10-02T08:13:29.505477Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:29.505494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871601615:6945], now have 1 active actors on pipe
2025-10-02T08:13:29.505680Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:29.505738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534576871601615:6945]
2025-10-02T08:13:29.505769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:29.505800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1756 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3530137e-9e791c-b4af3e10-d200c9fb_0
2025-10-02T08:13:29.505775Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:29.506000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1756 sessionId: src_id|3530137e-9e791c-b4af3e10-d200c9fb_0 is DEAD
2025-10-02T08:13:29.506122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3530137e-9e791c-b4af3e10-d200c9fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:29.506136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3530137e-9e791c-b4af3e10-d200c9fb_0] Write session will restart in 0.005566s
2025-10-02T08:13:29.506167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3530137e-9e791c-b4af3e10-d200c9fb_0] Write session: Do CDS request
2025-10-02T08:13:29.506174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3530137e-9e791c-b4af3e10-d200c9fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:29.509758Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f9585b4440670c6a] Result# TEvPutResult {Id# [72075186224037892:1755:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:29.509805Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1755:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:29.509869Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1755:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:29.513167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3530137e-9e791c-b4af3e10-d200c9fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.513209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:29.513245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1757
2025-10-02T08:13:29.513338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.513367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:29.513379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:29.513382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:29.513790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1757 sessionId:  describe result for acl check
2025-10-02T08:13:29.513823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:29.513829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:29.513830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:29.513835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534576871601738:11951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:29.514067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:29.514301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534576871601738:11951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:29.514867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:29.515087Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:29.515102Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:29.515118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:29.515224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:29.515280Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534576871601759:11958]
2025-10-02T08:13:29.515888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:29.516000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534576871601738:11951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:29.516035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:29.516065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:29.516281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:29.516315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.516315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.516316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.516316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.516317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.516320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.516326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.516328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.516330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.516331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.516335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.516339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.516342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.516345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.516347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.516350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.516352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.516354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.516357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.516359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.516371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:29.522724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534576871601738:11951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:29.522745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534576871601738:11951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:29.522748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534576871601738:11951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:29.522756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:29.524557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:29.526118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:29.526135Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:29.526137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:29.526140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:29.526145Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1756 [1:7556534576871601759:11958]
2025-10-02T08:13:29.526154Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:29.526167Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:29.526169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.526171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.526173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.526186Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:29.526190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:29.526195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:29.527016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.527024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.527027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:29.527030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:29.527107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:29.527115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.527129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.527145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:29.527160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1756
2025-10-02T08:13:29.527167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871601790:11951], now have 1 active actors on pipe
2025-10-02T08:13:29.527170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534577331315871:2378], now have 1 active actors on pipe
2025-10-02T08:13:29.527177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534576871601739:11958]
2025-10-02T08:13:29.527179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534576871601739:11958]
2025-10-02T08:13:29.527188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:29.527198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.527199Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:29.527201Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:29.527203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.527221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:29.527242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:29.527245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:29.527236Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1756
2025-10-02T08:13:29.527289Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:29.527302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.527307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.527308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:29.527316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.527330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:29.527342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534576871601739:11958]
2025-10-02T08:13:29.527352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:29.527359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:29.527384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.527461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.527468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.527481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.527521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1757 partition: 0 MaxSeqNo: 17 sessionId: src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0
2025-10-02T08:13:29.527827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3530137e-9e791c-b4af3e10-d200c9fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:29.530224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0] Write session: try to update token
2025-10-02T08:13:29.530239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:29.537895Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:29.537913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.537921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534576871601739:11958]
2025-10-02T08:13:29.537962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:29.538019Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:29.538138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:29.538285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.538428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.538588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.538788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:29.538828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:29.542681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId: src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:29.545208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:29.545653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.545679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.545716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:29.545751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:29.545822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.545829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.546006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.546076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.546152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.546228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.546281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.546291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.546371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.546448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.546523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.546601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.546654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.546662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.546738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.546809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.546885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.546960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.547009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.547017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.547091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.547172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.547258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.547337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.547398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.547407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.547494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.547570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.547650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.547732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.547793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.547802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.547888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.547972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.548054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.548141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.548212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.548224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.548310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.548393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.548476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.548560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.548618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.548626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.548712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.548788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.548888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.548970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.549029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.549034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.549121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.549194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.549269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.549348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.549410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.549419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.549503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.549582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.549659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.549729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.549785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.549793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.549841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:29.549918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.549944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.549951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:29.549985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:29.550001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:29.550008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:29.550011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:29.550014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:29.550466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:29.550485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:29.550490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:29.550494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:29.550498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:29.550501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:29.551152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:29.551186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:29.551193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:29.551197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:29.551201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:29.551204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:29.551923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:29.551951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:29.551956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:29.551958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:29.551961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:29.553408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:29.553428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:29.553440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392809553
2025-10-02T08:13:29.553565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:29.553581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:29.553590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:29.553599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:29.553603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:29.553607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:29.554204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:29.554232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:29.554238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:29.554242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:29.554246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:29.554251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:29.554739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:29.554760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:29.554766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:29.554772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:29.554775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:29.554778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:29.555299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:29.555335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:29.555341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:29.556580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:29.556599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:29.556605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:29.556613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:29.556623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392809556
2025-10-02T08:13:29.556976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:29.557000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:29.557008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:29.557011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:29.557015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:29.557019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:29.557504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:29.557530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:29.557539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:29.557543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:29.557547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:29.557552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:29.558000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:29.558025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.558119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392809557
2025-10-02T08:13:29.558881Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:29.558897Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:29.558901Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:29.558905Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:29.560602Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:29.560619Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.560621Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:29.560632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534576871601739:11958]
2025-10-02T08:13:29.560638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534576871601739:11958]
2025-10-02T08:13:29.560687Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:29.560699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:29.560703Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:29.560704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.560706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:29.560879Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:29.614020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534576871601824:6945]
2025-10-02T08:13:29.614177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1756, pipe: [1:7556534576871601824:6945]
2025-10-02T08:13:29.694977Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:29.695380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871601824:6945], now have 1 active actors on pipe
2025-10-02T08:13:29.695482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534576871601824:6945]
2025-10-02T08:13:29.695503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:29.695505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:29.695529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1757 reason: error at write: Disconnected sessionId: src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0
2025-10-02T08:13:29.695593Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:29.695681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1757 sessionId: src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0 is DEAD
2025-10-02T08:13:29.695657Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:29.695836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:29.695843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0] Write session will restart in 0.006117s
2025-10-02T08:13:29.695866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0] Write session: Do CDS request
2025-10-02T08:13:29.695872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:29.702119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:29.703071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:29.703244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.703244Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:29.703253Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:29.703263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:29.703311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:29.703328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:29.703333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1758
2025-10-02T08:13:29.703350Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534576871601962:11888]
2025-10-02T08:13:29.703446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.703494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:29.703505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:29.703508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:29.703872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1758 sessionId:  describe result for acl check
2025-10-02T08:13:29.703902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:29.703908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:29.703910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:29.703915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534576871601967:11882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:29.703957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:29.704149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:29.704178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:29.704404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534576871601967:11882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:29.704416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:29.704448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.704455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.704456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.704457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.704458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.704462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.704468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.704471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.704472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.704474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.704478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.704482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.704485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.704488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.704490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.704493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.704495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.704498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.704501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.704503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.704514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:29.706302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534576871601967:11882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:29.712055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534576871601967:11882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:29.712070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534576871601967:11882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:29.712073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534576871601967:11882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:29.712082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:29.712421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:29.713913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:29.713930Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:29.713932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:29.713935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:29.713940Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1757 [1:7556534576871601962:11888]
2025-10-02T08:13:29.713949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:29.713963Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:29.713965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.713967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.713970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.713981Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:29.713985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:29.713991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:29.714039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.714045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.714048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:29.714050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:29.714101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:29.714109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.714117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.714128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:29.714144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871602007:11882], now have 1 active actors on pipe
2025-10-02T08:13:29.714152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534576871601956:11888]
2025-10-02T08:13:29.714153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534576871601956:11888]
2025-10-02T08:13:29.714158Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:29.714157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1757
2025-10-02T08:13:29.714166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534577331315899:2378], now have 1 active actors on pipe
2025-10-02T08:13:29.714169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:29.714171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:29.714172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:29.714178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:29.714180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:29.714185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.714187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.714217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534576871601956:11888]
2025-10-02T08:13:29.714223Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:29.714233Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:29.714241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.714242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:29.714244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.714245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:29.714252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.714258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:29.714229Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1757
2025-10-02T08:13:29.714288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.714346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.714351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.714360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.714389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1758 partition: 0 MaxSeqNo: 17 sessionId: src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0
2025-10-02T08:13:29.714685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc4f86-8157c59a-4b7ba260-8f2bb1a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:29.717335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0] Write session: try to update token
2025-10-02T08:13:29.717349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:29.724924Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:29.724942Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.724950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534576871601956:11888]
2025-10-02T08:13:29.724994Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:29.724995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:29.725170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:29.725318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.725463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.725608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:29.725802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:29.725843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:29.730977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId: src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:29.733806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:29.733879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.733894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.733935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:29.733960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:29.734015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.734030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.734189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.734244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.734301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.734357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.734407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.734428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.734496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.734549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.734609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.734684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.734727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.734733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.734791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.734845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.734901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.734960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.735000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.735005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.735063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.735124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.735195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.735279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.735335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.735342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.735421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.735491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.735568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.735645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.735722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.735731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.735810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.735877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.735953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.736029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.736085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.736092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.736170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.736254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.736333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.736406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.736476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.736485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.736562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.736629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.736706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.736781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.736911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.736921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.737002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.737059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.737121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.737188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.737243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.737251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.737325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:29.737390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:29.737454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:29.737520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:29.737573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:29.737580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:29.737618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:29.737684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.737710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.737717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:29.737748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:29.737765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:29.737775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:29.737778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:29.737782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:29.738185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:29.738222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:29.738229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:29.738232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:29.738236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:29.738238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:29.738871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:29.738894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:29.738901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:29.738909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:29.738912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:29.738915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:29.739498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:29.739520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:29.739524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:29.739527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:29.739529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:29.740770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:29.740789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:29.740817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392809740
2025-10-02T08:13:29.740932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:29.740945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:29.740949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:29.740955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:29.740958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:29.740961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:29.741557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:29.741584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:29.741590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:29.741599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:29.741602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:29.741605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:29.742167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:29.742193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:29.742202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:29.742205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:29.742209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:29.742212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:29.742737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:29.742761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:29.742768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:29.744000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:29.744016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:29.744022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:29.744026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:29.744035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392809743
2025-10-02T08:13:29.744405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:29.744429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:29.744438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:29.744442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:29.744446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:29.744449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:29.745059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:29.745088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:29.745094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:29.745099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:29.745101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:29.745104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:29.745585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:29.745607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.745712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392809745
2025-10-02T08:13:29.747998Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:29.748020Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:29.748025Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:29.748030Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:29.749919Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:29.749944Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.749946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:29.749958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534576871601956:11888]
2025-10-02T08:13:29.749962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534576871601956:11888]
2025-10-02T08:13:29.750037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:29.750048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.750050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:29.750144Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:29.750159Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:29.750222Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:29.795414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534576871602033:6945]
2025-10-02T08:13:29.795578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1757, pipe: [1:7556534576871602033:6945]
2025-10-02T08:13:29.893936Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:29.894295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871602033:6945], now have 1 active actors on pipe
2025-10-02T08:13:29.894410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534576871602033:6945]
2025-10-02T08:13:29.894435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:29.894437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:29.894465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1758 reason: error at write: Disconnected sessionId: src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0
2025-10-02T08:13:29.894515Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:29.894572Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:29.894639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1758 sessionId: src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0 is DEAD
2025-10-02T08:13:29.894793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:29.894801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0] Write session will restart in 0.009975s
2025-10-02T08:13:29.894825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0] Write session: Do CDS request
2025-10-02T08:13:29.894831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:29.903073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:29.903445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:29.903613Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:29.903621Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:29.903631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:29.903670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:29.903704Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534576871602176:11867]
2025-10-02T08:13:29.904347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:29.904579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:29.904625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:29.905000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:29.905047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.905048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.905050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.905050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.905051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.905056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.905067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.905071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.905075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.905079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.905084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.905092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:29.905099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.905105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:29.905109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.905116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:29.905121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.905126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.905131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.905135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.905153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:29.906276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.906333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:29.906347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1759
2025-10-02T08:13:29.906506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:29.906543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:29.906548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:29.906552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:29.906930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1759 sessionId:  describe result for acl check
2025-10-02T08:13:29.906953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:29.906955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:29.906957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:29.906962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534576871602193:11861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:29.907438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534576871602193:11861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:29.909555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534576871602193:11861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:29.912533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534576871602193:11861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:29.912551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534576871602193:11861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:29.912554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534576871602193:11861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:29.912563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:29.913141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:29.914750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:29.914766Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:29.914770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:29.914774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:29.914781Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1758 [1:7556534576871602176:11867]
2025-10-02T08:13:29.914795Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:29.914814Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:29.914816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.914818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.914820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.914838Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:29.914844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:29.914852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:29.914922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.914924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.914928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:29.914930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:29.915004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:29.915007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.915021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:29.915034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:29.915051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534576871602170:11867]
2025-10-02T08:13:29.915054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534576871602170:11867]
2025-10-02T08:13:29.915069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:29.915082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:29.915099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:29.915102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:29.915126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:29.915130Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:29.915138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534576871602170:11867]
2025-10-02T08:13:29.915141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:29.915221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:29.915226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1758
2025-10-02T08:13:29.915242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871602224:11861], now have 1 active actors on pipe
2025-10-02T08:13:29.915339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534577331315908:2378], now have 1 active actors on pipe
2025-10-02T08:13:29.915352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.915356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.915382Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff2afde6-83c897c2-226286d6-3e753d74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:29.915389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:29.915393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:29.915395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:29.915406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:29.915416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:29.915432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.915473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:29.915481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:29.915496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:29.915533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1759 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff2afde6-83c897c2-226286d6-3e753d74_0
2025-10-02T08:13:29.915767Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1758
2025-10-02T08:13:29.915932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37deb1-3f90b37b-518e840e-fd2a6544_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff2afde6-83c897c2-226286d6-3e753d74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:29.918795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2afde6-83c897c2-226286d6-3e753d74_0] Write session: try to update token
2025-10-02T08:13:29.918812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2afde6-83c897c2-226286d6-3e753d74_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:29.933884Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:29.933906Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:29.933909Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:29.933922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534576871602170:11867]
2025-10-02T08:13:29.933925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534576871602170:11867]
2025-10-02T08:13:29.933968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:29.933970Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:29.933979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:29.933982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:29.933987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:29.934128Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:29.935748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId: src_id|ff2afde6-83c897c2-226286d6-3e753d74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:29.938581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:29.994574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534576871602242:6945]
2025-10-02T08:13:29.994690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1758, pipe: [1:7556534576871602242:6945]
2025-10-02T08:13:30.088431Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:30.088757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.088771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.088823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534576871602242:6945], now have 1 active actors on pipe
2025-10-02T08:13:30.088940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534576871602242:6945]
2025-10-02T08:13:30.088965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:30.088971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:30.089025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1759 reason: error at write: Disconnected sessionId: src_id|ff2afde6-83c897c2-226286d6-3e753d74_0
2025-10-02T08:13:30.089060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:30.089159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1759 sessionId: src_id|ff2afde6-83c897c2-226286d6-3e753d74_0 is DEAD
2025-10-02T08:13:30.089329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2afde6-83c897c2-226286d6-3e753d74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:30.089340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2afde6-83c897c2-226286d6-3e753d74_0] Write session will restart in 0.005628s
2025-10-02T08:13:30.089364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2afde6-83c897c2-226286d6-3e753d74_0] Write session: Do CDS request
2025-10-02T08:13:30.089373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2afde6-83c897c2-226286d6-3e753d74_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:30.090535Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:30.095919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:30.096299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2afde6-83c897c2-226286d6-3e753d74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.096306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:30.096338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:30.096344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1760
2025-10-02T08:13:30.096500Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:30.096505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.096510Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:30.096518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:30.096528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:30.096539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:30.096547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:30.096556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:30.096599Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534581166569679:11831]
2025-10-02T08:13:30.096917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1760 sessionId:  describe result for acl check
2025-10-02T08:13:30.096947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:30.096954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:30.096955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:30.096960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534581166569683:11834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:30.097080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:30.097273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:30.097323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:30.097436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534581166569683:11834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:30.097640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:30.097685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.097691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.097692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.097693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.097694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.097699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.097709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.097714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.097723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.097730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.097735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.097747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.097757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.097767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.097776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.097786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.097795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.097805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.097814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.097823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.097848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:30.099477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534581166569683:11834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:30.106492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:30.108074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:30.108096Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:30.108099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:30.108103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:30.108109Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1759 [1:7556534581166569679:11831]
2025-10-02T08:13:30.108121Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:30.108139Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:30.108142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.108145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.108148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.108163Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:30.108169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:30.108176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:30.108257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.108266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.108269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:30.108272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:30.108436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:30.108445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.108459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.108478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:30.108504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534581626283211:2378], now have 1 active actors on pipe
2025-10-02T08:13:30.108515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534581166569672:11831]
2025-10-02T08:13:30.108519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534581166569672:11831]
2025-10-02T08:13:30.108534Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:30.108548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:30.108562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:30.108564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:30.108568Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:30.108570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:30.108601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534581166569672:11831]
2025-10-02T08:13:30.108612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:30.108622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:30.108945Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1759
2025-10-02T08:13:30.109188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534581166569683:11834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:30.109200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534581166569683:11834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:30.109203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534581166569683:11834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:30.109211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:30.109581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1759
2025-10-02T08:13:30.109593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166569733:11834], now have 1 active actors on pipe
2025-10-02T08:13:30.109598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.109602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.109622Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:30.109643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.109647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.109649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:30.109657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.109668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:30.109686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.109714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.109720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.109731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.109754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1760 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0
2025-10-02T08:13:30.110071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2afde6-83c897c2-226286d6-3e753d74_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:30.112832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0] Write session: try to update token
2025-10-02T08:13:30.112850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:30.120285Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:30.120307Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:30.120317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534581166569672:11831]
2025-10-02T08:13:30.120361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:30.120365Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:30.120541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:30.120686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:30.120850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:30.120997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:30.121203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:30.121246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:30.132105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId: src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:30.134931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:30.135035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.135049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.135083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:30.135109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:30.135167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.135185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.135381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.135460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.135548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.135620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.135667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.135676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.135746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.135813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.135880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.135950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.135995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.136004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.136079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.136144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.136220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.136281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.136328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.136335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.136407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.136482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.136558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.136631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.136685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.136692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.136771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.136855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.136929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.137002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.137058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.137061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.137141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.137213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.137290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.137365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.137423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.137431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.137509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.137578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.137657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.137729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.137782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.137790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.137870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.137940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.138018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.138094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.138162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.138169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.138253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.138322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.138391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.138458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.138519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.138526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.138603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.138669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.138736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.138803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.138859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.138866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.138930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:30.139003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.139027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.139034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:30.139064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:30.139082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:30.139089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:30.139095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:30.139113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:30.139509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:30.139535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:30.139547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:30.139554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:30.139557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:30.139560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:30.140055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:30.140077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:30.140083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:30.140090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:30.140094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:30.140101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:30.140758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:30.140781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:30.140786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:30.140789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:30.140792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:30.142056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:30.142072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:30.142087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392810141
2025-10-02T08:13:30.142203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:30.142217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:30.142224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:30.142227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:30.142231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:30.142234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:30.142761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:30.142789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:30.142795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:30.142805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:30.142808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:30.142811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:30.143325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:30.143345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:30.143357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:30.143365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:30.143369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:30.143373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:30.143865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:30.143883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:30.143893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:30.145092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:30.145110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:30.145115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:30.145119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:30.145127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392810145
2025-10-02T08:13:30.145432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:30.145452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:30.145462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:30.145465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:30.145469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:30.145479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:30.145960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:30.145980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:30.145985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:30.145989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:30.145992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:30.145996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:30.146473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:30.146494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.146598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392810146
2025-10-02T08:13:30.149038Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:30.149062Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:30.149071Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:30.149078Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:30.149088Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:30.149095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:30.149097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:30.149104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534581166569672:11831]
2025-10-02T08:13:30.149108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534581166569672:11831]
2025-10-02T08:13:30.149172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:30.149185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:30.149186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:30.149189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.149191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:30.149340Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:30.189147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534581166569742:6945]
2025-10-02T08:13:30.189295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1759, pipe: [1:7556534581166569742:6945]
2025-10-02T08:13:30.290213Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:30.290600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166569742:6945], now have 1 active actors on pipe
2025-10-02T08:13:30.290724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534581166569742:6945]
2025-10-02T08:13:30.290745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:30.290747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:30.290771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1760 reason: error at write: Disconnected sessionId: src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0
2025-10-02T08:13:30.290830Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:30.290881Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:30.290925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1760 sessionId: src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0 is DEAD
2025-10-02T08:13:30.291049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:30.291059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0] Write session will restart in 0.009501s
2025-10-02T08:13:30.291080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0] Write session: Do CDS request
2025-10-02T08:13:30.291085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:30.295302Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2966050f2bf90ce1] Result# TEvPutResult {Id# [72075186224037892:1759:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:30.295354Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1759:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:30.295398Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1759:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:30.299743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:30.300362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:30.300578Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:30.300588Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:30.300598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:30.300656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:30.300695Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534581166569889:11829]
2025-10-02T08:13:30.301234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.301278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:30.301291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1761
2025-10-02T08:13:30.301390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:30.301413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.301436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:30.301443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:30.301447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:30.301578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:30.301620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:30.301744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1761 sessionId:  describe result for acl check
2025-10-02T08:13:30.301776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:30.301781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:30.301782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:30.301785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534581166569900:11818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:30.301938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:30.301991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.301997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.301998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.302000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.302001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.302007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.302022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.302030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.302036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.302044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.302053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.302065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.302075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.302086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.302095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.302104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.302112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.302121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.302130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.302140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.302163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:30.302172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534581166569900:11818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:30.304043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534581166569900:11818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:30.309283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534581166569900:11818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:30.309299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534581166569900:11818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:30.309302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534581166569900:11818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:30.309309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:30.309760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:30.311190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:30.311207Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:30.311208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:30.311212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:30.311217Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1760 [1:7556534581166569889:11829]
2025-10-02T08:13:30.311225Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:30.311238Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:30.311240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.311243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.311244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.311260Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:30.311263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:30.311268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:30.311314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.311320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.311322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:30.311324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:30.311436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1760
2025-10-02T08:13:30.311467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:30.311473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.311481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.311489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:30.311507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166569937:11818], now have 1 active actors on pipe
2025-10-02T08:13:30.311513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534581626283220:2378], now have 1 active actors on pipe
2025-10-02T08:13:30.311516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.311519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.311532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534581166569881:11829]
2025-10-02T08:13:30.311537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534581166569881:11829]
2025-10-02T08:13:30.311542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:30.311551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:30.311527Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1760
2025-10-02T08:13:30.311562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:30.311564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:30.311565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:30.311568Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:30.311576Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:30.311581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.311585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.311586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:30.311593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.311599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:30.311638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534581166569881:11829]
2025-10-02T08:13:30.311648Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:30.311658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.311662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:30.311730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.311737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.311749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.311776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1761 partition: 0 MaxSeqNo: 17 sessionId: src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0
2025-10-02T08:13:30.312093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d6a48b-365bad95-f88d2c47-6992530c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:30.314637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0] Write session: try to update token
2025-10-02T08:13:30.314654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:30.329429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId: src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:30.329710Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:30.329725Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:30.329728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:30.329737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534581166569881:11829]
2025-10-02T08:13:30.329746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534581166569881:11829]
2025-10-02T08:13:30.329792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:30.329799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:30.329803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.329805Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:30.329805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:30.329956Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:30.331927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:30.390871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534581166569953:6945]
2025-10-02T08:13:30.391009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1760, pipe: [1:7556534581166569953:6945]
2025-10-02T08:13:30.475687Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:30.475955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.475968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.476002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166569953:6945], now have 1 active actors on pipe
2025-10-02T08:13:30.476129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534581166569953:6945]
2025-10-02T08:13:30.476160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:30.476163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:30.476238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1761 reason: error at write: Disconnected sessionId: src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0
2025-10-02T08:13:30.476304Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:30.476422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1761 sessionId: src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0 is DEAD
2025-10-02T08:13:30.476607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:30.476617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0] Write session will restart in 0.005167s
2025-10-02T08:13:30.476642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0] Write session: Do CDS request
2025-10-02T08:13:30.476652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:30.476890Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:30.482992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:30.483349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.483385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:30.483398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1762
2025-10-02T08:13:30.483572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.483586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:30.483609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:30.483620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:30.483623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:30.483752Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:30.483763Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:30.483772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:30.483826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:30.483878Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534581166570100:11810]
2025-10-02T08:13:30.483986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1762 sessionId:  describe result for acl check
2025-10-02T08:13:30.484016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:30.484022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:30.484024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:30.484029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534581166570104:11789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:30.484474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:30.484512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534581166570104:11789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:30.484676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:30.484720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:30.485036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:30.485080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.485086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.485087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.485088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.485091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.485096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.485105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.485109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.485113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.485116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.485121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.485128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.485133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.485137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.485141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.485151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.485155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.485160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.485164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.485173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.485192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:30.486617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534581166570104:11789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:30.492151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534581166570104:11789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:30.492169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534581166570104:11789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:30.492173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534581166570104:11789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:30.492183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:30.493205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:30.494631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:30.494655Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:30.494662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:30.494666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:30.494671Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1761 [1:7556534581166570100:11810]
2025-10-02T08:13:30.494682Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:30.494699Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:30.494702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.494705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.494707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.494724Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:30.494731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:30.494738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:30.494802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.494811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.494813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:30.494815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:30.494867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:30.494873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.494883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.494893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:30.494914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534581166570093:11810]
2025-10-02T08:13:30.494920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534581166570093:11810]
2025-10-02T08:13:30.494927Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:30.494929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1761
2025-10-02T08:13:30.494942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166570147:11789], now have 1 active actors on pipe
2025-10-02T08:13:30.494950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534581626283239:2378], now have 1 active actors on pipe
2025-10-02T08:13:30.494953Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:30.494957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:30.494957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:30.494971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:30.494973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:30.494980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.494988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.495022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534581166570093:11810]
2025-10-02T08:13:30.495028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:30.495039Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:30.495010Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1761
2025-10-02T08:13:30.495045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:30.495047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.495053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.495055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:30.495061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.495067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:30.495098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.495139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.495144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.495155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.495193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1762 partition: 0 MaxSeqNo: 17 sessionId: src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0
2025-10-02T08:13:30.495516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d200cbfc-24a7f030-9e557d33-70aa0fab_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:30.497964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0] Write session: try to update token
2025-10-02T08:13:30.497985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:30.512116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId: src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:30.514515Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:30.514536Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:30.514538Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:30.514547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534581166570093:11810]
2025-10-02T08:13:30.514552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534581166570093:11810]
2025-10-02T08:13:30.514605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:30.514614Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:30.514616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.514620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:30.514630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:30.514758Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:30.514991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:30.576248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534581166570172:6945]
2025-10-02T08:13:30.576384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1761, pipe: [1:7556534581166570172:6945]
2025-10-02T08:13:30.652533Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:30.653196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.653211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.653247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166570172:6945], now have 1 active actors on pipe
2025-10-02T08:13:30.653406Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:30.653481Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:30.653665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534581166570172:6945]
2025-10-02T08:13:30.653684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:30.653736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1762 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0
2025-10-02T08:13:30.653904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1762 sessionId: src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0 is DEAD
2025-10-02T08:13:30.654102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:30.654112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0] Write session will restart in 0.009776s
2025-10-02T08:13:30.654135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0] Write session: Do CDS request
2025-10-02T08:13:30.654142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:30.660890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:30.661343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:30.661474Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:30.661481Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:30.661488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:30.661519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:30.661550Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534581166570339:11778]
2025-10-02T08:13:30.661988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:30.662172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:30.662209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:30.662462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:30.662507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.662512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.662513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.662514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.662515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.662519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.662527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.662530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.662533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.662537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.662541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.662547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.662553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.662556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.662560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.662579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.662592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.662597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.662602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.662606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.662623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:30.665207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.665327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:30.665341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1763
2025-10-02T08:13:30.665454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.665485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:30.665495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:30.665498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:30.665891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1763 sessionId:  describe result for acl check
2025-10-02T08:13:30.665925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:30.665932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:30.665933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:30.665938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534581166570371:11764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:30.666460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534581166570371:11764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:30.669259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534581166570371:11764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:30.670805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:30.672434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:30.672451Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:30.672453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:30.672456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:30.672461Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1762 [1:7556534581166570339:11778]
2025-10-02T08:13:30.672468Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:30.672483Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:30.672486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.672487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.672489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.672501Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:30.672510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:30.672515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:30.672553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534581166570371:11764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:30.672562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.672566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.672567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534581166570371:11764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:30.672568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:30.672570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:30.672571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534581166570371:11764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:30.672616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:30.672622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.672630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.672641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:30.672661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534581626283245:2378], now have 1 active actors on pipe
2025-10-02T08:13:30.672672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534581166570330:11778]
2025-10-02T08:13:30.672674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534581166570330:11778]
2025-10-02T08:13:30.672683Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:30.672697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:30.672702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:30.672706Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:30.672711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:30.672714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:30.672741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534581166570330:11778]
2025-10-02T08:13:30.672747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:30.672751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:30.672717Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1762
2025-10-02T08:13:30.672798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:30.673042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166570404:11764], now have 1 active actors on pipe
2025-10-02T08:13:30.673047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1762
2025-10-02T08:13:30.673052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.673055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.673074Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:30.673082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.673085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.673090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:30.673096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.673108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:30.673120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.673174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.673199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.673229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.673289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1763 partition: 0 MaxSeqNo: 17 sessionId: src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0
2025-10-02T08:13:30.673601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d872238-be3e7b9d-ecd8aa75-e585d156_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:30.676136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0] Write session: try to update token
2025-10-02T08:13:30.676149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:30.684119Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:30.684149Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:30.684158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534581166570330:11778]
2025-10-02T08:13:30.684208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:30.684215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:30.684398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:30.684555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:30.684703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:30.684870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:30.685276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:30.685327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:30.689814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId: src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:30.693063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:30.693137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.693151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.693193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:30.693220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:30.693289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.693307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.693508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.693577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.693668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.693753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.693806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.693816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.693940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.694011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.694080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.694151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.694205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.694213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.694291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.694358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.694429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.694497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.694549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.694558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.694637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.694714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.694791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.694869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.694946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.694958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.695048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.695119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.695199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.695286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.695339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.695345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.695424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.695488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.695559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.695638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.695696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.695699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.695786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.695850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.695920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.696012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.696066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.696070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.696148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.696236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.696315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.696395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.696450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.696452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.696531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.696588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.696643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.696700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.696747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.696749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.696870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:30.696940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:30.697002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:30.697071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:30.697127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:30.697134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:30.697174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:30.697240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.697260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.697263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:30.697295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:30.697311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:30.697318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:30.697321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:30.697324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:30.697716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:30.697746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:30.697753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:30.697755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:30.697758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:30.697762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:30.698262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:30.698285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:30.698291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:30.698296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:30.698299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:30.698302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:30.698792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:30.698816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:30.698823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:30.698825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:30.698828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:30.701289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:30.701305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:30.701317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392810701
2025-10-02T08:13:30.701424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:30.701438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:30.701443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:30.701446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:30.701451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:30.701458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:30.701950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:30.701969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:30.701975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:30.701978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:30.701981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:30.701985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:30.702420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:30.702443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:30.702452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:30.702455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:30.702459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:30.702462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:30.702956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:30.702979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:30.702986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:30.704169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:30.704188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:30.704205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:30.704209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:30.704218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392810704
2025-10-02T08:13:30.704543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:30.704564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:30.704569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:30.704571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:30.704574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:30.704576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:30.705068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:30.705089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:30.705097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:30.705105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:30.705108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:30.705113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:30.705631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:30.705656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.705762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392810705
2025-10-02T08:13:30.706722Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:30.706748Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:30.706759Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:30.706772Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:30.708491Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:30.708504Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:30.708507Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:30.708514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534581166570330:11778]
2025-10-02T08:13:30.708516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534581166570330:11778]
2025-10-02T08:13:30.708566Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:30.708580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:30.708584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.708585Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:30.708585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:30.708730Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:30.753864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534581166570429:6945]
2025-10-02T08:13:30.753996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1762, pipe: [1:7556534581166570429:6945]
2025-10-02T08:13:30.854252Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:30.854655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166570429:6945], now have 1 active actors on pipe
2025-10-02T08:13:30.855047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:30.854814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534581166570429:6945]
2025-10-02T08:13:30.854844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:30.854846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:30.854874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1763 reason: error at write: Disconnected sessionId: src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0
2025-10-02T08:13:30.855040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1763 sessionId: src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0 is DEAD
2025-10-02T08:13:30.855329Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:30.860907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:30.860922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0] Write session will restart in 0.006023s
2025-10-02T08:13:30.860948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0] Write session: Do CDS request
2025-10-02T08:13:30.860956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:30.866636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:30.867120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:30.867366Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:30.867371Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:30.867380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:30.867429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:30.867472Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534581166570580:11731]
2025-10-02T08:13:30.868150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:30.868257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.868287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:30.868297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1764
2025-10-02T08:13:30.868349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:30.868389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:30.868687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:30.868724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.868725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.868726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.868727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.868728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.868732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.868742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.868746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.868749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.868753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.868758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.868764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:30.868770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.868775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:30.868779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.868784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:30.868788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.868794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.868798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.868821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.868839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:30.868973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:30.869007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:30.869017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:30.869020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:30.869418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1764 sessionId:  describe result for acl check
2025-10-02T08:13:30.869446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:30.869452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:30.869453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:30.869459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534581166570596:11735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:30.869964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534581166570596:11735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:30.871922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534581166570596:11735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:30.877038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534581166570596:11735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:30.877061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534581166570596:11735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:30.877066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534581166570596:11735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:30.877075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:30.877592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:30.879182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:30.879205Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:30.879207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:30.879211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:30.879218Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1763 [1:7556534581166570580:11731]
2025-10-02T08:13:30.879230Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:30.879248Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:30.879251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.879254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.879256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.879272Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:30.879276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:30.879283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:30.879351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.879361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.879363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:30.879366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:30.879430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:30.879439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.879453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:30.879471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:30.879494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534581166570573:11731]
2025-10-02T08:13:30.879500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534581166570573:11731]
2025-10-02T08:13:30.879507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:30.879509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1763
2025-10-02T08:13:30.879521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166570627:11735], now have 1 active actors on pipe
2025-10-02T08:13:30.879530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:30.879543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:30.879546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:30.879552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534581626283276:2378], now have 1 active actors on pipe
2025-10-02T08:13:30.879557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.879561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.879600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534581166570573:11731]
2025-10-02T08:13:30.879608Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:30.879622Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:30.879634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:30.879637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:30.879639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:30.879649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:30.879653Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:30.879655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:30.879661Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:30.879663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:30.879698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.879774Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1763
2025-10-02T08:13:30.880076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:30.880090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:30.880121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:30.880161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1764 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0
2025-10-02T08:13:30.880530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddc5d30-3bd1fab1-fef96cc9-12044db8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:30.883247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0] Write session: try to update token
2025-10-02T08:13:30.883267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:30.897916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId: src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:30.898482Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:30.898486Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:30.898488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:30.898498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534581166570573:11731]
2025-10-02T08:13:30.898503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534581166570573:11731]
2025-10-02T08:13:30.898554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:30.898556Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:30.898561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:30.898563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:30.898571Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:30.898713Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:30.900674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:30.955116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534581166570641:6945]
2025-10-02T08:13:30.955268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1763, pipe: [1:7556534581166570641:6945]
2025-10-02T08:13:31.052858Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:31.053234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.053254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.053299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534581166570641:6945], now have 1 active actors on pipe
2025-10-02T08:13:31.053396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:31.053406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:31.053458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1764 reason: error at write: Disconnected sessionId: src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0
2025-10-02T08:13:31.053507Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:31.053616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1764 sessionId: src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0 is DEAD
2025-10-02T08:13:31.053582Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:31.053776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:31.053786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0] Write session will restart in 0.005477s
2025-10-02T08:13:31.053810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0] Write session: Do CDS request
2025-10-02T08:13:31.053792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534581166570641:6945]
2025-10-02T08:13:31.053817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:31.060316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.060389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:31.060415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1765
2025-10-02T08:13:31.060579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.060620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:31.060629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:31.060634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:31.061137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1765 sessionId:  describe result for acl check
2025-10-02T08:13:31.061176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:31.061182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:31.061184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:31.061189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534585461538082:11713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:31.061707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534585461538082:11713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:31.062287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:31.062635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:31.062792Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:31.062801Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:31.062810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:31.062852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:31.062889Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534585461538105:11720]
2025-10-02T08:13:31.063519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:31.063676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:31.063713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:31.063918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534585461538082:11713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:31.064000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:31.064042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.064048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.064049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.064050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.064051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.064056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.064065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.064070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.064073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.064077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.064082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.064089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.064095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.064102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.064107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.064112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.064117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.064121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.064128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.064132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.064151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:31.071519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534585461538082:11713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:31.071539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534585461538082:11713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:31.071543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534585461538082:11713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:31.071551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:31.075951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:31.077712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:31.077729Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:31.077732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:31.077736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:31.077742Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1764 [1:7556534585461538105:11720]
2025-10-02T08:13:31.077754Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:31.077771Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:31.077774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.077778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.077780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.077799Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:31.077804Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:31.077811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:31.077874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.077883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.077886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:31.077888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:31.077957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:31.077969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.077985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.077999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:31.078016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534585461538092:11720]
2025-10-02T08:13:31.078033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534585461538092:11720]
2025-10-02T08:13:31.078043Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:31.078063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:31.078063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1764
2025-10-02T08:13:31.078067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:31.078070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:31.078086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:31.078112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:31.078126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461538139:11713], now have 1 active actors on pipe
2025-10-02T08:13:31.078130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534585921250579:2378], now have 1 active actors on pipe
2025-10-02T08:13:31.078163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.078149Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1764
2025-10-02T08:13:31.078174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.078187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534585461538092:11720]
2025-10-02T08:13:31.078190Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:31.078199Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:31.078214Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:31.078225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.078231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.078239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:31.078248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.078262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:31.078296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.078338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.078345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.078357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.078395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1765 partition: 0 MaxSeqNo: 17 sessionId: src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0
2025-10-02T08:13:31.078715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b902be0-34375766-d789cdfd-5ab2ba26_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:31.081401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0] Write session: try to update token
2025-10-02T08:13:31.081422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:31.096283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId: src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:31.097012Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:31.097026Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:31.097028Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:31.097034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534585461538092:11720]
2025-10-02T08:13:31.097037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534585461538092:11720]
2025-10-02T08:13:31.097082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:31.097084Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:31.097089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:31.097094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.097096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:31.097237Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:31.099344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:31.153724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534585461538152:6945]
2025-10-02T08:13:31.153849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1764, pipe: [1:7556534585461538152:6945]
2025-10-02T08:13:31.232913Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:31.233267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.233282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.233322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461538152:6945], now have 1 active actors on pipe
2025-10-02T08:13:31.233446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534585461538152:6945]
2025-10-02T08:13:31.233470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:31.233474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:31.233502Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:31.233528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1765 reason: error at write: Disconnected sessionId: src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0
2025-10-02T08:13:31.233546Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:31.233672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1765 sessionId: src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0 is DEAD
2025-10-02T08:13:31.233817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:31.233827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0] Write session will restart in 0.005209s
2025-10-02T08:13:31.233853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0] Write session: Do CDS request
2025-10-02T08:13:31.233859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:31.240556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:31.240602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.240674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:31.240686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1766
2025-10-02T08:13:31.240843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.240875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:31.240884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:31.240887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:31.241106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:31.241233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1766 sessionId:  describe result for acl check
2025-10-02T08:13:31.241257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:31.241262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:31.241263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:31.241267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534585461538307:11683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:31.241341Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:31.241350Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:31.241360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:31.241418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:31.241456Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534585461538308:11687]
2025-10-02T08:13:31.241760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534585461538307:11683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:31.241920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:31.242081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:31.242109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:31.242326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:31.242361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.242366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.242367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.242368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.242368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.242372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.242379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.242381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.242383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.242385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.242389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.242394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.242398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.242401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.242405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.242408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.242410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.242413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.242416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.242418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.242429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:31.243672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534585461538307:11683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:31.249897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534585461538307:11683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:31.249914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534585461538307:11683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:31.249918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534585461538307:11683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:31.249941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:31.250922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:31.252618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:31.252634Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:31.252640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:31.252644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:31.252650Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1765 [1:7556534585461538308:11687]
2025-10-02T08:13:31.252663Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:31.252679Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:31.252687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.252690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.252692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.252708Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:31.252718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:31.252724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:31.252788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.252796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.252817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:31.252819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:31.252896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:31.252905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.252918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.252936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:31.252957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1765
2025-10-02T08:13:31.252959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461538354:11683], now have 1 active actors on pipe
2025-10-02T08:13:31.252965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534585461538299:11687]
2025-10-02T08:13:31.252968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534585461538299:11687]
2025-10-02T08:13:31.252979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:31.252993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534585921250589:2378], now have 1 active actors on pipe
2025-10-02T08:13:31.252994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:31.252998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:31.252998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.253003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.253021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:31.253036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:31.253043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:31.253038Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1765
2025-10-02T08:13:31.253085Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:31.253097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.253100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.253102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:31.253109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.253117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:31.253125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534585461538299:11687]
2025-10-02T08:13:31.253132Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:31.253144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:31.253163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.253213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.253219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.253233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.253269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1766 partition: 0 MaxSeqNo: 17 sessionId: src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0
2025-10-02T08:13:31.253615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832eaa72-773622e7-ec9a4bcf-d9415dd2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:31.256134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0] Write session: try to update token
2025-10-02T08:13:31.256149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:31.269991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId: src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:31.271550Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:31.271571Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:31.271574Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:31.271583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534585461538299:11687]
2025-10-02T08:13:31.271588Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534585461538299:11687]
2025-10-02T08:13:31.271642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:31.271642Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:31.271646Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:31.271653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.271657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:31.271830Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:31.272762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:31.333435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534585461538370:6945]
2025-10-02T08:13:31.333582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1765, pipe: [1:7556534585461538370:6945]
2025-10-02T08:13:31.425256Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:31.425554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.425573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.425614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461538370:6945], now have 1 active actors on pipe
2025-10-02T08:13:31.425713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:31.425721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:31.425774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1766 reason: error at write: Disconnected sessionId: src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0
2025-10-02T08:13:31.425815Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:31.425814Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:31.425948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1766 sessionId: src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0 is DEAD
2025-10-02T08:13:31.426113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:31.426124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0] Write session will restart in 0.008602s
2025-10-02T08:13:31.426148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0] Write session: Do CDS request
2025-10-02T08:13:31.426154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:31.426147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534585461538370:6945]
2025-10-02T08:13:31.433125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:31.433720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:31.433911Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:31.433922Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:31.433932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:31.433984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:31.434022Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534585461538525:11661]
2025-10-02T08:13:31.434675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:31.434879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:31.434925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:31.435263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:31.435328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.435335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.435336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.435337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.435338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.435344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.435363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.435368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.435372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.435375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.435383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.435390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.435396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.435409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.435414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.435423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.435429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.435439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.435444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.435453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.435471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:31.436286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.436361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:31.436374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1767
2025-10-02T08:13:31.436532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.436564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:31.436574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:31.436579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:31.437023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1767 sessionId:  describe result for acl check
2025-10-02T08:13:31.437059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:31.437066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:31.437068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:31.437073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534585461538541:11641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:31.437574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534585461538541:11641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:31.440024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534585461538541:11641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:31.443199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534585461538541:11641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:31.443212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534585461538541:11641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:31.443215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534585461538541:11641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:31.443221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:31.443927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:31.445627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:31.445647Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:31.445649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:31.445653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:31.445659Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1766 [1:7556534585461538525:11661]
2025-10-02T08:13:31.445671Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:31.445686Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:31.445690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.445693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.445694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.445711Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:31.445716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:31.445722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:31.445779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.445788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.445791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:31.445794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:31.445860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:31.445867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.445879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.445896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:31.445903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1766
2025-10-02T08:13:31.445921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461538573:11641], now have 1 active actors on pipe
2025-10-02T08:13:31.445928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534585921250596:2378], now have 1 active actors on pipe
2025-10-02T08:13:31.445933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.445937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.445953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534585461538519:11661]
2025-10-02T08:13:31.445960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534585461538519:11661]
2025-10-02T08:13:31.445971Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:31.445987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:31.445987Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:31.445991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:31.446004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:31.445975Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1766
2025-10-02T08:13:31.446007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:31.446020Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:31.446030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.446034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.446036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:31.446044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.446057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:31.446092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534585461538519:11661]
2025-10-02T08:13:31.446103Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:31.446110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:31.446125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.446181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.446191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.446210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.446243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1767 partition: 0 MaxSeqNo: 17 sessionId: src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0
2025-10-02T08:13:31.446553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afe183c-e0c7e673-b89714d9-1b7c0618_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:31.449209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0] Write session: try to update token
2025-10-02T08:13:31.449226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:31.460214Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:31.460236Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:31.460245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534585461538519:11661]
2025-10-02T08:13:31.460291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:31.460302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:31.460513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:31.460663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:31.460824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:31.460965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:31.461234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:31.461279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:31.462778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId: src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:31.465344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:31.465407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.465419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.465457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:31.465484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:31.465539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.465554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.465728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.465825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.465909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.465978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.466025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.466034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.466102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.466163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.466225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.466297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.466349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.466357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.466441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.466501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.466575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.466636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.466677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.466685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.466748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.466816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.466912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.466993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.467038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.467046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.467122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.467185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.467255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.467323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.467382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.467390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.467482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.467548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.467618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.467688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.467734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.467739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.467816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.467898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.467994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.468065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.468118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.468126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.468217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.468276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.468344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.468433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.468490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.468499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.468583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.468642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.468707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.468764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.468840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.468848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.468927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:31.468988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:31.469043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:31.469096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:31.469150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:31.469160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:31.469197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:31.469250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.469265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.469271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:31.469296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:31.469307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:31.469309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:31.469310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:31.469312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:31.469663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:31.469685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:31.469698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:31.469706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:31.469709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:31.469712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:31.470341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:31.470360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:31.470364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:31.470366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:31.470368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:31.470370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:31.470771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:31.470788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:31.470793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:31.470799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:31.470801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:31.472789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:31.472820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:31.472834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392811472
2025-10-02T08:13:31.472988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:31.473002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:31.473006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:31.473008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:31.473011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:31.473013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:31.473446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:31.473464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:31.473467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:31.473471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:31.473473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:31.473475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:31.473896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:31.473914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:31.473918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:31.473928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:31.473931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:31.473933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:31.474344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:31.474360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:31.474364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:31.475448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:31.475465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:31.475469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:31.475472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:31.475479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392811475
2025-10-02T08:13:31.475733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:31.475748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:31.475752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:31.475754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:31.475756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:31.475758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:31.476205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:31.476224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:31.476229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:31.476233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:31.476235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:31.476238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:31.476640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:31.476656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.476729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392811476
2025-10-02T08:13:31.477484Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:31.477503Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:31.477509Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:31.477515Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:31.479123Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:31.479137Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:31.479138Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:31.479147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534585461538519:11661]
2025-10-02T08:13:31.479149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534585461538519:11661]
2025-10-02T08:13:31.479196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:31.479203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.479204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:31.479217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:31.479225Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:31.479329Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:31.526504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534585461538608:6945]
2025-10-02T08:13:31.526643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1766, pipe: [1:7556534585461538608:6945]
2025-10-02T08:13:31.628762Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:31.629234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461538608:6945], now have 1 active actors on pipe
2025-10-02T08:13:31.629351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534585461538608:6945]
2025-10-02T08:13:31.629379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:31.629381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:31.629408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1767 reason: error at write: Disconnected sessionId: src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0
2025-10-02T08:13:31.629514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:31.629455Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:31.629595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1767 sessionId: src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0 is DEAD
2025-10-02T08:13:31.629767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:31.629779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0] Write session will restart in 0.009542s
2025-10-02T08:13:31.629803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0] Write session: Do CDS request
2025-10-02T08:13:31.629811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:31.637513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:31.638144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:31.638290Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:31.638298Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:31.638306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:31.638338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:31.638366Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534585461538766:11634]
2025-10-02T08:13:31.638800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:31.638998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:31.639040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:31.639296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:31.639328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.639333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.639333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.639334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.639335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.639338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.639346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.639349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.639353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.639356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.639363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.639370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.639376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.639381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.639385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.639389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.639391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.639394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.639396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.639399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.639409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:31.641295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.641370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:31.641381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1768
2025-10-02T08:13:31.644994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.645040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:31.645046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:31.645049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:31.645482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1768 sessionId:  describe result for acl check
2025-10-02T08:13:31.645518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:31.645524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:31.645526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:31.645531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534585461538783:11636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:31.646017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534585461538783:11636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:31.648998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:31.649755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534585461538783:11636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:31.650646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:31.650663Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:31.650666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:31.650670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:31.650676Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1767 [1:7556534585461538766:11634]
2025-10-02T08:13:31.650688Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:31.650705Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:31.650711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.650714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.650716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.650732Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:31.650738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:31.650745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:31.650815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.650823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.650826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:31.650828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:31.650989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:31.650997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.651012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.651033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:31.651056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534585921250616:2378], now have 1 active actors on pipe
2025-10-02T08:13:31.651067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534585461538760:11634]
2025-10-02T08:13:31.651069Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534585461538760:11634]
2025-10-02T08:13:31.651083Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:31.651100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:31.651114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:31.651118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:31.651151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534585461538760:11634]
2025-10-02T08:13:31.651153Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:31.651372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:31.651382Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:31.651387Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:31.651161Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1767
2025-10-02T08:13:31.659007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534585461538783:11636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:31.659034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534585461538783:11636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:31.659042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534585461538783:11636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:31.659053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:31.659446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1767
2025-10-02T08:13:31.659462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461538824:11636], now have 1 active actors on pipe
2025-10-02T08:13:31.659641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.659655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.659683Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:31.659695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.659700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.659702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:31.659714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.659735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:31.659752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.659786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.659792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.659804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.659835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1768 partition: 0 MaxSeqNo: 17 sessionId: src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0
2025-10-02T08:13:31.665045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|727fa83a-b2101aaf-3d114c78-8cd3e7b9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:31.667574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0] Write session: try to update token
2025-10-02T08:13:31.667593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:31.670699Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:31.670721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:31.670724Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:31.670733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534585461538760:11634]
2025-10-02T08:13:31.670739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534585461538760:11634]
2025-10-02T08:13:31.670781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:31.670788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.670791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:31.670929Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:31.670947Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:31.670953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:31.705382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId: src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:31.707954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:31.729744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534585461538859:6945]
2025-10-02T08:13:31.729873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1767, pipe: [1:7556534585461538859:6945]
2025-10-02T08:13:31.819659Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:31.820225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.820244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.820267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461538859:6945], now have 1 active actors on pipe
2025-10-02T08:13:31.820393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534585461538859:6945]
2025-10-02T08:13:31.820418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:31.820421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:31.820472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1768 reason: error at write: Disconnected sessionId: src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0
2025-10-02T08:13:31.820503Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:31.820504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:31.820645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1768 sessionId: src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0 is DEAD
2025-10-02T08:13:31.820824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:31.820834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0] Write session will restart in 0.005047s
2025-10-02T08:13:31.820860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0] Write session: Do CDS request
2025-10-02T08:13:31.820866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:31.827298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.827419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:31.827436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1769
2025-10-02T08:13:31.827587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:31.827629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:31.827633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:31.827634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:31.827638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:31.827980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1769 sessionId:  describe result for acl check
2025-10-02T08:13:31.828016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:31.828021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:31.828022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:31.828028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534585461539031:11577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:31.828301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:31.828422Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:31.828429Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:31.828436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:31.828441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534585461539031:11577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:31.828466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:31.828493Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534585461539034:11585]
2025-10-02T08:13:31.828920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:31.829119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:31.829177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:31.829466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:31.829508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.829514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.829515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.829517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.829518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.829523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.829533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.829538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.829542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.829545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.829550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.829561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:31.829567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.829572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:31.829576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.829581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:31.829585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.829594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.829599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.829608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.829626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:31.830315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534585461539031:11577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:31.836962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534585461539031:11577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:31.836977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534585461539031:11577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:31.836980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534585461539031:11577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:31.836988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:31.841670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:31.843206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:31.843223Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:31.843225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:31.843227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:31.843233Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1768 [1:7556534585461539034:11585]
2025-10-02T08:13:31.843242Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:31.843257Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:31.843259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.843261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.843262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.843273Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:31.843277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:31.843283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:31.843334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.843340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.843343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:31.843345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:31.843443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:31.843450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.843463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:31.843475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:31.843475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1768
2025-10-02T08:13:31.843489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461539076:11577], now have 1 active actors on pipe
2025-10-02T08:13:31.843497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534585461539025:11585]
2025-10-02T08:13:31.843499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534585461539025:11585]
2025-10-02T08:13:31.843504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:31.843514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:31.843525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:31.843530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:31.843553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:31.843562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534585461539025:11585]
2025-10-02T08:13:31.843564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:31.843564Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:31.843569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:31.843570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534585921250647:2378], now have 1 active actors on pipe
2025-10-02T08:13:31.843574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.843577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.843610Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:31.843619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:31.843622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:31.843623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:31.843629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:31.843639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:31.843655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.843675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1768
2025-10-02T08:13:31.843718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.843723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.843733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:31.843763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1769 partition: 0 MaxSeqNo: 17 sessionId: src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0
2025-10-02T08:13:31.844072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a20e0b-51b9b00d-d7fe06ad-5ae3d6ab_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:31.846636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0] Write session: try to update token
2025-10-02T08:13:31.846653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:31.861001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId: src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:31.861042Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:31.861046Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:31.861048Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:31.861057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534585461539025:11585]
2025-10-02T08:13:31.861068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534585461539025:11585]
2025-10-02T08:13:31.861110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:31.861123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:31.861124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:31.861125Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:31.861132Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:31.861264Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:31.863399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:31.920749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534585461539089:6945]
2025-10-02T08:13:31.920888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1768, pipe: [1:7556534585461539089:6945]
2025-10-02T08:13:31.994839Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:31.995113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:31.995126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:31.995165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534585461539089:6945], now have 1 active actors on pipe
2025-10-02T08:13:31.995266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:31.995271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:31.995315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1769 reason: error at write: Disconnected sessionId: src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0
2025-10-02T08:13:31.995387Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:31.995438Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:31.995452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1769 sessionId: src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0 is DEAD
2025-10-02T08:13:31.995629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:31.995639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0] Write session will restart in 0.005033s
2025-10-02T08:13:31.995622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534585461539089:6945]
2025-10-02T08:13:31.995662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0] Write session: Do CDS request
2025-10-02T08:13:31.995669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:32.002281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.002405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:32.002419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1770
2025-10-02T08:13:32.002544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.002575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:32.002580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:32.002583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:32.002832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:32.003011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1770 sessionId:  describe result for acl check
2025-10-02T08:13:32.003045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:32.003051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:32.003053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:32.003058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534589756506552:11561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:32.003322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:32.003482Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:32.003491Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:32.003500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:32.003542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:32.003577Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534589756506554:11567]
2025-10-02T08:13:32.003599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534589756506552:11561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:32.004202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:32.004356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:32.004393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:32.004684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:32.004723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.004729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.004729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.004730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.004731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.004736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.004746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.004750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.004754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.004759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.004764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.004771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.004781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.004787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.004796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.004817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.004826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.004832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.004836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.004841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.004864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:32.005433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534589756506552:11561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:32.010736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534589756506552:11561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:32.010751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534589756506552:11561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:32.010754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534589756506552:11561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:32.010769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:32.012715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:32.014349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:32.014370Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:32.014373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:32.014378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:32.014387Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1769 [1:7556534589756506554:11567]
2025-10-02T08:13:32.014398Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:32.014414Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:32.014422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.014425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.014427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.014442Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:32.014452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:32.014458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:32.014515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.014523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.014526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:32.014529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:32.014591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:32.014599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.014614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.014632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:32.014637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1769
2025-10-02T08:13:32.014662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756506597:11561], now have 1 active actors on pipe
2025-10-02T08:13:32.014666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534585921250654:2378], now have 1 active actors on pipe
2025-10-02T08:13:32.014671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.014675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.014691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534589756506547:11567]
2025-10-02T08:13:32.014693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534589756506547:11567]
2025-10-02T08:13:32.014699Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:32.014720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:32.014693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1769
2025-10-02T08:13:32.014736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:32.014739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:32.014741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:32.014746Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:32.014755Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:32.014761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.014765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.014766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:32.014775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.014782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:32.014815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534589756506547:11567]
2025-10-02T08:13:32.014827Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:32.014833Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:32.014852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.014923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.014930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.014944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.014983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1770 partition: 0 MaxSeqNo: 17 sessionId: src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0
2025-10-02T08:13:32.015315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a0604b-fe1616fc-3be92c08-66a9c6e1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:32.017905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0] Write session: try to update token
2025-10-02T08:13:32.017923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:32.026302Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:32.026320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.026328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534589756506547:11567]
2025-10-02T08:13:32.026367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:32.026369Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:32.026538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:32.026684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.026833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.026980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.027169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:32.027212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:32.032474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId: src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:32.035194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:32.035266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.035279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.035314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:32.035335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:32.035402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.035418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.035602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.035675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.035747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.035814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.036059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.036072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.036153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.036238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.036308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.036376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.036419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.036427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.036499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.036572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.036653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.036738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.036794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.036822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.036922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.037000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.037083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.037167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.037267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.037276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.037369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.037443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.037521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.037600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.037655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.037663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.037756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.037838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.037916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.037994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.038053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.038061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.038156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.038235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.038322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.038408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.038469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.038478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.038572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.038643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.038717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.038788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.038846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.038854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.038946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.039020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.039089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.039159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.039221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.039230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.039339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.039413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.039486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.039559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.039605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.039613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.039657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:32.039728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.039757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.039764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:32.039795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:32.039814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:32.039823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:32.039827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:32.039831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:32.040312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:32.040342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:32.040349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:32.040353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:32.040358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:32.040362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:32.041225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:32.041252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:32.041259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:32.041263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:32.041267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:32.041271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:32.041780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:32.041804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:32.041813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:32.041817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:32.041821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:32.044091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:32.044114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:32.044127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392812044
2025-10-02T08:13:32.044328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:32.044347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:32.044353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:32.044356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:32.044360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:32.044369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:32.044876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:32.044900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:32.044905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:32.044909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:32.044911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:32.044917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:32.045396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:32.045418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:32.045433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:32.045441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:32.045444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:32.045451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:32.045949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:32.045969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:32.045974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:32.047132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:32.047155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:32.047160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:32.047163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:32.047174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392812047
2025-10-02T08:13:32.047468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:32.047492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:32.047498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:32.047506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:32.047510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:32.047515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:32.047993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:32.048016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:32.048026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:32.048033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:32.048037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:32.048040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:32.048514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:32.048535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.048635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392812048
2025-10-02T08:13:32.049433Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:32.049453Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:32.049459Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:32.049466Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:32.051158Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:32.051173Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.051175Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:32.051181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534589756506547:11567]
2025-10-02T08:13:32.051186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534589756506547:11567]
2025-10-02T08:13:32.051241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:32.051245Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:32.051251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:32.051253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.051255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:32.051408Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:32.095811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534589756506617:6945]
2025-10-02T08:13:32.095924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1769, pipe: [1:7556534589756506617:6945]
2025-10-02T08:13:32.189782Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:32.190171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756506617:6945], now have 1 active actors on pipe
2025-10-02T08:13:32.190303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534589756506617:6945]
2025-10-02T08:13:32.190326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:32.190328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:32.190352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1770 reason: error at write: Disconnected sessionId: src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0
2025-10-02T08:13:32.190430Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:32.190412Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:32.190518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1770 sessionId: src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0 is DEAD
2025-10-02T08:13:32.190690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:32.190698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0] Write session will restart in 0.008620s
2025-10-02T08:13:32.190722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0] Write session: Do CDS request
2025-10-02T08:13:32.190729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:32.197968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:32.198586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:32.198820Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:32.198829Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:32.198838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:32.198882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:32.198921Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534589756506781:11541]
2025-10-02T08:13:32.199529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:32.199705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:32.199741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:32.200024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:32.200065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.200070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.200071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.200072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.200073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.200077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.200087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.200091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.200094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.200097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.200101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.200108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.200113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.200118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.200122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.200126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.200129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.200133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.200137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.200141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.200159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:32.200326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.200392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:32.200404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1771
2025-10-02T08:13:32.200564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.200594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:32.200602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:32.200605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:32.200990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1771 sessionId:  describe result for acl check
2025-10-02T08:13:32.201026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:32.201033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:32.201034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:32.201039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534589756506797:11542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:32.201589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534589756506797:11542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:32.203836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534589756506797:11542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:32.207492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534589756506797:11542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:32.207510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534589756506797:11542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:32.207513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534589756506797:11542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:32.207526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:32.211254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:32.212849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:32.212868Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:32.212871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:32.212875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:32.212883Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1770 [1:7556534589756506781:11541]
2025-10-02T08:13:32.212896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:32.212915Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:32.212918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.212922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.212925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.212943Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:32.212954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:32.212962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:32.213039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.213047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.213050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:32.213053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:32.213120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:32.213130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.213145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.213161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:32.213182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534589756506775:11541]
2025-10-02T08:13:32.213189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534589756506775:11541]
2025-10-02T08:13:32.213197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:32.213207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1770
2025-10-02T08:13:32.213216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756506828:11542], now have 1 active actors on pipe
2025-10-02T08:13:32.213226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:32.213240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:32.213247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:32.213253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534590216217959:2378], now have 1 active actors on pipe
2025-10-02T08:13:32.213268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:32.213280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:32.213287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534589756506775:11541]
2025-10-02T08:13:32.213290Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:32.213293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:32.213295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.213299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.213300Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1770
2025-10-02T08:13:32.213337Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93c72468-76f2be1-1a38f058-62d87598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:32.213350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.213354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.213356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:32.213363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.213376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:32.213413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.213565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.213579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.213604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.213645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1771 partition: 0 MaxSeqNo: 17 sessionId: src_id|93c72468-76f2be1-1a38f058-62d87598_0
2025-10-02T08:13:32.213981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8372d8-2fa99a4c-2d6a87a4-acfe30a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|93c72468-76f2be1-1a38f058-62d87598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:32.216785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93c72468-76f2be1-1a38f058-62d87598_0] Write session: try to update token
2025-10-02T08:13:32.216830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93c72468-76f2be1-1a38f058-62d87598_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:32.231312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId: src_id|93c72468-76f2be1-1a38f058-62d87598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:32.231709Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:32.231720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.231721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:32.231728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534589756506775:11541]
2025-10-02T08:13:32.231731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534589756506775:11541]
2025-10-02T08:13:32.231767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:32.231776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.231778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:32.231778Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:32.231784Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:32.231913Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:32.233836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:32.290375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534589756506843:6945]
2025-10-02T08:13:32.290474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1770, pipe: [1:7556534589756506843:6945]
2025-10-02T08:13:32.366092Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:32.366589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.366601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.366634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756506843:6945], now have 1 active actors on pipe
2025-10-02T08:13:32.366738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:32.366749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:32.366812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1771 reason: error at write: Disconnected sessionId: src_id|93c72468-76f2be1-1a38f058-62d87598_0
2025-10-02T08:13:32.366816Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:32.366950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1771 sessionId: src_id|93c72468-76f2be1-1a38f058-62d87598_0 is DEAD
2025-10-02T08:13:32.367086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c72468-76f2be1-1a38f058-62d87598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:32.367095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c72468-76f2be1-1a38f058-62d87598_0] Write session will restart in 0.005738s
2025-10-02T08:13:32.367113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c72468-76f2be1-1a38f058-62d87598_0] Write session: Do CDS request
2025-10-02T08:13:32.367101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534589756506843:6945]
2025-10-02T08:13:32.367118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c72468-76f2be1-1a38f058-62d87598_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:32.368204Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:32.374294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93c72468-76f2be1-1a38f058-62d87598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.374286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:32.374325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:32.374332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1772
2025-10-02T08:13:32.374469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.374499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:32.374508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:32.374511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:32.374913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1772 sessionId:  describe result for acl check
2025-10-02T08:13:32.374955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:32.374962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:32.374964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:32.374969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534589756507014:11524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:32.375124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:32.375256Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:32.375262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:32.375269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:32.375298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:32.375340Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534589756507016:11528]
2025-10-02T08:13:32.375470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534589756507014:11524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:32.375734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:32.375912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:32.375970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:32.376285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:32.376350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.376356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.376358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.376359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.376362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.376367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.376376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.376379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.376382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.376390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.376395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.376407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.376417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.376426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.376431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.376435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.376439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.376446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.376455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.376464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.376485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:32.377016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534589756507014:11524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:32.382128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534589756507014:11524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:32.382143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534589756507014:11524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:32.382145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534589756507014:11524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:32.382154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:32.384341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:32.385969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:32.385984Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:32.385985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:32.385988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:32.385993Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1771 [1:7556534589756507016:11528]
2025-10-02T08:13:32.386001Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:32.386016Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:32.386018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.386020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.386021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.386035Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:32.386040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:32.386044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:32.386092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.386098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.386100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:32.386101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:32.386148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:32.386153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.386161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.386168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:32.386183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534589756507007:11528]
2025-10-02T08:13:32.386188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534589756507007:11528]
2025-10-02T08:13:32.386193Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:32.386202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:32.386210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:32.386215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:32.386216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:32.386219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:32.386225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756507062:11524], now have 1 active actors on pipe
2025-10-02T08:13:32.386250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534590216217966:2378], now have 1 active actors on pipe
2025-10-02T08:13:32.386253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1771
2025-10-02T08:13:32.386255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534589756507007:11528]
2025-10-02T08:13:32.386260Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:32.386265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.386267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.386268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:32.386296Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:32.386309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.386312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.386313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:32.386319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.386326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:32.386343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.386329Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1771
2025-10-02T08:13:32.386386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.386401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.386427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.386471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1772 partition: 0 MaxSeqNo: 17 sessionId: src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0
2025-10-02T08:13:32.386790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93c72468-76f2be1-1a38f058-62d87598_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:32.389661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0] Write session: try to update token
2025-10-02T08:13:32.389678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:32.403659Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:32.403679Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.403683Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:32.403690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534589756507007:11528]
2025-10-02T08:13:32.403693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534589756507007:11528]
2025-10-02T08:13:32.403727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:32.403732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.403733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:32.403746Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:32.403753Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:32.403867Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:32.404441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId: src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:32.407171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:32.467004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534589756507076:6945]
2025-10-02T08:13:32.467117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1771, pipe: [1:7556534589756507076:6945]
2025-10-02T08:13:32.543722Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:32.544033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.544047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.544085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756507076:6945], now have 1 active actors on pipe
2025-10-02T08:13:32.544322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:32.544343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:32.544352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:32.544407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1772 reason: error at write: Disconnected sessionId: src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0
2025-10-02T08:13:32.544591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1772 sessionId: src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0 is DEAD
2025-10-02T08:13:32.544720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:32.544733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0] Write session will restart in 0.009405s
2025-10-02T08:13:32.544768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0] Write session: Do CDS request
2025-10-02T08:13:32.544775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:32.544786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534589756507076:6945]
2025-10-02T08:13:32.544871Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:32.552937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:32.553585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:32.553754Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:32.553762Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:32.553770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:32.553808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:32.553846Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534589756507255:11512]
2025-10-02T08:13:32.554432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:32.554582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:32.554610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:32.554808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:32.554838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.554842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.554843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.554843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.554844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.554847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.554853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.554855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.554857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.554859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.554863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.554867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.554870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.554872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.554875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.554877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.554879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.554882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.554884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.554888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.554903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:32.555212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.555345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:32.555354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1773
2025-10-02T08:13:32.555449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.555474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:32.555483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:32.555486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:32.555822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1773 sessionId:  describe result for acl check
2025-10-02T08:13:32.555850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:32.555852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:32.555853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:32.555857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534589756507271:11501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:32.556270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534589756507271:11501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:32.558496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534589756507271:11501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:32.562492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534589756507271:11501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:32.562509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534589756507271:11501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:32.562512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534589756507271:11501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:32.562521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:32.563294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:32.564855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:32.564871Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:32.564873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:32.564878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:32.564884Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1772 [1:7556534589756507255:11512]
2025-10-02T08:13:32.564896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:32.564914Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:32.564920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.564923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.564924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.564936Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:32.564940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:32.564945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:32.564992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.564998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.565000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:32.565002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:32.565101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:32.565106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.565115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.565125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1772
2025-10-02T08:13:32.565130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:32.565149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756507303:11501], now have 1 active actors on pipe
2025-10-02T08:13:32.565152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534590216217985:2378], now have 1 active actors on pipe
2025-10-02T08:13:32.565158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.565161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.565177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534589756507249:11512]
2025-10-02T08:13:32.565186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534589756507249:11512]
2025-10-02T08:13:32.565195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:32.565210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:32.565210Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:32.565213Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:32.565222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:32.565224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:32.565235Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a41603f9-313cb5f4-1d606201-aae57f71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:32.565242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.565211Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1772
2025-10-02T08:13:32.565246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.565252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:32.565261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.565269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:32.565302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534589756507249:11512]
2025-10-02T08:13:32.565312Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:32.565326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.565345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:32.565380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.565394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.565417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.565461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1773 partition: 0 MaxSeqNo: 17 sessionId: src_id|a41603f9-313cb5f4-1d606201-aae57f71_0
2025-10-02T08:13:32.565791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a24a022f-c6a3bb2a-1fdb316e-763ea7db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a41603f9-313cb5f4-1d606201-aae57f71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:32.568398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41603f9-313cb5f4-1d606201-aae57f71_0] Write session: try to update token
2025-10-02T08:13:32.568412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41603f9-313cb5f4-1d606201-aae57f71_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:32.582775Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:32.582796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.582805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534589756507249:11512]
2025-10-02T08:13:32.582847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:32.582900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId: src_id|a41603f9-313cb5f4-1d606201-aae57f71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:32.582943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:32.583042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:32.583182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.583328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.583471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.583796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:32.583839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:32.585594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:32.585685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.585704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.585735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:32.585766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:32.585825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.585839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.586015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.586081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.586149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.586221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.586269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.586279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.586349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.586418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.586487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.586556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.586605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.586613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.586683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.586747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.586813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.586878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.586927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.586938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.587011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.587086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.587161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.587240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.587298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.587307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.587384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.587484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.587562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.587639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.587696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.587705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.587785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.587857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.587935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.588013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.588088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.588096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.588174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.588259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.588339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.588416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.588474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.588482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.588559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.588633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.588711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.588792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.588903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.588916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.588995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.589065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.589134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.589205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.589263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.589274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.589350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.589418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.589488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.589565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.589623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.589631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.589672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:32.589741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.589765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.589772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:32.589808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:32.589826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:32.589835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:32.589838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:32.589842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:32.590264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:32.590299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:32.590307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:32.590310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:32.590314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:32.590318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:32.590937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:32.590965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:32.590978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:32.590990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:32.590999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:32.591008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:32.591499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:32.591525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:32.591535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:32.591542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:32.591545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:32.592898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:32.592918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:32.592931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392812592
2025-10-02T08:13:32.593092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:32.593113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:32.593119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:32.593122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:32.593127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:32.593130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:32.593632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:32.593661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:32.593673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:32.593682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:32.593685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:32.593693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:32.594193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:32.594218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:32.594232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:32.594241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:32.594245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:32.594248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:32.594763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:32.594792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:32.594798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:32.595937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:32.595959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:32.595965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:32.595969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:32.595977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392812595
2025-10-02T08:13:32.596332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:32.596357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:32.596365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:32.596376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:32.596379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:32.596388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:32.596898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:32.596922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:32.596928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:32.596932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:32.596935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:32.596941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:32.597413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:32.597437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.597541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392812597
2025-10-02T08:13:32.598318Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:32.598352Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:32.598365Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:32.598374Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:32.600128Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:32.600138Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.600140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:32.600150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534589756507249:11512]
2025-10-02T08:13:32.600154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534589756507249:11512]
2025-10-02T08:13:32.600201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:32.600203Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:32.600206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.600208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:32.600209Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:32.600353Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:32.645212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534589756507327:6945]
2025-10-02T08:13:32.645349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1772, pipe: [1:7556534589756507327:6945]
2025-10-02T08:13:32.737143Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:32.737447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756507327:6945], now have 1 active actors on pipe
2025-10-02T08:13:32.737561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534589756507327:6945]
2025-10-02T08:13:32.737672Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:32.737742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:32.738119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:32.738152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1773 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a41603f9-313cb5f4-1d606201-aae57f71_0
2025-10-02T08:13:32.738301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1773 sessionId: src_id|a41603f9-313cb5f4-1d606201-aae57f71_0 is DEAD
2025-10-02T08:13:32.738460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41603f9-313cb5f4-1d606201-aae57f71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:32.738469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41603f9-313cb5f4-1d606201-aae57f71_0] Write session will restart in 0.008814s
2025-10-02T08:13:32.738490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41603f9-313cb5f4-1d606201-aae57f71_0] Write session: Do CDS request
2025-10-02T08:13:32.738496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41603f9-313cb5f4-1d606201-aae57f71_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:32.744516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:32.745236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:32.745367Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:32.745374Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:32.745380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:32.745409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:32.745435Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534589756507510:11499]
2025-10-02T08:13:32.745856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:32.746010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:32.746040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:32.746257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:32.746289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.746293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.746294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.746295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.746295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.746298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.746305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.746307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.746309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.746311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.746315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.746320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.746324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.746327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.746329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.746331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.746333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.746336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.746338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.746341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.746352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:32.748310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41603f9-313cb5f4-1d606201-aae57f71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.748383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:32.748394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1774
2025-10-02T08:13:32.748520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.748548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:32.748557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:32.748560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:32.748997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1774 sessionId:  describe result for acl check
2025-10-02T08:13:32.749026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:32.749031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:32.749033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:32.749037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534589756507526:11492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:32.749484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534589756507526:11492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:32.751495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534589756507526:11492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:32.754312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:32.754937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534589756507526:11492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:32.754949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534589756507526:11492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:32.754951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534589756507526:11492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:32.754960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:32.755823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:32.755838Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:32.755840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:32.755842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:32.755847Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1773 [1:7556534589756507510:11499]
2025-10-02T08:13:32.755853Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:32.755866Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:32.755872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.755874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.755876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.755887Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:32.755894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:32.755899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:32.755939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.755944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.755946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:32.755947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:32.755993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:32.756000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.756008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.756019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:32.756035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756507565:11492], now have 1 active actors on pipe
2025-10-02T08:13:32.756042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534590216217994:2378], now have 1 active actors on pipe
2025-10-02T08:13:32.756047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534589756507504:11499]
2025-10-02T08:13:32.756049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534589756507504:11499]
2025-10-02T08:13:32.756060Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:32.756076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:32.756077Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1773
2025-10-02T08:13:32.756078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:32.756079Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:32.756086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:32.756088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:32.756110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534589756507504:11499]
2025-10-02T08:13:32.756112Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:32.756115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:32.756187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1773
2025-10-02T08:13:32.756220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.756236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.756262Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:32.756273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.756281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.756283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:32.756291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.756300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:32.756319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.756403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.756413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.756432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.756472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1774 partition: 0 MaxSeqNo: 17 sessionId: src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0
2025-10-02T08:13:32.756776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41603f9-313cb5f4-1d606201-aae57f71_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:32.759319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0] Write session: try to update token
2025-10-02T08:13:32.759333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:32.766962Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:32.766983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.766991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534589756507504:11499]
2025-10-02T08:13:32.767029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:32.767040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:32.767204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:32.767353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.767498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.767641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:32.767837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:32.767876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:32.772869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId: src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:32.775677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:32.775752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.775764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.775796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:32.775817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:32.775875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.775908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.776074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.776155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.776247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.776332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.776381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.776392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.776466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.776532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.776599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.776672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.776718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.776728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.776827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.776893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.776956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.777022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.777068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.777076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.777143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.777221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.777295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.777389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.777442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.777461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.777541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.777606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.777677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.777748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.777798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.777801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.777877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.777941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.778008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.778074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.778121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.778125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.778203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.778268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.778340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.778411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.778464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.778466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.778551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.778617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.778690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.778762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.778813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.778816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.778898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.778956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.779014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.779077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.779126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.779129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.779210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:32.779273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:32.779337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:32.779400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:32.779449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:32.779452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:32.779492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:32.779556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.779575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.779577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:32.779607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:32.779619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:32.779622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:32.779624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:32.779627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:32.780044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:32.780061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:32.780067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:32.780071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:32.780077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:32.780080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:32.780738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:32.780754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:32.780761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:32.780764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:32.780768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:32.780771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:32.781609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:32.781642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:32.781648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:32.781651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:32.781654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:32.782930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:32.782956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:32.782968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392812782
2025-10-02T08:13:32.783125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:32.783146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:32.783152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:32.783157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:32.783161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:32.783164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:32.783625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:32.783652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:32.783658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:32.783661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:32.783664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:32.783667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:32.784146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:32.784173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:32.784182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:32.784185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:32.784189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:32.784203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:32.784700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:32.784729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:32.784734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:32.785961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:32.785984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:32.785990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:32.785994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:32.786003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392812785
2025-10-02T08:13:32.786325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:32.786351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:32.786363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:32.786366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:32.786377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:32.786381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:32.786878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:32.786899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:32.786905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:32.786909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:32.786912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:32.786915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:32.787372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:32.787396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.787497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392812787
2025-10-02T08:13:32.788304Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:32.788325Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:32.788332Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:32.788340Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:32.790035Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:32.790055Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.790057Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:32.790070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534589756507504:11499]
2025-10-02T08:13:32.790073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534589756507504:11499]
2025-10-02T08:13:32.790134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:32.790143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.790145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:32.790163Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:32.790169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:32.790289Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:32.837739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534589756507606:6945]
2025-10-02T08:13:32.837926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1773, pipe: [1:7556534589756507606:6945]
2025-10-02T08:13:32.934254Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:32.934614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756507606:6945], now have 1 active actors on pipe
2025-10-02T08:13:32.934738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534589756507606:6945]
2025-10-02T08:13:32.934773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:32.934778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:32.934796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1774 reason: error at write: Disconnected sessionId: src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0
2025-10-02T08:13:32.934845Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:32.934866Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:32.934950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1774 sessionId: src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0 is DEAD
2025-10-02T08:13:32.935114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:32.935124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0] Write session will restart in 0.007457s
2025-10-02T08:13:32.935145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0] Write session: Do CDS request
2025-10-02T08:13:32.935151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:32.943235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:32.943281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.943364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:32.943374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1775
2025-10-02T08:13:32.943470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:32.943504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:32.943513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:32.943516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:32.943609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:32.943759Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:32.943768Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:32.943776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:32.943816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:32.943848Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534589756507778:11472]
2025-10-02T08:13:32.943920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1775 sessionId:  describe result for acl check
2025-10-02T08:13:32.943953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:32.943959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:32.943960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:32.943965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534589756507781:11453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:32.944324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:32.944366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534589756507781:11453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:32.944486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:32.944526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:32.944745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:32.944776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.944780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.944780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.944781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.944782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.944785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.944791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.944793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.944795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.944797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.944820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.944828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:32.944832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.944837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:32.944839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.944841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:32.944843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.944846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.944848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.944854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.944869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:32.946035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534589756507781:11453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:32.952207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534589756507781:11453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:32.952226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534589756507781:11453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:32.952229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534589756507781:11453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:32.952239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:32.952915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:32.954243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:32.954257Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:32.954259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:32.954262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:32.954266Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1774 [1:7556534589756507778:11472]
2025-10-02T08:13:32.954273Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:32.954289Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:32.954290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.954292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.954293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.954305Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:32.954308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:32.954313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:32.954353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.954359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.954361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:32.954363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:32.954411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:32.954416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.954425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:32.954432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:32.954445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534589756507823:11453], now have 1 active actors on pipe
2025-10-02T08:13:32.954449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1774
2025-10-02T08:13:32.954453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534589756507770:11472]
2025-10-02T08:13:32.954454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534589756507770:11472]
2025-10-02T08:13:32.954459Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:32.954465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534590216218022:2378], now have 1 active actors on pipe
2025-10-02T08:13:32.954467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:32.954469Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:32.954470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.954472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.954484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:32.954497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:32.954503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:32.954510Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1774
2025-10-02T08:13:32.954533Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:32.954541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:32.954545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:32.954546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:32.954551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:32.954557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:32.954562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534589756507770:11472]
2025-10-02T08:13:32.954567Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:32.954574Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:32.954589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.954620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:32.954633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:32.954650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:32.954682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1775 partition: 0 MaxSeqNo: 17 sessionId: src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0
2025-10-02T08:13:32.955016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a77a96a-a282eda6-12d5accc-d7ecbd70_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:32.957420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0] Write session: try to update token
2025-10-02T08:13:32.957435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:32.970526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId: src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:32.971857Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:32.971876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:32.971879Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:32.971887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534589756507770:11472]
2025-10-02T08:13:32.971892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534589756507770:11472]
2025-10-02T08:13:32.971934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:32.971933Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:32.971941Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:32.971945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:32.971948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:32.972079Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:32.973122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:33.034823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534594051475137:6945]
2025-10-02T08:13:33.034963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1774, pipe: [1:7556534594051475137:6945]
2025-10-02T08:13:33.103976Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:33.104358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.104372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.104407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051475137:6945], now have 1 active actors on pipe
2025-10-02T08:13:33.104506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:33.104513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:33.104562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1775 reason: error at write: Disconnected sessionId: src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0
2025-10-02T08:13:33.104598Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:33.104672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:33.104711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1775 sessionId: src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0 is DEAD
2025-10-02T08:13:33.104873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:33.104867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534594051475137:6945]
2025-10-02T08:13:33.104888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0] Write session will restart in 0.008139s
2025-10-02T08:13:33.104924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0] Write session: Do CDS request
2025-10-02T08:13:33.104931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:33.112283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:33.112945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:33.113111Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:33.113120Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:33.113129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:33.113173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:33.113210Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534594051475310:11442]
2025-10-02T08:13:33.113854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:33.114037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:33.114075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:33.114296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.114369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:33.114381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:33.114387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1776
2025-10-02T08:13:33.114408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.114414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.114415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.114416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.114417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.114421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.114431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.114435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.114439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.114442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.114447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.114454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.114460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.114465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.114469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.114473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.114477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.114482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.114486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.114489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.114490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.114508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:33.114515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:33.114526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:33.114530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:33.114900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1776 sessionId:  describe result for acl check
2025-10-02T08:13:33.114933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:33.114934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:33.114935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:33.114940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534594051475326:11439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:33.115433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534594051475326:11439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:33.117816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534594051475326:11439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:33.122620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534594051475326:11439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:33.122638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534594051475326:11439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:33.122642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534594051475326:11439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:33.122658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:33.123180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:33.124763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:33.124778Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:33.124780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:33.124786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:33.124794Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1775 [1:7556534594051475310:11442]
2025-10-02T08:13:33.124821Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:33.124838Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:33.124846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.124849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.124852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.124868Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:33.124876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:33.124881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:33.124928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.124935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.124937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:33.124938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:33.124999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:33.125006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.125016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.125023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:33.125042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534594051475304:11442]
2025-10-02T08:13:33.125047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534594051475304:11442]
2025-10-02T08:13:33.125054Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:33.125067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1775
2025-10-02T08:13:33.125067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:33.125069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051475357:11439], now have 1 active actors on pipe
2025-10-02T08:13:33.125071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:33.125075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:33.125089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:33.125091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:33.125096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534594511185326:2378], now have 1 active actors on pipe
2025-10-02T08:13:33.125129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.125138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.125150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534594051475304:11442]
2025-10-02T08:13:33.125160Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:33.125178Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:33.125188Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:33.125195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.125200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.125202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:33.125165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1775
2025-10-02T08:13:33.125211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.125221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:33.125244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.125283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.125289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.125301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.125336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1776 partition: 0 MaxSeqNo: 17 sessionId: src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0
2025-10-02T08:13:33.125645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fb3f68-62450aef-63adb34c-55d3d9bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:33.128297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0] Write session: try to update token
2025-10-02T08:13:33.128315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:33.141970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId: src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:33.143201Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:33.143214Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:33.143217Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:33.143226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534594051475304:11442]
2025-10-02T08:13:33.143231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534594051475304:11442]
2025-10-02T08:13:33.143276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:33.143287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.143287Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:33.143290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:33.143294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:33.143431Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:33.144550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:33.204831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534594051475373:6945]
2025-10-02T08:13:33.204975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1775, pipe: [1:7556534594051475373:6945]
2025-10-02T08:13:33.277147Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:33.277477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.277491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.277532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051475373:6945], now have 1 active actors on pipe
2025-10-02T08:13:33.277672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:33.277683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:33.277745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1776 reason: error at write: Disconnected sessionId: src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0
2025-10-02T08:13:33.277757Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:33.277772Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:33.277897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1776 sessionId: src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0 is DEAD
2025-10-02T08:13:33.278043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534594051475373:6945]
2025-10-02T08:13:33.280890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:33.280902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0] Write session will restart in 0.009970s
2025-10-02T08:13:33.280927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0] Write session: Do CDS request
2025-10-02T08:13:33.280933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:33.288183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:33.289036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:33.289205Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:33.289215Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:33.289224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:33.289268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:33.289312Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534594051475546:11430]
2025-10-02T08:13:33.289978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:33.290202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:33.290274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:33.290611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:33.290671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.290677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.290678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.290679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.290680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.290685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.290695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.290698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.290702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.290705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.290711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.290718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.290724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.290733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.290737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.290742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.290746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.290751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.290755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.290760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.290776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:33.292317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.292365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:33.292375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1777
2025-10-02T08:13:33.292576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.292630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:33.292639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:33.292643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:33.293125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1777 sessionId:  describe result for acl check
2025-10-02T08:13:33.293160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:33.293166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:33.293168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:33.293173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534594051475563:11425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:33.293702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534594051475563:11425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:33.295870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534594051475563:11425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:33.298993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534594051475563:11425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:33.299004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534594051475563:11425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:33.299008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534594051475563:11425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:33.299015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:33.299491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:33.301194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:33.301207Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:33.301210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:33.301214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:33.301220Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1776 [1:7556534594051475546:11430]
2025-10-02T08:13:33.301231Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:33.301247Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:33.301250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.301253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.301256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.301274Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:33.301284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:33.301290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:33.301347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.301355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.301358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:33.301361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:33.301423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:33.301430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.301443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.301457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:33.301479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051475594:11425], now have 1 active actors on pipe
2025-10-02T08:13:33.301480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1776
2025-10-02T08:13:33.301490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534594051475540:11430]
2025-10-02T08:13:33.301492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534594051475540:11430]
2025-10-02T08:13:33.301499Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:33.301507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534594511185334:2378], now have 1 active actors on pipe
2025-10-02T08:13:33.301509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:33.301512Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:33.301514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.301519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.301534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:33.301548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:33.301556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:33.301597Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:33.301583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1776
2025-10-02T08:13:33.301607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.301611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.301612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:33.301620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.301628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:33.301638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534594051475540:11430]
2025-10-02T08:13:33.301649Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:33.301659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:33.301676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.301719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.301725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.301738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.301775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1777 partition: 0 MaxSeqNo: 17 sessionId: src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0
2025-10-02T08:13:33.302082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace49898-7235e53d-33b4ea3a-6ce3941c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:33.304885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0] Write session: try to update token
2025-10-02T08:13:33.304900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:33.320521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId: src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:33.320693Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:33.320707Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:33.320710Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:33.320719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534594051475540:11430]
2025-10-02T08:13:33.320724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534594051475540:11430]
2025-10-02T08:13:33.320772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:33.320784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.320786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:33.320796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:33.320824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:33.320991Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:33.323150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:33.378401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534594051475612:6945]
2025-10-02T08:13:33.378712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1776, pipe: [1:7556534594051475612:6945]
2025-10-02T08:13:33.460993Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:33.461287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.461300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.461332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051475612:6945], now have 1 active actors on pipe
2025-10-02T08:13:33.461446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534594051475612:6945]
2025-10-02T08:13:33.461474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:33.461480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:33.461497Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:33.461542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1777 reason: error at write: Disconnected sessionId: src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0
2025-10-02T08:13:33.461556Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:33.461705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1777 sessionId: src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0 is DEAD
2025-10-02T08:13:33.462039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:33.462046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0] Write session will restart in 0.007064s
2025-10-02T08:13:33.462070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0] Write session: Do CDS request
2025-10-02T08:13:33.462075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:33.470286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.470322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:33.470334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1778
2025-10-02T08:13:33.470502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.470544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:33.470554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:33.470557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:33.470960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1778 sessionId:  describe result for acl check
2025-10-02T08:13:33.470993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:33.470998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:33.471000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:33.471005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534594051475756:11410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:33.471480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534594051475756:11410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:33.472864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:33.473450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534594051475756:11410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:33.473764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:33.473920Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:33.473928Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:33.473936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:33.473974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:33.474016Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534594051475817:11420]
2025-10-02T08:13:33.474549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:33.474730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:33.474785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:33.475089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:33.475151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.475160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.475161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.475162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.475163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.475168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.475177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.475186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.475194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.475199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.475208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.475220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.475230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.475236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.475244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.475249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.475257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.475266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.475270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.475279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.475299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:33.475926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534594051475756:11410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:33.475937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534594051475756:11410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:33.475940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534594051475756:11410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:33.475951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:33.487564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:33.489354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:33.489377Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:33.489380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:33.489384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:33.489390Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1777 [1:7556534594051475817:11420]
2025-10-02T08:13:33.489402Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:33.489421Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:33.489431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.489434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.489436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.489452Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:33.489456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:33.489467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:33.489535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.489544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.489547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:33.489549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:33.489619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:33.489627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.489641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.489652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:33.489675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051475836:11410], now have 1 active actors on pipe
2025-10-02T08:13:33.489686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534594051475801:11420]
2025-10-02T08:13:33.489687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534594051475801:11420]
2025-10-02T08:13:33.489694Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:33.489704Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:33.489705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534594511185353:2378], now have 1 active actors on pipe
2025-10-02T08:13:33.489709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1777
2025-10-02T08:13:33.489710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:33.489711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:33.489724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:33.489726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:33.489761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.489770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.489782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534594051475801:11420]
2025-10-02T08:13:33.489795Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:33.489807Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1777
2025-10-02T08:13:33.489825Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:33.489827Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:33.489838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.489843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.489844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:33.489854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.489862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:33.489889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.489939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.489945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.489958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.489992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1778 partition: 0 MaxSeqNo: 17 sessionId: src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0
2025-10-02T08:13:33.490314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd01f960-73db35e0-55fa85cc-6e2f9bb0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:33.492942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0] Write session: try to update token
2025-10-02T08:13:33.492959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:33.507077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId: src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:33.507581Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:33.507597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:33.507600Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:33.507608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534594051475801:11420]
2025-10-02T08:13:33.507611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534594051475801:11420]
2025-10-02T08:13:33.507654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:33.507666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.507673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:33.507746Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:33.507758Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:33.507805Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:33.509848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:33.561686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534594051475863:6945]
2025-10-02T08:13:33.561800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1777, pipe: [1:7556534594051475863:6945]
2025-10-02T08:13:33.655319Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:33.655625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.655637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.655673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051475863:6945], now have 1 active actors on pipe
2025-10-02T08:13:33.655783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:33.655791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:33.655842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1778 reason: error at write: Disconnected sessionId: src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0
2025-10-02T08:13:33.655934Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:33.656000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1778 sessionId: src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0 is DEAD
2025-10-02T08:13:33.655990Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:33.656121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:33.656129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0] Write session will restart in 0.009898s
2025-10-02T08:13:33.656150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0] Write session: Do CDS request
2025-10-02T08:13:33.656156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:33.656169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534594051475863:6945]
2025-10-02T08:13:33.664374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:33.664864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:33.665025Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:33.665034Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:33.665044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:33.665087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:33.665122Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534594051476049:11414]
2025-10-02T08:13:33.665525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:33.665672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:33.665706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:33.665911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:33.665948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.665952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.665954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.665954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.665955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.665960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.665970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.665973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.665977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.665980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.665986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.665992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.665998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.666002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.666006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.666010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.666015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.666020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.666028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.666033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.666054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:33.667278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.667343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:33.667355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1779
2025-10-02T08:13:33.667468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.667498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:33.667502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:33.667505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:33.667931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1779 sessionId:  describe result for acl check
2025-10-02T08:13:33.667965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:33.667971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:33.667972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:33.667978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534594051476066:11412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:33.668435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534594051476066:11412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:33.670549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534594051476066:11412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:33.673144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534594051476066:11412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:33.673162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534594051476066:11412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:33.673166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534594051476066:11412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:33.673175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:33.673832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:33.675393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:33.675411Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:33.675413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:33.675418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:33.675423Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1778 [1:7556534594051476049:11414]
2025-10-02T08:13:33.675435Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:33.675452Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:33.675454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.675457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.675459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.675475Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:33.675485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:33.675491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:33.675550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.675557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.675560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:33.675562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:33.675623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:33.675629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.675641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.675655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:33.675676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051476097:11412], now have 1 active actors on pipe
2025-10-02T08:13:33.675676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1778
2025-10-02T08:13:33.675683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534594511185360:2378], now have 1 active actors on pipe
2025-10-02T08:13:33.675689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534594051476043:11414]
2025-10-02T08:13:33.675691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534594051476043:11414]
2025-10-02T08:13:33.675703Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:33.675715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.675717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:33.675720Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:33.675722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.675739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:33.675755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:33.675762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:33.675756Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1778
2025-10-02T08:13:33.675803Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:33.675817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.675820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.675821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:33.675829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.675838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:33.675845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534594051476043:11414]
2025-10-02T08:13:33.675853Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:33.675870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:33.675883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.675946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.675972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.675998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.676037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1779 partition: 0 MaxSeqNo: 17 sessionId: src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0
2025-10-02T08:13:33.676390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7075a123-4c45e8fb-5dd2cac6-3449a1b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:33.679088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0] Write session: try to update token
2025-10-02T08:13:33.679103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:33.693679Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:33.693698Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:33.693701Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:33.693710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534594051476043:11414]
2025-10-02T08:13:33.693714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534594051476043:11414]
2025-10-02T08:13:33.693755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:33.693760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.693762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:33.693771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:33.693779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:33.693901Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:33.696101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId: src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:33.698787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:33.756272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534594051476113:6945]
2025-10-02T08:13:33.756373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1778, pipe: [1:7556534594051476113:6945]
2025-10-02T08:13:33.829891Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:33.830209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.830222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.830259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051476113:6945], now have 1 active actors on pipe
2025-10-02T08:13:33.830382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:33.830388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:33.830445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1779 reason: error at write: Disconnected sessionId: src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0
2025-10-02T08:13:33.830480Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:33.830467Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:33.830601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1779 sessionId: src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0 is DEAD
2025-10-02T08:13:33.830715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:33.830721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0] Write session will restart in 0.008615s
2025-10-02T08:13:33.830738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0] Write session: Do CDS request
2025-10-02T08:13:33.830743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:33.830735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534594051476113:6945]
2025-10-02T08:13:33.838554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:33.839396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:33.839543Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:33.839551Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:33.839558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:33.839592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:33.839632Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534594051476326:11381]
2025-10-02T08:13:33.840046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:33.840228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:33.840251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.840270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:33.840338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:33.840348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1780
2025-10-02T08:13:33.840460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:33.840487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:33.840495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:33.840499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:33.840532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:33.840575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.840576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.840577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.840578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.840579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.840583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.840591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.840594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.840597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.840600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.840604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.840611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:33.840616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.840621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:33.840624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.840628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:33.840631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.840635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.840639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.840642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.840657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:33.840952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1780 sessionId:  describe result for acl check
2025-10-02T08:13:33.840985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:33.840991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:33.840992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:33.840997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534594051476342:11379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:33.841464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534594051476342:11379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:33.843723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534594051476342:11379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:33.847655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534594051476342:11379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:33.847670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534594051476342:11379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:33.847672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534594051476342:11379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:33.847680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:33.848173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:33.849740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:33.849755Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:33.849758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:33.849761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:33.849766Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1779 [1:7556534594051476326:11381]
2025-10-02T08:13:33.849775Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:33.849792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:33.849794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.849798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.849800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.849812Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:33.849816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:33.849822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:33.849880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.849887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.849890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:33.849892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:33.849953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:33.849961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.849972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:33.849982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:33.850003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534594051476320:11381]
2025-10-02T08:13:33.850009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534594051476320:11381]
2025-10-02T08:13:33.850020Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:33.850037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:33.850057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:33.850060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:33.850070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:33.850073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:33.850090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534594051476320:11381]
2025-10-02T08:13:33.850093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:33.850130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1779
2025-10-02T08:13:33.850141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051476371:11379], now have 1 active actors on pipe
2025-10-02T08:13:33.850143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:33.850252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.850264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.850280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534594511185382:2378], now have 1 active actors on pipe
2025-10-02T08:13:33.850305Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|455b5946-56077a62-76ab5aa5-34aac492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:33.850312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:33.850316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:33.850318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:33.850328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:33.850341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:33.850357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.850457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:33.850467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:33.850482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:33.850488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1779
2025-10-02T08:13:33.850519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1780 partition: 0 MaxSeqNo: 17 sessionId: src_id|455b5946-56077a62-76ab5aa5-34aac492_0
2025-10-02T08:13:33.850835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556c5b0d-7915a5c8-e73318f4-f1506f9a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|455b5946-56077a62-76ab5aa5-34aac492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:33.853530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|455b5946-56077a62-76ab5aa5-34aac492_0] Write session: try to update token
2025-10-02T08:13:33.853543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|455b5946-56077a62-76ab5aa5-34aac492_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:33.867602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId: src_id|455b5946-56077a62-76ab5aa5-34aac492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:33.868978Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:33.868992Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:33.868994Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:33.869003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534594051476320:11381]
2025-10-02T08:13:33.869007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534594051476320:11381]
2025-10-02T08:13:33.869043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:33.869046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:33.869049Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:33.869051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:33.869053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:33.869178Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:33.870102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:33.930807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534594051476392:6945]
2025-10-02T08:13:33.930917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1779, pipe: [1:7556534594051476392:6945]
2025-10-02T08:13:34.010637Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:34.010925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.010935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.010969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534594051476392:6945], now have 1 active actors on pipe
2025-10-02T08:13:34.011240Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:34.011234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:34.011468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:34.011526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1780 reason: status is not ok: tablet will be restarted right now sessionId: src_id|455b5946-56077a62-76ab5aa5-34aac492_0
2025-10-02T08:13:34.011588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534594051476392:6945]
2025-10-02T08:13:34.011660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1780 sessionId: src_id|455b5946-56077a62-76ab5aa5-34aac492_0 is DEAD
2025-10-02T08:13:34.011970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455b5946-56077a62-76ab5aa5-34aac492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:34.011981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455b5946-56077a62-76ab5aa5-34aac492_0] Write session will restart in 0.007223s
2025-10-02T08:13:34.012011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455b5946-56077a62-76ab5aa5-34aac492_0] Write session: Do CDS request
2025-10-02T08:13:34.012018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455b5946-56077a62-76ab5aa5-34aac492_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:34.020335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|455b5946-56077a62-76ab5aa5-34aac492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.020426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:34.020429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:34.020441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1781
2025-10-02T08:13:34.020553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.020585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:34.020595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:34.020598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:34.021027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1781 sessionId:  describe result for acl check
2025-10-02T08:13:34.021064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:34.021070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:34.021072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:34.021078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534598346443876:11348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:34.021433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:34.021584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534598346443876:11348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:34.021626Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:34.021637Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:34.021648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:34.021692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:34.021734Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534598346443879:11349]
2025-10-02T08:13:34.022389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:34.022604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:34.022664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:34.022996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:34.023056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.023063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.023065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.023066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.023068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.023074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.023083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.023088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.023092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.023096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.023102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.023110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.023116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.023121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.023126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.023131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.023135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.023141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.023146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.023151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.023173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:34.023646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534598346443876:11348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:34.029369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534598346443876:11348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:34.029386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534598346443876:11348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:34.029389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534598346443876:11348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:34.029395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:34.031703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:34.033561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:34.033578Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:34.033580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:34.033583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:34.033588Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1780 [1:7556534598346443879:11349]
2025-10-02T08:13:34.033601Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:34.033618Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:34.033622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.033625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.033627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.033645Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:34.033651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:34.033658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:34.033707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.033715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.033717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:34.033720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:34.033781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:34.033790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.033804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.033818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:34.033834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346443920:11348], now have 1 active actors on pipe
2025-10-02T08:13:34.033844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534598346443869:11349]
2025-10-02T08:13:34.033846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534598346443869:11349]
2025-10-02T08:13:34.033853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1780
2025-10-02T08:13:34.033853Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:34.033863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534598806152694:2378], now have 1 active actors on pipe
2025-10-02T08:13:34.033866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:34.033870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:34.033870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:34.033882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:34.033885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:34.033892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.033896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.033941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534598346443869:11349]
2025-10-02T08:13:34.033951Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:34.033967Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d561867-28f35335-379bf815-1a078ae9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:34.033972Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:34.033973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.033976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.033978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:34.033989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.033941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1780
2025-10-02T08:13:34.034001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:34.034047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.034133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.034139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.034152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.034186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1781 partition: 0 MaxSeqNo: 17 sessionId: src_id|4d561867-28f35335-379bf815-1a078ae9_0
2025-10-02T08:13:34.034513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455b5946-56077a62-76ab5aa5-34aac492_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4d561867-28f35335-379bf815-1a078ae9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:34.037157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d561867-28f35335-379bf815-1a078ae9_0] Write session: try to update token
2025-10-02T08:13:34.037174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d561867-28f35335-379bf815-1a078ae9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:34.052219Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:34.052236Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:34.052238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:34.052247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534598346443869:11349]
2025-10-02T08:13:34.052251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534598346443869:11349]
2025-10-02T08:13:34.052293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:34.052299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.052299Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:34.052303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:34.052305Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:34.052442Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:34.054827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId: src_id|4d561867-28f35335-379bf815-1a078ae9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:34.057593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:34.111256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534598346443934:6945]
2025-10-02T08:13:34.111381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1780, pipe: [1:7556534598346443934:6945]
2025-10-02T08:13:34.183779Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:34.184012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.184023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.184061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346443934:6945], now have 1 active actors on pipe
2025-10-02T08:13:34.184177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534598346443934:6945]
2025-10-02T08:13:34.184212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:34.184215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:34.184261Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:34.184285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1781 reason: error at write: Disconnected sessionId: src_id|4d561867-28f35335-379bf815-1a078ae9_0
2025-10-02T08:13:34.184289Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:34.184440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1781 sessionId: src_id|4d561867-28f35335-379bf815-1a078ae9_0 is DEAD
2025-10-02T08:13:34.184564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d561867-28f35335-379bf815-1a078ae9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:34.184570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d561867-28f35335-379bf815-1a078ae9_0] Write session will restart in 0.007283s
2025-10-02T08:13:34.184589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d561867-28f35335-379bf815-1a078ae9_0] Write session: Do CDS request
2025-10-02T08:13:34.184594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d561867-28f35335-379bf815-1a078ae9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:34.192004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:34.192567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:34.192695Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:34.192701Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:34.192708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:34.192741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:34.192781Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534598346444119:11340]
2025-10-02T08:13:34.193206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d561867-28f35335-379bf815-1a078ae9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.193249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:34.193307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:34.193315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1782
2025-10-02T08:13:34.193415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:34.193444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.193458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:34.193487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:34.193501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:34.193504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:34.193724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:34.193757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.193761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.193762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.193763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.193763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.193766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.193773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.193775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.193777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.193779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.193782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.193787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.193797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.193806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.193815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.193824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.193828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.193836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.193845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.193854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.193862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1782 sessionId:  describe result for acl check
2025-10-02T08:13:34.193875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:34.193891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:34.193898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:34.193899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:34.193904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534598346444131:11334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:34.194362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534598346444131:11334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:34.196112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534598346444131:11334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:34.200422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534598346444131:11334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:34.200435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534598346444131:11334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:34.200438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534598346444131:11334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:34.200446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:34.201467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:34.202899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:34.202912Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:34.202915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:34.202917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:34.202923Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1781 [1:7556534598346444119:11340]
2025-10-02T08:13:34.202933Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:34.202947Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:34.202954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.202957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.202958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.202974Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:34.202982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:34.202988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:34.203039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.203046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.203052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:34.203054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:34.203111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:34.203117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.203129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.203144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:34.203168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346444168:11334], now have 1 active actors on pipe
2025-10-02T08:13:34.203174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534598346444113:11340]
2025-10-02T08:13:34.203176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534598346444113:11340]
2025-10-02T08:13:34.203183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:34.203183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1781
2025-10-02T08:13:34.203190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534598806152703:2378], now have 1 active actors on pipe
2025-10-02T08:13:34.203194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:34.203197Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:34.203197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:34.203210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:34.203213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:34.203220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.203223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.203257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534598346444113:11340]
2025-10-02T08:13:34.203266Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:34.203268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:34.203279Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:34.203235Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1781
2025-10-02T08:13:34.203284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.203287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.203289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:34.203299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.203307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:34.203342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.203394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.203400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.203412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.203439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1782 partition: 0 MaxSeqNo: 17 sessionId: src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0
2025-10-02T08:13:34.203745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d561867-28f35335-379bf815-1a078ae9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:34.206273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0] Write session: try to update token
2025-10-02T08:13:34.206288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:34.219073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId: src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:34.220372Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:34.220389Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:34.220391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:34.220404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534598346444113:11340]
2025-10-02T08:13:34.220408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534598346444113:11340]
2025-10-02T08:13:34.220447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:34.220457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.220460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:34.220469Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:34.220475Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:34.220604Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:34.221715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:34.284108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534598346444181:6945]
2025-10-02T08:13:34.284262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1781, pipe: [1:7556534598346444181:6945]
2025-10-02T08:13:34.361894Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:34.362194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.362207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.362244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346444181:6945], now have 1 active actors on pipe
2025-10-02T08:13:34.362312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534598346444181:6945]
2025-10-02T08:13:34.362330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:34.362332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:34.362378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1782 reason: error at write: Disconnected sessionId: src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0
2025-10-02T08:13:34.362456Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:34.362443Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:34.362536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1782 sessionId: src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0 is DEAD
2025-10-02T08:13:34.362652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:34.362660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0] Write session will restart in 0.007437s
2025-10-02T08:13:34.362679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0] Write session: Do CDS request
2025-10-02T08:13:34.362685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:34.370494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:34.371283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.371294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:34.371304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1783
2025-10-02T08:13:34.371482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.371508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:34.371514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:34.371517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:34.371593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:34.371759Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:34.371766Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:34.371773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:34.371808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:34.371834Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534598346444372:11315]
2025-10-02T08:13:34.371847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1783 sessionId:  describe result for acl check
2025-10-02T08:13:34.371879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:34.371885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:34.371887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:34.371893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534598346444375:11312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:34.372358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534598346444375:11312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:34.372360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:34.372516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:34.372543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:34.372755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:34.372787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.372791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.372792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.372792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.372793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.372796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.372816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.372819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.372823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.372826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.372830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.372837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.372846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.372849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.372851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.372854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.372856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.372859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.372861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.372864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.372875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:34.374202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534598346444375:11312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:34.380241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534598346444375:11312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:34.380258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534598346444375:11312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:34.380262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534598346444375:11312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:34.380272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:34.380600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:34.382088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:34.382104Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:34.382107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:34.382110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:34.382116Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1782 [1:7556534598346444372:11315]
2025-10-02T08:13:34.382127Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:34.382143Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:34.382146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.382149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.382151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.382169Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:34.382179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:34.382186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:34.382236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.382244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.382247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:34.382250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:34.382312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:34.382319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.382330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.382346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:34.382369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346444418:11312], now have 1 active actors on pipe
2025-10-02T08:13:34.382374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534598346444364:11315]
2025-10-02T08:13:34.382377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534598346444364:11315]
2025-10-02T08:13:34.382379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1782
2025-10-02T08:13:34.382383Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:34.382391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534598806152710:2378], now have 1 active actors on pipe
2025-10-02T08:13:34.382393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:34.382396Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:34.382397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:34.382405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:34.382407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:34.382411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.382414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.382444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534598346444364:11315]
2025-10-02T08:13:34.382451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:34.382463Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:34.382471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.382474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.382475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:34.382441Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1782
2025-10-02T08:13:34.382480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:34.382481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.382487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:34.382513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.382562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.382568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.382579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.382609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1783 partition: 0 MaxSeqNo: 17 sessionId: src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0
2025-10-02T08:13:34.382905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98e6c79-8de0bfa6-cdfcf7ff-b590159_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:34.385406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0] Write session: try to update token
2025-10-02T08:13:34.385418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:34.398064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId: src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:34.400209Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:34.400223Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:34.400225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:34.400231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534598346444364:11315]
2025-10-02T08:13:34.400235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534598346444364:11315]
2025-10-02T08:13:34.400282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:34.400289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.400291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:34.400294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:34.400299Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:34.400421Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:34.400640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:34.462258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534598346444432:6945]
2025-10-02T08:13:34.462387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1782, pipe: [1:7556534598346444432:6945]
2025-10-02T08:13:34.529018Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:34.529369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.529382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.529416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346444432:6945], now have 1 active actors on pipe
2025-10-02T08:13:34.529523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534598346444432:6945]
2025-10-02T08:13:34.529543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:34.529548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:34.529598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1783 reason: error at write: Disconnected sessionId: src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0
2025-10-02T08:13:34.529624Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:34.529670Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:34.529763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1783 sessionId: src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0 is DEAD
2025-10-02T08:13:34.529921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:34.529928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0] Write session will restart in 0.006896s
2025-10-02T08:13:34.529953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0] Write session: Do CDS request
2025-10-02T08:13:34.529960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:34.537601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:34.538277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.538363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:34.538375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1784
2025-10-02T08:13:34.538437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:34.538500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.538532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:34.538541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:34.538545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:34.538585Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:34.538600Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:34.538607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:34.538651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:34.538683Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534598346444637:11295]
2025-10-02T08:13:34.538906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1784 sessionId:  describe result for acl check
2025-10-02T08:13:34.538942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:34.538949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:34.538950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:34.538956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534598346444641:11294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:34.539107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:34.539267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:34.539296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:34.539449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534598346444641:11294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:34.539489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:34.539512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.539517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.539518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.539518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.539519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.539521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.539527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.539529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.539531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.539533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.539537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.539541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.539544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.539547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.539549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.539552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.539554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.539557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.539559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.539562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.539571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:34.541431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534598346444641:11294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:34.546996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534598346444641:11294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:34.547011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534598346444641:11294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:34.547013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534598346444641:11294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:34.547019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:34.547559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:34.549111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:34.549131Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:34.549134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:34.549138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:34.549144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1783 [1:7556534598346444637:11295]
2025-10-02T08:13:34.549154Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:34.549172Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:34.549182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.549185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.549187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.549203Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:34.549208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:34.549219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:34.549280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.549288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.549291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:34.549293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:34.549356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:34.549363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.549377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.549395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:34.549404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1783
2025-10-02T08:13:34.549417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346444684:11294], now have 1 active actors on pipe
2025-10-02T08:13:34.549426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534598806152729:2378], now have 1 active actors on pipe
2025-10-02T08:13:34.549432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534598346444630:11295]
2025-10-02T08:13:34.549434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534598346444630:11295]
2025-10-02T08:13:34.549447Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:34.549456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.549466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.549467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:34.549471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:34.549484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:34.549467Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1783
2025-10-02T08:13:34.549504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:34.549512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:34.549554Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:34.549564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.549568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.549570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:34.549579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.549591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:34.549609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534598346444630:11295]
2025-10-02T08:13:34.549623Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:34.549646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:34.549654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.549728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.549736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.549751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.549788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1784 partition: 0 MaxSeqNo: 17 sessionId: src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0
2025-10-02T08:13:34.550114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e233d45a-488e03d2-ab5ebbce-47293a7f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:34.552726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0] Write session: try to update token
2025-10-02T08:13:34.552740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:34.566424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId: src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:34.567301Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:34.567320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:34.567322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:34.567330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534598346444630:11295]
2025-10-02T08:13:34.567337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534598346444630:11295]
2025-10-02T08:13:34.567381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:34.567392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.567395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:34.567396Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:34.567402Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:34.567530Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:34.568914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:34.629710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534598346444698:6945]
2025-10-02T08:13:34.629828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1783, pipe: [1:7556534598346444698:6945]
2025-10-02T08:13:34.694653Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:34.695035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.695045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.695077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346444698:6945], now have 1 active actors on pipe
2025-10-02T08:13:34.695207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:34.695221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:34.695233Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:34.695291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1784 reason: error at write: Disconnected sessionId: src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0
2025-10-02T08:13:34.695325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:34.695446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534598346444698:6945]
2025-10-02T08:13:34.695456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1784 sessionId: src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0 is DEAD
2025-10-02T08:13:34.695601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:34.695612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0] Write session will restart in 0.008582s
2025-10-02T08:13:34.695639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0] Write session: Do CDS request
2025-10-02T08:13:34.695645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:34.703339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:34.704063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:34.704227Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:34.704236Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:34.704245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:34.704285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:34.704319Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534598346444891:11287]
2025-10-02T08:13:34.704902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:34.705118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:34.705159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:34.705253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.705335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:34.705346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1785
2025-10-02T08:13:34.705455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:34.705480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.705496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.705502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.705503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.705504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.705505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.705509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.705512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:34.705517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:34.705518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.705521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:34.705522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.705526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.705529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.705535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.705542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.705547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.705551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.705556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.705565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.705573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.705578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.705586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.705591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.705613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:34.705900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1785 sessionId:  describe result for acl check
2025-10-02T08:13:34.705931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:34.705937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:34.705939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:34.705945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534598346444907:11282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:34.706458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534598346444907:11282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:34.708378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534598346444907:11282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:34.713087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534598346444907:11282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:34.713104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534598346444907:11282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:34.713107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534598346444907:11282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:34.713117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:34.713686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:34.715300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:34.715316Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:34.715321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:34.715325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:34.715332Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1784 [1:7556534598346444891:11287]
2025-10-02T08:13:34.715346Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:34.715366Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:34.715374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.715377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.715379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.715393Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:34.715402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:34.715413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:34.715470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.715477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.715480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:34.715483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:34.715548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:34.715558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.715572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.715584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:34.715597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1784
2025-10-02T08:13:34.715607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346444939:11282], now have 1 active actors on pipe
2025-10-02T08:13:34.715613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534598346444885:11287]
2025-10-02T08:13:34.715615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534598346444885:11287]
2025-10-02T08:13:34.715627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:34.715636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534598806152735:2378], now have 1 active actors on pipe
2025-10-02T08:13:34.715640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.715644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.715645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:34.715648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:34.715662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:34.715677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:34.715683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:34.715680Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1784
2025-10-02T08:13:34.715723Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|704ebd24-90288204-748bac37-8604b22e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:34.715735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.715738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.715740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:34.715748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.715757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:34.715769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534598346444885:11287]
2025-10-02T08:13:34.715781Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:34.715796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:34.715817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.715858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.715866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.715880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.715916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1785 partition: 0 MaxSeqNo: 17 sessionId: src_id|704ebd24-90288204-748bac37-8604b22e_0
2025-10-02T08:13:34.716273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b2ec99d-95d0319-bba8c3c2-da38852d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|704ebd24-90288204-748bac37-8604b22e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:34.719121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|704ebd24-90288204-748bac37-8604b22e_0] Write session: try to update token
2025-10-02T08:13:34.719138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|704ebd24-90288204-748bac37-8604b22e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:34.728393Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:34.728416Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:34.728426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534598346444885:11287]
2025-10-02T08:13:34.728474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:34.728486Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:34.728674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:34.728869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:34.729035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:34.729194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:34.729434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:34.729484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:34.733671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId: src_id|704ebd24-90288204-748bac37-8604b22e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:34.736601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:34.736667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.736677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.736715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:34.736744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:34.736787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.736814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.736973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.737041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.737097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.737165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.737210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.737217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.737294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.737351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.737407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.737467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.737511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.737518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.737578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.737635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.737693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.737749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.737791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.737796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.737865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.737932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.738002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.738072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.738121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.738126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.738197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.738259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.738323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.738391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.738599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.738606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.738678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.738741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.738804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.738867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.738914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.738919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.739007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.739075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.739145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.739214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.739261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.739266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.739336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.739395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.739459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.739528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.739581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.739586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.739655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.739711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.739766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.739824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.739870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.739875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.739941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:34.739999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:34.740055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:34.740118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:34.740172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:34.740180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:34.740224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:34.740276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.740293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.740299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:34.740323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:34.740337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:34.740343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:34.740345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:34.740347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:34.740698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:34.740718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:34.740726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:34.740729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:34.740731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:34.740733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:34.741172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:34.741192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:34.741196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:34.741199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:34.741201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:34.741203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:34.741703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:34.741719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:34.741723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:34.741725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:34.741727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:34.742825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:34.742842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:34.742858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392814742
2025-10-02T08:13:34.742980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:34.742991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:34.742994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:34.742997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:34.742999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:34.743001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:34.743455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:34.743474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:34.743482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:34.743484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:34.743486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:34.743490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:34.743918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:34.743934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:34.743941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:34.743943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:34.743945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:34.743947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:34.744367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:34.744385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:34.744389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:34.745401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:34.745412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:34.745416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:34.745419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:34.745425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392814745
2025-10-02T08:13:34.745697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:34.745714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:34.745718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:34.745720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:34.745722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:34.745726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:34.746142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:34.746161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:34.746165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:34.746169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:34.746171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:34.746173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:34.746598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:34.746615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.746688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392814746
2025-10-02T08:13:34.747396Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:34.747416Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:34.747421Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:34.747427Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:34.749035Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:34.749045Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:34.749046Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:34.749055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534598346444885:11287]
2025-10-02T08:13:34.749057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534598346444885:11287]
2025-10-02T08:13:34.749091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:34.749102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:34.749103Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:34.749105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.749106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:34.749244Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:34.795611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534598346444962:6945]
2025-10-02T08:13:34.796527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1784, pipe: [1:7556534598346444962:6945]
2025-10-02T08:13:34.886430Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:34.886716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346444962:6945], now have 1 active actors on pipe
2025-10-02T08:13:34.886806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:34.886811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:34.886830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1785 reason: error at write: Disconnected sessionId: src_id|704ebd24-90288204-748bac37-8604b22e_0
2025-10-02T08:13:34.886893Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:34.886940Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:34.887008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1785 sessionId: src_id|704ebd24-90288204-748bac37-8604b22e_0 is DEAD
2025-10-02T08:13:34.887182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704ebd24-90288204-748bac37-8604b22e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:34.887201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704ebd24-90288204-748bac37-8604b22e_0] Write session will restart in 0.009474s
2025-10-02T08:13:34.887162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534598346444962:6945]
2025-10-02T08:13:34.887237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704ebd24-90288204-748bac37-8604b22e_0] Write session: Do CDS request
2025-10-02T08:13:34.887243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704ebd24-90288204-748bac37-8604b22e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:34.895861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:34.897163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:34.897353Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:34.897364Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:34.897374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:34.897428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:34.897469Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534598346445187:11257]
2025-10-02T08:13:34.898132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:34.898351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:34.898403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:34.898625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|704ebd24-90288204-748bac37-8604b22e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.898694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:34.898709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1786
2025-10-02T08:13:34.898725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:34.898768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.898780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.898781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.898782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.898783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.898789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.898799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.898803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.898807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.898811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.898817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.898825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:34.898830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.898835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:34.898843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.898849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:34.898857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.898862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.898871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.898876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.898899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:34.898907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:34.898931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:34.898942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:34.898946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:34.899354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1786 sessionId:  describe result for acl check
2025-10-02T08:13:34.899391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:34.899399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:34.899400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:34.899405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534598346445204:11256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:34.899928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534598346445204:11256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:34.902204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534598346445204:11256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:34.906796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534598346445204:11256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:34.906816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534598346445204:11256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:34.906818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534598346445204:11256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:34.906825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:34.907323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:34.909118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:34.909134Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:34.909137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:34.909140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:34.909147Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1785 [1:7556534598346445187:11257]
2025-10-02T08:13:34.909159Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:34.909175Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:34.909178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.909181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.909184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.909199Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:34.909204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:34.909210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:34.909270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.909279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.909283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:34.909285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:34.909343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:34.909352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.909366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:34.909379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:34.909397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346445232:11256], now have 1 active actors on pipe
2025-10-02T08:13:34.909406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534598806152757:2378], now have 1 active actors on pipe
2025-10-02T08:13:34.909412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534598346445181:11257]
2025-10-02T08:13:34.909414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534598346445181:11257]
2025-10-02T08:13:34.909419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1785
2025-10-02T08:13:34.909421Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:34.909429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:34.909431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:34.909433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:34.909447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:34.909455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:34.909462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.909470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.909465Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1785
2025-10-02T08:13:34.909510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534598346445181:11257]
2025-10-02T08:13:34.909521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:34.909528Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:34.909540Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:34.909553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:34.909561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:34.909562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:34.909571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:34.909583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:34.909627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.909680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:34.909687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:34.909699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:34.909734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1786 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0
2025-10-02T08:13:34.910050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|704ebd24-90288204-748bac37-8604b22e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:34.912644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0] Write session: try to update token
2025-10-02T08:13:34.912660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:34.927368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId: src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:34.927603Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:34.927622Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:34.927625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:34.927633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534598346445181:11257]
2025-10-02T08:13:34.927637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534598346445181:11257]
2025-10-02T08:13:34.927681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:34.927690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:34.927690Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:34.927696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:34.927698Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:34.927851Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:34.929967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:34.987077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534598346445255:6945]
2025-10-02T08:13:34.987201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1785, pipe: [1:7556534598346445255:6945]
2025-10-02T08:13:35.066572Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:35.066828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.066840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.066874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534598346445255:6945], now have 1 active actors on pipe
2025-10-02T08:13:35.067006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534598346445255:6945]
2025-10-02T08:13:35.067035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:35.067038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:35.067098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1786 reason: error at write: Disconnected sessionId: src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0
2025-10-02T08:13:35.067099Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:35.067103Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:35.067273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1786 sessionId: src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0 is DEAD
2025-10-02T08:13:35.067464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:35.067471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0] Write session will restart in 0.008470s
2025-10-02T08:13:35.067495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0] Write session: Do CDS request
2025-10-02T08:13:35.067501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:35.075063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:35.075895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:35.076049Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:35.076057Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:35.076064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:35.076100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:35.076128Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534602641412746:11222]
2025-10-02T08:13:35.076565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:35.076720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:35.076747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:35.076968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:35.077011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.077016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.077016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.077017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.077018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.077021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.077028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.077030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.077032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.077034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.077038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.077042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.077045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.077048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.077051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.077054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.077057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.077059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.077062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.077065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.077076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:35.077265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.077362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:35.077373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1787
2025-10-02T08:13:35.077462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.077490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:35.077498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:35.077500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:35.077880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1787 sessionId:  describe result for acl check
2025-10-02T08:13:35.077917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:35.077918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:35.077920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:35.077926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534602641412762:11218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:35.078452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534602641412762:11218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:35.081169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534602641412762:11218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:35.084673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534602641412762:11218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:35.084688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534602641412762:11218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:35.084693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534602641412762:11218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:35.084702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:35.085311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:35.087002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:35.087022Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:35.087025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:35.087030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:35.087036Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1786 [1:7556534602641412746:11222]
2025-10-02T08:13:35.087046Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:35.087062Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:35.087070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.087074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.087076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.087093Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:35.087103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:35.087109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:35.087165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.087173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.087176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:35.087178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:35.087239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:35.087246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.087259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.087272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:35.087283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1786
2025-10-02T08:13:35.087296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641412794:11218], now have 1 active actors on pipe
2025-10-02T08:13:35.087299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534603101120069:2378], now have 1 active actors on pipe
2025-10-02T08:13:35.087304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.087307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.087324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534602641412740:11222]
2025-10-02T08:13:35.087331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534602641412740:11222]
2025-10-02T08:13:35.087340Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:35.087352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1786
2025-10-02T08:13:35.087353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:35.087356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:35.087362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:35.087369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:35.087372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:35.087386Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:35.087391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.087394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.087396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:35.087404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.087412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:35.087446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534602641412740:11222]
2025-10-02T08:13:35.087462Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:35.087478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.087494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:35.087544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.087554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.087577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.087617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1787 partition: 0 MaxSeqNo: 17 sessionId: src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0
2025-10-02T08:13:35.087953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12b497-2ceeaf75-2a142fc6-b9775a1d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:35.090531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0] Write session: try to update token
2025-10-02T08:13:35.090549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:35.104355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId: src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:35.107562Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:35.107584Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:35.107587Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:35.107598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534602641412740:11222]
2025-10-02T08:13:35.107602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534602641412740:11222]
2025-10-02T08:13:35.107648Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:35.107655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:35.107660Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:35.107664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.107669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:35.107868Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:35.107948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:35.167311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534602641412810:6945]
2025-10-02T08:13:35.167430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1786, pipe: [1:7556534602641412810:6945]
2025-10-02T08:13:35.246268Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:35.246539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.246550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.246586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641412810:6945], now have 1 active actors on pipe
2025-10-02T08:13:35.246698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534602641412810:6945]
2025-10-02T08:13:35.246718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:35.246720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:35.246775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1787 reason: error at write: Disconnected sessionId: src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0
2025-10-02T08:13:35.246829Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:35.246807Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:35.246937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1787 sessionId: src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0 is DEAD
2025-10-02T08:13:35.247062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:35.247070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0] Write session will restart in 0.007486s
2025-10-02T08:13:35.247099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0] Write session: Do CDS request
2025-10-02T08:13:35.247106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:35.253901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:35.254625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:35.254763Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:35.254770Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:35.254777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:35.254808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:35.254833Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534602641413006:11208]
2025-10-02T08:13:35.255268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.255230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:35.255331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:35.255335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1788
2025-10-02T08:13:35.255396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:35.255437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:35.255464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.255489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:35.255501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:35.255504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:35.255713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:35.255765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.255770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.255771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.255773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.255773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.255778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.255787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.255795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.255799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.255802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.255814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.255824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1788 sessionId:  describe result for acl check
2025-10-02T08:13:35.255824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.255832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.255836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.255840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.255844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.255847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.255850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:35.255851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:35.255851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.255853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:35.255855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.255857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534602641413018:11204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:35.255859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.255874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:35.256222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534602641413018:11204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:35.258091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534602641413018:11204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:35.262762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534602641413018:11204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:35.262775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534602641413018:11204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:35.262778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534602641413018:11204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:35.262786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:35.263236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:35.264733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:35.264747Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:35.264750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:35.264752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:35.264756Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1787 [1:7556534602641413006:11208]
2025-10-02T08:13:35.264764Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:35.264775Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:35.264777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.264779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.264780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.264791Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:35.264795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:35.264800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:35.264863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.264870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.264872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:35.264874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:35.264927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:35.264933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.264944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.264958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:35.264978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641413053:11204], now have 1 active actors on pipe
2025-10-02T08:13:35.264979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1787
2025-10-02T08:13:35.264987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534602641413000:11208]
2025-10-02T08:13:35.264989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534602641413000:11208]
2025-10-02T08:13:35.264998Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:35.265007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534603101120078:2378], now have 1 active actors on pipe
2025-10-02T08:13:35.265009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:35.265011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:35.265017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.265020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.265034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:35.265052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:35.265058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:35.265063Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1787
2025-10-02T08:13:35.265096Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|412128a7-c3eb096a-4c909fa6-69a73922_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:35.265106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.265109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.265111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:35.265119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.265129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:35.265136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534602641413000:11208]
2025-10-02T08:13:35.265145Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:35.265164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.265168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:35.265248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.265255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.265267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.265296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1788 partition: 0 MaxSeqNo: 17 sessionId: src_id|412128a7-c3eb096a-4c909fa6-69a73922_0
2025-10-02T08:13:35.265589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cacc66-6010d7dc-cbc8c0a5-838fc46f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|412128a7-c3eb096a-4c909fa6-69a73922_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:35.268134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|412128a7-c3eb096a-4c909fa6-69a73922_0] Write session: try to update token
2025-10-02T08:13:35.268148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|412128a7-c3eb096a-4c909fa6-69a73922_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:35.276439Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:35.276459Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:35.276467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534602641413000:11208]
2025-10-02T08:13:35.276511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:35.276514Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:35.276710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:35.276883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:35.277032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:35.277181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:35.277388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:35.277431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:35.281898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId: src_id|412128a7-c3eb096a-4c909fa6-69a73922_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:35.284529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:35.284614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.284626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.284662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:35.284690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:35.284723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.284731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.284914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.284986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.285064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.285132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.285240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.285250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.285319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.285384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.285453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.285521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.285567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.285574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.285639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.285698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.285762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.285820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.285864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.285871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.285941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.286007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.286081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.286163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.286219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.286226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.286303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.286373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.286450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.286528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.286582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.286589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.286674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.286741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.286813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.286893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.286954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.286961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.287040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.287116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.287190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.287269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.287318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.287324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.287409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.287478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.287551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.287630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.287690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.287700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.287786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.287853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.287919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.287985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.288038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.288046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.288125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:35.288204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:35.288277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:35.288344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:35.288398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:35.288405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:35.288450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:35.288524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.288546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.288553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:35.288587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:35.288605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:35.288612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:35.288616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:35.288619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:35.289063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:35.289093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:35.289105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:35.289108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:35.289112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:35.289115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:35.289751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:35.289776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:35.289782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:35.289785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:35.289789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:35.289792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:35.290307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:35.290331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:35.290340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:35.290344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:35.290349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:35.291690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:35.291707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:35.291716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392815291
2025-10-02T08:13:35.291853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:35.291871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:35.291876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:35.291879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:35.291883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:35.291887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:35.292448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:35.292472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:35.292478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:35.292482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:35.292486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:35.292489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:35.292985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:35.293005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:35.293015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:35.293024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:35.293029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:35.293034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:35.293521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:35.293542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:35.293547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:35.294733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:35.294749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:35.294756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:35.294760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:35.294768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392815294
2025-10-02T08:13:35.295064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:35.295084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:35.295089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:35.295093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:35.295097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:35.295100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:35.295597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:35.295616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:35.295622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:35.295630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:35.295634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:35.295637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:35.296101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:35.296119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.296231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392815295
2025-10-02T08:13:35.297016Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:35.297036Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:35.297045Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:35.297054Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:35.298752Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:35.298768Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:35.298769Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:35.298782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534602641413000:11208]
2025-10-02T08:13:35.298786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534602641413000:11208]
2025-10-02T08:13:35.298835Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:35.298850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:35.298850Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:35.298854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.298856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:35.299009Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:35.347080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534602641413076:6945]
2025-10-02T08:13:35.347208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1787, pipe: [1:7556534602641413076:6945]
2025-10-02T08:13:35.436126Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:35.436528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641413076:6945], now have 1 active actors on pipe
2025-10-02T08:13:35.436596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534602641413076:6945]
2025-10-02T08:13:35.436615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:35.436620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:35.436642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1788 reason: error at write: Disconnected sessionId: src_id|412128a7-c3eb096a-4c909fa6-69a73922_0
2025-10-02T08:13:35.436715Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:35.436700Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:35.436820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1788 sessionId: src_id|412128a7-c3eb096a-4c909fa6-69a73922_0 is DEAD
2025-10-02T08:13:35.437141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|412128a7-c3eb096a-4c909fa6-69a73922_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:35.437150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|412128a7-c3eb096a-4c909fa6-69a73922_0] Write session will restart in 0.006893s
2025-10-02T08:13:35.437173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|412128a7-c3eb096a-4c909fa6-69a73922_0] Write session: Do CDS request
2025-10-02T08:13:35.437179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|412128a7-c3eb096a-4c909fa6-69a73922_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:35.444534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:35.445213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|412128a7-c3eb096a-4c909fa6-69a73922_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.445243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:35.445257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1789
2025-10-02T08:13:35.445351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.445379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:35.445387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:35.445390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:35.445717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:35.445725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1789 sessionId:  describe result for acl check
2025-10-02T08:13:35.445747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:35.445754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:35.445755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:35.445759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534602641413276:11190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:35.445874Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:35.445884Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:35.445893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:35.445936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:35.445985Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534602641413278:11196]
2025-10-02T08:13:35.446199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534602641413276:11190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:35.446588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:35.446781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:35.446822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:35.447133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:35.447179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.447185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.447186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.447186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.447187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.447192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.447201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.447204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.447207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.447210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.447215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.447223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.447228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.447232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.447235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.447240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.447244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.447248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.447252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.447256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.447272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:35.448456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534602641413276:11190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:35.454766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534602641413276:11190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:35.454785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534602641413276:11190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:35.454792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534602641413276:11190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:35.454814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:35.455777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:35.457499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:35.457518Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:35.457521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:35.457524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:35.457531Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1788 [1:7556534602641413278:11196]
2025-10-02T08:13:35.457542Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:35.457558Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:35.457561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.457564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.457566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.457581Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:35.457586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:35.457592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:35.457651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.457659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.457662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:35.457664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:35.457723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:35.457730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.457741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.457752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:35.457773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641413323:11190], now have 1 active actors on pipe
2025-10-02T08:13:35.457781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1788
2025-10-02T08:13:35.457783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534602641413269:11196]
2025-10-02T08:13:35.457785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534602641413269:11196]
2025-10-02T08:13:35.457792Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:35.457801Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:35.457806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534603101120096:2378], now have 1 active actors on pipe
2025-10-02T08:13:35.457811Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:35.457813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:35.457825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:35.457832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:35.457840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.457843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.457881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534602641413269:11196]
2025-10-02T08:13:35.457888Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:35.457898Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:35.457865Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1788
2025-10-02T08:13:35.457902Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:35.457907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.457911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.457912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:35.457921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.457928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:35.457964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.458040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.458053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.458076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.458115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1789 partition: 0 MaxSeqNo: 17 sessionId: src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0
2025-10-02T08:13:35.458458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|412128a7-c3eb096a-4c909fa6-69a73922_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:35.461095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0] Write session: try to update token
2025-10-02T08:13:35.461111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:35.474631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId: src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:35.475551Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:35.475569Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:35.475571Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:35.475579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534602641413269:11196]
2025-10-02T08:13:35.475584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534602641413269:11196]
2025-10-02T08:13:35.475628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:35.475630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:35.475636Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:35.475641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.475643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:35.475790Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:35.477504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:35.536999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534602641413351:6945]
2025-10-02T08:13:35.537145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1788, pipe: [1:7556534602641413351:6945]
2025-10-02T08:13:35.609174Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:35.609476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.609485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.609516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641413351:6945], now have 1 active actors on pipe
2025-10-02T08:13:35.609605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:35.609616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:35.609640Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:35.609669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1789 reason: error at write: Disconnected sessionId: src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0
2025-10-02T08:13:35.609710Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:35.609806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1789 sessionId: src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0 is DEAD
2025-10-02T08:13:35.609855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534602641413351:6945]
2025-10-02T08:13:35.609962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:35.609972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0] Write session will restart in 0.005798s
2025-10-02T08:13:35.610010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0] Write session: Do CDS request
2025-10-02T08:13:35.610016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:35.617317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.617334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:35.617349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1790
2025-10-02T08:13:35.617506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.617539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:35.617548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:35.617551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:35.617808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:35.617941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1790 sessionId:  describe result for acl check
2025-10-02T08:13:35.617970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:35.617976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:35.617978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:35.617984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534602641413551:11177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:35.618454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534602641413551:11177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:35.618559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:35.618689Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:35.618699Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:35.618706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:35.618740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:35.618763Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534602641413556:11182]
2025-10-02T08:13:35.619161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:35.619364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:35.619406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:35.619623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:35.619652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.619656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.619657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.619658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.619658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.619662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.619669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.619671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.619673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.619675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.619678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.619684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.619689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.619693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.619697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.619701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.619705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.619710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.619714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.619718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.619728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:35.620081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534602641413551:11177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:35.626369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534602641413551:11177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:35.626384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534602641413551:11177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:35.626390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534602641413551:11177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:35.626398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:35.627273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:35.628758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:35.628774Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:35.628776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:35.628779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:35.628784Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1789 [1:7556534602641413556:11182]
2025-10-02T08:13:35.628792Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:35.628825Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:35.628827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.628829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.628831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.628843Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:35.628846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:35.628851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:35.628898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.628903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.628906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:35.628908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:35.628954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:35.628959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.628968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.628975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:35.628986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534602641413546:11182]
2025-10-02T08:13:35.628987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534602641413546:11182]
2025-10-02T08:13:35.628992Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:35.629001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:35.629013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:35.629015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:35.629018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:35.629020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:35.629042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1789
2025-10-02T08:13:35.629057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641413599:11177], now have 1 active actors on pipe
2025-10-02T08:13:35.629060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534603101120104:2378], now have 1 active actors on pipe
2025-10-02T08:13:35.629063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534602641413546:11182]
2025-10-02T08:13:35.629070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:35.629076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.629078Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:35.629080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.629112Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27fa658-d207e2d3-7984354c-2a5135c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:35.629120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.629123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.629125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:35.629131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.629138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:35.629152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.629150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1789
2025-10-02T08:13:35.629192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.629199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.629215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.629250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1790 partition: 0 MaxSeqNo: 17 sessionId: src_id|27fa658-d207e2d3-7984354c-2a5135c7_0
2025-10-02T08:13:35.629567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1e5e2e-66808977-b92bc2ae-c72b066_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|27fa658-d207e2d3-7984354c-2a5135c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:35.632178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27fa658-d207e2d3-7984354c-2a5135c7_0] Write session: try to update token
2025-10-02T08:13:35.632206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27fa658-d207e2d3-7984354c-2a5135c7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:35.645837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId: src_id|27fa658-d207e2d3-7984354c-2a5135c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:35.646612Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:35.646630Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:35.646632Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:35.646643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534602641413546:11182]
2025-10-02T08:13:35.646648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534602641413546:11182]
2025-10-02T08:13:35.646683Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:35.646693Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:35.646694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:35.646700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.646703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:35.646843Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:35.648310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:35.710027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534602641413617:6945]
2025-10-02T08:13:35.710153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1789, pipe: [1:7556534602641413617:6945]
2025-10-02T08:13:35.780011Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:35.780333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.780346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.780382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641413617:6945], now have 1 active actors on pipe
2025-10-02T08:13:35.780502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:35.780511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:35.780565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1790 reason: error at write: Disconnected sessionId: src_id|27fa658-d207e2d3-7984354c-2a5135c7_0
2025-10-02T08:13:35.780606Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:35.780667Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:35.780700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1790 sessionId: src_id|27fa658-d207e2d3-7984354c-2a5135c7_0 is DEAD
2025-10-02T08:13:35.780858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fa658-d207e2d3-7984354c-2a5135c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:35.780869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fa658-d207e2d3-7984354c-2a5135c7_0] Write session will restart in 0.005484s
2025-10-02T08:13:35.780892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fa658-d207e2d3-7984354c-2a5135c7_0] Write session: Do CDS request
2025-10-02T08:13:35.780884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534602641413617:6945]
2025-10-02T08:13:35.780899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fa658-d207e2d3-7984354c-2a5135c7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:35.787259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27fa658-d207e2d3-7984354c-2a5135c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.787287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:35.787300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1791
2025-10-02T08:13:35.787428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.787465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:35.787474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:35.787477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:35.787873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1791 sessionId:  describe result for acl check
2025-10-02T08:13:35.787904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:35.787909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:35.787911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:35.787916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534602641413805:11170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:35.788333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534602641413805:11170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:35.789565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:35.790541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534602641413805:11170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:35.790598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:35.790757Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:35.790765Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:35.790771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:35.790806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:35.790839Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534602641413843:11169]
2025-10-02T08:13:35.791274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:35.791457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:35.791496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:35.791725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:35.791758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.791762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.791763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.791764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.791764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.791768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.791775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.791777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.791779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.791781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.791786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.791794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.791799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.791804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.791808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.791813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.791820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.791823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.791825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.791828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.791839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:35.796612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534602641413805:11170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:35.796626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534602641413805:11170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:35.796629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534602641413805:11170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:35.796637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:35.799840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:35.801635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:35.801651Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:35.801654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:35.801658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:35.801664Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1790 [1:7556534602641413843:11169]
2025-10-02T08:13:35.801675Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:35.801691Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:35.801693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.801697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.801698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.801715Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:35.801724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:35.801731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:35.801798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.801805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.801808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:35.801810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:35.801873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:35.801879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.801892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.801908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:35.801930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534603101120113:2378], now have 1 active actors on pipe
2025-10-02T08:13:35.801939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1790
2025-10-02T08:13:35.801940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534602641413829:11169]
2025-10-02T08:13:35.801942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534602641413829:11169]
2025-10-02T08:13:35.801949Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:35.801959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:35.801962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641413868:11170], now have 1 active actors on pipe
2025-10-02T08:13:35.801963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:35.801969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:35.801982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:35.801989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:35.801996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.802003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.801992Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1790
2025-10-02T08:13:35.802043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534602641413829:11169]
2025-10-02T08:13:35.802055Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:35.802064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:35.802079Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:35.802090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.802097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.802099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:35.802107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.802119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:35.802157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.802210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.802213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.802224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.802257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1791 partition: 0 MaxSeqNo: 17 sessionId: src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0
2025-10-02T08:13:35.802598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fa658-d207e2d3-7984354c-2a5135c7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:35.805192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0] Write session: try to update token
2025-10-02T08:13:35.805207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:35.819284Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:35.819303Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:35.819305Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:35.819314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534602641413829:11169]
2025-10-02T08:13:35.819318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534602641413829:11169]
2025-10-02T08:13:35.819357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:35.819364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.819366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:35.819429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:35.819443Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:35.819521Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:35.819672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId: src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:35.822278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:35.881059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534602641413914:6945]
2025-10-02T08:13:35.881223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1790, pipe: [1:7556534602641413914:6945]
2025-10-02T08:13:35.960862Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:35.961240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.961258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.961296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641413914:6945], now have 1 active actors on pipe
2025-10-02T08:13:35.961415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:35.961424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:35.961512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1791 reason: error at write: Disconnected sessionId: src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0
2025-10-02T08:13:35.961513Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:35.961518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:35.961663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1791 sessionId: src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0 is DEAD
2025-10-02T08:13:35.961765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534602641413914:6945]
2025-10-02T08:13:35.961810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:35.961819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0] Write session will restart in 0.007506s
2025-10-02T08:13:35.961839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0] Write session: Do CDS request
2025-10-02T08:13:35.961844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:35.970300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.970331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:35.970550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:35.970561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1792
2025-10-02T08:13:35.970679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:35.970718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:35.970722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:35.970726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:35.971102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1792 sessionId:  describe result for acl check
2025-10-02T08:13:35.971136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:35.971143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:35.971144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:35.971149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534602641414127:11120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:35.971287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:35.971446Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:35.971455Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:35.971463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:35.971510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:35.971546Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534602641414129:11130]
2025-10-02T08:13:35.971647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534602641414127:11120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:35.972168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:35.972370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:35.972423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:35.972719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:35.972764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.972770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.972771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.972772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.972773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.972777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.972785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.972789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.972792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.972795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.972822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.972828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:35.972834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.972838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:35.972842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.972846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:35.972850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.972854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.972858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.972862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.972878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:35.973699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534602641414127:11120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:35.979889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534602641414127:11120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:35.979916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534602641414127:11120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:35.979920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534602641414127:11120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:35.979928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:35.980760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:35.982418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:35.982434Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:35.982436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:35.982440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:35.982445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1791 [1:7556534602641414129:11130]
2025-10-02T08:13:35.982455Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:35.982471Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:35.982474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.982477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.982480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.982494Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:35.982499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:35.982504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:35.982549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.982557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.982559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:35.982562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:35.982618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:35.982625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:35.982635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:35.982645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:35.982664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534602641414171:11120], now have 1 active actors on pipe
2025-10-02T08:13:35.982675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534602641414120:11130]
2025-10-02T08:13:35.982677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534602641414120:11130]
2025-10-02T08:13:35.982682Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:35.982692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:35.982704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:35.982707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:35.982731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534602641414120:11130]
2025-10-02T08:13:35.982738Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:35.982770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1791
2025-10-02T08:13:35.982789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.982798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.982798Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:35.982801Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:35.982807Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:35.982810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534603101120142:2378], now have 1 active actors on pipe
2025-10-02T08:13:35.982822Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:35.982832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:35.982835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:35.982837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:35.982846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:35.982855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:35.982867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.982928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:35.982935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:35.982946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:35.982973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1792 partition: 0 MaxSeqNo: 17 sessionId: src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0
2025-10-02T08:13:35.983144Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1791
2025-10-02T08:13:35.983306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f98f20d-785dd4f-2bf9407f-f91f5b5f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:35.985786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0] Write session: try to update token
2025-10-02T08:13:35.985801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:35.994852Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:35.994873Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:35.994883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534602641414120:11130]
2025-10-02T08:13:35.994924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:35.994926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:35.995145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:35.995333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:35.995509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:35.995661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:35.995940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:35.995977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:36.000305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId: src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:36.002842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:36.002901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.002913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.002955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:36.002979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:36.003038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.003053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.003231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.003305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.003368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.003435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.003493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.003502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.003575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.003638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.003702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.003772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.003817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.003825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.003893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.003955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.004018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.004082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.004125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.004132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.004210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.004276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.004345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.004474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.004523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.004531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.004607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.004680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.004750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.004839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.004895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.004904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.004983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.005049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.005150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.005228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.005280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.005287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.005363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.005430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.005506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.005578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.005627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.005634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.005712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.005779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.005849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.005922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.006064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.006071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.006151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.006213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.006278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.006341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.006391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.006398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.006476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.006542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.006613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.006678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.006727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.006734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.006771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:36.006838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.006862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.006869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:36.006900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:36.006917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:36.006924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:36.006928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:36.006931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:36.007342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:36.007372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:36.007378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:36.007381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:36.007385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:36.007389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:36.008100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:36.008127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:36.008133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:36.008141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:36.008145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:36.008148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:36.008712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:36.008733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:36.008739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:36.008742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:36.008748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:36.010051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:36.010071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:36.010082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392816009
2025-10-02T08:13:36.010233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:36.010246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:36.010251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:36.010254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:36.010258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:36.010262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:36.010736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:36.010758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:36.010762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:36.010765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:36.010769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:36.010797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:36.011282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:36.011303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:36.011309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:36.011312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:36.011317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:36.011320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:36.011809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:36.011833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:36.011838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:36.013051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:36.013067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:36.013073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:36.013078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:36.013086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392816013
2025-10-02T08:13:36.013390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:36.013409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:36.013415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:36.013419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:36.013422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:36.013431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:36.013894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:36.013914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:36.013919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:36.013923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:36.013927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:36.013931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:36.014388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:36.014407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.014502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392816014
2025-10-02T08:13:36.015293Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:36.015317Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:36.015324Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:36.015332Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:36.017066Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:36.017078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:36.017080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:36.017087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534602641414120:11130]
2025-10-02T08:13:36.017091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534602641414120:11130]
2025-10-02T08:13:36.017140Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:36.017148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:36.017153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.017155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:36.017155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:36.017291Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:36.061786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534606936381492:6945]
2025-10-02T08:13:36.061894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1791, pipe: [1:7556534606936381492:6945]
2025-10-02T08:13:36.168678Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:36.169040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936381492:6945], now have 1 active actors on pipe
2025-10-02T08:13:36.169160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:36.169169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:36.169178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534606936381492:6945]
2025-10-02T08:13:36.169193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1792 reason: error at write: Disconnected sessionId: src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0
2025-10-02T08:13:36.169251Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:36.169347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1792 sessionId: src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0 is DEAD
2025-10-02T08:13:36.169408Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:36.169494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:36.169504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0] Write session will restart in 0.005132s
2025-10-02T08:13:36.169528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0] Write session: Do CDS request
2025-10-02T08:13:36.169534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:36.176325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.176398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:36.176412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1793
2025-10-02T08:13:36.176546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.176576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:36.176582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:36.176585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:36.176886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1793 sessionId:  describe result for acl check
2025-10-02T08:13:36.176917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:36.176923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:36.176925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:36.176931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534606936381687:11099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:36.177342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534606936381687:11099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:36.177651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:36.178649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:36.178839Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:36.178849Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:36.178858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:36.178904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:36.178939Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534606936381720:11100]
2025-10-02T08:13:36.179235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534606936381687:11099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:36.179463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:36.179652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:36.179707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:36.180005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:36.180041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.180045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.180046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.180046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.180047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.180050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.180057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.180066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.180068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.180070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.180074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.180078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.180081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.180084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.180086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.180089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.180091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.180093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.180096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.180098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.180110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:36.184693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534606936381687:11099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:36.184709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534606936381687:11099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:36.184713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534606936381687:11099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:36.184741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:36.187997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:36.189614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:36.189629Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:36.189632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:36.189636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:36.189643Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1792 [1:7556534606936381720:11100]
2025-10-02T08:13:36.189654Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:36.189669Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:36.189671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.189675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.189677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.189691Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:36.189698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:36.189704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:36.189759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.189766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.189769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:36.189771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:36.189828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:36.189836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.189848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.189857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:36.189875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936381748:11099], now have 1 active actors on pipe
2025-10-02T08:13:36.189883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534607396087447:2378], now have 1 active actors on pipe
2025-10-02T08:13:36.189883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1792
2025-10-02T08:13:36.189889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534606936381701:11100]
2025-10-02T08:13:36.189890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534606936381701:11100]
2025-10-02T08:13:36.189902Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:36.189912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:36.189923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:36.189927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:36.189926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:36.189930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:36.189932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.189936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.189971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534606936381701:11100]
2025-10-02T08:13:36.189980Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:36.189985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:36.189993Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fd49658-55ac3880-828718e2-f9a76394_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:36.189999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.190001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.190003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:36.190010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.190021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:36.190054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.190092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.190099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.190111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.190095Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1792
2025-10-02T08:13:36.190141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1793 partition: 0 MaxSeqNo: 17 sessionId: src_id|9fd49658-55ac3880-828718e2-f9a76394_0
2025-10-02T08:13:36.190445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430c3ef7-5c24852a-6ec3b66e-d6a1ff1c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9fd49658-55ac3880-828718e2-f9a76394_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:36.192982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd49658-55ac3880-828718e2-f9a76394_0] Write session: try to update token
2025-10-02T08:13:36.192997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd49658-55ac3880-828718e2-f9a76394_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:36.200867Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:36.200885Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:36.200894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534606936381701:11100]
2025-10-02T08:13:36.200933Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:36.200935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:36.201165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:36.201317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:36.201467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:36.201607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:36.201803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:36.201841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:36.205989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId: src_id|9fd49658-55ac3880-828718e2-f9a76394_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:36.208618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:36.208682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.208696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.208732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:36.208756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:36.208817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.208834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.209027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.209096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.209162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.209233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.209293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.209304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.209373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.209435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.209509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.209591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.209637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.209644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.209710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.209774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.209836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.209907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.209959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.209969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.210037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.210107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.210183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.210264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.210314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.210322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.210400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.210473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.210550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.210630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.210687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.210696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.210770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.210830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.210896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.210960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.211009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.211014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.211090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.211155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.211224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.211291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.211351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.211357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.211431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.211494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.211563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.211633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.211690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.211698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.211772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.211829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.211887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.211946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.211995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.212000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.212069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:36.212132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:36.212215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:36.212277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:36.212327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:36.212336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:36.212371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:36.212428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.212445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.212448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:36.212475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:36.212490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:36.212493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:36.212496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:36.212497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:36.212905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:36.212927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:36.212934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:36.212941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:36.212943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:36.212945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:36.213456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:36.213477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:36.213482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:36.213484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:36.213487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:36.213489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:36.214022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:36.214043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:36.214047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:36.214050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:36.214052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:36.215271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:36.215290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:36.215299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392816214
2025-10-02T08:13:36.215401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:36.215414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:36.215418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:36.215420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:36.215426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:36.215428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:36.215850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:36.215870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:36.215875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:36.215877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:36.215879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:36.215881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:36.216358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:36.216376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:36.216381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:36.216382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:36.216385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:36.216387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:36.216830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:36.216853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:36.216857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:36.217969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:36.217990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:36.217994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:36.217997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:36.218003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392816217
2025-10-02T08:13:36.218303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:36.218322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:36.218326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:36.218331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:36.218334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:36.218337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:36.218833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:36.218855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:36.218860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:36.218865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:36.218868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:36.218871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:36.219318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:36.219335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.219409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392816218
2025-10-02T08:13:36.220118Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:36.220138Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:36.220142Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:36.220146Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:36.221750Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:36.221762Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:36.221764Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:36.221771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534606936381701:11100]
2025-10-02T08:13:36.221776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534606936381701:11100]
2025-10-02T08:13:36.221822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:36.221825Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:36.221831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.221831Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:36.221833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:36.221962Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:36.269135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534606936381768:6945]
2025-10-02T08:13:36.269278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1792, pipe: [1:7556534606936381768:6945]
2025-10-02T08:13:36.355034Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:36.355468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936381768:6945], now have 1 active actors on pipe
2025-10-02T08:13:36.355580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534606936381768:6945]
2025-10-02T08:13:36.355610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:36.355617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:36.355648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1793 reason: error at write: Disconnected sessionId: src_id|9fd49658-55ac3880-828718e2-f9a76394_0
2025-10-02T08:13:36.355698Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:36.355708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:36.355838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1793 sessionId: src_id|9fd49658-55ac3880-828718e2-f9a76394_0 is DEAD
2025-10-02T08:13:36.355971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd49658-55ac3880-828718e2-f9a76394_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:36.355979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd49658-55ac3880-828718e2-f9a76394_0] Write session will restart in 0.006792s
2025-10-02T08:13:36.355999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd49658-55ac3880-828718e2-f9a76394_0] Write session: Do CDS request
2025-10-02T08:13:36.356004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd49658-55ac3880-828718e2-f9a76394_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:36.364331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd49658-55ac3880-828718e2-f9a76394_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.364385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:36.364401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1794
2025-10-02T08:13:36.364590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.364632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:36.364637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:36.364642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:36.365090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1794 sessionId:  describe result for acl check
2025-10-02T08:13:36.365124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:36.365130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:36.365132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:36.365137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534606936381964:11058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:36.365657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534606936381964:11058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:36.366419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:36.367599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:36.367780Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:36.367791Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:36.367800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:36.367851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:36.367887Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534606936382002:11078]
2025-10-02T08:13:36.367903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534606936381964:11058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:36.368526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:36.368727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:36.368779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:36.369110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:36.369156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.369163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.369164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.369165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.369166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.369171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.369180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.369184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.369188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.369192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.369197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.369204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.369210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.369220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.369224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.369230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.369237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.369241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.369244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.369248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.369265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:36.373902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534606936381964:11058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:36.373918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534606936381964:11058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:36.373922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534606936381964:11058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:36.373930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:36.377055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:36.378729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:36.378746Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:36.378749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:36.378752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:36.378758Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1793 [1:7556534606936382002:11078]
2025-10-02T08:13:36.378769Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:36.378785Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:36.378788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.378792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.378794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.378810Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:36.378820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:36.378825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:36.378882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.378889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.378892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:36.378894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:36.378954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:36.378960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.378972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.378987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:36.379006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1793
2025-10-02T08:13:36.379007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936382029:11058], now have 1 active actors on pipe
2025-10-02T08:13:36.379010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534607396087455:2378], now have 1 active actors on pipe
2025-10-02T08:13:36.379015Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534606936381982:11078]
2025-10-02T08:13:36.379016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534606936381982:11078]
2025-10-02T08:13:36.379027Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:36.379036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.379040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.379041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:36.379044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:36.379060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:36.379075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:36.379082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:36.379117Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:36.379090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1793
2025-10-02T08:13:36.379127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.379130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.379131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:36.379138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.379145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:36.379152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534606936381982:11078]
2025-10-02T08:13:36.379159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:36.379173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:36.379186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.379264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.379270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.379282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.379320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1794 partition: 0 MaxSeqNo: 17 sessionId: src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0
2025-10-02T08:13:36.379625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd49658-55ac3880-828718e2-f9a76394_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:36.382095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0] Write session: try to update token
2025-10-02T08:13:36.382108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:36.395857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId: src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:36.397017Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:36.397030Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:36.397032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:36.397039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534606936381982:11078]
2025-10-02T08:13:36.397041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534606936381982:11078]
2025-10-02T08:13:36.397074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:36.397080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.397081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:36.397213Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:36.397283Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:36.397297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:36.398405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:36.455513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534606936382042:6945]
2025-10-02T08:13:36.455655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1793, pipe: [1:7556534606936382042:6945]
2025-10-02T08:13:36.530895Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:36.531149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.531159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.531195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936382042:6945], now have 1 active actors on pipe
2025-10-02T08:13:36.531329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534606936382042:6945]
2025-10-02T08:13:36.531358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:36.531366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:36.531460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1794 reason: error at write: Disconnected sessionId: src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0
2025-10-02T08:13:36.531461Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:36.531520Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:36.531634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1794 sessionId: src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0 is DEAD
2025-10-02T08:13:36.531762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:36.531771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0] Write session will restart in 0.007587s
2025-10-02T08:13:36.531793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0] Write session: Do CDS request
2025-10-02T08:13:36.531799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:36.539009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:36.539913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:36.540138Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:36.540147Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:36.540158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:36.540179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.540223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:36.540267Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534606936382266:11045]
2025-10-02T08:13:36.540318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:36.540329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1795
2025-10-02T08:13:36.540419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.540440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:36.540447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:36.540449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:36.540727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1795 sessionId:  describe result for acl check
2025-10-02T08:13:36.540748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:36.540752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:36.540754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:36.540757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534606936382271:11037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:36.540857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:36.541048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:36.541087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:36.541131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534606936382271:11037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:36.541384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:36.541420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.541425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.541426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.541427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.541428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.541433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.541442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.541446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.541452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.541455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.541459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.541466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.541471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.541476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.541485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.541490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.541494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.541499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.541504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.541508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.541527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:36.542889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534606936382271:11037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:36.548765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534606936382271:11037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:36.548781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534606936382271:11037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:36.548785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534606936382271:11037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:36.548795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:36.549307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:36.550861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:36.550876Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:36.550878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:36.550882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:36.550888Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1794 [1:7556534606936382266:11045]
2025-10-02T08:13:36.550898Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:36.550914Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:36.550922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.550925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.550927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.550941Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:36.550950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:36.550957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:36.551016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.551023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.551025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:36.551027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:36.551085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:36.551092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.551102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.551115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:36.551130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1794
2025-10-02T08:13:36.551136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936382313:11037], now have 1 active actors on pipe
2025-10-02T08:13:36.551139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534607396087474:2378], now have 1 active actors on pipe
2025-10-02T08:13:36.551144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534606936382260:11045]
2025-10-02T08:13:36.551146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534606936382260:11045]
2025-10-02T08:13:36.551156Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:36.551165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.551168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:36.551171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:36.551172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.551188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:36.551203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:36.551210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:36.551202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1794
2025-10-02T08:13:36.551246Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|229104e1-407c6001-de15e4-91520c0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:36.551256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.551258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.551259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:36.551267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.551274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:36.551284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534606936382260:11045]
2025-10-02T08:13:36.551288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:36.551299Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:36.551315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.551393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.551404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.551416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.551452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1795 partition: 0 MaxSeqNo: 17 sessionId: src_id|229104e1-407c6001-de15e4-91520c0b_0
2025-10-02T08:13:36.551747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb65c0e-c62fa7b0-499cf968-ff2a0450_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|229104e1-407c6001-de15e4-91520c0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:36.554464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229104e1-407c6001-de15e4-91520c0b_0] Write session: try to update token
2025-10-02T08:13:36.554481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229104e1-407c6001-de15e4-91520c0b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:36.569413Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:36.569436Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:36.569439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:36.569447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534606936382260:11045]
2025-10-02T08:13:36.569452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534606936382260:11045]
2025-10-02T08:13:36.569496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:36.569495Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:36.569502Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:36.569502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.569505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:36.569650Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:36.570184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId: src_id|229104e1-407c6001-de15e4-91520c0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:36.572903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:36.631617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534606936382327:6945]
2025-10-02T08:13:36.631720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1794, pipe: [1:7556534606936382327:6945]
2025-10-02T08:13:36.711119Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:36.711415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.711429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.711469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936382327:6945], now have 1 active actors on pipe
2025-10-02T08:13:36.711588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534606936382327:6945]
2025-10-02T08:13:36.711773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:36.711788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:36.711850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1795 reason: error at write: Disconnected sessionId: src_id|229104e1-407c6001-de15e4-91520c0b_0
2025-10-02T08:13:36.711907Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:36.711910Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:36.712005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1795 sessionId: src_id|229104e1-407c6001-de15e4-91520c0b_0 is DEAD
2025-10-02T08:13:36.712141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229104e1-407c6001-de15e4-91520c0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:36.712151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229104e1-407c6001-de15e4-91520c0b_0] Write session will restart in 0.009472s
2025-10-02T08:13:36.712176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229104e1-407c6001-de15e4-91520c0b_0] Write session: Do CDS request
2025-10-02T08:13:36.712183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229104e1-407c6001-de15e4-91520c0b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:36.720183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:36.720989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:36.721181Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:36.721184Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:36.721194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:36.721240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:36.721270Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534606936382544:11023]
2025-10-02T08:13:36.721884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:36.722097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:36.722138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:36.722430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:36.722469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.722471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.722472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.722473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.722474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.722479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.722489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.722493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.722496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.722500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.722505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.722512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.722519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.722525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.722529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.722534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.722539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.722543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.722548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.722552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.722571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:36.723224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229104e1-407c6001-de15e4-91520c0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.723333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:36.723342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1796
2025-10-02T08:13:36.723465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.723492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:36.723497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:36.723500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:36.724034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1796 sessionId:  describe result for acl check
2025-10-02T08:13:36.724086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:36.724093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:36.724095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:36.724100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534606936382560:11031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:36.724608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534606936382560:11031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:36.726713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534606936382560:11031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:36.731686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534606936382560:11031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:36.731703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534606936382560:11031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:36.731706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534606936382560:11031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:36.731715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:36.732173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:36.733832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:36.733850Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:36.733853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:36.733856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:36.733862Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1795 [1:7556534606936382544:11023]
2025-10-02T08:13:36.733874Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:36.733889Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:36.733897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.733901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.733903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.733918Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:36.733930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:36.733941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:36.734005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.734011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.734014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:36.734016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:36.734074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:36.734080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.734093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.734109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:36.734121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1795
2025-10-02T08:13:36.734132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936382591:11031], now have 1 active actors on pipe
2025-10-02T08:13:36.734135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534607396087482:2378], now have 1 active actors on pipe
2025-10-02T08:13:36.734140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534606936382538:11023]
2025-10-02T08:13:36.734142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534606936382538:11023]
2025-10-02T08:13:36.734153Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:36.734166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:36.734168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.734171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.734176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:36.734188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:36.734201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:36.734208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:36.734219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1795
2025-10-02T08:13:36.734246Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:36.734255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.734257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.734259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:36.734268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.734274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:36.734284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534606936382538:11023]
2025-10-02T08:13:36.734293Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:36.734311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:36.734326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.734377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.734383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.734396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.734432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1796 partition: 0 MaxSeqNo: 17 sessionId: src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0
2025-10-02T08:13:36.734750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229104e1-407c6001-de15e4-91520c0b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:36.737402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0] Write session: try to update token
2025-10-02T08:13:36.737414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:36.751325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId: src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:36.752530Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:36.752546Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:36.752548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:36.752556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534606936382538:11023]
2025-10-02T08:13:36.752560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534606936382538:11023]
2025-10-02T08:13:36.752606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:36.752617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.752620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:36.752747Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:36.752903Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:36.752919Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:36.754021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:36.811857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534606936382608:6945]
2025-10-02T08:13:36.811986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1795, pipe: [1:7556534606936382608:6945]
2025-10-02T08:13:36.900371Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:36.900718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.900732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.900769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936382608:6945], now have 1 active actors on pipe
2025-10-02T08:13:36.901022Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:36.901571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:36.901582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0] Write session will restart in 0.007522s
2025-10-02T08:13:36.901604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0] Write session: Do CDS request
2025-10-02T08:13:36.901612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:36.900961Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:36.901241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:36.901290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1796 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0
2025-10-02T08:13:36.901443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1796 sessionId: src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0 is DEAD
2025-10-02T08:13:36.901591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534606936382608:6945]
2025-10-02T08:13:36.910330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.910456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:36.910476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1797
2025-10-02T08:13:36.910606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:36.910638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:36.910647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:36.910651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:36.911040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1797 sessionId:  describe result for acl check
2025-10-02T08:13:36.911092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:36.911101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:36.911102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:36.911107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534606936382832:11011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:36.911266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:36.911902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534606936382832:11011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:36.911994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:36.912153Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:36.912173Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:36.912206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:36.912307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:36.912365Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534606936382840:11020]
2025-10-02T08:13:36.912950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:36.913180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:36.913240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:36.913523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:36.913572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.913578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.913579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.913580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.913581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.913586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.913595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.913599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.913602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.913606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.913610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.913617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:36.913622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.913626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:36.913635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.913640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:36.913652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.913662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.913666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.913670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.913685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:36.915750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534606936382832:11011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:36.921085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534606936382832:11011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:36.921097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534606936382832:11011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:36.921101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534606936382832:11011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:36.921108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:36.921602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:36.923104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:36.923121Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:36.923124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:36.923127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:36.923132Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1796 [1:7556534606936382840:11020]
2025-10-02T08:13:36.923142Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:36.923159Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:36.923161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.923164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.923166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.923180Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:36.923185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:36.923191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:36.923236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.923243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.923246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:36.923247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:36.923292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:36.923297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.923308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:36.923323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:36.923344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534606936382833:11020]
2025-10-02T08:13:36.923349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534606936382833:11020]
2025-10-02T08:13:36.923349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1796
2025-10-02T08:13:36.923354Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:36.923363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534606936382900:11011], now have 1 active actors on pipe
2025-10-02T08:13:36.923367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:36.923370Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:36.923373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:36.923386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:36.923392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:36.923398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.923401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.923413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534607396087488:2378], now have 1 active actors on pipe
2025-10-02T08:13:36.923443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534606936382833:11020]
2025-10-02T08:13:36.923451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:36.923461Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:36.923465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:36.923467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:36.923446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1796
2025-10-02T08:13:36.923468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:36.923473Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:36.923474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:36.923480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:36.923504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.923560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:36.923565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:36.923574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:36.923602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1797 partition: 0 MaxSeqNo: 17 sessionId: src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0
2025-10-02T08:13:36.923902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d65cf-814f7b45-b7bab5b3-11b92ee3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:36.926551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0] Write session: try to update token
2025-10-02T08:13:36.926570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:36.940516Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:36.940539Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:36.940542Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:36.940552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534606936382833:11020]
2025-10-02T08:13:36.940555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534606936382833:11020]
2025-10-02T08:13:36.940597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:36.940597Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:36.940603Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:36.940607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:36.940609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:36.940753Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:36.940789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId: src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:36.943318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:37.001794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534611231350221:6945]
2025-10-02T08:13:37.001869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1796, pipe: [1:7556534611231350221:6945]
2025-10-02T08:13:37.078201Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:37.078447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.078458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.078491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231350221:6945], now have 1 active actors on pipe
2025-10-02T08:13:37.078594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:37.078600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:37.078641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1797 reason: error at write: Disconnected sessionId: src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0
2025-10-02T08:13:37.078716Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:37.078735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:37.078936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:37.078946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0] Write session will restart in 0.006003s
2025-10-02T08:13:37.078968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0] Write session: Do CDS request
2025-10-02T08:13:37.078974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:37.078807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1797 sessionId: src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0 is DEAD
2025-10-02T08:13:37.078961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534611231350221:6945]
2025-10-02T08:13:37.086319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.086407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:37.086427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1798
2025-10-02T08:13:37.086535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.086565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:37.086570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:37.086572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:37.086823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:37.086976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1798 sessionId:  describe result for acl check
2025-10-02T08:13:37.087011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:37.087016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:37.087018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:37.087023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534611231350437:10974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:37.087496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534611231350437:10974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:37.087980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:37.088169Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:37.088179Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:37.088190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:37.088258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:37.088298Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534611231350444:10977]
2025-10-02T08:13:37.088940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:37.089151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:37.089203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:37.089515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:37.089559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.089566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.089567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.089568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.089569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.089574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.089583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.089586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.089589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.089593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.089597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.089604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.089610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.089619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.089622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.089631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.089635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.089639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.089643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.089647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.089666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:37.089837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534611231350437:10974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:37.095854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534611231350437:10974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:37.095872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534611231350437:10974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:37.095876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534611231350437:10974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:37.095893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:37.097994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:37.099485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:37.099500Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:37.099503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:37.099506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:37.099511Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1797 [1:7556534611231350444:10977]
2025-10-02T08:13:37.099519Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:37.099533Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:37.099540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.099542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.099543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.099556Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:37.099564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:37.099569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:37.099616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.099621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.099623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:37.099625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:37.099680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:37.099686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.099699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.099713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:37.099736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231350485:10974], now have 1 active actors on pipe
2025-10-02T08:13:37.099741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1797
2025-10-02T08:13:37.099746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534611231350432:10977]
2025-10-02T08:13:37.099748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534611231350432:10977]
2025-10-02T08:13:37.099760Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:37.099769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534611691054813:2378], now have 1 active actors on pipe
2025-10-02T08:13:37.099778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:37.099782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:37.099782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.099787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.099801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:37.099817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:37.099825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:37.099800Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1797
2025-10-02T08:13:37.099864Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:37.099875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.099883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.099885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:37.099893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.099906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:37.099923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534611231350432:10977]
2025-10-02T08:13:37.099932Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:37.099946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:37.099956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.100033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.100043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.100059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.100093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1798 partition: 0 MaxSeqNo: 17 sessionId: src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0
2025-10-02T08:13:37.100463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d1db6b-6acc41c9-909d333-1a0e2126_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:37.103308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0] Write session: try to update token
2025-10-02T08:13:37.103327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:37.111466Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:37.111489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:37.111500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534611231350432:10977]
2025-10-02T08:13:37.111555Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:37.111559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:37.111824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:37.111974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:37.112124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:37.112266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:37.112451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:37.112483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:37.116473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId: src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:37.119051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:37.119116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.119128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.119169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:37.119191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:37.119567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.119582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.119748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.119812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.119876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.119945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.120290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.120301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.120369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.120430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.120494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.120565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.120613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.120621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.120690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.120752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.120833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.120897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.120943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.120953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.121025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.121092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.121158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.121227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.121274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.121282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.121353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.121416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.121483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.121548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.121594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.121604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.121682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.121757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.121831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.121903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.121960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.121968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.122043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.122113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.122190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.122263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.122313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.122320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.122396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.122469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.122541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.122614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.122673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.122681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.122746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.122807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.122871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.122945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.122992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.122999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.123071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.123135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.123200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.123276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.123326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.123333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.123371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:37.123433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.123455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.123462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:37.123489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:37.123506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:37.123513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:37.123516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:37.123519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:37.123913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:37.123939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:37.123951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:37.123954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:37.123956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:37.123959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:37.124460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:37.124482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:37.124487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:37.124489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:37.124492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:37.124495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:37.125202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:37.125225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:37.125231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:37.125234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:37.125236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:37.126457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:37.126476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:37.126487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392817126
2025-10-02T08:13:37.126597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:37.126609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:37.126613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:37.126616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:37.126620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:37.126623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:37.127114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:37.127134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:37.127139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:37.127142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:37.127145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:37.127148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:37.127624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:37.127645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:37.127652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:37.127654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:37.127657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:37.127660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:37.128123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:37.128145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:37.128150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:37.129290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:37.129309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:37.129314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:37.129318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:37.129326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392817129
2025-10-02T08:13:37.129630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:37.129651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:37.129656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:37.129659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:37.129662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:37.129666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:37.130132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:37.130152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:37.130158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:37.130161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:37.130164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:37.130169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:37.130646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:37.130667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.130758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392817130
2025-10-02T08:13:37.131521Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:37.131545Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:37.131551Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:37.131558Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:37.133355Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:37.133370Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:37.133373Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:37.133380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534611231350432:10977]
2025-10-02T08:13:37.133383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534611231350432:10977]
2025-10-02T08:13:37.133431Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:37.133445Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:37.133447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:37.133452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.133454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:37.133596Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:37.178972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534611231350507:6945]
2025-10-02T08:13:37.179100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1797, pipe: [1:7556534611231350507:6945]
2025-10-02T08:13:37.274899Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:37.275307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231350507:6945], now have 1 active actors on pipe
2025-10-02T08:13:37.275419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:37.275426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:37.275453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1798 reason: error at write: Disconnected sessionId: src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0
2025-10-02T08:13:37.275494Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:37.275555Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:37.275625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1798 sessionId: src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0 is DEAD
2025-10-02T08:13:37.275732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534611231350507:6945]
2025-10-02T08:13:37.275772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:37.275783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0] Write session will restart in 0.009854s
2025-10-02T08:13:37.275801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0] Write session: Do CDS request
2025-10-02T08:13:37.275805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:37.283468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:37.284709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:37.284859Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:37.284866Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:37.284881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:37.284918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:37.284949Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534611231350725:10940]
2025-10-02T08:13:37.285346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:37.285541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:37.285588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:37.285818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:37.285849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.285858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.285859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.285860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.285861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.285866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.285875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.285879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.285883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.285886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.285891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.285902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.285905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.285908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.285911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.285913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.285916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.285919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.285923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.285926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.285936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:37.286298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.286408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:37.286419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1799
2025-10-02T08:13:37.286530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.286556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:37.286561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:37.286564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:37.286909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1799 sessionId:  describe result for acl check
2025-10-02T08:13:37.286937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:37.286939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:37.286940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:37.286944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534611231350741:10933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:37.287424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534611231350741:10933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:37.289756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534611231350741:10933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:37.293011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534611231350741:10933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:37.293023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534611231350741:10933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:37.293027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534611231350741:10933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:37.293033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:37.293644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:37.295004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:37.295019Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:37.295021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:37.295027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:37.295033Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1798 [1:7556534611231350725:10940]
2025-10-02T08:13:37.295044Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:37.295057Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:37.295060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.295063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.295064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.295075Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:37.295079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:37.295083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:37.295135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.295143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.295146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:37.295148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:37.295197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:37.295204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.295215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.295226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:37.295248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231350772:10933], now have 1 active actors on pipe
2025-10-02T08:13:37.295258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534611231350719:10940]
2025-10-02T08:13:37.295260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534611231350719:10940]
2025-10-02T08:13:37.295274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:37.295286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534611691054823:2378], now have 1 active actors on pipe
2025-10-02T08:13:37.295297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:37.295309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:37.295312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:37.295316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1798
2025-10-02T08:13:37.295316Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:37.295316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:37.295300Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1798
2025-10-02T08:13:37.295344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534611231350719:10940]
2025-10-02T08:13:37.295350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:37.295356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.295358Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:37.295360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.295398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:37.295408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.295411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.295412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:37.295420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.295431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:37.295452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.295497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.295506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.295524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.295561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1799 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0
2025-10-02T08:13:37.295890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35d9c7a-237a5e30-f5b045f9-d8d5e204_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:37.298460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0] Write session: try to update token
2025-10-02T08:13:37.298476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:37.312069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId: src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:37.312610Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:37.312632Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:37.312634Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:37.312643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534611231350719:10940]
2025-10-02T08:13:37.312646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534611231350719:10940]
2025-10-02T08:13:37.312684Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:37.312687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:37.312693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.312695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:37.312696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:37.312847Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:37.314519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:37.376064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534611231350790:6945]
2025-10-02T08:13:37.376211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1798, pipe: [1:7556534611231350790:6945]
2025-10-02T08:13:37.438054Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:37.438441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.438451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.438483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231350790:6945], now have 1 active actors on pipe
2025-10-02T08:13:37.438680Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:37.438747Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:37.438887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:37.438930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1799 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0
2025-10-02T08:13:37.439060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1799 sessionId: src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0 is DEAD
2025-10-02T08:13:37.439191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534611231350790:6945]
2025-10-02T08:13:37.439230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:37.439240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0] Write session will restart in 0.007596s
2025-10-02T08:13:37.439264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0] Write session: Do CDS request
2025-10-02T08:13:37.439270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:37.447259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:37.448206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:37.448237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.448279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:37.448292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1800
2025-10-02T08:13:37.448380Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:37.448391Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:37.448401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:37.448416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.448443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:37.448451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:37.448453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:37.448454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:37.448483Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534611231351010:10920]
2025-10-02T08:13:37.448817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1800 sessionId:  describe result for acl check
2025-10-02T08:13:37.448851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:37.448852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:37.448854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:37.448859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534611231351014:10902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:37.449113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:37.449280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:37.449322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:37.449342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534611231351014:10902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:37.449610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:37.449648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.449653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.449654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.449655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.449657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.449661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.449671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.449679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.449683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.449690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.449695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.449706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.449718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.449727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.449737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.449745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.449754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.449762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.449770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.449779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.449800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:37.450978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534611231351014:10902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:37.457652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534611231351014:10902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:37.457672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534611231351014:10902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:37.457676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534611231351014:10902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:37.457688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:37.458002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:37.459610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:37.459625Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:37.459628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:37.459631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:37.459637Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1799 [1:7556534611231351010:10920]
2025-10-02T08:13:37.459650Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:37.459665Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:37.459669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.459672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.459674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.459689Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:37.459698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:37.459705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:37.459769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.459778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.459780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:37.459783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:37.459841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:37.459848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.459861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.459879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:37.459898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1799
2025-10-02T08:13:37.459906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231351056:10902], now have 1 active actors on pipe
2025-10-02T08:13:37.459913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534611231351003:10920]
2025-10-02T08:13:37.459916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534611231351003:10920]
2025-10-02T08:13:37.459929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:37.459937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534611691054829:2378], now have 1 active actors on pipe
2025-10-02T08:13:37.459942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.459946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.459947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:37.459950Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:37.459962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:37.459976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:37.459979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:37.459990Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1799
2025-10-02T08:13:37.460018Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b416c417-530bf009-c7edc14-45b333d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:37.460030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.460034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.460036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:37.460045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.460057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:37.460068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534611231351003:10920]
2025-10-02T08:13:37.460079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:37.460091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:37.460111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.460147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.460154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.460168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.460210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1800 partition: 0 MaxSeqNo: 17 sessionId: src_id|b416c417-530bf009-c7edc14-45b333d9_0
2025-10-02T08:13:37.460503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce37ba2-63d96474-c4a35aed-1f3d1946_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b416c417-530bf009-c7edc14-45b333d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:37.463217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b416c417-530bf009-c7edc14-45b333d9_0] Write session: try to update token
2025-10-02T08:13:37.463233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b416c417-530bf009-c7edc14-45b333d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:37.471280Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:37.471301Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:37.471310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534611231351003:10920]
2025-10-02T08:13:37.471350Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:37.471357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:37.471523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:37.471659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:37.471800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:37.471944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:37.472136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:37.472175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:37.476667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId: src_id|b416c417-530bf009-c7edc14-45b333d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:37.479279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:37.479340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.479351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.479382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:37.479406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:37.479461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.479476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.479610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.479663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.479717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.479773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.479813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.479820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.479880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.479933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.479991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.480051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.480092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.480097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.480160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.480229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.480294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.480354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.480394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.480400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.480460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.480515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.480571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.480627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.480668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.480675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.480736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.480789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.480868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.480925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.480967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.480972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.481040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.481103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.481179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.481246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.481293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.481302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.481375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.481434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.481500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.481566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.481617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.481623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.481693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.481753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.481815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.481882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.481926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.481931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.481990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.482043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.482102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.482166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.482213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.482219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.482283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:37.482336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:37.482395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:37.482470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:37.482517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:37.482522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:37.482550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:37.482606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.482621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.482626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:37.482650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:37.482664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:37.482669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:37.482671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:37.482673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:37.483009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:37.483028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:37.483037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:37.483039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:37.483041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:37.483044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:37.483564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:37.483584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:37.483588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:37.483590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:37.483592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:37.483593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:37.484094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:37.484112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:37.484115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:37.484117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:37.484119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:37.485256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:37.485271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:37.485281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392817485
2025-10-02T08:13:37.485376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:37.485385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:37.485390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:37.485392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:37.485395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:37.485397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:37.485862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:37.485880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:37.485883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:37.485885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:37.485887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:37.485889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:37.486345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:37.486365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:37.486372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:37.486374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:37.486377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:37.486379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:37.486805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:37.486821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:37.486825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:37.487838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:37.487853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:37.487856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:37.487859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:37.487865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392817487
2025-10-02T08:13:37.488127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:37.488142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:37.488148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:37.488151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:37.488155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:37.488166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:37.488587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:37.488604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:37.488608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:37.488612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:37.488614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:37.488616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:37.489027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:37.489042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.489114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392817488
2025-10-02T08:13:37.489780Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:37.489799Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:37.489803Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:37.489806Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:37.491441Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:37.491454Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:37.491455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:37.491461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534611231351003:10920]
2025-10-02T08:13:37.491464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534611231351003:10920]
2025-10-02T08:13:37.491508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:37.491507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:37.491514Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:37.491514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.491516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:37.491635Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:37.539559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534611231351091:6945]
2025-10-02T08:13:37.539645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1799, pipe: [1:7556534611231351091:6945]
2025-10-02T08:13:37.624473Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:37.624820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231351091:6945], now have 1 active actors on pipe
2025-10-02T08:13:37.624932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534611231351091:6945]
2025-10-02T08:13:37.625069Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:37.625364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:37.625399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1800 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b416c417-530bf009-c7edc14-45b333d9_0
2025-10-02T08:13:37.625706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b416c417-530bf009-c7edc14-45b333d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:37.625715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b416c417-530bf009-c7edc14-45b333d9_0] Write session will restart in 0.009629s
2025-10-02T08:13:37.625737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b416c417-530bf009-c7edc14-45b333d9_0] Write session: Do CDS request
2025-10-02T08:13:37.625743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b416c417-530bf009-c7edc14-45b333d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:37.625574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1800 sessionId: src_id|b416c417-530bf009-c7edc14-45b333d9_0 is DEAD
2025-10-02T08:13:37.628865Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:37.634320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:37.635523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:37.635709Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:37.635717Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:37.635724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:37.635772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:37.635807Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534611231351313:10885]
2025-10-02T08:13:37.636323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b416c417-530bf009-c7edc14-45b333d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.636347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:37.636360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1801
2025-10-02T08:13:37.636400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:37.636519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.636551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:37.636560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:37.636563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:37.636608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:37.636665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:37.636914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1801 sessionId:  describe result for acl check
2025-10-02T08:13:37.636941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:37.636949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:37.636950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:37.636955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534611231351324:10881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:37.637018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:37.637066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.637074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.637075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.637077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.637078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.637084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.637094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.637099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.637103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.637108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.637114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.637123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.637129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.637141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.637146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.637152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.637161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.637171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.637182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.637192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.637215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:37.637440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534611231351324:10881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:37.639456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534611231351324:10881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:37.644590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534611231351324:10881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:37.644605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534611231351324:10881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:37.644608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534611231351324:10881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:37.644617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:37.644996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:37.646321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:37.646334Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:37.646336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:37.646338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:37.646342Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1800 [1:7556534611231351313:10885]
2025-10-02T08:13:37.646350Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:37.646361Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:37.646363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.646365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.646367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.646379Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:37.646382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:37.646386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:37.646426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.646431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.646433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:37.646435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:37.646493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:37.646500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.646510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.646526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:37.646544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534611691054847:2378], now have 1 active actors on pipe
2025-10-02T08:13:37.646551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231351363:10881], now have 1 active actors on pipe
2025-10-02T08:13:37.646556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534611231351307:10885]
2025-10-02T08:13:37.646558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534611231351307:10885]
2025-10-02T08:13:37.646564Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:37.646571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1800
2025-10-02T08:13:37.646577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:37.646579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:37.646580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:37.646591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:37.646598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:37.646604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.646607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.646591Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1800
2025-10-02T08:13:37.646641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534611231351307:10885]
2025-10-02T08:13:37.646652Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:37.646660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:37.646675Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:37.646684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.646688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.646690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:37.646698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.646711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:37.646749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.646788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.646795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.646805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.646836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1801 partition: 0 MaxSeqNo: 17 sessionId: src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0
2025-10-02T08:13:37.647121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b416c417-530bf009-c7edc14-45b333d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:37.649514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0] Write session: try to update token
2025-10-02T08:13:37.649524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:37.661965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId: src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:37.664153Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:37.664167Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:37.664168Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:37.664174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534611231351307:10885]
2025-10-02T08:13:37.664177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534611231351307:10885]
2025-10-02T08:13:37.664225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:37.664231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.664230Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:37.664232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:37.664235Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:37.664365Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:37.664524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:37.725269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534611231351379:6945]
2025-10-02T08:13:37.725415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1800, pipe: [1:7556534611231351379:6945]
2025-10-02T08:13:37.796991Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:37.797369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.797383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.797415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231351379:6945], now have 1 active actors on pipe
2025-10-02T08:13:37.797554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:37.797562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:37.797614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1801 reason: error at write: Disconnected sessionId: src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0
2025-10-02T08:13:37.797638Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:37.797697Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:37.797781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1801 sessionId: src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0 is DEAD
2025-10-02T08:13:37.797949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:37.797957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0] Write session will restart in 0.005460s
2025-10-02T08:13:37.797933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534611231351379:6945]
2025-10-02T08:13:37.797981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0] Write session: Do CDS request
2025-10-02T08:13:37.797987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:37.804216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.804263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:37.804276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1802
2025-10-02T08:13:37.804400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.804429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:37.804439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:37.804442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:37.804924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1802 sessionId:  describe result for acl check
2025-10-02T08:13:37.804958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:37.804964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:37.804965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:37.804970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534611231351581:10871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:37.805448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534611231351581:10871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:37.806743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:37.807506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:37.807627Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:37.807634Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:37.807640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:37.807669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:37.807692Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534611231351627:10873]
2025-10-02T08:13:37.807728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534611231351581:10871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:37.808094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:37.808241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:37.808270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:37.808457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:37.808486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.808491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.808493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.808494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.808495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.808498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.808507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.808512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.808519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.808523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.808532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.808540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.808546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.808549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.808551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.808554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.808556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.808559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.808561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.808564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.808574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:37.813537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534611231351581:10871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:37.813549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534611231351581:10871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:37.813552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534611231351581:10871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:37.813558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:37.816139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:37.817690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:37.817703Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:37.817706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:37.817709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:37.817714Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1801 [1:7556534611231351627:10873]
2025-10-02T08:13:37.817725Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:37.817740Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:37.817741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.817743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.817744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.817756Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:37.817763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:37.817768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:37.817818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.817824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.817826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:37.817828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:37.817873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:37.817880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.817891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.817907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:37.817921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534611231351617:10873]
2025-10-02T08:13:37.817925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534611231351617:10873]
2025-10-02T08:13:37.817932Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:37.817942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231351654:10871], now have 1 active actors on pipe
2025-10-02T08:13:37.817942Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:37.817945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:37.817950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:37.817956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1801
2025-10-02T08:13:37.817958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:37.817959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:37.817964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534611691054854:2378], now have 1 active actors on pipe
2025-10-02T08:13:37.817988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.817995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.818007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534611231351617:10873]
2025-10-02T08:13:37.818017Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:37.818029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:37.818041Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:37.818052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.818055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.818056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:37.818030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1801
2025-10-02T08:13:37.818061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.818067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:37.818085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.818126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.818130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.818140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.818163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1802 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0
2025-10-02T08:13:37.818465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ace12a-8652b9d-a4bae9f1-ee8a1e4d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:37.821062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0] Write session: try to update token
2025-10-02T08:13:37.821078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:37.833196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId: src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:37.834944Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:37.834958Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:37.834961Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:37.834968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534611231351617:10873]
2025-10-02T08:13:37.834973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534611231351617:10873]
2025-10-02T08:13:37.835009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:37.835010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:37.835014Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:37.835016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.835019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:37.835146Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:37.835554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:37.898326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534611231351669:6945]
2025-10-02T08:13:37.898450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1801, pipe: [1:7556534611231351669:6945]
2025-10-02T08:13:37.972734Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:37.973203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.973217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.973255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231351669:6945], now have 1 active actors on pipe
2025-10-02T08:13:37.973348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:37.973354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:37.973399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1802 reason: error at write: Disconnected sessionId: src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0
2025-10-02T08:13:37.973473Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:37.973551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1802 sessionId: src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0 is DEAD
2025-10-02T08:13:37.973530Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:37.973671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534611231351669:6945]
2025-10-02T08:13:37.973694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:37.973692Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:13:37.973704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0] Write session will restart in 0.007548s
2025-10-02T08:13:37.973727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0] Write session: Do CDS request
2025-10-02T08:13:37.973734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:37.973755Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 18 consumer shared/user session shared/user_1_18_7955205124146356881_v1 is DEAD
2025-10-02T08:13:37.973846Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:13:37.973884Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:13:37.973888Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:13:37.973901Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.005366s
2025-10-02T08:13:37.973914Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534533921903880:6951] disconnected; active server actors: 1
2025-10-02T08:13:37.973924Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534533921903880:6951] client user disconnected session shared/user_1_18_7955205124146356881_v1
2025-10-02T08:13:37.980165Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:13:37.980835Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:13:37.980849Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 19
2025-10-02T08:13:37.980991Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 19 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:13:37.981040Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:13:37.981125Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 auth for : user
2025-10-02T08:13:37.981283Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 Handle describe topics response
2025-10-02T08:13:37.981314Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 auth is DEAD
2025-10-02T08:13:37.981321Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:13:37.981556Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:13:37.981709Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_19_16383212970648087262_v1
2025-10-02T08:13:37.981719Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:13:37.981804Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:13:37.981950Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534611231351883:10817] connected; active server actors: 1
2025-10-02T08:13:37.982018Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:13:37.982131Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 got read request: guid# ce94b74-cf56d1e4-9553f61b-268aa4b8
2025-10-02T08:13:37.982175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.982221Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534611231351883:10817] session shared/user_1_19_16383212970648087262_v1
2025-10-02T08:13:37.982239Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:13:37.982248Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:13:37.982258Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_19_16383212970648087262_v1" (Sender=[1:7556534611231351860:10817], Pipe=[1:7556534611231351883:10817], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:13:37.982262Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:13:37.982275Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:13:37.982294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:37.982302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1803
2025-10-02T08:13:37.982286Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_19_16383212970648087262_v1" (Sender=[1:7556534611231351860:10817], Pipe=[1:7556534611231351883:10817], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:13:37.982310Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_19_16383212970648087262_v1" sender [1:7556534611231351860:10817] lock partition 0 for ReadingSession "shared/user_1_19_16383212970648087262_v1" (Sender=[1:7556534611231351860:10817], Pipe=[1:7556534611231351883:10817], Partitions=[], ActiveFamilyCount=1) generation 1 step 19
2025-10-02T08:13:37.982324Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:13:37.982328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000046s
2025-10-02T08:13:37.982383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:37.982416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:37.982424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:37.982427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:37.982627Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 19 Session: "shared/user_1_19_16383212970648087262_v1" ClientId: "user" PipeClient { RawX1: 7556534611231351883 RawX2: 4503603922348609 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:13:37.982645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:13:37.982944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1803 sessionId:  describe result for acl check
2025-10-02T08:13:37.982968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:37.982970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:37.982971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:37.982975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534611231351921:10830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:37.983427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534611231351921:10830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:37.984396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:37.985886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:37.986041Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:37.986051Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:37.986060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:37.986108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:37.986140Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534611231351954:10834]
2025-10-02T08:13:37.986646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:37.986739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534611231351921:10830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:37.986866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:37.986902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:37.987182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:37.987235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.987241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.987242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.987243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.987244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.987248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.987257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.987260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.987263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.987266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.987271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.987278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:37.987283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.987288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:37.987292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.987297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:37.987300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.987305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.987309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.987314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.987331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:37.992368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534611231351921:10830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:37.992383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534611231351921:10830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:37.992386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534611231351921:10830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:37.992394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:37.995805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:37.997448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:37.997467Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:37.997469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:37.997472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:37.997478Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1802 [1:7556534611231351954:10834]
2025-10-02T08:13:37.997488Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:37.997502Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:37.997506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.997508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.997510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.997526Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:37.997536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:37.997542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:37.997597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.997605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.997608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:37.997610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:37.997675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:37.997683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:37.997696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:37.997711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:37.997724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1802
2025-10-02T08:13:37.997734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231351917:10829], now have 1 active actors on pipe
2025-10-02T08:13:37.997736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534611231351981:10830], now have 1 active actors on pipe
2025-10-02T08:13:37.997739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534611691054860:2378], now have 1 active actors on pipe
2025-10-02T08:13:37.997744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534611231351937:10834]
2025-10-02T08:13:37.997746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534611231351937:10834]
2025-10-02T08:13:37.997753Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:37.997755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1802, pipe: [1:7556534611231351917:10829]
2025-10-02T08:13:37.997762Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:37.997765Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:37.997767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.997771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.997788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:37.997805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:37.997812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:37.997816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.997818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.997824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_19_16383212970648087262_v1 on pipe: [1:7556534611231351917:10829]
2025-10-02T08:13:37.997812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1802
2025-10-02T08:13:37.997842Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_19_16383212970648087262_v1:1 with generation 1802
2025-10-02T08:13:37.997871Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|801ebc8d-903bc1a5-b603ac75-963d138_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:37.997881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.997885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.997891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:37.997899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.997907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:37.997918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534611231351937:10834]
2025-10-02T08:13:37.997931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:37.997933Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:37.997947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.997954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.997956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:37.997969Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_19_16383212970648087262_v1
2025-10-02T08:13:37.997975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.998013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.998041Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:37.998062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:37.998068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:37.998158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:37.998197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1803 partition: 0 MaxSeqNo: 17 sessionId: src_id|801ebc8d-903bc1a5-b603ac75-963d138_0
2025-10-02T08:13:37.998507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab46d86-2f084f0c-d02495b5-24b9be72_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|801ebc8d-903bc1a5-b603ac75-963d138_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:37.999913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:13:37.999946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:13:37.999960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:37.999967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:37.999969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:37.999976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:13:37.999995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:13:38.000062Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392817997 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:13:38.000079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:13:38.000111Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 sending to client partition status
2025-10-02T08:13:38.001010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|801ebc8d-903bc1a5-b603ac75-963d138_0] Write session: try to update token
2025-10-02T08:13:38.001024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|801ebc8d-903bc1a5-b603ac75-963d138_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:38.008767Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:38.008786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:38.008795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534611231351937:10834]
2025-10-02T08:13:38.008859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:38.008860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:38.009025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:38.009174Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:38.009316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:38.009460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:38.009653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:38.009690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:38.013973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId: src_id|801ebc8d-903bc1a5-b603ac75-963d138_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:38.016400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:38.016462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.016474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.016502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:38.016524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:38.016609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.016833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.016997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.017060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.017121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.017180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.017220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.017226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.017286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.017338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.017393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.017545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.017600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.017607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.017670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.017723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.017773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.017830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.017869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.017874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.017928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.017995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.018064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.018138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.018234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.018235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.018302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.018356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.018413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.018473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.018524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.018526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.018597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.018650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.018709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.018769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.018811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.018813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.018887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.018943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.019008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.019071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.019121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.019123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.019196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.019250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.019309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.019382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.019439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.019445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.019519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.019572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.019629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.019688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.019732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.019734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.019801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.019853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.019906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.019965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.020008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.020010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.020049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:38.020098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.020115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.020118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:38.020143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:38.020156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:38.020159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:38.020162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:38.020164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:38.020522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:38.020536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:38.020541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:38.020544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:38.020548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:38.020551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:38.021103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:38.021132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:38.021139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:38.021142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:38.021145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:38.021147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:38.021590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:38.021612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:38.021620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:38.021623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:38.021625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:38.022763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:38.022789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:38.022800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392818022
2025-10-02T08:13:38.022926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:38.022940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:38.022949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:38.022956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:38.022960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:38.022963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:38.023391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:38.023412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:38.023419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:38.023422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:38.023426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:38.023429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:38.023851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:38.023868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:38.023874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:38.023876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:38.023878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:38.023880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:38.024318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:38.024339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:38.024349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:38.025402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:38.025416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:38.025420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:38.025422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:38.025427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392818025
2025-10-02T08:13:38.025693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:38.025708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:38.025712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:38.025714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:38.025718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:38.025721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:38.026168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:38.026189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:38.026195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:38.026202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:38.026206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:38.026209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:38.026651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:38.026673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.026750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392818026
2025-10-02T08:13:38.027519Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:38.027541Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:38.027548Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:38.027559Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:38.029227Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:38.029247Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:38.029249Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:38.029257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534611231351937:10834]
2025-10-02T08:13:38.029260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534611231351937:10834]
2025-10-02T08:13:38.029318Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:38.029320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:38.029324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.029326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:38.029330Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:38.029478Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:38.159671Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:38.160027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:38.160035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:38.160053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1803 reason: error at write: Disconnected sessionId: src_id|801ebc8d-903bc1a5-b603ac75-963d138_0
2025-10-02T08:13:38.160132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_19_16383212970648087262_v1
2025-10-02T08:13:38.160150Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:38.160213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1803 sessionId: src_id|801ebc8d-903bc1a5-b603ac75-963d138_0 is DEAD
2025-10-02T08:13:38.160321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ebc8d-903bc1a5-b603ac75-963d138_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:38.160331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ebc8d-903bc1a5-b603ac75-963d138_0] Write session will restart in 0.006955s
2025-10-02T08:13:38.160354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ebc8d-903bc1a5-b603ac75-963d138_0] Write session: Do CDS request
2025-10-02T08:13:38.160359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ebc8d-903bc1a5-b603ac75-963d138_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:38.160364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534611231351917:10829]
2025-10-02T08:13:38.160381Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_19_16383212970648087262_v1
2025-10-02T08:13:38.160525Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:38.168253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|801ebc8d-903bc1a5-b603ac75-963d138_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.168326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:38.168341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1804
2025-10-02T08:13:38.168434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.168461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:38.168470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:38.168473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:38.168836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1804 sessionId:  describe result for acl check
2025-10-02T08:13:38.168865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:38.168867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:38.168868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:38.168873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534615526319582:10822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:38.169261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534615526319582:10822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:38.169379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:38.169763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:38.169926Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:38.169937Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:38.169947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:38.169996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:38.170025Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534615526319605:10821]
2025-10-02T08:13:38.170604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:38.170778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:38.170815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:38.170865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534615526319582:10822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:38.171069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:38.171104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.171109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.171110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.171112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.171113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.171117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.171126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.171129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.171132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.171135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.171139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.171145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.171150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.171154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.171158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.171162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.171170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.171174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.171178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.171182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.171199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:38.177004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534615526319582:10822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:38.177020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534615526319582:10822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:38.177024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534615526319582:10822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:38.177032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:38.181994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:38.183477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:38.183496Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:38.183500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:38.183504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:38.183510Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1803 [1:7556534615526319605:10821]
2025-10-02T08:13:38.183525Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:38.183540Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:38.183543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.183546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.183548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.183563Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:38.183568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:38.183574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:38.183634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.183643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.183646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:38.183649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:38.183780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1803
2025-10-02T08:13:38.183833Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1803
2025-10-02T08:13:38.183877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:38.183886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.183899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.183917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:38.183940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534615986022187:2378], now have 1 active actors on pipe
2025-10-02T08:13:38.183947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526319637:10822], now have 1 active actors on pipe
2025-10-02T08:13:38.183951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.183955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.183978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534615526319587:10821]
2025-10-02T08:13:38.183985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534615526319587:10821]
2025-10-02T08:13:38.183996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:38.184008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:38.184016Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:38.184019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:38.184027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:38.184034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:38.184048Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:38.184059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.184067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.184069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:38.184078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.184090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:38.184127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534615526319587:10821]
2025-10-02T08:13:38.184138Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:38.184150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:38.184155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.184226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.184234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.184247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.184284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1804 partition: 0 MaxSeqNo: 17 sessionId: src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0
2025-10-02T08:13:38.184586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ebc8d-903bc1a5-b603ac75-963d138_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:38.187018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0] Write session: try to update token
2025-10-02T08:13:38.187031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:38.200402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId: src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:38.201838Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:38.201861Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:38.201863Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:38.201872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534615526319587:10821]
2025-10-02T08:13:38.201877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534615526319587:10821]
2025-10-02T08:13:38.201918Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:38.201919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:38.201924Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:38.201925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.201928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:38.202060Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:38.202786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:38.260300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534615526319650:10829]
2025-10-02T08:13:38.260468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1803, pipe: [1:7556534615526319650:10829]
2025-10-02T08:13:38.349040Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:38.349361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.349374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.349411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526319650:10829], now have 1 active actors on pipe
2025-10-02T08:13:38.349504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:38.349511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:38.349562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1804 reason: error at write: Disconnected sessionId: src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0
2025-10-02T08:13:38.349650Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:38.349649Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:38.349712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1804 sessionId: src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0 is DEAD
2025-10-02T08:13:38.349854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534615526319650:10829]
2025-10-02T08:13:38.349876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:38.349889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0] Write session will restart in 0.006205s
2025-10-02T08:13:38.349916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0] Write session: Do CDS request
2025-10-02T08:13:38.349923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:38.357265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.357331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:38.357350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1805
2025-10-02T08:13:38.357464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.357495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:38.357518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:38.357521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:38.357901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1805 sessionId:  describe result for acl check
2025-10-02T08:13:38.357932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:38.357933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:38.357935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:38.357940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534615526319922:10806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:38.358409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534615526319922:10806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:38.358461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:38.358852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:38.358987Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:38.358996Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:38.359004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:38.359039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:38.359071Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534615526319937:9851]
2025-10-02T08:13:38.359709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:38.359844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:38.359877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:38.360157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:38.360205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.360211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.360212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.360213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.360214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.360219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.360228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.360235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.360239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.360243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.360247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.360254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.360260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.360262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534615526319922:10806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:38.360269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.360274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.360283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.360291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.360297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.360305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.360314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.360338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:38.366164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534615526319922:10806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:38.366181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534615526319922:10806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:38.366185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534615526319922:10806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:38.366192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:38.368068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:38.369537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:38.369554Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:38.369557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:38.369560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:38.369566Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1804 [1:7556534615526319937:9851]
2025-10-02T08:13:38.369578Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:38.369593Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:38.369601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.369604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.369606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.369622Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:38.369632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:38.369638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:38.369772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.369780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.369782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:38.369784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:38.369841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:38.369848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.369861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.369874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:38.369885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1804
2025-10-02T08:13:38.369896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526319977:10806], now have 1 active actors on pipe
2025-10-02T08:13:38.369899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534615986022193:2378], now have 1 active actors on pipe
2025-10-02T08:13:38.369905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534615526319927:9851]
2025-10-02T08:13:38.369911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534615526319927:9851]
2025-10-02T08:13:38.369923Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:38.369935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.369938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:38.369941Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:38.369942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.369958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:38.369976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:38.369983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:38.369954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1804
2025-10-02T08:13:38.370019Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:38.370028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.370031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.370033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:38.370042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.370054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:38.370069Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534615526319927:9851]
2025-10-02T08:13:38.370081Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:38.370094Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:38.370107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.370163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.370171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.370183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.370215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1805 partition: 0 MaxSeqNo: 17 sessionId: src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0
2025-10-02T08:13:38.370525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34c0a02-4664dd31-fbd7b20c-b00c104c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:38.373261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0] Write session: try to update token
2025-10-02T08:13:38.373280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:38.387630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId: src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:38.387996Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:38.388013Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:38.388016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:38.388025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534615526319927:9851]
2025-10-02T08:13:38.388029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534615526319927:9851]
2025-10-02T08:13:38.388071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:38.388081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.388084Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:38.388085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:38.388088Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:38.388237Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:38.390058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:38.450234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534615526319990:10829]
2025-10-02T08:13:38.450330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1804, pipe: [1:7556534615526319990:10829]
2025-10-02T08:13:38.523426Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:38.523677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.523687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.523729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526319990:10829], now have 1 active actors on pipe
2025-10-02T08:13:38.524182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:38.524193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0] Write session will restart in 0.008607s
2025-10-02T08:13:38.524224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0] Write session: Do CDS request
2025-10-02T08:13:38.524230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:38.523848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:38.523854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:38.523905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1805 reason: error at write: Disconnected sessionId: src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0
2025-10-02T08:13:38.524036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1805 sessionId: src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0 is DEAD
2025-10-02T08:13:38.524225Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:38.524535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534615526319990:10829]
2025-10-02T08:13:38.524905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:38.534270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.534576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:38.534592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1806
2025-10-02T08:13:38.534764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.534793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:38.534798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:38.534801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:38.535173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1806 sessionId:  describe result for acl check
2025-10-02T08:13:38.535198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:38.535200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:38.535201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:38.535206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534615526320266:10792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:38.535691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534615526320266:10792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:38.536620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:38.537403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:38.537558Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:38.537568Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:38.537577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:38.537621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:38.537654Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534615526320302:10796]
2025-10-02T08:13:38.538064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:38.538213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:38.538242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:38.538468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:38.538502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.538506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.538507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.538507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.538508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.538510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.538516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.538518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.538521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.538523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.538526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.538530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.538534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.538537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.538539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.538542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.538544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.538546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.538549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.538551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.538560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:38.541693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534615526320266:10792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:38.546064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534615526320266:10792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:38.546079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534615526320266:10792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:38.546082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534615526320266:10792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:38.546090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:38.546476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:38.547997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:38.548013Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:38.548015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:38.548018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:38.548022Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1805 [1:7556534615526320302:10796]
2025-10-02T08:13:38.548030Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:38.548041Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:38.548044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.548046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.548047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.548059Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:38.548062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:38.548066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:38.548105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.548111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.548113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:38.548115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:38.548167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:38.548176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.548187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.548207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:38.548221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1805
2025-10-02T08:13:38.548229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526320328:10792], now have 1 active actors on pipe
2025-10-02T08:13:38.548235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534615526320287:10796]
2025-10-02T08:13:38.548237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534615526320287:10796]
2025-10-02T08:13:38.548248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:38.548260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534615986022211:2378], now have 1 active actors on pipe
2025-10-02T08:13:38.548267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:38.548269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.548271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:38.548273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.548289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:38.548301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:38.548305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:38.548317Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1805
2025-10-02T08:13:38.548341Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:38.548353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.548357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.548358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:38.548365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.548374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:38.548380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534615526320287:10796]
2025-10-02T08:13:38.548388Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:38.548405Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:38.548415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.548483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.548488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.548498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.548523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1806 partition: 0 MaxSeqNo: 17 sessionId: src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0
2025-10-02T08:13:38.548796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ad2fcc-ce629422-b7496b89-8843047a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:38.551364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0] Write session: try to update token
2025-10-02T08:13:38.551379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:38.559341Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:38.559360Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:38.559370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534615526320287:10796]
2025-10-02T08:13:38.559410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:38.559410Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:38.559572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:38.559710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:38.559851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:38.559994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:38.560208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:38.560250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:38.571224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId: src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:38.573723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:38.573815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.573827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.573857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:38.573877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:38.573920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.573937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.574130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.574201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.574288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.574359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.574509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.574517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.574592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.574658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.574730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.574805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.574854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.574862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.574936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.575004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.575069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.575137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.575183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.575191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.575263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.575336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.575415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.575491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.575538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.575544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.575618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.575697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.575772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.575849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.575904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.575910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.575987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.576054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.576126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.576209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.576259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.576265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.576341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.576407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.576486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.576560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.576612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.576619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.576701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.576770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.576863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.576939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.576996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.577002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.577081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.577148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.577211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.577277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.577327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.577335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.577409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:38.577474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:38.577538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:38.577607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:38.577657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:38.577663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:38.577732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:38.577796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.577820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.577823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:38.577871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:38.577891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:38.577898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:38.577901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:38.577904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:38.578331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:38.578363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:38.578370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:38.578373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:38.578376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:38.578379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:38.579026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:38.579053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:38.579059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:38.579062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:38.579065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:38.579070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:38.579518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:38.579537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:38.579540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:38.579542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:38.579544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:38.580843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:38.580861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:38.580876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392818580
2025-10-02T08:13:38.581020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:38.581036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:38.581047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:38.581050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:38.581056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:38.581064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:38.581560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:38.581585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:38.581593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:38.581601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:38.581607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:38.581611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:38.582116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:38.582141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:38.582154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:38.582162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:38.582166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:38.582169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:38.582604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:38.582625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:38.582629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:38.583677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:38.583697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:38.583705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:38.583707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:38.583713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392818583
2025-10-02T08:13:38.583999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:38.584018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:38.584026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:38.584030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:38.584032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:38.584034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:38.584462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:38.584483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:38.584486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:38.584489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:38.584491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:38.584493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:38.584939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:38.584954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.585024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392818584
2025-10-02T08:13:38.587219Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:38.587242Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:38.587249Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:38.587256Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:38.587271Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:38.587273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:38.587274Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:38.587281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534615526320287:10796]
2025-10-02T08:13:38.587290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534615526320287:10796]
2025-10-02T08:13:38.587331Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:38.587344Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:38.587350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:38.587354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.587355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:38.587482Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:38.624859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534615526320343:10829]
2025-10-02T08:13:38.624967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1805, pipe: [1:7556534615526320343:10829]
2025-10-02T08:13:38.722929Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:38.723274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526320343:10829], now have 1 active actors on pipe
2025-10-02T08:13:38.723426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:38.723435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:38.723452Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:38.723463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1806 reason: error at write: Disconnected sessionId: src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0
2025-10-02T08:13:38.723754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:38.723765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0] Write session will restart in 0.008176s
2025-10-02T08:13:38.723790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0] Write session: Do CDS request
2025-10-02T08:13:38.723796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:38.723627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1806 sessionId: src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0 is DEAD
2025-10-02T08:13:38.723782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534615526320343:10829]
2025-10-02T08:13:38.723900Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:38.727065Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [d3f2c9bcc0d36bd8] Result# TEvPutResult {Id# [72075186224037892:1805:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:38.727068Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1805:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:38.727165Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1805:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:38.733243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.733295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:38.733310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1807
2025-10-02T08:13:38.733464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.733519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:38.733528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:38.733532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:38.733933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1807 sessionId:  describe result for acl check
2025-10-02T08:13:38.733963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:38.733968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:38.733970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:38.733976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534615526320622:10784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:38.734444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534615526320622:10784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:38.734498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:38.735073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:38.735227Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:38.735236Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:38.735245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:38.735288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:38.735321Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534615526320647:10786]
2025-10-02T08:13:38.735901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:38.736067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:38.736101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:38.736186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534615526320622:10784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:38.736397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:38.736444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.736449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.736451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.736453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.736454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.736459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.736468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.736477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.736481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.736485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.736491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.736497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.736502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.736507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.736512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.736517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.736526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.736531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.736539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.736544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.736566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:38.741689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534615526320622:10784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:38.741707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534615526320622:10784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:38.741710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534615526320622:10784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:38.741719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:38.744176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:38.745783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:38.745796Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:38.745799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:38.745802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:38.745809Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1806 [1:7556534615526320647:10786]
2025-10-02T08:13:38.745820Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:38.745833Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:38.745837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.745839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.745841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.745855Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:38.745859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:38.745865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:38.745918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.745926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.745928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:38.745931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:38.745990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:38.745996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.746010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.746042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:38.746065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534615986022219:2378], now have 1 active actors on pipe
2025-10-02T08:13:38.746072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526320679:10784], now have 1 active actors on pipe
2025-10-02T08:13:38.746071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1806
2025-10-02T08:13:38.746077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534615526320628:10786]
2025-10-02T08:13:38.746079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534615526320628:10786]
2025-10-02T08:13:38.746089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:38.746103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:38.746104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:38.746106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:38.746117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:38.746123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:38.746130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.746134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.746128Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1806
2025-10-02T08:13:38.746175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534615526320628:10786]
2025-10-02T08:13:38.746187Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:38.746197Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:38.746204Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22a31618-271e6f67-d720305-68848f15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:38.746211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.746215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.746216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:38.746226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.746239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:38.746271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.746305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.746311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.746322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.746354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1807 partition: 0 MaxSeqNo: 17 sessionId: src_id|22a31618-271e6f67-d720305-68848f15_0
2025-10-02T08:13:38.746666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db3e1fef-5b331eb6-2e52fd5a-66a838d9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|22a31618-271e6f67-d720305-68848f15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:38.749080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a31618-271e6f67-d720305-68848f15_0] Write session: try to update token
2025-10-02T08:13:38.749094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a31618-271e6f67-d720305-68848f15_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:38.761634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId: src_id|22a31618-271e6f67-d720305-68848f15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:38.762980Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:38.762995Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:38.762996Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:38.763002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534615526320628:10786]
2025-10-02T08:13:38.763005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534615526320628:10786]
2025-10-02T08:13:38.763037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:38.763045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.763046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:38.763047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:38.763051Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:38.763175Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:38.764372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:38.824006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534615526320695:10829]
2025-10-02T08:13:38.824119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1806, pipe: [1:7556534615526320695:10829]
2025-10-02T08:13:38.889427Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:38.889689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.889700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.889739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526320695:10829], now have 1 active actors on pipe
2025-10-02T08:13:38.889838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:38.889844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:38.889895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1807 reason: error at write: Disconnected sessionId: src_id|22a31618-271e6f67-d720305-68848f15_0
2025-10-02T08:13:38.889994Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:38.890009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:38.890048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1807 sessionId: src_id|22a31618-271e6f67-d720305-68848f15_0 is DEAD
2025-10-02T08:13:38.890199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534615526320695:10829]
2025-10-02T08:13:38.890213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a31618-271e6f67-d720305-68848f15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:38.890221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a31618-271e6f67-d720305-68848f15_0] Write session will restart in 0.005534s
2025-10-02T08:13:38.890244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a31618-271e6f67-d720305-68848f15_0] Write session: Do CDS request
2025-10-02T08:13:38.890250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a31618-271e6f67-d720305-68848f15_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:38.897242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a31618-271e6f67-d720305-68848f15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.897316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:38.897333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1808
2025-10-02T08:13:38.897445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:38.897473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:38.897481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:38.897485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:38.897846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1808 sessionId:  describe result for acl check
2025-10-02T08:13:38.897867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:38.897872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:38.897873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:38.897876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534615526320961:10777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:38.898310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534615526320961:10777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:38.898858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:38.899375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:38.899488Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:38.899495Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:38.899501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:38.899529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:38.899561Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534615526320997:10778]
2025-10-02T08:13:38.899995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:38.900080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534615526320961:10777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:38.900126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:38.900155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:38.900351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:38.900375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.900379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.900380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.900380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.900381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.900384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.900390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.900392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.900394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.900396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.900399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.900403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:38.900406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.900409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:38.900411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.900413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:38.900416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.900419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.900421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.900424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.900433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:38.905844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534615526320961:10777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:38.905859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534615526320961:10777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:38.905862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534615526320961:10777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:38.905918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:38.907856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:38.909448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:38.909466Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:38.909469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:38.909472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:38.909478Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1807 [1:7556534615526320997:10778]
2025-10-02T08:13:38.909488Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:38.909503Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:38.909506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.909509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.909512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.909527Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:38.909532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:38.909538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:38.909594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.909602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.909604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:38.909607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:38.909664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:38.909671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.909682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:38.909695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:38.909707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1807
2025-10-02T08:13:38.909714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534615526321025:10777], now have 1 active actors on pipe
2025-10-02T08:13:38.909721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534615526320980:10778]
2025-10-02T08:13:38.909722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534615526320980:10778]
2025-10-02T08:13:38.909730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:38.909738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534615986022226:2378], now have 1 active actors on pipe
2025-10-02T08:13:38.909743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:38.909745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:38.909746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.909750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.909765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:38.909783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:38.909789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:38.909795Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1807
2025-10-02T08:13:38.909828Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:38.909838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:38.909841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:38.909843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:38.909851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:38.909858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:38.909867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534615526320980:10778]
2025-10-02T08:13:38.909879Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:38.909886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:38.909909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.909986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.909993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.910004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:38.910044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1808 partition: 0 MaxSeqNo: 17 sessionId: src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0
2025-10-02T08:13:38.910373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a31618-271e6f67-d720305-68848f15_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:38.912787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0] Write session: try to update token
2025-10-02T08:13:38.912816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:38.926837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId: src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:38.929648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:38.929838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:38.929857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:38.929875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:38.929880Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:38.929882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:38.929888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534615526320980:10778]
2025-10-02T08:13:38.929893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534615526320980:10778]
2025-10-02T08:13:38.929934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:38.929935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:38.929942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:38.929944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:38.929946Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:38.930083Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:39.000645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534619821288348:10829]
2025-10-02T08:13:39.001200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1807, pipe: [1:7556534619821288348:10829]
2025-10-02T08:13:39.063949Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:39.064192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:39.064237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821288348:10829], now have 1 active actors on pipe
2025-10-02T08:13:39.064237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:39.064321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:39.064331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:39.064349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1808 reason: error at write: Disconnected sessionId: src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0
2025-10-02T08:13:39.064449Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:39.064483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1808 sessionId: src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0 is DEAD
2025-10-02T08:13:39.064615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:39.064626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0] Write session will restart in 0.007079s
2025-10-02T08:13:39.064653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0] Write session: Do CDS request
2025-10-02T08:13:39.064638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534619821288348:10829]
2025-10-02T08:13:39.064663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:39.073233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:39.073286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.073326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:39.073336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1809
2025-10-02T08:13:39.073486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.073515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:39.073524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:39.073527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:39.073542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:39.073699Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:39.073708Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:39.073716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:39.073749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:39.073822Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534619821288662:10746]
2025-10-02T08:13:39.073851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1809 sessionId:  describe result for acl check
2025-10-02T08:13:39.073883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:39.073886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:39.073888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:39.073891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534619821288665:10738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:39.074213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:39.074292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534619821288665:10738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:39.074359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:39.074400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:39.074670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:39.074707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.074712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.074713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.074714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.074714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.074719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.074727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.074730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.074733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.074735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.074739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.074745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.074749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.074753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.074756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.074760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.074762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.074766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.074770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.074773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.074790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:39.075890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534619821288665:10738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:39.081381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534619821288665:10738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:39.081396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534619821288665:10738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:39.081399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534619821288665:10738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:39.081407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:39.082372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:39.083871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:39.083886Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:39.083889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:39.083893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:39.083899Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1808 [1:7556534619821288662:10746]
2025-10-02T08:13:39.083911Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:39.083926Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:39.083929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.083931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.083933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.083949Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:39.083954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:39.083960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:39.084065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.084074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.084077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:39.084079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:39.084136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:39.084143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.084154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.084173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:39.084173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1808
2025-10-02T08:13:39.084193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821288705:10738], now have 1 active actors on pipe
2025-10-02T08:13:39.084210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534620280989542:2378], now have 1 active actors on pipe
2025-10-02T08:13:39.084214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.084222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.084237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534619821288654:10746]
2025-10-02T08:13:39.084243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534619821288654:10746]
2025-10-02T08:13:39.084250Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:39.084260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:39.084242Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1808
2025-10-02T08:13:39.084278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:39.084280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:39.084281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:39.084284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:39.084294Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:39.084300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.084308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.084310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:39.084318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.084325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:39.084359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534619821288654:10746]
2025-10-02T08:13:39.084372Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:39.084381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:39.084391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.084441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.084447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.084461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.084495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1809 partition: 0 MaxSeqNo: 17 sessionId: src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0
2025-10-02T08:13:39.084812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4db54657-dcf9f4c2-dcb6356e-41b8136e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:39.087364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0] Write session: try to update token
2025-10-02T08:13:39.087382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:39.094917Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:39.094938Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:39.094945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534619821288654:10746]
2025-10-02T08:13:39.094988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:39.094992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:39.095158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:39.095295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:39.095426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:39.095560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:39.095748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:39.095783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:39.099407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId: src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:39.101819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:39.101873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.101882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.101911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:39.101936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:39.101991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.102006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.102157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.102219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.102278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.102356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.102446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.102455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.102522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.102583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.102647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.102709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.102750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.102757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.102818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.102875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.102932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.103001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.103052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.103059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.103122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.103183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.103253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.103319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.103369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.103378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.103453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.103525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.103595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.103667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.103714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.103721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.103792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.103855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.103925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.103995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.104046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.104054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.104125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.104188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.104267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.104342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.104393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.104400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.104476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.104539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.104607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.104678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.104729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.104735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.104833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.104894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.104956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.105019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.105070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.105077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.105151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:39.105217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:39.105283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:39.105344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:39.105395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:39.105402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:39.105435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:39.105503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.105525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.105531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:39.105562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:39.105579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:39.105586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:39.105588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:39.105591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:39.105980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:39.106004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:39.106014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:39.106017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:39.106020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:39.106022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:39.106628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:39.106650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:39.106655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:39.106658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:39.106661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:39.106664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:39.107124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:39.107144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:39.107152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:39.107155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:39.107159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:39.109376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:39.109396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:39.109407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392819109
2025-10-02T08:13:39.109530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:39.109544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:39.109554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:39.109557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:39.109561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:39.109564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:39.110071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:39.110090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:39.110094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:39.110096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:39.110099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:39.110103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:39.110539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:39.110558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:39.110567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:39.110573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:39.110582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:39.110586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:39.111019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:39.111042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:39.111048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:39.112189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:39.112216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:39.112221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:39.112225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:39.112234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392819112
2025-10-02T08:13:39.112524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:39.112546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:39.112551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:39.112554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:39.112557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:39.112566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:39.113112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:39.113135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:39.113146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:39.113155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:39.113158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:39.113161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:39.113619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:39.113654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.113752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392819113
2025-10-02T08:13:39.114507Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:39.114537Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:39.114550Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:39.114562Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:39.116146Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:39.116157Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:39.116158Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:39.116169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534619821288654:10746]
2025-10-02T08:13:39.116172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534619821288654:10746]
2025-10-02T08:13:39.116230Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:39.116238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:39.116241Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:39.116242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.116244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:39.116383Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:39.165014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534619821288725:10829]
2025-10-02T08:13:39.165127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1808, pipe: [1:7556534619821288725:10829]
2025-10-02T08:13:39.251691Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:39.252109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821288725:10829], now have 1 active actors on pipe
2025-10-02T08:13:39.252232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:39.252248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:39.252280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1809 reason: error at write: Disconnected sessionId: src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0
2025-10-02T08:13:39.252328Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:39.252361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:39.252474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1809 sessionId: src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0 is DEAD
2025-10-02T08:13:39.252639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:39.252650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0] Write session will restart in 0.008009s
2025-10-02T08:13:39.252645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534619821288725:10829]
2025-10-02T08:13:39.252673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0] Write session: Do CDS request
2025-10-02T08:13:39.252680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:39.261492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:39.262070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:39.262228Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:39.262242Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:39.262259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.262252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:39.262294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:39.262330Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534619821289012:10723]
2025-10-02T08:13:39.262369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:39.262379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1810
2025-10-02T08:13:39.262467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.262487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:39.262494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:39.262497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:39.262819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1810 sessionId:  describe result for acl check
2025-10-02T08:13:39.262847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:39.262849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:39.262850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:39.262854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534619821289017:10720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:39.262961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:39.263139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:39.263185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:39.263272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534619821289017:10720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:39.263499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:39.263539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.263545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.263547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.263548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.263549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.263554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.263564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.263572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.263576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.263584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.263589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.263600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.263612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.263618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.263622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.263627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.263632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.263643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.263648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.263653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.263673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:39.265353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534619821289017:10720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:39.271169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534619821289017:10720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:39.271186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534619821289017:10720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:39.271188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534619821289017:10720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:39.271195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:39.271692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:39.273258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:39.273275Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:39.273277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:39.273279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:39.273284Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1809 [1:7556534619821289012:10723]
2025-10-02T08:13:39.273292Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:39.273308Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:39.273316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.273318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.273321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.273334Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:39.273340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:39.273347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:39.273393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.273397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.273399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:39.273401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:39.273453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:39.273458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.273466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.273472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:39.273491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534619821289006:10723]
2025-10-02T08:13:39.273492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534619821289006:10723]
2025-10-02T08:13:39.273497Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:39.273507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:39.273514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:39.273516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:39.273521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:39.273525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:39.273541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1809
2025-10-02T08:13:39.273545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534620280989559:2378], now have 1 active actors on pipe
2025-10-02T08:13:39.273547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821289059:10720], now have 1 active actors on pipe
2025-10-02T08:13:39.273548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534619821289006:10723]
2025-10-02T08:13:39.273550Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:39.273553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:39.273554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.273557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.273587Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:39.273599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.273602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.273604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:39.273612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.273623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:39.273614Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1809
2025-10-02T08:13:39.273642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.273684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.273690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.273702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.273735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1810 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0
2025-10-02T08:13:39.274036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94495ef9-7a3d8232-d5dfd776-abcf863b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:39.276489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0] Write session: try to update token
2025-10-02T08:13:39.276502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:39.289776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId: src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:39.292094Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:39.292114Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:39.292116Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:39.292122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534619821289006:10723]
2025-10-02T08:13:39.292125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534619821289006:10723]
2025-10-02T08:13:39.292161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:39.292163Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:39.292170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.292172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:39.292172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:39.292346Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:39.292433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:39.352917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534619821289075:10829]
2025-10-02T08:13:39.353037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1809, pipe: [1:7556534619821289075:10829]
2025-10-02T08:13:39.422586Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:39.422821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.422835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.422871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821289075:10829], now have 1 active actors on pipe
2025-10-02T08:13:39.422994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534619821289075:10829]
2025-10-02T08:13:39.423016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:39.423018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:39.423072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1810 reason: error at write: Disconnected sessionId: src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0
2025-10-02T08:13:39.423092Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:39.423106Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:39.423264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1810 sessionId: src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0 is DEAD
2025-10-02T08:13:39.423603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:39.423612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0] Write session will restart in 0.007609s
2025-10-02T08:13:39.423631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0] Write session: Do CDS request
2025-10-02T08:13:39.423636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:39.432264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.432304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:39.432321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1811
2025-10-02T08:13:39.432488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.432524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:39.432533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:39.432536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:39.432883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:39.432951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1811 sessionId:  describe result for acl check
2025-10-02T08:13:39.432990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:39.432997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:39.432998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:39.433004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534619821289363:10703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:39.433495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534619821289363:10703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:39.433774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:39.433934Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:39.433944Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:39.433953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:39.433997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:39.434031Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534619821289371:10705]
2025-10-02T08:13:39.434636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:39.434781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:39.434819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:39.435102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:39.435147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.435153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.435154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.435155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.435157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.435161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.435170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.435178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.435184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.435194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.435204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.435211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.435215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.435220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.435228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.435233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.435241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.435246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.435254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.435258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.435281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:39.435700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534619821289363:10703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:39.441295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534619821289363:10703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:39.441317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534619821289363:10703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:39.441321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534619821289363:10703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:39.441330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:39.445893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:39.447634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:39.447651Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:39.447653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:39.447657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:39.447665Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1810 [1:7556534619821289371:10705]
2025-10-02T08:13:39.447675Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:39.447690Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:39.447693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.447696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.447698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.447714Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:39.447724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:39.447730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:39.447787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.447794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.447797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:39.447800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:39.447859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:39.447867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.447879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.447893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:39.447913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1810
2025-10-02T08:13:39.447917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821289412:10703], now have 1 active actors on pipe
2025-10-02T08:13:39.447924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534619821289359:10705]
2025-10-02T08:13:39.447926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534619821289359:10705]
2025-10-02T08:13:39.447934Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:39.447942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534620280989565:2378], now have 1 active actors on pipe
2025-10-02T08:13:39.447944Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:39.447947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:39.447954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.447959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.447974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:39.447991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:39.447993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:39.448011Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1810
2025-10-02T08:13:39.448033Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1e10366-172be720-14f238d7-56967720_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:39.448043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.448047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.448049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:39.448055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.448064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:39.448071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534619821289359:10705]
2025-10-02T08:13:39.448090Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:39.448100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:39.448114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.448135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.448136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.448149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.448188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1811 partition: 0 MaxSeqNo: 17 sessionId: src_id|f1e10366-172be720-14f238d7-56967720_0
2025-10-02T08:13:39.448485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b65e3cf-f4567288-e2365048-f9c1b85d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f1e10366-172be720-14f238d7-56967720_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:39.451033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e10366-172be720-14f238d7-56967720_0] Write session: try to update token
2025-10-02T08:13:39.451046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e10366-172be720-14f238d7-56967720_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:39.464367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId: src_id|f1e10366-172be720-14f238d7-56967720_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:39.465961Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:39.465978Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:39.465979Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:39.465985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534619821289359:10705]
2025-10-02T08:13:39.465989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534619821289359:10705]
2025-10-02T08:13:39.466022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:39.466030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.466030Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:39.466032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:39.466035Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:39.466171Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:39.466916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:39.523390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534619821289430:10829]
2025-10-02T08:13:39.523485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1810, pipe: [1:7556534619821289430:10829]
2025-10-02T08:13:39.594782Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:39.595084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.595102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.595159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821289430:10829], now have 1 active actors on pipe
2025-10-02T08:13:39.595340Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:39.595374Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:39.595517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:39.595582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1811 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1e10366-172be720-14f238d7-56967720_0
2025-10-02T08:13:39.595609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534619821289430:10829]
2025-10-02T08:13:39.595727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1811 sessionId: src_id|f1e10366-172be720-14f238d7-56967720_0 is DEAD
2025-10-02T08:13:39.595860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e10366-172be720-14f238d7-56967720_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:39.595868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e10366-172be720-14f238d7-56967720_0] Write session will restart in 0.005263s
2025-10-02T08:13:39.595889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e10366-172be720-14f238d7-56967720_0] Write session: Do CDS request
2025-10-02T08:13:39.595894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e10366-172be720-14f238d7-56967720_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:39.602236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e10366-172be720-14f238d7-56967720_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.602440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:39.602452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1812
2025-10-02T08:13:39.602532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.602558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:39.602567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:39.602570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:39.602857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1812 sessionId:  describe result for acl check
2025-10-02T08:13:39.602878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:39.602884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:39.602885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:39.602890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534619821289725:10694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:39.603247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:39.603304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534619821289725:10694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:39.603936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:39.604081Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:39.604092Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:39.604101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:39.604151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:39.604185Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534619821289748:10697]
2025-10-02T08:13:39.604788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:39.604945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:39.604989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:39.605021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534619821289725:10694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:39.605276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:39.605329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.605336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.605337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.605338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.605339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.605344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.605353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.605357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.605361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.605364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.605373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.605380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.605390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.605395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.605399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.605404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.605411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.605416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.605425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.605429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.605448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:39.610923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534619821289725:10694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:39.610939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534619821289725:10694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:39.610944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534619821289725:10694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:39.610952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:39.612771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:39.614157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:39.614171Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:39.614174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:39.614177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:39.614182Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1811 [1:7556534619821289748:10697]
2025-10-02T08:13:39.614193Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:39.614207Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:39.614210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.614212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.614215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.614228Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:39.614233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:39.614238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:39.614285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.614292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.614295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:39.614297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:39.614352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:39.614358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.614369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.614381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:39.614394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1811
2025-10-02T08:13:39.614401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821289783:10694], now have 1 active actors on pipe
2025-10-02T08:13:39.614404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534620280989584:2378], now have 1 active actors on pipe
2025-10-02T08:13:39.614409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534619821289728:10697]
2025-10-02T08:13:39.614411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534619821289728:10697]
2025-10-02T08:13:39.614422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:39.614434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.614438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:39.614441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:39.614443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.614459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:39.614475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:39.614481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:39.614463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1811
2025-10-02T08:13:39.614512Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4003853-107df-40d4218e-b604b990_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:39.614521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.614525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.614526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:39.614534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.614541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:39.614556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534619821289728:10697]
2025-10-02T08:13:39.614566Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:39.614577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:39.614586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.614621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.614627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.614638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.614670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1812 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4003853-107df-40d4218e-b604b990_0
2025-10-02T08:13:39.614928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1e10366-172be720-14f238d7-56967720_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4003853-107df-40d4218e-b604b990_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:39.617417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4003853-107df-40d4218e-b604b990_0] Write session: try to update token
2025-10-02T08:13:39.617430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4003853-107df-40d4218e-b604b990_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:39.630711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId: src_id|b4003853-107df-40d4218e-b604b990_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:39.633085Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:39.633106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:39.633109Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:39.633117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534619821289728:10697]
2025-10-02T08:13:39.633121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534619821289728:10697]
2025-10-02T08:13:39.633165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:39.633173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:39.633175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.633177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:39.633179Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:39.633309Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:39.633394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:39.695964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534619821289801:10829]
2025-10-02T08:13:39.696105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1811, pipe: [1:7556534619821289801:10829]
2025-10-02T08:13:39.764417Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:39.764782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.764794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.764840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821289801:10829], now have 1 active actors on pipe
2025-10-02T08:13:39.764965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534619821289801:10829]
2025-10-02T08:13:39.765008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:39.765014Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:39.765014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:39.765076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1812 reason: error at write: Disconnected sessionId: src_id|b4003853-107df-40d4218e-b604b990_0
2025-10-02T08:13:39.765115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:39.765263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1812 sessionId: src_id|b4003853-107df-40d4218e-b604b990_0 is DEAD
2025-10-02T08:13:39.765391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4003853-107df-40d4218e-b604b990_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:39.765401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4003853-107df-40d4218e-b604b990_0] Write session will restart in 0.005979s
2025-10-02T08:13:39.765426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4003853-107df-40d4218e-b604b990_0] Write session: Do CDS request
2025-10-02T08:13:39.765432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4003853-107df-40d4218e-b604b990_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:39.772228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4003853-107df-40d4218e-b604b990_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.772262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:39.772276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1813
2025-10-02T08:13:39.772402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.772433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:39.772446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:39.772449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:39.772797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1813 sessionId:  describe result for acl check
2025-10-02T08:13:39.772842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:39.772847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:39.772848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:39.772852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534619821290041:10686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:39.773290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534619821290041:10686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:39.775108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534619821290041:10686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:39.775257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:39.775837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:39.775995Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:39.776007Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:39.776015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:39.776054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:39.776084Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534619821290124:10683]
2025-10-02T08:13:39.776666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:39.776901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:39.776963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:39.777293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:39.777353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.777360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.777361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.777361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.777362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.777367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.777377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.777380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.777384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.777387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.777392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.777398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:39.777403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.777407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:39.777411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.777415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:39.777419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.777423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.777428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.777432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.777449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:39.777599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534619821290041:10686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:39.777611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534619821290041:10686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:39.777614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534619821290041:10686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:39.777621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:39.785481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:39.787212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:39.787236Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:39.787238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:39.787242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:39.787249Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1812 [1:7556534619821290124:10683]
2025-10-02T08:13:39.787261Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:39.787279Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:39.787287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.787290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.787293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.787307Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:39.787312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:39.787324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:39.787393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.787400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.787403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:39.787406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:39.787468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:39.787478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.787491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:39.787502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:39.787510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1812
2025-10-02T08:13:39.787521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821290142:10686], now have 1 active actors on pipe
2025-10-02T08:13:39.787527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534619821290109:10683]
2025-10-02T08:13:39.787529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534619821290109:10683]
2025-10-02T08:13:39.787536Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:39.787545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534620280989592:2378], now have 1 active actors on pipe
2025-10-02T08:13:39.787547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:39.787549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.787550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:39.787553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.787570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:39.787584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:39.787587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:39.787629Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:39.787642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:39.787650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:39.787652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:39.787661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:39.787669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:39.787635Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1812
2025-10-02T08:13:39.787676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534619821290109:10683]
2025-10-02T08:13:39.787688Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:39.787700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:39.787723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.787754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.787763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.787776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:39.787808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1813 partition: 0 MaxSeqNo: 17 sessionId: src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0
2025-10-02T08:13:39.788123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4003853-107df-40d4218e-b604b990_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:39.790760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0] Write session: try to update token
2025-10-02T08:13:39.790775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:39.803997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId: src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:39.804912Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:39.804929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:39.804931Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:39.804940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534619821290109:10683]
2025-10-02T08:13:39.804944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534619821290109:10683]
2025-10-02T08:13:39.804981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:39.804987Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:39.804993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:39.804999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:39.805001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:39.805138Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:39.806590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:39.864879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534619821290158:10829]
2025-10-02T08:13:39.865014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1812, pipe: [1:7556534619821290158:10829]
2025-10-02T08:13:39.940469Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:39.940689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:39.940700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:39.940730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534619821290158:10829], now have 1 active actors on pipe
2025-10-02T08:13:39.940838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534619821290158:10829]
2025-10-02T08:13:39.940867Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:39.940885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:39.940951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1813 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0
2025-10-02T08:13:39.941095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1813 sessionId: src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0 is DEAD
2025-10-02T08:13:39.941229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:39.941235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0] Write session will restart in 0.008162s
2025-10-02T08:13:39.941218Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:39.941257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0] Write session: Do CDS request
2025-10-02T08:13:39.941263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:39.950320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.950364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:39.950381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1814
2025-10-02T08:13:39.950563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:39.950597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:39.950608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:39.950614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:39.966988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1814 sessionId:  describe result for acl check
2025-10-02T08:13:39.967030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:39.967032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:39.967034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:39.967039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534619821290204:10672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:39.967542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534619821290204:10672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:39.997317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534619821290204:10672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:40.008029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534619821290204:10672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:40.008055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534619821290204:10672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:40.008057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534619821290204:10672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:40.008065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:40.011651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:40.012278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:40.012430Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:40.012442Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:40.012452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:40.012496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:40.012552Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534624116257820:10671]
2025-10-02T08:13:40.012967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:40.013130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:40.013162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:40.013349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:40.013376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.013381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.013381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.013382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.013383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.013386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.013393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.013395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.013397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.013399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.013402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.013406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.013410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.013412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.013415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.013417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.013419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.013422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.013424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.013427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.013436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:40.025005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:40.026974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:40.026994Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:40.026996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:40.026999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:40.027004Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1813 [1:7556534624116257820:10671]
2025-10-02T08:13:40.027014Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:40.027031Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:40.027039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.027043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.027044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.027056Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:40.027064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:40.027068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:40.027111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.027117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.027119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:40.027120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:40.027179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:40.027188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.027201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.027212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:40.027229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116257698:10672], now have 1 active actors on pipe
2025-10-02T08:13:40.027236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534620280989600:2378], now have 1 active actors on pipe
2025-10-02T08:13:40.027242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534624116257814:10671]
2025-10-02T08:13:40.027244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534624116257814:10671]
2025-10-02T08:13:40.027253Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:40.027272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:40.027272Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:40.027274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:40.027288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:40.027290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:40.027320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534624116257814:10671]
2025-10-02T08:13:40.027331Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:40.027343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:40.027339Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1813
2025-10-02T08:13:40.027388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1813
2025-10-02T08:13:40.027418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.027425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.027447Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:40.027457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.027460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.027466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:40.027475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.027484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:40.027501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.027525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.027531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.027544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.027574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1814 partition: 0 MaxSeqNo: 17 sessionId: src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0
2025-10-02T08:13:40.027910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1d1f3d-d4752fe4-92e9a3fc-5149fbf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:40.030365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0] Write session: try to update token
2025-10-02T08:13:40.030380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:40.041388Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:40.041410Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:40.041418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534624116257814:10671]
2025-10-02T08:13:40.041458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:40.041461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:40.041638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:40.041793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:40.041947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:40.042097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:40.042299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:40.042340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:40.042480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534624116257844:10829]
2025-10-02T08:13:40.042586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1813, pipe: [1:7556534624116257844:10829]
2025-10-02T08:13:40.042599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116257844:10829], now have 1 active actors on pipe
2025-10-02T08:13:40.045493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId: src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:40.047954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:40.048035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.048053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.048082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:40.048108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:40.048165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.048178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.048365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.048425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.048483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.048559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.048627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.048633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.048695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.048749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.048824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.048883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.048924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.048931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.048993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.049050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.049105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.049156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.049198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.049203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.049258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.049322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.049384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.049445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.049495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.049500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.049574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.049634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.049695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.049757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.049806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.049814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.049880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.049936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.050002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.050069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.050117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.050122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.050187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.050243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.050318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.050382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.050427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.050433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.050499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.050557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.050623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.050684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.050828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.050835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.050900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.050949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.050999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.051055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.051105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.051111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.051175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.051230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.051284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.051343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.051387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.051392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.051419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:40.051469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.051484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.051489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:40.051511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:40.051524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:40.051529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:40.051532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:40.051535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:40.051912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:40.051936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:40.051944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:40.051949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:40.051950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:40.051952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:40.052400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:40.052420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:40.052424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:40.052426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:40.052428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:40.052430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:40.052862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:40.052878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:40.052882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:40.052884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:40.052885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:40.053947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:40.053961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:40.053968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392820053
2025-10-02T08:13:40.054068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:40.054077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:40.054082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:40.054084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:40.054086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:40.054090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:40.054524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:40.054544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:40.054548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:40.054552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:40.054553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:40.054556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:40.054947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:40.054963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:40.054969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:40.054971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:40.054974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:40.054975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:40.055385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:40.055403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:40.055408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:40.056402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:40.056414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:40.056418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:40.056422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:40.056427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392820056
2025-10-02T08:13:40.056688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:40.056710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:40.056715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:40.056721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:40.056723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:40.056726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:40.057147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:40.057165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:40.057170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:40.057172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:40.057174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:40.057176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:40.057597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:40.057615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.057686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392820057
2025-10-02T08:13:40.058376Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:40.058398Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:40.058405Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:40.058409Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:40.059919Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:40.059931Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:40.059932Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:40.059939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534624116257814:10671]
2025-10-02T08:13:40.059942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534624116257814:10671]
2025-10-02T08:13:40.059988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:40.059990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:40.059995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.059995Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:40.059996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:40.060121Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:40.187852Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:40.188355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534624116257844:10829]
2025-10-02T08:13:40.188375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:40.188377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:40.188398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1814 reason: error at write: Disconnected sessionId: src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0
2025-10-02T08:13:40.188467Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:40.188473Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:40.188547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1814 sessionId: src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0 is DEAD
2025-10-02T08:13:40.188902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:40.188912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0] Write session will restart in 0.007599s
2025-10-02T08:13:40.188934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0] Write session: Do CDS request
2025-10-02T08:13:40.188941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:40.197223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.197227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:40.197241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1815
2025-10-02T08:13:40.197417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.197456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:40.197465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:40.197469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:40.197866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1815 sessionId:  describe result for acl check
2025-10-02T08:13:40.197900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:40.197906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:40.197908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:40.197911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534624116258157:10600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:40.198427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534624116258157:10600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:40.198839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:40.200192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:40.200568Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:40.200578Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:40.200591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:40.200650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:40.200690Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534624116258190:10603]
2025-10-02T08:13:40.201203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:40.201434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534624116258157:10600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:40.201480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:40.201524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:40.201775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:40.201816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.201817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.201818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.201819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.201820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.201824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.201833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.201837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.201840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.201844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.201848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.201855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.201861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.201866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.201870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.201874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.201878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.201883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.201888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.201893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.201911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:40.208147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534624116258157:10600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:40.208163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534624116258157:10600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:40.208166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534624116258157:10600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:40.208175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:40.210557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:40.213131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:40.213157Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:40.213161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:40.213167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:40.213178Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1814 [1:7556534624116258190:10603]
2025-10-02T08:13:40.213196Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:40.213220Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:40.213234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.213239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.213243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.213264Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:40.213272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:40.213281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:40.213377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.213399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.213404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:40.213408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:40.213514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:40.213531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.213547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.213560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:40.213572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1814
2025-10-02T08:13:40.213656Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1814
2025-10-02T08:13:40.213584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116258218:10600], now have 1 active actors on pipe
2025-10-02T08:13:40.213593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534624575956926:2378], now have 1 active actors on pipe
2025-10-02T08:13:40.213599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.213605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.213626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534624116258174:10603]
2025-10-02T08:13:40.213628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534624116258174:10603]
2025-10-02T08:13:40.213643Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:40.213659Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:40.213660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:40.213663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:40.213675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:40.213679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:40.213699Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:40.213707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.213713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.213716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:40.213728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.213740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:40.213786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534624116258174:10603]
2025-10-02T08:13:40.213801Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:40.213809Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:40.213827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.213917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.213925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.213947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.213994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1815 partition: 0 MaxSeqNo: 17 sessionId: src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0
2025-10-02T08:13:40.214429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cb04fcb-8d5e2b45-bc671743-e1b4729a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:40.217727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0] Write session: try to update token
2025-10-02T08:13:40.217748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:40.225598Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:40.225625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:40.225638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534624116258174:10603]
2025-10-02T08:13:40.225693Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:40.225696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:40.225899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:40.226064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:40.226221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:40.226383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:40.226604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:40.226660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:40.235667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId: src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:40.238430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:40.238543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.238556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.238592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:40.238617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:40.238680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.238713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.238894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.238969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.239032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.239101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.239393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.239406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.239478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.239539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.239600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.239668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.239711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.239724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.239788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.239858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.239932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.240010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.240063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.240072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.240150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.240236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.240309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.240380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.240434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.240442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.240519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.240589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.240661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.240734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.240793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.240816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.240895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.240963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.241037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.241111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.241165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.241176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.241254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.241323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.241399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.241471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.241535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.241543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.241626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.241691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.241758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.241825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.241875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.241885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.241967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.242039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.242103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.242170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.242222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.242229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.242311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:40.242378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:40.242447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:40.242516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:40.242565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:40.242573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:40.242644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:40.242710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.242734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.242741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:40.242772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:40.242792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:40.242800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:40.242803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:40.242806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:40.243227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:40.243256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:40.243268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:40.243276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:40.243284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:40.243287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:40.243798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:40.243832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:40.243838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:40.243841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:40.243845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:40.243855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:40.244473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:40.244500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:40.244507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:40.244510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:40.244515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:40.246835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:40.246857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:40.246869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392820246
2025-10-02T08:13:40.246985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:40.246999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:40.247009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:40.247012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:40.247019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:40.247027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:40.247504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:40.247531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:40.247537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:40.247541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:40.247544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:40.247548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:40.248053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:40.248076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:40.248084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:40.248087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:40.248091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:40.248094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:40.248589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:40.248617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:40.248627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:40.249841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:40.249863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:40.249869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:40.249877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:40.249886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392820249
2025-10-02T08:13:40.250198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:40.250225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:40.250235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:40.250242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:40.250251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:40.250254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:40.250753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:40.250778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:40.250789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:40.250793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:40.250801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:40.250805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:40.251317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:40.251341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.251449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392820251
2025-10-02T08:13:40.257162Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:40.257194Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:40.257201Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:40.257208Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:40.257221Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:40.257224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:40.257226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:40.257234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534624116258174:10603]
2025-10-02T08:13:40.257239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534624116258174:10603]
2025-10-02T08:13:40.257325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:40.257338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.257339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:40.257403Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:40.257416Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:40.257488Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:40.288319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534624116258233:10829]
2025-10-02T08:13:40.288527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1814, pipe: [1:7556534624116258233:10829]
2025-10-02T08:13:40.388293Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:40.388745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116258233:10829], now have 1 active actors on pipe
2025-10-02T08:13:40.388924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534624116258233:10829]
2025-10-02T08:13:40.388944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:40.388950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:40.388975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1815 reason: error at write: Disconnected sessionId: src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0
2025-10-02T08:13:40.389081Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:40.389014Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:40.389132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1815 sessionId: src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0 is DEAD
2025-10-02T08:13:40.389266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:40.389276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0] Write session will restart in 0.005524s
2025-10-02T08:13:40.389300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0] Write session: Do CDS request
2025-10-02T08:13:40.389306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:40.393409Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [bb80e4d72ca0d415] Result# TEvPutResult {Id# [72075186224037892:1814:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:40.393451Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1814:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:40.393495Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1814:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:40.396264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.396450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:40.396465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1816
2025-10-02T08:13:40.396597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.396648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:40.396658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:40.396661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:40.397111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1816 sessionId:  describe result for acl check
2025-10-02T08:13:40.397140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:40.397146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:40.397147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:40.397151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534624116258429:10588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:40.397650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534624116258429:10588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:40.400818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534624116258429:10588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:40.401053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:40.401798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:40.401989Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:40.401999Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:40.402007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:40.402051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:40.402086Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534624116258568:10589]
2025-10-02T08:13:40.402668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:40.402877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:40.402944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:40.403255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:40.403301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.403307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.403308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.403309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.403319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.403324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.403334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.403338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.403341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.403344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.403350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.403357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.403362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.403367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.403371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.403376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.403380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.403384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.403388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.403394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.403413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:40.403447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534624116258429:10588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:40.403460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534624116258429:10588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:40.403464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534624116258429:10588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:40.403472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:40.411234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:40.412692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:40.412708Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:40.412710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:40.412713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:40.412717Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1815 [1:7556534624116258568:10589]
2025-10-02T08:13:40.412725Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:40.412739Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:40.412741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.412743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.412745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.412756Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:40.412759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:40.412764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:40.412837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.412843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.412845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:40.412847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:40.412966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1815
2025-10-02T08:13:40.413078Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1815
2025-10-02T08:13:40.413172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:40.413181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.413189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.413196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:40.413217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116258583:10588], now have 1 active actors on pipe
2025-10-02T08:13:40.413225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534624575956933:2378], now have 1 active actors on pipe
2025-10-02T08:13:40.413230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.413235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.413258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534624116258552:10589]
2025-10-02T08:13:40.413263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534624116258552:10589]
2025-10-02T08:13:40.413272Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:40.413285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:40.413295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:40.413297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:40.413299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:40.413304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:40.413311Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:40.413315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.413318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.413319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:40.413327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.413334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:40.413365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534624116258552:10589]
2025-10-02T08:13:40.413373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:40.413382Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:40.413384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.413433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.413440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.413449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.413479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1816 partition: 0 MaxSeqNo: 17 sessionId: src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0
2025-10-02T08:13:40.413761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58fb531-8422a5b5-a5e258b4-d709d6ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:40.416692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0] Write session: try to update token
2025-10-02T08:13:40.416711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:40.430835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId: src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:40.430837Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:40.430841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:40.430843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:40.430851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534624116258552:10589]
2025-10-02T08:13:40.430855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534624116258552:10589]
2025-10-02T08:13:40.430896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:40.430901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.430903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:40.430965Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:40.430980Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:40.431034Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:40.433689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:40.489031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534624116258598:10829]
2025-10-02T08:13:40.489150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1815, pipe: [1:7556534624116258598:10829]
2025-10-02T08:13:40.558775Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:40.559064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.559074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.559105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116258598:10829], now have 1 active actors on pipe
2025-10-02T08:13:40.559212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:40.559227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:40.559289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1816 reason: error at write: Disconnected sessionId: src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0
2025-10-02T08:13:40.559350Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:40.559435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1816 sessionId: src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0 is DEAD
2025-10-02T08:13:40.559536Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:40.559571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:40.559582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0] Write session will restart in 0.008396s
2025-10-02T08:13:40.559580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534624116258598:10829]
2025-10-02T08:13:40.559606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0] Write session: Do CDS request
2025-10-02T08:13:40.559612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:40.567249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:40.567836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:40.567955Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:40.567963Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:40.567970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:40.567997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:40.568023Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534624116258910:10573]
2025-10-02T08:13:40.568529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:40.568736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:40.568777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:40.569009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:40.569040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.569044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.569045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.569046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.569046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.569049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.569056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.569058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.569060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.569062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.569066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.569070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.569074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.569076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.569079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.569082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.569084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.569087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.569089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.569092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.569101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:40.569216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.569288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:40.569294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1817
2025-10-02T08:13:40.569402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.569429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:40.569437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:40.569440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:40.569768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1817 sessionId:  describe result for acl check
2025-10-02T08:13:40.569800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:40.569806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:40.569807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:40.569811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534624116258926:10564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:40.570299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534624116258926:10564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:40.572621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534624116258926:10564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:40.576150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534624116258926:10564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:40.576163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534624116258926:10564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:40.576166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534624116258926:10564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:40.576172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:40.576719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:40.578226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:40.578248Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:40.578251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:40.578254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:40.578260Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1816 [1:7556534624116258910:10573]
2025-10-02T08:13:40.578275Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:40.578294Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:40.578300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.578303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.578305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.578319Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:40.578328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:40.578338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:40.578399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.578407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.578410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:40.578413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:40.578473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:40.578480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.578493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.578508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:40.578529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534624116258904:10573]
2025-10-02T08:13:40.578535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534624116258904:10573]
2025-10-02T08:13:40.578536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1816
2025-10-02T08:13:40.578542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:40.578556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116258958:10564], now have 1 active actors on pipe
2025-10-02T08:13:40.578560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534624575956952:2378], now have 1 active actors on pipe
2025-10-02T08:13:40.578559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:40.578562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:40.578566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:40.578579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:40.578587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:40.578593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.578603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.578638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534624116258904:10573]
2025-10-02T08:13:40.578646Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:40.578656Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:40.578658Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:40.578664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.578667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.578669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:40.578679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.578687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:40.578649Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1816
2025-10-02T08:13:40.578731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.578803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.578810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.578823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.578859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1817 partition: 0 MaxSeqNo: 17 sessionId: src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0
2025-10-02T08:13:40.579186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f137fe3e-f3d5c134-6335b032-33bd5458_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:40.581535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0] Write session: try to update token
2025-10-02T08:13:40.581547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:40.593658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId: src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:40.595205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:40.595222Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:40.595225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:40.595233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534624116258904:10573]
2025-10-02T08:13:40.595237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534624116258904:10573]
2025-10-02T08:13:40.595278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:40.595281Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:40.595286Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:40.595289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.595292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:40.595436Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:40.596095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:40.659519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534624116258975:10829]
2025-10-02T08:13:40.659638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1816, pipe: [1:7556534624116258975:10829]
2025-10-02T08:13:40.728941Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:40.729207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.729218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.729253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116258975:10829], now have 1 active actors on pipe
2025-10-02T08:13:40.729365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:40.729380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:40.729429Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:40.729445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1817 reason: error at write: Disconnected sessionId: src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0
2025-10-02T08:13:40.729571Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:40.729637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1817 sessionId: src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0 is DEAD
2025-10-02T08:13:40.729675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534624116258975:10829]
2025-10-02T08:13:40.729784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:40.729789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0] Write session will restart in 0.009450s
2025-10-02T08:13:40.729809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0] Write session: Do CDS request
2025-10-02T08:13:40.729815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:40.739474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:40.740256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.740275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:40.740310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:40.740325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1818
2025-10-02T08:13:40.740462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.740489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:40.740497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:40.740501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:40.740614Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:40.740627Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:40.740639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:40.740704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:40.740742Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534624116259279:10548]
2025-10-02T08:13:40.740868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1818 sessionId:  describe result for acl check
2025-10-02T08:13:40.740897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:40.740902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:40.740906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:40.740911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534624116259283:10527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:40.741384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:40.741417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534624116259283:10527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:40.741590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:40.741641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:40.741941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:40.741999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.742007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.742008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.742009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.742010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.742015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.742025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.742029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.742033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.742037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.742042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.742055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.742065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.742071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.742080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.742085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.742089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.742094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.742104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.742109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.742127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:40.743411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534624116259283:10527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:40.748841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534624116259283:10527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:40.748861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534624116259283:10527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:40.748865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534624116259283:10527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:40.748873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:40.749944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:40.751765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:40.751783Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:40.751787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:40.751791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:40.751796Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1817 [1:7556534624116259279:10548]
2025-10-02T08:13:40.751808Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:40.751822Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:40.751825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.751827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.751829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.751843Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:40.751848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:40.751853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:40.751905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.751913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.751916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:40.751918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:40.751972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:40.751979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.751989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.751999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:40.752002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1817
2025-10-02T08:13:40.752018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116259326:10527], now have 1 active actors on pipe
2025-10-02T08:13:40.752028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534624116259272:10548]
2025-10-02T08:13:40.752030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534624116259272:10548]
2025-10-02T08:13:40.752040Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:40.752050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534624575956961:2378], now have 1 active actors on pipe
2025-10-02T08:13:40.752050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:40.752053Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:40.752054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.752059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.752075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:40.752090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:40.752096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:40.752133Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:40.752143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.752146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.752147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:40.752154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.752161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:40.752171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534624116259272:10548]
2025-10-02T08:13:40.752129Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1817
2025-10-02T08:13:40.752178Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:40.752195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:40.752226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.752294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.752304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.752323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.752354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1818 partition: 0 MaxSeqNo: 17 sessionId: src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0
2025-10-02T08:13:40.752634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3682679-3aca44c7-e6bd0440-2cd9b594_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:40.755206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0] Write session: try to update token
2025-10-02T08:13:40.755221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:40.768910Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:40.768928Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:40.768932Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:40.768940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534624116259272:10548]
2025-10-02T08:13:40.768944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534624116259272:10548]
2025-10-02T08:13:40.768979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:40.768982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:40.768984Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:40.768988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.768990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:40.769009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId: src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:40.769124Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:40.771527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:40.830023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534624116259342:10829]
2025-10-02T08:13:40.830146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1817, pipe: [1:7556534624116259342:10829]
2025-10-02T08:13:40.903399Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:40.903770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.903788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.903831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116259342:10829], now have 1 active actors on pipe
2025-10-02T08:13:40.903939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534624116259342:10829]
2025-10-02T08:13:40.903960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:40.903966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:40.904103Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:40.904020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1818 reason: error at write: Disconnected sessionId: src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0
2025-10-02T08:13:40.904070Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:40.904188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1818 sessionId: src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0 is DEAD
2025-10-02T08:13:40.904524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:40.904532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0] Write session will restart in 0.009285s
2025-10-02T08:13:40.904560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0] Write session: Do CDS request
2025-10-02T08:13:40.904567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:40.915261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.915340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:40.915360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1819
2025-10-02T08:13:40.915481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:40.915511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:40.915516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:40.915527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:40.915724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:40.915899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1819 sessionId:  describe result for acl check
2025-10-02T08:13:40.915932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:40.915938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:40.915939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:40.915944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534624116259647:10492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:40.916494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534624116259647:10492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:40.916640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:40.916842Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:40.916853Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:40.916863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:40.916926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:40.916966Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534624116259655:10491]
2025-10-02T08:13:40.917554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:40.917726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:40.917775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:40.918096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:40.918153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.918159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.918161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.918162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.918163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.918168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.918178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.918182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.918185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.918189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.918194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.918200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:40.918210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.918215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:40.918219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.918224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:40.918229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.918234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.918239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.918244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.918265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:40.918374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534624116259647:10492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:40.924174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534624116259647:10492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:40.924193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534624116259647:10492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:40.924206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534624116259647:10492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:40.924215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:40.926367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:40.928181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:40.928215Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:40.928218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:40.928221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:40.928228Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1818 [1:7556534624116259655:10491]
2025-10-02T08:13:40.928240Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:40.928257Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:40.928265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.928269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.928272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.928289Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:40.928300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:40.928306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:40.928371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.928379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.928381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:40.928384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:40.928450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:40.928458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.928472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:40.928492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:40.928506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1818
2025-10-02T08:13:40.928516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534624116259695:10492], now have 1 active actors on pipe
2025-10-02T08:13:40.928521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534624116259642:10491]
2025-10-02T08:13:40.928523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534624116259642:10491]
2025-10-02T08:13:40.928534Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:40.928549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:40.928550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534624575956967:2378], now have 1 active actors on pipe
2025-10-02T08:13:40.928555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.928559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:40.928561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.928578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:40.928596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:40.928602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:40.928592Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1818
2025-10-02T08:13:40.928653Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b40b61ca-77069482-c2a9007c-f9607f81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:40.928663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:40.928670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:40.928672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:40.928680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:40.928690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:40.928701Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534624116259642:10491]
2025-10-02T08:13:40.928712Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:40.928734Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:40.928746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.928843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:40.928850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:40.928864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:40.928902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1819 partition: 0 MaxSeqNo: 17 sessionId: src_id|b40b61ca-77069482-c2a9007c-f9607f81_0
2025-10-02T08:13:40.929225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d60a6a-72aa339a-ebbda3ef-236105c2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b40b61ca-77069482-c2a9007c-f9607f81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:40.931691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b61ca-77069482-c2a9007c-f9607f81_0] Write session: try to update token
2025-10-02T08:13:40.931703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b61ca-77069482-c2a9007c-f9607f81_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:40.945236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId: src_id|b40b61ca-77069482-c2a9007c-f9607f81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:40.946273Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:40.946293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:40.946295Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:40.946303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534624116259642:10491]
2025-10-02T08:13:40.946307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534624116259642:10491]
2025-10-02T08:13:40.946347Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:40.946350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:40.946357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:40.946359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:40.946361Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:40.946495Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:40.947917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:41.004111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534628411227008:10829]
2025-10-02T08:13:41.004185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1818, pipe: [1:7556534628411227008:10829]
2025-10-02T08:13:41.094856Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:41.095168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.095186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.095223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411227008:10829], now have 1 active actors on pipe
2025-10-02T08:13:41.095339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534628411227008:10829]
2025-10-02T08:13:41.095365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:41.095367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:41.095419Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:41.095426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1819 reason: error at write: Disconnected sessionId: src_id|b40b61ca-77069482-c2a9007c-f9607f81_0
2025-10-02T08:13:41.095472Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:41.095583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1819 sessionId: src_id|b40b61ca-77069482-c2a9007c-f9607f81_0 is DEAD
2025-10-02T08:13:41.095726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b61ca-77069482-c2a9007c-f9607f81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:41.095743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b61ca-77069482-c2a9007c-f9607f81_0] Write session will restart in 0.008162s
2025-10-02T08:13:41.095769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b61ca-77069482-c2a9007c-f9607f81_0] Write session: Do CDS request
2025-10-02T08:13:41.095776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b61ca-77069482-c2a9007c-f9607f81_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:41.105260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b61ca-77069482-c2a9007c-f9607f81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.105301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:41.105321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1820
2025-10-02T08:13:41.105478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.105516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:41.105521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:41.105524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:41.105826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:41.105939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1820 sessionId:  describe result for acl check
2025-10-02T08:13:41.105968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:41.105972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:41.105974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:41.105979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534628411227343:10431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:41.106422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534628411227343:10431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:41.106587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:41.106766Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:41.106776Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:41.106785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:41.106838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:41.106872Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534628411227351:10430]
2025-10-02T08:13:41.107443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:41.107581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:41.107620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:41.107896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:41.107938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.107944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.107945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.107946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.107947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.107952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.107962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.107966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.107970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.107974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.107978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.107985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.107989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.107995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.107999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.108003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.108008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.108013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.108018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.108023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.108044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:41.108310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534628411227343:10431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:41.114421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534628411227343:10431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:41.114441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534628411227343:10431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:41.114444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534628411227343:10431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:41.114453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:41.116067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:41.117880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:41.117900Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:41.117902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:41.117906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:41.117912Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1819 [1:7556534628411227351:10430]
2025-10-02T08:13:41.117924Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:41.117941Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:41.117944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.117946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.117948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.117964Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:41.117976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:41.117982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:41.118041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.118047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.118050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:41.118052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:41.118122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:41.118129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.118138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.118144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:41.118159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534628411227339:10430]
2025-10-02T08:13:41.118164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534628411227339:10430]
2025-10-02T08:13:41.118170Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:41.118173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1819
2025-10-02T08:13:41.118180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411227389:10431], now have 1 active actors on pipe
2025-10-02T08:13:41.118191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:41.118198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:41.118201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:41.118232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534628411227339:10430]
2025-10-02T08:13:41.118239Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:41.118261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534628870924269:2378], now have 1 active actors on pipe
2025-10-02T08:13:41.118261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:41.118264Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:41.118269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.118271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:41.118274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.118301Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:41.118310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.118313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.118315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:41.118323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.118332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:41.118351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.118389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.118396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.118407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.118386Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1819
2025-10-02T08:13:41.118437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1820 partition: 0 MaxSeqNo: 17 sessionId: src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0
2025-10-02T08:13:41.118724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40b61ca-77069482-c2a9007c-f9607f81_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:41.121248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0] Write session: try to update token
2025-10-02T08:13:41.121261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:41.129669Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:41.129699Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:41.129709Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534628411227339:10430]
2025-10-02T08:13:41.129756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:41.129759Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:41.129975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:41.130122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:41.130270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:41.130415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:41.130607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:41.130647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:41.134621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId: src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:41.137446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:41.137519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.137528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.137562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:41.137581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:41.137637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.137647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.137814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.137876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.137936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.138005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.138415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.138420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.138493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.138550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.138611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.138678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.138720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.138723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.138794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.138852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.138911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.138976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.139015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.139018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.139083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.139145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.139212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.139283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.139331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.139334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.139416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.139480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.139546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.139618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.139665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.139668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.139746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.139808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.139874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.139942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.139988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.139991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.140067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.140146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.140233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.140303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.140354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.140362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.140439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.140503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.140574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.140646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.140696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.140704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.140778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.140962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.141028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.141087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.141132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.141144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.141232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.141298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.141360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.141422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.141471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.141482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.141524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:41.141586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.141611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.141613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:41.141644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:41.141660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:41.141666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:41.141669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:41.141672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:41.142063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:41.142093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:41.142100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:41.142104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:41.142106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:41.142110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:41.142709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:41.142738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:41.142748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:41.142751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:41.142754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:41.142757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:41.143282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:41.143307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:41.143318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:41.143321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:41.143324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:41.145536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:41.145557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:41.145568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392821145
2025-10-02T08:13:41.145711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:41.145728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:41.145735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:41.145744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:41.145748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:41.145751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:41.146214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:41.146240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:41.146251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:41.146255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:41.146260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:41.146269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:41.146763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:41.146787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:41.146802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:41.146810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:41.146814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:41.146817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:41.147305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:41.147330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:41.147336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:41.148495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:41.148515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:41.148520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:41.148523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:41.148533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392821148
2025-10-02T08:13:41.148851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:41.148871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:41.148883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:41.148892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:41.148897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:41.148900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:41.149352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:41.149373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:41.149383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:41.149387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:41.149390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:41.149393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:41.149834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:41.149854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.149959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392821149
2025-10-02T08:13:41.153873Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:41.153896Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:41.153904Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:41.153911Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:41.155490Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:41.155508Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:41.155510Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:41.155522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534628411227339:10430]
2025-10-02T08:13:41.155527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534628411227339:10430]
2025-10-02T08:13:41.155583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:41.155593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.155592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:41.155598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:41.155601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:41.155741Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:41.195603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534628411227418:10829]
2025-10-02T08:13:41.195812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1819, pipe: [1:7556534628411227418:10829]
2025-10-02T08:13:41.300591Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:41.300989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411227418:10829], now have 1 active actors on pipe
2025-10-02T08:13:41.301224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:41.301630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:41.301137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534628411227418:10829]
2025-10-02T08:13:41.301642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0] Write session will restart in 0.009271s
2025-10-02T08:13:41.301158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:41.301160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:41.301182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1820 reason: error at write: Disconnected sessionId: src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0
2025-10-02T08:13:41.301255Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:41.301335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1820 sessionId: src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0 is DEAD
2025-10-02T08:13:41.301665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0] Write session: Do CDS request
2025-10-02T08:13:41.301671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:41.312275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.312405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:41.312424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1821
2025-10-02T08:13:41.312629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:41.312945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.312978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:41.312988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:41.312993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:41.313390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:41.313442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1821 sessionId:  describe result for acl check
2025-10-02T08:13:41.313475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:41.313481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:41.313482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:41.313487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534628411227727:10415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:41.313570Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:41.313580Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:41.313589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:41.313642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:41.313683Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534628411227728:10422]
2025-10-02T08:13:41.313978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534628411227727:10415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:41.314291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:41.314493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:41.314537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:41.314822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:41.314898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.314905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.314906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.314907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.314908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.314912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.314920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.314924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.314928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.314931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.314936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.314944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.314950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.314955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.314960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.314971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.314980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.314985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.314996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.315006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.315024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:41.315795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534628411227727:10415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:41.321818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534628411227727:10415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:41.321834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534628411227727:10415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:41.321836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534628411227727:10415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:41.321842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:41.322820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:41.324649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:41.324666Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:41.324669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:41.324673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:41.324679Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1820 [1:7556534628411227728:10422]
2025-10-02T08:13:41.324690Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:41.324707Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:41.324710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.324713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.324715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.324730Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:41.324736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:41.324742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:41.324798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.324821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.324824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:41.324826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:41.324879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:41.324880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.324892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.324902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:41.324918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534628411227719:10422]
2025-10-02T08:13:41.324920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534628411227719:10422]
2025-10-02T08:13:41.324929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:41.324940Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:41.324942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411227773:10415], now have 1 active actors on pipe
2025-10-02T08:13:41.324943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:41.324950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:41.324952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1820
2025-10-02T08:13:41.324962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:41.324965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:41.324970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534628870924302:2378], now have 1 active actors on pipe
2025-10-02T08:13:41.325001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.325004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.325017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534628411227719:10422]
2025-10-02T08:13:41.325025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:41.325034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:41.325060Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:41.325067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.325072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.325073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:41.325083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.325092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:41.325112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.325086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1820
2025-10-02T08:13:41.325175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.325182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.325195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.325239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1821 partition: 0 MaxSeqNo: 17 sessionId: src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0
2025-10-02T08:13:41.325564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8221c90f-dd4c5e31-aa6dbcdb-f70ba98c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:41.328133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0] Write session: try to update token
2025-10-02T08:13:41.328149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:41.343176Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:41.343196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId: src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:41.343200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:41.343202Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:41.343211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534628411227719:10422]
2025-10-02T08:13:41.343216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534628411227719:10422]
2025-10-02T08:13:41.343257Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:41.343259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:41.343265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.343268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:41.343270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:41.343416Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:41.345636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:41.401361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534628411227790:10829]
2025-10-02T08:13:41.401469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1820, pipe: [1:7556534628411227790:10829]
2025-10-02T08:13:41.479829Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:41.480082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.480097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.480138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411227790:10829], now have 1 active actors on pipe
2025-10-02T08:13:41.480383Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:41.480423Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:41.480645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:41.480697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1821 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0
2025-10-02T08:13:41.480854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534628411227790:10829]
2025-10-02T08:13:41.480885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1821 sessionId: src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0 is DEAD
2025-10-02T08:13:41.480989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:41.481000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0] Write session will restart in 0.005766s
2025-10-02T08:13:41.481026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0] Write session: Do CDS request
2025-10-02T08:13:41.481032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:41.488270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.488351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:41.488370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1822
2025-10-02T08:13:41.488488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.488519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:41.488528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:41.488531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:41.489057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1822 sessionId:  describe result for acl check
2025-10-02T08:13:41.489091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:41.489093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:41.489095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:41.489100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534628411228092:10402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:41.489662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534628411228092:10402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:41.490968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:41.492036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:41.492137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534628411228092:10402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:41.492292Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:41.492304Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:41.492314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:41.492373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:41.492425Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534628411228129:10401]
2025-10-02T08:13:41.493082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:41.493285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:41.493338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:41.493690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:41.493740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.493746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.493748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.493749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.493750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.493755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.493764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.493768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.493772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.493776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.493782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.493789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.493796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.493801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.493810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.493816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.493820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.493826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.493830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.493835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.493852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:41.498693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534628411228092:10402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:41.498709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534628411228092:10402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:41.498712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534628411228092:10402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:41.498720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:41.501623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:41.503359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:41.503381Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:41.503384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:41.503388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:41.503396Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1821 [1:7556534628411228129:10401]
2025-10-02T08:13:41.503409Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:41.503427Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:41.503430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.503433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.503435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.503449Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:41.503462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:41.503469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:41.503536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.503543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.503547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:41.503551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:41.503614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:41.503620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.503634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.503653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:41.503673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411228156:10402], now have 1 active actors on pipe
2025-10-02T08:13:41.503680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534628870924321:2378], now have 1 active actors on pipe
2025-10-02T08:13:41.503686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534628411228117:10401]
2025-10-02T08:13:41.503687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534628411228117:10401]
2025-10-02T08:13:41.503700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:41.503717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:41.503717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:41.503721Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:41.503735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:41.503742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:41.503773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534628411228117:10401]
2025-10-02T08:13:41.503780Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:41.503788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:41.503827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1821
2025-10-02T08:13:41.503872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.503876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.503899Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36352a84-59458dd0-5da6a32e-56096b04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:41.503911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.503915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.503917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:41.503924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.503932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:41.503949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.503982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.503991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.504003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.504031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1822 partition: 0 MaxSeqNo: 17 sessionId: src_id|36352a84-59458dd0-5da6a32e-56096b04_0
2025-10-02T08:13:41.504166Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1821
2025-10-02T08:13:41.504372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fa7ff6a-b69639af-8d4ae20-3f2361df_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|36352a84-59458dd0-5da6a32e-56096b04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:41.506887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36352a84-59458dd0-5da6a32e-56096b04_0] Write session: try to update token
2025-10-02T08:13:41.506901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36352a84-59458dd0-5da6a32e-56096b04_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:41.522659Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:41.522683Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:41.522686Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:41.522695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534628411228117:10401]
2025-10-02T08:13:41.522700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534628411228117:10401]
2025-10-02T08:13:41.522744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:41.522751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.522753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:41.522790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:41.522796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:41.522903Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:41.523429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId: src_id|36352a84-59458dd0-5da6a32e-56096b04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:41.526234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:41.581127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534628411228183:10829]
2025-10-02T08:13:41.581348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1821, pipe: [1:7556534628411228183:10829]
2025-10-02T08:13:41.670538Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:41.670767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.670778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.670816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411228183:10829], now have 1 active actors on pipe
2025-10-02T08:13:41.671048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534628411228183:10829]
2025-10-02T08:13:41.671065Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:41.671072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:41.671075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:41.671138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1822 reason: error at write: Disconnected sessionId: src_id|36352a84-59458dd0-5da6a32e-56096b04_0
2025-10-02T08:13:41.671108Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:41.671294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1822 sessionId: src_id|36352a84-59458dd0-5da6a32e-56096b04_0 is DEAD
2025-10-02T08:13:41.671401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36352a84-59458dd0-5da6a32e-56096b04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:41.671408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36352a84-59458dd0-5da6a32e-56096b04_0] Write session will restart in 0.008589s
2025-10-02T08:13:41.671434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36352a84-59458dd0-5da6a32e-56096b04_0] Write session: Do CDS request
2025-10-02T08:13:41.671439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36352a84-59458dd0-5da6a32e-56096b04_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:41.681226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36352a84-59458dd0-5da6a32e-56096b04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.681565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:41.681586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1823
2025-10-02T08:13:41.681723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.681758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:41.681777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:41.681785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:41.682242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1823 sessionId:  describe result for acl check
2025-10-02T08:13:41.682278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:41.682284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:41.682286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:41.682292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534628411228495:10391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:41.682508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:41.682829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534628411228495:10391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:41.683410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:41.683574Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:41.683585Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:41.683594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:41.683641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:41.683668Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534628411228512:10393]
2025-10-02T08:13:41.684322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:41.684455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:41.684488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:41.684636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534628411228495:10391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:41.684957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:41.685013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.685015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.685016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.685017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.685018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.685023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.685033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.685037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.685041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.685045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.685051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.685058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.685064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.685069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.685074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.685079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.685083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.685089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.685096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.685102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.685121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:41.691220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534628411228495:10391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:41.691238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534628411228495:10391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:41.691242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534628411228495:10391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:41.691250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:41.693456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:41.695286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:41.695306Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:41.695308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:41.695312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:41.695320Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1822 [1:7556534628411228512:10393]
2025-10-02T08:13:41.695333Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:41.695351Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:41.695361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.695364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.695366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.695381Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:41.695385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:41.695392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:41.695454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.695462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.695465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:41.695467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:41.695541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:41.695549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.695563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.695578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:41.695593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534628411228496:10393]
2025-10-02T08:13:41.695600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534628411228496:10393]
2025-10-02T08:13:41.695607Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:41.695620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:41.695621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411228547:10391], now have 1 active actors on pipe
2025-10-02T08:13:41.695629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:41.695632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:41.695632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1822
2025-10-02T08:13:41.695644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:41.695647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:41.695653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534628870924327:2378], now have 1 active actors on pipe
2025-10-02T08:13:41.695683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.695692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.695705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534628411228496:10393]
2025-10-02T08:13:41.695717Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:41.695730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:41.695745Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:41.695759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.695767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.695769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:41.695778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.695788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:41.695743Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1822
2025-10-02T08:13:41.695820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.696248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36352a84-59458dd0-5da6a32e-56096b04_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:41.695868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.695876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.695891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.695930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1823 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0
2025-10-02T08:13:41.698821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0] Write session: try to update token
2025-10-02T08:13:41.698836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:41.712426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId: src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:41.715235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:41.715309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.715323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.716933Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:41.716948Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:41.716951Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:41.716963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534628411228496:10393]
2025-10-02T08:13:41.716967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534628411228496:10393]
2025-10-02T08:13:41.717007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:41.717029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:41.717036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.717038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:41.717041Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:41.717047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:41.717054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:41.717178Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:41.771075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534628411228562:10829]
2025-10-02T08:13:41.771156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1822, pipe: [1:7556534628411228562:10829]
2025-10-02T08:13:41.855393Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:41.855783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.855801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.855969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.856030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.856093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.856156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.856227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.856232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.856303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.856367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.856434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.856503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.856545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.856552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.856639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.856700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.856765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.856903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.856959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.856974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.857061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.857141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.857235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.857314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.857371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.857379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.857460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.857550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.857626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.857700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.857753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.857764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.857841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.857915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.857989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.858065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.858120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.858126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.858205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.858281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.858358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.858434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.858490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.858498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.858574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.858651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.858725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.858803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.858855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.858861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.858933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.859000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.859064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.859132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.859185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.859191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.859264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:41.859329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:41.859394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:41.859465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:41.859518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:41.859523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:41.859598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411228562:10829], now have 1 active actors on pipe
2025-10-02T08:13:41.859752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534628411228562:10829]
2025-10-02T08:13:41.859788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:41.859795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:41.859824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1823 reason: error at write: Disconnected sessionId: src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0
2025-10-02T08:13:41.860132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:41.860144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0] Write session will restart in 0.009621s
2025-10-02T08:13:41.860170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0] Write session: Do CDS request
2025-10-02T08:13:41.860176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:41.859979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1823 sessionId: src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0 is DEAD
2025-10-02T08:13:41.860059Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:41.862303Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:41.871306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.872230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:41.872255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1824
2025-10-02T08:13:41.872411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:41.872466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:41.872477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:41.872485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:41.872998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1824 sessionId:  describe result for acl check
2025-10-02T08:13:41.873036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:41.873038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:41.873040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:41.873045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534628411228715:10364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:41.873641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534628411228715:10364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:41.878559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534628411228715:10364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:41.889818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534628411228715:10364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:41.889836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534628411228715:10364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:41.889839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534628411228715:10364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:41.889846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:41.900346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:41.900821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:41.901005Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:41.901008Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:41.901019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:41.901061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:41.901086Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534628411228915:10383]
2025-10-02T08:13:41.901617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:41.901944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:41.901992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:41.902283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:41.902331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.902332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.902333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.902335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.902336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.902340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.902350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.902353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.902356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.902360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.902366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.902372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:41.902377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.902381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:41.902385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.902389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:41.902393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.902397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.902401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.902406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.902421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:41.910752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:41.912427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:41.912444Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:41.912446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:41.912449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:41.912454Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1823 [1:7556534628411228915:10383]
2025-10-02T08:13:41.912462Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:41.912477Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:41.912479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.912481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.912482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.912495Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:41.912501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:41.912505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:41.912553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.912559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.912561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:41.912563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:41.912609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:41.912614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.912622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:41.912629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:41.912645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534628411228908:10383]
2025-10-02T08:13:41.912646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534628411228908:10383]
2025-10-02T08:13:41.912652Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:41.912661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:41.912670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:41.912672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:41.912677Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:41.912681Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:41.912702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534628870924335:2378], now have 1 active actors on pipe
2025-10-02T08:13:41.912705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411228817:10364], now have 1 active actors on pipe
2025-10-02T08:13:41.912706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534628411228908:10383]
2025-10-02T08:13:41.912712Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:41.912720Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:41.912726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1823
2025-10-02T08:13:41.912728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.912731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.912752Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:41.912757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:41.912760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:41.912762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:41.912767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:41.912850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1823
2025-10-02T08:13:41.913203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c6d142-6b537f87-7ba1a6a3-d8d3ad8f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:41.912774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:41.912783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.912831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:41.912834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:41.912847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:41.912875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1824 partition: 0 MaxSeqNo: 17 sessionId: src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0
2025-10-02T08:13:41.915706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0] Write session: try to update token
2025-10-02T08:13:41.915720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:41.930494Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:41.930513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:41.930516Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:41.930525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534628411228908:10383]
2025-10-02T08:13:41.930529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534628411228908:10383]
2025-10-02T08:13:41.930569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:41.930578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:41.930580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:41.930591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:41.930595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:41.930707Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:41.936895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId: src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:41.939547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:41.960012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534628411228940:10829]
2025-10-02T08:13:41.960219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1823, pipe: [1:7556534628411228940:10829]
2025-10-02T08:13:42.070017Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:42.070355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.070368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.070408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534628411228940:10829], now have 1 active actors on pipe
2025-10-02T08:13:42.070561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534628411228940:10829]
2025-10-02T08:13:42.070595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:42.070602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:42.070622Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:42.070678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1824 reason: error at write: Disconnected sessionId: src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0
2025-10-02T08:13:42.070835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1824 sessionId: src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0 is DEAD
2025-10-02T08:13:42.071173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:42.071183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0] Write session will restart in 0.006378s
2025-10-02T08:13:42.071206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0] Write session: Do CDS request
2025-10-02T08:13:42.071216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:42.070699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:42.078276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.078361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:42.078379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1825
2025-10-02T08:13:42.078481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.078517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:42.078526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:42.078530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:42.078899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1825 sessionId:  describe result for acl check
2025-10-02T08:13:42.078930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:42.078933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:42.078936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:42.078941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534632706196520:10357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:42.079462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534632706196520:10357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:42.081183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534632706196520:10357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:42.081951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:42.082344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:42.082522Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:42.082532Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:42.082542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:42.082594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:42.082630Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534632706196585:10361]
2025-10-02T08:13:42.083312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:42.083714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:42.083766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:42.083874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534632706196520:10357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:42.083887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534632706196520:10357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:42.083890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534632706196520:10357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:42.083906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:42.084092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:42.084136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.084142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.084145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.084146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.084147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.084152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.084161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.084170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.084173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.084181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.084186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.084211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.084217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.084222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.084226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.084231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.084234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.084239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.084243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.084248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.084266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:42.092610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:42.094527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:42.094551Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:42.094554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:42.094557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:42.094564Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1824 [1:7556534632706196585:10361]
2025-10-02T08:13:42.094576Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:42.094594Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:42.094597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.094600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.094603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.094618Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:42.094627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:42.094633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:42.094702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.094713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.094716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:42.094718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:42.094783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:42.094793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.094807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.094826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:42.094851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706196599:10357], now have 1 active actors on pipe
2025-10-02T08:13:42.094860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534633165891636:2378], now have 1 active actors on pipe
2025-10-02T08:13:42.094866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534632706196579:10361]
2025-10-02T08:13:42.094868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534632706196579:10361]
2025-10-02T08:13:42.094880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:42.094894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:42.094899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:42.094903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:42.094915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:42.094922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:42.094956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534632706196579:10361]
2025-10-02T08:13:42.094964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:42.094967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:42.094939Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1824
2025-10-02T08:13:42.095022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1824
2025-10-02T08:13:42.095079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.095088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.095113Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:42.095125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.095131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.095133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:42.095142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.095157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:42.095176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.095203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.095211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.095224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.095260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1825 partition: 0 MaxSeqNo: 17 sessionId: src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0
2025-10-02T08:13:42.095583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad599539-18f74e60-71ddd8ab-9649cd64_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:42.098174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0] Write session: try to update token
2025-10-02T08:13:42.098190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:42.106476Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:42.106502Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:42.106511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534632706196579:10361]
2025-10-02T08:13:42.106549Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:42.106556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:42.106767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:42.106928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:42.107091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:42.107219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:42.107402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:42.107442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:42.111476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId: src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:42.114021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:42.114079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.114090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.114117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:42.114129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:42.114170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.114175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.114297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.114350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.114404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.114457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.114495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.114502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.114560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.114610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.114665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.114721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.114760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.114765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.114822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.114875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.114926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.114977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.115013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.115018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.115071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.115129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.115191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.115251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.115296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.115303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.115368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.115424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.115491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.115560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.115605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.115609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.115676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.115732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.115795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.115856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.115903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.115908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.115974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.116030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.116096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.116161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.116219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.116227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.116294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.116351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.116411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.116480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.116531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.116538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.116609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.116669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.116737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.116794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.116855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.116864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.116937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.117000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.117058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.117110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.117156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.117162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.117189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:42.117240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.117257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.117259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:42.117287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:42.117306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:42.117313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:42.117315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:42.117317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:42.117698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:42.117725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:42.117732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:42.117736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:42.117739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:42.117742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:42.118293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:42.118320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:42.118325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:42.118329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:42.118332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:42.118336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:42.118764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:42.118788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:42.118796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:42.118799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:42.118801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:42.119930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:42.119948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:42.119956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392822119
2025-10-02T08:13:42.120106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:42.120127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:42.120133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:42.120136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:42.120141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:42.120144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:42.120567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:42.120588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:42.120593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:42.120598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:42.120601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:42.120605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:42.121049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:42.121071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:42.121078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:42.121080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:42.121082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:42.121084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:42.121503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:42.121522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:42.121529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:42.122463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:42.122478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:42.122482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:42.122484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:42.122490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392822122
2025-10-02T08:13:42.122734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:42.122750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:42.122753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:42.122756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:42.122758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:42.122760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:42.123155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:42.123174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:42.123179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:42.123182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:42.123185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:42.123187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:42.123558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:42.123575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.123647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392822123
2025-10-02T08:13:42.126680Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:42.126699Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:42.126703Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:42.126707Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:42.128182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:42.128193Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:42.128196Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:42.128212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534632706196579:10361]
2025-10-02T08:13:42.128215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534632706196579:10361]
2025-10-02T08:13:42.128257Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:42.128260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:42.128264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.128265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:42.128269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:42.128388Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:42.170985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534632706196652:10829]
2025-10-02T08:13:42.171104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1824, pipe: [1:7556534632706196652:10829]
2025-10-02T08:13:42.263797Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:42.264254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706196652:10829], now have 1 active actors on pipe
2025-10-02T08:13:42.264404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:42.264413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:42.264433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1825 reason: error at write: Disconnected sessionId: src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0
2025-10-02T08:13:42.264524Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:42.264564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1825 sessionId: src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0 is DEAD
2025-10-02T08:13:42.264585Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:42.264736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534632706196652:10829]
2025-10-02T08:13:42.265029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:42.265049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0] Write session will restart in 0.008960s
2025-10-02T08:13:42.265073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0] Write session: Do CDS request
2025-10-02T08:13:42.265082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:42.275299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.279027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:42.279045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1826
2025-10-02T08:13:42.279293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.279337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:42.279347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:42.279351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:42.279753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1826 sessionId:  describe result for acl check
2025-10-02T08:13:42.279796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:42.279798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:42.279800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:42.279805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534632706196864:10312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:42.280516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534632706196864:10312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:42.283850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534632706196864:10312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:42.287771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534632706196864:10312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:42.287789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534632706196864:10312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:42.287792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534632706196864:10312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:42.287799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:42.287867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:42.288966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:42.289176Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:42.289188Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:42.289199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:42.289258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:42.289424Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534632706197016:10319]
2025-10-02T08:13:42.290034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:42.290256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:42.290308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:42.290592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:42.290651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.290657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.290658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.290659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.290660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.290665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.290673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.290677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.290681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.290684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.290703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.290714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.290719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.290727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.290731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.290736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.290740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.290745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.290749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.290754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.290772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:42.298553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:42.301819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:42.301838Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:42.301840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:42.301842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:42.301848Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1825 [1:7556534632706197016:10319]
2025-10-02T08:13:42.301856Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:42.301873Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:42.301876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.301878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.301880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.301897Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:42.301901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:42.301906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:42.301958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.301966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.301969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:42.301972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:42.302046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:42.302056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.302069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.302076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:42.302089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1825
2025-10-02T08:13:42.302090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706197008:10312], now have 1 active actors on pipe
2025-10-02T08:13:42.302096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534632706197004:10319]
2025-10-02T08:13:42.302098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534632706197004:10319]
2025-10-02T08:13:42.302105Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:42.302116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:42.302117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:42.302121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:42.302130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:42.302138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:42.302145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.302149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.302163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534633165891667:2378], now have 1 active actors on pipe
2025-10-02T08:13:42.302191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534632706197004:10319]
2025-10-02T08:13:42.302199Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:42.302202Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:42.302179Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1825
2025-10-02T08:13:42.302216Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:42.302225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.302234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.302236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:42.302241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.302248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:42.302278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.302361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.302376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.302398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.302444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1826 partition: 0 MaxSeqNo: 17 sessionId: src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0
2025-10-02T08:13:42.302756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52d95733-3e4a33d6-ded9ebf-c2591b42_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:42.309687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0] Write session: try to update token
2025-10-02T08:13:42.309703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:42.313546Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:42.313573Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:42.313582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534632706197004:10319]
2025-10-02T08:13:42.313618Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:42.313621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:42.314270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:42.314430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:42.315003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:42.315328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:42.315552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:42.315597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:42.324938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId: src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:42.327571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:42.327640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.327653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.327687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:42.327712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:42.327777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.327797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.327981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.328048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.328125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.328190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.328421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.328426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.328498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.328553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.328616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.328676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.328714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.328718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.328780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.328857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.328908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.328964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.329004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.329008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.329115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.329229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.329301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.329726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.329777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.329780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.329856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.329918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.329985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.330049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.330097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.330100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.330176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.330237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.330302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.330368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.330416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.330421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.330494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.330552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.330620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.330690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.330736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.330739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.330822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.330886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.330949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.331016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.331063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.331066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.331142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.331197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.331256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.331321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.331369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.331372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.331445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:42.331506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:42.331563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:42.331641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:42.331692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:42.331694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:42.331752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:42.331813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.331830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.331832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:42.331861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:42.331874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:42.331878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:42.331881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:42.331884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:42.332275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:42.332293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:42.332303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:42.332306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:42.332309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:42.332312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:42.333114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:42.333142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:42.333148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:42.333151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:42.333154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:42.333157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:42.333693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:42.333722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:42.333728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:42.333732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:42.333735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:42.334920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:42.334944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:42.334956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392822334
2025-10-02T08:13:42.335096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:42.335125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:42.335135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:42.335139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:42.335143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:42.335147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:42.335621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:42.335647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:42.335653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:42.335656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:42.335660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:42.335669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:42.336168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:42.336192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:42.336215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:42.336223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:42.336226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:42.336229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:42.336661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:42.336686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:42.336697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:42.337852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:42.337873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:42.337878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:42.337883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:42.337891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392822337
2025-10-02T08:13:42.338186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:42.338208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:42.338214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:42.338219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:42.338223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:42.338226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:42.338692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:42.338718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:42.338731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:42.338739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:42.338742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:42.338746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:42.339202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:42.339226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.339318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392822339
2025-10-02T08:13:42.341666Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:42.341697Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:42.341705Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:42.341712Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:42.341725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:42.341727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:42.341732Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:42.341741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534632706197004:10319]
2025-10-02T08:13:42.341750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534632706197004:10319]
2025-10-02T08:13:42.341797Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:42.341812Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:42.341823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:42.341827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.341829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:42.341967Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:42.364617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534632706197048:10829]
2025-10-02T08:13:42.364874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1825, pipe: [1:7556534632706197048:10829]
2025-10-02T08:13:42.489381Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:42.489825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706197048:10829], now have 1 active actors on pipe
2025-10-02T08:13:42.490029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534632706197048:10829]
2025-10-02T08:13:42.490051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:42.490057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:42.490097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1826 reason: error at write: Disconnected sessionId: src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0
2025-10-02T08:13:42.490116Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:42.490156Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:42.490260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1826 sessionId: src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0 is DEAD
2025-10-02T08:13:42.490396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:42.490406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0] Write session will restart in 0.009395s
2025-10-02T08:13:42.490429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0] Write session: Do CDS request
2025-10-02T08:13:42.490444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:42.494391Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [383d198160661194] Result# TEvPutResult {Id# [72075186224037892:1825:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:42.494420Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1825:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:42.494469Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1825:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:42.501239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.501365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:42.501382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1827
2025-10-02T08:13:42.501483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.501529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:42.501538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:42.501541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:42.501978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1827 sessionId:  describe result for acl check
2025-10-02T08:13:42.502020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:42.502028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:42.502029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:42.502034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534632706197351:10303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:42.502538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534632706197351:10303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:42.504287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:42.505086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534632706197351:10303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:42.505499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:42.505666Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:42.505675Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:42.505683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:42.505723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:42.505834Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534632706197403:10306]
2025-10-02T08:13:42.506446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:42.506621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:42.506675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:42.506911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:42.506963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.506968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.506969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.506970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.506971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.506974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.506981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.506983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.506985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.506987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.506990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.506994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.506998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.507001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.507004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.507007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.507009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.507012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.507015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.507017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.507028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:42.511542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534632706197351:10303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:42.511571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534632706197351:10303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:42.511574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534632706197351:10303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:42.511582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:42.514635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:42.516215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:42.516228Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:42.516230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:42.516232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:42.516237Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1826 [1:7556534632706197403:10306]
2025-10-02T08:13:42.516249Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:42.516264Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:42.516268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.516272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.516273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.516284Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:42.516287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:42.516293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:42.516337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.516344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.516346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:42.516349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:42.516416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:42.516425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.516438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.516449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:42.516471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706197424:10303], now have 1 active actors on pipe
2025-10-02T08:13:42.516478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534633165891688:2378], now have 1 active actors on pipe
2025-10-02T08:13:42.516478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1826
2025-10-02T08:13:42.516484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534632706197389:10306]
2025-10-02T08:13:42.516485Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534632706197389:10306]
2025-10-02T08:13:42.516494Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:42.516506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:42.516510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:42.516513Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:42.516518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:42.516520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:42.516526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.516530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.516565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534632706197389:10306]
2025-10-02T08:13:42.516538Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1826
2025-10-02T08:13:42.516573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:42.516574Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:42.516586Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:42.516591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.516594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.516595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:42.516604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.516611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:42.516652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.516737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.516746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.516759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.516793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1827 partition: 0 MaxSeqNo: 17 sessionId: src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0
2025-10-02T08:13:42.517117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4410f674-e7cbcef6-aa8eb6d1-e1bb9533_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:42.519611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0] Write session: try to update token
2025-10-02T08:13:42.519625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:42.533314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId: src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:42.534078Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:42.534107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:42.534110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:42.534118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534632706197389:10306]
2025-10-02T08:13:42.534124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534632706197389:10306]
2025-10-02T08:13:42.534170Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:42.534173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:42.534181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.534183Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:42.534183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:42.534354Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:42.535791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:42.590448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534632706197449:10829]
2025-10-02T08:13:42.590585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1826, pipe: [1:7556534632706197449:10829]
2025-10-02T08:13:42.672942Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:42.673342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.673361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.673404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706197449:10829], now have 1 active actors on pipe
2025-10-02T08:13:42.673513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:42.673526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:42.673581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1827 reason: error at write: Disconnected sessionId: src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0
2025-10-02T08:13:42.673593Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:42.673738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1827 sessionId: src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0 is DEAD
2025-10-02T08:13:42.673878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:42.673923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534632706197449:10829]
2025-10-02T08:13:42.673946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:42.674021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0] Write session will restart in 0.008945s
2025-10-02T08:13:42.674050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0] Write session: Do CDS request
2025-10-02T08:13:42.674057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:42.684413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.684783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:42.684815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1828
2025-10-02T08:13:42.684959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.684981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:42.684985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:42.684988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:42.685382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1828 sessionId:  describe result for acl check
2025-10-02T08:13:42.685416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:42.685417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:42.685419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:42.685424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534632706197772:10274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:42.685448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:42.685913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534632706197772:10274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:42.686651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:42.686815Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:42.686827Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:42.686836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:42.686884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:42.686918Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534632706197791:10280]
2025-10-02T08:13:42.687499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:42.687696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:42.687739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:42.687904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534632706197772:10274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:42.688031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:42.688079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.688085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.688086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.688087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.688088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.688094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.688102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.688111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.688115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.688119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.688123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.688134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.688144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.688152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.688156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.688161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.688169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.688174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.688182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.688186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.688215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:42.693731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534632706197772:10274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:42.693748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534632706197772:10274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:42.693751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534632706197772:10274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:42.693759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:42.695685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:42.697393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:42.697408Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:42.697410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:42.697413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:42.697417Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1827 [1:7556534632706197791:10280]
2025-10-02T08:13:42.697426Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:42.697438Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:42.697440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.697442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.697444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.697454Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:42.697457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:42.697462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:42.697506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.697512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.697514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:42.697516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:42.697564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:42.697568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.697578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.697588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:42.697612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534632706197771:10280]
2025-10-02T08:13:42.697618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534632706197771:10280]
2025-10-02T08:13:42.697625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:42.697631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1827
2025-10-02T08:13:42.697635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:42.697638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:42.697638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:42.697652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:42.697654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:42.697662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706197823:10274], now have 1 active actors on pipe
2025-10-02T08:13:42.697672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534633165891695:2378], now have 1 active actors on pipe
2025-10-02T08:13:42.697676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.697678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.697712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534632706197771:10280]
2025-10-02T08:13:42.697723Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:42.697729Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:42.697737Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:42.697747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.697750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.697752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:42.697717Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1827
2025-10-02T08:13:42.697759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.697771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:42.697805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.697871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.697878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.697893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.697933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1828 partition: 0 MaxSeqNo: 17 sessionId: src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0
2025-10-02T08:13:42.698269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed49d60-2a0fc99d-ae96d48f-13a0ea84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:42.700874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0] Write session: try to update token
2025-10-02T08:13:42.700889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:42.714646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId: src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:42.714970Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:42.714986Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:42.714988Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:42.714995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534632706197771:10280]
2025-10-02T08:13:42.714999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534632706197771:10280]
2025-10-02T08:13:42.715042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:42.715052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.715054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:42.715153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:42.715170Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:42.715208Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:42.717107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:42.774207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534632706197838:10829]
2025-10-02T08:13:42.774309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1827, pipe: [1:7556534632706197838:10829]
2025-10-02T08:13:42.851672Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:42.852068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.852082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.852119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706197838:10829], now have 1 active actors on pipe
2025-10-02T08:13:42.852356Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:42.852725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534632706197838:10829]
2025-10-02T08:13:42.852752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:42.853040Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:42.852826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1828 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0
2025-10-02T08:13:42.852987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1828 sessionId: src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0 is DEAD
2025-10-02T08:13:42.853230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:42.853247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0] Write session will restart in 0.009764s
2025-10-02T08:13:42.853279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0] Write session: Do CDS request
2025-10-02T08:13:42.853287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:42.864516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.864658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:42.864687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1829
2025-10-02T08:13:42.864906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:42.864946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:42.864953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:42.864959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:42.865457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1829 sessionId:  describe result for acl check
2025-10-02T08:13:42.865511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:42.865513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:42.865515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:42.865521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534632706197996:10261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:42.866099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534632706197996:10261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:42.868372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534632706197996:10261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:42.872384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534632706197996:10261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:42.872403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534632706197996:10261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:42.872406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534632706197996:10261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:42.872414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:42.875989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:42.877472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:42.877674Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:42.877683Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:42.877691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:42.877737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:42.877774Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534632706198201:10267]
2025-10-02T08:13:42.878383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:42.878635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:42.878698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:42.879037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:42.879107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.879114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.879115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.879116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.879117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.879122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.879132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.879136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.879140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.879143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.879149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.879156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:42.879162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.879167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:42.879172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.879182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:42.879186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.879195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.879200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.879209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.879231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:42.887137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:42.889247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:42.889271Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:42.889275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:42.889279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:42.889286Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1828 [1:7556534632706198201:10267]
2025-10-02T08:13:42.889298Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:42.889318Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:42.889321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.889324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.889326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.889341Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:42.889346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:42.889353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:42.889424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.889435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.889438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:42.889441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:42.889506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:42.889515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.889530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:42.889546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:42.889562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534632706198195:10267]
2025-10-02T08:13:42.889570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534632706198195:10267]
2025-10-02T08:13:42.889577Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:42.889593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1828
2025-10-02T08:13:42.889594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:42.889595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706198138:10261], now have 1 active actors on pipe
2025-10-02T08:13:42.889597Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:42.889603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:42.889616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:42.889619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:42.889626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534633165891706:2378], now have 1 active actors on pipe
2025-10-02T08:13:42.889637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.889648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.889693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534632706198195:10267]
2025-10-02T08:13:42.889700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:42.889716Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1016404-74ab918e-c2643ab5-7a42e482_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:42.889725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:42.889726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:42.889730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:42.889732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:42.889709Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1828
2025-10-02T08:13:42.889742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:42.889755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:42.889802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.889841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:42.889849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:42.889862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:42.889900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1829 partition: 0 MaxSeqNo: 17 sessionId: src_id|f1016404-74ab918e-c2643ab5-7a42e482_0
2025-10-02T08:13:42.890420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4db4563-59cb8aa4-b6b89cc0-afb22664_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f1016404-74ab918e-c2643ab5-7a42e482_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:42.892996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1016404-74ab918e-c2643ab5-7a42e482_0] Write session: try to update token
2025-10-02T08:13:42.893012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1016404-74ab918e-c2643ab5-7a42e482_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:42.907570Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:42.907606Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:42.907609Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:42.907621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534632706198195:10267]
2025-10-02T08:13:42.907627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534632706198195:10267]
2025-10-02T08:13:42.907685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:42.907704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:42.907712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:42.908251Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:42.908253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId: src_id|f1016404-74ab918e-c2643ab5-7a42e482_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:42.909130Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:42.909148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:42.910927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:42.952251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534632706198225:10829]
2025-10-02T08:13:42.952336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1828, pipe: [1:7556534632706198225:10829]
2025-10-02T08:13:43.056388Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:43.056972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.056992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.057031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534632706198225:10829], now have 1 active actors on pipe
2025-10-02T08:13:43.057159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:43.057171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:43.057229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1829 reason: error at write: Disconnected sessionId: src_id|f1016404-74ab918e-c2643ab5-7a42e482_0
2025-10-02T08:13:43.057243Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:43.057286Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:43.057361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1829 sessionId: src_id|f1016404-74ab918e-c2643ab5-7a42e482_0 is DEAD
2025-10-02T08:13:43.057497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1016404-74ab918e-c2643ab5-7a42e482_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:43.057504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1016404-74ab918e-c2643ab5-7a42e482_0] Write session will restart in 0.006451s
2025-10-02T08:13:43.057521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1016404-74ab918e-c2643ab5-7a42e482_0] Write session: Do CDS request
2025-10-02T08:13:43.057511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534632706198225:10829]
2025-10-02T08:13:43.057526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1016404-74ab918e-c2643ab5-7a42e482_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:43.065258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1016404-74ab918e-c2643ab5-7a42e482_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.065446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:43.065462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1830
2025-10-02T08:13:43.065552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.065582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:43.065588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:43.065591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:43.066034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1830 sessionId:  describe result for acl check
2025-10-02T08:13:43.066069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:43.066075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:43.066076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:43.066081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534637001165795:10253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:43.066576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534637001165795:10253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:43.068881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:43.069199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534637001165795:10253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:43.069939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:43.070102Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:43.070112Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:43.070120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:43.070166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:43.070200Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534637001165881:10254]
2025-10-02T08:13:43.070866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:43.071059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:43.071103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:43.071445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:43.071516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.071522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.071523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.071524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.071525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.071530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.071539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.071543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.071547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.071551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.071556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.071564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.071569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.071574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.071578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.071584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.071587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.071592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.071597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.071608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.071630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:43.071960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534637001165795:10253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:43.071971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534637001165795:10253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:43.071975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534637001165795:10253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:43.071981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:43.081998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:43.083444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:43.083464Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:43.083467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:43.083469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:43.083474Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1829 [1:7556534637001165881:10254]
2025-10-02T08:13:43.083483Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:43.083497Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:43.083499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.083501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.083502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.083514Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:43.083517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:43.083524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:43.083569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.083575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.083578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:43.083580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:43.083629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:43.083634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.083643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.083654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:43.083667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001165897:10253], now have 1 active actors on pipe
2025-10-02T08:13:43.083674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534637001165864:10254]
2025-10-02T08:13:43.083676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534637001165864:10254]
2025-10-02T08:13:43.083681Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:43.083690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:43.083692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:43.083696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:43.083698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:43.083700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:43.083705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534637460859008:2378], now have 1 active actors on pipe
2025-10-02T08:13:43.083710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1829
2025-10-02T08:13:43.083729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.083737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.083749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534637001165864:10254]
2025-10-02T08:13:43.083754Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:43.083764Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:43.083777Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23151ede-6027070c-69ed03d2-6c1596ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:43.083782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.083785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.083787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:43.083796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.083803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:43.083820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.083762Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1829
2025-10-02T08:13:43.083878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.083884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.083893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.083920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1830 partition: 0 MaxSeqNo: 17 sessionId: src_id|23151ede-6027070c-69ed03d2-6c1596ce_0
2025-10-02T08:13:43.084229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1016404-74ab918e-c2643ab5-7a42e482_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|23151ede-6027070c-69ed03d2-6c1596ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:43.086886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23151ede-6027070c-69ed03d2-6c1596ce_0] Write session: try to update token
2025-10-02T08:13:43.086900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23151ede-6027070c-69ed03d2-6c1596ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:43.101161Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:43.101178Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:43.101180Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:43.101188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534637001165864:10254]
2025-10-02T08:13:43.101192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534637001165864:10254]
2025-10-02T08:13:43.101232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:43.101232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:43.101237Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:43.101238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.101239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:43.101246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId: src_id|23151ede-6027070c-69ed03d2-6c1596ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:43.101362Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:43.103858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:43.176278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534637001165924:10829]
2025-10-02T08:13:43.183784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1829, pipe: [1:7556534637001165924:10829]
2025-10-02T08:13:43.246659Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:43.246916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.246926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.246959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001165924:10829], now have 1 active actors on pipe
2025-10-02T08:13:43.247263Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:43.247109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534637001165924:10829]
2025-10-02T08:13:43.247136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:43.247139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:43.247150Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:43.247206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1830 reason: error at write: Disconnected sessionId: src_id|23151ede-6027070c-69ed03d2-6c1596ce_0
2025-10-02T08:13:43.247375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1830 sessionId: src_id|23151ede-6027070c-69ed03d2-6c1596ce_0 is DEAD
2025-10-02T08:13:43.247576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23151ede-6027070c-69ed03d2-6c1596ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:43.247591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23151ede-6027070c-69ed03d2-6c1596ce_0] Write session will restart in 0.009368s
2025-10-02T08:13:43.247621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23151ede-6027070c-69ed03d2-6c1596ce_0] Write session: Do CDS request
2025-10-02T08:13:43.247628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23151ede-6027070c-69ed03d2-6c1596ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:43.261259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23151ede-6027070c-69ed03d2-6c1596ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.261297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:43.261315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1831
2025-10-02T08:13:43.261441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.261475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:43.261480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:43.261483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:43.261849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1831 sessionId:  describe result for acl check
2025-10-02T08:13:43.261872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:43.261873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:43.261875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:43.261880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534637001166267:10197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:43.262362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534637001166267:10197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:43.262825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:43.264025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:43.264186Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:43.264195Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:43.264215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:43.264260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:43.264299Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534637001166297:10198]
2025-10-02T08:13:43.265057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:43.265216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:43.265253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:43.265336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534637001166267:10197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:43.265549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:43.265583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.265584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.265585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.265587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.265588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.265592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.265602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.265605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.265609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.265612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.265616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.265625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.265630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.265635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.265640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.265645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.265649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.265654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.265659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.265664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.265686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:43.273056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534637001166267:10197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:43.273074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534637001166267:10197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:43.273077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534637001166267:10197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:43.273086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:43.274958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:43.276745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:43.276763Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:43.276766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:43.276770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:43.276777Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1830 [1:7556534637001166297:10198]
2025-10-02T08:13:43.276789Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:43.277065Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:43.277076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.277080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.277082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.277098Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:43.277108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:43.277114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:43.277190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.277197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.277200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:43.277203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:43.277265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:43.277272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.277284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.277300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:43.277323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001166323:10197], now have 1 active actors on pipe
2025-10-02T08:13:43.277334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534637001166281:10198]
2025-10-02T08:13:43.277333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1830
2025-10-02T08:13:43.277336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534637001166281:10198]
2025-10-02T08:13:43.277344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:43.277356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534637460859035:2378], now have 1 active actors on pipe
2025-10-02T08:13:43.277365Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:43.277367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:43.277377Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:43.277380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:43.277383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:43.277389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.277397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.277439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534637001166281:10198]
2025-10-02T08:13:43.277445Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:43.277453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:43.277460Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:43.277466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.277470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.277476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:43.277435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1830
2025-10-02T08:13:43.277488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.277500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:43.277537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.277590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.277597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.277618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.277653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1831 partition: 0 MaxSeqNo: 17 sessionId: src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0
2025-10-02T08:13:43.277937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23151ede-6027070c-69ed03d2-6c1596ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:43.280361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0] Write session: try to update token
2025-10-02T08:13:43.280375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:43.295912Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:43.295935Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:43.295937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:43.295945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534637001166281:10198]
2025-10-02T08:13:43.295950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534637001166281:10198]
2025-10-02T08:13:43.295989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:43.295996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.295999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:43.296010Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:43.296027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:43.296135Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:43.298626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId: src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:43.301363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:43.347038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534637001166339:10829]
2025-10-02T08:13:43.347167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1830, pipe: [1:7556534637001166339:10829]
2025-10-02T08:13:43.443890Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:43.444352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.444372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.444409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001166339:10829], now have 1 active actors on pipe
2025-10-02T08:13:43.444581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534637001166339:10829]
2025-10-02T08:13:43.444742Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:43.444689Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:43.445266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:43.445324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1831 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0
2025-10-02T08:13:43.445498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1831 sessionId: src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0 is DEAD
2025-10-02T08:13:43.445656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:43.445681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0] Write session will restart in 0.005853s
2025-10-02T08:13:43.445718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0] Write session: Do CDS request
2025-10-02T08:13:43.445728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:43.452259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.452375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:43.452396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1832
2025-10-02T08:13:43.452526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.452557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:43.452567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:43.452570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:43.453059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1832 sessionId:  describe result for acl check
2025-10-02T08:13:43.453096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:43.453102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:43.453103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:43.453108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534637001166535:10184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:43.453682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534637001166535:10184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:43.456052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534637001166535:10184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:43.458722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:43.458886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534637001166535:10184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:43.458900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534637001166535:10184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:43.458903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534637001166535:10184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:43.458911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:43.459799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:43.459954Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:43.459961Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:43.459968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:43.460003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:43.460034Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534637001166707:10183]
2025-10-02T08:13:43.460436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:43.460597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:43.460627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:43.460843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:43.460875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.460880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.460881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.460881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.460882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.460885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.460893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.460895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.460897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.460899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.460902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.460906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.460909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.460912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.460915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.460918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.460920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.460923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.460925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.460927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.460938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:43.468981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:43.470676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:43.470693Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:43.470696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:43.470699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:43.470706Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1831 [1:7556534637001166707:10183]
2025-10-02T08:13:43.470718Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:43.470735Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:43.470738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.470742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.470744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.470761Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:43.470766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:43.470773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:43.470831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.470833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.470837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:43.470839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:43.470903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:43.470905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.470918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.470928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:43.470943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534637001166695:10183]
2025-10-02T08:13:43.470945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534637001166695:10183]
2025-10-02T08:13:43.470951Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:43.470965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001166703:10184], now have 1 active actors on pipe
2025-10-02T08:13:43.470965Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:43.470968Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:43.470973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:43.470986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:43.470989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:43.470988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1831
2025-10-02T08:13:43.470994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534637460859046:2378], now have 1 active actors on pipe
2025-10-02T08:13:43.471026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.471030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.471044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534637001166695:10183]
2025-10-02T08:13:43.471051Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:43.471075Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:43.471075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:43.471081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.471084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.471086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:43.471095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.471104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:43.471127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.471107Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1831
2025-10-02T08:13:43.471154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.471164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.471178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.471223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1832 partition: 0 MaxSeqNo: 17 sessionId: src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0
2025-10-02T08:13:43.471797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52e64f1c-8ea5af6f-365c4db7-6e9718cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:43.474364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0] Write session: try to update token
2025-10-02T08:13:43.474385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:43.494986Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:43.495012Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:43.495015Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:43.495025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534637001166695:10183]
2025-10-02T08:13:43.495030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534637001166695:10183]
2025-10-02T08:13:43.495075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:43.495083Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:43.495087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.495088Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:43.495089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:43.495233Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:43.496137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId: src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:43.498993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:43.544786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534637001166749:10829]
2025-10-02T08:13:43.544962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1831, pipe: [1:7556534637001166749:10829]
2025-10-02T08:13:43.638254Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:43.638673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.638686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.638726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001166749:10829], now have 1 active actors on pipe
2025-10-02T08:13:43.638997Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:43.639367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:43.639426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1832 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0
2025-10-02T08:13:43.639585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1832 sessionId: src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0 is DEAD
2025-10-02T08:13:43.639632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534637001166749:10829]
2025-10-02T08:13:43.639740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:43.639752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0] Write session will restart in 0.007152s
2025-10-02T08:13:43.639776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0] Write session: Do CDS request
2025-10-02T08:13:43.639785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:43.639544Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:43.648275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.648347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:43.648367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1833
2025-10-02T08:13:43.648512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.648559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:43.648568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:43.648572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:43.648926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1833 sessionId:  describe result for acl check
2025-10-02T08:13:43.648951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:43.648952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:43.648953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:43.648957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534637001166955:10152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:43.649466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534637001166955:10152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:43.652219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534637001166955:10152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:43.655357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534637001166955:10152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:43.655371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534637001166955:10152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:43.655373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534637001166955:10152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:43.655380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:43.661274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:43.662190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:43.662368Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:43.662372Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:43.662381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:43.662425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:43.662459Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534637001167121:10171]
2025-10-02T08:13:43.663116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:43.663373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:43.663424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:43.663747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:43.663786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.663787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.663789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.663790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.663791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.663796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.663806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.663810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.663815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.663819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.663824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.663831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.663837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.663843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.663847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.663852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.663857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.663862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.663870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.663876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.663895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:43.677349Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1832
2025-10-02T08:13:43.674505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:43.676432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:43.676437Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:43.676440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:43.676444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:43.676451Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1832 [1:7556534637001167121:10171]
2025-10-02T08:13:43.676465Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:43.676482Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:43.676486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.676489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.676491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.676506Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:43.676511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:43.676518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:43.676576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.676578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.676582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:43.676584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:43.676655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:43.676657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.676672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.676686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:43.676701Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534637001167115:10171]
2025-10-02T08:13:43.676704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534637001167115:10171]
2025-10-02T08:13:43.676720Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:43.676733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:43.676747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:43.676750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:43.676758Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:43.676762Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:43.676784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534637001167115:10171]
2025-10-02T08:13:43.676787Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:43.676841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:43.676853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1832
2025-10-02T08:13:43.679150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001167100:10152], now have 1 active actors on pipe
2025-10-02T08:13:43.679164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534637460859064:2378], now have 1 active actors on pipe
2025-10-02T08:13:43.679169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.679174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.679217Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:43.679225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.679230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.679232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:43.679251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.679263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:43.679285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.679419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.679425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.679441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.679473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1833 partition: 0 MaxSeqNo: 17 sessionId: src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0
2025-10-02T08:13:43.681087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5cf2bd6-4a00b668-5ebc0f75-84334ead_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:43.683770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0] Write session: try to update token
2025-10-02T08:13:43.683785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:43.696227Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:43.696252Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:43.696255Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:43.696264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534637001167115:10171]
2025-10-02T08:13:43.696272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534637001167115:10171]
2025-10-02T08:13:43.696313Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:43.696320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:43.696327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.696329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:43.696341Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:43.696485Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:43.699016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId: src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:43.701819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:43.739210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534637001167147:10829]
2025-10-02T08:13:43.739355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1832, pipe: [1:7556534637001167147:10829]
2025-10-02T08:13:43.844071Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:43.844499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.844516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.844555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001167147:10829], now have 1 active actors on pipe
2025-10-02T08:13:43.844834Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:43.844660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:43.844669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:43.844721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1833 reason: error at write: Disconnected sessionId: src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0
2025-10-02T08:13:43.844810Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:43.844893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1833 sessionId: src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0 is DEAD
2025-10-02T08:13:43.845049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534637001167147:10829]
2025-10-02T08:13:43.848883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:43.848893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0] Write session will restart in 0.008766s
2025-10-02T08:13:43.848921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0] Write session: Do CDS request
2025-10-02T08:13:43.848927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:43.857640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:43.858875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:43.859094Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:43.859104Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:43.859114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:43.859175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:43.859217Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534637001167485:10149]
2025-10-02T08:13:43.859318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.859393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:43.859406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1834
2025-10-02T08:13:43.859572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:43.859604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:43.859614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:43.859617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:43.859848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:43.859970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1834 sessionId:  describe result for acl check
2025-10-02T08:13:43.860004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:43.860011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:43.860013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:43.860019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534637001167494:10143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:43.860031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:43.860067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:43.860380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:43.860426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.860433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.860434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.860435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.860436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.860441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.860451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.860455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.860460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.860471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534637001167494:10143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:43.860478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.860484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.860492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:43.860502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.860508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:43.860517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.860522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:43.860529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.860534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.860539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.860544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.860563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:43.862572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534637001167494:10143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:43.867970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534637001167494:10143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:43.867991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534637001167494:10143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:43.867995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534637001167494:10143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:43.868003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:43.869112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:43.870906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:43.870927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:43.870930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:43.870933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:43.870940Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1833 [1:7556534637001167485:10149]
2025-10-02T08:13:43.870957Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:43.870976Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:43.870980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.870983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.870985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.871001Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:43.871007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:43.871014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:43.871086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.871094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.871097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:43.871100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:43.871173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:43.871183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.871198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:43.871214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:43.871232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1833
2025-10-02T08:13:43.871239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001167533:10143], now have 1 active actors on pipe
2025-10-02T08:13:43.871243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534637460859073:2378], now have 1 active actors on pipe
2025-10-02T08:13:43.871249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534637001167479:10149]
2025-10-02T08:13:43.871251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534637001167479:10149]
2025-10-02T08:13:43.871262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:43.871271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.871275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.871284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:43.871294Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:43.871294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:43.871309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:43.871313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:43.871296Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1833
2025-10-02T08:13:43.871362Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e6f5b17-efe23344-3468b420-26c778df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:43.871374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:43.871379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:43.871386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:43.871395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:43.871408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:43.871421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534637001167479:10149]
2025-10-02T08:13:43.871432Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:43.871437Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:43.871465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.871552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:43.871560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:43.871573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:43.871612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1834 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e6f5b17-efe23344-3468b420-26c778df_0
2025-10-02T08:13:43.871943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc92dba-a6f1d0fd-bec644a6-fe08b22_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e6f5b17-efe23344-3468b420-26c778df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:43.874731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6f5b17-efe23344-3468b420-26c778df_0] Write session: try to update token
2025-10-02T08:13:43.874748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6f5b17-efe23344-3468b420-26c778df_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:43.889411Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:43.889434Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:43.889436Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:43.889445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534637001167479:10149]
2025-10-02T08:13:43.889449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534637001167479:10149]
2025-10-02T08:13:43.889487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:43.889493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:43.889500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:43.889500Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:43.889502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:43.889653Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:43.889791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId: src_id|8e6f5b17-efe23344-3468b420-26c778df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:43.892582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:43.945034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534637001167546:10829]
2025-10-02T08:13:43.945146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1833, pipe: [1:7556534637001167546:10829]
2025-10-02T08:13:44.037873Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:44.038157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.038169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.038208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534637001167546:10829], now have 1 active actors on pipe
2025-10-02T08:13:44.038312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:44.038332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:44.038392Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:44.038421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1834 reason: error at write: Disconnected sessionId: src_id|8e6f5b17-efe23344-3468b420-26c778df_0
2025-10-02T08:13:44.038414Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:44.038597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1834 sessionId: src_id|8e6f5b17-efe23344-3468b420-26c778df_0 is DEAD
2025-10-02T08:13:44.038714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6f5b17-efe23344-3468b420-26c778df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:44.038733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6f5b17-efe23344-3468b420-26c778df_0] Write session will restart in 0.006577s
2025-10-02T08:13:44.038721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534637001167546:10829]
2025-10-02T08:13:44.038760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6f5b17-efe23344-3468b420-26c778df_0] Write session: Do CDS request
2025-10-02T08:13:44.038766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6f5b17-efe23344-3468b420-26c778df_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:44.046244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6f5b17-efe23344-3468b420-26c778df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.046310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:44.046325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1835
2025-10-02T08:13:44.046425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.046448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:44.046455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:44.046457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:44.047033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1835 sessionId:  describe result for acl check
2025-10-02T08:13:44.047072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:44.047091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:44.047099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:44.047105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534641296135126:10126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:44.047540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534641296135126:10126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:44.049764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:44.050047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534641296135126:10126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:44.050718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:44.050868Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:44.050876Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:44.050883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:44.050915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:44.050944Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534641296135212:10127]
2025-10-02T08:13:44.051365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:44.051551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:44.051607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:44.051926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:44.051968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.051974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.051975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.051976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.051977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.051983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.051992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.051995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.051997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.051999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.052003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.052007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.052011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.052013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.052016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.052019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.052021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.052023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.052026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.052031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.052048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:44.053028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534641296135126:10126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:44.053044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534641296135126:10126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:44.053048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534641296135126:10126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:44.053057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:44.060776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:44.062373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:44.062393Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:44.062399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:44.062402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:44.062409Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1834 [1:7556534641296135212:10127]
2025-10-02T08:13:44.062423Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:44.062440Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:44.062442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.062445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.062448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.062464Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:44.062469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:44.062480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:44.062547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.062557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.062560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:44.062562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:44.062625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:44.062632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.062645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.062656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:44.062670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534641296135196:10127]
2025-10-02T08:13:44.062678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534641296135196:10127]
2025-10-02T08:13:44.062693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:44.062713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:44.062732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:44.062735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:44.062752Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:44.062755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:44.062766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534641296135196:10127]
2025-10-02T08:13:44.062768Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:44.062819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1834
2025-10-02T08:13:44.062827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296135229:10126], now have 1 active actors on pipe
2025-10-02T08:13:44.062837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:44.062908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.062918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.062932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534641755826375:2378], now have 1 active actors on pipe
2025-10-02T08:13:44.062948Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db9d60ab-5965b791-2253db24-26a1954e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:44.062959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.062962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.062968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:44.062978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.062990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:44.063008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.063077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.063086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.063099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.063134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1835 partition: 0 MaxSeqNo: 17 sessionId: src_id|db9d60ab-5965b791-2253db24-26a1954e_0
2025-10-02T08:13:44.063122Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1834
2025-10-02T08:13:44.063444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e6f5b17-efe23344-3468b420-26c778df_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|db9d60ab-5965b791-2253db24-26a1954e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:44.066009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9d60ab-5965b791-2253db24-26a1954e_0] Write session: try to update token
2025-10-02T08:13:44.066024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9d60ab-5965b791-2253db24-26a1954e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:44.079030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId: src_id|db9d60ab-5965b791-2253db24-26a1954e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:44.080790Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:44.080796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:44.080818Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:44.080827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534641296135196:10127]
2025-10-02T08:13:44.080831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534641296135196:10127]
2025-10-02T08:13:44.080872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:44.080876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:44.080878Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:44.080883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.080885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:44.081027Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:44.081634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:44.139075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534641296135242:10829]
2025-10-02T08:13:44.141221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1834, pipe: [1:7556534641296135242:10829]
2025-10-02T08:13:44.220340Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:44.221008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.221024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.221062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296135242:10829], now have 1 active actors on pipe
2025-10-02T08:13:44.221255Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:44.221334Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:44.221600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534641296135242:10829]
2025-10-02T08:13:44.221622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:44.221678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1835 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db9d60ab-5965b791-2253db24-26a1954e_0
2025-10-02T08:13:44.221838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1835 sessionId: src_id|db9d60ab-5965b791-2253db24-26a1954e_0 is DEAD
2025-10-02T08:13:44.221989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9d60ab-5965b791-2253db24-26a1954e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:44.221997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9d60ab-5965b791-2253db24-26a1954e_0] Write session will restart in 0.007416s
2025-10-02T08:13:44.222033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9d60ab-5965b791-2253db24-26a1954e_0] Write session: Do CDS request
2025-10-02T08:13:44.222039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9d60ab-5965b791-2253db24-26a1954e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:44.230295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9d60ab-5965b791-2253db24-26a1954e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.230327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:44.230344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1836
2025-10-02T08:13:44.230494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.230535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:44.230544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:44.230547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:44.230999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1836 sessionId:  describe result for acl check
2025-10-02T08:13:44.231030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:44.231036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:44.231038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:44.231042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534641296135579:10106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:44.233342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:44.233439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534641296135579:10106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:44.235122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:44.235291Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:44.235301Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:44.235312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:44.235355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:44.235390Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534641296135615:10105]
2025-10-02T08:13:44.236044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:44.236665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534641296135579:10106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:44.236773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:44.236837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:44.237135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:44.237178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.237184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.237185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.237186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.237187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.237193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.237202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.237206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.237210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.237214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.237219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.237226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.237232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.237237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.237242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.237250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.237255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.237260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.237265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.237272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.237295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:44.244008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534641296135579:10106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:44.244023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534641296135579:10106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:44.244026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534641296135579:10106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:44.244035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:44.245774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:44.247245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:44.247263Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:44.247266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:44.247270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:44.247276Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1835 [1:7556534641296135615:10105]
2025-10-02T08:13:44.247287Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:44.247304Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:44.247311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.247314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.247316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.247331Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:44.247341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:44.247347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:44.247414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.247422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.247425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:44.247428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:44.247492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:44.247500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.247514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.247526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:44.247547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296135658:10106], now have 1 active actors on pipe
2025-10-02T08:13:44.247556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1835
2025-10-02T08:13:44.247558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534641296135592:10105]
2025-10-02T08:13:44.247560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534641296135592:10105]
2025-10-02T08:13:44.247568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:44.247575Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:44.247577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534641755826383:2378], now have 1 active actors on pipe
2025-10-02T08:13:44.247577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:44.247584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:44.247600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:44.247607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:44.247615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.247619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.247657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534641296135592:10105]
2025-10-02T08:13:44.247664Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:44.247667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:44.247679Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:44.247690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.247694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.247698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:44.247658Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1835
2025-10-02T08:13:44.247706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.247718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:44.247764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.247806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.247812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.247824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.247861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1836 partition: 0 MaxSeqNo: 17 sessionId: src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0
2025-10-02T08:13:44.248181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9d60ab-5965b791-2253db24-26a1954e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:44.250611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0] Write session: try to update token
2025-10-02T08:13:44.250623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:44.263626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId: src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:44.265709Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:44.265727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:44.265730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:44.265739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534641296135592:10105]
2025-10-02T08:13:44.265743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534641296135592:10105]
2025-10-02T08:13:44.265786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:44.265785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:44.265791Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:44.265798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.265801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:44.265941Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:44.266043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:44.321339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534641296135678:10829]
2025-10-02T08:13:44.321513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1835, pipe: [1:7556534641296135678:10829]
2025-10-02T08:13:44.411622Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:44.412065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.412079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.412120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296135678:10829], now have 1 active actors on pipe
2025-10-02T08:13:44.412283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534641296135678:10829]
2025-10-02T08:13:44.412306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:44.412314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:44.412371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1836 reason: error at write: Disconnected sessionId: src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0
2025-10-02T08:13:44.412390Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:44.412351Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:44.412562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1836 sessionId: src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0 is DEAD
2025-10-02T08:13:44.412745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:44.412756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0] Write session will restart in 0.005544s
2025-10-02T08:13:44.413128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0] Write session: Do CDS request
2025-10-02T08:13:44.413140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:44.420506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.420515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:44.420529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1837
2025-10-02T08:13:44.420729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.420762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:44.420771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:44.420775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:44.421249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1837 sessionId:  describe result for acl check
2025-10-02T08:13:44.421278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:44.421283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:44.421284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:44.421288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534641296135965:10069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:44.421771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534641296135965:10069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:44.424663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534641296135965:10069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:44.425572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:44.425890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:44.426000Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:44.426006Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:44.426013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:44.426042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:44.426066Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534641296136052:10081]
2025-10-02T08:13:44.426475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:44.426644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:44.426677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:44.426908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:44.426951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.426956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.426957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.426958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.426959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.426964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.426973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.426977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.426981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.426985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.426992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.427000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.427008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.427013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.427021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.427027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.427034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.427038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.427043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.427048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.427067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:44.427212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534641296135965:10069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:44.427226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534641296135965:10069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:44.427229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534641296135965:10069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:44.427236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:44.434886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:44.436458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:44.436474Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:44.436477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:44.436480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:44.436486Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1836 [1:7556534641296136052:10081]
2025-10-02T08:13:44.436498Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:44.436513Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:44.436520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.436523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.436525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.436538Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:44.436546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:44.436552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:44.436614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.436620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.436622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:44.436625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:44.436688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:44.436694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.436705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.436718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:44.436733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534641296136046:10081]
2025-10-02T08:13:44.436738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534641296136046:10081]
2025-10-02T08:13:44.436745Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:44.436753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1836
2025-10-02T08:13:44.436754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:44.436757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296136069:10069], now have 1 active actors on pipe
2025-10-02T08:13:44.436757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:44.436765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:44.436776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:44.436783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:44.436789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534641755826411:2378], now have 1 active actors on pipe
2025-10-02T08:13:44.436794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.436820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.436866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534641296136046:10081]
2025-10-02T08:13:44.436873Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:44.436885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:44.436849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1836
2025-10-02T08:13:44.436889Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9513929-67f17a2-72382cea-aa036ae3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:44.436894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.436898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.436900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:44.436907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.436915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:44.436958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.437030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.437037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.437050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.437087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1837 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9513929-67f17a2-72382cea-aa036ae3_0
2025-10-02T08:13:44.437390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f4fa9f-53da9e2d-73c8890d-44cd8c20_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9513929-67f17a2-72382cea-aa036ae3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:44.440037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9513929-67f17a2-72382cea-aa036ae3_0] Write session: try to update token
2025-10-02T08:13:44.440052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9513929-67f17a2-72382cea-aa036ae3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:44.447476Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:44.447494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:44.447502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534641296136046:10081]
2025-10-02T08:13:44.447542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:44.447542Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:44.447703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:44.447845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:44.447985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:44.448151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:44.448354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:44.448397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:44.454386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId: src_id|c9513929-67f17a2-72382cea-aa036ae3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:44.457025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:44.457087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.457097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.457130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:44.457159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:44.457207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.457219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.457406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.457488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.457552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.457612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.457880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.457890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.457961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.458026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.458086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.458153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.458194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.458201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.458270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.458337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.458410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.458479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.458547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.458554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.458628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.458694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.458764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.458839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.458894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.458901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.458989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.459060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.459137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.459214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.459269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.459276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.459362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.459426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.459494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.459561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.459614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.459622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.459694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.459754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.459827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.459898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.459945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.459951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.460019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.460074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.460137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.460209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.460259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.460264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.460333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.460399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.460461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.460522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.460570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.460576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.460653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:44.460710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:44.460763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:44.460843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:44.460890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:44.460898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:44.460938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:44.461001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.461024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.461027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:44.461056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:44.461068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:44.461073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:44.461076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:44.461078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:44.461490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:44.461516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:44.461522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:44.461525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:44.461527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:44.461530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:44.462158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:44.462179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:44.462184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:44.462186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:44.462188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:44.462192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:44.462616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:44.462637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:44.462642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:44.462644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:44.462646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:44.463852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:44.463868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:44.463883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392824463
2025-10-02T08:13:44.464056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:44.464070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:44.464076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:44.464079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:44.464083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:44.464086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:44.464580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:44.464603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:44.464608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:44.464613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:44.464616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:44.464622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:44.465121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:44.465140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:44.465149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:44.465155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:44.465159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:44.465163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:44.465627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:44.465649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:44.465654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:44.466832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:44.466849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:44.466854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:44.466861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:44.466870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392824466
2025-10-02T08:13:44.467168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:44.467190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:44.467196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:44.467199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:44.467203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:44.467207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:44.467665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:44.467683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:44.467691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:44.467695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:44.467699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:44.467702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:44.468162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:44.468181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.468296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392824468
2025-10-02T08:13:44.469083Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:44.469115Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:44.469122Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:44.469131Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:44.470843Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:44.470853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:44.470855Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:44.470864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534641296136046:10081]
2025-10-02T08:13:44.470868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534641296136046:10081]
2025-10-02T08:13:44.470930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:44.470940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.470943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:44.471016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:44.471030Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:44.471083Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:44.512315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534641296136091:10829]
2025-10-02T08:13:44.512561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1836, pipe: [1:7556534641296136091:10829]
2025-10-02T08:13:44.611415Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:44.611800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296136091:10829], now have 1 active actors on pipe
2025-10-02T08:13:44.611970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534641296136091:10829]
2025-10-02T08:13:44.611990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:44.611996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:44.612016Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:44.612017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1837 reason: error at write: Disconnected sessionId: src_id|c9513929-67f17a2-72382cea-aa036ae3_0
2025-10-02T08:13:44.612161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1837 sessionId: src_id|c9513929-67f17a2-72382cea-aa036ae3_0 is DEAD
2025-10-02T08:13:44.612388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9513929-67f17a2-72382cea-aa036ae3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:44.612399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9513929-67f17a2-72382cea-aa036ae3_0] Write session will restart in 0.006554s
2025-10-02T08:13:44.612423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9513929-67f17a2-72382cea-aa036ae3_0] Write session: Do CDS request
2025-10-02T08:13:44.612428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9513929-67f17a2-72382cea-aa036ae3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:44.612178Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:44.620311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9513929-67f17a2-72382cea-aa036ae3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.620375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:44.620390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1838
2025-10-02T08:13:44.620551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.620594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:44.620604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:44.620608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:44.621073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1838 sessionId:  describe result for acl check
2025-10-02T08:13:44.621107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:44.621113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:44.621115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:44.621120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534641296136378:10074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:44.621889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534641296136378:10074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:44.624360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534641296136378:10074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:44.626126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:44.626537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:44.626755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534641296136378:10074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:44.626766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534641296136378:10074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:44.626770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534641296136378:10074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:44.626778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:44.626917Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:44.626930Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:44.626953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:44.627027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:44.627066Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534641296136481:10073]
2025-10-02T08:13:44.627646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:44.627836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:44.627883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:44.628185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:44.628262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.628268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.628269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.628269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.628271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.628275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.628284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.628287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.628290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.628294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.628299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.628307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.628312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.628317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.628321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.628325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.628329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.628334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.628338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.628348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.628365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:44.636580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:44.638395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:44.638412Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:44.638415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:44.638419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:44.638426Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1837 [1:7556534641296136481:10073]
2025-10-02T08:13:44.638439Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:44.638458Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:44.638461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.638463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.638465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.638482Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:44.638487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:44.638493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:44.638567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.638575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.638579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:44.638582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:44.638653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:44.638660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.638673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.638688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:44.638707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1837
2025-10-02T08:13:44.638713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296136480:10074], now have 1 active actors on pipe
2025-10-02T08:13:44.638717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534641755826430:2378], now have 1 active actors on pipe
2025-10-02T08:13:44.638726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534641296136472:10073]
2025-10-02T08:13:44.638728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534641296136472:10073]
2025-10-02T08:13:44.638743Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:44.638753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.638759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.638764Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:44.638767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:44.638777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:44.638795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:44.638803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:44.638845Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:44.638857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.638861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.638863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:44.638873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.638850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1837
2025-10-02T08:13:44.638883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:44.638893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534641296136472:10073]
2025-10-02T08:13:44.638901Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:44.638911Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:44.638928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.639004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.639011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.639025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.639066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1838 partition: 0 MaxSeqNo: 17 sessionId: src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0
2025-10-02T08:13:44.639391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9513929-67f17a2-72382cea-aa036ae3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:44.641892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0] Write session: try to update token
2025-10-02T08:13:44.641906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:44.655483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId: src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:44.656825Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:44.656836Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:44.656838Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:44.656848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534641296136472:10073]
2025-10-02T08:13:44.656852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534641296136472:10073]
2025-10-02T08:13:44.656894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:44.656903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.656905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:44.656905Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:44.656911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:44.657030Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:44.658195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:44.712537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534641296136513:10829]
2025-10-02T08:13:44.712702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1837, pipe: [1:7556534641296136513:10829]
2025-10-02T08:13:44.795781Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:44.796152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.796170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.796224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296136513:10829], now have 1 active actors on pipe
2025-10-02T08:13:44.796343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:44.796353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:44.796411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1838 reason: error at write: Disconnected sessionId: src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0
2025-10-02T08:13:44.796435Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:44.796476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:44.796578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1838 sessionId: src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0 is DEAD
2025-10-02T08:13:44.796720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:44.796725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0] Write session will restart in 0.009279s
2025-10-02T08:13:44.796742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0] Write session: Do CDS request
2025-10-02T08:13:44.796747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:44.796754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534641296136513:10829]
2025-10-02T08:13:44.807361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.807388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:44.807413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1839
2025-10-02T08:13:44.807580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.807616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:44.807625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:44.807629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:44.808026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1839 sessionId:  describe result for acl check
2025-10-02T08:13:44.808062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:44.808063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:44.808065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:44.808070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534641296136767:10056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:44.808634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534641296136767:10056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:44.811441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534641296136767:10056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:44.812503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:44.813797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:44.813980Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:44.813992Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:44.814004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:44.814081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:44.814118Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534641296136890:10062]
2025-10-02T08:13:44.814178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534641296136767:10056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:44.814188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534641296136767:10056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:44.814192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534641296136767:10056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:44.814199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:44.814728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:44.814952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:44.815001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:44.815289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:44.815320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.815325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.815325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.815326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.815327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.815330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.815336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.815339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.815340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.815342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.815346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.815351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.815355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.815357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.815360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.815363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.815366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.815368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.815372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.815374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.815386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:44.823679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:44.825491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:44.825513Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:44.825516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:44.825520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:44.825527Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1838 [1:7556534641296136890:10062]
2025-10-02T08:13:44.825540Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:44.825558Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:44.825562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.825565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.825567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.825583Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:44.825593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:44.825602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:44.825668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.825676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.825679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:44.825681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:44.825748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:44.825756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.825771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.825783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:44.825795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1838
2025-10-02T08:13:44.825801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296136895:10056], now have 1 active actors on pipe
2025-10-02T08:13:44.825805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534641755826439:2378], now have 1 active actors on pipe
2025-10-02T08:13:44.825811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534641296136884:10062]
2025-10-02T08:13:44.825813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534641296136884:10062]
2025-10-02T08:13:44.825824Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:44.825835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.825837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:44.825840Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:44.825839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.825858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:44.825872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:44.825875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:44.825921Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|397581b0-7ec3c5c0-db969428-86019ddc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:44.825932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:44.825936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:44.825937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:44.825946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:44.825959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:44.825971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534641296136884:10062]
2025-10-02T08:13:44.825983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:44.825999Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:44.826012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.826096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.826105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.826120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:44.826163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1839 partition: 0 MaxSeqNo: 17 sessionId: src_id|397581b0-7ec3c5c0-db969428-86019ddc_0
2025-10-02T08:13:44.826220Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1838
2025-10-02T08:13:44.826478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c2e7653-206a536a-cd41a1f5-a74b4243_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|397581b0-7ec3c5c0-db969428-86019ddc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:44.829004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397581b0-7ec3c5c0-db969428-86019ddc_0] Write session: try to update token
2025-10-02T08:13:44.829020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397581b0-7ec3c5c0-db969428-86019ddc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:44.843540Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:44.843559Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:44.843561Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:44.843570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534641296136884:10062]
2025-10-02T08:13:44.843575Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534641296136884:10062]
2025-10-02T08:13:44.843615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:44.843619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:44.843623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.843626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:44.843633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:44.843764Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:44.849685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId: src_id|397581b0-7ec3c5c0-db969428-86019ddc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:44.852375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:44.896796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534641296136922:10829]
2025-10-02T08:13:44.897307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1838, pipe: [1:7556534641296136922:10829]
2025-10-02T08:13:44.977157Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:44.977393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:44.977403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:44.977434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296136922:10829], now have 1 active actors on pipe
2025-10-02T08:13:44.977574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534641296136922:10829]
2025-10-02T08:13:44.977600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:44.977604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:44.977611Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:44.977667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1839 reason: error at write: Disconnected sessionId: src_id|397581b0-7ec3c5c0-db969428-86019ddc_0
2025-10-02T08:13:44.977662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:44.977825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1839 sessionId: src_id|397581b0-7ec3c5c0-db969428-86019ddc_0 is DEAD
2025-10-02T08:13:44.977955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397581b0-7ec3c5c0-db969428-86019ddc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:44.977963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397581b0-7ec3c5c0-db969428-86019ddc_0] Write session will restart in 0.005805s
2025-10-02T08:13:44.977987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397581b0-7ec3c5c0-db969428-86019ddc_0] Write session: Do CDS request
2025-10-02T08:13:44.977993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397581b0-7ec3c5c0-db969428-86019ddc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:44.985239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397581b0-7ec3c5c0-db969428-86019ddc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.985328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:44.985341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1840
2025-10-02T08:13:44.985438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:44.985463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:44.985470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:44.985486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:44.985865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1840 sessionId:  describe result for acl check
2025-10-02T08:13:44.985898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:44.985904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:44.985906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:44.985911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534641296137145:10046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:44.986381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534641296137145:10046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:44.988783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534641296137145:10046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:44.990402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:44.991660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:44.991899Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:44.991908Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:44.991916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:44.991956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:44.991986Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534641296137297:10048]
2025-10-02T08:13:44.991996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534641296137145:10046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:44.992002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534641296137145:10046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:44.992005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534641296137145:10046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:44.992013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:44.992568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:44.992734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:44.992767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:44.993057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:44.993092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.993097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.993098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.993099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.993100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.993104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.993112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.993115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.993118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.993122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.993126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.993132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:44.993138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.993142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:44.993145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.993150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:44.993154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.993157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:44.993161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.993165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:44.993180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:45.001280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:45.002982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:45.002996Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:45.002999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:45.003003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:45.003009Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1839 [1:7556534641296137297:10048]
2025-10-02T08:13:45.003021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:45.003037Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:45.003045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.003048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.003050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.003065Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:45.003073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:45.003078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:45.003141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.003148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.003151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:45.003154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:45.003226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:45.003234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.003246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.003259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:45.003278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534641296137302:10046], now have 1 active actors on pipe
2025-10-02T08:13:45.003280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1839
2025-10-02T08:13:45.003289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534641296137291:10048]
2025-10-02T08:13:45.003291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534641296137291:10048]
2025-10-02T08:13:45.003304Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:45.003314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534641755826446:2378], now have 1 active actors on pipe
2025-10-02T08:13:45.003318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.003318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:45.003321Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:45.003322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.003339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:45.003353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:45.003355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:45.003399Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:45.003410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.003418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.003420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:45.003428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.003440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:45.003453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534641296137291:10048]
2025-10-02T08:13:45.003464Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:45.003476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:45.003499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.003580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.003587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.003602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.003639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1840 partition: 0 MaxSeqNo: 17 sessionId: src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0
2025-10-02T08:13:45.003982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397581b0-7ec3c5c0-db969428-86019ddc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:45.003390Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1839
2025-10-02T08:13:45.006734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0] Write session: try to update token
2025-10-02T08:13:45.006752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:45.021107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId: src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:45.024052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:45.024141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.024156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.024193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:45.024235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:45.024610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.024628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.024863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.024967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.025052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.025128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.025402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.025417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.025494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.025604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.025676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.025755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.025808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.025817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.025896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.025967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.026075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.026185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.026247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.026255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.026328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.026403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.026485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.026566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.026623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.026632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.026711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.026787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.026864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.026944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.026999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.027006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.027087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.027162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.027241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.027318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.027373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.027382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.027465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.027538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.027620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.027698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.027752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.027759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.027842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.027916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.027995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.028073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.028126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.028133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.028224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.028291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.028357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.028427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.028480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.028488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.028565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:45.028634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:45.028701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:45.028772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:45.028849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:45.028857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:45.028933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:45.029005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.029030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.029037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:45.029070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:45.029088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:45.029098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:45.029101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:45.029104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:45.029555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:45.029582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:45.029589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:45.029595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:45.029599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:45.029602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:45.030309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:45.030334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:45.030341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:45.030345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:45.030349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:45.030354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:45.030957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:45.030983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:45.031014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:45.031023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:45.031026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:45.032427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:45.032447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:45.032461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392825031
2025-10-02T08:13:45.032591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:45.032611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:45.032620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:45.032624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:45.032628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:45.032632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:45.033176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:45.033206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:45.033213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:45.033217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:45.033223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:45.033228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:45.033728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:45.033751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:45.033761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:45.033767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:45.033770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:45.033774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:45.034283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:45.034304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:45.034310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:45.035475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:45.035494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:45.035500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:45.035504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:45.035514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392825035
2025-10-02T08:13:45.035833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:45.035857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:45.035864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:45.035868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:45.035876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:45.035879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:45.036403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:45.036432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:45.036439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:45.036444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:45.036448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:45.036451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:45.036956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:45.036976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.037085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392825037
2025-10-02T08:13:45.039650Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:45.039678Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:45.039686Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:45.039695Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:45.039705Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:45.039712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:45.039714Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:45.039723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534641296137291:10048]
2025-10-02T08:13:45.039726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534641296137291:10048]
2025-10-02T08:13:45.039780Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:45.039793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:45.046601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:45.046621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.046623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:45.046787Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:45.077617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534645591104628:10829]
2025-10-02T08:13:45.077751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1839, pipe: [1:7556534645591104628:10829]
2025-10-02T08:13:45.199898Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:45.200299Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:45.200307Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:45.200318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534641296137291:10048]
2025-10-02T08:13:45.200376Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:45.200401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591104628:10829], now have 1 active actors on pipe
2025-10-02T08:13:45.200604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534645591104628:10829]
2025-10-02T08:13:45.200627Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:45.200631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:45.200634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:45.200667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1840 reason: error at write: Disconnected sessionId: src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0
2025-10-02T08:13:45.200741Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:45.200860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1840 sessionId: src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0 is DEAD
2025-10-02T08:13:45.201213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:45.201224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0] Write session will restart in 0.007629s
2025-10-02T08:13:45.201247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0] Write session: Do CDS request
2025-10-02T08:13:45.201253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:45.206019Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0dafa69474949db3] Result# TEvPutResult {Id# [72075186224037892:1839:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:45.206044Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1839:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:45.206102Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1839:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:45.210322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.210313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:45.210325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1841
2025-10-02T08:13:45.210523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.210553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:45.210565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:45.210568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:45.211056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1841 sessionId:  describe result for acl check
2025-10-02T08:13:45.211085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:45.211091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:45.211093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:45.211098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534645591104856:10035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:45.211664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534645591104856:10035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:45.215170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534645591104856:10035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:45.216410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:45.217446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:45.217725Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:45.217735Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:45.217747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:45.217800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534645591104856:10035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:45.217804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:45.217813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534645591104856:10035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:45.217816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534645591104856:10035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:45.217825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:45.217852Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534645591105012:10022]
2025-10-02T08:13:45.218567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:45.218734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:45.218782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:45.219066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:45.219118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.219124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.219125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.219126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.219127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.219131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.219141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.219150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.219153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.219156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.219164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.219172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.219182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.219191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.219201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.219210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.219218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.219230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.219238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.219245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.219266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:45.227724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:45.229369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:45.229387Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:45.229390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:45.229395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:45.229403Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1840 [1:7556534645591105012:10022]
2025-10-02T08:13:45.229416Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:45.229436Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:45.229440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.229443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.229450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.229466Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:45.229472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:45.229479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:45.229544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.229554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.229557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:45.229561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:45.229634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:45.229646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.229660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.229673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:45.229695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591105017:10035], now have 1 active actors on pipe
2025-10-02T08:13:45.229708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534645591105006:10022]
2025-10-02T08:13:45.229708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1840
2025-10-02T08:13:45.229710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534645591105006:10022]
2025-10-02T08:13:45.229719Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:45.229729Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:45.229732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534646050793750:2378], now have 1 active actors on pipe
2025-10-02T08:13:45.229737Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:45.229740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:45.229755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:45.229762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:45.229769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.229780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.229826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534645591105006:10022]
2025-10-02T08:13:45.229840Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:45.229854Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:45.229859Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:45.229868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.229872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.229823Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1840
2025-10-02T08:13:45.229874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:45.229883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.229892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:45.229940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.229998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.230006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.230019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.230062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1841 partition: 0 MaxSeqNo: 17 sessionId: src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0
2025-10-02T08:13:45.230453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|689fdfc3-a5206789-b23c5889-fb373fdc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:45.233245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0] Write session: try to update token
2025-10-02T08:13:45.233263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:45.248770Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:45.248784Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:45.248785Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:45.248792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534645591105006:10022]
2025-10-02T08:13:45.248796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534645591105006:10022]
2025-10-02T08:13:45.248856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:45.248856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:45.248862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:45.248871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.248873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:45.249014Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:45.285934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId: src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:45.288672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:45.300824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534645591105071:10829]
2025-10-02T08:13:45.300939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1840, pipe: [1:7556534645591105071:10829]
2025-10-02T08:13:45.390831Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:45.391317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.391327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.391342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591105071:10829], now have 1 active actors on pipe
2025-10-02T08:13:45.391437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:45.391444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:45.391495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1841 reason: error at write: Disconnected sessionId: src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0
2025-10-02T08:13:45.391571Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:45.391568Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:45.391657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1841 sessionId: src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0 is DEAD
2025-10-02T08:13:45.391781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:45.391783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534645591105071:10829]
2025-10-02T08:13:45.391798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0] Write session will restart in 0.005776s
2025-10-02T08:13:45.391823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0] Write session: Do CDS request
2025-10-02T08:13:45.391829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:45.398299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.398431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:45.398445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1842
2025-10-02T08:13:45.398570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.398605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:45.398615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:45.398618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:45.399085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1842 sessionId:  describe result for acl check
2025-10-02T08:13:45.399120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:45.399122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:45.399124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:45.399129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534645591105289:9992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:45.399691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534645591105289:9992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:45.403015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534645591105289:9992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:45.409318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534645591105289:9992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:45.409331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534645591105289:9992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:45.409334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534645591105289:9992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:45.409343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:45.409494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:45.410046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:45.410220Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:45.410230Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:45.410241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:45.410290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:45.410347Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534645591105468:9999]
2025-10-02T08:13:45.411009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:45.411222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:45.411266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:45.411604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:45.411659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.411666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.411667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.411669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.411670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.411676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.411687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.411691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.411696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.411700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.411705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.411712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.411719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.411725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.411731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.411736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.411740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.411748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.411757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.411762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.411783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:45.420916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:45.422522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:45.422539Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:45.422541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:45.422544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:45.422549Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1841 [1:7556534645591105468:9999]
2025-10-02T08:13:45.422558Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:45.422572Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:45.422574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.422576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.422577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.422589Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:45.422592Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:45.422597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:45.422652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.422658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.422660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:45.422662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:45.422721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:45.422727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.422736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.422743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:45.422755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534645591105457:9999]
2025-10-02T08:13:45.422760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534645591105457:9999]
2025-10-02T08:13:45.422765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:45.422776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591105459:9992], now have 1 active actors on pipe
2025-10-02T08:13:45.422779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1841
2025-10-02T08:13:45.422780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:45.422783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:45.422786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:45.422795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:45.422797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:45.422802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534646050793779:2378], now have 1 active actors on pipe
2025-10-02T08:13:45.422827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.422833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.422844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534645591105457:9999]
2025-10-02T08:13:45.422852Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:45.422859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:45.422872Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:45.422880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.422883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.422884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:45.422891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.422898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:45.422915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.422899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1841
2025-10-02T08:13:45.422963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.422968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.422983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.423016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1842 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0
2025-10-02T08:13:45.423319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8aa8b-bfb5157d-59b3eb39-5c65a34c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:45.425700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0] Write session: try to update token
2025-10-02T08:13:45.425714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:45.439288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId: src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:45.440434Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:45.440446Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:45.440448Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:45.440455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534645591105457:9999]
2025-10-02T08:13:45.440459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534645591105457:9999]
2025-10-02T08:13:45.440492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:45.440500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.440502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:45.440508Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:45.440513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:45.440640Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:45.441981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:45.491799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534645591105492:10829]
2025-10-02T08:13:45.491890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1841, pipe: [1:7556534645591105492:10829]
2025-10-02T08:13:45.580842Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:45.581122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.581135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.581167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591105492:10829], now have 1 active actors on pipe
2025-10-02T08:13:45.581297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534645591105492:10829]
2025-10-02T08:13:45.581320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:45.581323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:45.581377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1842 reason: error at write: Disconnected sessionId: src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0
2025-10-02T08:13:45.581517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1842 sessionId: src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0 is DEAD
2025-10-02T08:13:45.581468Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:45.581714Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:45.582040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:45.582050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0] Write session will restart in 0.009651s
2025-10-02T08:13:45.582078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0] Write session: Do CDS request
2025-10-02T08:13:45.582085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:45.593289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.593322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:45.593336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1843
2025-10-02T08:13:45.593490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.593528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:45.593537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:45.593540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:45.593995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1843 sessionId:  describe result for acl check
2025-10-02T08:13:45.594026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:45.594031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:45.594032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:45.594035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534645591105842:9983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:45.594426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534645591105842:9983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:45.595814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:45.597043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:45.597064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534645591105842:9983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:45.597347Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:45.597362Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:45.597374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:45.597434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:45.597471Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534645591105880:9984]
2025-10-02T08:13:45.598034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:45.598236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:45.598293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:45.598545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:45.598596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.598601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.598603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.598604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.598605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.598609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.598615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.598618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.598620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.598622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.598637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.598644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.598650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.598661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.598670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.598675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.598681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.598685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.598688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.598691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.598702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:45.604032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534645591105842:9983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:45.604048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534645591105842:9983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:45.604052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534645591105842:9983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:45.604060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:45.606897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:45.608441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:45.608454Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:45.608457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:45.608462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:45.608469Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1842 [1:7556534645591105880:9984]
2025-10-02T08:13:45.608483Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:45.608500Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:45.608505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.608509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.608511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.608529Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:45.608538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:45.608545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:45.608609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.608615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.608618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:45.608620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:45.608684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:45.608691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.608703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.608715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:45.608733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534645591105867:9984]
2025-10-02T08:13:45.608738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534645591105867:9984]
2025-10-02T08:13:45.608745Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:45.608757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:45.608763Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:45.608767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:45.608773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:45.608775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1842
2025-10-02T08:13:45.608776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:45.608785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591105905:9983], now have 1 active actors on pipe
2025-10-02T08:13:45.608794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534646050793798:2378], now have 1 active actors on pipe
2025-10-02T08:13:45.608845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.608852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.608865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534645591105867:9984]
2025-10-02T08:13:45.608875Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:45.608888Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:45.608901Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:45.608907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.608913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.608915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:45.608924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.608934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:45.608954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.608929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1842
2025-10-02T08:13:45.609045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.609051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.609064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.609099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1843 partition: 0 MaxSeqNo: 17 sessionId: src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0
2025-10-02T08:13:45.609417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d14c19e-7fcbf0a3-a2fab3bb-1d0e17d0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:45.612032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0] Write session: try to update token
2025-10-02T08:13:45.612053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:45.625317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId: src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:45.627626Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:45.627642Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:45.627644Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:45.627652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534645591105867:9984]
2025-10-02T08:13:45.627655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534645591105867:9984]
2025-10-02T08:13:45.627690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:45.627695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.627696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:45.627704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:45.627710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:45.627831Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:45.627893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:45.681233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534645591105936:10829]
2025-10-02T08:13:45.681326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1842, pipe: [1:7556534645591105936:10829]
2025-10-02T08:13:45.773242Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:45.773944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.773961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.774001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591105936:10829], now have 1 active actors on pipe
2025-10-02T08:13:45.774342Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:45.774226Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:45.774226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534645591105936:10829]
2025-10-02T08:13:45.774247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:45.774330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1843 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0
2025-10-02T08:13:45.774509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1843 sessionId: src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0 is DEAD
2025-10-02T08:13:45.775606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:45.775617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0] Write session will restart in 0.007798s
2025-10-02T08:13:45.775643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0] Write session: Do CDS request
2025-10-02T08:13:45.775651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:45.784300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.784377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:45.784391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1844
2025-10-02T08:13:45.785026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.785069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:45.785076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:45.785081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:45.785874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1844 sessionId:  describe result for acl check
2025-10-02T08:13:45.785910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:45.785912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:45.785914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:45.785918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534645591106089:9967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:45.786474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534645591106089:9967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:45.789256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534645591106089:9967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:45.796142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534645591106089:9967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:45.796157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534645591106089:9967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:45.796161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534645591106089:9967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:45.796169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:45.797026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:45.798730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:45.799090Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:45.799100Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:45.799109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:45.799159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:45.799195Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534645591106328:9973]
2025-10-02T08:13:45.799837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:45.800036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:45.800069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:45.800371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:45.800421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.800427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.800428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.800429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.800430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.800434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.800444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.800448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.800451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.800455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.800460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.800466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.800472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.800476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.800481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.800485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.800490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.800495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.800499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.800504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.800520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:45.809303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:45.810825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:45.810842Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:45.810845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:45.810848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:45.810854Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1843 [1:7556534645591106328:9973]
2025-10-02T08:13:45.810864Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:45.810880Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:45.810883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.810885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.810887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.810900Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:45.810904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:45.810910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:45.810960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.810967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.810969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:45.810971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:45.811028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:45.811034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.811044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.811051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:45.811068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534645591106322:9973]
2025-10-02T08:13:45.811074Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534645591106322:9973]
2025-10-02T08:13:45.811081Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:45.811091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:45.811103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:45.811109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:45.811136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534645591106322:9973]
2025-10-02T08:13:45.811141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:45.811152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591106310:9967], now have 1 active actors on pipe
2025-10-02T08:13:45.811152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1843
2025-10-02T08:13:45.811170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:45.811174Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:45.811181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:45.811195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.811203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.811218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534646050793807:2378], now have 1 active actors on pipe
2025-10-02T08:13:45.811237Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf72de3-afd46cb7-51a179de-2551142f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:45.811248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:45.811252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:45.811255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:45.811264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:45.811272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:45.811291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.811336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.811343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.811356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:45.811339Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1843
2025-10-02T08:13:45.811413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1844 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf72de3-afd46cb7-51a179de-2551142f_0
2025-10-02T08:13:45.811720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24ec601a-d6655aba-bccf472b-9aed28fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf72de3-afd46cb7-51a179de-2551142f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:45.814439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf72de3-afd46cb7-51a179de-2551142f_0] Write session: try to update token
2025-10-02T08:13:45.814455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf72de3-afd46cb7-51a179de-2551142f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:45.831783Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:45.831801Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:45.831803Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:45.831813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534645591106322:9973]
2025-10-02T08:13:45.831817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534645591106322:9973]
2025-10-02T08:13:45.831869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:45.831875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.831878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:45.831895Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:45.831904Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:45.832057Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:45.836876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId: src_id|cf72de3-afd46cb7-51a179de-2551142f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:45.839829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:45.874246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534645591106355:10829]
2025-10-02T08:13:45.874368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1843, pipe: [1:7556534645591106355:10829]
2025-10-02T08:13:45.973512Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:45.974152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:45.974162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:45.974202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591106355:10829], now have 1 active actors on pipe
2025-10-02T08:13:45.974446Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:45.974587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:45.974662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1844 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf72de3-afd46cb7-51a179de-2551142f_0
2025-10-02T08:13:45.974799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534645591106355:10829]
2025-10-02T08:13:45.974825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1844 sessionId: src_id|cf72de3-afd46cb7-51a179de-2551142f_0 is DEAD
2025-10-02T08:13:45.975134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf72de3-afd46cb7-51a179de-2551142f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:45.975146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf72de3-afd46cb7-51a179de-2551142f_0] Write session will restart in 0.007260s
2025-10-02T08:13:45.975170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf72de3-afd46cb7-51a179de-2551142f_0] Write session: Do CDS request
2025-10-02T08:13:45.975179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf72de3-afd46cb7-51a179de-2551142f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:45.975804Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:45.983268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf72de3-afd46cb7-51a179de-2551142f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.983584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:45.983595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1845
2025-10-02T08:13:45.984719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:45.984766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:45.984771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:45.984774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:45.985209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1845 sessionId:  describe result for acl check
2025-10-02T08:13:45.985244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:45.985248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:45.985249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:45.985255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534645591106528:9942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:45.985875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534645591106528:9942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:45.988914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534645591106528:9942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:45.993252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:45.993308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534645591106528:9942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:45.993321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534645591106528:9942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:45.993324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534645591106528:9942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:45.993333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:45.993695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:45.993837Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:45.993845Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:45.993852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:45.993895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:45.994042Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534645591106746:9943]
2025-10-02T08:13:45.994574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:45.994955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:45.995016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:45.995340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:45.995404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.995411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.995412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.995412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.995413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.995418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.995424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.995427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.995429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.995431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.995435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.995440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:45.995445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.995449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:45.995453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.995457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:45.995461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.995466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:45.995469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.995473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:45.995489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:46.003622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:46.005353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:46.005367Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:46.005370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:46.005374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:46.005381Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1844 [1:7556534645591106746:9943]
2025-10-02T08:13:46.005393Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:46.005410Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:46.005413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.005417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.005419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.005435Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:46.005440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:46.005447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:46.005514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.005522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.005525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:46.005527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:46.005592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:46.005599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.005612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.005628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:46.005650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534645591106741:9942], now have 1 active actors on pipe
2025-10-02T08:13:46.005654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1844
2025-10-02T08:13:46.005660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534645591106734:9943]
2025-10-02T08:13:46.005662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534645591106734:9943]
2025-10-02T08:13:46.005670Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:46.005680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:46.005684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:46.005686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:46.005698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:46.005706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:46.005713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534646050793815:2378], now have 1 active actors on pipe
2025-10-02T08:13:46.005719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.005727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.005767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534645591106734:9943]
2025-10-02T08:13:46.005778Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:46.005793Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:46.005799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.005808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.005810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:46.005819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.005828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:46.005830Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:46.005813Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1844
2025-10-02T08:13:46.005860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.005923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.005929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.005940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.005969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1845 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0
2025-10-02T08:13:46.006312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf72de3-afd46cb7-51a179de-2551142f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:46.009061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0] Write session: try to update token
2025-10-02T08:13:46.009075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:46.027025Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:46.027058Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:46.027069Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:46.027082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534645591106734:9943]
2025-10-02T08:13:46.027089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534645591106734:9943]
2025-10-02T08:13:46.027157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:46.027178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.027180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:46.027346Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:46.027642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId: src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:46.028865Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:46.028873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:46.030740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:46.074970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534649886074070:10829]
2025-10-02T08:13:46.075097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1844, pipe: [1:7556534649886074070:10829]
2025-10-02T08:13:46.172441Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:46.172725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.172740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.172781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886074070:10829], now have 1 active actors on pipe
2025-10-02T08:13:46.172938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534649886074070:10829]
2025-10-02T08:13:46.173000Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:46.173034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:46.173103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1845 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0
2025-10-02T08:13:46.173289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1845 sessionId: src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0 is DEAD
2025-10-02T08:13:46.173378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:46.173655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:46.173664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0] Write session will restart in 0.005673s
2025-10-02T08:13:46.173691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0] Write session: Do CDS request
2025-10-02T08:13:46.173698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:46.180285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.180355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:46.180369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1846
2025-10-02T08:13:46.180485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.180514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:46.180522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:46.180526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:46.181089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1846 sessionId:  describe result for acl check
2025-10-02T08:13:46.181122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:46.181128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:46.181129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:46.181135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534649886074298:9921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:46.181625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534649886074298:9921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:46.184861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534649886074298:9921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:46.188572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:46.188964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:46.189014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534649886074298:9921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:46.189026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534649886074298:9921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:46.189029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534649886074298:9921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:46.189039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:46.189210Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:46.189222Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:46.189234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:46.189318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:46.189357Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534649886074464:9934]
2025-10-02T08:13:46.190026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:46.190218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:46.190261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:46.190566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:46.190636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.190642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.190643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.190645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.190646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.190654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.190664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.190671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.190675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.190679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.190686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.190697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.190707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.190712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.190722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.190731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.190738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.190744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.190752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.190760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.190784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:46.198871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:46.200607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:46.200627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:46.200630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:46.200634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:46.200641Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1845 [1:7556534649886074464:9934]
2025-10-02T08:13:46.200654Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:46.200672Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:46.200675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.200678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.200680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.200699Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:46.200703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:46.200709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:46.200781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.200787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.200790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:46.200792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:46.200880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:46.200888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.200902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.200912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:46.200925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1845
2025-10-02T08:13:46.200929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886074462:9921], now have 1 active actors on pipe
2025-10-02T08:13:46.200936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534649886074454:9934]
2025-10-02T08:13:46.200938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534649886074454:9934]
2025-10-02T08:13:46.200944Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:46.200957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:46.200962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534650345761119:2378], now have 1 active actors on pipe
2025-10-02T08:13:46.200969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.200969Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:46.200973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.200989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:46.201004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:46.201007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:46.201048Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:46.201058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.201068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.201039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1845
2025-10-02T08:13:46.201074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:46.201083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.201091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:46.201115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534649886074454:9934]
2025-10-02T08:13:46.201126Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:46.201141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:46.201162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.201243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.201250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.201263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.201305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1846 partition: 0 MaxSeqNo: 17 sessionId: src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0
2025-10-02T08:13:46.201639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c24f228-334b26e0-9be8f9ee-a7f2f83_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:46.204245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0] Write session: try to update token
2025-10-02T08:13:46.204259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:46.217667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId: src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:46.220397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:46.220462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.220476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.222086Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:46.222103Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:46.222105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:46.222114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534649886074454:9934]
2025-10-02T08:13:46.222118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534649886074454:9934]
2025-10-02T08:13:46.222165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:46.222164Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:46.222171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:46.222189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:46.222197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.222200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:46.222346Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:46.222716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:46.273148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534649886074490:10829]
2025-10-02T08:13:46.273277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1845, pipe: [1:7556534649886074490:10829]
2025-10-02T08:13:46.361988Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:46.362293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.362307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.362460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.362520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.362572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.362628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.362674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.362681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.362756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.362814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.362866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.362919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.362959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.362961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.363023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.363072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.363122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.363187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.363228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.363232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.363298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.363359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.363420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.363480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.363523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.363525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.363596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.363657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.363724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.363787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.363829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.363831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.363900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.363956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.364017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.364079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.364123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.364127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.364218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.364297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.364357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.364417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.364459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.364461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.364531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.364597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.364674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.364739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.364780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.364782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.364881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.364939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.364996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.365059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.365125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.365133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.365207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.365271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.365333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.365403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.365470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.365477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.365541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886074490:10829], now have 1 active actors on pipe
2025-10-02T08:13:46.365657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534649886074490:10829]
2025-10-02T08:13:46.365697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:46.365699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:46.365727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1846 reason: error at write: Disconnected sessionId: src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0
2025-10-02T08:13:46.365769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:46.365861Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:46.365906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1846 sessionId: src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0 is DEAD
2025-10-02T08:13:46.366046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:46.366054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0] Write session will restart in 0.007655s
2025-10-02T08:13:46.366079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0] Write session: Do CDS request
2025-10-02T08:13:46.366085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:46.375301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.375353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:46.375368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1847
2025-10-02T08:13:46.377000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.377042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:46.377047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:46.377051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:46.377432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1847 sessionId:  describe result for acl check
2025-10-02T08:13:46.377454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:46.377456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:46.377458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:46.377462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534649886074845:9890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:46.378050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534649886074845:9890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:46.379939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534649886074845:9890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:46.380817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:46.382062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:46.382266Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:46.382276Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:46.382288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:46.382343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:46.382383Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534649886074919:9902]
2025-10-02T08:13:46.383060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:46.383205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534649886074845:9890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:46.383207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:46.383219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534649886074845:9890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:46.383223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534649886074845:9890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:46.383230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:46.383242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:46.383553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:46.383602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.383611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.383612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.383614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.383615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.383621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.383631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.383636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.383641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.383645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.383650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.383658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.383664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.383671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.383676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.383686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.383691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.383701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.383706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.383711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.383736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:46.392264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:46.393991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:46.394012Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:46.394014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:46.394018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:46.394026Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1846 [1:7556534649886074919:9902]
2025-10-02T08:13:46.394038Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:46.394057Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:46.394061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.394064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.394066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.394084Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:46.394089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:46.394101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:46.394171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.394178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.394181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:46.394184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:46.394252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:46.394260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.394279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.394294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:46.394316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534649886074913:9902]
2025-10-02T08:13:46.394328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534649886074913:9902]
2025-10-02T08:13:46.394337Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:46.394351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:46.394350Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:46.394354Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:46.394369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:46.394377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:46.394388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886074930:9890], now have 1 active actors on pipe
2025-10-02T08:13:46.394397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534650345761138:2378], now have 1 active actors on pipe
2025-10-02T08:13:46.394403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.394406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.394452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534649886074913:9902]
2025-10-02T08:13:46.394461Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:46.394471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:46.394436Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1846
2025-10-02T08:13:46.394477Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:46.394488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.394492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.394495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:46.394504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.394512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:46.394560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.394778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1846
2025-10-02T08:13:46.394857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.394864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.394880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.394924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1847 partition: 0 MaxSeqNo: 17 sessionId: src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0
2025-10-02T08:13:46.395258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136bd3fe-bfbc792b-7a623933-c7b8d983_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:46.397962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0] Write session: try to update token
2025-10-02T08:13:46.397981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:46.412217Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:46.412233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:46.412235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:46.412246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534649886074913:9902]
2025-10-02T08:13:46.412250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534649886074913:9902]
2025-10-02T08:13:46.412300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:46.412299Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:46.412306Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:46.412312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.412314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:46.412463Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:46.417579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId: src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:46.420609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:46.465603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534649886074949:10829]
2025-10-02T08:13:46.465698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1846, pipe: [1:7556534649886074949:10829]
2025-10-02T08:13:46.550244Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:46.550605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.550618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.550659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886074949:10829], now have 1 active actors on pipe
2025-10-02T08:13:46.550798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534649886074949:10829]
2025-10-02T08:13:46.550826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:46.550833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:46.550876Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:46.550891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1847 reason: error at write: Disconnected sessionId: src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0
2025-10-02T08:13:46.550922Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:46.552769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1847 sessionId: src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0 is DEAD
2025-10-02T08:13:46.552852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:46.552861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0] Write session will restart in 0.006568s
2025-10-02T08:13:46.552886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0] Write session: Do CDS request
2025-10-02T08:13:46.552893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:46.560243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.560370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:46.560383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1848
2025-10-02T08:13:46.560506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.560545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:46.560554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:46.560557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:46.560916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1848 sessionId:  describe result for acl check
2025-10-02T08:13:46.560945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:46.560950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:46.560952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:46.560957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534649886075287:9877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:46.561437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534649886075287:9877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:46.563167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534649886075287:9877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:46.565805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534649886075287:9877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:46.565820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534649886075287:9877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:46.565823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534649886075287:9877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:46.565830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:46.566719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:46.568038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:46.568175Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:46.568183Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:46.568189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:46.568236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:46.568264Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534649886075360:9876]
2025-10-02T08:13:46.568744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:46.568937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:46.568973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:46.569176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:46.569206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.569210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.569211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.569212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.569213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.569216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.569223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.569225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.569227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.569229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.569233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.569237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.569241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.569243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.569246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.569249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.569251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.569254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.569256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.569259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.569270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:46.577802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:46.579638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:46.579653Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:46.579655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:46.579658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:46.579663Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1847 [1:7556534649886075360:9876]
2025-10-02T08:13:46.579672Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:46.579688Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:46.579690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.579692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.579694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.579709Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:46.579714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:46.579722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:46.579790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.579796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.579798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:46.579800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:46.579849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:46.579854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.579864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.579871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:46.579883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534649886075354:9876]
2025-10-02T08:13:46.579885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534649886075354:9876]
2025-10-02T08:13:46.579890Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:46.579901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:46.579914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:46.579922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:46.579933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886075342:9877], now have 1 active actors on pipe
2025-10-02T08:13:46.579932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:46.579936Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:46.579947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1847
2025-10-02T08:13:46.579972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534649886075354:9876]
2025-10-02T08:13:46.579984Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:46.579993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:46.579998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534650345761166:2378], now have 1 active actors on pipe
2025-10-02T08:13:46.580003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.580011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.580056Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:46.580066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.580070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.580072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:46.580081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.580094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:46.580123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.580164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.580171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.580183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.580229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1848 partition: 0 MaxSeqNo: 17 sessionId: src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0
2025-10-02T08:13:46.580543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7567d9-2be1a3fd-be40377d-45f5edc8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:46.580076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1847
2025-10-02T08:13:46.583312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0] Write session: try to update token
2025-10-02T08:13:46.583326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:46.597863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId: src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:46.598836Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:46.598850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:46.598851Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:46.598857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534649886075354:9876]
2025-10-02T08:13:46.598861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534649886075354:9876]
2025-10-02T08:13:46.598891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:46.598896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.598897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:46.598934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:46.598954Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:46.599016Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:46.600447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:46.650951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534649886075387:10829]
2025-10-02T08:13:46.651091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1847, pipe: [1:7556534649886075387:10829]
2025-10-02T08:13:46.737435Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:46.737820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.737832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.737868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886075387:10829], now have 1 active actors on pipe
2025-10-02T08:13:46.737974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534649886075387:10829]
2025-10-02T08:13:46.738099Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:46.738112Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:46.738380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:46.738446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1848 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0
2025-10-02T08:13:46.738607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1848 sessionId: src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0 is DEAD
2025-10-02T08:13:46.741015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:46.741026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0] Write session will restart in 0.009362s
2025-10-02T08:13:46.741052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0] Write session: Do CDS request
2025-10-02T08:13:46.741059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:46.751293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.751384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:46.751399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1849
2025-10-02T08:13:46.751526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.751558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:46.751584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:46.751587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:46.752005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1849 sessionId:  describe result for acl check
2025-10-02T08:13:46.752040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:46.752047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:46.752048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:46.752053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534649886075748:9864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:46.752106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:46.752629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534649886075748:9864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:46.753317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:46.753497Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:46.753509Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:46.753521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:46.753588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:46.753628Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534649886075761:9863]
2025-10-02T08:13:46.754277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:46.754461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:46.754506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:46.754689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534649886075748:9864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:46.754807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:46.754853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.754859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.754860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.754861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.754862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.754867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.754877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.754882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.754885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.754889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.754894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.754902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.754907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.754912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.754916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.754922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.754927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.754932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.754943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.754948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.754964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:46.761297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534649886075748:9864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:46.761312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534649886075748:9864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:46.761315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534649886075748:9864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:46.761323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:46.763464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:46.765417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:46.765436Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:46.765439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:46.765443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:46.765449Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1848 [1:7556534649886075761:9863]
2025-10-02T08:13:46.765462Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:46.765480Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:46.765483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.765485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.765487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.765503Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:46.765514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:46.765521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:46.765588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.765597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.765600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:46.765603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:46.765672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:46.765680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.765695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.765707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:46.765731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886075800:9864], now have 1 active actors on pipe
2025-10-02T08:13:46.765739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1848
2025-10-02T08:13:46.765742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534649886075747:9863]
2025-10-02T08:13:46.765744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534649886075747:9863]
2025-10-02T08:13:46.765760Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:46.765775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534650345761174:2378], now have 1 active actors on pipe
2025-10-02T08:13:46.765786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:46.765800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:46.765808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:46.765815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.765820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.765819Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1848
2025-10-02T08:13:46.765856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:46.765865Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:46.765866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534649886075747:9863]
2025-10-02T08:13:46.765870Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:46.765872Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:46.765885Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:46.765896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.765904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.765906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:46.765925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.765943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:46.765990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.766102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.766111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.766126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.766170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1849 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0
2025-10-02T08:13:46.766502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3ed8b96-676b8842-6bd3c70f-df711fdf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:46.769082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0] Write session: try to update token
2025-10-02T08:13:46.769098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:46.784648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId: src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:46.787209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:46.787664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.787685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.787706Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:46.787713Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:46.787716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:46.787725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534649886075747:9863]
2025-10-02T08:13:46.787730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534649886075747:9863]
2025-10-02T08:13:46.787768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:46.787781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:46.787781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:46.787788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.787791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:46.787934Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:46.838351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534649886075816:10829]
2025-10-02T08:13:46.838465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1848, pipe: [1:7556534649886075816:10829]
2025-10-02T08:13:46.921258Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:46.921755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:46.921799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:46.921803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886075816:10829], now have 1 active actors on pipe
2025-10-02T08:13:46.921896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:46.921915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:46.921937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1849 reason: error at write: Disconnected sessionId: src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0
2025-10-02T08:13:46.922066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1849 sessionId: src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0 is DEAD
2025-10-02T08:13:46.922223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:46.922234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0] Write session will restart in 0.009676s
2025-10-02T08:13:46.922236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534649886075816:10829]
2025-10-02T08:13:46.922257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0] Write session: Do CDS request
2025-10-02T08:13:46.922264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:46.922005Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:46.933176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.933748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:46.933763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1850
2025-10-02T08:13:46.935081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:46.935116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:46.935119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:46.935123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:46.935469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1850 sessionId:  describe result for acl check
2025-10-02T08:13:46.935493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:46.935495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:46.935496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:46.935502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534649886076175:9854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:46.935940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534649886076175:9854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:46.936341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:46.937809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:46.938014Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:46.938018Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:46.938028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:46.938083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:46.938115Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534649886076203:9853]
2025-10-02T08:13:46.938534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534649886076175:9854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:46.938698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:46.939083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:46.939115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:46.939331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:46.939358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.939358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.939359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.939360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.939361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.939364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.939371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.939373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.939375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.939377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.939381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.939386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:46.939390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.939393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:46.939395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.939398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:46.939401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.939404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.939406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.939409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.939422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:46.948250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534649886076175:9854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:46.948265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534649886076175:9854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:46.948269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534649886076175:9854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:46.948278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:46.950121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:46.951811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:46.951825Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:46.951827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:46.951830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:46.951834Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1849 [1:7556534649886076203:9853]
2025-10-02T08:13:46.951843Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:46.951856Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:46.951858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.951860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.951862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.951874Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:46.951878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:46.951883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:46.951940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.951946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.951948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:46.951950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:46.952009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:46.952016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.952030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:46.952045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:46.952067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534649886076230:9854], now have 1 active actors on pipe
2025-10-02T08:13:46.952069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1849
2025-10-02T08:13:46.952077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534649886076182:9853]
2025-10-02T08:13:46.952079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534649886076182:9853]
2025-10-02T08:13:46.952086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:46.952094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534650345761182:2378], now have 1 active actors on pipe
2025-10-02T08:13:46.952104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.952108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.952126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:46.952140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:46.952143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:46.952145Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:46.952146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:46.952191Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:46.952211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.952215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.952218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:46.952227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.952240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:46.952247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534649886076182:9853]
2025-10-02T08:13:46.952254Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:46.952260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:46.952198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1849
2025-10-02T08:13:46.952281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.952367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.952375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.952389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:46.952429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1850 partition: 0 MaxSeqNo: 17 sessionId: src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0
2025-10-02T08:13:46.952751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f2da5d1-2bfc3ade-18881392-aa494c19_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:46.955315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0] Write session: try to update token
2025-10-02T08:13:46.955328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:46.963974Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:46.963991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:46.964000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534649886076182:9853]
2025-10-02T08:13:46.964041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:46.964046Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:46.964235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:46.964378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:46.964521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:46.964664Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:46.964875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:46.964921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:46.973510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId: src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:46.976055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:46.976136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.976149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.976183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:46.976219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:46.976436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:46.976453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:46.976642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.976712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.976778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.976866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.976916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.976926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.977013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.977083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.977143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.977204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.977245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.977253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.977325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.977390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.977463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.977533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.977588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.977601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.977682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.977755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.977832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.977911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.977965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.977976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.978058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.978129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.978208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.978284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.978337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.978345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.978425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.978510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.978582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.978657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.978810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.978819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.978901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.978970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.979043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.979122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.979173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.979181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.979266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.979330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.979397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.979460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.979514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.979523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.979604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.979671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.979741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.979804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.979862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.979870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.979954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:46.980022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:46.980085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:46.980146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:46.980193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:46.980210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:46.980256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:46.980328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:46.980352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:46.980358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:46.980389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:46.980405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:46.980413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:46.980416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:46.980419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:46.980838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:46.980863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:46.980874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:46.980878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:46.980883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:46.980886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:46.981603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:46.981631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:46.981638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:46.981641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:46.981644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:46.981647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:46.982123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:46.982150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:46.982163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:46.982172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:46.982179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:46.983393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:46.983415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:46.983426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392826981
2025-10-02T08:13:46.983601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:46.983612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:46.983618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:46.983622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:46.983625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:46.983628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:46.984106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:46.984122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:46.984128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:46.984132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:46.984139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:46.984143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:46.984632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:46.984647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:46.984657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:46.984679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:46.984683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:46.984687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:46.985336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:46.985365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:46.985372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:46.986534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:46.986555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:46.986561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:46.986565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:46.986574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392826986
2025-10-02T08:13:46.986866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:46.986892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:46.986903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:46.986913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:46.986921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:46.986927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:46.987401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:46.987424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:46.987434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:46.987438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:46.987441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:46.987449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:46.987897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:46.987919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:46.988022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392826987
2025-10-02T08:13:46.988819Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:46.988839Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:46.988846Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:46.988853Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:46.990544Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:46.990559Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:46.990561Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:46.990572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534649886076182:9853]
2025-10-02T08:13:46.990580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534649886076182:9853]
2025-10-02T08:13:46.990641Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:46.990644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:46.990650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:46.990651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:46.990652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:46.990802Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:47.022158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534654181043549:10829]
2025-10-02T08:13:47.022280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1849, pipe: [1:7556534654181043549:10829]
2025-10-02T08:13:47.133532Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:47.133875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181043549:10829], now have 1 active actors on pipe
2025-10-02T08:13:47.134014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:47.134024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:47.134050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1850 reason: error at write: Disconnected sessionId: src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0
2025-10-02T08:13:47.134109Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:47.134104Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:47.134207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1850 sessionId: src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0 is DEAD
2025-10-02T08:13:47.134347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534654181043549:10829]
2025-10-02T08:13:47.134529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:47.134540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0] Write session will restart in 0.008103s
2025-10-02T08:13:47.134563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0] Write session: Do CDS request
2025-10-02T08:13:47.134568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:47.143328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:47.143341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1851
2025-10-02T08:13:47.143403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.143653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.143692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:47.143702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:47.143705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:47.144090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1851 sessionId:  describe result for acl check
2025-10-02T08:13:47.144127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:47.144129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:47.144131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:47.144136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534654181043783:9822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:47.144830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534654181043783:9822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:47.147536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534654181043783:9822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:47.152005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534654181043783:9822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:47.152019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534654181043783:9822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:47.152022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534654181043783:9822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:47.152030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:47.154918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:47.156072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:47.156320Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:47.156330Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:47.156340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:47.156393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:47.156432Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534654181043953:9821]
2025-10-02T08:13:47.157022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:47.157227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:47.157279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:47.157587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:47.157642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.157648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.157649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.157650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.157651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.157656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.157666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.157670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.157676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.157679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.157684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.157691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.157696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.157701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.157705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.157710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.157714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.157719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.157723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.157728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.157747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:47.165922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:47.167667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:47.167684Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:47.167687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:47.167690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:47.167696Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1850 [1:7556534654181043953:9821]
2025-10-02T08:13:47.167709Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:47.167727Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:47.167730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.167734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.167736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.167751Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:47.167756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:47.167768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:47.167828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.167836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.167839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:47.167841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:47.168097Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1850
2025-10-02T08:13:47.167913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:47.167923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.167936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.167949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:47.167966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534654181043947:9821]
2025-10-02T08:13:47.167968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534654181043947:9821]
2025-10-02T08:13:47.167974Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:47.167987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181043910:9822], now have 1 active actors on pipe
2025-10-02T08:13:47.167991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:47.167995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:47.167995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:47.168001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1850
2025-10-02T08:13:47.168009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:47.168013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:47.168018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534654640728486:2378], now have 1 active actors on pipe
2025-10-02T08:13:47.168022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.168026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.168068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534654181043947:9821]
2025-10-02T08:13:47.168076Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:47.168085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:47.168092Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:47.168099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.168103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.168105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:47.168115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.168123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:47.168165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.168316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.168326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.168341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.168714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb1a339-8889a16c-23f333e2-1744e02b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:47.168385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1851 partition: 0 MaxSeqNo: 17 sessionId: src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0
2025-10-02T08:13:47.171338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0] Write session: try to update token
2025-10-02T08:13:47.171357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:47.179051Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:47.179067Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:47.179075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534654181043947:9821]
2025-10-02T08:13:47.179119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:47.179124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:47.179284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:47.179428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.179562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.179689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.179876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:47.179918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:47.184967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId: src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:47.187295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:47.187350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.187360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.187385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:47.187402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:47.187455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.187468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.187647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.187716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.187797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.187876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.187920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.187929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.188005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.188072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.188137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.188231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.188276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.188286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.188356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.188421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.188486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.188549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.188593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.188602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.188670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.188739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.188828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.188904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.188954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.188961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.189043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.189117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.189194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.189273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.189327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.189334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.189414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.189482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.189557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.189632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.189686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.189692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.189770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.189840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.189911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.189992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.190044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.190051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.190130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.190203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.190276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.190348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.190400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.190413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.190497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.190572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.190646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.190715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.190808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.190816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.190893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.190965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.191040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.191111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.191175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.191183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.191237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:47.191308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.191330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.191337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:47.191369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:47.191385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:47.191393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:47.191396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:47.191399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:47.191831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:47.191867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:47.191880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:47.191884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:47.191887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:47.191890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:47.192425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:47.192455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:47.192461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:47.192464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:47.192470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:47.192474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:47.193202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:47.193236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:47.193242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:47.193246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:47.193249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:47.194595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:47.194617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:47.194629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392827194
2025-10-02T08:13:47.194756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:47.194771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:47.194776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:47.194780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:47.194786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:47.194789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:47.195392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:47.195423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:47.195429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:47.195433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:47.195436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:47.195440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:47.195985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:47.196013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:47.196025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:47.196028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:47.196031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:47.196034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:47.196558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:47.196590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:47.196596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:47.197837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:47.197863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:47.197868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:47.197874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:47.197882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392827197
2025-10-02T08:13:47.198210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:47.198237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:47.198247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:47.198254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:47.198258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:47.198261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:47.198746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:47.198773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:47.198783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:47.198787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:47.198790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:47.198794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:47.199311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:47.199333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.199441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392827199
2025-10-02T08:13:47.200269Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:47.200288Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:47.200294Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:47.200300Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:47.202139Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:47.202151Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:47.202153Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:47.202162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534654181043947:9821]
2025-10-02T08:13:47.202167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534654181043947:9821]
2025-10-02T08:13:47.202219Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:47.202228Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:47.202228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:47.202233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.202235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:47.202387Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:47.233112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534654181043985:10829]
2025-10-02T08:13:47.233216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1850, pipe: [1:7556534654181043985:10829]
2025-10-02T08:13:47.339393Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:47.339712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181043985:10829], now have 1 active actors on pipe
2025-10-02T08:13:47.339841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534654181043985:10829]
2025-10-02T08:13:47.339862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:47.339869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:47.339892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1851 reason: error at write: Disconnected sessionId: src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0
2025-10-02T08:13:47.339971Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:47.340001Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:47.340084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1851 sessionId: src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0 is DEAD
2025-10-02T08:13:47.340230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:47.340241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0] Write session will restart in 0.006554s
2025-10-02T08:13:47.340264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0] Write session: Do CDS request
2025-10-02T08:13:47.340271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:47.348260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.348303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:47.348317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1852
2025-10-02T08:13:47.348441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.348484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:47.348494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:47.348498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:47.348930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1852 sessionId:  describe result for acl check
2025-10-02T08:13:47.348963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:47.348969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:47.348970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:47.348976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534654181044287:9810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:47.349473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534654181044287:9810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:47.351928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534654181044287:9810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:47.352263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:47.353411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:47.353633Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:47.353643Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:47.353653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:47.353710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:47.353748Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534654181044386:9809]
2025-10-02T08:13:47.354385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:47.354803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534654181044287:9810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:47.354815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534654181044287:9810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:47.354818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534654181044287:9810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:47.354826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:47.354938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:47.354985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:47.355295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:47.355341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.355347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.355349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.355350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.355351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.355356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.355366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.355370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.355374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.355378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.355383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.355391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.355403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.355409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.355415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.355421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.355430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.355438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.355446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.355456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.355479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:47.363384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:47.364973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:47.364996Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:47.364999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:47.365005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:47.365012Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1851 [1:7556534654181044386:9809]
2025-10-02T08:13:47.365023Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:47.365040Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:47.365043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.365046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.365049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.365068Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:47.365078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:47.365084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:47.365148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.365160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.365162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:47.365165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:47.365228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:47.365235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.365249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.365264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:47.365285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181044399:9810], now have 1 active actors on pipe
2025-10-02T08:13:47.365293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534654640728495:2378], now have 1 active actors on pipe
2025-10-02T08:13:47.365300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534654181044371:9809]
2025-10-02T08:13:47.365306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534654181044371:9809]
2025-10-02T08:13:47.365318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:47.365333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:47.365334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:47.365342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:47.365351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:47.365355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:47.365385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534654181044371:9809]
2025-10-02T08:13:47.365392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:47.365401Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:47.365441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1851
2025-10-02T08:13:47.365474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.365482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.365503Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:47.365514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.365517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.365519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:47.365527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.365537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:47.365554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.365589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.365595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.365607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.365596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1851
2025-10-02T08:13:47.365645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1852 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0
2025-10-02T08:13:47.366001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcda169-bb83dce7-69f3bdca-e82ff91a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:47.368482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0] Write session: try to update token
2025-10-02T08:13:47.368497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:47.376558Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:47.376576Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:47.376585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534654181044371:9809]
2025-10-02T08:13:47.376629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:47.376630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:47.376798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:47.376958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.377105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.377245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.377455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:47.377497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:47.381932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId: src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:47.384666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:47.384734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.384746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.384787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:47.384826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:47.384887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.384895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.385059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.385132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.385204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.385279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.385330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.385340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.385415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.385488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.385556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.385626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.385676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.385683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.385760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.385822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.385883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.385948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.385992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.385999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.386073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.386151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.386227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.386306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.386367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.386375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.386455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.386525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.386601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.386677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.386742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.386748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.386835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.386908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.386987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.387074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.387130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.387138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.387219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.387294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.387373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.387449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.387503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.387511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.387594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.387662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.387745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.387821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.387876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.387884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.387966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.388030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.388093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.388160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.388226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.388233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.388315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.388385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.388452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.388515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.388570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.388577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.388621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:47.388690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.388713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.388719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:47.388750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:47.388766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:47.388774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:47.388777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:47.388781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:47.389212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:47.389243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:47.389249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:47.389252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:47.389254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:47.389257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:47.389956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:47.389983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:47.389989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:47.389991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:47.389994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:47.389997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:47.390582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:47.390610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:47.390615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:47.390619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:47.390622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:47.391863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:47.391887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:47.391899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392827391
2025-10-02T08:13:47.392018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:47.392036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:47.392046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:47.392049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:47.392058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:47.392061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:47.392610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:47.392641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:47.392646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:47.392650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:47.392653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:47.392657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:47.393187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:47.393212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:47.393219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:47.393224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:47.393228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:47.393231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:47.393703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:47.393729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:47.393734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:47.394961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:47.395010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:47.395016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:47.395020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:47.395030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392827394
2025-10-02T08:13:47.395328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:47.395352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:47.395363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:47.395367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:47.395374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:47.395377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:47.395920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:47.395949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:47.395955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:47.395958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:47.395962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:47.395965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:47.396463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:47.396485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.396596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392827396
2025-10-02T08:13:47.397509Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:47.397538Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:47.397546Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:47.397553Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:47.399334Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:47.399348Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:47.399350Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:47.399361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534654181044371:9809]
2025-10-02T08:13:47.399364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534654181044371:9809]
2025-10-02T08:13:47.399418Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:47.399433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:47.399436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.399438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:47.399444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:47.399597Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:47.439967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534654181044462:10829]
2025-10-02T08:13:47.440072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1851, pipe: [1:7556534654181044462:10829]
2025-10-02T08:13:47.551233Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:47.551632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181044462:10829], now have 1 active actors on pipe
2025-10-02T08:13:47.551759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:47.551766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:47.551789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1852 reason: error at write: Disconnected sessionId: src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0
2025-10-02T08:13:47.551821Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:47.551889Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:47.551957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1852 sessionId: src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0 is DEAD
2025-10-02T08:13:47.552112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534654181044462:10829]
2025-10-02T08:13:47.552640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:47.552649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0] Write session will restart in 0.005598s
2025-10-02T08:13:47.552676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0] Write session: Do CDS request
2025-10-02T08:13:47.552684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:47.559263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.559322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:47.559338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1853
2025-10-02T08:13:47.559457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.559485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:47.559490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:47.559493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:47.559989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1853 sessionId:  describe result for acl check
2025-10-02T08:13:47.560018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:47.560024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:47.560025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:47.560029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534654181044749:9771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:47.560519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534654181044749:9771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:47.563575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534654181044749:9771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:47.564887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:47.566439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:47.566604Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:47.566613Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:47.566622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:47.566663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:47.566696Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534654181044877:9774]
2025-10-02T08:13:47.566831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534654181044749:9771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:47.566843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534654181044749:9771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:47.566845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534654181044749:9771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:47.566853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:47.567243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:47.567403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:47.567437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:47.567690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:47.567731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.567736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.567737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.567738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.567739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.567744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.567752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.567756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.567759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.567762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.567766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.567773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.567785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.567790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.567793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.567798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.567801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.567806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.567810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.567813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.567830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:47.575724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:47.577363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:47.577381Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:47.577383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:47.577387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:47.577393Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1852 [1:7556534654181044877:9774]
2025-10-02T08:13:47.577404Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:47.577422Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:47.577425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.577427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.577430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.577446Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:47.577452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:47.577458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:47.577522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.577533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.577536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:47.577538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:47.577603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:47.577611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.577623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.577634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:47.577652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181044882:9771], now have 1 active actors on pipe
2025-10-02T08:13:47.577658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534654181044871:9774]
2025-10-02T08:13:47.577660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1852
2025-10-02T08:13:47.577666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534654181044871:9774]
2025-10-02T08:13:47.577677Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:47.577686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534654640728535:2378], now have 1 active actors on pipe
2025-10-02T08:13:47.577691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:47.577694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:47.577698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:47.577709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:47.577716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:47.577724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.577727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.577766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534654181044871:9774]
2025-10-02T08:13:47.577778Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:47.577781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:47.577793Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:47.577799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.577807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.577809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:47.577818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.577831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:47.577870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.577919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.577926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.577938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.577924Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1852
2025-10-02T08:13:47.577991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1853 partition: 0 MaxSeqNo: 17 sessionId: src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0
2025-10-02T08:13:47.578320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1eb6712-938eebd3-58a27dc7-d69873fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:47.580990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0] Write session: try to update token
2025-10-02T08:13:47.581007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:47.595487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId: src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:47.596212Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:47.596224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:47.596226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:47.596233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534654181044871:9774]
2025-10-02T08:13:47.596237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534654181044871:9774]
2025-10-02T08:13:47.596277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:47.596278Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:47.596285Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:47.596287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.596289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:47.596423Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:47.598119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:47.651950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534654181044911:10829]
2025-10-02T08:13:47.652079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1852, pipe: [1:7556534654181044911:10829]
2025-10-02T08:13:47.737550Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:47.737773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.737785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.737819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181044911:10829], now have 1 active actors on pipe
2025-10-02T08:13:47.737976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:47.737987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:47.738054Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:47.738063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1853 reason: error at write: Disconnected sessionId: src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0
2025-10-02T08:13:47.738242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1853 sessionId: src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0 is DEAD
2025-10-02T08:13:47.738410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:47.738421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0] Write session will restart in 0.008182s
2025-10-02T08:13:47.738406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534654181044911:10829]
2025-10-02T08:13:47.738445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0] Write session: Do CDS request
2025-10-02T08:13:47.738454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:47.738418Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:47.747248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.747315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:47.747328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1854
2025-10-02T08:13:47.747455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.747485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:47.747494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:47.747497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:47.747834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1854 sessionId:  describe result for acl check
2025-10-02T08:13:47.747868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:47.747870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:47.747871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:47.747876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534654181045226:9757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:47.748377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534654181045226:9757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:47.751305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:47.751563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534654181045226:9757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:47.752605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:47.752765Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:47.752774Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:47.752783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:47.752843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:47.752876Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534654181045317:9761]
2025-10-02T08:13:47.753460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:47.753614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:47.753650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:47.753952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:47.753964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534654181045226:9757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:47.753970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534654181045226:9757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:47.753972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534654181045226:9757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:47.753980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:47.753992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.753993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.753994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.753995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.753997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.754001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.754011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.754019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.754023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.754026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.754031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.754038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.754043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.754048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.754052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.754057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.754065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.754070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.754074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.754083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.754100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:47.761872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:47.763544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:47.763562Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:47.763565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:47.763568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:47.763574Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1853 [1:7556534654181045317:9761]
2025-10-02T08:13:47.763584Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:47.763599Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:47.763601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.763604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.763607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.763621Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:47.763625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:47.763631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:47.763683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.763690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.763693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:47.763695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:47.763770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:47.763777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.763788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.763797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:47.763817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181045329:9757], now have 1 active actors on pipe
2025-10-02T08:13:47.763825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534654640728543:2378], now have 1 active actors on pipe
2025-10-02T08:13:47.763829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.763833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.763848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534654181045301:9761]
2025-10-02T08:13:47.763854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534654181045301:9761]
2025-10-02T08:13:47.763867Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:47.763881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:47.763897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:47.763904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:47.763913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:47.763917Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:47.763922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:47.763923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.763925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.763927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:47.763937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.763944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:47.763943Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1853
2025-10-02T08:13:47.763978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534654181045301:9761]
2025-10-02T08:13:47.763990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1853
2025-10-02T08:13:47.763992Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:47.764001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.764015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:47.764027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.764033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.764053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.764092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1854 partition: 0 MaxSeqNo: 17 sessionId: src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0
2025-10-02T08:13:47.764377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b9ced47-9db2655d-b624b664-e8b960d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:47.766916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0] Write session: try to update token
2025-10-02T08:13:47.766932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:47.775209Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:47.775229Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:47.775239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534654181045301:9761]
2025-10-02T08:13:47.775278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:47.775286Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:47.775446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:47.775593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.775740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.775886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:47.776085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:47.776128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:47.779409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId: src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:47.782132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:47.782199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.782213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.782250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:47.782275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:47.782318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.782334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.782527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.782596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.782661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.782726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.782771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.782780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.782853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.782914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.782980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.783047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.783094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.783102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.783173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.783238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.783299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.783360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.783404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.783411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.783477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.783544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.783624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.783702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.783753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.783760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.783837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.783923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.783998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.784070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.784123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.784133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.784228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.784302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.784376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.784449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.784501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.784508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.784587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.784658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.784735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.784836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.784889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.784896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.784976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.785044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.785120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.785192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.785243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.785254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.785334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.785395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.785459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.785519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.785580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.785588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.785664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:47.785733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:47.785799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:47.785867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:47.785922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:47.785930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:47.785979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:47.786051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.786073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.786080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:47.786111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:47.786129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:47.786137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:47.786141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:47.786144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:47.786555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:47.786583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:47.786590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:47.786593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:47.786596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:47.786600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:47.787285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:47.787313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:47.787319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:47.787322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:47.787325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:47.787328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:47.787946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:47.787965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:47.787970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:47.787974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:47.787978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:47.789329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:47.789355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:47.789367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392827789
2025-10-02T08:13:47.789550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:47.789568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:47.789578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:47.789581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:47.789586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:47.789591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:47.790066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:47.790094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:47.790104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:47.790107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:47.790110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:47.790116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:47.790635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:47.790661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:47.790668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:47.790671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:47.790675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:47.790678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:47.791175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:47.791208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:47.791218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:47.792436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:47.792456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:47.792462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:47.792468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:47.792478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392827792
2025-10-02T08:13:47.792795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:47.792866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:47.792879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:47.792883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:47.792886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:47.792895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:47.793385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:47.793411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:47.793416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:47.793421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:47.793424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:47.793429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:47.793901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:47.793914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.794019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392827793
2025-10-02T08:13:47.794815Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:47.794828Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:47.794835Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:47.794841Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:47.796574Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:47.796577Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:47.796579Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:47.796591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534654181045301:9761]
2025-10-02T08:13:47.796596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534654181045301:9761]
2025-10-02T08:13:47.796659Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:47.796664Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:47.796665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:47.796670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.796672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:47.797015Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:47.844887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534654181045357:10829]
2025-10-02T08:13:47.845131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1853, pipe: [1:7556534654181045357:10829]
2025-10-02T08:13:47.939237Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:47.939624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181045357:10829], now have 1 active actors on pipe
2025-10-02T08:13:47.939780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:47.939787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:47.939813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1854 reason: error at write: Disconnected sessionId: src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0
2025-10-02T08:13:47.940136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:47.940148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0] Write session will restart in 0.008732s
2025-10-02T08:13:47.940171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0] Write session: Do CDS request
2025-10-02T08:13:47.940177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:47.940526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:47.939855Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:47.940088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1854 sessionId: src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0 is DEAD
2025-10-02T08:13:47.940307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534654181045357:10829]
2025-10-02T08:13:47.950240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.950297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:47.950311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1855
2025-10-02T08:13:47.950447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:47.950489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:47.950495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:47.950499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:47.950925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1855 sessionId:  describe result for acl check
2025-10-02T08:13:47.950956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:47.950958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:47.950959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:47.950966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534654181045659:9725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:47.951505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534654181045659:9725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:47.954663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534654181045659:9725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:47.955647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:47.957084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:47.957250Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:47.957259Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:47.957268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:47.957309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:47.957342Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534654181045765:9728]
2025-10-02T08:13:47.957515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534654181045659:9725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:47.957530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534654181045659:9725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:47.957533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534654181045659:9725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:47.957540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:47.957961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:47.958134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:47.958174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:47.958464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:47.958511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.958517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.958518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.958519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.958520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.958525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.958534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.958538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.958541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.958549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.958554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.958565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:47.958574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.958579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:47.958583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.958593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:47.958596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.958601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.958609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.958617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.958637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:47.966373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:47.967887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:47.967906Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:47.967908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:47.967912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:47.967919Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1854 [1:7556534654181045765:9728]
2025-10-02T08:13:47.967931Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:47.967946Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:47.967947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.967949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.967951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.967962Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:47.967965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:47.967970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:47.968015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.968024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.968026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:47.968028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:47.968084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:47.968091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.968104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:47.968116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:47.968132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534654181045770:9725], now have 1 active actors on pipe
2025-10-02T08:13:47.968141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534654181045759:9728]
2025-10-02T08:13:47.968143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534654181045759:9728]
2025-10-02T08:13:47.968150Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:47.968151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1854
2025-10-02T08:13:47.968160Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:47.968163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:47.968163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:47.968175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:47.968178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:47.968188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534654640728549:2378], now have 1 active actors on pipe
2025-10-02T08:13:47.968195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.968210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.968248Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1854
2025-10-02T08:13:47.968250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534654181045759:9728]
2025-10-02T08:13:47.968259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:47.968272Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:47.968278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:47.968282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:47.968284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:47.968290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:47.968292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:47.968300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:47.968333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.968420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.968428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.968441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:47.968478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1855 partition: 0 MaxSeqNo: 17 sessionId: src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0
2025-10-02T08:13:47.968792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2d9d272-a9e4bc09-4c40cb77-7f4dc13d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:47.971182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0] Write session: try to update token
2025-10-02T08:13:47.971195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:47.984242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId: src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:47.986811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:47.988155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:47.988173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:47.988189Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:47.988191Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:47.988193Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:47.988198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534654181045759:9728]
2025-10-02T08:13:47.988214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534654181045759:9728]
2025-10-02T08:13:47.988261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:47.988269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:47.988271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:47.988278Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:47.988284Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:47.988392Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:48.040569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534658476013094:10829]
2025-10-02T08:13:48.040681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1854, pipe: [1:7556534658476013094:10829]
2025-10-02T08:13:48.125155Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:48.125504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:48.125543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:48.125545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476013094:10829], now have 1 active actors on pipe
2025-10-02T08:13:48.125646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534658476013094:10829]
2025-10-02T08:13:48.125664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:48.125666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:48.125687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1855 reason: error at write: Disconnected sessionId: src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0
2025-10-02T08:13:48.125754Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:48.125812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1855 sessionId: src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0 is DEAD
2025-10-02T08:13:48.125954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:48.125962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0] Write session will restart in 0.008600s
2025-10-02T08:13:48.125984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0] Write session: Do CDS request
2025-10-02T08:13:48.125994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:48.130087Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:13:48.130108Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-10-02T08:13:48.135311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.135338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:48.135358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1856
2025-10-02T08:13:48.135529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.135573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:48.135583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:48.135587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:48.136000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1856 sessionId:  describe result for acl check
2025-10-02T08:13:48.136033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:48.136039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:48.136041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:48.136047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534658476013426:9712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:48.136600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534658476013426:9712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:48.139136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534658476013426:9712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:48.139711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:48.141273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:48.141472Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:48.141487Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:48.141498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:48.141554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:48.141594Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534658476013507:9708]
2025-10-02T08:13:48.142227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:48.142241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534658476013426:9712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:48.142248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534658476013426:9712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:48.142251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534658476013426:9712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:48.142259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:48.142398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:48.142444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:48.142749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:48.142800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.142806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.142807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.142808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.142810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.142815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.142825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.142829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.142833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.142837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.142843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.142849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.142855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.142861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.142866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.142871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.142875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.142880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.142886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.142891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.142918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:48.151265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:48.152851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:48.152864Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:48.152867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:48.152871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:48.152877Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1855 [1:7556534658476013507:9708]
2025-10-02T08:13:48.152888Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:48.152905Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:48.152908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.152911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.152914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.152928Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:48.152938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:48.152944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:48.152997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.153004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.153007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:48.153009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:48.153081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:48.153088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.153102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.153119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:48.153141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476013516:9712], now have 1 active actors on pipe
2025-10-02T08:13:48.153153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534658476013497:9708]
2025-10-02T08:13:48.153156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534658476013497:9708]
2025-10-02T08:13:48.153163Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:48.153174Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:48.153177Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:48.153178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:48.153193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:48.153196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:48.153204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534658935695871:2378], now have 1 active actors on pipe
2025-10-02T08:13:48.153235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534658476013497:9708]
2025-10-02T08:13:48.153239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1855
2025-10-02T08:13:48.153242Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:48.153252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:48.153259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.153268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.153260Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1855
2025-10-02T08:13:48.153297Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:48.153307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.153311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.153313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:48.153322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.153337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:48.153375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.153431Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:13:48.153457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.153463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.153475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.153511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1856 partition: 0 MaxSeqNo: 17 sessionId: src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0
2025-10-02T08:13:48.153628Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 16 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:13:48.153668Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:13:48.153846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510df8f8-bbfef5f1-5d093afa-f6e3c888_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:48.156526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0] Write session: try to update token
2025-10-02T08:13:48.156544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:48.170658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId: src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:48.171895Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:48.171905Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:48.171907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:48.171916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534658476013497:9708]
2025-10-02T08:13:48.171921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534658476013497:9708]
2025-10-02T08:13:48.171967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:48.171971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:48.171977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:48.171979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.171981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:48.172121Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:48.173545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:48.225869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534658476013540:10829]
2025-10-02T08:13:48.225958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1855, pipe: [1:7556534658476013540:10829]
2025-10-02T08:13:48.308079Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:48.308409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.308423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.308455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476013540:10829], now have 1 active actors on pipe
2025-10-02T08:13:48.308585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534658476013540:10829]
2025-10-02T08:13:48.308613Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:48.308615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:48.308618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:48.308682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1856 reason: error at write: Disconnected sessionId: src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0
2025-10-02T08:13:48.308706Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:48.308846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1856 sessionId: src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0 is DEAD
2025-10-02T08:13:48.309001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:48.309011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0] Write session will restart in 0.009041s
2025-10-02T08:13:48.309039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0] Write session: Do CDS request
2025-10-02T08:13:48.309045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:48.319270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.319295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:48.319313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1857
2025-10-02T08:13:48.319497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.319535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:48.319540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:48.319548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:48.319920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1857 sessionId:  describe result for acl check
2025-10-02T08:13:48.319955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:48.319957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:48.319958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:48.319965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534658476013919:9703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:48.320346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:48.320505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534658476013919:9703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:48.321788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:48.321970Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:48.321984Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:48.321994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:48.322043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:48.322114Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534658476013944:9704]
2025-10-02T08:13:48.322699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:48.322715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534658476013919:9703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:48.322876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:48.322947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:48.323261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:48.323312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.323318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.323319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.323320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.323321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.323328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.323338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.323346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.323350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.323357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.323363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.323375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.323384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.323395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.323404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.323410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.323415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.323421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.323426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.323431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.323452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:48.328525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534658476013919:9703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:48.328544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534658476013919:9703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:48.328548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534658476013919:9703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:48.328556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:48.331121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:48.333184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:48.333200Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:48.333203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:48.333207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:48.333213Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1856 [1:7556534658476013944:9704]
2025-10-02T08:13:48.333224Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:48.333243Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:48.333246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.333250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.333252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.333267Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:48.333274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:48.333281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:48.333343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.333352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.333355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:48.333357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:48.333566Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1856
2025-10-02T08:13:48.333418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:48.333429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.333442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.333453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:48.333469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476013971:9703], now have 1 active actors on pipe
2025-10-02T08:13:48.333475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534658476013920:9704]
2025-10-02T08:13:48.333477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534658476013920:9704]
2025-10-02T08:13:48.333488Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:48.333498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534658935695881:2378], now have 1 active actors on pipe
2025-10-02T08:13:48.333504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:48.333516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:48.333519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:48.333550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:48.333553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:48.333556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534658476013920:9704]
2025-10-02T08:13:48.333558Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:48.333560Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:48.333591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1856
2025-10-02T08:13:48.333710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.333719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.333745Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:48.333757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.333766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.333768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:48.333779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.333794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:48.333819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.333870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.333879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.333894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.333932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1857 partition: 0 MaxSeqNo: 17 sessionId: src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0
2025-10-02T08:13:48.334283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7deb2183-b400f18d-b04e1a08-1a2c3ca1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:48.337076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0] Write session: try to update token
2025-10-02T08:13:48.337093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:48.351379Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:48.351399Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:48.351402Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:48.351411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534658476013920:9704]
2025-10-02T08:13:48.351416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534658476013920:9704]
2025-10-02T08:13:48.351461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:48.351466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.351469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:48.351468Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:48.351474Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:48.351614Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:48.351649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId: src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:48.354381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:48.408648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534658476013987:10829]
2025-10-02T08:13:48.413479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1856, pipe: [1:7556534658476013987:10829]
2025-10-02T08:13:48.496502Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:48.496785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.496813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.496853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476013987:10829], now have 1 active actors on pipe
2025-10-02T08:13:48.496992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534658476013987:10829]
2025-10-02T08:13:48.497019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:48.497022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:48.497073Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:48.497081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1857 reason: error at write: Disconnected sessionId: src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0
2025-10-02T08:13:48.497081Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:48.497249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1857 sessionId: src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0 is DEAD
2025-10-02T08:13:48.497561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:48.497569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0] Write session will restart in 0.006455s
2025-10-02T08:13:48.497591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0] Write session: Do CDS request
2025-10-02T08:13:48.497596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:48.505252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.505331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:48.505347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1858
2025-10-02T08:13:48.505448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.505476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:48.505488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:48.505491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:48.505994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1858 sessionId:  describe result for acl check
2025-10-02T08:13:48.506025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:48.506031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:48.506033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:48.506038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534658476014329:9671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:48.506576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534658476014329:9671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:48.509127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534658476014329:9671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:48.509805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:48.511430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:48.511601Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:48.511612Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:48.511621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:48.511676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:48.511711Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534658476014435:9672]
2025-10-02T08:13:48.511722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534658476014329:9671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:48.511731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534658476014329:9671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:48.511734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534658476014329:9671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:48.511740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:48.512401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:48.512593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:48.512638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:48.512986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:48.513040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.513046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.513047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.513048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.513049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.513055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.513066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.513070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.513074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.513078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.513084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.513091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.513097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.513103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.513107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.513115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.513124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.513130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.513136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.513146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.513166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:48.521257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:48.523216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:48.523234Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:48.523237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:48.523240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:48.523246Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1857 [1:7556534658476014435:9672]
2025-10-02T08:13:48.523258Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:48.523277Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:48.523279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.523282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.523284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.523300Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:48.523305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:48.523311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:48.523374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.523383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.523386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:48.523393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:48.523504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1857
2025-10-02T08:13:48.523645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:48.523654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.523635Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1857
2025-10-02T08:13:48.523668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.523686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:48.523710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476014440:9671], now have 1 active actors on pipe
2025-10-02T08:13:48.523719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.523724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.523737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534658935695921:2378], now have 1 active actors on pipe
2025-10-02T08:13:48.523753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534658476014425:9672]
2025-10-02T08:13:48.523759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534658476014425:9672]
2025-10-02T08:13:48.524345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffefe88c-a46c9964-59a9d5a1-b6cb1189_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f748e409-e780599d-6dcbe50-a79c4778_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:48.523772Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:48.523788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:48.523791Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:48.523792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:48.523807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:48.523810Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:48.523828Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f748e409-e780599d-6dcbe50-a79c4778_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:48.523834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.523838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.523840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:48.523850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.523861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:48.523894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534658476014425:9672]
2025-10-02T08:13:48.523903Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:48.523914Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:48.523915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.523958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.523961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.523976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.524012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1858 partition: 0 MaxSeqNo: 17 sessionId: src_id|f748e409-e780599d-6dcbe50-a79c4778_0
2025-10-02T08:13:48.526935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f748e409-e780599d-6dcbe50-a79c4778_0] Write session: try to update token
2025-10-02T08:13:48.526953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f748e409-e780599d-6dcbe50-a79c4778_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:48.537818Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:48.537833Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:48.537841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534658476014425:9672]
2025-10-02T08:13:48.537877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:48.537889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:48.538028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:48.538176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:48.538308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:48.538437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:48.538612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:48.538651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:48.544664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId: src_id|f748e409-e780599d-6dcbe50-a79c4778_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:48.547252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:48.547315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.547325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.547359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:48.547377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:48.547429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.547434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.547571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.547630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.547704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.547771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.547808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.547812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.547882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.547938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.547999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.548069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.548113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.548119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.548183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.548261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.548321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.548383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.548425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.548428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.548503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.548576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.548650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.548722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.548779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.548787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.548910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.548977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.549042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.549107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.549160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.549166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.549242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.549315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.549387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.549460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.549507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.549513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.549589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.549648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.549712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.549792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.549842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.549848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.549942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.550017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.550095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.550182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.550230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.550232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.550311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.550381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.550450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.550515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.550563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.550569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.550640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.550697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.550756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.550823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.550880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.550888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.550930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:48.550994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.551018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.551023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:48.551054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:48.551073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:48.551081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:48.551084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:48.551086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:48.551485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:48.551507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:48.551512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:48.551518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:48.551520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:48.551522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:48.552037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:48.552054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:48.552058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:48.552060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:48.552062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:48.552065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:48.552631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:48.552650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:48.552655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:48.552659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:48.552661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:48.554801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:48.554819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:48.554829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392828553
2025-10-02T08:13:48.554970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:48.554982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:48.554986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:48.554990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:48.554993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:48.554995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:48.555431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:48.555452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:48.555458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:48.555466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:48.555469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:48.555475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:48.555967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:48.555987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:48.555994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:48.556002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:48.556005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:48.556009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:48.556622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:48.556645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:48.556653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:48.557747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:48.557762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:48.557766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:48.557769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:48.557775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392828556
2025-10-02T08:13:48.558055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:48.558071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:48.558076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:48.558078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:48.558082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:48.558084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:48.558537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:48.558556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:48.558561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:48.558563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:48.558566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:48.558569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:48.559010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:48.559027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.559107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392828556
2025-10-02T08:13:48.559862Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:48.559882Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:48.559888Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:48.559894Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:48.561527Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:48.561538Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:48.561540Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:48.561551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534658476014425:9672]
2025-10-02T08:13:48.561555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534658476014425:9672]
2025-10-02T08:13:48.561594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:48.561604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:48.561606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:48.561607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.561609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:48.561740Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:48.599686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534658476014486:10829]
2025-10-02T08:13:48.600032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1857, pipe: [1:7556534658476014486:10829]
2025-10-02T08:13:48.700662Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:48.701110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476014486:10829], now have 1 active actors on pipe
2025-10-02T08:13:48.701269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:48.701279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:48.701309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1858 reason: error at write: Disconnected sessionId: src_id|f748e409-e780599d-6dcbe50-a79c4778_0
2025-10-02T08:13:48.701317Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:48.701466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1858 sessionId: src_id|f748e409-e780599d-6dcbe50-a79c4778_0 is DEAD
2025-10-02T08:13:48.701631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534658476014486:10829]
2025-10-02T08:13:48.703535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f748e409-e780599d-6dcbe50-a79c4778_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:48.703544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f748e409-e780599d-6dcbe50-a79c4778_0] Write session will restart in 0.007115s
2025-10-02T08:13:48.703561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f748e409-e780599d-6dcbe50-a79c4778_0] Write session: Do CDS request
2025-10-02T08:13:48.703566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f748e409-e780599d-6dcbe50-a79c4778_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:48.701432Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:48.711184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f748e409-e780599d-6dcbe50-a79c4778_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.711474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:48.711485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1859
2025-10-02T08:13:48.711564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.711580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:48.711584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:48.711587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:48.711973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1859 sessionId:  describe result for acl check
2025-10-02T08:13:48.712002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:48.712004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:48.712006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:48.712010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534658476014726:9662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:48.712480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534658476014726:9662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:48.714888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534658476014726:9662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:48.718968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534658476014726:9662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:48.718983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534658476014726:9662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:48.718986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534658476014726:9662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:48.718993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:48.720773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:48.722584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:48.722766Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:48.722777Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:48.722785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:48.722846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:48.722887Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534658476014910:9663]
2025-10-02T08:13:48.723486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:48.723684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:48.723725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:48.724012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:48.724052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.724057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.724058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.724059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.724060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.724064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.724074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.724081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.724084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.724092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.724097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.724104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.724114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.724119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.724125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.724133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.724143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.724151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.724156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.724165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.724183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:48.732660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:48.734573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:48.734593Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:48.734597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:48.734600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:48.734606Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1858 [1:7556534658476014910:9663]
2025-10-02T08:13:48.734618Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:48.734635Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:48.734638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.734640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.734643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.734658Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:48.734663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:48.734669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:48.734732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.734742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.734744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:48.734747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:48.734810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:48.734812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.734823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.734832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:48.734848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534658476014904:9663]
2025-10-02T08:13:48.734850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534658476014904:9663]
2025-10-02T08:13:48.734866Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:48.734877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:48.734888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:48.734889Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:48.734890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:48.734894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:48.734921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534658476014904:9663]
2025-10-02T08:13:48.734924Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:48.734965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1858
2025-10-02T08:13:48.734973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476014885:9662], now have 1 active actors on pipe
2025-10-02T08:13:48.734978Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:48.735263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.735278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.735307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534658935695927:2378], now have 1 active actors on pipe
2025-10-02T08:13:48.735323Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ae4683-257a5adc-804587e6-e974d3e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:48.735331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.735335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.735337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:48.735348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.735359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:48.735376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.735589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.735602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.735624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.735656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1859 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ae4683-257a5adc-804587e6-e974d3e4_0
2025-10-02T08:13:48.736004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f748e409-e780599d-6dcbe50-a79c4778_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ae4683-257a5adc-804587e6-e974d3e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:48.736659Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1858
2025-10-02T08:13:48.738700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae4683-257a5adc-804587e6-e974d3e4_0] Write session: try to update token
2025-10-02T08:13:48.738715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae4683-257a5adc-804587e6-e974d3e4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:48.753233Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:48.753248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:48.753251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:48.753263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534658476014904:9663]
2025-10-02T08:13:48.753267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534658476014904:9663]
2025-10-02T08:13:48.753309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:48.753322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.753324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:48.753335Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:48.753341Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:48.753460Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:48.756629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId: src_id|9ae4683-257a5adc-804587e6-e974d3e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:48.759349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:48.801309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534658476014937:10829]
2025-10-02T08:13:48.801447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1858, pipe: [1:7556534658476014937:10829]
2025-10-02T08:13:48.889044Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:48.889459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.889472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.889508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476014937:10829], now have 1 active actors on pipe
2025-10-02T08:13:48.889677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534658476014937:10829]
2025-10-02T08:13:48.889699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:48.889704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:48.889759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1859 reason: error at write: Disconnected sessionId: src_id|9ae4683-257a5adc-804587e6-e974d3e4_0
2025-10-02T08:13:48.889779Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:48.889828Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:48.889903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1859 sessionId: src_id|9ae4683-257a5adc-804587e6-e974d3e4_0 is DEAD
2025-10-02T08:13:48.890033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae4683-257a5adc-804587e6-e974d3e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:48.890040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae4683-257a5adc-804587e6-e974d3e4_0] Write session will restart in 0.006369s
2025-10-02T08:13:48.890065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae4683-257a5adc-804587e6-e974d3e4_0] Write session: Do CDS request
2025-10-02T08:13:48.890072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae4683-257a5adc-804587e6-e974d3e4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:48.897261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae4683-257a5adc-804587e6-e974d3e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.897329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:48.897343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1860
2025-10-02T08:13:48.897593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:48.897623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:48.897628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:48.897631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:48.897997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1860 sessionId:  describe result for acl check
2025-10-02T08:13:48.898023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:48.898029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:48.898031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:48.898035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534658476015197:9648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:48.898492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534658476015197:9648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:48.901190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534658476015197:9648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:48.904012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534658476015197:9648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:48.904026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534658476015197:9648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:48.904029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534658476015197:9648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:48.904035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:48.904349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:48.905825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:48.906138Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:48.906150Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:48.906161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:48.906209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:48.906249Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534658476015361:9649]
2025-10-02T08:13:48.906773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:48.906974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:48.907012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:48.907286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:48.907329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.907335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.907336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.907337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.907338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.907343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.907352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.907355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.907358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.907361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.907369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.907375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:48.907379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.907383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:48.907387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.907390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:48.907394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.907398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.907401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.907405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.907424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:48.915530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:48.917090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:48.917104Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:48.917107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:48.917110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:48.917117Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1859 [1:7556534658476015361:9649]
2025-10-02T08:13:48.917130Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:48.917148Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:48.917151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.917154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.917156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.917173Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:48.917178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:48.917185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:48.917250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.917252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.917255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:48.917257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:48.917319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:48.917321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.917332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:48.917349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:48.917370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534658476015355:9649]
2025-10-02T08:13:48.917375Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534658476015355:9649]
2025-10-02T08:13:48.917383Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:48.917392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1859
2025-10-02T08:13:48.917401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476015352:9648], now have 1 active actors on pipe
2025-10-02T08:13:48.917402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:48.917406Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:48.917413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:48.917425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:48.917436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:48.917442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534658935695936:2378], now have 1 active actors on pipe
2025-10-02T08:13:48.917451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.917459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.917499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534658476015355:9649]
2025-10-02T08:13:48.917507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:48.917490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1859
2025-10-02T08:13:48.917518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:48.917523Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:48.917529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.917532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.917534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:48.917544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.917552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:48.917592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.917674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.917680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.917694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:48.917729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1860 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0
2025-10-02T08:13:48.918041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae4683-257a5adc-804587e6-e974d3e4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:48.920652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0] Write session: try to update token
2025-10-02T08:13:48.920670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:48.928635Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:48.928653Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:48.928660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534658476015355:9649]
2025-10-02T08:13:48.928706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:48.928717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:48.928916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:48.929072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:48.929212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:48.929344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:48.929532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:48.929574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:48.939389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId: src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:48.942457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:48.942548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.942571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.942626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:48.942653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:48.942706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:48.942722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:48.942986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.943056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.943163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.943230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.943700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.943714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.943795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.943869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.943947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.944018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.944066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.944075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.944143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.944214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.944275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.944337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.944383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.944389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.944455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.944520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.944599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.944674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.944728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.944734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.944826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.944896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.944983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.945062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.945119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.945122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.945210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.945277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.945355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.945427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.945474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.945481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.945560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.945623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.945705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.945783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.945836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.945842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.945924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.946001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.946076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.946152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.946207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.946216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.946302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.946365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.946433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.946513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.946568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.946579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.946658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:48.946725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:48.946788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:48.946854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:48.946909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:48.946916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:48.947013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:48.947098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:48.947121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:48.947128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:48.947162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:48.947189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:48.947198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:48.947201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:48.947204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:48.947588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:48.947614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:48.947626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:48.947630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:48.947638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:48.947641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:48.948607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:48.948634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:48.948641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:48.948644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:48.948651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:48.948656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:48.956846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:48.956891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:48.956902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:48.956907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:48.956910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:48.958191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:48.958201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:48.958215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392828957
2025-10-02T08:13:48.958458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:48.958469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:48.958475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:48.958481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:48.958486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:48.958489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:48.958977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:48.958995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:48.959001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:48.959007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:48.959010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:48.959013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:48.959467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:48.959478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:48.959487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:48.959490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:48.959494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:48.959497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:48.959938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:48.959949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:48.959954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:48.961423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:48.961445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:48.961451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:48.961459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:48.961467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392828961
2025-10-02T08:13:48.961755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:48.961785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:48.961793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:48.961797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:48.961801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:48.961806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:48.962271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:48.962295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:48.962304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:48.962308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:48.962311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:48.962315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:48.962771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:48.962793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:48.962900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392828962
2025-10-02T08:13:48.965280Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:48.965314Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:48.965327Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:48.965339Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:48.965354Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:48.965360Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:48.965362Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:48.965373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534658476015355:9649]
2025-10-02T08:13:48.965383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534658476015355:9649]
2025-10-02T08:13:48.965429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:48.965441Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:48.965473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:48.965480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:48.965489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:48.965639Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:48.989795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534658476015387:10829]
2025-10-02T08:13:48.989926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1859, pipe: [1:7556534658476015387:10829]
2025-10-02T08:13:49.096413Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:49.096940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534658476015387:10829], now have 1 active actors on pipe
2025-10-02T08:13:49.097090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:49.097097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:49.097130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1860 reason: error at write: Disconnected sessionId: src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0
2025-10-02T08:13:49.097215Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:49.097252Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:49.097353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1860 sessionId: src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0 is DEAD
2025-10-02T08:13:49.097456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:49.097466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0] Write session will restart in 0.008825s
2025-10-02T08:13:49.097508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0] Write session: Do CDS request
2025-10-02T08:13:49.097514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:49.097599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534658476015387:10829]
2025-10-02T08:13:49.101734Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [9408023e4d38fc42] Result# TEvPutResult {Id# [72075186224037892:1859:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:49.101779Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1859:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:49.101820Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1859:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:49.107336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.107430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:49.107443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1861
2025-10-02T08:13:49.107533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.107560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:49.107569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:49.107573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:49.108006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1861 sessionId:  describe result for acl check
2025-10-02T08:13:49.108032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:49.108037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:49.108038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:49.108042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534662770982929:9632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:49.108599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534662770982929:9632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:49.111451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534662770982929:9632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:49.115736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534662770982929:9632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:49.115754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534662770982929:9632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:49.115757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534662770982929:9632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:49.115765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:49.118228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:49.120389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:49.120759Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:49.120771Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:49.120783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:49.120863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:49.120905Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534662770983115:9634]
2025-10-02T08:13:49.121615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:49.121820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:49.121864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:49.122180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:49.122220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.122221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.122222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.122223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.122224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.122229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.122238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.122242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.122245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.122248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.122253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.122261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.122266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.122271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.122275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.122279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.122284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.122288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.122293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.122298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.122316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:49.130969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:49.132684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:49.132699Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:49.132700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:49.132704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:49.132709Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1860 [1:7556534662770983115:9634]
2025-10-02T08:13:49.132718Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:49.132733Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:49.132735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.132737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.132739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.132751Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:49.132755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:49.132760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:49.132833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.132835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.132838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:49.132840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:49.132915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:49.132917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.132930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.132943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:49.132962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770983094:9632], now have 1 active actors on pipe
2025-10-02T08:13:49.132967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534662770983109:9634]
2025-10-02T08:13:49.132969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534662770983109:9634]
2025-10-02T08:13:49.132979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:49.132987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1860
2025-10-02T08:13:49.132990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:49.133086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1860
2025-10-02T08:13:49.132989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:49.132993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:49.133001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:49.133004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:49.133008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534663230663238:2378], now have 1 active actors on pipe
2025-10-02T08:13:49.133012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.133015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.133050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534662770983109:9634]
2025-10-02T08:13:49.133057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:49.133069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:49.133071Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c7968da-c694a7e5-6484436e-585a0da6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:49.133077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.133081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.133083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:49.133091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.133099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:49.133133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.133203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.133206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.133219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.133259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1861 partition: 0 MaxSeqNo: 17 sessionId: src_id|1c7968da-c694a7e5-6484436e-585a0da6_0
2025-10-02T08:13:49.133588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a48cd2e-141cbcb9-664b30a2-8053ee91_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1c7968da-c694a7e5-6484436e-585a0da6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:49.138429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7968da-c694a7e5-6484436e-585a0da6_0] Write session: try to update token
2025-10-02T08:13:49.138447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7968da-c694a7e5-6484436e-585a0da6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:49.152609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId: src_id|1c7968da-c694a7e5-6484436e-585a0da6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:49.152900Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:49.152913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:49.152916Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:49.152924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534662770983109:9634]
2025-10-02T08:13:49.152928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534662770983109:9634]
2025-10-02T08:13:49.152971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:49.152973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:49.152982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:49.152982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.152984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:49.153127Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:49.155361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:49.200905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534662770983140:10829]
2025-10-02T08:13:49.201023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1860, pipe: [1:7556534662770983140:10829]
2025-10-02T08:13:49.298569Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:49.298959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.298972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.299006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770983140:10829], now have 1 active actors on pipe
2025-10-02T08:13:49.299113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:49.299123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:49.299184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1861 reason: error at write: Disconnected sessionId: src_id|1c7968da-c694a7e5-6484436e-585a0da6_0
2025-10-02T08:13:49.299225Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:49.299341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1861 sessionId: src_id|1c7968da-c694a7e5-6484436e-585a0da6_0 is DEAD
2025-10-02T08:13:49.299497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534662770983140:10829]
2025-10-02T08:13:49.299508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7968da-c694a7e5-6484436e-585a0da6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:49.299519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7968da-c694a7e5-6484436e-585a0da6_0] Write session will restart in 0.005688s
2025-10-02T08:13:49.299541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7968da-c694a7e5-6484436e-585a0da6_0] Write session: Do CDS request
2025-10-02T08:13:49.299551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7968da-c694a7e5-6484436e-585a0da6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:49.299623Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:49.306279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7968da-c694a7e5-6484436e-585a0da6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.306477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:49.306491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1862
2025-10-02T08:13:49.306608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.306638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:49.306643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:49.306646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:49.307034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1862 sessionId:  describe result for acl check
2025-10-02T08:13:49.307071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:49.307076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:49.307078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:49.307083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534662770983388:9622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:49.307588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534662770983388:9622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:49.310303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534662770983388:9622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:49.313111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:49.313501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534662770983388:9622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:49.313514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534662770983388:9622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:49.313516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534662770983388:9622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:49.313523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:49.314663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:49.314853Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:49.314863Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:49.314872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:49.314920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:49.314953Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534662770983567:9621]
2025-10-02T08:13:49.315584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:49.315805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:49.315845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:49.316137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:49.316179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.316185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.316186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.316187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.316188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.316193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.316214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.316219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.316223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.316227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.316232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.316245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.316256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.316262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.316267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.316273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.316277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.316283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.316291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.316297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.316320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:49.325163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:49.326944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:49.326960Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:49.326966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:49.326969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:49.326976Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1861 [1:7556534662770983567:9621]
2025-10-02T08:13:49.326987Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:49.327004Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:49.327007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.327011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.327013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.327027Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:49.327032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:49.327038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:49.327107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.327115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.327119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:49.327121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:49.327190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:49.327197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.327211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.327229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:49.327250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770983563:9622], now have 1 active actors on pipe
2025-10-02T08:13:49.327262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534662770983555:9621]
2025-10-02T08:13:49.327264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534662770983555:9621]
2025-10-02T08:13:49.327269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1861
2025-10-02T08:13:49.327271Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:49.327284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534663230663248:2378], now have 1 active actors on pipe
2025-10-02T08:13:49.327283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:49.327287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:49.327291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:49.327306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:49.327314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:49.327321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.327325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.327367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534662770983555:9621]
2025-10-02T08:13:49.327379Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:49.327389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:49.327393Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:49.327398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.327402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.327367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1861
2025-10-02T08:13:49.327404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:49.327413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.327420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:49.327459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.327502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.327508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.327521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.327558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1862 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0
2025-10-02T08:13:49.327889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7968da-c694a7e5-6484436e-585a0da6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:49.330420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0] Write session: try to update token
2025-10-02T08:13:49.330437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:49.343851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId: src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:49.346500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:49.347531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.347555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.347575Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:49.347578Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:49.347580Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:49.347589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534662770983555:9621]
2025-10-02T08:13:49.347594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534662770983555:9621]
2025-10-02T08:13:49.347645Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:49.347657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:49.347658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:49.347664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.347666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:49.347812Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:49.399900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534662770983594:10829]
2025-10-02T08:13:49.400032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1861, pipe: [1:7556534662770983594:10829]
2025-10-02T08:13:49.483441Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:49.484597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:49.484634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770983594:10829], now have 1 active actors on pipe
2025-10-02T08:13:49.484659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:49.484724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:49.484730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:49.484742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1862 reason: error at write: Disconnected sessionId: src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0
2025-10-02T08:13:49.484885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1862 sessionId: src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0 is DEAD
2025-10-02T08:13:49.485036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:49.485047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0] Write session will restart in 0.007877s
2025-10-02T08:13:49.485070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0] Write session: Do CDS request
2025-10-02T08:13:49.485077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:49.485340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534662770983594:10829]
2025-10-02T08:13:49.485769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:49.497200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.497240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:49.497256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1863
2025-10-02T08:13:49.497397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.497423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:49.497432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:49.497435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:49.497783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1863 sessionId:  describe result for acl check
2025-10-02T08:13:49.497810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:49.497816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:49.497817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:49.497821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534662770984003:9594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:49.498626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534662770984003:9594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:49.498877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:49.500081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534662770984003:9594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:49.500477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:49.500743Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:49.500753Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:49.500764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:49.500842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:49.500881Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534662770984049:9607]
2025-10-02T08:13:49.501469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:49.501647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:49.501708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:49.502181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:49.502228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.502233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.502234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.502235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.502236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.502240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.502249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.502252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.502255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.502259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.502263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.502269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.502274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.502278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.502282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.502286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.502289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.502293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.502297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.502301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.502316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:49.502957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534662770984003:9594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:49.502968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534662770984003:9594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:49.502970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534662770984003:9594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:49.502976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:49.510349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:49.511968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:49.511983Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:49.511986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:49.511991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:49.511998Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1862 [1:7556534662770984049:9607]
2025-10-02T08:13:49.512009Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:49.512026Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:49.512034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.512036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.512038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.512053Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:49.512057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:49.512063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:49.512131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.512139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.512142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:49.512144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:49.512212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:49.512220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.512234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.512246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:49.512266Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534662770984024:9607]
2025-10-02T08:13:49.512276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534662770984024:9607]
2025-10-02T08:13:49.512283Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:49.512291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1862
2025-10-02T08:13:49.512296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770984070:9594], now have 1 active actors on pipe
2025-10-02T08:13:49.512295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:49.512298Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:49.512303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:49.512316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:49.512320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:49.512325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534663230663280:2378], now have 1 active actors on pipe
2025-10-02T08:13:49.512329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.512333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.512373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534662770984024:9607]
2025-10-02T08:13:49.512381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:49.512395Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:49.512401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.512410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.512412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:49.512421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.512433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:49.512461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.512478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:49.512510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.512516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.512528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.512563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1863 partition: 0 MaxSeqNo: 17 sessionId: src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0
2025-10-02T08:13:49.512729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1862
2025-10-02T08:13:49.512875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d5de09a-a55df9f9-6255d151-c5b3ab08_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:49.515535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0] Write session: try to update token
2025-10-02T08:13:49.515551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:49.529967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId: src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:49.531947Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:49.531968Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:49.531970Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:49.531979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534662770984024:9607]
2025-10-02T08:13:49.531986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534662770984024:9607]
2025-10-02T08:13:49.532029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:49.532034Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:49.532036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.532038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:49.532040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:49.532174Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:49.532759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:49.585765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534662770984100:10829]
2025-10-02T08:13:49.585894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1862, pipe: [1:7556534662770984100:10829]
2025-10-02T08:13:49.671908Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:49.672392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.672405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.672444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770984100:10829], now have 1 active actors on pipe
2025-10-02T08:13:49.672580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534662770984100:10829]
2025-10-02T08:13:49.672607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:49.672609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:49.672678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1863 reason: error at write: Disconnected sessionId: src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0
2025-10-02T08:13:49.672719Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:49.672893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1863 sessionId: src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0 is DEAD
2025-10-02T08:13:49.672984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:49.672997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0] Write session will restart in 0.005828s
2025-10-02T08:13:49.673019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0] Write session: Do CDS request
2025-10-02T08:13:49.673028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:49.673178Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:49.680339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.680393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:49.680410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1864
2025-10-02T08:13:49.680527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.680569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:49.680580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:49.680584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:49.681025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1864 sessionId:  describe result for acl check
2025-10-02T08:13:49.681062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:49.681067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:49.681069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:49.681074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534662770984332:9559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:49.681623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534662770984332:9559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:49.684977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534662770984332:9559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:49.688497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534662770984332:9559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:49.688510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534662770984332:9559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:49.688512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534662770984332:9559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:49.688519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:49.688549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:49.690187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:49.690348Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:49.690356Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:49.690364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:49.690405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:49.690440Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534662770984534:9575]
2025-10-02T08:13:49.690877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:49.691061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:49.691094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:49.691306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:49.691336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.691340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.691341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.691341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.691342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.691345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.691352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.691355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.691357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.691359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.691363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.691368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.691371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.691374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.691377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.691380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.691382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.691385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.691387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.691390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.691401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:49.700091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:49.702001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:49.702019Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:49.702022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:49.702025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:49.702031Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1863 [1:7556534662770984534:9575]
2025-10-02T08:13:49.702044Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:49.702061Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:49.702063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.702065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.702066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.702079Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:49.702083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:49.702088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:49.702171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.702174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.702177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:49.702179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:49.702279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:49.702282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.702295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.702313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:49.702321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1863
2025-10-02T08:13:49.702332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770984526:9559], now have 1 active actors on pipe
2025-10-02T08:13:49.702338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534662770984521:9575]
2025-10-02T08:13:49.702339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534662770984521:9575]
2025-10-02T08:13:49.702345Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:49.702355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.702359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.702369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:49.702372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:49.702376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:49.702390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:49.702392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:49.702430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534663230663295:2378], now have 1 active actors on pipe
2025-10-02T08:13:49.702443Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5840952e-68f82e4d-be322930-aacfc29a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:49.702449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.702453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.702455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:49.702464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.702473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:49.702480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534662770984521:9575]
2025-10-02T08:13:49.702490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:49.702502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:49.702517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.702618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.702634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.702661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.702709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1864 partition: 0 MaxSeqNo: 17 sessionId: src_id|5840952e-68f82e4d-be322930-aacfc29a_0
2025-10-02T08:13:49.703064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c5d8d4-d622f806-725f54d9-65d26281_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5840952e-68f82e4d-be322930-aacfc29a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:49.704907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1863
2025-10-02T08:13:49.705704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5840952e-68f82e4d-be322930-aacfc29a_0] Write session: try to update token
2025-10-02T08:13:49.705720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5840952e-68f82e4d-be322930-aacfc29a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:49.719455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId: src_id|5840952e-68f82e4d-be322930-aacfc29a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:49.722144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:49.722263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.722278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.722317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:49.722341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:49.722566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.722579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.722738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.722801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.722867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.722935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.722979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.722987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.723057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.723119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.723183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.723249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.723291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.723298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.723361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.723420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.723472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.723529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.723575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.723584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.723647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.723712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.723785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.723857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.723917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.723919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.723994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.724058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.724124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.724187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.724240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.724242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.724313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.724371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.724434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.724496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.724541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.724544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.724618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.724681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.724753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.724852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.724903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.724916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.724992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.725065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.725133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.725192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.725236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.725238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.725302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.725354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.725407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.725474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.725523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.725524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.725596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:49.725655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:49.725706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:49.725764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:49.725807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:49.725809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:49.725863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:49.725922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.725941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.725943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:49.725975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:49.725988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:49.725992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:49.725995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:49.725998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:49.726353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:49.726368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:49.726372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:49.726375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:49.726377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:49.726379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:49.727211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:49.727224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:49.727229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:49.727232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:49.727234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:49.727238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:49.727664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:49.727673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:49.727677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:49.727680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:49.727682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:49.729252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:49.729268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:49.729280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392829729
2025-10-02T08:13:49.729481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:49.729494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:49.729499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:49.729505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:49.729511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:49.729518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:49.729953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:49.729976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:49.729982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:49.729987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:49.729990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:49.729994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:49.730408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:49.730430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:49.730441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:49.730444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:49.730447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:49.730450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:49.730849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:49.730869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:49.730875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:49.731879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:49.731893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:49.731898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:49.731902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:49.731911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392829731
2025-10-02T08:13:49.732168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:49.732186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:49.732196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:49.732210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:49.732215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:49.732218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:49.732638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:49.732661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:49.732667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:49.732670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:49.732674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:49.732678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:49.733209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:49.733230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.733319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392829732
2025-10-02T08:13:49.735536Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:49.735559Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:49.735565Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:49.735572Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:49.735597Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:49.735604Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:49.735606Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:49.735616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534662770984521:9575]
2025-10-02T08:13:49.735625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534662770984521:9575]
2025-10-02T08:13:49.735649Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:49.735656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:49.736550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:49.736564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.736566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:49.736711Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:49.772637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534662770984562:10829]
2025-10-02T08:13:49.772883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1863, pipe: [1:7556534662770984562:10829]
2025-10-02T08:13:49.879517Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:49.879979Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:49.879983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:49.879992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534662770984521:9575]
2025-10-02T08:13:49.880037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770984562:10829], now have 1 active actors on pipe
2025-10-02T08:13:49.880217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:49.880384Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:49.880716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:49.880983Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:49.880746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1864 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5840952e-68f82e4d-be322930-aacfc29a_0
2025-10-02T08:13:49.880875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534662770984562:10829]
2025-10-02T08:13:49.880909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1864 sessionId: src_id|5840952e-68f82e4d-be322930-aacfc29a_0 is DEAD
2025-10-02T08:13:49.881215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5840952e-68f82e4d-be322930-aacfc29a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:49.881223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5840952e-68f82e4d-be322930-aacfc29a_0] Write session will restart in 0.008768s
2025-10-02T08:13:49.881244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5840952e-68f82e4d-be322930-aacfc29a_0] Write session: Do CDS request
2025-10-02T08:13:49.881248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5840952e-68f82e4d-be322930-aacfc29a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:49.886674Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1863:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:49.886674Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f561a3363424f8b2] Result# TEvPutResult {Id# [72075186224037892:1863:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:49.886805Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1863:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:49.891382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5840952e-68f82e4d-be322930-aacfc29a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.891562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:49.891579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1865
2025-10-02T08:13:49.891704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:49.891739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:49.891744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:49.891748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:49.892132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1865 sessionId:  describe result for acl check
2025-10-02T08:13:49.892161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:49.892167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:49.892169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:49.892174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534662770984877:9564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:49.892702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534662770984877:9564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:49.895803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534662770984877:9564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:49.896629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:49.898272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:49.898510Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:49.898521Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:49.898534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:49.898583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:49.898679Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534662770984994:9567]
2025-10-02T08:13:49.898764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534662770984877:9564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:49.898774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534662770984877:9564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:49.898776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534662770984877:9564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:49.898783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:49.899312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:49.899515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:49.899558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:49.899855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:49.899895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.899901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.899902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.899903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.899904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.899911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.899919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.899923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.899927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.899930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.899934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.899940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:49.899945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.899950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:49.899954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.899958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:49.899961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.899965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.899971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.899975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.899990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:49.909024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:49.910556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:49.910573Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:49.910580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:49.910583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:49.910589Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1864 [1:7556534662770984994:9567]
2025-10-02T08:13:49.910602Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:49.910620Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:49.910623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.910625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.910627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.910644Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:49.910648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:49.910654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:49.910710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.910718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.910721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:49.910723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:49.910778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:49.910784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.910793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:49.910800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:49.910814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770984999:9564], now have 1 active actors on pipe
2025-10-02T08:13:49.910818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534662770984987:9567]
2025-10-02T08:13:49.910820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534662770984987:9567]
2025-10-02T08:13:49.910827Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:49.910838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:49.910839Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:49.910839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1864
2025-10-02T08:13:49.910842Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:49.910846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:49.910848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:49.910855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534663230663304:2378], now have 1 active actors on pipe
2025-10-02T08:13:49.910859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.910862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.910893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534662770984987:9567]
2025-10-02T08:13:49.910902Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:49.910909Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:49.910914Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:49.910919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:49.910927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:49.910931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:49.910941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:49.910949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:49.910985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.910951Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1864
2025-10-02T08:13:49.911056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:49.911066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:49.911078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:49.911115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1865 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0
2025-10-02T08:13:49.911419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5840952e-68f82e4d-be322930-aacfc29a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:49.914062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0] Write session: try to update token
2025-10-02T08:13:49.914078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:49.928153Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:49.928170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:49.928171Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:49.928179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534662770984987:9567]
2025-10-02T08:13:49.928183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534662770984987:9567]
2025-10-02T08:13:49.928235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:49.928246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:49.928247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:49.928249Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:49.928256Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:49.928373Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:49.931067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId: src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:49.933572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:49.981010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534662770985025:10829]
2025-10-02T08:13:49.981121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1864, pipe: [1:7556534662770985025:10829]
2025-10-02T08:13:50.071092Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:50.071326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:50.071338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0] Write session will restart in 0.007569s
2025-10-02T08:13:50.071362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0] Write session: Do CDS request
2025-10-02T08:13:50.071368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:50.070117Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:50.070480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.070488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.070525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534662770985025:10829], now have 1 active actors on pipe
2025-10-02T08:13:50.070669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:50.070673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:50.070753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1865 reason: error at write: Disconnected sessionId: src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0
2025-10-02T08:13:50.070935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1865 sessionId: src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0 is DEAD
2025-10-02T08:13:50.071099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534662770985025:10829]
2025-10-02T08:13:50.071214Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:50.080351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.080451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:50.080466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1866
2025-10-02T08:13:50.080618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.080648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:50.080653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:50.080657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:50.081126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1866 sessionId:  describe result for acl check
2025-10-02T08:13:50.081163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:50.081169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:50.081171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:50.081175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534667065952599:9543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:50.081863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534667065952599:9543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:50.088245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534667065952599:9543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:50.090184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:50.091785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:50.092071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534667065952599:9543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:50.092085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534667065952599:9543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:50.092087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534667065952599:9543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:50.092094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:50.092153Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:50.092164Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:50.092177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:50.092257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:50.092297Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534667065952754:9547]
2025-10-02T08:13:50.092965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:50.093174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:50.093224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:50.093543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:50.093629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.093635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.093637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.093640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.093641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.093646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.093657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.093661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.093665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.093669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.093675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.093682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.093688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.093694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.093698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.093703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.093707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.093713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.093723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.093728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.093760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:50.102574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:50.104127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:50.104143Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:50.104146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:50.104149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:50.104155Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1865 [1:7556534667065952754:9547]
2025-10-02T08:13:50.104164Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:50.104181Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:50.104183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.104186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.104187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.104218Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:50.104222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:50.104228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:50.104278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.104285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.104288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:50.104289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:50.104347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:50.104356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.104366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.104373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:50.104386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534667065952747:9547]
2025-10-02T08:13:50.104387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534667065952747:9547]
2025-10-02T08:13:50.104394Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:50.104405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:50.104413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:50.104416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:50.104424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065952756:9543], now have 1 active actors on pipe
2025-10-02T08:13:50.104424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:50.104428Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:50.104438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1865
2025-10-02T08:13:50.104452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534667065952747:9547]
2025-10-02T08:13:50.104454Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:50.104457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:50.104458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534667525630606:2378], now have 1 active actors on pipe
2025-10-02T08:13:50.104462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.104465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.104502Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:50.104511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.104518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.104520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:50.104527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.104538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:50.104519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1865
2025-10-02T08:13:50.104551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.104584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.104589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.104603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.104635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1866 partition: 0 MaxSeqNo: 17 sessionId: src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0
2025-10-02T08:13:50.104954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec22d68-94fab010-4a87530d-a9cd3cec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:50.107510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0] Write session: try to update token
2025-10-02T08:13:50.107528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:50.121790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId: src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:50.123225Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:50.123240Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:50.123242Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:50.123249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534667065952747:9547]
2025-10-02T08:13:50.123253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534667065952747:9547]
2025-10-02T08:13:50.123292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:50.123305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.123309Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:50.123312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:50.123315Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:50.123457Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:50.124543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:50.172955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534667065952783:10829]
2025-10-02T08:13:50.177245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1865, pipe: [1:7556534667065952783:10829]
2025-10-02T08:13:50.255955Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:50.256328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.256342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.256378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065952783:10829], now have 1 active actors on pipe
2025-10-02T08:13:50.256580Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:50.256632Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:50.256764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:50.256776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:50.256854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1866 reason: error at write: Disconnected sessionId: src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0
2025-10-02T08:13:50.256918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534667065952783:10829]
2025-10-02T08:13:50.257001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1866 sessionId: src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0 is DEAD
2025-10-02T08:13:50.257133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:50.257141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0] Write session will restart in 0.009504s
2025-10-02T08:13:50.257158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0] Write session: Do CDS request
2025-10-02T08:13:50.257163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:50.267410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.267487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:50.267503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1867
2025-10-02T08:13:50.267614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.267656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:50.267665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:50.267668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:50.268077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1867 sessionId:  describe result for acl check
2025-10-02T08:13:50.268114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:50.268120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:50.268121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:50.268126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534667065953168:9530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:50.268631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534667065953168:9530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:50.269802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:50.270776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534667065953168:9530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:50.271234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:50.271417Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:50.271428Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:50.271438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:50.271488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:50.271524Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534667065953215:9536]
2025-10-02T08:13:50.272126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:50.272327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:50.272376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:50.272688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:50.272737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.272742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.272743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.272744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.272745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.272750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.272760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.272764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.272768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.272772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.272777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.272783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.272789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.272794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.272818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.272823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.272833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.272838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.272843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.272848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.272869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:50.273253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534667065953168:9530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:50.273266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534667065953168:9530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:50.273270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534667065953168:9530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:50.273279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:50.280550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:50.282185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:50.282202Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:50.282205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:50.282209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:50.282215Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1866 [1:7556534667065953215:9536]
2025-10-02T08:13:50.282227Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:50.282243Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:50.282247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.282249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.282252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.282266Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:50.282278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:50.282283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:50.282341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.282349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.282352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:50.282355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:50.282417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:50.282424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.282437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.282452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:50.282472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1866
2025-10-02T08:13:50.282473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065953231:9530], now have 1 active actors on pipe
2025-10-02T08:13:50.282479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534667065953195:9536]
2025-10-02T08:13:50.282483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534667065953195:9536]
2025-10-02T08:13:50.282491Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:50.282501Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:50.282502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:50.282504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:50.282516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:50.282524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:50.282530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534667525630614:2378], now have 1 active actors on pipe
2025-10-02T08:13:50.282535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.282543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.282562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1866
2025-10-02T08:13:50.282584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534667065953195:9536]
2025-10-02T08:13:50.282591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:50.282594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:50.282605Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c828b44f-28d88a6b-292e62ce-775a102d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:50.282611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.282614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.282616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:50.282625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.282632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:50.282676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.282739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.282746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.282758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.282798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1867 partition: 0 MaxSeqNo: 17 sessionId: src_id|c828b44f-28d88a6b-292e62ce-775a102d_0
2025-10-02T08:13:50.283103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a6969f-75e13391-5c8649a1-a0b655b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c828b44f-28d88a6b-292e62ce-775a102d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:50.285774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c828b44f-28d88a6b-292e62ce-775a102d_0] Write session: try to update token
2025-10-02T08:13:50.285790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c828b44f-28d88a6b-292e62ce-775a102d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:50.297915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId: src_id|c828b44f-28d88a6b-292e62ce-775a102d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:50.298894Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:50.298910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:50.298912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:50.298920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534667065953195:9536]
2025-10-02T08:13:50.298924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534667065953195:9536]
2025-10-02T08:13:50.298965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:50.298970Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:50.298976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.298978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:50.298978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:50.299104Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:50.300105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:50.357353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534667065953245:10829]
2025-10-02T08:13:50.357422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1866, pipe: [1:7556534667065953245:10829]
2025-10-02T08:13:50.442377Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:50.442739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.442751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.442786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065953245:10829], now have 1 active actors on pipe
2025-10-02T08:13:50.442910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:50.442921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:50.442988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1867 reason: error at write: Disconnected sessionId: src_id|c828b44f-28d88a6b-292e62ce-775a102d_0
2025-10-02T08:13:50.443058Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:50.443165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1867 sessionId: src_id|c828b44f-28d88a6b-292e62ce-775a102d_0 is DEAD
2025-10-02T08:13:50.443356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534667065953245:10829]
2025-10-02T08:13:50.443554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c828b44f-28d88a6b-292e62ce-775a102d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:50.443565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c828b44f-28d88a6b-292e62ce-775a102d_0] Write session will restart in 0.008739s
2025-10-02T08:13:50.443587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c828b44f-28d88a6b-292e62ce-775a102d_0] Write session: Do CDS request
2025-10-02T08:13:50.443596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c828b44f-28d88a6b-292e62ce-775a102d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:50.444887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:50.453455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c828b44f-28d88a6b-292e62ce-775a102d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.453515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:50.453530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1868
2025-10-02T08:13:50.453695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.453724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:50.453735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:50.453738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:50.454166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1868 sessionId:  describe result for acl check
2025-10-02T08:13:50.454206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:50.454212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:50.454213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:50.454219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534667065953601:9519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:50.454777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534667065953601:9519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:50.457366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534667065953601:9519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:50.458788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:50.459137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:50.459409Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:50.459420Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:50.459432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:50.459498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:50.459551Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534667065953681:9520]
2025-10-02T08:13:50.460188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:50.460425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:50.460478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:50.460500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534667065953601:9519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:50.460510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534667065953601:9519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:50.460512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534667065953601:9519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:50.460518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:50.460819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:50.460879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.460885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.460886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.460887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.460888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.460894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.460904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.460908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.460911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.460914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.460919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.460928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.460934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.460940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.460944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.460950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.460958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.460963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.460968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.460977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.460997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:50.469259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:50.470863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:50.470870Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:50.470872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:50.470876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:50.470884Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1867 [1:7556534667065953681:9520]
2025-10-02T08:13:50.470897Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:50.470915Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:50.470919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.470922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.470924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.470942Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:50.470949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:50.470956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:50.471021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.471023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.471025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:50.471028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:50.471098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:50.471101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.471116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.471129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:50.471145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534667065953675:9520]
2025-10-02T08:13:50.471147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534667065953675:9520]
2025-10-02T08:13:50.471154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:50.471167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:50.471182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:50.471185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:50.471195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065953692:9519], now have 1 active actors on pipe
2025-10-02T08:13:50.471201Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:50.471206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:50.471230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534667065953675:9520]
2025-10-02T08:13:50.471233Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:50.471239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534667525630622:2378], now have 1 active actors on pipe
2025-10-02T08:13:50.471283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1867
2025-10-02T08:13:50.471448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:50.471514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.471531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.471560Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63e5513-d67f26fc-aaac3734-11ac167f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:50.471534Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1867
2025-10-02T08:13:50.471573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.471577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.471580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:50.471590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.471602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:50.471622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.471702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.471708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.471718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.471746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1868 partition: 0 MaxSeqNo: 17 sessionId: src_id|63e5513-d67f26fc-aaac3734-11ac167f_0
2025-10-02T08:13:50.472077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c828b44f-28d88a6b-292e62ce-775a102d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63e5513-d67f26fc-aaac3734-11ac167f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:50.474767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e5513-d67f26fc-aaac3734-11ac167f_0] Write session: try to update token
2025-10-02T08:13:50.474785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e5513-d67f26fc-aaac3734-11ac167f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:50.488258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId: src_id|63e5513-d67f26fc-aaac3734-11ac167f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:50.490499Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:50.490530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:50.490532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:50.490541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534667065953675:9520]
2025-10-02T08:13:50.490547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534667065953675:9520]
2025-10-02T08:13:50.490590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:50.490589Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:50.490594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:50.490597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.490599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:50.490661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:50.490730Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:50.543676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534667065953748:10829]
2025-10-02T08:13:50.543797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1867, pipe: [1:7556534667065953748:10829]
2025-10-02T08:13:50.640980Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:50.641393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.641407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.641443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065953748:10829], now have 1 active actors on pipe
2025-10-02T08:13:50.641722Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:50.641734Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:50.642085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:50.642095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534667065953748:10829]
2025-10-02T08:13:50.642140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1868 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63e5513-d67f26fc-aaac3734-11ac167f_0
2025-10-02T08:13:50.642300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1868 sessionId: src_id|63e5513-d67f26fc-aaac3734-11ac167f_0 is DEAD
2025-10-02T08:13:50.642448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e5513-d67f26fc-aaac3734-11ac167f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:50.642457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e5513-d67f26fc-aaac3734-11ac167f_0] Write session will restart in 0.007586s
2025-10-02T08:13:50.642482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e5513-d67f26fc-aaac3734-11ac167f_0] Write session: Do CDS request
2025-10-02T08:13:50.642488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e5513-d67f26fc-aaac3734-11ac167f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:50.653172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e5513-d67f26fc-aaac3734-11ac167f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.657100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:50.657120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1869
2025-10-02T08:13:50.657157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:50.657291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.657344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:50.657355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:50.657359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:50.657762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1869 sessionId:  describe result for acl check
2025-10-02T08:13:50.657797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:50.657800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:50.657801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:50.657807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534667065954168:9472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:50.658302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534667065954168:9472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:50.659022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:50.659198Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:50.659207Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:50.659216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:50.659269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:50.659304Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534667065954184:9476]
2025-10-02T08:13:50.659901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:50.660060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:50.660123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:50.660383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534667065954168:9472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:50.660421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:50.660460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.660465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.660466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.660466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.660467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.660472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.660481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.660488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.660492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.660499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.660504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.660514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.660524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.660529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.660537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.660540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.660548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.660553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.660557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.660560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.660578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:50.667130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534667065954168:9472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:50.667148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534667065954168:9472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:50.667151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534667065954168:9472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:50.667159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:50.668930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:50.670667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:50.670687Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:50.670690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:50.670694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:50.670700Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1868 [1:7556534667065954184:9476]
2025-10-02T08:13:50.670711Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:50.670727Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:50.670729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.670733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.670734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.670750Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:50.670755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:50.670761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:50.670827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.670834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.670837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:50.670839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:50.670900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:50.670908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.670922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.670939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:50.670960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534667065954161:9476]
2025-10-02T08:13:50.670963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534667065954161:9476]
2025-10-02T08:13:50.670971Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:50.670984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:50.670988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534667525630661:2378], now have 1 active actors on pipe
2025-10-02T08:13:50.670994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:50.670996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:50.670999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1868
2025-10-02T08:13:50.671011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:50.671014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:50.671020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065954214:9472], now have 1 active actors on pipe
2025-10-02T08:13:50.671056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.671065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.671077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534667065954161:9476]
2025-10-02T08:13:50.671086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:50.671096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:50.671118Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68488f24-6c99c937-d4a6749f-fd435c09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:50.671129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.671133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.671139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:50.671149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.671161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:50.671117Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1868
2025-10-02T08:13:50.671196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.671242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.671248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.671261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.671294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1869 partition: 0 MaxSeqNo: 17 sessionId: src_id|68488f24-6c99c937-d4a6749f-fd435c09_0
2025-10-02T08:13:50.671685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e5513-d67f26fc-aaac3734-11ac167f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|68488f24-6c99c937-d4a6749f-fd435c09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:50.674643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68488f24-6c99c937-d4a6749f-fd435c09_0] Write session: try to update token
2025-10-02T08:13:50.674663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68488f24-6c99c937-d4a6749f-fd435c09_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:50.691630Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:50.691648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:50.691650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:50.691660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534667065954161:9476]
2025-10-02T08:13:50.691665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534667065954161:9476]
2025-10-02T08:13:50.691710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:50.691719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.691722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:50.691741Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:50.691748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:50.691863Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:50.697431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId: src_id|68488f24-6c99c937-d4a6749f-fd435c09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:50.699995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:50.741973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534667065954229:10829]
2025-10-02T08:13:50.742420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1868, pipe: [1:7556534667065954229:10829]
2025-10-02T08:13:50.841369Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:50.842096Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:50.841798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.841815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.841855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065954229:10829], now have 1 active actors on pipe
2025-10-02T08:13:50.841986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534667065954229:10829]
2025-10-02T08:13:50.842021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:50.842023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:50.842057Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:50.842095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1869 reason: error at write: Disconnected sessionId: src_id|68488f24-6c99c937-d4a6749f-fd435c09_0
2025-10-02T08:13:50.842445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68488f24-6c99c937-d4a6749f-fd435c09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:50.842461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68488f24-6c99c937-d4a6749f-fd435c09_0] Write session will restart in 0.007956s
2025-10-02T08:13:50.842502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68488f24-6c99c937-d4a6749f-fd435c09_0] Write session: Do CDS request
2025-10-02T08:13:50.842513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68488f24-6c99c937-d4a6749f-fd435c09_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:50.842258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1869 sessionId: src_id|68488f24-6c99c937-d4a6749f-fd435c09_0 is DEAD
2025-10-02T08:13:50.851510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68488f24-6c99c937-d4a6749f-fd435c09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.851547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:50.851562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1870
2025-10-02T08:13:50.851728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:50.851760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:50.851765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:50.851768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:50.852174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1870 sessionId:  describe result for acl check
2025-10-02T08:13:50.852220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:50.852227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:50.852228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:50.852234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534667065954511:9453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:50.852773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534667065954511:9453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:50.857630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534667065954511:9453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:50.858936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:50.860325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:50.860536Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:50.860544Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:50.860554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:50.860598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:50.860629Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534667065954669:9452]
2025-10-02T08:13:50.860693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534667065954511:9453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:50.860706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534667065954511:9453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:50.860709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534667065954511:9453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:50.860718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:50.861095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:50.861242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:50.861274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:50.861477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:50.861512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.861518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.861519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.861520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.861521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.861526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.861532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.861534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.861537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.861539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.861543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.861547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:50.861550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.861554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:50.861557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.861560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:50.861562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.861565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.861568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.861571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.861583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:50.870064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:50.872786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:50.872912Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:50.872923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:50.872927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:50.872934Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1869 [1:7556534667065954669:9452]
2025-10-02T08:13:50.872949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:50.872977Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:50.872985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.872988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.872991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.873010Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:50.873023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:50.873030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:50.873122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.873133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.873136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:50.873139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:50.873226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:50.873235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.873251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:50.873269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:50.873292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065954674:9453], now have 1 active actors on pipe
2025-10-02T08:13:50.873300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1869
2025-10-02T08:13:50.873302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534667525630669:2378], now have 1 active actors on pipe
2025-10-02T08:13:50.873310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534667065954663:9452]
2025-10-02T08:13:50.873312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534667065954663:9452]
2025-10-02T08:13:50.873328Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:50.873345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.873345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:50.873349Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:50.873357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.873380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:50.873399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:50.873409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:50.873422Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1869
2025-10-02T08:13:50.873473Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fbd3e97-8b755717-38dce385-1dca561d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:50.873486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:50.873494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:50.873495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:50.873506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:50.873523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:50.873538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534667065954663:9452]
2025-10-02T08:13:50.873555Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:50.873567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:50.873601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.873715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.873727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.873746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:50.873793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1870 partition: 0 MaxSeqNo: 17 sessionId: src_id|4fbd3e97-8b755717-38dce385-1dca561d_0
2025-10-02T08:13:50.874189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68488f24-6c99c937-d4a6749f-fd435c09_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4fbd3e97-8b755717-38dce385-1dca561d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:50.877068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbd3e97-8b755717-38dce385-1dca561d_0] Write session: try to update token
2025-10-02T08:13:50.877086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbd3e97-8b755717-38dce385-1dca561d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:50.891019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId: src_id|4fbd3e97-8b755717-38dce385-1dca561d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:50.893900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:50.894625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:50.894647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:50.894667Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:50.894675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:50.894678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:50.894685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534667065954663:9452]
2025-10-02T08:13:50.894690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534667065954663:9452]
2025-10-02T08:13:50.894738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:50.894744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:50.894752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:50.894752Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:50.894754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:50.894896Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:50.942011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534667065954701:10829]
2025-10-02T08:13:50.942118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1869, pipe: [1:7556534667065954701:10829]
2025-10-02T08:13:51.043395Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:51.043729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:51.043778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:51.043781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534667065954701:10829], now have 1 active actors on pipe
2025-10-02T08:13:51.044538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:51.044547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:51.044578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1870 reason: error at write: Disconnected sessionId: src_id|4fbd3e97-8b755717-38dce385-1dca561d_0
2025-10-02T08:13:51.044720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1870 sessionId: src_id|4fbd3e97-8b755717-38dce385-1dca561d_0 is DEAD
2025-10-02T08:13:51.044752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534667065954701:10829]
2025-10-02T08:13:51.044902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbd3e97-8b755717-38dce385-1dca561d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:51.044913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbd3e97-8b755717-38dce385-1dca561d_0] Write session will restart in 0.005447s
2025-10-02T08:13:51.044936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbd3e97-8b755717-38dce385-1dca561d_0] Write session: Do CDS request
2025-10-02T08:13:51.044944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbd3e97-8b755717-38dce385-1dca561d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:51.044977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:51.052375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbd3e97-8b755717-38dce385-1dca561d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.052697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:51.052714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1871
2025-10-02T08:13:51.052878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.052913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:51.052923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:51.052927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:51.053371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1871 sessionId:  describe result for acl check
2025-10-02T08:13:51.053413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:51.053420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:51.053421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:51.053427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534671360922269:9432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:51.054007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534671360922269:9432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:51.061149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534671360922269:9432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:51.062863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:51.064766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:51.064966Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:51.064974Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:51.064983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:51.065028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:51.065059Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534671360922438:9434]
2025-10-02T08:13:51.065303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534671360922269:9432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:51.065315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534671360922269:9432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:51.065319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534671360922269:9432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:51.065327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:51.065738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:51.065945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:51.065990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:51.066280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:51.066327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.066327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.066328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.066329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.066330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.066335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.066341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.066343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.066345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.066347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.066351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.066356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.066361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.066365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.066369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.066373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.066377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.066381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.066386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.066391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.066408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:51.074405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:51.075865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:51.075882Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:51.075885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:51.075888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:51.075893Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1870 [1:7556534671360922438:9434]
2025-10-02T08:13:51.075903Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:51.075918Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:51.075920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.075921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.075923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.075936Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:51.075940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:51.075945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:51.075992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.075994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.075996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:51.075998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:51.076048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:51.076050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.076059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.076066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:51.076080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534671360922430:9434]
2025-10-02T08:13:51.076082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534671360922430:9434]
2025-10-02T08:13:51.076095Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:51.076104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:51.076113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:51.076115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:51.076143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534671360922430:9434]
2025-10-02T08:13:51.076145Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:51.076148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:51.076152Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:51.076159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:51.076521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1870
2025-10-02T08:13:51.076577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360922443:9432], now have 1 active actors on pipe
2025-10-02T08:13:51.076588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534671820597971:2378], now have 1 active actors on pipe
2025-10-02T08:13:51.076612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1870
2025-10-02T08:13:51.076630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.076634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.076660Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4877a58f-b228f2db-99a9c640-12fc1178_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:51.076667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.076671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.076674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:51.076684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.076697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:51.076711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.076744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.076750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.076761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.076790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1871 partition: 0 MaxSeqNo: 17 sessionId: src_id|4877a58f-b228f2db-99a9c640-12fc1178_0
2025-10-02T08:13:51.077147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbd3e97-8b755717-38dce385-1dca561d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4877a58f-b228f2db-99a9c640-12fc1178_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:51.079754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4877a58f-b228f2db-99a9c640-12fc1178_0] Write session: try to update token
2025-10-02T08:13:51.079769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4877a58f-b228f2db-99a9c640-12fc1178_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:51.089275Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:51.089292Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:51.089301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534671360922430:9434]
2025-10-02T08:13:51.089347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:51.089346Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:51.089526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:51.089676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:51.089817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:51.089960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:51.090158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:51.090191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:51.096133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId: src_id|4877a58f-b228f2db-99a9c640-12fc1178_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:51.098902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:51.099070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.099083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.099120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:51.099133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:51.099251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.099257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.099425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.099490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.099556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.099622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.099667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.099672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.099750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.099812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.099880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.099945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.099989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.099991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.100070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.100133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.100196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.100271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.100378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.100382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.100458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.100715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.100790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.100889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.100938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.100942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.101026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.101098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.101174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.101252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.101307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.101310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.101392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.101468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.101542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.101619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.101732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.101735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.101814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.101882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.101958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.102030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.102082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.102085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.102164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.102234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.102308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.102383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.102434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.102437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.102514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.102574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.102642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.102713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.102764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.102767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.102849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.102925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.103003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.103086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.103140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.103143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.103189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:51.103260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.103280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.103282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:51.103321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:51.103334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:51.103338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:51.103342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:51.103345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:51.103780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:51.103795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:51.103800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:51.103803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:51.103805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:51.103808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:51.104308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:51.104319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:51.104326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:51.104328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:51.104331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:51.104333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:51.105154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:51.105171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:51.105175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:51.105177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:51.105180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:51.107324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:51.107332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:51.107344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392831106
2025-10-02T08:13:51.107496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:51.107505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:51.107511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:51.107515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:51.107518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:51.107520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:51.108453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:51.108479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:51.108486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:51.108491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:51.108494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:51.108498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:51.109087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:51.109103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:51.109108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:51.109113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:51.109115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:51.109117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:51.109522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:51.109531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:51.109534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:51.110485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:51.110490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:51.110493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:51.110497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:51.110502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392831110
2025-10-02T08:13:51.110769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:51.110777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:51.110783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:51.110785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:51.110787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:51.110790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:51.111210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:51.111222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:51.111226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:51.111229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:51.111231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:51.111233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:51.111628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:51.111637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.111718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392831111
2025-10-02T08:13:51.112412Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:51.112423Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:51.112429Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:51.112435Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:51.114007Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:51.114020Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:51.114022Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:51.114029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534671360922430:9434]
2025-10-02T08:13:51.114033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534671360922430:9434]
2025-10-02T08:13:51.114092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:51.114100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.114102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:51.114229Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:51.116851Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:51.116865Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:51.144921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534671360922476:10829]
2025-10-02T08:13:51.145097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1870, pipe: [1:7556534671360922476:10829]
2025-10-02T08:13:51.252546Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:51.252976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360922476:10829], now have 1 active actors on pipe
2025-10-02T08:13:51.253153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534671360922476:10829]
2025-10-02T08:13:51.253180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:51.253183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:51.253228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1871 reason: error at write: Disconnected sessionId: src_id|4877a58f-b228f2db-99a9c640-12fc1178_0
2025-10-02T08:13:51.253291Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:51.253408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1871 sessionId: src_id|4877a58f-b228f2db-99a9c640-12fc1178_0 is DEAD
2025-10-02T08:13:51.253555Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:51.253725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4877a58f-b228f2db-99a9c640-12fc1178_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:51.253735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4877a58f-b228f2db-99a9c640-12fc1178_0] Write session will restart in 0.005689s
2025-10-02T08:13:51.253758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4877a58f-b228f2db-99a9c640-12fc1178_0] Write session: Do CDS request
2025-10-02T08:13:51.253764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4877a58f-b228f2db-99a9c640-12fc1178_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:51.260734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4877a58f-b228f2db-99a9c640-12fc1178_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.261003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:51.261018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1872
2025-10-02T08:13:51.261137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.261179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:51.261188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:51.261192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:51.262147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1872 sessionId:  describe result for acl check
2025-10-02T08:13:51.262181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:51.262186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:51.262188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:51.262194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534671360922674:9406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:51.262706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534671360922674:9406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:51.265579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534671360922674:9406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:51.269406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534671360922674:9406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:51.269421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534671360922674:9406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:51.269425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534671360922674:9406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:51.269434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:51.274008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:51.275872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:51.276044Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:51.276054Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:51.276063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:51.276112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:51.276157Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534671360922924:9412]
2025-10-02T08:13:51.276787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:51.276985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:51.277028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:51.277317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:51.277366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.277371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.277372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.277374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.277374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.277379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.277388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.277392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.277395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.277399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.277404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.277411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.277416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.277420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.277424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.277428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.277432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.277436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.277440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.277444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.277460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:51.286343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:51.287810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:51.287823Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:51.287825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:51.287828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:51.287836Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1871 [1:7556534671360922924:9412]
2025-10-02T08:13:51.287846Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:51.287862Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:51.287863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.287865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.287867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.287879Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:51.287883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:51.287888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:51.287937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.287943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.287946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:51.287948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:51.288008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:51.288015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.288026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.288037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:51.288052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534671360922918:9412]
2025-10-02T08:13:51.288057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534671360922918:9412]
2025-10-02T08:13:51.288064Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:51.288073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360922869:9406], now have 1 active actors on pipe
2025-10-02T08:13:51.288080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:51.288081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1871
2025-10-02T08:13:51.288087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:51.288088Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:51.288090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:51.288091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:51.288119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534671360922918:9412]
2025-10-02T08:13:51.288131Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:51.288137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:51.288142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534671820597979:2378], now have 1 active actors on pipe
2025-10-02T08:13:51.288146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.288151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.288189Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:51.288197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.288211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.288213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:51.288221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.288233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:51.288248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.288241Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1871
2025-10-02T08:13:51.288284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.288291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.288309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.288347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1872 partition: 0 MaxSeqNo: 17 sessionId: src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0
2025-10-02T08:13:51.288638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4877a58f-b228f2db-99a9c640-12fc1178_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:51.291220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0] Write session: try to update token
2025-10-02T08:13:51.291234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:51.311336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId: src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:51.313987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:51.314814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.314840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.314860Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:51.314863Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:51.314866Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:51.314873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534671360922918:9412]
2025-10-02T08:13:51.314878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534671360922918:9412]
2025-10-02T08:13:51.314934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:51.314948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.314950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:51.315093Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:51.315276Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:51.315290Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:51.353142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534671360922948:10829]
2025-10-02T08:13:51.353272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1871, pipe: [1:7556534671360922948:10829]
2025-10-02T08:13:51.451086Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:51.451427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:51.451486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:51.451491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360922948:10829], now have 1 active actors on pipe
2025-10-02T08:13:51.451595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:51.451605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:51.451626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1872 reason: error at write: Disconnected sessionId: src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0
2025-10-02T08:13:51.451757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1872 sessionId: src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0 is DEAD
2025-10-02T08:13:51.451889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:51.451898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0] Write session will restart in 0.006219s
2025-10-02T08:13:51.451923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0] Write session: Do CDS request
2025-10-02T08:13:51.451930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:51.451944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534671360922948:10829]
2025-10-02T08:13:51.452936Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:51.461232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.463855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:51.463873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1873
2025-10-02T08:13:51.464172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.464214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:51.464219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:51.464222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:51.465340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1873 sessionId:  describe result for acl check
2025-10-02T08:13:51.465380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:51.465382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:51.465383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:51.465388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534671360923285:9401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:51.465980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534671360923285:9401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:51.472129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534671360923285:9401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:51.473349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:51.475234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:51.475373Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:51.475379Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:51.475386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:51.475423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:51.475451Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534671360923394:9398]
2025-10-02T08:13:51.475766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534671360923285:9401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:51.475780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534671360923285:9401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:51.475783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534671360923285:9401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:51.475791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:51.476020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:51.476405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:51.476444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:51.476704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:51.476748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.476749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.476750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.476751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.476752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.476756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.476766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.476769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.476773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.476776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.476780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.476787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.476793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.476797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.476820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.476825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.476828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.476833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.476837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.476840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.476857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:51.488536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:51.490204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:51.490220Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:51.490223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:51.490226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:51.490231Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1872 [1:7556534671360923394:9398]
2025-10-02T08:13:51.490238Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:51.490251Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:51.490253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.490255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.490256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.490269Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:51.490276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:51.490281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:51.490330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.490337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.490339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:51.490341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:51.490385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:51.490391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.490399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.490409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1872
2025-10-02T08:13:51.490413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:51.490430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360923399:9401], now have 1 active actors on pipe
2025-10-02T08:13:51.490438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534671820597986:2378], now have 1 active actors on pipe
2025-10-02T08:13:51.490442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.490450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.490473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534671360923386:9398]
2025-10-02T08:13:51.490478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534671360923386:9398]
2025-10-02T08:13:51.490485Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:51.490475Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1872
2025-10-02T08:13:51.490498Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:51.490498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:51.490509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:51.490510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:51.490512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:51.490524Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4aa87ed-2677d06-9189dced-28706cc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:51.490528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.490532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.490534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:51.490542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.490551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:51.490587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534671360923386:9398]
2025-10-02T08:13:51.490596Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:51.490608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:51.490610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.490653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.490658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.490668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.490699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1873 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4aa87ed-2677d06-9189dced-28706cc7_0
2025-10-02T08:13:51.490990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916bc949-c5b80d75-f4a5cb0c-5267697a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4aa87ed-2677d06-9189dced-28706cc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:51.493497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4aa87ed-2677d06-9189dced-28706cc7_0] Write session: try to update token
2025-10-02T08:13:51.493511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4aa87ed-2677d06-9189dced-28706cc7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:51.501632Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:51.501652Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:51.501660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534671360923386:9398]
2025-10-02T08:13:51.501694Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:51.501705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:51.501880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:51.502020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:51.502157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:51.502302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:51.502486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:51.502518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:51.510377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId: src_id|b4aa87ed-2677d06-9189dced-28706cc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:51.513254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:51.513331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.513346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.513380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:51.513409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:51.513463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.513476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.513661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.513734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.513797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.513856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.513900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.513904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.513976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.514033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.514088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.514149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.514188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.514191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.514265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.514329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.514398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.514464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.514511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.514514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.514592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.514661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.514728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.514795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.514842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.514845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.514924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.514989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.515056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.515125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.515172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.515175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.515249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.515315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.515381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.515449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.515496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.515499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.515578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.515642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.515714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.515784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.515831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.515834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.515906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.515964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.516024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.516086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.516139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.516142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.516230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.516289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.516350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.516411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.516459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.516462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.516538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:51.516593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:51.516649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:51.516709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:51.516749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:51.516751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:51.517092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:51.517167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.517188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.517194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:51.517223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:51.517237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:51.517244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:51.517247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:51.517250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:51.517621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:51.517646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:51.517656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:51.517659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:51.517662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:51.517666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:51.518298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:51.518320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:51.518326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:51.518328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:51.518331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:51.518333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:51.518774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:51.518796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:51.518805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:51.518812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:51.518815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:51.520950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:51.520966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:51.520976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392831520
2025-10-02T08:13:51.521146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:51.521162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:51.521167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:51.521170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:51.521174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:51.521176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:51.521613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:51.521636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:51.521640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:51.521650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:51.521653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:51.521655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:51.522094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:51.522115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:51.522123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:51.522130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:51.522133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:51.522135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:51.522567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:51.522586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:51.522592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:51.523650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:51.523666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:51.523675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:51.523679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:51.523685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392831523
2025-10-02T08:13:51.523968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:51.523986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:51.523993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:51.523996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:51.524000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:51.524003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:51.524465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:51.524487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:51.524492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:51.524495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:51.524498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:51.524504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:51.524970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:51.524990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.525078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392831524
2025-10-02T08:13:51.527393Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:51.527429Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:51.527437Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:51.527444Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:51.527456Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:51.527464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:51.527466Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:51.527475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534671360923386:9398]
2025-10-02T08:13:51.527483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534671360923386:9398]
2025-10-02T08:13:51.527532Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:51.527546Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:51.527564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:51.527573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.527575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:51.527717Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:51.577821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534671360923439:10829]
2025-10-02T08:13:51.581406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1872, pipe: [1:7556534671360923439:10829]
2025-10-02T08:13:51.663686Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:51.664820Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:51.664223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360923439:10829], now have 1 active actors on pipe
2025-10-02T08:13:51.664473Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:51.664796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:51.664840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4aa87ed-2677d06-9189dced-28706cc7_0
2025-10-02T08:13:51.664884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534671360923439:10829]
2025-10-02T08:13:51.665336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4aa87ed-2677d06-9189dced-28706cc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:51.665345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4aa87ed-2677d06-9189dced-28706cc7_0] Write session will restart in 0.008384s
2025-10-02T08:13:51.665362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4aa87ed-2677d06-9189dced-28706cc7_0] Write session: Do CDS request
2025-10-02T08:13:51.665370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4aa87ed-2677d06-9189dced-28706cc7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:51.665009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1873 sessionId: src_id|b4aa87ed-2677d06-9189dced-28706cc7_0 is DEAD
2025-10-02T08:13:51.671737Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f8b4f87f5daa0882] Result# TEvPutResult {Id# [72075186224037892:1872:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:51.671792Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1872:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:51.671878Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1872:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:51.675219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4aa87ed-2677d06-9189dced-28706cc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.675686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:51.675701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1874
2025-10-02T08:13:51.675984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.676016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:51.676021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:51.676025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:51.676586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1874 sessionId:  describe result for acl check
2025-10-02T08:13:51.676621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:51.676623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:51.676624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:51.676629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534671360923742:9374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:51.677217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534671360923742:9374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:51.680968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534671360923742:9374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:51.687521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534671360923742:9374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:51.687539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534671360923742:9374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:51.687543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534671360923742:9374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:51.687553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:51.689158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:51.691563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:51.691842Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:51.691855Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:51.691866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:51.691931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:51.691968Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534671360923935:9375]
2025-10-02T08:13:51.692678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:51.692917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:51.692965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:51.693277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:51.693313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.693315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.693316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.693317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.693318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.693324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.693335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.693339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.693344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.693348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.693354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.693363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.693368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.693374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.693379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.693385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.693390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.693395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.693400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.693406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.693427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:51.706029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:51.707626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:51.707648Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:51.707651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:51.707655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:51.707662Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1873 [1:7556534671360923935:9375]
2025-10-02T08:13:51.707674Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:51.707692Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:51.707700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.707704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.707707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.707723Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:51.707734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:51.707740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:51.707805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.707812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.707815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:51.707818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:51.707888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:51.707896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.707910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.707926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:51.707954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534671360923929:9375]
2025-10-02T08:13:51.707964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534671360923929:9375]
2025-10-02T08:13:51.707971Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:51.707987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360923915:9374], now have 1 active actors on pipe
2025-10-02T08:13:51.707996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:51.707997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:51.708001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:51.708009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:51.708015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:51.708048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534671820598027:2378], now have 1 active actors on pipe
2025-10-02T08:13:51.708051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534671360923929:9375]
2025-10-02T08:13:51.708054Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:51.708095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1873
2025-10-02T08:13:51.708147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:51.708293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.708304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.708328Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:51.708343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.708351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.708353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:51.708364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.708374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:51.708394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.708469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.708478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.708494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.708532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1874 partition: 0 MaxSeqNo: 17 sessionId: src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0
2025-10-02T08:13:51.708610Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1873
2025-10-02T08:13:51.709016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4aa87ed-2677d06-9189dced-28706cc7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:51.711699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0] Write session: try to update token
2025-10-02T08:13:51.711714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:51.727583Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:51.727605Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:51.727608Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:51.727616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534671360923929:9375]
2025-10-02T08:13:51.727621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534671360923929:9375]
2025-10-02T08:13:51.727665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:51.727677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.727683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:51.727826Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:51.728352Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:51.728368Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:51.729662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId: src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:51.732230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:51.764508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534671360923962:10829]
2025-10-02T08:13:51.765086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1873, pipe: [1:7556534671360923962:10829]
2025-10-02T08:13:51.858403Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:51.858820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.858831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.858865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360923962:10829], now have 1 active actors on pipe
2025-10-02T08:13:51.859007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534671360923962:10829]
2025-10-02T08:13:51.859034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:51.859040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:51.859099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1874 reason: error at write: Disconnected sessionId: src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0
2025-10-02T08:13:51.859265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1874 sessionId: src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0 is DEAD
2025-10-02T08:13:51.859395Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:51.859988Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:51.860287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:51.860300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0] Write session will restart in 0.009462s
2025-10-02T08:13:51.860325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0] Write session: Do CDS request
2025-10-02T08:13:51.860332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:51.871291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.871338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:51.871357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1875
2025-10-02T08:13:51.871512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:51.871553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:51.871559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:51.871563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:51.872025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1875 sessionId:  describe result for acl check
2025-10-02T08:13:51.872057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:51.872062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:51.872063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:51.872067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534671360924288:9363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:51.872472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534671360924288:9363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:51.875712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534671360924288:9363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:51.878515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:51.878960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:51.879140Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:51.879151Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:51.879161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:51.879211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:51.879240Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534671360924411:9359]
2025-10-02T08:13:51.879900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:51.880112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:51.880152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:51.880157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534671360924288:9363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:51.880163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534671360924288:9363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:51.880167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534671360924288:9363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:51.880176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:51.880468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:51.880512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.880518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.880519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.880520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.880521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.880526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.880536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.880540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.880545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.880548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.880554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.880561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:51.880567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.880572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:51.880577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.880584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:51.880589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.880599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.880606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.880614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.880635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:51.899461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:51.901249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:51.901263Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:51.901265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:51.901269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:51.901273Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1874 [1:7556534671360924411:9359]
2025-10-02T08:13:51.901281Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:51.901295Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:51.901297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.901299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.901300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.901313Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:51.901316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:51.901321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:51.901380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.901387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.901390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:51.901393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:51.901452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:51.901461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.901474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:51.901490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:51.901508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534671360924405:9359]
2025-10-02T08:13:51.901514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534671360924405:9359]
2025-10-02T08:13:51.901522Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:51.901538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:51.901555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:51.901561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:51.901572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360924422:9363], now have 1 active actors on pipe
2025-10-02T08:13:51.901606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534671360924405:9359]
2025-10-02T08:13:51.901612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:51.901651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1874
2025-10-02T08:13:51.901675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:51.901684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:51.901690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:51.901706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534671820598036:2378], now have 1 active actors on pipe
2025-10-02T08:13:51.901786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.901792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.901811Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:51.901815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:51.901821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:51.901823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:51.901830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:51.901836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:51.901852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.901999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:51.902005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:51.902016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:51.902048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1875 partition: 0 MaxSeqNo: 17 sessionId: src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0
2025-10-02T08:13:51.902352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf064e4-4fe333f8-48f4fac4-409db995_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:51.904856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0] Write session: try to update token
2025-10-02T08:13:51.904876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:51.904903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1874
2025-10-02T08:13:51.919769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId: src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:51.920846Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:51.920861Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:51.920864Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:51.920871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534671360924405:9359]
2025-10-02T08:13:51.920875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534671360924405:9359]
2025-10-02T08:13:51.920919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:51.920932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:51.920935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:51.920951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:51.920956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:51.921077Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:51.922418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:51.959483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534671360924443:10829]
2025-10-02T08:13:51.960710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1874, pipe: [1:7556534671360924443:10829]
2025-10-02T08:13:52.057504Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:52.057974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.057984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.058026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534671360924443:10829], now have 1 active actors on pipe
2025-10-02T08:13:52.058672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:52.058362Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:52.058394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534671360924443:10829]
2025-10-02T08:13:52.058413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:52.058475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1875 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0
2025-10-02T08:13:52.058633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1875 sessionId: src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0 is DEAD
2025-10-02T08:13:52.058970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:52.058981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0] Write session will restart in 0.007083s
2025-10-02T08:13:52.059008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0] Write session: Do CDS request
2025-10-02T08:13:52.059014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:52.067245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.067380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:52.067396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1876
2025-10-02T08:13:52.067482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.067510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:52.067515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:52.067518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:52.067934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1876 sessionId:  describe result for acl check
2025-10-02T08:13:52.067968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:52.067970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:52.067971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:52.067976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534675655891950:9338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:52.068429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534675655891950:9338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:52.073865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534675655891950:9338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:52.077119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:52.077833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534675655891950:9338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:52.077847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534675655891950:9338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:52.077850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534675655891950:9338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:52.077857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:52.078781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:52.078965Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:52.078969Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:52.078980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:52.079032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:52.079080Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534675655892196:9346]
2025-10-02T08:13:52.079673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:52.079876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:52.079916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:52.080130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:52.080161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.080166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.080167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.080168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.080169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.080175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.080185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.080189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.080191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.080194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.080199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.080217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.080224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.080228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.080232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.080236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.080239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.080242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.080246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.080250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.080267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:52.092679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:52.094482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:52.094503Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:52.094505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:52.094508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:52.094515Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1875 [1:7556534675655892196:9346]
2025-10-02T08:13:52.094527Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:52.094543Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:52.094546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.094549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.094552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.094566Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:52.094576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:52.094583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:52.094646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.094655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.094658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:52.094662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:52.094726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:52.094733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.094746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.094757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:52.094779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655892192:9338], now have 1 active actors on pipe
2025-10-02T08:13:52.094781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1875
2025-10-02T08:13:52.094787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534676115565338:2378], now have 1 active actors on pipe
2025-10-02T08:13:52.094793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534675655892184:9346]
2025-10-02T08:13:52.094795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534675655892184:9346]
2025-10-02T08:13:52.094807Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:52.094817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.094820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.094822Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:52.094825Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:52.094838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:52.094853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:52.094862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:52.094909Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:52.094893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1875
2025-10-02T08:13:52.094921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.094925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.094927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:52.094936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.094946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:52.094954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534675655892184:9346]
2025-10-02T08:13:52.094966Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:52.094980Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:52.094999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.095083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.095090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.095103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.095144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1876 partition: 0 MaxSeqNo: 17 sessionId: src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0
2025-10-02T08:13:52.095561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75b7c31-44864bb4-6e1c0f04-d8d119c4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:52.098153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0] Write session: try to update token
2025-10-02T08:13:52.098168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:52.111546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId: src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:52.113054Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:52.113069Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:52.113071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:52.113079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534675655892184:9346]
2025-10-02T08:13:52.113083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534675655892184:9346]
2025-10-02T08:13:52.113121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:52.113130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.113132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:52.113142Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:52.113147Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:52.113263Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:52.114191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:52.158569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534675655892221:10829]
2025-10-02T08:13:52.158695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1875, pipe: [1:7556534675655892221:10829]
2025-10-02T08:13:52.246207Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:52.246590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.246603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.246647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655892221:10829], now have 1 active actors on pipe
2025-10-02T08:13:52.246791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534675655892221:10829]
2025-10-02T08:13:52.246829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:52.246832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:52.246862Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:52.246897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1876 reason: error at write: Disconnected sessionId: src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0
2025-10-02T08:13:52.246892Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:52.247077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1876 sessionId: src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0 is DEAD
2025-10-02T08:13:52.247203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:52.247210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0] Write session will restart in 0.007595s
2025-10-02T08:13:52.247229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0] Write session: Do CDS request
2025-10-02T08:13:52.247234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:52.256308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.256396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:52.256411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1877
2025-10-02T08:13:52.256529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.256557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:52.256562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:52.256566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:52.257017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1877 sessionId:  describe result for acl check
2025-10-02T08:13:52.257067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:52.257069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:52.257070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:52.257075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534675655892564:9335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:52.257718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534675655892564:9335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:52.260771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534675655892564:9335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:52.263417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534675655892564:9335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:52.263450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534675655892564:9335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:52.263453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534675655892564:9335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:52.263462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:52.265098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:52.265540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:52.265694Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:52.265705Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:52.265714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:52.265760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:52.265797Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534675655892679:9332]
2025-10-02T08:13:52.266371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:52.266548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:52.266587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:52.266851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:52.266907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.266912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.266913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.266915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.266916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.266920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.266929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.266933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.266936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.266939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.266944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.266950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.266955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.266959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.266963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.266967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.266971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.266975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.266979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.266983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.267002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:52.274970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:52.276664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:52.276681Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:52.276683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:52.276687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:52.276693Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1876 [1:7556534675655892679:9332]
2025-10-02T08:13:52.276705Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:52.276721Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:52.276725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.276727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.276730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.276744Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:52.276749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:52.276755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:52.276835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.276842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.276845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:52.276848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:52.276909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:52.276919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.276931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.276941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:52.276958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655892670:9335], now have 1 active actors on pipe
2025-10-02T08:13:52.276964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534676115565347:2378], now have 1 active actors on pipe
2025-10-02T08:13:52.276969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534675655892673:9332]
2025-10-02T08:13:52.276971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534675655892673:9332]
2025-10-02T08:13:52.276978Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:52.276980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1876
2025-10-02T08:13:52.276988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:52.276989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:52.276992Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:52.277004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:52.277007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:52.277013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.277017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.277057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534675655892673:9332]
2025-10-02T08:13:52.277067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:52.277076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:52.277082Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c406b205-59f8912d-9809af8a-a8771a8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:52.277087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.277091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.277093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:52.277101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.277073Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1876
2025-10-02T08:13:52.277109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:52.277146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.277219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.277225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.277237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.277269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1877 partition: 0 MaxSeqNo: 17 sessionId: src_id|c406b205-59f8912d-9809af8a-a8771a8f_0
2025-10-02T08:13:52.277573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbd4d77-17b9a391-28762cfc-e050b44f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c406b205-59f8912d-9809af8a-a8771a8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:52.280060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c406b205-59f8912d-9809af8a-a8771a8f_0] Write session: try to update token
2025-10-02T08:13:52.280077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c406b205-59f8912d-9809af8a-a8771a8f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:52.294532Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:52.294553Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:52.294556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:52.294563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534675655892673:9332]
2025-10-02T08:13:52.294569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534675655892673:9332]
2025-10-02T08:13:52.294610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:52.294613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:52.294619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:52.294621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.294623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:52.294765Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:52.298990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId: src_id|c406b205-59f8912d-9809af8a-a8771a8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:52.301770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:52.346973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534675655892706:10829]
2025-10-02T08:13:52.347104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1876, pipe: [1:7556534675655892706:10829]
2025-10-02T08:13:52.431149Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:52.431549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.431566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.431605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655892706:10829], now have 1 active actors on pipe
2025-10-02T08:13:52.431739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:52.431749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:52.431812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1877 reason: error at write: Disconnected sessionId: src_id|c406b205-59f8912d-9809af8a-a8771a8f_0
2025-10-02T08:13:52.431830Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:52.431968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1877 sessionId: src_id|c406b205-59f8912d-9809af8a-a8771a8f_0 is DEAD
2025-10-02T08:13:52.432010Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:52.432098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406b205-59f8912d-9809af8a-a8771a8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:52.432108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406b205-59f8912d-9809af8a-a8771a8f_0] Write session will restart in 0.005688s
2025-10-02T08:13:52.432130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406b205-59f8912d-9809af8a-a8771a8f_0] Write session: Do CDS request
2025-10-02T08:13:52.432135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406b205-59f8912d-9809af8a-a8771a8f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:52.432125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534675655892706:10829]
2025-10-02T08:13:52.439277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c406b205-59f8912d-9809af8a-a8771a8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.439346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:52.439362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1878
2025-10-02T08:13:52.439478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.439508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:52.439517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:52.439520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:52.439956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1878 sessionId:  describe result for acl check
2025-10-02T08:13:52.439983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:52.439990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:52.439991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:52.439996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534675655892994:9299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:52.440509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534675655892994:9299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:52.445095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534675655892994:9299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:52.447928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:52.448231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:52.448289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534675655892994:9299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:52.448303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534675655892994:9299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:52.448310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534675655892994:9299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:52.448319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:52.448366Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:52.448374Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:52.448382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:52.448415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:52.448443Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534675655893164:9309]
2025-10-02T08:13:52.448868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:52.448995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:52.449021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:52.449205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:52.449232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.449236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.449237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.449238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.449238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.449242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.449248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.449250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.449252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.449254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.449258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.449262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.449265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.449268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.449270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.449273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.449275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.449278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.449281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.449285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.449304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:52.457046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:52.458806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:52.458822Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:52.458824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:52.458828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:52.458833Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1877 [1:7556534675655893164:9309]
2025-10-02T08:13:52.458845Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:52.458864Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:52.458867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.458870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.458872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.458887Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:52.458892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:52.458898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:52.458960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.458969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.458972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:52.458975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:52.459035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:52.459042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.459055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.459072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:52.459093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534675655893157:9309]
2025-10-02T08:13:52.459099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534675655893157:9309]
2025-10-02T08:13:52.459106Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:52.459117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:52.459118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:52.459128Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:52.459132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:52.459135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:52.459144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534676115565354:2378], now have 1 active actors on pipe
2025-10-02T08:13:52.459145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1877
2025-10-02T08:13:52.459154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655893167:9299], now have 1 active actors on pipe
2025-10-02T08:13:52.459185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.459194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.459207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534675655893157:9309]
2025-10-02T08:13:52.459215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:52.459238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:52.459240Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:52.459210Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1877
2025-10-02T08:13:52.459247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.459252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.459254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:52.459264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.459273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:52.459300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.459345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.459351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.459365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.459405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1878 partition: 0 MaxSeqNo: 17 sessionId: src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0
2025-10-02T08:13:52.459725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406b205-59f8912d-9809af8a-a8771a8f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:52.462208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0] Write session: try to update token
2025-10-02T08:13:52.462223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:52.475817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId: src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:52.476865Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:52.476880Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:52.476882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:52.476890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534675655893157:9309]
2025-10-02T08:13:52.476895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534675655893157:9309]
2025-10-02T08:13:52.476939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:52.476951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.476953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:52.477054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:52.477071Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:52.477098Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:52.478304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:52.532328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534675655893194:10829]
2025-10-02T08:13:52.532464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1877, pipe: [1:7556534675655893194:10829]
2025-10-02T08:13:52.618476Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:52.619507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.619525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.619558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655893194:10829], now have 1 active actors on pipe
2025-10-02T08:13:52.619722Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:52.619935Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:52.620250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534675655893194:10829]
2025-10-02T08:13:52.620269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:52.620315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1878 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0
2025-10-02T08:13:52.620591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:52.620599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0] Write session will restart in 0.007858s
2025-10-02T08:13:52.620616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0] Write session: Do CDS request
2025-10-02T08:13:52.620622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:52.620467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1878 sessionId: src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0 is DEAD
2025-10-02T08:13:52.629423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.629551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:52.629567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1879
2025-10-02T08:13:52.629719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.629756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:52.629760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:52.629763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:52.630253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1879 sessionId:  describe result for acl check
2025-10-02T08:13:52.630289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:52.630290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:52.630292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:52.630297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534675655893565:9262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:52.630812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534675655893565:9262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:52.635037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534675655893565:9262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:52.641445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:52.641617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534675655893565:9262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:52.641631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534675655893565:9262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:52.641634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534675655893565:9262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:52.641641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:52.642013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:52.642390Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:52.642405Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:52.642420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:52.642491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:52.642528Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534675655893696:9272]
2025-10-02T08:13:52.643100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:52.643529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:52.643579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:52.643865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:52.643925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.643931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.643932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.643933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.643934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.643939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.643948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.643951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.643954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.643962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.643967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.643978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.643989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.643993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.644004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.644013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.644020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.644029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.644036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.644043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.644064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:52.652563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:52.654465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:52.654489Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:52.654491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:52.654495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:52.654501Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1878 [1:7556534675655893696:9272]
2025-10-02T08:13:52.654513Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:52.654529Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:52.654532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.654535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.654537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.654553Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:52.654557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:52.654564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:52.654623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.654632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.654635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:52.654638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:52.654700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:52.654710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.654724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.654735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:52.654754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534676115565386:2378], now have 1 active actors on pipe
2025-10-02T08:13:52.654765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534675655893685:9272]
2025-10-02T08:13:52.654768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534675655893685:9272]
2025-10-02T08:13:52.654774Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:52.654787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655893693:9262], now have 1 active actors on pipe
2025-10-02T08:13:52.654792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1878
2025-10-02T08:13:52.654797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:52.654813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:52.654813Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:52.654816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:52.654817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:52.654852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.654857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.654871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534675655893685:9272]
2025-10-02T08:13:52.654881Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:52.654902Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:52.654905Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:52.654912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.654916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.654918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:52.654928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.654937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:52.654967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.655020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.655031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.655044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.655078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1879 partition: 0 MaxSeqNo: 17 sessionId: src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0
2025-10-02T08:13:52.655460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d33863-a7ab9f35-1c3ec514-55632caa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:52.654882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1878
2025-10-02T08:13:52.658617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0] Write session: try to update token
2025-10-02T08:13:52.658638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:52.672664Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:52.672685Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:52.672687Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:52.672695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534675655893685:9272]
2025-10-02T08:13:52.672700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534675655893685:9272]
2025-10-02T08:13:52.672748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:52.672763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.672764Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:52.672767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:52.672771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:52.672936Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:52.676658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId: src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:52.679361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:52.720760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534675655893732:10829]
2025-10-02T08:13:52.720997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1878, pipe: [1:7556534675655893732:10829]
2025-10-02T08:13:52.806251Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:52.806967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.806985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.807028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655893732:10829], now have 1 active actors on pipe
2025-10-02T08:13:52.807227Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:52.807912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:52.807922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0] Write session will restart in 0.006648s
2025-10-02T08:13:52.807945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0] Write session: Do CDS request
2025-10-02T08:13:52.807951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:52.807527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:52.807581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1879 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0
2025-10-02T08:13:52.807740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1879 sessionId: src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0 is DEAD
2025-10-02T08:13:52.807944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534675655893732:10829]
2025-10-02T08:13:52.813032Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:52.815323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.815605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:52.815621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1880
2025-10-02T08:13:52.815739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:52.815771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:52.815781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:52.815784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:52.816311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1880 sessionId:  describe result for acl check
2025-10-02T08:13:52.816344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:52.816350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:52.816352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:52.816356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534675655893960:9244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:52.816980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534675655893960:9244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:52.820627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534675655893960:9244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:52.824632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534675655893960:9244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:52.824651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534675655893960:9244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:52.824655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534675655893960:9244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:52.824663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:52.826641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:52.828348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:52.828508Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:52.828515Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:52.828522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:52.828553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:52.828741Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534675655894198:9245]
2025-10-02T08:13:52.829197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:52.829431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:52.829478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:52.829708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:52.829743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.829747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.829748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.829749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.829750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.829753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.829761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.829763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.829765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.829767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.829772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.829776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:52.829780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.829783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:52.829785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.829788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:52.829791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.829793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.829796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.829799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.829811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:52.838573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:52.840046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:52.840064Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:52.840066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:52.840069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:52.840074Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1879 [1:7556534675655894198:9245]
2025-10-02T08:13:52.840084Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:52.840104Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:52.840110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.840112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.840114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.840127Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:52.840135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:52.840148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:52.840237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.840245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.840247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:52.840250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:52.840316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:52.840323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.840340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:52.840354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:52.840359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1879
2025-10-02T08:13:52.840378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655894177:9244], now have 1 active actors on pipe
2025-10-02T08:13:52.840386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534676115565403:2378], now have 1 active actors on pipe
2025-10-02T08:13:52.840392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534675655894192:9245]
2025-10-02T08:13:52.840398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534675655894192:9245]
2025-10-02T08:13:52.840413Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:52.840427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:52.840429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.840434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.840436Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:52.840453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:52.840466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:52.840476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:52.840494Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1879
2025-10-02T08:13:52.840527Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b3c665-c19ad811-989df4ec-1e69c526_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:52.840538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.840545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.840548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:52.840557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.840568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:52.840578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534675655894192:9245]
2025-10-02T08:13:52.840593Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:52.840609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:52.840629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.840672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.840680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.840693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:52.840732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1880 partition: 0 MaxSeqNo: 17 sessionId: src_id|8b3c665-c19ad811-989df4ec-1e69c526_0
2025-10-02T08:13:52.841080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae2bf07-4eff1f98-f4dc7720-d6a6b11d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8b3c665-c19ad811-989df4ec-1e69c526_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:52.844135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b3c665-c19ad811-989df4ec-1e69c526_0] Write session: try to update token
2025-10-02T08:13:52.844152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b3c665-c19ad811-989df4ec-1e69c526_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:52.851644Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:52.851664Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:52.851673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534675655894192:9245]
2025-10-02T08:13:52.851715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:52.851734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:52.851889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:52.852019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:52.852147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:52.852291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:52.852478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:52.852520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:52.858297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId: src_id|8b3c665-c19ad811-989df4ec-1e69c526_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:52.860978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:52.861084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.861100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.861145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:52.861175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:52.861240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:52.861243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:52.861418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.861490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.861554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.861615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.861658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.861663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.861736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.861794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.861856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.861925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.861967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.861970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.862047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.862106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.862166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.862225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.862265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.862268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.862336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.862401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.862472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.862543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.862590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.862593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.862675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.862735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.862804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.862870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.862927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.862930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.863006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.863072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.863140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.863225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.863271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.863274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.863352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.863417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.863487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.863558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.863607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.863610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.863691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.863754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.863825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.863892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.863940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.863943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.864024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.864081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.864146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.864222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.864272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.864276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.864349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:52.864411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:52.864469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:52.864530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:52.864578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:52.864581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:52.864624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:52.864690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:52.864708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:52.864710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:52.864742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:52.864755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:52.864758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:52.864762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:52.864765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:52.865206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:52.865237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:52.865248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:52.865256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:52.865259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:52.865267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:52.865966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:52.865991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:52.865998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:52.866001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:52.866004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:52.866008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:52.866623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:52.866650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:52.866673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:52.866680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:52.866684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:52.867901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:52.867921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:52.867934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392832867
2025-10-02T08:13:52.868126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:52.868145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:52.868149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:52.868152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:52.868156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:52.868159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:52.868628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:52.868650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:52.868655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:52.868659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:52.868667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:52.868670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:52.869265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:52.869289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:52.869295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:52.869298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:52.869302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:52.869305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:52.869802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:52.869826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:52.869831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:52.871004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:52.871024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:52.871029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:52.871033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:52.871041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392832870
2025-10-02T08:13:52.871361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:52.871382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:52.871389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:52.871394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:52.871398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:52.871401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:52.871847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:52.871867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:52.871873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:52.871876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:52.871879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:52.871883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:52.872375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:52.872391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:52.872487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392832872
2025-10-02T08:13:52.873291Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:52.873315Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:52.873322Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:52.873331Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:52.875075Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:52.875090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:52.875095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:52.875100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534675655894192:9245]
2025-10-02T08:13:52.875103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534675655894192:9245]
2025-10-02T08:13:52.875155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:52.875158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:52.875164Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:52.875164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:52.875166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:52.875304Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:52.907068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534675655894234:10829]
2025-10-02T08:13:52.907183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1879, pipe: [1:7556534675655894234:10829]
2025-10-02T08:13:53.012268Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:53.012678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534675655894234:10829], now have 1 active actors on pipe
2025-10-02T08:13:53.012790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534675655894234:10829]
2025-10-02T08:13:53.012828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:53.012831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:53.012856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1880 reason: error at write: Disconnected sessionId: src_id|8b3c665-c19ad811-989df4ec-1e69c526_0
2025-10-02T08:13:53.012919Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:53.013018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1880 sessionId: src_id|8b3c665-c19ad811-989df4ec-1e69c526_0 is DEAD
2025-10-02T08:13:53.012984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:53.013158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b3c665-c19ad811-989df4ec-1e69c526_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:53.013168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b3c665-c19ad811-989df4ec-1e69c526_0] Write session will restart in 0.007060s
2025-10-02T08:13:53.013191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b3c665-c19ad811-989df4ec-1e69c526_0] Write session: Do CDS request
2025-10-02T08:13:53.013198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b3c665-c19ad811-989df4ec-1e69c526_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:53.021579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b3c665-c19ad811-989df4ec-1e69c526_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.021632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:53.021648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1881
2025-10-02T08:13:53.021772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.021812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:53.021822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:53.021826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:53.022228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1881 sessionId:  describe result for acl check
2025-10-02T08:13:53.022266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:53.022275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:53.022276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:53.022280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534679950861843:9225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:53.022829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534679950861843:9225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:53.025508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534679950861843:9225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:53.034612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534679950861843:9225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:53.034632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534679950861843:9225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:53.034635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534679950861843:9225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:53.034644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:53.035848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:53.036479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:53.036667Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:53.036677Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:53.036687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:53.036737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:53.036774Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534679950862076:9222]
2025-10-02T08:13:53.037409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:53.037612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:53.037656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:53.037944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:53.038007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.038014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.038015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.038016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.038017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.038021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.038032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.038036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.038039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.038043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.038049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.038056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.038062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.038072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.038077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.038083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.038088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.038098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.038105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.038110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.038128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:53.050449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:53.051993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:53.052016Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:53.052019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:53.052023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:53.052030Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1880 [1:7556534679950862076:9222]
2025-10-02T08:13:53.052043Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:53.052061Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:53.052064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.052067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.052069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.052086Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:53.052091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:53.052098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:53.052164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.052176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.052179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:53.052181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:53.052263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:53.052271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.052286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.052304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:53.052322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950862057:9225], now have 1 active actors on pipe
2025-10-02T08:13:53.052337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534679950862070:9222]
2025-10-02T08:13:53.052339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534679950862070:9222]
2025-10-02T08:13:53.052347Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:53.052346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1880
2025-10-02T08:13:53.052356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534680410532704:2378], now have 1 active actors on pipe
2025-10-02T08:13:53.052359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:53.052363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:53.052366Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:53.052378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:53.052382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:53.052389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.052392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.052435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534679950862070:9222]
2025-10-02T08:13:53.052448Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:53.052452Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:53.052469Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8004af5-300c777a-749ce190-232eaa81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:53.052475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.052479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.052481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:53.052491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.052504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:53.052492Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1880
2025-10-02T08:13:53.052533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.052578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.052585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.052598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.052637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1881 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8004af5-300c777a-749ce190-232eaa81_0
2025-10-02T08:13:53.052979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b3c665-c19ad811-989df4ec-1e69c526_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8004af5-300c777a-749ce190-232eaa81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:53.055476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8004af5-300c777a-749ce190-232eaa81_0] Write session: try to update token
2025-10-02T08:13:53.055491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8004af5-300c777a-749ce190-232eaa81_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:53.066701Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:53.066724Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:53.066735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534679950862070:9222]
2025-10-02T08:13:53.066776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:53.066785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:53.066944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:53.067091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:53.067228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:53.067368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:53.067557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:53.067598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:53.069077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId: src_id|d8004af5-300c777a-749ce190-232eaa81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:53.071823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:53.071958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.071974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.072015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:53.072039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:53.072178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.072188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.072374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.072448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.072517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.072587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.072638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.072647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.072732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.072797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.072891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.072965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.073015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.073023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.073094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.073164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.073231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.073299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.073342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.073349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.073417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.073489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.073564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.073635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.073689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.073692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.073783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.073858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.073932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.074010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.074061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.074064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.074157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.074230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.074312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.074395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.074449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.074452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.074555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.074633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.074713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.074791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.074844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.074847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.074933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.075005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.075087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.075165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.075216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.075219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.075310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.075374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.075438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.075502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.075557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.075560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.075638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.075697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.075762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.075827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.075880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.075883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.075929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:53.075997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.076016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.076019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:53.076055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:53.076068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:53.076071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:53.076075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:53.076078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:53.076533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:53.076554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:53.076560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:53.076564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:53.076567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:53.076573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:53.077375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:53.077412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:53.077418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:53.077421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:53.077425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:53.077428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:53.078168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:53.078201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:53.078213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:53.078217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:53.078226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:53.079635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:53.079659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:53.079672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392833079
2025-10-02T08:13:53.079921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:53.079942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:53.079948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:53.079951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:53.079956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:53.079961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:53.080554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:53.080584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:53.080595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:53.080599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:53.080604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:53.080607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:53.081490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:53.081519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:53.081527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:53.081530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:53.081535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:53.081538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:53.082024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:53.082038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:53.082045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:53.083234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:53.083244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:53.083251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:53.083257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:53.083267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392833083
2025-10-02T08:13:53.083580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:53.083594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:53.083603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:53.083606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:53.083610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:53.083614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:53.084127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:53.084147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:53.084154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:53.084157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:53.084161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:53.084165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:53.084699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:53.084711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.085022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392833084
2025-10-02T08:13:53.085842Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:53.085869Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:53.085882Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:53.085893Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:53.087673Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:53.087686Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:53.087688Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:53.087697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534679950862070:9222]
2025-10-02T08:13:53.087702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534679950862070:9222]
2025-10-02T08:13:53.087766Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:53.087770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:53.087775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.087777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:53.087782Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:53.087930Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:53.114586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534679950862108:10829]
2025-10-02T08:13:53.114800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1880, pipe: [1:7556534679950862108:10829]
2025-10-02T08:13:53.232860Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:53.233484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950862108:10829], now have 1 active actors on pipe
2025-10-02T08:13:53.233752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:53.234383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8004af5-300c777a-749ce190-232eaa81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:53.234393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8004af5-300c777a-749ce190-232eaa81_0] Write session will restart in 0.008924s
2025-10-02T08:13:53.234417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8004af5-300c777a-749ce190-232eaa81_0] Write session: Do CDS request
2025-10-02T08:13:53.234423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8004af5-300c777a-749ce190-232eaa81_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:53.233705Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:53.234080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534679950862108:10829]
2025-10-02T08:13:53.234092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:53.234113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1881 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8004af5-300c777a-749ce190-232eaa81_0
2025-10-02T08:13:53.234263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1881 sessionId: src_id|d8004af5-300c777a-749ce190-232eaa81_0 is DEAD
2025-10-02T08:13:53.244258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8004af5-300c777a-749ce190-232eaa81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.244297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:53.244313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1882
2025-10-02T08:13:53.244428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.244457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:53.244466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:53.244469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:53.244859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1882 sessionId:  describe result for acl check
2025-10-02T08:13:53.244894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:53.244900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:53.244902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:53.244907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534679950862523:9211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:53.245404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534679950862523:9211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:53.247828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534679950862523:9211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:53.248690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:53.249551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:53.249710Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:53.249718Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:53.249728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:53.249771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:53.249807Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534679950862647:9213]
2025-10-02T08:13:53.250320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:53.250459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:53.250497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:53.250774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:53.250812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.250820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.250821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.250823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.250824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.250829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.250838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.250842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.250845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.250848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.250853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.250859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.250864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.250869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.250873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.250878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.250882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.250887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.250891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.250896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.250913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:53.250926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534679950862523:9211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:53.250932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534679950862523:9211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:53.250934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534679950862523:9211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:53.250940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:53.258960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:53.260677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:53.260696Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:53.260698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:53.260702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:53.260709Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1881 [1:7556534679950862647:9213]
2025-10-02T08:13:53.260721Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:53.260736Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:53.260739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.260742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.260744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.260758Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:53.260762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:53.260768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:53.260850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.260859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.260861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:53.260864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:53.260925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:53.260932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.260947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.260959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:53.260976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950862661:9211], now have 1 active actors on pipe
2025-10-02T08:13:53.260984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1881
2025-10-02T08:13:53.260987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534679950862641:9213]
2025-10-02T08:13:53.260990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534679950862641:9213]
2025-10-02T08:13:53.261001Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:53.261014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534680410532712:2378], now have 1 active actors on pipe
2025-10-02T08:13:53.261014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:53.261017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:53.261026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:53.261040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:53.261043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:53.261051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.261059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.261074Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1881
2025-10-02T08:13:53.261099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534679950862641:9213]
2025-10-02T08:13:53.261109Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:53.261117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:53.261123Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:53.261129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.261133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.261135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:53.261143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.261151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:53.261193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.261251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.261258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.261270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.261308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1882 partition: 0 MaxSeqNo: 17 sessionId: src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0
2025-10-02T08:13:53.261631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8004af5-300c777a-749ce190-232eaa81_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:53.264093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0] Write session: try to update token
2025-10-02T08:13:53.264105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:53.272471Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:53.272494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:53.272502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534679950862641:9213]
2025-10-02T08:13:53.272543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:53.272550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:53.272723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:53.272883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:53.273026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:53.273166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:53.273357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:53.273398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:53.276843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId: src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:53.279372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:53.279441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.279448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.279479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:53.279498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:53.279555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.279563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.279739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.279803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.279880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.279950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.280054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.280062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.280136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.280213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.280275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.280336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.280374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.280377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.280436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.280490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.280543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.280591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.280631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.280633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.280691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.280745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.280830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.280903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.280948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.280951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.281029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.281095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.281165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.281236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.281297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.281304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.281385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.281454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.281530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.281606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.281660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.281668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.281747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.281820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.281903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.281978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.282035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.282042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.282121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.282189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.282261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.282336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.282389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.282396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.282470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.282534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.282600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.282662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.282713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.282719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.282795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:53.282862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:53.282931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:53.282993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:53.283054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:53.283060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:53.283097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:53.283161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.283184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.283190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:53.283217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:53.283233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:53.283240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:53.283245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:53.283247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:53.283632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:53.283661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:53.283673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:53.283683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:53.283686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:53.283688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:53.284258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:53.284283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:53.284289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:53.284297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:53.284300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:53.284303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:53.284769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:53.284793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:53.284928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:53.284939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:53.284942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:53.286181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:53.286202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:53.286213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392833285
2025-10-02T08:13:53.286325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:53.286340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:53.286344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:53.286348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:53.286352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:53.286355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:53.286857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:53.286884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:53.286890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:53.286893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:53.286896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:53.286901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:53.287376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:53.287397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:53.287410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:53.287422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:53.287428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:53.287432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:53.287887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:53.287910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:53.287916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:53.289142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:53.289160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:53.289164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:53.289167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:53.289174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392833288
2025-10-02T08:13:53.289460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:53.289483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:53.289494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:53.289502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:53.289506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:53.289510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:53.289991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:53.290011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:53.290015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:53.290018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:53.290020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:53.290022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:53.290426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:53.290442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.290521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392833290
2025-10-02T08:13:53.291216Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:53.291235Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:53.291239Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:53.291243Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:53.293288Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:53.293303Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:53.293306Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:53.293315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534679950862641:9213]
2025-10-02T08:13:53.293318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534679950862641:9213]
2025-10-02T08:13:53.293356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:53.293361Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:53.293365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.293366Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:53.293367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:53.293513Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:53.335996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534679950862685:10829]
2025-10-02T08:13:53.336193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1881, pipe: [1:7556534679950862685:10829]
2025-10-02T08:13:53.437374Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:53.438098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950862685:10829], now have 1 active actors on pipe
2025-10-02T08:13:53.438204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534679950862685:10829]
2025-10-02T08:13:53.438229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:53.438232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:53.438257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1882 reason: error at write: Disconnected sessionId: src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0
2025-10-02T08:13:53.438335Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:53.438425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1882 sessionId: src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0 is DEAD
2025-10-02T08:13:53.438761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:53.438771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0] Write session will restart in 0.009812s
2025-10-02T08:13:53.438808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0] Write session: Do CDS request
2025-10-02T08:13:53.438814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:53.438366Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:53.454245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.454332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:53.454348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1883
2025-10-02T08:13:53.454462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.454490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:53.454496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:53.454504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:53.454921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1883 sessionId:  describe result for acl check
2025-10-02T08:13:53.454950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:53.454961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:53.454963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:53.454969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534679950862897:9197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:53.455508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534679950862897:9197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:53.458348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534679950862897:9197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:53.462137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534679950862897:9197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:53.462148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534679950862897:9197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:53.462151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534679950862897:9197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:53.462157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:53.470772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:53.471607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:53.471811Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:53.471814Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:53.471829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:53.471864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:53.471887Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534679950863234:9201]
2025-10-02T08:13:53.472377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:53.477082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:53.477138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:53.477407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:53.477436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.477437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.477437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.477438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.477439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.477442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.477448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.477451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.477453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.477455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.477460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.477464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.477469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.477479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.477481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.477484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.477486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.477491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.477493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.477496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.477506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:53.497009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:53.498818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:53.498835Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:53.498837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:53.498839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:53.498844Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1882 [1:7556534679950863234:9201]
2025-10-02T08:13:53.498852Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:53.498865Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:53.498866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.498868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.498869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.498881Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:53.498884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:53.498889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:53.498932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.498934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.498936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:53.498937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:53.499396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1882
2025-10-02T08:13:53.499579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efdd77f-3fd2e4ac-69c137d8-eb478960_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:53.499000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:53.499009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.499022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.499029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:53.499041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534679950863228:9201]
2025-10-02T08:13:53.499043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534679950863228:9201]
2025-10-02T08:13:53.499049Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:53.499059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:53.499067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:53.499069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:53.499068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:53.499074Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:53.499075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1882
2025-10-02T08:13:53.499079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950862981:9197], now have 1 active actors on pipe
2025-10-02T08:13:53.499113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534680410532719:2378], now have 1 active actors on pipe
2025-10-02T08:13:53.499116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534679950863228:9201]
2025-10-02T08:13:53.499125Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:53.499129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.499132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.499135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:53.499164Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:53.499169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.499172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.499174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:53.499180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.499187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:53.499201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.499233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.499235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.499244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.499273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1883 partition: 0 MaxSeqNo: 17 sessionId: src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0
2025-10-02T08:13:53.502150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0] Write session: try to update token
2025-10-02T08:13:53.502166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:53.516716Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:53.516738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:53.516741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:53.516750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534679950863228:9201]
2025-10-02T08:13:53.516754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534679950863228:9201]
2025-10-02T08:13:53.516820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:53.516828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.516830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:53.516828Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:53.516836Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:53.516985Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:53.530259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId: src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:53.533189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:53.538366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534679950863258:10829]
2025-10-02T08:13:53.538703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1882, pipe: [1:7556534679950863258:10829]
2025-10-02T08:13:53.654247Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:53.654626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.654639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.654660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950863258:10829], now have 1 active actors on pipe
2025-10-02T08:13:53.654879Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:53.654973Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:53.655254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:53.655311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1883 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0
2025-10-02T08:13:53.655488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1883 sessionId: src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0 is DEAD
2025-10-02T08:13:53.655666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534679950863258:10829]
2025-10-02T08:13:53.656763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:53.656775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0] Write session will restart in 0.008259s
2025-10-02T08:13:53.656820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0] Write session: Do CDS request
2025-10-02T08:13:53.656827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:53.666288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.672981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:53.672997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1884
2025-10-02T08:13:53.673610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.673652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:53.673657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:53.673661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:53.674130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1884 sessionId:  describe result for acl check
2025-10-02T08:13:53.674166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:53.674172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:53.674174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:53.674179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534679950863812:9161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:53.674664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534679950863812:9161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:53.674867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:53.675385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:53.675534Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:53.675538Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:53.675547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:53.675586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:53.675618Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534679950863825:9165]
2025-10-02T08:13:53.676263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:53.676463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:53.676503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:53.676828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:53.676870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.676871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.676872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.676873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.676874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.676880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.676890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.676894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.676898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.676903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.676908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.676915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.676921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.676927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.676931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.676936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.676941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.676947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.676952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.676958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.676979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:53.678730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534679950863812:9161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:53.686105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534679950863812:9161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:53.686122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534679950863812:9161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:53.686126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534679950863812:9161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:53.686133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:53.690566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:53.692193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:53.692215Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:53.692218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:53.692222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:53.692230Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1883 [1:7556534679950863825:9165]
2025-10-02T08:13:53.692242Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:53.692261Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:53.692264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.692267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.692269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.692286Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:53.692291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:53.692298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:53.692371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.692373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.692376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:53.692378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:53.692635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:53.692637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.692648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.692656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:53.692670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534679950863816:9165]
2025-10-02T08:13:53.692671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534679950863816:9165]
2025-10-02T08:13:53.692683Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:53.692693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:53.692702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:53.692704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:53.692732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534679950863816:9165]
2025-10-02T08:13:53.692734Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:53.692793Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:53.692796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:53.692816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:53.692871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534680410532752:2378], now have 1 active actors on pipe
2025-10-02T08:13:53.692876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950863868:9161], now have 1 active actors on pipe
2025-10-02T08:13:53.692893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1883
2025-10-02T08:13:53.692913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.692917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.692939Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:53.692945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.692948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.692950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:53.692959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.692968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:53.692982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.693184Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1883
2025-10-02T08:13:53.693421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b390dcfc-cafd52b7-93990a7a-eeee83b0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:53.695955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0] Write session: try to update token
2025-10-02T08:13:53.695971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:53.693057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.693068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.693080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.693113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1884 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0
2025-10-02T08:13:53.713365Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:53.713382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:53.713384Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:53.713391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534679950863816:9165]
2025-10-02T08:13:53.713394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534679950863816:9165]
2025-10-02T08:13:53.713432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:53.713439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.713441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:53.713580Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:53.715350Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:53.715359Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:53.716428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId: src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:53.718956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:53.756016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534679950863883:10829]
2025-10-02T08:13:53.756260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1883, pipe: [1:7556534679950863883:10829]
2025-10-02T08:13:53.857785Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:53.858237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.858254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.858294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950863883:10829], now have 1 active actors on pipe
2025-10-02T08:13:53.858501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:53.858512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:53.858521Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:53.858582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1884 reason: error at write: Disconnected sessionId: src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0
2025-10-02T08:13:53.858754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1884 sessionId: src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0 is DEAD
2025-10-02T08:13:53.858876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:53.858887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0] Write session will restart in 0.005610s
2025-10-02T08:13:53.858911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0] Write session: Do CDS request
2025-10-02T08:13:53.858918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:53.858884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534679950863883:10829]
2025-10-02T08:13:53.858885Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:53.865284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.865368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:53.865385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1885
2025-10-02T08:13:53.865469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:53.865508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:53.865513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:53.865522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:53.865914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1885 sessionId:  describe result for acl check
2025-10-02T08:13:53.865946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:53.865953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:53.865955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:53.865960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534679950864140:9128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:53.866486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534679950864140:9128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:53.869973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534679950864140:9128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:53.873154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534679950864140:9128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:53.873169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534679950864140:9128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:53.873172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534679950864140:9128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:53.873181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:53.874189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:53.875382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:53.875621Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:53.875632Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:53.875641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:53.875691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:53.875729Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534679950864436:9131]
2025-10-02T08:13:53.876383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:53.876546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:53.876586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:53.876907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:53.876955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.876960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.876961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.876962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.876964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.876969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.876979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.876982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.876986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.876990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.876995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.877007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:53.877013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.877017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:53.877022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.877026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:53.877031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.877036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.877044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.877049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.877066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:53.885692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:53.887502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:53.887525Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:53.887528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:53.887532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:53.887538Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1884 [1:7556534679950864436:9131]
2025-10-02T08:13:53.887551Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:53.887569Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:53.887577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.887580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.887582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.887597Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:53.887602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:53.887608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:53.887677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.887684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.887687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:53.887690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:53.887756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:53.887767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.887781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:53.887794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:53.887811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950864418:9128], now have 1 active actors on pipe
2025-10-02T08:13:53.887818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534679950864430:9131]
2025-10-02T08:13:53.887820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534679950864430:9131]
2025-10-02T08:13:53.887823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1884
2025-10-02T08:13:53.887827Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:53.887837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534680410532770:2378], now have 1 active actors on pipe
2025-10-02T08:13:53.887838Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:53.887840Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:53.887844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:53.887858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:53.887860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:53.887867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.887871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.887911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534679950864430:9131]
2025-10-02T08:13:53.887922Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:53.887937Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:53.887948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:53.887947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:53.887951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:53.887919Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1884
2025-10-02T08:13:53.887954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:53.887962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:53.887971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:53.888002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.888097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:53.888105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:53.888118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:53.888160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1885 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0
2025-10-02T08:13:53.888504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc3d5ffd-8ba8ebc-f111aac6-69142069_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:53.891033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0] Write session: try to update token
2025-10-02T08:13:53.891048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:53.904427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId: src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:53.905657Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:53.905679Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:53.905682Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:53.905690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534679950864430:9131]
2025-10-02T08:13:53.905698Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534679950864430:9131]
2025-10-02T08:13:53.905741Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:53.905746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:53.905753Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:53.905754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:53.905755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:53.905890Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:53.906951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:53.958265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534679950864461:10829]
2025-10-02T08:13:53.958414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1884, pipe: [1:7556534679950864461:10829]
2025-10-02T08:13:54.042578Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:54.043139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.043162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.043204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534679950864461:10829], now have 1 active actors on pipe
2025-10-02T08:13:54.043320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534679950864461:10829]
2025-10-02T08:13:54.043344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:54.043353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:54.043417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1885 reason: error at write: Disconnected sessionId: src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0
2025-10-02T08:13:54.043423Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:54.043410Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:54.043580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1885 sessionId: src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0 is DEAD
2025-10-02T08:13:54.043715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:54.043726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0] Write session will restart in 0.008517s
2025-10-02T08:13:54.043752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0] Write session: Do CDS request
2025-10-02T08:13:54.043759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:54.053253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.053322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:54.053337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1886
2025-10-02T08:13:54.053469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.053500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:54.053510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:54.053514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:54.053982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1886 sessionId:  describe result for acl check
2025-10-02T08:13:54.054013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:54.054015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:54.054016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:54.054021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534684245832145:9119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:54.054517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534684245832145:9119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:54.056712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534684245832145:9119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:54.060278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534684245832145:9119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:54.060294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534684245832145:9119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:54.060297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534684245832145:9119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:54.060305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:54.061441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:54.062331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:54.062525Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:54.062537Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:54.062547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:54.062608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:54.062647Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534684245832312:9121]
2025-10-02T08:13:54.063278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:54.063472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:54.063516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:54.063817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:54.063870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.063877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.063878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.063879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.063880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.063886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.063896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.063900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.063904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.063908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.063914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.063922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.063928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.063933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.063938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.063943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.063947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.063952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.063961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.063966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.063986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:54.072106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:54.073886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:54.073911Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:54.073914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:54.073918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:54.073925Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1885 [1:7556534684245832312:9121]
2025-10-02T08:13:54.073937Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:54.073955Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:54.073963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.073966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.073969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.073984Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:54.073998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:54.074005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:54.074075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.074082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.074086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:54.074089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:54.074158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:54.074165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.074179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.074195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:54.074219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534684245832306:9121]
2025-10-02T08:13:54.074225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534684245832306:9121]
2025-10-02T08:13:54.074233Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:54.074244Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:54.074246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245832291:9119], now have 1 active actors on pipe
2025-10-02T08:13:54.074250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1885
2025-10-02T08:13:54.074254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:54.074254Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:54.074267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:54.074271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:54.074277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534684705500072:2378], now have 1 active actors on pipe
2025-10-02T08:13:54.074314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.074323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.074335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534684245832306:9121]
2025-10-02T08:13:54.074343Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:54.074346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:54.074368Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:54.074379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.074383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.074328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1885
2025-10-02T08:13:54.074385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:54.074395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.074403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:54.074431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.074475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.074482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.074494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.074535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1886 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0
2025-10-02T08:13:54.074845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0f01f3-b6afbc18-bf38ff19-2400f355_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:54.077537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0] Write session: try to update token
2025-10-02T08:13:54.077554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:54.090956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId: src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:54.092704Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:54.092728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:54.092731Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:54.092742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534684245832306:9121]
2025-10-02T08:13:54.092747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534684245832306:9121]
2025-10-02T08:13:54.092820Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:54.092822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:54.092831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.092833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:54.092835Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:54.093032Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:54.094323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:54.143563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534684245832337:10829]
2025-10-02T08:13:54.143692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1885, pipe: [1:7556534684245832337:10829]
2025-10-02T08:13:54.225943Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:54.226669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.226683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.226720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245832337:10829], now have 1 active actors on pipe
2025-10-02T08:13:54.226820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534684245832337:10829]
2025-10-02T08:13:54.226847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:54.226849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:54.226901Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:54.226906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1886 reason: error at write: Disconnected sessionId: src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0
2025-10-02T08:13:54.227063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1886 sessionId: src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0 is DEAD
2025-10-02T08:13:54.227189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:54.227197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0] Write session will restart in 0.009652s
2025-10-02T08:13:54.227220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0] Write session: Do CDS request
2025-10-02T08:13:54.227227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:54.227020Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:54.238568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.238597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:54.238617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1887
2025-10-02T08:13:54.238809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.238851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:54.238862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:54.238865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:54.239333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1887 sessionId:  describe result for acl check
2025-10-02T08:13:54.239374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:54.239380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:54.239382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:54.239388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534684245832739:9088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:54.239970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534684245832739:9088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:54.242811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534684245832739:9088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:54.245868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534684245832739:9088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:54.245883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534684245832739:9088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:54.245887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534684245832739:9088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:54.245895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:54.245955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:54.246682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:54.246859Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:54.246870Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:54.246895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:54.246949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:54.246986Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534684245832891:9087]
2025-10-02T08:13:54.247545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:54.247751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:54.247793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:54.248078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:54.248126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.248132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.248133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.248134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.248135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.248140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.248149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.248156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.248159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.248165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.248174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.248185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.248194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.248215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.248223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.248227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.248235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.248240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.248248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.248252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.248271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:54.257542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:54.259418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:54.259440Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:54.259443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:54.259447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:54.259455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1886 [1:7556534684245832891:9087]
2025-10-02T08:13:54.259467Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:54.259486Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:54.259490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.259494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.259496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.259513Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:54.259523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:54.259530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:54.259604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.259612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.259614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:54.259617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:54.259686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:54.259694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.259708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.259894Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1886
2025-10-02T08:13:54.259719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:54.259747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534684245832879:9087]
2025-10-02T08:13:54.259749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534684245832879:9087]
2025-10-02T08:13:54.259757Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:54.259769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:54.259775Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:54.259778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:54.259783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:54.259786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:54.259796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245832883:9088], now have 1 active actors on pipe
2025-10-02T08:13:54.259822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1886
2025-10-02T08:13:54.259829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534684705500080:2378], now have 1 active actors on pipe
2025-10-02T08:13:54.259832Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534684245832879:9087]
2025-10-02T08:13:54.259839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:54.259846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.259850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.259852Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:54.259892Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:54.259899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.259903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.259905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:54.259913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.259922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:54.259939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.259978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.259984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.260012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.260056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1887 partition: 0 MaxSeqNo: 17 sessionId: src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0
2025-10-02T08:13:54.260443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9de715b-4aabcf54-b6329b7c-9e7475f9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:54.263682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0] Write session: try to update token
2025-10-02T08:13:54.263706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:54.276654Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:54.276675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:54.276678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:54.276687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534684245832879:9087]
2025-10-02T08:13:54.276692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534684245832879:9087]
2025-10-02T08:13:54.276734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:54.276737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:54.276744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.276746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:54.276746Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:54.276903Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:54.282502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId: src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:54.285295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:54.326857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534684245832916:10829]
2025-10-02T08:13:54.326981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1886, pipe: [1:7556534684245832916:10829]
2025-10-02T08:13:54.405238Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:54.405725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.405743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.405765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245832916:10829], now have 1 active actors on pipe
2025-10-02T08:13:54.405913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534684245832916:10829]
2025-10-02T08:13:54.405938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:54.405944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:54.405963Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:54.406003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1887 reason: error at write: Disconnected sessionId: src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0
2025-10-02T08:13:54.406000Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:54.406145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1887 sessionId: src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0 is DEAD
2025-10-02T08:13:54.406288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:54.406304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0] Write session will restart in 0.009480s
2025-10-02T08:13:54.406337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0] Write session: Do CDS request
2025-10-02T08:13:54.406343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:54.417291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.417572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:54.417587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1888
2025-10-02T08:13:54.417758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.417787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:54.417796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:54.417798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:54.418247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1888 sessionId:  describe result for acl check
2025-10-02T08:13:54.418281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:54.418283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:54.418284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:54.418289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534684245833415:9067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:54.418875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534684245833415:9067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:54.420380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:54.421128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534684245833415:9067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:54.421155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:54.421333Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:54.421353Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:54.421364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:54.421422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:54.421465Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534684245833459:9064]
2025-10-02T08:13:54.422026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:54.422342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:54.422402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:54.422747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:54.422793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.422800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.422801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.422802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.422803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.422808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.422818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.422823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.422827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.422831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.422836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.422845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.422851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.422858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.422867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.422872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.422881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.422886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.422895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.422901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.422922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:54.427961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534684245833415:9067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:54.427978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534684245833415:9067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:54.427982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534684245833415:9067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:54.427990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:54.431178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:54.434902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:54.434927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:54.434931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:54.434934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:54.434942Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1887 [1:7556534684245833459:9064]
2025-10-02T08:13:54.434956Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:54.434975Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:54.434978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.434981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.434982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.435000Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:54.435007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:54.435014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:54.435080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.435091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.435094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:54.435096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:54.435162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:54.435169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.435184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.435202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:54.435224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245833485:9067], now have 1 active actors on pipe
2025-10-02T08:13:54.435237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534684245833450:9064]
2025-10-02T08:13:54.435239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534684245833450:9064]
2025-10-02T08:13:54.435246Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:54.435253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1887
2025-10-02T08:13:54.435255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534684705500086:2378], now have 1 active actors on pipe
2025-10-02T08:13:54.435255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:54.435259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:54.435263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:54.435276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:54.435279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:54.435286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.435294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.435339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534684245833450:9064]
2025-10-02T08:13:54.435354Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:54.435373Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:54.435385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.435386Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:54.435388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.435390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:54.435357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1887
2025-10-02T08:13:54.435399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.435412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:54.435454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.435547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.435554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.435569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.435610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1888 partition: 0 MaxSeqNo: 17 sessionId: src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0
2025-10-02T08:13:54.435951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48de97ed-63c0880c-d0a8e3d-37d52c14_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:54.438793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0] Write session: try to update token
2025-10-02T08:13:54.438809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:54.446720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:54.446743Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:54.446752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534684245833450:9064]
2025-10-02T08:13:54.446793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:54.446801Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:54.446976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:54.447119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:54.447273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:54.447422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:54.447623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:54.447665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:54.452727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId: src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:54.455538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:54.455613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.455626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.455663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:54.455688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:54.455742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.455765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.455951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.456034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.456099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.456164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.456222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.456230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.456300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.456364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.456430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.456503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.456552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.456558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.456628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.456693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.456753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.456838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.456884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.456891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.456956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.457023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.457097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.457173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.457224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.457231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.457311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.457384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.457458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.457535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.457588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.457594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.457672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.457742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.457815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.457893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.457944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.457950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.458026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.458091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.458165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.458239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.458556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.458571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.458660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.458728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.458806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.458885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.458938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.458944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.459027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.459090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.459151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.459215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.459278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.459285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.459360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:54.459430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:54.459495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:54.459559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:54.459611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:54.459617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:54.459656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:54.459725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.459747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.459753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:54.459786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:54.459802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:54.459809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:54.459812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:54.459815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:54.460217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:54.460246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:54.460255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:54.460259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:54.460262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:54.460266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:54.460868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:54.460892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:54.460899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:54.460902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:54.460909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:54.460912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:54.461440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:54.461466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:54.461473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:54.461476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:54.461479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:54.462672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:54.462691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:54.462704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392834462
2025-10-02T08:13:54.462864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:54.462885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:54.462891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:54.462897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:54.462902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:54.462905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:54.463401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:54.463431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:54.463457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:54.463464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:54.463467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:54.463471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:54.463981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:54.464007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:54.464015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:54.464017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:54.464021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:54.464023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:54.464476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:54.464495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:54.464499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:54.465583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:54.465607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:54.465616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:54.465620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:54.465628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392834465
2025-10-02T08:13:54.465915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:54.465936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:54.465945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:54.465948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:54.465951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:54.465956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:54.466399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:54.466422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:54.466428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:54.466431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:54.466434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:54.466439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:54.466890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:54.466911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.466992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392834466
2025-10-02T08:13:54.467746Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:54.467766Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:54.467772Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:54.467778Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:54.469444Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:54.469457Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:54.469462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:54.469478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534684245833450:9064]
2025-10-02T08:13:54.469481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534684245833450:9064]
2025-10-02T08:13:54.469539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:54.469540Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:54.469546Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:54.469547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.469549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:54.469692Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:54.506070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534684245833506:10829]
2025-10-02T08:13:54.506203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1887, pipe: [1:7556534684245833506:10829]
2025-10-02T08:13:54.602877Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:54.603290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245833506:10829], now have 1 active actors on pipe
2025-10-02T08:13:54.603409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534684245833506:10829]
2025-10-02T08:13:54.603431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:54.603433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:54.603457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1888 reason: error at write: Disconnected sessionId: src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0
2025-10-02T08:13:54.603557Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:54.603564Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:54.603629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1888 sessionId: src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0 is DEAD
2025-10-02T08:13:54.603773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:54.603783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0] Write session will restart in 0.007453s
2025-10-02T08:13:54.603806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0] Write session: Do CDS request
2025-10-02T08:13:54.603812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:54.612249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.612331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:54.612349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1889
2025-10-02T08:13:54.612467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.612496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:54.612502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:54.612505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:54.613001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1889 sessionId:  describe result for acl check
2025-10-02T08:13:54.613035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:54.613040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:54.613042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:54.613046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534684245833846:9043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:54.613530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534684245833846:9043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:54.615648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534684245833846:9043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:54.618740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534684245833846:9043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:54.618756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534684245833846:9043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:54.618759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534684245833846:9043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:54.618767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:54.618817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:54.619657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:54.619803Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:54.619812Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:54.619818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:54.619854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:54.619883Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534684245834067:9053]
2025-10-02T08:13:54.620316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:54.620478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:54.620517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:54.620750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:54.620796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.620818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.620823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.620824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.620825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.620831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.620841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.620849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.620853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.620858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.620863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.620874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.620882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.620888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.620896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.620902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.620907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.620914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.620922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.620927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.620947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:54.628924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:54.630658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:54.630676Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:54.630679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:54.630682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:54.630689Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1888 [1:7556534684245834067:9053]
2025-10-02T08:13:54.630700Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:54.630718Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:54.630721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.630723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.630725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.630745Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:54.630753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:54.630760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:54.630813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.630820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.630823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:54.630825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:54.630887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:54.630894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.630907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.630921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:54.630941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534684245834055:9053]
2025-10-02T08:13:54.630947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534684245834055:9053]
2025-10-02T08:13:54.630955Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:54.630963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1888
2025-10-02T08:13:54.630967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:54.630971Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:54.630973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245834060:9043], now have 1 active actors on pipe
2025-10-02T08:13:54.630981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:54.630995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:54.631002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:54.631008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534684705500104:2378], now have 1 active actors on pipe
2025-10-02T08:13:54.631014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.631019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.631064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534684245834055:9053]
2025-10-02T08:13:54.631075Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:54.631085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:54.631096Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:54.631102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.631106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.631109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:54.631117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.631131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:54.631108Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1888
2025-10-02T08:13:54.631175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.631238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.631244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.631258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.631299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1889 partition: 0 MaxSeqNo: 17 sessionId: src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0
2025-10-02T08:13:54.631619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5a6e5d-187df6c2-3c625e93-22c3d21c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:54.634149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0] Write session: try to update token
2025-10-02T08:13:54.634162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:54.648904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId: src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:54.649094Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:54.649108Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:54.649110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:54.649119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534684245834055:9053]
2025-10-02T08:13:54.649124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534684245834055:9053]
2025-10-02T08:13:54.649160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:54.649167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:54.649171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:54.649173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.649175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:54.649309Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:54.651639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:54.705320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534684245834120:10829]
2025-10-02T08:13:54.705490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1888, pipe: [1:7556534684245834120:10829]
2025-10-02T08:13:54.786173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:54.786853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.786871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.786913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245834120:10829], now have 1 active actors on pipe
2025-10-02T08:13:54.787263Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:54.787507Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:54.788080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:54.788090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0] Write session will restart in 0.006223s
2025-10-02T08:13:54.788114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0] Write session: Do CDS request
2025-10-02T08:13:54.788121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:54.787682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:54.787754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1889 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0
2025-10-02T08:13:54.787909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534684245834120:10829]
2025-10-02T08:13:54.787922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1889 sessionId: src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0 is DEAD
2025-10-02T08:13:54.797228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.797535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:54.797552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1890
2025-10-02T08:13:54.797662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.797693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:54.797703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:54.797707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:54.798077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1890 sessionId:  describe result for acl check
2025-10-02T08:13:54.798106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:54.798108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:54.798110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:54.798114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534684245834439:9027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:54.798681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534684245834439:9027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:54.802705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534684245834439:9027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:54.806413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534684245834439:9027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:54.806426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534684245834439:9027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:54.806428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534684245834439:9027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:54.806434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:54.808069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:54.808772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:54.808948Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:54.808958Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:54.808968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:54.809010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:54.809045Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534684245834706:9029]
2025-10-02T08:13:54.809696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:54.809886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:54.809918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:54.810215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:54.810251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.810252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.810253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.810254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.810255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.810259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.810269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.810273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.810277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.810281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.810287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.810294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.810300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.810305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.810309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.810314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.810318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.810322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.810327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.810332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.810350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:54.818661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:54.820306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:54.820324Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:54.820327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:54.820332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:54.820339Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1889 [1:7556534684245834706:9029]
2025-10-02T08:13:54.820352Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:54.820371Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:54.820375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.820378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.820380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.820395Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:54.820403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:54.820415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:54.820480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.820490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.820493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:54.820496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:54.820566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:54.820574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.820589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.820773Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1889
2025-10-02T08:13:54.820606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:54.820619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1889
2025-10-02T08:13:54.820628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245834685:9027], now have 1 active actors on pipe
2025-10-02T08:13:54.820635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534684245834700:9029]
2025-10-02T08:13:54.820637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534684245834700:9029]
2025-10-02T08:13:54.820652Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:54.820663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.820667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.820682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534684705500136:2378], now have 1 active actors on pipe
2025-10-02T08:13:54.820689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:54.820704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:54.820707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:54.820749Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbc46ff7-5be1a848-90714b93-3310383_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:54.820755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:54.820759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:54.820760Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:54.820761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:54.820763Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:54.820769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:54.820777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:54.820784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534684245834700:9029]
2025-10-02T08:13:54.820794Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:54.820835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:54.820852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.820938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.820941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.820956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:54.820993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1890 partition: 0 MaxSeqNo: 17 sessionId: src_id|cbc46ff7-5be1a848-90714b93-3310383_0
2025-10-02T08:13:54.821323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94277a63-45347c90-1cdc4a2-781ac9ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cbc46ff7-5be1a848-90714b93-3310383_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:54.824128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc46ff7-5be1a848-90714b93-3310383_0] Write session: try to update token
2025-10-02T08:13:54.824146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc46ff7-5be1a848-90714b93-3310383_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:54.838735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId: src_id|cbc46ff7-5be1a848-90714b93-3310383_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:54.841483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:54.842624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:54.842648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:54.842668Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:54.842671Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:54.842674Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:54.842683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534684245834700:9029]
2025-10-02T08:13:54.842686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534684245834700:9029]
2025-10-02T08:13:54.842737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:54.842743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.842746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:54.842898Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:54.842933Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:54.842946Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:54.888016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534684245834732:10829]
2025-10-02T08:13:54.888132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1889, pipe: [1:7556534684245834732:10829]
2025-10-02T08:13:54.973725Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:54.974247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:54.974305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245834732:10829], now have 1 active actors on pipe
2025-10-02T08:13:54.974318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:54.974414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:54.974421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:54.974443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1890 reason: error at write: Disconnected sessionId: src_id|cbc46ff7-5be1a848-90714b93-3310383_0
2025-10-02T08:13:54.974610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1890 sessionId: src_id|cbc46ff7-5be1a848-90714b93-3310383_0 is DEAD
2025-10-02T08:13:54.974735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc46ff7-5be1a848-90714b93-3310383_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:54.974746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc46ff7-5be1a848-90714b93-3310383_0] Write session will restart in 0.005707s
2025-10-02T08:13:54.974770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc46ff7-5be1a848-90714b93-3310383_0] Write session: Do CDS request
2025-10-02T08:13:54.974776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc46ff7-5be1a848-90714b93-3310383_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:54.974768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534684245834732:10829]
2025-10-02T08:13:54.974821Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:54.981219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc46ff7-5be1a848-90714b93-3310383_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.981279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:54.981292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1891
2025-10-02T08:13:54.981406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:54.981437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:54.981456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:54.981460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:54.981954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1891 sessionId:  describe result for acl check
2025-10-02T08:13:54.981986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:54.981992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:54.981996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:54.982001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534684245834974:8997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:54.982478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534684245834974:8997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:54.984970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534684245834974:8997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:54.990278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534684245834974:8997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:54.990301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534684245834974:8997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:54.990304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534684245834974:8997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:54.990312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:54.991174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:54.992255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:54.992428Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:54.992438Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:54.992447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:54.992490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:54.992525Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534684245835293:9013]
2025-10-02T08:13:54.993186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:54.993368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:54.993411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:54.993713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:54.993759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.993765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.993766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.993767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.993769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.993773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.993785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.993793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.993797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.993801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.993806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.993814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:54.993820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.993826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:54.993835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.993844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:54.993853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.993863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:54.993872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.993881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:54.993904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:55.001738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:55.003687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:55.003708Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:55.003711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:55.003715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:55.003721Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1890 [1:7556534684245835293:9013]
2025-10-02T08:13:55.003733Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:55.003752Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:55.003755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.003757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.003759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.003774Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:55.003785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:55.003792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:55.003873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.003881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.003886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:55.003889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:55.003954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:55.003964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.003978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.003991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:55.004010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534684245835275:8997], now have 1 active actors on pipe
2025-10-02T08:13:55.004016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534684245835287:9013]
2025-10-02T08:13:55.004018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534684245835287:9013]
2025-10-02T08:13:55.004025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:55.004026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1890
2025-10-02T08:13:55.004037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:55.004037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:55.004040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:55.004052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:55.004060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:55.004066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534684705500142:2378], now have 1 active actors on pipe
2025-10-02T08:13:55.004071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.004075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.004117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534684245835287:9013]
2025-10-02T08:13:55.004125Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:55.004116Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1890
2025-10-02T08:13:55.004140Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|649ccc9d-73576922-71df521e-31821805_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:55.004152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.004156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.004158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:55.004159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:55.004168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.004176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:55.004233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.004294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.004304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.004318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.004351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1891 partition: 0 MaxSeqNo: 17 sessionId: src_id|649ccc9d-73576922-71df521e-31821805_0
2025-10-02T08:13:55.004687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc46ff7-5be1a848-90714b93-3310383_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|649ccc9d-73576922-71df521e-31821805_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:55.007344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649ccc9d-73576922-71df521e-31821805_0] Write session: try to update token
2025-10-02T08:13:55.007361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649ccc9d-73576922-71df521e-31821805_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:55.020909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId: src_id|649ccc9d-73576922-71df521e-31821805_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:55.022262Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:55.022278Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:55.022281Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:55.022289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534684245835287:9013]
2025-10-02T08:13:55.022293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534684245835287:9013]
2025-10-02T08:13:55.022340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:55.022341Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:55.022348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:55.022352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.022355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:55.022502Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:55.023578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:55.074897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534688540802616:10829]
2025-10-02T08:13:55.075018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1890, pipe: [1:7556534688540802616:10829]
2025-10-02T08:13:55.162775Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:55.163269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.163285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.163322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540802616:10829], now have 1 active actors on pipe
2025-10-02T08:13:55.163458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534688540802616:10829]
2025-10-02T08:13:55.163481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:55.163489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:55.163529Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:55.163539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1891 reason: error at write: Disconnected sessionId: src_id|649ccc9d-73576922-71df521e-31821805_0
2025-10-02T08:13:55.163566Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:55.163694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1891 sessionId: src_id|649ccc9d-73576922-71df521e-31821805_0 is DEAD
2025-10-02T08:13:55.163847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649ccc9d-73576922-71df521e-31821805_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:55.163855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649ccc9d-73576922-71df521e-31821805_0] Write session will restart in 0.006763s
2025-10-02T08:13:55.163880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649ccc9d-73576922-71df521e-31821805_0] Write session: Do CDS request
2025-10-02T08:13:55.163887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649ccc9d-73576922-71df521e-31821805_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:55.171271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649ccc9d-73576922-71df521e-31821805_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.171343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:55.171361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1892
2025-10-02T08:13:55.171503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.171535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:55.171545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:55.171548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:55.171950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1892 sessionId:  describe result for acl check
2025-10-02T08:13:55.171979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:55.171985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:55.171987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:55.171992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534688540802896:8985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:55.172499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534688540802896:8985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:55.175722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534688540802896:8985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:55.178952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534688540802896:8985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:55.178966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534688540802896:8985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:55.178969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534688540802896:8985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:55.178977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:55.181027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:55.181449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:55.181625Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:55.181635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:55.181643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:55.181700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:55.181737Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534688540803180:8988]
2025-10-02T08:13:55.182218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:55.182406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:55.182442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:55.182691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:55.182735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.182740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.182741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.182743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.182744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.182749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.182758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.182763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.182766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.182770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.182775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.182786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.182792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.182797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.182802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.182807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.182811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.182816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.182825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.182829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.182853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:55.190842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:55.192446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:55.192462Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:55.192465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:55.192468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:55.192475Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1891 [1:7556534688540803180:8988]
2025-10-02T08:13:55.192486Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:55.192504Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:55.192507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.192510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.192512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.192527Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:55.192532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:55.192539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:55.192606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.192612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.192615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:55.192618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:55.192682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:55.192689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.192700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.192715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:55.192732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540803161:8985], now have 1 active actors on pipe
2025-10-02T08:13:55.192740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534689000467446:2378], now have 1 active actors on pipe
2025-10-02T08:13:55.192740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1891
2025-10-02T08:13:55.192746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534688540803174:8988]
2025-10-02T08:13:55.192748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534688540803174:8988]
2025-10-02T08:13:55.192760Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:55.192772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.192775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.192781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:55.192784Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:55.192790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:55.192819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:55.192822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:55.192869Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:55.192882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.192885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.192873Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1891
2025-10-02T08:13:55.192887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:55.192895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.192903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:55.192911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534688540803174:8988]
2025-10-02T08:13:55.192924Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:55.192934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:55.192949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.193028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.193035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.193056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.193094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1892 partition: 0 MaxSeqNo: 17 sessionId: src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0
2025-10-02T08:13:55.193426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649ccc9d-73576922-71df521e-31821805_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:55.196168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0] Write session: try to update token
2025-10-02T08:13:55.196184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:55.210529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId: src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:55.213309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:55.213394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.213405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.213433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:55.213453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:55.213497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.213515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.213701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.213770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.213852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.213923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.214344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.214356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.214423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.214491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.214554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.214626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.214674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.214681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.214750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.214815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.214877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.214942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.214989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.214996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.215062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.215133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.215208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.215284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.215338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.215345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.215420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.215498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.215571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.215649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.215700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.215708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.215790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.215864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.215937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.216015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.216067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.216075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.216155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.216244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.216327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.216404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.216454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.216461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.216540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.216609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.216690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.216764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.216833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.216840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.216915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.216977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.217046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.217120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.217173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.217181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.217260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.217327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.217396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.217465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.217525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.217536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.217589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:55.217644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.217665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.217672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:55.217706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:55.217722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:55.217728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:55.217730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:55.217732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:55.218116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:55.218139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:55.218145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:55.218155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:55.218157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:55.218159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:55.218863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:55.218891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:55.218897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:55.218901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:55.218904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:55.218907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:55.219549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:55.219576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:55.219586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:55.219589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:55.219595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:55.220945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:55.220964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:55.220975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392835219
2025-10-02T08:13:55.221160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:55.221177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:55.221183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:55.221192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:55.221195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:55.221200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:55.221715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:55.221743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:55.221751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:55.221759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:55.221763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:55.221768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:55.222241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:55.222265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:55.222277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:55.222280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:55.222284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:55.222289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:55.222818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:55.222834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:55.222839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:55.224080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:55.224088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:55.224094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:55.224098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:55.224107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392835219
2025-10-02T08:13:55.224484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:55.224499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:55.224505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:55.224509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:55.224513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:55.224519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:55.225221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:55.225253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:55.225259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:55.225265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:55.225268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:55.225271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:55.225791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:55.225803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.225910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392835224
2025-10-02T08:13:55.228660Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:55.228695Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:55.228703Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:55.228711Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:55.228746Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:55.228752Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:55.228753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:55.228762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534688540803174:8988]
2025-10-02T08:13:55.228765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534688540803174:8988]
2025-10-02T08:13:55.228814Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:55.228828Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:55.235216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:55.235241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.235244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:55.235415Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:55.263849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534688540803206:10829]
2025-10-02T08:13:55.263986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1891, pipe: [1:7556534688540803206:10829]
2025-10-02T08:13:55.367772Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:55.368466Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:55.368482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:55.368491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534688540803174:8988]
2025-10-02T08:13:55.368527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540803206:10829], now have 1 active actors on pipe
2025-10-02T08:13:55.368538Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:55.368623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534688540803206:10829]
2025-10-02T08:13:55.368644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:55.368650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:55.368674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1892 reason: error at write: Disconnected sessionId: src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0
2025-10-02T08:13:55.368734Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:55.368729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:55.368875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1892 sessionId: src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0 is DEAD
2025-10-02T08:13:55.369019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:55.369027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0] Write session will restart in 0.009698s
2025-10-02T08:13:55.369054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0] Write session: Do CDS request
2025-10-02T08:13:55.369061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:55.375225Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [318a6b97da3b74ab] Result# TEvPutResult {Id# [72075186224037892:1891:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:55.375297Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1891:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:55.375430Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1891:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:55.380682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.380727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:55.380741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1893
2025-10-02T08:13:55.380880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.380909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:55.380917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:55.380920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:55.381317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1893 sessionId:  describe result for acl check
2025-10-02T08:13:55.381347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:55.381349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:55.381350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:55.381354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534688540803538:8962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:55.381900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534688540803538:8962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:55.384167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534688540803538:8962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:55.387182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534688540803538:8962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:55.387198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534688540803538:8962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:55.387201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534688540803538:8962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:55.387209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:55.389267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:55.390398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:55.390664Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:55.390674Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:55.390684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:55.390734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:55.390770Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534688540803779:8969]
2025-10-02T08:13:55.391390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:55.391569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:55.391606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:55.391900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:55.391940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.391946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.391947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.391948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.391949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.391955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.391965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.391969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.391973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.391977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.391982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.391989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.392000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.392005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.392010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.392020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.392024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.392030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.392035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.392040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.392063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:55.399532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:55.401176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:55.401188Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:55.401190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:55.401192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:55.401196Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1892 [1:7556534688540803779:8969]
2025-10-02T08:13:55.401204Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:55.401217Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:55.401219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.401220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.401222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.401234Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:55.401237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:55.401242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:55.401283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.401289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.401291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:55.401293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:55.401341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:55.401346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.401354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.401361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:55.401380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534688540803773:8969]
2025-10-02T08:13:55.401382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534688540803773:8969]
2025-10-02T08:13:55.401392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:55.401402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:55.401407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534689000467453:2378], now have 1 active actors on pipe
2025-10-02T08:13:55.401412Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:55.401413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:55.401421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1892
2025-10-02T08:13:55.401425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:55.401428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:55.401433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540803739:8962], now have 1 active actors on pipe
2025-10-02T08:13:55.401457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.401467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.401478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534688540803773:8969]
2025-10-02T08:13:55.401490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:55.401499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:55.401514Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d168721c-23ec69ad-39fdd83d-541771f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:55.401524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.401529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.401530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:55.401538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.401546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:55.401497Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1892
2025-10-02T08:13:55.401569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.401606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.401613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.401623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.401653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1893 partition: 0 MaxSeqNo: 17 sessionId: src_id|d168721c-23ec69ad-39fdd83d-541771f2_0
2025-10-02T08:13:55.401938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd98e8f7-cd536bf5-ced017c7-e7240885_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d168721c-23ec69ad-39fdd83d-541771f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:55.404567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d168721c-23ec69ad-39fdd83d-541771f2_0] Write session: try to update token
2025-10-02T08:13:55.404580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d168721c-23ec69ad-39fdd83d-541771f2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:55.420151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId: src_id|d168721c-23ec69ad-39fdd83d-541771f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:55.422535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:55.422568Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:55.422571Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:55.422573Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:55.422580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534688540803773:8969]
2025-10-02T08:13:55.422583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534688540803773:8969]
2025-10-02T08:13:55.422613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:55.422617Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:55.422628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.422644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.422662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:55.422668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.422676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:55.422804Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:55.468651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534688540803804:10829]
2025-10-02T08:13:55.468952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1892, pipe: [1:7556534688540803804:10829]
2025-10-02T08:13:55.552762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168721c-23ec69ad-39fdd83d-541771f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:55.552777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168721c-23ec69ad-39fdd83d-541771f2_0] Write session will restart in 0.009063s
2025-10-02T08:13:55.552820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168721c-23ec69ad-39fdd83d-541771f2_0] Write session: Do CDS request
2025-10-02T08:13:55.552827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168721c-23ec69ad-39fdd83d-541771f2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:55.551734Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:55.550946Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:55.551228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540803804:10829], now have 1 active actors on pipe
2025-10-02T08:13:55.551933Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:55.551946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:55.551950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:55.552016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1893 reason: error at write: Disconnected sessionId: src_id|d168721c-23ec69ad-39fdd83d-541771f2_0
2025-10-02T08:13:55.552145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1893 sessionId: src_id|d168721c-23ec69ad-39fdd83d-541771f2_0 is DEAD
2025-10-02T08:13:55.552375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534688540803804:10829]
2025-10-02T08:13:55.565313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d168721c-23ec69ad-39fdd83d-541771f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.567878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:55.567898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1894
2025-10-02T08:13:55.568028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.568070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:55.568086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:55.568090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:55.568731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1894 sessionId:  describe result for acl check
2025-10-02T08:13:55.568767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:55.568775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:55.568776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:55.568781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534688540804181:8954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:55.569314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534688540804181:8954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:55.576494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534688540804181:8954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:55.577393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:55.578524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:55.578698Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:55.578709Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:55.578718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:55.578762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:55.578798Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534688540804366:8957]
2025-10-02T08:13:55.579353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:55.579561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:55.579613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:55.580105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:55.580154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.580155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.580156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.580157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.580159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.580164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.580173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.580177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.580181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.580185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.580191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.580198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.580220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.580225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.580229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.580235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.580239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.580244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.580248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.580252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.580270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:55.580400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534688540804181:8954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:55.580407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534688540804181:8954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:55.580411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534688540804181:8954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:55.580419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:55.588970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:55.590677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:55.590683Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:55.590686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:55.590690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:55.590697Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1893 [1:7556534688540804366:8957]
2025-10-02T08:13:55.590710Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:55.590728Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:55.590732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.590734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.590737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.590752Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:55.590757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:55.590766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:55.590831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.590833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.590837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:55.590839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:55.590911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:55.590913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.590928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.590941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:55.590960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534688540804355:8957]
2025-10-02T08:13:55.590962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534688540804355:8957]
2025-10-02T08:13:55.590970Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:55.590985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:55.590999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:55.591002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:55.591015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540804379:8954], now have 1 active actors on pipe
2025-10-02T08:13:55.591022Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:55.591026Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:55.591033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1893
2025-10-02T08:13:55.591048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534688540804355:8957]
2025-10-02T08:13:55.591051Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:55.591058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534689000467471:2378], now have 1 active actors on pipe
2025-10-02T08:13:55.591181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:55.591541Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1893
2025-10-02T08:13:55.591330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.591342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.591367Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:55.591374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.591378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.591380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:55.591391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.591401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:55.591417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.591456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.591459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.591471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.591509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1894 partition: 0 MaxSeqNo: 17 sessionId: src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0
2025-10-02T08:13:55.592896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d168721c-23ec69ad-39fdd83d-541771f2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:55.595683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0] Write session: try to update token
2025-10-02T08:13:55.595701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:55.603120Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:55.603143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:55.603151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534688540804355:8957]
2025-10-02T08:13:55.603200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:55.603218Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:55.603387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:55.603560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:55.603709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:55.603850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:55.604079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:55.604114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:55.612516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId: src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:55.615153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:55.615492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.615510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.615545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:55.615567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:55.615744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.615749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.615908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.615966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.616026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.616088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.616131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.616135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.616223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.616282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.616342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.616408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.616450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.616454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.616522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.616577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.616634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.616693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.616731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.616735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.616821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.616882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.616964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.617040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.617086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.617089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.617169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.617232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.617309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.617386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.617434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.617437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.617518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.617582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.617646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.617712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.617763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.617766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.617840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.617905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.617973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.618041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.618086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.618092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.618167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.618228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.618297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.618364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.618413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.618416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.618492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.618549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.618606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.618664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.618716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.618718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.618793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:55.618856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:55.618915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:55.618972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:55.619021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:55.619024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:55.619080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:55.619139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.619160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.619163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:55.619192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:55.619205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:55.619209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:55.619211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:55.619214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:55.619604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:55.619619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:55.619628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:55.619632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:55.619635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:55.619639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:55.620437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:55.620450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:55.620457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:55.620460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:55.620465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:55.620469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:55.620956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:55.620969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:55.620977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:55.620980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:55.620983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:55.622242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:55.622264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:55.622278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392835622
2025-10-02T08:13:55.622394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:55.622402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:55.622408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:55.622412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:55.622416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:55.622420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:55.622957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:55.622969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:55.622975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:55.622979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:55.622983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:55.622987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:55.623467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:55.623479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:55.623489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:55.623493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:55.623499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:55.623503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:55.623952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:55.623963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:55.623967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:55.625172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:55.625194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:55.625200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:55.625203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:55.625213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392835624
2025-10-02T08:13:55.625523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:55.625536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:55.625541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:55.625545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:55.625548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:55.625551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:55.626019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:55.626029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:55.626034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:55.626038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:55.626042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:55.626046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:55.626491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:55.626503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.626601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392835626
2025-10-02T08:13:55.629028Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:55.629059Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:55.629067Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:55.629076Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:55.629087Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:55.629090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:55.629092Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:55.629099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534688540804355:8957]
2025-10-02T08:13:55.629103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534688540804355:8957]
2025-10-02T08:13:55.629160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:55.629167Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:55.629185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:55.629193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.629195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:55.629336Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:55.652415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534688540804413:10829]
2025-10-02T08:13:55.652579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1893, pipe: [1:7556534688540804413:10829]
2025-10-02T08:13:55.767278Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:55.767614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540804413:10829], now have 1 active actors on pipe
2025-10-02T08:13:55.767983Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:55.767894Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:55.767968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:55.768008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1894 reason: status is not ok: tablet will be restarted right now sessionId: src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0
2025-10-02T08:13:55.768270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534688540804413:10829]
2025-10-02T08:13:55.768323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1894 sessionId: src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0 is DEAD
2025-10-02T08:13:55.772405Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [bca6acc943aa2931] Result# TEvPutResult {Id# [72075186224037892:1893:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:13:55.772444Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1893:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:55.772486Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1893:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:13:55.772979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:55.772991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0] Write session will restart in 0.006207s
2025-10-02T08:13:55.773013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0] Write session: Do CDS request
2025-10-02T08:13:55.773018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:55.781518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.781575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:55.781594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1895
2025-10-02T08:13:55.781722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.781753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:55.781762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:55.781766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:55.782189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1895 sessionId:  describe result for acl check
2025-10-02T08:13:55.782224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:55.782230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:55.782232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:55.782238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534688540804918:8912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:55.782720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534688540804918:8912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:55.785276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534688540804918:8912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:55.785872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:55.787512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:55.787794Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:55.787807Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:55.787819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:55.787873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:55.787918Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534688540805019:8909]
2025-10-02T08:13:55.787988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534688540804918:8912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:55.788002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534688540804918:8912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:55.788006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534688540804918:8912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:55.788014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:55.788502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:55.788674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:55.788715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:55.789014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:55.789070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.789078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.789079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.789080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.789081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.789086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.789094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.789098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.789101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.789104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.789110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.789116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.789122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.789126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.789130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.789134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.789138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.789142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.789146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.789150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.789166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:55.797115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:55.799037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:55.799057Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:55.799059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:55.799064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:55.799071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1894 [1:7556534688540805019:8909]
2025-10-02T08:13:55.799083Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:55.799100Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:55.799104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.799107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.799109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.799126Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:55.799134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:55.799146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:55.799216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.799225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.799229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:55.799231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:55.799298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:55.799305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.799319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.799334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:55.799354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534688540805009:8909]
2025-10-02T08:13:55.799360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534688540805009:8909]
2025-10-02T08:13:55.799367Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:55.799380Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:55.799382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:55.799393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:55.799397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:55.799399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:55.799401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1894
2025-10-02T08:13:55.799409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540805024:8912], now have 1 active actors on pipe
2025-10-02T08:13:55.799412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534689000467493:2378], now have 1 active actors on pipe
2025-10-02T08:13:55.799444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.799455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.799468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534688540805009:8909]
2025-10-02T08:13:55.799471Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:55.799478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:55.799495Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|490483b9-263da651-7c1e6127-5a25e766_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:55.799505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.799482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1894
2025-10-02T08:13:55.799508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.799510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:55.799519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.799527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:55.799553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.799591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.799598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.799612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.799651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1895 partition: 0 MaxSeqNo: 17 sessionId: src_id|490483b9-263da651-7c1e6127-5a25e766_0
2025-10-02T08:13:55.799966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|709876d8-baf3c43d-f7c9c9e0-120b7fb0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|490483b9-263da651-7c1e6127-5a25e766_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:55.802685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|490483b9-263da651-7c1e6127-5a25e766_0] Write session: try to update token
2025-10-02T08:13:55.802703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|490483b9-263da651-7c1e6127-5a25e766_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:55.816563Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:55.816580Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:55.816582Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:55.816591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534688540805009:8909]
2025-10-02T08:13:55.816595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534688540805009:8909]
2025-10-02T08:13:55.816641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:55.816650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:55.816651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.816653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:55.816654Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:55.816779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId: src_id|490483b9-263da651-7c1e6127-5a25e766_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:55.816786Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:55.819190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:55.868500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534688540805051:10829]
2025-10-02T08:13:55.868628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1894, pipe: [1:7556534688540805051:10829]
2025-10-02T08:13:55.950677Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:55.951241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.951252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.951294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540805051:10829], now have 1 active actors on pipe
2025-10-02T08:13:55.951392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:55.951402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:55.951444Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:55.951454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1895 reason: error at write: Disconnected sessionId: src_id|490483b9-263da651-7c1e6127-5a25e766_0
2025-10-02T08:13:55.951626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1895 sessionId: src_id|490483b9-263da651-7c1e6127-5a25e766_0 is DEAD
2025-10-02T08:13:55.951755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|490483b9-263da651-7c1e6127-5a25e766_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:55.951763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|490483b9-263da651-7c1e6127-5a25e766_0] Write session will restart in 0.006257s
2025-10-02T08:13:55.951786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|490483b9-263da651-7c1e6127-5a25e766_0] Write session: Do CDS request
2025-10-02T08:13:55.951793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|490483b9-263da651-7c1e6127-5a25e766_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:55.951785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534688540805051:10829]
2025-10-02T08:13:55.951827Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:55.959319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|490483b9-263da651-7c1e6127-5a25e766_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.959375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:55.959393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1896
2025-10-02T08:13:55.959536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:55.959573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:55.959583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:55.959587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:55.959975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1896 sessionId:  describe result for acl check
2025-10-02T08:13:55.960008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:55.960014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:55.960016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:55.960021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534688540805360:8892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:55.960532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534688540805360:8892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:55.963172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534688540805360:8892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:55.966406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534688540805360:8892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:55.966426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534688540805360:8892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:55.966429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534688540805360:8892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:55.966437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:55.967732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:55.968488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:55.968749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:55.968760Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:55.968770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:55.968839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:55.968876Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534688540805624:8894]
2025-10-02T08:13:55.969543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:55.969712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:55.969753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:55.970049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:55.970090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.970096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.970097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.970098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.970099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.970104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.970115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.970119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.970123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.970127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.970132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.970139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:55.970145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.970151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:55.970160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.970166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:55.970174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.970180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.970189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.970194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.970217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:55.978178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:55.979617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:55.979637Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:55.979640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:55.979644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:55.979652Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1895 [1:7556534688540805624:8894]
2025-10-02T08:13:55.979665Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:55.979682Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:55.979686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.979689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.979692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.979708Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:55.979717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:55.979724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:55.979787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.979795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.979798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:55.979801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:55.979866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:55.979878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.979892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:55.979904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:55.979920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534688540805618:8894]
2025-10-02T08:13:55.979926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534688540805618:8894]
2025-10-02T08:13:55.979933Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:55.979941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1895
2025-10-02T08:13:55.979955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534688540805602:8892], now have 1 active actors on pipe
2025-10-02T08:13:55.979963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:55.979963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:55.979966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:55.979978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:55.979981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:55.979987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534689000467509:2378], now have 1 active actors on pipe
2025-10-02T08:13:55.980018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.980027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.980040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534688540805618:8894]
2025-10-02T08:13:55.980047Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:55.980057Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:55.980024Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1895
2025-10-02T08:13:55.980072Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:55.980083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:55.980086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:55.980088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:55.980098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:55.980110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:55.980139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.980185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:55.980192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:55.980217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:55.980255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1896 partition: 0 MaxSeqNo: 17 sessionId: src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0
2025-10-02T08:13:55.980557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|490483b9-263da651-7c1e6127-5a25e766_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:55.983165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0] Write session: try to update token
2025-10-02T08:13:55.983184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:55.996415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId: src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:55.998353Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:55.998375Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:55.998377Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:55.998384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534688540805618:8894]
2025-10-02T08:13:55.998388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534688540805618:8894]
2025-10-02T08:13:55.998423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:55.998428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:55.998430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:55.998428Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:55.998433Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:55.998563Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:55.999286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:56.051791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534692835772946:10829]
2025-10-02T08:13:56.051917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1895, pipe: [1:7556534692835772946:10829]
2025-10-02T08:13:56.146695Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:56.147352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.147372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.147416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835772946:10829], now have 1 active actors on pipe
2025-10-02T08:13:56.147541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:56.147550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:56.147599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1896 reason: error at write: Disconnected sessionId: src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0
2025-10-02T08:13:56.147627Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:56.147628Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:56.147750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1896 sessionId: src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0 is DEAD
2025-10-02T08:13:56.147902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534692835772946:10829]
2025-10-02T08:13:56.148093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:56.148105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0] Write session will restart in 0.009689s
2025-10-02T08:13:56.148132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0] Write session: Do CDS request
2025-10-02T08:13:56.148138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:56.159338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.159340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:56.159359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1897
2025-10-02T08:13:56.159602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.159632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:56.159636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:56.159639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:56.160044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1897 sessionId:  describe result for acl check
2025-10-02T08:13:56.160079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:56.160086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:56.160087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:56.160092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534692835773435:8866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:56.160611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534692835773435:8866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:56.162705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534692835773435:8866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:56.163931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:56.164291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:56.164656Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:56.164671Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:56.164682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:56.164732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:56.164767Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534692835773515:8868]
2025-10-02T08:13:56.165273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534692835773435:8866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:56.165288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534692835773435:8866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:56.165291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534692835773435:8866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:56.165299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:56.165434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:56.165581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:56.165619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:56.165910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:56.165952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.165960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.165961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.165962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.165964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.165969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.165978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.165982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.165986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.165989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.165995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.166002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.166007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.166012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.166016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.166021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.166025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.166030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.166035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.166040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.166057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:56.174401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:56.176237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:56.176257Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:56.176259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:56.176263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:56.176269Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1896 [1:7556534692835773515:8868]
2025-10-02T08:13:56.176282Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:56.176300Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:56.176308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.176312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.176314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.176330Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:56.176340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:56.176347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:56.176413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.176421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.176424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:56.176426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:56.176497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:56.176506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.176519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.176530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:56.176548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835773520:8866], now have 1 active actors on pipe
2025-10-02T08:13:56.176552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1896
2025-10-02T08:13:56.176555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534692835773509:8868]
2025-10-02T08:13:56.176557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534692835773509:8868]
2025-10-02T08:13:56.176565Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:56.176574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534693295434812:2378], now have 1 active actors on pipe
2025-10-02T08:13:56.176576Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:56.176579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:56.176581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:56.176595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:56.176597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:56.176603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.176607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.176645Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534692835773509:8868]
2025-10-02T08:13:56.176660Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:56.176673Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9519298b-48b2ac0c-d0926985-476155e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:56.176684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.176687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.176689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:56.176694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:56.176697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.176678Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1896
2025-10-02T08:13:56.176706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:56.176745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.176828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.176835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.176847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.176888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1897 partition: 0 MaxSeqNo: 17 sessionId: src_id|9519298b-48b2ac0c-d0926985-476155e6_0
2025-10-02T08:13:56.177256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|906a2a6b-33a7d87b-7a0b8c5-d42cc21b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9519298b-48b2ac0c-d0926985-476155e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:56.179993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9519298b-48b2ac0c-d0926985-476155e6_0] Write session: try to update token
2025-10-02T08:13:56.180011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9519298b-48b2ac0c-d0926985-476155e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:56.193881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId: src_id|9519298b-48b2ac0c-d0926985-476155e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:56.195745Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:56.195770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:56.195772Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:56.195781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534692835773509:8868]
2025-10-02T08:13:56.195786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534692835773509:8868]
2025-10-02T08:13:56.195830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:56.195834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:56.195839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:56.195841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.195847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:56.195999Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:56.196653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:56.247889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534692835773546:10829]
2025-10-02T08:13:56.248020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1896, pipe: [1:7556534692835773546:10829]
2025-10-02T08:13:56.344118Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:56.344459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.344481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.344523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835773546:10829], now have 1 active actors on pipe
2025-10-02T08:13:56.344648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:56.344662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:56.344723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1897 reason: error at write: Disconnected sessionId: src_id|9519298b-48b2ac0c-d0926985-476155e6_0
2025-10-02T08:13:56.344775Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:56.344791Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:56.344914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1897 sessionId: src_id|9519298b-48b2ac0c-d0926985-476155e6_0 is DEAD
2025-10-02T08:13:56.345046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9519298b-48b2ac0c-d0926985-476155e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:56.345056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9519298b-48b2ac0c-d0926985-476155e6_0] Write session will restart in 0.006099s
2025-10-02T08:13:56.345079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9519298b-48b2ac0c-d0926985-476155e6_0] Write session: Do CDS request
2025-10-02T08:13:56.345085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9519298b-48b2ac0c-d0926985-476155e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:56.345084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534692835773546:10829]
2025-10-02T08:13:56.352298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9519298b-48b2ac0c-d0926985-476155e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.352359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:56.352374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1898
2025-10-02T08:13:56.352481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.352508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:56.352517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:56.352520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:56.352888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1898 sessionId:  describe result for acl check
2025-10-02T08:13:56.352917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:56.352922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:56.352923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:56.352927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534692835773874:8852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:56.353392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534692835773874:8852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:56.355799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534692835773874:8852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:56.358621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534692835773874:8852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:56.358634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534692835773874:8852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:56.358638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534692835773874:8852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:56.358646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:56.359923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:56.360222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:56.360409Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:56.360425Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:56.360439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:56.360509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:56.360552Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534692835774122:8855]
2025-10-02T08:13:56.361251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:56.361444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:56.361497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:56.361828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:56.361917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.361929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.361930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.361932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.361933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.361938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.361949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.361952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.361956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.361959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.361966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.361973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.361988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.361993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.361998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.362009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.362014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.362023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.362028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.362036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.362054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:56.369943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:56.371763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:56.371782Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:56.371786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:56.371789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:56.371795Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1897 [1:7556534692835774122:8855]
2025-10-02T08:13:56.371806Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:56.371822Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:56.371829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.371833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.371834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.371852Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:56.371861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:56.371868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:56.371929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.371936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.371940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:56.371942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:56.372005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:56.372013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.372026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.372043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:56.372052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1897
2025-10-02T08:13:56.372066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835774107:8852], now have 1 active actors on pipe
2025-10-02T08:13:56.372076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534692835774116:8855]
2025-10-02T08:13:56.372079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534692835774116:8855]
2025-10-02T08:13:56.372090Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:56.372102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534693295434821:2378], now have 1 active actors on pipe
2025-10-02T08:13:56.372110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:56.372111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.372115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.372123Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:56.372132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:56.372147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:56.372149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:56.372194Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9d7539d-7d12c840-172ef707-accf1f26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:56.372215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.372219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.372169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1897
2025-10-02T08:13:56.372220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:56.372229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.372238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:56.372248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534692835774116:8855]
2025-10-02T08:13:56.372255Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:56.372267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:56.372285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.372336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.372343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.372354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.372390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1898 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9d7539d-7d12c840-172ef707-accf1f26_0
2025-10-02T08:13:56.372700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9519298b-48b2ac0c-d0926985-476155e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9d7539d-7d12c840-172ef707-accf1f26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:56.375092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7539d-7d12c840-172ef707-accf1f26_0] Write session: try to update token
2025-10-02T08:13:56.375109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7539d-7d12c840-172ef707-accf1f26_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:56.388777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId: src_id|c9d7539d-7d12c840-172ef707-accf1f26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:56.390562Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:56.390590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:56.390593Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:56.390603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534692835774116:8855]
2025-10-02T08:13:56.390608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534692835774116:8855]
2025-10-02T08:13:56.390654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:56.390661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.390663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:56.390662Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:56.390668Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:56.390829Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:56.391471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:56.445159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534692835774149:10829]
2025-10-02T08:13:56.445286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1897, pipe: [1:7556534692835774149:10829]
2025-10-02T08:13:56.529786Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:56.530291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.530303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.530335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835774149:10829], now have 1 active actors on pipe
2025-10-02T08:13:56.530474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534692835774149:10829]
2025-10-02T08:13:56.530507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:56.530513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:56.530548Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:56.530590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1898 reason: error at write: Disconnected sessionId: src_id|c9d7539d-7d12c840-172ef707-accf1f26_0
2025-10-02T08:13:56.530628Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:56.530742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1898 sessionId: src_id|c9d7539d-7d12c840-172ef707-accf1f26_0 is DEAD
2025-10-02T08:13:56.530882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7539d-7d12c840-172ef707-accf1f26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:56.530893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7539d-7d12c840-172ef707-accf1f26_0] Write session will restart in 0.007291s
2025-10-02T08:13:56.530917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7539d-7d12c840-172ef707-accf1f26_0] Write session: Do CDS request
2025-10-02T08:13:56.530923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7539d-7d12c840-172ef707-accf1f26_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:56.539357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7539d-7d12c840-172ef707-accf1f26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.539450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:56.539480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1899
2025-10-02T08:13:56.539619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.539650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:56.539673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:56.539677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:56.540052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1899 sessionId:  describe result for acl check
2025-10-02T08:13:56.540091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:56.540097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:56.540099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:56.540104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534692835774488:8841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:56.540619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534692835774488:8841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:56.543452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534692835774488:8841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:56.546705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534692835774488:8841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:56.546722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534692835774488:8841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:56.546726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534692835774488:8841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:56.546734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:56.547022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:56.548252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:56.548418Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:56.548428Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:56.548438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:56.548481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:56.548519Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534692835774727:8843]
2025-10-02T08:13:56.549176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:56.549377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:56.549424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:56.549702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:56.549737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.549738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.549739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.549740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.549741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.549746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.549757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.549761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.549765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.549768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.549774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.549780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.549786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.549791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.549795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.549800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.549805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.549810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.549814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.549819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.549839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:56.557890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:56.559585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:56.559609Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:56.559611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:56.559615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:56.559621Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1898 [1:7556534692835774727:8843]
2025-10-02T08:13:56.559633Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:56.559650Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:56.559653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.559655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.559660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.559674Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:56.559683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:56.559690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:56.559753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.559761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.559763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:56.559766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:56.559822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:56.559828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.559841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.559850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:56.559871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835774718:8841], now have 1 active actors on pipe
2025-10-02T08:13:56.559881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534692835774720:8843]
2025-10-02T08:13:56.559882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534692835774720:8843]
2025-10-02T08:13:56.559888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1898
2025-10-02T08:13:56.559890Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:56.559900Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:56.559900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534693295434841:2378], now have 1 active actors on pipe
2025-10-02T08:13:56.559902Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:56.559905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:56.559918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:56.559921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:56.559927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.559930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.560045Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1898
2025-10-02T08:13:56.559965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534692835774720:8843]
2025-10-02T08:13:56.559979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:56.559995Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:56.560001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.560005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.560006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:56.560014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.560017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:56.560022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:56.560048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.560177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.560186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.560228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.560282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1899 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0
2025-10-02T08:13:56.560612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7539d-7d12c840-172ef707-accf1f26_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:56.563202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0] Write session: try to update token
2025-10-02T08:13:56.563219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:56.576793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId: src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:56.578035Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:56.578054Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:56.578057Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:56.578066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534692835774720:8843]
2025-10-02T08:13:56.578070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534692835774720:8843]
2025-10-02T08:13:56.578113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:56.578115Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:56.578121Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:56.578125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.578128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:56.578272Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:56.579448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:56.630941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534692835774764:10829]
2025-10-02T08:13:56.631038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1898, pipe: [1:7556534692835774764:10829]
2025-10-02T08:13:56.710323Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:56.710809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.710823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.710856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835774764:10829], now have 1 active actors on pipe
2025-10-02T08:13:56.710940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534692835774764:10829]
2025-10-02T08:13:56.710963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:56.710965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:56.711032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1899 reason: error at write: Disconnected sessionId: src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0
2025-10-02T08:13:56.711058Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:56.711186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1899 sessionId: src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0 is DEAD
2025-10-02T08:13:56.711190Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:56.711344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:56.711355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0] Write session will restart in 0.006027s
2025-10-02T08:13:56.711379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0] Write session: Do CDS request
2025-10-02T08:13:56.711385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:56.718299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.718353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:56.718374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1900
2025-10-02T08:13:56.718527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.718560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:56.718569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:56.718572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:56.719068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1900 sessionId:  describe result for acl check
2025-10-02T08:13:56.719098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:56.719100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:56.719101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:56.719106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534692835775107:8818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:56.719627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534692835775107:8818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:56.722192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534692835775107:8818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:56.724862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534692835775107:8818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:56.724876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534692835775107:8818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:56.724880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534692835775107:8818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:56.724888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:56.725984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:56.726259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:56.726588Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:56.726598Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:56.726607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:56.726653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:56.726687Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534692835775347:8822]
2025-10-02T08:13:56.727264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:56.727425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:56.727462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:56.727725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:56.727762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.727767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.727768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.727769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.727770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.727774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.727783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.727786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.727790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.727793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.727798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.727805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.727811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.727816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.727819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.727825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.727834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.727839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.727846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.727851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.727872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:56.735664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:56.737144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:56.737163Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:56.737165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:56.737168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:56.737173Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1899 [1:7556534692835775347:8822]
2025-10-02T08:13:56.737183Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:56.737199Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:56.737201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.737204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.737205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.737218Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:56.737222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:56.737227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:56.737289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.737300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.737303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:56.737309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:56.737372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:56.737380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.737392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.737408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:56.737432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835775337:8818], now have 1 active actors on pipe
2025-10-02T08:13:56.737441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534692835775341:8822]
2025-10-02T08:13:56.737443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534692835775341:8822]
2025-10-02T08:13:56.737450Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:56.737453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1899
2025-10-02T08:13:56.737460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:56.737471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:56.737477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:56.737481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534693295434848:2378], now have 1 active actors on pipe
2025-10-02T08:13:56.737507Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534692835775341:8822]
2025-10-02T08:13:56.737512Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:56.737538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.737544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.737547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:56.737550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:56.737556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:56.737564Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ea72295-5204dee3-2f52e232-979cecbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:56.737568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.737572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.737573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:56.737580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.737590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:56.737602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.737604Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1899
2025-10-02T08:13:56.737644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.737649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.737662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.737694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1900 partition: 0 MaxSeqNo: 17 sessionId: src_id|1ea72295-5204dee3-2f52e232-979cecbd_0
2025-10-02T08:13:56.738010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e38f43b-ef573c34-69163b9c-a024bc99_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1ea72295-5204dee3-2f52e232-979cecbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:56.740553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea72295-5204dee3-2f52e232-979cecbd_0] Write session: try to update token
2025-10-02T08:13:56.740569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea72295-5204dee3-2f52e232-979cecbd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:56.748374Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:56.748396Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:56.748405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534692835775341:8822]
2025-10-02T08:13:56.748445Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:56.748452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:56.748669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:56.748860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:56.749029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:56.749203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:56.749443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:56.749492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:56.754765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId: src_id|1ea72295-5204dee3-2f52e232-979cecbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:56.757565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:56.757637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.757651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.757692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:56.757711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:56.757776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.757784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.757958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.758029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.758105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.758182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.758379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.758391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.758471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.758543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.758614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.758685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.758733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.758741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.758820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.758888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.758960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.759030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.759076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.759084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.759159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.759237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.759318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.759398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.759455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.759463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.759546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.759620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.759699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.759778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.759835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.759843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.759929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.760008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.760092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.760175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.760246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.760253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.760342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.760453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.760549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.760634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.760691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.760698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.760786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.760881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.760968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.761054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.761106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.761113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.761194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.761265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.761332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.761397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.761454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.761460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.761541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:56.761619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:56.761690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:56.761760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:56.761814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:56.761820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:56.761861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:56.761929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.761950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.761953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:56.761984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:56.761998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:56.762000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:56.762003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:56.762005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:56.762436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:56.762471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:56.762478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:56.762486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:56.762488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:56.762491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:56.763099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:56.763129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:56.763135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:56.763142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:56.763144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:56.763147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:56.763665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:56.763699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:56.763705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:56.763713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:56.763715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:56.765056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:56.765080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:56.765091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392836764
2025-10-02T08:13:56.765225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:56.765245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:56.765251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:56.765254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:56.765258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:56.765261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:56.765753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:56.765783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:56.765794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:56.765797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:56.765800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:56.765804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:56.766329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:56.766358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:56.766368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:56.766371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:56.766376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:56.766379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:56.766881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:56.766913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:56.766924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:56.768165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:56.768190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:56.768195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:56.768199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:56.768221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392836768
2025-10-02T08:13:56.768550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:56.768578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:56.768584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:56.768587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:56.768591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:56.768599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:56.769138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:56.769170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:56.769178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:56.769189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:56.769192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:56.769197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:56.769705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:56.769730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.769832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392836769
2025-10-02T08:13:56.770676Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:56.770701Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:56.770707Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:56.770713Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:56.772564Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:56.772582Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:56.772584Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:56.772594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534692835775341:8822]
2025-10-02T08:13:56.772599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534692835775341:8822]
2025-10-02T08:13:56.772664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:56.772665Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:56.772674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:56.772678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.772680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:56.772889Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:56.811072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534692835775411:10829]
2025-10-02T08:13:56.811199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1899, pipe: [1:7556534692835775411:10829]
2025-10-02T08:13:56.919671Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:56.919984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835775411:10829], now have 1 active actors on pipe
2025-10-02T08:13:56.920110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:56.920115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:56.920124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534692835775411:10829]
2025-10-02T08:13:56.920136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1900 reason: error at write: Disconnected sessionId: src_id|1ea72295-5204dee3-2f52e232-979cecbd_0
2025-10-02T08:13:56.920224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:56.920297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1900 sessionId: src_id|1ea72295-5204dee3-2f52e232-979cecbd_0 is DEAD
2025-10-02T08:13:56.920391Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:56.920428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea72295-5204dee3-2f52e232-979cecbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:56.920438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea72295-5204dee3-2f52e232-979cecbd_0] Write session will restart in 0.008279s
2025-10-02T08:13:56.920460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea72295-5204dee3-2f52e232-979cecbd_0] Write session: Do CDS request
2025-10-02T08:13:56.920467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea72295-5204dee3-2f52e232-979cecbd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:56.930266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea72295-5204dee3-2f52e232-979cecbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.930423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:56.930442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1901
2025-10-02T08:13:56.930545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:56.930573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:56.930582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:56.930585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:56.930962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1901 sessionId:  describe result for acl check
2025-10-02T08:13:56.930995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:56.930996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:56.930998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:56.931003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534692835775841:8763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:56.931484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534692835775841:8763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:56.934139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534692835775841:8763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:56.937622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:56.937718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534692835775841:8763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:56.937733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534692835775841:8763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:56.937737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534692835775841:8763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:56.937744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:56.937976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:56.938128Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:56.938136Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:56.938144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:56.938183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:56.938218Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534692835776001:8764]
2025-10-02T08:13:56.938789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:56.938973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:56.939016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:56.939295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:56.939332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.939338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.939339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.939340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.939341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.939345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.939354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.939363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.939366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.939373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.939378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.939388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:56.939398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.939407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:56.939411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.939419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:56.939427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.939432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.939442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.939451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.939472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:56.947333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:56.949330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:56.949351Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:56.949352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:56.949355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:56.949361Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1900 [1:7556534692835776001:8764]
2025-10-02T08:13:56.949369Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:56.949383Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:56.949385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.949387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.949388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.949401Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:56.949404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:56.949409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:56.949460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.949466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.949468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:56.949470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:56.949520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:56.949526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.949534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:56.949545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:56.949557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534692835775989:8764]
2025-10-02T08:13:56.949562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534692835775989:8764]
2025-10-02T08:13:56.949567Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:56.949576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:56.949584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:56.949587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:56.949588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:56.949589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:56.949626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534692835775996:8763], now have 1 active actors on pipe
2025-10-02T08:13:56.949628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1900
2025-10-02T08:13:56.949634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534692835775989:8764]
2025-10-02T08:13:56.949638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:56.949643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534693295434878:2378], now have 1 active actors on pipe
2025-10-02T08:13:56.949643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:56.949647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.949651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.949696Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf53b311-13c04ce-169fdd5d-53823789_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:56.949707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:56.949711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:56.949713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:56.949707Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1900
2025-10-02T08:13:56.949720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:56.949733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:56.949753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.949790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.949795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.949804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:56.949843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1901 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf53b311-13c04ce-169fdd5d-53823789_0
2025-10-02T08:13:56.950127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea72295-5204dee3-2f52e232-979cecbd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf53b311-13c04ce-169fdd5d-53823789_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:56.952875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf53b311-13c04ce-169fdd5d-53823789_0] Write session: try to update token
2025-10-02T08:13:56.952894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf53b311-13c04ce-169fdd5d-53823789_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:56.968735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId: src_id|cf53b311-13c04ce-169fdd5d-53823789_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:56.971704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:56.972052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:56.972076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:56.973887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:56.973926Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:56.973929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:56.973931Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:56.973939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534692835775989:8764]
2025-10-02T08:13:56.973943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534692835775989:8764]
2025-10-02T08:13:56.973986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:56.973998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:56.974001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:56.974004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:56.974008Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:56.974014Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:56.974158Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:57.020524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534697130743325:10829]
2025-10-02T08:13:57.020674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1900, pipe: [1:7556534697130743325:10829]
2025-10-02T08:13:57.111493Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:57.111970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.111992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.112144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.112217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.112278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.112340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.112383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.112391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.112453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.112512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.112583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.112646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.112691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.112697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.112763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.112847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.112906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.112966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.113007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.113013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.113081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.113158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.113229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.113306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.113369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.113376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.113471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.113549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.113634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.113720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.113784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.113787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.113873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.113946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.114017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.114090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.114139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.114142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.114226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.114296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.114378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.114461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.114519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.114522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.114610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.114687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.114764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.114839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.114891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.114894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.114975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.115043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.115115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.115185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.115236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.115239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.115318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.115385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.115450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.115528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.115581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.115584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.115665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130743325:10829], now have 1 active actors on pipe
2025-10-02T08:13:57.115966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534697130743325:10829]
2025-10-02T08:13:57.116101Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:57.116168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:57.116740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf53b311-13c04ce-169fdd5d-53823789_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:57.116749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf53b311-13c04ce-169fdd5d-53823789_0] Write session will restart in 0.005413s
2025-10-02T08:13:57.116772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf53b311-13c04ce-169fdd5d-53823789_0] Write session: Do CDS request
2025-10-02T08:13:57.116778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf53b311-13c04ce-169fdd5d-53823789_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:57.116229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1901 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf53b311-13c04ce-169fdd5d-53823789_0
2025-10-02T08:13:57.116401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1901 sessionId: src_id|cf53b311-13c04ce-169fdd5d-53823789_0 is DEAD
2025-10-02T08:13:57.117169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:57.123295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf53b311-13c04ce-169fdd5d-53823789_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.123401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:57.123418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1902
2025-10-02T08:13:57.123544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.123575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:57.123585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:57.123589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:57.123990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1902 sessionId:  describe result for acl check
2025-10-02T08:13:57.124032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:57.124038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:57.124040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:57.124045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534697130743554:8746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:57.124597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534697130743554:8746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:57.127549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534697130743554:8746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:57.130589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534697130743554:8746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:57.130607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534697130743554:8746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:57.130610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534697130743554:8746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:57.130617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:57.135339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:57.136570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:57.136831Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:57.136841Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:57.136851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:57.136993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:57.137032Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534697130743910:8755]
2025-10-02T08:13:57.137559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:57.137752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:57.137791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:57.138070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:57.138109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.138115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.138116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.138117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.138118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.138123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.138133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.138137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.138141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.138144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.138150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.138156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.138162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.138166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.138171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.138176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.138180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.138185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.138189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.138193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.138214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:57.145977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:57.147387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:57.147408Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:57.147410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:57.147413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:57.147418Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1901 [1:7556534697130743910:8755]
2025-10-02T08:13:57.147427Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:57.147442Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:57.147444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.147446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.147448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.147461Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:57.147464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:57.147470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:57.147516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.147524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.147526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:57.147528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:57.147596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:57.147608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.147620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.147630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:57.147642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1901
2025-10-02T08:13:57.147647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130743771:8746], now have 1 active actors on pipe
2025-10-02T08:13:57.147650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534697590402181:2378], now have 1 active actors on pipe
2025-10-02T08:13:57.147655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.147658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.147674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534697130743904:8755]
2025-10-02T08:13:57.147676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534697130743904:8755]
2025-10-02T08:13:57.147688Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:57.147698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:57.147700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:57.147706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:57.147717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:57.147720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:57.147735Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:57.147741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.147745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.147747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:57.147753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.147761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:57.147794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534697130743904:8755]
2025-10-02T08:13:57.147806Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:57.147817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:57.147817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.147792Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1901
2025-10-02T08:13:57.147917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.147926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.147940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.147973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1902 partition: 0 MaxSeqNo: 17 sessionId: src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0
2025-10-02T08:13:57.148315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf53b311-13c04ce-169fdd5d-53823789_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:57.150750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0] Write session: try to update token
2025-10-02T08:13:57.150765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:57.158900Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:57.158921Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:57.158928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534697130743904:8755]
2025-10-02T08:13:57.158971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:57.159140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:57.159210Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:57.159283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:57.159419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:57.159550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:57.159732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:57.159760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:57.164834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId: src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:57.167313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:57.167385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.167398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.167430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:57.167451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:57.167500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.167514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.167656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.167711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.167779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.167836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.167883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.167893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.167962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.168015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.168069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.168129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.168169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.168177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.168251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.168311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.168382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.168455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.168500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.168506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.168579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.168640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.168708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.168778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.168851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.168857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.168932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.168990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.169053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.169120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.169167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.169173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.169242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.169302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.169368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.169442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.169489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.169494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.169564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.169626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.169694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.169758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.169804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.169809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.169878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.169941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.169997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.170054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.170100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.170105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.170173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.170234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.170291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.170348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.170394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.170400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.170474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.170532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.170590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.170663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.170716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.170723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.170763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:57.170833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.170855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.170860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:57.170888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:57.170903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:57.170909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:57.170912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:57.170914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:57.171273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:57.171298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:57.171303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:57.171307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:57.171309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:57.171312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:57.171850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:57.171873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:57.171878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:57.171880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:57.171883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:57.171885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:57.172415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:57.172436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:57.172444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:57.172447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:57.172449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:57.173612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:57.173630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:57.173639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392837173
2025-10-02T08:13:57.173735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:57.173746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:57.173750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:57.173760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:57.173766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:57.173768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:57.174216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:57.174239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:57.174243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:57.174246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:57.174248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:57.174251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:57.174699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:57.174710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:57.174717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:57.174719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:57.174721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:57.174724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:57.175155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:57.175164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:57.175168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:57.176215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:57.176224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:57.176228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:57.176231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:57.176237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392837176
2025-10-02T08:13:57.176504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:57.176510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:57.176515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:57.176517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:57.176519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:57.176523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:57.177029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:57.177056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:57.177062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:57.177065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:57.177068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:57.177072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:57.177543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:57.177564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.177656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392837177
2025-10-02T08:13:57.178375Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:57.178394Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:57.178402Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:57.178409Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:57.180090Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:57.180105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:57.180107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:57.180116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534697130743904:8755]
2025-10-02T08:13:57.180120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534697130743904:8755]
2025-10-02T08:13:57.180177Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:57.180180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:57.180183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.180184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:57.180190Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:57.180332Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:57.215590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534697130743941:10829]
2025-10-02T08:13:57.215796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1901, pipe: [1:7556534697130743941:10829]
2025-10-02T08:13:57.314332Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:57.314758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130743941:10829], now have 1 active actors on pipe
2025-10-02T08:13:57.314882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534697130743941:10829]
2025-10-02T08:13:57.314905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:57.314908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:57.314931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1902 reason: error at write: Disconnected sessionId: src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0
2025-10-02T08:13:57.314994Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:57.315143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1902 sessionId: src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0 is DEAD
2025-10-02T08:13:57.315271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:57.315281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0] Write session will restart in 0.006033s
2025-10-02T08:13:57.315303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0] Write session: Do CDS request
2025-10-02T08:13:57.315310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:57.315337Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:13:57.315099Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:57.315454Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 19 consumer shared/user session shared/user_1_19_16383212970648087262_v1 is DEAD
2025-10-02T08:13:57.315593Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:13:57.315620Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534611231351883:10817] disconnected; active server actors: 1
2025-10-02T08:13:57.315630Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534611231351883:10817] client user disconnected session shared/user_1_19_16383212970648087262_v1
2025-10-02T08:13:57.315711Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:13:57.315717Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:13:57.315723Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.005692s
2025-10-02T08:13:57.322176Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:13:57.322310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.322365Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:13:57.322370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:57.322375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1903
2025-10-02T08:13:57.322379Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 20
2025-10-02T08:13:57.322503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.322534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:57.322543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:57.322546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:57.322623Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 20 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:13:57.322676Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:13:57.322765Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 auth for : user
2025-10-02T08:13:57.322858Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 Handle describe topics response
2025-10-02T08:13:57.322878Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 auth is DEAD
2025-10-02T08:13:57.322879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1903 sessionId:  describe result for acl check
2025-10-02T08:13:57.322899Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:13:57.322903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:57.322905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:57.322906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:57.322910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534697130744211:8732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:57.323112Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:13:57.323196Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_20_14160681258514996816_v1
2025-10-02T08:13:57.323206Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:13:57.323267Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:13:57.323273Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534697130744212:8738] connected; active server actors: 1
2025-10-02T08:13:57.323366Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:13:57.323404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534697130744211:8732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:57.323408Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 got read request: guid# f381d3c8-99346559-9e6380f3-b6367091
2025-10-02T08:13:57.323590Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534697130744212:8738] session shared/user_1_20_14160681258514996816_v1
2025-10-02T08:13:57.323609Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:13:57.323617Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:13:57.323622Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_20_14160681258514996816_v1" (Sender=[1:7556534697130744200:8738], Pipe=[1:7556534697130744212:8738], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:13:57.323625Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:13:57.323636Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:13:57.323642Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_20_14160681258514996816_v1" (Sender=[1:7556534697130744200:8738], Pipe=[1:7556534697130744212:8738], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:13:57.323653Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_20_14160681258514996816_v1" sender [1:7556534697130744200:8738] lock partition 0 for ReadingSession "shared/user_1_20_14160681258514996816_v1" (Sender=[1:7556534697130744200:8738], Pipe=[1:7556534697130744212:8738], Partitions=[], ActiveFamilyCount=1) generation 1 step 20
2025-10-02T08:13:57.323667Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:13:57.323672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000031s
2025-10-02T08:13:57.324006Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 20 Session: "shared/user_1_20_14160681258514996816_v1" ClientId: "user" PipeClient { RawX1: 7556534697130744212 RawX2: 4503603922346530 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:13:57.324031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:13:57.329293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534697130744211:8732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:57.332500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534697130744211:8732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:57.332519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534697130744211:8732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:57.332522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534697130744211:8732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:57.332530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:57.335627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:57.336025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:57.336162Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:57.336169Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:57.336176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:57.336223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:57.336253Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534697130744535:8735]
2025-10-02T08:13:57.336737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:57.336915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:57.336945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:57.337146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:57.337187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.337193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.337194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.337197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.337197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.337201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.337207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.337210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.337213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.337215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.337219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.337223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.337227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.337230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.337232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.337234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.337237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.337240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.337242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.337245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.337256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:57.345099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:57.346858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:57.346882Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:57.346885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:57.346890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:57.346897Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1902 [1:7556534697130744535:8735]
2025-10-02T08:13:57.346909Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:57.346927Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:57.346930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.346933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.346935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.346956Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:57.346967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:57.346973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:57.347044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.347051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.347054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:57.347057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:57.347122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:57.347130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.347144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.347155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:57.347173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130744513:8732], now have 1 active actors on pipe
2025-10-02T08:13:57.347176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130744239:8716], now have 1 active actors on pipe
2025-10-02T08:13:57.347182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534697130744529:8735]
2025-10-02T08:13:57.347181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1902, pipe: [1:7556534697130744239:8716]
2025-10-02T08:13:57.347186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534697130744529:8735]
2025-10-02T08:13:57.347197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:57.347202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1902
2025-10-02T08:13:57.347208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:57.347210Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:57.347213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.347217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.347227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_20_14160681258514996816_v1 on pipe: [1:7556534697130744239:8716]
2025-10-02T08:13:57.347243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534697590402190:2378], now have 1 active actors on pipe
2025-10-02T08:13:57.347247Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_20_14160681258514996816_v1:1 with generation 1902
2025-10-02T08:13:57.347255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:57.347268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:57.347271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:57.347306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.347280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1902
2025-10-02T08:13:57.347313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.347324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.347329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.347330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:57.347347Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_20_14160681258514996816_v1
2025-10-02T08:13:57.347353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.347375Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534697130744529:8735]
2025-10-02T08:13:57.347386Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:57.347391Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:57.347421Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47725f1f-2210ccd0-cda5daee-97230d47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:57.347430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:13:57.347434Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:57.349806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf81184-5ec7c68-56aea65-a7b9cb43_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47725f1f-2210ccd0-cda5daee-97230d47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:57.349258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:13:57.349291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:13:57.349298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.349303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.349305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:57.349316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.349325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:57.349332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:13:57.349341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:13:57.349355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.349382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.349387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.349402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.349422Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392837346 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:13:57.349433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:13:57.349440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1903 partition: 0 MaxSeqNo: 17 sessionId: src_id|47725f1f-2210ccd0-cda5daee-97230d47_0
2025-10-02T08:13:57.349459Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 sending to client partition status
2025-10-02T08:13:57.352513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47725f1f-2210ccd0-cda5daee-97230d47_0] Write session: try to update token
2025-10-02T08:13:57.352528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47725f1f-2210ccd0-cda5daee-97230d47_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:57.366891Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:57.366926Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:57.366929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:57.366939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534697130744529:8735]
2025-10-02T08:13:57.366944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534697130744529:8735]
2025-10-02T08:13:57.366999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:57.367002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:57.367009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.367011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:57.367015Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:57.367213Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:57.367575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId: src_id|47725f1f-2210ccd0-cda5daee-97230d47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:57.370579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:57.503379Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:57.504011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.504031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.504167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:57.504179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:57.504233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1903 reason: error at write: Disconnected sessionId: src_id|47725f1f-2210ccd0-cda5daee-97230d47_0
2025-10-02T08:13:57.504298Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:57.504392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1903 sessionId: src_id|47725f1f-2210ccd0-cda5daee-97230d47_0 is DEAD
2025-10-02T08:13:57.504506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534697130744239:8716]
2025-10-02T08:13:57.504535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47725f1f-2210ccd0-cda5daee-97230d47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:57.504546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47725f1f-2210ccd0-cda5daee-97230d47_0] Write session will restart in 0.006632s
2025-10-02T08:13:57.504553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_20_14160681258514996816_v1
2025-10-02T08:13:57.504568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47725f1f-2210ccd0-cda5daee-97230d47_0] Write session: Do CDS request
2025-10-02T08:13:57.504577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47725f1f-2210ccd0-cda5daee-97230d47_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:57.504576Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:57.504597Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_20_14160681258514996816_v1
2025-10-02T08:13:57.512305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47725f1f-2210ccd0-cda5daee-97230d47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.512376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:57.512393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1904
2025-10-02T08:13:57.512504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.512550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:57.512561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:57.512565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:57.512981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1904 sessionId:  describe result for acl check
2025-10-02T08:13:57.513015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:57.513021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:57.513023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:57.513028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534697130744871:8710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:57.513511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534697130744871:8710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:57.515986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534697130744871:8710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:57.519865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534697130744871:8710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:57.519883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534697130744871:8710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:57.519887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534697130744871:8710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:57.519897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:57.521123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:57.522523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:57.522696Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:57.522706Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:57.522715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:57.522757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:57.522793Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534697130745154:8711]
2025-10-02T08:13:57.523449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:57.523652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:57.523696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:57.523986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:57.524041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.524048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.524049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.524050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.524051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.524056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.524066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.524070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.524073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.524077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.524082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.524090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.524096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.524106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.524111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.524116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.524120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.524125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.524129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.524136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.524153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:57.532134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:57.533809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:57.533830Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:57.533833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:57.533836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:57.533843Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1903 [1:7556534697130745154:8711]
2025-10-02T08:13:57.533856Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:57.533873Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:57.533876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.533880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.533882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.533897Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:57.533907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:57.533913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:57.533977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.533984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.533987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:57.533990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:57.534057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:57.534064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.534079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.534092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:57.534100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1903
2025-10-02T08:13:57.534109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130745133:8710], now have 1 active actors on pipe
2025-10-02T08:13:57.534116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534697130745148:8711]
2025-10-02T08:13:57.534119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534697130745148:8711]
2025-10-02T08:13:57.534126Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:57.534137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.534138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:57.534141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:57.534141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.534155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534697590402197:2378], now have 1 active actors on pipe
2025-10-02T08:13:57.534162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:57.534175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:57.534178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:57.534220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59234ab7-9ea451f0-631c4884-35b2f085_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:57.534230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.534234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.534236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:57.534244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.534256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:57.534269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534697130745148:8711]
2025-10-02T08:13:57.534277Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:57.534247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1903
2025-10-02T08:13:57.534284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:57.534303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.534380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.534388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.534400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.534440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1904 partition: 0 MaxSeqNo: 17 sessionId: src_id|59234ab7-9ea451f0-631c4884-35b2f085_0
2025-10-02T08:13:57.534769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47725f1f-2210ccd0-cda5daee-97230d47_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59234ab7-9ea451f0-631c4884-35b2f085_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:57.537492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59234ab7-9ea451f0-631c4884-35b2f085_0] Write session: try to update token
2025-10-02T08:13:57.537514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59234ab7-9ea451f0-631c4884-35b2f085_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:57.551448Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:57.551473Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:57.551475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:57.551484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534697130745148:8711]
2025-10-02T08:13:57.551487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534697130745148:8711]
2025-10-02T08:13:57.551526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:57.551535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.551537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:57.551542Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:57.551550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:57.551672Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:57.552191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId: src_id|59234ab7-9ea451f0-631c4884-35b2f085_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:57.554791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:57.604724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534697130745179:8716]
2025-10-02T08:13:57.604826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1903, pipe: [1:7556534697130745179:8716]
2025-10-02T08:13:57.690297Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:57.690951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.690963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.690995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130745179:8716], now have 1 active actors on pipe
2025-10-02T08:13:57.691125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534697130745179:8716]
2025-10-02T08:13:57.691158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:57.691166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:57.691232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1904 reason: error at write: Disconnected sessionId: src_id|59234ab7-9ea451f0-631c4884-35b2f085_0
2025-10-02T08:13:57.691333Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:57.691389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1904 sessionId: src_id|59234ab7-9ea451f0-631c4884-35b2f085_0 is DEAD
2025-10-02T08:13:57.691462Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:57.691518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59234ab7-9ea451f0-631c4884-35b2f085_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:57.691529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59234ab7-9ea451f0-631c4884-35b2f085_0] Write session will restart in 0.005772s
2025-10-02T08:13:57.691555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59234ab7-9ea451f0-631c4884-35b2f085_0] Write session: Do CDS request
2025-10-02T08:13:57.691562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59234ab7-9ea451f0-631c4884-35b2f085_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:57.701224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59234ab7-9ea451f0-631c4884-35b2f085_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.701622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:57.701639Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1905
2025-10-02T08:13:57.701895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.701933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:57.701944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:57.701947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:57.702322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1905 sessionId:  describe result for acl check
2025-10-02T08:13:57.702353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:57.702354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:57.702357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:57.702362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534697130745581:8705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:57.702845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534697130745581:8705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:57.707073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534697130745581:8705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:57.709050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:57.710435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:57.710625Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:57.710633Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:57.710645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:57.710695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:57.710736Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534697130745782:8704]
2025-10-02T08:13:57.710852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534697130745581:8705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:57.710864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534697130745581:8705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:57.710867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534697130745581:8705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:57.710876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:57.711296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:57.711451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:57.711479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:57.711673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:57.711701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.711705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.711706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.711707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.711707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.711711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.711717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.711719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.711721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.711723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.711726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.711730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.711734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.711737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.711739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.711742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.711744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.711747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.711750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.711753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.711764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:57.720143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:57.721601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:57.721615Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:57.721618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:57.721621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:57.721626Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1904 [1:7556534697130745782:8704]
2025-10-02T08:13:57.721636Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:57.721651Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:57.721653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.721655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.721657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.721669Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:57.721672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:57.721678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:57.721728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.721734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.721736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:57.721738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:57.721800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:57.721808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.721824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.721835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:57.721854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534697130745776:8704]
2025-10-02T08:13:57.721861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534697130745776:8704]
2025-10-02T08:13:57.721871Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:57.721878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:57.721882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:57.721887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1904
2025-10-02T08:13:57.721887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130745787:8705], now have 1 active actors on pipe
2025-10-02T08:13:57.721893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:57.721905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:57.721908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:57.721914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534697590402216:2378], now have 1 active actors on pipe
2025-10-02T08:13:57.721945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.721948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.721959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534697130745776:8704]
2025-10-02T08:13:57.721966Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:57.721986Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:57.721990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.721993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.721994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:57.721993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:57.722001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.721966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1904
2025-10-02T08:13:57.722007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:57.722029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.722072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.722078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.722089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.722128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1905 partition: 0 MaxSeqNo: 17 sessionId: src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0
2025-10-02T08:13:57.722442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59234ab7-9ea451f0-631c4884-35b2f085_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:57.725278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0] Write session: try to update token
2025-10-02T08:13:57.725298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:57.739459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId: src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:57.740367Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:57.740382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:57.740385Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:57.740393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534697130745776:8704]
2025-10-02T08:13:57.740398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534697130745776:8704]
2025-10-02T08:13:57.740437Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:57.740441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:57.740448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.740448Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:57.740450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:57.740592Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:57.742191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:57.791062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534697130745815:8716]
2025-10-02T08:13:57.791176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1904, pipe: [1:7556534697130745815:8716]
2025-10-02T08:13:57.878666Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:57.879138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.879155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.879191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130745815:8716], now have 1 active actors on pipe
2025-10-02T08:13:57.879329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534697130745815:8716]
2025-10-02T08:13:57.879357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:57.879361Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:57.879363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:57.879422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1905 reason: error at write: Disconnected sessionId: src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0
2025-10-02T08:13:57.879419Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:57.879583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1905 sessionId: src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0 is DEAD
2025-10-02T08:13:57.879749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:57.879758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0] Write session will restart in 0.005442s
2025-10-02T08:13:57.879786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0] Write session: Do CDS request
2025-10-02T08:13:57.879793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:57.886295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.886360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:57.886389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1906
2025-10-02T08:13:57.886487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:57.886517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:57.886526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:57.886529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:57.886887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1906 sessionId:  describe result for acl check
2025-10-02T08:13:57.886919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:57.886920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:57.886922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:57.886926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534697130746135:8648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:57.887389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534697130746135:8648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:57.889547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534697130746135:8648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:57.893104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534697130746135:8648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:57.893120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534697130746135:8648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:57.893123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534697130746135:8648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:57.893132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:57.895411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:57.896478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:57.896730Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:57.896742Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:57.896751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:57.896817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:57.896860Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534697130746443:8669]
2025-10-02T08:13:57.897516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:57.897695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:57.897741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:57.898046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:57.898083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.898084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.898086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.898087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.898089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.898094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.898104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.898108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.898112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.898116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.898121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.898128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:57.898133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.898139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:57.898143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.898149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:57.898153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.898158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.898163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.898168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.898188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:57.906809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:57.908749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:57.908770Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:57.908772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:57.908776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:57.908782Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1905 [1:7556534697130746443:8669]
2025-10-02T08:13:57.908794Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:57.908833Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:57.908838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.908847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.908849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.908864Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:57.908874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:57.908880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:57.908943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.908951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.908954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:57.908956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:57.909021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:57.909029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.909043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:57.909060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:57.909072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1905
2025-10-02T08:13:57.909082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130746414:8648], now have 1 active actors on pipe
2025-10-02T08:13:57.909085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534697590402247:2378], now have 1 active actors on pipe
2025-10-02T08:13:57.909089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.909094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.909110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534697130746437:8669]
2025-10-02T08:13:57.909117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534697130746437:8669]
2025-10-02T08:13:57.909129Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:57.909145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:57.909150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:57.909153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:57.909162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:57.909170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:57.909187Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf254c3b-14687618-aa063a3d-4e07f243_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:57.909196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.909200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.909203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:57.909211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.909223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:57.909261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534697130746437:8669]
2025-10-02T08:13:57.909278Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:57.909290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.909314Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:57.909334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.909337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.909351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:57.909394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1906 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf254c3b-14687618-aa063a3d-4e07f243_0
2025-10-02T08:13:57.909355Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1905
2025-10-02T08:13:57.909759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1272aaf-b9ba5bf7-35d3e27a-f77baa01_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf254c3b-14687618-aa063a3d-4e07f243_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:57.912371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf254c3b-14687618-aa063a3d-4e07f243_0] Write session: try to update token
2025-10-02T08:13:57.912388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf254c3b-14687618-aa063a3d-4e07f243_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:57.921231Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:57.921258Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:57.921270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534697130746437:8669]
2025-10-02T08:13:57.921324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:57.921672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:57.921932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:57.922183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:57.922434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:57.922790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:57.922846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:57.923029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:57.926294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId: src_id|bf254c3b-14687618-aa063a3d-4e07f243_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:57.928972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:57.929070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.929092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.929130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:57.929162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:57.929213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:57.929224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:57.929373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.929429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.929485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.929546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.929784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.929792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.929855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.929913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.929967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.930034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.930074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.930080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.930141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.930201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.930278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.930345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.930395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.930400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.930478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.930554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.930636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.930718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.930772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.930781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.930866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.930936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.931025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.931103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.931161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.931175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.931258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.931358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.931432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.931508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.931562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.931571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.931651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.931725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.931817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.931906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.931960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.931968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.932044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.932108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.932175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.932255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.932307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.932315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.932391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.932466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.932528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.932592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.932644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.932655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.932739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:57.932880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:57.932986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:57.933066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:57.933117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:57.933126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:57.933171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:57.933250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:57.933272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:57.933275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:57.933313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:57.933325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:57.933329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:57.933332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:57.933335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:57.933852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:57.933873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:57.933882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:57.933886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:57.933893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:57.933897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:57.934529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:57.934545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:57.934551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:57.934554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:57.934558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:57.934561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:57.935022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:57.935034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:57.935039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:57.935042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:57.935046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:57.936148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:57.936154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:57.936165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392837935
2025-10-02T08:13:57.936274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:57.936280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:57.936283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:57.936285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:57.936287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:57.936289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:57.937055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:57.937078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:57.937084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:57.937088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:57.937091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:57.937094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:57.937598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:57.937617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:57.937629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:57.937633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:57.937638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:57.937641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:57.938119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:57.938135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:57.938141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:57.939216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:57.939223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:57.939227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:57.939229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:57.939237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392837938
2025-10-02T08:13:57.939487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:57.939498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:57.939503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:57.939506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:57.939510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:57.939513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:57.940032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:57.940045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:57.940051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:57.940053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:57.940055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:57.940058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:57.940494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:57.940503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:57.940581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392837940
2025-10-02T08:13:57.941377Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:57.941409Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:57.941416Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:57.941426Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:57.942958Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:57.942973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:57.942976Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:57.942986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534697130746437:8669]
2025-10-02T08:13:57.942989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534697130746437:8669]
2025-10-02T08:13:57.943046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:57.943054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:57.943056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:57.943064Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:57.943081Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:57.943189Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:57.979499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534697130746476:8716]
2025-10-02T08:13:57.979656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1905, pipe: [1:7556534697130746476:8716]
2025-10-02T08:13:58.082316Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:58.082742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534697130746476:8716], now have 1 active actors on pipe
2025-10-02T08:13:58.082903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:58.082914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:58.082944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1906 reason: error at write: Disconnected sessionId: src_id|bf254c3b-14687618-aa063a3d-4e07f243_0
2025-10-02T08:13:58.082955Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:58.083114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1906 sessionId: src_id|bf254c3b-14687618-aa063a3d-4e07f243_0 is DEAD
2025-10-02T08:13:58.083293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf254c3b-14687618-aa063a3d-4e07f243_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:58.083305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf254c3b-14687618-aa063a3d-4e07f243_0] Write session will restart in 0.009887s
2025-10-02T08:13:58.083299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534697130746476:8716]
2025-10-02T08:13:58.083330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf254c3b-14687618-aa063a3d-4e07f243_0] Write session: Do CDS request
2025-10-02T08:13:58.083337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf254c3b-14687618-aa063a3d-4e07f243_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:58.083397Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:58.094274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf254c3b-14687618-aa063a3d-4e07f243_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.094310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:58.094326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1907
2025-10-02T08:13:58.094484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.094527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:58.094537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:58.094540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:58.094967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1907 sessionId:  describe result for acl check
2025-10-02T08:13:58.094998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:58.095004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:58.095006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:58.095010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534701425714265:8630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:58.095475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534701425714265:8630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:58.097862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534701425714265:8630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:58.099403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:58.099758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:58.099903Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:58.099914Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:58.099922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:58.099965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:58.100001Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534701425714362:8634]
2025-10-02T08:13:58.100415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534701425714265:8630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:58.100427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534701425714265:8630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:58.100429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534701425714265:8630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:58.100435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:58.100655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:58.100820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:58.100865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:58.101167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:58.101210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.101216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.101217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.101218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.101219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.101224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.101234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.101242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.101251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.101258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.101264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.101271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.101277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.101282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.101291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.101297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.101301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.101307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.101312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.101317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.101337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:58.109563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:58.111259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:58.111278Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:58.111280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:58.111283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:58.111288Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1906 [1:7556534701425714362:8634]
2025-10-02T08:13:58.111296Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:58.111309Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:58.111311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.111313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.111314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.111326Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:58.111329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:58.111335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:58.111381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.111387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.111390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:58.111391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:58.111452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:58.111460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.111471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.111481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:58.111497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534701425714356:8634]
2025-10-02T08:13:58.111503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534701425714356:8634]
2025-10-02T08:13:58.111509Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:58.111523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425714367:8630], now have 1 active actors on pipe
2025-10-02T08:13:58.111531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:58.111539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:58.111543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:58.111546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:58.111546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1906
2025-10-02T08:13:58.111547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:58.111580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534701425714356:8634]
2025-10-02T08:13:58.111591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:58.111601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534701885369549:2378], now have 1 active actors on pipe
2025-10-02T08:13:58.111601Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:58.111609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.111648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.111642Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1906
2025-10-02T08:13:58.111747Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cbf8931-ed7d3a64-85783458-76442760_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:58.111760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.111763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.111765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:58.111775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.111788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:58.111815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.111849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.111855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.111867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.111904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1907 partition: 0 MaxSeqNo: 17 sessionId: src_id|3cbf8931-ed7d3a64-85783458-76442760_0
2025-10-02T08:13:58.112220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf254c3b-14687618-aa063a3d-4e07f243_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3cbf8931-ed7d3a64-85783458-76442760_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:58.114682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf8931-ed7d3a64-85783458-76442760_0] Write session: try to update token
2025-10-02T08:13:58.114694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf8931-ed7d3a64-85783458-76442760_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:58.129877Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:58.129899Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:58.129902Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:58.129911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534701425714356:8634]
2025-10-02T08:13:58.129915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534701425714356:8634]
2025-10-02T08:13:58.129957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:58.129964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.129967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:58.129959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:58.129977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:58.129982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId: src_id|3cbf8931-ed7d3a64-85783458-76442760_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:58.130114Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:58.132568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:58.183278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534701425714393:8716]
2025-10-02T08:13:58.183424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1906, pipe: [1:7556534701425714393:8716]
2025-10-02T08:13:58.261384Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:58.261821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.261839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.261879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425714393:8716], now have 1 active actors on pipe
2025-10-02T08:13:58.262484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf8931-ed7d3a64-85783458-76442760_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:13:58.262496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf8931-ed7d3a64-85783458-76442760_0] Write session will restart in 0.007157s
2025-10-02T08:13:58.262089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534701425714393:8716]
2025-10-02T08:13:58.262520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf8931-ed7d3a64-85783458-76442760_0] Write session: Do CDS request
2025-10-02T08:13:58.262092Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:58.262116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:58.262526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf8931-ed7d3a64-85783458-76442760_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:58.262177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1907 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3cbf8931-ed7d3a64-85783458-76442760_0
2025-10-02T08:13:58.262333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1907 sessionId: src_id|3cbf8931-ed7d3a64-85783458-76442760_0 is DEAD
2025-10-02T08:13:58.262106Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:58.271331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf8931-ed7d3a64-85783458-76442760_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.271381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:58.271400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1908
2025-10-02T08:13:58.271518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.271549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:58.271553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:58.271557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:58.272023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1908 sessionId:  describe result for acl check
2025-10-02T08:13:58.272065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:58.272072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:58.272074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:58.272079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534701425714759:8604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:58.272604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534701425714759:8604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:58.275014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534701425714759:8604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:58.277788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534701425714759:8604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:58.277804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534701425714759:8604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:58.277807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534701425714759:8604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:58.277815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:58.279628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:58.279962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:58.280148Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:58.280163Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:58.280175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:58.280256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:58.280295Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534701425714989:8624]
2025-10-02T08:13:58.280931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:58.281119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:58.281164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:58.281465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:58.281516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.281523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.281524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.281525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.281526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.281532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.281542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.281547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.281551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.281555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.281561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.281569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.281580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.281586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.281594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.281599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.281609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.281618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.281623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.281633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.281652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:58.289800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:58.291691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:58.291711Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:58.291713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:58.291717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:58.291724Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1907 [1:7556534701425714989:8624]
2025-10-02T08:13:58.291736Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:58.291752Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:58.291761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.291764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.291766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.291782Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:58.291786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:58.291792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:58.291862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.291870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.291873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:58.291875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:58.291940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:58.291949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.291960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.291976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:58.292000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534701885369557:2378], now have 1 active actors on pipe
2025-10-02T08:13:58.292012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534701425714983:8624]
2025-10-02T08:13:58.292018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534701425714983:8624]
2025-10-02T08:13:58.292026Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:58.292039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1907
2025-10-02T08:13:58.292042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425714971:8604], now have 1 active actors on pipe
2025-10-02T08:13:58.292045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:58.292047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:58.292048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:58.292060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:58.292062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:58.292069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.292075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.292117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534701425714983:8624]
2025-10-02T08:13:58.292124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:58.292088Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1907
2025-10-02T08:13:58.292126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:58.292140Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:58.292150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.292158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.292160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:58.292169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.292181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:58.292236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.292285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.292293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.292306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.292344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1908 partition: 0 MaxSeqNo: 17 sessionId: src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0
2025-10-02T08:13:58.292656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf8931-ed7d3a64-85783458-76442760_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:58.295314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0] Write session: try to update token
2025-10-02T08:13:58.295333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:58.309356Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:58.309377Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:58.309379Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:58.309384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534701425714983:8624]
2025-10-02T08:13:58.309388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534701425714983:8624]
2025-10-02T08:13:58.309423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:58.309429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.309430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:58.309452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:58.309469Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:58.309556Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:58.309800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId: src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:58.312368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:58.362451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534701425715014:8716]
2025-10-02T08:13:58.362555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1907, pipe: [1:7556534701425715014:8716]
2025-10-02T08:13:58.439647Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:58.440061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.440077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.440110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425715014:8716], now have 1 active actors on pipe
2025-10-02T08:13:58.440376Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:58.440686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:58.440253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534701425715014:8716]
2025-10-02T08:13:58.440698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0] Write session will restart in 0.008106s
2025-10-02T08:13:58.440280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:58.440282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:58.440342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1908 reason: error at write: Disconnected sessionId: src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0
2025-10-02T08:13:58.440409Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:58.440521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1908 sessionId: src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0 is DEAD
2025-10-02T08:13:58.440722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0] Write session: Do CDS request
2025-10-02T08:13:58.440729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:58.455799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.455918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:58.455937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1909
2025-10-02T08:13:58.456058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.456086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:58.456092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:58.456094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:58.456540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1909 sessionId:  describe result for acl check
2025-10-02T08:13:58.456571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:58.456573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:58.456574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:58.456580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534701425715426:8598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:58.457087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534701425715426:8598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:58.459759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534701425715426:8598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:58.470354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534701425715426:8598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:58.470379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534701425715426:8598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:58.470382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534701425715426:8598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:58.470392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:58.475329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:58.476844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:58.477030Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:58.477040Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:58.477049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:58.477097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:58.477149Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534701425715615:8602]
2025-10-02T08:13:58.477677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:58.477893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:58.477945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:58.478168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:58.478206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.478212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.478213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.478215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.478215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.478221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.478229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.478232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.478234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.478236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.478241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.478245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.478249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.478252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.478254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.478257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.478262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.478264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.478267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.478270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.478285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:58.486379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:58.488003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:58.488021Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:58.488024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:58.488028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:58.488034Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1908 [1:7556534701425715615:8602]
2025-10-02T08:13:58.488046Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:58.488062Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:58.488065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.488068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.488070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.488086Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:58.488098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:58.488104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:58.488166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.488173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.488177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:58.488179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:58.488257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:58.488265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.488279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.488291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:58.488310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425715507:8598], now have 1 active actors on pipe
2025-10-02T08:13:58.488441Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1908
2025-10-02T08:13:58.488317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534701425715609:8602]
2025-10-02T08:13:58.488319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534701425715609:8602]
2025-10-02T08:13:58.488318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1908
2025-10-02T08:13:58.488326Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:58.488337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:58.488339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:58.488342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:58.488351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:58.488354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:58.488360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534701885369564:2378], now have 1 active actors on pipe
2025-10-02T08:13:58.488365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.488368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.488405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534701425715609:8602]
2025-10-02T08:13:58.488412Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:58.488418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:58.488432Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|612b67b-16b9d95e-3a0b4328-c097f57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:58.488438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.488442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.488444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:58.488452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.488460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:58.488491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.488589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.488605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.488630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.488740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1909 partition: 0 MaxSeqNo: 17 sessionId: src_id|612b67b-16b9d95e-3a0b4328-c097f57_0
2025-10-02T08:13:58.489298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8cfffc3-2e94c7dc-62c7bcf6-f92c883f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|612b67b-16b9d95e-3a0b4328-c097f57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:58.491948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|612b67b-16b9d95e-3a0b4328-c097f57_0] Write session: try to update token
2025-10-02T08:13:58.491964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|612b67b-16b9d95e-3a0b4328-c097f57_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:58.507113Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:58.507144Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:58.507147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:58.507160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534701425715609:8602]
2025-10-02T08:13:58.507166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534701425715609:8602]
2025-10-02T08:13:58.507220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:58.507231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:58.507236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.507239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:58.507239Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:58.507416Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:58.507774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId: src_id|612b67b-16b9d95e-3a0b4328-c097f57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:58.510433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:58.540107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534701425715639:8716]
2025-10-02T08:13:58.540306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1908, pipe: [1:7556534701425715639:8716]
2025-10-02T08:13:58.656752Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:58.657556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.657574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.657619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425715639:8716], now have 1 active actors on pipe
2025-10-02T08:13:58.657738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:58.657754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:58.657806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1909 reason: error at write: Disconnected sessionId: src_id|612b67b-16b9d95e-3a0b4328-c097f57_0
2025-10-02T08:13:58.657919Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:58.657979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1909 sessionId: src_id|612b67b-16b9d95e-3a0b4328-c097f57_0 is DEAD
2025-10-02T08:13:58.657995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:58.658161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|612b67b-16b9d95e-3a0b4328-c097f57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:58.658173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|612b67b-16b9d95e-3a0b4328-c097f57_0] Write session will restart in 0.006445s
2025-10-02T08:13:58.658194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|612b67b-16b9d95e-3a0b4328-c097f57_0] Write session: Do CDS request
2025-10-02T08:13:58.658200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|612b67b-16b9d95e-3a0b4328-c097f57_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:58.658200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534701425715639:8716]
2025-10-02T08:13:58.665323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|612b67b-16b9d95e-3a0b4328-c097f57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.665497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:58.665520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1910
2025-10-02T08:13:58.665644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.665677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:58.665687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:58.665691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:58.666315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1910 sessionId:  describe result for acl check
2025-10-02T08:13:58.666354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:58.666356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:58.666357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:58.666363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534701425715925:8586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:58.666944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534701425715925:8586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:58.669540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534701425715925:8586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:58.675237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534701425715925:8586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:58.675262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534701425715925:8586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:58.675265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534701425715925:8586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:58.675275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:58.679827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:58.681219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:58.681404Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:58.681414Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:58.681421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:58.681456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:58.681485Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534701425716255:8588]
2025-10-02T08:13:58.681902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:58.682062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:58.682094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:58.682292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:58.682320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.682324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.682325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.682325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.682326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.682329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.682336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.682338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.682340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.682342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.682346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.682350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.682354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.682357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.682359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.682362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.682364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.682367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.682370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.682372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.682382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:58.690522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:58.692504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:58.692530Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:58.692533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:58.692536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:58.692543Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1909 [1:7556534701425716255:8588]
2025-10-02T08:13:58.692555Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:58.692573Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:58.692581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.692585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.692587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.692603Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:58.692609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:58.692615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:58.692690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.692700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.692703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:58.692706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:58.692772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:58.692786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.692825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.692841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:58.692865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425716146:8586], now have 1 active actors on pipe
2025-10-02T08:13:58.692873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534701885369583:2378], now have 1 active actors on pipe
2025-10-02T08:13:58.692873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1909
2025-10-02T08:13:58.692879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534701425716249:8588]
2025-10-02T08:13:58.692881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534701425716249:8588]
2025-10-02T08:13:58.692897Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:58.692911Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:58.692912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.692916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.692922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:58.692936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:58.692952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:58.692960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:58.693011Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:58.693022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.693026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.693033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:58.693043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.693057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:58.693070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534701425716249:8588]
2025-10-02T08:13:58.693074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:58.693079Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:58.693030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1909
2025-10-02T08:13:58.693102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.693217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.693225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.693242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.693288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1910 partition: 0 MaxSeqNo: 17 sessionId: src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0
2025-10-02T08:13:58.693616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|612b67b-16b9d95e-3a0b4328-c097f57_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:58.696264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0] Write session: try to update token
2025-10-02T08:13:58.696279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:58.712465Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:58.712485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:58.712488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:58.712497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534701425716249:8588]
2025-10-02T08:13:58.712502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534701425716249:8588]
2025-10-02T08:13:58.712541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:58.712548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.712551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:58.712550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:58.712556Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:58.712698Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:58.714561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId: src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:58.717199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:58.760879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534701425716280:8716]
2025-10-02T08:13:58.761013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1909, pipe: [1:7556534701425716280:8716]
2025-10-02T08:13:58.848220Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:58.848675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:58.848686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0] Write session will restart in 0.006633s
2025-10-02T08:13:58.848710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0] Write session: Do CDS request
2025-10-02T08:13:58.848716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:58.847339Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:58.847822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.847830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.847872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425716280:8716], now have 1 active actors on pipe
2025-10-02T08:13:58.848031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:58.848035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:58.848078Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:58.848108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1910 reason: error at write: Disconnected sessionId: src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0
2025-10-02T08:13:58.848291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1910 sessionId: src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0 is DEAD
2025-10-02T08:13:58.848425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534701425716280:8716]
2025-10-02T08:13:58.856280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.857066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:58.857083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1911
2025-10-02T08:13:58.857223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:58.857252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:58.857261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:58.857265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:58.858810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1911 sessionId:  describe result for acl check
2025-10-02T08:13:58.858850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:58.858852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:58.858853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:58.858857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534701425716316:8548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:58.859335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534701425716316:8548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:58.864276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534701425716316:8548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:58.868307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534701425716316:8548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:58.868323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534701425716316:8548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:58.868325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534701425716316:8548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:58.868331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:58.879040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:58.880588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:58.880769Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:58.880779Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:58.880788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:58.880853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:58.880889Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534701425716898:8550]
2025-10-02T08:13:58.881520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:58.881714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:58.881752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:58.882050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:58.882095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.882100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.882101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.882102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.882103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.882121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.882129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.882133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.882141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.882144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.882149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.882156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:58.882161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.882170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:58.882174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.882179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:58.882187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.882192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.882197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.882203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.882224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:58.890527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:58.893573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:58.893603Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:58.893605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:58.893609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:58.893616Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1910 [1:7556534701425716898:8550]
2025-10-02T08:13:58.893627Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:58.893646Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:58.893650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.893652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.893655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.893674Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:58.893686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:58.893693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:58.893776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.893785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.893788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:58.893790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:58.893868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:58.893877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.893892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:58.893903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:58.893923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534701425716892:8550]
2025-10-02T08:13:58.893935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534701425716892:8550]
2025-10-02T08:13:58.893945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:58.893954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1910
2025-10-02T08:13:58.893957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:58.893960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:58.893961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:58.893976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:58.893979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:58.893991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425716679:8548], now have 1 active actors on pipe
2025-10-02T08:13:58.893995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534701885369592:2378], now have 1 active actors on pipe
2025-10-02T08:13:58.894032Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534701425716892:8550]
2025-10-02T08:13:58.894042Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:58.894135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:58.894153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.894165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.894192Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:58.894206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:58.894211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:58.894220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:58.894232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:58.894250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:58.894272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.894390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:58.894400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:58.894416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:58.894458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1911 partition: 0 MaxSeqNo: 17 sessionId: src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0
2025-10-02T08:13:58.894913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a69ed69-6479ee0c-3549be85-d78b5492_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:58.894861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1910
2025-10-02T08:13:58.897693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0] Write session: try to update token
2025-10-02T08:13:58.897710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:58.919060Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:58.919076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:58.919078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:58.919087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534701425716892:8550]
2025-10-02T08:13:58.919091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534701425716892:8550]
2025-10-02T08:13:58.919135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:58.919142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:58.919143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:58.919148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:58.919149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:58.919287Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:58.920383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId: src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:58.922987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:58.948682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534701425716946:8716]
2025-10-02T08:13:58.948784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1910, pipe: [1:7556534701425716946:8716]
2025-10-02T08:13:59.050264Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:59.050986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.050993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.051024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534701425716946:8716], now have 1 active actors on pipe
2025-10-02T08:13:59.051179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:59.051202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:59.051224Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:59.051265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1911 reason: error at write: Disconnected sessionId: src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0
2025-10-02T08:13:59.051437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1911 sessionId: src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0 is DEAD
2025-10-02T08:13:59.051485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534701425716946:8716]
2025-10-02T08:13:59.051772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:59.051783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0] Write session will restart in 0.005897s
2025-10-02T08:13:59.051807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0] Write session: Do CDS request
2025-10-02T08:13:59.051816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:59.052864Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:59.059325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.059372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:59.059384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1912
2025-10-02T08:13:59.059547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.059580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:59.059589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:59.059606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:59.060011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1912 sessionId:  describe result for acl check
2025-10-02T08:13:59.060044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:59.060050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:59.060051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:59.060056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534705720684587:8505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:59.060572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534705720684587:8505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:59.062953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534705720684587:8505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:59.065863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534705720684587:8505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:59.065875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534705720684587:8505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:59.065878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534705720684587:8505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:59.065886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:59.066877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:59.068361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:59.068518Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:59.068527Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:59.068534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:59.068572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:59.068606Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534705720684848:8504]
2025-10-02T08:13:59.069251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:59.069415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:59.069449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:59.069732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:59.069771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.069777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.069778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.069779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.069780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.069785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.069793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.069797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.069801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.069804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.069809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.069816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.069822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.069827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.069831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.069837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.069841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.069846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.069850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.069855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.069873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:59.078204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:59.079799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:59.079818Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:59.079821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:59.079825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:59.079832Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1911 [1:7556534705720684848:8504]
2025-10-02T08:13:59.079844Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:59.079863Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:59.079871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.079874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.079876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.079891Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:59.079896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:59.079902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:59.079959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.079967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.079970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:59.079973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:59.080036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:59.080043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.080059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.080078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:59.080101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720684829:8505], now have 1 active actors on pipe
2025-10-02T08:13:59.080105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1911
2025-10-02T08:13:59.080113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534705720684842:8504]
2025-10-02T08:13:59.080115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534705720684842:8504]
2025-10-02T08:13:59.080122Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:59.080134Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:59.080138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534706180336917:2378], now have 1 active actors on pipe
2025-10-02T08:13:59.080143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:59.080144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:59.080155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:59.080159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:59.080165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.080174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.080227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534705720684842:8504]
2025-10-02T08:13:59.080240Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:59.080252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:59.080255Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:59.080262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.080266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.080268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:59.080278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.080290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:59.080240Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1911
2025-10-02T08:13:59.080336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.080413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.080420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.080433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.080473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1912 partition: 0 MaxSeqNo: 17 sessionId: src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0
2025-10-02T08:13:59.080863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c9aeff-ae7c27-4e53ad7a-d8da453a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:59.083457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0] Write session: try to update token
2025-10-02T08:13:59.083477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:59.098119Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:59.098137Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:59.098140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:59.098148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534705720684842:8504]
2025-10-02T08:13:59.098152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534705720684842:8504]
2025-10-02T08:13:59.098196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:59.098203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.098205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:59.098206Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:59.098211Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:59.098344Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:59.099241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId: src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:59.102077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:59.151431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534705720684874:8716]
2025-10-02T08:13:59.151548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1911, pipe: [1:7556534705720684874:8716]
2025-10-02T08:13:59.246358Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:59.246915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.246930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.246968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720684874:8716], now have 1 active actors on pipe
2025-10-02T08:13:59.247111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534705720684874:8716]
2025-10-02T08:13:59.247135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:59.247138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:59.247166Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:59.247211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1912 reason: error at write: Disconnected sessionId: src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0
2025-10-02T08:13:59.247250Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:59.247368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1912 sessionId: src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0 is DEAD
2025-10-02T08:13:59.248973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:59.248984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0] Write session will restart in 0.009022s
2025-10-02T08:13:59.249010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0] Write session: Do CDS request
2025-10-02T08:13:59.249016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:59.261234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.264940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:59.264954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1913
2025-10-02T08:13:59.268338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.268381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:59.268386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:59.268390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:59.268906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1913 sessionId:  describe result for acl check
2025-10-02T08:13:59.268936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:59.268938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:59.268939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:59.268945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534705720685412:8490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:59.269462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534705720685412:8490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:59.273203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534705720685412:8490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:59.278384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:59.278715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534705720685412:8490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:59.278722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534705720685412:8490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:59.278725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534705720685412:8490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:59.278734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:59.280037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:59.280432Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:59.280436Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:59.280448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:59.280504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:59.280534Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534705720685480:8495]
2025-10-02T08:13:59.281176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:59.281494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:59.281534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:59.281830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:59.281865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.281866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.281867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.281869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.281870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.281875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.281886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.281890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.281894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.281898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.281903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.281909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.281915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.281920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.281925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.281931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.281935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.281940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.281945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.281951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.281970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:59.290417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:59.292181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:59.292186Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:59.292188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:59.292191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:59.292198Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1912 [1:7556534705720685480:8495]
2025-10-02T08:13:59.292227Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:59.292243Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:59.292246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.292249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.292251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.292266Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:59.292271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:59.292277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:59.292339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.292341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.292344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:59.292346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:59.292409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:59.292411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.292424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.292435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:59.292450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534705720685467:8495]
2025-10-02T08:13:59.292452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534705720685467:8495]
2025-10-02T08:13:59.292458Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:59.292469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:59.292482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:59.292484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:59.292512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534705720685467:8495]
2025-10-02T08:13:59.292514Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:59.292571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:59.292574Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:59.292580Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:59.292976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1912
2025-10-02T08:13:59.292991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720685475:8490], now have 1 active actors on pipe
2025-10-02T08:13:59.292995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534706180336924:2378], now have 1 active actors on pipe
2025-10-02T08:13:59.292999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.293004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.293030Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:59.293037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.293040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.293042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:59.293054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.293064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:59.293078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.293107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.293109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.293122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.293148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1913 partition: 0 MaxSeqNo: 17 sessionId: src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0
2025-10-02T08:13:59.293055Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1912
2025-10-02T08:13:59.294263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6056be4b-9f1a3d3a-3a049928-ece55baa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:59.296778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0] Write session: try to update token
2025-10-02T08:13:59.296792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:59.312578Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:59.312594Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:59.312597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:59.312605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534705720685467:8495]
2025-10-02T08:13:59.312610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534705720685467:8495]
2025-10-02T08:13:59.312654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:59.312661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.312664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:59.312669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:59.312677Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:59.312791Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:59.318100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId: src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:59.320664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:59.346531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534705720685505:8716]
2025-10-02T08:13:59.348967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1912, pipe: [1:7556534705720685505:8716]
2025-10-02T08:13:59.460055Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:59.460331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.460344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.460380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720685505:8716], now have 1 active actors on pipe
2025-10-02T08:13:59.460497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534705720685505:8716]
2025-10-02T08:13:59.460520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:59.460526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:59.460589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1913 reason: error at write: Disconnected sessionId: src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0
2025-10-02T08:13:59.460582Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:59.460788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1913 sessionId: src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0 is DEAD
2025-10-02T08:13:59.460837Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:59.460896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:59.460903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0] Write session will restart in 0.005209s
2025-10-02T08:13:59.460930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0] Write session: Do CDS request
2025-10-02T08:13:59.460936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:59.467288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.467375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:59.467389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1914
2025-10-02T08:13:59.467502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.467534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:59.467543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:59.467546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:59.468450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1914 sessionId:  describe result for acl check
2025-10-02T08:13:59.468479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:59.468480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:59.468481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:59.468485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534705720685747:8473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:59.468920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534705720685747:8473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:59.472595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534705720685747:8473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:59.476102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534705720685747:8473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:59.476118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534705720685747:8473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:59.476122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534705720685747:8473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:59.476131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:59.482507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:59.484061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:59.484260Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:59.484269Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:59.484279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:59.484342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:59.484381Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534705720686116:8486]
2025-10-02T08:13:59.485050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:59.485264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:59.485321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:59.485639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:59.485686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.485692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.485693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.485694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.485696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.485701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.485711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.485716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.485720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.485723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.485728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.485736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.485746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.485751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.485763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.485768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.485776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.485782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.485786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.485796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.485813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:59.494118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:59.496072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:59.496094Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:59.496097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:59.496101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:59.496110Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1913 [1:7556534705720686116:8486]
2025-10-02T08:13:59.496123Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:59.496141Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:59.496149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.496153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.496155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.496172Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:59.496180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:59.496191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:59.496282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.496289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.496292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:59.496296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:59.496372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:59.496381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.496396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.496408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:59.496425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720685946:8473], now have 1 active actors on pipe
2025-10-02T08:13:59.496432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534705720686110:8486]
2025-10-02T08:13:59.496435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534705720686110:8486]
2025-10-02T08:13:59.496443Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:59.496460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:59.496462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:59.496466Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:59.496478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:59.496483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:59.496481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1913
2025-10-02T08:13:59.496491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534706180336932:2378], now have 1 active actors on pipe
2025-10-02T08:13:59.496524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.496533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.496547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534705720686110:8486]
2025-10-02T08:13:59.496565Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:59.496574Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:59.496593Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:59.496605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.496609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.496611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:59.496625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.496639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:59.496666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.496739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.496747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.496760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.496817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1914 partition: 0 MaxSeqNo: 17 sessionId: src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0
2025-10-02T08:13:59.496845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1913
2025-10-02T08:13:59.497148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e44f139-7c7eac7a-275dbe1e-e626559c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:59.500075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0] Write session: try to update token
2025-10-02T08:13:59.500095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:59.514411Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:59.514412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId: src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:59.514430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:59.514433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:59.514441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534705720686110:8486]
2025-10-02T08:13:59.514445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534705720686110:8486]
2025-10-02T08:13:59.514490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:59.514497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.514496Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:59.514499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:59.514501Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:59.514638Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:59.516926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:59.560538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534705720686143:8716]
2025-10-02T08:13:59.560709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1913, pipe: [1:7556534705720686143:8716]
2025-10-02T08:13:59.663718Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:59.662773Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:59.663325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.663333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.663372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720686143:8716], now have 1 active actors on pipe
2025-10-02T08:13:59.663614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534705720686143:8716]
2025-10-02T08:13:59.663631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:59.663633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:59.663810Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:59.664368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1914 reason: error at write: Disconnected sessionId: src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0
2025-10-02T08:13:59.664523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1914 sessionId: src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0 is DEAD
2025-10-02T08:13:59.664834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:59.664845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0] Write session will restart in 0.005528s
2025-10-02T08:13:59.664872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0] Write session: Do CDS request
2025-10-02T08:13:59.664879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:59.671355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.671400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:59.671412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1915
2025-10-02T08:13:59.671609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.671639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:59.671645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:59.671648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:59.672085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1915 sessionId:  describe result for acl check
2025-10-02T08:13:59.672113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:59.672114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:59.672116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:59.672121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534705720686402:8457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:59.672846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534705720686402:8457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:59.677993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534705720686402:8457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:59.681800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534705720686402:8457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:59.681819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534705720686402:8457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:59.681821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534705720686402:8457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:59.681831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:59.689414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:59.692085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:59.692535Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:59.692551Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:59.692563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:59.692629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:59.692671Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534705720686769:8463]
2025-10-02T08:13:59.693342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:59.693609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:59.693664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:59.693972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:59.694018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.694026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.694027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.694028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.694029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.694034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.694043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.694047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.694050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.694054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.694061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.694067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.694072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.694078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.694082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.694086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.694090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.694095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.694100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.694108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.694131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:59.702086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:59.703548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:59.703566Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:59.703569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:59.703573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:59.703579Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1914 [1:7556534705720686769:8463]
2025-10-02T08:13:59.703592Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:59.703609Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:59.703612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.703615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.703617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.703633Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:59.703638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:59.703645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:59.703708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.703719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.703722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:59.703724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:59.703791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:59.703798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.703811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.703827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:59.703850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720686617:8457], now have 1 active actors on pipe
2025-10-02T08:13:59.703849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1914
2025-10-02T08:13:59.703861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534705720686763:8463]
2025-10-02T08:13:59.703864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534705720686763:8463]
2025-10-02T08:13:59.703876Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:59.703890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534706180336951:2378], now have 1 active actors on pipe
2025-10-02T08:13:59.703890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:59.703893Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:59.703898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.703903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.703920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:59.703939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:59.703947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:59.703962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1914
2025-10-02T08:13:59.703991Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:59.704002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.704006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.704008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:59.704018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.704027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:59.704045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534705720686763:8463]
2025-10-02T08:13:59.704053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:59.704075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.704077Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:59.704160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.704168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.704181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.704229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1915 partition: 0 MaxSeqNo: 17 sessionId: src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0
2025-10-02T08:13:59.704600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9daaee86-cf0b34f2-e72dc28a-90b6f27f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:59.707134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0] Write session: try to update token
2025-10-02T08:13:59.707149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:59.720891Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:59.720912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:59.720922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534705720686763:8463]
2025-10-02T08:13:59.720967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:59.720978Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:59.721138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:59.721284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:59.721420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:59.721559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:59.721748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:59.721780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:59.723769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId: src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:59.726355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:59.726413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.726422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.726451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:59.726471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:59.726763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.726776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.726935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.726993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.727063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.727134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.727177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.727198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.727274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.727342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.727409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.727481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.727783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.727795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.727864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.727926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.727988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.728059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.728107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.728114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.728181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.728267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.728343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.728424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.728481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.728488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.728562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.728632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.728705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.728772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.728846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.728857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.728942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.729015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.729101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.729174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.729226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.729234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.729315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.729388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.729469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.729550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.729683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.729689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.729765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.729835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.729908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.729983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.730132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.730139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.730209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.730268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.730332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.730401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.730451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.730457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.730529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.730595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.730660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.730727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.730777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.730784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.730826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:59.730894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.730920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.730923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:59.730952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:59.730964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:59.730968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:59.730971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:59.730974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:59.731353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:59.731376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:59.731388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:59.731391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:59.731395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:59.731399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:59.731848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:59.731871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:59.731878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:59.731881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:59.731885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:59.731893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:59.732474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:59.732495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:59.732501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:59.732504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:59.732507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:59.733781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:59.733798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:59.733815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392839733
2025-10-02T08:13:59.734045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:59.734070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:59.734076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:59.734079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:59.734084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:59.734087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:59.734662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:59.734690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:59.734696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:59.734700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:59.734705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:59.734708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:59.735243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:59.735264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:59.735271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:59.735273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:59.735275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:59.735278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:59.735705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:59.735729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:59.735739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:59.736895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:59.736910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:59.736915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:59.736918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:59.736924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392839736
2025-10-02T08:13:59.737201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:59.737220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:59.737224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:59.737227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:59.737230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:59.737232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:59.737663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:59.737683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:59.737688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:59.737692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:59.737697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:59.737702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:59.738168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:59.738184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.738268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392839738
2025-10-02T08:13:59.739006Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:59.739024Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:59.739031Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:59.739037Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:59.740698Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:59.740710Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:59.740712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:59.740719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534705720686763:8463]
2025-10-02T08:13:59.740726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534705720686763:8463]
2025-10-02T08:13:59.740779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:59.740792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:59.740792Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:59.740796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.740798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:59.740958Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:59.764924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534705720686801:8716]
2025-10-02T08:13:59.765136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1914, pipe: [1:7556534705720686801:8716]
2025-10-02T08:13:59.880175Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:13:59.880496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720686801:8716], now have 1 active actors on pipe
2025-10-02T08:13:59.880626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534705720686801:8716]
2025-10-02T08:13:59.880655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:13:59.880661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:13:59.880670Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:13:59.880695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1915 reason: error at write: Disconnected sessionId: src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0
2025-10-02T08:13:59.880780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:13:59.880935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1915 sessionId: src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0 is DEAD
2025-10-02T08:13:59.881034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:13:59.881042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0] Write session will restart in 0.006389s
2025-10-02T08:13:59.881063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0] Write session: Do CDS request
2025-10-02T08:13:59.881070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:13:59.888281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.889197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:13:59.889222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1916
2025-10-02T08:13:59.889339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:13:59.889369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:13:59.889374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:13:59.889381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:13:59.889774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1916 sessionId:  describe result for acl check
2025-10-02T08:13:59.889801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:13:59.889802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:13:59.889804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:13:59.889808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534705720687158:8441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:13:59.890161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534705720687158:8441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:13:59.892664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534705720687158:8441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:13:59.897575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534705720687158:8441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:13:59.897592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534705720687158:8441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:13:59.897595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534705720687158:8441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:13:59.897604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:13:59.899412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:13:59.899763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:13:59.899931Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:13:59.899941Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:13:59.899951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:13:59.900002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:13:59.900039Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534705720687429:8456]
2025-10-02T08:13:59.900674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:13:59.900883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:13:59.900924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:13:59.901222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:13:59.901263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.901269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.901270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.901271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.901272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.901277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.901286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.901291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.901295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.901299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.901304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.901312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:13:59.901318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.901327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:13:59.901332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.901338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:13:59.901347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.901353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.901362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.901367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.901390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:13:59.909927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:13:59.911788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:13:59.911808Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:13:59.911811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:13:59.911814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:13:59.911820Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1915 [1:7556534705720687429:8456]
2025-10-02T08:13:59.911830Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:13:59.911844Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:13:59.911847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.911850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.911851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.911865Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:13:59.911871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:13:59.911877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:13:59.911941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.911950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.911952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:13:59.911955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:13:59.912018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:13:59.912026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.912041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:13:59.912059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:13:59.912081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534706180336959:2378], now have 1 active actors on pipe
2025-10-02T08:13:59.912088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720687418:8441], now have 1 active actors on pipe
2025-10-02T08:13:59.912094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534705720687423:8456]
2025-10-02T08:13:59.912096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534705720687423:8456]
2025-10-02T08:13:59.912108Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:13:59.912125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:13:59.912144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:13:59.912150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:13:59.912161Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1915
2025-10-02T08:13:59.912182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534705720687423:8456]
2025-10-02T08:13:59.912184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:13:59.912187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:13:59.912190Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:13:59.912191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:13:59.912287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1915
2025-10-02T08:13:59.912320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.912328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.912349Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:13:59.912362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.912366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.912367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:13:59.912376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.912385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:13:59.912401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.912426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.912433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.912446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:13:59.912480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1916 partition: 0 MaxSeqNo: 17 sessionId: src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0
2025-10-02T08:13:59.912865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a604d355-f5f0fb6c-3e42d920-3728daee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:13:59.915458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0] Write session: try to update token
2025-10-02T08:13:59.915477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:13:59.923629Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:13:59.923648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:59.923658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534705720687423:8456]
2025-10-02T08:13:59.923699Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:13:59.923701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:13:59.923857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:13:59.923997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:59.924131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:59.924287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:13:59.924470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:13:59.924510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:13:59.930087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId: src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:13:59.932674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:13:59.932762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.932781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.932837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:13:59.932875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:13:59.932953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:13:59.932966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:13:59.933127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.933189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.933256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.933323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.933764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.933776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.933849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.933913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.933979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.934046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.934090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.934098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.934169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.934232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.934294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.934363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.934409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.934417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.934488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.934551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.934614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.934676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.934721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.934729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.934799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.934862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.934921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.934982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.935024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.935031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.935112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.935181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.935257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.935329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.935381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.935389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.935468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.935541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.935615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.935690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.935742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.935753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.935831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.935902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.935966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.936028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.936073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.936080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.936149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.936232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.936304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.936365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.936409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.936416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.936487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:13:59.936556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:13:59.936623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:13:59.936687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:13:59.936730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:13:59.936738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:13:59.936779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:13:59.936872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:13:59.936896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:13:59.936902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:13:59.936930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:13:59.936947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:13:59.936955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:13:59.936958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:13:59.936961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:13:59.937355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:13:59.937381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:13:59.937391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:13:59.937394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:13:59.937398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:13:59.937406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:13:59.938263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:13:59.938286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:13:59.938293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:13:59.938296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:13:59.938299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:13:59.938302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:13:59.938904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:13:59.938925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:13:59.938933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:13:59.938936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:13:59.938944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:13:59.940126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:13:59.940142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:13:59.940155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392839939
2025-10-02T08:13:59.940389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:13:59.940404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:13:59.940408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:13:59.940411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:13:59.940415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:13:59.940419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:13:59.940906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:13:59.940926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:13:59.940932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:13:59.940935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:13:59.940942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:13:59.940946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:13:59.941389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:13:59.941410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:13:59.941419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:13:59.941422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:13:59.941426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:13:59.941429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:13:59.941885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:13:59.941908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:13:59.941913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:13:59.943028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:13:59.943045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:13:59.943050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:13:59.943054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:13:59.943066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392839942
2025-10-02T08:13:59.943367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:13:59.943391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:13:59.943398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:13:59.943403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:13:59.943407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:13:59.943410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:13:59.943850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:13:59.943870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:13:59.943876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:13:59.943880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:13:59.943883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:13:59.943886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:13:59.944360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:13:59.944377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:13:59.944482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392839944
2025-10-02T08:13:59.945261Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:13:59.945290Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:13:59.945301Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:13:59.945312Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:13:59.947037Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:13:59.947050Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:13:59.947052Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:13:59.947062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534705720687423:8456]
2025-10-02T08:13:59.947067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534705720687423:8456]
2025-10-02T08:13:59.947130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:13:59.947141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:13:59.947143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:13:59.947165Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:13:59.947180Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:13:59.947284Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:13:59.980894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534705720687485:8716]
2025-10-02T08:13:59.981001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1915, pipe: [1:7556534705720687485:8716]
2025-10-02T08:14:00.094684Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:00.095105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534705720687485:8716], now have 1 active actors on pipe
2025-10-02T08:14:00.095725Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:00.095888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:00.095898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0] Write session will restart in 0.006936s
2025-10-02T08:14:00.095921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0] Write session: Do CDS request
2025-10-02T08:14:00.095927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:00.095350Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:00.095579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534705720687485:8716]
2025-10-02T08:14:00.095596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:00.095622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1916 reason: status is not ok: tablet will be restarted right now sessionId: src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0
2025-10-02T08:14:00.095785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1916 sessionId: src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0 is DEAD
2025-10-02T08:14:00.104670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.105038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:00.105051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1917
2025-10-02T08:14:00.105179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.105222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:00.105233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:00.105236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:00.108158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1917 sessionId:  describe result for acl check
2025-10-02T08:14:00.108217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:00.108219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:00.108220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:00.108226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534710015655109:8406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:00.108851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534710015655109:8406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:00.112878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534710015655109:8406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:00.116424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534710015655109:8406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:00.116439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534710015655109:8406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:00.116443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534710015655109:8406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:00.116452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:00.118341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:00.120314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:00.120518Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:00.120530Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:00.120539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:00.120591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:00.120639Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534710015655397:8409]
2025-10-02T08:14:00.121338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:00.121613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:00.121684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:00.122016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:00.122071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.122076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.122077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.122078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.122079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.122085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.122096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.122099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.122103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.122106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.122113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.122120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.122126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.122132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.122136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.122141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.122145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.122150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.122154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.122158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.122181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:00.134611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:00.136119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:00.136134Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:00.136136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:00.136139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:00.136144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1916 [1:7556534710015655397:8409]
2025-10-02T08:14:00.136156Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:00.136172Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:00.136175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.136177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.136179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.136192Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:00.136196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:00.136201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:00.136276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.136284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.136289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:00.136291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:00.136351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:00.136359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.136371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.136378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:00.136396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534710015655391:8409]
2025-10-02T08:14:00.136405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534710015655391:8409]
2025-10-02T08:14:00.136414Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:00.136414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1916
2025-10-02T08:14:00.136421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:00.136424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:00.136428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015655376:8406], now have 1 active actors on pipe
2025-10-02T08:14:00.136435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:00.136445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:00.136447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:00.136452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534710475304283:2378], now have 1 active actors on pipe
2025-10-02T08:14:00.136456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.136459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.136516Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1916
2025-10-02T08:14:00.136494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534710015655391:8409]
2025-10-02T08:14:00.136504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:00.136516Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:00.136521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.136521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:00.136524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.136526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:00.136535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.136544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:00.136586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:00.136675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.136685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.136701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:00.136744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1917 partition: 0 MaxSeqNo: 17 sessionId: src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0
2025-10-02T08:14:00.137127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169cd505-486ca06e-a01358e0-7aa6aae5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:00.139953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0] Write session: try to update token
2025-10-02T08:14:00.139971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:00.148699Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:00.148718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:00.148727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534710015655391:8409]
2025-10-02T08:14:00.148769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:00.148779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:00.148961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:00.149103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:00.149242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:00.149374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:00.149932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:00.149978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:00.156157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId: src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:00.158993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:00.159047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.159056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.159091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:00.159116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:00.159175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.159198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.159382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.159456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.159530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.159605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.159656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.159666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.159740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.159820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.159911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.159993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.160042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.160051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.160129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.160197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.160282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.160350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.160400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.160409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.160488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.160556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.160623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.160690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.160739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.160747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.160845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.160917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.160988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.161062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.161120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.161128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.161212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.161288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.161373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.161457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.161510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.161518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.161606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.161687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.161771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.161858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.161920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.161923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.162009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.162090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.162170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.162257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.162308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.162315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.162392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.162457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.162527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.162616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.162666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.162669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.162763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.162832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.162904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.162983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.163034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.163037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.163087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:00.163153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.163175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.163177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:00.163216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:00.163230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:00.163234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:00.163237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:00.163240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:00.163657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:00.163676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:00.163682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:00.163686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:00.163690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:00.163696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:00.164187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:00.164228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:00.164234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:00.164240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:00.164244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:00.164247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:00.164926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:00.164948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:00.164954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:00.164957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:00.164961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:00.166191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:00.166207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:00.166219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392840166
2025-10-02T08:14:00.166379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:00.166394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:00.166405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:00.166413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:00.166421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:00.166429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:00.166909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:00.166929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:00.166934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:00.166938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:00.166941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:00.166945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:00.167392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:00.167411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:00.167422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:00.167430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:00.167434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:00.167437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:00.167880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:00.167904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:00.167911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:00.169155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:00.169174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:00.169180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:00.169183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:00.169193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392840168
2025-10-02T08:14:00.169485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:00.169507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:00.169516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:00.169526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:00.169530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:00.169538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:00.170023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:00.170044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:00.170054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:00.170058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:00.170066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:00.170070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:00.170538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:00.170558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.170660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392840170
2025-10-02T08:14:00.171519Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:00.171537Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:00.171544Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:00.171551Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:00.173690Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:00.173705Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:00.173707Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:00.173721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534710015655391:8409]
2025-10-02T08:14:00.173726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534710015655391:8409]
2025-10-02T08:14:00.173777Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:00.173789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:00.173791Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:00.173793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.173795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:00.173951Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:00.195916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534710015655429:8716]
2025-10-02T08:14:00.196088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1916, pipe: [1:7556534710015655429:8716]
2025-10-02T08:14:00.323799Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:00.324243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015655429:8716], now have 1 active actors on pipe
2025-10-02T08:14:00.324365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:00.324372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:00.324396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1917 reason: error at write: Disconnected sessionId: src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0
2025-10-02T08:14:00.324510Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:00.324559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1917 sessionId: src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0 is DEAD
2025-10-02T08:14:00.324533Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:00.324685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534710015655429:8716]
2025-10-02T08:14:00.324704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:00.324729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0] Write session will restart in 0.009081s
2025-10-02T08:14:00.324756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0] Write session: Do CDS request
2025-10-02T08:14:00.324764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:00.335344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.335550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:00.335564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1918
2025-10-02T08:14:00.335677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.335709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:00.335717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:00.335721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:00.336159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1918 sessionId:  describe result for acl check
2025-10-02T08:14:00.336193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:00.336199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:00.336212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:00.336218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534710015655728:8396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:00.336746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534710015655728:8396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:00.339133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534710015655728:8396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:00.343020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534710015655728:8396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:00.343035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534710015655728:8396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:00.343038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534710015655728:8396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:00.343048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:00.347367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:00.348999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:00.349291Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:00.349302Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:00.349314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:00.349378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:00.349431Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534710015656046:8397]
2025-10-02T08:14:00.350079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:00.350285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:00.350324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:00.350611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:00.350649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.350654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.350655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.350656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.350657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.350662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.350672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.350676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.350679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.350682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.350688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.350694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.350700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.350705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.350708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.350713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.350717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.350721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.350730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.350734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.350755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:00.358994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:00.360937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:00.360958Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:00.360961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:00.360964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:00.360972Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1917 [1:7556534710015656046:8397]
2025-10-02T08:14:00.360984Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:00.361003Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:00.361006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.361009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.361011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.361027Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:00.361035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:00.361042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:00.361107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.361116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.361119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:00.361123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:00.361189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:00.361203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.361218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.361231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:00.361247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534710015656040:8397]
2025-10-02T08:14:00.361254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534710015656040:8397]
2025-10-02T08:14:00.361263Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:00.361273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:00.361276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015655975:8396], now have 1 active actors on pipe
2025-10-02T08:14:00.361283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:00.361284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:00.361299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:00.361307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:00.361313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534710475304293:2378], now have 1 active actors on pipe
2025-10-02T08:14:00.361346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534710015656040:8397]
2025-10-02T08:14:00.361361Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:00.361367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:00.361404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1917
2025-10-02T08:14:00.361422Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1917
2025-10-02T08:14:00.361446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.361460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.361495Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:00.361508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.361516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.361519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:00.361528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.361539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:00.361558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:00.361604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.361609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.361620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:00.361651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1918 partition: 0 MaxSeqNo: 17 sessionId: src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0
2025-10-02T08:14:00.361973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b243fcf-c5484bf6-7c68e230-317b2091_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:00.364664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0] Write session: try to update token
2025-10-02T08:14:00.364682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:00.379690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId: src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:00.380980Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:00.380992Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:00.380995Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:00.381003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534710015656040:8397]
2025-10-02T08:14:00.381008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534710015656040:8397]
2025-10-02T08:14:00.381054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:00.381056Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:00.381060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.381063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:00.381067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:00.381190Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:00.382310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:00.424883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534710015656072:8716]
2025-10-02T08:14:00.425087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1917, pipe: [1:7556534710015656072:8716]
2025-10-02T08:14:00.521896Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:00.522471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.522479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.522515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015656072:8716], now have 1 active actors on pipe
2025-10-02T08:14:00.523088Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:00.523448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534710015656072:8716]
2025-10-02T08:14:00.523469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:00.523518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1918 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0
2025-10-02T08:14:00.523768Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:00.523679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1918 sessionId: src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0 is DEAD
2025-10-02T08:14:00.523917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:00.523923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0] Write session will restart in 0.008467s
2025-10-02T08:14:00.523943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0] Write session: Do CDS request
2025-10-02T08:14:00.523948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:00.537077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.537187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:00.537202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1919
2025-10-02T08:14:00.537456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.537485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:00.537489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:00.537493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:00.537982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1919 sessionId:  describe result for acl check
2025-10-02T08:14:00.538019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:00.538020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:00.538021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:00.538027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534710015656517:8374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:00.538530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534710015656517:8374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:00.543085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534710015656517:8374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:00.545421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:00.547237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:00.547401Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:00.547410Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:00.547418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:00.547461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:00.547494Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534710015656685:8375]
2025-10-02T08:14:00.547627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534710015656517:8374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:00.547639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534710015656517:8374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:00.547642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534710015656517:8374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:00.547651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:00.548068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:00.548261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:00.548296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:00.548572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:00.548603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.548604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.548605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.548606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.548606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.548610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.548620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.548623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.548626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.548629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.548634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.548640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.548645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.548650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.548654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.548658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.548663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.548667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.548671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.548675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.548691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:00.561783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:00.563586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:00.563606Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:00.563609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:00.563613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:00.563620Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1918 [1:7556534710015656685:8375]
2025-10-02T08:14:00.563633Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:00.563652Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:00.563666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.563669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.563672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.563690Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:00.563695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:00.563704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:00.563773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.563775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.563778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:00.563780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:00.563855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:00.563858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.563873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.563886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:00.563903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534710015656675:8375]
2025-10-02T08:14:00.563906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534710015656675:8375]
2025-10-02T08:14:00.563913Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:00.563927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:00.563942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:00.563946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:00.563952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:00.563955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:00.563984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015656690:8374], now have 1 active actors on pipe
2025-10-02T08:14:00.563988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534710015656675:8375]
2025-10-02T08:14:00.563991Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:00.564044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1918
2025-10-02T08:14:00.564115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:00.564191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534710475304311:2378], now have 1 active actors on pipe
2025-10-02T08:14:00.564214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.564219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.564243Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:00.564254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.564258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.564260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:00.564270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.564280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:00.564300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:00.564418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.564426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.564439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:00.564471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1919 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0
2025-10-02T08:14:00.564863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02f514a-e3e0face-c86bf594-bf7c1926_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:00.565377Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1918
2025-10-02T08:14:00.567375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0] Write session: try to update token
2025-10-02T08:14:00.567392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:00.587770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId: src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:00.590452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:00.590703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.590714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.590747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:00.590764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:00.590824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.590826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.590992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.591049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.591111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.591172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.591215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.591219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.591288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.591350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.591414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.591477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.591629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.591635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.591707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.591767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.591830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.591894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.592041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.592045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.592113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.592182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.592266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.592337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.592383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.592386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.592465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.592528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.592599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.592670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.592718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.592721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.592818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.592892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.592960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.593027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.593074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.593077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.593154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.593221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.593295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.593368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.593419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.593422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.593505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.593575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.593649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.593718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.593767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.593770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.593842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.593899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.593959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.594024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.594073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.594075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.594153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.594215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.594274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.594336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.594385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.594388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.594434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:00.594499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.594532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.594535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:00.594567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:00.594581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:00.594585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:00.594588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:00.594591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:00.595019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:00.595048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:00.595057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:00.595061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:00.595065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:00.595069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:00.595578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:00.595591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:00.595598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:00.595601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:00.595605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:00.595611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:00.596090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:00.596102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:00.596108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:00.596113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:00.596116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:00.597514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:00.597533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:00.597546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392840597
2025-10-02T08:14:00.597666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:00.597674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:00.597680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:00.597683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:00.597688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:00.597692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:00.598410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:00.598423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:00.598429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:00.598434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:00.598437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:00.598445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:00.598896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:00.598906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:00.598914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:00.598917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:00.598921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:00.598925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:00.599427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:00.599437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:00.599443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:00.600570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:00.600578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:00.600583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:00.600588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:00.600597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392840600
2025-10-02T08:14:00.601097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:00.601117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:00.601124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:00.601127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:00.601133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:00.601137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:00.601624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:00.601636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:00.601645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:00.601648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:00.601652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:00.601656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:00.602121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:00.602130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.602235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392840602
2025-10-02T08:14:00.603003Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:00.603021Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:00.603029Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:00.603036Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:00.604708Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:00.604711Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:00.604712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:00.604721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534710015656675:8375]
2025-10-02T08:14:00.604726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534710015656675:8375]
2025-10-02T08:14:00.604791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:00.604796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.604849Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:00.604855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:00.604958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:00.605109Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:00.623363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534710015656723:8716]
2025-10-02T08:14:00.623630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1918, pipe: [1:7556534710015656723:8716]
2025-10-02T08:14:00.758235Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:00.758633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015656723:8716], now have 1 active actors on pipe
2025-10-02T08:14:00.758873Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:00.758754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534710015656723:8716]
2025-10-02T08:14:00.758758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:00.759080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:00.758760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:00.759090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0] Write session will restart in 0.009834s
2025-10-02T08:14:00.758784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1919 reason: error at write: Disconnected sessionId: src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0
2025-10-02T08:14:00.758894Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:00.758932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1919 sessionId: src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0 is DEAD
2025-10-02T08:14:00.759113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0] Write session: Do CDS request
2025-10-02T08:14:00.759119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:00.770547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.771717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:00.771730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1920
2025-10-02T08:14:00.771836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.771859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:00.771867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:00.771870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:00.772253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1920 sessionId:  describe result for acl check
2025-10-02T08:14:00.772280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:00.772281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:00.772282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:00.772286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534710015656988:8359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:00.772755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534710015656988:8359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:00.777187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534710015656988:8359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:00.779238Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:14:00.780035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534710015656988:8359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:00.780050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534710015656988:8359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:00.780054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534710015656988:8359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:00.780061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:00.787138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:00.788927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:00.789130Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:00.789140Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:00.789150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:00.789197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:00.789240Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534710015657361:8358]
2025-10-02T08:14:00.789917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:00.790130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:00.790172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:00.790481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:00.790524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.790530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.790532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.790533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.790534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.790540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.790551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.790556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.790560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.790564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.790571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.790580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:00.790585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.790591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:00.790596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.790601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:00.790606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.790611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.790619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.790624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.790649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:00.799251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:00.800868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:00.800882Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:00.800885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:00.800889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:00.800896Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1919 [1:7556534710015657361:8358]
2025-10-02T08:14:00.800907Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:00.800924Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:00.800927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.800930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.800932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.800947Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:00.800955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:00.800962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:00.801023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.801030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.801033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:00.801035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:00.801171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1919
2025-10-02T08:14:00.801473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:00.801483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.801492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:00.801501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:00.801518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015657222:8359], now have 1 active actors on pipe
2025-10-02T08:14:00.801521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534710475304320:2378], now have 1 active actors on pipe
2025-10-02T08:14:00.801525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.801528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.801546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534710015657355:8358]
2025-10-02T08:14:00.801547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534710015657355:8358]
2025-10-02T08:14:00.801557Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:00.801574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:00.801579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:00.801582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:00.801586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:00.801589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:00.801601Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:00.801606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.801609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.801611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:00.801618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.801629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:00.801661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534710015657355:8358]
2025-10-02T08:14:00.801672Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:00.801682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:00.801698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:00.801725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.801727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.801740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:00.801774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1920 partition: 0 MaxSeqNo: 17 sessionId: src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0
2025-10-02T08:14:00.802062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa0ed310-99868b9f-9df15d21-799ba23d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:00.804517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0] Write session: try to update token
2025-10-02T08:14:00.804531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:00.801313Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1919
2025-10-02T08:14:00.813696Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:00.813715Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:00.813723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534710015657355:8358]
2025-10-02T08:14:00.813769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:00.813773Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:00.813951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:00.814095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:00.814246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:00.814398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:00.814629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:00.814672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:00.822335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId: src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:00.825227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:00.825308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.825322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.825357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:00.825383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:00.825657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:00.825675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:00.825862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.825931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.825997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.826063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.826396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.826410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.826485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.826551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.826625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.826703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.826754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.826763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.826843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.826914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.826990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.827062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.827112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.827120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.827196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.827284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.827358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.827432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.827485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.827493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.827568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.827639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.827717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.827790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.827844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.827856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.827933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.828002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.828080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.828152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.828220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.828227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.828305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.828377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.828452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.828541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.828598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.828606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.828684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.828757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.828875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.828951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.829004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.829007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.829088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.829157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.829230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.829319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.829371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.829379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.829456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:00.829532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:00.829606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:00.829684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:00.829737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:00.829745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:00.829796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:00.829870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:00.829895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:00.829902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:00.829937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:00.829956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:00.829964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:00.829968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:00.829973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:00.830401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:00.830430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:00.830437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:00.830443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:00.830446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:00.830455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:00.831098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:00.831122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:00.831129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:00.831137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:00.831141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:00.831144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:00.831717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:00.831742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:00.831749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:00.831752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:00.831756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:00.833114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:00.833133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:00.833147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392840832
2025-10-02T08:14:00.833322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:00.833337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:00.833343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:00.833351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:00.833357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:00.833360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:00.833867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:00.833891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:00.833897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:00.833906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:00.833912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:00.833917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:00.834419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:00.834441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:00.834451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:00.834456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:00.834460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:00.834464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:00.834976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:00.835004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:00.835009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:00.836156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:00.836176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:00.836181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:00.836186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:00.836197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392840835
2025-10-02T08:14:00.836535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:00.836546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:00.836552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:00.836556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:00.836559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:00.836565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:00.837161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:00.837186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:00.837192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:00.837195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:00.837199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:00.837202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:00.837686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:00.837698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:00.837824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392840837
2025-10-02T08:14:00.838604Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:00.838617Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:00.838623Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:00.838630Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:00.840529Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:00.840534Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:00.840536Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:00.840546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534710015657355:8358]
2025-10-02T08:14:00.840550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534710015657355:8358]
2025-10-02T08:14:00.840612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:00.840619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:00.840858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:00.840871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:00.840873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:00.841012Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:00.858958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534710015657394:8716]
2025-10-02T08:14:00.859085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1919, pipe: [1:7556534710015657394:8716]
2025-10-02T08:14:00.979256Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:00.979526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015657394:8716], now have 1 active actors on pipe
2025-10-02T08:14:00.979619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:00.979626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:00.979648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1920 reason: error at write: Disconnected sessionId: src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0
2025-10-02T08:14:00.979705Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:00.979729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:00.979821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1920 sessionId: src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0 is DEAD
2025-10-02T08:14:00.979950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:00.979961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0] Write session will restart in 0.005123s
2025-10-02T08:14:00.979983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0] Write session: Do CDS request
2025-10-02T08:14:00.979990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:00.979991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534710015657394:8716]
2025-10-02T08:14:00.986239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.986334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:00.986348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1921
2025-10-02T08:14:00.986490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:00.986520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:00.986525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:00.986528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:00.987050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1921 sessionId:  describe result for acl check
2025-10-02T08:14:00.987087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:00.987094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:00.987096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:00.987100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534710015657692:8306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:00.987503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534710015657692:8306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:00.989525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534710015657692:8306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:00.993195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534710015657692:8306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:00.993212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534710015657692:8306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:00.993215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534710015657692:8306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:00.993223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:00.999789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:01.001302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:01.001605Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:01.001611Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:01.001620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:01.001659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:01.001689Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534714310625349:8308]
2025-10-02T08:14:01.002086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:01.002284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:01.002316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:01.002499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:01.002526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.002530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.002531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.002531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.002532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.002534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.002541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.002543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.002545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.002547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.002551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.002558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.002567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.002571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.002579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.002583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.002592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.002600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.002604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.002613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.002631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:01.010340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:01.011682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:01.011699Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:01.011701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:01.011704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:01.011708Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1920 [1:7556534714310625349:8308]
2025-10-02T08:14:01.011717Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:01.011730Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:01.011731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.011734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.011735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.011747Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:01.011750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:01.011755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:01.011799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.011804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.011807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:01.011809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:01.011866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:01.011873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.011881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.011893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:01.011907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534710015658047:8308]
2025-10-02T08:14:01.011912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534710015658047:8308]
2025-10-02T08:14:01.011918Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:01.011926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1920
2025-10-02T08:14:01.011927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534710015657883:8306], now have 1 active actors on pipe
2025-10-02T08:14:01.011934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:01.011941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:01.011943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:01.011944Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:01.011947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:01.011969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534710475304341:2378], now have 1 active actors on pipe
2025-10-02T08:14:01.011979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.011982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.011996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534710015658047:8308]
2025-10-02T08:14:01.012004Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:01.012028Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:01.012032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:01.012034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.012037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.012039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:01.012047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.012057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:01.012081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.012130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.012136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.012148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.012186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1921 partition: 0 MaxSeqNo: 17 sessionId: src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0
2025-10-02T08:14:01.012491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea3ebbd-6c8a448e-a9dee63b-2969bfd4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:01.012039Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1920
2025-10-02T08:14:01.014995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0] Write session: try to update token
2025-10-02T08:14:01.015011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:01.029748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId: src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:01.030963Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:01.030981Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:01.030983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:01.030991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534710015658047:8308]
2025-10-02T08:14:01.030997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534710015658047:8308]
2025-10-02T08:14:01.031037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:01.031045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:01.031048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.031050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:01.031052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:01.031190Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:01.032354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:01.080155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534714310625375:8716]
2025-10-02T08:14:01.080266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1920, pipe: [1:7556534714310625375:8716]
2025-10-02T08:14:01.168939Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:01.169453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.169468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.169509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310625375:8716], now have 1 active actors on pipe
2025-10-02T08:14:01.169620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:01.169630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:01.169690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1921 reason: error at write: Disconnected sessionId: src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0
2025-10-02T08:14:01.169707Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:01.169859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1921 sessionId: src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0 is DEAD
2025-10-02T08:14:01.170031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534714310625375:8716]
2025-10-02T08:14:01.169759Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:01.172929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:01.172947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0] Write session will restart in 0.008090s
2025-10-02T08:14:01.172982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0] Write session: Do CDS request
2025-10-02T08:14:01.172990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:01.182321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.182385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:01.182400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1922
2025-10-02T08:14:01.182499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.182525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:01.182529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:01.182532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:01.182945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1922 sessionId:  describe result for acl check
2025-10-02T08:14:01.182980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:01.182986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:01.182988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:01.182993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534714310625883:8285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:01.183511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534714310625883:8285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:01.186295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534714310625883:8285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:01.187039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:01.188993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:01.189166Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:01.189175Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:01.189184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:01.189235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:01.189269Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534714310625994:8289]
2025-10-02T08:14:01.189317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534714310625883:8285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:01.189329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534714310625883:8285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:01.189337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534714310625883:8285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:01.189344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:01.189713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:01.189867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:01.189893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:01.190089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:01.190126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.190132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.190132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.190133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.190133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.190136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.190142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.190145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.190147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.190150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.190155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.190165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.190176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.190181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.190188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.190191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.190194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.190196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.190199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.190202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.190213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:01.197913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:01.199507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:01.199521Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:01.199522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:01.199525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:01.199530Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1921 [1:7556534714310625994:8289]
2025-10-02T08:14:01.199538Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:01.199551Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:01.199553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.199555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.199556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.199568Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:01.199572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:01.199578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:01.199625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.199631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.199634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:01.199636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:01.199693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:01.199698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.199705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.199716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:01.199730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534714310625988:8289]
2025-10-02T08:14:01.199732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534714310625988:8289]
2025-10-02T08:14:01.199737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:01.199748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:01.199756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:01.199758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:01.199759Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:01.199760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:01.199767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310625999:8285], now have 1 active actors on pipe
2025-10-02T08:14:01.199777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1921
2025-10-02T08:14:01.199789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534714770271656:2378], now have 1 active actors on pipe
2025-10-02T08:14:01.199790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534714310625988:8289]
2025-10-02T08:14:01.199796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:01.199804Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:01.199805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.199808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.199835Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e727511-7e450c-3bd91a80-a60006f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:01.199844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.199850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.199851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:01.199857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.199867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:01.199886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.199870Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1921
2025-10-02T08:14:01.199926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.199933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.199945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.199973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1922 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e727511-7e450c-3bd91a80-a60006f6_0
2025-10-02T08:14:01.200295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a2ae1-ad195a58-c99292bb-82f54c8d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e727511-7e450c-3bd91a80-a60006f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:01.202766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e727511-7e450c-3bd91a80-a60006f6_0] Write session: try to update token
2025-10-02T08:14:01.202780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e727511-7e450c-3bd91a80-a60006f6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:01.216105Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:01.216121Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:01.216122Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:01.216128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534714310625988:8289]
2025-10-02T08:14:01.216132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534714310625988:8289]
2025-10-02T08:14:01.216164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:01.216169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.216171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:01.216173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:01.216177Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:01.216363Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:01.217036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId: src_id|2e727511-7e450c-3bd91a80-a60006f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:01.219329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:01.270107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534714310626025:8716]
2025-10-02T08:14:01.270242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1921, pipe: [1:7556534714310626025:8716]
2025-10-02T08:14:01.340936Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:01.341141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.341150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.341184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310626025:8716], now have 1 active actors on pipe
2025-10-02T08:14:01.341326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:01.341335Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:01.341339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:01.341405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1922 reason: error at write: Disconnected sessionId: src_id|2e727511-7e450c-3bd91a80-a60006f6_0
2025-10-02T08:14:01.341432Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:01.341601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1922 sessionId: src_id|2e727511-7e450c-3bd91a80-a60006f6_0 is DEAD
2025-10-02T08:14:01.341733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e727511-7e450c-3bd91a80-a60006f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:01.341746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e727511-7e450c-3bd91a80-a60006f6_0] Write session will restart in 0.006360s
2025-10-02T08:14:01.341733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534714310626025:8716]
2025-10-02T08:14:01.341768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e727511-7e450c-3bd91a80-a60006f6_0] Write session: Do CDS request
2025-10-02T08:14:01.341775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e727511-7e450c-3bd91a80-a60006f6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:01.349449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e727511-7e450c-3bd91a80-a60006f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.349522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:01.349535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1923
2025-10-02T08:14:01.349699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.349730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:01.349739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:01.349742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:01.350108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1923 sessionId:  describe result for acl check
2025-10-02T08:14:01.350140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:01.350145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:01.350147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:01.350151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534714310626371:8280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:01.350631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534714310626371:8280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:01.352968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534714310626371:8280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:01.356157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534714310626371:8280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:01.356171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534714310626371:8280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:01.356173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534714310626371:8280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:01.356181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:01.357979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:01.359574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:01.359733Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:01.359742Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:01.359751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:01.359792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:01.359830Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534714310626650:8281]
2025-10-02T08:14:01.360453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:01.360647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:01.360684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:01.360996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:01.361038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.361043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.361044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.361045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.361047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.361052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.361063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.361067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.361071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.361075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.361080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.361088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.361093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.361098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.361103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.361108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.361112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.361117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.361122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.361132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.361151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:01.369266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:01.371052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:01.371068Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:01.371070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:01.371074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:01.371080Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1922 [1:7556534714310626650:8281]
2025-10-02T08:14:01.371092Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:01.371109Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:01.371118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.371121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.371123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.371138Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:01.371148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:01.371155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:01.371224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.371231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.371235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:01.371237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:01.371304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:01.371311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.371324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.371337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:01.371358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310626629:8280], now have 1 active actors on pipe
2025-10-02T08:14:01.371363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1922
2025-10-02T08:14:01.371368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534714310626644:8281]
2025-10-02T08:14:01.371370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534714310626644:8281]
2025-10-02T08:14:01.371381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:01.371394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534714770271663:2378], now have 1 active actors on pipe
2025-10-02T08:14:01.371397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:01.371400Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:01.371414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.371418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.371432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:01.371452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:01.371458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:01.371434Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1922
2025-10-02T08:14:01.371497Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:01.371507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.371511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.371513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:01.371521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.371532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:01.371543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534714310626644:8281]
2025-10-02T08:14:01.371550Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:01.371573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:01.371584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.371623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.371630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.371642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.371684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1923 partition: 0 MaxSeqNo: 17 sessionId: src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0
2025-10-02T08:14:01.372066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e727511-7e450c-3bd91a80-a60006f6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:01.375376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0] Write session: try to update token
2025-10-02T08:14:01.375398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:01.388657Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:01.388675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:01.388678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:01.388687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534714310626644:8281]
2025-10-02T08:14:01.388692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534714310626644:8281]
2025-10-02T08:14:01.388734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:01.388734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:01.388740Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:01.388741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.388743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:01.388897Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:01.392112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId: src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:01.395029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:01.442137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534714310626677:8716]
2025-10-02T08:14:01.442264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1922, pipe: [1:7556534714310626677:8716]
2025-10-02T08:14:01.524510Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:01.524960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.524974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.525014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310626677:8716], now have 1 active actors on pipe
2025-10-02T08:14:01.525172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:01.525183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:01.525220Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:01.525245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1923 reason: error at write: Disconnected sessionId: src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0
2025-10-02T08:14:01.525400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1923 sessionId: src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0 is DEAD
2025-10-02T08:14:01.525574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534714310626677:8716]
2025-10-02T08:14:01.525289Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:01.525673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:01.525688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0] Write session will restart in 0.006780s
2025-10-02T08:14:01.525717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0] Write session: Do CDS request
2025-10-02T08:14:01.525725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:01.533266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.533329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:01.533342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1924
2025-10-02T08:14:01.533499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.533534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:01.533543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:01.533546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:01.533889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1924 sessionId:  describe result for acl check
2025-10-02T08:14:01.533916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:01.533921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:01.533923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:01.533927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534714310627010:8268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:01.534501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534714310627010:8268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:01.536841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534714310627010:8268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:01.540752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534714310627010:8268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:01.540775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534714310627010:8268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:01.540780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534714310627010:8268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:01.540789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:01.543178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:01.544624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:01.544833Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:01.544840Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:01.544848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:01.544887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:01.544914Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534714310627305:8259]
2025-10-02T08:14:01.545351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:01.545551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:01.545594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:01.545829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:01.545869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.545873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.545874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.545875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.545876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.545879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.545886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.545888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.545890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.545892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.545896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.545900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.545903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.545906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.545909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.545912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.545914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.545917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.545919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.545921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.545935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:01.553523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:01.555330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:01.555350Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:01.555352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:01.555356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:01.555362Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1923 [1:7556534714310627305:8259]
2025-10-02T08:14:01.555375Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:01.555394Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:01.555398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.555401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.555402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.555423Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:01.555429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:01.555437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:01.555518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.555520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.555523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:01.555526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:01.555607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:01.555610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.555623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.555633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:01.555652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310627266:8268], now have 1 active actors on pipe
2025-10-02T08:14:01.555655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534714770271670:2378], now have 1 active actors on pipe
2025-10-02T08:14:01.555662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534714310627299:8259]
2025-10-02T08:14:01.555664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534714310627299:8259]
2025-10-02T08:14:01.555677Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:01.555691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:01.555692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:01.555695Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:01.555704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:01.555707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:01.555738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534714310627299:8259]
2025-10-02T08:14:01.555745Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:01.555751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:01.555783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1923
2025-10-02T08:14:01.555798Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1923
2025-10-02T08:14:01.555796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.555800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.555821Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65cc245a-b87c8137-bbad4649-22061afb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:01.555827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.555831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.555833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:01.555840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.555848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:01.555859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.555885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.555892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.555903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.555933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1924 partition: 0 MaxSeqNo: 17 sessionId: src_id|65cc245a-b87c8137-bbad4649-22061afb_0
2025-10-02T08:14:01.556305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658fb3f4-568ecf21-aa98bc1c-e294345a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|65cc245a-b87c8137-bbad4649-22061afb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:01.559335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cc245a-b87c8137-bbad4649-22061afb_0] Write session: try to update token
2025-10-02T08:14:01.559353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cc245a-b87c8137-bbad4649-22061afb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:01.566684Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:01.566703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:01.566711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534714310627299:8259]
2025-10-02T08:14:01.566753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:01.566756Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:01.566920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:01.567071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:01.567212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:01.567350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:01.567549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:01.567596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:01.574739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId: src_id|65cc245a-b87c8137-bbad4649-22061afb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:01.577603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:01.577707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.577725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.577767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:01.577796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:01.577866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.577886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.578067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.578145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.578221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.578298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.578621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.578638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.578714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.578785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.578851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.579145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.579186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.579190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.579261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.579326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.579393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.579464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.579511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.579515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.579592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.579667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.579738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.579808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.579854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.579857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.579936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.580007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.580078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.580147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.580197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.580200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.580300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.580362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.580435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.580505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.580556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.580559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.580644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.580710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.580784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.580880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.580929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.580932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.581012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.581074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.581138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.581205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.581254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.581257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.581338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.581406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.581472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.581538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.581589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.581593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.581675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:01.581740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:01.581802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:01.581866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:01.581918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:01.581921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:01.581992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:01.582053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.582071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.582073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:01.582107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:01.582123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:01.582126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:01.582132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:01.582137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:01.582559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:01.582578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:01.582585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:01.582588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:01.582591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:01.582594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:01.583243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:01.583258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:01.583264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:01.583267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:01.583270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:01.583273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:01.583773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:01.583786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:01.583793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:01.583797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:01.583800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:01.585544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:01.585575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:01.585590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392841585
2025-10-02T08:14:01.585767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:01.585789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:01.585801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:01.585808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:01.585812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:01.585815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:01.586347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:01.586384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:01.586392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:01.586395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:01.586398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:01.586401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:01.586943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:01.586973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:01.586988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:01.586995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:01.586999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:01.587003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:01.587531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:01.587561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:01.587567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:01.588863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:01.588882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:01.588888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:01.588894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:01.588902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392841588
2025-10-02T08:14:01.589219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:01.589247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:01.589259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:01.589266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:01.589270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:01.589273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:01.589771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:01.589798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:01.589805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:01.589808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:01.589812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:01.589815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:01.590309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:01.590333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.590442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392841590
2025-10-02T08:14:01.593047Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:01.593078Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:01.593086Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:01.593098Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:01.593113Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:01.593119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:01.593123Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:01.593135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534714310627299:8259]
2025-10-02T08:14:01.593142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534714310627299:8259]
2025-10-02T08:14:01.593223Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:01.593231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.593233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:01.593269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:01.593285Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:01.593372Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:01.625940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534714310627331:8716]
2025-10-02T08:14:01.626073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1923, pipe: [1:7556534714310627331:8716]
2025-10-02T08:14:01.727806Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:01.728143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310627331:8716], now have 1 active actors on pipe
2025-10-02T08:14:01.728284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:01.728292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:01.728314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1924 reason: error at write: Disconnected sessionId: src_id|65cc245a-b87c8137-bbad4649-22061afb_0
2025-10-02T08:14:01.728368Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:01.728453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1924 sessionId: src_id|65cc245a-b87c8137-bbad4649-22061afb_0 is DEAD
2025-10-02T08:14:01.728519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:01.728580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cc245a-b87c8137-bbad4649-22061afb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:01.728588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cc245a-b87c8137-bbad4649-22061afb_0] Write session will restart in 0.008011s
2025-10-02T08:14:01.728607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cc245a-b87c8137-bbad4649-22061afb_0] Write session: Do CDS request
2025-10-02T08:14:01.728613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cc245a-b87c8137-bbad4649-22061afb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:01.728617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534714310627331:8716]
2025-10-02T08:14:01.731406Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [b5b38fdafea2a528] Result# TEvPutResult {Id# [72075186224037892:1923:1:2:3:6247585:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:01.731445Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1923:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:01.731488Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1923:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:01.737249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cc245a-b87c8137-bbad4649-22061afb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.737400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:01.737418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1925
2025-10-02T08:14:01.737559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.737603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:01.737613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:01.737617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:01.738018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1925 sessionId:  describe result for acl check
2025-10-02T08:14:01.738051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:01.738056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:01.738058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:01.738062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534714310627637:8261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:01.738538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534714310627637:8261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:01.740791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534714310627637:8261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:01.743660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534714310627637:8261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:01.743671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534714310627637:8261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:01.743673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534714310627637:8261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:01.743679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:01.746836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:01.747872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:01.748019Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:01.748027Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:01.748035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:01.748074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:01.748107Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534714310627981:8264]
2025-10-02T08:14:01.748602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:01.748724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:01.748758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:01.749002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:01.749042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.749047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.749048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.749049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.749050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.749055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.749066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.749069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.749073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.749077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.749095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.749105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.749113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.749119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.749126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.749131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.749139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.749145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.749149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.749154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.749175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:01.756917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:01.758365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:01.758378Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:01.758379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:01.758382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:01.758386Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1924 [1:7556534714310627981:8264]
2025-10-02T08:14:01.758394Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:01.758408Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:01.758411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.758413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.758415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.758431Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:01.758435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:01.758442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:01.758501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.758511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.758514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:01.758517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:01.758567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:01.758572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.758581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.758591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:01.758604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534714310627975:8264]
2025-10-02T08:14:01.758609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534714310627975:8264]
2025-10-02T08:14:01.758614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:01.758624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310627903:8261], now have 1 active actors on pipe
2025-10-02T08:14:01.758626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:01.758629Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:01.758634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:01.758636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1924
2025-10-02T08:14:01.758642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:01.758644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:01.758648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534714770271689:2378], now have 1 active actors on pipe
2025-10-02T08:14:01.758673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.758679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.758690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534714310627975:8264]
2025-10-02T08:14:01.758701Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:01.758711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:01.758723Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:01.758727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.758730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.758737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:01.758743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.758720Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1924
2025-10-02T08:14:01.758750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:01.758769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.758818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.758824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.758833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.758863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1925 partition: 0 MaxSeqNo: 17 sessionId: src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0
2025-10-02T08:14:01.759194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cc245a-b87c8137-bbad4649-22061afb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:01.761789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0] Write session: try to update token
2025-10-02T08:14:01.761805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:01.774529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId: src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:01.775177Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:01.775191Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:01.775193Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:01.775202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534714310627975:8264]
2025-10-02T08:14:01.775206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534714310627975:8264]
2025-10-02T08:14:01.775251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:01.775263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.775265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:01.775337Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:01.775351Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:01.775403Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:01.776927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:01.828673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534714310628010:8716]
2025-10-02T08:14:01.828833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1924, pipe: [1:7556534714310628010:8716]
2025-10-02T08:14:01.912254Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:01.912777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.912792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.912842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310628010:8716], now have 1 active actors on pipe
2025-10-02T08:14:01.912987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:01.912999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:01.913017Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:01.913062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1925 reason: error at write: Disconnected sessionId: src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0
2025-10-02T08:14:01.913076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:01.913212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1925 sessionId: src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0 is DEAD
2025-10-02T08:14:01.913395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:01.913405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0] Write session will restart in 0.007978s
2025-10-02T08:14:01.913401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534714310628010:8716]
2025-10-02T08:14:01.913441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0] Write session: Do CDS request
2025-10-02T08:14:01.913447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:01.922304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.922385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:01.922400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1926
2025-10-02T08:14:01.922522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:01.922551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:01.922556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:01.922559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:01.922989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1926 sessionId:  describe result for acl check
2025-10-02T08:14:01.923029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:01.923035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:01.923037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:01.923042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534714310628303:8239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:01.923564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534714310628303:8239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:01.926856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534714310628303:8239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:01.930175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534714310628303:8239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:01.930192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534714310628303:8239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:01.930195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534714310628303:8239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:01.930204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:01.936504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:01.937964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:01.938149Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:01.938156Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:01.938163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:01.938204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:01.938240Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534714310628643:8246]
2025-10-02T08:14:01.938712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:01.938922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:01.938977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:01.939210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:01.939245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.939245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.939246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.939247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.939248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.939251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.939258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.939260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.939263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.939268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.939273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.939281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:01.939287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.939292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:01.939305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.939310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:01.939315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.939319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.939322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.939325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.939335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:01.948963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:01.950625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:01.950641Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:01.950643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:01.950647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:01.950653Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1925 [1:7556534714310628643:8246]
2025-10-02T08:14:01.950664Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:01.950681Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:01.950683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.950686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.950688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.950703Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:01.950707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:01.950714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:01.950777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.950786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.950789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:01.950791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:01.950871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:01.950893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.950905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:01.950917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:01.950926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1925
2025-10-02T08:14:01.950937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534714310628495:8239], now have 1 active actors on pipe
2025-10-02T08:14:01.950941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534714770271698:2378], now have 1 active actors on pipe
2025-10-02T08:14:01.950945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.950950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.950968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534714310628637:8246]
2025-10-02T08:14:01.950970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534714310628637:8246]
2025-10-02T08:14:01.950984Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:01.950999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:01.951007Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:01.951009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:01.951013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:01.951016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:01.951031Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:01.951036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:01.951040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:01.951042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:01.951051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:01.951060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:01.951038Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1925
2025-10-02T08:14:01.951091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534714310628637:8246]
2025-10-02T08:14:01.951098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:01.951103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:01.951112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.951155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:01.951161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:01.951174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:01.951216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1926 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0
2025-10-02T08:14:01.951597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630a47e0-d7d035d7-e4f99e49-e9403445_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:01.954158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0] Write session: try to update token
2025-10-02T08:14:01.954174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:01.970535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId: src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:01.972330Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:01.972343Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:01.972345Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:01.972353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534714310628637:8246]
2025-10-02T08:14:01.972356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534714310628637:8246]
2025-10-02T08:14:01.972388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:01.972393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:01.972394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:01.972400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:01.972405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:01.972557Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:01.973196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:02.023245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534718605595977:8716]
2025-10-02T08:14:02.023462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1925, pipe: [1:7556534718605595977:8716]
2025-10-02T08:14:02.110419Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:02.110809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.110822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.110860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605595977:8716], now have 1 active actors on pipe
2025-10-02T08:14:02.111007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534718605595977:8716]
2025-10-02T08:14:02.111034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:02.111041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:02.111111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1926 reason: error at write: Disconnected sessionId: src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0
2025-10-02T08:14:02.111142Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:02.111138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:02.111274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1926 sessionId: src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0 is DEAD
2025-10-02T08:14:02.111563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:02.111572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0] Write session will restart in 0.005151s
2025-10-02T08:14:02.111592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0] Write session: Do CDS request
2025-10-02T08:14:02.111598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:02.118242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.118378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:02.118394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1927
2025-10-02T08:14:02.118507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.118535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:02.118545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:02.118548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:02.118919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1927 sessionId:  describe result for acl check
2025-10-02T08:14:02.118950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:02.118956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:02.118958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:02.118963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534718605596047:8220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:02.119463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534718605596047:8220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:02.122782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534718605596047:8220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:02.126795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534718605596047:8220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:02.126811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534718605596047:8220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:02.126815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534718605596047:8220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:02.126824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:02.133730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:02.135634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:02.135825Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:02.135836Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:02.135846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:02.135894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:02.135932Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534718605596636:8221]
2025-10-02T08:14:02.136547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:02.136725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:02.136769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:02.137068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:02.137125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.137131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.137133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.137134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.137135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.137139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.137148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.137151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.137154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.137157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.137163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.137169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.137181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.137185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.137194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.137198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.137206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.137210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.137214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.137218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.137233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:02.146651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:02.148306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:02.148320Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:02.148322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:02.148324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:02.148329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1926 [1:7556534718605596636:8221]
2025-10-02T08:14:02.148338Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:02.148350Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:02.148352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.148354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.148355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.148368Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:02.148373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:02.148378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:02.148435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.148445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.148448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:02.148450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:02.148501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:02.148514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.148522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.148532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:02.148545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534718605596630:8221]
2025-10-02T08:14:02.148550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534718605596630:8221]
2025-10-02T08:14:02.148556Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:02.148560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1926
2025-10-02T08:14:02.148566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605596455:8220], now have 1 active actors on pipe
2025-10-02T08:14:02.148569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:02.148572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:02.148572Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:02.148580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:02.148583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:02.148586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534719065239022:2378], now have 1 active actors on pipe
2025-10-02T08:14:02.148590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.148592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.148626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534718605596630:8221]
2025-10-02T08:14:02.148636Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:02.148647Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e53ed61c-6dc73e09-91254870-18075d60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:02.148655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.148658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.148659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:02.148665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.148675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:02.148701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.148702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:02.148723Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1926
2025-10-02T08:14:02.148850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.148860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.148883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.148933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1927 partition: 0 MaxSeqNo: 17 sessionId: src_id|e53ed61c-6dc73e09-91254870-18075d60_0
2025-10-02T08:14:02.149205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fe48b2-cf93d930-fa2e21cb-3b9e384b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e53ed61c-6dc73e09-91254870-18075d60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:02.151521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53ed61c-6dc73e09-91254870-18075d60_0] Write session: try to update token
2025-10-02T08:14:02.151535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53ed61c-6dc73e09-91254870-18075d60_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:02.161549Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:02.161571Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:02.161580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534718605596630:8221]
2025-10-02T08:14:02.161622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:02.161690Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:02.161804Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:02.161955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:02.162105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:02.162247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:02.162442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:02.162474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:02.168011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId: src_id|e53ed61c-6dc73e09-91254870-18075d60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:02.170667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:02.170740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.170753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.170787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:02.170806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:02.170864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.170871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.171036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.171101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.171163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.171228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.171274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.171285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.171355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.171418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.171487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.171557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.171603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.171610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.171683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.171740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.171798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.171897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.171944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.171957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.172025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.172097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.172171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.172259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.172315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.172322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.172409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.172478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.172553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.172626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.172681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.172689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.172768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.172943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.173021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.173097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.173149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.173156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.173242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.173310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.173387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.173477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.173613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.173622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.173702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.173775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.173854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.173927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.173987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.173994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.174070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.174134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.174201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.174272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.174322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.174330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.174405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:02.174471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:02.174534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:02.174601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:02.174653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:02.174661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:02.174702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:02.174775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.174799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.174806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:02.174840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:02.174859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:02.174867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:02.174870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:02.174877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:02.175291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:02.175321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:02.175332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:02.175336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:02.175339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:02.175342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:02.176222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:02.176246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:02.176252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:02.176255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:02.176258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:02.176262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:02.176943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:02.176974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:02.176979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:02.176983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:02.176986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:02.184667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:02.184696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:02.184711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392842184
2025-10-02T08:14:02.184842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:02.184863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:02.184870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:02.184874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:02.184878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:02.184880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:02.185337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:02.185360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:02.185366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:02.185374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:02.185377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:02.185381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:02.185961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:02.185983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:02.185990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:02.185998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:02.186001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:02.186005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:02.186512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:02.186532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:02.186536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:02.187675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:02.187696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:02.187701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:02.187705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:02.187714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392842187
2025-10-02T08:14:02.188057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:02.188084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:02.188099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:02.188108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:02.188111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:02.188115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:02.188640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:02.188661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:02.188667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:02.188673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:02.188677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:02.188680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:02.189297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:02.189321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.189419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392842189
2025-10-02T08:14:02.193227Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:02.193255Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:02.193262Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:02.193273Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:02.195017Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:02.195031Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:02.195033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:02.195041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534718605596630:8221]
2025-10-02T08:14:02.195046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534718605596630:8221]
2025-10-02T08:14:02.195089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:02.195099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:02.195104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:02.195109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.195111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:02.195250Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:02.211143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534718605596669:8716]
2025-10-02T08:14:02.211219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1926, pipe: [1:7556534718605596669:8716]
2025-10-02T08:14:02.335085Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:02.335595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605596669:8716], now have 1 active actors on pipe
2025-10-02T08:14:02.335726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534718605596669:8716]
2025-10-02T08:14:02.335750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:02.335757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:02.335783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1927 reason: error at write: Disconnected sessionId: src_id|e53ed61c-6dc73e09-91254870-18075d60_0
2025-10-02T08:14:02.335820Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:02.336051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53ed61c-6dc73e09-91254870-18075d60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:02.336058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53ed61c-6dc73e09-91254870-18075d60_0] Write session will restart in 0.006516s
2025-10-02T08:14:02.336096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53ed61c-6dc73e09-91254870-18075d60_0] Write session: Do CDS request
2025-10-02T08:14:02.336102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53ed61c-6dc73e09-91254870-18075d60_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:02.335948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1927 sessionId: src_id|e53ed61c-6dc73e09-91254870-18075d60_0 is DEAD
2025-10-02T08:14:02.335820Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:02.343260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53ed61c-6dc73e09-91254870-18075d60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.343333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:02.343348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1928
2025-10-02T08:14:02.343477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.343508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:02.343519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:02.343522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:02.343890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1928 sessionId:  describe result for acl check
2025-10-02T08:14:02.343925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:02.343933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:02.343934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:02.343939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534718605596989:8202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:02.344491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534718605596989:8202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:02.347493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534718605596989:8202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:02.350478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534718605596989:8202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:02.350491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534718605596989:8202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:02.350494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534718605596989:8202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:02.350502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:02.353608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:02.353984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:02.354143Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:02.354154Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:02.354164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:02.354237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:02.354278Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534718605597360:8199]
2025-10-02T08:14:02.354859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:02.355078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:02.355130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:02.355419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:02.355484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.355491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.355492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.355493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.355494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.355500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.355509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.355513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.355517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.355520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.355530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.355541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.355551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.355557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.355565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.355573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.355582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.355588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.355593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.355602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.355626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:02.364330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:02.365968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:02.365985Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:02.365988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:02.365992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:02.365998Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1927 [1:7556534718605597360:8199]
2025-10-02T08:14:02.366009Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:02.366025Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:02.366033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.366037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.366044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.366059Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:02.366068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:02.366075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:02.366139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.366146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.366149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:02.366152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:02.366219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:02.366229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.366242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.366254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:02.366273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605597299:8202], now have 1 active actors on pipe
2025-10-02T08:14:02.366285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534718605597354:8199]
2025-10-02T08:14:02.366288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534718605597354:8199]
2025-10-02T08:14:02.366295Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:02.366294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1927
2025-10-02T08:14:02.366304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:02.366306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534719065239033:2378], now have 1 active actors on pipe
2025-10-02T08:14:02.366307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:02.366311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:02.366325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:02.366327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:02.366334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.366338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.366376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534718605597354:8199]
2025-10-02T08:14:02.366388Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:02.366393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:02.366403Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:02.366409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.366412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.366414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:02.366423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.366433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:02.366403Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1927
2025-10-02T08:14:02.366475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.366524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.366532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.366547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.366580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1928 partition: 0 MaxSeqNo: 17 sessionId: src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0
2025-10-02T08:14:02.366882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53ed61c-6dc73e09-91254870-18075d60_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:02.369420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0] Write session: try to update token
2025-10-02T08:14:02.369432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:02.382444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId: src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:02.385557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:02.385795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.385816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.385837Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:02.385844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:02.385847Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:02.385856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534718605597354:8199]
2025-10-02T08:14:02.385865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534718605597354:8199]
2025-10-02T08:14:02.385902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:02.385917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:02.385917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:02.385922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.385925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:02.386077Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:02.435916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534718605597389:8716]
2025-10-02T08:14:02.436015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1927, pipe: [1:7556534718605597389:8716]
2025-10-02T08:14:02.537212Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:02.537493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:02.537538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:02.537542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605597389:8716], now have 1 active actors on pipe
2025-10-02T08:14:02.537650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:02.537658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:02.537678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1928 reason: error at write: Disconnected sessionId: src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0
2025-10-02T08:14:02.537808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1928 sessionId: src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0 is DEAD
2025-10-02T08:14:02.537780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:02.537941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534718605597389:8716]
2025-10-02T08:14:02.537988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:02.537999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0] Write session will restart in 0.006998s
2025-10-02T08:14:02.538025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0] Write session: Do CDS request
2025-10-02T08:14:02.538036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:02.546242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.546318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:02.546333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1929
2025-10-02T08:14:02.546572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.546613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:02.546624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:02.546628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:02.546985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1929 sessionId:  describe result for acl check
2025-10-02T08:14:02.547014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:02.547020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:02.547022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:02.547026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534718605597737:8178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:02.547570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534718605597737:8178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:02.549428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534718605597737:8178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:02.552701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534718605597737:8178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:02.552716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534718605597737:8178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:02.552719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534718605597737:8178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:02.552728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:02.557666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:02.558442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:02.558600Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:02.558609Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:02.558618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:02.558663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:02.558699Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534718605598075:8185]
2025-10-02T08:14:02.559337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:02.559512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:02.559552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:02.559847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:02.559898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.559904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.559905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.559906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.559908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.559912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.559923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.559927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.559931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.559935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.559939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.559946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.559952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.559957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.559961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.559966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.559971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.559976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.559981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.559990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.560012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:02.571171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:02.572773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:02.572791Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:02.572794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:02.572797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:02.572817Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1928 [1:7556534718605598075:8185]
2025-10-02T08:14:02.572830Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:02.572848Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:02.572854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.572858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.572860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.572878Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:02.572888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:02.572900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:02.572966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.572972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.572976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:02.572978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:02.573046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:02.573052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.573064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.573076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:02.573096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605597896:8178], now have 1 active actors on pipe
2025-10-02T08:14:02.573102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1928
2025-10-02T08:14:02.573107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534718605598069:8185]
2025-10-02T08:14:02.573108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534718605598069:8185]
2025-10-02T08:14:02.573116Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:02.573124Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:02.573128Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:02.573131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:02.573147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:02.573153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:02.573160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534719065239051:2378], now have 1 active actors on pipe
2025-10-02T08:14:02.573164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.573172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.573212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534718605598069:8185]
2025-10-02T08:14:02.573219Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:02.573220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:02.573194Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1928
2025-10-02T08:14:02.573235Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:02.573243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.573248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.573253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:02.573263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.573275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:02.573318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.573382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.573388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.573402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.573441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1929 partition: 0 MaxSeqNo: 17 sessionId: src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0
2025-10-02T08:14:02.573779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3a0f30-34bb33ef-9362a180-15c829a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:02.576174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0] Write session: try to update token
2025-10-02T08:14:02.576189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:02.590589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId: src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:02.590806Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:02.590811Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:02.590813Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:02.590821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534718605598069:8185]
2025-10-02T08:14:02.590826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534718605598069:8185]
2025-10-02T08:14:02.590873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:02.590873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:02.590879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:02.590880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.590882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:02.591022Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:02.593111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:02.638164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534718605598100:8716]
2025-10-02T08:14:02.638255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1928, pipe: [1:7556534718605598100:8716]
2025-10-02T08:14:02.725758Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:02.726414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.726431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.726471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605598100:8716], now have 1 active actors on pipe
2025-10-02T08:14:02.726615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:02.726628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:02.726683Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:02.727059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:02.727071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0] Write session will restart in 0.008225s
2025-10-02T08:14:02.727096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0] Write session: Do CDS request
2025-10-02T08:14:02.727105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:02.726716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1929 reason: error at write: Disconnected sessionId: src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0
2025-10-02T08:14:02.726895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1929 sessionId: src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0 is DEAD
2025-10-02T08:14:02.727056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534718605598100:8716]
2025-10-02T08:14:02.727009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:02.736331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.736368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:02.736384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1930
2025-10-02T08:14:02.736731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.736772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:02.736780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:02.736784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:02.737262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1930 sessionId:  describe result for acl check
2025-10-02T08:14:02.737297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:02.737303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:02.737305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:02.737309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534718605598527:8155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:02.737944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534718605598527:8155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:02.740930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534718605598527:8155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:02.745637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534718605598527:8155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:02.745662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534718605598527:8155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:02.745665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534718605598527:8155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:02.745673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:02.746916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:02.747289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:02.747583Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:02.747588Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:02.747602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:02.747671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:02.747708Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534718605598802:8157]
2025-10-02T08:14:02.748362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:02.748569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:02.748610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:02.748979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:02.749058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.749066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.749068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.749068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.749069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.749075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.749085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.749088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.749098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.749102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.749108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.749122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.749146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.749157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.749167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.749177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.749187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.749197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.749201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.749211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.749234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:02.757438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:02.759322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:02.759343Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:02.759345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:02.759349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:02.759355Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1929 [1:7556534718605598802:8157]
2025-10-02T08:14:02.759366Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:02.759383Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:02.759387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.759390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.759392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.759408Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:02.759414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:02.759425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:02.759492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.759501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.759504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:02.759507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:02.759569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:02.759579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.759592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.759604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:02.759623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605598792:8155], now have 1 active actors on pipe
2025-10-02T08:14:02.759630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534718605598796:8157]
2025-10-02T08:14:02.759631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1929
2025-10-02T08:14:02.759632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534718605598796:8157]
2025-10-02T08:14:02.759639Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:02.759647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534719065239058:2378], now have 1 active actors on pipe
2025-10-02T08:14:02.759649Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:02.759652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:02.759655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:02.759669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:02.759679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:02.759686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.759690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.759755Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1929
2025-10-02T08:14:02.759728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534718605598796:8157]
2025-10-02T08:14:02.759743Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:02.759749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:02.759759Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:02.759765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.759769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.759771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:02.759780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.759789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:02.759833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.759880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.759887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.759900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.759941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1930 partition: 0 MaxSeqNo: 17 sessionId: src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0
2025-10-02T08:14:02.760251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd9fc19-3af9ed79-dfac92a8-276c4d0c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:02.762875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0] Write session: try to update token
2025-10-02T08:14:02.762896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:02.777409Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:02.777427Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:02.777429Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:02.777438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534718605598796:8157]
2025-10-02T08:14:02.777442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534718605598796:8157]
2025-10-02T08:14:02.777480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:02.777488Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:02.777493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.777495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:02.777495Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:02.777622Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:02.778953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId: src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:02.781564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:02.826582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534718605598830:8716]
2025-10-02T08:14:02.826685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1929, pipe: [1:7556534718605598830:8716]
2025-10-02T08:14:02.919685Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:02.920080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.920095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.920137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605598830:8716], now have 1 active actors on pipe
2025-10-02T08:14:02.920274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534718605598830:8716]
2025-10-02T08:14:02.920385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:02.920395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:02.920410Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:02.920452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1930 reason: error at write: Disconnected sessionId: src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0
2025-10-02T08:14:02.920599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1930 sessionId: src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0 is DEAD
2025-10-02T08:14:02.920743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:02.920754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0] Write session will restart in 0.006979s
2025-10-02T08:14:02.920777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0] Write session: Do CDS request
2025-10-02T08:14:02.920822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:02.920440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:02.929246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.929284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:02.929298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1931
2025-10-02T08:14:02.929452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:02.929481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:02.929490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:02.929493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:02.930324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1931 sessionId:  describe result for acl check
2025-10-02T08:14:02.930355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:02.930359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:02.930361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:02.930365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534718605599078:8148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:02.930781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534718605599078:8148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:02.933993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534718605599078:8148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:02.937459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534718605599078:8148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:02.937477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534718605599078:8148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:02.937479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534718605599078:8148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:02.937488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:02.943567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:02.944136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:02.944281Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:02.944288Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:02.944294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:02.944325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:02.944353Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534718605599520:8132]
2025-10-02T08:14:02.944784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:02.944971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:02.945005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:02.945195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:02.945222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.945227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.945227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.945228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.945229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.945232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.945238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.945240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.945242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.945244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.945248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.945252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:02.945256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.945259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:02.945261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.945264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:02.945266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.945269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.945271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.945274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.945295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:02.953423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:02.954818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:02.954835Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:02.954837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:02.954839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:02.954844Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1930 [1:7556534718605599520:8132]
2025-10-02T08:14:02.954855Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:02.954869Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:02.954875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.954877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.954878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.954890Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:02.954894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:02.954899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:02.954948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.954954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.954956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:02.954959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:02.955007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:02.955018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.955029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:02.955041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:02.955057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534718605599514:8132]
2025-10-02T08:14:02.955059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534718605599514:8132]
2025-10-02T08:14:02.955067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:02.955080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:02.955083Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:02.955085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:02.955098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:02.955101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:02.955110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534718605599326:8148], now have 1 active actors on pipe
2025-10-02T08:14:02.955124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1930
2025-10-02T08:14:02.955146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534719065239066:2378], now have 1 active actors on pipe
2025-10-02T08:14:02.955152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534718605599514:8132]
2025-10-02T08:14:02.955159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:02.955170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:02.955173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.955176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.955187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1930
2025-10-02T08:14:02.955220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbb954-e3c21afd-97700056-e941b41d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:02.955231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:02.955235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:02.955237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:02.955245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:02.955258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:02.955285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.955324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:02.955330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:02.955342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:02.955379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1931 partition: 0 MaxSeqNo: 17 sessionId: src_id|bbb954-e3c21afd-97700056-e941b41d_0
2025-10-02T08:14:02.955734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f0cec7-60bda774-33d86302-82ea9d5f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bbb954-e3c21afd-97700056-e941b41d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:02.958378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb954-e3c21afd-97700056-e941b41d_0] Write session: try to update token
2025-10-02T08:14:02.958393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb954-e3c21afd-97700056-e941b41d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:02.972411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId: src_id|bbb954-e3c21afd-97700056-e941b41d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:02.972640Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:02.972655Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:02.972657Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:02.972665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534718605599514:8132]
2025-10-02T08:14:02.972669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534718605599514:8132]
2025-10-02T08:14:02.972710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:02.972719Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:02.972721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:02.972723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:02.972724Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:02.972890Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:02.974929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:03.020734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534722900566840:8716]
2025-10-02T08:14:03.020872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1930, pipe: [1:7556534722900566840:8716]
2025-10-02T08:14:03.105489Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:03.106052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.106068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.106106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900566840:8716], now have 1 active actors on pipe
2025-10-02T08:14:03.106214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:03.106235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:03.106301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1931 reason: error at write: Disconnected sessionId: src_id|bbb954-e3c21afd-97700056-e941b41d_0
2025-10-02T08:14:03.106328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:03.106466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1931 sessionId: src_id|bbb954-e3c21afd-97700056-e941b41d_0 is DEAD
2025-10-02T08:14:03.106609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb954-e3c21afd-97700056-e941b41d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:03.106619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb954-e3c21afd-97700056-e941b41d_0] Write session will restart in 0.006858s
2025-10-02T08:14:03.106643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb954-e3c21afd-97700056-e941b41d_0] Write session: Do CDS request
2025-10-02T08:14:03.106635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534722900566840:8716]
2025-10-02T08:14:03.106650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb954-e3c21afd-97700056-e941b41d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:03.107502Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:03.114273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb954-e3c21afd-97700056-e941b41d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.114307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:03.114320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1932
2025-10-02T08:14:03.114438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.114465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:03.114474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:03.114477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:03.114889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1932 sessionId:  describe result for acl check
2025-10-02T08:14:03.114921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:03.114923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:03.114924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:03.114937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534722900567216:8107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:03.115478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534722900567216:8107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:03.117974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534722900567216:8107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:03.124295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534722900567216:8107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:03.124312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534722900567216:8107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:03.124316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534722900567216:8107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:03.124325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:03.125947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:03.126631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:03.126800Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:03.126811Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:03.126821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:03.126864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:03.126903Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534722900567570:8108]
2025-10-02T08:14:03.127548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:03.127747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:03.127787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:03.128085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:03.128127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.128134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.128135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.128136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.128138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.128143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.128152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.128156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.128159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.128163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.128169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.128180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.128191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.128201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.128222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.128232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.128240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.128250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.128255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.128260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.128284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:03.135912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:03.137608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:03.137626Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:03.137628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:03.137632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:03.137638Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1931 [1:7556534722900567570:8108]
2025-10-02T08:14:03.137650Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:03.137667Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:03.137670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.137673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.137675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.137691Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:03.137700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:03.137707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:03.137764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.137773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.137776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:03.137779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:03.137844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:03.137853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.137866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.137879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:03.137897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1931
2025-10-02T08:14:03.137901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900567549:8107], now have 1 active actors on pipe
2025-10-02T08:14:03.137907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534722900567564:8108]
2025-10-02T08:14:03.137910Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534722900567564:8108]
2025-10-02T08:14:03.137927Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:03.137941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534723360206393:2378], now have 1 active actors on pipe
2025-10-02T08:14:03.137945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.137949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.137966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:03.137974Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:03.137978Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:03.137985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:03.137992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:03.137996Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1931
2025-10-02T08:14:03.138032Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:03.138043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.138047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.138049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:03.138056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.138064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:03.138076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534722900567564:8108]
2025-10-02T08:14:03.138088Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:03.138112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:03.138121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.138191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.138198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.138212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.138250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1932 partition: 0 MaxSeqNo: 17 sessionId: src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0
2025-10-02T08:14:03.138549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb954-e3c21afd-97700056-e941b41d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:03.141121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0] Write session: try to update token
2025-10-02T08:14:03.141140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:03.149912Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:03.149926Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:03.149933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534722900567564:8108]
2025-10-02T08:14:03.149967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:03.149980Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:03.150128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:03.150278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:03.150407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:03.150530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:03.150702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:03.150739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:03.154687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId: src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:03.157115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:03.157178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.157192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.157227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:03.157248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:03.157293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.157309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.157503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.157568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.157633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.157697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.158079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.158090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.158158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.158216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.158278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.158345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.158389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.158397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.158470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.158532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.158599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.158664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.158718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.158727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.158799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.158864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.158927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.158990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.159032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.159043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.159119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.159182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.159243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.159307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.159359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.159368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.159447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.159520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.159592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.159675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.159727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.159734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.159807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.159876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.159952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.160026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.160077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.160084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.160159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.160243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.160316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.160391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.160443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.160451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.160515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.160579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.160645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.160718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.160764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.160771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.160879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.160942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.161007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.161080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.161131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.161138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.161185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:03.161251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.161273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.161281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:03.161310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:03.161326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:03.161333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:03.161336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:03.161343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:03.161738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:03.161764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:03.161775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:03.161779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:03.161782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:03.161785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:03.162444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:03.162469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:03.162481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:03.162488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:03.162491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:03.162499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:03.163072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:03.163098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:03.163104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:03.163108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:03.163111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:03.170029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:03.170057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:03.170071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392843169
2025-10-02T08:14:03.170191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:03.170208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:03.170217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:03.170221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:03.170225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:03.170237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:03.170708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:03.170731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:03.170737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:03.170741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:03.170745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:03.170749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:03.171270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:03.171295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:03.171302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:03.171305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:03.171309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:03.171312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:03.171797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:03.171822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:03.171828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:03.172965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:03.172984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:03.172992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:03.172996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:03.173008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392843172
2025-10-02T08:14:03.173336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:03.173362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:03.173368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:03.173371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:03.173376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:03.173378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:03.173864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:03.173886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:03.173892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:03.173895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:03.173898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:03.173901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:03.174412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:03.174436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.174533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392843174
2025-10-02T08:14:03.175356Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:03.175378Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:03.175388Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:03.175396Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:03.177305Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:03.177319Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:03.177321Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:03.177331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534722900567564:8108]
2025-10-02T08:14:03.177338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534722900567564:8108]
2025-10-02T08:14:03.177399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:03.177399Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:03.177405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:03.177408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.177411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:03.177558Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:03.207012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534722900567602:8716]
2025-10-02T08:14:03.207167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1931, pipe: [1:7556534722900567602:8716]
2025-10-02T08:14:03.323685Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:03.324084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900567602:8716], now have 1 active actors on pipe
2025-10-02T08:14:03.324221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:03.324228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:03.324251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1932 reason: error at write: Disconnected sessionId: src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0
2025-10-02T08:14:03.324352Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:03.324345Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:03.324411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1932 sessionId: src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0 is DEAD
2025-10-02T08:14:03.324585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:03.324595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0] Write session will restart in 0.006014s
2025-10-02T08:14:03.324580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534722900567602:8716]
2025-10-02T08:14:03.324617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0] Write session: Do CDS request
2025-10-02T08:14:03.324623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:03.331218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.331301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:03.331315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1933
2025-10-02T08:14:03.331411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.331439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:03.331444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:03.331447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:03.331801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1933 sessionId:  describe result for acl check
2025-10-02T08:14:03.331831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:03.331833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:03.331835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:03.331839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534722900567965:8096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:03.332320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534722900567965:8096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:03.334601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534722900567965:8096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:03.337416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534722900567965:8096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:03.337430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534722900567965:8096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:03.337434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534722900567965:8096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:03.337441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:03.339694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:03.340513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:03.340639Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:03.340647Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:03.340653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:03.340683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:03.340711Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534722900568295:8097]
2025-10-02T08:14:03.341169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:03.341321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:03.341348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:03.341533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:03.341560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.341564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.341565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.341565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.341566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.341569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.341577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.341581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.341584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.341588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.341592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.341599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.341604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.341609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.341613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.341616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.341618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.341621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.341623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.341626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.341637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:03.349220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:03.350799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:03.350814Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:03.350816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:03.350819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:03.350823Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1932 [1:7556534722900568295:8097]
2025-10-02T08:14:03.350831Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:03.350844Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:03.350846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.350848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.350849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.350862Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:03.350866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:03.350877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:03.350934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.350940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.350942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:03.350944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:03.350990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:03.350996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.351003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.351010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:03.351025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534722900568289:8097]
2025-10-02T08:14:03.351030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534722900568289:8097]
2025-10-02T08:14:03.351036Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:03.351047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:03.351052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:03.351055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:03.351058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:03.351060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:03.351064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1932
2025-10-02T08:14:03.351068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900568248:8096], now have 1 active actors on pipe
2025-10-02T08:14:03.351072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534723360206402:2378], now have 1 active actors on pipe
2025-10-02T08:14:03.351101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.351111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.351123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534722900568289:8097]
2025-10-02T08:14:03.351134Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:03.351144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:03.351161Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:03.351170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.351173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.351176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:03.351185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.351158Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1932
2025-10-02T08:14:03.351198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:03.351222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.351260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.351265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.351274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.351305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1933 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0
2025-10-02T08:14:03.351588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93fd5dd-abb5b26b-d21773b7-bece379a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:03.354004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0] Write session: try to update token
2025-10-02T08:14:03.354022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:03.366751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId: src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:03.368459Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:03.368478Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:03.368480Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:03.368489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534722900568289:8097]
2025-10-02T08:14:03.368493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534722900568289:8097]
2025-10-02T08:14:03.368540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:03.368542Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:03.368547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:03.368551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.368553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:03.368690Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:03.369637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:03.424607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534722900568322:8716]
2025-10-02T08:14:03.424750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1932, pipe: [1:7556534722900568322:8716]
2025-10-02T08:14:03.506929Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:03.507198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.507214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.507255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900568322:8716], now have 1 active actors on pipe
2025-10-02T08:14:03.507376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534722900568322:8716]
2025-10-02T08:14:03.507402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:03.507405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:03.507477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1933 reason: error at write: Disconnected sessionId: src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0
2025-10-02T08:14:03.507540Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:03.507598Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:03.507643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1933 sessionId: src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0 is DEAD
2025-10-02T08:14:03.507818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:03.507829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0] Write session will restart in 0.008839s
2025-10-02T08:14:03.507854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0] Write session: Do CDS request
2025-10-02T08:14:03.507860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:03.518293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.518364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:03.518384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1934
2025-10-02T08:14:03.518491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.518516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:03.518521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:03.518524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:03.518958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1934 sessionId:  describe result for acl check
2025-10-02T08:14:03.518994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:03.518996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:03.518997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:03.519002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534722900568733:8075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:03.519465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534722900568733:8075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:03.521518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534722900568733:8075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:03.524360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534722900568733:8075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:03.524378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534722900568733:8075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:03.524381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534722900568733:8075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:03.524389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:03.529221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:03.529991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:03.530170Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:03.530178Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:03.530187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:03.530234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:03.530270Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534722900569018:8079]
2025-10-02T08:14:03.530844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:03.530999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:03.531037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:03.531337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:03.531423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.531432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.531433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.531434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.531435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.531440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.531450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.531462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.531471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.531475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.531482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.531489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.531495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.531505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.531513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.531518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.531522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.531532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.531537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.531547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.531575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:03.539443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:03.541200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:03.541214Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:03.541216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:03.541218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:03.541223Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1933 [1:7556534722900569018:8079]
2025-10-02T08:14:03.541232Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:03.541245Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:03.541247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.541249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.541250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.541265Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:03.541269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:03.541276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:03.541323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.541329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.541331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:03.541333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:03.541395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:03.541401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.541413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.541423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:03.541443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900568857:8075], now have 1 active actors on pipe
2025-10-02T08:14:03.541446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534723360206409:2378], now have 1 active actors on pipe
2025-10-02T08:14:03.541451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534722900569012:8079]
2025-10-02T08:14:03.541453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534722900569012:8079]
2025-10-02T08:14:03.541466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:03.541477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:03.541489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:03.541489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:03.541492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:03.541499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:03.541516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1933
2025-10-02T08:14:03.541533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534722900569012:8079]
2025-10-02T08:14:03.541540Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:03.541546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.541549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:03.541550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.541587Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:03.541598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.541601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.541603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:03.541611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.541624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:03.541613Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1933
2025-10-02T08:14:03.541648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.541679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.541685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.541697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.541730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1934 partition: 0 MaxSeqNo: 17 sessionId: src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0
2025-10-02T08:14:03.542009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d037f49-3c92ee2c-fa759c17-31875f2a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:03.544547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0] Write session: try to update token
2025-10-02T08:14:03.544561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:03.558597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId: src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:03.559631Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:03.559652Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:03.559655Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:03.559664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534722900569012:8079]
2025-10-02T08:14:03.559669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534722900569012:8079]
2025-10-02T08:14:03.559716Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:03.559718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:03.559723Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:03.559725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.559727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:03.559912Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:03.561552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:03.607398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534722900569043:8716]
2025-10-02T08:14:03.608234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1933, pipe: [1:7556534722900569043:8716]
2025-10-02T08:14:03.689296Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:03.689537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.689549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.689587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900569043:8716], now have 1 active actors on pipe
2025-10-02T08:14:03.689699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:03.689712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:03.689785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1934 reason: error at write: Disconnected sessionId: src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0
2025-10-02T08:14:03.689787Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:03.689943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1934 sessionId: src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0 is DEAD
2025-10-02T08:14:03.690178Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:03.690403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:03.690410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0] Write session will restart in 0.007084s
2025-10-02T08:14:03.690434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0] Write session: Do CDS request
2025-10-02T08:14:03.690440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:03.690076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534722900569043:8716]
2025-10-02T08:14:03.700986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.701255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:03.701272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1935
2025-10-02T08:14:03.701354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.701386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:03.701394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:03.701397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:03.701751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1935 sessionId:  describe result for acl check
2025-10-02T08:14:03.701787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:03.701794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:03.701795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:03.701801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534722900569543:8050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:03.702294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534722900569543:8050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:03.705210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534722900569543:8050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:03.708772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534722900569543:8050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:03.708789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534722900569543:8050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:03.708792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534722900569543:8050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:03.708816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:03.709187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:03.709531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:03.709796Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:03.709808Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:03.709818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:03.709878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:03.709915Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534722900569757:8070]
2025-10-02T08:14:03.710472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:03.710659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:03.710702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:03.710992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:03.711046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.711053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.711054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.711055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.711056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.711060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.711068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.711071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.711075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.711078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.711083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.711090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.711095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.711100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.711103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.711107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.711111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.711115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.711119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.711123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.711142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:03.720573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:03.722081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:03.722099Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:03.722101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:03.722104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:03.722108Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1934 [1:7556534722900569757:8070]
2025-10-02T08:14:03.722119Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:03.722134Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:03.722135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.722138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.722139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.722152Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:03.722156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:03.722161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:03.722209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.722215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.722217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:03.722219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:03.722270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:03.722275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.722284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.722291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:03.722309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534722900569751:8070]
2025-10-02T08:14:03.722315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534722900569751:8070]
2025-10-02T08:14:03.722324Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:03.722338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1934
2025-10-02T08:14:03.722340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900569748:8050], now have 1 active actors on pipe
2025-10-02T08:14:03.722343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:03.722347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:03.722348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:03.722360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:03.722362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:03.722367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534723360206427:2378], now have 1 active actors on pipe
2025-10-02T08:14:03.722396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.722403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.722414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534722900569751:8070]
2025-10-02T08:14:03.722424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:03.722436Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:03.722447Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:03.722452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.722454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.722455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:03.722461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.722469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:03.722450Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1934
2025-10-02T08:14:03.722501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.722550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.722556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.722568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.722605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1935 partition: 0 MaxSeqNo: 17 sessionId: src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0
2025-10-02T08:14:03.722884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f31d9b4-78eadfd6-f7fc597e-b7aea514_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:03.725547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0] Write session: try to update token
2025-10-02T08:14:03.725565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:03.740188Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:03.740225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:03.740228Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:03.740236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534722900569751:8070]
2025-10-02T08:14:03.740240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534722900569751:8070]
2025-10-02T08:14:03.740280Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:03.740283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:03.740290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.740293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:03.740293Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:03.740436Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:03.743148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId: src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:03.745739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:03.790181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534722900569784:8716]
2025-10-02T08:14:03.790312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1934, pipe: [1:7556534722900569784:8716]
2025-10-02T08:14:03.875515Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:03.876091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.876104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.876140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900569784:8716], now have 1 active actors on pipe
2025-10-02T08:14:03.876263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534722900569784:8716]
2025-10-02T08:14:03.876290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:03.876297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:03.876347Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:03.876354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1935 reason: error at write: Disconnected sessionId: src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0
2025-10-02T08:14:03.876396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:03.876509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1935 sessionId: src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0 is DEAD
2025-10-02T08:14:03.876819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:03.876829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0] Write session will restart in 0.007020s
2025-10-02T08:14:03.876853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0] Write session: Do CDS request
2025-10-02T08:14:03.876860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:03.885180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.885529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:03.885546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1936
2025-10-02T08:14:03.885647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:03.885678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:03.885684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:03.885692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:03.886174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1936 sessionId:  describe result for acl check
2025-10-02T08:14:03.886205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:03.886211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:03.886212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:03.886217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534722900570167:8037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:03.886712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534722900570167:8037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:03.891449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534722900570167:8037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:03.896364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534722900570167:8037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:03.896383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534722900570167:8037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:03.896386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534722900570167:8037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:03.896394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:03.899705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:03.900891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:03.901073Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:03.901082Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:03.901092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:03.901140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:03.901192Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534722900570484:8036]
2025-10-02T08:14:03.901886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:03.902103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:03.902155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:03.902470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:03.902511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.902517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.902519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.902520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.902521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.902526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.902535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.902540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.902544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.902548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.902554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.902562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:03.902568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.902578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:03.902582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.902587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:03.902593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.902597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.902606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.902611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.902634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:03.910831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:03.912564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:03.912589Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:03.912591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:03.912595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:03.912602Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1935 [1:7556534722900570484:8036]
2025-10-02T08:14:03.912614Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:03.912632Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:03.912636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.912638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.912640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.912657Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:03.912667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:03.912673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:03.912751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.912759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.912762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:03.912765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:03.912847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:03.912858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.912871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:03.912883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:03.912906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900570432:8037], now have 1 active actors on pipe
2025-10-02T08:14:03.912913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534723360206436:2378], now have 1 active actors on pipe
2025-10-02T08:14:03.912919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534722900570478:8036]
2025-10-02T08:14:03.912921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534722900570478:8036]
2025-10-02T08:14:03.912933Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:03.912949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:03.912962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:03.912962Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:03.912965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:03.912966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:03.912998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534722900570478:8036]
2025-10-02T08:14:03.913005Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:03.913010Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:03.913046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1935
2025-10-02T08:14:03.913052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.913056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.913079Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:03.913085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.913088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.913090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:03.913101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.913110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:03.913123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.913145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.913148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.913160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:03.913190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1936 partition: 0 MaxSeqNo: 17 sessionId: src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0
2025-10-02T08:14:03.913513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9eb5de-9bd73527-712c9c70-983ad0b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:03.913671Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1935
2025-10-02T08:14:03.916079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0] Write session: try to update token
2025-10-02T08:14:03.916092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:03.924614Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:03.924638Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:03.924647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534722900570478:8036]
2025-10-02T08:14:03.924692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:03.924691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:03.924901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:03.925063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:03.925216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:03.925370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:03.925579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:03.925632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:03.932222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId: src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:03.934704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:03.934774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.934786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.934821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:03.934845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:03.934889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:03.934904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:03.935076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.935137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.935204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.935272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.935568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.935581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.935651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.935714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.935776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.935847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.935890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.935900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.935972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.936031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.936094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.936157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.936239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.936246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.936314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.936383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.936453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.936528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.936585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.936597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.936690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.936782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.936893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.936990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.937045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.937053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.937131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.937202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.937279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.937352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.937404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.937411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.937487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.937559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.937632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.937707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.937756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.937764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.937846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.937915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.937986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.938058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.938110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.938117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.938192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.938251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.938311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.938377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.938427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.938433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.938504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:03.938565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:03.938626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:03.938693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:03.938742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:03.938748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:03.938786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:03.938848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:03.938870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:03.938876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:03.938906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:03.938923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:03.938930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:03.938933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:03.938936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:03.939379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:03.939415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:03.939422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:03.939433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:03.939436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:03.939439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:03.940137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:03.940162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:03.940169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:03.940171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:03.940175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:03.940177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:03.940751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:03.940774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:03.940780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:03.940783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:03.940786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:03.941982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:03.942000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:03.942014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392843941
2025-10-02T08:14:03.942132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:03.942157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:03.942165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:03.942168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:03.942172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:03.942175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:03.942732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:03.942756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:03.942766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:03.942769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:03.942772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:03.942775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:03.943259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:03.943282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:03.943289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:03.943296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:03.943299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:03.943302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:03.943743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:03.943766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:03.943771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:03.944830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:03.944844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:03.944850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:03.944852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:03.944859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392843944
2025-10-02T08:14:03.945138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:03.945158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:03.945164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:03.945171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:03.945174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:03.945177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:03.945650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:03.945679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:03.945692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:03.945695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:03.945698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:03.945701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:03.946168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:03.946190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:03.946282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392843946
2025-10-02T08:14:03.947041Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:03.947058Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:03.947063Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:03.947069Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:03.948733Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:03.948746Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:03.948747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:03.948756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534722900570478:8036]
2025-10-02T08:14:03.948761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534722900570478:8036]
2025-10-02T08:14:03.948827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:03.948833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:03.948837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:03.948838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:03.948842Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:03.948975Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:03.976545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534722900570516:8716]
2025-10-02T08:14:03.976660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1935, pipe: [1:7556534722900570516:8716]
2025-10-02T08:14:04.086184Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:04.086508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534722900570516:8716], now have 1 active actors on pipe
2025-10-02T08:14:04.086769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:04.087726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:04.087734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0] Write session will restart in 0.009621s
2025-10-02T08:14:04.087752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0] Write session: Do CDS request
2025-10-02T08:14:04.087756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:04.087037Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:04.087413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:04.087438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1936 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0
2025-10-02T08:14:04.087589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1936 sessionId: src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0 is DEAD
2025-10-02T08:14:04.087701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534722900570516:8716]
2025-10-02T08:14:04.098240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.098287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:04.098305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1937
2025-10-02T08:14:04.098407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.098434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:04.098442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:04.098445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:04.098858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1937 sessionId:  describe result for acl check
2025-10-02T08:14:04.098890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:04.098895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:04.098897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:04.098901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534727195538327:8009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:04.099547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534727195538327:8009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:04.102273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534727195538327:8009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:04.103810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:04.104574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:04.104732Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:04.104747Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:04.104756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:04.104830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:04.104871Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534727195538523:8008]
2025-10-02T08:14:04.105438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:04.105619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:04.105667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:04.105936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:04.105991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.105997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.105998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.105999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.106000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.106005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.106013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.106017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.106020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.106023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.106028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.106035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.106040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.106050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.106054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.106062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.106067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.106076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.106080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.106084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.106106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:04.106246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534727195538327:8009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:04.106257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534727195538327:8009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:04.106258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534727195538327:8009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:04.106264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:04.113726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:04.115639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:04.115656Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:04.115658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:04.115661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:04.115668Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1936 [1:7556534727195538523:8008]
2025-10-02T08:14:04.115678Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:04.115693Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:04.115696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.115698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.115700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.115714Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:04.115723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:04.115728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:04.115781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.115787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.115790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:04.115792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:04.115850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:04.115859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.115871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.115882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:04.115900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534727195538513:8008]
2025-10-02T08:14:04.115907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534727195538513:8008]
2025-10-02T08:14:04.115914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:04.115925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195538548:8009], now have 1 active actors on pipe
2025-10-02T08:14:04.115925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:04.115928Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:04.115933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1936
2025-10-02T08:14:04.115937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:04.115949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:04.115956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:04.115961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534727655173752:2378], now have 1 active actors on pipe
2025-10-02T08:14:04.115990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.115997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.116009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534727195538513:8008]
2025-10-02T08:14:04.116016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:04.116005Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1936
2025-10-02T08:14:04.116039Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:04.116040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:04.116049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.116052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.116054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:04.116061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.116074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:04.116104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.116146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.116153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.116164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.116195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1937 partition: 0 MaxSeqNo: 17 sessionId: src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0
2025-10-02T08:14:04.116518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10ec262f-a1991eb6-c67be46d-43e306ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:04.119099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0] Write session: try to update token
2025-10-02T08:14:04.119118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:04.132273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId: src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:04.133017Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:04.133034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:04.133036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:04.133045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534727195538513:8008]
2025-10-02T08:14:04.133053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534727195538513:8008]
2025-10-02T08:14:04.133093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:04.133105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.133107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:04.133175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:04.133193Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:04.133239Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:04.134801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:04.187970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534727195538576:8716]
2025-10-02T08:14:04.188076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1936, pipe: [1:7556534727195538576:8716]
2025-10-02T08:14:04.271522Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:04.272037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.272057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.272092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195538576:8716], now have 1 active actors on pipe
2025-10-02T08:14:04.272170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:04.272179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:04.272241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1937 reason: error at write: Disconnected sessionId: src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0
2025-10-02T08:14:04.272309Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:04.272331Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:04.272419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1937 sessionId: src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0 is DEAD
2025-10-02T08:14:04.272557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534727195538576:8716]
2025-10-02T08:14:04.272762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:04.272771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0] Write session will restart in 0.009025s
2025-10-02T08:14:04.272797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0] Write session: Do CDS request
2025-10-02T08:14:04.272820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:04.283282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.283411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:04.283428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1938
2025-10-02T08:14:04.283552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.283593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:04.283603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:04.283606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:04.283991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1938 sessionId:  describe result for acl check
2025-10-02T08:14:04.284028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:04.284034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:04.284036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:04.284042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534727195539069:7981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:04.284531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534727195539069:7981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:04.287175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534727195539069:7981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:04.289487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:04.290335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:04.290591Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:04.290605Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:04.290617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:04.290644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534727195539069:7981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:04.290655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534727195539069:7981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:04.290662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534727195539069:7981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:04.290670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:04.290678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:04.290710Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534727195539274:7980]
2025-10-02T08:14:04.291186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:04.291342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:04.291375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:04.291573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:04.291603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.291608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.291608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.291609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.291610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.291613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.291619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.291621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.291623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.291625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.291629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.291633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.291637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.291640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.291642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.291645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.291647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.291649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.291652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.291654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.291664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:04.299838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:04.301539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:04.301557Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:04.301558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:04.301561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:04.301566Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1937 [1:7556534727195539274:7980]
2025-10-02T08:14:04.301574Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:04.301588Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:04.301590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.301591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.301593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.301604Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:04.301606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:04.301611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:04.301660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.301666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.301669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:04.301671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:04.301731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:04.301740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.301754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.301769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:04.301791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195539279:7981], now have 1 active actors on pipe
2025-10-02T08:14:04.301792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1937
2025-10-02T08:14:04.301801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534727195539268:7980]
2025-10-02T08:14:04.301804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534727195539268:7980]
2025-10-02T08:14:04.301812Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:04.301823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:04.301823Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:04.301826Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:04.301840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:04.301850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:04.301856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534727655173771:2378], now have 1 active actors on pipe
2025-10-02T08:14:04.301862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.301870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.301912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534727195539268:7980]
2025-10-02T08:14:04.301926Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:04.301933Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:04.301940Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:04.301950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.301953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.301955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:04.301964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.301932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1937
2025-10-02T08:14:04.301976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:04.302010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.302110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.302122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.302154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.302198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1938 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0
2025-10-02T08:14:04.302518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be2ffb3e-3177abcf-9f6b2aaf-8e543c32_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:04.305143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0] Write session: try to update token
2025-10-02T08:14:04.305158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:04.319869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId: src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:04.320336Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:04.320356Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:04.320359Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:04.320368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534727195539268:7980]
2025-10-02T08:14:04.320373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534727195539268:7980]
2025-10-02T08:14:04.320417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:04.320426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:04.320429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.320431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:04.320432Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:04.320579Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:04.322536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:04.372826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534727195539305:8716]
2025-10-02T08:14:04.372958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1937, pipe: [1:7556534727195539305:8716]
2025-10-02T08:14:04.458857Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:04.459182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.459198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.459236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195539305:8716], now have 1 active actors on pipe
2025-10-02T08:14:04.459336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534727195539305:8716]
2025-10-02T08:14:04.459374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:04.459380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:04.459430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1938 reason: error at write: Disconnected sessionId: src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0
2025-10-02T08:14:04.459455Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:04.459590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1938 sessionId: src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0 is DEAD
2025-10-02T08:14:04.459739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:04.459746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0] Write session will restart in 0.009696s
2025-10-02T08:14:04.459770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0] Write session: Do CDS request
2025-10-02T08:14:04.459776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:04.459472Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:04.470267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.470327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:04.470343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1939
2025-10-02T08:14:04.470451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.470491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:04.470500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:04.470509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:04.470883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1939 sessionId:  describe result for acl check
2025-10-02T08:14:04.470913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:04.470918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:04.470919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:04.470924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534727195539794:7953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:04.471381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534727195539794:7953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:04.474360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534727195539794:7953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:04.477757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534727195539794:7953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:04.477772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534727195539794:7953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:04.477775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534727195539794:7953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:04.477783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:04.478284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:04.478656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:04.478815Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:04.478827Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:04.478838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:04.478895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:04.478945Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534727195540012:7955]
2025-10-02T08:14:04.479555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:04.479778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:04.479822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:04.480115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:04.480164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.480170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.480172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.480173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.480174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.480178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.480187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.480191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.480195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.480214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.480220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.480226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.480232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.480237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.480248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.480252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.480256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.480262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.480270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.480275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.480294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:04.488050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:04.489740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:04.489756Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:04.489759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:04.489762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:04.489769Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1938 [1:7556534727195540012:7955]
2025-10-02T08:14:04.489781Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:04.489798Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:04.489804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.489808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.489810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.489826Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:04.489834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:04.489840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:04.489901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.489907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.489910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:04.489913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:04.489972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:04.489983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.489995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.490006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:04.490024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195540003:7953], now have 1 active actors on pipe
2025-10-02T08:14:04.490027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534727655173777:2378], now have 1 active actors on pipe
2025-10-02T08:14:04.490033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534727195540006:7955]
2025-10-02T08:14:04.490035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534727195540006:7955]
2025-10-02T08:14:04.490037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1938
2025-10-02T08:14:04.490042Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:04.490052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:04.490053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:04.490063Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:04.490064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:04.490067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:04.490074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.490077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.490117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534727195540006:7955]
2025-10-02T08:14:04.490134Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:04.490139Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:04.490149Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:04.490161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.490168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.490170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:04.490179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.490150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1938
2025-10-02T08:14:04.490186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:04.490226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.490265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.490268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.490281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.490317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1939 partition: 0 MaxSeqNo: 17 sessionId: src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0
2025-10-02T08:14:04.490641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2077a4-3b1c5703-a6a2d793-471520b9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:04.493164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0] Write session: try to update token
2025-10-02T08:14:04.493179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:04.506543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId: src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:04.507320Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:04.507337Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:04.507339Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:04.507347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534727195540006:7955]
2025-10-02T08:14:04.507351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534727195540006:7955]
2025-10-02T08:14:04.507395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:04.507399Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:04.507404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.507404Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:04.507405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:04.507541Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:04.508951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:04.559678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534727195540040:8716]
2025-10-02T08:14:04.559806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1938, pipe: [1:7556534727195540040:8716]
2025-10-02T08:14:04.635826Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:04.636233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.636247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.636288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195540040:8716], now have 1 active actors on pipe
2025-10-02T08:14:04.636380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534727195540040:8716]
2025-10-02T08:14:04.636400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:04.636402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:04.636449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1939 reason: error at write: Disconnected sessionId: src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0
2025-10-02T08:14:04.636527Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:04.636881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:04.636515Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:04.636892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0] Write session will restart in 0.007350s
2025-10-02T08:14:04.636603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1939 sessionId: src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0 is DEAD
2025-10-02T08:14:04.636938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0] Write session: Do CDS request
2025-10-02T08:14:04.636953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:04.645253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.645354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:04.645373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1940
2025-10-02T08:14:04.645529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.645569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:04.645582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:04.645595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:04.646058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1940 sessionId:  describe result for acl check
2025-10-02T08:14:04.646087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:04.646093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:04.646094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:04.646098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534727195540421:7927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:04.646714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534727195540421:7927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:04.648954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534727195540421:7927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:04.652065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534727195540421:7927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:04.652079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534727195540421:7927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:04.652082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534727195540421:7927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:04.652089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:04.655680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:04.656619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:04.656773Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:04.656782Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:04.656790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:04.656848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:04.656884Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534727195540762:7928]
2025-10-02T08:14:04.657463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:04.657668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:04.657705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:04.657981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:04.658021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.658026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.658027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.658027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.658028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.658031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.658043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.658047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.658050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.658053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.658058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.658065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.658070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.658075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.658080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.658089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.658093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.658101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.658109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.658114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.658129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:04.666107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:04.667761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:04.667786Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:04.667789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:04.667793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:04.667800Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1939 [1:7556534727195540762:7928]
2025-10-02T08:14:04.667814Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:04.667832Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:04.667834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.667837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.667840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.667857Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:04.667861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:04.667868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:04.667933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.667942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.667945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:04.667948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:04.668020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:04.668031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.668045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.668056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:04.668071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195540673:7927], now have 1 active actors on pipe
2025-10-02T08:14:04.668083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534727195540756:7928]
2025-10-02T08:14:04.668084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1939
2025-10-02T08:14:04.668090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534727195540756:7928]
2025-10-02T08:14:04.668098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:04.668110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:04.668110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:04.668113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:04.668129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:04.668132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:04.668137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534727655173796:2378], now have 1 active actors on pipe
2025-10-02T08:14:04.668142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.668147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.668194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534727195540756:7928]
2025-10-02T08:14:04.668212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:04.668227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:04.668191Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1939
2025-10-02T08:14:04.668229Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4e5aea-a67ee607-37c64c11-f96388df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:04.668235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.668238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.668240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:04.668249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.668258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:04.668299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.668368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.668377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.668391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.668429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1940 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4e5aea-a67ee607-37c64c11-f96388df_0
2025-10-02T08:14:04.668758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c1562c2-4a09eaae-69da0569-94ab5895_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4e5aea-a67ee607-37c64c11-f96388df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:04.671615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e5aea-a67ee607-37c64c11-f96388df_0] Write session: try to update token
2025-10-02T08:14:04.671631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e5aea-a67ee607-37c64c11-f96388df_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:04.685302Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:04.685322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:04.685325Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:04.685333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534727195540756:7928]
2025-10-02T08:14:04.685338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534727195540756:7928]
2025-10-02T08:14:04.685378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:04.685383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.685385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:04.685401Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:04.685417Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:04.685542Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:04.686079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId: src_id|c4e5aea-a67ee607-37c64c11-f96388df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:04.688658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:04.736346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534727195540787:8716]
2025-10-02T08:14:04.736482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1939, pipe: [1:7556534727195540787:8716]
2025-10-02T08:14:04.823528Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:04.824283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.824300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.824338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195540787:8716], now have 1 active actors on pipe
2025-10-02T08:14:04.824435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:04.824463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:04.824526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1940 reason: error at write: Disconnected sessionId: src_id|c4e5aea-a67ee607-37c64c11-f96388df_0
2025-10-02T08:14:04.824552Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:04.824557Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:04.824707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1940 sessionId: src_id|c4e5aea-a67ee607-37c64c11-f96388df_0 is DEAD
2025-10-02T08:14:04.824857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e5aea-a67ee607-37c64c11-f96388df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:04.824866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e5aea-a67ee607-37c64c11-f96388df_0] Write session will restart in 0.006153s
2025-10-02T08:14:04.824883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e5aea-a67ee607-37c64c11-f96388df_0] Write session: Do CDS request
2025-10-02T08:14:04.824887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e5aea-a67ee607-37c64c11-f96388df_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:04.824893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534727195540787:8716]
2025-10-02T08:14:04.832237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e5aea-a67ee607-37c64c11-f96388df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.832331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:04.832346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1941
2025-10-02T08:14:04.832460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:04.832491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:04.832500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:04.832503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:04.832857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1941 sessionId:  describe result for acl check
2025-10-02T08:14:04.832886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:04.832887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:04.832888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:04.832891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534727195541163:7914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:04.833372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534727195541163:7914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:04.836039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534727195541163:7914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:04.839154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534727195541163:7914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:04.839172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534727195541163:7914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:04.839175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534727195541163:7914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:04.839181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:04.841674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:04.842657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:04.842800Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:04.842811Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:04.842819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:04.842856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:04.842887Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534727195541499:7916]
2025-10-02T08:14:04.843462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:04.843638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:04.843674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:04.843949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:04.843986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.843992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.843993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.843993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.843995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.843999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.844008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.844012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.844015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.844018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.844023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.844030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:04.844035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.844040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:04.844043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.844048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:04.844056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.844060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.844064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.844069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.844089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:04.851573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:04.853062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:04.853076Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:04.853077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:04.853080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:04.853085Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1940 [1:7556534727195541499:7916]
2025-10-02T08:14:04.853093Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:04.853106Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:04.853108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.853110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.853112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.853123Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:04.853126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:04.853130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:04.853173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.853180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.853183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:04.853184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:04.853234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:04.853240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.853249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:04.853255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:04.853265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534727195541493:7916]
2025-10-02T08:14:04.853267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534727195541493:7916]
2025-10-02T08:14:04.853272Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:04.853281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:04.853289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:04.853291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:04.853290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:04.853294Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:04.853298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195541449:7914], now have 1 active actors on pipe
2025-10-02T08:14:04.853308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1940
2025-10-02T08:14:04.853323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534727655173805:2378], now have 1 active actors on pipe
2025-10-02T08:14:04.853325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534727195541493:7916]
2025-10-02T08:14:04.853332Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:04.853340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.853342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:04.853343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.853372Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:04.853376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:04.853379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:04.853380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:04.853386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:04.853393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:04.853404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.853402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1940
2025-10-02T08:14:04.853451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:04.853456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:04.853464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:04.853494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1941 partition: 0 MaxSeqNo: 17 sessionId: src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0
2025-10-02T08:14:04.853776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4e5aea-a67ee607-37c64c11-f96388df_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:04.856289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0] Write session: try to update token
2025-10-02T08:14:04.856303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:04.868865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId: src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:04.869899Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:04.869914Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:04.869917Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:04.869924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534727195541493:7916]
2025-10-02T08:14:04.869927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534727195541493:7916]
2025-10-02T08:14:04.869965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:04.869971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:04.869976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:04.869976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:04.869978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:04.870097Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:04.871324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:04.925275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534727195541524:8716]
2025-10-02T08:14:04.925396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1940, pipe: [1:7556534727195541524:8716]
2025-10-02T08:14:05.000245Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:05.000821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.000838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.000877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534727195541524:8716], now have 1 active actors on pipe
2025-10-02T08:14:05.000987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:05.000994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:05.001045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1941 reason: error at write: Disconnected sessionId: src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0
2025-10-02T08:14:05.001045Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:05.001087Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:05.001219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1941 sessionId: src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0 is DEAD
2025-10-02T08:14:05.001382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:05.001390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0] Write session will restart in 0.007887s
2025-10-02T08:14:05.001412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0] Write session: Do CDS request
2025-10-02T08:14:05.001419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:05.001556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534727195541524:8716]
2025-10-02T08:14:05.010274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.010303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:05.010316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1942
2025-10-02T08:14:05.010468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.010500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:05.010504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:05.010507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:05.010834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1942 sessionId:  describe result for acl check
2025-10-02T08:14:05.010864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:05.010869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:05.010871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:05.010876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534731490509280:7893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:05.011247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534731490509280:7893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:05.013623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534731490509280:7893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:05.016070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534731490509280:7893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:05.016084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534731490509280:7893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:05.016087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534731490509280:7893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:05.016094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:05.018572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:05.018809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:05.018920Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:05.018926Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:05.018932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:05.018959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:05.018986Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534731490509542:7897]
2025-10-02T08:14:05.019382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:05.019499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:05.019524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:05.019705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:05.019730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.019734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.019735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.019735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.019736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.019739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.019745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.019747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.019749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.019751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.019754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.019759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.019762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.019765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.019767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.019770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.019772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.019774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.019777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.019779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.019788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:05.027353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:05.029089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:05.029103Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:05.029105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:05.029108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:05.029114Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1941 [1:7556534731490509542:7897]
2025-10-02T08:14:05.029125Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:05.029139Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:05.029142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.029145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.029147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.029160Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:05.029166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:05.029172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:05.029230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.029237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.029241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:05.029243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:05.029303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:05.029311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.029322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.029334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:05.029349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1941
2025-10-02T08:14:05.029353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490509521:7893], now have 1 active actors on pipe
2025-10-02T08:14:05.029358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534731490509536:7897]
2025-10-02T08:14:05.029360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534731490509536:7897]
2025-10-02T08:14:05.029372Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:05.029380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534731950141108:2378], now have 1 active actors on pipe
2025-10-02T08:14:05.029383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:05.029384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.029385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:05.029388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.029404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:05.029422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:05.029429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:05.029467Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:05.029477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.029480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.029482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:05.029446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1941
2025-10-02T08:14:05.029490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.029502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:05.029512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534731490509536:7897]
2025-10-02T08:14:05.029523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:05.029544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:05.029550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.029608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.029615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.029627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.029658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1942 partition: 0 MaxSeqNo: 17 sessionId: src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0
2025-10-02T08:14:05.029959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82448e93-57bdcd22-d47ffd63-68a89c82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:05.032449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0] Write session: try to update token
2025-10-02T08:14:05.032461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:05.045501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId: src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:05.047612Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:05.047633Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:05.047636Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:05.047646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534731490509536:7897]
2025-10-02T08:14:05.047650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534731490509536:7897]
2025-10-02T08:14:05.047694Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:05.047697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:05.047705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.047707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:05.047708Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:05.047891Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:05.048876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:05.101891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534731490509569:8716]
2025-10-02T08:14:05.102015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1941, pipe: [1:7556534731490509569:8716]
2025-10-02T08:14:05.177401Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:05.177654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.177667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.177702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490509569:8716], now have 1 active actors on pipe
2025-10-02T08:14:05.177794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534731490509569:8716]
2025-10-02T08:14:05.177815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:05.177818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:05.177868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1942 reason: error at write: Disconnected sessionId: src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0
2025-10-02T08:14:05.177939Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:05.178021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1942 sessionId: src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0 is DEAD
2025-10-02T08:14:05.178195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:05.178205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0] Write session will restart in 0.006101s
2025-10-02T08:14:05.178228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0] Write session: Do CDS request
2025-10-02T08:14:05.178233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:05.178209Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:05.185217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.185264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:05.185276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1943
2025-10-02T08:14:05.185408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.185432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:05.185440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:05.185442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:05.185843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1943 sessionId:  describe result for acl check
2025-10-02T08:14:05.185879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:05.185886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:05.185887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:05.185892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534731490509958:7873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:05.186340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534731490509958:7873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:05.188318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534731490509958:7873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:05.191313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534731490509958:7873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:05.191329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534731490509958:7873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:05.191332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534731490509958:7873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:05.191340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:05.196016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:05.196540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:05.196679Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:05.196685Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:05.196692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:05.196731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:05.196766Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534731490510319:7877]
2025-10-02T08:14:05.197188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:05.197410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:05.197471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:05.197776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:05.197832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.197838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.197838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.197839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.197840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.197844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.197853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.197856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.197860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.197863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.197868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.197875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.197881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.197886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.197890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.197894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.197897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.197902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.197906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.197910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.197926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:05.205834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:05.207649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:05.207667Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:05.207670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:05.207674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:05.207680Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1942 [1:7556534731490510319:7877]
2025-10-02T08:14:05.207692Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:05.207709Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:05.207718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.207721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.207723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.207737Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:05.207750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:05.207757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:05.207816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.207824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.207826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:05.207829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:05.207891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:05.207899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.207913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.207930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:05.207952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490510170:7873], now have 1 active actors on pipe
2025-10-02T08:14:05.207965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534731490510313:7877]
2025-10-02T08:14:05.207964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1942
2025-10-02T08:14:05.207971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534731490510313:7877]
2025-10-02T08:14:05.207983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:05.208000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:05.208000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:05.208010Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:05.208014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:05.208017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:05.208023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534731950141139:2378], now have 1 active actors on pipe
2025-10-02T08:14:05.208027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.208031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.208070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534731490510313:7877]
2025-10-02T08:14:05.208079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:05.208089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:05.208094Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:05.208105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.208070Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1942
2025-10-02T08:14:05.208110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.208116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:05.208127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.208136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:05.208182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.208277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.208286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.208300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.208334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1943 partition: 0 MaxSeqNo: 17 sessionId: src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0
2025-10-02T08:14:05.208625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eaf106e-75c7d45e-20536ae8-adef4638_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:05.211147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0] Write session: try to update token
2025-10-02T08:14:05.211161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:05.225267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId: src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:05.226169Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:05.226186Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:05.226189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:05.226197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534731490510313:7877]
2025-10-02T08:14:05.226201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534731490510313:7877]
2025-10-02T08:14:05.226250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:05.226257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.226260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:05.226271Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:05.226278Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:05.226399Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:05.227921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:05.278039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534731490510344:8716]
2025-10-02T08:14:05.278140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1942, pipe: [1:7556534731490510344:8716]
2025-10-02T08:14:05.363839Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:05.364260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.364274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.364314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490510344:8716], now have 1 active actors on pipe
2025-10-02T08:14:05.364444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534731490510344:8716]
2025-10-02T08:14:05.364472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:05.364475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:05.364521Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:05.364539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1943 reason: error at write: Disconnected sessionId: src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0
2025-10-02T08:14:05.364514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:05.364711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1943 sessionId: src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0 is DEAD
2025-10-02T08:14:05.364859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:05.364870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0] Write session will restart in 0.007349s
2025-10-02T08:14:05.364901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0] Write session: Do CDS request
2025-10-02T08:14:05.364906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:05.373185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.373262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:05.373280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1944
2025-10-02T08:14:05.373422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.373452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:05.373461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:05.373465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:05.373834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1944 sessionId:  describe result for acl check
2025-10-02T08:14:05.373873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:05.373879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:05.373881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:05.373885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534731490510754:7845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:05.374351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534731490510754:7845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:05.377135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534731490510754:7845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:05.380328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534731490510754:7845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:05.380345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534731490510754:7845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:05.380348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534731490510754:7845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:05.380356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:05.382761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:05.383151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:05.383296Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:05.383304Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:05.383312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:05.383352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:05.383389Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534731490511061:7839]
2025-10-02T08:14:05.384011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:05.384186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:05.384234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:05.384528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:05.384572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.384578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.384579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.384580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.384581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.384586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.384595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.384599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.384603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.384606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.384611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.384618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.384624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.384631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.384636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.384641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.384645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.384649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.384654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.384664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.384683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:05.392527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:05.394192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:05.394213Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:05.394218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:05.394222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:05.394228Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1943 [1:7556534731490511061:7839]
2025-10-02T08:14:05.394240Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:05.394258Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:05.394260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.394263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.394264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.394279Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:05.394284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:05.394290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:05.394352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.394361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.394363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:05.394366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:05.394427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:05.394434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.394447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.394462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:05.394480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534731490511055:7839]
2025-10-02T08:14:05.394486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534731490511055:7839]
2025-10-02T08:14:05.394495Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:05.394504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1943
2025-10-02T08:14:05.394508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490511040:7845], now have 1 active actors on pipe
2025-10-02T08:14:05.394516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:05.394517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:05.394521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:05.394529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:05.394532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:05.394565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534731950141145:2378], now have 1 active actors on pipe
2025-10-02T08:14:05.394569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.394574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.394586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534731490511055:7839]
2025-10-02T08:14:05.394589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:05.394615Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:05.394620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.394624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.394625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:05.394633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.394647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:05.394671Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:05.394672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.394738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.394746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.394758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.394796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1944 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0
2025-10-02T08:14:05.394750Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1943
2025-10-02T08:14:05.395090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc90dae-253a4c59-25f89ff3-6595d799_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:05.397767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0] Write session: try to update token
2025-10-02T08:14:05.397786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:05.411027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId: src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:05.412486Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:05.412502Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:05.412503Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:05.412509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534731490511055:7839]
2025-10-02T08:14:05.412512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534731490511055:7839]
2025-10-02T08:14:05.412545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:05.412555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.412556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:05.412559Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:05.412565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:05.412681Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:05.413556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:05.464409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534731490511086:8716]
2025-10-02T08:14:05.464536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1943, pipe: [1:7556534731490511086:8716]
2025-10-02T08:14:05.553267Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:05.554004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.554021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.554064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490511086:8716], now have 1 active actors on pipe
2025-10-02T08:14:05.554201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:05.554215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:05.554287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1944 reason: error at write: Disconnected sessionId: src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0
2025-10-02T08:14:05.554331Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:05.554379Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:05.554632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:05.554643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0] Write session will restart in 0.005968s
2025-10-02T08:14:05.554479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1944 sessionId: src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0 is DEAD
2025-10-02T08:14:05.554672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0] Write session: Do CDS request
2025-10-02T08:14:05.554630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534731490511086:8716]
2025-10-02T08:14:05.554695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:05.562251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.562303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:05.562318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1945
2025-10-02T08:14:05.562459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.562485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:05.562494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:05.562496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:05.562949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1945 sessionId:  describe result for acl check
2025-10-02T08:14:05.562974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:05.562975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:05.562976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:05.562980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534731490511471:7842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:05.563444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534731490511471:7842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:05.565920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534731490511471:7842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:05.568853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534731490511471:7842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:05.568867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534731490511471:7842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:05.568870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534731490511471:7842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:05.568877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:05.572591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:05.572917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:05.573053Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:05.573062Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:05.573071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:05.573109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:05.573136Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534731490511803:7843]
2025-10-02T08:14:05.573760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:05.573937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:05.573980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:05.574287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:05.574323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.574327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.574328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.574328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.574329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.574332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.574338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.574340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.574342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.574344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.574349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.574353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.574357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.574360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.574363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.574374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.574378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.574381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.574383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.574386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.574398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:05.582675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:05.584034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:05.584049Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:05.584051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:05.584053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:05.584058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1944 [1:7556534731490511803:7843]
2025-10-02T08:14:05.584067Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:05.584081Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:05.584082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.584085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.584087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.584098Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:05.584101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:05.584106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:05.584161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.584169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.584172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:05.584174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:05.584237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:05.584244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.584253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.584260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:05.584276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534731490511797:7843]
2025-10-02T08:14:05.584281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534731490511797:7843]
2025-10-02T08:14:05.584286Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:05.584297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490511753:7842], now have 1 active actors on pipe
2025-10-02T08:14:05.584298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1944
2025-10-02T08:14:05.584305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:05.584304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:05.584307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:05.584313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:05.584315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:05.584319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534731950141164:2378], now have 1 active actors on pipe
2025-10-02T08:14:05.584322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.584327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.584364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534731490511797:7843]
2025-10-02T08:14:05.584377Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:05.584396Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:05.584399Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:05.584406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.584409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.584411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:05.584418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.584431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:05.584425Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1944
2025-10-02T08:14:05.584466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.584536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.584544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.584557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.584593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1945 partition: 0 MaxSeqNo: 17 sessionId: src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0
2025-10-02T08:14:05.585015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b556ac2-47190e-3a1b8e2a-1767a691_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:05.594401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0] Write session: try to update token
2025-10-02T08:14:05.594419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:05.610882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId: src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:05.616609Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:05.616628Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:05.616630Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:05.616637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534731490511797:7843]
2025-10-02T08:14:05.616640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534731490511797:7843]
2025-10-02T08:14:05.616685Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:05.616699Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:05.617535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:05.617553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.617554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:05.617685Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:05.617922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:05.654882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534731490511840:8716]
2025-10-02T08:14:05.655039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1944, pipe: [1:7556534731490511840:8716]
2025-10-02T08:14:05.751275Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:05.751671Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:05.751679Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:05.751687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534731490511797:7843]
2025-10-02T08:14:05.751722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.751728Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:05.751732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.751747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490511840:8716], now have 1 active actors on pipe
2025-10-02T08:14:05.751874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534731490511840:8716]
2025-10-02T08:14:05.751876Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:05.751906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:05.751966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1945 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0
2025-10-02T08:14:05.751952Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:05.752141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1945 sessionId: src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0 is DEAD
2025-10-02T08:14:05.752301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:05.752309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0] Write session will restart in 0.008083s
2025-10-02T08:14:05.752325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0] Write session: Do CDS request
2025-10-02T08:14:05.752331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:05.761248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.761287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:05.761304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1946
2025-10-02T08:14:05.761447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.761479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:05.761488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:05.761492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:05.761888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1946 sessionId:  describe result for acl check
2025-10-02T08:14:05.761924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:05.761930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:05.761931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:05.761937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534731490512309:7827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:05.762414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534731490512309:7827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:05.764484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534731490512309:7827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:05.768333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534731490512309:7827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:05.768348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534731490512309:7827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:05.768352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534731490512309:7827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:05.768360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:05.770443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:05.770817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:05.770950Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:05.770957Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:05.770964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:05.770993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:05.771018Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534731490512562:7829]
2025-10-02T08:14:05.771417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:05.771594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:05.771629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:05.771850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:05.771883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.771887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.771888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.771888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.771889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.771893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.771899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.771901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.771903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.771905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.771909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.771913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.771917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.771920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.771922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.771924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.771928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.771931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.771933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.771936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.771946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:05.779929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:05.781696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:05.781719Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:05.781721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:05.781725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:05.781731Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1945 [1:7556534731490512562:7829]
2025-10-02T08:14:05.781742Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:05.781755Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:05.781758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.781761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.781763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.781777Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:05.781782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:05.781789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:05.781854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.781863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.781866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:05.781868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:05.781933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:05.781945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.781958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.781972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:05.781986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1945
2025-10-02T08:14:05.781993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490512544:7827], now have 1 active actors on pipe
2025-10-02T08:14:05.781997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534731950141172:2378], now have 1 active actors on pipe
2025-10-02T08:14:05.782003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534731490512556:7829]
2025-10-02T08:14:05.782005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534731490512556:7829]
2025-10-02T08:14:05.782020Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:05.782034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.782042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.782041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:05.782045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:05.782059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:05.782078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:05.782086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:05.782086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1945
2025-10-02T08:14:05.782126Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:05.782136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.782144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.782146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:05.782154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.782167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:05.782177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534731490512556:7829]
2025-10-02T08:14:05.782189Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:05.782194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:05.782219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.782265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.782275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.782288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.782325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1946 partition: 0 MaxSeqNo: 17 sessionId: src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0
2025-10-02T08:14:05.782627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abadd75-91c43b1d-25dd1e8d-cdea71e9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:05.785206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0] Write session: try to update token
2025-10-02T08:14:05.785222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:05.799121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId: src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:05.800722Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:05.800743Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:05.800745Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:05.800754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534731490512556:7829]
2025-10-02T08:14:05.800761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534731490512556:7829]
2025-10-02T08:14:05.800826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:05.800827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:05.800833Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:05.800837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.800840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:05.800976Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:05.801992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:05.852000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534731490512590:8716]
2025-10-02T08:14:05.852150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1945, pipe: [1:7556534731490512590:8716]
2025-10-02T08:14:05.951127Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:05.951515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.951534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.951572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490512590:8716], now have 1 active actors on pipe
2025-10-02T08:14:05.951645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534731490512590:8716]
2025-10-02T08:14:05.951665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:05.951676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:05.951731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1946 reason: error at write: Disconnected sessionId: src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0
2025-10-02T08:14:05.951801Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:05.951902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1946 sessionId: src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0 is DEAD
2025-10-02T08:14:05.952045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:05.952057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0] Write session will restart in 0.005630s
2025-10-02T08:14:05.952081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0] Write session: Do CDS request
2025-10-02T08:14:05.952091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:05.952911Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:05.959259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.959301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:05.959319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1947
2025-10-02T08:14:05.959458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:05.959490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:05.959500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:05.959503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:05.959908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1947 sessionId:  describe result for acl check
2025-10-02T08:14:05.959939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:05.959943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:05.959944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:05.959949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534731490512908:7814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:05.960347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534731490512908:7814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:05.962762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534731490512908:7814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:05.965558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534731490512908:7814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:05.965575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534731490512908:7814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:05.965579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534731490512908:7814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:05.965586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:05.971187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:05.971956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:05.972190Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:05.972201Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:05.972223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:05.972274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:05.972310Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534731490513312:7815]
2025-10-02T08:14:05.972991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:05.973211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:05.973252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:05.973560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:05.973623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.973630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.973631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.973632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.973634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.973638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.973648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.973652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.973656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.973660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.973665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.973673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:05.973679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.973687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:05.973696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.973702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:05.973711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.973717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.973728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.973733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.973759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:05.981686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:05.983125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:05.983146Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:05.983149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:05.983152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:05.983160Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1946 [1:7556534731490513312:7815]
2025-10-02T08:14:05.983171Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:05.983190Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:05.983198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.983201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.983204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.983218Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:05.983228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:05.983240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:05.983307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.983314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.983318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:05.983321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:05.983426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1946
2025-10-02T08:14:05.983516Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1946
2025-10-02T08:14:05.983763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:05.983774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:05.983788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:05.983803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:05.983824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534731490513152:7814], now have 1 active actors on pipe
2025-10-02T08:14:05.983832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534731950141179:2378], now have 1 active actors on pipe
2025-10-02T08:14:05.983837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.983842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.983865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534731490513306:7815]
2025-10-02T08:14:05.983873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534731490513306:7815]
2025-10-02T08:14:05.983885Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:05.983894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:05.983897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:05.983902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:05.983918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:05.983926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:05.983941Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:05.983951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:05.983956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:05.983962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:05.983970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:05.983984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:05.984021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534731490513306:7815]
2025-10-02T08:14:05.984033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:05.984040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:05.984048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.984147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:05.984155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:05.984170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:05.984218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1947 partition: 0 MaxSeqNo: 17 sessionId: src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0
2025-10-02T08:14:05.984563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0e4a3-fd1119a4-11357323-935e3bdb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:05.987184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0] Write session: try to update token
2025-10-02T08:14:05.987200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:06.001917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId: src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:06.002237Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:06.002251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:06.002253Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:06.002261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534731490513306:7815]
2025-10-02T08:14:06.002267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534731490513306:7815]
2025-10-02T08:14:06.002311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:06.002319Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:06.002324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.002325Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:06.002326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:06.002460Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:06.004410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:06.051707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534735785480635:8716]
2025-10-02T08:14:06.051839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1946, pipe: [1:7556534735785480635:8716]
2025-10-02T08:14:06.144274Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:06.144699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.144718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.144753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785480635:8716], now have 1 active actors on pipe
2025-10-02T08:14:06.144973Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:06.144990Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:06.145318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534735785480635:8716]
2025-10-02T08:14:06.145339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:06.145387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1947 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0
2025-10-02T08:14:06.145546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1947 sessionId: src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0 is DEAD
2025-10-02T08:14:06.145708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:06.145719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0] Write session will restart in 0.006922s
2025-10-02T08:14:06.145744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0] Write session: Do CDS request
2025-10-02T08:14:06.145751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:06.154305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.154327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:06.154344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1948
2025-10-02T08:14:06.154666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.154702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:06.154715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:06.154718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:06.155182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1948 sessionId:  describe result for acl check
2025-10-02T08:14:06.155212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:06.155220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:06.155221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:06.155226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534735785481020:7777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:06.155812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534735785481020:7777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:06.158555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534735785481020:7777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:06.161674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534735785481020:7777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:06.161693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534735785481020:7777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:06.161695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534735785481020:7777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:06.161703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:06.165854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:06.167221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:06.167427Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:06.167442Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:06.167452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:06.167497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:06.167534Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534735785481371:7786]
2025-10-02T08:14:06.168170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:06.168396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:06.168462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:06.168698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:06.168733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.168738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.168739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.168740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.168740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.168744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.168759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.168762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.168764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.168766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.168770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.168775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.168780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.168785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.168789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.168794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.168797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.168815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.168820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.168824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.168835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:06.176875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:06.178649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:06.178666Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:06.178669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:06.178673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:06.178679Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1947 [1:7556534735785481371:7786]
2025-10-02T08:14:06.178695Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:06.178714Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:06.178722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.178725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.178729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.178745Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:06.178756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:06.178762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:06.178820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.178827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.178830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:06.178833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:06.178899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:06.178906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.178920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.178932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:06.178953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534735785481365:7786]
2025-10-02T08:14:06.178960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534735785481365:7786]
2025-10-02T08:14:06.178968Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:06.178980Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:06.178989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534736245108482:2378], now have 1 active actors on pipe
2025-10-02T08:14:06.178994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:06.178995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:06.179007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:06.179010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:06.179015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785481276:7777], now have 1 active actors on pipe
2025-10-02T08:14:06.179027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1947
2025-10-02T08:14:06.179045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534735785481365:7786]
2025-10-02T08:14:06.179054Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:06.179066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:06.179092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1947
2025-10-02T08:14:06.179110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.179118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.179140Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:06.179151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.179155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.179157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:06.179164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.179173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:06.179187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.179221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.179228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.179240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.179268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1948 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0
2025-10-02T08:14:06.179588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78da533-7c4fb7a9-4514f8d1-13f6674_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:06.182241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0] Write session: try to update token
2025-10-02T08:14:06.182253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:06.189711Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:06.189732Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:06.189739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534735785481365:7786]
2025-10-02T08:14:06.189774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:06.189775Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:06.189942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:06.190089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:06.190228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:06.190369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:06.190563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:06.190601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:06.195732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId: src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:06.198735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:06.198798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.198811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.198841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:06.198860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:06.198903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.198916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.199051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.199115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.199182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.199243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.199825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.199837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.199897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.199949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.200005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.200075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.200119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.200129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.200199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.200271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.200327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.200380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.200423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.200428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.200487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.200544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.200601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.200657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.200698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.200703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.200765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.200850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.200908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.200964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.201005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.201011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.201072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.201137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.201195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.201257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.201304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.201309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.201368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.201421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.201479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.201547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.201592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.201600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.201664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.201719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.201777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.201842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.201889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.201894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.201955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.202011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.202071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.202138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.202260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.202265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.202330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:06.202388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:06.202444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:06.202502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:06.202543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:06.202548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:06.202579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:06.202636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.202653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.202658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:06.202684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:06.202701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:06.202703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:06.202705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:06.202707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:06.203048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:06.203069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:06.203076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:06.203080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:06.203081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:06.203084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:06.203539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:06.203562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:06.203568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:06.203571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:06.203573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:06.203576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:06.204004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:06.204025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:06.204029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:06.204031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:06.204035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:06.206080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:06.206103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:06.206117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392846205
2025-10-02T08:14:06.206217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:06.206230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:06.206235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:06.206241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:06.206244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:06.206246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:06.206814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:06.206834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:06.206842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:06.206845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:06.206851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:06.206855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:06.207285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:06.207306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:06.207314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:06.207316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:06.207321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:06.207323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:06.207711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:06.207728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:06.207731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:06.208689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:06.208707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:06.208711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:06.208713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:06.208719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392846208
2025-10-02T08:14:06.209008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:06.209035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:06.209041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:06.209044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:06.209047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:06.209051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:06.209445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:06.209465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:06.209471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:06.209473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:06.209475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:06.209477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:06.209892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:06.209908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.209976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392846209
2025-10-02T08:14:06.210658Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:06.210673Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:06.210677Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:06.210680Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:06.212226Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:06.212238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:06.212240Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:06.212246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534735785481365:7786]
2025-10-02T08:14:06.212250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534735785481365:7786]
2025-10-02T08:14:06.212305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:06.212309Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:06.212315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.212315Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:06.212317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:06.212448Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:06.245701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534735785481426:8716]
2025-10-02T08:14:06.245840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1947, pipe: [1:7556534735785481426:8716]
2025-10-02T08:14:06.346016Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:06.346339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785481426:8716], now have 1 active actors on pipe
2025-10-02T08:14:06.346464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534735785481426:8716]
2025-10-02T08:14:06.346482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:06.346484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:06.346505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1948 reason: error at write: Disconnected sessionId: src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0
2025-10-02T08:14:06.346593Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:06.346581Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:06.346661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1948 sessionId: src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0 is DEAD
2025-10-02T08:14:06.346784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:06.346796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0] Write session will restart in 0.009448s
2025-10-02T08:14:06.346820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0] Write session: Do CDS request
2025-10-02T08:14:06.346826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:06.357262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.357388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:06.357405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1949
2025-10-02T08:14:06.357530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.357569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:06.357578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:06.357582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:06.357992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1949 sessionId:  describe result for acl check
2025-10-02T08:14:06.358025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:06.358030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:06.358031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:06.358034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534735785481998:7749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:06.358476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534735785481998:7749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:06.360348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534735785481998:7749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:06.361941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:06.362764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:06.362901Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:06.362908Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:06.362916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:06.362958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:06.362994Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534735785482146:7748]
2025-10-02T08:14:06.363109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534735785481998:7749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:06.363121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534735785481998:7749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:06.363124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534735785481998:7749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:06.363131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:06.363418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:06.363533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:06.363559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:06.363751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:06.363781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.363786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.363786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.363787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.363787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.363790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.363796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.363798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.363800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.363802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.363806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.363815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.363820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.363822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.363825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.363827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.363829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.363832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.363838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.363841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.363852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:06.373787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:06.375148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:06.375166Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:06.375168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:06.375171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:06.375176Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1948 [1:7556534735785482146:7748]
2025-10-02T08:14:06.375183Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:06.375199Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:06.375201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.375203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.375204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.375216Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:06.375223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:06.375229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:06.375282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.375288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.375290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:06.375292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:06.375340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:06.375346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.375354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.375369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:06.375386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1948
2025-10-02T08:14:06.375391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785482151:7749], now have 1 active actors on pipe
2025-10-02T08:14:06.375397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534735785482139:7748]
2025-10-02T08:14:06.375399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534735785482139:7748]
2025-10-02T08:14:06.375409Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:06.375416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534736245108513:2378], now have 1 active actors on pipe
2025-10-02T08:14:06.375425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.375427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:06.375430Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:06.375433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.375449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:06.375466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:06.375473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:06.375512Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:06.375521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.375525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.375527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:06.375535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.375491Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1948
2025-10-02T08:14:06.375548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:06.375558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534735785482139:7748]
2025-10-02T08:14:06.375568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:06.375572Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:06.375590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.375633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.375640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.375655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.375687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1949 partition: 0 MaxSeqNo: 17 sessionId: src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0
2025-10-02T08:14:06.375982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0d8da4-3565947c-57b8608b-dcd089cd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:06.378407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0] Write session: try to update token
2025-10-02T08:14:06.378419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:06.390273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId: src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:06.392222Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:06.392238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:06.392240Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:06.392246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534735785482139:7748]
2025-10-02T08:14:06.392249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534735785482139:7748]
2025-10-02T08:14:06.392283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:06.392284Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:06.392288Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:06.392292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.392294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:06.392413Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:06.393109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:06.446431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534735785482180:8716]
2025-10-02T08:14:06.446526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1948, pipe: [1:7556534735785482180:8716]
2025-10-02T08:14:06.521517Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:06.522066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.522078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.522112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785482180:8716], now have 1 active actors on pipe
2025-10-02T08:14:06.522256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534735785482180:8716]
2025-10-02T08:14:06.522284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:06.522287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:06.522296Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:06.522347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1949 reason: error at write: Disconnected sessionId: src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0
2025-10-02T08:14:06.522353Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:06.522519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1949 sessionId: src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0 is DEAD
2025-10-02T08:14:06.522701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:06.522710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0] Write session will restart in 0.009941s
2025-10-02T08:14:06.522730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0] Write session: Do CDS request
2025-10-02T08:14:06.522734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:06.533235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.533281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:06.533297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1950
2025-10-02T08:14:06.533490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.533521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:06.533531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:06.533535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:06.533924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1950 sessionId:  describe result for acl check
2025-10-02T08:14:06.533956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:06.533957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:06.533958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:06.533962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534735785482738:7725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:06.534456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534735785482738:7725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:06.536757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534735785482738:7725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:06.540097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:06.540311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534735785482738:7725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:06.540324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534735785482738:7725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:06.540327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534735785482738:7725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:06.540333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:06.540471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:06.540625Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:06.540635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:06.540644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:06.540693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:06.540729Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534735785482907:7741]
2025-10-02T08:14:06.541321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:06.541495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:06.541544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:06.541844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:06.541882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.541887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.541888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.541889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.541890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.541895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.541904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.541912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.541920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.541923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.541928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.541935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.541940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.541945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.541949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.541953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.541958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.541962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.541971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.541978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.542000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:06.549664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:06.551537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:06.551551Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:06.551553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:06.551556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:06.551560Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1949 [1:7556534735785482907:7741]
2025-10-02T08:14:06.551569Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:06.551582Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:06.551583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.551586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.551587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.551598Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:06.551601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:06.551606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:06.551652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.551658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.551660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:06.551661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:06.551710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:06.551715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.551723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.551734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:06.551750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534735785482895:7741]
2025-10-02T08:14:06.551754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534735785482895:7741]
2025-10-02T08:14:06.551759Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:06.551770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:06.551781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:06.551782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1949
2025-10-02T08:14:06.551786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:06.551789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:06.551792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:06.551793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785482903:7725], now have 1 active actors on pipe
2025-10-02T08:14:06.551820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534736245108520:2378], now have 1 active actors on pipe
2025-10-02T08:14:06.551830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534735785482895:7741]
2025-10-02T08:14:06.551836Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:06.551842Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:06.551843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.551846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.551877Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64581778-521a61c5-64a90ab7-221cc26e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:06.551888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.551891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.551893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:06.551871Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1949
2025-10-02T08:14:06.551901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.551907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:06.551926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.551951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.551956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.551965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.551993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1950 partition: 0 MaxSeqNo: 17 sessionId: src_id|64581778-521a61c5-64a90ab7-221cc26e_0
2025-10-02T08:14:06.552263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|959fe91f-aa0e7fd6-ca2cdf1a-c22d1d67_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|64581778-521a61c5-64a90ab7-221cc26e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:06.554914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64581778-521a61c5-64a90ab7-221cc26e_0] Write session: try to update token
2025-10-02T08:14:06.554927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64581778-521a61c5-64a90ab7-221cc26e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:06.566950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId: src_id|64581778-521a61c5-64a90ab7-221cc26e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:06.568583Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:06.568598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:06.568600Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:06.568609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534735785482895:7741]
2025-10-02T08:14:06.568613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534735785482895:7741]
2025-10-02T08:14:06.568655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:06.568662Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:06.568669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:06.568676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.568677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:06.568817Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:06.569289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:06.622568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534735785482932:8716]
2025-10-02T08:14:06.622630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1949, pipe: [1:7556534735785482932:8716]
2025-10-02T08:14:06.700649Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:06.701163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.701180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.701218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785482932:8716], now have 1 active actors on pipe
2025-10-02T08:14:06.701421Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:06.701506Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:06.701811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534735785482932:8716]
2025-10-02T08:14:06.701836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:06.701887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1950 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64581778-521a61c5-64a90ab7-221cc26e_0
2025-10-02T08:14:06.702037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1950 sessionId: src_id|64581778-521a61c5-64a90ab7-221cc26e_0 is DEAD
2025-10-02T08:14:06.702172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64581778-521a61c5-64a90ab7-221cc26e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:06.702181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64581778-521a61c5-64a90ab7-221cc26e_0] Write session will restart in 0.005739s
2025-10-02T08:14:06.702199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64581778-521a61c5-64a90ab7-221cc26e_0] Write session: Do CDS request
2025-10-02T08:14:06.702203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64581778-521a61c5-64a90ab7-221cc26e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:06.709268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64581778-521a61c5-64a90ab7-221cc26e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.709287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:06.709303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1951
2025-10-02T08:14:06.709444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.709474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:06.709483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:06.709486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:06.709822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1951 sessionId:  describe result for acl check
2025-10-02T08:14:06.709847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:06.709848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:06.709849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:06.709852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534735785483301:7709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:06.710276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534735785483301:7709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:06.712681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534735785483301:7709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:06.715560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534735785483301:7709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:06.715579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534735785483301:7709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:06.715582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534735785483301:7709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:06.715590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:06.720645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:06.721726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:06.721916Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:06.721925Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:06.721935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:06.721988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:06.722023Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534735785483676:7715]
2025-10-02T08:14:06.722698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:06.722889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:06.722932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:06.723246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:06.723290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.723296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.723297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.723298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.723299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.723305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.723316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.723321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.723325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.723329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.723335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.723342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.723348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.723356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.723360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.723370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.723375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.723396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.723401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.723411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.723429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:06.731552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:06.733142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:06.733161Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:06.733164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:06.733167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:06.733176Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1950 [1:7556534735785483676:7715]
2025-10-02T08:14:06.733188Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:06.733213Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:06.733221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.733224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.733227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.733242Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:06.733252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:06.733258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:06.733328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.733338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.733342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:06.733345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:06.733415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:06.733425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.733440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.733454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:06.733473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785483519:7709], now have 1 active actors on pipe
2025-10-02T08:14:06.733472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1950
2025-10-02T08:14:06.733484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534735785483670:7715]
2025-10-02T08:14:06.733487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534735785483670:7715]
2025-10-02T08:14:06.733498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:06.733512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534736245108539:2378], now have 1 active actors on pipe
2025-10-02T08:14:06.733514Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:06.733518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:06.733522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.733526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.733544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:06.733565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:06.733572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:06.733614Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:06.733626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.733630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.733632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:06.733641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.733649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:06.733657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534735785483670:7715]
2025-10-02T08:14:06.733624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1950
2025-10-02T08:14:06.733672Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:06.733697Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:06.733698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.733785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.733793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.733806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.733843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1951 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0
2025-10-02T08:14:06.734199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64581778-521a61c5-64a90ab7-221cc26e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:06.736716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0] Write session: try to update token
2025-10-02T08:14:06.736734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:06.752091Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:06.752114Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:06.752121Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:06.752132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534735785483670:7715]
2025-10-02T08:14:06.752137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534735785483670:7715]
2025-10-02T08:14:06.752180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:06.752192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.752191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:06.752196Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:06.752196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:06.752533Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:06.753700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId: src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:06.755944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:06.801786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534735785483703:8716]
2025-10-02T08:14:06.801904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1950, pipe: [1:7556534735785483703:8716]
2025-10-02T08:14:06.890897Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:06.891680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.891695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.891734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785483703:8716], now have 1 active actors on pipe
2025-10-02T08:14:06.891862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534735785483703:8716]
2025-10-02T08:14:06.891885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:06.891887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:06.891941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1951 reason: error at write: Disconnected sessionId: src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0
2025-10-02T08:14:06.892000Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:06.891966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:06.892063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1951 sessionId: src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0 is DEAD
2025-10-02T08:14:06.892195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:06.892212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0] Write session will restart in 0.009002s
2025-10-02T08:14:06.892232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0] Write session: Do CDS request
2025-10-02T08:14:06.892236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:06.902250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.902306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:06.902318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1952
2025-10-02T08:14:06.902425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:06.902476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:06.902486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:06.902489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:06.902891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1952 sessionId:  describe result for acl check
2025-10-02T08:14:06.902918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:06.902924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:06.902925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:06.902930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534735785484171:7685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:06.903380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534735785484171:7685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:06.906443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534735785484171:7685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:06.909948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534735785484171:7685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:06.909964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534735785484171:7685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:06.909967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534735785484171:7685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:06.909974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:06.913038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:06.913368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:06.913523Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:06.913534Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:06.913543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:06.913588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:06.913630Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534735785484435:7686]
2025-10-02T08:14:06.914257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:06.914443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:06.914484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:06.914767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:06.914815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.914820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.914821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.914822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.914823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.914828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.914838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.914841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.914849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.914852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.914857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.914864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:06.914869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.914877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:06.914881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.914885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:06.914889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.914893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.914897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.914905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.914925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:06.926852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:06.928537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:06.928559Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:06.928562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:06.928566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:06.928573Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1951 [1:7556534735785484435:7686]
2025-10-02T08:14:06.928584Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:06.928602Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:06.928610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.928614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.928616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.928631Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:06.928636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:06.928643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:06.928709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.928717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.928720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:06.928723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:06.928790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:06.928817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.928830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:06.928844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:06.928863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785484414:7685], now have 1 active actors on pipe
2025-10-02T08:14:06.928871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1951
2025-10-02T08:14:06.928875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534735785484429:7686]
2025-10-02T08:14:06.928877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534735785484429:7686]
2025-10-02T08:14:06.928889Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:06.928900Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:06.928904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534736245108548:2378], now have 1 active actors on pipe
2025-10-02T08:14:06.928909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:06.928911Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:06.928923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:06.928926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:06.928933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.928944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.928987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534735785484429:7686]
2025-10-02T08:14:06.928995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:06.929000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:06.929010Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:06.928971Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1951
2025-10-02T08:14:06.929016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:06.929024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:06.929026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:06.929035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:06.929047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:06.929092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.929164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:06.929171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:06.929183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:06.929221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1952 partition: 0 MaxSeqNo: 17 sessionId: src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0
2025-10-02T08:14:06.929514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d4b091a-4d225e31-447da60c-bbe1c1c7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:06.931869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0] Write session: try to update token
2025-10-02T08:14:06.931885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:06.946259Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:06.946282Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:06.946284Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:06.946293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534735785484429:7686]
2025-10-02T08:14:06.946298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534735785484429:7686]
2025-10-02T08:14:06.946338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:06.946345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:06.946347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:06.946350Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:06.946356Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:06.946482Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:06.948935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId: src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:06.951242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:06.992218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534735785484460:8716]
2025-10-02T08:14:06.992351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1951, pipe: [1:7556534735785484460:8716]
2025-10-02T08:14:07.091853Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:07.092712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.092727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.092767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534735785484460:8716], now have 1 active actors on pipe
2025-10-02T08:14:07.092890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:07.092901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:07.092972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1952 reason: error at write: Disconnected sessionId: src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0
2025-10-02T08:14:07.093015Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:07.093082Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:07.093152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1952 sessionId: src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0 is DEAD
2025-10-02T08:14:07.093290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:07.093301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0] Write session will restart in 0.009796s
2025-10-02T08:14:07.093323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0] Write session: Do CDS request
2025-10-02T08:14:07.093329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:07.093322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534735785484460:8716]
2025-10-02T08:14:07.104400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.104497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:07.104516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1953
2025-10-02T08:14:07.104616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.104647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:07.104655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:07.104658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:07.105096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1953 sessionId:  describe result for acl check
2025-10-02T08:14:07.105133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:07.105139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:07.105141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:07.105146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534740080452263:7657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:07.105676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534740080452263:7657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:07.108516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534740080452263:7657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:07.111644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534740080452263:7657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:07.111659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534740080452263:7657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:07.111662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534740080452263:7657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:07.111670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:07.113809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:07.114256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:07.114426Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:07.114436Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:07.114446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:07.114494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:07.114535Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534740080452492:7660]
2025-10-02T08:14:07.115129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:07.115316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:07.115349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:07.115612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:07.115656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.115662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.115663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.115664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.115665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.115670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.115680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.115683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.115687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.115689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.115695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.115701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.115707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.115712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.115716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.115721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.115725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.115729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.115734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.115738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.115755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:07.124039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:07.125814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:07.125836Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:07.125839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:07.125843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:07.125849Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1952 [1:7556534740080452492:7660]
2025-10-02T08:14:07.125861Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:07.125879Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:07.125882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.125884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.125886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.125901Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:07.125907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:07.125914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:07.125981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.125991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.125994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:07.125996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:07.126061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:07.126068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.126081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.126098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:07.126116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080452475:7657], now have 1 active actors on pipe
2025-10-02T08:14:07.126124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534740080452486:7660]
2025-10-02T08:14:07.126125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534740080452486:7660]
2025-10-02T08:14:07.126131Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:07.126136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1952
2025-10-02T08:14:07.126141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:07.126149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:07.126151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:07.126152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:07.126153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:07.126158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534740540075851:2378], now have 1 active actors on pipe
2025-10-02T08:14:07.126161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.126167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.126208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534740080452486:7660]
2025-10-02T08:14:07.126220Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:07.126227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:07.126236Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:07.126242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.126245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.126247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:07.126255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.126236Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1952
2025-10-02T08:14:07.126269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:07.126312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.126382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.126388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.126401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.126435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1953 partition: 0 MaxSeqNo: 17 sessionId: src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0
2025-10-02T08:14:07.126712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faedd236-c0575946-8e54a61b-bb5ce41f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:07.129204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0] Write session: try to update token
2025-10-02T08:14:07.129220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:07.142572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId: src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:07.143429Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:07.143445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:07.143448Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:07.143457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534740080452486:7660]
2025-10-02T08:14:07.143461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534740080452486:7660]
2025-10-02T08:14:07.143502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:07.143513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.143518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:07.143521Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:07.143527Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:07.143675Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:07.144926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:07.227085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534740080452529:8716]
2025-10-02T08:14:07.229733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1952, pipe: [1:7556534740080452529:8716]
2025-10-02T08:14:07.271678Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:07.272092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.272103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.272142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080452529:8716], now have 1 active actors on pipe
2025-10-02T08:14:07.272334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:07.272346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:07.272360Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:07.272411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1953 reason: error at write: Disconnected sessionId: src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0
2025-10-02T08:14:07.272559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1953 sessionId: src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0 is DEAD
2025-10-02T08:14:07.272385Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:07.272641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534740080452529:8716]
2025-10-02T08:14:07.272879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:07.272890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0] Write session will restart in 0.005824s
2025-10-02T08:14:07.272913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0] Write session: Do CDS request
2025-10-02T08:14:07.272920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:07.280312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.280349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:07.280363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1954
2025-10-02T08:14:07.280499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.280541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:07.280551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:07.280554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:07.280978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1954 sessionId:  describe result for acl check
2025-10-02T08:14:07.281013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:07.281019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:07.281020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:07.281025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534740080452918:7587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:07.281410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534740080452918:7587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:07.283574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534740080452918:7587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:07.286626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534740080452918:7587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:07.286642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534740080452918:7587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:07.286645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534740080452918:7587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:07.286652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:07.293064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:07.293497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:07.293659Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:07.293669Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:07.293680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:07.293728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:07.293780Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534740080453286:7589]
2025-10-02T08:14:07.294230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:07.294410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:07.294453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:07.294666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:07.294704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.294709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.294710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.294712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.294713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.294718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.294728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.294732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.294739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.294743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.294749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.294760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.294769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.294777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.294782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.294790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.294795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.294803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.294812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.294822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.294850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:07.302569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:07.304099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:07.304115Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:07.304117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:07.304120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:07.304125Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1953 [1:7556534740080453286:7589]
2025-10-02T08:14:07.304136Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:07.304152Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:07.304154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.304157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.304159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.304174Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:07.304183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:07.304194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:07.304267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.304278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.304281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:07.304283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:07.304342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:07.304349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.304360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.304371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:07.304390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534740080453280:7589]
2025-10-02T08:14:07.304396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534740080453280:7589]
2025-10-02T08:14:07.304402Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:07.304414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080453176:7587], now have 1 active actors on pipe
2025-10-02T08:14:07.304414Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:07.304417Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:07.304423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534740540075883:2378], now have 1 active actors on pipe
2025-10-02T08:14:07.304423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1953
2025-10-02T08:14:07.304428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:07.304439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:07.304442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:07.304473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.304481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.304493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534740080453280:7589]
2025-10-02T08:14:07.304503Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:07.304519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:07.304524Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:07.304529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.304532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.304533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:07.304542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.304549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:07.304538Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1953
2025-10-02T08:14:07.304575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.304623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.304632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.304642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.304678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1954 partition: 0 MaxSeqNo: 17 sessionId: src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0
2025-10-02T08:14:07.305014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007f4d9-7870c7f5-b4509e15-e4cfc8a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:07.307548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0] Write session: try to update token
2025-10-02T08:14:07.307564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:07.321429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId: src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:07.322553Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:07.322575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:07.322578Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:07.322586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534740080453280:7589]
2025-10-02T08:14:07.322591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534740080453280:7589]
2025-10-02T08:14:07.322639Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:07.322641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:07.322647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.322650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:07.322652Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:07.322903Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:07.324190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:07.372580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534740080453310:8716]
2025-10-02T08:14:07.372729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1953, pipe: [1:7556534740080453310:8716]
2025-10-02T08:14:07.457433Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:07.457979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.457991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.458023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080453310:8716], now have 1 active actors on pipe
2025-10-02T08:14:07.458105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:07.458112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:07.458147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1954 reason: error at write: Disconnected sessionId: src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0
2025-10-02T08:14:07.458247Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:07.458284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1954 sessionId: src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0 is DEAD
2025-10-02T08:14:07.458329Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:07.458453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:07.458462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0] Write session will restart in 0.006497s
2025-10-02T08:14:07.458486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0] Write session: Do CDS request
2025-10-02T08:14:07.458492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:07.458572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534740080453310:8716]
2025-10-02T08:14:07.466272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.466302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:07.466318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1955
2025-10-02T08:14:07.466503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.466542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:07.466551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:07.466554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:07.466967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1955 sessionId:  describe result for acl check
2025-10-02T08:14:07.466995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:07.466997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:07.466998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:07.467003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534740080453696:7566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:07.467548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534740080453696:7566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:07.470055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534740080453696:7566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:07.472878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534740080453696:7566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:07.472891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534740080453696:7566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:07.472894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534740080453696:7566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:07.472901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:07.475967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:07.477093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:07.477342Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:07.477354Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:07.477365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:07.477421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:07.477453Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534740080454049:7577]
2025-10-02T08:14:07.478045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:07.478239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:07.478282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:07.478581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:07.478627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.478633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.478633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.478634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.478635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.478638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.478644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.478646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.478649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.478651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.478654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.478659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.478664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.478666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.478669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.478671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.478673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.478676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.478679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.478681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.478691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:07.486522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:07.487963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:07.487978Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:07.487981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:07.487985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:07.487991Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1954 [1:7556534740080454049:7577]
2025-10-02T08:14:07.488003Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:07.488020Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:07.488023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.488026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.488028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.488043Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:07.488048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:07.488054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:07.488114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.488121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.488125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:07.488127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:07.488191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:07.488198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.488219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.488236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:07.488238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1954
2025-10-02T08:14:07.488259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080453974:7566], now have 1 active actors on pipe
2025-10-02T08:14:07.488266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534740540075890:2378], now have 1 active actors on pipe
2025-10-02T08:14:07.488271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.488275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.488292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534740080454043:7577]
2025-10-02T08:14:07.488298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534740080454043:7577]
2025-10-02T08:14:07.488313Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:07.488329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:07.488344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:07.488346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:07.488350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:07.488354Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:07.488363Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:07.488369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.488373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.488374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:07.488383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.488396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:07.488377Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1954
2025-10-02T08:14:07.488432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534740080454043:7577]
2025-10-02T08:14:07.488444Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:07.488454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.488468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:07.488498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.488504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.488517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.488553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1955 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0
2025-10-02T08:14:07.488928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5f7d51f-ef72ceab-d68a2bc9-d6b2d6b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:07.491550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0] Write session: try to update token
2025-10-02T08:14:07.491566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:07.500086Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:07.500109Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:07.500117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534740080454043:7577]
2025-10-02T08:14:07.500171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:07.500179Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:07.500356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:07.500507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:07.500648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:07.500787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:07.501069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:07.501113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:07.504268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId: src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:07.506669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:07.506723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.506732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.506756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:07.506771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:07.506808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.506825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.506977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.507035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.507097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.507164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.507737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.507748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.507816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.507880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.507943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.508009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.508050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.508056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.508127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.508188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.508263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.508330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.508377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.508384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.508453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.508517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.508581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.508650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.508709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.508715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.508785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.508864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.508929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.508994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.509037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.509044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.509146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.509264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.509330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.509403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.509449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.509455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.509521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.509585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.509652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.509714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.509774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.509783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.509849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.509908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.509971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.510041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.510085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.510091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.510158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.510229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.510335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.510454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.510504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.510510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.510613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:07.510679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:07.510744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:07.510815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:07.510867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:07.510877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:07.510924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:07.510994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.511020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.511023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:07.511055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:07.511073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:07.511080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:07.511083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:07.511086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:07.511486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:07.511512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:07.511523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:07.511530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:07.511533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:07.511537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:07.512319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:07.512345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:07.512351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:07.512355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:07.512358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:07.512361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:07.512997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:07.513021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:07.513028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:07.513034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:07.513037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:07.515336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:07.515356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:07.515366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392847514
2025-10-02T08:14:07.515546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:07.515559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:07.515565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:07.515569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:07.515571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:07.515573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:07.516126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:07.516156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:07.516167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:07.516171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:07.516177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:07.516181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:07.516679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:07.516702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:07.516710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:07.516712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:07.516714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:07.516716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:07.517178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:07.517199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:07.517203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:07.518230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:07.518245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:07.518249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:07.518251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:07.518257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392847517
2025-10-02T08:14:07.518530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:07.518550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:07.518557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:07.518566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:07.518570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:07.518573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:07.519011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:07.519033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:07.519037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:07.519039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:07.519041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:07.519043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:07.519478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:07.519494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.519573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392847519
2025-10-02T08:14:07.520327Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:07.520347Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:07.520354Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:07.520360Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:07.522070Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:07.522086Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:07.522087Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:07.522095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534740080454043:7577]
2025-10-02T08:14:07.522099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534740080454043:7577]
2025-10-02T08:14:07.522147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:07.522154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.522155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:07.522153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:07.522180Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:07.522284Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:07.558997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534740080454080:8716]
2025-10-02T08:14:07.559104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1954, pipe: [1:7556534740080454080:8716]
2025-10-02T08:14:07.660137Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:07.660542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080454080:8716], now have 1 active actors on pipe
2025-10-02T08:14:07.660669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534740080454080:8716]
2025-10-02T08:14:07.660846Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:07.660879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:07.661246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:07.661287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1955 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0
2025-10-02T08:14:07.661448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1955 sessionId: src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0 is DEAD
2025-10-02T08:14:07.661593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:07.661604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0] Write session will restart in 0.006380s
2025-10-02T08:14:07.661626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0] Write session: Do CDS request
2025-10-02T08:14:07.661633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:07.669261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.669292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:07.669308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1956
2025-10-02T08:14:07.669461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.669495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:07.669503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:07.669507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:07.670162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1956 sessionId:  describe result for acl check
2025-10-02T08:14:07.670198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:07.670203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:07.670205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:07.670210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534740080454340:7541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:07.670642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534740080454340:7541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:07.673142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534740080454340:7541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:07.676191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534740080454340:7541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:07.676225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534740080454340:7541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:07.676229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534740080454340:7541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:07.676236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:07.682970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:07.684093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:07.684302Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:07.684311Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:07.684318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:07.684358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:07.684394Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534740080454834:7543]
2025-10-02T08:14:07.684828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:07.684984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:07.685016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:07.685207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:07.685235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.685239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.685240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.685241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.685241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.685244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.685251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.685253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.685255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.685257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.685260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.685264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.685268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.685271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.685273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.685276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.685279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.685282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.685284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.685287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.685296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:07.692659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:07.694440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:07.694456Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:07.694459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:07.694462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:07.694469Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1955 [1:7556534740080454834:7543]
2025-10-02T08:14:07.694480Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:07.694497Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:07.694503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.694506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.694508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.694522Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:07.694531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:07.694536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:07.694596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.694604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.694607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:07.694609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:07.694677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:07.694684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.694696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.694705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:07.694724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534740080454828:7543]
2025-10-02T08:14:07.694730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534740080454828:7543]
2025-10-02T08:14:07.694736Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:07.694750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080454592:7541], now have 1 active actors on pipe
2025-10-02T08:14:07.694750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1955
2025-10-02T08:14:07.694754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:07.694757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:07.694757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:07.694768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:07.694771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:07.694777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534740540075909:2378], now have 1 active actors on pipe
2025-10-02T08:14:07.694787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.694790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.694830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534740080454828:7543]
2025-10-02T08:14:07.694841Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:07.694857Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:07.694859Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ac506a2-11936488-872768bd-74ada613_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:07.694865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.694868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.694870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:07.694879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.694855Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1955
2025-10-02T08:14:07.694887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:07.694924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.694973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.694979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.694991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.695027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1956 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ac506a2-11936488-872768bd-74ada613_0
2025-10-02T08:14:07.695342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e20bc4-818750d3-ce0e8e42-8873304f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ac506a2-11936488-872768bd-74ada613_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:07.698121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac506a2-11936488-872768bd-74ada613_0] Write session: try to update token
2025-10-02T08:14:07.698137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac506a2-11936488-872768bd-74ada613_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:07.712507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId: src_id|2ac506a2-11936488-872768bd-74ada613_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:07.712537Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:07.712542Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:07.712544Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:07.712553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534740080454828:7543]
2025-10-02T08:14:07.712558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534740080454828:7543]
2025-10-02T08:14:07.712602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:07.712607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.712609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:07.712704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:07.712719Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:07.712741Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:07.715119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:07.760713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534740080454858:8716]
2025-10-02T08:14:07.760911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1955, pipe: [1:7556534740080454858:8716]
2025-10-02T08:14:07.849965Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:07.850434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.850453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.850498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080454858:8716], now have 1 active actors on pipe
2025-10-02T08:14:07.850605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:07.850614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:07.850675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1956 reason: error at write: Disconnected sessionId: src_id|2ac506a2-11936488-872768bd-74ada613_0
2025-10-02T08:14:07.850718Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:07.850749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:07.850846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1956 sessionId: src_id|2ac506a2-11936488-872768bd-74ada613_0 is DEAD
2025-10-02T08:14:07.850991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac506a2-11936488-872768bd-74ada613_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:07.851002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac506a2-11936488-872768bd-74ada613_0] Write session will restart in 0.009023s
2025-10-02T08:14:07.851026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac506a2-11936488-872768bd-74ada613_0] Write session: Do CDS request
2025-10-02T08:14:07.851033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac506a2-11936488-872768bd-74ada613_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:07.851159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534740080454858:8716]
2025-10-02T08:14:07.861213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac506a2-11936488-872768bd-74ada613_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.861501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:07.861517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1957
2025-10-02T08:14:07.861623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:07.861652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:07.861660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:07.861663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:07.862136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1957 sessionId:  describe result for acl check
2025-10-02T08:14:07.862167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:07.862168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:07.862170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:07.862174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534740080455314:7532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:07.862656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534740080455314:7532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:07.864775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534740080455314:7532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:07.867549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534740080455314:7532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:07.867566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534740080455314:7532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:07.867569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534740080455314:7532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:07.867577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:07.872587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:07.874081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:07.874256Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:07.874264Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:07.874273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:07.874321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:07.874366Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534740080455602:7536]
2025-10-02T08:14:07.874841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:07.875006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:07.875043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:07.875378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:07.875431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.875436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.875437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.875437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.875438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.875441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.875448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.875450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.875452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.875454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.875458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.875462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:07.875466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.875469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:07.875472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.875475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:07.875477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.875480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.875482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.875485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.875497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:07.883132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:07.884496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:07.884515Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:07.884518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:07.884521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:07.884528Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1956 [1:7556534740080455602:7536]
2025-10-02T08:14:07.884541Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:07.884559Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:07.884565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.884568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.884570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.884586Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:07.884595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:07.884601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:07.884652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.884661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.884664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:07.884667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:07.884721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:07.884727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.884741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:07.884756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:07.884773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534740080455596:7536]
2025-10-02T08:14:07.884778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534740080455596:7536]
2025-10-02T08:14:07.884786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:07.884799Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:07.884820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080455483:7532], now have 1 active actors on pipe
2025-10-02T08:14:07.884824Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:07.884825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1956
2025-10-02T08:14:07.884829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:07.884842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:07.884849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:07.884856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534740540075918:2378], now have 1 active actors on pipe
2025-10-02T08:14:07.884884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.884892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.884905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534740080455596:7536]
2025-10-02T08:14:07.884912Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:07.884891Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1956
2025-10-02T08:14:07.884928Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:07.884935Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:07.884941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:07.884945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:07.884947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:07.884957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:07.884969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:07.885000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.885043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:07.885048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:07.885060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:07.885097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1957 partition: 0 MaxSeqNo: 17 sessionId: src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0
2025-10-02T08:14:07.885447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac506a2-11936488-872768bd-74ada613_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:07.888015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0] Write session: try to update token
2025-10-02T08:14:07.888031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:07.901791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId: src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:07.902930Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:07.902947Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:07.902949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:07.902957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534740080455596:7536]
2025-10-02T08:14:07.902962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534740080455596:7536]
2025-10-02T08:14:07.903000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:07.903011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:07.903013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:07.903016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:07.903022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:07.903138Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:07.904270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:07.951184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534740080455627:8716]
2025-10-02T08:14:07.951287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1956, pipe: [1:7556534740080455627:8716]
2025-10-02T08:14:08.031022Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:08.031434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.031446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.031475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534740080455627:8716], now have 1 active actors on pipe
2025-10-02T08:14:08.031572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534740080455627:8716]
2025-10-02T08:14:08.031594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:08.031600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:08.031651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1957 reason: error at write: Disconnected sessionId: src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0
2025-10-02T08:14:08.031699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:08.031786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1957 sessionId: src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0 is DEAD
2025-10-02T08:14:08.031897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:08.031890Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:08.031904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0] Write session will restart in 0.009646s
2025-10-02T08:14:08.031922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0] Write session: Do CDS request
2025-10-02T08:14:08.031926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:08.042260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.042330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:08.042349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1958
2025-10-02T08:14:08.042452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.042480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:08.042489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:08.042492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:08.042843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1958 sessionId:  describe result for acl check
2025-10-02T08:14:08.042888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:08.042894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:08.042895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:08.042900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534744375423405:7497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:08.043386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534744375423405:7497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:08.045579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534744375423405:7497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:08.048830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534744375423405:7497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:08.048844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534744375423405:7497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:08.048847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534744375423405:7497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:08.048855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:08.051386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:08.051715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:08.051867Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:08.051877Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:08.051885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:08.051925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:08.051957Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534744375423667:7505]
2025-10-02T08:14:08.052453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:08.052601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:08.052638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:08.052921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:08.052962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.052968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.052969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.052970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.052971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.052976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.052986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.052990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.052993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.053000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.053005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.053016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.053025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.053034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.053042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.053051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.053059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.053064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.053069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.053077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.053098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:08.060993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:08.062501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:08.062516Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:08.062518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:08.062521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:08.062525Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1957 [1:7556534744375423667:7505]
2025-10-02T08:14:08.062533Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:08.062547Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:08.062549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.062551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.062552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.062566Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:08.062571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:08.062578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:08.062627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.062634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.062636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:08.062638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:08.062684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:08.062690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.062698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.062704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:08.062721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534744375423661:7505]
2025-10-02T08:14:08.062723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534744375423661:7505]
2025-10-02T08:14:08.062728Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:08.062737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:08.062741Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:08.062745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:08.062751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:08.062759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:08.062783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1957
2025-10-02T08:14:08.062798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375423646:7497], now have 1 active actors on pipe
2025-10-02T08:14:08.062805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534744835043221:2378], now have 1 active actors on pipe
2025-10-02T08:14:08.062808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534744375423661:7505]
2025-10-02T08:14:08.062814Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:08.062825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.062826Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:08.062833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.062868Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:08.062876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.062878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.062880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:08.062886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.062837Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1957
2025-10-02T08:14:08.062892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:08.062908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.062939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.062946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.062958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.062991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1958 partition: 0 MaxSeqNo: 17 sessionId: src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0
2025-10-02T08:14:08.063302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f8604e2-91458bf0-271f2587-9a8ea0b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:08.065953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0] Write session: try to update token
2025-10-02T08:14:08.065970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:08.079748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId: src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:08.080120Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:08.080133Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:08.080135Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:08.080141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534744375423661:7505]
2025-10-02T08:14:08.080144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534744375423661:7505]
2025-10-02T08:14:08.080182Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:08.080185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:08.080190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.080193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:08.080194Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:08.080336Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:08.082238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:08.131915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534744375423692:8716]
2025-10-02T08:14:08.132001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1957, pipe: [1:7556534744375423692:8716]
2025-10-02T08:14:08.214922Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:08.215281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.215294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.215324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375423692:8716], now have 1 active actors on pipe
2025-10-02T08:14:08.215451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:08.215462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:08.215484Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:08.215517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1958 reason: error at write: Disconnected sessionId: src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0
2025-10-02T08:14:08.215566Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:08.215669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1958 sessionId: src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0 is DEAD
2025-10-02T08:14:08.215719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534744375423692:8716]
2025-10-02T08:14:08.215839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:08.215849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0] Write session will restart in 0.009033s
2025-10-02T08:14:08.215872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0] Write session: Do CDS request
2025-10-02T08:14:08.215879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:08.226231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.226290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:08.226310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1959
2025-10-02T08:14:08.226424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.226453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:08.226462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:08.226465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:08.227018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1959 sessionId:  describe result for acl check
2025-10-02T08:14:08.227053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:08.227059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:08.227060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:08.227065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534744375424165:7477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:08.227590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534744375424165:7477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:08.229933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534744375424165:7477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:08.233459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534744375424165:7477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:08.233475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534744375424165:7477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:08.233478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534744375424165:7477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:08.233485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:08.236308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:08.236640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:08.236846Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:08.236856Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:08.236868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:08.236918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:08.236954Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534744375424449:7487]
2025-10-02T08:14:08.237568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:08.237820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:08.237871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:08.238169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:08.238220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.238226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.238227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.238228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.238229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.238234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.238243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.238247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.238251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.238259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.238264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.238276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.238285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.238290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.238299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.238304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.238309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.238314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.238323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.238328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.238350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:08.245812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:08.247214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:08.247228Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:08.247229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:08.247232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:08.247236Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1958 [1:7556534744375424449:7487]
2025-10-02T08:14:08.247243Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:08.247255Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:08.247256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.247258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.247259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.247271Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:08.247274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:08.247279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:08.247317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.247322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.247324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:08.247326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:08.247370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:08.247376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.247383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.247393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:08.247412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534744375424442:7487]
2025-10-02T08:14:08.247418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534744375424442:7487]
2025-10-02T08:14:08.247424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:08.247434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375424417:7477], now have 1 active actors on pipe
2025-10-02T08:14:08.247441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:08.247442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:08.247444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:08.247449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:08.247453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:08.247456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534744835043229:2378], now have 1 active actors on pipe
2025-10-02T08:14:08.247480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534744375424442:7487]
2025-10-02T08:14:08.247489Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:08.247499Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:08.247521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1958
2025-10-02T08:14:08.247535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.247542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.247534Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1958
2025-10-02T08:14:08.247569Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:08.247579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.247582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.247583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:08.247589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.247596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:08.247606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.247636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.247642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.247652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.247677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1959 partition: 0 MaxSeqNo: 17 sessionId: src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0
2025-10-02T08:14:08.247941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fe60d2-1359a7dd-b066ee9e-26e0410e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:08.250398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0] Write session: try to update token
2025-10-02T08:14:08.250412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:08.262356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId: src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:08.265119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:08.265185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.265196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.269025Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:08.269043Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:08.269046Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:08.269053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534744375424442:7487]
2025-10-02T08:14:08.269057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534744375424442:7487]
2025-10-02T08:14:08.269091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:08.269097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:08.269106Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:08.269109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:08.269114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.269116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:08.269127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:08.269273Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:08.315727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534744375424498:8716]
2025-10-02T08:14:08.315826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1958, pipe: [1:7556534744375424498:8716]
2025-10-02T08:14:08.406479Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:08.406875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.406888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.407026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.407081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.407138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.407200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.407240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.407247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.407307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.407366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.407427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.407483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.407523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.407528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.407587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.407640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.407696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.407779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.407816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.407826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.407917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.407975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.408028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.408082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.408121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.408126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.408190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.408254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.408309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.408365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.408427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.408434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.408496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.408558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.408615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.408672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.408716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.408723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.408817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.408881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.408942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.409002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.409048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.409053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.409109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.409161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.409222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.409281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.409318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.409323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.409379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.409437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.409492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.409545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.409584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.409589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.409645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:08.409699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:08.409756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:08.409810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:08.409853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:08.409858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:08.409914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375424498:8716], now have 1 active actors on pipe
2025-10-02T08:14:08.410047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:08.410069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:08.410102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1959 reason: error at write: Disconnected sessionId: src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0
2025-10-02T08:14:08.410161Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:08.410281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1959 sessionId: src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0 is DEAD
2025-10-02T08:14:08.410400Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:08.410418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:08.410429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0] Write session will restart in 0.006713s
2025-10-02T08:14:08.410453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0] Write session: Do CDS request
2025-10-02T08:14:08.410459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:08.410469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534744375424498:8716]
2025-10-02T08:14:08.418247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.418366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:08.418380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1960
2025-10-02T08:14:08.418530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.418558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:08.418567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:08.418570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:08.418948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1960 sessionId:  describe result for acl check
2025-10-02T08:14:08.418981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:08.418986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:08.418988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:08.418993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534744375424895:6484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:08.419482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534744375424895:6484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:08.422323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534744375424895:6484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:08.425282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534744375424895:6484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:08.425300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534744375424895:6484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:08.425303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534744375424895:6484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:08.425311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:08.429414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:08.431164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:08.431339Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:08.431365Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:08.431375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:08.431431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:08.431466Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534744375425246:6466]
2025-10-02T08:14:08.432069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:08.432285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:08.432314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:08.432571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:08.432641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.432647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.432647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.432648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.432649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.432652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.432659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.432661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.432663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.432665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.432669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.432673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.432677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.432680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.432684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.432686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.432688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.432691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.432694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.432697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.432709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:08.440363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:08.442207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:08.442226Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:08.442228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:08.442231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:08.442237Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1959 [1:7556534744375425246:6466]
2025-10-02T08:14:08.442248Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:08.442266Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:08.442273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.442276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.442278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.442293Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:08.442302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:08.442309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:08.442370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.442377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.442380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:08.442383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:08.442444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:08.442451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.442463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.442478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:08.442505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375425171:6484], now have 1 active actors on pipe
2025-10-02T08:14:08.442510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1959
2025-10-02T08:14:08.442512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534744375425240:6466]
2025-10-02T08:14:08.442514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534744375425240:6466]
2025-10-02T08:14:08.442521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:08.442532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:08.442534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:08.442537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:08.442544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:08.442552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:08.442559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.442566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.442580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534744835043258:2378], now have 1 active actors on pipe
2025-10-02T08:14:08.442613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534744375425240:6466]
2025-10-02T08:14:08.442616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1959
2025-10-02T08:14:08.442626Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:08.442637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:08.442643Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:08.442648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.442651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.442653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:08.442662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.442670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:08.442698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.442777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.442785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.442797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.442831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1960 partition: 0 MaxSeqNo: 17 sessionId: src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0
2025-10-02T08:14:08.443146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaae5e1-340cca2e-7b5a367-8aaee440_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:08.445549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0] Write session: try to update token
2025-10-02T08:14:08.445562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:08.458972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId: src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:08.460404Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:08.460424Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:08.460427Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:08.460435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534744375425240:6466]
2025-10-02T08:14:08.460440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534744375425240:6466]
2025-10-02T08:14:08.460481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:08.460485Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:08.460490Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:08.460493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.460495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:08.460628Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:08.461691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:08.510799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534744375425272:8716]
2025-10-02T08:14:08.510952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1959, pipe: [1:7556534744375425272:8716]
2025-10-02T08:14:08.585217Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:08.585646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.585657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.585690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375425272:8716], now have 1 active actors on pipe
2025-10-02T08:14:08.585837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:08.585851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:08.585896Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:08.585912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1960 reason: error at write: Disconnected sessionId: src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0
2025-10-02T08:14:08.585941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:08.586067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1960 sessionId: src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0 is DEAD
2025-10-02T08:14:08.586201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:08.586209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0] Write session will restart in 0.005141s
2025-10-02T08:14:08.586232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0] Write session: Do CDS request
2025-10-02T08:14:08.586239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:08.586237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534744375425272:8716]
2025-10-02T08:14:08.592225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.592373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:08.592392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1961
2025-10-02T08:14:08.592503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.592532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:08.592555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:08.592563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:08.593315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1961 sessionId:  describe result for acl check
2025-10-02T08:14:08.593351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:08.593353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:08.593355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:08.593359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534744375425562:6534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:08.593798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534744375425562:6534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:08.596357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534744375425562:6534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:08.599317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534744375425562:6534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:08.599330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534744375425562:6534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:08.599333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534744375425562:6534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:08.599339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:08.605763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:08.607066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:08.607226Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:08.607234Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:08.607243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:08.607282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:08.607318Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534744375426021:6491]
2025-10-02T08:14:08.607896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:08.608101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:08.608144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:08.608447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:08.608499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.608505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.608506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.608507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.608508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.608513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.608523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.608528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.608532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.608535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.608541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.608548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.608553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.608559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.608564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.608569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.608573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.608578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.608583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.608587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.608606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:08.616832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:08.618834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:08.618851Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:08.618852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:08.618855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:08.618860Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1960 [1:7556534744375426021:6491]
2025-10-02T08:14:08.618868Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:08.618882Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:08.618884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.618886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.618887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.618899Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:08.618905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:08.618910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:08.618956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.618961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.618963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:08.618965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:08.619027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:08.619034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.619046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.619060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:08.619081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375425829:6534], now have 1 active actors on pipe
2025-10-02T08:14:08.619090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534744375426015:6491]
2025-10-02T08:14:08.619092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534744375426015:6491]
2025-10-02T08:14:08.619102Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:08.619110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534744835043277:2378], now have 1 active actors on pipe
2025-10-02T08:14:08.619113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:08.619115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:08.619122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:08.619134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:08.619140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:08.619168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534744375426015:6491]
2025-10-02T08:14:08.619177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:08.619186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:08.619211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1960
2025-10-02T08:14:08.619192Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1960
2025-10-02T08:14:08.619221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.619225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.619251Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63d25146-4b8e7855-2825d9ad-3170076e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:08.619262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.619265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.619267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:08.619275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.619288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:08.619307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.619348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.619355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.619369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.619406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1961 partition: 0 MaxSeqNo: 17 sessionId: src_id|63d25146-4b8e7855-2825d9ad-3170076e_0
2025-10-02T08:14:08.619739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b64e73-c3d2bbbe-6f6e6727-c8ebddbc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63d25146-4b8e7855-2825d9ad-3170076e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:08.622350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d25146-4b8e7855-2825d9ad-3170076e_0] Write session: try to update token
2025-10-02T08:14:08.622366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d25146-4b8e7855-2825d9ad-3170076e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:08.635592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId: src_id|63d25146-4b8e7855-2825d9ad-3170076e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:08.637406Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:08.637430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:08.637433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:08.637441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534744375426015:6491]
2025-10-02T08:14:08.637445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534744375426015:6491]
2025-10-02T08:14:08.637492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:08.637504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.637504Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:08.637507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:08.637510Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:08.637644Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:08.638083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:08.686408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534744375426061:8716]
2025-10-02T08:14:08.686542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1960, pipe: [1:7556534744375426061:8716]
2025-10-02T08:14:08.777520Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:08.777852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.777862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.777893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375426061:8716], now have 1 active actors on pipe
2025-10-02T08:14:08.778001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534744375426061:8716]
2025-10-02T08:14:08.778030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:08.778037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:08.778075Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:08.778098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1961 reason: error at write: Disconnected sessionId: src_id|63d25146-4b8e7855-2825d9ad-3170076e_0
2025-10-02T08:14:08.778138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:08.778247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1961 sessionId: src_id|63d25146-4b8e7855-2825d9ad-3170076e_0 is DEAD
2025-10-02T08:14:08.778362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d25146-4b8e7855-2825d9ad-3170076e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:08.778370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d25146-4b8e7855-2825d9ad-3170076e_0] Write session will restart in 0.007728s
2025-10-02T08:14:08.778394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d25146-4b8e7855-2825d9ad-3170076e_0] Write session: Do CDS request
2025-10-02T08:14:08.778400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d25146-4b8e7855-2825d9ad-3170076e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:08.787264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d25146-4b8e7855-2825d9ad-3170076e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.787323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:08.787340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1962
2025-10-02T08:14:08.787450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.787478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:08.787487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:08.787491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:08.787844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1962 sessionId:  describe result for acl check
2025-10-02T08:14:08.787874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:08.787876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:08.787877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:08.787881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534744375426489:6535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:08.788369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534744375426489:6535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:08.790675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534744375426489:6535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:08.793232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534744375426489:6535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:08.793244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534744375426489:6535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:08.793247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534744375426489:6535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:08.793253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:08.797382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:08.798747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:08.798947Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:08.798954Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:08.798961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:08.798996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:08.799022Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534744375426815:6518]
2025-10-02T08:14:08.799396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:08.799518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:08.799542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:08.799726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:08.799766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.799770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.799771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.799771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.799772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.799775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.799781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.799783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.799785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.799787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.799790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.799794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.799798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.799801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.799803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.799806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.799808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.799810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.799812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.799815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.799824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:08.807352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:08.808857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:08.808872Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:08.808875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:08.808880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:08.808886Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1961 [1:7556534744375426815:6518]
2025-10-02T08:14:08.808898Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:08.808915Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:08.808923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.808926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.808928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.808943Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:08.808953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:08.808959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:08.809026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.809033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.809036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:08.809038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:08.809170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1961
2025-10-02T08:14:08.809252Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1961
2025-10-02T08:14:08.809446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:08.809460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.809474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.809487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:08.809512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375426719:6535], now have 1 active actors on pipe
2025-10-02T08:14:08.809523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534744835043287:2378], now have 1 active actors on pipe
2025-10-02T08:14:08.809528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.809532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.809554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534744375426809:6518]
2025-10-02T08:14:08.809562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534744375426809:6518]
2025-10-02T08:14:08.809575Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:08.809593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:08.809594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:08.809597Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:08.809612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:08.809619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:08.809634Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:08.809644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.809652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.809658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:08.809668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.809682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:08.809723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534744375426809:6518]
2025-10-02T08:14:08.809734Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:08.809743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:08.809749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.809879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.809891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.809912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.809951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1962 partition: 0 MaxSeqNo: 17 sessionId: src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0
2025-10-02T08:14:08.810275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d25146-4b8e7855-2825d9ad-3170076e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:08.812796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0] Write session: try to update token
2025-10-02T08:14:08.812831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:08.826142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId: src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:08.826460Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:08.826478Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:08.826480Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:08.826486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534744375426809:6518]
2025-10-02T08:14:08.826490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534744375426809:6518]
2025-10-02T08:14:08.826523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:08.826533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.826538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:08.826549Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:08.826567Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:08.826674Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:08.828630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:08.878422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534744375426840:8716]
2025-10-02T08:14:08.878583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1961, pipe: [1:7556534744375426840:8716]
2025-10-02T08:14:08.960352Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:08.960785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.960798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.960846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375426840:8716], now have 1 active actors on pipe
2025-10-02T08:14:08.960945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534744375426840:8716]
2025-10-02T08:14:08.960972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:08.960973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:08.961020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1962 reason: error at write: Disconnected sessionId: src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0
2025-10-02T08:14:08.961041Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:08.961072Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:08.961152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1962 sessionId: src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0 is DEAD
2025-10-02T08:14:08.961292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:08.961302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0] Write session will restart in 0.008818s
2025-10-02T08:14:08.961340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0] Write session: Do CDS request
2025-10-02T08:14:08.961346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:08.971259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.971324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:08.971339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1963
2025-10-02T08:14:08.971466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:08.971492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:08.971501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:08.971504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:08.971878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1963 sessionId:  describe result for acl check
2025-10-02T08:14:08.971908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:08.971914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:08.971915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:08.971919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534744375427331:6587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:08.972365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534744375427331:6587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:08.974864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534744375427331:6587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:08.978307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534744375427331:6587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:08.978323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534744375427331:6587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:08.978327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534744375427331:6587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:08.978334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:08.981138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:08.981486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:08.981622Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:08.981630Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:08.981637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:08.981672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:08.981702Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534744375427593:6560]
2025-10-02T08:14:08.982200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:08.982372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:08.982402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:08.982587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:08.982619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.982625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.982626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.982626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.982627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.982631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.982639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.982643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.982646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.982649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.982653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.982660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:08.982666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.982670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:08.982674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.982679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:08.982686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.982691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.982696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.982700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.982714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:08.990460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:08.991944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:08.991961Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:08.991963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:08.991965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:08.991971Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1962 [1:7556534744375427593:6560]
2025-10-02T08:14:08.991981Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:08.991997Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:08.992000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.992003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.992005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.992016Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:08.992020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:08.992025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:08.992069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.992076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.992078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:08.992079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:08.992128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:08.992134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:08.992142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:08.992148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:08.992162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534744375427572:6587], now have 1 active actors on pipe
2025-10-02T08:14:08.992166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534744375427587:6560]
2025-10-02T08:14:08.992168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534744375427587:6560]
2025-10-02T08:14:08.992173Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:08.992181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:08.992188Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:08.992189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1962
2025-10-02T08:14:08.992191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:08.992193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:08.992198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534744835043294:2378], now have 1 active actors on pipe
2025-10-02T08:14:08.992200Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:08.992235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534744375427587:6560]
2025-10-02T08:14:08.992238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:08.992241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:08.992243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.992247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.992276Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:08.992285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:08.992288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:08.992290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:08.992296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:08.992302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:08.992315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.992306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1962
2025-10-02T08:14:08.992360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:08.992366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:08.992375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:08.992412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1963 partition: 0 MaxSeqNo: 17 sessionId: src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0
2025-10-02T08:14:08.992679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adb2f0cb-d2eaf54c-bd3660b4-24e63be2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:08.995042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0] Write session: try to update token
2025-10-02T08:14:08.995054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:09.007493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId: src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:09.008876Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:09.008892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:09.008894Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:09.008905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534744375427587:6560]
2025-10-02T08:14:09.008909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534744375427587:6560]
2025-10-02T08:14:09.008949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:09.008955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.008954Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:09.008957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:09.008961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:09.009125Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:09.009834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:09.061186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534748670394915:8716]
2025-10-02T08:14:09.061305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1962, pipe: [1:7556534748670394915:8716]
2025-10-02T08:14:09.144603Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:09.145182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.145199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.145235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670394915:8716], now have 1 active actors on pipe
2025-10-02T08:14:09.145335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:09.145347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:09.145390Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:09.145420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1963 reason: error at write: Disconnected sessionId: src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0
2025-10-02T08:14:09.145569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1963 sessionId: src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0 is DEAD
2025-10-02T08:14:09.145630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534748670394915:8716]
2025-10-02T08:14:09.145718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:09.145730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0] Write session will restart in 0.007775s
2025-10-02T08:14:09.145752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0] Write session: Do CDS request
2025-10-02T08:14:09.145762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:09.145679Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:09.154265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.154347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:09.154364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1964
2025-10-02T08:14:09.154490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.154521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:09.154539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:09.154548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:09.154970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1964 sessionId:  describe result for acl check
2025-10-02T08:14:09.155004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:09.155005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:09.155007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:09.155011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534748670395383:6604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:09.155530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534748670395383:6604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:09.158548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534748670395383:6604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:09.161737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534748670395383:6604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:09.161758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534748670395383:6604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:09.161762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534748670395383:6604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:09.161770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:09.165928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:09.167081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:09.167330Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:09.167340Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:09.167347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:09.167386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:09.167413Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534748670395671:6619]
2025-10-02T08:14:09.167882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:09.168069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:09.168101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:09.168311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:09.168338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.168343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.168344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.168344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.168345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.168348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.168354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.168356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.168358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.168360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.168364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.168368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.168372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.168375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.168378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.168380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.168383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.168385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.168388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.168390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.168401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:09.176341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:09.177797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:09.177813Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:09.177816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:09.177820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:09.177827Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1963 [1:7556534748670395671:6619]
2025-10-02T08:14:09.177841Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:09.177858Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:09.177861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.177864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.177866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.177882Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:09.177887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:09.178189Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1963
2025-10-02T08:14:09.177894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:09.177967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.177969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.177972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:09.177975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:09.178039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:09.178041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.178055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.178067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:09.178086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670395640:6604], now have 1 active actors on pipe
2025-10-02T08:14:09.178092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534748670395665:6619]
2025-10-02T08:14:09.178095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534748670395665:6619]
2025-10-02T08:14:09.178099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1963
2025-10-02T08:14:09.178102Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:09.178115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:09.178115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:09.178118Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:09.178129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:09.178132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:09.178137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534749130010597:2378], now have 1 active actors on pipe
2025-10-02T08:14:09.178142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.178146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.178184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534748670395665:6619]
2025-10-02T08:14:09.178192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:09.178203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:09.178205Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1f37251-9b4a16e-96fcf20-772e28da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:09.178211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.178214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.178216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:09.178226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.178236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:09.178266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.178342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.178346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.178370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.178406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1964 partition: 0 MaxSeqNo: 17 sessionId: src_id|f1f37251-9b4a16e-96fcf20-772e28da_0
2025-10-02T08:14:09.178745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d29bbf9-21d218d5-4f4d468e-e1b2d138_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f1f37251-9b4a16e-96fcf20-772e28da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:09.181362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f37251-9b4a16e-96fcf20-772e28da_0] Write session: try to update token
2025-10-02T08:14:09.181376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f37251-9b4a16e-96fcf20-772e28da_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:09.194990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId: src_id|f1f37251-9b4a16e-96fcf20-772e28da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:09.195887Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:09.195904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:09.195906Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:09.195916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534748670395665:6619]
2025-10-02T08:14:09.195920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534748670395665:6619]
2025-10-02T08:14:09.195961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:09.195973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.195975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:09.195976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:09.195981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:09.196116Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:09.197610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:09.245993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534748670395695:8716]
2025-10-02T08:14:09.246094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1963, pipe: [1:7556534748670395695:8716]
2025-10-02T08:14:09.331355Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:09.331849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.331863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.331899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670395695:8716], now have 1 active actors on pipe
2025-10-02T08:14:09.332015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:09.332022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:09.332070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1964 reason: error at write: Disconnected sessionId: src_id|f1f37251-9b4a16e-96fcf20-772e28da_0
2025-10-02T08:14:09.332146Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:09.332230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1964 sessionId: src_id|f1f37251-9b4a16e-96fcf20-772e28da_0 is DEAD
2025-10-02T08:14:09.332171Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:09.332351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f37251-9b4a16e-96fcf20-772e28da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:09.332362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f37251-9b4a16e-96fcf20-772e28da_0] Write session will restart in 0.009263s
2025-10-02T08:14:09.332395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f37251-9b4a16e-96fcf20-772e28da_0] Write session: Do CDS request
2025-10-02T08:14:09.332400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f37251-9b4a16e-96fcf20-772e28da_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:09.332381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534748670395695:8716]
2025-10-02T08:14:09.342309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f37251-9b4a16e-96fcf20-772e28da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.342370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:09.342387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1965
2025-10-02T08:14:09.342503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.342537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:09.342545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:09.342548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:09.342988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1965 sessionId:  describe result for acl check
2025-10-02T08:14:09.343028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:09.343034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:09.343036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:09.343041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534748670396201:6717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:09.343523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534748670396201:6717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:09.346001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534748670396201:6717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:09.348995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534748670396201:6717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:09.349010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534748670396201:6717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:09.349013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534748670396201:6717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:09.349021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:09.352093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:09.353768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:09.354056Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:09.354065Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:09.354076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:09.354133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:09.354167Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534748670396488:6708]
2025-10-02T08:14:09.354743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:09.354921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:09.354961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:09.355233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:09.355280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.355285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.355286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.355287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.355288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.355292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.355300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.355304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.355307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.355310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.355315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.355322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.355327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.355331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.355335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.355339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.355343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.355347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.355351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.355355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.355374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:09.363547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:09.365459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:09.365479Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:09.365481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:09.365485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:09.365491Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1964 [1:7556534748670396488:6708]
2025-10-02T08:14:09.365502Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:09.365520Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:09.365523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.365526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.365527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.365544Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:09.365554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:09.365560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:09.365626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.365632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.365635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:09.365637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:09.365698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:09.365705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.365717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.365730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:09.365752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670396437:6717], now have 1 active actors on pipe
2025-10-02T08:14:09.365758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534748670396482:6708]
2025-10-02T08:14:09.365760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534748670396482:6708]
2025-10-02T08:14:09.365763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1964
2025-10-02T08:14:09.365766Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:09.365773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534749130010627:2378], now have 1 active actors on pipe
2025-10-02T08:14:09.365776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:09.365779Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:09.365779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:09.365791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:09.365794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:09.365800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.365804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.365846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534748670396482:6708]
2025-10-02T08:14:09.365853Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:09.365868Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:09.365869Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|781be3c0-6932628d-95782195-a5365bfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:09.365875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.365879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.365880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:09.365887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.365858Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1964
2025-10-02T08:14:09.365894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:09.365928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.366005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.366012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.366024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.366059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1965 partition: 0 MaxSeqNo: 17 sessionId: src_id|781be3c0-6932628d-95782195-a5365bfc_0
2025-10-02T08:14:09.366388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f37251-9b4a16e-96fcf20-772e28da_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|781be3c0-6932628d-95782195-a5365bfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:09.368975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|781be3c0-6932628d-95782195-a5365bfc_0] Write session: try to update token
2025-10-02T08:14:09.368987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|781be3c0-6932628d-95782195-a5365bfc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:09.377148Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:09.377173Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:09.377184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534748670396482:6708]
2025-10-02T08:14:09.377224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:09.377225Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:09.377397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:09.377539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:09.377675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:09.377805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:09.377990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:09.378030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:09.389344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId: src_id|781be3c0-6932628d-95782195-a5365bfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:09.391879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:09.391935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.391943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.391975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:09.391996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:09.392059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.392061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.392235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.392305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.392383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.392447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.392495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.392505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.392574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.392636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.392699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.392764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.396291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.396316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.396389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.396455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.396686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.396945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.396993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.397003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.397089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.397153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.397223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.397293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.397342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.397350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.397421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.397505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.397577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.397643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.397694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.397704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.397778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.397842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.397909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.397977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.398024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.398032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.398105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.398167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.398240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.398480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.398535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.398542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.398781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.399024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.399093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.399155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.399199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.399202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.399450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.399684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.399758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.399825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.399872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.399880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.400134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:09.400390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:09.400455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:09.400520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:09.400567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:09.400576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:09.402255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:09.402333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.402370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.402377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:09.402409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:09.402436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:09.402441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:09.402446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:09.402449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:09.403032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:09.403063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:09.403070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:09.403075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:09.403078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:09.403081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:09.404368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:09.404394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:09.404402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:09.404405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:09.404408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:09.404415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:09.405402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:09.405434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:09.405441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:09.405445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:09.405449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:09.407749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:09.407770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:09.407787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392849407
2025-10-02T08:14:09.407908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:09.407924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:09.407932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:09.407941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:09.407946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:09.407951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:09.408545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:09.408571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:09.408577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:09.408581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:09.408586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:09.408590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:09.409169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:09.409195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:09.409223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:09.409233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:09.409237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:09.409240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:09.409731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:09.409763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:09.409771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:09.410904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:09.410924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:09.410930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:09.410936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:09.410945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392849410
2025-10-02T08:14:09.411261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:09.411287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:09.411294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:09.411298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:09.411301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:09.411311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:09.411790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:09.411816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:09.411827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:09.411837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:09.411844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:09.411848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:09.412337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:09.412360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.412469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392849412
2025-10-02T08:14:09.416703Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:09.416722Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:09.416725Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:09.416737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534748670396482:6708]
2025-10-02T08:14:09.416742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534748670396482:6708]
2025-10-02T08:14:09.416787Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:09.416849Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:09.416859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:09.416895Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:09.416907Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:09.416915Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:09.416930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:09.416940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.416942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:09.417090Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:09.432398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534748670396514:8716]
2025-10-02T08:14:09.432565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1964, pipe: [1:7556534748670396514:8716]
2025-10-02T08:14:09.550364Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:09.550796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670396514:8716], now have 1 active actors on pipe
2025-10-02T08:14:09.551127Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:09.550978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534748670396514:8716]
2025-10-02T08:14:09.551000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:09.551002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:09.551027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1965 reason: error at write: Disconnected sessionId: src_id|781be3c0-6932628d-95782195-a5365bfc_0
2025-10-02T08:14:09.551050Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:09.551193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1965 sessionId: src_id|781be3c0-6932628d-95782195-a5365bfc_0 is DEAD
2025-10-02T08:14:09.551420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781be3c0-6932628d-95782195-a5365bfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:09.551428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781be3c0-6932628d-95782195-a5365bfc_0] Write session will restart in 0.007643s
2025-10-02T08:14:09.551454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781be3c0-6932628d-95782195-a5365bfc_0] Write session: Do CDS request
2025-10-02T08:14:09.551461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781be3c0-6932628d-95782195-a5365bfc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:09.555600Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [3a2aafe620c23901] Result# TEvPutResult {Id# [72075186224037892:1964:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:09.555658Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1964:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:09.555729Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1964:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:09.560244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|781be3c0-6932628d-95782195-a5365bfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.560373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:09.560391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1966
2025-10-02T08:14:09.560607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.560640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:09.560649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:09.560652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:09.561094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1966 sessionId:  describe result for acl check
2025-10-02T08:14:09.561129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:09.561135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:09.561136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:09.561141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534748670396817:6758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:09.561646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534748670396817:6758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:09.565680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534748670396817:6758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:09.569082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534748670396817:6758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:09.569097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534748670396817:6758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:09.569100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534748670396817:6758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:09.569107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:09.573925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:09.575577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:09.575758Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:09.575768Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:09.575777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:09.575824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:09.575858Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534748670397282:6762]
2025-10-02T08:14:09.576489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:09.576718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:09.576767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:09.577092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:09.577136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.577138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.577139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.577140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.577141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.577146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.577157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.577161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.577165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.577169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.577174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.577182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.577188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.577194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.577198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.577203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.577206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.577210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.577213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.577218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.577237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:09.585445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:09.587313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:09.587333Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:09.587337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:09.587341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:09.587347Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1965 [1:7556534748670397282:6762]
2025-10-02T08:14:09.587359Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:09.587376Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:09.587379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.587382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.587384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.587398Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:09.587403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:09.587409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:09.587486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.587493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.587496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:09.587498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:09.587559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:09.587566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.587577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.587590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:09.587610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534748670397276:6762]
2025-10-02T08:14:09.587616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534748670397276:6762]
2025-10-02T08:14:09.587627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:09.587643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:09.587660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:09.587667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:09.587701Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534748670397276:6762]
2025-10-02T08:14:09.587708Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:09.587767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:09.587774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:09.587779Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:09.587940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1965
2025-10-02T08:14:09.587986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670397182:6758], now have 1 active actors on pipe
2025-10-02T08:14:09.588001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534749130010646:2378], now have 1 active actors on pipe
2025-10-02T08:14:09.588091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.588106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.588158Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:09.588174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.588186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.588188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:09.588211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.588234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:09.588256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.588293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.588304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.588319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.588367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1966 partition: 0 MaxSeqNo: 17 sessionId: src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0
2025-10-02T08:14:09.588774Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1965
2025-10-02T08:14:09.589034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|781be3c0-6932628d-95782195-a5365bfc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:09.591633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0] Write session: try to update token
2025-10-02T08:14:09.591646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:09.608102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId: src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:09.610922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:09.612528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.612551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.612570Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:09.612573Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:09.612575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:09.612582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534748670397276:6762]
2025-10-02T08:14:09.612590Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534748670397276:6762]
2025-10-02T08:14:09.612635Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:09.612647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:09.612654Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:09.612654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.612656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:09.612791Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:09.651022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534748670397312:8716]
2025-10-02T08:14:09.651167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1965, pipe: [1:7556534748670397312:8716]
2025-10-02T08:14:09.751846Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:09.752396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:09.752441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670397312:8716], now have 1 active actors on pipe
2025-10-02T08:14:09.752441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:09.752528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:09.752540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:09.752558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1966 reason: error at write: Disconnected sessionId: src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0
2025-10-02T08:14:09.752680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1966 sessionId: src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0 is DEAD
2025-10-02T08:14:09.752679Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:09.752820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534748670397312:8716]
2025-10-02T08:14:09.752902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:09.752919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0] Write session will restart in 0.007499s
2025-10-02T08:14:09.753037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0] Write session: Do CDS request
2025-10-02T08:14:09.753053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:09.761335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.761412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:09.761427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1967
2025-10-02T08:14:09.761544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.761573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:09.761582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:09.761585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:09.761981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1967 sessionId:  describe result for acl check
2025-10-02T08:14:09.762007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:09.762014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:09.762015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:09.762020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534748670397728:6800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:09.762456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534748670397728:6800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:09.764861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534748670397728:6800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:09.766952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534748670397728:6800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:09.766965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534748670397728:6800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:09.766967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534748670397728:6800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:09.766973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:09.771235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:09.772872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:09.773023Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:09.773032Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:09.773041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:09.773085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:09.773119Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534748670398090:6825]
2025-10-02T08:14:09.773597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:09.773755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:09.773782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:09.773984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:09.774017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.774021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.774021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.774022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.774023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.774026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.774032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.774036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.774040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.774043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.774047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.774055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.774060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.774065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.774068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.774071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.774073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.774076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.774078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.774080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.774090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:09.781869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:09.783192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:09.783206Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:09.783208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:09.783211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:09.783216Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1966 [1:7556534748670398090:6825]
2025-10-02T08:14:09.783224Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:09.783237Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:09.783238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.783240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.783242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.783254Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:09.783259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:09.783264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:09.783315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.783321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.783323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:09.783325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:09.783375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:09.783382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.783393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.783409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:09.783419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1966
2025-10-02T08:14:09.783425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670397975:6800], now have 1 active actors on pipe
2025-10-02T08:14:09.783430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534748670398083:6825]
2025-10-02T08:14:09.783431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534748670398083:6825]
2025-10-02T08:14:09.783436Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:09.783442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534749130010655:2378], now have 1 active actors on pipe
2025-10-02T08:14:09.783446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.783447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:09.783450Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:09.783453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.783471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:09.783488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:09.783495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:09.783530Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:09.783508Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1966
2025-10-02T08:14:09.783544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.783547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.783550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:09.783558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.783565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:09.783572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534748670398083:6825]
2025-10-02T08:14:09.783579Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:09.783582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:09.783600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.783641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.783647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.783660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.783698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1967 partition: 0 MaxSeqNo: 17 sessionId: src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0
2025-10-02T08:14:09.784051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e2cebe-4b42f49a-7936d24e-b1ec18ed_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:09.787102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0] Write session: try to update token
2025-10-02T08:14:09.787122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:09.800220Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:09.800239Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:09.800241Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:09.800248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534748670398083:6825]
2025-10-02T08:14:09.800252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534748670398083:6825]
2025-10-02T08:14:09.800290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:09.800294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:09.800297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.800299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:09.800304Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:09.800756Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:09.801245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId: src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:09.803578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:09.853241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534748670398118:8716]
2025-10-02T08:14:09.853339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1966, pipe: [1:7556534748670398118:8716]
2025-10-02T08:14:09.938241Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:09.938946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.938958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.938992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670398118:8716], now have 1 active actors on pipe
2025-10-02T08:14:09.939111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:09.939127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:09.939188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1967 reason: error at write: Disconnected sessionId: src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0
2025-10-02T08:14:09.939191Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:09.939226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:09.939370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1967 sessionId: src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0 is DEAD
2025-10-02T08:14:09.939523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534748670398118:8716]
2025-10-02T08:14:09.939539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:09.939550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0] Write session will restart in 0.007821s
2025-10-02T08:14:09.939575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0] Write session: Do CDS request
2025-10-02T08:14:09.939581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:09.948376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.948486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:09.948504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1968
2025-10-02T08:14:09.948629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:09.948658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:09.948663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:09.948666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:09.949131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1968 sessionId:  describe result for acl check
2025-10-02T08:14:09.949166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:09.949173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:09.949174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:09.949180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534748670398492:6814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:09.949716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534748670398492:6814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:09.953354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534748670398492:6814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:09.956605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534748670398492:6814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:09.956621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534748670398492:6814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:09.956623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534748670398492:6814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:09.956630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:09.960494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:09.961865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:09.961980Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:09.961987Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:09.961993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:09.962023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:09.962050Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534748670398881:6811]
2025-10-02T08:14:09.962490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:09.962641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:09.962673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:09.962903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:09.962936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.962940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.962941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.962942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.962942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.962946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.962953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.962955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.962957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.962959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.962963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.962967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:09.962970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.962974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:09.962976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.962979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:09.962982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.962984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.962987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.962990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.963001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:09.970777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:09.972612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:09.972624Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:09.972626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:09.972628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:09.972632Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1967 [1:7556534748670398881:6811]
2025-10-02T08:14:09.972640Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:09.972652Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:09.972654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.972656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.972657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.972667Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:09.972672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:09.972676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:09.972717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.972722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.972724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:09.972726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:09.972778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:09.972784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.972792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:09.972813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:09.972835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534748670398875:6811]
2025-10-02T08:14:09.972838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534748670398875:6811]
2025-10-02T08:14:09.972844Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:09.972853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534748670398785:6814], now have 1 active actors on pipe
2025-10-02T08:14:09.972854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1967
2025-10-02T08:14:09.972855Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:09.972858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:09.972858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:09.972866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:09.972868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:09.972872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534749130010668:2378], now have 1 active actors on pipe
2025-10-02T08:14:09.972875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.972879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.972916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534748670398875:6811]
2025-10-02T08:14:09.972927Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:09.972934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:09.972940Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:09.972946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:09.972949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:09.972951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:09.972959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:09.972968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:09.972961Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1967
2025-10-02T08:14:09.972987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.973051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:09.973059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:09.973072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:09.973107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1968 partition: 0 MaxSeqNo: 17 sessionId: src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0
2025-10-02T08:14:09.973427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b610eb05-e642b086-e5f7eb82-8ecbfcb1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:09.976404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0] Write session: try to update token
2025-10-02T08:14:09.976423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:09.990104Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:09.990127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:09.990130Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:09.990138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534748670398875:6811]
2025-10-02T08:14:09.990143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534748670398875:6811]
2025-10-02T08:14:09.990182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:09.990189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:09.990191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:09.990190Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:09.990196Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:09.990356Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:09.991008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId: src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:09.993386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:10.039617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534752965366204:8716]
2025-10-02T08:14:10.039750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1967, pipe: [1:7556534752965366204:8716]
2025-10-02T08:14:10.116955Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:10.117188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.117202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.117242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965366204:8716], now have 1 active actors on pipe
2025-10-02T08:14:10.117355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:10.117365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:10.117414Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:10.117417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1968 reason: error at write: Disconnected sessionId: src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0
2025-10-02T08:14:10.117439Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:10.117582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1968 sessionId: src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0 is DEAD
2025-10-02T08:14:10.117780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534752965366204:8716]
2025-10-02T08:14:10.117985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:10.117996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0] Write session will restart in 0.008865s
2025-10-02T08:14:10.118034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0] Write session: Do CDS request
2025-10-02T08:14:10.118039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:10.128399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.128445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:10.128463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1969
2025-10-02T08:14:10.128576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.128597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:10.128604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:10.128607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:10.129042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1969 sessionId:  describe result for acl check
2025-10-02T08:14:10.129079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:10.129086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:10.129087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:10.129093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534752965366679:6836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:10.129565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534752965366679:6836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:10.132499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534752965366679:6836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:10.136030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534752965366679:6836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:10.136043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534752965366679:6836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:10.136045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534752965366679:6836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:10.136052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:10.136785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:10.138263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:10.138426Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:10.138433Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:10.138439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:10.138472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:10.138506Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534752965366969:6835]
2025-10-02T08:14:10.138951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:10.139085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:10.139111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:10.139307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:10.139336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.139340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.139341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.139342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.139342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.139345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.139351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.139354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.139356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.139357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.139361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.139365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.139369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.139372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.139374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.139377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.139380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.139382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.139385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.139387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.139397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:10.147019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:10.148889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:10.148905Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:10.148907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:10.148909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:10.148914Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1968 [1:7556534752965366969:6835]
2025-10-02T08:14:10.148924Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:10.148938Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:10.148939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.148941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.148943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.148956Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:10.148959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:10.148964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:10.149013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.149018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.149020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:10.149022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:10.149073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:10.149079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.149087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.149094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:10.149106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534752965366963:6835]
2025-10-02T08:14:10.149110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534752965366963:6835]
2025-10-02T08:14:10.149117Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:10.149126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:10.149131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:10.149134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:10.149135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:10.149142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:10.149143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965366950:6836], now have 1 active actors on pipe
2025-10-02T08:14:10.149145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534753424977971:2378], now have 1 active actors on pipe
2025-10-02T08:14:10.149154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1968
2025-10-02T08:14:10.149169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534752965366963:6835]
2025-10-02T08:14:10.149177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:10.149182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.149185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:10.149190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.149219Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:10.149228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.149232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.149238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:10.149246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.149231Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1968
2025-10-02T08:14:10.149258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:10.149283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.149319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.149324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.149333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.149365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1969 partition: 0 MaxSeqNo: 17 sessionId: src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0
2025-10-02T08:14:10.149700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e7f645-a92a93c0-3f59ed66-f27d3a38_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:10.152493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0] Write session: try to update token
2025-10-02T08:14:10.152509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:10.165889Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:10.165915Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:10.165917Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:10.165925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534752965366963:6835]
2025-10-02T08:14:10.165930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534752965366963:6835]
2025-10-02T08:14:10.165974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:10.165979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:10.165983Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:10.165987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.165989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:10.166030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId: src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:10.166125Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:10.168620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:10.217819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534752965366994:8716]
2025-10-02T08:14:10.217939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1968, pipe: [1:7556534752965366994:8716]
2025-10-02T08:14:10.296016Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:10.296234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.296244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.296274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965366994:8716], now have 1 active actors on pipe
2025-10-02T08:14:10.296382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:10.296396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:10.296451Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:10.296468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1969 reason: error at write: Disconnected sessionId: src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0
2025-10-02T08:14:10.296470Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:10.296653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1969 sessionId: src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0 is DEAD
2025-10-02T08:14:10.296766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:10.296774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0] Write session will restart in 0.008124s
2025-10-02T08:14:10.296813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0] Write session: Do CDS request
2025-10-02T08:14:10.296818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:10.296814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534752965366994:8716]
2025-10-02T08:14:10.306361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.306378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:10.306395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1970
2025-10-02T08:14:10.306770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.306812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:10.306818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:10.306821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:10.307234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1970 sessionId:  describe result for acl check
2025-10-02T08:14:10.307266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:10.307273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:10.307274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:10.307278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534752965367449:6847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:10.307752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534752965367449:6847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:10.310643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534752965367449:6847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:10.313834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534752965367449:6847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:10.313850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534752965367449:6847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:10.313853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534752965367449:6847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:10.313861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:10.317657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:10.317974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:10.318107Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:10.318114Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:10.318123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:10.318163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:10.318198Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534752965367775:6861]
2025-10-02T08:14:10.318805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:10.318993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:10.319048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:10.319346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:10.319394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.319400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.319401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.319402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.319403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.319408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.319418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.319426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.319429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.319433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.319438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.319444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.319451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.319460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.319468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.319476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.319484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.319494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.319497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.319502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.319525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:10.327418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:10.329075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:10.329095Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:10.329097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:10.329101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:10.329108Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1969 [1:7556534752965367775:6861]
2025-10-02T08:14:10.329119Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:10.329132Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:10.329134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.329138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.329139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.329152Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:10.329157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:10.329162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:10.329217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.329227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.329230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:10.329232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:10.329289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:10.329296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.329309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.329327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:10.329347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965367737:6847], now have 1 active actors on pipe
2025-10-02T08:14:10.329359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534752965367769:6861]
2025-10-02T08:14:10.329361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534752965367769:6861]
2025-10-02T08:14:10.329371Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:10.329381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534753424977980:2378], now have 1 active actors on pipe
2025-10-02T08:14:10.329385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:10.329388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:10.329388Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:10.329400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:10.329403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:10.329435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534752965367769:6861]
2025-10-02T08:14:10.329446Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:10.329451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:10.329441Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1969
2025-10-02T08:14:10.329494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1969
2025-10-02T08:14:10.329509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.329517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.329538Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37c65391-53837570-c1fc6086-fe25ca82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:10.329552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.329554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.329556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:10.329563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.329571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:10.329589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.329618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.329624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.329633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.329663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1970 partition: 0 MaxSeqNo: 17 sessionId: src_id|37c65391-53837570-c1fc6086-fe25ca82_0
2025-10-02T08:14:10.329967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3b3408f-f6284d52-50d3ad8e-900faa75_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|37c65391-53837570-c1fc6086-fe25ca82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:10.332381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c65391-53837570-c1fc6086-fe25ca82_0] Write session: try to update token
2025-10-02T08:14:10.332395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c65391-53837570-c1fc6086-fe25ca82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:10.339999Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:10.340020Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:10.340028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534752965367769:6861]
2025-10-02T08:14:10.340058Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:10.340064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:10.340242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:10.340394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:10.340527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:10.340660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:10.340874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:10.340914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:10.344717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId: src_id|37c65391-53837570-c1fc6086-fe25ca82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:10.347210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:10.347259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.347269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.347294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:10.347308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:10.347353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.347358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.347495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.347560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.347620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.347681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.347729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.347738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.347816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.347883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.347948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.348016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.348064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.348072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.348178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.348256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.348317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.348372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.348410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.348414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.348471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.348528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.348586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.348643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.348683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.348688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.348748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.348826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.348883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.348938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.349009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.349016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.349104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.349190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.349255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.349312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.349352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.349358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.349416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.349475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.349534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.349589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.349629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.349634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.349693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.349744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.349831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.349888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.349929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.349935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.349995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.350050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.350137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.350207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.350248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.350253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.350309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.350361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.350414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.350475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.350515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.350519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.350551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:10.350599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.350614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.350619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:10.350643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:10.350657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:10.350659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:10.350660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:10.350662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:10.351041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:10.351063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:10.351071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:10.351073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:10.351075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:10.351077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:10.351577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:10.351595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:10.351602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:10.351604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:10.351606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:10.351608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:10.352045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:10.352061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:10.352067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:10.352069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:10.352071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:10.353982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:10.354002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:10.354010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392850353
2025-10-02T08:14:10.354108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:10.354119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:10.354137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:10.354144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:10.354146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:10.354149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:10.354559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:10.354582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:10.354588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:10.354596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:10.354598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:10.354602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:10.355029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:10.355048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:10.355054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:10.355056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:10.355057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:10.355059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:10.355478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:10.355497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:10.355500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:10.356460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:10.356476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:10.356479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:10.356481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:10.356486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392850355
2025-10-02T08:14:10.356740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:10.356755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:10.356759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:10.356765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:10.356769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:10.356771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:10.357195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:10.357214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:10.357217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:10.357220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:10.357222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:10.357224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:10.357664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:10.357683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.357754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392850357
2025-10-02T08:14:10.358419Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:10.358444Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:10.358455Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:10.358466Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:10.359966Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:10.359982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:10.359984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:10.359991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534752965367769:6861]
2025-10-02T08:14:10.359994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534752965367769:6861]
2025-10-02T08:14:10.360027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:10.360037Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:10.360045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:10.360054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.360056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:10.360176Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:10.396997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534752965367831:8716]
2025-10-02T08:14:10.397095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1969, pipe: [1:7556534752965367831:8716]
2025-10-02T08:14:10.491882Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:10.492428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965367831:8716], now have 1 active actors on pipe
2025-10-02T08:14:10.492542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534752965367831:8716]
2025-10-02T08:14:10.492570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:10.492572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:10.492604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1970 reason: error at write: Disconnected sessionId: src_id|37c65391-53837570-c1fc6086-fe25ca82_0
2025-10-02T08:14:10.492622Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:10.492675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:10.492844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1970 sessionId: src_id|37c65391-53837570-c1fc6086-fe25ca82_0 is DEAD
2025-10-02T08:14:10.493033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c65391-53837570-c1fc6086-fe25ca82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:10.493047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c65391-53837570-c1fc6086-fe25ca82_0] Write session will restart in 0.008281s
2025-10-02T08:14:10.493072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c65391-53837570-c1fc6086-fe25ca82_0] Write session: Do CDS request
2025-10-02T08:14:10.493078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c65391-53837570-c1fc6086-fe25ca82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:10.502428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c65391-53837570-c1fc6086-fe25ca82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.502436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:10.502464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1971
2025-10-02T08:14:10.502590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.502617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:10.502626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:10.502629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:10.503085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1971 sessionId:  describe result for acl check
2025-10-02T08:14:10.503130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:10.503138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:10.503140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:10.503146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534752965368248:6988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:10.503646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534752965368248:6988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:10.506300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534752965368248:6988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:10.509217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534752965368248:6988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:10.509244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534752965368248:6988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:10.509246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534752965368248:6988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:10.509255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:10.515763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:10.516161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:10.516504Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:10.516516Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:10.516527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:10.516579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:10.516617Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534752965368601:6981]
2025-10-02T08:14:10.517250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:10.517435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:10.517475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:10.517757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:10.517797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.517803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.517804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.517805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.517806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.517811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.517821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.517825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.517828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.517831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.517837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.517843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.517848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.517853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.517862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.517867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.517871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.517877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.517882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.517886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.517907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:10.528850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:10.530563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:10.530583Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:10.530585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:10.530588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:10.530595Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1970 [1:7556534752965368601:6981]
2025-10-02T08:14:10.530606Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:10.530623Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:10.530627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.530630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.530632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.530648Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:10.530652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:10.530658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:10.530724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.530732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.530734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:10.530736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:10.530789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:10.530794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.530803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.530813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:10.530828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534752965368595:6981]
2025-10-02T08:14:10.530833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534752965368595:6981]
2025-10-02T08:14:10.530839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:10.530852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:10.530858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:10.530861Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:10.530868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:10.530877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:10.530886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965368504:6988], now have 1 active actors on pipe
2025-10-02T08:14:10.530896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1970
2025-10-02T08:14:10.530917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534753424978008:2378], now have 1 active actors on pipe
2025-10-02T08:14:10.530920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534752965368595:6981]
2025-10-02T08:14:10.530926Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:10.530932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.530934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:10.530936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.530978Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:10.530986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.530989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.530965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1970
2025-10-02T08:14:10.530991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:10.530997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.531005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:10.531026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.531054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.531059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.531067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.531096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1971 partition: 0 MaxSeqNo: 17 sessionId: src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0
2025-10-02T08:14:10.531365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c65391-53837570-c1fc6086-fe25ca82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:10.533975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0] Write session: try to update token
2025-10-02T08:14:10.533992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:10.548229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId: src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:10.548881Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:10.548895Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:10.548897Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:10.548904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534752965368595:6981]
2025-10-02T08:14:10.548908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534752965368595:6981]
2025-10-02T08:14:10.548945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:10.548945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:10.548951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:10.548956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.548958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:10.549130Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:10.550811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:10.592590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534752965368625:8716]
2025-10-02T08:14:10.592731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1970, pipe: [1:7556534752965368625:8716]
2025-10-02T08:14:10.686862Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:10.687266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.687281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.687321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965368625:8716], now have 1 active actors on pipe
2025-10-02T08:14:10.687465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:10.687478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:10.687539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1971 reason: error at write: Disconnected sessionId: src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0
2025-10-02T08:14:10.687557Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:10.687540Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:10.687688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1971 sessionId: src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0 is DEAD
2025-10-02T08:14:10.687854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:10.687862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0] Write session will restart in 0.007234s
2025-10-02T08:14:10.687887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0] Write session: Do CDS request
2025-10-02T08:14:10.687894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:10.687883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534752965368625:8716]
2025-10-02T08:14:10.696341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.696393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:10.696411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1972
2025-10-02T08:14:10.696549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.696582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:10.696591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:10.696594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:10.697017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1972 sessionId:  describe result for acl check
2025-10-02T08:14:10.697059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:10.697065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:10.697067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:10.697073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534752965369022:7004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:10.697574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534752965369022:7004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:10.700108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534752965369022:7004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:10.703243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534752965369022:7004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:10.703259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534752965369022:7004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:10.703262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534752965369022:7004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:10.703270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:10.710179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:10.711733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:10.711935Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:10.711947Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:10.711957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:10.712012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:10.712048Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534752965369412:6996]
2025-10-02T08:14:10.712737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:10.712949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:10.712998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:10.713324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:10.713373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.713380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.713381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.713382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.713383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.713388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.713400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.713404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.713409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.713413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.713418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.713431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.713437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.713443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.713448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.713458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.713463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.713468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.713478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.713484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.713508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:10.721772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:10.723618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:10.723642Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:10.723644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:10.723648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:10.723654Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1971 [1:7556534752965369412:6996]
2025-10-02T08:14:10.723667Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:10.723684Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:10.723687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.723691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.723693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.723707Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:10.723712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:10.723719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:10.723781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.723790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.723793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:10.723796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:10.723862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:10.723869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.723882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.723900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:10.723921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965369266:7004], now have 1 active actors on pipe
2025-10-02T08:14:10.723932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534752965369406:6996]
2025-10-02T08:14:10.723937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1971
2025-10-02T08:14:10.723939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534752965369406:6996]
2025-10-02T08:14:10.723950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:10.723963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:10.723966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:10.723966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534753424978026:2378], now have 1 active actors on pipe
2025-10-02T08:14:10.723973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:10.723987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:10.723995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:10.724002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.724010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.724035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1971
2025-10-02T08:14:10.724050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534752965369406:6996]
2025-10-02T08:14:10.724060Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:10.724068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:10.724074Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:10.724081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.724085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.724087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:10.724096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.724103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:10.724145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.724225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.724228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.724241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.724277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1972 partition: 0 MaxSeqNo: 17 sessionId: src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0
2025-10-02T08:14:10.724597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65dbce09-916c2590-d539ffaa-31e59ae2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:10.727232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0] Write session: try to update token
2025-10-02T08:14:10.727248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:10.741086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId: src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:10.741338Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:10.741359Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:10.741361Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:10.741372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534752965369406:6996]
2025-10-02T08:14:10.741384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534752965369406:6996]
2025-10-02T08:14:10.741429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:10.741439Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:10.741442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.741444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:10.741447Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:10.741627Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:10.744020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:10.788165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534752965369439:8716]
2025-10-02T08:14:10.788357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1971, pipe: [1:7556534752965369439:8716]
2025-10-02T08:14:10.885447Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:10.885982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.885997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.886033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965369439:8716], now have 1 active actors on pipe
2025-10-02T08:14:10.886183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534752965369439:8716]
2025-10-02T08:14:10.886221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:10.886229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:10.886291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1972 reason: error at write: Disconnected sessionId: src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0
2025-10-02T08:14:10.886287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:10.886480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1972 sessionId: src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0 is DEAD
2025-10-02T08:14:10.886639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:10.886650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0] Write session will restart in 0.007563s
2025-10-02T08:14:10.886672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0] Write session: Do CDS request
2025-10-02T08:14:10.886683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:10.886703Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:10.895366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.895395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:10.895417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1973
2025-10-02T08:14:10.895556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:10.895589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:10.895598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:10.895601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:10.895952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1973 sessionId:  describe result for acl check
2025-10-02T08:14:10.895989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:10.895995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:10.895996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:10.896001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534752965369816:7070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:10.896434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534752965369816:7070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:10.899310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534752965369816:7070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:10.902387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534752965369816:7070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:10.902408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534752965369816:7070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:10.902411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534752965369816:7070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:10.902420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:10.908062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:10.909497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:10.909722Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:10.909731Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:10.909739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:10.909778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:10.909811Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534752965370213:7071]
2025-10-02T08:14:10.910300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:10.910452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:10.910489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:10.910738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:10.910791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.910797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.910798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.910799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.910800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.910805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.910815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.910818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.910822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.910825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.910830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.910836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:10.910843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.910847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:10.910857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.910862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:10.910866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.910870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.910875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.910884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.910903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:10.919282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:10.920922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:10.920941Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:10.920943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:10.920947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:10.920954Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1972 [1:7556534752965370213:7071]
2025-10-02T08:14:10.920966Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:10.920983Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:10.920990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.920993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.920996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.921013Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:10.921023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:10.921033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:10.921096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.921102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.921105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:10.921108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:10.921171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:10.921179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.921192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:10.921206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:10.921228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965370065:7070], now have 1 active actors on pipe
2025-10-02T08:14:10.921237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1972
2025-10-02T08:14:10.921238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534752965370207:7071]
2025-10-02T08:14:10.921241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534752965370207:7071]
2025-10-02T08:14:10.921248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:10.921256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:10.921258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534753424978034:2378], now have 1 active actors on pipe
2025-10-02T08:14:10.921261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:10.921265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:10.921276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:10.921279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:10.921286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.921290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.921333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534752965370207:7071]
2025-10-02T08:14:10.921345Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:10.921361Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:10.921367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.921347Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1972
2025-10-02T08:14:10.921376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.921378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:10.921386Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:10.921386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.921394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:10.921430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.921514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.921522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.921534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:10.921572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1973 partition: 0 MaxSeqNo: 17 sessionId: src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0
2025-10-02T08:14:10.921915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ca7f4bf-e22c82a6-39c5e0ac-5d9e4d0d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:10.924553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0] Write session: try to update token
2025-10-02T08:14:10.924571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:10.932472Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:10.932497Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:10.932506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534752965370207:7071]
2025-10-02T08:14:10.932549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:10.932561Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:10.932735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:10.932927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:10.933077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:10.933221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:10.933425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:10.933481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:10.938550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId: src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:10.941030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:10.941103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.941117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.941151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:10.941174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:10.941232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:10.941241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:10.941407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.941473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.941539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.941605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.941653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.941663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.941734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.941799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.941894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.941963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.942010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.942018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.942087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.942155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.942219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.942287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.942331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.942339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.942434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.942499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.942562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.942625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.942679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.942687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.942755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.942817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.942882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.942950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.942995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.943003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.943071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.943132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.943195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.943261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.943306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.943313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.943380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.943444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.943509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.943580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.943642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.943650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.943715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.943777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.943839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.943905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.943971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.943980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.944048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.944111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.944175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.944252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.944314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.944322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.944395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:10.944457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:10.944524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:10.944589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:10.944636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:10.944644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:10.944679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:10.944745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:10.944770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:10.944777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:10.944827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:10.944845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:10.944854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:10.944857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:10.944861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:10.945245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:10.945274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:10.945285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:10.945290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:10.945298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:10.945301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:10.946089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:10.946133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:10.946141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:10.946144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:10.946150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:10.946153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:10.946847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:10.946875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:10.946886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:10.946894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:10.946899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:10.948130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:10.948150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:10.948162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392850947
2025-10-02T08:14:10.948303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:10.948318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:10.948324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:10.948327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:10.948331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:10.948334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:10.948784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:10.948824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:10.948830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:10.948838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:10.948840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:10.948843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:10.949404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:10.949432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:10.949438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:10.949446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:10.949450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:10.949453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:10.949968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:10.949989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:10.949993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:10.951094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:10.951110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:10.951117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:10.951120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:10.951131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392850950
2025-10-02T08:14:10.951424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:10.951445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:10.951486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:10.951496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:10.951500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:10.951502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:10.951945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:10.951967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:10.951973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:10.951976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:10.951979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:10.951983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:10.952458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:10.952481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:10.952563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392850952
2025-10-02T08:14:10.953358Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:10.953379Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:10.953385Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:10.953391Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:10.954860Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:10.954874Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:10.954876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:10.954883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534752965370207:7071]
2025-10-02T08:14:10.954886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534752965370207:7071]
2025-10-02T08:14:10.954936Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:10.954940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:10.954943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:10.954944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:10.954953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:10.955064Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:10.986314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534752965370246:8716]
2025-10-02T08:14:10.986444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1972, pipe: [1:7556534752965370246:8716]
2025-10-02T08:14:11.088634Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:11.088994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534752965370246:8716], now have 1 active actors on pipe
2025-10-02T08:14:11.089136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534752965370246:8716]
2025-10-02T08:14:11.089176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:11.089179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:11.089290Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:11.089547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:11.089555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0] Write session will restart in 0.008545s
2025-10-02T08:14:11.089578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0] Write session: Do CDS request
2025-10-02T08:14:11.089593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:11.089207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1973 reason: error at write: Disconnected sessionId: src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0
2025-10-02T08:14:11.089356Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:11.089375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1973 sessionId: src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0 is DEAD
2025-10-02T08:14:11.099321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.099393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:11.099413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1974
2025-10-02T08:14:11.099535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.099563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:11.099573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:11.099577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:11.099946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1974 sessionId:  describe result for acl check
2025-10-02T08:14:11.099983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:11.099990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:11.099992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:11.099996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534757260337959:7077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:11.100511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534757260337959:7077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:11.102632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534757260337959:7077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:11.106067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534757260337959:7077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:11.106081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534757260337959:7077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:11.106084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534757260337959:7077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:11.106092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:11.111156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:11.112923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:11.113118Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:11.113130Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:11.113141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:11.113199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:11.113233Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534757260338319:7076]
2025-10-02T08:14:11.113842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:11.114045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:11.114093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:11.114394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:11.114461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.114468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.114470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.114471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.114472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.114477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.114488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.114497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.114501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.114509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.114516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.114527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.114537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.114542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.114551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.114560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.114568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.114572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.114576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.114580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.114599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:11.122729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:11.124331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:11.124345Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:11.124347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:11.124349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:11.124354Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1973 [1:7556534757260338319:7076]
2025-10-02T08:14:11.124363Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:11.124377Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:11.124383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.124385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.124386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.124400Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:11.124403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:11.124411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:11.124463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.124471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.124474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:11.124477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:11.124533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:11.124540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.124554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.124567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:11.124590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260338199:7077], now have 1 active actors on pipe
2025-10-02T08:14:11.124601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534757260338313:7076]
2025-10-02T08:14:11.124603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534757260338313:7076]
2025-10-02T08:14:11.124604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1973
2025-10-02T08:14:11.124610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:11.124620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:11.124623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:11.124631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:11.124637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:11.124640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:11.124646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534757719945336:2378], now have 1 active actors on pipe
2025-10-02T08:14:11.124650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.124653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.124690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534757260338313:7076]
2025-10-02T08:14:11.124702Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:11.124709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:11.124720Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:11.124730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.124734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.124737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:11.124746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.124758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:11.124785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.124884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.124892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.124904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.124939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1974 partition: 0 MaxSeqNo: 17 sessionId: src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0
2025-10-02T08:14:11.125250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ebfac9-69ce93a0-65f20d36-1cef6a54_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:11.126926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1973
2025-10-02T08:14:11.128020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0] Write session: try to update token
2025-10-02T08:14:11.128034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:11.137854Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:11.137880Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:11.137889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534757260338313:7076]
2025-10-02T08:14:11.137935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:11.137941Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:11.138153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:11.138344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:11.138510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:11.138676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:11.138897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:11.138941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:11.143341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1974 sessionId: src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:11.145957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:11.146026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.146039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.146073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:11.146098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:11.146146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.146176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.146357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.146425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.146496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.146578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.146859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.146873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.146946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.147011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.147082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.147154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.147202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.147210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.147283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.147346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.147415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.147489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.147535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.147544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.147618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.147686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.147757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.147828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.147875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.147883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.147956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.148025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.148094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.148165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.148235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.148244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.148315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.148386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.148454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.148523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.148589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.148597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.148670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.148735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.148830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.148903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.148955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.148963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.149033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.149102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.149170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.149238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.149290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.149298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.149367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.149437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.149506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.149573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.149621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.149628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.149699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.149762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.149831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.149898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.149964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.149972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.150016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:11.150086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.150111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.150118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:11.150150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:11.150168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:11.150176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:11.150179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:11.150183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:11.150600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:11.150630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:11.150638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:11.150642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:11.150645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:11.150648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:11.151301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:11.151329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:11.151334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:11.151339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:11.151343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:11.151346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:11.151835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:11.151869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:11.151876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:11.151885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:11.151889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:11.153279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:11.153302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:11.153315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392851153
2025-10-02T08:14:11.153498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:11.153514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:11.153519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:11.153523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:11.153527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:11.153531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:11.154033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:11.154059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:11.154071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:11.154079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:11.154085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:11.154088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:11.154558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:11.154581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:11.154590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:11.154594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:11.154601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:11.154605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:11.155078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:11.155103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:11.155108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:11.156228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:11.156249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:11.156254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:11.156260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:11.156268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392851154
2025-10-02T08:14:11.156559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:11.156582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:11.156588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:11.156591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:11.156595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:11.156598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:11.157129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:11.157153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:11.157158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:11.157162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:11.157166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:11.157170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:11.157656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:11.157678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.157772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392851157
2025-10-02T08:14:11.158573Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:11.158617Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:11.158629Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:11.158636Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:11.160564Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:11.160581Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:11.160583Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:11.160592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534757260338313:7076]
2025-10-02T08:14:11.160598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534757260338313:7076]
2025-10-02T08:14:11.160644Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:11.160655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:11.160658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:11.160659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.160661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:11.160793Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:11.189228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534757260338351:8716]
2025-10-02T08:14:11.189367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1973, pipe: [1:7556534757260338351:8716]
2025-10-02T08:14:11.307658Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:11.308029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260338351:8716], now have 1 active actors on pipe
2025-10-02T08:14:11.308154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:11.308161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:11.308185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1974 reason: error at write: Disconnected sessionId: src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0
2025-10-02T08:14:11.308242Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:11.308274Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:11.308371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1974 sessionId: src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0 is DEAD
2025-10-02T08:14:11.308544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:11.308561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0] Write session will restart in 0.008064s
2025-10-02T08:14:11.308589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0] Write session: Do CDS request
2025-10-02T08:14:11.308596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:11.308561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534757260338351:8716]
2025-10-02T08:14:11.318417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.318484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:11.318506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1975
2025-10-02T08:14:11.318637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.318682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:11.318692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:11.318696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:11.319262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1975 sessionId:  describe result for acl check
2025-10-02T08:14:11.319302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:11.319308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:11.319312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:11.319318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534757260338676:7104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:11.319849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534757260338676:7104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:11.322642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534757260338676:7104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:11.325814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534757260338676:7104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:11.325833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534757260338676:7104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:11.325836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534757260338676:7104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:11.325843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:11.333927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:11.335450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:11.335721Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:11.335732Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:11.335742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:11.335795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:11.335835Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534757260339130:7106]
2025-10-02T08:14:11.336495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:11.336696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:11.336736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:11.337064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:11.337116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.337121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.337123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.337124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.337125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.337131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.337142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.337150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.337154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.337158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.337164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.337175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.337182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.337188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.337197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.337206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.337215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.337220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.337229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.337239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.337262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:11.345260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:11.346845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:11.346864Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:11.346866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:11.346869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:11.346879Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1974 [1:7556534757260339130:7106]
2025-10-02T08:14:11.346890Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:11.346905Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:11.346912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.346915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.346917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.346928Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:11.346935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:11.346940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:11.346986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.346992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.346994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:11.346995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:11.347037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:11.347042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.347050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.347056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:11.347071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534757260339124:7106]
2025-10-02T08:14:11.347076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534757260339124:7106]
2025-10-02T08:14:11.347082Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:11.347090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:11.347096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:11.347099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:11.347102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:11.347104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:11.347104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1974
2025-10-02T08:14:11.347111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260338915:7104], now have 1 active actors on pipe
2025-10-02T08:14:11.347113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534757719945346:2378], now have 1 active actors on pipe
2025-10-02T08:14:11.347135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534757260339124:7106]
2025-10-02T08:14:11.347143Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:11.347147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.347150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.347154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:11.347180Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:11.347188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.347192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.347193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:11.347202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.347213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:11.347231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.347187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1974
2025-10-02T08:14:11.347302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.347308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.347319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.347346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1975 partition: 0 MaxSeqNo: 17 sessionId: src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0
2025-10-02T08:14:11.347636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c28ea-e621e49b-c6dbd854-45a40b78_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:11.350160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0] Write session: try to update token
2025-10-02T08:14:11.350174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:11.364608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId: src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:11.367159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:11.368859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.368883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.368901Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:11.368916Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:11.368918Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:11.368925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534757260339124:7106]
2025-10-02T08:14:11.368929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534757260339124:7106]
2025-10-02T08:14:11.368972Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:11.368978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:11.368983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.368985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:11.368990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:11.369121Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:11.408711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534757260339192:8716]
2025-10-02T08:14:11.408877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1974, pipe: [1:7556534757260339192:8716]
2025-10-02T08:14:11.520142Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:11.519255Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:11.519771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:11.519809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260339192:8716], now have 1 active actors on pipe
2025-10-02T08:14:11.519851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:11.519922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:11.519925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:11.519942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1975 reason: error at write: Disconnected sessionId: src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0
2025-10-02T08:14:11.520085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1975 sessionId: src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0 is DEAD
2025-10-02T08:14:11.520691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534757260339192:8716]
2025-10-02T08:14:11.520985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:11.520997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0] Write session will restart in 0.009617s
2025-10-02T08:14:11.521020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0] Write session: Do CDS request
2025-10-02T08:14:11.521030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:11.531356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.531426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:11.531450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1976
2025-10-02T08:14:11.531599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.531631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:11.531641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:11.531644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:11.532073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1976 sessionId:  describe result for acl check
2025-10-02T08:14:11.532109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:11.532118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:11.532119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:11.532124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534757260339668:7169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:11.532656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534757260339668:7169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:11.535176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534757260339668:7169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:11.539196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534757260339668:7169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:11.539221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534757260339668:7169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:11.539224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534757260339668:7169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:11.539233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:11.542752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:11.544893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:11.545111Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:11.545114Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:11.545125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:11.545177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:11.545224Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534757260339972:7167]
2025-10-02T08:14:11.545746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:11.545950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:11.546000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:11.546234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:11.546276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.546281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.546282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.546284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.546285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.546291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.546301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.546310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.546314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.546318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.546328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.546336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.546347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.546353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.546358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.546367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.546378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.546385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.546395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.546403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.546426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:11.555078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:11.556673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:11.556695Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:11.556697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:11.556700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:11.556705Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1975 [1:7556534757260339972:7167]
2025-10-02T08:14:11.556717Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:11.556732Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:11.556733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.556736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.556737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.556752Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:11.556757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:11.556763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:11.557378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.557390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.557394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:11.557397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:11.557466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:11.557475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.557489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.557500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:11.557517Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534757260339966:7167]
2025-10-02T08:14:11.557519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534757260339966:7167]
2025-10-02T08:14:11.557527Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:11.557540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:11.557542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:11.557549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:11.557556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:11.557558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:11.557569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260339921:7169], now have 1 active actors on pipe
2025-10-02T08:14:11.557603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534757260339966:7167]
2025-10-02T08:14:11.557612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:11.557618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534757719945375:2378], now have 1 active actors on pipe
2025-10-02T08:14:11.557624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:11.557649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1975
2025-10-02T08:14:11.557679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.557687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.557711Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:11.557722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.557727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.557733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:11.557743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.557757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:11.557781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.557813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.557819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.557830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.557869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1976 partition: 0 MaxSeqNo: 17 sessionId: src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0
2025-10-02T08:14:11.558201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90aa26-5b09bac0-cec8d0c3-a41ccc96_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:11.557709Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1975
2025-10-02T08:14:11.560899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0] Write session: try to update token
2025-10-02T08:14:11.560916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:11.575844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId: src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:11.578817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:11.579001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.579023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.579043Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:11.579051Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:11.579053Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:11.579060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534757260339966:7167]
2025-10-02T08:14:11.579064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534757260339966:7167]
2025-10-02T08:14:11.579102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:11.579115Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:11.579117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:11.579124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.579127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:11.579274Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:11.619671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534757260339997:8716]
2025-10-02T08:14:11.619842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1975, pipe: [1:7556534757260339997:8716]
2025-10-02T08:14:11.713593Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:11.714349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:11.714405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260339997:8716], now have 1 active actors on pipe
2025-10-02T08:14:11.714406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:11.714485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:11.714491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:11.714506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1976 reason: error at write: Disconnected sessionId: src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0
2025-10-02T08:14:11.714615Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:11.714626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1976 sessionId: src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0 is DEAD
2025-10-02T08:14:11.714775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534757260339997:8716]
2025-10-02T08:14:11.714791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:11.714798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0] Write session will restart in 0.008255s
2025-10-02T08:14:11.714827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0] Write session: Do CDS request
2025-10-02T08:14:11.714836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:11.724330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.724374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:11.724389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1977
2025-10-02T08:14:11.724567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.724608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:11.724617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:11.724620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:11.725014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1977 sessionId:  describe result for acl check
2025-10-02T08:14:11.725052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:11.725057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:11.725059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:11.725064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534757260340369:7179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:11.725544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534757260340369:7179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:11.727983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534757260340369:7179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:11.731594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534757260340369:7179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:11.731609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534757260340369:7179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:11.731612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534757260340369:7179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:11.731620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:11.738150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:11.740354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:11.740566Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:11.740575Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:11.740583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:11.740632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:11.740668Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534757260340800:7177]
2025-10-02T08:14:11.741309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:11.741512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:11.741556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:11.741840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:11.741881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.741886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.741888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.741889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.741890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.741894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.741904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.741908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.741912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.741916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.741921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.741928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.741934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.741939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.741943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.741948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.741952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.741957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.741962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.741967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.741989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:11.750164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:11.752225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:11.752242Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:11.752244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:11.752248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:11.752254Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1976 [1:7556534757260340800:7177]
2025-10-02T08:14:11.752265Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:11.752281Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:11.752283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.752286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.752294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.752308Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:11.752312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:11.752318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:11.752381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.752388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.752390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:11.752393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:11.752456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:11.752463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.752477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.752493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:11.752492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1976
2025-10-02T08:14:11.752514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260340629:7179], now have 1 active actors on pipe
2025-10-02T08:14:11.752522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534757719945394:2378], now have 1 active actors on pipe
2025-10-02T08:14:11.752527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534757260340794:7177]
2025-10-02T08:14:11.752533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534757260340794:7177]
2025-10-02T08:14:11.752544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:11.752552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.752556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:11.752557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:11.752560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.752576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:11.752589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:11.752598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:11.752642Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13f95625-44788a75-c9b4b8be-27cc320d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:11.752607Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1976
2025-10-02T08:14:11.752651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.752655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.752657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:11.752664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.752672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:11.752679Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534757260340794:7177]
2025-10-02T08:14:11.752688Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:11.752692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:11.752717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.752752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.752760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.752772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.752828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1977 partition: 0 MaxSeqNo: 17 sessionId: src_id|13f95625-44788a75-c9b4b8be-27cc320d_0
2025-10-02T08:14:11.753160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133420df-8b44dcc7-f7ff724e-4c51c63a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|13f95625-44788a75-c9b4b8be-27cc320d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:11.755781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f95625-44788a75-c9b4b8be-27cc320d_0] Write session: try to update token
2025-10-02T08:14:11.755798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f95625-44788a75-c9b4b8be-27cc320d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:11.763723Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:11.763742Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:11.763752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534757260340794:7177]
2025-10-02T08:14:11.763797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:11.763799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:11.763962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:11.764113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:11.764275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:11.764414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:11.764605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:11.764651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:11.769559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId: src_id|13f95625-44788a75-c9b4b8be-27cc320d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:11.772089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:11.772183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.772197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.772250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:11.772276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:11.772367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.772383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.772556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.772624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.772699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.772783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.773177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.773188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.773261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.773367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.773433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.773500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.773544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.773552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.773620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.773681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.773741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.773804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.773856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.773866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.773931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.773997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.774063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.774127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.774185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.774193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.774262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.774324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.774388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.774456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.774505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.774513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.774582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.774650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.774723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.774791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.774838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.774847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.774919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.774988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.775056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.775122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.775174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.775182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.775255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.775318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.775388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.775458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.775503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.775511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.775583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.775648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.775713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.775781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.775831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.775839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.775909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:11.775974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:11.776043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:11.776108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:11.776156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:11.776164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:11.776221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:11.776292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.776317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.776325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:11.776359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:11.776375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:11.776384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:11.776388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:11.776391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:11.776840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:11.776866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:11.776874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:11.776883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:11.776888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:11.776892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:11.777566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:11.777592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:11.777604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:11.777613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:11.777617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:11.777620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:11.778215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:11.778240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:11.778246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:11.778250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:11.778254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:11.787514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:11.787544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:11.787563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392851787
2025-10-02T08:14:11.787697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:11.787717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:11.787726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:11.787739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:11.787750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:11.787753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:11.788265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:11.788289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:11.788296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:11.788305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:11.788373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:11.788382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:11.788910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:11.788935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:11.788943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:11.788947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:11.788951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:11.788955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:11.789483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:11.789513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:11.789519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:11.790653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:11.790673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:11.790679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:11.790684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:11.790693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392851790
2025-10-02T08:14:11.791009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:11.791035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:11.791041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:11.791045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:11.791049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:11.791053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:11.791534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:11.791558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:11.791563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:11.791570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:11.791579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:11.791582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:11.792061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:11.792082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.792180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392851792
2025-10-02T08:14:11.793022Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:11.793045Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:11.793054Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:11.793067Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:11.794685Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:11.794699Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:11.794701Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:11.794712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534757260340794:7177]
2025-10-02T08:14:11.794716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534757260340794:7177]
2025-10-02T08:14:11.794771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:11.794781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.794779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:11.794783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:11.794786Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:11.794912Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:11.814723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534757260340835:8716]
2025-10-02T08:14:11.814831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1976, pipe: [1:7556534757260340835:8716]
2025-10-02T08:14:11.940983Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:11.941334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260340835:8716], now have 1 active actors on pipe
2025-10-02T08:14:11.941434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:11.941440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:11.941462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1977 reason: error at write: Disconnected sessionId: src_id|13f95625-44788a75-c9b4b8be-27cc320d_0
2025-10-02T08:14:11.941561Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:11.941549Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:11.941618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1977 sessionId: src_id|13f95625-44788a75-c9b4b8be-27cc320d_0 is DEAD
2025-10-02T08:14:11.941744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f95625-44788a75-c9b4b8be-27cc320d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:11.941751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f95625-44788a75-c9b4b8be-27cc320d_0] Write session will restart in 0.009970s
2025-10-02T08:14:11.941769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f95625-44788a75-c9b4b8be-27cc320d_0] Write session: Do CDS request
2025-10-02T08:14:11.941773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f95625-44788a75-c9b4b8be-27cc320d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:11.941776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534757260340835:8716]
2025-10-02T08:14:11.953258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f95625-44788a75-c9b4b8be-27cc320d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.953331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:11.953344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1978
2025-10-02T08:14:11.953441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:11.953479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:11.953489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:11.953492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:11.953875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1978 sessionId:  describe result for acl check
2025-10-02T08:14:11.953899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:11.953904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:11.953905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:11.953909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534757260341323:7219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:11.954325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534757260341323:7219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:11.956874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534757260341323:7219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:11.959584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534757260341323:7219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:11.959598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534757260341323:7219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:11.959601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534757260341323:7219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:11.959608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:11.962161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:11.963955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:11.964131Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:11.964143Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:11.964153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:11.964231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:11.964272Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534757260341619:7225]
2025-10-02T08:14:11.964893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:11.965071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:11.965121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:11.965416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:11.965465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.965471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.965472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.965473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.965475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.965479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.965489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.965493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.965497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.965500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.965506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.965513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:11.965522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.965527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:11.965531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.965541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:11.965546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.965555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.965560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.965570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.965589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:11.976421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:11.978180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:11.978202Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:11.978205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:11.978209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:11.978215Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1977 [1:7556534757260341619:7225]
2025-10-02T08:14:11.978228Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:11.978246Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:11.978249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.978252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.978255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.978273Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:11.978278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:11.978284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:11.978349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.978357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.978361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:11.978363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:11.978428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:11.978438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.978452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:11.978467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:11.978487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534757260341613:7225]
2025-10-02T08:14:11.978494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534757260341613:7225]
2025-10-02T08:14:11.978503Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:11.978514Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:11.978519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1977
2025-10-02T08:14:11.978521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534757260341575:7219], now have 1 active actors on pipe
2025-10-02T08:14:11.978523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:11.978528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534757719945404:2378], now have 1 active actors on pipe
2025-10-02T08:14:11.978533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:11.978544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:11.978547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:11.978583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.978592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.978605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534757260341613:7225]
2025-10-02T08:14:11.978612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:11.978601Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1977
2025-10-02T08:14:11.978624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:11.978636Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:11.978642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:11.978649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:11.978651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:11.978660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:11.978673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:11.978703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.978787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:11.978794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:11.978807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:11.978846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1978 partition: 0 MaxSeqNo: 17 sessionId: src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0
2025-10-02T08:14:11.979149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f95625-44788a75-c9b4b8be-27cc320d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:11.981846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0] Write session: try to update token
2025-10-02T08:14:11.981863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:11.995780Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:11.995796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:11.995798Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:11.995805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534757260341613:7225]
2025-10-02T08:14:11.995808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534757260341613:7225]
2025-10-02T08:14:11.995840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:11.995846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:11.995847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:11.995873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:11.995879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:11.995974Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:11.996190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId: src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:11.998649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:12.042085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534761555308942:8716]
2025-10-02T08:14:12.042219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1977, pipe: [1:7556534761555308942:8716]
2025-10-02T08:14:12.126395Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:12.126858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.126869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.126900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555308942:8716], now have 1 active actors on pipe
2025-10-02T08:14:12.127001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:12.127011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:12.127076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1978 reason: error at write: Disconnected sessionId: src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0
2025-10-02T08:14:12.127133Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:12.127261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1978 sessionId: src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0 is DEAD
2025-10-02T08:14:12.127408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:12.127419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0] Write session will restart in 0.008470s
2025-10-02T08:14:12.127441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0] Write session: Do CDS request
2025-10-02T08:14:12.127447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:12.127434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534761555308942:8716]
2025-10-02T08:14:12.128116Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:12.137278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.137377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:12.137388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1979
2025-10-02T08:14:12.137492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.137512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:12.137519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:12.137522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:12.137825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1979 sessionId:  describe result for acl check
2025-10-02T08:14:12.137848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:12.137862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:12.137863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:12.137866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534761555309380:7244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:12.138219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534761555309380:7244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:12.140324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534761555309380:7244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:12.143310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534761555309380:7244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:12.143322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534761555309380:7244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:12.143325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534761555309380:7244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:12.143331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:12.146923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:12.148501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:12.148642Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:12.148649Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:12.148656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:12.148695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:12.148722Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534761555309728:7257]
2025-10-02T08:14:12.149159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:12.149325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:12.149356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:12.149573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:12.149603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.149608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.149609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.149609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.149610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.149613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.149619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.149621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.149623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.149625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.149629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.149633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.149636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.149639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.149642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.149644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.149647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.149649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.149653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.149656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.149666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:12.157230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:12.158872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:12.158887Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:12.158889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:12.158892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:12.158896Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1978 [1:7556534761555309728:7257]
2025-10-02T08:14:12.158905Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:12.158919Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:12.158921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.158923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.158925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.158936Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:12.158940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:12.158944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:12.158994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.159000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.159003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:12.159005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:12.159052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:12.159058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.159066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.159073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:12.159086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534761555309722:7257]
2025-10-02T08:14:12.159088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534761555309722:7257]
2025-10-02T08:14:12.159099Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:12.159111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:12.159120Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:12.159123Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:12.159123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:12.159126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:12.159135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555309632:7244], now have 1 active actors on pipe
2025-10-02T08:14:12.159144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1978
2025-10-02T08:14:12.159226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1978
2025-10-02T08:14:12.159166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534762014912706:2378], now have 1 active actors on pipe
2025-10-02T08:14:12.159173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534761555309722:7257]
2025-10-02T08:14:12.159180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:12.159186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.159189Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:12.159189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.159227Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c333650-a1e2dc33-98f80046-62b36977_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:12.159232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.159235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.159237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:12.159245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.159253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:12.159275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.159316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.159317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.159326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.159356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1979 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c333650-a1e2dc33-98f80046-62b36977_0
2025-10-02T08:14:12.159672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d4bf33-8cdef7ed-7005ddc9-976ab728_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c333650-a1e2dc33-98f80046-62b36977_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:12.162198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333650-a1e2dc33-98f80046-62b36977_0] Write session: try to update token
2025-10-02T08:14:12.162218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333650-a1e2dc33-98f80046-62b36977_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:12.178541Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:12.178561Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:12.178563Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:12.178571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534761555309722:7257]
2025-10-02T08:14:12.178576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534761555309722:7257]
2025-10-02T08:14:12.178619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:12.178626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.178628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:12.178627Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:12.178634Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:12.178765Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:12.182097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId: src_id|9c333650-a1e2dc33-98f80046-62b36977_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:12.184661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:12.227422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534761555309752:8716]
2025-10-02T08:14:12.227531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1978, pipe: [1:7556534761555309752:8716]
2025-10-02T08:14:12.317622Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:12.318146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.318164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.318205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555309752:8716], now have 1 active actors on pipe
2025-10-02T08:14:12.318301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534761555309752:8716]
2025-10-02T08:14:12.318322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:12.318324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:12.318371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1979 reason: error at write: Disconnected sessionId: src_id|9c333650-a1e2dc33-98f80046-62b36977_0
2025-10-02T08:14:12.318415Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:12.318538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1979 sessionId: src_id|9c333650-a1e2dc33-98f80046-62b36977_0 is DEAD
2025-10-02T08:14:12.318717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333650-a1e2dc33-98f80046-62b36977_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:12.318733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333650-a1e2dc33-98f80046-62b36977_0] Write session will restart in 0.008925s
2025-10-02T08:14:12.318758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333650-a1e2dc33-98f80046-62b36977_0] Write session: Do CDS request
2025-10-02T08:14:12.318768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333650-a1e2dc33-98f80046-62b36977_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:12.318478Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:12.329381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333650-a1e2dc33-98f80046-62b36977_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.329434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:12.329449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1980
2025-10-02T08:14:12.329668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.329698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:12.329701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:12.329703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:12.330089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1980 sessionId:  describe result for acl check
2025-10-02T08:14:12.330118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:12.330124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:12.330126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:12.330131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534761555310171:7265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:12.330616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534761555310171:7265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:12.333507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534761555310171:7265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:12.336486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534761555310171:7265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:12.336502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534761555310171:7265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:12.336505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534761555310171:7265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:12.336512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:12.341070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:12.342695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:12.343170Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:12.343182Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:12.343191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:12.343234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:12.343268Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534761555310555:7264]
2025-10-02T08:14:12.343888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:12.344087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:12.344123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:12.344418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:12.344459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.344465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.344466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.344467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.344468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.344472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.344481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.344485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.344489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.344493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.344498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.344509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.344516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.344520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.344526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.344535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.344543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.344552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.344560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.344564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.344586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:12.352443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:12.353935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:12.353951Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:12.353954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:12.353957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:12.353963Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1979 [1:7556534761555310555:7264]
2025-10-02T08:14:12.353975Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:12.353993Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:12.354001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.354004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.354006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.354019Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:12.354028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:12.354034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:12.354092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.354099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.354102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:12.354104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:12.354167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:12.354174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.354185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.354201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:12.354221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555310443:7265], now have 1 active actors on pipe
2025-10-02T08:14:12.354222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1979
2025-10-02T08:14:12.354229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534762014912716:2378], now have 1 active actors on pipe
2025-10-02T08:14:12.354235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534761555310542:7264]
2025-10-02T08:14:12.354237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534761555310542:7264]
2025-10-02T08:14:12.354248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:12.354256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.354260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.354261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:12.354264Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:12.354276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:12.354289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:12.354292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:12.354329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afb1305f-7a596316-7fd57707-5fc70f82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:12.354339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.354345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.354316Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1979
2025-10-02T08:14:12.354347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:12.354356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.354363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:12.354372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534761555310542:7264]
2025-10-02T08:14:12.354381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:12.354414Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:12.354416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.354460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.354467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.354479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.354525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1980 partition: 0 MaxSeqNo: 17 sessionId: src_id|afb1305f-7a596316-7fd57707-5fc70f82_0
2025-10-02T08:14:12.354816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c333650-a1e2dc33-98f80046-62b36977_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|afb1305f-7a596316-7fd57707-5fc70f82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:12.357257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb1305f-7a596316-7fd57707-5fc70f82_0] Write session: try to update token
2025-10-02T08:14:12.357271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb1305f-7a596316-7fd57707-5fc70f82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:12.370047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId: src_id|afb1305f-7a596316-7fd57707-5fc70f82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:12.371420Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:12.371436Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:12.371439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:12.371446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534761555310542:7264]
2025-10-02T08:14:12.371450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534761555310542:7264]
2025-10-02T08:14:12.371486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:12.371487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:12.371492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:12.371494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.371496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:12.371619Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:12.372591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:12.431821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534761555310596:8716]
2025-10-02T08:14:12.432013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1979, pipe: [1:7556534761555310596:8716]
2025-10-02T08:14:12.509359Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:12.510107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.510123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.510161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555310596:8716], now have 1 active actors on pipe
2025-10-02T08:14:12.510284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:12.510298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:12.510359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1980 reason: error at write: Disconnected sessionId: src_id|afb1305f-7a596316-7fd57707-5fc70f82_0
2025-10-02T08:14:12.510399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:12.510559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1980 sessionId: src_id|afb1305f-7a596316-7fd57707-5fc70f82_0 is DEAD
2025-10-02T08:14:12.510616Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:12.510753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534761555310596:8716]
2025-10-02T08:14:12.510774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb1305f-7a596316-7fd57707-5fc70f82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:12.510790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb1305f-7a596316-7fd57707-5fc70f82_0] Write session will restart in 0.008528s
2025-10-02T08:14:12.510829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb1305f-7a596316-7fd57707-5fc70f82_0] Write session: Do CDS request
2025-10-02T08:14:12.510838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb1305f-7a596316-7fd57707-5fc70f82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:12.515565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:12.516467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:12.516642Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:12.516652Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:12.516661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:12.516705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:12.516754Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534761555310682:7354]
2025-10-02T08:14:12.517392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:12.517590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:12.517634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:12.517954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:12.517999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.518005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.518007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.518008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.518009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.518014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.518024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.518027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.518030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.518033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.518039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.518046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.518051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.518056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.518060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.518065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.518069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.518074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.518079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.518083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.518102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:12.520468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb1305f-7a596316-7fd57707-5fc70f82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.520545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:12.520557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1981
2025-10-02T08:14:12.520731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.520761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:12.520770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:12.520773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:12.521217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1981 sessionId:  describe result for acl check
2025-10-02T08:14:12.521255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:12.521261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:12.521263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:12.521268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534761555310698:7395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:12.521783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534761555310698:7395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:12.523809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534761555310698:7395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:12.525629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:12.526923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534761555310698:7395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:12.526935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534761555310698:7395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:12.526937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534761555310698:7395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:12.526944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:12.527171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:12.527188Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:12.527191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:12.527195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:12.527200Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1980 [1:7556534761555310682:7354]
2025-10-02T08:14:12.527211Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:12.527226Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:12.527234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.527237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.527239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.527258Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:12.527269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:12.527275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:12.527346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.527353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.527356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:12.527359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:12.527416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:12.527422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.527436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.527446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:12.527446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1980
2025-10-02T08:14:12.527468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534762014912744:2378], now have 1 active actors on pipe
2025-10-02T08:14:12.527475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555310729:7395], now have 1 active actors on pipe
2025-10-02T08:14:12.527481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.527484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.527501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534761555310676:7354]
2025-10-02T08:14:12.527507Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534761555310676:7354]
2025-10-02T08:14:12.527515Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:12.527523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:12.527527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:12.527530Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:12.527539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:12.527542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:12.527506Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1980
2025-10-02T08:14:12.527558Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:12.527568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.527572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.527574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:12.527582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.527595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:12.527639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534761555310676:7354]
2025-10-02T08:14:12.527651Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:12.527663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:12.527667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.527707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.527713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.527725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.527758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1981 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0
2025-10-02T08:14:12.528092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb1305f-7a596316-7fd57707-5fc70f82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:12.530827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0] Write session: try to update token
2025-10-02T08:14:12.530843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:12.537945Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:12.537964Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:12.537973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534761555310676:7354]
2025-10-02T08:14:12.538015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:12.538016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:12.538191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:12.538352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.538494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.538647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.538848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:12.538890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:12.544250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId: src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:12.546944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:12.547015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.547028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.547059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:12.547081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:12.547146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.547163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.547368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.547434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.547516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.547582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.547627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.547636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.547705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.547764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.547847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.547936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.547986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.547994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.548064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.548119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.548175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.548247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.548288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.548294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.548364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.548446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.548530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.548594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.548635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.548641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.548703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.548759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.548840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.548899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.548973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.548981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.549069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.549140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.549201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.549263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.549306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.549311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.549375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.549431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.549500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.549583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.549638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.549647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.549723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.549778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.549835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.549929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.549971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.549977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.550040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.550111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.550199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.550289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.550345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.550350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.550411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.550465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.550520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.550577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.550641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.550649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.550692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:12.550766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.550788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.550793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:12.550817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:12.550831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:12.550836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:12.550838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:12.550840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:12.551198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:12.551227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:12.551239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:12.551243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:12.551247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:12.551250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:12.551984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:12.552006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:12.552011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:12.552015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:12.552017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:12.552018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:12.552497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:12.552516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:12.552522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:12.552524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:12.552526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:12.553622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:12.553638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:12.553646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392852553
2025-10-02T08:14:12.553804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:12.553814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:12.553817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:12.553819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:12.553822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:12.553824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:12.554226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:12.554244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:12.554247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:12.554251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:12.554253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:12.554256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:12.554648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:12.554663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:12.554668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:12.554671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:12.554673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:12.554675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:12.555088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:12.555102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:12.555105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:12.556030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:12.556040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:12.556044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:12.556046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:12.556052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392852556
2025-10-02T08:14:12.556314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:12.556330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:12.556336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:12.556340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:12.556342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:12.556344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:12.556768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:12.556792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:12.556798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:12.556818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:12.556822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:12.556827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:12.557280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:12.557300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.557390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392852557
2025-10-02T08:14:12.558100Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:12.558114Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:12.558118Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:12.558122Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:12.559582Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:12.559595Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:12.559596Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:12.559607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534761555310676:7354]
2025-10-02T08:14:12.559610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534761555310676:7354]
2025-10-02T08:14:12.559651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:12.559660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.559661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:12.559660Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:12.559666Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:12.559782Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:12.610886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534761555310751:8716]
2025-10-02T08:14:12.610969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1980, pipe: [1:7556534761555310751:8716]
2025-10-02T08:14:12.699235Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:12.699623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555310751:8716], now have 1 active actors on pipe
2025-10-02T08:14:12.699743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:12.699753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:12.699784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1981 reason: error at write: Disconnected sessionId: src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0
2025-10-02T08:14:12.699847Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:12.699944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:12.699950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1981 sessionId: src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0 is DEAD
2025-10-02T08:14:12.700066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:12.700075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0] Write session will restart in 0.008868s
2025-10-02T08:14:12.700099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0] Write session: Do CDS request
2025-10-02T08:14:12.700105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:12.700143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534761555310751:8716]
2025-10-02T08:14:12.705316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:12.706256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:12.706447Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:12.706456Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:12.706465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:12.706520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:12.706556Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534761555310825:7402]
2025-10-02T08:14:12.707187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:12.707341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:12.707378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:12.707659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:12.707702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.707707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.707708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.707709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.707710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.707715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.707726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.707729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.707733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.707736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.707742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.707750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.707756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.707761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.707765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.707769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.707774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.707783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.707791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.707798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.707824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:12.710369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:12.710381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1982
2025-10-02T08:14:12.710391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.710670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.710701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:12.710706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:12.710709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:12.711128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1982 sessionId:  describe result for acl check
2025-10-02T08:14:12.711163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:12.711169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:12.711170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:12.711175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534761555310841:7420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:12.711707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534761555310841:7420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:12.713573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534761555310841:7420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:12.715409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:12.716123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534761555310841:7420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:12.716139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534761555310841:7420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:12.716142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534761555310841:7420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:12.716149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:12.717098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:12.717111Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:12.717114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:12.717117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:12.717122Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1981 [1:7556534761555310825:7402]
2025-10-02T08:14:12.717132Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:12.717148Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:12.717151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.717154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.717156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.717171Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:12.717176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:12.717181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:12.717241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.717249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.717252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:12.717254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:12.717311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:12.717318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.717330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.717345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1981
2025-10-02T08:14:12.717350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:12.717367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555310872:7420], now have 1 active actors on pipe
2025-10-02T08:14:12.717370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534762014912762:2378], now have 1 active actors on pipe
2025-10-02T08:14:12.717374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.717378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.717393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534761555310819:7402]
2025-10-02T08:14:12.717400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534761555310819:7402]
2025-10-02T08:14:12.717411Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:12.717423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:12.717430Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:12.717434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:12.717440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:12.717442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:12.717455Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8da3eae-f4887b51-a01b1280-40613df9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:12.717465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.717434Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1981
2025-10-02T08:14:12.717471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.717477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:12.717485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.717497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:12.717531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534761555310819:7402]
2025-10-02T08:14:12.717542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:12.717560Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:12.717563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.717608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.717616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.717628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.717656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1982 partition: 0 MaxSeqNo: 17 sessionId: src_id|f8da3eae-f4887b51-a01b1280-40613df9_0
2025-10-02T08:14:12.717931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1330c24-3d2bd69d-9157d1b5-cc8a7142_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f8da3eae-f4887b51-a01b1280-40613df9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:12.720540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8da3eae-f4887b51-a01b1280-40613df9_0] Write session: try to update token
2025-10-02T08:14:12.720555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8da3eae-f4887b51-a01b1280-40613df9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:12.727969Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:12.727987Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:12.727997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534761555310819:7402]
2025-10-02T08:14:12.728037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:12.728040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:12.728223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:12.728404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.728554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.728696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.728912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:12.728957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:12.735352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId: src_id|f8da3eae-f4887b51-a01b1280-40613df9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:12.737853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:12.737932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.737943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.737970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:12.737991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:12.738049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.738055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.738204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.738271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.738335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.738429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.738475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.738485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.738553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.738625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.738695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.738767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.738811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.738818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.738890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.738953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.739015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.739078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.739120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.739126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.739192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.739257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.739324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.739390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.739434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.739440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.739509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.739575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.739638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.739703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.739751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.739758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.739824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.739886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.739952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.740015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.740060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.740067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.740132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.740196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.740274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.740342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.740393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.740404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.740473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.740537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.740605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.740669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.740714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.740720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.740786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.740886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.740950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.741015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.741059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.741066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.741127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.741190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.741253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.741315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.741359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.741367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.741416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:12.741479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.741502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.741505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:12.741533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:12.741548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:12.741555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:12.741558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:12.741560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:12.741966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:12.741991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:12.742001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:12.742007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:12.742010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:12.742013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:12.742485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:12.742506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:12.742511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:12.742514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:12.742517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:12.742521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:12.743039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:12.743061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:12.743070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:12.743073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:12.743076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:12.744350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:12.744365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:12.744376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392852743
2025-10-02T08:14:12.744542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:12.744554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:12.744559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:12.744564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:12.744571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:12.744575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:12.745122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:12.745143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:12.745148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:12.745153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:12.745155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:12.745158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:12.745663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:12.745682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:12.745692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:12.745695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:12.745699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:12.745702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:12.746161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:12.746183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:12.746188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:12.747318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:12.747336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:12.747343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:12.747346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:12.747354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392852747
2025-10-02T08:14:12.747651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:12.747671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:12.747677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:12.747682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:12.747685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:12.747688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:12.748159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:12.748183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:12.748189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:12.748193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:12.748199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:12.748212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:12.748704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:12.748723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.748835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392852748
2025-10-02T08:14:12.749578Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:12.749594Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:12.749598Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:12.749601Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:12.751138Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:12.751151Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:12.751152Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:12.751159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534761555310819:7402]
2025-10-02T08:14:12.751162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534761555310819:7402]
2025-10-02T08:14:12.751216Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:12.751222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:12.751227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.751228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:12.751231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:12.751367Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:12.800353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534761555310899:8716]
2025-10-02T08:14:12.800578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1981, pipe: [1:7556534761555310899:8716]
2025-10-02T08:14:12.884004Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:12.884375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555310899:8716], now have 1 active actors on pipe
2025-10-02T08:14:12.884490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534761555310899:8716]
2025-10-02T08:14:12.884512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:12.884514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:12.884542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1982 reason: error at write: Disconnected sessionId: src_id|f8da3eae-f4887b51-a01b1280-40613df9_0
2025-10-02T08:14:12.884610Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:12.884656Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:12.884744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1982 sessionId: src_id|f8da3eae-f4887b51-a01b1280-40613df9_0 is DEAD
2025-10-02T08:14:12.884889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8da3eae-f4887b51-a01b1280-40613df9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:12.884896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8da3eae-f4887b51-a01b1280-40613df9_0] Write session will restart in 0.009290s
2025-10-02T08:14:12.884919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8da3eae-f4887b51-a01b1280-40613df9_0] Write session: Do CDS request
2025-10-02T08:14:12.884924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8da3eae-f4887b51-a01b1280-40613df9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:12.890756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:12.891967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:12.892128Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:12.892135Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:12.892144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:12.892188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:12.892234Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534761555310961:7433]
2025-10-02T08:14:12.892642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:12.892794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:12.892843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:12.893088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:12.893129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.893134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.893135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.893136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.893137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.893142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.893151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.893154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.893158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.893162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.893167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.893174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:12.893180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.893189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:12.893194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.893202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:12.893207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.893215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.893219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.893227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.893246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:12.895293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8da3eae-f4887b51-a01b1280-40613df9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.896926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:12.896942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1983
2025-10-02T08:14:12.897111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:12.897154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:12.897163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:12.897167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:12.897587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1983 sessionId:  describe result for acl check
2025-10-02T08:14:12.897622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:12.897628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:12.897629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:12.897634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534761555310977:7429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:12.898096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534761555310977:7429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:12.900023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534761555310977:7429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:12.901019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:12.902753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534761555310977:7429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:12.902755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:12.902762Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:12.902765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:12.902770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534761555310977:7429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:12.902770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:12.902773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534761555310977:7429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:12.902777Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1982 [1:7556534761555310961:7433]
2025-10-02T08:14:12.902780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:12.902790Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:12.902811Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:12.902814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.902817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.902820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.902841Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:12.902846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:12.902854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:12.902926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.902943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.902945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:12.902948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:12.903008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:12.903017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.903028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:12.903044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:12.903059Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1982
2025-10-02T08:14:12.903068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534762014912770:2378], now have 1 active actors on pipe
2025-10-02T08:14:12.903082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534761555310955:7433]
2025-10-02T08:14:12.903084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534761555310955:7433]
2025-10-02T08:14:12.903091Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:12.903099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:12.903102Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:12.903104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:12.903119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:12.903122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:12.903128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555311008:7429], now have 1 active actors on pipe
2025-10-02T08:14:12.903164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534761555310955:7433]
2025-10-02T08:14:12.903171Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:12.903191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:12.903192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1982
2025-10-02T08:14:12.903202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.903206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.903229Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:12.903235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.903239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.903241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:12.903251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.903261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:12.903275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.903311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.903316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.903340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:12.903382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1983 partition: 0 MaxSeqNo: 17 sessionId: src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0
2025-10-02T08:14:12.903715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8da3eae-f4887b51-a01b1280-40613df9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:12.906601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0] Write session: try to update token
2025-10-02T08:14:12.906617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:12.914385Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:12.914408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:12.914418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534761555310955:7433]
2025-10-02T08:14:12.914460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:12.914473Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:12.914634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:12.914771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.914910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.915051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:12.915246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:12.915285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:12.922373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId: src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:12.924860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:12.924931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.924944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.924976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:12.925013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:12.925080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:12.925083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:12.925234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.925305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.925372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.925435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.925472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.925477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.925548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.925601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.925652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.925713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.925753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.925757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.925820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.925871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.925930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.925994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.926036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.926039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.926105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.926167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.926230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.926296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.926338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.926341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.926411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.926472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.926531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.926588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.926626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.926629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.926690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.926744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.926801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.926862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.926899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.926902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.926973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.927024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.927080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.927134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.927176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.927178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.927244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.927308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.927372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.927428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.927466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.927468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.927530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.927590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.927644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.927696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.927736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.927738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.927795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:12.927852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:12.927903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:12.927955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:12.927991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:12.927992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:12.928029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:12.928078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:12.928090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:12.928092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:12.928119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:12.928130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:12.928132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:12.928134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:12.928136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:12.928501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:12.928514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:12.928520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:12.928522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:12.928524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:12.928526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:12.929218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:12.929240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:12.929245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:12.929247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:12.929249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:12.929252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:12.929676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:12.929698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:12.929703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:12.929707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:12.929710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:12.930805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:12.930819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:12.930828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392852930
2025-10-02T08:14:12.930998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:12.931011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:12.931017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:12.931022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:12.931026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:12.931029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:12.931496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:12.931517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:12.931522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:12.931525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:12.931527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:12.931531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:12.931959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:12.931968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:12.931972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:12.931974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:12.931976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:12.931978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:12.932410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:12.932420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:12.932424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:12.935273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:12.935300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:12.935308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:12.935313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:12.935324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392852934
2025-10-02T08:14:12.935600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:12.935624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:12.935636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:12.935656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:12.935660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:12.935663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:12.936279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:12.936312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:12.936317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:12.936319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:12.936327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:12.936331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:12.937048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:12.937076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:12.937176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392852936
2025-10-02T08:14:12.937883Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:12.937903Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:12.937912Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:12.937916Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:12.939408Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:12.939420Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:12.939421Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:12.939428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534761555310955:7433]
2025-10-02T08:14:12.939431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534761555310955:7433]
2025-10-02T08:14:12.939471Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:12.939477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:12.939477Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:12.939480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:12.939482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:12.939597Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:12.984894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534761555311031:8716]
2025-10-02T08:14:12.985022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1982, pipe: [1:7556534761555311031:8716]
2025-10-02T08:14:13.070262Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:13.070675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534761555311031:8716], now have 1 active actors on pipe
2025-10-02T08:14:13.070803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534761555311031:8716]
2025-10-02T08:14:13.070833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:13.070844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:13.070884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1983 reason: error at write: Disconnected sessionId: src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0
2025-10-02T08:14:13.070926Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:13.070939Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:13.071063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1983 sessionId: src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0 is DEAD
2025-10-02T08:14:13.071224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:13.071231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0] Write session will restart in 0.006764s
2025-10-02T08:14:13.071260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0] Write session: Do CDS request
2025-10-02T08:14:13.071269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:13.076521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:13.077426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:13.077603Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:13.077614Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:13.077623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:13.077674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:13.077714Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534765850278391:2336]
2025-10-02T08:14:13.078342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:13.078515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:13.078556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:13.078845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:13.078899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.078905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.078907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.078908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.078909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.078913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.078924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.078928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.078931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.078935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.078941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.078953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.078958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.078968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.078972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.078978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.078986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.078993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.079011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.079019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.079038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:13.079316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.079343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:13.079353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1984
2025-10-02T08:14:13.079519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.079555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:13.079564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:13.079567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:13.079979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1984 sessionId:  describe result for acl check
2025-10-02T08:14:13.080016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:13.080023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:13.080027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:13.080032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534765850278407:2330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:13.080692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534765850278407:2330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:13.082862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534765850278407:2330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:13.086237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534765850278407:2330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:13.086254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534765850278407:2330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:13.086258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534765850278407:2330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:13.086266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:13.086914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:13.088486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:13.088501Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:13.088504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:13.088508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:13.088513Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1983 [1:7556534765850278391:2336]
2025-10-02T08:14:13.088524Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:13.088540Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:13.088542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.088545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.088563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.088585Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:13.088594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:13.088600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:13.088665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.088673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.088675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:13.088677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:13.088737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:13.088745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.088756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.088770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:13.088777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1983
2025-10-02T08:14:13.088791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850278438:2330], now have 1 active actors on pipe
2025-10-02T08:14:13.088797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534766309880072:2378], now have 1 active actors on pipe
2025-10-02T08:14:13.088819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.088827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.088842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534765850278385:2336]
2025-10-02T08:14:13.088848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534765850278385:2336]
2025-10-02T08:14:13.088855Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:13.088868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:13.088880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:13.088886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:13.088852Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1983
2025-10-02T08:14:13.088888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:13.088890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:13.088903Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5775c907-d88c296d-c5625b95-ff4ee646_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:13.088909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.088912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.088916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:13.088924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.088933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:13.088966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534765850278385:2336]
2025-10-02T08:14:13.088977Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:13.088994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:13.088997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.089047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.089060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.089083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.089125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1984 partition: 0 MaxSeqNo: 17 sessionId: src_id|5775c907-d88c296d-c5625b95-ff4ee646_0
2025-10-02T08:14:13.089432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cdaa2c-8ca5c552-81dc3656-d69272b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5775c907-d88c296d-c5625b95-ff4ee646_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:13.091997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5775c907-d88c296d-c5625b95-ff4ee646_0] Write session: try to update token
2025-10-02T08:14:13.092012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5775c907-d88c296d-c5625b95-ff4ee646_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:13.106735Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:13.106755Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:13.106758Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:13.106768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534765850278385:2336]
2025-10-02T08:14:13.106772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534765850278385:2336]
2025-10-02T08:14:13.106816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:13.106822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.106827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:13.106833Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:13.106840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:13.106963Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:13.107885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId: src_id|5775c907-d88c296d-c5625b95-ff4ee646_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:13.110323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:13.171020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534765850278454:8716]
2025-10-02T08:14:13.171130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1983, pipe: [1:7556534765850278454:8716]
2025-10-02T08:14:13.251428Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:13.251785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.251800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.251839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850278454:8716], now have 1 active actors on pipe
2025-10-02T08:14:13.252034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534765850278454:8716]
2025-10-02T08:14:13.252071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:13.252074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:13.252037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:13.252131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1984 reason: error at write: Disconnected sessionId: src_id|5775c907-d88c296d-c5625b95-ff4ee646_0
2025-10-02T08:14:13.252323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1984 sessionId: src_id|5775c907-d88c296d-c5625b95-ff4ee646_0 is DEAD
2025-10-02T08:14:13.252626Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:13.252894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5775c907-d88c296d-c5625b95-ff4ee646_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:13.252904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5775c907-d88c296d-c5625b95-ff4ee646_0] Write session will restart in 0.009100s
2025-10-02T08:14:13.252937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5775c907-d88c296d-c5625b95-ff4ee646_0] Write session: Do CDS request
2025-10-02T08:14:13.252943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5775c907-d88c296d-c5625b95-ff4ee646_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:13.260790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:13.261672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:13.261847Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:13.261858Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:13.261869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:13.261924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:13.261967Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534765850278517:2360]
2025-10-02T08:14:13.262635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:13.262840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:13.262896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:13.263130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:13.263180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.263186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.263187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.263188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.263190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.263195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.263205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.263208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.263212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.263214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.263218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.263222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.263226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.263229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.263232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.263235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.263249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.263254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.263259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.263271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.263286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:13.263365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5775c907-d88c296d-c5625b95-ff4ee646_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.263378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:13.263384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1985
2025-10-02T08:14:13.263566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.263603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:13.263612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:13.263616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:13.263983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1985 sessionId:  describe result for acl check
2025-10-02T08:14:13.264011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:13.264015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:13.264019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:13.264023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534765850278534:2377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:13.264442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534765850278534:2377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:13.266581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534765850278534:2377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:13.270500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534765850278534:2377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:13.270512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534765850278534:2377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:13.270514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534765850278534:2377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:13.270528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:13.271062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:13.272595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:13.272612Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:13.272615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:13.272619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:13.272624Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1984 [1:7556534765850278517:2360]
2025-10-02T08:14:13.272635Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:13.272650Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:13.272652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.272656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.272664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.272680Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:13.272691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:13.272701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:13.272757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.272763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.272766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:13.272768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:13.272843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:13.272852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.272864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.272877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:13.272893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534765850278511:2360]
2025-10-02T08:14:13.272896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534765850278511:2360]
2025-10-02T08:14:13.272902Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:13.272903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1984
2025-10-02T08:14:13.272912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:13.272914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850278565:2377], now have 1 active actors on pipe
2025-10-02T08:14:13.272915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:13.272918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534766309880080:2378], now have 1 active actors on pipe
2025-10-02T08:14:13.272925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:13.272939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:13.272946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:13.272952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.272956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.272955Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1984
2025-10-02T08:14:13.272991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534765850278511:2360]
2025-10-02T08:14:13.272998Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:13.273007Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:13.273012Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:13.273017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.273020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.273022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:13.273032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.273044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:13.273083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.273168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.273175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.273187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.273216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1985 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0
2025-10-02T08:14:13.273551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5775c907-d88c296d-c5625b95-ff4ee646_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:13.276075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0] Write session: try to update token
2025-10-02T08:14:13.276089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:13.289712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId: src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:13.290235Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:13.290252Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:13.290254Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:13.290263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534765850278511:2360]
2025-10-02T08:14:13.290270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534765850278511:2360]
2025-10-02T08:14:13.290318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:13.290321Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:13.290325Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:13.290330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.290332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:13.290484Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:13.292687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:13.352304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534765850278581:8716]
2025-10-02T08:14:13.352451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1984, pipe: [1:7556534765850278581:8716]
2025-10-02T08:14:13.421761Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:13.422045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.422054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.422092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850278581:8716], now have 1 active actors on pipe
2025-10-02T08:14:13.422402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:13.422336Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:13.422606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:13.422659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1985 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0
2025-10-02T08:14:13.422815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1985 sessionId: src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0 is DEAD
2025-10-02T08:14:13.422948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534765850278581:8716]
2025-10-02T08:14:13.423275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:13.423287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0] Write session will restart in 0.005229s
2025-10-02T08:14:13.423314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0] Write session: Do CDS request
2025-10-02T08:14:13.423321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:13.429459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.429714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:13.429733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1986
2025-10-02T08:14:13.430884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:13.432070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:13.432260Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:13.432271Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:13.432282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:13.432330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:13.432366Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534765850278648:2428]
2025-10-02T08:14:13.433009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:13.433076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.433117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:13.433127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:13.433131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:13.433224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:13.433275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:13.433607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:13.433653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.433658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.433659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.433661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.433662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.433668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.433677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.433681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.433685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.433689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.433695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.433702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.433711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.433716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.433725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.433729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.433734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.433741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.433746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.433751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.433768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:13.434025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1986 sessionId:  describe result for acl check
2025-10-02T08:14:13.434053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:13.434055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:13.434056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:13.434060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534765850278668:2426] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:13.434465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534765850278668:2426] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:13.436568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534765850278668:2426] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:13.441723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:13.443245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:13.443260Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:13.443262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:13.443268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:13.443274Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1985 [1:7556534765850278648:2428]
2025-10-02T08:14:13.443285Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:13.443300Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:13.443306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.443309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.443312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.443327Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:13.443335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:13.443344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:13.443403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.443412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.443415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:13.443417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:13.443483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:13.443490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.443502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.443517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:13.443536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534765850278642:2428]
2025-10-02T08:14:13.443542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534765850278642:2428]
2025-10-02T08:14:13.443549Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:13.443561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:13.443577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:13.443583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:13.443614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534765850278642:2428]
2025-10-02T08:14:13.443622Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:13.444069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534765850278668:2426] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:13.444084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534765850278668:2426] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:13.444087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534765850278668:2426] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:13.444095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:13.444539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:13.444546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:13.444551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:13.444738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534766309880087:2378], now have 1 active actors on pipe
2025-10-02T08:14:13.444860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1985
2025-10-02T08:14:13.444878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850278711:2426], now have 1 active actors on pipe
2025-10-02T08:14:13.444838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1985
2025-10-02T08:14:13.444885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.444895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.444935Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:13.444948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.444951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.444953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:13.444962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.444973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:13.444992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.445033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.445040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.445052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.445075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1986 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0
2025-10-02T08:14:13.445522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d815bf7-f404b446-6d3068bd-c0bb3e94_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:13.448903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0] Write session: try to update token
2025-10-02T08:14:13.448926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:13.470407Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:13.470425Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:13.470427Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:13.470441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534765850278642:2428]
2025-10-02T08:14:13.470446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534765850278642:2428]
2025-10-02T08:14:13.470488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:13.470495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.470495Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:13.470498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:13.470502Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:13.470633Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:13.481712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId: src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:13.484473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:13.523275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534765850278747:8716]
2025-10-02T08:14:13.523409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1985, pipe: [1:7556534765850278747:8716]
2025-10-02T08:14:13.603095Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:13.602492Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:13.602846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.602852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.602885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850278747:8716], now have 1 active actors on pipe
2025-10-02T08:14:13.602992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534765850278747:8716]
2025-10-02T08:14:13.603013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:13.603015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:13.603047Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:13.603090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1986 reason: error at write: Disconnected sessionId: src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0
2025-10-02T08:14:13.603229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1986 sessionId: src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0 is DEAD
2025-10-02T08:14:13.603443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:13.603458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0] Write session will restart in 0.007587s
2025-10-02T08:14:13.603485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0] Write session: Do CDS request
2025-10-02T08:14:13.603493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:13.608642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:13.609684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:13.609843Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:13.609850Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:13.609857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:13.609901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:13.609928Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534765850278814:2514]
2025-10-02T08:14:13.610345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:13.610521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:13.610547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:13.610737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:13.610775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.610780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.610781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.610782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.610783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.610788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.610795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.610797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.610799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.610802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.610807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.610813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.610818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.610824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.610829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.610833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.610837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.610842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.610844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.610847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.610857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:13.612384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.612400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:13.612417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1987
2025-10-02T08:14:13.612647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.612679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:13.612687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:13.612691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:13.613045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1987 sessionId:  describe result for acl check
2025-10-02T08:14:13.613077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:13.613083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:13.613085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:13.613090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534765850278830:2523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:13.613651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534765850278830:2523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:13.615726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534765850278830:2523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:13.618748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534765850278830:2523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:13.618763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534765850278830:2523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:13.618767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534765850278830:2523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:13.618786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:13.618806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:13.620354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:13.620370Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:13.620372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:13.620374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:13.620380Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1986 [1:7556534765850278814:2514]
2025-10-02T08:14:13.620388Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:13.620402Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:13.620404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.620406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.620408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.620423Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:13.620427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:13.620435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:13.620485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.620493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.620496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:13.620499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:13.620551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:13.620561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.620573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.620584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:13.620603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850278862:2523], now have 1 active actors on pipe
2025-10-02T08:14:13.620610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534765850278808:2514]
2025-10-02T08:14:13.620617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534765850278808:2514]
2025-10-02T08:14:13.620624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:13.620632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1986
2025-10-02T08:14:13.620635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534766309880128:2378], now have 1 active actors on pipe
2025-10-02T08:14:13.620640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:13.620639Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:13.620652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:13.620653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:13.620656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:13.620688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.620694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.620704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534765850278808:2514]
2025-10-02T08:14:13.620709Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:13.620716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:13.620727Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:13.620706Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1986
2025-10-02T08:14:13.620733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.620741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.620743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:13.620751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.620760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:13.620789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.620848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.620855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.620867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.620900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1987 partition: 0 MaxSeqNo: 17 sessionId: src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0
2025-10-02T08:14:13.621204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b50d874-2953161f-7b3bcc75-4f35a617_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:13.623928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0] Write session: try to update token
2025-10-02T08:14:13.623946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:13.638126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId: src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:13.639177Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:13.639199Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:13.639201Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:13.639210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534765850278808:2514]
2025-10-02T08:14:13.639215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534765850278808:2514]
2025-10-02T08:14:13.639258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:13.639270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.639274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:13.639402Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:13.639415Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:13.639452Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:13.640836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:13.702996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534765850278892:8716]
2025-10-02T08:14:13.703099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1986, pipe: [1:7556534765850278892:8716]
2025-10-02T08:14:13.775859Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:13.776171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.776187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.776237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850278892:8716], now have 1 active actors on pipe
2025-10-02T08:14:13.776326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:13.776337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:13.776427Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:13.776399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1987 reason: error at write: Disconnected sessionId: src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0
2025-10-02T08:14:13.776412Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:13.776577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1987 sessionId: src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0 is DEAD
2025-10-02T08:14:13.776652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534765850278892:8716]
2025-10-02T08:14:13.776721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:13.776732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0] Write session will restart in 0.007774s
2025-10-02T08:14:13.776759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0] Write session: Do CDS request
2025-10-02T08:14:13.776765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:13.785325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:13.786271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.786377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:13.786391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1988
2025-10-02T08:14:13.786474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.786495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:13.786502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:13.786505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:13.786756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:13.786933Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:13.786942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1988 sessionId:  describe result for acl check
2025-10-02T08:14:13.786945Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:13.786956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:13.786973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:13.786983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:13.786985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:13.786990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534765850278967:2542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:13.787005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:13.787035Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534765850278966:2538]
2025-10-02T08:14:13.787425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:13.787503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534765850278967:2542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:13.787608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:13.787663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:13.787966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:13.788011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.788017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.788018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.788020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.788021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.788026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.788036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.788040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.788044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.788048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.788052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.788060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.788066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.788076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.788081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.788086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.788094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.788101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.788110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.788115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.788137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:13.789245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534765850278967:2542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:13.795347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534765850278967:2542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:13.795362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534765850278967:2542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:13.795366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534765850278967:2542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:13.795374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:13.795952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:13.797862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:13.797883Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:13.797888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:13.797891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:13.797897Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1987 [1:7556534765850278966:2538]
2025-10-02T08:14:13.797907Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:13.797925Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:13.797928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.797931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.797933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.797948Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:13.797961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:13.797967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:13.798028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.798036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.798039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:13.798041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:13.798104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:13.798113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.798127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.798146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:13.798159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1987
2025-10-02T08:14:13.798171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850279011:2542], now have 1 active actors on pipe
2025-10-02T08:14:13.798180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534766309880138:2378], now have 1 active actors on pipe
2025-10-02T08:14:13.798186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534765850278958:2538]
2025-10-02T08:14:13.798188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534765850278958:2538]
2025-10-02T08:14:13.798197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:13.798208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.798212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.798225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:13.798230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:13.798238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:13.798244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:13.798247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:13.798245Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1987
2025-10-02T08:14:13.798291Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:13.798303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.798306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.798308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:13.798317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.798330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:13.798338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534765850278958:2538]
2025-10-02T08:14:13.798350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:13.798386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.798392Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:13.798485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.798498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.798517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.798554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1988 partition: 0 MaxSeqNo: 17 sessionId: src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0
2025-10-02T08:14:13.798861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbde5614-fe132e59-87c08a91-7bd5105b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:13.801400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0] Write session: try to update token
2025-10-02T08:14:13.801418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:13.809076Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:13.809097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:13.809105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534765850278958:2538]
2025-10-02T08:14:13.809148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:13.809152Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:13.809326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:13.809473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:13.809615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:13.809756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:13.810058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:13.810101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:13.818608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId: src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:13.821076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:13.821145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.821159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.821191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:13.821223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:13.821282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.821295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.821434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.821489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.821545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.821602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.821656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.821665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.821728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.821796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.821859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.821924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.821966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.821976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.822045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.822103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.822171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.822239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.822282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.822289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.822353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.822410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.822487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.822549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.822597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.822604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.822669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.822730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.822795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.822895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.822951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.822960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.823034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.823103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.823174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.823245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.823295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.823302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.823378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.823449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.823523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.823595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.823662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.823670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.823739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.823809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.823880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.823951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.823999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.824008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.824074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.824138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.824199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.824273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.824389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.824394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.824454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:13.824510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:13.824568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:13.824623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:13.824665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:13.824670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:13.824722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:13.824776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.824795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.824847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:13.824878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:13.824893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:13.824902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:13.824906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:13.824909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:13.825326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:13.825353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:13.825365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:13.825369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:13.825372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:13.825377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:13.825806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:13.825825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:13.825830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:13.825833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:13.825836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:13.825838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:13.826421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:13.826449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:13.826460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:13.826465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:13.826467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:13.828668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:13.828690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:13.828702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392853828
2025-10-02T08:14:13.828856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:13.828871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:13.828875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:13.828881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:13.828885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:13.828888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:13.829369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:13.829394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:13.829399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:13.829401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:13.829403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:13.829406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:13.829809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:13.829830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:13.829835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:13.829837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:13.829839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:13.829842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:13.830272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:13.830293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:13.830299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:13.831342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:13.831357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:13.831361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:13.831365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:13.831373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392853830
2025-10-02T08:14:13.831642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:13.831659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:13.831663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:13.831665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:13.831668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:13.831670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:13.832105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:13.832122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:13.832126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:13.832128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:13.832130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:13.832132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:13.832567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:13.832588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.832684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392853832
2025-10-02T08:14:13.834987Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:13.835012Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:13.835016Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:13.835021Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:13.835031Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:13.835033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:13.835035Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:13.835045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534765850278958:2538]
2025-10-02T08:14:13.835048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534765850278958:2538]
2025-10-02T08:14:13.835094Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:13.835105Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:13.835114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:13.835116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.835117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:13.835232Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:13.877026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534765850279028:8716]
2025-10-02T08:14:13.877166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1987, pipe: [1:7556534765850279028:8716]
2025-10-02T08:14:13.967827Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:13.968236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850279028:8716], now have 1 active actors on pipe
2025-10-02T08:14:13.968351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:13.968361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:13.968386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1988 reason: error at write: Disconnected sessionId: src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0
2025-10-02T08:14:13.968449Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:13.968534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1988 sessionId: src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0 is DEAD
2025-10-02T08:14:13.968667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:13.968678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0] Write session will restart in 0.005889s
2025-10-02T08:14:13.968702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0] Write session: Do CDS request
2025-10-02T08:14:13.968708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:13.968694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534765850279028:8716]
2025-10-02T08:14:13.968516Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:13.974421Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [c06bf0e9a08e1ad0] Result# TEvPutResult {Id# [72075186224037892:1987:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:13.974665Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1987:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:13.974828Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1987:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:13.975256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.975351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:13.975366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1989
2025-10-02T08:14:13.975476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:13.975513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:13.975522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:13.975525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:13.975952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1989 sessionId:  describe result for acl check
2025-10-02T08:14:13.975992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:13.975993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:13.975995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:13.976000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534765850279112:2583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:13.976074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:13.976517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534765850279112:2583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:13.977218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:13.977398Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:13.977408Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:13.977418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:13.977466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:13.977501Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534765850279132:2580]
2025-10-02T08:14:13.978084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:13.978240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:13.978243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534765850279112:2583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:13.978278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:13.978570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:13.978620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.978626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.978628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.978629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.978630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.978635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.978643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.978651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.978655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.978663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.978668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.978679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:13.978688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.978693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:13.978699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.978708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:13.978712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.978716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.978726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.978734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.978755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:13.983456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534765850279112:2583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:13.983471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534765850279112:2583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:13.983474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534765850279112:2583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:13.983482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:13.989849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:13.991406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:13.991425Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:13.991428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:13.991431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:13.991436Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1988 [1:7556534765850279132:2580]
2025-10-02T08:14:13.991449Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:13.991463Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:13.991471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.991474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.991477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.991491Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:13.991500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:13.991506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:13.991563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.991570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.991573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:13.991575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:13.991634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:13.991641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:13.991653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:13.991666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:13.991686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534765850279113:2580]
2025-10-02T08:14:13.991691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534765850279113:2580]
2025-10-02T08:14:13.991698Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:13.991710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:13.991718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:13.991721Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:13.991727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:13.991730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:13.991733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1988
2025-10-02T08:14:13.991739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534765850279160:2583], now have 1 active actors on pipe
2025-10-02T08:14:13.991748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534766309880144:2378], now have 1 active actors on pipe
2025-10-02T08:14:13.991779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.991786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.991800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534765850279113:2580]
2025-10-02T08:14:13.991811Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:13.991818Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:13.991833Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:13.991842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:13.991813Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1988
2025-10-02T08:14:13.991845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:13.991847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:13.991855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:13.991863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:13.991887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.991932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:13.991938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:13.991949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:13.991986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1989 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0
2025-10-02T08:14:13.992298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc7cbea-1ba8ec90-ccc19dc6-3326068_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:13.994837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0] Write session: try to update token
2025-10-02T08:14:13.994855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:14.008460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId: src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:14.008645Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:14.008662Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:14.008664Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:14.008672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534765850279113:2580]
2025-10-02T08:14:14.008675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534765850279113:2580]
2025-10-02T08:14:14.008710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:14.008713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:14.008713Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:14.008719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.008721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:14.008873Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:14.010962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:14.069092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534770145246473:8716]
2025-10-02T08:14:14.069243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1988, pipe: [1:7556534770145246473:8716]
2025-10-02T08:14:14.137007Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:14.137271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.137280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.137311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145246473:8716], now have 1 active actors on pipe
2025-10-02T08:14:14.137408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:14.137417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:14.137486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1989 reason: error at write: Disconnected sessionId: src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0
2025-10-02T08:14:14.137543Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:14.137638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1989 sessionId: src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0 is DEAD
2025-10-02T08:14:14.137727Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:14.137788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:14.137800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0] Write session will restart in 0.009705s
2025-10-02T08:14:14.137804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534770145246473:8716]
2025-10-02T08:14:14.137825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0] Write session: Do CDS request
2025-10-02T08:14:14.137831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:14.142350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:14.143273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:14.143420Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:14.143427Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:14.143436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:14.143479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:14.143514Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534770145246547:2575]
2025-10-02T08:14:14.144121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:14.144298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:14.144338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:14.144618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:14.144652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.144657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.144658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.144659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.144660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.144664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.144675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.144683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.144686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.144694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.144699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.144709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.144718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.144723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.144727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.144731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.144739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.144744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.144748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.144755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.144773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:14.148321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.148426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:14.148439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1990
2025-10-02T08:14:14.148555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.148582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:14.148593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:14.148600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:14.149038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1990 sessionId:  describe result for acl check
2025-10-02T08:14:14.149072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:14.149074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:14.149076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:14.149080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534770145246563:2630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:14.149561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534770145246563:2630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:14.151196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534770145246563:2630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:14.152382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:14.153866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534770145246563:2630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:14.153878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534770145246563:2630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:14.153884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534770145246563:2630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:14.153891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:14.153908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:14.153922Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:14.153924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:14.153927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:14.153932Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1989 [1:7556534770145246547:2575]
2025-10-02T08:14:14.153939Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:14.153951Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:14.153956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.153958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.153960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.153972Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:14.153979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:14.153984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:14.154030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.154042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.154044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:14.154045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:14.154085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:14.154091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.154100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.154113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:14.154125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145246595:2630], now have 1 active actors on pipe
2025-10-02T08:14:14.154127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534770604847446:2378], now have 1 active actors on pipe
2025-10-02T08:14:14.154131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534770145246541:2575]
2025-10-02T08:14:14.154132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534770145246541:2575]
2025-10-02T08:14:14.154141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:14.154152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:14.154155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:14.154157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:14.154163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:14.154165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:14.154193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534770145246541:2575]
2025-10-02T08:14:14.154171Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1989
2025-10-02T08:14:14.154200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:14.154204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1989
2025-10-02T08:14:14.154209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:14.154217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.154221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.154244Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53c3f2c9-60561986-93ab3888-7110585c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:14.154251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.154254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.154255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:14.154261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.154268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:14.154282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.154318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.154329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.154351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.154382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1990 partition: 0 MaxSeqNo: 17 sessionId: src_id|53c3f2c9-60561986-93ab3888-7110585c_0
2025-10-02T08:14:14.154637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8d275f-751321ac-9e258d85-3ec05c69_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|53c3f2c9-60561986-93ab3888-7110585c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:14.157220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53c3f2c9-60561986-93ab3888-7110585c_0] Write session: try to update token
2025-10-02T08:14:14.157238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53c3f2c9-60561986-93ab3888-7110585c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:14.170830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId: src_id|53c3f2c9-60561986-93ab3888-7110585c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:14.170985Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:14.171001Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:14.171003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:14.171011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534770145246541:2575]
2025-10-02T08:14:14.171018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534770145246541:2575]
2025-10-02T08:14:14.171054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:14.171063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.171064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:14.171190Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:14.171210Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:14.171223Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:14.173420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:14.238027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534770145246609:8716]
2025-10-02T08:14:14.238153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1989, pipe: [1:7556534770145246609:8716]
2025-10-02T08:14:14.306882Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:14.307266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.307276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.307307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145246609:8716], now have 1 active actors on pipe
2025-10-02T08:14:14.307442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:14.307456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:14.307507Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:14.307518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1990 reason: error at write: Disconnected sessionId: src_id|53c3f2c9-60561986-93ab3888-7110585c_0
2025-10-02T08:14:14.307569Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:14.307680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1990 sessionId: src_id|53c3f2c9-60561986-93ab3888-7110585c_0 is DEAD
2025-10-02T08:14:14.307740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534770145246609:8716]
2025-10-02T08:14:14.307835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c3f2c9-60561986-93ab3888-7110585c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:14.307846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c3f2c9-60561986-93ab3888-7110585c_0] Write session will restart in 0.006788s
2025-10-02T08:14:14.307869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c3f2c9-60561986-93ab3888-7110585c_0] Write session: Do CDS request
2025-10-02T08:14:14.307875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c3f2c9-60561986-93ab3888-7110585c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:14.312717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:14.313520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:14.313683Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:14.313697Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:14.313707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:14.313759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:14.313794Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534770145246684:2633]
2025-10-02T08:14:14.314396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:14.314554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:14.314602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:14.314892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:14.314962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.314969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.314970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.314971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.314972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.314977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.314987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.314991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.314998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.315002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.315008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.315019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.315030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.315039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.315047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.315056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.315064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.315074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.315082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.315090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.315113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:14.316138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53c3f2c9-60561986-93ab3888-7110585c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.316260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:14.316272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1991
2025-10-02T08:14:14.316372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.316398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:14.316406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:14.316410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:14.316792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1991 sessionId:  describe result for acl check
2025-10-02T08:14:14.316859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:14.316866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:14.316867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:14.316872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534770145246700:2613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:14.317352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534770145246700:2613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:14.319072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534770145246700:2613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:14.322086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534770145246700:2613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:14.322098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534770145246700:2613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:14.322102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534770145246700:2613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:14.322109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:14.322548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:14.324043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:14.324060Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:14.324062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:14.324066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:14.324071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1990 [1:7556534770145246684:2633]
2025-10-02T08:14:14.324081Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:14.324095Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:14.324100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.324103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.324104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.324119Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:14.324124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:14.324130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:14.324194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.324213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.324215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:14.324218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:14.324283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:14.324294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.324307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.324318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:14.324326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1990
2025-10-02T08:14:14.324336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145246733:2613], now have 1 active actors on pipe
2025-10-02T08:14:14.324342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534770145246678:2633]
2025-10-02T08:14:14.324344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534770145246678:2633]
2025-10-02T08:14:14.324351Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:14.324361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534770604847454:2378], now have 1 active actors on pipe
2025-10-02T08:14:14.324364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:14.324365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.324367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:14.324369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.324387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:14.324400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:14.324403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:14.324442Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:14.324449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.324455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.324457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:14.324465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.324481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:14.324528Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1990
2025-10-02T08:14:14.324567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534770145246678:2633]
2025-10-02T08:14:14.324578Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:14.324590Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:14.324600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.324633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.324640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.324657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.324696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1991 partition: 0 MaxSeqNo: 17 sessionId: src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0
2025-10-02T08:14:14.325036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c3f2c9-60561986-93ab3888-7110585c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:14.327325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0] Write session: try to update token
2025-10-02T08:14:14.327336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:14.341205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:14.341224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:14.341227Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:14.341235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534770145246678:2633]
2025-10-02T08:14:14.341239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534770145246678:2633]
2025-10-02T08:14:14.341279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:14.341293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.341304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:14.341345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId: src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:14.341386Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:14.341401Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:14.341459Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:14.343790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:14.408021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534770145246749:8716]
2025-10-02T08:14:14.408160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1990, pipe: [1:7556534770145246749:8716]
2025-10-02T08:14:14.474932Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:14.475256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.475274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.475313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145246749:8716], now have 1 active actors on pipe
2025-10-02T08:14:14.475441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:14.475465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:14.475495Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:14.475848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:14.475859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0] Write session will restart in 0.008463s
2025-10-02T08:14:14.475881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0] Write session: Do CDS request
2025-10-02T08:14:14.475887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:14.475527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1991 reason: error at write: Disconnected sessionId: src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0
2025-10-02T08:14:14.475698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1991 sessionId: src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0 is DEAD
2025-10-02T08:14:14.475998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534770145246749:8716]
2025-10-02T08:14:14.476492Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:14.480653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:14.481677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:14.481821Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:14.481828Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:14.481836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:14.481876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:14.481907Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534770145246825:2636]
2025-10-02T08:14:14.482469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:14.482609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:14.482641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:14.482892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:14.482929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.482931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.482932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.482933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.482936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.482940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.482948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.482956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.482960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.482963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.482968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.482974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.482980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.482984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.482988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.482991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.482995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.482999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.483003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.483007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.483022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:14.485230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.485297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:14.485307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1992
2025-10-02T08:14:14.485402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.485428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:14.485436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:14.485440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:14.485819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1992 sessionId:  describe result for acl check
2025-10-02T08:14:14.485853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:14.485859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:14.485861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:14.485868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534770145246842:2650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:14.486360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534770145246842:2650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:14.488315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534770145246842:2650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:14.490624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:14.491186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534770145246842:2650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:14.491196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534770145246842:2650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:14.491199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534770145246842:2650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:14.491205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:14.492241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:14.492257Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:14.492259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:14.492263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:14.492268Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1991 [1:7556534770145246825:2636]
2025-10-02T08:14:14.492279Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:14.492293Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:14.492301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.492304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.492306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.492319Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:14.492325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:14.492335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:14.492391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.492397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.492400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:14.492402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:14.492460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:14.492467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.492478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.492494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:14.492515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145246883:2650], now have 1 active actors on pipe
2025-10-02T08:14:14.492524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534770604847460:2378], now have 1 active actors on pipe
2025-10-02T08:14:14.492530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534770145246819:2636]
2025-10-02T08:14:14.492532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534770145246819:2636]
2025-10-02T08:14:14.492543Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:14.492555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:14.492562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:14.492565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:14.492570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:14.492573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:14.492569Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1991
2025-10-02T08:14:14.492601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534770145246819:2636]
2025-10-02T08:14:14.492614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:14.492628Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:14.492651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1991
2025-10-02T08:14:14.492710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.492718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.492738Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6c6bc18-db755367-5a4c9271-787d6173_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:14.492750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.492758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.492760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:14.492770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.492782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:14.492814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.492848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.492854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.492866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.492893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1992 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6c6bc18-db755367-5a4c9271-787d6173_0
2025-10-02T08:14:14.493183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bbed52-a3b67a12-456a3641-ab6c7d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6c6bc18-db755367-5a4c9271-787d6173_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:14.495807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c6bc18-db755367-5a4c9271-787d6173_0] Write session: try to update token
2025-10-02T08:14:14.495822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c6bc18-db755367-5a4c9271-787d6173_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:14.503677Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:14.503699Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:14.503708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534770145246819:2636]
2025-10-02T08:14:14.503740Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:14.503747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:14.503908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:14.504048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:14.504184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:14.504328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:14.504578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:14.504618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:14.509517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId: src_id|c6c6bc18-db755367-5a4c9271-787d6173_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:14.511985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:14.512047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.512058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.512092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:14.512108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:14.512165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.512171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.512326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.512388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.512446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.512511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.512556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.512564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.512630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.512691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.512751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.512833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.512877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.512885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.512950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.513010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.513063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.513116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.513152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.513157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.513214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.513267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.513321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.513375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.513421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.513424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.513489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.513558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.513612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.513666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.513705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.513709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.513766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.513827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.513888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.513955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.513999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.514006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.514068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.514119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.514173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.514226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.514327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.514333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.514391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.514446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.514505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.514564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.514601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.514605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.514661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.514710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.514763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.514827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.514872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.514878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.514938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.514993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.515051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.515101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.515139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.515144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.515174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:14.515222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.515237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.515241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:14.515265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:14.515276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:14.515282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:14.515284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:14.515286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:14.515663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:14.515692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:14.515703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:14.515706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:14.515708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:14.515711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:14.516330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:14.516352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:14.516356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:14.516359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:14.516361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:14.516363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:14.516751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:14.516769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:14.516772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:14.516774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:14.516776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:14.517948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:14.517963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:14.517972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392854517
2025-10-02T08:14:14.518094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:14.518101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:14.518105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:14.518107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:14.518109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:14.518111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:14.518521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:14.518532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:14.518535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:14.518537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:14.518539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:14.518543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:14.518928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:14.518936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:14.518941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:14.518944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:14.518946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:14.518948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:14.519398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:14.519412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:14.519417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:14.520427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:14.520434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:14.520437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:14.520439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:14.520445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392854518
2025-10-02T08:14:14.520679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:14.520687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:14.520690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:14.520692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:14.520695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:14.520697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:14.521160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:14.521183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:14.521188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:14.521193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:14.521196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:14.521199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:14.521651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:14.521661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.521739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392854518
2025-10-02T08:14:14.522403Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:14.522413Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:14.522417Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:14.522420Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:14.523921Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:14.523926Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:14.523927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:14.523935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534770145246819:2636]
2025-10-02T08:14:14.523939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534770145246819:2636]
2025-10-02T08:14:14.523997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:14.524001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.524002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:14.523993Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:14.524008Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:14.524115Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:14.575948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534770145246939:8716]
2025-10-02T08:14:14.576046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1991, pipe: [1:7556534770145246939:8716]
2025-10-02T08:14:14.656111Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:14.656489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145246939:8716], now have 1 active actors on pipe
2025-10-02T08:14:14.656583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:14.656589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:14.656614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1992 reason: error at write: Disconnected sessionId: src_id|c6c6bc18-db755367-5a4c9271-787d6173_0
2025-10-02T08:14:14.656729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:14.656934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c6bc18-db755367-5a4c9271-787d6173_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:14.656943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c6bc18-db755367-5a4c9271-787d6173_0] Write session will restart in 0.009348s
2025-10-02T08:14:14.656967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c6bc18-db755367-5a4c9271-787d6173_0] Write session: Do CDS request
2025-10-02T08:14:14.656973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c6bc18-db755367-5a4c9271-787d6173_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:14.656723Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:14.656791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1992 sessionId: src_id|c6c6bc18-db755367-5a4c9271-787d6173_0 is DEAD
2025-10-02T08:14:14.656982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534770145246939:8716]
2025-10-02T08:14:14.662735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:14.663068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:14.663226Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:14.663235Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:14.663244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:14.663289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:14.663325Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534770145247039:2699]
2025-10-02T08:14:14.663935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:14.664102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:14.664137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:14.664425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:14.664476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.664481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.664482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.664483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.664484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.664489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.664499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.664503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.664508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.664512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.664517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.664523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.664529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.664539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.664548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.664553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.664562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.664567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.664576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.664585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.664610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:14.667220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c6bc18-db755367-5a4c9271-787d6173_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.667320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:14.667332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1993
2025-10-02T08:14:14.667441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.667468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:14.667477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:14.667480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:14.667840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1993 sessionId:  describe result for acl check
2025-10-02T08:14:14.667872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:14.667877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:14.667878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:14.667883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534770145247062:2695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:14.668166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534770145247062:2695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:14.669558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534770145247062:2695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:14.671898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534770145247062:2695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:14.671910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534770145247062:2695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:14.671914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534770145247062:2695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:14.671920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:14.676367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:14.678012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:14.678032Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:14.678034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:14.678037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:14.678044Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1992 [1:7556534770145247039:2699]
2025-10-02T08:14:14.678055Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:14.678071Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:14.678074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.678077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.678080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.678097Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:14.678102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:14.678109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:14.678165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.678174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.678179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:14.678182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:14.678248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:14.678255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.678268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.678281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:14.678298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534770145247033:2699]
2025-10-02T08:14:14.678304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534770145247033:2699]
2025-10-02T08:14:14.678312Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:14.678317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1992
2025-10-02T08:14:14.678324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145247098:2695], now have 1 active actors on pipe
2025-10-02T08:14:14.678326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:14.678330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:14.678333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:14.678347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:14.678355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:14.678361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534770604847501:2378], now have 1 active actors on pipe
2025-10-02T08:14:14.678365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.678370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.678411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534770145247033:2699]
2025-10-02T08:14:14.678420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:14.678434Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:14.678444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:14.678417Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1992
2025-10-02T08:14:14.678445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.678449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.678451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:14.678459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.678467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:14.678516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.678559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.678566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.678578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.678612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1993 partition: 0 MaxSeqNo: 17 sessionId: src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0
2025-10-02T08:14:14.678936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c6bc18-db755367-5a4c9271-787d6173_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:14.681507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0] Write session: try to update token
2025-10-02T08:14:14.681522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:14.691545Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:14.691565Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:14.691574Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534770145247033:2699]
2025-10-02T08:14:14.691620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:14.691620Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:14.691786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:14.691926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:14.692061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:14.692196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:14.692402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:14.692442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:14.694772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId: src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:14.697217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:14.697282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.697294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.697322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:14.697345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:14.697477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.697491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.697657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.697718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.697796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.697856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.697904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.697913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.697978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.698037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.698100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.698162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.698204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.698211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.698279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.698355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.698415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.698475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.698517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.698526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.698592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.698658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.698722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.698786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.698847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.698854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.698919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.698978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.699036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.699102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.699150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.699157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.699221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.699279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.699341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.699402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.699449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.699456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.699521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.699582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.699647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.699710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.699751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.699758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.699825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.699880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.699943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.700005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.700048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.700054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.700122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.700184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.700254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.700317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.700358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.700365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.700428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:14.700489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:14.700572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:14.700635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:14.700680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:14.700687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:14.700724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:14.700790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.700829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.700831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:14.700859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:14.700874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:14.700881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:14.700884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:14.700887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:14.701292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:14.701318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:14.701324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:14.701327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:14.701330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:14.701334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:14.701912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:14.701932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:14.701938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:14.701942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:14.701946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:14.701948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:14.702490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:14.702514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:14.702519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:14.702524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:14.702528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:14.703767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:14.703783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:14.703794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392854703
2025-10-02T08:14:14.703931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:14.703944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:14.703950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:14.703952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:14.703956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:14.703960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:14.704433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:14.704454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:14.704461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:14.704464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:14.704467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:14.704471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:14.704909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:14.704928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:14.704934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:14.704937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:14.704939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:14.704943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:14.705424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:14.705448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:14.705453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:14.706510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:14.706531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:14.706537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:14.706541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:14.706549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392854706
2025-10-02T08:14:14.706842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:14.706863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:14.706867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:14.706869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:14.706871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:14.706876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:14.707293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:14.707312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:14.707316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:14.707318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:14.707322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:14.707324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:14.707739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:14.707756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.707919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392854707
2025-10-02T08:14:14.708676Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:14.708691Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:14.708695Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:14.708698Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:14.710207Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:14.710219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:14.710220Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:14.710227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534770145247033:2699]
2025-10-02T08:14:14.710230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534770145247033:2699]
2025-10-02T08:14:14.710274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:14.710281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.710282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:14.710396Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:14.710397Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:14.710402Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:14.757201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534770145247120:8716]
2025-10-02T08:14:14.757394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1992, pipe: [1:7556534770145247120:8716]
2025-10-02T08:14:14.847420Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:14.847750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145247120:8716], now have 1 active actors on pipe
2025-10-02T08:14:14.847883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:14.847895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:14.847919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1993 reason: error at write: Disconnected sessionId: src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0
2025-10-02T08:14:14.847977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:14.848010Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:14.848046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1993 sessionId: src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0 is DEAD
2025-10-02T08:14:14.848157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:14.848167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0] Write session will restart in 0.005817s
2025-10-02T08:14:14.848199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0] Write session: Do CDS request
2025-10-02T08:14:14.848214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:14.848218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534770145247120:8716]
2025-10-02T08:14:14.853764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:14.854097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:14.854249Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:14.854259Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:14.854267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:14.854310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:14.854353Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534770145247218:2712]
2025-10-02T08:14:14.854945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:14.855104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:14.855139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:14.855257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.855355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:14.855364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1994
2025-10-02T08:14:14.855397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:14.855456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.855461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.855464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.855466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.855467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.855471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.855479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.855482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.855485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.855488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.855493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.855494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:14.855499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:14.855505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.855509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:14.855513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.855517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:14.855518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:14.855521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:14.855521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.855524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:14.855525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.855529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.855533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.855548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:14.855864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1994 sessionId:  describe result for acl check
2025-10-02T08:14:14.855898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:14.855904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:14.855906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:14.855910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534770145247234:2741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:14.856309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534770145247234:2741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:14.858334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534770145247234:2741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:14.862590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534770145247234:2741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:14.862604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534770145247234:2741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:14.862610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534770145247234:2741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:14.862620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:14.863175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:14.864692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:14.864709Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:14.864711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:14.864714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:14.864720Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1993 [1:7556534770145247218:2712]
2025-10-02T08:14:14.864730Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:14.864745Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:14.864748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.864750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.864752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.864766Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:14.864769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:14.864775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:14.864841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.864849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.864851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:14.864854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:14.864922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:14.864930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.864942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:14.864962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:14.864971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1993
2025-10-02T08:14:14.864982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145247267:2741], now have 1 active actors on pipe
2025-10-02T08:14:14.864989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534770604847509:2378], now have 1 active actors on pipe
2025-10-02T08:14:14.864995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.864998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.865013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534770145247212:2712]
2025-10-02T08:14:14.865019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534770145247212:2712]
2025-10-02T08:14:14.865029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:14.865043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:14.865043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:14.865046Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:14.865059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:14.865062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:14.865043Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1993
2025-10-02T08:14:14.865075Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:14.865087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:14.865090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:14.865092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:14.865100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:14.865112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:14.865144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534770145247212:2712]
2025-10-02T08:14:14.865153Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:14.865165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.865171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:14.865246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.865252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.865266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:14.865297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1994 partition: 0 MaxSeqNo: 17 sessionId: src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0
2025-10-02T08:14:14.865586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a07499c-24fc8cc6-31a4a02d-4023b768_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:14.868021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0] Write session: try to update token
2025-10-02T08:14:14.868037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:14.880493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId: src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:14.883051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:14.883980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:14.883996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:14.884012Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:14.884015Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:14.884017Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:14.884025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534770145247212:2712]
2025-10-02T08:14:14.884035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534770145247212:2712]
2025-10-02T08:14:14.884075Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:14.884078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:14.884081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:14.884083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:14.884088Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:14.884212Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:14.948180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534770145247281:8716]
2025-10-02T08:14:14.948278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1993, pipe: [1:7556534770145247281:8716]
2025-10-02T08:14:15.013702Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:15.013990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:15.014027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534770145247281:8716], now have 1 active actors on pipe
2025-10-02T08:14:15.014028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:15.014125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:15.014135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:15.014154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1994 reason: error at write: Disconnected sessionId: src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0
2025-10-02T08:14:15.014220Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:15.014312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1994 sessionId: src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0 is DEAD
2025-10-02T08:14:15.014404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534770145247281:8716]
2025-10-02T08:14:15.014445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:15.014452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0] Write session will restart in 0.006212s
2025-10-02T08:14:15.014483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0] Write session: Do CDS request
2025-10-02T08:14:15.014488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:15.019882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:15.020320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:15.020437Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:15.020445Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:15.020452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:15.020483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:15.020511Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534774440214673:2744]
2025-10-02T08:14:15.020937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:15.021069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:15.021097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:15.021282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:15.021310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.021314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.021315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.021315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.021316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.021319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.021325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.021329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.021331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.021333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.021336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.021341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.021344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.021347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.021349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.021351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.021353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.021356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.021358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.021361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.021377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:15.022261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.022375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:15.022386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1995
2025-10-02T08:14:15.022499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.022519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:15.022526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:15.022528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:15.022873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1995 sessionId:  describe result for acl check
2025-10-02T08:14:15.022912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:15.022918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:15.022919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:15.022923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534774440214689:2743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:15.023367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534774440214689:2743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:15.025086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534774440214689:2743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:15.028701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534774440214689:2743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:15.028714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534774440214689:2743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:15.028716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534774440214689:2743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:15.028790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:15.029477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:15.030836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:15.030848Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:15.030850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:15.030852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:15.030857Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1994 [1:7556534774440214673:2744]
2025-10-02T08:14:15.030866Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:15.030879Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:15.030885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.030887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.030888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.030899Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:15.030905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:15.030910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:15.030951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.030956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.030958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:15.030960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:15.031008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:15.031014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.031022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.031033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:15.031035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1994
2025-10-02T08:14:15.031050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440214723:2743], now have 1 active actors on pipe
2025-10-02T08:14:15.031056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534774899814812:2378], now have 1 active actors on pipe
2025-10-02T08:14:15.031060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534774440214667:2744]
2025-10-02T08:14:15.031065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534774440214667:2744]
2025-10-02T08:14:15.031078Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:15.031089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.031091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.031094Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:15.031096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:15.031105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:15.031113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:15.031118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:15.031111Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1994
2025-10-02T08:14:15.031150Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:15.031159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.031162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.031163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:15.031169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.031175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:15.031180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534774440214667:2744]
2025-10-02T08:14:15.031182Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:15.031191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:15.031209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.031259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.031270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.031293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.031329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1995 partition: 0 MaxSeqNo: 17 sessionId: src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0
2025-10-02T08:14:15.031631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c60ce8-5d46a85b-28457cbf-24e87e3a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:15.034216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0] Write session: try to update token
2025-10-02T08:14:15.034234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:15.047866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId: src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:15.049751Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:15.049773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:15.049775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:15.049787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534774440214667:2744]
2025-10-02T08:14:15.049791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534774440214667:2744]
2025-10-02T08:14:15.049833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:15.049834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:15.049840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:15.049845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.049847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:15.049984Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:15.050709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:15.114568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534774440214739:8716]
2025-10-02T08:14:15.114691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1994, pipe: [1:7556534774440214739:8716]
2025-10-02T08:14:15.193428Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:15.193667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.193679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.193713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440214739:8716], now have 1 active actors on pipe
2025-10-02T08:14:15.193800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534774440214739:8716]
2025-10-02T08:14:15.193879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:15.193891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:15.193911Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:15.193955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1995 reason: error at write: Disconnected sessionId: src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0
2025-10-02T08:14:15.193942Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:15.194117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1995 sessionId: src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0 is DEAD
2025-10-02T08:14:15.194264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:15.194273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0] Write session will restart in 0.007260s
2025-10-02T08:14:15.194292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0] Write session: Do CDS request
2025-10-02T08:14:15.194297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:15.200163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:15.200693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:15.200859Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:15.200867Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:15.200875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:15.200913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:15.200947Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534774440214839:2775]
2025-10-02T08:14:15.201494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:15.201660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:15.201691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:15.201897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:15.201925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.201926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.201927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.201927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.201928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.201931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.201937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.201940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.201941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.201943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.201947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.201954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.201958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.201962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.201965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.201970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.201975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.201979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.201983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.201988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.201999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:15.202247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.202294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:15.202306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1996
2025-10-02T08:14:15.202454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.202480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:15.202489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:15.202492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:15.202844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1996 sessionId:  describe result for acl check
2025-10-02T08:14:15.202889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:15.202895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:15.202896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:15.202901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534774440214855:2776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:15.203347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534774440214855:2776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:15.205370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534774440214855:2776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:15.209047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534774440214855:2776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:15.209062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534774440214855:2776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:15.209065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534774440214855:2776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:15.209073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:15.209628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:15.211338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:15.211356Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:15.211359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:15.211362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:15.211368Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1995 [1:7556534774440214839:2775]
2025-10-02T08:14:15.211377Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:15.211393Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:15.211400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.211403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.211405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.211420Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:15.211425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:15.211431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:15.211492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.211499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.211502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:15.211505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:15.211569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:15.211577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.211589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.211602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:15.211615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1995
2025-10-02T08:14:15.211623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440214887:2776], now have 1 active actors on pipe
2025-10-02T08:14:15.211626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534774899814821:2378], now have 1 active actors on pipe
2025-10-02T08:14:15.211632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534774440214833:2775]
2025-10-02T08:14:15.211639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534774440214833:2775]
2025-10-02T08:14:15.211654Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:15.211668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.211672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.211676Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:15.211687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:15.211689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:15.211703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:15.211712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:15.211704Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1995
2025-10-02T08:14:15.211751Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:15.211760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.211764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.211766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:15.211777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.211789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:15.211803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534774440214833:2775]
2025-10-02T08:14:15.211815Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:15.211827Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:15.211847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.211915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.211925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.211947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.211984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1996 partition: 0 MaxSeqNo: 17 sessionId: src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0
2025-10-02T08:14:15.212324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d830521b-24a5f470-4ec1be02-4d2dde92_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:15.215013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0] Write session: try to update token
2025-10-02T08:14:15.215033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:15.228494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId: src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:15.229225Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:15.229242Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:15.229244Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:15.229253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534774440214833:2775]
2025-10-02T08:14:15.229257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534774440214833:2775]
2025-10-02T08:14:15.229303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:15.229311Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:15.229316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.229316Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:15.229318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:15.229453Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:15.230976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:15.293771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534774440214901:8716]
2025-10-02T08:14:15.293866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1995, pipe: [1:7556534774440214901:8716]
2025-10-02T08:14:15.367649Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:15.368055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.368068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.368110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440214901:8716], now have 1 active actors on pipe
2025-10-02T08:14:15.368284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534774440214901:8716]
2025-10-02T08:14:15.368298Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:15.368315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:15.368388Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:15.368398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1996 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0
2025-10-02T08:14:15.368566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1996 sessionId: src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0 is DEAD
2025-10-02T08:14:15.368715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:15.368721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0] Write session will restart in 0.007647s
2025-10-02T08:14:15.368743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0] Write session: Do CDS request
2025-10-02T08:14:15.368748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:15.374080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:15.374477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:15.374626Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:15.374635Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:15.374644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:15.374683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:15.374730Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534774440215004:2850]
2025-10-02T08:14:15.375356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:15.375563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:15.375600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:15.375887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:15.375928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.375934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.375935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.375937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.375938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.375942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.375951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.375955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.375959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.375963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.375968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.375989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.375999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.376008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.376012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.376016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.376019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.376023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.376032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.376036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.376058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:15.377232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.377303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:15.377315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1997
2025-10-02T08:14:15.377424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.377454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:15.377462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:15.377466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:15.377900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1997 sessionId:  describe result for acl check
2025-10-02T08:14:15.377938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:15.377945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:15.377947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:15.377952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534774440215020:2847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:15.378509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534774440215020:2847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:15.380823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534774440215020:2847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:15.383742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534774440215020:2847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:15.383756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534774440215020:2847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:15.383760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534774440215020:2847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:15.383768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:15.384085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:15.385765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:15.385781Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:15.385782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:15.385787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:15.385792Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1996 [1:7556534774440215004:2850]
2025-10-02T08:14:15.385799Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:15.385814Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:15.385816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.385818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.385819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.385832Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:15.385838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:15.385843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:15.385890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.385896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.385899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:15.385901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:15.385949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:15.385954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.385963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.385969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:15.385989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534774440214998:2850]
2025-10-02T08:14:15.385994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534774440214998:2850]
2025-10-02T08:14:15.386000Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:15.386009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440215051:2847], now have 1 active actors on pipe
2025-10-02T08:14:15.386010Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:15.386013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:15.386016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1996
2025-10-02T08:14:15.386019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:15.386027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:15.386029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:15.386033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534774899814828:2378], now have 1 active actors on pipe
2025-10-02T08:14:15.386037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.386042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.386082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534774440214998:2850]
2025-10-02T08:14:15.386090Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:15.386106Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|899448a9-fb274fc5-cd0999d-17f805a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:15.386112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:15.386113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.386116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.386117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:15.386128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.386136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:15.386090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1996
2025-10-02T08:14:15.386178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.386255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.386262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.386273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.386313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1997 partition: 0 MaxSeqNo: 17 sessionId: src_id|899448a9-fb274fc5-cd0999d-17f805a9_0
2025-10-02T08:14:15.386630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc1c8b-6a1c58a1-9e045c3-2a0898f8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|899448a9-fb274fc5-cd0999d-17f805a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:15.389435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899448a9-fb274fc5-cd0999d-17f805a9_0] Write session: try to update token
2025-10-02T08:14:15.389453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899448a9-fb274fc5-cd0999d-17f805a9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:15.402782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId: src_id|899448a9-fb274fc5-cd0999d-17f805a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:15.404196Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:15.404224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:15.404226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:15.404236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534774440214998:2850]
2025-10-02T08:14:15.404240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534774440214998:2850]
2025-10-02T08:14:15.404276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:15.404285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.404287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:15.404288Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:15.404294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:15.404418Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:15.405488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:15.468361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534774440215067:8716]
2025-10-02T08:14:15.468466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1996, pipe: [1:7556534774440215067:8716]
2025-10-02T08:14:15.542629Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:15.542858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.542869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.542899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440215067:8716], now have 1 active actors on pipe
2025-10-02T08:14:15.542985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:15.542991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:15.543025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1997 reason: error at write: Disconnected sessionId: src_id|899448a9-fb274fc5-cd0999d-17f805a9_0
2025-10-02T08:14:15.543135Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:15.543314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899448a9-fb274fc5-cd0999d-17f805a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:15.543324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899448a9-fb274fc5-cd0999d-17f805a9_0] Write session will restart in 0.009299s
2025-10-02T08:14:15.543345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899448a9-fb274fc5-cd0999d-17f805a9_0] Write session: Do CDS request
2025-10-02T08:14:15.543351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899448a9-fb274fc5-cd0999d-17f805a9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:15.543172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1997 sessionId: src_id|899448a9-fb274fc5-cd0999d-17f805a9_0 is DEAD
2025-10-02T08:14:15.543401Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:15.543652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534774440215067:8716]
2025-10-02T08:14:15.549966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:15.550522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:15.550677Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:15.550686Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:15.550694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:15.550732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:15.550764Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534774440215184:2890]
2025-10-02T08:14:15.551376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:15.551535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:15.551571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:15.551845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:15.551883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.551888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.551889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.551891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.551892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.551896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.551905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.551913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.551917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.551921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.551925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.551932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.551940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.551950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.551966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.551975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.551981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.551989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.551995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.552003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.552025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:15.553256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899448a9-fb274fc5-cd0999d-17f805a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.553314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:15.553324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1998
2025-10-02T08:14:15.553456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.553482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:15.553491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:15.553495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:15.553839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1998 sessionId:  describe result for acl check
2025-10-02T08:14:15.553869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:15.553870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:15.553872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:15.553876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534774440215200:2914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:15.554289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534774440215200:2914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:15.556238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534774440215200:2914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:15.559335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534774440215200:2914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:15.559347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534774440215200:2914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:15.559350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534774440215200:2914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:15.559357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:15.560424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:15.562054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:15.562074Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:15.562076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:15.562079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:15.562085Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1997 [1:7556534774440215184:2890]
2025-10-02T08:14:15.562095Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:15.562109Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:15.562115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.562117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.562119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.562130Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:15.562137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:15.562143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:15.562202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.562209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.562212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:15.562214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:15.562267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:15.562273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.562282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.562290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:15.562302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1997
2025-10-02T08:14:15.562305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440215232:2914], now have 1 active actors on pipe
2025-10-02T08:14:15.562310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534774440215178:2890]
2025-10-02T08:14:15.562312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534774440215178:2890]
2025-10-02T08:14:15.562318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:15.562329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:15.562329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:15.562332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:15.562342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:15.562347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:15.562353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.562356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.562370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534774899814847:2378], now have 1 active actors on pipe
2025-10-02T08:14:15.562399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534774440215178:2890]
2025-10-02T08:14:15.562414Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:15.562428Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ab3b429-536ed746-6854dcf0-38704e70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:15.562438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.562441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:15.562443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.562444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:15.562454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.562461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:15.562492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.562523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.562529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.562541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.562536Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1997
2025-10-02T08:14:15.562568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1998 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ab3b429-536ed746-6854dcf0-38704e70_0
2025-10-02T08:14:15.562869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899448a9-fb274fc5-cd0999d-17f805a9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ab3b429-536ed746-6854dcf0-38704e70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:15.565479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3b429-536ed746-6854dcf0-38704e70_0] Write session: try to update token
2025-10-02T08:14:15.565497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3b429-536ed746-6854dcf0-38704e70_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:15.573130Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:15.573147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:15.573152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534774440215178:2890]
2025-10-02T08:14:15.573185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:15.573200Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:15.573348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:15.573503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:15.573670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:15.573802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:15.573979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:15.574020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:15.579253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId: src_id|4ab3b429-536ed746-6854dcf0-38704e70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:15.581677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:15.581748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.581760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.581787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:15.581806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:15.582058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.582075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.582235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.582302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.582364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.582423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.582613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.582623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.582709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.582765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.582825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.582886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.582927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.582936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.582997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.583053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.583123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.583182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.583222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.583229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.583289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.583346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.583406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.583465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.583575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.583582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.583640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.583695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.583752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.583810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.583852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.583859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.583922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.583979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.584037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.584098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.584142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.584149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.584221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.584277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.584340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.584404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.584444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.584452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.584511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.584568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.584625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.584687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.584730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.584739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.584830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.584892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.584953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.585018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.585060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.585067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.585131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:15.585190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:15.585251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:15.585310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:15.585351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:15.585360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:15.585395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:15.585458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.585482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.585488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:15.585520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:15.585537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:15.585545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:15.585548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:15.585551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:15.585920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:15.585947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:15.585958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:15.585963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:15.585971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:15.585975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:15.586514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:15.586537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:15.586543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:15.586548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:15.586552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:15.586556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:15.586972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:15.586994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:15.587003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:15.587006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:15.587009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:15.589129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:15.589148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:15.589159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392855589
2025-10-02T08:14:15.589310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:15.589323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:15.589328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:15.589336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:15.589340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:15.589344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:15.589775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:15.589798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:15.589803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:15.589808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:15.589811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:15.589816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:15.590245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:15.590266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:15.590279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:15.590287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:15.590291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:15.590295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:15.590728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:15.590749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:15.590754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:15.591807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:15.591823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:15.591828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:15.591831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:15.591839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392855591
2025-10-02T08:14:15.592117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:15.592139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:15.592144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:15.592148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:15.592152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:15.592161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:15.592607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:15.592629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:15.592635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:15.592643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:15.592647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:15.592651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:15.593090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:15.593109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.593204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392855592
2025-10-02T08:14:15.596963Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:15.596984Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:15.596992Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:15.596999Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:15.598518Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:15.598533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:15.598535Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:15.598545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534774440215178:2890]
2025-10-02T08:14:15.598555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534774440215178:2890]
2025-10-02T08:14:15.598613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:15.598619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:15.598622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.598624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:15.598625Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:15.598749Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:15.643988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534774440215280:8716]
2025-10-02T08:14:15.644098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1997, pipe: [1:7556534774440215280:8716]
2025-10-02T08:14:15.749362Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:15.749724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440215280:8716], now have 1 active actors on pipe
2025-10-02T08:14:15.749844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534774440215280:8716]
2025-10-02T08:14:15.749863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:15.749870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:15.749892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1998 reason: error at write: Disconnected sessionId: src_id|4ab3b429-536ed746-6854dcf0-38704e70_0
2025-10-02T08:14:15.749958Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:15.750014Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:15.750050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1998 sessionId: src_id|4ab3b429-536ed746-6854dcf0-38704e70_0 is DEAD
2025-10-02T08:14:15.750195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3b429-536ed746-6854dcf0-38704e70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:15.750202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3b429-536ed746-6854dcf0-38704e70_0] Write session will restart in 0.008845s
2025-10-02T08:14:15.750231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3b429-536ed746-6854dcf0-38704e70_0] Write session: Do CDS request
2025-10-02T08:14:15.750237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3b429-536ed746-6854dcf0-38704e70_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:15.756637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:15.756962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:15.757113Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:15.757121Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:15.757131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:15.757174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:15.757205Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534774440215401:2945]
2025-10-02T08:14:15.757815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:15.757982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:15.758015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:15.758295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:15.758333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.758339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.758340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.758341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.758342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.758346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.758357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.758361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.758365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.758368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.758375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.758382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.758392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.758397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.758401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.758405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.758409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.758414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.758419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.758428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.758446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:15.760259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3b429-536ed746-6854dcf0-38704e70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.760331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:15.760342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1999
2025-10-02T08:14:15.760464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.760492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:15.760500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:15.760503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:15.760876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1999 sessionId:  describe result for acl check
2025-10-02T08:14:15.760917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:15.760924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:15.760925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:15.760931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534774440215417:2978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:15.761409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534774440215417:2978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:15.763381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534774440215417:2978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:15.766104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534774440215417:2978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:15.766118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534774440215417:2978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:15.766121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534774440215417:2978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:15.766129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:15.766438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:15.767775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:15.767788Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:15.767789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:15.767792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:15.767796Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1998 [1:7556534774440215401:2945]
2025-10-02T08:14:15.767805Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:15.767817Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:15.767819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.767823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.767830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.767841Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:15.767848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:15.767852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:15.768089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.768095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.768097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:15.768099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:15.768145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:15.768151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.768159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.768166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:15.768183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440215449:2978], now have 1 active actors on pipe
2025-10-02T08:14:15.768191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534774440215395:2945]
2025-10-02T08:14:15.768193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534774440215395:2945]
2025-10-02T08:14:15.768213Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:15.768218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1998
2025-10-02T08:14:15.768223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534774899814877:2378], now have 1 active actors on pipe
2025-10-02T08:14:15.768227Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:15.768230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:15.768230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:15.768238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:15.768240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:15.768264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.768270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.768279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534774440215395:2945]
2025-10-02T08:14:15.768288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:15.768297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:15.768307Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:15.768311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.768314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.768317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:15.768322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.768297Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1998
2025-10-02T08:14:15.768329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:15.768354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.768393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.768398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.768406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.768432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1999 partition: 0 MaxSeqNo: 17 sessionId: src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0
2025-10-02T08:14:15.768722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3b429-536ed746-6854dcf0-38704e70_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:15.770997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0] Write session: try to update token
2025-10-02T08:14:15.771008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:15.783727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId: src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:15.786528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:15.786791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.786818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.786839Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:15.786841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:15.786843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:15.786851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534774440215395:2945]
2025-10-02T08:14:15.786855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534774440215395:2945]
2025-10-02T08:14:15.786894Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:15.786907Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:15.786910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:15.786916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.786919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:15.787064Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:15.849790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534774440215467:8716]
2025-10-02T08:14:15.849919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1998, pipe: [1:7556534774440215467:8716]
2025-10-02T08:14:15.919569Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:15.919846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:15.919877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:15.919884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440215467:8716], now have 1 active actors on pipe
2025-10-02T08:14:15.919974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:15.919982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:15.920005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1999 reason: error at write: Disconnected sessionId: src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0
2025-10-02T08:14:15.920113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1999 sessionId: src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0 is DEAD
2025-10-02T08:14:15.920110Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:15.920316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:15.920323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0] Write session will restart in 0.007400s
2025-10-02T08:14:15.920308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534774440215467:8716]
2025-10-02T08:14:15.920340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0] Write session: Do CDS request
2025-10-02T08:14:15.920347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:15.925166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:15.925605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:15.925751Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:15.925758Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:15.925765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:15.925799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:15.925836Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534774440215573:2993]
2025-10-02T08:14:15.926265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:15.926394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:15.926421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:15.926617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:15.926648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.926652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.926653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.926654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.926654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.926657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.926664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.926666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.926668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.926670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.926673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.926678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:15.926681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.926684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:15.926686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.926690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:15.926692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.926695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.926697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.926702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.926713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:15.929226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.929327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:15.929340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2000
2025-10-02T08:14:15.929459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:15.929491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:15.929501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:15.929504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:15.929878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2000 sessionId:  describe result for acl check
2025-10-02T08:14:15.929912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:15.929917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:15.929919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:15.929936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534774440215590:2992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:15.930379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534774440215590:2992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:15.932634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534774440215590:2992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:15.934843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:15.935233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534774440215590:2992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:15.935247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534774440215590:2992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:15.935251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534774440215590:2992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:15.935259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:15.936297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:15.936309Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:15.936311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:15.936313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:15.936318Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1999 [1:7556534774440215573:2993]
2025-10-02T08:14:15.936325Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:15.936338Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:15.936339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.936341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.936342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.936354Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:15.936358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:15.936363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:15.936406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.936414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.936416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:15.936418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:15.936466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:15.936471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.936479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:15.936486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:15.936500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534774440215567:2993]
2025-10-02T08:14:15.936506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534774440215567:2993]
2025-10-02T08:14:15.936512Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:15.936519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1999
2025-10-02T08:14:15.936521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:15.936522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534774440215622:2992], now have 1 active actors on pipe
2025-10-02T08:14:15.936524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:15.936527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:15.936535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:15.936537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:15.936540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534774899814884:2378], now have 1 active actors on pipe
2025-10-02T08:14:15.936562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.936568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.936579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534774440215567:2993]
2025-10-02T08:14:15.936588Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:15.936596Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:15.936613Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63ed805e-9d9d7814-845aa807-64642a6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:15.936586Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1999
2025-10-02T08:14:15.936622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:15.936625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:15.936626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:15.936631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:15.936637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:15.936657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.936700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:15.936706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:15.936718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:15.936748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2000 partition: 0 MaxSeqNo: 17 sessionId: src_id|63ed805e-9d9d7814-845aa807-64642a6f_0
2025-10-02T08:14:15.937053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fb17ba-797be063-3a8ce1-9ab658b0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63ed805e-9d9d7814-845aa807-64642a6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:15.939509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ed805e-9d9d7814-845aa807-64642a6f_0] Write session: try to update token
2025-10-02T08:14:15.939521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ed805e-9d9d7814-845aa807-64642a6f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:15.953743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId: src_id|63ed805e-9d9d7814-845aa807-64642a6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:15.954465Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:15.954485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:15.954487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:15.954495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534774440215567:2993]
2025-10-02T08:14:15.954500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534774440215567:2993]
2025-10-02T08:14:15.954544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:15.954557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:15.954563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:15.954637Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:15.954652Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:15.954705Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:15.956225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:16.020312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534778735182933:8716]
2025-10-02T08:14:16.020422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1999, pipe: [1:7556534778735182933:8716]
2025-10-02T08:14:16.092702Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:16.093027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.093042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.093083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735182933:8716], now have 1 active actors on pipe
2025-10-02T08:14:16.093176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:16.093185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:16.093242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2000 reason: error at write: Disconnected sessionId: src_id|63ed805e-9d9d7814-845aa807-64642a6f_0
2025-10-02T08:14:16.093269Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:16.093392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2000 sessionId: src_id|63ed805e-9d9d7814-845aa807-64642a6f_0 is DEAD
2025-10-02T08:14:16.093524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534778735182933:8716]
2025-10-02T08:14:16.093655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:16.096895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ed805e-9d9d7814-845aa807-64642a6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:16.096910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ed805e-9d9d7814-845aa807-64642a6f_0] Write session will restart in 0.007049s
2025-10-02T08:14:16.096939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ed805e-9d9d7814-845aa807-64642a6f_0] Write session: Do CDS request
2025-10-02T08:14:16.096945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ed805e-9d9d7814-845aa807-64642a6f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:16.102563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:16.103013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:16.103183Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:16.103195Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:16.103206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:16.103262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:16.103301Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534778735183044:3019]
2025-10-02T08:14:16.103979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:16.104155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:16.104195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:16.104519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:16.104560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.104567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.104568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.104569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.104570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.104575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.104586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.104589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.104594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.104598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.104605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.104613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.104618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.104623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.104629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.104634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.104639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.104644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.104649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.104659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.104679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:16.105228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63ed805e-9d9d7814-845aa807-64642a6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.105460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:16.105473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2001
2025-10-02T08:14:16.105577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.105606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:16.105615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:16.105618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:16.106015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2001 sessionId:  describe result for acl check
2025-10-02T08:14:16.106049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:16.106056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:16.106057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:16.106062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534778735183061:3017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:16.106559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534778735183061:3017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:16.108575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534778735183061:3017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:16.112109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534778735183061:3017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:16.112121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534778735183061:3017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:16.112126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534778735183061:3017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:16.112133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:16.112738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:16.114461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:16.114476Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:16.114479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:16.114482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:16.114489Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2000 [1:7556534778735183044:3019]
2025-10-02T08:14:16.114501Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:16.114517Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:16.114521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.114524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.114527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.114542Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:16.114548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:16.114554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:16.114611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.114619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.114622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:16.114625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:16.114690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:16.114697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.114712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.114720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2000
2025-10-02T08:14:16.114731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:16.114753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183092:3017], now have 1 active actors on pipe
2025-10-02T08:14:16.114763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.114767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.114780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534779194782187:2378], now have 1 active actors on pipe
2025-10-02T08:14:16.114786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534778735183038:3019]
2025-10-02T08:14:16.114789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534778735183038:3019]
2025-10-02T08:14:16.114797Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:16.114814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:16.114820Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:16.114824Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:16.114832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:16.114835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:16.114793Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2000
2025-10-02T08:14:16.114851Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:16.114861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.114865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.114867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:16.114875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.114883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:16.114928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534778735183038:3019]
2025-10-02T08:14:16.114940Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:16.114951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.114960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:16.115010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.115022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.115043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.115084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2001 partition: 0 MaxSeqNo: 17 sessionId: src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0
2025-10-02T08:14:16.115457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63ed805e-9d9d7814-845aa807-64642a6f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:16.118192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0] Write session: try to update token
2025-10-02T08:14:16.118210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:16.126029Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:16.126049Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:16.126057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534778735183038:3019]
2025-10-02T08:14:16.126090Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:16.126097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:16.126254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:16.126391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:16.126521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:16.126653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:16.126901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:16.126936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:16.133450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId: src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:16.135624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:16.135680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.135693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.135731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:16.135758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:16.135810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.135825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.135988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.136048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.136119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.136185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.136253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.136261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.136319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.136376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.136434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.136502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.136546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.136552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.136613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.136666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.136722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.136775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.136837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.136843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.136905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.136959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.137013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.137094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.137151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.137156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.137210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.137263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.137318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.137373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.137419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.137428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.137485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.137538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.137597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.137660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.137700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.137705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.137764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.137817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.137874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.137946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.137992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.137999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.138062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.138124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.138187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.138248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.138290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.138296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.138356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.138414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.138471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.138531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.138574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.138581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.138646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:16.138704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:16.138762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:16.138823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:16.138866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:16.138872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:16.138914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:16.138979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.139003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.139009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:16.139039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:16.139055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:16.139061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:16.139065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:16.139068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:16.139479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:16.139507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:16.139513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:16.139516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:16.139519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:16.139523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:16.140108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:16.140131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:16.140137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:16.140139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:16.140142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:16.140145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:16.140700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:16.140721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:16.140728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:16.140731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:16.140735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:16.141939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:16.141957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:16.141967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392856141
2025-10-02T08:14:16.142116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:16.142133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:16.142139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:16.142142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:16.142145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:16.142148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:16.142629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:16.142650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:16.142654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:16.142657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:16.142659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:16.142662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:16.143059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:16.143077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:16.143081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:16.143084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:16.143086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:16.143088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:16.143503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:16.143520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:16.143524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:16.144499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:16.144514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:16.144518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:16.144523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:16.144529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392856144
2025-10-02T08:14:16.144829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:16.144848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:16.144852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:16.144854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:16.144856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:16.144858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:16.145247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:16.145267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:16.145273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:16.145276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:16.145279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:16.145282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:16.145700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:16.145718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.145799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392856145
2025-10-02T08:14:16.146445Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:16.146463Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:16.146468Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:16.146474Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:16.147862Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:16.147874Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:16.147876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:16.147887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534778735183038:3019]
2025-10-02T08:14:16.147892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534778735183038:3019]
2025-10-02T08:14:16.147931Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:16.147941Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:16.147952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:16.147955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.147957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:16.148067Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:16.193892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534778735183114:8716]
2025-10-02T08:14:16.194046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2000, pipe: [1:7556534778735183114:8716]
2025-10-02T08:14:16.287173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:16.287600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183114:8716], now have 1 active actors on pipe
2025-10-02T08:14:16.287735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534778735183114:8716]
2025-10-02T08:14:16.287760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:16.287766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:16.287791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2001 reason: error at write: Disconnected sessionId: src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0
2025-10-02T08:14:16.287814Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:16.287883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:16.287949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2001 sessionId: src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0 is DEAD
2025-10-02T08:14:16.288093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:16.288100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0] Write session will restart in 0.005697s
2025-10-02T08:14:16.288124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0] Write session: Do CDS request
2025-10-02T08:14:16.288131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:16.294100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:16.294729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:16.294905Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:16.294916Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:16.294926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:16.294976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:16.295019Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534778735183226:3037]
2025-10-02T08:14:16.295259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.295320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:16.295331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2002
2025-10-02T08:14:16.295427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.295446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:16.295453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:16.295455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:16.295674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:16.295725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2002 sessionId:  describe result for acl check
2025-10-02T08:14:16.295759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:16.295765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:16.295767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:16.295771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534778735183233:3049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:16.295840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:16.295887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:16.296131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534778735183233:3049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:16.296183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:16.296246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.296252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.296253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.296254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.296255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.296259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.296268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.296272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.296275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.296279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.296283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.296290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.296295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.296305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.296309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.296318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.296322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.296328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.296336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.296341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.296358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:16.298181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534778735183233:3049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:16.303671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534778735183233:3049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:16.303689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534778735183233:3049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:16.303693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534778735183233:3049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:16.303702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:16.304239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:16.305828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:16.305847Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:16.305850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:16.305854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:16.305861Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2001 [1:7556534778735183226:3037]
2025-10-02T08:14:16.305872Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:16.305892Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:16.305895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.305898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.305900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.305915Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:16.305927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:16.305933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:16.305992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.305999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.306002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:16.306005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:16.306070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:16.306077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.306091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.306105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:16.306120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2001
2025-10-02T08:14:16.306130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183273:3049], now have 1 active actors on pipe
2025-10-02T08:14:16.306134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534779194782198:2378], now have 1 active actors on pipe
2025-10-02T08:14:16.306139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534778735183220:3037]
2025-10-02T08:14:16.306141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534778735183220:3037]
2025-10-02T08:14:16.306154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:16.306168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.306172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:16.306175Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:16.306176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.306194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:16.306213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:16.306217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:16.306210Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2001
2025-10-02T08:14:16.306259Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:16.306277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.306280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.306282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:16.306290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.306297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:16.306304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534778735183220:3037]
2025-10-02T08:14:16.306314Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:16.306331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:16.306348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.306408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.306416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.306431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.306464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2002 partition: 0 MaxSeqNo: 17 sessionId: src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0
2025-10-02T08:14:16.306793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa81b48f-32b1da61-a7cbca4d-a55132fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:16.309564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0] Write session: try to update token
2025-10-02T08:14:16.309579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:16.323709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId: src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:16.324571Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:16.324589Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:16.324592Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:16.324601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534778735183220:3037]
2025-10-02T08:14:16.324606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534778735183220:3037]
2025-10-02T08:14:16.324643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:16.324650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:16.324656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.324657Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:16.324662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:16.324830Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:16.326290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:16.387912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534778735183289:8716]
2025-10-02T08:14:16.388052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2001, pipe: [1:7556534778735183289:8716]
2025-10-02T08:14:16.459531Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:16.459886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.459900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.459936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183289:8716], now have 1 active actors on pipe
2025-10-02T08:14:16.460036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:16.460043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:16.460096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2002 reason: error at write: Disconnected sessionId: src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0
2025-10-02T08:14:16.460168Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:16.460199Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:16.460287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2002 sessionId: src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0 is DEAD
2025-10-02T08:14:16.460438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:16.460449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0] Write session will restart in 0.007556s
2025-10-02T08:14:16.460472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0] Write session: Do CDS request
2025-10-02T08:14:16.460478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:16.460499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534778735183289:8716]
2025-10-02T08:14:16.460521Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:14:16.460612Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 20 consumer shared/user session shared/user_1_20_14160681258514996816_v1 is DEAD
2025-10-02T08:14:16.460791Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:14:16.460820Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534697130744212:8738] disconnected; active server actors: 1
2025-10-02T08:14:16.460833Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534697130744212:8738] client user disconnected session shared/user_1_20_14160681258514996816_v1
2025-10-02T08:14:16.460903Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:14:16.460908Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:14:16.460913Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.009504s
2025-10-02T08:14:16.466789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:16.467514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:16.467682Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:16.467691Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:16.467701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:16.467745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:16.467784Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534778735183403:3052]
2025-10-02T08:14:16.468400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:16.468582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:16.468624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:16.468926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:16.468971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.468976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.468978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.468979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.468980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.468984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.468995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.468998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.469001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.469004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.469010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.469017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.469022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.469027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.469036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.469041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.469045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.469054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.469059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.469064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.469085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:16.469225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.469289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:16.469300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2003
2025-10-02T08:14:16.469427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.469457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:16.469462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:16.469467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:16.469792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2003 sessionId:  describe result for acl check
2025-10-02T08:14:16.469819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:16.469824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:16.469825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:16.469828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534778735183419:3077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:16.470221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534778735183419:3077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:16.471090Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:14:16.472407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534778735183419:3077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:16.472901Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:14:16.472912Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 21
2025-10-02T08:14:16.473078Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 21 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:14:16.473133Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:14:16.473209Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 auth for : user
2025-10-02T08:14:16.473356Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 Handle describe topics response
2025-10-02T08:14:16.473380Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 auth is DEAD
2025-10-02T08:14:16.473390Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:14:16.473637Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:14:16.473737Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_21_2498544722244708379_v1
2025-10-02T08:14:16.473749Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:14:16.473813Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:14:16.473774Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534778735183452:3072] connected; active server actors: 1
2025-10-02T08:14:16.473923Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534778735183452:3072] session shared/user_1_21_2498544722244708379_v1
2025-10-02T08:14:16.473939Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:14:16.473930Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:14:16.473952Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:14:16.473958Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_21_2498544722244708379_v1" (Sender=[1:7556534778735183448:3072], Pipe=[1:7556534778735183452:3072], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:14:16.473961Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:14:16.473972Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:14:16.473979Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 got read request: guid# 9a30bece-f496eef6-f44248d8-71176e5e
2025-10-02T08:14:16.473981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_21_2498544722244708379_v1" (Sender=[1:7556534778735183448:3072], Pipe=[1:7556534778735183452:3072], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:14:16.473998Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_21_2498544722244708379_v1" sender [1:7556534778735183448:3072] lock partition 0 for ReadingSession "shared/user_1_21_2498544722244708379_v1" (Sender=[1:7556534778735183448:3072], Pipe=[1:7556534778735183452:3072], Partitions=[], ActiveFamilyCount=1) generation 1 step 21
2025-10-02T08:14:16.474011Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:14:16.474015Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000039s
2025-10-02T08:14:16.474279Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 21 Session: "shared/user_1_21_2498544722244708379_v1" ClientId: "user" PipeClient { RawX1: 7556534778735183452 RawX2: 4503603922340864 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:14:16.474315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:14:16.476639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534778735183419:3077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:16.476654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534778735183419:3077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:16.476657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534778735183419:3077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:16.476664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:16.477599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:16.479159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:16.479177Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:16.479180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:16.479183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:16.479190Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2002 [1:7556534778735183403:3052]
2025-10-02T08:14:16.479199Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:16.479213Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:16.479216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.479219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.479221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.479238Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:16.479243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:16.479249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:16.479307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.479321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.479324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:16.479326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:16.479388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:16.479391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.479404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.479415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:16.479431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534778735183397:3052]
2025-10-02T08:14:16.479432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534778735183397:3052]
2025-10-02T08:14:16.479442Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:16.479453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:16.479468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:16.479471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:16.479482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:16.479485Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:16.479499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534778735183397:3052]
2025-10-02T08:14:16.479502Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:16.479539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2002
2025-10-02T08:14:16.479557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183460:3077], now have 1 active actors on pipe
2025-10-02T08:14:16.479561Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:16.479561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183454:3106], now have 1 active actors on pipe
2025-10-02T08:14:16.479577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2002, pipe: [1:7556534778735183454:3106]
2025-10-02T08:14:16.479594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.479598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.479611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534779194782204:2378], now have 1 active actors on pipe
2025-10-02T08:14:16.479614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.479617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.479623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_21_2498544722244708379_v1 on pipe: [1:7556534778735183454:3106]
2025-10-02T08:14:16.479645Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:16.479657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.479660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.479661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:16.479669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.479677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:16.479690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.479697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.479698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:16.479712Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_21_2498544722244708379_v1
2025-10-02T08:14:16.479718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.479743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.479753Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:16.479848Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_21_2498544722244708379_v1:1 with generation 2002
2025-10-02T08:14:16.480094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.480106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.480127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.480167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2003 partition: 0 MaxSeqNo: 17 sessionId: src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0
2025-10-02T08:14:16.480451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ce7c8d-f3eae8ce-617fff64-ade5013b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:16.479811Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2002
2025-10-02T08:14:16.481655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:14:16.481684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:14:16.481692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.481701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.481703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.481709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:14:16.481718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:14:16.481763Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392856479 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:14:16.481777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:14:16.481800Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 sending to client partition status
2025-10-02T08:14:16.483004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0] Write session: try to update token
2025-10-02T08:14:16.483017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:16.496600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId: src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:16.499410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:16.499453Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:16.499456Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:16.499459Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:16.499467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534778735183397:3052]
2025-10-02T08:14:16.499471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534778735183397:3052]
2025-10-02T08:14:16.499498Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:16.499506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.499513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:16.499514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.499532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:16.499538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.499540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:16.499686Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:16.649401Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:16.650054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:16.650063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:16.650117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2003 reason: error at write: Disconnected sessionId: src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0
2025-10-02T08:14:16.650427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:16.650438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0] Write session will restart in 0.007898s
2025-10-02T08:14:16.650337Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:16.650463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0] Write session: Do CDS request
2025-10-02T08:14:16.650469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:16.650257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_21_2498544722244708379_v1
2025-10-02T08:14:16.650274Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:16.650276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2003 sessionId: src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0 is DEAD
2025-10-02T08:14:16.650430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534778735183454:3106]
2025-10-02T08:14:16.650445Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_21_2498544722244708379_v1
2025-10-02T08:14:16.657576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:16.658257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:16.658382Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:16.658390Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:16.658396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:16.658425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:16.658448Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534778735183630:3141]
2025-10-02T08:14:16.658877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:16.659062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:16.659089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:16.659307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:16.659358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.659341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.659347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.659347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.659348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.659349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.659352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.659358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.659361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.659363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.659365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.659369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.659374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.659378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.659381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.659384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.659386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.659389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.659392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.659394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.659397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.659408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:16.659430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:16.659432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2004
2025-10-02T08:14:16.659561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.659594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:16.659602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:16.659604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:16.659971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2004 sessionId:  describe result for acl check
2025-10-02T08:14:16.660006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:16.660012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:16.660013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:16.660018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534778735183649:3168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:16.660488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534778735183649:3168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:16.662944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534778735183649:3168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:16.667490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:16.669248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:16.669264Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:16.669267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:16.669270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:16.669277Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2003 [1:7556534778735183630:3141]
2025-10-02T08:14:16.669288Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:16.669304Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:16.669307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.669310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.669312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.669328Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:16.669333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:16.669339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:16.669399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.669408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.669411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:16.669414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:16.669469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:16.669477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.669491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.669509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:16.669529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534778735183624:3141]
2025-10-02T08:14:16.669535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534778735183624:3141]
2025-10-02T08:14:16.669543Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:16.669554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:16.669573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:16.669580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:16.669611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534778735183624:3141]
2025-10-02T08:14:16.669619Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:16.669731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:16.669739Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:16.669743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:16.669937Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2003
2025-10-02T08:14:16.670336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534779194782246:2378], now have 1 active actors on pipe
2025-10-02T08:14:16.670406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534778735183649:3168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:16.670422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534778735183649:3168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:16.670425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534778735183649:3168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:16.670433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:16.670953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2003
2025-10-02T08:14:16.670967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183685:3168], now have 1 active actors on pipe
2025-10-02T08:14:16.671022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.671030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.671053Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:16.671066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.671074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.671076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:16.671086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.671100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:16.671119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.671852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.671864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.671882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.671908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2004 partition: 0 MaxSeqNo: 17 sessionId: src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0
2025-10-02T08:14:16.672259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15083fe-a2dffced-7f50e0e-8af2e2b3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:16.674762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0] Write session: try to update token
2025-10-02T08:14:16.674777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:16.688019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId: src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:16.690185Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:16.690201Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:16.690204Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:16.690212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534778735183624:3141]
2025-10-02T08:14:16.690216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534778735183624:3141]
2025-10-02T08:14:16.690258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:16.690259Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:16.690265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.690267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:16.690267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:16.690422Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:16.690835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:16.749893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534778735183705:3106]
2025-10-02T08:14:16.750042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2003, pipe: [1:7556534778735183705:3106]
2025-10-02T08:14:16.833711Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:16.834028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.834043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.834084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183705:3106], now have 1 active actors on pipe
2025-10-02T08:14:16.834211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:16.834219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:16.834269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2004 reason: error at write: Disconnected sessionId: src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0
2025-10-02T08:14:16.834334Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:16.834314Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:16.834423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2004 sessionId: src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0 is DEAD
2025-10-02T08:14:16.834517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:16.834523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0] Write session will restart in 0.006604s
2025-10-02T08:14:16.834540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0] Write session: Do CDS request
2025-10-02T08:14:16.834545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:16.834537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534778735183705:3106]
2025-10-02T08:14:16.841629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:16.842267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.842328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:16.842337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2005
2025-10-02T08:14:16.842440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:16.842468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:16.842477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:16.842481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:16.842586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:16.842733Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:16.842741Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:16.842751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:16.842797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:16.842831Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534778735183827:3150]
2025-10-02T08:14:16.842863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2005 sessionId:  describe result for acl check
2025-10-02T08:14:16.842898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:16.842904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:16.842906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:16.842910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534778735183830:3158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:16.843424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534778735183830:3158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:16.843468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:16.843630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:16.843669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:16.843960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:16.844002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.844008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.844009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.844010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.844012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.844016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.844026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.844031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.844035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.844039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.844044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.844051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:16.844059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.844069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:16.844074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.844083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:16.844087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.844092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.844097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.844106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.844126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:16.845531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534778735183830:3158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:16.851863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534778735183830:3158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:16.851880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534778735183830:3158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:16.851883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534778735183830:3158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:16.851892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:16.852393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:16.853950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:16.853970Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:16.853973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:16.853976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:16.853983Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2004 [1:7556534778735183827:3150]
2025-10-02T08:14:16.853995Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:16.854010Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:16.854018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.854024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.854026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.854040Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:16.854050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:16.854056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:16.854119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.854127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.854130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:16.854132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:16.854242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2004
2025-10-02T08:14:16.854318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:16.854328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.854310Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2004
2025-10-02T08:14:16.854343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:16.854362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:16.854385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183873:3158], now have 1 active actors on pipe
2025-10-02T08:14:16.854393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534779194782255:2378], now have 1 active actors on pipe
2025-10-02T08:14:16.854398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.854407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.854428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534778735183819:3150]
2025-10-02T08:14:16.854436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534778735183819:3150]
2025-10-02T08:14:16.854448Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:16.854464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:16.854467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:16.854469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:16.854484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:16.854491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:16.854505Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|586e890c-fb0a6755-759e0838-e9b581a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:16.854516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:16.854522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:16.854530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:16.854541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:16.854550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:16.854592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534778735183819:3150]
2025-10-02T08:14:16.854607Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:16.854623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.854627Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:16.854678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:16.854686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:16.854700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:16.854737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2005 partition: 0 MaxSeqNo: 17 sessionId: src_id|586e890c-fb0a6755-759e0838-e9b581a0_0
2025-10-02T08:14:16.855058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12e39f1-8904b33d-7494882f-e52f3d85_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|586e890c-fb0a6755-759e0838-e9b581a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:16.857626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586e890c-fb0a6755-759e0838-e9b581a0_0] Write session: try to update token
2025-10-02T08:14:16.857647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586e890c-fb0a6755-759e0838-e9b581a0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:16.871274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId: src_id|586e890c-fb0a6755-759e0838-e9b581a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:16.872607Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:16.872627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:16.872630Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:16.872640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534778735183819:3150]
2025-10-02T08:14:16.872644Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534778735183819:3150]
2025-10-02T08:14:16.872677Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:16.872681Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:16.872683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:16.872689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:16.872691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:16.872846Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:16.873787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:16.934211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534778735183888:3106]
2025-10-02T08:14:16.934306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2004, pipe: [1:7556534778735183888:3106]
2025-10-02T08:14:17.008583Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:17.008941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.008955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.008993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534778735183888:3106], now have 1 active actors on pipe
2025-10-02T08:14:17.009139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534778735183888:3106]
2025-10-02T08:14:17.009159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:17.009162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:17.009209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2005 reason: error at write: Disconnected sessionId: src_id|586e890c-fb0a6755-759e0838-e9b581a0_0
2025-10-02T08:14:17.009235Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:17.009373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2005 sessionId: src_id|586e890c-fb0a6755-759e0838-e9b581a0_0 is DEAD
2025-10-02T08:14:17.009686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586e890c-fb0a6755-759e0838-e9b581a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:17.009695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586e890c-fb0a6755-759e0838-e9b581a0_0] Write session will restart in 0.006083s
2025-10-02T08:14:17.009716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586e890c-fb0a6755-759e0838-e9b581a0_0] Write session: Do CDS request
2025-10-02T08:14:17.009724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586e890c-fb0a6755-759e0838-e9b581a0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:17.009327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:17.016439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:17.017166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:17.017225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586e890c-fb0a6755-759e0838-e9b581a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.017245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:17.017258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2006
2025-10-02T08:14:17.017355Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:17.017366Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:17.017374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:17.017419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:17.017424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.017451Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534783030151304:3186]
2025-10-02T08:14:17.017454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:17.017458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:17.017461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:17.017774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2006 sessionId:  describe result for acl check
2025-10-02T08:14:17.017802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:17.017807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:17.017808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:17.017813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534783030151308:3189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:17.018077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:17.018262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534783030151308:3189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:17.018294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:17.018340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:17.018636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:17.018682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.018687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.018689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.018690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.018691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.018696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.018705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.018709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.018712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.018716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.018720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.018727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.018732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.018737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.018742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.018750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.018754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.018758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.018762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.018767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.018789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:17.020224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534783030151308:3189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:17.026153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534783030151308:3189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:17.026170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534783030151308:3189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:17.026173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534783030151308:3189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:17.026182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:17.026656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:17.028140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:17.028159Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:17.028162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:17.028165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:17.028171Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2005 [1:7556534783030151304:3186]
2025-10-02T08:14:17.028182Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:17.028197Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:17.028214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.028217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.028219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.028237Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:17.028246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:17.028252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:17.028315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.028321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.028324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:17.028327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:17.028387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:17.028396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.028411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.028422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:17.028433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2005
2025-10-02T08:14:17.028439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030151351:3189], now have 1 active actors on pipe
2025-10-02T08:14:17.028442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534783489749558:2378], now have 1 active actors on pipe
2025-10-02T08:14:17.028447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534783030151297:3186]
2025-10-02T08:14:17.028449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534783030151297:3186]
2025-10-02T08:14:17.028459Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:17.028472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.028472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:17.028475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:17.028482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.028500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:17.028513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:17.028520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:17.028559Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:17.028570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.028573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.028575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:17.028582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.028595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:17.028578Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2005
2025-10-02T08:14:17.028606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534783030151297:3186]
2025-10-02T08:14:17.028619Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:17.028627Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:17.028646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.028681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.028689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.028701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.028734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2006 partition: 0 MaxSeqNo: 17 sessionId: src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0
2025-10-02T08:14:17.029084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586e890c-fb0a6755-759e0838-e9b581a0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:17.031580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0] Write session: try to update token
2025-10-02T08:14:17.031596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:17.046605Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:17.046625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:17.046628Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:17.046637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534783030151297:3186]
2025-10-02T08:14:17.046642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534783030151297:3186]
2025-10-02T08:14:17.046686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:17.046686Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:17.046692Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:17.046696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.046699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:17.046842Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:17.048719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId: src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:17.051150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:17.109326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534783030151368:3106]
2025-10-02T08:14:17.109469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2005, pipe: [1:7556534783030151368:3106]
2025-10-02T08:14:17.197659Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:17.198018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.198036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.198080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030151368:3106], now have 1 active actors on pipe
2025-10-02T08:14:17.198170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:17.198179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:17.198227Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:17.198231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2006 reason: error at write: Disconnected sessionId: src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0
2025-10-02T08:14:17.198318Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:17.198381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2006 sessionId: src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0 is DEAD
2025-10-02T08:14:17.198482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534783030151368:3106]
2025-10-02T08:14:17.198540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:17.198551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0] Write session will restart in 0.008682s
2025-10-02T08:14:17.198577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0] Write session: Do CDS request
2025-10-02T08:14:17.198583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:17.204895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:17.205387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:17.205538Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:17.205548Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:17.205556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:17.205605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:17.205641Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534783030151491:3232]
2025-10-02T08:14:17.206299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:17.206460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:17.206501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:17.206808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:17.206848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.206854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.206855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.206856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.206857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.206862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.206873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.206878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.206882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.206886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.206896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.206903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.206914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.206919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.206924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.206930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.206935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.206940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.206950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.206956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.206977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:17.208303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.208420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:17.208432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2007
2025-10-02T08:14:17.208561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.208588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:17.208597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:17.208601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:17.208983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2007 sessionId:  describe result for acl check
2025-10-02T08:14:17.209017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:17.209022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:17.209023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:17.209027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534783030151507:3222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:17.209397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534783030151507:3222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:17.211467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534783030151507:3222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:17.214140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534783030151507:3222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:17.214154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534783030151507:3222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:17.214158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534783030151507:3222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:17.214166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:17.214658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:17.216229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:17.216244Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:17.216246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:17.216250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:17.216256Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2006 [1:7556534783030151491:3232]
2025-10-02T08:14:17.216265Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:17.216280Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:17.216283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.216286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.216288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.216305Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:17.216309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:17.216315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:17.216366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.216377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.216380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:17.216382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:17.216439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:17.216446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.216459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.216477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:17.216497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030151538:3222], now have 1 active actors on pipe
2025-10-02T08:14:17.216498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2006
2025-10-02T08:14:17.216505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534783489749567:2378], now have 1 active actors on pipe
2025-10-02T08:14:17.216511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534783030151485:3232]
2025-10-02T08:14:17.216513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534783030151485:3232]
2025-10-02T08:14:17.216523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:17.216535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.216538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:17.216541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:17.216543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.216559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:17.216577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:17.216584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:17.216565Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2006
2025-10-02T08:14:17.216621Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:17.216630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.216633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.216635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:17.216642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.216650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:17.216662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534783030151485:3232]
2025-10-02T08:14:17.216673Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:17.216684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:17.216700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.216779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.216787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.216813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.216850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2007 partition: 0 MaxSeqNo: 17 sessionId: src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0
2025-10-02T08:14:17.217143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08c7b50-1cb947ec-b1ffc24-eaeee4f8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:17.219895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0] Write session: try to update token
2025-10-02T08:14:17.219913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:17.228138Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:17.228162Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:17.228171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534783030151485:3232]
2025-10-02T08:14:17.228225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:17.228224Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:17.228388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:17.228530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:17.228665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:17.228823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:17.229012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:17.229053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:17.233794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId: src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:17.236308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:17.236362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.236376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.236408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:17.236427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:17.236475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.236494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.236670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.236740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.236849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.236919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.237060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.237072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.237141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.237204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.237269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.237338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.237383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.237390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.237458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.237518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.237581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.237643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.237687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.237698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.237761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.237823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.237889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.237954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.237997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.238006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.238068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.238128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.238190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.238255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.238299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.238305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.238369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.238429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.238491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.238555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.238599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.238606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.238674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.238738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.238811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.238873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.238923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.238932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.238994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.239059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.239123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.239188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.239234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.239242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.239314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.239375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.239442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.239508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.239555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.239563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.239635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.239700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.239766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.239831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.239877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.239884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.239926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:17.239991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.240015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.240022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:17.240054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:17.240074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:17.240081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:17.240084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:17.240086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:17.240501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:17.240531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:17.240542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:17.240546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:17.240549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:17.240552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:17.241176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:17.241205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:17.241213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:17.241217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:17.241225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:17.241228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:17.241725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:17.241755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:17.241765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:17.241769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:17.241772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:17.243000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:17.243020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:17.243033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392857242
2025-10-02T08:14:17.243161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:17.243175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:17.243180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:17.243183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:17.243188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:17.243191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:17.243666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:17.243691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:17.243698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:17.243705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:17.243710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:17.243715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:17.244160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:17.244188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:17.244196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:17.244200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:17.244211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:17.244214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:17.244668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:17.244696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:17.244701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:17.245731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:17.245752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:17.245757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:17.245761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:17.245769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392857245
2025-10-02T08:14:17.246036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:17.246054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:17.246060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:17.246070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:17.246074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:17.246078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:17.246474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:17.246492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:17.246495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:17.246498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:17.246500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:17.246502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:17.246915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:17.246932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.247003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392857247
2025-10-02T08:14:17.247681Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:17.247696Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:17.247701Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:17.247706Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:17.249167Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:17.249180Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:17.249182Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:17.249196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534783030151485:3232]
2025-10-02T08:14:17.249199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534783030151485:3232]
2025-10-02T08:14:17.249245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:17.249247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:17.249252Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:17.249254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.249256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:17.249371Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:17.298754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534783030151559:3106]
2025-10-02T08:14:17.298861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2006, pipe: [1:7556534783030151559:3106]
2025-10-02T08:14:17.383492Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:17.383916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030151559:3106], now have 1 active actors on pipe
2025-10-02T08:14:17.384034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534783030151559:3106]
2025-10-02T08:14:17.384053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:17.384054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:17.384073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2007 reason: error at write: Disconnected sessionId: src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0
2025-10-02T08:14:17.384165Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:17.384148Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:17.384245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2007 sessionId: src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0 is DEAD
2025-10-02T08:14:17.384328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:17.384335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0] Write session will restart in 0.005254s
2025-10-02T08:14:17.384357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0] Write session: Do CDS request
2025-10-02T08:14:17.384364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:17.390313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.390375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:17.390390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2008
2025-10-02T08:14:17.390510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.390538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:17.390543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:17.390546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:17.390551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:17.390820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2008 sessionId:  describe result for acl check
2025-10-02T08:14:17.390847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:17.390851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:17.390852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:17.390856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534783030151684:3247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:17.391221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534783030151684:3247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:17.391364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:17.391511Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:17.391521Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:17.391529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:17.391568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:17.391595Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534783030151692:3245]
2025-10-02T08:14:17.391972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:17.392222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:17.392277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:17.392585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:17.392624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.392629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.392631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.392632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.392633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.392640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.392649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.392656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.392660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.392667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.392672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.392682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.392691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.392699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.392707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.392711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.392715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.392719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.392725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.392733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.392752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:17.393033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534783030151684:3247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:17.398592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534783030151684:3247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:17.398613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534783030151684:3247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:17.398616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534783030151684:3247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:17.398624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:17.400731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:17.402237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:17.402252Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:17.402254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:17.402257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:17.402262Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2007 [1:7556534783030151692:3245]
2025-10-02T08:14:17.402270Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:17.402284Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:17.402285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.402288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.402289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.402302Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:17.402306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:17.402311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:17.402366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.402374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.402376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:17.402380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:17.402467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:17.402474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.402485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.402496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:17.402506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2007
2025-10-02T08:14:17.402513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030151734:3247], now have 1 active actors on pipe
2025-10-02T08:14:17.402519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534783489749573:2378], now have 1 active actors on pipe
2025-10-02T08:14:17.402523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.402526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.402543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534783030151679:3245]
2025-10-02T08:14:17.402556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534783030151679:3245]
2025-10-02T08:14:17.402568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:17.402571Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2007
2025-10-02T08:14:17.402581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:17.402589Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:17.402592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:17.402594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:17.402596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:17.402608Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:17.402612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.402614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.402615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:17.402621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.402629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:17.402657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534783030151679:3245]
2025-10-02T08:14:17.402667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:17.402680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.402687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:17.402729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.402735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.402745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.402781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2008 partition: 0 MaxSeqNo: 17 sessionId: src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0
2025-10-02T08:14:17.403053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2116f8e-2bf2291-a86cf51b-577dde68_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:17.405667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0] Write session: try to update token
2025-10-02T08:14:17.405683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:17.417893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId: src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:17.419755Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:17.419775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:17.419778Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:17.419787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534783030151679:3245]
2025-10-02T08:14:17.419791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534783030151679:3245]
2025-10-02T08:14:17.419833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:17.419846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.419848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:17.419862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:17.419881Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:17.419981Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:17.420536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:17.484103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534783030151747:3106]
2025-10-02T08:14:17.484242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2007, pipe: [1:7556534783030151747:3106]
2025-10-02T08:14:17.559875Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:17.560126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.560138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.560167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030151747:3106], now have 1 active actors on pipe
2025-10-02T08:14:17.560258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:17.560277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:17.560326Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:17.560329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2008 reason: error at write: Disconnected sessionId: src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0
2025-10-02T08:14:17.560384Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:17.560459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2008 sessionId: src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0 is DEAD
2025-10-02T08:14:17.560561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534783030151747:3106]
2025-10-02T08:14:17.560603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:17.560610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0] Write session will restart in 0.005597s
2025-10-02T08:14:17.560635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0] Write session: Do CDS request
2025-10-02T08:14:17.560641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:17.566231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:17.566842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:17.566998Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:17.567010Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:17.567020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:17.567065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:17.567105Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534783030151874:3258]
2025-10-02T08:14:17.567236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.567304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:17.567317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2009
2025-10-02T08:14:17.567439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.567466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:17.567469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:17.567472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:17.567745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:17.567746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2009 sessionId:  describe result for acl check
2025-10-02T08:14:17.567763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:17.567764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:17.567765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:17.567768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534783030151879:3271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:17.567926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:17.567972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:17.568162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534783030151879:3271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:17.568291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:17.568341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.568347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.568348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.568349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.568350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.568355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.568363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.568367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.568371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.568375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.568380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.568387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.568392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.568397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.568402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.568406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.568415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.568420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.568429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.568434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.568452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:17.569777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534783030151879:3271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:17.574843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534783030151879:3271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:17.574860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534783030151879:3271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:17.574863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534783030151879:3271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:17.574871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:17.576461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:17.578010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:17.578027Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:17.578031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:17.578035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:17.578040Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2008 [1:7556534783030151874:3258]
2025-10-02T08:14:17.578051Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:17.578066Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:17.578072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.578075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.578077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.578093Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:17.578103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:17.578109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:17.578161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.578168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.578171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:17.578174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:17.578233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:17.578243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.578265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2008
2025-10-02T08:14:17.578270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.578284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:17.578301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030151922:3271], now have 1 active actors on pipe
2025-10-02T08:14:17.578310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534783489749579:2378], now have 1 active actors on pipe
2025-10-02T08:14:17.578315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.578320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.578334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534783030151868:3258]
2025-10-02T08:14:17.578336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534783030151868:3258]
2025-10-02T08:14:17.578348Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:17.578359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:17.578360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:17.578364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:17.578374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:17.578377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:17.578390Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:17.578398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.578401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.578402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:17.578369Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2008
2025-10-02T08:14:17.578411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.578419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:17.578452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534783030151868:3258]
2025-10-02T08:14:17.578463Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:17.578475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:17.578477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.578565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.578573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.578587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.578618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2009 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0
2025-10-02T08:14:17.578930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30665c5f-2b14d1e7-cb582a52-b9203d8e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:17.581426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0] Write session: try to update token
2025-10-02T08:14:17.581441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:17.595284Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:17.595306Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:17.595308Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:17.595318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534783030151868:3258]
2025-10-02T08:14:17.595321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534783030151868:3258]
2025-10-02T08:14:17.595359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:17.595366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.595370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:17.595372Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:17.595376Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:17.595493Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:17.595638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId: src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:17.598077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:17.660727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534783030151975:3106]
2025-10-02T08:14:17.660795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2008, pipe: [1:7556534783030151975:3106]
2025-10-02T08:14:17.736001Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:17.736326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.736341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.736377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030151975:3106], now have 1 active actors on pipe
2025-10-02T08:14:17.736465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:17.736475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:17.736526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2009 reason: error at write: Disconnected sessionId: src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0
2025-10-02T08:14:17.736534Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:17.736592Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:17.736672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2009 sessionId: src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0 is DEAD
2025-10-02T08:14:17.736752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534783030151975:3106]
2025-10-02T08:14:17.736785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:17.736791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0] Write session will restart in 0.007608s
2025-10-02T08:14:17.736830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0] Write session: Do CDS request
2025-10-02T08:14:17.736837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:17.743429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:17.743972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:17.744110Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:17.744119Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:17.744128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:17.744171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:17.744213Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534783030152114:3333]
2025-10-02T08:14:17.744757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:17.744963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:17.745002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:17.745274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.745282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:17.745318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.745322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.745323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.745323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.745324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.745327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.745333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.745335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.745337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.745340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.745340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:17.745344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.745345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2010
2025-10-02T08:14:17.745347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.745350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.745353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.745355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.745358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.745359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.745362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.745364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.745367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.745390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:17.745444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.745470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:17.745476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:17.745479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:17.745784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2010 sessionId:  describe result for acl check
2025-10-02T08:14:17.745818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:17.745824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:17.745825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:17.745831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534783030152130:3340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:17.746291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534783030152130:3340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:17.748011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534783030152130:3340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:17.753079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534783030152130:3340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:17.753098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534783030152130:3340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:17.753101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534783030152130:3340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:17.753109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:17.753474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:17.755075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:17.755090Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:17.755091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:17.755094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:17.755099Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2009 [1:7556534783030152114:3333]
2025-10-02T08:14:17.755109Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:17.755124Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:17.755127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.755130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.755132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.755146Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:17.755152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:17.755159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:17.755426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.755435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.755440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:17.755442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:17.755503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:17.755512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.755522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.755532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:17.755545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2009
2025-10-02T08:14:17.755549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030152162:3340], now have 1 active actors on pipe
2025-10-02T08:14:17.755555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534783030152108:3333]
2025-10-02T08:14:17.755557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534783030152108:3333]
2025-10-02T08:14:17.755567Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:17.755575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534783489749619:2378], now have 1 active actors on pipe
2025-10-02T08:14:17.755579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.755579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:17.755582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:17.755583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.755599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:17.755611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:17.755619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:17.755622Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2009
2025-10-02T08:14:17.755659Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:17.755668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.755672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.755673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:17.755681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.755687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:17.755692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534783030152108:3333]
2025-10-02T08:14:17.755699Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:17.755704Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:17.755722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.755792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.755798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.755808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.755838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2010 partition: 0 MaxSeqNo: 17 sessionId: src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0
2025-10-02T08:14:17.756123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1aa4df-702c093b-8ffb689a-b54f9a62_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:17.758699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0] Write session: try to update token
2025-10-02T08:14:17.758719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:17.772502Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:17.772526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:17.772529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:17.772537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534783030152108:3333]
2025-10-02T08:14:17.772541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534783030152108:3333]
2025-10-02T08:14:17.772588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:17.772594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:17.772599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.772601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:17.772601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:17.772748Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:17.777369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId: src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:17.779806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:17.836905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534783030152180:3106]
2025-10-02T08:14:17.840946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2009, pipe: [1:7556534783030152180:3106]
2025-10-02T08:14:17.905381Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:17.905658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.905674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.905710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030152180:3106], now have 1 active actors on pipe
2025-10-02T08:14:17.905834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:17.905845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:17.905902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2010 reason: error at write: Disconnected sessionId: src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0
2025-10-02T08:14:17.905925Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:17.906053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2010 sessionId: src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0 is DEAD
2025-10-02T08:14:17.906171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534783030152180:3106]
2025-10-02T08:14:17.906328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:17.906353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0] Write session will restart in 0.007211s
2025-10-02T08:14:17.906374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0] Write session: Do CDS request
2025-10-02T08:14:17.906383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:17.908882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:17.914555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.914586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:17.914603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2011
2025-10-02T08:14:17.914740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:17.914767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:17.914776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:17.914778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:17.915168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2011 sessionId:  describe result for acl check
2025-10-02T08:14:17.915203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:17.915209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:17.915211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:17.915216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534783030152275:3356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:17.915709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534783030152275:3356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:17.918281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534783030152275:3356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:17.919422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:17.920707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:17.920898Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:17.920910Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:17.920919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:17.920971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:17.921003Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534783030152341:3358]
2025-10-02T08:14:17.921073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534783030152275:3356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:17.921079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534783030152275:3356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:17.921081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534783030152275:3356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:17.921089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:17.921574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:17.921771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:17.921817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:17.922118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:17.922168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.922174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.922175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.922176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.922177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.922182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.922191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.922200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.922208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.922212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.922217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.922228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:17.922233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.922238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:17.922243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.922247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:17.922251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.922256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.922260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.922265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.922284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:17.932441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:17.933916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:17.933939Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:17.933942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:17.933946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:17.933953Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2010 [1:7556534783030152341:3358]
2025-10-02T08:14:17.933966Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:17.933983Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:17.933992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.933998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.934001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.934017Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:17.934026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:17.934033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:17.934099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.934107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.934110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:17.934113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:17.934215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:17.934225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.934239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2010
2025-10-02T08:14:17.934241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:17.934256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:17.934274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534783030152346:3356], now have 1 active actors on pipe
2025-10-02T08:14:17.934282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534783489749628:2378], now have 1 active actors on pipe
2025-10-02T08:14:17.934287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.934291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.934307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534783030152335:3358]
2025-10-02T08:14:17.934314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534783030152335:3358]
2025-10-02T08:14:17.934325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:17.934341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:17.934349Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:17.934353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:17.934360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:17.934363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:17.934325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2010
2025-10-02T08:14:17.934380Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6938dbd-bed6737-b4616975-56949f31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:17.934392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.934401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.934403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:17.934413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.934427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:17.934466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534783030152335:3358]
2025-10-02T08:14:17.934478Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:17.934493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:17.934500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.934546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.934553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.934569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:17.934611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2011 partition: 0 MaxSeqNo: 17 sessionId: src_id|6938dbd-bed6737-b4616975-56949f31_0
2025-10-02T08:14:17.934950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea7efb34-9c993174-8730cc39-e5a97ee7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6938dbd-bed6737-b4616975-56949f31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:17.937583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6938dbd-bed6737-b4616975-56949f31_0] Write session: try to update token
2025-10-02T08:14:17.937598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6938dbd-bed6737-b4616975-56949f31_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:17.946413Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:17.946435Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:17.946443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534783030152335:3358]
2025-10-02T08:14:17.946484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:17.946490Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:17.946649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:17.946795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:17.946936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:17.947074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:17.947750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:17.947805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:17.959583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId: src_id|6938dbd-bed6737-b4616975-56949f31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:17.961988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:17.962062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.962072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.962108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:17.962128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:17.962179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:17.962182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:17.962335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.962390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.962448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.962508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.962547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.962552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.962621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.962691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.962764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.962824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.962861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.962864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.962934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.962986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.963148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.963266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.963304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.963307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.963432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.963488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.963545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.963603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.963642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.963645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.963713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.963767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.963824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.963882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.963921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.963924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.963993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.964048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.964106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.964162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.964304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.964308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.964373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.964428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.964489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.964545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.964583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.964586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.964650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.964704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.964765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.965023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.965071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.965074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.965140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.965195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.965249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.965307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.965346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.965349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.965413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:17.965467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:17.965523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:17.965579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:17.965618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:17.965621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:17.965659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:17.965719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:17.965740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:17.965742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:17.965773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:17.965785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:17.965789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:17.965792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:17.965795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:17.966207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:17.966222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:17.966229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:17.966232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:17.966237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:17.966240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:17.966691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:17.966704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:17.966710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:17.966713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:17.966716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:17.966719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:17.967205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:17.967216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:17.967222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:17.967225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:17.967229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:17.975203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:17.975240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:17.975253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392857975
2025-10-02T08:14:17.975417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:17.975436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:17.975448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:17.975457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:17.975471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:17.975475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:17.975964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:17.975993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:17.976001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:17.976005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:17.976013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:17.976017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:17.976495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:17.976519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:17.976527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:17.976530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:17.976536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:17.976539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:17.977028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:17.977054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:17.977060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:17.978140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:17.978164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:17.978169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:17.978173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:17.978181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392857978
2025-10-02T08:14:17.978473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:17.978486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:17.978492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:17.978496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:17.978499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:17.978503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:17.978966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:17.978977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:17.978983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:17.978989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:17.978993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:17.978997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:17.979457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:17.979466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:17.979568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392857979
2025-10-02T08:14:17.983626Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:17.983650Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:17.983658Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:17.983665Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:17.985306Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:17.985318Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:17.985320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:17.985333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534783030152335:3358]
2025-10-02T08:14:17.985337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534783030152335:3358]
2025-10-02T08:14:17.985391Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:17.985404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:17.985404Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:17.985410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:17.985412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:17.985550Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:18.006346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534787325119675:3106]
2025-10-02T08:14:18.006562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2010, pipe: [1:7556534787325119675:3106]
2025-10-02T08:14:18.130805Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:14:18.130839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-10-02T08:14:18.134735Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:18.135102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325119675:3106], now have 1 active actors on pipe
2025-10-02T08:14:18.135258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534787325119675:3106]
2025-10-02T08:14:18.135286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:18.135293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:18.135318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2011 reason: error at write: Disconnected sessionId: src_id|6938dbd-bed6737-b4616975-56949f31_0
2025-10-02T08:14:18.135400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:18.135424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-10-02T08:14:18.135384Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:18.135489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2011 sessionId: src_id|6938dbd-bed6737-b4616975-56949f31_0 is DEAD
2025-10-02T08:14:18.135602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6938dbd-bed6737-b4616975-56949f31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:18.135613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6938dbd-bed6737-b4616975-56949f31_0] Write session will restart in 0.008294s
2025-10-02T08:14:18.135635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6938dbd-bed6737-b4616975-56949f31_0] Write session: Do CDS request
2025-10-02T08:14:18.135641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6938dbd-bed6737-b4616975-56949f31_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:18.143391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:18.144535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:18.144726Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:18.144739Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:18.144751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:18.144827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:18.144868Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534787325119810:3398]
2025-10-02T08:14:18.145244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6938dbd-bed6737-b4616975-56949f31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.145312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:18.145326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2012
2025-10-02T08:14:18.145425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.145431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:18.145451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:18.145460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:18.145463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:18.145637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:18.145685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:18.145808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2012 sessionId:  describe result for acl check
2025-10-02T08:14:18.145836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:18.145842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:18.145843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:18.145848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534787325119821:3400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:18.145963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:18.146029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.146036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.146037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.146038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.146039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.146043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.146052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.146057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.146060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.146063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.146068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.146074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.146079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.146083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.146086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.146090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.146094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.146097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.146101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.146105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.146121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:18.146277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534787325119821:3400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:18.148582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534787325119821:3400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:18.153353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534787325119821:3400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:18.153370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534787325119821:3400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:18.153373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534787325119821:3400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:18.153383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:18.153983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:18.155572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:18.155590Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:18.155593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:18.155596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:18.155602Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2011 [1:7556534787325119810:3398]
2025-10-02T08:14:18.155613Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:18.155628Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:18.155631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.155633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.155635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.155651Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:18.155655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:18.155661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:18.155716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.155726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.155729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:18.155731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:18.155795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:18.155805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.155817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.155826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:18.155838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2011
2025-10-02T08:14:18.155846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325119858:3400], now have 1 active actors on pipe
2025-10-02T08:14:18.155849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534787784716931:2378], now have 1 active actors on pipe
2025-10-02T08:14:18.155855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534787325119804:3398]
2025-10-02T08:14:18.155860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534787325119804:3398]
2025-10-02T08:14:18.155871Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:18.155879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.155883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.155885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:18.155888Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:18.155900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:18.155912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:18.155915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:18.155957Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:18.155964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.155970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.155972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:18.155981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.155989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:18.155995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534787325119804:3398]
2025-10-02T08:14:18.156003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:18.156018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:18.156028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.156074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.156083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.156097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.156095Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2011
2025-10-02T08:14:18.156137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2012 partition: 0 MaxSeqNo: 17 sessionId: src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0
2025-10-02T08:14:18.156191Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:14:18.156387Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 17 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:14:18.156416Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:14:18.156472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6938dbd-bed6737-b4616975-56949f31_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:18.158933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0] Write session: try to update token
2025-10-02T08:14:18.158949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:18.173301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId: src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:18.174348Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:18.174367Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:18.174369Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:18.174378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534787325119804:3398]
2025-10-02T08:14:18.174382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534787325119804:3398]
2025-10-02T08:14:18.174436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:18.174449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.174452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:18.174461Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:18.174471Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:18.174595Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:18.176116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:18.235211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534787325119876:3106]
2025-10-02T08:14:18.235319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2011, pipe: [1:7556534787325119876:3106]
2025-10-02T08:14:18.307088Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:18.307430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.307444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.307487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325119876:3106], now have 1 active actors on pipe
2025-10-02T08:14:18.307580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:18.307589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:18.307639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2012 reason: error at write: Disconnected sessionId: src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0
2025-10-02T08:14:18.307665Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:18.307735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:18.307763Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T08:14:18.307950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:18.307959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0] Write session will restart in 0.008508s
2025-10-02T08:14:18.307797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2012 sessionId: src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0 is DEAD
2025-10-02T08:14:18.307930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534787325119876:3106]
2025-10-02T08:14:18.307979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0] Write session: Do CDS request
2025-10-02T08:14:18.307986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:18.315200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:18.316044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:18.316219Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:18.316229Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:18.316239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:18.316289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:18.316325Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534787325120012:3432]
2025-10-02T08:14:18.316976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:18.317174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:18.317219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:18.317251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.317351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:18.317361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2013
2025-10-02T08:14:18.317488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.317515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:18.317517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:18.317522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:18.317525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:18.317547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.317555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.317556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.317557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.317559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.317564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.317573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.317577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.317581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.317585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.317590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.317598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.317604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.317620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.317628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.317633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.317637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.317642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.317647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.317656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.317673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:18.317863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2013 sessionId:  describe result for acl check
2025-10-02T08:14:18.317885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:18.317889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:18.317891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:18.317894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534787325120026:3460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:18.318333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534787325120026:3460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:18.319967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534787325120026:3460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:18.325116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534787325120026:3460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:18.325132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534787325120026:3460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:18.325135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534787325120026:3460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:18.325144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:18.325606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:18.326962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:18.326976Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:18.326978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:18.326980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:18.326985Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2012 [1:7556534787325120012:3432]
2025-10-02T08:14:18.326993Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:18.327007Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:18.327015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.327018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.327019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.327030Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:18.327034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:18.327042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:18.327084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.327089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.327091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:18.327093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:18.327138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:18.327144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.327152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.327166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:18.327179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2012
2025-10-02T08:14:18.327186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325120059:3460], now have 1 active actors on pipe
2025-10-02T08:14:18.327192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534787325120006:3432]
2025-10-02T08:14:18.327195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534787325120006:3432]
2025-10-02T08:14:18.327200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:18.327211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534787784716942:2378], now have 1 active actors on pipe
2025-10-02T08:14:18.327215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.327217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.327225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:18.327230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:18.327234Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:18.327239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:18.327240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:18.327270Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:18.327278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.327281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.327286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:18.327292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.327299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:18.327305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534787325120006:3432]
2025-10-02T08:14:18.327308Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:18.327314Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:18.327325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.327283Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2012
2025-10-02T08:14:18.327362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.327369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.327399Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:14:18.327421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.327447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2013 partition: 0 MaxSeqNo: 17 sessionId: src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0
2025-10-02T08:14:18.327572Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 18 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:14:18.327602Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:14:18.327705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|325689ac-30dd0f4b-f1d10a7a-217a2cf3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:18.330141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0] Write session: try to update token
2025-10-02T08:14:18.330154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:18.343820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId: src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:18.344946Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:18.344963Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:18.344965Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:18.344973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534787325120006:3432]
2025-10-02T08:14:18.344977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534787325120006:3432]
2025-10-02T08:14:18.345018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:18.345017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:18.345022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:18.345031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.345034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:18.345168Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:18.346349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:18.408296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534787325120079:3106]
2025-10-02T08:14:18.408407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2012, pipe: [1:7556534787325120079:3106]
2025-10-02T08:14:18.490868Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:18.491254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.491267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.491305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325120079:3106], now have 1 active actors on pipe
2025-10-02T08:14:18.491432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534787325120079:3106]
2025-10-02T08:14:18.491470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:18.491473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:18.491532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2013 reason: error at write: Disconnected sessionId: src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0
2025-10-02T08:14:18.491563Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:18.491680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2013 sessionId: src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0 is DEAD
2025-10-02T08:14:18.491831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:18.491841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0] Write session will restart in 0.008577s
2025-10-02T08:14:18.491861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0] Write session: Do CDS request
2025-10-02T08:14:18.491868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:18.491937Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:18.497809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:18.498677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:18.498834Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:18.498847Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:18.498855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:18.498900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:18.498936Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534787325120218:3498]
2025-10-02T08:14:18.499495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:18.499690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:18.499734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:18.500032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:18.500074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.500080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.500083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.500084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.500085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.500090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.500100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.500109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.500113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.500116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.500122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.500133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.500142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.500151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.500159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.500168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.500177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.500186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.500195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.500210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.500230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:18.501237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.501307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:18.501317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2014
2025-10-02T08:14:18.501412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.501438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:18.501446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:18.501449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:18.501768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2014 sessionId:  describe result for acl check
2025-10-02T08:14:18.501795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:18.501802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:18.501803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:18.501807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534787325120234:3532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:18.502261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534787325120234:3532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:18.504559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534787325120234:3532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:18.507747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534787325120234:3532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:18.507762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534787325120234:3532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:18.507765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534787325120234:3532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:18.507773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:18.508381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:18.509935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:18.509951Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:18.509954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:18.509957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:18.509963Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2013 [1:7556534787325120218:3498]
2025-10-02T08:14:18.509973Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:18.509988Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:18.509991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.509993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.509995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.510010Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:18.510014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:18.510019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:18.510068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.510076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.510078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:18.510081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:18.510139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:18.510146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.510157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.510169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:18.510185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2013
2025-10-02T08:14:18.510189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325120265:3532], now have 1 active actors on pipe
2025-10-02T08:14:18.510193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534787784716950:2378], now have 1 active actors on pipe
2025-10-02T08:14:18.510198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534787325120212:3498]
2025-10-02T08:14:18.510200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534787325120212:3498]
2025-10-02T08:14:18.510210Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:18.510218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.510221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.510225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:18.510235Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:18.510237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:18.510250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:18.510257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:18.510246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2013
2025-10-02T08:14:18.510296Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:18.510305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.510308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.510311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:18.510318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.510325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:18.510335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534787325120212:3498]
2025-10-02T08:14:18.510341Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:18.510349Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:18.510366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.510414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.510425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.510445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.510482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2014 partition: 0 MaxSeqNo: 17 sessionId: src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0
2025-10-02T08:14:18.510803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ab0f6e-ece7757a-3712b115-cd348c41_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:18.513540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0] Write session: try to update token
2025-10-02T08:14:18.513558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:18.527142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId: src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:18.527663Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:18.527682Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:18.527684Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:18.527692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534787325120212:3498]
2025-10-02T08:14:18.527696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534787325120212:3498]
2025-10-02T08:14:18.527738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:18.527739Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:18.527745Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:18.527751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.527753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:18.527921Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:18.529639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:18.591580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534787325120280:3106]
2025-10-02T08:14:18.591829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2013, pipe: [1:7556534787325120280:3106]
2025-10-02T08:14:18.665797Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:18.666128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.666135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.666169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325120280:3106], now have 1 active actors on pipe
2025-10-02T08:14:18.666473Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:18.666744Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:18.667020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534787325120280:3106]
2025-10-02T08:14:18.667047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:18.667094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2014 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0
2025-10-02T08:14:18.667247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2014 sessionId: src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0 is DEAD
2025-10-02T08:14:18.667422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:18.667432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0] Write session will restart in 0.005962s
2025-10-02T08:14:18.667457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0] Write session: Do CDS request
2025-10-02T08:14:18.667463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:18.674236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.674091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:18.674312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:18.674317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2015
2025-10-02T08:14:18.674502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.674535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:18.674544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:18.674547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:18.674885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2015 sessionId:  describe result for acl check
2025-10-02T08:14:18.674916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:18.674921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:18.674923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:18.674927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534787325120434:3587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:18.675439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:18.675589Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:18.675599Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:18.675608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:18.675653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:18.675689Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534787325120437:3573]
2025-10-02T08:14:18.676230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:18.676273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534787325120434:3587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:18.676442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:18.676482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:18.676746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:18.676819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.676825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.676826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.676827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.676828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.676833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.676841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.676844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.676847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.676850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.676856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.676862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.676868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.676872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.676880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.676885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.676889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.676893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.676896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.676902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.676923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:18.679611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534787325120434:3587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:18.683983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534787325120434:3587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:18.683998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534787325120434:3587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:18.684000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534787325120434:3587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:18.684007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:18.684491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:18.686018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:18.686032Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:18.686033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:18.686036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:18.686040Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2014 [1:7556534787325120437:3573]
2025-10-02T08:14:18.686047Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:18.686059Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:18.686060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.686062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.686063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.686075Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:18.686078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:18.686081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:18.686119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.686126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.686128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:18.686130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:18.686185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:18.686192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.686204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.686214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:18.686238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325120509:3587], now have 1 active actors on pipe
2025-10-02T08:14:18.686239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2014
2025-10-02T08:14:18.686241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534787784716981:2378], now have 1 active actors on pipe
2025-10-02T08:14:18.686247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534787325120427:3573]
2025-10-02T08:14:18.686253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534787325120427:3573]
2025-10-02T08:14:18.686262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:18.686274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.686274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:18.686277Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:18.686281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.686297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:18.686308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:18.686312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:18.686279Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2014
2025-10-02T08:14:18.686340Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e65546b3-562ab219-625ef0de-b583a04f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:18.686347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.686349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.686350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:18.686356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.686366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:18.686374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534787325120427:3573]
2025-10-02T08:14:18.686382Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:18.686393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:18.686406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.686453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.686460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.686471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.686502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2015 partition: 0 MaxSeqNo: 17 sessionId: src_id|e65546b3-562ab219-625ef0de-b583a04f_0
2025-10-02T08:14:18.686772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2910e837-f06db085-f8ca297b-42fa0fe7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e65546b3-562ab219-625ef0de-b583a04f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:18.689221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65546b3-562ab219-625ef0de-b583a04f_0] Write session: try to update token
2025-10-02T08:14:18.689234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65546b3-562ab219-625ef0de-b583a04f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:18.703096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId: src_id|e65546b3-562ab219-625ef0de-b583a04f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:18.703118Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:18.703122Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:18.703125Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:18.703137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534787325120427:3573]
2025-10-02T08:14:18.703141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534787325120427:3573]
2025-10-02T08:14:18.703169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:18.703174Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:18.703191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:18.703198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.703200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:18.703337Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:18.705644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:18.765106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534787325120531:3106]
2025-10-02T08:14:18.765235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2014, pipe: [1:7556534787325120531:3106]
2025-10-02T08:14:18.847102Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:18.847329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.847339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.847370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325120531:3106], now have 1 active actors on pipe
2025-10-02T08:14:18.847490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534787325120531:3106]
2025-10-02T08:14:18.847520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:18.847522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:18.847534Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:18.847586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2015 reason: error at write: Disconnected sessionId: src_id|e65546b3-562ab219-625ef0de-b583a04f_0
2025-10-02T08:14:18.847614Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:18.847750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2015 sessionId: src_id|e65546b3-562ab219-625ef0de-b583a04f_0 is DEAD
2025-10-02T08:14:18.847875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65546b3-562ab219-625ef0de-b583a04f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:18.847881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65546b3-562ab219-625ef0de-b583a04f_0] Write session will restart in 0.006076s
2025-10-02T08:14:18.847900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65546b3-562ab219-625ef0de-b583a04f_0] Write session: Do CDS request
2025-10-02T08:14:18.847904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65546b3-562ab219-625ef0de-b583a04f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:18.853979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:18.854868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:18.855029Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:18.855036Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:18.855046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:18.855087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:18.855121Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534787325120673:3654]
2025-10-02T08:14:18.855238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65546b3-562ab219-625ef0de-b583a04f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.855562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:18.855578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2016
2025-10-02T08:14:18.855678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:18.855704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:18.855713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:18.855716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:18.855722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:18.855901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:18.855951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:18.856042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2016 sessionId:  describe result for acl check
2025-10-02T08:14:18.856070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:18.856075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:18.856076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:18.856080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534787325120684:3674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:18.856271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:18.856312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.856317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.856318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.856319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.856320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.856325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.856334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.856338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.856341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.856344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.856349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.856356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:18.856363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.856372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:18.856376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.856381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:18.856384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.856389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.856393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.856398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.856417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:18.856533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534787325120684:3674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:18.858654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534787325120684:3674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:18.863591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534787325120684:3674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:18.863610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534787325120684:3674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:18.863614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534787325120684:3674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:18.863623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:18.864040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:18.865563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:18.865577Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:18.865580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:18.865584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:18.865590Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2015 [1:7556534787325120673:3654]
2025-10-02T08:14:18.865602Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:18.865618Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:18.865624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.865627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.865629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.865642Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:18.865650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:18.865656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:18.865712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.865719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.865723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:18.865734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:18.865796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:18.865802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.865815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:18.865831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:18.865841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2015
2025-10-02T08:14:18.865851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325120721:3674], now have 1 active actors on pipe
2025-10-02T08:14:18.865856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534787325120667:3654]
2025-10-02T08:14:18.865858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534787325120667:3654]
2025-10-02T08:14:18.865865Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:18.865875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:18.865877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:18.865885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:18.865889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:18.865892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:18.865898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.865902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.865915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534787784716999:2378], now have 1 active actors on pipe
2025-10-02T08:14:18.865947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534787325120667:3654]
2025-10-02T08:14:18.865956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:18.865959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:18.865944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2015
2025-10-02T08:14:18.865969Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:18.865979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:18.865982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:18.865984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:18.865991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:18.865999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:18.866038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.866081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:18.866087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:18.866099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:18.866143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2016 partition: 0 MaxSeqNo: 17 sessionId: src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0
2025-10-02T08:14:18.866437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65546b3-562ab219-625ef0de-b583a04f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:18.868860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0] Write session: try to update token
2025-10-02T08:14:18.868875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:18.880871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId: src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:18.882872Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:18.882887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:18.882890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:18.882898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534787325120667:3654]
2025-10-02T08:14:18.882901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534787325120667:3654]
2025-10-02T08:14:18.882940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:18.882946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:18.882954Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:18.882957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:18.882960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:18.883089Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:18.884246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:18.947423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534787325120736:3106]
2025-10-02T08:14:18.947583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2015, pipe: [1:7556534787325120736:3106]
2025-10-02T08:14:19.018512Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:19.018969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.018988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.019024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534787325120736:3106], now have 1 active actors on pipe
2025-10-02T08:14:19.019094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:19.019101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:19.019144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2016 reason: error at write: Disconnected sessionId: src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0
2025-10-02T08:14:19.019181Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:19.019197Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:19.019288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2016 sessionId: src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0 is DEAD
2025-10-02T08:14:19.019389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534787325120736:3106]
2025-10-02T08:14:19.019454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:19.019464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0] Write session will restart in 0.006013s
2025-10-02T08:14:19.019484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0] Write session: Do CDS request
2025-10-02T08:14:19.019488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:19.025805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:19.026191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.026243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:19.026259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2017
2025-10-02T08:14:19.026371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:19.026449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.026479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:19.026486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:19.026488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:19.026539Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:19.026550Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:19.026559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:19.026618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:19.026652Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534791620088174:3673]
2025-10-02T08:14:19.026851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2017 sessionId:  describe result for acl check
2025-10-02T08:14:19.026876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:19.026881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:19.026882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:19.026886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534791620088178:3675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:19.027235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:19.027304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534791620088178:3675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:19.027396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:19.027439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:19.027655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:19.027688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.027693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.027694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.027695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.027695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.027699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.027705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.027707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.027709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.027711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.027714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.027721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.027725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.027730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.027733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.027737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.027740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.027745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.027749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.027754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.027770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:19.029178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534791620088178:3675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:19.034862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534791620088178:3675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:19.034878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534791620088178:3675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:19.034882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534791620088178:3675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:19.034891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:19.039076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:19.040717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:19.040733Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:19.040735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:19.040738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:19.040742Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2016 [1:7556534791620088174:3673]
2025-10-02T08:14:19.040753Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:19.040767Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:19.040769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.040771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.040772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.040783Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:19.040786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:19.040792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:19.040876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.040884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.040887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:19.040889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:19.040958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:19.040965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.040978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.040994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:19.041014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620088224:3675], now have 1 active actors on pipe
2025-10-02T08:14:19.041024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534792079684302:2378], now have 1 active actors on pipe
2025-10-02T08:14:19.041030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534791620088167:3673]
2025-10-02T08:14:19.041029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2016
2025-10-02T08:14:19.041032Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534791620088167:3673]
2025-10-02T08:14:19.041041Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:19.041055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:19.041055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:19.041058Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:19.041067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:19.041070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:19.041075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.041065Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2016
2025-10-02T08:14:19.041082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.041123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534791620088167:3673]
2025-10-02T08:14:19.041130Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:19.041133Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:19.041143Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:19.041153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.041160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.041161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:19.041169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.041177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:19.041221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.041255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.041264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.041277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.041312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2017 partition: 0 MaxSeqNo: 17 sessionId: src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0
2025-10-02T08:14:19.041644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5813b-9e7efc5f-73645bca-a9474ac4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:19.044242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0] Write session: try to update token
2025-10-02T08:14:19.044260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:19.056698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId: src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:19.057364Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:19.057380Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.057389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534791620088167:3673]
2025-10-02T08:14:19.057430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:19.057444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:19.057609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:19.057761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.057911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.058056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.058253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:19.058293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:19.059113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:19.059190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.059205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.059231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:19.059258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:19.059309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.059319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.059469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.059543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.059603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.059661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.059934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.059945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.060014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.060069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.060130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.060194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.060244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.060251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.060316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.060372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.060431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.060493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.060537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.060540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.060607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.060667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.060726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.060782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.060844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.060852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.060920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.060975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.061036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.061099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.061145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.061151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.061227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.061285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.061348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.061410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.061454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.061461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.061529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.061588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.061651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.061712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.061760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.061766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.061832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.061896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.061958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.062021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.062068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.062075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.062138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.062199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.062261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.062323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.062367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.062374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.062438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.062496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.062557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.062621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.062676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.062682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.062717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:19.062778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.062799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.062801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:19.062831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:19.062847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:19.062853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:19.062856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:19.062858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:19.063228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:19.063254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:19.063264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:19.063267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:19.063270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:19.063273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:19.063818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:19.063841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:19.063848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:19.063851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:19.063854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:19.063856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:19.064300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:19.064322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:19.064327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:19.064330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:19.064333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:19.066241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:19.066260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:19.066271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392859066
2025-10-02T08:14:19.066394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:19.066404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:19.066407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:19.066409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:19.066413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:19.066415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:19.066831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:19.066849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:19.066858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:19.066864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:19.066866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:19.066868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:19.067286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:19.067303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:19.067310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:19.067315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:19.067317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:19.067319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:19.067727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:19.067746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:19.067751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:19.068781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:19.068796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:19.068813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:19.068817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:19.068824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392859068
2025-10-02T08:14:19.069089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:19.069120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:19.069128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:19.069130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:19.069134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:19.069136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:19.069558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:19.069577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:19.069582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:19.069586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:19.069589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:19.069592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:19.069999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:19.070021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.070090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392859069
2025-10-02T08:14:19.070769Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:19.070805Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:19.070814Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:19.070820Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:19.072377Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:19.072389Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.072390Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:19.072401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534791620088167:3673]
2025-10-02T08:14:19.072408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534791620088167:3673]
2025-10-02T08:14:19.072448Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:19.072455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:19.072460Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:19.072460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.072461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:19.072580Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:19.119425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534791620088245:3106]
2025-10-02T08:14:19.119536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2016, pipe: [1:7556534791620088245:3106]
2025-10-02T08:14:19.199003Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:19.199322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620088245:3106], now have 1 active actors on pipe
2025-10-02T08:14:19.199437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:19.199443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:19.199466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2017 reason: error at write: Disconnected sessionId: src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0
2025-10-02T08:14:19.199502Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:19.199566Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:19.199627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2017 sessionId: src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0 is DEAD
2025-10-02T08:14:19.199739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:19.199761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0] Write session will restart in 0.006766s
2025-10-02T08:14:19.199785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0] Write session: Do CDS request
2025-10-02T08:14:19.199791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:19.199778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534791620088245:3106]
2025-10-02T08:14:19.205981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:19.206659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:19.206839Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:19.206847Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:19.206856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:19.206899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:19.206937Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534791620088390:3702]
2025-10-02T08:14:19.207216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.207304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:19.207317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2018
2025-10-02T08:14:19.207413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.207434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:19.207441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:19.207444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:19.207476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:19.207616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:19.207664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:19.207738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2018 sessionId:  describe result for acl check
2025-10-02T08:14:19.207772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:19.207777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:19.207779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:19.207784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534791620088401:3715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:19.207929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:19.207968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.207975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.207976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.207977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.207978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.207982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.207991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.207995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.207998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.208002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.208006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.208013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.208019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.208023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.208036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.208044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.208049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.208054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.208058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.208066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.208083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:19.208211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534791620088401:3715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:19.210482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534791620088401:3715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:19.215278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534791620088401:3715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:19.215296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534791620088401:3715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:19.215300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534791620088401:3715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:19.215309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:19.215741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:19.217176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:19.217190Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:19.217192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:19.217195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:19.217199Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2017 [1:7556534791620088390:3702]
2025-10-02T08:14:19.217206Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:19.217219Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:19.217223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.217225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.217226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.217238Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:19.217244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:19.217250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:19.217296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.217304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.217306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:19.217308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:19.217352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:19.217358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.217365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.217372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:19.217386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534791620088384:3702]
2025-10-02T08:14:19.217392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534791620088384:3702]
2025-10-02T08:14:19.217399Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:19.217406Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:19.217408Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:19.217414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620088437:3715], now have 1 active actors on pipe
2025-10-02T08:14:19.217416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2017
2025-10-02T08:14:19.217424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534792079684311:2378], now have 1 active actors on pipe
2025-10-02T08:14:19.217428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:19.217436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:19.217441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:19.217469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.217477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.217490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534791620088384:3702]
2025-10-02T08:14:19.217493Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:19.217495Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:19.217479Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2017
2025-10-02T08:14:19.217512Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:19.217523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.217526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.217527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:19.217538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.217544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:19.217564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.217607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.217612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.217619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.217645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2018 partition: 0 MaxSeqNo: 17 sessionId: src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0
2025-10-02T08:14:19.217939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d6c334e-9111d1f8-e7f027ea-42f55fa6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:19.220270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0] Write session: try to update token
2025-10-02T08:14:19.220283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:19.233186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId: src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:19.234297Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:19.234315Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.234318Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:19.234326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534791620088384:3702]
2025-10-02T08:14:19.234330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534791620088384:3702]
2025-10-02T08:14:19.234376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:19.234388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:19.234392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.234394Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:19.234395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:19.234543Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:19.235420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:19.300171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534791620088451:3106]
2025-10-02T08:14:19.300290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2017, pipe: [1:7556534791620088451:3106]
2025-10-02T08:14:19.369553Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:19.369868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.369881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.369921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620088451:3106], now have 1 active actors on pipe
2025-10-02T08:14:19.370042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534791620088451:3106]
2025-10-02T08:14:19.370071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:19.370079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:19.370139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2018 reason: error at write: Disconnected sessionId: src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0
2025-10-02T08:14:19.370145Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:19.370307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2018 sessionId: src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0 is DEAD
2025-10-02T08:14:19.370430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:19.370441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0] Write session will restart in 0.005870s
2025-10-02T08:14:19.370463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0] Write session: Do CDS request
2025-10-02T08:14:19.370472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:19.370795Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:19.377196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.377254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:19.377281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:19.377287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2019
2025-10-02T08:14:19.377384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.377419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:19.377429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:19.377432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:19.377812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2019 sessionId:  describe result for acl check
2025-10-02T08:14:19.377843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:19.377849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:19.377851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:19.377856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534791620088599:3782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:19.378042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:19.378207Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:19.378215Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:19.378225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:19.378281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:19.378313Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534791620088601:3751]
2025-10-02T08:14:19.378343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534791620088599:3782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:19.378825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:19.378991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:19.379029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:19.379297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:19.379336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.379342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.379343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.379344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.379345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.379349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.379358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.379361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.379364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.379367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.379372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.379379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.379384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.379389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.379393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.379398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.379401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.379408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.379412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.379416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.379432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:19.380385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534791620088599:3782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:19.385945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534791620088599:3782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:19.385960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534791620088599:3782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:19.385966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534791620088599:3782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:19.385972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:19.389929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:19.391512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:19.391533Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:19.391536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:19.391540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:19.391546Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2018 [1:7556534791620088601:3751]
2025-10-02T08:14:19.391558Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:19.391573Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:19.391577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.391580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.391583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.391599Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:19.391608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:19.391614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:19.391721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.391728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.391731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:19.391736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:19.391801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:19.391808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.391821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.391837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:19.391859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620088646:3782], now have 1 active actors on pipe
2025-10-02T08:14:19.391861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2018
2025-10-02T08:14:19.391869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534791620088592:3751]
2025-10-02T08:14:19.391871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534791620088592:3751]
2025-10-02T08:14:19.391880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:19.391895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534792079684317:2378], now have 1 active actors on pipe
2025-10-02T08:14:19.391894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:19.391897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:19.391899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.391902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.391920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:19.391936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:19.391942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:19.391935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2018
2025-10-02T08:14:19.391983Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:19.391993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.392000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.392005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:19.392013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.392024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:19.392030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534791620088592:3751]
2025-10-02T08:14:19.392038Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:19.392046Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:19.392064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.392101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.392105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.392115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.392146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2019 partition: 0 MaxSeqNo: 17 sessionId: src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0
2025-10-02T08:14:19.392455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4a5726-99527ab1-9a1a29ca-a0373577_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:19.394794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0] Write session: try to update token
2025-10-02T08:14:19.394808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:19.403182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:19.403200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.403207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534791620088592:3751]
2025-10-02T08:14:19.403245Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:19.403248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:19.403417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:19.403543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.403670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.403796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.403985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:19.404027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:19.406787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId: src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:19.409031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:19.409080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.409091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.409118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:19.409141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:19.409248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.409265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.409406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.409460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.409515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.409568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.409617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.409624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.409682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.409735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.409787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.409843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.409882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.409887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.409943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.409996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.410046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.410098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.410135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.410141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.410197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.410250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.410304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.410358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.410400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.410405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.410460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.410511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.410564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.410616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.410655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.410660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.410716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.410767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.410820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.410874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.410978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.410984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.411039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.411091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.411145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.411200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.411241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.411246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.411301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.411352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.411408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.411474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.411513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.411518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.411573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.411623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.411680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.411732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.411770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.411775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.411830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.411881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.411935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.411988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.412028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.412033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.412061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:19.412109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.412124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.412128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:19.412149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:19.412161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:19.412167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:19.412169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:19.412171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:19.412507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:19.412528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:19.412532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:19.412534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:19.412535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:19.412538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:19.413068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:19.413089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:19.413093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:19.413095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:19.413099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:19.413101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:19.413546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:19.413563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:19.413566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:19.413568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:19.413570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:19.414599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:19.414614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:19.414622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392859414
2025-10-02T08:14:19.414745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:19.414753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:19.414756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:19.414763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:19.414766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:19.414768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:19.415143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:19.415158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:19.415165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:19.415167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:19.415169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:19.415172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:19.415565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:19.415580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:19.415589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:19.415591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:19.415593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:19.415595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:19.415974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:19.415990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:19.415996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:19.416946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:19.416960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:19.416963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:19.416966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:19.416971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392859416
2025-10-02T08:14:19.417208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:19.417223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:19.417231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:19.417233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:19.417235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:19.417237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:19.417640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:19.417655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:19.417660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:19.417666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:19.417668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:19.417672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:19.418065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:19.418079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.418149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392859417
2025-10-02T08:14:19.418768Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:19.418786Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:19.418789Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:19.418793Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:19.420187Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:19.420194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.420195Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:19.420212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534791620088592:3751]
2025-10-02T08:14:19.420215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534791620088592:3751]
2025-10-02T08:14:19.420255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:19.420258Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:19.420262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.420263Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:19.420268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:19.420374Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:19.470127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534791620088671:3106]
2025-10-02T08:14:19.470229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2018, pipe: [1:7556534791620088671:3106]
2025-10-02T08:14:19.557039Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:19.557315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620088671:3106], now have 1 active actors on pipe
2025-10-02T08:14:19.557392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:19.557405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:19.557438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2019 reason: error at write: Disconnected sessionId: src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0
2025-10-02T08:14:19.557450Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:19.557512Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:19.557612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2019 sessionId: src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0 is DEAD
2025-10-02T08:14:19.557703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:19.557709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0] Write session will restart in 0.006758s
2025-10-02T08:14:19.557731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0] Write session: Do CDS request
2025-10-02T08:14:19.557737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:19.557821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534791620088671:3106]
2025-10-02T08:14:19.564599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:19.565147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.565250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:19.565262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2020
2025-10-02T08:14:19.565265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:19.565352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.565379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:19.565387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:19.565390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:19.565425Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:19.565437Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:19.565446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:19.565494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:19.565525Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534791620088824:3765]
2025-10-02T08:14:19.565664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2020 sessionId:  describe result for acl check
2025-10-02T08:14:19.565689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:19.565690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:19.565692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:19.565697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534791620088828:3801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:19.566060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:19.566072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534791620088828:3801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:19.566238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:19.566270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:19.566517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:19.566550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.566559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.566560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.566560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.566561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.566565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.566573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.566576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.566580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.566582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.566588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.566594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.566598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.566602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.566605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.566609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.566612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.566616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.566619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.566623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.566637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:19.567643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534791620088828:3801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:19.572993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534791620088828:3801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:19.573012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534791620088828:3801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:19.573015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534791620088828:3801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:19.573022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:19.573998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:19.575500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:19.575516Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:19.575519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:19.575522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:19.575528Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2019 [1:7556534791620088824:3765]
2025-10-02T08:14:19.575537Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:19.575552Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:19.575555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.575557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.575560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.575574Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:19.575579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:19.575584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:19.575633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.575645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.575647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:19.575649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:19.575706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:19.575715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.575725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.575735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:19.575735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2019
2025-10-02T08:14:19.575752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620088871:3801], now have 1 active actors on pipe
2025-10-02T08:14:19.575755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534792079684323:2378], now have 1 active actors on pipe
2025-10-02T08:14:19.575759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.575762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.575781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534791620088817:3765]
2025-10-02T08:14:19.575787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534791620088817:3765]
2025-10-02T08:14:19.575800Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:19.575813Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:19.575814Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:19.575816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:19.575828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:19.575830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:19.575842Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b850f84-15f462b7-fb32a603-e137c67f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:19.575848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.575855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.575857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:19.575866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.575865Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2019
2025-10-02T08:14:19.575874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:19.575900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534791620088817:3765]
2025-10-02T08:14:19.575908Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:19.575910Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:19.575918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.576031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.576037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.576050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.576081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2020 partition: 0 MaxSeqNo: 17 sessionId: src_id|9b850f84-15f462b7-fb32a603-e137c67f_0
2025-10-02T08:14:19.576372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5952e1ef-5e20a8d5-59635af2-a31f8b22_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9b850f84-15f462b7-fb32a603-e137c67f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:19.578636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b850f84-15f462b7-fb32a603-e137c67f_0] Write session: try to update token
2025-10-02T08:14:19.578648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b850f84-15f462b7-fb32a603-e137c67f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:19.586118Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:19.586138Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.586145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534791620088817:3765]
2025-10-02T08:14:19.586184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:19.586187Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:19.586677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:19.586817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.586961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.587090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:19.587276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:19.587315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:19.592134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId: src_id|9b850f84-15f462b7-fb32a603-e137c67f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:19.594583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:19.594645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.594658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.594693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:19.594715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:19.594767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.594784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.594954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.595012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.595075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.595135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.595181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.595189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.595253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.595309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.595431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.595490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.595532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.595538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.595603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.595660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.595717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.595773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.595813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.595819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.595893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.595949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.596006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.596067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.596108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.596117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.596259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.596365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.596424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.596486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.596550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.596557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.596620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.596674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.596732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.596791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.596851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.596857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.596917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.596974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.597032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.597085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.597128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.597135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.597195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.597247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.597301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.597356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.597412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.597418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.597473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.597521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.597573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.597625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.597664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.597669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.597724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:19.597775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:19.597828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:19.597886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:19.597927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:19.597932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:19.597964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:19.598016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.598031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.598035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:19.598058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:19.598070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:19.598075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:19.598078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:19.598079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:19.598405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:19.598425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:19.598430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:19.598432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:19.598434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:19.598436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:19.598952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:19.598975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:19.598985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:19.598988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:19.598991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:19.598998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:19.599495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:19.599513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:19.599518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:19.599523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:19.599525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:19.601379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:19.601395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:19.601407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392859601
2025-10-02T08:14:19.601502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:19.601515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:19.601520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:19.601527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:19.601529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:19.601532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:19.602017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:19.602038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:19.602042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:19.602044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:19.602046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:19.602052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:19.602465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:19.602481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:19.602485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:19.602490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:19.602493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:19.602495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:19.602891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:19.602908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:19.602911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:19.603822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:19.603837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:19.603840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:19.603843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:19.603849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392859603
2025-10-02T08:14:19.604102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:19.604117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:19.604121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:19.604123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:19.604125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:19.604127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:19.604539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:19.604557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:19.604563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:19.604570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:19.604573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:19.604577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:19.605007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:19.605027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.605118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392859604
2025-10-02T08:14:19.608269Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:19.608289Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:19.608295Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:19.608300Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:19.609916Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:19.609930Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.609934Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:19.609941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534791620088817:3765]
2025-10-02T08:14:19.609945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534791620088817:3765]
2025-10-02T08:14:19.609995Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:19.609997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:19.610002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.610004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:19.610011Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:19.610144Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:19.658055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534791620088891:3106]
2025-10-02T08:14:19.658185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2019, pipe: [1:7556534791620088891:3106]
2025-10-02T08:14:19.746840Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:19.747122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620088891:3106], now have 1 active actors on pipe
2025-10-02T08:14:19.747262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534791620088891:3106]
2025-10-02T08:14:19.747287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:19.747294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:19.747320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2020 reason: error at write: Disconnected sessionId: src_id|9b850f84-15f462b7-fb32a603-e137c67f_0
2025-10-02T08:14:19.747384Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:19.747371Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:19.747470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2020 sessionId: src_id|9b850f84-15f462b7-fb32a603-e137c67f_0 is DEAD
2025-10-02T08:14:19.747582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b850f84-15f462b7-fb32a603-e137c67f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:19.747592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b850f84-15f462b7-fb32a603-e137c67f_0] Write session will restart in 0.009513s
2025-10-02T08:14:19.747614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b850f84-15f462b7-fb32a603-e137c67f_0] Write session: Do CDS request
2025-10-02T08:14:19.747620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b850f84-15f462b7-fb32a603-e137c67f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:19.754140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:19.755062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:19.755204Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:19.755213Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:19.755222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:19.755260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:19.755296Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534791620089094:3879]
2025-10-02T08:14:19.755693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:19.755849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:19.755962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:19.756304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:19.756338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.756343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.756343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.756344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.756344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.756348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.756354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.756356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.756358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.756360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.756364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.756368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.756375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.756378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.756381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.756383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.756386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.756389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.756391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.756393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.756407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:19.758249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b850f84-15f462b7-fb32a603-e137c67f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.758315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:19.758328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2021
2025-10-02T08:14:19.758464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.758489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:19.758500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:19.758504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:19.758881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2021 sessionId:  describe result for acl check
2025-10-02T08:14:19.758918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:19.758924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:19.758925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:19.758930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534791620089110:3899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:19.759382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534791620089110:3899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:19.761310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534791620089110:3899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:19.763826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534791620089110:3899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:19.763831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:19.763838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534791620089110:3899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:19.763841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534791620089110:3899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:19.763847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:19.765376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:19.765394Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:19.765396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:19.765399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:19.765404Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2020 [1:7556534791620089094:3879]
2025-10-02T08:14:19.765416Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:19.765429Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:19.765436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.765438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.765439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.765453Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:19.765456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:19.765463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:19.765513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.765523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.765526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:19.765528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:19.765592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:19.765598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.765608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.765620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2020
2025-10-02T08:14:19.765622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:19.765637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620089138:3899], now have 1 active actors on pipe
2025-10-02T08:14:19.765644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534792079684365:2378], now have 1 active actors on pipe
2025-10-02T08:14:19.765648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.765655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.765670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534791620089088:3879]
2025-10-02T08:14:19.765675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534791620089088:3879]
2025-10-02T08:14:19.765686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:19.765700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:19.765702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:19.765705Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:19.765717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:19.765719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:19.765731Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:19.765691Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2020
2025-10-02T08:14:19.765740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.765743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.765745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:19.765753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.765760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:19.765788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534791620089088:3879]
2025-10-02T08:14:19.765800Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:19.765812Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:19.765818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.765917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.765925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.765939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.765972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2021 partition: 0 MaxSeqNo: 17 sessionId: src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0
2025-10-02T08:14:19.766247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b850f84-15f462b7-fb32a603-e137c67f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:19.768875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0] Write session: try to update token
2025-10-02T08:14:19.768890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:19.783602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId: src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:19.783644Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:19.783648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.783650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:19.783658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534791620089088:3879]
2025-10-02T08:14:19.783663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534791620089088:3879]
2025-10-02T08:14:19.783711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:19.783714Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:19.783720Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:19.783726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.783729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:19.783870Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:19.785936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:19.847492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534791620089156:3106]
2025-10-02T08:14:19.847586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2020, pipe: [1:7556534791620089156:3106]
2025-10-02T08:14:19.922608Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:19.922850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.922859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.922893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620089156:3106], now have 1 active actors on pipe
2025-10-02T08:14:19.923009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534791620089156:3106]
2025-10-02T08:14:19.923036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:19.923038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:19.923102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2021 reason: error at write: Disconnected sessionId: src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0
2025-10-02T08:14:19.923164Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:19.923259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2021 sessionId: src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0 is DEAD
2025-10-02T08:14:19.923420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:19.923431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0] Write session will restart in 0.009549s
2025-10-02T08:14:19.923452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0] Write session: Do CDS request
2025-10-02T08:14:19.923458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:19.923497Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:19.930038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:19.931102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:19.931270Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:19.931280Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:19.931289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:19.931330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:19.931365Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534791620089307:3911]
2025-10-02T08:14:19.931971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:19.932221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:19.932279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:19.932596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:19.932644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.932650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.932651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.932652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.932653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.932658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.932669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.932673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.932677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.932681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.932686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.932698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:19.932703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.932708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:19.932711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.932717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:19.932721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.932726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.932730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.932735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.932754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:19.934270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.934315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:19.934328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2022
2025-10-02T08:14:19.934459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:19.934499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:19.934507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:19.934511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:19.934908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2022 sessionId:  describe result for acl check
2025-10-02T08:14:19.934937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:19.934939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:19.934940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:19.934945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534791620089323:3920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:19.935443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534791620089323:3920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:19.937707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534791620089323:3920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:19.940366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:19.940405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534791620089323:3920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:19.940412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534791620089323:3920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:19.940415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534791620089323:3920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:19.940423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:19.941970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:19.941985Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:19.941988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:19.941991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:19.941997Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2021 [1:7556534791620089307:3911]
2025-10-02T08:14:19.942009Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:19.942030Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:19.942039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.942046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.942048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.942064Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:19.942073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:19.942083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:19.942141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.942149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.942152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:19.942154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:19.942211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:19.942218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.942231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:19.942246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:19.942252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2021
2025-10-02T08:14:19.942266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534791620089354:3920], now have 1 active actors on pipe
2025-10-02T08:14:19.942275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534792079684371:2378], now have 1 active actors on pipe
2025-10-02T08:14:19.942280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.942283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.942297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534791620089301:3911]
2025-10-02T08:14:19.942299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534791620089301:3911]
2025-10-02T08:14:19.942309Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:19.942323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:19.942326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:19.942329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:19.942340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:19.942342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:19.942356Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69e37432-f58ca040-5ee3820-8b703258_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:19.942366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:19.942324Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2021
2025-10-02T08:14:19.942371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:19.942378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:19.942386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:19.942397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:19.942431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534791620089301:3911]
2025-10-02T08:14:19.942442Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:19.942452Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:19.942460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.942507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:19.942513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:19.942525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:19.942560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2022 partition: 0 MaxSeqNo: 17 sessionId: src_id|69e37432-f58ca040-5ee3820-8b703258_0
2025-10-02T08:14:19.942885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37e31f4-5f15a46c-2bf7413a-304ee0a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|69e37432-f58ca040-5ee3820-8b703258_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:19.945614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Write session: try to update token
2025-10-02T08:14:19.945632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:19.959207Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:19.959233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:19.959235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:19.959244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534791620089301:3911]
2025-10-02T08:14:19.959248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534791620089301:3911]
2025-10-02T08:14:19.959275Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:19.959279Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:19.959287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:19.959294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:19.959296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:19.959450Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:19.959691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId: src_id|69e37432-f58ca040-5ee3820-8b703258_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:19.961917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:20.023129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534795915056665:3106]
2025-10-02T08:14:20.023228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2021, pipe: [1:7556534795915056665:3106]
2025-10-02T08:14:20.105078Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:20.105335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.105347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.105383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915056665:3106], now have 1 active actors on pipe
2025-10-02T08:14:20.105441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:20.105448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:20.105496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2022 reason: error at write: Disconnected sessionId: src_id|69e37432-f58ca040-5ee3820-8b703258_0
2025-10-02T08:14:20.105555Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:20.105592Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:20.105641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2022 sessionId: src_id|69e37432-f58ca040-5ee3820-8b703258_0 is DEAD
2025-10-02T08:14:20.105776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 162 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:14:20.105781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534795915056665:3106]
2025-10-02T08:14:20.105799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:20.105813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Write session will restart in 0.008966s
2025-10-02T08:14:20.105842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Write session: Do CDS request
2025-10-02T08:14:20.105848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:20.113524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:20.114299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:20.114440Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:20.114449Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:20.114456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:20.114496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:20.114535Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534795915056819:3954]
2025-10-02T08:14:20.115114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:20.115283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:20.115324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:20.115618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:20.115659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.115664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.115666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.115666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.115668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.115672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.115682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.115686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.115690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.115694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.115699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.115707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.115711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.115716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.115721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.115726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.115730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.115735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.115739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.115749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.115767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:20.116327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.116354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:20.116365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2023
2025-10-02T08:14:20.116515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.116543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:20.116551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:20.116555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:20.116963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2023 sessionId:  describe result for acl check
2025-10-02T08:14:20.116993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:20.116998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:20.117000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:20.117004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534795915056835:3927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:20.117561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534795915056835:3927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:20.119694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534795915056835:3927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:20.123193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534795915056835:3927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:20.123213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534795915056835:3927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:20.123218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534795915056835:3927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:20.123227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:20.123692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:20.125361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:20.125379Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:20.125380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:20.125383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:20.125388Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2022 [1:7556534795915056819:3954]
2025-10-02T08:14:20.125397Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:20.125411Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:20.125414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.125417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.125419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.125435Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:20.125449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:20.125455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:20.125499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.125505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.125508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:20.125509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:20.125558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:20.125563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.125572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.125579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:20.125589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534795915056813:3954]
2025-10-02T08:14:20.125594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534795915056813:3954]
2025-10-02T08:14:20.125599Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:20.125609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:20.125610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:20.125614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:20.125620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:20.125622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:20.125636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2022
2025-10-02T08:14:20.125650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915056867:3927], now have 1 active actors on pipe
2025-10-02T08:14:20.125656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534796374651674:2378], now have 1 active actors on pipe
2025-10-02T08:14:20.125657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534795915056813:3954]
2025-10-02T08:14:20.125663Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:20.125668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.125670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.125675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:20.125699Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:20.125707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.125710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.125711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:20.125716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.125724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:20.125701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2022
2025-10-02T08:14:20.125749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.125783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.125793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.125811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.125843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2023 partition: 0 MaxSeqNo: 17 sessionId: src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0
2025-10-02T08:14:20.126131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e37432-f58ca040-5ee3820-8b703258_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:20.128862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0] Write session: try to update token
2025-10-02T08:14:20.128877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:20.143009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId: src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:20.143952Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:20.143972Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:20.143975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:20.143982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534795915056813:3954]
2025-10-02T08:14:20.143986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534795915056813:3954]
2025-10-02T08:14:20.144029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:20.144043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.144049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:20.144159Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:20.144173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:20.144187Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:20.145467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:20.205926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534795915056882:3106]
2025-10-02T08:14:20.206056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2022, pipe: [1:7556534795915056882:3106]
2025-10-02T08:14:20.289382Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:20.289755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.289770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.289809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915056882:3106], now have 1 active actors on pipe
2025-10-02T08:14:20.289955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534795915056882:3106]
2025-10-02T08:14:20.289987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:20.289990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:20.290056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2023 reason: error at write: Disconnected sessionId: src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0
2025-10-02T08:14:20.290053Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:20.290226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2023 sessionId: src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0 is DEAD
2025-10-02T08:14:20.290370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:20.290375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0] Write session will restart in 0.006807s
2025-10-02T08:14:20.290391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0] Write session: Do CDS request
2025-10-02T08:14:20.290398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:20.291221Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:20.297092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:20.297744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:20.297896Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:20.297905Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:20.297914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:20.297958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:20.297987Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534795915057036:3955]
2025-10-02T08:14:20.298220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.298268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:20.298282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2024
2025-10-02T08:14:20.298394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.298421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:20.298431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:20.298434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:20.298592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:20.298737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:20.298763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2024 sessionId:  describe result for acl check
2025-10-02T08:14:20.298774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:20.298792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:20.298798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:20.298799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:20.298804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534795915057046:3970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:20.299048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:20.299085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.299091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.299092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.299093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.299094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.299098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.299106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.299114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.299117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.299124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.299129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.299139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.299153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.299161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.299169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.299173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.299180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.299185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.299192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.299196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.299212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:20.299258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534795915057046:3970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:20.300771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534795915057046:3970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:20.306254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534795915057046:3970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:20.306272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534795915057046:3970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:20.306275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534795915057046:3970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:20.306283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:20.306758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:20.308226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:20.308239Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:20.308241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:20.308244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:20.308249Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2023 [1:7556534795915057036:3955]
2025-10-02T08:14:20.308258Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:20.308273Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:20.308275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.308279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.308281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.308293Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:20.308299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:20.308305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:20.308353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.308360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.308362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:20.308365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:20.308420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:20.308426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.308436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.308451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:20.308466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2023
2025-10-02T08:14:20.308471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915057084:3970], now have 1 active actors on pipe
2025-10-02T08:14:20.308475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534796374651683:2378], now have 1 active actors on pipe
2025-10-02T08:14:20.308480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534795915057030:3955]
2025-10-02T08:14:20.308482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534795915057030:3955]
2025-10-02T08:14:20.308493Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:20.308506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.308514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.308517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:20.308527Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:20.308529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:20.308541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:20.308547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:20.308516Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2023
2025-10-02T08:14:20.308580Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba1fb214-7f92baa5-30f59492-805ba582_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:20.308590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.308597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.308599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:20.308607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.308617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:20.308627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534795915057030:3955]
2025-10-02T08:14:20.308637Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:20.308648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:20.308670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.308712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.308718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.308729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.308759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2024 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba1fb214-7f92baa5-30f59492-805ba582_0
2025-10-02T08:14:20.309042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6519f7d8-9f340b70-5dfbc8d6-2fe1224_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba1fb214-7f92baa5-30f59492-805ba582_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:20.311412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fb214-7f92baa5-30f59492-805ba582_0] Write session: try to update token
2025-10-02T08:14:20.311429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fb214-7f92baa5-30f59492-805ba582_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:20.325034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId: src_id|ba1fb214-7f92baa5-30f59492-805ba582_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:20.325880Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:20.325901Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:20.325904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:20.325914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534795915057030:3955]
2025-10-02T08:14:20.325921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534795915057030:3955]
2025-10-02T08:14:20.325974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:20.325973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:20.325982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:20.325988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.325991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:20.326186Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:20.328013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:20.390689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534795915057099:3106]
2025-10-02T08:14:20.390886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2023, pipe: [1:7556534795915057099:3106]
2025-10-02T08:14:20.458466Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:20.458784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.458798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.458837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915057099:3106], now have 1 active actors on pipe
2025-10-02T08:14:20.458944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:20.458957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:20.459011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2024 reason: error at write: Disconnected sessionId: src_id|ba1fb214-7f92baa5-30f59492-805ba582_0
2025-10-02T08:14:20.459054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:20.459151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2024 sessionId: src_id|ba1fb214-7f92baa5-30f59492-805ba582_0 is DEAD
2025-10-02T08:14:20.459317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fb214-7f92baa5-30f59492-805ba582_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:20.459325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fb214-7f92baa5-30f59492-805ba582_0] Write session will restart in 0.007842s
2025-10-02T08:14:20.459346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fb214-7f92baa5-30f59492-805ba582_0] Write session: Do CDS request
2025-10-02T08:14:20.459336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534795915057099:3106]
2025-10-02T08:14:20.459353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fb214-7f92baa5-30f59492-805ba582_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:20.459895Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:20.466911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:20.467787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:20.467953Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:20.467962Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:20.467970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:20.468022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:20.468059Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534795915057257:3996]
2025-10-02T08:14:20.468280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fb214-7f92baa5-30f59492-805ba582_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.468358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:20.468370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2025
2025-10-02T08:14:20.468475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.468501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:20.468512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:20.468516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:20.468669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:20.468844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:20.468882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:20.468936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2025 sessionId:  describe result for acl check
2025-10-02T08:14:20.468967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:20.468973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:20.468975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:20.468980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534795915057268:3994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:20.469184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:20.469237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.469243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.469244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.469245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.469246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.469251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.469259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.469263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.469267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.469270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.469275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.469282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.469288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.469293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.469297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.469301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.469306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.469310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.469314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.469324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.469341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:20.469451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534795915057268:3994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:20.471537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534795915057268:3994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:20.476584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534795915057268:3994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:20.476607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534795915057268:3994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:20.476610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534795915057268:3994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:20.476619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:20.477220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:20.478663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:20.478679Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:20.478682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:20.478685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:20.478694Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2024 [1:7556534795915057257:3996]
2025-10-02T08:14:20.478705Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:20.478720Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:20.478723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.478726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.478728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.478742Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:20.478746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:20.478753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:20.478804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.478811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.478814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:20.478816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:20.478879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:20.478887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.478899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.478912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:20.478929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915057305:3994], now have 1 active actors on pipe
2025-10-02T08:14:20.478936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534796374651690:2378], now have 1 active actors on pipe
2025-10-02T08:14:20.478942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534795915057251:3996]
2025-10-02T08:14:20.478944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534795915057251:3996]
2025-10-02T08:14:20.478956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:20.478969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2024
2025-10-02T08:14:20.478973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:20.478987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:20.478990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:20.479012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:20.479019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534795915057251:3996]
2025-10-02T08:14:20.479021Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:20.479006Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2024
2025-10-02T08:14:20.479023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:20.479029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:20.479041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.479045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.479074Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:20.479086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.479089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.479091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:20.479099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.479107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:20.479124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.479172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.479184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.479206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.479254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2025 partition: 0 MaxSeqNo: 17 sessionId: src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0
2025-10-02T08:14:20.479603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fb214-7f92baa5-30f59492-805ba582_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:20.482348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0] Write session: try to update token
2025-10-02T08:14:20.482366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:20.496391Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:20.496408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:20.496415Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534795915057251:3996]
2025-10-02T08:14:20.496448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:20.496451Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:20.496471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId: src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:20.496624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:20.496778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:20.496937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:20.497083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:20.497403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:20.497444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:20.499160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:20.499236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.499253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.499286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:20.499405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:20.499458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.499473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.499630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.499693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.499759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.499822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.499867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.499876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.499942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.500006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.500069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.500134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.500178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.500185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.500263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.500323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.500386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.500447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.500499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.500501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.500567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.500632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.500699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.500769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.500841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.500849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.500918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.500979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.501050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.501117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.501162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.501170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.501241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.501307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.501373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.501435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.501475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.501478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.501544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.501606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.501667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.501726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.501767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.501770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.501836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.501895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.501956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.502016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.502060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.502062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.502126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.502179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.502235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.502290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.502337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.502340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.502402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.502460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.502519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.502579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.502617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.502620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.502657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:20.502719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.502737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.502739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:20.502768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:20.502780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:20.502783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:20.502785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:20.502788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:20.503171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:20.503188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:20.503194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:20.503197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:20.503202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:20.503206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:20.503672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:20.503684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:20.503694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:20.503696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:20.503700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:20.503703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:20.504318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:20.504332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:20.504337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:20.504341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:20.504344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:20.505787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:20.505810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:20.505822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392860505
2025-10-02T08:14:20.505974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:20.505992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:20.505996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:20.505999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:20.506005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:20.506012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:20.506495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:20.506518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:20.506524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:20.506527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:20.506529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:20.506532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:20.507011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:20.507036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:20.507045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:20.507055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:20.507058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:20.507061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:20.507509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:20.507532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:20.507537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:20.508647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:20.508667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:20.508671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:20.508676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:20.508686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392860508
2025-10-02T08:14:20.509005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:20.509028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:20.509033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:20.509036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:20.509039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:20.509043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:20.509521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:20.509545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:20.509550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:20.509555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:20.509558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:20.509561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:20.510102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:20.510125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.510228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392860509
2025-10-02T08:14:20.510990Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:20.511011Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:20.511018Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:20.511025Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:20.512641Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:20.512657Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:20.512659Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:20.512666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534795915057251:3996]
2025-10-02T08:14:20.512669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534795915057251:3996]
2025-10-02T08:14:20.512725Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:20.512730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:20.512734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.512736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:20.512742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:20.512887Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:20.559697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534795915057327:3106]
2025-10-02T08:14:20.559808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2024, pipe: [1:7556534795915057327:3106]
2025-10-02T08:14:20.646182Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:20.646587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915057327:3106], now have 1 active actors on pipe
2025-10-02T08:14:20.646724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534795915057327:3106]
2025-10-02T08:14:20.646740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:20.646745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:20.646763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2025 reason: error at write: Disconnected sessionId: src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0
2025-10-02T08:14:20.646803Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:20.646803Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:20.646917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2025 sessionId: src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0 is DEAD
2025-10-02T08:14:20.647078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:20.647087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0] Write session will restart in 0.007717s
2025-10-02T08:14:20.647111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0] Write session: Do CDS request
2025-10-02T08:14:20.647117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:20.653750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:20.654725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:20.654894Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:20.654902Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:20.654909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:20.654943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:20.654971Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534795915057485:5851]
2025-10-02T08:14:20.655495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:20.655678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:20.655735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:20.656020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:20.656089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.656096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.656097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.656098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.656099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.656104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.656113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.656117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.656124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.656128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.656139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.656150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.656160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.656169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.656178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.656183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.656191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.656198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.656222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.656226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.656241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:20.656275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.656313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:20.656321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2026
2025-10-02T08:14:20.656495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.656520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:20.656526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:20.656529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:20.656901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2026 sessionId:  describe result for acl check
2025-10-02T08:14:20.656937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:20.656942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:20.656944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:20.656949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534795915057501:4015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:20.657482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534795915057501:4015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:20.659336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534795915057501:4015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:20.663488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534795915057501:4015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:20.663505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534795915057501:4015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:20.663509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534795915057501:4015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:20.663517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:20.663936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:20.665431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:20.665446Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:20.665447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:20.665450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:20.665455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2025 [1:7556534795915057485:5851]
2025-10-02T08:14:20.665463Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:20.665475Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:20.665477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.665479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.665480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.665492Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:20.665497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:20.665502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:20.665552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.665557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.665559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:20.665561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:20.665606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:20.665612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.665621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.665627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:20.665638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534795915057479:5851]
2025-10-02T08:14:20.665642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534795915057479:5851]
2025-10-02T08:14:20.665648Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:20.665657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915057536:4015], now have 1 active actors on pipe
2025-10-02T08:14:20.665660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2025
2025-10-02T08:14:20.665661Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:20.665664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:20.665667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:20.665674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:20.665676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:20.665680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534796374651709:2378], now have 1 active actors on pipe
2025-10-02T08:14:20.665703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.665710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.665720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534795915057479:5851]
2025-10-02T08:14:20.665728Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:20.665739Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:20.665746Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:20.665751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.665754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.665756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:20.665762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.665768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:20.665731Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2025
2025-10-02T08:14:20.665794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.665827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.665841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.665862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.665901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2026 partition: 0 MaxSeqNo: 17 sessionId: src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0
2025-10-02T08:14:20.666353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c054a7-10c335b4-fcae8231-1c5f60a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:20.668610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0] Write session: try to update token
2025-10-02T08:14:20.668623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:20.681964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId: src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:20.683009Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:20.683031Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:20.683034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:20.683041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534795915057479:5851]
2025-10-02T08:14:20.683045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534795915057479:5851]
2025-10-02T08:14:20.683088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:20.683095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.683097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:20.683137Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:20.683152Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:20.683239Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:20.684708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:20.768967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534795915057576:3106]
2025-10-02T08:14:20.769217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2025, pipe: [1:7556534795915057576:3106]
2025-10-02T08:14:20.831266Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:20.831625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.831638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.831675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915057576:3106], now have 1 active actors on pipe
2025-10-02T08:14:20.831775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534795915057576:3106]
2025-10-02T08:14:20.831795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:20.831801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:20.831847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2026 reason: error at write: Disconnected sessionId: src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0
2025-10-02T08:14:20.831864Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:20.831914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:20.832005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2026 sessionId: src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0 is DEAD
2025-10-02T08:14:20.832145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:20.832152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0] Write session will restart in 0.008124s
2025-10-02T08:14:20.832174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0] Write session: Do CDS request
2025-10-02T08:14:20.832181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:20.840249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:20.841202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:20.841293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.841402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:20.841412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2027
2025-10-02T08:14:20.841419Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:20.841423Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:20.841432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:20.841496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:20.841531Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534795915057765:4097]
2025-10-02T08:14:20.841537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:20.841561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:20.841571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:20.841574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:20.841940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2027 sessionId:  describe result for acl check
2025-10-02T08:14:20.841969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:20.841978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:20.841979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:20.841983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534795915057770:4095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:20.842118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:20.842385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:20.842429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534795915057770:4095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:20.842441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:20.842769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:20.842815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.842821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.842822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.842825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.842826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.842831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.842841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.842850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.842854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.842862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.842867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.842884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:20.842890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.842895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:20.842899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.842904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:20.842910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.842915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.842920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.842925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.842942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:20.844761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534795915057770:4095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:20.850428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534795915057770:4095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:20.850445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534795915057770:4095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:20.850449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534795915057770:4095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:20.850459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:20.850639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:20.852094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:20.852113Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:20.852116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:20.852119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:20.852126Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2026 [1:7556534795915057765:4097]
2025-10-02T08:14:20.852136Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:20.852155Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:20.852163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.852166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.852169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.852184Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:20.852193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:20.852216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:20.852274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.852281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.852284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:20.852287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:20.852369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2026
2025-10-02T08:14:20.852382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:20.852386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.852398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:20.852420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:20.852424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2026
2025-10-02T08:14:20.852438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915057812:4095], now have 1 active actors on pipe
2025-10-02T08:14:20.852447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534796374651740:2378], now have 1 active actors on pipe
2025-10-02T08:14:20.852452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.852460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.852477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534795915057759:4097]
2025-10-02T08:14:20.852483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534795915057759:4097]
2025-10-02T08:14:20.852494Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:20.852506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:20.852513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:20.852523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:20.852527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:20.852530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:20.852551Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:20.852562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.852570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.852573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:20.852586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.852598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:20.852633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534795915057759:4097]
2025-10-02T08:14:20.852645Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:20.852651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:20.852661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.852773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.852781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.852795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:20.852849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2027 partition: 0 MaxSeqNo: 17 sessionId: src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0
2025-10-02T08:14:20.853158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c089f96-cca09e2f-5ceddb3f-3bcef012_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:20.855803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0] Write session: try to update token
2025-10-02T08:14:20.855822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:20.863423Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:20.863443Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:20.863449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534795915057759:4097]
2025-10-02T08:14:20.863487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:20.863491Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:20.863642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:20.863763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:20.863902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:20.864026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:20.864223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:20.864262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:20.869941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId: src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:20.872348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:20.872409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.872418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.872441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:20.872459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:20.872510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:20.872516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:20.872653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.872703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.872763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.872842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.872883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.872890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.872948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.873004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.873061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.873117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.873161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.873169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.873232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.873292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.873347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.873403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.873500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.873511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.873567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.873641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.873693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.873747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.873791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.873799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.873858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.873910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.873961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.874021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.874065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.874070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.874128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.874181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.874236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.874295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.874337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.874342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.874396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.874449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.874505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.874568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.874608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.874613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.874671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.874721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.874774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.874834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.874875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.874880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.874935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.874990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.875051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.875115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.875154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.875158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.875217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:20.875276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:20.875338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:20.875396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:20.875444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:20.875452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:20.875485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:20.875550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:20.875573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:20.875576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:20.875606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:20.875623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:20.875631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:20.875633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:20.875636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:20.876013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:20.876041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:20.876046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:20.876049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:20.876058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:20.876061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:20.876577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:20.876598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:20.876604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:20.876607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:20.876609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:20.876610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:20.877083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:20.877104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:20.877108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:20.877111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:20.877116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:20.878193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:20.878208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:20.878216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392860878
2025-10-02T08:14:20.878311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:20.878320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:20.878323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:20.878325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:20.878328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:20.878330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:20.878737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:20.878752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:20.878757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:20.878759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:20.878761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:20.878764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:20.879190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:20.879208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:20.879214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:20.879216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:20.879218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:20.879220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:20.879647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:20.879669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:20.879674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:20.880655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:20.880669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:20.880674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:20.880677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:20.880682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392860880
2025-10-02T08:14:20.880977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:20.880992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:20.881001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:20.881003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:20.881005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:20.881007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:20.881415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:20.881430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:20.881435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:20.881437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:20.881441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:20.881445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:20.881828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:20.881844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:20.881927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392860881
2025-10-02T08:14:20.882571Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:20.882585Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:20.882589Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:20.882592Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:20.884011Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:20.884023Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:20.884024Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:20.884033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534795915057759:4097]
2025-10-02T08:14:20.884037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534795915057759:4097]
2025-10-02T08:14:20.884082Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:20.884090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:20.884091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:20.884093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:20.884094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:20.884224Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:20.931906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534795915057833:3106]
2025-10-02T08:14:20.932010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2026, pipe: [1:7556534795915057833:3106]
2025-10-02T08:14:21.003009Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 20 CurrentSessionLifetimeMs: 421697 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:14:21.015152Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:21.015447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534795915057833:3106], now have 1 active actors on pipe
2025-10-02T08:14:21.015579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534795915057833:3106]
2025-10-02T08:14:21.015610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:21.015613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:21.015617Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:21.015647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2027 reason: error at write: Disconnected sessionId: src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0
2025-10-02T08:14:21.015777Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:21.016004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:21.016015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0] Write session will restart in 0.006890s
2025-10-02T08:14:21.016050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0] Write session: Do CDS request
2025-10-02T08:14:21.016060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:21.015829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2027 sessionId: src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0 is DEAD
2025-10-02T08:14:21.023953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:21.024306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.024312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:21.024319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2028
2025-10-02T08:14:21.024473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.024493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:21.024500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:21.024503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:21.024798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2028 sessionId:  describe result for acl check
2025-10-02T08:14:21.024837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:21.024842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:21.024843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:21.024846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534800210025295:4108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:21.024963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:21.025093Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:21.025102Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:21.025109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:21.025142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:21.025168Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534800210025297:4141]
2025-10-02T08:14:21.025416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534800210025295:4108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:21.025567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:21.025728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:21.025756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:21.025966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:21.025995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.025999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.026000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.026001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.026001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.026005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.026012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.026014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.026016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.026018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.026021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.026026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.026034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.026037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.026040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.026045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.026047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.026050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.026052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.026055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.026066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:21.027309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534800210025295:4108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:21.033058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534800210025295:4108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:21.033074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534800210025295:4108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:21.033078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534800210025295:4108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:21.033086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:21.034024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:21.035580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:21.035593Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:21.035595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:21.035597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:21.035602Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2027 [1:7556534800210025297:4141]
2025-10-02T08:14:21.035609Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:21.035622Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:21.035624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.035626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.035628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.035640Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:21.035644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:21.035648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:21.035694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.035701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.035703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:21.035706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:21.035755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:21.035761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.035770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.035779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:21.035799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534800210025288:4141]
2025-10-02T08:14:21.035805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534800210025288:4141]
2025-10-02T08:14:21.035812Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:21.035823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2027
2025-10-02T08:14:21.035825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210025342:4108], now have 1 active actors on pipe
2025-10-02T08:14:21.035825Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:21.035829Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:21.035830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:21.035840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:21.035843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:21.035848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534800669619042:2378], now have 1 active actors on pipe
2025-10-02T08:14:21.035853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.035857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.035894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534800210025288:4141]
2025-10-02T08:14:21.035907Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:21.035913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:21.035923Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76406776-565b7875-79188459-64f61d02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:21.035928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.035931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.035933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:21.035940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.035950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:21.035942Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2027
2025-10-02T08:14:21.035980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.036023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.036029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.036040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.036074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2028 partition: 0 MaxSeqNo: 17 sessionId: src_id|76406776-565b7875-79188459-64f61d02_0
2025-10-02T08:14:21.036384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d3b0ac-7e64caa8-c5d45d24-daee90f8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|76406776-565b7875-79188459-64f61d02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:21.038979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76406776-565b7875-79188459-64f61d02_0] Write session: try to update token
2025-10-02T08:14:21.038997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76406776-565b7875-79188459-64f61d02_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:21.054113Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:21.054131Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:21.054134Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:21.054142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534800210025288:4141]
2025-10-02T08:14:21.054146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534800210025288:4141]
2025-10-02T08:14:21.054189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:21.054201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.054204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:21.054312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId: src_id|76406776-565b7875-79188459-64f61d02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:21.054347Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:21.056068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:21.056082Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:21.056779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:21.115717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534800210025358:3106]
2025-10-02T08:14:21.115855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2027, pipe: [1:7556534800210025358:3106]
2025-10-02T08:14:21.201912Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:21.202210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.202222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.202259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210025358:3106], now have 1 active actors on pipe
2025-10-02T08:14:21.202368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534800210025358:3106]
2025-10-02T08:14:21.202386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:21.202388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:21.202436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2028 reason: error at write: Disconnected sessionId: src_id|76406776-565b7875-79188459-64f61d02_0
2025-10-02T08:14:21.202457Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:21.202473Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:21.202570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2028 sessionId: src_id|76406776-565b7875-79188459-64f61d02_0 is DEAD
2025-10-02T08:14:21.202710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76406776-565b7875-79188459-64f61d02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:21.202720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76406776-565b7875-79188459-64f61d02_0] Write session will restart in 0.008646s
2025-10-02T08:14:21.202738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76406776-565b7875-79188459-64f61d02_0] Write session: Do CDS request
2025-10-02T08:14:21.202743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76406776-565b7875-79188459-64f61d02_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:21.209326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:21.210146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:21.210311Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:21.210321Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:21.210330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:21.210376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:21.210413Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534800210025523:4116]
2025-10-02T08:14:21.211028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:21.211206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:21.211251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:21.211543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:21.211601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.211608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.211609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.211610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.211610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.211616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.211626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.211634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.211638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.211645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.211651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.211662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.211671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.211680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.211685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.211694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.211702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.211711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.211719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.211727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.211750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:21.212210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76406776-565b7875-79188459-64f61d02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.212344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:21.212353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2029
2025-10-02T08:14:21.212457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.212483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:21.212493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:21.212496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:21.212855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2029 sessionId:  describe result for acl check
2025-10-02T08:14:21.212885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:21.212890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:21.212892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:21.212897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534800210025539:4118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:21.213260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534800210025539:4118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:21.215300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534800210025539:4118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:21.218714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534800210025539:4118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:21.218729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534800210025539:4118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:21.218733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534800210025539:4118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:21.218743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:21.219262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:21.220912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:21.220921Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:21.220922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:21.220924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:21.220929Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2028 [1:7556534800210025523:4116]
2025-10-02T08:14:21.220936Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:21.220949Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:21.220954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.220956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.220958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.220969Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:21.220972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:21.220977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:21.221017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.221022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.221024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:21.221026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:21.221069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:21.221074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.221083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.221089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:21.221108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210025571:4118], now have 1 active actors on pipe
2025-10-02T08:14:21.221118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534800210025517:4116]
2025-10-02T08:14:21.221120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534800210025517:4116]
2025-10-02T08:14:21.221126Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:21.221138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:21.221139Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:21.221146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:21.221146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2028
2025-10-02T08:14:21.221155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:21.221157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:21.221162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534800669619050:2378], now have 1 active actors on pipe
2025-10-02T08:14:21.221192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.221199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.221211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534800210025517:4116]
2025-10-02T08:14:21.221218Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:21.221191Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2028
2025-10-02T08:14:21.221231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:21.221238Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:21.221244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.221247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.221248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:21.221253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.221260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:21.221275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.221328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.221341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.221365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.221407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2029 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0
2025-10-02T08:14:21.221716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76406776-565b7875-79188459-64f61d02_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:21.224049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0] Write session: try to update token
2025-10-02T08:14:21.224062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:21.236125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId: src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:21.237664Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:21.237675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:21.237680Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:21.237686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534800210025517:4116]
2025-10-02T08:14:21.237688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534800210025517:4116]
2025-10-02T08:14:21.237723Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:21.237727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:21.237728Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:21.237733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.237735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:21.237867Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:21.238617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:21.302613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534800210025586:3106]
2025-10-02T08:14:21.302722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2028, pipe: [1:7556534800210025586:3106]
2025-10-02T08:14:21.365620Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:21.365861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.365872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.365908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210025586:3106], now have 1 active actors on pipe
2025-10-02T08:14:21.366039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:21.366047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:21.366095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2029 reason: error at write: Disconnected sessionId: src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0
2025-10-02T08:14:21.366115Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:21.366130Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:21.366240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2029 sessionId: src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0 is DEAD
2025-10-02T08:14:21.366389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534800210025586:3106]
2025-10-02T08:14:21.366553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:21.366561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0] Write session will restart in 0.007240s
2025-10-02T08:14:21.366580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0] Write session: Do CDS request
2025-10-02T08:14:21.366584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:21.375268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.375416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:21.375430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2030
2025-10-02T08:14:21.375530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.375553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:21.375558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:21.375561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:21.375915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2030 sessionId:  describe result for acl check
2025-10-02T08:14:21.375938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:21.375941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:21.375942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:21.375947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534800210025738:4129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:21.376425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534800210025738:4129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:21.376890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:21.377814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:21.377972Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:21.377980Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:21.377989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:21.378029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:21.378067Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534800210025774:4127]
2025-10-02T08:14:21.378303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534800210025738:4129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:21.378660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:21.378836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:21.378891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:21.379117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:21.379144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.379149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.379150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.379151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.379152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.379157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.379166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.379169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.379172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.379176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.379181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.379188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.379192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.379198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.379202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.379206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.379210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.379213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.379215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.379218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.379229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:21.382974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534800210025738:4129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:21.382986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534800210025738:4129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:21.382990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534800210025738:4129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:21.383000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:21.387198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:21.388972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:21.388988Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:21.388990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:21.388993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:21.389000Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2029 [1:7556534800210025774:4127]
2025-10-02T08:14:21.389010Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:21.389027Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:21.389030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.389032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.389034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.389047Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:21.389051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:21.389061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:21.389118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.389125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.389127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:21.389129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:21.389191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:21.389199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.389212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.389224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:21.389240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534800210025755:4127]
2025-10-02T08:14:21.389242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534800210025755:4127]
2025-10-02T08:14:21.389257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:21.389274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:21.389292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:21.389293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:21.389295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:21.389296Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:21.389327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534800210025755:4127]
2025-10-02T08:14:21.389334Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:21.389354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210025801:4129], now have 1 active actors on pipe
2025-10-02T08:14:21.389360Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:21.389370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534800669619057:2378], now have 1 active actors on pipe
2025-10-02T08:14:21.389373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2029
2025-10-02T08:14:21.389519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2029
2025-10-02T08:14:21.389625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.389636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.389665Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:21.389675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.389678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.389679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:21.389688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.389697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:21.389712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.389765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.389767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.389780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.389810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2030 partition: 0 MaxSeqNo: 17 sessionId: src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0
2025-10-02T08:14:21.390122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc822dbb-b8231edc-8ffe3cc6-4cde1a65_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:21.392625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0] Write session: try to update token
2025-10-02T08:14:21.392642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:21.405649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId: src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:21.408178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:21.409445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.409467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.409487Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:21.409489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:21.409491Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:21.409499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534800210025755:4127]
2025-10-02T08:14:21.409502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534800210025755:4127]
2025-10-02T08:14:21.409551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:21.409561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.409564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:21.409565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:21.409571Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:21.409690Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:21.466450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534800210025818:3106]
2025-10-02T08:14:21.466555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2029, pipe: [1:7556534800210025818:3106]
2025-10-02T08:14:21.548176Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:21.548484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:21.548529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:21.548536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210025818:3106], now have 1 active actors on pipe
2025-10-02T08:14:21.548684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:21.548694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:21.548713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2030 reason: error at write: Disconnected sessionId: src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0
2025-10-02T08:14:21.548757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:21.548865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2030 sessionId: src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0 is DEAD
2025-10-02T08:14:21.549009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:21.549022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0] Write session will restart in 0.009681s
2025-10-02T08:14:21.549044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0] Write session: Do CDS request
2025-10-02T08:14:21.549050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:21.549040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534800210025818:3106]
2025-10-02T08:14:21.556326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:21.557147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:21.557296Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:21.557305Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:21.557313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:21.557355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:21.557389Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534800210025988:4146]
2025-10-02T08:14:21.557974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:21.558170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:21.558204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:21.558482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:21.558517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.558522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.558523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.558524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.558525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.558529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.558538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.558543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.558547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.558550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.558555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.558565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.558573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.558582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.558590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.558595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.558599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.558603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.558607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.558612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.558633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:21.560223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.560299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:21.560308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2031
2025-10-02T08:14:21.560432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.560457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:21.560466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:21.560469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:21.560849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2031 sessionId:  describe result for acl check
2025-10-02T08:14:21.560879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:21.560884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:21.560886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:21.560891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534800210026004:4184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:21.561344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534800210026004:4184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:21.563683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534800210026004:4184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:21.565900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534800210026004:4184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:21.565911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534800210026004:4184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:21.565915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534800210026004:4184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:21.565924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:21.566192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:21.567672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:21.567686Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:21.567689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:21.567692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:21.567697Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2030 [1:7556534800210025988:4146]
2025-10-02T08:14:21.567707Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:21.567720Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:21.567723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.567726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.567728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.567742Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:21.567746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:21.567752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:21.567799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.567807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.567810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:21.567813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:21.567870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:21.567877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.567889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.567900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:21.567920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210026035:4184], now have 1 active actors on pipe
2025-10-02T08:14:21.567921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2030
2025-10-02T08:14:21.567927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534800669619065:2378], now have 1 active actors on pipe
2025-10-02T08:14:21.567933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534800210025982:4146]
2025-10-02T08:14:21.567935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534800210025982:4146]
2025-10-02T08:14:21.567944Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:21.567958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.567960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:21.567963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:21.567965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.567974Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2030
2025-10-02T08:14:21.567980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:21.567998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:21.568001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:21.568039Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:21.568048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.568051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.568053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:21.568060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.568071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:21.568082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534800210025982:4146]
2025-10-02T08:14:21.568089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:21.568089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:21.568106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.568137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.568145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.568158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.568266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2031 partition: 0 MaxSeqNo: 17 sessionId: src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0
2025-10-02T08:14:21.568561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f9bd2d-769bd570-f85d7e8-63eb99d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:21.571004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0] Write session: try to update token
2025-10-02T08:14:21.571019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:21.583755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId: src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:21.585470Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:21.585484Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:21.585487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:21.585495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534800210025982:4146]
2025-10-02T08:14:21.585500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534800210025982:4146]
2025-10-02T08:14:21.585540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:21.585538Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:21.585544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:21.585547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.585549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:21.585680Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:21.586251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:21.649245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534800210026054:3106]
2025-10-02T08:14:21.649388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2030, pipe: [1:7556534800210026054:3106]
2025-10-02T08:14:21.732561Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:21.733045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.733058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.733094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210026054:3106], now have 1 active actors on pipe
2025-10-02T08:14:21.733230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534800210026054:3106]
2025-10-02T08:14:21.733251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:21.733257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:21.733311Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:21.733313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2031 reason: error at write: Disconnected sessionId: src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0
2025-10-02T08:14:21.733285Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:21.733451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2031 sessionId: src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0 is DEAD
2025-10-02T08:14:21.733607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:21.733615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0] Write session will restart in 0.007609s
2025-10-02T08:14:21.733650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0] Write session: Do CDS request
2025-10-02T08:14:21.733656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:21.740543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:21.741495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:21.741628Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:21.741636Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:21.741644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:21.741687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:21.741724Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534800210026240:4194]
2025-10-02T08:14:21.742151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:21.742226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.742309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:21.742346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:21.742383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:21.742396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2032
2025-10-02T08:14:21.742509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.742537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:21.742546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:21.742549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:21.742641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:21.742685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.742690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.742691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.742692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.742693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.742698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.742708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.742711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.742715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.742719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.742724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.742731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.742740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.742745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.742753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.742758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.742762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.742766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.742771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.742776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.742796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:21.742889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2032 sessionId:  describe result for acl check
2025-10-02T08:14:21.742918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:21.742924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:21.742926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:21.742931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534800210026254:4213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:21.743413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534800210026254:4213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:21.745344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534800210026254:4213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:21.749875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534800210026254:4213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:21.749885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534800210026254:4213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:21.749887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534800210026254:4213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:21.749894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:21.750462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:21.751818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:21.751829Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:21.751830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:21.751833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:21.751837Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2031 [1:7556534800210026240:4194]
2025-10-02T08:14:21.751845Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:21.751859Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:21.751861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.751863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.751864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.751876Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:21.751878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:21.751883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:21.751924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.751929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.751931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:21.751933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:21.751983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:21.751989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.752000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.752015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:21.752028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2031
2025-10-02T08:14:21.752036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210026288:4213], now have 1 active actors on pipe
2025-10-02T08:14:21.752041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534800210026234:4194]
2025-10-02T08:14:21.752043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534800210026234:4194]
2025-10-02T08:14:21.752052Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:21.752063Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:21.752064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534800669619083:2378], now have 1 active actors on pipe
2025-10-02T08:14:21.752066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:21.752067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.752071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.752087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:21.752103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:21.752108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:21.752119Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2031
2025-10-02T08:14:21.752138Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8f758f3-b069b0d9-5aef042e-877785f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:21.752148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.752153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.752154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:21.752161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.752169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:21.752176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534800210026234:4194]
2025-10-02T08:14:21.752182Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:21.752206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:21.752215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.752237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.752243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.752255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.752284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2032 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8f758f3-b069b0d9-5aef042e-877785f_0
2025-10-02T08:14:21.752561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e98e2dbb-fe0486de-532a2e34-caddf5bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8f758f3-b069b0d9-5aef042e-877785f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:21.754909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f758f3-b069b0d9-5aef042e-877785f_0] Write session: try to update token
2025-10-02T08:14:21.754924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f758f3-b069b0d9-5aef042e-877785f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:21.767396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId: src_id|d8f758f3-b069b0d9-5aef042e-877785f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:21.769125Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:21.769140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:21.769143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:21.769150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534800210026234:4194]
2025-10-02T08:14:21.769155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534800210026234:4194]
2025-10-02T08:14:21.769193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:21.769197Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:21.769203Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:21.769203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.769205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:21.769337Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:21.770041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:21.833584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534800210026342:3106]
2025-10-02T08:14:21.833805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2031, pipe: [1:7556534800210026342:3106]
2025-10-02T08:14:21.912946Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:21.913327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.913344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.913383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210026342:3106], now have 1 active actors on pipe
2025-10-02T08:14:21.913485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534800210026342:3106]
2025-10-02T08:14:21.913505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:21.913507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:21.913558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2032 reason: error at write: Disconnected sessionId: src_id|d8f758f3-b069b0d9-5aef042e-877785f_0
2025-10-02T08:14:21.913557Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:21.913597Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:21.913708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2032 sessionId: src_id|d8f758f3-b069b0d9-5aef042e-877785f_0 is DEAD
2025-10-02T08:14:21.913865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f758f3-b069b0d9-5aef042e-877785f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:21.913872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f758f3-b069b0d9-5aef042e-877785f_0] Write session will restart in 0.005195s
2025-10-02T08:14:21.913898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f758f3-b069b0d9-5aef042e-877785f_0] Write session: Do CDS request
2025-10-02T08:14:21.913904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f758f3-b069b0d9-5aef042e-877785f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:21.920211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f758f3-b069b0d9-5aef042e-877785f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.920298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:21.920311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2033
2025-10-02T08:14:21.920408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:21.920435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:21.920444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:21.920447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:21.920823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2033 sessionId:  describe result for acl check
2025-10-02T08:14:21.920850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:21.920855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:21.920857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:21.920863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534800210026506:4348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:21.921343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:21.921352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534800210026506:4348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:21.922374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:21.922542Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:21.922554Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:21.922563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:21.922607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:21.922640Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534800210026529:4333]
2025-10-02T08:14:21.923258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:21.923440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:21.923478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:21.923762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:21.923798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.923804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.923807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.923808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.923809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.923814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.923823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.923827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.923831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.923836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.923840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.923847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:21.923853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.923862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:21.923866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.923872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:21.923880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.923884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.923888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.923892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.923915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:21.925027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534800210026506:4348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:21.931117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534800210026506:4348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:21.931130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534800210026506:4348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:21.931133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534800210026506:4348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:21.931142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:21.931559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:21.933299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:21.933316Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:21.933319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:21.933322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:21.933329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2032 [1:7556534800210026529:4333]
2025-10-02T08:14:21.933341Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:21.933356Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:21.933360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.933363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.933365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.933380Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:21.933385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:21.933391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:21.933450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.933458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.933461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:21.933464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:21.933536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:21.933544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.933555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:21.933568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:21.933568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2032
2025-10-02T08:14:21.933590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534800210026563:4348], now have 1 active actors on pipe
2025-10-02T08:14:21.933598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534800669619114:2378], now have 1 active actors on pipe
2025-10-02T08:14:21.933604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.933608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.933626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534800210026512:4333]
2025-10-02T08:14:21.933632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534800210026512:4333]
2025-10-02T08:14:21.933643Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:21.933655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:21.933660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:21.933662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:21.933673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:21.933676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:21.933691Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:21.933701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.933705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.933707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:21.933677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2032
2025-10-02T08:14:21.933716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.933728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:21.933765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534800210026512:4333]
2025-10-02T08:14:21.933777Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:21.933784Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:21.933794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.933851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.933859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.933872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:21.933906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2033 partition: 0 MaxSeqNo: 17 sessionId: src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0
2025-10-02T08:14:21.934220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f758f3-b069b0d9-5aef042e-877785f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:21.936727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0] Write session: try to update token
2025-10-02T08:14:21.936741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:21.949997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId: src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:21.950901Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:21.950914Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:21.950923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534800210026512:4333]
2025-10-02T08:14:21.950969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:21.951143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:21.951291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:21.951433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:21.951580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:21.951782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:21.951824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:21.951960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:21.952680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:21.952757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.952770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.952799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:21.952833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:21.952878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:21.952889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:21.953049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.953111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.953180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.953244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.953360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.953370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.953438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.953504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.953576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.953641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.953682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.953689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.953758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.953821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.953888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.953969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.954019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.954026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.954096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.954163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.954228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.954293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.954336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.954346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.954416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.954484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.954546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.954609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.954662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.954671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.954743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.954805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.954870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.954935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.954982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.954989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.955058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.955130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.955203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.955269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.955381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.955390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.955459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.955522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.955592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.955663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.955711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.955718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.955792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.955856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.955919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.955980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.956023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.956033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.956099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:21.956154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:21.956226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:21.956281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:21.956322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:21.956327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:21.956360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:21.956411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:21.956432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:21.956434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:21.956457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:21.956474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:21.956479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:21.956481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:21.956484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:21.956894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:21.956916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:21.956921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:21.956923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:21.956925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:21.956927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:21.957469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:21.957488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:21.957493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:21.957497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:21.957499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:21.957501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:21.957999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:21.958020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:21.958028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:21.958031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:21.958034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:21.959286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:21.959305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:21.959316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392861958
2025-10-02T08:14:21.959452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:21.959468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:21.959477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:21.959481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:21.959486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:21.959494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:21.959988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:21.960013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:21.960019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:21.960023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:21.960026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:21.960030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:21.960498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:21.960516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:21.960524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:21.960526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:21.960528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:21.960530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:21.961010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:21.961029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:21.961036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:21.962113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:21.962139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:21.962144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:21.962148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:21.962157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392861961
2025-10-02T08:14:21.962459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:21.962477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:21.962483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:21.962489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:21.962495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:21.962498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:21.962971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:21.962992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:21.962996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:21.963000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:21.963002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:21.963005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:21.963440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:21.963457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:21.963529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392861963
2025-10-02T08:14:21.964244Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:21.964259Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:21.964263Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:21.964267Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:21.965813Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:21.965824Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:21.965825Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:21.965833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534800210026512:4333]
2025-10-02T08:14:21.965837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534800210026512:4333]
2025-10-02T08:14:21.965878Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:21.965879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:21.965883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:21.965884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:21.965890Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:21.966012Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:22.013776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534804504993882:3106]
2025-10-02T08:14:22.013896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2032, pipe: [1:7556534804504993882:3106]
2025-10-02T08:14:22.100044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:22.100057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0] Write session will restart in 0.008254s
2025-10-02T08:14:22.100079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0] Write session: Do CDS request
2025-10-02T08:14:22.100086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:22.099178Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:22.099523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504993882:3106], now have 1 active actors on pipe
2025-10-02T08:14:22.099690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534804504993882:3106]
2025-10-02T08:14:22.099706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:22.099708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:22.099746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2033 reason: error at write: Disconnected sessionId: src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0
2025-10-02T08:14:22.099789Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:22.099918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2033 sessionId: src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0 is DEAD
2025-10-02T08:14:22.100884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:22.107696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:22.108767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:22.108970Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:22.108986Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:22.108995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:22.109042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:22.109092Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534804504994060:4372]
2025-10-02T08:14:22.109256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.109315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:22.109326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2034
2025-10-02T08:14:22.109552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.109584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:22.109589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:22.109592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:22.109701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:22.109935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2034 sessionId:  describe result for acl check
2025-10-02T08:14:22.109960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:22.109988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:22.109989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:22.109990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:22.109995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534804504994069:4369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:22.110009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:22.110308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:22.110359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.110360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.110361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.110362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.110363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.110369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.110389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.110393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.110396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.110398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.110404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.110411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.110417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.110422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.110426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.110431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.110435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.110438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534804504994069:4369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:22.110440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.110444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.110449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.110467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:22.112822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534804504994069:4369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:22.119298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534804504994069:4369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:22.119309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534804504994069:4369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:22.119312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534804504994069:4369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:22.119320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:22.122343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:22.123983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:22.124001Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:22.124003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:22.124008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:22.124014Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2033 [1:7556534804504994060:4372]
2025-10-02T08:14:22.124021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:22.124033Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:22.124035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.124037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.124039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.124051Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:22.124058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:22.124063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:22.124106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.124110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.124113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:22.124115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:22.124163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:22.124168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.124176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.124187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:22.124216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504994108:4369], now have 1 active actors on pipe
2025-10-02T08:14:22.124226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534804504994053:4372]
2025-10-02T08:14:22.124232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534804504994053:4372]
2025-10-02T08:14:22.124240Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:22.124246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2033
2025-10-02T08:14:22.124254Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:22.124259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:22.124262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:22.124271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:22.124279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:22.124286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534804964586418:2378], now have 1 active actors on pipe
2025-10-02T08:14:22.124290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.124294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.124333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534804504994053:4372]
2025-10-02T08:14:22.124344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:22.124357Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:22.124338Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2033
2025-10-02T08:14:22.124367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.124369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:22.124370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.124372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:22.124378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.124385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:22.124417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.124492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.124497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.124506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.124537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2034 partition: 0 MaxSeqNo: 17 sessionId: src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0
2025-10-02T08:14:22.124843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17fb464-7b2455a7-225e1a9f-9d232c9c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:22.127561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0] Write session: try to update token
2025-10-02T08:14:22.127577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:22.136611Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:22.136630Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:22.136638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534804504994053:4372]
2025-10-02T08:14:22.136674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:22.136677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:22.136872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:22.137016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:22.137158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:22.137293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:22.137463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:22.137492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:22.144353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId: src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:22.146750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:22.146823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.146830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.146864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:22.146885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:22.146937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.146939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.147092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.147148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.147205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.147266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.147306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.147311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.147380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.147435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.147497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.147556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.147595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.147598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.147668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.147723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.147775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.147831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.147879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.147885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.147950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.148029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.148095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.148157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.148212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.148219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.148286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.148348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.148413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.148480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.148528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.148535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.148600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.148652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.148718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.148786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.148847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.148853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.148916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.148969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.149025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.149079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.149119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.149124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.149184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.149238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.149291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.149343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.149382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.149387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.149443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.149497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.149563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.149628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.149669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.149674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.149737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:22.149798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:22.149861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:22.149923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:22.149966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:22.149973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:22.150009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:22.150074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.150095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.150100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:22.150129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:22.150143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:22.150149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:22.150151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:22.150154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:22.150513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:22.150533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:22.150542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:22.150544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:22.150545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:22.150548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:22.151036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:22.151054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:22.151058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:22.151060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:22.151064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:22.151065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:22.151493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:22.151507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:22.151511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:22.151513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:22.151516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:22.153446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:22.153463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:22.153472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392862152
2025-10-02T08:14:22.153581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:22.153591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:22.153595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:22.153597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:22.153600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:22.153602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:22.154000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:22.154019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:22.154024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:22.154026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:22.154028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:22.154031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:22.154513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:22.154533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:22.154540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:22.154547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:22.154549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:22.154552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:22.154934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:22.154952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:22.154959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:22.155851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:22.155864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:22.155867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:22.155869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:22.155875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392862155
2025-10-02T08:14:22.156121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:22.156135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:22.156139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:22.156141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:22.156143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:22.156146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:22.156534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:22.156549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:22.156553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:22.156556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:22.156559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:22.156561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:22.156957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:22.156972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.157041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392862156
2025-10-02T08:14:22.160069Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:22.160083Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:22.160087Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:22.160090Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:22.161545Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:22.161558Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:22.161559Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:22.161566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534804504994053:4372]
2025-10-02T08:14:22.161568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534804504994053:4372]
2025-10-02T08:14:22.161615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:22.161624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.161626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:22.161629Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:22.161635Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:22.161752Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:22.199633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534804504994133:3106]
2025-10-02T08:14:22.199773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2033, pipe: [1:7556534804504994133:3106]
2025-10-02T08:14:22.298074Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:22.298466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504994133:3106], now have 1 active actors on pipe
2025-10-02T08:14:22.298579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534804504994133:3106]
2025-10-02T08:14:22.298672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:22.298675Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:22.298681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:22.298712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2034 reason: error at write: Disconnected sessionId: src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0
2025-10-02T08:14:22.298883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2034 sessionId: src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0 is DEAD
2025-10-02T08:14:22.298710Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:22.299039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:22.299061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0] Write session will restart in 0.008514s
2025-10-02T08:14:22.299089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0] Write session: Do CDS request
2025-10-02T08:14:22.299096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:22.307642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:22.307941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:22.308077Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:22.308085Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:22.308093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:22.308133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:22.308169Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534804504994356:4374]
2025-10-02T08:14:22.308830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:22.308997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:22.309033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:22.309251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.309326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:22.309327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:22.309333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2035
2025-10-02T08:14:22.309366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.309371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.309372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.309373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.309374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.309379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.309387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.309391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.309394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.309397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.309402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.309408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.309414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.309419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.309423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.309427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.309435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.309440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.309444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.309452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.309471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:22.309491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.309515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:22.309522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:22.309524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:22.309843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2035 sessionId:  describe result for acl check
2025-10-02T08:14:22.309872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:22.309877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:22.309878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:22.309882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534804504994372:4410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:22.310345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534804504994372:4410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:22.312039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534804504994372:4410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:22.316784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534804504994372:4410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:22.316814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534804504994372:4410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:22.316818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534804504994372:4410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:22.316834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:22.317268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:22.318753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:22.318769Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:22.318772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:22.318775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:22.318782Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2034 [1:7556534804504994356:4374]
2025-10-02T08:14:22.318795Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:22.318819Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:22.318823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.318826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.318827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.318841Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:22.318845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:22.318852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:22.318916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.318923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.318926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:22.318928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:22.318991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:22.318998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.319012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.319026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2034
2025-10-02T08:14:22.319027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:22.319044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504994404:4410], now have 1 active actors on pipe
2025-10-02T08:14:22.319047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534804964586427:2378], now have 1 active actors on pipe
2025-10-02T08:14:22.319052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534804504994350:4374]
2025-10-02T08:14:22.319054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534804504994350:4374]
2025-10-02T08:14:22.319064Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:22.319073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.319076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:22.319078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.319079Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:22.319095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:22.319107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:22.319110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:22.319150Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:22.319160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.319165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.319114Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2034
2025-10-02T08:14:22.319167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:22.319174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.319182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:22.319187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534804504994350:4374]
2025-10-02T08:14:22.319193Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:22.319205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:22.319220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.319286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.319291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.319300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.319324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2035 partition: 0 MaxSeqNo: 17 sessionId: src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0
2025-10-02T08:14:22.319618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20dfa20f-15b73e67-2c701bf-146e81c0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:22.322169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0] Write session: try to update token
2025-10-02T08:14:22.322186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:22.336882Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:22.336893Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:22.336895Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:22.336901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534804504994350:4374]
2025-10-02T08:14:22.336905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534804504994350:4374]
2025-10-02T08:14:22.336938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:22.336938Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:22.336943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:22.336943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.336947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:22.337379Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:22.338833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId: src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:22.341891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:22.398792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534804504994424:3106]
2025-10-02T08:14:22.398896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2034, pipe: [1:7556534804504994424:3106]
2025-10-02T08:14:22.470099Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:22.470418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.470434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.470472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504994424:3106], now have 1 active actors on pipe
2025-10-02T08:14:22.470605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534804504994424:3106]
2025-10-02T08:14:22.470631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:22.470636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:22.470681Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:22.470694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2035 reason: error at write: Disconnected sessionId: src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0
2025-10-02T08:14:22.470702Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:22.470848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2035 sessionId: src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0 is DEAD
2025-10-02T08:14:22.470978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:22.470984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0] Write session will restart in 0.005571s
2025-10-02T08:14:22.471010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0] Write session: Do CDS request
2025-10-02T08:14:22.471016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:22.477216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.477256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:22.477268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2036
2025-10-02T08:14:22.477433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.477461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:22.477468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:22.477471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:22.477864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2036 sessionId:  describe result for acl check
2025-10-02T08:14:22.477892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:22.477897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:22.477898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:22.477903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534804504994632:4384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:22.478361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534804504994632:4384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:22.479063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:22.479523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:22.479654Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:22.479661Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:22.479668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:22.479700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:22.479727Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534804504994667:4393]
2025-10-02T08:14:22.480145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:22.480313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:22.480355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:22.480364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534804504994632:4384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:22.480602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:22.480647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.480651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.480651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.480652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.480653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.480656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.480661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.480663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.480665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.480667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.480670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.480675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.480681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.480684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.480686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.480689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.480691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.480694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.480696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.480699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.480709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:22.486204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534804504994632:4384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:22.486215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534804504994632:4384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:22.486219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534804504994632:4384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:22.486228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:22.490662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:22.492230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:22.492241Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:22.492242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:22.492245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:22.492249Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2035 [1:7556534804504994667:4393]
2025-10-02T08:14:22.492255Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:22.492269Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:22.492271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.492273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.492275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.492287Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:22.492292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:22.492298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:22.492343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.492349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.492351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:22.492352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:22.492399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:22.492405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.492413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.492422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:22.492439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534804504994649:4393]
2025-10-02T08:14:22.492445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534804504994649:4393]
2025-10-02T08:14:22.492452Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:22.492462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2035
2025-10-02T08:14:22.492467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504994695:4384], now have 1 active actors on pipe
2025-10-02T08:14:22.492473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:22.492478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:22.492481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:22.492485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:22.492492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:22.492498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.492501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.492539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534804964586434:2378], now have 1 active actors on pipe
2025-10-02T08:14:22.492547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534804504994649:4393]
2025-10-02T08:14:22.492553Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:22.492570Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:22.492573Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:22.492580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.492583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.492584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:22.492593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.492600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:22.492567Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2035
2025-10-02T08:14:22.492625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.492702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.492707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.492716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.492742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2036 partition: 0 MaxSeqNo: 17 sessionId: src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0
2025-10-02T08:14:22.493063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36ceb77-5d464b68-f26b0f0e-f0f2a1ff_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:22.495543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0] Write session: try to update token
2025-10-02T08:14:22.495558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:22.508574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId: src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:22.509711Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:22.509725Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:22.509728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:22.509736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534804504994649:4393]
2025-10-02T08:14:22.509741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534804504994649:4393]
2025-10-02T08:14:22.509781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:22.509791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.509795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:22.509883Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:22.509896Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:22.509928Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:22.511159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:22.570836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534804504994709:3106]
2025-10-02T08:14:22.570986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2035, pipe: [1:7556534804504994709:3106]
2025-10-02T08:14:22.643707Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:22.643948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.643959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.643990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504994709:3106], now have 1 active actors on pipe
2025-10-02T08:14:22.644109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534804504994709:3106]
2025-10-02T08:14:22.644138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:22.644145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:22.644166Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:22.644233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2036 reason: error at write: Disconnected sessionId: src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0
2025-10-02T08:14:22.644417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2036 sessionId: src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0 is DEAD
2025-10-02T08:14:22.644511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:22.644567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:22.644577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0] Write session will restart in 0.009623s
2025-10-02T08:14:22.644600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0] Write session: Do CDS request
2025-10-02T08:14:22.644606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:22.654771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:22.655287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.655289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:22.655340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:22.655350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2037
2025-10-02T08:14:22.655470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.655475Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:22.655479Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:22.655489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:22.655495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:22.655499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:22.655513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:22.655564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:22.655603Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534804504994934:4402]
2025-10-02T08:14:22.655843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2037 sessionId:  describe result for acl check
2025-10-02T08:14:22.655863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:22.655867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:22.655868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:22.655871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534804504994938:4408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:22.656241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534804504994938:4408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:22.656244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:22.656440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:22.656474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:22.656739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:22.656776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.656780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.656781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.656782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.656782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.656786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.656791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.656793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.656795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.656797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.656849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.656860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.656865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.656870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.656878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.656883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.656886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.656892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.656899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.656904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.656927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:22.658290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534804504994938:4408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:22.663905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534804504994938:4408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:22.663916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534804504994938:4408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:22.663918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534804504994938:4408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:22.663927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:22.664336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:22.665710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:22.665722Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:22.665725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:22.665729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:22.665734Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2036 [1:7556534804504994934:4402]
2025-10-02T08:14:22.665744Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:22.665759Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:22.665762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.665765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.665767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.665782Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:22.665791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:22.665798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:22.665846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.665852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.665855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:22.665858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:22.665967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:22.665975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.665986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.666001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:22.666010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2036
2025-10-02T08:14:22.666022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504994983:4408], now have 1 active actors on pipe
2025-10-02T08:14:22.666025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534804964586452:2378], now have 1 active actors on pipe
2025-10-02T08:14:22.666029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.666036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.666052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534804504994927:4402]
2025-10-02T08:14:22.666057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534804504994927:4402]
2025-10-02T08:14:22.666064Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:22.666042Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2036
2025-10-02T08:14:22.666074Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:22.666077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:22.666083Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:22.666089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:22.666092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:22.666105Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0b11b86-2e624630-e599a515-710b9e9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:22.666114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.666118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.666123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:22.666132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.666144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:22.666178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534804504994927:4402]
2025-10-02T08:14:22.666188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:22.666201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.666207Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:22.666262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.666267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.666280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.666314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2037 partition: 0 MaxSeqNo: 17 sessionId: src_id|f0b11b86-2e624630-e599a515-710b9e9a_0
2025-10-02T08:14:22.666607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb0239e-aecf07de-1cc47b4e-9cc335b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f0b11b86-2e624630-e599a515-710b9e9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:22.669240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b11b86-2e624630-e599a515-710b9e9a_0] Write session: try to update token
2025-10-02T08:14:22.669256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b11b86-2e624630-e599a515-710b9e9a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:22.682310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId: src_id|f0b11b86-2e624630-e599a515-710b9e9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:22.683165Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:22.683178Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:22.683179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:22.683185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534804504994927:4402]
2025-10-02T08:14:22.683189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534804504994927:4402]
2025-10-02T08:14:22.683218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:22.683224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.683230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:22.683229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:22.683234Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:22.683358Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:22.684785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:22.744389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534804504995010:3106]
2025-10-02T08:14:22.744463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2036, pipe: [1:7556534804504995010:3106]
2025-10-02T08:14:22.815631Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:22.816260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.816277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.816314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504995010:3106], now have 1 active actors on pipe
2025-10-02T08:14:22.816560Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:22.816585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:22.816592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:22.816638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2037 reason: error at write: Disconnected sessionId: src_id|f0b11b86-2e624630-e599a515-710b9e9a_0
2025-10-02T08:14:22.816791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2037 sessionId: src_id|f0b11b86-2e624630-e599a515-710b9e9a_0 is DEAD
2025-10-02T08:14:22.816939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b11b86-2e624630-e599a515-710b9e9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:22.816948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b11b86-2e624630-e599a515-710b9e9a_0] Write session will restart in 0.009095s
2025-10-02T08:14:22.816973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b11b86-2e624630-e599a515-710b9e9a_0] Write session: Do CDS request
2025-10-02T08:14:22.816979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b11b86-2e624630-e599a515-710b9e9a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:22.817044Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:22.817274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534804504995010:3106]
2025-10-02T08:14:22.826758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:22.827738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b11b86-2e624630-e599a515-710b9e9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.827476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:22.827679Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:22.827682Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:22.827692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:22.827736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:22.827766Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534804504995251:4472]
2025-10-02T08:14:22.828442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:22.828498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:22.828509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2038
2025-10-02T08:14:22.828619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:22.828658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:22.829010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:22.829062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.829068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.829069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.829070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.829071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.829076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.829085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.829089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.829094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.829098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.829103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.829112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:22.829118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.829123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:22.829128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.829133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:22.829137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.829143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.829147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.829152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.829172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:22.829218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:22.829246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:22.829257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:22.829261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:22.829564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2038 sessionId:  describe result for acl check
2025-10-02T08:14:22.829584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:22.829586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:22.829587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:22.829592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534804504995267:4466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:22.830044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534804504995267:4466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:22.832216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534804504995267:4466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:22.839071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534804504995267:4466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:22.839086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534804504995267:4466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:22.839092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534804504995267:4466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:22.839100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:22.840033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:22.841641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:22.841661Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:22.841663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:22.841667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:22.841672Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2037 [1:7556534804504995251:4472]
2025-10-02T08:14:22.841683Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:22.841698Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:22.841701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.841704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.841706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.841721Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:22.841725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:22.841731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:22.841788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.841797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.841800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:22.841802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:22.841862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:22.841869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.841881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:22.841895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:22.841918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534804964586460:2378], now have 1 active actors on pipe
2025-10-02T08:14:22.841928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534804504995245:4472]
2025-10-02T08:14:22.841930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534804504995245:4472]
2025-10-02T08:14:22.841941Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:22.841956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:22.841958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:22.841962Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:22.841974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:22.841978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:22.842008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534804504995245:4472]
2025-10-02T08:14:22.842015Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:22.842024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:22.841991Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2037
2025-10-02T08:14:22.842329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2037
2025-10-02T08:14:22.842341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504995299:4466], now have 1 active actors on pipe
2025-10-02T08:14:22.842346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.842350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.842371Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df480631-386a7021-68dc11b0-aa4cfd50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:22.842383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:22.842391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:22.842392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:22.842401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:22.842413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:22.842431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.842477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:22.842484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:22.842495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:22.842521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2038 partition: 0 MaxSeqNo: 17 sessionId: src_id|df480631-386a7021-68dc11b0-aa4cfd50_0
2025-10-02T08:14:22.842942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b11b86-2e624630-e599a515-710b9e9a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df480631-386a7021-68dc11b0-aa4cfd50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:22.845689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df480631-386a7021-68dc11b0-aa4cfd50_0] Write session: try to update token
2025-10-02T08:14:22.845702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df480631-386a7021-68dc11b0-aa4cfd50_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:22.865582Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:22.865597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:22.865598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:22.865605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534804504995245:4472]
2025-10-02T08:14:22.865608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534804504995245:4472]
2025-10-02T08:14:22.865642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:22.865647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:22.865648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:22.865649Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:22.865656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:22.865770Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:22.866111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId: src_id|df480631-386a7021-68dc11b0-aa4cfd50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:22.868671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:22.917432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534804504995337:3106]
2025-10-02T08:14:22.917558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2037, pipe: [1:7556534804504995337:3106]
2025-10-02T08:14:23.001681Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:23.001937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.001951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.001987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534804504995337:3106], now have 1 active actors on pipe
2025-10-02T08:14:23.002084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:23.002095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:23.002149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2038 reason: error at write: Disconnected sessionId: src_id|df480631-386a7021-68dc11b0-aa4cfd50_0
2025-10-02T08:14:23.002197Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:23.002422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df480631-386a7021-68dc11b0-aa4cfd50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:23.002429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df480631-386a7021-68dc11b0-aa4cfd50_0] Write session will restart in 0.005020s
2025-10-02T08:14:23.002451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df480631-386a7021-68dc11b0-aa4cfd50_0] Write session: Do CDS request
2025-10-02T08:14:23.002457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df480631-386a7021-68dc11b0-aa4cfd50_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:23.002232Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:23.002314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2038 sessionId: src_id|df480631-386a7021-68dc11b0-aa4cfd50_0 is DEAD
2025-10-02T08:14:23.002477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534804504995337:3106]
2025-10-02T08:14:23.008306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df480631-386a7021-68dc11b0-aa4cfd50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.008490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:23.008506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2039
2025-10-02T08:14:23.008627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.008664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:23.008673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:23.008676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:23.009041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2039 sessionId:  describe result for acl check
2025-10-02T08:14:23.009069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:23.009078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:23.009080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:23.009084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534808799962846:4491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:23.009535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534808799962846:4491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:23.010203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:23.010802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:23.010945Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:23.010953Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:23.010962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:23.011000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:23.011039Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534808799962882:4485]
2025-10-02T08:14:23.011353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534808799962846:4491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:23.011619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:23.011778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:23.011820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:23.012129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:23.012183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.012188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.012189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.012190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.012191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.012196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.012211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.012214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.012217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.012220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.012225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.012231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.012238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.012242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.012246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.012251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.012254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.012258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.012261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.012266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.012284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:23.016920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534808799962846:4491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:23.016933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534808799962846:4491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:23.016937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534808799962846:4491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:23.016945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:23.019955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:23.021435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:23.021449Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:23.021452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:23.021456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:23.021461Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2038 [1:7556534808799962882:4485]
2025-10-02T08:14:23.021472Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:23.021488Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:23.021492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.021494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.021496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.021511Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:23.021522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:23.021528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:23.021588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.021594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.021597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:23.021599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:23.021660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:23.021666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.021679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.021695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:23.021715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799962910:4491], now have 1 active actors on pipe
2025-10-02T08:14:23.021721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2038
2025-10-02T08:14:23.021725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534808799962865:4485]
2025-10-02T08:14:23.021729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534808799962865:4485]
2025-10-02T08:14:23.021738Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:23.021749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534809259553784:2378], now have 1 active actors on pipe
2025-10-02T08:14:23.021752Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:23.021755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:23.021765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:23.021777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:23.021780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:23.021787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.021792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.021790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2038
2025-10-02T08:14:23.021828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534808799962865:4485]
2025-10-02T08:14:23.021842Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:23.021862Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:23.021872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.021875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.021877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:23.021885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.021893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:23.021934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.021936Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:23.022023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.022033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.022064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.022103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2039 partition: 0 MaxSeqNo: 17 sessionId: src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0
2025-10-02T08:14:23.022383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df480631-386a7021-68dc11b0-aa4cfd50_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:23.024786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0] Write session: try to update token
2025-10-02T08:14:23.024818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:23.039154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId: src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:23.039630Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:23.039644Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:23.039646Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:23.039654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534808799962865:4485]
2025-10-02T08:14:23.039658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534808799962865:4485]
2025-10-02T08:14:23.039704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:23.039707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:23.039711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.039712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:23.039712Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:23.039864Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:23.041668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:23.102788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534808799962925:3106]
2025-10-02T08:14:23.102908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2038, pipe: [1:7556534808799962925:3106]
2025-10-02T08:14:23.175513Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:23.175760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.175773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.175804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799962925:3106], now have 1 active actors on pipe
2025-10-02T08:14:23.175908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534808799962925:3106]
2025-10-02T08:14:23.175923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:23.175925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:23.175964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2039 reason: error at write: Disconnected sessionId: src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0
2025-10-02T08:14:23.176056Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:23.176105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2039 sessionId: src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0 is DEAD
2025-10-02T08:14:23.176071Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:23.176265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:23.176272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0] Write session will restart in 0.009893s
2025-10-02T08:14:23.176293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0] Write session: Do CDS request
2025-10-02T08:14:23.176306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:23.183901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:23.184350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:23.184498Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:23.184509Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:23.184519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:23.184577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:23.184615Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534808799963155:4507]
2025-10-02T08:14:23.185175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:23.185356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:23.185404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:23.185684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:23.185742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.185747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.185749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.185750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.185751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.185755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.185765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.185769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.185772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.185776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.185781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.185788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.185797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.185802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.185806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.185815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.185819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.185824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.185828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.185832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.185846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:23.187275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.187350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:23.187364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2040
2025-10-02T08:14:23.187463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.187489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:23.187499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:23.187506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:23.187867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2040 sessionId:  describe result for acl check
2025-10-02T08:14:23.187902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:23.187907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:23.187909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:23.187914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534808799963171:4501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:23.188391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534808799963171:4501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:23.190347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534808799963171:4501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:23.192968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534808799963171:4501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:23.192981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534808799963171:4501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:23.192985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534808799963171:4501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:23.192993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:23.193576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:23.195107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:23.195123Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:23.195126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:23.195129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:23.195135Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2039 [1:7556534808799963155:4507]
2025-10-02T08:14:23.195145Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:23.195160Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:23.195167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.195170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.195172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.195191Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:23.195200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:23.195210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:23.195266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.195273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.195276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:23.195278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:23.195338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:23.195345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.195357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.195375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:23.195382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2039
2025-10-02T08:14:23.195398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799963203:4501], now have 1 active actors on pipe
2025-10-02T08:14:23.195410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534809259553792:2378], now have 1 active actors on pipe
2025-10-02T08:14:23.195414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.195418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.195435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534808799963149:4507]
2025-10-02T08:14:23.195447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534808799963149:4507]
2025-10-02T08:14:23.195462Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:23.195474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:23.195475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:23.195477Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:23.195488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:23.195490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:23.195504Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:23.195475Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2039
2025-10-02T08:14:23.195510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.195518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.195520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:23.195529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.195541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:23.195572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534808799963149:4507]
2025-10-02T08:14:23.195586Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:23.195605Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:23.195606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.195654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.195665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.195687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.195725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2040 partition: 0 MaxSeqNo: 17 sessionId: src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0
2025-10-02T08:14:23.196026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546f0b44-1785c635-6da2eed7-515d2dfa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:23.198494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0] Write session: try to update token
2025-10-02T08:14:23.198507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:23.211963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId: src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:23.213207Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:23.213223Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:23.213225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:23.213235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534808799963149:4507]
2025-10-02T08:14:23.213239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534808799963149:4507]
2025-10-02T08:14:23.213280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:23.213286Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:23.213291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.213292Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:23.213293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:23.213431Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:23.214583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:23.275839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534808799963217:3106]
2025-10-02T08:14:23.276013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2039, pipe: [1:7556534808799963217:3106]
2025-10-02T08:14:23.358332Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:23.358762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.358777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.358815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799963217:3106], now have 1 active actors on pipe
2025-10-02T08:14:23.358968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534808799963217:3106]
2025-10-02T08:14:23.359090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:23.359376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:23.359386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0] Write session will restart in 0.008282s
2025-10-02T08:14:23.359407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0] Write session: Do CDS request
2025-10-02T08:14:23.359413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:23.358999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:23.359006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:23.359012Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:23.359065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2040 reason: error at write: Disconnected sessionId: src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0
2025-10-02T08:14:23.359229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2040 sessionId: src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0 is DEAD
2025-10-02T08:14:23.369277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.369335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:23.369350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2041
2025-10-02T08:14:23.369468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.369501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:23.369512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:23.369528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:23.369952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2041 sessionId:  describe result for acl check
2025-10-02T08:14:23.369982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:23.369988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:23.369990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:23.369996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534808799963446:4555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:23.370077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:23.370509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534808799963446:4555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:23.370806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:23.370952Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:23.370961Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:23.370969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:23.371009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:23.371046Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534808799963458:4528]
2025-10-02T08:14:23.371672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:23.371847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:23.371898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:23.372261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:23.372312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.372317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.372319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.372320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.372321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.372326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.372337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.372341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.372345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.372348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.372352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.372359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.372369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.372374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.372379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.372385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.372393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.372398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.372402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.372411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.372432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:23.372606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534808799963446:4555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:23.378436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534808799963446:4555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:23.378450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534808799963446:4555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:23.378465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534808799963446:4555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:23.378479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:23.380554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:23.382125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:23.382142Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:23.382144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:23.382149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:23.382155Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2040 [1:7556534808799963458:4528]
2025-10-02T08:14:23.382166Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:23.382181Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:23.382184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.382188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.382190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.382204Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:23.382209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:23.382217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:23.382277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.382285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.382288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:23.382290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:23.382354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:23.382361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.382374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.382387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:23.382407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534808799963447:4528]
2025-10-02T08:14:23.382417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534808799963447:4528]
2025-10-02T08:14:23.382424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:23.382437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799963498:4555], now have 1 active actors on pipe
2025-10-02T08:14:23.382444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:23.382457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:23.382460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:23.382465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534809259553799:2378], now have 1 active actors on pipe
2025-10-02T08:14:23.382493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534808799963447:4528]
2025-10-02T08:14:23.382499Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:23.382542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2040
2025-10-02T08:14:23.382557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:23.382561Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:23.382567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:23.382634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.382649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.382676Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a888bff4-71237ab1-e5e74107-6e972db2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:23.382687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.382692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.382699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:23.382709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.382721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:23.382743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.382850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.382858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.382878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.382912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2041 partition: 0 MaxSeqNo: 17 sessionId: src_id|a888bff4-71237ab1-e5e74107-6e972db2_0
2025-10-02T08:14:23.383228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7af9487-23a9a405-eb029fc0-1c2c49c2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a888bff4-71237ab1-e5e74107-6e972db2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:23.385878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a888bff4-71237ab1-e5e74107-6e972db2_0] Write session: try to update token
2025-10-02T08:14:23.385918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a888bff4-71237ab1-e5e74107-6e972db2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:23.386076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2040
2025-10-02T08:14:23.402049Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:23.402069Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:23.402071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:23.402080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534808799963447:4528]
2025-10-02T08:14:23.402084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534808799963447:4528]
2025-10-02T08:14:23.402125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:23.402129Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:23.402131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.402133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:23.402134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:23.402267Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:23.405239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId: src_id|a888bff4-71237ab1-e5e74107-6e972db2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:23.407719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:23.459114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534808799963514:3106]
2025-10-02T08:14:23.459252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2040, pipe: [1:7556534808799963514:3106]
2025-10-02T08:14:23.544845Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:23.545175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.545186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.545222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799963514:3106], now have 1 active actors on pipe
2025-10-02T08:14:23.545711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a888bff4-71237ab1-e5e74107-6e972db2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:23.545721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a888bff4-71237ab1-e5e74107-6e972db2_0] Write session will restart in 0.008828s
2025-10-02T08:14:23.545352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534808799963514:3106]
2025-10-02T08:14:23.545368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:23.545370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:23.545745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a888bff4-71237ab1-e5e74107-6e972db2_0] Write session: Do CDS request
2025-10-02T08:14:23.545415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2041 reason: error at write: Disconnected sessionId: src_id|a888bff4-71237ab1-e5e74107-6e972db2_0
2025-10-02T08:14:23.545442Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:23.545751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a888bff4-71237ab1-e5e74107-6e972db2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:23.545566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2041 sessionId: src_id|a888bff4-71237ab1-e5e74107-6e972db2_0 is DEAD
2025-10-02T08:14:23.548882Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:23.554311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:23.555131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:23.555240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a888bff4-71237ab1-e5e74107-6e972db2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.555304Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:23.555310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:23.555313Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:23.555316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2042
2025-10-02T08:14:23.555324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:23.555369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:23.555417Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534808799963748:4558]
2025-10-02T08:14:23.555452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.555492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:23.555502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:23.555505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:23.555847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2042 sessionId:  describe result for acl check
2025-10-02T08:14:23.555879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:23.555885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:23.555886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:23.555891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534808799963753:4560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:23.556061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:23.556231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:23.556271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:23.556380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534808799963753:4560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:23.556574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:23.556621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.556627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.556628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.556629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.556630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.556635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.556644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.556654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.556657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.556661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.556666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.556673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.556679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.556684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.556689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.556698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.556706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.556711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.556720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.556728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.556746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:23.558250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534808799963753:4560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:23.562593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534808799963753:4560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:23.562605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534808799963753:4560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:23.562608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534808799963753:4560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:23.562616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:23.564495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:23.565966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:23.565981Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:23.565983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:23.565986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:23.565993Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2041 [1:7556534808799963748:4558]
2025-10-02T08:14:23.566004Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:23.566019Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:23.566022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.566024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.566026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.566040Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:23.566043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:23.566048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:23.566100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.566107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.566109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:23.566112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:23.566170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:23.566176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.566186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.566195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:23.566214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534808799963742:4558]
2025-10-02T08:14:23.566220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534808799963742:4558]
2025-10-02T08:14:23.566226Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:23.566239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799963797:4560], now have 1 active actors on pipe
2025-10-02T08:14:23.566242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:23.566245Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:23.566248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:23.566248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2041
2025-10-02T08:14:23.566260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:23.566262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:23.566268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534809259553805:2378], now have 1 active actors on pipe
2025-10-02T08:14:23.566295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.566300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.566316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534808799963742:4558]
2025-10-02T08:14:23.566330Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:23.566337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:23.566356Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:23.566364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.566367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.566368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:23.566375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.566386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:23.566356Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2041
2025-10-02T08:14:23.566413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.566451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.566456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.566468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.566495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2042 partition: 0 MaxSeqNo: 17 sessionId: src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0
2025-10-02T08:14:23.566774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a888bff4-71237ab1-e5e74107-6e972db2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:23.569327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0] Write session: try to update token
2025-10-02T08:14:23.569344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:23.583706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId: src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:23.586191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:23.586827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.586849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.586868Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:23.586875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:23.586877Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:23.586884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534808799963742:4558]
2025-10-02T08:14:23.586892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534808799963742:4558]
2025-10-02T08:14:23.586931Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:23.586938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:23.586943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:23.586945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.586947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:23.587088Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:23.645482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534808799963811:3106]
2025-10-02T08:14:23.645610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2041, pipe: [1:7556534808799963811:3106]
2025-10-02T08:14:23.730874Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:23.731257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:23.731291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:23.731298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799963811:3106], now have 1 active actors on pipe
2025-10-02T08:14:23.731427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:23.731438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:23.731458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2042 reason: error at write: Disconnected sessionId: src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0
2025-10-02T08:14:23.731502Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:23.731585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2042 sessionId: src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0 is DEAD
2025-10-02T08:14:23.731708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:23.731717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0] Write session will restart in 0.007175s
2025-10-02T08:14:23.731734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0] Write session: Do CDS request
2025-10-02T08:14:23.731738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:23.731722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534808799963811:3106]
2025-10-02T08:14:23.740328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.740363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:23.740380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2043
2025-10-02T08:14:23.740513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.740542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:23.740551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:23.740555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:23.740956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2043 sessionId:  describe result for acl check
2025-10-02T08:14:23.740989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:23.740992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:23.740994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:23.740999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534808799964058:4598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:23.741052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:23.741465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534808799964058:4598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:23.741726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:23.741907Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:23.741916Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:23.741926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:23.741973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:23.742008Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534808799964069:4568]
2025-10-02T08:14:23.742607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:23.742830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:23.742868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:23.743153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:23.743197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.743203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.743204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.743205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.743207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.743212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.743222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.743226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.743231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.743235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.743240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.743249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.743258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.743264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.743273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.743278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.743287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.743294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.743302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.743307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.743327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:23.743589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534808799964058:4598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:23.748945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534808799964058:4598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:23.748959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534808799964058:4598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:23.748962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534808799964058:4598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:23.748969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:23.751526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:23.753029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:23.753048Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:23.753052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:23.753056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:23.753062Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2042 [1:7556534808799964069:4568]
2025-10-02T08:14:23.753073Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:23.753088Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:23.753090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.753092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.753094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.753108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:23.753113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:23.753118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:23.753175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.753183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.753186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:23.753188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:23.753245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:23.753253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.753266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.753278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:23.753292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2042
2025-10-02T08:14:23.753296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799964110:4598], now have 1 active actors on pipe
2025-10-02T08:14:23.753299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534809259553825:2378], now have 1 active actors on pipe
2025-10-02T08:14:23.753304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534808799964057:4568]
2025-10-02T08:14:23.753306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534808799964057:4568]
2025-10-02T08:14:23.753317Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:23.753328Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:23.753333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.753335Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:23.753337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.753353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:23.753366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:23.753372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:23.753361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2042
2025-10-02T08:14:23.753408Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:23.753418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.753423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.753425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:23.753433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.753444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:23.753454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534808799964057:4568]
2025-10-02T08:14:23.753462Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:23.753487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:23.753497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.753576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.753583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.753597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.753631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2043 partition: 0 MaxSeqNo: 17 sessionId: src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0
2025-10-02T08:14:23.753997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bb62775-6044fbb7-a3c3d1a2-68aa9b34_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:23.757228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0] Write session: try to update token
2025-10-02T08:14:23.757251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:23.763797Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:23.763814Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:23.763824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534808799964057:4568]
2025-10-02T08:14:23.763868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:23.763869Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:23.764043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:23.764195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:23.764351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:23.764495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:23.764696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:23.764737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:23.774303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId: src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:23.777217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:23.777282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.777293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.777340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:23.777370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:23.777448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.777454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.777650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.777723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.777794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.777871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.777928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.777937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.778018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.778091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.778165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.778253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.778309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.778316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.778396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.778464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.778530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.778600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.778650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.778658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.778733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.778803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.778877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.778953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.779008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.779016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.779097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.779167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.779239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.779314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.779369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.779380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.779458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.779528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.779600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.779676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.779732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.779739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.779823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.779897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.779975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.780053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.780109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.780116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.780192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.780270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.780536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.780612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.780666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.780669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.780748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.780844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.780909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.780990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.781045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.781052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.781129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:23.781198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:23.781275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:23.781343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:23.781397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:23.781404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:23.781476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:23.781562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.781586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.781593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:23.781636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:23.781657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:23.781665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:23.781668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:23.781670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:23.782112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:23.782146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:23.782153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:23.782160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:23.782163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:23.782167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:23.782863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:23.782890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:23.782896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:23.782899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:23.782902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:23.782905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:23.783445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:23.783468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:23.783476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:23.783481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:23.783484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:23.784989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:23.785011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:23.785025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392863784
2025-10-02T08:14:23.785235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:23.785257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:23.785264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:23.785267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:23.785275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:23.785278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:23.785853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:23.785885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:23.785891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:23.785897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:23.785901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:23.785905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:23.786486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:23.786515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:23.786526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:23.786529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:23.786532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:23.786535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:23.787104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:23.787133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:23.787144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:23.788530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:23.788553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:23.788559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:23.788563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:23.788573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392863788
2025-10-02T08:14:23.788947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:23.788972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:23.788979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:23.788983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:23.788987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:23.788990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:23.789534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:23.789561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:23.789569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:23.789576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:23.789580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:23.789587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:23.790131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:23.790160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.790271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392863789
2025-10-02T08:14:23.792997Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:23.793021Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:23.793027Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:23.793032Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:23.793042Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:23.793044Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:23.793045Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:23.793055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534808799964057:4568]
2025-10-02T08:14:23.793058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534808799964057:4568]
2025-10-02T08:14:23.793119Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:23.793133Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:23.793156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:23.793166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.793169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:23.793313Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:23.831900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534808799964127:3106]
2025-10-02T08:14:23.831968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2042, pipe: [1:7556534808799964127:3106]
2025-10-02T08:14:23.936530Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:23.936988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799964127:3106], now have 1 active actors on pipe
2025-10-02T08:14:23.937123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:23.937133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:23.937156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2043 reason: error at write: Disconnected sessionId: src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0
2025-10-02T08:14:23.937203Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:23.937238Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:23.937313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2043 sessionId: src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0 is DEAD
2025-10-02T08:14:23.937448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534808799964127:3106]
2025-10-02T08:14:23.937466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:23.937475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0] Write session will restart in 0.009755s
2025-10-02T08:14:23.937498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0] Write session: Do CDS request
2025-10-02T08:14:23.937503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:23.941561Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6c1a8742b8fed7bf] Result# TEvPutResult {Id# [72075186224037892:2042:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:23.941571Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2042:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:23.941642Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2042:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:23.948352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.948505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:23.948527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2044
2025-10-02T08:14:23.948687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:23.948693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:23.948712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:23.948723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:23.948726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:23.949070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2044 sessionId:  describe result for acl check
2025-10-02T08:14:23.949103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:23.949111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:23.949112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:23.949117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534808799964409:4681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:23.949371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:23.949516Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:23.949524Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:23.949530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:23.949564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:23.949603Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534808799964412:4661]
2025-10-02T08:14:23.949610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534808799964409:4681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:23.949983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:23.950109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:23.950134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:23.950402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:23.950449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.950450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.950450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.950451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.950451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.950454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.950460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.950462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.950464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.950465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.950469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.950473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:23.950476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.950481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:23.950483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.950485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:23.950487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.950490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.950492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.950494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.950505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:23.951637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534808799964409:4681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:23.957413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534808799964409:4681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:23.957428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534808799964409:4681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:23.957431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534808799964409:4681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:23.957439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:23.958094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:23.959617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:23.959630Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:23.959632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:23.959635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:23.959639Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2043 [1:7556534808799964412:4661]
2025-10-02T08:14:23.959657Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:23.959668Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:23.959670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.959672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.959673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.959683Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:23.959687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:23.959692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:23.959736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.959743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.959745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:23.959747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:23.959792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:23.959799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.959806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:23.959813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:23.959825Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534808799964403:4661]
2025-10-02T08:14:23.959826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534808799964403:4661]
2025-10-02T08:14:23.959831Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:23.959840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:23.959850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:23.959852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:23.959862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2043
2025-10-02T08:14:23.959862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534808799964453:4681], now have 1 active actors on pipe
2025-10-02T08:14:23.959867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:23.959869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:23.959890Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534808799964403:4661]
2025-10-02T08:14:23.959896Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:23.959900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534809259553857:2378], now have 1 active actors on pipe
2025-10-02T08:14:23.959915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:23.959917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.959920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.959941Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:23.959951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:23.959954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:23.959956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:23.959963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:23.959974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:23.959987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.959966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2043
2025-10-02T08:14:23.960021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:23.960032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:23.960053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:23.960089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2044 partition: 0 MaxSeqNo: 17 sessionId: src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0
2025-10-02T08:14:23.960524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ff5b2a-e943e437-2449d05a-847e71e1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:23.963526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0] Write session: try to update token
2025-10-02T08:14:23.963552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:23.976852Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:23.976869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:23.976870Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:23.976878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534808799964403:4661]
2025-10-02T08:14:23.976882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534808799964403:4661]
2025-10-02T08:14:23.976916Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:23.976921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:23.976921Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:23.976928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:23.976930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:23.977066Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:23.989179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId: src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:23.991633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:24.037704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534813094931766:3106]
2025-10-02T08:14:24.037824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2043, pipe: [1:7556534813094931766:3106]
2025-10-02T08:14:24.108089Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:24.108444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.108454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.108473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094931766:3106], now have 1 active actors on pipe
2025-10-02T08:14:24.108548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534813094931766:3106]
2025-10-02T08:14:24.108571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:24.108572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:24.108620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2044 reason: error at write: Disconnected sessionId: src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0
2025-10-02T08:14:24.108677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:24.108699Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:24.108755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2044 sessionId: src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0 is DEAD
2025-10-02T08:14:24.108909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:24.108922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0] Write session will restart in 0.009952s
2025-10-02T08:14:24.108945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0] Write session: Do CDS request
2025-10-02T08:14:24.108950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:24.116443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:24.117212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:24.117360Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:24.117369Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:24.117378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:24.117413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:24.117443Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534813094932006:4665]
2025-10-02T08:14:24.117964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:24.118145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:24.118178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:24.118426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:24.118464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.118469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.118470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.118471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.118472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.118475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.118483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.118486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.118489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.118492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.118496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.118502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.118507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.118511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.118514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.118518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.118521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.118525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.118528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.118532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.118546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:24.120436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.120580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:24.120594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2045
2025-10-02T08:14:24.120789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.120834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:24.120843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:24.120847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:24.121243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2045 sessionId:  describe result for acl check
2025-10-02T08:14:24.121277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:24.121283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:24.121284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:24.121288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534813094932022:4679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:24.121758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534813094932022:4679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:24.123597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534813094932022:4679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:24.126006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534813094932022:4679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:24.126020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534813094932022:4679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:24.126024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534813094932022:4679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:24.126037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:24.126435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:24.128016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:24.128043Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:24.128046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:24.128049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:24.128055Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2044 [1:7556534813094932006:4665]
2025-10-02T08:14:24.128065Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:24.128079Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:24.128085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.128088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.128090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.128104Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:24.128117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:24.128123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:24.128175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.128182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.128184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:24.128186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:24.128251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:24.128258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.128270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.128279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:24.128363Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2044
2025-10-02T08:14:24.128948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f10dae76-87da7953-a71ff7d2-f9d7b7ac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32b67cab-3dccba7d-f33df583-f5047075_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:24.128299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094932053:4679], now have 1 active actors on pipe
2025-10-02T08:14:24.128306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534813554521160:2378], now have 1 active actors on pipe
2025-10-02T08:14:24.128311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534813094932000:4665]
2025-10-02T08:14:24.128313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534813094932000:4665]
2025-10-02T08:14:24.128318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:24.128322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2044
2025-10-02T08:14:24.128329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:24.128329Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:24.128331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:24.128341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:24.128343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:24.128350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.128354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.128391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534813094932000:4665]
2025-10-02T08:14:24.128396Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:24.128403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:24.128410Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32b67cab-3dccba7d-f33df583-f5047075_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:24.128415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.128419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.128421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:24.128431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.128439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:24.128476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.128543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.128546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.128560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.128593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2045 partition: 0 MaxSeqNo: 17 sessionId: src_id|32b67cab-3dccba7d-f33df583-f5047075_0
2025-10-02T08:14:24.132155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32b67cab-3dccba7d-f33df583-f5047075_0] Write session: try to update token
2025-10-02T08:14:24.132176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32b67cab-3dccba7d-f33df583-f5047075_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:24.144776Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:24.144795Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:24.144796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:24.144845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534813094932000:4665]
2025-10-02T08:14:24.144848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534813094932000:4665]
2025-10-02T08:14:24.144881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:24.144889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:24.144892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.144895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:24.144895Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:24.145017Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:24.150615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId: src_id|32b67cab-3dccba7d-f33df583-f5047075_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:24.153182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:24.208724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534813094932068:3106]
2025-10-02T08:14:24.208898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2044, pipe: [1:7556534813094932068:3106]
2025-10-02T08:14:24.274711Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:24.275017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.275031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.275049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094932068:3106], now have 1 active actors on pipe
2025-10-02T08:14:24.275268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:24.276066Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:24.276392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534813094932068:3106]
2025-10-02T08:14:24.276416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:24.276459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2045 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32b67cab-3dccba7d-f33df583-f5047075_0
2025-10-02T08:14:24.276601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2045 sessionId: src_id|32b67cab-3dccba7d-f33df583-f5047075_0 is DEAD
2025-10-02T08:14:24.276820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b67cab-3dccba7d-f33df583-f5047075_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:24.276829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b67cab-3dccba7d-f33df583-f5047075_0] Write session will restart in 0.009258s
2025-10-02T08:14:24.276854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b67cab-3dccba7d-f33df583-f5047075_0] Write session: Do CDS request
2025-10-02T08:14:24.276860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b67cab-3dccba7d-f33df583-f5047075_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:24.286380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:24.287269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32b67cab-3dccba7d-f33df583-f5047075_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.287301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:24.287354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:24.287359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2046
2025-10-02T08:14:24.287443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.287465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:24.287470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:24.287472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:24.287488Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:24.287491Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:24.287500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:24.287546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:24.287576Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534813094932310:4671]
2025-10-02T08:14:24.287821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2046 sessionId:  describe result for acl check
2025-10-02T08:14:24.287842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:24.287843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:24.287845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:24.287849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534813094932314:4678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:24.288183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:24.288308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534813094932314:4678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:24.288362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:24.288388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:24.288646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:24.288685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.288689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.288690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.288690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.288691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.288695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.288700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.288702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.288704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.288706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.288709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.288714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.288718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.288720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.288723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.288725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.288728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.288730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.288732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.288735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.288745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:24.290336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534813094932314:4678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:24.296059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534813094932314:4678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:24.296074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534813094932314:4678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:24.296079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534813094932314:4678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:24.296088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:24.296559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:24.298357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:24.298373Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:24.298376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:24.298379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:24.298386Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2045 [1:7556534813094932310:4671]
2025-10-02T08:14:24.298397Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:24.298414Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:24.298418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.298421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.298423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.298440Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:24.298448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:24.298455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:24.298528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.298534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.298538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:24.298541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:24.298600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:24.298611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.298625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.298636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:24.298654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094932356:4678], now have 1 active actors on pipe
2025-10-02T08:14:24.298664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534813094932302:4671]
2025-10-02T08:14:24.298664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2045
2025-10-02T08:14:24.298666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534813094932302:4671]
2025-10-02T08:14:24.298673Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:24.298681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534813554521168:2378], now have 1 active actors on pipe
2025-10-02T08:14:24.298685Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:24.298688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:24.298688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:24.298700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:24.298704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:24.298710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.298719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.298737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2045
2025-10-02T08:14:24.298759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534813094932302:4671]
2025-10-02T08:14:24.298770Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:24.298778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:24.298785Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c26553d7-9633c565-ccc032be-1312d3e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:24.298792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.298795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.298797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:24.298806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.298814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:24.298852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.298946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.298964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.298990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.299032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2046 partition: 0 MaxSeqNo: 17 sessionId: src_id|c26553d7-9633c565-ccc032be-1312d3e0_0
2025-10-02T08:14:24.299364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32b67cab-3dccba7d-f33df583-f5047075_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c26553d7-9633c565-ccc032be-1312d3e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:24.302215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26553d7-9633c565-ccc032be-1312d3e0_0] Write session: try to update token
2025-10-02T08:14:24.302235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26553d7-9633c565-ccc032be-1312d3e0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:24.316380Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:24.316395Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:24.316397Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:24.316406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534813094932302:4671]
2025-10-02T08:14:24.316411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534813094932302:4671]
2025-10-02T08:14:24.316447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:24.316453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.316452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:24.316455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:24.316458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:24.316586Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:24.319660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId: src_id|c26553d7-9633c565-ccc032be-1312d3e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:24.322331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:24.376673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534813094932371:3106]
2025-10-02T08:14:24.376823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2045, pipe: [1:7556534813094932371:3106]
2025-10-02T08:14:24.451522Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:24.451757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.451769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.451801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094932371:3106], now have 1 active actors on pipe
2025-10-02T08:14:24.451939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:24.451949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:24.452003Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:24.452027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2046 reason: error at write: Disconnected sessionId: src_id|c26553d7-9633c565-ccc032be-1312d3e0_0
2025-10-02T08:14:24.452170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2046 sessionId: src_id|c26553d7-9633c565-ccc032be-1312d3e0_0 is DEAD
2025-10-02T08:14:24.452278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534813094932371:3106]
2025-10-02T08:14:24.452327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26553d7-9633c565-ccc032be-1312d3e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:24.452337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26553d7-9633c565-ccc032be-1312d3e0_0] Write session will restart in 0.009280s
2025-10-02T08:14:24.452360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26553d7-9633c565-ccc032be-1312d3e0_0] Write session: Do CDS request
2025-10-02T08:14:24.452369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26553d7-9633c565-ccc032be-1312d3e0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:24.451986Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:24.461945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:24.462607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:24.462824Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:24.462840Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:24.462854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:24.462926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:24.462969Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534813094932623:4730]
2025-10-02T08:14:24.463270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26553d7-9633c565-ccc032be-1312d3e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.463330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:24.463340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2047
2025-10-02T08:14:24.463456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.463476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:24.463483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:24.463485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:24.463530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:24.463686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:24.463722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:24.463848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2047 sessionId:  describe result for acl check
2025-10-02T08:14:24.463878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:24.463883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:24.463884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:24.463889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534813094932634:4738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:24.463928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:24.463960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.463964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.463965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.463965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.463966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.463969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.463975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.463977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.463979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.463981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.463984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.463989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.463993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.463995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.463997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.464000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.464003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.464005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.464008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.464010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.464021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:24.464402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534813094932634:4738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:24.466664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534813094932634:4738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:24.471534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534813094932634:4738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:24.471551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534813094932634:4738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:24.471556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534813094932634:4738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:24.471565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:24.472545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:24.474129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:24.474145Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:24.474148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:24.474151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:24.474157Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2046 [1:7556534813094932623:4730]
2025-10-02T08:14:24.474170Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:24.474186Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:24.474189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.474192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.474195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.474211Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:24.474220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:24.474231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:24.474294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.474302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.474304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:24.474306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:24.474367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:24.474374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.474386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.474400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:24.474418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534813094932617:4730]
2025-10-02T08:14:24.474419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534813094932617:4730]
2025-10-02T08:14:24.474431Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:24.474446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:24.474463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:24.474468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:24.474499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534813094932617:4730]
2025-10-02T08:14:24.474505Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:24.474579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:24.474585Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:24.474591Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:24.474722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2046
2025-10-02T08:14:24.474738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094932671:4738], now have 1 active actors on pipe
2025-10-02T08:14:24.474743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534813554521175:2378], now have 1 active actors on pipe
2025-10-02T08:14:24.474748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.474753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.474778Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:24.474786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.474789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.474791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:24.474809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.474820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:24.474835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.474981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2046
2025-10-02T08:14:24.474991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.474997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.475009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.475037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2047 partition: 0 MaxSeqNo: 17 sessionId: src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0
2025-10-02T08:14:24.475383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26553d7-9633c565-ccc032be-1312d3e0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:24.478159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0] Write session: try to update token
2025-10-02T08:14:24.478173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:24.492650Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:24.492669Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:24.492672Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:24.492680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534813094932617:4730]
2025-10-02T08:14:24.492686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534813094932617:4730]
2025-10-02T08:14:24.492725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:24.492730Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:24.492732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.492734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:24.492736Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:24.492883Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:24.493140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId: src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:24.495370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:24.551757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534813094932688:3106]
2025-10-02T08:14:24.551860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2046, pipe: [1:7556534813094932688:3106]
2025-10-02T08:14:24.633245Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:24.633430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.633441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.633469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094932688:3106], now have 1 active actors on pipe
2025-10-02T08:14:24.633565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534813094932688:3106]
2025-10-02T08:14:24.633586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:24.633597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:24.633664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2047 reason: error at write: Disconnected sessionId: src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0
2025-10-02T08:14:24.633660Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:24.633714Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:24.633970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:24.633827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2047 sessionId: src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0 is DEAD
2025-10-02T08:14:24.633980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0] Write session will restart in 0.005502s
2025-10-02T08:14:24.634007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0] Write session: Do CDS request
2025-10-02T08:14:24.634013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:24.640285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.640340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:24.640352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2048
2025-10-02T08:14:24.640487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.640525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:24.640534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:24.640538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:24.640951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2048 sessionId:  describe result for acl check
2025-10-02T08:14:24.640980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:24.640985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:24.640988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:24.640991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534813094932918:4728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:24.641350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534813094932918:4728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:24.642337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:24.642793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:24.642959Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:24.642967Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:24.642977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:24.643023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:24.643055Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534813094932954:4733]
2025-10-02T08:14:24.643200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534813094932918:4728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:24.643579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:24.643760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:24.643798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:24.644051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:24.644089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.644094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.644094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.644095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.644096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.644100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.644108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.644111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.644115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.644118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.644122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.644128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.644133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.644137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.644145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.644149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.644153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.644157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.644160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.644164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.644181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:24.648691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534813094932918:4728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:24.648705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534813094932918:4728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:24.648709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534813094932918:4728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:24.648716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:24.652120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:24.653814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:24.653827Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:24.653829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:24.653832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:24.653836Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2047 [1:7556534813094932954:4733]
2025-10-02T08:14:24.653845Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:24.653859Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:24.653861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.653863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.653864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.653877Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:24.653880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:24.653887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:24.653935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.653941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.653943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:24.653945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:24.654008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:24.654016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.654029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.654043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:24.654064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534813094932944:4733]
2025-10-02T08:14:24.654071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534813094932944:4733]
2025-10-02T08:14:24.654078Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:24.654094Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:24.654096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:24.654101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094932982:4728], now have 1 active actors on pipe
2025-10-02T08:14:24.654106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2047
2025-10-02T08:14:24.654109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:24.654120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:24.654123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:24.654128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534813554521193:2378], now have 1 active actors on pipe
2025-10-02T08:14:24.654161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534813094932944:4733]
2025-10-02T08:14:24.654169Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:24.654238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:24.654246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.654251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.654274Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:24.654285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.654293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.654295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:24.654303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.654316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:24.654300Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2047
2025-10-02T08:14:24.654334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.654383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.654388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.654401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.654438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2048 partition: 0 MaxSeqNo: 17 sessionId: src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0
2025-10-02T08:14:24.654740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b5a97a-fd76a390-9bb7c373-ecfe4e67_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:24.657366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0] Write session: try to update token
2025-10-02T08:14:24.657384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:24.671011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId: src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:24.671169Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:24.671187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:24.671190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:24.671199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534813094932944:4733]
2025-10-02T08:14:24.671211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534813094932944:4733]
2025-10-02T08:14:24.671257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:24.671269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.671276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:24.671348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:24.671359Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:24.671456Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:24.673576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:24.733503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534813094933011:3106]
2025-10-02T08:14:24.733600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2047, pipe: [1:7556534813094933011:3106]
2025-10-02T08:14:24.802802Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:24.803058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.803071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.803111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094933011:3106], now have 1 active actors on pipe
2025-10-02T08:14:24.803232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534813094933011:3106]
2025-10-02T08:14:24.803265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:24.803272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:24.803340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2048 reason: error at write: Disconnected sessionId: src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0
2025-10-02T08:14:24.803342Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:24.803500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2048 sessionId: src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0 is DEAD
2025-10-02T08:14:24.803554Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:24.803646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:24.803657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0] Write session will restart in 0.005235s
2025-10-02T08:14:24.803682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0] Write session: Do CDS request
2025-10-02T08:14:24.803687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:24.810268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.810362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:24.810375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2049
2025-10-02T08:14:24.810505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.810543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:24.810563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:24.810574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:24.811031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2049 sessionId:  describe result for acl check
2025-10-02T08:14:24.811064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:24.811070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:24.811071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:24.811076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534813094933241:4761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:24.811567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534813094933241:4761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:24.812586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:24.813323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:24.813485Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:24.813497Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:24.813506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:24.813559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:24.813598Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534813094933281:4753]
2025-10-02T08:14:24.813898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534813094933241:4761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:24.814193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:24.814360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:24.814404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:24.814624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:24.814654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.814658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.814659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.814659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.814660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.814663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.814669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.814671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.814673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.814675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.814679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.814683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.814687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.814690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.814692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.814695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.814697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.814700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.814703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.814706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.814716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:24.820644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534813094933241:4761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:24.820659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534813094933241:4761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:24.820662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534813094933241:4761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:24.820669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:24.822374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:24.823732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:24.823745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:24.823747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:24.823750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:24.823755Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2048 [1:7556534813094933281:4753]
2025-10-02T08:14:24.823762Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:24.823774Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:24.823776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.823778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.823780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.823791Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:24.823794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:24.823799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:24.823859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.823864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.823867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:24.823868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:24.823913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:24.823918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.823927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.823933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:24.823949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094933309:4761], now have 1 active actors on pipe
2025-10-02T08:14:24.823957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534813094933264:4753]
2025-10-02T08:14:24.823956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2048
2025-10-02T08:14:24.823958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534813094933264:4753]
2025-10-02T08:14:24.823964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:24.823972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:24.823975Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:24.823978Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:24.823984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:24.823987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:24.823992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.823995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.824005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534813554521202:2378], now have 1 active actors on pipe
2025-10-02T08:14:24.824025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534813094933264:4753]
2025-10-02T08:14:24.824032Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:24.824037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:24.824045Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25f0b2-b0ecdd13-e32db006-913d6294_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:24.824050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:24.824053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:24.824054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:24.824060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:24.824067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:24.824093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.824068Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2048
2025-10-02T08:14:24.824144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.824151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.824161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:24.824477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f458623-5cfa730a-d67e9f7c-784c474e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25f0b2-b0ecdd13-e32db006-913d6294_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:24.824191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2049 partition: 0 MaxSeqNo: 17 sessionId: src_id|25f0b2-b0ecdd13-e32db006-913d6294_0
2025-10-02T08:14:24.826857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f0b2-b0ecdd13-e32db006-913d6294_0] Write session: try to update token
2025-10-02T08:14:24.826871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f0b2-b0ecdd13-e32db006-913d6294_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:24.839288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId: src_id|25f0b2-b0ecdd13-e32db006-913d6294_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:24.840692Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:24.840705Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:24.840708Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:24.840784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534813094933264:4753]
2025-10-02T08:14:24.840795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534813094933264:4753]
2025-10-02T08:14:24.840860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:24.840864Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:24.840870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:24.840870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.840872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:24.841015Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:24.841846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:24.933515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534813094933337:3106]
2025-10-02T08:14:24.935833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2048, pipe: [1:7556534813094933337:3106]
2025-10-02T08:14:24.978629Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:24.978952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:24.978965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:24.979007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094933337:3106], now have 1 active actors on pipe
2025-10-02T08:14:24.979169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:24.979186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:24.979212Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:24.979210Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:24.979294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2049 reason: error at write: Disconnected sessionId: src_id|25f0b2-b0ecdd13-e32db006-913d6294_0
2025-10-02T08:14:24.979515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534813094933337:3106]
2025-10-02T08:14:24.979531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2049 sessionId: src_id|25f0b2-b0ecdd13-e32db006-913d6294_0 is DEAD
2025-10-02T08:14:24.979707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f0b2-b0ecdd13-e32db006-913d6294_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:24.979719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f0b2-b0ecdd13-e32db006-913d6294_0] Write session will restart in 0.008894s
2025-10-02T08:14:24.979749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f0b2-b0ecdd13-e32db006-913d6294_0] Write session: Do CDS request
2025-10-02T08:14:24.979757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f0b2-b0ecdd13-e32db006-913d6294_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:24.990254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f0b2-b0ecdd13-e32db006-913d6294_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.990302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:24.990315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2050
2025-10-02T08:14:24.990519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:24.990548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:24.990557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:24.990560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:24.990939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2050 sessionId:  describe result for acl check
2025-10-02T08:14:24.990974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:24.990980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:24.990982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:24.990987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534813094933607:4896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:24.991115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:24.991451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:24.991451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534813094933607:4896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:24.991632Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:24.991641Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:24.991650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:24.991698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:24.991732Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534813094933617:4873]
2025-10-02T08:14:24.992333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:24.992467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:24.992495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:24.992738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:24.992775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.992780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.992781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.992782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.992782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.992786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.992791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.992793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.992795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.992798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.992826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.992831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:24.992834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.992837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:24.992840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.992843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:24.992846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.992849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:24.992851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.992853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:24.992864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:24.993217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534813094933607:4896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:24.999672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534813094933607:4896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:24.999701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534813094933607:4896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:24.999705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534813094933607:4896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:24.999713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:25.000649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:25.002117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:25.002135Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:25.002137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:25.002139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:25.002143Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2049 [1:7556534813094933617:4873]
2025-10-02T08:14:25.002153Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:25.002166Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:25.002167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.002169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.002170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.002181Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:25.002188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:25.002193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:25.002239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.002248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.002251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:25.002252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:25.002315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:25.002321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.002331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.002337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:25.002349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534813094933608:4873]
2025-10-02T08:14:25.002354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534813094933608:4873]
2025-10-02T08:14:25.002359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:25.002368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:25.002376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:25.002381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:25.002384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:25.002387Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:25.002390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534813094933656:4896], now have 1 active actors on pipe
2025-10-02T08:14:25.002393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2049
2025-10-02T08:14:25.002418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534813554521231:2378], now have 1 active actors on pipe
2025-10-02T08:14:25.002425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534813094933608:4873]
2025-10-02T08:14:25.002427Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:25.002522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:25.002537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.002543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.002572Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c95584cc-fa329cae-1bc71932-dad49f95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:25.002582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.002588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.002590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:25.002600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.002583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2049
2025-10-02T08:14:25.002613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:25.002631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.002666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.002672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.002682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.002714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2050 partition: 0 MaxSeqNo: 17 sessionId: src_id|c95584cc-fa329cae-1bc71932-dad49f95_0
2025-10-02T08:14:25.003049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f0b2-b0ecdd13-e32db006-913d6294_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c95584cc-fa329cae-1bc71932-dad49f95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:25.005516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c95584cc-fa329cae-1bc71932-dad49f95_0] Write session: try to update token
2025-10-02T08:14:25.005531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c95584cc-fa329cae-1bc71932-dad49f95_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:25.019148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId: src_id|c95584cc-fa329cae-1bc71932-dad49f95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:25.019595Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:25.019610Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:25.019612Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:25.019620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534813094933608:4873]
2025-10-02T08:14:25.019624Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534813094933608:4873]
2025-10-02T08:14:25.019665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:25.019679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.019685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:25.019772Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:25.019787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:25.019838Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:25.021635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:25.079630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534817389900969:3106]
2025-10-02T08:14:25.079757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2049, pipe: [1:7556534817389900969:3106]
2025-10-02T08:14:25.155020Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:25.155350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.155364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.155403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389900969:3106], now have 1 active actors on pipe
2025-10-02T08:14:25.155556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534817389900969:3106]
2025-10-02T08:14:25.155584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:25.155586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:25.155652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2050 reason: error at write: Disconnected sessionId: src_id|c95584cc-fa329cae-1bc71932-dad49f95_0
2025-10-02T08:14:25.155821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2050 sessionId: src_id|c95584cc-fa329cae-1bc71932-dad49f95_0 is DEAD
2025-10-02T08:14:25.156114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95584cc-fa329cae-1bc71932-dad49f95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:25.156126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95584cc-fa329cae-1bc71932-dad49f95_0] Write session will restart in 0.005997s
2025-10-02T08:14:25.156152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95584cc-fa329cae-1bc71932-dad49f95_0] Write session: Do CDS request
2025-10-02T08:14:25.156170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95584cc-fa329cae-1bc71932-dad49f95_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:25.156098Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:25.156375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:25.163246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c95584cc-fa329cae-1bc71932-dad49f95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.163708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:25.163724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2051
2025-10-02T08:14:25.163897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.163925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:25.163929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:25.163933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:25.164356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2051 sessionId:  describe result for acl check
2025-10-02T08:14:25.164382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:25.164383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:25.164385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:25.164389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534817389901132:4904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:25.164915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534817389901132:4904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:25.167836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534817389901132:4904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:25.173305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:25.173575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:25.173617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534817389901132:4904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:25.173623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534817389901132:4904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:25.173626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534817389901132:4904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:25.173635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:25.173753Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:25.173757Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:25.173767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:25.173812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:25.173845Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534817389901255:4906]
2025-10-02T08:14:25.174478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:25.174707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:25.174752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:25.175055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:25.175090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.175091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.175092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.175093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.175094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.175098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.175109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.175113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.175117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.175121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.175126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.175134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.175139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.175144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.175150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.175155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.175159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.175164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.175169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.175173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.175191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:25.183647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:25.185382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:25.185399Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:25.185402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:25.185406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:25.185412Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2050 [1:7556534817389901255:4906]
2025-10-02T08:14:25.185421Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:25.185438Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:25.185441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.185444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.185446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.185462Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:25.185471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:25.185477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:25.185533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.185540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.185543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:25.185545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:25.185977Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2050
2025-10-02T08:14:25.185608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:25.185614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.185627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.185640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:25.185655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534817389901246:4906]
2025-10-02T08:14:25.185657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534817389901246:4906]
2025-10-02T08:14:25.185664Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:25.185679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:25.185680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2050
2025-10-02T08:14:25.185693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:25.185695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:25.185704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389901254:4904], now have 1 active actors on pipe
2025-10-02T08:14:25.185726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:25.185729Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:25.185733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534817389901246:4906]
2025-10-02T08:14:25.185736Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:25.185748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534817849488534:2378], now have 1 active actors on pipe
2025-10-02T08:14:25.185753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.185756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.185784Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:25.185789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.185798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.185800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:25.185808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.185816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:25.185831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.185906Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:25.186031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.186037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.186069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.186108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2051 partition: 0 MaxSeqNo: 17 sessionId: src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0
2025-10-02T08:14:25.186442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95584cc-fa329cae-1bc71932-dad49f95_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:25.189033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0] Write session: try to update token
2025-10-02T08:14:25.189050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:25.201961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId: src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:25.203754Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:25.203773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:25.203776Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:25.203785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534817389901246:4906]
2025-10-02T08:14:25.203789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534817389901246:4906]
2025-10-02T08:14:25.203832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:25.203838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.203841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:25.203976Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:25.204406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:25.204466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:25.204483Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:25.255782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534817389901283:3106]
2025-10-02T08:14:25.255933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2050, pipe: [1:7556534817389901283:3106]
2025-10-02T08:14:25.350002Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:25.350303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.350312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.350351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389901283:3106], now have 1 active actors on pipe
2025-10-02T08:14:25.350676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:25.350628Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:25.350627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534817389901283:3106]
2025-10-02T08:14:25.350646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:25.350649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:25.350720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2051 reason: error at write: Disconnected sessionId: src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0
2025-10-02T08:14:25.350880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2051 sessionId: src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0 is DEAD
2025-10-02T08:14:25.351057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:25.351067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0] Write session will restart in 0.006655s
2025-10-02T08:14:25.351093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0] Write session: Do CDS request
2025-10-02T08:14:25.351100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:25.360319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.360404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:25.360420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2052
2025-10-02T08:14:25.360532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.360573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:25.360578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:25.360595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:25.360603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:25.361011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2052 sessionId:  describe result for acl check
2025-10-02T08:14:25.361050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:25.361056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:25.361058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:25.361064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534817389901538:4929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:25.361430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:25.361574Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:25.361582Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:25.361589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:25.361606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534817389901538:4929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:25.361622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:25.361643Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534817389901541:4930]
2025-10-02T08:14:25.362091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:25.362298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:25.362362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:25.362694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:25.362748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.362755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.362755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.362756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.362757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.362762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.362770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.362774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.362778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.362781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.362786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.362793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.362798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.362803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.362807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.362812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.362815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.362820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.362824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.362829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.362846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:25.363769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534817389901538:4929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:25.370737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534817389901538:4929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:25.370756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534817389901538:4929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:25.370759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534817389901538:4929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:25.370779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:25.371416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:25.373045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:25.373059Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:25.373062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:25.373066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:25.373073Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2051 [1:7556534817389901541:4930]
2025-10-02T08:14:25.373084Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:25.373100Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:25.373103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.373106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.373108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.373124Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:25.373129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:25.373143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:25.373192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.373197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.373199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:25.373201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:25.373259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:25.373267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.373280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.373292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:25.373310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534817389901532:4930]
2025-10-02T08:14:25.373316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534817389901532:4930]
2025-10-02T08:14:25.373319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2051
2025-10-02T08:14:25.373323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:25.373450Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2051
2025-10-02T08:14:25.373335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389901585:4929], now have 1 active actors on pipe
2025-10-02T08:14:25.373340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:25.373343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:25.373348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:25.373360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:25.373363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:25.373367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534817849488542:2378], now have 1 active actors on pipe
2025-10-02T08:14:25.373372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.373376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.373412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534817389901532:4930]
2025-10-02T08:14:25.373420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:25.373429Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:25.373434Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|989c1b05-d64da232-caa36e8d-e05cc995_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:25.373439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.373443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.373445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:25.373454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.373462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:25.373492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.373583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.373590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.373613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.373648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2052 partition: 0 MaxSeqNo: 17 sessionId: src_id|989c1b05-d64da232-caa36e8d-e05cc995_0
2025-10-02T08:14:25.373964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72755ea9-470ad703-d7c7538e-9ac32ae5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|989c1b05-d64da232-caa36e8d-e05cc995_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:25.376548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989c1b05-d64da232-caa36e8d-e05cc995_0] Write session: try to update token
2025-10-02T08:14:25.376565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989c1b05-d64da232-caa36e8d-e05cc995_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:25.390564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId: src_id|989c1b05-d64da232-caa36e8d-e05cc995_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:25.391036Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:25.391054Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:25.391056Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:25.391063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534817389901532:4930]
2025-10-02T08:14:25.391067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534817389901532:4930]
2025-10-02T08:14:25.391106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:25.391116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.391118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:25.391119Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:25.391127Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:25.391261Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:25.393193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:25.450832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534817389901602:3106]
2025-10-02T08:14:25.450920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2051, pipe: [1:7556534817389901602:3106]
2025-10-02T08:14:25.523099Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:25.523400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.523410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.523439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389901602:3106], now have 1 active actors on pipe
2025-10-02T08:14:25.523531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534817389901602:3106]
2025-10-02T08:14:25.523547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:25.523549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:25.523594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2052 reason: error at write: Disconnected sessionId: src_id|989c1b05-d64da232-caa36e8d-e05cc995_0
2025-10-02T08:14:25.523622Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:25.523660Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:25.523744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2052 sessionId: src_id|989c1b05-d64da232-caa36e8d-e05cc995_0 is DEAD
2025-10-02T08:14:25.523869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989c1b05-d64da232-caa36e8d-e05cc995_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:25.523879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989c1b05-d64da232-caa36e8d-e05cc995_0] Write session will restart in 0.008722s
2025-10-02T08:14:25.523901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989c1b05-d64da232-caa36e8d-e05cc995_0] Write session: Do CDS request
2025-10-02T08:14:25.523907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989c1b05-d64da232-caa36e8d-e05cc995_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:25.531523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:25.532361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:25.532481Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:25.532488Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:25.532495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:25.532524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:25.532550Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534817389901857:4949]
2025-10-02T08:14:25.533078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:25.533253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989c1b05-d64da232-caa36e8d-e05cc995_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.533249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:25.533277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:25.533285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:25.533291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2053
2025-10-02T08:14:25.533474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.533487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:25.533500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:25.533509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:25.533516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.533516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:25.533517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.533518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.533518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.533519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.533522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.533528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.533529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.533532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.533533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.533537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.533541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.533545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.533548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.533550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.533553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.533555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.533557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.533560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.533562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.533578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:25.533843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2053 sessionId:  describe result for acl check
2025-10-02T08:14:25.533870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:25.533876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:25.533877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:25.533881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534817389901873:4955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:25.534315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534817389901873:4955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:25.535992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534817389901873:4955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:25.540301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534817389901873:4955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:25.540312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534817389901873:4955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:25.540315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534817389901873:4955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:25.540326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:25.540964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:25.542422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:25.542439Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:25.542441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:25.542445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:25.542450Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2052 [1:7556534817389901857:4949]
2025-10-02T08:14:25.542460Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:25.542473Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:25.542476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.542478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.542480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.542495Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:25.542500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:25.542505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:25.542559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.542568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.542571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:25.542574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:25.542630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:25.542637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.542649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.542663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:25.542667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2052
2025-10-02T08:14:25.542683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389901905:4955], now have 1 active actors on pipe
2025-10-02T08:14:25.542690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534817849488549:2378], now have 1 active actors on pipe
2025-10-02T08:14:25.542694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.542696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.542712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534817389901851:4949]
2025-10-02T08:14:25.542718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534817389901851:4949]
2025-10-02T08:14:25.542733Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:25.542734Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2052
2025-10-02T08:14:25.542746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:25.542753Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:25.542756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:25.542764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:25.542767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:25.542780Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:25.542785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.542788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.542790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:25.542797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.542805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:25.542834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534817389901851:4949]
2025-10-02T08:14:25.542845Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:25.542858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:25.542859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.542906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.542915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.542934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.542969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2053 partition: 0 MaxSeqNo: 17 sessionId: src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0
2025-10-02T08:14:25.543259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989c1b05-d64da232-caa36e8d-e05cc995_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:25.545755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0] Write session: try to update token
2025-10-02T08:14:25.545771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:25.558439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId: src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:25.559693Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:25.559709Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:25.559711Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:25.559718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534817389901851:4949]
2025-10-02T08:14:25.559723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534817389901851:4949]
2025-10-02T08:14:25.559760Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:25.559766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:25.559772Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:25.559773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.559775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:25.559907Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:25.560881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:25.623881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534817389901920:3106]
2025-10-02T08:14:25.623973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2052, pipe: [1:7556534817389901920:3106]
2025-10-02T08:14:25.692825Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:25.693136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.693147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.693185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389901920:3106], now have 1 active actors on pipe
2025-10-02T08:14:25.693278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534817389901920:3106]
2025-10-02T08:14:25.693297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:25.693299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:25.693347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2053 reason: error at write: Disconnected sessionId: src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0
2025-10-02T08:14:25.693380Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:25.693488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2053 sessionId: src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0 is DEAD
2025-10-02T08:14:25.693492Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:25.693628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:25.693637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0] Write session will restart in 0.008122s
2025-10-02T08:14:25.693663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0] Write session: Do CDS request
2025-10-02T08:14:25.693669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:25.703299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.703369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:25.703371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:25.703384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2054
2025-10-02T08:14:25.703508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.703540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:25.703548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:25.703551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:25.703874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2054 sessionId:  describe result for acl check
2025-10-02T08:14:25.703905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:25.703911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:25.703912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:25.703917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534817389902194:4997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:25.704346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534817389902194:4997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:25.704410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:25.704591Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:25.704601Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:25.704610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:25.704657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:25.704695Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534817389902201:4968]
2025-10-02T08:14:25.705301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:25.705486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:25.705537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:25.705825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:25.705870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.705874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.705875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.705876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.705876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.705880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.705885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.705887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.705889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.705891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.705895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.705899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.705902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.705905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.705907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.705910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.705912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.705915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.705918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.705920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.705932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:25.706208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534817389902194:4997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:25.711630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534817389902194:4997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:25.711646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534817389902194:4997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:25.711649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534817389902194:4997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:25.711658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:25.713558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:25.715190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:25.715207Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:25.715209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:25.715213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:25.715219Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2053 [1:7556534817389902201:4968]
2025-10-02T08:14:25.715229Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:25.715246Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:25.715253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.715256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.715258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.715275Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:25.715279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:25.715289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:25.715346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.715355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.715358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:25.715360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:25.715421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:25.715429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.715442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.715458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:25.715480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389902241:4997], now have 1 active actors on pipe
2025-10-02T08:14:25.715487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534817849488568:2378], now have 1 active actors on pipe
2025-10-02T08:14:25.715493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534817389902187:4968]
2025-10-02T08:14:25.715495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534817389902187:4968]
2025-10-02T08:14:25.715506Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:25.715512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2053
2025-10-02T08:14:25.715521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:25.715532Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:25.715538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:25.715541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:25.715544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:25.715568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534817389902187:4968]
2025-10-02T08:14:25.715579Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:25.715583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:25.715589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.715592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.715625Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:25.715637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.715642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.715602Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2053
2025-10-02T08:14:25.715648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:25.715656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.715664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:25.715685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.715718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.715724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.715736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.715765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2054 partition: 0 MaxSeqNo: 17 sessionId: src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0
2025-10-02T08:14:25.716084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4101887-8152a3b7-9c6ba6d0-ecaa0456_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:25.718867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0] Write session: try to update token
2025-10-02T08:14:25.718885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:25.732795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId: src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:25.733089Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:25.733106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:25.733108Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:25.733117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534817389902187:4968]
2025-10-02T08:14:25.733122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534817389902187:4968]
2025-10-02T08:14:25.733164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:25.733177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.733179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:25.733294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:25.733308Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:25.733322Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:25.735191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:25.793365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534817389902257:3106]
2025-10-02T08:14:25.793580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2053, pipe: [1:7556534817389902257:3106]
2025-10-02T08:14:25.866359Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:25.866672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.866690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.866734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389902257:3106], now have 1 active actors on pipe
2025-10-02T08:14:25.866917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:25.866877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534817389902257:3106]
2025-10-02T08:14:25.866898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:25.866900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:25.866932Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:25.866961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2054 reason: error at write: Disconnected sessionId: src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0
2025-10-02T08:14:25.867099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2054 sessionId: src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0 is DEAD
2025-10-02T08:14:25.868970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:25.868980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0] Write session will restart in 0.007641s
2025-10-02T08:14:25.869005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0] Write session: Do CDS request
2025-10-02T08:14:25.869011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:25.878258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.878352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:25.878365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2055
2025-10-02T08:14:25.878486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:25.878516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:25.878521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:25.878524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:25.878896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2055 sessionId:  describe result for acl check
2025-10-02T08:14:25.878944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:25.878946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:25.878947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:25.878953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534817389902513:5031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:25.879322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534817389902513:5031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:25.879503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:25.880441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:25.880611Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:25.880619Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:25.880628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:25.880674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:25.880715Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534817389902539:5025]
2025-10-02T08:14:25.881094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534817389902513:5031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:25.881346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:25.881545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:25.881587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:25.881882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:25.881916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.881917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.881918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.881919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.881920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.881925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.881934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.881938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.881942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.881946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.881950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.881958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:25.881963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.881969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:25.881972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.881977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:25.881981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.881987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.881991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.881998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.882015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:25.886762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534817389902513:5031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:25.886776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534817389902513:5031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:25.886779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534817389902513:5031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:25.886787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:25.889976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:25.891662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:25.891682Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:25.891685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:25.891689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:25.891695Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2054 [1:7556534817389902539:5025]
2025-10-02T08:14:25.891708Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:25.891726Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:25.891735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.891738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.891740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.891756Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:25.891766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:25.891773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:25.891835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.891844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.891848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:25.891851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:25.891917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:25.891925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.891939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:25.891957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:25.891979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389902566:5031], now have 1 active actors on pipe
2025-10-02T08:14:25.891988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2054
2025-10-02T08:14:25.891990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534817389902517:5025]
2025-10-02T08:14:25.891992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534817389902517:5025]
2025-10-02T08:14:25.892002Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:25.892013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:25.892015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534817849488576:2378], now have 1 active actors on pipe
2025-10-02T08:14:25.892017Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:25.892023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:25.892037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:25.892041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:25.892048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.892058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.892098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534817389902517:5025]
2025-10-02T08:14:25.892106Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:25.892067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2054
2025-10-02T08:14:25.892116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:25.892121Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:25.892128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:25.892131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:25.892134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:25.892143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:25.892152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:25.892212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.892282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:25.892290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:25.892304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:25.892345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2055 partition: 0 MaxSeqNo: 17 sessionId: src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0
2025-10-02T08:14:25.892659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1f7f62-4f18c52f-27a346f2-13f386cd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:25.895206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0] Write session: try to update token
2025-10-02T08:14:25.895223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:25.910013Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:25.910036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:25.910039Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:25.910049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534817389902517:5025]
2025-10-02T08:14:25.910054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534817389902517:5025]
2025-10-02T08:14:25.910096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:25.910107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:25.910109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:25.910124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:25.910131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:25.910247Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:25.910402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId: src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:25.913859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:25.973021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534817389902592:3106]
2025-10-02T08:14:25.973188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2054, pipe: [1:7556534817389902592:3106]
2025-10-02T08:14:26.047431Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:26.047699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.047711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.047749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534817389902592:3106], now have 1 active actors on pipe
2025-10-02T08:14:26.047842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534817389902592:3106]
2025-10-02T08:14:26.047869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:26.047872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:26.047954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:26.047901Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:26.047941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2055 reason: error at write: Disconnected sessionId: src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0
2025-10-02T08:14:26.048099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2055 sessionId: src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0 is DEAD
2025-10-02T08:14:26.048226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:26.048233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0] Write session will restart in 0.009936s
2025-10-02T08:14:26.048259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0] Write session: Do CDS request
2025-10-02T08:14:26.048265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:26.056959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:26.057864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:26.058011Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:26.058018Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:26.058025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:26.058060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:26.058110Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534821684870175:5131]
2025-10-02T08:14:26.058641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:26.058851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:26.058896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:26.059159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:26.059200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.059205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.059206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.059206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.059207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.059210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.059217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.059219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.059221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.059223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.059227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.059232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.059235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.059238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.059240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.059243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.059245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.059260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.059248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.059250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.059253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.059264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:26.059306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:26.059313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2056
2025-10-02T08:14:26.059401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.059422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:26.059431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:26.059433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:26.059786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2056 sessionId:  describe result for acl check
2025-10-02T08:14:26.059815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:26.059819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:26.059820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:26.059824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534821684870191:5114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:26.060227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534821684870191:5114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:26.061957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534821684870191:5114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:26.066735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534821684870191:5114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:26.066750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534821684870191:5114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:26.066752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534821684870191:5114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:26.066758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:26.067153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:26.068713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:26.068728Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:26.068730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:26.068734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:26.068739Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2055 [1:7556534821684870175:5131]
2025-10-02T08:14:26.068749Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:26.068766Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:26.068774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.068777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.068779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.068795Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:26.068800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:26.068821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:26.068884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.068891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.068894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:26.068896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:26.068965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:26.068972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.068983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.068993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2055
2025-10-02T08:14:26.068994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:26.069010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684870223:5114], now have 1 active actors on pipe
2025-10-02T08:14:26.069018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534822144455900:2378], now have 1 active actors on pipe
2025-10-02T08:14:26.069022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.069026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.069042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534821684870169:5131]
2025-10-02T08:14:26.069048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534821684870169:5131]
2025-10-02T08:14:26.069059Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:26.069077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:26.069077Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:26.069081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:26.069095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:26.069097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:26.069112Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:26.069122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.069125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.069077Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2055
2025-10-02T08:14:26.069127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:26.069135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.069144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:26.069176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534821684870169:5131]
2025-10-02T08:14:26.069187Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:26.069197Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:26.069203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.069236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.069245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.069267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.069309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2056 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0
2025-10-02T08:14:26.069618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa6d544-e8c4454e-354cdf00-7326a61d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:26.072234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0] Write session: try to update token
2025-10-02T08:14:26.072249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:26.085740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId: src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:26.086129Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:26.086134Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:26.086142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534821684870169:5131]
2025-10-02T08:14:26.086187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:26.086191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:26.086404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:26.086539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.086667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.086796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.086977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:26.087008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:26.088148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:26.088246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.088256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.088293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:26.088321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:26.088394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.088413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.088579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.088646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.088714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.088785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.089038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.089058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.089187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.089307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.089373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.089444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.089489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.089497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.089568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.089634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.089697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.089758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.089804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.089812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.089876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.089968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.090040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.090107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.090155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.090162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.090227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.090291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.090355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.090421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.090472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.090479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.090542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.090602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.090668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.090735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.090779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.090786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.090856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.090922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.090994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.091067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.091114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.091122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.091203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.091317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.091389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.091460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.091509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.091516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.091589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.091658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.091759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.091858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.091907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.091914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.091985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.092053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.092124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.092195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.092253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.092259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.092295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:26.092357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.092381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.092385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:26.092413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:26.092429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:26.092435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:26.092438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:26.092440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:26.092818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:26.092846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:26.092853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:26.092856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:26.092859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:26.092861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:26.093381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:26.093401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:26.093405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:26.093407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:26.093411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:26.093415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:26.093880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:26.093897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:26.093901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:26.093903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:26.093905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:26.095851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:26.095867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:26.095876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392866095
2025-10-02T08:14:26.096000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:26.096012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:26.096017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:26.096020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:26.096024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:26.096026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:26.096441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:26.096458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:26.096462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:26.096466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:26.096468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:26.096471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:26.096876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:26.096891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:26.096896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:26.096898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:26.096900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:26.096902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:26.097322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:26.097347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:26.097352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:26.098368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:26.098385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:26.098391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:26.098394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:26.098403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392866097
2025-10-02T08:14:26.098687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:26.098709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:26.098715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:26.098718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:26.098722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:26.098726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:26.099164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:26.099186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:26.099191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:26.099200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:26.099203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:26.099212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:26.099635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:26.099654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.099757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392866099
2025-10-02T08:14:26.100473Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:26.100496Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:26.100503Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:26.100510Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:26.102067Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:26.102082Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:26.102084Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:26.102095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534821684870169:5131]
2025-10-02T08:14:26.102099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534821684870169:5131]
2025-10-02T08:14:26.102147Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:26.102155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:26.102159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.102161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:26.102162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:26.102286Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:26.148188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534821684870246:3106]
2025-10-02T08:14:26.148327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2055, pipe: [1:7556534821684870246:3106]
2025-10-02T08:14:26.236308Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:26.236592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684870246:3106], now have 1 active actors on pipe
2025-10-02T08:14:26.236685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:26.236695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:26.236720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2056 reason: error at write: Disconnected sessionId: src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0
2025-10-02T08:14:26.236758Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:26.236840Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:26.236891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2056 sessionId: src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0 is DEAD
2025-10-02T08:14:26.237008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:26.237021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534821684870246:3106]
2025-10-02T08:14:26.237036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0] Write session will restart in 0.006887s
2025-10-02T08:14:26.237060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0] Write session: Do CDS request
2025-10-02T08:14:26.237066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:26.245307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.245313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:26.245327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2057
2025-10-02T08:14:26.245498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.245531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:26.245534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:26.245537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:26.245554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:26.245807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2057 sessionId:  describe result for acl check
2025-10-02T08:14:26.245827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:26.245828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:26.245829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:26.245832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534821684870509:5117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:26.246216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534821684870509:5117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:26.246695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:26.246835Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:26.246844Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:26.246852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:26.246892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:26.246924Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534821684870517:5120]
2025-10-02T08:14:26.247526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:26.247664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:26.247704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:26.247984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:26.248022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.248028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.248029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.248030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.248031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.248036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.248044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.248048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.248052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.248056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.248062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.248069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.248074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.248079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.248083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.248088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.248089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534821684870509:5117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:26.248092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.248098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.248102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.248107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.248125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:26.253561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534821684870509:5117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:26.253574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534821684870509:5117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:26.253576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534821684870509:5117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:26.253588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:26.255521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:26.257033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:26.257048Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:26.257051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:26.257054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:26.257059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2056 [1:7556534821684870517:5120]
2025-10-02T08:14:26.257071Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:26.257084Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:26.257086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.257089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.257091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.257105Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:26.257110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:26.257116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:26.257167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.257174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.257177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:26.257180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:26.257237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:26.257244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.257255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.257271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:26.257288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2056
2025-10-02T08:14:26.257291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684870558:5117], now have 1 active actors on pipe
2025-10-02T08:14:26.257297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534821684870504:5120]
2025-10-02T08:14:26.257299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534821684870504:5120]
2025-10-02T08:14:26.257309Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:26.257317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534822144455910:2378], now have 1 active actors on pipe
2025-10-02T08:14:26.257321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.257325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.257334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:26.257337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:26.257341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:26.257356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:26.257363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:26.257394Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:26.257403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.257407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.257382Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2056
2025-10-02T08:14:26.257408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:26.257417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.257424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:26.257430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534821684870504:5120]
2025-10-02T08:14:26.257437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:26.257441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:26.257463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.257496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.257505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.257523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.257557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2057 partition: 0 MaxSeqNo: 17 sessionId: src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0
2025-10-02T08:14:26.257866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c8ec5e9-6b4a2978-f541367a-4944af99_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:26.260268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0] Write session: try to update token
2025-10-02T08:14:26.260284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:26.273605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId: src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:26.274235Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:26.274251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:26.274253Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:26.274262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534821684870504:5120]
2025-10-02T08:14:26.274268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534821684870504:5120]
2025-10-02T08:14:26.274306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:26.274315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.274316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:26.274422Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:26.274434Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:26.274450Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:26.276048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:26.337073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534821684870572:3106]
2025-10-02T08:14:26.337199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2056, pipe: [1:7556534821684870572:3106]
2025-10-02T08:14:26.421487Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:26.421878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.421895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.421937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684870572:3106], now have 1 active actors on pipe
2025-10-02T08:14:26.422102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:26.422115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:26.422586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:26.422597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0] Write session will restart in 0.009115s
2025-10-02T08:14:26.422620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0] Write session: Do CDS request
2025-10-02T08:14:26.422627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:26.422187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2057 reason: error at write: Disconnected sessionId: src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0
2025-10-02T08:14:26.422351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2057 sessionId: src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0 is DEAD
2025-10-02T08:14:26.422494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534821684870572:3106]
2025-10-02T08:14:26.422741Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:26.423141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:26.433254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.433306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:26.433321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2058
2025-10-02T08:14:26.433441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.433467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:26.433475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:26.433478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:26.433741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:26.433900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2058 sessionId:  describe result for acl check
2025-10-02T08:14:26.433937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:26.433939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:26.433941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:26.433946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534821684870841:5136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:26.434462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534821684870841:5136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:26.435774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:26.435953Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:26.435962Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:26.435972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:26.436020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:26.436057Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534821684870861:5125]
2025-10-02T08:14:26.436454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534821684870841:5136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:26.436700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:26.436913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:26.436972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:26.437298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:26.437353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.437358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.437358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.437359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.437360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.437364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.437370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.437372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.437374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.437376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.437380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.437385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.437389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.437393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.437395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.437398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.437401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.437408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.437412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.437416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.437431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:26.442386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534821684870841:5136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:26.442402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534821684870841:5136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:26.442406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534821684870841:5136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:26.442415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:26.445311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:26.446780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:26.446794Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:26.446796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:26.446799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:26.446804Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2057 [1:7556534821684870861:5125]
2025-10-02T08:14:26.446812Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:26.446824Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:26.446826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.446828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.446830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.446846Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:26.446851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:26.446856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:26.446902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.446909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.446911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:26.446913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:26.446960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:26.446965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.446974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.446981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:26.446996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534821684870836:5125]
2025-10-02T08:14:26.447002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534821684870836:5125]
2025-10-02T08:14:26.447012Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:26.447025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2057
2025-10-02T08:14:26.447025Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:26.447028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684870888:5136], now have 1 active actors on pipe
2025-10-02T08:14:26.447029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:26.447036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:26.447047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:26.447050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:26.447055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534822144455917:2378], now have 1 active actors on pipe
2025-10-02T08:14:26.447081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.447088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.447098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534821684870836:5125]
2025-10-02T08:14:26.447106Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:26.447130Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d13539e-2a18759b-517fd207-4b0e44dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:26.447141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.447145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.447152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:26.447159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.447115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2057
2025-10-02T08:14:26.447165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:26.447167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:26.447194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.447302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.447311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.447321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.447353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2058 partition: 0 MaxSeqNo: 17 sessionId: src_id|d13539e-2a18759b-517fd207-4b0e44dd_0
2025-10-02T08:14:26.447622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e530d51f-7854eeeb-b92227cb-9a79575c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d13539e-2a18759b-517fd207-4b0e44dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:26.450173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d13539e-2a18759b-517fd207-4b0e44dd_0] Write session: try to update token
2025-10-02T08:14:26.450188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d13539e-2a18759b-517fd207-4b0e44dd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:26.463577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId: src_id|d13539e-2a18759b-517fd207-4b0e44dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:26.464929Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:26.464944Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:26.464946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:26.464954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534821684870836:5125]
2025-10-02T08:14:26.464959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534821684870836:5125]
2025-10-02T08:14:26.464998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:26.464999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:26.465006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:26.465009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.465014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:26.465159Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:26.466499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:26.522458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534821684870902:3106]
2025-10-02T08:14:26.523299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2057, pipe: [1:7556534821684870902:3106]
2025-10-02T08:14:26.602270Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:26.602538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.602547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.602576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684870902:3106], now have 1 active actors on pipe
2025-10-02T08:14:26.602657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534821684870902:3106]
2025-10-02T08:14:26.602675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:26.602682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:26.602729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2058 reason: error at write: Disconnected sessionId: src_id|d13539e-2a18759b-517fd207-4b0e44dd_0
2025-10-02T08:14:26.602808Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:26.602798Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:26.602878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2058 sessionId: src_id|d13539e-2a18759b-517fd207-4b0e44dd_0 is DEAD
2025-10-02T08:14:26.603009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13539e-2a18759b-517fd207-4b0e44dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:26.603019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13539e-2a18759b-517fd207-4b0e44dd_0] Write session will restart in 0.005353s
2025-10-02T08:14:26.603045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13539e-2a18759b-517fd207-4b0e44dd_0] Write session: Do CDS request
2025-10-02T08:14:26.603051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13539e-2a18759b-517fd207-4b0e44dd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:26.609225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d13539e-2a18759b-517fd207-4b0e44dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.609314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:26.609331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2059
2025-10-02T08:14:26.609456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.609486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:26.609494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:26.609498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:26.609882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2059 sessionId:  describe result for acl check
2025-10-02T08:14:26.609915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:26.609922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:26.609924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:26.609928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534821684871117:5153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:26.610413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534821684871117:5153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:26.612176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534821684871117:5153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:26.612226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:26.613081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:26.613241Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:26.613251Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:26.613261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:26.613310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:26.613349Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534821684871200:5146]
2025-10-02T08:14:26.613932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:26.614106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:26.614145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:26.614430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:26.614473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.614480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.614482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.614483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.614484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.614489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.614499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.614503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.614507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.614511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.614516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.614523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.614528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.614534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.614538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.614544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.614548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.614554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.614559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.614564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.614584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:26.614804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534821684871117:5153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:26.614815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534821684871117:5153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:26.614818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534821684871117:5153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:26.614825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:26.622519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:26.624223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:26.624236Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:26.624238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:26.624242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:26.624248Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2058 [1:7556534821684871200:5146]
2025-10-02T08:14:26.624258Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:26.624273Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:26.624280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.624283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.624285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.624300Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:26.624304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:26.624310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:26.624364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.624372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.624376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:26.624378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:26.624439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:26.624446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.624457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.624473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:26.624495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684871218:5153], now have 1 active actors on pipe
2025-10-02T08:14:26.624496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2058
2025-10-02T08:14:26.624503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534822144455935:2378], now have 1 active actors on pipe
2025-10-02T08:14:26.624508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534821684871184:5146]
2025-10-02T08:14:26.624511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534821684871184:5146]
2025-10-02T08:14:26.624521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:26.624534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.624534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:26.624537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:26.624542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.624556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:26.624574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:26.624582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:26.624620Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:26.624629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.624633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.624640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:26.624647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.624655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:26.624668Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534821684871184:5146]
2025-10-02T08:14:26.624671Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:26.624675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:26.624622Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2058
2025-10-02T08:14:26.624697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.624748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.624754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.624770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.624821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2059 partition: 0 MaxSeqNo: 17 sessionId: src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0
2025-10-02T08:14:26.625132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d13539e-2a18759b-517fd207-4b0e44dd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:26.627739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0] Write session: try to update token
2025-10-02T08:14:26.627753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:26.641399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId: src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:26.641737Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:26.641751Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:26.641754Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:26.641761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534821684871184:5146]
2025-10-02T08:14:26.641765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534821684871184:5146]
2025-10-02T08:14:26.641801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:26.641813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.641814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:26.641870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:26.641882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:26.641941Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:26.644002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:26.702682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534821684871248:3106]
2025-10-02T08:14:26.702798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2058, pipe: [1:7556534821684871248:3106]
2025-10-02T08:14:26.771516Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:26.771798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.771812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.771848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684871248:3106], now have 1 active actors on pipe
2025-10-02T08:14:26.771969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534821684871248:3106]
2025-10-02T08:14:26.772006Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:26.772013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:26.772015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:26.772079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2059 reason: error at write: Disconnected sessionId: src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0
2025-10-02T08:14:26.772079Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:26.772278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2059 sessionId: src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0 is DEAD
2025-10-02T08:14:26.772460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:26.772470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0] Write session will restart in 0.006543s
2025-10-02T08:14:26.772496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0] Write session: Do CDS request
2025-10-02T08:14:26.772509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:26.780237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.780306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:26.780325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2060
2025-10-02T08:14:26.780402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.780425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:26.780429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:26.780431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:26.780718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2060 sessionId:  describe result for acl check
2025-10-02T08:14:26.780755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:26.780762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:26.780764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:26.780768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534821684871503:5176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:26.781131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534821684871503:5176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:26.781660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:26.782671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:26.782776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534821684871503:5176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:26.782834Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:26.782843Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:26.782853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:26.782903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:26.782938Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534821684871538:5173]
2025-10-02T08:14:26.783526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:26.783712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:26.783752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:26.783957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:26.783984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.783988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.783988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.783989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.783989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.783993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.783999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.784001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.784003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.784005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.784008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.784013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.784016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.784019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.784022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.784028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.784031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.784036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.784040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.784044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.784059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:26.788592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534821684871503:5176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:26.788606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534821684871503:5176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:26.788609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534821684871503:5176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:26.788626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:26.791702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:26.793369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:26.793389Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:26.793392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:26.793395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:26.793401Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2059 [1:7556534821684871538:5173]
2025-10-02T08:14:26.793412Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:26.793428Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:26.793435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.793438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.793440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.793457Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:26.793466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:26.793473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:26.793539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.793547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.793550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:26.793552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:26.793675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2059
2025-10-02T08:14:26.793713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:26.793726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.793739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.793752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:26.793776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684871567:5176], now have 1 active actors on pipe
2025-10-02T08:14:26.793784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534822144455944:2378], now have 1 active actors on pipe
2025-10-02T08:14:26.793756Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2059
2025-10-02T08:14:26.793789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.793793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.793810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534821684871521:5173]
2025-10-02T08:14:26.793812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534821684871521:5173]
2025-10-02T08:14:26.793818Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:26.793832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:26.793837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:26.793840Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:26.793852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:26.793860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:26.793880Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:26.793892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.793899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.793902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:26.793909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.793919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:26.793950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534821684871521:5173]
2025-10-02T08:14:26.793963Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:26.793978Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:26.793980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.794084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.794092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.794108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.794146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2060 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0
2025-10-02T08:14:26.794465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2bda-7728e381-2d2189f8-5eca0ac7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:26.797023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0] Write session: try to update token
2025-10-02T08:14:26.797039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:26.809159Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:26.809182Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:26.809192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534821684871521:5173]
2025-10-02T08:14:26.809234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:26.809243Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:26.809411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:26.809571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.809724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.809865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.810056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:26.810095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:26.810383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId: src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:26.812952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:26.813021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.813035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.813065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:26.813088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:26.813149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.813166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.813375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.813438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.813501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.813569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.813771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.813781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.813854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.813920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.813992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.814070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.814114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.814121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.814204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.814273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.814337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.814407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.814465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.814473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.814544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.814616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.814679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.814746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.814784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.814787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.814875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.814935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.814997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.815063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.815121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.815128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.815202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.815269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.815340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.815411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.815457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.815460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.815531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.815605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.815680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.815755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.815805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.815813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.815885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.815954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.816016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.816081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.816127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.816133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.816196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.816268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.816337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.816396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.816447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.816454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.816515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.816571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.816634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.816703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.816751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.816758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.816799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:26.816879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.816915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.816921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:26.816954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:26.816970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:26.816977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:26.816980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:26.816983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:26.817357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:26.817379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:26.817388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:26.817390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:26.817393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:26.817395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:26.817951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:26.817978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:26.817988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:26.817990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:26.817992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:26.817994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:26.818467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:26.818492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:26.818499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:26.818502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:26.818507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:26.819646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:26.819663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:26.819693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392866819
2025-10-02T08:14:26.819796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:26.819804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:26.819809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:26.819811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:26.819814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:26.819816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:26.820284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:26.820307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:26.820317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:26.820325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:26.820328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:26.820332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:26.820831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:26.820850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:26.820859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:26.820862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:26.820866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:26.820870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:26.821354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:26.821379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:26.821385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:26.822519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:26.822537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:26.822542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:26.822545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:26.822554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392866822
2025-10-02T08:14:26.822862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:26.822884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:26.822892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:26.822899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:26.822903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:26.822906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:26.823369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:26.823393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:26.823399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:26.823403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:26.823406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:26.823413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:26.823845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:26.823863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.823943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392866823
2025-10-02T08:14:26.824679Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:26.824702Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:26.824708Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:26.824719Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:26.826395Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:26.826415Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:26.826416Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:26.826432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534821684871521:5173]
2025-10-02T08:14:26.826437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534821684871521:5173]
2025-10-02T08:14:26.826495Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:26.826506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:26.826510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.826511Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:26.826512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:26.826646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:26.872153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534821684871590:3106]
2025-10-02T08:14:26.872280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2059, pipe: [1:7556534821684871590:3106]
2025-10-02T08:14:26.957498Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:26.957776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684871590:3106], now have 1 active actors on pipe
2025-10-02T08:14:26.957853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:26.957862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:26.957887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2060 reason: error at write: Disconnected sessionId: src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0
2025-10-02T08:14:26.957973Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:26.957963Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:26.958032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2060 sessionId: src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0 is DEAD
2025-10-02T08:14:26.958166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:26.958176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0] Write session will restart in 0.006867s
2025-10-02T08:14:26.958197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0] Write session: Do CDS request
2025-10-02T08:14:26.958187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534821684871590:3106]
2025-10-02T08:14:26.958203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:26.966177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.966242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:26.966256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2061
2025-10-02T08:14:26.966358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:26.966386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:26.966394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:26.966397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:26.966802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2061 sessionId:  describe result for acl check
2025-10-02T08:14:26.966836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:26.966841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:26.966842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:26.966845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534821684871849:5193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:26.967215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534821684871849:5193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:26.968073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:26.969218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:26.969390Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:26.969402Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:26.969411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:26.969413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534821684871849:5193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:26.969456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:26.969491Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534821684871882:5238]
2025-10-02T08:14:26.970102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:26.970282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:26.970323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:26.970614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:26.970654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.970660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.970661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.970662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.970663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.970667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.970676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.970683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.970687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.970691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.970700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.970707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:26.970716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.970722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:26.970730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.970735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:26.970739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.970748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.970756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.970761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.970783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:26.975281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534821684871849:5193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:26.975296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534821684871849:5193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:26.975299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534821684871849:5193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:26.975307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:26.978332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:26.979849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:26.979866Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:26.979869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:26.979874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:26.979880Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2060 [1:7556534821684871882:5238]
2025-10-02T08:14:26.979892Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:26.979907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:26.979910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.979913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.979915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.979929Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:26.979940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:26.979945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:26.980006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.980013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.980015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:26.980017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:26.980079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:26.980086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:26.980098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:26.980109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:26.980130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534821684871910:5193], now have 1 active actors on pipe
2025-10-02T08:14:26.980140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534822144455951:2378], now have 1 active actors on pipe
2025-10-02T08:14:26.980146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534821684871868:5238]
2025-10-02T08:14:26.980148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534821684871868:5238]
2025-10-02T08:14:26.980158Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:26.980169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:26.980170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:26.980173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:26.980181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:26.980184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:26.980225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534821684871868:5238]
2025-10-02T08:14:26.980233Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:26.980237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:26.980229Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2060
2025-10-02T08:14:26.980271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2060
2025-10-02T08:14:26.980303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.980311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.980332Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37f03686-496e2e79-26081287-ebe9c37b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:26.980342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:26.980345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:26.980346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:26.980354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:26.980362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:26.980374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.980404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.980409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.980420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:26.980444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2061 partition: 0 MaxSeqNo: 17 sessionId: src_id|37f03686-496e2e79-26081287-ebe9c37b_0
2025-10-02T08:14:26.980726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb063f4c-24b7d23c-77ec0ddf-45ef6d97_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|37f03686-496e2e79-26081287-ebe9c37b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:26.983325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f03686-496e2e79-26081287-ebe9c37b_0] Write session: try to update token
2025-10-02T08:14:26.983345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f03686-496e2e79-26081287-ebe9c37b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:26.990898Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:26.990913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:26.990923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534821684871868:5238]
2025-10-02T08:14:26.990963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:26.990973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:26.991149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:26.991292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.991440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.991573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:26.991772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:26.991819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:26.996428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId: src_id|37f03686-496e2e79-26081287-ebe9c37b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:26.998927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:26.998988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.999003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.999034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:26.999050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:26.999101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:26.999108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:26.999243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.999305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.999369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.999445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.999490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.999498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.999560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.999622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.999683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:26.999746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:26.999789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:26.999795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:26.999860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:26.999929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:26.999987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.000055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.000098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.000104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.000167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.000233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.000297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.000354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.000399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.000407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.000475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.000540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.000610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.000680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.000727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.000735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.000831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.000892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.000952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.001013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.001059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.001066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.001136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.001197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.001264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.001332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.001377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.001384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.001450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.001509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.001574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.001639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.001687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.001693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.001761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.001826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.001893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.001955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.002003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.002011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.002076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.002140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.002210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.002278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.002326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.002333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.002370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:27.002431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.002450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.002456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:27.002485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:27.002500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:27.002507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:27.002510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:27.002513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:27.002932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:27.002961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:27.002972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:27.002979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:27.002984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:27.002991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:27.003639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:27.003670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:27.003680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:27.003684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:27.003690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:27.003695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:27.004179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:27.004220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:27.004229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:27.004232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:27.004235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:27.005571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:27.005597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:27.005608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392867005
2025-10-02T08:14:27.005778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:27.005799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:27.005811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:27.005818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:27.005821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:27.005825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:27.006327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:27.006360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:27.006371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:27.006375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:27.006378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:27.006381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:27.006898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:27.006930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:27.006944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:27.006951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:27.006955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:27.006957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:27.007465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:27.007493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:27.007504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:27.008689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:27.008706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:27.008711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:27.008714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:27.008723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392867008
2025-10-02T08:14:27.009068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:27.009094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:27.009100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:27.009105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:27.009109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:27.009112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:27.009592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:27.009614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:27.009618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:27.009620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:27.009622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:27.009627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:27.010063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:27.010084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.010155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392867009
2025-10-02T08:14:27.011996Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:27.012015Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:27.012027Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:27.012035Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:27.013518Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:27.013530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:27.013532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:27.013537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534821684871868:5238]
2025-10-02T08:14:27.013540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534821684871868:5238]
2025-10-02T08:14:27.013586Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:27.013589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:27.013593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.013594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:27.013606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:27.013728Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:27.058520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534825979839265:3106]
2025-10-02T08:14:27.058630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2060, pipe: [1:7556534825979839265:3106]
2025-10-02T08:14:27.146205Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:27.146876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979839265:3106], now have 1 active actors on pipe
2025-10-02T08:14:27.146982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534825979839265:3106]
2025-10-02T08:14:27.146998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:27.147000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:27.147019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2061 reason: error at write: Disconnected sessionId: src_id|37f03686-496e2e79-26081287-ebe9c37b_0
2025-10-02T08:14:27.147085Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:27.147163Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:27.147188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2061 sessionId: src_id|37f03686-496e2e79-26081287-ebe9c37b_0 is DEAD
2025-10-02T08:14:27.147306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f03686-496e2e79-26081287-ebe9c37b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:27.147313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f03686-496e2e79-26081287-ebe9c37b_0] Write session will restart in 0.006038s
2025-10-02T08:14:27.147337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f03686-496e2e79-26081287-ebe9c37b_0] Write session: Do CDS request
2025-10-02T08:14:27.147343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f03686-496e2e79-26081287-ebe9c37b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:27.154287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f03686-496e2e79-26081287-ebe9c37b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.154334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:27.154350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2062
2025-10-02T08:14:27.154456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.154498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:27.154509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:27.154512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:27.154911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2062 sessionId:  describe result for acl check
2025-10-02T08:14:27.154947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:27.154949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:27.154950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:27.154955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534825979839490:5272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:27.155435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534825979839490:5272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:27.157848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534825979839490:5272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:27.158186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:27.159133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:27.159300Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:27.159312Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:27.159322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:27.159367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:27.159400Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534825979839570:5273]
2025-10-02T08:14:27.160010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:27.160166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:27.160218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:27.160497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:27.160533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.160538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.160539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.160540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.160541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.160545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.160554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.160558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.160560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.160563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.160568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.160574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.160578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534825979839490:5272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:27.160580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.160584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.160584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534825979839490:5272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:27.160587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534825979839490:5272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:27.160588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.160592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.160595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.160595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:27.160599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.160603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.160607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.160622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:27.168510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:27.170018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:27.170033Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:27.170036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:27.170040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:27.170050Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2061 [1:7556534825979839570:5273]
2025-10-02T08:14:27.170062Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:27.170080Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:27.170082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.170085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.170088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.170105Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:27.170110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:27.170116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:27.170173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.170182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.170185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:27.170187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:27.170247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:27.170253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.170266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.170281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:27.170303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979839584:5272], now have 1 active actors on pipe
2025-10-02T08:14:27.170313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534825979839557:5273]
2025-10-02T08:14:27.170315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534825979839557:5273]
2025-10-02T08:14:27.170322Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:27.170322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2061
2025-10-02T08:14:27.170333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:27.170345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:27.170346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:27.170349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:27.170354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534826439423275:2378], now have 1 active actors on pipe
2025-10-02T08:14:27.170355Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:27.170359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.170362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.170401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534825979839557:5273]
2025-10-02T08:14:27.170410Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:27.170425Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:27.170434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:27.170436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.170440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.170442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:27.170450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.170461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:27.170502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.170614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.170628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.170652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.170696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2062 partition: 0 MaxSeqNo: 17 sessionId: src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0
2025-10-02T08:14:27.170997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f03686-496e2e79-26081287-ebe9c37b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:27.170412Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2061
2025-10-02T08:14:27.173658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0] Write session: try to update token
2025-10-02T08:14:27.173674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:27.187293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId: src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:27.187638Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:27.187651Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:27.187653Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:27.187659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534825979839557:5273]
2025-10-02T08:14:27.187663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534825979839557:5273]
2025-10-02T08:14:27.187696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:27.187704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.187705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:27.187731Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:27.187738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:27.187829Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:27.189874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:27.246930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534825979839601:3106]
2025-10-02T08:14:27.247027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2061, pipe: [1:7556534825979839601:3106]
2025-10-02T08:14:27.316552Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:27.316966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.316979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.317017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979839601:3106], now have 1 active actors on pipe
2025-10-02T08:14:27.317120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:27.317130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:27.317180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2062 reason: error at write: Disconnected sessionId: src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0
2025-10-02T08:14:27.317194Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:27.317305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2062 sessionId: src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0 is DEAD
2025-10-02T08:14:27.317443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:27.317450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0] Write session will restart in 0.008222s
2025-10-02T08:14:27.317439Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:27.317448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534825979839601:3106]
2025-10-02T08:14:27.317472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0] Write session: Do CDS request
2025-10-02T08:14:27.317479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:27.327266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.327307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:27.327331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2063
2025-10-02T08:14:27.327422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.327451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:27.327458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:27.327460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:27.327783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2063 sessionId:  describe result for acl check
2025-10-02T08:14:27.327813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:27.327814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:27.327826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:27.327832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534825979839872:5298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:27.328178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534825979839872:5298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:27.328466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:27.328777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:27.328918Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:27.328926Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:27.328932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:27.328962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:27.328991Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534825979839884:5289]
2025-10-02T08:14:27.329416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:27.329591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:27.329633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:27.329858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:27.329896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.329901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.329902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.329902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.329903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.329906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.329912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.329914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.329916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.329918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.329921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.329926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.329929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.329932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.329935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.329937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.329940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.329942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.329945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.329948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.329957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:27.330556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534825979839872:5298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:27.335355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534825979839872:5298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:27.335371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534825979839872:5298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:27.335375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534825979839872:5298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:27.335383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:27.337379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:27.338914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:27.338930Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:27.338932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:27.338935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:27.338941Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2062 [1:7556534825979839884:5289]
2025-10-02T08:14:27.338951Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:27.338969Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:27.338976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.338979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.338982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.338996Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:27.339005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:27.339015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:27.339074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.339081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.339085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:27.339087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:27.339144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:27.339151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.339163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.339180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:27.339181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2062
2025-10-02T08:14:27.339201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979839924:5298], now have 1 active actors on pipe
2025-10-02T08:14:27.339209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534826439423284:2378], now have 1 active actors on pipe
2025-10-02T08:14:27.339216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.339224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.339240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534825979839875:5289]
2025-10-02T08:14:27.339245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534825979839875:5289]
2025-10-02T08:14:27.339257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:27.339273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:27.339274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:27.339277Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:27.339289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:27.339292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:27.339268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2062
2025-10-02T08:14:27.339306Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:27.339316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.339320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.339322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:27.339329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.339338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:27.339372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534825979839875:5289]
2025-10-02T08:14:27.339384Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:27.339403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.339403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:27.339493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.339500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.339513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.339548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2063 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0
2025-10-02T08:14:27.339853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b60dcfb-3ab32ee7-c0026a91-2034c7ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:27.342419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0] Write session: try to update token
2025-10-02T08:14:27.342433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:27.350079Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:27.350097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:27.350106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534825979839875:5289]
2025-10-02T08:14:27.350142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:27.350145Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:27.350297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:27.350430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:27.350561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:27.350695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:27.350874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:27.350916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:27.355471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId: src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:27.358028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:27.358085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.358099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.358137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:27.358160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:27.358207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.358222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.358381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.358446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.358522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.358585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.358818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.358829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.358893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.358947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.359006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.359070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.359112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.359119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.359182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.359243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.359301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.359359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.359401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.359407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.359468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.359526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.359591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.359654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.359699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.359705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.359770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.359843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.359902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.359963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.360007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.360015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.360078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.360139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.360212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.360271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.360312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.360318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.360379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.360436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.360500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.360563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.360607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.360616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.360678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.360734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.360793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.360936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.360980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.360987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.361053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.361109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.361170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.361228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.361272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.361280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.361342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:27.361399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:27.361459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:27.361525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:27.361575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:27.361583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:27.361615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:27.361681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.361703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.361708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:27.361735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:27.361750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:27.361753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:27.361756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:27.361759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:27.362151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:27.362182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:27.362188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:27.362198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:27.362201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:27.362204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:27.362862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:27.362889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:27.362895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:27.362898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:27.362902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:27.362904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:27.363363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:27.363385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:27.363392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:27.363395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:27.363398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:27.364552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:27.364569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:27.364578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392867364
2025-10-02T08:14:27.364724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:27.364735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:27.364739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:27.364741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:27.364743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:27.364745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:27.365179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:27.365196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:27.365200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:27.365204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:27.365206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:27.365208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:27.365593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:27.365610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:27.365616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:27.365618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:27.365620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:27.365621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:27.366023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:27.366040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:27.366044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:27.366977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:27.366991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:27.366995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:27.366999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:27.367003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392867366
2025-10-02T08:14:27.367248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:27.367262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:27.367266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:27.367269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:27.367271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:27.367272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:27.367652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:27.367672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:27.367676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:27.367678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:27.367680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:27.367682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:27.368094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:27.368110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.368187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392867367
2025-10-02T08:14:27.368870Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:27.368886Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:27.368889Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:27.368894Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:27.370299Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:27.370311Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:27.370312Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:27.370318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534825979839875:5289]
2025-10-02T08:14:27.370321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534825979839875:5289]
2025-10-02T08:14:27.370356Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:27.370361Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:27.370367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:27.370370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.370372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:27.370483Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:27.417427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534825979839948:3106]
2025-10-02T08:14:27.417564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2062, pipe: [1:7556534825979839948:3106]
2025-10-02T08:14:27.496932Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:27.497213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979839948:3106], now have 1 active actors on pipe
2025-10-02T08:14:27.497314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534825979839948:3106]
2025-10-02T08:14:27.497349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:27.497357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:27.497380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2063 reason: error at write: Disconnected sessionId: src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0
2025-10-02T08:14:27.497404Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:27.497430Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:27.497518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2063 sessionId: src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0 is DEAD
2025-10-02T08:14:27.497633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:27.497644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0] Write session will restart in 0.006780s
2025-10-02T08:14:27.497667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0] Write session: Do CDS request
2025-10-02T08:14:27.497673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:27.505195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.505309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:27.505322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2064
2025-10-02T08:14:27.505435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.505474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:27.505478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:27.505481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:27.505971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2064 sessionId:  describe result for acl check
2025-10-02T08:14:27.506000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:27.506002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:27.506003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:27.506007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534825979840223:5312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:27.506322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:27.506440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534825979840223:5312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:27.507361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:27.507524Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:27.507543Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:27.507556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:27.507606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:27.507639Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534825979840247:5306]
2025-10-02T08:14:27.508166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534825979840223:5312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:27.508236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:27.508397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:27.508437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:27.508714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:27.508748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.508753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.508754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.508755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.508756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.508760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.508767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.508771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.508774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.508777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.508781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.508787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.508792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.508796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.508814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.508819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.508822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.508826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.508832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.508836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.508852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:27.513871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534825979840223:5312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:27.513887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534825979840223:5312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:27.513891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534825979840223:5312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:27.514018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:27.516357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:27.517770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:27.517787Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:27.517790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:27.517794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:27.517799Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2063 [1:7556534825979840247:5306]
2025-10-02T08:14:27.517809Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:27.517823Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:27.517825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.517828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.517830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.517845Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:27.517857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:27.517863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:27.517920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.517929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.517932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:27.517934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:27.517995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:27.518002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.518013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.518029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:27.518041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2063
2025-10-02T08:14:27.518051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979840276:5312], now have 1 active actors on pipe
2025-10-02T08:14:27.518054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534826439423291:2378], now have 1 active actors on pipe
2025-10-02T08:14:27.518060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534825979840224:5306]
2025-10-02T08:14:27.518062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534825979840224:5306]
2025-10-02T08:14:27.518087Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:27.518102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.518106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.518113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:27.518117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:27.518124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:27.518112Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2063
2025-10-02T08:14:27.518142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:27.518152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:27.518190Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:27.518201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.518210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.518212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:27.518221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.518229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:27.518248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534825979840224:5306]
2025-10-02T08:14:27.518260Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:27.518276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:27.518287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.518337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.518345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.518359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.518394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2064 partition: 0 MaxSeqNo: 17 sessionId: src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0
2025-10-02T08:14:27.518669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff724ba-23ade9dc-48c53481-4a9498d2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:27.521132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0] Write session: try to update token
2025-10-02T08:14:27.521147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:27.533651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId: src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:27.534833Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:27.534848Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:27.534849Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:27.534855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534825979840224:5306]
2025-10-02T08:14:27.534859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534825979840224:5306]
2025-10-02T08:14:27.534894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:27.534904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.534906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:27.534915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:27.534921Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:27.535027Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:27.536185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:27.597631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534825979840290:3106]
2025-10-02T08:14:27.597741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2063, pipe: [1:7556534825979840290:3106]
2025-10-02T08:14:27.677838Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:27.678177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.678193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.678244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979840290:3106], now have 1 active actors on pipe
2025-10-02T08:14:27.678463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:27.678342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:27.678353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:27.678404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2064 reason: error at write: Disconnected sessionId: src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0
2025-10-02T08:14:27.678551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2064 sessionId: src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0 is DEAD
2025-10-02T08:14:27.678751Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:27.678755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534825979840290:3106]
2025-10-02T08:14:27.678954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:27.678965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0] Write session will restart in 0.009701s
2025-10-02T08:14:27.678999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0] Write session: Do CDS request
2025-10-02T08:14:27.679005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:27.688747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:27.689592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:27.689754Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:27.689763Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:27.689772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:27.689819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:27.689854Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534825979840576:5337]
2025-10-02T08:14:27.690222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.690311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:27.690324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2065
2025-10-02T08:14:27.690377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:27.690437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.690464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:27.690472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:27.690475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:27.690559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:27.690616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:27.690718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2065 sessionId:  describe result for acl check
2025-10-02T08:14:27.690739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:27.690742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:27.690743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:27.690746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534825979840588:5344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:27.690876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:27.690926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.690931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.690932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.690935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.690936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.690941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.690949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.690952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.690956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.690959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.690964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.690971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.690975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.690980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.690984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.690993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.690998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.691004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.691008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.691012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.691033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:27.691075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534825979840588:5344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:27.693129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534825979840588:5344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:27.698097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534825979840588:5344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:27.698116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534825979840588:5344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:27.698118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534825979840588:5344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:27.698124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:27.698592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:27.699979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:27.699991Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:27.699993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:27.699995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:27.699999Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2064 [1:7556534825979840576:5337]
2025-10-02T08:14:27.700005Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:27.700016Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:27.700017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.700019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.700021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.700031Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:27.700034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:27.700038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:27.700089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.700095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.700097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:27.700099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:27.700140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:27.700145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.700153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.700160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:27.700173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979840625:5344], now have 1 active actors on pipe
2025-10-02T08:14:27.700176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2064
2025-10-02T08:14:27.700181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534825979840570:5337]
2025-10-02T08:14:27.700182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534825979840570:5337]
2025-10-02T08:14:27.700186Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:27.700196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:27.700196Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:27.700206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:27.700217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:27.700219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:27.700223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534826439423310:2378], now have 1 active actors on pipe
2025-10-02T08:14:27.700226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.700228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.700256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534825979840570:5337]
2025-10-02T08:14:27.700264Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:27.700266Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:27.700277Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4953c40-ef60f41d-749bf563-c70a634c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:27.700286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.700289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.700290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:27.700253Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2064
2025-10-02T08:14:27.700297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.700309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:27.700348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.700392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.700398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.700410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.700440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2065 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4953c40-ef60f41d-749bf563-c70a634c_0
2025-10-02T08:14:27.700752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11dfa9ab-1839d57-a3b0d3ff-975a7a3d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4953c40-ef60f41d-749bf563-c70a634c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:27.703348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4953c40-ef60f41d-749bf563-c70a634c_0] Write session: try to update token
2025-10-02T08:14:27.703364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4953c40-ef60f41d-749bf563-c70a634c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:27.715953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId: src_id|c4953c40-ef60f41d-749bf563-c70a634c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:27.717334Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:27.717349Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:27.717351Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:27.717359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534825979840570:5337]
2025-10-02T08:14:27.717364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534825979840570:5337]
2025-10-02T08:14:27.717408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:27.717415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.717417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:27.717460Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:27.717476Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:27.717561Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:27.718438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:27.778888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534825979840651:3106]
2025-10-02T08:14:27.779018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2064, pipe: [1:7556534825979840651:3106]
2025-10-02T08:14:27.844732Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:27.844983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.844994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.845025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979840651:3106], now have 1 active actors on pipe
2025-10-02T08:14:27.845133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534825979840651:3106]
2025-10-02T08:14:27.845160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:27.845168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:27.845233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2065 reason: error at write: Disconnected sessionId: src_id|c4953c40-ef60f41d-749bf563-c70a634c_0
2025-10-02T08:14:27.845233Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:27.845376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2065 sessionId: src_id|c4953c40-ef60f41d-749bf563-c70a634c_0 is DEAD
2025-10-02T08:14:27.845516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4953c40-ef60f41d-749bf563-c70a634c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:27.845523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4953c40-ef60f41d-749bf563-c70a634c_0] Write session will restart in 0.007437s
2025-10-02T08:14:27.845540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4953c40-ef60f41d-749bf563-c70a634c_0] Write session: Do CDS request
2025-10-02T08:14:27.845545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4953c40-ef60f41d-749bf563-c70a634c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:27.845598Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:27.854274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4953c40-ef60f41d-749bf563-c70a634c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.854305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:27.854319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2066
2025-10-02T08:14:27.854452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:27.854476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:27.854485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:27.854488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:27.854591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:27.854789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2066 sessionId:  describe result for acl check
2025-10-02T08:14:27.854814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:27.854818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:27.854820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:27.854823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534825979840936:5386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:27.855172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534825979840936:5386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:27.855440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:27.855562Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:27.855568Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:27.855574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:27.855606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:27.855638Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534825979840943:5359]
2025-10-02T08:14:27.856092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:27.856235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:27.856265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:27.856515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:27.856561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.856566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.856567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.856567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.856568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.856571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.856577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.856579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.856581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.856583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.856586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.856591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:27.856595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.856597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:27.856600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.856602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:27.856604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.856607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.856611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.856613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.856624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:27.857095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534825979840936:5386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:27.862339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534825979840936:5386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:27.862352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534825979840936:5386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:27.862354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534825979840936:5386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:27.862360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:27.864519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:27.866014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:27.866029Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:27.866031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:27.866034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:27.866039Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2065 [1:7556534825979840943:5359]
2025-10-02T08:14:27.866048Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:27.866062Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:27.866064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.866067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.866069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.866080Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:27.866088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:27.866093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:27.866130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.866135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.866137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:27.866139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:27.866180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:27.866185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.866193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:27.866199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:27.866213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534825979840930:5359]
2025-10-02T08:14:27.866218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534825979840930:5359]
2025-10-02T08:14:27.866223Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:27.866231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2065
2025-10-02T08:14:27.866232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979840984:5386], now have 1 active actors on pipe
2025-10-02T08:14:27.866237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:27.866238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:27.866241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:27.866245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:27.866246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:27.866250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534826439423319:2378], now have 1 active actors on pipe
2025-10-02T08:14:27.866253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.866255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.866282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534825979840930:5359]
2025-10-02T08:14:27.866290Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:27.866297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:27.866304Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:27.866310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:27.866314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:27.866316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:27.866323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:27.866335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:27.866363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.866335Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2065
2025-10-02T08:14:27.866496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:27.866502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:27.866511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:27.866536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2066 partition: 0 MaxSeqNo: 17 sessionId: src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0
2025-10-02T08:14:27.866808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4953c40-ef60f41d-749bf563-c70a634c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:27.869388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0] Write session: try to update token
2025-10-02T08:14:27.869405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:27.882749Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:27.882767Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:27.882769Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:27.882779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534825979840930:5359]
2025-10-02T08:14:27.882782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534825979840930:5359]
2025-10-02T08:14:27.882814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:27.882823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:27.882825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:27.882948Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:27.883057Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:27.883070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:27.883232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId: src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:27.885536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:27.945284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534825979840997:3106]
2025-10-02T08:14:27.945411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2065, pipe: [1:7556534825979840997:3106]
2025-10-02T08:14:28.014401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:28.014414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0] Write session will restart in 0.009843s
2025-10-02T08:14:28.014444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0] Write session: Do CDS request
2025-10-02T08:14:28.014451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:28.014544Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:28.013559Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:28.013854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.013861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.013899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534825979840997:3106], now have 1 active actors on pipe
2025-10-02T08:14:28.014032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:28.014036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:28.014090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2066 reason: error at write: Disconnected sessionId: src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0
2025-10-02T08:14:28.014277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2066 sessionId: src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0 is DEAD
2025-10-02T08:14:28.014347Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:28.014406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534825979840997:3106]
2025-10-02T08:14:28.025029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:28.026801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:28.027005Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:28.027013Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:28.027020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:28.027061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:28.027097Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534830274808591:5390]
2025-10-02T08:14:28.027506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:28.027705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:28.027745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:28.027975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:28.028011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.028015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.028016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.028017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.028017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.028021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.028026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.028028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.028030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.028032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.028036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.028040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.028044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.028046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.028049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.028051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.028053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.028056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.028059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.028061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.028082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:28.029227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.029254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:28.029267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2067
2025-10-02T08:14:28.029410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.029437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:28.029446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:28.029449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:28.029787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2067 sessionId:  describe result for acl check
2025-10-02T08:14:28.029820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:28.029827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:28.029829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:28.029834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534830274808607:5417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:28.030231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534830274808607:5417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:28.032304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534830274808607:5417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:28.035517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534830274808607:5417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:28.035528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534830274808607:5417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:28.035532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534830274808607:5417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:28.035537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:28.036419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:28.037794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:28.037809Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:28.037812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:28.037815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:28.037820Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2066 [1:7556534830274808591:5390]
2025-10-02T08:14:28.037829Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:28.037843Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:28.037847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.037849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.037852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.037866Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:28.037872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:28.037876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:28.037927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.037934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.037937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:28.037939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:28.037984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:28.037989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.037997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.038003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:28.038017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534830274808585:5390]
2025-10-02T08:14:28.038022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534830274808585:5390]
2025-10-02T08:14:28.038028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:28.038037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:28.038040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:28.038043Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:28.038048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:28.038050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:28.038059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534830734390621:2378], now have 1 active actors on pipe
2025-10-02T08:14:28.038088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534830274808585:5390]
2025-10-02T08:14:28.038099Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:28.038109Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:28.038104Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2066
2025-10-02T08:14:28.038299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2066
2025-10-02T08:14:28.038308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274808638:5417], now have 1 active actors on pipe
2025-10-02T08:14:28.038312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.038316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.038338Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:28.038347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.038350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.038352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:28.038359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.038367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:28.038380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.038415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.038419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.038430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.038462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2067 partition: 0 MaxSeqNo: 17 sessionId: src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0
2025-10-02T08:14:28.038771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d6a5705-4227aa4e-4fa045bb-4b02863e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:28.041438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0] Write session: try to update token
2025-10-02T08:14:28.041454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:28.056791Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:28.056848Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:28.056851Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:28.056858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534830274808585:5390]
2025-10-02T08:14:28.056862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534830274808585:5390]
2025-10-02T08:14:28.056887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:28.056891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:28.056900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:28.056906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.056909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:28.057030Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:28.059873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId: src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:28.062251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:28.114233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534830274808677:3106]
2025-10-02T08:14:28.114347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2066, pipe: [1:7556534830274808677:3106]
2025-10-02T08:14:28.187262Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:28.187561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.187572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.187605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274808677:3106], now have 1 active actors on pipe
2025-10-02T08:14:28.187720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534830274808677:3106]
2025-10-02T08:14:28.187741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:28.187747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:28.187792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2067 reason: error at write: Disconnected sessionId: src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0
2025-10-02T08:14:28.187857Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:28.187851Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:28.187958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2067 sessionId: src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0 is DEAD
2025-10-02T08:14:28.188278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:28.188288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0] Write session will restart in 0.007047s
2025-10-02T08:14:28.188312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0] Write session: Do CDS request
2025-10-02T08:14:28.188319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:28.196246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.196505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:28.196522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2068
2025-10-02T08:14:28.196622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.196650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:28.196660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:28.196663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:28.197180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2068 sessionId:  describe result for acl check
2025-10-02T08:14:28.197222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:28.197223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:28.197225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:28.197229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534830274808948:5479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:28.197718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534830274808948:5479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:28.198728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:28.199914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534830274808948:5479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:28.199944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:28.200158Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:28.200167Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:28.200176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:28.200236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:28.200273Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534830274808987:5517]
2025-10-02T08:14:28.200732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:28.200933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:28.200984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:28.201401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:28.201467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.201473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.201474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.201475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.201476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.201481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.201490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.201493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.201496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.201499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.201504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.201511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.201522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.201527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.201534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.201539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.201544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.201548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.201556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.201560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.201578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:28.206519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534830274808948:5479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:28.206534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534830274808948:5479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:28.206538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534830274808948:5479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:28.206545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:28.213709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:28.216583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:28.216607Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:28.216609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:28.216613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:28.216619Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2067 [1:7556534830274808987:5517]
2025-10-02T08:14:28.216631Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:28.216647Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:28.216650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.216654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.216655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.216670Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:28.216680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:28.216687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:28.216760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.216770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.216773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:28.216775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:28.216853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:28.216861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.216875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.216892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:28.216902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2067
2025-10-02T08:14:28.216914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274809012:5479], now have 1 active actors on pipe
2025-10-02T08:14:28.216923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534830734390651:2378], now have 1 active actors on pipe
2025-10-02T08:14:28.216927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.216932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.216953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534830274808969:5517]
2025-10-02T08:14:28.216959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534830274808969:5517]
2025-10-02T08:14:28.216974Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:28.216989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:28.216990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:28.216997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:28.217004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:28.217007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:28.217021Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:28.217034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.216988Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2067
2025-10-02T08:14:28.217038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.217044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:28.217053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.217065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:28.217105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534830274808969:5517]
2025-10-02T08:14:28.217117Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:28.217128Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:28.217136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.217177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.217184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.217197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.217236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2068 partition: 0 MaxSeqNo: 17 sessionId: src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0
2025-10-02T08:14:28.217560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe7f7c4-210f05e3-949129ad-a7a9919d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:28.224460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0] Write session: try to update token
2025-10-02T08:14:28.224474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:28.234102Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:28.234118Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:28.234121Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:28.234130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534830274808969:5517]
2025-10-02T08:14:28.234135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534830274808969:5517]
2025-10-02T08:14:28.234176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:28.234178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:28.234184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:28.234193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.234196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:28.234396Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:28.237756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId: src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:28.240136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:28.287836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534830274809025:3106]
2025-10-02T08:14:28.287977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2067, pipe: [1:7556534830274809025:3106]
2025-10-02T08:14:28.361274Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:28.361646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.361662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.361702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274809025:3106], now have 1 active actors on pipe
2025-10-02T08:14:28.361856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534830274809025:3106]
2025-10-02T08:14:28.361886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:28.361890Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:28.361893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:28.361955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2068 reason: error at write: Disconnected sessionId: src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0
2025-10-02T08:14:28.361987Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:28.362129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2068 sessionId: src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0 is DEAD
2025-10-02T08:14:28.362252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:28.362263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0] Write session will restart in 0.009739s
2025-10-02T08:14:28.362286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0] Write session: Do CDS request
2025-10-02T08:14:28.362293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:28.372902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:28.373183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.373244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:28.373255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2069
2025-10-02T08:14:28.373362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.373393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:28.373402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:28.373406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:28.373710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2069 sessionId:  describe result for acl check
2025-10-02T08:14:28.373735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:28.373736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:28.373737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:28.373741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534830274809314:5493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:28.374106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534830274809314:5493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:28.374144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:28.374308Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:28.374311Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:28.374319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:28.374362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:28.374394Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534830274809320:5494]
2025-10-02T08:14:28.375013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:28.375195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:28.375241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:28.375588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:28.375635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.375642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.375643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.375644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.375645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.375650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.375660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.375664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.375668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.375672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.375677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.375684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.375689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.375698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.375702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.375707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.375712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.375721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.375726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.375736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.375756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:28.376268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534830274809314:5493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:28.381493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534830274809314:5493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:28.381508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534830274809314:5493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:28.381511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534830274809314:5493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:28.381520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:28.383326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:28.384860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:28.384878Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:28.384880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:28.384883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:28.384887Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2068 [1:7556534830274809320:5494]
2025-10-02T08:14:28.384895Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:28.384908Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:28.384910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.384912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.384913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.384925Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:28.384928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:28.384932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:28.384975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.384981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.384984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:28.384986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:28.385031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:28.385037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.385044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.385051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:28.385063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534830274809307:5494]
2025-10-02T08:14:28.385064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534830274809307:5494]
2025-10-02T08:14:28.385069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:28.385078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:28.385088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:28.385093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:28.385101Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:28.385111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:28.385120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274809361:5493], now have 1 active actors on pipe
2025-10-02T08:14:28.385121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2068
2025-10-02T08:14:28.385122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534830274809307:5494]
2025-10-02T08:14:28.385124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:28.385127Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:28.385127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534830734390657:2378], now have 1 active actors on pipe
2025-10-02T08:14:28.385137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.385140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.385162Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ef7559b-51181f2c-aec7c514-a7924086_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:28.385170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.385173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.385174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:28.385179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.385189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:28.385204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.385198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2068
2025-10-02T08:14:28.385237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.385242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.385250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.385273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2069 partition: 0 MaxSeqNo: 17 sessionId: src_id|5ef7559b-51181f2c-aec7c514-a7924086_0
2025-10-02T08:14:28.385571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3416fd39-1e472b14-e170a210-dc9a8adf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5ef7559b-51181f2c-aec7c514-a7924086_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:28.387971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef7559b-51181f2c-aec7c514-a7924086_0] Write session: try to update token
2025-10-02T08:14:28.387983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef7559b-51181f2c-aec7c514-a7924086_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:28.400832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId: src_id|5ef7559b-51181f2c-aec7c514-a7924086_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:28.403394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:28.403467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.403479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.403511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:28.403538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:28.403599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.403618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.403781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.403847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.403910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.403985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.404246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.404258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.404357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.404414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.404472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.404536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.404577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.404586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.404647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.404698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.404748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.404847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.404884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.404889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.404945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.404996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.405083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.405168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.405209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.405216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.405272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.405323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.405375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.405429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.405479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.405491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.405557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.405613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.405675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.405738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.405785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.405792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.405856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.405919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.405982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.406050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.406091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.406093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.406163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.406220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.406274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.406329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.406371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.406373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.406440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.406496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.406555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.406604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.406640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.406642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.406702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.406754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.406807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.406858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.406894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.406896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.406941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:28.406986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.407001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.407003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:28.407031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:28.407043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:28.407047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:28.407050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:28.407053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:28.407448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:28.407468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:28.407476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:28.407479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:28.407485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:28.407487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:28.407951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:28.407966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:28.407973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:28.407975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:28.407978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:28.407981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:28.408528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:28.408543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:28.408550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:28.408553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:28.408556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:28.415390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:28.415417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:28.415433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392868415
2025-10-02T08:14:28.415540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:28.415556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:28.415571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:28.415577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:28.415581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:28.415584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:28.415996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:28.416016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:28.416021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:28.416028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:28.416031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:28.416035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:28.416485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:28.416510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:28.416520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:28.416523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:28.416526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:28.416529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:28.416960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:28.416985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:28.416991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:28.417929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:28.417945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:28.417950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:28.417954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:28.417962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392868417
2025-10-02T08:14:28.418219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:28.418240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:28.418247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:28.418250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:28.418255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:28.418260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:28.418701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:28.418729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:28.418735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:28.418738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:28.418741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:28.418744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:28.419174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:28.419193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.419278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392868418
2025-10-02T08:14:28.421356Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:28.421377Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:28.421381Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:28.421385Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:28.421393Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:28.421396Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:28.421397Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:28.421402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534830274809307:5494]
2025-10-02T08:14:28.421406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534830274809307:5494]
2025-10-02T08:14:28.421466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:28.421492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:28.426770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:28.426788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.426790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:28.426930Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:28.461917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534830274809378:3106]
2025-10-02T08:14:28.462006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2068, pipe: [1:7556534830274809378:3106]
2025-10-02T08:14:28.563342Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:28.563703Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:28.563718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:28.563728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534830274809307:5494]
2025-10-02T08:14:28.563802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274809378:3106], now have 1 active actors on pipe
2025-10-02T08:14:28.564095Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:28.564101Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:28.564445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534830274809378:3106]
2025-10-02T08:14:28.564480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:28.564507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2069 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ef7559b-51181f2c-aec7c514-a7924086_0
2025-10-02T08:14:28.564676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2069 sessionId: src_id|5ef7559b-51181f2c-aec7c514-a7924086_0 is DEAD
2025-10-02T08:14:28.564899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef7559b-51181f2c-aec7c514-a7924086_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:28.564920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef7559b-51181f2c-aec7c514-a7924086_0] Write session will restart in 0.008717s
2025-10-02T08:14:28.564877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:28.564943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef7559b-51181f2c-aec7c514-a7924086_0] Write session: Do CDS request
2025-10-02T08:14:28.564949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef7559b-51181f2c-aec7c514-a7924086_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:28.569052Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [eeffe47ed88fded6] Result# TEvPutResult {Id# [72075186224037892:2068:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:28.569077Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2068:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:28.569181Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2068:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:28.575296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef7559b-51181f2c-aec7c514-a7924086_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.577464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:28.577480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2070
2025-10-02T08:14:28.579786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:28.580512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.580559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:28.580569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:28.580572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:28.581025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2070 sessionId:  describe result for acl check
2025-10-02T08:14:28.581057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:28.581063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:28.581065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:28.581071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534830274809673:5511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:28.581075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:28.581224Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:28.581235Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:28.581245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:28.581294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:28.581330Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534830274809676:5506]
2025-10-02T08:14:28.581525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534830274809673:5511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:28.581797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:28.581961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:28.582001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:28.582256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:28.582295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.582300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.582302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.582303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.582304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.582308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.582317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.582322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.582330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.582333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.582338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.582349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.582355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.582360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.582369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.582372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.582376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.582379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.582389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.582392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.582407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:28.584108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534830274809673:5511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:28.589943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534830274809673:5511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:28.589960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534830274809673:5511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:28.589966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534830274809673:5511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:28.589975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:28.592540Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2069
2025-10-02T08:14:28.590411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:28.592147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:28.592152Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:28.592155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:28.592158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:28.592163Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2069 [1:7556534830274809676:5506]
2025-10-02T08:14:28.592174Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:28.592189Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:28.592192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.592194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.592210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.592225Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:28.592229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:28.592236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:28.592292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.592294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.592297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:28.592299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:28.592365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:28.592368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.592381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.592391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:28.592406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534830274809667:5506]
2025-10-02T08:14:28.592408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534830274809667:5506]
2025-10-02T08:14:28.592413Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:28.592425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:28.592436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:28.592436Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:28.592439Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:28.592439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:28.592444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2069
2025-10-02T08:14:28.592448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274809720:5511], now have 1 active actors on pipe
2025-10-02T08:14:28.592480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534830734390664:2378], now have 1 active actors on pipe
2025-10-02T08:14:28.592484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.592487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.592498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534830274809667:5506]
2025-10-02T08:14:28.592508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:28.592523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:28.592531Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:28.592536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.592540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.592542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:28.592550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.592558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:28.592578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.592616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.592618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.592631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.592662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2070 partition: 0 MaxSeqNo: 17 sessionId: src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0
2025-10-02T08:14:28.593007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ef7559b-51181f2c-aec7c514-a7924086_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:28.595757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0] Write session: try to update token
2025-10-02T08:14:28.595774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:28.610064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId: src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:28.612501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:28.612591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.612604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.612637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:28.612660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:28.612708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.612723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.612892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.612956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.613019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.613082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.613214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.613223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.613288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.613349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.613410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.613509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.613557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.613564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.613658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.613734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.613820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.613906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.613949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.613956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.614019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.614079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.614139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.614198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.614255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.614261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.614322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.614377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.614435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.614496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.614552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.614559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.614624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.614682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.614744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.614806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.614866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.614873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.614935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.614993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.615054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.615113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.615154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.615160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.615224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.615279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.615340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.615399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.615441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.615448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.615511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.615568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.615625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.615682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.615724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.615730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.615790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:28.615848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:28.615907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:28.615964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:28.616005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:28.616013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:28.616049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:28.616111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.616134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.616140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:28.616167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:28.616184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:28.616190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:28.616193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:28.616209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:28.616569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:28.616594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:28.616603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:28.616606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:28.616608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:28.616611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:28.617142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:28.617164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:28.617171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:28.617174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:28.617176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:28.617179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:28.617606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:28.617628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:28.617633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:28.617635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:28.617639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:28.618754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:28.618772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:28.618783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392868618
2025-10-02T08:14:28.618951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:28.618966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:28.618971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:28.618974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:28.618979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:28.618982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:28.619439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:28.619458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:28.619462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:28.619467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:28.619475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:28.619478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:28.619956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:28.619975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:28.619983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:28.619986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:28.619990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:28.619993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:28.620438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:28.620458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:28.620464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:28.621565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:28.621584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:28.621589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:28.621593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:28.621603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392868621
2025-10-02T08:14:28.621897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:28.621918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:28.621923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:28.621928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:28.621932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:28.621935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:28.622416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:28.622436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:28.622441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:28.622445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:28.622449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:28.622452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:28.622910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:28.622930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.623025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392868622
2025-10-02T08:14:28.623792Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:28.623812Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:28.623820Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:28.623825Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:28.625462Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:28.625475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:28.625476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:28.625484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534830274809667:5506]
2025-10-02T08:14:28.625488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534830274809667:5506]
2025-10-02T08:14:28.625523Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:28.625537Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:28.625541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:28.625545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.625547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:28.625680Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:28.664678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534830274809742:3106]
2025-10-02T08:14:28.664817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2069, pipe: [1:7556534830274809742:3106]
2025-10-02T08:14:28.756233Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:28.756652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274809742:3106], now have 1 active actors on pipe
2025-10-02T08:14:28.756779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534830274809742:3106]
2025-10-02T08:14:28.756815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:28.756822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:28.756848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2070 reason: error at write: Disconnected sessionId: src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0
2025-10-02T08:14:28.756881Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:28.756913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:28.757053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2070 sessionId: src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0 is DEAD
2025-10-02T08:14:28.757104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:28.757110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0] Write session will restart in 0.008118s
2025-10-02T08:14:28.757127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0] Write session: Do CDS request
2025-10-02T08:14:28.757131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:28.766204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.766262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:28.766277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2071
2025-10-02T08:14:28.766399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.766426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:28.766435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:28.766438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:28.766784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2071 sessionId:  describe result for acl check
2025-10-02T08:14:28.766813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:28.766818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:28.766820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:28.766825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534830274810044:5521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:28.767072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:28.767249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534830274810044:5521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:28.768133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:28.768280Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:28.768287Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:28.768293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:28.768329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:28.768353Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534830274810069:5531]
2025-10-02T08:14:28.768727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534830274810044:5521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:28.768728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:28.768876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:28.768912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:28.769125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:28.769157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.769162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.769163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.769164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.769164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.769168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.769173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.769175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.769177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.769179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.769182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.769186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.769190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.769193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.769196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.769198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.769201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.769204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.769207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.769209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.769219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:28.774620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534830274810044:5521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:28.774634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534830274810044:5521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:28.774636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534830274810044:5521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:28.774642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:28.776676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:28.778233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:28.778251Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:28.778253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:28.778256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:28.778260Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2070 [1:7556534830274810069:5531]
2025-10-02T08:14:28.778268Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:28.778283Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:28.778286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.778289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.778291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.778306Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:28.778310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:28.778316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:28.778373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.778381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.778384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:28.778387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:28.778446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:28.778453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.778465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.778480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:28.778502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274810097:5521], now have 1 active actors on pipe
2025-10-02T08:14:28.778514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534830274810045:5531]
2025-10-02T08:14:28.778516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534830274810045:5531]
2025-10-02T08:14:28.778523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:28.778528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2070
2025-10-02T08:14:28.778531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534830734390686:2378], now have 1 active actors on pipe
2025-10-02T08:14:28.778534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:28.778537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:28.778538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:28.778550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:28.778553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:28.778559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.778562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.778598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534830274810045:5531]
2025-10-02T08:14:28.778610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:28.778610Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2070
2025-10-02T08:14:28.778621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:28.778621Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e839f46-dce1715b-b2030579-1a237328_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:28.778625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.778629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.778630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:28.778637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.778645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:28.778682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.778720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.778727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.778739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.778767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2071 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e839f46-dce1715b-b2030579-1a237328_0
2025-10-02T08:14:28.779075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cf67f5-35d47302-a3276a71-7c32b2a1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e839f46-dce1715b-b2030579-1a237328_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:28.781818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e839f46-dce1715b-b2030579-1a237328_0] Write session: try to update token
2025-10-02T08:14:28.781833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e839f46-dce1715b-b2030579-1a237328_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:28.795150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId: src_id|6e839f46-dce1715b-b2030579-1a237328_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:28.796541Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:28.796561Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:28.796564Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:28.796572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534830274810045:5531]
2025-10-02T08:14:28.796577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534830274810045:5531]
2025-10-02T08:14:28.796613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:28.796615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:28.796621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.796623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:28.796626Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:28.796755Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:28.797442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:28.857166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534830274810114:3106]
2025-10-02T08:14:28.857283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2070, pipe: [1:7556534830274810114:3106]
2025-10-02T08:14:28.929467Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:28.929760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.929771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.929803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274810114:3106], now have 1 active actors on pipe
2025-10-02T08:14:28.929907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534830274810114:3106]
2025-10-02T08:14:28.929909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:28.929913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:28.929976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2071 reason: error at write: Disconnected sessionId: src_id|6e839f46-dce1715b-b2030579-1a237328_0
2025-10-02T08:14:28.930017Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:28.930008Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:28.930138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2071 sessionId: src_id|6e839f46-dce1715b-b2030579-1a237328_0 is DEAD
2025-10-02T08:14:28.930281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e839f46-dce1715b-b2030579-1a237328_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:28.930289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e839f46-dce1715b-b2030579-1a237328_0] Write session will restart in 0.007281s
2025-10-02T08:14:28.930312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e839f46-dce1715b-b2030579-1a237328_0] Write session: Do CDS request
2025-10-02T08:14:28.930318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e839f46-dce1715b-b2030579-1a237328_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:28.938208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e839f46-dce1715b-b2030579-1a237328_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.938277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:28.938293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2072
2025-10-02T08:14:28.938405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:28.938426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:28.938432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:28.938435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:28.938832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2072 sessionId:  describe result for acl check
2025-10-02T08:14:28.938866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:28.938876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:28.938878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:28.938883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534830274810392:5556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:28.939357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534830274810392:5556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:28.939887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:28.940854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:28.941060Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:28.941071Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:28.941081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:28.941127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:28.941151Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534830274810428:5553]
2025-10-02T08:14:28.941407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534830274810392:5556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:28.941532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:28.941711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:28.941764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:28.942061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:28.942101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.942107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.942108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.942109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.942110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.942115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.942125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.942129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.942133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.942137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.942142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.942155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:28.942165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.942169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:28.942175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.942181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:28.942189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.942194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.942199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.942209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.942228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:28.946690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534830274810392:5556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:28.946704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534830274810392:5556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:28.946706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534830274810392:5556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:28.946714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:28.949906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:28.951529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:28.951544Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:28.951547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:28.951550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:28.951556Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2071 [1:7556534830274810428:5553]
2025-10-02T08:14:28.951565Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:28.951582Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:28.951584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.951586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.951588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.951603Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:28.951607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:28.951617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:28.951673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.951678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.951681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:28.951683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:28.951726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:28.951732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.951740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:28.951747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:28.951758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534830274810409:5553]
2025-10-02T08:14:28.951764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534830274810409:5553]
2025-10-02T08:14:28.951770Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:28.951782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:28.951783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534830274810456:5556], now have 1 active actors on pipe
2025-10-02T08:14:28.951788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:28.951792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:28.951801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:28.951801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2071
2025-10-02T08:14:28.951805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:28.951810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534830734390693:2378], now have 1 active actors on pipe
2025-10-02T08:14:28.951836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.951844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.951869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534830274810409:5553]
2025-10-02T08:14:28.951875Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:28.951877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:28.951861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2071
2025-10-02T08:14:28.951897Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:28.951905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:28.951907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:28.951909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:28.951914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:28.951921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:28.951943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.951987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:28.951992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:28.952001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:28.952026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2072 partition: 0 MaxSeqNo: 17 sessionId: src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0
2025-10-02T08:14:28.952320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e839f46-dce1715b-b2030579-1a237328_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:28.954781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0] Write session: try to update token
2025-10-02T08:14:28.954795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:28.967612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId: src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:28.968551Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:28.968567Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:28.968569Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:28.968577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534830274810409:5553]
2025-10-02T08:14:28.968581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534830274810409:5553]
2025-10-02T08:14:28.968619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:28.968624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:28.968630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:28.968634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:28.968636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:28.968773Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:28.970073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:29.030198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534834569777767:3106]
2025-10-02T08:14:29.030304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2071, pipe: [1:7556534834569777767:3106]
2025-10-02T08:14:29.107616Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:29.107842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.107849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.107879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569777767:3106], now have 1 active actors on pipe
2025-10-02T08:14:29.108024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534834569777767:3106]
2025-10-02T08:14:29.108038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:29.108041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:29.108085Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:29.108088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2072 reason: error at write: Disconnected sessionId: src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0
2025-10-02T08:14:29.108245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2072 sessionId: src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0 is DEAD
2025-10-02T08:14:29.108347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:29.108351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0] Write session will restart in 0.006362s
2025-10-02T08:14:29.108367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0] Write session: Do CDS request
2025-10-02T08:14:29.108375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:29.108486Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:29.118160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.118285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:29.118300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2073
2025-10-02T08:14:29.118408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.118433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:29.118437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:29.118440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:29.118960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2073 sessionId:  describe result for acl check
2025-10-02T08:14:29.119007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:29.119014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:29.119015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:29.119020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534834569778087:5616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:29.119496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534834569778087:5616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:29.120633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:29.121855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:29.122011Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:29.122014Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:29.122024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:29.122065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:29.122089Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534834569778120:5613]
2025-10-02T08:14:29.122204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534834569778087:5616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:29.122682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:29.122863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:29.122907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:29.123200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:29.123232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.123233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.123234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.123235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.123236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.123241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.123250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.123254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.123258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.123262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.123266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.123273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.123278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.123283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.123287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.123291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.123295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.123300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.123304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.123310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.123327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:29.127971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534834569778087:5616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:29.127987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534834569778087:5616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:29.127990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534834569778087:5616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:29.127998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:29.131192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:29.132759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:29.132776Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:29.132779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:29.132782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:29.132788Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2072 [1:7556534834569778120:5613]
2025-10-02T08:14:29.132819Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:29.132839Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:29.132842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.132846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.132848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.132863Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:29.132867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:29.132872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:29.132932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.132941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.132944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:29.132946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:29.133005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:29.133012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.133025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.133039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:29.133060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569778147:5616], now have 1 active actors on pipe
2025-10-02T08:14:29.133062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2072
2025-10-02T08:14:29.133071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534834569778109:5613]
2025-10-02T08:14:29.133073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534834569778109:5613]
2025-10-02T08:14:29.133084Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:29.133097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534835029358018:2378], now have 1 active actors on pipe
2025-10-02T08:14:29.133099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:29.133102Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:29.133108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.133112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.133126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:29.133147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:29.133153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:29.133161Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2072
2025-10-02T08:14:29.133190Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a7cdc56-4a575d77-22de57be-b470881f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:29.133199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.133204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.133206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:29.133214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.133221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:29.133227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534834569778109:5613]
2025-10-02T08:14:29.133238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:29.133255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:29.133268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.133312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.133319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.133333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.133365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2073 partition: 0 MaxSeqNo: 17 sessionId: src_id|7a7cdc56-4a575d77-22de57be-b470881f_0
2025-10-02T08:14:29.133663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32058beb-1bce1b9f-ada3fe0e-e993db93_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7a7cdc56-4a575d77-22de57be-b470881f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:29.136072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a7cdc56-4a575d77-22de57be-b470881f_0] Write session: try to update token
2025-10-02T08:14:29.136086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a7cdc56-4a575d77-22de57be-b470881f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:29.151693Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:29.151716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:29.151719Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:29.151727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534834569778109:5613]
2025-10-02T08:14:29.151733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534834569778109:5613]
2025-10-02T08:14:29.151773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:29.151779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.151781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:29.151781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:29.151787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:29.151911Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:29.152042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId: src_id|7a7cdc56-4a575d77-22de57be-b470881f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:29.154623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:29.208380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534834569778162:3106]
2025-10-02T08:14:29.208508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2072, pipe: [1:7556534834569778162:3106]
2025-10-02T08:14:29.298320Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:29.298706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.298726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.298780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569778162:3106], now have 1 active actors on pipe
2025-10-02T08:14:29.298899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:29.298907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:29.298961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2073 reason: error at write: Disconnected sessionId: src_id|7a7cdc56-4a575d77-22de57be-b470881f_0
2025-10-02T08:14:29.299051Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:29.299057Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:29.299302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a7cdc56-4a575d77-22de57be-b470881f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:29.299309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a7cdc56-4a575d77-22de57be-b470881f_0] Write session will restart in 0.006177s
2025-10-02T08:14:29.299333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a7cdc56-4a575d77-22de57be-b470881f_0] Write session: Do CDS request
2025-10-02T08:14:29.299339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a7cdc56-4a575d77-22de57be-b470881f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:29.299137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2073 sessionId: src_id|7a7cdc56-4a575d77-22de57be-b470881f_0 is DEAD
2025-10-02T08:14:29.299270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534834569778162:3106]
2025-10-02T08:14:29.306256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a7cdc56-4a575d77-22de57be-b470881f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.308920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:29.308939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2074
2025-10-02T08:14:29.309093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.309123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:29.309132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:29.309135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:29.309458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2074 sessionId:  describe result for acl check
2025-10-02T08:14:29.309486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:29.309492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:29.309493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:29.309497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534834569778445:5652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:29.309963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534834569778445:5652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:29.310366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:29.311355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:29.311592Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:29.311601Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:29.311610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:29.311669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:29.311706Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534834569778479:5628]
2025-10-02T08:14:29.312339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:29.312467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534834569778445:5652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:29.312496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:29.312534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:29.312843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:29.312886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.312892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.312893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.312894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.312895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.312900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.312910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.312913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.312917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.312920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.312925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.312933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.312941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.312948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.312956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.312962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.312970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.312975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.312980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.312989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.313008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:29.318955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534834569778445:5652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:29.318972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534834569778445:5652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:29.318975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534834569778445:5652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:29.318982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:29.321211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:29.322781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:29.322797Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:29.322800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:29.322803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:29.322810Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2073 [1:7556534834569778479:5628]
2025-10-02T08:14:29.322821Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:29.322838Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:29.322840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.322843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.322845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.322860Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:29.322865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:29.322872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:29.322929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.322936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.322939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:29.322941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:29.323003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:29.323010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.323022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.323033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:29.323052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534834569778460:5628]
2025-10-02T08:14:29.323057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534834569778460:5628]
2025-10-02T08:14:29.323063Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:29.323076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534835029358026:2378], now have 1 active actors on pipe
2025-10-02T08:14:29.323082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:29.323086Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:29.323092Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:29.323100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:29.323102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:29.323106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569778508:5652], now have 1 active actors on pipe
2025-10-02T08:14:29.323132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534834569778460:5628]
2025-10-02T08:14:29.323138Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:29.323176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2073
2025-10-02T08:14:29.323173Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2073
2025-10-02T08:14:29.323228Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:29.323239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.323242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.323262Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|379ccea3-154e2c83-a1b7f730-43563af5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:29.323274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.323281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.323283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:29.323289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.323300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:29.323316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.323478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.323491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.323534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.323572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2074 partition: 0 MaxSeqNo: 17 sessionId: src_id|379ccea3-154e2c83-a1b7f730-43563af5_0
2025-10-02T08:14:29.323905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a7cdc56-4a575d77-22de57be-b470881f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|379ccea3-154e2c83-a1b7f730-43563af5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:29.326553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|379ccea3-154e2c83-a1b7f730-43563af5_0] Write session: try to update token
2025-10-02T08:14:29.326568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|379ccea3-154e2c83-a1b7f730-43563af5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:29.340268Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:29.340286Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:29.340288Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:29.340297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534834569778460:5628]
2025-10-02T08:14:29.340301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534834569778460:5628]
2025-10-02T08:14:29.340342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:29.340347Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:29.340353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:29.340355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.340358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:29.340378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId: src_id|379ccea3-154e2c83-a1b7f730-43563af5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:29.340481Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:29.342759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:29.399374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534834569778522:3106]
2025-10-02T08:14:29.399500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2073, pipe: [1:7556534834569778522:3106]
2025-10-02T08:14:29.473051Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:29.473272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.473284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.473315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569778522:3106], now have 1 active actors on pipe
2025-10-02T08:14:29.473386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:29.473392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:29.473432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2074 reason: error at write: Disconnected sessionId: src_id|379ccea3-154e2c83-a1b7f730-43563af5_0
2025-10-02T08:14:29.473518Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:29.473535Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:29.473591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2074 sessionId: src_id|379ccea3-154e2c83-a1b7f730-43563af5_0 is DEAD
2025-10-02T08:14:29.473732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379ccea3-154e2c83-a1b7f730-43563af5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:29.473741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379ccea3-154e2c83-a1b7f730-43563af5_0] Write session will restart in 0.005137s
2025-10-02T08:14:29.473763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379ccea3-154e2c83-a1b7f730-43563af5_0] Write session: Do CDS request
2025-10-02T08:14:29.473770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379ccea3-154e2c83-a1b7f730-43563af5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:29.473754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534834569778522:3106]
2025-10-02T08:14:29.480247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|379ccea3-154e2c83-a1b7f730-43563af5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.480258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:29.480274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2075
2025-10-02T08:14:29.480429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.480456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:29.480464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:29.480467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:29.480787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2075 sessionId:  describe result for acl check
2025-10-02T08:14:29.480828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:29.480833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:29.480835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:29.480840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534834569778712:5656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:29.481262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534834569778712:5656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:29.484431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534834569778712:5656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:29.486176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:29.487157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:29.487321Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:29.487330Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:29.487339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:29.487380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:29.487417Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534834569778855:5654]
2025-10-02T08:14:29.487512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534834569778712:5656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:29.487524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534834569778712:5656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:29.487526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534834569778712:5656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:29.487531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:29.488008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:29.488188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:29.488239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:29.488535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:29.488577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.488583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.488584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.488587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.488588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.488593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.488602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.488610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.488616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.488624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.488629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.488636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.488645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.488653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.488661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.488667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.488674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.488679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.488688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.488697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.488719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:29.496372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:29.498000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:29.498022Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:29.498025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:29.498029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:29.498035Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2074 [1:7556534834569778855:5654]
2025-10-02T08:14:29.498046Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:29.498063Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:29.498066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.498069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.498071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.498091Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:29.498101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:29.498108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:29.498176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.498184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.498187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:29.498189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:29.498251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:29.498259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.498274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.498292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:29.498310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569778860:5656], now have 1 active actors on pipe
2025-10-02T08:14:29.498320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534834569778849:5654]
2025-10-02T08:14:29.498323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534834569778849:5654]
2025-10-02T08:14:29.498328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2074
2025-10-02T08:14:29.498329Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:29.498339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534835029358033:2378], now have 1 active actors on pipe
2025-10-02T08:14:29.498341Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:29.498344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:29.498344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:29.498361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:29.498363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:29.498370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.498374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.498411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534834569778849:5654]
2025-10-02T08:14:29.498424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:29.498437Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:29.498441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:29.498448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.498452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.498454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:29.498462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.498474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:29.498440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2074
2025-10-02T08:14:29.498521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.498571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.498577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.498591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.498630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2075 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0
2025-10-02T08:14:29.498970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379ccea3-154e2c83-a1b7f730-43563af5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:29.501541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0] Write session: try to update token
2025-10-02T08:14:29.501556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:29.514906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId: src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:29.516531Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:29.516545Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:29.516546Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:29.516554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534834569778849:5654]
2025-10-02T08:14:29.516558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534834569778849:5654]
2025-10-02T08:14:29.516607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:29.516612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:29.516615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.516616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:29.516618Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:29.516763Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:29.517461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:29.573948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534834569778889:3106]
2025-10-02T08:14:29.574066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2074, pipe: [1:7556534834569778889:3106]
2025-10-02T08:14:29.648440Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:29.648848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.648860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.648895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569778889:3106], now have 1 active actors on pipe
2025-10-02T08:14:29.648997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534834569778889:3106]
2025-10-02T08:14:29.649017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:29.649019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:29.649068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2075 reason: error at write: Disconnected sessionId: src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0
2025-10-02T08:14:29.649110Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:29.649157Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:29.649239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2075 sessionId: src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0 is DEAD
2025-10-02T08:14:29.649394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:29.649405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0] Write session will restart in 0.005712s
2025-10-02T08:14:29.649432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0] Write session: Do CDS request
2025-10-02T08:14:29.649438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:29.657185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.657331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:29.657348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2076
2025-10-02T08:14:29.658603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.658638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:29.658647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:29.658650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:29.658995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2076 sessionId:  describe result for acl check
2025-10-02T08:14:29.659027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:29.659032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:29.659034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:29.659038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534834569779187:5710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:29.659159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:29.659818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:29.659997Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:29.660008Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:29.660018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:29.660073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:29.660114Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534834569779195:5690]
2025-10-02T08:14:29.660668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:29.660722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534834569779187:5710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:29.660870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:29.660917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:29.661216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:29.661277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.661284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.661285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.661286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.661287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.661292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.661302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.661306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.661309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.661313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.661318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.661325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.661331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.661337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.661341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.661346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.661350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.661355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.661359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.661363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.661383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:29.662830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534834569779187:5710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:29.667868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534834569779187:5710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:29.667882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534834569779187:5710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:29.667886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534834569779187:5710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:29.667894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:29.669512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:29.670936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:29.670947Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:29.670949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:29.670951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:29.670955Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2075 [1:7556534834569779195:5690]
2025-10-02T08:14:29.670963Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:29.670974Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:29.670976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.670978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.670979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.670991Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:29.670994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:29.670999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:29.671038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.671044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.671046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:29.671049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:29.671092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:29.671099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.671110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.671123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:29.671138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569779242:5710], now have 1 active actors on pipe
2025-10-02T08:14:29.671147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534834569779188:5690]
2025-10-02T08:14:29.671148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534834569779188:5690]
2025-10-02T08:14:29.671148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2075
2025-10-02T08:14:29.671154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:29.671160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534835029358052:2378], now have 1 active actors on pipe
2025-10-02T08:14:29.671162Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:29.671164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:29.671166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:29.671177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:29.671183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:29.671189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.671193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.671226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534834569779188:5690]
2025-10-02T08:14:29.671232Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:29.671244Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|203af882-dd92bedc-fef7cf0-20554403_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:29.671251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:29.671225Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2075
2025-10-02T08:14:29.671252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.671255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.671256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:29.671262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.671269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:29.671327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.671375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.671379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.671388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.671412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2076 partition: 0 MaxSeqNo: 17 sessionId: src_id|203af882-dd92bedc-fef7cf0-20554403_0
2025-10-02T08:14:29.671669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1c8cf0-5f0d9a9f-72df7571-295feec5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|203af882-dd92bedc-fef7cf0-20554403_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:29.674291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|203af882-dd92bedc-fef7cf0-20554403_0] Write session: try to update token
2025-10-02T08:14:29.674304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|203af882-dd92bedc-fef7cf0-20554403_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:29.687203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId: src_id|203af882-dd92bedc-fef7cf0-20554403_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:29.688388Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:29.688391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:29.688394Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:29.688402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534834569779188:5690]
2025-10-02T08:14:29.688406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534834569779188:5690]
2025-10-02T08:14:29.688449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:29.688455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.688457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:29.688457Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:29.688464Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:29.688594Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:29.689678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:29.749060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534834569779268:3106]
2025-10-02T08:14:29.749175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2075, pipe: [1:7556534834569779268:3106]
2025-10-02T08:14:29.821153Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:29.821384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.821396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.821428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569779268:3106], now have 1 active actors on pipe
2025-10-02T08:14:29.821529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534834569779268:3106]
2025-10-02T08:14:29.821550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:29.821556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:29.821608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2076 reason: error at write: Disconnected sessionId: src_id|203af882-dd92bedc-fef7cf0-20554403_0
2025-10-02T08:14:29.821635Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:29.821778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2076 sessionId: src_id|203af882-dd92bedc-fef7cf0-20554403_0 is DEAD
2025-10-02T08:14:29.821927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|203af882-dd92bedc-fef7cf0-20554403_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:29.821937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|203af882-dd92bedc-fef7cf0-20554403_0] Write session will restart in 0.005808s
2025-10-02T08:14:29.821957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|203af882-dd92bedc-fef7cf0-20554403_0] Write session: Do CDS request
2025-10-02T08:14:29.821964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|203af882-dd92bedc-fef7cf0-20554403_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:29.822402Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:29.829166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|203af882-dd92bedc-fef7cf0-20554403_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.829200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:29.829215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2077
2025-10-02T08:14:29.829348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:29.829378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:29.829387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:29.829389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:29.829766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2077 sessionId:  describe result for acl check
2025-10-02T08:14:29.829793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:29.829794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:29.829796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:29.829800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534834569779547:5738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:29.830254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534834569779547:5738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:29.831764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:29.832579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534834569779547:5738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:29.832833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:29.832973Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:29.832982Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:29.832991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:29.833031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:29.833068Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534834569779601:5739]
2025-10-02T08:14:29.833512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:29.833702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:29.833770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:29.834085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:29.834126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.834131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.834132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.834133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.834134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.834140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.834148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.834152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.834156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.834159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.834164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.834176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:29.834185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.834190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:29.834201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.834206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:29.834211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.834216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.834220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.834227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.834247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:29.838936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534834569779547:5738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:29.838966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534834569779547:5738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:29.838969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534834569779547:5738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:29.838977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:29.842054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:29.843600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:29.843614Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:29.843616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:29.843621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:29.843627Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2076 [1:7556534834569779601:5739]
2025-10-02T08:14:29.843637Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:29.843656Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:29.843662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.843665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.843667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.843682Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:29.843688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:29.843695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:29.843751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.843757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.843760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:29.843764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:29.843822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:29.843829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.843843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:29.843859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:29.843878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2076
2025-10-02T08:14:29.843880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569779623:5738], now have 1 active actors on pipe
2025-10-02T08:14:29.843886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534834569779585:5739]
2025-10-02T08:14:29.843888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534834569779585:5739]
2025-10-02T08:14:29.843894Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:29.843901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534835029358060:2378], now have 1 active actors on pipe
2025-10-02T08:14:29.843908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:29.843924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:29.843932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:29.843934Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:29.843937Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:29.843938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.843942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.843977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534834569779585:5739]
2025-10-02T08:14:29.843983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:29.843989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:29.843996Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:29.844007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:29.844014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:29.843974Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2076
2025-10-02T08:14:29.844015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:29.844023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:29.844031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:29.844066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.844109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.844115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.844125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:29.844158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2077 partition: 0 MaxSeqNo: 17 sessionId: src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0
2025-10-02T08:14:29.844491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|203af882-dd92bedc-fef7cf0-20554403_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:29.846981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0] Write session: try to update token
2025-10-02T08:14:29.846996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:29.860350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId: src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:29.860973Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:29.860988Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:29.860990Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:29.860998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534834569779585:5739]
2025-10-02T08:14:29.861002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534834569779585:5739]
2025-10-02T08:14:29.861042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:29.861052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:29.861054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:29.861053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:29.861059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:29.861237Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:29.862790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:29.921616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534834569779637:3106]
2025-10-02T08:14:29.921736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2076, pipe: [1:7556534834569779637:3106]
2025-10-02T08:14:29.995944Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:29.996195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:29.996221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:29.996254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534834569779637:3106], now have 1 active actors on pipe
2025-10-02T08:14:29.996369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534834569779637:3106]
2025-10-02T08:14:29.996394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:29.996400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:29.996434Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:29.996458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2077 reason: error at write: Disconnected sessionId: src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0
2025-10-02T08:14:29.996496Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:29.996612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2077 sessionId: src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0 is DEAD
2025-10-02T08:14:29.996752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:29.996759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0] Write session will restart in 0.007282s
2025-10-02T08:14:29.996780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0] Write session: Do CDS request
2025-10-02T08:14:29.996786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:30.005263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.005343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:30.005359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2078
2025-10-02T08:14:30.005492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.005516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:30.005521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:30.005524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:30.006049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2078 sessionId:  describe result for acl check
2025-10-02T08:14:30.006084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:30.006090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:30.006092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:30.006097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534838864747216:5771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:30.006623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534838864747216:5771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:30.008229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:30.009769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:30.010067Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:30.010082Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:30.010093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:30.010160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:30.010202Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534838864747260:5772]
2025-10-02T08:14:30.010813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534838864747216:5771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:30.010819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:30.011012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:30.011068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:30.011524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:30.011595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.011600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.011602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.011603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.011604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.011611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.011619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.011622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.011626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.011629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.011635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.011642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.011652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.011657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.011661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.011665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.011669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.011673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.011677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.011681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.011700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:30.016679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534838864747216:5771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:30.016697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534838864747216:5771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:30.016701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534838864747216:5771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:30.016709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:30.019879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:30.021613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:30.021635Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:30.021638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:30.021642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:30.021649Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2077 [1:7556534838864747260:5772]
2025-10-02T08:14:30.021663Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:30.021681Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:30.021684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.021687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.021689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.021706Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:30.021711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:30.021717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:30.021787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.021799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.021802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:30.021804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:30.021865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:30.021874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.021888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.021901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:30.021919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864747287:5771], now have 1 active actors on pipe
2025-10-02T08:14:30.021925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534838864747240:5772]
2025-10-02T08:14:30.021927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534838864747240:5772]
2025-10-02T08:14:30.021935Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:30.021944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2077
2025-10-02T08:14:30.021945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534835029358066:2378], now have 1 active actors on pipe
2025-10-02T08:14:30.021945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:30.021949Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:30.021951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:30.021966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:30.021969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:30.021976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.021986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.022027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534838864747240:5772]
2025-10-02T08:14:30.022036Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:30.022050Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23df7c14-2f230712-cdca85ce-27da3994_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:30.022051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:30.022060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.022063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.022065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:30.022017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2077
2025-10-02T08:14:30.022074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.022084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:30.022130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.022198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.022207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.022223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.022260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2078 partition: 0 MaxSeqNo: 17 sessionId: src_id|23df7c14-2f230712-cdca85ce-27da3994_0
2025-10-02T08:14:30.022575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e6a0-b0b8a927-2352d3e6-23b52fcf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|23df7c14-2f230712-cdca85ce-27da3994_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:30.025247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23df7c14-2f230712-cdca85ce-27da3994_0] Write session: try to update token
2025-10-02T08:14:30.025268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23df7c14-2f230712-cdca85ce-27da3994_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:30.039376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId: src_id|23df7c14-2f230712-cdca85ce-27da3994_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:30.042027Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:30.042051Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:30.042054Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:30.042062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534838864747240:5772]
2025-10-02T08:14:30.042068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534838864747240:5772]
2025-10-02T08:14:30.042110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:30.042116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.042119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:30.042119Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:30.042123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:30.042124Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:30.042259Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:30.096715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534838864747303:3106]
2025-10-02T08:14:30.096867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2077, pipe: [1:7556534838864747303:3106]
2025-10-02T08:14:30.193988Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:30.194348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.194363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.194401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864747303:3106], now have 1 active actors on pipe
2025-10-02T08:14:30.194551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534838864747303:3106]
2025-10-02T08:14:30.194581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:30.194588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:30.194614Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:30.194648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2078 reason: error at write: Disconnected sessionId: src_id|23df7c14-2f230712-cdca85ce-27da3994_0
2025-10-02T08:14:30.194677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:30.194795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2078 sessionId: src_id|23df7c14-2f230712-cdca85ce-27da3994_0 is DEAD
2025-10-02T08:14:30.194963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23df7c14-2f230712-cdca85ce-27da3994_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:30.194975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23df7c14-2f230712-cdca85ce-27da3994_0] Write session will restart in 0.006316s
2025-10-02T08:14:30.195000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23df7c14-2f230712-cdca85ce-27da3994_0] Write session: Do CDS request
2025-10-02T08:14:30.195007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23df7c14-2f230712-cdca85ce-27da3994_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:30.202243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23df7c14-2f230712-cdca85ce-27da3994_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.202320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:30.202487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2079
2025-10-02T08:14:30.202613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.202650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:30.202655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:30.202659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:30.203240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2079 sessionId:  describe result for acl check
2025-10-02T08:14:30.203270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:30.203276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:30.203277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:30.203282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534838864747598:5821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:30.203738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534838864747598:5821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:30.206006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:30.206121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534838864747598:5821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:30.207331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:30.207500Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:30.207510Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:30.207519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:30.207561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:30.207594Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534838864747677:5828]
2025-10-02T08:14:30.208175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:30.208355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:30.208404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:30.208622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534838864747598:5821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:30.208635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534838864747598:5821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:30.208638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534838864747598:5821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:30.208646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:30.208693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:30.208731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.208736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.208737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.208738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.208739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.208744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.208752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.208757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.208761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.208764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.208769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.208776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.208785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.208790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.208795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.208817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.208825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.208831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.208840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.208846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.208868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:30.216740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:30.218453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:30.218473Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:30.218474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:30.218478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:30.218482Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2078 [1:7556534838864747677:5828]
2025-10-02T08:14:30.218491Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:30.218506Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:30.218508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.218510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.218511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.218524Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:30.218527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:30.218532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:30.218580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.218586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.218588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:30.218589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:30.218641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:30.218651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.218663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.218674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:30.218692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864747689:5821], now have 1 active actors on pipe
2025-10-02T08:14:30.218698Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534838864747660:5828]
2025-10-02T08:14:30.218700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534838864747660:5828]
2025-10-02T08:14:30.218707Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:30.218717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2078
2025-10-02T08:14:30.218718Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:30.218721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:30.218721Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:30.218735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:30.218738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:30.218743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534839324325393:2378], now have 1 active actors on pipe
2025-10-02T08:14:30.218748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.218752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.218796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534838864747660:5828]
2025-10-02T08:14:30.218810Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:30.218820Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:30.218828Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9449a672-bb7c1467-e56db98d-83f599b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:30.218833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.218837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.218839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:30.218847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.218856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:30.218846Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2078
2025-10-02T08:14:30.218882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.218957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.218963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.218974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.219002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2079 partition: 0 MaxSeqNo: 17 sessionId: src_id|9449a672-bb7c1467-e56db98d-83f599b4_0
2025-10-02T08:14:30.219303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23df7c14-2f230712-cdca85ce-27da3994_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9449a672-bb7c1467-e56db98d-83f599b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:30.221974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9449a672-bb7c1467-e56db98d-83f599b4_0] Write session: try to update token
2025-10-02T08:14:30.221991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9449a672-bb7c1467-e56db98d-83f599b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:30.230401Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:30.230422Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:30.230429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534838864747660:5828]
2025-10-02T08:14:30.230463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:30.230469Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:30.230621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:30.230759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:30.230897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:30.231026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:30.231197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:30.231241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:30.235213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId: src_id|9449a672-bb7c1467-e56db98d-83f599b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:30.237774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:30.237837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.237849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.237880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:30.237902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:30.237951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.237967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.238136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.238206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.238278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.238351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.238506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.238517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.238625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.238688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.238753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.238816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.238858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.238868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.238937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.239004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.239072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.239139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.239183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.239189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.239253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.239311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.239368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.239428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.239471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.239477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.239545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.239612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.239673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.239732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.239775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.239781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.239844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.239902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.239974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.240042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.240088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.240096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.240163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.240241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.240314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.240380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.240427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.240436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.240507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.240569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.240633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.240698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.240749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.240757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.240838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.240901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.240963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.241032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.241177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.241186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.241258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.241322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.241385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.241443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.241551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.241559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.241600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:30.241667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.241684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.241686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:30.241710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:30.241725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:30.241727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:30.241729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:30.241731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:30.242102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:30.242132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:30.242137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:30.242139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:30.242141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:30.242143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:30.242694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:30.242717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:30.242722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:30.242724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:30.242726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:30.242730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:30.243263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:30.243285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:30.243289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:30.243294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:30.243297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:30.244528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:30.244545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:30.244556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392870244
2025-10-02T08:14:30.244667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:30.244680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:30.244686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:30.244689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:30.244693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:30.244696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:30.245205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:30.245232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:30.245238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:30.245242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:30.245246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:30.245249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:30.245729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:30.245753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:30.245760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:30.245763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:30.245769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:30.245772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:30.246355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:30.246379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:30.246384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:30.247508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:30.247528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:30.247533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:30.247537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:30.247545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392870247
2025-10-02T08:14:30.247853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:30.247877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:30.247883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:30.247887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:30.247890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:30.247894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:30.248394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:30.248418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:30.248424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:30.248433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:30.248436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:30.248441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:30.248939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:30.248966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.249081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392870248
2025-10-02T08:14:30.249861Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:30.249882Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:30.249892Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:30.249904Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:30.251529Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:30.251544Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:30.251546Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:30.251553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534838864747660:5828]
2025-10-02T08:14:30.251557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534838864747660:5828]
2025-10-02T08:14:30.251609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:30.251613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:30.251618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.251620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:30.251624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:30.251751Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:30.294865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534838864747714:3106]
2025-10-02T08:14:30.294989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2078, pipe: [1:7556534838864747714:3106]
2025-10-02T08:14:30.387121Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:30.387464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864747714:3106], now have 1 active actors on pipe
2025-10-02T08:14:30.387610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534838864747714:3106]
2025-10-02T08:14:30.387651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:30.387658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:30.387682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2079 reason: error at write: Disconnected sessionId: src_id|9449a672-bb7c1467-e56db98d-83f599b4_0
2025-10-02T08:14:30.387743Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:30.387801Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:30.387844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2079 sessionId: src_id|9449a672-bb7c1467-e56db98d-83f599b4_0 is DEAD
2025-10-02T08:14:30.387999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9449a672-bb7c1467-e56db98d-83f599b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:30.388009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9449a672-bb7c1467-e56db98d-83f599b4_0] Write session will restart in 0.006401s
2025-10-02T08:14:30.388032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9449a672-bb7c1467-e56db98d-83f599b4_0] Write session: Do CDS request
2025-10-02T08:14:30.388038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9449a672-bb7c1467-e56db98d-83f599b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:30.395223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9449a672-bb7c1467-e56db98d-83f599b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.395281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:30.395292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2080
2025-10-02T08:14:30.395401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.395422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:30.395429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:30.395432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:30.395742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2080 sessionId:  describe result for acl check
2025-10-02T08:14:30.395768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:30.395772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:30.395773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:30.395776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534838864747946:5858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:30.396254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534838864747946:5858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:30.399312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534838864747946:5858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:30.399711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:30.400752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:30.400938Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:30.400946Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:30.400954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:30.400991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:30.401049Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534838864748055:5850]
2025-10-02T08:14:30.401460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:30.401591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:30.401619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:30.401800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:30.401827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.401831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.401832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.401832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.401833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.401836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.401841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.401843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.401845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.401847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.401850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.401854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.401857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.401861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.401867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.401869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.401871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.401874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.401876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.401878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.401886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:30.401981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534838864747946:5858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:30.401994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534838864747946:5858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:30.401997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534838864747946:5858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:30.402005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:30.409254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:30.410648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:30.410664Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:30.410666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:30.410668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:30.410673Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2079 [1:7556534838864748055:5850]
2025-10-02T08:14:30.410681Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:30.410695Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:30.410697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.410699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.410700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.410711Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:30.410714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:30.410719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:30.410764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.410770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.410773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:30.410774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:30.410829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:30.410837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.410848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.410860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:30.410876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864748072:5858], now have 1 active actors on pipe
2025-10-02T08:14:30.410885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534838864748041:5850]
2025-10-02T08:14:30.410887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534838864748041:5850]
2025-10-02T08:14:30.410891Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:30.410899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:30.410901Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:30.410903Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:30.410910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:30.410911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2079
2025-10-02T08:14:30.410912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:30.410917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534839324325400:2378], now have 1 active actors on pipe
2025-10-02T08:14:30.410939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.410945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.410956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534838864748041:5850]
2025-10-02T08:14:30.410964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:30.410972Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:30.410982Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:30.410985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.410991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.410992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:30.410998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.411008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:30.410965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2079
2025-10-02T08:14:30.411026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.411056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.411060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.411069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.411097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2080 partition: 0 MaxSeqNo: 17 sessionId: src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0
2025-10-02T08:14:30.411403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9449a672-bb7c1467-e56db98d-83f599b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:30.414013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0] Write session: try to update token
2025-10-02T08:14:30.414026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:30.428966Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:30.428989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:30.428992Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:30.429000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534838864748041:5850]
2025-10-02T08:14:30.429004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534838864748041:5850]
2025-10-02T08:14:30.429054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:30.429056Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:30.429062Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:30.429066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.429068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:30.429218Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:30.429861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId: src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:30.432433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:30.487887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534838864748087:3106]
2025-10-02T08:14:30.488028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2079, pipe: [1:7556534838864748087:3106]
2025-10-02T08:14:30.557121Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:30.557474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.557485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.557523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864748087:3106], now have 1 active actors on pipe
2025-10-02T08:14:30.557738Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:30.557932Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:30.558216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:30.558221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534838864748087:3106]
2025-10-02T08:14:30.558269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2080 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0
2025-10-02T08:14:30.558431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2080 sessionId: src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0 is DEAD
2025-10-02T08:14:30.558561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:30.558572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0] Write session will restart in 0.008686s
2025-10-02T08:14:30.558598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0] Write session: Do CDS request
2025-10-02T08:14:30.558603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:30.568272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.568338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:30.568353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2081
2025-10-02T08:14:30.568455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.568491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:30.568503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:30.568507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:30.568855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2081 sessionId:  describe result for acl check
2025-10-02T08:14:30.568888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:30.568892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:30.568893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:30.568897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534838864748395:5888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:30.568959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:30.569289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534838864748395:5888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:30.570118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:30.570308Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:30.570311Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:30.570319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:30.570360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:30.570392Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534838864748418:5848]
2025-10-02T08:14:30.570865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:30.571025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:30.571078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:30.571107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534838864748395:5888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:30.571369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:30.571429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.571434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.571435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.571436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.571438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.571442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.571450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.571453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.571458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.571462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.571466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.571473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.571478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.571482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.571485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.571490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.571493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.571497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.571501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.571505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.571522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:30.577317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534838864748395:5888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:30.577334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534838864748395:5888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:30.577338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534838864748395:5888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:30.577346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:30.579388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:30.581045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:30.581060Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:30.581062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:30.581066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:30.581072Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2080 [1:7556534838864748418:5848]
2025-10-02T08:14:30.581086Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:30.581100Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:30.581103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.581106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.581108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.581122Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:30.581127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:30.581138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:30.581201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.581208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.581210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:30.581213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:30.581275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:30.581282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.581294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.581312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:30.581332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864748447:5888], now have 1 active actors on pipe
2025-10-02T08:14:30.581332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2080
2025-10-02T08:14:30.581339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534839324325407:2378], now have 1 active actors on pipe
2025-10-02T08:14:30.581345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534838864748394:5848]
2025-10-02T08:14:30.581347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534838864748394:5848]
2025-10-02T08:14:30.581356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:30.581364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.581370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.581373Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:30.581376Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:30.581386Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:30.581403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:30.581409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:30.581446Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a46cb37d-f8969848-96da891d-24919efc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:30.581456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.581460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.581466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:30.581414Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2080
2025-10-02T08:14:30.581474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.581486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:30.581497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534838864748394:5848]
2025-10-02T08:14:30.581507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:30.581515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:30.581538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.581586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.581593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.581604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.581640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2081 partition: 0 MaxSeqNo: 17 sessionId: src_id|a46cb37d-f8969848-96da891d-24919efc_0
2025-10-02T08:14:30.581987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2004dffb-aa0ca5b0-3044fbc2-9aba58c7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a46cb37d-f8969848-96da891d-24919efc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:30.584431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46cb37d-f8969848-96da891d-24919efc_0] Write session: try to update token
2025-10-02T08:14:30.584444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46cb37d-f8969848-96da891d-24919efc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:30.598990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId: src_id|a46cb37d-f8969848-96da891d-24919efc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:30.599484Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:30.599499Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:30.599504Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:30.599512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534838864748394:5848]
2025-10-02T08:14:30.599516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534838864748394:5848]
2025-10-02T08:14:30.599551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:30.599562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:30.599568Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:30.599568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.599570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:30.599701Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:30.601762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:30.658387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534838864748460:3106]
2025-10-02T08:14:30.658529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2080, pipe: [1:7556534838864748460:3106]
2025-10-02T08:14:30.733001Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:30.733252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.733275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.733315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864748460:3106], now have 1 active actors on pipe
2025-10-02T08:14:30.733447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534838864748460:3106]
2025-10-02T08:14:30.733469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:30.733470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:30.733521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2081 reason: error at write: Disconnected sessionId: src_id|a46cb37d-f8969848-96da891d-24919efc_0
2025-10-02T08:14:30.733563Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:30.733675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2081 sessionId: src_id|a46cb37d-f8969848-96da891d-24919efc_0 is DEAD
2025-10-02T08:14:30.733780Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:30.733829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46cb37d-f8969848-96da891d-24919efc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:30.733839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46cb37d-f8969848-96da891d-24919efc_0] Write session will restart in 0.006948s
2025-10-02T08:14:30.733865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46cb37d-f8969848-96da891d-24919efc_0] Write session: Do CDS request
2025-10-02T08:14:30.733871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46cb37d-f8969848-96da891d-24919efc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:30.742222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46cb37d-f8969848-96da891d-24919efc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.742260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:30.742283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2082
2025-10-02T08:14:30.742432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.742461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:30.742471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:30.742474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:30.742995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2082 sessionId:  describe result for acl check
2025-10-02T08:14:30.743025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:30.743031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:30.743033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:30.743039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534838864748764:5902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:30.743560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534838864748764:5902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:30.745488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:30.746141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534838864748764:5902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:30.746693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:30.746858Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:30.746870Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:30.746878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:30.746920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:30.746958Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534838864748820:5901]
2025-10-02T08:14:30.747582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:30.747784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:30.747831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:30.748228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:30.748284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.748291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.748292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.748293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.748294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.748299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.748307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.748311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.748314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.748317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.748323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.748329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.748334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.748339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.748342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.748347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.748351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.748355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.748360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.748363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.748378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:30.748742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534838864748764:5902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:30.748755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534838864748764:5902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:30.748758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534838864748764:5902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:30.748765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:30.756236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:30.757795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:30.757814Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:30.757816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:30.757822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:30.757827Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2081 [1:7556534838864748820:5901]
2025-10-02T08:14:30.757834Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:30.757849Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:30.757851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.757853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.757854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.757867Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:30.757870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:30.757875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:30.757927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.757933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.757935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:30.757936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:30.757989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:30.757998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.758007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.758014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:30.758027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534838864748804:5901]
2025-10-02T08:14:30.758028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534838864748804:5901]
2025-10-02T08:14:30.758035Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:30.758046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864748837:5902], now have 1 active actors on pipe
2025-10-02T08:14:30.758054Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:30.758055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:30.758057Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:30.758058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2081
2025-10-02T08:14:30.758063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:30.758066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:30.758092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534839324325426:2378], now have 1 active actors on pipe
2025-10-02T08:14:30.758096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.758103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.758113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534838864748804:5901]
2025-10-02T08:14:30.758125Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:30.758148Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:30.758155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.758158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.758159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:30.758136Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2081
2025-10-02T08:14:30.758163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:30.758165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.758172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:30.758186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.758254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.758259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.758268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.758302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2082 partition: 0 MaxSeqNo: 17 sessionId: src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0
2025-10-02T08:14:30.758625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46cb37d-f8969848-96da891d-24919efc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:30.761333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0] Write session: try to update token
2025-10-02T08:14:30.761359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:30.769362Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:30.769378Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:30.769386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534838864748804:5901]
2025-10-02T08:14:30.769427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:30.769432Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:30.769604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:30.769743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:30.769879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:30.770017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:30.770214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:30.770256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:30.779175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId: src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:30.781754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:30.781832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.781844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.781881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:30.781909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:30.781961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.781990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.782196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.782268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.782342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.782405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.782717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.782727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.782787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.782840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.782897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.782952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.782993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.782998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.783057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.783122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.783172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.783223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.783282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.783288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.783347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.783401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.783456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.783510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.783553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.783561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.783634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.783698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.783759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.783817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.783858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.783863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.783922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.783974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.784031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.784100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.784150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.784157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.784232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.784286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.784347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.784406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.784447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.784454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.784513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.784572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.784635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.784700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.784743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.784749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.784832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.784897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.784952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.785008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.785051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.785058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.785124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:30.785183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:30.785256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:30.785315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:30.785359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:30.785365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:30.785420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:30.785473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.785489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.785495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:30.785520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:30.785533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:30.785539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:30.785541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:30.785543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:30.785953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:30.785976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:30.785982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:30.785985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:30.785987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:30.785989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:30.786458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:30.786480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:30.786486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:30.786490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:30.786495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:30.786496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:30.787221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:30.787248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:30.787253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:30.787257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:30.787260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:30.788493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:30.788511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:30.788525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392870788
2025-10-02T08:14:30.788688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:30.788704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:30.788709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:30.788712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:30.788718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:30.788723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:30.789264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:30.789287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:30.789292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:30.789296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:30.789301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:30.789306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:30.789774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:30.789795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:30.789800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:30.789802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:30.789804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:30.789806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:30.790245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:30.790264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:30.790269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:30.791321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:30.791337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:30.791342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:30.791345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:30.791353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392870790
2025-10-02T08:14:30.791636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:30.791656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:30.791666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:30.791673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:30.791677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:30.791680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:30.792142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:30.792164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:30.792175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:30.792179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:30.792182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:30.792186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:30.792640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:30.792660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.792750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392870792
2025-10-02T08:14:30.794998Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:30.795024Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:30.795030Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:30.795045Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:30.795060Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:30.795062Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:30.795064Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:30.795077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534838864748804:5901]
2025-10-02T08:14:30.795085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534838864748804:5901]
2025-10-02T08:14:30.795136Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:30.795152Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:30.795153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:30.795156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.795158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:30.795283Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:30.833482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534838864748853:3106]
2025-10-02T08:14:30.833614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2081, pipe: [1:7556534838864748853:3106]
2025-10-02T08:14:30.939550Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:30.940154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864748853:3106], now have 1 active actors on pipe
2025-10-02T08:14:30.940380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:30.940390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:30.940420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2082 reason: error at write: Disconnected sessionId: src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0
2025-10-02T08:14:30.940463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:30.940509Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:30.940595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2082 sessionId: src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0 is DEAD
2025-10-02T08:14:30.940726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:30.940743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0] Write session will restart in 0.005061s
2025-10-02T08:14:30.940772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0] Write session: Do CDS request
2025-10-02T08:14:30.940777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:30.940786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534838864748853:3106]
2025-10-02T08:14:30.944209Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7a53ee833d0b29c5] Result# TEvPutResult {Id# [72075186224037892:2081:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:30.944264Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2081:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:30.944326Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2081:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:30.947274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.947344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:30.947360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2083
2025-10-02T08:14:30.947489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:30.947521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:30.947530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:30.947534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:30.948053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2083 sessionId:  describe result for acl check
2025-10-02T08:14:30.948081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:30.948086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:30.948087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:30.948091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534838864749048:5906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:30.948549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534838864749048:5906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:30.953289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534838864749048:5906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:30.953532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:30.954737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:30.954933Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:30.954942Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:30.954951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:30.954996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:30.955032Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534838864749205:5905]
2025-10-02T08:14:30.955695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:30.955870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:30.955913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:30.956018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534838864749048:5906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:30.956030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534838864749048:5906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:30.956034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534838864749048:5906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:30.956042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:30.956249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:30.956301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.956307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.956308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.956309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.956310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.956315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.956325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.956332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.956336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.956343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.956349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.956355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:30.956364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.956370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:30.956378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.956386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:30.956395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.956402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.956405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.956411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.956425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:30.965119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:30.966577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:30.966591Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:30.966592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:30.966595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:30.966600Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2082 [1:7556534838864749205:5905]
2025-10-02T08:14:30.966609Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:30.966624Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:30.966630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.966632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.966634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.966654Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:30.966662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:30.966672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:30.966726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.966734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.966736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:30.966737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:30.966790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:30.966796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.966806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:30.966824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:30.966842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534838864749216:5906], now have 1 active actors on pipe
2025-10-02T08:14:30.966847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534838864749189:5905]
2025-10-02T08:14:30.966849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534838864749189:5905]
2025-10-02T08:14:30.966852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2082
2025-10-02T08:14:30.966855Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:30.966861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534839324325435:2378], now have 1 active actors on pipe
2025-10-02T08:14:30.966866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.966869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.966870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:30.966873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:30.966880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:30.966888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:30.966890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:30.966922Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|970251a-392fe757-841ab9b3-f96e9ee6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:30.966927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:30.966929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:30.966943Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2082
2025-10-02T08:14:30.966930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:30.966936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:30.966942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:30.966947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534838864749189:5905]
2025-10-02T08:14:30.966955Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:30.966968Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:30.966972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.967033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:30.967039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:30.967051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:30.967086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2083 partition: 0 MaxSeqNo: 17 sessionId: src_id|970251a-392fe757-841ab9b3-f96e9ee6_0
2025-10-02T08:14:30.967362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa8b4-e2fb534c-bb3f4575-5cc5858d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|970251a-392fe757-841ab9b3-f96e9ee6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:30.972005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970251a-392fe757-841ab9b3-f96e9ee6_0] Write session: try to update token
2025-10-02T08:14:30.972020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970251a-392fe757-841ab9b3-f96e9ee6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:30.985063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId: src_id|970251a-392fe757-841ab9b3-f96e9ee6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:30.985219Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:30.985233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:30.985236Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:30.985243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534838864749189:5905]
2025-10-02T08:14:30.985252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534838864749189:5905]
2025-10-02T08:14:30.985291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:30.985300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:30.985307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:30.985354Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:30.985367Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:30.985444Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:30.987333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:31.040836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534843159716534:3106]
2025-10-02T08:14:31.040920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2082, pipe: [1:7556534843159716534:3106]
2025-10-02T08:14:31.113308Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:31.113634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.113648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.113688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159716534:3106], now have 1 active actors on pipe
2025-10-02T08:14:31.113807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:31.113821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:31.113882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2083 reason: error at write: Disconnected sessionId: src_id|970251a-392fe757-841ab9b3-f96e9ee6_0
2025-10-02T08:14:31.113885Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:31.113909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:31.114059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2083 sessionId: src_id|970251a-392fe757-841ab9b3-f96e9ee6_0 is DEAD
2025-10-02T08:14:31.114200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970251a-392fe757-841ab9b3-f96e9ee6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:31.114206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970251a-392fe757-841ab9b3-f96e9ee6_0] Write session will restart in 0.005344s
2025-10-02T08:14:31.114224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970251a-392fe757-841ab9b3-f96e9ee6_0] Write session: Do CDS request
2025-10-02T08:14:31.114209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534843159716534:3106]
2025-10-02T08:14:31.114230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970251a-392fe757-841ab9b3-f96e9ee6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:31.120254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970251a-392fe757-841ab9b3-f96e9ee6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.120351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:31.120369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2084
2025-10-02T08:14:31.120512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.120547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:31.120553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:31.120556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:31.120964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2084 sessionId:  describe result for acl check
2025-10-02T08:14:31.120992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:31.120998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:31.120999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:31.121004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534843159716767:5960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:31.121480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534843159716767:5960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:31.124121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534843159716767:5960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:31.124904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:31.125972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:31.126197Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:31.126207Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:31.126216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:31.126270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:31.126307Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534843159716882:5943]
2025-10-02T08:14:31.126485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534843159716767:5960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:31.126496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534843159716767:5960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:31.126499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534843159716767:5960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:31.126505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:31.126800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:31.126973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:31.127006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:31.127221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:31.127256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.127261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.127261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.127262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.127263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.127266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.127272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.127274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.127276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.127278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.127282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.127286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.127289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.127293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.127299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.127307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.127311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.127320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.127324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.127328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.127348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:31.137973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:31.139658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:31.139676Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:31.139678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:31.139682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:31.139689Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2083 [1:7556534843159716882:5943]
2025-10-02T08:14:31.139699Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:31.139715Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:31.139718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.139721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.139722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.139739Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:31.139748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:31.139755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:31.139814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.139819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.139822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:31.139824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:31.139869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:31.139875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.139883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.139889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:31.139901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534843159716875:5943]
2025-10-02T08:14:31.139908Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534843159716875:5943]
2025-10-02T08:14:31.139915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:31.139930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2083
2025-10-02T08:14:31.139931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159716887:5960], now have 1 active actors on pipe
2025-10-02T08:14:31.139930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:31.139933Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:31.139938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:31.139951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:31.139954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:31.139959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534843619292738:2378], now have 1 active actors on pipe
2025-10-02T08:14:31.139987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.139989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.140000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534843159716875:5943]
2025-10-02T08:14:31.140005Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:31.140021Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:31.140023Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:31.140027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.140032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.140035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:31.140042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.140016Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2083
2025-10-02T08:14:31.140048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:31.140068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.140149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.140166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.140194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.140265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2084 partition: 0 MaxSeqNo: 17 sessionId: src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0
2025-10-02T08:14:31.140591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970251a-392fe757-841ab9b3-f96e9ee6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:31.143502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0] Write session: try to update token
2025-10-02T08:14:31.143519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:31.158329Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:31.158351Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:31.158353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:31.158361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534843159716875:5943]
2025-10-02T08:14:31.158365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534843159716875:5943]
2025-10-02T08:14:31.158403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:31.158403Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:31.158409Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:31.158415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.158417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:31.158550Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:31.180330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId: src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:31.182741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:31.214401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534843159716950:3106]
2025-10-02T08:14:31.214515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2083, pipe: [1:7556534843159716950:3106]
2025-10-02T08:14:31.295960Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:31.296373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.296391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.296413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159716950:3106], now have 1 active actors on pipe
2025-10-02T08:14:31.296505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534843159716950:3106]
2025-10-02T08:14:31.296540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:31.296542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:31.296592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2084 reason: error at write: Disconnected sessionId: src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0
2025-10-02T08:14:31.296641Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:31.296629Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:31.296933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:31.296943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0] Write session will restart in 0.007028s
2025-10-02T08:14:31.296763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2084 sessionId: src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0 is DEAD
2025-10-02T08:14:31.296965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0] Write session: Do CDS request
2025-10-02T08:14:31.296971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:31.305246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.305309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:31.305324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2085
2025-10-02T08:14:31.305478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.305509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:31.305518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:31.305521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:31.305861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2085 sessionId:  describe result for acl check
2025-10-02T08:14:31.305891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:31.305896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:31.305897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:31.305902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534843159717218:5993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:31.306383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534843159717218:5993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:31.308683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534843159717218:5993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:31.308887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:31.310092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:31.310289Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:31.310301Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:31.310311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:31.310362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:31.310394Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534843159717300:5990]
2025-10-02T08:14:31.310926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:31.311099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:31.311139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:31.311397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534843159717218:5993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:31.311409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534843159717218:5993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:31.311411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534843159717218:5993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:31.311417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:31.311433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:31.311478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.311483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.311484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.311485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.311486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.311491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.311500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.311504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.311508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.311516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.311520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.311527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.311537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.311543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.311554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.311559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.311563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.311568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.311572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.311578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.311597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:31.319922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:31.321555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:31.321576Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:31.321578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:31.321582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:31.321587Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2084 [1:7556534843159717300:5990]
2025-10-02T08:14:31.321600Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:31.321617Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:31.321620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.321623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.321625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.321645Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:31.321649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:31.321655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:31.321717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.321725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.321728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:31.321730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:31.321792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:31.321798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.321810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.321824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:31.321844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159717312:5993], now have 1 active actors on pipe
2025-10-02T08:14:31.321854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534843159717285:5990]
2025-10-02T08:14:31.321856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534843159717285:5990]
2025-10-02T08:14:31.321855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2084
2025-10-02T08:14:31.321864Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:31.321874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:31.321874Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:31.321878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:31.321885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:31.321888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:31.321894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534843619292768:2378], now have 1 active actors on pipe
2025-10-02T08:14:31.321898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.321901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.321939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534843159717285:5990]
2025-10-02T08:14:31.321954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:31.321956Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:31.321972Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:31.321982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.321991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.321996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:31.321978Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2084
2025-10-02T08:14:31.322007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.322018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:31.322059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.322125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.322132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.322143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.322189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2085 partition: 0 MaxSeqNo: 17 sessionId: src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0
2025-10-02T08:14:31.322535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45081ebb-d703f13d-67cb1c9a-a84aa6d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:31.325112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0] Write session: try to update token
2025-10-02T08:14:31.325133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:31.338558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId: src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:31.339581Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:31.339597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:31.339599Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:31.339608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534843159717285:5990]
2025-10-02T08:14:31.339613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534843159717285:5990]
2025-10-02T08:14:31.339653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:31.339657Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:31.339663Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:31.339668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.339669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:31.339811Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:31.341102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:31.396687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534843159717332:3106]
2025-10-02T08:14:31.396817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2084, pipe: [1:7556534843159717332:3106]
2025-10-02T08:14:31.475104Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:31.475420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.475432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.475467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159717332:3106], now have 1 active actors on pipe
2025-10-02T08:14:31.475555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534843159717332:3106]
2025-10-02T08:14:31.475574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:31.475581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:31.475627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2085 reason: error at write: Disconnected sessionId: src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0
2025-10-02T08:14:31.475686Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:31.475700Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:31.475781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2085 sessionId: src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0 is DEAD
2025-10-02T08:14:31.475940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:31.475951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0] Write session will restart in 0.005734s
2025-10-02T08:14:31.475975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0] Write session: Do CDS request
2025-10-02T08:14:31.475981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:31.483277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.483323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:31.483337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2086
2025-10-02T08:14:31.483479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.483508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:31.483518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:31.483522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:31.483898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2086 sessionId:  describe result for acl check
2025-10-02T08:14:31.483930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:31.483936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:31.483938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:31.483942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534843159717589:6022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:31.484440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534843159717589:6022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:31.486992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534843159717589:6022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:31.488779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:31.489108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:31.489258Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:31.489268Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:31.489276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:31.489314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:31.489341Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534843159717686:6023]
2025-10-02T08:14:31.489525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534843159717589:6022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:31.489539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534843159717589:6022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:31.489542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534843159717589:6022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:31.489549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:31.489920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:31.490077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:31.490114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:31.490348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:31.490388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.490394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.490395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.490396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.490397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.490402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.490407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.490409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.490411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.490413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.490417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.490420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.490424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.490426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.490428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.490431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.490433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.490436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.490438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.490441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.490450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:31.498205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:31.499747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:31.499765Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:31.499767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:31.499770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:31.499776Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2085 [1:7556534843159717686:6023]
2025-10-02T08:14:31.499787Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:31.499802Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:31.499804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.499807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.499809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.499824Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:31.499829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:31.499835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:31.499888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.499895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.499898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:31.499900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:31.499961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:31.499967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.499979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.499993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:31.500002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2085
2025-10-02T08:14:31.500014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159717691:6022], now have 1 active actors on pipe
2025-10-02T08:14:31.500024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534843159717680:6023]
2025-10-02T08:14:31.500025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534843159717680:6023]
2025-10-02T08:14:31.500036Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:31.500047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534843619292774:2378], now have 1 active actors on pipe
2025-10-02T08:14:31.500052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.500055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:31.500056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.500058Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:31.500073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:31.500088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:31.500095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:31.500130Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:31.500139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.500142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.500144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:31.500152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.500126Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2085
2025-10-02T08:14:31.500159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:31.500170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534843159717680:6023]
2025-10-02T08:14:31.500178Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:31.500186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:31.500208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.500281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.500288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.500299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.500337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2086 partition: 0 MaxSeqNo: 17 sessionId: src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0
2025-10-02T08:14:31.500648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4221932a-b0b03da4-55ca5446-1e5ad550_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:31.503158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0] Write session: try to update token
2025-10-02T08:14:31.503170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:31.522694Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:31.522716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:31.522719Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:31.522727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534843159717680:6023]
2025-10-02T08:14:31.522732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534843159717680:6023]
2025-10-02T08:14:31.522774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:31.522781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.522783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:31.522927Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:31.524854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:31.524860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:31.525784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId: src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:31.528766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:31.575837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534843159717718:3106]
2025-10-02T08:14:31.576027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2085, pipe: [1:7556534843159717718:3106]
2025-10-02T08:14:31.660528Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:31.660970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.660991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.661035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159717718:3106], now have 1 active actors on pipe
2025-10-02T08:14:31.661157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:31.661169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:31.661226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2086 reason: error at write: Disconnected sessionId: src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0
2025-10-02T08:14:31.661392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2086 sessionId: src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0 is DEAD
2025-10-02T08:14:31.661526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:31.661534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0] Write session will restart in 0.009470s
2025-10-02T08:14:31.661559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0] Write session: Do CDS request
2025-10-02T08:14:31.661565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:31.661550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534843159717718:3106]
2025-10-02T08:14:31.662441Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:31.661289Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:31.672392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.672473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:31.672490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2087
2025-10-02T08:14:31.672613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.672641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:31.672650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:31.672653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:31.672820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:31.673047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2087 sessionId:  describe result for acl check
2025-10-02T08:14:31.673080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:31.673086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:31.673087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:31.673092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534843159718045:6048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:31.673558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534843159718045:6048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:31.673864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:31.674027Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:31.674034Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:31.674042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:31.674090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:31.674126Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534843159718053:6055]
2025-10-02T08:14:31.674630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:31.674797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:31.674844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:31.675183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:31.675232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.675238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.675239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.675240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.675241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.675257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.675270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.675277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.675281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.675285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.675290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.675297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.675303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.675315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.675319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.675323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.675327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.675332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.675336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.675341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.675361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:31.675528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534843159718045:6048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:31.681670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534843159718045:6048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:31.681687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534843159718045:6048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:31.681690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534843159718045:6048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:31.681698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:31.683389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:31.684937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:31.684954Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:31.684956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:31.684960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:31.684968Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2086 [1:7556534843159718053:6055]
2025-10-02T08:14:31.684978Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:31.684993Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:31.685000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.685003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.685005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.685020Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:31.685027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:31.685033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:31.685094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.685101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.685104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:31.685106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:31.685166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:31.685174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.685185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.685196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:31.685215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534843159718040:6055]
2025-10-02T08:14:31.685222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534843159718040:6055]
2025-10-02T08:14:31.685229Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:31.685240Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:31.685241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159718093:6048], now have 1 active actors on pipe
2025-10-02T08:14:31.685248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:31.685253Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:31.685260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:31.685263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:31.685268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534843619292793:2378], now have 1 active actors on pipe
2025-10-02T08:14:31.685295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534843159718040:6055]
2025-10-02T08:14:31.685298Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:31.685301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:31.685373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2086
2025-10-02T08:14:31.685463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.685473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.685495Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15625517-15c43af5-f6534386-cc6a3a53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:31.685505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.685508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.685510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:31.685520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.685532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:31.685552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.685592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.685599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.685611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.685648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2087 partition: 0 MaxSeqNo: 17 sessionId: src_id|15625517-15c43af5-f6534386-cc6a3a53_0
2025-10-02T08:14:31.685960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c80db6-1f56d58-861641a1-8f9e6f52_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|15625517-15c43af5-f6534386-cc6a3a53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:31.688414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15625517-15c43af5-f6534386-cc6a3a53_0] Write session: try to update token
2025-10-02T08:14:31.688428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15625517-15c43af5-f6534386-cc6a3a53_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:31.685287Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2086
2025-10-02T08:14:31.701677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId: src_id|15625517-15c43af5-f6534386-cc6a3a53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:31.704088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:31.704155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.704168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.704210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:31.704235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:31.704280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.704295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.704447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.704502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.704560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.704625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.704875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.704886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.704961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.705017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.705095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.705162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.705205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.705210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.705279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.705340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.705402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.705463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.705503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.705508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.705569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.705630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.705693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.705765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.705814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.705821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.705891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.705987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.706046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.706105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.706167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.706175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.706238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.706334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.706410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.706483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.706528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.706536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.706608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.706677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.706749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.706813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.706932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.706940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.707007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.707072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.707141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.707207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.707251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.707258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.707324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.707391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.707456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.707521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.707563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.707571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.707638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:31.707702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:31.707765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:31.707828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:31.707878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:31.707885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:31.707942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:31.708001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.708022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.708028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:31.708055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:31.708069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:31.708077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:31.708081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:31.708084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:31.708519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:31.708543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:31.708549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:31.708557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:31.708560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:31.708563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:31.709163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:31.709186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:31.709193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:31.709195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:31.709199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:31.709202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:31.709700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:31.709725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:31.709730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:31.709733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:31.709736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:31.711897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:31.711915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:31.711924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392871711
2025-10-02T08:14:31.712091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:31.712104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:31.712108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:31.712111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:31.712114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:31.712117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:31.712611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:31.712629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:31.712633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:31.712635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:31.712637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:31.712640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:31.713117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:31.713141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:31.713148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:31.713151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:31.713159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:31.713167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:31.713637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:31.713658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:31.713667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:31.714767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:31.714786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:31.714792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:31.714796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:31.714804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392871714
2025-10-02T08:14:31.715103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:31.715122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:31.715127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:31.715130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:31.715133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:31.715136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:31.715602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:31.715622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:31.715627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:31.715631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:31.715634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:31.715637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:31.716112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:31.716132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.716244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392871716
2025-10-02T08:14:31.721695Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:31.721738Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:31.721745Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:31.721758Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:31.721770Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:31.721773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:31.721775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:31.721783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534843159718040:6055]
2025-10-02T08:14:31.721789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534843159718040:6055]
2025-10-02T08:14:31.721836Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:31.721850Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:31.727572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:31.727592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.727593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:31.727732Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:31.761752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534843159718121:3106]
2025-10-02T08:14:31.761874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2086, pipe: [1:7556534843159718121:3106]
2025-10-02T08:14:31.864964Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:31.865338Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:31.865353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:31.865363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534843159718040:6055]
2025-10-02T08:14:31.865419Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:31.865439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159718121:3106], now have 1 active actors on pipe
2025-10-02T08:14:31.865560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534843159718121:3106]
2025-10-02T08:14:31.865596Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:31.865627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:31.865662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2087 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15625517-15c43af5-f6534386-cc6a3a53_0
2025-10-02T08:14:31.865677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:31.865834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2087 sessionId: src_id|15625517-15c43af5-f6534386-cc6a3a53_0 is DEAD
2025-10-02T08:14:31.865968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15625517-15c43af5-f6534386-cc6a3a53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:31.865978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15625517-15c43af5-f6534386-cc6a3a53_0] Write session will restart in 0.007962s
2025-10-02T08:14:31.865995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15625517-15c43af5-f6534386-cc6a3a53_0] Write session: Do CDS request
2025-10-02T08:14:31.865999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15625517-15c43af5-f6534386-cc6a3a53_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:31.869737Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [25febc4cf21c9a67] Result# TEvPutResult {Id# [72075186224037892:2086:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:31.869762Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2086:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:31.869836Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2086:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:31.875270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15625517-15c43af5-f6534386-cc6a3a53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.875331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:31.875348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2088
2025-10-02T08:14:31.875502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:31.875531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:31.875541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:31.875543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:31.875958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2088 sessionId:  describe result for acl check
2025-10-02T08:14:31.875980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:31.875985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:31.875986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:31.875989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534843159718410:6096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:31.876353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534843159718410:6096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:31.878292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534843159718410:6096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:31.878946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:31.880504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:31.880668Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:31.880678Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:31.880700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:31.880717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534843159718410:6096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:31.880729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534843159718410:6096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:31.880731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534843159718410:6096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:31.880736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:31.880755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:31.880785Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534843159718488:6090]
2025-10-02T08:14:31.881219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:31.881346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:31.881384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:31.881597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:31.881635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.881640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.881641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.881642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.881643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.881647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.881657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.881660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.881664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.881667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.881672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.881680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:31.881686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.881691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:31.881698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.881707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:31.881712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.881720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.881724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.881732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.881750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:31.889255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:31.890860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:31.890877Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:31.890879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:31.890881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:31.890885Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2087 [1:7556534843159718488:6090]
2025-10-02T08:14:31.890892Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:31.890905Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:31.890907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.890909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.890910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.890921Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:31.890924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:31.890928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:31.890971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.890976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.890979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:31.890980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:31.891023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:31.891028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.891036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:31.891042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:31.891056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534843159718480:6090]
2025-10-02T08:14:31.891062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534843159718480:6090]
2025-10-02T08:14:31.891068Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:31.891079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:31.891095Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:31.891096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:31.891097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:31.891099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2087
2025-10-02T08:14:31.891104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159718493:6096], now have 1 active actors on pipe
2025-10-02T08:14:31.891104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:31.891126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534843159718480:6090]
2025-10-02T08:14:31.891133Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:31.891135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:31.891136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534843619292802:2378], now have 1 active actors on pipe
2025-10-02T08:14:31.891139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.891142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.891172Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:31.891179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:31.891184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:31.891186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:31.891191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:31.891199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:31.891213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.891190Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2087
2025-10-02T08:14:31.891246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:31.891253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:31.891263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:31.891292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2088 partition: 0 MaxSeqNo: 17 sessionId: src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0
2025-10-02T08:14:31.891589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15625517-15c43af5-f6534386-cc6a3a53_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:31.894056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0] Write session: try to update token
2025-10-02T08:14:31.894069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:31.906906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId: src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:31.908193Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:31.908227Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:31.908229Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:31.908237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534843159718480:6090]
2025-10-02T08:14:31.908241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534843159718480:6090]
2025-10-02T08:14:31.908282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:31.908286Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:31.908292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:31.908293Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:31.908295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:31.908429Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:31.909326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:31.965500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534843159718519:3106]
2025-10-02T08:14:31.965876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2087, pipe: [1:7556534843159718519:3106]
2025-10-02T08:14:32.039586Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:32.039886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.039899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.039941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534843159718519:3106], now have 1 active actors on pipe
2025-10-02T08:14:32.040130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:32.040143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:32.040151Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:32.040216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2088 reason: error at write: Disconnected sessionId: src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0
2025-10-02T08:14:32.040372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2088 sessionId: src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0 is DEAD
2025-10-02T08:14:32.040461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534843159718519:3106]
2025-10-02T08:14:32.040547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:32.040559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0] Write session will restart in 0.006265s
2025-10-02T08:14:32.040583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0] Write session: Do CDS request
2025-10-02T08:14:32.040590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:32.040159Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:32.048230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.048358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:32.048376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2089
2025-10-02T08:14:32.048475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.048504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:32.048513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:32.048517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:32.049019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2089 sessionId:  describe result for acl check
2025-10-02T08:14:32.049046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:32.049051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:32.049052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:32.049056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534847454686073:6114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:32.049572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534847454686073:6114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:32.052568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534847454686073:6114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:32.053222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:32.054573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:32.054759Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:32.054772Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:32.054782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:32.054839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:32.054879Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534847454686177:6108]
2025-10-02T08:14:32.055383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534847454686073:6114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:32.055394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534847454686073:6114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:32.055400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534847454686073:6114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:32.055407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:32.055473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:32.055608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:32.055645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:32.055912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:32.055948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.055953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.055954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.055955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.055956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.055962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.055972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.055977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.055980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.055983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.055988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.055995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.056001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.056006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.056010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.056017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.056022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.056031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.056036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.056041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.056059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:32.064189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:32.065873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:32.065885Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:32.065887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:32.065891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:32.065897Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2088 [1:7556534847454686177:6108]
2025-10-02T08:14:32.065909Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:32.065927Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:32.065933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.065936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.065939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.065955Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:32.065963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:32.065972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:32.066041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.066048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.066051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:32.066054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:32.066121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:32.066127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.066140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.066155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:32.066166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2088
2025-10-02T08:14:32.066175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454686182:6114], now have 1 active actors on pipe
2025-10-02T08:14:32.066178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534847914260110:2378], now have 1 active actors on pipe
2025-10-02T08:14:32.066185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534847454686170:6108]
2025-10-02T08:14:32.066190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534847454686170:6108]
2025-10-02T08:14:32.066202Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:32.066214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.066216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:32.066219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:32.066222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.066239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:32.066256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:32.066262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:32.066282Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2088
2025-10-02T08:14:32.066339Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:32.066349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.066355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.066357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:32.066368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.066376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:32.066388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534847454686170:6108]
2025-10-02T08:14:32.066399Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:32.066411Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:32.066433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.066515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.066521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.066534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.066572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2089 partition: 0 MaxSeqNo: 17 sessionId: src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0
2025-10-02T08:14:32.066877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a04cd98-cb804911-6dcf2f11-5b35fc84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:32.069422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0] Write session: try to update token
2025-10-02T08:14:32.069438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:32.083155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId: src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:32.083788Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:32.083802Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:32.083804Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:32.083812Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534847454686170:6108]
2025-10-02T08:14:32.083816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534847454686170:6108]
2025-10-02T08:14:32.083861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:32.083862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:32.083869Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:32.083871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.083874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:32.084005Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:32.085721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:32.140607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534847454686207:3106]
2025-10-02T08:14:32.140719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2088, pipe: [1:7556534847454686207:3106]
2025-10-02T08:14:32.223988Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:32.224366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.224379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.224408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454686207:3106], now have 1 active actors on pipe
2025-10-02T08:14:32.224544Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:32.224560Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:32.224571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534847454686207:3106]
2025-10-02T08:14:32.224670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:32.224725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2089 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0
2025-10-02T08:14:32.224886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2089 sessionId: src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0 is DEAD
2025-10-02T08:14:32.225058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:32.225078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0] Write session will restart in 0.008149s
2025-10-02T08:14:32.225102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0] Write session: Do CDS request
2025-10-02T08:14:32.225108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:32.234281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.234346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:32.234359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2090
2025-10-02T08:14:32.234499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.234543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:32.234551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:32.234554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:32.235040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2090 sessionId:  describe result for acl check
2025-10-02T08:14:32.235066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:32.235082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:32.235083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:32.235088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534847454686562:6186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:32.235472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534847454686562:6186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:32.236552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:32.237909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:32.237925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534847454686562:6186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:32.238095Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:32.238104Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:32.238114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:32.238159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:32.238203Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534847454686596:6182]
2025-10-02T08:14:32.238716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:32.238923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:32.238976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:32.239350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:32.239413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.239418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.239420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.239421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.239422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.239427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.239436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.239439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.239443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.239448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.239458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.239466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.239472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.239477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.239482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.239490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.239495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.239500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.239505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.239509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.239529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:32.244354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534847454686562:6186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:32.244366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534847454686562:6186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:32.244370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534847454686562:6186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:32.244378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:32.249923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:32.251526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:32.251543Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:32.251546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:32.251550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:32.251555Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2089 [1:7556534847454686596:6182]
2025-10-02T08:14:32.251566Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:32.251584Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:32.251591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.251595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.251597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.251612Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:32.251622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:32.251628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:32.251689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.251697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.251700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:32.251702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:32.251765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:32.251772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.251783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.251796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:32.251806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2089
2025-10-02T08:14:32.251818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454686622:6186], now have 1 active actors on pipe
2025-10-02T08:14:32.251826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534847914260141:2378], now have 1 active actors on pipe
2025-10-02T08:14:32.251833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534847454686584:6182]
2025-10-02T08:14:32.251835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534847454686584:6182]
2025-10-02T08:14:32.251848Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:32.251864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.251866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:32.251869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:32.251873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.251891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:32.251908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:32.251915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:32.251923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2089
2025-10-02T08:14:32.251956Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:32.251969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.251976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.251978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:32.251986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.251997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:32.252008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534847454686584:6182]
2025-10-02T08:14:32.252019Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:32.252037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:32.252050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.252091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.252097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.252109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.252146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2090 partition: 0 MaxSeqNo: 17 sessionId: src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0
2025-10-02T08:14:32.252491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1188d9fe-b5d8a-faa54aee-2ddd9cc8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:32.255143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0] Write session: try to update token
2025-10-02T08:14:32.255159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:32.263491Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:32.263505Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:32.263513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534847454686584:6182]
2025-10-02T08:14:32.263552Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:32.263555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:32.263715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:32.263861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:32.264005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:32.264135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:32.264339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:32.264374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:32.268935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId: src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:32.271321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:32.271377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.271389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.271419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:32.271439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:32.271482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.271495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.271641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.271717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.271795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.271856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.272216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.272227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.272311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.272366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.272422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.272480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.272525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.272532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.272592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.272645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.272711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.272791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.272856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.272865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.272931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.272985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.273045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.273101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.273145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.273151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.273214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.273287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.273364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.273422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.273525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.273532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.273592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.273646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.273705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.273783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.273832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.273840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.273915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.273969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.274029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.274089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.274130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.274137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.274197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.274263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.274341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.274421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.274460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.274467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.274528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.274583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.274640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.274697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.274740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.274748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.274828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:32.274905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:32.274962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:32.275021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:32.275063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:32.275072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:32.275105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:32.275165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.275186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.275193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:32.275220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:32.275235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:32.275251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:32.275261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:32.275265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:32.275648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:32.275670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:32.275684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:32.275687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:32.275690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:32.275694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:32.276532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:32.276555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:32.276565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:32.276569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:32.276572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:32.276575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:32.277188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:32.277208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:32.277217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:32.277220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:32.277224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:32.278387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:32.278401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:32.278410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392872278
2025-10-02T08:14:32.278503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:32.278512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:32.278516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:32.278521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:32.278524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:32.278528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:32.278929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:32.278946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:32.278950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:32.278956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:32.278958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:32.278960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:32.279356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:32.279372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:32.279377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:32.279379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:32.279381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:32.279384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:32.279839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:32.279857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:32.279861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:32.280845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:32.280857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:32.280862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:32.280866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:32.280872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392872280
2025-10-02T08:14:32.281135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:32.281149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:32.281153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:32.281155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:32.281157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:32.281160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:32.281589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:32.281606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:32.281610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:32.281612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:32.281614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:32.281617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:32.282092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:32.282115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.282214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392872281
2025-10-02T08:14:32.282936Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:32.282948Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:32.282952Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:32.282958Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:32.284441Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:32.284454Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:32.284456Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:32.284463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534847454686584:6182]
2025-10-02T08:14:32.284466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534847454686584:6182]
2025-10-02T08:14:32.284513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:32.284522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.284523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:32.284522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:32.284539Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:32.284639Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:32.324951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534847454686643:3106]
2025-10-02T08:14:32.325046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2089, pipe: [1:7556534847454686643:3106]
2025-10-02T08:14:32.422801Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:32.423132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454686643:3106], now have 1 active actors on pipe
2025-10-02T08:14:32.423318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534847454686643:3106]
2025-10-02T08:14:32.423356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:32.423358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:32.423378Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:32.423384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2090 reason: error at write: Disconnected sessionId: src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0
2025-10-02T08:14:32.423389Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:32.423561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2090 sessionId: src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0 is DEAD
2025-10-02T08:14:32.423639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:32.423647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0] Write session will restart in 0.005714s
2025-10-02T08:14:32.423670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0] Write session: Do CDS request
2025-10-02T08:14:32.423676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:32.430287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.430340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:32.430355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2091
2025-10-02T08:14:32.430470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.430496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:32.430504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:32.430507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:32.430935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2091 sessionId:  describe result for acl check
2025-10-02T08:14:32.430961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:32.430967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:32.430968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:32.430972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534847454686879:6209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:32.431508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534847454686879:6209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:32.434216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534847454686879:6209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:32.435619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:32.436780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:32.436984Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:32.436992Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:32.437001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:32.437046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:32.437081Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534847454687012:6206]
2025-10-02T08:14:32.437109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534847454686879:6209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:32.437121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534847454686879:6209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:32.437124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534847454686879:6209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:32.437130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:32.437660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:32.437803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:32.437835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:32.438097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:32.438149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.438155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.438156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.438157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.438160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.438165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.438173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.438178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.438181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.438184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.438193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.438200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.438209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.438218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.438222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.438230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.438233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.438238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.438245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.438249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.438266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:32.446285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:32.447758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:32.447772Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:32.447774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:32.447777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:32.447781Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2090 [1:7556534847454687012:6206]
2025-10-02T08:14:32.447789Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:32.447801Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:32.447802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.447805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.447806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.447817Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:32.447823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:32.447828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:32.447876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.447883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.447885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:32.447887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:32.447942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:32.447948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.447956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.447963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:32.447975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534847454687006:6206]
2025-10-02T08:14:32.447982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534847454687006:6206]
2025-10-02T08:14:32.447988Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:32.447996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:32.448008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:32.448011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:32.448020Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:32.448023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:32.448041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2090
2025-10-02T08:14:32.448043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454687017:6209], now have 1 active actors on pipe
2025-10-02T08:14:32.448046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534847454687006:6206]
2025-10-02T08:14:32.448048Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:32.448051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534847914260149:2378], now have 1 active actors on pipe
2025-10-02T08:14:32.448059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:32.448064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.448067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.448096Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:32.448107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.448111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.448113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:32.448122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.448136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:32.448152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.448146Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2090
2025-10-02T08:14:32.448242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.448248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.448260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.448291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2091 partition: 0 MaxSeqNo: 17 sessionId: src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0
2025-10-02T08:14:32.448616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce0ced63-3aaa2418-e152a1da-bb63fe8a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:32.451239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0] Write session: try to update token
2025-10-02T08:14:32.451253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:32.465457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId: src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:32.465833Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:32.465844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:32.465846Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:32.465854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534847454687006:6206]
2025-10-02T08:14:32.465857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534847454687006:6206]
2025-10-02T08:14:32.465894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:32.465902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:32.465905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.465907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:32.465907Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:32.466039Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:32.467840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:32.523643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534847454687043:3106]
2025-10-02T08:14:32.523873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2090, pipe: [1:7556534847454687043:3106]
2025-10-02T08:14:32.608111Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:32.608345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.608357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.608392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454687043:3106], now have 1 active actors on pipe
2025-10-02T08:14:32.608469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:32.608478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:32.608528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2091 reason: error at write: Disconnected sessionId: src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0
2025-10-02T08:14:32.608552Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:32.608574Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:32.608681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2091 sessionId: src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0 is DEAD
2025-10-02T08:14:32.608817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:32.608827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0] Write session will restart in 0.005092s
2025-10-02T08:14:32.608851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0] Write session: Do CDS request
2025-10-02T08:14:32.608857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:32.608862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534847454687043:3106]
2025-10-02T08:14:32.615247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.615327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:32.615341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2092
2025-10-02T08:14:32.615446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.615474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:32.615483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:32.615486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:32.615992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2092 sessionId:  describe result for acl check
2025-10-02T08:14:32.616017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:32.616027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:32.616028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:32.616033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534847454687293:6226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:32.616591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534847454687293:6226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:32.620231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534847454687293:6226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:32.620684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:32.621852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:32.622025Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:32.622035Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:32.622044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:32.622091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:32.622126Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534847454687409:6237]
2025-10-02T08:14:32.622705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:32.622843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:32.622882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:32.623090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534847454687293:6226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:32.623101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534847454687293:6226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:32.623105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534847454687293:6226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:32.623113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:32.623188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:32.623227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.623232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.623233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.623234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.623235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.623239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.623249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.623255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.623258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.623263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.623268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.623275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.623280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.623287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.623292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.623298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.623302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.623307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.623315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.623322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.623346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:32.631260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:32.632818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:32.632830Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:32.632833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:32.632836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:32.632843Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2091 [1:7556534847454687409:6237]
2025-10-02T08:14:32.632854Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:32.632872Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:32.632876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.632879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.632882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.632898Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:32.632903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:32.632908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:32.632969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.632976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.632979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:32.632981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:32.633049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:32.633057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.633070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.633089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:32.633110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454687420:6226], now have 1 active actors on pipe
2025-10-02T08:14:32.633111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2091
2025-10-02T08:14:32.633116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534847914260168:2378], now have 1 active actors on pipe
2025-10-02T08:14:32.633122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534847454687397:6237]
2025-10-02T08:14:32.633125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534847454687397:6237]
2025-10-02T08:14:32.633139Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:32.633152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.633156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.633173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:32.633190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:32.633198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:32.633231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:32.633239Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:32.633239Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|178a0e15-a62cafc1-937086cc-f3d33367_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:32.633247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.633250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.633252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:32.633260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.633272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:32.633279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534847454687397:6237]
2025-10-02T08:14:32.633290Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:32.633304Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:32.633316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.633399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.633411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.633434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.633474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2092 partition: 0 MaxSeqNo: 17 sessionId: src_id|178a0e15-a62cafc1-937086cc-f3d33367_0
2025-10-02T08:14:32.633739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d39c5a9a-f6e3fb0f-d1d89afc-356abcad_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|178a0e15-a62cafc1-937086cc-f3d33367_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:32.633799Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2091
2025-10-02T08:14:32.636372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178a0e15-a62cafc1-937086cc-f3d33367_0] Write session: try to update token
2025-10-02T08:14:32.636390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178a0e15-a62cafc1-937086cc-f3d33367_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:32.649293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId: src_id|178a0e15-a62cafc1-937086cc-f3d33367_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:32.649626Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:32.649641Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:32.649644Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:32.649653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534847454687397:6237]
2025-10-02T08:14:32.649657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534847454687397:6237]
2025-10-02T08:14:32.649699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:32.649706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:32.649710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.649711Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:32.649713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:32.649847Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:32.651737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:32.709041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534847454687445:3106]
2025-10-02T08:14:32.709267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2091, pipe: [1:7556534847454687445:3106]
2025-10-02T08:14:32.780307Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:32.780517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.780527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.780558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454687445:3106], now have 1 active actors on pipe
2025-10-02T08:14:32.780683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534847454687445:3106]
2025-10-02T08:14:32.780706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:32.780712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:32.780729Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:32.780778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2092 reason: error at write: Disconnected sessionId: src_id|178a0e15-a62cafc1-937086cc-f3d33367_0
2025-10-02T08:14:32.780817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:32.780954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2092 sessionId: src_id|178a0e15-a62cafc1-937086cc-f3d33367_0 is DEAD
2025-10-02T08:14:32.781088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a0e15-a62cafc1-937086cc-f3d33367_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:32.781096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a0e15-a62cafc1-937086cc-f3d33367_0] Write session will restart in 0.006151s
2025-10-02T08:14:32.781127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a0e15-a62cafc1-937086cc-f3d33367_0] Write session: Do CDS request
2025-10-02T08:14:32.781133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a0e15-a62cafc1-937086cc-f3d33367_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:32.788252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|178a0e15-a62cafc1-937086cc-f3d33367_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.788293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:32.788305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2093
2025-10-02T08:14:32.788458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.788488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:32.788496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:32.788500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:32.788878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2093 sessionId:  describe result for acl check
2025-10-02T08:14:32.788906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:32.788911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:32.788912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:32.788917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534847454687708:6251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:32.789368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534847454687708:6251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:32.792146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534847454687708:6251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:32.792886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:32.794313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:32.794476Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:32.794486Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:32.794494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:32.794537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:32.794570Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534847454687824:6236]
2025-10-02T08:14:32.794777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534847454687708:6251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:32.794787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534847454687708:6251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:32.794790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534847454687708:6251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:32.794796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:32.795160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:32.795317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:32.795359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:32.795641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:32.795679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.795685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.795686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.795687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.795688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.795692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.795702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.795706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.795714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.795718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.795726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.795736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.795746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.795751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.795760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.795769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.795773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.795782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.795791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.795800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.795822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:32.803875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:32.805492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:32.805507Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:32.805509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:32.805513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:32.805519Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2092 [1:7556534847454687824:6236]
2025-10-02T08:14:32.805530Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:32.805545Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:32.805549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.805551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.805553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.805568Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:32.805574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:32.805579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:32.805636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.805644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.805647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:32.805649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:32.805705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:32.805714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.805728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.805740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:32.805756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534847454687817:6236]
2025-10-02T08:14:32.805758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534847454687817:6236]
2025-10-02T08:14:32.805764Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:32.805775Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:32.805776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454687829:6251], now have 1 active actors on pipe
2025-10-02T08:14:32.805778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:32.805779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2092
2025-10-02T08:14:32.805784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:32.805796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:32.805799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:32.805805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534847914260177:2378], now have 1 active actors on pipe
2025-10-02T08:14:32.805833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.805842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.805854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534847454687817:6236]
2025-10-02T08:14:32.805865Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:32.805879Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:32.805893Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97bef816-be254637-8e169c97-c81fb2d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:32.805870Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2092
2025-10-02T08:14:32.805903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.805906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.805908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:32.805916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.805925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:32.805948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.806004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.806011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.806022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.806055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2093 partition: 0 MaxSeqNo: 17 sessionId: src_id|97bef816-be254637-8e169c97-c81fb2d5_0
2025-10-02T08:14:32.806353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|178a0e15-a62cafc1-937086cc-f3d33367_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|97bef816-be254637-8e169c97-c81fb2d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:32.809036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97bef816-be254637-8e169c97-c81fb2d5_0] Write session: try to update token
2025-10-02T08:14:32.809055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97bef816-be254637-8e169c97-c81fb2d5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:32.823212Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:32.823213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId: src_id|97bef816-be254637-8e169c97-c81fb2d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:32.823231Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:32.823233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:32.823241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534847454687817:6236]
2025-10-02T08:14:32.823245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534847454687817:6236]
2025-10-02T08:14:32.823286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:32.823292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.823294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:32.823342Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:32.823354Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:32.823435Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:32.825816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:32.880940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534847454687856:3106]
2025-10-02T08:14:32.881028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2092, pipe: [1:7556534847454687856:3106]
2025-10-02T08:14:32.952337Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:32.952677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.952688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.952717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454687856:3106], now have 1 active actors on pipe
2025-10-02T08:14:32.952810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534847454687856:3106]
2025-10-02T08:14:32.952828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:32.952833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:32.952883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2093 reason: error at write: Disconnected sessionId: src_id|97bef816-be254637-8e169c97-c81fb2d5_0
2025-10-02T08:14:32.952922Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:32.952949Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:32.953034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2093 sessionId: src_id|97bef816-be254637-8e169c97-c81fb2d5_0 is DEAD
2025-10-02T08:14:32.953179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bef816-be254637-8e169c97-c81fb2d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:32.953189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bef816-be254637-8e169c97-c81fb2d5_0] Write session will restart in 0.007061s
2025-10-02T08:14:32.953212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bef816-be254637-8e169c97-c81fb2d5_0] Write session: Do CDS request
2025-10-02T08:14:32.953218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bef816-be254637-8e169c97-c81fb2d5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:32.961272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97bef816-be254637-8e169c97-c81fb2d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.961261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:32.961273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2094
2025-10-02T08:14:32.961473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:32.961508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:32.961516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:32.961519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:32.961932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2094 sessionId:  describe result for acl check
2025-10-02T08:14:32.961969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:32.961983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:32.961984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:32.961989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534847454688152:6266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:32.962361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534847454688152:6266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:32.964379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534847454688152:6266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:32.964524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:32.965917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:32.966109Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:32.966118Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:32.966127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:32.966167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:32.966203Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534847454688224:6264]
2025-10-02T08:14:32.966706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:32.966714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534847454688152:6266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:32.966720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534847454688152:6266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:32.966723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534847454688152:6266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:32.966729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:32.966880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:32.966934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:32.967338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:32.967389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.967394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.967395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.967396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.967397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.967402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.967411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.967418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.967421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.967424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.967429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.967435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:32.967440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.967445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:32.967449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.967457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:32.967461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.967465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.967469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.967472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.967489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:32.975216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:32.977084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:32.977097Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:32.977099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:32.977103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:32.977109Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2093 [1:7556534847454688224:6264]
2025-10-02T08:14:32.977121Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:32.977138Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:32.977141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.977143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.977145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.977160Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:32.977173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:32.977179Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:32.977233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.977240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.977244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:32.977246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:32.977303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:32.977310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.977321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:32.977332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:32.977349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534847454688233:6266], now have 1 active actors on pipe
2025-10-02T08:14:32.977360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534847454688208:6264]
2025-10-02T08:14:32.977362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534847454688208:6264]
2025-10-02T08:14:32.977362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2093
2025-10-02T08:14:32.977368Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:32.977379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:32.977379Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:32.977383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:32.977391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:32.977393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:32.977399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534847914260184:2378], now have 1 active actors on pipe
2025-10-02T08:14:32.977403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.977406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.977444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534847454688208:6264]
2025-10-02T08:14:32.977458Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:32.977476Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67abfc52-f7188a33-9466652b-412f552e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:32.977477Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:32.977487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:32.977490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:32.977492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:32.977501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:32.977508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:32.977545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.977636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.977652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.977679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:32.977722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2094 partition: 0 MaxSeqNo: 17 sessionId: src_id|67abfc52-f7188a33-9466652b-412f552e_0
2025-10-02T08:14:32.978055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97bef816-be254637-8e169c97-c81fb2d5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|67abfc52-f7188a33-9466652b-412f552e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:32.978063Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2093
2025-10-02T08:14:32.980535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67abfc52-f7188a33-9466652b-412f552e_0] Write session: try to update token
2025-10-02T08:14:32.980554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67abfc52-f7188a33-9466652b-412f552e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:32.993511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId: src_id|67abfc52-f7188a33-9466652b-412f552e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:32.995973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:32.996831Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:32.996842Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:32.996845Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:32.996852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534847454688208:6264]
2025-10-02T08:14:32.996856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534847454688208:6264]
2025-10-02T08:14:32.996897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:32.996904Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:32.996908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:32.996909Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:32.996925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:32.996935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:32.996937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:32.997069Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:33.052981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534851749655553:3106]
2025-10-02T08:14:33.053096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2093, pipe: [1:7556534851749655553:3106]
2025-10-02T08:14:33.143427Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:33.143819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749655553:3106], now have 1 active actors on pipe
2025-10-02T08:14:33.143938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:33.143948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:33.144001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2094 reason: error at write: Disconnected sessionId: src_id|67abfc52-f7188a33-9466652b-412f552e_0
2025-10-02T08:14:33.144037Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:33.144095Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:33.144168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2094 sessionId: src_id|67abfc52-f7188a33-9466652b-412f552e_0 is DEAD
2025-10-02T08:14:33.144330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534851749655553:3106]
2025-10-02T08:14:33.144537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67abfc52-f7188a33-9466652b-412f552e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:33.144544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67abfc52-f7188a33-9466652b-412f552e_0] Write session will restart in 0.009696s
2025-10-02T08:14:33.144565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67abfc52-f7188a33-9466652b-412f552e_0] Write session: Do CDS request
2025-10-02T08:14:33.144571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67abfc52-f7188a33-9466652b-412f552e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:33.155244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67abfc52-f7188a33-9466652b-412f552e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.155362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:33.155376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2095
2025-10-02T08:14:33.155486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.155515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:33.155524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:33.155528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:33.155972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2095 sessionId:  describe result for acl check
2025-10-02T08:14:33.156006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:33.156008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:33.156010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:33.156014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534851749655888:6319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:33.156515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534851749655888:6319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:33.157258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:33.158628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534851749655888:6319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:33.159206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:33.159374Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:33.159385Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:33.159394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:33.159436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:33.159471Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534851749655925:6315]
2025-10-02T08:14:33.160098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:33.160310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:33.160363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:33.160676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:33.160715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.160720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.160722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.160723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.160724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.160739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.160753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.160761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.160766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.160769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.160774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.160782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.160788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.160793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.160836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.160846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.160851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.160861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.160865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.160870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.160888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:33.161390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534851749655888:6319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:33.161401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534851749655888:6319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:33.161404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534851749655888:6319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:33.161411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:33.169633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:33.171224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:33.171238Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:33.171240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:33.171243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:33.171248Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2094 [1:7556534851749655925:6315]
2025-10-02T08:14:33.171259Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:33.171276Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:33.171283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.171286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.171288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.171302Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:33.171311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:33.171317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:33.171373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.171379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.171382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:33.171384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:33.171448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:33.171455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.171466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.171481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:33.171503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749655942:6319], now have 1 active actors on pipe
2025-10-02T08:14:33.171506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2094
2025-10-02T08:14:33.171512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534851749655897:6315]
2025-10-02T08:14:33.171515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534851749655897:6315]
2025-10-02T08:14:33.171521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:33.171529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534852209227488:2378], now have 1 active actors on pipe
2025-10-02T08:14:33.171533Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:33.171536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:33.171537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:33.171548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:33.171550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:33.171556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.171561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.171598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534851749655897:6315]
2025-10-02T08:14:33.171609Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:33.171621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:33.171624Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:33.171629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.171633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.171634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:33.171644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.171653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:33.171624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2094
2025-10-02T08:14:33.171687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.171751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.171757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.171769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.171806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2095 partition: 0 MaxSeqNo: 17 sessionId: src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0
2025-10-02T08:14:33.172126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67abfc52-f7188a33-9466652b-412f552e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:33.174681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0] Write session: try to update token
2025-10-02T08:14:33.174699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:33.188675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId: src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:33.189697Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:33.189709Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:33.189712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:33.189720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534851749655897:6315]
2025-10-02T08:14:33.189724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534851749655897:6315]
2025-10-02T08:14:33.189763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:33.189774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.189776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:33.189818Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:33.189833Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:33.189911Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:33.191248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:33.263194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534851749655970:3106]
2025-10-02T08:14:33.265743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2094, pipe: [1:7556534851749655970:3106]
2025-10-02T08:14:33.326027Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:33.326331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.326345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.326379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749655970:3106], now have 1 active actors on pipe
2025-10-02T08:14:33.326442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:33.326449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:33.326498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2095 reason: error at write: Disconnected sessionId: src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0
2025-10-02T08:14:33.326589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:33.326648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2095 sessionId: src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0 is DEAD
2025-10-02T08:14:33.326693Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:33.326799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534851749655970:3106]
2025-10-02T08:14:33.326838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:33.326849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0] Write session will restart in 0.008592s
2025-10-02T08:14:33.326873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0] Write session: Do CDS request
2025-10-02T08:14:33.326879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:33.336345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.336379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:33.336392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2096
2025-10-02T08:14:33.336552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.336579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:33.336583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:33.336587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:33.337033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2096 sessionId:  describe result for acl check
2025-10-02T08:14:33.337066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:33.337072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:33.337074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:33.337078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534851749656311:6365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:33.337569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534851749656311:6365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:33.338917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:33.339744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534851749656311:6365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:33.340144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:33.340319Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:33.340330Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:33.340341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:33.340394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:33.340432Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534851749656361:6350]
2025-10-02T08:14:33.341082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:33.341266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:33.341311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:33.341683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:33.341725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.341730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.341731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.341732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.341733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.341738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.341746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.341753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.341756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.341763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.341769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.341779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.341788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.341792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.341799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.341804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.341807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.341812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.341815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.341820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.341836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:33.342441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534851749656311:6365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:33.342451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534851749656311:6365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:33.342454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534851749656311:6365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:33.342460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:33.349405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:33.350874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:33.350888Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:33.350890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:33.350894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:33.350902Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2095 [1:7556534851749656361:6350]
2025-10-02T08:14:33.350914Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:33.350929Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:33.350932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.350934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.350936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.350951Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:33.350960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:33.350966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:33.351031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.351038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.351041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:33.351043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:33.351100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:33.351108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.351118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.351129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:33.351150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749656382:6365], now have 1 active actors on pipe
2025-10-02T08:14:33.351159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534851749656345:6350]
2025-10-02T08:14:33.351161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534851749656345:6350]
2025-10-02T08:14:33.351162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2095
2025-10-02T08:14:33.351170Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:33.351180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534852209227518:2378], now have 1 active actors on pipe
2025-10-02T08:14:33.351179Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:33.351181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:33.351191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:33.351202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:33.351204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:33.351212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.351216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.351259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534851749656345:6350]
2025-10-02T08:14:33.351235Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2095
2025-10-02T08:14:33.351265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:33.351273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:33.351279Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:33.351284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.351290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.351291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:33.351299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.351311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:33.351350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.351390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.351396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.351406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.351438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2096 partition: 0 MaxSeqNo: 17 sessionId: src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0
2025-10-02T08:14:33.351849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4a08ff-4cb74644-ab80209d-6db2e825_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:33.354420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0] Write session: try to update token
2025-10-02T08:14:33.354435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:33.367919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId: src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:33.368278Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:33.368293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:33.368296Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:33.368304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534851749656345:6350]
2025-10-02T08:14:33.368308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534851749656345:6350]
2025-10-02T08:14:33.368347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:33.368354Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:33.368356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.368358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:33.368360Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:33.368488Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:33.370386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:33.426766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534851749656399:3106]
2025-10-02T08:14:33.427022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2095, pipe: [1:7556534851749656399:3106]
2025-10-02T08:14:33.505536Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:33.505803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.505814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.505848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749656399:3106], now have 1 active actors on pipe
2025-10-02T08:14:33.505973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534851749656399:3106]
2025-10-02T08:14:33.505997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:33.505999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:33.506042Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:33.506056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2096 reason: error at write: Disconnected sessionId: src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0
2025-10-02T08:14:33.506080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:33.506203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2096 sessionId: src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0 is DEAD
2025-10-02T08:14:33.506636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:33.506646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0] Write session will restart in 0.007876s
2025-10-02T08:14:33.506670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0] Write session: Do CDS request
2025-10-02T08:14:33.506676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:33.515260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.515356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:33.515369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2097
2025-10-02T08:14:33.515471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.515503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:33.515512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:33.515515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:33.515854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2097 sessionId:  describe result for acl check
2025-10-02T08:14:33.515878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:33.515883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:33.515884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:33.515887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534851749656727:6369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:33.516273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534851749656727:6369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:33.517132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:33.518327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534851749656727:6369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:33.518444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:33.518597Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:33.518606Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:33.518614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:33.518656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:33.518690Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534851749656767:6367]
2025-10-02T08:14:33.519292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:33.519448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:33.519486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:33.519733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:33.519765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.519769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.519770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.519770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.519771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.519774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.519781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.519783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.519785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.519788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.519791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.519796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.519799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.519802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.519804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.519807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.519809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.519812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.519814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.519817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.519826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:33.520564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534851749656727:6369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:33.520577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534851749656727:6369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:33.520579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534851749656727:6369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:33.520587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:33.528010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:33.529446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:33.529458Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:33.529460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:33.529463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:33.529468Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2096 [1:7556534851749656767:6367]
2025-10-02T08:14:33.529479Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:33.529493Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:33.529495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.529497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.529498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.529511Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:33.529514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:33.529521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:33.529566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.529571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.529573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:33.529575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:33.529653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:33.529659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.529670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.529686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2096
2025-10-02T08:14:33.529689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:33.529702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749656790:6369], now have 1 active actors on pipe
2025-10-02T08:14:33.529704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534852209227524:2378], now have 1 active actors on pipe
2025-10-02T08:14:33.529708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.529710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.529724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534851749656748:6367]
2025-10-02T08:14:33.529726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534851749656748:6367]
2025-10-02T08:14:33.529737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:33.529751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:33.529753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:33.529759Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:33.529765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:33.529768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:33.529781Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:33.529787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.529793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.529795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:33.529803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.529815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:33.529787Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2096
2025-10-02T08:14:33.529847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534851749656748:6367]
2025-10-02T08:14:33.529859Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:33.529871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:33.529877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.529934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.529941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.529953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.529990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2097 partition: 0 MaxSeqNo: 17 sessionId: src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0
2025-10-02T08:14:33.530326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c6b98f1-d1bd9ddd-82446dbf-dcbaaad9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:33.532845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0] Write session: try to update token
2025-10-02T08:14:33.532861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:33.540527Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:33.540547Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:33.540557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534851749656748:6367]
2025-10-02T08:14:33.540595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:33.540597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:33.540762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:33.540923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:33.541050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:33.541190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:33.541379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:33.541420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:33.545968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId: src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:33.548341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:33.548473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.548486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.548519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:33.548541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:33.548601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.548613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.548749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.548819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.548885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.548939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.549316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.549324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.549384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.549438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.549490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.549563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.549604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.549609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.549673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.549724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.549774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.549823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.549861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.549866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.549926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.549979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.550033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.550091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.550131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.550138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.550202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.550261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.550317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.550371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.550418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.550426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.550486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.550536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.550590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.550646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.550690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.550695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.550758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.550809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.550865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.550923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.550966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.550971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.551031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.551089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.551143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.551202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.551260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.551267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.551329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.551383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.551441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.551499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.551541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.551547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.551608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.551663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.551725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.551783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.551825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.551831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.551864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:33.551924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.551948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.551954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:33.551983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:33.551998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:33.552005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:33.552008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:33.552011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:33.552379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:33.552401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:33.552408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:33.552412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:33.552417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:33.552419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:33.553004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:33.553022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:33.553027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:33.553030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:33.553033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:33.553035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:33.553482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:33.553498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:33.553503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:33.553506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:33.553510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:33.555662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:33.555675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:33.555684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392873555
2025-10-02T08:14:33.555819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:33.555829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:33.555832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:33.555835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:33.555837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:33.555838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:33.556248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:33.556263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:33.556267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:33.556271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:33.556273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:33.556277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:33.556667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:33.556684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:33.556690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:33.556696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:33.556699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:33.556700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:33.557121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:33.557135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:33.557138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:33.558065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:33.558080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:33.558085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:33.558088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:33.558095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392873557
2025-10-02T08:14:33.558394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:33.558412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:33.558417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:33.558420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:33.558424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:33.558427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:33.558814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:33.558831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:33.558840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:33.558843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:33.558846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:33.558853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:33.559236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:33.559250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.559320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392873559
2025-10-02T08:14:33.559955Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:33.559968Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:33.559972Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:33.559977Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:33.561393Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:33.561404Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:33.561405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:33.561416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534851749656748:6367]
2025-10-02T08:14:33.561419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534851749656748:6367]
2025-10-02T08:14:33.561460Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:33.561467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:33.561468Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:33.561470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.561472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:33.561585Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:33.605985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534851749656812:3106]
2025-10-02T08:14:33.606110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2096, pipe: [1:7556534851749656812:3106]
2025-10-02T08:14:33.694267Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:33.694550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749656812:3106], now have 1 active actors on pipe
2025-10-02T08:14:33.694633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534851749656812:3106]
2025-10-02T08:14:33.694652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:33.694658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:33.694682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2097 reason: error at write: Disconnected sessionId: src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0
2025-10-02T08:14:33.694712Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:33.694760Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:33.694985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:33.694995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0] Write session will restart in 0.005849s
2025-10-02T08:14:33.695016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0] Write session: Do CDS request
2025-10-02T08:14:33.694838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2097 sessionId: src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0 is DEAD
2025-10-02T08:14:33.695030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:33.702223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.702308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:33.702320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2098
2025-10-02T08:14:33.702433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.702459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:33.702464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:33.702468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:33.702871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2098 sessionId:  describe result for acl check
2025-10-02T08:14:33.702896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:33.702902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:33.702903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:33.702907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534851749657118:6384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:33.703349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534851749657118:6384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:33.705097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534851749657118:6384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:33.706591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:33.706927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:33.707068Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:33.707077Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:33.707086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:33.707128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:33.707160Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534851749657196:6390]
2025-10-02T08:14:33.707578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534851749657118:6384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:33.707589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534851749657118:6384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:33.707592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534851749657118:6384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:33.707598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:33.707738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:33.707889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:33.707927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:33.708193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:33.708237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.708242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.708243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.708243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.708245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.708249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.708257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.708263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.708266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.708269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.708274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.708281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.708291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.708296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.708304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.708309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.708316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.708321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.708329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.708334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.708355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:33.716134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:33.717635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:33.717647Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:33.717649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:33.717653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:33.717658Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2097 [1:7556534851749657196:6390]
2025-10-02T08:14:33.717665Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:33.717677Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:33.717683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.717685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.717687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.717699Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:33.717705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:33.717710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:33.718470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.718480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.718483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:33.718485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:33.718556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:33.718563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.718576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.718592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:33.718601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2097
2025-10-02T08:14:33.718614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749657201:6384], now have 1 active actors on pipe
2025-10-02T08:14:33.718618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534852209227542:2378], now have 1 active actors on pipe
2025-10-02T08:14:33.718624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.718633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.718650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534851749657190:6390]
2025-10-02T08:14:33.718655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534851749657190:6390]
2025-10-02T08:14:33.718667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:33.718683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:33.718691Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:33.718694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:33.718700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:33.718704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:33.718720Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39ded548-25cc4158-162bfb59-3f40e416_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:33.718729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.718701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2097
2025-10-02T08:14:33.718733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.718738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:33.718746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.718758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:33.718794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534851749657190:6390]
2025-10-02T08:14:33.718805Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:33.718819Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:33.718820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.718867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.718873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.718885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.718921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2098 partition: 0 MaxSeqNo: 17 sessionId: src_id|39ded548-25cc4158-162bfb59-3f40e416_0
2025-10-02T08:14:33.719238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e76c53d-83b49ac7-5f35a61f-f32a5f0e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|39ded548-25cc4158-162bfb59-3f40e416_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:33.721638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ded548-25cc4158-162bfb59-3f40e416_0] Write session: try to update token
2025-10-02T08:14:33.721651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ded548-25cc4158-162bfb59-3f40e416_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:33.730549Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:33.730566Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:33.730575Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534851749657190:6390]
2025-10-02T08:14:33.730615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:33.730656Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:33.730792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:33.730944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:33.731091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:33.731235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:33.731427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:33.731464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:33.734306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId: src_id|39ded548-25cc4158-162bfb59-3f40e416_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:33.736899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:33.736974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.736988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.737015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:33.737038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:33.737086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.737101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.737262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.737327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.737390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.737457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.737503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.737511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.737579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.737640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.737706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.737772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.737818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.737826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.737889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.737950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.738014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.738075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.738119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.738126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.738191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.738256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.738321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.738387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.738627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.738639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.738701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.738758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.738817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.738875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.738914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.738924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.738985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.739043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.739105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.739164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.739205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.739212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.739277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.739335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.739400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.739463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.739507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.739513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.739575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.739633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.739693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.739751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.739793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.739799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.739861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.739920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.739982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.740044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.740086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.740092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.740154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:33.740222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:33.740278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:33.740337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:33.740380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:33.740387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:33.740423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:33.740483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.740505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.740511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:33.740539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:33.740553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:33.740561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:33.740564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:33.740567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:33.740966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:33.740991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:33.740997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:33.741001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:33.741004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:33.741008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:33.741550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:33.741570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:33.741576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:33.741580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:33.741583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:33.741586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:33.742067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:33.742088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:33.742093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:33.742097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:33.742100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:33.743230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:33.743246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:33.743256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392873743
2025-10-02T08:14:33.743363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:33.743374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:33.743384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:33.743391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:33.743395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:33.743401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:33.743847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:33.743866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:33.743872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:33.743879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:33.743884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:33.743891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:33.744347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:33.744367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:33.744373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:33.744376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:33.744379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:33.744382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:33.744857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:33.744877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:33.744882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:33.745900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:33.745916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:33.745922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:33.745927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:33.745935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392873745
2025-10-02T08:14:33.746221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:33.746241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:33.746247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:33.746250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:33.746253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:33.746258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:33.746716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:33.746734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:33.746743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:33.746751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:33.746754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:33.746757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:33.747216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:33.747237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.747331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392873747
2025-10-02T08:14:33.748053Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:33.748070Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:33.748082Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:33.748093Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:33.749680Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:33.749692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:33.749694Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:33.749702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534851749657190:6390]
2025-10-02T08:14:33.749706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534851749657190:6390]
2025-10-02T08:14:33.749746Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:33.749756Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:33.749757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:33.749761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.749763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:33.749885Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:33.794890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534851749657248:3106]
2025-10-02T08:14:33.794980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2097, pipe: [1:7556534851749657248:3106]
2025-10-02T08:14:33.894622Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:33.894969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749657248:3106], now have 1 active actors on pipe
2025-10-02T08:14:33.895077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:33.895083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:33.895107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2098 reason: error at write: Disconnected sessionId: src_id|39ded548-25cc4158-162bfb59-3f40e416_0
2025-10-02T08:14:33.895185Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:33.895261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2098 sessionId: src_id|39ded548-25cc4158-162bfb59-3f40e416_0 is DEAD
2025-10-02T08:14:33.895230Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:33.895397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ded548-25cc4158-162bfb59-3f40e416_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:33.895406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ded548-25cc4158-162bfb59-3f40e416_0] Write session will restart in 0.006908s
2025-10-02T08:14:33.895427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ded548-25cc4158-162bfb59-3f40e416_0] Write session: Do CDS request
2025-10-02T08:14:33.895431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ded548-25cc4158-162bfb59-3f40e416_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:33.895465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534851749657248:3106]
2025-10-02T08:14:33.903296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ded548-25cc4158-162bfb59-3f40e416_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.903385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:33.903404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2099
2025-10-02T08:14:33.903502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:33.903530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:33.903538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:33.903555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:33.904019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2099 sessionId:  describe result for acl check
2025-10-02T08:14:33.904051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:33.904058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:33.904059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:33.904063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534851749657568:6411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:33.904556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534851749657568:6411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:33.906073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:33.906446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534851749657568:6411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:33.907334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:33.907465Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:33.907472Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:33.907478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:33.907510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:33.907534Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534851749657629:6402]
2025-10-02T08:14:33.907921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:33.908070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:33.908110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:33.908322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:33.908353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.908357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.908357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.908358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.908358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.908361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.908366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.908369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.908371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.908373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.908377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.908381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:33.908385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.908388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:33.908390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.908392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:33.908396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.908399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.908401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.908403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.908414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:33.912964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534851749657568:6411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:33.912977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534851749657568:6411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:33.912981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534851749657568:6411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:33.912989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:33.916052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:33.917512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:33.917527Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:33.917529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:33.917531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:33.917536Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2098 [1:7556534851749657629:6402]
2025-10-02T08:14:33.917544Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:33.917558Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:33.917560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.917563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.917564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.917576Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:33.917579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:33.917583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:33.917627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.917637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.917639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:33.917640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:33.917698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:33.917705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.917715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:33.917725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:33.917744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534851749657612:6402]
2025-10-02T08:14:33.917754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534851749657612:6402]
2025-10-02T08:14:33.917760Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:33.917767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2098
2025-10-02T08:14:33.917774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749657646:6411], now have 1 active actors on pipe
2025-10-02T08:14:33.917775Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:33.917778Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:33.917780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:33.917792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:33.917794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:33.917799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534852209227550:2378], now have 1 active actors on pipe
2025-10-02T08:14:33.917802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.917808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.917843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534851749657612:6402]
2025-10-02T08:14:33.917851Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:33.917864Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30951752-7654421-a4fcc362-61aab521_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:33.917868Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:33.917874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:33.917850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2098
2025-10-02T08:14:33.917877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:33.917879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:33.917888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:33.917895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:33.917930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.918010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:33.918016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:33.918028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:33.918063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2099 partition: 0 MaxSeqNo: 17 sessionId: src_id|30951752-7654421-a4fcc362-61aab521_0
2025-10-02T08:14:33.918384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ded548-25cc4158-162bfb59-3f40e416_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|30951752-7654421-a4fcc362-61aab521_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:33.920846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30951752-7654421-a4fcc362-61aab521_0] Write session: try to update token
2025-10-02T08:14:33.920858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30951752-7654421-a4fcc362-61aab521_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:33.933088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId: src_id|30951752-7654421-a4fcc362-61aab521_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:33.935443Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:33.935455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:33.935457Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:33.935464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534851749657612:6402]
2025-10-02T08:14:33.935467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534851749657612:6402]
2025-10-02T08:14:33.935501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:33.935509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:33.935511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:33.935520Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:33.935525Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:33.935533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:33.935621Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:33.995597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534851749657659:3106]
2025-10-02T08:14:33.995699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2098, pipe: [1:7556534851749657659:3106]
2025-10-02T08:14:34.076373Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:34.076817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.076830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.076866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534851749657659:3106], now have 1 active actors on pipe
2025-10-02T08:14:34.076972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534851749657659:3106]
2025-10-02T08:14:34.076992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:34.076997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:34.077044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2099 reason: error at write: Disconnected sessionId: src_id|30951752-7654421-a4fcc362-61aab521_0
2025-10-02T08:14:34.077047Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:34.077100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:34.077161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2099 sessionId: src_id|30951752-7654421-a4fcc362-61aab521_0 is DEAD
2025-10-02T08:14:34.077326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30951752-7654421-a4fcc362-61aab521_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:34.077335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30951752-7654421-a4fcc362-61aab521_0] Write session will restart in 0.007543s
2025-10-02T08:14:34.077356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30951752-7654421-a4fcc362-61aab521_0] Write session: Do CDS request
2025-10-02T08:14:34.077360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30951752-7654421-a4fcc362-61aab521_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:34.086336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30951752-7654421-a4fcc362-61aab521_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.086437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:34.086451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2100
2025-10-02T08:14:34.086556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.086590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:34.086596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:34.086599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:34.087045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2100 sessionId:  describe result for acl check
2025-10-02T08:14:34.087068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:34.087069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:34.087070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:34.087073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534856044625291:6430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:34.087420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534856044625291:6430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:34.088463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:34.089134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534856044625291:6430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:34.089912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:34.090044Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:34.090053Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:34.090061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:34.090093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:34.090117Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534856044625339:6429]
2025-10-02T08:14:34.090517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:34.090665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:34.090692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:34.090915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:34.090946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.090950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.090950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.090951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.090951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.090954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.090960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.090962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.090964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.090966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.090969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.090974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.090977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.090980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.090983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.090986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.090990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.090992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.090994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.091009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.091022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:34.095836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534856044625291:6430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:34.095849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534856044625291:6430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:34.095852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534856044625291:6430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:34.095859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:34.099156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:34.100711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:34.100728Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:34.100730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:34.100733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:34.100739Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2099 [1:7556534856044625339:6429]
2025-10-02T08:14:34.100749Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:34.100768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:34.100771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.100773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.100775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.100788Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:34.100796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:34.100820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:34.100878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.100885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.100888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:34.100890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:34.100950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:34.100956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.100967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.100981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:34.101001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044625356:6430], now have 1 active actors on pipe
2025-10-02T08:14:34.101011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534856044625322:6429]
2025-10-02T08:14:34.101011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2099
2025-10-02T08:14:34.101016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534856044625322:6429]
2025-10-02T08:14:34.101022Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:34.101030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534856504194853:2378], now have 1 active actors on pipe
2025-10-02T08:14:34.101033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:34.101036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:34.101040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:34.101051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:34.101057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:34.101065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.101074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.101106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534856044625322:6429]
2025-10-02T08:14:34.101113Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:34.101117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:34.101090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2099
2025-10-02T08:14:34.101127Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:34.101139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.101146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.101147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:34.101156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.101163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:34.101203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.101275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.101285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.101297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.101328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2100 partition: 0 MaxSeqNo: 17 sessionId: src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0
2025-10-02T08:14:34.101613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30951752-7654421-a4fcc362-61aab521_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:34.104060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0] Write session: try to update token
2025-10-02T08:14:34.104076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:34.111859Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:34.111879Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:34.111888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534856044625322:6429]
2025-10-02T08:14:34.111930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:34.111930Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:34.112090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:34.112230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.112376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.112519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.112713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:34.112751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:34.118753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId: src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:34.121307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:34.121386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.121403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.121438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:34.121464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:34.121511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.121526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.121685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.121760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.121821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.121883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.121931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.121936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.122003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.122063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.122123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.122184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.122225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.122232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.122296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.122356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.122418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.122480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.122523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.122530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.122598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.122661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.122722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.122787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.122832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.122839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.122903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.122965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.123027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.123097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.123142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.123149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.123217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.123279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.123342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.123404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.123447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.123454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.123522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.123581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.123643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.123705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.123749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.123757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.123821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.123884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.123943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.124006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.124051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.124058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.124120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.124181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.124258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.124321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.124370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.124377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.124441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.124500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.124562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.124623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.124664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.124671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.124716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:34.124781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.124825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.124832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:34.124863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:34.124876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:34.124880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:34.124883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:34.124886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:34.125260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:34.125289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:34.125300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:34.125304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:34.125307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:34.125310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:34.125939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:34.125967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:34.125975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:34.125983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:34.125987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:34.125992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:34.126555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:34.126577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:34.126584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:34.126587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:34.126596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:34.127766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:34.127784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:34.127795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392874127
2025-10-02T08:14:34.127980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:34.127994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:34.128001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:34.128004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:34.128008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:34.128012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:34.128493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:34.128513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:34.128520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:34.128525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:34.128533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:34.128538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:34.129024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:34.129044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:34.129052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:34.129060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:34.129065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:34.129068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:34.129519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:34.129539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:34.129543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:34.130609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:34.130627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:34.130632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:34.130636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:34.130644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392874130
2025-10-02T08:14:34.130928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:34.130949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:34.130957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:34.130960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:34.130964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:34.130967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:34.131406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:34.131424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:34.131430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:34.131433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:34.131436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:34.131440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:34.131859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:34.131877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.131976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392874131
2025-10-02T08:14:34.132697Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:34.132731Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:34.132742Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:34.132750Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:34.134284Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:34.134298Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:34.134300Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:34.134310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534856044625322:6429]
2025-10-02T08:14:34.134313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534856044625322:6429]
2025-10-02T08:14:34.134367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:34.134369Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:34.134373Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:34.134376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.134379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:34.134501Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:34.177364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534856044625376:3106]
2025-10-02T08:14:34.177462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2099, pipe: [1:7556534856044625376:3106]
2025-10-02T08:14:34.279545Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:34.279875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044625376:3106], now have 1 active actors on pipe
2025-10-02T08:14:34.280104Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:34.280309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:34.280404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:34.280432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2100 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0
2025-10-02T08:14:34.280592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2100 sessionId: src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0 is DEAD
2025-10-02T08:14:34.280722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:34.280731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0] Write session will restart in 0.007145s
2025-10-02T08:14:34.280752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0] Write session: Do CDS request
2025-10-02T08:14:34.280743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534856044625376:3106]
2025-10-02T08:14:34.280759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:34.289238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.289290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:34.289303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2101
2025-10-02T08:14:34.289444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.289474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:34.289482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:34.289486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:34.290049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2101 sessionId:  describe result for acl check
2025-10-02T08:14:34.290076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:34.290078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:34.290079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:34.290082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534856044625700:6461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:34.290541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534856044625700:6461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:34.292567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:34.293339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534856044625700:6461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:34.293774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:34.293936Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:34.293944Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:34.293954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:34.294001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:34.294037Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534856044625765:6453]
2025-10-02T08:14:34.294590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:34.294799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:34.294838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:34.295115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:34.295163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.295168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.295169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.295170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.295171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.295176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.295185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.295188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.295192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.295200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.295207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.295217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.295225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.295231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.295238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.295243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.295250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.295255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.295260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.295269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.295286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:34.301059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534856044625700:6461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:34.301072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534856044625700:6461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:34.304793Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2100
2025-10-02T08:14:34.301075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534856044625700:6461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:34.301083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:34.303027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:34.304450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:34.304456Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:34.304458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:34.304461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:34.304467Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2100 [1:7556534856044625765:6453]
2025-10-02T08:14:34.304476Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:34.304490Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:34.304493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.304495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.304499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.304514Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:34.304518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:34.304525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:34.304579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.304580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.304583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:34.304585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:34.304643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:34.304645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.304656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.304667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:34.304683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044625789:6461], now have 1 active actors on pipe
2025-10-02T08:14:34.304689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534856044625757:6453]
2025-10-02T08:14:34.304691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534856044625757:6453]
2025-10-02T08:14:34.304697Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:34.304706Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:34.304708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:34.304710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:34.304721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:34.304724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:34.304728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534856504194876:2378], now have 1 active actors on pipe
2025-10-02T08:14:34.304754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534856044625757:6453]
2025-10-02T08:14:34.304760Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:34.304766Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:34.304795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2100
2025-10-02T08:14:34.304909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.304912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.304936Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:34.304941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.304945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.304946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:34.304955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.304963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:34.304976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.305145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.305156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.305168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.305205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2101 partition: 0 MaxSeqNo: 17 sessionId: src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0
2025-10-02T08:14:34.305519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28eea910-9f7433e5-4d1fe631-e2e5f4dc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:34.307969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0] Write session: try to update token
2025-10-02T08:14:34.307983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:34.321495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId: src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:34.322833Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:34.322852Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:34.322854Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:34.322861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534856044625757:6453]
2025-10-02T08:14:34.322865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534856044625757:6453]
2025-10-02T08:14:34.322905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:34.322911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.322913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:34.322915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:34.322921Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:34.323054Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:34.323929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:34.381137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534856044625827:3106]
2025-10-02T08:14:34.381206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2100, pipe: [1:7556534856044625827:3106]
2025-10-02T08:14:34.457803Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:34.458348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.458366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.458403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044625827:3106], now have 1 active actors on pipe
2025-10-02T08:14:34.458508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:34.458518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:34.458582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2101 reason: error at write: Disconnected sessionId: src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0
2025-10-02T08:14:34.458603Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:34.458717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2101 sessionId: src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0 is DEAD
2025-10-02T08:14:34.458888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:34.458899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0] Write session will restart in 0.009124s
2025-10-02T08:14:34.458865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534856044625827:3106]
2025-10-02T08:14:34.458926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0] Write session: Do CDS request
2025-10-02T08:14:34.458933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:34.459484Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:34.469264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.469318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:34.469334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2102
2025-10-02T08:14:34.469454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.469478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:34.469483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:34.469486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:34.469935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2102 sessionId:  describe result for acl check
2025-10-02T08:14:34.469958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:34.469960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:34.469962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:34.469967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534856044626167:12284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:34.470432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534856044626167:12284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:34.471685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:34.472687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534856044626167:12284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:34.473149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:34.473324Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:34.473335Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:34.473344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:34.473391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:34.473425Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534856044626213:6512]
2025-10-02T08:14:34.474054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:34.474257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:34.474314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:34.474608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:34.474664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.474671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.474672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.474673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.474674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.474680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.474689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.474693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.474696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.474699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.474705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.474712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.474722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.474727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.474731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.474736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.474744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.474750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.474758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.474764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.474786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:34.475635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534856044626167:12284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:34.475647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534856044626167:12284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:34.475651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534856044626167:12284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:34.475670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:34.482949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:34.484630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:34.484648Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:34.484653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:34.484656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:34.484662Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2101 [1:7556534856044626213:6512]
2025-10-02T08:14:34.484675Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:34.484693Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:34.484696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.484699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.484701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.484716Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:34.484720Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:34.484728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:34.484792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.484818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.484821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:34.484823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:34.484889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:34.484899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.484912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.484924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:34.484941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534856044626194:6512]
2025-10-02T08:14:34.484947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534856044626194:6512]
2025-10-02T08:14:34.484954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:34.484961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2101
2025-10-02T08:14:34.484966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:34.484968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044626231:12284], now have 1 active actors on pipe
2025-10-02T08:14:34.484969Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:34.484975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:34.484990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:34.484992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:34.484997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534856504194891:2378], now have 1 active actors on pipe
2025-10-02T08:14:34.485002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.485005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.485045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534856044626194:6512]
2025-10-02T08:14:34.485057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:34.485064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:34.485072Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:34.485079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.485084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.485085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:34.485093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.485107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:34.485147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.485191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.485198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.485211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.485250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2102 partition: 0 MaxSeqNo: 17 sessionId: src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0
2025-10-02T08:14:34.485559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445c1d7f-8c1cd09d-5c9aaef4-627861cf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:34.488075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0] Write session: try to update token
2025-10-02T08:14:34.488094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:34.488949Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2101
2025-10-02T08:14:34.496409Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:34.496424Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:34.496431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534856044626194:6512]
2025-10-02T08:14:34.496469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:34.496469Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:34.496635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:34.496779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.496951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.497089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.497280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:34.497321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:34.507111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId: src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:34.509532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:34.509764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.509783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.509816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:34.509848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:34.509885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.509890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.510119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.510175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.510237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.510299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.510341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.510347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.510409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.510465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.510535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.510603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.510646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.510651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.510722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.510791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.510845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.510900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.510938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.510943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.511003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.511070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.511129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.511186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.511226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.511231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.511290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.511344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.511405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.511464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.511507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.511512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.511575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.511777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.511977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.512038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.512084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.512092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.512151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.512219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.512280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.512340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.512436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.512444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.512506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.512566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.512631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.512693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.512732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.512737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.512815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.512884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.512943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.513002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.513043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.513048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.513116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.513171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.513232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.513292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.513335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.513341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.513374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:34.513442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.513462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.513467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:34.513498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:34.513515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:34.513520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:34.513532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:34.513538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:34.513905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:34.513928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:34.513936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:34.513943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:34.513945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:34.513947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:34.514383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:34.514402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:34.514410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:34.514416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:34.514418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:34.514420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:34.514855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:34.514873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:34.514878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:34.514884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:34.514886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:34.518325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:34.518341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:34.518351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392874518
2025-10-02T08:14:34.518558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:34.518570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:34.518574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:34.518576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:34.518579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:34.518581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:34.519024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:34.519044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:34.519048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:34.519055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:34.519057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:34.519059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:34.519471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:34.519490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:34.519495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:34.519498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:34.519500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:34.519502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:34.519918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:34.519942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:34.519949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:34.520967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:34.520982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:34.520986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:34.520990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:34.520996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392874520
2025-10-02T08:14:34.521255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:34.521275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:34.521280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:34.521284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:34.521287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:34.521290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:34.521715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:34.521733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:34.521737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:34.521739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:34.521742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:34.521746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:34.522162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:34.522181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.522265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392874521
2025-10-02T08:14:34.522961Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:34.522980Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:34.522988Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:34.522991Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:34.524526Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:34.524537Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:34.524538Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:34.524544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534856044626194:6512]
2025-10-02T08:14:34.524547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534856044626194:6512]
2025-10-02T08:14:34.524595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:34.524596Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:34.524601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:34.524602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.524603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:34.524725Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:34.558776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534856044626255:3106]
2025-10-02T08:14:34.558884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2101, pipe: [1:7556534856044626255:3106]
2025-10-02T08:14:34.661132Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:34.661448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044626255:3106], now have 1 active actors on pipe
2025-10-02T08:14:34.661605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534856044626255:3106]
2025-10-02T08:14:34.661637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:34.661640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:34.661645Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:34.661672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2102 reason: error at write: Disconnected sessionId: src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0
2025-10-02T08:14:34.661709Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:34.661846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2102 sessionId: src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0 is DEAD
2025-10-02T08:14:34.662000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:34.662015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0] Write session will restart in 0.005477s
2025-10-02T08:14:34.661987Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:14:34.662037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0] Write session: Do CDS request
2025-10-02T08:14:34.662044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:34.662100Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 21 consumer shared/user session shared/user_1_21_2498544722244708379_v1 is DEAD
2025-10-02T08:14:34.662282Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:14:34.662298Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534778735183452:3072] disconnected; active server actors: 1
2025-10-02T08:14:34.662315Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534778735183452:3072] client user disconnected session shared/user_1_21_2498544722244708379_v1
2025-10-02T08:14:34.662402Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:14:34.662408Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:14:34.662413Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.006810s
2025-10-02T08:14:34.668344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.668444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:34.668463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2103
2025-10-02T08:14:34.668588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.668629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:34.668638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:34.668643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:34.669134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2103 sessionId:  describe result for acl check
2025-10-02T08:14:34.669165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:34.669171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:34.669173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:34.669178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534856044626458:12262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:34.669662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534856044626458:12262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:34.672582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534856044626458:12262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:34.673121Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:14:34.673304Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:14:34.673318Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 22
2025-10-02T08:14:34.673624Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 22 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:14:34.673673Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:14:34.673752Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 auth for : user
2025-10-02T08:14:34.674018Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 Handle describe topics response
2025-10-02T08:14:34.674049Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 auth is DEAD
2025-10-02T08:14:34.674059Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:14:34.674292Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:14:34.674377Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_22_10142374153447640747_v1
2025-10-02T08:14:34.674389Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:14:34.674468Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:14:34.674541Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:14:34.674577Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534856044626624:12254] connected; active server actors: 1
2025-10-02T08:14:34.674593Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 got read request: guid# f8c0fc78-e9e8ee75-902d5452-3a9c754e
2025-10-02T08:14:34.674706Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534856044626624:12254] session shared/user_1_22_10142374153447640747_v1
2025-10-02T08:14:34.674721Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:14:34.674732Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:14:34.674738Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_22_10142374153447640747_v1" (Sender=[1:7556534856044626592:12254], Pipe=[1:7556534856044626624:12254], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:14:34.674742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:14:34.674754Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:14:34.674760Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_22_10142374153447640747_v1" (Sender=[1:7556534856044626592:12254], Pipe=[1:7556534856044626624:12254], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:14:34.674769Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_22_10142374153447640747_v1" sender [1:7556534856044626592:12254] lock partition 0 for ReadingSession "shared/user_1_22_10142374153447640747_v1" (Sender=[1:7556534856044626592:12254], Pipe=[1:7556534856044626624:12254], Partitions=[], ActiveFamilyCount=1) generation 1 step 22
2025-10-02T08:14:34.674782Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:14:34.674789Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-02T08:14:34.675034Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 22 Session: "shared/user_1_22_10142374153447640747_v1" ClientId: "user" PipeClient { RawX1: 7556534856044626624 RawX2: 4503603922350046 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:14:34.675066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:14:34.676381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:34.676591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534856044626458:12262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:34.676602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534856044626458:12262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:34.676605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534856044626458:12262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:34.676613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:34.677627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:34.677804Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:34.677813Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:34.677823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:34.677887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:34.677920Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534856044626658:12260]
2025-10-02T08:14:34.678497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:34.678689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:34.678740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:34.679027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:34.679078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.679084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.679084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.679085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.679086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.679089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.679095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.679097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.679099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.679101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.679104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.679109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.679113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.679115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.679118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.679121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.679123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.679125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.679128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.679131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.679143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:34.688973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:34.690657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:34.690682Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:34.690685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:34.690689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:34.690696Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2102 [1:7556534856044626658:12260]
2025-10-02T08:14:34.690709Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:34.690727Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:34.690736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.690739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.690741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.690756Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:34.690761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:34.690773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:34.690840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.690848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.690851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:34.690854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:34.690925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:34.690936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.690949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.690961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:34.690983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2102, pipe: [1:7556534856044626633:12248]
2025-10-02T08:14:34.690985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044626633:12248], now have 1 active actors on pipe
2025-10-02T08:14:34.690989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044626653:12262], now have 1 active actors on pipe
2025-10-02T08:14:34.690992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534856504194909:2378], now have 1 active actors on pipe
2025-10-02T08:14:34.690998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534856044626647:12260]
2025-10-02T08:14:34.691001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534856044626647:12260]
2025-10-02T08:14:34.691006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2102
2025-10-02T08:14:34.691008Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:34.691019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.691020Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:34.691023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:34.691024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.691036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_22_10142374153447640747_v1 on pipe: [1:7556534856044626633:12248]
2025-10-02T08:14:34.691064Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_22_10142374153447640747_v1:1 with generation 2102
2025-10-02T08:14:34.691066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:34.691082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:34.691090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:34.691060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2102
2025-10-02T08:14:34.691097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.691106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.691150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.691166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.691168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:34.691185Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_22_10142374153447640747_v1
2025-10-02T08:14:34.691188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.691222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534856044626647:12260]
2025-10-02T08:14:34.691242Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:34.691265Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:34.691276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:14:34.691286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:34.691300Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:34.692709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:14:34.692735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:14:34.692743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.692752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.692758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:34.692767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.692782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:34.692791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:14:34.692835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:14:34.692850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.692879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.692888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.692903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.692910Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392874690 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:14:34.692919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:14:34.692935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2103 partition: 0 MaxSeqNo: 17 sessionId: src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0
2025-10-02T08:14:34.692941Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 sending to client partition status
2025-10-02T08:14:34.693285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54619451-6faf2c3a-1c31fc38-6a0b7d45_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:34.695960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0] Write session: try to update token
2025-10-02T08:14:34.695978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:34.704663Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:34.704680Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:34.704688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534856044626647:12260]
2025-10-02T08:14:34.704730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:34.704733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:34.704912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:34.705043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.705231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.705397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:34.705619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:34.705660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:34.710651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId: src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:34.713277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:34.713410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.713426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.713458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:34.713507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:34.713585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.713598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.713750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.713820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.713885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.713952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.714001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.714010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.714078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.714146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.714233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.714298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.714344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.714352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.714423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.714481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.714539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.714602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.714647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.714654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.714729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.714795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.714858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.714925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.714980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.714988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.715057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.715121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.715188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.715253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.715297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.715304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.715371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.715432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.715501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.715565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.715614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.715621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.715690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.715750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.715818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.715885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.715938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.715946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.716018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.716079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.716141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.716224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.716274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.716281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.716349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.716414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.716482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.716546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.716593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.716600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.716666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:34.716730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:34.716795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:34.716884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:34.716932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:34.716939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:34.716978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:34.717043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.717066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.717072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:34.717105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:34.717122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:34.717129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:34.717132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:34.717135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:34.717533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:34.717569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:34.717581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:34.717589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:34.717593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:34.717597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:34.718225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:34.718255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:34.718261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:34.718265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:34.718269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:34.718273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:34.718861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:34.718892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:34.718898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:34.718902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:34.718906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:34.720224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:34.720247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:34.720261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392874720
2025-10-02T08:14:34.720384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:34.720400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:34.720405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:34.720412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:34.720421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:34.720424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:34.720931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:34.720956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:34.720963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:34.720967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:34.720971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:34.720974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:34.721518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:34.721545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:34.721554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:34.721558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:34.721562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:34.721565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:34.722065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:34.722094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:34.722100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:34.723258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:34.723284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:34.723292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:34.723296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:34.723306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392874723
2025-10-02T08:14:34.723632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:34.723660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:34.723671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:34.723678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:34.723682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:34.723686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:34.724231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:34.724258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:34.724265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:34.724268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:34.724273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:34.724277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:34.724772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:34.724798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.724927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392874724
2025-10-02T08:14:34.725778Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:34.725799Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:34.725807Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:34.725816Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:34.727619Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:34.727636Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:34.727638Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:34.727649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534856044626647:12260]
2025-10-02T08:14:34.727653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534856044626647:12260]
2025-10-02T08:14:34.727706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:34.727710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:34.727716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.727718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:34.727720Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:34.727862Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:34.867055Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:34.867495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534856044626633:12248]
2025-10-02T08:14:34.867533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:34.867540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:34.867564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_22_10142374153447640747_v1
2025-10-02T08:14:34.867567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2103 reason: error at write: Disconnected sessionId: src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0
2025-10-02T08:14:34.867584Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:34.867583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:34.867720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2103 sessionId: src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0 is DEAD
2025-10-02T08:14:34.867874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:34.867886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0] Write session will restart in 0.005053s
2025-10-02T08:14:34.867881Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_22_10142374153447640747_v1
2025-10-02T08:14:34.867910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0] Write session: Do CDS request
2025-10-02T08:14:34.867919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:34.874304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.874364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:34.874377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2104
2025-10-02T08:14:34.874502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:34.874533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:34.874538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:34.874541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:34.874920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2104 sessionId:  describe result for acl check
2025-10-02T08:14:34.874952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:34.874958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:34.874960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:34.874965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534856044626937:12241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:34.875456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534856044626937:12241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:34.877575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534856044626937:12241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:34.881275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534856044626937:12241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:34.881290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534856044626937:12241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:34.881293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534856044626937:12241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:34.881301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:34.883811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:34.884105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:34.884299Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:34.884308Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:34.884317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:34.884364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:34.884399Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534856044627178:12242]
2025-10-02T08:14:34.885036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:34.885240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:34.885283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:34.885599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:34.885648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.885653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.885654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.885655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.885657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.885661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.885671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.885679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.885683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.885687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.885692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.885700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:34.885706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.885711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:34.885716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.885737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:34.885746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.885751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.885759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.885764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.885786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:34.893555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:34.895051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:34.895066Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:34.895068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:34.895072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:34.895079Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2103 [1:7556534856044627178:12242]
2025-10-02T08:14:34.895090Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:34.895104Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:34.895110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.895112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.895113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.895125Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:34.895132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:34.895137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:34.895182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.895187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.895189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:34.895191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:34.895239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:34.895245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.895263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:34.895273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:34.895290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044627153:12241], now have 1 active actors on pipe
2025-10-02T08:14:34.895299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534856044627172:12242]
2025-10-02T08:14:34.895298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2103
2025-10-02T08:14:34.895300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534856044627172:12242]
2025-10-02T08:14:34.895305Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:34.895311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534856504194919:2378], now have 1 active actors on pipe
2025-10-02T08:14:34.895318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.895324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:34.895327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:34.895330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.895352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:34.895368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:34.895375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:34.895419Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:34.895430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:34.895434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:34.895435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:34.895444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:34.895452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:34.895421Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2103
2025-10-02T08:14:34.895464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534856044627172:12242]
2025-10-02T08:14:34.895476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:34.895479Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:34.895505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.895573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:34.895581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:34.895595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:34.895628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2104 partition: 0 MaxSeqNo: 17 sessionId: src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0
2025-10-02T08:14:34.895911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3058779e-a929dd8d-ff1a807d-2b29e4bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:34.898878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0] Write session: try to update token
2025-10-02T08:14:34.898892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:34.914024Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:34.914024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId: src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:34.914043Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:34.914046Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:34.914053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534856044627172:12242]
2025-10-02T08:14:34.914057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534856044627172:12242]
2025-10-02T08:14:34.914098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:34.914105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:34.914107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:34.914216Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:34.914230Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:34.914256Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:34.916581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:34.968915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534856044627203:12248]
2025-10-02T08:14:34.969012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2103, pipe: [1:7556534856044627203:12248]
2025-10-02T08:14:35.052466Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:35.052955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.052969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.053001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534856044627203:12248], now have 1 active actors on pipe
2025-10-02T08:14:35.053292Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:35.053699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:35.053710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0] Write session will restart in 0.007166s
2025-10-02T08:14:35.053735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0] Write session: Do CDS request
2025-10-02T08:14:35.053741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:35.053342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:35.053410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2104 reason: status is not ok: tablet will be restarted right now sessionId: src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0
2025-10-02T08:14:35.053561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2104 sessionId: src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0 is DEAD
2025-10-02T08:14:35.053689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534856044627203:12248]
2025-10-02T08:14:35.053855Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:35.062300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.064922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:35.064940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2105
2025-10-02T08:14:35.065728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.065757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:35.065760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:35.065762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:35.066378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2105 sessionId:  describe result for acl check
2025-10-02T08:14:35.066403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:35.066405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:35.066406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:35.066410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534860339594843:12208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:35.066821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534860339594843:12208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:35.069898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534860339594843:12208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:35.071348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:35.072134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:35.072297Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:35.072306Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:35.072315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:35.072359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:35.072394Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534860339594962:12218]
2025-10-02T08:14:35.072746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534860339594843:12208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:35.072760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534860339594843:12208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:35.072764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534860339594843:12208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:35.072772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:35.073006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:35.073161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:35.073198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:35.073452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:35.073479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.073483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.073484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.073485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.073485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.073489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.073494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.073497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.073500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.073504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.073508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.073515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.073520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.073525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.073528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.073531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.073533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.073536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.073539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.073541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.073551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:35.083701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:35.085143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:35.085157Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:35.085160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:35.085164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:35.085170Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2104 [1:7556534860339594962:12218]
2025-10-02T08:14:35.085182Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:35.085200Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:35.085202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.085205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.085207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.085222Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:35.085232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:35.085239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:35.085283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.085290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.085292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:35.085293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:35.085343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:35.085348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.085357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.085363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:35.085377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534860339594956:12218]
2025-10-02T08:14:35.085383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534860339594956:12218]
2025-10-02T08:14:35.085388Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:35.085397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:35.085406Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:35.085409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:35.085409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:35.085411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:35.085418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2104
2025-10-02T08:14:35.085419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339594967:12208], now have 1 active actors on pipe
2025-10-02T08:14:35.085421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534860799162222:2378], now have 1 active actors on pipe
2025-10-02T08:14:35.085447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534860339594956:12218]
2025-10-02T08:14:35.085455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:35.085462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.085464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:35.085468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.085506Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:35.085516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.085521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.085522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:35.085529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.085540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:35.085523Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2104
2025-10-02T08:14:35.085556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.085597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.085604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.085615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.085651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2105 partition: 0 MaxSeqNo: 17 sessionId: src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0
2025-10-02T08:14:35.085971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|251a05f3-a3dcfcd6-6b8ccae1-46743fad_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:35.088612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0] Write session: try to update token
2025-10-02T08:14:35.088627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:35.106888Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:35.106905Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:35.106908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:35.106916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534860339594956:12218]
2025-10-02T08:14:35.106920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534860339594956:12218]
2025-10-02T08:14:35.106925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId: src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:35.106957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:35.106962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.106963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:35.107088Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:35.108692Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:35.108700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:35.110029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:35.153755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534860339594992:12248]
2025-10-02T08:14:35.153923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2104, pipe: [1:7556534860339594992:12248]
2025-10-02T08:14:35.250254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:35.250267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0] Write session will restart in 0.007818s
2025-10-02T08:14:35.250290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0] Write session: Do CDS request
2025-10-02T08:14:35.250296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:35.249869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:35.249129Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:35.249530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.249539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.249578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339594992:12248], now have 1 active actors on pipe
2025-10-02T08:14:35.249701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534860339594992:12248]
2025-10-02T08:14:35.249716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:35.249718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:35.249769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2105 reason: error at write: Disconnected sessionId: src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0
2025-10-02T08:14:35.249791Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:35.249920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2105 sessionId: src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0 is DEAD
2025-10-02T08:14:35.259310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.259328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:35.259348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2106
2025-10-02T08:14:35.259515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.259546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:35.259555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:35.259559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:35.259969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2106 sessionId:  describe result for acl check
2025-10-02T08:14:35.260002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:35.260008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:35.260009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:35.260014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534860339595353:12205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:35.260465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534860339595353:12205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:35.262757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534860339595353:12205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:35.263304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:35.263857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:35.264014Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:35.264023Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:35.264032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:35.264069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:35.264098Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534860339595455:12204]
2025-10-02T08:14:35.264535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:35.264781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:35.264835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:35.265106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:35.265148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.265149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.265150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.265151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.265152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.265156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.265165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.265169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.265173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.265176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.265181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.265188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.265192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.265197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.265201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.265206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.265211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.265215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.265220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.265225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.265243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:35.265327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534860339595353:12205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:35.265334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534860339595353:12205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:35.265337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534860339595353:12205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:35.265346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:35.280387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:35.281956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:35.281972Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:35.281974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:35.281976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:35.281981Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2105 [1:7556534860339595455:12204]
2025-10-02T08:14:35.281992Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:35.282009Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:35.282011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.282014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.282016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.282031Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:35.282036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:35.282042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:35.282100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.282108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.282111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:35.282113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:35.282173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:35.282179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.282190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.282206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:35.282326Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2105
2025-10-02T08:14:35.282226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534860339595448:12204]
2025-10-02T08:14:35.282233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534860339595448:12204]
2025-10-02T08:14:35.282240Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:35.282251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:35.282253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:35.282255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:35.282264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:35.282267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:35.282276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339595471:12205], now have 1 active actors on pipe
2025-10-02T08:14:35.282279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534860799162230:2378], now have 1 active actors on pipe
2025-10-02T08:14:35.282309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534860339595448:12204]
2025-10-02T08:14:35.282317Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:35.282328Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:35.282352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2105
2025-10-02T08:14:35.282367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.282371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.282398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:35.282404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.282407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.282409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:35.282418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.282427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:35.282441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.282466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.282467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.282479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.282511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2106 partition: 0 MaxSeqNo: 17 sessionId: src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0
2025-10-02T08:14:35.282830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|883e5fc5-53c13053-bd4c11bc-dfe5a533_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:35.285316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0] Write session: try to update token
2025-10-02T08:14:35.285334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:35.298859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId: src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:35.300102Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:35.300117Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:35.300125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534860339595448:12204]
2025-10-02T08:14:35.300172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:35.300177Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:35.300378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:35.300540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:35.300688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:35.300862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:35.301131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:35.301169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:35.301546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:35.301622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.301631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.301660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:35.301683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:35.301732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.301739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.301905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.301966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.302033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.302095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.302506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.302511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.302587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.302654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.302721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.302795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.302854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.302863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.302938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.303006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.303077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.303146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.303194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.303203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.303276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.303347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.303417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.303488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.303537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.303545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.303617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.303685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.303758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.303832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.303882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.303894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.303967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.304048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.304122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.304192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.304253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.304261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.304335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.304406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.304481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.304558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.304609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.304617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.304692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.304760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.304881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.304952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.305000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.305008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.305078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.305144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.305214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.305286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.305333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.305340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.305414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:35.305479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:35.305544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:35.305618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:35.305667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:35.305676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:35.305711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:35.305758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.305771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.305773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:35.305799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:35.305809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:35.305811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:35.305813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:35.305815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:35.306176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:35.306191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:35.306196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:35.306198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:35.306200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:35.306202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:35.306748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:35.306759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:35.306764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:35.306766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:35.306772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:35.306774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:35.307255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:35.307267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:35.307272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:35.307276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:35.307278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:35.309451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:35.309471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:35.309484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392875309
2025-10-02T08:14:35.309605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:35.309618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:35.309626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:35.309629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:35.309633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:35.309636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:35.310082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:35.310103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:35.310109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:35.310113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:35.310116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:35.310120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:35.310563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:35.310586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:35.310597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:35.310600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:35.310603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:35.310607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:35.311062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:35.311086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:35.311092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:35.312191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:35.312222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:35.312227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:35.312231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:35.312239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392875311
2025-10-02T08:14:35.312531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:35.312551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:35.312557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:35.312560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:35.312563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:35.312568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:35.313095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:35.313122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:35.313129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:35.313133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:35.313137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:35.313141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:35.313666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:35.313689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.313800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392875313
2025-10-02T08:14:35.314530Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:35.314550Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:35.314557Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:35.314564Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:35.317275Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:35.317290Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:35.317292Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:35.317309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534860339595448:12204]
2025-10-02T08:14:35.317315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534860339595448:12204]
2025-10-02T08:14:35.317353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:35.317353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:35.317357Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:35.317362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.317364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:35.317497Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:35.349841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534860339595528:12248]
2025-10-02T08:14:35.349954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2105, pipe: [1:7556534860339595528:12248]
2025-10-02T08:14:35.451548Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:35.451958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339595528:12248], now have 1 active actors on pipe
2025-10-02T08:14:35.452069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534860339595528:12248]
2025-10-02T08:14:35.452103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:35.452106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:35.452126Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:35.452133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2106 reason: error at write: Disconnected sessionId: src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0
2025-10-02T08:14:35.452214Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:35.452329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2106 sessionId: src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0 is DEAD
2025-10-02T08:14:35.452449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:35.452456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0] Write session will restart in 0.008271s
2025-10-02T08:14:35.452478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0] Write session: Do CDS request
2025-10-02T08:14:35.452485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:35.462334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.462389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:35.462417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2107
2025-10-02T08:14:35.462552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.462578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:35.462583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:35.462586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:35.462921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2107 sessionId:  describe result for acl check
2025-10-02T08:14:35.462950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:35.462951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:35.462953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:35.462957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534860339595954:12159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:35.463411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534860339595954:12159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:35.463456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:35.464171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:35.464370Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:35.464379Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:35.464388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:35.464442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:35.464490Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534860339595980:12162]
2025-10-02T08:14:35.465016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:35.465198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:35.465232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:35.465276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534860339595954:12159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:35.465478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:35.465519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.465524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.465526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.465527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.465527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.465532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.465540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.465544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.465547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.465550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.465558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.465568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.465576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.465583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.465590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.465595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.465598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.465605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.465612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.465617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.465637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:35.471336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534860339595954:12159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:35.471351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534860339595954:12159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:35.471356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534860339595954:12159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:35.471364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:35.473482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:35.475038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:35.475048Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:35.475050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:35.475052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:35.475056Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2106 [1:7556534860339595980:12162]
2025-10-02T08:14:35.475065Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:35.475077Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:35.475079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.475081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.475082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.475093Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:35.475096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:35.475100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:35.475138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.475144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.475146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:35.475147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:35.475189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:35.475194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.475202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.475209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:35.475223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534860339595961:12162]
2025-10-02T08:14:35.475228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534860339595961:12162]
2025-10-02T08:14:35.475234Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:35.475242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:35.475253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:35.475253Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:35.475255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:35.475258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:35.475257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2106
2025-10-02T08:14:35.475264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339596012:12159], now have 1 active actors on pipe
2025-10-02T08:14:35.475291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.475298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.475310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534860339595961:12162]
2025-10-02T08:14:35.475322Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:35.475331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534860799162259:2378], now have 1 active actors on pipe
2025-10-02T08:14:35.475342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:35.475350Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:35.475356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.475359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.475361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:35.475341Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2106
2025-10-02T08:14:35.475372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.475385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:35.475411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.475450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.475456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.475468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.475501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2107 partition: 0 MaxSeqNo: 17 sessionId: src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0
2025-10-02T08:14:35.475800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e49c74-4d0a3f62-29a1837-59643bf4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:35.478194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0] Write session: try to update token
2025-10-02T08:14:35.478214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:35.490531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId: src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:35.492776Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:35.492792Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:35.492794Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:35.492817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534860339595961:12162]
2025-10-02T08:14:35.492821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534860339595961:12162]
2025-10-02T08:14:35.492860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:35.492862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:35.492866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.492867Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:35.492868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:35.492873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:35.493003Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:35.552082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534860339596026:12248]
2025-10-02T08:14:35.552166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2106, pipe: [1:7556534860339596026:12248]
2025-10-02T08:14:35.625772Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:35.626102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.626113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.626143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339596026:12248], now have 1 active actors on pipe
2025-10-02T08:14:35.626236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:35.626247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:35.626294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2107 reason: error at write: Disconnected sessionId: src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0
2025-10-02T08:14:35.626366Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:35.626377Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:35.626604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:35.626614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0] Write session will restart in 0.008005s
2025-10-02T08:14:35.626637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0] Write session: Do CDS request
2025-10-02T08:14:35.626643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:35.626456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2107 sessionId: src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0 is DEAD
2025-10-02T08:14:35.626589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534860339596026:12248]
2025-10-02T08:14:35.636354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.636412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:35.636427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2108
2025-10-02T08:14:35.636598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.636650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:35.636659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:35.636663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:35.637093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2108 sessionId:  describe result for acl check
2025-10-02T08:14:35.637129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:35.637132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:35.637133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:35.637138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534860339596392:12146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:35.637607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534860339596392:12146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:35.640135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:35.640226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534860339596392:12146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:35.640718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:35.640911Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:35.640919Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:35.640929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:35.640970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:35.641167Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534860339596491:12144]
2025-10-02T08:14:35.641759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:35.642002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:35.642048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:35.642311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:35.642355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.642361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.642362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.642363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.642364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.642370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.642379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.642384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.642388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.642392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.642397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.642404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.642411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.642416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.642427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.642433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.642441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.642446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.642451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.642460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.642478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:35.643022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534860339596392:12146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:35.643032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534860339596392:12146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:35.643035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534860339596392:12146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:35.643043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:35.650560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:35.652188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:35.652220Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:35.652223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:35.652227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:35.652232Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2107 [1:7556534860339596491:12144]
2025-10-02T08:14:35.652243Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:35.652260Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:35.652263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.652266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.652267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.652283Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:35.652288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:35.652294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:35.652352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.652360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.652364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:35.652366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:35.652431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:35.652440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.652454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.652466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:35.652484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339596508:12146], now have 1 active actors on pipe
2025-10-02T08:14:35.652491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534860339596476:12144]
2025-10-02T08:14:35.652492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534860339596476:12144]
2025-10-02T08:14:35.652500Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:35.652509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:35.652513Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:35.652519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:35.652532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:35.652532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2107
2025-10-02T08:14:35.652535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:35.652541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534860799162278:2378], now have 1 active actors on pipe
2025-10-02T08:14:35.652573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.652582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.652595Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534860339596476:12144]
2025-10-02T08:14:35.652606Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:35.652616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:35.652636Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:35.652646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.652650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.652652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:35.652608Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2107
2025-10-02T08:14:35.652660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.652673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:35.652698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.652789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.652816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.652830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.652869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2108 partition: 0 MaxSeqNo: 17 sessionId: src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0
2025-10-02T08:14:35.653210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f5f528c-1e1b5bfd-17571ef4-15356d1c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:35.655755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0] Write session: try to update token
2025-10-02T08:14:35.655773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:35.671552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId: src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:35.671663Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:35.671678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:35.671680Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:35.671689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534860339596476:12144]
2025-10-02T08:14:35.671694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534860339596476:12144]
2025-10-02T08:14:35.671733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:35.671740Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:35.671743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.671745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:35.671746Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:35.671887Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:35.674123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:35.726679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534860339596538:12248]
2025-10-02T08:14:35.726786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2107, pipe: [1:7556534860339596538:12248]
2025-10-02T08:14:35.810287Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:35.810540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.810551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.810589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339596538:12248], now have 1 active actors on pipe
2025-10-02T08:14:35.810925Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:35.810924Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:35.811488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:35.811511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0] Write session will restart in 0.006294s
2025-10-02T08:14:35.811123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:35.811182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2108 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0
2025-10-02T08:14:35.811271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534860339596538:12248]
2025-10-02T08:14:35.811328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2108 sessionId: src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0 is DEAD
2025-10-02T08:14:35.811535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0] Write session: Do CDS request
2025-10-02T08:14:35.811543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:35.819342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.819395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:35.819410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2109
2025-10-02T08:14:35.819556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:35.819585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:35.819595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:35.819597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:35.819933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2109 sessionId:  describe result for acl check
2025-10-02T08:14:35.819964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:35.819970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:35.819972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:35.819976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534860339596875:12134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:35.820474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534860339596875:12134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:35.823137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534860339596875:12134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:35.824425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:35.824964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:35.825123Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:35.825132Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:35.825140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:35.825179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:35.825213Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534860339597008:12135]
2025-10-02T08:14:35.825755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534860339596875:12134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:35.825769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534860339596875:12134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:35.825772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534860339596875:12134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:35.825781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:35.825812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:35.825994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:35.826029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:35.826299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:35.826329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.826335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.826336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.826336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.826337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.826340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.826346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.826348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.826350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.826352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.826356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.826360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:35.826364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.826367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:35.826369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.826372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:35.826374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.826376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.826379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.826381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.826393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:35.834270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:35.835691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:35.835704Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:35.835706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:35.835708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:35.835713Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2108 [1:7556534860339597008:12135]
2025-10-02T08:14:35.835723Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:35.835737Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:35.835739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.835741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.835743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.835754Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:35.835758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:35.835766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:35.835823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.835830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.835832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:35.835835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:35.835893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:35.835901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.835909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:35.835916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:35.835929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339597014:12134], now have 1 active actors on pipe
2025-10-02T08:14:35.835934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534860339597002:12135]
2025-10-02T08:14:35.835935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534860339597002:12135]
2025-10-02T08:14:35.835942Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:35.835952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:35.835954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:35.835954Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:35.835956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2108
2025-10-02T08:14:35.835962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:35.835964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:35.835968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534860799162287:2378], now have 1 active actors on pipe
2025-10-02T08:14:35.835972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.835975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.836005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534860339597002:12135]
2025-10-02T08:14:35.836015Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:35.836029Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:35.836037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:35.836041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:35.836045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:35.836046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:35.836054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:35.836061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:35.836092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.836054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2108
2025-10-02T08:14:35.836160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.836166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.836179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:35.836227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2109 partition: 0 MaxSeqNo: 17 sessionId: src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0
2025-10-02T08:14:35.836577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d05d3413-6f5eae9d-dc4feac9-1c47641_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:35.839027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0] Write session: try to update token
2025-10-02T08:14:35.839040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:35.851987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId: src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:35.854663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:35.854756Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:35.854773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:35.854775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:35.854783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534860339597002:12135]
2025-10-02T08:14:35.854804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534860339597002:12135]
2025-10-02T08:14:35.854851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:35.854850Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:35.854855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:35.854863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:35.854882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:35.854893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:35.854899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:35.855037Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:35.911495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534860339597041:12248]
2025-10-02T08:14:35.911621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2108, pipe: [1:7556534860339597041:12248]
2025-10-02T08:14:35.990013Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:35.990582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534860339597041:12248], now have 1 active actors on pipe
2025-10-02T08:14:35.990712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:35.990723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:35.990774Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:35.990797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2109 reason: error at write: Disconnected sessionId: src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0
2025-10-02T08:14:35.990850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:35.990960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2109 sessionId: src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0 is DEAD
2025-10-02T08:14:35.991039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534860339597041:12248]
2025-10-02T08:14:35.991082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:35.991089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0] Write session will restart in 0.008200s
2025-10-02T08:14:35.991120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0] Write session: Do CDS request
2025-10-02T08:14:35.991124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:36.000263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.000325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:36.000339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2110
2025-10-02T08:14:36.000463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.000487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:36.000491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:36.000494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:36.000988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2110 sessionId:  describe result for acl check
2025-10-02T08:14:36.001017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:36.001019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:36.001020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:36.001025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534864634564685:12125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:36.001524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534864634564685:12125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:36.004033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534864634564685:12125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:36.004573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:36.007216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:36.007410Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:36.007422Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:36.007433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:36.007493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:36.007626Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534864634564805:12130]
2025-10-02T08:14:36.007717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534864634564685:12125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:36.007730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534864634564685:12125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:36.007733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534864634564685:12125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:36.007738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:36.008282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:36.008471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:36.008514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:36.008832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:36.008886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.008892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.008893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.008894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.008896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.008901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.008910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.008914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.008917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.008921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.008926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.008934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.008939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.008947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.008951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.008961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.008966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.008976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.008981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.008990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.009011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:36.017475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:36.019217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:36.019235Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:36.019237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:36.019239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:36.019245Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2109 [1:7556534864634564805:12130]
2025-10-02T08:14:36.019254Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:36.019270Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:36.019274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.019277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.019279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.019295Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:36.019299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:36.019305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:36.019358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.019365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.019367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:36.019369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:36.019442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:36.019451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.019468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.019485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:36.019504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634564810:12125], now have 1 active actors on pipe
2025-10-02T08:14:36.019511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534860799162294:2378], now have 1 active actors on pipe
2025-10-02T08:14:36.019515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2109
2025-10-02T08:14:36.019518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534864634564795:12130]
2025-10-02T08:14:36.019520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534864634564795:12130]
2025-10-02T08:14:36.019531Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:36.019545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:36.019546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:36.019549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:36.019562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:36.019565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:36.019571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.019580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.019621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534864634564795:12130]
2025-10-02T08:14:36.019630Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:36.019645Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:36.019655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.019660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.019667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:36.019676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.019678Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:36.019685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:36.019620Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2109
2025-10-02T08:14:36.019736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.019803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.019806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.019819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.019863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2110 partition: 0 MaxSeqNo: 17 sessionId: src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0
2025-10-02T08:14:36.020230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6583b328-796eb13c-24cd3f7a-50f39ce5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:36.030306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0] Write session: try to update token
2025-10-02T08:14:36.030328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:36.038722Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:36.038739Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:36.038742Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:36.038750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534864634564795:12130]
2025-10-02T08:14:36.038754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534864634564795:12130]
2025-10-02T08:14:36.038795Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:36.038797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:36.038801Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:36.038805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.038807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:36.038952Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:36.047237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId: src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:36.056185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:36.091239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534864634564839:12248]
2025-10-02T08:14:36.091369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2109, pipe: [1:7556534864634564839:12248]
2025-10-02T08:14:36.195220Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:36.195630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.195645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.195664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634564839:12248], now have 1 active actors on pipe
2025-10-02T08:14:36.195796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:36.195808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:36.195868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2110 reason: error at write: Disconnected sessionId: src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0
2025-10-02T08:14:36.195937Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:36.195925Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:36.196029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2110 sessionId: src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0 is DEAD
2025-10-02T08:14:36.196252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534864634564839:12248]
2025-10-02T08:14:36.196891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:36.196903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0] Write session will restart in 0.006658s
2025-10-02T08:14:36.196929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0] Write session: Do CDS request
2025-10-02T08:14:36.196935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:36.204352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.204399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:36.204415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2111
2025-10-02T08:14:36.204656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.204694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:36.204704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:36.204707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:36.205142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2111 sessionId:  describe result for acl check
2025-10-02T08:14:36.205177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:36.205182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:36.205184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:36.205189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534864634565198:12112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:36.205704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534864634565198:12112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:36.208482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534864634565198:12112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:36.208707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:36.209453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:36.209739Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:36.209752Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:36.209764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:36.209816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:36.209853Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534864634565311:12120]
2025-10-02T08:14:36.210489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:36.210662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:36.210700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:36.210990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:36.211037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.211042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.211043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.211044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.211046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.211051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.211061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.211065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.211069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.211073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.211082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.211089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.211099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.211104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.211112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.211118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.211127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.211132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.211140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.211150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.211169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:36.211361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534864634565198:12112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:36.211374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534864634565198:12112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:36.211378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534864634565198:12112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:36.211385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:36.219384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:36.221021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:36.221039Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:36.221042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:36.221046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:36.221054Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2110 [1:7556534864634565311:12120]
2025-10-02T08:14:36.221066Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:36.221084Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:36.221088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.221091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.221093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.221107Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:36.221112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:36.221118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:36.221180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.221189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.221192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:36.221195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:36.221254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:36.221263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.221276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.221293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:36.221309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2110
2025-10-02T08:14:36.221316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634565328:12112], now have 1 active actors on pipe
2025-10-02T08:14:36.221322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534864634565296:12120]
2025-10-02T08:14:36.221324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534864634565296:12120]
2025-10-02T08:14:36.221336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:36.221350Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:36.221351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534865094129599:2378], now have 1 active actors on pipe
2025-10-02T08:14:36.221353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:36.221355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.221360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.221377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:36.221397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:36.221405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:36.221447Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e65d63f-abfe35a9-f9483de4-3949274_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:36.221458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.221462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.221468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:36.221444Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2110
2025-10-02T08:14:36.221478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.221491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:36.221499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534864634565296:12120]
2025-10-02T08:14:36.221507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:36.221516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:36.221537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.221632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.221640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.221653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.221688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2111 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e65d63f-abfe35a9-f9483de4-3949274_0
2025-10-02T08:14:36.222020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0389e5d-d1c3fd43-b448163b-c616ec0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e65d63f-abfe35a9-f9483de4-3949274_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:36.224742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e65d63f-abfe35a9-f9483de4-3949274_0] Write session: try to update token
2025-10-02T08:14:36.224754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e65d63f-abfe35a9-f9483de4-3949274_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:36.238149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId: src_id|5e65d63f-abfe35a9-f9483de4-3949274_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:36.240584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:36.240662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.240676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.240716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:36.240743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:36.240820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.240830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.240983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.241044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.241112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.241174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.241222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.241231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.241295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.241356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.241416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.241480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.241639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.241648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.241712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.241770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.241827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.241886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.241928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.241935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.241996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.242057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.242119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.242183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.242234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.242240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.242306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.242365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.242425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.242488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.242529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.242537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.242601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.242660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.242720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.242779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.242824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.242831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.242896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.242956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.243019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.243079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.243127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.243135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.243199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.243259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.243322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.243385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.243433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.243440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.243508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.243568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.243628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.243686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.243836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.243844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.243911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:36.243971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:36.244031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:36.244091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:36.244230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:36.244237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:36.244291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:36.244355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.244381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.244387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:36.244418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:36.244435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:36.244443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:36.244447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:36.244449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:36.244848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:36.244871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:36.244881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:36.244891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:36.244894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:36.244897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:36.245359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:36.245381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:36.245387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:36.245390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:36.245393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:36.245397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:36.245883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:36.245906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:36.245912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:36.245916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:36.245921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:36.247156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:36.247175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:36.247187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392876246
2025-10-02T08:14:36.247387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:36.247403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:36.247413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:36.247417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:36.247422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:36.247426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:36.247861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:36.247883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:36.247889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:36.247897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:36.247900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:36.247904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:36.248389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:36.248414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:36.248422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:36.248430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:36.248434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:36.248437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:36.248937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:36.248959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:36.248965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:36.250134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:36.250152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:36.250158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:36.250161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:36.250169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392876249
2025-10-02T08:14:36.250459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:36.250480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:36.250486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:36.250494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:36.250498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:36.250501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:36.250950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:36.250971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:36.250977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:36.250983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:36.250986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:36.250989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:36.251450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:36.251469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.251569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392876251
2025-10-02T08:14:36.254255Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:36.254295Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:36.254303Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:36.254312Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:36.254325Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:36.254336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:36.254341Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:36.254349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534864634565296:12120]
2025-10-02T08:14:36.254352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534864634565296:12120]
2025-10-02T08:14:36.254408Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:36.254421Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:36.261331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:36.261349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.261350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:36.261476Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:36.296515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534864634565343:12248]
2025-10-02T08:14:36.296676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2110, pipe: [1:7556534864634565343:12248]
2025-10-02T08:14:36.396572Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:36.396936Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:36.396944Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:36.396952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534864634565296:12120]
2025-10-02T08:14:36.396997Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:36.397021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634565343:12248], now have 1 active actors on pipe
2025-10-02T08:14:36.397249Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:36.397267Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:36.397529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534864634565343:12248]
2025-10-02T08:14:36.397553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:36.397576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2111 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e65d63f-abfe35a9-f9483de4-3949274_0
2025-10-02T08:14:36.397908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e65d63f-abfe35a9-f9483de4-3949274_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:36.397923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e65d63f-abfe35a9-f9483de4-3949274_0] Write session will restart in 0.008313s
2025-10-02T08:14:36.397755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2111 sessionId: src_id|5e65d63f-abfe35a9-f9483de4-3949274_0 is DEAD
2025-10-02T08:14:36.397946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e65d63f-abfe35a9-f9483de4-3949274_0] Write session: Do CDS request
2025-10-02T08:14:36.397967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e65d63f-abfe35a9-f9483de4-3949274_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:36.404726Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [62a225ed1f253dc7] Result# TEvPutResult {Id# [72075186224037892:2110:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:36.404767Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2110:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:36.404838Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2110:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:36.407310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e65d63f-abfe35a9-f9483de4-3949274_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.407361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:36.407376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2112
2025-10-02T08:14:36.407522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.407548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:36.407557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:36.407560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:36.408025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2112 sessionId:  describe result for acl check
2025-10-02T08:14:36.408072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:36.408079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:36.408081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:36.408086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534864634565560:12076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:36.408624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534864634565560:12076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:36.410800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534864634565560:12076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:36.413837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534864634565560:12076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:36.413853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534864634565560:12076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:36.413856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534864634565560:12076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:36.413865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:36.417399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:36.418417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:36.418594Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:36.418603Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:36.418612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:36.418659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:36.418749Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534864634565865:12072]
2025-10-02T08:14:36.419418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:36.419595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:36.419633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:36.419934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:36.419976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.419982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.419984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.419985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.419986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.419992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.420003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.420007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.420011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.420015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.420020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.420028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.420038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.420043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.420048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.420053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.420059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.420069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.420074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.420079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.420102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:36.428347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:36.430085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:36.430106Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:36.430109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:36.430116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:36.430122Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2111 [1:7556534864634565865:12072]
2025-10-02T08:14:36.430135Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:36.430154Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:36.430157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.430159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.430161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.430177Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:36.430183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:36.430189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:36.430250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.430259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.430261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:36.430263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:36.430329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:36.430339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.430353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.430364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:36.430380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534864634565859:12072]
2025-10-02T08:14:36.430387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534864634565859:12072]
2025-10-02T08:14:36.430395Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:36.430407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634565801:12076], now have 1 active actors on pipe
2025-10-02T08:14:36.430409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:36.430413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:36.430415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:36.430427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2111
2025-10-02T08:14:36.430429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:36.430435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:36.430441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534865094129628:2378], now have 1 active actors on pipe
2025-10-02T08:14:36.430475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.430485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.430498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534864634565859:12072]
2025-10-02T08:14:36.430510Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:36.430523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:36.430537Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:36.430548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.430552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.430554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:36.430563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.430571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:36.430604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.430649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.430655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.430667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.430707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2112 partition: 0 MaxSeqNo: 17 sessionId: src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0
2025-10-02T08:14:36.430707Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2111
2025-10-02T08:14:36.431057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e65d63f-abfe35a9-f9483de4-3949274_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:36.433691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0] Write session: try to update token
2025-10-02T08:14:36.433708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:36.447395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId: src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:36.448596Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:36.448613Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:36.448615Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:36.448623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534864634565859:12072]
2025-10-02T08:14:36.448627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534864634565859:12072]
2025-10-02T08:14:36.448666Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:36.448669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:36.448671Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:36.448675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.448677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:36.448843Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:36.450233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:36.497742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534864634565889:12248]
2025-10-02T08:14:36.497879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2111, pipe: [1:7556534864634565889:12248]
2025-10-02T08:14:36.595236Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:36.595711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.595727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.595764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634565889:12248], now have 1 active actors on pipe
2025-10-02T08:14:36.595938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534864634565889:12248]
2025-10-02T08:14:36.595966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:36.595974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:36.596014Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:36.596039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2112 reason: error at write: Disconnected sessionId: src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0
2025-10-02T08:14:36.596097Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:36.596214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2112 sessionId: src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0 is DEAD
2025-10-02T08:14:36.596372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:36.596381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0] Write session will restart in 0.008267s
2025-10-02T08:14:36.596407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0] Write session: Do CDS request
2025-10-02T08:14:36.596414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:36.606297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.606348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:36.606363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2113
2025-10-02T08:14:36.606502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.606532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:36.606542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:36.606545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:36.606901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2113 sessionId:  describe result for acl check
2025-10-02T08:14:36.606932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:36.606938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:36.606939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:36.606944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534864634566255:12058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:36.607378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534864634566255:12058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:36.609562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534864634566255:12058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:36.611447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:36.611818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:36.611977Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:36.611988Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:36.611995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:36.612037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:36.612083Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534864634566365:12066]
2025-10-02T08:14:36.612098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534864634566255:12058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:36.612109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534864634566255:12058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:36.612112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534864634566255:12058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:36.612119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:36.612689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:36.612884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:36.612921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:36.613208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:36.613245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.613249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.613250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.613251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.613252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.613257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.613265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.613273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.613276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.613283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.613288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.613310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.613319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.613324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.613327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.613332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.613335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.613341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.613346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.613351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.613369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:36.621122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:36.622534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:36.622552Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:36.622554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:36.622557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:36.622563Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2112 [1:7556534864634566365:12066]
2025-10-02T08:14:36.622573Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:36.622589Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:36.622592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.622595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.622597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.622612Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:36.622616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:36.622624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:36.622678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.622686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.622689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:36.622691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:36.622748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:36.622754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.622765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.622780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:36.622801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634566370:12058], now have 1 active actors on pipe
2025-10-02T08:14:36.622808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2112
2025-10-02T08:14:36.622811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534864634566359:12066]
2025-10-02T08:14:36.622813Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534864634566359:12066]
2025-10-02T08:14:36.622819Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:36.622827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534865094129635:2378], now have 1 active actors on pipe
2025-10-02T08:14:36.622839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:36.622859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:36.622862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:36.622891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534864634566359:12066]
2025-10-02T08:14:36.622898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:36.622917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.622922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:36.622925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:36.622925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.622931Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:36.622951Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18a5592f-e9965250-98eb03f-d665f9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:36.622960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.622967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.622969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:36.622979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.622991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:36.623007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.622986Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2112
2025-10-02T08:14:36.623402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.623411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.623425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.623469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2113 partition: 0 MaxSeqNo: 17 sessionId: src_id|18a5592f-e9965250-98eb03f-d665f9a_0
2025-10-02T08:14:36.623750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237c2439-12ca10bd-4ec4cbf2-9b30ee58_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|18a5592f-e9965250-98eb03f-d665f9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:36.626410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a5592f-e9965250-98eb03f-d665f9a_0] Write session: try to update token
2025-10-02T08:14:36.626426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a5592f-e9965250-98eb03f-d665f9a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:36.640276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId: src_id|18a5592f-e9965250-98eb03f-d665f9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:36.640867Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:36.640881Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:36.640884Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:36.640892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534864634566359:12066]
2025-10-02T08:14:36.640896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534864634566359:12066]
2025-10-02T08:14:36.640939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:36.640946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.640948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:36.640947Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:36.640953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:36.641087Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:36.642819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:36.696396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534864634566398:12248]
2025-10-02T08:14:36.696497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2112, pipe: [1:7556534864634566398:12248]
2025-10-02T08:14:36.779909Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:36.780362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.780375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.780411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634566398:12248], now have 1 active actors on pipe
2025-10-02T08:14:36.780940Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:36.783282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a5592f-e9965250-98eb03f-d665f9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:36.783291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a5592f-e9965250-98eb03f-d665f9a_0] Write session will restart in 0.008730s
2025-10-02T08:14:36.783314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a5592f-e9965250-98eb03f-d665f9a_0] Write session: Do CDS request
2025-10-02T08:14:36.783321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a5592f-e9965250-98eb03f-d665f9a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:36.780892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534864634566398:12248]
2025-10-02T08:14:36.780922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:36.780925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:36.780961Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:36.780983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2113 reason: error at write: Disconnected sessionId: src_id|18a5592f-e9965250-98eb03f-d665f9a_0
2025-10-02T08:14:36.781138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2113 sessionId: src_id|18a5592f-e9965250-98eb03f-d665f9a_0 is DEAD
2025-10-02T08:14:36.793243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a5592f-e9965250-98eb03f-d665f9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.793240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:36.793254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2114
2025-10-02T08:14:36.793433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.793471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:36.793480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:36.793483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:36.793639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:36.794009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2114 sessionId:  describe result for acl check
2025-10-02T08:14:36.794034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:36.794042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:36.794043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:36.794048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534864634566860:12048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:36.794578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:36.794731Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:36.794738Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:36.794746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:36.794790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:36.794819Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534864634566863:12053]
2025-10-02T08:14:36.795221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:36.795251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534864634566860:12048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:36.795407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:36.795439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:36.795639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:36.795667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.795671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.795671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.795672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.795673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.795676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.795682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.795684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.795686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.795688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.795691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.795699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.795704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.795709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.795713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.795718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.795724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.795727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.795729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.795732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.795742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:36.797609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534864634566860:12048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:36.802166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534864634566860:12048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:36.802180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534864634566860:12048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:36.802183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534864634566860:12048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:36.802191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:36.803659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:36.805375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:36.805400Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:36.805403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:36.805407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:36.805414Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2113 [1:7556534864634566863:12053]
2025-10-02T08:14:36.805425Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:36.805439Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:36.805442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.805445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.805448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.805462Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:36.805467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:36.805473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:36.805542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.805550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.805553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:36.805555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:36.805769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2113
2025-10-02T08:14:36.805621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:36.805629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.805641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.805654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:36.805673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634566906:12048], now have 1 active actors on pipe
2025-10-02T08:14:36.805674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2113
2025-10-02T08:14:36.805677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534865094129657:2378], now have 1 active actors on pipe
2025-10-02T08:14:36.805683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534864634566854:12053]
2025-10-02T08:14:36.805685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534864634566854:12053]
2025-10-02T08:14:36.805696Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:36.805704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.805707Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:36.805708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.805709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:36.805727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:36.805740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:36.805742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:36.805780Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:36.805786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:36.805793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:36.805794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:36.805802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:36.805810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:36.805816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534864634566854:12053]
2025-10-02T08:14:36.805824Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:36.805841Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:36.805845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.805901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.805903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.805915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:36.805947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2114 partition: 0 MaxSeqNo: 17 sessionId: src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0
2025-10-02T08:14:36.806271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a5592f-e9965250-98eb03f-d665f9a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:36.808949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0] Write session: try to update token
2025-10-02T08:14:36.808964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:36.823359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId: src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:36.824571Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:36.824588Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:36.824592Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:36.824601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534864634566854:12053]
2025-10-02T08:14:36.824605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534864634566854:12053]
2025-10-02T08:14:36.824650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:36.824656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.824658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:36.824676Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:36.824685Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:36.824820Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:36.826164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:36.877658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534864634566921:12248]
2025-10-02T08:14:36.877816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2113, pipe: [1:7556534864634566921:12248]
2025-10-02T08:14:36.971604Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:36.971894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:36.971907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:36.971945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634566921:12248], now have 1 active actors on pipe
2025-10-02T08:14:36.972106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534864634566921:12248]
2025-10-02T08:14:36.972133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:36.972139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:36.972166Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:36.972222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2114 reason: error at write: Disconnected sessionId: src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0
2025-10-02T08:14:36.972386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2114 sessionId: src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0 is DEAD
2025-10-02T08:14:36.972671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:36.972683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0] Write session will restart in 0.007213s
2025-10-02T08:14:36.972705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0] Write session: Do CDS request
2025-10-02T08:14:36.972713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:36.972872Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:36.983807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.984183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:36.984211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2115
2025-10-02T08:14:36.984507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:36.984546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:36.984556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:36.984560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:36.985149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2115 sessionId:  describe result for acl check
2025-10-02T08:14:36.985180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:36.985185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:36.985187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:36.985192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534864634567249:12020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:36.985690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534864634567249:12020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:36.988067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534864634567249:12020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:36.992714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:36.993059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534864634567249:12020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:36.993065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534864634567249:12020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:36.993069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534864634567249:12020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:36.993076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:36.993661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:36.993906Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:36.993909Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:36.993931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:36.993986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:36.994019Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534864634567407:12040]
2025-10-02T08:14:36.994620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:36.994832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:36.994886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:36.995304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:36.995354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.995355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.995356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.995358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.995359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.995364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.995374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.995377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.995381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.995385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.995390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.995397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:36.995402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.995407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:36.995412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.995416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:36.995419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.995425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:36.995430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.995434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:36.995452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:37.005316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:37.007104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:37.007121Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:37.007123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:37.007127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:37.007133Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2114 [1:7556534864634567407:12040]
2025-10-02T08:14:37.007145Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:37.007163Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:37.007167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.007172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.007174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.007190Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:37.007195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:37.007202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:37.007264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.007275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.007278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:37.007281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:37.007346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:37.007354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.007367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.007384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:37.007403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534864634567395:12040]
2025-10-02T08:14:37.007410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534864634567395:12040]
2025-10-02T08:14:37.007418Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:37.007432Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:37.007433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534864634567403:12020], now have 1 active actors on pipe
2025-10-02T08:14:37.007436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2114
2025-10-02T08:14:37.007441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:37.007441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:37.007454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:37.007456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:37.007462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534865094129663:2378], now have 1 active actors on pipe
2025-10-02T08:14:37.007466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.007471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.007511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534864634567395:12040]
2025-10-02T08:14:37.007519Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:37.007535Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d492131e-e2d332d8-91c232b8-44886e3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:37.007544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.007548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.007550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:37.007559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.007567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:37.007588Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:37.007600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.007697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.007705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.007717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.007854Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2114
2025-10-02T08:14:37.007750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2115 partition: 0 MaxSeqNo: 17 sessionId: src_id|d492131e-e2d332d8-91c232b8-44886e3c_0
2025-10-02T08:14:37.008134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e68e1-85a5594d-1dc2bc7c-13c7eb84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d492131e-e2d332d8-91c232b8-44886e3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:37.010855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d492131e-e2d332d8-91c232b8-44886e3c_0] Write session: try to update token
2025-10-02T08:14:37.010870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d492131e-e2d332d8-91c232b8-44886e3c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:37.026344Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:37.026364Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:37.026366Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:37.026375Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534864634567395:12040]
2025-10-02T08:14:37.026379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534864634567395:12040]
2025-10-02T08:14:37.026425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:37.026432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.026434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:37.026433Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:37.026440Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:37.026569Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:37.033689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId: src_id|d492131e-e2d332d8-91c232b8-44886e3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:37.036318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:37.072205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534868929534730:12248]
2025-10-02T08:14:37.072301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2114, pipe: [1:7556534868929534730:12248]
2025-10-02T08:14:37.172740Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:37.173252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.173265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.173285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929534730:12248], now have 1 active actors on pipe
2025-10-02T08:14:37.173403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:37.173411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:37.173425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534868929534730:12248]
2025-10-02T08:14:37.173452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2115 reason: error at write: Disconnected sessionId: src_id|d492131e-e2d332d8-91c232b8-44886e3c_0
2025-10-02T08:14:37.173511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:37.173562Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:37.173610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2115 sessionId: src_id|d492131e-e2d332d8-91c232b8-44886e3c_0 is DEAD
2025-10-02T08:14:37.173741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d492131e-e2d332d8-91c232b8-44886e3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:37.173751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d492131e-e2d332d8-91c232b8-44886e3c_0] Write session will restart in 0.007838s
2025-10-02T08:14:37.173776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d492131e-e2d332d8-91c232b8-44886e3c_0] Write session: Do CDS request
2025-10-02T08:14:37.173783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d492131e-e2d332d8-91c232b8-44886e3c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:37.182306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d492131e-e2d332d8-91c232b8-44886e3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.182333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:37.182349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2116
2025-10-02T08:14:37.182495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.182525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:37.182530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:37.182533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:37.182904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2116 sessionId:  describe result for acl check
2025-10-02T08:14:37.182937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:37.182943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:37.182945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:37.182949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534868929535063:12014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:37.183424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534868929535063:12014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:37.185527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534868929535063:12014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:37.187469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:37.188531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:37.188744Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:37.188755Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:37.188765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:37.188767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534868929535063:12014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:37.188774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534868929535063:12014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:37.188778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534868929535063:12014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:37.188785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:37.188838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:37.188874Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534868929535211:12018]
2025-10-02T08:14:37.189488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:37.189650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:37.189686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:37.189974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:37.190012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.190017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.190018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.190020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.190021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.190026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.190035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.190040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.190044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.190048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.190053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.190060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.190069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.190075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.190079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.190085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.190093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.190099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.190104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.190113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.190134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:37.197927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:37.199676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:37.199694Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:37.199696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:37.199700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:37.199706Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2115 [1:7556534868929535211:12018]
2025-10-02T08:14:37.199717Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:37.199734Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:37.199737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.199740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.199742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.199757Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:37.199764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:37.199775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:37.199831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.199839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.199842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:37.199845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:37.199926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:37.199933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.199946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.199959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:37.199981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534869389096965:2378], now have 1 active actors on pipe
2025-10-02T08:14:37.199987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534868929535205:12018]
2025-10-02T08:14:37.199989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534868929535205:12018]
2025-10-02T08:14:37.199996Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:37.199998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2115
2025-10-02T08:14:37.200004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929535216:12014], now have 1 active actors on pipe
2025-10-02T08:14:37.200008Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:37.200011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:37.200011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:37.200024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:37.200032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:37.200040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.200043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.200087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534868929535205:12018]
2025-10-02T08:14:37.200094Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:37.200067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2115
2025-10-02T08:14:37.200104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:37.200109Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:37.200115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.200118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.200120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:37.200130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.200138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:37.200184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.200266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.200273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.200286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.200323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2116 partition: 0 MaxSeqNo: 17 sessionId: src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0
2025-10-02T08:14:37.200643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d492131e-e2d332d8-91c232b8-44886e3c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:37.203329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0] Write session: try to update token
2025-10-02T08:14:37.203346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:37.219744Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:37.219765Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:37.219768Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:37.219776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534868929535205:12018]
2025-10-02T08:14:37.219781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534868929535205:12018]
2025-10-02T08:14:37.219818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:37.219825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.219825Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:37.219827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:37.219830Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:37.219952Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:37.223303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId: src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:37.226006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:37.273445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534868929535242:12248]
2025-10-02T08:14:37.273584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2115, pipe: [1:7556534868929535242:12248]
2025-10-02T08:14:37.364844Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:37.365303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.365315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.365353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929535242:12248], now have 1 active actors on pipe
2025-10-02T08:14:37.365435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:37.365443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:37.365491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2116 reason: error at write: Disconnected sessionId: src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0
2025-10-02T08:14:37.365524Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:37.365573Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:37.365643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2116 sessionId: src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0 is DEAD
2025-10-02T08:14:37.365785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:37.365793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0] Write session will restart in 0.007939s
2025-10-02T08:14:37.365809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0] Write session: Do CDS request
2025-10-02T08:14:37.365814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:37.365785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534868929535242:12248]
2025-10-02T08:14:37.375271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.375267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:37.375282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2117
2025-10-02T08:14:37.375447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.375469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:37.375476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:37.375478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:37.375795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2117 sessionId:  describe result for acl check
2025-10-02T08:14:37.375825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:37.375826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:37.375827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:37.375830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534868929535672:11982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:37.376228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534868929535672:11982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:37.377374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:37.378004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534868929535672:11982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:37.378059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:37.378240Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:37.378248Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:37.378254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:37.378295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:37.378320Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534868929535721:12003]
2025-10-02T08:14:37.378693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:37.378862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:37.378898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:37.379103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:37.379128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.379133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.379134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.379135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.379136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.379141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.379149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.379154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.379157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.379160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.379163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.379171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.379174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.379180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.379182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.379185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.379187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.379189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.379192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.379195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.379206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:37.383605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534868929535672:11982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:37.383621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534868929535672:11982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:37.383625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534868929535672:11982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:37.383633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:37.386758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:37.388328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:37.388346Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:37.388348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:37.388351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:37.388356Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2116 [1:7556534868929535721:12003]
2025-10-02T08:14:37.388366Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:37.388379Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:37.388382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.388385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.388387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.388404Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:37.388409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:37.388415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:37.388472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.388481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.388484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:37.388487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:37.388545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:37.388553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.388564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.388578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:37.388598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534868929535703:12003]
2025-10-02T08:14:37.388604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534868929535703:12003]
2025-10-02T08:14:37.388611Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:37.388623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:37.388640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:37.388640Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:37.388642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:37.388647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:37.388682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929535742:11982], now have 1 active actors on pipe
2025-10-02T08:14:37.388690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534869389096974:2378], now have 1 active actors on pipe
2025-10-02T08:14:37.388692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534868929535703:12003]
2025-10-02T08:14:37.388701Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:37.388716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:37.388736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2116
2025-10-02T08:14:37.388703Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2116
2025-10-02T08:14:37.388826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.388836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.388862Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:37.388875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.388883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.388885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:37.388893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.388907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:37.388925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.388945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.388950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.388959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.388980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2117 partition: 0 MaxSeqNo: 17 sessionId: src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0
2025-10-02T08:14:37.389243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fd7a61-108fec14-da84ffab-f7310bd8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:37.391743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0] Write session: try to update token
2025-10-02T08:14:37.391759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:37.399853Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:37.399875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:37.399883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534868929535703:12003]
2025-10-02T08:14:37.399919Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:37.399927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:37.400153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:37.400340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:37.400505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:37.400671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:37.400919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:37.400968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:37.406584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId: src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:37.408947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:37.409026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.409038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.409068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:37.409085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:37.409140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.409146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.409297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.409360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.409425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.409490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.409534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.409543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.409609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.409670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.409730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.409797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.409845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.409851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.409919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.409984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.410045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.410108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.410151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.410158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.410225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.410293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.410359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.410423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.410469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.410476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.410548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.410613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.410676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.410740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.410802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.410809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.410870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.410926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.410981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.411037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.411075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.411081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.411138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.411192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.411254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.411307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.411348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.411356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.411414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.411465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.411518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.411572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.411609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.411614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.411671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.411729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.411791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.411847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.411890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.411896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.411960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.412016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.412082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.412146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.412201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.412208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.412243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:37.412301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.412322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.412328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:37.412353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:37.412366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:37.412373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:37.412375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:37.412378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:37.412727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:37.412750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:37.412756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:37.412763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:37.412767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:37.412770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:37.413198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:37.413218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:37.413222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:37.413223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:37.413226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:37.413229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:37.413721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:37.413740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:37.413745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:37.413747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:37.413748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:37.414988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:37.415011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:37.415021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392877414
2025-10-02T08:14:37.415208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:37.415221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:37.415225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:37.415228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:37.415232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:37.415236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:37.415717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:37.415739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:37.415745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:37.415749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:37.415752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:37.415756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:37.416255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:37.416276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:37.416290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:37.416297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:37.416300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:37.416303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:37.416752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:37.416777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:37.416786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:37.417976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:37.417995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:37.418000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:37.418003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:37.418012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392877417
2025-10-02T08:14:37.418290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:37.418312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:37.418318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:37.418321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:37.418325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:37.418328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:37.418806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:37.418828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:37.418833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:37.418837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:37.418844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:37.418847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:37.419314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:37.419334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.419425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392877419
2025-10-02T08:14:37.420179Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:37.420191Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:37.420209Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:37.420233Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:37.422981Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:37.423000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:37.423002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:37.423010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534868929535703:12003]
2025-10-02T08:14:37.423014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534868929535703:12003]
2025-10-02T08:14:37.423038Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:37.423050Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:37.423063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:37.423073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.423075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:37.423205Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:37.465952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534868929535802:12248]
2025-10-02T08:14:37.466085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2116, pipe: [1:7556534868929535802:12248]
2025-10-02T08:14:37.561724Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:37.562106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929535802:12248], now have 1 active actors on pipe
2025-10-02T08:14:37.562219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534868929535802:12248]
2025-10-02T08:14:37.562257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:37.562270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:37.562296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2117 reason: error at write: Disconnected sessionId: src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0
2025-10-02T08:14:37.562356Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:37.562369Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:37.562454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2117 sessionId: src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0 is DEAD
2025-10-02T08:14:37.562570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:37.562579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0] Write session will restart in 0.007206s
2025-10-02T08:14:37.562597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0] Write session: Do CDS request
2025-10-02T08:14:37.562603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:37.571272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.571290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:37.571304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2118
2025-10-02T08:14:37.571473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.571500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:37.571508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:37.571510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:37.571888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2118 sessionId:  describe result for acl check
2025-10-02T08:14:37.571920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:37.571927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:37.571929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:37.571933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534868929536187:11946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:37.572436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534868929536187:11946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:37.574501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534868929536187:11946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:37.574865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:37.575640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:37.575798Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:37.575809Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:37.575817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:37.575861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:37.575899Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534868929536288:11947]
2025-10-02T08:14:37.576445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:37.576639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:37.576693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:37.577017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:37.577063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.577068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.577069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.577070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.577071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.577076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.577086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.577095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.577099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.577107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.577112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.577124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.577133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.577143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.577151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.577160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.577165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.577175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.577183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.577189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.577210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:37.577218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534868929536187:11946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:37.577224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534868929536187:11946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:37.577233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534868929536187:11946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:37.577241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:37.585089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:37.586723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:37.586736Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:37.586738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:37.586743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:37.586749Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2117 [1:7556534868929536288:11947]
2025-10-02T08:14:37.586759Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:37.586779Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:37.586786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.586789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.586791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.586806Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:37.586814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:37.586820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:37.586880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.586887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.586890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:37.586893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:37.586957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:37.586964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.586976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.586993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:37.586995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2117
2025-10-02T08:14:37.587014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929536302:11946], now have 1 active actors on pipe
2025-10-02T08:14:37.587021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534869389097003:2378], now have 1 active actors on pipe
2025-10-02T08:14:37.587026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.587030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.587050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534868929536274:11947]
2025-10-02T08:14:37.587056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534868929536274:11947]
2025-10-02T08:14:37.587069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:37.587083Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:37.587079Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2117
2025-10-02T08:14:37.587085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:37.587093Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:37.587097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:37.587100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:37.587114Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:37.587119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.587122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.587125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:37.587133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.587142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:37.587171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534868929536274:11947]
2025-10-02T08:14:37.587183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:37.587196Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:37.587203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.587245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.587258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.587281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.587339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2118 partition: 0 MaxSeqNo: 17 sessionId: src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0
2025-10-02T08:14:37.587645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7dca3c-b8354860-76ced63c-16080b4b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:37.589959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0] Write session: try to update token
2025-10-02T08:14:37.589974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:37.597503Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:37.597523Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:37.597532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534868929536274:11947]
2025-10-02T08:14:37.597575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:37.597574Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:37.597756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:37.597894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:37.598049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:37.598180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:37.598366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:37.598403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:37.601955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId: src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:37.604500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:37.604569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.604581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.604613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:37.604635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:37.604670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.604684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.604848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.604918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.604980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.605045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.605303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.605314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.605381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.605443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.605504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.605568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.605609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.605616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.605680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.605742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.605803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.605862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.605904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.605911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.605979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.606040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.606100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.606163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.606208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.606215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.606282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.606344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.606406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.606470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.606511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.606517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.606579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.606636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.606697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.606760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.606806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.606814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.606880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.606936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.607000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.607062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.607102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.607109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.607171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.607236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.607299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.607361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.607406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.607413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.607479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.607536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.607600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.607663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.607708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.607716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.607779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:37.607839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:37.607897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:37.607960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:37.608003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:37.608010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:37.608045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:37.608109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.608133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.608136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:37.608165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:37.608181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:37.608188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:37.608200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:37.608203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:37.608585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:37.608610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:37.608617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:37.608620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:37.608623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:37.608626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:37.609238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:37.609263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:37.609269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:37.609272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:37.609275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:37.609278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:37.609830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:37.609855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:37.609860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:37.609863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:37.609866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:37.611025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:37.611047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:37.611058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392877610
2025-10-02T08:14:37.611207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:37.611222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:37.611231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:37.611234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:37.611239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:37.611242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:37.611705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:37.611729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:37.611734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:37.611742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:37.611745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:37.611749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:37.612204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:37.612223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:37.612232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:37.612239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:37.612243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:37.612246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:37.612695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:37.612715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:37.612720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:37.613782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:37.613798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:37.613803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:37.613807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:37.613816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392877613
2025-10-02T08:14:37.614098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:37.614118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:37.614124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:37.614127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:37.614131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:37.614134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:37.614572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:37.614590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:37.614595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:37.614599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:37.614602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:37.614605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:37.615042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:37.615062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.615154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392877614
2025-10-02T08:14:37.615881Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:37.615901Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:37.615909Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:37.615915Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:37.617502Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:37.617514Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:37.617516Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:37.617526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534868929536274:11947]
2025-10-02T08:14:37.617529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534868929536274:11947]
2025-10-02T08:14:37.617581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:37.617581Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:37.617587Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:37.617588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.617590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:37.617719Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:37.662535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534868929536326:12248]
2025-10-02T08:14:37.662635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2117, pipe: [1:7556534868929536326:12248]
2025-10-02T08:14:37.749139Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:37.749516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929536326:12248], now have 1 active actors on pipe
2025-10-02T08:14:37.749679Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:37.749616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534868929536326:12248]
2025-10-02T08:14:37.749618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:37.749620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:37.749643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2118 reason: error at write: Disconnected sessionId: src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0
2025-10-02T08:14:37.749770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:37.749790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2118 sessionId: src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0 is DEAD
2025-10-02T08:14:37.749919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:37.749924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0] Write session will restart in 0.007185s
2025-10-02T08:14:37.749941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0] Write session: Do CDS request
2025-10-02T08:14:37.749947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:37.758274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.758329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:37.758344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2119
2025-10-02T08:14:37.758467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.758496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:37.758506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:37.758509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:37.758893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2119 sessionId:  describe result for acl check
2025-10-02T08:14:37.758922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:37.758923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:37.758925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:37.758930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534868929536708:11940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:37.759423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534868929536708:11940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:37.761677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534868929536708:11940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:37.763492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:37.764445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:37.764644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534868929536708:11940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:37.764656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534868929536708:11940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:37.764660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534868929536708:11940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:37.764669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:37.764691Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:37.764704Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:37.764716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:37.764784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:37.764862Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534868929536831:11937]
2025-10-02T08:14:37.765462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:37.765692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:37.765741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:37.766037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:37.766098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.766105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.766106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.766107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.766108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.766113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.766122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.766126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.766130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.766133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.766139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.766145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.766151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.766156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.766166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.766171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.766175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.766185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.766189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.766198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.766214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:37.774005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:37.775732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:37.775747Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:37.775750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:37.775754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:37.775760Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2118 [1:7556534868929536831:11937]
2025-10-02T08:14:37.775771Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:37.775788Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:37.775791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.775794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.775796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.775811Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:37.775821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:37.775827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:37.775898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.775905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.775908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:37.775911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:37.775975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:37.775983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.775995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.776010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:37.776032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929536833:11940], now have 1 active actors on pipe
2025-10-02T08:14:37.776031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2118
2025-10-02T08:14:37.776039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534869389097024:2378], now have 1 active actors on pipe
2025-10-02T08:14:37.776044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534868929536824:11937]
2025-10-02T08:14:37.776047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534868929536824:11937]
2025-10-02T08:14:37.776057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:37.776066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.776072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:37.776074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.776076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:37.776092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:37.776110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:37.776117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:37.776123Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2118
2025-10-02T08:14:37.776154Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:37.776163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.776167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.776169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:37.776178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.776189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:37.776213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534868929536824:11937]
2025-10-02T08:14:37.776224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:37.776241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:37.776258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.776327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.776335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.776348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.776385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2119 partition: 0 MaxSeqNo: 17 sessionId: src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0
2025-10-02T08:14:37.776698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e25c779-10edb026-ccd1b07f-6dc14080_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:37.779373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0] Write session: try to update token
2025-10-02T08:14:37.779388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:37.793280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId: src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:37.793391Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:37.793408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:37.793410Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:37.793417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534868929536824:11937]
2025-10-02T08:14:37.793421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534868929536824:11937]
2025-10-02T08:14:37.793454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:37.793467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.793475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:37.793594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:37.793610Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:37.793613Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:37.796063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:37.849944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534868929536863:12248]
2025-10-02T08:14:37.850042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2118, pipe: [1:7556534868929536863:12248]
2025-10-02T08:14:37.932619Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:37.932966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.932984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.933021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929536863:12248], now have 1 active actors on pipe
2025-10-02T08:14:37.933204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534868929536863:12248]
2025-10-02T08:14:37.933234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:37.933241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:37.933295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2119 reason: error at write: Disconnected sessionId: src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0
2025-10-02T08:14:37.933446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2119 sessionId: src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0 is DEAD
2025-10-02T08:14:37.933670Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:37.934020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:37.934032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0] Write session will restart in 0.006318s
2025-10-02T08:14:37.934057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0] Write session: Do CDS request
2025-10-02T08:14:37.934065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:37.933375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:37.945183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.945617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:37.945632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2120
2025-10-02T08:14:37.948892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:37.948935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:37.948941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:37.948945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:37.949349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2120 sessionId:  describe result for acl check
2025-10-02T08:14:37.949391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:37.949397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:37.949399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:37.949404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534868929537276:11934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:37.949797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534868929537276:11934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:37.952123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534868929537276:11934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:37.952462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:37.953220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:37.953393Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:37.953402Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:37.953411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:37.953458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:37.953491Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534868929537354:11933]
2025-10-02T08:14:37.954097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:37.954260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:37.954304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:37.954607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:37.954644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534868929537276:11934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:37.954655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534868929537276:11934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:37.954658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.954658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534868929537276:11934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:37.954659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.954660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.954661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.954662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.954665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:37.954667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.954677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.954682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.954686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.954690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.954701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.954709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:37.954719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.954729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:37.954738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.954747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:37.954752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.954757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.954766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.954771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.954795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:37.962406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:37.964030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:37.964045Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:37.964048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:37.964051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:37.964058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2119 [1:7556534868929537354:11933]
2025-10-02T08:14:37.964069Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:37.964085Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:37.964088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.964091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.964093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.964112Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:37.964117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:37.964122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:37.964179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.964187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.964190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:37.964206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:37.964284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:37.964298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.964311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:37.964324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:37.964341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534868929537366:11934], now have 1 active actors on pipe
2025-10-02T08:14:37.964344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534869389097031:2378], now have 1 active actors on pipe
2025-10-02T08:14:37.964344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2119
2025-10-02T08:14:37.964350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534868929537340:11933]
2025-10-02T08:14:37.964352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534868929537340:11933]
2025-10-02T08:14:37.964363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:37.964376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.964379Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:37.964380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.964383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:37.964396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:37.964414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:37.964422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:37.964427Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2119
2025-10-02T08:14:37.964459Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:37.964471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:37.964474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:37.964477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:37.964485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:37.964492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:37.964504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534868929537340:11933]
2025-10-02T08:14:37.964516Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:37.964534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:37.964549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.964606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:37.964613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:37.964624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:37.964662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2120 partition: 0 MaxSeqNo: 17 sessionId: src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0
2025-10-02T08:14:37.964999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9df4ee55-c09a68e2-93b760e6-5a3488f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:37.967583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0] Write session: try to update token
2025-10-02T08:14:37.967598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:37.980266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId: src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:37.982138Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:37.982159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:37.982161Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:37.982169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534868929537340:11933]
2025-10-02T08:14:37.982175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534868929537340:11933]
2025-10-02T08:14:37.982216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:37.982224Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:37.982229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:37.982230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:37.982233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:37.982368Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:37.983393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:38.033226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534873224504680:12248]
2025-10-02T08:14:38.033378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2119, pipe: [1:7556534873224504680:12248]
2025-10-02T08:14:38.130013Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:38.130455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.130462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.130500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224504680:12248], now have 1 active actors on pipe
2025-10-02T08:14:38.131112Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:38.131417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:38.131469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2120 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0
2025-10-02T08:14:38.131626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2120 sessionId: src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0 is DEAD
2025-10-02T08:14:38.131752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534873224504680:12248]
2025-10-02T08:14:38.132599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:38.132611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0] Write session will restart in 0.008882s
2025-10-02T08:14:38.132634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0] Write session: Do CDS request
2025-10-02T08:14:38.132645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:38.132960Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:38.142279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.142428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:38.142445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2121
2025-10-02T08:14:38.142546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.142575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:38.142584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:38.142587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:38.142958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2121 sessionId:  describe result for acl check
2025-10-02T08:14:38.142990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:38.142995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:38.142997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:38.143000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534873224504882:11917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:38.143505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534873224504882:11917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:38.146919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534873224504882:11917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:38.154092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534873224504882:11917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:38.154108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534873224504882:11917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:38.154111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534873224504882:11917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:38.154119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:38.160556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:38.161978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:38.162153Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:38.162173Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:38.162186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:38.162229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:38.162263Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534873224505181:11919]
2025-10-02T08:14:38.162761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:38.162942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:38.162975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:38.163212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:38.163253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.163259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.163260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.163261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.163262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.163267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.163276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.163280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.163283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.163287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.163292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.163303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.163312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.163317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.163325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.163329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.163334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.163339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.163346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.163351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.163373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:38.171243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:38.172748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:38.172765Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:38.172768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:38.172771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:38.172778Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2120 [1:7556534873224505181:11919]
2025-10-02T08:14:38.172795Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:38.172833Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:38.172836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.172839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.172842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.172856Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:38.172865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:38.172870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:38.172916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.172922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.172924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:38.172926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:38.172973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:38.172978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.172987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.172994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:38.173009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534873224505175:11919]
2025-10-02T08:14:38.173014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534873224505175:11919]
2025-10-02T08:14:38.173020Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:38.173030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:38.173045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:38.173049Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:38.173051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:38.173052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:38.173062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2120
2025-10-02T08:14:38.173089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224505082:11917], now have 1 active actors on pipe
2025-10-02T08:14:38.173097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534873684064336:2378], now have 1 active actors on pipe
2025-10-02T08:14:38.173099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534873224505175:11919]
2025-10-02T08:14:38.173105Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:38.173111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.173112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:38.173117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.173147Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:38.173154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.173156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.173158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:38.173164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.173171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:38.173187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.173169Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2120
2025-10-02T08:14:38.173277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.173283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.173293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.173328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2121 partition: 0 MaxSeqNo: 17 sessionId: src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0
2025-10-02T08:14:38.173665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6076a1e5-c6c278de-9d14a3da-a87f0eb2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:38.176275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0] Write session: try to update token
2025-10-02T08:14:38.176292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:38.189785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId: src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:38.192118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:38.196449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.196473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.196495Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:38.196498Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:38.196500Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:38.196509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534873224505175:11919]
2025-10-02T08:14:38.196513Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534873224505175:11919]
2025-10-02T08:14:38.196575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:38.196581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.196583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:38.196722Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:38.196848Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:38.196862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:38.231892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534873224505209:12248]
2025-10-02T08:14:38.232007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2120, pipe: [1:7556534873224505209:12248]
2025-10-02T08:14:38.329076Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:38.329539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:38.329585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224505209:12248], now have 1 active actors on pipe
2025-10-02T08:14:38.329582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:38.329675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:38.329688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:38.329708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2121 reason: error at write: Disconnected sessionId: src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0
2025-10-02T08:14:38.329843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2121 sessionId: src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0 is DEAD
2025-10-02T08:14:38.329824Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:38.329964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:38.329972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0] Write session will restart in 0.005764s
2025-10-02T08:14:38.329993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0] Write session: Do CDS request
2025-10-02T08:14:38.329999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:38.330149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534873224505209:12248]
2025-10-02T08:14:38.337217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.337289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:38.337305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2122
2025-10-02T08:14:38.337701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.337745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:38.337754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:38.337758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:38.338207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2122 sessionId:  describe result for acl check
2025-10-02T08:14:38.338242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:38.338245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:38.338247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:38.338251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534873224505501:11902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:38.338723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534873224505501:11902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:38.341565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534873224505501:11902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:38.344306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534873224505501:11902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:38.344321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534873224505501:11902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:38.344325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534873224505501:11902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:38.344331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:38.344937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:38.345879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:38.346038Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:38.346048Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:38.346058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:38.346107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:38.346142Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534873224505711:11885]
2025-10-02T08:14:38.346722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:38.346959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:38.347001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:38.347280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:38.347336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.347344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.347346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.347347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.347348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.347353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.347362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.347365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.347369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.347372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.347378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.347385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.347391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.347396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.347401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.347406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.347410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.347415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.347420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.347424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.347441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:38.355723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:38.357468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:38.357487Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:38.357490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:38.357493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:38.357499Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2121 [1:7556534873224505711:11885]
2025-10-02T08:14:38.357510Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:38.357526Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:38.357533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.357535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.357537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.357552Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:38.357561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:38.357567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:38.357624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.357634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.357637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:38.357639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:38.357700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:38.357707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.357718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.357733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:38.357744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2121
2025-10-02T08:14:38.357754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224505702:11902], now have 1 active actors on pipe
2025-10-02T08:14:38.357764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534873224505705:11885]
2025-10-02T08:14:38.357766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534873224505705:11885]
2025-10-02T08:14:38.357772Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:38.357783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:38.357785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534873684064344:2378], now have 1 active actors on pipe
2025-10-02T08:14:38.357789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.357793Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:38.357793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.357810Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:38.357826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:38.357832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:38.357872Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9780304-5e6b0d22-36e3a813-d5904812_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:38.357881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.357885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.357887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:38.357895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.357902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:38.357909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534873224505705:11885]
2025-10-02T08:14:38.357912Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:38.357916Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:38.357878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2121
2025-10-02T08:14:38.357933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.357988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.357994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.358006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.358039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2122 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9780304-5e6b0d22-36e3a813-d5904812_0
2025-10-02T08:14:38.358364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf592a1-e70cc9a-c4f322e3-6e96d1c1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9780304-5e6b0d22-36e3a813-d5904812_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:38.360976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9780304-5e6b0d22-36e3a813-d5904812_0] Write session: try to update token
2025-10-02T08:14:38.360990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9780304-5e6b0d22-36e3a813-d5904812_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:38.375182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:38.375203Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:38.375205Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:38.375214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534873224505705:11885]
2025-10-02T08:14:38.375219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534873224505705:11885]
2025-10-02T08:14:38.375261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:38.375265Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:38.375270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:38.375277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.375280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:38.375367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId: src_id|f9780304-5e6b0d22-36e3a813-d5904812_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:38.375432Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:38.378050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:38.463031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534873224505752:12248]
2025-10-02T08:14:38.464690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2121, pipe: [1:7556534873224505752:12248]
2025-10-02T08:14:38.511590Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:38.512025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.512040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.512073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224505752:12248], now have 1 active actors on pipe
2025-10-02T08:14:38.512185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534873224505752:12248]
2025-10-02T08:14:38.512223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:38.512230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:38.512239Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:38.512300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2122 reason: error at write: Disconnected sessionId: src_id|f9780304-5e6b0d22-36e3a813-d5904812_0
2025-10-02T08:14:38.512328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:38.512471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2122 sessionId: src_id|f9780304-5e6b0d22-36e3a813-d5904812_0 is DEAD
2025-10-02T08:14:38.517076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9780304-5e6b0d22-36e3a813-d5904812_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:38.517088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9780304-5e6b0d22-36e3a813-d5904812_0] Write session will restart in 0.007085s
2025-10-02T08:14:38.517110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9780304-5e6b0d22-36e3a813-d5904812_0] Write session: Do CDS request
2025-10-02T08:14:38.517115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9780304-5e6b0d22-36e3a813-d5904812_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:38.526869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:38.527736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9780304-5e6b0d22-36e3a813-d5904812_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.527838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:38.527853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2123
2025-10-02T08:14:38.527958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.527973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:38.527991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:38.527997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:38.528005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:38.528161Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:38.528176Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:38.528186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:38.528280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:38.528319Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534873224506242:11876]
2025-10-02T08:14:38.528449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2123 sessionId:  describe result for acl check
2025-10-02T08:14:38.528477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:38.528483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:38.528485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:38.528490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534873224506246:11875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:38.528952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534873224506246:11875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:38.528978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:38.529205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:38.529251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:38.529529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:38.529580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.529585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.529587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.529588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.529601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.529607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.529621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.529629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.529632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.529636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.529641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.529648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.529657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.529662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.529671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.529675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.529679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.529683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.529687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.529695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.529714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:38.530764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534873224506246:11875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:38.537055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534873224506246:11875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:38.537072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534873224506246:11875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:38.537076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534873224506246:11875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:38.537084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:38.539749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2122
2025-10-02T08:14:38.537729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:38.539396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:38.539402Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:38.539404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:38.539408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:38.539415Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2122 [1:7556534873224506242:11876]
2025-10-02T08:14:38.539426Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:38.539443Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:38.539446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.539449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.539452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.539466Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:38.539473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:38.539479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:38.539537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.539539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.539542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:38.539544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:38.539613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:38.539616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.539629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.539642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:38.539659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224506285:11875], now have 1 active actors on pipe
2025-10-02T08:14:38.539663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2122
2025-10-02T08:14:38.539665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534873224506235:11876]
2025-10-02T08:14:38.539667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534873224506235:11876]
2025-10-02T08:14:38.539673Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:38.539684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:38.539685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534873684064372:2378], now have 1 active actors on pipe
2025-10-02T08:14:38.539688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:38.539690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:38.539704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:38.539706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:38.539712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.539716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.539755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534873224506235:11876]
2025-10-02T08:14:38.539764Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:38.539779Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:38.539784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.539785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:38.539788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.539791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:38.539801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.539809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:38.539843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.539893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.539898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.539922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.539974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2123 partition: 0 MaxSeqNo: 17 sessionId: src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0
2025-10-02T08:14:38.540281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9780304-5e6b0d22-36e3a813-d5904812_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:38.543098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0] Write session: try to update token
2025-10-02T08:14:38.543115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:38.559002Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:38.559023Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:38.559026Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:38.559035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534873224506235:11876]
2025-10-02T08:14:38.559041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534873224506235:11876]
2025-10-02T08:14:38.559084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:38.559084Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:38.559088Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:38.559097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.559099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:38.559233Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:38.559901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId: src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:38.562610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:38.612307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534873224506301:12248]
2025-10-02T08:14:38.612439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2122, pipe: [1:7556534873224506301:12248]
2025-10-02T08:14:38.692143Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:38.692619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.692635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.692672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224506301:12248], now have 1 active actors on pipe
2025-10-02T08:14:38.692791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534873224506301:12248]
2025-10-02T08:14:38.692832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:38.692838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:38.692897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2123 reason: error at write: Disconnected sessionId: src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0
2025-10-02T08:14:38.692921Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:38.693013Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:38.693051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2123 sessionId: src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0 is DEAD
2025-10-02T08:14:38.693177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:38.693186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0] Write session will restart in 0.009169s
2025-10-02T08:14:38.693210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0] Write session: Do CDS request
2025-10-02T08:14:38.693216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:38.703246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.703292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:38.703308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2124
2025-10-02T08:14:38.703420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.703448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:38.703453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:38.703455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:38.703959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2124 sessionId:  describe result for acl check
2025-10-02T08:14:38.704001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:38.704007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:38.704009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:38.704014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534873224506736:11866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:38.704597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534873224506736:11866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:38.706239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:38.706318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534873224506736:11866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:38.706942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:38.707147Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:38.707155Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:38.707165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:38.707211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:38.707244Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534873224506801:11869]
2025-10-02T08:14:38.707854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:38.708061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:38.708121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:38.708443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:38.708494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.708505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.708506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.708507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.708508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.708513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.708522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.708526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.708530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.708533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.708538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.708545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.708550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.708555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.708559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.708563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.708567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.708572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.708575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.708580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.708598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:38.708778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534873224506736:11866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:38.708791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534873224506736:11866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:38.708795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534873224506736:11866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:38.708818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:38.716140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:38.717874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:38.717894Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:38.717896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:38.717900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:38.717906Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2123 [1:7556534873224506801:11869]
2025-10-02T08:14:38.717917Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:38.717931Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:38.717934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.717937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.717938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.717952Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:38.717962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:38.717968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:38.718042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.718050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.718053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:38.718055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:38.718112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:38.718119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.718132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.718148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:38.718169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224506818:11866], now have 1 active actors on pipe
2025-10-02T08:14:38.718173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2123
2025-10-02T08:14:38.718177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534873684064390:2378], now have 1 active actors on pipe
2025-10-02T08:14:38.718182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534873224506785:11869]
2025-10-02T08:14:38.718184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534873224506785:11869]
2025-10-02T08:14:38.718191Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:38.718200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.718208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.718207Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:38.718210Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:38.718225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:38.718239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:38.718246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:38.718235Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2123
2025-10-02T08:14:38.718285Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:38.718297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.718300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.718306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:38.718313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.718322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:38.718329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534873224506785:11869]
2025-10-02T08:14:38.718342Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:38.718357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:38.718378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.718453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.718460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.718475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.718512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2124 partition: 0 MaxSeqNo: 17 sessionId: src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0
2025-10-02T08:14:38.718851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b2740b-e975bbb0-939822f9-9a04b8b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:38.721501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0] Write session: try to update token
2025-10-02T08:14:38.721519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:38.735403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId: src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:38.735943Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:38.735959Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:38.735961Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:38.735970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534873224506785:11869]
2025-10-02T08:14:38.735974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534873224506785:11869]
2025-10-02T08:14:38.736015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:38.736020Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:38.736026Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:38.736027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.736029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:38.736169Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:38.737829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:38.793020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534873224506847:12248]
2025-10-02T08:14:38.793128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2123, pipe: [1:7556534873224506847:12248]
2025-10-02T08:14:38.868623Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:38.868963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.868981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.869026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224506847:12248], now have 1 active actors on pipe
2025-10-02T08:14:38.869142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534873224506847:12248]
2025-10-02T08:14:38.869163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:38.869170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:38.869222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2124 reason: error at write: Disconnected sessionId: src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0
2025-10-02T08:14:38.869290Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:38.869389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2124 sessionId: src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0 is DEAD
2025-10-02T08:14:38.869702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:38.869710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0] Write session will restart in 0.005268s
2025-10-02T08:14:38.869733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0] Write session: Do CDS request
2025-10-02T08:14:38.869743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:38.869459Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:38.878968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.879036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:38.879099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2125
2025-10-02T08:14:38.879215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:38.879250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:38.879260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:38.879263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:38.879653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2125 sessionId:  describe result for acl check
2025-10-02T08:14:38.879684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:38.879690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:38.879692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:38.879696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534873224507246:11837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:38.880186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534873224507246:11837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:38.883597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:38.884682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:38.884869Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:38.884880Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:38.884892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:38.884942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:38.884981Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534873224507324:11853]
2025-10-02T08:14:38.885521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:38.885678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:38.885717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:38.885940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:38.885991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.886000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.886001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.886002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.886002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.886008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.886016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.886019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.886023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.886026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.886030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.886036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:38.886041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.886045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:38.886049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.886053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:38.886062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.886066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.886070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.886075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.886091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:38.886832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534873224507246:11837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:38.893504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534873224507246:11837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:38.893519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534873224507246:11837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:38.893522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534873224507246:11837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:38.893530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:38.895089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:38.897019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:38.897035Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:38.897038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:38.897041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:38.897048Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2124 [1:7556534873224507324:11853]
2025-10-02T08:14:38.897060Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:38.897078Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:38.897081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.897084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.897085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.897101Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:38.897106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:38.897115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:38.897182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.897193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.897196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:38.897198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:38.897271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:38.897281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.897294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:38.897307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:38.897312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2124
2025-10-02T08:14:38.897326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224507363:11837], now have 1 active actors on pipe
2025-10-02T08:14:38.897329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534873684064398:2378], now have 1 active actors on pipe
2025-10-02T08:14:38.897334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.897338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.897357Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534873224507318:11853]
2025-10-02T08:14:38.897359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534873224507318:11853]
2025-10-02T08:14:38.897373Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:38.897389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:38.897391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:38.897398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:38.897405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:38.897407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:38.897422Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:38.897434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.897438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.897445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:38.897454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.897469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:38.897508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534873224507318:11853]
2025-10-02T08:14:38.897520Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:38.897540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:38.897543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.897584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.897594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.897612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:38.897653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2125 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0
2025-10-02T08:14:38.897390Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2124
2025-10-02T08:14:38.898008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41bb80e5-3906a78d-1e54c7df-988c2009_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:38.900944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0] Write session: try to update token
2025-10-02T08:14:38.900962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:38.909248Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:38.909269Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:38.909281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534873224507318:11853]
2025-10-02T08:14:38.909321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:38.909323Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:38.909501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:38.909655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:38.909797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:38.909939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:38.910151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:38.910197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:38.914772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId: src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:38.917193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:38.917315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.917329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.917363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:38.917388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:38.917495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:38.917509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:38.917677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.917741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.917805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.917869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.917930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.917938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.918004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.918066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.918131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.918197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.918241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.918248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.918316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.918391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.918449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.918507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.918548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.918556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.918620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.918682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.918749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.918812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.918857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.918864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.918929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.918988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.919047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.919113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.919157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.919166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.919229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.919295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.919361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.919425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.919472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.919480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.919546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.919607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.919674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.919738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.919784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.919792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.919860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.919921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.919985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.920051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.920099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.920106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.920171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.920247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.920310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.920379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.920424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.920432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.920500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:38.920562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:38.920622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:38.920682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:38.920726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:38.920735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:38.920774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:38.920864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:38.920887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:38.920889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:38.920919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:38.920936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:38.920946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:38.920949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:38.920952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:38.921351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:38.921378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:38.921384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:38.921387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:38.921390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:38.921393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:38.921922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:38.921945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:38.921951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:38.921954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:38.921958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:38.921961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:38.922497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:38.922520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:38.922525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:38.922529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:38.922531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:38.923715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:38.923733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:38.923744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392878923
2025-10-02T08:14:38.923854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:38.923872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:38.923876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:38.923879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:38.923883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:38.923886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:38.924377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:38.924398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:38.924407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:38.924413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:38.924416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:38.924423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:38.924884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:38.924908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:38.924916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:38.924920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:38.924924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:38.924927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:38.925396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:38.925420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:38.925426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:38.926474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:38.926493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:38.926498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:38.926504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:38.926515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392878926
2025-10-02T08:14:38.926813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:38.926836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:38.926847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:38.926854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:38.926858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:38.926866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:38.927291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:38.927313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:38.927324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:38.927329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:38.927332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:38.927336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:38.927778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:38.927797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:38.927901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392878927
2025-10-02T08:14:38.928675Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:38.928694Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:38.928701Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:38.928707Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:38.930290Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:38.930305Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:38.930309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:38.930318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534873224507318:11853]
2025-10-02T08:14:38.930321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534873224507318:11853]
2025-10-02T08:14:38.930344Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:38.930348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:38.930365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:38.930370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:38.930371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:38.930498Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:38.969184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534873224507386:12248]
2025-10-02T08:14:38.969367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2124, pipe: [1:7556534873224507386:12248]
2025-10-02T08:14:39.075788Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:39.076203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534873224507386:12248], now have 1 active actors on pipe
2025-10-02T08:14:39.076372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:39.076384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:39.076423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2125 reason: error at write: Disconnected sessionId: src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0
2025-10-02T08:14:39.076439Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:39.076620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2125 sessionId: src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0 is DEAD
2025-10-02T08:14:39.076766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:39.076774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0] Write session will restart in 0.008568s
2025-10-02T08:14:39.076797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0] Write session: Do CDS request
2025-10-02T08:14:39.076823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:39.076847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534873224507386:12248]
2025-10-02T08:14:39.077881Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:39.092450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.093354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:39.093370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2126
2025-10-02T08:14:39.093521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.093552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:39.093557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:39.093561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:39.093957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2126 sessionId:  describe result for acl check
2025-10-02T08:14:39.093995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:39.093996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:39.093998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:39.094003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534877519475040:11838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:39.094692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534877519475040:11838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:39.098115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534877519475040:11838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:39.102676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:39.104681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:39.104951Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:39.104965Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:39.104978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:39.105042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:39.105088Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534877519475187:11843]
2025-10-02T08:14:39.105689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:39.106106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534877519475040:11838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:39.106119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534877519475040:11838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:39.106123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534877519475040:11838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:39.106133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:39.106228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:39.106281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:39.106575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:39.106646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.106652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.106653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.106654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.106655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.106661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.106670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.106674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.106677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.106680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.106686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.106692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.106698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.106702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.106706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.106711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.106714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.106718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.106722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.106726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.106743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:39.117314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:39.118983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:39.119007Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:39.119010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:39.119014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:39.119021Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2125 [1:7556534877519475187:11843]
2025-10-02T08:14:39.119034Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:39.119053Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:39.119056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.119059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.119061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.119078Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:39.119083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:39.119089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:39.119157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.119167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.119170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:39.119173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:39.119481Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2125
2025-10-02T08:14:39.119240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:39.119249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.119261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.119272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:39.119290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519475196:11838], now have 1 active actors on pipe
2025-10-02T08:14:39.119296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534877519475181:11843]
2025-10-02T08:14:39.119298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534877519475181:11843]
2025-10-02T08:14:39.119305Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:39.119316Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:39.119317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:39.119319Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:39.119332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:39.119334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:39.119340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534877979031700:2378], now have 1 active actors on pipe
2025-10-02T08:14:39.119370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534877519475181:11843]
2025-10-02T08:14:39.119380Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:39.119426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2125
2025-10-02T08:14:39.119458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:39.119553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.119558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.119581Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:39.119588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.119592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.119594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:39.119602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.119611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:39.119627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.119673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.119675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.119686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.119719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2126 partition: 0 MaxSeqNo: 17 sessionId: src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0
2025-10-02T08:14:39.120461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d56e228-6d175af1-f8daed75-8e34cbc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:39.123034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0] Write session: try to update token
2025-10-02T08:14:39.123054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:39.134743Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:39.134765Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:39.134774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534877519475181:11843]
2025-10-02T08:14:39.134820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:39.134828Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:39.134996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:39.135148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:39.135296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:39.135437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:39.135635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:39.135675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:39.138789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId: src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:39.141802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:39.141887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.141895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.141929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:39.141948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:39.142105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.142110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.142274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.142336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.142406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.142470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.142513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.142517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.142593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.142656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.142722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.142800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.142846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.142849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.142929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.142992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.143055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.143122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.143164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.143167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.143240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.143307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.143373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.143446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.143495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.143500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.143579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.143641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.143705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.143772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.143819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.143822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.143894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.143961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.144030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.144095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.144140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.144143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.144232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.144295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.144361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.144434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.144475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.144477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.144549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.144615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.144681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.144746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.144789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.144792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.144887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.144946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.145006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.145067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.145108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.145111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.145178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.145520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.145588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.145650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.145690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.145693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.145730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:39.145795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.145813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.145815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:39.145845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:39.145859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:39.145862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:39.145864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:39.145867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:39.146289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:39.146308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:39.146314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:39.146317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:39.146320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:39.146322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:39.147038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:39.147051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:39.147058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:39.147061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:39.147063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:39.147066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:39.147548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:39.147560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:39.147564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:39.147567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:39.147569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:39.148719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:39.148724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:39.148734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392879148
2025-10-02T08:14:39.149078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:39.149102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:39.149109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:39.149112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:39.149117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:39.149122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:39.149720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:39.149746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:39.149753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:39.149757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:39.149762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:39.149766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:39.150499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:39.150515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:39.150523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:39.150526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:39.150531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:39.150534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:39.151091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:39.151118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:39.151124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:39.152355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:39.152366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:39.152372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:39.152375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:39.152384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392879151
2025-10-02T08:14:39.152737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:39.152755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:39.152762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:39.152766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:39.152770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:39.152774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:39.153496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:39.153526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:39.153533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:39.153536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:39.153539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:39.153543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:39.154063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:39.154077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.154175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392879154
2025-10-02T08:14:39.154995Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:39.155010Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:39.155016Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:39.155022Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:39.156784Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:39.156827Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:39.156829Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:39.156837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534877519475181:11843]
2025-10-02T08:14:39.156840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534877519475181:11843]
2025-10-02T08:14:39.156892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:39.156899Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:39.156902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:39.156906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.156908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:39.157051Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:39.177039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534877519475224:12248]
2025-10-02T08:14:39.177153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2125, pipe: [1:7556534877519475224:12248]
2025-10-02T08:14:39.288218Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:39.288543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519475224:12248], now have 1 active actors on pipe
2025-10-02T08:14:39.288671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534877519475224:12248]
2025-10-02T08:14:39.288690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:39.288696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:39.288719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2126 reason: error at write: Disconnected sessionId: src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0
2025-10-02T08:14:39.288760Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:39.288784Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:39.288932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2126 sessionId: src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0 is DEAD
2025-10-02T08:14:39.289169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:39.289179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0] Write session will restart in 0.007945s
2025-10-02T08:14:39.289200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0] Write session: Do CDS request
2025-10-02T08:14:39.289210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:39.298254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.298294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:39.298310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2127
2025-10-02T08:14:39.298465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.298492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:39.298501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:39.298504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:39.299009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2127 sessionId:  describe result for acl check
2025-10-02T08:14:39.299037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:39.299043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:39.299044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:39.299048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534877519475504:11835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:39.299495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534877519475504:11835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:39.302276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534877519475504:11835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:39.305298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534877519475504:11835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:39.305313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534877519475504:11835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:39.305316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534877519475504:11835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:39.305323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:39.305729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:39.306948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:39.307125Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:39.307137Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:39.307148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:39.307197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:39.307232Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534877519475735:11836]
2025-10-02T08:14:39.307778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:39.307950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:39.307989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:39.308252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:39.308295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.308301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.308302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.308303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.308304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.308309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.308318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.308323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.308326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.308330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.308335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.308343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.308352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.308357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.308365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.308370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.308375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.308386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.308390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.308399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.308417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:39.316614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:39.318312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:39.318329Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:39.318332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:39.318336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:39.318343Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2126 [1:7556534877519475735:11836]
2025-10-02T08:14:39.318355Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:39.318370Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:39.318374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.318377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.318379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.318396Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:39.318401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:39.318407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:39.318470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.318480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.318483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:39.318485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:39.318554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:39.318561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.318576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.318591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:39.318614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519475726:11835], now have 1 active actors on pipe
2025-10-02T08:14:39.318625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534877979031710:2378], now have 1 active actors on pipe
2025-10-02T08:14:39.318631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534877519475729:11836]
2025-10-02T08:14:39.318633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534877519475729:11836]
2025-10-02T08:14:39.318646Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:39.318659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:39.318664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:39.318667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:39.318671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:39.318674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:39.318706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534877519475729:11836]
2025-10-02T08:14:39.318721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:39.318736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:39.318828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2126
2025-10-02T08:14:39.318765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2126
2025-10-02T08:14:39.318777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.318781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.318805Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32afcbd5-6685771a-60a89b17-b630740f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:39.318811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.318815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.318818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:39.318828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.318839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:39.318853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.318892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.318895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.318909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.318945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2127 partition: 0 MaxSeqNo: 17 sessionId: src_id|32afcbd5-6685771a-60a89b17-b630740f_0
2025-10-02T08:14:39.319284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeecdf0a-ffc36277-b00f6dae-be270801_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32afcbd5-6685771a-60a89b17-b630740f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:39.321951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32afcbd5-6685771a-60a89b17-b630740f_0] Write session: try to update token
2025-10-02T08:14:39.321969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32afcbd5-6685771a-60a89b17-b630740f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:39.335722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId: src_id|32afcbd5-6685771a-60a89b17-b630740f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:39.336335Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:39.336351Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:39.336352Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:39.336358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534877519475729:11836]
2025-10-02T08:14:39.336361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534877519475729:11836]
2025-10-02T08:14:39.336398Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:39.336400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:39.336403Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:39.336406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.336408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:39.336544Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:39.338195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:39.389006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534877519475759:12248]
2025-10-02T08:14:39.389138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2126, pipe: [1:7556534877519475759:12248]
2025-10-02T08:14:39.469670Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:39.469891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.469907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.469944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519475759:12248], now have 1 active actors on pipe
2025-10-02T08:14:39.470141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:39.471283Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:39.471594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:39.471646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2127 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32afcbd5-6685771a-60a89b17-b630740f_0
2025-10-02T08:14:39.471721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534877519475759:12248]
2025-10-02T08:14:39.471797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2127 sessionId: src_id|32afcbd5-6685771a-60a89b17-b630740f_0 is DEAD
2025-10-02T08:14:39.471938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32afcbd5-6685771a-60a89b17-b630740f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:39.471948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32afcbd5-6685771a-60a89b17-b630740f_0] Write session will restart in 0.008770s
2025-10-02T08:14:39.471974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32afcbd5-6685771a-60a89b17-b630740f_0] Write session: Do CDS request
2025-10-02T08:14:39.471981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32afcbd5-6685771a-60a89b17-b630740f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:39.482286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32afcbd5-6685771a-60a89b17-b630740f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.484057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:39.484080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2128
2025-10-02T08:14:39.484228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.484258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:39.484262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:39.484265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:39.484606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2128 sessionId:  describe result for acl check
2025-10-02T08:14:39.484631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:39.484637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:39.484638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:39.484643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534877519476246:11802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:39.484756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:39.485283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534877519476246:11802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:39.485761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:39.485910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:39.485925Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:39.485933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:39.485971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:39.486003Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534877519476258:11814]
2025-10-02T08:14:39.486595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:39.486765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:39.486801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:39.487091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:39.487128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.487134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.487135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.487137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.487137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.487143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.487152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.487156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.487160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.487164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.487170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.487181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.487191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.487196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.487201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.487206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.487212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.487217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.487222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.487231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.487250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:39.488815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534877519476246:11802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:39.495205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:39.496689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:39.496710Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:39.496713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:39.496716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:39.496722Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2127 [1:7556534877519476258:11814]
2025-10-02T08:14:39.496734Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:39.496750Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:39.496753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.496755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.496757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.496771Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:39.496776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:39.496782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:39.496869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.496879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.496883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:39.496885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:39.496947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:39.496955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.496969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.496980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:39.497003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534877979031721:2378], now have 1 active actors on pipe
2025-10-02T08:14:39.497013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534877519476247:11814]
2025-10-02T08:14:39.497016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534877519476247:11814]
2025-10-02T08:14:39.497029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:39.497049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:39.497063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:39.497061Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:39.497066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:39.497066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:39.497095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534877519476247:11814]
2025-10-02T08:14:39.497101Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:39.497103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:39.497076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2127
2025-10-02T08:14:39.497382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534877519476246:11802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:39.497394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534877519476246:11802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:39.497397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534877519476246:11802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:39.497404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:39.497959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2127
2025-10-02T08:14:39.497973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519476303:11802], now have 1 active actors on pipe
2025-10-02T08:14:39.497978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.497983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.498004Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:39.498011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.498021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.498023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:39.498034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.498051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:39.498069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.498118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.498125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.498137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.498164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2128 partition: 0 MaxSeqNo: 17 sessionId: src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0
2025-10-02T08:14:39.498517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32afcbd5-6685771a-60a89b17-b630740f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:39.501271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0] Write session: try to update token
2025-10-02T08:14:39.501292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:39.508569Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:39.508589Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:39.508597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534877519476247:11814]
2025-10-02T08:14:39.508634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:39.508633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:39.508819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:39.508955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:39.509095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:39.509233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:39.509424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:39.509472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:39.514842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId: src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:39.517440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:39.517529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.517542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.517576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:39.517595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:39.518211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.518235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.518387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.518456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.518523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.518587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.518637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.518647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.518714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.518779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.518842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.518912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.518957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.518965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.519035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.519101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.519168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.519233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.519282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.519290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.519359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.519427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.519492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.519562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.519613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.519624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.519691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.519750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.519811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.519876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.519924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.519931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.520000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.520065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.520129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.520208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.520253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.520260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.520326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.520389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.520461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.520526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.520636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.520644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.520711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.520772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.520856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.520922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.520968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.520975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.521045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.521107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.521171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.521235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.521282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.521290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.521356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:39.521418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:39.521479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:39.521546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:39.521598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:39.521606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:39.521644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:39.521707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.521731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.521738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:39.521770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:39.521787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:39.521795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:39.521798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:39.521801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:39.522206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:39.522238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:39.522249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:39.522258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:39.522261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:39.522265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:39.523164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:39.523197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:39.523204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:39.523212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:39.523215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:39.523223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:39.523939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:39.523971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:39.523977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:39.523981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:39.523988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:39.525242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:39.525269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:39.525282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392879525
2025-10-02T08:14:39.525522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:39.525548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:39.525560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:39.525568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:39.525573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:39.525580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:39.526043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:39.526072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:39.526082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:39.526088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:39.526091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:39.526095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:39.526606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:39.526637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:39.526645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:39.526649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:39.526652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:39.526656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:39.527150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:39.527180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:39.527190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:39.528288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:39.528310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:39.528316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:39.528319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:39.528329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392879528
2025-10-02T08:14:39.528622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:39.528648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:39.528659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:39.528664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:39.528671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:39.528676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:39.529174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:39.529202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:39.529208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:39.529211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:39.529216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:39.529219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:39.529693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:39.529718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.529815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392879529
2025-10-02T08:14:39.530553Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:39.530575Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:39.530582Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:39.530592Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:39.532216Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:39.532235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:39.532237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:39.532247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534877519476247:11814]
2025-10-02T08:14:39.532252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534877519476247:11814]
2025-10-02T08:14:39.532294Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:39.532305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:39.532309Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:39.532310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.532312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:39.532440Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:39.571782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534877519476345:12248]
2025-10-02T08:14:39.571900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2127, pipe: [1:7556534877519476345:12248]
2025-10-02T08:14:39.661432Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:39.661726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519476345:12248], now have 1 active actors on pipe
2025-10-02T08:14:39.661831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534877519476345:12248]
2025-10-02T08:14:39.661848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:39.661850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:39.661872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2128 reason: error at write: Disconnected sessionId: src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0
2025-10-02T08:14:39.661949Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:39.662008Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:39.662027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2128 sessionId: src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0 is DEAD
2025-10-02T08:14:39.662152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:39.662158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0] Write session will restart in 0.009973s
2025-10-02T08:14:39.662181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0] Write session: Do CDS request
2025-10-02T08:14:39.662187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:39.673192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.673261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:39.673277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2129
2025-10-02T08:14:39.673446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.673473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:39.673480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:39.673483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:39.673797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2129 sessionId:  describe result for acl check
2025-10-02T08:14:39.673831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:39.673836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:39.673837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:39.673840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534877519476791:11775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:39.674207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534877519476791:11775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:39.676146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534877519476791:11775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:39.676158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:39.676990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:39.677123Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:39.677131Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:39.677139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:39.677180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:39.677211Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534877519476858:11776]
2025-10-02T08:14:39.677656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:39.677791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:39.677825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:39.678037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:39.678073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.678078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.678079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.678081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.678082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.678087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.678096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.678100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.678104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.678107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.678112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.678122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.678129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.678134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.678142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.678148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.678155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.678161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.678168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.678174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.678195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:39.678389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534877519476791:11775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:39.678399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534877519476791:11775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:39.678402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534877519476791:11775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:39.678408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:39.685798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:39.687305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:39.687323Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:39.687325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:39.687328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:39.687332Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2128 [1:7556534877519476858:11776]
2025-10-02T08:14:39.687341Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:39.687357Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:39.687360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.687363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.687365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.687380Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:39.687383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:39.687388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:39.687434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.687436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.687438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:39.687441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:39.687499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:39.687505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.687513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.687524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:39.687536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534877519476842:11776]
2025-10-02T08:14:39.687541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534877519476842:11776]
2025-10-02T08:14:39.687546Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:39.687556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519476875:11775], now have 1 active actors on pipe
2025-10-02T08:14:39.687559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:39.687561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2128
2025-10-02T08:14:39.687562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:39.687566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:39.687574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:39.687576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:39.687580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534877979031758:2378], now have 1 active actors on pipe
2025-10-02T08:14:39.687606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.687616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.687632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534877519476842:11776]
2025-10-02T08:14:39.687640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:39.687644Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:39.687663Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39ac969-770f00d2-ab19133f-f309d71e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:39.687672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.687680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.687683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:39.687646Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2128
2025-10-02T08:14:39.687692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.687704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:39.687732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.687787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.687794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.687805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.687841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2129 partition: 0 MaxSeqNo: 17 sessionId: src_id|39ac969-770f00d2-ab19133f-f309d71e_0
2025-10-02T08:14:39.688132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9da1583-404aacb8-ff49f9ea-84e0b53d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|39ac969-770f00d2-ab19133f-f309d71e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:39.690539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ac969-770f00d2-ab19133f-f309d71e_0] Write session: try to update token
2025-10-02T08:14:39.690552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ac969-770f00d2-ab19133f-f309d71e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:39.703907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId: src_id|39ac969-770f00d2-ab19133f-f309d71e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:39.704928Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:39.704939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:39.704941Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:39.704947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534877519476842:11776]
2025-10-02T08:14:39.704950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534877519476842:11776]
2025-10-02T08:14:39.704985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:39.704995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.704997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:39.705112Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:39.705127Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:39.705141Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:39.706398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:39.762273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534877519476901:12248]
2025-10-02T08:14:39.762395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2128, pipe: [1:7556534877519476901:12248]
2025-10-02T08:14:39.835464Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:39.835879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.835897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.835937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519476901:12248], now have 1 active actors on pipe
2025-10-02T08:14:39.836988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534877519476901:12248]
2025-10-02T08:14:39.837007Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:39.837017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:39.837020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:39.837091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2129 reason: error at write: Disconnected sessionId: src_id|39ac969-770f00d2-ab19133f-f309d71e_0
2025-10-02T08:14:39.837246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2129 sessionId: src_id|39ac969-770f00d2-ab19133f-f309d71e_0 is DEAD
2025-10-02T08:14:39.837647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ac969-770f00d2-ab19133f-f309d71e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:39.837654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ac969-770f00d2-ab19133f-f309d71e_0] Write session will restart in 0.005972s
2025-10-02T08:14:39.837680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ac969-770f00d2-ab19133f-f309d71e_0] Write session: Do CDS request
2025-10-02T08:14:39.837688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ac969-770f00d2-ab19133f-f309d71e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:39.840877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:39.845201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ac969-770f00d2-ab19133f-f309d71e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.845287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:39.845303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2130
2025-10-02T08:14:39.845416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:39.845440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:39.845445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:39.845448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:39.845849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2130 sessionId:  describe result for acl check
2025-10-02T08:14:39.845876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:39.845878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:39.845879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:39.845884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534877519476919:11762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:39.846394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534877519476919:11762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:39.850744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534877519476919:11762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:39.854299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534877519476919:11762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:39.854315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534877519476919:11762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:39.854318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534877519476919:11762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:39.854326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:39.865211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:39.866566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:39.866724Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:39.866734Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:39.866743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:39.866788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:39.866826Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534877519477420:11758]
2025-10-02T08:14:39.867441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:39.867629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:39.867668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:39.867955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:39.867994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.868000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.868001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.868002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.868004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.868008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.868018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.868022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.868026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.868030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.868035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.868042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:39.868046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.868051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:39.868056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.868060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:39.868065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.868069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.868088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.868098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.868115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:39.876228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:39.877842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:39.877860Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:39.877863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:39.877867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:39.877875Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2129 [1:7556534877519477420:11758]
2025-10-02T08:14:39.877889Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:39.877907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:39.877911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.877914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.877917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.877933Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:39.877943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:39.877950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:39.878012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.878019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.878023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:39.878025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:39.878107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:39.878117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.878131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:39.878142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:39.878162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519477125:11762], now have 1 active actors on pipe
2025-10-02T08:14:39.878172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534877519477414:11758]
2025-10-02T08:14:39.878174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534877519477414:11758]
2025-10-02T08:14:39.878196Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:39.878210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534877979031767:2378], now have 1 active actors on pipe
2025-10-02T08:14:39.878216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2129
2025-10-02T08:14:39.878221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:39.878237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:39.878245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:39.878252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.878260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.878293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:39.878292Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2129
2025-10-02T08:14:39.878297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534877519477414:11758]
2025-10-02T08:14:39.878300Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:39.878306Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:39.878314Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:39.878318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:39.878321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:39.878326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:39.878328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:39.878337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:39.878345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:39.878379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.878465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:39.878477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:39.878502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:39.878549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2130 partition: 0 MaxSeqNo: 17 sessionId: src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0
2025-10-02T08:14:39.878843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ac969-770f00d2-ab19133f-f309d71e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:39.881437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0] Write session: try to update token
2025-10-02T08:14:39.881453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:39.895577Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:39.895598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:39.895600Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:39.895609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534877519477414:11758]
2025-10-02T08:14:39.895613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534877519477414:11758]
2025-10-02T08:14:39.895653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:39.895659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:39.895659Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:39.895661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:39.895665Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:39.895788Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:39.896982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId: src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:39.899740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:39.937353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534877519477446:12248]
2025-10-02T08:14:39.937480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2129, pipe: [1:7556534877519477446:12248]
2025-10-02T08:14:40.045033Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:40.045303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.045316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.045356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534877519477446:12248], now have 1 active actors on pipe
2025-10-02T08:14:40.045487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534877519477446:12248]
2025-10-02T08:14:40.045514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:40.045516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:40.045573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2130 reason: error at write: Disconnected sessionId: src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0
2025-10-02T08:14:40.045577Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:40.045748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2130 sessionId: src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0 is DEAD
2025-10-02T08:14:40.048245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:40.048258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0] Write session will restart in 0.008677s
2025-10-02T08:14:40.048284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0] Write session: Do CDS request
2025-10-02T08:14:40.048293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:40.046003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:40.058259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.058420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:40.058435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2131
2025-10-02T08:14:40.058588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.058617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:40.058626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:40.058629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:40.059117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2131 sessionId:  describe result for acl check
2025-10-02T08:14:40.059152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:40.059159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:40.059160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:40.059165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534881814445173:11743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:40.059657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534881814445173:11743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:40.063426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534881814445173:11743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:40.063459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:40.065109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:40.065281Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:40.065291Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:40.065300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:40.065344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:40.065380Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534881814445255:11753]
2025-10-02T08:14:40.066024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:40.066203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:40.066241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:40.066298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534881814445173:11743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:40.066313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534881814445173:11743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:40.066316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534881814445173:11743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:40.066324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:40.066536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:40.066574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.066580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.066582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.066583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.066584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.066588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.066598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.066601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.066604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.066607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.066612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.066619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.066625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.066631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.066635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.066639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.066644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.066649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.066654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.066659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.066681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:40.074502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:40.076053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:40.076071Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:40.076074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:40.076078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:40.076086Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2130 [1:7556534881814445255:11753]
2025-10-02T08:14:40.076099Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:40.076116Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:40.076119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.076122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.076124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.076140Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:40.076151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:40.076159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:40.076235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.076243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.076247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:40.076249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:40.076312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:40.076320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.076333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.076351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:40.076369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814445266:11743], now have 1 active actors on pipe
2025-10-02T08:14:40.076380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534881814445238:11753]
2025-10-02T08:14:40.076382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534881814445238:11753]
2025-10-02T08:14:40.076389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2130
2025-10-02T08:14:40.076390Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:40.076401Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:40.076403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:40.076413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:40.076416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:40.076419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:40.076426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534882273999070:2378], now have 1 active actors on pipe
2025-10-02T08:14:40.076431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.076435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.076477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534881814445238:11753]
2025-10-02T08:14:40.076491Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:40.076503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:40.076511Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:40.076521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.076526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.076532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:40.076541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.076554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:40.076526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2130
2025-10-02T08:14:40.077074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28e05e-a00bdd83-40a3a69-88fcf6fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:40.079817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0] Write session: try to update token
2025-10-02T08:14:40.079833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:40.076594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.076672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.076675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.076687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.076724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2131 partition: 0 MaxSeqNo: 17 sessionId: src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0
2025-10-02T08:14:40.094220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId: src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:40.094504Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:40.094523Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:40.094526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:40.094535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534881814445238:11753]
2025-10-02T08:14:40.094539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534881814445238:11753]
2025-10-02T08:14:40.094582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:40.094586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.094588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:40.094589Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:40.094595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:40.094738Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:40.097110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:40.145754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534881814445287:12248]
2025-10-02T08:14:40.145884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2130, pipe: [1:7556534881814445287:12248]
2025-10-02T08:14:40.203169Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:14:40.232001Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:40.232549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.232562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.232602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814445287:12248], now have 1 active actors on pipe
2025-10-02T08:14:40.232758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534881814445287:12248]
2025-10-02T08:14:40.232791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:40.232796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:40.232867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2131 reason: error at write: Disconnected sessionId: src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0
2025-10-02T08:14:40.232888Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:40.233038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2131 sessionId: src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0 is DEAD
2025-10-02T08:14:40.233202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:40.233215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0] Write session will restart in 0.006120s
2025-10-02T08:14:40.233240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0] Write session: Do CDS request
2025-10-02T08:14:40.233246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:40.233176Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:40.240229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.240414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:40.240429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2132
2025-10-02T08:14:40.240553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.240584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:40.240589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:40.240592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:40.241049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2132 sessionId:  describe result for acl check
2025-10-02T08:14:40.241082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:40.241085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:40.241086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:40.241091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534881814445549:11747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:40.241583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534881814445549:11747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:40.246749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534881814445549:11747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:40.249539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:40.249972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534881814445549:11747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:40.249985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534881814445549:11747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:40.249988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534881814445549:11747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:40.249996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:40.250937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:40.251106Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:40.251110Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:40.251120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:40.251173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:40.251216Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534881814445807:11744]
2025-10-02T08:14:40.251825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:40.251978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:40.252019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:40.252302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:40.252350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.252359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.252360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.252362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.252363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.252367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.252377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.252380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.252384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.252387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.252393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.252399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.252405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.252411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.252415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.252420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.252423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.252428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.252433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.252438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.252454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:40.260224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:40.262004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:40.262019Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:40.262021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:40.262024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:40.262028Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2131 [1:7556534881814445807:11744]
2025-10-02T08:14:40.262038Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:40.262052Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:40.262054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.262056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.262057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.262068Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:40.262071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:40.262075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:40.262118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.262123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.262125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:40.262127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:40.262174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:40.262179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.262187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.262194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:40.262209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534881814445795:11744]
2025-10-02T08:14:40.262214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534881814445795:11744]
2025-10-02T08:14:40.262219Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:40.262228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:40.262245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:40.262252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:40.262252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:40.262256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:40.262263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814445803:11747], now have 1 active actors on pipe
2025-10-02T08:14:40.262294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534882273999078:2378], now have 1 active actors on pipe
2025-10-02T08:14:40.262301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534881814445795:11744]
2025-10-02T08:14:40.262309Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:40.262385Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2131
2025-10-02T08:14:40.262333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:40.262504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2131
2025-10-02T08:14:40.262510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.262514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.262538Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70a70e3-3910e60d-26a3e812-70d5599d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:40.262544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.262548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.262549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:40.262558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.262574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:40.262590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.262610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.262617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.262628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.262658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2132 partition: 0 MaxSeqNo: 17 sessionId: src_id|70a70e3-3910e60d-26a3e812-70d5599d_0
2025-10-02T08:14:40.262960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ef7fa5-95f09a7d-48841265-eecac6e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|70a70e3-3910e60d-26a3e812-70d5599d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:40.265498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a70e3-3910e60d-26a3e812-70d5599d_0] Write session: try to update token
2025-10-02T08:14:40.265515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a70e3-3910e60d-26a3e812-70d5599d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:40.279283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId: src_id|70a70e3-3910e60d-26a3e812-70d5599d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:40.279682Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:40.279700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:40.279703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:40.279714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534881814445795:11744]
2025-10-02T08:14:40.279717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534881814445795:11744]
2025-10-02T08:14:40.279755Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:40.279757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:40.279765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.279766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:40.279778Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:40.279904Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:40.281832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:40.333138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534881814445832:12248]
2025-10-02T08:14:40.333265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2131, pipe: [1:7556534881814445832:12248]
2025-10-02T08:14:40.419825Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:40.420093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.420101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.420140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814445832:12248], now have 1 active actors on pipe
2025-10-02T08:14:40.420478Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:40.420827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534881814445832:12248]
2025-10-02T08:14:40.420844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:40.420894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2132 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70a70e3-3910e60d-26a3e812-70d5599d_0
2025-10-02T08:14:40.421019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2132 sessionId: src_id|70a70e3-3910e60d-26a3e812-70d5599d_0 is DEAD
2025-10-02T08:14:40.421028Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:40.421302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a70e3-3910e60d-26a3e812-70d5599d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:40.421311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a70e3-3910e60d-26a3e812-70d5599d_0] Write session will restart in 0.009105s
2025-10-02T08:14:40.421337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a70e3-3910e60d-26a3e812-70d5599d_0] Write session: Do CDS request
2025-10-02T08:14:40.421343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a70e3-3910e60d-26a3e812-70d5599d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:40.433261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a70e3-3910e60d-26a3e812-70d5599d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.437088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:40.437108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2133
2025-10-02T08:14:40.437247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.437286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:40.437298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:40.437301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:40.437704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2133 sessionId:  describe result for acl check
2025-10-02T08:14:40.437734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:40.437737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:40.437738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:40.437744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534881814446252:11727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:40.438251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534881814446252:11727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:40.442012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534881814446252:11727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:40.443313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:40.443653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:40.443801Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:40.443811Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:40.443821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:40.443862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:40.443908Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534881814446351:11729]
2025-10-02T08:14:40.444544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534881814446252:11727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:40.444558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534881814446252:11727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:40.444562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534881814446252:11727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:40.444584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:40.444584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:40.444820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:40.444880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:40.445196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:40.445259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.445266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.445268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.445269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.445270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.445275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.445285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.445294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.445297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.445300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.445306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.445319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.445329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.445335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.445344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.445349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.445354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.445359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.445364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.445374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.445394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:40.457709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:40.459381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:40.459401Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:40.459403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:40.459407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:40.459413Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2132 [1:7556534881814446351:11729]
2025-10-02T08:14:40.459426Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:40.459443Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:40.459446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.459449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.459451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.459467Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:40.459473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:40.459479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:40.459538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.459547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.459550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:40.459553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:40.459623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:40.459631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.459645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.459663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:40.459684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534881814446345:11729]
2025-10-02T08:14:40.459691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534881814446345:11729]
2025-10-02T08:14:40.459704Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:40.459721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:40.459740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:40.459748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:40.459779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534881814446345:11729]
2025-10-02T08:14:40.459786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:40.460009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2132
2025-10-02T08:14:40.459913Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:40.459921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:40.459927Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:40.460497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534882273999084:2378], now have 1 active actors on pipe
2025-10-02T08:14:40.460509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814446358:11727], now have 1 active actors on pipe
2025-10-02T08:14:40.460534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2132
2025-10-02T08:14:40.460591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.460602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.460629Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:40.460645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.460649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.460652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:40.460662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.460673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:40.460687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.461085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.461095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.461116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.461156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2133 partition: 0 MaxSeqNo: 17 sessionId: src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0
2025-10-02T08:14:40.461644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a70e3-3910e60d-26a3e812-70d5599d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:40.464061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0] Write session: try to update token
2025-10-02T08:14:40.464075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:40.483097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId: src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:40.485272Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:40.485293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:40.485296Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:40.485305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534881814446345:11729]
2025-10-02T08:14:40.485310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534881814446345:11729]
2025-10-02T08:14:40.485356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:40.485367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.485370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:40.485507Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:40.485633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:40.485644Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:40.485750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:40.553508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534881814446401:12248]
2025-10-02T08:14:40.554273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2132, pipe: [1:7556534881814446401:12248]
2025-10-02T08:14:40.634878Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:40.635287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.635301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.635339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814446401:12248], now have 1 active actors on pipe
2025-10-02T08:14:40.635547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:40.635554Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:40.635556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:40.635612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2133 reason: error at write: Disconnected sessionId: src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0
2025-10-02T08:14:40.635689Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:40.635765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2133 sessionId: src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0 is DEAD
2025-10-02T08:14:40.635883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:40.635890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0] Write session will restart in 0.008273s
2025-10-02T08:14:40.635913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0] Write session: Do CDS request
2025-10-02T08:14:40.635919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:40.635910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534881814446401:12248]
2025-10-02T08:14:40.649293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.649288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:40.649305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2134
2025-10-02T08:14:40.649530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.649582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:40.649592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:40.649595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:40.650022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2134 sessionId:  describe result for acl check
2025-10-02T08:14:40.650060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:40.650066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:40.650068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:40.650073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534881814446876:11698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:40.650566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534881814446876:11698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:40.652480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:40.652624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534881814446876:11698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:40.653748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:40.654128Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:40.654140Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:40.654150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:40.654208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:40.654246Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534881814446936:11699]
2025-10-02T08:14:40.654923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:40.655082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:40.655127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:40.655431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:40.655475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.655481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.655482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.655483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.655484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.655490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.655513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.655524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.655528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.655532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.655537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.655544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.655550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.655555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.655560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.655565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.655570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.655575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.655580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.655586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.655607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:40.655893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534881814446876:11698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:40.655910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534881814446876:11698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:40.655915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534881814446876:11698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:40.655924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:40.663935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:40.665450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:40.665471Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:40.665474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:40.665478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:40.665486Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2133 [1:7556534881814446936:11699]
2025-10-02T08:14:40.665498Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:40.665517Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:40.665519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.665522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.665524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.665540Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:40.665545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:40.665552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:40.665614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.665624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.665628Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:40.665630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:40.665697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:40.665705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.665719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.665732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:40.665736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2133
2025-10-02T08:14:40.665751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814446953:11698], now have 1 active actors on pipe
2025-10-02T08:14:40.665754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534882273999126:2378], now have 1 active actors on pipe
2025-10-02T08:14:40.665759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.665763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.665779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534881814446920:11699]
2025-10-02T08:14:40.665782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534881814446920:11699]
2025-10-02T08:14:40.665795Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:40.665812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:40.665814Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:40.665818Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:40.665831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:40.665833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:40.665849Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:40.665860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.665864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.665871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:40.665879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.665889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:40.665858Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2133
2025-10-02T08:14:40.665923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534881814446920:11699]
2025-10-02T08:14:40.665936Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:40.665950Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:40.665955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.666013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.666020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.666034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.666075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2134 partition: 0 MaxSeqNo: 17 sessionId: src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0
2025-10-02T08:14:40.666447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f81b331e-480bb305-da937fe9-b3aabb5d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:40.669038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0] Write session: try to update token
2025-10-02T08:14:40.669056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:40.677900Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:40.677925Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:40.677935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534881814446920:11699]
2025-10-02T08:14:40.677978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:40.677976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:40.678153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:40.678300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:40.678439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:40.678582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:40.678780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:40.678823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:40.682874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId: src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:40.685506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:40.685585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.685599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.685633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:40.685661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:40.685721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.685746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.685918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.685974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.686053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.686117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.686308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.686315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.686387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.686451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.686503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.686557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.686596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.686601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.686657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.686711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.686768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.686822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.686866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.686874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.686937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.686993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.687047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.687102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.687142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.687146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.687204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.687272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.687333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.687397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.687442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.687448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.687512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.687584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.687645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.687704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.687747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.687753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.687815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.687874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.687938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.688000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.688044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.688050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.688113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.688172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.688268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.688331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.688375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.688382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.688453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.688517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.688579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.688643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.688691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.688698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.688766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:40.688849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:40.688913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:40.688973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:40.689015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:40.689022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:40.689064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:40.689125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.689140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.689146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:40.689171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:40.689184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:40.689189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:40.689191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:40.689193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:40.689572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:40.689592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:40.689597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:40.689605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:40.689608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:40.689611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:40.690157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:40.690196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:40.690208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:40.690215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:40.690218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:40.690222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:40.690763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:40.690785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:40.690790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:40.690794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:40.690797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:40.692027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:40.692045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:40.692059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392880691
2025-10-02T08:14:40.692255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:40.692272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:40.692282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:40.692288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:40.692297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:40.692302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:40.692746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:40.692764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:40.692770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:40.692774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:40.692779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:40.692782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:40.693268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:40.693295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:40.693307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:40.693314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:40.693319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:40.693323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:40.693809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:40.693832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:40.693838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:40.694929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:40.694953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:40.694958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:40.694965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:40.694972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392880694
2025-10-02T08:14:40.695274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:40.695302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:40.695308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:40.695315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:40.695319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:40.695322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:40.695770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:40.695790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:40.695795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:40.695798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:40.695807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:40.695813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:40.696304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:40.696331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.696436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392880696
2025-10-02T08:14:40.697177Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:40.697197Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:40.697203Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:40.697209Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:40.698732Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:40.698749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:40.698751Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:40.698761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534881814446920:11699]
2025-10-02T08:14:40.698765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534881814446920:11699]
2025-10-02T08:14:40.698809Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:40.698811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:40.698814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.698815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:40.698823Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:40.698929Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:40.736062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534881814446988:12248]
2025-10-02T08:14:40.736170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2133, pipe: [1:7556534881814446988:12248]
2025-10-02T08:14:40.838544Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:40.838936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814446988:12248], now have 1 active actors on pipe
2025-10-02T08:14:40.839087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:40.839097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:40.839122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2134 reason: error at write: Disconnected sessionId: src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0
2025-10-02T08:14:40.839147Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:40.839205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:40.839296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2134 sessionId: src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0 is DEAD
2025-10-02T08:14:40.839446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:40.839457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0] Write session will restart in 0.009630s
2025-10-02T08:14:40.839448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534881814446988:12248]
2025-10-02T08:14:40.839480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0] Write session: Do CDS request
2025-10-02T08:14:40.839487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:40.850289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.850338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:40.850355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2135
2025-10-02T08:14:40.850533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:40.850567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:40.850575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:40.850578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:40.850988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2135 sessionId:  describe result for acl check
2025-10-02T08:14:40.851025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:40.851031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:40.851033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:40.851038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534881814447410:11689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:40.851511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534881814447410:11689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:40.853976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534881814447410:11689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:40.855388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:40.855756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:40.855970Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:40.855978Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:40.855988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:40.856044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:40.856080Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534881814447512:11694]
2025-10-02T08:14:40.856555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534881814447410:11689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:40.856580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534881814447410:11689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:40.856583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534881814447410:11689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:40.856595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:40.856682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:40.856849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:40.856888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:40.857177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:40.857233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.857238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.857239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.857240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.857241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.857246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.857255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.857259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.857262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.857266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.857274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.857284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:40.857293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.857298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:40.857302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.857311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:40.857314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.857319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.857323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.857332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.857348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:40.865054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:40.866768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:40.866787Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:40.866789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:40.866792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:40.866798Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2134 [1:7556534881814447512:11694]
2025-10-02T08:14:40.866809Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:40.866825Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:40.866832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.866836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.866837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.866854Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:40.866861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:40.866868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:40.866922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.866933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.866936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:40.866938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:40.866997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:40.867004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.867014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:40.867024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:40.867044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814447517:11689], now have 1 active actors on pipe
2025-10-02T08:14:40.867049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2134
2025-10-02T08:14:40.867053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534881814447506:11694]
2025-10-02T08:14:40.867055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534881814447506:11694]
2025-10-02T08:14:40.867062Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:40.867073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:40.867088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:40.867094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:40.867100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.867104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.867113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:40.867117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534882273999134:2378], now have 1 active actors on pipe
2025-10-02T08:14:40.867122Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:40.867142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534881814447506:11694]
2025-10-02T08:14:40.867153Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:40.867159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:40.867166Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba1487c-56841bbe-662ce73b-cf077455_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:40.867171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:40.867174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:40.867176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:40.867185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:40.867192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:40.867227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.867276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:40.867283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:40.867294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:40.867321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2135 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba1487c-56841bbe-662ce73b-cf077455_0
2025-10-02T08:14:40.867640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c91318-21ad0972-1ae9217a-a4792a4c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba1487c-56841bbe-662ce73b-cf077455_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:40.868932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2134
2025-10-02T08:14:40.870209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1487c-56841bbe-662ce73b-cf077455_0] Write session: try to update token
2025-10-02T08:14:40.870225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1487c-56841bbe-662ce73b-cf077455_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:40.883704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId: src_id|ba1487c-56841bbe-662ce73b-cf077455_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:40.884418Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:40.884431Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:40.884434Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:40.884443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534881814447506:11694]
2025-10-02T08:14:40.884448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534881814447506:11694]
2025-10-02T08:14:40.884491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:40.884503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:40.884501Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:40.884506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:40.884507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:40.884644Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:40.886367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:40.939863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534881814447543:12248]
2025-10-02T08:14:40.939985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2134, pipe: [1:7556534881814447543:12248]
2025-10-02T08:14:41.017187Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:41.017499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.017510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.017541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534881814447543:12248], now have 1 active actors on pipe
2025-10-02T08:14:41.017628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:41.017633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:41.017682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2135 reason: error at write: Disconnected sessionId: src_id|ba1487c-56841bbe-662ce73b-cf077455_0
2025-10-02T08:14:41.017724Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:41.017753Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:41.017838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2135 sessionId: src_id|ba1487c-56841bbe-662ce73b-cf077455_0 is DEAD
2025-10-02T08:14:41.017965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1487c-56841bbe-662ce73b-cf077455_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:41.017972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1487c-56841bbe-662ce73b-cf077455_0] Write session will restart in 0.008662s
2025-10-02T08:14:41.017956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534881814447543:12248]
2025-10-02T08:14:41.017994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1487c-56841bbe-662ce73b-cf077455_0] Write session: Do CDS request
2025-10-02T08:14:41.018001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1487c-56841bbe-662ce73b-cf077455_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:41.028208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1487c-56841bbe-662ce73b-cf077455_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.028248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:41.028266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2136
2025-10-02T08:14:41.028366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.028394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:41.028403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:41.028406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:41.028824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2136 sessionId:  describe result for acl check
2025-10-02T08:14:41.028858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:41.028860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:41.028861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:41.028866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534886109415237:11681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:41.029339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534886109415237:11681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:41.031815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534886109415237:11681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:41.032658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:41.034061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:41.034391Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:41.034404Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:41.034415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:41.034471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:41.034511Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534886109415361:11682]
2025-10-02T08:14:41.034811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534886109415237:11681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:41.034824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534886109415237:11681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:41.034827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534886109415237:11681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:41.034833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:41.035068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:41.035222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:41.035261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:41.035543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:41.035582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.035588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.035589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.035590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.035591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.035596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.035605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.035614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.035618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.035625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.035631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.035641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.035646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.035656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.035665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.035673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.035677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.035682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.035686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.035691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.035714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:41.043622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:41.045123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:41.045142Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:41.045144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:41.045147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:41.045152Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2135 [1:7556534886109415361:11682]
2025-10-02T08:14:41.045162Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:41.045176Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:41.045179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.045181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.045183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.045194Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:41.045197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:41.045203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:41.045264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.045272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.045275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:41.045277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:41.045343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:41.045355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.045365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.045372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:41.045385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534886109415355:11682]
2025-10-02T08:14:41.045386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534886109415355:11682]
2025-10-02T08:14:41.045391Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:41.045398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2135
2025-10-02T08:14:41.045402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109415366:11681], now have 1 active actors on pipe
2025-10-02T08:14:41.045408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:41.045407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:41.045410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:41.045416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:41.045418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:41.045422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534886568966436:2378], now have 1 active actors on pipe
2025-10-02T08:14:41.045426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.045428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.045460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534886109415355:11682]
2025-10-02T08:14:41.045474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:41.045489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:41.045491Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:41.045499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.045502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.045505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:41.045513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.045527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:41.045527Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2135
2025-10-02T08:14:41.045560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.045618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.045626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.045637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.045670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2136 partition: 0 MaxSeqNo: 17 sessionId: src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0
2025-10-02T08:14:41.045981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1487c-56841bbe-662ce73b-cf077455_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:41.048547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0] Write session: try to update token
2025-10-02T08:14:41.048565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:41.062236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId: src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:41.062573Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:41.062593Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:41.062596Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:41.062605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534886109415355:11682]
2025-10-02T08:14:41.062609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534886109415355:11682]
2025-10-02T08:14:41.062651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:41.062651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:41.062664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.062666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:41.062669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:41.062809Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:41.065042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:41.118222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534886109415395:12248]
2025-10-02T08:14:41.118305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2135, pipe: [1:7556534886109415395:12248]
2025-10-02T08:14:41.209080Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:41.209629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.209647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.209686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109415395:12248], now have 1 active actors on pipe
2025-10-02T08:14:41.209789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534886109415395:12248]
2025-10-02T08:14:41.209809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:41.209814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:41.209862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2136 reason: error at write: Disconnected sessionId: src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0
2025-10-02T08:14:41.209913Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:41.209969Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:41.210024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2136 sessionId: src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0 is DEAD
2025-10-02T08:14:41.210360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:41.210370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0] Write session will restart in 0.007343s
2025-10-02T08:14:41.210395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0] Write session: Do CDS request
2025-10-02T08:14:41.210400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:41.219661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.219748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:41.219765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2137
2025-10-02T08:14:41.219894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.219917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:41.219922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:41.219925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:41.220358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2137 sessionId:  describe result for acl check
2025-10-02T08:14:41.220390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:41.220392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:41.220393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:41.220399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534886109415737:11669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:41.220989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534886109415737:11669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:41.223127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534886109415737:11669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:41.228311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534886109415737:11669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:41.228326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534886109415737:11669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:41.228342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534886109415737:11669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:41.228350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:41.235651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:41.237175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:41.237355Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:41.237364Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:41.237373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:41.237426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:41.237512Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534886109415924:11671]
2025-10-02T08:14:41.238119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:41.238339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:41.238381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:41.238667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:41.238725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.238732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.238733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.238734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.238735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.238740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.238749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.238751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.238753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.238755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.238768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.238773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.238777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.238780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.238783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.238786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.238788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.238791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.238793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.238796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.238807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:41.247425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:41.248926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:41.248943Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:41.248945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:41.248949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:41.248955Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2136 [1:7556534886109415924:11671]
2025-10-02T08:14:41.248963Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:41.248976Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:41.248979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.248981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.248982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.248995Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:41.248999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:41.249007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:41.249055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.249063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.249066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:41.249069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:41.249133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:41.249140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.249149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.249157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:41.249176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534886109415918:11671]
2025-10-02T08:14:41.249183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534886109415918:11671]
2025-10-02T08:14:41.249191Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:41.249205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2136
2025-10-02T08:14:41.249209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109415807:11669], now have 1 active actors on pipe
2025-10-02T08:14:41.249210Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:41.249213Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:41.249218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:41.249231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:41.249239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:41.249244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534886568966445:2378], now have 1 active actors on pipe
2025-10-02T08:14:41.249276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.249284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.249297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534886109415918:11671]
2025-10-02T08:14:41.249308Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:41.249324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:41.249336Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:41.249342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.249345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.249347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:41.249356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.249366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:41.249392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.249443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.249451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.249464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.249498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2137 partition: 0 MaxSeqNo: 17 sessionId: src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0
2025-10-02T08:14:41.249855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48beff0-3bf851d7-bd045c4f-91b9f514_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:41.249917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2136
2025-10-02T08:14:41.252418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0] Write session: try to update token
2025-10-02T08:14:41.252435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:41.268097Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:41.268117Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:41.268119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:41.268128Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534886109415918:11671]
2025-10-02T08:14:41.268132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534886109415918:11671]
2025-10-02T08:14:41.268173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:41.268173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:41.268178Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:41.268180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.268182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:41.268320Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:41.272176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId: src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:41.274784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:41.310022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534886109415950:12248]
2025-10-02T08:14:41.310152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2136, pipe: [1:7556534886109415950:12248]
2025-10-02T08:14:41.397872Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:41.398369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.398389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.398434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109415950:12248], now have 1 active actors on pipe
2025-10-02T08:14:41.398547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:41.398555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:41.398608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2137 reason: error at write: Disconnected sessionId: src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0
2025-10-02T08:14:41.398652Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:41.398672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:41.398752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2137 sessionId: src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0 is DEAD
2025-10-02T08:14:41.398867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:41.398875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0] Write session will restart in 0.009116s
2025-10-02T08:14:41.398900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0] Write session: Do CDS request
2025-10-02T08:14:41.398906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:41.398917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534886109415950:12248]
2025-10-02T08:14:41.409221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.409282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:41.409306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2138
2025-10-02T08:14:41.409434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.409462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:41.409471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:41.409474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:41.409847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2138 sessionId:  describe result for acl check
2025-10-02T08:14:41.409873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:41.409879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:41.409881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:41.409885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534886109416352:11646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:41.410342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534886109416352:11646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:41.413235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534886109416352:11646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:41.414514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:41.415492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:41.415638Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:41.415647Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:41.415656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:41.415696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:41.415728Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534886109416476:11658]
2025-10-02T08:14:41.416233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534886109416352:11646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:41.416246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534886109416352:11646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:41.416249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534886109416352:11646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:41.416257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:41.416288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:41.416470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:41.416507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:41.416788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:41.416942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.416948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.416949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.416950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.416951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.416955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.416963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.416966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.416969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.416974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.416979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.416990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.417000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.417004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.417012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.417016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.417023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.417027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.417034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.417042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.417056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:41.424818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:41.426660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:41.426684Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:41.426687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:41.426690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:41.426696Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2137 [1:7556534886109416476:11658]
2025-10-02T08:14:41.426707Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:41.426724Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:41.426727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.426729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.426731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.426747Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:41.426752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:41.426759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:41.426818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.426826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.426829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:41.426832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:41.426911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:41.426919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.426932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.426935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2137
2025-10-02T08:14:41.426943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:41.426967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109416482:11646], now have 1 active actors on pipe
2025-10-02T08:14:41.426977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534886109416470:11658]
2025-10-02T08:14:41.426979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534886109416470:11658]
2025-10-02T08:14:41.426990Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:41.427002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534886568966452:2378], now have 1 active actors on pipe
2025-10-02T08:14:41.427010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.427011Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:41.427012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.427015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:41.427027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:41.427035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:41.427043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:41.427034Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2137
2025-10-02T08:14:41.427082Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:41.427091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.427095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.427096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:41.427104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.427113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:41.427125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534886109416470:11658]
2025-10-02T08:14:41.427132Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:41.427145Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:41.427160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.427233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.427240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.427254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.427285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2138 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0
2025-10-02T08:14:41.427609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b10c9-58573d81-a94d42e4-87c32c4a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:41.430067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0] Write session: try to update token
2025-10-02T08:14:41.430080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:41.443001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId: src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:41.443213Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:41.443232Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:41.443240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534886109416470:11658]
2025-10-02T08:14:41.443284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:41.443287Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:41.443458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:41.443604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:41.443750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:41.443915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:41.444124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:41.444171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:41.445622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:41.445725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.445745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.445778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:41.445807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:41.445865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.445877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.446040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.446103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.446167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.446230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.446550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.446563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.446633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.446698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.446761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.446827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.446870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.446877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.446942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.447003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.447061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.447121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.447166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.447174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.447236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.447298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.447363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.447428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.447473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.447482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.447548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.447608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.447670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.447734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.447780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.447787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.447854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.447917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.447979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.448044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.448089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.448096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.448162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.448236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.448301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.448367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.448412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.448419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.448482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.448542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.448606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.448669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.448712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.448719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.448782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.448862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.448925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.448988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.449038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.449045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.449108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:41.449170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:41.449231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:41.449293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:41.449341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:41.449348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:41.449384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:41.449445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.449469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.449475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:41.449504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:41.449520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:41.449528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:41.449532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:41.449535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:41.449921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:41.449951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:41.449961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:41.449964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:41.449967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:41.449970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:41.450635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:41.450660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:41.450670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:41.450673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:41.450677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:41.450680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:41.451142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:41.451166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:41.451172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:41.451179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:41.451182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:41.452414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:41.452435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:41.452447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392881452
2025-10-02T08:14:41.452619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:41.452635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:41.452642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:41.452649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:41.452653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:41.452656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:41.453160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:41.453187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:41.453197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:41.453204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:41.453208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:41.453211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:41.453681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:41.453707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:41.453716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:41.453719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:41.453723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:41.453726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:41.454181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:41.454205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:41.454210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:41.455282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:41.455305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:41.455312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:41.455316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:41.455326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392881454
2025-10-02T08:14:41.455621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:41.455648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:41.455655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:41.455657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:41.455661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:41.455664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:41.456134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:41.456158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:41.456168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:41.456172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:41.456175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:41.456179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:41.456646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:41.456669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.456773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392881456
2025-10-02T08:14:41.457546Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:41.457568Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:41.457577Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:41.457586Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:41.459178Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:41.459194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:41.459195Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:41.459204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534886109416470:11658]
2025-10-02T08:14:41.459207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534886109416470:11658]
2025-10-02T08:14:41.459261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:41.459270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.459272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:41.459372Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:41.459387Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:41.459401Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:41.498976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534886109416517:12248]
2025-10-02T08:14:41.499111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2137, pipe: [1:7556534886109416517:12248]
2025-10-02T08:14:41.607301Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:41.607674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109416517:12248], now have 1 active actors on pipe
2025-10-02T08:14:41.607800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534886109416517:12248]
2025-10-02T08:14:41.607820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:41.607827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:41.607848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2138 reason: error at write: Disconnected sessionId: src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0
2025-10-02T08:14:41.607910Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:41.607930Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:41.608019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2138 sessionId: src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0 is DEAD
2025-10-02T08:14:41.608152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:41.608162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0] Write session will restart in 0.007501s
2025-10-02T08:14:41.608186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0] Write session: Do CDS request
2025-10-02T08:14:41.608200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:41.617196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.617281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:41.617298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2139
2025-10-02T08:14:41.617408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.617437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:41.617441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:41.617444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:41.617844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2139 sessionId:  describe result for acl check
2025-10-02T08:14:41.617888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:41.617895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:41.617897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:41.617901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534886109416916:11623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:41.618362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534886109416916:11623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:41.621079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534886109416916:11623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:41.623345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:41.623557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534886109416916:11623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:41.623573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534886109416916:11623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:41.623576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534886109416916:11623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:41.623584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:41.624327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:41.624623Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:41.624630Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:41.624638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:41.624677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:41.624708Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534886109417088:11628]
2025-10-02T08:14:41.625146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:41.625301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:41.625333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:41.625564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:41.625604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.625609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.625609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.625610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.625611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.625614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.625620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.625621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.625623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.625625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.625629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.625636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.625639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.625642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.625644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.625647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.625649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.625652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.625654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.625656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.625666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:41.633165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:41.634525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:41.634539Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:41.634541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:41.634544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:41.634548Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2138 [1:7556534886109417088:11628]
2025-10-02T08:14:41.634555Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:41.634567Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:41.634572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.634574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.634576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.634587Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:41.634594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:41.634599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:41.634641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.634648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.634650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:41.634652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:41.634695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:41.634700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.634708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.634714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:41.634730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534886109417076:11628]
2025-10-02T08:14:41.634731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534886109417076:11628]
2025-10-02T08:14:41.634736Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:41.634745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109417083:11623], now have 1 active actors on pipe
2025-10-02T08:14:41.634755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:41.634756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:41.634759Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:41.634765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:41.634767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:41.634773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534886568966481:2378], now have 1 active actors on pipe
2025-10-02T08:14:41.634778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2138
2025-10-02T08:14:41.634796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.634804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.634817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534886109417076:11628]
2025-10-02T08:14:41.634827Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:41.634836Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:41.634844Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:41.634848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.634852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.634853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:41.634859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.634828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2138
2025-10-02T08:14:41.634865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:41.634887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.634927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.634932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.634941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.634970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2139 partition: 0 MaxSeqNo: 17 sessionId: src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0
2025-10-02T08:14:41.635239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f084d72-f3bc713e-b7a7ce93-1a271b0e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:41.637536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0] Write session: try to update token
2025-10-02T08:14:41.637548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:41.649943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId: src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:41.651418Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:41.651438Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:41.651440Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:41.651447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534886109417076:11628]
2025-10-02T08:14:41.651452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534886109417076:11628]
2025-10-02T08:14:41.651492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:41.651503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.651508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:41.651509Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:41.651514Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:41.651652Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:41.652458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:41.707865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534886109417115:12248]
2025-10-02T08:14:41.707980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2138, pipe: [1:7556534886109417115:12248]
2025-10-02T08:14:41.780437Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:41.780857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.780869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.780899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109417115:12248], now have 1 active actors on pipe
2025-10-02T08:14:41.781047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:41.781059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:41.781073Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:41.781118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2139 reason: error at write: Disconnected sessionId: src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0
2025-10-02T08:14:41.781135Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:41.781272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2139 sessionId: src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0 is DEAD
2025-10-02T08:14:41.781316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534886109417115:12248]
2025-10-02T08:14:41.781405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:41.781415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0] Write session will restart in 0.007060s
2025-10-02T08:14:41.781437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0] Write session: Do CDS request
2025-10-02T08:14:41.781444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:41.789173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.789289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:41.789306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2140
2025-10-02T08:14:41.789425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.789453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:41.789462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:41.789465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:41.790119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2140 sessionId:  describe result for acl check
2025-10-02T08:14:41.790148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:41.790149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:41.790150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:41.790155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534886109417452:11588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:41.790602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534886109417452:11588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:41.793256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534886109417452:11588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:41.796226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534886109417452:11588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:41.796239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534886109417452:11588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:41.796241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534886109417452:11588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:41.796246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:41.796761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:41.798005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:41.798124Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:41.798132Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:41.798139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:41.798167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:41.798193Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534886109417666:11592]
2025-10-02T08:14:41.798571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:41.798747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:41.798773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:41.798960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:41.798988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.798989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.798989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.798990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.798991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.798993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.799000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.799002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.799004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.799005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.799008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.799012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.799015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.799018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.799020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.799023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.799025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.799027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.799029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.799032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.799042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:41.806706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:41.808237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:41.808253Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:41.808254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:41.808257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:41.808261Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2139 [1:7556534886109417666:11592]
2025-10-02T08:14:41.808271Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:41.808285Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:41.808289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.808296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.808297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.808315Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:41.808319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:41.808325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:41.808380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.808386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.808389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:41.808390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:41.808439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:41.808446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.808458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.808474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:41.808489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534886109417660:11592]
2025-10-02T08:14:41.808490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534886109417660:11592]
2025-10-02T08:14:41.808495Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:41.808504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109417652:11588], now have 1 active actors on pipe
2025-10-02T08:14:41.808510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:41.808520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2139
2025-10-02T08:14:41.808521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:41.808523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:41.808522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:41.808526Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:41.808527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534886568966501:2378], now have 1 active actors on pipe
2025-10-02T08:14:41.808551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534886109417660:11592]
2025-10-02T08:14:41.808565Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:41.808569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.808573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.808578Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:41.808612Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:41.808596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2139
2025-10-02T08:14:41.808623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:41.808626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:41.808628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:41.808635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:41.808641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:41.808658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.808694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.808700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.808709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:41.808734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2140 partition: 0 MaxSeqNo: 17 sessionId: src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0
2025-10-02T08:14:41.809041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cefd0a-fbd46f1b-2c920cd4-1c7586fe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:41.811516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0] Write session: try to update token
2025-10-02T08:14:41.811535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:41.825044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId: src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:41.826050Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:41.826068Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:41.826071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:41.826079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534886109417660:11592]
2025-10-02T08:14:41.826084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534886109417660:11592]
2025-10-02T08:14:41.826125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:41.826129Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:41.826134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:41.826136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.826138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:41.826277Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:41.827510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:41.881426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534886109417691:12248]
2025-10-02T08:14:41.881558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2139, pipe: [1:7556534886109417691:12248]
2025-10-02T08:14:41.965128Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:41.965647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:41.965663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:41.965702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109417691:12248], now have 1 active actors on pipe
2025-10-02T08:14:41.965819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534886109417691:12248]
2025-10-02T08:14:41.965849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:41.965857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:41.965969Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:41.966191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:41.966201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0] Write session will restart in 0.009173s
2025-10-02T08:14:41.965912Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:41.966224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0] Write session: Do CDS request
2025-10-02T08:14:41.965913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2140 reason: error at write: Disconnected sessionId: src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0
2025-10-02T08:14:41.966232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:41.966059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2140 sessionId: src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0 is DEAD
2025-10-02T08:14:41.976345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.976949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:41.976969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2141
2025-10-02T08:14:41.977112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:41.977160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:41.977170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:41.977174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:41.977567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2141 sessionId:  describe result for acl check
2025-10-02T08:14:41.977602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:41.977608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:41.977610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:41.977615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534886109417990:11600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:41.978155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534886109417990:11600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:41.981422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534886109417990:11600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:41.985603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534886109417990:11600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:41.985624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534886109417990:11600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:41.985627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534886109417990:11600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:41.985635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:41.990673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:41.992030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:41.992210Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:41.992219Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:41.992226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:41.992262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:41.992294Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534886109418229:11601]
2025-10-02T08:14:41.992837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:41.993029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:41.993106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:41.993429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:41.993498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.993505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.993506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.993507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.993508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.993513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.993522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.993526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.993529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.993533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.993538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.993545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:41.993550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.993554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:41.993558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.993562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:41.993571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.993576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:41.993580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.993586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:41.993608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:42.001522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:42.003239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:42.003260Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:42.003262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:42.003266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:42.003274Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2140 [1:7556534886109418229:11601]
2025-10-02T08:14:42.003284Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:42.003301Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:42.003304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.003307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.003309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.003323Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:42.003328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:42.003333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:42.003395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.003402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.003405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:42.003407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:42.003467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:42.003475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.003488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.003501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:42.003518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2140
2025-10-02T08:14:42.003523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534886109418153:11600], now have 1 active actors on pipe
2025-10-02T08:14:42.003529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534886109418223:11601]
2025-10-02T08:14:42.003531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534886109418223:11601]
2025-10-02T08:14:42.003537Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:42.003548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:42.003548Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:42.003550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:42.003567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:42.003574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:42.003583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.003592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.003605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534886568966509:2378], now have 1 active actors on pipe
2025-10-02T08:14:42.003637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534886109418223:11601]
2025-10-02T08:14:42.003644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:42.003660Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|869e4770-9bf2732b-7c147293-eb4603f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:42.003664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:42.003670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.003674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.003639Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2140
2025-10-02T08:14:42.003676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:42.003683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.003692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:42.003728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.003767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.003774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.003786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.003822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2141 partition: 0 MaxSeqNo: 17 sessionId: src_id|869e4770-9bf2732b-7c147293-eb4603f2_0
2025-10-02T08:14:42.004139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd214f1-5d798a51-bc19ffc7-5eb65e5e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|869e4770-9bf2732b-7c147293-eb4603f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:42.006674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|869e4770-9bf2732b-7c147293-eb4603f2_0] Write session: try to update token
2025-10-02T08:14:42.006687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|869e4770-9bf2732b-7c147293-eb4603f2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:42.014104Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:42.014124Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:42.014132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534886109418223:11601]
2025-10-02T08:14:42.014171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:42.014186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:42.014346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:42.014492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:42.014630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:42.014772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:42.014978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:42.015020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:42.020079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId: src_id|869e4770-9bf2732b-7c147293-eb4603f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:42.022668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:42.022732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.022745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.022782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:42.022809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:42.022860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.022875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.023050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.023129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.023192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.023255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.023530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.023543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.023620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.023678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.023736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.023801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.023841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.023847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.023908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.023960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.024031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.024114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.024170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.024178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.024251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.024312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.024370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.024429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.024469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.024476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.024549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.024638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.024707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.024769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.024965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.024973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.025041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.025117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.025195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.025258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.025297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.025305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.025371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.025435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.025504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.025570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.025620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.025623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.025690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.025751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.025817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.025881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.025925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.025932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.026000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.026062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.026126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.026196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.026248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.026255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.026318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:42.026381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:42.026444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:42.026503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:42.026545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:42.026552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:42.026594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:42.026659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.026680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.026686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:42.026717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:42.026735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:42.026742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:42.026745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:42.026748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:42.027128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:42.027154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:42.027165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:42.027168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:42.027172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:42.027174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:42.027720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:42.027741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:42.027745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:42.027747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:42.027749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:42.027752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:42.028251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:42.028270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:42.028274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:42.028277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:42.028279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:42.029380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:42.029395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:42.029404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392882029
2025-10-02T08:14:42.029508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:42.029519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:42.029523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:42.029525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:42.029528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:42.029532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:42.029982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:42.029999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:42.030007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:42.030010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:42.030015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:42.030017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:42.030404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:42.030421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:42.030428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:42.030431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:42.030435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:42.030439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:42.030854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:42.030872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:42.030876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:42.031825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:42.031841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:42.031844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:42.031847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:42.031855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392882031
2025-10-02T08:14:42.032107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:42.032122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:42.032126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:42.032128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:42.032131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:42.032136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:42.032582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:42.032600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:42.032607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:42.032610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:42.032612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:42.032614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:42.033031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:42.033048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.033120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392882032
2025-10-02T08:14:42.033782Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:42.033809Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:42.033818Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:42.033824Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:42.035242Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:42.035254Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:42.035255Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:42.035261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534886109418223:11601]
2025-10-02T08:14:42.035264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534886109418223:11601]
2025-10-02T08:14:42.035309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:42.035308Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:42.035313Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:42.035315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.035317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:42.035431Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:42.065721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534890404385558:12248]
2025-10-02T08:14:42.065845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2140, pipe: [1:7556534890404385558:12248]
2025-10-02T08:14:42.169547Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:42.169873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404385558:12248], now have 1 active actors on pipe
2025-10-02T08:14:42.170008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534890404385558:12248]
2025-10-02T08:14:42.170039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:42.170046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:42.170073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2141 reason: error at write: Disconnected sessionId: src_id|869e4770-9bf2732b-7c147293-eb4603f2_0
2025-10-02T08:14:42.170102Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:42.170258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2141 sessionId: src_id|869e4770-9bf2732b-7c147293-eb4603f2_0 is DEAD
2025-10-02T08:14:42.170402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869e4770-9bf2732b-7c147293-eb4603f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:42.170414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869e4770-9bf2732b-7c147293-eb4603f2_0] Write session will restart in 0.005794s
2025-10-02T08:14:42.170436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869e4770-9bf2732b-7c147293-eb4603f2_0] Write session: Do CDS request
2025-10-02T08:14:42.170406Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:42.170443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869e4770-9bf2732b-7c147293-eb4603f2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:42.177170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|869e4770-9bf2732b-7c147293-eb4603f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.177299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:42.177314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2142
2025-10-02T08:14:42.177444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.177485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:42.177494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:42.177498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:42.177936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2142 sessionId:  describe result for acl check
2025-10-02T08:14:42.177971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:42.177977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:42.177979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:42.177983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534890404385801:11589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:42.178339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534890404385801:11589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:42.180948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534890404385801:11589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:42.183737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534890404385801:11589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:42.183756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534890404385801:11589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:42.183759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534890404385801:11589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:42.183766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:42.187731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:42.188060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:42.188217Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:42.188226Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:42.188235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:42.188275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:42.188306Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534890404386099:11596]
2025-10-02T08:14:42.188898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:42.189081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:42.189117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:42.189396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:42.189437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.189443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.189444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.189445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.189446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.189450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.189459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.189463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.189467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.189470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.189475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.189483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.189488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.189493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.189497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.189502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.189506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.189510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.189514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.189519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.189541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:42.197534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:42.199035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:42.199040Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:42.199043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:42.199047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:42.199053Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2141 [1:7556534890404386099:11596]
2025-10-02T08:14:42.199065Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:42.199080Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:42.199083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.199086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.199088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.199105Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:42.199111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:42.199117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:42.199172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.199174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.199177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:42.199179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:42.199249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:42.199252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.199265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.199277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:42.199292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534890404386093:11596]
2025-10-02T08:14:42.199294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534890404386093:11596]
2025-10-02T08:14:42.199301Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:42.199313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:42.199326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:42.199868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|869e4770-9bf2732b-7c147293-eb4603f2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:42.199327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:42.199459Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2141
2025-10-02T08:14:42.199329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:42.199331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:42.199338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404386046:11589], now have 1 active actors on pipe
2025-10-02T08:14:42.199355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2141
2025-10-02T08:14:42.199369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534890863933812:2378], now have 1 active actors on pipe
2025-10-02T08:14:42.199372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534890404386093:11596]
2025-10-02T08:14:42.199380Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:42.199386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.199390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.199392Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:42.199430Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:42.199435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.199439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.199441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:42.199452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.199459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:42.199474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.199517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.199520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.199532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.199564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2142 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0
2025-10-02T08:14:42.202346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0] Write session: try to update token
2025-10-02T08:14:42.202363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:42.218749Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:42.218773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:42.218775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:42.218784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534890404386093:11596]
2025-10-02T08:14:42.218788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534890404386093:11596]
2025-10-02T08:14:42.218837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:42.218843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.218846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:42.218980Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:42.221580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:42.221587Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:42.221724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId: src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:42.224305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:42.270025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534890404386124:12248]
2025-10-02T08:14:42.270194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2141, pipe: [1:7556534890404386124:12248]
2025-10-02T08:14:42.368951Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:42.369296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.369313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.369349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404386124:12248], now have 1 active actors on pipe
2025-10-02T08:14:42.369400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:42.369406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:42.369454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2142 reason: error at write: Disconnected sessionId: src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0
2025-10-02T08:14:42.369500Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:42.369533Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:42.369598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2142 sessionId: src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0 is DEAD
2025-10-02T08:14:42.369745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534890404386124:12248]
2025-10-02T08:14:42.369874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:42.369885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0] Write session will restart in 0.008848s
2025-10-02T08:14:42.369912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0] Write session: Do CDS request
2025-10-02T08:14:42.369919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:42.380292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.380325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:42.380342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2143
2025-10-02T08:14:42.380487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.380516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:42.380525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:42.380529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:42.380899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2143 sessionId:  describe result for acl check
2025-10-02T08:14:42.380933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:42.380939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:42.380940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:42.380945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534890404386500:11574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:42.381431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534890404386500:11574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:42.384112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534890404386500:11574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:42.386282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:42.387330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:42.387572Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:42.387587Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:42.387597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:42.387644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534890404386500:11574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:42.387645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:42.387658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534890404386500:11574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:42.387661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534890404386500:11574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:42.387676Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534890404386664:11578]
2025-10-02T08:14:42.387668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:42.388221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:42.388391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:42.388429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:42.388694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:42.388740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.388746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.388747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.388747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.388748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.388753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.388761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.388764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.388768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.388771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.388775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.388781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.388786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.388790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.388794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.388798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.388818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.388823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.388827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.388831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.388848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:42.396665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:42.398092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:42.398113Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:42.398116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:42.398119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:42.398126Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2142 [1:7556534890404386664:11578]
2025-10-02T08:14:42.398138Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:42.398154Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:42.398162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.398166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.398172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.398186Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:42.398196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:42.398203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:42.398262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.398269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.398272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:42.398274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:42.398341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:42.398348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.398361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.398378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:42.398401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404386669:11574], now have 1 active actors on pipe
2025-10-02T08:14:42.398409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2142
2025-10-02T08:14:42.398411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534890404386658:11578]
2025-10-02T08:14:42.398413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534890404386658:11578]
2025-10-02T08:14:42.398420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:42.398434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:42.398435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534890863933822:2378], now have 1 active actors on pipe
2025-10-02T08:14:42.398442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:42.398446Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:42.398455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:42.398458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:42.398465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.398469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.398506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534890404386658:11578]
2025-10-02T08:14:42.398518Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:42.398508Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2142
2025-10-02T08:14:42.398533Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:42.398534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f98da502-e7a7f820-233622a5-41b39d8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:42.398540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.398544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.398546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:42.398555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.398563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:42.398601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.398646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.398653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.398665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.398701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2143 partition: 0 MaxSeqNo: 17 sessionId: src_id|f98da502-e7a7f820-233622a5-41b39d8a_0
2025-10-02T08:14:42.398988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba54b17d-b5c52bbc-e290dfa8-ffa6301d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f98da502-e7a7f820-233622a5-41b39d8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:42.401753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f98da502-e7a7f820-233622a5-41b39d8a_0] Write session: try to update token
2025-10-02T08:14:42.401772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f98da502-e7a7f820-233622a5-41b39d8a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:42.415818Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:42.415839Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:42.415841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:42.415848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534890404386658:11578]
2025-10-02T08:14:42.415851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534890404386658:11578]
2025-10-02T08:14:42.415884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:42.415889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.415891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:42.416014Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:42.417343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId: src_id|f98da502-e7a7f820-233622a5-41b39d8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:42.420234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:42.420397Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:42.420417Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:42.469706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534890404386701:12248]
2025-10-02T08:14:42.469793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2142, pipe: [1:7556534890404386701:12248]
2025-10-02T08:14:42.549918Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:42.550241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.550256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.550293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404386701:12248], now have 1 active actors on pipe
2025-10-02T08:14:42.550410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534890404386701:12248]
2025-10-02T08:14:42.550440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:42.550448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:42.550489Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:42.550506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2143 reason: error at write: Disconnected sessionId: src_id|f98da502-e7a7f820-233622a5-41b39d8a_0
2025-10-02T08:14:42.550659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2143 sessionId: src_id|f98da502-e7a7f820-233622a5-41b39d8a_0 is DEAD
2025-10-02T08:14:42.550790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f98da502-e7a7f820-233622a5-41b39d8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:42.550800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f98da502-e7a7f820-233622a5-41b39d8a_0] Write session will restart in 0.008872s
2025-10-02T08:14:42.550822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f98da502-e7a7f820-233622a5-41b39d8a_0] Write session: Do CDS request
2025-10-02T08:14:42.550830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f98da502-e7a7f820-233622a5-41b39d8a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:42.552892Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:42.561214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f98da502-e7a7f820-233622a5-41b39d8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.561252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:42.561270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2144
2025-10-02T08:14:42.561416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.561444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:42.561453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:42.561456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:42.561817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2144 sessionId:  describe result for acl check
2025-10-02T08:14:42.561854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:42.561861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:42.561862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:42.561867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534890404387131:11557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:42.562355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534890404387131:11557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:42.564612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534890404387131:11557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:42.565509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:42.566646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:42.566826Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:42.566840Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:42.566850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:42.566906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:42.566942Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534890404387238:11560]
2025-10-02T08:14:42.567525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:42.567725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:42.567765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534890404387131:11557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:42.567770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534890404387131:11557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:42.567773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534890404387131:11557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:42.567778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:42.567781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:42.568070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:42.568291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.568293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.568294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.568295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.568297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.568302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.568313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.568317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.568321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.568325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.568331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.568338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.568344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.568349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.568353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.568357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.568361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.568365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.568370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.568374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.568394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:42.576279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:42.578026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:42.578049Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:42.578051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:42.578054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:42.578061Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2143 [1:7556534890404387238:11560]
2025-10-02T08:14:42.578072Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:42.578088Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:42.578091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.578094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.578096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.578116Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:42.578121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:42.578127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:42.578189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.578197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.578200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:42.578202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:42.578264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:42.578275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.578289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.578299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:42.578318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404387249:11557], now have 1 active actors on pipe
2025-10-02T08:14:42.578319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2143
2025-10-02T08:14:42.578330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534890404387231:11560]
2025-10-02T08:14:42.578332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534890404387231:11560]
2025-10-02T08:14:42.578345Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:42.578359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534890863933829:2378], now have 1 active actors on pipe
2025-10-02T08:14:42.578360Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:42.578363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:42.578371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.578375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.578390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:42.578408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:42.578414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:42.578437Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2143
2025-10-02T08:14:42.578455Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:42.578468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.578472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.578473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:42.578482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.578493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:42.578502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534890404387231:11560]
2025-10-02T08:14:42.578511Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:42.578530Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:42.578542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.578579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.578586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.578599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.578639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2144 partition: 0 MaxSeqNo: 17 sessionId: src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0
2025-10-02T08:14:42.578987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f98da502-e7a7f820-233622a5-41b39d8a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:42.581489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0] Write session: try to update token
2025-10-02T08:14:42.581504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:42.595994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId: src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:42.596431Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:42.596448Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:42.596450Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:42.596456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534890404387231:11560]
2025-10-02T08:14:42.596459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534890404387231:11560]
2025-10-02T08:14:42.596494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:42.596503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.596504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:42.596574Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:42.596595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:42.596634Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:42.598875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:42.650426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534890404387305:12248]
2025-10-02T08:14:42.651038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2143, pipe: [1:7556534890404387305:12248]
2025-10-02T08:14:42.732631Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:42.732945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.732956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.732986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404387305:12248], now have 1 active actors on pipe
2025-10-02T08:14:42.733084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534890404387305:12248]
2025-10-02T08:14:42.733103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:42.733104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:42.733254Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:42.733475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:42.733485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0] Write session will restart in 0.009516s
2025-10-02T08:14:42.733508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0] Write session: Do CDS request
2025-10-02T08:14:42.733148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2144 reason: error at write: Disconnected sessionId: src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0
2025-10-02T08:14:42.733515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:42.733197Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:42.733309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2144 sessionId: src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0 is DEAD
2025-10-02T08:14:42.744306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.744297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:42.744313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2145
2025-10-02T08:14:42.744496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.744527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:42.744535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:42.744538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:42.744903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2145 sessionId:  describe result for acl check
2025-10-02T08:14:42.744936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:42.744941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:42.744943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:42.744948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534890404387723:11525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:42.745340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534890404387723:11525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:42.748131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534890404387723:11525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:42.748645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:42.750157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:42.750290Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:42.750297Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:42.750303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:42.750334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:42.750356Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534890404387859:11529]
2025-10-02T08:14:42.750545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534890404387723:11525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:42.750560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534890404387723:11525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:42.750563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534890404387723:11525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:42.750569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:42.750761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:42.750910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:42.750949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:42.751215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:42.751270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.751275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.751276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.751277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.751278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.751283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.751291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.751294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.751298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.751301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.751305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.751312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.751317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.751322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.751330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.751335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.751338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.751343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.751351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.751355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.751369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:42.758769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:42.760442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:42.760456Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:42.760457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:42.760460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:42.760464Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2144 [1:7556534890404387859:11529]
2025-10-02T08:14:42.760472Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:42.760485Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:42.760487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.760489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.760490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.760505Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:42.760509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:42.760516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:42.760558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.760565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.760567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:42.760569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:42.760625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:42.760631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.760638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.760645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:42.760656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534890404387849:11529]
2025-10-02T08:14:42.760660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534890404387849:11529]
2025-10-02T08:14:42.760666Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:42.760678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404387864:11525], now have 1 active actors on pipe
2025-10-02T08:14:42.760680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:42.760683Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:42.760687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:42.760693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2144
2025-10-02T08:14:42.760698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:42.760700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:42.760730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534890863933868:2378], now have 1 active actors on pipe
2025-10-02T08:14:42.760739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.760743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.760755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534890404387849:11529]
2025-10-02T08:14:42.760767Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:42.760787Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:42.760761Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2144
2025-10-02T08:14:42.760792Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:42.760812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.760815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.760817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:42.760826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.760834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:42.760848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.760893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.760898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.760908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.760934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2145 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0
2025-10-02T08:14:42.761219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6491c759-7a5bfe06-6f5ec5f0-f015893d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:42.763662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0] Write session: try to update token
2025-10-02T08:14:42.763674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:42.776493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId: src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:42.777476Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:42.777495Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:42.777498Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:42.777506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534890404387849:11529]
2025-10-02T08:14:42.777510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534890404387849:11529]
2025-10-02T08:14:42.777549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:42.777551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:42.777557Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:42.777560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.777562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:42.777695Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:42.778974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:42.833231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534890404387892:12248]
2025-10-02T08:14:42.833415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2144, pipe: [1:7556534890404387892:12248]
2025-10-02T08:14:42.915157Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:42.915462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.915476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.915507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404387892:12248], now have 1 active actors on pipe
2025-10-02T08:14:42.915602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534890404387892:12248]
2025-10-02T08:14:42.915627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:42.915634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:42.915645Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:42.915684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2145 reason: error at write: Disconnected sessionId: src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0
2025-10-02T08:14:42.915714Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:42.915830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2145 sessionId: src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0 is DEAD
2025-10-02T08:14:42.915921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:42.915927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0] Write session will restart in 0.009176s
2025-10-02T08:14:42.915948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0] Write session: Do CDS request
2025-10-02T08:14:42.915954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:42.926263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.926360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:42.926394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2146
2025-10-02T08:14:42.926503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:42.926535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:42.926542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:42.926545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:42.926905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2146 sessionId:  describe result for acl check
2025-10-02T08:14:42.926936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:42.926943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:42.926944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:42.926949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534890404388348:11516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:42.927423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534890404388348:11516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:42.929481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534890404388348:11516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:42.931033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:42.931389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:42.931538Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:42.931547Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:42.931556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:42.931606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:42.931624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534890404388348:11516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:42.931630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534890404388348:11516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:42.931633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534890404388348:11516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:42.931638Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534890404388435:11517]
2025-10-02T08:14:42.931639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:42.932263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:42.932427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:42.932466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:42.932754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:42.932813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.932819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.932820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.932821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.932823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.932828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.932837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.932841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.932845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.932849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.932854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.932865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:42.932874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.932883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:42.932892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.932901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:42.932905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.932910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.932919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.932928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.932950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:42.940372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:42.942065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:42.942081Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:42.942082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:42.942085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:42.942089Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2145 [1:7556534890404388435:11517]
2025-10-02T08:14:42.942097Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:42.942109Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:42.942111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.942113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.942114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.942125Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:42.942128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:42.942134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:42.942177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.942186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.942190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:42.942192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:42.942251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:42.942258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.942269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:42.942282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:42.942304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534890404388440:11516], now have 1 active actors on pipe
2025-10-02T08:14:42.942311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534890863933876:2378], now have 1 active actors on pipe
2025-10-02T08:14:42.942318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534890404388429:11517]
2025-10-02T08:14:42.942320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534890404388429:11517]
2025-10-02T08:14:42.942331Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:42.942344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.942347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2145
2025-10-02T08:14:42.942350Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:42.942351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.942354Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:42.942368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:42.942385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:42.942391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:42.942371Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2145
2025-10-02T08:14:42.942428Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:42.942437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:42.942440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:42.942442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:42.942451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:42.942463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:42.942478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534890404388429:11517]
2025-10-02T08:14:42.942489Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:42.942501Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:42.942515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.942585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:42.942591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:42.942604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:42.942639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2146 partition: 0 MaxSeqNo: 17 sessionId: src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0
2025-10-02T08:14:42.942931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba6dfa47-445aa17c-a5c62eb2-52c4305_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:42.945276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0] Write session: try to update token
2025-10-02T08:14:42.945287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:42.957906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId: src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:42.959458Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:42.959475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:42.959477Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:42.959483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534890404388429:11517]
2025-10-02T08:14:42.959486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534890404388429:11517]
2025-10-02T08:14:42.959525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:42.959528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:42.959531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:42.959532Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:42.959533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:42.959655Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:42.960340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:43.016005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534894699355761:12248]
2025-10-02T08:14:43.016142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2145, pipe: [1:7556534894699355761:12248]
2025-10-02T08:14:43.089921Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:43.090279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.090291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.090332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699355761:12248], now have 1 active actors on pipe
2025-10-02T08:14:43.090470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:43.090479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:43.090532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2146 reason: error at write: Disconnected sessionId: src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0
2025-10-02T08:14:43.090544Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:43.090521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:43.090694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2146 sessionId: src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0 is DEAD
2025-10-02T08:14:43.090835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534894699355761:12248]
2025-10-02T08:14:43.090858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:43.090868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0] Write session will restart in 0.008836s
2025-10-02T08:14:43.090891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0] Write session: Do CDS request
2025-10-02T08:14:43.090897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:43.101213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.101247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:43.101265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2147
2025-10-02T08:14:43.104008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.104060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:43.104069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:43.104075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:43.104411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2147 sessionId:  describe result for acl check
2025-10-02T08:14:43.104438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:43.104444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:43.104446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:43.104451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534894699356261:11487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:43.104922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534894699356261:11487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:43.105380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:43.106493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:43.106642Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:43.106652Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:43.106662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:43.106706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:43.106738Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534894699356284:11491]
2025-10-02T08:14:43.107328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:43.107519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:43.107561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:43.107842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:43.107882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.107889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.107890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.107891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.107892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.107897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.107907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.107911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.107915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.107918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.107922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.107929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.107934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.107939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.107943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.107948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.107952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.107962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.107966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.107971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.107994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:43.110534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534894699356261:11487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:43.115014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534894699356261:11487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:43.115028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534894699356261:11487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:43.115031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534894699356261:11487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:43.115037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:43.115589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:43.117058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:43.117073Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:43.117075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:43.117079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:43.117085Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2146 [1:7556534894699356284:11491]
2025-10-02T08:14:43.117094Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:43.117109Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:43.117111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.117114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.117116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.117130Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:43.117135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:43.117144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:43.117198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.117208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.117211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:43.117213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:43.117270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:43.117277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.117292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.117310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:43.117330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699356323:11487], now have 1 active actors on pipe
2025-10-02T08:14:43.117334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2146
2025-10-02T08:14:43.117340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534894699356278:11491]
2025-10-02T08:14:43.117342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534894699356278:11491]
2025-10-02T08:14:43.117353Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:43.117361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534895158901179:2378], now have 1 active actors on pipe
2025-10-02T08:14:43.117369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.117371Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:43.117373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.117374Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:43.117389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:43.117408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:43.117415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:43.117454Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:43.117465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.117468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.117470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:43.117478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.117486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:43.117455Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2146
2025-10-02T08:14:43.117497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534894699356278:11491]
2025-10-02T08:14:43.117501Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:43.117504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:43.117523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.117574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.117580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.117592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.117627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2147 partition: 0 MaxSeqNo: 17 sessionId: src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0
2025-10-02T08:14:43.117951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad73375c-87760ce0-f2dd0be7-901d599a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:43.120490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0] Write session: try to update token
2025-10-02T08:14:43.120508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:43.134518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId: src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:43.134911Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:43.134928Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:43.134931Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:43.134938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534894699356278:11491]
2025-10-02T08:14:43.134943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534894699356278:11491]
2025-10-02T08:14:43.134987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:43.134999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.135001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:43.135141Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:43.135157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:43.135164Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:43.137248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:43.191095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534894699356337:12248]
2025-10-02T08:14:43.191207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2146, pipe: [1:7556534894699356337:12248]
2025-10-02T08:14:43.280348Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:43.280696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.280712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.280749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699356337:12248], now have 1 active actors on pipe
2025-10-02T08:14:43.280866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:43.280878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:43.280929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2147 reason: error at write: Disconnected sessionId: src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0
2025-10-02T08:14:43.280932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534894699356337:12248]
2025-10-02T08:14:43.280950Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:43.281053Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:43.281095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2147 sessionId: src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0 is DEAD
2025-10-02T08:14:43.281238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:43.281246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0] Write session will restart in 0.009649s
2025-10-02T08:14:43.281266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0] Write session: Do CDS request
2025-10-02T08:14:43.281270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:43.292292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.292349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:43.292369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2148
2025-10-02T08:14:43.292491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.292533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:43.292543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:43.292546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:43.293022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2148 sessionId:  describe result for acl check
2025-10-02T08:14:43.293055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:43.293061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:43.293063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:43.293067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534894699356813:11471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:43.293586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534894699356813:11471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:43.295459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534894699356813:11471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:43.295692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:43.296988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:43.297152Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:43.297163Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:43.297171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:43.297214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:43.297250Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534894699356883:11474]
2025-10-02T08:14:43.297857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:43.298057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:43.298114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:43.298417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:43.298464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.298465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.298466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.298467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.298468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.298472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.298482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.298486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.298489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.298492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.298500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.298506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.298511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.298516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.298520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.298525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.298529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.298534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.298538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.298543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.298551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534894699356813:11471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:43.298557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534894699356813:11471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:43.298560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534894699356813:11471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:43.298561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:43.298568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:43.306189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:43.307998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:43.308023Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:43.308025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:43.308029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:43.308035Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2147 [1:7556534894699356883:11474]
2025-10-02T08:14:43.308047Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:43.308063Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:43.308066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.308068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.308070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.308085Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:43.308089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:43.308095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:43.308145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.308153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.308155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:43.308157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:43.308221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:43.308227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.308235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.308242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:43.308255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699356897:11471], now have 1 active actors on pipe
2025-10-02T08:14:43.308263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534894699356868:11474]
2025-10-02T08:14:43.308264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534894699356868:11474]
2025-10-02T08:14:43.308269Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:43.308275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2147
2025-10-02T08:14:43.308277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:43.308280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:43.308282Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:43.308285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:43.308287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:43.308291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534895158901187:2378], now have 1 active actors on pipe
2025-10-02T08:14:43.308294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.308297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.308327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534894699356868:11474]
2025-10-02T08:14:43.308333Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:43.308340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:43.308344Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:43.308348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.308351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.308352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:43.308359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.308364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:43.308362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2147
2025-10-02T08:14:43.308392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.308435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.308442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.308451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.308477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2148 partition: 0 MaxSeqNo: 17 sessionId: src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0
2025-10-02T08:14:43.308779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a57954a8-601a12e-8f7c8548-8b5ca8d3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:43.311174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0] Write session: try to update token
2025-10-02T08:14:43.311193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:43.324787Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:43.324825Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:43.324828Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:43.324837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534894699356868:11474]
2025-10-02T08:14:43.324841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534894699356868:11474]
2025-10-02T08:14:43.324874Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:43.324878Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:43.324881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:43.324887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.324890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:43.325017Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:43.329717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId: src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:43.332149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:43.381089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534894699356913:12248]
2025-10-02T08:14:43.381236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2147, pipe: [1:7556534894699356913:12248]
2025-10-02T08:14:43.454250Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:43.454699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.454710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.454746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699356913:12248], now have 1 active actors on pipe
2025-10-02T08:14:43.454859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:43.454870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:43.454932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2148 reason: error at write: Disconnected sessionId: src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0
2025-10-02T08:14:43.454937Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:43.455096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2148 sessionId: src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0 is DEAD
2025-10-02T08:14:43.455080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:43.455229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534894699356913:12248]
2025-10-02T08:14:43.456946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:43.456957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0] Write session will restart in 0.008030s
2025-10-02T08:14:43.456981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0] Write session: Do CDS request
2025-10-02T08:14:43.456986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:43.466230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.466341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:43.466358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2149
2025-10-02T08:14:43.466532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.466563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:43.466572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:43.466575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:43.466971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2149 sessionId:  describe result for acl check
2025-10-02T08:14:43.467001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:43.467008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:43.467010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:43.467015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534894699356955:11464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:43.467497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534894699356955:11464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:43.471258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534894699356955:11464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:43.474775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534894699356955:11464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:43.474789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534894699356955:11464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:43.474791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534894699356955:11464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:43.474797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:43.480968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:43.482328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:43.482491Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:43.482500Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:43.482509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:43.482556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:43.482589Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534894699357469:11465]
2025-10-02T08:14:43.483229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:43.483472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:43.483518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:43.483815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:43.483865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.483870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.483870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.483871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.483872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.483875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.483881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.483884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.483894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.483896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.483901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.483905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.483908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.483911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.483914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.483917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.483919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.483922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.483924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.483927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.483940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:43.492868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:43.494666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:43.494687Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:43.494690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:43.494693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:43.494700Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2148 [1:7556534894699357469:11465]
2025-10-02T08:14:43.494713Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:43.494730Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:43.494739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.494744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.494750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.494765Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:43.494774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:43.494785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:43.494851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.494859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.494862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:43.494864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:43.494932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:43.494941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.494954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.494971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:43.494992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534894699357463:11465]
2025-10-02T08:14:43.494999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534894699357463:11465]
2025-10-02T08:14:43.495010Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:43.495019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:43.495021Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:43.495023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2148
2025-10-02T08:14:43.495028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699357355:11464], now have 1 active actors on pipe
2025-10-02T08:14:43.495037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:43.495139Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2148
2025-10-02T08:14:43.495055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:43.495063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:43.495071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534895158901193:2378], now have 1 active actors on pipe
2025-10-02T08:14:43.495106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.495110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.495121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534894699357463:11465]
2025-10-02T08:14:43.495130Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:43.495135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:43.495154Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3af3b96-bf09548e-662239c5-e837395f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:43.495164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.495167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.495169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:43.495178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.495186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:43.495205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.495267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.495270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.495282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.495317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2149 partition: 0 MaxSeqNo: 17 sessionId: src_id|d3af3b96-bf09548e-662239c5-e837395f_0
2025-10-02T08:14:43.497750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d632f2ab-cb4c4368-50231c0e-935a9d7d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d3af3b96-bf09548e-662239c5-e837395f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:43.500348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3af3b96-bf09548e-662239c5-e837395f_0] Write session: try to update token
2025-10-02T08:14:43.500365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3af3b96-bf09548e-662239c5-e837395f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:43.515021Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:43.515044Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:43.515047Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:43.515056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534894699357463:11465]
2025-10-02T08:14:43.515061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534894699357463:11465]
2025-10-02T08:14:43.515100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:43.515108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.515115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:43.515123Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:43.515130Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:43.515250Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:43.518266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId: src_id|d3af3b96-bf09548e-662239c5-e837395f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:43.520742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:43.555160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534894699357493:12248]
2025-10-02T08:14:43.555281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2148, pipe: [1:7556534894699357493:12248]
2025-10-02T08:14:43.658518Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:43.659263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.659284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.659323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699357493:12248], now have 1 active actors on pipe
2025-10-02T08:14:43.659542Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:43.659667Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:43.660250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3af3b96-bf09548e-662239c5-e837395f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:43.660259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3af3b96-bf09548e-662239c5-e837395f_0] Write session will restart in 0.005132s
2025-10-02T08:14:43.659923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534894699357493:12248]
2025-10-02T08:14:43.659946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:43.659990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2149 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3af3b96-bf09548e-662239c5-e837395f_0
2025-10-02T08:14:43.660110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2149 sessionId: src_id|d3af3b96-bf09548e-662239c5-e837395f_0 is DEAD
2025-10-02T08:14:43.660281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3af3b96-bf09548e-662239c5-e837395f_0] Write session: Do CDS request
2025-10-02T08:14:43.660299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3af3b96-bf09548e-662239c5-e837395f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:43.666286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3af3b96-bf09548e-662239c5-e837395f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.666313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:43.666333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2150
2025-10-02T08:14:43.666501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.666544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:43.666557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:43.666560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:43.666983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2150 sessionId:  describe result for acl check
2025-10-02T08:14:43.667014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:43.667020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:43.667022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:43.667026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534894699357748:11438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:43.667736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534894699357748:11438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:43.670248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534894699357748:11438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:43.673737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534894699357748:11438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:43.673749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534894699357748:11438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:43.673751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534894699357748:11438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:43.673756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:43.683845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:43.685848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:43.686023Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:43.686035Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:43.686044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:43.686093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:43.686126Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534894699358081:11445]
2025-10-02T08:14:43.686751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:43.686965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:43.687008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:43.687289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:43.687320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.687325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.687326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.687327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.687327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.687332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.687339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.687342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.687345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.687348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.687352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.687358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.687362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.687372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.687375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.687379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.687382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.687386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.687390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.687393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.687408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:43.695233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:43.696743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:43.696758Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:43.696760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:43.696763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:43.696767Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2149 [1:7556534894699358081:11445]
2025-10-02T08:14:43.696775Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:43.696788Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:43.696790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.696792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.696793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.696830Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:43.696834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:43.696840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:43.696886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.696894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.696897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:43.696898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:43.696947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:43.696952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.696961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.696968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:43.696982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534894699358063:11445]
2025-10-02T08:14:43.696987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534894699358063:11445]
2025-10-02T08:14:43.696993Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:43.697002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:43.697011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:43.697016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:43.697023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:43.697029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2149
2025-10-02T08:14:43.697033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:43.697043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699357898:11438], now have 1 active actors on pipe
2025-10-02T08:14:43.697046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534895158901226:2378], now have 1 active actors on pipe
2025-10-02T08:14:43.697047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534894699358063:11445]
2025-10-02T08:14:43.697049Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:43.697052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:43.697060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.697066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.697089Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:43.697096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.697099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.697100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:43.697106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.697111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:43.697127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.697117Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2149
2025-10-02T08:14:43.697164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.697169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.697177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.697203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2150 partition: 0 MaxSeqNo: 17 sessionId: src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0
2025-10-02T08:14:43.697502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3af3b96-bf09548e-662239c5-e837395f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:43.700140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0] Write session: try to update token
2025-10-02T08:14:43.700153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:43.713751Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:43.713779Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:43.713781Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:43.713791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534894699358063:11445]
2025-10-02T08:14:43.713795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534894699358063:11445]
2025-10-02T08:14:43.713835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:43.713840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:43.713845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.713846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:43.713847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:43.714079Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:43.714439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId: src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:43.716853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:43.759939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534894699358126:12248]
2025-10-02T08:14:43.760031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2149, pipe: [1:7556534894699358126:12248]
2025-10-02T08:14:43.845098Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:43.845541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.845554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.845584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699358126:12248], now have 1 active actors on pipe
2025-10-02T08:14:43.845690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534894699358126:12248]
2025-10-02T08:14:43.845730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:43.845739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:43.845769Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:43.845795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2150 reason: error at write: Disconnected sessionId: src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0
2025-10-02T08:14:43.845938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2150 sessionId: src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0 is DEAD
2025-10-02T08:14:43.846093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:43.846103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0] Write session will restart in 0.009946s
2025-10-02T08:14:43.846126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0] Write session: Do CDS request
2025-10-02T08:14:43.846135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:43.848869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:43.857250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.857287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:43.857309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2151
2025-10-02T08:14:43.857476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:43.857529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:43.857539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:43.857543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:43.857955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2151 sessionId:  describe result for acl check
2025-10-02T08:14:43.857995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:43.858002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:43.858004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:43.858009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534894699358588:11399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:43.858475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534894699358588:11399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:43.860759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534894699358588:11399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:43.862415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:43.862783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:43.862943Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:43.862951Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:43.862958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:43.862996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:43.863027Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534894699358681:11397]
2025-10-02T08:14:43.863123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534894699358588:11399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:43.863135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534894699358588:11399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:43.863138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534894699358588:11399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:43.863146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:43.863570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:43.863706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:43.863733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:43.863953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:43.863982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.863986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.863987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.863988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.863988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.863991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.863998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.864000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.864002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.864004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.864008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.864012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:43.864015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.864018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:43.864020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.864022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:43.864025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.864027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.864029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.864033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.864043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:43.871679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:43.873316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:43.873333Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:43.873335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:43.873338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:43.873345Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2150 [1:7556534894699358681:11397]
2025-10-02T08:14:43.873356Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:43.873371Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:43.873374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.873377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.873378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.873394Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:43.873398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:43.873404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:43.873461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.873466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.873469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:43.873472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:43.873534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:43.873542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.873554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:43.873564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:43.873584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699358686:11399], now have 1 active actors on pipe
2025-10-02T08:14:43.873591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534894699358675:11397]
2025-10-02T08:14:43.873594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534894699358675:11397]
2025-10-02T08:14:43.873601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2150
2025-10-02T08:14:43.873601Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:43.873610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:43.873611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534895158901244:2378], now have 1 active actors on pipe
2025-10-02T08:14:43.873614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:43.873616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:43.873628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:43.873631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:43.873638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.873642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.873681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534894699358675:11397]
2025-10-02T08:14:43.873694Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:43.873703Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:43.873714Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:43.873725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:43.873728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:43.873711Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2150
2025-10-02T08:14:43.873734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:43.873745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:43.873754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:43.873796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.873842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:43.873849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:43.873862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:43.873914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2151 partition: 0 MaxSeqNo: 17 sessionId: src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0
2025-10-02T08:14:43.874248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dbcbc90-1bf5e60c-10429a7b-4eb4c79e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:43.876844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0] Write session: try to update token
2025-10-02T08:14:43.876860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:43.891643Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:43.891665Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:43.891668Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:43.891677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534894699358675:11397]
2025-10-02T08:14:43.891681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534894699358675:11397]
2025-10-02T08:14:43.891725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:43.891728Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:43.891732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:43.891734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:43.891736Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:43.891873Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:43.894413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId: src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:43.896750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:43.945802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534894699358712:12248]
2025-10-02T08:14:43.947374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2150, pipe: [1:7556534894699358712:12248]
2025-10-02T08:14:44.024100Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:44.024580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.024594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.024633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534894699358712:12248], now have 1 active actors on pipe
2025-10-02T08:14:44.024756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534894699358712:12248]
2025-10-02T08:14:44.024792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:44.024812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:44.024817Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:44.024874Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:44.024891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2151 reason: error at write: Disconnected sessionId: src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0
2025-10-02T08:14:44.025059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2151 sessionId: src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0 is DEAD
2025-10-02T08:14:44.025178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:44.025188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0] Write session will restart in 0.009558s
2025-10-02T08:14:44.025211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0] Write session: Do CDS request
2025-10-02T08:14:44.025217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:44.036261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.036330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:44.036350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2152
2025-10-02T08:14:44.036480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.036534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:44.036544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:44.036548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:44.037016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2152 sessionId:  describe result for acl check
2025-10-02T08:14:44.037057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:44.037064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:44.037065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:44.037071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534898994326442:11358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:44.037601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534898994326442:11358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:44.041703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534898994326442:11358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:44.044647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:44.044898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534898994326442:11358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:44.044900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:44.044909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534898994326442:11358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:44.044912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534898994326442:11358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:44.044918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:44.045215Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:44.045232Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:44.045247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:44.045310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:44.045349Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534898994326568:11378]
2025-10-02T08:14:44.045919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:44.046104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:44.046150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:44.046444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:44.046501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.046507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.046508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.046509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.046510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.046515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.046524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.046528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.046533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.046536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.046542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.046554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.046559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.046564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.046570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.046575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.046584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.046590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.046599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.046603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.046619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:44.054424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:44.055899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:44.055919Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:44.055922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:44.055926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:44.055934Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2151 [1:7556534898994326568:11378]
2025-10-02T08:14:44.055942Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:44.055957Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:44.055960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.055962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.055963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.055976Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:44.055980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:44.055985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:44.056035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.056041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.056043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:44.056045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:44.056108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:44.056116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.056129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.056149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:44.056162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2151
2025-10-02T08:14:44.056168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994326564:11358], now have 1 active actors on pipe
2025-10-02T08:14:44.056174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534898994326556:11378]
2025-10-02T08:14:44.056176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534898994326556:11378]
2025-10-02T08:14:44.056182Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:44.056203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:44.056204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.056206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:44.056209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.056228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:44.056248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:44.056255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:44.056260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534899453868545:2378], now have 1 active actors on pipe
2025-10-02T08:14:44.056301Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:44.056311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.056314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.056315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:44.056322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.056299Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2151
2025-10-02T08:14:44.056329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:44.056337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534898994326556:11378]
2025-10-02T08:14:44.056340Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:44.056344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:44.056356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.056398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.056405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.056419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.056461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2152 partition: 0 MaxSeqNo: 17 sessionId: src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0
2025-10-02T08:14:44.056787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97c3ada-900df832-58e4df1d-8222d0f8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:44.059302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0] Write session: try to update token
2025-10-02T08:14:44.059316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:44.073774Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:44.073799Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:44.073801Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:44.073810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534898994326556:11378]
2025-10-02T08:14:44.073815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534898994326556:11378]
2025-10-02T08:14:44.073855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:44.073859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:44.073860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:44.073869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.074021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:44.074166Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:44.076848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId: src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:44.079420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:44.124999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534898994326595:12248]
2025-10-02T08:14:44.125089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2151, pipe: [1:7556534898994326595:12248]
2025-10-02T08:14:44.207655Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:44.208029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.208038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.208075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994326595:12248], now have 1 active actors on pipe
2025-10-02T08:14:44.208512Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:44.208640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:44.208651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0] Write session will restart in 0.005806s
2025-10-02T08:14:44.208257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534898994326595:12248]
2025-10-02T08:14:44.208294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:44.208297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:44.208308Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:44.208359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2152 reason: error at write: Disconnected sessionId: src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0
2025-10-02T08:14:44.208509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2152 sessionId: src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0 is DEAD
2025-10-02T08:14:44.208675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0] Write session: Do CDS request
2025-10-02T08:14:44.208693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:44.215308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.217085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:44.217103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2153
2025-10-02T08:14:44.217213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.217243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:44.217252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:44.217259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:44.217652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2153 sessionId:  describe result for acl check
2025-10-02T08:14:44.217681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:44.217687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:44.217688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:44.217693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534898994326616:11370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:44.218183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534898994326616:11370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:44.219947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534898994326616:11370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:44.224392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534898994326616:11370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:44.224408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534898994326616:11370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:44.224411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534898994326616:11370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:44.224418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:44.231108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:44.232815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:44.233068Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:44.233080Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:44.233090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:44.233139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:44.233176Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534898994327157:11371]
2025-10-02T08:14:44.233815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:44.233976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:44.234015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:44.234315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:44.234355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.234363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.234364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.234365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.234366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.234371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.234381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.234389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.234397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.234402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.234411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.234422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.234432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.234441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.234449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.234458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.234467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.234476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.234484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.234493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.234516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:44.243130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:44.245033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:44.245053Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:44.245056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:44.245060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:44.245065Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2152 [1:7556534898994327157:11371]
2025-10-02T08:14:44.245076Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:44.245092Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:44.245095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.245098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.245100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.245114Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:44.245119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:44.245127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:44.245182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.245191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.245195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:44.245197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:44.245260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:44.245270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.245283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.245295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:44.245313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534899453868553:2378], now have 1 active actors on pipe
2025-10-02T08:14:44.245320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534898994327151:11371]
2025-10-02T08:14:44.245322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534898994327151:11371]
2025-10-02T08:14:44.245329Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:44.245340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:44.245340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:44.245355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:44.245355Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:44.245357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:44.245360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2152
2025-10-02T08:14:44.245365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994326963:11370], now have 1 active actors on pipe
2025-10-02T08:14:44.245393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534898994327151:11371]
2025-10-02T08:14:44.245404Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:44.245411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.245415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.245422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:44.245454Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:44.245461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.245464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.245465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:44.245473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.245480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:44.245500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.245542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.245544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.245554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.245592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2153 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0
2025-10-02T08:14:44.245890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f83844be-a70ccddd-56b25518-2c8b2e23_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:44.248601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0] Write session: try to update token
2025-10-02T08:14:44.248618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:44.248891Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2152
2025-10-02T08:14:44.262621Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:44.262645Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:44.262647Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:44.262655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534898994327151:11371]
2025-10-02T08:14:44.262660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534898994327151:11371]
2025-10-02T08:14:44.262700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:44.262704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:44.262707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.262709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:44.262710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:44.262843Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:44.273793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId: src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:44.276179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:44.308870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534898994327182:12248]
2025-10-02T08:14:44.309073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2152, pipe: [1:7556534898994327182:12248]
2025-10-02T08:14:44.408422Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:44.408707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.408720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.408738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994327182:12248], now have 1 active actors on pipe
2025-10-02T08:14:44.408871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534898994327182:12248]
2025-10-02T08:14:44.408894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:44.408896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:44.408945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2153 reason: error at write: Disconnected sessionId: src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0
2025-10-02T08:14:44.408951Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:44.409025Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:44.409085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2153 sessionId: src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0 is DEAD
2025-10-02T08:14:44.409220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:44.409229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0] Write session will restart in 0.007599s
2025-10-02T08:14:44.409255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0] Write session: Do CDS request
2025-10-02T08:14:44.409262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:44.418312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.418383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:44.418401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2154
2025-10-02T08:14:44.418542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.418587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:44.418596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:44.418599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:44.419001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2154 sessionId:  describe result for acl check
2025-10-02T08:14:44.419035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:44.419037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:44.419039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:44.419044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534898994327576:11366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:44.419531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534898994327576:11366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:44.421784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534898994327576:11366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:44.424906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534898994327576:11366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:44.424924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534898994327576:11366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:44.424928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534898994327576:11366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:44.424935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:44.424977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:44.426089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:44.426244Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:44.426254Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:44.426262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:44.426301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:44.426335Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534898994327748:11365]
2025-10-02T08:14:44.426959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:44.427159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:44.427200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:44.427541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:44.427592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.427598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.427599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.427599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.427600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.427604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.427610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.427613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.427617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.427620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.427626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.427633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.427639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.427644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.427648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.427651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.427653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.427655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.427658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.427662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.427678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:44.435312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:44.436627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:44.436643Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:44.436645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:44.436648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:44.436653Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2153 [1:7556534898994327748:11365]
2025-10-02T08:14:44.436661Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:44.436675Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:44.436676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.436678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.436680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.436691Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:44.436694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:44.436701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:44.436743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.436750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.436754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:44.436756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:44.436825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:44.436832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.436840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.436847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:44.436861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534898994327734:11365]
2025-10-02T08:14:44.436866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534898994327734:11365]
2025-10-02T08:14:44.436872Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:44.436881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:44.436882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994327739:11366], now have 1 active actors on pipe
2025-10-02T08:14:44.436888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:44.436892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2153
2025-10-02T08:14:44.436895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:44.436898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:44.436900Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:44.436903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534899453868560:2378], now have 1 active actors on pipe
2025-10-02T08:14:44.436924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534898994327734:11365]
2025-10-02T08:14:44.436931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:44.436936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.436937Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:44.436939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.436967Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f5521e7-b3752930-728d1448-1f64fb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:44.436971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.436974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.436976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:44.436986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.436961Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2153
2025-10-02T08:14:44.436998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:44.437025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.437060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.437066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.437074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.437103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2154 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f5521e7-b3752930-728d1448-1f64fb6_0
2025-10-02T08:14:44.437371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f8b8ef6-688c45a-ae6f1466-100ac457_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f5521e7-b3752930-728d1448-1f64fb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:44.439609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5521e7-b3752930-728d1448-1f64fb6_0] Write session: try to update token
2025-10-02T08:14:44.439620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5521e7-b3752930-728d1448-1f64fb6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:44.452179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId: src_id|3f5521e7-b3752930-728d1448-1f64fb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:44.453827Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:44.453844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:44.453847Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:44.453854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534898994327734:11365]
2025-10-02T08:14:44.453858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534898994327734:11365]
2025-10-02T08:14:44.453895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:44.453901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:44.453905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.453907Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:44.453907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:44.454038Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:44.454624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:44.508996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534898994327773:12248]
2025-10-02T08:14:44.509106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2153, pipe: [1:7556534898994327773:12248]
2025-10-02T08:14:44.584168Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:44.584750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.584768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.584820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994327773:12248], now have 1 active actors on pipe
2025-10-02T08:14:44.584953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534898994327773:12248]
2025-10-02T08:14:44.584973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:44.584975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:44.584998Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:44.585022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2154 reason: error at write: Disconnected sessionId: src_id|3f5521e7-b3752930-728d1448-1f64fb6_0
2025-10-02T08:14:44.585046Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:44.585170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2154 sessionId: src_id|3f5521e7-b3752930-728d1448-1f64fb6_0 is DEAD
2025-10-02T08:14:44.585328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5521e7-b3752930-728d1448-1f64fb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:44.585337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5521e7-b3752930-728d1448-1f64fb6_0] Write session will restart in 0.007016s
2025-10-02T08:14:44.585361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5521e7-b3752930-728d1448-1f64fb6_0] Write session: Do CDS request
2025-10-02T08:14:44.585367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5521e7-b3752930-728d1448-1f64fb6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:44.593225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5521e7-b3752930-728d1448-1f64fb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.593274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:44.593296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2155
2025-10-02T08:14:44.593416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.593444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:44.593450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:44.593453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:44.593884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2155 sessionId:  describe result for acl check
2025-10-02T08:14:44.593915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:44.593920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:44.593921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:44.593925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534898994328192:11329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:44.594355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534898994328192:11329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:44.597028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534898994328192:11329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:44.598373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:44.599765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:44.599899Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:44.599916Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:44.599924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:44.599965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:44.599999Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534898994328346:11339]
2025-10-02T08:14:44.600134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534898994328192:11329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:44.600148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534898994328192:11329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:44.600151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534898994328192:11329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:44.600158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:44.600430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:44.600563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:44.600597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:44.600866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:44.600909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.600914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.600915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.600916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.600917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.600922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.600931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.600935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.600938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.600942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.600946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.600956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.600965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.600970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.600974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.600982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.600987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.600995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.601001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.601009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.601027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:44.608707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:44.610304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:44.610322Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:44.610325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:44.610329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:44.610335Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2154 [1:7556534898994328346:11339]
2025-10-02T08:14:44.610346Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:44.610362Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:44.610365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.610368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.610370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.610386Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:44.610391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:44.610399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:44.610459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.610468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.610471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:44.610474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:44.610539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:44.610547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.610560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.610577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:44.610585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2154
2025-10-02T08:14:44.610598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994328351:11329], now have 1 active actors on pipe
2025-10-02T08:14:44.610606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534899453868566:2378], now have 1 active actors on pipe
2025-10-02T08:14:44.610611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534898994328340:11339]
2025-10-02T08:14:44.610618Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534898994328340:11339]
2025-10-02T08:14:44.610630Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:44.610645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.610645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:44.610648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:44.610654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.610671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:44.610689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:44.610697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:44.610681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2154
2025-10-02T08:14:44.610734Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:44.610744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.610748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.610749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:44.610759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.610771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:44.610783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534898994328340:11339]
2025-10-02T08:14:44.610796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:44.610804Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:44.610825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.610864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.610871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.610885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.610922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2155 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0
2025-10-02T08:14:44.611186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5521e7-b3752930-728d1448-1f64fb6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:44.613518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0] Write session: try to update token
2025-10-02T08:14:44.613531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:44.625142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId: src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:44.627289Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:44.627311Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:44.627313Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:44.627320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534898994328340:11339]
2025-10-02T08:14:44.627324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534898994328340:11339]
2025-10-02T08:14:44.627354Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:44.627356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:44.627362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.627365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:44.627378Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:44.627493Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:44.627754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:44.685150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534898994328379:12248]
2025-10-02T08:14:44.685252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2154, pipe: [1:7556534898994328379:12248]
2025-10-02T08:14:44.761579Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:44.761917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.761927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.761957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994328379:12248], now have 1 active actors on pipe
2025-10-02T08:14:44.762572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534898994328379:12248]
2025-10-02T08:14:44.762595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:44.762597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:44.762624Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:44.762661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2155 reason: error at write: Disconnected sessionId: src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0
2025-10-02T08:14:44.762778Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:44.762845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2155 sessionId: src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0 is DEAD
2025-10-02T08:14:44.762976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:44.762986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0] Write session will restart in 0.005137s
2025-10-02T08:14:44.763010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0] Write session: Do CDS request
2025-10-02T08:14:44.763016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:44.769207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.769289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:44.769308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2156
2025-10-02T08:14:44.769420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.769450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:44.769460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:44.769463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:44.769819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2156 sessionId:  describe result for acl check
2025-10-02T08:14:44.769852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:44.769858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:44.769860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:44.769864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534898994328671:11302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:44.770372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534898994328671:11302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:44.772498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534898994328671:11302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:44.775827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534898994328671:11302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:44.775845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534898994328671:11302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:44.775848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534898994328671:11302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:44.775855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:44.781049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:44.781495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:44.781818Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:44.781827Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:44.781835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:44.781892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:44.781928Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534898994328995:11307]
2025-10-02T08:14:44.782329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:44.782509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:44.782538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:44.782733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:44.782760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.782761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.782762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.782762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.782763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.782766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.782772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.782774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.782777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.782778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.782783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.782788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.782791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.782794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.782796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.782799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.782802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.782805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.782807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.782809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.782821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:44.790789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:44.792362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:44.792384Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:44.792387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:44.792391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:44.792398Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2155 [1:7556534898994328995:11307]
2025-10-02T08:14:44.792409Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:44.792426Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:44.792429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.792432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.792434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.792449Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:44.792455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:44.792462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:44.792526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.792528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.792531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:44.792534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:44.792604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:44.792607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.792621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.792633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:44.792650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2155
2025-10-02T08:14:44.792651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994328912:11302], now have 1 active actors on pipe
2025-10-02T08:14:44.792658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534898994328989:11307]
2025-10-02T08:14:44.792660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534898994328989:11307]
2025-10-02T08:14:44.792667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:44.792677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.792681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.792683Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:44.792686Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:44.792702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:44.792714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:44.792717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:44.792722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534899453868608:2378], now have 1 active actors on pipe
2025-10-02T08:14:44.792762Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a6dab3-458643b4-9d93792-3557a191_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:44.792780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.792784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.792791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:44.792818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.792833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:44.792842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534898994328989:11307]
2025-10-02T08:14:44.792856Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:44.792856Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2155
2025-10-02T08:14:44.792869Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:44.792882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.792959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.792973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.792997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.793037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2156 partition: 0 MaxSeqNo: 17 sessionId: src_id|3a6dab3-458643b4-9d93792-3557a191_0
2025-10-02T08:14:44.793400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3b0f2-6f3311b7-2b7745c5-67e1fddc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3a6dab3-458643b4-9d93792-3557a191_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:44.795892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6dab3-458643b4-9d93792-3557a191_0] Write session: try to update token
2025-10-02T08:14:44.795904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6dab3-458643b4-9d93792-3557a191_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:44.808990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId: src_id|3a6dab3-458643b4-9d93792-3557a191_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:44.810082Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:44.810102Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:44.810104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:44.810113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534898994328989:11307]
2025-10-02T08:14:44.810118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534898994328989:11307]
2025-10-02T08:14:44.810164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:44.810175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.810177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:44.810314Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:44.811350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:44.811434Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:44.811451Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:44.862798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534898994329023:12248]
2025-10-02T08:14:44.862924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2155, pipe: [1:7556534898994329023:12248]
2025-10-02T08:14:44.950261Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:44.950791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.950805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.950843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994329023:12248], now have 1 active actors on pipe
2025-10-02T08:14:44.951119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534898994329023:12248]
2025-10-02T08:14:44.951149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:44.951152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:44.951184Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:44.951212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2156 reason: error at write: Disconnected sessionId: src_id|3a6dab3-458643b4-9d93792-3557a191_0
2025-10-02T08:14:44.951379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2156 sessionId: src_id|3a6dab3-458643b4-9d93792-3557a191_0 is DEAD
2025-10-02T08:14:44.951476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6dab3-458643b4-9d93792-3557a191_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:44.951485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6dab3-458643b4-9d93792-3557a191_0] Write session will restart in 0.008656s
2025-10-02T08:14:44.951508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6dab3-458643b4-9d93792-3557a191_0] Write session: Do CDS request
2025-10-02T08:14:44.951517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6dab3-458643b4-9d93792-3557a191_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:44.951760Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:44.961356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6dab3-458643b4-9d93792-3557a191_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.961533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:44.961558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2157
2025-10-02T08:14:44.961670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:44.961699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:44.961708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:44.961711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:44.962067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2157 sessionId:  describe result for acl check
2025-10-02T08:14:44.962100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:44.962106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:44.962109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:44.962114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534898994329320:11286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:44.962672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534898994329320:11286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:44.965276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534898994329320:11286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:44.968452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534898994329320:11286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:44.968472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534898994329320:11286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:44.968475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534898994329320:11286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:44.968482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:44.971203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:44.972681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:44.972872Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:44.972883Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:44.972893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:44.972939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:44.972974Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534898994329593:11292]
2025-10-02T08:14:44.973574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:44.973819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:44.973859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:44.974148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:44.974189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.974194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.974196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.974197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.974198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.974203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.974213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.974217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.974221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.974225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.974232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.974243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:44.974248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.974253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:44.974257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.974262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:44.974267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.974277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.974281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.974286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.974310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:44.989400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:44.990994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:44.991010Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:44.991012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:44.991015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:44.991021Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2156 [1:7556534898994329593:11292]
2025-10-02T08:14:44.991032Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:44.991054Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:44.991057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.991060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.991063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.991075Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:44.991079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:44.991085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:44.991133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.991139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.991141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:44.991143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:44.991207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:44.991215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:44.991229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:44.991244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:44.991265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534898994329587:11292]
2025-10-02T08:14:44.991273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534898994329587:11292]
2025-10-02T08:14:44.991287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2156
2025-10-02T08:14:44.991290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:44.991293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:44.991280Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:44.991337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534898994329551:11286], now have 1 active actors on pipe
2025-10-02T08:14:44.991346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:44.991358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:44.991361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:44.991366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534899453868615:2378], now have 1 active actors on pipe
2025-10-02T08:14:44.991370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.991374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.991413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534898994329587:11292]
2025-10-02T08:14:44.991421Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:44.991433Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:44.991436Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:44.991442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:44.991395Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2156
2025-10-02T08:14:44.991452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:44.991454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:44.991462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:44.991470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:44.991504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.991586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:44.991594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:44.991607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:44.991644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2157 partition: 0 MaxSeqNo: 17 sessionId: src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0
2025-10-02T08:14:44.991987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6dab3-458643b4-9d93792-3557a191_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:44.994602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0] Write session: try to update token
2025-10-02T08:14:44.994625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:45.012169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId: src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:45.014595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:45.014853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.014885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.014905Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:45.014908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:45.014910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:45.014918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534898994329587:11292]
2025-10-02T08:14:45.014922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534898994329587:11292]
2025-10-02T08:14:45.014966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:45.014976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:45.014982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:45.014982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.014985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:45.015128Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:45.050701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534903289296916:12248]
2025-10-02T08:14:45.050876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2156, pipe: [1:7556534903289296916:12248]
2025-10-02T08:14:45.156083Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:45.156668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:45.156704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:45.156728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289296916:12248], now have 1 active actors on pipe
2025-10-02T08:14:45.156818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534903289296916:12248]
2025-10-02T08:14:45.156880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:45.156886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:45.156904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2157 reason: error at write: Disconnected sessionId: src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0
2025-10-02T08:14:45.156911Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:45.157037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2157 sessionId: src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0 is DEAD
2025-10-02T08:14:45.157164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:45.157172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0] Write session will restart in 0.009374s
2025-10-02T08:14:45.157195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0] Write session: Do CDS request
2025-10-02T08:14:45.157204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:45.167286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.167368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:45.167386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2158
2025-10-02T08:14:45.167510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.167550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:45.167560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:45.167563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:45.167941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2158 sessionId:  describe result for acl check
2025-10-02T08:14:45.167977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:45.167983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:45.167984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:45.167989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534903289297316:11262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:45.168586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534903289297316:11262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:45.171898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534903289297316:11262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:45.173809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:45.175285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:45.175465Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:45.175482Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:45.175493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:45.175572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:45.175612Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534903289297482:11260]
2025-10-02T08:14:45.175660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534903289297316:11262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:45.175676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534903289297316:11262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:45.175679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534903289297316:11262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:45.175687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:45.176173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:45.176349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:45.176390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:45.176637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:45.176669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.176673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.176674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.176675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.176675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.176679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.176686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.176688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.176690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.176692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.176695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.176700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.176703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.176706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.176708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.176711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.176713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.176717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.176719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.176722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.176732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:45.184843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:45.186549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:45.186572Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:45.186574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:45.186577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:45.186584Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2157 [1:7556534903289297482:11260]
2025-10-02T08:14:45.186595Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:45.186611Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:45.186621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.186624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.186626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.186652Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:45.186663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:45.186674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:45.186740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.186748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.186751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:45.186754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:45.186819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:45.186829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.186842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.186854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:45.186871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534903289297476:11260]
2025-10-02T08:14:45.186873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534903289297476:11260]
2025-10-02T08:14:45.186881Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:45.186895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289297487:11262], now have 1 active actors on pipe
2025-10-02T08:14:45.186898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2157
2025-10-02T08:14:45.186901Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:45.186903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:45.186904Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:45.186915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:45.186918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:45.186924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534903748835918:2378], now have 1 active actors on pipe
2025-10-02T08:14:45.186952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.186961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.186973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534903289297476:11260]
2025-10-02T08:14:45.186985Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:45.187000Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:45.187010Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:45.187015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.187020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.187021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:45.187030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.187038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:45.187020Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2157
2025-10-02T08:14:45.187059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.187132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.187137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.187150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.187183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2158 partition: 0 MaxSeqNo: 17 sessionId: src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0
2025-10-02T08:14:45.187495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4db59-fd489b19-e59bde80-48a1de83_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:45.190177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0] Write session: try to update token
2025-10-02T08:14:45.190191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:45.203929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId: src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:45.204994Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:45.205012Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:45.205014Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:45.205024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534903289297476:11260]
2025-10-02T08:14:45.205028Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534903289297476:11260]
2025-10-02T08:14:45.205062Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:45.205068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:45.205070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:45.205076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.205078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:45.205215Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:45.207502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:45.257054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534903289297513:12248]
2025-10-02T08:14:45.257192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2157, pipe: [1:7556534903289297513:12248]
2025-10-02T08:14:45.346058Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:45.346410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.346421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.346452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289297513:12248], now have 1 active actors on pipe
2025-10-02T08:14:45.346639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534903289297513:12248]
2025-10-02T08:14:45.346660Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:45.346669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:45.346672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:45.346688Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:45.346734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2158 reason: error at write: Disconnected sessionId: src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0
2025-10-02T08:14:45.347024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:45.347046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0] Write session will restart in 0.008357s
2025-10-02T08:14:45.347070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0] Write session: Do CDS request
2025-10-02T08:14:45.347077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:45.346888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2158 sessionId: src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0 is DEAD
2025-10-02T08:14:45.356283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.356328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:45.356348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2159
2025-10-02T08:14:45.356483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.356513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:45.356522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:45.356529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:45.357154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2159 sessionId:  describe result for acl check
2025-10-02T08:14:45.357204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:45.357211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:45.357213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:45.357218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534903289297895:11251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:45.357741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534903289297895:11251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:45.360666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534903289297895:11251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:45.363424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:45.363853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534903289297895:11251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:45.363870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534903289297895:11251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:45.363873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534903289297895:11251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:45.363881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:45.364943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:45.365124Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:45.365134Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:45.365143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:45.365333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:45.365372Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534903289298088:11246]
2025-10-02T08:14:45.366024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:45.366194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:45.366234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:45.366536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:45.366578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.366584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.366585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.366587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.366588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.366592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.366603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.366607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.366611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.366615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.366620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.366628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.366638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.366645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.366650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.366655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.366659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.366665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.366674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.366679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.366699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:45.374928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:45.376409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:45.376427Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:45.376430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:45.376433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:45.376440Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2158 [1:7556534903289298088:11246]
2025-10-02T08:14:45.376450Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:45.376466Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:45.376469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.376472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.376474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.376489Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:45.376499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:45.376504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:45.376562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.376570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.376573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:45.376576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:45.376644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:45.376652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.376664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.376678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:45.376705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534903289298076:11246]
2025-10-02T08:14:45.376712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534903289298076:11246]
2025-10-02T08:14:45.376721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:45.376731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:45.376735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:45.376742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:45.376748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:45.376751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:45.376760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289298084:11251], now have 1 active actors on pipe
2025-10-02T08:14:45.376767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2158
2025-10-02T08:14:45.376769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534903748835926:2378], now have 1 active actors on pipe
2025-10-02T08:14:45.376817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.376827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.376840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534903289298076:11246]
2025-10-02T08:14:45.376852Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:45.376858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:45.376882Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:45.376893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.376855Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2158
2025-10-02T08:14:45.376898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.376900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:45.376909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.376918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:45.376947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.377017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.377023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.377035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.377073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2159 partition: 0 MaxSeqNo: 17 sessionId: src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0
2025-10-02T08:14:45.377366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1781d2-a8515efe-7e7a94d1-5df6eab3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:45.379937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0] Write session: try to update token
2025-10-02T08:14:45.379953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:45.394116Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:45.394140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:45.394142Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:45.394150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534903289298076:11246]
2025-10-02T08:14:45.394155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534903289298076:11246]
2025-10-02T08:14:45.394196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:45.394203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.394205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:45.394204Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:45.394211Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:45.394347Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:45.394856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId: src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:45.397213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:45.447009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534903289298115:12248]
2025-10-02T08:14:45.447134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2158, pipe: [1:7556534903289298115:12248]
2025-10-02T08:14:45.527357Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:45.527704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.527719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.527752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289298115:12248], now have 1 active actors on pipe
2025-10-02T08:14:45.527855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:45.527873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:45.527907Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:45.527951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2159 reason: error at write: Disconnected sessionId: src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0
2025-10-02T08:14:45.527985Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:45.528133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2159 sessionId: src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0 is DEAD
2025-10-02T08:14:45.528216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534903289298115:12248]
2025-10-02T08:14:45.528275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:45.528282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0] Write session will restart in 0.008890s
2025-10-02T08:14:45.528302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0] Write session: Do CDS request
2025-10-02T08:14:45.528307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:45.538258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.538304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:45.538323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2160
2025-10-02T08:14:45.538463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.538502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:45.538512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:45.538515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:45.538967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2160 sessionId:  describe result for acl check
2025-10-02T08:14:45.538998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:45.539004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:45.539006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:45.539011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534903289298550:11241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:45.539540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534903289298550:11241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:45.542074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534903289298550:11241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:45.544507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534903289298550:11241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:45.544522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534903289298550:11241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:45.544524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534903289298550:11241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:45.544531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:45.545911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:45.546224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:45.546365Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:45.546374Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:45.546383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:45.546428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:45.546465Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534903289298691:11244]
2025-10-02T08:14:45.547036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:45.547200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:45.547236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:45.547501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:45.547539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.547544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.547546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.547547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.547548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.547552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.547561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.547570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.547573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.547580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.547586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.547597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.547603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.547612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.547616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.547620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.547628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.547633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.547637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.547641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.547657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:45.555819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:45.557490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:45.557511Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:45.557514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:45.557518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:45.557524Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2159 [1:7556534903289298691:11244]
2025-10-02T08:14:45.557536Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:45.557552Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:45.557555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.557564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.557566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.557583Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:45.557588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:45.557599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:45.557659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.557667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.557670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:45.557672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:45.557739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:45.557747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.557762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.557779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:45.557799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534903289298685:11244]
2025-10-02T08:14:45.557805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534903289298685:11244]
2025-10-02T08:14:45.557813Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:45.557825Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:45.557826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2159
2025-10-02T08:14:45.557831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289298682:11241], now have 1 active actors on pipe
2025-10-02T08:14:45.557836Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:45.557838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:45.557852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:45.557863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:45.557868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534903748835933:2378], now have 1 active actors on pipe
2025-10-02T08:14:45.557899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.557909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.557922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534903289298685:11244]
2025-10-02T08:14:45.557931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:45.557933Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:45.557913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2159
2025-10-02T08:14:45.557956Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:45.557966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.557971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.557977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:45.557986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.557994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:45.558029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.558070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.558077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.558090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.558129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2160 partition: 0 MaxSeqNo: 17 sessionId: src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0
2025-10-02T08:14:45.558413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43abb8fb-62dafbb6-62db8161-5e1d96ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:45.561046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0] Write session: try to update token
2025-10-02T08:14:45.561060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:45.575281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId: src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:45.576982Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:45.577000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:45.577002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:45.577009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534903289298685:11244]
2025-10-02T08:14:45.577014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534903289298685:11244]
2025-10-02T08:14:45.577057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:45.577059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:45.577064Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:45.577068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.577070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:45.577209Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:45.577880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:45.628239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534903289298716:12248]
2025-10-02T08:14:45.628605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2159, pipe: [1:7556534903289298716:12248]
2025-10-02T08:14:45.713015Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:45.713311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.713324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.713355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289298716:12248], now have 1 active actors on pipe
2025-10-02T08:14:45.713445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534903289298716:12248]
2025-10-02T08:14:45.713461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:45.713462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:45.713502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2160 reason: error at write: Disconnected sessionId: src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0
2025-10-02T08:14:45.713590Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:45.713635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2160 sessionId: src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0 is DEAD
2025-10-02T08:14:45.713630Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:45.713778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:45.713788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0] Write session will restart in 0.007017s
2025-10-02T08:14:45.713814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0] Write session: Do CDS request
2025-10-02T08:14:45.713820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:45.722273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.722381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:45.722399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2161
2025-10-02T08:14:45.722541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.722571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:45.722579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:45.722583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:45.723190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2161 sessionId:  describe result for acl check
2025-10-02T08:14:45.723225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:45.723239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:45.723245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:45.723251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534903289299065:11234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:45.723732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534903289299065:11234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:45.726368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534903289299065:11234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:45.730476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534903289299065:11234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:45.730491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534903289299065:11234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:45.730494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534903289299065:11234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:45.730500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:45.731859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:45.733289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:45.733479Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:45.733490Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:45.733499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:45.733544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:45.733592Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534903289299300:11235]
2025-10-02T08:14:45.734221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:45.734647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:45.734689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:45.735003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:45.735042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.735048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.735049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.735050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.735051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.735056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.735065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.735074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.735082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.735091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.735096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.735103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.735113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.735123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.735131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.735140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.735149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.735157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.735164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.735173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.735195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:45.743122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:45.744706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:45.744722Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:45.744723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:45.744726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:45.744730Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2160 [1:7556534903289299300:11235]
2025-10-02T08:14:45.744741Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:45.744755Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:45.744758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.744760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.744762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.744777Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:45.744784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:45.744789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:45.744861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.744868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.744870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:45.744873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:45.744925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:45.744930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.744938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.744945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:45.744960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534903289299293:11235]
2025-10-02T08:14:45.744965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534903289299293:11235]
2025-10-02T08:14:45.744972Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:45.744991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289299278:11234], now have 1 active actors on pipe
2025-10-02T08:14:45.744993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:45.744996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:45.744997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:45.745009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:45.745012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:45.745044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534903748835952:2378], now have 1 active actors on pipe
2025-10-02T08:14:45.745051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534903289299293:11235]
2025-10-02T08:14:45.745058Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:45.745072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:45.745102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2160
2025-10-02T08:14:45.745128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.745135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.745157Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:45.745167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.745174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.745176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:45.745184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.745192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:45.745205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.745237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.745242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.745254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.745282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2161 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0
2025-10-02T08:14:45.745513Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2160
2025-10-02T08:14:45.745579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bf6d77-7bf4fc7b-9beba334-3517f303_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:45.748027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0] Write session: try to update token
2025-10-02T08:14:45.748041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:45.760788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId: src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:45.763377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:45.763453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.763464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.765063Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:45.765082Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:45.765085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:45.765092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534903289299293:11235]
2025-10-02T08:14:45.765096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534903289299293:11235]
2025-10-02T08:14:45.765140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:45.765143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:45.765149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:45.765156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:45.765161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.765167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:45.765296Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:45.770785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:45.813581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534903289299374:12248]
2025-10-02T08:14:45.813705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2160, pipe: [1:7556534903289299374:12248]
2025-10-02T08:14:45.901608Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:45.901912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.901923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.902061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.902127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.902187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.902256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.902304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.902312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.902387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.902447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.902504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.902563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.902602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.902608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.902666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.902717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.902771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.902824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.902865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.902871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.902936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.903006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.903074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.903138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.903179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.903184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.903246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.903300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.903369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.903432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.903473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.903482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.903543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.903606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.903669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.903731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.903770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.903776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.903834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.903888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.903946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.904006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.904045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.904053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.904111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.904171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.904240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.904297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.904338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.904343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.904403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.904458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.904513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.904568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.904606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.904611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.904675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:45.904728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:45.904785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:45.904858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:45.904899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:45.904904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:45.904960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289299374:12248], now have 1 active actors on pipe
2025-10-02T08:14:45.905093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:45.905106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:45.905136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2161 reason: error at write: Disconnected sessionId: src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0
2025-10-02T08:14:45.905269Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:45.905262Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:45.905316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2161 sessionId: src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0 is DEAD
2025-10-02T08:14:45.905460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:45.905466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0] Write session will restart in 0.006359s
2025-10-02T08:14:45.905486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0] Write session: Do CDS request
2025-10-02T08:14:45.905493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:45.905495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534903289299374:12248]
2025-10-02T08:14:45.913275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.913306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:45.913324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2162
2025-10-02T08:14:45.913468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:45.913498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:45.913507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:45.913510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:45.913900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2162 sessionId:  describe result for acl check
2025-10-02T08:14:45.913931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:45.913936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:45.913938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:45.913942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534903289299671:11179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:45.914417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534903289299671:11179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:45.916744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534903289299671:11179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:45.920368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534903289299671:11179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:45.920384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534903289299671:11179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:45.920387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534903289299671:11179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:45.920395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:45.923585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:45.925202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:45.925377Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:45.925388Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:45.925398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:45.925443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:45.925639Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534903289299955:11195]
2025-10-02T08:14:45.926150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:45.926321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:45.926364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:45.926646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:45.926699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.926706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.926707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.926709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.926710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.926715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.926726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.926730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.926735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.926739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.926744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.926752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:45.926758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.926764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:45.926768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.926774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:45.926778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.926784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.926793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.926799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.926819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:45.934888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:45.936212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:45.936228Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:45.936230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:45.936233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:45.936238Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2161 [1:7556534903289299955:11195]
2025-10-02T08:14:45.936246Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:45.936262Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:45.936264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.936266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.936268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.936280Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:45.936283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:45.936290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:45.936342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.936350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.936353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:45.936356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:45.936407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:45.936412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.936422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:45.936429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:45.936440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534903289299949:11195]
2025-10-02T08:14:45.936445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534903289299949:11195]
2025-10-02T08:14:45.936451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:45.936460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:45.936468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:45.936472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:45.936476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:45.936479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:45.936496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2161
2025-10-02T08:14:45.936514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534903289299904:11179], now have 1 active actors on pipe
2025-10-02T08:14:45.936522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534903748835982:2378], now have 1 active actors on pipe
2025-10-02T08:14:45.936525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534903289299949:11195]
2025-10-02T08:14:45.936532Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:45.936538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.936538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:45.936546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.936582Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:45.936591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:45.936594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:45.936595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:45.936602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:45.936577Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2161
2025-10-02T08:14:45.936609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:45.936629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.936669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:45.936675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:45.936686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:45.936725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2162 partition: 0 MaxSeqNo: 17 sessionId: src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0
2025-10-02T08:14:45.937116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a0af34c-5c0a3776-b23e8ed5-10f74dcd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:45.939573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0] Write session: try to update token
2025-10-02T08:14:45.939588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:45.953290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId: src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:45.954297Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:45.954319Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:45.954322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:45.954331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534903289299949:11195]
2025-10-02T08:14:45.954335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534903289299949:11195]
2025-10-02T08:14:45.954377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:45.954389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:45.954391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:45.954416Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:45.954429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:45.954523Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:45.955870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:46.005583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534907584267276:12248]
2025-10-02T08:14:46.005693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2161, pipe: [1:7556534907584267276:12248]
2025-10-02T08:14:46.096375Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:46.096821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.096835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.096870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584267276:12248], now have 1 active actors on pipe
2025-10-02T08:14:46.096972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:46.096978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:46.097025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2162 reason: error at write: Disconnected sessionId: src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0
2025-10-02T08:14:46.097122Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:46.097187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2162 sessionId: src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0 is DEAD
2025-10-02T08:14:46.097196Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:46.097323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:46.097333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0] Write session will restart in 0.008563s
2025-10-02T08:14:46.097354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0] Write session: Do CDS request
2025-10-02T08:14:46.097360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:46.097444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534907584267276:12248]
2025-10-02T08:14:46.107248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.107293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:46.107310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2163
2025-10-02T08:14:46.107433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.107462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:46.107470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:46.107474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:46.107842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2163 sessionId:  describe result for acl check
2025-10-02T08:14:46.107877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:46.107883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:46.107884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:46.107889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534907584267702:11176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:46.108380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534907584267702:11176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:46.111313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534907584267702:11176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:46.113938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:46.114399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534907584267702:11176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:46.114409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534907584267702:11176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:46.114411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534907584267702:11176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:46.114417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:46.115640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:46.115832Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:46.115844Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:46.115853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:46.115904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:46.115940Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534907584267861:11174]
2025-10-02T08:14:46.116493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:46.116666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:46.116697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:46.116942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:46.116996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.117002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.117003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.117004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.117005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.117009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.117019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.117023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.117026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.117030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.117034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.117042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.117048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.117052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.117060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.117069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.117074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.117091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.117100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.117104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.117126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:46.124596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:46.126274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:46.126293Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:46.126297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:46.126300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:46.126306Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2162 [1:7556534907584267861:11174]
2025-10-02T08:14:46.126317Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:46.126333Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:46.126335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.126338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.126340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.126356Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:46.126365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:46.126374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:46.126433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.126439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.126442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:46.126445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:46.126506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:46.126514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.126529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.126547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:46.126569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584267857:11176], now have 1 active actors on pipe
2025-10-02T08:14:46.126575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2162
2025-10-02T08:14:46.126579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534907584267849:11174]
2025-10-02T08:14:46.126582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534907584267849:11174]
2025-10-02T08:14:46.126589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:46.126602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:46.126609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:46.126616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:46.126618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:46.126621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:46.126625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534908043803285:2378], now have 1 active actors on pipe
2025-10-02T08:14:46.126630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.126635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.126673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534907584267849:11174]
2025-10-02T08:14:46.126686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:46.126694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:46.126701Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:46.126707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.126711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.126713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:46.126722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.126735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:46.126733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2162
2025-10-02T08:14:46.126768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.126831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.126839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.126852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.126892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2163 partition: 0 MaxSeqNo: 17 sessionId: src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0
2025-10-02T08:14:46.127194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522a9d3b-8b218cf5-4307d0a6-3db57cc4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:46.129659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0] Write session: try to update token
2025-10-02T08:14:46.129675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:46.142623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId: src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:46.143703Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:46.143721Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:46.143724Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:46.143732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534907584267849:11174]
2025-10-02T08:14:46.143737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534907584267849:11174]
2025-10-02T08:14:46.143777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:46.143788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.143787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:46.143790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:46.143793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:46.143924Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:46.144953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:46.197580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534907584267886:12248]
2025-10-02T08:14:46.197709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2162, pipe: [1:7556534907584267886:12248]
2025-10-02T08:14:46.280915Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:46.281358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.281374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.281410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584267886:12248], now have 1 active actors on pipe
2025-10-02T08:14:46.281525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534907584267886:12248]
2025-10-02T08:14:46.281551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:46.281554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:46.281611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2163 reason: error at write: Disconnected sessionId: src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0
2025-10-02T08:14:46.281619Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:46.281657Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:46.281773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2163 sessionId: src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0 is DEAD
2025-10-02T08:14:46.281921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:46.281932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0] Write session will restart in 0.005178s
2025-10-02T08:14:46.281958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0] Write session: Do CDS request
2025-10-02T08:14:46.281965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:46.288276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.288376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:46.288394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2164
2025-10-02T08:14:46.288511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.288568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:46.288577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:46.288581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:46.288942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2164 sessionId:  describe result for acl check
2025-10-02T08:14:46.288973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:46.288975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:46.288976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:46.288980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534907584268145:11163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:46.289484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534907584268145:11163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:46.291754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534907584268145:11163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:46.294605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534907584268145:11163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:46.294620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534907584268145:11163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:46.294624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534907584268145:11163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:46.294631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:46.298906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:46.300657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:46.300874Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:46.300884Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:46.300894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:46.300941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:46.300978Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534907584268470:11161]
2025-10-02T08:14:46.301587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:46.301771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:46.301808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:46.302098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:46.302138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.302144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.302145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.302147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.302148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.302152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.302162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.302166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.302169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.302173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.302178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.302184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.302190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.302195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.302200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.302205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.302208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.302213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.302217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.302222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.302239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:46.310529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:46.312335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:46.312355Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:46.312357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:46.312360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:46.312367Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2163 [1:7556534907584268470:11161]
2025-10-02T08:14:46.312378Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:46.312393Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:46.312396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.312400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.312401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.312416Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:46.312424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:46.312430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:46.312489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.312497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.312502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:46.312504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:46.312567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:46.312576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.312588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.312606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:46.312627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534907584268464:11161]
2025-10-02T08:14:46.312629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534907584268464:11161]
2025-10-02T08:14:46.312636Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:46.312641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2163
2025-10-02T08:14:46.312646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:46.312649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584268378:11163], now have 1 active actors on pipe
2025-10-02T08:14:46.312650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:46.312657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:46.312672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:46.312675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:46.312680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534908043803293:2378], now have 1 active actors on pipe
2025-10-02T08:14:46.312684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.312688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.312727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534907584268464:11161]
2025-10-02T08:14:46.312736Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:46.312745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:46.312750Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12fdc0db-262bc5e1-72877215-6a43774e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:46.312756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.312760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.312762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:46.312771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.312726Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2163
2025-10-02T08:14:46.312779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:46.312844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.312919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.312926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.312940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.312980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2164 partition: 0 MaxSeqNo: 17 sessionId: src_id|12fdc0db-262bc5e1-72877215-6a43774e_0
2025-10-02T08:14:46.313323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a94b6aa-3f3a78fd-779f195a-aa3d609_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|12fdc0db-262bc5e1-72877215-6a43774e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:46.315837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fdc0db-262bc5e1-72877215-6a43774e_0] Write session: try to update token
2025-10-02T08:14:46.315851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fdc0db-262bc5e1-72877215-6a43774e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:46.330467Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:46.330488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:46.330490Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:46.330498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534907584268464:11161]
2025-10-02T08:14:46.330502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534907584268464:11161]
2025-10-02T08:14:46.330544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:46.330550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:46.330552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:46.330558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.330560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:46.330695Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:46.330846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId: src_id|12fdc0db-262bc5e1-72877215-6a43774e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:46.333467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:46.381917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534907584268495:12248]
2025-10-02T08:14:46.382038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2163, pipe: [1:7556534907584268495:12248]
2025-10-02T08:14:46.467638Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:46.468011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.468025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.468058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584268495:12248], now have 1 active actors on pipe
2025-10-02T08:14:46.468148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:46.468157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:46.468215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2164 reason: error at write: Disconnected sessionId: src_id|12fdc0db-262bc5e1-72877215-6a43774e_0
2025-10-02T08:14:46.468235Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:46.468377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2164 sessionId: src_id|12fdc0db-262bc5e1-72877215-6a43774e_0 is DEAD
2025-10-02T08:14:46.468479Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:46.468514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fdc0db-262bc5e1-72877215-6a43774e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:46.468524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fdc0db-262bc5e1-72877215-6a43774e_0] Write session will restart in 0.007987s
2025-10-02T08:14:46.468548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fdc0db-262bc5e1-72877215-6a43774e_0] Write session: Do CDS request
2025-10-02T08:14:46.468554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fdc0db-262bc5e1-72877215-6a43774e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:46.468550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534907584268495:12248]
2025-10-02T08:14:46.477271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12fdc0db-262bc5e1-72877215-6a43774e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.477329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:46.477346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2165
2025-10-02T08:14:46.477466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.477496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:46.477504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:46.477507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:46.477846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2165 sessionId:  describe result for acl check
2025-10-02T08:14:46.477874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:46.477880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:46.477881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:46.477885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534907584268883:11144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:46.478378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534907584268883:11144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:46.481125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534907584268883:11144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:46.484242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534907584268883:11144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:46.484258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534907584268883:11144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:46.484261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534907584268883:11144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:46.484267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:46.486081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:46.486459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:46.486597Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:46.486605Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:46.486613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:46.486650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:46.486685Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534907584269083:11141]
2025-10-02T08:14:46.487152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:46.487292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:46.487319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:46.487500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:46.487525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.487529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.487530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.487531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.487531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.487534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.487540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.487542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.487544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.487546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.487550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.487556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.487561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.487565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.487569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.487572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.487575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.487579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.487583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.487587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.487603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:46.495155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:46.496917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:46.496932Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:46.496934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:46.496937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:46.496943Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2164 [1:7556534907584269083:11141]
2025-10-02T08:14:46.496954Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:46.496969Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:46.496972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.496975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.496976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.496992Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:46.496996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:46.497003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:46.497062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.497071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.497074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:46.497077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:46.497136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:46.497143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.497156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.497171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:46.497187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2164
2025-10-02T08:14:46.497193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584269073:11144], now have 1 active actors on pipe
2025-10-02T08:14:46.497199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534907584269077:11141]
2025-10-02T08:14:46.497201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534907584269077:11141]
2025-10-02T08:14:46.497207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:46.497214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534908043803301:2378], now have 1 active actors on pipe
2025-10-02T08:14:46.497219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:46.497220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:46.497228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:46.497230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:46.497231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:46.497234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.497237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.497268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534907584269077:11141]
2025-10-02T08:14:46.497277Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:46.497291Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9688a4-cee574ed-432802f8-e4b56812_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:46.497294Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:46.497300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.497304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.497305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:46.497313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.497319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:46.497285Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2164
2025-10-02T08:14:46.497350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.497423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.497429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.497438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.497465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2165 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9688a4-cee574ed-432802f8-e4b56812_0
2025-10-02T08:14:46.497765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12fdc0db-262bc5e1-72877215-6a43774e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9688a4-cee574ed-432802f8-e4b56812_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:46.500245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9688a4-cee574ed-432802f8-e4b56812_0] Write session: try to update token
2025-10-02T08:14:46.500259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9688a4-cee574ed-432802f8-e4b56812_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:46.513942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId: src_id|f9688a4-cee574ed-432802f8-e4b56812_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:46.514629Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:46.514647Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:46.514650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:46.514659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534907584269077:11141]
2025-10-02T08:14:46.514662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534907584269077:11141]
2025-10-02T08:14:46.514703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:46.514715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.514717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:46.514824Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:46.514844Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:46.514852Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:46.516493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:46.568792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534907584269108:12248]
2025-10-02T08:14:46.568924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2164, pipe: [1:7556534907584269108:12248]
2025-10-02T08:14:46.652125Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:46.652480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.652494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.652523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584269108:12248], now have 1 active actors on pipe
2025-10-02T08:14:46.652607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:46.652613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:46.652656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2165 reason: error at write: Disconnected sessionId: src_id|f9688a4-cee574ed-432802f8-e4b56812_0
2025-10-02T08:14:46.652735Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:46.652750Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:46.652973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9688a4-cee574ed-432802f8-e4b56812_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:46.652984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9688a4-cee574ed-432802f8-e4b56812_0] Write session will restart in 0.009687s
2025-10-02T08:14:46.652822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2165 sessionId: src_id|f9688a4-cee574ed-432802f8-e4b56812_0 is DEAD
2025-10-02T08:14:46.652960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534907584269108:12248]
2025-10-02T08:14:46.653019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9688a4-cee574ed-432802f8-e4b56812_0] Write session: Do CDS request
2025-10-02T08:14:46.653026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9688a4-cee574ed-432802f8-e4b56812_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:46.664272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9688a4-cee574ed-432802f8-e4b56812_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.664329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:46.664345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2166
2025-10-02T08:14:46.664509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.664546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:46.664557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:46.664560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:46.665021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2166 sessionId:  describe result for acl check
2025-10-02T08:14:46.665054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:46.665061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:46.665063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:46.665067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534907584269530:11127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:46.665648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534907584269530:11127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:46.668965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534907584269530:11127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:46.671853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:46.673541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:46.673741Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:46.673750Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:46.673760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:46.673779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534907584269530:11127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:46.673793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534907584269530:11127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:46.673796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534907584269530:11127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:46.673804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:46.673804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:46.673838Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534907584269694:11131]
2025-10-02T08:14:46.674441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:46.674608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:46.674645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:46.674920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:46.674959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.674964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.674965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.674966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.674967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.674971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.674980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.674984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.674987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.674991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.674996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.675002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.675012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.675017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.675021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.675029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.675033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.675042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.675049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.675057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.675074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:46.683178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:46.685154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:46.685173Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:46.685175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:46.685179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:46.685184Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2165 [1:7556534907584269694:11131]
2025-10-02T08:14:46.685194Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:46.685209Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:46.685212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.685215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.685216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.685230Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:46.685235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:46.685240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:46.685298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.685306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.685308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:46.685310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:46.685374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:46.685384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.685395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.685404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:46.685405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2165
2025-10-02T08:14:46.685421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584269699:11127], now have 1 active actors on pipe
2025-10-02T08:14:46.685424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534908043803320:2378], now have 1 active actors on pipe
2025-10-02T08:14:46.685428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.685432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.685448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534907584269685:11131]
2025-10-02T08:14:46.685456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534907584269685:11131]
2025-10-02T08:14:46.685466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:46.685476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:46.685478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:46.685481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:46.685487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:46.685489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:46.685503Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6091856-68b54b4e-68953d0f-34784fb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:46.685513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.685515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.685517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:46.685525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.685532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:46.685533Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2165
2025-10-02T08:14:46.685560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534907584269685:11131]
2025-10-02T08:14:46.685568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:46.685576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.685576Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:46.685611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.685617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.685631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.685667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2166 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6091856-68b54b4e-68953d0f-34784fb6_0
2025-10-02T08:14:46.685943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9688a4-cee574ed-432802f8-e4b56812_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6091856-68b54b4e-68953d0f-34784fb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:46.688297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6091856-68b54b4e-68953d0f-34784fb6_0] Write session: try to update token
2025-10-02T08:14:46.688308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6091856-68b54b4e-68953d0f-34784fb6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:46.700720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId: src_id|c6091856-68b54b4e-68953d0f-34784fb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:46.703163Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:46.703187Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:46.703190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:46.703198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534907584269685:11131]
2025-10-02T08:14:46.703202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534907584269685:11131]
2025-10-02T08:14:46.703215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:46.703242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:46.703243Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:46.703247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.703248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:46.703248Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:46.703376Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:46.753086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534907584269737:12248]
2025-10-02T08:14:46.757040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2165, pipe: [1:7556534907584269737:12248]
2025-10-02T08:14:46.832394Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:46.832738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.832752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.832786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584269737:12248], now have 1 active actors on pipe
2025-10-02T08:14:46.832887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:46.832895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:46.832999Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:46.832939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2166 reason: error at write: Disconnected sessionId: src_id|c6091856-68b54b4e-68953d0f-34784fb6_0
2025-10-02T08:14:46.832965Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:46.833092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2166 sessionId: src_id|c6091856-68b54b4e-68953d0f-34784fb6_0 is DEAD
2025-10-02T08:14:46.833205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534907584269737:12248]
2025-10-02T08:14:46.833399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6091856-68b54b4e-68953d0f-34784fb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:46.833406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6091856-68b54b4e-68953d0f-34784fb6_0] Write session will restart in 0.009545s
2025-10-02T08:14:46.833429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6091856-68b54b4e-68953d0f-34784fb6_0] Write session: Do CDS request
2025-10-02T08:14:46.833435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6091856-68b54b4e-68953d0f-34784fb6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:46.844297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6091856-68b54b4e-68953d0f-34784fb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.844321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:46.844338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2167
2025-10-02T08:14:46.844487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:46.844515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:46.844524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:46.844527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:46.845005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2167 sessionId:  describe result for acl check
2025-10-02T08:14:46.845041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:46.845042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:46.845043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:46.845048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534907584270206:11104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:46.845511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534907584270206:11104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:46.848369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534907584270206:11104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:46.850759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:46.852238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:46.852608Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:46.852616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534907584270206:11104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:46.852620Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:46.852621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534907584270206:11104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:46.852624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534907584270206:11104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:46.852632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:46.852632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:46.852687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:46.852740Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534907584270359:11106]
2025-10-02T08:14:46.853334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:46.853511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:46.853554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:46.853828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:46.853869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.853875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.853876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.853877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.853878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.853883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.853892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.853896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.853900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.853903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.853908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.853915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:46.853921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.853925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:46.853930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.853934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:46.853938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.853943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.853948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.853952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.853970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:46.862575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:46.864105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:46.864126Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:46.864129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:46.864134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:46.864141Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2166 [1:7556534907584270359:11106]
2025-10-02T08:14:46.864153Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:46.864508Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2166
2025-10-02T08:14:46.864176Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:46.864197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.864201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.864203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.864220Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:46.864225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:46.864231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:46.864292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.864294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.864296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:46.864298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:46.864360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:46.864362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.864375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:46.864384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:46.864393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2166
2025-10-02T08:14:46.864402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584270363:11104], now have 1 active actors on pipe
2025-10-02T08:14:46.864404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534908043803351:2378], now have 1 active actors on pipe
2025-10-02T08:14:46.864411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534907584270353:11106]
2025-10-02T08:14:46.864412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534907584270353:11106]
2025-10-02T08:14:46.864424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:46.864433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.864437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.864454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:46.864465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:46.864468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:46.864507Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:46.864513Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:46.864513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:46.864515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:46.864516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:46.864518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:46.864526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:46.864533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:46.864539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534907584270353:11106]
2025-10-02T08:14:46.864548Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:46.864568Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:46.864568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.864665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:46.864671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:46.864702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:46.864739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2167 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0
2025-10-02T08:14:46.865104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6091856-68b54b4e-68953d0f-34784fb6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:46.867717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0] Write session: try to update token
2025-10-02T08:14:46.867736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:46.881780Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:46.881806Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:46.881808Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:46.881817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534907584270353:11106]
2025-10-02T08:14:46.881823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534907584270353:11106]
2025-10-02T08:14:46.881865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:46.881875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:46.881878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:46.881885Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:46.881889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:46.882010Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:46.890812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId: src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:46.893164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:46.933328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534907584270390:12248]
2025-10-02T08:14:46.933524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2166, pipe: [1:7556534907584270390:12248]
2025-10-02T08:14:47.013052Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:47.013372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.013384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.013400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534907584270390:12248], now have 1 active actors on pipe
2025-10-02T08:14:47.013498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:47.013506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:47.013543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2167 reason: error at write: Disconnected sessionId: src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0
2025-10-02T08:14:47.013626Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:47.013667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2167 sessionId: src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0 is DEAD
2025-10-02T08:14:47.013633Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:47.013791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:47.013801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0] Write session will restart in 0.009851s
2025-10-02T08:14:47.013822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0] Write session: Do CDS request
2025-10-02T08:14:47.013827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:47.013813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534907584270390:12248]
2025-10-02T08:14:47.025212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.025418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:47.025436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2168
2025-10-02T08:14:47.025531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.025558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:47.025563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:47.025566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:47.026003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2168 sessionId:  describe result for acl check
2025-10-02T08:14:47.026038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:47.026043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:47.026045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:47.026050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534911879238155:11085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:47.026431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534911879238155:11085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:47.029497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534911879238155:11085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:47.031013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:47.032624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:47.032841Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:47.032852Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:47.032862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:47.032916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:47.032956Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534911879238272:11089]
2025-10-02T08:14:47.032989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534911879238155:11085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:47.033003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534911879238155:11085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:47.033006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534911879238155:11085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:47.033014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:47.033533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:47.033726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:47.033768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:47.034047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:47.034096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.034102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.034104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.034105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.034106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.034111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.034120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.034124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.034128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.034132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.034139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.034146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.034156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.034161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.034165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.034174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.034178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.034183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.034192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.034197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.034214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:47.041953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:47.043593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:47.043617Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:47.043620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:47.043624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:47.043630Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2167 [1:7556534911879238272:11089]
2025-10-02T08:14:47.043642Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:47.043659Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:47.043668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.043672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.043673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.043689Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:47.043698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:47.043710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:47.043931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.043944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.043947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:47.043949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:47.044016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:47.044028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.044041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.044053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:47.044071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879238277:11085], now have 1 active actors on pipe
2025-10-02T08:14:47.044078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534911879238266:11089]
2025-10-02T08:14:47.044081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2167
2025-10-02T08:14:47.044086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534911879238266:11089]
2025-10-02T08:14:47.044093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:47.044101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534912338770654:2378], now have 1 active actors on pipe
2025-10-02T08:14:47.044103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:47.044106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:47.044113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:47.044126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:47.044133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:47.044140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.044144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.044159Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2167
2025-10-02T08:14:47.044200Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534911879238266:11089]
2025-10-02T08:14:47.044211Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:47.044215Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:47.044226Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:47.044232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.044240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.044242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:47.044251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.044263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:47.044309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.044379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.044386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.044400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.044437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2168 partition: 0 MaxSeqNo: 17 sessionId: src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0
2025-10-02T08:14:47.044728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc33c3f3-9f9e5ba3-7d698d45-dd0d5dca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:47.047403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0] Write session: try to update token
2025-10-02T08:14:47.047421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:47.061863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId: src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:47.062098Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:47.062102Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:47.062104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:47.062113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534911879238266:11089]
2025-10-02T08:14:47.062118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534911879238266:11089]
2025-10-02T08:14:47.062165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:47.062172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.062174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:47.062309Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:47.064350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:47.064418Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:47.064423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:47.114058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534911879238305:12248]
2025-10-02T08:14:47.114462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2167, pipe: [1:7556534911879238305:12248]
2025-10-02T08:14:47.208319Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:47.208620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.208638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.208679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879238305:12248], now have 1 active actors on pipe
2025-10-02T08:14:47.208819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:47.208833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:47.208891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2168 reason: error at write: Disconnected sessionId: src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0
2025-10-02T08:14:47.208899Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:47.208935Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:47.209046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2168 sessionId: src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0 is DEAD
2025-10-02T08:14:47.209207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:47.209214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0] Write session will restart in 0.008070s
2025-10-02T08:14:47.209249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0] Write session: Do CDS request
2025-10-02T08:14:47.209255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:47.209325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534911879238305:12248]
2025-10-02T08:14:47.218264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.218337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:47.218355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2169
2025-10-02T08:14:47.218457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.218500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:47.218507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:47.218510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:47.218926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2169 sessionId:  describe result for acl check
2025-10-02T08:14:47.218955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:47.218961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:47.218962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:47.218966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534911879238660:11075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:47.219432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534911879238660:11075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:47.221869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534911879238660:11075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:47.225461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534911879238660:11075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:47.225475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534911879238660:11075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:47.225478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534911879238660:11075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:47.225485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:47.228105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:47.228474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:47.228635Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:47.228645Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:47.228655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:47.228707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:47.228743Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534911879238899:11079]
2025-10-02T08:14:47.229354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:47.229610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:47.229658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:47.229955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:47.230013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.230020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.230021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.230022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.230023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.230029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.230039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.230043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.230047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.230051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.230057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.230066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.230076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.230082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.230086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.230091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.230095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.230102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.230106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.230113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.230131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:47.237917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:47.239416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:47.239436Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:47.239439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:47.239442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:47.239448Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2168 [1:7556534911879238899:11079]
2025-10-02T08:14:47.239459Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:47.239475Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:47.239478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.239482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.239483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.239499Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:47.239504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:47.239515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:47.239575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.239583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.239586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:47.239589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:47.239647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:47.239656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.239670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.239681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:47.239699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879238878:11075], now have 1 active actors on pipe
2025-10-02T08:14:47.239700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2168
2025-10-02T08:14:47.239711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534911879238893:11079]
2025-10-02T08:14:47.239713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534911879238893:11079]
2025-10-02T08:14:47.239720Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:47.239734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534912338770662:2378], now have 1 active actors on pipe
2025-10-02T08:14:47.239739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:47.239745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:47.239753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:47.239756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:47.239757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:47.239762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.239765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.239803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534911879238893:11079]
2025-10-02T08:14:47.239817Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:47.239831Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:47.239838Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:47.239844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.239848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.239850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:47.239858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.239867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:47.239859Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2168
2025-10-02T08:14:47.239899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.239993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.240001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.240018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.240057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2169 partition: 0 MaxSeqNo: 17 sessionId: src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0
2025-10-02T08:14:47.240382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40f5d9a0-11398864-8b44fdfb-8ef980a9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:47.242809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0] Write session: try to update token
2025-10-02T08:14:47.242822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:47.255746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId: src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:47.258307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:47.258638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.258662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.258680Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:47.258682Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:47.258684Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:47.258692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534911879238893:11079]
2025-10-02T08:14:47.258696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534911879238893:11079]
2025-10-02T08:14:47.258734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:47.258746Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:47.258747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:47.258753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.258755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:47.258889Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:47.309644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534911879238924:12248]
2025-10-02T08:14:47.309956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2168, pipe: [1:7556534911879238924:12248]
2025-10-02T08:14:47.396380Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:47.396955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:47.397012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879238924:12248], now have 1 active actors on pipe
2025-10-02T08:14:47.397055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:47.397131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:47.397138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:47.397154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2169 reason: error at write: Disconnected sessionId: src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0
2025-10-02T08:14:47.397358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:47.397367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0] Write session will restart in 0.007974s
2025-10-02T08:14:47.397390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0] Write session: Do CDS request
2025-10-02T08:14:47.397395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:47.397272Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:47.397268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2169 sessionId: src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0 is DEAD
2025-10-02T08:14:47.397437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534911879238924:12248]
2025-10-02T08:14:47.406250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.406355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:47.406374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2170
2025-10-02T08:14:47.408982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.409024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:47.409033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:47.409036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:47.409437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2170 sessionId:  describe result for acl check
2025-10-02T08:14:47.409468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:47.409473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:47.409475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:47.409480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534911879239346:11072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:47.409862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534911879239346:11072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:47.411741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534911879239346:11072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:47.415598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534911879239346:11072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:47.415616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534911879239346:11072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:47.415619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534911879239346:11072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:47.415627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:47.417620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:47.419050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:47.419220Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:47.419230Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:47.419240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:47.419282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:47.419314Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534911879239520:11073]
2025-10-02T08:14:47.419893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:47.420087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:47.420143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:47.420459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:47.420505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.420512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.420513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.420515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.420516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.420521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.420530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.420534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.420538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.420541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.420547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.420554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.420560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.420565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.420569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.420579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.420583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.420588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.420593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.420603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.420621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:47.429146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:47.430749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:47.430775Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:47.430777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:47.430781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:47.430788Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2169 [1:7556534911879239520:11073]
2025-10-02T08:14:47.430800Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:47.430816Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:47.430819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.430822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.430824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.430838Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:47.430847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:47.430854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:47.430920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.430927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.430930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:47.430933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:47.430995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:47.431002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.431015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.431031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:47.431050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534911879239514:11073]
2025-10-02T08:14:47.431056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534911879239514:11073]
2025-10-02T08:14:47.431069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:47.431084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:47.431103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:47.431110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:47.431135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:47.431141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534911879239514:11073]
2025-10-02T08:14:47.431144Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:47.431147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:47.431153Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:47.431251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2169
2025-10-02T08:14:47.431269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879239500:11072], now have 1 active actors on pipe
2025-10-02T08:14:47.431274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534912338770669:2378], now have 1 active actors on pipe
2025-10-02T08:14:47.431401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2169
2025-10-02T08:14:47.431499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.431511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.431542Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cbe309b-3e83cdad-73889f89-583a0931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:47.431554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.431559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.431562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:47.431572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.431581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:47.431596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.432899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0730ba-fb78d024-e1471982-fbf29a7a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9cbe309b-3e83cdad-73889f89-583a0931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:47.435599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cbe309b-3e83cdad-73889f89-583a0931_0] Write session: try to update token
2025-10-02T08:14:47.435615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cbe309b-3e83cdad-73889f89-583a0931_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:47.431641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.431652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.431678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.431717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2170 partition: 0 MaxSeqNo: 17 sessionId: src_id|9cbe309b-3e83cdad-73889f89-583a0931_0
2025-10-02T08:14:47.448646Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:47.448671Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:47.448673Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:47.448681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534911879239514:11073]
2025-10-02T08:14:47.448686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534911879239514:11073]
2025-10-02T08:14:47.448727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:47.448739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.448741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:47.448887Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:47.452934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:47.452951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:47.457825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId: src_id|9cbe309b-3e83cdad-73889f89-583a0931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:47.460215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:47.497545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534911879239547:12248]
2025-10-02T08:14:47.497655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2169, pipe: [1:7556534911879239547:12248]
2025-10-02T08:14:47.581105Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:47.581447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.581462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.581500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879239547:12248], now have 1 active actors on pipe
2025-10-02T08:14:47.581614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534911879239547:12248]
2025-10-02T08:14:47.581638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:47.581640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:47.581687Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:47.581689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2170 reason: error at write: Disconnected sessionId: src_id|9cbe309b-3e83cdad-73889f89-583a0931_0
2025-10-02T08:14:47.581749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:47.581876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2170 sessionId: src_id|9cbe309b-3e83cdad-73889f89-583a0931_0 is DEAD
2025-10-02T08:14:47.582009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cbe309b-3e83cdad-73889f89-583a0931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:47.582019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cbe309b-3e83cdad-73889f89-583a0931_0] Write session will restart in 0.009212s
2025-10-02T08:14:47.582042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cbe309b-3e83cdad-73889f89-583a0931_0] Write session: Do CDS request
2025-10-02T08:14:47.582047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cbe309b-3e83cdad-73889f89-583a0931_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:47.592211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cbe309b-3e83cdad-73889f89-583a0931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.592248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:47.592267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2171
2025-10-02T08:14:47.592392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.592426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:47.592433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:47.592436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:47.592814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2171 sessionId:  describe result for acl check
2025-10-02T08:14:47.592844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:47.592846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:47.592847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:47.592851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534911879239978:11066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:47.593321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534911879239978:11066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:47.596174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534911879239978:11066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:47.598869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:47.599215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534911879239978:11066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:47.599226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534911879239978:11066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:47.599229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534911879239978:11066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:47.599235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:47.600389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:47.600554Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:47.600562Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:47.600571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:47.600613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:47.600645Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534911879240145:11063]
2025-10-02T08:14:47.601245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:47.601422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:47.601459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:47.601745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:47.601783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.601789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.601790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.601791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.601791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.601795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.601805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.601808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.601811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.601814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.601818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.601825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.601833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.601837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.601845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.601849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.601852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.601857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.601861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.601870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.601899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:47.609554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:47.611287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:47.611304Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:47.611306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:47.611308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:47.611312Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2170 [1:7556534911879240145:11063]
2025-10-02T08:14:47.611321Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:47.611333Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:47.611335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.611337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.611339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.611350Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:47.611353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:47.611357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:47.611403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.611409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.611411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:47.611412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:47.611462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:47.611468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.611480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.611494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:47.611514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534911879240133:11063]
2025-10-02T08:14:47.611519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534911879240133:11063]
2025-10-02T08:14:47.611526Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:47.611533Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:47.611538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879240141:11066], now have 1 active actors on pipe
2025-10-02T08:14:47.611540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2170
2025-10-02T08:14:47.611541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:47.611545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:47.611558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:47.611564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:47.611570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534912338770675:2378], now have 1 active actors on pipe
2025-10-02T08:14:47.611596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.611602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.611613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534911879240133:11063]
2025-10-02T08:14:47.611619Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:47.611631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:47.611641Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0592864-39727e9d-ec5c9250-c07a2244_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:47.611651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.611659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.611661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:47.611672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.611684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:47.611644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2170
2025-10-02T08:14:47.611712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.611778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.611783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.611795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.611831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2171 partition: 0 MaxSeqNo: 17 sessionId: src_id|c0592864-39727e9d-ec5c9250-c07a2244_0
2025-10-02T08:14:47.612127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cbe309b-3e83cdad-73889f89-583a0931_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c0592864-39727e9d-ec5c9250-c07a2244_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:47.614666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0592864-39727e9d-ec5c9250-c07a2244_0] Write session: try to update token
2025-10-02T08:14:47.614684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0592864-39727e9d-ec5c9250-c07a2244_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:47.627658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId: src_id|c0592864-39727e9d-ec5c9250-c07a2244_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:47.628423Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:47.628439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:47.628442Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:47.628452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534911879240133:11063]
2025-10-02T08:14:47.628456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534911879240133:11063]
2025-10-02T08:14:47.628492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:47.628500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:47.628507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:47.628507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.628510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:47.628651Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:47.630149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:47.681846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534911879240173:12248]
2025-10-02T08:14:47.682094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2170, pipe: [1:7556534911879240173:12248]
2025-10-02T08:14:47.760629Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:47.760918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.760936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.760972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879240173:12248], now have 1 active actors on pipe
2025-10-02T08:14:47.761111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:47.761117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:47.761138Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:47.761163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2171 reason: error at write: Disconnected sessionId: src_id|c0592864-39727e9d-ec5c9250-c07a2244_0
2025-10-02T08:14:47.761161Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:47.761288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2171 sessionId: src_id|c0592864-39727e9d-ec5c9250-c07a2244_0 is DEAD
2025-10-02T08:14:47.761383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534911879240173:12248]
2025-10-02T08:14:47.761436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0592864-39727e9d-ec5c9250-c07a2244_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:47.761444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0592864-39727e9d-ec5c9250-c07a2244_0] Write session will restart in 0.005083s
2025-10-02T08:14:47.761484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0592864-39727e9d-ec5c9250-c07a2244_0] Write session: Do CDS request
2025-10-02T08:14:47.761490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0592864-39727e9d-ec5c9250-c07a2244_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:47.767227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0592864-39727e9d-ec5c9250-c07a2244_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.767351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:47.767367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2172
2025-10-02T08:14:47.767486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.767518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:47.767526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:47.767530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:47.767936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2172 sessionId:  describe result for acl check
2025-10-02T08:14:47.767966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:47.767972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:47.767974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:47.767979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534911879240435:11049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:47.768446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534911879240435:11049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:47.771143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534911879240435:11049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:47.774406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534911879240435:11049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:47.774419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534911879240435:11049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:47.774422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534911879240435:11049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:47.774429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:47.779828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:47.780144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:47.780328Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:47.780339Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:47.780349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:47.780403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:47.780442Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534911879240786:11057]
2025-10-02T08:14:47.781081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:47.781289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:47.781336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:47.781622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:47.781669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.781681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.781683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.781684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.781685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.781690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.781700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.781703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.781707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.781711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.781716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.781723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.781727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.781732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.781737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.781742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.781746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.781751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.781755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.781760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.781776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:47.789891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:47.791386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:47.791404Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:47.791406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:47.791410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:47.791415Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2171 [1:7556534911879240786:11057]
2025-10-02T08:14:47.791427Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:47.791440Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:47.791443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.791445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.791447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.791461Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:47.791466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:47.791471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:47.791526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.791534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.791537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:47.791539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:47.791597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:47.791604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.791613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.791627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:47.791640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2171
2025-10-02T08:14:47.791648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879240698:11049], now have 1 active actors on pipe
2025-10-02T08:14:47.791650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534912338770696:2378], now have 1 active actors on pipe
2025-10-02T08:14:47.791656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534911879240780:11057]
2025-10-02T08:14:47.791657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534911879240780:11057]
2025-10-02T08:14:47.791669Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:47.791684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.791686Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:47.791688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:47.791691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.791707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:47.791723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:47.791730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:47.791728Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2171
2025-10-02T08:14:47.791767Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f07c50e-872c384a-f95de55-a93d3d04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:47.791778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.791781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.791783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:47.791792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.791800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:47.791806Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534911879240780:11057]
2025-10-02T08:14:47.791813Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:47.791823Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:47.791838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.791875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.791881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.791894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.791928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2172 partition: 0 MaxSeqNo: 17 sessionId: src_id|2f07c50e-872c384a-f95de55-a93d3d04_0
2025-10-02T08:14:47.792226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0592864-39727e9d-ec5c9250-c07a2244_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2f07c50e-872c384a-f95de55-a93d3d04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:47.794747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f07c50e-872c384a-f95de55-a93d3d04_0] Write session: try to update token
2025-10-02T08:14:47.794761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f07c50e-872c384a-f95de55-a93d3d04_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:47.805766Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:47.805787Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:47.805794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534911879240780:11057]
2025-10-02T08:14:47.805834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:47.805849Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:47.805982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:47.806107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:47.806231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:47.806365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:47.806532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:47.806566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:47.816576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId: src_id|2f07c50e-872c384a-f95de55-a93d3d04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:47.819008Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:47.819033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:47.819036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:47.819046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534911879240780:11057]
2025-10-02T08:14:47.819050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534911879240780:11057]
2025-10-02T08:14:47.819092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:47.819103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.819105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:47.819117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:47.819128Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:47.819134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:47.819245Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:47.861578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534911879240843:12248]
2025-10-02T08:14:47.861663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2171, pipe: [1:7556534911879240843:12248]
2025-10-02T08:14:47.955291Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:47.955693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.955708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.955729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879240843:12248], now have 1 active actors on pipe
2025-10-02T08:14:47.955867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534911879240843:12248]
2025-10-02T08:14:47.955941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:47.955896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:47.955903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:47.955950Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:47.955961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2172 reason: error at write: Disconnected sessionId: src_id|2f07c50e-872c384a-f95de55-a93d3d04_0
2025-10-02T08:14:47.956111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2172 sessionId: src_id|2f07c50e-872c384a-f95de55-a93d3d04_0 is DEAD
2025-10-02T08:14:47.956257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f07c50e-872c384a-f95de55-a93d3d04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:47.956274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f07c50e-872c384a-f95de55-a93d3d04_0] Write session will restart in 0.006896s
2025-10-02T08:14:47.956299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f07c50e-872c384a-f95de55-a93d3d04_0] Write session: Do CDS request
2025-10-02T08:14:47.956306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f07c50e-872c384a-f95de55-a93d3d04_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:47.964297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f07c50e-872c384a-f95de55-a93d3d04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.964305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:47.964322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2173
2025-10-02T08:14:47.964533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:47.964564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:47.964575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:47.964578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:47.965059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2173 sessionId:  describe result for acl check
2025-10-02T08:14:47.965094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:47.965100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:47.965103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:47.965107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534911879241193:11007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:47.965600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534911879241193:11007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:47.968668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534911879241193:11007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:47.972491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534911879241193:11007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:47.972507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534911879241193:11007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:47.972510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534911879241193:11007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:47.972517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:47.974592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:47.976154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:47.976341Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:47.976352Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:47.976362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:47.976410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:47.976452Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534911879241452:11006]
2025-10-02T08:14:47.976961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:47.977164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:47.977206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:47.977433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:47.977480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.977485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.977486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.977487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.977488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.977493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.977502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.977506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.977510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.977513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.977518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.977528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:47.977533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.977538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:47.977542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.977546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:47.977550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.977555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.977559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.977564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.977583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:47.985703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:47.987202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:47.987219Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:47.987221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:47.987225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:47.987231Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2172 [1:7556534911879241452:11006]
2025-10-02T08:14:47.987242Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:47.987259Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:47.987264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.987267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.987269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.987285Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:47.987294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:47.987301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:47.987366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.987372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.987375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:47.987378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:47.987439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:47.987445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:47.987459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:47.987476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:47.987498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534911879241432:11007], now have 1 active actors on pipe
2025-10-02T08:14:47.987502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2172
2025-10-02T08:14:47.987503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534911879241446:11006]
2025-10-02T08:14:47.987505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534911879241446:11006]
2025-10-02T08:14:47.987512Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:47.987522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534912338770725:2378], now have 1 active actors on pipe
2025-10-02T08:14:47.987524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:47.987528Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:47.987529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:47.987542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:47.987546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:47.987553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.987556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.987603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534911879241446:11006]
2025-10-02T08:14:47.987599Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2172
2025-10-02T08:14:47.987614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:47.987628Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:47.987634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:47.987635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:47.987637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:47.987638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:47.987646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:47.987654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:47.987688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.987735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:47.987742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:47.987754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:47.987784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2173 partition: 0 MaxSeqNo: 17 sessionId: src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0
2025-10-02T08:14:47.988099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f07c50e-872c384a-f95de55-a93d3d04_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:47.990592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0] Write session: try to update token
2025-10-02T08:14:47.990608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:48.003278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId: src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:48.004906Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:48.004923Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:48.004927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:48.004936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534911879241446:11006]
2025-10-02T08:14:48.004940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534911879241446:11006]
2025-10-02T08:14:48.004981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:48.004985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:48.004990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:48.004995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.004997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:48.005124Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:48.005848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:48.056129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534916174208775:12248]
2025-10-02T08:14:48.056229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2172, pipe: [1:7556534916174208775:12248]
2025-10-02T08:14:48.130883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:14:48.130910Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-02T08:14:48.132585Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:48.133185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.133199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.133236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174208775:12248], now have 1 active actors on pipe
2025-10-02T08:14:48.133376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534916174208775:12248]
2025-10-02T08:14:48.133399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:48.133401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:48.133448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2173 reason: error at write: Disconnected sessionId: src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0
2025-10-02T08:14:48.133461Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:48.133607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2173 sessionId: src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0 is DEAD
2025-10-02T08:14:48.133720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:48.133730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0] Write session will restart in 0.005286s
2025-10-02T08:14:48.133748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0] Write session: Do CDS request
2025-10-02T08:14:48.133754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:48.133801Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:48.133824Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-02T08:14:48.140296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.140372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:48.140391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2174
2025-10-02T08:14:48.141306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.141347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:48.141357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:48.141360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:48.141861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2174 sessionId:  describe result for acl check
2025-10-02T08:14:48.141888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:48.141894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:48.141896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:48.141900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534916174209036:10998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:48.142353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534916174209036:10998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:48.145268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534916174209036:10998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:48.148492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534916174209036:10998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:48.148510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534916174209036:10998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:48.148513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534916174209036:10998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:48.148520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:48.155423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:48.155741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:48.155915Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:48.155930Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:48.155939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:48.155994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:48.156035Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534916174209381:10999]
2025-10-02T08:14:48.156686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:48.156877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:48.156933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:48.157230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:48.157296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.157303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.157304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.157305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.157306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.157312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.157322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.157326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.157330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.157333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.157339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.157346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.157351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.157356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.157361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.157368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.157372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.157377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.157381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.157386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.157405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:48.165321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:48.166975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:48.166996Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:48.166998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:48.167002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:48.167009Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2173 [1:7556534916174209381:10999]
2025-10-02T08:14:48.167021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:48.167037Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:48.167041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.167044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.167046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.167063Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:48.167069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:48.167075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:48.167135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.167143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.167146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:48.167149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:48.167213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:48.167220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.167233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.167249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:48.167255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2173
2025-10-02T08:14:48.167272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174209257:10998], now have 1 active actors on pipe
2025-10-02T08:14:48.167282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534916174209375:10999]
2025-10-02T08:14:48.167285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534916174209375:10999]
2025-10-02T08:14:48.167300Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:48.167310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534916633738030:2378], now have 1 active actors on pipe
2025-10-02T08:14:48.167315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.167320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.167332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:48.167342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:48.167345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:48.167357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:48.167365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:48.167407Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:48.167419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.167422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.167427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:48.167437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.167451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:48.167463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534916174209375:10999]
2025-10-02T08:14:48.167472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:48.167481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:48.167495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.167559Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2173
2025-10-02T08:14:48.167595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.167605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.167641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.167673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2174 partition: 0 MaxSeqNo: 17 sessionId: src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0
2025-10-02T08:14:48.167696Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:14:48.167890Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 19 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:14:48.167924Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:14:48.167970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec83b14-4141d490-cf7ac10c-e81db3a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:48.170353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0] Write session: try to update token
2025-10-02T08:14:48.170365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:48.184914Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:48.184937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:48.184939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:48.184947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534916174209375:10999]
2025-10-02T08:14:48.184952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534916174209375:10999]
2025-10-02T08:14:48.184991Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:48.184994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:48.185000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.185002Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:48.185002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:48.185133Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:48.187016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId: src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:48.189621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:48.236935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534916174209408:12248]
2025-10-02T08:14:48.237050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2173, pipe: [1:7556534916174209408:12248]
2025-10-02T08:14:48.329809Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:48.330368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.330385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.330423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174209408:12248], now have 1 active actors on pipe
2025-10-02T08:14:48.330549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534916174209408:12248]
2025-10-02T08:14:48.330595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:48.330602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:48.330624Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:48.330660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2174 reason: error at write: Disconnected sessionId: src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0
2025-10-02T08:14:48.330699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:48.330724Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-02T08:14:48.330823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2174 sessionId: src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0 is DEAD
2025-10-02T08:14:48.330966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:48.330976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0] Write session will restart in 0.007130s
2025-10-02T08:14:48.330997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0] Write session: Do CDS request
2025-10-02T08:14:48.331003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:48.339244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.339362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:48.339387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2175
2025-10-02T08:14:48.339486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.339513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:48.339522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:48.339525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:48.339963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2175 sessionId:  describe result for acl check
2025-10-02T08:14:48.340001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:48.340007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:48.340009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:48.340015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534916174209789:10981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:48.340521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534916174209789:10981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:48.343489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534916174209789:10981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:48.346720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534916174209789:10981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:48.346735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534916174209789:10981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:48.346738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534916174209789:10981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:48.346745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:48.348241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:48.348572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:48.348695Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:48.348702Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:48.348709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:48.348737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:48.348768Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534916174210017:10980]
2025-10-02T08:14:48.349244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:48.349390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:48.349423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:48.349671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:48.349713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.349719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.349719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.349721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.349722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.349726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.349734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.349738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.349742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.349745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.349750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.349756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.349762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.349766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.349770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.349775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.349778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.349783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.349787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.349792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.349808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:48.361053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:48.362604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:48.362626Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:48.362629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:48.362632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:48.362638Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2174 [1:7556534916174210017:10980]
2025-10-02T08:14:48.362650Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:48.362668Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:48.362675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.362678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.362680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.362694Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:48.362699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:48.362704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:48.362764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.362774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.362777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:48.362780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:48.362844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:48.362852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.362864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.362881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:48.362903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174210007:10981], now have 1 active actors on pipe
2025-10-02T08:14:48.362907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2174
2025-10-02T08:14:48.362911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534916633738041:2378], now have 1 active actors on pipe
2025-10-02T08:14:48.362917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534916174210011:10980]
2025-10-02T08:14:48.362919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534916174210011:10980]
2025-10-02T08:14:48.362930Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:48.362941Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:48.362944Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:48.362948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.362952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.362967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:48.362980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:48.362984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:48.363024Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|708c39d9-10ca702a-bad34992-70215db3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:48.363035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.363039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.363045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:48.363015Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2174
2025-10-02T08:14:48.363055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.363067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:48.363078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534916174210011:10980]
2025-10-02T08:14:48.363089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:48.363096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:48.363131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.363184Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:14:48.363215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.363222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.363238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.363273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2175 partition: 0 MaxSeqNo: 17 sessionId: src_id|708c39d9-10ca702a-bad34992-70215db3_0
2025-10-02T08:14:48.363401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 20 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:14:48.363434Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:14:48.363584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ccb59a1-4453d25c-9aec74ab-36ab66c1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|708c39d9-10ca702a-bad34992-70215db3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:48.366045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708c39d9-10ca702a-bad34992-70215db3_0] Write session: try to update token
2025-10-02T08:14:48.366062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708c39d9-10ca702a-bad34992-70215db3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:48.379085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId: src_id|708c39d9-10ca702a-bad34992-70215db3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:48.380548Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:48.380552Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:48.380554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:48.380562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534916174210011:10980]
2025-10-02T08:14:48.380566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534916174210011:10980]
2025-10-02T08:14:48.380613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:48.380616Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:48.380619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.380621Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:48.380621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:48.380754Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:48.381581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:48.430920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534916174210046:12248]
2025-10-02T08:14:48.431047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2174, pipe: [1:7556534916174210046:12248]
2025-10-02T08:14:48.510993Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:48.511350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.511361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.511389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174210046:12248], now have 1 active actors on pipe
2025-10-02T08:14:48.511512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534916174210046:12248]
2025-10-02T08:14:48.511543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:48.511550Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:48.511551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:48.511614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2175 reason: error at write: Disconnected sessionId: src_id|708c39d9-10ca702a-bad34992-70215db3_0
2025-10-02T08:14:48.511633Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:48.511782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2175 sessionId: src_id|708c39d9-10ca702a-bad34992-70215db3_0 is DEAD
2025-10-02T08:14:48.511929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708c39d9-10ca702a-bad34992-70215db3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:48.511941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708c39d9-10ca702a-bad34992-70215db3_0] Write session will restart in 0.008204s
2025-10-02T08:14:48.511966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708c39d9-10ca702a-bad34992-70215db3_0] Write session: Do CDS request
2025-10-02T08:14:48.511972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708c39d9-10ca702a-bad34992-70215db3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:48.521220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708c39d9-10ca702a-bad34992-70215db3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.521273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:48.521298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2176
2025-10-02T08:14:48.521393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.521442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:48.521470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:48.521473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:48.521878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2176 sessionId:  describe result for acl check
2025-10-02T08:14:48.521917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:48.521924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:48.521926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:48.521930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534916174210450:10964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:48.522410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534916174210450:10964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:48.525021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534916174210450:10964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:48.528317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534916174210450:10964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:48.528331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534916174210450:10964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:48.528335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534916174210450:10964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:48.528342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:48.529679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:48.531210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:48.531370Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:48.531379Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:48.531388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:48.531433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:48.531467Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534916174210658:10962]
2025-10-02T08:14:48.532076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:48.532273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:48.532309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:48.532583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:48.532624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.532629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.532630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.532631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.532632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.532636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.532655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.532659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.532663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.532665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.532671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.532678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.532683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.532687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.532691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.532696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.532700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.532710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.532714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.532718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.532735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:48.540697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:48.542654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:48.542675Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:48.542677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:48.542681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:48.542687Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2175 [1:7556534916174210658:10962]
2025-10-02T08:14:48.542701Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:48.542716Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:48.542719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.542721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.542723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.542739Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:48.542749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:48.542755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:48.542817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.542827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.542829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:48.542832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:48.542903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:48.542911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.542924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.542936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:48.542952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534916174210652:10962]
2025-10-02T08:14:48.542962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534916174210652:10962]
2025-10-02T08:14:48.542970Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:48.542977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2175
2025-10-02T08:14:48.542981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:48.542982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174210637:10964], now have 1 active actors on pipe
2025-10-02T08:14:48.542984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:48.542990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:48.543003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:48.543005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:48.543011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534916633738050:2378], now have 1 active actors on pipe
2025-10-02T08:14:48.543016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.543020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.543058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534916174210652:10962]
2025-10-02T08:14:48.543068Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:48.543081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:48.543087Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|988c1d08-8f8d252a-4871002c-2768ad39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:48.543093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.543097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.543098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:48.543107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.543122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:48.543081Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2175
2025-10-02T08:14:48.543169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.543243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.543255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.543269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.543307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2176 partition: 0 MaxSeqNo: 17 sessionId: src_id|988c1d08-8f8d252a-4871002c-2768ad39_0
2025-10-02T08:14:48.543620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708c39d9-10ca702a-bad34992-70215db3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|988c1d08-8f8d252a-4871002c-2768ad39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:48.546162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988c1d08-8f8d252a-4871002c-2768ad39_0] Write session: try to update token
2025-10-02T08:14:48.546180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988c1d08-8f8d252a-4871002c-2768ad39_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:48.559528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId: src_id|988c1d08-8f8d252a-4871002c-2768ad39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:48.562002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:48.563176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.563196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.563212Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:48.563218Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:48.563220Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:48.563225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534916174210652:10962]
2025-10-02T08:14:48.563228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534916174210652:10962]
2025-10-02T08:14:48.563266Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:48.563268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:48.563272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.563273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:48.563278Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:48.563386Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:48.611654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534916174210683:12248]
2025-10-02T08:14:48.611776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2175, pipe: [1:7556534916174210683:12248]
2025-10-02T08:14:48.697787Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:48.698121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:48.698171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174210683:12248], now have 1 active actors on pipe
2025-10-02T08:14:48.698172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:48.698281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:48.698288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:48.698308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2176 reason: error at write: Disconnected sessionId: src_id|988c1d08-8f8d252a-4871002c-2768ad39_0
2025-10-02T08:14:48.698445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2176 sessionId: src_id|988c1d08-8f8d252a-4871002c-2768ad39_0 is DEAD
2025-10-02T08:14:48.698595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534916174210683:12248]
2025-10-02T08:14:48.698783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988c1d08-8f8d252a-4871002c-2768ad39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:48.698793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988c1d08-8f8d252a-4871002c-2768ad39_0] Write session will restart in 0.006963s
2025-10-02T08:14:48.698814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988c1d08-8f8d252a-4871002c-2768ad39_0] Write session: Do CDS request
2025-10-02T08:14:48.698820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988c1d08-8f8d252a-4871002c-2768ad39_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:48.700913Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:48.707268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988c1d08-8f8d252a-4871002c-2768ad39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.707313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:48.707329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2177
2025-10-02T08:14:48.707458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.707487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:48.707497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:48.707500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:48.707900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2177 sessionId:  describe result for acl check
2025-10-02T08:14:48.707926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:48.707932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:48.707934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:48.707938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534916174211005:10941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:48.708393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534916174211005:10941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:48.710294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534916174211005:10941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:48.713006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534916174211005:10941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:48.713022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534916174211005:10941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:48.713025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534916174211005:10941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:48.713033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:48.722327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:48.722715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:48.722896Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:48.722922Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:48.722936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:48.722994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:48.723029Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534916174211296:10958]
2025-10-02T08:14:48.723558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:48.723757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:48.723801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:48.724028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:48.724062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.724066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.724067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.724068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.724069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.724074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.724082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.724086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.724089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.724093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.724098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.724104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.724110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.724115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.724119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.724124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.724128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.724133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.724141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.724144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.724154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:48.731884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:48.733584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:48.733605Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:48.733608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:48.733612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:48.733618Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2176 [1:7556534916174211296:10958]
2025-10-02T08:14:48.733629Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:48.733645Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:48.733648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.733651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.733653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.733669Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:48.733674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:48.733681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:48.733746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.733756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.733760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:48.733762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:48.733836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:48.733846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.733861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.733873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:48.733890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174211124:10941], now have 1 active actors on pipe
2025-10-02T08:14:48.733901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534916174211290:10958]
2025-10-02T08:14:48.733903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534916174211290:10958]
2025-10-02T08:14:48.733906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2176
2025-10-02T08:14:48.733910Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:48.733922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534916633738068:2378], now have 1 active actors on pipe
2025-10-02T08:14:48.733926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:48.733930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:48.733931Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:48.733943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:48.733946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:48.733968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.733977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.734016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534916174211290:10958]
2025-10-02T08:14:48.734029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:48.734041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:48.734021Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2176
2025-10-02T08:14:48.734046Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:48.734052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.734055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.734057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:48.734066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.734076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:48.734124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.734170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.734179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.734191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.734226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2177 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0
2025-10-02T08:14:48.734575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988c1d08-8f8d252a-4871002c-2768ad39_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:48.736974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0] Write session: try to update token
2025-10-02T08:14:48.736988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:48.751016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId: src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:48.752535Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:48.752554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:48.752556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:48.752563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534916174211290:10958]
2025-10-02T08:14:48.752565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534916174211290:10958]
2025-10-02T08:14:48.752597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:48.752603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.752604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:48.752724Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:48.752757Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:48.752771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:48.753475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:48.798534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534916174211335:12248]
2025-10-02T08:14:48.798637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2176, pipe: [1:7556534916174211335:12248]
2025-10-02T08:14:48.881114Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:48.881422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.881434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.881471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174211335:12248], now have 1 active actors on pipe
2025-10-02T08:14:48.881630Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:48.881704Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:48.881929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534916174211335:12248]
2025-10-02T08:14:48.881957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:48.882000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2177 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0
2025-10-02T08:14:48.882152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2177 sessionId: src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0 is DEAD
2025-10-02T08:14:48.882300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:48.882309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0] Write session will restart in 0.007548s
2025-10-02T08:14:48.882334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0] Write session: Do CDS request
2025-10-02T08:14:48.882341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:48.891228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.891342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:48.891359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2178
2025-10-02T08:14:48.891451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:48.891476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:48.891484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:48.891487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:48.891815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2178 sessionId:  describe result for acl check
2025-10-02T08:14:48.891850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:48.891852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:48.891853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:48.891857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534916174211732:10945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:48.892736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534916174211732:10945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:48.895298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534916174211732:10945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:48.899392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534916174211732:10945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:48.899410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534916174211732:10945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:48.899413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534916174211732:10945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:48.899420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:48.902188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:48.902546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:48.902690Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:48.902699Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:48.902707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:48.902742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:48.902776Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534916174211977:10946]
2025-10-02T08:14:48.903393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:48.903548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:48.903585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:48.903876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:48.903917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.903922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.903924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.903925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.903926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.903931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.903939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.903943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.903946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.903949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.903953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.903960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:48.903965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.903969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:48.903973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.903977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:48.903981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.903985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.903991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.903996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.904012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:48.911840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:48.913403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:48.913419Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:48.913421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:48.913424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:48.913429Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2177 [1:7556534916174211977:10946]
2025-10-02T08:14:48.913439Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:48.913454Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:48.913461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.913464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.913465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.913479Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:48.913483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:48.913492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:48.913546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.913552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.913555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:48.913557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:48.913612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:48.913620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.913630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:48.913640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:48.913657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174211959:10945], now have 1 active actors on pipe
2025-10-02T08:14:48.913660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534916633738088:2378], now have 1 active actors on pipe
2025-10-02T08:14:48.913664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.913667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.913682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534916174211971:10946]
2025-10-02T08:14:48.913684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534916174211971:10946]
2025-10-02T08:14:48.913695Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:48.913708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2177
2025-10-02T08:14:48.913711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:48.913722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:48.913724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:48.913733Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:48.913738Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:48.913743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.913746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.913746Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:48.913748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:48.913755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.913763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:48.913790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534916174211971:10946]
2025-10-02T08:14:48.913793Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:48.913739Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2177
2025-10-02T08:14:48.913800Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:48.913801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.913848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.913855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.913866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:48.913901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2178 partition: 0 MaxSeqNo: 17 sessionId: src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0
2025-10-02T08:14:48.914242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5cc75f-c848ccba-625e9911-3e2d2cc9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:48.916752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0] Write session: try to update token
2025-10-02T08:14:48.916767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:48.929231Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:48.929256Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:48.929265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534916174211971:10946]
2025-10-02T08:14:48.929305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:48.929314Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:48.929480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:48.929618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:48.929751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:48.929895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:48.930076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:48.930103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:48.930581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId: src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:48.933002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:48.933060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.933070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.933094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:48.933112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:48.933149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:48.933168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:48.933326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.933391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.933461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.933525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.933691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.933700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.933762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.933815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.933869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.933927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.933970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.933976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.934036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.934096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.934150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.934207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.934249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.934256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.934315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.934373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.934441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.934506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.934547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.934552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.934613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.934671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.934731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.934799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.934847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.934853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.934928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.934996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.935057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.935127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.935183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.935192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.935276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.935334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.935396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.935458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.935505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.935515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.935580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.935647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.935727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.935808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.935849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.935855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.935919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.935982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.936043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.936111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.936170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.936178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.936278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:48.936343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:48.936403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:48.936465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:48.936506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:48.936513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:48.936548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:48.936618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:48.936643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:48.936650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:48.936685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:48.936704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:48.936713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:48.936716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:48.936719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:48.937133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:48.937162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:48.937176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:48.937180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:48.937183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:48.937186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:48.937812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:48.937835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:48.937843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:48.937850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:48.937854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:48.937857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:48.938341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:48.938365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:48.938375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:48.938378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:48.938382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:48.940426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:48.940445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:48.940456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392888940
2025-10-02T08:14:48.940575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:48.940588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:48.940598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:48.940605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:48.940609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:48.940616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:48.941082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:48.941104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:48.941109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:48.941112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:48.941115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:48.941119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:48.941570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:48.941593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:48.941601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:48.941606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:48.941611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:48.941614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:48.942068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:48.942090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:48.942096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:48.943178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:48.943194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:48.943199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:48.943203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:48.943211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392888942
2025-10-02T08:14:48.943512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:48.943531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:48.943536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:48.943539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:48.943543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:48.943547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:48.943981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:48.944003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:48.944009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:48.944012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:48.944016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:48.944021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:48.944486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:48.944503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:48.944622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392888944
2025-10-02T08:14:48.945391Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:48.945408Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:48.945417Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:48.945424Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:48.947018Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:48.947030Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:48.947032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:48.947040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534916174211971:10946]
2025-10-02T08:14:48.947043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534916174211971:10946]
2025-10-02T08:14:48.947095Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:48.947101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:48.947105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:48.947106Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:48.947109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:48.947239Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:48.982358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534916174212016:12248]
2025-10-02T08:14:48.982487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2177, pipe: [1:7556534916174212016:12248]
2025-10-02T08:14:49.075754Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:49.076055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534916174212016:12248], now have 1 active actors on pipe
2025-10-02T08:14:49.076165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534916174212016:12248]
2025-10-02T08:14:49.076198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:49.076199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:49.076221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2178 reason: error at write: Disconnected sessionId: src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0
2025-10-02T08:14:49.076273Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:49.076382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2178 sessionId: src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0 is DEAD
2025-10-02T08:14:49.076544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:49.076554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0] Write session will restart in 0.009938s
2025-10-02T08:14:49.076578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0] Write session: Do CDS request
2025-10-02T08:14:49.076583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:49.076675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:49.087254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.087319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:49.087338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2179
2025-10-02T08:14:49.087457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.087491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:49.087500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:49.087504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:49.087862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2179 sessionId:  describe result for acl check
2025-10-02T08:14:49.087899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:49.087905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:49.087906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:49.087910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534920469179737:10898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:49.088417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534920469179737:10898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:49.091322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534920469179737:10898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:49.094713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534920469179737:10898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:49.094728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534920469179737:10898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:49.094732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534920469179737:10898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:49.094740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:49.097034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:49.097685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:49.097889Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:49.097898Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:49.097908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:49.097958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:49.097993Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534920469179928:10919]
2025-10-02T08:14:49.098622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:49.098811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:49.098852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:49.099160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:49.099205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.099212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.099214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.099225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.099226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.099231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.099242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.099245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.099250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.099254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.099260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.099267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.099273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.099278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.099282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.099288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.099292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.099297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.099303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.099312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.099331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:49.110349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:49.112028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:49.112046Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:49.112049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:49.112056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:49.112062Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2178 [1:7556534920469179928:10919]
2025-10-02T08:14:49.112072Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:49.112088Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:49.112090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.112094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.112095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.112109Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:49.112116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:49.112122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:49.112181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.112246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.112249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:49.112251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:49.112311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:49.112318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.112330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.112340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:49.112357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2178
2025-10-02T08:14:49.112359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469179916:10898], now have 1 active actors on pipe
2025-10-02T08:14:49.112366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534920469179922:10919]
2025-10-02T08:14:49.112367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534920469179922:10919]
2025-10-02T08:14:49.112374Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:49.112383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:49.112385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:49.112386Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:49.112398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:49.112406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:49.112412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534920928705400:2378], now have 1 active actors on pipe
2025-10-02T08:14:49.112416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.112419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.112458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534920469179922:10919]
2025-10-02T08:14:49.112472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:49.112486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:49.112488Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:49.112497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.112500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.112501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:49.112509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.112516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:49.112546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.112629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.112636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.112647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.112676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2179 partition: 0 MaxSeqNo: 17 sessionId: src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0
2025-10-02T08:14:49.112923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2178
2025-10-02T08:14:49.113138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4b8648-fafc0142-8bb9bad2-7887e02a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:49.115579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0] Write session: try to update token
2025-10-02T08:14:49.115594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:49.130468Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:49.130483Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:49.130485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:49.130494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534920469179922:10919]
2025-10-02T08:14:49.130499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534920469179922:10919]
2025-10-02T08:14:49.130540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:49.130544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:49.130547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.130549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:49.130561Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:49.130692Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:49.132564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId: src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:49.134968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:49.176411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534920469179953:12248]
2025-10-02T08:14:49.176527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2178, pipe: [1:7556534920469179953:12248]
2025-10-02T08:14:49.260599Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:49.260815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.260828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.260861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469179953:12248], now have 1 active actors on pipe
2025-10-02T08:14:49.261018Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:49.261038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534920469179953:12248]
2025-10-02T08:14:49.261077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:49.261080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:49.261083Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:49.261142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2179 reason: error at write: Disconnected sessionId: src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0
2025-10-02T08:14:49.261308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2179 sessionId: src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0 is DEAD
2025-10-02T08:14:49.261419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:49.261425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0] Write session will restart in 0.007388s
2025-10-02T08:14:49.261451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0] Write session: Do CDS request
2025-10-02T08:14:49.261457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:49.270297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.270368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:49.270384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2180
2025-10-02T08:14:49.270517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.270541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:49.270546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:49.270549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:49.271100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2180 sessionId:  describe result for acl check
2025-10-02T08:14:49.271129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:49.271131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:49.271133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:49.271138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534920469180263:10911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:49.271784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534920469180263:10911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:49.274962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534920469180263:10911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:49.278384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534920469180263:10911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:49.278398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534920469180263:10911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:49.278402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534920469180263:10911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:49.278409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:49.283795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:49.285485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:49.285646Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:49.285655Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:49.285664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:49.285707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:49.285740Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534920469180570:10912]
2025-10-02T08:14:49.286358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:49.286529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:49.286566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:49.286858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:49.286898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.286903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.286904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.286905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.286907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.286911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.286921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.286925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.286929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.286933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.286939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.286946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.286952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.286957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.286961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.286967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.286971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.286976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.286986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.286991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.287013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:49.294876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:49.296732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:49.296750Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:49.296753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:49.296757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:49.296763Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2179 [1:7556534920469180570:10912]
2025-10-02T08:14:49.296775Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:49.296792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:49.296795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.296816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.296818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.296835Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:49.296840Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:49.296846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:49.296907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.296909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.296914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:49.296916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:49.296980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:49.296988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.297001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.297012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:49.297031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469180460:10911], now have 1 active actors on pipe
2025-10-02T08:14:49.297042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534920469180564:10912]
2025-10-02T08:14:49.297044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534920469180564:10912]
2025-10-02T08:14:49.297050Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:49.297066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:49.297083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:49.297086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:49.297092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534920928705409:2378], now have 1 active actors on pipe
2025-10-02T08:14:49.297099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2179
2025-10-02T08:14:49.297121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534920469180564:10912]
2025-10-02T08:14:49.297123Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:49.297163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:49.297171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:49.297177Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:49.297199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.297207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.297230Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|707c644a-387a5995-5a9805ba-adc63c84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:49.297241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.297249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.297255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:49.297262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.297276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:49.297244Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2179
2025-10-02T08:14:49.297298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.297380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.297387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.297399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.297436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2180 partition: 0 MaxSeqNo: 17 sessionId: src_id|707c644a-387a5995-5a9805ba-adc63c84_0
2025-10-02T08:14:49.297764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb587f88-48964ab6-7242dc5e-c1d0cb9b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|707c644a-387a5995-5a9805ba-adc63c84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:49.300163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|707c644a-387a5995-5a9805ba-adc63c84_0] Write session: try to update token
2025-10-02T08:14:49.300176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|707c644a-387a5995-5a9805ba-adc63c84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:49.314513Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:49.314531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:49.314534Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:49.314545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534920469180564:10912]
2025-10-02T08:14:49.314549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534920469180564:10912]
2025-10-02T08:14:49.314588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:49.314588Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:49.314594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:49.314594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.314596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:49.314723Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:49.319917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId: src_id|707c644a-387a5995-5a9805ba-adc63c84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:49.322361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:49.361239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534920469180594:12248]
2025-10-02T08:14:49.361324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2179, pipe: [1:7556534920469180594:12248]
2025-10-02T08:14:49.464441Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:49.464902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.464913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.464951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469180594:12248], now have 1 active actors on pipe
2025-10-02T08:14:49.468944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:49.468744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534920469180594:12248]
2025-10-02T08:14:49.468847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:49.468849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:49.468906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2180 reason: error at write: Disconnected sessionId: src_id|707c644a-387a5995-5a9805ba-adc63c84_0
2025-10-02T08:14:49.469057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2180 sessionId: src_id|707c644a-387a5995-5a9805ba-adc63c84_0 is DEAD
2025-10-02T08:14:49.469264Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:49.469493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707c644a-387a5995-5a9805ba-adc63c84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:49.469500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707c644a-387a5995-5a9805ba-adc63c84_0] Write session will restart in 0.007650s
2025-10-02T08:14:49.469526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707c644a-387a5995-5a9805ba-adc63c84_0] Write session: Do CDS request
2025-10-02T08:14:49.469533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707c644a-387a5995-5a9805ba-adc63c84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:49.478260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|707c644a-387a5995-5a9805ba-adc63c84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.481079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:49.481098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2181
2025-10-02T08:14:49.481274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.481316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:49.481326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:49.481329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:49.481820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2181 sessionId:  describe result for acl check
2025-10-02T08:14:49.481859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:49.481861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:49.481863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:49.481867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534920469181049:10905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:49.482388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534920469181049:10905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:49.485379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534920469181049:10905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:49.488915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:49.489217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534920469181049:10905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:49.489230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534920469181049:10905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:49.489233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534920469181049:10905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:49.489242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:49.490518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:49.490660Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:49.490666Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:49.490674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:49.490711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:49.490744Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534920469181215:10906]
2025-10-02T08:14:49.491287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:49.491461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:49.491494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:49.491749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:49.491795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.491800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.491801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.491803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.491804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.491808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.491818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.491823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.491827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.491831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.491836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.491843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.491848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.491853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.491857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.491862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.491867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.491872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.491876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.491882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.491899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:49.499979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:49.502012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:49.502028Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:49.502031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:49.502034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:49.502041Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2180 [1:7556534920469181215:10906]
2025-10-02T08:14:49.502052Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:49.502067Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:49.502070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.502072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.502074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.502089Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:49.502094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:49.502099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:49.502158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.502165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.502168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:49.502170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:49.502229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:49.502236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.502248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.502262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:49.502282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534920469181203:10906]
2025-10-02T08:14:49.502288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534920469181203:10906]
2025-10-02T08:14:49.502295Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:49.502309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469181210:10905], now have 1 active actors on pipe
2025-10-02T08:14:49.502313Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:49.502316Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:49.502320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:49.502332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:49.502335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:49.502340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534920928705415:2378], now have 1 active actors on pipe
2025-10-02T08:14:49.502367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534920469181203:10906]
2025-10-02T08:14:49.502374Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:49.502410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2180
2025-10-02T08:14:49.502503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:49.502523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.502531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.502552Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61574b3c-750a2004-98d9529c-a6f52341_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:49.502561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.502564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.502566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:49.502575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.502587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:49.502605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.502794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.502803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.502816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.502849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2181 partition: 0 MaxSeqNo: 17 sessionId: src_id|61574b3c-750a2004-98d9529c-a6f52341_0
2025-10-02T08:14:49.503168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707c644a-387a5995-5a9805ba-adc63c84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|61574b3c-750a2004-98d9529c-a6f52341_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:49.504298Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2180
2025-10-02T08:14:49.505697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61574b3c-750a2004-98d9529c-a6f52341_0] Write session: try to update token
2025-10-02T08:14:49.505711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61574b3c-750a2004-98d9529c-a6f52341_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:49.519989Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:49.520004Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:49.520006Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:49.520012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534920469181203:10906]
2025-10-02T08:14:49.520015Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534920469181203:10906]
2025-10-02T08:14:49.520048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:49.520054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.520055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:49.520059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:49.520065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:49.520175Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:49.522301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId: src_id|61574b3c-750a2004-98d9529c-a6f52341_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:49.524725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:49.569092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534920469181243:12248]
2025-10-02T08:14:49.569230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2180, pipe: [1:7556534920469181243:12248]
2025-10-02T08:14:49.653779Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:49.653962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.653972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.653999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469181243:12248], now have 1 active actors on pipe
2025-10-02T08:14:49.654070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534920469181243:12248]
2025-10-02T08:14:49.654091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:49.654097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:49.654112Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:49.654148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2181 reason: error at write: Disconnected sessionId: src_id|61574b3c-750a2004-98d9529c-a6f52341_0
2025-10-02T08:14:49.654296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2181 sessionId: src_id|61574b3c-750a2004-98d9529c-a6f52341_0 is DEAD
2025-10-02T08:14:49.654438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61574b3c-750a2004-98d9529c-a6f52341_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:49.654448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61574b3c-750a2004-98d9529c-a6f52341_0] Write session will restart in 0.007317s
2025-10-02T08:14:49.654470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61574b3c-750a2004-98d9529c-a6f52341_0] Write session: Do CDS request
2025-10-02T08:14:49.654478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61574b3c-750a2004-98d9529c-a6f52341_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:49.654732Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:49.663251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61574b3c-750a2004-98d9529c-a6f52341_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.663315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:49.663329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2182
2025-10-02T08:14:49.663455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.663506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:49.663515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:49.663518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:49.663889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2182 sessionId:  describe result for acl check
2025-10-02T08:14:49.663917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:49.663923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:49.663924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:49.663928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534920469181590:10884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:49.664403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534920469181590:10884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:49.666435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534920469181590:10884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:49.670069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534920469181590:10884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:49.670082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534920469181590:10884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:49.670084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534920469181590:10884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:49.670091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:49.674924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:49.675203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:49.675361Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:49.675369Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:49.675379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:49.675427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:49.675460Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534920469181866:10888]
2025-10-02T08:14:49.676089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:49.676247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:49.676281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:49.676570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:49.676605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.676610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.676611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.676611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.676612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.676616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.676625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.676629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.676633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.676636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.676641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.676647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.676652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.676656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.676659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.676663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.676667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.676670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.676676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.676680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.676695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:49.684418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:49.686183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:49.686198Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:49.686200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:49.686203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:49.686209Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2181 [1:7556534920469181866:10888]
2025-10-02T08:14:49.686219Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:49.686235Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:49.686241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.686244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.686246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.686261Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:49.686270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:49.686276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:49.686338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.686346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.686350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:49.686351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:49.686419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:49.686426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.686436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.686446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:49.686465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469181801:10884], now have 1 active actors on pipe
2025-10-02T08:14:49.686465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2181
2025-10-02T08:14:49.686477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534920469181860:10888]
2025-10-02T08:14:49.686479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534920469181860:10888]
2025-10-02T08:14:49.686488Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:49.686497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.686501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.686516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534920928705432:2378], now have 1 active actors on pipe
2025-10-02T08:14:49.686519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:49.686523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:49.686523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:49.686535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:49.686537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:49.686574Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:49.686579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.686582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.686584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:49.686591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.686600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:49.686606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534920469181860:10888]
2025-10-02T08:14:49.686615Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:49.686640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.686644Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:49.686686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.686692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.686704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.686687Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2181
2025-10-02T08:14:49.686745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2182 partition: 0 MaxSeqNo: 17 sessionId: src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0
2025-10-02T08:14:49.687017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61574b3c-750a2004-98d9529c-a6f52341_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:49.689501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0] Write session: try to update token
2025-10-02T08:14:49.689515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:49.703159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId: src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:49.705425Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:49.705443Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:49.705445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:49.705454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534920469181860:10888]
2025-10-02T08:14:49.705458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534920469181860:10888]
2025-10-02T08:14:49.705500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:49.705507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.705510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:49.705517Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:49.705522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:49.705648Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:49.705727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:49.754451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534920469181903:12248]
2025-10-02T08:14:49.754547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2181, pipe: [1:7556534920469181903:12248]
2025-10-02T08:14:49.835610Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:49.836285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.836299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.836337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469181903:12248], now have 1 active actors on pipe
2025-10-02T08:14:49.836451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534920469181903:12248]
2025-10-02T08:14:49.836471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:49.836473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:49.836529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2182 reason: error at write: Disconnected sessionId: src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0
2025-10-02T08:14:49.836537Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:49.836575Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:49.836673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2182 sessionId: src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0 is DEAD
2025-10-02T08:14:49.836829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:49.836839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0] Write session will restart in 0.005726s
2025-10-02T08:14:49.836863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0] Write session: Do CDS request
2025-10-02T08:14:49.836869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:49.843222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.843341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:49.843353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2183
2025-10-02T08:14:49.843447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:49.843474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:49.843483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:49.843486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:49.844019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2183 sessionId:  describe result for acl check
2025-10-02T08:14:49.844048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:49.844054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:49.844056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:49.844060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534920469182183:10858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:49.844534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534920469182183:10858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:49.847053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534920469182183:10858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:49.850213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534920469182183:10858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:49.850224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534920469182183:10858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:49.850227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534920469182183:10858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:49.850234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:49.854869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:49.856514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:49.856669Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:49.856676Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:49.856684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:49.856722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:49.856756Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534920469182528:10872]
2025-10-02T08:14:49.857324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:49.857552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:49.857606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:49.857910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:49.857955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.857961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.857962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.857963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.857964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.857969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.857979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.857983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.857987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.857991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.857998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.858010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:49.858016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.858025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:49.858030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.858035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:49.858040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.858045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.858050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.858055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.858072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:49.865603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:49.867300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:49.867315Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:49.867317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:49.867320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:49.867327Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2182 [1:7556534920469182528:10872]
2025-10-02T08:14:49.867337Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:49.867353Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:49.867357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.867360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.867362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.867378Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:49.867388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:49.867394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:49.867454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.867460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.867463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:49.867465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:49.867524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:49.867531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.867543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:49.867554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:49.867573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2182
2025-10-02T08:14:49.867575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469182423:10858], now have 1 active actors on pipe
2025-10-02T08:14:49.867582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534920469182522:10872]
2025-10-02T08:14:49.867584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534920469182522:10872]
2025-10-02T08:14:49.867597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:49.867610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534920928705442:2378], now have 1 active actors on pipe
2025-10-02T08:14:49.867611Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:49.867621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:49.867622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.867625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.867640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:49.867658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:49.867665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:49.867677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2182
2025-10-02T08:14:49.867708Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:49.867718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:49.867722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:49.867724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:49.867734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:49.867742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:49.867749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534920469182522:10872]
2025-10-02T08:14:49.867758Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:49.867773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:49.867785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.867867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:49.867875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:49.867889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:49.867927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2183 partition: 0 MaxSeqNo: 17 sessionId: src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0
2025-10-02T08:14:49.868235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b910e49b-b2311bf8-36fccc55-22733b7b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:49.870592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0] Write session: try to update token
2025-10-02T08:14:49.870605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:49.883688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId: src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:49.884723Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:49.884736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:49.884738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:49.884746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534920469182522:10872]
2025-10-02T08:14:49.884753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534920469182522:10872]
2025-10-02T08:14:49.884795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:49.884813Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:49.884819Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:49.884819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:49.884822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:49.884959Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:49.886370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:49.936692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534920469182582:12248]
2025-10-02T08:14:49.936791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2182, pipe: [1:7556534920469182582:12248]
2025-10-02T08:14:50.018302Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:50.018659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.018671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.018711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534920469182582:12248], now have 1 active actors on pipe
2025-10-02T08:14:50.018813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:50.018824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:50.018884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2183 reason: error at write: Disconnected sessionId: src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0
2025-10-02T08:14:50.018908Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:50.018952Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:50.019042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2183 sessionId: src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0 is DEAD
2025-10-02T08:14:50.019190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:50.019200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0] Write session will restart in 0.007507s
2025-10-02T08:14:50.019224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0] Write session: Do CDS request
2025-10-02T08:14:50.019229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:50.019227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534920469182582:12248]
2025-10-02T08:14:50.028279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.028338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:50.028351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2184
2025-10-02T08:14:50.028465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.028492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:50.028501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:50.028504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:50.029037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2184 sessionId:  describe result for acl check
2025-10-02T08:14:50.029064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:50.029066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:50.029067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:50.029071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534924764150285:10835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:50.029548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534924764150285:10835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:50.031930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534924764150285:10835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:50.035447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534924764150285:10835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:50.035457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534924764150285:10835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:50.035459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534924764150285:10835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:50.035465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:50.037848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:50.038244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:50.038388Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:50.038397Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:50.038405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:50.038444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:50.038478Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534924764150510:10833]
2025-10-02T08:14:50.039109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:50.039264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:50.039300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:50.039574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:50.039612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.039613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.039614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.039615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.039616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.039621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.039631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.039634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.039638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.039641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.039646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.039653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.039659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.039664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.039669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.039674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.039678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.039683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.039690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.039695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.039713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:50.047485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:50.049026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:50.049038Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:50.049041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:50.049045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:50.049050Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2183 [1:7556534924764150510:10833]
2025-10-02T08:14:50.049061Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:50.049079Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:50.049082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.049084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.049086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.049100Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:50.049105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:50.049110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:50.049163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.049171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.049174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:50.049176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:50.049236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:50.049243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.049254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.049260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2183
2025-10-02T08:14:50.049267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:50.049285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764150492:10835], now have 1 active actors on pipe
2025-10-02T08:14:50.049292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534925223672767:2378], now have 1 active actors on pipe
2025-10-02T08:14:50.049296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.049299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.049314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534924764150504:10833]
2025-10-02T08:14:50.049320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534924764150504:10833]
2025-10-02T08:14:50.049331Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:50.049349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:50.049356Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:50.049361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:50.049363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:50.049366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:50.049380Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:50.049387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.049391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.049392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:50.049367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2183
2025-10-02T08:14:50.049400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.049409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:50.049436Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534924764150504:10833]
2025-10-02T08:14:50.049447Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:50.049463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.049466Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:50.049503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.049509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.049522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.049559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2184 partition: 0 MaxSeqNo: 17 sessionId: src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0
2025-10-02T08:14:50.049855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c9f66a-4441fd52-9de5f0a7-b313adfe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:50.052118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0] Write session: try to update token
2025-10-02T08:14:50.052132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:50.060485Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:50.060504Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:50.060512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534924764150504:10833]
2025-10-02T08:14:50.060540Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:50.060549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:50.060704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:50.060863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.060995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.061124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.061302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:50.061339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:50.064430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId: src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:50.066766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:50.066826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.066838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.066867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:50.066887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:50.066937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.066950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.067115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.067176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.067239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.067305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.067517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.067529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.067592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.067652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.067711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.067777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.067819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.067825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.067890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.067950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.068008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.068067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.068112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.068120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.068202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.068265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.068321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.068374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.068413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.068418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.068479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.068530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.068587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.068641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.068680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.068685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.068750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.068827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.068892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.068954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.068993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.068998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.069058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.069110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.069167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.069220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.069261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.069265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.069323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.069374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.069428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.069486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.069526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.069530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.069588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.069637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.069690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.069742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.069779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.069784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.069838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.069891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.069946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.070004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.070054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.070061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.070095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:50.070150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.070166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.070171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:50.070196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:50.070208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:50.070213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:50.070215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:50.070216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:50.070546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:50.070566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:50.070570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:50.070575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:50.070577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:50.070579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:50.071244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:50.071262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:50.071266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:50.071272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:50.071274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:50.071277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:50.071682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:50.071700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:50.071704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:50.071706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:50.071707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:50.072816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:50.072831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:50.072842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392890072
2025-10-02T08:14:50.073007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:50.073021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:50.073026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:50.073030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:50.073033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:50.073036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:50.073476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:50.073496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:50.073500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:50.073503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:50.073505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:50.073507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:50.073941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:50.073962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:50.073975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:50.073982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:50.073985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:50.073988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:50.074456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:50.074484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:50.074494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:50.075450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:50.075468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:50.075471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:50.075474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:50.075481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392890075
2025-10-02T08:14:50.075772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:50.075794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:50.075801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:50.075804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:50.075807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:50.075810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:50.076218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:50.076233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:50.076237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:50.076239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:50.076241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:50.076243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:50.076632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:50.076647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.076729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392890076
2025-10-02T08:14:50.077409Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:50.077424Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:50.077427Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:50.077432Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:50.078799Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:50.078809Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:50.078810Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:50.078816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534924764150504:10833]
2025-10-02T08:14:50.078819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534924764150504:10833]
2025-10-02T08:14:50.078860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:50.078866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.078867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:50.078882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:50.078897Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:50.078978Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:50.119481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534924764150544:12248]
2025-10-02T08:14:50.119560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2183, pipe: [1:7556534924764150544:12248]
2025-10-02T08:14:50.209352Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:50.209648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764150544:12248], now have 1 active actors on pipe
2025-10-02T08:14:50.209898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:50.209845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:50.209850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:50.209870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2184 reason: error at write: Disconnected sessionId: src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0
2025-10-02T08:14:50.209909Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:50.209996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2184 sessionId: src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0 is DEAD
2025-10-02T08:14:50.210099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534924764150544:12248]
2025-10-02T08:14:50.212888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:50.212899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0] Write session will restart in 0.008894s
2025-10-02T08:14:50.212923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0] Write session: Do CDS request
2025-10-02T08:14:50.212929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:50.225163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.228923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:50.228936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2185
2025-10-02T08:14:50.229081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.229117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:50.229120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:50.229123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:50.229605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2185 sessionId:  describe result for acl check
2025-10-02T08:14:50.229631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:50.229633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:50.229634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:50.229639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534924764151118:10799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:50.231547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534924764151118:10799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:50.231828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:50.233382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:50.233546Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:50.233564Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:50.233573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:50.233619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:50.233661Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534924764151154:10795]
2025-10-02T08:14:50.234247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:50.234790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534924764151118:10799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:50.234861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:50.234901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:50.235187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:50.235220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.235225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.235226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.235227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.235228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.235232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.235240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.235243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.235247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.235250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.235255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.235261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.235266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.235271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.235275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.235279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.235283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.235287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.235296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.235301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.235316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:50.240066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534924764151118:10799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:50.240080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534924764151118:10799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:50.240083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534924764151118:10799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:50.240091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:50.243521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:50.245163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:50.245175Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:50.245178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:50.245181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:50.245186Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2184 [1:7556534924764151154:10795]
2025-10-02T08:14:50.245197Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:50.245216Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:50.245223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.245226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.245228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.245242Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:50.245253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:50.245259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:50.245313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.245320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.245323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:50.245325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:50.245384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:50.245392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.245403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.245416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:50.245431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764151180:10799], now have 1 active actors on pipe
2025-10-02T08:14:50.245437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534924764151133:10795]
2025-10-02T08:14:50.245439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534924764151133:10795]
2025-10-02T08:14:50.245446Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:50.245457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534925223672775:2378], now have 1 active actors on pipe
2025-10-02T08:14:50.245462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:50.245466Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:50.245470Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:50.245474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:50.245477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:50.245504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534924764151133:10795]
2025-10-02T08:14:50.245511Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:50.245531Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:50.245547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2184
2025-10-02T08:14:50.245569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.245573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.245594Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4fdad13-560e3028-d2306217-22329812_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:50.245604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.245610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.245617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:50.245624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.245632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:50.245650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.245708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.245714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.245725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.245752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2185 partition: 0 MaxSeqNo: 17 sessionId: src_id|a4fdad13-560e3028-d2306217-22329812_0
2025-10-02T08:14:50.245926Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2184
2025-10-02T08:14:50.248916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e80070-2f0cfc9c-263c7b2b-17ca4a70_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a4fdad13-560e3028-d2306217-22329812_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:50.251421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fdad13-560e3028-d2306217-22329812_0] Write session: try to update token
2025-10-02T08:14:50.251438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fdad13-560e3028-d2306217-22329812_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:50.263314Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:50.263336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:50.263338Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:50.263347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534924764151133:10795]
2025-10-02T08:14:50.263351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534924764151133:10795]
2025-10-02T08:14:50.263393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:50.263391Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:50.263400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:50.263401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.263403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:50.263549Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:50.265958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId: src_id|a4fdad13-560e3028-d2306217-22329812_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:50.268469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:50.310468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534924764151195:12248]
2025-10-02T08:14:50.310594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2184, pipe: [1:7556534924764151195:12248]
2025-10-02T08:14:50.399160Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:50.399454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.399466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.399500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764151195:12248], now have 1 active actors on pipe
2025-10-02T08:14:50.399604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:50.399613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:50.399682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2185 reason: error at write: Disconnected sessionId: src_id|a4fdad13-560e3028-d2306217-22329812_0
2025-10-02T08:14:50.399717Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:50.399733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:50.399858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2185 sessionId: src_id|a4fdad13-560e3028-d2306217-22329812_0 is DEAD
2025-10-02T08:14:50.399995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fdad13-560e3028-d2306217-22329812_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:50.400003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fdad13-560e3028-d2306217-22329812_0] Write session will restart in 0.005941s
2025-10-02T08:14:50.400025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fdad13-560e3028-d2306217-22329812_0] Write session: Do CDS request
2025-10-02T08:14:50.400031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fdad13-560e3028-d2306217-22329812_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:50.400031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534924764151195:12248]
2025-10-02T08:14:50.407275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fdad13-560e3028-d2306217-22329812_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.407340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:50.407357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2186
2025-10-02T08:14:50.407495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.407526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:50.407539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:50.407542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:50.408045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2186 sessionId:  describe result for acl check
2025-10-02T08:14:50.408086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:50.408091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:50.408093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:50.408098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534924764151479:10771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:50.408580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534924764151479:10771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:50.411492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534924764151479:10771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:50.414625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534924764151479:10771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:50.414636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534924764151479:10771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:50.414639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534924764151479:10771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:50.414644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:50.420178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:50.422211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:50.422346Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:50.422354Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:50.422360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:50.422389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:50.422414Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534924764151823:10781]
2025-10-02T08:14:50.422827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:50.422989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:50.423018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:50.423215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:50.423247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.423248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.423249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.423250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.423250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.423253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.423260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.423262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.423264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.423266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.423270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.423274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.423277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.423280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.423282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.423285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.423287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.423289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.423292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.423295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.423304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:50.434893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:50.436691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:50.436713Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:50.436716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:50.436720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:50.436726Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2185 [1:7556534924764151823:10781]
2025-10-02T08:14:50.436738Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:50.436756Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:50.436760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.436764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.436766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.436783Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:50.436795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:50.436826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:50.436905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.436912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.436915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:50.436918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:50.436994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:50.437002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.437015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.437025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:50.437045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764151709:10771], now have 1 active actors on pipe
2025-10-02T08:14:50.437051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534924764151817:10781]
2025-10-02T08:14:50.437054Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534924764151817:10781]
2025-10-02T08:14:50.437061Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:50.437065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2185
2025-10-02T08:14:50.437073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534925223672782:2378], now have 1 active actors on pipe
2025-10-02T08:14:50.437081Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:50.437085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:50.437085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:50.437099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:50.437102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:50.437109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.437114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.437157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534924764151817:10781]
2025-10-02T08:14:50.437167Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:50.437151Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2185
2025-10-02T08:14:50.437182Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:50.437187Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9616c0c-5e9d6036-9928691f-91712b12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:50.437194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.437197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.437199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:50.437208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.437218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:50.437264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.437354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.437362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.437375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.437423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2186 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9616c0c-5e9d6036-9928691f-91712b12_0
2025-10-02T08:14:50.437734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fdad13-560e3028-d2306217-22329812_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9616c0c-5e9d6036-9928691f-91712b12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:50.440580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9616c0c-5e9d6036-9928691f-91712b12_0] Write session: try to update token
2025-10-02T08:14:50.440600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9616c0c-5e9d6036-9928691f-91712b12_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:50.448300Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:50.448317Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:50.448326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534924764151817:10781]
2025-10-02T08:14:50.448364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:50.448379Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:50.448555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:50.448718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.448905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.449061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.449270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:50.449311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:50.454714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId: src_id|a9616c0c-5e9d6036-9928691f-91712b12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:50.457374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:50.457440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.457453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.457491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:50.457514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:50.457568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.457583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.457753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.457832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.457908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.457975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.458023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.458032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.458105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.458170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.458240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.458314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.458362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.458369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.458436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.458500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.458564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.458628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.458671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.458678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.458745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.458814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.458885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.458954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.459001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.459008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.459077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.459141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.459208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.459277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.459323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.459331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.459399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.459462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.459533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.459601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.459748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.459755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.459825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.459893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.459964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.460033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.460078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.460085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.460165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.460246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.460314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.460376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.460419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.460421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.460492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.460556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.460627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.460697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.460740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.460748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.460833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.460900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.460968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.461035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.461087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.461094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.461139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:50.461211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.461239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.461244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:50.461274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:50.461293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:50.461296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:50.461299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:50.461302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:50.461703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:50.461726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:50.461736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:50.461739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:50.461743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:50.461745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:50.462438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:50.462463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:50.462469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:50.462472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:50.462475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:50.462478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:50.462927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:50.462949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:50.462954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:50.462957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:50.462961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:50.464995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:50.465013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:50.465024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392890464
2025-10-02T08:14:50.465227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:50.465240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:50.465245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:50.465250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:50.465254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:50.465259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:50.465688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:50.465707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:50.465711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:50.465716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:50.465720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:50.465723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:50.466136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:50.466155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:50.466164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:50.466167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:50.466170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:50.466173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:50.466623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:50.466642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:50.466648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:50.467763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:50.467782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:50.467788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:50.467792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:50.467806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392890467
2025-10-02T08:14:50.468092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:50.468114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:50.468120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:50.468125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:50.468129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:50.468132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:50.468611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:50.468636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:50.468641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:50.468645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:50.468649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:50.468654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:50.469164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:50.469187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.469296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392890469
2025-10-02T08:14:50.472694Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:50.472712Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:50.472719Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:50.472725Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:50.474275Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:50.474287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:50.474289Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:50.474301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534924764151817:10781]
2025-10-02T08:14:50.474305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534924764151817:10781]
2025-10-02T08:14:50.474365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:50.474373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.474375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:50.474504Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:50.474518Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:50.474524Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:50.500442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534924764151860:12248]
2025-10-02T08:14:50.500624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2185, pipe: [1:7556534924764151860:12248]
2025-10-02T08:14:50.611839Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:50.612444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764151860:12248], now have 1 active actors on pipe
2025-10-02T08:14:50.612575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534924764151860:12248]
2025-10-02T08:14:50.612598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:50.612604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:50.612630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2186 reason: error at write: Disconnected sessionId: src_id|a9616c0c-5e9d6036-9928691f-91712b12_0
2025-10-02T08:14:50.612654Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:50.612696Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:50.612810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2186 sessionId: src_id|a9616c0c-5e9d6036-9928691f-91712b12_0 is DEAD
2025-10-02T08:14:50.612934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9616c0c-5e9d6036-9928691f-91712b12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:50.612952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9616c0c-5e9d6036-9928691f-91712b12_0] Write session will restart in 0.005227s
2025-10-02T08:14:50.612975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9616c0c-5e9d6036-9928691f-91712b12_0] Write session: Do CDS request
2025-10-02T08:14:50.612980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9616c0c-5e9d6036-9928691f-91712b12_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:50.619257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9616c0c-5e9d6036-9928691f-91712b12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.619346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:50.619362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2187
2025-10-02T08:14:50.619490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.619518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:50.619527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:50.619530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:50.619907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2187 sessionId:  describe result for acl check
2025-10-02T08:14:50.619939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:50.619941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:50.619942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:50.619947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534924764152130:10757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:50.620429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534924764152130:10757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:50.623316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534924764152130:10757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:50.626299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534924764152130:10757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:50.626311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534924764152130:10757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:50.626315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534924764152130:10757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:50.626321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:50.632796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:50.636885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:50.637088Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:50.637096Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:50.637106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:50.637157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:50.637196Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534924764152579:10759]
2025-10-02T08:14:50.637700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:50.637949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:50.638004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:50.638305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:50.638357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.638362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.638364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.638365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.638366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.638372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.638381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.638385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.638389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.638392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.638398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.638405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.638415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.638419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.638423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.638427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.638431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.638436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.638441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.638446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.638463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:50.646612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:50.648236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:50.648249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:50.648251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:50.648254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:50.648259Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2186 [1:7556534924764152579:10759]
2025-10-02T08:14:50.648267Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:50.648282Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:50.648284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.648286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.648288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.648300Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:50.648302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:50.648308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:50.648356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.648362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.648364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:50.648366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:50.648416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:50.648424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.648432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.648439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:50.648454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764152418:10757], now have 1 active actors on pipe
2025-10-02T08:14:50.648456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534925223672789:2378], now have 1 active actors on pipe
2025-10-02T08:14:50.648460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2186
2025-10-02T08:14:50.648461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534924764152573:10759]
2025-10-02T08:14:50.648462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534924764152573:10759]
2025-10-02T08:14:50.648468Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:50.648475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:50.648477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.648478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:50.648481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.648498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:50.648513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:50.648520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:50.648565Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f410efd2-a1148e53-19565b89-e9080207_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:50.648575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.648579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.648580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:50.648562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2186
2025-10-02T08:14:50.648589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.648597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:50.648603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534924764152573:10759]
2025-10-02T08:14:50.648607Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:50.648609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:50.648627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.648698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.648705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.648717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.648750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2187 partition: 0 MaxSeqNo: 17 sessionId: src_id|f410efd2-a1148e53-19565b89-e9080207_0
2025-10-02T08:14:50.649061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9616c0c-5e9d6036-9928691f-91712b12_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f410efd2-a1148e53-19565b89-e9080207_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:50.651659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f410efd2-a1148e53-19565b89-e9080207_0] Write session: try to update token
2025-10-02T08:14:50.651676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f410efd2-a1148e53-19565b89-e9080207_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:50.666133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId: src_id|f410efd2-a1148e53-19565b89-e9080207_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:50.666996Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:50.667015Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:50.667017Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:50.667026Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534924764152573:10759]
2025-10-02T08:14:50.667030Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534924764152573:10759]
2025-10-02T08:14:50.667073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:50.667083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.667085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:50.667089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:50.667094Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:50.667228Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:50.668745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:50.712882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534924764152607:12248]
2025-10-02T08:14:50.713000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2186, pipe: [1:7556534924764152607:12248]
2025-10-02T08:14:50.802598Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:50.802996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.803010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.803048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764152607:12248], now have 1 active actors on pipe
2025-10-02T08:14:50.803155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:50.803165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:50.803223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2187 reason: error at write: Disconnected sessionId: src_id|f410efd2-a1148e53-19565b89-e9080207_0
2025-10-02T08:14:50.803293Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:50.803365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2187 sessionId: src_id|f410efd2-a1148e53-19565b89-e9080207_0 is DEAD
2025-10-02T08:14:50.803494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f410efd2-a1148e53-19565b89-e9080207_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:50.803508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f410efd2-a1148e53-19565b89-e9080207_0] Write session will restart in 0.005450s
2025-10-02T08:14:50.803528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f410efd2-a1148e53-19565b89-e9080207_0] Write session: Do CDS request
2025-10-02T08:14:50.803532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f410efd2-a1148e53-19565b89-e9080207_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:50.803559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534924764152607:12248]
2025-10-02T08:14:50.803770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:50.810281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f410efd2-a1148e53-19565b89-e9080207_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.810354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:50.810368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2188
2025-10-02T08:14:50.810462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:50.810490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:50.810500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:50.810504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:50.810936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2188 sessionId:  describe result for acl check
2025-10-02T08:14:50.810972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:50.810978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:50.810980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:50.810985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534924764152959:10741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:50.811452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534924764152959:10741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:50.813758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534924764152959:10741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:50.816659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534924764152959:10741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:50.816670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534924764152959:10741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:50.816673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534924764152959:10741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:50.816680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:50.821765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:50.822073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:50.822218Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:50.822226Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:50.822232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:50.822260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:50.822284Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534924764153336:10742]
2025-10-02T08:14:50.822798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:50.822973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:50.823003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:50.823201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:50.823227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.823231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.823232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.823233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.823233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.823237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.823244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.823246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.823248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.823249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.823253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.823258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:50.823261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.823264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:50.823266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.823269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:50.823271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.823274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.823276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.823278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.823288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:50.832339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:50.833994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:50.834012Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:50.834016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:50.834019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:50.834026Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2187 [1:7556534924764153336:10742]
2025-10-02T08:14:50.834037Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:50.834054Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:50.834057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.834060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.834063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.834078Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:50.834083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:50.834090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:50.834159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.834173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.834176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:50.834179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:50.834244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:50.834252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.834264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:50.834276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:50.834297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534924764153330:10742]
2025-10-02T08:14:50.834303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534924764153330:10742]
2025-10-02T08:14:50.834311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:50.834329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:50.834348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:50.834355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:50.834387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534924764153330:10742]
2025-10-02T08:14:50.834395Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:50.834399Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:50.834402Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:50.834405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764153200:10741], now have 1 active actors on pipe
2025-10-02T08:14:50.834408Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:50.834422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2187
2025-10-02T08:14:50.834451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.834460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.834484Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:50.834497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.834501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.834503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:50.834511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.834520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:50.834530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534925223672810:2378], now have 1 active actors on pipe
2025-10-02T08:14:50.834538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.834718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.834726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.834740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:50.834781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2188 partition: 0 MaxSeqNo: 17 sessionId: src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0
2025-10-02T08:14:50.834779Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2187
2025-10-02T08:14:50.835078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f410efd2-a1148e53-19565b89-e9080207_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:50.837712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0] Write session: try to update token
2025-10-02T08:14:50.837728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:50.847518Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:50.847546Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:50.847558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534924764153330:10742]
2025-10-02T08:14:50.847596Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:50.847615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:50.847979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:50.848260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.848519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.848790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:50.849331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:50.849401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:50.851436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId: src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:50.853873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:50.853929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.853942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.853972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:50.853994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:50.854039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:50.854054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:50.854199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.854262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.854318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.854373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.854425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.854434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.854523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.854590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.854654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.854728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.854775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.854782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.854855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.854920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.854986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.855054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.855104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.855112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.855183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.855250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.855319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.855390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.855440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.855451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.855524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.855584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.855650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.855715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.855762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.855764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.855831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.855897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.855962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.856029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.856074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.856077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.856150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.856226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.856297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.856360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.856403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.856406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.856475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.856537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.856601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.856662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.856706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.856709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.856777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.856866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.856930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.856994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.857041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.857045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.857116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:50.857177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:50.857238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:50.857304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:50.857369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:50.857373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:50.857406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:50.857457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:50.857472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:50.857474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:50.857499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:50.857510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:50.857512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:50.857514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:50.857516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:50.857877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:50.857894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:50.857901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:50.857904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:50.857907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:50.857910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:50.858585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:50.858601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:50.858608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:50.858611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:50.858614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:50.858617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:50.859554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:50.859582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:50.859588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:50.859591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:50.859594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:50.866673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:50.866699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:50.866714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392890866
2025-10-02T08:14:50.866903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:50.866922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:50.866929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:50.866933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:50.866937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:50.866941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:50.867462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:50.867489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:50.867498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:50.867502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:50.867506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:50.867511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:50.868025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:50.868052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:50.868063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:50.868068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:50.868073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:50.868076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:50.868565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:50.868589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:50.868595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:50.869725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:50.869748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:50.869754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:50.869758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:50.869766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392890869
2025-10-02T08:14:50.870073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:50.870095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:50.870104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:50.870108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:50.870111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:50.870114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:50.870606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:50.870631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:50.870638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:50.870642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:50.870647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:50.870650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:50.871168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:50.871190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:50.871293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392890871
2025-10-02T08:14:50.872086Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:50.872121Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:50.872128Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:50.872137Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:50.873807Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:50.873821Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:50.873822Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:50.873830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534924764153330:10742]
2025-10-02T08:14:50.873835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534924764153330:10742]
2025-10-02T08:14:50.873882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:50.873889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:50.873891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:50.873892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:50.873908Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:50.874013Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:50.903890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534924764153369:12248]
2025-10-02T08:14:50.904078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2187, pipe: [1:7556534924764153369:12248]
2025-10-02T08:14:51.013583Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:51.014724Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:51.013931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534924764153369:12248], now have 1 active actors on pipe
2025-10-02T08:14:51.014105Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:51.014696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:51.014721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0
2025-10-02T08:14:51.014876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2188 sessionId: src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0 is DEAD
2025-10-02T08:14:51.014985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534924764153369:12248]
2025-10-02T08:14:51.016661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:51.016673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0] Write session will restart in 0.005652s
2025-10-02T08:14:51.016698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0] Write session: Do CDS request
2025-10-02T08:14:51.016705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:51.023787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:51.023798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2189
2025-10-02T08:14:51.024072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.024322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.024353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:51.024358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:51.024361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:51.025380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2189 sessionId:  describe result for acl check
2025-10-02T08:14:51.025416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:51.025422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:51.025425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:51.025430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534929059120743:10712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:51.025869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534929059120743:10712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:51.028543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534929059120743:10712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:51.034284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534929059120743:10712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:51.034298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534929059120743:10712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:51.034301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534929059120743:10712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:51.034309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:51.048321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:51.048665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:51.048839Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:51.048849Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:51.048859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:51.048905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:51.048941Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534929059121418:10711]
2025-10-02T08:14:51.049597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:51.049755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:51.049794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:51.050101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:51.050141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.050147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.050148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.050150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.050151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.050156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.050166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.050171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.050175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.050179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.050184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.050192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.050198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.050209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.050214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.050219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.050226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.050231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.050241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.050247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.050273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:51.058496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:51.060243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:51.060260Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:51.060263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:51.060266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:51.060273Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2188 [1:7556534929059121418:10711]
2025-10-02T08:14:51.060285Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:51.060302Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:51.060305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.060308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.060310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.060325Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:51.060335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:51.060342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:51.060418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.060425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.060428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:51.060430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:51.060491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:51.060499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.060511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.060526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:51.060545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534929059121412:10711]
2025-10-02T08:14:51.060552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534929059121412:10711]
2025-10-02T08:14:51.060565Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:51.060581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:51.060598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:51.060606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:51.060620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:51.060631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:51.060636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534929059121412:10711]
2025-10-02T08:14:51.060643Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:51.060693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2188
2025-10-02T08:14:51.060716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:51.060733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059121025:10712], now have 1 active actors on pipe
2025-10-02T08:14:51.061046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.061059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.061077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534929518640135:2378], now have 1 active actors on pipe
2025-10-02T08:14:51.061093Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:51.061101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.061105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.061107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:51.061117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.061128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:51.061143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.061190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.061193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.061205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.061241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2189 partition: 0 MaxSeqNo: 17 sessionId: src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0
2025-10-02T08:14:51.061681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5154b2ea-a9e45902-cea5109-65a0bdb0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:51.062483Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2188
2025-10-02T08:14:51.064295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0] Write session: try to update token
2025-10-02T08:14:51.064311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:51.078893Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:51.078912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:51.078915Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:51.078924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534929059121412:10711]
2025-10-02T08:14:51.078928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534929059121412:10711]
2025-10-02T08:14:51.078970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:51.078976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.078979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:51.079006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:51.079029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:51.079176Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:51.086752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId: src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:51.089537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:51.115347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534929059121444:12248]
2025-10-02T08:14:51.115537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2188, pipe: [1:7556534929059121444:12248]
2025-10-02T08:14:51.215698Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:51.216321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.216336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.216356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059121444:12248], now have 1 active actors on pipe
2025-10-02T08:14:51.216484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:51.216497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:51.216570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2189 reason: error at write: Disconnected sessionId: src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0
2025-10-02T08:14:51.216589Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:51.216658Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:51.216733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2189 sessionId: src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0 is DEAD
2025-10-02T08:14:51.216917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534929059121444:12248]
2025-10-02T08:14:51.219160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:51.219172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0] Write session will restart in 0.009708s
2025-10-02T08:14:51.219212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0] Write session: Do CDS request
2025-10-02T08:14:51.219218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:51.230317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.230436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:51.230453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2190
2025-10-02T08:14:51.230569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.230603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:51.230613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:51.230617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:51.231067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2190 sessionId:  describe result for acl check
2025-10-02T08:14:51.231104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:51.231110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:51.231111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:51.231116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534929059121963:10681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:51.231754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534929059121963:10681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:51.234616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534929059121963:10681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:51.238140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:51.238495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534929059121963:10681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:51.238509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534929059121963:10681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:51.238513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534929059121963:10681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:51.238520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:51.238817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:51.238962Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:51.238970Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:51.238978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:51.239014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:51.239047Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534929059122164:10675]
2025-10-02T08:14:51.239580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:51.239746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:51.239780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:51.240044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:51.240076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.240081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.240082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.240083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.240084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.240088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.240097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.240100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.240103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.240107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.240111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.240118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.240125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.240129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.240133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.240137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.240141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.240144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.240148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.240153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.240167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:51.247856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:51.249640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:51.249658Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:51.249661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:51.249665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:51.249670Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2189 [1:7556534929059122164:10675]
2025-10-02T08:14:51.249681Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:51.249698Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:51.249706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.249708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.249711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.249725Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:51.249739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:51.249745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:51.249810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.249818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.249821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:51.249824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:51.249891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:51.249899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.249912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.249927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:51.249945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059122160:10681], now have 1 active actors on pipe
2025-10-02T08:14:51.249945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2189
2025-10-02T08:14:51.249952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534929518640143:2378], now have 1 active actors on pipe
2025-10-02T08:14:51.249959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534929059122152:10675]
2025-10-02T08:14:51.249961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534929059122152:10675]
2025-10-02T08:14:51.249973Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:51.249985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.249989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:51.249992Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:51.249993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.250012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:51.250030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:51.250039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:51.250050Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2189
2025-10-02T08:14:51.250077Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27f5c497-51394609-8b2535b0-bd33f81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:51.250088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.250092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.250094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:51.250103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.250112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:51.250120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534929059122152:10675]
2025-10-02T08:14:51.250137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:51.250159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:51.250171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.250242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.250250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.250264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.250305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2190 partition: 0 MaxSeqNo: 17 sessionId: src_id|27f5c497-51394609-8b2535b0-bd33f81_0
2025-10-02T08:14:51.250606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dabd380-aa20aa4f-783b9a2-1a75ccd4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|27f5c497-51394609-8b2535b0-bd33f81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:51.253207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5c497-51394609-8b2535b0-bd33f81_0] Write session: try to update token
2025-10-02T08:14:51.253221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5c497-51394609-8b2535b0-bd33f81_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:51.268408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId: src_id|27f5c497-51394609-8b2535b0-bd33f81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:51.271022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:51.272350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.272375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.272395Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:51.272398Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:51.272401Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:51.272409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534929059122152:10675]
2025-10-02T08:14:51.272420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534929059122152:10675]
2025-10-02T08:14:51.272468Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:51.272477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:51.272480Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:51.272483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.272485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:51.272622Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:51.317068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534929059122189:12248]
2025-10-02T08:14:51.317172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2189, pipe: [1:7556534929059122189:12248]
2025-10-02T08:14:51.418786Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:51.419434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:51.419489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059122189:12248], now have 1 active actors on pipe
2025-10-02T08:14:51.419537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:51.419616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:51.419624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:51.419643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2190 reason: error at write: Disconnected sessionId: src_id|27f5c497-51394609-8b2535b0-bd33f81_0
2025-10-02T08:14:51.419719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534929059122189:12248]
2025-10-02T08:14:51.419806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2190 sessionId: src_id|27f5c497-51394609-8b2535b0-bd33f81_0 is DEAD
2025-10-02T08:14:51.419784Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:51.420079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5c497-51394609-8b2535b0-bd33f81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:51.420090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5c497-51394609-8b2535b0-bd33f81_0] Write session will restart in 0.005241s
2025-10-02T08:14:51.420114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5c497-51394609-8b2535b0-bd33f81_0] Write session: Do CDS request
2025-10-02T08:14:51.420123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5c497-51394609-8b2535b0-bd33f81_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:51.426273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5c497-51394609-8b2535b0-bd33f81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.426804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:51.426821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2191
2025-10-02T08:14:51.427036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.427070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:51.427081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:51.427085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:51.427515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2191 sessionId:  describe result for acl check
2025-10-02T08:14:51.427548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:51.427550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:51.427551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:51.427556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534929059122488:12288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:51.428079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534929059122488:12288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:51.433860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534929059122488:12288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:51.440483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534929059122488:12288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:51.440500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534929059122488:12288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:51.440503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534929059122488:12288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:51.440512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:51.441647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:51.442035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:51.442197Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:51.442211Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:51.442220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:51.442265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:51.442300Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534929059122912:10655]
2025-10-02T08:14:51.442892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:51.443110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:51.443158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:51.443454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:51.443517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.443524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.443525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.443526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.443527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.443531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.443542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.443545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.443549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.443553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.443559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.443565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.443576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.443582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.443586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.443591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.443596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.443600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.443610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.443615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.443633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:51.453246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:51.454964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:51.454985Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:51.454988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:51.454992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:51.454999Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2190 [1:7556534929059122912:10655]
2025-10-02T08:14:51.455012Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:51.455029Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:51.455032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.455035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.455037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.455052Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:51.455056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:51.455063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:51.455123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.455131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.455134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:51.455137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:51.455205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:51.455213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.455226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.455238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:51.455254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534929059122906:10655]
2025-10-02T08:14:51.455256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534929059122906:10655]
2025-10-02T08:14:51.455264Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:51.455277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:51.455295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:51.455301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:51.455303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2190
2025-10-02T08:14:51.455310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059122902:12288], now have 1 active actors on pipe
2025-10-02T08:14:51.455310Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:51.455313Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:51.455341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534929059122906:10655]
2025-10-02T08:14:51.455349Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:51.455354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534929518640149:2378], now have 1 active actors on pipe
2025-10-02T08:14:51.455358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.455362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.455403Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:51.455414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.455417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.455419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:51.455429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.455437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:51.455460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.455558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:51.455619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.455626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.455641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.455679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2191 partition: 0 MaxSeqNo: 17 sessionId: src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0
2025-10-02T08:14:51.455644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2190
2025-10-02T08:14:51.456091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27f5c497-51394609-8b2535b0-bd33f81_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:51.458759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0] Write session: try to update token
2025-10-02T08:14:51.458777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:51.474767Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:51.474790Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:51.474793Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:51.474802Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534929059122906:10655]
2025-10-02T08:14:51.474806Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534929059122906:10655]
2025-10-02T08:14:51.474850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:51.474862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.474862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:51.474865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:51.474868Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:51.475008Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:51.477866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId: src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:51.480367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:51.519813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534929059122937:12248]
2025-10-02T08:14:51.519932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2190, pipe: [1:7556534929059122937:12248]
2025-10-02T08:14:51.608942Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:51.609665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.609681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.609723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059122937:12248], now have 1 active actors on pipe
2025-10-02T08:14:51.609816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:51.609827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:51.609870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2191 reason: error at write: Disconnected sessionId: src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0
2025-10-02T08:14:51.609935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:51.610040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2191 sessionId: src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0 is DEAD
2025-10-02T08:14:51.610071Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:51.610179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:51.610189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0] Write session will restart in 0.005436s
2025-10-02T08:14:51.610213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0] Write session: Do CDS request
2025-10-02T08:14:51.610219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:51.610207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534929059122937:12248]
2025-10-02T08:14:51.616296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.616374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:51.616384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2192
2025-10-02T08:14:51.616472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.616500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:51.616505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:51.616508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:51.617494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2192 sessionId:  describe result for acl check
2025-10-02T08:14:51.617535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:51.617541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:51.617542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:51.617546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534929059123227:12295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:51.618025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534929059123227:12295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:51.620847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534929059123227:12295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:51.623607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534929059123227:12295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:51.623620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534929059123227:12295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:51.623623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534929059123227:12295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:51.623630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:51.629527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:51.629847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:51.629994Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:51.630004Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:51.630012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:51.630056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:51.630091Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534929059123660:12294]
2025-10-02T08:14:51.630660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:51.630846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:51.630884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:51.631108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:51.631144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.631148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.631149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.631149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.631150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.631153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.631159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.631161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.631163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.631165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.631169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.631175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.631180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.631184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.631192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.631201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.631206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.631214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.631221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.631224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.631234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:51.638643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:51.640194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:51.640209Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:51.640213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:51.640216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:51.640222Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2191 [1:7556534929059123660:12294]
2025-10-02T08:14:51.640235Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:51.640252Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:51.640255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.640258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.640260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.640276Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:51.640281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:51.640287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:51.640359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.640369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.640373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:51.640376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:51.640450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:51.640458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.640472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.640483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2191
2025-10-02T08:14:51.640492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:51.640510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059123518:12295], now have 1 active actors on pipe
2025-10-02T08:14:51.640514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534929518640156:2378], now have 1 active actors on pipe
2025-10-02T08:14:51.640521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.640525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.640541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534929059123654:12294]
2025-10-02T08:14:51.640549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534929059123654:12294]
2025-10-02T08:14:51.640561Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:51.640574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:51.640577Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:51.640580Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:51.640587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:51.640590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:51.640608Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46aa028e-554a903b-a008d207-411ea53f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:51.640615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.640626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.640595Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2191
2025-10-02T08:14:51.640628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:51.640637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.640645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:51.640680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534929059123654:12294]
2025-10-02T08:14:51.640692Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:51.640701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:51.640709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.640792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.640820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.640838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.640877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2192 partition: 0 MaxSeqNo: 17 sessionId: src_id|46aa028e-554a903b-a008d207-411ea53f_0
2025-10-02T08:14:51.641179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7012c6e5-9114037e-cd5bb375-4233eb6a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|46aa028e-554a903b-a008d207-411ea53f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:51.643664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa028e-554a903b-a008d207-411ea53f_0] Write session: try to update token
2025-10-02T08:14:51.643676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa028e-554a903b-a008d207-411ea53f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:51.658156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId: src_id|46aa028e-554a903b-a008d207-411ea53f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:51.658169Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:51.658173Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:51.658175Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:51.658183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534929059123654:12294]
2025-10-02T08:14:51.658187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534929059123654:12294]
2025-10-02T08:14:51.658219Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:51.658224Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:51.658228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:51.658235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.658237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:51.658370Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:51.660509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:51.710294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534929059123693:12248]
2025-10-02T08:14:51.710429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2191, pipe: [1:7556534929059123693:12248]
2025-10-02T08:14:51.805964Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:51.806686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.806699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.806740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059123693:12248], now have 1 active actors on pipe
2025-10-02T08:14:51.806835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534929059123693:12248]
2025-10-02T08:14:51.806853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:51.806860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:51.806912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2192 reason: error at write: Disconnected sessionId: src_id|46aa028e-554a903b-a008d207-411ea53f_0
2025-10-02T08:14:51.806952Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:51.806964Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:51.807074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2192 sessionId: src_id|46aa028e-554a903b-a008d207-411ea53f_0 is DEAD
2025-10-02T08:14:51.807205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa028e-554a903b-a008d207-411ea53f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:51.807214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa028e-554a903b-a008d207-411ea53f_0] Write session will restart in 0.009595s
2025-10-02T08:14:51.807234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa028e-554a903b-a008d207-411ea53f_0] Write session: Do CDS request
2025-10-02T08:14:51.807238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa028e-554a903b-a008d207-411ea53f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:51.818272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa028e-554a903b-a008d207-411ea53f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.818327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:51.818342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2193
2025-10-02T08:14:51.818476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:51.818513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:51.818522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:51.818526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:51.818943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2193 sessionId:  describe result for acl check
2025-10-02T08:14:51.818975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:51.818978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:51.818979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:51.818984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534929059124207:12302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:51.819448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534929059124207:12302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:51.821863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534929059124207:12302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:51.824922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534929059124207:12302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:51.824935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534929059124207:12302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:51.824939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534929059124207:12302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:51.824946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:51.826382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:51.826718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:51.826866Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:51.826874Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:51.826883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:51.826923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:51.826958Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534929059124433:12301]
2025-10-02T08:14:51.827562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:51.827727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:51.827766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:51.828049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:51.828089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.828094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.828095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.828096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.828097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.828102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.828112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.828116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.828124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.828128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.828138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.828149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:51.828159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.828169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:51.828192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.828202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:51.828210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.828216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.828221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.828226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.828249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:51.836383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:51.838082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:51.838098Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:51.838101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:51.838105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:51.838112Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2192 [1:7556534929059124433:12301]
2025-10-02T08:14:51.838124Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:51.838142Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:51.838144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.838147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.838150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.838164Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:51.838169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:51.838175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:51.838237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.838249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.838253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:51.838255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:51.838319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:51.838327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.838341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:51.838358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:51.838381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059124420:12302], now have 1 active actors on pipe
2025-10-02T08:14:51.838387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2192
2025-10-02T08:14:51.838388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534929059124427:12301]
2025-10-02T08:14:51.838391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534929059124427:12301]
2025-10-02T08:14:51.838401Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:51.838411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534929518640177:2378], now have 1 active actors on pipe
2025-10-02T08:14:51.838418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.838422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.838437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:51.838453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:51.838455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:51.838457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:51.838457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:51.838496Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:51.838502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:51.838463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2192
2025-10-02T08:14:51.838506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:51.838509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:51.838517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:51.838525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:51.838533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534929059124427:12301]
2025-10-02T08:14:51.838542Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:51.838546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:51.838572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.838656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.838664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.838680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:51.838720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2193 partition: 0 MaxSeqNo: 17 sessionId: src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0
2025-10-02T08:14:51.839035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa028e-554a903b-a008d207-411ea53f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:51.841517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0] Write session: try to update token
2025-10-02T08:14:51.841533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:51.855483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId: src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:51.856518Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:51.856533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:51.856536Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:51.856545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534929059124427:12301]
2025-10-02T08:14:51.856550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534929059124427:12301]
2025-10-02T08:14:51.856591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:51.856591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:51.856596Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:51.856602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:51.856604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:51.856743Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:51.857985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:51.906899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534929059124459:12248]
2025-10-02T08:14:51.907015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2192, pipe: [1:7556534929059124459:12248]
2025-10-02T08:14:51.990901Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:51.991324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:51.991340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:51.991376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534929059124459:12248], now have 1 active actors on pipe
2025-10-02T08:14:51.991470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:51.991477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:51.991523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2193 reason: error at write: Disconnected sessionId: src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0
2025-10-02T08:14:51.991662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:51.991678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2193 sessionId: src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0 is DEAD
2025-10-02T08:14:51.991905Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:51.992233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534929059124459:12248]
2025-10-02T08:14:51.992429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:51.992437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0] Write session will restart in 0.007774s
2025-10-02T08:14:51.992457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0] Write session: Do CDS request
2025-10-02T08:14:51.992462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:52.001229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.001279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:52.001295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2194
2025-10-02T08:14:52.001397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.001425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:52.001433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:52.001436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:52.001888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2194 sessionId:  describe result for acl check
2025-10-02T08:14:52.001915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:52.001917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:52.001918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:52.001923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534933354092212:12314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:52.002519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534933354092212:12314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:52.004768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534933354092212:12314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:52.008190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534933354092212:12314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:52.008203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534933354092212:12314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:52.008206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534933354092212:12314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:52.008213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:52.010752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:52.011095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:52.011266Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:52.011275Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:52.011284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:52.011345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:52.011376Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534933354092494:12313]
2025-10-02T08:14:52.011950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:52.012117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:52.012157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:52.012449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:52.012489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.012495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.012496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.012497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.012498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.012503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.012512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.012516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.012520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.012523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.012528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.012534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.012540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.012545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.012549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.012553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.012557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.012561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.012572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.012577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.012598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:52.024462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:52.026175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:52.026192Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:52.026194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:52.026197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:52.026204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2193 [1:7556534933354092494:12313]
2025-10-02T08:14:52.026211Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:52.026223Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:52.026225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.026228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.026229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.026241Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:52.026245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:52.026252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:52.026309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.026316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.026319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:52.026321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:52.026378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:52.026385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.026397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.026413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:52.026432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354092473:12314], now have 1 active actors on pipe
2025-10-02T08:14:52.026441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534933354092488:12313]
2025-10-02T08:14:52.026443Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534933354092488:12313]
2025-10-02T08:14:52.026450Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:52.026460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:52.026463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2193
2025-10-02T08:14:52.026472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:52.026473Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:52.026474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:52.026476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:52.026479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534929518640183:2378], now have 1 active actors on pipe
2025-10-02T08:14:52.026508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.026515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.026527Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534933354092488:12313]
2025-10-02T08:14:52.026538Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:52.026544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:52.026561Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5639088e-adf73dc-7184f753-e193fb45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:52.026571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.026574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.026575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:52.026553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2193
2025-10-02T08:14:52.026583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.026593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:52.026613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.026661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.026667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.026678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.026712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2194 partition: 0 MaxSeqNo: 17 sessionId: src_id|5639088e-adf73dc-7184f753-e193fb45_0
2025-10-02T08:14:52.027051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffd0eb0-43e4bc9f-cae07f8b-56ba21c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5639088e-adf73dc-7184f753-e193fb45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:52.029822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5639088e-adf73dc-7184f753-e193fb45_0] Write session: try to update token
2025-10-02T08:14:52.029838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5639088e-adf73dc-7184f753-e193fb45_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:52.043879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId: src_id|5639088e-adf73dc-7184f753-e193fb45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:52.046454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:52.046544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.046561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.046593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:52.046621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:52.046678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.046689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.046844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.046909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.046975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.047047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.047091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.047101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.047168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.047232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.047295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.047363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.047409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.047416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.047485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.047547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.047608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.047667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.047711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.047719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.047784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.047860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.047924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.047989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.048036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.048044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.048110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.048171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.048248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.048317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.048363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.048371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.048437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.048505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.048564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.048626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.048668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.048672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.048740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.048819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.048883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.048942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.048981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.048984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.049049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.049109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.049170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.049234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.049276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.049279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.049347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.049403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.049462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.049521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.049564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.049567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.049635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.049699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.049763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.049826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.049871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.049874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.049931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:52.049987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.050008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.050010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:52.050040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:52.050053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:52.050057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:52.050062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:52.050065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:52.050452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:52.050469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:52.050474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:52.050478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:52.050481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:52.050485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:52.051453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:52.051469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:52.051476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:52.051480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:52.051483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:52.051486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:52.051945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:52.051959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:52.051964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:52.051968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:52.051971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:52.054512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:52.054540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:52.054552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392892054
2025-10-02T08:14:52.054843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:52.054860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:52.054865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:52.054868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:52.054871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:52.054874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:52.055363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:52.055386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:52.055391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:52.055396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:52.055400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:52.055403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:52.055896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:52.055919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:52.055928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:52.055931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:52.055934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:52.055937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:52.056449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:52.056476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:52.056481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:52.057594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:52.057611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:52.057616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:52.057620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:52.057629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392892057
2025-10-02T08:14:52.057969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:52.057991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:52.057997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:52.058004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:52.058010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:52.058013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:52.058672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:52.058710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:52.058719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:52.058723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:52.058726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:52.058732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:52.059522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:52.059556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.059679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392892059
2025-10-02T08:14:52.063313Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:52.063336Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:52.063342Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:52.063347Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:52.063361Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:52.063363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:52.063365Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:52.063377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534933354092488:12313]
2025-10-02T08:14:52.063380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534933354092488:12313]
2025-10-02T08:14:52.063431Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:52.063455Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:52.069231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:52.069247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.069248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:52.069387Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:52.092214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534933354092545:12248]
2025-10-02T08:14:52.092335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2193, pipe: [1:7556534933354092545:12248]
2025-10-02T08:14:52.202529Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:52.202814Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:52.202822Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:52.202831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534933354092488:12313]
2025-10-02T08:14:52.202858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:52.202885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354092545:12248], now have 1 active actors on pipe
2025-10-02T08:14:52.202992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:52.202999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:52.203024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2194 reason: error at write: Disconnected sessionId: src_id|5639088e-adf73dc-7184f753-e193fb45_0
2025-10-02T08:14:52.203077Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:52.203197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2194 sessionId: src_id|5639088e-adf73dc-7184f753-e193fb45_0 is DEAD
2025-10-02T08:14:52.203324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5639088e-adf73dc-7184f753-e193fb45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:52.203333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5639088e-adf73dc-7184f753-e193fb45_0] Write session will restart in 0.008741s
2025-10-02T08:14:52.203356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5639088e-adf73dc-7184f753-e193fb45_0] Write session: Do CDS request
2025-10-02T08:14:52.203365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5639088e-adf73dc-7184f753-e193fb45_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:52.203357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534933354092545:12248]
2025-10-02T08:14:52.203648Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:52.207131Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [c7ed44b686899a45] Result# TEvPutResult {Id# [72075186224037892:2193:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:52.207170Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2193:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:52.207237Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2193:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:52.213673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5639088e-adf73dc-7184f753-e193fb45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.213802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:52.213817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2195
2025-10-02T08:14:52.213912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.213941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:52.213950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:52.213952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:52.214322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2195 sessionId:  describe result for acl check
2025-10-02T08:14:52.214347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:52.214348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:52.214349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:52.214353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534933354092942:12327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:52.214801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534933354092942:12327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:52.217028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534933354092942:12327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:52.219743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534933354092942:12327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:52.219757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534933354092942:12327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:52.219760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534933354092942:12327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:52.219766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:52.222688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:52.223017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:52.223131Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:52.223137Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:52.223144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:52.223176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:52.223200Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534933354093279:12326]
2025-10-02T08:14:52.223589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:52.223771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:52.223800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:52.224009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:52.224050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.224056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.224057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.224058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.224059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.224062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.224068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.224070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.224072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.224074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.224082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.224086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.224090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.224092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.224095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.224097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.224099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.224104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.224106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.224109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.224124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:52.231598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:52.233257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:52.233271Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:52.233274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:52.233277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:52.233285Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2194 [1:7556534933354093279:12326]
2025-10-02T08:14:52.233295Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:52.233314Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:52.233316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.233319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.233321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.233337Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:52.233346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:52.233352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:52.233397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.233404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.233407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:52.233408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:52.233475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:52.233484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.233495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.233505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:52.233522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354093217:12327], now have 1 active actors on pipe
2025-10-02T08:14:52.233529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534933354093273:12326]
2025-10-02T08:14:52.233529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2194
2025-10-02T08:14:52.233530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534933354093273:12326]
2025-10-02T08:14:52.233538Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:52.233545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:52.233546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534933813607510:2378], now have 1 active actors on pipe
2025-10-02T08:14:52.233549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:52.233553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:52.233565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:52.233567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:52.233575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.233579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.233616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534933354093273:12326]
2025-10-02T08:14:52.233627Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:52.233633Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:52.233644Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:52.233650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.233657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.233659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:52.233667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.233676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:52.233719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.233766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.233773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.233785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.233819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2195 partition: 0 MaxSeqNo: 17 sessionId: src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0
2025-10-02T08:14:52.234132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5639088e-adf73dc-7184f753-e193fb45_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:52.236497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0] Write session: try to update token
2025-10-02T08:14:52.236508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:52.236973Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2194
2025-10-02T08:14:52.249324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId: src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:52.251414Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:52.251435Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:52.251438Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:52.251448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534933354093273:12326]
2025-10-02T08:14:52.251453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534933354093273:12326]
2025-10-02T08:14:52.251497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:52.251499Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:52.251504Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:52.251509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.251511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:52.251646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:52.251844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:52.303681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534933354093304:12248]
2025-10-02T08:14:52.303847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2194, pipe: [1:7556534933354093304:12248]
2025-10-02T08:14:52.388904Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:52.389281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.389300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.389341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354093304:12248], now have 1 active actors on pipe
2025-10-02T08:14:52.389613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:52.389623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:52.389674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2195 reason: error at write: Disconnected sessionId: src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0
2025-10-02T08:14:52.389678Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:52.389710Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:52.389821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2195 sessionId: src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0 is DEAD
2025-10-02T08:14:52.389964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:52.389974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0] Write session will restart in 0.008729s
2025-10-02T08:14:52.389996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0] Write session: Do CDS request
2025-10-02T08:14:52.390003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:52.389995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534933354093304:12248]
2025-10-02T08:14:52.400278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.400323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:52.400338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2196
2025-10-02T08:14:52.400447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.400477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:52.400486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:52.400490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:52.400868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2196 sessionId:  describe result for acl check
2025-10-02T08:14:52.400899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:52.400904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:52.400906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:52.400911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534933354093773:12333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:52.401328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534933354093773:12333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:52.403464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534933354093773:12333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:52.406336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534933354093773:12333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:52.406348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534933354093773:12333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:52.406351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534933354093773:12333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:52.406358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:52.408079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:52.408462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:52.408692Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:52.408704Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:52.408714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:52.408766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:52.408818Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534933354094039:12332]
2025-10-02T08:14:52.409406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:52.409626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:52.409673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:52.409972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:52.410021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.410027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.410028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.410030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.410031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.410036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.410045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.410049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.410052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.410055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.410060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.410067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.410072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.410078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.410082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.410090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.410094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.410104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.410109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.410117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.410132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:52.417841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:52.419263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:52.419282Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:52.419286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:52.419289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:52.419296Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2195 [1:7556534933354094039:12332]
2025-10-02T08:14:52.419308Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:52.419326Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:52.419333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.419337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.419339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.419354Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:52.419360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:52.419366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:52.419429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.419437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.419440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:52.419443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:52.419509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:52.419517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.419531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.419551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:52.419568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354094018:12333], now have 1 active actors on pipe
2025-10-02T08:14:52.419574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534933813607517:2378], now have 1 active actors on pipe
2025-10-02T08:14:52.419574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2195
2025-10-02T08:14:52.419583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.419587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.419604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534933354094033:12332]
2025-10-02T08:14:52.419612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534933354094033:12332]
2025-10-02T08:14:52.419624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:52.419641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:52.419647Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:52.419652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:52.419662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:52.419665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:52.419681Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74360c6a-fad124b4-900bbe65-6439826d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:52.419691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.419694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.419697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:52.419705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.419714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:52.419701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2195
2025-10-02T08:14:52.419753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534933354094033:12332]
2025-10-02T08:14:52.419764Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:52.419775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.419774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:52.419826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.419834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.419848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.419894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2196 partition: 0 MaxSeqNo: 17 sessionId: src_id|74360c6a-fad124b4-900bbe65-6439826d_0
2025-10-02T08:14:52.420200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f7cbcb-abe6961f-568d6901-70a54d53_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74360c6a-fad124b4-900bbe65-6439826d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:52.422570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74360c6a-fad124b4-900bbe65-6439826d_0] Write session: try to update token
2025-10-02T08:14:52.422585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74360c6a-fad124b4-900bbe65-6439826d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:52.430362Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:52.430382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:52.430391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534933354094033:12332]
2025-10-02T08:14:52.430436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:52.430437Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:52.430601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:52.430749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:52.430882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:52.431013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:52.431210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:52.431253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:52.436072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId: src_id|74360c6a-fad124b4-900bbe65-6439826d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:52.438609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:52.438701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.438716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.438748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:52.438773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:52.438832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.438854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.439028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.439109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.439180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.439252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.439611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.439630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.439704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.439767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.439837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.439911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.439963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.439971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.440045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.440108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.440174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.440253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.440296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.440304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.440377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.440447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.440513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.440578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.440630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.440637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.440706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.440770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.440856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.440926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.440975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.440983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.441055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.441119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.441185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.441254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.441301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.441311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.441382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.441447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.441520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.441588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.441635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.441645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.441718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.441791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.441860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.441929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.441977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.441985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.442056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.442121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.442182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.442251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.442303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.442311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.442385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:52.442448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:52.442512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:52.442579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:52.442713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:52.442723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:52.442770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:52.442838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.442862Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.442869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:52.442900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:52.442917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:52.442925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:52.442928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:52.442932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:52.443338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:52.443368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:52.443374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:52.443381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:52.443384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:52.443391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:52.443929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:52.443953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:52.443960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:52.443963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:52.443966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:52.443970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:52.444621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:52.444649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:52.444655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:52.444659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:52.444662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:52.451491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:52.451528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:52.451547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392892451
2025-10-02T08:14:52.451786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:52.451811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:52.451823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:52.451826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:52.451830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:52.451834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:52.452359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:52.452391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:52.452407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:52.452411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:52.452413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:52.452417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:52.453361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:52.453391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:52.453409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:52.453413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:52.453417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:52.453420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:52.454610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:52.454640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:52.454647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:52.455984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:52.456010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:52.456019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:52.456022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:52.456032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392892455
2025-10-02T08:14:52.456576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:52.456606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:52.456620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:52.456629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:52.456632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:52.456636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:52.457545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:52.457573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:52.457581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:52.457590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:52.457593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:52.457597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:52.458480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:52.458506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.458619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392892458
2025-10-02T08:14:52.462642Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:52.462682Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:52.462691Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:52.462698Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:52.464399Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:52.464403Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:52.464405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:52.464414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534933354094033:12332]
2025-10-02T08:14:52.464420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534933354094033:12332]
2025-10-02T08:14:52.464464Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:52.464468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:52.464472Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:52.464485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.464488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:52.464626Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:52.490052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534933354094074:12248]
2025-10-02T08:14:52.490151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2195, pipe: [1:7556534933354094074:12248]
2025-10-02T08:14:52.609553Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:52.609956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354094074:12248], now have 1 active actors on pipe
2025-10-02T08:14:52.610339Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:52.610140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534933354094074:12248]
2025-10-02T08:14:52.610329Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:52.611067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74360c6a-fad124b4-900bbe65-6439826d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:52.610727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:52.611077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74360c6a-fad124b4-900bbe65-6439826d_0] Write session will restart in 0.006473s
2025-10-02T08:14:52.610764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2196 reason: status is not ok: tablet will be restarted right now sessionId: src_id|74360c6a-fad124b4-900bbe65-6439826d_0
2025-10-02T08:14:52.610923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2196 sessionId: src_id|74360c6a-fad124b4-900bbe65-6439826d_0 is DEAD
2025-10-02T08:14:52.611106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74360c6a-fad124b4-900bbe65-6439826d_0] Write session: Do CDS request
2025-10-02T08:14:52.611112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74360c6a-fad124b4-900bbe65-6439826d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:52.621278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74360c6a-fad124b4-900bbe65-6439826d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.621322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:52.621337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2197
2025-10-02T08:14:52.621515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.621548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:52.621554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:52.621557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:52.622022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2197 sessionId:  describe result for acl check
2025-10-02T08:14:52.622064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:52.622070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:52.622072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:52.622079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534933354094530:12340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:52.622597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534933354094530:12340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:52.625803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534933354094530:12340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:52.631498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534933354094530:12340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:52.631516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534933354094530:12340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:52.631519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534933354094530:12340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:52.631529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:52.635682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:52.636107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:52.636347Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:52.636357Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:52.636368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:52.636433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:52.636467Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534933354094807:12339]
2025-10-02T08:14:52.637097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:52.637480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:52.637536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:52.637857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:52.637918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.637924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.637926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.637927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.637929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.637934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.637944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.637948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.637952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.637956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.637962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.637969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.637975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.637981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.637991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.637996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.638000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.638011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.638016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.638021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.638047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:52.646811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:52.648499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:52.648517Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:52.648519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:52.648523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:52.648528Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2196 [1:7556534933354094807:12339]
2025-10-02T08:14:52.648540Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:52.648556Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:52.648558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.648561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.648563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.648580Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:52.648584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:52.648591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:52.648654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.648661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.648665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:52.648667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:52.648728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:52.648735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.648748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.648762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:52.648780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354094786:12340], now have 1 active actors on pipe
2025-10-02T08:14:52.648791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534933354094801:12339]
2025-10-02T08:14:52.648793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534933354094801:12339]
2025-10-02T08:14:52.648811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2196
2025-10-02T08:14:52.648824Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:52.648827Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:52.648834Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:52.648847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:52.648866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:52.648876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:52.648883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534933813607525:2378], now have 1 active actors on pipe
2025-10-02T08:14:52.648887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.648891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.648933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534933354094801:12339]
2025-10-02T08:14:52.648946Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:52.648961Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:52.648963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:52.648971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.648975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.648977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:52.648984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.648993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:52.649029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.649119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.649127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.649140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.649174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2197 partition: 0 MaxSeqNo: 17 sessionId: src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0
2025-10-02T08:14:52.649639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74360c6a-fad124b4-900bbe65-6439826d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:52.650737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2196
2025-10-02T08:14:52.652243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0] Write session: try to update token
2025-10-02T08:14:52.652260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:52.669510Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:52.669533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:52.669535Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:52.669543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534933354094801:12339]
2025-10-02T08:14:52.669548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534933354094801:12339]
2025-10-02T08:14:52.669587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:52.669595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.669598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:52.669725Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:52.669725Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:52.669731Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:52.682137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId: src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:52.684490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:52.710218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534933354094836:12248]
2025-10-02T08:14:52.710301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2196, pipe: [1:7556534933354094836:12248]
2025-10-02T08:14:52.815445Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:52.816072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.816086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.816106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354094836:12248], now have 1 active actors on pipe
2025-10-02T08:14:52.816263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534933354094836:12248]
2025-10-02T08:14:52.816293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:52.816296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:52.816356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2197 reason: error at write: Disconnected sessionId: src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0
2025-10-02T08:14:52.816386Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:52.816553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2197 sessionId: src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0 is DEAD
2025-10-02T08:14:52.816837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:52.816848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0] Write session will restart in 0.006364s
2025-10-02T08:14:52.816838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:52.816871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0] Write session: Do CDS request
2025-10-02T08:14:52.816878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:52.825199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.825335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:52.825353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2198
2025-10-02T08:14:52.825463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:52.825496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:52.825506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:52.825509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:52.825926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2198 sessionId:  describe result for acl check
2025-10-02T08:14:52.825965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:52.825967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:52.825969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:52.825975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534933354094871:12347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:52.826536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534933354094871:12347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:52.828368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534933354094871:12347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:52.834498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534933354094871:12347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:52.834514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534933354094871:12347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:52.834518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534933354094871:12347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:52.834525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:52.846542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:52.847429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:52.847598Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:52.847609Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:52.847618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:52.847660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:52.847698Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534933354095585:12346]
2025-10-02T08:14:52.848303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:52.848540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:52.848598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:52.848930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:52.848988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.848993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.848994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.848995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.848996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.849000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.849009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.849013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.849017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.849020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.849025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.849032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:52.849037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.849041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:52.849049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.849054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:52.849060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.849064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.849068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.849073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.849096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:52.859784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:52.861892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:52.861914Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:52.861916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:52.861920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:52.861927Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2197 [1:7556534933354095585:12346]
2025-10-02T08:14:52.861938Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:52.861957Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:52.861961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.861964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.861967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.861981Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:52.861987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:52.861993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:52.862055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.862065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.862068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:52.862070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:52.862134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:52.862141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.862157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:52.862176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:52.862199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354095249:12347], now have 1 active actors on pipe
2025-10-02T08:14:52.862209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534933354095579:12346]
2025-10-02T08:14:52.862211Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534933354095579:12346]
2025-10-02T08:14:52.862218Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:52.862219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2197
2025-10-02T08:14:52.862227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534933813607546:2378], now have 1 active actors on pipe
2025-10-02T08:14:52.862231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:52.862235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:52.862235Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:52.862248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:52.862251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:52.862257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.862260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.862300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534933354095579:12346]
2025-10-02T08:14:52.862313Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:52.862326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:52.862331Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b300bf23-bd1c9267-10760115-587ad6be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:52.862338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:52.862341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:52.862343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:52.862352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:52.862364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:52.862347Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2197
2025-10-02T08:14:52.862404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.862490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:52.862497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:52.862510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:52.862555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2198 partition: 0 MaxSeqNo: 17 sessionId: src_id|b300bf23-bd1c9267-10760115-587ad6be_0
2025-10-02T08:14:52.864501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f2b70de-a7616d6c-3ddfec11-46407767_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b300bf23-bd1c9267-10760115-587ad6be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:52.867328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b300bf23-bd1c9267-10760115-587ad6be_0] Write session: try to update token
2025-10-02T08:14:52.867346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b300bf23-bd1c9267-10760115-587ad6be_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:52.880533Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:52.880555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:52.880558Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:52.880567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534933354095579:12346]
2025-10-02T08:14:52.880572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534933354095579:12346]
2025-10-02T08:14:52.880612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:52.880619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:52.880618Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:52.880624Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:52.880626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:52.880761Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:52.883619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId: src_id|b300bf23-bd1c9267-10760115-587ad6be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:52.886276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:52.916538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534933354095611:12248]
2025-10-02T08:14:52.916988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2197, pipe: [1:7556534933354095611:12248]
2025-10-02T08:14:53.027561Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:53.027941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.027955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.027994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534933354095611:12248], now have 1 active actors on pipe
2025-10-02T08:14:53.028408Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:53.028726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534933354095611:12248]
2025-10-02T08:14:53.028753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:53.028257Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:53.028874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2198 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b300bf23-bd1c9267-10760115-587ad6be_0
2025-10-02T08:14:53.029028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2198 sessionId: src_id|b300bf23-bd1c9267-10760115-587ad6be_0 is DEAD
2025-10-02T08:14:53.032382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b300bf23-bd1c9267-10760115-587ad6be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:53.032391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b300bf23-bd1c9267-10760115-587ad6be_0] Write session will restart in 0.006415s
2025-10-02T08:14:53.032419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b300bf23-bd1c9267-10760115-587ad6be_0] Write session: Do CDS request
2025-10-02T08:14:53.032423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b300bf23-bd1c9267-10760115-587ad6be_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:53.040255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b300bf23-bd1c9267-10760115-587ad6be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.040516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:53.040532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2199
2025-10-02T08:14:53.041621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.041658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:53.041663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:53.041666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:53.042126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2199 sessionId:  describe result for acl check
2025-10-02T08:14:53.042155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:53.042157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:53.042158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:53.042164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534937649063392:12359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:53.042874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534937649063392:12359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:53.045544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534937649063392:12359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:53.051888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534937649063392:12359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:53.051906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534937649063392:12359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:53.051909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534937649063392:12359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:53.051917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:53.053047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:53.053367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:53.053503Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:53.053506Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:53.053515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:53.053552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:53.053580Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534937649063657:12358]
2025-10-02T08:14:53.054183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:53.054680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:53.054715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:53.055028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:53.055065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.055066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.055067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.055069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.055070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.055074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.055083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.055087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.055091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.055095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.055099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.055106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.055111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.055117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.055121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.055126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.055130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.055135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.055141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.055146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.055164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:53.075209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:53.077179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:53.077195Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:53.077198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:53.077201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:53.077207Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2198 [1:7556534937649063657:12358]
2025-10-02T08:14:53.077217Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:53.077232Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:53.077235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.077238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.077239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.077253Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:53.077258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:53.077264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:53.077317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.077319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.077321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:53.077323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:53.077385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:53.077387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.077400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.077412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:53.077428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534937649063651:12358]
2025-10-02T08:14:53.077430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534937649063651:12358]
2025-10-02T08:14:53.077439Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:53.077452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:53.077466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:53.077469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:53.077500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534937649063651:12358]
2025-10-02T08:14:53.077501Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:53.077504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:53.077508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:53.077510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649063647:12359], now have 1 active actors on pipe
2025-10-02T08:14:53.077522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:53.077542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2198
2025-10-02T08:14:53.077957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.077966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.077981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534938108574849:2378], now have 1 active actors on pipe
2025-10-02T08:14:53.077996Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d90a13e6-3171c436-191c752f-66dede26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:53.078002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.078007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.078009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:53.078018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.078027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:53.078045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.078165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.078169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.078182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.078214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2199 partition: 0 MaxSeqNo: 17 sessionId: src_id|d90a13e6-3171c436-191c752f-66dede26_0
2025-10-02T08:14:53.077905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2198
2025-10-02T08:14:53.084897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b300bf23-bd1c9267-10760115-587ad6be_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d90a13e6-3171c436-191c752f-66dede26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:53.087487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d90a13e6-3171c436-191c752f-66dede26_0] Write session: try to update token
2025-10-02T08:14:53.087509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d90a13e6-3171c436-191c752f-66dede26_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:53.097759Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:53.097782Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:53.097785Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:53.097794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534937649063651:12358]
2025-10-02T08:14:53.097799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534937649063651:12358]
2025-10-02T08:14:53.097839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:53.097841Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:53.097846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.097847Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:53.097849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:53.097983Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:53.103408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId: src_id|d90a13e6-3171c436-191c752f-66dede26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:53.106105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:53.128969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534937649063709:12248]
2025-10-02T08:14:53.129319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2198, pipe: [1:7556534937649063709:12248]
2025-10-02T08:14:53.232145Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:53.232381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.232392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.232424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649063709:12248], now have 1 active actors on pipe
2025-10-02T08:14:53.233058Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:53.233338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90a13e6-3171c436-191c752f-66dede26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:53.233355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90a13e6-3171c436-191c752f-66dede26_0] Write session will restart in 0.006661s
2025-10-02T08:14:53.232912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534937649063709:12248]
2025-10-02T08:14:53.232932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:53.232934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:53.233379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90a13e6-3171c436-191c752f-66dede26_0] Write session: Do CDS request
2025-10-02T08:14:53.232989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2199 reason: error at write: Disconnected sessionId: src_id|d90a13e6-3171c436-191c752f-66dede26_0
2025-10-02T08:14:53.233150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2199 sessionId: src_id|d90a13e6-3171c436-191c752f-66dede26_0 is DEAD
2025-10-02T08:14:53.233386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90a13e6-3171c436-191c752f-66dede26_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:53.234266Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:53.241206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d90a13e6-3171c436-191c752f-66dede26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.243915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:53.243937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2200
2025-10-02T08:14:53.244076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.244114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:53.244123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:53.244127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:53.244528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2200 sessionId:  describe result for acl check
2025-10-02T08:14:53.244567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:53.244573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:53.244575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:53.244580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534937649064056:12372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:53.244988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534937649064056:12372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:53.249414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534937649064056:12372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:53.252474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534937649064056:12372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:53.252486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534937649064056:12372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:53.252489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534937649064056:12372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:53.252496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:53.257512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:53.257805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:53.257936Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:53.257945Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:53.257952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:53.257979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:53.258004Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534937649064448:12371]
2025-10-02T08:14:53.258389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:53.258535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:53.258563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:53.258755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:53.258785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.258785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.258786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.258787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.258787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.258790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.258797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.258799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.258801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.258803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.258806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.258810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.258813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.258816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.258818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.258821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.258823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.258826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.258828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.258831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.258840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:53.266472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:53.268159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:53.268174Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:53.268176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:53.268179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:53.268192Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2199 [1:7556534937649064448:12371]
2025-10-02T08:14:53.268203Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:53.268220Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:53.268223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.268226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.268228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.268240Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:53.268244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:53.268251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:53.268316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.268326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.268329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:53.268331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:53.268378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:53.268384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.268391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.268398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:53.268413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534937649064442:12371]
2025-10-02T08:14:53.268418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534937649064442:12371]
2025-10-02T08:14:53.268425Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:53.268442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:53.268453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2199
2025-10-02T08:14:53.268457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:53.268457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:53.268459Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:53.268460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:53.268469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649064356:12372], now have 1 active actors on pipe
2025-10-02T08:14:53.268496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534937649064442:12371]
2025-10-02T08:14:53.268510Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:53.268518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534938108574879:2378], now have 1 active actors on pipe
2025-10-02T08:14:53.268522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.268526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.268552Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2199
2025-10-02T08:14:53.268539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:53.268563Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:53.268568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.268570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.268572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:53.268578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.268585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:53.268601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.268638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.268640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.268651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.268682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2200 partition: 0 MaxSeqNo: 17 sessionId: src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0
2025-10-02T08:14:53.269000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90a13e6-3171c436-191c752f-66dede26_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:53.271524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0] Write session: try to update token
2025-10-02T08:14:53.271538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:53.285563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId: src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:53.286227Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:53.286242Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:53.286244Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:53.286250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534937649064442:12371]
2025-10-02T08:14:53.286254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534937649064442:12371]
2025-10-02T08:14:53.286285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:53.286293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.286295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:53.286366Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:53.286380Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:53.286419Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:53.288293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:53.333978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534937649064473:12248]
2025-10-02T08:14:53.334446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2199, pipe: [1:7556534937649064473:12248]
2025-10-02T08:14:53.420331Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:53.420956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.420970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.421011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649064473:12248], now have 1 active actors on pipe
2025-10-02T08:14:53.421138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534937649064473:12248]
2025-10-02T08:14:53.421166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:53.421171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:53.421233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2200 reason: error at write: Disconnected sessionId: src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0
2025-10-02T08:14:53.421258Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:53.421390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2200 sessionId: src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0 is DEAD
2025-10-02T08:14:53.421434Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:53.421679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:53.421691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0] Write session will restart in 0.009043s
2025-10-02T08:14:53.421715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0] Write session: Do CDS request
2025-10-02T08:14:53.421722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:53.432266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.432327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:53.432343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2201
2025-10-02T08:14:53.432478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.432525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:53.432537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:53.432545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:53.432911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2201 sessionId:  describe result for acl check
2025-10-02T08:14:53.432940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:53.432946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:53.432948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:53.432952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534937649064930:12379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:53.433477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534937649064930:12379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:53.436379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534937649064930:12379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:53.439277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534937649064930:12379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:53.439288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534937649064930:12379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:53.439290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534937649064930:12379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:53.439295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:53.441389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:53.442586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:53.442751Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:53.442759Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:53.442768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:53.442813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:53.442847Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534937649065216:12377]
2025-10-02T08:14:53.443290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:53.443484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:53.443520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:53.443810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:53.443859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.443864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.443866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.443867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.443868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.443873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.443883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.443887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.443891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.443895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.443900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.443907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.443913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.443917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.443921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.443926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.443930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.443949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.443957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.443962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.443986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:53.457953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:53.459843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:53.459862Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:53.459864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:53.459868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:53.459874Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2200 [1:7556534937649065216:12377]
2025-10-02T08:14:53.459885Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:53.459902Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:53.459905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.459908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.459911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.459929Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:53.459934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:53.459941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:53.459999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.460008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.460011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:53.460014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:53.460083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:53.460091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.460105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.460118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:53.460141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649065192:12379], now have 1 active actors on pipe
2025-10-02T08:14:53.460151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534937649065210:12377]
2025-10-02T08:14:53.460153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534937649065210:12377]
2025-10-02T08:14:53.460159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:53.460161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2200
2025-10-02T08:14:53.460169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:53.460171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:53.460172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:53.460193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:53.460196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:53.460202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534938108574886:2378], now have 1 active actors on pipe
2025-10-02T08:14:53.460206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.460220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.460260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534937649065210:12377]
2025-10-02T08:14:53.460283Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2200
2025-10-02T08:14:53.460268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:53.460272Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:53.460283Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d542d17-2ad22eef-8a130539-4d56492c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:53.460289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.460293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.460295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:53.460306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.460314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:53.460351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.460431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.460444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.460469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.460518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2201 partition: 0 MaxSeqNo: 17 sessionId: src_id|9d542d17-2ad22eef-8a130539-4d56492c_0
2025-10-02T08:14:53.460884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e27921-fe70b91a-b62ccdb-6b55c485_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9d542d17-2ad22eef-8a130539-4d56492c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:53.463463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d542d17-2ad22eef-8a130539-4d56492c_0] Write session: try to update token
2025-10-02T08:14:53.463479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d542d17-2ad22eef-8a130539-4d56492c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:53.477807Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:53.477830Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:53.477833Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:53.477842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534937649065210:12377]
2025-10-02T08:14:53.477847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534937649065210:12377]
2025-10-02T08:14:53.477893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:53.477899Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:53.477904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.477905Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:53.477907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:53.478046Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:53.482709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId: src_id|9d542d17-2ad22eef-8a130539-4d56492c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:53.485198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:53.521433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534937649065241:12248]
2025-10-02T08:14:53.521545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2200, pipe: [1:7556534937649065241:12248]
2025-10-02T08:14:53.613598Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:53.613843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.613851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.613884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649065241:12248], now have 1 active actors on pipe
2025-10-02T08:14:53.614174Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:53.614253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:53.614320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2201 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d542d17-2ad22eef-8a130539-4d56492c_0
2025-10-02T08:14:53.614464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2201 sessionId: src_id|9d542d17-2ad22eef-8a130539-4d56492c_0 is DEAD
2025-10-02T08:14:53.614616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534937649065241:12248]
2025-10-02T08:14:53.614631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d542d17-2ad22eef-8a130539-4d56492c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:53.614642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d542d17-2ad22eef-8a130539-4d56492c_0] Write session will restart in 0.007267s
2025-10-02T08:14:53.614664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d542d17-2ad22eef-8a130539-4d56492c_0] Write session: Do CDS request
2025-10-02T08:14:53.614672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d542d17-2ad22eef-8a130539-4d56492c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:53.614778Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:53.625260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d542d17-2ad22eef-8a130539-4d56492c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.625537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:53.625555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2202
2025-10-02T08:14:53.625640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.625669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:53.625673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:53.625676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:53.626154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2202 sessionId:  describe result for acl check
2025-10-02T08:14:53.626183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:53.626188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:53.626190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:53.626206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534937649065627:12385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:53.626634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534937649065627:12385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:53.631166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534937649065627:12385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:53.633822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534937649065627:12385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:53.633836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534937649065627:12385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:53.633840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534937649065627:12385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:53.633856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:53.640304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:53.640639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:53.640785Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:53.640794Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:53.640818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:53.640857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:53.640904Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534937649065984:12384]
2025-10-02T08:14:53.641565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:53.641719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:53.641755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:53.642051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:53.642089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.642095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.642096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.642097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.642099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.642104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.642115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.642124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.642132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.642141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.642150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.642159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.642169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.642174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.642183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.642193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.642202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.642212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.642221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.642230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.642254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:53.650217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:53.651947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:53.651966Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:53.651969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:53.651973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:53.651980Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2201 [1:7556534937649065984:12384]
2025-10-02T08:14:53.651991Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:53.652007Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:53.652015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.652018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.652020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.652036Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:53.652040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:53.652047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:53.652110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.652119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.652123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:53.652125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:53.652196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:53.652203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.652216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.652232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:53.652254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649065829:12385], now have 1 active actors on pipe
2025-10-02T08:14:53.652262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534938108574893:2378], now have 1 active actors on pipe
2025-10-02T08:14:53.652268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534937649065978:12384]
2025-10-02T08:14:53.652270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534937649065978:12384]
2025-10-02T08:14:53.652277Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:53.652278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2201
2025-10-02T08:14:53.652284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:53.652286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:53.652290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:53.652303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:53.652311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:53.652319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.652327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.652298Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2201
2025-10-02T08:14:53.652375Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534937649065978:12384]
2025-10-02T08:14:53.652391Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:53.652408Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:53.652410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:53.652418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.652427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.652432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:53.652441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.652451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:53.652494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.652538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.652545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.652559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.652596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2202 partition: 0 MaxSeqNo: 17 sessionId: src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0
2025-10-02T08:14:53.652901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d542d17-2ad22eef-8a130539-4d56492c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:53.655378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0] Write session: try to update token
2025-10-02T08:14:53.655395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:53.667995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId: src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:53.669422Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:53.669436Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:53.669439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:53.669448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534937649065978:12384]
2025-10-02T08:14:53.669453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534937649065978:12384]
2025-10-02T08:14:53.669495Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:53.669497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:53.669504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.669506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:53.669507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:53.669686Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:53.670856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:53.714765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534937649066013:12248]
2025-10-02T08:14:53.714855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2201, pipe: [1:7556534937649066013:12248]
2025-10-02T08:14:53.798861Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:53.799289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.799308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.799345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649066013:12248], now have 1 active actors on pipe
2025-10-02T08:14:53.799463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534937649066013:12248]
2025-10-02T08:14:53.799486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:53.799488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:53.799544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2202 reason: error at write: Disconnected sessionId: src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0
2025-10-02T08:14:53.799600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:53.799704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2202 sessionId: src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0 is DEAD
2025-10-02T08:14:53.799748Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:53.799919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:53.799926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0] Write session will restart in 0.005992s
2025-10-02T08:14:53.799952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0] Write session: Do CDS request
2025-10-02T08:14:53.799959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:53.799917Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:14:53.800063Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 22 consumer shared/user session shared/user_1_22_10142374153447640747_v1 is DEAD
2025-10-02T08:14:53.800281Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:14:53.800291Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534856044626624:12254] disconnected; active server actors: 1
2025-10-02T08:14:53.800306Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534856044626624:12254] client user disconnected session shared/user_1_22_10142374153447640747_v1
2025-10-02T08:14:53.800329Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:14:53.800333Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:14:53.800347Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.009787s
2025-10-02T08:14:53.807250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.807276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:53.807290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2203
2025-10-02T08:14:53.807443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:53.807476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:53.807481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:53.807485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:53.807870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2203 sessionId:  describe result for acl check
2025-10-02T08:14:53.807902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:53.807903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:53.807904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:53.807910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534937649066374:12392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:53.808401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534937649066374:12392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:53.811329Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:14:53.811479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534937649066374:12392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:53.811532Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:14:53.811535Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 23
2025-10-02T08:14:53.811668Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 23 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:14:53.811716Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:14:53.811798Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 auth for : user
2025-10-02T08:14:53.812106Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 Handle describe topics response
2025-10-02T08:14:53.812133Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 auth is DEAD
2025-10-02T08:14:53.812151Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:14:53.812390Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:14:53.812493Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_23_13701838405486042660_v1
2025-10-02T08:14:53.812501Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:14:53.812569Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:14:53.812668Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:14:53.812743Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 got read request: guid# a1c285bb-5780c14e-1ccd32ca-b3e49d93
2025-10-02T08:14:53.812858Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534937649066532:12396] connected; active server actors: 1
2025-10-02T08:14:53.813007Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556534937649066532:12396] session shared/user_1_23_13701838405486042660_v1
2025-10-02T08:14:53.813026Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:14:53.813037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:14:53.813047Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_23_13701838405486042660_v1" (Sender=[1:7556534937649066502:12396], Pipe=[1:7556534937649066532:12396], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:14:53.813052Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:14:53.813067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:14:53.813077Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_23_13701838405486042660_v1" (Sender=[1:7556534937649066502:12396], Pipe=[1:7556534937649066532:12396], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:14:53.813087Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_23_13701838405486042660_v1" sender [1:7556534937649066502:12396] lock partition 0 for ReadingSession "shared/user_1_23_13701838405486042660_v1" (Sender=[1:7556534937649066502:12396], Pipe=[1:7556534937649066532:12396], Partitions=[], ActiveFamilyCount=1) generation 1 step 23
2025-10-02T08:14:53.813103Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:14:53.813111Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000037s
2025-10-02T08:14:53.813448Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 23 Session: "shared/user_1_23_13701838405486042660_v1" ClientId: "user" PipeClient { RawX1: 7556534937649066532 RawX2: 4503603922350188 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:14:53.813471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:14:53.814565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534937649066374:12392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:53.814577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534937649066374:12392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:53.814580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534937649066374:12392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:53.814586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:53.826398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:53.826831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:53.826990Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:53.827002Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:53.827012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:53.827081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:53.827122Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534937649066779:12391]
2025-10-02T08:14:53.827615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:53.827817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:53.827857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:53.828073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:53.828100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.828104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.828105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.828106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.828106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.828109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.828115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.828117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.828120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.828122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.828126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.828131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:53.828134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.828137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:53.828139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.828142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:53.828144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.828147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.828149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.828151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.828163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:53.836015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:53.837506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:53.837527Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:53.837529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:53.837533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:53.837540Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2202 [1:7556534937649066779:12391]
2025-10-02T08:14:53.837552Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:53.837569Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:53.837577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.837579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.837581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.837598Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:53.837608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:53.837614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:53.837673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.837681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.837684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:53.837687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:53.837747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:53.837754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.837768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:53.837783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:53.837805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649066620:12392], now have 1 active actors on pipe
2025-10-02T08:14:53.837812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534937649066576:12399], now have 1 active actors on pipe
2025-10-02T08:14:53.837816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534938108574913:2378], now have 1 active actors on pipe
2025-10-02T08:14:53.837821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534937649066773:12391]
2025-10-02T08:14:53.837822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2202
2025-10-02T08:14:53.837829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534937649066773:12391]
2025-10-02T08:14:53.837839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:53.837848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2202, pipe: [1:7556534937649066576:12399]
2025-10-02T08:14:53.837848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.837852Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:53.837852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.837855Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:53.837870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:53.837883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:53.837890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:53.837896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.837898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.837904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_23_13701838405486042660_v1 on pipe: [1:7556534937649066576:12399]
2025-10-02T08:14:53.837886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2202
2025-10-02T08:14:53.837929Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_23_13701838405486042660_v1:1 with generation 2202
2025-10-02T08:14:53.837953Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:53.837963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.837966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.837967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:53.837975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.837983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:53.837997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534937649066773:12391]
2025-10-02T08:14:53.838010Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:53.838022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.838025Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:53.838029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.838031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:53.838043Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_23_13701838405486042660_v1
2025-10-02T08:14:53.838049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.838092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.838295Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:53.838313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.838320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.838350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:53.838393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2203 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0
2025-10-02T08:14:53.838732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5039cb7-7cd835f6-92a3f4b5-e9343140_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:53.841310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0] Write session: try to update token
2025-10-02T08:14:53.841327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:53.843050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:14:53.843084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:14:53.843093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:53.843100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:53.843101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:53.843109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:14:53.843126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:14:53.843184Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392893837 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:14:53.843197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:14:53.843224Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 sending to client partition status
2025-10-02T08:14:53.855504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId: src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:53.856269Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:53.856286Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:53.856289Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:53.856297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534937649066773:12391]
2025-10-02T08:14:53.856301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534937649066773:12391]
2025-10-02T08:14:53.856342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:53.856342Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:53.856348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:53.856348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:53.856350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:53.856491Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:53.857978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:53.993140Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:53.993638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:53.993652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:53.993810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:53.993826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:53.993873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_23_13701838405486042660_v1
2025-10-02T08:14:53.993883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2203 reason: error at write: Disconnected sessionId: src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0
2025-10-02T08:14:53.993887Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:53.993956Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:53.994052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2203 sessionId: src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0 is DEAD
2025-10-02T08:14:53.994185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:53.994196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0] Write session will restart in 0.007814s
2025-10-02T08:14:53.994196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534937649066576:12399]
2025-10-02T08:14:53.994203Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_23_13701838405486042660_v1
2025-10-02T08:14:53.994219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0] Write session: Do CDS request
2025-10-02T08:14:53.994226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:54.003234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.003323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:54.003337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2204
2025-10-02T08:14:54.003444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.003499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:54.003508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:54.003512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:54.003835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2204 sessionId:  describe result for acl check
2025-10-02T08:14:54.003868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:54.003874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:54.003875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:54.003880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534941944034508:12402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:54.004315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534941944034508:12402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:54.006663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534941944034508:12402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:54.009764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534941944034508:12402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:54.009781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534941944034508:12402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:54.009784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534941944034508:12402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:54.009791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:54.014549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:54.014887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:54.015026Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:54.015035Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:54.015042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:54.015077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:54.015102Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534941944034849:12401]
2025-10-02T08:14:54.015514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:54.015809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:54.015834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:54.016041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:54.016073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.016077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.016078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.016078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.016079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.016082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.016088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.016090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.016092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.016094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.016098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.016102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.016105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.016108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.016110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.016113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.016115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.016117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.016119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.016122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.016131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:54.023923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:54.025391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:54.025406Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:54.025408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:54.025411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:54.025415Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2203 [1:7556534941944034849:12401]
2025-10-02T08:14:54.025423Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:54.025437Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:54.025439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.025441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.025443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.025454Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:54.025458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:54.025463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:54.025513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.025519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.025522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:54.025524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:54.025571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:54.025576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.025585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.025592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:54.025607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534941944034843:12401]
2025-10-02T08:14:54.025612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534941944034843:12401]
2025-10-02T08:14:54.025617Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:54.025627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944034750:12402], now have 1 active actors on pipe
2025-10-02T08:14:54.025629Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:54.025633Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:54.025632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2203
2025-10-02T08:14:54.025636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:54.025644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:54.025645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:54.025650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534938108574920:2378], now have 1 active actors on pipe
2025-10-02T08:14:54.025674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.025680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.025692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534941944034843:12401]
2025-10-02T08:14:54.025700Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:54.025711Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:54.025720Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7befa012-548c5859-9653cd0-482682cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:54.025724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.025727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.025728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:54.025735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.025712Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2203
2025-10-02T08:14:54.025746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:54.025779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.025817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.025822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.025831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.025859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2204 partition: 0 MaxSeqNo: 17 sessionId: src_id|7befa012-548c5859-9653cd0-482682cd_0
2025-10-02T08:14:54.026155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f33c590-f1eb5fe2-8e6e85c6-ef21f4dd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7befa012-548c5859-9653cd0-482682cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:54.028631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7befa012-548c5859-9653cd0-482682cd_0] Write session: try to update token
2025-10-02T08:14:54.028646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7befa012-548c5859-9653cd0-482682cd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:54.041211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId: src_id|7befa012-548c5859-9653cd0-482682cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:54.042213Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:54.042230Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:54.042233Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:54.042240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534941944034843:12401]
2025-10-02T08:14:54.042245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534941944034843:12401]
2025-10-02T08:14:54.042282Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:54.042286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:54.042293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.042295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:54.042295Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:54.042432Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:54.043679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:54.094809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534941944034889:12399]
2025-10-02T08:14:54.094982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2203, pipe: [1:7556534941944034889:12399]
2025-10-02T08:14:54.189669Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:54.190165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.190179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.190217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944034889:12399], now have 1 active actors on pipe
2025-10-02T08:14:54.190369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:54.190379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:54.190433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2204 reason: error at write: Disconnected sessionId: src_id|7befa012-548c5859-9653cd0-482682cd_0
2025-10-02T08:14:54.190514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:54.190488Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:54.190579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2204 sessionId: src_id|7befa012-548c5859-9653cd0-482682cd_0 is DEAD
2025-10-02T08:14:54.190712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534941944034889:12399]
2025-10-02T08:14:54.192881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7befa012-548c5859-9653cd0-482682cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:54.192892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7befa012-548c5859-9653cd0-482682cd_0] Write session will restart in 0.005953s
2025-10-02T08:14:54.192916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7befa012-548c5859-9653cd0-482682cd_0] Write session: Do CDS request
2025-10-02T08:14:54.192923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7befa012-548c5859-9653cd0-482682cd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:54.200275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7befa012-548c5859-9653cd0-482682cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.200431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:54.200444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2205
2025-10-02T08:14:54.200553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.200587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:54.200596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:54.200599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:54.201057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2205 sessionId:  describe result for acl check
2025-10-02T08:14:54.201089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:54.201095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:54.201096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:54.201100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534941944035284:12421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:54.201699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534941944035284:12421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:54.203956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534941944035284:12421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:54.206610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534941944035284:12421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:54.206623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534941944035284:12421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:54.206626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534941944035284:12421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:54.206634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:54.211861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:54.212563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:54.212722Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:54.212732Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:54.212740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:54.212784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:54.212834Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534941944035661:12420]
2025-10-02T08:14:54.213395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:54.213586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:54.213630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:54.213898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:54.213952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.213958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.213959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.213960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.213961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.213966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.213979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.213982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.213985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.213988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.213993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.213999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.214004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.214013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.214017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.214022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.214026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.214031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.214034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.214039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.214058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:54.221820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:54.223391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:54.223412Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:54.223415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:54.223418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:54.223425Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2204 [1:7556534941944035661:12420]
2025-10-02T08:14:54.223436Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:54.223453Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:54.223455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.223458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.223460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.223478Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:54.223491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:54.223498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:54.223561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.223568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.223571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:54.223574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:54.223638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:54.223650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.223662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.223675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:54.223694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944035489:12421], now have 1 active actors on pipe
2025-10-02T08:14:54.223704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2204
2025-10-02T08:14:54.223705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534941944035655:12420]
2025-10-02T08:14:54.223707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534941944035655:12420]
2025-10-02T08:14:54.223714Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:54.223722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534942403542245:2378], now have 1 active actors on pipe
2025-10-02T08:14:54.223727Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:54.223731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:54.223734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:54.223747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:54.223755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:54.223761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.223771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.223808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534941944035655:12420]
2025-10-02T08:14:54.223816Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:54.223830Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f495f08b-83efa66d-74a85289-2b3dd785_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:54.223832Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:54.223843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.223847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.223849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:54.223808Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2204
2025-10-02T08:14:54.223857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.223870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:54.223913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.223964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.223970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.223984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.224023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2205 partition: 0 MaxSeqNo: 17 sessionId: src_id|f495f08b-83efa66d-74a85289-2b3dd785_0
2025-10-02T08:14:54.224374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7befa012-548c5859-9653cd0-482682cd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f495f08b-83efa66d-74a85289-2b3dd785_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:54.226825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f495f08b-83efa66d-74a85289-2b3dd785_0] Write session: try to update token
2025-10-02T08:14:54.226841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f495f08b-83efa66d-74a85289-2b3dd785_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:54.239581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId: src_id|f495f08b-83efa66d-74a85289-2b3dd785_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:54.241066Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:54.241082Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:54.241084Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:54.241093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534941944035655:12420]
2025-10-02T08:14:54.241098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534941944035655:12420]
2025-10-02T08:14:54.241141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:54.241153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.241159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:54.241231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:54.241247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:54.241297Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:54.242038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:54.290760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534941944035686:12399]
2025-10-02T08:14:54.290875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2204, pipe: [1:7556534941944035686:12399]
2025-10-02T08:14:54.387641Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:54.388433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.388453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.388497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944035686:12399], now have 1 active actors on pipe
2025-10-02T08:14:54.388591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534941944035686:12399]
2025-10-02T08:14:54.388612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:54.388619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:54.388670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2205 reason: error at write: Disconnected sessionId: src_id|f495f08b-83efa66d-74a85289-2b3dd785_0
2025-10-02T08:14:54.388722Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:54.388785Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:54.388843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2205 sessionId: src_id|f495f08b-83efa66d-74a85289-2b3dd785_0 is DEAD
2025-10-02T08:14:54.389076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f495f08b-83efa66d-74a85289-2b3dd785_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:54.389085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f495f08b-83efa66d-74a85289-2b3dd785_0] Write session will restart in 0.007653s
2025-10-02T08:14:54.389111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f495f08b-83efa66d-74a85289-2b3dd785_0] Write session: Do CDS request
2025-10-02T08:14:54.389117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f495f08b-83efa66d-74a85289-2b3dd785_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:54.398207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f495f08b-83efa66d-74a85289-2b3dd785_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.398294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:54.398309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2206
2025-10-02T08:14:54.398440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.398475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:54.398484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:54.398488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:54.398862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2206 sessionId:  describe result for acl check
2025-10-02T08:14:54.398891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:54.398897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:54.398899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:54.398904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534941944035987:12427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:54.399373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534941944035987:12427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:54.401966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534941944035987:12427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:54.404889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534941944035987:12427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:54.404903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534941944035987:12427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:54.404906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534941944035987:12427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:54.404914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:54.410987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:54.411954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:54.412106Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:54.412117Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:54.412125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:54.412164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:54.412261Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534941944036437:12426]
2025-10-02T08:14:54.412901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:54.413122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:54.413161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:54.413458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:54.413500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.413505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.413506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.413507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.413508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.413513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.413523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.413527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.413530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.413534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.413539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.413546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.413552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.413557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.413562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.413567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.413571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.413576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.413581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.413586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.413606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:54.423800Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2205
2025-10-02T08:14:54.421725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:54.423331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:54.423337Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:54.423339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:54.423343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:54.423350Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2205 [1:7556534941944036437:12426]
2025-10-02T08:14:54.423362Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:54.423379Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:54.423383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.423386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.423388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.423402Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:54.423407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:54.423414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:54.423474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.423476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.423480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:54.423482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:54.423559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:54.423562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.423574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.423588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:54.423606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944036262:12427], now have 1 active actors on pipe
2025-10-02T08:14:54.424227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f495f08b-83efa66d-74a85289-2b3dd785_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:54.423605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2205
2025-10-02T08:14:54.423612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534941944036431:12426]
2025-10-02T08:14:54.423614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534941944036431:12426]
2025-10-02T08:14:54.423623Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:54.423634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.423638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.423653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:54.423667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:54.423670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:54.423672Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:54.423675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:54.423710Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:54.423716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.423720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.423722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:54.423730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.423739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:54.423749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534942403542254:2378], now have 1 active actors on pipe
2025-10-02T08:14:54.423752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534941944036431:12426]
2025-10-02T08:14:54.423762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:54.423771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:54.423786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.423842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.423844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.423857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.423893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2206 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0
2025-10-02T08:14:54.426928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0] Write session: try to update token
2025-10-02T08:14:54.426943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:54.442314Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:54.442334Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:54.442336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:54.442346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534941944036431:12426]
2025-10-02T08:14:54.442350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534941944036431:12426]
2025-10-02T08:14:54.442388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:54.442400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:54.442401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:54.442407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.442409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:54.442535Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:54.444959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId: src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:54.447482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:54.488899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534941944036464:12399]
2025-10-02T08:14:54.489067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2205, pipe: [1:7556534941944036464:12399]
2025-10-02T08:14:54.575036Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:54.575814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.575828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.575864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944036464:12399], now have 1 active actors on pipe
2025-10-02T08:14:54.575994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:54.576007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:54.576065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2206 reason: error at write: Disconnected sessionId: src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0
2025-10-02T08:14:54.576082Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:54.576119Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:54.576232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2206 sessionId: src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0 is DEAD
2025-10-02T08:14:54.576355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:54.576365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0] Write session will restart in 0.006480s
2025-10-02T08:14:54.576399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0] Write session: Do CDS request
2025-10-02T08:14:54.576406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:54.576360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534941944036464:12399]
2025-10-02T08:14:54.584265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.584334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:54.584350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2207
2025-10-02T08:14:54.584456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.584485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:54.584494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:54.584497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:54.584895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2207 sessionId:  describe result for acl check
2025-10-02T08:14:54.584926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:54.584933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:54.584934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:54.584940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534941944036811:12436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:54.585437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534941944036811:12436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:54.588429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534941944036811:12436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:54.591537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534941944036811:12436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:54.591553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534941944036811:12436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:54.591556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534941944036811:12436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:54.591565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:54.596885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:54.598131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:54.598290Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:54.598298Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:54.598307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:54.598340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:54.598368Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534941944037220:12435]
2025-10-02T08:14:54.598804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:54.598984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:54.599024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:54.599232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:54.599261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.599262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.599262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.599263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.599264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.599267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.599273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.599275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.599277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.599279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.599283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.599287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.599290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.599293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.599295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.599298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.599300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.599303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.599305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.599309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.599319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:54.607275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:54.608949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:54.608964Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:54.608967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:54.608970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:54.608976Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2206 [1:7556534941944037220:12435]
2025-10-02T08:14:54.608988Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:54.609005Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:54.609019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.609022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.609024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.609041Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:54.609045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:54.609052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:54.609116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.609123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.609126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:54.609129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:54.609197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:54.609206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.609219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.609231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:54.609250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534941944037214:12435]
2025-10-02T08:14:54.609252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534941944037214:12435]
2025-10-02T08:14:54.609259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:54.609271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:54.609275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944037070:12436], now have 1 active actors on pipe
2025-10-02T08:14:54.609281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:54.609281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:54.609282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2206
2025-10-02T08:14:54.609293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:54.609295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:54.609302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534942403542261:2378], now have 1 active actors on pipe
2025-10-02T08:14:54.609332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.609341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.609354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534941944037214:12435]
2025-10-02T08:14:54.609365Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:54.609371Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:54.609395Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:54.609405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.609409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.609411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:54.609421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.609381Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2206
2025-10-02T08:14:54.609431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:54.609450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.609492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.609497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.609511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.609549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2207 partition: 0 MaxSeqNo: 17 sessionId: src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0
2025-10-02T08:14:54.609897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f8c641-850d801d-35c6ca08-a4c89f20_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:54.612636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0] Write session: try to update token
2025-10-02T08:14:54.612654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:54.626681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId: src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:54.627463Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:54.627481Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:54.627483Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:54.627491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534941944037214:12435]
2025-10-02T08:14:54.627495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534941944037214:12435]
2025-10-02T08:14:54.627533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:54.627543Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:54.627545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.627547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:54.627556Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:54.627677Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:54.629192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:54.676272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534941944037245:12399]
2025-10-02T08:14:54.676495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2206, pipe: [1:7556534941944037245:12399]
2025-10-02T08:14:54.770905Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:54.771698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.771711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.771747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944037245:12399], now have 1 active actors on pipe
2025-10-02T08:14:54.771905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534941944037245:12399]
2025-10-02T08:14:54.771937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:54.771939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:54.771967Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:54.771999Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:54.772390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:54.772400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0] Write session will restart in 0.006869s
2025-10-02T08:14:54.772424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0] Write session: Do CDS request
2025-10-02T08:14:54.772431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:54.772002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2207 reason: error at write: Disconnected sessionId: src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0
2025-10-02T08:14:54.772170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2207 sessionId: src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0 is DEAD
2025-10-02T08:14:54.780290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.780379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:54.780394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2208
2025-10-02T08:14:54.780489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.780517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:54.780526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:54.780529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:54.781090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2208 sessionId:  describe result for acl check
2025-10-02T08:14:54.781126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:54.781133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:54.781135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:54.781140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534941944037607:12443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:54.781568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534941944037607:12443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:54.784465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534941944037607:12443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:54.787327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534941944037607:12443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:54.787337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534941944037607:12443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:54.787339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534941944037607:12443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:54.787344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:54.793843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:54.795060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:54.795291Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:54.795302Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:54.795311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:54.795360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:54.795395Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534941944038015:12442]
2025-10-02T08:14:54.796037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:54.796216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:54.796255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:54.796534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:54.796574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.796580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.796581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.796582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.796583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.796587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.796596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.796600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.796608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.796616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.796622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.796629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.796639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.796647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.796656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.796665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.796674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.796683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.796692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.796697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.796715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:54.804289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:54.805896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:54.805914Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:54.805917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:54.805920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:54.805926Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2207 [1:7556534941944038015:12442]
2025-10-02T08:14:54.805937Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:54.805953Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:54.805955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.805958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.805960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.805975Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:54.805986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:54.805992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:54.806056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.806063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.806065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:54.806067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:54.806134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:54.806145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.806159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.806171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:54.806174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2207
2025-10-02T08:14:54.806190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944037869:12443], now have 1 active actors on pipe
2025-10-02T08:14:54.806193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534942403542282:2378], now have 1 active actors on pipe
2025-10-02T08:14:54.806197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.806201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.806217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534941944038009:12442]
2025-10-02T08:14:54.806220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534941944038009:12442]
2025-10-02T08:14:54.806232Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:54.806244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:54.806250Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:54.806253Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:54.806258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:54.806261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:54.806277Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e79f7ab-71433af9-11c202d-df862274_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:54.806278Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2207
2025-10-02T08:14:54.806283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.806287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.806289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:54.806298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.806306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:54.806337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534941944038009:12442]
2025-10-02T08:14:54.806350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:54.806361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.806376Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:54.806426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.806436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.806448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:54.806481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2208 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e79f7ab-71433af9-11c202d-df862274_0
2025-10-02T08:14:54.806765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf9eb6f-4b5130dd-576d2542-8befcaec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e79f7ab-71433af9-11c202d-df862274_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:54.809278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e79f7ab-71433af9-11c202d-df862274_0] Write session: try to update token
2025-10-02T08:14:54.809292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e79f7ab-71433af9-11c202d-df862274_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:54.816839Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:54.816859Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:54.816867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534941944038009:12442]
2025-10-02T08:14:54.816906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:54.816912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:54.817071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:54.817230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:54.817366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:54.817501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:54.817687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:54.817725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:54.822348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId: src_id|5e79f7ab-71433af9-11c202d-df862274_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:54.824885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:54.824992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.825011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.825048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:54.825077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:54.825135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:54.825151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:54.825317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.825383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.825468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.825534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.825780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.825794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.825868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.825933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.825996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.826102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.826147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.826154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.826223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.826284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.826344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.826414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.826458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.826466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.826534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.826598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.826699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.826762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.826822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.826833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.826900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.827015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.827107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.827169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.827223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.827226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.827292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.827350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.827410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.827471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.827512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.827515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.827584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.827642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.827703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.827763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.827812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.827814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.827881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.827939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.828002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.828062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.828102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.828108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.828176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.828247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.828305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.828364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.828409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.828411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.828481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:54.828538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:54.828596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:54.828657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:54.828714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:54.828717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:54.828755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:54.828976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:54.829002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:54.829005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:54.829037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:54.829056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:54.829063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:54.829066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:54.829069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:54.829480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:54.829512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:54.829520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:54.829524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:54.829528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:54.829531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:54.830126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:54.830153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:54.830159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:54.830163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:54.830168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:54.830171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:54.830715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:54.830740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:54.830746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:54.830751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:54.830754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:54.833076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:54.833097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:54.833109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392894832
2025-10-02T08:14:54.833269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:54.833284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:54.833289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:54.833293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:54.833297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:54.833306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:54.833796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:54.833815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:54.833820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:54.833825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:54.833830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:54.833834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:54.834321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:54.834343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:54.834352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:54.834360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:54.834364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:54.834369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:54.834847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:54.834873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:54.834879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:54.836004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:54.836024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:54.836029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:54.836033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:54.836041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392894835
2025-10-02T08:14:54.836361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:54.836382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:54.836393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:54.836403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:54.836407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:54.836416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:54.836927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:54.836947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:54.836952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:54.836958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:54.836960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:54.836963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:54.837373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:54.837389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:54.837488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392894837
2025-10-02T08:14:54.838227Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:54.838251Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:54.838260Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:54.838272Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:54.839888Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:54.839903Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:54.839905Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:54.839915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534941944038009:12442]
2025-10-02T08:14:54.839918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534941944038009:12442]
2025-10-02T08:14:54.839974Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:54.839975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:54.839979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.839982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:54.839986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:54.840116Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:54.872949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534941944038050:12399]
2025-10-02T08:14:54.873066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2207, pipe: [1:7556534941944038050:12399]
2025-10-02T08:14:54.973592Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:54.974353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944038050:12399], now have 1 active actors on pipe
2025-10-02T08:14:54.974511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534941944038050:12399]
2025-10-02T08:14:54.974555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:54.974563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:54.974567Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:54.974597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2208 reason: error at write: Disconnected sessionId: src_id|5e79f7ab-71433af9-11c202d-df862274_0
2025-10-02T08:14:54.974629Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:54.974759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2208 sessionId: src_id|5e79f7ab-71433af9-11c202d-df862274_0 is DEAD
2025-10-02T08:14:54.974914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e79f7ab-71433af9-11c202d-df862274_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:54.974925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e79f7ab-71433af9-11c202d-df862274_0] Write session will restart in 0.009097s
2025-10-02T08:14:54.974956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e79f7ab-71433af9-11c202d-df862274_0] Write session: Do CDS request
2025-10-02T08:14:54.974962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e79f7ab-71433af9-11c202d-df862274_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:54.985221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e79f7ab-71433af9-11c202d-df862274_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.985225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:54.985242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2209
2025-10-02T08:14:54.985400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:54.985432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:54.985442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:54.985445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:54.985843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2209 sessionId:  describe result for acl check
2025-10-02T08:14:54.985881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:54.985887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:54.985889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:54.985896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534941944038483:12449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:54.986459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534941944038483:12449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:54.989114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534941944038483:12449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:54.992174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534941944038483:12449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:54.992207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534941944038483:12449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:54.992211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534941944038483:12449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:54.992220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:54.996431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:54.996778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:54.996967Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:54.996981Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:54.996992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:54.997047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:54.997089Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534941944038808:12448]
2025-10-02T08:14:54.997697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:54.997935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:54.997991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:54.998301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:54.998363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.998370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.998371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.998372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.998373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.998378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.998388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.998392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.998401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.998405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.998415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.998427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:54.998437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.998447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:54.998455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.998461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:54.998465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.998475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:54.998484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.998489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:54.998512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:55.006782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:55.008495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:55.008516Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:55.008519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:55.008522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:55.008529Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2208 [1:7556534941944038808:12448]
2025-10-02T08:14:55.008540Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:55.008556Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:55.008558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.008561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.008563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.008579Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:55.008584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:55.008590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:55.008650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.008665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.008668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:55.008670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:55.008734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:55.008743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.008758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.008775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:55.008781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2208
2025-10-02T08:14:55.008796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534941944038749:12449], now have 1 active actors on pipe
2025-10-02T08:14:55.008823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534941944038802:12448]
2025-10-02T08:14:55.008830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534941944038802:12448]
2025-10-02T08:14:55.008842Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:55.008855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.008860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:55.008863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.008863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:55.008878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534942403542290:2378], now have 1 active actors on pipe
2025-10-02T08:14:55.008889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:55.008906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:55.008913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:55.008953Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:55.008963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.008966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.008969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:55.008977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.008986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:55.008997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534941944038802:12448]
2025-10-02T08:14:55.009010Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:55.009030Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:55.009038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.009074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.009080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.009094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.009128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2209 partition: 0 MaxSeqNo: 17 sessionId: src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0
2025-10-02T08:14:55.009181Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2208
2025-10-02T08:14:55.009470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e79f7ab-71433af9-11c202d-df862274_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:55.011818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0] Write session: try to update token
2025-10-02T08:14:55.011831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:55.021270Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:55.021293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:55.021303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534941944038802:12448]
2025-10-02T08:14:55.021342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:55.021343Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:55.021528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:55.021673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:55.021807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:55.021962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:55.022147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:55.022188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:55.024467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId: src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:55.026886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:55.026951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.026969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.026998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:55.027022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:55.027053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.027061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.027224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.027294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.027354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.027417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.027638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.027648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.027710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.027766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.027823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.027886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.027939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.027946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.028012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.028065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.028123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.028177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.028230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.028237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.028299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.028357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.028420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.028506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.028554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.028561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.028627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.028684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.028744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.028881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.028930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.028937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.029000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.029060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.029121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.029183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.029226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.029233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.029297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.029355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.029420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.029483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.029527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.029534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.029597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.029653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.029712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.029769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.029890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.029898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.029998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.030089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.030186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.030248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.030293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.030301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.030363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.030422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.030483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.030548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.030592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.030600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.030639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:55.030702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.030724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.030730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:55.030762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:55.030776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:55.030783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:55.030786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:55.030788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:55.031167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:55.031190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:55.031199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:55.031207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:55.031210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:55.031213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:55.031757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:55.031775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:55.031780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:55.031783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:55.031786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:55.031789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:55.032274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:55.032295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:55.032300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:55.032303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:55.032306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:55.033487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:55.033503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:55.033514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392895033
2025-10-02T08:14:55.033621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:55.033633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:55.033637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:55.033644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:55.033650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:55.033653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:55.034072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:55.034093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:55.034099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:55.034104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:55.034107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:55.034110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:55.034538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:55.034556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:55.034564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:55.034567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:55.034570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:55.034573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:55.035026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:55.035046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:55.035051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:55.036072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:55.036093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:55.036097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:55.036101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:55.036110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392895035
2025-10-02T08:14:55.036410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:55.036428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:55.036434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:55.036437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:55.036440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:55.036443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:55.036898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:55.036917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:55.036922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:55.036926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:55.036928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:55.036932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:55.037379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:55.037399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.037493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392895037
2025-10-02T08:14:55.038222Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:55.038244Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:55.038256Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:55.038266Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:55.039756Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:55.039770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:55.039774Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:55.039782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534941944038802:12448]
2025-10-02T08:14:55.039785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534941944038802:12448]
2025-10-02T08:14:55.039831Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:55.039841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:55.039844Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:55.039845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.039847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:55.039967Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:55.074657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534946239006138:12399]
2025-10-02T08:14:55.074771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2208, pipe: [1:7556534946239006138:12399]
2025-10-02T08:14:55.170406Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:55.170723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239006138:12399], now have 1 active actors on pipe
2025-10-02T08:14:55.170842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534946239006138:12399]
2025-10-02T08:14:55.170862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:55.170868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:55.170886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2209 reason: error at write: Disconnected sessionId: src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0
2025-10-02T08:14:55.170930Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:55.171089Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:55.171156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:55.171164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0] Write session will restart in 0.005187s
2025-10-02T08:14:55.171185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0] Write session: Do CDS request
2025-10-02T08:14:55.171191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:55.171035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2209 sessionId: src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0 is DEAD
2025-10-02T08:14:55.177264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:55.177317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:55.177333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2210
2025-10-02T08:14:55.177575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:55.177600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:55.177605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:55.177608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:55.178778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2210 sessionId:  describe result for acl check
2025-10-02T08:14:55.178805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:55.178807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:55.178808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:55.178813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534946239006414:12468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:55.179305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534946239006414:12468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:55.182640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534946239006414:12468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:55.186607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534946239006414:12468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:55.186624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534946239006414:12468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:55.186627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534946239006414:12468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:55.186635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:55.199696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:55.200869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:55.201029Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:55.201038Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:55.201046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:55.201085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:55.201119Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534946239006933:12467]
2025-10-02T08:14:55.201785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:55.202267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:55.202304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:55.202602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:55.202643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.202649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.202650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.202651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.202652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.202657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.202668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.202672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.202676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.202680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.202685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.202692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.202698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.202704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.202708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.202713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.202717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.202722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.202727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.202732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.202751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:55.215022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:55.218153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:55.218178Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:55.218182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:55.218187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:55.218194Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2209 [1:7556534946239006933:12467]
2025-10-02T08:14:55.218209Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:55.218230Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:55.218234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.218241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.218251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.218276Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:55.218288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:55.218294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:55.218386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.218397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.218401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:55.218406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:55.218506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:55.218511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.218527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.218541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:55.218555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2209
2025-10-02T08:14:55.218561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239006646:12468], now have 1 active actors on pipe
2025-10-02T08:14:55.218566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534946698509614:2378], now have 1 active actors on pipe
2025-10-02T08:14:55.218573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534946239006927:12467]
2025-10-02T08:14:55.218577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534946239006927:12467]
2025-10-02T08:14:55.218589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:55.218603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.218608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.218627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:55.218641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:55.218644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:55.218688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:55.218692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:55.218696Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ed110a8-123607cc-b5905a26-17f98366_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:55.218703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.218707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.218709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:55.218719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.218728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:55.218739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534946239006927:12467]
2025-10-02T08:14:55.218749Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:55.218766Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:55.218776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.218818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.218821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.218834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.218870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2210 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ed110a8-123607cc-b5905a26-17f98366_0
2025-10-02T08:14:55.220900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7061d8a7-eaad6c9e-abed6967-e6d811db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ed110a8-123607cc-b5905a26-17f98366_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:55.220900Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2209
2025-10-02T08:14:55.223461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed110a8-123607cc-b5905a26-17f98366_0] Write session: try to update token
2025-10-02T08:14:55.223477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed110a8-123607cc-b5905a26-17f98366_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:55.241321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId: src_id|9ed110a8-123607cc-b5905a26-17f98366_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:55.241963Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:55.241980Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:55.241983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:55.241991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534946239006927:12467]
2025-10-02T08:14:55.241996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534946239006927:12467]
2025-10-02T08:14:55.242034Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:55.242037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:55.242044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.242047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:55.242053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:55.242192Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:55.243774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:55.271261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534946239006958:12399]
2025-10-02T08:14:55.271355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2209, pipe: [1:7556534946239006958:12399]
2025-10-02T08:14:55.377105Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:55.377842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.377851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.377887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239006958:12399], now have 1 active actors on pipe
2025-10-02T08:14:55.378158Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:55.378347Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:55.378563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:55.378616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2210 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ed110a8-123607cc-b5905a26-17f98366_0
2025-10-02T08:14:55.378774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2210 sessionId: src_id|9ed110a8-123607cc-b5905a26-17f98366_0 is DEAD
2025-10-02T08:14:55.379031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed110a8-123607cc-b5905a26-17f98366_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:55.379038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed110a8-123607cc-b5905a26-17f98366_0] Write session will restart in 0.009344s
2025-10-02T08:14:55.379060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed110a8-123607cc-b5905a26-17f98366_0] Write session: Do CDS request
2025-10-02T08:14:55.379066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed110a8-123607cc-b5905a26-17f98366_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:55.379044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534946239006958:12399]
2025-10-02T08:14:55.389324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed110a8-123607cc-b5905a26-17f98366_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:55.389448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:55.389464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2211
2025-10-02T08:14:55.389585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:55.389614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:55.389619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:55.389622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:55.390104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2211 sessionId:  describe result for acl check
2025-10-02T08:14:55.390138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:55.390146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:55.390147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:55.390152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534946239007283:12474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:55.390680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534946239007283:12474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:55.394431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534946239007283:12474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:55.398139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534946239007283:12474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:55.398157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534946239007283:12474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:55.398160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534946239007283:12474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:55.398167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:55.408886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:55.409287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:55.409471Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:55.409480Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:55.409490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:55.409546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:55.409588Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534946239007720:12473]
2025-10-02T08:14:55.410017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:55.410184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:55.410215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:55.410414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:55.410441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.410445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.410446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.410447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.410448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.410451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.410457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.410459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.410461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.410463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.410467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.410472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.410475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.410478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.410481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.410484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.410486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.410488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.410491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.410493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.410504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:55.419331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:55.421148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:55.421169Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:55.421171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:55.421175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:55.421181Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2210 [1:7556534946239007720:12473]
2025-10-02T08:14:55.421192Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:55.421210Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:55.421213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.421216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.421218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.421233Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:55.421243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:55.421249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:55.421315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.421323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.421326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:55.421328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:55.421390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:55.421398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.421411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.421422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:55.421424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2210
2025-10-02T08:14:55.421441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239007511:12474], now have 1 active actors on pipe
2025-10-02T08:14:55.421444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534946698509622:2378], now have 1 active actors on pipe
2025-10-02T08:14:55.421497Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2210
2025-10-02T08:14:55.421449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.421457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.421474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534946239007714:12473]
2025-10-02T08:14:55.421476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534946239007714:12473]
2025-10-02T08:14:55.421487Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:55.421499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:55.421507Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:55.421511Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:55.421513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:55.421516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:55.421530Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|842af350-935b408-561ebc30-d88a0056_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:55.421537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.421541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.421543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:55.421552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.421560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:55.421592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534946239007714:12473]
2025-10-02T08:14:55.421600Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:55.421606Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:55.421621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.421669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.421679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.421693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.421728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2211 partition: 0 MaxSeqNo: 17 sessionId: src_id|842af350-935b408-561ebc30-d88a0056_0
2025-10-02T08:14:55.422052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed110a8-123607cc-b5905a26-17f98366_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|842af350-935b408-561ebc30-d88a0056_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:55.424509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842af350-935b408-561ebc30-d88a0056_0] Write session: try to update token
2025-10-02T08:14:55.424524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842af350-935b408-561ebc30-d88a0056_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:55.433182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:55.433204Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:55.433212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534946239007714:12473]
2025-10-02T08:14:55.433253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:55.433262Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:55.433461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:55.433613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:55.433793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:55.433969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:55.434157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:55.434192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:55.442941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId: src_id|842af350-935b408-561ebc30-d88a0056_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:55.445508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:55.445677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.445695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.445730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:55.445753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:55.445889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.445898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.446059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.446125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.446204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.446275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.446341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.446351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.446421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.446500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.446564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.446630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.446775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.446784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.446886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.446949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.447018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.447082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.447194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.447202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.447270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.447331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.447396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.447458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.447515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.447526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.447594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.447657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.447723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.447835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.447878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.447881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.447950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.448042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.448101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.448158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.448223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.448226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.448331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.448449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.448527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.448603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.448662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.448672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.448839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.448945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.449012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.449077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.449121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.449129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.449197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.449373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.449438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.449503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.449563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.449573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.449642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:55.449705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:55.449772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:55.449835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:55.449893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:55.449901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:55.449956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:55.450024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.450049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.450060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:55.450093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:55.450105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:55.450109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:55.450112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:55.450116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:55.450562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:55.450581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:55.450588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:55.450592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:55.450595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:55.450598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:55.451582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:55.451610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:55.451616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:55.451620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:55.451623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:55.451627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:55.452368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:55.452396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:55.452403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:55.452406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:55.452409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:55.453651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:55.453668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:55.453680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392895453
2025-10-02T08:14:55.453795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:55.453815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:55.453822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:55.453825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:55.453829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:55.453832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:55.454315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:55.454332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:55.454340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:55.454344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:55.454347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:55.454350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:55.454939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:55.454953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:55.454959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:55.454963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:55.454968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:55.454971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:55.455497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:55.455512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:55.455517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:55.456617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:55.456627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:55.456633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:55.456637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:55.456646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392895456
2025-10-02T08:14:55.457277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:55.457310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:55.457316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:55.457320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:55.457324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:55.457328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:55.457805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:55.457832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:55.457840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:55.457843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:55.457852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:55.457855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:55.458361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:55.458389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.458495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392895458
2025-10-02T08:14:55.460968Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:55.460995Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:55.461002Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:55.461010Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:55.461020Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:55.461028Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:55.461030Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:55.461038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534946239007714:12473]
2025-10-02T08:14:55.461046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534946239007714:12473]
2025-10-02T08:14:55.461098Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:55.461109Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:55.461127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:55.461131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.461138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:55.461267Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:55.479128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534946239007747:12399]
2025-10-02T08:14:55.479244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2210, pipe: [1:7556534946239007747:12399]
2025-10-02T08:14:55.607015Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:55.607420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239007747:12399], now have 1 active actors on pipe
2025-10-02T08:14:55.607572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534946239007747:12399]
2025-10-02T08:14:55.607601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:55.607609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:55.607633Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:55.607634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2211 reason: error at write: Disconnected sessionId: src_id|842af350-935b408-561ebc30-d88a0056_0
2025-10-02T08:14:55.607651Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:55.607788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2211 sessionId: src_id|842af350-935b408-561ebc30-d88a0056_0 is DEAD
2025-10-02T08:14:55.607916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842af350-935b408-561ebc30-d88a0056_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:55.607928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842af350-935b408-561ebc30-d88a0056_0] Write session will restart in 0.006563s
2025-10-02T08:14:55.607951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842af350-935b408-561ebc30-d88a0056_0] Write session: Do CDS request
2025-10-02T08:14:55.607957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842af350-935b408-561ebc30-d88a0056_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:55.612116Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [7e4e9ab78cae7d12] Result# TEvPutResult {Id# [72075186224037892:2210:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:14:55.612121Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2210:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:55.612190Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2210:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:14:55.615172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842af350-935b408-561ebc30-d88a0056_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:55.615301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:55.615313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2212
2025-10-02T08:14:55.615430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:55.615451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:55.615457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:55.615471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:55.616303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2212 sessionId:  describe result for acl check
2025-10-02T08:14:55.616341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:55.616348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:55.616350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:55.616355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534946239007999:12481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:55.616874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534946239007999:12481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:55.619007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534946239007999:12481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:55.621894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534946239007999:12481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:55.621910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534946239007999:12481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:55.621913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534946239007999:12481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:55.621920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:55.630222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:55.631827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:55.632005Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:55.632016Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:55.632026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:55.632072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:55.632107Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534946239008515:12480]
2025-10-02T08:14:55.632681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:55.632896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:55.632939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:55.633249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:55.633293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.633300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.633302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.633303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.633303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.633308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.633318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.633322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.633325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.633329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.633334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.633342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.633347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.633352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.633359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.633365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.633372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.633378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.633382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.633392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.633410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:55.641407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:55.643212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:55.643233Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:55.643236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:55.643240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:55.643246Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2211 [1:7556534946239008515:12480]
2025-10-02T08:14:55.643257Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:55.643273Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:55.643281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.643284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.643285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.643300Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:55.643307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:55.643318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:55.643376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.643383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.643386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:55.643388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:55.643449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:55.643460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.643472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.643483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:55.643499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239008258:12481], now have 1 active actors on pipe
2025-10-02T08:14:55.643502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2211
2025-10-02T08:14:55.643504Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534946239008509:12480]
2025-10-02T08:14:55.643506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534946239008509:12480]
2025-10-02T08:14:55.643513Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:55.643523Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:55.643524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534946698509629:2378], now have 1 active actors on pipe
2025-10-02T08:14:55.643531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.643526Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:55.643535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.643550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:55.643565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:55.643568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:55.643607Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:55.643613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.643616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.643618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:55.643627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.643642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:55.643649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534946239008509:12480]
2025-10-02T08:14:55.643657Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:55.643682Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:55.643686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.643752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.643760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.643773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.643810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2212 partition: 0 MaxSeqNo: 17 sessionId: src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0
2025-10-02T08:14:55.644136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842af350-935b408-561ebc30-d88a0056_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:55.643584Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2211
2025-10-02T08:14:55.646683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0] Write session: try to update token
2025-10-02T08:14:55.646701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:55.660116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId: src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:55.661033Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:55.661049Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:55.661052Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:55.661060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534946239008509:12480]
2025-10-02T08:14:55.661065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534946239008509:12480]
2025-10-02T08:14:55.661105Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:55.661108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:55.661116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.661117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:55.661118Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:55.661255Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:55.662550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:55.708005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534946239008543:12399]
2025-10-02T08:14:55.708128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2211, pipe: [1:7556534946239008543:12399]
2025-10-02T08:14:55.794161Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:55.794598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.794611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.794650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239008543:12399], now have 1 active actors on pipe
2025-10-02T08:14:55.794807Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:55.794821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534946239008543:12399]
2025-10-02T08:14:55.794838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:55.794887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2212 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0
2025-10-02T08:14:55.795045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2212 sessionId: src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0 is DEAD
2025-10-02T08:14:55.795205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:55.795216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0] Write session will restart in 0.006099s
2025-10-02T08:14:55.795239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0] Write session: Do CDS request
2025-10-02T08:14:55.795248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:55.795381Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:55.802250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:55.802346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:55.802362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2213
2025-10-02T08:14:55.804992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:55.805033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:55.805042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:55.805045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:55.805528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2213 sessionId:  describe result for acl check
2025-10-02T08:14:55.805568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:55.805573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:55.805576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:55.805581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534946239009005:12488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:55.806075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534946239009005:12488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:55.809061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534946239009005:12488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:55.813512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534946239009005:12488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:55.813529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534946239009005:12488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:55.813532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534946239009005:12488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:55.813540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:55.816757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:55.818178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:55.818336Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:55.818348Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:55.818357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:55.818406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:55.818445Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534946239009322:12487]
2025-10-02T08:14:55.818977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:55.819185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:55.819231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:55.819544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:55.819603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.819608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.819609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.819610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.819611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.819616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.819625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.819629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.819634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.819641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.819647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.819658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:55.819668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.819677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:55.819685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.819695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:55.819703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.819712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.819720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.819725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.819743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:55.827858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:55.829638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:55.829654Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:55.829657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:55.829661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:55.829667Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2212 [1:7556534946239009322:12487]
2025-10-02T08:14:55.829680Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:55.829696Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:55.829699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.829703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.829705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.829723Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:55.829727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:55.829738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:55.829800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.829807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.829810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:55.829813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:55.829875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:55.829885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.829898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:55.829908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:55.829922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2212
2025-10-02T08:14:55.829926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239009245:12488], now have 1 active actors on pipe
2025-10-02T08:14:55.829933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534946239009316:12487]
2025-10-02T08:14:55.829935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534946239009316:12487]
2025-10-02T08:14:55.829942Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:55.829952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:55.829954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:55.829961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:55.829967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:55.829970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:55.829978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534946698509651:2378], now have 1 active actors on pipe
2025-10-02T08:14:55.829982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.829986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.830025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534946239009316:12487]
2025-10-02T08:14:55.830034Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:55.830040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:55.830047Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:55.830053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:55.830056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:55.830058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:55.830067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:55.830075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:55.830042Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2212
2025-10-02T08:14:55.830116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.830161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.830169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.830182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:55.830225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2213 partition: 0 MaxSeqNo: 17 sessionId: src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0
2025-10-02T08:14:55.830535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7c29438-3545cf8a-5f5a8b1a-af079017_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:55.833139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0] Write session: try to update token
2025-10-02T08:14:55.833155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:55.847190Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:55.847208Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:55.847210Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:55.847217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534946239009316:12487]
2025-10-02T08:14:55.847220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534946239009316:12487]
2025-10-02T08:14:55.847250Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:55.847252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:55.847254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:55.847256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:55.847257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:55.847267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId: src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:55.847391Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:55.849721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:55.894860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534946239009349:12399]
2025-10-02T08:14:55.894970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2212, pipe: [1:7556534946239009349:12399]
2025-10-02T08:14:55.986528Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:55.987131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:55.987148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:55.987187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534946239009349:12399], now have 1 active actors on pipe
2025-10-02T08:14:55.987312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534946239009349:12399]
2025-10-02T08:14:55.987338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:55.987345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:55.987397Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:55.987422Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:55.987417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2213 reason: error at write: Disconnected sessionId: src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0
2025-10-02T08:14:55.987587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2213 sessionId: src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0 is DEAD
2025-10-02T08:14:55.987746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:55.987753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0] Write session will restart in 0.008992s
2025-10-02T08:14:55.987777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0] Write session: Do CDS request
2025-10-02T08:14:55.987784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:55.998239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.000967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:56.000986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2214
2025-10-02T08:14:56.004942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.005003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:56.005014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:56.005018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:56.005488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2214 sessionId:  describe result for acl check
2025-10-02T08:14:56.005516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:56.005517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:56.005519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:56.005523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534950533977045:12494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:56.006034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534950533977045:12494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:56.009709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534950533977045:12494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:56.013737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534950533977045:12494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:56.013763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534950533977045:12494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:56.013767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534950533977045:12494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:56.013775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:56.020263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:56.021774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:56.021923Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:56.021932Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:56.021942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:56.021984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:56.022022Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534950533977411:12493]
2025-10-02T08:14:56.022512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:56.022682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:56.022718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:56.022940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:56.022985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.022986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.022987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.022988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.022989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.022994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.023002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.023006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.023010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.023012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.023017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.023024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.023029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.023033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.023037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.023041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.023045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.023049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.023053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.023057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.023080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:56.031017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:56.032704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:56.032720Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:56.032723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:56.032726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:56.032734Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2213 [1:7556534950533977411:12493]
2025-10-02T08:14:56.032745Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:56.032762Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:56.032765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.032768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.032769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.032783Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:56.032788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:56.032795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:56.032877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.032884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.032887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:56.032889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:56.032951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:56.032958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.032971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.032988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:56.033011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534946698509657:2378], now have 1 active actors on pipe
2025-10-02T08:14:56.033021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2213
2025-10-02T08:14:56.033022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534950533977405:12493]
2025-10-02T08:14:56.033024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534950533977405:12493]
2025-10-02T08:14:56.033033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:56.033041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533977240:12494], now have 1 active actors on pipe
2025-10-02T08:14:56.033044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:56.033048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:56.033053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:56.033066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:56.033073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:56.033080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.033088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.033126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534950533977405:12493]
2025-10-02T08:14:56.033133Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:56.033142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:56.033148Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:56.033153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.033158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.033160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:56.033170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.033178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:56.033261Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2213
2025-10-02T08:14:56.033211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.033384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.033394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.033416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.033452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2214 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0
2025-10-02T08:14:56.033808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de1d22e6-c4969175-ac8d7102-2b231a4e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:56.036560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0] Write session: try to update token
2025-10-02T08:14:56.036575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:56.046661Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:56.046681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:56.046691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534950533977405:12493]
2025-10-02T08:14:56.046730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:56.046892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:56.047029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:56.047164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:56.047297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:56.047477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:56.047507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:56.048837Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:56.051993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId: src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:56.054484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:56.054542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.054553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.054582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:56.054604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:56.054644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.054661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.054828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.054885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.054956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.055015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.055509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.055520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.055587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.055642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.055727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.055792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.055838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.055844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.055907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.055963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.056021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.056075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.056114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.056121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.056194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.056257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.056316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.056373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.056417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.056423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.056488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.056545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.056603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.056661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.056702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.056708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.056771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.056848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.056909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.056967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.057016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.057023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.057084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.057139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.057206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.057267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.057310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.057317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.057378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.057437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.057495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.057553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.057593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.057598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.057657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.057707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.057764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.057831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.057944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.057950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.058014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:56.058072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:56.058130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:56.058183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:56.058220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:56.058225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:56.058258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:56.058312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.058332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.058335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:56.058364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:56.058378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:56.058384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:56.058387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:56.058390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:56.058736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:56.058761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:56.058767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:56.058770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:56.058773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:56.058779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:56.059343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:56.059365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:56.059372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:56.059375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:56.059378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:56.059380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:56.059814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:56.059836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:56.059843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:56.059846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:56.059849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:56.061040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:56.061059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:56.061069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392896060
2025-10-02T08:14:56.061176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:56.061187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:56.061193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:56.061196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:56.061200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:56.061203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:56.061679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:56.061696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:56.061701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:56.061704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:56.061707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:56.061712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:56.062173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:56.062193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:56.062203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:56.062207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:56.062210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:56.062217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:56.062653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:56.062674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:56.062680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:56.063663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:56.063678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:56.063687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:56.063690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:56.063698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392896063
2025-10-02T08:14:56.063963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:56.063980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:56.063986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:56.063989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:56.063992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:56.063996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:56.064428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:56.064449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:56.064454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:56.064458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:56.064461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:56.064464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:56.064890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:56.064906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.065002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392896064
2025-10-02T08:14:56.065695Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:56.065712Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:56.065718Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:56.065725Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:56.067205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:56.067217Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:56.067219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:56.067229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534950533977405:12493]
2025-10-02T08:14:56.067233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534950533977405:12493]
2025-10-02T08:14:56.067273Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:56.067286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:56.067287Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:56.067290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.067292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:56.067416Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:56.087381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534950533977445:12399]
2025-10-02T08:14:56.087636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2213, pipe: [1:7556534950533977445:12399]
2025-10-02T08:14:56.205281Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:56.205688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533977445:12399], now have 1 active actors on pipe
2025-10-02T08:14:56.205820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:56.205831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:56.205854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2214 reason: error at write: Disconnected sessionId: src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0
2025-10-02T08:14:56.205914Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:56.205918Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:56.206025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2214 sessionId: src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0 is DEAD
2025-10-02T08:14:56.206187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534950533977445:12399]
2025-10-02T08:14:56.206368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:56.206378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0] Write session will restart in 0.005735s
2025-10-02T08:14:56.206399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0] Write session: Do CDS request
2025-10-02T08:14:56.206406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:56.213169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.213276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:56.213292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2215
2025-10-02T08:14:56.213383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.213416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:56.213425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:56.213428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:56.213810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2215 sessionId:  describe result for acl check
2025-10-02T08:14:56.213842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:56.213848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:56.213850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:56.213855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534950533977860:12513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:56.214344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534950533977860:12513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:56.216671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534950533977860:12513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:56.219424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534950533977860:12513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:56.219447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534950533977860:12513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:56.219450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534950533977860:12513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:56.219457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:56.223475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:56.224766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:56.224917Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:56.224924Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:56.224931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:56.224966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:56.224992Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534950533978251:12512]
2025-10-02T08:14:56.225431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:56.225567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:56.225598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:56.225835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:56.225875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.225881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.225882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.225883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.225884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.225888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.225899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.225902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.225906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.225910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.225915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.225925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.225935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.225944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.225953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.225958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.225967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.225976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.225984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.225993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.226016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:56.233594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:56.235304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:56.235325Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:56.235327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:56.235330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:56.235337Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2214 [1:7556534950533978251:12512]
2025-10-02T08:14:56.235349Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:56.235367Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:56.235370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.235373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.235375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.235390Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:56.235395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:56.235401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:56.235464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.235476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.235479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:56.235486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:56.235549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:56.235557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.235568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.235577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:56.235711Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2214
2025-10-02T08:14:56.235596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533978131:12513], now have 1 active actors on pipe
2025-10-02T08:14:56.235611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534950533978245:12512]
2025-10-02T08:14:56.235613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534950533978245:12512]
2025-10-02T08:14:56.235614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2214
2025-10-02T08:14:56.235622Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:56.235635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:56.235635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:56.235639Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:56.235647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:56.235650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:56.235657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534950993476983:2378], now have 1 active actors on pipe
2025-10-02T08:14:56.235662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.235666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.235707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534950533978245:12512]
2025-10-02T08:14:56.235710Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:56.235725Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d248afea-18ac617d-4c494a83-139d8fbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:56.235730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.235734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.235736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:56.235737Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:56.235744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.235754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:56.235799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.235842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.235844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.235857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.235891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2215 partition: 0 MaxSeqNo: 17 sessionId: src_id|d248afea-18ac617d-4c494a83-139d8fbb_0
2025-10-02T08:14:56.236216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e916278-b8fdab33-1dcb91ba-891f960b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d248afea-18ac617d-4c494a83-139d8fbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:56.238900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d248afea-18ac617d-4c494a83-139d8fbb_0] Write session: try to update token
2025-10-02T08:14:56.238916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d248afea-18ac617d-4c494a83-139d8fbb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:56.252597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId: src_id|d248afea-18ac617d-4c494a83-139d8fbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:56.253762Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:56.253768Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:56.253770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:56.253780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534950533978245:12512]
2025-10-02T08:14:56.253786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534950533978245:12512]
2025-10-02T08:14:56.253848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:56.253855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.253857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:56.253961Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:56.253968Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:56.254059Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:56.255846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:56.306510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534950533978275:12399]
2025-10-02T08:14:56.306679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2214, pipe: [1:7556534950533978275:12399]
2025-10-02T08:14:56.390320Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:56.390867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.390880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.390919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533978275:12399], now have 1 active actors on pipe
2025-10-02T08:14:56.391033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534950533978275:12399]
2025-10-02T08:14:56.391054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:56.391060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:56.391106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2215 reason: error at write: Disconnected sessionId: src_id|d248afea-18ac617d-4c494a83-139d8fbb_0
2025-10-02T08:14:56.391135Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:56.391194Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:56.391254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2215 sessionId: src_id|d248afea-18ac617d-4c494a83-139d8fbb_0 is DEAD
2025-10-02T08:14:56.391368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d248afea-18ac617d-4c494a83-139d8fbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:56.391375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d248afea-18ac617d-4c494a83-139d8fbb_0] Write session will restart in 0.006086s
2025-10-02T08:14:56.391403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d248afea-18ac617d-4c494a83-139d8fbb_0] Write session: Do CDS request
2025-10-02T08:14:56.391410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d248afea-18ac617d-4c494a83-139d8fbb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:56.398284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d248afea-18ac617d-4c494a83-139d8fbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.398351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:56.398367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2216
2025-10-02T08:14:56.398502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.398532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:56.398541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:56.398543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:56.398998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2216 sessionId:  describe result for acl check
2025-10-02T08:14:56.399043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:56.399048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:56.399050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:56.399054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534950533978589:12519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:56.399532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534950533978589:12519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:56.402335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534950533978589:12519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:56.406001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534950533978589:12519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:56.406013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534950533978589:12519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:56.406017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534950533978589:12519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:56.406025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:56.412445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:56.414233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:56.414434Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:56.414444Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:56.414454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:56.414501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:56.414538Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534950533979048:12518]
2025-10-02T08:14:56.415172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:56.415369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:56.415410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:56.415702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:56.415748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.415754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.415756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.415757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.415758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.415763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.415774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.415779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.415783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.415787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.415793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.415806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.415813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.415823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.415828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.415838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.415847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.415857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.415866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.415876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.415899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:56.423672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:56.425613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:56.425630Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:56.425632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:56.425636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:56.425643Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2215 [1:7556534950533979048:12518]
2025-10-02T08:14:56.425654Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:56.425669Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:56.425673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.425675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.425678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.425692Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:56.425697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:56.425703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:56.425757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.425764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.425767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:56.425768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:56.425817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:56.425822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.425831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.425840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:56.425853Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534950533979042:12518]
2025-10-02T08:14:56.425858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534950533979042:12518]
2025-10-02T08:14:56.425864Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:56.425873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:56.425887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:56.425894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:56.425897Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:56.425901Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:56.425930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533978840:12519], now have 1 active actors on pipe
2025-10-02T08:14:56.425938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534950993476989:2378], now have 1 active actors on pipe
2025-10-02T08:14:56.425940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534950533979042:12518]
2025-10-02T08:14:56.425943Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:56.425946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:56.425947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2215
2025-10-02T08:14:56.425961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.425969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.425997Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:56.426005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.426007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.426009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:56.426015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.426026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:56.426039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.426066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.426072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.426083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.426080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2215
2025-10-02T08:14:56.426114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2216 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0
2025-10-02T08:14:56.426431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d248afea-18ac617d-4c494a83-139d8fbb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:56.429121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0] Write session: try to update token
2025-10-02T08:14:56.429137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:56.443323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId: src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:56.444095Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:56.444110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:56.444112Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:56.444118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534950533979042:12518]
2025-10-02T08:14:56.444121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534950533979042:12518]
2025-10-02T08:14:56.444156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:56.444161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.444167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:56.444175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:56.444197Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:56.444320Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:56.445870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:56.491350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534950533979074:12399]
2025-10-02T08:14:56.491470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2215, pipe: [1:7556534950533979074:12399]
2025-10-02T08:14:56.585713Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:56.586230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:56.586242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0] Write session will restart in 0.007842s
2025-10-02T08:14:56.586266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0] Write session: Do CDS request
2025-10-02T08:14:56.586272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:56.584952Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:56.585439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.585448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.585487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533979074:12399], now have 1 active actors on pipe
2025-10-02T08:14:56.585620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534950533979074:12399]
2025-10-02T08:14:56.585642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:56.585644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:56.585708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2216 reason: error at write: Disconnected sessionId: src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0
2025-10-02T08:14:56.585861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2216 sessionId: src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0 is DEAD
2025-10-02T08:14:56.585932Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:56.595319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.595327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:56.595352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2217
2025-10-02T08:14:56.595540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.595570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:56.595579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:56.595583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:56.595988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2217 sessionId:  describe result for acl check
2025-10-02T08:14:56.596019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:56.596024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:56.596026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:56.596030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534950533979437:12526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:56.596572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534950533979437:12526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:56.599008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534950533979437:12526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:56.602895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534950533979437:12526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:56.602911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534950533979437:12526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:56.602915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534950533979437:12526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:56.602923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:56.608445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:56.609774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:56.609941Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:56.609950Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:56.609959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:56.610006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:56.610047Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534950533979848:12525]
2025-10-02T08:14:56.610636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:56.610841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:56.610881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:56.611179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:56.611225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.611231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.611232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.611233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.611234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.611239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.611249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.611253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.611258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.611262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.611267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.611275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.611281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.611286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.611295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.611300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.611306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.611311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.611315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.611321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.611345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:56.619523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:56.621140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:56.621157Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:56.621159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:56.621162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:56.621169Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2216 [1:7556534950533979848:12525]
2025-10-02T08:14:56.621182Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:56.621200Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:56.621208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.621211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.621213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.621229Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:56.621234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:56.621240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:56.621306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.621318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.621321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:56.621324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:56.621677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2216
2025-10-02T08:14:56.621872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:56.621876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.621890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.621904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:56.621925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534950993476995:2378], now have 1 active actors on pipe
2025-10-02T08:14:56.621929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533979692:12526], now have 1 active actors on pipe
2025-10-02T08:14:56.621935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534950533979842:12525]
2025-10-02T08:14:56.621937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534950533979842:12525]
2025-10-02T08:14:56.621944Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:56.621953Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:56.621956Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:56.621956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.621960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.621975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:56.621988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:56.621991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:56.622034Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|927272d7-fdf87d0a-803cae13-894c854c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:56.622040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.622043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.622045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:56.622055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.622063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:56.622070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534950533979842:12525]
2025-10-02T08:14:56.622082Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:56.622086Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:56.622103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.622348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.622358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.622372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.622401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2217 partition: 0 MaxSeqNo: 17 sessionId: src_id|927272d7-fdf87d0a-803cae13-894c854c_0
2025-10-02T08:14:56.622788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a5bad-d4e75f53-6eeb688c-d0e806ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|927272d7-fdf87d0a-803cae13-894c854c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:56.621869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2216
2025-10-02T08:14:56.625477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927272d7-fdf87d0a-803cae13-894c854c_0] Write session: try to update token
2025-10-02T08:14:56.625495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927272d7-fdf87d0a-803cae13-894c854c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:56.639600Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:56.639623Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:56.639626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:56.639633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534950533979842:12525]
2025-10-02T08:14:56.639638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534950533979842:12525]
2025-10-02T08:14:56.639679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:56.639686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.639686Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:56.639687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:56.639693Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:56.639831Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:56.642369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId: src_id|927272d7-fdf87d0a-803cae13-894c854c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:56.645085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:56.685924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534950533979876:12399]
2025-10-02T08:14:56.686064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2216, pipe: [1:7556534950533979876:12399]
2025-10-02T08:14:56.775173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:56.775382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.775392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.775423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533979876:12399], now have 1 active actors on pipe
2025-10-02T08:14:56.775512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:56.775521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:56.775559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2217 reason: error at write: Disconnected sessionId: src_id|927272d7-fdf87d0a-803cae13-894c854c_0
2025-10-02T08:14:56.775638Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:56.775630Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:56.775709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2217 sessionId: src_id|927272d7-fdf87d0a-803cae13-894c854c_0 is DEAD
2025-10-02T08:14:56.775829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927272d7-fdf87d0a-803cae13-894c854c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:56.775822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534950533979876:12399]
2025-10-02T08:14:56.775840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927272d7-fdf87d0a-803cae13-894c854c_0] Write session will restart in 0.006268s
2025-10-02T08:14:56.775866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927272d7-fdf87d0a-803cae13-894c854c_0] Write session: Do CDS request
2025-10-02T08:14:56.775872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927272d7-fdf87d0a-803cae13-894c854c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:56.783336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927272d7-fdf87d0a-803cae13-894c854c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.783368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:56.783385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2218
2025-10-02T08:14:56.783559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.783581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:56.783588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:56.783591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:56.784075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2218 sessionId:  describe result for acl check
2025-10-02T08:14:56.784106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:56.784108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:56.784110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:56.784116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534950533980196:12533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:56.784569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534950533980196:12533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:56.787302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534950533980196:12533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:56.790687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534950533980196:12533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:56.790704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534950533980196:12533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:56.790707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534950533980196:12533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:56.790715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:56.799065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:56.799348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:56.799496Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:56.799505Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:56.799512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:56.799546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:56.799583Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534950533980665:12532]
2025-10-02T08:14:56.800165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:56.800341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:56.800374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:56.800653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:56.800686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.800691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.800692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.800693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.800694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.800698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.800707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.800710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.800713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.800716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.800721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.800727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:56.800732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.800737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:56.800740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.800744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:56.800748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.800752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.800755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.800759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.800774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:56.808615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:56.810344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:56.810360Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:56.810362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:56.810365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:56.810369Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2217 [1:7556534950533980665:12532]
2025-10-02T08:14:56.810379Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:56.810392Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:56.810394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.810396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.810398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.810411Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:56.810414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:56.810420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:56.810467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.810473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.810475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:56.810477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:56.810527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:56.810535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.810549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:56.810564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:56.810577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534950533980657:12532]
2025-10-02T08:14:56.810583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534950533980657:12532]
2025-10-02T08:14:56.810589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:56.810597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533980475:12533], now have 1 active actors on pipe
2025-10-02T08:14:56.810607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:56.810612Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:56.810614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:56.810616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:56.810616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:56.810619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2217
2025-10-02T08:14:56.810621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534950993477016:2378], now have 1 active actors on pipe
2025-10-02T08:14:56.810643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534950533980657:12532]
2025-10-02T08:14:56.810653Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:56.810658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.810661Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:56.810695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.810748Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73fbaa5-9e111617-fac7addb-d876cc96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:56.810758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:56.810761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:56.810762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:56.810769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:56.810777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:56.810790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.810742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2217
2025-10-02T08:14:56.810869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.810877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.810895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:56.810931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2218 partition: 0 MaxSeqNo: 17 sessionId: src_id|73fbaa5-9e111617-fac7addb-d876cc96_0
2025-10-02T08:14:56.811652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927272d7-fdf87d0a-803cae13-894c854c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|73fbaa5-9e111617-fac7addb-d876cc96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:56.814464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73fbaa5-9e111617-fac7addb-d876cc96_0] Write session: try to update token
2025-10-02T08:14:56.814481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73fbaa5-9e111617-fac7addb-d876cc96_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:56.828123Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:56.828145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:56.828147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:56.828160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534950533980657:12532]
2025-10-02T08:14:56.828164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534950533980657:12532]
2025-10-02T08:14:56.828200Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:56.828205Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:56.828213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:56.828219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:56.828221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:56.828360Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:56.833958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId: src_id|73fbaa5-9e111617-fac7addb-d876cc96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:56.836260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:56.876049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534950533980691:12399]
2025-10-02T08:14:56.876203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2217, pipe: [1:7556534950533980691:12399]
2025-10-02T08:14:56.959442Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:56.959679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:56.959692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:56.959727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533980691:12399], now have 1 active actors on pipe
2025-10-02T08:14:56.959830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:56.959838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:56.959888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2218 reason: error at write: Disconnected sessionId: src_id|73fbaa5-9e111617-fac7addb-d876cc96_0
2025-10-02T08:14:56.959935Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:56.960033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2218 sessionId: src_id|73fbaa5-9e111617-fac7addb-d876cc96_0 is DEAD
2025-10-02T08:14:56.960133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534950533980691:12399]
2025-10-02T08:14:56.960292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fbaa5-9e111617-fac7addb-d876cc96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:56.960300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fbaa5-9e111617-fac7addb-d876cc96_0] Write session will restart in 0.009243s
2025-10-02T08:14:56.960321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fbaa5-9e111617-fac7addb-d876cc96_0] Write session: Do CDS request
2025-10-02T08:14:56.960327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fbaa5-9e111617-fac7addb-d876cc96_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:56.959934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:56.970244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73fbaa5-9e111617-fac7addb-d876cc96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.970546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:56.970561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2219
2025-10-02T08:14:56.970694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:56.970736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:56.970745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:56.970749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:56.971131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2219 sessionId:  describe result for acl check
2025-10-02T08:14:56.971166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:56.971172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:56.971174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:56.971179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534950533980725:12539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:56.971573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534950533980725:12539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:56.973469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534950533980725:12539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:56.981730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534950533980725:12539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:56.981747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534950533980725:12539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:56.981750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534950533980725:12539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:56.981758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:56.998945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:57.000327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:57.000506Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:57.000515Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:57.000524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:57.000579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:57.000616Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534954828948763:12538]
2025-10-02T08:14:57.001222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:57.001439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:57.001475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:57.001675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:57.001701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.001706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.001706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.001707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.001708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.001711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.001717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.001719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.001721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.001723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.001727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.001732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.001735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.001738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.001740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.001743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.001745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.001748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.001751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.001754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.001765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:57.009255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:57.010641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:57.010660Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:57.010662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:57.010666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:57.010672Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2218 [1:7556534954828948763:12538]
2025-10-02T08:14:57.010682Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:57.010699Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:57.010707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.010709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.010712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.010725Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:57.010734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:57.010740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:57.010793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.010800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.010803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:57.010806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:57.010859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:57.010866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.010876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.010888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:57.010907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534950533981461:12538]
2025-10-02T08:14:57.010909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534950533981461:12538]
2025-10-02T08:14:57.010915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:57.010916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2218
2025-10-02T08:14:57.010927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534950533981037:12539], now have 1 active actors on pipe
2025-10-02T08:14:57.010931Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:57.010937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:57.010946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:57.010951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:57.010954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:57.010959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534950993477025:2378], now have 1 active actors on pipe
2025-10-02T08:14:57.010962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.010966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.011001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534950533981461:12538]
2025-10-02T08:14:57.011013Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:57.011022Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:57.011026Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|814498c6-73b19c23-c85c8c13-9fc94583_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:57.011031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.011007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2218
2025-10-02T08:14:57.011036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.011042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:57.011050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.011057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:57.011091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.011128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.011134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.011145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.011177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2219 partition: 0 MaxSeqNo: 17 sessionId: src_id|814498c6-73b19c23-c85c8c13-9fc94583_0
2025-10-02T08:14:57.011474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fbaa5-9e111617-fac7addb-d876cc96_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|814498c6-73b19c23-c85c8c13-9fc94583_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:57.013898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814498c6-73b19c23-c85c8c13-9fc94583_0] Write session: try to update token
2025-10-02T08:14:57.013911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814498c6-73b19c23-c85c8c13-9fc94583_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:57.026249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId: src_id|814498c6-73b19c23-c85c8c13-9fc94583_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:57.027626Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:57.027642Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:57.027645Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:57.027654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534950533981461:12538]
2025-10-02T08:14:57.027658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534950533981461:12538]
2025-10-02T08:14:57.027700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:57.027703Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:57.027705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.027707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:57.027709Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:57.027845Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:57.028721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:57.060164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534954828948791:12399]
2025-10-02T08:14:57.060292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2218, pipe: [1:7556534954828948791:12399]
2025-10-02T08:14:57.171773Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:57.172422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.172436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.172473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828948791:12399], now have 1 active actors on pipe
2025-10-02T08:14:57.172587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:57.172594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:57.172642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2219 reason: error at write: Disconnected sessionId: src_id|814498c6-73b19c23-c85c8c13-9fc94583_0
2025-10-02T08:14:57.172702Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:57.172716Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:57.172794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2219 sessionId: src_id|814498c6-73b19c23-c85c8c13-9fc94583_0 is DEAD
2025-10-02T08:14:57.172965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814498c6-73b19c23-c85c8c13-9fc94583_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:57.172975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814498c6-73b19c23-c85c8c13-9fc94583_0] Write session will restart in 0.009371s
2025-10-02T08:14:57.172997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814498c6-73b19c23-c85c8c13-9fc94583_0] Write session: Do CDS request
2025-10-02T08:14:57.173002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814498c6-73b19c23-c85c8c13-9fc94583_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:57.173086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534954828948791:12399]
2025-10-02T08:14:57.183249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814498c6-73b19c23-c85c8c13-9fc94583_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.183259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:57.183277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2220
2025-10-02T08:14:57.183424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.183453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:57.183462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:57.183465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:57.183840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2220 sessionId:  describe result for acl check
2025-10-02T08:14:57.183871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:57.183877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:57.183879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:57.183883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534954828949299:12552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:57.184330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534954828949299:12552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:57.186976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534954828949299:12552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:57.190572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534954828949299:12552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:57.190584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534954828949299:12552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:57.190587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534954828949299:12552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:57.190594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:57.192384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:57.193826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:57.194015Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:57.194024Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:57.194040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:57.194084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:57.194123Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534954828949583:12545]
2025-10-02T08:14:57.194595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:57.194798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:57.194841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:57.195053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:57.195093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.195097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.195098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.195098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.195099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.195102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.195108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.195112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.195114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.195116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.195119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.195123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.195126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.195129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.195131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.195134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.195136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.195138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.195141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.195144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.195152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:57.202989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:57.204540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:57.204557Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:57.204559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:57.204562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:57.204567Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2219 [1:7556534954828949583:12545]
2025-10-02T08:14:57.204578Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:57.204592Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:57.204594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.204599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.204601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.204615Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:57.204619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:57.204625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:57.204675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.204680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.204683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:57.204685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:57.204742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:57.204749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.204761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.204776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:57.204817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534954828949577:12545]
2025-10-02T08:14:57.204822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534954828949577:12545]
2025-10-02T08:14:57.204828Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:57.204841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828949562:12552], now have 1 active actors on pipe
2025-10-02T08:14:57.204853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:57.204860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:57.204863Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:57.204869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:57.204875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:57.204881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534955288444328:2378], now have 1 active actors on pipe
2025-10-02T08:14:57.204906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534954828949577:12545]
2025-10-02T08:14:57.204917Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:57.204927Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:57.204981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2219
2025-10-02T08:14:57.204957Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2219
2025-10-02T08:14:57.204992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.205001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.205029Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:57.205039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.205044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.205046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:57.205054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.205065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:57.205080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.205108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.205113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.205124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.205157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2220 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0
2025-10-02T08:14:57.205427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814498c6-73b19c23-c85c8c13-9fc94583_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:57.207852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0] Write session: try to update token
2025-10-02T08:14:57.207864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:57.215466Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:57.215488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:57.215495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534954828949577:12545]
2025-10-02T08:14:57.215531Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:57.215533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:57.215695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:57.215842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:57.215979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:57.216119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:57.216319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:57.216360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:57.221232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId: src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:57.223708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:57.223794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.223812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.223845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:57.223868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:57.223905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.223916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.224068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.224132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.224218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.224287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.224932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.224946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.225014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.225075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.225148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.225216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.225260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.225267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.225346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.225414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.225483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.225572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.225620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.225630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.225699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.225768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.225836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.225909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.225975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.225985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.226065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.226134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.226201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.226261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.226304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.226306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.226379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.226439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.226505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.226571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.226626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.226631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.226702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.226766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.226838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.226904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.226972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.226979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.227056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.227122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.227193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.227260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.227319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.227327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.227395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.227453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.227512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.227572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.227614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.227619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.227682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:57.227748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:57.227812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:57.227878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:57.227924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:57.227931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:57.227961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:57.228007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.228024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.228029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:57.228055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:57.228068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:57.228073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:57.228075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:57.228077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:57.228455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:57.228477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:57.228482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:57.228489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:57.228491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:57.228494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:57.228985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:57.229005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:57.229009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:57.229011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:57.229013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:57.229016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:57.229904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:57.229932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:57.229939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:57.229942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:57.229945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:57.231246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:57.231269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:57.231281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392897231
2025-10-02T08:14:57.231689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:57.231708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:57.231712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:57.231716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:57.231719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:57.231721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:57.232310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:57.232334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:57.232341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:57.232345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:57.232348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:57.232351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:57.232820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:57.232841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:57.232849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:57.232853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:57.232856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:57.232859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:57.233303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:57.233325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:57.233331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:57.234488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:57.234516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:57.234523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:57.234526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:57.234534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392897234
2025-10-02T08:14:57.234913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:57.234945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:57.234952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:57.234955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:57.234960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:57.234963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:57.235471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:57.235497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:57.235504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:57.235507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:57.235513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:57.235521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:57.236031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:57.236055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.236158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392897235
2025-10-02T08:14:57.236983Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:57.237001Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:57.237008Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:57.237015Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:57.238681Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:57.238698Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:57.238700Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:57.238708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534954828949577:12545]
2025-10-02T08:14:57.238713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534954828949577:12545]
2025-10-02T08:14:57.238773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:57.238782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.238784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:57.238808Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:57.238823Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:57.238915Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:57.273166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534954828949637:12399]
2025-10-02T08:14:57.273293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2219, pipe: [1:7556534954828949637:12399]
2025-10-02T08:14:57.371595Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:57.372008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828949637:12399], now have 1 active actors on pipe
2025-10-02T08:14:57.372126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:57.372135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:57.372162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2220 reason: error at write: Disconnected sessionId: src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0
2025-10-02T08:14:57.372241Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:57.372248Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:57.372338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2220 sessionId: src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0 is DEAD
2025-10-02T08:14:57.372428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:57.372437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0] Write session will restart in 0.009593s
2025-10-02T08:14:57.372459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0] Write session: Do CDS request
2025-10-02T08:14:57.372466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:57.372504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534954828949637:12399]
2025-10-02T08:14:57.383277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.383314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:57.383330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2221
2025-10-02T08:14:57.383459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.383489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:57.383498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:57.383501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:57.384010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2221 sessionId:  describe result for acl check
2025-10-02T08:14:57.384047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:57.384049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:57.384051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:57.384057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534954828950160:12564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:57.384544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534954828950160:12564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:57.387174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534954828950160:12564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:57.390387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534954828950160:12564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:57.390401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534954828950160:12564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:57.390404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534954828950160:12564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:57.390410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:57.393236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:57.393563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:57.393709Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:57.393719Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:57.393728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:57.393767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:57.393802Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534954828950418:12563]
2025-10-02T08:14:57.394391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:57.394595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:57.394646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:57.394973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:57.395048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.395056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.395057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.395058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.395059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.395064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.395072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.395075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.395078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.395081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.395088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.395101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.395107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.395111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.395115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.395120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.395130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.395135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.395144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.395149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.395171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:57.402763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:57.404317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:57.404332Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:57.404334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:57.404337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:57.404343Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2220 [1:7556534954828950418:12563]
2025-10-02T08:14:57.404355Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:57.404373Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:57.404380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.404383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.404385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.404399Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:57.404403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:57.404409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:57.404466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.404473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.404476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:57.404478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:57.404538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:57.404545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.404558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.404568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:57.404581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2220
2025-10-02T08:14:57.404588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828950397:12564], now have 1 active actors on pipe
2025-10-02T08:14:57.404590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534955288444358:2378], now have 1 active actors on pipe
2025-10-02T08:14:57.404596Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534954828950412:12563]
2025-10-02T08:14:57.404598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534954828950412:12563]
2025-10-02T08:14:57.404609Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:57.404621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:57.404623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.404624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:57.404629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.404645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:57.404657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:57.404665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:57.404673Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2220
2025-10-02T08:14:57.404700Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:57.404709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.404712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.404714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:57.404722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.404730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:57.404737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534954828950412:12563]
2025-10-02T08:14:57.404744Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:57.404757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:57.404775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.404847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.404854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.404868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.404904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2221 partition: 0 MaxSeqNo: 17 sessionId: src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0
2025-10-02T08:14:57.405193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce38c2d-a33dfc25-c4e3b6bc-ac057e63_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:57.407673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0] Write session: try to update token
2025-10-02T08:14:57.407687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:57.420577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId: src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:57.421008Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:57.421023Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:57.421025Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:57.421033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534954828950412:12563]
2025-10-02T08:14:57.421041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534954828950412:12563]
2025-10-02T08:14:57.421070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:57.421080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:57.421082Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:57.421086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.421088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:57.421217Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:57.422821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:57.472846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534954828950446:12399]
2025-10-02T08:14:57.472924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2220, pipe: [1:7556534954828950446:12399]
2025-10-02T08:14:57.555449Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:57.556019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.556031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.556063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828950446:12399], now have 1 active actors on pipe
2025-10-02T08:14:57.556191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:57.556203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:57.556267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2221 reason: error at write: Disconnected sessionId: src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0
2025-10-02T08:14:57.556268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:57.556393Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:57.556424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2221 sessionId: src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0 is DEAD
2025-10-02T08:14:57.556598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534954828950446:12399]
2025-10-02T08:14:57.556616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:57.556627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0] Write session will restart in 0.008589s
2025-10-02T08:14:57.556649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0] Write session: Do CDS request
2025-10-02T08:14:57.556655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:57.566262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.566328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:57.566345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2222
2025-10-02T08:14:57.566449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.566477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:57.566482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:57.566485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:57.566891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2222 sessionId:  describe result for acl check
2025-10-02T08:14:57.566925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:57.566927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:57.566928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:57.566933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534954828950865:12571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:57.567418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534954828950865:12571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:57.570036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534954828950865:12571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:57.573023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534954828950865:12571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:57.573041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534954828950865:12571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:57.573044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534954828950865:12571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:57.573051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:57.577368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:57.578491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:57.578770Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:57.578784Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:57.578796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:57.578848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:57.578890Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534954828951229:12570]
2025-10-02T08:14:57.579587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:57.579777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:57.579816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:57.580138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:57.580192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.580198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.580199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.580200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.580202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.580207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.580218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.580223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.580227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.580231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.580237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.580244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.580250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.580260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.580269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.580278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.580286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.580290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.580300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.580310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.580333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:57.588255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:57.590161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:57.590181Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:57.590183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:57.590187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:57.590195Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2221 [1:7556534954828951229:12570]
2025-10-02T08:14:57.590205Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:57.590221Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:57.590224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.590227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.590229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.590244Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:57.590248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:57.590255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:57.590308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.590316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.590319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:57.590322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:57.590383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:57.590393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.590404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.590416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:57.590441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828951139:12571], now have 1 active actors on pipe
2025-10-02T08:14:57.590447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2221
2025-10-02T08:14:57.590448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534955288444364:2378], now have 1 active actors on pipe
2025-10-02T08:14:57.590454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534954828951223:12570]
2025-10-02T08:14:57.590456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534954828951223:12570]
2025-10-02T08:14:57.590467Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:57.590479Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:57.590480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.590481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:57.590484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.590500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:57.590517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:57.590523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:57.590526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2221
2025-10-02T08:14:57.590561Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:57.590572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.590575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.590577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:57.590585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.590597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:57.590608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534954828951223:12570]
2025-10-02T08:14:57.590619Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:57.590637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:57.590650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.590675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.590681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.590694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.590733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2222 partition: 0 MaxSeqNo: 17 sessionId: src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0
2025-10-02T08:14:57.591041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ad9ae-30b172c3-199cabe0-d482f7eb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:57.593637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0] Write session: try to update token
2025-10-02T08:14:57.593652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:57.607071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId: src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:57.607726Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:57.607746Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:57.607748Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:57.607757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534954828951223:12570]
2025-10-02T08:14:57.607762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534954828951223:12570]
2025-10-02T08:14:57.607799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:57.607805Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:57.607810Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:57.607810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.607813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:57.607947Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:57.609548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:57.656650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534954828951257:12399]
2025-10-02T08:14:57.656766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2221, pipe: [1:7556534954828951257:12399]
2025-10-02T08:14:57.740441Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:57.740939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.740956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.740999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828951257:12399], now have 1 active actors on pipe
2025-10-02T08:14:57.743828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534954828951257:12399]
2025-10-02T08:14:57.743867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:57.743870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:57.743943Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:57.743952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2222 reason: error at write: Disconnected sessionId: src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0
2025-10-02T08:14:57.743968Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:57.744105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2222 sessionId: src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0 is DEAD
2025-10-02T08:14:57.744362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:57.744373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0] Write session will restart in 0.008600s
2025-10-02T08:14:57.744398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0] Write session: Do CDS request
2025-10-02T08:14:57.744404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:57.754272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.754328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:57.754346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2223
2025-10-02T08:14:57.754501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.754544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:57.754550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:57.754553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:57.754983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2223 sessionId:  describe result for acl check
2025-10-02T08:14:57.755017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:57.755018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:57.755020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:57.755025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534954828951707:12577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:57.755541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534954828951707:12577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:57.758428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534954828951707:12577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:57.761572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534954828951707:12577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:57.761586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534954828951707:12577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:57.761588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534954828951707:12577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:57.761595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:57.766512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:57.766861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:57.767021Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:57.767034Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:57.767045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:57.767086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:57.767123Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534954828952057:12576]
2025-10-02T08:14:57.767744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:57.767924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:57.767961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:57.768263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:57.768309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.768314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.768315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.768316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.768318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.768323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.768333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.768337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.768340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.768344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.768349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.768356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.768361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.768366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.768370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.768375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.768379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.768383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.768387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.768392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.768409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:57.779220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9703a7cd-1f672eef-9bb76501-77a11b77_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:57.776616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:57.778364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:57.778370Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:57.778372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:57.778376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:57.778383Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2222 [1:7556534954828952057:12576]
2025-10-02T08:14:57.778395Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:57.778411Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:57.778414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.778417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.778418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.778434Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:57.778439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:57.778446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:57.778510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.778513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.778516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:57.778519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:57.778586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:57.778589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.778603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.778616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:57.778632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534954828952051:12576]
2025-10-02T08:14:57.778635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534954828952051:12576]
2025-10-02T08:14:57.778641Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:57.778656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828951983:12577], now have 1 active actors on pipe
2025-10-02T08:14:57.778660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:57.780945Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2222
2025-10-02T08:14:57.778662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:57.778664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:57.778676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:57.778679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:57.778680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2222
2025-10-02T08:14:57.778684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534955288444383:2378], now have 1 active actors on pipe
2025-10-02T08:14:57.778714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.778718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.778731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534954828952051:12576]
2025-10-02T08:14:57.778740Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:57.778750Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:57.778765Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:57.778771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.778775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.778777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:57.778786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.778795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:57.778817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.778858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.778860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.778871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.778904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2223 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0
2025-10-02T08:14:57.781762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0] Write session: try to update token
2025-10-02T08:14:57.781777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:57.795247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId: src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:57.796258Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:57.796272Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:57.796274Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:57.796281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534954828952051:12576]
2025-10-02T08:14:57.796284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534954828952051:12576]
2025-10-02T08:14:57.796317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:57.796326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.796328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:57.796333Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:57.796339Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:57.796452Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:57.797994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:57.844026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534954828952084:12399]
2025-10-02T08:14:57.844210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2222, pipe: [1:7556534954828952084:12399]
2025-10-02T08:14:57.926744Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:57.927247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.927261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.927292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828952084:12399], now have 1 active actors on pipe
2025-10-02T08:14:57.927442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534954828952084:12399]
2025-10-02T08:14:57.927481Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:57.927510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:57.927534Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:57.927580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2223 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0
2025-10-02T08:14:57.927736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2223 sessionId: src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0 is DEAD
2025-10-02T08:14:57.927879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:57.927888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0] Write session will restart in 0.008509s
2025-10-02T08:14:57.927915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0] Write session: Do CDS request
2025-10-02T08:14:57.927921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:57.937309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.937368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:57.937390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2224
2025-10-02T08:14:57.937537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:57.937569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:57.937578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:57.937581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:57.937977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2224 sessionId:  describe result for acl check
2025-10-02T08:14:57.938009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:57.938015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:57.938016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:57.938021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534954828952507:12584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:57.938557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534954828952507:12584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:57.941247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534954828952507:12584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:57.944487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534954828952507:12584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:57.944503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534954828952507:12584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:57.944506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534954828952507:12584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:57.944513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:57.948817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:57.950337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:57.950602Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:57.950617Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:57.950628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:57.950680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:57.950711Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534954828952871:12583]
2025-10-02T08:14:57.951355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:57.951543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:57.951576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:57.951855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:57.951889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.951890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.951891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.951892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.951893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.951897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.951906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.951909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.951913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.951916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.951921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.951928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:57.951933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.951937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:57.951942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.951946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:57.951950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.951955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.951963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.951967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.951983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:57.959748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:57.961688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:57.961708Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:57.961711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:57.961715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:57.961724Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2223 [1:7556534954828952871:12583]
2025-10-02T08:14:57.961734Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:57.961751Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:57.961754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.961757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.961758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.961773Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:57.961778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:57.961784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:57.961846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.961854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.961857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:57.961859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:57.961923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:57.961931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.961944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:57.961960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:57.961982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534954828952770:12584], now have 1 active actors on pipe
2025-10-02T08:14:57.961984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2223
2025-10-02T08:14:57.961993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534954828952865:12583]
2025-10-02T08:14:57.961995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534954828952865:12583]
2025-10-02T08:14:57.962006Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:57.962018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534955288444391:2378], now have 1 active actors on pipe
2025-10-02T08:14:57.962018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:57.962021Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:57.962028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.962032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.962047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:57.962064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:57.962072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:57.962091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2223
2025-10-02T08:14:57.962112Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:57.962125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:57.962128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:57.962131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:57.962140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:57.962148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:57.962158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534954828952865:12583]
2025-10-02T08:14:57.962167Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:57.962178Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:57.962198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.962266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:57.962273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:57.962285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:57.962323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2224 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0
2025-10-02T08:14:57.962632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4816d68-e6d8ad3f-b35af998-f8324fa6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:57.965200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0] Write session: try to update token
2025-10-02T08:14:57.965217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:57.980145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId: src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:57.980960Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:57.980987Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:57.980990Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:57.981003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534954828952865:12583]
2025-10-02T08:14:57.981009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534954828952865:12583]
2025-10-02T08:14:57.981054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:57.981062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:57.981067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:57.981071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:57.981073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:57.981337Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:57.982829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:58.028206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534959123920192:12399]
2025-10-02T08:14:58.028393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2223, pipe: [1:7556534959123920192:12399]
2025-10-02T08:14:58.127827Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:58.128308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.128323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.128360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123920192:12399], now have 1 active actors on pipe
2025-10-02T08:14:58.128462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534959123920192:12399]
2025-10-02T08:14:58.128483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:58.128485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:58.128530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2224 reason: error at write: Disconnected sessionId: src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0
2025-10-02T08:14:58.128545Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:58.128853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:58.128864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0] Write session will restart in 0.005632s
2025-10-02T08:14:58.128888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0] Write session: Do CDS request
2025-10-02T08:14:58.128894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:58.128589Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:58.128679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2224 sessionId: src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0 is DEAD
2025-10-02T08:14:58.135225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.135396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:58.135415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2225
2025-10-02T08:14:58.135529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.135559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:58.135568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:58.135571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:58.136010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2225 sessionId:  describe result for acl check
2025-10-02T08:14:58.136045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:58.136047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:58.136048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:58.136053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534959123920514:12591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:58.136555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534959123920514:12591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:58.139556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534959123920514:12591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:58.145640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534959123920514:12591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:58.145658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534959123920514:12591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:58.145661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534959123920514:12591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:58.145669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:58.154913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:58.156355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:58.156518Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:58.156525Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:58.156532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:58.156564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:58.156591Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534959123920982:12590]
2025-10-02T08:14:58.157043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:58.157208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:58.157248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:58.157457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:58.157509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.157514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.157515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.157516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.157516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.157519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.157528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.157532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.157535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.157538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.157544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.157551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.157556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.157559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.157562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.157564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.157567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.157570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.157575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.157577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.157587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:58.165435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:58.167029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:58.167045Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:58.167048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:58.167051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:58.167059Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2224 [1:7556534959123920982:12590]
2025-10-02T08:14:58.167069Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:58.167086Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:58.167089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.167092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.167094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.167108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:58.167112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:58.167118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:58.167181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.167189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.167192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:58.167194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:58.167252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:58.167260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.167269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.167279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:58.167295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534959123920976:12590]
2025-10-02T08:14:58.167296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534959123920976:12590]
2025-10-02T08:14:58.167302Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:58.167314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:58.167317Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:58.167320Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:58.167329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:58.167332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:58.167343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123920743:12591], now have 1 active actors on pipe
2025-10-02T08:14:58.167346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534959583411695:2378], now have 1 active actors on pipe
2025-10-02T08:14:58.167347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2224
2025-10-02T08:14:58.167376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.167385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.167397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534959123920976:12590]
2025-10-02T08:14:58.167404Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:58.167413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:58.167430Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:58.167440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.167444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.167446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:58.167456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.167440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2224
2025-10-02T08:14:58.167468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:58.167500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.167546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.167552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.167564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.167600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2225 partition: 0 MaxSeqNo: 17 sessionId: src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0
2025-10-02T08:14:58.167932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc54d0ee-9b48cf6a-dfd1d7b7-40ed1dd9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:58.170644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0] Write session: try to update token
2025-10-02T08:14:58.170662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:58.186153Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:58.186189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:58.186192Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:58.186204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534959123920976:12590]
2025-10-02T08:14:58.186209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534959123920976:12590]
2025-10-02T08:14:58.186253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:58.186268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:58.186269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:58.186277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.186281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:58.186481Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:58.186834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId: src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:58.189392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:58.256041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534959123921020:12399]
2025-10-02T08:14:58.258483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2224, pipe: [1:7556534959123921020:12399]
2025-10-02T08:14:58.316824Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:58.317030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.317041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.317077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123921020:12399], now have 1 active actors on pipe
2025-10-02T08:14:58.317195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534959123921020:12399]
2025-10-02T08:14:58.317216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:58.317221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:58.317273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2225 reason: error at write: Disconnected sessionId: src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0
2025-10-02T08:14:58.317323Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:58.317314Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:58.317434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2225 sessionId: src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0 is DEAD
2025-10-02T08:14:58.317572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:58.317581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0] Write session will restart in 0.007071s
2025-10-02T08:14:58.317607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0] Write session: Do CDS request
2025-10-02T08:14:58.317614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:58.326238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.326332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:58.326350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2226
2025-10-02T08:14:58.326463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.326492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:58.326500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:58.326504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:58.326893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2226 sessionId:  describe result for acl check
2025-10-02T08:14:58.326928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:58.326934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:58.326935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:58.326940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534959123921406:12609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:58.327411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534959123921406:12609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:58.329658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534959123921406:12609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:58.332962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534959123921406:12609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:58.332986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534959123921406:12609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:58.332989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534959123921406:12609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:58.332996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:58.339420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:58.340764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:58.340937Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:58.340943Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:58.340950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:58.340985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:58.341010Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534959123921833:12608]
2025-10-02T08:14:58.341414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:58.341561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:58.341584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:58.341825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:58.341873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.341878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.341878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.341879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.341880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.341883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.341892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.341895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.341899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.341901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.341908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.341914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.341919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.341923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.341927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.341931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.341935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.341939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.341943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.341947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.341963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:58.349531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:58.350986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:58.351001Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:58.351002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:58.351005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:58.351010Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2225 [1:7556534959123921833:12608]
2025-10-02T08:14:58.351019Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:58.351033Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:58.351035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.351037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.351038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.351049Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:58.351053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:58.351058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:58.351102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.351107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.351110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:58.351112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:58.351155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:58.351161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.351168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.351174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:58.351186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534959123921827:12608]
2025-10-02T08:14:58.351191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534959123921827:12608]
2025-10-02T08:14:58.351198Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:58.351207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123921651:12609], now have 1 active actors on pipe
2025-10-02T08:14:58.351214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:58.351217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:58.351216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2225
2025-10-02T08:14:58.351217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:58.351224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:58.351225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:58.351229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534959583411725:2378], now have 1 active actors on pipe
2025-10-02T08:14:58.351252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.351258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.351268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534959123921827:12608]
2025-10-02T08:14:58.351277Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:58.351287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:58.351293Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:58.351298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.351301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.351303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:58.351304Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2225
2025-10-02T08:14:58.351312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.351323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:58.351347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.351377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.351382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.351391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.351420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2226 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0
2025-10-02T08:14:58.351713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b445ee-e9bb0e8a-40f07af6-4d48742c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:58.354395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0] Write session: try to update token
2025-10-02T08:14:58.354410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:58.368095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId: src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:58.368721Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:58.368736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:58.368737Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:58.368744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534959123921827:12608]
2025-10-02T08:14:58.368747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534959123921827:12608]
2025-10-02T08:14:58.368783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:58.368789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.368798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:58.368816Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:58.368822Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:58.368967Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:58.370667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:58.417486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534959123921858:12399]
2025-10-02T08:14:58.417635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2225, pipe: [1:7556534959123921858:12399]
2025-10-02T08:14:58.502919Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:58.503489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.503505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.503544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123921858:12399], now have 1 active actors on pipe
2025-10-02T08:14:58.503636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534959123921858:12399]
2025-10-02T08:14:58.503657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:58.503659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:58.503705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2226 reason: error at write: Disconnected sessionId: src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0
2025-10-02T08:14:58.503727Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:58.503771Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:58.504003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:58.504011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0] Write session will restart in 0.008868s
2025-10-02T08:14:58.503861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2226 sessionId: src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0 is DEAD
2025-10-02T08:14:58.504034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0] Write session: Do CDS request
2025-10-02T08:14:58.504042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:58.515680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.515762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:58.515784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2227
2025-10-02T08:14:58.515909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.515965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:58.515974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:58.515978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:58.516377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2227 sessionId:  describe result for acl check
2025-10-02T08:14:58.516425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:58.516432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:58.516433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:58.516438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534959123922376:12616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:58.516990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534959123922376:12616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:58.520960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534959123922376:12616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:58.525686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534959123922376:12616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:58.525700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534959123922376:12616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:58.525703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534959123922376:12616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:58.525711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:58.530071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:58.531564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:58.531744Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:58.531753Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:58.531771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:58.531820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:58.531855Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534959123922654:12615]
2025-10-02T08:14:58.532497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:58.532689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:58.532744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:58.533097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:58.533161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.533167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.533168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.533169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.533170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.533175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.533184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.533188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.533191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.533194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.533199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.533206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.533211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.533216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.533220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.533230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.533233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.533238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.533242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.533246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.533266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:58.540929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:58.542821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:58.542839Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:58.542842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:58.542846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:58.542852Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2226 [1:7556534959123922654:12615]
2025-10-02T08:14:58.542864Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:58.542883Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:58.542890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.542894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.542896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.542912Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:58.542917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:58.542924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:58.542982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.542990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.542993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:58.542996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:58.543063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:58.543070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.543084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.543102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:58.543129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534959123922648:12615]
2025-10-02T08:14:58.543136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534959123922648:12615]
2025-10-02T08:14:58.543144Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:58.543160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123922538:12616], now have 1 active actors on pipe
2025-10-02T08:14:58.543162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2226
2025-10-02T08:14:58.543172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:58.543184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:58.543186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:58.543187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:58.543189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:58.543196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534959583411732:2378], now have 1 active actors on pipe
2025-10-02T08:14:58.543230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534959123922648:12615]
2025-10-02T08:14:58.543243Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:58.543251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.543255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:58.543260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.543299Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:58.543310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.543314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.543316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:58.543278Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2226
2025-10-02T08:14:58.543325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.543338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:58.543367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.543413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.543421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.543434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.543473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2227 partition: 0 MaxSeqNo: 17 sessionId: src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0
2025-10-02T08:14:58.543818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce2e286-96baccdb-6a166713-c0ab9542_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:58.546560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0] Write session: try to update token
2025-10-02T08:14:58.546581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:58.560470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId: src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:58.560633Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:58.560650Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:58.560653Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:58.560662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534959123922648:12615]
2025-10-02T08:14:58.560666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534959123922648:12615]
2025-10-02T08:14:58.560712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:58.560719Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:58.560723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.560725Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:58.560725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:58.560896Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:58.563067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:58.603859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534959123922679:12399]
2025-10-02T08:14:58.603970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2226, pipe: [1:7556534959123922679:12399]
2025-10-02T08:14:58.695312Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:58.695945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.695968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.696007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123922679:12399], now have 1 active actors on pipe
2025-10-02T08:14:58.696092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:58.696099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:58.696123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534959123922679:12399]
2025-10-02T08:14:58.696146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2227 reason: error at write: Disconnected sessionId: src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0
2025-10-02T08:14:58.696242Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:58.696306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2227 sessionId: src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0 is DEAD
2025-10-02T08:14:58.696309Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:58.696435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:58.696443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0] Write session will restart in 0.007613s
2025-10-02T08:14:58.696468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0] Write session: Do CDS request
2025-10-02T08:14:58.696474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:58.705221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.705253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:58.705270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2228
2025-10-02T08:14:58.705421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.705454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:58.705462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:58.705466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:58.705808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2228 sessionId:  describe result for acl check
2025-10-02T08:14:58.705835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:58.705841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:58.705842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:58.705847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534959123923069:12622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:58.706246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534959123923069:12622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:58.708329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534959123923069:12622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:58.711249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534959123923069:12622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:58.711265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534959123923069:12622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:58.711268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534959123923069:12622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:58.711274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:58.718347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:58.720256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:58.720836Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:58.720850Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:58.720860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:58.720932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:58.720959Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534959123923489:12621]
2025-10-02T08:14:58.721523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:58.721717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:58.721758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:58.722054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:58.722097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.722103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.722104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.722105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.722105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.722110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.722119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.722123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.722126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.722130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.722135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.722141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.722146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.722151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.722154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.722159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.722177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.722185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.722189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.722193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.722209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:58.730634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:58.732157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:58.732189Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:58.732193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:58.732196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:58.732206Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2227 [1:7556534959123923489:12621]
2025-10-02T08:14:58.732218Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:58.732236Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:58.732243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.732246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.732249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.732265Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:58.732272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:58.732277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:58.732350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.732358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.732361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:58.732364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:58.732611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2227
2025-10-02T08:14:58.733011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:58.733024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.733036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.733048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:58.733072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123923307:12622], now have 1 active actors on pipe
2025-10-02T08:14:58.733073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2227
2025-10-02T08:14:58.733080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534959583411750:2378], now have 1 active actors on pipe
2025-10-02T08:14:58.733094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534959123923471:12621]
2025-10-02T08:14:58.733105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534959123923471:12621]
2025-10-02T08:14:58.733117Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:58.733131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:58.733133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:58.733135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:58.733147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:58.733151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:58.733157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.733161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.733194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534959123923471:12621]
2025-10-02T08:14:58.733204Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:58.733209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:58.733215Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da4bb164-6518af3-c698a438-81247688_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:58.733221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.733228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.733229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:58.733237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.733244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:58.733270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.733301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.733306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.733316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.733344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2228 partition: 0 MaxSeqNo: 17 sessionId: src_id|da4bb164-6518af3-c698a438-81247688_0
2025-10-02T08:14:58.733655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b26b19-23b115f0-5bc8565c-af7013a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|da4bb164-6518af3-c698a438-81247688_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:58.736409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da4bb164-6518af3-c698a438-81247688_0] Write session: try to update token
2025-10-02T08:14:58.736424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da4bb164-6518af3-c698a438-81247688_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:58.751633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId: src_id|da4bb164-6518af3-c698a438-81247688_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:58.752201Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:58.752215Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:58.752225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534959123923471:12621]
2025-10-02T08:14:58.752276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:58.752297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:58.752625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:58.752827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:58.753007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:58.753166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:58.753371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:58.753417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:58.754479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:58.754567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.754590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.754625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:58.754651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:58.754701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.754714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.754873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.754943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.755012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.755080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.755852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.755868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.755939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.756003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.756068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.756146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.756204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.756212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.756282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.756351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.756414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.756672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.756723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.756730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.756815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.756882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.756953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.757021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.757084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.757095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.757166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.757232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.757297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.757367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.757426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.757435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.757501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.757565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.757630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.757700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.757745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.757753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.757823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.757887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.757966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.758035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.758081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.758088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.758156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.758223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.758288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.758355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.758400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.758407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.758473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.758537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.758602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.758669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.758716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.758723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.758789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:58.758892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:58.758960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:58.759029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:58.759093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:58.759101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:58.759135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:58.759201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.759225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.759233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:58.759262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:58.759280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:58.759288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:58.759292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:58.759295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:58.759872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:58.759898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:58.759910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:58.759913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:58.759919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:58.759923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:58.760706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:58.760732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:58.760743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:58.760754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:58.760757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:58.760760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:58.761437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:58.761466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:58.761476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:58.761484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:58.761488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:58.763995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:58.764019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:58.764032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392898763
2025-10-02T08:14:58.764148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:58.764162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:58.764168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:58.764171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:58.764185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:58.764189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:58.764736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:58.764765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:58.764772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:58.764777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:58.764780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:58.764784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:58.765278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:58.765302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:58.765316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:58.765324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:58.765327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:58.765331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:58.765805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:58.765832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:58.765841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:58.766954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:58.766973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:58.766978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:58.766988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:58.766999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392898766
2025-10-02T08:14:58.767307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:58.767334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:58.767340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:58.767343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:58.767347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:58.767350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:58.767826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:58.767848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:58.767853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:58.767862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:58.767865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:58.767869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:58.768347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:58.768368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.768472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392898768
2025-10-02T08:14:58.772361Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:58.772387Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:58.772395Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:58.772402Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:58.774111Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:58.774127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:58.774128Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:58.774138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534959123923471:12621]
2025-10-02T08:14:58.774144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534959123923471:12621]
2025-10-02T08:14:58.774202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:58.774206Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:58.774211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.774212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:58.774213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:58.774354Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:58.796378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534959123923533:12399]
2025-10-02T08:14:58.796494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2227, pipe: [1:7556534959123923533:12399]
2025-10-02T08:14:58.908136Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:58.908476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123923533:12399], now have 1 active actors on pipe
2025-10-02T08:14:58.908615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534959123923533:12399]
2025-10-02T08:14:58.908615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:58.908618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:58.908648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2228 reason: error at write: Disconnected sessionId: src_id|da4bb164-6518af3-c698a438-81247688_0
2025-10-02T08:14:58.908790Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:58.908859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2228 sessionId: src_id|da4bb164-6518af3-c698a438-81247688_0 is DEAD
2025-10-02T08:14:58.908842Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:58.908976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4bb164-6518af3-c698a438-81247688_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:58.908987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4bb164-6518af3-c698a438-81247688_0] Write session will restart in 0.009228s
2025-10-02T08:14:58.909014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4bb164-6518af3-c698a438-81247688_0] Write session: Do CDS request
2025-10-02T08:14:58.909020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4bb164-6518af3-c698a438-81247688_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:58.917832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:58.918250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:58.918427Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:58.918440Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:58.918451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:58.918509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:58.918564Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534959123923596:12628]
2025-10-02T08:14:58.919193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:58.919316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da4bb164-6518af3-c698a438-81247688_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.919457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:58.919473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2229
2025-10-02T08:14:58.919474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:58.919533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:58.919600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:58.919632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:58.919642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:58.919647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:58.919833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:58.919888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.919895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.919897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.919898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.919899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.919904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.919913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.919916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.919920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.919923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.919929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.919936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:58.919942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.919946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:58.919955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.919960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:58.919968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.919972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.919976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.919981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.920001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:58.920063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2229 sessionId:  describe result for acl check
2025-10-02T08:14:58.920115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:58.920122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:58.920126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:58.920131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534959123923610:12630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:58.920734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534959123923610:12630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:58.923082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534959123923610:12630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:58.927633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534959123923610:12630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:58.927651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534959123923610:12630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:58.927655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534959123923610:12630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:58.927663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:58.928163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:58.929888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:58.929906Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:58.929909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:58.929913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:58.929919Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2228 [1:7556534959123923596:12628]
2025-10-02T08:14:58.929931Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:58.929948Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:58.929951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.929955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.929957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.929974Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:58.929984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:58.929993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:58.930058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.930065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.930068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:58.930071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:58.930133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:58.930141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.930299Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2228
2025-10-02T08:14:58.930154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:58.930175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:58.930192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534959123923643:12630], now have 1 active actors on pipe
2025-10-02T08:14:58.930195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534959583411758:2378], now have 1 active actors on pipe
2025-10-02T08:14:58.930198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2228
2025-10-02T08:14:58.930201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534959123923590:12628]
2025-10-02T08:14:58.930203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534959123923590:12628]
2025-10-02T08:14:58.930215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:58.930227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.930229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:58.930231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.930232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:58.930245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:58.930259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:58.930262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:58.930301Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63426839-82f094e9-d065a12a-7918c034_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:58.930307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:58.930310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:58.930313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:58.930321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:58.930329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:58.930351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534959123923590:12628]
2025-10-02T08:14:58.930361Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:58.930367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:58.930387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.930469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:58.930477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:58.930502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:58.930544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2229 partition: 0 MaxSeqNo: 17 sessionId: src_id|63426839-82f094e9-d065a12a-7918c034_0
2025-10-02T08:14:58.930897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da4bb164-6518af3-c698a438-81247688_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63426839-82f094e9-d065a12a-7918c034_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:58.933670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63426839-82f094e9-d065a12a-7918c034_0] Write session: try to update token
2025-10-02T08:14:58.933687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63426839-82f094e9-d065a12a-7918c034_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:58.948951Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:58.948974Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:58.948976Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:58.948986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534959123923590:12628]
2025-10-02T08:14:58.948990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534959123923590:12628]
2025-10-02T08:14:58.949035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:58.949041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:58.949044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:58.949049Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:58.949056Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:58.949196Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:58.950945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId: src_id|63426839-82f094e9-d065a12a-7918c034_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:58.953383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:59.008836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534963418890954:12399]
2025-10-02T08:14:59.008955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2228, pipe: [1:7556534963418890954:12399]
2025-10-02T08:14:59.089077Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:59.089506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.089524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.089565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418890954:12399], now have 1 active actors on pipe
2025-10-02T08:14:59.089652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534963418890954:12399]
2025-10-02T08:14:59.089672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:59.089674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:59.089721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2229 reason: error at write: Disconnected sessionId: src_id|63426839-82f094e9-d065a12a-7918c034_0
2025-10-02T08:14:59.089762Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:59.089861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2229 sessionId: src_id|63426839-82f094e9-d065a12a-7918c034_0 is DEAD
2025-10-02T08:14:59.089958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:59.090008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63426839-82f094e9-d065a12a-7918c034_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:59.090017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63426839-82f094e9-d065a12a-7918c034_0] Write session will restart in 0.006775s
2025-10-02T08:14:59.090040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63426839-82f094e9-d065a12a-7918c034_0] Write session: Do CDS request
2025-10-02T08:14:59.090046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63426839-82f094e9-d065a12a-7918c034_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:59.095060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:59.095937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:59.096102Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:59.096111Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:59.096121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:59.096198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:59.096243Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534963418891015:12635]
2025-10-02T08:14:59.096890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:59.097073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:59.097118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:59.097417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:59.097459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.097465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.097467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.097468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.097470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.097475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.097496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.097504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.097508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.097512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.097517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.097525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.097530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.097535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.097539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.097544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.097548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.097558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.097563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.097568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.097587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:59.098324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63426839-82f094e9-d065a12a-7918c034_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.098466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:59.098480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2230
2025-10-02T08:14:59.098599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.098626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:59.098635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:59.098639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:59.099019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2230 sessionId:  describe result for acl check
2025-10-02T08:14:59.099061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:59.099065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:59.099066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:59.099070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534963418891031:12637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:59.099461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534963418891031:12637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:59.101460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534963418891031:12637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:59.104854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534963418891031:12637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:59.104874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534963418891031:12637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:59.104878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534963418891031:12637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:59.104886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:59.108887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:59.110645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:59.110669Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:59.110672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:59.110676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:59.110682Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2229 [1:7556534963418891015:12635]
2025-10-02T08:14:59.110693Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:59.110712Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:59.110720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.110723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.110725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.110740Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:59.110750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:59.110756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:59.110825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.110834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.110837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:59.110839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:59.110926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:59.110935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.110950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.110966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:59.110989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534963418891009:12635]
2025-10-02T08:14:59.110996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534963418891009:12635]
2025-10-02T08:14:59.111003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:59.111006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2229
2025-10-02T08:14:59.111014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:59.111017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891063:12637], now have 1 active actors on pipe
2025-10-02T08:14:59.111025Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:59.111029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:59.111042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:59.111048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:59.111055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534963878379060:2378], now have 1 active actors on pipe
2025-10-02T08:14:59.111066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.111070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.111112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534963418891009:12635]
2025-10-02T08:14:59.111126Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:59.111143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:59.111149Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:59.111155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.111117Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2229
2025-10-02T08:14:59.111159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.111160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:59.111171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.111181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:59.111231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.111307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.111337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.111361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.111405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2230 partition: 0 MaxSeqNo: 17 sessionId: src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0
2025-10-02T08:14:59.111764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63426839-82f094e9-d065a12a-7918c034_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:59.114513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0] Write session: try to update token
2025-10-02T08:14:59.114531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:59.128639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId: src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:59.129538Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:59.129558Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:59.129561Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:59.129569Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534963418891009:12635]
2025-10-02T08:14:59.129574Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534963418891009:12635]
2025-10-02T08:14:59.129622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:59.129633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.129637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:59.129649Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:59.129662Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:59.129782Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:59.131042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:59.189585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534963418891078:12399]
2025-10-02T08:14:59.189699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2229, pipe: [1:7556534963418891078:12399]
2025-10-02T08:14:59.276713Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:59.277680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.277699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.277737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891078:12399], now have 1 active actors on pipe
2025-10-02T08:14:59.277976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:59.278655Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:59.279282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:59.279332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2230 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0
2025-10-02T08:14:59.279489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2230 sessionId: src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0 is DEAD
2025-10-02T08:14:59.279629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534963418891078:12399]
2025-10-02T08:14:59.279854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:59.279870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0] Write session will restart in 0.009708s
2025-10-02T08:14:59.279896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0] Write session: Do CDS request
2025-10-02T08:14:59.279902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:59.283575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:59.284575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:59.284769Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:59.284787Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:59.284816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:59.284874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:59.284923Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534963418891151:12647]
2025-10-02T08:14:59.285617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:59.285794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:59.285835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:59.286126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:59.286166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.286172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.286174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.286176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.286177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.286182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.286192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.286200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.286205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.286213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.286218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.286226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.286232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.286236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.286241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.286246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.286250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.286255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.286259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.286263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.286282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:59.290388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.290383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:59.290400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2231
2025-10-02T08:14:59.290618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.290655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:59.290663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:59.290667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:59.291010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2231 sessionId:  describe result for acl check
2025-10-02T08:14:59.291042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:59.291048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:59.291050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:59.291054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534963418891167:12649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:59.291503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534963418891167:12649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:59.293321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534963418891167:12649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:59.294193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:59.295683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:59.295702Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:59.295704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:59.295708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:59.295713Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2230 [1:7556534963418891151:12647]
2025-10-02T08:14:59.295723Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:59.295739Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:59.295742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.295746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.295748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.295763Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:59.295777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:59.295784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:59.295845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.295852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.295855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:59.295857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:59.295912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:59.295919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.295930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.295941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:59.295962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534963418891145:12647]
2025-10-02T08:14:59.295963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534963418891145:12647]
2025-10-02T08:14:59.295969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:59.295981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:59.295981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534963878379082:2378], now have 1 active actors on pipe
2025-10-02T08:14:59.295984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:59.295989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:59.296001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:59.296004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:59.296033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534963418891145:12647]
2025-10-02T08:14:59.296036Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:59.296085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:59.296028Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2230
2025-10-02T08:14:59.304355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caac670-4c8bb7fe-15c013ef-3ec6d55d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:59.303539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534963418891167:12649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:59.303558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534963418891167:12649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:59.303562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534963418891167:12649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:59.303569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:59.303788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2230
2025-10-02T08:14:59.303800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891224:12649], now have 1 active actors on pipe
2025-10-02T08:14:59.303806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.303812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.303837Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:59.303846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.303849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.303851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:59.303861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.303874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:59.303890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.303945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.303948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.303960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.303985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2231 partition: 0 MaxSeqNo: 17 sessionId: src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0
2025-10-02T08:14:59.307003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0] Write session: try to update token
2025-10-02T08:14:59.307018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:59.320948Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:59.320972Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:59.320974Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:59.320983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534963418891145:12647]
2025-10-02T08:14:59.320988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534963418891145:12647]
2025-10-02T08:14:59.321039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:59.321046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.321045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:59.321049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:59.321053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:59.321197Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:59.323282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId: src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:59.326152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:59.379547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534963418891237:12399]
2025-10-02T08:14:59.379701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2230, pipe: [1:7556534963418891237:12399]
2025-10-02T08:14:59.463445Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:59.464085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.464098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.464134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891237:12399], now have 1 active actors on pipe
2025-10-02T08:14:59.464241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:59.464253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:59.464306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2231 reason: error at write: Disconnected sessionId: src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0
2025-10-02T08:14:59.464351Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:59.464461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2231 sessionId: src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0 is DEAD
2025-10-02T08:14:59.464530Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:59.464594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534963418891237:12399]
2025-10-02T08:14:59.464781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:59.464792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0] Write session will restart in 0.009221s
2025-10-02T08:14:59.464833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0] Write session: Do CDS request
2025-10-02T08:14:59.464840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:59.469160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:59.469930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:59.470044Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:59.470050Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:59.470057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:59.470087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:59.470118Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534963418891302:12660]
2025-10-02T08:14:59.470588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:59.470731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:59.470754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:59.470942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:59.470969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.470973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.470974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.470975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.470976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.470979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.470985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.470987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.470989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.470991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.470994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.470998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.471002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.471004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.471007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.471010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.471012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.471015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.471019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.471021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.471030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:59.475250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.475322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:59.475338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2232
2025-10-02T08:14:59.475453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.475480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:59.475489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:59.475492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:59.475881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2232 sessionId:  describe result for acl check
2025-10-02T08:14:59.475913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:59.475919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:59.475921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:59.475925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534963418891318:12662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:59.476370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534963418891318:12662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:59.477868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534963418891318:12662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:59.478883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:59.480614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534963418891318:12662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:59.480628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534963418891318:12662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:59.480631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534963418891318:12662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:59.480639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:59.480729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:59.480747Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:59.480750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:59.480753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:59.480759Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2231 [1:7556534963418891302:12660]
2025-10-02T08:14:59.480770Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:59.480790Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:59.480798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.480820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.480828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.480844Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:59.480854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:59.480860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:59.480921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.480934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.480938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:59.480941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:59.481007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:59.481015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.481027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.481042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:59.481061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534963418891296:12660]
2025-10-02T08:14:59.481067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534963418891296:12660]
2025-10-02T08:14:59.481079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:59.481096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:59.481096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:59.481099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:59.481114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:59.481121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:59.481147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2231
2025-10-02T08:14:59.481152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534963418891296:12660]
2025-10-02T08:14:59.481155Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:59.481158Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:59.481164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891349:12662], now have 1 active actors on pipe
2025-10-02T08:14:59.481168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.481172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.481186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534963878379099:2378], now have 1 active actors on pipe
2025-10-02T08:14:59.481220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:59.481231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.481235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.481241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:59.481250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.481264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:59.481286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.481264Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2231
2025-10-02T08:14:59.481320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.481331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.481352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.481393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2232 partition: 0 MaxSeqNo: 17 sessionId: src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0
2025-10-02T08:14:59.481662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa60aaf-c6f44b81-fc182700-93f9c0f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:59.484346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0] Write session: try to update token
2025-10-02T08:14:59.484358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:59.497871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId: src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:59.498927Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:59.498946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:59.498949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:59.498957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534963418891296:12660]
2025-10-02T08:14:59.498961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534963418891296:12660]
2025-10-02T08:14:59.499004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:59.499003Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:59.499008Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:59.499015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.499017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:59.499188Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:59.500440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:59.564872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534963418891367:12399]
2025-10-02T08:14:59.564991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2231, pipe: [1:7556534963418891367:12399]
2025-10-02T08:14:59.635626Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:59.636023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.636038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.636075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891367:12399], now have 1 active actors on pipe
2025-10-02T08:14:59.636266Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:59.636276Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:59.636556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:59.636615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2232 reason: status is not ok: tablet will be restarted right now sessionId: src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0
2025-10-02T08:14:59.636768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2232 sessionId: src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0 is DEAD
2025-10-02T08:14:59.636914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534963418891367:12399]
2025-10-02T08:14:59.636932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:14:59.636941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0] Write session will restart in 0.008671s
2025-10-02T08:14:59.636967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0] Write session: Do CDS request
2025-10-02T08:14:59.636974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:59.641749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:59.642592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:59.642742Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:59.642751Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:59.642760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:59.642802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:59.642839Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534963418891431:12668]
2025-10-02T08:14:59.643464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:59.643623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:59.643666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:59.643963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:59.644006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.644012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.644014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.644015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.644018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.644023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.644033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.644036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.644040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.644044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.644050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.644061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.644071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.644081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.644085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.644095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.644100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.644106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.644111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.644116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.644135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:59.646315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.646379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:59.646393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2233
2025-10-02T08:14:59.646521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.646556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:59.646562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:59.646566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:59.646968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2233 sessionId:  describe result for acl check
2025-10-02T08:14:59.647006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:59.647012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:59.647016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:59.647021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534963418891448:12670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:59.647522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534963418891448:12670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:59.649912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534963418891448:12670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:59.652224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:59.652907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534963418891448:12670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:59.652919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534963418891448:12670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:59.652922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534963418891448:12670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:59.652928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:59.653635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:59.653650Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:59.653652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:59.653655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:59.653659Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2232 [1:7556534963418891431:12668]
2025-10-02T08:14:59.653666Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:59.653678Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:59.653681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.653683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.653685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.653696Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:59.653700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:59.653704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:59.653750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.653755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.653757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:59.653758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:59.653803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:59.653808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.653816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.653823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:59.653838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891479:12670], now have 1 active actors on pipe
2025-10-02T08:14:59.653846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534963418891425:12668]
2025-10-02T08:14:59.653847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534963418891425:12668]
2025-10-02T08:14:59.653852Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:59.653853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2232
2025-10-02T08:14:59.653859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:59.653870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:59.653871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:59.653873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:59.653878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534963878379105:2378], now have 1 active actors on pipe
2025-10-02T08:14:59.653880Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:59.653881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.653884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.653916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534963418891425:12668]
2025-10-02T08:14:59.653924Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:59.653938Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:59.653942Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:59.653947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.653949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.653950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:59.653956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.653962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:59.653932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2232
2025-10-02T08:14:59.653992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.654050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.654055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.654065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.654090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2233 partition: 0 MaxSeqNo: 17 sessionId: src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0
2025-10-02T08:14:59.654356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|198f706c-5bb78cb7-ddb212cd-f5902e0e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:59.656924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0] Write session: try to update token
2025-10-02T08:14:59.656937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:59.669804Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:14:59.669824Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:59.669833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534963418891425:12668]
2025-10-02T08:14:59.669875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:14:59.669876Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:14:59.670042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:14:59.670186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:59.670314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:59.670508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:14:59.670638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId: src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:59.670759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:14:59.670799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:14:59.673068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:59.673163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.673180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.673216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:14:59.673242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:14:59.673291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.673300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.673436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.673493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.673552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.673608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.673648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.673654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.673713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.673772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.673833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.673896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.673938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.673954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.674023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.674083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.674142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.674197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.674236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.674241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.674304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.674362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.674418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.674474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.674528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.674534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.674593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.674647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.674701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.674758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.674812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.674819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.674876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.674929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.674986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.675045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.675162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.675168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.675224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.675278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.675345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.675403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.675458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.675464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.675521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.675577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.675634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.675691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.675731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.675736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.675794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.675854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.675908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.675966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.676019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.676025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.676082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:14:59.676134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:14:59.676202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:14:59.676259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:14:59.676301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:14:59.676308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:14:59.676338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:14:59.676392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.676408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.676413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:14:59.676437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:14:59.676450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:14:59.676455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:14:59.676457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:14:59.676459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:14:59.676796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:14:59.676838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:14:59.676845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:14:59.676849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:14:59.676851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:14:59.676856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:14:59.677531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:14:59.677555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:14:59.677561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:14:59.677565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:14:59.677568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:14:59.677572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:14:59.678114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:14:59.678140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:14:59.678146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:14:59.678152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:14:59.678156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:14:59.680192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:14:59.680215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:14:59.680229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392899680
2025-10-02T08:14:59.680367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:14:59.680389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:14:59.680394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:14:59.680397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:14:59.680400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:14:59.680403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:14:59.680887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:14:59.680906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:14:59.680910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:14:59.680913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:14:59.680916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:14:59.680919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:14:59.681342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:14:59.681362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:14:59.681370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:14:59.681373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:14:59.681376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:14:59.681380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:14:59.681826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:14:59.681851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:14:59.681856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:14:59.682859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:14:59.682878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:14:59.682882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:14:59.682884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:14:59.682889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392899682
2025-10-02T08:14:59.683144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:14:59.683160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:14:59.683163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:14:59.683170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:14:59.683172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:14:59.683176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:14:59.683590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:14:59.683612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:14:59.683617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:14:59.683621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:14:59.683624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:14:59.683629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:14:59.684026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:14:59.684044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.684126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392899684
2025-10-02T08:14:59.684853Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:14:59.684868Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:14:59.684871Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:14:59.684875Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:14:59.686287Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:59.686299Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:59.686300Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:59.686307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534963418891425:12668]
2025-10-02T08:14:59.686310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534963418891425:12668]
2025-10-02T08:14:59.686352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:59.686360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.686362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:59.686372Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:59.686377Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:59.686475Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:59.737426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534963418891504:12399]
2025-10-02T08:14:59.737608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2232, pipe: [1:7556534963418891504:12399]
2025-10-02T08:14:59.817509Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:59.817878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891504:12399], now have 1 active actors on pipe
2025-10-02T08:14:59.817989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:59.817998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:59.818021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2233 reason: error at write: Disconnected sessionId: src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0
2025-10-02T08:14:59.818101Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:59.818093Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:59.818199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2233 sessionId: src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0 is DEAD
2025-10-02T08:14:59.818305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:59.818315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0] Write session will restart in 0.005409s
2025-10-02T08:14:59.818338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0] Write session: Do CDS request
2025-10-02T08:14:59.818344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:59.818371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534963418891504:12399]
2025-10-02T08:14:59.823463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:59.824467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:59.824632Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:59.824642Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:59.824650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:59.824695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:59.824733Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534963418891585:12675]
2025-10-02T08:14:59.825207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.825311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:59.825324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2234
2025-10-02T08:14:59.825390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:59.825422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.825447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:59.825456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:59.825459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:59.825598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:59.825649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:59.825775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2234 sessionId:  describe result for acl check
2025-10-02T08:14:59.825812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:59.825818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:59.825819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:59.825824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534963418891596:12677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:59.825976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:59.826022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.826026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.826027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.826030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.826030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.826034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.826039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.826041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.826043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.826045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.826048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.826053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.826056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.826059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.826062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.826065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.826067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.826070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.826072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.826075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.826085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:59.826322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534963418891596:12677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:59.828235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534963418891596:12677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:59.833141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534963418891596:12677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:59.833158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534963418891596:12677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:59.833161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534963418891596:12677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:59.833169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:14:59.833557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:59.834926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:14:59.834940Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:14:59.834942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:14:59.834944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:14:59.834949Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2233 [1:7556534963418891585:12675]
2025-10-02T08:14:59.834955Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:14:59.834967Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:14:59.834969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.834971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.834972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.834986Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:14:59.834989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:14:59.834993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:14:59.835033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.835039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.835041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:14:59.835043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:14:59.835084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:14:59.835092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.835099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.835106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:14:59.835118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891632:12677], now have 1 active actors on pipe
2025-10-02T08:14:59.835123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534963418891579:12675]
2025-10-02T08:14:59.835124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534963418891579:12675]
2025-10-02T08:14:59.835128Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:14:59.835136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:14:59.835138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2233
2025-10-02T08:14:59.835143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:14:59.835145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:14:59.835146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:14:59.835146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:14:59.835150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534963878379125:2378], now have 1 active actors on pipe
2025-10-02T08:14:59.835153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.835156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.835184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534963418891579:12675]
2025-10-02T08:14:59.835192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:14:59.835202Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:14:59.835203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:14:59.835209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:14:59.835212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:14:59.835213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:14:59.835218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:14:59.835215Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2233
2025-10-02T08:14:59.835223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:14:59.835251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.835285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.835290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.835298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:14:59.835323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2234 partition: 0 MaxSeqNo: 17 sessionId: src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0
2025-10-02T08:14:59.835598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd766ee-bac77ac1-557f4ff5-3d3cc741_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:14:59.838026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0] Write session: try to update token
2025-10-02T08:14:59.838039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:14:59.850716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId: src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:14:59.851412Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:14:59.851426Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:14:59.851429Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:14:59.851437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534963418891579:12675]
2025-10-02T08:14:59.851440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534963418891579:12675]
2025-10-02T08:14:59.851480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:14:59.851493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.851493Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:14:59.851496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:14:59.851499Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:14:59.851632Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:14:59.853182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:14:59.918672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534963418891648:12399]
2025-10-02T08:14:59.918773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2233, pipe: [1:7556534963418891648:12399]
2025-10-02T08:14:59.984156Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:14:59.984449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:14:59.984463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:14:59.984498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891648:12399], now have 1 active actors on pipe
2025-10-02T08:14:59.984608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:14:59.984617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:14:59.984694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2234 reason: error at write: Disconnected sessionId: src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0
2025-10-02T08:14:59.984717Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:14:59.984884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2234 sessionId: src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0 is DEAD
2025-10-02T08:14:59.984913Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:14:59.984989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:14:59.984996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0] Write session will restart in 0.008625s
2025-10-02T08:14:59.985019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0] Write session: Do CDS request
2025-10-02T08:14:59.985026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:14:59.985123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534963418891648:12399]
2025-10-02T08:14:59.990156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:14:59.990953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:14:59.991098Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:14:59.991106Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:14:59.991115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:14:59.991159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:14:59.991193Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534963418891718:12681]
2025-10-02T08:14:59.991801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:14:59.991942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:14:59.991978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:14:59.992262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:14:59.992301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.992306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.992307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.992312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.992313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.992317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.992328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.992332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.992335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.992339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.992348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.992359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:14:59.992368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.992373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:14:59.992377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.992387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:14:59.992391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.992397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:14:59.992405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.992410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:14:59.992429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:14:59.994235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.994273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:14:59.994283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2235
2025-10-02T08:14:59.994447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:14:59.994474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:14:59.994483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:14:59.994486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:14:59.994848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2235 sessionId:  describe result for acl check
2025-10-02T08:14:59.994880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:14:59.994885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:14:59.994887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:14:59.994892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534963418891734:12683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:14:59.995359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534963418891734:12683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:14:59.997409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534963418891734:12683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:14:59.999912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534963418891734:12683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:14:59.999916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:14:59.999922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534963418891734:12683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:14:59.999925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534963418891734:12683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:14:59.999931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:00.001352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:00.001366Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:00.001367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:00.001370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:00.001374Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2234 [1:7556534963418891718:12681]
2025-10-02T08:15:00.001382Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:00.001394Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:00.001396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.001398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.001399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.001411Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:00.001414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:00.001419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:00.001463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.001468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.001470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:00.001473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:00.001558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:00.001565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.001569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2234
2025-10-02T08:15:00.001572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.001580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:00.001592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534963418891763:12683], now have 1 active actors on pipe
2025-10-02T08:15:00.001594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534963878379131:2378], now have 1 active actors on pipe
2025-10-02T08:15:00.001597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.001599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.001611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534963418891712:12681]
2025-10-02T08:15:00.001613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534963418891712:12681]
2025-10-02T08:15:00.001620Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:00.001628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:00.001639Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:00.001643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:00.001643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:00.001646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:00.001659Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31c36525-a92e808d-58a97633-c415c19e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:00.001664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.001667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.001670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:00.001676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.001688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:00.001653Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2234
2025-10-02T08:15:00.001713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534963418891712:12681]
2025-10-02T08:15:00.001721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:00.001729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.001733Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:00.001774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.001779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.001789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.001815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2235 partition: 0 MaxSeqNo: 17 sessionId: src_id|31c36525-a92e808d-58a97633-c415c19e_0
2025-10-02T08:15:00.002068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfd023a-f2969853-9dcda524-acfa9efc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|31c36525-a92e808d-58a97633-c415c19e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:00.004502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c36525-a92e808d-58a97633-c415c19e_0] Write session: try to update token
2025-10-02T08:15:00.004514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c36525-a92e808d-58a97633-c415c19e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:00.012252Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:00.012274Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:00.012284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534963418891712:12681]
2025-10-02T08:15:00.012333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:00.012333Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:00.012582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:00.012781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:00.012981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:00.013150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:00.013396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:00.013451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:00.018918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId: src_id|31c36525-a92e808d-58a97633-c415c19e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:00.021509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:00.021575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.021588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.021628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:00.021650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:00.021708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.021717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.021929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.021997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.022079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.022145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.022301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.022312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.022383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.022445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.022517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.022586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.022630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.022640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.022710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.022775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.022842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.022915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.022965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.022977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.023052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.023123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.023199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.023290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.023336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.023345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.023412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.023479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.023551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.023626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.023672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.023677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.023747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.023809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.023871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.023931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.024047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.024052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.024127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.024200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.024270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.024338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.024414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.024421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.024499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.024571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.024642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.024717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.024778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.024789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.024876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.024955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.025027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.025096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.025143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.025150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.025219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.025281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.025350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.025412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.025456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.025464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.025505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:00.025572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.025595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.025598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:00.025632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:00.025651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:00.025659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:00.025662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:00.025665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:00.026086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:00.026111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:00.026118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:00.026121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:00.026125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:00.026128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:00.026965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:00.026983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:00.026989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:00.026991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:00.026993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:00.026995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:00.027469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:00.027488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:00.027492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:00.027494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:00.027496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:00.029817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:00.029837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:00.029850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392900029
2025-10-02T08:15:00.030058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:00.030072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:00.030079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:00.030083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:00.030087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:00.030090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:00.030591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:00.030615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:00.030622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:00.030635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:00.030639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:00.030644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:00.031144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:00.031166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:00.031177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:00.031181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:00.031184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:00.031188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:00.031700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:00.031730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:00.031736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:00.032953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:00.032968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:00.032974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:00.032979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:00.032991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392900032
2025-10-02T08:15:00.033311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:00.033329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:00.033337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:00.033339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:00.033342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:00.033344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:00.033810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:00.033827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:00.033832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:00.033835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:00.033838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:00.033841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:00.034315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:00.034334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.034413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392900034
2025-10-02T08:15:00.035233Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:00.035251Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:00.035259Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:00.035266Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:00.036985Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:00.036995Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:00.036996Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:00.037010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534963418891712:12681]
2025-10-02T08:15:00.037014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534963418891712:12681]
2025-10-02T08:15:00.037079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:00.037080Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:00.037088Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:00.037088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.037090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:00.037223Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:00.086017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534967713859083:12399]
2025-10-02T08:15:00.086228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2234, pipe: [1:7556534967713859083:12399]
2025-10-02T08:15:00.177338Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:00.177764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859083:12399], now have 1 active actors on pipe
2025-10-02T08:15:00.178017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534967713859083:12399]
2025-10-02T08:15:00.178043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:00.178046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:00.178072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2235 reason: error at write: Disconnected sessionId: src_id|31c36525-a92e808d-58a97633-c415c19e_0
2025-10-02T08:15:00.178142Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:00.178274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2235 sessionId: src_id|31c36525-a92e808d-58a97633-c415c19e_0 is DEAD
2025-10-02T08:15:00.178284Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:00.178385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c36525-a92e808d-58a97633-c415c19e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:00.178395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c36525-a92e808d-58a97633-c415c19e_0] Write session will restart in 0.007963s
2025-10-02T08:15:00.178417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c36525-a92e808d-58a97633-c415c19e_0] Write session: Do CDS request
2025-10-02T08:15:00.178424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c36525-a92e808d-58a97633-c415c19e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:00.184291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:00.185239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:00.185383Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:00.185391Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:00.185400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:00.185439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:00.185471Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534967713859155:12688]
2025-10-02T08:15:00.185876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:00.186057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:00.186084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:00.186282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:00.186312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.186316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.186317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.186317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.186318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.186321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.186328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.186331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.186333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.186336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.186340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.186345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.186348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.186351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.186354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.186357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.186359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.186362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.186364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.186367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.186379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:00.187246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c36525-a92e808d-58a97633-c415c19e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.187385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:00.187397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2236
2025-10-02T08:15:00.187566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.187602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:00.187610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:00.187613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:00.188044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2236 sessionId:  describe result for acl check
2025-10-02T08:15:00.188081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:00.188087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:00.188089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:00.188094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534967713859171:12690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:00.188632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534967713859171:12690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:00.191077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534967713859171:12690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:00.194288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534967713859171:12690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:00.194305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534967713859171:12690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:00.194312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534967713859171:12690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:00.194320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:00.195772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:00.197527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:00.197546Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:00.197549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:00.197552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:00.197558Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2235 [1:7556534967713859155:12688]
2025-10-02T08:15:00.197571Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:00.197587Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:00.197595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.197598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.197600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.197616Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:00.197626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:00.197637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:00.197696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.197705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.197708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:00.197711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:00.197774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:00.197781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.197793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.197803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:00.197828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534967713859149:12688]
2025-10-02T08:15:00.197830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534967713859149:12688]
2025-10-02T08:15:00.197833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2235
2025-10-02T08:15:00.197839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:00.197852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859203:12690], now have 1 active actors on pipe
2025-10-02T08:15:00.197858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:00.197859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:00.197861Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:00.197871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:00.197873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:00.197879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.197883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.197896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534968173346434:2378], now have 1 active actors on pipe
2025-10-02T08:15:00.197926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534967713859149:12688]
2025-10-02T08:15:00.197934Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:00.197949Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|526f5b55-eb10ae51-20005129-f8070eca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:00.197961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.197964Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:00.197969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.197971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:00.197929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2235
2025-10-02T08:15:00.197981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.197994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:00.198036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.198084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.198091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.198102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.198138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2236 partition: 0 MaxSeqNo: 17 sessionId: src_id|526f5b55-eb10ae51-20005129-f8070eca_0
2025-10-02T08:15:00.198467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c36525-a92e808d-58a97633-c415c19e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|526f5b55-eb10ae51-20005129-f8070eca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:00.201307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526f5b55-eb10ae51-20005129-f8070eca_0] Write session: try to update token
2025-10-02T08:15:00.201326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526f5b55-eb10ae51-20005129-f8070eca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:00.215935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId: src_id|526f5b55-eb10ae51-20005129-f8070eca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:00.216088Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:00.216105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:00.216107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:00.216117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534967713859149:12688]
2025-10-02T08:15:00.216122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534967713859149:12688]
2025-10-02T08:15:00.216166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:00.216185Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:00.216192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.216192Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:00.216194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:00.216348Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:00.218662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:00.278241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534967713859217:12399]
2025-10-02T08:15:00.278349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2235, pipe: [1:7556534967713859217:12399]
2025-10-02T08:15:00.359906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:00.359295Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:00.359624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.359633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.359674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859217:12399], now have 1 active actors on pipe
2025-10-02T08:15:00.360641Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:00.360999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:00.361062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2236 reason: status is not ok: tablet will be restarted right now sessionId: src_id|526f5b55-eb10ae51-20005129-f8070eca_0
2025-10-02T08:15:00.361199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534967713859217:12399]
2025-10-02T08:15:00.361233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2236 sessionId: src_id|526f5b55-eb10ae51-20005129-f8070eca_0 is DEAD
2025-10-02T08:15:00.361464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526f5b55-eb10ae51-20005129-f8070eca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:00.361475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526f5b55-eb10ae51-20005129-f8070eca_0] Write session will restart in 0.005698s
2025-10-02T08:15:00.361512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526f5b55-eb10ae51-20005129-f8070eca_0] Write session: Do CDS request
2025-10-02T08:15:00.361520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526f5b55-eb10ae51-20005129-f8070eca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:00.368317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526f5b55-eb10ae51-20005129-f8070eca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.368918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:00.368933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2237
2025-10-02T08:15:00.373051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.373098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:00.373103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:00.373106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:00.373441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:00.373873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2237 sessionId:  describe result for acl check
2025-10-02T08:15:00.373906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:00.373908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:00.373910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:00.373916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534967713859328:12707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:00.374446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534967713859328:12707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:00.374682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:00.374878Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:00.374882Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:00.374894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:00.374949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:00.374984Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534967713859334:12706]
2025-10-02T08:15:00.375642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:00.376023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:00.376068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:00.376433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:00.376486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.376487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.376489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.376493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.376494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.376500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.376510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.376514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.376517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.376522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.376527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.376535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.376543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.376549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.376554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.376560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.376564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.376570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.376575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.376580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.376600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:00.382339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534967713859328:12707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:00.386323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534967713859328:12707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:00.386338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534967713859328:12707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:00.386341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534967713859328:12707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:00.386364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:00.387036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:00.388636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:00.388652Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:00.388655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:00.388659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:00.388665Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2236 [1:7556534967713859334:12706]
2025-10-02T08:15:00.388677Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:00.388693Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:00.388696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.388699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.388701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.388716Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:00.388722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:00.388728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:00.388787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.388795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.389667Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2236
2025-10-02T08:15:00.388998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:00.389005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:00.389070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:00.389073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.389087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.389101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:00.389117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534967713859322:12706]
2025-10-02T08:15:00.389120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534967713859322:12706]
2025-10-02T08:15:00.389128Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:00.389142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:00.389156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:00.389159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:00.389192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534967713859322:12706]
2025-10-02T08:15:00.389195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:00.389262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:00.389264Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:00.389278Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:00.389418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2236
2025-10-02T08:15:00.389444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859372:12707], now have 1 active actors on pipe
2025-10-02T08:15:00.389451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.389457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.389471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534968173346464:2378], now have 1 active actors on pipe
2025-10-02T08:15:00.389488Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:00.389497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.389502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.389504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:00.389515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.389529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:00.389546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.389600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.389602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.389616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.389643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2237 partition: 0 MaxSeqNo: 17 sessionId: src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0
2025-10-02T08:15:00.392949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526f5b55-eb10ae51-20005129-f8070eca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:00.395557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0] Write session: try to update token
2025-10-02T08:15:00.395573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:00.409166Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:00.409184Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:00.409186Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:00.409196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534967713859322:12706]
2025-10-02T08:15:00.409201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534967713859322:12706]
2025-10-02T08:15:00.409245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:00.409252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.409255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:00.409256Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:00.409262Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:00.409393Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:00.410865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId: src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:00.413442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:00.461379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534967713859389:12399]
2025-10-02T08:15:00.461852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2236, pipe: [1:7556534967713859389:12399]
2025-10-02T08:15:00.541182Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:00.541596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.541609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.541649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859389:12399], now have 1 active actors on pipe
2025-10-02T08:15:00.541751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:00.541761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:00.541860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2237 reason: error at write: Disconnected sessionId: src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0
2025-10-02T08:15:00.541946Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:00.542002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2237 sessionId: src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0 is DEAD
2025-10-02T08:15:00.542076Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:00.542133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:00.542140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0] Write session will restart in 0.007673s
2025-10-02T08:15:00.542134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534967713859389:12399]
2025-10-02T08:15:00.542163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0] Write session: Do CDS request
2025-10-02T08:15:00.542169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:00.547506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:00.548653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:00.548829Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:00.548838Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:00.548849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:00.548900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:00.548939Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534967713859464:12713]
2025-10-02T08:15:00.549596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:00.549785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:00.549828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:00.550124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:00.550171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.550177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.550178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.550179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.550182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.550187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.550197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.550200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.550204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.550208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.550213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.550221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.550228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.550234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.550238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.550243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.550247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.550251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.550256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.550261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.550286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:00.551296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.551380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:00.551390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2238
2025-10-02T08:15:00.551523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.551553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:00.551563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:00.551566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:00.551939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2238 sessionId:  describe result for acl check
2025-10-02T08:15:00.551970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:00.551975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:00.551977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:00.551982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534967713859480:12715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:00.552435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534967713859480:12715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:00.554386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534967713859480:12715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:00.557633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534967713859480:12715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:00.557645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534967713859480:12715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:00.557649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534967713859480:12715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:00.557657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:00.558235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:00.559792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:00.559813Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:00.559816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:00.559820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:00.559826Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2237 [1:7556534967713859464:12713]
2025-10-02T08:15:00.559837Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:00.559852Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:00.559856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.559859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.559861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.559876Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:00.559880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:00.559886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:00.559939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.559949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.559952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:00.559954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:00.560018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:00.560025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.560036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.560048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:00.560066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859511:12715], now have 1 active actors on pipe
2025-10-02T08:15:00.560077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534967713859458:12713]
2025-10-02T08:15:00.560061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2237
2025-10-02T08:15:00.560079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534967713859458:12713]
2025-10-02T08:15:00.560090Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:00.560098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534968173346471:2378], now have 1 active actors on pipe
2025-10-02T08:15:00.560104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.560107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:00.560108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.560110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:00.560125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:00.560146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:00.560154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:00.560162Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2237
2025-10-02T08:15:00.560207Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:00.560218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.560223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.560226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:00.560235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.560243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:00.560251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534967713859458:12713]
2025-10-02T08:15:00.560265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:00.560295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:00.560301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.560378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.560390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.560410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.560447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2238 partition: 0 MaxSeqNo: 17 sessionId: src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0
2025-10-02T08:15:00.560757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd478776-1ffeee10-1733f8ef-a304fc61_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:00.563264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0] Write session: try to update token
2025-10-02T08:15:00.563279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:00.571447Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:00.571465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:00.571475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534967713859458:12713]
2025-10-02T08:15:00.571513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:00.571523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:00.572031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:00.572192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:00.572333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:00.572468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:00.572736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:00.572778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:00.577040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId: src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:00.579507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:00.579575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.579590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.579621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:00.579646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:00.579703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.579715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.579860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.579912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.579971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.580052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.580105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.580113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.580190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.580269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.580351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.580415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.580458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.580466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.580535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.580592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.580649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.580711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.580753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.580761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.580845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.580907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.580965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.581033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.581093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.581099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.581167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.581227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.581287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.581349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.581391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.581398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.581470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.581529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.581589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.581650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.581693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.581705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.581770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.581844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.581906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.581967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.582010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.582017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.582079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.582136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.582197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.582257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.582297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.582303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.582368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.582425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.582484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.582543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.582584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.582594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.582654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:00.582709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:00.582769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:00.582824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:00.582870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:00.582878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:00.582918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:00.582980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.583004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.583011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:00.583039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:00.583054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:00.583059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:00.583061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:00.583063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:00.583417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:00.583436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:00.583440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:00.583443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:00.583445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:00.583447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:00.583941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:00.583959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:00.583964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:00.583966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:00.583968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:00.583971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:00.584421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:00.584438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:00.584441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:00.584443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:00.584446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:00.585676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:00.585694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:00.585706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392900585
2025-10-02T08:15:00.585868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:00.585884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:00.585890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:00.585895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:00.585899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:00.585902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:00.586397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:00.586420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:00.586428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:00.586432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:00.586437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:00.586444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:00.586911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:00.586932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:00.586940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:00.586947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:00.586951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:00.586954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:00.587400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:00.587419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:00.587424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:00.588522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:00.588543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:00.588548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:00.588551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:00.588560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392900588
2025-10-02T08:15:00.588886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:00.588908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:00.588914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:00.588918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:00.588922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:00.588925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:00.589413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:00.589439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:00.589445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:00.589453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:00.589457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:00.589460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:00.589904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:00.589932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.590061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392900589
2025-10-02T08:15:00.590797Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:00.590815Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:00.590824Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:00.590832Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:00.592397Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:00.592411Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:00.592413Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:00.592424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534967713859458:12713]
2025-10-02T08:15:00.592428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534967713859458:12713]
2025-10-02T08:15:00.592482Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:00.592486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:00.592491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.592494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:00.592494Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:00.592616Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:00.642063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534967713859533:12399]
2025-10-02T08:15:00.642169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2237, pipe: [1:7556534967713859533:12399]
2025-10-02T08:15:00.728781Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:00.729089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859533:12399], now have 1 active actors on pipe
2025-10-02T08:15:00.729217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534967713859533:12399]
2025-10-02T08:15:00.729240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:00.729243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:00.729266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2238 reason: error at write: Disconnected sessionId: src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0
2025-10-02T08:15:00.729331Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:00.729340Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:00.729413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2238 sessionId: src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0 is DEAD
2025-10-02T08:15:00.729566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:00.729576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0] Write session will restart in 0.009998s
2025-10-02T08:15:00.729600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0] Write session: Do CDS request
2025-10-02T08:15:00.729614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:00.734691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:00.735515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:00.735697Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:00.735704Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:00.735713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:00.735758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:00.735790Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534967713859612:12719]
2025-10-02T08:15:00.736406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:00.736564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:00.736599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:00.736899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:00.736941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.736946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.736947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.736949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.736950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.736954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.736964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.736967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.736971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.736974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.736979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.736985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.736993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.736997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.737001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.737006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.737010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.737019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.737024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.737029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.737050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:00.740255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.740310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:00.740323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2239
2025-10-02T08:15:00.740466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.740499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:00.740510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:00.740513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:00.740971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2239 sessionId:  describe result for acl check
2025-10-02T08:15:00.741007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:00.741012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:00.741014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:00.741019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534967713859629:12721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:00.741515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534967713859629:12721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:00.743416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534967713859629:12721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:00.744579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:00.746030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:00.746047Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:00.746049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:00.746053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:00.746058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2238 [1:7556534967713859612:12719]
2025-10-02T08:15:00.746068Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:00.746081Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:00.746090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.746094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.746096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.746111Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:00.746120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:00.746126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:00.746181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.746189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.746192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:00.746194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:00.746251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:00.746257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.746270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.746286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:00.746306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534968173346489:2378], now have 1 active actors on pipe
2025-10-02T08:15:00.746315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534967713859606:12719]
2025-10-02T08:15:00.746317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534967713859606:12719]
2025-10-02T08:15:00.746326Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:00.746339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:00.746340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:00.746346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:00.746353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:00.746355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:00.746380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534967713859606:12719]
2025-10-02T08:15:00.746386Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:00.746389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534967713859629:12721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:00.746395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534967713859629:12721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:00.746398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534967713859629:12721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:00.746399Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:00.746363Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2238
2025-10-02T08:15:00.746406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:00.746590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2238
2025-10-02T08:15:00.746604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859664:12721], now have 1 active actors on pipe
2025-10-02T08:15:00.746610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.746617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.746639Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4b38542-179c2908-1615d08c-6f2150ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:00.746650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.746658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.746660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:00.746672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.746686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:00.746703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.746746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.746752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.746764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.746794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2239 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4b38542-179c2908-1615d08c-6f2150ea_0
2025-10-02T08:15:00.747087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30642b13-ce12ac76-bd8dbe0-a94a5870_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4b38542-179c2908-1615d08c-6f2150ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:00.749545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b38542-179c2908-1615d08c-6f2150ea_0] Write session: try to update token
2025-10-02T08:15:00.749558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b38542-179c2908-1615d08c-6f2150ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:00.762356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId: src_id|b4b38542-179c2908-1615d08c-6f2150ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:00.763136Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:00.763151Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:00.763153Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:00.763161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534967713859606:12719]
2025-10-02T08:15:00.763166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534967713859606:12719]
2025-10-02T08:15:00.763200Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:00.763204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:00.763208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:00.763211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.763213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:00.763338Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:00.765015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:00.829558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534967713859689:12399]
2025-10-02T08:15:00.829661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2238, pipe: [1:7556534967713859689:12399]
2025-10-02T08:15:00.905663Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:00.905942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.905954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.905988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859689:12399], now have 1 active actors on pipe
2025-10-02T08:15:00.906084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:00.906092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:00.906146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2239 reason: error at write: Disconnected sessionId: src_id|b4b38542-179c2908-1615d08c-6f2150ea_0
2025-10-02T08:15:00.906175Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:00.906202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:00.906309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2239 sessionId: src_id|b4b38542-179c2908-1615d08c-6f2150ea_0 is DEAD
2025-10-02T08:15:00.906444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534967713859689:12399]
2025-10-02T08:15:00.907047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b38542-179c2908-1615d08c-6f2150ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:00.907057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b38542-179c2908-1615d08c-6f2150ea_0] Write session will restart in 0.007026s
2025-10-02T08:15:00.907081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b38542-179c2908-1615d08c-6f2150ea_0] Write session: Do CDS request
2025-10-02T08:15:00.907087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b38542-179c2908-1615d08c-6f2150ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:00.912004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:00.913218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:00.913365Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:00.913373Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:00.913383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:00.913429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:00.913470Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534967713859769:12726]
2025-10-02T08:15:00.913917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:00.914104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:00.914141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:00.914365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:00.914405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.914410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.914412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.914413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.914414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.914419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.914429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.914437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.914441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.914445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.914450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.914458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:00.914467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.914473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:00.914481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.914486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:00.914494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.914499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.914507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.914513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.914537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:00.915289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b38542-179c2908-1615d08c-6f2150ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.915323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:00.915335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2240
2025-10-02T08:15:00.915499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:00.915530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:00.915539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:00.915542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:00.915912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2240 sessionId:  describe result for acl check
2025-10-02T08:15:00.915948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:00.915953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:00.915954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:00.915959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534967713859785:12728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:00.916408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534967713859785:12728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:00.918727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534967713859785:12728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:00.921991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534967713859785:12728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:00.922004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534967713859785:12728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:00.922007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534967713859785:12728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:00.922016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:00.922516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:00.924022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:00.924034Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:00.924037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:00.924040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:00.924044Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2239 [1:7556534967713859769:12726]
2025-10-02T08:15:00.924055Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:00.924071Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:00.924073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.924076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.924078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.924092Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:00.924099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:00.924104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:00.924148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.924156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.924158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:00.924160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:00.924216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:00.924222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.924231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:00.924238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:00.924251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534967713859820:12728], now have 1 active actors on pipe
2025-10-02T08:15:00.924255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534967713859763:12726]
2025-10-02T08:15:00.924256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534967713859763:12726]
2025-10-02T08:15:00.924261Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:00.924270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:00.924272Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:00.924275Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:00.924276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2239
2025-10-02T08:15:00.924282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:00.924284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:00.924289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534968173346498:2378], now have 1 active actors on pipe
2025-10-02T08:15:00.924320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.924328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.924339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534967713859763:12726]
2025-10-02T08:15:00.924346Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:00.924348Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:00.924324Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2239
2025-10-02T08:15:00.924367Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:00.924376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:00.924378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:00.924379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:00.924386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:00.924393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:00.924416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.924462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:00.924477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:00.924501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:00.924538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2240 partition: 0 MaxSeqNo: 17 sessionId: src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0
2025-10-02T08:15:00.924873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b38542-179c2908-1615d08c-6f2150ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:00.927288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0] Write session: try to update token
2025-10-02T08:15:00.927305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:00.940074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId: src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:00.941796Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:00.941810Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:00.941812Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:00.941821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534967713859763:12726]
2025-10-02T08:15:00.941828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534967713859763:12726]
2025-10-02T08:15:00.941862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:00.941872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:00.941872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:00.941873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:00.941877Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:00.941988Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:00.942359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:01.006171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534972008827131:12399]
2025-10-02T08:15:01.006299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2239, pipe: [1:7556534972008827131:12399]
2025-10-02T08:15:01.073046Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:01.073338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.073350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.073388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827131:12399], now have 1 active actors on pipe
2025-10-02T08:15:01.073501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:01.073511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:01.073570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2240 reason: error at write: Disconnected sessionId: src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0
2025-10-02T08:15:01.073606Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:01.073632Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:01.073745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2240 sessionId: src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0 is DEAD
2025-10-02T08:15:01.073840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534972008827131:12399]
2025-10-02T08:15:01.073901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:01.073912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0] Write session will restart in 0.005487s
2025-10-02T08:15:01.073939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0] Write session: Do CDS request
2025-10-02T08:15:01.073945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:01.079128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:01.080111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:01.080239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.080272Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:01.080282Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:01.080292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:01.080317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:01.080327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2241
2025-10-02T08:15:01.080334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:01.080368Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534972008827213:12733]
2025-10-02T08:15:01.080418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.080438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:01.080445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:01.080447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:01.080750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2241 sessionId:  describe result for acl check
2025-10-02T08:15:01.080771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:01.080776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:01.080777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:01.080780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534972008827218:12735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:01.081019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:01.081170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534972008827218:12735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:01.081176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:01.081206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:01.081492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:01.081529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.081534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.081535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.081536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.081537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.081542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.081551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.081556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.081560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.081569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.081574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.081585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.081590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.081599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.081603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.081608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.081612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.081617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.081625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.081630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.081651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:01.083232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534972008827218:12735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:01.088862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534972008827218:12735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:01.088875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534972008827218:12735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:01.088878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534972008827218:12735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:01.088886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:01.089293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:01.090730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:01.090742Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:01.090744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:01.090747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:01.090751Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2240 [1:7556534972008827213:12733]
2025-10-02T08:15:01.090759Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:01.090772Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:01.090774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.090776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.090777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.090790Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:01.090795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:01.090800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:01.090844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.090850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.090852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:01.090853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:01.090896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:01.090903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.090911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.090917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:01.090929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827261:12735], now have 1 active actors on pipe
2025-10-02T08:15:01.090929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2240
2025-10-02T08:15:01.090934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534972008827207:12733]
2025-10-02T08:15:01.090935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534972008827207:12733]
2025-10-02T08:15:01.090940Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:01.090946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534972468313800:2378], now have 1 active actors on pipe
2025-10-02T08:15:01.090951Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:01.090951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:01.090953Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:01.090959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:01.090960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:01.090965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.090968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.091000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534972008827207:12733]
2025-10-02T08:15:01.091007Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:01.091018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:01.091020Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:01.091025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.091031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.091032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:01.090996Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2240
2025-10-02T08:15:01.091038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.091048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:01.091076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.091111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.091115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.091124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.091150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2241 partition: 0 MaxSeqNo: 17 sessionId: src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0
2025-10-02T08:15:01.091419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c241af-7cfbd8a7-cac9475-5214c0bb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:01.094080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0] Write session: try to update token
2025-10-02T08:15:01.094103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:01.107890Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:01.107907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:01.107909Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:01.107915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534972008827207:12733]
2025-10-02T08:15:01.107919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534972008827207:12733]
2025-10-02T08:15:01.107951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:01.107956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.107958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:01.107963Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:01.107969Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:01.108088Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:01.109721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId: src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:01.112216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:01.174106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534972008827276:12399]
2025-10-02T08:15:01.174270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2240, pipe: [1:7556534972008827276:12399]
2025-10-02T08:15:01.240370Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:01.240679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.240695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.240737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827276:12399], now have 1 active actors on pipe
2025-10-02T08:15:01.241249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:01.241261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0] Write session will restart in 0.005400s
2025-10-02T08:15:01.241285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0] Write session: Do CDS request
2025-10-02T08:15:01.240867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:01.240875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:01.240927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2241 reason: error at write: Disconnected sessionId: src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0
2025-10-02T08:15:01.240977Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:01.241083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2241 sessionId: src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0 is DEAD
2025-10-02T08:15:01.241292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:01.241237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534972008827276:12399]
2025-10-02T08:15:01.244885Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:01.248325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.248342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:01.248354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2242
2025-10-02T08:15:01.248504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.248542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:01.248546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:01.248549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:01.248959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2242 sessionId:  describe result for acl check
2025-10-02T08:15:01.248989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:01.248991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:01.248993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:01.248997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534972008827338:12740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:01.249416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534972008827338:12740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:01.250580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:01.251390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534972008827338:12740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:01.251577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:01.251797Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:01.251806Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:01.251816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:01.251862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:01.251897Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534972008827386:12739]
2025-10-02T08:15:01.252387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:01.252537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:01.252583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:01.252790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:01.252849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.252854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.252855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.252856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.252857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.252862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.252871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.252875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.252880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.252884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.252889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.252896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.252903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.252910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.252915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.252921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.252925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.252930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.252937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.252945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.252962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:01.253654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534972008827338:12740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:01.253665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534972008827338:12740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:01.253668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534972008827338:12740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:01.253675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:01.261076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:01.262779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:01.262800Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:01.262803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:01.262808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:01.262815Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2241 [1:7556534972008827386:12739]
2025-10-02T08:15:01.262828Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:01.262846Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:01.262849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.262852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.262854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.262872Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:01.262877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:01.262894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:01.262962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.262970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.262974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:01.262976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:01.263041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:01.263051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.263063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.263073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:01.263087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2241
2025-10-02T08:15:01.263096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827407:12740], now have 1 active actors on pipe
2025-10-02T08:15:01.263103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534972008827370:12739]
2025-10-02T08:15:01.263105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534972008827370:12739]
2025-10-02T08:15:01.263112Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:01.263122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534972468313808:2378], now have 1 active actors on pipe
2025-10-02T08:15:01.263123Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:01.263126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:01.263133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:01.263145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:01.263149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:01.263156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.263161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.263206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534972008827370:12739]
2025-10-02T08:15:01.263215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:01.263223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:01.263231Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38402cb4-e2b17922-11785734-dd48586a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:01.263240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.263244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.263246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:01.263202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2241
2025-10-02T08:15:01.263257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.263268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:01.263309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.263376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.263382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.263394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.263433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2242 partition: 0 MaxSeqNo: 17 sessionId: src_id|38402cb4-e2b17922-11785734-dd48586a_0
2025-10-02T08:15:01.263776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10c562db-789b3e85-ca4be5eb-e0f0ef2d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|38402cb4-e2b17922-11785734-dd48586a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:01.266629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38402cb4-e2b17922-11785734-dd48586a_0] Write session: try to update token
2025-10-02T08:15:01.266649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38402cb4-e2b17922-11785734-dd48586a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:01.281523Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:01.281542Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:01.281545Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:01.281553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534972008827370:12739]
2025-10-02T08:15:01.281559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534972008827370:12739]
2025-10-02T08:15:01.281604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:01.281610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.281615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:01.281657Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:01.281669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:01.281756Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:01.282647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId: src_id|38402cb4-e2b17922-11785734-dd48586a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:01.285181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:01.341540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534972008827421:12399]
2025-10-02T08:15:01.341800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2241, pipe: [1:7556534972008827421:12399]
2025-10-02T08:15:01.424144Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:01.424762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.424780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.424840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827421:12399], now have 1 active actors on pipe
2025-10-02T08:15:01.424968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534972008827421:12399]
2025-10-02T08:15:01.424990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:01.424997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:01.425056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2242 reason: error at write: Disconnected sessionId: src_id|38402cb4-e2b17922-11785734-dd48586a_0
2025-10-02T08:15:01.425093Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:01.425142Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:01.425227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2242 sessionId: src_id|38402cb4-e2b17922-11785734-dd48586a_0 is DEAD
2025-10-02T08:15:01.425561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38402cb4-e2b17922-11785734-dd48586a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:01.425573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38402cb4-e2b17922-11785734-dd48586a_0] Write session will restart in 0.008262s
2025-10-02T08:15:01.425597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38402cb4-e2b17922-11785734-dd48586a_0] Write session: Do CDS request
2025-10-02T08:15:01.425603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38402cb4-e2b17922-11785734-dd48586a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:01.432035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:01.433280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:01.433451Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:01.433461Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:01.433471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:01.433530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:01.433577Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534972008827543:12757]
2025-10-02T08:15:01.434300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:01.434473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:01.434515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:01.434843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:01.434899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.434905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.434908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.434910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.434911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.434916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.434928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.434937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.434941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.434945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.434951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.434958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.434964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.434970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.434976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.434981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.434984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.434989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.434994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.434999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.435018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:01.435524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38402cb4-e2b17922-11785734-dd48586a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.435625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:01.435635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2243
2025-10-02T08:15:01.435742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.435768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:01.435777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:01.435780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:01.436169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2243 sessionId:  describe result for acl check
2025-10-02T08:15:01.436209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:01.436215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:01.436216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:01.436221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534972008827561:12760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:01.436714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534972008827561:12760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:01.438543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534972008827561:12760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:01.442150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534972008827561:12760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:01.442159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534972008827561:12760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:01.442161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534972008827561:12760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:01.442167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:01.442797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:01.444429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:01.444444Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:01.444446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:01.444450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:01.444455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2242 [1:7556534972008827543:12757]
2025-10-02T08:15:01.444465Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:01.444480Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:01.444483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.444487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.444489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.444505Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:01.444514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:01.444521Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:01.444580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.444589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.444594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:01.444596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:01.444654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:01.444658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.444671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.444686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:01.444703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2242
2025-10-02T08:15:01.444708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827591:12760], now have 1 active actors on pipe
2025-10-02T08:15:01.444711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534972468313836:2378], now have 1 active actors on pipe
2025-10-02T08:15:01.444717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534972008827537:12757]
2025-10-02T08:15:01.444719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534972008827537:12757]
2025-10-02T08:15:01.444730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:01.444738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.444742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.444747Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:01.444750Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:01.444763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:01.444776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:01.444783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:01.444781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2242
2025-10-02T08:15:01.444844Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a399cd68-44d424ca-72926394-33e34666_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:01.444855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.444858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.444860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:01.444869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.444879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:01.444887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534972008827537:12757]
2025-10-02T08:15:01.444899Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:01.444910Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:01.444933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.444975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.444981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.444993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.445027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2243 partition: 0 MaxSeqNo: 17 sessionId: src_id|a399cd68-44d424ca-72926394-33e34666_0
2025-10-02T08:15:01.445304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38402cb4-e2b17922-11785734-dd48586a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a399cd68-44d424ca-72926394-33e34666_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:01.447935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a399cd68-44d424ca-72926394-33e34666_0] Write session: try to update token
2025-10-02T08:15:01.447949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a399cd68-44d424ca-72926394-33e34666_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:01.461782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId: src_id|a399cd68-44d424ca-72926394-33e34666_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:01.462871Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:01.462884Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:01.462886Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:01.462893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534972008827537:12757]
2025-10-02T08:15:01.462895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534972008827537:12757]
2025-10-02T08:15:01.462927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:01.462935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.462937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:01.462952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:01.462966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:01.463060Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:01.464426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:01.525336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534972008827605:12399]
2025-10-02T08:15:01.525474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2242, pipe: [1:7556534972008827605:12399]
2025-10-02T08:15:01.600472Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:01.600764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.600777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.600835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827605:12399], now have 1 active actors on pipe
2025-10-02T08:15:01.600968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:01.600978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:01.601039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2243 reason: error at write: Disconnected sessionId: src_id|a399cd68-44d424ca-72926394-33e34666_0
2025-10-02T08:15:01.601058Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:01.601124Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:01.601211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2243 sessionId: src_id|a399cd68-44d424ca-72926394-33e34666_0 is DEAD
2025-10-02T08:15:01.601337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534972008827605:12399]
2025-10-02T08:15:01.601552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a399cd68-44d424ca-72926394-33e34666_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:01.601564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a399cd68-44d424ca-72926394-33e34666_0] Write session will restart in 0.009564s
2025-10-02T08:15:01.601593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a399cd68-44d424ca-72926394-33e34666_0] Write session: Do CDS request
2025-10-02T08:15:01.601599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a399cd68-44d424ca-72926394-33e34666_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:01.607820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:01.609019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:01.609177Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:01.609184Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:01.609191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:01.609227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:01.609259Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534972008827692:12764]
2025-10-02T08:15:01.609749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:01.609946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:01.609989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:01.610273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:01.610307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.610312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.610312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.610313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.610313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.610317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.610323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.610325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.610328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.610329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.610333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.610337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.610341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.610344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.610346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.610349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.610351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.610355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.610358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.610361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.610372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:01.612300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a399cd68-44d424ca-72926394-33e34666_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.612345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:01.612355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2244
2025-10-02T08:15:01.612598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.612629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:01.612634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:01.612637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:01.613043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2244 sessionId:  describe result for acl check
2025-10-02T08:15:01.613080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:01.613085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:01.613087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:01.613091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534972008827708:12766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:01.613579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534972008827708:12766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:01.616162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534972008827708:12766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:01.618534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:01.618856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534972008827708:12766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:01.618871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534972008827708:12766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:01.618875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534972008827708:12766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:01.618885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:01.619926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:01.619938Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:01.619940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:01.619942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:01.619947Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2243 [1:7556534972008827692:12764]
2025-10-02T08:15:01.619955Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:01.619967Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:01.619969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.619971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.619973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.619984Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:01.619988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:01.619993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:01.620034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.620040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.620042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:01.620044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:01.620099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:01.620105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.620112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.620119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:01.620131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2243
2025-10-02T08:15:01.620132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827740:12766], now have 1 active actors on pipe
2025-10-02T08:15:01.620134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534972468313843:2378], now have 1 active actors on pipe
2025-10-02T08:15:01.620139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534972008827686:12764]
2025-10-02T08:15:01.620141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534972008827686:12764]
2025-10-02T08:15:01.620146Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:01.620154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.620156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:01.620157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.620159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:01.620185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:01.620203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:01.620210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:01.620218Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2243
2025-10-02T08:15:01.620241Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:01.620254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.620257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.620259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:01.620267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.620276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:01.620283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534972008827686:12764]
2025-10-02T08:15:01.620291Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:01.620307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:01.620321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.620396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.620403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.620416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.620449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2244 partition: 0 MaxSeqNo: 17 sessionId: src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0
2025-10-02T08:15:01.620713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a399cd68-44d424ca-72926394-33e34666_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:01.623247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0] Write session: try to update token
2025-10-02T08:15:01.623263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:01.636359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId: src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:01.638858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:01.639488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.639515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.639545Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:01.639554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:01.639556Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:01.639565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534972008827686:12764]
2025-10-02T08:15:01.639577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534972008827686:12764]
2025-10-02T08:15:01.639630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:01.639636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:01.639642Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:01.639645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.639647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:01.639840Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:01.701459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534972008827757:12399]
2025-10-02T08:15:01.701599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2243, pipe: [1:7556534972008827757:12399]
2025-10-02T08:15:01.780528Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:01.781041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:01.781084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:01.781100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827757:12399], now have 1 active actors on pipe
2025-10-02T08:15:01.781327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:01.781549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:01.781560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0] Write session will restart in 0.007092s
2025-10-02T08:15:01.781266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:01.781274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:01.781582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0] Write session: Do CDS request
2025-10-02T08:15:01.781295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2244 reason: error at write: Disconnected sessionId: src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0
2025-10-02T08:15:01.781589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:01.781423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2244 sessionId: src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0 is DEAD
2025-10-02T08:15:01.781538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534972008827757:12399]
2025-10-02T08:15:01.788002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:01.789137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:01.789302Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:01.789325Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:01.789339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:01.789385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:01.789424Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534972008827858:12771]
2025-10-02T08:15:01.790065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:01.790281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.790268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:01.790311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:01.790347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:01.790352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2245
2025-10-02T08:15:01.790607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:01.790644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.790646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.790647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.790649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.790650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.790655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.790665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.790669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.790673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.790680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.790686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.790693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.790699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.790704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.790709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.790714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.790719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.790724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.790728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.790734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.790754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:01.791757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.791795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:01.791805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:01.791808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:01.792167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2245 sessionId:  describe result for acl check
2025-10-02T08:15:01.792204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:01.792212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:01.792213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:01.792218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534972008827874:12773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:01.792709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534972008827874:12773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:01.794371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534972008827874:12773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:01.803883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534972008827874:12773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:01.803899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534972008827874:12773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:01.803902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534972008827874:12773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:01.803911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:01.806779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:01.808459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:01.808474Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:01.808477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:01.808481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:01.808487Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2244 [1:7556534972008827858:12771]
2025-10-02T08:15:01.808499Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:01.808516Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:01.808519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.808522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.808524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.808544Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:01.808549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:01.808555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:01.808612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.808621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.808624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:01.808626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:01.808690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:01.808699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.808712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.808729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:01.808749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534972008827852:12771]
2025-10-02T08:15:01.808754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534972008827852:12771]
2025-10-02T08:15:01.808761Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:01.808764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2244
2025-10-02T08:15:01.808774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827908:12773], now have 1 active actors on pipe
2025-10-02T08:15:01.808786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:01.808818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:01.808825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:01.808831Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:01.808835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:01.808858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534972008827852:12771]
2025-10-02T08:15:01.808866Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:01.808870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:01.808881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534972468313865:2378], now have 1 active actors on pipe
2025-10-02T08:15:01.808890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.808894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.808923Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:01.808934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.808940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.808945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:01.808953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.808966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:01.808985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.808965Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2244
2025-10-02T08:15:01.809025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.809033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.809044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.809072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2245 partition: 0 MaxSeqNo: 17 sessionId: src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0
2025-10-02T08:15:01.809388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30cb5a7e-d939e9ee-1481a31c-a4633542_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:01.811923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0] Write session: try to update token
2025-10-02T08:15:01.811935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:01.825703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId: src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:01.828151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:01.828286Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:01.828299Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:01.828301Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:01.828307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534972008827852:12771]
2025-10-02T08:15:01.828310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534972008827852:12771]
2025-10-02T08:15:01.828340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.828347Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:01.828350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.828353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:01.828367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:01.828375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.828377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:01.828493Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:01.881692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534972008827923:12399]
2025-10-02T08:15:01.881800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2244, pipe: [1:7556534972008827923:12399]
2025-10-02T08:15:01.966360Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:01.966831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008827923:12399], now have 1 active actors on pipe
2025-10-02T08:15:01.966952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534972008827923:12399]
2025-10-02T08:15:01.966977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:01.966984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:01.967037Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:01.967043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2245 reason: error at write: Disconnected sessionId: src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0
2025-10-02T08:15:01.967067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:01.967196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2245 sessionId: src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0 is DEAD
2025-10-02T08:15:01.967326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:01.967337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0] Write session will restart in 0.008249s
2025-10-02T08:15:01.967361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0] Write session: Do CDS request
2025-10-02T08:15:01.967368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:01.972751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:01.974036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:01.974175Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:01.974183Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:01.974190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:01.974222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:01.974250Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534972008828018:12777]
2025-10-02T08:15:01.974679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:01.974828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:01.974857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:01.975054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:01.975084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.975088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.975089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.975090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.975090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.975093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.975102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.975104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.975106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.975108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.975112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.975116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:01.975120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.975122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:01.975125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.975128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:01.975130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.975132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.975135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.975138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.975148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:01.976270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.976386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:01.976398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2246
2025-10-02T08:15:01.976505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:01.976533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:01.976537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:01.976540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:01.976949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2246 sessionId:  describe result for acl check
2025-10-02T08:15:01.976981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:01.976987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:01.976988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:01.976993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534972008828034:12779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:01.977441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534972008828034:12779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:01.979134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534972008828034:12779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:01.982621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534972008828034:12779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:01.982635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534972008828034:12779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:01.982639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534972008828034:12779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:01.982646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:01.983075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:01.984594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:01.984607Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:01.984610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:01.984612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:01.984617Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2245 [1:7556534972008828018:12777]
2025-10-02T08:15:01.984626Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:01.984638Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:01.984640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.984642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.984644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.984657Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:01.984662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:01.984666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:01.984709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.984714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.984717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:01.984718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:01.984763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:01.984769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:01.984781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:01.984792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:01.984811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2245
2025-10-02T08:15:01.984829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534972008828062:12779], now have 1 active actors on pipe
2025-10-02T08:15:01.984836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534972468313872:2378], now have 1 active actors on pipe
2025-10-02T08:15:01.984840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534972008828012:12777]
2025-10-02T08:15:01.984841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534972008828012:12777]
2025-10-02T08:15:01.984850Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:01.984863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.984866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:01.984868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.984871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:01.984882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:01.984890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:01.984897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:01.984878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2245
2025-10-02T08:15:01.984936Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|120b02bf-5ae865f2-7e084d71-7299872f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:01.984946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:01.984949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:01.984952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:01.984959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:01.984968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:01.984978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534972008828012:12777]
2025-10-02T08:15:01.984983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:01.984995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:01.985008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.985070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:01.985076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:01.985086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:01.985110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2246 partition: 0 MaxSeqNo: 17 sessionId: src_id|120b02bf-5ae865f2-7e084d71-7299872f_0
2025-10-02T08:15:01.985411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40c154e5-f60d3d4b-d4e222b5-faf4e279_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|120b02bf-5ae865f2-7e084d71-7299872f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:01.988199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|120b02bf-5ae865f2-7e084d71-7299872f_0] Write session: try to update token
2025-10-02T08:15:01.988217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|120b02bf-5ae865f2-7e084d71-7299872f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:02.002058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId: src_id|120b02bf-5ae865f2-7e084d71-7299872f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:02.003014Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:02.003032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:02.003035Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:02.003043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534972008828012:12777]
2025-10-02T08:15:02.003048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534972008828012:12777]
2025-10-02T08:15:02.003089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:02.003091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:02.003098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.003100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:02.003104Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:02.003228Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:02.004547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:02.067057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534976303795375:12399]
2025-10-02T08:15:02.067179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2245, pipe: [1:7556534976303795375:12399]
2025-10-02T08:15:02.147395Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:02.147653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.147664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.147697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303795375:12399], now have 1 active actors on pipe
2025-10-02T08:15:02.147882Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:02.148185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534976303795375:12399]
2025-10-02T08:15:02.148205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:02.148249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2246 reason: status is not ok: tablet will be restarted right now sessionId: src_id|120b02bf-5ae865f2-7e084d71-7299872f_0
2025-10-02T08:15:02.148304Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:02.148590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120b02bf-5ae865f2-7e084d71-7299872f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:02.148601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120b02bf-5ae865f2-7e084d71-7299872f_0] Write session will restart in 0.008613s
2025-10-02T08:15:02.148408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2246 sessionId: src_id|120b02bf-5ae865f2-7e084d71-7299872f_0 is DEAD
2025-10-02T08:15:02.148623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120b02bf-5ae865f2-7e084d71-7299872f_0] Write session: Do CDS request
2025-10-02T08:15:02.148630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120b02bf-5ae865f2-7e084d71-7299872f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:02.154695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:02.155684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:02.155858Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:02.155867Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:02.155875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:02.155922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:02.155969Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534976303795468:12784]
2025-10-02T08:15:02.156620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:02.156788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:02.156837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:02.157088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:02.157129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.157134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.157135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.157136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.157137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.157142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.157152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.157156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.157160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.157164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.157173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.157184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.157194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.157217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.157226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.157235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.157243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.157249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.157258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.157266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.157290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:02.158252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|120b02bf-5ae865f2-7e084d71-7299872f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.158567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:02.158578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2247
2025-10-02T08:15:02.158693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.158719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:02.158724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:02.158727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:02.159076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2247 sessionId:  describe result for acl check
2025-10-02T08:15:02.159105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:02.159110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:02.159111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:02.159116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534976303795484:12786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:02.159640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534976303795484:12786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:02.161701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534976303795484:12786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:02.165282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534976303795484:12786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:02.165297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534976303795484:12786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:02.165301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534976303795484:12786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:02.165310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:02.165713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:02.167274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:02.167290Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:02.167292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:02.167296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:02.167302Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2246 [1:7556534976303795468:12784]
2025-10-02T08:15:02.167313Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:02.167330Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:02.167333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.167336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.167338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.167351Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:02.167362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:02.167369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:02.167427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.167434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.167437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:02.167439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:02.167512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:02.167520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.167533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.167553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:02.167573Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534976303795462:12784]
2025-10-02T08:15:02.167578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534976303795462:12784]
2025-10-02T08:15:02.167595Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:02.167610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:02.167623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:02.167626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:02.167650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:02.167660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534976303795462:12784]
2025-10-02T08:15:02.167662Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:02.167664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:02.167670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:02.167736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2246
2025-10-02T08:15:02.167743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303795515:12786], now have 1 active actors on pipe
2025-10-02T08:15:02.167778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.167786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.167809Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf631ec3-567c5800-8e400207-754e1e85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:02.167819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.167822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.167824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:02.167832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.167840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:02.167849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534976763281175:2378], now have 1 active actors on pipe
2025-10-02T08:15:02.167857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.168061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2246
2025-10-02T08:15:02.168331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|120b02bf-5ae865f2-7e084d71-7299872f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf631ec3-567c5800-8e400207-754e1e85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:02.167994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.167999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.168011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.168044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2247 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf631ec3-567c5800-8e400207-754e1e85_0
2025-10-02T08:15:02.171088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf631ec3-567c5800-8e400207-754e1e85_0] Write session: try to update token
2025-10-02T08:15:02.171106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf631ec3-567c5800-8e400207-754e1e85_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:02.186119Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:02.186139Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:02.186142Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:02.186150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534976303795462:12784]
2025-10-02T08:15:02.186155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534976303795462:12784]
2025-10-02T08:15:02.186193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId: src_id|cf631ec3-567c5800-8e400207-754e1e85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:02.186198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:02.186202Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:02.186205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.186208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:02.186211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:02.186371Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:02.188933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:02.248301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534976303795530:12399]
2025-10-02T08:15:02.248452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2246, pipe: [1:7556534976303795530:12399]
2025-10-02T08:15:02.332124Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:02.332441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.332458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.332497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303795530:12399], now have 1 active actors on pipe
2025-10-02T08:15:02.332630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:02.332641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:02.332688Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:02.332701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2247 reason: error at write: Disconnected sessionId: src_id|cf631ec3-567c5800-8e400207-754e1e85_0
2025-10-02T08:15:02.332790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:02.332871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2247 sessionId: src_id|cf631ec3-567c5800-8e400207-754e1e85_0 is DEAD
2025-10-02T08:15:02.332968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534976303795530:12399]
2025-10-02T08:15:02.336911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf631ec3-567c5800-8e400207-754e1e85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:02.336935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf631ec3-567c5800-8e400207-754e1e85_0] Write session will restart in 0.005431s
2025-10-02T08:15:02.336957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf631ec3-567c5800-8e400207-754e1e85_0] Write session: Do CDS request
2025-10-02T08:15:02.336963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf631ec3-567c5800-8e400207-754e1e85_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:02.339093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:02.340302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:02.340477Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:02.340499Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:02.340513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:02.340560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:02.340598Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534976303795628:12790]
2025-10-02T08:15:02.341302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:02.341511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:02.341551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:02.341861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:02.341917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.341922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.341924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.341925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.341926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.341931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.341942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.341946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.341950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.341954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.341959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.341968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.341975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.341980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.341985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.341995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.342000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.342005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.342015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.342020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.342043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:02.343294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf631ec3-567c5800-8e400207-754e1e85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.343384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:02.343395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2248
2025-10-02T08:15:02.343498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.343528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:02.343533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:02.343538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:02.343953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2248 sessionId:  describe result for acl check
2025-10-02T08:15:02.343984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:02.343986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:02.343987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:02.343992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534976303795644:12792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:02.344519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534976303795644:12792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:02.346749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534976303795644:12792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:02.349816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534976303795644:12792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:02.349831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534976303795644:12792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:02.349834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534976303795644:12792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:02.349843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:02.350473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:02.351982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:02.352007Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:02.352010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:02.352014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:02.352021Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2247 [1:7556534976303795628:12790]
2025-10-02T08:15:02.352033Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:02.352049Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:02.352056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.352059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.352061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.352076Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:02.352086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:02.352093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:02.352161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.352163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.352166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:02.352169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:02.352249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:02.352252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.352265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.352280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:02.352282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2247
2025-10-02T08:15:02.352298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303795675:12792], now have 1 active actors on pipe
2025-10-02T08:15:02.352301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534976763281184:2378], now have 1 active actors on pipe
2025-10-02T08:15:02.352305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.352309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.352325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534976303795622:12790]
2025-10-02T08:15:02.352327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534976303795622:12790]
2025-10-02T08:15:02.352341Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:02.352353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:02.352363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:02.352368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:02.352368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:02.352371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:02.352385Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec801568-83cde84e-9a814750-75a2e6d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:02.352362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2247
2025-10-02T08:15:02.352391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.352400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.352402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:02.352411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.352420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:02.352459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534976303795622:12790]
2025-10-02T08:15:02.352471Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:02.352488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.352503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:02.352652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.352667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.352690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.352728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2248 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec801568-83cde84e-9a814750-75a2e6d6_0
2025-10-02T08:15:02.353036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf631ec3-567c5800-8e400207-754e1e85_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec801568-83cde84e-9a814750-75a2e6d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:02.355488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec801568-83cde84e-9a814750-75a2e6d6_0] Write session: try to update token
2025-10-02T08:15:02.355500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec801568-83cde84e-9a814750-75a2e6d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:02.368726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId: src_id|ec801568-83cde84e-9a814750-75a2e6d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:02.371574Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:02.371594Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:02.371597Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:02.371603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:02.371605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534976303795622:12790]
2025-10-02T08:15:02.371609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534976303795622:12790]
2025-10-02T08:15:02.371644Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:02.371648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:02.371650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:02.371654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.371656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:02.371789Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:02.433098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534976303795720:12399]
2025-10-02T08:15:02.433177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2247, pipe: [1:7556534976303795720:12399]
2025-10-02T08:15:02.505205Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:02.505572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.505593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.505638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303795720:12399], now have 1 active actors on pipe
2025-10-02T08:15:02.505786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534976303795720:12399]
2025-10-02T08:15:02.505814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:02.505820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:02.505852Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:02.505885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2248 reason: error at write: Disconnected sessionId: src_id|ec801568-83cde84e-9a814750-75a2e6d6_0
2025-10-02T08:15:02.506074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2248 sessionId: src_id|ec801568-83cde84e-9a814750-75a2e6d6_0 is DEAD
2025-10-02T08:15:02.506225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec801568-83cde84e-9a814750-75a2e6d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:02.506234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec801568-83cde84e-9a814750-75a2e6d6_0] Write session will restart in 0.007053s
2025-10-02T08:15:02.506251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec801568-83cde84e-9a814750-75a2e6d6_0] Write session: Do CDS request
2025-10-02T08:15:02.506259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec801568-83cde84e-9a814750-75a2e6d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:02.506405Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:02.512609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:02.513713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:02.513882Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:02.513889Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:02.513899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:02.513945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:02.513987Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534976303795827:12809]
2025-10-02T08:15:02.514287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec801568-83cde84e-9a814750-75a2e6d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.514373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:02.514383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2249
2025-10-02T08:15:02.514486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.514507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:02.514513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:02.514516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:02.514541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:02.514742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:02.514783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:02.514849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2249 sessionId:  describe result for acl check
2025-10-02T08:15:02.514875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:02.514880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:02.514881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:02.514885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534976303795838:12811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:02.515017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:02.515061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.515066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.515067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.515068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.515069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.515074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.515082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.515085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.515089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.515092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.515097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.515103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.515108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.515112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.515116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.515120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.515125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.515130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.515135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.515139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.515159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:02.515339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534976303795838:12811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:02.517547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534976303795838:12811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:02.522558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534976303795838:12811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:02.522575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534976303795838:12811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:02.522579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534976303795838:12811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:02.522589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:02.523009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:02.524759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:02.524775Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:02.524778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:02.524782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:02.524788Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2248 [1:7556534976303795827:12809]
2025-10-02T08:15:02.524820Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:02.524837Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:02.524843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.524846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.524847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.524863Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:02.524868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:02.524874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:02.524929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.524938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.524940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:02.524943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:02.525003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:02.525011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.525024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.525037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:02.525061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534976763281212:2378], now have 1 active actors on pipe
2025-10-02T08:15:02.525069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303795874:12811], now have 1 active actors on pipe
2025-10-02T08:15:02.525075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2248
2025-10-02T08:15:02.525075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534976303795821:12809]
2025-10-02T08:15:02.525077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534976303795821:12809]
2025-10-02T08:15:02.525085Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:02.525097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:02.525101Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:02.525105Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:02.525117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:02.525120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:02.525127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.525131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.525149Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2248
2025-10-02T08:15:02.525172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534976303795821:12809]
2025-10-02T08:15:02.525183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:02.525190Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:02.525202Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79167109-3b13f353-6069a085-70074f86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:02.525208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.525212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.525214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:02.525223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.525231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:02.525272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.525323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.525329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.525343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.525378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2249 partition: 0 MaxSeqNo: 17 sessionId: src_id|79167109-3b13f353-6069a085-70074f86_0
2025-10-02T08:15:02.525726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec801568-83cde84e-9a814750-75a2e6d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79167109-3b13f353-6069a085-70074f86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:02.528403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79167109-3b13f353-6069a085-70074f86_0] Write session: try to update token
2025-10-02T08:15:02.528420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79167109-3b13f353-6069a085-70074f86_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:02.542024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId: src_id|79167109-3b13f353-6069a085-70074f86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:02.543051Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:02.543067Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:02.543070Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:02.543078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534976303795821:12809]
2025-10-02T08:15:02.543082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534976303795821:12809]
2025-10-02T08:15:02.543125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:02.543138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.543146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:02.543173Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:02.543186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:02.543285Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:02.544565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:02.606156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534976303795890:12399]
2025-10-02T08:15:02.606241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2248, pipe: [1:7556534976303795890:12399]
2025-10-02T08:15:02.674929Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:02.675144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.675153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.675186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303795890:12399], now have 1 active actors on pipe
2025-10-02T08:15:02.675320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534976303795890:12399]
2025-10-02T08:15:02.675341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:02.675347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:02.675371Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:02.675401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2249 reason: error at write: Disconnected sessionId: src_id|79167109-3b13f353-6069a085-70074f86_0
2025-10-02T08:15:02.675463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:02.675555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2249 sessionId: src_id|79167109-3b13f353-6069a085-70074f86_0 is DEAD
2025-10-02T08:15:02.675689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79167109-3b13f353-6069a085-70074f86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:02.675700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79167109-3b13f353-6069a085-70074f86_0] Write session will restart in 0.008108s
2025-10-02T08:15:02.675735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79167109-3b13f353-6069a085-70074f86_0] Write session: Do CDS request
2025-10-02T08:15:02.675740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79167109-3b13f353-6069a085-70074f86_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:02.681676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:02.682760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:02.682910Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:02.682918Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:02.682925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:02.682960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:02.682991Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534976303795989:12815]
2025-10-02T08:15:02.683414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:02.683612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:02.683670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:02.683993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:02.684037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.684043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.684044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.684045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.684046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.684051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.684060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.684064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.684068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.684071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.684076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.684088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.684097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.684107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.684110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.684119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.684124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.684132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.684141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.684145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.684167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:02.685243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79167109-3b13f353-6069a085-70074f86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.685317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:02.685326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2250
2025-10-02T08:15:02.685424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.685454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:02.685463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:02.685468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:02.685895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2250 sessionId:  describe result for acl check
2025-10-02T08:15:02.685923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:02.685928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:02.685930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:02.685935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534976303796006:12817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:02.686473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534976303796006:12817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:02.688298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534976303796006:12817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:02.691336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534976303796006:12817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:02.691351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534976303796006:12817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:02.691355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534976303796006:12817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:02.691362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:02.691837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:02.693539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:02.693555Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:02.693557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:02.693560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:02.693566Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2249 [1:7556534976303795989:12815]
2025-10-02T08:15:02.693576Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:02.693590Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:02.693598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.693601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.693603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.693619Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:02.693623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:02.693628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:02.693680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.693687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.693690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:02.693691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:02.693756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:02.693764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.693775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.693782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2249
2025-10-02T08:15:02.693785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:02.693799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303796038:12817], now have 1 active actors on pipe
2025-10-02T08:15:02.693807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534976763281218:2378], now have 1 active actors on pipe
2025-10-02T08:15:02.693811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.693814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.693829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534976303795983:12815]
2025-10-02T08:15:02.693837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534976303795983:12815]
2025-10-02T08:15:02.693847Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:02.693859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:02.693867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:02.693870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:02.693870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:02.693874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:02.693862Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2249
2025-10-02T08:15:02.693888Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:02.693897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.693900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.693903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:02.693911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.693923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:02.693956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534976303795983:12815]
2025-10-02T08:15:02.693966Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:02.693979Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:02.693981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.694017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.694024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.694036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.694066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2250 partition: 0 MaxSeqNo: 17 sessionId: src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0
2025-10-02T08:15:02.694353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79167109-3b13f353-6069a085-70074f86_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:02.696942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0] Write session: try to update token
2025-10-02T08:15:02.696955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:02.709723Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:02.709744Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:02.709753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534976303795983:12815]
2025-10-02T08:15:02.709800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:02.709970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:02.710100Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:02.710125Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:02.710245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId: src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:02.710264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:02.710408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:02.710607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:02.710656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:02.712626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:02.712703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.712718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.712746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:02.712768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:02.712824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.712836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.713000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.713067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.713132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.713200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.713252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.713260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.713325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.713385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.713447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.713510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.713555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.713562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.713627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.713690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.713753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.713816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.713863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.713871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.713936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.713997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.714058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.714118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.714163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.714171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.714236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.714300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.714363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.714427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.714473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.714480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.714546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.714607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.714672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.714742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.714788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.714797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.714862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.714927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.714991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.715054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.715100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.715107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.715174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.715237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.715300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.715363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.715407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.715414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.715479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.715542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.715604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.715667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.715717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.715726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.715792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:02.715854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:02.715919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:02.715984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:02.716027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:02.716034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:02.716069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:02.716138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.716164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.716167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:02.716210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:02.716228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:02.716236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:02.716240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:02.716243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:02.716636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:02.716662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:02.716669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:02.716678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:02.716681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:02.716684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:02.717429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:02.717458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:02.717465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:02.717468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:02.717471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:02.717476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:02.718107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:02.718131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:02.718136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:02.718141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:02.718144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:02.720485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:02.720507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:02.720520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392902720
2025-10-02T08:15:02.720672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:02.720687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:02.720695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:02.720703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:02.720707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:02.720710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:02.721241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:02.721268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:02.721274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:02.721283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:02.721288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:02.721292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:02.721748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:02.721769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:02.721780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:02.721783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:02.721787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:02.721791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:02.722270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:02.722295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:02.722301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:02.723383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:02.723402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:02.723408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:02.723414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:02.723422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392902723
2025-10-02T08:15:02.723714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:02.723738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:02.723744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:02.723747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:02.723750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:02.723758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:02.724236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:02.724258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:02.724264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:02.724268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:02.724271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:02.724275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:02.724769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:02.724790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.724931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392902724
2025-10-02T08:15:02.725672Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:02.725701Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:02.725714Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:02.725727Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:02.727334Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:02.727351Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:02.727353Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:02.727362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534976303795983:12815]
2025-10-02T08:15:02.727368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534976303795983:12815]
2025-10-02T08:15:02.727421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:02.727431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.727429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:02.727433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:02.727436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:02.727562Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:02.775615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534976303796073:12399]
2025-10-02T08:15:02.775752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2249, pipe: [1:7556534976303796073:12399]
2025-10-02T08:15:02.875545Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:02.875904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303796073:12399], now have 1 active actors on pipe
2025-10-02T08:15:02.876539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:02.876550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0] Write session will restart in 0.009297s
2025-10-02T08:15:02.876574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0] Write session: Do CDS request
2025-10-02T08:15:02.876580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:02.876203Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:02.876203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:02.876208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:02.876242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2250 reason: error at write: Disconnected sessionId: src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0
2025-10-02T08:15:02.876402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2250 sessionId: src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0 is DEAD
2025-10-02T08:15:02.876546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534976303796073:12399]
2025-10-02T08:15:02.881064Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:02.886431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:02.887302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.887331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:02.887342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2251
2025-10-02T08:15:02.887511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:02.887539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:02.887547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:02.887551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:02.887732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:02.887895Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:02.887904Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:02.887913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:02.887914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2251 sessionId:  describe result for acl check
2025-10-02T08:15:02.887934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:02.887936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:02.887939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:02.887943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534976303796179:12824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:02.887980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:02.888023Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534976303796178:12822]
2025-10-02T08:15:02.888383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534976303796179:12824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:02.888587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:02.888790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:02.888863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:02.889183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:02.889225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.889232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.889233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.889234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.889235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.889240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.889249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.889253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.889257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.889265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.889270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.889277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:02.889287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.889292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:02.889300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.889305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:02.889314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.889319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.889323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.889327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.889346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:02.890086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534976303796179:12824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:02.896015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534976303796179:12824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:02.896034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534976303796179:12824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:02.896037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534976303796179:12824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:02.896045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:02.897013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:02.898560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:02.898581Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:02.898583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:02.898587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:02.898592Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2250 [1:7556534976303796178:12822]
2025-10-02T08:15:02.898603Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:02.898618Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:02.898626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.898629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.898631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.898645Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:02.898650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:02.898656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:02.898716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.898723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.898726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:02.898729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:02.898786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:02.898793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.898804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:02.898818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:02.898837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2250
2025-10-02T08:15:02.898838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303796225:12824], now have 1 active actors on pipe
2025-10-02T08:15:02.898841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534976763281239:2378], now have 1 active actors on pipe
2025-10-02T08:15:02.898846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534976303796170:12822]
2025-10-02T08:15:02.898848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534976303796170:12822]
2025-10-02T08:15:02.898858Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:02.898866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.898869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.898872Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:02.898876Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:02.898886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:02.898902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:02.898909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:02.898895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2250
2025-10-02T08:15:02.898945Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:02.898954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:02.898957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:02.898958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:02.898967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:02.898978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:02.898987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534976303796170:12822]
2025-10-02T08:15:02.898994Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:02.899008Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:02.899025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.899075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:02.899087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:02.899107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:02.899142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2251 partition: 0 MaxSeqNo: 17 sessionId: src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0
2025-10-02T08:15:02.899440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dc3aa-ed2e889e-8a7ac47f-8a49757a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:02.901919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0] Write session: try to update token
2025-10-02T08:15:02.901934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:02.915292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId: src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:02.916092Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:02.916107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:02.916110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:02.916119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534976303796170:12822]
2025-10-02T08:15:02.916124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534976303796170:12822]
2025-10-02T08:15:02.916170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:02.916169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:02.916184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:02.916193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:02.916195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:02.916364Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:02.917885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:02.976838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534976303796239:12399]
2025-10-02T08:15:02.976951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2250, pipe: [1:7556534976303796239:12399]
2025-10-02T08:15:03.064894Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:03.065216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.065229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.065268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534976303796239:12399], now have 1 active actors on pipe
2025-10-02T08:15:03.065476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534976303796239:12399]
2025-10-02T08:15:03.065485Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:03.065505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:03.065566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2251 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0
2025-10-02T08:15:03.065540Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:03.065885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:03.065894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0] Write session will restart in 0.006013s
2025-10-02T08:15:03.065722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2251 sessionId: src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0 is DEAD
2025-10-02T08:15:03.065916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0] Write session: Do CDS request
2025-10-02T08:15:03.065923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:03.072208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:03.073180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:03.073239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.073355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:03.073365Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:03.073368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2252
2025-10-02T08:15:03.073369Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:03.073378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:03.073433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:03.073471Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534980598763639:12829]
2025-10-02T08:15:03.073471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.073493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:03.073498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:03.073509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:03.073863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2252 sessionId:  describe result for acl check
2025-10-02T08:15:03.073884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:03.073886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:03.073888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:03.073893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534980598763644:12831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:03.073989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:03.074152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:03.074184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:03.074386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:03.074389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534980598763644:12831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:03.074410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.074411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.074412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.074412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.074413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.074416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.074422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.074424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.074426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.074428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.074432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.074439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.074445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.074449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.074453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.074458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.074463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.074468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.074471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.074474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.074485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:03.076727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534980598763644:12831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:03.081905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534980598763644:12831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:03.081924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534980598763644:12831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:03.081927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534980598763644:12831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:03.081936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:03.082833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:03.084505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:03.084522Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:03.084524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:03.084527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:03.084534Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2251 [1:7556534980598763639:12829]
2025-10-02T08:15:03.084544Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:03.084559Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:03.084562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.084565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.084568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.084585Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:03.084594Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:03.084600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:03.084663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.084670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.084673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:03.084675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:03.084735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:03.084741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.084752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.084767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:03.084786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598763687:12831], now have 1 active actors on pipe
2025-10-02T08:15:03.084789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2251
2025-10-02T08:15:03.084796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534980598763633:12829]
2025-10-02T08:15:03.084798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534980598763633:12829]
2025-10-02T08:15:03.084822Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:03.084836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534981058248541:2378], now have 1 active actors on pipe
2025-10-02T08:15:03.084845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:03.084857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:03.084863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:03.084869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.084873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.084931Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2251
2025-10-02T08:15:03.084911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534980598763633:12829]
2025-10-02T08:15:03.084918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:03.084921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:03.084923Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:03.084925Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:03.084936Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:03.084943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.084947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.084948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:03.084957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.084965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:03.084999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.085075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.085087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.085109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.085147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2252 partition: 0 MaxSeqNo: 17 sessionId: src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0
2025-10-02T08:15:03.085497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1e8fef-2f2fb94e-e7be53cc-fb3333b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:03.088336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0] Write session: try to update token
2025-10-02T08:15:03.088352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:03.102522Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:03.102547Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:03.102549Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:03.102558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534980598763633:12829]
2025-10-02T08:15:03.102562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534980598763633:12829]
2025-10-02T08:15:03.102605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:03.102613Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:03.102620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.102622Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:03.102622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:03.102760Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:03.104060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId: src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:03.106496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:03.165765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534980598763703:12399]
2025-10-02T08:15:03.165866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2251, pipe: [1:7556534980598763703:12399]
2025-10-02T08:15:03.242989Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:03.243420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.243435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.243474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598763703:12399], now have 1 active actors on pipe
2025-10-02T08:15:03.243596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:03.243608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:03.243679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2252 reason: error at write: Disconnected sessionId: src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0
2025-10-02T08:15:03.243733Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:03.243724Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:03.243842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2252 sessionId: src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0 is DEAD
2025-10-02T08:15:03.243978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:03.243984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0] Write session will restart in 0.009572s
2025-10-02T08:15:03.244006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0] Write session: Do CDS request
2025-10-02T08:15:03.244013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:03.244013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534980598763703:12399]
2025-10-02T08:15:03.250717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:03.252038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:03.252224Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:03.252234Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:03.252243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:03.252288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:03.252343Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534980598763807:12835]
2025-10-02T08:15:03.253006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:03.253238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:03.253276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:03.253566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:03.253608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.253613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.253615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.253616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.253617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.253622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.253632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.253638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.253642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.253646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.253651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.253658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.253664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.253669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.253675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.253681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.253685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.253690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.253699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.253704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.253722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:03.254228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.254312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:03.254321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2253
2025-10-02T08:15:03.254432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.254461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:03.254469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:03.254472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:03.254875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2253 sessionId:  describe result for acl check
2025-10-02T08:15:03.254910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:03.254916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:03.254919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:03.254923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534980598763823:12837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:03.255384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534980598763823:12837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:03.257274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534980598763823:12837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:03.260822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534980598763823:12837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:03.260835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534980598763823:12837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:03.260838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534980598763823:12837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:03.260846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:03.261549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:03.263287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:03.263302Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:03.263305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:03.263308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:03.263315Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2252 [1:7556534980598763807:12835]
2025-10-02T08:15:03.263325Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:03.263341Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:03.263344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.263347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.263349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.263367Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:03.263372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:03.263378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:03.263434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.263443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.263446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:03.263449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:03.263513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:03.263523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.263536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.263549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:03.263567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598763855:12837], now have 1 active actors on pipe
2025-10-02T08:15:03.263572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2252
2025-10-02T08:15:03.263578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534980598763801:12835]
2025-10-02T08:15:03.263580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534980598763801:12835]
2025-10-02T08:15:03.263591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:03.263605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534981058248551:2378], now have 1 active actors on pipe
2025-10-02T08:15:03.263609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:03.263613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:03.263615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.263619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.263634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:03.263654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:03.263661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:03.263646Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2252
2025-10-02T08:15:03.263700Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:03.263710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.263714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.263717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:03.263725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.263737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:03.263749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534980598763801:12835]
2025-10-02T08:15:03.263758Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:03.263769Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:03.263781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.263811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.263822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.263840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.263882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2253 partition: 0 MaxSeqNo: 17 sessionId: src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0
2025-10-02T08:15:03.264923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3848e80-8ab37e13-6ebd8625-e4e851ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:03.267565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0] Write session: try to update token
2025-10-02T08:15:03.267580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:03.281752Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:03.281778Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:03.281788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534980598763801:12835]
2025-10-02T08:15:03.281834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:03.282007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:03.282160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.282306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.282441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.282837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:03.282887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:03.282979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:03.287475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId: src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:03.290200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:03.290383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.290401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.290440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:03.290731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:03.292304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.292325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.292501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.292573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.292647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.292719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.292767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.292777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.292873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.292943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.293004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.293066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.293113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.293118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.293231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.293296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.293353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.293421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.293463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.293470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.293536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.293600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.293662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.293730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.293774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.293783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.293849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.293910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.293974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.294051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.294096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.294102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.294171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.294235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.294302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.294368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.294420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.294426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.294498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.294561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.294624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.294685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.294729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.294732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.294803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.294861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.294928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.294993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.295034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.295036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.295105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.295165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.295229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.295290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.295335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.295338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.295410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.295473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.295528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.295585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.295627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.295630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.295676Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:03.295678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:03.295680Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:03.295689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534980598763801:12835]
2025-10-02T08:15:03.295692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534980598763801:12835]
2025-10-02T08:15:03.295740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:03.295740Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:03.295744Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:03.295799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.295817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.295819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:03.295848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:03.295861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:03.295865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:03.295867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:03.295870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:03.296301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:03.296323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:03.296330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:03.296334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:03.296336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:03.296339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:03.297014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:03.297039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:03.297054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:03.297056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:03.297059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:03.297061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:03.297558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:03.297584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:03.297590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:03.297593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:03.297597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:03.299715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:03.299736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:03.299748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392903299
2025-10-02T08:15:03.299903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:03.299917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:03.299922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:03.299924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:03.299927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:03.299929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:03.300365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:03.300392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:03.300397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:03.300403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:03.300407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:03.300411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:03.300871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:03.300895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:03.300902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:03.300903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:03.300906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:03.300908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:03.301369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:03.301389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:03.301392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:03.302487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:03.302505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:03.302511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:03.302514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:03.302522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392903302
2025-10-02T08:15:03.302815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:03.302837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:03.302847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:03.302851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:03.302854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:03.302859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:03.303299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:03.303319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:03.303324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:03.303326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:03.303328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:03.303331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:03.303770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:03.303792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.303887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392903303
2025-10-02T08:15:03.304617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:03.304627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.304629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:03.304779Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:03.345069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534980598763870:12399]
2025-10-02T08:15:03.349078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2252, pipe: [1:7556534980598763870:12399]
2025-10-02T08:15:03.448368Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:03.448637Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:03.448658Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:03.448666Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:03.448670Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:03.448684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598763870:12399], now have 1 active actors on pipe
2025-10-02T08:15:03.448842Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:03.449302Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:03.450980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534980598763870:12399]
2025-10-02T08:15:03.451029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:03.451064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2253 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0
2025-10-02T08:15:03.451218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2253 sessionId: src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0 is DEAD
2025-10-02T08:15:03.451357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:03.451367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0] Write session will restart in 0.007226s
2025-10-02T08:15:03.451391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0] Write session: Do CDS request
2025-10-02T08:15:03.451396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:03.456965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:03.458685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:03.458866Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:03.458878Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:03.458888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:03.458940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:03.458981Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534980598763992:12848]
2025-10-02T08:15:03.459272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.459612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:03.459674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:03.459683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2254
2025-10-02T08:15:03.459779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.459805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:03.459814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:03.459817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:03.459856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:03.459901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:03.460221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:03.460276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.460282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.460284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.460285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.460286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.460290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.460299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.460303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.460307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.460311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.460317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.460325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.460331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.460336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.460340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.460345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.460349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.460355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.460359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.460364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.460383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:03.460727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2254 sessionId:  describe result for acl check
2025-10-02T08:15:03.460757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:03.460763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:03.460764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:03.460769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534980598764008:12850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:03.461261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534980598764008:12850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:03.463120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534980598764008:12850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:03.468266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:03.469942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:03.469959Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:03.469962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:03.469965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:03.469972Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2253 [1:7556534980598763992:12848]
2025-10-02T08:15:03.469983Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:03.470050Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:03.470060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.470062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.470064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.470081Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:03.470087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:03.470093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:03.470153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.470160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.470163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:03.470165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:03.470229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:03.470238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.470252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.470264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:03.470289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534981058248559:2378], now have 1 active actors on pipe
2025-10-02T08:15:03.470301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534980598763986:12848]
2025-10-02T08:15:03.470307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534980598763986:12848]
2025-10-02T08:15:03.470318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:03.470330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:03.470347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534980598764008:12850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:03.470348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:03.470351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:03.470351Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:03.470355Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:03.470363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534980598764008:12850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:03.470367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534980598764008:12850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:03.470374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:03.470384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534980598763986:12848]
2025-10-02T08:15:03.470397Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:03.470409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:03.470512Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2253
2025-10-02T08:15:03.470667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2253
2025-10-02T08:15:03.470678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598764044:12850], now have 1 active actors on pipe
2025-10-02T08:15:03.470682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.470685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.470702Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:03.470712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.470719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.470721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:03.470728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.470737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:03.470751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.470804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.470810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.470818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.470840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2254 partition: 0 MaxSeqNo: 17 sessionId: src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0
2025-10-02T08:15:03.471137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52291ad7-a2bfb442-4395ed57-8363d8a6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:03.473788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0] Write session: try to update token
2025-10-02T08:15:03.473805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:03.483764Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:03.483782Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:03.483790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534980598763986:12848]
2025-10-02T08:15:03.483831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:03.484004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:03.484157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.484213Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:03.484310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.484499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.484766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:03.484819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:03.487786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId: src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:03.490334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:03.490404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.490415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.490451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:03.490477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:03.490532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.490558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.490717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.490772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.490829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.490899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.491258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.491270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.491340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.491402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.491464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.491535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.491578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.491588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.491654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.491715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.491777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.491837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.491880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.491888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.491950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.492011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.492070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.492130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.492187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.492195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.492258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.492317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.492377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.492440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.492484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.492491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.492555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.492615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.492678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.492740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.492783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.492796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.492882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.492942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.493007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.493071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.493123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.493130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.493195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.493255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.493321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.493378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.493416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.493419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.493486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.493540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.493594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.493647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.493687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.493690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.493768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.493823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.493882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.493940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.493980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.493983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.494025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:03.494085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.494101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.494104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:03.494132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:03.494147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:03.494150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:03.494154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:03.494157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:03.494547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:03.494563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:03.494570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:03.494573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:03.494576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:03.494579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:03.495201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:03.495226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:03.495233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:03.495236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:03.495239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:03.495243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:03.495983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:03.496006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:03.496012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:03.496016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:03.496020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:03.497229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:03.497247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:03.497259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392903496
2025-10-02T08:15:03.497423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:03.497437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:03.497442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:03.497446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:03.497449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:03.497452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:03.497910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:03.497933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:03.497940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:03.497944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:03.497947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:03.497951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:03.498401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:03.498424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:03.498432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:03.498435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:03.498438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:03.498443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:03.498887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:03.498908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:03.498914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:03.499962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:03.499979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:03.499985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:03.499988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:03.499996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392903499
2025-10-02T08:15:03.500308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:03.500325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:03.500330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:03.500333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:03.500339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:03.500346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:03.500785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:03.500822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:03.500827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:03.500831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:03.500834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:03.500836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:03.501310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:03.501330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.501427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392903501
2025-10-02T08:15:03.502261Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:03.502284Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:03.502292Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:03.502299Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:03.503838Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:03.503851Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:03.503853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:03.503861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534980598763986:12848]
2025-10-02T08:15:03.503866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534980598763986:12848]
2025-10-02T08:15:03.503891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:03.503901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:03.503906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:03.503910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.503912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:03.504032Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:03.551302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534980598764088:12399]
2025-10-02T08:15:03.551479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2253, pipe: [1:7556534980598764088:12399]
2025-10-02T08:15:03.651668Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:03.652018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598764088:12399], now have 1 active actors on pipe
2025-10-02T08:15:03.652085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534980598764088:12399]
2025-10-02T08:15:03.652104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:03.652110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:03.652133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2254 reason: error at write: Disconnected sessionId: src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0
2025-10-02T08:15:03.652232Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:03.652247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:03.652318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2254 sessionId: src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0 is DEAD
2025-10-02T08:15:03.652463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:03.652473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0] Write session will restart in 0.009436s
2025-10-02T08:15:03.652495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0] Write session: Do CDS request
2025-10-02T08:15:03.652502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:03.659755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:03.660158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:03.660284Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:03.660292Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:03.660300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:03.660360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:03.660398Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534980598764232:12860]
2025-10-02T08:15:03.660824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:03.661031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:03.661067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:03.661270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:03.661309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.661313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.661314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.661315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.661316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.661321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.661331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.661339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.661343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.661347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.661352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.661362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.661367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.661371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.661375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.661380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.661384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.661388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.661393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.661398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.661416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:03.663291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.663316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:03.663327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2255
2025-10-02T08:15:03.663477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.663502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:03.663507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:03.663514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:03.663909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2255 sessionId:  describe result for acl check
2025-10-02T08:15:03.663953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:03.663959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:03.663961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:03.663966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534980598764248:12862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:03.664471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534980598764248:12862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:03.666498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534980598764248:12862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:03.669654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534980598764248:12862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:03.669668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534980598764248:12862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:03.669672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534980598764248:12862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:03.669680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:03.671961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:03.673439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:03.673453Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:03.673455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:03.673460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:03.673465Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2254 [1:7556534980598764232:12860]
2025-10-02T08:15:03.673480Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:03.673496Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:03.673498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.673501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.673503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.673517Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:03.673522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:03.673527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:03.673589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.673595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.673598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:03.673601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:03.673663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:03.673670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.673682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.673692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:03.673716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598764279:12862], now have 1 active actors on pipe
2025-10-02T08:15:03.673721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534980598764226:12860]
2025-10-02T08:15:03.673722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534980598764226:12860]
2025-10-02T08:15:03.673727Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:03.673735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534981058248588:2378], now have 1 active actors on pipe
2025-10-02T08:15:03.673736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2254
2025-10-02T08:15:03.673741Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:03.673742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:03.673744Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:03.673754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:03.673757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:03.673765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.673770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.673808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534980598764226:12860]
2025-10-02T08:15:03.673816Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:03.673828Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:03.673830Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:03.673838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.673841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.673843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:03.673851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.673859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:03.673893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.673931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.673934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.673946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.673983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2255 partition: 0 MaxSeqNo: 17 sessionId: src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0
2025-10-02T08:15:03.674029Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2254
2025-10-02T08:15:03.674288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5118e536-5cab1c53-bc8fe60a-5c39b1f3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:03.676886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0] Write session: try to update token
2025-10-02T08:15:03.676898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:03.687138Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:03.687158Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:03.687166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534980598764226:12860]
2025-10-02T08:15:03.687209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:03.687213Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:03.687381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:03.687532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.687673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.687815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:03.688020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:03.688060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:03.689957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId: src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:03.692370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:03.692445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.692460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.692494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:03.692519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:03.692582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.692594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.692742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.692824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.692889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.692954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.692997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.693006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.693074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.693132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.693192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.693260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.693305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.693312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.693377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.693435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.693494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.693560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.693662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.693670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.693734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.693799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.693861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.693922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.693969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.693978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.694045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.694106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.694171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.694230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.694276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.694283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.694348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.694406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.694469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.694533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.694580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.694590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.694655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.694715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.694781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.694840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.694889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.694896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.694961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.695023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.695091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.695158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.695203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.695205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.695272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.695331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.695393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.695456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.695522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.695529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.695595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:03.695654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:03.695717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:03.695777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:03.695821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:03.695828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:03.695861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:03.695925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.695947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.695953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:03.695982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:03.696000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:03.696005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:03.696010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:03.696013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:03.696398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:03.696423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:03.696429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:03.696433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:03.696436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:03.696440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:03.696993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:03.697015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:03.697021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:03.697025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:03.697028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:03.697031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:03.697596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:03.697618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:03.697623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:03.697628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:03.697632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:03.703940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:03.703963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:03.703978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392903703
2025-10-02T08:15:03.704096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:03.704112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:03.704118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:03.704122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:03.704126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:03.704130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:03.704651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:03.704676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:03.704682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:03.704688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:03.704692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:03.704697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:03.705181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:03.705203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:03.705213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:03.705217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:03.705220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:03.705223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:03.705648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:03.705669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:03.705677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:03.706743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:03.706761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:03.706766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:03.706769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:03.706777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392903706
2025-10-02T08:15:03.707047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:03.707069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:03.707075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:03.707079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:03.707082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:03.707085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:03.707536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:03.707558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:03.707563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:03.707567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:03.707571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:03.707575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:03.708018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:03.708038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.708135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392903707
2025-10-02T08:15:03.708903Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:03.708931Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:03.708938Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:03.708946Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:03.710470Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:03.710483Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:03.710485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:03.710494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534980598764226:12860]
2025-10-02T08:15:03.710497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534980598764226:12860]
2025-10-02T08:15:03.710545Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:03.710554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:03.710559Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:03.710559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.710561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:03.710690Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:03.752015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534980598764304:12399]
2025-10-02T08:15:03.752233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2254, pipe: [1:7556534980598764304:12399]
2025-10-02T08:15:03.845614Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:03.845975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598764304:12399], now have 1 active actors on pipe
2025-10-02T08:15:03.846104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:03.846111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:03.846135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2255 reason: error at write: Disconnected sessionId: src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0
2025-10-02T08:15:03.846228Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:03.846242Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:03.846287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2255 sessionId: src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0 is DEAD
2025-10-02T08:15:03.846409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:03.846417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0] Write session will restart in 0.006156s
2025-10-02T08:15:03.846439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0] Write session: Do CDS request
2025-10-02T08:15:03.846445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:03.846444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534980598764304:12399]
2025-10-02T08:15:03.853050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:03.854111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:03.854245Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:03.854254Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:03.854264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:03.854313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:03.854344Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534980598764457:12867]
2025-10-02T08:15:03.854744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:03.855155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.855274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:03.855286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2256
2025-10-02T08:15:03.855380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:03.855406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:03.855419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:03.855422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:03.855805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2256 sessionId:  describe result for acl check
2025-10-02T08:15:03.855861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:03.855870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:03.855872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:03.855877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534980598764467:12869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:03.856521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534980598764467:12869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:03.858669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534980598764467:12869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:03.861372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534980598764467:12869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:03.861386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534980598764467:12869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:03.861388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534980598764467:12869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:03.861396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:03.863660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:03.863716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:03.863950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:03.863988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.863996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.863997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.863998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.863999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.864005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.864013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.864016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.864020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.864023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.864028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.864037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:03.864043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.864047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:03.864051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.864055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:03.864059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.864064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.864068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.864072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.864089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:03.888203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:03.889892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:03.889912Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:03.889917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:03.889921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:03.889927Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2255 [1:7556534980598764457:12867]
2025-10-02T08:15:03.889937Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:03.889953Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:03.889962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.889965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.889966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.889981Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:03.889991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:03.889997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:03.890055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.890061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.890064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:03.890066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:03.890131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:03.890139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.890152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:03.890168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:03.890183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534980598764449:12867]
2025-10-02T08:15:03.890190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534980598764449:12867]
2025-10-02T08:15:03.890198Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:03.890211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598764503:12869], now have 1 active actors on pipe
2025-10-02T08:15:03.890215Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:03.890218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2255
2025-10-02T08:15:03.890219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:03.890223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:03.890236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:03.890244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:03.890249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534981058248608:2378], now have 1 active actors on pipe
2025-10-02T08:15:03.890284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.890291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.890316Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2255
2025-10-02T08:15:03.890303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534980598764449:12867]
2025-10-02T08:15:03.890320Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:03.890334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:03.890349Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:03.890356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:03.890360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:03.890361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:03.890369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:03.890379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:03.890454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.890496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:03.890498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:03.890512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:03.890548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2256 partition: 0 MaxSeqNo: 17 sessionId: src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0
2025-10-02T08:15:03.890930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5b5e37-f086c262-28bcfddd-def6ea15_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:03.893648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0] Write session: try to update token
2025-10-02T08:15:03.893667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:03.907315Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:03.907338Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:03.907340Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:03.907344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId: src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:03.907348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534980598764449:12867]
2025-10-02T08:15:03.907356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534980598764449:12867]
2025-10-02T08:15:03.907397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:03.907404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:03.907406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:03.907423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:03.907430Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:03.907544Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:03.909836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:03.946570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534980598764525:12399]
2025-10-02T08:15:03.948949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2255, pipe: [1:7556534980598764525:12399]
2025-10-02T08:15:04.043871Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:04.044226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.044245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.044299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534980598764525:12399], now have 1 active actors on pipe
2025-10-02T08:15:04.044567Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:04.044887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534980598764525:12399]
2025-10-02T08:15:04.044911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:04.044960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2256 reason: status is not ok: tablet will be restarted right now sessionId: src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0
2025-10-02T08:15:04.045103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2256 sessionId: src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0 is DEAD
2025-10-02T08:15:04.045277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:04.045288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0] Write session will restart in 0.005674s
2025-10-02T08:15:04.045319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0] Write session: Do CDS request
2025-10-02T08:15:04.045328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:04.045625Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:04.052227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.056936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:04.056954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2257
2025-10-02T08:15:04.057120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.057157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:04.057162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:04.057166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:04.057411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:04.057832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2257 sessionId:  describe result for acl check
2025-10-02T08:15:04.057856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:04.057858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:04.057859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:04.057865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534984893731962:12875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:04.058237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:04.058350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534984893731962:12875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:04.058402Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:04.058405Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:04.058414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:04.058462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:04.058499Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534984893731965:12873]
2025-10-02T08:15:04.059132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:04.059377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:04.059410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:04.059720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:04.059759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.059760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.059761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.059762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.059763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.059768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.059778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.059782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.059786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.059789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.059794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.059801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.059807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.059812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.059816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.059822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.059828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.059833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.059837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.059842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.059861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:04.061087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534984893731962:12875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:04.066976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534984893731962:12875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:04.066992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534984893731962:12875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:04.066998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534984893731962:12875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:04.067007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:04.070464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:04.072189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:04.072195Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:04.072198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:04.072202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:04.072210Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2256 [1:7556534984893731965:12873]
2025-10-02T08:15:04.072223Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:04.072239Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:04.072242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.072245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.072247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.072263Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:04.072268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:04.072277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:04.072342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.072344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.072347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:04.072349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:04.072420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:04.072424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.072437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.072449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:04.072465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534984893731956:12873]
2025-10-02T08:15:04.072467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534984893731956:12873]
2025-10-02T08:15:04.072482Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:04.072493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:04.072507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:04.072509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:04.072543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534984893731956:12873]
2025-10-02T08:15:04.072547Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:04.072546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:04.072550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:04.072563Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:04.073013Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2256
2025-10-02T08:15:04.073105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2256
2025-10-02T08:15:04.073124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732011:12875], now have 1 active actors on pipe
2025-10-02T08:15:04.073128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534985353215911:2378], now have 1 active actors on pipe
2025-10-02T08:15:04.073169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.073178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.073207Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:04.073215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.073219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.073221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:04.073233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.073245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:04.073266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.074149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27c56b12-fde642f3-8d1fc81d-eea638f7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:04.073730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.073742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.073759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.073793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2257 partition: 0 MaxSeqNo: 17 sessionId: src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0
2025-10-02T08:15:04.077333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0] Write session: try to update token
2025-10-02T08:15:04.077350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:04.091798Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:04.091826Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:04.091829Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:04.091838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534984893731956:12873]
2025-10-02T08:15:04.091842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534984893731956:12873]
2025-10-02T08:15:04.091884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:04.091887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:04.091892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:04.091895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.091897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:04.092048Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:04.093138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId: src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:04.095611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:04.145235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534984893732026:12399]
2025-10-02T08:15:04.145342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2256, pipe: [1:7556534984893732026:12399]
2025-10-02T08:15:04.229100Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:04.229343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.229354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.229388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732026:12399], now have 1 active actors on pipe
2025-10-02T08:15:04.229508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:04.229520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:04.229592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2257 reason: error at write: Disconnected sessionId: src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0
2025-10-02T08:15:04.229597Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:04.229585Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:04.229764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2257 sessionId: src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0 is DEAD
2025-10-02T08:15:04.229885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534984893732026:12399]
2025-10-02T08:15:04.229911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:04.229925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0] Write session will restart in 0.006440s
2025-10-02T08:15:04.229944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0] Write session: Do CDS request
2025-10-02T08:15:04.229950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:04.236785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:04.237292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.237321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:04.237334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:04.237341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2258
2025-10-02T08:15:04.237496Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:04.237496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.237507Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:04.237517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:04.237519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:04.237524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:04.237527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:04.237573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:04.237611Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534984893732169:12880]
2025-10-02T08:15:04.237868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2258 sessionId:  describe result for acl check
2025-10-02T08:15:04.237902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:04.237908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:04.237910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:04.237915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534984893732173:12882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:04.238199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:04.238360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:04.238382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534984893732173:12882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:04.238396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:04.238686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:04.238731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.238736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.238737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.238738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.238739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.238744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.238753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.238756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.238760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.238763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.238768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.238774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.238779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.238784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.238792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.238798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.238806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.238810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.238815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.238820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.238842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:04.240233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534984893732173:12882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:04.245121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534984893732173:12882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:04.245135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534984893732173:12882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:04.245138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534984893732173:12882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:04.245146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:04.250913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:04.252508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:04.252528Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:04.252531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:04.252534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:04.252540Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2257 [1:7556534984893732169:12880]
2025-10-02T08:15:04.252553Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:04.252569Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:04.252577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.252580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.252582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.252598Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:04.252608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:04.252614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:04.252675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.252683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.252686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:04.252689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:04.252753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:04.252759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.252771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.252785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:04.252841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534984893732162:12880]
2025-10-02T08:15:04.252848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534984893732162:12880]
2025-10-02T08:15:04.252859Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:04.252866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:04.252872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732216:12882], now have 1 active actors on pipe
2025-10-02T08:15:04.252877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2257
2025-10-02T08:15:04.252882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:04.252887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:04.252896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:04.252906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:04.252912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534985353215920:2378], now have 1 active actors on pipe
2025-10-02T08:15:04.252944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.252947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.252959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534984893732162:12880]
2025-10-02T08:15:04.252967Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:04.252942Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2257
2025-10-02T08:15:04.252976Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:04.252991Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50694e75-65f4c777-acc3a927-efdee166_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:04.253002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.253006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.253012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:04.253023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.253037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:04.253131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.253221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.253231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.253261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.253301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2258 partition: 0 MaxSeqNo: 17 sessionId: src_id|50694e75-65f4c777-acc3a927-efdee166_0
2025-10-02T08:15:04.253616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f36e08-98bf77dc-b20b1de7-8fc2ba02_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|50694e75-65f4c777-acc3a927-efdee166_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:04.256360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50694e75-65f4c777-acc3a927-efdee166_0] Write session: try to update token
2025-10-02T08:15:04.256378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50694e75-65f4c777-acc3a927-efdee166_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:04.270213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId: src_id|50694e75-65f4c777-acc3a927-efdee166_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:04.270507Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:04.270529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:04.270531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:04.270540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534984893732162:12880]
2025-10-02T08:15:04.270545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534984893732162:12880]
2025-10-02T08:15:04.270584Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:04.270591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:04.270596Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:04.270602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.270604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:04.270748Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:04.273013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:04.330064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534984893732230:12399]
2025-10-02T08:15:04.332385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2257, pipe: [1:7556534984893732230:12399]
2025-10-02T08:15:04.411459Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:04.411729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.411743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.411783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732230:12399], now have 1 active actors on pipe
2025-10-02T08:15:04.411887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534984893732230:12399]
2025-10-02T08:15:04.411903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:04.411905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:04.412060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:04.412219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50694e75-65f4c777-acc3a927-efdee166_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:04.412225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50694e75-65f4c777-acc3a927-efdee166_0] Write session will restart in 0.007742s
2025-10-02T08:15:04.412249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50694e75-65f4c777-acc3a927-efdee166_0] Write session: Do CDS request
2025-10-02T08:15:04.412255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50694e75-65f4c777-acc3a927-efdee166_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:04.411947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2258 reason: error at write: Disconnected sessionId: src_id|50694e75-65f4c777-acc3a927-efdee166_0
2025-10-02T08:15:04.412051Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:04.412077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2258 sessionId: src_id|50694e75-65f4c777-acc3a927-efdee166_0 is DEAD
2025-10-02T08:15:04.418799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:04.419570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:04.419777Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:04.419786Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:04.419796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:04.419843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:04.419881Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534984893732374:12886]
2025-10-02T08:15:04.420477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:04.420663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:04.420705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:04.421029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:04.421089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.421096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.421098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.421099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.421100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.421105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.421115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.421118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.421121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.421124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.421130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.421137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.421143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.421147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.421152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.421157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.421161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.421166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.421172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.421177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.421196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:04.421290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50694e75-65f4c777-acc3a927-efdee166_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.421370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:04.421378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2259
2025-10-02T08:15:04.421482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.421511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:04.421520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:04.421525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:04.421881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2259 sessionId:  describe result for acl check
2025-10-02T08:15:04.421911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:04.421917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:04.421919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:04.421924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534984893732390:12888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:04.422422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534984893732390:12888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:04.424732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534984893732390:12888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:04.428466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534984893732390:12888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:04.428481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534984893732390:12888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:04.428487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534984893732390:12888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:04.428496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:04.429146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:04.430913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:04.430927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:04.430929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:04.430933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:04.430938Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2258 [1:7556534984893732374:12886]
2025-10-02T08:15:04.430949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:04.430964Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:04.430966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.430969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.430971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.430985Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:04.430995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:04.431001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:04.431056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.431063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.431066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:04.431069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:04.431127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:04.431133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.431145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.431156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:04.431158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2258
2025-10-02T08:15:04.431177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732421:12888], now have 1 active actors on pipe
2025-10-02T08:15:04.431185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.431188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.431200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534985353215926:2378], now have 1 active actors on pipe
2025-10-02T08:15:04.431209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534984893732368:12886]
2025-10-02T08:15:04.431212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534984893732368:12886]
2025-10-02T08:15:04.431223Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:04.431236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:04.431241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:04.431244Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:04.431252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:04.431255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:04.431235Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2258
2025-10-02T08:15:04.431268Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:04.431277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.431280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.431281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:04.431289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.431300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:04.431331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534984893732368:12886]
2025-10-02T08:15:04.431344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:04.431358Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:04.431365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.431415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.431426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.431448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.431483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2259 partition: 0 MaxSeqNo: 17 sessionId: src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0
2025-10-02T08:15:04.431799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50694e75-65f4c777-acc3a927-efdee166_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:04.434609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0] Write session: try to update token
2025-10-02T08:15:04.434624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:04.448051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId: src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:04.448651Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:04.448671Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:04.448673Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:04.448683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534984893732368:12886]
2025-10-02T08:15:04.448688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534984893732368:12886]
2025-10-02T08:15:04.448729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:04.448736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.448743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:04.448744Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:04.448751Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:04.448899Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:04.450739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:04.510948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534984893732466:12399]
2025-10-02T08:15:04.511209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2258, pipe: [1:7556534984893732466:12399]
2025-10-02T08:15:04.592068Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:04.592369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.592384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.592418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732466:12399], now have 1 active actors on pipe
2025-10-02T08:15:04.592517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:04.592526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:04.592586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2259 reason: error at write: Disconnected sessionId: src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0
2025-10-02T08:15:04.592653Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:04.592626Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:04.592751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2259 sessionId: src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0 is DEAD
2025-10-02T08:15:04.592892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534984893732466:12399]
2025-10-02T08:15:04.593079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:04.593087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0] Write session will restart in 0.009032s
2025-10-02T08:15:04.593107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0] Write session: Do CDS request
2025-10-02T08:15:04.593112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:04.598814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:04.599242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:04.599375Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:04.599383Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:04.599392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:04.599426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:04.599471Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534984893732625:12907]
2025-10-02T08:15:04.600053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:04.600202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:04.600234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:04.600504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:04.600541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.600546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.600547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.600548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.600549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.600555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.600563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.600566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.600569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.600573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.600578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.600583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.600589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.600593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.600596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.600600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.600603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.600606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.600610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.600614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.600633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:04.603281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.603330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:04.603340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2260
2025-10-02T08:15:04.603490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.603515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:04.603535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:04.603538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:04.603931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2260 sessionId:  describe result for acl check
2025-10-02T08:15:04.603972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:04.603977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:04.603979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:04.603984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534984893732641:12909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:04.604479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534984893732641:12909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:04.606252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534984893732641:12909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:04.608093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:04.609190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534984893732641:12909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:04.609202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534984893732641:12909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:04.609206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534984893732641:12909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:04.609213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:04.609649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:04.609667Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:04.609669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:04.609672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:04.609678Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2259 [1:7556534984893732625:12907]
2025-10-02T08:15:04.609692Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:04.609707Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:04.609710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.609714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.609716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.609733Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:04.609740Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:04.609746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:04.609803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.609809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.609813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:04.609815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:04.609873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:04.609879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.609890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.609900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2259
2025-10-02T08:15:04.609903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:04.609919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732669:12909], now have 1 active actors on pipe
2025-10-02T08:15:04.609925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534985353215954:2378], now have 1 active actors on pipe
2025-10-02T08:15:04.609929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.609932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.609947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534984893732619:12907]
2025-10-02T08:15:04.609952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534984893732619:12907]
2025-10-02T08:15:04.609963Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:04.609977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:04.609981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:04.609985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:04.609993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:04.609961Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2259
2025-10-02T08:15:04.609996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:04.610013Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:04.610021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.610024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.610026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:04.610036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.610046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:04.610079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534984893732619:12907]
2025-10-02T08:15:04.610090Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:04.610103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:04.610109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.610152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.610156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.610169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.610211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2260 partition: 0 MaxSeqNo: 17 sessionId: src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0
2025-10-02T08:15:04.610499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf98791-b51c4fae-6ef7421f-13f835b2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:04.613197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0] Write session: try to update token
2025-10-02T08:15:04.613212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:04.626948Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:04.626970Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:04.626973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:04.626981Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534984893732619:12907]
2025-10-02T08:15:04.626986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534984893732619:12907]
2025-10-02T08:15:04.627032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:04.627038Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:04.627043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.627043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:04.627045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:04.627186Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:04.627790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId: src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:04.630272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:04.693047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534984893732687:12399]
2025-10-02T08:15:04.693136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2259, pipe: [1:7556534984893732687:12399]
2025-10-02T08:15:04.762405Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:04.762659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.762669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.762697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732687:12399], now have 1 active actors on pipe
2025-10-02T08:15:04.762788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534984893732687:12399]
2025-10-02T08:15:04.762814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:04.762821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:04.762823Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:04.762844Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:04.762884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2260 reason: error at write: Disconnected sessionId: src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0
2025-10-02T08:15:04.763042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2260 sessionId: src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0 is DEAD
2025-10-02T08:15:04.763160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:04.763170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0] Write session will restart in 0.009948s
2025-10-02T08:15:04.763192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0] Write session: Do CDS request
2025-10-02T08:15:04.763199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:04.769151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:04.769765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:04.769938Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:04.769951Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:04.769961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:04.770006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:04.770044Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534984893732835:12913]
2025-10-02T08:15:04.770628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:04.770785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:04.770821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:04.771083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:04.771132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.771137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.771138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.771139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.771140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.771144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.771153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.771157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.771160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.771163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.771171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.771181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.771190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.771199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.771207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.771215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.771221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.771226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.771234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.771240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.771258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:04.774230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.774310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:04.774322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2261
2025-10-02T08:15:04.774421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.774447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:04.774455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:04.774458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:04.774753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2261 sessionId:  describe result for acl check
2025-10-02T08:15:04.774777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:04.774782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:04.774783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:04.774787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534984893732863:12916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:04.775073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534984893732863:12916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:04.776399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534984893732863:12916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:04.778691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534984893732863:12916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:04.778701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534984893732863:12916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:04.778704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534984893732863:12916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:04.778708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:04.778810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:04.780449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:04.780468Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:04.780470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:04.780475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:04.780479Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2260 [1:7556534984893732835:12913]
2025-10-02T08:15:04.780489Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:04.780502Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:04.780505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.780507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.780510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.780523Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:04.780533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:04.780538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:04.780592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.780600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.780603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:04.780605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:04.780661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:04.780668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.780680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.780697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:04.780713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2260
2025-10-02T08:15:04.780720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732894:12916], now have 1 active actors on pipe
2025-10-02T08:15:04.780723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534985353215973:2378], now have 1 active actors on pipe
2025-10-02T08:15:04.780729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534984893732829:12913]
2025-10-02T08:15:04.780731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534984893732829:12913]
2025-10-02T08:15:04.780742Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:04.780751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.780755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:04.780756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.780758Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:04.780772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:04.780761Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2260
2025-10-02T08:15:04.780785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:04.780792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:04.780844Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:04.780855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.780858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.780860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:04.780869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.780877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:04.780888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534984893732829:12913]
2025-10-02T08:15:04.780899Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:04.780915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:04.780921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.780985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.780992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.781005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.781035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2261 partition: 0 MaxSeqNo: 17 sessionId: src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0
2025-10-02T08:15:04.781324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a6eb2b-dd49b37f-8ce7f16c-f4d5f74e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:04.783682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0] Write session: try to update token
2025-10-02T08:15:04.783694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:04.796321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId: src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:04.797969Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:04.797982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:04.797984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:04.797991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534984893732829:12913]
2025-10-02T08:15:04.797994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534984893732829:12913]
2025-10-02T08:15:04.798026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:04.798037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.798042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:04.798055Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:04.798079Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:04.798161Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:04.799216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:04.862994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534984893732912:12399]
2025-10-02T08:15:04.863138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2260, pipe: [1:7556534984893732912:12399]
2025-10-02T08:15:04.950957Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:04.951208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.951219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.951259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893732912:12399], now have 1 active actors on pipe
2025-10-02T08:15:04.951369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534984893732912:12399]
2025-10-02T08:15:04.951396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:04.951398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:04.951422Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:04.951471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2261 reason: error at write: Disconnected sessionId: src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0
2025-10-02T08:15:04.951805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:04.951812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0] Write session will restart in 0.008318s
2025-10-02T08:15:04.951837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0] Write session: Do CDS request
2025-10-02T08:15:04.951843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:04.951648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2261 sessionId: src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0 is DEAD
2025-10-02T08:15:04.951825Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:04.959382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:04.960255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:04.960416Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:04.960426Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:04.960435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:04.960483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:04.960519Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534984893733066:12920]
2025-10-02T08:15:04.961097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:04.961225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.961322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:04.961336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2262
2025-10-02T08:15:04.961410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:04.961442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:04.961464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:04.961477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:04.961487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:04.961491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:04.961789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:04.961848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2262 sessionId:  describe result for acl check
2025-10-02T08:15:04.961860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.961861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.961863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.961864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.961865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.961870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.961877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:04.961879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:04.961879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.961880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:04.961883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.961886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534984893733078:12922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:04.961886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.961890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.961895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.961903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:04.961909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.961915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:04.961919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.961924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:04.961930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.961941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.961945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.961954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.961972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:04.962367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534984893733078:12922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:04.964386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534984893733078:12922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:04.970099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534984893733078:12922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:04.970120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534984893733078:12922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:04.970124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534984893733078:12922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:04.970133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:04.970143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:04.971903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:04.971919Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:04.971921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:04.971925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:04.971930Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2261 [1:7556534984893733066:12920]
2025-10-02T08:15:04.971943Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:04.971961Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:04.971963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.971967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.971969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.971985Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:04.971992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:04.971999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:04.972066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.972079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.972082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:04.972084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:04.972148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:04.972155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.972168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:04.972190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:04.972213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534984893733110:12922], now have 1 active actors on pipe
2025-10-02T08:15:04.972220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534985353215981:2378], now have 1 active actors on pipe
2025-10-02T08:15:04.972226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534984893733060:12920]
2025-10-02T08:15:04.972229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534984893733060:12920]
2025-10-02T08:15:04.972243Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:04.972262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:04.972277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2261
2025-10-02T08:15:04.972280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:04.972283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:04.972295Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2261
2025-10-02T08:15:04.972315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534984893733060:12920]
2025-10-02T08:15:04.972315Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:04.972318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:04.972324Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:04.972339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.972343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:04.972343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.972375Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:04.972381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:04.972385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:04.972387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:04.972397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:04.972408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:04.972431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.972619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:04.972629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:04.972645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:04.972682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2262 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0
2025-10-02T08:15:04.973038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f45cfbd-d796a024-4ac62c52-9c6e7083_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:04.975782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0] Write session: try to update token
2025-10-02T08:15:04.975799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:04.992254Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:04.992279Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:04.992282Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:04.992293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534984893733060:12920]
2025-10-02T08:15:04.992297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534984893733060:12920]
2025-10-02T08:15:04.992346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:04.992352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:04.992355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:04.992511Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:04.992555Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:04.992561Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:04.997991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId: src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:05.000532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:05.051465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534989188700420:12399]
2025-10-02T08:15:05.051592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2261, pipe: [1:7556534989188700420:12399]
2025-10-02T08:15:05.127937Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:05.128224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.128234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.128269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188700420:12399], now have 1 active actors on pipe
2025-10-02T08:15:05.128379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:05.128390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:05.128445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2262 reason: error at write: Disconnected sessionId: src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0
2025-10-02T08:15:05.128448Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:05.128582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2262 sessionId: src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0 is DEAD
2025-10-02T08:15:05.128683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534989188700420:12399]
2025-10-02T08:15:05.128736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:05.128742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0] Write session will restart in 0.006591s
2025-10-02T08:15:05.128765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0] Write session: Do CDS request
2025-10-02T08:15:05.128774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:05.128539Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:05.135386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:05.135866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:05.136012Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:05.136020Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:05.136027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:05.136060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:05.136099Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534989188700575:12927]
2025-10-02T08:15:05.136221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.136315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:05.136329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2263
2025-10-02T08:15:05.136426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.136453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:05.136462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:05.136465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:05.136557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:05.136731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:05.136770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:05.136831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2263 sessionId:  describe result for acl check
2025-10-02T08:15:05.136860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:05.136866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:05.136868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:05.136873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534989188700586:12929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:05.137003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:05.137036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.137041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.137042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.137042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.137043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.137046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.137052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.137055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.137059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.137061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.137065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.137069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.137073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.137075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.137078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.137080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.137082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.137085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.137089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.137092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.137102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:05.137353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534989188700586:12929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:05.142508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534989188700586:12929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:05.145169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534989188700586:12929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:05.145183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534989188700586:12929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:05.145186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534989188700586:12929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:05.145194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:05.145426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:05.146912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:05.146925Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:05.146927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:05.146929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:05.146934Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2262 [1:7556534989188700575:12927]
2025-10-02T08:15:05.146942Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:05.146954Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:05.146956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.146958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.146961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.146974Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:05.146978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:05.146984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:05.147033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.147042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.147045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:05.147047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:05.147103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:05.147230Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2262
2025-10-02T08:15:05.147112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.147122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.147133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:05.147150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188700622:12929], now have 1 active actors on pipe
2025-10-02T08:15:05.147156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534989188700569:12927]
2025-10-02T08:15:05.147157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534989188700569:12927]
2025-10-02T08:15:05.147158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2262
2025-10-02T08:15:05.147163Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:05.147170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534989648183283:2378], now have 1 active actors on pipe
2025-10-02T08:15:05.147170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:05.147172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:05.147177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:05.147190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:05.147192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:05.147199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.147203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.147238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534989188700569:12927]
2025-10-02T08:15:05.147241Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:05.147252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:05.147254Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd50da54-58e349f-551c9663-af60ed62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:05.147262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.147266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.147267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:05.147276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.147285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:05.147321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.147372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.147374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.147387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.147422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2263 partition: 0 MaxSeqNo: 17 sessionId: src_id|cd50da54-58e349f-551c9663-af60ed62_0
2025-10-02T08:15:05.147739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cae7cf-49694c62-e425aab8-40e8df2f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cd50da54-58e349f-551c9663-af60ed62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:05.150249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd50da54-58e349f-551c9663-af60ed62_0] Write session: try to update token
2025-10-02T08:15:05.150268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd50da54-58e349f-551c9663-af60ed62_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:05.164291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId: src_id|cd50da54-58e349f-551c9663-af60ed62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:05.166918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:05.167590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.167613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.167634Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:05.167636Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:05.167640Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:05.167647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534989188700569:12927]
2025-10-02T08:15:05.167651Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534989188700569:12927]
2025-10-02T08:15:05.167694Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:05.167700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:05.167707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.167707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:05.167709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:05.167844Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:05.228624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534989188700636:12399]
2025-10-02T08:15:05.228702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2262, pipe: [1:7556534989188700636:12399]
2025-10-02T08:15:05.308507Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:05.308930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:05.308965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:05.308972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188700636:12399], now have 1 active actors on pipe
2025-10-02T08:15:05.309058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:05.309068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:05.309086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2263 reason: error at write: Disconnected sessionId: src_id|cd50da54-58e349f-551c9663-af60ed62_0
2025-10-02T08:15:05.309185Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:05.309202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2263 sessionId: src_id|cd50da54-58e349f-551c9663-af60ed62_0 is DEAD
2025-10-02T08:15:05.309318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd50da54-58e349f-551c9663-af60ed62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:05.309325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd50da54-58e349f-551c9663-af60ed62_0] Write session will restart in 0.007592s
2025-10-02T08:15:05.309343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd50da54-58e349f-551c9663-af60ed62_0] Write session: Do CDS request
2025-10-02T08:15:05.309348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd50da54-58e349f-551c9663-af60ed62_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:05.309361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534989188700636:12399]
2025-10-02T08:15:05.316320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:05.316773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:05.316925Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:05.316932Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:05.316940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:05.316980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:05.317006Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534989188700790:12933]
2025-10-02T08:15:05.317465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:05.317619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:05.317646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:05.317911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:05.317950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.317956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.317957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.317958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.317960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.317964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.317973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.317976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.317980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.317983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.317987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.317992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.317997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.318001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.318005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.318009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.318013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.318016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.318022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.318026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.318041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:05.318289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd50da54-58e349f-551c9663-af60ed62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.318334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:05.318348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2264
2025-10-02T08:15:05.318791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.318829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:05.318837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:05.318841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:05.319217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2264 sessionId:  describe result for acl check
2025-10-02T08:15:05.319244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:05.319251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:05.319252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:05.319257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534989188700806:12935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:05.319723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534989188700806:12935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:05.321763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534989188700806:12935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:05.324988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534989188700806:12935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:05.325002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534989188700806:12935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:05.325007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534989188700806:12935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:05.325015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:05.325521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:05.326830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:05.326844Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:05.326846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:05.326849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:05.326853Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2263 [1:7556534989188700790:12933]
2025-10-02T08:15:05.326862Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:05.326874Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:05.326876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.326878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.326879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.326892Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:05.326897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:05.326907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:05.326952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.326957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.326960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:05.326961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:05.327007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:05.327012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.327021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.327032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:05.327054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188700838:12935], now have 1 active actors on pipe
2025-10-02T08:15:05.327061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534989188700784:12933]
2025-10-02T08:15:05.327063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534989188700784:12933]
2025-10-02T08:15:05.327065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2263
2025-10-02T08:15:05.327069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:05.327075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534989648183291:2378], now have 1 active actors on pipe
2025-10-02T08:15:05.327079Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:05.327081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:05.327089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:05.327091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:05.327094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:05.327106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.327109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.327146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534989188700784:12933]
2025-10-02T08:15:05.327134Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2263
2025-10-02T08:15:05.327155Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:05.327157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:05.327167Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:05.327172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.327175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.327177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:05.327186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.327193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:05.327224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.327264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.327276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.327296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.327331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2264 partition: 0 MaxSeqNo: 17 sessionId: src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0
2025-10-02T08:15:05.327630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd50da54-58e349f-551c9663-af60ed62_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:05.330156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0] Write session: try to update token
2025-10-02T08:15:05.330170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:05.343245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId: src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:05.344178Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:05.344193Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:05.344195Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:05.344204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534989188700784:12933]
2025-10-02T08:15:05.344209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534989188700784:12933]
2025-10-02T08:15:05.344249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:05.344249Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:05.344255Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:05.344260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.344263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:05.344393Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:05.345697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:05.409380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534989188700853:12399]
2025-10-02T08:15:05.409499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2263, pipe: [1:7556534989188700853:12399]
2025-10-02T08:15:05.480387Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:05.480725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.480737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.480768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188700853:12399], now have 1 active actors on pipe
2025-10-02T08:15:05.480892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:05.480905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:05.480966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2264 reason: error at write: Disconnected sessionId: src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0
2025-10-02T08:15:05.480982Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:05.481003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:05.481125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2264 sessionId: src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0 is DEAD
2025-10-02T08:15:05.481261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:05.481268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0] Write session will restart in 0.006847s
2025-10-02T08:15:05.481289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0] Write session: Do CDS request
2025-10-02T08:15:05.481263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534989188700853:12399]
2025-10-02T08:15:05.481294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:05.488560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:05.489080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:05.489268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.489274Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:05.489285Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:05.489287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:05.489292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2265
2025-10-02T08:15:05.489295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:05.489345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:05.489396Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534989188701010:12940]
2025-10-02T08:15:05.489454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.489480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:05.489489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:05.489492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:05.489830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2265 sessionId:  describe result for acl check
2025-10-02T08:15:05.489856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:05.489861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:05.489863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:05.489867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534989188701015:12942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:05.489995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:05.490148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:05.490183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:05.490307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534989188701015:12942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:05.490457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:05.490502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.490509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.490511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.490512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.490512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.490517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.490526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.490530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.490533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.490537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.490543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.490550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.490556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.490562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.490568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.490573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.490577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.490582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.490586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.490591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.490614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:05.492090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534989188701015:12942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:05.496937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534989188701015:12942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:05.496954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534989188701015:12942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:05.496957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534989188701015:12942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:05.496965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:05.498661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:05.500286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:05.500306Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:05.500308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:05.500315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:05.500321Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2264 [1:7556534989188701010:12940]
2025-10-02T08:15:05.500333Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:05.500349Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:05.500352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.500355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.500357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.500372Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:05.500383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:05.500389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:05.500452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.500461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.500463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:05.500466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:05.500532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:05.500539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.500554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.500572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:05.500578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2264
2025-10-02T08:15:05.500594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188701059:12942], now have 1 active actors on pipe
2025-10-02T08:15:05.500597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534989648183298:2378], now have 1 active actors on pipe
2025-10-02T08:15:05.500602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.500605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.500620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534989188701004:12940]
2025-10-02T08:15:05.500627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534989188701004:12940]
2025-10-02T08:15:05.500638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:05.500643Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2264
2025-10-02T08:15:05.500654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:05.500663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:05.500666Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:05.500674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:05.500677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:05.500690Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:05.500696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.500699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.500702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:05.500710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.500718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:05.500748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534989188701004:12940]
2025-10-02T08:15:05.500762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:05.500768Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:05.500779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.500854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.500861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.500875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.500912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2265 partition: 0 MaxSeqNo: 17 sessionId: src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0
2025-10-02T08:15:05.501204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80eb5fe9-ec3f0aa9-de1c7e1f-a754a3fc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:05.503666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0] Write session: try to update token
2025-10-02T08:15:05.503683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:05.511936Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:05.511957Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:05.511967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534989188701004:12940]
2025-10-02T08:15:05.512009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:05.512015Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:05.512206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:05.512362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:05.512507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:05.512659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:05.512877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:05.512925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:05.516866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId: src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:05.519426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:05.519499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.519514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.519549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:05.519568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:05.519625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.519634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.519787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.519855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.519920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.519991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.520145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.520156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.520243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.520303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.520374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.520442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.520488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.520497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.520564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.520624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.520685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.520748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.520794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.520822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.520889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.520952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.521016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.521081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.521124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.521132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.521200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.521261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.521326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.521395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.521441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.521443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.521510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.521577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.521642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.521711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.521762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.521770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.521836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.521900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.521972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.522042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.522133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.522144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.522217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.522286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.522358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.522426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.522477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.522488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.522562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.522627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.522693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.522762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.522816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.522825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.522894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.522955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.523019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.523086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.523129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.523136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.523175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:05.523243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.523269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.523275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:05.523309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:05.523326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:05.523333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:05.523336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:05.523342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:05.523748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:05.523791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:05.523802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:05.523806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:05.523810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:05.523814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:05.524424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:05.524451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:05.524463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:05.524470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:05.524474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:05.524482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:05.524996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:05.525019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:05.525031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:05.525039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:05.525042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:05.526291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:05.526314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:05.526331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392905526
2025-10-02T08:15:05.526463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:05.526482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:05.526488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:05.526497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:05.526519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:05.526526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:05.527120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:05.527152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:05.527158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:05.527166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:05.527174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:05.527177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:05.527707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:05.527743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:05.527753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:05.527756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:05.527760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:05.527763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:05.528266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:05.528295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:05.528306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:05.529460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:05.529482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:05.529487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:05.529492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:05.529504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392905529
2025-10-02T08:15:05.529821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:05.529852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:05.529858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:05.529868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:05.529871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:05.529878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:05.530373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:05.530401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:05.530413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:05.530416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:05.530419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:05.530422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:05.530933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:05.530955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.531053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392905530
2025-10-02T08:15:05.532388Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:05.532419Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:05.532426Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:05.532435Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:05.534111Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:05.534127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:05.534129Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:05.534138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534989188701004:12940]
2025-10-02T08:15:05.534143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534989188701004:12940]
2025-10-02T08:15:05.534198Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:05.534201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:05.534207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.534209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:05.534223Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:05.534343Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:05.581619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534989188701109:12399]
2025-10-02T08:15:05.581681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2264, pipe: [1:7556534989188701109:12399]
2025-10-02T08:15:05.683210Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:05.683633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188701109:12399], now have 1 active actors on pipe
2025-10-02T08:15:05.683751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534989188701109:12399]
2025-10-02T08:15:05.683776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:05.683790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:05.683812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2265 reason: error at write: Disconnected sessionId: src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0
2025-10-02T08:15:05.683820Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:05.683876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:05.683979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2265 sessionId: src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0 is DEAD
2025-10-02T08:15:05.684082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:05.684093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0] Write session will restart in 0.007134s
2025-10-02T08:15:05.684119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0] Write session: Do CDS request
2025-10-02T08:15:05.684125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:05.690883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:05.691405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:05.691626Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:05.691645Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:05.691658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:05.691716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:05.691761Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534989188701276:12958]
2025-10-02T08:15:05.692266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.692391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:05.692400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:05.692406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2266
2025-10-02T08:15:05.692539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.692573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:05.692583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:05.692586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:05.692610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:05.692671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:05.692928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2266 sessionId:  describe result for acl check
2025-10-02T08:15:05.692959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:05.692965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:05.692966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:05.692971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534989188701287:12960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:05.693007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:05.693079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.693085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.693086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.693087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.693088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.693094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.693101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.693104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.693108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.693112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.693117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.693125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.693133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.693143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.693150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.693160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.693164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.693169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.693178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.693183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.693205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:05.693415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534989188701287:12960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:05.695144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534989188701287:12960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:05.699503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534989188701287:12960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:05.699519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534989188701287:12960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:05.699521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534989188701287:12960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:05.699552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:05.701170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:05.702704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:05.702721Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:05.702723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:05.702726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:05.702733Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2265 [1:7556534989188701276:12958]
2025-10-02T08:15:05.702742Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:05.702761Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:05.702769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.702772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.702778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.702794Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:05.702803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:05.702809Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:05.702864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.702870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.702873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:05.702875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:05.702937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:05.702945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.702956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.702970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:05.702990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188701325:12960], now have 1 active actors on pipe
2025-10-02T08:15:05.702993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2265
2025-10-02T08:15:05.702997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534989648183327:2378], now have 1 active actors on pipe
2025-10-02T08:15:05.703002Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534989188701270:12958]
2025-10-02T08:15:05.703004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534989188701270:12958]
2025-10-02T08:15:05.703016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:05.703031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.703036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:05.703038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.703039Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:05.703053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:05.703064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:05.703071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:05.703109Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a278471-20b538fc-2b1631b8-8254abcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:05.703120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.703123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.703072Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2265
2025-10-02T08:15:05.703125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:05.703133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.703141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:05.703150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534989188701270:12958]
2025-10-02T08:15:05.703154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:05.703186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.703202Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:05.703327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.703344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.703368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.703413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2266 partition: 0 MaxSeqNo: 17 sessionId: src_id|a278471-20b538fc-2b1631b8-8254abcc_0
2025-10-02T08:15:05.703734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d40bc1-a99f8131-34273c3b-936897fd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a278471-20b538fc-2b1631b8-8254abcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:05.706371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a278471-20b538fc-2b1631b8-8254abcc_0] Write session: try to update token
2025-10-02T08:15:05.706388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a278471-20b538fc-2b1631b8-8254abcc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:05.720391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId: src_id|a278471-20b538fc-2b1631b8-8254abcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:05.721368Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:05.721390Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:05.721392Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:05.721400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534989188701270:12958]
2025-10-02T08:15:05.721405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534989188701270:12958]
2025-10-02T08:15:05.721441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:05.721452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.721457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:05.721505Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:05.721534Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:05.721582Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:05.722950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:05.784177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534989188701355:12399]
2025-10-02T08:15:05.784305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2265, pipe: [1:7556534989188701355:12399]
2025-10-02T08:15:05.854277Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:05.854625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.854638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.854676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188701355:12399], now have 1 active actors on pipe
2025-10-02T08:15:05.854809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534989188701355:12399]
2025-10-02T08:15:05.854833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:05.854835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:05.854887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2266 reason: error at write: Disconnected sessionId: src_id|a278471-20b538fc-2b1631b8-8254abcc_0
2025-10-02T08:15:05.854923Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:05.854941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:05.855080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2266 sessionId: src_id|a278471-20b538fc-2b1631b8-8254abcc_0 is DEAD
2025-10-02T08:15:05.855187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a278471-20b538fc-2b1631b8-8254abcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:05.855197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a278471-20b538fc-2b1631b8-8254abcc_0] Write session will restart in 0.007658s
2025-10-02T08:15:05.855222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a278471-20b538fc-2b1631b8-8254abcc_0] Write session: Do CDS request
2025-10-02T08:15:05.855228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a278471-20b538fc-2b1631b8-8254abcc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:05.861904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:05.862641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:05.862807Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:05.862817Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:05.862825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:05.862867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:05.862905Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534989188701518:12965]
2025-10-02T08:15:05.863486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:05.863680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:05.863719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:05.863962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:05.863998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.863999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.864000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.864000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.864001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.864004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.864011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.864015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.864018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.864021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.864025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.864031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:05.864037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.864046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:05.864051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.864056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:05.864060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.864069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.864076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.864084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.864101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:05.864289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a278471-20b538fc-2b1631b8-8254abcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.864362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:05.864374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2267
2025-10-02T08:15:05.864489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:05.864515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:05.864525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:05.864528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:05.864899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2267 sessionId:  describe result for acl check
2025-10-02T08:15:05.864933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:05.864939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:05.864940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:05.864945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534989188701534:12967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:05.865398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534989188701534:12967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:05.867351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534989188701534:12967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:05.871128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534989188701534:12967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:05.871143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534989188701534:12967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:05.871146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534989188701534:12967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:05.871154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:05.871586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:05.873082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:05.873096Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:05.873099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:05.873101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:05.873106Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2266 [1:7556534989188701518:12965]
2025-10-02T08:15:05.873114Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:05.873126Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:05.873128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.873130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.873131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.873144Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:05.873153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:05.873158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:05.873198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.873203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.873206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:05.873208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:05.873308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:05.873315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.873327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:05.873334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2266
2025-10-02T08:15:05.873343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:05.873360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534989648183348:2378], now have 1 active actors on pipe
2025-10-02T08:15:05.873366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188701566:12967], now have 1 active actors on pipe
2025-10-02T08:15:05.873370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.873373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.873385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534989188701512:12965]
2025-10-02T08:15:05.873386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534989188701512:12965]
2025-10-02T08:15:05.873396Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:05.873411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:05.873412Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:05.873414Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:05.873427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:05.873429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:05.873401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2266
2025-10-02T08:15:05.873445Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:05.873455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.873458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.873460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:05.873468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.873480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:05.873512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534989188701512:12965]
2025-10-02T08:15:05.873522Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:05.873538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.873546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:05.873589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.873595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.873610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:05.873644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2267 partition: 0 MaxSeqNo: 17 sessionId: src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0
2025-10-02T08:15:05.873954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a278471-20b538fc-2b1631b8-8254abcc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:05.876513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0] Write session: try to update token
2025-10-02T08:15:05.876531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:05.883921Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:05.883941Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:05.883950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534989188701512:12965]
2025-10-02T08:15:05.883994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:05.883996Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:05.884166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:05.884326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:05.884467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:05.884608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:05.884784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:05.884839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:05.889946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId: src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:05.892395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:05.892448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.892457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.892483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:05.892503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:05.892546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:05.892564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:05.892751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.892839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.892902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.892970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.893310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.893321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.893389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.893453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.893518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.893589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.893632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.893639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.893706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.893768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.893829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.893899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.893943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.893951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.894013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.894075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.894138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.894200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.894343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.894351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.894417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.894478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.894545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.894613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.894659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.894666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.894733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.894793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.894860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.894924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.894970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.894976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.895055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.895121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.895188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.895253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.895298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.895304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.895369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.895430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.895495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.895564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.895612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.895622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.895688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.895749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.895812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.895874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.895918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.895925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.895992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:05.896054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:05.896116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:05.896191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:05.896239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:05.896247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:05.896291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:05.896356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:05.896378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:05.896384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:05.896414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:05.896429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:05.896436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:05.896438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:05.896441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:05.896863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:05.896886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:05.896896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:05.896900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:05.896902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:05.896905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:05.897377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:05.897400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:05.897406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:05.897409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:05.897412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:05.897415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:05.897957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:05.897981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:05.897990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:05.897993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:05.897996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:05.899077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:05.899094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:05.899101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392905898
2025-10-02T08:15:05.899198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:05.899208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:05.899211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:05.899213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:05.899217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:05.899223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:05.899598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:05.899615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:05.899618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:05.899620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:05.899622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:05.899625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:05.899997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:05.900013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:05.900018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:05.900024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:05.900026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:05.900029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:05.900478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:05.900496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:05.900500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:05.901450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:05.901465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:05.901469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:05.901472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:05.901479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392905901
2025-10-02T08:15:05.901728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:05.901743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:05.901751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:05.901752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:05.901756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:05.901758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:05.902132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:05.902148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:05.902155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:05.902157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:05.902160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:05.902165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:05.902557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:05.902573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:05.902667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392905902
2025-10-02T08:15:05.903303Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:05.903318Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:05.903322Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:05.903326Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:05.904824Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:05.904836Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:05.904837Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:05.904847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534989188701512:12965]
2025-10-02T08:15:05.904851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534989188701512:12965]
2025-10-02T08:15:05.904890Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:05.904894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:05.904897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:05.904899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:05.904901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:05.905014Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:05.955147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534989188701589:12399]
2025-10-02T08:15:05.955244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2266, pipe: [1:7556534989188701589:12399]
2025-10-02T08:15:06.037141Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:06.037451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534989188701589:12399], now have 1 active actors on pipe
2025-10-02T08:15:06.037571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:06.037578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:06.037598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2267 reason: error at write: Disconnected sessionId: src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0
2025-10-02T08:15:06.037712Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:06.037715Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:06.037755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2267 sessionId: src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0 is DEAD
2025-10-02T08:15:06.037914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:06.037924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0] Write session will restart in 0.009392s
2025-10-02T08:15:06.037901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534989188701589:12399]
2025-10-02T08:15:06.037946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0] Write session: Do CDS request
2025-10-02T08:15:06.037953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:06.044409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:06.045216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:06.045386Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:06.045394Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:06.045403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:06.045438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:06.045470Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534993483669045:12971]
2025-10-02T08:15:06.045935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:06.046094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:06.046121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:06.046396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:06.046433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.046439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.046441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.046441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.046442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.046447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.046456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.046459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.046463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.046466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.046471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.046477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.046482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.046487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.046491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.046496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.046499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.046505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.046509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.046514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.046531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:06.048234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.048317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:06.048332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2268
2025-10-02T08:15:06.048471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.048498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:06.048503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:06.048512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:06.048934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2268 sessionId:  describe result for acl check
2025-10-02T08:15:06.048977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:06.048979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:06.048980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:06.048986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534993483669061:12973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:06.049499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534993483669061:12973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:06.051691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534993483669061:12973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:06.054325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:06.056281Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2267
2025-10-02T08:15:06.055883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:06.055904Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:06.055910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:06.055914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:06.055920Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2267 [1:7556534993483669045:12971]
2025-10-02T08:15:06.055930Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:06.055945Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:06.055948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.055951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.055953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.055971Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:06.055976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:06.055983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:06.056041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.056043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.056046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:06.056049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:06.056115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:06.056117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.056132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.056145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:06.056163Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534993483669039:12971]
2025-10-02T08:15:06.056165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534993483669039:12971]
2025-10-02T08:15:06.056194Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:06.056207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534993943150651:2378], now have 1 active actors on pipe
2025-10-02T08:15:06.056208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:06.056212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:06.056216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:06.056231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:06.056234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:06.056265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534993483669039:12971]
2025-10-02T08:15:06.056271Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:06.056281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:06.061676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534993483669061:12973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:06.061694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534993483669061:12973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:06.061698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534993483669061:12973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:06.061706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:06.061915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2267
2025-10-02T08:15:06.061919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483669102:12973], now have 1 active actors on pipe
2025-10-02T08:15:06.061926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.061931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.061957Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d214741-44285e34-f3ee6822-74285a67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:06.061973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.061977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.061979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:06.061988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.062006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:06.062032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.062078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.062088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.062110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.062162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2268 partition: 0 MaxSeqNo: 17 sessionId: src_id|1d214741-44285e34-f3ee6822-74285a67_0
2025-10-02T08:15:06.062499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fa73f35-e0c81c40-7cf43df-6fce73bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1d214741-44285e34-f3ee6822-74285a67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:06.065203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d214741-44285e34-f3ee6822-74285a67_0] Write session: try to update token
2025-10-02T08:15:06.065220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d214741-44285e34-f3ee6822-74285a67_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:06.075655Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:06.075678Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:06.075680Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:06.075688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534993483669039:12971]
2025-10-02T08:15:06.075692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534993483669039:12971]
2025-10-02T08:15:06.075737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:06.075738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:06.075743Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:06.075748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.075751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:06.075883Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:06.079419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId: src_id|1d214741-44285e34-f3ee6822-74285a67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:06.081996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:06.137926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534993483669111:12399]
2025-10-02T08:15:06.138027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2267, pipe: [1:7556534993483669111:12399]
2025-10-02T08:15:06.225870Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:06.226178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.226193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.226231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483669111:12399], now have 1 active actors on pipe
2025-10-02T08:15:06.226347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534993483669111:12399]
2025-10-02T08:15:06.226367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:06.226369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:06.226417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2268 reason: error at write: Disconnected sessionId: src_id|1d214741-44285e34-f3ee6822-74285a67_0
2025-10-02T08:15:06.226465Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:06.226570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2268 sessionId: src_id|1d214741-44285e34-f3ee6822-74285a67_0 is DEAD
2025-10-02T08:15:06.226536Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:06.226770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d214741-44285e34-f3ee6822-74285a67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:06.226782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d214741-44285e34-f3ee6822-74285a67_0] Write session will restart in 0.007131s
2025-10-02T08:15:06.226809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d214741-44285e34-f3ee6822-74285a67_0] Write session: Do CDS request
2025-10-02T08:15:06.226815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d214741-44285e34-f3ee6822-74285a67_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:06.234471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:06.235268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:06.235303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d214741-44285e34-f3ee6822-74285a67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.235333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:06.235350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2269
2025-10-02T08:15:06.235427Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:06.235438Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:06.235446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:06.235491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:06.235506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.235525Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534993483669275:12978]
2025-10-02T08:15:06.235541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:06.235551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:06.235555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:06.235927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2269 sessionId:  describe result for acl check
2025-10-02T08:15:06.235959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:06.235966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:06.235968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:06.235973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534993483669279:12980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:06.236191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:06.236392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:06.236432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:06.236489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534993483669279:12980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:06.236735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:06.236779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.236784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.236785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.236786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.236787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.236792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.236818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.236822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.236826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.236830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.236836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.236843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.236849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.236854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.236861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.236866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.236875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.236881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.236887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.236893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.236913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:06.238707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534993483669279:12980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:06.243470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534993483669279:12980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:06.243487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534993483669279:12980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:06.243491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534993483669279:12980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:06.243499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:06.244971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:06.246503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:06.246508Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:06.246510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:06.246514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:06.246520Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2268 [1:7556534993483669275:12978]
2025-10-02T08:15:06.246531Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:06.246545Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:06.246548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.246551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.246553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.246570Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:06.246575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:06.246580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:06.246640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.246641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.246645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:06.246648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:06.246713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:06.246716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.246729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.246743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:06.246750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2268
2025-10-02T08:15:06.246759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483669323:12980], now have 1 active actors on pipe
2025-10-02T08:15:06.246763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534993943150660:2378], now have 1 active actors on pipe
2025-10-02T08:15:06.246768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534993483669268:12978]
2025-10-02T08:15:06.246770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534993483669268:12978]
2025-10-02T08:15:06.246782Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:06.246790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.246795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.246795Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:06.246798Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:06.246812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:06.246826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:06.246828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:06.246865Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:06.246870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.246877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.246879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:06.246889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.246898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:06.246905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534993483669268:12978]
2025-10-02T08:15:06.246916Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:06.246939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.246944Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:06.247263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.247270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.247290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.247321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2269 partition: 0 MaxSeqNo: 17 sessionId: src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0
2025-10-02T08:15:06.247654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d214741-44285e34-f3ee6822-74285a67_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:06.247179Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2268
2025-10-02T08:15:06.250228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0] Write session: try to update token
2025-10-02T08:15:06.250242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:06.264368Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:06.264387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:06.264388Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:06.264394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534993483669268:12978]
2025-10-02T08:15:06.264397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534993483669268:12978]
2025-10-02T08:15:06.264429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:06.264435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.264437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:06.264512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId: src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:06.264534Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:06.264539Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:06.264561Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:06.267251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:06.326380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534993483669337:12399]
2025-10-02T08:15:06.326507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2268, pipe: [1:7556534993483669337:12399]
2025-10-02T08:15:06.398817Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:06.399071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.399091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.399139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483669337:12399], now have 1 active actors on pipe
2025-10-02T08:15:06.399233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:06.399239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:06.399288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2269 reason: error at write: Disconnected sessionId: src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0
2025-10-02T08:15:06.399312Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:06.399385Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:06.399451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2269 sessionId: src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0 is DEAD
2025-10-02T08:15:06.399589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:06.399595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0] Write session will restart in 0.009024s
2025-10-02T08:15:06.399614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0] Write session: Do CDS request
2025-10-02T08:15:06.399621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:06.399621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534993483669337:12399]
2025-10-02T08:15:06.406818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:06.407326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:06.407493Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:06.407503Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:06.407512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:06.407555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:06.407591Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534993483669503:12984]
2025-10-02T08:15:06.408157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:06.408384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:06.408427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:06.408710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:06.408754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.408760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.408761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.408761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.408762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.408767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.408775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.408783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.408786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.408789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.408795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.408818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.408823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.408827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.408830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.408835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.408842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.408846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.408850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.408855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.408875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:06.409210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.409338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:06.409349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2270
2025-10-02T08:15:06.409449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.409476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:06.409486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:06.409489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:06.409874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2270 sessionId:  describe result for acl check
2025-10-02T08:15:06.409910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:06.409912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:06.409914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:06.409919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534993483669519:12986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:06.410377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534993483669519:12986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:06.412289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534993483669519:12986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:06.416098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534993483669519:12986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:06.416111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534993483669519:12986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:06.416114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534993483669519:12986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:06.416120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:06.416735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:06.418327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:06.418345Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:06.418348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:06.418352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:06.418358Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2269 [1:7556534993483669503:12984]
2025-10-02T08:15:06.418370Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:06.418385Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:06.418390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.418393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.418395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.418412Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:06.418422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:06.418429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:06.418484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.418492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.418494Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:06.418496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:06.418556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:06.418563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.418575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.418588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:06.418609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2269
2025-10-02T08:15:06.418610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483669550:12986], now have 1 active actors on pipe
2025-10-02T08:15:06.418617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534993483669497:12984]
2025-10-02T08:15:06.418619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534993483669497:12984]
2025-10-02T08:15:06.418631Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:06.418642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:06.418643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534993943150668:2378], now have 1 active actors on pipe
2025-10-02T08:15:06.418648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.418651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:06.418651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.418668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:06.418685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:06.418692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:06.418665Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2269
2025-10-02T08:15:06.418733Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:06.418744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.418752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.418755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:06.418767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.418779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:06.418796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534993483669497:12984]
2025-10-02T08:15:06.418810Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:06.418838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.418850Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:06.418919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.418927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.418940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.418975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2270 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0
2025-10-02T08:15:06.419279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d8e5a5-743eb5b4-1aac8d5a-3564f6aa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:06.421726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0] Write session: try to update token
2025-10-02T08:15:06.421742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:06.435019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId: src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:06.437426Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:06.437444Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:06.437446Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:06.437452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534993483669497:12984]
2025-10-02T08:15:06.437455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534993483669497:12984]
2025-10-02T08:15:06.437492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:06.437502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.437504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:06.437517Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:06.437523Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:06.437630Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:06.437785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:06.499925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534993483669567:12399]
2025-10-02T08:15:06.500062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2269, pipe: [1:7556534993483669567:12399]
2025-10-02T08:15:06.570398Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:06.570725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.570741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.570781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483669567:12399], now have 1 active actors on pipe
2025-10-02T08:15:06.570972Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:06.570995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:06.571273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:06.571329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0
2025-10-02T08:15:06.571491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2270 sessionId: src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0 is DEAD
2025-10-02T08:15:06.571650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534993483669567:12399]
2025-10-02T08:15:06.571905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:06.571913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0] Write session will restart in 0.005881s
2025-10-02T08:15:06.571930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0] Write session: Do CDS request
2025-10-02T08:15:06.571935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:06.578874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:06.579276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.579289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:06.579301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2271
2025-10-02T08:15:06.579443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.579469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:06.579477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:06.579479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:06.579658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:06.579815Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:06.579823Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:06.579831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:06.579871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:06.579983Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534993483669749:12997]
2025-10-02T08:15:06.580548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:06.580775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2271 sessionId:  describe result for acl check
2025-10-02T08:15:06.580821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:06.580826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:06.580827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:06.580831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534993483669756:12999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:06.580870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:06.580905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:06.581166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:06.581203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.581208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.581209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.581210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.581211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.581216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.581224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.581229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.581232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.581235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.581240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.581248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.581256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.581261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.581264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.581268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.581271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.581279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.581284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.581288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.581306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:06.581717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534993483669756:12999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:06.583583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534993483669756:12999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:06.588348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534993483669756:12999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:06.588364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534993483669756:12999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:06.588367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534993483669756:12999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:06.588374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:06.589454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:06.590945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:06.590959Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:06.590961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:06.590964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:06.590969Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2270 [1:7556534993483669749:12997]
2025-10-02T08:15:06.590981Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:06.590994Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:06.590998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.591001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.591002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.591016Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:06.591021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:06.591026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:06.591074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.591084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.591086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:06.591088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:06.591137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:06.591146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.591156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.591172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:06.591190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483669795:12999], now have 1 active actors on pipe
2025-10-02T08:15:06.591192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2270
2025-10-02T08:15:06.591197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534993943150674:2378], now have 1 active actors on pipe
2025-10-02T08:15:06.591204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534993483669741:12997]
2025-10-02T08:15:06.591205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534993483669741:12997]
2025-10-02T08:15:06.591211Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:06.591220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:06.591220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:06.591223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:06.591232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:06.591235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:06.591241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.591248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.591247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2270
2025-10-02T08:15:06.591282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534993483669741:12997]
2025-10-02T08:15:06.591289Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:06.591290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:06.591302Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:06.591312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.591315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.591317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:06.591324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.591334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:06.591373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.591423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.591433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.591450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.591479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2271 partition: 0 MaxSeqNo: 17 sessionId: src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0
2025-10-02T08:15:06.592107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ce3397-d3c148-b25e5b93-5bc84e0c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:06.594627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0] Write session: try to update token
2025-10-02T08:15:06.594641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:06.607686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId: src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:06.608184Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:06.608203Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:06.608205Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:06.608214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534993483669741:12997]
2025-10-02T08:15:06.608217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534993483669741:12997]
2025-10-02T08:15:06.608256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:06.608263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.608266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:06.608391Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:06.610330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:06.610405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:06.610411Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:06.671942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534993483669834:12399]
2025-10-02T08:15:06.672063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2270, pipe: [1:7556534993483669834:12399]
2025-10-02T08:15:06.756404Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:06.756898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.756911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.756952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483669834:12399], now have 1 active actors on pipe
2025-10-02T08:15:06.757133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534993483669834:12399]
2025-10-02T08:15:06.757163Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:06.757166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:06.757169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:06.757231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2271 reason: error at write: Disconnected sessionId: src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0
2025-10-02T08:15:06.757234Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:06.757393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2271 sessionId: src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0 is DEAD
2025-10-02T08:15:06.757543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:06.757553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0] Write session will restart in 0.009648s
2025-10-02T08:15:06.757578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0] Write session: Do CDS request
2025-10-02T08:15:06.757584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:06.765406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:06.766193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:06.766364Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:06.766372Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:06.766379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:06.766416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:06.766454Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534993483670007:13009]
2025-10-02T08:15:06.766960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:06.767158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:06.767199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:06.767405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:06.767433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.767438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.767439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.767439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.767440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.767443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.767449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.767451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.767453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.767455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.767458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.767462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.767466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.767468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.767472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.767475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.767477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.767479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.767481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.767484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.767494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:06.768293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.768354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:06.768366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2272
2025-10-02T08:15:06.768521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.768553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:06.768562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:06.768567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:06.768975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2272 sessionId:  describe result for acl check
2025-10-02T08:15:06.769010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:06.769016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:06.769017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:06.769023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534993483670023:13011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:06.769456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534993483670023:13011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:06.771788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534993483670023:13011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:06.774646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534993483670023:13011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:06.774660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534993483670023:13011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:06.774663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534993483670023:13011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:06.774672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:06.778887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:06.780377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:06.780395Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:06.780397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:06.780400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:06.780406Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2271 [1:7556534993483670007:13009]
2025-10-02T08:15:06.780415Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:06.780427Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:06.780431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.780434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.780436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.780451Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:06.780456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:06.780462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:06.780514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.780521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.780525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:06.780527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:06.780585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:06.780592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.780606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.780618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:06.780629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2271
2025-10-02T08:15:06.780633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483670054:13011], now have 1 active actors on pipe
2025-10-02T08:15:06.780636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534993943150715:2378], now have 1 active actors on pipe
2025-10-02T08:15:06.780641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534993483670001:13009]
2025-10-02T08:15:06.780643Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534993483670001:13009]
2025-10-02T08:15:06.780653Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:06.780663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:06.780663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.780667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.780670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:06.780684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:06.780696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:06.780703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:06.780739Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:06.780747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.780750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.780752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:06.780760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.780734Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2271
2025-10-02T08:15:06.780772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:06.780785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534993483670001:13009]
2025-10-02T08:15:06.780793Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:06.780821Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:06.780839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.780916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.780923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.780934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.780971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2272 partition: 0 MaxSeqNo: 17 sessionId: src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0
2025-10-02T08:15:06.781270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81035bb-75c3e71b-edfd6fd2-e909fd96_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:06.783755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0] Write session: try to update token
2025-10-02T08:15:06.783771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:06.795744Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:06.795763Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:06.795769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534993483670001:13009]
2025-10-02T08:15:06.795804Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:06.795816Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:06.795961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:06.796093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:06.796231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:06.796354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:06.796530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:06.796563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:06.797492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId: src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:06.799770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:06.799827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.799838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.799862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:06.799883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:06.799925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.799944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.800101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.800183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.800244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.800316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.800407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.800417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.800484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.800545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.800603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.800667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.800709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.800717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.800782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.800869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.800934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.800998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.801045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.801052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.801117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.801179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.801254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.801318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.801360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.801373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.801442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.801502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.801564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.801629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.801675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.801681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.801747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.801806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.801874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.801939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.802002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.802010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.802080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.802143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.802212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.802277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.802321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.802328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.802393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.802455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.802524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.802589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.802633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.802641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.802724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.802786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.802848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.802909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.802953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.802960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.803024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:06.803087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:06.803148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:06.803216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:06.803258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:06.803264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:06.803298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:06.803364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.803383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.803389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:06.803418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:06.803433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:06.803440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:06.803442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:06.803445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:06.803822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:06.803851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:06.803857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:06.803859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:06.803862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:06.803864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:06.804484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:06.804508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:06.804514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:06.804517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:06.804519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:06.804524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:06.805034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:06.805057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:06.805062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:06.805069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:06.805071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:06.807101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:06.807118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:06.807129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392906807
2025-10-02T08:15:06.807285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:06.807299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:06.807308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:06.807317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:06.807325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:06.807333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:06.807792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:06.807816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:06.807825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:06.807834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:06.807839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:06.807846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:06.808294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:06.808316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:06.808327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:06.808334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:06.808337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:06.808340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:06.808829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:06.808848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:06.808853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:06.809900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:06.809929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:06.809934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:06.809937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:06.809946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392906809
2025-10-02T08:15:06.810241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:06.810270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:06.810280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:06.810283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:06.810288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:06.810295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:06.810736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:06.810760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:06.810765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:06.810773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:06.810775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:06.810778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:06.811212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:06.811238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.811325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392906811
2025-10-02T08:15:06.812051Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:06.812074Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:06.812080Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:06.812086Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:06.813670Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:06.813684Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:06.813686Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:06.813696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534993483670001:13009]
2025-10-02T08:15:06.813699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534993483670001:13009]
2025-10-02T08:15:06.813749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:06.813757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.813758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:06.813881Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:06.813901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:06.813907Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:06.857316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534993483670090:12399]
2025-10-02T08:15:06.857446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2271, pipe: [1:7556534993483670090:12399]
2025-10-02T08:15:06.954364Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:06.954668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483670090:12399], now have 1 active actors on pipe
2025-10-02T08:15:06.954766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534993483670090:12399]
2025-10-02T08:15:06.954782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:06.954786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:06.954805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2272 reason: error at write: Disconnected sessionId: src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0
2025-10-02T08:15:06.954887Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:06.954874Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:06.954932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2272 sessionId: src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0 is DEAD
2025-10-02T08:15:06.955214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:06.955225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0] Write session will restart in 0.007050s
2025-10-02T08:15:06.955246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0] Write session: Do CDS request
2025-10-02T08:15:06.955253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:06.962498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:06.963169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:06.963315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.963356Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:06.963367Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:06.963368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:06.963376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:06.963381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2273
2025-10-02T08:15:06.963438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:06.963531Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534993483670267:13016]
2025-10-02T08:15:06.963546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:06.963576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:06.963585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:06.963591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:06.963958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2273 sessionId:  describe result for acl check
2025-10-02T08:15:06.963986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:06.963992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:06.963994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:06.963999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534993483670272:13018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:06.964190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:06.964379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:06.964424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:06.964471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534993483670272:13018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:06.964720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:06.964763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.964769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.964771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.964772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.964773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.964778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.964787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.964791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.964794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.964797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.964816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.964828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:06.964834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.964843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:06.964848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.964857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:06.964861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.964865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.964870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.964876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.964900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:06.966274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534993483670272:13018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:06.974389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534993483670272:13018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:06.974409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534993483670272:13018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:06.974415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534993483670272:13018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:06.974423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:06.978381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:06.979985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:06.979999Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:06.980001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:06.980004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:06.980009Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2272 [1:7556534993483670267:13016]
2025-10-02T08:15:06.980019Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:06.980031Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:06.980033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.980035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.980036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.980047Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:06.980050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:06.980056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:06.980100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.980106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.980108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:06.980109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:06.980156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:06.980161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:06.980180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:06.980187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:06.980199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534993483670312:13018], now have 1 active actors on pipe
2025-10-02T08:15:06.980207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534993483670261:13016]
2025-10-02T08:15:06.980208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534993483670261:13016]
2025-10-02T08:15:06.980213Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:06.980213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2272
2025-10-02T08:15:06.980218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534993943150724:2378], now have 1 active actors on pipe
2025-10-02T08:15:06.980224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:06.980225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:06.980228Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:06.980232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:06.980234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:06.980239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.980242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.980272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534993483670261:13016]
2025-10-02T08:15:06.980281Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:06.980290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:06.980294Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:06.980297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:06.980300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:06.980300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:06.980306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:06.980313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:06.980334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.980411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:06.980422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:06.980453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:06.980498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2273 partition: 0 MaxSeqNo: 17 sessionId: src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0
2025-10-02T08:15:06.980304Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2272
2025-10-02T08:15:06.980854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551530e-bf75a12f-bdd5ec82-3287cd2a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:06.983297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0] Write session: try to update token
2025-10-02T08:15:06.983313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:06.992151Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:06.992181Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:06.992189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534993483670261:13016]
2025-10-02T08:15:06.992226Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:06.992228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:06.992383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:06.992508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:06.992631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:06.992768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:06.992960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:06.992997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:07.002339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId: src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:07.004826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:07.004962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.004974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.005007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:07.005026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:07.005154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.005163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.005315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.005374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.005436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.005500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.005548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.005557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.005618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.005676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.005738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.005804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.005849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.005856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.005937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.005998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.006049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.006101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.006138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.006141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.006205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.006260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.006317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.006376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.006415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.006418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.006482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.006542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.006602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.006665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.006705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.006707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.006771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.006824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.006884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.006941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.006979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.006981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.007044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.007098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.007159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.007218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.007257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.007259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.007328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.007379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.007433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.007493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.007531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.007534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.007596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.007648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.007703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.007757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.007798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.007801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.007866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.007918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.007971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.008028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.008073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.008076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.008112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:07.008183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.008201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.008204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:07.008233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:07.008245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:07.008249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:07.008251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:07.008255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:07.008615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:07.008629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:07.008636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:07.008639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:07.008645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:07.008649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:07.009681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:07.009719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:07.009725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:07.009729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:07.009732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:07.009735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:07.010240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:07.010263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:07.010270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:07.010277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:07.010281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:07.011434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:07.011455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:07.011466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392907011
2025-10-02T08:15:07.011603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:07.011611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:07.011615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:07.011620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:07.011623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:07.011626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:07.012073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:07.012088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:07.012093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:07.012097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:07.012100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:07.012103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:07.012567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:07.012578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:07.012584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:07.012587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:07.012591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:07.012595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:07.013148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:07.013172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:07.013177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:07.014205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:07.014224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:07.014228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:07.014234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:07.014242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392907013
2025-10-02T08:15:07.014523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:07.014543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:07.014548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:07.014551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:07.014555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:07.014558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:07.015032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:07.015050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:07.015054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:07.015058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:07.015061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:07.015065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:07.015497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:07.015518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.015619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392907014
2025-10-02T08:15:07.016329Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:07.016348Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:07.016357Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:07.016370Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:07.017948Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:07.017964Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:07.017966Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:07.017975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534993483670261:13016]
2025-10-02T08:15:07.017978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534993483670261:13016]
2025-10-02T08:15:07.018038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:07.018048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.018050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:07.018111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:07.018128Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:07.018174Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:07.054914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534997778637628:12399]
2025-10-02T08:15:07.055088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2272, pipe: [1:7556534997778637628:12399]
2025-10-02T08:15:07.163765Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:07.164107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778637628:12399], now have 1 active actors on pipe
2025-10-02T08:15:07.164315Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:07.164396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:07.164877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:07.165217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:07.164913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0
2025-10-02T08:15:07.165097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2273 sessionId: src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0 is DEAD
2025-10-02T08:15:07.165241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0] Write session will restart in 0.007491s
2025-10-02T08:15:07.165265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0] Write session: Do CDS request
2025-10-02T08:15:07.165271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:07.165277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534997778637628:12399]
2025-10-02T08:15:07.174267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.174345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:07.174364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2274
2025-10-02T08:15:07.174498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.174529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:07.174538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:07.174541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:07.174767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:07.174854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2274 sessionId:  describe result for acl check
2025-10-02T08:15:07.174883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:07.174888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:07.174891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:07.174896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534997778637804:13025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:07.175272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534997778637804:13025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:07.176066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:07.176251Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:07.176262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:07.176273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:07.176329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:07.176368Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534997778637813:13023]
2025-10-02T08:15:07.177030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:07.177429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:07.177482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:07.177662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534997778637804:13025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:07.177807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:07.177858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.177865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.177866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.177867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.177868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.177874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.177884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.177889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.177893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.177897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.177903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.177910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.177917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.177927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.177932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.177938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.177943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.177948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.177953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.177961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.177983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:07.186964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534997778637804:13025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:07.186985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534997778637804:13025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:07.186988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534997778637804:13025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:07.186995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:07.187354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:07.189184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:07.189204Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:07.189206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:07.189210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:07.189217Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2273 [1:7556534997778637813:13023]
2025-10-02T08:15:07.189229Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:07.189245Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:07.189248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.189252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.189253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.189271Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:07.189276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:07.189283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:07.189348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.189359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.189362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:07.189365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:07.189438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:07.189446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.189459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2273
2025-10-02T08:15:07.189462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.189473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:07.189493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778637852:13025], now have 1 active actors on pipe
2025-10-02T08:15:07.189506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534998238118026:2378], now have 1 active actors on pipe
2025-10-02T08:15:07.189511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.189517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.189532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534997778637800:13023]
2025-10-02T08:15:07.189534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534997778637800:13023]
2025-10-02T08:15:07.189546Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:07.189560Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:07.189564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:07.189542Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2273
2025-10-02T08:15:07.189567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:07.189576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:07.189579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:07.189594Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50c55360-414d9851-9529d1ec-65940fc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:07.189600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.189603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.189604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:07.189614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.189624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:07.189661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534997778637800:13023]
2025-10-02T08:15:07.189675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:07.189690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:07.189692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.189802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.189807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.189819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.189854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2274 partition: 0 MaxSeqNo: 17 sessionId: src_id|50c55360-414d9851-9529d1ec-65940fc9_0
2025-10-02T08:15:07.190155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce22f1e8-d352d7b9-26ff102c-c8b655b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|50c55360-414d9851-9529d1ec-65940fc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:07.192963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c55360-414d9851-9529d1ec-65940fc9_0] Write session: try to update token
2025-10-02T08:15:07.192976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c55360-414d9851-9529d1ec-65940fc9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:07.206019Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:07.206034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:07.206041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534997778637800:13023]
2025-10-02T08:15:07.206076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:07.206079Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:07.206236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:07.206360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:07.206485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:07.206555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId: src_id|50c55360-414d9851-9529d1ec-65940fc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:07.206614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:07.206796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:07.206828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:07.208969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:07.209050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.209067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.209103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:07.209130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:07.209180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.209192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.209352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.209411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.209467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.209524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.209601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.209605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.209668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.209721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.209776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.209838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.209876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.209879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.209942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.209994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.210049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.210101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.210141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.210144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.210210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.210265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.210322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.210377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.210493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.210505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.210566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.210626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.210686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.210750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.210794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.210801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.210864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.210918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.210978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.211041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.211078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.211081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.211146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.211201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.211260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.211316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.211355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.211358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.211421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.211474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.211532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.211586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.211626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.211629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.211692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.211745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.211801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.211856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.211896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.211898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.211958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.212013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.212068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.212123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.212162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.212164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.212212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:07.212274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.212295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.212297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:07.212328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:07.212339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:07.212342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:07.212349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:07.212352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:07.212713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:07.212728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:07.212736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:07.212740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:07.212743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:07.212746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:07.213448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:07.213472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:07.213478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:07.213481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:07.213484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:07.213488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:07.213984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:07.214004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:07.214010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:07.214013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:07.214016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:07.215193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:07.215210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:07.215222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392907215
2025-10-02T08:15:07.215352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:07.215369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:07.215374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:07.215376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:07.215381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:07.215384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:07.215824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:07.215843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:07.215849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:07.215852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:07.215856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:07.215859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:07.216284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:07.216303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:07.216313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:07.216316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:07.216320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:07.216323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:07.216761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:07.216780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:07.216784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:07.217841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:07.217858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:07.217862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:07.217866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:07.217874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392907217
2025-10-02T08:15:07.218157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:07.218168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:07.218173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:07.218178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:07.218184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:07.218187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:07.218618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:07.218630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:07.218635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:07.218639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:07.218644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:07.218648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:07.219086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:07.219096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.219196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392907218
2025-10-02T08:15:07.219885Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:07.219896Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:07.219903Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:07.219910Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:07.222709Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:07.222725Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:07.222728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:07.222737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534997778637800:13023]
2025-10-02T08:15:07.222741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534997778637800:13023]
2025-10-02T08:15:07.222780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:07.222792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.222794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:07.222796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:07.222802Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:07.222937Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:07.265300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534997778637875:12399]
2025-10-02T08:15:07.265586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2273, pipe: [1:7556534997778637875:12399]
2025-10-02T08:15:07.360489Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:07.360882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778637875:12399], now have 1 active actors on pipe
2025-10-02T08:15:07.361004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534997778637875:12399]
2025-10-02T08:15:07.361032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:07.361034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:07.361060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2274 reason: error at write: Disconnected sessionId: src_id|50c55360-414d9851-9529d1ec-65940fc9_0
2025-10-02T08:15:07.361126Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:07.361185Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:07.361281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2274 sessionId: src_id|50c55360-414d9851-9529d1ec-65940fc9_0 is DEAD
2025-10-02T08:15:07.361391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c55360-414d9851-9529d1ec-65940fc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:07.361401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c55360-414d9851-9529d1ec-65940fc9_0] Write session will restart in 0.008338s
2025-10-02T08:15:07.361425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c55360-414d9851-9529d1ec-65940fc9_0] Write session: Do CDS request
2025-10-02T08:15:07.361431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c55360-414d9851-9529d1ec-65940fc9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:07.370115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:07.372319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c55360-414d9851-9529d1ec-65940fc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.372345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:07.372358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2275
2025-10-02T08:15:07.372560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.372593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:07.372602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:07.372605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:07.373049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2275 sessionId:  describe result for acl check
2025-10-02T08:15:07.373081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:07.373086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:07.373088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:07.373094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534997778638051:13031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:07.373574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534997778638051:13031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:07.374754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:07.374958Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:07.374962Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:07.374971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:07.375019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:07.375047Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534997778638063:13029]
2025-10-02T08:15:07.375680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:07.375828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:07.375862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:07.376157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:07.376208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.376209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.376211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.376212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.376213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.376218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.376229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.376233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.376237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.376242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.376246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.376254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.376259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.376266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.376271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.376279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.376284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.376290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.376295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.376301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.376320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:07.377742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534997778638051:13031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:07.383977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534997778638051:13031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:07.383989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534997778638051:13031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:07.383993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534997778638051:13031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:07.384001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:07.384505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:07.386194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:07.386216Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:07.386219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:07.386223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:07.386231Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2274 [1:7556534997778638063:13029]
2025-10-02T08:15:07.386243Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:07.386260Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:07.386266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.386274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.386276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.386292Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:07.386301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:07.386308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:07.386372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.386379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.386382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:07.386384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:07.386465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:07.386474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.386487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.386499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:07.386516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534997778638044:13029]
2025-10-02T08:15:07.386521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534997778638044:13029]
2025-10-02T08:15:07.386534Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:07.386551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:07.386566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:07.386567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:07.386569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:07.386569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:07.386600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534997778638044:13029]
2025-10-02T08:15:07.386606Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:07.386625Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:07.386631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778638098:13031], now have 1 active actors on pipe
2025-10-02T08:15:07.386650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2274
2025-10-02T08:15:07.386861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534998238118035:2378], now have 1 active actors on pipe
2025-10-02T08:15:07.386872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.386879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.386907Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:07.386919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.386922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.386928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:07.386937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.386946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:07.386965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.387015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.387021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.387033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.387063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2275 partition: 0 MaxSeqNo: 17 sessionId: src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0
2025-10-02T08:15:07.387445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c55360-414d9851-9529d1ec-65940fc9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:07.387187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2274
2025-10-02T08:15:07.390110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0] Write session: try to update token
2025-10-02T08:15:07.390126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:07.398922Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:07.398939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:07.398947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556534997778638044:13029]
2025-10-02T08:15:07.398989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:07.398996Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:07.399486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:07.399961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:07.400100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:07.400255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:07.400440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:07.400476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:07.403849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId: src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:07.406574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:07.406644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.406660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.406694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:07.406717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:07.406759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.406772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.406946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.407014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.407082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.407165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.407213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.407220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.407284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.407338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.407396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.407455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.407503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.407510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.407577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.407633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.407694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.407757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.407927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.407933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.407992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.408048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.408105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.408162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.408221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.408229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.408295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.408348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.408404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.408461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.408503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.408509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.408570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.408624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.408680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.408746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.408794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.408816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.408883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.408934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.408993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.409056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.409105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.409110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.409171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.409236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.409296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.409351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.409390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.409397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.409457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.409518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.409576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.409629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.409669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.409674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.409738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:07.409800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:07.409865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:07.409927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:07.409971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:07.409979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:07.410011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:07.410061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.410076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.410082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:07.410108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:07.410121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:07.410128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:07.410130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:07.410132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:07.410497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:07.410518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:07.410524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:07.410526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:07.410528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:07.410530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:07.410987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:07.411005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:07.411009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:07.411012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:07.411014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:07.411016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:07.411607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:07.411634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:07.411640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:07.411643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:07.411647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:07.413781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:07.413798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:07.413810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392907413
2025-10-02T08:15:07.413915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:07.413926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:07.413929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:07.413931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:07.413934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:07.413937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:07.414351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:07.414369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:07.414376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:07.414378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:07.414380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:07.414382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:07.414791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:07.414810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:07.414820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:07.414826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:07.414828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:07.414830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:07.415225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:07.415245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:07.415252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:07.416262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:07.416276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:07.416280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:07.416283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:07.416289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392907415
2025-10-02T08:15:07.416543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:07.416560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:07.416566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:07.416569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:07.416571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:07.416573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:07.416993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:07.417013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:07.417018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:07.417021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:07.417024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:07.417026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:07.417442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:07.417459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.417563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392907417
2025-10-02T08:15:07.421064Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:07.421081Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:07.421085Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:07.421089Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:07.422634Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:07.422647Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:07.422649Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:07.422663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534997778638044:13029]
2025-10-02T08:15:07.422667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534997778638044:13029]
2025-10-02T08:15:07.422725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:07.422727Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:07.422733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:07.422737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.422739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:07.422872Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:07.460952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534997778638124:12399]
2025-10-02T08:15:07.461112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2274, pipe: [1:7556534997778638124:12399]
2025-10-02T08:15:07.556754Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:07.557137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778638124:12399], now have 1 active actors on pipe
2025-10-02T08:15:07.557254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:07.557260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:07.557285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2275 reason: error at write: Disconnected sessionId: src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0
2025-10-02T08:15:07.557390Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:07.557397Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:07.557464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2275 sessionId: src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0 is DEAD
2025-10-02T08:15:07.557554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:07.557562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0] Write session will restart in 0.008829s
2025-10-02T08:15:07.557586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0] Write session: Do CDS request
2025-10-02T08:15:07.557591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:07.557618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534997778638124:12399]
2025-10-02T08:15:07.565112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:07.565826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:07.566018Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:07.566027Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:07.566037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:07.566086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:07.566147Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534997778638300:13036]
2025-10-02T08:15:07.566780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:07.567003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:07.567044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:07.567271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:07.567302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.567305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.567309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.567310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.567310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.567311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.567314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.567320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.567323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.567325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.567327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.567331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.567335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.567339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.567344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.567348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.567353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.567357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.567361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.567365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.567384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:07.567385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.567396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2276
2025-10-02T08:15:07.567403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:07.567526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.567561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:07.567565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:07.567576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:07.567902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2276 sessionId:  describe result for acl check
2025-10-02T08:15:07.567934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:07.567940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:07.567941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:07.567946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534997778638316:13038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:07.568348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534997778638316:13038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:07.570452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534997778638316:13038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:07.574912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534997778638316:13038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:07.574925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534997778638316:13038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:07.574930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534997778638316:13038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:07.574936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:07.575531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:07.577206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:07.577221Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:07.577224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:07.577228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:07.577234Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2275 [1:7556534997778638300:13036]
2025-10-02T08:15:07.577247Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:07.577263Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:07.577267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.577270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.577271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.577289Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:07.577299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:07.577305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:07.577367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.577374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.577378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:07.577380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:07.577450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:07.577457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.577469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.577480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:07.577492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2275
2025-10-02T08:15:07.577494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778638349:13038], now have 1 active actors on pipe
2025-10-02T08:15:07.577496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534998238118042:2378], now have 1 active actors on pipe
2025-10-02T08:15:07.577501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.577503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.577516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534997778638294:13036]
2025-10-02T08:15:07.577518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534997778638294:13036]
2025-10-02T08:15:07.577528Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:07.577541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:07.577541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:07.577544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:07.577553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:07.577555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:07.577567Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e9e257c-d5a210dc-572768a2-600951e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:07.577571Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2275
2025-10-02T08:15:07.577572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.577574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.577575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:07.577581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.577589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:07.577621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534997778638294:13036]
2025-10-02T08:15:07.577631Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:07.577636Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:07.577644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.577692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.577697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.577708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.577739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2276 partition: 0 MaxSeqNo: 17 sessionId: src_id|9e9e257c-d5a210dc-572768a2-600951e1_0
2025-10-02T08:15:07.578053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de62a70-f83b0107-632f2a0d-382e1d2d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9e9e257c-d5a210dc-572768a2-600951e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:07.580578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9e257c-d5a210dc-572768a2-600951e1_0] Write session: try to update token
2025-10-02T08:15:07.580591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9e257c-d5a210dc-572768a2-600951e1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:07.593741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId: src_id|9e9e257c-d5a210dc-572768a2-600951e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:07.594965Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:07.594980Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:07.594982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:07.594990Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534997778638294:13036]
2025-10-02T08:15:07.594994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534997778638294:13036]
2025-10-02T08:15:07.595044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:07.595054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.595053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:07.595057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:07.595059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:07.595196Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:07.596308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:07.657563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534997778638393:12399]
2025-10-02T08:15:07.657676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2275, pipe: [1:7556534997778638393:12399]
2025-10-02T08:15:07.723980Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:07.724225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.724240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.724274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778638393:12399], now have 1 active actors on pipe
2025-10-02T08:15:07.724377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534997778638393:12399]
2025-10-02T08:15:07.724396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:07.724398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:07.724447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2276 reason: error at write: Disconnected sessionId: src_id|9e9e257c-d5a210dc-572768a2-600951e1_0
2025-10-02T08:15:07.724473Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:07.724510Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:07.724596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2276 sessionId: src_id|9e9e257c-d5a210dc-572768a2-600951e1_0 is DEAD
2025-10-02T08:15:07.724721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9e257c-d5a210dc-572768a2-600951e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:07.724728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9e257c-d5a210dc-572768a2-600951e1_0] Write session will restart in 0.008412s
2025-10-02T08:15:07.724744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9e257c-d5a210dc-572768a2-600951e1_0] Write session: Do CDS request
2025-10-02T08:15:07.724749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9e257c-d5a210dc-572768a2-600951e1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:07.731829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:07.732662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:07.732887Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:07.732897Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:07.732909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:07.732966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:07.733005Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534997778638581:13054]
2025-10-02T08:15:07.733626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:07.733807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:07.733850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:07.734130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:07.734193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.734200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.734201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.734202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.734203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.734207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.734216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.734220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.734224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.734227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.734233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.734240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.734246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.734251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.734255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.734260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.734263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.734268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.734272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.734276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.734303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9e257c-d5a210dc-572768a2-600951e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.734298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:07.734331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:07.734340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2277
2025-10-02T08:15:07.734516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.734548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:07.734557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:07.734560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:07.734990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2277 sessionId:  describe result for acl check
2025-10-02T08:15:07.735021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:07.735026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:07.735027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:07.735032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534997778638597:13056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:07.735503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534997778638597:13056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:07.737210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534997778638597:13056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:07.741480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534997778638597:13056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:07.741498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534997778638597:13056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:07.741501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534997778638597:13056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:07.741510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:07.741960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:07.743352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:07.743367Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:07.743369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:07.743372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:07.743377Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2276 [1:7556534997778638581:13054]
2025-10-02T08:15:07.743385Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:07.743398Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:07.743402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.743405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.743406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.743417Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:07.743420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:07.743424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:07.743469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.743477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.743479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:07.743481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:07.743537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:07.743543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.743555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.743568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:07.743590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534998238118083:2378], now have 1 active actors on pipe
2025-10-02T08:15:07.743601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534997778638575:13054]
2025-10-02T08:15:07.743603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534997778638575:13054]
2025-10-02T08:15:07.743609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2276
2025-10-02T08:15:07.743610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:07.743618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778638629:13056], now have 1 active actors on pipe
2025-10-02T08:15:07.743621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:07.743624Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:07.743626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:07.743638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:07.743641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:07.743646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.743650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.743690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534997778638575:13054]
2025-10-02T08:15:07.743695Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:07.743715Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:07.743721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.743724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.743726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:07.743735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.743738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:07.743748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:07.743687Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2276
2025-10-02T08:15:07.743782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.743831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.743841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.743863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.743902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2277 partition: 0 MaxSeqNo: 17 sessionId: src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0
2025-10-02T08:15:07.744238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e9e257c-d5a210dc-572768a2-600951e1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:07.746737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0] Write session: try to update token
2025-10-02T08:15:07.746752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:07.759649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId: src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:07.760513Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:07.760530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:07.760533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:07.760540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534997778638575:13054]
2025-10-02T08:15:07.760545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534997778638575:13054]
2025-10-02T08:15:07.760580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:07.760588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.760589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:07.760591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:07.760597Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:07.760713Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:07.762309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:07.824457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534997778638658:12399]
2025-10-02T08:15:07.824573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2276, pipe: [1:7556534997778638658:12399]
2025-10-02T08:15:07.888254Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:07.888526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.888540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.888578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778638658:12399], now have 1 active actors on pipe
2025-10-02T08:15:07.888692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:07.888705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:07.888764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2277 reason: error at write: Disconnected sessionId: src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0
2025-10-02T08:15:07.888841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:07.888936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2277 sessionId: src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0 is DEAD
2025-10-02T08:15:07.889071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:07.889081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0] Write session will restart in 0.006638s
2025-10-02T08:15:07.889100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0] Write session: Do CDS request
2025-10-02T08:15:07.889106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:07.889111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534997778638658:12399]
2025-10-02T08:15:07.889751Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:07.896649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:07.897229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.897298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:07.897309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2278
2025-10-02T08:15:07.897420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:07.897431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:07.897448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:07.897457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:07.897460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:07.897594Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:07.897606Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:07.897616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:07.897661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:07.897699Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556534997778638841:13061]
2025-10-02T08:15:07.897794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2278 sessionId:  describe result for acl check
2025-10-02T08:15:07.897820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:07.897825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:07.897826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:07.897831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556534997778638844:13063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:07.898238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556534997778638844:13063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:07.898337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:07.898502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:07.898541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:07.898827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:07.898877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.898883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.898884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.898885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.898886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.898890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.898901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.898912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.898915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.898919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.898924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.898931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:07.898940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.898945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:07.898953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.898962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:07.898971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.898976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.898984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.898993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.899015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:07.899864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556534997778638844:13063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:07.905565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556534997778638844:13063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:07.905576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556534997778638844:13063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:07.905580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556534997778638844:13063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:07.905587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:07.906507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:07.907927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:07.907941Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:07.907946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:07.907949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:07.907956Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2277 [1:7556534997778638841:13061]
2025-10-02T08:15:07.907965Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:07.907980Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:07.907982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.907985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.907986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.908002Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:07.908007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:07.908013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:07.908078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.908086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.908089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:07.908091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:07.908149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:07.908155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.908182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:07.908196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:07.908205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2277
2025-10-02T08:15:07.908212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778638887:13063], now have 1 active actors on pipe
2025-10-02T08:15:07.908215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556534998238118091:2378], now have 1 active actors on pipe
2025-10-02T08:15:07.908221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556534997778638833:13061]
2025-10-02T08:15:07.908223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556534997778638833:13061]
2025-10-02T08:15:07.908228Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:07.908241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:07.908241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:07.908244Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:07.908259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:07.908261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:07.908267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.908275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.908309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556534997778638833:13061]
2025-10-02T08:15:07.908321Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:07.908303Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2277
2025-10-02T08:15:07.908334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:07.908339Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:07.908345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:07.908349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:07.908351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:07.908360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:07.908369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:07.908411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.908454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:07.908460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:07.908471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:07.908502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2278 partition: 0 MaxSeqNo: 17 sessionId: src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0
2025-10-02T08:15:07.908798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5db69f1e-b2df3d6b-4ff69045-af0c265a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:07.911246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0] Write session: try to update token
2025-10-02T08:15:07.911261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:07.929734Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:07.929750Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:07.929753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:07.929761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556534997778638833:13061]
2025-10-02T08:15:07.929766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556534997778638833:13061]
2025-10-02T08:15:07.929808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:07.929812Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:07.929814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:07.929816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:07.929821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:07.929953Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:07.932973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId: src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:07.935492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:07.989322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556534997778638902:12399]
2025-10-02T08:15:07.989481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2277, pipe: [1:7556534997778638902:12399]
2025-10-02T08:15:08.070497Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:08.070884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.070899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.070941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556534997778638902:12399], now have 1 active actors on pipe
2025-10-02T08:15:08.071090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556534997778638902:12399]
2025-10-02T08:15:08.071111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:08.071117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:08.071171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2278 reason: error at write: Disconnected sessionId: src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0
2025-10-02T08:15:08.071195Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:08.071230Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:08.071302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2278 sessionId: src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0 is DEAD
2025-10-02T08:15:08.071421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:08.071429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0] Write session will restart in 0.005692s
2025-10-02T08:15:08.071450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0] Write session: Do CDS request
2025-10-02T08:15:08.071455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:08.078211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.078306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:08.078318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2279
2025-10-02T08:15:08.078416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.078442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:08.078447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:08.078449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:08.078556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:08.078807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2279 sessionId:  describe result for acl check
2025-10-02T08:15:08.078836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:08.078842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:08.078843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:08.078848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535002073606384:13070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:08.079254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:08.079327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535002073606384:13070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:08.079380Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:08.079389Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:08.079398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:08.079430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:08.079460Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535002073606388:13068]
2025-10-02T08:15:08.079879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:08.080068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:08.080127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:08.080434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:08.080491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.080497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.080499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.080500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.080501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.080506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.080514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.080518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.080521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.080525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.080529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.080537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.080543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.080547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.080551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.080556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.080560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.080564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.080568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.080572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.080589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:08.081151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535002073606384:13070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:08.087406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535002073606384:13070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:08.087423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535002073606384:13070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:08.087426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535002073606384:13070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:08.087436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:08.088394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:08.090112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:08.090128Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:08.090130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:08.090133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:08.090140Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2278 [1:7556535002073606388:13068]
2025-10-02T08:15:08.090152Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:08.090168Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:08.090171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.090174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.090176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.090192Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:08.090202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:08.090211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:08.090271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.090279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.090282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:08.090284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:08.090351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:08.090358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.090371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.090389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:08.090400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2278
2025-10-02T08:15:08.090408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073606432:13070], now have 1 active actors on pipe
2025-10-02T08:15:08.090411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535002533085393:2378], now have 1 active actors on pipe
2025-10-02T08:15:08.090418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535002073606379:13068]
2025-10-02T08:15:08.090419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535002073606379:13068]
2025-10-02T08:15:08.090431Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:08.090446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.090448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:08.090452Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:08.090454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.090473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:08.090491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:08.090497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:08.090478Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2278
2025-10-02T08:15:08.090538Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:08.090549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.090553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.090560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:08.090569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.090582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:08.090594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535002073606379:13068]
2025-10-02T08:15:08.090608Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:08.090612Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:08.090635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.090710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.090719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.090733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.090771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2279 partition: 0 MaxSeqNo: 17 sessionId: src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0
2025-10-02T08:15:08.091091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4642f52-c8f2fda2-aae8e369-8fd2c69b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:08.093747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0] Write session: try to update token
2025-10-02T08:15:08.093764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:08.107085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId: src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:08.108096Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:08.108108Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:08.108109Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:08.108116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535002073606379:13068]
2025-10-02T08:15:08.108120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535002073606379:13068]
2025-10-02T08:15:08.108152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:08.108160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.108160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:08.108162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:08.108174Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:08.108302Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:08.109728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:08.171104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535002073606446:12399]
2025-10-02T08:15:08.171254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2278, pipe: [1:7556535002073606446:12399]
2025-10-02T08:15:08.250109Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:08.250441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.250458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.250502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073606446:12399], now have 1 active actors on pipe
2025-10-02T08:15:08.250619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535002073606446:12399]
2025-10-02T08:15:08.250640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:08.250645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:08.250706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2279 reason: error at write: Disconnected sessionId: src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0
2025-10-02T08:15:08.250724Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:08.250746Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:08.250861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2279 sessionId: src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0 is DEAD
2025-10-02T08:15:08.250966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:08.250974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0] Write session will restart in 0.007989s
2025-10-02T08:15:08.250996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0] Write session: Do CDS request
2025-10-02T08:15:08.251002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:08.257503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:08.258258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:08.258418Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:08.258427Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:08.258435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:08.258475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:08.258516Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535002073606632:13074]
2025-10-02T08:15:08.259102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:08.259303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:08.259346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:08.259645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:08.259691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.259697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.259713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.259715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.259716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.259721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.259732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.259736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.259740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.259744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.259749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.259761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.259772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.259777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.259786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.259792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.259797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.259802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.259811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.259816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.259840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:08.260284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.260380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:08.260389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2280
2025-10-02T08:15:08.260487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.260515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:08.260524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:08.260527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:08.260949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2280 sessionId:  describe result for acl check
2025-10-02T08:15:08.260981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:08.260985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:08.260987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:08.260992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535002073606648:13076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:08.261444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535002073606648:13076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:08.263693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535002073606648:13076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:08.266990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535002073606648:13076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:08.267001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535002073606648:13076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:08.267003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535002073606648:13076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:08.267015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:08.267497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:08.269000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:08.269014Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:08.269016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:08.269020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:08.269025Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2279 [1:7556535002073606632:13074]
2025-10-02T08:15:08.269035Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:08.269052Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:08.269058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.269061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.269064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.269079Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:08.269088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:08.269095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:08.269153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.269160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.269163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:08.269165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:08.269226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:08.269233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.269242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2279
2025-10-02T08:15:08.269246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.269258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:08.269280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073606679:13076], now have 1 active actors on pipe
2025-10-02T08:15:08.269288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535002533085401:2378], now have 1 active actors on pipe
2025-10-02T08:15:08.269292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.269296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.269311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535002073606626:13074]
2025-10-02T08:15:08.269317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535002073606626:13074]
2025-10-02T08:15:08.269324Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:08.269334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:08.269334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:08.269337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:08.269351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:08.269353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:08.269320Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2279
2025-10-02T08:15:08.269367Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13608d81-428c07cb-ab9450cf-53c4249b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:08.269377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.269380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.269382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:08.269391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.269402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:08.269439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535002073606626:13074]
2025-10-02T08:15:08.269449Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:08.269457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:08.269463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.269511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.269522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.269533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.269565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2280 partition: 0 MaxSeqNo: 17 sessionId: src_id|13608d81-428c07cb-ab9450cf-53c4249b_0
2025-10-02T08:15:08.269866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca4c8f7-66f0b1a6-a6e8517b-2a61d975_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|13608d81-428c07cb-ab9450cf-53c4249b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:08.272143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13608d81-428c07cb-ab9450cf-53c4249b_0] Write session: try to update token
2025-10-02T08:15:08.272155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13608d81-428c07cb-ab9450cf-53c4249b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:08.286050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId: src_id|13608d81-428c07cb-ab9450cf-53c4249b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:08.286269Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:08.286283Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:08.286286Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:08.286294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535002073606626:13074]
2025-10-02T08:15:08.286298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535002073606626:13074]
2025-10-02T08:15:08.286340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:08.286352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.286354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:08.286353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:08.286359Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:08.286490Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:08.288240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:08.350800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535002073606694:12399]
2025-10-02T08:15:08.350909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2279, pipe: [1:7556535002073606694:12399]
2025-10-02T08:15:08.435182Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:08.435523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.435538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.435577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073606694:12399], now have 1 active actors on pipe
2025-10-02T08:15:08.435729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:08.435741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:08.435825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2280 reason: error at write: Disconnected sessionId: src_id|13608d81-428c07cb-ab9450cf-53c4249b_0
2025-10-02T08:15:08.435847Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:08.436014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2280 sessionId: src_id|13608d81-428c07cb-ab9450cf-53c4249b_0 is DEAD
2025-10-02T08:15:08.436162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13608d81-428c07cb-ab9450cf-53c4249b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:08.436180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13608d81-428c07cb-ab9450cf-53c4249b_0] Write session will restart in 0.006196s
2025-10-02T08:15:08.436155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535002073606694:12399]
2025-10-02T08:15:08.436204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13608d81-428c07cb-ab9450cf-53c4249b_0] Write session: Do CDS request
2025-10-02T08:15:08.436213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13608d81-428c07cb-ab9450cf-53c4249b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:08.436356Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:08.443300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13608d81-428c07cb-ab9450cf-53c4249b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.443384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:08.443403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2281
2025-10-02T08:15:08.443510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.443539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:08.443545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:08.443548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:08.443918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2281 sessionId:  describe result for acl check
2025-10-02T08:15:08.443951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:08.443953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:08.443954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:08.443959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535002073606876:13082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:08.444449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:08.444472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535002073606876:13082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:08.445601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:08.445782Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:08.445791Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:08.445801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:08.445851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:08.445888Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535002073606904:13080]
2025-10-02T08:15:08.446484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535002073606876:13082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:08.446517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:08.446688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:08.446735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:08.447045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:08.447087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.447092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.447093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.447094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.447095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.447100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.447110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.447114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.447118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.447121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.447126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.447133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.447143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.447152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.447156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.447161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.447165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.447170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.447174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.447179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.447200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:08.452157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535002073606876:13082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:08.452181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535002073606876:13082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:08.452184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535002073606876:13082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:08.452194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:08.455303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:08.457052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:08.457069Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:08.457072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:08.457075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:08.457082Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2280 [1:7556535002073606904:13080]
2025-10-02T08:15:08.457095Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:08.457113Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:08.457116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.457119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.457121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.457139Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:08.457149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:08.457158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:08.457233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.457240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.457243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:08.457246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:08.457312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:08.457319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.457335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.457353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:08.457376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073606932:13082], now have 1 active actors on pipe
2025-10-02T08:15:08.457384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2280
2025-10-02T08:15:08.457390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535002073606880:13080]
2025-10-02T08:15:08.457392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535002073606880:13080]
2025-10-02T08:15:08.457404Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:08.457414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535002533085408:2378], now have 1 active actors on pipe
2025-10-02T08:15:08.457418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:08.457421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.457422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:08.457425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.457440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:08.457455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:08.457458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:08.457502Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:08.457478Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2280
2025-10-02T08:15:08.457514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.457518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.457520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:08.457528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.457537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:08.457544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535002073606880:13080]
2025-10-02T08:15:08.457554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:08.457562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:08.457587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.457703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.457711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.457726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.457766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2281 partition: 0 MaxSeqNo: 17 sessionId: src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0
2025-10-02T08:15:08.458064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13608d81-428c07cb-ab9450cf-53c4249b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:08.460642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0] Write session: try to update token
2025-10-02T08:15:08.460656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:08.474383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId: src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:08.474441Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:08.474456Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:08.474460Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:08.474471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535002073606880:13080]
2025-10-02T08:15:08.474480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535002073606880:13080]
2025-10-02T08:15:08.474524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:08.474532Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:08.474536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.474538Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:08.474538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:08.474686Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:08.477008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:08.536158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535002073606946:12399]
2025-10-02T08:15:08.536301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2280, pipe: [1:7556535002073606946:12399]
2025-10-02T08:15:08.617551Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:08.617926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.617941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.617981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073606946:12399], now have 1 active actors on pipe
2025-10-02T08:15:08.618096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:08.618109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:08.618169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2281 reason: error at write: Disconnected sessionId: src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0
2025-10-02T08:15:08.618222Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:08.618254Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:08.618329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2281 sessionId: src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0 is DEAD
2025-10-02T08:15:08.618464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:08.618472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0] Write session will restart in 0.008864s
2025-10-02T08:15:08.618494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0] Write session: Do CDS request
2025-10-02T08:15:08.618499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:08.618492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535002073606946:12399]
2025-10-02T08:15:08.628304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.628143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:08.628343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:08.628348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2282
2025-10-02T08:15:08.628979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.629019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:08.629029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:08.629032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:08.629196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:08.629387Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:08.629396Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:08.629405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:08.629445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2282 sessionId:  describe result for acl check
2025-10-02T08:15:08.629450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:08.629474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:08.629480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:08.629481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:08.629482Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535002073607138:13087]
2025-10-02T08:15:08.629487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535002073607140:13089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:08.629961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535002073607140:13089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:08.630102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:08.630300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:08.630336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:08.630620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:08.630679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.630683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.630684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.630685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.630687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.630692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.630700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.630704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.630708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.630711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.630716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.630723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.630729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.630734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.630738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.630742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.630747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.630752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.630757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.630762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.630780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:08.632887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535002073607140:13089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:08.638700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535002073607140:13089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:08.638720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535002073607140:13089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:08.638723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535002073607140:13089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:08.638732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:08.639117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:08.640657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:08.640671Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:08.640673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:08.640676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:08.640682Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2281 [1:7556535002073607138:13087]
2025-10-02T08:15:08.640694Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:08.640710Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:08.640711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.640713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.640715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.640726Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:08.640730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:08.640737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:08.640787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.640793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.640795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:08.640797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:08.640871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:08.640877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.640887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.640894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:08.640902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2281
2025-10-02T08:15:08.640907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073607183:13089], now have 1 active actors on pipe
2025-10-02T08:15:08.640912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.640915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.640925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535002533085415:2378], now have 1 active actors on pipe
2025-10-02T08:15:08.640933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535002073607130:13087]
2025-10-02T08:15:08.640934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535002073607130:13087]
2025-10-02T08:15:08.640943Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:08.640951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:08.640959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:08.640962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:08.640962Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:08.640963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:08.640974Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:08.640978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.640981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.640982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:08.640988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.640997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:08.640981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2281
2025-10-02T08:15:08.641023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535002073607130:13087]
2025-10-02T08:15:08.641032Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:08.641038Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:08.641045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.641090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.641096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.641106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.641134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2282 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0
2025-10-02T08:15:08.641415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2257bf0f-fb7f4ba1-11199aaf-ab3f36ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:08.643942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0] Write session: try to update token
2025-10-02T08:15:08.643961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:08.653607Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:08.653625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:08.653634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535002073607130:13087]
2025-10-02T08:15:08.653672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:08.653699Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:08.653839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:08.653983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:08.654120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:08.654286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:08.654530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:08.654568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:08.657266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId: src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:08.659719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:08.659776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.659786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.659810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:08.659821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:08.659865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.659870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.659999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.660083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.660163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.660230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.660267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.660275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.660335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.660386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.660437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.660500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.660551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.660561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.660643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.660711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.660764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.660837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.660878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.660884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.660952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.661019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.661079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.661132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.661169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.661174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.661231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.661283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.661336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.661393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.661435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.661440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.661497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.661548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.661602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.661656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.661696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.661700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.661757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.661811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.661866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.661922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.661960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.661964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.662018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.662081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.662156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.662221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.662264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.662267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.662331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.662383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.662447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.662508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.662551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.662559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.662618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:08.662675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:08.662735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:08.662795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:08.662839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:08.662846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:08.662878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:08.662938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.662964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.662970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:08.662999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:08.663015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:08.663022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:08.663025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:08.663028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:08.663392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:08.663413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:08.663418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:08.663420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:08.663423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:08.663427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:08.663868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:08.663885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:08.663889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:08.663892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:08.663893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:08.663895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:08.664290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:08.664305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:08.664308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:08.664310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:08.664312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:08.665379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:08.665392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:08.665401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392908664
2025-10-02T08:15:08.665521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:08.665530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:08.665534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:08.665536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:08.665539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:08.665540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:08.666216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:08.666240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:08.666246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:08.666250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:08.666252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:08.666255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:08.666708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:08.666728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:08.666735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:08.666738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:08.666741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:08.666744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:08.667155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:08.667179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:08.667190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:08.668107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:08.668121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:08.668124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:08.668127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:08.668133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392908664
2025-10-02T08:15:08.668389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:08.668406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:08.668410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:08.668415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:08.668417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:08.668419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:08.668828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:08.668843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:08.668847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:08.668849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:08.668851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:08.668853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:08.669236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:08.669250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.669331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392908669
2025-10-02T08:15:08.669969Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:08.669984Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:08.669988Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:08.669995Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:08.671429Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:08.671439Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:08.671440Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:08.671446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535002073607130:13087]
2025-10-02T08:15:08.671450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535002073607130:13087]
2025-10-02T08:15:08.671486Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:08.671488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:08.671491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.671492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:08.671495Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:08.671603Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:08.718429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535002073607244:12399]
2025-10-02T08:15:08.718549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2281, pipe: [1:7556535002073607244:12399]
2025-10-02T08:15:08.797780Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:08.798045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073607244:12399], now have 1 active actors on pipe
2025-10-02T08:15:08.798165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535002073607244:12399]
2025-10-02T08:15:08.798181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:08.798183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:08.798199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2282 reason: error at write: Disconnected sessionId: src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0
2025-10-02T08:15:08.798288Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:08.798270Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:08.798359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2282 sessionId: src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0 is DEAD
2025-10-02T08:15:08.798463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:08.798472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0] Write session will restart in 0.008732s
2025-10-02T08:15:08.798489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0] Write session: Do CDS request
2025-10-02T08:15:08.798494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:08.806540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:08.807526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:08.807701Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:08.807710Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:08.807719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:08.807763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:08.807805Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535002073607450:13106]
2025-10-02T08:15:08.808265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.808351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:08.808363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2283
2025-10-02T08:15:08.808449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:08.808458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.808478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:08.808487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:08.808490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:08.808627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:08.808671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:08.808841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2283 sessionId:  describe result for acl check
2025-10-02T08:15:08.808869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:08.808870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:08.808872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:08.808876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535002073607461:13108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:08.808970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:08.809032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.809038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.809039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.809040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.809040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.809045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.809052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.809056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.809059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.809062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.809067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.809074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.809079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.809084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.809092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.809096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.809100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.809104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.809112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.809116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.809133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:08.809307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535002073607461:13108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:08.811423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535002073607461:13108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:08.816549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535002073607461:13108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:08.816563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535002073607461:13108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:08.816566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535002073607461:13108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:08.816575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:08.817265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:08.818988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:08.819009Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:08.819011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:08.819014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:08.819020Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2282 [1:7556535002073607450:13106]
2025-10-02T08:15:08.819032Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:08.819047Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:08.819051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.819057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.819064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.819081Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:08.819086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:08.819093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:08.819163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.819171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.819174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:08.819176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:08.819240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:08.819247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.819260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.819277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:08.819298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535002073607443:13106]
2025-10-02T08:15:08.819307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535002073607443:13106]
2025-10-02T08:15:08.819309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2282
2025-10-02T08:15:08.819314Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:08.819323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:08.819326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:08.819329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073607498:13108], now have 1 active actors on pipe
2025-10-02T08:15:08.819332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535002533085457:2378], now have 1 active actors on pipe
2025-10-02T08:15:08.819340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:08.819354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:08.819357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:08.819363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.819368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.819407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535002073607443:13106]
2025-10-02T08:15:08.819417Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:08.819400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2282
2025-10-02T08:15:08.819432Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:08.819434Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:08.819440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.819444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.819446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:08.819456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.819465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:08.819515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.819562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.819572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.819592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.819626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2283 partition: 0 MaxSeqNo: 17 sessionId: src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0
2025-10-02T08:15:08.819940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f02bb8-b710e6a0-3d1fe1d9-c0e8df9c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:08.822613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0] Write session: try to update token
2025-10-02T08:15:08.822630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:08.837267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId: src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:08.838059Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:08.838076Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:08.838078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:08.838087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535002073607443:13106]
2025-10-02T08:15:08.838091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535002073607443:13106]
2025-10-02T08:15:08.838132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:08.838133Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:08.838138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:08.838143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.838145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:08.838285Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:08.839790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:08.898112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535002073607513:12399]
2025-10-02T08:15:08.898203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2282, pipe: [1:7556535002073607513:12399]
2025-10-02T08:15:08.971550Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:08.972113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.972128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.972159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073607513:12399], now have 1 active actors on pipe
2025-10-02T08:15:08.972300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535002073607513:12399]
2025-10-02T08:15:08.972326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:08.972346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:08.972411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:08.972375Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:08.972413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2283 reason: error at write: Disconnected sessionId: src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0
2025-10-02T08:15:08.972581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2283 sessionId: src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0 is DEAD
2025-10-02T08:15:08.972717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:08.972727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0] Write session will restart in 0.008655s
2025-10-02T08:15:08.972752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0] Write session: Do CDS request
2025-10-02T08:15:08.972757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:08.980182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:08.981170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:08.981348Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:08.981361Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:08.981371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:08.981422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:08.981461Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535002073607709:13112]
2025-10-02T08:15:08.982104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:08.982293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.982342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:08.982371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:08.982382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2284
2025-10-02T08:15:08.982405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:08.982479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:08.982506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:08.982517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:08.982521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:08.982750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:08.982810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.982818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.982819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.982820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.982821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.982826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.982835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.982838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.982842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.982845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.982847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2284 sessionId:  describe result for acl check
2025-10-02T08:15:08.982852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.982860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:08.982867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.982872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:08.982873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:08.982874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:08.982876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.982876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:08.982880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535002073607721:13114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:08.982881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:08.982886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.982891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.982895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.982900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.982918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:08.983345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535002073607721:13114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:08.985564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535002073607721:13114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:08.990243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535002073607721:13114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:08.990260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535002073607721:13114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:08.990263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535002073607721:13114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:08.990271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:08.990821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:08.992519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:08.992533Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:08.992536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:08.992539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:08.992546Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2283 [1:7556535002073607709:13112]
2025-10-02T08:15:08.992556Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:08.992571Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:08.992578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.992581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.992583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.992598Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:08.992608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:08.992619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:08.992686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.992692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.992697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:08.992700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:08.992765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:08.992774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:08.992786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:08.992815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:08.992819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2283
2025-10-02T08:15:08.992833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535002073607754:13114], now have 1 active actors on pipe
2025-10-02T08:15:08.992841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535002533085464:2378], now have 1 active actors on pipe
2025-10-02T08:15:08.992846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.992851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.992873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535002073607703:13112]
2025-10-02T08:15:08.992883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535002073607703:13112]
2025-10-02T08:15:08.992890Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:08.992901Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:08.992887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2283
2025-10-02T08:15:08.992903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:08.992905Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:08.992915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:08.992918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:08.992932Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:08.992938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:08.992941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:08.992942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:08.992950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:08.992958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:08.992993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535002073607703:13112]
2025-10-02T08:15:08.993010Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:08.993021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.993034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:08.993075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:08.993082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:08.993095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:08.993128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2284 partition: 0 MaxSeqNo: 17 sessionId: src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0
2025-10-02T08:15:08.993450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d26f2a4-95f7cd91-a2f1a593-a16718fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:08.996059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0] Write session: try to update token
2025-10-02T08:15:08.996075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:09.009850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId: src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:09.010031Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:09.010046Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:09.010048Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:09.010059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535002073607703:13112]
2025-10-02T08:15:09.010063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535002073607703:13112]
2025-10-02T08:15:09.010108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:09.010115Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:09.010120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.010121Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:09.010122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:09.010277Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:09.012415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:09.072716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535006368575066:12399]
2025-10-02T08:15:09.072865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2283, pipe: [1:7556535006368575066:12399]
2025-10-02T08:15:09.158444Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:09.158824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.158841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.158888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368575066:12399], now have 1 active actors on pipe
2025-10-02T08:15:09.158994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:09.159002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:09.159061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2284 reason: error at write: Disconnected sessionId: src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0
2025-10-02T08:15:09.159117Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:09.159109Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:09.159227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2284 sessionId: src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0 is DEAD
2025-10-02T08:15:09.159350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:09.159358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0] Write session will restart in 0.009165s
2025-10-02T08:15:09.159381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0] Write session: Do CDS request
2025-10-02T08:15:09.159387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:09.159393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535006368575066:12399]
2025-10-02T08:15:09.167859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:09.168988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:09.169201Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:09.169209Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:09.169219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:09.169269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:09.169280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.169307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:09.169312Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535006368575263:13119]
2025-10-02T08:15:09.169317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2285
2025-10-02T08:15:09.169507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.169541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:09.169551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:09.169555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:09.169830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2285 sessionId:  describe result for acl check
2025-10-02T08:15:09.169852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:09.169853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:09.169855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:09.169858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535006368575268:13121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:09.169883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:09.170118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:09.170183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:09.170249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535006368575268:13121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:09.170496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:09.170549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.170554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.170556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.170557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.170558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.170563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.170573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.170577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.170581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.170585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.170590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.170597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.170607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.170611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.170617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.170621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.170625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.170630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.170640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.170644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.170662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:09.172429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535006368575268:13121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:09.178034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535006368575268:13121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:09.178049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535006368575268:13121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:09.178054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535006368575268:13121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:09.178062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:09.178530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:09.180153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:09.180180Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:09.180182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:09.180186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:09.180193Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2284 [1:7556535006368575263:13119]
2025-10-02T08:15:09.180204Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:09.180223Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:09.180231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.180235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.180237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.180255Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:09.180266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:09.180277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:09.180346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.180353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.180356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:09.180358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:09.180425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:09.180436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.180448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.180460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:09.180478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368575310:13121], now have 1 active actors on pipe
2025-10-02T08:15:09.180482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2284
2025-10-02T08:15:09.180484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535006368575257:13119]
2025-10-02T08:15:09.180486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535006368575257:13119]
2025-10-02T08:15:09.180493Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:09.180502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535006828052767:2378], now have 1 active actors on pipe
2025-10-02T08:15:09.180506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:09.180511Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:09.180514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:09.180528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:09.180535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:09.180541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.180549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.180587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535006368575257:13119]
2025-10-02T08:15:09.180595Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:09.180600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:09.180553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2284
2025-10-02T08:15:09.180609Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:09.180620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.180628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.180630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:09.180639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.180653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:09.180699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.180772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.180782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.180822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.180863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2285 partition: 0 MaxSeqNo: 17 sessionId: src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0
2025-10-02T08:15:09.181163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa242e54-b26b1f8c-212f1c48-f4c41e2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:09.183812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0] Write session: try to update token
2025-10-02T08:15:09.183825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:09.197540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId: src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:09.198210Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:09.198223Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:09.198225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:09.198231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535006368575257:13119]
2025-10-02T08:15:09.198235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535006368575257:13119]
2025-10-02T08:15:09.198268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:09.198273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.198275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:09.198279Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:09.198285Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:09.198400Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:09.200052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:09.259596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535006368575325:12399]
2025-10-02T08:15:09.259733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2284, pipe: [1:7556535006368575325:12399]
2025-10-02T08:15:09.327884Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:09.328138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.328150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.328196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368575325:12399], now have 1 active actors on pipe
2025-10-02T08:15:09.328319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:09.328328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:09.328394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2285 reason: error at write: Disconnected sessionId: src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0
2025-10-02T08:15:09.328440Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:09.328444Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:09.328557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2285 sessionId: src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0 is DEAD
2025-10-02T08:15:09.328708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:09.328718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0] Write session will restart in 0.007446s
2025-10-02T08:15:09.328720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535006368575325:12399]
2025-10-02T08:15:09.328741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0] Write session: Do CDS request
2025-10-02T08:15:09.328747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:09.335683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:09.336594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:09.336740Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:09.336749Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:09.336757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:09.336792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:09.336845Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535006368575522:13125]
2025-10-02T08:15:09.337223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.337269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:09.337282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2286
2025-10-02T08:15:09.337402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:09.337425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.337450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:09.337458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:09.337461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:09.337590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:09.337646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:09.337800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2286 sessionId:  describe result for acl check
2025-10-02T08:15:09.337830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:09.337835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:09.337836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:09.337841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535006368575533:13127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:09.338010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:09.338080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.338088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.338089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.338090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.338091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.338096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.338105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.338108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.338111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.338115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.338121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.338137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.338152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.338166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.338179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.338192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.338204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.338218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.338231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.338239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.338260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:09.338281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535006368575533:13127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:09.340489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535006368575533:13127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:09.345423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535006368575533:13127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:09.345437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535006368575533:13127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:09.345442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535006368575533:13127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:09.345451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:09.345821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:09.347326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:09.347339Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:09.347341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:09.347344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:09.347348Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2285 [1:7556535006368575522:13125]
2025-10-02T08:15:09.347359Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:09.347371Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:09.347374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.347377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.347378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.347388Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:09.347395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:09.347399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:09.347439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.347444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.347446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:09.347448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:09.347502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:09.347509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.347519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.347532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:09.347553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368575570:13127], now have 1 active actors on pipe
2025-10-02T08:15:09.347559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535006828052775:2378], now have 1 active actors on pipe
2025-10-02T08:15:09.347560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2285
2025-10-02T08:15:09.347566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535006368575516:13125]
2025-10-02T08:15:09.347567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535006368575516:13125]
2025-10-02T08:15:09.347573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:09.347583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:09.347585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:09.347591Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:09.347596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:09.347598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:09.347604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.347608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.347588Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2285
2025-10-02T08:15:09.347641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535006368575516:13125]
2025-10-02T08:15:09.347658Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:09.347663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:09.347670Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:09.347681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.347684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.347687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:09.347694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.347704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:09.347738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.347776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.347783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.347795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.347830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2286 partition: 0 MaxSeqNo: 17 sessionId: src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0
2025-10-02T08:15:09.348070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14e6c89-61b45d22-1ef7646e-8160512b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:09.350507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0] Write session: try to update token
2025-10-02T08:15:09.350522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:09.364915Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:09.364933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:09.364935Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:09.364944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535006368575516:13125]
2025-10-02T08:15:09.364949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535006368575516:13125]
2025-10-02T08:15:09.364996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:09.365007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.365006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:09.365009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:09.365011Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:09.365083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId: src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:09.365158Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:09.367728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:09.429369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535006368575585:12399]
2025-10-02T08:15:09.429474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2285, pipe: [1:7556535006368575585:12399]
2025-10-02T08:15:09.499853Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:09.500104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.500116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.500149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368575585:12399], now have 1 active actors on pipe
2025-10-02T08:15:09.500249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:09.500254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:09.500297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2286 reason: error at write: Disconnected sessionId: src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0
2025-10-02T08:15:09.500572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:09.500583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0] Write session will restart in 0.005462s
2025-10-02T08:15:09.500607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0] Write session: Do CDS request
2025-10-02T08:15:09.500614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:09.500445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2286 sessionId: src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0 is DEAD
2025-10-02T08:15:09.500609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535006368575585:12399]
2025-10-02T08:15:09.500723Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:09.500419Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:09.507278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.507329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:09.507343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2287
2025-10-02T08:15:09.507473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.507504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:09.507519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:09.507527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:09.507874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2287 sessionId:  describe result for acl check
2025-10-02T08:15:09.507901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:09.507906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:09.507908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:09.507913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535006368575774:13133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:09.508374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535006368575774:13133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:09.508740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:09.509798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:09.509954Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:09.509961Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:09.509968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:09.510008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:09.510041Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535006368575808:13132]
2025-10-02T08:15:09.510301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535006368575774:13133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:09.510452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:09.510645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:09.510696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:09.510923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:09.510961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.510965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.510966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.510966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.510967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.510970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.510976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.510978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.510980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.510982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.510986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.510990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.510994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.511000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.511003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.511006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.511010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.511015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.511019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.511023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.511046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:09.515737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535006368575774:13133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:09.515750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535006368575774:13133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:09.515754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535006368575774:13133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:09.515761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:09.519128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:09.520584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:09.520601Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:09.520603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:09.520606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:09.520611Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2286 [1:7556535006368575808:13132]
2025-10-02T08:15:09.520619Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:09.520632Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:09.520633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.520636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.520638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.520651Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:09.520654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:09.520659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:09.520708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.520714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.520718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:09.520719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:09.520768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:09.520773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.520781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.520787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:09.520824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535006368575787:13132]
2025-10-02T08:15:09.520835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535006368575787:13132]
2025-10-02T08:15:09.520841Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:09.520853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:09.520864Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:09.520870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:09.520875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2286
2025-10-02T08:15:09.520880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368575835:13133], now have 1 active actors on pipe
2025-10-02T08:15:09.520884Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:09.520887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:09.520907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535006368575787:13132]
2025-10-02T08:15:09.520914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:09.520917Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:09.520919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535006828052781:2378], now have 1 active actors on pipe
2025-10-02T08:15:09.520923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.520926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.520960Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:09.520968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.520971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.520972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:09.520978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.520985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:09.520997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.520979Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2286
2025-10-02T08:15:09.521042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.521048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.521063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.521102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2287 partition: 0 MaxSeqNo: 17 sessionId: src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0
2025-10-02T08:15:09.521401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bb41fb9-e7b62139-224e5d04-c5050aa8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:09.523793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0] Write session: try to update token
2025-10-02T08:15:09.523805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:09.536786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId: src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:09.538335Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:09.538348Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:09.538350Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:09.538357Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535006368575787:13132]
2025-10-02T08:15:09.538360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535006368575787:13132]
2025-10-02T08:15:09.538394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:09.538397Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:09.538399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.538400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:09.538402Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:09.538526Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:09.539200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:09.597494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535006368575852:12399]
2025-10-02T08:15:09.597634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2286, pipe: [1:7556535006368575852:12399]
2025-10-02T08:15:09.675970Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:09.676513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.676526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.676557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368575852:12399], now have 1 active actors on pipe
2025-10-02T08:15:09.676615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535006368575852:12399]
2025-10-02T08:15:09.676629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:09.676634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:09.676672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2287 reason: error at write: Disconnected sessionId: src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0
2025-10-02T08:15:09.676743Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:09.676790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:09.676978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:09.676989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0] Write session will restart in 0.007048s
2025-10-02T08:15:09.677011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0] Write session: Do CDS request
2025-10-02T08:15:09.677022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:09.676826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2287 sessionId: src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0 is DEAD
2025-10-02T08:15:09.684917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:09.685184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.685265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:09.685275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2288
2025-10-02T08:15:09.685362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.685383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:09.685389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:09.685391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:09.685632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2288 sessionId:  describe result for acl check
2025-10-02T08:15:09.685654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:09.685658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:09.685659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:09.685663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535006368576075:13148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:09.685949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535006368576075:13148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:09.686175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:09.686299Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:09.686307Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:09.686313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:09.686342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:09.686371Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535006368576082:13140]
2025-10-02T08:15:09.686756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:09.686931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:09.686962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:09.687149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:09.687176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.687180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.687181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.687182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.687183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.687187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.687197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.687201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.687204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.687208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.687213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.687218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.687221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.687224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.687226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.687228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.687230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.687233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.687236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.687238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.687249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:09.688669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535006368576075:13148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:09.695255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:09.696755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:09.696773Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:09.696775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:09.696778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:09.696783Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2287 [1:7556535006368576082:13140]
2025-10-02T08:15:09.696791Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:09.696828Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:09.696831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.696833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.696835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.696847Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:09.696850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:09.696855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:09.696916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.696923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.696925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:09.696926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:09.696989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:09.696996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.697008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.697024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:09.697043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535006368576059:13140]
2025-10-02T08:15:09.697049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535006368576059:13140]
2025-10-02T08:15:09.697057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:09.697066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:09.697069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:09.697074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535006828052787:2378], now have 1 active actors on pipe
2025-10-02T08:15:09.697087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:09.697103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:09.697109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:09.697142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535006368576059:13140]
2025-10-02T08:15:09.697154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:09.697163Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:09.697185Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2287
2025-10-02T08:15:09.697498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535006368576075:13148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:09.697514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535006368576075:13148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:09.697517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535006368576075:13148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:09.697524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:09.697853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2287
2025-10-02T08:15:09.697863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368576127:13148], now have 1 active actors on pipe
2025-10-02T08:15:09.697867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.697872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.697894Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:09.697905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.697912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.697915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:09.697924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.697937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:09.697955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.698056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.698066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.698077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.698098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2288 partition: 0 MaxSeqNo: 17 sessionId: src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0
2025-10-02T08:15:09.698382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc6a889-a83b1b03-81a6f861-f684a704_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:09.700974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0] Write session: try to update token
2025-10-02T08:15:09.700989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:09.708661Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:09.708681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:09.708689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535006368576059:13140]
2025-10-02T08:15:09.708730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:09.708731Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:09.708925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:09.709077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:09.709222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:09.709371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:09.709579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:09.709616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:09.715125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId: src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:09.717689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:09.717748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.717760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.717790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:09.717812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:09.717847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.717861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.717991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.718047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.718106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.718166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.718288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.718294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.718357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.718416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.718471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.718528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.718571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.718576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.718642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.718696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.718749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.718804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.719006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.719012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.719070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.719128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.719187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.719247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.719286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.719292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.719351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.719405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.719472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.719531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.719571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.719576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.719642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.719699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.719755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.719813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.719853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.719859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.719916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.719981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.720040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.720100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.720143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.720150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.720229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.720284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.720343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.720401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.720441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.720446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.720510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.720569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.720629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.720697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.720738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.720743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.720823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:09.720882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:09.720940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:09.720997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:09.721037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:09.721042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:09.721075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:09.721123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.721140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.721145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:09.721175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:09.721191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:09.721202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:09.721204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:09.721206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:09.721551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:09.721572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:09.721583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:09.721586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:09.721588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:09.721591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:09.722082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:09.722101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:09.722108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:09.722111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:09.722113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:09.722115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:09.722565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:09.722583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:09.722586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:09.722588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:09.722590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:09.723709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:09.723727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:09.723742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392909723
2025-10-02T08:15:09.723849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:09.723858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:09.723862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:09.723865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:09.723867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:09.723869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:09.724289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:09.724303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:09.724307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:09.724309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:09.724312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:09.724314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:09.724742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:09.724761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:09.724771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:09.724778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:09.724780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:09.724782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:09.725211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:09.725231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:09.725235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:09.726204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:09.726220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:09.726224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:09.726226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:09.726234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392909725
2025-10-02T08:15:09.726503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:09.726520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:09.726529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:09.726531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:09.726533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:09.726535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:09.726949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:09.726966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:09.726969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:09.726976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:09.726978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:09.726981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:09.727392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:09.727405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.727477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392909726
2025-10-02T08:15:09.728147Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:09.728174Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:09.728182Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:09.728185Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:09.729811Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:09.729824Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:09.729825Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:09.729834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535006368576059:13140]
2025-10-02T08:15:09.729836Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535006368576059:13140]
2025-10-02T08:15:09.729890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:09.729894Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:09.729900Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:09.729901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.729902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:09.730039Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:09.776710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535006368576167:12399]
2025-10-02T08:15:09.776860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2287, pipe: [1:7556535006368576167:12399]
2025-10-02T08:15:09.862052Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:09.862429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368576167:12399], now have 1 active actors on pipe
2025-10-02T08:15:09.862556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535006368576167:12399]
2025-10-02T08:15:09.862578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:09.862580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:09.862600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2288 reason: error at write: Disconnected sessionId: src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0
2025-10-02T08:15:09.862611Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:09.862671Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:09.862767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2288 sessionId: src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0 is DEAD
2025-10-02T08:15:09.862927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:09.862936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0] Write session will restart in 0.006223s
2025-10-02T08:15:09.862952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0] Write session: Do CDS request
2025-10-02T08:15:09.862958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:09.869563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:09.870257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.870345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:09.870360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2289
2025-10-02T08:15:09.870499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:09.870524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:09.870546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:09.870550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:09.870554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:09.870772Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:09.870790Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:09.870804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:09.870888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:09.870916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2289 sessionId:  describe result for acl check
2025-10-02T08:15:09.870934Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535006368576388:13159]
2025-10-02T08:15:09.870944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:09.870946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:09.870949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:09.870954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535006368576391:13161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:09.871439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535006368576391:13161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:09.871531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:09.871754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:09.871803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:09.872090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:09.872132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.872137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.872139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.872140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.872141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.872147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.872156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.872176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.872180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.872184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.872189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.872197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:09.872206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.872211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:09.872220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.872225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:09.872230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.872241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.872245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.872250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.872272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:09.873945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535006368576391:13161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:09.879644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535006368576391:13161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:09.879659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535006368576391:13161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:09.879662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535006368576391:13161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:09.879672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:09.880080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:09.881715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:09.881734Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:09.881737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:09.881740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:09.881745Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2288 [1:7556535006368576388:13159]
2025-10-02T08:15:09.881754Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:09.881770Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:09.881773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.881775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.881777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.881791Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:09.881796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:09.881803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:09.881869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.881877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.881879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:09.881881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:09.881950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:09.881956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.881969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:09.881984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:09.881995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2288
2025-10-02T08:15:09.882003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368576433:13161], now have 1 active actors on pipe
2025-10-02T08:15:09.882006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535006828052829:2378], now have 1 active actors on pipe
2025-10-02T08:15:09.882011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535006368576380:13159]
2025-10-02T08:15:09.882013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535006368576380:13159]
2025-10-02T08:15:09.882025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:09.882033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.882038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.882040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:09.882044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:09.882052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:09.882064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:09.882066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:09.882106Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:09.882120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:09.882127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:09.882129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:09.882137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:09.882145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:09.882157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535006368576380:13159]
2025-10-02T08:15:09.882164Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:09.882185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.882199Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:09.882244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:09.882251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:09.882262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:09.882287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2289 partition: 0 MaxSeqNo: 17 sessionId: src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0
2025-10-02T08:15:09.882355Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2288
2025-10-02T08:15:09.882591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a953a2ca-3b09c31f-7246b443-c7a98aca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:09.885047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0] Write session: try to update token
2025-10-02T08:15:09.885060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:09.898158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId: src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:09.899890Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:09.899910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:09.899913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:09.899921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535006368576380:13159]
2025-10-02T08:15:09.899925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535006368576380:13159]
2025-10-02T08:15:09.899966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:09.899970Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:09.899973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:09.899975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:09.899976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:09.900105Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:09.900447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:09.962551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535006368576448:12399]
2025-10-02T08:15:09.962646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2288, pipe: [1:7556535006368576448:12399]
2025-10-02T08:15:10.031252Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:10.031497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.031508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.031539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535006368576448:12399], now have 1 active actors on pipe
2025-10-02T08:15:10.031682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535006368576448:12399]
2025-10-02T08:15:10.031697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:10.031702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:10.031735Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:10.031743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2289 reason: error at write: Disconnected sessionId: src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0
2025-10-02T08:15:10.031807Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:10.031884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2289 sessionId: src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0 is DEAD
2025-10-02T08:15:10.032015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:10.032023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0] Write session will restart in 0.008393s
2025-10-02T08:15:10.032048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0] Write session: Do CDS request
2025-10-02T08:15:10.032056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:10.039711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:10.040881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:10.041034Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:10.041040Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:10.041047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:10.041092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:10.041124Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535010663543949:13165]
2025-10-02T08:15:10.041206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.041269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:10.041280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2290
2025-10-02T08:15:10.041371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.041395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:10.041399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:10.041401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:10.041566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:10.041686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2290 sessionId:  describe result for acl check
2025-10-02T08:15:10.041709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:10.041713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:10.041716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:10.041718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:10.041719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535010663543958:13167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:10.041749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:10.041940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:10.041973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.041978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.041979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.041980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.041981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.041985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.041993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.041996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.041999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.042002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.042007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.042013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.042018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.042023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.042025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.042028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.042030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.042032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.042035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.042037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.042047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:10.042138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535010663543958:13167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:10.043560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535010663543958:13167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:10.049658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:10.050976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:10.050990Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:10.050991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:10.050994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:10.050998Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2289 [1:7556535010663543949:13165]
2025-10-02T08:15:10.051006Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:10.051017Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:10.051019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.051021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.051022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.051033Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:10.051036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:10.051040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:10.051083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.051084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.051086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:10.051089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:10.051151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:10.051161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.051170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.051179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:10.051195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535011123020131:2378], now have 1 active actors on pipe
2025-10-02T08:15:10.051206Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535010663543943:13165]
2025-10-02T08:15:10.051209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535010663543943:13165]
2025-10-02T08:15:10.051219Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:10.051237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:10.051241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:10.051244Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:10.051253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:10.051256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:10.051241Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2289
2025-10-02T08:15:10.051280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535010663543943:13165]
2025-10-02T08:15:10.051286Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:10.051292Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:10.051621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535010663543958:13167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:10.051646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535010663543958:13167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:10.051649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535010663543958:13167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:10.051656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:10.051843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2289
2025-10-02T08:15:10.051848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663544004:13167], now have 1 active actors on pipe
2025-10-02T08:15:10.051853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.051857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.051885Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|815b6b25-96584cf6-5299b463-f8725a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:10.051896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.051899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.051901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:10.051908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.051919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:10.051929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.051965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.051975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.051997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.052031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2290 partition: 0 MaxSeqNo: 17 sessionId: src_id|815b6b25-96584cf6-5299b463-f8725a6_0
2025-10-02T08:15:10.052320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aecf8a20-9efd8738-79cee46f-1b07c338_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|815b6b25-96584cf6-5299b463-f8725a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:10.054751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815b6b25-96584cf6-5299b463-f8725a6_0] Write session: try to update token
2025-10-02T08:15:10.054764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815b6b25-96584cf6-5299b463-f8725a6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:10.061956Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:10.061975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:10.061985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535010663543943:13165]
2025-10-02T08:15:10.062022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:10.062026Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:10.062185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:10.062323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:10.062458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:10.062598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:10.062784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:10.062822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:10.067485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId: src_id|815b6b25-96584cf6-5299b463-f8725a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:10.070054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:10.070114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.070125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.070160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:10.070183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:10.070323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.070332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.070495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.070555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.070618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.070680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.070737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.070745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.070815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.070884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.070946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.071009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.071051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.071057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.071120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.071183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.071246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.071315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.071359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.071362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.071427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.071486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.071545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.071606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.071643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.071645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.071706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.071756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.071812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.071866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.071903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.071905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.071973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.072027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.072081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.072133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.072189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.072192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.072261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.072321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.072377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.072434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.072477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.072480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.072539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.072596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.072651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.072703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.072746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.072749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.072831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.072889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.072945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.073009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.073067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.073075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.073156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.073230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.073288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.073346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.073388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.073391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.073428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:10.073491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.073510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.073513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:10.073543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:10.073555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:10.073558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:10.073561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:10.073564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:10.073964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:10.073980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:10.073987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:10.073990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:10.073993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:10.073995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:10.074573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:10.074587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:10.074593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:10.074596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:10.074599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:10.074602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:10.075220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:10.075236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:10.075241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:10.075244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:10.075247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:10.076434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:10.076442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:10.076451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392910076
2025-10-02T08:15:10.076567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:10.076573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:10.076578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:10.076581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:10.076585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:10.076588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:10.077090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:10.077113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:10.077119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:10.077122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:10.077125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:10.077128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:10.077611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:10.077633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:10.077642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:10.077648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:10.077651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:10.077653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:10.078108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:10.078134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:10.078141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:10.079249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:10.079271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:10.079275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:10.079279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:10.079286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392910079
2025-10-02T08:15:10.079581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:10.079606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:10.079612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:10.079614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:10.079618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:10.079620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:10.080088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:10.080112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:10.080117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:10.080121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:10.080125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:10.080128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:10.080606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:10.080625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.080718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392910080
2025-10-02T08:15:10.081477Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:10.081497Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:10.081503Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:10.081510Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:10.083139Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:10.083150Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:10.083151Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:10.083161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535010663543943:13165]
2025-10-02T08:15:10.083164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535010663543943:13165]
2025-10-02T08:15:10.083214Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:10.083221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:10.083226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.083227Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:10.083228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:10.083356Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:10.132073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535010663544023:12399]
2025-10-02T08:15:10.132242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2289, pipe: [1:7556535010663544023:12399]
2025-10-02T08:15:10.211054Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:10.211351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663544023:12399], now have 1 active actors on pipe
2025-10-02T08:15:10.211477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535010663544023:12399]
2025-10-02T08:15:10.211495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:10.211496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:10.211516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2290 reason: error at write: Disconnected sessionId: src_id|815b6b25-96584cf6-5299b463-f8725a6_0
2025-10-02T08:15:10.211536Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:10.211612Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:10.211654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2290 sessionId: src_id|815b6b25-96584cf6-5299b463-f8725a6_0 is DEAD
2025-10-02T08:15:10.211774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815b6b25-96584cf6-5299b463-f8725a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:10.211783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815b6b25-96584cf6-5299b463-f8725a6_0] Write session will restart in 0.006788s
2025-10-02T08:15:10.211807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815b6b25-96584cf6-5299b463-f8725a6_0] Write session: Do CDS request
2025-10-02T08:15:10.211813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815b6b25-96584cf6-5299b463-f8725a6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:10.219217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815b6b25-96584cf6-5299b463-f8725a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.219280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:10.219295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2291
2025-10-02T08:15:10.219423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.219450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:10.219459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:10.219462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:10.219474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:10.219775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2291 sessionId:  describe result for acl check
2025-10-02T08:15:10.219801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:10.219808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:10.219810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:10.219815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535010663544232:13174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:10.220282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535010663544232:13174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:10.220297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:10.220426Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:10.220436Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:10.220443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:10.220477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:10.220503Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535010663544236:13172]
2025-10-02T08:15:10.220997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:10.221125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:10.221161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:10.221412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:10.221443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.221447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.221448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.221448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.221449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.221452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.221457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.221459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.221461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.221463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.221467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.221470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.221474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.221476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.221478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.221481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.221483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.221486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.221488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.221491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.221500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:10.221647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535010663544232:13174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:10.227003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535010663544232:13174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:10.227013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535010663544232:13174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:10.227015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535010663544232:13174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:10.227020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:10.229028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:10.230425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:10.230437Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:10.230438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:10.230440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:10.230444Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2290 [1:7556535010663544236:13172]
2025-10-02T08:15:10.230452Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:10.230464Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:10.230466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.230468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.230469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.230481Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:10.230484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:10.230491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:10.230535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.230543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.230545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:10.230547Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:10.230592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:10.230597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.230605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.230611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:10.230622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535010663544226:13172]
2025-10-02T08:15:10.230626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535010663544226:13172]
2025-10-02T08:15:10.230632Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:10.230640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:10.230652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:10.230654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2290
2025-10-02T08:15:10.230655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:10.230658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:10.230661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:10.230669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663544279:13174], now have 1 active actors on pipe
2025-10-02T08:15:10.230694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535011123020140:2378], now have 1 active actors on pipe
2025-10-02T08:15:10.230698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.230701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.230713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535010663544226:13172]
2025-10-02T08:15:10.230720Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:10.230727Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:10.230745Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69409367-26969d64-d2f7b119-a26ff760_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:10.230757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.230761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.230763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:10.230741Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2290
2025-10-02T08:15:10.230771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.230783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:10.230807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.230849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.230854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.230865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.230897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2291 partition: 0 MaxSeqNo: 17 sessionId: src_id|69409367-26969d64-d2f7b119-a26ff760_0
2025-10-02T08:15:10.231182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815b6b25-96584cf6-5299b463-f8725a6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|69409367-26969d64-d2f7b119-a26ff760_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:10.233579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69409367-26969d64-d2f7b119-a26ff760_0] Write session: try to update token
2025-10-02T08:15:10.233592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69409367-26969d64-d2f7b119-a26ff760_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:10.245947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId: src_id|69409367-26969d64-d2f7b119-a26ff760_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:10.247647Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:10.247661Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:10.247663Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:10.247670Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535010663544226:13172]
2025-10-02T08:15:10.247673Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535010663544226:13172]
2025-10-02T08:15:10.247700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:10.247703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:10.247704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:10.247707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.247709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:10.247835Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:10.248344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:10.311732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535010663544294:12399]
2025-10-02T08:15:10.311814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2290, pipe: [1:7556535010663544294:12399]
2025-10-02T08:15:10.369927Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:10.370224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.370236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.370277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663544294:12399], now have 1 active actors on pipe
2025-10-02T08:15:10.370384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535010663544294:12399]
2025-10-02T08:15:10.370399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:10.370400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:10.370443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2291 reason: error at write: Disconnected sessionId: src_id|69409367-26969d64-d2f7b119-a26ff760_0
2025-10-02T08:15:10.370508Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:10.370505Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:10.370600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2291 sessionId: src_id|69409367-26969d64-d2f7b119-a26ff760_0 is DEAD
2025-10-02T08:15:10.370722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69409367-26969d64-d2f7b119-a26ff760_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:10.370731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69409367-26969d64-d2f7b119-a26ff760_0] Write session will restart in 0.006932s
2025-10-02T08:15:10.370754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69409367-26969d64-d2f7b119-a26ff760_0] Write session: Do CDS request
2025-10-02T08:15:10.370759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69409367-26969d64-d2f7b119-a26ff760_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:10.377475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:10.378316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:10.378452Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:10.378460Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:10.378467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:10.378498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:10.378525Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535010663544502:13178]
2025-10-02T08:15:10.378941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:10.379085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:10.379112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:10.379185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69409367-26969d64-d2f7b119-a26ff760_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.379271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:10.379285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2292
2025-10-02T08:15:10.379312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:10.379348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.379353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.379354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.379354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.379355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.379360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.379368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.379372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.379379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.379382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.379390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.379395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.379401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.379404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.379405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.379408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.379410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.379413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.379416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.379418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.379421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.379431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:10.379433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:10.379440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:10.379447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:10.379821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2292 sessionId:  describe result for acl check
2025-10-02T08:15:10.379855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:10.379860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:10.379862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:10.379867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535010663544518:13180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:10.380337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535010663544518:13180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:10.382151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535010663544518:13180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:10.386366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535010663544518:13180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:10.386377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535010663544518:13180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:10.386379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535010663544518:13180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:10.386384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:10.386909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:10.388434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:10.388449Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:10.388451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:10.388455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:10.388460Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2291 [1:7556535010663544502:13178]
2025-10-02T08:15:10.388472Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:10.388489Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:10.388494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.388497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.388499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.388513Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:10.388523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:10.388529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:10.388592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.388599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.388603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:10.388605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:10.388674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:10.388681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.388693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.388705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:10.388710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2291
2025-10-02T08:15:10.388726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663544549:13180], now have 1 active actors on pipe
2025-10-02T08:15:10.388738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535011123020146:2378], now have 1 active actors on pipe
2025-10-02T08:15:10.388744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535010663544496:13178]
2025-10-02T08:15:10.388745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535010663544496:13178]
2025-10-02T08:15:10.388757Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:10.388768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.388771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.388774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:10.388777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:10.388788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:10.388772Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2291
2025-10-02T08:15:10.388822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:10.388829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:10.388865Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fd10016-22f51563-d5990daa-e41a5f65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:10.388875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.388878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.388879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:10.388888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.388897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:10.388912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535010663544496:13178]
2025-10-02T08:15:10.388923Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:10.388945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.388947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:10.389002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.389011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.389028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.389056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2292 partition: 0 MaxSeqNo: 17 sessionId: src_id|1fd10016-22f51563-d5990daa-e41a5f65_0
2025-10-02T08:15:10.389344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69409367-26969d64-d2f7b119-a26ff760_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1fd10016-22f51563-d5990daa-e41a5f65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:10.391781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd10016-22f51563-d5990daa-e41a5f65_0] Write session: try to update token
2025-10-02T08:15:10.391794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd10016-22f51563-d5990daa-e41a5f65_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:10.404693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId: src_id|1fd10016-22f51563-d5990daa-e41a5f65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:10.405703Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:10.405715Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:10.405716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:10.405722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535010663544496:13178]
2025-10-02T08:15:10.405726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535010663544496:13178]
2025-10-02T08:15:10.405760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:10.405771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.405769Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:10.405772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:10.405774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:10.405889Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:10.407041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:10.470471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535010663544566:12399]
2025-10-02T08:15:10.470623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2291, pipe: [1:7556535010663544566:12399]
2025-10-02T08:15:10.530824Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:10.531124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.531137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.531173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663544566:12399], now have 1 active actors on pipe
2025-10-02T08:15:10.531303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535010663544566:12399]
2025-10-02T08:15:10.531332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:10.531339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:10.531348Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:10.531396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2292 reason: error at write: Disconnected sessionId: src_id|1fd10016-22f51563-d5990daa-e41a5f65_0
2025-10-02T08:15:10.531426Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:10.531528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2292 sessionId: src_id|1fd10016-22f51563-d5990daa-e41a5f65_0 is DEAD
2025-10-02T08:15:10.531675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd10016-22f51563-d5990daa-e41a5f65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:10.531684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd10016-22f51563-d5990daa-e41a5f65_0] Write session will restart in 0.007305s
2025-10-02T08:15:10.531702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd10016-22f51563-d5990daa-e41a5f65_0] Write session: Do CDS request
2025-10-02T08:15:10.531707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd10016-22f51563-d5990daa-e41a5f65_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:10.539335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:10.540232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:10.540270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd10016-22f51563-d5990daa-e41a5f65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.540262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:10.540273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2293
2025-10-02T08:15:10.540361Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:10.540368Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:10.540374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:10.540415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:10.540442Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535010663544777:13185]
2025-10-02T08:15:10.540462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.540488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:10.540497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:10.540500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:10.540843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2293 sessionId:  describe result for acl check
2025-10-02T08:15:10.540871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:10.540877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:10.540878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:10.540884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535010663544781:13187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:10.540889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:10.541033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:10.541058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:10.541238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:10.541266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.541269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.541270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.541270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.541271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.541274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.541280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.541282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.541284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.541285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.541289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.541292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.541296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.541298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.541300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.541303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.541305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.541308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.541310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.541312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.541322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:10.541339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535010663544781:13187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:10.542801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535010663544781:13187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:10.548400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535010663544781:13187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:10.548414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535010663544781:13187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:10.548418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535010663544781:13187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:10.548427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:10.548851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:10.550272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:10.550290Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:10.550292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:10.550296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:10.550301Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2292 [1:7556535010663544777:13185]
2025-10-02T08:15:10.550313Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:10.550328Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:10.550331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.550334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.550336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.550349Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:10.550358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:10.550364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:10.550423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.550433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.550436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:10.550438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:10.550498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:10.550505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.550517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.550530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:10.550550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663544824:13187], now have 1 active actors on pipe
2025-10-02T08:15:10.550556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2292
2025-10-02T08:15:10.550560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535010663544770:13185]
2025-10-02T08:15:10.550562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535010663544770:13185]
2025-10-02T08:15:10.550568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:10.550576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535011123020152:2378], now have 1 active actors on pipe
2025-10-02T08:15:10.550580Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:10.550583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:10.550587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:10.550601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:10.550607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:10.550613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.550616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.550652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535010663544770:13185]
2025-10-02T08:15:10.550659Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:10.550624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2292
2025-10-02T08:15:10.550669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:10.550674Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:10.550679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.550682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.550684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:10.550692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.550700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:10.550743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.550809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.550820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.550841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.550876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2293 partition: 0 MaxSeqNo: 17 sessionId: src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0
2025-10-02T08:15:10.551140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd10016-22f51563-d5990daa-e41a5f65_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:10.553624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0] Write session: try to update token
2025-10-02T08:15:10.553644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:10.566586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId: src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:10.567652Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:10.567664Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:10.567666Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:10.567672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535010663544770:13185]
2025-10-02T08:15:10.567675Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535010663544770:13185]
2025-10-02T08:15:10.567705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:10.567713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.567715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:10.567714Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:10.567718Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:10.567836Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:10.568958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:10.631237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535010663544839:12399]
2025-10-02T08:15:10.631363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2292, pipe: [1:7556535010663544839:12399]
2025-10-02T08:15:10.692859Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:10.693176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.693187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.693219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663544839:12399], now have 1 active actors on pipe
2025-10-02T08:15:10.693335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:10.693347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:10.693373Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:10.693410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2293 reason: error at write: Disconnected sessionId: src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0
2025-10-02T08:15:10.693436Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:10.693563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2293 sessionId: src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0 is DEAD
2025-10-02T08:15:10.693581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535010663544839:12399]
2025-10-02T08:15:10.693688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:10.693694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0] Write session will restart in 0.007640s
2025-10-02T08:15:10.693718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0] Write session: Do CDS request
2025-10-02T08:15:10.693724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:10.700544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:10.701683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:10.701853Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:10.701862Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:10.701871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:10.701913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:10.701949Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535010663545055:13191]
2025-10-02T08:15:10.702237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.702332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:10.702344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2294
2025-10-02T08:15:10.702465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.702492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:10.702501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:10.702504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:10.702551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:10.702690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:10.702725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:10.702864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2294 sessionId:  describe result for acl check
2025-10-02T08:15:10.702893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:10.702899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:10.702900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:10.702905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535010663545066:13193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:10.703020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:10.703057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.703062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.703063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.703064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.703065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.703070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.703079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.703083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.703089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.703093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.703099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.703110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.703121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.703129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.703133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.703142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.703150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.703155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.703160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.703168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.703185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:10.703348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535010663545066:13193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:10.705325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535010663545066:13193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:10.710452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535010663545066:13193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:10.710466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535010663545066:13193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:10.710469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535010663545066:13193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:10.710477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:10.710975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:10.712324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:10.712340Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:10.712342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:10.712345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:10.712350Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2293 [1:7556535010663545055:13191]
2025-10-02T08:15:10.712361Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:10.712375Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:10.712382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.712385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.712387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.712400Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:10.712409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:10.712415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:10.712469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.712476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.712479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:10.712481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:10.712541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:10.712548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.712559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.712575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:10.712587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2293
2025-10-02T08:15:10.712595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663545102:13193], now have 1 active actors on pipe
2025-10-02T08:15:10.712598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535011123020159:2378], now have 1 active actors on pipe
2025-10-02T08:15:10.712604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535010663545049:13191]
2025-10-02T08:15:10.712606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535010663545049:13191]
2025-10-02T08:15:10.712617Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:10.712630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.712632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:10.712633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.712635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:10.712649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:10.712616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2293
2025-10-02T08:15:10.712662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:10.712669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:10.712700Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:10.712710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.712716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.712722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:10.712729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.712737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:10.712752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535010663545049:13191]
2025-10-02T08:15:10.712762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:10.712780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:10.712787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.712847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.712857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.712878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.712913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2294 partition: 0 MaxSeqNo: 17 sessionId: src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0
2025-10-02T08:15:10.713274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ad381e-4b39c09f-f7c64da4-5ef98ec9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:10.715504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0] Write session: try to update token
2025-10-02T08:15:10.715519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:10.727812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId: src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:10.730154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:10.730218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.730229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.731653Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:10.731667Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:10.731670Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:10.731677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535010663545049:13191]
2025-10-02T08:15:10.731680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535010663545049:13191]
2025-10-02T08:15:10.731713Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:10.731719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:10.731722Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:10.731728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:10.731734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.731737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:10.731856Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:10.749740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:10.793548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535010663545165:12399]
2025-10-02T08:15:10.793659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2293, pipe: [1:7556535010663545165:12399]
2025-10-02T08:15:10.876237Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:10.876690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.876703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.876869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.876929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.876996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.877059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.877102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.877111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.877181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.877239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.877299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.877365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.877408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.877416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.877477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.877533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.877591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.877648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.877690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.877696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.877760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.877822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.877882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.877943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.877984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.877991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.878053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.878113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.878173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.878237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.878280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.878287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.878349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.878407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.878466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.878527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.878568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.878577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.878638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.878694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.878756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.878816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.878859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.878866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.878927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.878985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.879042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.879103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.879145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.879152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.879215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.879271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.879328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.879389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.879433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.879439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.879500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:10.879557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:10.879612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:10.879671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:10.879711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:10.879714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:10.879753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663545165:12399], now have 1 active actors on pipe
2025-10-02T08:15:10.879863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535010663545165:12399]
2025-10-02T08:15:10.879893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:10.879901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:10.879927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2294 reason: error at write: Disconnected sessionId: src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0
2025-10-02T08:15:10.879969Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:10.880077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2294 sessionId: src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0 is DEAD
2025-10-02T08:15:10.880218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:10.880223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0] Write session will restart in 0.006348s
2025-10-02T08:15:10.880241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0] Write session: Do CDS request
2025-10-02T08:15:10.880246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:10.880271Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:10.886924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:10.887163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.887281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:10.887293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2295
2025-10-02T08:15:10.887420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:10.887454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:10.887463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:10.887466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:10.887824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:10.887847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2295 sessionId:  describe result for acl check
2025-10-02T08:15:10.887879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:10.887885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:10.887886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:10.887891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535010663545386:13212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:10.888000Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:10.888008Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:10.888015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:10.888048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:10.888074Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535010663545387:13210]
2025-10-02T08:15:10.888401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535010663545386:13212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:10.888463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:10.888674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:10.888723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:10.889026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:10.889072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.889081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.889082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.889083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.889085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.889090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.889099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.889103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.889107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.889111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.889115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.889123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:10.889128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.889139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:10.889143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.889148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:10.889157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.889166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.889174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.889183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.889206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:10.889890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535010663545386:13212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:10.894594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535010663545386:13212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:10.894605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535010663545386:13212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:10.894608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535010663545386:13212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:10.894615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:10.896596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:10.897994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:10.898006Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:10.898008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:10.898012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:10.898017Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2294 [1:7556535010663545387:13210]
2025-10-02T08:15:10.898026Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:10.898041Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:10.898048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.898051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.898053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.898067Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:10.898076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:10.898082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:10.898129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.898135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.898138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:10.898141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:10.898194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:10.898200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.898212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:10.898227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:10.898246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663545432:13212], now have 1 active actors on pipe
2025-10-02T08:15:10.898247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2294
2025-10-02T08:15:10.898255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535010663545378:13210]
2025-10-02T08:15:10.898257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535010663545378:13210]
2025-10-02T08:15:10.898267Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:10.898278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535011123020201:2378], now have 1 active actors on pipe
2025-10-02T08:15:10.898279Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:10.898281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:10.898287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.898291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.898309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:10.898325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:10.898330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:10.898364Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1059305-54e04382-4ae55356-910d44ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:10.898373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:10.898376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:10.898380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:10.898387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:10.898364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2294
2025-10-02T08:15:10.898398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:10.898409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535010663545378:13210]
2025-10-02T08:15:10.898415Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:10.898418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:10.898437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.898473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:10.898478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:10.898493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:10.898524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2295 partition: 0 MaxSeqNo: 17 sessionId: src_id|d1059305-54e04382-4ae55356-910d44ab_0
2025-10-02T08:15:10.898833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509bb68d-7174f796-bd91ee54-a10ee2a3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d1059305-54e04382-4ae55356-910d44ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:10.901295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1059305-54e04382-4ae55356-910d44ab_0] Write session: try to update token
2025-10-02T08:15:10.901308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1059305-54e04382-4ae55356-910d44ab_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:10.914024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId: src_id|d1059305-54e04382-4ae55356-910d44ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:10.915193Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:10.915209Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:10.915211Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:10.915223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535010663545378:13210]
2025-10-02T08:15:10.915227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535010663545378:13210]
2025-10-02T08:15:10.915261Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:10.915267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:10.915270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:10.915273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:10.915275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:10.915407Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:10.916309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:10.979931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535010663545447:12399]
2025-10-02T08:15:10.980041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2294, pipe: [1:7556535010663545447:12399]
2025-10-02T08:15:11.039492Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:11.039726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.039736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.039766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535010663545447:12399], now have 1 active actors on pipe
2025-10-02T08:15:11.039849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:11.039861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:11.039914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2295 reason: error at write: Disconnected sessionId: src_id|d1059305-54e04382-4ae55356-910d44ab_0
2025-10-02T08:15:11.039982Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:11.040048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2295 sessionId: src_id|d1059305-54e04382-4ae55356-910d44ab_0 is DEAD
2025-10-02T08:15:11.040191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1059305-54e04382-4ae55356-910d44ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:11.040199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1059305-54e04382-4ae55356-910d44ab_0] Write session will restart in 0.007162s
2025-10-02T08:15:11.040220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1059305-54e04382-4ae55356-910d44ab_0] Write session: Do CDS request
2025-10-02T08:15:11.040225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1059305-54e04382-4ae55356-910d44ab_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:11.040246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535010663545447:12399]
2025-10-02T08:15:11.040288Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:11.047024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:11.047992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:11.048112Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:11.048120Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:11.048126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:11.048153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:11.048198Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535014958512958:13216]
2025-10-02T08:15:11.048220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1059305-54e04382-4ae55356-910d44ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.048270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:11.048283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2296
2025-10-02T08:15:11.048401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.048428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:11.048436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:11.048443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:11.048587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:11.048732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:11.048755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:11.048797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2296 sessionId:  describe result for acl check
2025-10-02T08:15:11.048843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:11.048849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:11.048850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:11.048855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535014958512969:13218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:11.048950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:11.048982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.048986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.048986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.048987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.048987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.048990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.048996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.048998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.049000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.049001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.049005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.049009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.049014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.049022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.049025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.049030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.049038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.049047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.049050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.049052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.049066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:11.049332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535014958512969:13218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:11.051164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535014958512969:13218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:11.055987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535014958512969:13218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:11.055999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535014958512969:13218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:11.056001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535014958512969:13218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:11.056006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:11.056426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:11.057797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:11.057810Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:11.057812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:11.057815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:11.057819Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2295 [1:7556535014958512958:13216]
2025-10-02T08:15:11.057828Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:11.057839Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:11.057840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.057842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.057844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.057855Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:11.057858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:11.057863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:11.057920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.057926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.057928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:11.057931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:11.057990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:11.057996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.058006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.058007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2295
2025-10-02T08:15:11.058021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:11.058041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958513006:13218], now have 1 active actors on pipe
2025-10-02T08:15:11.058049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.058057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.058069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535015417987503:2378], now have 1 active actors on pipe
2025-10-02T08:15:11.058077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535014958512952:13216]
2025-10-02T08:15:11.058078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535014958512952:13216]
2025-10-02T08:15:11.058086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:11.058098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:11.058104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:11.058107Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:11.058108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:11.058110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:11.058120Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|248465ef-bdd1d7a7-cefa9443-509618be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:11.058128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.058134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.058136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:11.058144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.058114Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2295
2025-10-02T08:15:11.058155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:11.058187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535014958512952:13216]
2025-10-02T08:15:11.058195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:11.058209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:11.058210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.058290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.058295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.058305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.058332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2296 partition: 0 MaxSeqNo: 17 sessionId: src_id|248465ef-bdd1d7a7-cefa9443-509618be_0
2025-10-02T08:15:11.058652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1059305-54e04382-4ae55356-910d44ab_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|248465ef-bdd1d7a7-cefa9443-509618be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:11.061053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|248465ef-bdd1d7a7-cefa9443-509618be_0] Write session: try to update token
2025-10-02T08:15:11.061069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|248465ef-bdd1d7a7-cefa9443-509618be_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:11.073091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId: src_id|248465ef-bdd1d7a7-cefa9443-509618be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:11.074679Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:11.074695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:11.074696Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:11.074703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535014958512952:13216]
2025-10-02T08:15:11.074706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535014958512952:13216]
2025-10-02T08:15:11.074739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:11.074744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.074746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:11.074749Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:11.074755Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:11.074875Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:11.075554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:11.140156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535014958513023:12399]
2025-10-02T08:15:11.140267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2295, pipe: [1:7556535014958513023:12399]
2025-10-02T08:15:11.202812Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:11.203092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.203103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.203136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958513023:12399], now have 1 active actors on pipe
2025-10-02T08:15:11.203221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:11.203230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:11.203285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2296 reason: error at write: Disconnected sessionId: src_id|248465ef-bdd1d7a7-cefa9443-509618be_0
2025-10-02T08:15:11.203337Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:11.203325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:11.203418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2296 sessionId: src_id|248465ef-bdd1d7a7-cefa9443-509618be_0 is DEAD
2025-10-02T08:15:11.203562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535014958513023:12399]
2025-10-02T08:15:11.203582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|248465ef-bdd1d7a7-cefa9443-509618be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:11.203592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|248465ef-bdd1d7a7-cefa9443-509618be_0] Write session will restart in 0.009313s
2025-10-02T08:15:11.203617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|248465ef-bdd1d7a7-cefa9443-509618be_0] Write session: Do CDS request
2025-10-02T08:15:11.203622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|248465ef-bdd1d7a7-cefa9443-509618be_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:11.211449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:11.212453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:11.212615Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:11.212624Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:11.212633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:11.212675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:11.212727Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535014958513241:13223]
2025-10-02T08:15:11.213385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:11.213579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:11.213619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:11.213897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:11.213936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.213941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.213943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.213944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.213945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.213949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.213961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.213965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.213969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.213972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.213978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.213986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.213991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.213996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.214000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.214005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.214011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.214016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.214021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.214026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.214044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:11.214275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|248465ef-bdd1d7a7-cefa9443-509618be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.214360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:11.214369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2297
2025-10-02T08:15:11.214467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.214492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:11.214501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:11.214504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:11.214896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2297 sessionId:  describe result for acl check
2025-10-02T08:15:11.214926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:11.214932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:11.214933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:11.214938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535014958513257:13225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:11.215407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535014958513257:13225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:11.217235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535014958513257:13225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:11.221448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535014958513257:13225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:11.221463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535014958513257:13225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:11.221467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535014958513257:13225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:11.221476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:11.221880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:11.223451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:11.223465Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:11.223467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:11.223470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:11.223475Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2296 [1:7556535014958513241:13223]
2025-10-02T08:15:11.223485Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:11.223500Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:11.223503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.223505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.223507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.223525Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:11.223529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:11.223536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:11.223600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.223609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.223612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:11.223615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:11.223683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:11.223691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.223702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.223717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:11.223719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2296
2025-10-02T08:15:11.223741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958513289:13225], now have 1 active actors on pipe
2025-10-02T08:15:11.223745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535015417987512:2378], now have 1 active actors on pipe
2025-10-02T08:15:11.223750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535014958513235:13223]
2025-10-02T08:15:11.223752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535014958513235:13223]
2025-10-02T08:15:11.223766Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:11.223782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.223783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:11.223786Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:11.223791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.223808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:11.223820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:11.223828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:11.223813Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2296
2025-10-02T08:15:11.223866Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:11.223878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.223886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.223888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:11.223898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.223913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:11.223925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535014958513235:13223]
2025-10-02T08:15:11.223936Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:11.223947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:11.223965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.224018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.224025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.224038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.224079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2297 partition: 0 MaxSeqNo: 17 sessionId: src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0
2025-10-02T08:15:11.224357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|248465ef-bdd1d7a7-cefa9443-509618be_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:11.226856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0] Write session: try to update token
2025-10-02T08:15:11.226873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:11.240257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId: src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:11.240739Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:11.240753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:11.240756Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:11.240763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535014958513235:13223]
2025-10-02T08:15:11.240768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535014958513235:13223]
2025-10-02T08:15:11.240828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:11.240842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.240844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:11.240915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:11.240928Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:11.240981Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:11.242771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:11.303517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535014958513304:12399]
2025-10-02T08:15:11.303685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2296, pipe: [1:7556535014958513304:12399]
2025-10-02T08:15:11.386095Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:11.386412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.386428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.386467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958513304:12399], now have 1 active actors on pipe
2025-10-02T08:15:11.386679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:11.386691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:11.386711Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:11.386693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:11.386767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2297 reason: error at write: Disconnected sessionId: src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0
2025-10-02T08:15:11.386921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2297 sessionId: src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0 is DEAD
2025-10-02T08:15:11.387011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535014958513304:12399]
2025-10-02T08:15:11.387062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:11.387072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0] Write session will restart in 0.006322s
2025-10-02T08:15:11.387093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0] Write session: Do CDS request
2025-10-02T08:15:11.387098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:11.394329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.394346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:11.394357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2298
2025-10-02T08:15:11.394543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.394578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:11.394587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:11.394590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:11.394970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2298 sessionId:  describe result for acl check
2025-10-02T08:15:11.394996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:11.395001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:11.395002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:11.395006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535014958513517:13230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:11.395420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535014958513517:13230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:11.395504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:11.396787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:11.396970Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:11.396979Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:11.396989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:11.397034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:11.397075Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535014958513547:13229]
2025-10-02T08:15:11.397718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:11.397820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535014958513517:13230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:11.397866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:11.397902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:11.398183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:11.398221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.398226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.398227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.398228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.398229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.398234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.398244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.398248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.398252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.398256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.398260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.398267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.398272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.398278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.398288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.398293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.398297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.398306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.398311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.398316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.398341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:11.404692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535014958513517:13230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:11.404710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535014958513517:13230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:11.404714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535014958513517:13230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:11.404723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:11.406941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:11.408631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:11.408651Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:11.408655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:11.408658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:11.408665Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2297 [1:7556535014958513547:13229]
2025-10-02T08:15:11.408680Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:11.408698Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:11.408706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.408709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.408710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.408727Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:11.408736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:11.408742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:11.408833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.408847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.408850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:11.408853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:11.408926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:11.408936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.408950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.408967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:11.408977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2297
2025-10-02T08:15:11.408985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958513574:13230], now have 1 active actors on pipe
2025-10-02T08:15:11.408989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535015417987519:2378], now have 1 active actors on pipe
2025-10-02T08:15:11.408994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.408999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.409014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535014958513524:13229]
2025-10-02T08:15:11.409021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535014958513524:13229]
2025-10-02T08:15:11.409031Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:11.409046Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:11.409047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:11.409049Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:11.409062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:11.409074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:11.409089Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:11.409099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.409102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.409104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:11.409113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.409094Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2297
2025-10-02T08:15:11.409127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:11.409168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535014958513524:13229]
2025-10-02T08:15:11.409181Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:11.409203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.409208Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:11.409314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.409322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.409337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.409377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2298 partition: 0 MaxSeqNo: 17 sessionId: src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0
2025-10-02T08:15:11.409713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35c37e8-d8f375d2-143267c4-2adb5b27_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:11.412221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0] Write session: try to update token
2025-10-02T08:15:11.412238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:11.425650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId: src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:11.426520Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:11.426538Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:11.426541Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:11.426549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535014958513524:13229]
2025-10-02T08:15:11.426553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535014958513524:13229]
2025-10-02T08:15:11.426590Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:11.426596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:11.426602Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:11.426606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.426609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:11.426733Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:11.427972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:11.487297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535014958513591:12399]
2025-10-02T08:15:11.487429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2297, pipe: [1:7556535014958513591:12399]
2025-10-02T08:15:11.569945Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:11.570273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.570288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.570328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958513591:12399], now have 1 active actors on pipe
2025-10-02T08:15:11.570467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:11.570479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:11.570539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2298 reason: error at write: Disconnected sessionId: src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0
2025-10-02T08:15:11.570572Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:11.570687Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:11.570715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2298 sessionId: src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0 is DEAD
2025-10-02T08:15:11.570862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535014958513591:12399]
2025-10-02T08:15:11.571114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:11.571123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0] Write session will restart in 0.006648s
2025-10-02T08:15:11.571147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0] Write session: Do CDS request
2025-10-02T08:15:11.571154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:11.579281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.579367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:11.579380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2299
2025-10-02T08:15:11.579502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.579535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:11.579540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:11.579543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:11.579701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:11.579893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2299 sessionId:  describe result for acl check
2025-10-02T08:15:11.579926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:11.579932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:11.579934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:11.579939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535014958513815:13238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:11.580431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535014958513815:13238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:11.581064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:11.581239Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:11.581248Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:11.581257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:11.581304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:11.581341Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535014958513825:13236]
2025-10-02T08:15:11.581858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:11.582085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:11.582150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:11.582455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:11.582515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.582521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.582522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.582523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.582524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.582539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535014958513815:13238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:11.582541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.582549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.582557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.582560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.582563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.582568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.582575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.582584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.582589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.582593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.582601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.582604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.582609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.582612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.582616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.582632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:11.588737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535014958513815:13238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:11.588751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535014958513815:13238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:11.588754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535014958513815:13238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:11.588763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:11.590826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:11.592444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:11.592460Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:11.592463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:11.592467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:11.592474Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2298 [1:7556535014958513825:13236]
2025-10-02T08:15:11.592484Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:11.592501Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:11.592504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.592507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.592510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.592525Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:11.592531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:11.592543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:11.592614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.592621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.592624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:11.592627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:11.592705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:11.592715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.592728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.592739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:11.592759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2298
2025-10-02T08:15:11.592760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958513863:13238], now have 1 active actors on pipe
2025-10-02T08:15:11.592764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535015417987526:2378], now have 1 active actors on pipe
2025-10-02T08:15:11.592769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535014958513809:13236]
2025-10-02T08:15:11.592771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535014958513809:13236]
2025-10-02T08:15:11.592783Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:11.592792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.592796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.592825Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:11.592828Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:11.592832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:11.592846Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:11.592854Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:11.592896Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:11.592908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.592868Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2298
2025-10-02T08:15:11.592912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.592914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:11.592922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.592932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:11.592942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535014958513809:13236]
2025-10-02T08:15:11.592949Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:11.592962Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:11.592978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.593063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.593072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.593085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.593122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2299 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0
2025-10-02T08:15:11.593440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfa6050-d99d9db1-c109795d-f69d296d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:11.595947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0] Write session: try to update token
2025-10-02T08:15:11.595976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:11.608794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId: src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:11.610448Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:11.610468Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:11.610470Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:11.610479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535014958513809:13236]
2025-10-02T08:15:11.610484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535014958513809:13236]
2025-10-02T08:15:11.610524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:11.610528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:11.610534Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:11.610535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.610537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:11.610674Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:11.611409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:11.671121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535014958513877:12399]
2025-10-02T08:15:11.671280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2298, pipe: [1:7556535014958513877:12399]
2025-10-02T08:15:11.745268Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:11.745657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.745671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.745707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958513877:12399], now have 1 active actors on pipe
2025-10-02T08:15:11.745825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535014958513877:12399]
2025-10-02T08:15:11.745845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:11.745847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:11.745895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2299 reason: error at write: Disconnected sessionId: src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0
2025-10-02T08:15:11.745941Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:11.745995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:11.746040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2299 sessionId: src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0 is DEAD
2025-10-02T08:15:11.746204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:11.746215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0] Write session will restart in 0.005613s
2025-10-02T08:15:11.746238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0] Write session: Do CDS request
2025-10-02T08:15:11.746245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:11.753267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.753324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:11.753338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2300
2025-10-02T08:15:11.753483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.753510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:11.753518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:11.753521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:11.753874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2300 sessionId:  describe result for acl check
2025-10-02T08:15:11.753902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:11.753903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:11.753905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:11.753909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535014958514101:13243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:11.754300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:11.754392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535014958514101:13243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:11.755444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:11.755600Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:11.755610Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:11.755620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:11.755668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:11.755706Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535014958514125:13242]
2025-10-02T08:15:11.756271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:11.756447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:11.756488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:11.756764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:11.756834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.756841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.756841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.756843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.756843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.756848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.756857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.756862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.756866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.756869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.756874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.756880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.756886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.756890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.756894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.756899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.756908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.756912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.756917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.756921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.756938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:11.758095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535014958514101:13243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:11.763904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535014958514101:13243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:11.763917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535014958514101:13243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:11.763920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535014958514101:13243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:11.763930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:11.765001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:11.766428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:11.766445Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:11.766447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:11.766450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:11.766456Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2299 [1:7556535014958514125:13242]
2025-10-02T08:15:11.766465Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:11.766480Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:11.766487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.766489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.766491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.766509Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:11.766513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:11.766518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:11.766575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.766582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.766585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:11.766587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:11.766647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:11.766654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.766666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.766676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:11.766696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958514167:13243], now have 1 active actors on pipe
2025-10-02T08:15:11.766704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535014958514102:13242]
2025-10-02T08:15:11.766706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535014958514102:13242]
2025-10-02T08:15:11.766715Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:11.766725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535015417987544:2378], now have 1 active actors on pipe
2025-10-02T08:15:11.766728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:11.766730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:11.766736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:11.766747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:11.766749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:11.766778Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535014958514102:13242]
2025-10-02T08:15:11.766784Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:11.766793Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:11.766773Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2299
2025-10-02T08:15:11.766857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2299
2025-10-02T08:15:11.766876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.766879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.766898Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:11.766905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.766907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.766910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:11.766917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.766926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:11.766937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.766977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.766980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.766990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.767015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2300 partition: 0 MaxSeqNo: 17 sessionId: src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0
2025-10-02T08:15:11.767306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e8d8aa-e53464c1-4b510f7c-53ccaa19_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:11.769764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0] Write session: try to update token
2025-10-02T08:15:11.769781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:11.783812Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:11.783829Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:11.783831Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:11.783840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535014958514102:13242]
2025-10-02T08:15:11.783844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535014958514102:13242]
2025-10-02T08:15:11.783880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:11.783884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.783886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:11.783884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:11.783890Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:11.783999Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:11.790737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId: src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:11.793460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:11.846213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535014958514219:12399]
2025-10-02T08:15:11.846348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2299, pipe: [1:7556535014958514219:12399]
2025-10-02T08:15:11.910390Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:11.910663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.910675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.910694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958514219:12399], now have 1 active actors on pipe
2025-10-02T08:15:11.910809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535014958514219:12399]
2025-10-02T08:15:11.910830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:11.910832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:11.910880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2300 reason: error at write: Disconnected sessionId: src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0
2025-10-02T08:15:11.910896Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:11.910914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:11.911028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2300 sessionId: src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0 is DEAD
2025-10-02T08:15:11.911142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:11.911148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0] Write session will restart in 0.009371s
2025-10-02T08:15:11.911168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0] Write session: Do CDS request
2025-10-02T08:15:11.911174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:11.917616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:11.918437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:11.918546Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:11.918554Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:11.918561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:11.918589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:11.918617Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535014958514446:13261]
2025-10-02T08:15:11.918993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:11.919104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:11.919128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:11.919304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:11.919329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.919333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.919333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.919334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.919334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.919337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.919343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.919345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.919347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.919349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.919352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.919356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:11.919359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.919362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:11.919364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.919366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:11.919368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.919371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.919373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.919375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.919384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:11.921141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.921257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:11.921268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2301
2025-10-02T08:15:11.921376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:11.921398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:11.921405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:11.921407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:11.921663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2301 sessionId:  describe result for acl check
2025-10-02T08:15:11.921686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:11.921687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:11.921688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:11.921691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535014958514462:13263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:11.922067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535014958514462:13263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:11.923670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535014958514462:13263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:11.926179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535014958514462:13263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:11.926188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535014958514462:13263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:11.926190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535014958514462:13263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:11.926195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:11.926660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:11.928025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:11.928037Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:11.928039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:11.928041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:11.928044Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2300 [1:7556535014958514446:13261]
2025-10-02T08:15:11.928051Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:11.928062Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:11.928067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.928069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.928070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.928081Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:11.928087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:11.928091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:11.928131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.928136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.928139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:11.928140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:11.928210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:11.928215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.928222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:11.928228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:11.928228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2300
2025-10-02T08:15:11.928241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535014958514495:13263], now have 1 active actors on pipe
2025-10-02T08:15:11.928251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535014958514439:13261]
2025-10-02T08:15:11.928257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535014958514439:13261]
2025-10-02T08:15:11.928269Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:11.928279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535015417987575:2378], now have 1 active actors on pipe
2025-10-02T08:15:11.928282Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:11.928284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:11.928285Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:11.928292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:11.928294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:11.928298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.928304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.928305Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2300
2025-10-02T08:15:11.928331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535014958514439:13261]
2025-10-02T08:15:11.928337Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:11.928339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:11.928346Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|642df5b1-d26446a-c85924c2-22831b93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:11.928350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:11.928354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:11.928356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:11.928361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:11.928368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:11.928394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.928432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:11.928436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:11.928444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:11.928471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2301 partition: 0 MaxSeqNo: 17 sessionId: src_id|642df5b1-d26446a-c85924c2-22831b93_0
2025-10-02T08:15:11.928705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2765f15-3f8280e3-8af3deea-5728d8f7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|642df5b1-d26446a-c85924c2-22831b93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:11.930982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642df5b1-d26446a-c85924c2-22831b93_0] Write session: try to update token
2025-10-02T08:15:11.930998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642df5b1-d26446a-c85924c2-22831b93_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:11.942878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId: src_id|642df5b1-d26446a-c85924c2-22831b93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:11.944308Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:11.944321Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:11.944323Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:11.944330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535014958514439:13261]
2025-10-02T08:15:11.944333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535014958514439:13261]
2025-10-02T08:15:11.944362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:11.944367Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:11.944369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:11.944371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:11.944372Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:11.944489Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:11.945083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:12.011399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535019253481806:12399]
2025-10-02T08:15:12.011523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2300, pipe: [1:7556535019253481806:12399]
2025-10-02T08:15:12.068773Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:12.069105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.069115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.069145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253481806:12399], now have 1 active actors on pipe
2025-10-02T08:15:12.069246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:12.069252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:12.069290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2301 reason: error at write: Disconnected sessionId: src_id|642df5b1-d26446a-c85924c2-22831b93_0
2025-10-02T08:15:12.069390Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:12.069382Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:12.069418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2301 sessionId: src_id|642df5b1-d26446a-c85924c2-22831b93_0 is DEAD
2025-10-02T08:15:12.069536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535019253481806:12399]
2025-10-02T08:15:12.069596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642df5b1-d26446a-c85924c2-22831b93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:12.069604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642df5b1-d26446a-c85924c2-22831b93_0] Write session will restart in 0.005390s
2025-10-02T08:15:12.069627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642df5b1-d26446a-c85924c2-22831b93_0] Write session: Do CDS request
2025-10-02T08:15:12.069633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642df5b1-d26446a-c85924c2-22831b93_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:12.076218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642df5b1-d26446a-c85924c2-22831b93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.076304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:12.076315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2302
2025-10-02T08:15:12.076420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.076441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:12.076447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:12.076449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:12.076710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2302 sessionId:  describe result for acl check
2025-10-02T08:15:12.076730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:12.076731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:12.076732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:12.076735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535019253482021:13269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:12.077127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535019253482021:13269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:12.078111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:12.079016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535019253482021:13269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:12.079219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:12.079466Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:12.079474Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:12.079483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:12.079530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:12.079564Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535019253482065:13268]
2025-10-02T08:15:12.080074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:12.080267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:12.080307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:12.080567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:12.080620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.080626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.080626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.080628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.080628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.080634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.080642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.080649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.080652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.080655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.080660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.080670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.080679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.080684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.080691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.080695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.080699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.080708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.080712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.080721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.080736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:12.081341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535019253482021:13269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:12.081351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535019253482021:13269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:12.081353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535019253482021:13269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:12.081360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:12.088102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:12.089487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:12.089501Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:12.089503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:12.089505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:12.089509Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2301 [1:7556535019253482065:13268]
2025-10-02T08:15:12.089517Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:12.089529Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:12.089532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.089534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.089535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.089547Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:12.089554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:12.089561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:12.089607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.089615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.089617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:12.089618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:12.089670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:12.089675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.089684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.089694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:12.089707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535019253482047:13268]
2025-10-02T08:15:12.089711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535019253482047:13268]
2025-10-02T08:15:12.089716Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:12.089725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:12.089736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:12.089737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:12.089737Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:12.089740Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:12.089744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253482084:13269], now have 1 active actors on pipe
2025-10-02T08:15:12.089744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2301
2025-10-02T08:15:12.089766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535019253482047:13268]
2025-10-02T08:15:12.089771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:12.089774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:12.089774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535019712954878:2378], now have 1 active actors on pipe
2025-10-02T08:15:12.089777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.089780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.089807Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:12.089814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.089817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.089820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:12.089826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.089832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:12.089843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.089828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2301
2025-10-02T08:15:12.089902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.089907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.089916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.089941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2302 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0
2025-10-02T08:15:12.090236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642df5b1-d26446a-c85924c2-22831b93_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:12.092635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0] Write session: try to update token
2025-10-02T08:15:12.092648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:12.105326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId: src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:12.106279Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:12.106291Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:12.106293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:12.106299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535019253482047:13268]
2025-10-02T08:15:12.106304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535019253482047:13268]
2025-10-02T08:15:12.106335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:12.106344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.106346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:12.106355Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:12.106360Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:12.106466Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:12.107886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:12.169801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535019253482099:12399]
2025-10-02T08:15:12.169930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2301, pipe: [1:7556535019253482099:12399]
2025-10-02T08:15:12.231906Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:12.232142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.232153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.232193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253482099:12399], now have 1 active actors on pipe
2025-10-02T08:15:12.232303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:12.232315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:12.232373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2302 reason: error at write: Disconnected sessionId: src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0
2025-10-02T08:15:12.232443Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:12.232532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2302 sessionId: src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0 is DEAD
2025-10-02T08:15:12.232617Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:12.232691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:12.232699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0] Write session will restart in 0.009805s
2025-10-02T08:15:12.232696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535019253482099:12399]
2025-10-02T08:15:12.232717Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:15:12.232738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0] Write session: Do CDS request
2025-10-02T08:15:12.232745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:12.232793Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 23 consumer shared/user session shared/user_1_23_13701838405486042660_v1 is DEAD
2025-10-02T08:15:12.232935Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:15:12.233019Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:15:12.233023Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:15:12.233011Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534937649066532:12396] disconnected; active server actors: 1
2025-10-02T08:15:12.233031Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.006686s
2025-10-02T08:15:12.233024Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556534937649066532:12396] client user disconnected session shared/user_1_23_13701838405486042660_v1
2025-10-02T08:15:12.240126Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:15:12.240290Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:15:12.240301Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 24
2025-10-02T08:15:12.240434Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 24 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:15:12.240489Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:15:12.240557Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 auth for : user
2025-10-02T08:15:12.240684Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 Handle describe topics response
2025-10-02T08:15:12.240704Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 auth is DEAD
2025-10-02T08:15:12.240720Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:15:12.240757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:12.240929Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:15:12.240999Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_24_12670745165275090981_v1
2025-10-02T08:15:12.241009Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:15:12.241089Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:15:12.241104Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535019253482330:13276] connected; active server actors: 1
2025-10-02T08:15:12.241213Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556535019253482330:13276] session shared/user_1_24_12670745165275090981_v1
2025-10-02T08:15:12.241232Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:15:12.241240Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:15:12.241246Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_24_12670745165275090981_v1" (Sender=[1:7556535019253482319:13276], Pipe=[1:7556535019253482330:13276], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:15:12.241254Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:15:12.241238Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:15:12.241266Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:15:12.241277Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_24_12670745165275090981_v1" (Sender=[1:7556535019253482319:13276], Pipe=[1:7556535019253482330:13276], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:15:12.241289Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_24_12670745165275090981_v1" sender [1:7556535019253482319:13276] lock partition 0 for ReadingSession "shared/user_1_24_12670745165275090981_v1" (Sender=[1:7556535019253482319:13276], Pipe=[1:7556535019253482330:13276], Partitions=[], ActiveFamilyCount=1) generation 1 step 24
2025-10-02T08:15:12.241303Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:15:12.241306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-02T08:15:12.241304Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 got read request: guid# 5b215b2b-1054dcc0-6f935ca8-71430594
2025-10-02T08:15:12.241506Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 24 Session: "shared/user_1_24_12670745165275090981_v1" ClientId: "user" PipeClient { RawX1: 7556535019253482330 RawX2: 4503603922351068 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:15:12.241527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:15:12.241763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:12.241918Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:12.241928Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:12.241937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:12.241983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:12.242017Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535019253482336:13274]
2025-10-02T08:15:12.242563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:12.242726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:12.242768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:12.243050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:12.243108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.243114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.243115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.243117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.243117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.243123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.243132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.243136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.243139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.243142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.243147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.243153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.243159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.243164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.243164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.243167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.243172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.243176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.243181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.243185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.243187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:12.243189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.243191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2303
2025-10-02T08:15:12.243209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:12.243359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.243389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:12.243397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:12.243400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:12.243703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2303 sessionId:  describe result for acl check
2025-10-02T08:15:12.243731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:12.243737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:12.243738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:12.243743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535019253482352:13280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:12.244198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535019253482352:13280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:12.245733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535019253482352:13280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:12.250305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535019253482352:13280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:12.250320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535019253482352:13280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:12.250322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535019253482352:13280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:12.250328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:12.250760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:12.252295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:12.252308Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:12.252310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:12.252314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:12.252320Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2302 [1:7556535019253482336:13274]
2025-10-02T08:15:12.252330Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:12.252344Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:12.252347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.252350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.252352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.252367Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:12.252376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:12.252382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:12.252440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.252446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.252449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:12.252453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:12.252518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:12.252526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.252536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.252537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2302
2025-10-02T08:15:12.252545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:12.252554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2302, pipe: [1:7556535019253482332:13279]
2025-10-02T08:15:12.252566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253482385:13280], now have 1 active actors on pipe
2025-10-02T08:15:12.252573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253482332:13279], now have 1 active actors on pipe
2025-10-02T08:15:12.252575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535019712954886:2378], now have 1 active actors on pipe
2025-10-02T08:15:12.252579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.252582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.252596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.252601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.252606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_24_12670745165275090981_v1 on pipe: [1:7556535019253482332:13279]
2025-10-02T08:15:12.252621Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535019253482324:13274]
2025-10-02T08:15:12.252623Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_24_12670745165275090981_v1:1 with generation 2302
2025-10-02T08:15:12.252627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535019253482324:13274]
2025-10-02T08:15:12.252633Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:12.252611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2302
2025-10-02T08:15:12.252642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:12.252644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:12.252650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:12.252657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:12.252659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:12.252673Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88e37506-21206ba2-61d35caf-b0df2e38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:12.252682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.252690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.252691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:12.252699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.252712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:12.252725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.252732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.252733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:12.252792Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_24_12670745165275090981_v1
2025-10-02T08:15:12.252798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.252858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535019253482324:13274]
2025-10-02T08:15:12.252870Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:12.252879Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:12.252884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.252899Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:12.252935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.252941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.253017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.253057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2303 partition: 0 MaxSeqNo: 17 sessionId: src_id|88e37506-21206ba2-61d35caf-b0df2e38_0
2025-10-02T08:15:12.253342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca9f14f0-ca5c927a-e74ac206-63615bf7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|88e37506-21206ba2-61d35caf-b0df2e38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:12.253455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:15:12.253478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:15:12.253489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.253491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.253492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.253498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:15:12.253506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:15:12.253550Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392912252 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:15:12.253564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:15:12.253586Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 sending to client partition status
2025-10-02T08:15:12.255720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e37506-21206ba2-61d35caf-b0df2e38_0] Write session: try to update token
2025-10-02T08:15:12.255733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e37506-21206ba2-61d35caf-b0df2e38_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:12.263677Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:12.263694Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:12.263703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535019253482324:13274]
2025-10-02T08:15:12.263746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:12.263748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:12.263901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:12.264034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:12.264184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:12.264313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:12.264491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:12.264531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:12.269601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId: src_id|88e37506-21206ba2-61d35caf-b0df2e38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:12.271901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:12.271967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.271979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.272010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:12.272033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:12.272084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.272092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.272268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.272327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.272388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.272447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.272489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.272497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.272562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.272621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.272682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.272745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.272786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.272794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.272882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.272941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.273002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.273059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.273102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.273108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.273172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.273231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.273292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.273353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.273403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.273410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.273475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.273532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.273590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.273651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.273695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.273702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.273774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.273832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.273894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.273954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.273994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.274001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.274063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.274119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.274181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.274245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.274286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.274292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.274356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.274414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.274470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.274529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.274570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.274577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.274638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.274694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.274756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.274813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.274952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.274961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.275024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.275080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.275140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.275199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.275242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.275248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.275283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:12.275349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.275372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.275379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:12.275408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:12.275423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:12.275431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:12.275438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:12.275441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:12.275818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:12.275844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:12.275849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:12.275852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:12.275855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:12.275858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:12.276295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:12.276314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:12.276319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:12.276327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:12.276330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:12.276337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:12.276852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:12.276866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:12.276878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:12.276881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:12.276884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:12.277987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:12.278004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:12.278014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392912277
2025-10-02T08:15:12.278173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:12.278188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:12.278193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:12.278199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:12.278203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:12.278208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:12.278626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:12.278647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:12.278655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:12.278664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:12.278672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:12.278675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:12.279117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:12.279137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:12.279142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:12.279151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:12.279154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:12.279157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:12.279573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:12.279617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:12.279627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:12.280654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:12.280671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:12.280675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:12.280678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:12.280685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392912280
2025-10-02T08:15:12.280963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:12.280985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:12.280990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:12.280993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:12.280996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:12.280999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:12.281421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:12.281442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:12.281448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:12.281452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:12.281456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:12.281459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:12.281864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:12.281882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.281982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392912281
2025-10-02T08:15:12.282697Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:12.282716Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:12.282723Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:12.282730Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:12.284227Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:12.284239Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:12.284241Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:12.284247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535019253482324:13274]
2025-10-02T08:15:12.284251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535019253482324:13274]
2025-10-02T08:15:12.284301Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:12.284304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:12.284309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.284311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:12.284317Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:12.284436Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:12.428839Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:12.429533Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:12.429452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_24_12670745165275090981_v1
2025-10-02T08:15:12.429467Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:12.430741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:12.430769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2303 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88e37506-21206ba2-61d35caf-b0df2e38_0
2025-10-02T08:15:12.430914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2303 sessionId: src_id|88e37506-21206ba2-61d35caf-b0df2e38_0 is DEAD
2025-10-02T08:15:12.431043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535019253482332:13279]
2025-10-02T08:15:12.431057Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_24_12670745165275090981_v1
2025-10-02T08:15:12.432955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e37506-21206ba2-61d35caf-b0df2e38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:12.432966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e37506-21206ba2-61d35caf-b0df2e38_0] Write session will restart in 0.007626s
2025-10-02T08:15:12.432991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e37506-21206ba2-61d35caf-b0df2e38_0] Write session: Do CDS request
2025-10-02T08:15:12.432999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e37506-21206ba2-61d35caf-b0df2e38_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:12.441261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e37506-21206ba2-61d35caf-b0df2e38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.441535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:12.441548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2304
2025-10-02T08:15:12.441687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:12.441708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.441733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:12.441738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:12.441741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:12.442160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2304 sessionId:  describe result for acl check
2025-10-02T08:15:12.442192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:12.442193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:12.442195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:12.442200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535019253482650:13287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:12.442705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535019253482650:13287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:12.443486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:12.443651Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:12.443654Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:12.443663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:12.443709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:12.443736Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535019253482662:13284]
2025-10-02T08:15:12.444366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:12.444584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:12.444623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:12.444930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:12.444975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.444980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.444981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.444982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.444983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.444988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.444998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.445002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.445006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.445011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.445016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.445024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.445030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.445034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.445039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.445044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.445048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.445054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.445059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.445064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.445084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:12.445548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535019253482650:13287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:12.452412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535019253482650:13287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:12.452427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535019253482650:13287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:12.452430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535019253482650:13287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:12.452442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:12.459973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:12.461662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:12.461679Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:12.461681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:12.461684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:12.461690Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2303 [1:7556535019253482662:13284]
2025-10-02T08:15:12.461702Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:12.461718Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:12.461721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.461724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.461726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.461740Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:12.461745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:12.461751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:12.461815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.461817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.461820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:12.461822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:12.461896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:12.461899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.461911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.461924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:12.461939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535019253482642:13284]
2025-10-02T08:15:12.461942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535019253482642:13284]
2025-10-02T08:15:12.461949Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:12.461961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:12.461967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:12.461970Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:12.461975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:12.461978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:12.461987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253482698:13287], now have 1 active actors on pipe
2025-10-02T08:15:12.462012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2303
2025-10-02T08:15:12.462018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535019253482642:13284]
2025-10-02T08:15:12.462021Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:12.462301Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2303
2025-10-02T08:15:12.462121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:12.462139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535019712954895:2378], now have 1 active actors on pipe
2025-10-02T08:15:12.462146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.462150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.462172Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:12.462179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.462182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.462184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:12.462194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.462204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:12.462217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.462259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.462262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.462280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.462310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2304 partition: 0 MaxSeqNo: 17 sessionId: src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0
2025-10-02T08:15:12.464903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e37506-21206ba2-61d35caf-b0df2e38_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:12.467612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0] Write session: try to update token
2025-10-02T08:15:12.467627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:12.481018Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:12.481036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:12.481038Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:12.481046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535019253482642:13284]
2025-10-02T08:15:12.481050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535019253482642:13284]
2025-10-02T08:15:12.481090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:12.481097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.481099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:12.481103Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:12.481109Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:12.481233Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:12.485448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId: src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:12.488077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:12.531305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535019253482714:13279]
2025-10-02T08:15:12.531542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2303, pipe: [1:7556535019253482714:13279]
2025-10-02T08:15:12.627002Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:12.627402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.627418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.627458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253482714:13279], now have 1 active actors on pipe
2025-10-02T08:15:12.627610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535019253482714:13279]
2025-10-02T08:15:12.627640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:12.627646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:12.627735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:12.627707Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:12.627719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2304 reason: error at write: Disconnected sessionId: src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0
2025-10-02T08:15:12.627892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2304 sessionId: src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0 is DEAD
2025-10-02T08:15:12.628025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:12.628036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0] Write session will restart in 0.005258s
2025-10-02T08:15:12.628062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0] Write session: Do CDS request
2025-10-02T08:15:12.628069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:12.634235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.634342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:12.634355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2305
2025-10-02T08:15:12.634455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.634483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:12.634492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:12.634506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:12.635141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2305 sessionId:  describe result for acl check
2025-10-02T08:15:12.635173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:12.635179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:12.635180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:12.635185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535019253482934:13292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:12.635654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535019253482934:13292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:12.636614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:12.637761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535019253482934:13292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:12.637848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:12.638004Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:12.638016Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:12.638025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:12.638071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:12.638111Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535019253482972:13291]
2025-10-02T08:15:12.638717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:12.638921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:12.638972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:12.639281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:12.639325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.639333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.639333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.639334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.639335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.639341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.639351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.639355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.639359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.639363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.639368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.639376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.639385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.639390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.639394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.639403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.639407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.639412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.639417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.639423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.639446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:12.640049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535019253482934:13292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:12.640065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535019253482934:13292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:12.640068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535019253482934:13292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:12.640075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:12.647422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:12.649369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:12.649389Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:12.649393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:12.649399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:12.649405Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2304 [1:7556535019253482972:13291]
2025-10-02T08:15:12.649418Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:12.649435Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:12.649438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.649441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.649443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.649460Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:12.649471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:12.649478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:12.649548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.649557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.649560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:12.649562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:12.649633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:12.649644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.649657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.649669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2304
2025-10-02T08:15:12.649670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:12.649691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253482997:13292], now have 1 active actors on pipe
2025-10-02T08:15:12.649694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535019712954903:2378], now have 1 active actors on pipe
2025-10-02T08:15:12.649699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.649705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.649723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535019253482955:13291]
2025-10-02T08:15:12.649732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535019253482955:13291]
2025-10-02T08:15:12.649746Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:12.649764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:12.649781Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:12.649785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:12.649788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:12.649792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:12.649802Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:12.649808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.649812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.649813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:12.649822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.649837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:12.649790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2304
2025-10-02T08:15:12.649877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535019253482955:13291]
2025-10-02T08:15:12.649889Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:12.649896Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:12.649909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.649961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.649970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.649984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.650020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2305 partition: 0 MaxSeqNo: 17 sessionId: src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0
2025-10-02T08:15:12.650351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f84e05-834ae3f2-7ac074d3-11d1d145_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:12.653116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0] Write session: try to update token
2025-10-02T08:15:12.653131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:12.666826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId: src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:12.667304Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:12.667324Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:12.667326Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:12.667335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535019253482955:13291]
2025-10-02T08:15:12.667338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535019253482955:13291]
2025-10-02T08:15:12.667378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:12.667384Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:12.667390Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:12.667390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.667393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:12.667522Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:12.669570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:12.727879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535019253483017:13279]
2025-10-02T08:15:12.727994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2304, pipe: [1:7556535019253483017:13279]
2025-10-02T08:15:12.810822Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:12.811041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.811052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.811082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253483017:13279], now have 1 active actors on pipe
2025-10-02T08:15:12.811264Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:12.811275Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:12.811457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535019253483017:13279]
2025-10-02T08:15:12.811474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:12.811509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2305 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0
2025-10-02T08:15:12.811630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2305 sessionId: src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0 is DEAD
2025-10-02T08:15:12.811779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:12.811787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0] Write session will restart in 0.005760s
2025-10-02T08:15:12.811802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0] Write session: Do CDS request
2025-10-02T08:15:12.811806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:12.818157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.818218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:12.818232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2306
2025-10-02T08:15:12.818322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:12.818350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:12.818358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:12.818361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:12.818779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2306 sessionId:  describe result for acl check
2025-10-02T08:15:12.818807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:12.818813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:12.818814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:12.818818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535019253483270:13309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:12.820086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:12.820194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535019253483270:13309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:12.821316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:12.821459Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:12.821467Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:12.821473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:12.821503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:12.821528Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535019253483306:13308]
2025-10-02T08:15:12.821894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:12.822267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535019253483270:13309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:12.822334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:12.822372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:12.822565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:12.822591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.822595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.822595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.822596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.822597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.822599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.822605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.822607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.822609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.822611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.822614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.822618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:12.822622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.822624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:12.822627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.822629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:12.822632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.822634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.822636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.822639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.822649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:12.828222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535019253483270:13309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:12.828241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535019253483270:13309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:12.828244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535019253483270:13309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:12.828254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:12.830195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:12.831739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:12.831756Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:12.831758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:12.831761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:12.831767Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2305 [1:7556535019253483306:13308]
2025-10-02T08:15:12.831777Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:12.831792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:12.831799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.831802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.831804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.831817Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:12.831826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:12.831832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:12.831894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.831902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.831905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:12.831907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:12.831967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:12.831974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.831988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:12.832004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:12.832024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253483333:13309], now have 1 active actors on pipe
2025-10-02T08:15:12.832031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535019712954929:2378], now have 1 active actors on pipe
2025-10-02T08:15:12.832037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535019253483282:13308]
2025-10-02T08:15:12.832039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535019253483282:13308]
2025-10-02T08:15:12.832050Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:12.832065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:12.832067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:12.832071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:12.832083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:12.832086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:12.832060Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2305
2025-10-02T08:15:12.832115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535019253483282:13308]
2025-10-02T08:15:12.832127Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:12.832141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:12.832184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2305
2025-10-02T08:15:12.832204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.832212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.832233Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdaf8668-e62fc52d-cafae603-377e077e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:12.832243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.832251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.832253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:12.832265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.832277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:12.832293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.832316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.832323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.832334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:12.832364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2306 partition: 0 MaxSeqNo: 17 sessionId: src_id|bdaf8668-e62fc52d-cafae603-377e077e_0
2025-10-02T08:15:12.832664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51185cd-9bbd2b26-7345f098-d96cfdd0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bdaf8668-e62fc52d-cafae603-377e077e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:12.834919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdaf8668-e62fc52d-cafae603-377e077e_0] Write session: try to update token
2025-10-02T08:15:12.834930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdaf8668-e62fc52d-cafae603-377e077e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:12.842433Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:12.842453Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:12.842460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535019253483282:13308]
2025-10-02T08:15:12.842489Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:12.842496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:12.842667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:12.842816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:12.842956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:12.843105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:12.843301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:12.843342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:12.847652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId: src_id|bdaf8668-e62fc52d-cafae603-377e077e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:12.850299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:12.850367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.850379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.850414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:12.850440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:12.850710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:12.850720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:12.850859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.850910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.850962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.851016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.851057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.851063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.851124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.851182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.851251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.851309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.851347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.851352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.851407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.851457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.851510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.851565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.851604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.851610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.851669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.851729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.851787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.851840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.851879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.851884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.851942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.851993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.852048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.852102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.852141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.852145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.852220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.852273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.852330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.852383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.852421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.852425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.852481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.852532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.852587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.852642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.852681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.852686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.852751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.852824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.852883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.852937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.853023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.853028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.853085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.853137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.853191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.853252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.853291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.853296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.853357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:12.853407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:12.853459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:12.853512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:12.853551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:12.853555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:12.853583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:12.853631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:12.853647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:12.853651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:12.853677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:12.853690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:12.853695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:12.853697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:12.853700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:12.854046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:12.854066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:12.854071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:12.854073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:12.854075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:12.854077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:12.854657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:12.854677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:12.854681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:12.854683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:12.854686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:12.854688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:12.855208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:12.855233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:12.855239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:12.855241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:12.855243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:12.856329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:12.856342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:12.856350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392912856
2025-10-02T08:15:12.856494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:12.856504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:12.856508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:12.856510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:12.856512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:12.856514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:12.856951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:12.856968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:12.856972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:12.856975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:12.856976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:12.856980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:12.857377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:12.857395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:12.857400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:12.857403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:12.857406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:12.857410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:12.857805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:12.857827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:12.857833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:12.858839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:12.858854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:12.858859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:12.858863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:12.858870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392912858
2025-10-02T08:15:12.859130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:12.859146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:12.859152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:12.859154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:12.859157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:12.859159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:12.859547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:12.859562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:12.859565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:12.859567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:12.859570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:12.859572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:12.859984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:12.859999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:12.860068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392912859
2025-10-02T08:15:12.860737Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:12.860758Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:12.860763Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:12.860767Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:12.862233Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:12.862245Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:12.862246Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:12.862252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535019253483282:13308]
2025-10-02T08:15:12.862255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535019253483282:13308]
2025-10-02T08:15:12.862298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:12.862299Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:12.862303Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:12.862305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:12.862309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:12.862424Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:12.911685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535019253483383:13279]
2025-10-02T08:15:12.911786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2305, pipe: [1:7556535019253483383:13279]
2025-10-02T08:15:12.998155Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:12.998643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535019253483383:13279], now have 1 active actors on pipe
2025-10-02T08:15:12.998773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535019253483383:13279]
2025-10-02T08:15:12.998799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:12.998802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:12.998828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2306 reason: error at write: Disconnected sessionId: src_id|bdaf8668-e62fc52d-cafae603-377e077e_0
2025-10-02T08:15:12.998859Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:12.998898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:12.999125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdaf8668-e62fc52d-cafae603-377e077e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:12.999136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdaf8668-e62fc52d-cafae603-377e077e_0] Write session will restart in 0.008448s
2025-10-02T08:15:12.998979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2306 sessionId: src_id|bdaf8668-e62fc52d-cafae603-377e077e_0 is DEAD
2025-10-02T08:15:12.999159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdaf8668-e62fc52d-cafae603-377e077e_0] Write session: Do CDS request
2025-10-02T08:15:12.999166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdaf8668-e62fc52d-cafae603-377e077e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:13.008290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdaf8668-e62fc52d-cafae603-377e077e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.008616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:13.008630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2307
2025-10-02T08:15:13.008726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.008756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:13.008765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:13.008770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:13.009149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2307 sessionId:  describe result for acl check
2025-10-02T08:15:13.009181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:13.009186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:13.009188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:13.009193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535023548450972:13321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:13.009649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535023548450972:13321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:13.009735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:13.010214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:13.010371Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:13.010380Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:13.010389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:13.010432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:13.010473Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535023548450984:13320]
2025-10-02T08:15:13.011091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:13.011274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:13.011328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:13.011654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:13.011706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.011712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.011713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.011714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.011715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.011720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.011729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.011733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.011737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.011742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.011747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.011754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.011760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.011766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.011770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.011776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.011780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.011785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.011794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.011799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.011814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535023548450972:13321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:13.011816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:13.017535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535023548450972:13321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:13.017552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535023548450972:13321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:13.017555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535023548450972:13321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:13.017564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:13.019577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:13.021210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:13.021226Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:13.021229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:13.021233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:13.021239Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2306 [1:7556535023548450984:13320]
2025-10-02T08:15:13.021251Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:13.021267Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:13.021270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.021273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.021275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.021289Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:13.021294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:13.021300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:13.021365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.021374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.021377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:13.021379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:13.021441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:13.021448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.021461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.021476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:13.021497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548451021:13321], now have 1 active actors on pipe
2025-10-02T08:15:13.021499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2306
2025-10-02T08:15:13.021512Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535023548450974:13320]
2025-10-02T08:15:13.021514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535023548450974:13320]
2025-10-02T08:15:13.021524Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:13.021533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535019712954958:2378], now have 1 active actors on pipe
2025-10-02T08:15:13.021540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.021543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.021552Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:13.021556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:13.021558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:13.021570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:13.021574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:13.021562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2306
2025-10-02T08:15:13.021615Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:13.021626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.021629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.021631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:13.021639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.021646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:13.021653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535023548450974:13320]
2025-10-02T08:15:13.021667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:13.021689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:13.021700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.021734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.021742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.021753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.021789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2307 partition: 0 MaxSeqNo: 17 sessionId: src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0
2025-10-02T08:15:13.022112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdaf8668-e62fc52d-cafae603-377e077e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:13.024665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0] Write session: try to update token
2025-10-02T08:15:13.024680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:13.037741Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:13.037760Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:13.037772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535023548450974:13320]
2025-10-02T08:15:13.037795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId: src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:13.037815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:13.037823Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:13.037985Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:13.038122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:13.038245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:13.038369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:13.038542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:13.038571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:13.040316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:13.040396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.040408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.040432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:13.040454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:13.040498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.040507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.040648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.040703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.040762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.040841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.040967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.040976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.041034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.041088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.041148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.041209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.041249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.041256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.041328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.041388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.041444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.041507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.041550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.041557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.041622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.041679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.041742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.041822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.041876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.041884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.041965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.042023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.042082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.042144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.042186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.042193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.042259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.042320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.042384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.042449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.042503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.042510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.042573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.042633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.042696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.042758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.042800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.042803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.042871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.042931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.042990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.043049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.043091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.043098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.043167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.043226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.043288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.043349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.043392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.043400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.043466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.043523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.043585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.043648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.043690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.043696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.043731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:13.043792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.043814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.043821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:13.043852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:13.043869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:13.043876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:13.043879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:13.043882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:13.044273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:13.044299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:13.044310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:13.044313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:13.044316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:13.044320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:13.044861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:13.044879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:13.044884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:13.044886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:13.044889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:13.044890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:13.045341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:13.045362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:13.045366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:13.045370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:13.045373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:13.047373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:13.047390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:13.047401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392913047
2025-10-02T08:15:13.047535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:13.047548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:13.047554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:13.047557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:13.047561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:13.047565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:13.048025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:13.048045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:13.048052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:13.048055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:13.048062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:13.048067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:13.048505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:13.048529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:13.048537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:13.048541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:13.048544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:13.048549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:13.049024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:13.049045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:13.049050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:13.050143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:13.050160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:13.050165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:13.050169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:13.050179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392913049
2025-10-02T08:15:13.050497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:13.050518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:13.050524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:13.050530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:13.050535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:13.050538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:13.051025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:13.051050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:13.051061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:13.051065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:13.051070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:13.051074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:13.051523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:13.051543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.051641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392913051
2025-10-02T08:15:13.055534Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:13.055561Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:13.055568Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:13.055575Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:13.057126Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:13.057140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:13.057141Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:13.057150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535023548450974:13320]
2025-10-02T08:15:13.057153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535023548450974:13320]
2025-10-02T08:15:13.057196Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:13.057199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:13.057205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.057206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:13.057212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:13.057334Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:13.099079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535023548451045:13279]
2025-10-02T08:15:13.099176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2306, pipe: [1:7556535023548451045:13279]
2025-10-02T08:15:13.187998Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:13.188325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548451045:13279], now have 1 active actors on pipe
2025-10-02T08:15:13.188436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535023548451045:13279]
2025-10-02T08:15:13.188466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:13.188468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:13.188496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2307 reason: error at write: Disconnected sessionId: src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0
2025-10-02T08:15:13.188540Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:13.188539Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:13.188662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2307 sessionId: src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0 is DEAD
2025-10-02T08:15:13.188789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:13.188828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0] Write session will restart in 0.006256s
2025-10-02T08:15:13.188852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0] Write session: Do CDS request
2025-10-02T08:15:13.188858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:13.196269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.196304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:13.196318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2308
2025-10-02T08:15:13.196469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.196497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:13.196507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:13.196510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:13.196798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2308 sessionId:  describe result for acl check
2025-10-02T08:15:13.196838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:13.196840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:13.196841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:13.196844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535023548451327:13328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:13.197257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535023548451327:13328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:13.197387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:13.198374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:13.198543Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:13.198555Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:13.198564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:13.198611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:13.198650Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535023548451352:13327]
2025-10-02T08:15:13.199271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:13.199425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:13.199464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:13.199743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:13.199783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.199789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.199791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.199792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.199793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.199798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.199808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.199812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.199822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.199826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.199830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.199838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.199848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.199853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.199857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.199862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.199871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.199876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.199880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.199889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.199908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:13.201100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535023548451327:13328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:13.206536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535023548451327:13328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:13.206551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535023548451327:13328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:13.206555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535023548451327:13328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:13.206566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:13.207500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:13.209151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:13.209168Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:13.209171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:13.209175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:13.209182Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2307 [1:7556535023548451352:13327]
2025-10-02T08:15:13.209193Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:13.209208Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:13.209213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.209215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.209217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.209232Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:13.209241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:13.209248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:13.209309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.209315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.209320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:13.209322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:13.209383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:13.209390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.209403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.209419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:13.209442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548451387:13328], now have 1 active actors on pipe
2025-10-02T08:15:13.209452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535023548451337:13327]
2025-10-02T08:15:13.209455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535023548451337:13327]
2025-10-02T08:15:13.209454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2307
2025-10-02T08:15:13.209461Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:13.209469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535024007922261:2378], now have 1 active actors on pipe
2025-10-02T08:15:13.209471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:13.209474Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:13.209475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:13.209489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:13.209496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:13.209503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.209509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.209544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535023548451337:13327]
2025-10-02T08:15:13.209553Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:13.209566Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c98209-7b10840c-5e165871-2ee29856_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:13.209570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:13.209575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.209542Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2307
2025-10-02T08:15:13.209578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.209580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:13.209587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.209596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:13.209633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.209703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.209709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.209722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.209755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2308 partition: 0 MaxSeqNo: 17 sessionId: src_id|45c98209-7b10840c-5e165871-2ee29856_0
2025-10-02T08:15:13.210048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84441fd0-10bf789b-27f7e06e-5bd0bcfa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45c98209-7b10840c-5e165871-2ee29856_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:13.212422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c98209-7b10840c-5e165871-2ee29856_0] Write session: try to update token
2025-10-02T08:15:13.212435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c98209-7b10840c-5e165871-2ee29856_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:13.225373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId: src_id|45c98209-7b10840c-5e165871-2ee29856_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:13.226263Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:13.226279Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:13.226281Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:13.226288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535023548451337:13327]
2025-10-02T08:15:13.226293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535023548451337:13327]
2025-10-02T08:15:13.226333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:13.226341Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:13.226344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.226347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:13.226347Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:13.226476Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:13.227570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:13.288535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535023548451401:13279]
2025-10-02T08:15:13.288700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2307, pipe: [1:7556535023548451401:13279]
2025-10-02T08:15:13.364551Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:13.364861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.364876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.364918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548451401:13279], now have 1 active actors on pipe
2025-10-02T08:15:13.365048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535023548451401:13279]
2025-10-02T08:15:13.365077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:13.365098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:13.365105Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:13.365162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2308 reason: error at write: Disconnected sessionId: src_id|45c98209-7b10840c-5e165871-2ee29856_0
2025-10-02T08:15:13.365176Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:13.365303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2308 sessionId: src_id|45c98209-7b10840c-5e165871-2ee29856_0 is DEAD
2025-10-02T08:15:13.365434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c98209-7b10840c-5e165871-2ee29856_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:13.365441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c98209-7b10840c-5e165871-2ee29856_0] Write session will restart in 0.007172s
2025-10-02T08:15:13.365465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c98209-7b10840c-5e165871-2ee29856_0] Write session: Do CDS request
2025-10-02T08:15:13.365471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c98209-7b10840c-5e165871-2ee29856_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:13.373219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c98209-7b10840c-5e165871-2ee29856_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.373260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:13.373273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2309
2025-10-02T08:15:13.373386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.373416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:13.373423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:13.373426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:13.373691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2309 sessionId:  describe result for acl check
2025-10-02T08:15:13.373717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:13.373721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:13.373722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:13.373726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535023548451693:13334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:13.373782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:13.374064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535023548451693:13334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:13.374290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:13.374411Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:13.374418Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:13.374425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:13.374456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:13.374486Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535023548451705:13333]
2025-10-02T08:15:13.374852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:13.374995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:13.375032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:13.375236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:13.375267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.375269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.375270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.375270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.375271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.375274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.375280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.375282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.375284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.375285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.375289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.375293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.375296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.375299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.375301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.375304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.375306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.375309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.375311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.375313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.375323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:13.375553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535023548451693:13334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:13.381004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535023548451693:13334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:13.381021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535023548451693:13334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:13.381024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535023548451693:13334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:13.381032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:13.383020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:13.384512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:13.384527Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:13.384529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:13.384531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:13.384536Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2308 [1:7556535023548451705:13333]
2025-10-02T08:15:13.384544Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:13.384556Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:13.384558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.384560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.384561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.384574Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:13.384578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:13.384582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:13.384624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.384630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.384632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:13.384634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:13.384679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:13.384685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.384693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.384699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:13.384711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535023548451694:13333]
2025-10-02T08:15:13.384716Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535023548451694:13333]
2025-10-02T08:15:13.384722Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:13.384730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:13.384741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:13.384742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:13.384745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:13.384747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:13.384749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2308
2025-10-02T08:15:13.384754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548451745:13334], now have 1 active actors on pipe
2025-10-02T08:15:13.384776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535024007922269:2378], now have 1 active actors on pipe
2025-10-02T08:15:13.384781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535023548451694:13333]
2025-10-02T08:15:13.384786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:13.384790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.384793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.384799Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:13.384839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2308
2025-10-02T08:15:13.384866Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:13.384875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.384878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.384879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:13.384887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.384893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:13.384909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.384948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.384952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.384962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.384990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2309 partition: 0 MaxSeqNo: 17 sessionId: src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0
2025-10-02T08:15:13.385259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c98209-7b10840c-5e165871-2ee29856_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:13.387633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0] Write session: try to update token
2025-10-02T08:15:13.387645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:13.400158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId: src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:13.401597Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:13.401618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:13.401620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:13.401629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535023548451694:13333]
2025-10-02T08:15:13.401636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535023548451694:13333]
2025-10-02T08:15:13.401677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:13.401684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.401686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:13.401692Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:13.401699Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:13.401829Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:13.402580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:13.465186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535023548451761:13279]
2025-10-02T08:15:13.465335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2308, pipe: [1:7556535023548451761:13279]
2025-10-02T08:15:13.530247Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:13.530504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.530514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.530544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548451761:13279], now have 1 active actors on pipe
2025-10-02T08:15:13.530649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535023548451761:13279]
2025-10-02T08:15:13.530669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:13.530671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:13.530718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2309 reason: error at write: Disconnected sessionId: src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0
2025-10-02T08:15:13.530788Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:13.530796Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:13.530872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2309 sessionId: src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0 is DEAD
2025-10-02T08:15:13.531018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:13.531030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0] Write session will restart in 0.005030s
2025-10-02T08:15:13.531053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0] Write session: Do CDS request
2025-10-02T08:15:13.531059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:13.537236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.537255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:13.537271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2310
2025-10-02T08:15:13.537571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.537602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:13.537606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:13.537610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:13.538015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2310 sessionId:  describe result for acl check
2025-10-02T08:15:13.538060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:13.538066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:13.538068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:13.538073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535023548452023:13341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:13.538534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535023548452023:13341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:13.539823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:13.540142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535023548452023:13341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:13.540388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:13.540538Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:13.540547Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:13.540557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:13.540604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:13.540643Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535023548452084:13340]
2025-10-02T08:15:13.541214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:13.541404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:13.541452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:13.541758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:13.541801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.541806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.541807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.541808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.541809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.541814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.541824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.541827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.541831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.541835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.541840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.541847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.541852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.541857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.541861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.541866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.541871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.541876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.541880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.541885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.541902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:13.544335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535023548452023:13341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:13.544349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535023548452023:13341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:13.544353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535023548452023:13341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:13.544361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:13.549803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:13.551511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:13.551531Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:13.551534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:13.551538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:13.551545Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2309 [1:7556535023548452084:13340]
2025-10-02T08:15:13.551558Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:13.551576Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:13.551579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.551583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.551585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.551601Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:13.551606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:13.551613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:13.551797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.551808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.551811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:13.551814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:13.551887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:13.551895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.551910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.551929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:13.551953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548452106:13341], now have 1 active actors on pipe
2025-10-02T08:15:13.551957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2309
2025-10-02T08:15:13.551961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535024007922275:2378], now have 1 active actors on pipe
2025-10-02T08:15:13.551967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535023548452072:13340]
2025-10-02T08:15:13.551970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535023548452072:13340]
2025-10-02T08:15:13.551983Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:13.552003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.552009Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:13.552012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.552014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:13.552027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:13.552047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:13.552055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:13.552025Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2309
2025-10-02T08:15:13.552098Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:13.552109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.552113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.552115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:13.552125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.552134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:13.552154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535023548452072:13340]
2025-10-02T08:15:13.552175Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:13.552176Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:13.552197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.552259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.552266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.552280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.552321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2310 partition: 0 MaxSeqNo: 17 sessionId: src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0
2025-10-02T08:15:13.552620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41e5dca1-d60aac6f-1eefbd64-344396d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:13.555340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0] Write session: try to update token
2025-10-02T08:15:13.555361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:13.569487Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:13.569508Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:13.569511Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:13.569520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535023548452072:13340]
2025-10-02T08:15:13.569525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535023548452072:13340]
2025-10-02T08:15:13.569570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:13.569574Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:13.569576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.569578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:13.569581Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:13.569713Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:13.569824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId: src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:13.572503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:13.631072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535023548452120:13279]
2025-10-02T08:15:13.631181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2309, pipe: [1:7556535023548452120:13279]
2025-10-02T08:15:13.703282Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:13.703510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.703519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.703552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548452120:13279], now have 1 active actors on pipe
2025-10-02T08:15:13.703717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:13.703729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:13.703753Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:13.703805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2310 reason: error at write: Disconnected sessionId: src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0
2025-10-02T08:15:13.703920Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:13.704106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:13.704116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0] Write session will restart in 0.005501s
2025-10-02T08:15:13.704139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0] Write session: Do CDS request
2025-10-02T08:15:13.704145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:13.703964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2310 sessionId: src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0 is DEAD
2025-10-02T08:15:13.704020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535023548452120:13279]
2025-10-02T08:15:13.710243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.710274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:13.710291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2311
2025-10-02T08:15:13.710445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.710480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:13.710489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:13.710493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:13.710817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2311 sessionId:  describe result for acl check
2025-10-02T08:15:13.710838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:13.710842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:13.710843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:13.710846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535023548452379:13347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:13.711287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535023548452379:13347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:13.712865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:13.713357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535023548452379:13347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:13.713375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:13.713479Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:13.713489Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:13.713496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:13.713522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:13.713548Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535023548452444:13346]
2025-10-02T08:15:13.713920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:13.714079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:13.714111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:13.714306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:13.714333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.714337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.714338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.714338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.714339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.714342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.714348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.714349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.714351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.714353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.714356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.714360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.714363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.714366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.714368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.714371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.714373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.714375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.714377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.714380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.714389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:13.718799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535023548452379:13347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:13.718813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535023548452379:13347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:13.718815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535023548452379:13347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:13.718821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:13.721786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:13.723279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:13.723295Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:13.723297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:13.723300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:13.723305Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2310 [1:7556535023548452444:13346]
2025-10-02T08:15:13.723314Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:13.723326Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:13.723328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.723330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.723331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.723343Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:13.723346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:13.723351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:13.723397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.723404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.723406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:13.723408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:13.723460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:13.723467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.723475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.723482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:13.723494Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535023548452437:13346]
2025-10-02T08:15:13.723500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535023548452437:13346]
2025-10-02T08:15:13.723506Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:13.723516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548452471:13347], now have 1 active actors on pipe
2025-10-02T08:15:13.723522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:13.723525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:13.723526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:13.723533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:13.723536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:13.723540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535024007922282:2378], now have 1 active actors on pipe
2025-10-02T08:15:13.723541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2310
2025-10-02T08:15:13.723564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.723573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.723583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535023548452437:13346]
2025-10-02T08:15:13.723593Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:13.723610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:13.723614Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:13.723622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.723631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.723633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:13.723641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.723653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:13.723673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.723643Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2310
2025-10-02T08:15:13.723718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.723724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.723734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.723767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2311 partition: 0 MaxSeqNo: 17 sessionId: src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0
2025-10-02T08:15:13.724060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3604f6b-7016cecf-cb130fbf-4d8e574a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:13.726564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0] Write session: try to update token
2025-10-02T08:15:13.726580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:13.739497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId: src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:13.740511Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:13.740530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:13.740532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:13.740540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535023548452437:13346]
2025-10-02T08:15:13.740544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535023548452437:13346]
2025-10-02T08:15:13.740590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:13.740597Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:13.740601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:13.740602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.740604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:13.740742Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:13.742021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:13.804080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535023548452497:13279]
2025-10-02T08:15:13.804151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2310, pipe: [1:7556535023548452497:13279]
2025-10-02T08:15:13.870852Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:13.871713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.871729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.871758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548452497:13279], now have 1 active actors on pipe
2025-10-02T08:15:13.871876Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:13.871923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:13.872075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535023548452497:13279]
2025-10-02T08:15:13.872095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:13.872144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2311 reason: status is not ok: tablet will be restarted right now sessionId: src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0
2025-10-02T08:15:13.872307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2311 sessionId: src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0 is DEAD
2025-10-02T08:15:13.872438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:13.872445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0] Write session will restart in 0.006291s
2025-10-02T08:15:13.872471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0] Write session: Do CDS request
2025-10-02T08:15:13.872476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:13.880236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.880289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:13.880304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2312
2025-10-02T08:15:13.880533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:13.880640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:13.880668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:13.880675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:13.880677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:13.881006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:13.881048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2312 sessionId:  describe result for acl check
2025-10-02T08:15:13.881074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:13.881080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:13.881081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:13.881084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535023548452816:13361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:13.881173Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:13.881184Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:13.881193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:13.881238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:13.881275Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535023548452817:13359]
2025-10-02T08:15:13.881874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:13.882447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:13.882502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:13.882716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535023548452816:13361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:13.882809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:13.882860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.882866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.882867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.882868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.882869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.882874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.882883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.882887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.882891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.882896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.882900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.882908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:13.882914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.882919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:13.882923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.882927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:13.882931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.882936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.882940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.882949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.882967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:13.884881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535023548452816:13361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:13.889905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535023548452816:13361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:13.889918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535023548452816:13361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:13.889921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535023548452816:13361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:13.889929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:13.890427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:13.891914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:13.891927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:13.891928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:13.891930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:13.891934Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2311 [1:7556535023548452817:13359]
2025-10-02T08:15:13.891940Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:13.891952Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:13.891954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.891956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.891957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.891968Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:13.891971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:13.891976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:13.892018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.892026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.892028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:13.892030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:13.892079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:13.892085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.892092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:13.892098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:13.892103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2311
2025-10-02T08:15:13.892111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548452876:13361], now have 1 active actors on pipe
2025-10-02T08:15:13.892113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535024007922309:2378], now have 1 active actors on pipe
2025-10-02T08:15:13.892116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.892118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.892131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535023548452809:13359]
2025-10-02T08:15:13.892133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535023548452809:13359]
2025-10-02T08:15:13.892141Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:13.892150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:13.892157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:13.892168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:13.892171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:13.892154Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2311
2025-10-02T08:15:13.892172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:13.892187Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18851978-af6c125-7025f2fd-5b1692bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:13.892191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.892193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.892194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:13.892200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.892207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:13.892232Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535023548452809:13359]
2025-10-02T08:15:13.892238Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:13.892246Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:13.892253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.892337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.892343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.892353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:13.892379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2312 partition: 0 MaxSeqNo: 17 sessionId: src_id|18851978-af6c125-7025f2fd-5b1692bc_0
2025-10-02T08:15:13.892697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882b2e0e-21c891db-b84000f1-f9faa6c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|18851978-af6c125-7025f2fd-5b1692bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:13.895358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18851978-af6c125-7025f2fd-5b1692bc_0] Write session: try to update token
2025-10-02T08:15:13.895376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18851978-af6c125-7025f2fd-5b1692bc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:13.903620Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:13.903640Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:13.903647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535023548452809:13359]
2025-10-02T08:15:13.903684Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:13.903691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:13.903857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:13.903997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:13.904144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:13.904315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:13.904520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:13.904560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:13.909011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId: src_id|18851978-af6c125-7025f2fd-5b1692bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:13.911492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:13.911556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.911569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.911600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:13.911622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:13.911670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:13.911686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:13.911853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.911929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.911990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.912059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.912250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.912261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.912339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.912419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.912485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.912551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.912595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.912602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.912666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.912735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.912795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.912872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.912913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.912920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.912981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.913038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.913092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.913146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.913188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.913193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.913250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.913304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.913359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.913412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.913451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.913456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.913510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.913561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.913614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.913670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.913708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.913714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.913767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.913830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.913888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.913940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.913978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.913983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.914037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.914087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.914140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.914195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.914233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.914238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.914295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.914353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.914406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.914459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.914500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.914505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.914561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:13.914610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:13.914662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:13.914714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:13.914751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:13.914756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:13.914783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:13.914839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:13.914854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:13.914860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:13.914885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:13.914898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:13.914904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:13.914906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:13.914908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:13.915239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:13.915261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:13.915270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:13.915272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:13.915274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:13.915277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:13.915725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:13.915747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:13.915751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:13.915754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:13.915756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:13.915759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:13.916192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:13.916208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:13.916211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:13.916214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:13.916217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:13.918448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:13.918471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:13.918488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392913918
2025-10-02T08:15:13.918624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:13.918640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:13.918649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:13.918653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:13.918659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:13.918662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:13.919176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:13.919200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:13.919207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:13.919210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:13.919213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:13.919216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:13.919687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:13.919714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:13.919729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:13.919736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:13.919739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:13.919741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:13.920231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:13.920257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:13.920267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:13.921400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:13.921418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:13.921423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:13.921429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:13.921437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392913921
2025-10-02T08:15:13.921732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:13.921754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:13.921763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:13.921767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:13.921770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:13.921775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:13.922218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:13.922241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:13.922246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:13.922250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:13.922253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:13.922256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:13.922697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:13.922718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:13.922817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392913922
2025-10-02T08:15:13.926601Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:13.926649Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:13.926660Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:13.926667Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:13.928129Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:13.928143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:13.928145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:13.928158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535023548452809:13359]
2025-10-02T08:15:13.928175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535023548452809:13359]
2025-10-02T08:15:13.928232Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:13.928234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:13.928239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:13.928241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:13.928242Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:13.928379Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:13.972057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535023548452905:13279]
2025-10-02T08:15:13.972193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2311, pipe: [1:7556535023548452905:13279]
2025-10-02T08:15:14.071000Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:14.071403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535023548452905:13279], now have 1 active actors on pipe
2025-10-02T08:15:14.071558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535023548452905:13279]
2025-10-02T08:15:14.071580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:14.071586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:14.071615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2312 reason: error at write: Disconnected sessionId: src_id|18851978-af6c125-7025f2fd-5b1692bc_0
2025-10-02T08:15:14.071647Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:14.071671Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:14.071792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2312 sessionId: src_id|18851978-af6c125-7025f2fd-5b1692bc_0 is DEAD
2025-10-02T08:15:14.071884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18851978-af6c125-7025f2fd-5b1692bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:14.071894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18851978-af6c125-7025f2fd-5b1692bc_0] Write session will restart in 0.009850s
2025-10-02T08:15:14.071918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18851978-af6c125-7025f2fd-5b1692bc_0] Write session: Do CDS request
2025-10-02T08:15:14.071924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18851978-af6c125-7025f2fd-5b1692bc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:14.081473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:14.082309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:14.082449Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:14.082457Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:14.082466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:14.082507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:14.082538Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535027843420507:13371]
2025-10-02T08:15:14.083015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:14.083235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:14.083261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18851978-af6c125-7025f2fd-5b1692bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.083280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:14.083384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:14.083394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2313
2025-10-02T08:15:14.083495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.083521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:14.083530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:14.083533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:14.083570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:14.083637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.083643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.083643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.083644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.083645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.083650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.083659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.083662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.083665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.083668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.083682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.083688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.083693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.083698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.083702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.083706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.083709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.083714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.083718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.083721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.083737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:14.083867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2313 sessionId:  describe result for acl check
2025-10-02T08:15:14.083894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:14.083901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:14.083902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:14.083907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535027843420521:13373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:14.084371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535027843420521:13373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:14.086860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535027843420521:13373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:14.090945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535027843420521:13373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:14.090964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535027843420521:13373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:14.090967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535027843420521:13373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:14.090976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:14.091491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:14.093048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:14.093060Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:14.093063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:14.093067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:14.093072Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2312 [1:7556535027843420507:13371]
2025-10-02T08:15:14.093082Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:14.093098Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:14.093101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.093103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.093106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.093121Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:14.093128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:14.093141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:14.093205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.093211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.093213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:14.093216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:14.093280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:14.093286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.093298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.093314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:14.093334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843420555:13373], now have 1 active actors on pipe
2025-10-02T08:15:14.093341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535028302889628:2378], now have 1 active actors on pipe
2025-10-02T08:15:14.093347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535027843420501:13371]
2025-10-02T08:15:14.093352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535027843420501:13371]
2025-10-02T08:15:14.093363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:14.093377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:14.093382Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:14.093385Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:14.093392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:14.093397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:14.093402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2312
2025-10-02T08:15:14.093430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.093437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.093450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535027843420501:13371]
2025-10-02T08:15:14.093465Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:14.093471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:14.093417Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2312
2025-10-02T08:15:14.093494Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:14.093503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.093506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.093509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:14.093518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.093529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:14.093552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.093587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.093593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.093604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.093634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2313 partition: 0 MaxSeqNo: 17 sessionId: src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0
2025-10-02T08:15:14.094127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18851978-af6c125-7025f2fd-5b1692bc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:14.096668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0] Write session: try to update token
2025-10-02T08:15:14.096686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:14.110096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId: src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:14.111055Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:14.111070Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:14.111072Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:14.111080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535027843420501:13371]
2025-10-02T08:15:14.111084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535027843420501:13371]
2025-10-02T08:15:14.111128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:14.111140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.111147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:14.111246Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:14.111261Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:14.111284Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:14.112573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:14.171737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535027843420570:13279]
2025-10-02T08:15:14.171867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2312, pipe: [1:7556535027843420570:13279]
2025-10-02T08:15:14.248564Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:14.248894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.248912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.248951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843420570:13279], now have 1 active actors on pipe
2025-10-02T08:15:14.249048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535027843420570:13279]
2025-10-02T08:15:14.249073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:14.249075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:14.249128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2313 reason: error at write: Disconnected sessionId: src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0
2025-10-02T08:15:14.249185Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:14.249172Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:14.249294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2313 sessionId: src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0 is DEAD
2025-10-02T08:15:14.249448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:14.249459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0] Write session will restart in 0.007805s
2025-10-02T08:15:14.249485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0] Write session: Do CDS request
2025-10-02T08:15:14.249491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:14.258235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.258297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:14.258313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2314
2025-10-02T08:15:14.258457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.258508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:14.258516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:14.258519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:14.258912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2314 sessionId:  describe result for acl check
2025-10-02T08:15:14.258944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:14.258951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:14.258952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:14.258956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535027843420860:13378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:14.259446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535027843420860:13378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:14.260576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:14.261210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:14.261382Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:14.261391Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:14.261399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:14.261417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535027843420860:13378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:14.261442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:14.261478Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535027843420897:13377]
2025-10-02T08:15:14.261905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:14.262063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:14.262112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:14.262331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:14.262369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.262375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.262375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.262376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.262376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.262380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.262386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.262388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.262390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.262392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.262396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.262401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.262405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.262408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.262411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.262413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.262415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.262418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.262420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.262422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.262431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:14.266881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535027843420860:13378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:14.266908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535027843420860:13378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:14.266911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535027843420860:13378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:14.266919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:14.270110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:14.271681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:14.271698Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:14.271699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:14.271703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:14.271709Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2313 [1:7556535027843420897:13377]
2025-10-02T08:15:14.271723Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:14.271737Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:14.271740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.271743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.271745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.271759Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:14.271764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:14.271771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:14.271840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.271847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.271861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:14.271868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:14.271934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:14.271941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.271953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.271968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:14.271991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2313
2025-10-02T08:15:14.271993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843420924:13378], now have 1 active actors on pipe
2025-10-02T08:15:14.271996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535028302889636:2378], now have 1 active actors on pipe
2025-10-02T08:15:14.272003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535027843420888:13377]
2025-10-02T08:15:14.272005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535027843420888:13377]
2025-10-02T08:15:14.272016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:14.272026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.272029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.272032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:14.272036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:14.272046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:14.272060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:14.272070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:14.272048Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2313
2025-10-02T08:15:14.272107Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:14.272117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.272121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.272124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:14.272132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.272144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:14.272168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535027843420888:13377]
2025-10-02T08:15:14.272180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:14.272188Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:14.272204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.272236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.272245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.272264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.272303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2314 partition: 0 MaxSeqNo: 17 sessionId: src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0
2025-10-02T08:15:14.272583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0050b-7e7fdbe9-39e09969-dff7028f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:14.275270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0] Write session: try to update token
2025-10-02T08:15:14.275284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:14.288140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId: src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:14.288856Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:14.288869Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:14.288871Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:14.288877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535027843420888:13377]
2025-10-02T08:15:14.288880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535027843420888:13377]
2025-10-02T08:15:14.288911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:14.288920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:14.288922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:14.288925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.288927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:14.289047Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:14.290482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:14.349480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535027843420938:13279]
2025-10-02T08:15:14.349635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2313, pipe: [1:7556535027843420938:13279]
2025-10-02T08:15:14.422097Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:14.422346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.422360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.422396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843420938:13279], now have 1 active actors on pipe
2025-10-02T08:15:14.422816Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:14.422482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:14.422494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:14.422552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2314 reason: error at write: Disconnected sessionId: src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0
2025-10-02T08:15:14.422719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2314 sessionId: src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0 is DEAD
2025-10-02T08:15:14.422840Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:14.422894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535027843420938:13279]
2025-10-02T08:15:14.423799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:14.423811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0] Write session will restart in 0.006626s
2025-10-02T08:15:14.423835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0] Write session: Do CDS request
2025-10-02T08:15:14.423842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:14.431203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.431267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:14.431283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2315
2025-10-02T08:15:14.431396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.431425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:14.431434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:14.431437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:14.431825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2315 sessionId:  describe result for acl check
2025-10-02T08:15:14.431856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:14.431862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:14.431864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:14.431868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535027843421118:13384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:14.432543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535027843421118:13384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:14.435103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535027843421118:13384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:14.436881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:14.437501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:14.437706Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:14.437717Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:14.437727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:14.437798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535027843421118:13384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:14.437801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:14.437811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535027843421118:13384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:14.437813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535027843421118:13384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:14.437821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:14.437877Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535027843421277:13383]
2025-10-02T08:15:14.438412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:14.438571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:14.438612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:14.438803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:14.438826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.438827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.438828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.438828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.438829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.438832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.438839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.438841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.438843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.438845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.438848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.438853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.438856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.438860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.438862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.438866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.438868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.438870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.438872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.438874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.438883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:14.446687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:14.448036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:14.448068Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:14.448070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:14.448075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:14.448081Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2314 [1:7556535027843421277:13383]
2025-10-02T08:15:14.448092Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:14.448111Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:14.448118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.448121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.448124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.448139Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:14.448148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:14.448154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:14.448232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.448238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.448241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:14.448242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:14.448290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:14.448295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.448303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.448309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:14.448326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535027843421271:13383]
2025-10-02T08:15:14.448332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535027843421271:13383]
2025-10-02T08:15:14.448339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:14.448346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:14.448354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843421282:13384], now have 1 active actors on pipe
2025-10-02T08:15:14.448355Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:14.448356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2314
2025-10-02T08:15:14.448360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:14.448372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:14.448375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:14.448383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535028302889643:2378], now have 1 active actors on pipe
2025-10-02T08:15:14.448417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.448427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.448401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2314
2025-10-02T08:15:14.448439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535027843421271:13383]
2025-10-02T08:15:14.448450Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:14.448453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:14.448475Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b81e5f44-89b8db65-9df950a6-5534023d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:14.448489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.448495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.448496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:14.448503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.448510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:14.448530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.448573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.448578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.448591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.448624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2315 partition: 0 MaxSeqNo: 17 sessionId: src_id|b81e5f44-89b8db65-9df950a6-5534023d_0
2025-10-02T08:15:14.448931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91c9e36-22fbfe9a-a4a4703e-3132b6e8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b81e5f44-89b8db65-9df950a6-5534023d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:14.451308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b81e5f44-89b8db65-9df950a6-5534023d_0] Write session: try to update token
2025-10-02T08:15:14.451321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b81e5f44-89b8db65-9df950a6-5534023d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:14.463312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId: src_id|b81e5f44-89b8db65-9df950a6-5534023d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:14.465193Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:14.465209Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:14.465211Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:14.465219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535027843421271:13383]
2025-10-02T08:15:14.465222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535027843421271:13383]
2025-10-02T08:15:14.465257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:14.465265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.465264Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:14.465267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:14.465270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:14.465390Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:14.465724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:14.522972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535027843421310:13279]
2025-10-02T08:15:14.523094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2314, pipe: [1:7556535027843421310:13279]
2025-10-02T08:15:14.595152Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:14.595629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.595645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.595683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843421310:13279], now have 1 active actors on pipe
2025-10-02T08:15:14.595804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535027843421310:13279]
2025-10-02T08:15:14.595833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:14.595836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:14.595895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2315 reason: error at write: Disconnected sessionId: src_id|b81e5f44-89b8db65-9df950a6-5534023d_0
2025-10-02T08:15:14.595898Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:14.595932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:14.596067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2315 sessionId: src_id|b81e5f44-89b8db65-9df950a6-5534023d_0 is DEAD
2025-10-02T08:15:14.596205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81e5f44-89b8db65-9df950a6-5534023d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:14.596216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81e5f44-89b8db65-9df950a6-5534023d_0] Write session will restart in 0.005869s
2025-10-02T08:15:14.596240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81e5f44-89b8db65-9df950a6-5534023d_0] Write session: Do CDS request
2025-10-02T08:15:14.596247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81e5f44-89b8db65-9df950a6-5534023d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:14.603283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b81e5f44-89b8db65-9df950a6-5534023d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.603358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:14.603376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2316
2025-10-02T08:15:14.603479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.603503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:14.603506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:14.603509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:14.603949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2316 sessionId:  describe result for acl check
2025-10-02T08:15:14.603983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:14.603988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:14.603990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:14.603995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535027843421458:13393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:14.604482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535027843421458:13393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:14.606801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535027843421458:13393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:14.609906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535027843421458:13393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:14.609919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535027843421458:13393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:14.609922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535027843421458:13393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:14.609930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:14.611221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:14.611730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:14.611868Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:14.611877Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:14.611886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:14.611925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:14.611964Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535027843421660:13392]
2025-10-02T08:15:14.612595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:14.612738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:14.612771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:14.613071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:14.613114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.613119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.613120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.613121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.613122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.613127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.613136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.613140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.613144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.613148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.613152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.613159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.613164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.613169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.613173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.613177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.613181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.613191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.613198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.613203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.613227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:14.621133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:14.622869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:14.622891Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:14.622894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:14.622897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:14.622903Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2315 [1:7556535027843421660:13392]
2025-10-02T08:15:14.622915Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:14.622933Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:14.622940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.622944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.622946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.622962Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:14.622971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:14.622979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:14.623048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.623055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.623058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:14.623060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:14.623127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:14.623134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.623148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.623158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:14.623178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535027843421654:13392]
2025-10-02T08:15:14.623184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535027843421654:13392]
2025-10-02T08:15:14.623191Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:14.623199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2315
2025-10-02T08:15:14.623202Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:14.623206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:14.623206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843421639:13393], now have 1 active actors on pipe
2025-10-02T08:15:14.623212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535028302889650:2378], now have 1 active actors on pipe
2025-10-02T08:15:14.623217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:14.623234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:14.623240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:14.623248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.623256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.623293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535027843421654:13392]
2025-10-02T08:15:14.623299Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:14.623308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:14.623313Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:14.623322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.623330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.623332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:14.623340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.623354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:14.623388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.623431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.623437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.623401Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2315
2025-10-02T08:15:14.623455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.623495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2316 partition: 0 MaxSeqNo: 17 sessionId: src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0
2025-10-02T08:15:14.623880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b81e5f44-89b8db65-9df950a6-5534023d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:14.626523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0] Write session: try to update token
2025-10-02T08:15:14.626541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:14.634369Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:14.634391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:14.634400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535027843421654:13392]
2025-10-02T08:15:14.634445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:14.634620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:14.634772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:14.634919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:14.635062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:14.635258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:14.635303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:14.635374Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:14.641495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId: src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:14.644121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:14.644189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.644197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.644227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:14.644250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:14.644319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.644322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.644479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.644539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.644601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.644661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.644703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.644707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.644775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.644868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.644931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.645005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.645051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.645064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.645138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.645209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.645280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.645345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.645391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.645399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.645466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.645534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.645599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.645662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.645709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.645716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.645783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.645846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.645913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.645982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.646028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.646036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.646102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.646165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.646231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.646299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.646343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.646351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.646415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.646477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.646544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.646612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.646655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.646662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.646731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.646798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.646865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.646934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.646979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.646986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.647055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.647116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.647182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.647249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.647295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.647302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.647366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.647435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.647498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.647560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.647603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.647610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.647645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:14.647710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.647732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.647739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:14.647768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:14.647784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:14.647791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:14.647794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:14.647796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:14.648195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:14.648218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:14.648225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:14.648228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:14.648235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:14.648240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:14.648709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:14.648731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:14.648736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:14.648739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:14.648741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:14.648744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:14.649318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:14.649345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:14.649353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:14.649357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:14.649360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:14.650587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:14.650610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:14.650620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392914650
2025-10-02T08:15:14.650736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:14.650750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:14.650756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:14.650759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:14.650764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:14.650768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:14.651255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:14.651278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:14.651289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:14.651294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:14.651301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:14.651305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:14.651782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:14.651803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:14.651813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:14.651821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:14.651824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:14.651827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:14.652308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:14.652329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:14.652339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:14.653448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:14.653467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:14.653474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:14.653477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:14.653485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392914653
2025-10-02T08:15:14.653794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:14.653818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:14.653823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:14.653826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:14.653829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:14.653833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:14.654309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:14.654331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:14.654336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:14.654345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:14.654348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:14.654351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:14.654810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:14.654830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.654930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392914654
2025-10-02T08:15:14.655691Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:14.655714Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:14.655723Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:14.655730Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:14.657380Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:14.657396Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:14.657398Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:14.657408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535027843421654:13392]
2025-10-02T08:15:14.657412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535027843421654:13392]
2025-10-02T08:15:14.657464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:14.657468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.657470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:14.657600Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:14.660850Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:14.660856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:14.696023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535027843421695:13279]
2025-10-02T08:15:14.696168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2315, pipe: [1:7556535027843421695:13279]
2025-10-02T08:15:14.804826Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:14.805173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843421695:13279], now have 1 active actors on pipe
2025-10-02T08:15:14.805314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:14.805329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:14.805355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2316 reason: error at write: Disconnected sessionId: src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0
2025-10-02T08:15:14.805417Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:14.805414Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:14.805535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2316 sessionId: src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0 is DEAD
2025-10-02T08:15:14.805643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:14.805650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0] Write session will restart in 0.008602s
2025-10-02T08:15:14.805667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0] Write session: Do CDS request
2025-10-02T08:15:14.805672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:14.805709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535027843421695:13279]
2025-10-02T08:15:14.815203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.815254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:14.815271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2317
2025-10-02T08:15:14.815373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:14.815402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:14.815409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:14.815413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:14.815526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:14.815826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2317 sessionId:  describe result for acl check
2025-10-02T08:15:14.815865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:14.815872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:14.815874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:14.815879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535027843422022:13401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:14.816186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:14.816337Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:14.816347Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:14.816355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:14.816383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535027843422022:13401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:14.816398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:14.816430Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535027843422026:13399]
2025-10-02T08:15:14.817068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:14.817224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:14.817280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:14.817597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:14.817651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.817659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.817661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.817662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.817663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.817668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.817676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.817679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.817683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.817685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.817690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.817697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:14.817703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.817708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:14.817711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.817716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:14.817720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.817724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.817728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.817733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.817751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:14.818257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535027843422022:13401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:14.823263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535027843422022:13401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:14.823280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535027843422022:13401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:14.823283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535027843422022:13401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:14.823291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:14.825347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:14.826962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:14.826980Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:14.826982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:14.826985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:14.826990Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2316 [1:7556535027843422026:13399]
2025-10-02T08:15:14.827000Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:14.827016Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:14.827019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.827023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.827025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.827040Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:14.827045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:14.827051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:14.827109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.827117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.827120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:14.827123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:14.827188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:14.827196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.827208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:14.827221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:14.827239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843422070:13401], now have 1 active actors on pipe
2025-10-02T08:15:14.827242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2316
2025-10-02T08:15:14.827246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535028302889672:2378], now have 1 active actors on pipe
2025-10-02T08:15:14.827252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535027843422016:13399]
2025-10-02T08:15:14.827254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535027843422016:13399]
2025-10-02T08:15:14.827262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:14.827273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.827280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:14.827283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.827284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:14.827298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:14.827314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:14.827320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:14.827360Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:14.827370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.827373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.827328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2316
2025-10-02T08:15:14.827375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:14.827382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.827390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:14.827397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535027843422016:13399]
2025-10-02T08:15:14.827403Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:14.827416Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:14.827432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.827507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.827515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.827529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:14.827568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2317 partition: 0 MaxSeqNo: 17 sessionId: src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0
2025-10-02T08:15:14.827876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b76a81-3d5c88ef-9dd6dd74-8d8d7b7b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:14.830355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0] Write session: try to update token
2025-10-02T08:15:14.830369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:14.840752Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:14.840774Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:14.840783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535027843422016:13399]
2025-10-02T08:15:14.840836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:14.840995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:14.841140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:14.841280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:14.841417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:14.841606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:14.841646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:14.841714Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:14.842769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId: src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:14.845161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:14.845252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.845264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.845294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:14.845320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:14.845379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:14.845392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:14.845559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.845625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.845695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.845764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.845911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.845923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.845990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.846052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.846116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.846182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.846231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.846238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.846304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.846360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.846418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.846479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.846524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.846532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.846604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.846672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.846739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.846805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.846849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.846856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.846918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.846973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.847038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.847108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.847149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.847154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.847217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.847273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.847330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.847387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.847427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.847432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.847505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.847567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.847627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.847689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.847729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.847736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.847796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.847850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.847905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.847961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.848003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.848009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.848068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.848121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.848195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.848261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.848302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.848307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.848369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:14.848422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:14.848479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:14.848542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:14.848583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:14.848588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:14.848621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:14.848672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:14.848692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:14.848696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:14.848723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:14.848736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:14.848741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:14.848743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:14.848745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:14.849136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:14.849157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:14.849162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:14.849166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:14.849168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:14.849170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:14.849676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:14.849695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:14.849699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:14.849701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:14.849703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:14.849706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:14.850139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:14.850156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:14.850160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:14.850162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:14.850164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:14.852371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:14.852392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:14.852405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392914852
2025-10-02T08:15:14.852576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:14.852594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:14.852599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:14.852603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:14.852608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:14.852611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:14.853121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:14.853149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:14.853155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:14.853158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:14.853161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:14.853164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:14.853612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:14.853634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:14.853639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:14.853641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:14.853644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:14.853647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:14.854074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:14.854095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:14.854099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:14.855120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:14.855141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:14.855147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:14.855150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:14.855159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392914854
2025-10-02T08:15:14.855449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:14.855471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:14.855476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:14.855478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:14.855481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:14.855484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:14.855885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:14.855906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:14.855911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:14.855913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:14.855915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:14.855918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:14.856388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:14.856409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:14.856485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392914856
2025-10-02T08:15:14.857231Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:14.857248Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:14.857252Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:14.857256Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:14.858715Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:14.858728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:14.858730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:14.858737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535027843422016:13399]
2025-10-02T08:15:14.858740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535027843422016:13399]
2025-10-02T08:15:14.858784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:14.858790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:14.858792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:14.858799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:14.858814Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:14.858909Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:14.919475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535027843422104:13279]
2025-10-02T08:15:14.919663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2316, pipe: [1:7556535027843422104:13279]
2025-10-02T08:15:14.996602Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:14.997014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535027843422104:13279], now have 1 active actors on pipe
2025-10-02T08:15:14.997145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535027843422104:13279]
2025-10-02T08:15:14.997167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:14.997174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:14.997197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2317 reason: error at write: Disconnected sessionId: src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0
2025-10-02T08:15:14.997253Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:14.997256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:14.997359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2317 sessionId: src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0 is DEAD
2025-10-02T08:15:14.997498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:14.997509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0] Write session will restart in 0.007708s
2025-10-02T08:15:14.997531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0] Write session: Do CDS request
2025-10-02T08:15:14.997538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:15.006269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.006326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:15.006344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2318
2025-10-02T08:15:15.006462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.006495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:15.006506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:15.006509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:15.006993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2318 sessionId:  describe result for acl check
2025-10-02T08:15:15.007039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:15.007046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:15.007048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:15.007056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535032138389717:13418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:15.007538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535032138389717:13418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:15.009149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:15.010336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535032138389717:13418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:15.010575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:15.010768Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:15.010780Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:15.010792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:15.010845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:15.010880Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535032138389758:13417]
2025-10-02T08:15:15.011442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:15.011686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:15.011725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:15.011983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:15.012014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.012019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.012019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.012020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.012021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.012024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.012031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.012033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.012035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.012037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.012041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.012045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.012049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.012051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.012058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.012062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.012066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.012070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.012073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.012077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.012096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:15.017219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535032138389717:13418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:15.017237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535032138389717:13418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:15.017241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535032138389717:13418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:15.017249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:15.020905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:15.022733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:15.022750Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:15.022752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:15.022755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:15.022762Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2317 [1:7556535032138389758:13417]
2025-10-02T08:15:15.022774Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:15.022791Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:15.022794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.022798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.022800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.022812Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:15.022825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:15.022831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:15.022890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.022896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.022899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:15.022902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:15.022961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:15.022968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.022981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.022994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:15.023014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2317
2025-10-02T08:15:15.023016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138389784:13418], now have 1 active actors on pipe
2025-10-02T08:15:15.023022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535032138389743:13417]
2025-10-02T08:15:15.023024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535032138389743:13417]
2025-10-02T08:15:15.023030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:15.023038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535028302889700:2378], now have 1 active actors on pipe
2025-10-02T08:15:15.023042Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:15.023045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:15.023045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.023049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.023063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:15.023077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:15.023084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:15.023121Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d96fe558-40c0b87b-8e325ef8-80040573_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:15.023132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.023136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.023138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:15.023146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.023153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:15.023139Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2317
2025-10-02T08:15:15.023160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535032138389743:13417]
2025-10-02T08:15:15.023163Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:15.023168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:15.023184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.023232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.023239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.023255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.023297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2318 partition: 0 MaxSeqNo: 17 sessionId: src_id|d96fe558-40c0b87b-8e325ef8-80040573_0
2025-10-02T08:15:15.023599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbbe619-30e8db5b-a94cd9eb-73da87bc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d96fe558-40c0b87b-8e325ef8-80040573_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:15.025960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d96fe558-40c0b87b-8e325ef8-80040573_0] Write session: try to update token
2025-10-02T08:15:15.025974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d96fe558-40c0b87b-8e325ef8-80040573_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:15.038797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId: src_id|d96fe558-40c0b87b-8e325ef8-80040573_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:15.040504Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:15.040523Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:15.040525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:15.040535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535032138389743:13417]
2025-10-02T08:15:15.040542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535032138389743:13417]
2025-10-02T08:15:15.040584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:15.040592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.040599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:15.040601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:15.040608Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:15.040735Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:15.041377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:15.097412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535032138389801:13279]
2025-10-02T08:15:15.097576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2317, pipe: [1:7556535032138389801:13279]
2025-10-02T08:15:15.178542Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:15.178879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.178891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.178929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138389801:13279], now have 1 active actors on pipe
2025-10-02T08:15:15.179074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:15.179087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:15.179147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2318 reason: error at write: Disconnected sessionId: src_id|d96fe558-40c0b87b-8e325ef8-80040573_0
2025-10-02T08:15:15.179186Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:15.179208Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:15.179300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2318 sessionId: src_id|d96fe558-40c0b87b-8e325ef8-80040573_0 is DEAD
2025-10-02T08:15:15.179432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96fe558-40c0b87b-8e325ef8-80040573_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:15.179443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96fe558-40c0b87b-8e325ef8-80040573_0] Write session will restart in 0.007588s
2025-10-02T08:15:15.179467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96fe558-40c0b87b-8e325ef8-80040573_0] Write session: Do CDS request
2025-10-02T08:15:15.179474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96fe558-40c0b87b-8e325ef8-80040573_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:15.179467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535032138389801:13279]
2025-10-02T08:15:15.188284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d96fe558-40c0b87b-8e325ef8-80040573_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.188322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:15.188338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2319
2025-10-02T08:15:15.188482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.188524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:15.188534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:15.188537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:15.188903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2319 sessionId:  describe result for acl check
2025-10-02T08:15:15.188944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:15.188950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:15.188951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:15.188956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535032138390102:13425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:15.189385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535032138390102:13425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:15.190005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:15.190802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:15.190942Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:15.190951Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:15.190960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:15.191003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:15.191037Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535032138390138:13424]
2025-10-02T08:15:15.191394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535032138390102:13425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:15.191625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:15.191775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:15.191812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:15.192017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:15.192057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.192063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.192064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.192065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.192066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.192071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.192080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.192085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.192093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.192097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.192103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.192114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.192120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.192126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.192130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.192135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.192139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.192144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.192154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.192172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.192195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:15.197365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535032138390102:13425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:15.197382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535032138390102:13425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:15.197386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535032138390102:13425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:15.197394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:15.200603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:15.202043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:15.202059Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:15.202061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:15.202063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:15.202068Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2318 [1:7556535032138390138:13424]
2025-10-02T08:15:15.202077Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:15.202094Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:15.202097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.202101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.202103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.202117Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:15.202121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:15.202126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:15.202172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.202178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.202181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:15.202182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:15.202233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:15.202238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.202247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.202253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:15.202268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535032138390119:13424]
2025-10-02T08:15:15.202273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535032138390119:13424]
2025-10-02T08:15:15.202278Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:15.202288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:15.202294Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:15.202297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:15.202296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2318
2025-10-02T08:15:15.202299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:15.202301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:15.202308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138390165:13425], now have 1 active actors on pipe
2025-10-02T08:15:15.202333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535032597857003:2378], now have 1 active actors on pipe
2025-10-02T08:15:15.202341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.202346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.202359Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535032138390119:13424]
2025-10-02T08:15:15.202372Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:15.202398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:15.202398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:15.202406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.202409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.202410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:15.202418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.202424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:15.202440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.202425Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2318
2025-10-02T08:15:15.202477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.202483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.202492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.202520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2319 partition: 0 MaxSeqNo: 17 sessionId: src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0
2025-10-02T08:15:15.202801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d96fe558-40c0b87b-8e325ef8-80040573_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:15.205179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0] Write session: try to update token
2025-10-02T08:15:15.205192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:15.218801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId: src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:15.220067Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:15.220083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:15.220085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:15.220095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535032138390119:13424]
2025-10-02T08:15:15.220099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535032138390119:13424]
2025-10-02T08:15:15.220142Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:15.220147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:15.220153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.220156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:15.220165Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:15.220305Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:15.221370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:15.279694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535032138390179:13279]
2025-10-02T08:15:15.279865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2318, pipe: [1:7556535032138390179:13279]
2025-10-02T08:15:15.359022Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:15.359288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.359298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.359330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138390179:13279], now have 1 active actors on pipe
2025-10-02T08:15:15.359423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535032138390179:13279]
2025-10-02T08:15:15.359448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:15.359454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:15.359501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2319 reason: error at write: Disconnected sessionId: src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0
2025-10-02T08:15:15.359508Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:15.359644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2319 sessionId: src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0 is DEAD
2025-10-02T08:15:15.359749Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:15.359809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:15.359820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0] Write session will restart in 0.008563s
2025-10-02T08:15:15.359845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0] Write session: Do CDS request
2025-10-02T08:15:15.359852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:15.369167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.369142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:15.369228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:15.369242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2320
2025-10-02T08:15:15.369394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.369429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:15.369439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:15.369443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:15.369737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:15.369797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2320 sessionId:  describe result for acl check
2025-10-02T08:15:15.369829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:15.369835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:15.369836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:15.369841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535032138390498:13432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:15.369884Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:15.369893Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:15.369902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:15.369950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:15.369983Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535032138390499:13430]
2025-10-02T08:15:15.370300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535032138390498:13432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:15.370612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:15.370749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:15.370789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:15.371084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:15.371127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.371132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.371133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.371134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.371136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.371140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.371150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.371153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.371161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.371164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.371173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.371184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.371194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.371217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.371227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.371236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.371244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.371254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.371263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.371273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.371297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:15.371964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535032138390498:13432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:15.376668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535032138390498:13432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:15.376681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535032138390498:13432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:15.376685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535032138390498:13432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:15.376693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:15.378735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:15.380370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:15.380389Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:15.380392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:15.380395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:15.380401Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2319 [1:7556535032138390499:13430]
2025-10-02T08:15:15.380413Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:15.380429Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:15.380436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.380440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.380442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.380457Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:15.380466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:15.380473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:15.380533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.380540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.380543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:15.380546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:15.380606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:15.380614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.380626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.380644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:15.380666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138390545:13432], now have 1 active actors on pipe
2025-10-02T08:15:15.380667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2319
2025-10-02T08:15:15.380677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535032138390490:13430]
2025-10-02T08:15:15.380679Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535032138390490:13430]
2025-10-02T08:15:15.380694Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:15.380706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535032597857011:2378], now have 1 active actors on pipe
2025-10-02T08:15:15.380714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.380714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:15.380717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:15.380724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.380738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:15.380754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:15.380757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:15.380792Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:15.380754Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2319
2025-10-02T08:15:15.380822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.380831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.380834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:15.380844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.380857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:15.380869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535032138390490:13430]
2025-10-02T08:15:15.380881Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:15.380909Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:15.380913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.380959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.380966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.380979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.381015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2320 partition: 0 MaxSeqNo: 17 sessionId: src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0
2025-10-02T08:15:15.381319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb96401-cc4041b6-9dc1841e-775feddb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:15.383831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0] Write session: try to update token
2025-10-02T08:15:15.383846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:15.397298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId: src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:15.398247Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:15.398266Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:15.398268Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:15.398277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535032138390490:13430]
2025-10-02T08:15:15.398281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535032138390490:13430]
2025-10-02T08:15:15.398323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:15.398334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.398334Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:15.398336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:15.398340Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:15.398472Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:15.399648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:15.459408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535032138390561:13279]
2025-10-02T08:15:15.459514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2319, pipe: [1:7556535032138390561:13279]
2025-10-02T08:15:15.546065Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:15.546345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.546357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.546391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138390561:13279], now have 1 active actors on pipe
2025-10-02T08:15:15.546507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:15.546514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:15.546533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535032138390561:13279]
2025-10-02T08:15:15.546561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2320 reason: error at write: Disconnected sessionId: src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0
2025-10-02T08:15:15.546611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:15.546709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2320 sessionId: src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0 is DEAD
2025-10-02T08:15:15.546859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:15.546864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0] Write session will restart in 0.006018s
2025-10-02T08:15:15.546882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0] Write session: Do CDS request
2025-10-02T08:15:15.546890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:15.546794Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:15.554265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.554297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:15.554313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2321
2025-10-02T08:15:15.554477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.554509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:15.554522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:15.554526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:15.554906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2321 sessionId:  describe result for acl check
2025-10-02T08:15:15.554940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:15.554946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:15.554948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:15.554952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535032138390834:13438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:15.555402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535032138390834:13438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:15.557206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:15.557870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535032138390834:13438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:15.557964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:15.558113Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:15.558123Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:15.558133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:15.558191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:15.558227Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535032138390903:13437]
2025-10-02T08:15:15.558834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:15.559003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:15.559045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:15.559329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:15.559375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.559381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.559383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.559384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.559385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.559390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.559398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.559402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.559407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.559411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.559416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.559427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.559437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.559442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.559451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.559457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.559466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.559472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.559484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.559489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.559507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:15.564214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535032138390834:13438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:15.564230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535032138390834:13438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:15.564234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535032138390834:13438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:15.564248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:15.567580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:15.569235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:15.569253Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:15.569256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:15.569260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:15.569266Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2320 [1:7556535032138390903:13437]
2025-10-02T08:15:15.569278Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:15.569293Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:15.569296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.569300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.569302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.569316Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:15.569321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:15.569327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:15.569383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.569393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.569396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:15.569399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:15.569462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:15.569471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.569483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.569496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:15.569517Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535032138390895:13437]
2025-10-02T08:15:15.569524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535032138390895:13437]
2025-10-02T08:15:15.569531Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:15.569531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2320
2025-10-02T08:15:15.569544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138390929:13438], now have 1 active actors on pipe
2025-10-02T08:15:15.569544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:15.569547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:15.569553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535032597857018:2378], now have 1 active actors on pipe
2025-10-02T08:15:15.569561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:15.569576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:15.569583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:15.569590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.569593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.569629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535032138390895:13437]
2025-10-02T08:15:15.569638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:15.569643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:15.569609Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2320
2025-10-02T08:15:15.569652Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:15.569660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.569664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.569666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:15.569674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.569682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:15.569717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.569760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.569769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.569782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.569818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2321 partition: 0 MaxSeqNo: 17 sessionId: src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0
2025-10-02T08:15:15.570143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258bf8f5-bb34b8de-cd6b2011-a22a651e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:15.572665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0] Write session: try to update token
2025-10-02T08:15:15.572681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:15.585353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId: src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:15.587392Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:15.587415Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:15.587418Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:15.587428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535032138390895:13437]
2025-10-02T08:15:15.587433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535032138390895:13437]
2025-10-02T08:15:15.587476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:15.587481Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:15.587487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:15.587487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.587490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:15.587626Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:15.587844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:15.646799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535032138390943:13279]
2025-10-02T08:15:15.646924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2320, pipe: [1:7556535032138390943:13279]
2025-10-02T08:15:15.738600Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:15.739004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.739023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.739065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138390943:13279], now have 1 active actors on pipe
2025-10-02T08:15:15.739192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535032138390943:13279]
2025-10-02T08:15:15.739219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:15.739226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:15.739285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2321 reason: error at write: Disconnected sessionId: src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0
2025-10-02T08:15:15.739300Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:15.739321Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:15.739454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2321 sessionId: src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0 is DEAD
2025-10-02T08:15:15.739597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:15.739607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0] Write session will restart in 0.005040s
2025-10-02T08:15:15.739633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0] Write session: Do CDS request
2025-10-02T08:15:15.739639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:15.746267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.746279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:15.746299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2322
2025-10-02T08:15:15.746445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.746487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:15.746492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:15.746495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:15.746855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2322 sessionId:  describe result for acl check
2025-10-02T08:15:15.746883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:15.746889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:15.746890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:15.746895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535032138391182:13444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:15.747398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535032138391182:13444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:15.750442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535032138391182:13444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:15.751634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:15.752363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:15.752533Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:15.752542Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:15.752552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:15.752608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:15.752652Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535032138391312:13443]
2025-10-02T08:15:15.753049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535032138391182:13444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:15.753062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535032138391182:13444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:15.753065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535032138391182:13444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:15.753072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:15.753201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:15.753364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:15.753414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:15.753715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:15.753755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.753761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.753761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.753762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.753763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.753770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.753779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.753783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.753786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.753789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.753795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.753801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.753809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.753814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.753817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.753821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.753826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.753830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.753833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.753838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.753854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:15.761890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:15.763505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:15.763525Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:15.763529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:15.763533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:15.763539Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2321 [1:7556535032138391312:13443]
2025-10-02T08:15:15.763551Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:15.763569Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:15.763572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.763575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.763577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.763592Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:15.763597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:15.763604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:15.763669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.763678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.763681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:15.763683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:15.763755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:15.763765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.763779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.763790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:15.763808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138391317:13444], now have 1 active actors on pipe
2025-10-02T08:15:15.763808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2321
2025-10-02T08:15:15.763817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535032597857037:2378], now have 1 active actors on pipe
2025-10-02T08:15:15.763823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535032138391306:13443]
2025-10-02T08:15:15.763826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535032138391306:13443]
2025-10-02T08:15:15.763837Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:15.763849Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:15.763851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.763856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.763859Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:15.763873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:15.763892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:15.763899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:15.763940Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95142add-facb438-22e08495-5ab9febe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:15.763951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.763955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.763957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:15.763966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.763975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:15.763983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535032138391306:13443]
2025-10-02T08:15:15.763997Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:15.764015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:15.764026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.764022Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2321
2025-10-02T08:15:15.764115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.764125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.764140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.764186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2322 partition: 0 MaxSeqNo: 17 sessionId: src_id|95142add-facb438-22e08495-5ab9febe_0
2025-10-02T08:15:15.764532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287b66f5-51ac33d3-f4ed9d56-b24d134f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|95142add-facb438-22e08495-5ab9febe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:15.767249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95142add-facb438-22e08495-5ab9febe_0] Write session: try to update token
2025-10-02T08:15:15.767265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95142add-facb438-22e08495-5ab9febe_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:15.774911Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:15.774933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:15.774942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535032138391306:13443]
2025-10-02T08:15:15.774984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:15.774996Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:15.775161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:15.775300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:15.775436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:15.775574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:15.775762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:15.775804Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:15.788239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId: src_id|95142add-facb438-22e08495-5ab9febe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:15.790640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:15.790716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.790730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.790763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:15.790788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:15.790847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.790864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.791036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.791098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.791159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.791222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.791304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.791313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.791378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.791436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.791496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.791563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.791612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.791621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.791684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.791745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.791802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.791858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.791898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.791905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.791964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.792024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.792084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.792143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.792199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.792207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.792273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.792333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.792396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.792472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.792527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.792535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.792599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.792661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.792721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.792783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.792844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.792852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.792914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.792974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.793038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.793099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.793141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.793148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.793213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.793274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.793340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.793405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.793448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.793455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.793520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.793576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.793637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.793700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.793750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.793759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.793823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:15.793881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:15.793943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:15.794004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:15.794050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:15.794058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:15.794115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:15.794180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.794203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.794209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:15.794240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:15.794255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:15.794263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:15.794268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:15.794270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:15.794641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:15.794667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:15.794678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:15.794681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:15.794690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:15.794694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:15.795168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:15.795196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:15.795201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:15.795204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:15.795207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:15.795209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:15.795663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:15.795689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:15.795694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:15.795697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:15.795700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:15.796929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:15.796950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:15.796961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392915796
2025-10-02T08:15:15.797101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:15.797121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:15.797127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:15.797130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:15.797134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:15.797138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:15.797632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:15.797659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:15.797665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:15.797669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:15.797671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:15.797674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:15.798126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:15.798154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:15.798165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:15.798172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:15.798176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:15.798179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:15.798629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:15.798652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:15.798661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:15.799726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:15.799745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:15.799750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:15.799754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:15.799762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392915799
2025-10-02T08:15:15.800039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:15.800060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:15.800072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:15.800080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:15.800083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:15.800091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:15.800561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:15.800584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:15.800589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:15.800592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:15.800595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:15.800598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:15.801058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:15.801080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.801177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392915800
2025-10-02T08:15:15.803416Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:15.803445Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:15.803451Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:15.803458Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:15.803474Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:15.803480Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:15.803482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:15.803489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535032138391306:13443]
2025-10-02T08:15:15.803492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535032138391306:13443]
2025-10-02T08:15:15.803535Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:15.803547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:15.803567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:15.803576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.803578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:15.803709Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:15.839306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535032138391359:13279]
2025-10-02T08:15:15.839445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2321, pipe: [1:7556535032138391359:13279]
2025-10-02T08:15:15.944299Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:15.944911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138391359:13279], now have 1 active actors on pipe
2025-10-02T08:15:15.945194Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:15.945475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535032138391359:13279]
2025-10-02T08:15:15.945492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:15.945510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2322 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95142add-facb438-22e08495-5ab9febe_0
2025-10-02T08:15:15.945656Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:15.945644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2322 sessionId: src_id|95142add-facb438-22e08495-5ab9febe_0 is DEAD
2025-10-02T08:15:15.945793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95142add-facb438-22e08495-5ab9febe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:15.945804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95142add-facb438-22e08495-5ab9febe_0] Write session will restart in 0.008142s
2025-10-02T08:15:15.945825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95142add-facb438-22e08495-5ab9febe_0] Write session: Do CDS request
2025-10-02T08:15:15.945831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95142add-facb438-22e08495-5ab9febe_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:15.949081Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [4aba258258f85a4e] Result# TEvPutResult {Id# [72075186224037892:2321:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:15:15.949123Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2321:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:15.949239Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2321:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:15.955270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95142add-facb438-22e08495-5ab9febe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.955310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:15.955322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2323
2025-10-02T08:15:15.955464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:15.955496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:15.955504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:15.955507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:15.955894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2323 sessionId:  describe result for acl check
2025-10-02T08:15:15.955921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:15.955926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:15.955927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:15.955932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535032138391674:13457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:15.956471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535032138391674:13457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:15.957858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:15.958609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:15.958749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:15.958757Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:15.958764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:15.958795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:15.958822Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535032138391711:13456]
2025-10-02T08:15:15.959356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:15.959530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:15.959558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:15.959767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:15.959814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.959821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.959822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.959823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.959824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.959828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.959837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.959840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.959844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.959848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.959855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.959860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:15.959863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.959866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:15.959869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.959871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:15.959874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.959876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.959879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.959881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.959891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:15.961093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535032138391674:13457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:15.968144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535032138391674:13457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:15.968175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535032138391674:13457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:15.968178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535032138391674:13457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:15.968187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:15.969174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:15.970791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:15.970810Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:15.970812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:15.970815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:15.970821Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2322 [1:7556535032138391711:13456]
2025-10-02T08:15:15.970831Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:15.970847Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:15.970850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.970852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.970855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.970869Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:15.970879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:15.970886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:15.970947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.970956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.970959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:15.970961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:15.971027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:15.971039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.971053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:15.971065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:15.971084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535032597857059:2378], now have 1 active actors on pipe
2025-10-02T08:15:15.971090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535032138391705:13456]
2025-10-02T08:15:15.971092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535032138391705:13456]
2025-10-02T08:15:15.971099Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:15.971110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:15.971111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:15.971114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:15.971124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:15.971127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:15.971157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535032138391705:13456]
2025-10-02T08:15:15.971166Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:15.971174Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:15.971175Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2322
2025-10-02T08:15:15.971259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2322
2025-10-02T08:15:15.971284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535032138391748:13457], now have 1 active actors on pipe
2025-10-02T08:15:15.971301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.971310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.971334Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f208016-19734732-549c3e80-de3ddb94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:15.971346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:15.971353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:15.971355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:15.971364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:15.971378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:15.971397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.971429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:15.971436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:15.971447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:15.971476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2323 partition: 0 MaxSeqNo: 17 sessionId: src_id|2f208016-19734732-549c3e80-de3ddb94_0
2025-10-02T08:15:15.971784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95142add-facb438-22e08495-5ab9febe_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2f208016-19734732-549c3e80-de3ddb94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:15.974367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f208016-19734732-549c3e80-de3ddb94_0] Write session: try to update token
2025-10-02T08:15:15.974382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f208016-19734732-549c3e80-de3ddb94_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:15.988719Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:15.988736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:15.988738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:15.988744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535032138391705:13456]
2025-10-02T08:15:15.988748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535032138391705:13456]
2025-10-02T08:15:15.988779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:15.988783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:15.988785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:15.988787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:15.988793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:15.988983Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:15.990463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId: src_id|2f208016-19734732-549c3e80-de3ddb94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:15.992839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:16.045643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535036433359082:13279]
2025-10-02T08:15:16.045796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2322, pipe: [1:7556535036433359082:13279]
2025-10-02T08:15:16.127103Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:16.127684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.127702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.127742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433359082:13279], now have 1 active actors on pipe
2025-10-02T08:15:16.127983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:16.127993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:16.128035Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:16.128046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2323 reason: error at write: Disconnected sessionId: src_id|2f208016-19734732-549c3e80-de3ddb94_0
2025-10-02T08:15:16.128201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2323 sessionId: src_id|2f208016-19734732-549c3e80-de3ddb94_0 is DEAD
2025-10-02T08:15:16.128509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f208016-19734732-549c3e80-de3ddb94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:16.128517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f208016-19734732-549c3e80-de3ddb94_0] Write session will restart in 0.008843s
2025-10-02T08:15:16.128540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f208016-19734732-549c3e80-de3ddb94_0] Write session: Do CDS request
2025-10-02T08:15:16.128547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f208016-19734732-549c3e80-de3ddb94_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:16.128510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535036433359082:13279]
2025-10-02T08:15:16.128578Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:16.138291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f208016-19734732-549c3e80-de3ddb94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.138373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:16.138389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2324
2025-10-02T08:15:16.138497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.138520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:16.138524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:16.138527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:16.138916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2324 sessionId:  describe result for acl check
2025-10-02T08:15:16.138942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:16.138944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:16.138946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:16.138952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535036433359353:13470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:16.139646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535036433359353:13470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:16.141913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535036433359353:13470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:16.142245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:16.142970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:16.143128Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:16.143131Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:16.143141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:16.143205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:16.143275Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535036433359441:13469]
2025-10-02T08:15:16.143834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:16.144062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:16.144095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:16.144351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:16.144393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.144397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.144398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.144399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.144399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.144404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.144410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.144412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.144414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.144416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.144421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.144425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.144428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.144431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.144433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.144436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.144439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.144442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.144444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.144446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.144457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:16.144596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535036433359353:13470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:16.144620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535036433359353:13470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:16.144622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535036433359353:13470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:16.144630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:16.153292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:16.154720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:16.154744Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:16.154747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:16.154751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:16.154757Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2323 [1:7556535036433359441:13469]
2025-10-02T08:15:16.154768Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:16.154787Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:16.154790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.154793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.154795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.154808Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:16.154814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:16.154820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:16.154885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.154896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.154899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:16.154901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:16.154967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:16.154976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.154988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.155004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:16.155025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433359458:13470], now have 1 active actors on pipe
2025-10-02T08:15:16.155035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535036892824372:2378], now have 1 active actors on pipe
2025-10-02T08:15:16.155041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535036433359427:13469]
2025-10-02T08:15:16.155043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535036433359427:13469]
2025-10-02T08:15:16.155053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:16.155070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:16.155067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:16.155083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:16.155086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:16.155087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:16.155118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535036433359427:13469]
2025-10-02T08:15:16.155128Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:16.155140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:16.155164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2323
2025-10-02T08:15:16.155175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.155179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.155207Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:16.155222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.155229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.155231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:16.155241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.155255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:16.155273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.155360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2323
2025-10-02T08:15:16.155312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.155320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.155333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.155362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2324 partition: 0 MaxSeqNo: 17 sessionId: src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0
2025-10-02T08:15:16.155657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f208016-19734732-549c3e80-de3ddb94_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:16.158273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0] Write session: try to update token
2025-10-02T08:15:16.158290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:16.167071Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:16.167098Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:16.167110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535036433359427:13469]
2025-10-02T08:15:16.167151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:16.167165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:16.167390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:16.167533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:16.167670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:16.167794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:16.167979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:16.168015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:16.171971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId: src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:16.174455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:16.174514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.174525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.174550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:16.174568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:16.174614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.174620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.174755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.174807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.174863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.174920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.174979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.174988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.175052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.175103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.175163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.175224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.175262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.175268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.175325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.175377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.175428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.175487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.175530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.175538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.175603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.175672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.175727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.175781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.175821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.175827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.175883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.175934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.175989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.176045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.176088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.176094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.176149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.176215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.176270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.176325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.176363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.176368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.176424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.176475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.176531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.176598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.176638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.176643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.176704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.176758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.176834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.176892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.176931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.176937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.176994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.177050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.177111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.177174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.177219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.177225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.177285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:16.177338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:16.177392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:16.177442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:16.177485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:16.177490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:16.177519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:16.177577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.177594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.177599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:16.177624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:16.177638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:16.177643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:16.177645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:16.177646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:16.177986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:16.178008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:16.178013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:16.178015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:16.178017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:16.178019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:16.178444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:16.178464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:16.178468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:16.178469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:16.178471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:16.178473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:16.178959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:16.178984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:16.178988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:16.178990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:16.178991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:16.180206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:16.180227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:16.180238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392916179
2025-10-02T08:15:16.180349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:16.180356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:16.180361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:16.180365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:16.180369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:16.180372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:16.180891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:16.180914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:16.180919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:16.180922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:16.180924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:16.180926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:16.181394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:16.181422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:16.181429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:16.181432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:16.181437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:16.181440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:16.181904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:16.181915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:16.181918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:16.182853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:16.182863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:16.182867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:16.182870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:16.182880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392916182
2025-10-02T08:15:16.183179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:16.183192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:16.183197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:16.183200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:16.183206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:16.183208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:16.183586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:16.183593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:16.183597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:16.183599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:16.183601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:16.183603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:16.184018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:16.184027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.184098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392916182
2025-10-02T08:15:16.184747Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:16.184764Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:16.184769Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:16.184773Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:16.186157Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:16.186170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:16.186171Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:16.186176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535036433359427:13469]
2025-10-02T08:15:16.186179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535036433359427:13469]
2025-10-02T08:15:16.186215Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:16.186221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:16.186224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.186226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:16.186228Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:16.186340Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:16.228426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535036433359480:13279]
2025-10-02T08:15:16.228559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2323, pipe: [1:7556535036433359480:13279]
2025-10-02T08:15:16.329592Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:16.329972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433359480:13279], now have 1 active actors on pipe
2025-10-02T08:15:16.330790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:16.330176Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:16.330457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535036433359480:13279]
2025-10-02T08:15:16.330472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:16.330801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0] Write session will restart in 0.008369s
2025-10-02T08:15:16.330496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2324 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0
2025-10-02T08:15:16.330647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2324 sessionId: src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0 is DEAD
2025-10-02T08:15:16.330841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0] Write session: Do CDS request
2025-10-02T08:15:16.330847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:16.332925Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:16.340328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.340382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:16.340401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2325
2025-10-02T08:15:16.341050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.341096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:16.341107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:16.341113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:16.341770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2325 sessionId:  describe result for acl check
2025-10-02T08:15:16.341811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:16.341818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:16.341820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:16.341826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535036433359644:13476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:16.342357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535036433359644:13476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:16.345701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535036433359644:13476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:16.348364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:16.348459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535036433359644:13476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:16.348476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535036433359644:13476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:16.348479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535036433359644:13476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:16.348487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:16.348984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:16.349248Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:16.349262Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:16.349274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:16.349338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:16.349378Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535036433359855:13475]
2025-10-02T08:15:16.350010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:16.350209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:16.350252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:16.350528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:16.350573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.350579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.350579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.350581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.350581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.350586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.350595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.350599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.350603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.350606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.350611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.350618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.350624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.350630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.350634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.350638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.350646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.350651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.350656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.350664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.350682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:16.359071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:16.360655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:16.360677Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:16.360680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:16.360683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:16.360690Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2324 [1:7556535036433359855:13475]
2025-10-02T08:15:16.360701Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:16.360718Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:16.360720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.360723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.360725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.360741Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:16.360745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:16.360751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:16.360829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.360840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.360843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:16.360845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:16.360909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:16.360915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.360927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.360938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:16.360955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433359850:13476], now have 1 active actors on pipe
2025-10-02T08:15:16.360965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535036433359843:13475]
2025-10-02T08:15:16.360966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2324
2025-10-02T08:15:16.360967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535036433359843:13475]
2025-10-02T08:15:16.360976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:16.360987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:16.360991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:16.360995Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:16.361004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:16.361011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:16.361016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535036892824382:2378], now have 1 active actors on pipe
2025-10-02T08:15:16.361045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.361049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.361061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535036433359843:13475]
2025-10-02T08:15:16.361070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:16.361084Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:16.361093Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34a47f91-e109244e-881f3e0e-a6bed928_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:16.361099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.361102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.361104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:16.361113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.361121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:16.361140Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2324
2025-10-02T08:15:16.361139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.361189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.361190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.361201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.361234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2325 partition: 0 MaxSeqNo: 17 sessionId: src_id|34a47f91-e109244e-881f3e0e-a6bed928_0
2025-10-02T08:15:16.361562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3355d-dc1d41b-38261b71-2aca514f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|34a47f91-e109244e-881f3e0e-a6bed928_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:16.364113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34a47f91-e109244e-881f3e0e-a6bed928_0] Write session: try to update token
2025-10-02T08:15:16.364131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34a47f91-e109244e-881f3e0e-a6bed928_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:16.377802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId: src_id|34a47f91-e109244e-881f3e0e-a6bed928_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:16.379010Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:16.379027Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:16.379029Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:16.379043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535036433359843:13475]
2025-10-02T08:15:16.379046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535036433359843:13475]
2025-10-02T08:15:16.379087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:16.379093Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:16.379097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.379099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:16.379099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:16.379228Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:16.380203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:16.430671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535036433359880:13279]
2025-10-02T08:15:16.430784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2324, pipe: [1:7556535036433359880:13279]
2025-10-02T08:15:16.515234Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:16.515542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.515559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.515602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433359880:13279], now have 1 active actors on pipe
2025-10-02T08:15:16.515715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535036433359880:13279]
2025-10-02T08:15:16.515741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:16.515743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:16.515795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2325 reason: error at write: Disconnected sessionId: src_id|34a47f91-e109244e-881f3e0e-a6bed928_0
2025-10-02T08:15:16.515825Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:16.515841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:16.515971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2325 sessionId: src_id|34a47f91-e109244e-881f3e0e-a6bed928_0 is DEAD
2025-10-02T08:15:16.516107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a47f91-e109244e-881f3e0e-a6bed928_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:16.516115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a47f91-e109244e-881f3e0e-a6bed928_0] Write session will restart in 0.007531s
2025-10-02T08:15:16.516140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a47f91-e109244e-881f3e0e-a6bed928_0] Write session: Do CDS request
2025-10-02T08:15:16.516146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a47f91-e109244e-881f3e0e-a6bed928_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:16.525308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34a47f91-e109244e-881f3e0e-a6bed928_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.525468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:16.525485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2326
2025-10-02T08:15:16.525597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.525628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:16.525638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:16.525641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:16.526020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2326 sessionId:  describe result for acl check
2025-10-02T08:15:16.526055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:16.526057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:16.526059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:16.526063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535036433360197:13483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:16.526523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535036433360197:13483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:16.527635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:16.528548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:16.528712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535036433360197:13483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:16.528865Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:16.528879Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:16.528893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:16.528966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:16.529005Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535036433360233:13482]
2025-10-02T08:15:16.529667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:16.529863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:16.529903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:16.530163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:16.530210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.530215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.530217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.530218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.530219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.530224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.530235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.530239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.530243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.530247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.530252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.530259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.530265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.530271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.530275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.530280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.530284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.530290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.530294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.530299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.530313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:16.535286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535036433360197:13483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:16.535301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535036433360197:13483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:16.535303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535036433360197:13483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:16.535309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:16.538423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:16.539950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:16.539964Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:16.539968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:16.539971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:16.539975Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2325 [1:7556535036433360233:13482]
2025-10-02T08:15:16.539985Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:16.539998Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:16.539999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.540001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.540002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.540014Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:16.540017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:16.540022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:16.540062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.540069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.540072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:16.540074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:16.540130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:16.540136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.540144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.540150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:16.540178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535036433360223:13482]
2025-10-02T08:15:16.540184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535036433360223:13482]
2025-10-02T08:15:16.540192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:16.540205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:16.540217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:16.540219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2325
2025-10-02T08:15:16.540220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:16.540221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:16.540224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:16.540232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433360260:13483], now have 1 active actors on pipe
2025-10-02T08:15:16.540262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535036433360223:13482]
2025-10-02T08:15:16.540265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:16.540268Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:16.540274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.540278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.540290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535036892824389:2378], now have 1 active actors on pipe
2025-10-02T08:15:16.540325Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d095d541-47297afc-2dba63bc-9daa71a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:16.540334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.540337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.540339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:16.540347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.540360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:16.540372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.540350Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2325
2025-10-02T08:15:16.540416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.540423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.540434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.540470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2326 partition: 0 MaxSeqNo: 17 sessionId: src_id|d095d541-47297afc-2dba63bc-9daa71a5_0
2025-10-02T08:15:16.540789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34a47f91-e109244e-881f3e0e-a6bed928_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d095d541-47297afc-2dba63bc-9daa71a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:16.543387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d095d541-47297afc-2dba63bc-9daa71a5_0] Write session: try to update token
2025-10-02T08:15:16.543406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d095d541-47297afc-2dba63bc-9daa71a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:16.556974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId: src_id|d095d541-47297afc-2dba63bc-9daa71a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:16.558188Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:16.558205Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:16.558210Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:16.558220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535036433360223:13482]
2025-10-02T08:15:16.558224Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535036433360223:13482]
2025-10-02T08:15:16.558258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:16.558267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.558268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:16.558268Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:16.558275Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:16.558387Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:16.559521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:16.616535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535036433360274:13279]
2025-10-02T08:15:16.616708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2325, pipe: [1:7556535036433360274:13279]
2025-10-02T08:15:16.692937Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:16.693160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.693171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.693207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433360274:13279], now have 1 active actors on pipe
2025-10-02T08:15:16.693486Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:16.693466Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:16.693514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535036433360274:13279]
2025-10-02T08:15:16.693536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:16.693599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2326 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d095d541-47297afc-2dba63bc-9daa71a5_0
2025-10-02T08:15:16.693746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2326 sessionId: src_id|d095d541-47297afc-2dba63bc-9daa71a5_0 is DEAD
2025-10-02T08:15:16.695431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d095d541-47297afc-2dba63bc-9daa71a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:16.695443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d095d541-47297afc-2dba63bc-9daa71a5_0] Write session will restart in 0.006202s
2025-10-02T08:15:16.695468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d095d541-47297afc-2dba63bc-9daa71a5_0] Write session: Do CDS request
2025-10-02T08:15:16.695475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d095d541-47297afc-2dba63bc-9daa71a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:16.703350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d095d541-47297afc-2dba63bc-9daa71a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.704823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:16.704840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2327
2025-10-02T08:15:16.707352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.707394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:16.707399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:16.707402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:16.707797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2327 sessionId:  describe result for acl check
2025-10-02T08:15:16.707826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:16.707828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:16.707830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:16.707834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535036433360451:13489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:16.708334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535036433360451:13489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:16.710970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535036433360451:13489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:16.714052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535036433360451:13489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:16.714076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535036433360451:13489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:16.714079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535036433360451:13489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:16.714088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:16.719859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:16.721030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:16.721160Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:16.721167Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:16.721174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:16.721203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:16.721230Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535036433360646:13488]
2025-10-02T08:15:16.721628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:16.721798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:16.721829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:16.722032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:16.722064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.722069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.722070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.722071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.722072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.722076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.722085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.722088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.722092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.722096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.722100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.722107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.722112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.722117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.722122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.722131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.722135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.722140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.722145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.722148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.722158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:16.730143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:16.731548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:16.731565Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:16.731567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:16.731570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:16.731575Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2326 [1:7556535036433360646:13488]
2025-10-02T08:15:16.731583Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:16.731597Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:16.731598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.731601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.731602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.731613Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:16.731617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:16.731622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:16.731666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.731672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.731674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:16.731676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:16.731739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:16.731745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.731753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.731763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:16.731780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433360539:13489], now have 1 active actors on pipe
2025-10-02T08:15:16.731791Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535036433360640:13488]
2025-10-02T08:15:16.731793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535036433360640:13488]
2025-10-02T08:15:16.731793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2326
2025-10-02T08:15:16.731799Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:16.731811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:16.731811Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:16.731814Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:16.731895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2326
2025-10-02T08:15:16.731829Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:16.731836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:16.731842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535036892824395:2378], now have 1 active actors on pipe
2025-10-02T08:15:16.731846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.731848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.731876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535036433360640:13488]
2025-10-02T08:15:16.731882Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:16.731889Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:16.731893Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97f4693e-5575196b-99dec2cc-aa47221e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:16.731898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.731901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.731902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:16.731910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.731916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:16.731940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.732022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.732028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.732037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.732067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2327 partition: 0 MaxSeqNo: 17 sessionId: src_id|97f4693e-5575196b-99dec2cc-aa47221e_0
2025-10-02T08:15:16.732358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d095d541-47297afc-2dba63bc-9daa71a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|97f4693e-5575196b-99dec2cc-aa47221e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:16.735129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f4693e-5575196b-99dec2cc-aa47221e_0] Write session: try to update token
2025-10-02T08:15:16.735147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f4693e-5575196b-99dec2cc-aa47221e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:16.749818Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:16.749841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:16.749843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:16.749867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535036433360640:13488]
2025-10-02T08:15:16.749872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535036433360640:13488]
2025-10-02T08:15:16.749917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:16.749921Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:16.749928Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:16.749929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.749931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:16.750077Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:16.751576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId: src_id|97f4693e-5575196b-99dec2cc-aa47221e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:16.754020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:16.793687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535036433360671:13279]
2025-10-02T08:15:16.793780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2326, pipe: [1:7556535036433360671:13279]
2025-10-02T08:15:16.889367Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:16.889705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.889718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.889768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433360671:13279], now have 1 active actors on pipe
2025-10-02T08:15:16.889946Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:16.889960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:16.889964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:16.890024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2327 reason: error at write: Disconnected sessionId: src_id|97f4693e-5575196b-99dec2cc-aa47221e_0
2025-10-02T08:15:16.890158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2327 sessionId: src_id|97f4693e-5575196b-99dec2cc-aa47221e_0 is DEAD
2025-10-02T08:15:16.890183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535036433360671:13279]
2025-10-02T08:15:16.890245Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:16.890294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f4693e-5575196b-99dec2cc-aa47221e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:16.890305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f4693e-5575196b-99dec2cc-aa47221e_0] Write session will restart in 0.009350s
2025-10-02T08:15:16.890329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f4693e-5575196b-99dec2cc-aa47221e_0] Write session: Do CDS request
2025-10-02T08:15:16.890335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f4693e-5575196b-99dec2cc-aa47221e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:16.900965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:16.901275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f4693e-5575196b-99dec2cc-aa47221e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.901322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:16.901331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2328
2025-10-02T08:15:16.901485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:16.901512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:16.901521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:16.901524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:16.901826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:16.901887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2328 sessionId:  describe result for acl check
2025-10-02T08:15:16.901916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:16.901922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:16.901923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:16.901927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535036433361022:13497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:16.901944Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:16.901947Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:16.901953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:16.901987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:16.902016Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535036433361023:13495]
2025-10-02T08:15:16.902312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535036433361022:13497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:16.902425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:16.902586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:16.902627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:16.902884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:16.902938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.902944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.902945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.902946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.902947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.902951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.902959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.902963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.902967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.902970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.902975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.902982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:16.902987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.902991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:16.902995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.903000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:16.903003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.903008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.903011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.903016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.903034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:16.903992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535036433361022:13497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:16.909656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535036433361022:13497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:16.909672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535036433361022:13497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:16.909675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535036433361022:13497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:16.909683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:16.910720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:16.912330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:16.912347Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:16.912350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:16.912354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:16.912359Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2327 [1:7556535036433361023:13495]
2025-10-02T08:15:16.912369Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:16.912383Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:16.912386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.912389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.912390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.912406Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:16.912419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:16.912424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:16.912483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.912490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.912493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:16.912496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:16.912567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:16.912574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.912585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:16.912602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:16.912618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2327
2025-10-02T08:15:16.912624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535036433361068:13497], now have 1 active actors on pipe
2025-10-02T08:15:16.912628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535036892824416:2378], now have 1 active actors on pipe
2025-10-02T08:15:16.912634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535036433361014:13495]
2025-10-02T08:15:16.912636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535036433361014:13495]
2025-10-02T08:15:16.912648Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:16.912657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.912661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.912662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:16.912665Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:16.912679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:16.912692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:16.912695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:16.912732Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:16.912744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:16.912747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:16.912720Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2327
2025-10-02T08:15:16.912751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:16.912758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:16.912771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:16.912784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535036433361014:13495]
2025-10-02T08:15:16.912796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:16.912823Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:16.912844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.912885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:16.912892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:16.912905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:16.912940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2328 partition: 0 MaxSeqNo: 17 sessionId: src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0
2025-10-02T08:15:16.913228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f4693e-5575196b-99dec2cc-aa47221e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:16.915747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0] Write session: try to update token
2025-10-02T08:15:16.915759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:16.934615Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:16.934631Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:16.934634Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:16.934642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535036433361014:13495]
2025-10-02T08:15:16.934646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535036433361014:13495]
2025-10-02T08:15:16.934685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:16.934691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:16.934693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:16.934696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:16.934703Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:16.934826Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:16.938401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId: src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:16.940842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:17.005553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535040728328391:13279]
2025-10-02T08:15:17.005856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2327, pipe: [1:7556535040728328391:13279]
2025-10-02T08:15:17.083221Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:17.083521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.083534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.083573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728328391:13279], now have 1 active actors on pipe
2025-10-02T08:15:17.083696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535040728328391:13279]
2025-10-02T08:15:17.083724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:17.083727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:17.083786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2328 reason: error at write: Disconnected sessionId: src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0
2025-10-02T08:15:17.083789Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:17.083962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2328 sessionId: src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0 is DEAD
2025-10-02T08:15:17.083963Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:17.084107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:17.084116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0] Write session will restart in 0.007037s
2025-10-02T08:15:17.084135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0] Write session: Do CDS request
2025-10-02T08:15:17.084141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:17.092278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.092352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:17.092365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2329
2025-10-02T08:15:17.092502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.092543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:17.092553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:17.092557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:17.093062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2329 sessionId:  describe result for acl check
2025-10-02T08:15:17.093092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:17.093097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:17.093099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:17.093104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535040728328726:13515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:17.093605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535040728328726:13515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:17.095147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:17.095644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535040728328726:13515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:17.096018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:17.096142Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:17.096149Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:17.096166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:17.096201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:17.096321Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535040728328779:13514]
2025-10-02T08:15:17.096788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:17.097004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:17.097046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:17.097277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:17.097316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.097320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.097321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.097321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.097322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.097326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.097332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.097335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.097337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.097339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.097342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.097347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.097351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.097354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.097356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.097359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.097361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.097364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.097367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.097370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.097380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:17.101607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535040728328726:13515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:17.101619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535040728328726:13515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:17.101623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535040728328726:13515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:17.101630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:17.105335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:17.106863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:17.106877Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:17.106880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:17.106883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:17.106890Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2328 [1:7556535040728328779:13514]
2025-10-02T08:15:17.106901Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:17.106915Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:17.106918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.106922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.106924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.106940Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:17.106944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:17.106949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:17.107006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.107015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.107018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:17.107021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:17.107084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:17.107092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.107105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.107116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:17.107132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535041187791740:2378], now have 1 active actors on pipe
2025-10-02T08:15:17.107141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535040728328767:13514]
2025-10-02T08:15:17.107144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535040728328767:13514]
2025-10-02T08:15:17.107150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2328
2025-10-02T08:15:17.107151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:17.107157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728328800:13515], now have 1 active actors on pipe
2025-10-02T08:15:17.107161Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:17.107164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:17.107164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:17.107177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:17.107180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:17.107186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.107190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.107225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535040728328767:13514]
2025-10-02T08:15:17.107232Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:17.107241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:17.107249Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:17.107256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.107229Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2328
2025-10-02T08:15:17.107259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.107261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:17.107270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.107278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:17.107317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.107364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.107370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.107382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.107416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2329 partition: 0 MaxSeqNo: 17 sessionId: src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0
2025-10-02T08:15:17.107712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db569ea0-2df9b6ba-95b4a97b-28dd55be_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:17.110318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0] Write session: try to update token
2025-10-02T08:15:17.110332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:17.124359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId: src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:17.125926Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:17.125940Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:17.125942Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:17.125950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535040728328767:13514]
2025-10-02T08:15:17.125954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535040728328767:13514]
2025-10-02T08:15:17.125991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:17.125997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.125999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:17.125998Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:17.126005Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:17.126127Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:17.126704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:17.183838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535040728328813:13279]
2025-10-02T08:15:17.183970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2328, pipe: [1:7556535040728328813:13279]
2025-10-02T08:15:17.265470Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:17.265677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.265686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.265717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728328813:13279], now have 1 active actors on pipe
2025-10-02T08:15:17.265759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:17.265766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:17.265805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2329 reason: error at write: Disconnected sessionId: src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0
2025-10-02T08:15:17.265923Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:17.265923Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:17.265942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2329 sessionId: src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0 is DEAD
2025-10-02T08:15:17.266102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:17.266113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0] Write session will restart in 0.005185s
2025-10-02T08:15:17.266136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0] Write session: Do CDS request
2025-10-02T08:15:17.266134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535040728328813:13279]
2025-10-02T08:15:17.266143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:17.272242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.272347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:17.272359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2330
2025-10-02T08:15:17.272445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.272473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:17.272477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:17.272480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:17.272848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2330 sessionId:  describe result for acl check
2025-10-02T08:15:17.272874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:17.272876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:17.272877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:17.272881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535040728329033:13521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:17.273323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535040728329033:13521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:17.276220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535040728329033:13521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:17.277169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:17.278360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:17.278530Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:17.278542Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:17.278553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:17.278612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:17.278650Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535040728329182:13520]
2025-10-02T08:15:17.279262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:17.279292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535040728329033:13521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:17.279297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535040728329033:13521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:17.279300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535040728329033:13521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:17.279305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:17.279442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:17.279478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:17.279698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:17.279731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.279735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.279736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.279736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.279737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.279741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.279747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.279749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.279751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.279753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.279757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.279762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.279766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.279769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.279771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.279774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.279776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.279779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.279782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.279784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.279794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:17.287539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:17.289144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:17.289162Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:17.289164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:17.289168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:17.289174Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2329 [1:7556535040728329182:13520]
2025-10-02T08:15:17.289184Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:17.289200Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:17.289202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.289206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.289208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.289227Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:17.289231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:17.289237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:17.289299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.289311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.289314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:17.289316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:17.289397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:17.289405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.289418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.289434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:17.289456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728329191:13521], now have 1 active actors on pipe
2025-10-02T08:15:17.289459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535041187791748:2378], now have 1 active actors on pipe
2025-10-02T08:15:17.289464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.289468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.289485Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535040728329174:13520]
2025-10-02T08:15:17.289492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535040728329174:13520]
2025-10-02T08:15:17.289503Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:17.289515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:17.289524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:17.289527Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:17.289532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:17.289534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:17.289550Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c21ef74-914427ab-f600c659-986cc3bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:17.289523Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2329
2025-10-02T08:15:17.289550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2329
2025-10-02T08:15:17.289560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.289563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.289565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:17.289574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.289583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:17.289619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535040728329174:13520]
2025-10-02T08:15:17.289631Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:17.289636Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:17.289651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.289709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.289716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.290070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65069000-6518f43f-6ec9bdb5-7e2263b0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2c21ef74-914427ab-f600c659-986cc3bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:17.292608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c21ef74-914427ab-f600c659-986cc3bd_0] Write session: try to update token
2025-10-02T08:15:17.292625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c21ef74-914427ab-f600c659-986cc3bd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:17.289730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.289766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2330 partition: 0 MaxSeqNo: 17 sessionId: src_id|2c21ef74-914427ab-f600c659-986cc3bd_0
2025-10-02T08:15:17.307057Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:17.307074Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:17.307077Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:17.307085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535040728329174:13520]
2025-10-02T08:15:17.307090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535040728329174:13520]
2025-10-02T08:15:17.307139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:17.307145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.307147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:17.307153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:17.307159Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:17.307306Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:17.308117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId: src_id|2c21ef74-914427ab-f600c659-986cc3bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:17.310426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:17.366112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535040728329212:13279]
2025-10-02T08:15:17.366198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2329, pipe: [1:7556535040728329212:13279]
2025-10-02T08:15:17.448093Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:17.448472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.448480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.448518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728329212:13279], now have 1 active actors on pipe
2025-10-02T08:15:17.448570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535040728329212:13279]
2025-10-02T08:15:17.448593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:17.448596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:17.448655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2330 reason: error at write: Disconnected sessionId: src_id|2c21ef74-914427ab-f600c659-986cc3bd_0
2025-10-02T08:15:17.448703Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:17.448670Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:17.448843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2330 sessionId: src_id|2c21ef74-914427ab-f600c659-986cc3bd_0 is DEAD
2025-10-02T08:15:17.448950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c21ef74-914427ab-f600c659-986cc3bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:17.448960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c21ef74-914427ab-f600c659-986cc3bd_0] Write session will restart in 0.006992s
2025-10-02T08:15:17.448996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c21ef74-914427ab-f600c659-986cc3bd_0] Write session: Do CDS request
2025-10-02T08:15:17.449002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c21ef74-914427ab-f600c659-986cc3bd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:17.457257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c21ef74-914427ab-f600c659-986cc3bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.457314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:17.457325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2331
2025-10-02T08:15:17.457576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.457620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:17.457630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:17.457633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:17.458016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2331 sessionId:  describe result for acl check
2025-10-02T08:15:17.458047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:17.458054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:17.458055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:17.458061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535040728329538:13528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:17.458555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535040728329538:13528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:17.459050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:17.460298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:17.460447Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:17.460465Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:17.460474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:17.460539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:17.460572Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535040728329574:13527]
2025-10-02T08:15:17.460666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535040728329538:13528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:17.461105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:17.461288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:17.461336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:17.461645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:17.461690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.461695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.461696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.461697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.461698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.461702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.461711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.461714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.461718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.461721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.461730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.461741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.461751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.461760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.461764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.461768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.461772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.461777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.461781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.461786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.461803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:17.466817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535040728329538:13528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:17.466830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535040728329538:13528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:17.466834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535040728329538:13528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:17.466842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:17.470234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:17.471925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:17.471938Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:17.471940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:17.471942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:17.471947Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2330 [1:7556535040728329574:13527]
2025-10-02T08:15:17.471955Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:17.471969Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:17.471971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.471974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.471975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.471987Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:17.471992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:17.471997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:17.472043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.472050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.472053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:17.472056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:17.472110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:17.472116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.472125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.472133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:17.472148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535040728329555:13527]
2025-10-02T08:15:17.472153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535040728329555:13527]
2025-10-02T08:15:17.472170Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:17.472182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:17.472181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:17.472184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:17.472194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:17.472195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2330
2025-10-02T08:15:17.472196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:17.472204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728329602:13528], now have 1 active actors on pipe
2025-10-02T08:15:17.472206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535041187791756:2378], now have 1 active actors on pipe
2025-10-02T08:15:17.472233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.472243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.472253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535040728329555:13527]
2025-10-02T08:15:17.472259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:17.472279Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:17.472280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:17.472288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.472291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.472292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:17.472298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.472305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:17.472282Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2330
2025-10-02T08:15:17.472324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.472360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.472365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.472375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.472408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2331 partition: 0 MaxSeqNo: 17 sessionId: src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0
2025-10-02T08:15:17.472743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c21ef74-914427ab-f600c659-986cc3bd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:17.475386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0] Write session: try to update token
2025-10-02T08:15:17.475407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:17.490616Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:17.490638Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:17.490642Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:17.490652Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535040728329555:13527]
2025-10-02T08:15:17.490657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535040728329555:13527]
2025-10-02T08:15:17.490698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:17.490706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:17.490708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.490712Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:17.490712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:17.490846Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:17.494924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId: src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:17.497483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:17.548879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535040728329615:13279]
2025-10-02T08:15:17.549015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2330, pipe: [1:7556535040728329615:13279]
2025-10-02T08:15:17.602160Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:15:17.628777Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:17.629115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.629130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.629172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728329615:13279], now have 1 active actors on pipe
2025-10-02T08:15:17.629476Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:17.629736Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:17.629785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:17.629852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535040728329615:13279]
2025-10-02T08:15:17.629853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2331 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0
2025-10-02T08:15:17.630004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2331 sessionId: src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0 is DEAD
2025-10-02T08:15:17.630152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:17.630160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0] Write session will restart in 0.008980s
2025-10-02T08:15:17.630185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0] Write session: Do CDS request
2025-10-02T08:15:17.630195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:17.640333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.640389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:17.640404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2332
2025-10-02T08:15:17.640532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.640565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:17.640569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:17.640572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:17.640942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2332 sessionId:  describe result for acl check
2025-10-02T08:15:17.640974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:17.640978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:17.640979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:17.640983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535040728329952:13534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:17.641362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535040728329952:13534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:17.641769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:17.642830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:17.643001Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:17.643009Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:17.643027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:17.643079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:17.643119Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535040728329978:13533]
2025-10-02T08:15:17.643497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535040728329952:13534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:17.643655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:17.643849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:17.643895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:17.644326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:17.644379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.644384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.644385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.644386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.644388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.644392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.644402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.644406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.644410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.644415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.644420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.644427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.644437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.644443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.644452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.644457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.644465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.644469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.644474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.644479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.644501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:17.649414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535040728329952:13534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:17.649427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535040728329952:13534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:17.649430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535040728329952:13534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:17.649438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:17.652588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:17.654939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:17.654956Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:17.654959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:17.654963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:17.654969Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2331 [1:7556535040728329978:13533]
2025-10-02T08:15:17.654979Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:17.654995Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:17.654997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.655000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.655003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.655017Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:17.655027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:17.655034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:17.655097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.655103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.655106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:17.655109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:17.655172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:17.655182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.655195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.655208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:17.655219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2331
2025-10-02T08:15:17.655225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728330005:13534], now have 1 active actors on pipe
2025-10-02T08:15:17.655228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535041187791763:2378], now have 1 active actors on pipe
2025-10-02T08:15:17.655234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535040728329957:13533]
2025-10-02T08:15:17.655237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535040728329957:13533]
2025-10-02T08:15:17.655248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:17.655257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.655261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:17.655264Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:17.655265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.655281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:17.655298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:17.655305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:17.655289Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2331
2025-10-02T08:15:17.655344Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:17.655354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.655359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.655365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:17.655374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.655386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:17.655399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535040728329957:13533]
2025-10-02T08:15:17.655406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:17.655413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:17.655430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.655520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.655526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.655539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.655573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2332 partition: 0 MaxSeqNo: 17 sessionId: src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0
2025-10-02T08:15:17.655894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5d00db-c184241b-cf38c49b-f4506c80_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:17.663454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0] Write session: try to update token
2025-10-02T08:15:17.663477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:17.672445Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:17.672462Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:17.672464Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:17.672471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535040728329957:13533]
2025-10-02T08:15:17.672475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535040728329957:13533]
2025-10-02T08:15:17.672515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:17.672521Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:17.672526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.672526Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:17.672528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:17.672660Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:17.684543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId: src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:17.687139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:17.730111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535040728330021:13279]
2025-10-02T08:15:17.730270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2331, pipe: [1:7556535040728330021:13279]
2025-10-02T08:15:17.818275Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:17.818587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.818603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.818623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728330021:13279], now have 1 active actors on pipe
2025-10-02T08:15:17.820392Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:17.820236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:17.820244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:17.820304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2332 reason: error at write: Disconnected sessionId: src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0
2025-10-02T08:15:17.820364Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:17.820473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2332 sessionId: src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0 is DEAD
2025-10-02T08:15:17.820653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:17.820669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0] Write session will restart in 0.008793s
2025-10-02T08:15:17.820660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535040728330021:13279]
2025-10-02T08:15:17.820785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0] Write session: Do CDS request
2025-10-02T08:15:17.820812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:17.830267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.830318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:17.830333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2333
2025-10-02T08:15:17.830480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:17.830510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:17.830519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:17.830522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:17.830980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2333 sessionId:  describe result for acl check
2025-10-02T08:15:17.831015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:17.831022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:17.831024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:17.831029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535040728330363:13541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:17.831483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535040728330363:13541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:17.832578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:17.833374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535040728330363:13541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:17.833609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:17.833790Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:17.833800Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:17.833808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:17.833843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:17.833939Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535040728330406:13540]
2025-10-02T08:15:17.834354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:17.834506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:17.834537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:17.834721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:17.834750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.834754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.834755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.834756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.834756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.834759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.834765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.834767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.834769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.834771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.834775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.834779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:17.834783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.834786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:17.834788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.834791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:17.834793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.834795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.834799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.834801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.834811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:17.839461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535040728330363:13541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:17.839476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535040728330363:13541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:17.839479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535040728330363:13541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:17.839487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:17.842702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:17.844196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:17.844209Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:17.844210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:17.844213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:17.844218Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2332 [1:7556535040728330406:13540]
2025-10-02T08:15:17.844226Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:17.844240Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:17.844243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.844244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.844246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.844256Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:17.844260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:17.844265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:17.844307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.844312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.844314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:17.844315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:17.844363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:17.844369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.844376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:17.844383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:17.844395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535040728330390:13540]
2025-10-02T08:15:17.844400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535040728330390:13540]
2025-10-02T08:15:17.844405Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:17.844524Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2332
2025-10-02T08:15:17.844413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:17.844426Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:17.844427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:17.844429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:17.844430Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:17.844436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728330427:13541], now have 1 active actors on pipe
2025-10-02T08:15:17.844440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2332
2025-10-02T08:15:17.844464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535041187791783:2378], now have 1 active actors on pipe
2025-10-02T08:15:17.844467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535040728330390:13540]
2025-10-02T08:15:17.844470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:17.844472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:17.844476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.844480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.844524Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:17.844530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:17.844534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:17.844536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:17.844542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:17.844550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:17.844566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.844600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:17.844601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:17.844611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:17.844636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2333 partition: 0 MaxSeqNo: 17 sessionId: src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0
2025-10-02T08:15:17.844933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c1fef-692b080d-1d1c1bd5-ea3f9ff1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:17.847430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0] Write session: try to update token
2025-10-02T08:15:17.847446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:17.860227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId: src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:17.862309Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:17.862329Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:17.862331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:17.862339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535040728330390:13540]
2025-10-02T08:15:17.862344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535040728330390:13540]
2025-10-02T08:15:17.862385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:17.862388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:17.862391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:17.862392Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:17.862393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:17.862534Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:17.862944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:17.921623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535040728330441:13279]
2025-10-02T08:15:17.921739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2332, pipe: [1:7556535040728330441:13279]
2025-10-02T08:15:18.010588Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:18.010877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.010897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.010936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535040728330441:13279], now have 1 active actors on pipe
2025-10-02T08:15:18.011022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535040728330441:13279]
2025-10-02T08:15:18.011168Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:18.011271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:18.011313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2333 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0
2025-10-02T08:15:18.011437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2333 sessionId: src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0 is DEAD
2025-10-02T08:15:18.011155Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:18.012878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:18.012890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0] Write session will restart in 0.009789s
2025-10-02T08:15:18.012915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0] Write session: Do CDS request
2025-10-02T08:15:18.012921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:18.024260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.025771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:18.025785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2334
2025-10-02T08:15:18.026361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.026390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:18.026394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:18.026397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:18.026586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:18.027017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2334 sessionId:  describe result for acl check
2025-10-02T08:15:18.027041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:18.027042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:18.027043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:18.027048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535045023298097:13554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:18.027497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535045023298097:13554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:18.027973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:18.028216Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:18.028225Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:18.028235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:18.028283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:18.028319Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535045023298104:13552]
2025-10-02T08:15:18.028934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:18.029132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:18.029171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:18.029445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:18.029488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.029494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.029495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.029496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.029497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.029502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.029510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.029513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.029517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.029520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.029525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.029531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.029536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.029540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.029544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.029548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.029552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.029556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.029561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.029566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.029582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:18.030861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535045023298097:13554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:18.037121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535045023298097:13554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:18.037134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535045023298097:13554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:18.037140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535045023298097:13554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:18.037148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:18.040208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:18.041731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:18.041743Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:18.041745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:18.041748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:18.041752Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2333 [1:7556535045023298104:13552]
2025-10-02T08:15:18.041760Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:18.041772Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:18.041773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.041775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.041776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.041788Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:18.041791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:18.041797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:18.041837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.041842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.041844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:18.041846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:18.041904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:18.041909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.041918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.041924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:18.041936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535045023298091:13552]
2025-10-02T08:15:18.041941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535045023298091:13552]
2025-10-02T08:15:18.041946Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:18.041954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:18.041962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:18.041964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:18.041992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023298143:13554], now have 1 active actors on pipe
2025-10-02T08:15:18.041994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:18.041997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:18.041999Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535045023298091:13552]
2025-10-02T08:15:18.042004Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:18.042017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535045482759086:2378], now have 1 active actors on pipe
2025-10-02T08:15:18.042047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2333
2025-10-02T08:15:18.042249Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:18.042323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.042340Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2333
2025-10-02T08:15:18.042338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.042360Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b65df825-2ead246b-a0a95c52-ab778720_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:18.042367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.042371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.042372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:18.042382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.042390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:18.042407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.042461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.042467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.042478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.042515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2334 partition: 0 MaxSeqNo: 17 sessionId: src_id|b65df825-2ead246b-a0a95c52-ab778720_0
2025-10-02T08:15:18.042792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b6fcaf-29b2aa4-d6aefddd-1c06c88e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b65df825-2ead246b-a0a95c52-ab778720_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:18.045190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65df825-2ead246b-a0a95c52-ab778720_0] Write session: try to update token
2025-10-02T08:15:18.045207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65df825-2ead246b-a0a95c52-ab778720_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:18.058931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId: src_id|b65df825-2ead246b-a0a95c52-ab778720_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:18.061408Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:18.061428Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:18.061430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:18.061438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535045023298091:13552]
2025-10-02T08:15:18.061442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535045023298091:13552]
2025-10-02T08:15:18.061480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:18.061486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.061488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:18.061492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:18.061492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:18.061498Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:18.061623Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:18.111027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535045023298193:13279]
2025-10-02T08:15:18.111125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2333, pipe: [1:7556535045023298193:13279]
2025-10-02T08:15:18.130998Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:15:18.131020Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-02T08:15:18.206733Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:18.207061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.207078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.207120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023298193:13279], now have 1 active actors on pipe
2025-10-02T08:15:18.207268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535045023298193:13279]
2025-10-02T08:15:18.207293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:18.207295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:18.207332Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:18.207350Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-02T08:15:18.207348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2334 reason: error at write: Disconnected sessionId: src_id|b65df825-2ead246b-a0a95c52-ab778720_0
2025-10-02T08:15:18.207356Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:18.207510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2334 sessionId: src_id|b65df825-2ead246b-a0a95c52-ab778720_0 is DEAD
2025-10-02T08:15:18.207651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65df825-2ead246b-a0a95c52-ab778720_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:18.207661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65df825-2ead246b-a0a95c52-ab778720_0] Write session will restart in 0.005563s
2025-10-02T08:15:18.207682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65df825-2ead246b-a0a95c52-ab778720_0] Write session: Do CDS request
2025-10-02T08:15:18.207688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65df825-2ead246b-a0a95c52-ab778720_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:18.214204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65df825-2ead246b-a0a95c52-ab778720_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.214285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:18.214299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2335
2025-10-02T08:15:18.214392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.214433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:18.214438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:18.214441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:18.214837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2335 sessionId:  describe result for acl check
2025-10-02T08:15:18.214867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:18.214869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:18.214871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:18.214875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535045023298448:13567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:18.215347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535045023298448:13567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:18.217973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535045023298448:13567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:18.219556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:18.220562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:18.220732Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:18.220747Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:18.220756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:18.220817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:18.220857Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535045023298573:13566]
2025-10-02T08:15:18.220898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535045023298448:13567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:18.220910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535045023298448:13567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:18.220913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535045023298448:13567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:18.220922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:18.221467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:18.221659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:18.221703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:18.221998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:18.222039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.222045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.222046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.222048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.222049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.222054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.222063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.222067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.222072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.222076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.222081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.222087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.222097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.222102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.222107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.222112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.222116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.222121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.222126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.222136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.222154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:18.230178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:18.231704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:18.231720Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:18.231723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:18.231727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:18.231733Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2334 [1:7556535045023298573:13566]
2025-10-02T08:15:18.231744Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:18.231761Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:18.231764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.231767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.231769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.231785Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:18.231797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:18.231804Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:18.231868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.231875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.231878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:18.231881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:18.231945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:18.231953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.231965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.231978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:18.232002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023298578:13567], now have 1 active actors on pipe
2025-10-02T08:15:18.232003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2334
2025-10-02T08:15:18.232012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535045023298567:13566]
2025-10-02T08:15:18.232014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535045023298567:13566]
2025-10-02T08:15:18.232021Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:18.232031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535045482759144:2378], now have 1 active actors on pipe
2025-10-02T08:15:18.232032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:18.232035Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:18.232042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:18.232055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:18.232062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:18.232069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.232077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.232113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535045023298567:13566]
2025-10-02T08:15:18.232082Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2334
2025-10-02T08:15:18.232120Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:18.232128Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:18.232135Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed350013-baabb08c-6a698e84-4f09f22c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:18.232141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.232145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.232146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:18.232169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.232181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:18.232239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.232295Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:15:18.232323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.232329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.232341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.232372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2335 partition: 0 MaxSeqNo: 17 sessionId: src_id|ed350013-baabb08c-6a698e84-4f09f22c_0
2025-10-02T08:15:18.232507Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 21 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:15:18.232562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:15:18.232677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65df825-2ead246b-a0a95c52-ab778720_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ed350013-baabb08c-6a698e84-4f09f22c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:18.235127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed350013-baabb08c-6a698e84-4f09f22c_0] Write session: try to update token
2025-10-02T08:15:18.235142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed350013-baabb08c-6a698e84-4f09f22c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:18.247552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId: src_id|ed350013-baabb08c-6a698e84-4f09f22c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:18.248950Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:18.248968Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:18.248971Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:18.248984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535045023298567:13566]
2025-10-02T08:15:18.248988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535045023298567:13566]
2025-10-02T08:15:18.249030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:18.249037Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:18.249041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.249042Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:18.249044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:18.249237Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:18.250191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:18.307696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535045023298606:13279]
2025-10-02T08:15:18.307819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2334, pipe: [1:7556535045023298606:13279]
2025-10-02T08:15:18.395210Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:18.395616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.395623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.395664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023298606:13279], now have 1 active actors on pipe
2025-10-02T08:15:18.395920Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:18.395982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:18.396062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2335 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ed350013-baabb08c-6a698e84-4f09f22c_0
2025-10-02T08:15:18.396248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2335 sessionId: src_id|ed350013-baabb08c-6a698e84-4f09f22c_0 is DEAD
2025-10-02T08:15:18.396523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed350013-baabb08c-6a698e84-4f09f22c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:18.396530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed350013-baabb08c-6a698e84-4f09f22c_0] Write session will restart in 0.007461s
2025-10-02T08:15:18.396553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed350013-baabb08c-6a698e84-4f09f22c_0] Write session: Do CDS request
2025-10-02T08:15:18.396561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed350013-baabb08c-6a698e84-4f09f22c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:18.396547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535045023298606:13279]
2025-10-02T08:15:18.397115Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:18.409191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed350013-baabb08c-6a698e84-4f09f22c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.409297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:18.409312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2336
2025-10-02T08:15:18.409803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.409841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:18.409862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:18.409871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:18.410270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2336 sessionId:  describe result for acl check
2025-10-02T08:15:18.410299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:18.410302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:18.410304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:18.410309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535045023298903:13574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:18.410906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535045023298903:13574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:18.414759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:18.415501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535045023298903:13574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:18.417168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:18.417358Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:18.417362Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:18.417371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:18.417418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:18.417608Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535045023298989:13573]
2025-10-02T08:15:18.418232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:18.418570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:18.418606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:18.418902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:18.418942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.418943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.418944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.418945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.418946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.418952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.418961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.418965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.418969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.418972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.418978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.418985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.418991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.418996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.419001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.419007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.419012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.419017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.419022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.419027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.419049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:18.419118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535045023298903:13574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:18.419124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535045023298903:13574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:18.419128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535045023298903:13574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:18.419135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:18.431902Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2335
2025-10-02T08:15:18.432185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed350013-baabb08c-6a698e84-4f09f22c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9861bc80-3291e513-6395d753-98fdb053_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:18.429362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:18.430916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:18.430922Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:18.430925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:18.430928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:18.430936Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2335 [1:7556535045023298989:13573]
2025-10-02T08:15:18.430949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:18.430966Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:18.430969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.430973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.430976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.430992Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:18.430997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:18.431005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:18.431070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.431072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.431075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:18.431078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:18.431155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:18.431158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.431171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.431184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:18.431201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023299004:13574], now have 1 active actors on pipe
2025-10-02T08:15:18.431208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535045023298974:13573]
2025-10-02T08:15:18.431210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535045023298974:13573]
2025-10-02T08:15:18.431218Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:18.431231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:18.431246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:18.431249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:18.431256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535045482759153:2378], now have 1 active actors on pipe
2025-10-02T08:15:18.431286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535045023298974:13573]
2025-10-02T08:15:18.431288Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:18.431326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2335
2025-10-02T08:15:18.431353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:18.431356Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:18.431362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:18.431415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.431420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.431443Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9861bc80-3291e513-6395d753-98fdb053_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:18.431449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.431453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.431455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:18.431465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.431473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:18.431487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.431617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.431619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.431632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.431663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2336 partition: 0 MaxSeqNo: 17 sessionId: src_id|9861bc80-3291e513-6395d753-98fdb053_0
2025-10-02T08:15:18.434932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9861bc80-3291e513-6395d753-98fdb053_0] Write session: try to update token
2025-10-02T08:15:18.434951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9861bc80-3291e513-6395d753-98fdb053_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:18.451744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId: src_id|9861bc80-3291e513-6395d753-98fdb053_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:18.453102Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:18.453115Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:18.453116Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:18.453123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535045023298974:13573]
2025-10-02T08:15:18.453127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535045023298974:13573]
2025-10-02T08:15:18.453163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:18.453168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.453170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:18.453298Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:18.454206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:18.454267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:18.454277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:18.496599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535045023299023:13279]
2025-10-02T08:15:18.496688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2335, pipe: [1:7556535045023299023:13279]
2025-10-02T08:15:18.581517Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:18.581963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.581976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.582006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023299023:13279], now have 1 active actors on pipe
2025-10-02T08:15:18.582102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:18.582109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:18.582158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2336 reason: error at write: Disconnected sessionId: src_id|9861bc80-3291e513-6395d753-98fdb053_0
2025-10-02T08:15:18.582247Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:18.582245Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:18.582312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2336 sessionId: src_id|9861bc80-3291e513-6395d753-98fdb053_0 is DEAD
2025-10-02T08:15:18.582422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9861bc80-3291e513-6395d753-98fdb053_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:18.582430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9861bc80-3291e513-6395d753-98fdb053_0] Write session will restart in 0.006275s
2025-10-02T08:15:18.582454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9861bc80-3291e513-6395d753-98fdb053_0] Write session: Do CDS request
2025-10-02T08:15:18.582460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9861bc80-3291e513-6395d753-98fdb053_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:18.582460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535045023299023:13279]
2025-10-02T08:15:18.590268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9861bc80-3291e513-6395d753-98fdb053_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.590331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:18.590347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2337
2025-10-02T08:15:18.590488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.590523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:18.590534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:18.590537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:18.590916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2337 sessionId:  describe result for acl check
2025-10-02T08:15:18.590946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:18.590948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:18.590949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:18.590954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535045023299320:13581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:18.591363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535045023299320:13581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:18.593546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535045023299320:13581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:18.593738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:18.594875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:18.595049Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:18.595061Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:18.595071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:18.595125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:18.595165Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535045023299406:13580]
2025-10-02T08:15:18.595768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:18.595932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:18.595978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:18.596232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535045023299320:13581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:18.596243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535045023299320:13581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:18.596246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535045023299320:13581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:18.596254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:18.596284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:18.596338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.596344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.596345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.596346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.596347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.596352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.596361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.596365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.596369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.596373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.596378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.596389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.596394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.596399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.596403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.596415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.596419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.596423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.596428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.596433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.596452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:18.604274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:18.605979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:18.605994Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:18.605996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:18.605998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:18.606003Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2336 [1:7556535045023299406:13580]
2025-10-02T08:15:18.606012Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:18.606027Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:18.606028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.606030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.606031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.606044Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:18.606047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:18.606053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:18.606113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.606115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.606118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:18.606120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:18.606175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:18.606181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.606191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.606198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:18.606210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535045023299390:13580]
2025-10-02T08:15:18.606216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535045023299390:13580]
2025-10-02T08:15:18.606222Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:18.606235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023299418:13581], now have 1 active actors on pipe
2025-10-02T08:15:18.606237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:18.606239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2336
2025-10-02T08:15:18.606241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:18.606244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:18.606258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:18.606266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:18.606293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.606300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.606311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535045482759158:2378], now have 1 active actors on pipe
2025-10-02T08:15:18.606313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535045023299390:13580]
2025-10-02T08:15:18.606321Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:18.606332Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:18.606343Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:18.606347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.606350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.606351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:18.606359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.606366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:18.606390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.606375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2336
2025-10-02T08:15:18.606475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.606480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.606491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.606522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2337 partition: 0 MaxSeqNo: 17 sessionId: src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0
2025-10-02T08:15:18.606838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9861bc80-3291e513-6395d753-98fdb053_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:18.609651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0] Write session: try to update token
2025-10-02T08:15:18.609669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:18.624243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId: src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:18.626585Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:18.626606Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:18.626609Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:18.626617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535045023299390:13580]
2025-10-02T08:15:18.626622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535045023299390:13580]
2025-10-02T08:15:18.626667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:18.626674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.626677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:18.626689Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:18.626696Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:18.626822Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:18.626944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:18.682555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535045023299437:13279]
2025-10-02T08:15:18.682734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2336, pipe: [1:7556535045023299437:13279]
2025-10-02T08:15:18.772601Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:18.773026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.773040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.773078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023299437:13279], now have 1 active actors on pipe
2025-10-02T08:15:18.773547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:18.773558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0] Write session will restart in 0.005817s
2025-10-02T08:15:18.773581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0] Write session: Do CDS request
2025-10-02T08:15:18.773587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:18.773579Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:18.773179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:18.773184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:18.773241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2337 reason: error at write: Disconnected sessionId: src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0
2025-10-02T08:15:18.773397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2337 sessionId: src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0 is DEAD
2025-10-02T08:15:18.773682Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:18.773848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535045023299437:13279]
2025-10-02T08:15:18.780270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.780340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:18.780353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2338
2025-10-02T08:15:18.780465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.780484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:18.780490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:18.780492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:18.781182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2338 sessionId:  describe result for acl check
2025-10-02T08:15:18.781218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:18.781224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:18.781225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:18.781230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535045023299608:13587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:18.781723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535045023299608:13587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:18.784312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535045023299608:13587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:18.787387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535045023299608:13587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:18.787400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535045023299608:13587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:18.787402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535045023299608:13587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:18.787410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:18.788441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:18.789354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:18.789520Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:18.789532Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:18.789541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:18.789586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:18.789623Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535045023299832:13586]
2025-10-02T08:15:18.790219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:18.790390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:18.790428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:18.790714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:18.790753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.790759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.790760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.790762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.790763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.790768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.790778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.790782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.790786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.790789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.790794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.790802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.790807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.790814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.790824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.790829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.790833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.790842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.790850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.790858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.790875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:18.798712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:18.800394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:18.800410Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:18.800413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:18.800417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:18.800423Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2337 [1:7556535045023299832:13586]
2025-10-02T08:15:18.800436Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:18.800453Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:18.800457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.800460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.800462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.800477Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:18.800482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:18.800488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:18.800551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.800561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.800564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:18.800567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:18.800634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:18.800642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.800654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.800672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:18.800694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023299812:13587], now have 1 active actors on pipe
2025-10-02T08:15:18.800699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2337
2025-10-02T08:15:18.800705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535045023299826:13586]
2025-10-02T08:15:18.800708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535045023299826:13586]
2025-10-02T08:15:18.800716Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:18.800733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:18.800738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:18.800740Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:18.800752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:18.800755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:18.800761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535045482759177:2378], now have 1 active actors on pipe
2025-10-02T08:15:18.800767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.800777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.800833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535045023299826:13586]
2025-10-02T08:15:18.800843Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:18.800851Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:18.800857Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c91aacf6-136df71d-e2e90b26-21f665df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:18.800863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.800871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.800831Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2337
2025-10-02T08:15:18.800873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:18.800885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.800895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:18.800941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.800989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.800996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.801009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.801048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2338 partition: 0 MaxSeqNo: 17 sessionId: src_id|c91aacf6-136df71d-e2e90b26-21f665df_0
2025-10-02T08:15:18.801365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116e73ae-9ef32ed3-5c54f62c-6c9e7221_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c91aacf6-136df71d-e2e90b26-21f665df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:18.803881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91aacf6-136df71d-e2e90b26-21f665df_0] Write session: try to update token
2025-10-02T08:15:18.803895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91aacf6-136df71d-e2e90b26-21f665df_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:18.817412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId: src_id|c91aacf6-136df71d-e2e90b26-21f665df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:18.818157Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:18.818174Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:18.818176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:18.818184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535045023299826:13586]
2025-10-02T08:15:18.818188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535045023299826:13586]
2025-10-02T08:15:18.818230Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:18.818232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:18.818239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.818241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:18.818254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:18.818382Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:18.819734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:18.873899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535045023299871:13279]
2025-10-02T08:15:18.874220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2337, pipe: [1:7556535045023299871:13279]
2025-10-02T08:15:18.964440Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:18.964708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.964721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.964758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023299871:13279], now have 1 active actors on pipe
2025-10-02T08:15:18.964896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535045023299871:13279]
2025-10-02T08:15:18.964923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:18.964925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:18.965031Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:18.964987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2338 reason: error at write: Disconnected sessionId: src_id|c91aacf6-136df71d-e2e90b26-21f665df_0
2025-10-02T08:15:18.964997Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:18.965159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2338 sessionId: src_id|c91aacf6-136df71d-e2e90b26-21f665df_0 is DEAD
2025-10-02T08:15:18.965306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91aacf6-136df71d-e2e90b26-21f665df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:18.965317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91aacf6-136df71d-e2e90b26-21f665df_0] Write session will restart in 0.006401s
2025-10-02T08:15:18.965341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91aacf6-136df71d-e2e90b26-21f665df_0] Write session: Do CDS request
2025-10-02T08:15:18.965348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91aacf6-136df71d-e2e90b26-21f665df_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:18.973198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c91aacf6-136df71d-e2e90b26-21f665df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.973244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:18.973262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2339
2025-10-02T08:15:18.973437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:18.973483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:18.973493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:18.973497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:18.973953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2339 sessionId:  describe result for acl check
2025-10-02T08:15:18.973989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:18.973991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:18.973993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:18.973998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535045023300109:13594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:18.974523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535045023300109:13594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:18.977353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535045023300109:13594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:18.979249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:18.980440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:18.980602Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:18.980611Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:18.980622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:18.980668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:18.980704Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535045023300259:13593]
2025-10-02T08:15:18.980793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535045023300109:13594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:18.980820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535045023300109:13594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:18.980823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535045023300109:13594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:18.980831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:18.981418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:18.981629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:18.981694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:18.982041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:18.982102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.982107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.982108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.982109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.982111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.982115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.982124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.982127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.982131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.982135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.982140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.982147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:18.982152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.982157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:18.982161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.982166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:18.982169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.982174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.982178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.982183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.982201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:18.990063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:18.991458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:18.991476Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:18.991479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:18.991482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:18.991488Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2338 [1:7556535045023300259:13593]
2025-10-02T08:15:18.991500Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:18.991515Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:18.991518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.991520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.991523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.991535Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:18.991540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:18.991547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:18.991613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.991620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.991623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:18.991625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:18.991684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:18.991691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:18.991702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:18.991716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:18.991734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535045023300253:13593]
2025-10-02T08:15:18.991740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535045023300253:13593]
2025-10-02T08:15:18.991747Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:18.991763Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:18.991764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:18.991771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:18.991777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:18.991780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:18.991789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535045023300264:13594], now have 1 active actors on pipe
2025-10-02T08:15:18.991796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535045482759187:2378], now have 1 active actors on pipe
2025-10-02T08:15:18.991797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2338
2025-10-02T08:15:18.991822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535045023300253:13593]
2025-10-02T08:15:18.991834Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:18.991843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.991847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.991860Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:18.991885Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:18.991894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:18.991898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:18.991900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:18.991910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:18.991918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:18.991896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2338
2025-10-02T08:15:18.991939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.991977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:18.991983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:18.991993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:18.992031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2339 partition: 0 MaxSeqNo: 17 sessionId: src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0
2025-10-02T08:15:18.992367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c91aacf6-136df71d-e2e90b26-21f665df_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:18.994782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0] Write session: try to update token
2025-10-02T08:15:18.994797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:19.006908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId: src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:19.009045Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:19.009061Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:19.009063Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:19.009071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535045023300253:13593]
2025-10-02T08:15:19.009076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535045023300253:13593]
2025-10-02T08:15:19.009116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:19.009121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.009123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:19.009138Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:19.009150Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:19.009265Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:19.009426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:19.064911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535049318267586:13279]
2025-10-02T08:15:19.065034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2338, pipe: [1:7556535049318267586:13279]
2025-10-02T08:15:19.146519Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:19.146915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.146930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.146972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318267586:13279], now have 1 active actors on pipe
2025-10-02T08:15:19.147133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535049318267586:13279]
2025-10-02T08:15:19.147155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:19.147161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:19.147214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2339 reason: error at write: Disconnected sessionId: src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0
2025-10-02T08:15:19.147226Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:19.147256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:19.147374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2339 sessionId: src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0 is DEAD
2025-10-02T08:15:19.147538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:19.147562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0] Write session will restart in 0.005137s
2025-10-02T08:15:19.147586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0] Write session: Do CDS request
2025-10-02T08:15:19.147592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:19.154178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.154271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:19.154284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2340
2025-10-02T08:15:19.154380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.154411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:19.154420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:19.154423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:19.154826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2340 sessionId:  describe result for acl check
2025-10-02T08:15:19.154851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:19.154856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:19.154857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:19.154862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535049318267873:13613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:19.155316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535049318267873:13613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:19.157873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535049318267873:13613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:19.159297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:19.160389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:19.160564Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:19.160573Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:19.160582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:19.160631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:19.160666Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535049318268012:13612]
2025-10-02T08:15:19.160855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535049318267873:13613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:19.160869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535049318267873:13613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:19.160872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535049318267873:13613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:19.160879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:19.161247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:19.161425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:19.161467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:19.161758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:19.161796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.161802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.161803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.161804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.161805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.161810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.161820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.161825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.161829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.161833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.161838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.161845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.161854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.161860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.161864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.161873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.161882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.161891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.161899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.161909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.161932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:19.169855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:19.171441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:19.171464Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:19.171466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:19.171469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:19.171475Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2339 [1:7556535049318268012:13612]
2025-10-02T08:15:19.171486Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:19.171503Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:19.171511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.171514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.171516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.171532Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:19.171537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:19.171549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:19.171616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.171623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.171626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:19.171629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:19.171698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:19.171706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.171719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.171729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:19.171752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318268017:13613], now have 1 active actors on pipe
2025-10-02T08:15:19.171762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2339
2025-10-02T08:15:19.171764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535049318268006:13612]
2025-10-02T08:15:19.171767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535049318268006:13612]
2025-10-02T08:15:19.171774Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:19.171784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535049777726512:2378], now have 1 active actors on pipe
2025-10-02T08:15:19.171784Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:19.171789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:19.171792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:19.171806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:19.171815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:19.171823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.171827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.171870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535049318268006:13612]
2025-10-02T08:15:19.171880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:19.171889Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:19.171896Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:19.171902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.171906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.171917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:19.171927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.171935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:19.171922Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2339
2025-10-02T08:15:19.171970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.172023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.172031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.172045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.172089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2340 partition: 0 MaxSeqNo: 17 sessionId: src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0
2025-10-02T08:15:19.172424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cebf57a4-9b908a1d-3e8783bf-bd6d6007_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:19.174887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0] Write session: try to update token
2025-10-02T08:15:19.174905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:19.187997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId: src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:19.189490Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:19.189508Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:19.189511Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:19.189519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535049318268006:13612]
2025-10-02T08:15:19.189523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535049318268006:13612]
2025-10-02T08:15:19.189565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:19.189572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.189574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:19.189618Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:19.189629Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:19.189711Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:19.190784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:19.247166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535049318268043:13279]
2025-10-02T08:15:19.247278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2339, pipe: [1:7556535049318268043:13279]
2025-10-02T08:15:19.326582Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:19.326793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.326803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.326834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318268043:13279], now have 1 active actors on pipe
2025-10-02T08:15:19.326983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535049318268043:13279]
2025-10-02T08:15:19.327003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:19.327008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:19.327050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2340 reason: error at write: Disconnected sessionId: src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0
2025-10-02T08:15:19.327071Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:19.327121Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:19.327185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2340 sessionId: src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0 is DEAD
2025-10-02T08:15:19.327328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:19.327340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0] Write session will restart in 0.009142s
2025-10-02T08:15:19.327367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0] Write session: Do CDS request
2025-10-02T08:15:19.327373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:19.337247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.337284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:19.337298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2341
2025-10-02T08:15:19.337481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.337521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:19.337530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:19.337538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:19.337635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:19.337887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2341 sessionId:  describe result for acl check
2025-10-02T08:15:19.337915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:19.337921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:19.337922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:19.337927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535049318268402:13620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:19.338389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535049318268402:13620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:19.339299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:19.339475Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:19.339484Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:19.339493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:19.339537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:19.339574Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535049318268424:13618]
2025-10-02T08:15:19.340134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535049318268402:13620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:19.340194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:19.340366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:19.340404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:19.340739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:19.340790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.340797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.340798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.340799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.340813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.340818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.340827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.340831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.340835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.340838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.340844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.340851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.340862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.340867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.340872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.340876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.340880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.340885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.340889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.340893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.340914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:19.346098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535049318268402:13620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:19.346112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535049318268402:13620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:19.346118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535049318268402:13620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:19.346127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:19.348562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:19.350238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:19.350253Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:19.350254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:19.350257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:19.350261Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2340 [1:7556535049318268424:13618]
2025-10-02T08:15:19.350270Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:19.350282Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:19.350285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.350287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.350289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.350302Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:19.350305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:19.350310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:19.350359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.350365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.350367Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:19.350369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:19.350421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:19.350427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.350439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.350452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:19.350472Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535049318268397:13618]
2025-10-02T08:15:19.350477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535049318268397:13618]
2025-10-02T08:15:19.350485Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:19.350495Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:19.350497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318268451:13620], now have 1 active actors on pipe
2025-10-02T08:15:19.350504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:19.350506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:19.350508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2340
2025-10-02T08:15:19.350517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:19.350520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:19.350525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535049777726520:2378], now have 1 active actors on pipe
2025-10-02T08:15:19.350558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.350567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.350578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535049318268397:13618]
2025-10-02T08:15:19.350589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:19.350603Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:19.350609Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca93be5-1720bb8e-247afaa4-c409e788_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:19.350615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.350618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.350620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:19.350605Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2340
2025-10-02T08:15:19.350629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.350643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:19.350670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.350731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.350737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.350747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.350773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2341 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca93be5-1720bb8e-247afaa4-c409e788_0
2025-10-02T08:15:19.351081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5da32bc-98edb9db-69f83918-c9c2887a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca93be5-1720bb8e-247afaa4-c409e788_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:19.353602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca93be5-1720bb8e-247afaa4-c409e788_0] Write session: try to update token
2025-10-02T08:15:19.353618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca93be5-1720bb8e-247afaa4-c409e788_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:19.371311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId: src_id|ca93be5-1720bb8e-247afaa4-c409e788_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:19.373950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:19.374330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.374352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.374372Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:19.374380Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:19.374383Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:19.374391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535049318268397:13618]
2025-10-02T08:15:19.374396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535049318268397:13618]
2025-10-02T08:15:19.374434Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:19.374445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:19.374451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.374454Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:19.374456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:19.374590Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:19.426938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535049318268465:13279]
2025-10-02T08:15:19.427069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2340, pipe: [1:7556535049318268465:13279]
2025-10-02T08:15:19.523551Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:19.523911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:19.523959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:19.523963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318268465:13279], now have 1 active actors on pipe
2025-10-02T08:15:19.524053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:19.524060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:19.524079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2341 reason: error at write: Disconnected sessionId: src_id|ca93be5-1720bb8e-247afaa4-c409e788_0
2025-10-02T08:15:19.524233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2341 sessionId: src_id|ca93be5-1720bb8e-247afaa4-c409e788_0 is DEAD
2025-10-02T08:15:19.524239Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:19.524353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca93be5-1720bb8e-247afaa4-c409e788_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:19.524361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca93be5-1720bb8e-247afaa4-c409e788_0] Write session will restart in 0.009900s
2025-10-02T08:15:19.524381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca93be5-1720bb8e-247afaa4-c409e788_0] Write session: Do CDS request
2025-10-02T08:15:19.524388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca93be5-1720bb8e-247afaa4-c409e788_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:19.524400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535049318268465:13279]
2025-10-02T08:15:19.535316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca93be5-1720bb8e-247afaa4-c409e788_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.536928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:19.536943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2342
2025-10-02T08:15:19.537010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:19.537079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.537105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:19.537111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:19.537114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:19.537450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2342 sessionId:  describe result for acl check
2025-10-02T08:15:19.537488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:19.537489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:19.537490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:19.537495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535049318268833:13629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:19.537934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535049318268833:13629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:19.538372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:19.538545Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:19.538550Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:19.538559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:19.538605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:19.538632Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535049318268841:13627]
2025-10-02T08:15:19.539073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:19.539260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:19.539297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:19.539583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:19.539628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.539629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.539631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.539632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.539633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.539637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.539645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.539648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.539651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.539654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.539659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.539665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.539671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.539675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.539679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.539684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.539688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.539692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.539699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.539704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.539720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:19.539898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535049318268833:13629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:19.546100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535049318268833:13629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:19.546116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535049318268833:13629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:19.546120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535049318268833:13629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:19.546128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:19.547912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:19.549596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:19.549616Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:19.549618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:19.549621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:19.549628Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2341 [1:7556535049318268841:13627]
2025-10-02T08:15:19.549639Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:19.549654Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:19.549658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.549661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.549663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.549678Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:19.549682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:19.549687Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:19.549751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.549761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.549764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:19.549767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:19.549836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:19.549838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.549851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.549861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:19.549871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2341
2025-10-02T08:15:19.549879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318268884:13629], now have 1 active actors on pipe
2025-10-02T08:15:19.549885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535049318268826:13627]
2025-10-02T08:15:19.549887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535049318268826:13627]
2025-10-02T08:15:19.549901Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:19.549909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535049777726527:2378], now have 1 active actors on pipe
2025-10-02T08:15:19.549914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.549918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.549936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:19.549949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:19.549952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:19.549964Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:19.549967Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:19.549994Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:19.550001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.550005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.550006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:19.550014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.550023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:19.550029Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535049318268826:13627]
2025-10-02T08:15:19.550040Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:19.550051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:19.550059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.550143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.550145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.550159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.550193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2342 partition: 0 MaxSeqNo: 17 sessionId: src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0
2025-10-02T08:15:19.550517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca93be5-1720bb8e-247afaa4-c409e788_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:19.552886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2341
2025-10-02T08:15:19.553203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0] Write session: try to update token
2025-10-02T08:15:19.553218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:19.567012Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:19.567032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:19.567033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:19.567040Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535049318268826:13627]
2025-10-02T08:15:19.567045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535049318268826:13627]
2025-10-02T08:15:19.567085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:19.567090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.567089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:19.567091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:19.567095Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:19.567254Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:19.567348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId: src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:19.569995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:19.624535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535049318268898:13279]
2025-10-02T08:15:19.624666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2341, pipe: [1:7556535049318268898:13279]
2025-10-02T08:15:19.700252Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:19.700496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.700509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.700542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318268898:13279], now have 1 active actors on pipe
2025-10-02T08:15:19.700659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:19.700671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:19.700747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2342 reason: error at write: Disconnected sessionId: src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0
2025-10-02T08:15:19.700766Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:19.700924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2342 sessionId: src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0 is DEAD
2025-10-02T08:15:19.701115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535049318268898:13279]
2025-10-02T08:15:19.701183Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:19.701903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:19.701913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0] Write session will restart in 0.008585s
2025-10-02T08:15:19.701938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0] Write session: Do CDS request
2025-10-02T08:15:19.701944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:19.711343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.712270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:19.712284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2343
2025-10-02T08:15:19.712385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.712412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:19.712420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:19.712422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:19.712764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2343 sessionId:  describe result for acl check
2025-10-02T08:15:19.712791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:19.712797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:19.712798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:19.712821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535049318269250:13636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:19.713284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535049318269250:13636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:19.715567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535049318269250:13636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:19.715609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:19.716500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:19.716692Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:19.716704Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:19.716717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:19.716774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:19.716831Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535049318269296:13635]
2025-10-02T08:15:19.717439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:19.717620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:19.717670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:19.717966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:19.718031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.718041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.718042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.718043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.718045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.718050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.718060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.718064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.718067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.718071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.718077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.718084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.718090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.718095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.718099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.718110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.718114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.718119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.718124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.718133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.718160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:19.718497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535049318269250:13636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:19.718514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535049318269250:13636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:19.718517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535049318269250:13636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:19.718526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:19.726376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:19.728275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:19.728293Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:19.728296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:19.728300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:19.728306Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2342 [1:7556535049318269296:13635]
2025-10-02T08:15:19.728317Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:19.728333Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:19.728336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.728339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.728341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.728356Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:19.728360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:19.728366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:19.728426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.728435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.728437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:19.728440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:19.728505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:19.728516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.728529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.728540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:19.728558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318269313:13636], now have 1 active actors on pipe
2025-10-02T08:15:19.728570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535049318269280:13635]
2025-10-02T08:15:19.728572Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535049318269280:13635]
2025-10-02T08:15:19.728579Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:19.728579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2342
2025-10-02T08:15:19.728590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535049777726534:2378], now have 1 active actors on pipe
2025-10-02T08:15:19.728589Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:19.728592Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:19.728595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:19.728608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:19.728611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:19.728618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.728627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.728635Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2342
2025-10-02T08:15:19.728680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535049318269280:13635]
2025-10-02T08:15:19.728691Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:19.728694Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:19.728706Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:19.728712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.728715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.728717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:19.728726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.728734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:19.728776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.728896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.728914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.728947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.728993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2343 partition: 0 MaxSeqNo: 17 sessionId: src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0
2025-10-02T08:15:19.729343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa7dbd73-b2d82086-5ed1b742-f1bc80e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:19.731889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0] Write session: try to update token
2025-10-02T08:15:19.731904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:19.740967Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:19.740984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:19.740994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535049318269280:13635]
2025-10-02T08:15:19.741037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:19.741043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:19.741219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:19.741379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:19.741536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:19.741693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:19.741906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:19.741960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:19.745766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId: src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:19.748171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:19.748259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.748270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.748309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:19.748331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:19.748389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.748395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.748556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.748621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.748680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.748742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.748783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.748788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.748875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.748928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.748988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.749047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.749085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.749088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.749152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.749208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.749262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.749320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.749357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.749358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.749454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.749517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.749585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.749650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.749691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.749696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.749762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.749821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.749886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.749944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.749986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.749988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.750056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.750112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.750174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.750231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.750271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.750273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.750343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.750398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.750453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.750512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.750550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.750552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.750618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.750671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.750722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.750779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.750815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.750817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.750881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.750932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.750984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.751044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.751094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.751100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.751161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.751224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.751283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.751340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.751380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.751383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.751424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:19.751483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.751495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.751498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:19.751528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:19.751542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:19.751545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:19.751547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:19.751550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:19.751899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:19.751913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:19.751918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:19.751920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:19.751922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:19.751926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:19.752407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:19.752426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:19.752433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:19.752437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:19.752440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:19.752443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:19.753335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:19.753364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:19.753371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:19.753373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:19.753377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:19.755404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:19.755423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:19.755433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392919755
2025-10-02T08:15:19.755617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:19.755633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:19.755643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:19.755646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:19.755650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:19.755655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:19.756096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:19.756121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:19.756124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:19.756128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:19.756130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:19.756132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:19.756574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:19.756594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:19.756600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:19.756602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:19.756604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:19.756606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:19.757061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:19.757080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:19.757084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:19.758013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:19.758026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:19.758029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:19.758032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:19.758039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392919757
2025-10-02T08:15:19.758294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:19.758316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:19.758322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:19.758325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:19.758329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:19.758334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:19.758760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:19.758785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:19.758793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:19.758796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:19.758799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:19.758802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:19.759246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:19.759265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.759359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392919759
2025-10-02T08:15:19.760123Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:19.760143Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:19.760163Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:19.760167Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:19.761826Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:19.761845Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:19.761847Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:19.761854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535049318269280:13635]
2025-10-02T08:15:19.761858Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535049318269280:13635]
2025-10-02T08:15:19.761903Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:19.761915Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:19.761920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:19.761925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.761928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:19.762059Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:19.801161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535049318269335:13279]
2025-10-02T08:15:19.801260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2342, pipe: [1:7556535049318269335:13279]
2025-10-02T08:15:19.899908Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:19.900225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318269335:13279], now have 1 active actors on pipe
2025-10-02T08:15:19.900382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535049318269335:13279]
2025-10-02T08:15:19.900410Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:19.900414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:19.900416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:19.900458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2343 reason: error at write: Disconnected sessionId: src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0
2025-10-02T08:15:19.900530Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:19.900632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2343 sessionId: src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0 is DEAD
2025-10-02T08:15:19.900917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:19.900926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0] Write session will restart in 0.005670s
2025-10-02T08:15:19.900943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0] Write session: Do CDS request
2025-10-02T08:15:19.900948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:19.907208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.907279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:19.907291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2344
2025-10-02T08:15:19.907412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:19.907441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:19.907451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:19.907454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:19.907826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2344 sessionId:  describe result for acl check
2025-10-02T08:15:19.907853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:19.907857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:19.907858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:19.907861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535049318269606:13643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:19.908248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535049318269606:13643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:19.911037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535049318269606:13643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:19.912729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:19.914095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:19.914277Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:19.914288Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:19.914297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:19.914338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:19.914377Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535049318269747:13642]
2025-10-02T08:15:19.914533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535049318269606:13643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:19.914548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535049318269606:13643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:19.914551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535049318269606:13643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:19.914560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:19.914958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:19.915133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:19.915162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:19.915375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:19.915410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.915414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.915415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.915416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.915416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.915421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.915427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.915430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.915432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.915434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.915437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.915441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:19.915445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.915448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:19.915451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.915454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:19.915456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.915459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.915462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.915465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.915477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:19.927347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:19.928929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:19.928946Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:19.928949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:19.928953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:19.928961Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2343 [1:7556535049318269747:13642]
2025-10-02T08:15:19.928974Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:19.928993Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:19.928996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.928999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.929001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.929017Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:19.929022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:19.929029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:19.929098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.929107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.929111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:19.929114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:19.929193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:19.929200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.929216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:19.929234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:19.929252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2343
2025-10-02T08:15:19.929255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535049318269752:13643], now have 1 active actors on pipe
2025-10-02T08:15:19.929261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535049318269741:13642]
2025-10-02T08:15:19.929264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535049318269741:13642]
2025-10-02T08:15:19.929274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:19.929284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535049777726554:2378], now have 1 active actors on pipe
2025-10-02T08:15:19.929285Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:19.929289Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:19.929299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.929305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.929321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:19.929343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:19.929351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:19.929398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:19.929407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.929411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.929413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:19.929389Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2343
2025-10-02T08:15:19.929421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.929433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:19.929441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535049318269741:13642]
2025-10-02T08:15:19.929450Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:19.929463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:19.929472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.929558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.929566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.929578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:19.929615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2344 partition: 0 MaxSeqNo: 17 sessionId: src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0
2025-10-02T08:15:19.929951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3c4f2d-ce40f80c-5486c70f-a6c22d50_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:19.932610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Write session: try to update token
2025-10-02T08:15:19.932626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:19.941609Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:19.941626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:19.941633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535049318269741:13642]
2025-10-02T08:15:19.941669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:19.941691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:19.941848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:19.942002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:19.942146Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:19.942279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:19.942488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:19.942532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:19.947159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId: src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:19.949868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:19.949936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.949950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.949983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:19.950011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:19.950072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:19.950081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:19.950253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.950320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.950424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.950492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.950550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.950555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.950630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.950695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.950755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.950821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.950942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.950951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.951016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.951087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.951157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.951219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.951263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.951272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.951338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.951415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.951481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.951554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.951608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.951616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.951689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.951757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.951821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.951881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.951922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.951929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.951993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.952052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.952112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.952187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.952236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.952243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.952318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.952406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.952476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.952543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.952585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.952591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.952655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.952710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.952770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.952853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.952896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.952906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.952972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.953038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.953103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.953168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.953224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.953233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.953307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:19.953376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:19.953448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:19.953520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:19.953573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:19.953580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:19.953621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:19.953692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:19.953714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:19.953720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:19.953752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:19.953769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:19.953777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:19.953778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:19.953780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:19.954154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:19.954174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:19.954180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:19.954186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:19.954188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:19.954190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:19.954646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:19.954662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:19.954667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:19.954669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:19.954671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:19.954673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:19.955099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:19.955117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:19.955122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:19.955129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:19.955132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:19.956327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:19.956344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:19.956354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392919956
2025-10-02T08:15:19.956522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:19.956533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:19.956538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:19.956542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:19.956544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:19.956546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:19.957010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:19.957029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:19.957033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:19.957035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:19.957039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:19.957042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:19.957542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:19.957561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:19.957566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:19.957569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:19.957571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:19.957575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:19.958053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:19.958072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:19.958079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:19.959105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:19.959121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:19.959126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:19.959130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:19.959137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392919958
2025-10-02T08:15:19.959415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:19.959436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:19.959441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:19.959444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:19.959447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:19.959450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:19.959928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:19.959947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:19.959951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:19.959955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:19.959958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:19.959960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:19.960448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:19.960471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:19.960553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392919960
2025-10-02T08:15:19.961295Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:19.961315Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:19.961319Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:19.961323Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:19.962972Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:19.962986Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:19.962987Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:19.962992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535049318269741:13642]
2025-10-02T08:15:19.962995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535049318269741:13642]
2025-10-02T08:15:19.963046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:19.963052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:19.963055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:19.963057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:19.963059Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:19.963212Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:20.000605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535053613237081:13279]
2025-10-02T08:15:20.000702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2343, pipe: [1:7556535053613237081:13279]
2025-10-02T08:15:20.102944Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:20.103330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613237081:13279], now have 1 active actors on pipe
2025-10-02T08:15:20.103434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535053613237081:13279]
2025-10-02T08:15:20.103455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:20.103462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:20.103489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2344 reason: error at write: Disconnected sessionId: src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0
2025-10-02T08:15:20.103522Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:20.103658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2344 sessionId: src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0 is DEAD
2025-10-02T08:15:20.103788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:20.103798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Write session will restart in 0.008557s
2025-10-02T08:15:20.103820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Write session: Do CDS request
2025-10-02T08:15:20.103827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:20.104448Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:20.113535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.113640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:20.113657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2345
2025-10-02T08:15:20.113761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.113792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:20.113801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:20.113805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:20.114175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2345 sessionId:  describe result for acl check
2025-10-02T08:15:20.114208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:20.114216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:20.114217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:20.114223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535053613237364:13656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:20.114795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535053613237364:13656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:20.119403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:20.120947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:20.121117Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:20.121126Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:20.121135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:20.121178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:20.121217Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535053613237486:13649]
2025-10-02T08:15:20.121851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:20.122412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535053613237364:13656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:20.122664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:20.122703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:20.123014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:20.123056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.123057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.123058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.123059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.123060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.123064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.123074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.123078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.123081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.123085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.123089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.123097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.123102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.123107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.123111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.123116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.123120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.123125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.123129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.123134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.123151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:20.129111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535053613237364:13656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:20.129126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535053613237364:13656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:20.129129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535053613237364:13656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:20.129189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:20.131846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:20.133473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:20.133489Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:20.133492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:20.133496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:20.133503Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2344 [1:7556535053613237486:13649]
2025-10-02T08:15:20.133520Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:20.133537Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:20.133540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.133543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.133544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.133559Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:20.133564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:20.133571Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:20.133632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.133634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.133637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:20.133639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:20.133707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:20.133710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.133724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.133736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:20.133752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535053613237480:13649]
2025-10-02T08:15:20.133754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535053613237480:13649]
2025-10-02T08:15:20.133761Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:20.133773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613237512:13656], now have 1 active actors on pipe
2025-10-02T08:15:20.133781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:20.133780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:20.133783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:20.133797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:20.133800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:20.133833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535054072693856:2378], now have 1 active actors on pipe
2025-10-02T08:15:20.133836Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535053613237480:13649]
2025-10-02T08:15:20.133838Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:20.133878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2344
2025-10-02T08:15:20.133935Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:20.134007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2344
2025-10-02T08:15:20.134079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.134087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.134115Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:20.134124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.134128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.134130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:20.134138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.134147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:20.134162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.134235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.134241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.134253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.134280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2345 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0
2025-10-02T08:15:20.134605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 204 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:15:20.134641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0fed03-80ca1e16-18168d6f-2ae07748_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:20.137237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0] Write session: try to update token
2025-10-02T08:15:20.137251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:20.152193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId: src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:20.154499Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:20.154520Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:20.154522Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:20.154530Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535053613237480:13649]
2025-10-02T08:15:20.154533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535053613237480:13649]
2025-10-02T08:15:20.154573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:20.154582Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:20.154584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.154587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:20.154591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:20.154733Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:20.154829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:20.203591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535053613237549:13279]
2025-10-02T08:15:20.203734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2344, pipe: [1:7556535053613237549:13279]
2025-10-02T08:15:20.295486Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:20.295993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.296006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.296037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613237549:13279], now have 1 active actors on pipe
2025-10-02T08:15:20.296131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535053613237549:13279]
2025-10-02T08:15:20.296147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:20.296149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:20.296212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2345 reason: error at write: Disconnected sessionId: src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0
2025-10-02T08:15:20.296221Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:20.296334Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:20.296500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:20.296508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0] Write session will restart in 0.005853s
2025-10-02T08:15:20.296530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0] Write session: Do CDS request
2025-10-02T08:15:20.296540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:20.296375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2345 sessionId: src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0 is DEAD
2025-10-02T08:15:20.303269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.303347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:20.303363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2346
2025-10-02T08:15:20.303480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.303510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:20.303520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:20.303524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:20.303892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2346 sessionId:  describe result for acl check
2025-10-02T08:15:20.303922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:20.303930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:20.303931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:20.303937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535053613237799:13668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:20.304543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535053613237799:13668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:20.306973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535053613237799:13668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:20.308917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:20.310140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:20.310303Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:20.310313Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:20.310322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:20.310365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:20.310399Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535053613237951:13667]
2025-10-02T08:15:20.310711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535053613237799:13668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:20.310724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535053613237799:13668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:20.310727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535053613237799:13668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:20.310735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:20.311074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:20.311276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:20.311332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:20.311659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:20.311704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.311710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.311711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.311712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.311713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.311718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.311728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.311732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.311736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.311741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.311748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.311760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.311771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.311777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.311781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.311791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.311795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.311806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.311811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.311820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.311840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:20.320557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:20.322412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:20.322439Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:20.322442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:20.322446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:20.322452Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2345 [1:7556535053613237951:13667]
2025-10-02T08:15:20.322466Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:20.322485Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:20.322488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.322492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.322494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.322511Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:20.322517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:20.322523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:20.322591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.322601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.322603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:20.322606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:20.322747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2345
2025-10-02T08:15:20.322869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2345
2025-10-02T08:15:20.322962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:20.322971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.322987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.323006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:20.323028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613237956:13668], now have 1 active actors on pipe
2025-10-02T08:15:20.323036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535054072693887:2378], now have 1 active actors on pipe
2025-10-02T08:15:20.323042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.323050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.323074Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535053613237945:13667]
2025-10-02T08:15:20.323080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535053613237945:13667]
2025-10-02T08:15:20.323093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:20.323111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:20.323113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:20.323116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:20.323128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:20.323130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:20.323144Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:20.323155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.323163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.323165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:20.323174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.323188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:20.323231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535053613237945:13667]
2025-10-02T08:15:20.323243Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:20.323256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.323258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:20.323363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.323372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.323385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.323419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2346 partition: 0 MaxSeqNo: 17 sessionId: src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0
2025-10-02T08:15:20.323755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8bdb74b-cb18a363-a6018803-c4168fba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:20.326460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0] Write session: try to update token
2025-10-02T08:15:20.326480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:20.336007Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:20.336029Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:20.336039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535053613237945:13667]
2025-10-02T08:15:20.336086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:20.336089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:20.336299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:20.336444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:20.336591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:20.336738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:20.336988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:20.337025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:20.341065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId: src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:20.343518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:20.343587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.343600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.343632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:20.343655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:20.343708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.343723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.343896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.343965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.344038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.344123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.344328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.344339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.344409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.344468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.344529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.344592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.344635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.344640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.344718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.344780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.344881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.344942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.344987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.344994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.345059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.345161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.345226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.345288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.345332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.345339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.345405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.345462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.345523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.345582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.345640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.345650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.345713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.345769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.345829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.345890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.345936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.345941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.346004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.346059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.346123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.346190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.346233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.346238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.346300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.346356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.346416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.346474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.346515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.346520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.346579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.346637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.346708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.346767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.346812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.346817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.346877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.346928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.346989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.347046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.347089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.347094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.347130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:20.347197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.347216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.347222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:20.347251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:20.347266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:20.347271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:20.347273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:20.347275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:20.347656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:20.347681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:20.347690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:20.347697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:20.347701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:20.347704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:20.348321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:20.348343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:20.348349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:20.348351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:20.348354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:20.348356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:20.348930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:20.348950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:20.348955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:20.348958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:20.348959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:20.351012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:20.351031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:20.351040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392920351
2025-10-02T08:15:20.351170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:20.351180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:20.351184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:20.351186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:20.351189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:20.351192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:20.351622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:20.351641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:20.351645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:20.351647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:20.351650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:20.351652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:20.352127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:20.352148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:20.352173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:20.352175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:20.352178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:20.352180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:20.352597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:20.352616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:20.352622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:20.353615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:20.353633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:20.353639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:20.353643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:20.353652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392920353
2025-10-02T08:15:20.353951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:20.353976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:20.353983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:20.353986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:20.353990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:20.353995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:20.354464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:20.354482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:20.354486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:20.354488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:20.354491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:20.354493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:20.354910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:20.354927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.355001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392920354
2025-10-02T08:15:20.358494Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:20.358512Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:20.358516Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:20.358520Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:20.360148Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:20.360176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:20.360177Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:20.360189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535053613237945:13667]
2025-10-02T08:15:20.360193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535053613237945:13667]
2025-10-02T08:15:20.360246Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:20.360255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:20.360257Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:20.360260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.360263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:20.360399Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:20.396117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535053613237990:13279]
2025-10-02T08:15:20.396241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2345, pipe: [1:7556535053613237990:13279]
2025-10-02T08:15:20.505129Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:20.505806Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:20.506709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:20.506719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0] Write session will restart in 0.007370s
2025-10-02T08:15:20.506742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0] Write session: Do CDS request
2025-10-02T08:15:20.506748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:20.505524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613237990:13279], now have 1 active actors on pipe
2025-10-02T08:15:20.505863Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:20.506417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:20.506442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2346 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0
2025-10-02T08:15:20.506596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2346 sessionId: src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0 is DEAD
2025-10-02T08:15:20.506737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535053613237990:13279]
2025-10-02T08:15:20.515254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.515308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:20.515321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2347
2025-10-02T08:15:20.515441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.515472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:20.515514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:20.515522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:20.515946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2347 sessionId:  describe result for acl check
2025-10-02T08:15:20.515989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:20.515994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:20.515996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:20.516001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535053613238234:13675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:20.516508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535053613238234:13675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:20.520558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535053613238234:13675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:20.523967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535053613238234:13675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:20.523982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535053613238234:13675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:20.523985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535053613238234:13675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:20.523993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:20.524161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:20.525442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:20.525780Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:20.525788Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:20.525798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:20.525843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:20.525879Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535053613238401:13674]
2025-10-02T08:15:20.526464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:20.526646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:20.526680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:20.526969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:20.527006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.527011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.527012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.527013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.527015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.527018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.527027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.527031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.527034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.527037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.527042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.527049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.527053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.527057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.527061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.527065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.527070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.527075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.527079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.527083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.527100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:20.535753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:20.537198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:20.537213Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:20.537215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:20.537218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:20.537224Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2346 [1:7556535053613238401:13674]
2025-10-02T08:15:20.537232Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:20.537247Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:20.537249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.537251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.537253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.537266Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:20.537269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:20.537274Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:20.537335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.537342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.537344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:20.537347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:20.537406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:20.537417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.537429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.537436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:20.537448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535053613238392:13674]
2025-10-02T08:15:20.537450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535053613238392:13674]
2025-10-02T08:15:20.537455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:20.537465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613238391:13675], now have 1 active actors on pipe
2025-10-02T08:15:20.537472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:20.537472Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:20.537477Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:20.537485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:20.537485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2346
2025-10-02T08:15:20.537488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:20.537492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535054072693894:2378], now have 1 active actors on pipe
2025-10-02T08:15:20.537519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535053613238392:13674]
2025-10-02T08:15:20.537535Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:20.537541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.537544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.537547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:20.537587Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:20.537599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.537602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.537604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:20.537613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.537625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:20.537583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2346
2025-10-02T08:15:20.537649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.537687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.537695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.537707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.537741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2347 partition: 0 MaxSeqNo: 17 sessionId: src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0
2025-10-02T08:15:20.538079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1d3ab7e-8e930629-75b16e45-64aad1ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:20.540938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0] Write session: try to update token
2025-10-02T08:15:20.540957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:20.554480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId: src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:20.555552Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:20.555566Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:20.555569Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:20.555576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535053613238392:13674]
2025-10-02T08:15:20.555580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535053613238392:13674]
2025-10-02T08:15:20.555621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:20.555631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.555630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:20.555635Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:20.555637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:20.555766Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:20.557194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:20.607047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535053613238427:13279]
2025-10-02T08:15:20.607165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2346, pipe: [1:7556535053613238427:13279]
2025-10-02T08:15:20.688912Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:20.689286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.689297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.689334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613238427:13279], now have 1 active actors on pipe
2025-10-02T08:15:20.689452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535053613238427:13279]
2025-10-02T08:15:20.689477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:20.689479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:20.689546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2347 reason: error at write: Disconnected sessionId: src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0
2025-10-02T08:15:20.689608Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:20.689855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:20.689865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0] Write session will restart in 0.006289s
2025-10-02T08:15:20.689702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2347 sessionId: src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0 is DEAD
2025-10-02T08:15:20.689709Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:20.689888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0] Write session: Do CDS request
2025-10-02T08:15:20.689894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:20.697265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.697323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:20.697338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2348
2025-10-02T08:15:20.697498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.697527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:20.697536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:20.697539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:20.697857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2348 sessionId:  describe result for acl check
2025-10-02T08:15:20.697893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:20.697894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:20.697896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:20.697902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535053613238686:13681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:20.698413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535053613238686:13681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:20.701517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535053613238686:13681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:20.703895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:20.705084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:20.705262Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:20.705272Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:20.705283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:20.705300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535053613238686:13681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:20.705311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535053613238686:13681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:20.705315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535053613238686:13681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:20.705331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:20.705339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:20.705373Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535053613238834:13680]
2025-10-02T08:15:20.706019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:20.706218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:20.706260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:20.706549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:20.706608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.706614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.706615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.706616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.706617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.706622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.706633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.706637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.706641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.706645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.706651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.706663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.706673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.706679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.706690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.706695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.706704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.706709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.706714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.706719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.706737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:20.714982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:20.716571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:20.716590Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:20.716593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:20.716596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:20.716602Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2347 [1:7556535053613238834:13680]
2025-10-02T08:15:20.716614Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:20.716630Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:20.716633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.716636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.716639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.716655Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:20.716660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:20.716667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:20.716724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.716732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.716735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:20.716738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:20.716827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:20.716836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.716848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.716859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:20.716862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2347
2025-10-02T08:15:20.716877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613238839:13681], now have 1 active actors on pipe
2025-10-02T08:15:20.716882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535054072693901:2378], now have 1 active actors on pipe
2025-10-02T08:15:20.716887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.716891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.716906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535053613238828:13680]
2025-10-02T08:15:20.716913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535053613238828:13680]
2025-10-02T08:15:20.716925Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:20.716940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:20.716950Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:20.716953Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:20.716957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:20.716960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:20.716975Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:20.716980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.716988Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.716990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:20.716998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.716959Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2347
2025-10-02T08:15:20.717011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:20.717049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535053613238828:13680]
2025-10-02T08:15:20.717060Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:20.717076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.717085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:20.717128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.717135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.717149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.717186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2348 partition: 0 MaxSeqNo: 17 sessionId: src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0
2025-10-02T08:15:20.717500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624e2fad-e4572e14-52b14d4e-441cc0dc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:20.720094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0] Write session: try to update token
2025-10-02T08:15:20.720112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:20.728386Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:20.728404Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:20.728411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535053613238828:13680]
2025-10-02T08:15:20.728450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:20.728454Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:20.728619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:20.728758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:20.728921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:20.729056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:20.729243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:20.729281Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:20.733238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId: src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:20.735792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:20.735840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.735847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.735884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:20.735907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:20.735941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.735956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.736117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.736200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.736272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.736338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.736382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.736391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.736465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.736528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.736589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.736659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.736709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.736717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.736788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.736868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.736926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.736992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.737035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.737047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.737112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.737176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.737242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.737304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.737349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.737357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.737423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.737487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.737577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.737641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.737684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.737691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.737755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.737818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.737881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.737946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.737991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.738000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.738064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.738123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.738186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.738250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.738295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.738306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.738372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.738431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.738497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.738559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.738603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.738610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.738677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.738737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.738794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.738856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.738899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.738906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.738969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:20.739033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:20.739096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:20.739156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:20.739201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:20.739208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:20.739247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:20.739309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.739331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.739338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:20.739367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:20.739383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:20.739391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:20.739394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:20.739397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:20.739776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:20.739804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:20.739814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:20.739818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:20.739822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:20.739830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:20.740444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:20.740467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:20.740473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:20.740477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:20.740481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:20.740485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:20.740967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:20.740988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:20.740993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:20.740997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:20.741002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:20.742208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:20.742227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:20.742239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392920742
2025-10-02T08:15:20.742451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:20.742467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:20.742472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:20.742475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:20.742481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:20.742484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:20.742929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:20.742952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:20.742957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:20.742961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:20.742965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:20.742968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:20.743479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:20.743502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:20.743508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:20.743511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:20.743515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:20.743523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:20.744001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:20.744024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:20.744030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:20.745188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:20.745206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:20.745213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:20.745217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:20.745226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392920744
2025-10-02T08:15:20.745539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:20.745560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:20.745570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:20.745574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:20.745583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:20.745586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:20.746038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:20.746060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:20.746066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:20.746070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:20.746074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:20.746078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:20.746550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:20.746574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.746703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392920746
2025-10-02T08:15:20.747490Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:20.747516Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:20.747524Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:20.747529Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:20.749210Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:20.749227Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:20.749228Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:20.749238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535053613238828:13680]
2025-10-02T08:15:20.749243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535053613238828:13680]
2025-10-02T08:15:20.749290Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:20.749304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:20.749304Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:20.749308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.749310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:20.749443Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:20.789853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535053613238874:13279]
2025-10-02T08:15:20.789957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2347, pipe: [1:7556535053613238874:13279]
2025-10-02T08:15:20.886788Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:20.887123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613238874:13279], now have 1 active actors on pipe
2025-10-02T08:15:20.887226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:20.887234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:20.887260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2348 reason: error at write: Disconnected sessionId: src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0
2025-10-02T08:15:20.887335Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:20.887328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:20.887422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2348 sessionId: src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0 is DEAD
2025-10-02T08:15:20.887569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:20.887577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0] Write session will restart in 0.008167s
2025-10-02T08:15:20.887610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0] Write session: Do CDS request
2025-10-02T08:15:20.887616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:20.887596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535053613238874:13279]
2025-10-02T08:15:20.900945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.901386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:20.901399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2349
2025-10-02T08:15:20.901522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:20.901555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:20.901566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:20.901570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:20.901915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2349 sessionId:  describe result for acl check
2025-10-02T08:15:20.901943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:20.901945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:20.901946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:20.901951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535053613239262:13689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:20.901981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:20.902415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535053613239262:13689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:20.903321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:20.903505Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:20.903509Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:20.903529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:20.903582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:20.903615Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535053613239282:13687]
2025-10-02T08:15:20.904079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:20.904360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:20.904403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:20.904615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535053613239262:13689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:20.904746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:20.904824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.904831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.904832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.904833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.904834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.904839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.904849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.904852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.904855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.904858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.904864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.904870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:20.904883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.904888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:20.904892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.904898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:20.904902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.904906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.904910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.904914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.904933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:20.911019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535053613239262:13689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:20.911034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535053613239262:13689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:20.911052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535053613239262:13689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:20.911060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:20.913196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:20.914710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:20.914721Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:20.914724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:20.914728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:20.914734Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2348 [1:7556535053613239282:13687]
2025-10-02T08:15:20.914745Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:20.914762Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:20.914770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.914773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.914775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.914791Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:20.914802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:20.914808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:20.914859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.914861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.914865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:20.914867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:20.914914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:20.914916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.914924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:20.914931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:20.914943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535053613239261:13687]
2025-10-02T08:15:20.914945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535053613239261:13687]
2025-10-02T08:15:20.914954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:20.914963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:20.914971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:20.914973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:20.914997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535053613239261:13687]
2025-10-02T08:15:20.914999Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:20.915017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613239313:13689], now have 1 active actors on pipe
2025-10-02T08:15:20.915029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535054072693922:2378], now have 1 active actors on pipe
2025-10-02T08:15:20.915033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2348
2025-10-02T08:15:20.915116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:20.915119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:20.915125Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:20.915247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.915257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.915280Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86156b15-eae624fc-a4051520-fd374fa3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:20.915295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:20.915300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:20.915302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:20.915313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:20.915323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:20.915336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.915449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:20.915453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:20.915471Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2348
2025-10-02T08:15:20.915839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22134ae5-1ce27535-7b43394d-5bd7b9c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|86156b15-eae624fc-a4051520-fd374fa3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:20.915480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:20.915518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2349 partition: 0 MaxSeqNo: 17 sessionId: src_id|86156b15-eae624fc-a4051520-fd374fa3_0
2025-10-02T08:15:20.918375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86156b15-eae624fc-a4051520-fd374fa3_0] Write session: try to update token
2025-10-02T08:15:20.918391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86156b15-eae624fc-a4051520-fd374fa3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:20.933412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId: src_id|86156b15-eae624fc-a4051520-fd374fa3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:20.933694Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:20.933706Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:20.933708Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:20.933719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535053613239261:13687]
2025-10-02T08:15:20.933722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535053613239261:13687]
2025-10-02T08:15:20.933761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:20.933772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:20.933774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:20.933773Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:20.933779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:20.933913Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:20.935976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:20.988064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535053613239327:13279]
2025-10-02T08:15:20.988193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2348, pipe: [1:7556535053613239327:13279]
2025-10-02T08:15:21.068955Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:21.069234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.069245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.069277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535053613239327:13279], now have 1 active actors on pipe
2025-10-02T08:15:21.069455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535053613239327:13279]
2025-10-02T08:15:21.069480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:21.069482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:21.069568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2349 reason: error at write: Disconnected sessionId: src_id|86156b15-eae624fc-a4051520-fd374fa3_0
2025-10-02T08:15:21.069630Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:21.069724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2349 sessionId: src_id|86156b15-eae624fc-a4051520-fd374fa3_0 is DEAD
2025-10-02T08:15:21.069967Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 23 CurrentSessionLifetimeMs: 481764 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:15:21.070142Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:21.072977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86156b15-eae624fc-a4051520-fd374fa3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:21.072988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86156b15-eae624fc-a4051520-fd374fa3_0] Write session will restart in 0.008075s
2025-10-02T08:15:21.073012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86156b15-eae624fc-a4051520-fd374fa3_0] Write session: Do CDS request
2025-10-02T08:15:21.073018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86156b15-eae624fc-a4051520-fd374fa3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:21.082271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86156b15-eae624fc-a4051520-fd374fa3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.085006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:21.085023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2350
2025-10-02T08:15:21.085209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.085249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:21.085258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:21.085262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:21.085639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2350 sessionId:  describe result for acl check
2025-10-02T08:15:21.085675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:21.085681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:21.085683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:21.085688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535057908206899:13695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:21.086218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535057908206899:13695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:21.088583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535057908206899:13695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:21.094039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535057908206899:13695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:21.094055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535057908206899:13695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:21.094058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535057908206899:13695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:21.094067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:21.095414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:21.096355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:21.096513Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:21.096523Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:21.096531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:21.096573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:21.096609Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535057908207040:13694]
2025-10-02T08:15:21.097242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:21.097437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:21.097478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:21.097765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:21.097810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.097815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.097816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.097817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.097818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.097823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.097832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.097836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.097840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.097844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.097850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.097857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.097862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.097867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.097871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.097876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.097881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.097886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.097890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.097896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.097913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:21.109062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:21.110804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:21.110810Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:21.110813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:21.110816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:21.110822Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2349 [1:7556535057908207040:13694]
2025-10-02T08:15:21.110835Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:21.110852Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:21.110856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.110859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.110861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.110877Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:21.110882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:21.110890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:21.110957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.110960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.110964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:21.110966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:21.111032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:21.111035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.111050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.111062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:21.111078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535057908207034:13694]
2025-10-02T08:15:21.111080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535057908207034:13694]
2025-10-02T08:15:21.111088Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:21.111683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86156b15-eae624fc-a4051520-fd374fa3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:21.111101Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:21.111102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908207022:13695], now have 1 active actors on pipe
2025-10-02T08:15:21.111104Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:21.111106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2349
2025-10-02T08:15:21.111110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:21.111124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:21.111127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:21.111132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535058367661224:2378], now have 1 active actors on pipe
2025-10-02T08:15:21.111166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.111170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.111183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535057908207034:13694]
2025-10-02T08:15:21.111193Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:21.111198Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:21.111216Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:21.111223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.111227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.111229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:21.111238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.111247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:21.111270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.111316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.111318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.111331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.111367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2350 partition: 0 MaxSeqNo: 17 sessionId: src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0
2025-10-02T08:15:21.111906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2349
2025-10-02T08:15:21.114251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0] Write session: try to update token
2025-10-02T08:15:21.114266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:21.134887Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:21.134905Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:21.134908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:21.134920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535057908207034:13694]
2025-10-02T08:15:21.134924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535057908207034:13694]
2025-10-02T08:15:21.134965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:21.134971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.134973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:21.135104Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:21.137099Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:21.137110Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:21.143207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId: src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:21.145758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:21.196227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535057908207078:13279]
2025-10-02T08:15:21.201708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2349, pipe: [1:7556535057908207078:13279]
2025-10-02T08:15:21.284450Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:21.284890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.284904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.284924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908207078:13279], now have 1 active actors on pipe
2025-10-02T08:15:21.285469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:21.285478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:21.285534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2350 reason: error at write: Disconnected sessionId: src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0
2025-10-02T08:15:21.285685Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:21.285692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2350 sessionId: src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0 is DEAD
2025-10-02T08:15:21.285607Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:21.285836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:21.285844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0] Write session will restart in 0.007496s
2025-10-02T08:15:21.285868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0] Write session: Do CDS request
2025-10-02T08:15:21.285875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:21.285821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535057908207078:13279]
2025-10-02T08:15:21.294264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.294318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:21.294329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2351
2025-10-02T08:15:21.294471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.294511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:21.294521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:21.294525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:21.294945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2351 sessionId:  describe result for acl check
2025-10-02T08:15:21.294978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:21.294985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:21.294987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:21.294992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535057908207133:13713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:21.296299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535057908207133:13713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:21.299874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535057908207133:13713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:21.303010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535057908207133:13713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:21.303022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535057908207133:13713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:21.303026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535057908207133:13713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:21.303034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:21.305202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:21.306350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:21.306525Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:21.306533Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:21.306539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:21.306572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:21.306598Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535057908207518:13712]
2025-10-02T08:15:21.307101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:21.307269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:21.307307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:21.307585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:21.307621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.307625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.307626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.307626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.307627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.307630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.307637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.307639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.307641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.307643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.307647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.307654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.307658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.307661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.307663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.307665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.307667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.307682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.307691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.307695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.307710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:21.315605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:21.317298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:21.317315Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:21.317318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:21.317322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:21.317328Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2350 [1:7556535057908207518:13712]
2025-10-02T08:15:21.317341Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:21.317357Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:21.317366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.317369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.317371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.317385Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:21.317394Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:21.317405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:21.317468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.317475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.317478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:21.317481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:21.317538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:21.317546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.317559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.317576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:21.317599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908207477:13713], now have 1 active actors on pipe
2025-10-02T08:15:21.317598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2350
2025-10-02T08:15:21.317610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535057908207512:13712]
2025-10-02T08:15:21.317613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535057908207512:13712]
2025-10-02T08:15:21.317624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:21.317637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:21.317639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535058367661256:2378], now have 1 active actors on pipe
2025-10-02T08:15:21.317644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.317648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:21.317648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.317667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:21.317682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:21.317685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:21.317725Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:21.317736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.317740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.317742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:21.317750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.317759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:21.317771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535057908207512:13712]
2025-10-02T08:15:21.317784Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:21.317802Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:21.317807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.317774Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2350
2025-10-02T08:15:21.317896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.317903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.317919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.317956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2351 partition: 0 MaxSeqNo: 17 sessionId: src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0
2025-10-02T08:15:21.318268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558044c0-53e06e2d-16bb1ec5-e45f6518_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:21.320945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0] Write session: try to update token
2025-10-02T08:15:21.320964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:21.328560Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:21.328579Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:21.328588Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535057908207512:13712]
2025-10-02T08:15:21.328632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:21.328643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:21.328798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:21.328961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:21.329098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:21.329233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:21.329417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:21.329456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:21.336639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId: src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:21.339072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:21.339162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.339176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.339208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:21.339233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:21.339291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.339298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.339452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.339512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.339572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.339635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.339677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.339686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.339751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.339811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.339871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.339935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.339980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.339988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.340052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.340115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.340191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.340250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.340290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.340297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.340363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.340426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.340488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.340548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.340607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.340616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.340680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.341712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.341781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.341847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.341894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.341898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.341968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.342035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.342091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.342146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.342184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.342188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.342252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.342307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.342367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.342425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.342465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.342468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.342533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.342589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.342644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.342704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.342745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.342748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.342808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.342860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.342919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.342973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.343011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.343014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.343076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.343131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.343192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.343253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.343293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.343295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.343331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:21.343395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.343414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.343417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:21.343445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:21.343457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:21.343460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:21.343463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:21.343466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:21.343845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:21.343862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:21.343869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:21.343872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:21.343876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:21.343880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:21.344449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:21.344462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:21.344472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:21.344476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:21.344479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:21.344482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:21.345250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:21.345277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:21.345283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:21.345287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:21.345290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:21.346477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:21.346497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:21.346509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392921346
2025-10-02T08:15:21.346660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:21.346673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:21.346680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:21.346687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:21.346691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:21.346698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:21.347135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:21.347156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:21.347166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:21.347174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:21.347179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:21.347187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:21.347641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:21.347661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:21.347674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:21.347681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:21.347684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:21.347692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:21.348138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:21.348169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:21.348178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:21.349264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:21.349282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:21.349287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:21.349293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:21.349302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392921348
2025-10-02T08:15:21.349602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:21.349626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:21.349633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:21.349638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:21.349643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:21.349646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:21.350091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:21.350102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:21.350107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:21.350110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:21.350114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:21.350117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:21.350559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:21.350570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.350665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392921350
2025-10-02T08:15:21.351390Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:21.351405Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:21.351412Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:21.351419Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:21.353096Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:21.353109Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:21.353112Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:21.353123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535057908207512:13712]
2025-10-02T08:15:21.353126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535057908207512:13712]
2025-10-02T08:15:21.353179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:21.353183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.353185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:21.353276Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:21.353282Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:21.353315Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:21.385794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535057908207550:13279]
2025-10-02T08:15:21.385860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2350, pipe: [1:7556535057908207550:13279]
2025-10-02T08:15:21.511592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:21.511610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0] Write session will restart in 0.008781s
2025-10-02T08:15:21.511633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0] Write session: Do CDS request
2025-10-02T08:15:21.511639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:21.509803Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:21.510175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908207550:13279], now have 1 active actors on pipe
2025-10-02T08:15:21.510850Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:21.511260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535057908207550:13279]
2025-10-02T08:15:21.511277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:21.511304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2351 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0
2025-10-02T08:15:21.511456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2351 sessionId: src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0 is DEAD
2025-10-02T08:15:21.512031Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:21.521280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.522807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:21.522823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2352
2025-10-02T08:15:21.523030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.523062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:21.523067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:21.523071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:21.523445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2352 sessionId:  describe result for acl check
2025-10-02T08:15:21.523474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:21.523476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:21.523477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:21.523483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535057908207799:13720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:21.524022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535057908207799:13720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:21.529234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535057908207799:13720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:21.531157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:21.533511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:21.533606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535057908207799:13720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:21.533618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535057908207799:13720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:21.533621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535057908207799:13720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:21.533633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:21.533700Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:21.533710Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:21.533720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:21.533765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:21.533803Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535057908207966:13719]
2025-10-02T08:15:21.534458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:21.534690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:21.534744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:21.535054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:21.535103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.535108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.535109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.535109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.535110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.535113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.535120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.535123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.535125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.535127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.535131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.535136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.535139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.535142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.535144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.535147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.535149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.535152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.535154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.535157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.535168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:21.545406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:21.547248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:21.547265Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:21.547268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:21.547272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:21.547279Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2351 [1:7556535057908207966:13719]
2025-10-02T08:15:21.547294Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:21.547314Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:21.547322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.547326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.547329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.547345Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:21.547355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:21.547362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:21.547425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.547435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.547439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:21.547441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:21.547511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:21.547520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.547534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.547553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:21.547575Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535057908207959:13719]
2025-10-02T08:15:21.547581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535057908207959:13719]
2025-10-02T08:15:21.547594Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:21.547613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:21.547632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:21.547641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:21.547642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:21.547646Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:21.547676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535057908207959:13719]
2025-10-02T08:15:21.547679Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:21.547708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908207968:13720], now have 1 active actors on pipe
2025-10-02T08:15:21.547726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:21.547736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2351
2025-10-02T08:15:21.547873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535058367661263:2378], now have 1 active actors on pipe
2025-10-02T08:15:21.547883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.547889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.547919Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:21.547927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.547932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.547934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:21.547945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.547956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:21.547975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.548000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.548003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.548014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.548045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2352 partition: 0 MaxSeqNo: 17 sessionId: src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0
2025-10-02T08:15:21.548351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1149d7e6-8df80900-d359a936-4ecd2f6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:21.547995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2351
2025-10-02T08:15:21.551118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0] Write session: try to update token
2025-10-02T08:15:21.551135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:21.565752Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:21.565770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:21.565773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:21.565782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535057908207959:13719]
2025-10-02T08:15:21.565787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535057908207959:13719]
2025-10-02T08:15:21.565830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:21.565833Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:21.565839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:21.565840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.565843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:21.565983Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:21.569467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId: src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:21.571948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:21.611629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535057908207997:13279]
2025-10-02T08:15:21.611695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2351, pipe: [1:7556535057908207997:13279]
2025-10-02T08:15:21.705359Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:21.705764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.705777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.705817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908207997:13279], now have 1 active actors on pipe
2025-10-02T08:15:21.705935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:21.705946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:21.706016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2352 reason: error at write: Disconnected sessionId: src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0
2025-10-02T08:15:21.706055Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:21.706173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2352 sessionId: src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0 is DEAD
2025-10-02T08:15:21.706256Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:21.706311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:21.706319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0] Write session will restart in 0.005322s
2025-10-02T08:15:21.706341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0] Write session: Do CDS request
2025-10-02T08:15:21.706348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:21.706370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535057908207997:13279]
2025-10-02T08:15:21.713217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.713319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:21.713335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2353
2025-10-02T08:15:21.713451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.713480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:21.713489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:21.713493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:21.713900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2353 sessionId:  describe result for acl check
2025-10-02T08:15:21.713944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:21.713951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:21.713952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:21.713957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535057908208285:13726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:21.714446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535057908208285:13726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:21.717260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535057908208285:13726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:21.718561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:21.719678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:21.719854Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:21.719864Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:21.719874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:21.719921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:21.719955Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535057908208420:13725]
2025-10-02T08:15:21.720531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535057908208285:13726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:21.720544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535057908208285:13726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:21.720549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535057908208285:13726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:21.720557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:21.720622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:21.720836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:21.720885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:21.721206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:21.721248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.721249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.721250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.721251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.721252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.721257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.721266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.721270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.721274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.721277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.721282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.721289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.721294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.721299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.721303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.721308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.721311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.721313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.721316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.721318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.721330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:21.729325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:21.731183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:21.731202Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:21.731205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:21.731209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:21.731216Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2352 [1:7556535057908208420:13725]
2025-10-02T08:15:21.731228Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:21.731245Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:21.731248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.731251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.731253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.731268Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:21.731273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:21.731279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:21.731342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.731348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.731351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:21.731353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:21.731419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:21.731429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.731442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.731455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:21.731471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535057908208412:13725]
2025-10-02T08:15:21.731473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535057908208412:13725]
2025-10-02T08:15:21.731480Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:21.731494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908208425:13726], now have 1 active actors on pipe
2025-10-02T08:15:21.731495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2352
2025-10-02T08:15:21.731502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:21.731505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535058367661270:2378], now have 1 active actors on pipe
2025-10-02T08:15:21.731506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:21.731511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:21.731526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:21.731533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:21.731540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.731544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.731584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535057908208412:13725]
2025-10-02T08:15:21.731592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:21.731560Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2352
2025-10-02T08:15:21.731600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:21.731608Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|367b2d48-35cf0547-da257624-30e49699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:21.731614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.731618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.731620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:21.731630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.731642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:21.731685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.731755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.731762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.731776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.731815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2353 partition: 0 MaxSeqNo: 17 sessionId: src_id|367b2d48-35cf0547-da257624-30e49699_0
2025-10-02T08:15:21.732163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e1f2ae-a0c76f76-1e2c02a5-ff6d0ca5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|367b2d48-35cf0547-da257624-30e49699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:21.734896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367b2d48-35cf0547-da257624-30e49699_0] Write session: try to update token
2025-10-02T08:15:21.734913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367b2d48-35cf0547-da257624-30e49699_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:21.748711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId: src_id|367b2d48-35cf0547-da257624-30e49699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:21.749359Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:21.749377Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:21.749381Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:21.749389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535057908208412:13725]
2025-10-02T08:15:21.749394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535057908208412:13725]
2025-10-02T08:15:21.749431Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:21.749441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:21.749442Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:21.749448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.749450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:21.749594Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:21.751384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:21.806667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535057908208451:13279]
2025-10-02T08:15:21.806777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2352, pipe: [1:7556535057908208451:13279]
2025-10-02T08:15:21.886922Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:21.887226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.887243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.887278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908208451:13279], now have 1 active actors on pipe
2025-10-02T08:15:21.887462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:21.887470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:21.887475Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:21.887467Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:21.887528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2353 reason: error at write: Disconnected sessionId: src_id|367b2d48-35cf0547-da257624-30e49699_0
2025-10-02T08:15:21.887699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2353 sessionId: src_id|367b2d48-35cf0547-da257624-30e49699_0 is DEAD
2025-10-02T08:15:21.887785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535057908208451:13279]
2025-10-02T08:15:21.887866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367b2d48-35cf0547-da257624-30e49699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:21.887876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367b2d48-35cf0547-da257624-30e49699_0] Write session will restart in 0.008239s
2025-10-02T08:15:21.887898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367b2d48-35cf0547-da257624-30e49699_0] Write session: Do CDS request
2025-10-02T08:15:21.887904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367b2d48-35cf0547-da257624-30e49699_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:21.897262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367b2d48-35cf0547-da257624-30e49699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.897349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:21.897364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2354
2025-10-02T08:15:21.897478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:21.897509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:21.897518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:21.897521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:21.897949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2354 sessionId:  describe result for acl check
2025-10-02T08:15:21.897985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:21.897990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:21.897992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:21.897997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535057908208788:13733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:21.898469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535057908208788:13733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:21.901449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535057908208788:13733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:21.902328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:21.903830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:21.904019Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:21.904028Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:21.904038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:21.904096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:21.904139Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535057908208883:13732]
2025-10-02T08:15:21.904200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535057908208788:13733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:21.904214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535057908208788:13733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:21.904217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535057908208788:13733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:21.904225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:21.904755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:21.904977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:21.905016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:21.905284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:21.905314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.905318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.905319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.905320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.905320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.905324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.905330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.905332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.905334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.905336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.905340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.905345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:21.905349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.905351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:21.905354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.905358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:21.905360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.905362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.905365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.905368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.905378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:21.913454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:21.915303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:21.915323Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:21.915325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:21.915329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:21.915336Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2353 [1:7556535057908208883:13732]
2025-10-02T08:15:21.915348Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:21.915364Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:21.915370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.915373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.915375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.915391Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:21.915402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:21.915411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:21.915477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.915485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.915487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:21.915489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:21.915735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2353
2025-10-02T08:15:21.915550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:21.915560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.915574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:21.915586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:21.915601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535057908208877:13732]
2025-10-02T08:15:21.915603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535057908208877:13732]
2025-10-02T08:15:21.915610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:21.915622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908208888:13733], now have 1 active actors on pipe
2025-10-02T08:15:21.915622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:21.915625Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:21.915629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:21.915640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:21.915645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:21.915651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535058367661291:2378], now have 1 active actors on pipe
2025-10-02T08:15:21.915685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535057908208877:13732]
2025-10-02T08:15:21.915693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:21.915701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:21.915732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2353
2025-10-02T08:15:21.915743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.915747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.915769Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:21.915775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.915779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.915781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:21.915789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.915798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:21.915809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.915834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.915836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.915846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:21.915873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2354 partition: 0 MaxSeqNo: 17 sessionId: src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0
2025-10-02T08:15:21.916221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367b2d48-35cf0547-da257624-30e49699_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:21.918918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0] Write session: try to update token
2025-10-02T08:15:21.918939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:21.927537Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:21.927554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:21.927562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535057908208877:13732]
2025-10-02T08:15:21.927601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:21.927601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:21.927825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:21.927974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:21.928121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:21.928284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:21.928488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:21.928531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:21.934039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId: src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:21.936615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:21.936692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.936705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.936737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:21.936763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:21.936840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:21.936854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:21.937044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.937107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.937167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.937229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.937402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.937412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.937500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.937573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.937640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.937696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.937734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.937737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.937804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.937861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.937913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.937968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.938008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.938011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.938073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.938131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.938190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.938250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.938353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.938356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.938418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.938473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.938528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.938587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.938634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.938637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.938700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.938755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.938811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.938885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.938925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.938928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.938989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.939045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.939106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.939164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.939257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.939260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.939320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.939375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.939432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.939487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.939525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.939528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.939593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.939648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.939703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.939760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.939801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.939803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.939867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:21.939924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:21.939981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:21.940036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:21.940074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:21.940076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:21.940111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:21.940187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:21.940206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:21.940209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:21.940238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:21.940251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:21.940255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:21.940258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:21.940261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:21.940634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:21.940648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:21.940654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:21.940658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:21.940660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:21.940663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:21.941648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:21.941674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:21.941680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:21.941683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:21.941688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:21.941692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:21.942284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:21.942308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:21.942312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:21.942315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:21.942317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:21.944455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:21.944485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:21.944496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392921944
2025-10-02T08:15:21.944674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:21.944688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:21.944693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:21.944695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:21.944698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:21.944701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:21.945163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:21.945183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:21.945188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:21.945192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:21.945194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:21.945201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:21.945620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:21.945642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:21.945650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:21.945652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:21.945655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:21.945660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:21.946135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:21.946153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:21.946158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:21.947190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:21.947206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:21.947211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:21.947214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:21.947222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392921946
2025-10-02T08:15:21.947490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:21.947510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:21.947515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:21.947518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:21.947521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:21.947525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:21.947982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:21.948002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:21.948007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:21.948011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:21.948013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:21.948016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:21.948481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:21.948499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:21.948589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392921948
2025-10-02T08:15:21.952145Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:21.952186Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:21.952195Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:21.952208Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:21.953871Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:21.953887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:21.953889Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:21.953898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535057908208877:13732]
2025-10-02T08:15:21.953904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535057908208877:13732]
2025-10-02T08:15:21.953957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:21.953967Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:21.953971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:21.953973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:21.953973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:21.954103Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:21.990828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535057908208922:13279]
2025-10-02T08:15:21.990994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2353, pipe: [1:7556535057908208922:13279]
2025-10-02T08:15:22.103029Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:22.103412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535057908208922:13279], now have 1 active actors on pipe
2025-10-02T08:15:22.103582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535057908208922:13279]
2025-10-02T08:15:22.103613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:22.103615Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:22.103619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:22.103665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2354 reason: error at write: Disconnected sessionId: src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0
2025-10-02T08:15:22.103702Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:22.103837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2354 sessionId: src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0 is DEAD
2025-10-02T08:15:22.103970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:22.103979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0] Write session will restart in 0.006247s
2025-10-02T08:15:22.104001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0] Write session: Do CDS request
2025-10-02T08:15:22.104007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:22.111231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.111287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:22.111300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2355
2025-10-02T08:15:22.111462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.111499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:22.111510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:22.111513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:22.111989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2355 sessionId:  describe result for acl check
2025-10-02T08:15:22.112024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:22.112030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:22.112031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:22.112036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535062203176493:13740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:22.112523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535062203176493:13740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:22.114908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535062203176493:13740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:22.117862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:22.118256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535062203176493:13740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:22.118266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:22.118269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535062203176493:13740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:22.118272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535062203176493:13740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:22.118281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:22.118433Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:22.118455Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:22.118468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:22.118520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:22.118575Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535062203176644:13739]
2025-10-02T08:15:22.119209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:22.119405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:22.119458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:22.119908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:22.119963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.119969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.119971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.119972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.119973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.119979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.119989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.119992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.119996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.120000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.120005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.120011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.120016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.120021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.120025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.120030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.120039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.120044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.120049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.120057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.120076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:22.128330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:22.130090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:22.130110Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:22.130113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:22.130117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:22.130123Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2354 [1:7556535062203176644:13739]
2025-10-02T08:15:22.130136Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:22.130152Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:22.130156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.130159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.130161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.130177Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:22.130183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:22.130189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:22.130247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.130254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.130258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:22.130260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:22.130323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:22.130330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.130342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.130353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:22.130373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535062203176634:13739]
2025-10-02T08:15:22.130379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535062203176634:13739]
2025-10-02T08:15:22.130387Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:22.130400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:22.130414Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:22.130417Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:22.130420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:22.130424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:22.130429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2354
2025-10-02T08:15:22.130430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203176642:13740], now have 1 active actors on pipe
2025-10-02T08:15:22.130460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535062662628593:2378], now have 1 active actors on pipe
2025-10-02T08:15:22.130468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535062203176634:13739]
2025-10-02T08:15:22.130475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:22.130481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.130485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.130495Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:22.130526Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:22.130536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.130540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.130541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:22.130550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.130559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:22.130580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.130619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.130625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.130636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.130673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2355 partition: 0 MaxSeqNo: 17 sessionId: src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0
2025-10-02T08:15:22.130973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee838cd4-3ad2f5bd-93244d35-14fe6ecc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:22.132893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2354
2025-10-02T08:15:22.133624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0] Write session: try to update token
2025-10-02T08:15:22.133639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:22.146560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId: src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:22.148219Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:22.148235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:22.148237Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:22.148246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535062203176634:13739]
2025-10-02T08:15:22.148251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535062203176634:13739]
2025-10-02T08:15:22.148292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:22.148297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:22.148300Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:22.148303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.148305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:22.148447Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:22.149051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:22.203958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535062203176670:13279]
2025-10-02T08:15:22.204053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2354, pipe: [1:7556535062203176670:13279]
2025-10-02T08:15:22.285462Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:22.285794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.285808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.285844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203176670:13279], now have 1 active actors on pipe
2025-10-02T08:15:22.285961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535062203176670:13279]
2025-10-02T08:15:22.285995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:22.285998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:22.286039Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:22.286017Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:22.286053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2355 reason: error at write: Disconnected sessionId: src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0
2025-10-02T08:15:22.286215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2355 sessionId: src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0 is DEAD
2025-10-02T08:15:22.286322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:22.286329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0] Write session will restart in 0.008402s
2025-10-02T08:15:22.286355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0] Write session: Do CDS request
2025-10-02T08:15:22.286362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:22.296222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.296266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:22.296280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2356
2025-10-02T08:15:22.296404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.296433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:22.296441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:22.296444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:22.296828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2356 sessionId:  describe result for acl check
2025-10-02T08:15:22.296856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:22.296863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:22.296864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:22.296869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535062203177092:13758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:22.297124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:22.297425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535062203177092:13758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:22.298370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:22.298555Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:22.298564Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:22.298572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:22.298611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:22.298643Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535062203177113:13757]
2025-10-02T08:15:22.299200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:22.299282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535062203177092:13758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:22.299347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:22.299380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:22.299647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:22.299686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.299691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.299692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.299692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.299693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.299697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.299705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.299709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.299712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.299715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.299719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.299726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.299736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.299740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.299743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.299748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.299752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.299757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.299761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.299765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.299781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:22.304486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535062203177092:13758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:22.304500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535062203177092:13758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:22.304503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535062203177092:13758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:22.304511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:22.307398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:22.309209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:22.309226Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:22.309228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:22.309231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:22.309237Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2355 [1:7556535062203177113:13757]
2025-10-02T08:15:22.309247Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:22.309262Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:22.309270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.309273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.309275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.309291Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:22.309301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:22.309306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:22.309360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.309366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.309369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:22.309371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:22.309433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:22.309440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.309452Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.309466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:22.309485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2355
2025-10-02T08:15:22.309488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203177144:13758], now have 1 active actors on pipe
2025-10-02T08:15:22.309491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535062662628625:2378], now have 1 active actors on pipe
2025-10-02T08:15:22.309497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.309500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.309517Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535062203177095:13757]
2025-10-02T08:15:22.309523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535062203177095:13757]
2025-10-02T08:15:22.309535Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:22.309549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:22.309550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:22.309554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:22.309565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:22.309572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:22.309543Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2355
2025-10-02T08:15:22.309585Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:22.309594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.309602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.309603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:22.309611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.309623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:22.309656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535062203177095:13757]
2025-10-02T08:15:22.309668Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:22.309688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.309690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:22.309747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.309752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.309764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.309799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2356 partition: 0 MaxSeqNo: 17 sessionId: src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0
2025-10-02T08:15:22.310158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaaf235-57c71c3-9ebdf9b7-1cd95d75_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:22.312891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0] Write session: try to update token
2025-10-02T08:15:22.312905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:22.320683Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:22.320704Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:22.320712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535062203177095:13757]
2025-10-02T08:15:22.320753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:22.320754Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:22.320952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:22.321098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:22.321238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:22.321389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:22.321581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:22.321625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:22.326540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId: src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:22.329262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:22.329333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.329349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.329382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:22.329405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:22.329469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.329479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.329678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.329748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.329819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.329910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.330647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.330655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.330728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.330839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.330914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.330988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.331030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.331034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.331117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.331186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.331257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.331318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.331357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.331360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.331433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.331499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.331561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.331620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.331658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.331660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.331739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.331794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.331852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.331911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.331952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.331955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.332019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.332075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.332134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.332224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.332270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.332273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.332352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.332415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.332479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.332549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.332592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.332594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.332673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.332740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.332916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.332986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.333033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.333036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.333130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.333193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.333270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.333338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.333381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.333384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.333476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:22.333544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:22.333609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:22.333671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:22.333718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:22.333721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:22.333765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:22.333831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.333849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.333852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:22.333901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:22.333916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:22.333919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:22.333922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:22.333925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:22.334341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:22.334364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:22.334371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:22.334375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:22.334378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:22.334381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:22.334908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:22.334926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:22.334933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:22.334935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:22.334938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:22.334941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:22.335435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:22.335451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:22.335457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:22.335461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:22.335464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:22.336752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:22.336761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:22.336773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392922336
2025-10-02T08:15:22.336912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:22.336930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:22.336935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:22.336945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:22.336948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:22.336952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:22.337623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:22.337645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:22.337649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:22.337656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:22.337658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:22.337660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:22.338175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:22.338202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:22.338211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:22.338214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:22.338217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:22.338220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:22.338719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:22.338745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:22.338751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:22.339932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:22.339954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:22.339959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:22.339963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:22.339976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392922339
2025-10-02T08:15:22.340332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:22.340354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:22.340360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:22.340363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:22.340369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:22.340372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:22.340903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:22.340923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:22.340929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:22.340933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:22.340936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:22.340942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:22.341478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:22.341499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.341599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392922341
2025-10-02T08:15:22.342407Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:22.342431Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:22.342437Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:22.342448Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:22.344248Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:22.344264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:22.344265Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:22.344273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535062203177095:13757]
2025-10-02T08:15:22.344276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535062203177095:13757]
2025-10-02T08:15:22.344332Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:22.344336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:22.344339Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:22.344339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.344341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:22.344487Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:22.386258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535062203177172:13279]
2025-10-02T08:15:22.386362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2355, pipe: [1:7556535062203177172:13279]
2025-10-02T08:15:22.482943Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:22.483337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203177172:13279], now have 1 active actors on pipe
2025-10-02T08:15:22.483465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:22.483473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:22.483498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2356 reason: error at write: Disconnected sessionId: src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0
2025-10-02T08:15:22.483600Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:22.483588Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:22.483661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2356 sessionId: src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0 is DEAD
2025-10-02T08:15:22.483827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:22.483837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0] Write session will restart in 0.007327s
2025-10-02T08:15:22.483829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535062203177172:13279]
2025-10-02T08:15:22.483860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0] Write session: Do CDS request
2025-10-02T08:15:22.483866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:22.492248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.492259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:22.492272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2357
2025-10-02T08:15:22.492413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.492443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:22.492451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:22.492454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:22.492905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2357 sessionId:  describe result for acl check
2025-10-02T08:15:22.492940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:22.492946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:22.492947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:22.492952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535062203177544:13765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:22.493406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535062203177544:13765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:22.495057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535062203177544:13765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:22.496018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:22.496294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:22.496410Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:22.496417Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:22.496423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:22.496453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:22.496476Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535062203177651:13764]
2025-10-02T08:15:22.496963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:22.497123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:22.497164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:22.497430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:22.497464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.497468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.497471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.497471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.497472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.497475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.497481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.497483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.497485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.497487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.497490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.497494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.497498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.497500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.497503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.497506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.497508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.497511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.497515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.497517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.497527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:22.497577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535062203177544:13765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:22.497590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535062203177544:13765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:22.497593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535062203177544:13765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:22.497600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:22.505257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:22.506699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:22.506715Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:22.506717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:22.506720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:22.506726Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2356 [1:7556535062203177651:13764]
2025-10-02T08:15:22.506737Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:22.506751Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:22.506755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.506757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.506759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.506773Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:22.506778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:22.506784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:22.506843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.506852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.506855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:22.506857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:22.506908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:22.506913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.506923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.506929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:22.506943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203177667:13765], now have 1 active actors on pipe
2025-10-02T08:15:22.506952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535062203177645:13764]
2025-10-02T08:15:22.506953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535062203177645:13764]
2025-10-02T08:15:22.506958Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:22.506967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:22.506967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2356
2025-10-02T08:15:22.506969Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:22.506972Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:22.506979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:22.506981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:22.506985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535062662628633:2378], now have 1 active actors on pipe
2025-10-02T08:15:22.506988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.506991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.507020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535062203177645:13764]
2025-10-02T08:15:22.507028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:22.507038Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:22.507040Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:22.507044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.507046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.507048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:22.507053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.507059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:22.507050Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2356
2025-10-02T08:15:22.507085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.507139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.507144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.507153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.507179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2357 partition: 0 MaxSeqNo: 17 sessionId: src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0
2025-10-02T08:15:22.507433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1885eda-123f5d4-1befb9f7-5ed8cfc7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:22.509710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0] Write session: try to update token
2025-10-02T08:15:22.509725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:22.522526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId: src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:22.524400Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:22.524417Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:22.524419Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:22.524425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535062203177645:13764]
2025-10-02T08:15:22.524429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535062203177645:13764]
2025-10-02T08:15:22.524461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:22.524470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:22.524474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.524476Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:22.524478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:22.524608Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:22.525080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:22.583886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535062203177681:13279]
2025-10-02T08:15:22.584010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2356, pipe: [1:7556535062203177681:13279]
2025-10-02T08:15:22.659918Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:22.660204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.660222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.660260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203177681:13279], now have 1 active actors on pipe
2025-10-02T08:15:22.660329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535062203177681:13279]
2025-10-02T08:15:22.660415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:22.660423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:22.660479Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:22.660472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2357 reason: error at write: Disconnected sessionId: src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0
2025-10-02T08:15:22.660481Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:22.660630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2357 sessionId: src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0 is DEAD
2025-10-02T08:15:22.660786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:22.660796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0] Write session will restart in 0.006209s
2025-10-02T08:15:22.660836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0] Write session: Do CDS request
2025-10-02T08:15:22.660842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:22.668285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.668320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:22.668334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2358
2025-10-02T08:15:22.668468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.668497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:22.668506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:22.668509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:22.668884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2358 sessionId:  describe result for acl check
2025-10-02T08:15:22.668922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:22.668928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:22.668929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:22.668934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535062203177987:13771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:22.669408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535062203177987:13771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:22.671808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535062203177987:13771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:22.674085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:22.674664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:22.674786Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:22.674793Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:22.674801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:22.674850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:22.674862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535062203177987:13771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:22.674868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535062203177987:13771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:22.674871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535062203177987:13771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:22.674878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:22.674921Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535062203178156:13770]
2025-10-02T08:15:22.675443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:22.675583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:22.675617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:22.675810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:22.675844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.675849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.675860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.675864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.675864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.675868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.675874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.675876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.675878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.675882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.675886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.675892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.675902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.675907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.675911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.675920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.675923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.675926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.675929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.675935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.675946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:22.683532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:22.685097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:22.685118Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:22.685120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:22.685123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:22.685129Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2357 [1:7556535062203178156:13770]
2025-10-02T08:15:22.685141Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:22.685158Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:22.685161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.685163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.685165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.685179Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:22.685184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:22.685192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:22.685250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.685257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.685260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:22.685262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:22.685312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:22.685318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.685327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.685333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:22.685345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535062203178150:13770]
2025-10-02T08:15:22.685347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535062203178150:13770]
2025-10-02T08:15:22.685352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:22.685365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203178161:13771], now have 1 active actors on pipe
2025-10-02T08:15:22.685372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:22.685379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:22.685379Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:22.685381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:22.685383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:22.685385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535062662628640:2378], now have 1 active actors on pipe
2025-10-02T08:15:22.685387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2357
2025-10-02T08:15:22.685406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535062203178150:13770]
2025-10-02T08:15:22.685410Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:22.685413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:22.685416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.685419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.685447Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:22.685458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.685461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.685462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:22.685468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.685474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:22.685487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.685462Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2357
2025-10-02T08:15:22.685555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.685561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.685570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.685600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2358 partition: 0 MaxSeqNo: 17 sessionId: src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0
2025-10-02T08:15:22.685896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6870f545-f52f7a9d-405edbcc-411a33a6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:22.688367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0] Write session: try to update token
2025-10-02T08:15:22.688379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:22.701286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId: src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:22.703104Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:22.703125Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:22.703127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:22.703133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535062203178150:13770]
2025-10-02T08:15:22.703135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535062203178150:13770]
2025-10-02T08:15:22.703166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:22.703171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.703172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:22.703171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:22.703176Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:22.703290Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:22.703726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:22.760454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535062203178189:13279]
2025-10-02T08:15:22.760591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2357, pipe: [1:7556535062203178189:13279]
2025-10-02T08:15:22.838743Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:22.838942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.838955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.838991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203178189:13279], now have 1 active actors on pipe
2025-10-02T08:15:22.839176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:22.839178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:22.839179Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:22.839231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2358 reason: error at write: Disconnected sessionId: src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0
2025-10-02T08:15:22.839383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2358 sessionId: src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0 is DEAD
2025-10-02T08:15:22.839512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535062203178189:13279]
2025-10-02T08:15:22.839493Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:22.839904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:22.839911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0] Write session will restart in 0.006555s
2025-10-02T08:15:22.839936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0] Write session: Do CDS request
2025-10-02T08:15:22.839942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:22.847254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.847362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:22.847376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2359
2025-10-02T08:15:22.847485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:22.847512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:22.847521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:22.847524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:22.847892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2359 sessionId:  describe result for acl check
2025-10-02T08:15:22.847920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:22.847922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:22.847923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:22.847928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535062203178493:13778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:22.848383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535062203178493:13778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:22.851398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535062203178493:13778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:22.854432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535062203178493:13778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:22.854446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535062203178493:13778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:22.854449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535062203178493:13778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:22.854457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:22.855667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:22.856076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:22.856222Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:22.856231Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:22.856240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:22.856280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:22.856306Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535062203178686:13777]
2025-10-02T08:15:22.856864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:22.857047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:22.857115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:22.857421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:22.857466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.857472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.857473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.857474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.857475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.857480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.857491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.857495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.857499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.857504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.857509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.857520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:22.857526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.857535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:22.857539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.857545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:22.857553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.857557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.857562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.857571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.857590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:22.867840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:22.869291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:22.869308Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:22.869311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:22.869313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:22.869318Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2358 [1:7556535062203178686:13777]
2025-10-02T08:15:22.869327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:22.869343Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:22.869344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.869347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.869348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.869360Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:22.869363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:22.869368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:22.869422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.869427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.869429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:22.869431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:22.869575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2358
2025-10-02T08:15:22.869663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:22.869671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.869680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:22.869687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:22.869704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203178670:13778], now have 1 active actors on pipe
2025-10-02T08:15:22.869710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535062662628660:2378], now have 1 active actors on pipe
2025-10-02T08:15:22.869714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.869717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.869730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535062203178680:13777]
2025-10-02T08:15:22.869735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535062203178680:13777]
2025-10-02T08:15:22.869744Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:22.869757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:22.869769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:22.869771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:22.869775Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:22.869775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:22.869790Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|599564b6-1094020f-678d8d53-39af65c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:22.869799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:22.869802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:22.869803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:22.869809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:22.869816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:22.869846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535062203178680:13777]
2025-10-02T08:15:22.869856Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:22.869865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.869866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:22.869931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:22.869937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:22.869948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:22.869976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2359 partition: 0 MaxSeqNo: 17 sessionId: src_id|599564b6-1094020f-678d8d53-39af65c7_0
2025-10-02T08:15:22.870157Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2358
2025-10-02T08:15:22.872451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b481ec6-62e062de-5f09f0c4-504f136c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|599564b6-1094020f-678d8d53-39af65c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:22.874990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|599564b6-1094020f-678d8d53-39af65c7_0] Write session: try to update token
2025-10-02T08:15:22.875006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|599564b6-1094020f-678d8d53-39af65c7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:22.886436Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:22.886456Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:22.886457Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:22.886464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535062203178680:13777]
2025-10-02T08:15:22.886469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535062203178680:13777]
2025-10-02T08:15:22.886506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:22.886513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:22.886520Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:22.886522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:22.886524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:22.886658Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:22.888678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId: src_id|599564b6-1094020f-678d8d53-39af65c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:22.891180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:22.939725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535062203178711:13279]
2025-10-02T08:15:22.939874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2358, pipe: [1:7556535062203178711:13279]
2025-10-02T08:15:23.027586Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:23.027887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.027899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.027931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535062203178711:13279], now have 1 active actors on pipe
2025-10-02T08:15:23.028082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535062203178711:13279]
2025-10-02T08:15:23.028102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:23.028104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:23.028158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2359 reason: error at write: Disconnected sessionId: src_id|599564b6-1094020f-678d8d53-39af65c7_0
2025-10-02T08:15:23.028189Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:23.028261Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:23.028331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2359 sessionId: src_id|599564b6-1094020f-678d8d53-39af65c7_0 is DEAD
2025-10-02T08:15:23.028491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599564b6-1094020f-678d8d53-39af65c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:23.028498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599564b6-1094020f-678d8d53-39af65c7_0] Write session will restart in 0.007506s
2025-10-02T08:15:23.028522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599564b6-1094020f-678d8d53-39af65c7_0] Write session: Do CDS request
2025-10-02T08:15:23.028528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599564b6-1094020f-678d8d53-39af65c7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:23.037285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|599564b6-1094020f-678d8d53-39af65c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.037347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:23.037361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2360
2025-10-02T08:15:23.037491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.037536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:23.037546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:23.037550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:23.037962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2360 sessionId:  describe result for acl check
2025-10-02T08:15:23.037995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:23.038001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:23.038003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:23.038008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535066498146372:13784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:23.038600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535066498146372:13784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:23.042082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535066498146372:13784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:23.042211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:23.042713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:23.042899Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:23.042910Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:23.042920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:23.042976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:23.043014Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535066498146486:13783]
2025-10-02T08:15:23.043621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:23.043825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:23.043875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:23.044208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:23.044249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.044250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.044251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.044252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.044253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.044258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.044268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.044272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.044276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.044280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.044286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.044294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.044300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.044305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.044310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.044315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.044319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.044324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.044330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.044335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.044355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:23.044870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535066498146372:13784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:23.044882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535066498146372:13784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:23.044885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535066498146372:13784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:23.044892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:23.053284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:23.055095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:23.055114Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:23.055117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:23.055120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:23.055127Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2359 [1:7556535066498146486:13783]
2025-10-02T08:15:23.055139Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:23.055158Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:23.055170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.055173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.055175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.055191Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:23.055198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:23.055212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:23.055271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.055278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.055281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:23.055284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:23.055351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:23.055358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.055372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.055386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:23.055400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535066498146470:13783]
2025-10-02T08:15:23.055407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535066498146470:13783]
2025-10-02T08:15:23.055420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:23.055436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:23.055454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:23.055461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:23.055492Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535066498146470:13783]
2025-10-02T08:15:23.055498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:23.055507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498146503:13784], now have 1 active actors on pipe
2025-10-02T08:15:23.055508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2359
2025-10-02T08:15:23.055532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535066957595963:2378], now have 1 active actors on pipe
2025-10-02T08:15:23.055537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.055541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.055566Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cda826c-c4737437-a610b719-9f23f010_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:23.055577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.055581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.055588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:23.055598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.055610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:23.055628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.055735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2359
2025-10-02T08:15:23.055698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.055700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:23.055703Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:23.055705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.055709Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:23.055717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.055749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2360 partition: 0 MaxSeqNo: 17 sessionId: src_id|3cda826c-c4737437-a610b719-9f23f010_0
2025-10-02T08:15:23.056121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599564b6-1094020f-678d8d53-39af65c7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3cda826c-c4737437-a610b719-9f23f010_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:23.058772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cda826c-c4737437-a610b719-9f23f010_0] Write session: try to update token
2025-10-02T08:15:23.058790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cda826c-c4737437-a610b719-9f23f010_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:23.073728Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:23.073764Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:23.073767Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:23.073782Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535066498146470:13783]
2025-10-02T08:15:23.073790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535066498146470:13783]
2025-10-02T08:15:23.073855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:23.073866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.073869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:23.074123Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:23.074765Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:23.074779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:23.076037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId: src_id|3cda826c-c4737437-a610b719-9f23f010_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:23.078566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:23.129961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535066498146519:13279]
2025-10-02T08:15:23.130240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2359, pipe: [1:7556535066498146519:13279]
2025-10-02T08:15:23.236565Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:23.237573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.237594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.237643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498146519:13279], now have 1 active actors on pipe
2025-10-02T08:15:23.237762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535066498146519:13279]
2025-10-02T08:15:23.237776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:23.237778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:23.237843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2360 reason: error at write: Disconnected sessionId: src_id|3cda826c-c4737437-a610b719-9f23f010_0
2025-10-02T08:15:23.237857Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:23.237929Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:23.238042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2360 sessionId: src_id|3cda826c-c4737437-a610b719-9f23f010_0 is DEAD
2025-10-02T08:15:23.239060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cda826c-c4737437-a610b719-9f23f010_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:23.239070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cda826c-c4737437-a610b719-9f23f010_0] Write session will restart in 0.007364s
2025-10-02T08:15:23.239096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cda826c-c4737437-a610b719-9f23f010_0] Write session: Do CDS request
2025-10-02T08:15:23.239102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cda826c-c4737437-a610b719-9f23f010_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:23.247344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cda826c-c4737437-a610b719-9f23f010_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.247318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:23.247332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2361
2025-10-02T08:15:23.247548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.247585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:23.247592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:23.247595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:23.247953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2361 sessionId:  describe result for acl check
2025-10-02T08:15:23.247985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:23.247987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:23.247988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:23.247993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535066498146823:13797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:23.248477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535066498146823:13797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:23.250507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535066498146823:13797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:23.253959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535066498146823:13797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:23.253974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535066498146823:13797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:23.253976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535066498146823:13797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:23.253983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:23.259091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:23.259883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:23.260031Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:23.260041Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:23.260050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:23.260169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:23.260208Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535066498147018:13792]
2025-10-02T08:15:23.260857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:23.261050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:23.261090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:23.261379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:23.261423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.261429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.261430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.261431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.261432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.261437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.261447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.261451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.261455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.261459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.261464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.261471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.261477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.261483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.261487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.261492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.261497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.261503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.261512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.261517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.261534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:23.269601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:23.271297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:23.271315Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:23.271317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:23.271320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:23.271326Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2360 [1:7556535066498147018:13792]
2025-10-02T08:15:23.271337Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:23.271353Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:23.271360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.271363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.271365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.271380Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:23.271391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:23.271397Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:23.271462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.271470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.271474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:23.271477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:23.271543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:23.271549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.271562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.271580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:23.271600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498146874:13797], now have 1 active actors on pipe
2025-10-02T08:15:23.271608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535066957595972:2378], now have 1 active actors on pipe
2025-10-02T08:15:23.271614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535066498147012:13792]
2025-10-02T08:15:23.271616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535066498147012:13792]
2025-10-02T08:15:23.271628Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:23.271637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:23.271639Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:23.271643Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:23.271658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:23.271665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:23.271666Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2360
2025-10-02T08:15:23.271695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535066498147012:13792]
2025-10-02T08:15:23.271707Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:23.271712Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:23.271805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2360
2025-10-02T08:15:23.271815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.271819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.271840Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77807190-2d82d29-274dc440-33b9f590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:23.271851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.271855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.271858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:23.271867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.271879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:23.271897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.271921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.271927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.271939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.271970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2361 partition: 0 MaxSeqNo: 17 sessionId: src_id|77807190-2d82d29-274dc440-33b9f590_0
2025-10-02T08:15:23.272291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cda826c-c4737437-a610b719-9f23f010_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|77807190-2d82d29-274dc440-33b9f590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:23.274921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77807190-2d82d29-274dc440-33b9f590_0] Write session: try to update token
2025-10-02T08:15:23.274938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77807190-2d82d29-274dc440-33b9f590_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:23.295595Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:23.295827Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:23.295840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535066498147012:13792]
2025-10-02T08:15:23.295885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:23.295895Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:23.296074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:23.296253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:23.296403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:23.296552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:23.296760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:23.296793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:23.298630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId: src_id|77807190-2d82d29-274dc440-33b9f590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:23.301972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:23.302050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.302069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.302109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:23.302134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:23.302202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.302214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.302397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.302460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.302523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.302594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.302639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.302649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.302720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.302784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.302851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.302917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.302963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.302970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.303040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.303102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.303156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.303214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.303325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.303328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.303392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.303888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.303955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.304024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.304068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.304076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.304143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.304223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.304287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.304351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.304396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.304404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.304473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.304535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.304600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.304667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.304721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.304731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.304820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.304887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.304956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.305023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.305070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.305077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.305148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.305211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.305275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.305340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.305387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.305395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.305461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.305523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.305585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.305649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.305694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.305701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.305770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:23.305835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:23.305895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:23.305955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:23.305999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:23.306010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:23.306046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:23.306104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.306129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.306136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:23.306168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:23.306184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:23.306190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:23.306193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:23.306196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:23.306585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:23.306612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:23.306619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:23.306623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:23.306626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:23.306629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:23.307125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:23.307149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:23.307156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:23.307159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:23.307164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:23.307167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:23.307844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:23.307869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:23.307875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:23.307878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:23.307882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:23.310274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:23.310295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:23.310307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392923309
2025-10-02T08:15:23.310426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:23.310444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:23.310450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:23.310453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:23.310457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:23.310465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:23.311073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:23.311098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:23.311103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:23.311113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:23.311116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:23.311120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:23.311628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:23.311651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:23.311657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:23.311665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:23.311670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:23.311673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:23.312134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:23.312170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:23.312176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:23.313274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:23.313294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:23.313299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:23.313305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:23.313315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392923313
2025-10-02T08:15:23.313631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:23.313653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:23.313659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:23.313663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:23.313666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:23.313670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:23.314119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:23.314142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:23.314147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:23.314151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:23.314155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:23.314158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:23.314625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:23.314645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.314745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392923314
2025-10-02T08:15:23.315426Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:23.315445Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:23.315452Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:23.315464Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:23.321580Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:23.321596Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:23.321598Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:23.321607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535066498147012:13792]
2025-10-02T08:15:23.321611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535066498147012:13792]
2025-10-02T08:15:23.321634Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:23.321639Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:23.321649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:23.321655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.321657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:23.321784Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:23.338139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535066498147074:13279]
2025-10-02T08:15:23.340797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2360, pipe: [1:7556535066498147074:13279]
2025-10-02T08:15:23.466872Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:23.467189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498147074:13279], now have 1 active actors on pipe
2025-10-02T08:15:23.467470Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:23.467295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:23.467299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:23.467319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2361 reason: error at write: Disconnected sessionId: src_id|77807190-2d82d29-274dc440-33b9f590_0
2025-10-02T08:15:23.467428Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:23.467445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2361 sessionId: src_id|77807190-2d82d29-274dc440-33b9f590_0 is DEAD
2025-10-02T08:15:23.467545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535066498147074:13279]
2025-10-02T08:15:23.467720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77807190-2d82d29-274dc440-33b9f590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:23.467725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77807190-2d82d29-274dc440-33b9f590_0] Write session will restart in 0.009922s
2025-10-02T08:15:23.467741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77807190-2d82d29-274dc440-33b9f590_0] Write session: Do CDS request
2025-10-02T08:15:23.467746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77807190-2d82d29-274dc440-33b9f590_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:23.478733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77807190-2d82d29-274dc440-33b9f590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.478682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:23.478911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:23.478921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2362
2025-10-02T08:15:23.479059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.479087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:23.479091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:23.479094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:23.479248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:23.479410Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:23.479413Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:23.479422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:23.479470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:23.479499Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535066498147530:13809]
2025-10-02T08:15:23.480041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:23.480336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2362 sessionId:  describe result for acl check
2025-10-02T08:15:23.480356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:23.480358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:23.480359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:23.480363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535066498147538:13811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:23.480400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:23.480432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:23.480691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:23.480741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.480742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.480743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.480744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.480745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.480749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.480756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.480760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.480763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.480766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.480771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.480777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.480781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.480786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.480790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.480795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.480798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.480817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.480821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.480825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.480841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:23.481000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535066498147538:13811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:23.484278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535066498147538:13811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:23.490649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535066498147538:13811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:23.490677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535066498147538:13811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:23.490681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535066498147538:13811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:23.490690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:23.492181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:23.493759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:23.493773Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:23.493774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:23.493777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:23.493782Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2361 [1:7556535066498147530:13809]
2025-10-02T08:15:23.493790Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:23.493803Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:23.493804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.493806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.493807Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.493818Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:23.493822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:23.493827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:23.493871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.493876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.493879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:23.493881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:23.493931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:23.493935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.493944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.493950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:23.493966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535066498147523:13809]
2025-10-02T08:15:23.493970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535066498147523:13809]
2025-10-02T08:15:23.493976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:23.493984Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:23.493995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:23.493997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:23.494020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2361
2025-10-02T08:15:23.494022Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:23.494024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:23.494025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498147576:13811], now have 1 active actors on pipe
2025-10-02T08:15:23.494027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535066498147523:13809]
2025-10-02T08:15:23.494029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:23.494039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535066957596002:2378], now have 1 active actors on pipe
2025-10-02T08:15:23.494046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.494048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.494068Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:23.494077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.494079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.494080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:23.494087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.494093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:23.494103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.494159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:23.494230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.494239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.494255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.494241Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2361
2025-10-02T08:15:23.494292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2362 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0
2025-10-02T08:15:23.494556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77807190-2d82d29-274dc440-33b9f590_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:23.497124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0] Write session: try to update token
2025-10-02T08:15:23.497141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:23.510072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId: src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:23.511615Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:23.511636Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:23.511639Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:23.511646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535066498147523:13809]
2025-10-02T08:15:23.511650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535066498147523:13809]
2025-10-02T08:15:23.511691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:23.511700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:23.511702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.511705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:23.511706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:23.511857Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:23.512645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:23.568056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535066498147590:13279]
2025-10-02T08:15:23.568265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2361, pipe: [1:7556535066498147590:13279]
2025-10-02T08:15:23.660205Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:23.660567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.660576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.660617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498147590:13279], now have 1 active actors on pipe
2025-10-02T08:15:23.660739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:23.660743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:23.660797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2362 reason: error at write: Disconnected sessionId: src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0
2025-10-02T08:15:23.660861Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:23.660956Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:23.661139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:23.661149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0] Write session will restart in 0.006107s
2025-10-02T08:15:23.661174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0] Write session: Do CDS request
2025-10-02T08:15:23.661181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:23.660967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2362 sessionId: src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0 is DEAD
2025-10-02T08:15:23.661108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535066498147590:13279]
2025-10-02T08:15:23.668448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.669151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:23.669163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2363
2025-10-02T08:15:23.669390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.669427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:23.669433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:23.669437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:23.670150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2363 sessionId:  describe result for acl check
2025-10-02T08:15:23.670184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:23.670185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:23.670187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:23.670192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535066498147856:13816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:23.670684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535066498147856:13816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:23.674195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535066498147856:13816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:23.678122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535066498147856:13816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:23.678145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535066498147856:13816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:23.678149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535066498147856:13816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:23.678157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:23.679863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:23.680409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:23.680673Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:23.680685Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:23.680696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:23.680751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:23.680791Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535066498148082:13815]
2025-10-02T08:15:23.681427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:23.681633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:23.681675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:23.681974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:23.682032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.682038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.682039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.682040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.682041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.682046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.682055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.682058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.682061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.682064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.682069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.682075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.682081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.682085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.682102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.682111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.682115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.682120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.682124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.682129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.682144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:23.689998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:23.691616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:23.691632Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:23.691634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:23.691637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:23.691646Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2362 [1:7556535066498148082:13815]
2025-10-02T08:15:23.691656Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:23.691672Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:23.691675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.691677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.691680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.691696Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:23.691700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:23.691705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:23.692168Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2362
2025-10-02T08:15:23.691763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.691773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.691776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:23.691778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:23.691841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:23.691843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.691856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.691869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:23.691884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535066498148076:13815]
2025-10-02T08:15:23.691887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535066498148076:13815]
2025-10-02T08:15:23.691893Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:23.691904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:23.691908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2362
2025-10-02T08:15:23.691917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:23.691919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:23.691923Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:23.691926Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:23.691929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498148061:13816], now have 1 active actors on pipe
2025-10-02T08:15:23.691956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535066498148076:13815]
2025-10-02T08:15:23.691959Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:23.691964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535066957596008:2378], now have 1 active actors on pipe
2025-10-02T08:15:23.691968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.691972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.692007Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:23.692012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.692016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.692019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:23.692027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.692034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:23.692048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.692062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:23.692546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.692556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.692581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.692619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2363 partition: 0 MaxSeqNo: 17 sessionId: src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0
2025-10-02T08:15:23.692947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc46f979-97c9879e-edd34a15-a87d2f99_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:23.695495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0] Write session: try to update token
2025-10-02T08:15:23.695513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:23.709361Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:23.709383Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:23.709386Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:23.709394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535066498148076:13815]
2025-10-02T08:15:23.709399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535066498148076:13815]
2025-10-02T08:15:23.709442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:23.709447Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:23.709453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:23.709455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.709457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:23.709600Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:23.721587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId: src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:23.723929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:23.760971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535066498148109:13279]
2025-10-02T08:15:23.761166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2362, pipe: [1:7556535066498148109:13279]
2025-10-02T08:15:23.844726Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:23.845072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.845085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.845105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498148109:13279], now have 1 active actors on pipe
2025-10-02T08:15:23.845218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535066498148109:13279]
2025-10-02T08:15:23.845240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:23.845242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:23.845290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2363 reason: error at write: Disconnected sessionId: src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0
2025-10-02T08:15:23.845330Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:23.845381Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:23.845453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2363 sessionId: src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0 is DEAD
2025-10-02T08:15:23.845822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:23.845832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0] Write session will restart in 0.005994s
2025-10-02T08:15:23.845856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0] Write session: Do CDS request
2025-10-02T08:15:23.845862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:23.853230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.853540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:23.853567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2364
2025-10-02T08:15:23.853740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:23.853785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:23.853799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:23.853811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:23.854329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2364 sessionId:  describe result for acl check
2025-10-02T08:15:23.854369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:23.854375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:23.854377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:23.854382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535066498148445:13823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:23.854889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535066498148445:13823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:23.860786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535066498148445:13823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:23.861165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:23.861969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:23.862128Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:23.862140Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:23.862149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:23.862190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:23.862223Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535066498148611:13822]
2025-10-02T08:15:23.862812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:23.863026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:23.863061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:23.863461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:23.863486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535066498148445:13823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:23.863499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535066498148445:13823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:23.863502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535066498148445:13823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:23.863510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:23.863515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.863516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.863517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.863517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.863518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.863522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.863530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.863534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.863537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.863540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.863544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.863551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:23.863556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.863560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:23.863569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.863573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:23.863577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.863581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.863585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.863595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.863611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:23.872034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:23.873589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:23.873608Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:23.873610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:23.873614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:23.873622Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2363 [1:7556535066498148611:13822]
2025-10-02T08:15:23.873637Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:23.873655Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:23.873663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.873666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.873668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.873685Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:23.873689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:23.873698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:23.873762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.873770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.873773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:23.873776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:23.873845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:23.873855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.873869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:23.873882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:23.873899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535066498148597:13822]
2025-10-02T08:15:23.873901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535066498148597:13822]
2025-10-02T08:15:23.873918Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:23.873936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:23.873955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:23.873964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:23.873995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535066498148597:13822]
2025-10-02T08:15:23.874003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:23.874124Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:23.874131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:23.874136Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:23.874239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2363
2025-10-02T08:15:23.874244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498148623:13823], now have 1 active actors on pipe
2025-10-02T08:15:23.874289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.874299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.874329Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|649cff13-805c5711-58ccd317-6e1b71dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:23.874341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:23.874350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:23.874352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:23.874364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:23.874374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:23.874389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.874436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535066957596028:2378], now have 1 active actors on pipe
2025-10-02T08:15:23.874451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:23.874459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:23.874473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:23.874509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2364 partition: 0 MaxSeqNo: 17 sessionId: src_id|649cff13-805c5711-58ccd317-6e1b71dc_0
2025-10-02T08:15:23.874787Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2363
2025-10-02T08:15:23.874845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fe2c168-fff2593-bd6110b3-64aa4eda_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|649cff13-805c5711-58ccd317-6e1b71dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:23.877327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649cff13-805c5711-58ccd317-6e1b71dc_0] Write session: try to update token
2025-10-02T08:15:23.877341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649cff13-805c5711-58ccd317-6e1b71dc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:23.893158Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:23.893181Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:23.893184Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:23.893192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535066498148597:13822]
2025-10-02T08:15:23.893197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535066498148597:13822]
2025-10-02T08:15:23.893240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:23.893246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:23.893248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:23.893248Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:23.893255Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:23.893386Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:23.907633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId: src_id|649cff13-805c5711-58ccd317-6e1b71dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:23.910231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:23.945309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535066498148642:13279]
2025-10-02T08:15:23.945447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2363, pipe: [1:7556535066498148642:13279]
2025-10-02T08:15:24.034177Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:24.034721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.034735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.034753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535066498148642:13279], now have 1 active actors on pipe
2025-10-02T08:15:24.034898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535066498148642:13279]
2025-10-02T08:15:24.034935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:24.034942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:24.034946Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:24.035003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2364 reason: error at write: Disconnected sessionId: src_id|649cff13-805c5711-58ccd317-6e1b71dc_0
2025-10-02T08:15:24.035169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2364 sessionId: src_id|649cff13-805c5711-58ccd317-6e1b71dc_0 is DEAD
2025-10-02T08:15:24.035119Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:24.036953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649cff13-805c5711-58ccd317-6e1b71dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:24.036963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649cff13-805c5711-58ccd317-6e1b71dc_0] Write session will restart in 0.007504s
2025-10-02T08:15:24.036986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649cff13-805c5711-58ccd317-6e1b71dc_0] Write session: Do CDS request
2025-10-02T08:15:24.036991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649cff13-805c5711-58ccd317-6e1b71dc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:24.045828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649cff13-805c5711-58ccd317-6e1b71dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.049006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:24.049021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2365
2025-10-02T08:15:24.049234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.049273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:24.049282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:24.049286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:24.049734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2365 sessionId:  describe result for acl check
2025-10-02T08:15:24.049774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:24.049776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:24.049777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:24.049782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535070793116268:13829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:24.050296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535070793116268:13829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:24.052689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535070793116268:13829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:24.055582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:24.056139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535070793116268:13829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:24.056159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535070793116268:13829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:24.056162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535070793116268:13829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:24.056171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:24.057812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:24.057995Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:24.058006Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:24.058016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:24.058086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:24.058129Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535070793116434:13828]
2025-10-02T08:15:24.058699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:24.058881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:24.058916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:24.059152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:24.059191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.059196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.059197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.059198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.059200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.059204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.059214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.059218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.059222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.059225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.059230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.059237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.059243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.059248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.059258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.059263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.059267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.059270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.059272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.059276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.059288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:24.067026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:24.069013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:24.069034Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:24.069036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:24.069040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:24.069050Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2364 [1:7556535070793116434:13828]
2025-10-02T08:15:24.069062Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:24.069077Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:24.069079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.069082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.069084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.069099Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:24.069108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:24.069118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:24.069174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.069180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.069183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:24.069185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:24.069244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:24.069250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.069264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.069282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:24.069300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793116430:13829], now have 1 active actors on pipe
2025-10-02T08:15:24.069311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535070793116422:13828]
2025-10-02T08:15:24.069311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2364
2025-10-02T08:15:24.069315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535070793116422:13828]
2025-10-02T08:15:24.069322Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:24.069334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535071252563330:2378], now have 1 active actors on pipe
2025-10-02T08:15:24.069333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:24.069336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:24.069346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:24.069358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:24.069364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:24.069371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.069378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.069419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535070793116422:13828]
2025-10-02T08:15:24.069426Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:24.069436Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:24.069441Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:24.069447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.069452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.069454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:24.069463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.069477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:24.069450Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2364
2025-10-02T08:15:24.069515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.069592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.069600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.069614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.069648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2365 partition: 0 MaxSeqNo: 17 sessionId: src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0
2025-10-02T08:15:24.070213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649cff13-805c5711-58ccd317-6e1b71dc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:24.072858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0] Write session: try to update token
2025-10-02T08:15:24.072871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:24.086331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId: src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:24.089178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:24.089255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.089265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.089300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:24.089320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:24.089362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.089372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.089539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.089606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.089672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.089753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.090065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.090076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.090143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.090204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.090266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.090333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.090378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.090385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.090460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.090521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.090585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.090646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.090688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.090699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.090765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.090833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.090897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.090965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.091012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.091019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.091090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.091152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.091219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.091283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.091327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.091335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.091406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.091472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.091538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.091602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.091649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.091656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.091806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.091870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.091941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.092005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.092051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.092058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.092123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.092194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.092258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.092320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.092367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.092374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.092441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.092505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.092569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.092639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.092685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.092692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.092762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.092846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.092912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.092976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.093027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.093030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.093090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:24.093150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.093176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.093183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:24.093216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:24.093232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:24.093240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:24.093243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:24.093247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:24.093645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:24.093672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:24.093684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:24.093687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:24.093695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:24.093699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:24.094288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:24.094312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:24.094318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:24.094321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:24.094324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:24.094327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:24.094850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:24.094874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:24.094880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:24.094883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:24.094889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:24.096081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:24.096102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:24.096116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392924095
2025-10-02T08:15:24.096252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:24.096265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:24.096268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:24.096273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:24.096279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:24.096281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:24.096689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:24.096711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:24.096721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:24.096724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:24.096727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:24.096733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:24.097178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:24.097197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:24.097202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:24.097205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:24.097207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:24.097210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:24.097610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:24.097627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:24.097631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:24.098585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:24.098597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:24.098601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:24.098603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:24.098609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392924098
2025-10-02T08:15:24.098881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:24.098895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:24.098900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:24.098902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:24.098905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:24.098907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:24.099305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:24.099321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:24.099324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:24.099328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:24.099329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:24.099332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:24.099737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:24.099750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.099824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392924099
2025-10-02T08:15:24.101959Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:24.101979Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:24.101984Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:24.101988Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:24.102008Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:24.102010Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:24.102011Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:24.102017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535070793116422:13828]
2025-10-02T08:15:24.102022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535070793116422:13828]
2025-10-02T08:15:24.102061Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:24.102065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:24.107463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:24.107481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.107482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:24.107617Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:24.135256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535070793116463:13279]
2025-10-02T08:15:24.135376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2364, pipe: [1:7556535070793116463:13279]
2025-10-02T08:15:24.243978Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:24.244397Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:24.244407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:24.244417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535070793116422:13828]
2025-10-02T08:15:24.244459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793116463:13279], now have 1 active actors on pipe
2025-10-02T08:15:24.244466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:24.244586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:24.244595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:24.244623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2365 reason: error at write: Disconnected sessionId: src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0
2025-10-02T08:15:24.244660Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:24.244711Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:24.244938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:24.244951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0] Write session will restart in 0.009251s
2025-10-02T08:15:24.244974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0] Write session: Do CDS request
2025-10-02T08:15:24.244983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:24.244839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2365 sessionId: src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0 is DEAD
2025-10-02T08:15:24.245046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535070793116463:13279]
2025-10-02T08:15:24.251499Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [0c31fb770fa55f0c] Result# TEvPutResult {Id# [72075186224037892:2364:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:15:24.251509Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2364:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:24.251564Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2364:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:24.255297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.255356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:24.255371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2366
2025-10-02T08:15:24.255490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.255520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:24.255541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:24.255544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:24.255900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2366 sessionId:  describe result for acl check
2025-10-02T08:15:24.255929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:24.255935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:24.255937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:24.255941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535070793116679:13836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:24.256430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535070793116679:13836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:24.258862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535070793116679:13836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:24.262104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535070793116679:13836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:24.262132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535070793116679:13836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:24.262135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535070793116679:13836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:24.262142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:24.263898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:24.264627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:24.264785Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:24.264795Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:24.264819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:24.264862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:24.264899Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535070793116963:13835]
2025-10-02T08:15:24.265544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:24.265742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:24.265785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:24.266078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:24.266121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.266126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.266127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.266128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.266129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.266133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.266143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.266146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.266150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.266154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.266159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.266166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.266175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.266179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.266188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.266193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.266200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.266205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.266213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.266218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.266239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:24.274080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:24.275619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:24.275637Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:24.275639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:24.275642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:24.275648Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2365 [1:7556535070793116963:13835]
2025-10-02T08:15:24.275661Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:24.275677Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:24.275683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.275696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.275698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.275713Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:24.275719Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:24.275726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:24.275790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.275798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.275801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:24.275804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:24.275863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:24.275869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.275879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.275894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:24.275915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2365
2025-10-02T08:15:24.275917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793116942:13836], now have 1 active actors on pipe
2025-10-02T08:15:24.275921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535071252563339:2378], now have 1 active actors on pipe
2025-10-02T08:15:24.275926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535070793116957:13835]
2025-10-02T08:15:24.275929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535070793116957:13835]
2025-10-02T08:15:24.275938Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:24.275952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.275956Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:24.275959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:24.275960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.275976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:24.275988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:24.275990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:24.276024Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:24.276031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.276035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.276037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:24.276043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.276053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:24.276061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535070793116957:13835]
2025-10-02T08:15:24.276009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2365
2025-10-02T08:15:24.276066Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:24.276082Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:24.276098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.276205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.276220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.276255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.276296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2366 partition: 0 MaxSeqNo: 17 sessionId: src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0
2025-10-02T08:15:24.276590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5413f3-9edf606f-9bf1129f-6f0f9dc3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:24.279038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0] Write session: try to update token
2025-10-02T08:15:24.279053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:24.294044Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:24.294066Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:24.294068Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:24.294076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535070793116957:13835]
2025-10-02T08:15:24.294081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535070793116957:13835]
2025-10-02T08:15:24.294124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:24.294135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.294134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:24.294138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:24.294140Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:24.294274Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:24.295286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId: src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:24.298014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:24.361660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535070793117004:13279]
2025-10-02T08:15:24.364222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2365, pipe: [1:7556535070793117004:13279]
2025-10-02T08:15:24.428547Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:24.428862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.428873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.428905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793117004:13279], now have 1 active actors on pipe
2025-10-02T08:15:24.429126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:24.429139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:24.429244Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:24.429214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2366 reason: error at write: Disconnected sessionId: src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0
2025-10-02T08:15:24.429239Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:24.429369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2366 sessionId: src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0 is DEAD
2025-10-02T08:15:24.429493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:24.429503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0] Write session will restart in 0.005466s
2025-10-02T08:15:24.429527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0] Write session: Do CDS request
2025-10-02T08:15:24.429533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:24.429504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535070793117004:13279]
2025-10-02T08:15:24.436164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.436239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:24.436253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2367
2025-10-02T08:15:24.436348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.436370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:24.436376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:24.436379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:24.436759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2367 sessionId:  describe result for acl check
2025-10-02T08:15:24.436790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:24.436795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:24.436797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:24.436817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535070793117330:13858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:24.437347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535070793117330:13858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:24.439629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535070793117330:13858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:24.442330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535070793117330:13858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:24.442346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535070793117330:13858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:24.442348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535070793117330:13858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:24.442355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:24.442489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:24.442989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:24.443144Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:24.443153Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:24.443161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:24.443207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:24.443239Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535070793117529:13857]
2025-10-02T08:15:24.443846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:24.444028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:24.444063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:24.444357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:24.444398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.444403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.444404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.444406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.444407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.444411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.444420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.444424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.444428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.444432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.444437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.444444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.444450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.444455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.444459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.444464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.444468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.444473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.444478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.444484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.444503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:24.452332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:24.453922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:24.453940Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:24.453943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:24.453947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:24.453954Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2366 [1:7556535070793117529:13857]
2025-10-02T08:15:24.453965Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:24.453981Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:24.453984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.453987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.453993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.454009Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:24.454014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:24.454026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:24.454083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.454091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.454094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:24.454097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:24.454157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:24.454164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.454177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.454193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:24.454209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535070793117517:13857]
2025-10-02T08:15:24.454217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535070793117517:13857]
2025-10-02T08:15:24.454224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:24.454233Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:24.454237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:24.454236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2366
2025-10-02T08:15:24.454238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793117520:13858], now have 1 active actors on pipe
2025-10-02T08:15:24.454244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:24.454257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:24.454260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:24.454265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535071252563368:2378], now have 1 active actors on pipe
2025-10-02T08:15:24.454293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.454302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.454315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535070793117517:13857]
2025-10-02T08:15:24.454323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:24.454307Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2366
2025-10-02T08:15:24.454345Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d28c415c-693d10f5-2660f438-868d2e8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:24.454353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:24.454355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.454359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.454361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:24.454370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.454378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:24.454402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.454442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.454450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.454461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.454495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2367 partition: 0 MaxSeqNo: 17 sessionId: src_id|d28c415c-693d10f5-2660f438-868d2e8c_0
2025-10-02T08:15:24.454839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a1685e-3edffc78-b5523dc9-5ea3ee9b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d28c415c-693d10f5-2660f438-868d2e8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:24.457400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d28c415c-693d10f5-2660f438-868d2e8c_0] Write session: try to update token
2025-10-02T08:15:24.457415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d28c415c-693d10f5-2660f438-868d2e8c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:24.470515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId: src_id|d28c415c-693d10f5-2660f438-868d2e8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:24.471371Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:24.471386Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:24.471388Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:24.471395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535070793117517:13857]
2025-10-02T08:15:24.471399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535070793117517:13857]
2025-10-02T08:15:24.471438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:24.471447Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:24.471449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.471451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:24.471463Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:24.471583Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:24.472923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:24.529493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535070793117557:13279]
2025-10-02T08:15:24.529610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2366, pipe: [1:7556535070793117557:13279]
2025-10-02T08:15:24.604656Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:24.605199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.605215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.605255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793117557:13279], now have 1 active actors on pipe
2025-10-02T08:15:24.605362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:24.605372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:24.605424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2367 reason: error at write: Disconnected sessionId: src_id|d28c415c-693d10f5-2660f438-868d2e8c_0
2025-10-02T08:15:24.605489Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:24.605589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2367 sessionId: src_id|d28c415c-693d10f5-2660f438-868d2e8c_0 is DEAD
2025-10-02T08:15:24.605768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535070793117557:13279]
2025-10-02T08:15:24.606052Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:24.609041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28c415c-693d10f5-2660f438-868d2e8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:24.609052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28c415c-693d10f5-2660f438-868d2e8c_0] Write session will restart in 0.007822s
2025-10-02T08:15:24.609080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28c415c-693d10f5-2660f438-868d2e8c_0] Write session: Do CDS request
2025-10-02T08:15:24.609086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28c415c-693d10f5-2660f438-868d2e8c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:24.619262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d28c415c-693d10f5-2660f438-868d2e8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.619522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:24.619540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2368
2025-10-02T08:15:24.619679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.619708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:24.619717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:24.619722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:24.620115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2368 sessionId:  describe result for acl check
2025-10-02T08:15:24.620157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:24.620164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:24.620165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:24.620171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535070793118014:13867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:24.620636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535070793118014:13867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:24.620732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:24.621895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:24.622049Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:24.622058Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:24.622067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:24.622107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:24.622141Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535070793118046:13866]
2025-10-02T08:15:24.622510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535070793118014:13867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:24.622718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:24.622903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:24.622951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:24.623387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:24.623455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.623461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.623463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.623464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.623465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.623470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.623479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.623482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.623486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.623490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.623495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.623502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.623507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.623511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.623526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.623536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.623540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.623545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.623550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.623559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.623581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:24.629629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535070793118014:13867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:24.629645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535070793118014:13867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:24.629648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535070793118014:13867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:24.629657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:24.632077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:24.634294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:24.634312Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:24.634314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:24.634317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:24.634323Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2367 [1:7556535070793118046:13866]
2025-10-02T08:15:24.634335Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:24.634351Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:24.634354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.634357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.634359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.634373Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:24.634379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:24.634385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:24.634445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.634453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.634456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:24.634459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:24.634603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2367
2025-10-02T08:15:24.634693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:24.634702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.634672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2367
2025-10-02T08:15:24.634715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.634731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:24.634754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535071252563375:2378], now have 1 active actors on pipe
2025-10-02T08:15:24.634757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793118073:13867], now have 1 active actors on pipe
2025-10-02T08:15:24.634761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.634765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.634790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535070793118023:13866]
2025-10-02T08:15:24.634796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535070793118023:13866]
2025-10-02T08:15:24.634808Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:24.634824Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:24.634825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:24.634834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:24.634838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:24.634841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:24.634856Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:24.634866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.634870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.634875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:24.634885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.634897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:24.634934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535070793118023:13866]
2025-10-02T08:15:24.634945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:24.634955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:24.634958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.635008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.635014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.635027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.635063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2368 partition: 0 MaxSeqNo: 17 sessionId: src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0
2025-10-02T08:15:24.635383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d28c415c-693d10f5-2660f438-868d2e8c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:24.637980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0] Write session: try to update token
2025-10-02T08:15:24.637997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:24.645805Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:24.645822Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:24.645829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535070793118023:13866]
2025-10-02T08:15:24.645856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:24.645862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:24.646078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:24.646285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:24.646489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:24.646698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:24.647016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:24.647063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:24.651676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId: src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:24.654303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:24.654391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.654405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.654436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:24.654461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:24.654512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.654519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.654677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.654740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.654801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.654867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.654911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.654914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.654982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.655037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.655094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.655167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.655213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.655220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.655286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.655347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.655405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.655463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.655505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.655512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.655574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.655634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.655694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.655753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.655797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.655804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.655871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.655929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.655992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.656056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.656100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.656109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.656187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.656249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.656312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.656373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.656416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.656429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.656497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.656555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.656620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.656680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.656723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.656729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.656795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.656874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.656933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.656996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.657043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.657055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.657119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.657180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.657239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.657300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.657341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.657350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.657414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:24.657476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:24.657535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:24.657590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:24.657629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:24.657641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:24.657672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:24.657735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.657757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.657760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:24.657786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:24.657803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:24.657812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:24.657816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:24.657818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:24.658209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:24.658232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:24.658240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:24.658243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:24.658246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:24.658248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:24.658807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:24.658828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:24.658834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:24.658836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:24.658839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:24.658842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:24.659375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:24.659397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:24.659403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:24.659406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:24.659408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:24.660569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:24.660587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:24.660598Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392924660
2025-10-02T08:15:24.660707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:24.660725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:24.660732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:24.660740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:24.660744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:24.660747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:24.661271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:24.661295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:24.661300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:24.661303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:24.661306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:24.661312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:24.661840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:24.661862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:24.661868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:24.661871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:24.661874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:24.661877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:24.662346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:24.662366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:24.662371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:24.663477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:24.663494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:24.663499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:24.663502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:24.663509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392924663
2025-10-02T08:15:24.663832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:24.663852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:24.663857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:24.663860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:24.663863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:24.663866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:24.664355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:24.664375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:24.664383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:24.664386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:24.664389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:24.664392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:24.664871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:24.664892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.664984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392924664
2025-10-02T08:15:24.665714Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:24.665750Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:24.665762Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:24.665768Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:24.667322Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:24.667333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:24.667335Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:24.667345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535070793118023:13866]
2025-10-02T08:15:24.667348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535070793118023:13866]
2025-10-02T08:15:24.667399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:24.667408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.667411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:24.667437Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:24.667451Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:24.667532Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:24.706153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535070793118096:13279]
2025-10-02T08:15:24.706235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2367, pipe: [1:7556535070793118096:13279]
2025-10-02T08:15:24.806652Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:24.807032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793118096:13279], now have 1 active actors on pipe
2025-10-02T08:15:24.807921Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:24.807166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535070793118096:13279]
2025-10-02T08:15:24.807193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:24.807201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:24.807231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2368 reason: error at write: Disconnected sessionId: src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0
2025-10-02T08:15:24.807292Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:24.807389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2368 sessionId: src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0 is DEAD
2025-10-02T08:15:24.808885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:24.808898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0] Write session will restart in 0.005690s
2025-10-02T08:15:24.808921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0] Write session: Do CDS request
2025-10-02T08:15:24.808928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:24.815658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.815708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:24.815721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2369
2025-10-02T08:15:24.815840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:24.815863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:24.815870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:24.815874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:24.816245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2369 sessionId:  describe result for acl check
2025-10-02T08:15:24.816279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:24.816285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:24.816286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:24.816292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535070793118316:13873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:24.816875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535070793118316:13873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:24.820491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535070793118316:13873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:24.824245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535070793118316:13873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:24.824262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535070793118316:13873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:24.824265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535070793118316:13873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:24.824273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:24.825599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:24.825944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:24.826096Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:24.826106Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:24.826115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:24.826159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:24.826195Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535070793118614:13872]
2025-10-02T08:15:24.826810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:24.827003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:24.827062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:24.827368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:24.827416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.827426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.827427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.827428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.827429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.827433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.827441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.827444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.827448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.827451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.827456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.827463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:24.827468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.827472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:24.827478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.827482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:24.827487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.827492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.827496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.827501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.827518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:24.835200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:24.836747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:24.836763Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:24.836765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:24.836767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:24.836772Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2368 [1:7556535070793118614:13872]
2025-10-02T08:15:24.836779Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:24.836792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:24.836794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.836796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.836797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.836831Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:24.836835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:24.836843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:24.836892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.836898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.836900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:24.836902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:24.836951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:24.836956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.836963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:24.836970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:24.836985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535070793118608:13872]
2025-10-02T08:15:24.836991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535070793118608:13872]
2025-10-02T08:15:24.836995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:24.837008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793118600:13873], now have 1 active actors on pipe
2025-10-02T08:15:24.837012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:24.837012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:24.837015Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:24.837021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:24.837023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:24.837022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2368
2025-10-02T08:15:24.837027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535071252563397:2378], now have 1 active actors on pipe
2025-10-02T08:15:24.837051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.837057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.837068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535070793118608:13872]
2025-10-02T08:15:24.837078Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:24.837100Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:24.837107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:24.837109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:24.837110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:24.837117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:24.837123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:24.837129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:24.837145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.837130Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2368
2025-10-02T08:15:24.837353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:24.837359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:24.837373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:24.837404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2369 partition: 0 MaxSeqNo: 17 sessionId: src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0
2025-10-02T08:15:24.838062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37f261d-7ff83d6c-de5b86ed-4d50f6f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:24.840561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0] Write session: try to update token
2025-10-02T08:15:24.840577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:24.855071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId: src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:24.857741Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:24.857763Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:24.857766Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:24.857775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535070793118608:13872]
2025-10-02T08:15:24.857779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535070793118608:13872]
2025-10-02T08:15:24.857780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:24.857822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:24.857833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:24.857836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:24.857879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:24.857891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:24.857965Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:24.906756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535070793118639:13279]
2025-10-02T08:15:24.906899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2368, pipe: [1:7556535070793118639:13279]
2025-10-02T08:15:25.007063Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:25.007634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.007643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.007680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535070793118639:13279], now have 1 active actors on pipe
2025-10-02T08:15:25.008328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:25.008340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0] Write session will restart in 0.007557s
2025-10-02T08:15:25.008249Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:25.008363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0] Write session: Do CDS request
2025-10-02T08:15:25.008370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:25.007936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535070793118639:13279]
2025-10-02T08:15:25.007961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:25.007963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:25.008011Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:25.008030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2369 reason: error at write: Disconnected sessionId: src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0
2025-10-02T08:15:25.008207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2369 sessionId: src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0 is DEAD
2025-10-02T08:15:25.017482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.017585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:25.017602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2370
2025-10-02T08:15:25.017738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.017769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:25.017786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:25.017789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:25.018184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2370 sessionId:  describe result for acl check
2025-10-02T08:15:25.018225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:25.018238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:25.018245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:25.018251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535075088085963:13880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:25.018753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535075088085963:13880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:25.022513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535075088085963:13880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:25.030913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535075088085963:13880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:25.030931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535075088085963:13880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:25.030934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535075088085963:13880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:25.030943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:25.033033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:25.033441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:25.033615Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:25.033622Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:25.033629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:25.033664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:25.033857Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535075088086440:13879]
2025-10-02T08:15:25.034329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:25.034519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:25.034562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:25.034842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:25.034889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.034896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.034898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.034898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.034899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.034903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.034910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.034913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.034915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.034917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.034921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.034926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.034929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.034933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.034935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.034938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.034941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.034944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.034948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.034951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.034962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:25.042979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:25.044479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:25.044497Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:25.044500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:25.044503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:25.044510Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2369 [1:7556535075088086440:13879]
2025-10-02T08:15:25.044527Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:25.044544Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:25.044547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.044550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.044552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.044567Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:25.044578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:25.044584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:25.044645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.044654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.044657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:25.044660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:25.044721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:25.044730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.044742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.044754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:25.044774Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535075088086434:13879]
2025-10-02T08:15:25.044780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535075088086434:13879]
2025-10-02T08:15:25.044793Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:25.044824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:25.044842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:25.044849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:25.044865Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:25.044880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535075088086434:13879]
2025-10-02T08:15:25.044881Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:25.044884Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:25.044888Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:25.044917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088086420:13880], now have 1 active actors on pipe
2025-10-02T08:15:25.044935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2369
2025-10-02T08:15:25.044948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535075547530699:2378], now have 1 active actors on pipe
2025-10-02T08:15:25.045026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.045034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.045059Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:25.045070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.045074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.045076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:25.045084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.045093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:25.045111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.045123Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2369
2025-10-02T08:15:25.045154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.045160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.045172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.045202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2370 partition: 0 MaxSeqNo: 17 sessionId: src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0
2025-10-02T08:15:25.045509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1144033b-6bb5cd09-1b95b192-13389ed2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:25.048291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0] Write session: try to update token
2025-10-02T08:15:25.048309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:25.062194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId: src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:25.063037Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:25.063040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:25.063042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:25.063048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535075088086434:13879]
2025-10-02T08:15:25.063052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535075088086434:13879]
2025-10-02T08:15:25.063100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:25.063102Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:25.063106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.063107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:25.063108Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:25.063245Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:25.064795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:25.108201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535075088086466:13279]
2025-10-02T08:15:25.108305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2369, pipe: [1:7556535075088086466:13279]
2025-10-02T08:15:25.196079Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:25.196383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.196394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.196432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088086466:13279], now have 1 active actors on pipe
2025-10-02T08:15:25.196565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535075088086466:13279]
2025-10-02T08:15:25.196596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:25.196598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:25.196600Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:25.196651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2370 reason: error at write: Disconnected sessionId: src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0
2025-10-02T08:15:25.196675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:25.196817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2370 sessionId: src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0 is DEAD
2025-10-02T08:15:25.196964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:25.196974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0] Write session will restart in 0.009464s
2025-10-02T08:15:25.196993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0] Write session: Do CDS request
2025-10-02T08:15:25.196997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:25.207259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.208052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:25.208070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2371
2025-10-02T08:15:25.208187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.208216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:25.208225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:25.208228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:25.208634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2371 sessionId:  describe result for acl check
2025-10-02T08:15:25.208676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:25.208679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:25.208681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:25.208686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535075088086854:13887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:25.209213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535075088086854:13887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:25.212322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535075088086854:13887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:25.214188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:25.214600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:25.214771Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:25.214780Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:25.214789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:25.214831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:25.214865Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535075088086968:13886]
2025-10-02T08:15:25.215397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:25.215452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535075088086854:13887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:25.215470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535075088086854:13887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:25.215473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535075088086854:13887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:25.215482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:25.215620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:25.215674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:25.216214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:25.216281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.216287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.216289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.216290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.216291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.216296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.216307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.216310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.216314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.216318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.216324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.216331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.216337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.216342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.216347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.216352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.216356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.216362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.216369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.216374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.216393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:25.224949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:25.226597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:25.226617Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:25.226620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:25.226624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:25.226631Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2370 [1:7556535075088086968:13886]
2025-10-02T08:15:25.226642Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:25.226659Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:25.226663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.226666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.226667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.226682Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:25.226686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:25.226693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:25.226753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.226763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.226767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:25.226769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:25.226833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:25.226841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.226855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.226871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:25.226894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088086978:13887], now have 1 active actors on pipe
2025-10-02T08:15:25.226903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2370
2025-10-02T08:15:25.226905Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535075088086962:13886]
2025-10-02T08:15:25.226907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535075088086962:13886]
2025-10-02T08:15:25.226914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:25.226926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:25.226927Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:25.226931Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:25.226943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:25.226951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:25.226957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535075547530706:2378], now have 1 active actors on pipe
2025-10-02T08:15:25.226962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.226970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.227009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535075088086962:13886]
2025-10-02T08:15:25.227017Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:25.227027Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:25.227032Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57669f2f-28635736-3f3933a3-71b04112_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:25.227038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.227042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.227044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:25.227055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.227068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:25.227116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.227163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.227170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.227182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.227222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2371 partition: 0 MaxSeqNo: 17 sessionId: src_id|57669f2f-28635736-3f3933a3-71b04112_0
2025-10-02T08:15:25.227531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee0b5f0-a9f6f5af-e4ba70b4-44938c81_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|57669f2f-28635736-3f3933a3-71b04112_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:25.227028Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2370
2025-10-02T08:15:25.230185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57669f2f-28635736-3f3933a3-71b04112_0] Write session: try to update token
2025-10-02T08:15:25.230199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57669f2f-28635736-3f3933a3-71b04112_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:25.243269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId: src_id|57669f2f-28635736-3f3933a3-71b04112_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:25.245714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:25.245988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.246010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.246033Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:25.246041Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:25.246044Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:25.246052Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535075088086962:13886]
2025-10-02T08:15:25.246057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535075088086962:13886]
2025-10-02T08:15:25.246100Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:25.246111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:25.246117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.246118Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:25.246119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:25.246256Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:25.296975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535075088087000:13279]
2025-10-02T08:15:25.297084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2370, pipe: [1:7556535075088087000:13279]
2025-10-02T08:15:25.380109Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:25.380505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:25.380561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088087000:13279], now have 1 active actors on pipe
2025-10-02T08:15:25.380622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:25.380739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:25.380747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:25.380763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2371 reason: error at write: Disconnected sessionId: src_id|57669f2f-28635736-3f3933a3-71b04112_0
2025-10-02T08:15:25.380764Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:25.380905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2371 sessionId: src_id|57669f2f-28635736-3f3933a3-71b04112_0 is DEAD
2025-10-02T08:15:25.381042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57669f2f-28635736-3f3933a3-71b04112_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:25.381048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57669f2f-28635736-3f3933a3-71b04112_0] Write session will restart in 0.007410s
2025-10-02T08:15:25.381065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57669f2f-28635736-3f3933a3-71b04112_0] Write session: Do CDS request
2025-10-02T08:15:25.381070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57669f2f-28635736-3f3933a3-71b04112_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:25.381469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535075088087000:13279]
2025-10-02T08:15:25.389176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57669f2f-28635736-3f3933a3-71b04112_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.389241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:25.389255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2372
2025-10-02T08:15:25.389358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.389386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:25.389394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:25.389397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:25.389782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2372 sessionId:  describe result for acl check
2025-10-02T08:15:25.389811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:25.389817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:25.389818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:25.389822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535075088087370:13899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:25.390384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535075088087370:13899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:25.394224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535075088087370:13899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:25.394407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:25.395244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:25.395395Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:25.395403Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:25.395411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:25.395449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:25.395480Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535075088087515:13898]
2025-10-02T08:15:25.396041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:25.396245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:25.396279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:25.396550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:25.396585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.396590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.396591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.396592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.396593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.396597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.396605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.396608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.396611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.396614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.396618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.396624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.396629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.396633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.396640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.396644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.396651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.396655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.396663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.396669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.396688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:25.397087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535075088087370:13899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:25.397097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535075088087370:13899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:25.397100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535075088087370:13899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:25.397106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:25.404542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:25.405878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:25.405892Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:25.405894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:25.405896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:25.405900Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2371 [1:7556535075088087515:13898]
2025-10-02T08:15:25.405906Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:25.405919Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:25.405920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.405922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.405924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.405935Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:25.405938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:25.405942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:25.405983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.405990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.405993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:25.405995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:25.406048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:25.406055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.406062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.406069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:25.406087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088087531:13899], now have 1 active actors on pipe
2025-10-02T08:15:25.406096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535075088087499:13898]
2025-10-02T08:15:25.406097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535075088087499:13898]
2025-10-02T08:15:25.406102Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:25.406114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:25.406115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:25.406115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2371
2025-10-02T08:15:25.406124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:25.406125Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:25.406126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:25.406130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535075547530728:2378], now have 1 active actors on pipe
2025-10-02T08:15:25.406134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.406136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.406164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535075088087499:13898]
2025-10-02T08:15:25.406159Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2371
2025-10-02T08:15:25.406174Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:25.406177Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:25.406184Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:25.406188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.406190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.406191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:25.406197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.406203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:25.406232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.406274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.406280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.406291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.406324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2372 partition: 0 MaxSeqNo: 17 sessionId: src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0
2025-10-02T08:15:25.406596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57669f2f-28635736-3f3933a3-71b04112_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:25.408947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0] Write session: try to update token
2025-10-02T08:15:25.408959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:25.416508Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:25.416529Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:25.416536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535075088087499:13898]
2025-10-02T08:15:25.416574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:25.416582Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:25.416739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:25.416901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:25.417037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:25.417169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:25.417372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:25.417412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:25.422130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId: src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:25.424522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:25.424587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.424600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.424632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:25.424657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:25.424692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.424706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.424882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.424950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.425020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.425088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.425237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.425250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.425316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.425402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.425466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.425529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.425573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.425580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.425647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.425708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.425768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.425831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.425892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.425899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.425963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.426028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.426092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.426156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.426210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.426217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.426280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.426341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.426404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.426471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.426516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.426523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.426588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.426650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.426714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.426779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.426823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.426830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.426895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.426955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.427022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.427089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.427132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.427139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.427204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.427266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.427327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.427395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.427446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.427452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.427517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.427578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.427648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.427712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.427757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.427763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.427829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:25.427889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:25.427952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:25.428015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:25.428061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:25.428067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:25.428110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:25.428190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.428213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.428219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:25.428248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:25.428263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:25.428270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:25.428273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:25.428275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:25.428671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:25.428696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:25.428707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:25.428710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:25.428713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:25.428716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:25.429273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:25.429294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:25.429299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:25.429302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:25.429306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:25.429309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:25.429821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:25.429841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:25.429846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:25.429864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:25.429871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:25.431074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:25.431086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:25.431096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392925431
2025-10-02T08:15:25.431218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:25.431229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:25.431232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:25.431235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:25.431238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:25.431240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:25.431632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:25.431650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:25.431654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:25.431657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:25.431659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:25.431661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:25.432080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:25.432098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:25.432104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:25.432107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:25.432110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:25.432118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:25.432541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:25.432560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:25.432563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:25.433528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:25.433544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:25.433547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:25.433550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:25.433556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392925433
2025-10-02T08:15:25.433822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:25.433838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:25.433842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:25.433846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:25.433850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:25.433853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:25.434255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:25.434273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:25.434277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:25.434279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:25.434281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:25.434283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:25.434666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:25.434685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.434761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392925434
2025-10-02T08:15:25.435465Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:25.435487Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:25.435492Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:25.435495Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:25.436995Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:25.437006Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:25.437007Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:25.437013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535075088087499:13898]
2025-10-02T08:15:25.437015Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535075088087499:13898]
2025-10-02T08:15:25.437059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:25.437066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.437068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:25.437071Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:25.437077Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:25.437182Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:25.481816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535075088087579:13279]
2025-10-02T08:15:25.481916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2371, pipe: [1:7556535075088087579:13279]
2025-10-02T08:15:25.580998Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:25.581386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088087579:13279], now have 1 active actors on pipe
2025-10-02T08:15:25.581677Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:25.581728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:25.581765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2372 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0
2025-10-02T08:15:25.582057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:25.582067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0] Write session will restart in 0.007999s
2025-10-02T08:15:25.582090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0] Write session: Do CDS request
2025-10-02T08:15:25.582096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:25.582004Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:25.581926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2372 sessionId: src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0 is DEAD
2025-10-02T08:15:25.582001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535075088087579:13279]
2025-10-02T08:15:25.591274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.591396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:25.591411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2373
2025-10-02T08:15:25.591561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.591592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:25.591601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:25.591604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:25.592314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2373 sessionId:  describe result for acl check
2025-10-02T08:15:25.592351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:25.592359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:25.592361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:25.592366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535075088087817:13912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:25.592921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535075088087817:13912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:25.597949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535075088087817:13912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:25.604999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:25.605391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535075088087817:13912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:25.605405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535075088087817:13912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:25.605408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535075088087817:13912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:25.605416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:25.606365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:25.606498Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:25.606500Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:25.606506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:25.606534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:25.606555Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535075088088089:13911]
2025-10-02T08:15:25.606932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:25.607070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:25.607096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:25.607269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:25.607298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.607302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.607303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.607303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.607304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.607307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.607313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.607315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.607317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.607319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.607322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.607326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.607329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.607333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.607335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.607337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.607339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.607342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.607345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.607347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.607357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:25.619394Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2372
2025-10-02T08:15:25.617277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:25.618828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:25.618834Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:25.618837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:25.618841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:25.618848Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2372 [1:7556535075088088089:13911]
2025-10-02T08:15:25.618861Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:25.618880Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:25.618883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.618886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.618888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.618904Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:25.618910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:25.618917Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:25.618979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.618982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.618985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:25.618987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:25.619289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:25.619292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.619307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.619323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:25.619341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088088084:13912], now have 1 active actors on pipe
2025-10-02T08:15:25.619344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535075547530743:2378], now have 1 active actors on pipe
2025-10-02T08:15:25.619351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535075088088077:13911]
2025-10-02T08:15:25.619353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535075088088077:13911]
2025-10-02T08:15:25.619366Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:25.619380Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:25.619396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:25.619399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:25.619434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535075088088077:13911]
2025-10-02T08:15:25.619437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:25.619482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2372
2025-10-02T08:15:25.619679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:25.619687Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:25.619692Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:25.620069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.620077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.620101Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:25.620107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.620110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.620112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:25.620121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.620130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:25.620143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.620183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.620185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.620196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.620223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2373 partition: 0 MaxSeqNo: 17 sessionId: src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0
2025-10-02T08:15:25.620558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d1e8a58-4bbf0a35-837dc456-86df73f7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:25.623335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0] Write session: try to update token
2025-10-02T08:15:25.623349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:25.639831Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:25.639851Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:25.639854Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:25.639862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535075088088077:13911]
2025-10-02T08:15:25.639866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535075088088077:13911]
2025-10-02T08:15:25.639906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:25.639914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.639916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:25.639930Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:25.639936Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:25.640043Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:25.645623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId: src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:25.648110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:25.684278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535075088088115:13279]
2025-10-02T08:15:25.684540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2372, pipe: [1:7556535075088088115:13279]
2025-10-02T08:15:25.789486Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:25.789848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.789864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.789900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088088115:13279], now have 1 active actors on pipe
2025-10-02T08:15:25.790136Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:25.790523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:25.790529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535075088088115:13279]
2025-10-02T08:15:25.790586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2373 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0
2025-10-02T08:15:25.790730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2373 sessionId: src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0 is DEAD
2025-10-02T08:15:25.790848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:25.790859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0] Write session will restart in 0.005237s
2025-10-02T08:15:25.790881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0] Write session: Do CDS request
2025-10-02T08:15:25.790890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:25.790935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:25.797749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.798615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:25.798630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2374
2025-10-02T08:15:25.798760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:25.798845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:25.798857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:25.798860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:25.799646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2374 sessionId:  describe result for acl check
2025-10-02T08:15:25.799696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:25.799704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:25.799705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:25.799710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535075088088349:13918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:25.800246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535075088088349:13918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:25.803916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535075088088349:13918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:25.810558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535075088088349:13918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:25.810576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535075088088349:13918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:25.810580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535075088088349:13918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:25.810589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:25.816517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:25.819699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:25.819908Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:25.819912Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:25.819921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:25.819970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:25.820015Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535075088088634:13917]
2025-10-02T08:15:25.820674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:25.820913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:25.820963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:25.821269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:25.821302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.821303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.821304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.821305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.821305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.821310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.821320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.821324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.821328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.821332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.821338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.821344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:25.821351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.821357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:25.821362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.821367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:25.821372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.821378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.821383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.821387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.821409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:25.830304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:25.832021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:25.832026Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:25.832029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:25.832032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:25.832038Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2373 [1:7556535075088088634:13917]
2025-10-02T08:15:25.832050Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:25.832065Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:25.832068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.832070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.832072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.832086Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:25.832091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:25.832097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:25.832163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.832165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.832168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:25.832170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:25.832233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:25.832236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.832249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:25.832263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:25.832279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088088568:13918], now have 1 active actors on pipe
2025-10-02T08:15:25.832285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535075088088628:13917]
2025-10-02T08:15:25.832287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535075088088628:13917]
2025-10-02T08:15:25.832294Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:25.832307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:25.832319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:25.832322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:25.832327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535075547530761:2378], now have 1 active actors on pipe
2025-10-02T08:15:25.832353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535075088088628:13917]
2025-10-02T08:15:25.832356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:25.832390Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:25.832392Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:25.832394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2373
2025-10-02T08:15:25.832404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:25.832435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.832448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.832468Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:25.832474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:25.832515Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2373
2025-10-02T08:15:25.832479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:25.832480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:25.832488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:25.832496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:25.832511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.832595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:25.832597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:25.832614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:25.832641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2374 partition: 0 MaxSeqNo: 17 sessionId: src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0
2025-10-02T08:15:25.835817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a9ca51b-8b1af599-ce04d48d-444b2980_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:25.838327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0] Write session: try to update token
2025-10-02T08:15:25.838342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:25.850726Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:25.850749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:25.850752Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:25.850761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535075088088628:13917]
2025-10-02T08:15:25.850766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535075088088628:13917]
2025-10-02T08:15:25.850809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:25.850815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:25.850821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:25.850821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:25.850828Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:25.850963Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:25.854155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId: src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:25.856843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:25.890891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535075088088671:13279]
2025-10-02T08:15:25.891045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2373, pipe: [1:7556535075088088671:13279]
2025-10-02T08:15:26.003556Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:26.003966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.003982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.004021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535075088088671:13279], now have 1 active actors on pipe
2025-10-02T08:15:26.004250Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:26.004343Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:26.004673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:26.004733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2374 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0
2025-10-02T08:15:26.004903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2374 sessionId: src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0 is DEAD
2025-10-02T08:15:26.005070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:26.005081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0] Write session will restart in 0.006444s
2025-10-02T08:15:26.005104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0] Write session: Do CDS request
2025-10-02T08:15:26.005110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:26.005189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535075088088671:13279]
2025-10-02T08:15:26.012210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.012284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:26.012301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2375
2025-10-02T08:15:26.012399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.012429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:26.012438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:26.012441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:26.012965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2375 sessionId:  describe result for acl check
2025-10-02T08:15:26.013005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:26.013011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:26.013013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:26.013018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535079383056278:13925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:26.013462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535079383056278:13925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:26.017949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535079383056278:13925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:26.018979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:26.019905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:26.020058Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:26.020066Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:26.020074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:26.020111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:26.020152Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535079383056476:13924]
2025-10-02T08:15:26.020557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535079383056278:13925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:26.020570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535079383056278:13925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:26.020573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535079383056278:13925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:26.020580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:26.020712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:26.020875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:26.020919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:26.021211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:26.021249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.021254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.021255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.021257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.021258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.021262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.021272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.021275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.021279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.021283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.021287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.021294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.021299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.021303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.021308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.021316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.021320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.021325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.021333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.021337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.021361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:26.029153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:26.030702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:26.030716Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:26.030718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:26.030720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:26.030725Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2374 [1:7556535079383056476:13924]
2025-10-02T08:15:26.030733Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:26.030747Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:26.030749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.030751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.030752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.030764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:26.030767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:26.030772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:26.030818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.030823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.030826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:26.030827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:26.030882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:26.030890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.030900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.030911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:26.030932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535079383056470:13924]
2025-10-02T08:15:26.030939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535079383056470:13924]
2025-10-02T08:15:26.030945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:26.030949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2374
2025-10-02T08:15:26.030952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:26.030956Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:26.030957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383056481:13925], now have 1 active actors on pipe
2025-10-02T08:15:26.030963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535079842498066:2378], now have 1 active actors on pipe
2025-10-02T08:15:26.030967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:26.030980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:26.030988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:26.030994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.030998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.031031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535079383056470:13924]
2025-10-02T08:15:26.031041Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:26.031053Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:26.031062Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|549dea28-95597dff-dc271e51-6e9f9685_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:26.031067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.031070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.031072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:26.031079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.031096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:26.031078Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2374
2025-10-02T08:15:26.031130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.031188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.031194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.031206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.031241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2375 partition: 0 MaxSeqNo: 17 sessionId: src_id|549dea28-95597dff-dc271e51-6e9f9685_0
2025-10-02T08:15:26.031547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb3d1b7-91f93616-97431870-50a0aec5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|549dea28-95597dff-dc271e51-6e9f9685_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:26.034127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549dea28-95597dff-dc271e51-6e9f9685_0] Write session: try to update token
2025-10-02T08:15:26.034144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549dea28-95597dff-dc271e51-6e9f9685_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:26.047645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId: src_id|549dea28-95597dff-dc271e51-6e9f9685_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:26.049182Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:26.049203Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:26.049205Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:26.049214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535079383056470:13924]
2025-10-02T08:15:26.049218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535079383056470:13924]
2025-10-02T08:15:26.049257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:26.049257Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:26.049264Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:26.049268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.049271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:26.049423Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:26.050560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:26.105427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535079383056508:13279]
2025-10-02T08:15:26.105546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2374, pipe: [1:7556535079383056508:13279]
2025-10-02T08:15:26.184984Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:26.185583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.185598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.185637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383056508:13279], now have 1 active actors on pipe
2025-10-02T08:15:26.185905Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:26.185787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535079383056508:13279]
2025-10-02T08:15:26.185806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:26.185809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:26.185858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2375 reason: error at write: Disconnected sessionId: src_id|549dea28-95597dff-dc271e51-6e9f9685_0
2025-10-02T08:15:26.185876Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:26.186007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2375 sessionId: src_id|549dea28-95597dff-dc271e51-6e9f9685_0 is DEAD
2025-10-02T08:15:26.187169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549dea28-95597dff-dc271e51-6e9f9685_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:26.187179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549dea28-95597dff-dc271e51-6e9f9685_0] Write session will restart in 0.008427s
2025-10-02T08:15:26.187202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549dea28-95597dff-dc271e51-6e9f9685_0] Write session: Do CDS request
2025-10-02T08:15:26.187210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549dea28-95597dff-dc271e51-6e9f9685_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:26.196278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549dea28-95597dff-dc271e51-6e9f9685_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.196307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:26.196323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2376
2025-10-02T08:15:26.196449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.196487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:26.196497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:26.196501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:26.196867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2376 sessionId:  describe result for acl check
2025-10-02T08:15:26.196897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:26.196903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:26.196905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:26.196909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535079383056894:13932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:26.197339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535079383056894:13932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:26.200475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:26.201319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:26.201484Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:26.201492Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:26.201499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:26.201534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:26.201561Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535079383057006:13931]
2025-10-02T08:15:26.202037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:26.202184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:26.202214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:26.202426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535079383056894:13932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:26.202449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:26.202494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.202503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.202504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.202505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.202506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.202510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.202518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.202522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.202525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.202529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.202534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.202540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.202546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.202551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.202554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.202559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.202563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.202568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.202573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.202577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.202592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:26.208426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535079383056894:13932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:26.208442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535079383056894:13932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:26.208445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535079383056894:13932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:26.208454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:26.210229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:26.211695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:26.211710Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:26.211712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:26.211716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:26.211722Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2375 [1:7556535079383057006:13931]
2025-10-02T08:15:26.211729Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:26.211741Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:26.211746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.211749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.211750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.211762Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:26.211765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:26.211771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:26.211815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.211821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.211823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:26.211825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:26.211883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:26.211891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.211902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.211912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:26.211929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535079383056991:13931]
2025-10-02T08:15:26.211934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535079383056991:13931]
2025-10-02T08:15:26.211946Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:26.211963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:26.211974Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:26.211979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:26.211982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:26.211983Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:26.212013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535079383056991:13931]
2025-10-02T08:15:26.212020Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:26.212022Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:26.212028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383057037:13932], now have 1 active actors on pipe
2025-10-02T08:15:26.212041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535079842498072:2378], now have 1 active actors on pipe
2025-10-02T08:15:26.212063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2375
2025-10-02T08:15:26.212114Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2375
2025-10-02T08:15:26.212178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.212194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.212229Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:26.212242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.212250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.212253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:26.212267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.212281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:26.212302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.212347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.212353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.212366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.212417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2376 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0
2025-10-02T08:15:26.212747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549dea28-95597dff-dc271e51-6e9f9685_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:26.215348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0] Write session: try to update token
2025-10-02T08:15:26.215363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:26.229337Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:26.229360Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:26.229363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:26.229371Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535079383056991:13931]
2025-10-02T08:15:26.229376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535079383056991:13931]
2025-10-02T08:15:26.229418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:26.229430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.229433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:26.229453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:26.229462Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:26.229577Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:26.230536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId: src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:26.232849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:26.285629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535079383057051:13279]
2025-10-02T08:15:26.285736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2375, pipe: [1:7556535079383057051:13279]
2025-10-02T08:15:26.377154Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:26.377501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.377514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.377554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383057051:13279], now have 1 active actors on pipe
2025-10-02T08:15:26.377681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:26.377695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:26.377794Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:26.377758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2376 reason: error at write: Disconnected sessionId: src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0
2025-10-02T08:15:26.377767Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:26.377911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2376 sessionId: src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0 is DEAD
2025-10-02T08:15:26.378028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:26.378034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0] Write session will restart in 0.008448s
2025-10-02T08:15:26.378059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0] Write session: Do CDS request
2025-10-02T08:15:26.378064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:26.378051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535079383057051:13279]
2025-10-02T08:15:26.387261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.387318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:26.387333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2377
2025-10-02T08:15:26.387475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.387507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:26.387516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:26.387519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:26.387919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2377 sessionId:  describe result for acl check
2025-10-02T08:15:26.387949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:26.387955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:26.387956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:26.387960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535079383057452:13938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:26.388440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535079383057452:13938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:26.390522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535079383057452:13938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:26.391777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:26.392063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:26.392190Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:26.392197Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:26.392205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:26.392236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:26.392263Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535079383057564:13937]
2025-10-02T08:15:26.392695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:26.392789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535079383057452:13938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:26.392821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535079383057452:13938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:26.392828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535079383057452:13938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:26.392836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:26.392866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:26.392910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:26.393160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:26.393199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.393203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.393204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.393205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.393205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.393208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.393215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.393217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.393219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.393221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.393224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.393228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.393232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.393235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.393237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.393240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.393242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.393245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.393248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.393250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.393261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:26.400818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:26.402483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:26.402504Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:26.402505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:26.402509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:26.402514Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2376 [1:7556535079383057564:13937]
2025-10-02T08:15:26.402526Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:26.402540Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:26.402549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.402552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.402554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.402569Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:26.402574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:26.402580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:26.402635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.402643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.402646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:26.402649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:26.402712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:26.402719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.402729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.402740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:26.402763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383057574:13938], now have 1 active actors on pipe
2025-10-02T08:15:26.402770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535079842498081:2378], now have 1 active actors on pipe
2025-10-02T08:15:26.402775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535079383057558:13937]
2025-10-02T08:15:26.402777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535079383057558:13937]
2025-10-02T08:15:26.402786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:26.402798Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:26.402802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:26.402810Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:26.402816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:26.402819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:26.402846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535079383057558:13937]
2025-10-02T08:15:26.402854Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:26.402864Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:26.402839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2376
2025-10-02T08:15:26.402892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2376
2025-10-02T08:15:26.402908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.402916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.402937Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1196653-6e972750-756da367-7b14752c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:26.402947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.402951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.402952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:26.402960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.402969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:26.402986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.403008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.403014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.403026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.403061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2377 partition: 0 MaxSeqNo: 17 sessionId: src_id|1196653-6e972750-756da367-7b14752c_0
2025-10-02T08:15:26.403349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e02caf0-e7e51662-a871b8a9-32e60733_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1196653-6e972750-756da367-7b14752c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:26.406132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1196653-6e972750-756da367-7b14752c_0] Write session: try to update token
2025-10-02T08:15:26.406152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1196653-6e972750-756da367-7b14752c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:26.419978Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:26.419998Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:26.420000Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:26.420007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535079383057558:13937]
2025-10-02T08:15:26.420011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535079383057558:13937]
2025-10-02T08:15:26.420046Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:26.420048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:26.420050Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:26.420054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.420056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:26.420195Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:26.437273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId: src_id|1196653-6e972750-756da367-7b14752c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:26.439590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:26.478135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535079383057635:13279]
2025-10-02T08:15:26.478253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2376, pipe: [1:7556535079383057635:13279]
2025-10-02T08:15:26.559468Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:26.560081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.560094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.560114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383057635:13279], now have 1 active actors on pipe
2025-10-02T08:15:26.560204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:26.560217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:26.560275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2377 reason: error at write: Disconnected sessionId: src_id|1196653-6e972750-756da367-7b14752c_0
2025-10-02T08:15:26.560315Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:26.560452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2377 sessionId: src_id|1196653-6e972750-756da367-7b14752c_0 is DEAD
2025-10-02T08:15:26.560613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535079383057635:13279]
2025-10-02T08:15:26.560396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:26.560893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1196653-6e972750-756da367-7b14752c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:26.560905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1196653-6e972750-756da367-7b14752c_0] Write session will restart in 0.008896s
2025-10-02T08:15:26.560932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1196653-6e972750-756da367-7b14752c_0] Write session: Do CDS request
2025-10-02T08:15:26.560938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1196653-6e972750-756da367-7b14752c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:26.571429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1196653-6e972750-756da367-7b14752c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.571532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:26.571546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2378
2025-10-02T08:15:26.571682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.571716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:26.571721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:26.571725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:26.572155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2378 sessionId:  describe result for acl check
2025-10-02T08:15:26.572191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:26.572193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:26.572195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:26.572201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535079383057841:13957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:26.572723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535079383057841:13957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:26.577870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535079383057841:13957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:26.582967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535079383057841:13957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:26.582985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535079383057841:13957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:26.582988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535079383057841:13957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:26.583005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:26.585166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:26.587841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:26.588074Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:26.588087Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:26.588099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:26.588184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:26.588227Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535079383058155:13956]
2025-10-02T08:15:26.588884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:26.589104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:26.589158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:26.589459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:26.589525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.589532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.589533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.589534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.589536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.589541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.589551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.589555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.589559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.589563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.589569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.589577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.589583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.589588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.589593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.589598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.589609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.589614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.589623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.589628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.589651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:26.598077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:26.599730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:26.599745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:26.599748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:26.599752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:26.599760Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2377 [1:7556535079383058155:13956]
2025-10-02T08:15:26.599770Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:26.599788Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:26.599792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.599795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.599797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.599813Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:26.599819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:26.599827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:26.599875Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.599883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.599885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:26.599887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:26.599939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:26.599944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.599954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.599966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:26.599981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383058137:13957], now have 1 active actors on pipe
2025-10-02T08:15:26.599993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535079383058149:13956]
2025-10-02T08:15:26.600001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535079383058149:13956]
2025-10-02T08:15:26.600009Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:26.600019Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:26.600023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:26.600031Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:26.600033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:26.600035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:26.600041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535079842498109:2378], now have 1 active actors on pipe
2025-10-02T08:15:26.600045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.600048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.600086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535079383058149:13956]
2025-10-02T08:15:26.600099Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:26.600112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:26.600118Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:26.600124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.600127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.600129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:26.600138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.600153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2377
2025-10-02T08:15:26.600158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:26.600121Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2377
2025-10-02T08:15:26.600369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.600412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.600418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.600429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.600458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2378 partition: 0 MaxSeqNo: 17 sessionId: src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0
2025-10-02T08:15:26.600776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1196653-6e972750-756da367-7b14752c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:26.603306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0] Write session: try to update token
2025-10-02T08:15:26.603320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:26.618452Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:26.618473Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:26.618476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:26.618486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535079383058149:13956]
2025-10-02T08:15:26.618490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535079383058149:13956]
2025-10-02T08:15:26.618532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:26.618539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.618537Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:26.618541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:26.618544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:26.618675Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:26.624880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId: src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:26.627425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:26.660948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535079383058181:13279]
2025-10-02T08:15:26.661049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2377, pipe: [1:7556535079383058181:13279]
2025-10-02T08:15:26.760200Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:26.760576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.760589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.760627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383058181:13279], now have 1 active actors on pipe
2025-10-02T08:15:26.760714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:26.760720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:26.760772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2378 reason: error at write: Disconnected sessionId: src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0
2025-10-02T08:15:26.760847Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:26.760892Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:26.760937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2378 sessionId: src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0 is DEAD
2025-10-02T08:15:26.761086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:26.761096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0] Write session will restart in 0.008138s
2025-10-02T08:15:26.761084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535079383058181:13279]
2025-10-02T08:15:26.761119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0] Write session: Do CDS request
2025-10-02T08:15:26.761125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:26.770263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.770339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:26.770357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2379
2025-10-02T08:15:26.770468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.770502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:26.770510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:26.770514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:26.770814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2379 sessionId:  describe result for acl check
2025-10-02T08:15:26.770841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:26.770846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:26.770847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:26.770850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535079383058557:13963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:26.771276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535079383058557:13963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:26.774127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535079383058557:13963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:26.774948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:26.775703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:26.776059Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:26.776071Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:26.776083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:26.776155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:26.776194Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535079383058700:13962]
2025-10-02T08:15:26.776835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:26.776983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:26.777023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:26.777308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:26.777365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.777371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.777372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.777374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.777375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.777380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.777389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.777393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.777397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.777401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535079383058557:13963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:26.777403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.777408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.777408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535079383058557:13963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:26.777412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535079383058557:13963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:26.777415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.777420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:26.777422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.777427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.777433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.777439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.777443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.777448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.777456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.777461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.777479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:26.785272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:26.786883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:26.786895Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:26.786898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:26.786901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:26.786907Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2378 [1:7556535079383058700:13962]
2025-10-02T08:15:26.786919Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:26.786935Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:26.786938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.786940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.786942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.786956Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:26.786961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:26.786968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:26.787025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.787038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.787042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:26.787044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:26.787111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:26.787121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.787134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.787146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:26.787164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383058712:13963], now have 1 active actors on pipe
2025-10-02T08:15:26.787167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2378
2025-10-02T08:15:26.787176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535079383058690:13962]
2025-10-02T08:15:26.787178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535079383058690:13962]
2025-10-02T08:15:26.787189Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:26.787198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535079842498116:2378], now have 1 active actors on pipe
2025-10-02T08:15:26.787206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:26.787209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:26.787210Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:26.787224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:26.787230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:26.787237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.787241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.787285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535079383058690:13962]
2025-10-02T08:15:26.787292Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:26.787301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:26.787306Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:26.787312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.787316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.787318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:26.787326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.787338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:26.787313Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2378
2025-10-02T08:15:26.787375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.787416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.787422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.787434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.787471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2379 partition: 0 MaxSeqNo: 17 sessionId: src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0
2025-10-02T08:15:26.787780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f4426a-5d3b7249-7c8dead6-7a296629_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:26.790568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0] Write session: try to update token
2025-10-02T08:15:26.790585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:26.806652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId: src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:26.807109Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:26.807133Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:26.807135Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:26.807143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535079383058690:13962]
2025-10-02T08:15:26.807148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535079383058690:13962]
2025-10-02T08:15:26.807183Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:26.807188Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:26.807191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:26.807197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.807200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:26.807340Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:26.809343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:26.861181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535079383058746:13279]
2025-10-02T08:15:26.861312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2378, pipe: [1:7556535079383058746:13279]
2025-10-02T08:15:26.944268Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:26.944676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.944690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.944723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383058746:13279], now have 1 active actors on pipe
2025-10-02T08:15:26.944844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535079383058746:13279]
2025-10-02T08:15:26.944870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:26.944872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:26.944926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2379 reason: error at write: Disconnected sessionId: src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0
2025-10-02T08:15:26.944974Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:26.944985Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:26.945080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2379 sessionId: src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0 is DEAD
2025-10-02T08:15:26.945196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:26.945206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0] Write session will restart in 0.009161s
2025-10-02T08:15:26.945231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0] Write session: Do CDS request
2025-10-02T08:15:26.945237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:26.955287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.955334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:26.955350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2380
2025-10-02T08:15:26.955517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:26.955559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:26.955568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:26.955572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:26.956022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2380 sessionId:  describe result for acl check
2025-10-02T08:15:26.956060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:26.956066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:26.956068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:26.956073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535079383059141:13970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:26.956604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535079383059141:13970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:26.959328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535079383059141:13970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:26.960828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:26.961872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:26.962025Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:26.962032Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:26.962039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:26.962079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:26.962106Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535079383059267:13969]
2025-10-02T08:15:26.962240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535079383059141:13970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:26.962250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535079383059141:13970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:26.962252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535079383059141:13970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:26.962258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:26.962557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:26.962714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:26.962742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:26.962967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:26.963002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.963007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.963008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.963009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.963009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.963012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.963018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.963020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.963022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.963024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.963028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.963032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:26.963035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.963039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:26.963043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.963048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:26.963051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.963055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.963060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.963064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.963082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:26.970815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:26.972732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:26.972751Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:26.972753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:26.972756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:26.972763Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2379 [1:7556535079383059267:13969]
2025-10-02T08:15:26.972776Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:26.972792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:26.972816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.972824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.972826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.972842Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:26.972851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:26.972860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:26.972927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.972935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.972938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:26.972940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:26.973053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2379
2025-10-02T08:15:26.973109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:26.973111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:26.973124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:26.973137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:26.973155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535079383059272:13970], now have 1 active actors on pipe
2025-10-02T08:15:26.973166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535079842498137:2378], now have 1 active actors on pipe
2025-10-02T08:15:26.973143Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2379
2025-10-02T08:15:26.973171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.973175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.973192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535079383059261:13969]
2025-10-02T08:15:26.973195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535079383059261:13969]
2025-10-02T08:15:26.973205Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:26.973220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:26.973224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:26.973230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:26.973237Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:26.973240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:26.973261Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:26.973273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.973276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.973279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:26.973288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:26.973301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:26.973335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535079383059261:13969]
2025-10-02T08:15:26.973347Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:26.973364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.973365Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:26.973405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.973412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.973426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:26.973472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2380 partition: 0 MaxSeqNo: 17 sessionId: src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0
2025-10-02T08:15:26.973769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5d0061-43cc0f6f-821b2709-84ea8e33_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:26.976610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0] Write session: try to update token
2025-10-02T08:15:26.976625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:26.984309Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:26.984329Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:26.984342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535079383059261:13969]
2025-10-02T08:15:26.984377Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:26.984382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:26.984547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:26.984695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:26.984858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:26.985003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:26.985207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:26.985252Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:26.990851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId: src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:26.993412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:26.993474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.993491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.993526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:26.993548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:26.993608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:26.993616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:26.993774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.993839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.993902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.993961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.994004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.994011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.994075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.994145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.994217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.994298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.994339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.994345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.994409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.994473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.994542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.994615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.994662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.994669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.994739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.994814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.994881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.994948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.994999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.995005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.995086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.995153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.995225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.995290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.995338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.995343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.995405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.995476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.995543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.995602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.995653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.995660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.995735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.995805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.995878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.995947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.996002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.996010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.996084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.996158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.996233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.996312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.996365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.996375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.996448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.996522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.996589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.996660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.996711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.996718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.996795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:26.996884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:26.996955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:26.997027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:26.997079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:26.997091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:26.997131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:26.997206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:26.997229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:26.997236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:26.997269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:26.997288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:26.997297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:26.997300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:26.997302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:26.997735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:26.997771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:26.997783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:26.997792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:26.997795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:26.997799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:26.998351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:26.998378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:26.998385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:26.998392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:26.998396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:26.998404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:26.998959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:26.998992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:26.998999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:26.999007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:26.999012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:27.000225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:27.000241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:27.000250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392926999
2025-10-02T08:15:27.000386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:27.000398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:27.000403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:27.000405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:27.000408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:27.000410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:27.000891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:27.000911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:27.000916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:27.000919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:27.000921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:27.000925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:27.001374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:27.001395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:27.001403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:27.001406Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:27.001408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:27.001411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:27.001897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:27.001924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:27.001934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:27.003047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:27.003070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:27.003076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:27.003080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:27.003089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392927002
2025-10-02T08:15:27.003421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:27.003446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:27.003457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:27.003463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:27.003467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:27.003470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:27.003976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:27.004001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:27.004011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:27.004014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:27.004017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:27.004020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:27.004508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:27.004537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.004647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392927004
2025-10-02T08:15:27.005398Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:27.005414Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:27.005418Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:27.005422Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:27.006924Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:27.006935Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:27.006937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:27.006948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535079383059261:13969]
2025-10-02T08:15:27.006953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535079383059261:13969]
2025-10-02T08:15:27.007006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:27.007009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:27.007014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.007015Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:27.007016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:27.007135Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:27.044945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535083678026600:13279]
2025-10-02T08:15:27.045077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2379, pipe: [1:7556535083678026600:13279]
2025-10-02T08:15:27.140263Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:27.140598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678026600:13279], now have 1 active actors on pipe
2025-10-02T08:15:27.140686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535083678026600:13279]
2025-10-02T08:15:27.140709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:27.140711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:27.140734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2380 reason: error at write: Disconnected sessionId: src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0
2025-10-02T08:15:27.140777Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:27.140841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:27.140893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2380 sessionId: src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0 is DEAD
2025-10-02T08:15:27.141040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:27.141051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0] Write session will restart in 0.005468s
2025-10-02T08:15:27.141074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0] Write session: Do CDS request
2025-10-02T08:15:27.141080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:27.147366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.147376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:27.147392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2381
2025-10-02T08:15:27.147573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.147613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:27.147622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:27.147625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:27.148069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2381 sessionId:  describe result for acl check
2025-10-02T08:15:27.148101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:27.148103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:27.148104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:27.148109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535083678026859:13977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:27.148748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535083678026859:13977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:27.151376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535083678026859:13977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:27.154025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535083678026859:13977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:27.154040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535083678026859:13977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:27.154044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535083678026859:13977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:27.154051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:27.156992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:27.158153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:27.158428Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:27.158431Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:27.158441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:27.158491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:27.158521Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535083678027130:13976]
2025-10-02T08:15:27.159143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:27.159335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:27.159374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:27.159660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:27.159694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.159695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.159696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.159697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.159698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.159703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.159713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.159717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.159721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.159724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.159729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.159737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.159742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.159748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.159752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.159757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.159762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.159767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.159773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.159779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.159798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:27.167672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:27.169130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:27.169147Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:27.169150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:27.169154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:27.169161Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2380 [1:7556535083678027130:13976]
2025-10-02T08:15:27.169173Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:27.169190Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:27.169193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.169196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.169198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.169213Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:27.169218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:27.169224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:27.169286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.169295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.169298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:27.169300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:27.169365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:27.169374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.169387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.169404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:27.169425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535083678027124:13976]
2025-10-02T08:15:27.169431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535083678027124:13976]
2025-10-02T08:15:27.169438Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:27.169447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2380
2025-10-02T08:15:27.169451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:27.169456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678027073:13977], now have 1 active actors on pipe
2025-10-02T08:15:27.169462Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:27.169463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:27.169477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:27.169484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:27.169490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535084137465440:2378], now have 1 active actors on pipe
2025-10-02T08:15:27.169495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.169502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.169538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535083678027124:13976]
2025-10-02T08:15:27.169550Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:27.169559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:27.169565Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:27.169571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.169574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.169576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:27.169585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.169597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:27.169554Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2380
2025-10-02T08:15:27.169639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.169680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.169687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.169701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.169737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2381 partition: 0 MaxSeqNo: 17 sessionId: src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0
2025-10-02T08:15:27.170065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d69dd13f-a5e2c959-82bc2df8-e260124c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:27.172743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0] Write session: try to update token
2025-10-02T08:15:27.172760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:27.186319Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:27.186338Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:27.186341Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:27.186349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535083678027124:13976]
2025-10-02T08:15:27.186353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535083678027124:13976]
2025-10-02T08:15:27.186382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId: src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:27.186392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:27.186396Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:27.186399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.186402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:27.186402Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:27.186530Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:27.189006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:27.241502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535083678027154:13279]
2025-10-02T08:15:27.241691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2380, pipe: [1:7556535083678027154:13279]
2025-10-02T08:15:27.336955Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:27.337457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.337473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.337511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678027154:13279], now have 1 active actors on pipe
2025-10-02T08:15:27.337610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:27.337621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:27.337667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2381 reason: error at write: Disconnected sessionId: src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0
2025-10-02T08:15:27.337732Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:27.337818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2381 sessionId: src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0 is DEAD
2025-10-02T08:15:27.337971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:27.337967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535083678027154:13279]
2025-10-02T08:15:27.337981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0] Write session will restart in 0.006926s
2025-10-02T08:15:27.338006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0] Write session: Do CDS request
2025-10-02T08:15:27.338030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:27.340598Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:27.346254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.346289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:27.346302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2382
2025-10-02T08:15:27.346467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.346497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:27.346506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:27.346509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:27.346908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2382 sessionId:  describe result for acl check
2025-10-02T08:15:27.346956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:27.346963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:27.346965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:27.346970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535083678027497:13983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:27.347507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535083678027497:13983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:27.352288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535083678027497:13983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:27.355512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535083678027497:13983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:27.355526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535083678027497:13983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:27.355529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535083678027497:13983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:27.355576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:27.356342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:27.356660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:27.356822Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:27.356831Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:27.356841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:27.356894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:27.356930Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535083678027684:13982]
2025-10-02T08:15:27.357538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:27.357693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:27.357731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:27.358014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:27.358061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.358066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.358068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.358069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.358070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.358074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.358084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.358088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.358092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.358096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.358101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.358108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.358113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.358118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.358121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.358126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.358129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.358134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.358141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.358145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.358162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:27.366069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:27.367595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:27.367609Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:27.367611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:27.367613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:27.367618Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2381 [1:7556535083678027684:13982]
2025-10-02T08:15:27.367626Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:27.367640Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:27.367642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.367644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.367646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.367657Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:27.367662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:27.367671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:27.367720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.367725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.367728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:27.367729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:27.367779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:27.367785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.367796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.367806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:27.367826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535083678027678:13982]
2025-10-02T08:15:27.367833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535083678027678:13982]
2025-10-02T08:15:27.367839Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:27.367849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2381
2025-10-02T08:15:27.367852Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:27.367853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678027675:13983], now have 1 active actors on pipe
2025-10-02T08:15:27.367855Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:27.367859Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:27.367870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:27.367873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:27.367879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535084137465449:2378], now have 1 active actors on pipe
2025-10-02T08:15:27.367883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.367886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.367925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535083678027678:13982]
2025-10-02T08:15:27.367937Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:27.367951Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:27.367954Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:27.367961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.367964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.367966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:27.367975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.367987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:27.367963Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2381
2025-10-02T08:15:27.368022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.368086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.368093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.368104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.368163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2382 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0
2025-10-02T08:15:27.368480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a083a8f0-5e136e05-66273d32-1bfd0be3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:27.370844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0] Write session: try to update token
2025-10-02T08:15:27.370855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:27.385625Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:27.385645Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:27.385647Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:27.385654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535083678027678:13982]
2025-10-02T08:15:27.385657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535083678027678:13982]
2025-10-02T08:15:27.385698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:27.385700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:27.385703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.385705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:27.385706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:27.385827Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:27.387097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId: src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:27.389650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:27.438239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535083678027708:13279]
2025-10-02T08:15:27.438370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2381, pipe: [1:7556535083678027708:13279]
2025-10-02T08:15:27.521979Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:27.522744Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:27.522343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.522355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.522387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678027708:13279], now have 1 active actors on pipe
2025-10-02T08:15:27.522514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535083678027708:13279]
2025-10-02T08:15:27.522534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:27.522536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:27.522561Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:27.522599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2382 reason: error at write: Disconnected sessionId: src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0
2025-10-02T08:15:27.522748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2382 sessionId: src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0 is DEAD
2025-10-02T08:15:27.522850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:27.522858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0] Write session will restart in 0.008827s
2025-10-02T08:15:27.522878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0] Write session: Do CDS request
2025-10-02T08:15:27.522882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:27.533251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.536150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:27.536164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2383
2025-10-02T08:15:27.536863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.536887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:27.536895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:27.536898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:27.537254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2383 sessionId:  describe result for acl check
2025-10-02T08:15:27.537282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:27.537284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:27.537285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:27.537290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535083678027790:14002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:27.537745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535083678027790:14002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:27.539897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535083678027790:14002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:27.543421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535083678027790:14002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:27.543435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535083678027790:14002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:27.543438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535083678027790:14002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:27.543446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:27.552879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:27.553653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:27.553821Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:27.553831Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:27.553841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:27.553886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:27.553925Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535083678028278:14001]
2025-10-02T08:15:27.554495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:27.554675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:27.554712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:27.555133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:27.555190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.555196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.555198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.555199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.555199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.555204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.555214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.555217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.555220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.555223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.555229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.555236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.555241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.555245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.555249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.555253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.555258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.555262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.555266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.555271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.555289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:27.562976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:27.564390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:27.564407Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:27.564409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:27.564412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:27.564417Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2382 [1:7556535083678028278:14001]
2025-10-02T08:15:27.564426Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:27.564441Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:27.564443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.564445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.564447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.564459Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:27.564463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:27.564469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:27.564516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.564523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.564526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:27.564528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:27.564591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:27.564599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.564608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.564617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:27.564633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535083678028272:14001]
2025-10-02T08:15:27.564635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535083678028272:14001]
2025-10-02T08:15:27.564642Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:27.564655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:27.564661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2382
2025-10-02T08:15:27.564667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:27.564670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:27.564674Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:27.564676Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:27.564679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678028017:14002], now have 1 active actors on pipe
2025-10-02T08:15:27.564709Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535083678028272:14001]
2025-10-02T08:15:27.564711Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:27.564716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535084137465476:2378], now have 1 active actors on pipe
2025-10-02T08:15:27.564719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.564721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.564753Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:27.564757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.564760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.564762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:27.564769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.564776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:27.564789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.564845Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:27.564920Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2382
2025-10-02T08:15:27.564956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.564970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.564995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.565060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2383 partition: 0 MaxSeqNo: 17 sessionId: src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0
2025-10-02T08:15:27.565385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab1b172-bd8a475d-b430a7a-aaeac154_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:27.568054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0] Write session: try to update token
2025-10-02T08:15:27.568069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:27.582507Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:27.582585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId: src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:27.582820Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:27.582832Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:27.582841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535083678028272:14001]
2025-10-02T08:15:27.582846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535083678028272:14001]
2025-10-02T08:15:27.582894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:27.582908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.582910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:27.582979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:27.582991Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:27.583054Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:27.585209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:27.622476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535083678028302:13279]
2025-10-02T08:15:27.622600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2382, pipe: [1:7556535083678028302:13279]
2025-10-02T08:15:27.729062Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:27.729500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.729529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.729568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678028302:13279], now have 1 active actors on pipe
2025-10-02T08:15:27.729679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:27.729685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:27.729733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2383 reason: error at write: Disconnected sessionId: src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0
2025-10-02T08:15:27.729800Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:27.729812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:27.729898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2383 sessionId: src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0 is DEAD
2025-10-02T08:15:27.730028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:27.730037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0] Write session will restart in 0.007584s
2025-10-02T08:15:27.730059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0] Write session: Do CDS request
2025-10-02T08:15:27.730049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535083678028302:13279]
2025-10-02T08:15:27.730078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:27.741243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.741313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:27.741329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2384
2025-10-02T08:15:27.741455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.741483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:27.741488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:27.741491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:27.741985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2384 sessionId:  describe result for acl check
2025-10-02T08:15:27.742019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:27.742021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:27.742022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:27.742028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535083678028770:14008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:27.742501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535083678028770:14008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:27.744132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:27.744900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535083678028770:14008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:27.745595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:27.745749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:27.745758Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:27.745768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:27.745812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:27.745843Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535083678028836:14007]
2025-10-02T08:15:27.746397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:27.746558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:27.746596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:27.746874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:27.746927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.746933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.746934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.746935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.746936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.746941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.746949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.746953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.746956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.746960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.746965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.746971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.746976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.746981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.746986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.746990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.746994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.746999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.747008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.747012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.747028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:27.747572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535083678028770:14008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:27.747585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535083678028770:14008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:27.747588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535083678028770:14008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:27.747594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:27.754784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:27.756678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:27.756693Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:27.756695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:27.756699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:27.756705Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2383 [1:7556535083678028836:14007]
2025-10-02T08:15:27.756718Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:27.756735Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:27.756744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.756747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.756749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.756763Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:27.756772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:27.756778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:27.756855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.756862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.756865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:27.756867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:27.756923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:27.756935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.756946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.756959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:27.756976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678028853:14008], now have 1 active actors on pipe
2025-10-02T08:15:27.756983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535084137465483:2378], now have 1 active actors on pipe
2025-10-02T08:15:27.756989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535083678028820:14007]
2025-10-02T08:15:27.756992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535083678028820:14007]
2025-10-02T08:15:27.757002Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:27.757010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2383
2025-10-02T08:15:27.757013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:27.757025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:27.757028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:27.757057Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535083678028820:14007]
2025-10-02T08:15:27.757059Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:27.757078Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:27.757085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:27.757090Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:27.757099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.757107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.757130Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:27.757140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.757144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.757150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:27.757158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.757170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:27.757186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.757223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.757229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.757241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.757272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2384 partition: 0 MaxSeqNo: 17 sessionId: src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0
2025-10-02T08:15:27.757338Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2383
2025-10-02T08:15:27.757585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fde72e2-93995ffd-b8f7c70e-b86f024c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:27.760094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0] Write session: try to update token
2025-10-02T08:15:27.760110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:27.767905Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:27.767927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:27.767936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535083678028820:14007]
2025-10-02T08:15:27.767976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:27.768023Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:27.768140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:27.768288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:27.768418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:27.768553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:27.768739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:27.768774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:27.773910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId: src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:27.776591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:27.776689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.776705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.776738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:27.776765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:27.776849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.776857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.777021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.777080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.777158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.777229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.777325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.777330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.777402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.777458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.777520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.777589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.777644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.777653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.777722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.777784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.777847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.777913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.777965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.777972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.778045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.778113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.778177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.778247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.778314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.778322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.778427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.778493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.778563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.778632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.778679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.778689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.778755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.778816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.778877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.778942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.778982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.778985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.779052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.779113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.779176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.779237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.779279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.779282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.779355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.779426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.779488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.779558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.779604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.779607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.779675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.779736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.779798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.779857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.779901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.779906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.779976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.780041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.780101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.780178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.780230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.780232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.780271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:27.780334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.780357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.780359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:27.780387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:27.780408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:27.780411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:27.780415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:27.780417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:27.780832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:27.780857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:27.780863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:27.780867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:27.780869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:27.780872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:27.781566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:27.781592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:27.781599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:27.781602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:27.781606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:27.781611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:27.782155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:27.782169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:27.782174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:27.782178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:27.782181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:27.783457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:27.783478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:27.783491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392927783
2025-10-02T08:15:27.783635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:27.783651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:27.783656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:27.783658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:27.783662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:27.783664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:27.784188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:27.784213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:27.784219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:27.784222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:27.784228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:27.784232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:27.784707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:27.784730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:27.784740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:27.784743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:27.784746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:27.784749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:27.785239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:27.785253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:27.785258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:27.786493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:27.786507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:27.786512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:27.786517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:27.786524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392927786
2025-10-02T08:15:27.786818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:27.786840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:27.786846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:27.786852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:27.786855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:27.786859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:27.787342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:27.787370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:27.787378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:27.787387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:27.787391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:27.787396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:27.787863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:27.787883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.787972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392927787
2025-10-02T08:15:27.788722Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:27.788746Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:27.788752Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:27.788758Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:27.790448Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:27.790463Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:27.790465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:27.790478Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535083678028820:14007]
2025-10-02T08:15:27.790481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535083678028820:14007]
2025-10-02T08:15:27.790535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:27.790543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.790545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:27.790576Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:27.790592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:27.790672Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:27.830373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535083678028888:13279]
2025-10-02T08:15:27.830494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2383, pipe: [1:7556535083678028888:13279]
2025-10-02T08:15:27.922398Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:27.922695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678028888:13279], now have 1 active actors on pipe
2025-10-02T08:15:27.922794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:27.922802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:27.922826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2384 reason: error at write: Disconnected sessionId: src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0
2025-10-02T08:15:27.922884Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:27.922932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:27.923128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:27.923139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0] Write session will restart in 0.009150s
2025-10-02T08:15:27.923163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0] Write session: Do CDS request
2025-10-02T08:15:27.923170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:27.922983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2384 sessionId: src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0 is DEAD
2025-10-02T08:15:27.923159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535083678028888:13279]
2025-10-02T08:15:27.933151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.933276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:27.933292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2385
2025-10-02T08:15:27.933405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:27.933443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:27.933450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:27.933454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:27.933872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2385 sessionId:  describe result for acl check
2025-10-02T08:15:27.933901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:27.933906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:27.933907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:27.933910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535083678029324:14015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:27.934300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535083678029324:14015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:27.936761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535083678029324:14015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:27.937126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:27.938415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:27.938810Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:27.938822Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:27.938835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:27.938899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:27.938936Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535083678029417:14014]
2025-10-02T08:15:27.939524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:27.939692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:27.939733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:27.939735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535083678029324:14015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:27.939741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535083678029324:14015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:27.939745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535083678029324:14015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:27.939755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:27.940033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:27.940113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.940114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.940115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.940116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.940117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.940122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.940131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.940134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.940138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.940155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.940161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.940168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:27.940174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.940179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:27.940184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.940189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:27.940194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.940198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.940204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.940209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.940225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:27.948165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:27.949921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:27.949941Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:27.949944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:27.949948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:27.949956Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2384 [1:7556535083678029417:14014]
2025-10-02T08:15:27.949968Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:27.949986Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:27.949989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.949992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.949994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.950008Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:27.950012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:27.950019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:27.950085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.950095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.950098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:27.950100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:27.950162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:27.950171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.950185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:27.950199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:27.950217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535083678029428:14015], now have 1 active actors on pipe
2025-10-02T08:15:27.950226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535083678029403:14014]
2025-10-02T08:15:27.950233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535083678029403:14014]
2025-10-02T08:15:27.950241Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:27.950258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:27.950276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:27.950277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:27.950280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:27.950286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535084137465503:2378], now have 1 active actors on pipe
2025-10-02T08:15:27.950287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:27.950317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535083678029403:14014]
2025-10-02T08:15:27.950325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:27.950328Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:27.950352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2384
2025-10-02T08:15:27.950362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2384
2025-10-02T08:15:27.950366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.950370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.950392Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:27.950398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.950402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.950405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:27.950413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.950421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:27.950435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.950471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.950477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.950504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:27.950557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2385 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0
2025-10-02T08:15:27.950917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b415e5c-e33a4556-5873b1e7-d95a491_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:27.953438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0] Write session: try to update token
2025-10-02T08:15:27.953455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:27.961302Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:27.961323Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:27.961332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535083678029403:14014]
2025-10-02T08:15:27.961373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:27.961373Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:27.961547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:27.961691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:27.961872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:27.962006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:27.962193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:27.962234Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:27.966884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId: src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:27.969518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:27.969578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.969592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.969625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:27.969649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:27.969704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:27.969720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:27.969871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.969928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.969990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.970057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.970101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.970112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.970186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.970253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.970317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.970380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.970420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.970430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.970495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.970552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.970613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.970688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.970736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.970743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.970827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.970893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.970961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.971030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.971081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.971088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.971156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.971220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.971289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.971357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.971403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.971410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.971481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.971552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.971622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.971687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.971740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.971747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.971814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.971875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.971945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.972013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.972058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.972065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.972126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.972195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.972253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.972314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.972356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.972361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.972423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.972480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.972537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.972596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.972637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.972642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.972707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:27.972763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:27.972856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:27.972916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:27.972959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:27.972968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:27.973011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:27.973068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:27.973092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:27.973098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:27.973131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:27.973153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:27.973156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:27.973159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:27.973164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:27.973588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:27.973618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:27.973627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:27.973630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:27.973633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:27.973636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:27.974426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:27.974454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:27.974461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:27.974464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:27.974468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:27.974471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:27.974961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:27.974985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:27.974991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:27.974995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:27.974998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:27.976278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:27.976294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:27.976310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392927976
2025-10-02T08:15:27.976487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:27.976504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:27.976512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:27.976515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:27.976554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:27.976563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:27.977059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:27.977082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:27.977088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:27.977098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:27.977102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:27.977106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:27.977576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:27.977599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:27.977606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:27.977609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:27.977613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:27.977616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:27.978100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:27.978122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:27.978128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:27.979225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:27.979242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:27.979247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:27.979251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:27.979261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392927978
2025-10-02T08:15:27.979555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:27.979576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:27.979582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:27.979585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:27.979590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:27.979593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:27.980047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:27.980069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:27.980074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:27.980078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:27.980083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:27.980087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:27.980565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:27.980587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:27.980695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392927980
2025-10-02T08:15:27.981444Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:27.981461Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:27.981468Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:27.981474Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:27.982936Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:27.982947Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:27.982948Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:27.982955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535083678029403:14014]
2025-10-02T08:15:27.982957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535083678029403:14014]
2025-10-02T08:15:27.983002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:27.983009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:27.983010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:27.983009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:27.983014Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:27.983128Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:28.023675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535087972996751:13279]
2025-10-02T08:15:28.025384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2384, pipe: [1:7556535087972996751:13279]
2025-10-02T08:15:28.122288Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:28.122643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972996751:13279], now have 1 active actors on pipe
2025-10-02T08:15:28.122826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535087972996751:13279]
2025-10-02T08:15:28.122848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:28.122850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:28.122873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2385 reason: error at write: Disconnected sessionId: src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0
2025-10-02T08:15:28.122877Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:28.122879Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:28.123035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2385 sessionId: src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0 is DEAD
2025-10-02T08:15:28.123169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:28.123179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0] Write session will restart in 0.007335s
2025-10-02T08:15:28.123203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0] Write session: Do CDS request
2025-10-02T08:15:28.123210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:28.131295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.131417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:28.131437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2386
2025-10-02T08:15:28.131548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.131582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:28.131592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:28.131595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:28.132611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2386 sessionId:  describe result for acl check
2025-10-02T08:15:28.132671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:28.132677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:28.132679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:28.132685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535087972996949:14022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:28.133234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535087972996949:14022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:28.135632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535087972996949:14022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:28.138397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535087972996949:14022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:28.138411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535087972996949:14022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:28.138414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535087972996949:14022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:28.138422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:28.152285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:28.153784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:28.154016Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:28.154026Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:28.154036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:28.154088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:28.154120Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535087972997290:14021]
2025-10-02T08:15:28.154713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:28.155017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:28.155050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:28.155320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:28.155361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.155362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.155363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.155364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.155365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.155369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.155378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.155381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.155384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.155387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.155393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.155412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.155417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.155421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.155424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.155428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.155432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.155436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.155440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.155444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.155459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:28.163448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:28.165041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:28.165054Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:28.165056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:28.165059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:28.165063Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2385 [1:7556535087972997290:14021]
2025-10-02T08:15:28.165070Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:28.165083Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:28.165085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.165087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.165089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.165100Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:28.165105Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:28.165110Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:28.165157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.165163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.165165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:28.165166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:28.165214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:28.165219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.165228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.165235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:28.165253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535087972997283:14021]
2025-10-02T08:15:28.165259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535087972997283:14021]
2025-10-02T08:15:28.165266Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:28.165277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:28.165284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:28.165287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:28.165288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:28.165290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:28.165296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972997097:14022], now have 1 active actors on pipe
2025-10-02T08:15:28.165299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2385
2025-10-02T08:15:28.165321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535087972997283:14021]
2025-10-02T08:15:28.165329Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:28.165334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.165336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:28.165336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.165347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535088432432805:2378], now have 1 active actors on pipe
2025-10-02T08:15:28.165372Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7256b96a-601bd724-d5fe88d4-ff820099_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:28.165379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.165385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.165386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:28.165392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.165403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:28.165418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.165378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2385
2025-10-02T08:15:28.165461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.165466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.165475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.165503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2386 partition: 0 MaxSeqNo: 17 sessionId: src_id|7256b96a-601bd724-d5fe88d4-ff820099_0
2025-10-02T08:15:28.165792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad2f2f0-2a15d22f-29290ddf-db5118f6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7256b96a-601bd724-d5fe88d4-ff820099_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:28.168291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7256b96a-601bd724-d5fe88d4-ff820099_0] Write session: try to update token
2025-10-02T08:15:28.168305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7256b96a-601bd724-d5fe88d4-ff820099_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:28.181058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId: src_id|7256b96a-601bd724-d5fe88d4-ff820099_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:28.182778Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:28.182796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:28.182798Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:28.182807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535087972997283:14021]
2025-10-02T08:15:28.182811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535087972997283:14021]
2025-10-02T08:15:28.182856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:28.182856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:28.182861Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:28.182864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.182866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:28.183008Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:28.183791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:28.222528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535087972997314:13279]
2025-10-02T08:15:28.222671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2385, pipe: [1:7556535087972997314:13279]
2025-10-02T08:15:28.314217Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:28.314518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.314526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.314575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972997314:13279], now have 1 active actors on pipe
2025-10-02T08:15:28.314711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:28.314720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:28.314786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2386 reason: error at write: Disconnected sessionId: src_id|7256b96a-601bd724-d5fe88d4-ff820099_0
2025-10-02T08:15:28.314956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2386 sessionId: src_id|7256b96a-601bd724-d5fe88d4-ff820099_0 is DEAD
2025-10-02T08:15:28.315100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535087972997314:13279]
2025-10-02T08:15:28.315272Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:28.314876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:28.315926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7256b96a-601bd724-d5fe88d4-ff820099_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:28.315937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7256b96a-601bd724-d5fe88d4-ff820099_0] Write session will restart in 0.007641s
2025-10-02T08:15:28.315963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7256b96a-601bd724-d5fe88d4-ff820099_0] Write session: Do CDS request
2025-10-02T08:15:28.315969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7256b96a-601bd724-d5fe88d4-ff820099_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:28.325263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7256b96a-601bd724-d5fe88d4-ff820099_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.329140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:28.329156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2387
2025-10-02T08:15:28.330306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.330357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:28.330368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:28.330372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:28.331029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2387 sessionId:  describe result for acl check
2025-10-02T08:15:28.331066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:28.331068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:28.331070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:28.331075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535087972997567:14028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:28.331636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535087972997567:14028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:28.334996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535087972997567:14028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:28.338305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535087972997567:14028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:28.338320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535087972997567:14028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:28.338323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535087972997567:14028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:28.338330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:28.343355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:28.343855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:28.344020Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:28.344031Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:28.344041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:28.344088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:28.344124Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535087972997853:14027]
2025-10-02T08:15:28.344788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:28.345046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:28.345088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:28.345388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:28.345444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.345450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.345451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.345452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.345453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.345457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.345467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.345470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.345474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.345477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.345482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.345488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.345493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.345498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.345501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.345506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.345510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.345515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.345519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.345524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.345543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:28.354658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:28.356338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:28.356833Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2386
2025-10-02T08:15:28.356364Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:28.356367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:28.356371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:28.356378Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2386 [1:7556535087972997853:14027]
2025-10-02T08:15:28.356389Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:28.356406Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:28.356409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.356412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.356415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.356430Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:28.356435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:28.356441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:28.356507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.356509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.356512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:28.356514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:28.356598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:28.356600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.356617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.356631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:28.356649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972997747:14028], now have 1 active actors on pipe
2025-10-02T08:15:28.356656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535087972997846:14027]
2025-10-02T08:15:28.356658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535087972997846:14027]
2025-10-02T08:15:28.356665Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:28.356674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2386
2025-10-02T08:15:28.356676Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:28.356677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535088432432815:2378], now have 1 active actors on pipe
2025-10-02T08:15:28.356679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:28.356682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:28.356693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:28.356696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:28.356703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.356707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.356749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535087972997846:14027]
2025-10-02T08:15:28.356762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:28.356772Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:28.356777Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|547dce53-7598400c-8137d2f9-fa3377a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:28.356782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.356786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.356789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:28.357044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.357068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:28.357118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.357196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.357204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.357219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.357253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2387 partition: 0 MaxSeqNo: 17 sessionId: src_id|547dce53-7598400c-8137d2f9-fa3377a_0
2025-10-02T08:15:28.361033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7256b96a-601bd724-d5fe88d4-ff820099_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|547dce53-7598400c-8137d2f9-fa3377a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:28.363627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547dce53-7598400c-8137d2f9-fa3377a_0] Write session: try to update token
2025-10-02T08:15:28.363646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547dce53-7598400c-8137d2f9-fa3377a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:28.369638Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:28.369662Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:28.369672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535087972997846:14027]
2025-10-02T08:15:28.369712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:28.369888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:28.370027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:28.370170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:28.370309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:28.370504Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:28.370539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:28.370851Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:28.380710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId: src_id|547dce53-7598400c-8137d2f9-fa3377a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:28.383273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:28.383481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.383495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.383527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:28.383545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:28.383598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.383600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.383759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.383815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.383874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.383936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.383977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.383981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.384051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.384107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.384179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.384252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.384291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.384294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.384359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.384419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.384479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.384542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.384582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.384585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.384656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.384720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.384775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.384857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.384900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.384902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.384968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.385024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.385087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.385150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.385192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.385194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.385261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.385319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.385377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.385437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.385478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.385481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.385547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.385602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.385662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.385720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.385777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.385780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.385846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.385922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.385981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.386039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.386079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.386081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.386148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.386208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.386267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.386327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.386367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.386370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.386437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:28.386492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:28.386549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:28.386610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:28.386649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:28.386652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:28.386687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:28.386749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.386770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.386773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:28.386801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:28.386813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:28.386817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:28.386819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:28.386823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:28.387210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:28.387225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:28.387230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:28.387233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:28.387236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:28.387239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:28.387899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:28.387911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:28.387918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:28.387921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:28.387924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:28.387927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:28.388571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:28.388591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:28.388597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:28.388600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:28.388605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:28.389862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:28.389885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:28.389897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392928389
2025-10-02T08:15:28.390019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:28.390028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:28.390033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:28.390035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:28.390039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:28.390042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:28.390589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:28.390605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:28.390610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:28.390614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:28.390617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:28.390621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:28.391139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:28.391151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:28.391157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:28.391161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:28.391164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:28.391167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:28.391614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:28.391628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:28.391633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:28.392782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:28.392793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:28.392798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:28.392971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:28.392996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392928392
2025-10-02T08:15:28.393324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:28.393345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:28.393352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:28.393355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:28.393359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:28.393362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:28.393845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:28.393857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:28.393862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:28.393866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:28.393869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:28.393873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:28.394348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:28.394357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.394449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392928393
2025-10-02T08:15:28.395238Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:28.395249Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:28.395266Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:28.395272Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:28.397145Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:28.397158Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:28.397160Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:28.397169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535087972997846:14027]
2025-10-02T08:15:28.397173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535087972997846:14027]
2025-10-02T08:15:28.397228Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:28.397230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:28.397236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.397238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:28.397246Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:28.397373Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:28.415566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535087972997884:13279]
2025-10-02T08:15:28.415700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2386, pipe: [1:7556535087972997884:13279]
2025-10-02T08:15:28.531884Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:28.532219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972997884:13279], now have 1 active actors on pipe
2025-10-02T08:15:28.532350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:28.532353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:28.532375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2387 reason: error at write: Disconnected sessionId: src_id|547dce53-7598400c-8137d2f9-fa3377a_0
2025-10-02T08:15:28.532436Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:28.532527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2387 sessionId: src_id|547dce53-7598400c-8137d2f9-fa3377a_0 is DEAD
2025-10-02T08:15:28.532660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535087972997884:13279]
2025-10-02T08:15:28.532886Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:28.533072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547dce53-7598400c-8137d2f9-fa3377a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:28.533083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547dce53-7598400c-8137d2f9-fa3377a_0] Write session will restart in 0.006335s
2025-10-02T08:15:28.533104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547dce53-7598400c-8137d2f9-fa3377a_0] Write session: Do CDS request
2025-10-02T08:15:28.533110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547dce53-7598400c-8137d2f9-fa3377a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:28.541307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547dce53-7598400c-8137d2f9-fa3377a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.541653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:28.541668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2388
2025-10-02T08:15:28.541802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.541847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:28.541858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:28.541861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:28.542285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2388 sessionId:  describe result for acl check
2025-10-02T08:15:28.542313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:28.542315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:28.542317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:28.542321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535087972997951:14047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:28.542792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535087972997951:14047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:28.545801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535087972997951:14047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:28.549041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535087972997951:14047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:28.549068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535087972997951:14047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:28.549071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535087972997951:14047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:28.549081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:28.557191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:28.559200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:28.559418Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:28.559429Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:28.559441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:28.559506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:28.559557Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535087972998464:14046]
2025-10-02T08:15:28.560313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:28.560674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:28.560724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:28.561080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:28.561148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.561154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.561155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.561157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.561158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.561163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.561174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.561178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.561187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.561192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.561198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.561207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.561214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.561220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.561228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.561233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.561244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.561250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.561259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.561264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.561285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:28.570815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:28.573234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:28.573259Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:28.573262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:28.573266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:28.573273Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2387 [1:7556535087972998464:14046]
2025-10-02T08:15:28.573288Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:28.573309Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:28.573313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.573316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.573318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.573338Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:28.573349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:28.573358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:28.573449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.573460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.573464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:28.573468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:28.573548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:28.573557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.573573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.573587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:28.573600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2387
2025-10-02T08:15:28.573614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972998262:14047], now have 1 active actors on pipe
2025-10-02T08:15:28.573617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535088432432835:2378], now have 1 active actors on pipe
2025-10-02T08:15:28.573624Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535087972998458:14046]
2025-10-02T08:15:28.573633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535087972998458:14046]
2025-10-02T08:15:28.573647Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:28.573660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:28.573662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.573668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.573672Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:28.573689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:28.573709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:28.573717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:28.573767Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:28.573779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.573789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.573795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:28.573806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.573819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:28.573831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535087972998458:14046]
2025-10-02T08:15:28.573845Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:28.573868Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:28.573876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.573916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.573924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.573938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.573979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2388 partition: 0 MaxSeqNo: 17 sessionId: src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0
2025-10-02T08:15:28.574427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547dce53-7598400c-8137d2f9-fa3377a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:28.577007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2387
2025-10-02T08:15:28.577724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0] Write session: try to update token
2025-10-02T08:15:28.577741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:28.586769Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:28.586792Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:28.586801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535087972998458:14046]
2025-10-02T08:15:28.586848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:28.586856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:28.587027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:28.587171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:28.587304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:28.587433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:28.587614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:28.587665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:28.604263Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:28.604283Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:28.604286Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:28.604295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535087972998458:14046]
2025-10-02T08:15:28.604300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535087972998458:14046]
2025-10-02T08:15:28.604346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:28.604351Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:28.604354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.604357Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:28.604357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:28.604486Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:28.611936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId: src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:28.614566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:28.632893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535087972998488:13279]
2025-10-02T08:15:28.633160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2387, pipe: [1:7556535087972998488:13279]
2025-10-02T08:15:28.751215Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:28.751647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.751662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.751681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972998488:13279], now have 1 active actors on pipe
2025-10-02T08:15:28.751776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:28.751787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:28.751839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2388 reason: error at write: Disconnected sessionId: src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0
2025-10-02T08:15:28.751881Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:28.751982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2388 sessionId: src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0 is DEAD
2025-10-02T08:15:28.751930Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:28.752113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535087972998488:13279]
2025-10-02T08:15:28.752210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:28.752218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0] Write session will restart in 0.005552s
2025-10-02T08:15:28.752236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0] Write session: Do CDS request
2025-10-02T08:15:28.752241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:28.759274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.759326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:28.759343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2389
2025-10-02T08:15:28.759510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.759541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:28.759549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:28.759553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:28.759965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2389 sessionId:  describe result for acl check
2025-10-02T08:15:28.760008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:28.760015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:28.760016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:28.760021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535087972998789:14053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:28.760548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535087972998789:14053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:28.762937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535087972998789:14053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:28.766171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535087972998789:14053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:28.766185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535087972998789:14053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:28.766189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535087972998789:14053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:28.766211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:28.766650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:28.767774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:28.767928Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:28.767938Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:28.767947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:28.767992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:28.768026Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535087972999035:14052]
2025-10-02T08:15:28.768647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:28.768850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:28.768890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:28.769178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:28.769214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.769219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.769221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.769222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.769223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.769228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.769237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.769240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.769244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.769247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.769252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.769264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.769273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.769282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.769290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.769300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.769308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.769317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.769325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.769333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.769354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:28.776773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:28.778190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:28.778210Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:28.778212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:28.778216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:28.778221Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2388 [1:7556535087972999035:14052]
2025-10-02T08:15:28.778233Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:28.778247Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:28.778251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.778254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.778255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.778269Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:28.778273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:28.778280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:28.778333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.778342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.778344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:28.778347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:28.778408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:28.778415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.778427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.778444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:28.778454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2388
2025-10-02T08:15:28.778465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972999026:14053], now have 1 active actors on pipe
2025-10-02T08:15:28.778473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535088432432851:2378], now have 1 active actors on pipe
2025-10-02T08:15:28.778478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.778482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.778502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535087972999029:14052]
2025-10-02T08:15:28.778508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535087972999029:14052]
2025-10-02T08:15:28.778523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:28.778539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:28.778553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:28.778558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:28.778560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:28.778565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:28.778574Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:28.778540Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2388
2025-10-02T08:15:28.778580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.778587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.778590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:28.778598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.778609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:28.778644Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535087972999029:14052]
2025-10-02T08:15:28.778655Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:28.778670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.778670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:28.778743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.778750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.778763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.778800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2389 partition: 0 MaxSeqNo: 17 sessionId: src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0
2025-10-02T08:15:28.779108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6836fe-d80e84e3-78685f8-b2b4dd24_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:28.781710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0] Write session: try to update token
2025-10-02T08:15:28.781724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:28.795508Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:28.795532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:28.795534Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:28.795543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535087972999029:14052]
2025-10-02T08:15:28.795551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535087972999029:14052]
2025-10-02T08:15:28.795590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:28.795596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.795600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:28.795660Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:28.795673Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:28.795703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId: src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:28.795721Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:28.798248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:28.852314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535087972999074:13279]
2025-10-02T08:15:28.852447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2388, pipe: [1:7556535087972999074:13279]
2025-10-02T08:15:28.941518Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:28.942066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.942080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.942118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972999074:13279], now have 1 active actors on pipe
2025-10-02T08:15:28.942228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:28.942241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:28.942301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2389 reason: error at write: Disconnected sessionId: src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0
2025-10-02T08:15:28.942325Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:28.942361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:28.942481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2389 sessionId: src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0 is DEAD
2025-10-02T08:15:28.942620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:28.942628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0] Write session will restart in 0.009982s
2025-10-02T08:15:28.942650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0] Write session: Do CDS request
2025-10-02T08:15:28.942657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:28.942741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535087972999074:13279]
2025-10-02T08:15:28.953249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.953316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:28.953334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2390
2025-10-02T08:15:28.953470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:28.953501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:28.953510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:28.953514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:28.954873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2390 sessionId:  describe result for acl check
2025-10-02T08:15:28.954908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:28.954910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:28.954911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:28.954918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535087972999351:14060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:28.955402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535087972999351:14060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:28.958979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535087972999351:14060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:28.969056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535087972999351:14060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:28.969076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535087972999351:14060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:28.969078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535087972999351:14060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:28.969087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:28.977285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:28.978538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:28.978718Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:28.978731Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:28.978741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:28.978797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:28.978834Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535087972999620:14059]
2025-10-02T08:15:28.979439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:28.979639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:28.979683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:28.979968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:28.980024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.980030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.980031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.980032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.980033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.980038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.980048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.980056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.980059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.980062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.980068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.980075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:28.980085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.980095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:28.980103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.980113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:28.980121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.980130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.980149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.980159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.980183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:28.988402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:28.989963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:28.989980Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:28.989982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:28.989985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:28.989991Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2389 [1:7556535087972999620:14059]
2025-10-02T08:15:28.990003Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:28.990019Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:28.990022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.990025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.990028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.990043Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:28.990053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:28.990059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:28.990133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.990141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.990144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:28.990147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:28.990210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:28.990217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:28.990228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:28.990240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:28.990257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535087972999450:14060], now have 1 active actors on pipe
2025-10-02T08:15:28.990261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2389
2025-10-02T08:15:28.990268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535087972999614:14059]
2025-10-02T08:15:28.990270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535087972999614:14059]
2025-10-02T08:15:28.990283Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:28.990297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535088432432872:2378], now have 1 active actors on pipe
2025-10-02T08:15:28.990308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.990316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.990331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:28.990349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:28.990356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:28.990371Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:28.990384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:28.990397Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:28.990405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:28.990408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:28.990410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:28.990419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:28.990427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:28.990433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535087972999614:14059]
2025-10-02T08:15:28.990391Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2389
2025-10-02T08:15:28.990441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:28.990447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:28.990467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.990522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:28.990532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:28.990544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:28.990581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2390 partition: 0 MaxSeqNo: 17 sessionId: src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0
2025-10-02T08:15:28.990888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d2b43b-76a7622d-e20baf52-95beaf24_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:28.993526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0] Write session: try to update token
2025-10-02T08:15:28.993541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:29.007048Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:29.007071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:29.007074Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:29.007083Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535087972999614:14059]
2025-10-02T08:15:29.007088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535087972999614:14059]
2025-10-02T08:15:29.007129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:29.007136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.007138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:29.007268Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:29.008118Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:29.008133Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:29.014123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId: src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:29.016827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:29.042782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535092267966942:13279]
2025-10-02T08:15:29.042925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2389, pipe: [1:7556535092267966942:13279]
2025-10-02T08:15:29.144448Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:29.144963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.144975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.145008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267966942:13279], now have 1 active actors on pipe
2025-10-02T08:15:29.145264Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:29.145560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:29.145567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0] Write session will restart in 0.007360s
2025-10-02T08:15:29.145591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0] Write session: Do CDS request
2025-10-02T08:15:29.145598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:29.145133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535092267966942:13279]
2025-10-02T08:15:29.145164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:29.145166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:29.145185Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:29.145242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2390 reason: error at write: Disconnected sessionId: src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0
2025-10-02T08:15:29.145425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2390 sessionId: src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0 is DEAD
2025-10-02T08:15:29.154229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.154386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:29.154404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2391
2025-10-02T08:15:29.154502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.154535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:29.154541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:29.154544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:29.154940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2391 sessionId:  describe result for acl check
2025-10-02T08:15:29.154976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:29.154983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:29.154984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:29.154989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535092267967252:14067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:29.155503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535092267967252:14067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:29.158518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535092267967252:14067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:29.162328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535092267967252:14067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:29.162343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535092267967252:14067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:29.162347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535092267967252:14067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:29.162355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:29.163435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:29.164993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:29.165178Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:29.165190Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:29.165200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:29.165265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:29.165301Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535092267967491:14066]
2025-10-02T08:15:29.165873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:29.166101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:29.166152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:29.166475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:29.166546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.166553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.166554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.166555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.166556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.166562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.166572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.166576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.166580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.166583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.166589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.166596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.166601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.166606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.166611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.166616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.166619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.166624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.166635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.166639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.166656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:29.180067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:29.182091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:29.182113Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:29.182116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:29.182120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:29.182127Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2390 [1:7556535092267967491:14066]
2025-10-02T08:15:29.182139Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:29.182156Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:29.182159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.182163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.182165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.182180Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:29.182185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:29.182191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:29.182251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.182254Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.182257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:29.182259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:29.182340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:29.182342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.182357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.182368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:29.182385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535092267967485:14066]
2025-10-02T08:15:29.182387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535092267967485:14066]
2025-10-02T08:15:29.182396Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:29.182408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267967470:14067], now have 1 active actors on pipe
2025-10-02T08:15:29.182409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:29.182413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:29.182415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:29.182427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:29.182430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:29.182435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535092727400176:2378], now have 1 active actors on pipe
2025-10-02T08:15:29.182467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535092267967485:14066]
2025-10-02T08:15:29.182479Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:29.182488Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:29.182530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2390
2025-10-02T08:15:29.182546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.182550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.182574Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:29.182585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.182589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.182595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:29.182604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.182619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:29.182639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.182664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.182671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.182684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.182722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2391 partition: 0 MaxSeqNo: 17 sessionId: src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0
2025-10-02T08:15:29.182816Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2390
2025-10-02T08:15:29.183636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc57ac-cf89872e-f6e1d3a7-7961a7cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:29.186225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0] Write session: try to update token
2025-10-02T08:15:29.186240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:29.200431Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:29.200453Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:29.200455Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:29.200461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535092267967485:14066]
2025-10-02T08:15:29.200464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535092267967485:14066]
2025-10-02T08:15:29.200505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:29.200511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.200513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:29.200522Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:29.200528Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:29.200644Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:29.206149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId: src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:29.208748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:29.246364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535092267967516:13279]
2025-10-02T08:15:29.246670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2390, pipe: [1:7556535092267967516:13279]
2025-10-02T08:15:29.344489Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:29.344946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.344962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.345004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267967516:13279], now have 1 active actors on pipe
2025-10-02T08:15:29.345223Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:29.345550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535092267967516:13279]
2025-10-02T08:15:29.345577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:29.345625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2391 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0
2025-10-02T08:15:29.345778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2391 sessionId: src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0 is DEAD
2025-10-02T08:15:29.346065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:29.346076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0] Write session will restart in 0.006138s
2025-10-02T08:15:29.346099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0] Write session: Do CDS request
2025-10-02T08:15:29.346105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:29.346630Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:29.353657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.353704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:29.353720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2392
2025-10-02T08:15:29.353864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.353888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:29.353893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:29.353896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:29.354254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2392 sessionId:  describe result for acl check
2025-10-02T08:15:29.354277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:29.354279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:29.354280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:29.354284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535092267967788:14073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:29.354756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535092267967788:14073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:29.359922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535092267967788:14073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:29.362462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535092267967788:14073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:29.362478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535092267967788:14073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:29.362482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535092267967788:14073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:29.362490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:29.375708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:29.376241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:29.376416Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:29.376419Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:29.376428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:29.376469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:29.376509Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535092267968066:14072]
2025-10-02T08:15:29.377169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:29.377434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:29.377472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:29.377769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:29.377804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.377805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.377806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.377807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.377808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.377813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.377823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.377827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.377830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.377834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.377840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.377847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.377854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.377859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.377864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.377868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.377872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.377878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.377882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.377888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.377907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:29.388714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:29.390585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:29.390590Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:29.390591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:29.390594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:29.390599Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2391 [1:7556535092267968066:14072]
2025-10-02T08:15:29.390607Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:29.390620Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:29.390623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.390625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.390626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.390638Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:29.390641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:29.390646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:29.390696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.390697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.390700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:29.390701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:29.390755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:29.390757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.390765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.390772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:29.390783Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535092267968060:14072]
2025-10-02T08:15:29.390784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535092267968060:14072]
2025-10-02T08:15:29.390796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:29.390806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:29.390813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:29.390815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:29.390845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535092267968060:14072]
2025-10-02T08:15:29.390848Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:29.390867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:29.390871Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:29.390878Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:29.391378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2391
2025-10-02T08:15:29.391401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267967854:14073], now have 1 active actors on pipe
2025-10-02T08:15:29.391406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535092727400185:2378], now have 1 active actors on pipe
2025-10-02T08:15:29.391416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.391421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.391448Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:29.391461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.391481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.391488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:29.391500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.391516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:29.391536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.391591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.391598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.391610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.391652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2392 partition: 0 MaxSeqNo: 17 sessionId: src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0
2025-10-02T08:15:29.392914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2391
2025-10-02T08:15:29.393970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59763fad-a07a8e6-d4c0e029-c1809da7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:29.396524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0] Write session: try to update token
2025-10-02T08:15:29.396541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:29.412706Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:29.412726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:29.412729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:29.412738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535092267968060:14072]
2025-10-02T08:15:29.412741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535092267968060:14072]
2025-10-02T08:15:29.412786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:29.412794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.412796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:29.413052Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:29.416971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:29.416988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:29.419132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId: src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:29.421911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:29.449045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535092267968090:13279]
2025-10-02T08:15:29.453062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2391, pipe: [1:7556535092267968090:13279]
2025-10-02T08:15:29.553248Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:29.554000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.554007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.554043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267968090:13279], now have 1 active actors on pipe
2025-10-02T08:15:29.556839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:29.557069Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:29.557476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535092267968090:13279]
2025-10-02T08:15:29.557494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:29.557540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2392 reason: status is not ok: tablet will be restarted right now sessionId: src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0
2025-10-02T08:15:29.557660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2392 sessionId: src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0 is DEAD
2025-10-02T08:15:29.560973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:29.560985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0] Write session will restart in 0.006762s
2025-10-02T08:15:29.561012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0] Write session: Do CDS request
2025-10-02T08:15:29.561018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:29.573209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.573480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:29.573500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2393
2025-10-02T08:15:29.573645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.573684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:29.573693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:29.573696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:29.574068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2393 sessionId:  describe result for acl check
2025-10-02T08:15:29.574101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:29.574108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:29.574110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:29.574114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535092267968384:14088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:29.574563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535092267968384:14088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:29.577842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535092267968384:14088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:29.582288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535092267968384:14088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:29.582307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535092267968384:14088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:29.582310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535092267968384:14088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:29.582317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:29.586403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:29.588651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:29.588836Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:29.588844Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:29.588854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:29.588901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:29.588947Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535092267968683:14087]
2025-10-02T08:15:29.589550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:29.589757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:29.589797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:29.590079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:29.590129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.590135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.590136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.590137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.590138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.590142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.590152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.590156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.590159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.590163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.590167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.590174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.590180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.590185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.590189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.590193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.590197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.590202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.590206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.590216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.590233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:29.598009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:29.599550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:29.599567Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:29.599569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:29.599573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:29.599580Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2392 [1:7556535092267968683:14087]
2025-10-02T08:15:29.599590Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:29.599607Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:29.599610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.599613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.599615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.599629Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:29.599634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:29.599640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:29.599697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.599704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.599707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:29.599710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:29.599759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:29.599766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.599779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.599791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:29.599809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267968620:14088], now have 1 active actors on pipe
2025-10-02T08:15:29.599814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2392
2025-10-02T08:15:29.599816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535092267968677:14087]
2025-10-02T08:15:29.599818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535092267968677:14087]
2025-10-02T08:15:29.599826Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:29.599835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:29.599837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:29.599840Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:29.599843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:29.599845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:29.599850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535092727400204:2378], now have 1 active actors on pipe
2025-10-02T08:15:29.599854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.599858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.599897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535092267968677:14087]
2025-10-02T08:15:29.599908Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:29.599918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:29.599918Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:29.599922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.599925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.599926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:29.599932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.599939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:29.599964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.599960Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2392
2025-10-02T08:15:29.600012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.600025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.600053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.600095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2393 partition: 0 MaxSeqNo: 17 sessionId: src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0
2025-10-02T08:15:29.600375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36de3184-5bb2701e-6441edbb-b94cb57a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:29.602986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0] Write session: try to update token
2025-10-02T08:15:29.603001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:29.611170Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:29.611188Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:29.611197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535092267968677:14087]
2025-10-02T08:15:29.611234Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:29.611238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:29.611434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:29.611589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:29.611759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:29.611893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:29.612089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:29.612127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:29.616071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId: src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:29.618594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:29.618649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.618661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.618693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:29.618717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:29.618765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.618782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.618962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.619043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.619111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.619190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.619238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.619247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.619318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.619383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.619443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.619509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.619554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.619560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.619626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.619686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.619754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.619820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.619866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.619869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.619941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.620012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.620084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.620160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.620208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.620216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.620283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.620347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.620412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.620478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.620523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.620530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.620599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.620663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.620729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.620817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.620875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.620883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.620949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.621014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.621106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.621177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.621217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.621225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.621294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.621360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.621431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.621500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.621542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.621550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.621618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.621683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.621748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.621816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.621863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.621870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.621937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:29.622000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:29.622065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:29.622134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:29.622174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:29.622182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:29.622220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:29.622287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.622310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.622313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:29.622344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:29.622358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:29.622361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:29.622363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:29.622365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:29.622765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:29.622798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:29.622810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:29.622812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:29.622815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:29.622817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:29.623348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:29.623373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:29.623383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:29.623386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:29.623389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:29.623393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:29.623924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:29.623954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:29.623964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:29.623971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:29.623978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:29.625399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:29.625417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:29.625431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392929625
2025-10-02T08:15:29.625555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:29.625567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:29.625571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:29.625573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:29.625575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:29.625579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:29.626046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:29.626065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:29.626069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:29.626072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:29.626074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:29.626076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:29.626570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:29.626601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:29.626613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:29.626618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:29.626623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:29.626627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:29.627148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:29.627175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:29.627180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:29.628369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:29.628391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:29.628396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:29.628400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:29.628409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392929626
2025-10-02T08:15:29.628746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:29.628774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:29.628784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:29.628788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:29.628795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:29.628799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:29.629427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:29.629467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:29.629472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:29.629480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:29.629483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:29.629486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:29.630001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:29.630028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.630209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392929629
2025-10-02T08:15:29.631030Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:29.631049Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:29.631057Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:29.631064Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:29.632897Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:29.632910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:29.632912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:29.632922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535092267968677:14087]
2025-10-02T08:15:29.632926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535092267968677:14087]
2025-10-02T08:15:29.632976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:29.632988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:29.632988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:29.632993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.632995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:29.633138Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:29.657669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535092267968716:13279]
2025-10-02T08:15:29.657823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2392, pipe: [1:7556535092267968716:13279]
2025-10-02T08:15:29.770176Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:29.770508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267968716:13279], now have 1 active actors on pipe
2025-10-02T08:15:29.770643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535092267968716:13279]
2025-10-02T08:15:29.770665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:29.770671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:29.770693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2393 reason: error at write: Disconnected sessionId: src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0
2025-10-02T08:15:29.770755Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:29.770797Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:29.770876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2393 sessionId: src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0 is DEAD
2025-10-02T08:15:29.771015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:29.771023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0] Write session will restart in 0.006486s
2025-10-02T08:15:29.771042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0] Write session: Do CDS request
2025-10-02T08:15:29.771047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:29.778319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.778390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:29.778417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2394
2025-10-02T08:15:29.778548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.778585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:29.778594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:29.778598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:29.779420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2394 sessionId:  describe result for acl check
2025-10-02T08:15:29.779459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:29.779461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:29.779462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:29.779468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535092267968924:14100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:29.779957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535092267968924:14100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:29.783342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535092267968924:14100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:29.789800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535092267968924:14100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:29.789816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535092267968924:14100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:29.789819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535092267968924:14100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:29.789826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:29.791080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:29.791456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:29.791754Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:29.791763Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:29.791772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:29.791822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:29.791867Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535092267969272:14099]
2025-10-02T08:15:29.792473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:29.792637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:29.792671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:29.792981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:29.793024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.793029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.793031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.793032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.793033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.793037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.793054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.793062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.793066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.793069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.793074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.793081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.793090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.793095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.793103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.793108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.793112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.793117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.793121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.793126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.793143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:29.801196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:29.802671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:29.802689Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:29.802691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:29.802695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:29.802705Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2393 [1:7556535092267969272:14099]
2025-10-02T08:15:29.802716Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:29.802738Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:29.802745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.802748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.802750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.802764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:29.802768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:29.802774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:29.802838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.802845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.802848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:29.802851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:29.802912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:29.802919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.802931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.802943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:29.802964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267969263:14100], now have 1 active actors on pipe
2025-10-02T08:15:29.802967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2393
2025-10-02T08:15:29.802975Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535092267969266:14099]
2025-10-02T08:15:29.802977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535092267969266:14099]
2025-10-02T08:15:29.802988Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:29.802995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535092727400220:2378], now have 1 active actors on pipe
2025-10-02T08:15:29.803002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.803012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.803014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:29.803018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:29.803027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:29.803039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:29.803042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:29.803084Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:29.803095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.803099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.803100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:29.803069Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2393
2025-10-02T08:15:29.803110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.803118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:29.803124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535092267969266:14099]
2025-10-02T08:15:29.803137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:29.803155Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:29.803169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.803245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.803252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.803264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.803296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2394 partition: 0 MaxSeqNo: 17 sessionId: src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0
2025-10-02T08:15:29.803626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df757e70-cdfa3bb7-78385d0c-6b6a805a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:29.806217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0] Write session: try to update token
2025-10-02T08:15:29.806231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:29.820341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId: src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:29.821110Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:29.821126Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:29.821129Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:29.821137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535092267969266:14099]
2025-10-02T08:15:29.821141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535092267969266:14099]
2025-10-02T08:15:29.821177Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:29.821180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:29.821188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.821190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:29.821192Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:29.821321Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:29.823144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:29.870668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535092267969311:13279]
2025-10-02T08:15:29.870830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2393, pipe: [1:7556535092267969311:13279]
2025-10-02T08:15:29.960585Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:29.961126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.961139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.961181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267969311:13279], now have 1 active actors on pipe
2025-10-02T08:15:29.961498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535092267969311:13279]
2025-10-02T08:15:29.961520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:29.961523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:29.961585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2394 reason: error at write: Disconnected sessionId: src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0
2025-10-02T08:15:29.961667Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:29.961750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2394 sessionId: src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0 is DEAD
2025-10-02T08:15:29.961925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:29.961936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0] Write session will restart in 0.005885s
2025-10-02T08:15:29.961961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0] Write session: Do CDS request
2025-10-02T08:15:29.961971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:29.961935Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:29.973190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.973229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:29.973266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2395
2025-10-02T08:15:29.973383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:29.973411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:29.973420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:29.973423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:29.973872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2395 sessionId:  describe result for acl check
2025-10-02T08:15:29.973906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:29.973909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:29.973910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:29.973915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535092267969708:14107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:29.974425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535092267969708:14107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:29.977643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535092267969708:14107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:29.981522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535092267969708:14107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:29.981538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535092267969708:14107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:29.981542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535092267969708:14107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:29.981550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:29.984704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:29.985158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:29.985525Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:29.985529Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:29.985541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:29.985590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:29.985622Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535092267969867:14106]
2025-10-02T08:15:29.986274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:29.986498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:29.986545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:29.986866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:29.986909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.986915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.986916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.986917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.986918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.986924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.986934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.986938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.986941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.986945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.986951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.986965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:29.986970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.986976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:29.986980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.986985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:29.986989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.986994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.986999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.987004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.987022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:29.997487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:29.998958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:29.998977Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:29.998980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:29.998984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:29.998990Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2394 [1:7556535092267969867:14106]
2025-10-02T08:15:29.999002Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:29.999020Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:29.999027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.999031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.999033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.999049Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:29.999059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:29.999065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:29.999129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.999136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.999139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:29.999142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:29.999399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2394
2025-10-02T08:15:29.999205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:29.999215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:29.999228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:29.999240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:29.999258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535092267969846:14107], now have 1 active actors on pipe
2025-10-02T08:15:29.999258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2394
2025-10-02T08:15:29.999261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535092727400241:2378], now have 1 active actors on pipe
2025-10-02T08:15:29.999266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.999270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.999285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535092267969861:14106]
2025-10-02T08:15:29.999287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535092267969861:14106]
2025-10-02T08:15:29.999300Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:29.999311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:29.999318Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:29.999322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:29.999325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:29.999328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:29.999345Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:29.999350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:29.999354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:29.999356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:29.999364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:29.999372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:29.999404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535092267969861:14106]
2025-10-02T08:15:29.999412Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:29.999420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:29.999423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.999579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:29.999586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:29.999607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:29.999641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2395 partition: 0 MaxSeqNo: 17 sessionId: src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0
2025-10-02T08:15:29.999991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae1abde-9ccec0a7-b71b41b8-6dbab261_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:30.002695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0] Write session: try to update token
2025-10-02T08:15:30.002712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:30.017561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId: src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:30.020151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:30.020715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.020742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.020762Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:30.020770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:30.020773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:30.020781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535092267969861:14106]
2025-10-02T08:15:30.020785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535092267969861:14106]
2025-10-02T08:15:30.020840Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:30.020854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:30.020855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:30.020862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.020864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:30.020995Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:30.061637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535096562937189:13279]
2025-10-02T08:15:30.061865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2394, pipe: [1:7556535096562937189:13279]
2025-10-02T08:15:30.175253Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:30.175829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:30.175881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562937189:13279], now have 1 active actors on pipe
2025-10-02T08:15:30.175880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:30.175991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:30.176002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:30.176021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2395 reason: error at write: Disconnected sessionId: src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0
2025-10-02T08:15:30.176119Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:30.176170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2395 sessionId: src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0 is DEAD
2025-10-02T08:15:30.176280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:30.176288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0] Write session will restart in 0.007697s
2025-10-02T08:15:30.176306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0] Write session: Do CDS request
2025-10-02T08:15:30.176311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:30.176343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535096562937189:13279]
2025-10-02T08:15:30.185692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.185763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:30.185781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2396
2025-10-02T08:15:30.185951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.185993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:30.186003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:30.186006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:30.186478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2396 sessionId:  describe result for acl check
2025-10-02T08:15:30.186519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:30.186525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:30.186527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:30.186532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535096562937570:14114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:30.187170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535096562937570:14114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:30.190461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535096562937570:14114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:30.192303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:30.193881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:30.194064Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:30.194075Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:30.194083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:30.194126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:30.194167Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535096562937742:14113]
2025-10-02T08:15:30.194392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535096562937570:14114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:30.194406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535096562937570:14114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:30.194410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535096562937570:14114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:30.194419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:30.194849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:30.195036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:30.195073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:30.195379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:30.195420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.195425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.195426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.195427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.195428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.195433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.195442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.195447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.195450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.195454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.195470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.195482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.195488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.195497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.195501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.195506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.195511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.195521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.195525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.195530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.195552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:30.203765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:30.205422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:30.205442Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:30.205444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:30.205448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:30.205455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2395 [1:7556535096562937742:14113]
2025-10-02T08:15:30.205467Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:30.205482Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:30.205485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.205488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.205490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.205507Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:30.205518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:30.205525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:30.205591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.205599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.205603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:30.205606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:30.205678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:30.205685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.205697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.205861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2395
2025-10-02T08:15:30.205711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:30.205734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562937747:14114], now have 1 active actors on pipe
2025-10-02T08:15:30.205738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535097022367544:2378], now have 1 active actors on pipe
2025-10-02T08:15:30.205744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535096562937736:14113]
2025-10-02T08:15:30.205746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535096562937736:14113]
2025-10-02T08:15:30.205758Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:30.205770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:30.205774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:30.205777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:30.205782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:30.205785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:30.205818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535096562937736:14113]
2025-10-02T08:15:30.205824Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:30.205829Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:30.205865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2395
2025-10-02T08:15:30.205876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.205880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.205902Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:30.206234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.206245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.206247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:30.206259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.206285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:30.206313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:30.206522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.206538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.206563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:30.206609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2396 partition: 0 MaxSeqNo: 17 sessionId: src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0
2025-10-02T08:15:30.208910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7b8-f88dc020-a9e98092-6a812e00_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:30.211722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0] Write session: try to update token
2025-10-02T08:15:30.211738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:30.224671Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:30.224693Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:30.224695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:30.224703Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535096562937736:14113]
2025-10-02T08:15:30.224707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535096562937736:14113]
2025-10-02T08:15:30.224747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:30.224754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.224756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:30.224774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:30.224791Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:30.224907Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:30.228473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId: src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:30.231213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:30.276672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535096562937773:13279]
2025-10-02T08:15:30.276812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2395, pipe: [1:7556535096562937773:13279]
2025-10-02T08:15:30.366840Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:30.367238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.367255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.367294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562937773:13279], now have 1 active actors on pipe
2025-10-02T08:15:30.367408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535096562937773:13279]
2025-10-02T08:15:30.367453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:30.367460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:30.367524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2396 reason: error at write: Disconnected sessionId: src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0
2025-10-02T08:15:30.367539Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:30.367545Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:30.367687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2396 sessionId: src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0 is DEAD
2025-10-02T08:15:30.367895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:30.367912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0] Write session will restart in 0.008549s
2025-10-02T08:15:30.367944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0] Write session: Do CDS request
2025-10-02T08:15:30.367952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:30.377441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.377425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:30.377440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2397
2025-10-02T08:15:30.377729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.377772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:30.377775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:30.377778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:30.378206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2397 sessionId:  describe result for acl check
2025-10-02T08:15:30.378235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:30.378240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:30.378243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:30.378257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535096562938131:14120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:30.378742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535096562938131:14120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:30.381372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535096562938131:14120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:30.384106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535096562938131:14120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:30.384147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535096562938131:14120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:30.384151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535096562938131:14120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:30.384159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:30.385054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:30.386357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:30.386531Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:30.386540Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:30.386549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:30.386588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:30.386623Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535096562938333:14119]
2025-10-02T08:15:30.387245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:30.387421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:30.387455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:30.387723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:30.387757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.387762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.387763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.387765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.387766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.387770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.387779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.387782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.387785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.387789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.387794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.387800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.387809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.387813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.387821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.387825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.387829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.387833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.387841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.387845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.387862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:30.396152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:30.397637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:30.397657Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:30.397660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:30.397662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:30.397669Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2396 [1:7556535096562938333:14119]
2025-10-02T08:15:30.397684Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:30.397702Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:30.397705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.397708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.397711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.397727Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:30.397736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:30.397743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:30.397801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.397808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.397811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:30.397814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:30.397873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:30.397880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.397894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.397909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:30.397929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535096562938327:14119]
2025-10-02T08:15:30.397935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535096562938327:14119]
2025-10-02T08:15:30.397942Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:30.397955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:30.397956Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:30.397960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:30.397978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2396
2025-10-02T08:15:30.397982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:30.397986Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:30.397997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562938315:14120], now have 1 active actors on pipe
2025-10-02T08:15:30.398000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535097022367552:2378], now have 1 active actors on pipe
2025-10-02T08:15:30.398032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.398040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.398055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535096562938327:14119]
2025-10-02T08:15:30.398062Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:30.398064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:30.398030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2396
2025-10-02T08:15:30.398088Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:30.398101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.398107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.398110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:30.398120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.398129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:30.398161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:30.398225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.398231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.398244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:30.398283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2397 partition: 0 MaxSeqNo: 17 sessionId: src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0
2025-10-02T08:15:30.398654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b2a13f-f0195a9a-f7675b7c-efaeede5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:30.401417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0] Write session: try to update token
2025-10-02T08:15:30.401435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:30.415821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId: src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:30.417917Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:30.417943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:30.417946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:30.417955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535096562938327:14119]
2025-10-02T08:15:30.417961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535096562938327:14119]
2025-10-02T08:15:30.418012Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:30.418016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:30.418025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.418027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:30.418028Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:30.418180Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:30.418663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:30.467667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535096562938357:13279]
2025-10-02T08:15:30.467840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2396, pipe: [1:7556535096562938357:13279]
2025-10-02T08:15:30.570409Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:30.571015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.571032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.571083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562938357:13279], now have 1 active actors on pipe
2025-10-02T08:15:30.571345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535096562938357:13279]
2025-10-02T08:15:30.571371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:30.571374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:30.571425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2397 reason: error at write: Disconnected sessionId: src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0
2025-10-02T08:15:30.571433Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:30.571455Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:30.571581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2397 sessionId: src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0 is DEAD
2025-10-02T08:15:30.571730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:30.571741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0] Write session will restart in 0.005169s
2025-10-02T08:15:30.571767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0] Write session: Do CDS request
2025-10-02T08:15:30.571773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:30.578356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.578408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:30.578425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2398
2025-10-02T08:15:30.578608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.578663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:30.578674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:30.578679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:30.579163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2398 sessionId:  describe result for acl check
2025-10-02T08:15:30.579199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:30.579205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:30.579207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:30.579211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535096562938640:14127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:30.579844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535096562938640:14127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:30.583348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535096562938640:14127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:30.588027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:30.589835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:30.590051Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:30.590062Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:30.590073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:30.590129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:30.590166Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535096562938928:14126]
2025-10-02T08:15:30.590792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:30.590998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:30.591051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:30.591391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:30.591446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.591453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.591454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.591455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.591456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.591461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.591470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.591475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.591478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.591482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.591488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.591504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.591515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.591521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.591527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.591532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.591541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.591546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.591550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.591557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.591581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:30.592746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535096562938640:14127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:30.592763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535096562938640:14127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:30.592766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535096562938640:14127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:30.592773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:30.600431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:30.602198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:30.602219Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:30.602221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:30.602225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:30.602231Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2397 [1:7556535096562938928:14126]
2025-10-02T08:15:30.602242Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:30.602258Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:30.602261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.602263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.602266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.602279Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:30.602284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:30.602289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:30.602346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.602354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.602357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:30.602359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:30.602420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:30.602431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.602445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.602457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:30.602474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562938944:14127], now have 1 active actors on pipe
2025-10-02T08:15:30.602488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535096562938922:14126]
2025-10-02T08:15:30.602490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535096562938922:14126]
2025-10-02T08:15:30.602497Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:30.602507Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:30.602510Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:30.602515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:30.602529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:30.602536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:30.602542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535097022367558:2378], now have 1 active actors on pipe
2025-10-02T08:15:30.602570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535096562938922:14126]
2025-10-02T08:15:30.602581Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:30.602587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:30.602628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2397
2025-10-02T08:15:30.602639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.602642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.602668Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd87ce3-f484fe87-2a78506-76d0991c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:30.602678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.602682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.602684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:30.602692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.602705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:30.602722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:30.602756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.602761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.602773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:30.602813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2398 partition: 0 MaxSeqNo: 17 sessionId: src_id|bd87ce3-f484fe87-2a78506-76d0991c_0
2025-10-02T08:15:30.603178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73d5ff8-b6d4252c-315aba52-29be0cc1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bd87ce3-f484fe87-2a78506-76d0991c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:30.605603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd87ce3-f484fe87-2a78506-76d0991c_0] Write session: try to update token
2025-10-02T08:15:30.605617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd87ce3-f484fe87-2a78506-76d0991c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:30.608896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2397
2025-10-02T08:15:30.614637Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:30.614657Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:30.614665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535096562938922:14126]
2025-10-02T08:15:30.614704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:30.614710Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:30.614876Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:30.615018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:30.615156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:30.615295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:30.615481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:30.615520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:30.619314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId: src_id|bd87ce3-f484fe87-2a78506-76d0991c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:30.621980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:30.622217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.622232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.622265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:30.622284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:30.622393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.622399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.622567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.622642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.622716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.622784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.622833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.622845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.622917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.622994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.623064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.623134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.623184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.623189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.623263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.623339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.623408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.623477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.623522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.623531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.623600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.623667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.623734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.623803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.624086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.624095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.624177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.624242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.624312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.624383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.624428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.624437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.624506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.624570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.624636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.624707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.624754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.624761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.624863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.624928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.624999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.625068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.625108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.625111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.625177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.625244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.625311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.625378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.625427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.625434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.625498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.625563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.625631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.625698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.625746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.625754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.625823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:30.625888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:30.625958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:30.626023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:30.626069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:30.626078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:30.626121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:30.626187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.626214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.626216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:30.626247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:30.626270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:30.626273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:30.626276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:30.626281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:30.626700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:30.626730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:30.626743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:30.626747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:30.626751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:30.626755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:30.627311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:30.627337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:30.627343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:30.627346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:30.627350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:30.627353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:30.627836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:30.627862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:30.627868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:30.627872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:30.627875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:30.629332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:30.629353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:30.629366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392930628
2025-10-02T08:15:30.629535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:30.629553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:30.629562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:30.629566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:30.629574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:30.629579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:30.630084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:30.630114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:30.630121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:30.630124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:30.630127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:30.630130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:30.630636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:30.630651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:30.630657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:30.630662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:30.630666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:30.630669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:30.631135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:30.631147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:30.631152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:30.632282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:30.632290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:30.632295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:30.632299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:30.632307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392930631
2025-10-02T08:15:30.632604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:30.632614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:30.632620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:30.632623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:30.632628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:30.632631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:30.633249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:30.633277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:30.633283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:30.633294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:30.633302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:30.633307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:30.633758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:30.633779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.633878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392930632
2025-10-02T08:15:30.634651Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:30.634674Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:30.634681Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:30.634688Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:30.636327Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:30.636345Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:30.636347Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:30.636356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535096562938922:14126]
2025-10-02T08:15:30.636360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535096562938922:14126]
2025-10-02T08:15:30.636410Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:30.636419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:30.636424Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:30.636423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.636426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:30.636565Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:30.671430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535096562938989:13279]
2025-10-02T08:15:30.671520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2397, pipe: [1:7556535096562938989:13279]
2025-10-02T08:15:30.771535Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:30.771832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562938989:13279], now have 1 active actors on pipe
2025-10-02T08:15:30.772086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:30.772423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd87ce3-f484fe87-2a78506-76d0991c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:30.772434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd87ce3-f484fe87-2a78506-76d0991c_0] Write session will restart in 0.006582s
2025-10-02T08:15:30.772457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd87ce3-f484fe87-2a78506-76d0991c_0] Write session: Do CDS request
2025-10-02T08:15:30.772463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd87ce3-f484fe87-2a78506-76d0991c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:30.771969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535096562938989:13279]
2025-10-02T08:15:30.771987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:30.771989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:30.772012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2398 reason: error at write: Disconnected sessionId: src_id|bd87ce3-f484fe87-2a78506-76d0991c_0
2025-10-02T08:15:30.772083Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:30.772178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2398 sessionId: src_id|bd87ce3-f484fe87-2a78506-76d0991c_0 is DEAD
2025-10-02T08:15:30.780302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd87ce3-f484fe87-2a78506-76d0991c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.780393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:30.780407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2399
2025-10-02T08:15:30.780505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.780526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:30.780534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:30.780537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:30.780856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2399 sessionId:  describe result for acl check
2025-10-02T08:15:30.780888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:30.780889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:30.780890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:30.780893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535096562939227:14145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:30.781276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535096562939227:14145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:30.783717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535096562939227:14145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:30.787187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535096562939227:14145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:30.787203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535096562939227:14145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:30.787207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535096562939227:14145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:30.787215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:30.793112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:30.794531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:30.794723Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:30.794735Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:30.794743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:30.794790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:30.794995Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535096562939555:14144]
2025-10-02T08:15:30.795691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:30.795906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:30.795952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:30.796258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:30.796312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.796318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.796319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.796321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.796322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.796327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.796338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.796344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.796348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.796352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.796358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.796372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.796377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.796384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.796388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.796393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.796398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.796404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.796409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.796414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.796437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:30.805012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:30.806369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:30.806383Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:30.806385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:30.806389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:30.806396Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2398 [1:7556535096562939555:14144]
2025-10-02T08:15:30.806408Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:30.806427Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:30.806430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.806433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.806435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.806451Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:30.806462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:30.806468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:30.806517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.806522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.806525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:30.806526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:30.806589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:30.806597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.806609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.806626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:30.806644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562939439:14145], now have 1 active actors on pipe
2025-10-02T08:15:30.806655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535096562939549:14144]
2025-10-02T08:15:30.806657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535096562939549:14144]
2025-10-02T08:15:30.806664Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:30.806678Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:30.806679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535097022367586:2378], now have 1 active actors on pipe
2025-10-02T08:15:30.806684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:30.806690Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:30.806696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:30.806699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:30.806729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535096562939549:14144]
2025-10-02T08:15:30.806737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:30.806749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2398
2025-10-02T08:15:30.806757Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:30.806762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.806766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.806755Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2398
2025-10-02T08:15:30.806789Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:30.806800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:30.806803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:30.806805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:30.806814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:30.806824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:30.806847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:30.806886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.806892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.806904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:30.806945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2399 partition: 0 MaxSeqNo: 17 sessionId: src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0
2025-10-02T08:15:30.807219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd87ce3-f484fe87-2a78506-76d0991c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:30.809768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0] Write session: try to update token
2025-10-02T08:15:30.809783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:30.824929Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:30.824949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:30.824951Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:30.824959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535096562939549:14144]
2025-10-02T08:15:30.824962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535096562939549:14144]
2025-10-02T08:15:30.825001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:30.825008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.825010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:30.825011Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:30.825017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:30.825146Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:30.828540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId: src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:30.830920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:30.872146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535096562939594:13279]
2025-10-02T08:15:30.872385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2398, pipe: [1:7556535096562939594:13279]
2025-10-02T08:15:30.965321Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:30.965714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:30.965728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:30.965767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562939594:13279], now have 1 active actors on pipe
2025-10-02T08:15:30.965910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:30.965924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:30.965990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2399 reason: error at write: Disconnected sessionId: src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0
2025-10-02T08:15:30.966045Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:30.966352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:30.966370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0] Write session will restart in 0.007201s
2025-10-02T08:15:30.966158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2399 sessionId: src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0 is DEAD
2025-10-02T08:15:30.966166Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:30.966399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0] Write session: Do CDS request
2025-10-02T08:15:30.966330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535096562939594:13279]
2025-10-02T08:15:30.966409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:30.975316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.975431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:30.975449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2400
2025-10-02T08:15:30.975651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:30.975677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:30.975683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:30.975686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:30.976083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2400 sessionId:  describe result for acl check
2025-10-02T08:15:30.976106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:30.976107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:30.976108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:30.976113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535096562939942:14152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:30.976598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535096562939942:14152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:30.978998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535096562939942:14152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:30.982816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535096562939942:14152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:30.982830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535096562939942:14152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:30.982833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535096562939942:14152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:30.982842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:30.989401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:30.991245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:30.991455Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:30.991468Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:30.991479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:30.991536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:30.991579Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535096562940160:14151]
2025-10-02T08:15:30.992237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:30.992448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:30.992500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:30.992872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:30.992938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.992945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.992946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.992947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.992948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.992954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.992964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.992969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.992973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.992977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.992984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.992991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:30.993002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.993008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:30.993021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.993031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:30.993035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.993040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:30.993049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.993054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:30.993073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:31.001606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:31.003442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:31.003463Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:31.003465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:31.003469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:31.003475Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2399 [1:7556535096562940160:14151]
2025-10-02T08:15:31.003487Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:31.003504Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:31.003507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.003510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.003512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.003530Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:31.003534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:31.003541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:31.003603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.003613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.003616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:31.003619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:31.003681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:31.003688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.003701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.003712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:31.003731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535096562940154:14151]
2025-10-02T08:15:31.003738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535096562940154:14151]
2025-10-02T08:15:31.003745Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:31.003758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:31.003768Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:31.003775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:31.003778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:31.003779Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:31.003779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2399
2025-10-02T08:15:31.003789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535096562940139:14152], now have 1 active actors on pipe
2025-10-02T08:15:31.003793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535097022367606:2378], now have 1 active actors on pipe
2025-10-02T08:15:31.003824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535096562940154:14151]
2025-10-02T08:15:31.003838Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:31.003846Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:31.003849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.003853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.003902Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96f872be-233e307f-f49f6d1-2b4d0571_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:31.003889Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2399
2025-10-02T08:15:31.003913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.003916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.003918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:31.003927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.003935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:31.003959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.003999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.004006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.004017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.004054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2400 partition: 0 MaxSeqNo: 17 sessionId: src_id|96f872be-233e307f-f49f6d1-2b4d0571_0
2025-10-02T08:15:31.004438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c473a0-e34b86b8-8591f7e-19c0d43d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|96f872be-233e307f-f49f6d1-2b4d0571_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:31.007725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f872be-233e307f-f49f6d1-2b4d0571_0] Write session: try to update token
2025-10-02T08:15:31.007747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f872be-233e307f-f49f6d1-2b4d0571_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:31.021663Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:31.021685Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:31.021688Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:31.021699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535096562940154:14151]
2025-10-02T08:15:31.021704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535096562940154:14151]
2025-10-02T08:15:31.021745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:31.021748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:31.021755Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:31.021757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.021759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:31.021885Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:31.034041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId: src_id|96f872be-233e307f-f49f6d1-2b4d0571_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:31.036604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:31.066202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535100857907482:13279]
2025-10-02T08:15:31.068947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2399, pipe: [1:7556535100857907482:13279]
2025-10-02T08:15:31.159552Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:31.160191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.160211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.160229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857907482:13279], now have 1 active actors on pipe
2025-10-02T08:15:31.160301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535100857907482:13279]
2025-10-02T08:15:31.160384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:31.160390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:31.160415Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:31.160443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2400 reason: error at write: Disconnected sessionId: src_id|96f872be-233e307f-f49f6d1-2b4d0571_0
2025-10-02T08:15:31.160433Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:31.160595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2400 sessionId: src_id|96f872be-233e307f-f49f6d1-2b4d0571_0 is DEAD
2025-10-02T08:15:31.160920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f872be-233e307f-f49f6d1-2b4d0571_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:31.160938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f872be-233e307f-f49f6d1-2b4d0571_0] Write session will restart in 0.009017s
2025-10-02T08:15:31.160968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f872be-233e307f-f49f6d1-2b4d0571_0] Write session: Do CDS request
2025-10-02T08:15:31.160977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f872be-233e307f-f49f6d1-2b4d0571_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:31.171375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f872be-233e307f-f49f6d1-2b4d0571_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.171430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:31.171447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2401
2025-10-02T08:15:31.171601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.171626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:31.171631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:31.171633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:31.171992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2401 sessionId:  describe result for acl check
2025-10-02T08:15:31.172016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:31.172018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:31.172019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:31.172024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535100857907935:14159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:31.172588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535100857907935:14159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:31.175603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535100857907935:14159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:31.177597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:31.177891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535100857907935:14159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:31.177893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:31.177905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535100857907935:14159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:31.177909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535100857907935:14159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:31.177916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:31.178037Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:31.178058Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:31.178066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:31.178101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:31.178183Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535100857908049:14158]
2025-10-02T08:15:31.178653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:31.178850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:31.178907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:31.179253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:31.179310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.179316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.179317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.179318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.179319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.179325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.179335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.179339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.179347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.179351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.179360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.179372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.179382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.179387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.179392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.179400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.179404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.179408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.179416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.179420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.179437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:31.187840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:31.189614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:31.189632Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:31.189634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:31.189637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:31.189643Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2400 [1:7556535100857908049:14158]
2025-10-02T08:15:31.189654Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:31.189671Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:31.189674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.189676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.189678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.189692Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:31.189696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:31.189703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:31.189759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.189769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.189772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:31.189774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:31.189835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:31.189842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.189854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.189872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:31.189888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857908047:14159], now have 1 active actors on pipe
2025-10-02T08:15:31.189899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535100857908039:14158]
2025-10-02T08:15:31.189901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535100857908039:14158]
2025-10-02T08:15:31.189914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:31.189927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535101317334910:2378], now have 1 active actors on pipe
2025-10-02T08:15:31.189929Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:31.189932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:31.189938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:31.189940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2400
2025-10-02T08:15:31.189951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:31.189959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:31.189991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.189999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.190011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535100857908039:14158]
2025-10-02T08:15:31.190016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:31.190024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:31.190020Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2400
2025-10-02T08:15:31.190038Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:31.190049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.190052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.190054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:31.190062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.190069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:31.190087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.190128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.190134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.190146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.190182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2401 partition: 0 MaxSeqNo: 17 sessionId: src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0
2025-10-02T08:15:31.190486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f872be-233e307f-f49f6d1-2b4d0571_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:31.193131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0] Write session: try to update token
2025-10-02T08:15:31.193143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:31.205970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId: src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:31.207095Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:31.207113Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:31.207115Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:31.207123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535100857908039:14158]
2025-10-02T08:15:31.207127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535100857908039:14158]
2025-10-02T08:15:31.207169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:31.207170Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:31.207175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:31.207178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.207180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:31.207319Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:31.208444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:31.260209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535100857908076:13279]
2025-10-02T08:15:31.260320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2400, pipe: [1:7556535100857908076:13279]
2025-10-02T08:15:31.342501Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:31.342994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.343011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.343049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857908076:13279], now have 1 active actors on pipe
2025-10-02T08:15:31.343245Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:31.343534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:31.343543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535100857908076:13279]
2025-10-02T08:15:31.343600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2401 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0
2025-10-02T08:15:31.343768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2401 sessionId: src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0 is DEAD
2025-10-02T08:15:31.344094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:31.344106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0] Write session will restart in 0.008136s
2025-10-02T08:15:31.344130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0] Write session: Do CDS request
2025-10-02T08:15:31.344147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:31.344859Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:31.353247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.353307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:31.353332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2402
2025-10-02T08:15:31.353438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.353462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:31.353467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:31.353470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:31.353840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2402 sessionId:  describe result for acl check
2025-10-02T08:15:31.353864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:31.353866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:31.353867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:31.353872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535100857908447:14165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:31.354393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535100857908447:14165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:31.357002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535100857908447:14165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:31.360559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535100857908447:14165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:31.360576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535100857908447:14165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:31.360578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535100857908447:14165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:31.360586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:31.362525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:31.362941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:31.363314Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:31.363327Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:31.363338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:31.363399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:31.363438Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535100857908646:14164]
2025-10-02T08:15:31.364084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:31.364340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:31.364395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:31.364722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:31.364782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.364788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.364789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.364791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.364791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.364797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.364821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.364826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.364830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.364833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.364841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.364848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.364854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.364859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.364864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.364869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.364878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.364885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.364889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.364894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.364915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:31.373154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:31.374863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:31.374884Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:31.374886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:31.374889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:31.374895Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2401 [1:7556535100857908646:14164]
2025-10-02T08:15:31.374906Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:31.374920Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:31.374927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.374929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.374932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.374947Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:31.374956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:31.374966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:31.375028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.375035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.375038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:31.375040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:31.375101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:31.375107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.375118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.375128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:31.375148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857908635:14165], now have 1 active actors on pipe
2025-10-02T08:15:31.375159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535100857908640:14164]
2025-10-02T08:15:31.375164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535100857908640:14164]
2025-10-02T08:15:31.375169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2401
2025-10-02T08:15:31.375174Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:31.375185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:31.375188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535101317334920:2378], now have 1 active actors on pipe
2025-10-02T08:15:31.375193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:31.375197Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:31.375206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:31.375212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:31.375218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.375225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.375269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535100857908640:14164]
2025-10-02T08:15:31.375279Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:31.375298Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:31.375301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:31.375307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.375310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.375316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:31.375324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.375290Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2401
2025-10-02T08:15:31.375335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:31.375376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.375471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.375478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.375490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.375526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2402 partition: 0 MaxSeqNo: 17 sessionId: src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0
2025-10-02T08:15:31.375831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aefa84d6-58bcb528-a727fdc4-1672017e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:31.378548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0] Write session: try to update token
2025-10-02T08:15:31.378565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:31.392408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId: src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:31.392700Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:31.392719Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:31.392722Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:31.392731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535100857908640:14164]
2025-10-02T08:15:31.392735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535100857908640:14164]
2025-10-02T08:15:31.392779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:31.392784Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:31.392790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.392790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:31.392792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:31.392956Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:31.394970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:31.439965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535100857908671:13279]
2025-10-02T08:15:31.440116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2401, pipe: [1:7556535100857908671:13279]
2025-10-02T08:15:31.538328Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:31.538597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.538607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.538638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857908671:13279], now have 1 active actors on pipe
2025-10-02T08:15:31.538780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535100857908671:13279]
2025-10-02T08:15:31.538797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:31.538799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:31.538838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2402 reason: error at write: Disconnected sessionId: src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0
2025-10-02T08:15:31.538842Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:31.538903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:31.538986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2402 sessionId: src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0 is DEAD
2025-10-02T08:15:31.539109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:31.539120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0] Write session will restart in 0.007937s
2025-10-02T08:15:31.539111Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:15:31.539149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0] Write session: Do CDS request
2025-10-02T08:15:31.539154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:31.539234Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 24 consumer shared/user session shared/user_1_24_12670745165275090981_v1 is DEAD
2025-10-02T08:15:31.539277Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:15:31.539307Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:15:31.539311Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:15:31.539318Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.005896s
2025-10-02T08:15:31.539498Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535019253482330:13276] disconnected; active server actors: 1
2025-10-02T08:15:31.539508Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535019253482330:13276] client user disconnected session shared/user_1_24_12670745165275090981_v1
2025-10-02T08:15:31.546150Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:15:31.546308Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:15:31.546321Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 25
2025-10-02T08:15:31.546481Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 25 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:15:31.546528Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:15:31.546594Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 auth for : user
2025-10-02T08:15:31.546729Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 Handle describe topics response
2025-10-02T08:15:31.546755Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 auth is DEAD
2025-10-02T08:15:31.546760Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:15:31.546972Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:15:31.547061Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_25_13456385256805587762_v1
2025-10-02T08:15:31.547074Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:15:31.547135Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:15:31.547234Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535100857909004:14172] connected; active server actors: 1
2025-10-02T08:15:31.547230Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:15:31.547291Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 got read request: guid# 3bbc72de-6aa09a11-752ad0a9-b04e4924
2025-10-02T08:15:31.547346Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556535100857909004:14172] session shared/user_1_25_13456385256805587762_v1
2025-10-02T08:15:31.547364Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:15:31.547374Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:15:31.547379Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_25_13456385256805587762_v1" (Sender=[1:7556535100857908977:14172], Pipe=[1:7556535100857909004:14172], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:15:31.547383Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:15:31.547395Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:15:31.547407Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_25_13456385256805587762_v1" (Sender=[1:7556535100857908977:14172], Pipe=[1:7556535100857909004:14172], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:15:31.547420Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_25_13456385256805587762_v1" sender [1:7556535100857908977:14172] lock partition 0 for ReadingSession "shared/user_1_25_13456385256805587762_v1" (Sender=[1:7556535100857908977:14172], Pipe=[1:7556535100857909004:14172], Partitions=[], ActiveFamilyCount=1) generation 1 step 25
2025-10-02T08:15:31.547438Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:15:31.547449Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000047s
2025-10-02T08:15:31.547812Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 25 Session: "shared/user_1_25_13456385256805587762_v1" ClientId: "user" PipeClient { RawX1: 7556535100857909004 RawX2: 4503603922351964 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:15:31.547837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:15:31.548153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.548165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:31.548175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2403
2025-10-02T08:15:31.548297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.548320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:31.548328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:31.548331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:31.548741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2403 sessionId:  describe result for acl check
2025-10-02T08:15:31.548769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:31.548775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:31.548777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:31.548781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535100857909080:14176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:31.549254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535100857909080:14176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:31.551304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535100857909080:14176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:31.554755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535100857909080:14176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:31.554773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535100857909080:14176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:31.554775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535100857909080:14176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:31.554781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:31.557058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:31.557343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:31.557471Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:31.557479Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:31.557485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:31.557512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:31.557538Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535100857909252:14171]
2025-10-02T08:15:31.558047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:31.558215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:31.558257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:31.558525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:31.558580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.558586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.558587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.558588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.558589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.558595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.558606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.558610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.558614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.558618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.558623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.558630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.558636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.558645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.558650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.558660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.558664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.558674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.558679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.558684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.558703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:31.566489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:31.567940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:31.567961Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:31.567964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:31.567967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:31.567973Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2402 [1:7556535100857909252:14171]
2025-10-02T08:15:31.567985Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:31.568001Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:31.568003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.568007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.568009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.568024Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:31.568029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:31.568035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:31.568097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.568107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.568109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:31.568111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:31.568190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:31.568197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.568209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.568219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:31.568241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857909041:14175], now have 1 active actors on pipe
2025-10-02T08:15:31.568252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535100857909246:14171]
2025-10-02T08:15:31.568252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2402
2025-10-02T08:15:31.568258Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535100857909246:14171]
2025-10-02T08:15:31.568265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:31.568271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2402, pipe: [1:7556535100857909041:14175]
2025-10-02T08:15:31.568273Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:31.568275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857909232:14176], now have 1 active actors on pipe
2025-10-02T08:15:31.568276Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:31.568280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535101317334925:2378], now have 1 active actors on pipe
2025-10-02T08:15:31.568285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:31.568297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:31.568304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:31.568310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.568314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.568328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.568334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.568339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_25_13456385256805587762_v1 on pipe: [1:7556535100857909041:14175]
2025-10-02T08:15:31.568361Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_25_13456385256805587762_v1:1 with generation 2402
2025-10-02T08:15:31.568376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535100857909246:14171]
2025-10-02T08:15:31.568384Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:31.568355Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2402
2025-10-02T08:15:31.568393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:31.568401Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:31.568409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.568412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.568414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:31.568423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.568435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:31.568450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.568463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.568468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:31.568481Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_25_13456385256805587762_v1
2025-10-02T08:15:31.568487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.568543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.568563Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:31.568589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.568596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.568692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.568735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2403 partition: 0 MaxSeqNo: 17 sessionId: src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0
2025-10-02T08:15:31.569051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2041aef-5e4dd9f3-bb41e1d9-f14fec51_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:31.570341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:15:31.570370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:15:31.570377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.570379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.570381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.570387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:15:31.570396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:15:31.570443Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392931568 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:15:31.570457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:15:31.570484Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 sending to client partition status
2025-10-02T08:15:31.571504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0] Write session: try to update token
2025-10-02T08:15:31.571518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:31.585010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId: src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:31.585223Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:31.585236Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:31.585238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:31.585247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535100857909246:14171]
2025-10-02T08:15:31.585251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535100857909246:14171]
2025-10-02T08:15:31.585291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:31.585303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.585304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:31.585334Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:31.585349Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:31.585434Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:31.587564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:31.716462Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:31.716925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.716940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.717050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:31.717055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:31.717096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2403 reason: error at write: Disconnected sessionId: src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0
2025-10-02T08:15:31.717171Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:31.717188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_25_13456385256805587762_v1
2025-10-02T08:15:31.717207Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:31.717218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2403 sessionId: src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0 is DEAD
2025-10-02T08:15:31.717343Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_25_13456385256805587762_v1
2025-10-02T08:15:31.717373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:31.717383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0] Write session will restart in 0.007098s
2025-10-02T08:15:31.717374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535100857909041:14175]
2025-10-02T08:15:31.717404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0] Write session: Do CDS request
2025-10-02T08:15:31.717411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:31.725152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.725284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:31.725307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2404
2025-10-02T08:15:31.725429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.725460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:31.725469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:31.725473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:31.725830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2404 sessionId:  describe result for acl check
2025-10-02T08:15:31.725858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:31.725859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:31.725860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:31.725863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535100857909635:14194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:31.726362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535100857909635:14194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:31.730050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535100857909635:14194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:31.733971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535100857909635:14194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:31.733992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535100857909635:14194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:31.733995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535100857909635:14194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:31.734005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:31.735525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:31.737545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:31.737894Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:31.737904Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:31.737914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:31.737966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:31.737999Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535100857909890:14193]
2025-10-02T08:15:31.738446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:31.738720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:31.738777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:31.739054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:31.739107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.739113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.739114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.739115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.739116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.739121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.739140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.739144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.739152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.739155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.739161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.739167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.739173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.739182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.739186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.739195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.739199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.739203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.739207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.739211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.739228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:31.747385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:31.748902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:31.748916Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:31.748919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:31.748922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:31.748926Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2403 [1:7556535100857909890:14193]
2025-10-02T08:15:31.748935Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:31.748948Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:31.748951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.748953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.748954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.748963Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:31.748966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:31.748971Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:31.749023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.749030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.749033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:31.749036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:31.749098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:31.749104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.749114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.749124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:31.749138Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535100857909884:14193]
2025-10-02T08:15:31.749144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535100857909884:14193]
2025-10-02T08:15:31.749151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:31.749163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:31.749165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:31.749168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:31.749175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2403
2025-10-02T08:15:31.749180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:31.749182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:31.749191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857909869:14194], now have 1 active actors on pipe
2025-10-02T08:15:31.749194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535101317334955:2378], now have 1 active actors on pipe
2025-10-02T08:15:31.749223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.749230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.749243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535100857909884:14193]
2025-10-02T08:15:31.749253Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:31.749259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:31.749251Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2403
2025-10-02T08:15:31.749277Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:31.749287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.749290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.749292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:31.749300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.749307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:31.749333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.749372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.749378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.749390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.749414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2404 partition: 0 MaxSeqNo: 17 sessionId: src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0
2025-10-02T08:15:31.749715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6cc0e2-5ba476ec-693cc35c-6fa23ee7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:31.752209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0] Write session: try to update token
2025-10-02T08:15:31.752222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:31.765020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId: src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:31.767083Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:31.767105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:31.767107Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:31.767117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535100857909884:14193]
2025-10-02T08:15:31.767121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535100857909884:14193]
2025-10-02T08:15:31.767163Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:31.767166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:31.767168Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:31.767173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.767175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:31.767324Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:31.767467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:31.817299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535100857909914:14175]
2025-10-02T08:15:31.817430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2403, pipe: [1:7556535100857909914:14175]
2025-10-02T08:15:31.907292Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:31.907692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.907699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.907737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857909914:14175], now have 1 active actors on pipe
2025-10-02T08:15:31.908118Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:31.909026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:31.909036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0] Write session will restart in 0.008396s
2025-10-02T08:15:31.909059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0] Write session: Do CDS request
2025-10-02T08:15:31.909065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:31.908134Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:31.908503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535100857909914:14175]
2025-10-02T08:15:31.908519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:31.908568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2404 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0
2025-10-02T08:15:31.908709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2404 sessionId: src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0 is DEAD
2025-10-02T08:15:31.918259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.920939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:31.920958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2405
2025-10-02T08:15:31.921411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:31.921472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:31.921478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:31.921482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:31.922004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2405 sessionId:  describe result for acl check
2025-10-02T08:15:31.922042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:31.922045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:31.922046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:31.922052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535100857910284:14201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:31.922687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535100857910284:14201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:31.929013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535100857910284:14201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:31.934838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535100857910284:14201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:31.934860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535100857910284:14201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:31.934863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535100857910284:14201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:31.934871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:31.936165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:31.937775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:31.938170Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:31.938182Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:31.938195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:31.938258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:31.938299Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535100857910505:14200]
2025-10-02T08:15:31.938959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:31.939203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:31.939261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:31.939587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:31.939638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.939644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.939645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.939647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.939648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.939654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.939665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.939669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.939673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.939677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.939683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.939691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:31.939698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.939703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:31.939710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.939715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:31.939720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.939725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.939730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.939735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.939754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:31.953976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:31.955536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:31.955559Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:31.955563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:31.955567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:31.955575Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2404 [1:7556535100857910505:14200]
2025-10-02T08:15:31.955589Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:31.955607Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:31.955615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.955618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.955620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.955637Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:31.955647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:31.955653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:31.955719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.955727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.955730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:31.955733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:31.955800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:31.955808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.955822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:31.955839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:31.955861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535100857910489:14201], now have 1 active actors on pipe
2025-10-02T08:15:31.955869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535101317334975:2378], now have 1 active actors on pipe
2025-10-02T08:15:31.955875Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535100857910499:14200]
2025-10-02T08:15:31.955877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535100857910499:14200]
2025-10-02T08:15:31.955892Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:31.955911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:31.955929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:31.955936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:31.955969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535100857910499:14200]
2025-10-02T08:15:31.955976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:31.955985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:31.955997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:31.956004Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:31.956019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2404
2025-10-02T08:15:31.956041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.956048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.956021Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2404
2025-10-02T08:15:31.956074Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:31.956084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:31.956088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:31.956090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:31.956098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:31.956107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:31.956121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.956184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:31.956191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:31.956204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:31.956245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2405 partition: 0 MaxSeqNo: 17 sessionId: src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0
2025-10-02T08:15:31.956611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a860f5-bacb1e0e-7df917e8-aab29ee5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:31.959278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0] Write session: try to update token
2025-10-02T08:15:31.959296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:31.975753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId: src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:31.975811Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:31.975815Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:31.975818Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:31.975827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535100857910499:14200]
2025-10-02T08:15:31.975831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535100857910499:14200]
2025-10-02T08:15:31.975885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:31.975891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:31.975893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:31.975985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:31.975990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:31.976033Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:31.978605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:32.008822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535105152877825:14175]
2025-10-02T08:15:32.009071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2404, pipe: [1:7556535105152877825:14175]
2025-10-02T08:15:32.123403Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:32.124153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.124172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.124213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152877825:14175], now have 1 active actors on pipe
2025-10-02T08:15:32.124341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:32.124350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:32.124406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2405 reason: error at write: Disconnected sessionId: src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0
2025-10-02T08:15:32.124459Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:32.124493Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:32.124577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2405 sessionId: src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0 is DEAD
2025-10-02T08:15:32.124708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:32.124715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0] Write session will restart in 0.008305s
2025-10-02T08:15:32.124747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0] Write session: Do CDS request
2025-10-02T08:15:32.124755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:32.124741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535105152877825:14175]
2025-10-02T08:15:32.134327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.136965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:32.136983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2406
2025-10-02T08:15:32.137314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.137360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:32.137372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:32.137376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:32.138036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2406 sessionId:  describe result for acl check
2025-10-02T08:15:32.138074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:32.138076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:32.138078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:32.138083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535105152878230:14208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:32.138589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535105152878230:14208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:32.148180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535105152878230:14208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:32.150571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:32.153816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:32.154077Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:32.154082Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:32.154094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:32.154154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:32.154197Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535105152878399:14207]
2025-10-02T08:15:32.154965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:32.155435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:32.155526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:32.155933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:32.155998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.156006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.156007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.156009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.156010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.156016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.156027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.156031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.156036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.156041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.156047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.156056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.156063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.156069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.156074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.156080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.156084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.156091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.156096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.156102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.156128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:32.156962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535105152878230:14208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:32.156979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535105152878230:14208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:32.156983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535105152878230:14208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:32.156993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:32.169004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:32.170947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:32.170954Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:32.170957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:32.170961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:32.170968Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2405 [1:7556535105152878399:14207]
2025-10-02T08:15:32.170982Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:32.170998Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:32.171002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.171004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.171006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.171022Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:32.171028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:32.171035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:32.171104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.171106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.171109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:32.171112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:32.171185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:32.171189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.171205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.171219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:32.171237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535105152878384:14207]
2025-10-02T08:15:32.171239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535105152878384:14207]
2025-10-02T08:15:32.171247Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:32.171260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:32.171931Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2405
2025-10-02T08:15:32.171997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b4576e2-a1dc9e73-466ba5e6-5ae4ebf3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:32.171276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:32.171275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2405
2025-10-02T08:15:32.171283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:32.171286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:32.171295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:32.171306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152878416:14208], now have 1 active actors on pipe
2025-10-02T08:15:32.171340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535105612302278:2378], now have 1 active actors on pipe
2025-10-02T08:15:32.171345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.171349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.171361Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535105152878384:14207]
2025-10-02T08:15:32.171365Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:32.171391Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:32.171398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.171403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.171405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:32.171417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.171426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:32.171434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:32.171448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.171554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.171563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.171591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.171639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2406 partition: 0 MaxSeqNo: 17 sessionId: src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0
2025-10-02T08:15:32.174596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0] Write session: try to update token
2025-10-02T08:15:32.174612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:32.198025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId: src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:32.198143Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:32.198161Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:32.198163Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:32.198169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535105152878384:14207]
2025-10-02T08:15:32.198173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535105152878384:14207]
2025-10-02T08:15:32.198219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:32.198224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.198224Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:32.198226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:32.198231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:32.198374Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:32.200683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:32.224854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535105152878431:14175]
2025-10-02T08:15:32.225022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2405, pipe: [1:7556535105152878431:14175]
2025-10-02T08:15:32.339324Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:32.339771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.339789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.339822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152878431:14175], now have 1 active actors on pipe
2025-10-02T08:15:32.339917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535105152878431:14175]
2025-10-02T08:15:32.339930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:32.339934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:32.339997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2406 reason: error at write: Disconnected sessionId: src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0
2025-10-02T08:15:32.340055Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:32.340066Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:32.340188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2406 sessionId: src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0 is DEAD
2025-10-02T08:15:32.340538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:32.340546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0] Write session will restart in 0.006443s
2025-10-02T08:15:32.340572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0] Write session: Do CDS request
2025-10-02T08:15:32.340578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:32.348296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.348365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:32.348383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2407
2025-10-02T08:15:32.348526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.348569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:32.348578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:32.348582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:32.349044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2407 sessionId:  describe result for acl check
2025-10-02T08:15:32.349075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:32.349082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:32.349083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:32.349087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535105152878688:14214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:32.349622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535105152878688:14214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:32.353000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535105152878688:14214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:32.357608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535105152878688:14214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:32.357626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535105152878688:14214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:32.357629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535105152878688:14214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:32.357638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:32.363043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:32.365082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:32.365329Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:32.365340Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:32.365350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:32.365405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:32.365444Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535105152879013:14213]
2025-10-02T08:15:32.366099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:32.366318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:32.366361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:32.366664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:32.366713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.366718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.366720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.366721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.366722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.366727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.366738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.366742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.366746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.366750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.366756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.366764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.366770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.366775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.366780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.366801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.366810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.366816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.366821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.366826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.366850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:32.375185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:32.376982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:32.376997Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:32.376999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:32.377001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:32.377006Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2406 [1:7556535105152879013:14213]
2025-10-02T08:15:32.377013Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:32.377027Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:32.377028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.377031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.377032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.377043Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:32.377046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:32.377051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:32.377099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.377105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.377107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:32.377108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:32.377158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:32.377162Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.377171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.377177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:32.377193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535105612302289:2378], now have 1 active actors on pipe
2025-10-02T08:15:32.377198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152878929:14214], now have 1 active actors on pipe
2025-10-02T08:15:32.377203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535105152879007:14213]
2025-10-02T08:15:32.377202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2406
2025-10-02T08:15:32.377204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535105152879007:14213]
2025-10-02T08:15:32.377209Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:32.377219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:32.377220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:32.377221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:32.377228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:32.377231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:32.377236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.377238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.377270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535105152879007:14213]
2025-10-02T08:15:32.377280Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:32.377286Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:32.377291Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:32.377295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.377298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.377299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:32.377305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.377310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:32.377295Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2406
2025-10-02T08:15:32.377336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.377409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.377414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.377424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.377452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2407 partition: 0 MaxSeqNo: 17 sessionId: src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0
2025-10-02T08:15:32.377757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9665bbd9-27e32b90-e6f84cf9-227b33bc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:32.380202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0] Write session: try to update token
2025-10-02T08:15:32.380216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:32.393972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId: src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:32.395272Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:32.395276Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:32.395278Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:32.395287Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535105152879007:14213]
2025-10-02T08:15:32.395291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535105152879007:14213]
2025-10-02T08:15:32.395335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:32.395341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.395343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:32.395351Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:32.395357Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:32.395485Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:32.396625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:32.440342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535105152879039:14175]
2025-10-02T08:15:32.440588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2406, pipe: [1:7556535105152879039:14175]
2025-10-02T08:15:32.529103Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:32.529508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.529523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.529557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152879039:14175], now have 1 active actors on pipe
2025-10-02T08:15:32.529835Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:32.529654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:32.529662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:32.529711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2407 reason: error at write: Disconnected sessionId: src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0
2025-10-02T08:15:32.529778Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:32.529864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2407 sessionId: src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0 is DEAD
2025-10-02T08:15:32.529975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535105152879039:14175]
2025-10-02T08:15:32.532888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:32.532898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0] Write session will restart in 0.006374s
2025-10-02T08:15:32.532924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0] Write session: Do CDS request
2025-10-02T08:15:32.532931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:32.540363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.540662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:32.540681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2408
2025-10-02T08:15:32.540925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.540961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:32.540970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:32.540974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:32.541428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2408 sessionId:  describe result for acl check
2025-10-02T08:15:32.541470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:32.541472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:32.541474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:32.541479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535105152879460:14221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:32.541931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535105152879460:14221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:32.544183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535105152879460:14221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:32.547286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:32.548725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:32.549001Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:32.549013Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:32.549023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:32.549075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:32.549111Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535105152879618:14220]
2025-10-02T08:15:32.549751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:32.549914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:32.549956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:32.550039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535105152879460:14221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:32.550067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535105152879460:14221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:32.550074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535105152879460:14221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:32.550083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:32.550247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:32.550287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.550293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.550294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.550296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.550297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.550302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.550312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.550322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.550327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.550331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.550336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.550342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.550348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.550353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.550358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.550363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.550368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.550373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.550377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.550383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.550401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:32.558383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:32.560196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:32.560214Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:32.560216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:32.560220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:32.560227Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2407 [1:7556535105152879618:14220]
2025-10-02T08:15:32.560239Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:32.560255Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:32.560257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.560260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.560262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.560277Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:32.560289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:32.560295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:32.560356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.560363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.560366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:32.560368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:32.560433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:32.560439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.560451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.560463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:32.560489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152879629:14221], now have 1 active actors on pipe
2025-10-02T08:15:32.560493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2407
2025-10-02T08:15:32.560495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535105152879612:14220]
2025-10-02T08:15:32.560497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535105152879612:14220]
2025-10-02T08:15:32.560504Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:32.560514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535105612302296:2378], now have 1 active actors on pipe
2025-10-02T08:15:32.560516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:32.560519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:32.560520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:32.560533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:32.560536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:32.560542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.560547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.560584Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535105152879612:14220]
2025-10-02T08:15:32.560592Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:32.560600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:32.560606Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:32.560612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.560615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.560617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:32.560626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.560604Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2407
2025-10-02T08:15:32.560638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:32.560685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.560753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.560761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.560773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.560831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2408 partition: 0 MaxSeqNo: 17 sessionId: src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0
2025-10-02T08:15:32.561175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ac63d-e7aa74b9-ad3e1b36-72806cf7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:32.563746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0] Write session: try to update token
2025-10-02T08:15:32.563764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:32.577712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId: src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:32.578041Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:32.578057Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:32.578060Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:32.578070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535105152879612:14220]
2025-10-02T08:15:32.578074Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535105152879612:14220]
2025-10-02T08:15:32.578118Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:32.578124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:32.578125Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:32.578130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.578132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:32.578278Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:32.580307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:32.630384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535105152879648:14175]
2025-10-02T08:15:32.630611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2407, pipe: [1:7556535105152879648:14175]
2025-10-02T08:15:32.720724Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:32.722302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:32.722312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0] Write session will restart in 0.005952s
2025-10-02T08:15:32.722336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0] Write session: Do CDS request
2025-10-02T08:15:32.722343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:32.721789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.721810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.721848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152879648:14175], now have 1 active actors on pipe
2025-10-02T08:15:32.721892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:32.721895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:32.721951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2408 reason: error at write: Disconnected sessionId: src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0
2025-10-02T08:15:32.722133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2408 sessionId: src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0 is DEAD
2025-10-02T08:15:32.722461Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:32.722762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535105152879648:14175]
2025-10-02T08:15:32.722158Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:32.729217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.729520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:32.729540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2409
2025-10-02T08:15:32.730217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.730258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:32.730269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:32.730272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:32.731285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2409 sessionId:  describe result for acl check
2025-10-02T08:15:32.731317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:32.731319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:32.731320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:32.731325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535105152879949:14235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:32.732406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535105152879949:14235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:32.735805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535105152879949:14235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:32.743704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535105152879949:14235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:32.743721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535105152879949:14235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:32.743724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535105152879949:14235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:32.743735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:32.747760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:32.749656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:32.750013Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:32.750028Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:32.750043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:32.750119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:32.750152Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535105152880270:14234]
2025-10-02T08:15:32.750793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:32.751136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:32.751187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:32.751507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:32.751551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.751552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.751553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.751555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.751556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.751562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.751574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.751579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.751583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.751588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.751594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.751602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.751608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.751614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.751619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.751624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.751629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.751634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.751640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.751646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.751667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:32.764629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:32.766231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:32.766249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:32.766253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:32.766257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:32.766265Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2408 [1:7556535105152880270:14234]
2025-10-02T08:15:32.766278Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:32.766298Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:32.766302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.766306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.766308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.766325Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:32.766330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:32.766337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:32.766409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.766411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.766415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:32.766417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:32.766493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:32.766497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.766510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.766523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:32.766539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535105152880264:14234]
2025-10-02T08:15:32.766542Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535105152880264:14234]
2025-10-02T08:15:32.766549Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:32.766561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:32.766568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2408
2025-10-02T08:15:32.766576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:32.766579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:32.766579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:32.766582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:32.766590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152880249:14235], now have 1 active actors on pipe
2025-10-02T08:15:32.766626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535105612302324:2378], now have 1 active actors on pipe
2025-10-02T08:15:32.766629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535105152880264:14234]
2025-10-02T08:15:32.766632Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:32.766638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.766640Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:32.766643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.766689Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:32.766695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.766698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.766700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:32.766709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.766717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:32.766735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.767124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.767133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.767153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.767199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2409 partition: 0 MaxSeqNo: 17 sessionId: src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0
2025-10-02T08:15:32.769045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57efddf-1dc45386-bcc94fcf-8b8f0e2d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:32.769001Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2408
2025-10-02T08:15:32.771759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0] Write session: try to update token
2025-10-02T08:15:32.771778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:32.785900Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:32.785913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:32.785922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535105152880264:14234]
2025-10-02T08:15:32.785960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:32.785967Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:32.786133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:32.786269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:32.786444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:32.786590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:32.786786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:32.786813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:32.798217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId: src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:32.799132Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:32.799147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:32.799150Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:32.799159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535105152880264:14234]
2025-10-02T08:15:32.799164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535105152880264:14234]
2025-10-02T08:15:32.799208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:32.799215Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:32.799219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.799221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:32.799229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:32.799365Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:32.801017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:32.824914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535105152880296:14175]
2025-10-02T08:15:32.825068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2408, pipe: [1:7556535105152880296:14175]
2025-10-02T08:15:32.941011Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:32.941388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.941403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.941422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152880296:14175], now have 1 active actors on pipe
2025-10-02T08:15:32.941624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535105152880296:14175]
2025-10-02T08:15:32.941649Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:32.941651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:32.941653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:32.941714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2409 reason: error at write: Disconnected sessionId: src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0
2025-10-02T08:15:32.942051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:32.942060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0] Write session will restart in 0.009354s
2025-10-02T08:15:32.942089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0] Write session: Do CDS request
2025-10-02T08:15:32.942094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:32.941888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2409 sessionId: src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0 is DEAD
2025-10-02T08:15:32.942308Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:32.952259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.952393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:32.952408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2410
2025-10-02T08:15:32.952508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:32.952535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:32.952544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:32.952548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:32.952995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2410 sessionId:  describe result for acl check
2025-10-02T08:15:32.953028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:32.953034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:32.953036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:32.953042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535105152880347:14246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:32.953822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535105152880347:14246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:32.958006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535105152880347:14246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:32.961626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535105152880347:14246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:32.961639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535105152880347:14246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:32.961642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535105152880347:14246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:32.961650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:32.967345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:32.968615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:32.968793Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:32.968823Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:32.968832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:32.968873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:32.968909Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535105152880894:14245]
2025-10-02T08:15:32.969488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:32.969662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:32.969705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:32.969982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:32.970018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.970022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.970023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.970024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.970025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.970030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.970039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.970046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.970049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.970056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.970061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.970067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:32.970071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.970076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:32.970080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.970085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:32.970091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.970096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.970103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.970107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.970126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:32.978211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:32.979855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:32.979871Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:32.979872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:32.979875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:32.979880Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2409 [1:7556535105152880894:14245]
2025-10-02T08:15:32.979889Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:32.979902Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:32.979904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.979906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.979908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.979919Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:32.979922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:32.979929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:32.979977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.979982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.979984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:32.979987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:32.980034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:32.980039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.980048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:32.980054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:32.980067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535105152880888:14245]
2025-10-02T08:15:32.980078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535105152880888:14245]
2025-10-02T08:15:32.980088Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:32.980101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:32.980112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:32.980118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:32.980120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:32.980122Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:32.980130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535105152880747:14246], now have 1 active actors on pipe
2025-10-02T08:15:32.980142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535105612302345:2378], now have 1 active actors on pipe
2025-10-02T08:15:32.980168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535105152880888:14245]
2025-10-02T08:15:32.980177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:32.980214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2409
2025-10-02T08:15:32.980274Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2409
2025-10-02T08:15:32.980252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:32.980360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.980373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.980401Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:32.980413Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:32.980420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:32.980422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:32.980434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:32.980445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:32.980464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.980546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:32.980554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:32.980567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:32.980603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2410 partition: 0 MaxSeqNo: 17 sessionId: src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0
2025-10-02T08:15:32.980918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb9b2ed-62a0486c-b2f8daee-5071aff1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:32.983500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0] Write session: try to update token
2025-10-02T08:15:32.983516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:32.997185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId: src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:32.998072Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:32.998086Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:32.998089Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:32.998098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535105152880888:14245]
2025-10-02T08:15:32.998103Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535105152880888:14245]
2025-10-02T08:15:32.998146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:32.998152Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:32.998156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:32.998158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:32.998159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:32.998300Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:32.999762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:33.041969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535109447848219:14175]
2025-10-02T08:15:33.042128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2409, pipe: [1:7556535109447848219:14175]
2025-10-02T08:15:33.134263Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:33.134914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.134931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.134970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447848219:14175], now have 1 active actors on pipe
2025-10-02T08:15:33.135069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:33.135076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:33.135126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2410 reason: error at write: Disconnected sessionId: src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0
2025-10-02T08:15:33.135212Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:33.135421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:33.135429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0] Write session will restart in 0.006495s
2025-10-02T08:15:33.135451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0] Write session: Do CDS request
2025-10-02T08:15:33.135459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:33.135305Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:33.135288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2410 sessionId: src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0 is DEAD
2025-10-02T08:15:33.135420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535109447848219:14175]
2025-10-02T08:15:33.143269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.143366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:33.143379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2411
2025-10-02T08:15:33.143493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.143518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:33.143524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:33.143527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:33.143989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2411 sessionId:  describe result for acl check
2025-10-02T08:15:33.144016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:33.144018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:33.144020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:33.144025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535109447848261:14253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:33.144574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535109447848261:14253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:33.148362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535109447848261:14253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:33.151984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535109447848261:14253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:33.151997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535109447848261:14253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:33.152000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535109447848261:14253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:33.152018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:33.162248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:33.164321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:33.164508Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:33.164518Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:33.164528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:33.164577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:33.164614Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535109447848809:14252]
2025-10-02T08:15:33.165247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:33.165442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:33.165480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:33.165762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:33.165807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.165812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.165813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.165814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.165815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.165820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.165829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.165833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.165836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.165839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.165845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.165856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.165867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.165871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.165879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.165885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.165889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.165894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.165898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.165903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.165921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:33.177588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:33.179092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:33.179109Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:33.179112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:33.179116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:33.179124Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2410 [1:7556535109447848809:14252]
2025-10-02T08:15:33.179138Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:33.179157Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:33.179160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.179163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.179166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.179181Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:33.179186Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:33.179196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:33.179269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.179276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.179278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:33.179281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:33.179353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:33.179363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.179377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.179389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:33.179406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447848607:14253], now have 1 active actors on pipe
2025-10-02T08:15:33.179412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535109447848803:14252]
2025-10-02T08:15:33.179415Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535109447848803:14252]
2025-10-02T08:15:33.179422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:33.179432Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:33.179433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:33.179435Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:33.179447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:33.179450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:33.179456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535109907269650:2378], now have 1 active actors on pipe
2025-10-02T08:15:33.179487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535109447848803:14252]
2025-10-02T08:15:33.179494Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:33.179504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:33.179592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2410
2025-10-02T08:15:33.179819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.179830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.179864Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:33.179875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.179882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.179888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:33.179898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.179911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:33.179928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.179975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.179983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.179995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.180033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2411 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0
2025-10-02T08:15:33.180364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63e3d2d-5b8f3e4a-fcffed76-11dade82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:33.182983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0] Write session: try to update token
2025-10-02T08:15:33.182999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:33.180878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2410
2025-10-02T08:15:33.196850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId: src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:33.197388Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:33.197403Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:33.197405Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:33.197413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535109447848803:14252]
2025-10-02T08:15:33.197416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535109447848803:14252]
2025-10-02T08:15:33.197459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:33.197470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.197472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:33.197615Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:33.197653Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:33.197667Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:33.199410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:33.235591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535109447848834:14175]
2025-10-02T08:15:33.235767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2410, pipe: [1:7556535109447848834:14175]
2025-10-02T08:15:33.335835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:33.335849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0] Write session will restart in 0.008346s
2025-10-02T08:15:33.335873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0] Write session: Do CDS request
2025-10-02T08:15:33.335880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:33.334805Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:33.335277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.335285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.335317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447848834:14175], now have 1 active actors on pipe
2025-10-02T08:15:33.335445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:33.335449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:33.335515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2411 reason: error at write: Disconnected sessionId: src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0
2025-10-02T08:15:33.335671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2411 sessionId: src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0 is DEAD
2025-10-02T08:15:33.335845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535109447848834:14175]
2025-10-02T08:15:33.335998Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:33.338229Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:33.345884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.345954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:33.345970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2412
2025-10-02T08:15:33.346113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.346149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:33.346160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:33.346163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:33.346604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2412 sessionId:  describe result for acl check
2025-10-02T08:15:33.346652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:33.346658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:33.346660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:33.346665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535109447849191:14259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:33.347237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535109447849191:14259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:33.349560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535109447849191:14259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:33.358280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535109447849191:14259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:33.358296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535109447849191:14259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:33.358299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535109447849191:14259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:33.358309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:33.359944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:33.361879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:33.362067Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:33.362077Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:33.362085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:33.362130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:33.362170Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535109447849423:14258]
2025-10-02T08:15:33.362819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:33.363003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:33.363045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:33.363361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:33.363403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.363410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.363411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.363412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.363413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.363419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.363430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.363433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.363437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.363441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.363446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.363452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.363458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.363463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.363469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.363474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.363484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.363490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.363499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.363504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.363521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:33.373218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:33.375133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:33.375153Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:33.375156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:33.375160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:33.375166Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2411 [1:7556535109447849423:14258]
2025-10-02T08:15:33.375177Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:33.375196Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:33.375199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.375201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.375204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.375221Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:33.375226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:33.375233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:33.375293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.375301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.375304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:33.375306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:33.375365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:33.375371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.375385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.375547Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2411
2025-10-02T08:15:33.375402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:33.375424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535109447849417:14258]
2025-10-02T08:15:33.375426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535109447849417:14258]
2025-10-02T08:15:33.375434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2411
2025-10-02T08:15:33.375435Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:33.375447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447849402:14259], now have 1 active actors on pipe
2025-10-02T08:15:33.375453Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:33.375455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:33.375457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:33.375469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:33.375471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:33.375478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.375482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.375495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535109907269659:2378], now have 1 active actors on pipe
2025-10-02T08:15:33.375523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535109447849417:14258]
2025-10-02T08:15:33.375530Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:33.375537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:33.375543Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43b50f43-2a2751f2-139e918b-b4b25722_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:33.375548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.375552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.375554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:33.375565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.375574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:33.375606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.375712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.375715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.375731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.375777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2412 partition: 0 MaxSeqNo: 17 sessionId: src_id|43b50f43-2a2751f2-139e918b-b4b25722_0
2025-10-02T08:15:33.376112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec67bd51-ef6af18a-779f6abe-f696ea35_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|43b50f43-2a2751f2-139e918b-b4b25722_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:33.378592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43b50f43-2a2751f2-139e918b-b4b25722_0] Write session: try to update token
2025-10-02T08:15:33.378608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43b50f43-2a2751f2-139e918b-b4b25722_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:33.392070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId: src_id|43b50f43-2a2751f2-139e918b-b4b25722_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:33.393296Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:33.393317Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:33.393328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535109447849417:14258]
2025-10-02T08:15:33.393375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:33.393439Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:33.393584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:33.393745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:33.393892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:33.394049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:33.394263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:33.394303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:33.394890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:33.394955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.394971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.395002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:33.395027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:33.395075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.395087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.395251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.395316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.395384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.395456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.395958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.395972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.396048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.396121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.396203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.396278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.396326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.396334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.396407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.396477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.396547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.396616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.396664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.396671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.396744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.396847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.396920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.396990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.397042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.397051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.397124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.397192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.397263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.397332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.397380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.397387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.397461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.397527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.397595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.397670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.397720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.397727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.397798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.397869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.397946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.398018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.398081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.398088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.398161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.398233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.398308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.398383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.398433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.398441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.398511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.398596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.398666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.398739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.398789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.398797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.398868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:33.398943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:33.399012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:33.399081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:33.399135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:33.399142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:33.399185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:33.399256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.399280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.399286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:33.399319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:33.399336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:33.399344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:33.399347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:33.399350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:33.399780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:33.399809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:33.399816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:33.399819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:33.399822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:33.399826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:33.400564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:33.400592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:33.400599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:33.400602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:33.400606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:33.400611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:33.401234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:33.401261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:33.401267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:33.401272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:33.401275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:33.403738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:33.403757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:33.403769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392933403
2025-10-02T08:15:33.403912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:33.403928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:33.403939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:33.403943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:33.403948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:33.403951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:33.404474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:33.404497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:33.404504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:33.404507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:33.404514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:33.404518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:33.405020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:33.405048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:33.405058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:33.405062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:33.405066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:33.405071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:33.405542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:33.405567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:33.405572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:33.406796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:33.406817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:33.406822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:33.406826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:33.406835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392933406
2025-10-02T08:15:33.407153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:33.407175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:33.407187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:33.407193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:33.407201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:33.407204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:33.407706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:33.407732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:33.407738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:33.407743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:33.407746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:33.407750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:33.408250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:33.408271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.408385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392933408
2025-10-02T08:15:33.409235Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:33.409256Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:33.409263Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:33.409271Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:33.411080Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:33.411095Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:33.411097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:33.411107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535109447849417:14258]
2025-10-02T08:15:33.411111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535109447849417:14258]
2025-10-02T08:15:33.411166Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:33.411178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:33.411180Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:33.411183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.411187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:33.411335Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:33.440872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535109447849455:14175]
2025-10-02T08:15:33.444313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2411, pipe: [1:7556535109447849455:14175]
2025-10-02T08:15:33.551290Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:33.551693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447849455:14175], now have 1 active actors on pipe
2025-10-02T08:15:33.552371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43b50f43-2a2751f2-139e918b-b4b25722_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:33.552382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43b50f43-2a2751f2-139e918b-b4b25722_0] Write session will restart in 0.007078s
2025-10-02T08:15:33.552403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43b50f43-2a2751f2-139e918b-b4b25722_0] Write session: Do CDS request
2025-10-02T08:15:33.552410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43b50f43-2a2751f2-139e918b-b4b25722_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:33.551812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:33.551820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:33.551847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2412 reason: error at write: Disconnected sessionId: src_id|43b50f43-2a2751f2-139e918b-b4b25722_0
2025-10-02T08:15:33.551931Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:33.552013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2412 sessionId: src_id|43b50f43-2a2751f2-139e918b-b4b25722_0 is DEAD
2025-10-02T08:15:33.552182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535109447849455:14175]
2025-10-02T08:15:33.552958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:33.560273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43b50f43-2a2751f2-139e918b-b4b25722_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.560360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:33.560375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2413
2025-10-02T08:15:33.560485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.560514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:33.560524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:33.560527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:33.561074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2413 sessionId:  describe result for acl check
2025-10-02T08:15:33.561102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:33.561104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:33.561105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:33.561110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535109447849732:14266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:33.561655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535109447849732:14266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:33.564317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535109447849732:14266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:33.567274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535109447849732:14266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:33.567288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535109447849732:14266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:33.567291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535109447849732:14266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:33.567299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:33.575287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:33.581861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:33.582044Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:33.582053Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:33.582062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:33.582136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:33.582176Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535109447850048:14265]
2025-10-02T08:15:33.582688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:33.583005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:33.583070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:33.583395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:33.583444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.583458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.583463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.583465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.583466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.583471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.583486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.583495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.583499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.583506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.583512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.583524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.583533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.583543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.583551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.583556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.583560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.583566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.583570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.583579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.583603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:33.596066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:33.597945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:33.597964Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:33.597967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:33.597970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:33.597978Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2412 [1:7556535109447850048:14265]
2025-10-02T08:15:33.597990Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:33.598006Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:33.598009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.598013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.598016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.598030Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:33.598048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:33.598053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:33.598115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.598122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.598126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:33.598128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:33.598191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:33.598198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.598210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.598228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:33.598252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447849880:14266], now have 1 active actors on pipe
2025-10-02T08:15:33.598259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535109447850041:14265]
2025-10-02T08:15:33.598260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2412
2025-10-02T08:15:33.598261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535109447850041:14265]
2025-10-02T08:15:33.598268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:33.598282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:33.598284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:33.598287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:33.598296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:33.598299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:33.598304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535109907269664:2378], now have 1 active actors on pipe
2025-10-02T08:15:33.598309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.598312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.598353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535109447850041:14265]
2025-10-02T08:15:33.598365Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:33.598378Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:33.598389Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2412
2025-10-02T08:15:33.598380Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edef9c72-1d393480-4b92ced5-344f44bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:33.598386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.598390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.598392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:33.598401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.598408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:33.598445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.598503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.598510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.598522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.598559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2413 partition: 0 MaxSeqNo: 17 sessionId: src_id|edef9c72-1d393480-4b92ced5-344f44bb_0
2025-10-02T08:15:33.598893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43b50f43-2a2751f2-139e918b-b4b25722_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|edef9c72-1d393480-4b92ced5-344f44bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:33.601668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edef9c72-1d393480-4b92ced5-344f44bb_0] Write session: try to update token
2025-10-02T08:15:33.601684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edef9c72-1d393480-4b92ced5-344f44bb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:33.616471Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:33.616486Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:33.616489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:33.616497Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535109447850041:14265]
2025-10-02T08:15:33.616501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535109447850041:14265]
2025-10-02T08:15:33.616541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:33.616552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.616555Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:33.616557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:33.616561Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:33.616688Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:33.616751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId: src_id|edef9c72-1d393480-4b92ced5-344f44bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:33.619352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:33.651811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535109447850072:14175]
2025-10-02T08:15:33.651907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2412, pipe: [1:7556535109447850072:14175]
2025-10-02T08:15:33.751884Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:33.752455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.752471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.752510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447850072:14175], now have 1 active actors on pipe
2025-10-02T08:15:33.753016Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:33.753329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:33.753386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2413 reason: status is not ok: tablet will be restarted right now sessionId: src_id|edef9c72-1d393480-4b92ced5-344f44bb_0
2025-10-02T08:15:33.753538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2413 sessionId: src_id|edef9c72-1d393480-4b92ced5-344f44bb_0 is DEAD
2025-10-02T08:15:33.753687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535109447850072:14175]
2025-10-02T08:15:33.753789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edef9c72-1d393480-4b92ced5-344f44bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:33.753798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edef9c72-1d393480-4b92ced5-344f44bb_0] Write session will restart in 0.006175s
2025-10-02T08:15:33.753822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edef9c72-1d393480-4b92ced5-344f44bb_0] Write session: Do CDS request
2025-10-02T08:15:33.753831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edef9c72-1d393480-4b92ced5-344f44bb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:33.753691Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:33.761263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edef9c72-1d393480-4b92ced5-344f44bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.762201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:33.762214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2414
2025-10-02T08:15:33.762374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.762404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:33.762412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:33.762415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:33.763749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2414 sessionId:  describe result for acl check
2025-10-02T08:15:33.763781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:33.763783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:33.763785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:33.763789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535109447850317:14278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:33.764280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535109447850317:14278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:33.768298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535109447850317:14278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:33.771618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535109447850317:14278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:33.771634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535109447850317:14278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:33.771637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535109447850317:14278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:33.771645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:33.784239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:33.786148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:33.786431Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:33.786441Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:33.786453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:33.786513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:33.786552Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535109447850709:14277]
2025-10-02T08:15:33.787015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:33.787225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:33.787263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:33.787520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:33.787567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.787572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.787573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.787574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.787575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.787579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.787588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.787591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.787595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.787598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.787603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.787610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.787615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.787620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.787627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.787632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.787636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.787642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.787646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.787654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.787670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:33.796243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:33.798143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:33.798161Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:33.798163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:33.798167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:33.798173Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2413 [1:7556535109447850709:14277]
2025-10-02T08:15:33.798186Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:33.798203Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:33.798207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.798210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.798211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.798226Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:33.798238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:33.798244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:33.798307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.798315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.798317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:33.798320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:33.798381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:33.798389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.798403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.798420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:33.798442Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535109447850703:14277]
2025-10-02T08:15:33.798448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535109447850703:14277]
2025-10-02T08:15:33.798463Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:33.798480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:33.798498Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:33.798505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:33.798519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:33.798530Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:33.798536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535109447850703:14277]
2025-10-02T08:15:33.798544Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:33.798593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2413
2025-10-02T08:15:33.798598Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:33.798606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447850469:14278], now have 1 active actors on pipe
2025-10-02T08:15:33.798644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535109907269684:2378], now have 1 active actors on pipe
2025-10-02T08:15:33.798654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.798658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.798687Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:33.798697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.798705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.798707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:33.798717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.798730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:33.798748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.798855Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2413
2025-10-02T08:15:33.798912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.798921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.798938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.798973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2414 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0
2025-10-02T08:15:33.799750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edef9c72-1d393480-4b92ced5-344f44bb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:33.802724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0] Write session: try to update token
2025-10-02T08:15:33.802740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:33.818544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId: src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:33.821158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:33.822357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.822374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.822393Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:33.822395Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:33.822397Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:33.822403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535109447850703:14277]
2025-10-02T08:15:33.822406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535109447850703:14277]
2025-10-02T08:15:33.822449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:33.822453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:33.822454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.822456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:33.822459Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:33.822585Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:33.854029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535109447850748:14175]
2025-10-02T08:15:33.854146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2413, pipe: [1:7556535109447850748:14175]
2025-10-02T08:15:33.957451Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:33.957943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:33.957993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447850748:14175], now have 1 active actors on pipe
2025-10-02T08:15:33.958033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:33.958104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:33.958113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:33.958132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2414 reason: error at write: Disconnected sessionId: src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0
2025-10-02T08:15:33.958256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2414 sessionId: src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0 is DEAD
2025-10-02T08:15:33.958380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:33.958391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0] Write session will restart in 0.007192s
2025-10-02T08:15:33.958414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0] Write session: Do CDS request
2025-10-02T08:15:33.958421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:33.958871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535109447850748:14175]
2025-10-02T08:15:33.959618Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:33.968754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.969070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:33.969084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2415
2025-10-02T08:15:33.969205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:33.969232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:33.969241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:33.969244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:33.970208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2415 sessionId:  describe result for acl check
2025-10-02T08:15:33.970244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:33.970246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:33.970248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:33.970253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535109447850987:14291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:33.970768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535109447850987:14291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:33.973295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535109447850987:14291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:33.976461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535109447850987:14291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:33.976475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535109447850987:14291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:33.976478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535109447850987:14291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:33.976486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:33.983592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:33.985144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:33.985452Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:33.985463Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:33.985475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:33.985528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:33.985564Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535109447851344:14290]
2025-10-02T08:15:33.986212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:33.986408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:33.986460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:33.986785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:33.986830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.986836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.986837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.986838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.986840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.986845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.986856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.986861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.986870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.986874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.986880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.986887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:33.986893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.986899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:33.986904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.986910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:33.986916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.986925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.986929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.986935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.986955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:33.994783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:33.996616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:33.996634Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:33.996637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:33.996640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:33.996647Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2414 [1:7556535109447851344:14290]
2025-10-02T08:15:33.996658Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:33.996675Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:33.996677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.996681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.996683Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.996697Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:33.996703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:33.996709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:33.996774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.996783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.996786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:33.996789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:33.996871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:33.996878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:33.996891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:33.996907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:33.996928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535109447851191:14291], now have 1 active actors on pipe
2025-10-02T08:15:33.996929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2414
2025-10-02T08:15:33.996935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535109907269715:2378], now have 1 active actors on pipe
2025-10-02T08:15:33.996942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535109447851338:14290]
2025-10-02T08:15:33.996944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535109447851338:14290]
2025-10-02T08:15:33.996959Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:33.996972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.996976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.997047Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2414
2025-10-02T08:15:33.996982Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:33.996993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:33.996994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:33.997008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:33.997011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:33.997050Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:33.997056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:33.997059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:33.997061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:33.997071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:33.997079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:33.997085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535109447851338:14290]
2025-10-02T08:15:33.997089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:33.997097Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:33.997114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.997179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:33.997186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:33.997200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:33.997238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2415 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0
2025-10-02T08:15:33.997546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecbad82-aa9e34c2-ae104739-655ad083_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:34.000068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0] Write session: try to update token
2025-10-02T08:15:34.000081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:34.012667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId: src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:34.014317Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:34.014331Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:34.014333Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:34.014339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535109447851338:14290]
2025-10-02T08:15:34.014343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535109447851338:14290]
2025-10-02T08:15:34.014374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:34.014379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.014381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:34.014445Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:34.014460Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:34.014500Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:34.015386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:34.056769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535113742818665:14175]
2025-10-02T08:15:34.056919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2414, pipe: [1:7556535113742818665:14175]
2025-10-02T08:15:34.142603Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:34.143046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.143058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.143094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742818665:14175], now have 1 active actors on pipe
2025-10-02T08:15:34.143198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535113742818665:14175]
2025-10-02T08:15:34.143219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:34.143220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:34.143267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2415 reason: error at write: Disconnected sessionId: src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0
2025-10-02T08:15:34.143304Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:34.143382Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:34.143424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2415 sessionId: src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0 is DEAD
2025-10-02T08:15:34.143853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:34.143862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0] Write session will restart in 0.005705s
2025-10-02T08:15:34.143886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0] Write session: Do CDS request
2025-10-02T08:15:34.143892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:34.150271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.150622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:34.150637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2416
2025-10-02T08:15:34.150764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.150802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:34.150813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:34.150816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:34.151242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2416 sessionId:  describe result for acl check
2025-10-02T08:15:34.151271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:34.151273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:34.151274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:34.151279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535113742818931:14298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:34.151764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535113742818931:14298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:34.154516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535113742818931:14298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:34.157982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535113742818931:14298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:34.157995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535113742818931:14298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:34.157998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535113742818931:14298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:34.158005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:34.163631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:34.165322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:34.165523Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:34.165535Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:34.165545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:34.165598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:34.165636Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535113742819264:14297]
2025-10-02T08:15:34.166241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:34.166414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:34.166451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:34.166729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:34.166792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.166798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.166799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.166800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.166801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.166807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.166819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.166827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.166831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.166839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.166845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.166857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.166862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.166870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.166879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.166888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.166896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.166906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.166914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.166919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.166938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:34.174594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:34.176016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:34.176033Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:34.176036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:34.176039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:34.176045Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2415 [1:7556535113742819264:14297]
2025-10-02T08:15:34.176054Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:34.176068Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:34.176070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.176072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.176073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.176086Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:34.176088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:34.176093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:34.176154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.176160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.176163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:34.176165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:34.176340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2415
2025-10-02T08:15:34.176341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:34.176344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.176359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.176370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:34.176388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535114202237018:2378], now have 1 active actors on pipe
2025-10-02T08:15:34.176398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742819127:14298], now have 1 active actors on pipe
2025-10-02T08:15:34.176403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.176408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.176378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2415
2025-10-02T08:15:34.176429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535113742819258:14297]
2025-10-02T08:15:34.176435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535113742819258:14297]
2025-10-02T08:15:34.176442Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:34.176447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:34.176449Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:34.176456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:34.176469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:34.176475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:34.176496Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:34.176506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.176509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.176515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:34.176524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.176532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:34.176561Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535113742819258:14297]
2025-10-02T08:15:34.176570Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:34.176583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:34.176586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.176629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.176635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.176649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.176687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2416 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0
2025-10-02T08:15:34.176992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c70aa01-a4f0efe4-3666f12a-51cac597_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:34.179646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0] Write session: try to update token
2025-10-02T08:15:34.179670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:34.186865Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:34.186884Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:34.186892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535113742819258:14297]
2025-10-02T08:15:34.186934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:34.186947Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:34.187103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:34.187250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:34.187392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:34.187538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:34.187727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:34.187775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:34.192202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId: src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:34.194494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:34.194550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.194561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.194598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:34.194617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:34.194655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.194668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.194809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.194866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.194923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.194980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.195291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.195299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.195361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.195411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.195461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.195517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.195556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.195561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.195616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.195667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.195725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.195777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.195816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.195821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.195879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.195935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.195989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.196045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.196085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.196091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.196163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.196216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.196271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.196327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.196370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.196375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.196432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.196485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.196539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.196594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.196633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.196638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.196695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.196749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.196840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.196899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.197005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.197012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.197068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.197121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.197179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.197234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.197273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.197278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.197335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.197388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.197441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.197499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.197538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.197543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.197600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.197655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.197711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.197777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.197815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.197820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.197848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:34.197898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.197915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.197917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:34.197940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:34.197953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:34.197955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:34.197957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:34.197959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:34.198287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:34.198309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:34.198313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:34.198315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:34.198317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:34.198319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:34.198887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:34.198907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:34.198917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:34.198921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:34.198928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:34.198930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:34.199424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:34.199442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:34.199445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:34.199447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:34.199449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:34.201372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:34.201387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:34.201395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392934201
2025-10-02T08:15:34.201544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:34.201554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:34.201557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:34.201560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:34.201562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:34.201566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:34.202053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:34.202070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:34.202074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:34.202076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:34.202078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:34.202082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:34.202466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:34.202480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:34.202484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:34.202486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:34.202488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:34.202490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:34.202866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:34.202881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:34.202884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:34.203818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:34.203831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:34.203835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:34.203838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:34.203844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392934203
2025-10-02T08:15:34.204080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:34.204095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:34.204101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:34.204103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:34.204106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:34.204111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:34.204509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:34.204524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:34.204527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:34.204532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:34.204535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:34.204537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:34.204966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:34.204986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.205078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392934204
2025-10-02T08:15:34.208402Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:34.208418Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:34.208424Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:34.208428Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:34.209880Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:34.209891Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:34.209892Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:34.209898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535113742819258:14297]
2025-10-02T08:15:34.209900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535113742819258:14297]
2025-10-02T08:15:34.209948Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:34.209955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:34.209958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:34.209959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.209961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:34.210088Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:34.243155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535113742819297:14175]
2025-10-02T08:15:34.243256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2415, pipe: [1:7556535113742819297:14175]
2025-10-02T08:15:34.343739Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:34.344032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742819297:14175], now have 1 active actors on pipe
2025-10-02T08:15:34.344148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:34.344158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:34.344188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2416 reason: error at write: Disconnected sessionId: src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0
2025-10-02T08:15:34.344250Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:34.344277Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:34.344368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2416 sessionId: src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0 is DEAD
2025-10-02T08:15:34.344516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:34.344524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0] Write session will restart in 0.006059s
2025-10-02T08:15:34.344548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0] Write session: Do CDS request
2025-10-02T08:15:34.344539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535113742819297:14175]
2025-10-02T08:15:34.344554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:34.351263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.351336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:34.351348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2417
2025-10-02T08:15:34.351546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.351576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:34.351583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:34.351586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:34.352002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2417 sessionId:  describe result for acl check
2025-10-02T08:15:34.352027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:34.352039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:34.352040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:34.352044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535113742819603:14304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:34.352438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535113742819603:14304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:34.355328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535113742819603:14304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:34.359171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535113742819603:14304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:34.359185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535113742819603:14304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:34.359188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535113742819603:14304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:34.359196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:34.362000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:34.363416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:34.363614Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:34.363626Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:34.363635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:34.363683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:34.363718Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535113742819897:14303]
2025-10-02T08:15:34.364292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:34.364470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:34.364508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:34.364778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:34.364842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.364847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.364848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.364849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.364850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.364855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.364864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.364871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.364874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.364877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.364883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.364890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.364899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.364904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.364913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.364917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.364922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.364927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.364930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.364938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.364955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:34.372579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:34.374263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:34.374277Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:34.374279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:34.374281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:34.374286Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2416 [1:7556535113742819897:14303]
2025-10-02T08:15:34.374293Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:34.374307Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:34.374308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.374310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.374312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.374323Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:34.374326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:34.374331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:34.374376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.374383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.374385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:34.374386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:34.374444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:34.374451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.374459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.374466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:34.374478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742819857:14304], now have 1 active actors on pipe
2025-10-02T08:15:34.374482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535113742819891:14303]
2025-10-02T08:15:34.374484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535113742819891:14303]
2025-10-02T08:15:34.374488Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:34.374495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535114202237027:2378], now have 1 active actors on pipe
2025-10-02T08:15:34.374501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:34.374502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:34.374506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:34.374508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:34.374508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2416
2025-10-02T08:15:34.374510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:34.374532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535113742819891:14303]
2025-10-02T08:15:34.374541Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:34.374545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.374548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.374550Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:34.374580Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:34.374588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.374591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.374593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:34.374599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.374606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:34.374582Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2416
2025-10-02T08:15:34.374624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.374651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.374656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.374665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.374694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2417 partition: 0 MaxSeqNo: 17 sessionId: src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0
2025-10-02T08:15:34.374982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9347ea5-66de1e2c-a48f6cc4-a0e696ad_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:34.377475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0] Write session: try to update token
2025-10-02T08:15:34.377487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:34.389911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId: src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:34.391715Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:34.391733Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:34.391735Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:34.391745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535113742819891:14303]
2025-10-02T08:15:34.391750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535113742819891:14303]
2025-10-02T08:15:34.391790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:34.391801Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:34.391804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.391806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:34.391807Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:34.391955Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:34.392617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:34.444891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535113742819922:14175]
2025-10-02T08:15:34.445060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2416, pipe: [1:7556535113742819922:14175]
2025-10-02T08:15:34.526453Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:34.526924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.526935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.526974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742819922:14175], now have 1 active actors on pipe
2025-10-02T08:15:34.527064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:34.527074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:34.527113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2417 reason: error at write: Disconnected sessionId: src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0
2025-10-02T08:15:34.527211Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:34.527432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:34.527442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0] Write session will restart in 0.009666s
2025-10-02T08:15:34.527467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0] Write session: Do CDS request
2025-10-02T08:15:34.527473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:34.527224Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:34.527271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2417 sessionId: src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0 is DEAD
2025-10-02T08:15:34.527369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535113742819922:14175]
2025-10-02T08:15:34.538365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.538457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:34.538473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2418
2025-10-02T08:15:34.538582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.538612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:34.538622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:34.538625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:34.539050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2418 sessionId:  describe result for acl check
2025-10-02T08:15:34.539087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:34.539093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:34.539095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:34.539101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535113742820367:14311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:34.539608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535113742820367:14311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:34.542158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535113742820367:14311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:34.545943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:34.546098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535113742820367:14311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:34.546112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535113742820367:14311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:34.546116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535113742820367:14311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:34.546124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:34.546367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:34.546537Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:34.546549Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:34.546559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:34.546611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:34.546652Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535113742820525:14310]
2025-10-02T08:15:34.547309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:34.547496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:34.547536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:34.547830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:34.547873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.547878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.547879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.547880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.547881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.547887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.547897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.547904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.547908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.547916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.547921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.547932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.547938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.547942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.547946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.547951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.547960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.547965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.547974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.547979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.548000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:34.560020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:34.562009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:34.562031Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:34.562034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:34.562037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:34.562043Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2417 [1:7556535113742820525:14310]
2025-10-02T08:15:34.562058Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:34.562076Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:34.562079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.562082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.562084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.562099Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:34.562106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:34.562112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:34.562180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.562189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.562192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:34.562194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:34.562258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:34.562266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.562280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.562297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:34.562316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535113742820513:14310]
2025-10-02T08:15:34.562323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535113742820513:14310]
2025-10-02T08:15:34.562330Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:34.562341Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:34.562345Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:34.562348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742820521:14311], now have 1 active actors on pipe
2025-10-02T08:15:34.562352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2417
2025-10-02T08:15:34.562355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535114202237033:2378], now have 1 active actors on pipe
2025-10-02T08:15:34.562360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:34.562373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:34.562381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:34.562416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.562425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.562438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535113742820513:14310]
2025-10-02T08:15:34.562446Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:34.562448Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:34.562420Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2417
2025-10-02T08:15:34.562471Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:34.562486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.562490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.562492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:34.562500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.562509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:34.562536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.562585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.562592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.562604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.562642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2418 partition: 0 MaxSeqNo: 17 sessionId: src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0
2025-10-02T08:15:34.562969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0bd1ab-aa46e24c-a58ba82f-78ca6d90_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:34.565683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0] Write session: try to update token
2025-10-02T08:15:34.565697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:34.579332Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:34.579347Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:34.579349Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:34.579356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535113742820513:14310]
2025-10-02T08:15:34.579360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535113742820513:14310]
2025-10-02T08:15:34.579391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:34.579397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.579398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:34.579405Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:34.579411Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:34.579525Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:34.583169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId: src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:34.585737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:34.627672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535113742820553:14175]
2025-10-02T08:15:34.628766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2417, pipe: [1:7556535113742820553:14175]
2025-10-02T08:15:34.721275Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:34.721579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.721588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.721629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742820553:14175], now have 1 active actors on pipe
2025-10-02T08:15:34.722462Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:34.722802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:34.722859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2418 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0
2025-10-02T08:15:34.723019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2418 sessionId: src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0 is DEAD
2025-10-02T08:15:34.723145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535113742820553:14175]
2025-10-02T08:15:34.722265Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:34.724882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:34.724893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0] Write session will restart in 0.006673s
2025-10-02T08:15:34.724930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0] Write session: Do CDS request
2025-10-02T08:15:34.724936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:34.732278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.732425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:34.732441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2419
2025-10-02T08:15:34.732932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.732964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:34.732969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:34.732972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:34.734292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2419 sessionId:  describe result for acl check
2025-10-02T08:15:34.734324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:34.734325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:34.734327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:34.734332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535113742820843:14319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:34.734901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535113742820843:14319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:34.742277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535113742820843:14319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:34.746167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535113742820843:14319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:34.746182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535113742820843:14319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:34.746186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535113742820843:14319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:34.746194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:34.749070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:34.749550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:34.749761Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:34.749764Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:34.749774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:34.749826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:34.749858Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535113742821159:14318]
2025-10-02T08:15:34.750491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:34.750699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:34.750744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:34.751065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:34.751097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.751098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.751099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.751100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.751101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.751106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.751117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.751131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.751135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.751139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.751145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.751153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.751158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.751164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.751168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.751173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.751178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.751183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.751188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.751193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.751212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:34.759994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:34.761533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:34.761551Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:34.761554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:34.761558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:34.761565Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2418 [1:7556535113742821159:14318]
2025-10-02T08:15:34.761577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:34.761594Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:34.761597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.761600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.761603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.761617Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:34.761622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:34.761630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:34.761698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.761705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.761709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:34.761713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:34.761780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:34.761791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.761804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.761816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:34.761832Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535113742821153:14318]
2025-10-02T08:15:34.761834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535113742821153:14318]
2025-10-02T08:15:34.761842Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:34.761853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:34.761867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:34.761870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:34.761881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742821148:14319], now have 1 active actors on pipe
2025-10-02T08:15:34.761893Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:34.761896Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:34.761909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535113742821153:14318]
2025-10-02T08:15:34.761912Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:34.761917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535114202237039:2378], now have 1 active actors on pipe
2025-10-02T08:15:34.761957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2418
2025-10-02T08:15:34.762050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:34.762147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.762157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.762180Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:34.762191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.762195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.762197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:34.762207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.762220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:34.762737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2cfe82-7c4bc476-995b7aad-ca4efef2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:34.762136Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2418
2025-10-02T08:15:34.765519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0] Write session: try to update token
2025-10-02T08:15:34.765535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:34.762236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.762317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.762319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.762337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.762367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2419 partition: 0 MaxSeqNo: 17 sessionId: src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0
2025-10-02T08:15:34.781358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:34.781383Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:34.781398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535113742821153:14318]
2025-10-02T08:15:34.781460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:34.781577Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:34.781672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:34.781844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:34.782013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:34.782182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:34.782883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:34.782939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:34.787638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId: src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:34.790395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:34.790487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.790496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.790528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:34.790548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:34.790668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.790678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.790832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.790897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.790963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.791030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.791089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.791104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.791174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.791239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.791305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.791379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.791427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.791437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.791507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.791569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.791635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.791700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.791833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.791844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.791914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.791980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.792040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.792110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.792168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.792170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.792242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.792301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.792362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.792435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.792480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.792483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.792552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.792614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.792672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.792741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.792783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.792786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.792874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.792931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.792996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.793060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.793114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.793123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.793192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.793254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.793323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.793381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.793423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.793426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.793489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.793546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.793605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.793662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.793703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.793706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.793777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:34.793836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:34.793898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:34.793960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:34.794001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:34.794004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:34.794065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:34.794122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.794140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.794142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:34.794172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:34.794184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:34.794187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:34.794190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:34.794194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:34.794589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:34.794606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:34.794612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:34.794616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:34.794620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:34.794623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:34.795109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:34.795123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:34.795129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:34.795132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:34.795135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:34.795138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:34.795644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:34.795656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:34.795662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:34.795666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:34.795668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:34.796951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:34.796985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:34.797001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392934796
2025-10-02T08:15:34.797123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:34.797136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:34.797142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:34.797146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:34.797154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:34.797158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:34.797675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:34.797699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:34.797706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:34.797709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:34.797712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:34.797715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:34.798202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:34.798225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:34.798232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:34.798235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:34.798239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:34.798242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:34.798702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:34.798725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:34.798731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:34.799821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:34.799840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:34.799845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:34.799849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:34.799860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392934799
2025-10-02T08:15:34.800177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:34.800197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:34.800203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:34.800211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:34.800214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:34.800217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:34.800681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:34.800703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:34.800708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:34.800717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:34.800721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:34.800725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:34.801206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:34.801229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.801328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392934801
2025-10-02T08:15:34.803860Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:34.803887Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:34.803894Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:34.803900Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:34.803911Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:34.803912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:34.803915Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:34.803921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535113742821153:14318]
2025-10-02T08:15:34.803926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535113742821153:14318]
2025-10-02T08:15:34.803953Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:34.803957Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:34.804004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:34.804013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.804015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:34.804155Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:34.829388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535113742821200:14175]
2025-10-02T08:15:34.829703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2418, pipe: [1:7556535113742821200:14175]
2025-10-02T08:15:34.954243Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:34.954693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742821200:14175], now have 1 active actors on pipe
2025-10-02T08:15:34.954863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535113742821200:14175]
2025-10-02T08:15:34.954887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:34.954889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:34.954921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2419 reason: error at write: Disconnected sessionId: src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0
2025-10-02T08:15:34.954925Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:34.955057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2419 sessionId: src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0 is DEAD
2025-10-02T08:15:34.955188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:34.955201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0] Write session will restart in 0.007337s
2025-10-02T08:15:34.955226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0] Write session: Do CDS request
2025-10-02T08:15:34.955234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:34.955228Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:34.962683Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f492ce56c1ffebc7] Result# TEvPutResult {Id# [72075186224037892:2418:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:15:34.962703Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2418:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:34.962740Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2418:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:34.963267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.963706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:34.963720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2420
2025-10-02T08:15:34.963854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:34.963887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:34.963898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:34.963910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:34.964821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2420 sessionId:  describe result for acl check
2025-10-02T08:15:34.964858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:34.964864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:34.964866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:34.964871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535113742821475:11219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:34.965381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535113742821475:11219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:34.967849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535113742821475:11219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:34.973536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535113742821475:11219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:34.973548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535113742821475:11219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:34.973551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535113742821475:11219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:34.973559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:34.980936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:34.982928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:34.983237Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:34.983245Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:34.983254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:34.983314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:34.983345Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535113742821846:11186]
2025-10-02T08:15:34.983802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:34.984118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:34.984161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:34.984384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:34.984412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.984413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.984413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.984414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.984415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.984418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.984425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.984427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.984429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.984431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.984434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.984439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:34.984442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.984445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:34.984447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.984450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:34.984453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.984456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.984459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.984464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.984483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:34.994769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:34.996466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:34.996483Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:34.996487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:34.996491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:34.996497Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2419 [1:7556535113742821846:11186]
2025-10-02T08:15:34.996509Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:34.996527Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:34.996532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.996535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.996537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.996552Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:34.996563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:34.996569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:34.996633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.996640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.996643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:34.996646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:34.996709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:34.996716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:34.996729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:34.996745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:34.996765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535113742821840:11186]
2025-10-02T08:15:34.996777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535113742821840:11186]
2025-10-02T08:15:34.996785Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:34.996796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:34.996816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2419
2025-10-02T08:15:34.996830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:34.996833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:34.996843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535113742821686:11219], now have 1 active actors on pipe
2025-10-02T08:15:34.996848Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:34.996857Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:34.996874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535114202237082:2378], now have 1 active actors on pipe
2025-10-02T08:15:34.996881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535113742821840:11186]
2025-10-02T08:15:34.996884Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:34.996891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.996895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.996936Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:34.996946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:34.996950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:34.996952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:34.996960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:34.996972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:34.996992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.997037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:34.997089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:34.997096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:34.997109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:34.997142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2420 partition: 0 MaxSeqNo: 17 sessionId: src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0
2025-10-02T08:15:34.997111Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2419
2025-10-02T08:15:34.997491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a73dcc20-d5e6d456-1f5eefb3-eed25fbf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:35.000114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0] Write session: try to update token
2025-10-02T08:15:35.000144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:35.013674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId: src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:35.015491Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:35.015510Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:35.015513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:35.015524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535113742821840:11186]
2025-10-02T08:15:35.015529Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535113742821840:11186]
2025-10-02T08:15:35.015581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:35.015596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.015599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:35.015599Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:35.015610Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:35.015742Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:35.016407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:35.055446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535118037789167:14175]
2025-10-02T08:15:35.055678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2419, pipe: [1:7556535118037789167:14175]
2025-10-02T08:15:35.158145Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:35.158548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.158565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.158609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037789167:14175], now have 1 active actors on pipe
2025-10-02T08:15:35.158737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535118037789167:14175]
2025-10-02T08:15:35.158762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:35.158765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:35.158817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2420 reason: error at write: Disconnected sessionId: src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0
2025-10-02T08:15:35.158878Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:35.158973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2420 sessionId: src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0 is DEAD
2025-10-02T08:15:35.159112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:35.159120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0] Write session will restart in 0.006686s
2025-10-02T08:15:35.159143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0] Write session: Do CDS request
2025-10-02T08:15:35.159151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:35.159171Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:35.167220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.167336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:35.167350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2421
2025-10-02T08:15:35.167453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.167479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:35.167486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:35.167489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:35.167870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2421 sessionId:  describe result for acl check
2025-10-02T08:15:35.167905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:35.167906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:35.167908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:35.167913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535118037789497:11285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:35.168334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535118037789497:11285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:35.171062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535118037789497:11285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:35.174064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535118037789497:11285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:35.174075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535118037789497:11285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:35.174077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535118037789497:11285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:35.174083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:35.176120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:35.177612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:35.177771Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:35.177779Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:35.177786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:35.177819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:35.177845Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535118037789776:11242]
2025-10-02T08:15:35.178312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:35.178485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:35.178512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:35.178761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:35.178825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.178830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.178831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.178832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.178834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.178838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.178848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.178851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.178854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.178858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.178863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.178870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.178875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.178879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.178883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.178891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.178895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.178900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.178904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.178915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.178934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:35.186380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:35.187896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:35.187911Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:35.187913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:35.187917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:35.187925Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2420 [1:7556535118037789776:11242]
2025-10-02T08:15:35.187937Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:35.187952Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:35.187959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.187962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.187964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.187979Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:35.187988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:35.187994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:35.188048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.188053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.188055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:35.188057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:35.188117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:35.188124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.188144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.188156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:35.188176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535118497204385:2378], now have 1 active actors on pipe
2025-10-02T08:15:35.188187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535118037789770:11242]
2025-10-02T08:15:35.188190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535118037789770:11242]
2025-10-02T08:15:35.188192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2420
2025-10-02T08:15:35.188197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:35.188204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037789740:11285], now have 1 active actors on pipe
2025-10-02T08:15:35.188206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:35.188209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:35.188211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:35.188223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:35.188232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:35.188239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.188247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.188283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535118037789770:11242]
2025-10-02T08:15:35.188291Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:35.188300Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:35.188305Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:35.188310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.188313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.188316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:35.188324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.188266Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2420
2025-10-02T08:15:35.188338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:35.188379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.188444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.188450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.188462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.188498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2421 partition: 0 MaxSeqNo: 17 sessionId: src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0
2025-10-02T08:15:35.188787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e756bafd-59a1b298-29f008e1-fdd14e82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:35.191512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0] Write session: try to update token
2025-10-02T08:15:35.191529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:35.205294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId: src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:35.205410Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:35.205422Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:35.205425Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:35.205434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535118037789770:11242]
2025-10-02T08:15:35.205438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535118037789770:11242]
2025-10-02T08:15:35.205483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:35.205487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:35.205493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.205493Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:35.205495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:35.205629Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:35.207937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:35.258956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535118037789801:14175]
2025-10-02T08:15:35.259076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2420, pipe: [1:7556535118037789801:14175]
2025-10-02T08:15:35.344936Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:35.345458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.345473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.345507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037789801:14175], now have 1 active actors on pipe
2025-10-02T08:15:35.345630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535118037789801:14175]
2025-10-02T08:15:35.345648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:35.345649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:35.345696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2421 reason: error at write: Disconnected sessionId: src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0
2025-10-02T08:15:35.345770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:35.345750Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:35.345831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2421 sessionId: src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0 is DEAD
2025-10-02T08:15:35.346001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:35.346008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0] Write session will restart in 0.007702s
2025-10-02T08:15:35.346033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0] Write session: Do CDS request
2025-10-02T08:15:35.346039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:35.355295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.355312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:35.355326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2422
2025-10-02T08:15:35.355510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.355542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:35.355550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:35.355553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:35.356146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2422 sessionId:  describe result for acl check
2025-10-02T08:15:35.356183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:35.356190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:35.356192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:35.356197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535118037790156:11314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:35.356618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535118037790156:11314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:35.359526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535118037790156:11314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:35.369331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:35.369555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535118037790156:11314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:35.369570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535118037790156:11314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:35.369574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535118037790156:11314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:35.369584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:35.371558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:35.371743Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:35.371752Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:35.371760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:35.371801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:35.371836Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535118037790411:11284]
2025-10-02T08:15:35.372428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:35.372605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:35.372642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:35.372935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:35.372977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.372982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.372983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.372984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.372985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.372990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.372999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.373006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.373010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.373018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.373022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.373032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.373041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.373045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.373048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.373057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.373061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.373066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.373073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.373077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.373094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:35.381751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:35.383786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:35.383812Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:35.383815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:35.383819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:35.383825Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2421 [1:7556535118037790411:11284]
2025-10-02T08:15:35.383839Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:35.383857Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:35.383860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.383863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.383865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.383881Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:35.383893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:35.383899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:35.383964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.383975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.383977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:35.383980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:35.384048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:35.384050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.384064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.384076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:35.384098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535118037790398:11284]
2025-10-02T08:15:35.384100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535118037790398:11284]
2025-10-02T08:15:35.384110Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:35.384123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:35.384151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:35.384154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:35.384194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037790406:11314], now have 1 active actors on pipe
2025-10-02T08:15:35.384198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535118037790398:11284]
2025-10-02T08:15:35.384188Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:35.384201Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:35.384204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:35.384211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:35.384225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535118497204393:2378], now have 1 active actors on pipe
2025-10-02T08:15:35.384250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2421
2025-10-02T08:15:35.384643Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2421
2025-10-02T08:15:35.384606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.384622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.384652Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:35.384661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.384667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.384669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:35.384681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.384692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:35.384710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.384746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.384754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.384774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.384820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2422 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0
2025-10-02T08:15:35.385147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a6a3998-385a37e2-4bbe8fe9-6eec15f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:35.387699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0] Write session: try to update token
2025-10-02T08:15:35.387715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:35.404279Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:35.404299Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:35.404302Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:35.404312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535118037790398:11284]
2025-10-02T08:15:35.404317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535118037790398:11284]
2025-10-02T08:15:35.404365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:35.404371Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:35.404376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.404377Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:35.404379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:35.404515Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:35.405738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId: src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:35.408359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:35.445834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535118037790436:14175]
2025-10-02T08:15:35.446074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2421, pipe: [1:7556535118037790436:14175]
2025-10-02T08:15:35.552450Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:35.552715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.552728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.552766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037790436:14175], now have 1 active actors on pipe
2025-10-02T08:15:35.552980Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:35.553295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:35.553305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0] Write session will restart in 0.007613s
2025-10-02T08:15:35.553329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0] Write session: Do CDS request
2025-10-02T08:15:35.553335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:35.552903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535118037790436:14175]
2025-10-02T08:15:35.552931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:35.552933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:35.553003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2422 reason: error at write: Disconnected sessionId: src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0
2025-10-02T08:15:35.553165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2422 sessionId: src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0 is DEAD
2025-10-02T08:15:35.553509Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:35.562298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.562311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:35.562325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2423
2025-10-02T08:15:35.562529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.562560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:35.562565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:35.562570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:35.562975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2423 sessionId:  describe result for acl check
2025-10-02T08:15:35.563014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:35.563016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:35.563019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:35.563025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535118037790802:11331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:35.563493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535118037790802:11331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:35.565654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535118037790802:11331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:35.568371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535118037790802:11331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:35.568383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535118037790802:11331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:35.568386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535118037790802:11331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:35.568393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:35.577459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:35.579277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:35.579470Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:35.579479Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:35.579488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:35.579533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:35.579572Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535118037791049:11333]
2025-10-02T08:15:35.580251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:35.580475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:35.580520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:35.580834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:35.580883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.580889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.580890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.580891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.580893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.580897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.580908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.580912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.580921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.580925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.580931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.580953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.580963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.580967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.580977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.580983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.580987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.580997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.581002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.581012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.581032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:35.591344Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2422
2025-10-02T08:15:35.589224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:35.590936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:35.590942Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:35.590944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:35.590947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:35.590954Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2422 [1:7556535118037791049:11333]
2025-10-02T08:15:35.590966Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:35.590984Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:35.590987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.590990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.590992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.591006Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:35.591011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:35.591017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:35.591077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.591079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.591082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:35.591084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:35.591163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:35.591166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.591179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.591193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:35.591211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037790835:11331], now have 1 active actors on pipe
2025-10-02T08:15:35.591217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535118037791043:11333]
2025-10-02T08:15:35.591219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535118037791043:11333]
2025-10-02T08:15:35.591226Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:35.591228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2422
2025-10-02T08:15:35.591238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535118497204399:2378], now have 1 active actors on pipe
2025-10-02T08:15:35.591238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:35.591241Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:35.591244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:35.591259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:35.591262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:35.591270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.591274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.591313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535118037791043:11333]
2025-10-02T08:15:35.591323Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:35.591334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:35.591338Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:35.591345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.591350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.591352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:35.591362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.591371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:35.591400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.591490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.591498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.591526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.591574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2423 partition: 0 MaxSeqNo: 17 sessionId: src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0
2025-10-02T08:15:35.591923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc025b21-30d5e6bf-9fc09d52-17febdd3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:35.594641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0] Write session: try to update token
2025-10-02T08:15:35.594656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:35.610242Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:35.610262Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:35.610264Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:35.610272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535118037791043:11333]
2025-10-02T08:15:35.610277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535118037791043:11333]
2025-10-02T08:15:35.610318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:35.610319Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:35.610325Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:35.610333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.610335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:35.610479Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:35.610613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId: src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:35.613104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:35.653213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535118037791074:14175]
2025-10-02T08:15:35.653324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2422, pipe: [1:7556535118037791074:14175]
2025-10-02T08:15:35.759825Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:35.760417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.760431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.760470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037791074:14175], now have 1 active actors on pipe
2025-10-02T08:15:35.760570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:35.760577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:35.760627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2423 reason: error at write: Disconnected sessionId: src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0
2025-10-02T08:15:35.760719Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:35.760707Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:35.760776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2423 sessionId: src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0 is DEAD
2025-10-02T08:15:35.760897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:35.760906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0] Write session will restart in 0.007715s
2025-10-02T08:15:35.760928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0] Write session: Do CDS request
2025-10-02T08:15:35.760933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:35.760942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535118037791074:14175]
2025-10-02T08:15:35.769314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.769392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:35.769405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2424
2025-10-02T08:15:35.769506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.769534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:35.769542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:35.769545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:35.770001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2424 sessionId:  describe result for acl check
2025-10-02T08:15:35.770032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:35.770033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:35.770035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:35.770039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535118037791410:11353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:35.770529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535118037791410:11353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:35.773166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535118037791410:11353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:35.777320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535118037791410:11353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:35.777333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535118037791410:11353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:35.777335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535118037791410:11353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:35.777341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:35.780847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:35.781258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:35.781494Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:35.781504Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:35.781513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:35.781558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:35.781595Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535118037791691:11377]
2025-10-02T08:15:35.782224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:35.782454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:35.782491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:35.782773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:35.782811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.782817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.782818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.782819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.782820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.782826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.782835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.782839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.782844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.782847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.782853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.782860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.782865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.782870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.782875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.782879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.782884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.782893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.782899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.782907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.782927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:35.790484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:35.792199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:35.792215Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:35.792217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:35.792220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:35.792226Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2423 [1:7556535118037791691:11377]
2025-10-02T08:15:35.792237Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:35.792252Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:35.792255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.792258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.792260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.792275Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:35.792280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:35.792285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:35.792344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.792352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.792357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:35.792360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:35.792419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:35.792426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.792437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.792447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:35.792462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535118037791685:11377]
2025-10-02T08:15:35.792468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535118037791685:11377]
2025-10-02T08:15:35.792476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:35.792487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:35.792488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2423
2025-10-02T08:15:35.792489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037791660:11353], now have 1 active actors on pipe
2025-10-02T08:15:35.792495Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:35.792497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:35.792510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:35.792512Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:35.792518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535118497204406:2378], now have 1 active actors on pipe
2025-10-02T08:15:35.792545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.792554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.792567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535118037791685:11377]
2025-10-02T08:15:35.792577Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:35.792584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:35.792606Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0f09be9-10f66869-56f1d371-5478c635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:35.792615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.792619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.792621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:35.792588Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2423
2025-10-02T08:15:35.792629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.792639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:35.792663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.792728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.792747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.792764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.792822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2424 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0f09be9-10f66869-56f1d371-5478c635_0
2025-10-02T08:15:35.793135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775ff4e4-3d8340c2-dab8c268-de4d5297_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0f09be9-10f66869-56f1d371-5478c635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:35.795830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f09be9-10f66869-56f1d371-5478c635_0] Write session: try to update token
2025-10-02T08:15:35.795845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f09be9-10f66869-56f1d371-5478c635_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:35.808975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId: src_id|a0f09be9-10f66869-56f1d371-5478c635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:35.809715Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:35.809726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:35.809728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:35.809734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535118037791685:11377]
2025-10-02T08:15:35.809737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535118037791685:11377]
2025-10-02T08:15:35.809769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:35.809777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.809779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:35.809783Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:35.809789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:35.809906Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:35.811287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:35.871646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535118037791730:14175]
2025-10-02T08:15:35.872456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2423, pipe: [1:7556535118037791730:14175]
2025-10-02T08:15:35.948186Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:35.948537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.948544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.948575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037791730:14175], now have 1 active actors on pipe
2025-10-02T08:15:35.948852Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:35.948883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:35.949511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f09be9-10f66869-56f1d371-5478c635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:35.949521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f09be9-10f66869-56f1d371-5478c635_0] Write session will restart in 0.005502s
2025-10-02T08:15:35.949544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f09be9-10f66869-56f1d371-5478c635_0] Write session: Do CDS request
2025-10-02T08:15:35.949550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f09be9-10f66869-56f1d371-5478c635_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:35.949034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535118037791730:14175]
2025-10-02T08:15:35.949050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:35.949091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2424 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0f09be9-10f66869-56f1d371-5478c635_0
2025-10-02T08:15:35.949221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2424 sessionId: src_id|a0f09be9-10f66869-56f1d371-5478c635_0 is DEAD
2025-10-02T08:15:35.956275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f09be9-10f66869-56f1d371-5478c635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.956320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:35.956333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2425
2025-10-02T08:15:35.956450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:35.956478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:35.956483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:35.956486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:35.957196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2425 sessionId:  describe result for acl check
2025-10-02T08:15:35.957227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:35.957233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:35.957235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:35.957240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535118037792025:11421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:35.957730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535118037792025:11421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:35.960166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535118037792025:11421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:35.962947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535118037792025:11421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:35.962960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535118037792025:11421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:35.962963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535118037792025:11421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:35.962970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:35.968354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:35.970112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:35.970309Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:35.970317Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:35.970325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:35.970364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:35.970391Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535118037792382:11425]
2025-10-02T08:15:35.970878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:35.971053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:35.971091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:35.971371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:35.971410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.971415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.971417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.971418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.971419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.971424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.971434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.971437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.971441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.971444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.971450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.971456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:35.971462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.971467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:35.971471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.971476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:35.971480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.971485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.971490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.971494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.971514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:35.979825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:35.981376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:35.981395Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:35.981397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:35.981401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:35.981407Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2424 [1:7556535118037792382:11425]
2025-10-02T08:15:35.981417Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:35.981431Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:35.981432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.981435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.981437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.981449Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:35.981452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:35.981457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:35.981510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.981517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.981520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:35.981521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:35.981573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:35.981580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:35.981592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:35.981605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:35.981623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535118037792376:11425]
2025-10-02T08:15:35.981628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535118037792376:11425]
2025-10-02T08:15:35.981634Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:35.981644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:35.981648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:35.981654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:35.981662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:35.981670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2424
2025-10-02T08:15:35.981671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:35.981680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535118037792259:11421], now have 1 active actors on pipe
2025-10-02T08:15:35.981683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535118497204450:2378], now have 1 active actors on pipe
2025-10-02T08:15:35.981709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.981715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.981726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535118037792376:11425]
2025-10-02T08:15:35.981732Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:35.981750Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:35.981755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:35.981757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:35.981762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:35.981763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:35.981771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:35.981724Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2424
2025-10-02T08:15:35.981777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:35.981797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.981839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:35.981845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:35.981856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:35.981895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2425 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0
2025-10-02T08:15:35.982209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f09be9-10f66869-56f1d371-5478c635_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:35.984894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0] Write session: try to update token
2025-10-02T08:15:35.984907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:35.998793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId: src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:36.000194Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:36.000212Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:36.000215Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:36.000223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535118037792376:11425]
2025-10-02T08:15:36.000227Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535118037792376:11425]
2025-10-02T08:15:36.000273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:36.000280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.000282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:36.000328Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:36.000335Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:36.000430Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:36.001370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:36.047898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535122332759703:14175]
2025-10-02T08:15:36.048101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2424, pipe: [1:7556535122332759703:14175]
2025-10-02T08:15:36.151005Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:36.151740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.151750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.151792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332759703:14175], now have 1 active actors on pipe
2025-10-02T08:15:36.151971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535122332759703:14175]
2025-10-02T08:15:36.152000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:36.152006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:36.152146Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:36.152464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:36.152474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0] Write session will restart in 0.009915s
2025-10-02T08:15:36.152503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0] Write session: Do CDS request
2025-10-02T08:15:36.152509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:36.152093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2425 reason: error at write: Disconnected sessionId: src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0
2025-10-02T08:15:36.152100Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:36.152299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2425 sessionId: src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0 is DEAD
2025-10-02T08:15:36.163384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.164967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:36.164982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2426
2025-10-02T08:15:36.168899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.168953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:36.168965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:36.168969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:36.169662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2426 sessionId:  describe result for acl check
2025-10-02T08:15:36.169704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:36.169705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:36.169707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:36.169712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535122332760193:11494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:36.170228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535122332760193:11494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:36.173487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535122332760193:11494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:36.176973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535122332760193:11494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:36.176987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535122332760193:11494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:36.176991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535122332760193:11494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:36.176998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:36.184721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:36.187162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:36.187393Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:36.187408Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:36.187419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:36.187491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:36.187531Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535122332760322:11451]
2025-10-02T08:15:36.188299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:36.188580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:36.188639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:36.189004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:36.189076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.189085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.189086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.189087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.189089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.189094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.189105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.189110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.189114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.189118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.189124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.189132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.189138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.189143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.189147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.189152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.189157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.189162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.189167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.189172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.189190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:36.198602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:36.200031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:36.200047Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:36.200050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:36.200054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:36.200061Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2425 [1:7556535122332760322:11451]
2025-10-02T08:15:36.200071Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:36.200087Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:36.200090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.200092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.200095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.200109Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:36.200114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:36.200122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:36.200183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.200189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.200191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:36.200193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:36.200255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:36.200262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.200277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.200291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:36.200314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535122332760316:11451]
2025-10-02T08:15:36.200320Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535122332760316:11451]
2025-10-02T08:15:36.200340Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:36.200351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2425
2025-10-02T08:15:36.200355Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:36.200357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:36.200358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332760302:11494], now have 1 active actors on pipe
2025-10-02T08:15:36.200364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:36.200375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:36.200378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:36.200383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535122792171752:2378], now have 1 active actors on pipe
2025-10-02T08:15:36.200387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.200390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.200429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535122332760316:11451]
2025-10-02T08:15:36.200437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:36.200450Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c46d656d-e73147c5-95552054-20515426_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:36.200461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.200469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.200471Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:36.200480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.200492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:36.200508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:36.200533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.200866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.200894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.200960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.201018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2426 partition: 0 MaxSeqNo: 17 sessionId: src_id|c46d656d-e73147c5-95552054-20515426_0
2025-10-02T08:15:36.200613Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2425
2025-10-02T08:15:36.201303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9d7a7b-26513324-e89201d7-abe2aad0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c46d656d-e73147c5-95552054-20515426_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:36.206524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46d656d-e73147c5-95552054-20515426_0] Write session: try to update token
2025-10-02T08:15:36.206543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46d656d-e73147c5-95552054-20515426_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:36.221909Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:36.221933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:36.221937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:36.221946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535122332760316:11451]
2025-10-02T08:15:36.221950Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535122332760316:11451]
2025-10-02T08:15:36.221996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:36.222003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.222006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:36.222033Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:36.222048Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:36.222174Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:36.226399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId: src_id|c46d656d-e73147c5-95552054-20515426_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:36.229027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:36.252297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535122332760347:14175]
2025-10-02T08:15:36.252485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2425, pipe: [1:7556535122332760347:14175]
2025-10-02T08:15:36.361509Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:36.361989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.362003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.362040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332760347:14175], now have 1 active actors on pipe
2025-10-02T08:15:36.362155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535122332760347:14175]
2025-10-02T08:15:36.362180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:36.362187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:36.362250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2426 reason: error at write: Disconnected sessionId: src_id|c46d656d-e73147c5-95552054-20515426_0
2025-10-02T08:15:36.362250Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:36.362233Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:36.362408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2426 sessionId: src_id|c46d656d-e73147c5-95552054-20515426_0 is DEAD
2025-10-02T08:15:36.362560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46d656d-e73147c5-95552054-20515426_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:36.362570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46d656d-e73147c5-95552054-20515426_0] Write session will restart in 0.005831s
2025-10-02T08:15:36.362594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46d656d-e73147c5-95552054-20515426_0] Write session: Do CDS request
2025-10-02T08:15:36.362599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46d656d-e73147c5-95552054-20515426_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:36.369277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46d656d-e73147c5-95552054-20515426_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.369428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:36.369445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2427
2025-10-02T08:15:36.369573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.369611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:36.369626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:36.369637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:36.370067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2427 sessionId:  describe result for acl check
2025-10-02T08:15:36.370100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:36.370105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:36.370106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:36.370110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535122332760603:11490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:36.370535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535122332760603:11490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:36.372612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535122332760603:11490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:36.375600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535122332760603:11490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:36.375614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535122332760603:11490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:36.375616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535122332760603:11490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:36.375623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:36.382875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:36.383223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:36.383373Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:36.383381Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:36.383389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:36.383426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:36.383457Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535122332760967:11484]
2025-10-02T08:15:36.384013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:36.384193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:36.384228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:36.384485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:36.384521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.384526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.384527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.384528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.384529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.384533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.384542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.384546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.384549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.384551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.384555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.384562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.384566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.384571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.384575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.384579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.384583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.384587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.384591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.384595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.384612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:36.392362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:36.393712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:36.393724Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:36.393725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:36.393729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:36.393734Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2426 [1:7556535122332760967:11484]
2025-10-02T08:15:36.393742Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:36.393756Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:36.393762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.393765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.393766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.393778Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:36.393781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:36.393787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:36.393831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.393837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.393841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:36.393843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:36.393892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:36.393898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.393905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.393912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:36.393924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332760819:11490], now have 1 active actors on pipe
2025-10-02T08:15:36.393932Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535122332760961:11484]
2025-10-02T08:15:36.393933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535122332760961:11484]
2025-10-02T08:15:36.393938Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:36.393942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2426
2025-10-02T08:15:36.393946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:36.393949Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:36.393952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:36.393955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:36.393957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:36.393961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535122792171761:2378], now have 1 active actors on pipe
2025-10-02T08:15:36.393964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.393967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.393998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535122332760961:11484]
2025-10-02T08:15:36.394008Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:36.394014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:36.394026Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:36.394035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.394039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.394045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:36.394053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.394060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:36.394070Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2426
2025-10-02T08:15:36.394300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.394331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.394336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.394347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.394375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2427 partition: 0 MaxSeqNo: 17 sessionId: src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0
2025-10-02T08:15:36.394666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46d656d-e73147c5-95552054-20515426_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:36.397251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0] Write session: try to update token
2025-10-02T08:15:36.397266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:36.410909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId: src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:36.412868Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:36.412882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:36.412885Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:36.412893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535122332760961:11484]
2025-10-02T08:15:36.412897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535122332760961:11484]
2025-10-02T08:15:36.412936Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:36.412939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:36.412939Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:36.412946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.412948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:36.413090Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:36.413447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:36.462301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535122332760993:14175]
2025-10-02T08:15:36.462403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2426, pipe: [1:7556535122332760993:14175]
2025-10-02T08:15:36.556737Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:36.557526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.557543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.557580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332760993:14175], now have 1 active actors on pipe
2025-10-02T08:15:36.557673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:36.557684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:36.557743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2427 reason: error at write: Disconnected sessionId: src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0
2025-10-02T08:15:36.557785Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:36.557877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:36.558052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:36.558060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0] Write session will restart in 0.005617s
2025-10-02T08:15:36.558082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0] Write session: Do CDS request
2025-10-02T08:15:36.558088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:36.557913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2427 sessionId: src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0 is DEAD
2025-10-02T08:15:36.558038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535122332760993:14175]
2025-10-02T08:15:36.565278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.565364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:36.565378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2428
2025-10-02T08:15:36.565465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.565492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:36.565500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:36.565503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:36.565913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2428 sessionId:  describe result for acl check
2025-10-02T08:15:36.565940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:36.565942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:36.565944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:36.565948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535122332761274:11522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:36.566430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535122332761274:11522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:36.568652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535122332761274:11522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:36.571803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535122332761274:11522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:36.571815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535122332761274:11522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:36.571818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535122332761274:11522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:36.571825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:36.578458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:36.580038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:36.580313Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:36.580322Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:36.580333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:36.580390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:36.580429Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535122332761616:11518]
2025-10-02T08:15:36.581099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:36.581286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:36.581334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:36.581633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:36.581684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.581686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.581687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.581688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.581689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.581694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.581704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.581708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.581711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.581725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.581730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.581736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.581742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.581747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.581750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.581755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.581759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.581763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.581767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.581772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.581789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:36.592237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:36.594228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:36.594246Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:36.594249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:36.594253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:36.594260Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2427 [1:7556535122332761616:11518]
2025-10-02T08:15:36.594272Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:36.594290Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:36.594293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.594297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.594299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.594316Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:36.594321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:36.594329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:36.594395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.594410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.594416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:36.594418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:36.594492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:36.594500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.594514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.594528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:36.594551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332761464:11522], now have 1 active actors on pipe
2025-10-02T08:15:36.594562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535122332761610:11518]
2025-10-02T08:15:36.594564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535122332761610:11518]
2025-10-02T08:15:36.594580Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:36.594593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535122792171768:2378], now have 1 active actors on pipe
2025-10-02T08:15:36.594601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:36.594621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:36.594631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:36.594667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535122332761610:11518]
2025-10-02T08:15:36.594675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:36.594688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:36.594698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:36.594705Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:36.594717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2427
2025-10-02T08:15:36.594745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.594754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.594780Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:36.594791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.594795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.594797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:36.594806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.594820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:36.594840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.594922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.594937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.594965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.595009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2428 partition: 0 MaxSeqNo: 17 sessionId: src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0
2025-10-02T08:15:36.595360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2427
2025-10-02T08:15:36.595409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc52c05-a8d17d7-cc99786b-a728a5a7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:36.598054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0] Write session: try to update token
2025-10-02T08:15:36.598073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:36.612621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId: src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:36.615374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:36.615442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.615451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.617369Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:36.617386Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:36.617388Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:36.617396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535122332761610:11518]
2025-10-02T08:15:36.617401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535122332761610:11518]
2025-10-02T08:15:36.617443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:36.617446Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:36.617452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:36.617460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:36.617467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.617469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:36.617488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:36.617614Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:36.658242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535122332761641:14175]
2025-10-02T08:15:36.658351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2427, pipe: [1:7556535122332761641:14175]
2025-10-02T08:15:36.754767Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:36.755001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.755012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.755167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.755239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.755305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.755362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.755406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.755414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.755479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.755537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.755610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.755678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.755721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.755729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.755795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.755851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.755907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.755977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.756027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.756033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.756096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.756174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.756242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.756310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.756353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.756359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.756423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.756481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.756542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.756605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.756657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.756663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.756725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.756790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.756866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.756928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.756971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.756977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.757038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.757095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.757164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.757227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.757273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.757280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.757342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.757401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.757462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.757524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.757566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.757572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.757634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.757700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.757757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.757824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.757865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.757870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.757933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.757990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.758051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.758111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.758237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.758244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.758312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332761641:14175], now have 1 active actors on pipe
2025-10-02T08:15:36.758456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535122332761641:14175]
2025-10-02T08:15:36.758503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:36.758510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:36.758518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:36.758540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2428 reason: error at write: Disconnected sessionId: src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0
2025-10-02T08:15:36.758709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2428 sessionId: src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0 is DEAD
2025-10-02T08:15:36.758811Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:36.759037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:36.759046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0] Write session will restart in 0.005747s
2025-10-02T08:15:36.759063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0] Write session: Do CDS request
2025-10-02T08:15:36.759068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:36.766269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.766344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:36.766359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2429
2025-10-02T08:15:36.766498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.766523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:36.766532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:36.766536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:36.766909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2429 sessionId:  describe result for acl check
2025-10-02T08:15:36.766943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:36.766950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:36.766952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:36.766957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535122332761922:11562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:36.767437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535122332761922:11562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:36.770566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535122332761922:11562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:36.773432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535122332761922:11562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:36.773443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535122332761922:11562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:36.773445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535122332761922:11562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:36.773451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:36.777920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:36.779656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:36.779822Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:36.779829Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:36.779836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:36.779893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:36.779922Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535122332762268:11561]
2025-10-02T08:15:36.780396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:36.780591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:36.780633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:36.780898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:36.780953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.780958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.780958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.780959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.780960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.780963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.780969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.780971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.780973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.780975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.780979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.780984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.780987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.780990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.780993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.780997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.781003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.781007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.781012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.781017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.781036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:36.789857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:36.791607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:36.791626Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:36.791628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:36.791631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:36.791637Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2428 [1:7556535122332762268:11561]
2025-10-02T08:15:36.791650Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:36.791666Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:36.791670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.791673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.791674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.791686Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:36.791689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:36.791694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:36.791740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.791746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.791748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:36.791750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:36.791805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:36.791812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.791823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.791832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:36.791852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535122332762262:11561]
2025-10-02T08:15:36.791857Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535122332762262:11561]
2025-10-02T08:15:36.791864Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:36.791876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332762170:11562], now have 1 active actors on pipe
2025-10-02T08:15:36.791875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:36.791876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2428
2025-10-02T08:15:36.791879Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:36.791887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:36.791898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:36.791901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:36.791906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535122792171776:2378], now have 1 active actors on pipe
2025-10-02T08:15:36.791912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.791919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.791958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535122332762262:11561]
2025-10-02T08:15:36.791972Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:36.791978Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:36.791988Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1992cc25-93260388-82048ddf-3e8b6319_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:36.791994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.791998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.791999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:36.792007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.792015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:36.792000Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2428
2025-10-02T08:15:36.792042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.792086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.792092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.792105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.792151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2429 partition: 0 MaxSeqNo: 17 sessionId: src_id|1992cc25-93260388-82048ddf-3e8b6319_0
2025-10-02T08:15:36.792420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3844949-4db969d2-a4fb8572-b7ed8a32_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1992cc25-93260388-82048ddf-3e8b6319_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:36.794710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1992cc25-93260388-82048ddf-3e8b6319_0] Write session: try to update token
2025-10-02T08:15:36.794722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1992cc25-93260388-82048ddf-3e8b6319_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:36.807423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId: src_id|1992cc25-93260388-82048ddf-3e8b6319_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:36.809903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:36.810889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.810906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.810926Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:36.810932Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:36.810933Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:36.810939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535122332762262:11561]
2025-10-02T08:15:36.810942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535122332762262:11561]
2025-10-02T08:15:36.810971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:36.810980Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:36.810981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:36.810986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.810987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:36.811115Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:36.858441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535122332762294:14175]
2025-10-02T08:15:36.858564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2428, pipe: [1:7556535122332762294:14175]
2025-10-02T08:15:36.943278Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:36.943613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:36.943650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332762294:14175], now have 1 active actors on pipe
2025-10-02T08:15:36.943660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:36.943760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535122332762294:14175]
2025-10-02T08:15:36.943777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:36.943784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:36.943801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2429 reason: error at write: Disconnected sessionId: src_id|1992cc25-93260388-82048ddf-3e8b6319_0
2025-10-02T08:15:36.943890Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:36.943946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2429 sessionId: src_id|1992cc25-93260388-82048ddf-3e8b6319_0 is DEAD
2025-10-02T08:15:36.944078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992cc25-93260388-82048ddf-3e8b6319_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:36.944088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992cc25-93260388-82048ddf-3e8b6319_0] Write session will restart in 0.005816s
2025-10-02T08:15:36.944111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992cc25-93260388-82048ddf-3e8b6319_0] Write session: Do CDS request
2025-10-02T08:15:36.944120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992cc25-93260388-82048ddf-3e8b6319_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:36.951290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1992cc25-93260388-82048ddf-3e8b6319_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.951328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:36.951341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2430
2025-10-02T08:15:36.951510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:36.951540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:36.951545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:36.951547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:36.951948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2430 sessionId:  describe result for acl check
2025-10-02T08:15:36.951980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:36.951985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:36.951987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:36.951992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535122332762636:11713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:36.952484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535122332762636:11713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:36.955263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535122332762636:11713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:36.958473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535122332762636:11713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:36.958489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535122332762636:11713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:36.958493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535122332762636:11713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:36.958501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:36.962466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:36.964400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:36.964591Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:36.964600Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:36.964609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:36.964652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:36.964684Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535122332762968:11677]
2025-10-02T08:15:36.965273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:36.965473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:36.965509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:36.965786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:36.965834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.965839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.965841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.965842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.965843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.965848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.965857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.965861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.965864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.965868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.965873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.965880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:36.965906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.965911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:36.965916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.965921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:36.965925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.965930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.965935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.965941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.965959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:36.974011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:36.975514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:36.975530Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:36.975532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:36.975536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:36.975542Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2429 [1:7556535122332762968:11677]
2025-10-02T08:15:36.975553Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:36.975569Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:36.975572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.975575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.975578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.975592Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:36.975597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:36.975605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:36.975669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.975676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.975679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:36.975681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:36.975743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:36.975750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:36.975762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:36.975772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2429
2025-10-02T08:15:36.975775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:36.975792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535122332762889:11713], now have 1 active actors on pipe
2025-10-02T08:15:36.975796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535122792171820:2378], now have 1 active actors on pipe
2025-10-02T08:15:36.975800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.975804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.975820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535122332762962:11677]
2025-10-02T08:15:36.975826Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535122332762962:11677]
2025-10-02T08:15:36.975837Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:36.975854Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:36.975857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:36.975858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:36.975871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:36.975873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:36.975854Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2429
2025-10-02T08:15:36.975888Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eef49075-90032725-3ceb73a8-c1227f06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:36.975893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:36.975896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:36.975898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:36.975906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:36.975914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:36.975943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535122332762962:11677]
2025-10-02T08:15:36.975956Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:36.975968Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:36.975970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.976012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.976019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.976032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:36.976065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2430 partition: 0 MaxSeqNo: 17 sessionId: src_id|eef49075-90032725-3ceb73a8-c1227f06_0
2025-10-02T08:15:36.976488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992cc25-93260388-82048ddf-3e8b6319_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eef49075-90032725-3ceb73a8-c1227f06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:36.978910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef49075-90032725-3ceb73a8-c1227f06_0] Write session: try to update token
2025-10-02T08:15:36.978924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef49075-90032725-3ceb73a8-c1227f06_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:36.987999Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:36.988016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:36.988023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535122332762962:11677]
2025-10-02T08:15:36.988068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:36.988244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:36.988382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:36.988514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:36.988648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:36.988851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:36.988890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:36.988960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:36.996517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId: src_id|eef49075-90032725-3ceb73a8-c1227f06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:36.998993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:36.999063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.999079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.999112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:36.999140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:36.999179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:36.999198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:36.999370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.999434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.999500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:36.999565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:36.999781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:36.999792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:36.999862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:36.999929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:36.999996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.000065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.000112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.000122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.000202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.000265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.000327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.000392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.000439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.000447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.000515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.000583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.000658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.000729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.000784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.000791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.000880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.000945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.001013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.001081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.001131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.001138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.001207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.001270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.001339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.001407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.001458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.001466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.001536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.001601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.001895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.001965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.002008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.002016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.002083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.002149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.002218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.002285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.002330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.002338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.002405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.002469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.002536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.002606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.002651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.002658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.002726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.002791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.002856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.002921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.002968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.002976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.003016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:37.003081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.003105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.003111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:37.003142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:37.003158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:37.003166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:37.003169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:37.003172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:37.003597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:37.003625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:37.003638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:37.003642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:37.003645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:37.003648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:37.004300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:37.004322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:37.004327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:37.004335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:37.004338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:37.004341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:37.004829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:37.004849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:37.004855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:37.004858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:37.004865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:37.007061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:37.007081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:37.007095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392937006
2025-10-02T08:15:37.007278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:37.007293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:37.007297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:37.007300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:37.007304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:37.007307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:37.007798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:37.007821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:37.007827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:37.007833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:37.007837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:37.007840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:37.008342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:37.008365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:37.008374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:37.008378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:37.008383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:37.008391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:37.008909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:37.008928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:37.008934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:37.010073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:37.010090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:37.010096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:37.010101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:37.010111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392937009
2025-10-02T08:15:37.010424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:37.010447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:37.010452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:37.010459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:37.010462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:37.010464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:37.010883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:37.010900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:37.010903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:37.010906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:37.010908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:37.010911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:37.011339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:37.011356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.011435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392937010
2025-10-02T08:15:37.012166Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:37.012183Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:37.012189Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:37.012192Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:37.013741Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:37.013752Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:37.013753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:37.013761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535122332762962:11677]
2025-10-02T08:15:37.013764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535122332762962:11677]
2025-10-02T08:15:37.013810Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:37.013813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:37.013816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.013817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:37.013820Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:37.013937Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:37.043776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535126627730301:14175]
2025-10-02T08:15:37.043882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2429, pipe: [1:7556535126627730301:14175]
2025-10-02T08:15:37.152363Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:37.152781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627730301:14175], now have 1 active actors on pipe
2025-10-02T08:15:37.152929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535126627730301:14175]
2025-10-02T08:15:37.152951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:37.152957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:37.152981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2430 reason: error at write: Disconnected sessionId: src_id|eef49075-90032725-3ceb73a8-c1227f06_0
2025-10-02T08:15:37.152998Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:37.153000Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:37.153141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2430 sessionId: src_id|eef49075-90032725-3ceb73a8-c1227f06_0 is DEAD
2025-10-02T08:15:37.153275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef49075-90032725-3ceb73a8-c1227f06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:37.153287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef49075-90032725-3ceb73a8-c1227f06_0] Write session will restart in 0.009691s
2025-10-02T08:15:37.153311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef49075-90032725-3ceb73a8-c1227f06_0] Write session: Do CDS request
2025-10-02T08:15:37.153319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef49075-90032725-3ceb73a8-c1227f06_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:37.164286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef49075-90032725-3ceb73a8-c1227f06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.164367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:37.164397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2431
2025-10-02T08:15:37.164513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.164547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:37.164558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:37.164561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:37.164949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2431 sessionId:  describe result for acl check
2025-10-02T08:15:37.164983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:37.164989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:37.164990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:37.164995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535126627730806:11764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:37.165486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535126627730806:11764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:37.167854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535126627730806:11764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:37.170904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535126627730806:11764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:37.170919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535126627730806:11764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:37.170922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535126627730806:11764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:37.170930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:37.171117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:37.171585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:37.171751Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:37.171771Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:37.171784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:37.171831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:37.172061Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535126627731007:11777]
2025-10-02T08:15:37.172672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:37.172877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:37.172915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:37.173175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:37.173232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.173237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.173238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.173239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.173240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.173245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.173253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.173256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.173259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.173262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.173267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.173273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.173278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.173283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.173287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.173306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.173314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.173318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.173322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.173326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.173342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:37.185686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:37.187174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:37.187189Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:37.187192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:37.187196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:37.187203Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2430 [1:7556535126627731007:11777]
2025-10-02T08:15:37.187215Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:37.187233Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:37.187237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.187240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.187242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.187259Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:37.187264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:37.187271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:37.187330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.187337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.187340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:37.187341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:37.187392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:37.187398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.187406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.187413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:37.187424Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535126627730999:11777]
2025-10-02T08:15:37.187425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535126627730999:11777]
2025-10-02T08:15:37.187430Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:37.187440Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:37.187458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:37.187461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:37.187461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:37.187464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:37.187470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627730997:11764], now have 1 active actors on pipe
2025-10-02T08:15:37.187485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2430
2025-10-02T08:15:37.187504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535127087139123:2378], now have 1 active actors on pipe
2025-10-02T08:15:37.187511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535126627730999:11777]
2025-10-02T08:15:37.187521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:37.187532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.187536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.187546Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:37.187585Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:37.187596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.187600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.187602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:37.187610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.187581Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2430
2025-10-02T08:15:37.187623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:37.187654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.187687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.187692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.187702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.187735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2431 partition: 0 MaxSeqNo: 17 sessionId: src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0
2025-10-02T08:15:37.188032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef49075-90032725-3ceb73a8-c1227f06_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:37.190572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0] Write session: try to update token
2025-10-02T08:15:37.190586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:37.205096Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:37.205114Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:37.205116Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:37.205123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535126627730999:11777]
2025-10-02T08:15:37.205126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535126627730999:11777]
2025-10-02T08:15:37.205158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:37.205163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.205164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:37.205166Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:37.205171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:37.205279Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:37.205360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId: src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:37.207897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:37.253183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535126627731032:14175]
2025-10-02T08:15:37.253307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2430, pipe: [1:7556535126627731032:14175]
2025-10-02T08:15:37.339463Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:37.339788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.339797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.339828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627731032:14175], now have 1 active actors on pipe
2025-10-02T08:15:37.339958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535126627731032:14175]
2025-10-02T08:15:37.339983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:37.339986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:37.340026Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:37.340041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2431 reason: error at write: Disconnected sessionId: src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0
2025-10-02T08:15:37.340054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:37.340205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2431 sessionId: src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0 is DEAD
2025-10-02T08:15:37.340358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:37.340365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0] Write session will restart in 0.005766s
2025-10-02T08:15:37.340384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0] Write session: Do CDS request
2025-10-02T08:15:37.340388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:37.347206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.347295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:37.347307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2432
2025-10-02T08:15:37.347398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.347426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:37.347436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:37.347440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:37.347836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2432 sessionId:  describe result for acl check
2025-10-02T08:15:37.347863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:37.347869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:37.347870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:37.347874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535126627731370:11769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:37.348296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535126627731370:11769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:37.350622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535126627731370:11769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:37.353522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535126627731370:11769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:37.353537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535126627731370:11769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:37.353541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535126627731370:11769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:37.353548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:37.356517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:37.357158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:37.357329Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:37.357341Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:37.357351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:37.357419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:37.357456Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535126627731735:11765]
2025-10-02T08:15:37.358076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:37.358254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:37.358292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:37.358570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:37.358628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.358634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.358634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.358635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.358636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.358641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.358651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.358654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.358658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.358661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.358670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.358677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.358686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.358691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.358694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.358699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.358703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.358707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.358716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.358721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.358739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:37.366612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:37.368359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:37.368373Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:37.368376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:37.368379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:37.368386Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2431 [1:7556535126627731735:11765]
2025-10-02T08:15:37.368399Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:37.368419Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:37.368422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.368425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.368427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.368444Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:37.368455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:37.368461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:37.368528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.368536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.368538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:37.368541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:37.368608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:37.368616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.368629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.368645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:37.368663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535126627731729:11765]
2025-10-02T08:15:37.368665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535126627731729:11765]
2025-10-02T08:15:37.368672Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:37.368684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627731648:11769], now have 1 active actors on pipe
2025-10-02T08:15:37.368695Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:37.368699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:37.368701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:37.368711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:37.368714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:37.368719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535127087139132:2378], now have 1 active actors on pipe
2025-10-02T08:15:37.368749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535126627731729:11765]
2025-10-02T08:15:37.368757Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:37.368764Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:37.368793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2431
2025-10-02T08:15:37.368791Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2431
2025-10-02T08:15:37.368880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.368890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.368920Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:37.368933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.368942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.368944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:37.368954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.368970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:37.368991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.369019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.369025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.369036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.369068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2432 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0
2025-10-02T08:15:37.369454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b9dda4-3cdb433f-d1c88ecf-dcc4fa2e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:37.372038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0] Write session: try to update token
2025-10-02T08:15:37.372051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:37.383160Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:37.383194Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:37.383205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535126627731729:11765]
2025-10-02T08:15:37.383269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:37.383270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:37.383665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:37.383956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:37.384249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:37.384525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:37.384951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:37.385018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:37.386055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId: src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:37.388564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:37.388623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.388631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.388656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:37.388675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:37.388710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.388719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.388900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.388963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.389025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.389098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.389360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.389368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.389432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.389489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.389551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.389612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.389653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.389659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.389720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.389778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.389835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.389893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.389933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.389939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.390001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.390061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.390123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.390183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.390252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.390257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.390326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.390390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.390451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.390512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.390554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.390560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.390621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.390682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.390743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.390809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.390851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.390857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.390932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.391007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.391086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.391155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.391203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.391211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.391282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.391347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.391418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.391486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.391536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.391543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.391615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.391680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.391753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.391818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.391868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.391878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.391948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:37.392012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:37.392081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:37.392160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:37.392211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:37.392219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:37.392259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:37.392314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.392330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.392334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:37.392359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:37.392372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:37.392377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:37.392379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:37.392381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:37.392739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:37.392760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:37.392768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:37.392770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:37.392772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:37.392774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:37.393236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:37.393255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:37.393260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:37.393262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:37.393267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:37.393269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:37.393819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:37.393845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:37.393855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:37.393863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:37.393866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:37.395161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:37.395182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:37.395194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392937394
2025-10-02T08:15:37.395316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:37.395332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:37.395338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:37.395341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:37.395345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:37.395349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:37.395881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:37.395907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:37.395917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:37.395921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:37.395926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:37.395933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:37.396429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:37.396452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:37.396462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:37.396470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:37.396474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:37.396477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:37.396977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:37.397004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:37.397015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:37.398168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:37.398192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:37.398198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:37.398201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:37.398209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392937398
2025-10-02T08:15:37.398526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:37.398552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:37.398559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:37.398562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:37.398565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:37.398568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:37.399058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:37.399087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:37.399097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:37.399101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:37.399104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:37.399107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:37.399575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:37.399601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.399709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392937399
2025-10-02T08:15:37.403354Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:37.403380Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:37.403386Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:37.403390Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:37.405036Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:37.405048Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:37.405050Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:37.405060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535126627731729:11765]
2025-10-02T08:15:37.405064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535126627731729:11765]
2025-10-02T08:15:37.405114Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:37.405126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:37.405131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.405133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:37.405134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:37.405274Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:37.440079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535126627731767:14175]
2025-10-02T08:15:37.440189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2431, pipe: [1:7556535126627731767:14175]
2025-10-02T08:15:37.543600Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:37.544000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627731767:14175], now have 1 active actors on pipe
2025-10-02T08:15:37.544558Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:37.544896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:37.544985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535126627731767:14175]
2025-10-02T08:15:37.545011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:37.545040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2432 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0
2025-10-02T08:15:37.545542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:37.545554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0] Write session will restart in 0.007572s
2025-10-02T08:15:37.545578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0] Write session: Do CDS request
2025-10-02T08:15:37.545584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:37.545197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2432 sessionId: src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0 is DEAD
2025-10-02T08:15:37.554261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.554735Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:37.554750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2433
2025-10-02T08:15:37.554985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.555013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:37.555017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:37.555020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:37.555772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2433 sessionId:  describe result for acl check
2025-10-02T08:15:37.555811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:37.555817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:37.555819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:37.555824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535126627731992:11809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:37.556320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535126627731992:11809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:37.559761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535126627731992:11809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:37.569179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535126627731992:11809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:37.569196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535126627731992:11809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:37.569199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535126627731992:11809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:37.569207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:37.583115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:37.585180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:37.585543Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:37.585554Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:37.585659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:37.585723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:37.585766Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535126627732475:11818]
2025-10-02T08:15:37.586435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:37.586611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:37.586664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:37.586972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:37.587018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.587023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.587024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.587025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.587026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.587031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.587042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.587051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.587055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.587060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.587065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.587072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.587083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.587089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.587094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.587099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.587112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.587118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.587123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.587129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.587148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:37.595048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:37.596849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:37.596862Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:37.596865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:37.596870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:37.596877Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2432 [1:7556535126627732475:11818]
2025-10-02T08:15:37.596888Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:37.596905Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:37.596908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.596911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.596913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.596927Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:37.596933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:37.596940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:37.596996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.597003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.597006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:37.597009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:37.597069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:37.597077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.597090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.597102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:37.597123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627732276:11809], now have 1 active actors on pipe
2025-10-02T08:15:37.597133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535126627732469:11818]
2025-10-02T08:15:37.597135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535126627732469:11818]
2025-10-02T08:15:37.597142Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:37.597149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:37.597151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:37.597159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:37.597176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:37.597183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:37.597189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535127087139138:2378], now have 1 active actors on pipe
2025-10-02T08:15:37.597220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535126627732469:11818]
2025-10-02T08:15:37.597230Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:37.597244Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:37.597361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2432
2025-10-02T08:15:37.597375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.597378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.597402Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:37.597412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.597415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.597417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:37.597427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.597441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:37.597467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.597491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.597497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.597510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.597543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2433 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0
2025-10-02T08:15:37.597878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086e9a-7ee86e79-90713fac-2bbee53f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:37.600582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0] Write session: try to update token
2025-10-02T08:15:37.600599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:37.600896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2432
2025-10-02T08:15:37.615140Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:37.615157Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:37.615159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:37.615167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535126627732469:11818]
2025-10-02T08:15:37.615171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535126627732469:11818]
2025-10-02T08:15:37.615213Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:37.615215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:37.615218Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:37.615222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.615224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:37.615360Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:37.616420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId: src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:37.618867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:37.645406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535126627732500:14175]
2025-10-02T08:15:37.645566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2432, pipe: [1:7556535126627732500:14175]
2025-10-02T08:15:37.761880Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:37.762314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.762329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.762365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627732500:14175], now have 1 active actors on pipe
2025-10-02T08:15:37.762509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535126627732500:14175]
2025-10-02T08:15:37.762639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:37.762647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:37.762702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2433 reason: error at write: Disconnected sessionId: src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0
2025-10-02T08:15:37.762691Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:37.762857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2433 sessionId: src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0 is DEAD
2025-10-02T08:15:37.763010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:37.763018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0] Write session will restart in 0.007884s
2025-10-02T08:15:37.763040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0] Write session: Do CDS request
2025-10-02T08:15:37.763060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:37.763684Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:37.772325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.772354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:37.772370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2434
2025-10-02T08:15:37.772517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.772547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:37.772557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:37.772560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:37.773073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2434 sessionId:  describe result for acl check
2025-10-02T08:15:37.773109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:37.773111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:37.773113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:37.773118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535126627732949:11861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:37.773791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535126627732949:11861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:37.776268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535126627732949:11861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:37.779226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535126627732949:11861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:37.779237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535126627732949:11861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:37.779239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535126627732949:11861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:37.779245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:37.780625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:37.780946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:37.781188Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:37.781199Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:37.781209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:37.781259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:37.781297Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535126627733211:11860]
2025-10-02T08:15:37.781930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:37.782087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:37.782125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:37.782413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:37.782456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.782461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.782462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.782464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.782465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.782470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.782480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.782484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.782488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.782492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.782497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.782504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.782510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.782515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.782519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.782529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.782534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.782543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.782548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.782557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.782577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:37.790635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:37.792051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:37.792066Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:37.792069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:37.792073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:37.792080Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2433 [1:7556535126627733211:11860]
2025-10-02T08:15:37.792092Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:37.792110Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:37.792117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.792121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.792123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.792150Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:37.792160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:37.792167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:37.792232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.792239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.792242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:37.792245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:37.792311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:37.792318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.792333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.792349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:37.792377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627733193:11861], now have 1 active actors on pipe
2025-10-02T08:15:37.792381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535127087139144:2378], now have 1 active actors on pipe
2025-10-02T08:15:37.792387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535126627733205:11860]
2025-10-02T08:15:37.792389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535126627733205:11860]
2025-10-02T08:15:37.792400Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:37.792412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:37.792414Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:37.792418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:37.792426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:37.792429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:37.792462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535126627733205:11860]
2025-10-02T08:15:37.792472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:37.792485Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:37.792519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2433
2025-10-02T08:15:37.792601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.792619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.792648Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:37.792657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.792661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.792664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:37.792675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.792692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:37.792712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.792742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.792748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.792764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.792815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2434 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0
2025-10-02T08:15:37.792938Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2433
2025-10-02T08:15:37.793172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a596f5d-5871c58-fc622dc1-e371d5f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:37.795798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0] Write session: try to update token
2025-10-02T08:15:37.795815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:37.810015Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:37.810035Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:37.810037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:37.810045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535126627733205:11860]
2025-10-02T08:15:37.810049Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535126627733205:11860]
2025-10-02T08:15:37.810058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId: src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:37.810089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:37.810097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.810099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:37.810180Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:37.810186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:37.810232Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:37.812485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:37.862470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535126627733237:14175]
2025-10-02T08:15:37.862566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2433, pipe: [1:7556535126627733237:14175]
2025-10-02T08:15:37.944446Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:37.945101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.945114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.945146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627733237:14175], now have 1 active actors on pipe
2025-10-02T08:15:37.945899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:37.945913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0] Write session will restart in 0.007563s
2025-10-02T08:15:37.945297Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:37.945527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:37.945584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2434 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0
2025-10-02T08:15:37.945737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2434 sessionId: src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0 is DEAD
2025-10-02T08:15:37.945857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535126627733237:14175]
2025-10-02T08:15:37.945932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0] Write session: Do CDS request
2025-10-02T08:15:37.945363Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:37.945940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:37.954262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.954602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:37.954614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2435
2025-10-02T08:15:37.954702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:37.954727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:37.954735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:37.954738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:37.955149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2435 sessionId:  describe result for acl check
2025-10-02T08:15:37.955180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:37.955182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:37.955183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:37.955188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535126627733545:11914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:37.955677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535126627733545:11914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:37.958654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535126627733545:11914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:37.962686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535126627733545:11914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:37.962705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535126627733545:11914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:37.962708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535126627733545:11914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:37.962716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:37.970014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:37.970401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:37.970601Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:37.970612Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:37.970624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:37.970671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:37.970716Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535126627733995:11910]
2025-10-02T08:15:37.971418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:37.971618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:37.971658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:37.971973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:37.972020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.972028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.972029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.972031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.972032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.972038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.972050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.972054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.972058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.972062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.972069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.972077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:37.972084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.972090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:37.972096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.972101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:37.972107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.972113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.972119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.972125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.972161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:37.980076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:37.981592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:37.981607Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:37.981609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:37.981611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:37.981616Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2434 [1:7556535126627733995:11910]
2025-10-02T08:15:37.981624Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:37.981637Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:37.981639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.981642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.981643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.981655Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:37.981659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:37.981665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:37.981715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.981722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.981725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:37.981727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:37.981784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:37.981790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:37.981798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:37.981807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:37.981819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535126627733989:11910]
2025-10-02T08:15:37.981825Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535126627733989:11910]
2025-10-02T08:15:37.981832Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:37.981844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:37.981861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:37.981870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:37.981888Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:37.981891Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:37.981909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535126627733815:11914], now have 1 active actors on pipe
2025-10-02T08:15:37.981912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535126627733989:11910]
2025-10-02T08:15:37.981915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:37.981935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535127087139179:2378], now have 1 active actors on pipe
2025-10-02T08:15:37.981963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2434
2025-10-02T08:15:37.981969Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:37.982062Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2434
2025-10-02T08:15:37.982064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.982088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.982117Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:37.982126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:37.982134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:37.982137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:37.982147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:37.982162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:37.982199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.982241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:37.982246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:37.982268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:37.982298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2435 partition: 0 MaxSeqNo: 17 sessionId: src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0
2025-10-02T08:15:37.982615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa8925e1-3478b496-2a627b5d-ec18cbfc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:37.985258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0] Write session: try to update token
2025-10-02T08:15:37.985275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:37.993062Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:37.993080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:37.993089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535126627733989:11910]
2025-10-02T08:15:37.993130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:37.993153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:37.993300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:37.993445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:37.993584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:37.993727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:37.993927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:37.993967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:38.002350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId: src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:38.004929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:38.006913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.006931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.006966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:38.007000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:38.007063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.007070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.007204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.007260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.007311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.007361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.007398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.007401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.007462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.007511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.007584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.007648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.007691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.007701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.007769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.007820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.007877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.007931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.007976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.007982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.008040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.008098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.008171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.008234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.008280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.008286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.008343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.008395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.008451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.008506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.008553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.008560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.008616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.008677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.008734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.008791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.008853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.008860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.008918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.008973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.009031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.009086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.009127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.009134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.009197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.009251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.009313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.009368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.009412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.009414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.009471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.009524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.009580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.009642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.009690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.009701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.009757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.009811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.009866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.009915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.009957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.009958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.010007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:38.010058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.010070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.010072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:38.010097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:38.010107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:38.010109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:38.010111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:38.010113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:38.010448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:38.010462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:38.010466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:38.010469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:38.010471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:38.010473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:38.011114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:38.011124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:38.011129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:38.011131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:38.011133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:38.011135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:38.011730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:38.011740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:38.011747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:38.011749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:38.011751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:38.014925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:38.014944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:38.014955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392938014
2025-10-02T08:15:38.015058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:38.015071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:38.015076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:38.015079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:38.015083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:38.015087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:38.015621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:38.015645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:38.015651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:38.015654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:38.015657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:38.015662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:38.016103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:38.016136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:38.016143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:38.016146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:38.016150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:38.016154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:38.016662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:38.016683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:38.016688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:38.017716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:38.017735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:38.017742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:38.017745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:38.017753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392938017
2025-10-02T08:15:38.018065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:38.018090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:38.018098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:38.018101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:38.018105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:38.018108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:38.018513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:38.018530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:38.018534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:38.018536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:38.018541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:38.018543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:38.018945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:38.018963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.019041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392938018
2025-10-02T08:15:38.024099Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:38.024125Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:38.024139Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:38.024147Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:38.024161Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:38.024167Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:38.024169Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:38.024178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535126627733989:11910]
2025-10-02T08:15:38.024182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535126627733989:11910]
2025-10-02T08:15:38.024241Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:38.024251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:38.024252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:38.024256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.024258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:38.024370Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:38.045773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535130922701317:14175]
2025-10-02T08:15:38.045926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2434, pipe: [1:7556535130922701317:14175]
2025-10-02T08:15:38.153795Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:38.154133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922701317:14175], now have 1 active actors on pipe
2025-10-02T08:15:38.154618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:38.154628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0] Write session will restart in 0.006093s
2025-10-02T08:15:38.154289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:38.154653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0] Write session: Do CDS request
2025-10-02T08:15:38.154295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:38.154318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2435 reason: error at write: Disconnected sessionId: src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0
2025-10-02T08:15:38.154660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:38.154413Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:38.154457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2435 sessionId: src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0 is DEAD
2025-10-02T08:15:38.154602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535130922701317:14175]
2025-10-02T08:15:38.154925Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:38.159815Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [99c1ea3d3f54f12f] Result# TEvPutResult {Id# [72075186224037892:2434:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:15:38.159852Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2434:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:38.159910Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2434:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:38.162284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.162348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:38.162361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2436
2025-10-02T08:15:38.162498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.162531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:38.162539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:38.162542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:38.163477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2436 sessionId:  describe result for acl check
2025-10-02T08:15:38.163508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:38.163513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:38.163517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:38.163521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535130922701512:11994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:38.164001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535130922701512:11994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:38.167431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535130922701512:11994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:38.171986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535130922701512:11994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:38.171996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535130922701512:11994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:38.171998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535130922701512:11994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:38.172004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:38.179238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:38.180817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:38.181046Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:38.181055Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:38.181065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:38.181116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:38.181156Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535130922702033:11993]
2025-10-02T08:15:38.181771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:38.181978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:38.182013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:38.182291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:38.182327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.182337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.182338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.182339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.182340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.182344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.182354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.182357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.182361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.182364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.182369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.182376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.182381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.182385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.182389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.182393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.182397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.182401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.182405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.182414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.182429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:38.191691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:38.193789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:38.193810Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:38.193814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:38.193819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:38.193827Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2435 [1:7556535130922702033:11993]
2025-10-02T08:15:38.193842Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:38.193863Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:38.193867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.193871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.193874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.193892Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:38.193898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:38.193907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:38.193982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.193985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.193988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:38.193991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:38.194071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:38.194075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.194090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.194104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:38.194123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535130922702027:11993]
2025-10-02T08:15:38.194125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535130922702027:11993]
2025-10-02T08:15:38.194138Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:38.194152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:38.194169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:38.194172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:38.194212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535130922702027:11993]
2025-10-02T08:15:38.194215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:38.195235Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2435
2025-10-02T08:15:38.194451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:38.194458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:38.194464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:38.194678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2435
2025-10-02T08:15:38.194698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922701836:11994], now have 1 active actors on pipe
2025-10-02T08:15:38.194708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535131382106491:2378], now have 1 active actors on pipe
2025-10-02T08:15:38.194718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.194724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.194750Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3102e0fb-c85a5386-426085ef-bc169348_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:38.194760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.194764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.194767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:38.194777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.194792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:38.194825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.195024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.195358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92462cbe-51bb9bb1-8c67a92a-b28fc89f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3102e0fb-c85a5386-426085ef-bc169348_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:38.195027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.195038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.195067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2436 partition: 0 MaxSeqNo: 17 sessionId: src_id|3102e0fb-c85a5386-426085ef-bc169348_0
2025-10-02T08:15:38.197836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3102e0fb-c85a5386-426085ef-bc169348_0] Write session: try to update token
2025-10-02T08:15:38.197850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3102e0fb-c85a5386-426085ef-bc169348_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:38.212809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId: src_id|3102e0fb-c85a5386-426085ef-bc169348_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:38.213972Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:38.213993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:38.213995Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:38.214004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535130922702027:11993]
2025-10-02T08:15:38.214009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535130922702027:11993]
2025-10-02T08:15:38.214050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:38.214057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.214056Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:38.214058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:38.214062Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:38.214217Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:38.215337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:38.254700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535130922702058:14175]
2025-10-02T08:15:38.255005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2435, pipe: [1:7556535130922702058:14175]
2025-10-02T08:15:38.362275Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:38.363117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.363143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.363181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922702058:14175], now have 1 active actors on pipe
2025-10-02T08:15:38.363321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:38.363333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:38.363382Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:38.363406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2436 reason: error at write: Disconnected sessionId: src_id|3102e0fb-c85a5386-426085ef-bc169348_0
2025-10-02T08:15:38.363438Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:38.363662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2436 sessionId: src_id|3102e0fb-c85a5386-426085ef-bc169348_0 is DEAD
2025-10-02T08:15:38.363786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3102e0fb-c85a5386-426085ef-bc169348_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:38.363798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3102e0fb-c85a5386-426085ef-bc169348_0] Write session will restart in 0.007276s
2025-10-02T08:15:38.363820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3102e0fb-c85a5386-426085ef-bc169348_0] Write session: Do CDS request
2025-10-02T08:15:38.363826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3102e0fb-c85a5386-426085ef-bc169348_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:38.363824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535130922702058:14175]
2025-10-02T08:15:38.372252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3102e0fb-c85a5386-426085ef-bc169348_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.372304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:38.372323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2437
2025-10-02T08:15:38.372463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.372494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:38.372504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:38.372508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:38.372911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2437 sessionId:  describe result for acl check
2025-10-02T08:15:38.372949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:38.372957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:38.372958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:38.372963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535130922702493:12015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:38.373447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535130922702493:12015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:38.375956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535130922702493:12015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:38.378841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535130922702493:12015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:38.378862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535130922702493:12015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:38.378865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535130922702493:12015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:38.378873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:38.379508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:38.380450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:38.380683Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:38.380693Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:38.380703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:38.380745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:38.380781Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535130922702771:12024]
2025-10-02T08:15:38.381428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:38.381625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:38.381672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:38.381962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:38.382003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.382008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.382009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.382010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.382011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.382016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.382026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.382030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.382034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.382038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.382042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.382049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.382054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.382059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.382066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.382070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.382075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.382080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.382087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.382092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.382114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:38.389951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:38.391387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:38.391403Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:38.391406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:38.391409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:38.391416Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2436 [1:7556535130922702771:12024]
2025-10-02T08:15:38.391428Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:38.391445Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:38.391448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.391451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.391453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.391471Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:38.391475Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:38.391481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:38.391540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.391548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.391552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:38.391554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:38.391685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2436
2025-10-02T08:15:38.391790Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2436
2025-10-02T08:15:38.391977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:38.391986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.392000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.392018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:38.392042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922702760:12015], now have 1 active actors on pipe
2025-10-02T08:15:38.392050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535131382106499:2378], now have 1 active actors on pipe
2025-10-02T08:15:38.392055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.392065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.392086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535130922702765:12024]
2025-10-02T08:15:38.392092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535130922702765:12024]
2025-10-02T08:15:38.392104Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:38.392120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:38.392139Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:38.392150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:38.392151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:38.392154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:38.392169Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:38.392184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.392188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.392190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:38.392199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.392209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:38.392240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535130922702765:12024]
2025-10-02T08:15:38.392251Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:38.392263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:38.392267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.392387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.392394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.392408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.392446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2437 partition: 0 MaxSeqNo: 17 sessionId: src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0
2025-10-02T08:15:38.392777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3102e0fb-c85a5386-426085ef-bc169348_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:38.395270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0] Write session: try to update token
2025-10-02T08:15:38.395288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:38.408620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId: src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:38.409944Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:38.409959Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:38.409961Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:38.409969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535130922702765:12024]
2025-10-02T08:15:38.409973Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535130922702765:12024]
2025-10-02T08:15:38.410009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:38.410015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.410016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:38.410027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:38.410033Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:38.410148Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:38.411071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:38.464089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535130922702795:14175]
2025-10-02T08:15:38.464330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2436, pipe: [1:7556535130922702795:14175]
2025-10-02T08:15:38.546195Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:38.546452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.546465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.546500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922702795:14175], now have 1 active actors on pipe
2025-10-02T08:15:38.546640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:38.546654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:38.546725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2437 reason: error at write: Disconnected sessionId: src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0
2025-10-02T08:15:38.546744Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:38.546923Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:38.546934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2437 sessionId: src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0 is DEAD
2025-10-02T08:15:38.547036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:38.547046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0] Write session will restart in 0.007065s
2025-10-02T08:15:38.547069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0] Write session: Do CDS request
2025-10-02T08:15:38.547075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:38.547116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535130922702795:14175]
2025-10-02T08:15:38.555268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.555285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:38.555298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2438
2025-10-02T08:15:38.555466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.555495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:38.555504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:38.555507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:38.555883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2438 sessionId:  describe result for acl check
2025-10-02T08:15:38.555913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:38.555918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:38.555920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:38.555925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535130922703155:12059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:38.556388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535130922703155:12059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:38.559412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535130922703155:12059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:38.562279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535130922703155:12059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:38.562293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535130922703155:12059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:38.562295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535130922703155:12059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:38.562303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:38.565088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:38.566054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:38.566235Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:38.566246Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:38.566255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:38.566298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:38.566338Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535130922703512:12065]
2025-10-02T08:15:38.566939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:38.567122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:38.567174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:38.567460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:38.567516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.567521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.567522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.567523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.567524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.567530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.567541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.567545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.567549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.567552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.567557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.567564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.567576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.567583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.567587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.567596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.567601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.567606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.567614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.567619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.567642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:38.575969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:38.577633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:38.577653Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:38.577656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:38.577660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:38.577667Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2437 [1:7556535130922703512:12065]
2025-10-02T08:15:38.577680Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:38.577697Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:38.577700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.577703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.577705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.577720Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:38.577726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:38.577732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:38.577801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.577809Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.577812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:38.577815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:38.577881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:38.577888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.577902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.577919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:38.577939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535130922703506:12065]
2025-10-02T08:15:38.577945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535130922703506:12065]
2025-10-02T08:15:38.577954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:38.577959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2437
2025-10-02T08:15:38.577968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922703451:12059], now have 1 active actors on pipe
2025-10-02T08:15:38.577973Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:38.577976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:38.577977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:38.577990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:38.577998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:38.578003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535131382106505:2378], now have 1 active actors on pipe
2025-10-02T08:15:38.578035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.578043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.578056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535130922703506:12065]
2025-10-02T08:15:38.578067Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:38.578072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:38.578096Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|949f7f00-58de50f8-901bdb67-9a4185af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:38.578106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.578110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.578112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:38.578122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.578134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:38.578160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.578203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.578213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.578226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.578260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2438 partition: 0 MaxSeqNo: 17 sessionId: src_id|949f7f00-58de50f8-901bdb67-9a4185af_0
2025-10-02T08:15:38.578637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2a0c716-a3ad8da3-83a19821-edde1f43_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|949f7f00-58de50f8-901bdb67-9a4185af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:38.580883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2437
2025-10-02T08:15:38.581263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|949f7f00-58de50f8-901bdb67-9a4185af_0] Write session: try to update token
2025-10-02T08:15:38.581278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|949f7f00-58de50f8-901bdb67-9a4185af_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:38.598441Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:38.598465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:38.598468Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:38.598479Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535130922703506:12065]
2025-10-02T08:15:38.598484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535130922703506:12065]
2025-10-02T08:15:38.598530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:38.598537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.598539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:38.598775Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:38.599379Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:38.599391Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:38.599437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId: src_id|949f7f00-58de50f8-901bdb67-9a4185af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:38.602121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:38.647391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535130922703536:14175]
2025-10-02T08:15:38.647508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2437, pipe: [1:7556535130922703536:14175]
2025-10-02T08:15:38.744388Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:38.745023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.745042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.745081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922703536:14175], now have 1 active actors on pipe
2025-10-02T08:15:38.745242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535130922703536:14175]
2025-10-02T08:15:38.745270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:38.745277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:38.745339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2438 reason: error at write: Disconnected sessionId: src_id|949f7f00-58de50f8-901bdb67-9a4185af_0
2025-10-02T08:15:38.745358Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:38.745504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2438 sessionId: src_id|949f7f00-58de50f8-901bdb67-9a4185af_0 is DEAD
2025-10-02T08:15:38.745541Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:38.745648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949f7f00-58de50f8-901bdb67-9a4185af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:38.745658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949f7f00-58de50f8-901bdb67-9a4185af_0] Write session will restart in 0.007469s
2025-10-02T08:15:38.745684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949f7f00-58de50f8-901bdb67-9a4185af_0] Write session: Do CDS request
2025-10-02T08:15:38.745690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949f7f00-58de50f8-901bdb67-9a4185af_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:38.754192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|949f7f00-58de50f8-901bdb67-9a4185af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.754270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:38.754284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2439
2025-10-02T08:15:38.754389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.754418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:38.754427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:38.754430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:38.754779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2439 sessionId:  describe result for acl check
2025-10-02T08:15:38.754813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:38.754818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:38.754820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:38.754825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535130922703941:12103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:38.755290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535130922703941:12103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:38.757846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535130922703941:12103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:38.760917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535130922703941:12103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:38.760932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535130922703941:12103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:38.760936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535130922703941:12103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:38.760943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:38.763313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:38.763651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:38.763912Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:38.763924Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:38.763936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:38.763996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:38.764035Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535130922704256:12101]
2025-10-02T08:15:38.764493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:38.764708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:38.764737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:38.764959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:38.764991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.764995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.764996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.764996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.764997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.765000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.765007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.765009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.765010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.765012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.765016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.765020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.765024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.765027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.765030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.765032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.765035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.765038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.765040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.765043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.765054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:38.773011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:38.774502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:38.774517Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:38.774519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:38.774522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:38.774528Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2438 [1:7556535130922704256:12101]
2025-10-02T08:15:38.774536Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:38.774551Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:38.774557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.774560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.774561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.774573Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:38.774579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:38.774585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:38.774644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.774651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.774653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:38.774655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:38.774714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:38.774724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.774736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.774747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:38.774751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2438
2025-10-02T08:15:38.774764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922704235:12103], now have 1 active actors on pipe
2025-10-02T08:15:38.774768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535131382106512:2378], now have 1 active actors on pipe
2025-10-02T08:15:38.774772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.774780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.774798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535130922704250:12101]
2025-10-02T08:15:38.774805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535130922704250:12101]
2025-10-02T08:15:38.774818Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:38.774833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:38.774850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:38.774854Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:38.774857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:38.774858Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:38.774872Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:38.774887Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2438
2025-10-02T08:15:38.774878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.774884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.774886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:38.774896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.774905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:38.774953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535130922704250:12101]
2025-10-02T08:15:38.774961Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:38.774975Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:38.774979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.775032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.775041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.775056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.775087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2439 partition: 0 MaxSeqNo: 17 sessionId: src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0
2025-10-02T08:15:38.775390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|949f7f00-58de50f8-901bdb67-9a4185af_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:38.777838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0] Write session: try to update token
2025-10-02T08:15:38.777852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:38.785992Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:38.786028Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:38.786043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535130922704250:12101]
2025-10-02T08:15:38.786114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:38.786111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:38.786329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:38.786492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:38.786659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:38.786824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:38.787059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:38.787108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:38.794871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId: src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:38.797286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:38.797354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.797366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.797399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:38.797423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:38.797460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.797474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.797629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.797685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.797742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.797801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.798058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.798068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.798134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.798200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.798261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.798523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.798577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.798584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.798655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.798724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.798793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.798863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.798905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.798910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.798974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.799035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.799094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.799154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.799196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.799201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.799261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.799317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.799378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.799461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.799519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.799526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.799598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.799675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.799746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.799817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.799864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.799874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.799943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.800012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.800088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.800175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.800223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.800232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.800304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.800371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.800442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.800512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.800560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.800568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.800637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.800711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.800779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.800987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.801032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.801038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.801097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:38.801159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:38.801225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:38.801299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:38.801356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:38.801363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:38.801432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:38.801506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.801530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.801536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:38.801573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:38.801593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:38.801599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:38.801603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:38.801605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:38.802003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:38.802026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:38.802035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:38.802038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:38.802039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:38.802041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:38.802619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:38.802639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:38.802645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:38.802647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:38.802649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:38.802651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:38.803124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:38.803145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:38.803149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:38.803151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:38.803153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:38.804300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:38.804316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:38.804325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392938804
2025-10-02T08:15:38.804438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:38.804450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:38.804454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:38.804457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:38.804461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:38.804466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:38.804910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:38.804931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:38.804935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:38.804937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:38.804939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:38.804942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:38.805404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:38.805425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:38.805433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:38.805440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:38.805442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:38.805444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:38.805894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:38.805914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:38.805918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:38.807023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:38.807038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:38.807042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:38.807044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:38.807050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392938806
2025-10-02T08:15:38.807319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:38.807335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:38.807340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:38.807347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:38.807349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:38.807352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:38.807763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:38.807783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:38.807787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:38.807789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:38.807791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:38.807794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:38.808216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:38.808233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.808303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392938808
2025-10-02T08:15:38.810574Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:38.810596Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:38.810603Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:38.810609Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:38.810620Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:38.810628Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:38.810630Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:38.810639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535130922704250:12101]
2025-10-02T08:15:38.810647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535130922704250:12101]
2025-10-02T08:15:38.810700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:38.810711Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:38.810713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:38.810716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.810717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:38.810843Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:38.845501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535130922704283:14175]
2025-10-02T08:15:38.845612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2438, pipe: [1:7556535130922704283:14175]
2025-10-02T08:15:38.947575Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:38.947982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922704283:14175], now have 1 active actors on pipe
2025-10-02T08:15:38.948121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:38.948140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:38.948162Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:38.948169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2439 reason: error at write: Disconnected sessionId: src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0
2025-10-02T08:15:38.948289Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:38.948507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:38.948514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0] Write session will restart in 0.005032s
2025-10-02T08:15:38.948538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0] Write session: Do CDS request
2025-10-02T08:15:38.948544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:38.948360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2439 sessionId: src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0 is DEAD
2025-10-02T08:15:38.948509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535130922704283:14175]
2025-10-02T08:15:38.952606Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [fe8977372758fe6d] Result# TEvPutResult {Id# [72075186224037892:2438:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:15:38.952627Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2438:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:38.952687Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2438:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:38.954333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.954376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:38.954392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2440
2025-10-02T08:15:38.954552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:38.954588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:38.954593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:38.954596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:38.954939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2440 sessionId:  describe result for acl check
2025-10-02T08:15:38.954977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:38.954983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:38.954989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:38.954993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535130922704342:12141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:38.955489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535130922704342:12141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:38.958889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535130922704342:12141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:38.962108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535130922704342:12141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:38.962123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535130922704342:12141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:38.962125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535130922704342:12141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:38.962135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:38.968863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:38.969225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:38.969369Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:38.969377Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:38.969384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:38.969413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:38.969446Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535130922705032:12123]
2025-10-02T08:15:38.969896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:38.970041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:38.970068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:38.970254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:38.970281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.970285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.970286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.970286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.970287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.970289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.970296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.970298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.970300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.970302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.970306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.970310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:38.970313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.970315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:38.970319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.970322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:38.970324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.970327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.970329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.970331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.970340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:38.978228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:38.979851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:38.979870Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:38.979872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:38.979876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:38.979882Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2439 [1:7556535130922705032:12123]
2025-10-02T08:15:38.979893Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:38.979907Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:38.979910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.979913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.979914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.979930Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:38.979935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:38.979942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:38.980004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.980015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.980018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:38.980020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:38.980084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:38.980091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:38.980106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:38.980119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:38.980150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535130922704811:12141], now have 1 active actors on pipe
2025-10-02T08:15:38.980162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535130922705026:12123]
2025-10-02T08:15:38.980164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535130922705026:12123]
2025-10-02T08:15:38.980172Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:38.980184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:38.980186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535131382106534:2378], now have 1 active actors on pipe
2025-10-02T08:15:38.980191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:38.980194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:38.980204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:38.980206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:38.980237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535130922705026:12123]
2025-10-02T08:15:38.980248Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:38.980240Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2439
2025-10-02T08:15:38.980297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2439
2025-10-02T08:15:38.980342Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:38.980437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.980447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.980476Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:38.980488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:38.980499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:38.980501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:38.980510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:38.980525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:38.980543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.980577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.980584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.980595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:38.980626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2440 partition: 0 MaxSeqNo: 17 sessionId: src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0
2025-10-02T08:15:38.980957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a15d82e7-fc03faf5-18aa44d2-94d90a99_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:38.983708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0] Write session: try to update token
2025-10-02T08:15:38.983728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:38.991390Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:38.991408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:38.991416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535130922705026:12123]
2025-10-02T08:15:38.991458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:38.991621Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:38.991757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:38.991889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:38.992022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:38.992218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:38.992253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:38.992786Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:38.997364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId: src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:38.999738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:38.999794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:38.999806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:38.999838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:38.999855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:39.000013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.000023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.000198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.000262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.000324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.000386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.000430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.000442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.000505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.000559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.000610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.000670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.000708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.000711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.000773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.000848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.000901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.000954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.000996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.000999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.001062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.001124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.001181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.001239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.001280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.001283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.001345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.001399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.001454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.001511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.001550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.001555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.001617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.001672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.001730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.001789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.001826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.001829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.001891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.001945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.002002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.002059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.002098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.002100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.002163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.002216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.002270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.002324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.002361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.002364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.002430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.002488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.002548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.002606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.002643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.002646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.002707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.002758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.002815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.002870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.002907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.002911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.002945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:39.002999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.003017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.003019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:39.003047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:39.003060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:39.003063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:39.003067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:39.003069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:39.003436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:39.003452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:39.003458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:39.003461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:39.003465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:39.003467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:39.004228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:39.004241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:39.004247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:39.004250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:39.004255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:39.004259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:39.004702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:39.004714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:39.004719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:39.004723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:39.004726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:39.006247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:39.006271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:39.006282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392939004
2025-10-02T08:15:39.006503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:39.006511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:39.006516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:39.006519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:39.006523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:39.006526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:39.006988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:39.007001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:39.007006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:39.007011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:39.007014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:39.007018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:39.007469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:39.007480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:39.007489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:39.007492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:39.007495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:39.007498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:39.007928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:39.007938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:39.007943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:39.009141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:39.009159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:39.009164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:39.009167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:39.009175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392939008
2025-10-02T08:15:39.009453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:39.009463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:39.009471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:39.009474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:39.009477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:39.009482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:39.009931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:39.009946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:39.009951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:39.009955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:39.009958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:39.009962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:39.010418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:39.010428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.010528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392939010
2025-10-02T08:15:39.011242Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:39.011252Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:39.011259Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:39.011265Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:39.012771Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:39.012774Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:39.012776Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:39.012785Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535130922705026:12123]
2025-10-02T08:15:39.012788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535130922705026:12123]
2025-10-02T08:15:39.012868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:39.012872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.012874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:39.012997Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:39.013175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:39.013192Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:39.048273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535135217672384:14175]
2025-10-02T08:15:39.048521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2439, pipe: [1:7556535135217672384:14175]
2025-10-02T08:15:39.159700Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:39.160082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217672384:14175], now have 1 active actors on pipe
2025-10-02T08:15:39.160241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535135217672384:14175]
2025-10-02T08:15:39.160263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:39.160265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:39.160289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2440 reason: error at write: Disconnected sessionId: src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0
2025-10-02T08:15:39.160349Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:39.160357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:39.160461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2440 sessionId: src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0 is DEAD
2025-10-02T08:15:39.160573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:39.160583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0] Write session will restart in 0.005307s
2025-10-02T08:15:39.160615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0] Write session: Do CDS request
2025-10-02T08:15:39.160620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:39.167181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.167205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:39.167233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2441
2025-10-02T08:15:39.167333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.167354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:39.167361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:39.167364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:39.167785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2441 sessionId:  describe result for acl check
2025-10-02T08:15:39.167817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:39.167824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:39.167825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:39.167830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535135217672696:12237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:39.168298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535135217672696:12237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:39.170854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535135217672696:12237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:39.173415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535135217672696:12237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:39.173427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535135217672696:12237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:39.173431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535135217672696:12237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:39.173437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:39.181201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:39.181507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:39.181775Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:39.181786Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:39.181796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:39.181844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:39.181886Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535135217673120:12231]
2025-10-02T08:15:39.182483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:39.182669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:39.182706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:39.182988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:39.183044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.183049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.183050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.183051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.183052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.183056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.183065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.183068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.183072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.183075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.183080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.183086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.183091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.183095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.183099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.183103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.183106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.183110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.183114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.183118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.183135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:39.190819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:39.192242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:39.192256Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:39.192259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:39.192262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:39.192269Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2440 [1:7556535135217673120:12231]
2025-10-02T08:15:39.192281Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:39.192302Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:39.192310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.192313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.192315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.192331Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:39.192343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:39.192349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:39.192406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.192414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.192417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:39.192419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:39.192482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:39.192490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.192502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.192520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:39.192541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2440
2025-10-02T08:15:39.192541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217672928:12237], now have 1 active actors on pipe
2025-10-02T08:15:39.192548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535135217673114:12231]
2025-10-02T08:15:39.192550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535135217673114:12231]
2025-10-02T08:15:39.192558Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:39.192566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535135677073859:2378], now have 1 active actors on pipe
2025-10-02T08:15:39.192567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:39.192571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:39.192576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.192580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.192593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:39.192606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:39.192614Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:39.192650Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:39.192660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.192663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.192664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:39.192673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.192684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:39.192662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2440
2025-10-02T08:15:39.192694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535135217673114:12231]
2025-10-02T08:15:39.192697Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:39.192703Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:39.192715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.192749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.192755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.192770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.192826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2441 partition: 0 MaxSeqNo: 17 sessionId: src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0
2025-10-02T08:15:39.193169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4045d00-e87dfcf6-1b1f3212-eaeeda6f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:39.195723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0] Write session: try to update token
2025-10-02T08:15:39.195737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:39.209256Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:39.209277Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:39.209279Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:39.209288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535135217673114:12231]
2025-10-02T08:15:39.209291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535135217673114:12231]
2025-10-02T08:15:39.209330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:39.209338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.209337Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:39.209340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:39.209343Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:39.209469Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:39.211793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId: src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:39.214411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:39.260208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535135217673145:14175]
2025-10-02T08:15:39.260319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2440, pipe: [1:7556535135217673145:14175]
2025-10-02T08:15:39.354140Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:39.354767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.354781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.354819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217673145:14175], now have 1 active actors on pipe
2025-10-02T08:15:39.354969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535135217673145:14175]
2025-10-02T08:15:39.355004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:39.355004Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:39.355006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:39.355054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:39.355067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2441 reason: error at write: Disconnected sessionId: src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0
2025-10-02T08:15:39.355361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:39.355371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0] Write session will restart in 0.009515s
2025-10-02T08:15:39.355405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0] Write session: Do CDS request
2025-10-02T08:15:39.355412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:39.355234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2441 sessionId: src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0 is DEAD
2025-10-02T08:15:39.366599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.366672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:39.366688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2442
2025-10-02T08:15:39.366827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.366858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:39.366863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:39.366867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:39.367328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2442 sessionId:  describe result for acl check
2025-10-02T08:15:39.367358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:39.367360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:39.367361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:39.367366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535135217673520:12255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:39.367871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535135217673520:12255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:39.370899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535135217673520:12255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:39.374866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535135217673520:12255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:39.374880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535135217673520:12255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:39.374884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535135217673520:12255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:39.374892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:39.381869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:39.382702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:39.382904Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:39.382916Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:39.382927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:39.382988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:39.383029Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535135217673870:12256]
2025-10-02T08:15:39.383443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:39.383629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:39.383665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:39.383858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:39.383885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.383889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.383889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.383890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.383891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.383894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.383901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.383903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.383905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.383907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.383911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.383916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.383919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.383922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.383925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.383928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.383931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.383935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.383937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.383940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.383957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:39.393741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:39.395257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:39.395277Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:39.395280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:39.395284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:39.395290Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2441 [1:7556535135217673870:12256]
2025-10-02T08:15:39.395304Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:39.395322Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:39.395325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.395328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.395330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.395346Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:39.395357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:39.395363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:39.395434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.395443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.395446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:39.395448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:39.395519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:39.395526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.395540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.395554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:39.395576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535135217673864:12256]
2025-10-02T08:15:39.395583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535135217673864:12256]
2025-10-02T08:15:39.395590Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:39.395591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2441
2025-10-02T08:15:39.395609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:39.395611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217673658:12255], now have 1 active actors on pipe
2025-10-02T08:15:39.395612Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:39.395618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:39.395630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:39.395637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:39.395642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535135677073868:2378], now have 1 active actors on pipe
2025-10-02T08:15:39.395646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.395653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.395692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535135217673864:12256]
2025-10-02T08:15:39.395705Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:39.395715Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:39.395700Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2441
2025-10-02T08:15:39.395739Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea361985-d4493ce0-a520330f-6b93074a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:39.395749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.395753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.395759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:39.395766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.395780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:39.395828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.395878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.395885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.395898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.395942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2442 partition: 0 MaxSeqNo: 17 sessionId: src_id|ea361985-d4493ce0-a520330f-6b93074a_0
2025-10-02T08:15:39.396246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484d9838-1f58663d-6fdfb62f-e9ddc033_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ea361985-d4493ce0-a520330f-6b93074a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:39.398884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea361985-d4493ce0-a520330f-6b93074a_0] Write session: try to update token
2025-10-02T08:15:39.398905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea361985-d4493ce0-a520330f-6b93074a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:39.414251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId: src_id|ea361985-d4493ce0-a520330f-6b93074a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:39.414715Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:39.414727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:39.414729Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:39.414735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535135217673864:12256]
2025-10-02T08:15:39.414738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535135217673864:12256]
2025-10-02T08:15:39.414780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:39.414783Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:39.414789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:39.414792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.414794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:39.414916Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:39.417215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:39.457418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535135217673894:14175]
2025-10-02T08:15:39.457548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2441, pipe: [1:7556535135217673894:14175]
2025-10-02T08:15:39.550312Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:39.550749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.550762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.550798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217673894:14175], now have 1 active actors on pipe
2025-10-02T08:15:39.550904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535135217673894:14175]
2025-10-02T08:15:39.550934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:39.550936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:39.550962Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:39.550994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2442 reason: error at write: Disconnected sessionId: src_id|ea361985-d4493ce0-a520330f-6b93074a_0
2025-10-02T08:15:39.551009Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:39.551098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2442 sessionId: src_id|ea361985-d4493ce0-a520330f-6b93074a_0 is DEAD
2025-10-02T08:15:39.551231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea361985-d4493ce0-a520330f-6b93074a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:39.551241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea361985-d4493ce0-a520330f-6b93074a_0] Write session will restart in 0.005192s
2025-10-02T08:15:39.551267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea361985-d4493ce0-a520330f-6b93074a_0] Write session: Do CDS request
2025-10-02T08:15:39.551273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea361985-d4493ce0-a520330f-6b93074a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:39.557255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea361985-d4493ce0-a520330f-6b93074a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.557336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:39.557353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2443
2025-10-02T08:15:39.557447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.557469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:39.557473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:39.557476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:39.558056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2443 sessionId:  describe result for acl check
2025-10-02T08:15:39.558081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:39.558082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:39.558083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:39.558087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535135217674190:12272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:39.558556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535135217674190:12272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:39.560984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535135217674190:12272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:39.563776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535135217674190:12272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:39.563789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535135217674190:12272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:39.563792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535135217674190:12272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:39.563799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:39.569731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:39.569987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:39.570125Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:39.570133Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:39.570138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:39.570167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:39.570248Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535135217674625:12270]
2025-10-02T08:15:39.570652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:39.570825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:39.570852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:39.571066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:39.571105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.571111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.571112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.571113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.571114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.571118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.571126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.571130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.571133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.571136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.571141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.571147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.571153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.571157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.571161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.571165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.571169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.571173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.571181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.571186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.571202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:39.578835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:39.580562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:39.580574Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:39.580575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:39.580578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:39.580582Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2442 [1:7556535135217674625:12270]
2025-10-02T08:15:39.580589Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:39.580603Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:39.580605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.580607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.580608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.580620Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:39.580622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:39.580627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:39.580669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.580674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.580678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:39.580679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:39.580729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:39.580733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.580741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.580747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:39.580762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217674421:12272], now have 1 active actors on pipe
2025-10-02T08:15:39.580768Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535135217674619:12270]
2025-10-02T08:15:39.580770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535135217674619:12270]
2025-10-02T08:15:39.580777Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:39.580783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2442
2025-10-02T08:15:39.580786Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:39.580789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:39.580792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:39.580820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:39.580823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:39.580828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535135677073875:2378], now have 1 active actors on pipe
2025-10-02T08:15:39.580833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.580836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.580871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535135217674619:12270]
2025-10-02T08:15:39.580883Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:39.580890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:39.580896Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|403b65b9-30e2b21-d7907b03-5121a98d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:39.580902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.580906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.580908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:39.580881Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2442
2025-10-02T08:15:39.580916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.580928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:39.580955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.581033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.581038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.581048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.581082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2443 partition: 0 MaxSeqNo: 17 sessionId: src_id|403b65b9-30e2b21-d7907b03-5121a98d_0
2025-10-02T08:15:39.581354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea361985-d4493ce0-a520330f-6b93074a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|403b65b9-30e2b21-d7907b03-5121a98d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:39.583824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403b65b9-30e2b21-d7907b03-5121a98d_0] Write session: try to update token
2025-10-02T08:15:39.583840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403b65b9-30e2b21-d7907b03-5121a98d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:39.597455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId: src_id|403b65b9-30e2b21-d7907b03-5121a98d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:39.597592Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:39.597610Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:39.597613Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:39.597620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535135217674619:12270]
2025-10-02T08:15:39.597624Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535135217674619:12270]
2025-10-02T08:15:39.597668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:39.597681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.597683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:39.597753Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:39.597766Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:39.597833Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:39.599852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:39.650908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535135217674649:14175]
2025-10-02T08:15:39.651038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2442, pipe: [1:7556535135217674649:14175]
2025-10-02T08:15:39.726730Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:39.727180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.727196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.727226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217674649:14175], now have 1 active actors on pipe
2025-10-02T08:15:39.727283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:39.727291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:39.727339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2443 reason: error at write: Disconnected sessionId: src_id|403b65b9-30e2b21-d7907b03-5121a98d_0
2025-10-02T08:15:39.727407Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:39.727441Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:39.727481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2443 sessionId: src_id|403b65b9-30e2b21-d7907b03-5121a98d_0 is DEAD
2025-10-02T08:15:39.727614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403b65b9-30e2b21-d7907b03-5121a98d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:39.727619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535135217674649:14175]
2025-10-02T08:15:39.727639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403b65b9-30e2b21-d7907b03-5121a98d_0] Write session will restart in 0.009947s
2025-10-02T08:15:39.727665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403b65b9-30e2b21-d7907b03-5121a98d_0] Write session: Do CDS request
2025-10-02T08:15:39.727672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403b65b9-30e2b21-d7907b03-5121a98d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:39.738269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403b65b9-30e2b21-d7907b03-5121a98d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.738314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:39.738331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2444
2025-10-02T08:15:39.738464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.738494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:39.738504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:39.738507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:39.738907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2444 sessionId:  describe result for acl check
2025-10-02T08:15:39.738943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:39.738949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:39.738950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:39.738955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535135217675159:6480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:39.739460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535135217675159:6480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:39.741922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535135217675159:6480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:39.744994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535135217675159:6480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:39.745007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535135217675159:6480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:39.745010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535135217675159:6480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:39.745078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:39.745581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:39.745935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:39.746103Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:39.746124Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:39.746137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:39.746187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:39.746225Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535135217675384:6521]
2025-10-02T08:15:39.746863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:39.747068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:39.747107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:39.747396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:39.747443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.747449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.747450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.747451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.747453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.747458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.747468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.747472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.747476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.747480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.747485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.747497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.747503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.747512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.747517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.747526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.747530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.747539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.747544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.747549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.747572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:39.755631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:39.757416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:39.757433Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:39.757435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:39.757439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:39.757446Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2443 [1:7556535135217675384:6521]
2025-10-02T08:15:39.757456Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:39.757473Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:39.757481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.757484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.757486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.757501Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:39.757510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:39.757519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:39.757581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.757587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.757591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:39.757594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:39.757659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:39.757666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.757677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.757694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:39.757709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2443
2025-10-02T08:15:39.757716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217675375:6480], now have 1 active actors on pipe
2025-10-02T08:15:39.757719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535135677073882:2378], now have 1 active actors on pipe
2025-10-02T08:15:39.757726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535135217675378:6521]
2025-10-02T08:15:39.757728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535135217675378:6521]
2025-10-02T08:15:39.757754Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:39.757754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:39.757756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:39.757770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.757773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.757792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:39.757805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:39.757813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:39.757808Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2443
2025-10-02T08:15:39.757854Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:39.757864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.757868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.757870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:39.757879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.757887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:39.757894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535135217675378:6521]
2025-10-02T08:15:39.757903Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:39.757917Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:39.757933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.757998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.758005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.758020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.758057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2444 partition: 0 MaxSeqNo: 17 sessionId: src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0
2025-10-02T08:15:39.758378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403b65b9-30e2b21-d7907b03-5121a98d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:39.760989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0] Write session: try to update token
2025-10-02T08:15:39.761003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:39.767950Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:39.767973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:39.767981Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535135217675378:6521]
2025-10-02T08:15:39.768021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:39.768029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:39.768202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:39.768347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:39.768485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:39.768628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:39.768852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:39.768894Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:39.774226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId: src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:39.776722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:39.776792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.776823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.776859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:39.776885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:39.776949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.776964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.777131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.777197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.777261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.777327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.777769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.777781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.777850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.777915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.777976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.778042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.778090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.778097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.778162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.778221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.778282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.778343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.778385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.778392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.778457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.778522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.778585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.778652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.778704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.778712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.778778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.778841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.778903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.778963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.779006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.779013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.779084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.779148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.779213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.779278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.779324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.779333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.779399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.779460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.779526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.779590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.779648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.779656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.779725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.779788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.779852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.779918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.779962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.779969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.780038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.780099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.780177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.780241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.780283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.780290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.780357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:39.780419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:39.780483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:39.780545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:39.780589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:39.780596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:39.780643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:39.780708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.780733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.780739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:39.780771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:39.780788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:39.780795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:39.780799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:39.780820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:39.781200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:39.781227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:39.781237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:39.781241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:39.781249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:39.781253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:39.781991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:39.782013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:39.782019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:39.782023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:39.782026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:39.782031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:39.782563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:39.782590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:39.782595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:39.782599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:39.782603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:39.783813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:39.783834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:39.783846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392939783
2025-10-02T08:15:39.783969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:39.783987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:39.784007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:39.784011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:39.784015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:39.784018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:39.784494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:39.784516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:39.784523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:39.784531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:39.784534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:39.784538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:39.785020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:39.785044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:39.785057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:39.785064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:39.785068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:39.785072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:39.785548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:39.785569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:39.785575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:39.786645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:39.786664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:39.786669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:39.786674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:39.786690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392939786
2025-10-02T08:15:39.786986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:39.787010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:39.787016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:39.787022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:39.787025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:39.787030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:39.787483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:39.787508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:39.787514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:39.787517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:39.787520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:39.787524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:39.787962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:39.787972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.788066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392939788
2025-10-02T08:15:39.788799Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:39.788902Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:39.788911Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:39.788919Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:39.790457Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:39.790474Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:39.790475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:39.790484Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535135217675378:6521]
2025-10-02T08:15:39.790489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535135217675378:6521]
2025-10-02T08:15:39.790543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:39.790543Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:39.790549Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:39.790555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.790557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:39.790682Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:39.827514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535135217675417:14175]
2025-10-02T08:15:39.827619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2443, pipe: [1:7556535135217675417:14175]
2025-10-02T08:15:39.936610Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:39.937013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217675417:14175], now have 1 active actors on pipe
2025-10-02T08:15:39.937121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:39.937129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:39.937152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2444 reason: error at write: Disconnected sessionId: src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0
2025-10-02T08:15:39.937248Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:39.937290Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:39.937308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2444 sessionId: src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0 is DEAD
2025-10-02T08:15:39.937445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:39.937455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0] Write session will restart in 0.009335s
2025-10-02T08:15:39.937477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0] Write session: Do CDS request
2025-10-02T08:15:39.937483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:39.937478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535135217675417:14175]
2025-10-02T08:15:39.948287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.948423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:39.948439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2445
2025-10-02T08:15:39.948551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:39.948595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:39.948605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:39.948609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:39.949031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2445 sessionId:  describe result for acl check
2025-10-02T08:15:39.949069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:39.949078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:39.949080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:39.949086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535135217675929:6404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:39.949558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535135217675929:6404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:39.951953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535135217675929:6404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:39.955123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535135217675929:6404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:39.955136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535135217675929:6404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:39.955139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535135217675929:6404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:39.955145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:39.956437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:39.956739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:39.956912Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:39.956921Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:39.956931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:39.956981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:39.957017Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535135217676160:6414]
2025-10-02T08:15:39.957627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:39.957796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:39.957834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:39.958112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:39.958168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.958174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.958175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.958177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.958177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.958182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.958191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.958195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.958198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.958206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.958211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.958222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:39.958232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.958237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:39.958245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.958253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:39.958261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.958265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.958270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.958275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.958292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:39.966079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:39.967493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:39.967510Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:39.967513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:39.967517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:39.967523Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2444 [1:7556535135217676160:6414]
2025-10-02T08:15:39.967535Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:39.967550Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:39.967553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.967555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.967556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.967569Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:39.967577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:39.967583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:39.967635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.967641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.967642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:39.967644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:39.967691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:39.967696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.967703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:39.967710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:39.967721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535135217676154:6414]
2025-10-02T08:15:39.967722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535135217676154:6414]
2025-10-02T08:15:39.967727Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:39.967736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:39.967753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:39.967761Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:39.967767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:39.967777Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:39.967778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2444
2025-10-02T08:15:39.967796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535135217676150:6404], now have 1 active actors on pipe
2025-10-02T08:15:39.967799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535135217676154:6414]
2025-10-02T08:15:39.967802Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:39.967804Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:39.967805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535135677073902:2378], now have 1 active actors on pipe
2025-10-02T08:15:39.967809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.967811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.967854Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6114c52a-568e35bd-359e3986-62857b3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:39.967865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:39.967868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:39.967869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:39.967877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:39.967887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:39.967899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.967928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:39.967933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:39.967943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:39.967973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2445 partition: 0 MaxSeqNo: 17 sessionId: src_id|6114c52a-568e35bd-359e3986-62857b3a_0
2025-10-02T08:15:39.968085Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2444
2025-10-02T08:15:39.968328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44b88cf-e7bb2a31-7d3bb82-36abbfd3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6114c52a-568e35bd-359e3986-62857b3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:39.970968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6114c52a-568e35bd-359e3986-62857b3a_0] Write session: try to update token
2025-10-02T08:15:39.970984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6114c52a-568e35bd-359e3986-62857b3a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:39.984836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId: src_id|6114c52a-568e35bd-359e3986-62857b3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:39.985487Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:39.985500Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:39.985503Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:39.985510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535135217676154:6414]
2025-10-02T08:15:39.985514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535135217676154:6414]
2025-10-02T08:15:39.985553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:39.985552Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:39.985557Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:39.985563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:39.985565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:39.985695Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:39.987756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:40.051225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535139512643494:14175]
2025-10-02T08:15:40.053450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2444, pipe: [1:7556535139512643494:14175]
2025-10-02T08:15:40.117466Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:40.117850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.117863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.117901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512643494:14175], now have 1 active actors on pipe
2025-10-02T08:15:40.118016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:40.118028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:40.118049Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:40.118054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:40.118105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2445 reason: error at write: Disconnected sessionId: src_id|6114c52a-568e35bd-359e3986-62857b3a_0
2025-10-02T08:15:40.118246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2445 sessionId: src_id|6114c52a-568e35bd-359e3986-62857b3a_0 is DEAD
2025-10-02T08:15:40.118364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6114c52a-568e35bd-359e3986-62857b3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:40.118372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6114c52a-568e35bd-359e3986-62857b3a_0] Write session will restart in 0.009362s
2025-10-02T08:15:40.118390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6114c52a-568e35bd-359e3986-62857b3a_0] Write session: Do CDS request
2025-10-02T08:15:40.118395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6114c52a-568e35bd-359e3986-62857b3a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:40.118390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535139512643494:14175]
2025-10-02T08:15:40.129459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6114c52a-568e35bd-359e3986-62857b3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.129655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:40.129673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2446
2025-10-02T08:15:40.129868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.129901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:40.129905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:40.129908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:40.130340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2446 sessionId:  describe result for acl check
2025-10-02T08:15:40.130372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:40.130378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:40.130380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:40.130384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535139512643991:6212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:40.130885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535139512643991:6212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:40.133503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535139512643991:6212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:40.136352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535139512643991:6212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:40.136367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535139512643991:6212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:40.136370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535139512643991:6212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:40.136378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:40.141546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:40.141954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:40.142124Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:40.142135Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:40.142145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:40.142188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:40.142240Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535139512644250:6213]
2025-10-02T08:15:40.142882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:40.143090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:40.143135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:40.143458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:40.143505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.143511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.143512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.143513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.143514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.143519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.143529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.143533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.143537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.143540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.143546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.143553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.143559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.143565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.143569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.143575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.143584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.143590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.143595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.143604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.143623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:40.155117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:40.156694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:40.156715Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:40.156718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:40.156722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:40.156729Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2445 [1:7556535139512644250:6213]
2025-10-02T08:15:40.156743Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:40.156762Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:40.156765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.156769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.156771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.156787Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:40.156792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:40.156798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:40.156884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.156893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.156897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:40.156900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:40.156972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:40.156980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.156995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.157007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:40.157031Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535139512644244:6213]
2025-10-02T08:15:40.157038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535139512644244:6213]
2025-10-02T08:15:40.157052Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:40.157070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:40.157090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:40.157097Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:40.157132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535139512644244:6213]
2025-10-02T08:15:40.157139Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:40.157139Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:40.157143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:40.157149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:40.157410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512644162:6212], now have 1 active actors on pipe
2025-10-02T08:15:40.157419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535139972041228:2378], now have 1 active actors on pipe
2025-10-02T08:15:40.157440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2445
2025-10-02T08:15:40.157419Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2445
2025-10-02T08:15:40.157463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.157470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.157500Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a754a7d9-91f73772-55b721dd-d8cab545_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:40.157511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.157520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.157522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:40.157534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.157548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:40.157567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.157603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.157609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.157621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.157654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2446 partition: 0 MaxSeqNo: 17 sessionId: src_id|a754a7d9-91f73772-55b721dd-d8cab545_0
2025-10-02T08:15:40.158014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6114c52a-568e35bd-359e3986-62857b3a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a754a7d9-91f73772-55b721dd-d8cab545_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:40.161005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a754a7d9-91f73772-55b721dd-d8cab545_0] Write session: try to update token
2025-10-02T08:15:40.161023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a754a7d9-91f73772-55b721dd-d8cab545_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:40.178136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId: src_id|a754a7d9-91f73772-55b721dd-d8cab545_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:40.178987Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:40.178991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:40.178993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:40.179001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535139512644244:6213]
2025-10-02T08:15:40.179005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535139512644244:6213]
2025-10-02T08:15:40.179050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:40.179056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.179058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:40.179058Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:40.179065Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:40.179198Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:40.180729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:40.218672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535139512644276:14175]
2025-10-02T08:15:40.218746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2445, pipe: [1:7556535139512644276:14175]
2025-10-02T08:15:40.310887Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:40.311415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.311427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.311459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512644276:14175], now have 1 active actors on pipe
2025-10-02T08:15:40.311559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:40.311565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:40.311614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2446 reason: error at write: Disconnected sessionId: src_id|a754a7d9-91f73772-55b721dd-d8cab545_0
2025-10-02T08:15:40.311692Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:40.311700Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:40.311784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2446 sessionId: src_id|a754a7d9-91f73772-55b721dd-d8cab545_0 is DEAD
2025-10-02T08:15:40.311938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535139512644276:14175]
2025-10-02T08:15:40.311949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a754a7d9-91f73772-55b721dd-d8cab545_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:40.311960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a754a7d9-91f73772-55b721dd-d8cab545_0] Write session will restart in 0.009069s
2025-10-02T08:15:40.311989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a754a7d9-91f73772-55b721dd-d8cab545_0] Write session: Do CDS request
2025-10-02T08:15:40.311996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a754a7d9-91f73772-55b721dd-d8cab545_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:40.322259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a754a7d9-91f73772-55b721dd-d8cab545_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.322379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:40.322396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2447
2025-10-02T08:15:40.322501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.322529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:40.322538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:40.322542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:40.322955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2447 sessionId:  describe result for acl check
2025-10-02T08:15:40.322987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:40.322989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:40.322990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:40.322995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535139512644746:6103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:40.323473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535139512644746:6103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:40.326473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535139512644746:6103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:40.329777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535139512644746:6103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:40.329792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535139512644746:6103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:40.329795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535139512644746:6103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:40.329805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:40.331226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:40.331564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:40.331709Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:40.331716Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:40.331722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:40.331752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:40.331779Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535139512645008:6528]
2025-10-02T08:15:40.332199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:40.332378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:40.332419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:40.332633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:40.332674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.332679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.332681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.332682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.332683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.332688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.332698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.332705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.332709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.332716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.332721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.332732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.332738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.332743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.332751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.332757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.332764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.332769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.332774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.332782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.332814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:40.340883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:40.342745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:40.342760Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:40.342761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:40.342764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:40.342769Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2446 [1:7556535139512645008:6528]
2025-10-02T08:15:40.342778Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:40.342792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:40.342793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.342795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.342796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.342809Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:40.342812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:40.342817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:40.342869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.342876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.342878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:40.342880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:40.342928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:40.342933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.342942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.342948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:40.342959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535139512645002:6528]
2025-10-02T08:15:40.342964Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535139512645002:6528]
2025-10-02T08:15:40.342969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:40.342981Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:40.342990Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:40.342993Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:40.342997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:40.342999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2446
2025-10-02T08:15:40.343000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:40.343009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512644993:6103], now have 1 active actors on pipe
2025-10-02T08:15:40.343046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535139972041236:2378], now have 1 active actors on pipe
2025-10-02T08:15:40.343054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.343060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.343077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535139512645002:6528]
2025-10-02T08:15:40.343088Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:40.343097Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:40.343108Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:40.343114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.343119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.343121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:40.343100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2446
2025-10-02T08:15:40.343128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.343136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:40.343160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.343230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.343239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.343266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.343335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2447 partition: 0 MaxSeqNo: 17 sessionId: src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0
2025-10-02T08:15:40.343659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a754a7d9-91f73772-55b721dd-d8cab545_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:40.346225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0] Write session: try to update token
2025-10-02T08:15:40.346240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:40.360984Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:40.361002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:40.361004Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:40.361015Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535139512645002:6528]
2025-10-02T08:15:40.361020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535139512645002:6528]
2025-10-02T08:15:40.361054Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:40.361058Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:40.361058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:40.361064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.361066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:40.361215Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:40.364862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId: src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:40.367331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:40.412250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535139512645034:14175]
2025-10-02T08:15:40.412392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2446, pipe: [1:7556535139512645034:14175]
2025-10-02T08:15:40.495823Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:40.496344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.496357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.496393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512645034:14175], now have 1 active actors on pipe
2025-10-02T08:15:40.496495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535139512645034:14175]
2025-10-02T08:15:40.496520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:40.496529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:40.496587Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:40.496596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2447 reason: error at write: Disconnected sessionId: src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0
2025-10-02T08:15:40.496606Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:40.496760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2447 sessionId: src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0 is DEAD
2025-10-02T08:15:40.496925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:40.496934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0] Write session will restart in 0.005629s
2025-10-02T08:15:40.496958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0] Write session: Do CDS request
2025-10-02T08:15:40.496965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:40.503273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.503293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:40.503311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2448
2025-10-02T08:15:40.503464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.503497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:40.503506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:40.503509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:40.503914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2448 sessionId:  describe result for acl check
2025-10-02T08:15:40.503945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:40.503947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:40.503948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:40.503952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535139512645369:6525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:40.504444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535139512645369:6525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:40.506379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535139512645369:6525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:40.509700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535139512645369:6525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:40.509725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535139512645369:6525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:40.509728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535139512645369:6525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:40.509735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:40.516629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:40.517541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:40.517703Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:40.517712Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:40.517721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:40.517763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:40.517800Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535139512645771:6526]
2025-10-02T08:15:40.518413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:40.518613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:40.518650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:40.518940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:40.518979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.518984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.518985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.518986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.518987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.518992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.519002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.519006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.519014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.519018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.519027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.519039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.519049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.519058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.519064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.519073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.519081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.519087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.519095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.519100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.519120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:40.526988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:40.528638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:40.528655Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:40.528658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:40.528661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:40.528667Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2447 [1:7556535139512645771:6526]
2025-10-02T08:15:40.528679Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:40.528695Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:40.528706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.528708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.528710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.528726Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:40.528730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:40.528735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:40.528794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.528820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.528822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:40.528824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:40.528886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:40.528895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.528908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.528917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:40.528935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512645608:6525], now have 1 active actors on pipe
2025-10-02T08:15:40.528937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2447
2025-10-02T08:15:40.528942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535139512645765:6526]
2025-10-02T08:15:40.528943Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535139512645765:6526]
2025-10-02T08:15:40.528957Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:40.528971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.528973Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:40.528974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.528976Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:40.528988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535139972041242:2378], now have 1 active actors on pipe
2025-10-02T08:15:40.528997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:40.529009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:40.529017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:40.529043Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2447
2025-10-02T08:15:40.529071Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99729d7e-bd58f525-a71549d0-3d902a24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:40.529081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.529085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.529086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:40.529094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.529103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:40.529114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535139512645765:6526]
2025-10-02T08:15:40.529120Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:40.529133Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:40.529151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.529192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.529199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.529211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.529248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2448 partition: 0 MaxSeqNo: 17 sessionId: src_id|99729d7e-bd58f525-a71549d0-3d902a24_0
2025-10-02T08:15:40.529565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcc55b-6a2fb4be-7c4f8ac1-882156d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|99729d7e-bd58f525-a71549d0-3d902a24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:40.532257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99729d7e-bd58f525-a71549d0-3d902a24_0] Write session: try to update token
2025-10-02T08:15:40.532271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99729d7e-bd58f525-a71549d0-3d902a24_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:40.540156Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:40.540174Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:40.540182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535139512645765:6526]
2025-10-02T08:15:40.540216Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:40.540220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:40.540375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:40.540514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:40.540648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:40.540782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:40.540992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:40.541035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:40.546546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId: src_id|99729d7e-bd58f525-a71549d0-3d902a24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:40.548793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:40.548862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.548871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.548898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:40.548916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:40.548957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.548973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.549125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.549199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.549262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.549328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.549370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.549378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.549444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.549505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.549565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.549625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.549669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.549676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.549738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.549796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.549850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.549912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.549954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.549961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.550023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.550080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.550140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.550209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.550251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.550258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.550323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.550380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.550443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.550508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.550552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.550560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.550624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.550687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.550752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.550810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.550851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.550857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.550918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.550977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.551037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.551098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.551139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.551146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.551204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.551263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.551323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.551384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.551429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.551436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.551499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.551555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.551612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.551669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.551714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.551724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.551786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:40.551841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:40.551898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:40.551956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:40.552001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:40.552008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:40.552044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:40.552109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.552143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.552152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:40.552182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:40.552197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:40.552204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:40.552207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:40.552211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:40.552611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:40.552641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:40.552646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:40.552650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:40.552653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:40.552656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:40.553617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:40.553644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:40.553650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:40.553654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:40.553657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:40.553661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:40.554104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:40.554133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:40.554138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:40.554142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:40.554144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:40.555352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:40.555371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:40.555382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392940555
2025-10-02T08:15:40.555608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:40.555625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:40.555635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:40.555641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:40.555644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:40.555647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:40.556086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:40.556109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:40.556115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:40.556118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:40.556121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:40.556138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:40.556603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:40.556631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:40.556642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:40.556649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:40.556653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:40.556660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:40.557126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:40.557150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:40.557154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:40.558191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:40.558211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:40.558216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:40.558223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:40.558231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392940558
2025-10-02T08:15:40.558517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:40.558538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:40.558547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:40.558554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:40.558559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:40.558562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:40.558993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:40.559014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:40.559025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:40.559034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:40.559040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:40.559045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:40.559494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:40.559514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.559607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392940559
2025-10-02T08:15:40.560353Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:40.560378Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:40.560389Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:40.560401Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:40.561905Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:40.561919Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:40.561920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:40.561926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535139512645765:6526]
2025-10-02T08:15:40.561930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535139512645765:6526]
2025-10-02T08:15:40.561969Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:40.561985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:40.561985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:40.561994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.561996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:40.562121Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:40.596541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535139512645803:14175]
2025-10-02T08:15:40.596628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2447, pipe: [1:7556535139512645803:14175]
2025-10-02T08:15:40.695628Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:40.696257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512645803:14175], now have 1 active actors on pipe
2025-10-02T08:15:40.696511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:40.696521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:40.696562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2448 reason: error at write: Disconnected sessionId: src_id|99729d7e-bd58f525-a71549d0-3d902a24_0
2025-10-02T08:15:40.696580Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:40.696733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2448 sessionId: src_id|99729d7e-bd58f525-a71549d0-3d902a24_0 is DEAD
2025-10-02T08:15:40.696895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535139512645803:14175]
2025-10-02T08:15:40.697099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99729d7e-bd58f525-a71549d0-3d902a24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:40.697112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99729d7e-bd58f525-a71549d0-3d902a24_0] Write session will restart in 0.007815s
2025-10-02T08:15:40.697134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99729d7e-bd58f525-a71549d0-3d902a24_0] Write session: Do CDS request
2025-10-02T08:15:40.697141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99729d7e-bd58f525-a71549d0-3d902a24_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:40.696859Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:40.709347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99729d7e-bd58f525-a71549d0-3d902a24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.709646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:40.709663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2449
2025-10-02T08:15:40.709781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.709807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:40.709812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:40.709816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:40.710234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2449 sessionId:  describe result for acl check
2025-10-02T08:15:40.710282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:40.710287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:40.710289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:40.710294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535139512646253:6563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:40.710882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535139512646253:6563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:40.716010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535139512646253:6563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:40.718420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:40.719337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:40.719470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535139512646253:6563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:40.719482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535139512646253:6563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:40.719485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535139512646253:6563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:40.719492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:40.719523Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:40.719534Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:40.719545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:40.719603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:40.719643Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535139512646539:6545]
2025-10-02T08:15:40.720260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:40.720461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:40.720509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:40.720825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:40.720872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.720877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.720878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.720879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.720880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.720885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.720894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.720897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.720900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.720903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.720909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.720916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.720921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.720927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.720931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.720935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.720939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.720944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.720948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.720953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.720976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:40.728939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:40.730733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:40.730752Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:40.730755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:40.730759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:40.730766Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2448 [1:7556535139512646539:6545]
2025-10-02T08:15:40.730778Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:40.730795Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:40.730798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.730802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.730804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.730821Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:40.730827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:40.730834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:40.730899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.730908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.730911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:40.730921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:40.730995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:40.731006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.731020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.731033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:40.731044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2448
2025-10-02T08:15:40.731052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512646541:6563], now have 1 active actors on pipe
2025-10-02T08:15:40.731061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535139972041248:2378], now have 1 active actors on pipe
2025-10-02T08:15:40.731067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535139512646531:6545]
2025-10-02T08:15:40.731081Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535139512646531:6545]
2025-10-02T08:15:40.731094Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:40.731108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.731109Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:40.731112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:40.731116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.731134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:40.731148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:40.731142Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2448
2025-10-02T08:15:40.731157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:40.731196Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9e5491f-424b6540-e9868e2a-86391f28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:40.731203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.731207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.731209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:40.731217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.731225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:40.731233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535139512646531:6545]
2025-10-02T08:15:40.731242Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:40.731247Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:40.731272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.731344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.731352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.731366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.731417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2449 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9e5491f-424b6540-e9868e2a-86391f28_0
2025-10-02T08:15:40.731756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99729d7e-bd58f525-a71549d0-3d902a24_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9e5491f-424b6540-e9868e2a-86391f28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:40.734173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e5491f-424b6540-e9868e2a-86391f28_0] Write session: try to update token
2025-10-02T08:15:40.734186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e5491f-424b6540-e9868e2a-86391f28_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:40.747611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId: src_id|a9e5491f-424b6540-e9868e2a-86391f28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:40.748671Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:40.748675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:40.748677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:40.748686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535139512646531:6545]
2025-10-02T08:15:40.748689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535139512646531:6545]
2025-10-02T08:15:40.748737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:40.748743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.748745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:40.748911Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:40.750618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:40.750991Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:40.751006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:40.796757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535139512646568:14175]
2025-10-02T08:15:40.796872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2448, pipe: [1:7556535139512646568:14175]
2025-10-02T08:15:40.887517Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:40.888118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.888145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.888194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512646568:14175], now have 1 active actors on pipe
2025-10-02T08:15:40.888407Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:40.888416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535139512646568:14175]
2025-10-02T08:15:40.888435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:40.888492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2449 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9e5491f-424b6540-e9868e2a-86391f28_0
2025-10-02T08:15:40.888463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:40.888646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2449 sessionId: src_id|a9e5491f-424b6540-e9868e2a-86391f28_0 is DEAD
2025-10-02T08:15:40.888971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e5491f-424b6540-e9868e2a-86391f28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:40.888981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e5491f-424b6540-e9868e2a-86391f28_0] Write session will restart in 0.008349s
2025-10-02T08:15:40.889015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e5491f-424b6540-e9868e2a-86391f28_0] Write session: Do CDS request
2025-10-02T08:15:40.889021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e5491f-424b6540-e9868e2a-86391f28_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:40.898250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e5491f-424b6540-e9868e2a-86391f28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.898298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:40.898315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2450
2025-10-02T08:15:40.898454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:40.898483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:40.898492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:40.898494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:40.898954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2450 sessionId:  describe result for acl check
2025-10-02T08:15:40.898983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:40.898990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:40.898992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:40.898997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535139512647033:6581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:40.899470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535139512647033:6581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:40.902276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535139512647033:6581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:40.905251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535139512647033:6581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:40.905282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535139512647033:6581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:40.905285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535139512647033:6581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:40.905293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:40.908298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:40.909515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:40.909759Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:40.909773Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:40.909786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:40.909845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:40.909885Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535139512647323:6582]
2025-10-02T08:15:40.910523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:40.910755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:40.910807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:40.911103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:40.911160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.911166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.911167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.911168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.911169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.911174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.911184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.911188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.911192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.911195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.911202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.911209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:40.911215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.911221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:40.911226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.911233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:40.911242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.911248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.911259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.911268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.911287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:40.919618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:40.921783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:40.921804Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:40.921807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:40.921810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:40.921817Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2449 [1:7556535139512647323:6582]
2025-10-02T08:15:40.921828Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:40.921847Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:40.921850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.921853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.921855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.921871Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:40.921875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:40.921884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:40.921953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.921962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.921966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:40.921968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:40.922034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:40.922042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.922056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:40.922074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:40.922097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512647276:6581], now have 1 active actors on pipe
2025-10-02T08:15:40.922109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535139512647317:6582]
2025-10-02T08:15:40.922112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535139512647317:6582]
2025-10-02T08:15:40.922115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2449
2025-10-02T08:15:40.922119Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:40.922129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535139972041268:2378], now have 1 active actors on pipe
2025-10-02T08:15:40.922138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:40.922143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:40.922146Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:40.922151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:40.922155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:40.922162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.922166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.922208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535139512647317:6582]
2025-10-02T08:15:40.922218Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:40.922235Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:40.922242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:40.922246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:40.922249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:40.922251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:40.922260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:40.922200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2449
2025-10-02T08:15:40.922272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:40.922320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.922375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:40.922382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:40.922396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:40.922435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2450 partition: 0 MaxSeqNo: 17 sessionId: src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0
2025-10-02T08:15:40.922772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e5491f-424b6540-e9868e2a-86391f28_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:40.925492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0] Write session: try to update token
2025-10-02T08:15:40.925508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:40.940594Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:40.940617Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:40.940620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:40.940629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535139512647317:6582]
2025-10-02T08:15:40.940633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535139512647317:6582]
2025-10-02T08:15:40.940679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:40.940687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:40.940696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:40.940717Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:40.940723Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:40.940882Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:40.945483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId: src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:40.947949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:40.988729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535139512647347:14175]
2025-10-02T08:15:40.988864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2449, pipe: [1:7556535139512647347:14175]
2025-10-02T08:15:41.072659Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:41.072899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.072910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.072947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535139512647347:14175], now have 1 active actors on pipe
2025-10-02T08:15:41.073201Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:41.073371Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:41.073739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535139512647347:14175]
2025-10-02T08:15:41.073790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:41.073836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2450 reason: status is not ok: tablet will be restarted right now sessionId: src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0
2025-10-02T08:15:41.073959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2450 sessionId: src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0 is DEAD
2025-10-02T08:15:41.074106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:41.074114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0] Write session will restart in 0.009543s
2025-10-02T08:15:41.074131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0] Write session: Do CDS request
2025-10-02T08:15:41.074135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:41.085249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.085352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:41.085369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2451
2025-10-02T08:15:41.085476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.085504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:41.085513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:41.085516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:41.086138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2451 sessionId:  describe result for acl check
2025-10-02T08:15:41.086177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:41.086183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:41.086184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:41.086190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535143807615187:6626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:41.086804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535143807615187:6626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:41.089048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535143807615187:6626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:41.092319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535143807615187:6626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:41.092330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535143807615187:6626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:41.092332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535143807615187:6626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:41.092338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:41.094057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:41.095440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:41.095582Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:41.095589Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:41.095596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:41.095628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:41.095654Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535143807615408:6628]
2025-10-02T08:15:41.096119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:41.096343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:41.096388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:41.096640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:41.096675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.096680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.096680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.096681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.096683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.096687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.096696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.096700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.096703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.096707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.096712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.096720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.096727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.096733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.096737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.096742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.096746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.096750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.096754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.096759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.096779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:41.104734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:41.106706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:41.106721Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:41.106723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:41.106727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:41.106732Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2450 [1:7556535143807615408:6628]
2025-10-02T08:15:41.106743Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:41.106761Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:41.106764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.106767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.106769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.106785Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:41.106790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:41.106795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:41.106856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.106864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.106867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:41.106869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:41.106929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:41.106937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.106949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.106965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:41.106985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535143807615402:6628]
2025-10-02T08:15:41.106992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535143807615402:6628]
2025-10-02T08:15:41.107000Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:41.107013Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:41.107014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807615387:6626], now have 1 active actors on pipe
2025-10-02T08:15:41.107015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2450
2025-10-02T08:15:41.107019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:41.107023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:41.107032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:41.107037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:41.107042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535144267008584:2378], now have 1 active actors on pipe
2025-10-02T08:15:41.107073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.107081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.107094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535143807615402:6628]
2025-10-02T08:15:41.107105Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:41.107125Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:41.107129Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:41.107135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.107125Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2450
2025-10-02T08:15:41.107139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.107140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:41.107149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.107157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:41.107179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.107237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.107243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.107255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.107289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2451 partition: 0 MaxSeqNo: 17 sessionId: src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0
2025-10-02T08:15:41.107599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|338e6594-ba727b3f-1e6b939f-c8b21c7a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:41.110221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0] Write session: try to update token
2025-10-02T08:15:41.110240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:41.124547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId: src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:41.124917Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:41.124929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:41.124932Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:41.124940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535143807615402:6628]
2025-10-02T08:15:41.124944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535143807615402:6628]
2025-10-02T08:15:41.124994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:41.125006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.125009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:41.125078Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:41.125096Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:41.125142Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:41.127245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:41.174085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535143807615448:14175]
2025-10-02T08:15:41.174185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2450, pipe: [1:7556535143807615448:14175]
2025-10-02T08:15:41.250507Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:41.250961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.250976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.251013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807615448:14175], now have 1 active actors on pipe
2025-10-02T08:15:41.251132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:41.251140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:41.251189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2451 reason: error at write: Disconnected sessionId: src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0
2025-10-02T08:15:41.251204Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:41.251246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:41.251348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2451 sessionId: src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0 is DEAD
2025-10-02T08:15:41.251473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:41.251479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0] Write session will restart in 0.006148s
2025-10-02T08:15:41.251501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0] Write session: Do CDS request
2025-10-02T08:15:41.251507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:41.251508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535143807615448:14175]
2025-10-02T08:15:41.258222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.258294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:41.258311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2452
2025-10-02T08:15:41.258441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.258472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:41.258482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:41.258485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:41.258890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2452 sessionId:  describe result for acl check
2025-10-02T08:15:41.258918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:41.258923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:41.258925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:41.258929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535143807615807:6664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:41.259299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535143807615807:6664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:41.261846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535143807615807:6664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:41.264813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535143807615807:6664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:41.264826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535143807615807:6664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:41.264829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535143807615807:6664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:41.264837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:41.268291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:41.269292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:41.269467Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:41.269478Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:41.269487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:41.269539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:41.269577Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535143807616192:6657]
2025-10-02T08:15:41.270212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:41.270446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:41.270488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:41.270719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:41.270754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.270758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.270759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.270760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.270761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.270766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.270775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.270779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.270783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.270786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.270801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.270810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.270814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.270817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.270820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.270823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.270826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.270831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.270836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.270840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.270860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:41.278662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:41.280426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:41.280441Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:41.280443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:41.280445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:41.280451Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2451 [1:7556535143807616192:6657]
2025-10-02T08:15:41.280459Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:41.280472Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:41.280474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.280476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.280477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.280488Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:41.280492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:41.280496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:41.280563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.280572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.280576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:41.280579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:41.280627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:41.280632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.280641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.280648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:41.280660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535143807616186:6657]
2025-10-02T08:15:41.280665Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535143807616186:6657]
2025-10-02T08:15:41.280671Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:41.280683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:41.280697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2451
2025-10-02T08:15:41.280697Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:41.280701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:41.280701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:41.280703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:41.280713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807616101:6664], now have 1 active actors on pipe
2025-10-02T08:15:41.280743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535144267008602:2378], now have 1 active actors on pipe
2025-10-02T08:15:41.280750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.280753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.280764Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535143807616186:6657]
2025-10-02T08:15:41.280773Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:41.280785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:41.280798Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:41.280836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.280845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.280847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:41.280856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.280835Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2451
2025-10-02T08:15:41.280868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:41.280898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.280940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.280946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.280958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.280993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2452 partition: 0 MaxSeqNo: 17 sessionId: src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0
2025-10-02T08:15:41.281314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b9603e6-708e9531-f02cb138-f3ed0947_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:41.283937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0] Write session: try to update token
2025-10-02T08:15:41.283955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:41.300520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId: src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:41.300968Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:41.300983Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:41.300985Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:41.300992Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535143807616186:6657]
2025-10-02T08:15:41.300995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535143807616186:6657]
2025-10-02T08:15:41.301037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:41.301040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:41.301046Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:41.301047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.301049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:41.301175Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:41.303077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:41.351765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535143807616217:14175]
2025-10-02T08:15:41.351908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2451, pipe: [1:7556535143807616217:14175]
2025-10-02T08:15:41.435190Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:41.435630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.435644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.435682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807616217:14175], now have 1 active actors on pipe
2025-10-02T08:15:41.435788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:41.435799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:41.435845Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:41.435854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2452 reason: error at write: Disconnected sessionId: src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0
2025-10-02T08:15:41.435897Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:41.436000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2452 sessionId: src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0 is DEAD
2025-10-02T08:15:41.436147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:41.436157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0] Write session will restart in 0.009239s
2025-10-02T08:15:41.436180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0] Write session: Do CDS request
2025-10-02T08:15:41.436188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:41.436188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535143807616217:14175]
2025-10-02T08:15:41.446265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.446297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:41.446314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2453
2025-10-02T08:15:41.446471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.446511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:41.446520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:41.446523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:41.446837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2453 sessionId:  describe result for acl check
2025-10-02T08:15:41.446861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:41.446866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:41.446867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:41.446871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535143807616761:6680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:41.447219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535143807616761:6680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:41.449625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535143807616761:6680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:41.453593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:41.453674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535143807616761:6680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:41.453688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535143807616761:6680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:41.453692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535143807616761:6680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:41.453699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:41.453901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:41.454111Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:41.454119Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:41.454128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:41.454181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:41.454212Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535143807616962:6672]
2025-10-02T08:15:41.454672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:41.454864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:41.454921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:41.455235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:41.455288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.455295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.455296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.455297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.455298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.455303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.455313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.455321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.455329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.455343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.455352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.455359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.455370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.455376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.455381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.455385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.455394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.455403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.455412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.455421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.455443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:41.462991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:41.464874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:41.464886Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:41.464888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:41.464891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:41.464898Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2452 [1:7556535143807616962:6672]
2025-10-02T08:15:41.464909Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:41.464925Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:41.464931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.464934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.464936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.464951Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:41.464959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:41.464966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:41.465018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.465024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.465027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:41.465028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:41.465078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:41.465084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.465097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.465109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:41.465126Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535143807616950:6672]
2025-10-02T08:15:41.465130Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535143807616950:6672]
2025-10-02T08:15:41.465136Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:41.465145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:41.465157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:41.465162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:41.465164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:41.465165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2452
2025-10-02T08:15:41.465167Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:41.465169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807616958:6680], now have 1 active actors on pipe
2025-10-02T08:15:41.465197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535144267008609:2378], now have 1 active actors on pipe
2025-10-02T08:15:41.465204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535143807616950:6672]
2025-10-02T08:15:41.465207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:41.465280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.465283Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:41.465286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.465306Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:41.465314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.465316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.465318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:41.465325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.465335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:41.465350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.465384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.465390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.465401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.465400Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2452
2025-10-02T08:15:41.465430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2453 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0
2025-10-02T08:15:41.465725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|610cfd0d-44e8b8e1-358e7739-839dbf42_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:41.468007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0] Write session: try to update token
2025-10-02T08:15:41.468018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:41.475656Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:41.475676Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:41.475684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535143807616950:6672]
2025-10-02T08:15:41.475724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:41.475728Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:41.475890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:41.476033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:41.476188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:41.476323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:41.476595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:41.476636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:41.481705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId: src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:41.484064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:41.484135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.484145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.484171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:41.484191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:41.484235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.484256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.484422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.484493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.484563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.484633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.484845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.484856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.484930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.484996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.485062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.485137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.485189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.485198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.485272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.485337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.485399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.485461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.485515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.485522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.485589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.485657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.485726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.485796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.485843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.485850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.485921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.485989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.486058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.486125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.486172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.486179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.486250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.486309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.486381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.486448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.486495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.486503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.486574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.486640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.486713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.486780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.486833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.486840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.486910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.486972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.487040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.487104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.487149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.487156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.487228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.487294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.487363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.487432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.487479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.487487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.487552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:41.487617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:41.487685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:41.487750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:41.487795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:41.487801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:41.487840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:41.487908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.487932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.487938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:41.487967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:41.487985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:41.487992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:41.487995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:41.487997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:41.488438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:41.488469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:41.488476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:41.488479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:41.488482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:41.488485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:41.489120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:41.489146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:41.489153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:41.489157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:41.489160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:41.489163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:41.489690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:41.489715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:41.489725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:41.489729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:41.489732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:41.491080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:41.491099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:41.491123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392941490
2025-10-02T08:15:41.491252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:41.491267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:41.491272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:41.491282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:41.491287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:41.491291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:41.491823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:41.491848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:41.491854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:41.491863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:41.491867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:41.491872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:41.492400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:41.492426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:41.492437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:41.492441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:41.492447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:41.492450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:41.492995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:41.493020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:41.493025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:41.494129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:41.494148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:41.494153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:41.494157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:41.494165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392941494
2025-10-02T08:15:41.494455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:41.494476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:41.494482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:41.494485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:41.494488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:41.494491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:41.494955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:41.494979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:41.494984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:41.494994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:41.494998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:41.495001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:41.495462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:41.495482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.495580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392941495
2025-10-02T08:15:41.496337Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:41.496356Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:41.496362Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:41.496368Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:41.497981Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:41.497997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:41.497999Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:41.498008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535143807616950:6672]
2025-10-02T08:15:41.498012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535143807616950:6672]
2025-10-02T08:15:41.498068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:41.498078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.498080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:41.498209Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:41.498240Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:41.498256Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:41.536592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535143807616996:14175]
2025-10-02T08:15:41.536737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2452, pipe: [1:7556535143807616996:14175]
2025-10-02T08:15:41.628484Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:41.628849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807616996:14175], now have 1 active actors on pipe
2025-10-02T08:15:41.628984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:41.628995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:41.629019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2453 reason: error at write: Disconnected sessionId: src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0
2025-10-02T08:15:41.629072Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:41.629033Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:41.629198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2453 sessionId: src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0 is DEAD
2025-10-02T08:15:41.629284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:41.629290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0] Write session will restart in 0.008319s
2025-10-02T08:15:41.629313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0] Write session: Do CDS request
2025-10-02T08:15:41.629319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:41.629372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535143807616996:14175]
2025-10-02T08:15:41.638301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.638312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:41.638329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2454
2025-10-02T08:15:41.638524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.638563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:41.638572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:41.638576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:41.639047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2454 sessionId:  describe result for acl check
2025-10-02T08:15:41.639082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:41.639087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:41.639089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:41.639094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535143807617414:6709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:41.639625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535143807617414:6709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:41.642212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535143807617414:6709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:41.646097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535143807617414:6709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:41.646115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535143807617414:6709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:41.646118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535143807617414:6709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:41.646125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:41.648220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:41.649471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:41.649665Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:41.649676Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:41.649685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:41.649736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:41.649775Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535143807617743:6710]
2025-10-02T08:15:41.650420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:41.650635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:41.650711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:41.651044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:41.651095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.651103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.651104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.651106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.651106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.651112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.651122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.651127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.651131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.651135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.651141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.651148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.651158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.651163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.651173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.651185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.651189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.651194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.651199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.651204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.651230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:41.659581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:41.661656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:41.661677Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:41.661679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:41.661683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:41.661690Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2453 [1:7556535143807617743:6710]
2025-10-02T08:15:41.661701Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:41.661718Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:41.661722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.661725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.661727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.661743Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:41.661748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:41.661753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:41.661818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.661826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.661830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:41.661833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:41.661898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:41.661906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.661921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.661938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:41.661956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807617722:6709], now have 1 active actors on pipe
2025-10-02T08:15:41.661967Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535143807617737:6710]
2025-10-02T08:15:41.661969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535143807617737:6710]
2025-10-02T08:15:41.661976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:41.661980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2453
2025-10-02T08:15:41.661989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535144267008617:2378], now have 1 active actors on pipe
2025-10-02T08:15:41.661989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:41.661998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:41.662003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:41.662012Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:41.662015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:41.662021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.662025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.662066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535143807617737:6710]
2025-10-02T08:15:41.662079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:41.662089Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:41.662098Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:41.662108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.662112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.662118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:41.662126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.662134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:41.662176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.662227Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2453
2025-10-02T08:15:41.662301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.662310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.662331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.662368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2454 partition: 0 MaxSeqNo: 17 sessionId: src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0
2025-10-02T08:15:41.662692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ecfeb08-bfb896f8-bc2059d-efba1385_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:41.665372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0] Write session: try to update token
2025-10-02T08:15:41.665389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:41.679939Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:41.679960Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:41.679963Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:41.679971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535143807617737:6710]
2025-10-02T08:15:41.679976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535143807617737:6710]
2025-10-02T08:15:41.680021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:41.680023Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:41.680029Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:41.680032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.680035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:41.680185Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:41.692509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId: src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:41.694979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:41.732244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535143807617772:14175]
2025-10-02T08:15:41.732371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2453, pipe: [1:7556535143807617772:14175]
2025-10-02T08:15:41.824868Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:41.825136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.825150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.825167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807617772:14175], now have 1 active actors on pipe
2025-10-02T08:15:41.825247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:41.825258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:41.825271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535143807617772:14175]
2025-10-02T08:15:41.825324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2454 reason: error at write: Disconnected sessionId: src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0
2025-10-02T08:15:41.825325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:41.825422Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:41.825472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2454 sessionId: src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0 is DEAD
2025-10-02T08:15:41.829022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:41.829034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0] Write session will restart in 0.006258s
2025-10-02T08:15:41.829061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0] Write session: Do CDS request
2025-10-02T08:15:41.829068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:41.836282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.836910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:41.836926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2455
2025-10-02T08:15:41.837033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:41.837077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:41.837082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:41.837085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:41.837453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2455 sessionId:  describe result for acl check
2025-10-02T08:15:41.837482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:41.837487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:41.837489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:41.837494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535143807618271:6733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:41.837970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535143807618271:6733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:41.840376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535143807618271:6733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:41.843357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535143807618271:6733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:41.843368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535143807618271:6733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:41.843370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535143807618271:6733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:41.843376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:41.845691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:41.845999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:41.846155Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:41.846164Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:41.846172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:41.846222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:41.846258Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535143807618523:6726]
2025-10-02T08:15:41.846846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:41.847031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:41.847067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:41.847354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:41.847405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.847406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.847407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.847409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.847409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.847415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.847424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.847428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.847432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.847435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.847440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.847448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:41.847453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.847458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:41.847462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.847467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:41.847471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.847476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.847480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.847485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.847502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:41.855426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:41.857387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:41.857403Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:41.857406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:41.857410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:41.857416Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2454 [1:7556535143807618523:6726]
2025-10-02T08:15:41.857432Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:41.857448Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:41.857457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.857460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.857462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.857477Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:41.857482Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:41.857489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:41.857551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.857553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.857556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:41.857559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:41.857620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:41.857622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.857634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:41.857646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:41.857661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535143807618517:6726]
2025-10-02T08:15:41.857663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535143807618517:6726]
2025-10-02T08:15:41.857677Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:41.857688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:41.857700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:41.857703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:41.857732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535143807618517:6726]
2025-10-02T08:15:41.857734Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:41.857741Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:41.858229Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2454
2025-10-02T08:15:41.857745Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:41.857751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:41.857830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2454
2025-10-02T08:15:41.857841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807618503:6733], now have 1 active actors on pipe
2025-10-02T08:15:41.857844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535144267008636:2378], now have 1 active actors on pipe
2025-10-02T08:15:41.857914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.857929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.857951Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:41.857958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:41.857961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:41.857963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:41.857973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:41.857983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:41.857998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.858086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:41.858089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:41.858102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:41.858131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2455 partition: 0 MaxSeqNo: 17 sessionId: src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0
2025-10-02T08:15:41.858454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cccb24-21996e18-3d7007ed-af5f4e48_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:41.860779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0] Write session: try to update token
2025-10-02T08:15:41.860792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:41.874513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId: src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:41.875890Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:41.875913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:41.875915Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:41.875931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535143807618517:6726]
2025-10-02T08:15:41.875936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535143807618517:6726]
2025-10-02T08:15:41.875982Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:41.875986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:41.875995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:41.875997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:41.875998Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:41.876200Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:41.877626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:41.925214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535143807618561:14175]
2025-10-02T08:15:41.926344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2454, pipe: [1:7556535143807618561:14175]
2025-10-02T08:15:42.014324Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:42.014529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.014542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.014573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535143807618561:14175], now have 1 active actors on pipe
2025-10-02T08:15:42.014668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:42.014676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:42.014722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2455 reason: error at write: Disconnected sessionId: src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0
2025-10-02T08:15:42.014797Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:42.014817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:42.014881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2455 sessionId: src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0 is DEAD
2025-10-02T08:15:42.015017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:42.014992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535143807618561:14175]
2025-10-02T08:15:42.015031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0] Write session will restart in 0.006520s
2025-10-02T08:15:42.015070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0] Write session: Do CDS request
2025-10-02T08:15:42.015076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:42.022257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.022372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:42.022391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2456
2025-10-02T08:15:42.022548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.022582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:42.022593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:42.022596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:42.022993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2456 sessionId:  describe result for acl check
2025-10-02T08:15:42.023027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:42.023029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:42.023030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:42.023038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535148102586186:6777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:42.023535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535148102586186:6777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:42.025737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535148102586186:6777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:42.029076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535148102586186:6777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:42.029094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535148102586186:6777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:42.029097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535148102586186:6777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:42.029104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:42.037522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:42.037929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:42.038089Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:42.038098Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:42.038108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:42.038147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:42.038189Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535148102586608:6756]
2025-10-02T08:15:42.038822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:42.039003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:42.039041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:42.039333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:42.039391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.039397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.039398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.039399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.039400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.039405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.039414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.039418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.039421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.039424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.039430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.039437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.039442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.039447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.039453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.039458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.039463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.039468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.039473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.039483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.039500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:42.048030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:42.049939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:42.049963Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:42.049965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:42.049969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:42.049976Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2455 [1:7556535148102586608:6756]
2025-10-02T08:15:42.049988Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:42.050008Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:42.050011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.050014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.050016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.050032Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:42.050042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:42.050049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:42.050120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.050129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.050133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:42.050136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:42.050202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:42.050211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.050227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.050243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:42.050263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535148102586602:6756]
2025-10-02T08:15:42.050265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535148102586602:6756]
2025-10-02T08:15:42.050277Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:42.050294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:42.050311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:42.050318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:42.050350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535148102586602:6756]
2025-10-02T08:15:42.050356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:42.050375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102586427:6777], now have 1 active actors on pipe
2025-10-02T08:15:42.050399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2455
2025-10-02T08:15:42.050427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:42.050438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:42.050445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:42.050635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535148561975940:2378], now have 1 active actors on pipe
2025-10-02T08:15:42.050652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.050656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.050681Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:42.050692Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.050696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.050697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:42.050707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.050720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:42.050744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.050855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.050862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.050874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.050913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2456 partition: 0 MaxSeqNo: 17 sessionId: src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0
2025-10-02T08:15:42.050501Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2455
2025-10-02T08:15:42.053130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92eaa355-74bc15b5-97c4a9de-c062745b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:42.055827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0] Write session: try to update token
2025-10-02T08:15:42.055843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:42.069746Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:42.069767Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:42.069769Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:42.069776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535148102586602:6756]
2025-10-02T08:15:42.069781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535148102586602:6756]
2025-10-02T08:15:42.069817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:42.069821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.069823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:42.069828Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:42.069834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:42.069953Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:42.073256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId: src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:42.075770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:42.140785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535148102586648:14175]
2025-10-02T08:15:42.143706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2455, pipe: [1:7556535148102586648:14175]
2025-10-02T08:15:42.203797Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:42.204239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.204253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.204293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102586648:14175], now have 1 active actors on pipe
2025-10-02T08:15:42.204469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535148102586648:14175]
2025-10-02T08:15:42.204510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:42.204517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:42.204577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2456 reason: error at write: Disconnected sessionId: src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0
2025-10-02T08:15:42.204743Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:42.204753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2456 sessionId: src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0 is DEAD
2025-10-02T08:15:42.204526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:42.204911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:42.204921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0] Write session will restart in 0.008208s
2025-10-02T08:15:42.204944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0] Write session: Do CDS request
2025-10-02T08:15:42.204950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:42.214303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.214381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:42.214399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2457
2025-10-02T08:15:42.214574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.214607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:42.214615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:42.214619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:42.215038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2457 sessionId:  describe result for acl check
2025-10-02T08:15:42.215095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:42.215102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:42.215104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:42.215109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535148102587094:6809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:42.215623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535148102587094:6809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:42.218457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535148102587094:6809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:42.221467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535148102587094:6809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:42.221478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535148102587094:6809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:42.221480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535148102587094:6809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:42.221486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:42.224594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:42.225704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:42.225869Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:42.225881Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:42.225890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:42.225941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:42.225988Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535148102587424:6807]
2025-10-02T08:15:42.226575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:42.226788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:42.226829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:42.227100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:42.227155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.227162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.227163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.227164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.227165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.227170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.227179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.227182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.227185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.227187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.227193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.227201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.227206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.227210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.227214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.227222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.227230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.227235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.227239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.227248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.227268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:42.235037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:42.237104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:42.237122Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:42.237124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:42.237128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:42.237134Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2456 [1:7556535148102587424:6807]
2025-10-02T08:15:42.237147Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:42.237164Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:42.237177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.237180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.237182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.237199Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:42.237209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:42.237214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:42.237280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.237289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.237292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:42.237295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:42.237362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:42.237369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.237384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.237397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:42.237414Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535148102587418:6807]
2025-10-02T08:15:42.237421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535148102587418:6807]
2025-10-02T08:15:42.237428Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:42.237438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:42.237441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102587369:6809], now have 1 active actors on pipe
2025-10-02T08:15:42.237449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:42.237457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:42.237462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:42.237465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:42.237470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535148561975969:2378], now have 1 active actors on pipe
2025-10-02T08:15:42.237500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.237509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.237522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535148102587418:6807]
2025-10-02T08:15:42.237537Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:42.237549Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:42.237527Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2456
2025-10-02T08:15:42.237567Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:42.237579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.237587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.237590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:42.237600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.237610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2456
2025-10-02T08:15:42.237612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:42.237645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.237737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.237745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.237760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.237799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2457 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0
2025-10-02T08:15:42.238129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5af689f6-c28b58d4-9c16f075-b1a8764d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:42.240791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0] Write session: try to update token
2025-10-02T08:15:42.240832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:42.254950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId: src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:42.255180Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:42.255198Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:42.255200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:42.255210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535148102587418:6807]
2025-10-02T08:15:42.255218Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535148102587418:6807]
2025-10-02T08:15:42.255263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:42.255266Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:42.255271Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:42.255276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.255278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:42.255411Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:42.257562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:42.304607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535148102587449:14175]
2025-10-02T08:15:42.304730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2456, pipe: [1:7556535148102587449:14175]
2025-10-02T08:15:42.392099Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:42.392481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.392492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.392525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102587449:14175], now have 1 active actors on pipe
2025-10-02T08:15:42.392632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535148102587449:14175]
2025-10-02T08:15:42.392650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:42.392651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:42.392691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2457 reason: error at write: Disconnected sessionId: src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0
2025-10-02T08:15:42.392737Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:42.392765Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:42.392863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2457 sessionId: src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0 is DEAD
2025-10-02T08:15:42.392975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:42.392983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0] Write session will restart in 0.009278s
2025-10-02T08:15:42.393008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0] Write session: Do CDS request
2025-10-02T08:15:42.393013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:42.403243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.403325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:42.403341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2458
2025-10-02T08:15:42.403434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.403463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:42.403472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:42.403479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:42.403777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2458 sessionId:  describe result for acl check
2025-10-02T08:15:42.403800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:42.403804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:42.403805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:42.403809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535148102587946:6863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:42.404186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535148102587946:6863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:42.406509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535148102587946:6863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:42.411128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535148102587946:6863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:42.411145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535148102587946:6863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:42.411148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535148102587946:6863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:42.411156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:42.411947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:42.413530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:42.413770Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:42.413785Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:42.413795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:42.413847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:42.413888Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535148102588208:6851]
2025-10-02T08:15:42.414396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:42.414592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:42.414632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:42.414912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:42.414956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.414961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.414961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.414962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.414963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.414966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.414972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.414975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.414979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.414982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.414988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.415008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.415019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.415024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.415033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.415038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.415046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.415049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.415052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.415055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.415066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:42.422977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:42.424672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:42.424686Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:42.424688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:42.424691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:42.424695Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2457 [1:7556535148102588208:6851]
2025-10-02T08:15:42.424703Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:42.424716Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:42.424719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.424721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.424722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.424734Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:42.424737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:42.424741Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:42.424786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.424788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.424790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:42.424791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:42.424871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:42.424879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.424887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.424897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:42.424914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535148102588202:6851]
2025-10-02T08:15:42.424924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535148102588202:6851]
2025-10-02T08:15:42.424931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:42.424941Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:42.424941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2457
2025-10-02T08:15:42.424945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102588190:6863], now have 1 active actors on pipe
2025-10-02T08:15:42.424945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:42.424952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:42.424965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:42.424968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:42.424974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535148561975978:2378], now have 1 active actors on pipe
2025-10-02T08:15:42.424984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.424991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.425024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535148102588202:6851]
2025-10-02T08:15:42.425033Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:42.425041Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:42.425045Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:42.425049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.425051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.425035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2457
2025-10-02T08:15:42.425052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:42.425059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.425065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:42.425086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.425131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.425139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.425151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.425180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2458 partition: 0 MaxSeqNo: 17 sessionId: src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0
2025-10-02T08:15:42.425490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0aff3e-606f374a-a6d59710-b7ed15b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:42.428185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0] Write session: try to update token
2025-10-02T08:15:42.428200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:42.442290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId: src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:42.443080Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:42.443099Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:42.443101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:42.443110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535148102588202:6851]
2025-10-02T08:15:42.443114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535148102588202:6851]
2025-10-02T08:15:42.443149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:42.443154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:42.443160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:42.443161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.443163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:42.443301Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:42.444682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:42.493017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535148102588235:14175]
2025-10-02T08:15:42.493121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2457, pipe: [1:7556535148102588235:14175]
2025-10-02T08:15:42.584301Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:42.584826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.584843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.584884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102588235:14175], now have 1 active actors on pipe
2025-10-02T08:15:42.585053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:42.585065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:42.585104Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:42.585136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2458 reason: error at write: Disconnected sessionId: src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0
2025-10-02T08:15:42.585293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2458 sessionId: src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0 is DEAD
2025-10-02T08:15:42.585418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535148102588235:14175]
2025-10-02T08:15:42.585455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:42.585511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0] Write session will restart in 0.008952s
2025-10-02T08:15:42.585536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0] Write session: Do CDS request
2025-10-02T08:15:42.585549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:42.585781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:42.595649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.595674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:42.595688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2459
2025-10-02T08:15:42.595868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.595910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:42.595916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:42.595918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:42.596309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2459 sessionId:  describe result for acl check
2025-10-02T08:15:42.596337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:42.596342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:42.596343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:42.596348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535148102588580:6882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:42.596864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535148102588580:6882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:42.601165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535148102588580:6882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:42.605955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535148102588580:6882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:42.605971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535148102588580:6882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:42.605974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535148102588580:6882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:42.605983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:42.615779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:42.617552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:42.617781Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:42.617793Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:42.617817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:42.617884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:42.617926Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535148102588995:6881]
2025-10-02T08:15:42.618520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:42.618732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:42.618774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:42.619075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:42.619131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.619138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.619139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.619140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.619141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.619146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.619156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.619160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.619163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.619166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.619172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.619179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.619184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.619194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.619199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.619203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.619207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.619212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.619216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.619220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.619241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:42.629984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:42.631655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:42.631675Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:42.631678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:42.631681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:42.631688Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2458 [1:7556535148102588995:6881]
2025-10-02T08:15:42.631700Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:42.631717Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:42.631726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.631729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.631731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.631746Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:42.631751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:42.631758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:42.631835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.631844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.631846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:42.631849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:42.632109Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2458
2025-10-02T08:15:42.631923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:42.631933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.631947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.631958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:42.631976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102588849:6882], now have 1 active actors on pipe
2025-10-02T08:15:42.631983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535148102588989:6881]
2025-10-02T08:15:42.631985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535148102588989:6881]
2025-10-02T08:15:42.631995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:42.632008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535148561975984:2378], now have 1 active actors on pipe
2025-10-02T08:15:42.632008Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:42.632012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:42.632013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:42.632026Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:42.632028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:42.632061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535148102588989:6881]
2025-10-02T08:15:42.632070Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:42.632110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:42.632114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2458
2025-10-02T08:15:42.632134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.632138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.632162Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:42.632169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.632173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.632174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:42.632184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.632194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:42.632211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.632334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.632337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.632351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.632394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2459 partition: 0 MaxSeqNo: 17 sessionId: src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0
2025-10-02T08:15:42.632735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310745bc-9d2d2b59-b070e74d-9957e4c1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:42.635375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0] Write session: try to update token
2025-10-02T08:15:42.635393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:42.650701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId: src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:42.653448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:42.653558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.653579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.653620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:42.653647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:42.653723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.653726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.653884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.653960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.654026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.654097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.654146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.654160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.654235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.654303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.654371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.654449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.654501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.654510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.654584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.654647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.654768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.654837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.654883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.654891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.654963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.655030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.655096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.655167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.655218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.655225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.655294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.655362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.655430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.655496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.655543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.655550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.655624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.655689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.655759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.655827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.655874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.655882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.655951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.656015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.656084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.656164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.656209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.656216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.656280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.656345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.656412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.656482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.656586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.656593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.656659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.656721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.656792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.656884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.656923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.656932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.657001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:42.657097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:42.657180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:42.657246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:42.657292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:42.657300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:42.657338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:42.657404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.657431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.657437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:42.657467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:42.657483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:42.657490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:42.657493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:42.657500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:42.657922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:42.657951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:42.657958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:42.657962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:42.657965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:42.657970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:42.658455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:42.658478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:42.658484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:42.658488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:42.658497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:42.658501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:42.659207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:42.659230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:42.659236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:42.659239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:42.659245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:42.660510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:42.660530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:42.660542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392942660
2025-10-02T08:15:42.660780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:42.660816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:42.660827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:42.660830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:42.660836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:42.660843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:42.661340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:42.661360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:42.661365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:42.661369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:42.661372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:42.661375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:42.661926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:42.661949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:42.661956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:42.661964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:42.661968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:42.661971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:42.662495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:42.662519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:42.662527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:42.663984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:42.664007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:42.664012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:42.664015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:42.664023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392942663
2025-10-02T08:15:42.664362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:42.664387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:42.664394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:42.664398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:42.664402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:42.664405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:42.664908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:42.664930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:42.664936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:42.664940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:42.664942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:42.664946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:42.665393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:42.665414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.665506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392942665
2025-10-02T08:15:42.670037Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:42.670062Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:42.670071Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:42.670078Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:42.671763Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:42.671778Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:42.671780Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:42.671788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535148102588989:6881]
2025-10-02T08:15:42.671792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535148102588989:6881]
2025-10-02T08:15:42.671830Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:42.671842Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:42.678332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:42.678356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.678358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:42.678513Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:42.685148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535148102589027:14175]
2025-10-02T08:15:42.685230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2458, pipe: [1:7556535148102589027:14175]
2025-10-02T08:15:42.823362Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:42.823794Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:42.823798Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:42.823807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535148102588989:6881]
2025-10-02T08:15:42.823855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102589027:14175], now have 1 active actors on pipe
2025-10-02T08:15:42.824549Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:42.824692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:42.824695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:42.824735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2459 reason: error at write: Disconnected sessionId: src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0
2025-10-02T08:15:42.824768Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:42.825025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:42.825037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0] Write session will restart in 0.009143s
2025-10-02T08:15:42.825059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0] Write session: Do CDS request
2025-10-02T08:15:42.825065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:42.824919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2459 sessionId: src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0 is DEAD
2025-10-02T08:15:42.825103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535148102589027:14175]
2025-10-02T08:15:42.825361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:42.835262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.835338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:42.835354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2460
2025-10-02T08:15:42.835457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:42.835485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:42.835495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:42.835513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:42.836061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2460 sessionId:  describe result for acl check
2025-10-02T08:15:42.836098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:42.836103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:42.836105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:42.836111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535148102589439:6889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:42.836605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535148102589439:6889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:42.839271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535148102589439:6889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:42.842035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535148102589439:6889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:42.842048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535148102589439:6889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:42.842051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535148102589439:6889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:42.842058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:42.849188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:42.850561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:42.850729Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:42.850736Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:42.850743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:42.850778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:42.850825Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535148102589792:6885]
2025-10-02T08:15:42.851238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:42.851396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:42.851427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:42.851644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:42.851675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.851680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.851681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.851681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.851682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.851685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.851691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.851693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.851695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.851697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.851700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.851705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:42.851708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.851710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:42.851712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.851716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:42.851718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.851720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.851723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.851725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.851739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:42.859844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:42.862004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:42.862032Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:42.862036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:42.862040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:42.862047Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2459 [1:7556535148102589792:6885]
2025-10-02T08:15:42.862061Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:42.862081Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:42.862092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.862096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.862105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.862123Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:42.862128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:42.862134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:42.862221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.862231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.862234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:42.862237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:42.862319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:42.862334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.862347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:42.862358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:42.862380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102589628:6889], now have 1 active actors on pipe
2025-10-02T08:15:42.862388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535148102589786:6885]
2025-10-02T08:15:42.862391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2459
2025-10-02T08:15:42.862397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535148102589786:6885]
2025-10-02T08:15:42.862415Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:42.862430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535148561975994:2378], now have 1 active actors on pipe
2025-10-02T08:15:42.862446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:42.862446Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:42.862450Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:42.862459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:42.862462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:42.862469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.862473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.862519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535148102589786:6885]
2025-10-02T08:15:42.862499Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2459
2025-10-02T08:15:42.862532Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:42.862534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:42.862549Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:42.862556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:42.862561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:42.862563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:42.862573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:42.862585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:42.862634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.862707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:42.862716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:42.862732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:42.862776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2460 partition: 0 MaxSeqNo: 17 sessionId: src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0
2025-10-02T08:15:42.863139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ee9cad-bf00650f-c6043ec9-533310e5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:42.865809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0] Write session: try to update token
2025-10-02T08:15:42.865829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:42.880592Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:42.880615Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:42.880618Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:42.880626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535148102589786:6885]
2025-10-02T08:15:42.880630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535148102589786:6885]
2025-10-02T08:15:42.880671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:42.880683Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:42.880685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:42.880687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:42.880688Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:42.880839Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:42.884986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId: src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:42.887355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:42.925144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535148102589830:14175]
2025-10-02T08:15:42.925280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2459, pipe: [1:7556535148102589830:14175]
2025-10-02T08:15:43.013051Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:43.013365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.013382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.013424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535148102589830:14175], now have 1 active actors on pipe
2025-10-02T08:15:43.013563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535148102589830:14175]
2025-10-02T08:15:43.013594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:43.013597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:43.013658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2460 reason: error at write: Disconnected sessionId: src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0
2025-10-02T08:15:43.013672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:43.013820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2460 sessionId: src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0 is DEAD
2025-10-02T08:15:43.013985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:43.013995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0] Write session will restart in 0.009341s
2025-10-02T08:15:43.014019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0] Write session: Do CDS request
2025-10-02T08:15:43.014028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:43.014807Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:43.024384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.024456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:43.024475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2461
2025-10-02T08:15:43.024592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.024627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:43.024632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:43.024636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:43.025052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2461 sessionId:  describe result for acl check
2025-10-02T08:15:43.025084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:43.025091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:43.025093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:43.025097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535152397557554:6909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:43.025615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535152397557554:6909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:43.028443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535152397557554:6909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:43.030874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535152397557554:6909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:43.030890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535152397557554:6909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:43.030894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535152397557554:6909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:43.030901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:43.035109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:43.036377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:43.036567Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:43.036578Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:43.036587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:43.036630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:43.036666Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535152397557889:6911]
2025-10-02T08:15:43.037274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:43.037461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:43.037496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:43.037771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:43.037811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.037816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.037817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.037818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.037818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.037823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.037832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.037836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.037839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.037842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.037847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.037857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.037862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.037870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.037874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.037879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.037883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.037887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.037896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.037901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.037922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:43.045901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:43.047443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:43.047460Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:43.047462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:43.047466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:43.047472Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2460 [1:7556535152397557889:6911]
2025-10-02T08:15:43.047483Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:43.047498Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:43.047501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.047504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.047506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.047522Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:43.047526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:43.047532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:43.047594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.047601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.047604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:43.047607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:43.047671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:43.047678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.047691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.047707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:43.047726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535152397557883:6911]
2025-10-02T08:15:43.047732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535152397557883:6911]
2025-10-02T08:15:43.047738Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:43.047752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397557812:6909], now have 1 active actors on pipe
2025-10-02T08:15:43.047764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:43.047768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2460
2025-10-02T08:15:43.047779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:43.047786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:43.047791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535152856943308:2378], now have 1 active actors on pipe
2025-10-02T08:15:43.047818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535152397557883:6911]
2025-10-02T08:15:43.047826Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:43.047859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.047865Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:43.047867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:43.047868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.047873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:43.047889Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:43.047899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.047901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.047903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:43.047912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.047923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:43.047940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.047972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.047978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.047991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.048026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2461 partition: 0 MaxSeqNo: 17 sessionId: src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0
2025-10-02T08:15:43.048377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f376b1e6-3de36c1b-44a4fc4f-452d5436_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:43.048916Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2460
2025-10-02T08:15:43.050988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0] Write session: try to update token
2025-10-02T08:15:43.051005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:43.058486Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:43.058508Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:43.058516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535152397557883:6911]
2025-10-02T08:15:43.058566Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:43.058565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:43.058726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:43.058862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:43.058991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:43.059121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:43.059310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:43.059346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:43.065326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId: src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:43.067830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:43.067912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.067923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.067953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:43.067976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:43.068038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.068055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.068246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.068320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.068388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.068475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.068865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.068877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.068952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.069023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.069093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.069168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.069215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.069223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.069291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.069359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.069423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.069489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.069536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.069546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.069615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.069684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.069757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.069822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.069871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.069878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.069945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.070008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.070068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.070127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.070168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.070174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.070236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.070296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.070359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.070421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.070463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.070465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.070535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.070594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.070656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.070715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.070762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.070767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.070828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.070893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.070958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.071018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.071060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.071065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.071125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.071182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.071242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.071306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.071347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.071352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.071411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.071469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.071530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.071595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.071643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.071648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.071678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:43.071729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.071746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.071752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:43.071784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:43.071797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:43.071802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:43.071804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:43.071805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:43.072205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:43.072232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:43.072243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:43.072251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:43.072253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:43.072256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:43.072897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:43.072922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:43.072928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:43.072931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:43.072934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:43.072938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:43.073397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:43.073418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:43.073422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:43.073425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:43.073428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:43.075308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:43.075326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:43.075337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392943075
2025-10-02T08:15:43.075489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:43.075500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:43.075504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:43.075506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:43.075509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:43.075511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:43.075944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:43.075963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:43.075967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:43.075970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:43.075974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:43.075977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:43.076432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:43.076452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:43.076459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:43.076461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:43.076464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:43.076465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:43.076918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:43.076936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:43.076940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:43.077985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:43.078004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:43.078008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:43.078011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:43.078018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392943077
2025-10-02T08:15:43.078289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:43.078306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:43.078309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:43.078312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:43.078314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:43.078317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:43.078736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:43.078762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:43.078768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:43.078771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:43.078774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:43.078778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:43.079215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:43.079233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.079330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392943079
2025-10-02T08:15:43.082798Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:43.082827Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:43.082831Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:43.082835Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:43.084420Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:43.084433Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:43.084434Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:43.084446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535152397557883:6911]
2025-10-02T08:15:43.084448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535152397557883:6911]
2025-10-02T08:15:43.084498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:43.084504Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:43.084507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.084508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:43.084510Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:43.084646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:43.113604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535152397557923:14175]
2025-10-02T08:15:43.113749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2460, pipe: [1:7556535152397557923:14175]
2025-10-02T08:15:43.220438Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:43.220858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397557923:14175], now have 1 active actors on pipe
2025-10-02T08:15:43.220999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535152397557923:14175]
2025-10-02T08:15:43.221022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:43.221024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:43.221046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2461 reason: error at write: Disconnected sessionId: src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0
2025-10-02T08:15:43.221113Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:43.221160Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:43.221210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2461 sessionId: src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0 is DEAD
2025-10-02T08:15:43.221338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:43.221348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0] Write session will restart in 0.009699s
2025-10-02T08:15:43.221383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0] Write session: Do CDS request
2025-10-02T08:15:43.221390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:43.232229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.232299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:43.232325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2462
2025-10-02T08:15:43.232467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.232500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:43.232509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:43.232513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:43.232997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2462 sessionId:  describe result for acl check
2025-10-02T08:15:43.233062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:43.233077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:43.233078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:43.233086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535152397558414:6958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:43.233656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535152397558414:6958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:43.235997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535152397558414:6958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:43.238800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535152397558414:6958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:43.238814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535152397558414:6958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:43.238816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535152397558414:6958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:43.238822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:43.242107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:43.243402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:43.243594Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:43.243613Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:43.243628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:43.243682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:43.243719Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535152397558721:6949]
2025-10-02T08:15:43.244337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:43.244500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:43.244537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:43.244837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:43.244881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.244887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.244888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.244889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.244890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.244896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.244906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.244910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.244914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.244918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.244923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.244931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.244937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.244942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.244946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.244951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.244955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.244960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.244964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.244970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.244991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:43.252774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:43.254506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:43.254525Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:43.254527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:43.254532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:43.254537Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2461 [1:7556535152397558721:6949]
2025-10-02T08:15:43.254547Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:43.254564Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:43.254572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.254575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.254577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.254591Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:43.254600Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:43.254607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:43.254664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.254672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.254675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:43.254677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:43.254750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:43.254757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.254768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.254783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:43.254784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2461
2025-10-02T08:15:43.254801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397558665:6958], now have 1 active actors on pipe
2025-10-02T08:15:43.254804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535152856943346:2378], now have 1 active actors on pipe
2025-10-02T08:15:43.254808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.254816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.254832Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535152397558715:6949]
2025-10-02T08:15:43.254839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535152397558715:6949]
2025-10-02T08:15:43.254852Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:43.254866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:43.254869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:43.254874Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:43.254883Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:43.254885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:43.254874Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2461
2025-10-02T08:15:43.254899Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:43.254909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.254913Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.254915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:43.254924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.254932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:43.254969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535152397558715:6949]
2025-10-02T08:15:43.254982Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:43.254988Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:43.255003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.255062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.255068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.255081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.255138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2462 partition: 0 MaxSeqNo: 17 sessionId: src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0
2025-10-02T08:15:43.255420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dab50e7-b8ff5c74-2bfc89d1-37a22f7b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:43.257930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0] Write session: try to update token
2025-10-02T08:15:43.257946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:43.267202Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:43.267225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:43.267234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535152397558715:6949]
2025-10-02T08:15:43.267278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:43.267278Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:43.267452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:43.267605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:43.267750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:43.267885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:43.268085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:43.268149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:43.272734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId: src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:43.275314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:43.275376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.275388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.275418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:43.275450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:43.275513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.275521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.275671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.275731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.275798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.275864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.275909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.275918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.275982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.276044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.276109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.276185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.276230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.276237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.276305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.276368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.276432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.276495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.276536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.276544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.276611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.276677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.276740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.276825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.276869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.276877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.276941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.277005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.277075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.277146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.277192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.277200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.277274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.277341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.277408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.277476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.277520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.277527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.277595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.277659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.277724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.277793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.277839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.277846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.277909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.277972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.278038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.278105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.278157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.278164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.278232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.278297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.278360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.278425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.278470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.278476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.278544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:43.278609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:43.278675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:43.278748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:43.278792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:43.278804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:43.278840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:43.278898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.278919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.278925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:43.278953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:43.278973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:43.278976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:43.278981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:43.278983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:43.279380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:43.279407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:43.279419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:43.279426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:43.279429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:43.279432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:43.280192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:43.280215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:43.280222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:43.280229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:43.280233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:43.280235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:43.280711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:43.280735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:43.280741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:43.280744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:43.280746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:43.282118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:43.282137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:43.282148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392943281
2025-10-02T08:15:43.282427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:43.282445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:43.282451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:43.282453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:43.282459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:43.282462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:43.283022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:43.283046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:43.283056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:43.283064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:43.283071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:43.283074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:43.283538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:43.283564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:43.283576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:43.283584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:43.283587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:43.283594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:43.284149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:43.284178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:43.284188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:43.285337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:43.285359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:43.285365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:43.285369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:43.285377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392943284
2025-10-02T08:15:43.285699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:43.285728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:43.285735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:43.285738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:43.285741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:43.285744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:43.286216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:43.286246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:43.286256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:43.286264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:43.286267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:43.286270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:43.286731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:43.286757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.286847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392943286
2025-10-02T08:15:43.287606Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:43.287625Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:43.287631Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:43.287636Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:43.289305Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:43.289318Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:43.289320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:43.289327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535152397558715:6949]
2025-10-02T08:15:43.289330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535152397558715:6949]
2025-10-02T08:15:43.289375Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:43.289388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:43.289390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:43.289397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.289399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:43.289530Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:43.321410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535152397558752:14175]
2025-10-02T08:15:43.321569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2461, pipe: [1:7556535152397558752:14175]
2025-10-02T08:15:43.432742Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:43.433205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397558752:14175], now have 1 active actors on pipe
2025-10-02T08:15:43.433436Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:43.433674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:43.433715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2462 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0
2025-10-02T08:15:43.433809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535152397558752:14175]
2025-10-02T08:15:43.433878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2462 sessionId: src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0 is DEAD
2025-10-02T08:15:43.434018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:43.434030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0] Write session will restart in 0.008209s
2025-10-02T08:15:43.434053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0] Write session: Do CDS request
2025-10-02T08:15:43.434060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:43.436681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:43.443414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.443747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:43.443765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2463
2025-10-02T08:15:43.443859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.443881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:43.443886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:43.443888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:43.444348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2463 sessionId:  describe result for acl check
2025-10-02T08:15:43.444388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:43.444390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:43.444391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:43.444396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535152397559152:7030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:43.444909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535152397559152:7030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:43.448066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535152397559152:7030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:43.455345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:43.455544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535152397559152:7030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:43.455561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535152397559152:7030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:43.455564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535152397559152:7030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:43.455572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:43.455988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:43.456215Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:43.456227Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:43.456239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:43.456295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:43.456334Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535152397559517:7011]
2025-10-02T08:15:43.456947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:43.457168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:43.457211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:43.457591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:43.457651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.457658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.457659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.457660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.457661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.457666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.457676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.457679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.457683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.457686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.457692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.457699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.457710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.457715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.457720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.457730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.457734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.457741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.457749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.457754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.457776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:43.465787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:43.468067Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2462
2025-10-02T08:15:43.467672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:43.467692Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:43.467695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:43.467698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:43.467703Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2462 [1:7556535152397559517:7011]
2025-10-02T08:15:43.467715Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:43.467731Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:43.467734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.467737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.467739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.467753Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:43.467758Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:43.467764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:43.467824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.467826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.467829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:43.467831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:43.467898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:43.467901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.467914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.467926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:43.467943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397559513:7030], now have 1 active actors on pipe
2025-10-02T08:15:43.467949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535152397559505:7011]
2025-10-02T08:15:43.467952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535152397559505:7011]
2025-10-02T08:15:43.467960Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:43.467970Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:43.467973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:43.467975Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:43.467988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:43.467990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:43.467996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535152856943353:2378], now have 1 active actors on pipe
2025-10-02T08:15:43.468024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535152397559505:7011]
2025-10-02T08:15:43.468027Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:43.468036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2462
2025-10-02T08:15:43.468070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:43.468072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.468076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.468099Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99af37f1-8098af64-9747ac73-f6e5c984_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:43.468105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.468108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.468110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:43.468133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.468142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:43.468154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.468208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.468211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.468223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.468252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2463 partition: 0 MaxSeqNo: 17 sessionId: src_id|99af37f1-8098af64-9747ac73-f6e5c984_0
2025-10-02T08:15:43.468631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcfcb-61607ccb-c5b58adc-626a1b62_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|99af37f1-8098af64-9747ac73-f6e5c984_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:43.471104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99af37f1-8098af64-9747ac73-f6e5c984_0] Write session: try to update token
2025-10-02T08:15:43.471117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99af37f1-8098af64-9747ac73-f6e5c984_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:43.484247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId: src_id|99af37f1-8098af64-9747ac73-f6e5c984_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:43.484860Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:43.484872Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:43.484874Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:43.484882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535152397559505:7011]
2025-10-02T08:15:43.484886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535152397559505:7011]
2025-10-02T08:15:43.484919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:43.484928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.484929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:43.484930Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:43.484935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:43.485048Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:43.486697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:43.533869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535152397559543:14175]
2025-10-02T08:15:43.533960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2462, pipe: [1:7556535152397559543:14175]
2025-10-02T08:15:43.618506Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:43.618786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.618803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.618846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397559543:14175], now have 1 active actors on pipe
2025-10-02T08:15:43.619203Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:43.619679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:43.619733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2463 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99af37f1-8098af64-9747ac73-f6e5c984_0
2025-10-02T08:15:43.619895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2463 sessionId: src_id|99af37f1-8098af64-9747ac73-f6e5c984_0 is DEAD
2025-10-02T08:15:43.620023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535152397559543:14175]
2025-10-02T08:15:43.621158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af37f1-8098af64-9747ac73-f6e5c984_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:43.621168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af37f1-8098af64-9747ac73-f6e5c984_0] Write session will restart in 0.005943s
2025-10-02T08:15:43.621191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af37f1-8098af64-9747ac73-f6e5c984_0] Write session: Do CDS request
2025-10-02T08:15:43.621200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af37f1-8098af64-9747ac73-f6e5c984_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:43.619205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:43.628247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99af37f1-8098af64-9747ac73-f6e5c984_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.628993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:43.629010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2464
2025-10-02T08:15:43.630376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.630414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:43.630419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:43.630422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:43.630811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2464 sessionId:  describe result for acl check
2025-10-02T08:15:43.630844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:43.630845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:43.630846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:43.630860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535152397559975:7046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:43.631298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535152397559975:7046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:43.633458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535152397559975:7046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:43.637080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535152397559975:7046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:43.637097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535152397559975:7046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:43.637099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535152397559975:7046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:43.637108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:43.644663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:43.646140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:43.646316Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:43.646327Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:43.646336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:43.646379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:43.646417Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535152397560310:7041]
2025-10-02T08:15:43.647040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:43.647230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:43.647268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:43.647560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:43.647600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.647606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.647607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.647608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.647609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.647614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.647624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.647628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.647631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.647635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.647640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.647648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.647653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.647658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.647663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.647669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.647673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.647678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.647682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.647687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.647706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:43.656001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:43.657509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:43.657534Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:43.657536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:43.657540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:43.657547Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2463 [1:7556535152397560310:7041]
2025-10-02T08:15:43.657571Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:43.657593Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:43.657601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.657604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.657607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.657622Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:43.657627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:43.657638Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:43.657699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.657706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.657709Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:43.657711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:43.657776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:43.657784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.657796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.657806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:43.657822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535152397560304:7041]
2025-10-02T08:15:43.657824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535152397560304:7041]
2025-10-02T08:15:43.657831Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:43.657844Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:43.657858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:43.657860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:43.657869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397560102:7046], now have 1 active actors on pipe
2025-10-02T08:15:43.657876Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:43.657879Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:43.657900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535152397560304:7041]
2025-10-02T08:15:43.657906Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:43.657911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535152856943358:2378], now have 1 active actors on pipe
2025-10-02T08:15:43.657952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2463
2025-10-02T08:15:43.658035Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:43.658080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.658085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.658107Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:43.658113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.658117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.658119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:43.658128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.658136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:43.658149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.658226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.658228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.658241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.658277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2464 partition: 0 MaxSeqNo: 17 sessionId: src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0
2025-10-02T08:15:43.658643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99af37f1-8098af64-9747ac73-f6e5c984_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:43.658135Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2463
2025-10-02T08:15:43.661298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0] Write session: try to update token
2025-10-02T08:15:43.661315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:43.675954Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:43.675953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId: src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:43.675974Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:43.675976Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:43.675984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535152397560304:7041]
2025-10-02T08:15:43.675988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535152397560304:7041]
2025-10-02T08:15:43.676028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:43.676040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.676039Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:43.676045Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:43.676045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:43.676189Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:43.678342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:43.720286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535152397560337:14175]
2025-10-02T08:15:43.720377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2463, pipe: [1:7556535152397560337:14175]
2025-10-02T08:15:43.820513Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:43.821328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.821343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.821380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397560337:14175], now have 1 active actors on pipe
2025-10-02T08:15:43.821490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:43.821504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:43.821561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2464 reason: error at write: Disconnected sessionId: src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0
2025-10-02T08:15:43.821569Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:43.821628Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:43.821718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2464 sessionId: src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0 is DEAD
2025-10-02T08:15:43.821825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:43.821836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0] Write session will restart in 0.008351s
2025-10-02T08:15:43.821857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0] Write session: Do CDS request
2025-10-02T08:15:43.821864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:43.821874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535152397560337:14175]
2025-10-02T08:15:43.831245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.831266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:43.831282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2465
2025-10-02T08:15:43.831427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:43.831454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:43.831462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:43.831466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:43.831822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2465 sessionId:  describe result for acl check
2025-10-02T08:15:43.831849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:43.831855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:43.831857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:43.831862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535152397560767:7061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:43.832301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535152397560767:7061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:43.834924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535152397560767:7061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:43.838248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535152397560767:7061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:43.838262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535152397560767:7061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:43.838265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535152397560767:7061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:43.838273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:43.841807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:43.843309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:43.843546Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:43.843555Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:43.843563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:43.843606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:43.843640Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535152397561108:7105]
2025-10-02T08:15:43.844098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:43.844271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:43.844301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:43.844558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:43.844597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.844603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.844605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.844606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.844607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.844611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.844621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.844625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.844628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.844632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.844637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.844643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:43.844648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.844653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:43.844656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.844662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:43.844665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.844670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.844674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.844679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.844696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:43.852298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:43.853775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:43.853795Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:43.853798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:43.853802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:43.853808Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2464 [1:7556535152397561108:7105]
2025-10-02T08:15:43.853819Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:43.853836Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:43.853838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.853841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.853844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.853859Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:43.853864Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:43.853869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:43.853931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.853943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.853946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:43.853950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:43.854010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:43.854017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.854030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:43.854047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:43.854060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2464
2025-10-02T08:15:43.854063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397561025:7061], now have 1 active actors on pipe
2025-10-02T08:15:43.854070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535152397561102:7105]
2025-10-02T08:15:43.854072Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535152397561102:7105]
2025-10-02T08:15:43.854079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:43.854091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535152856943366:2378], now have 1 active actors on pipe
2025-10-02T08:15:43.854101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:43.854102Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:43.854106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:43.854115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:43.854122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:43.854127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.854131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.854168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535152397561102:7105]
2025-10-02T08:15:43.854180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:43.854186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:43.854193Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:43.854203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:43.854177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2464
2025-10-02T08:15:43.854208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:43.854214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:43.854222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:43.854230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:43.854268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.854343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:43.854350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:43.854364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:43.854400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2465 partition: 0 MaxSeqNo: 17 sessionId: src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0
2025-10-02T08:15:43.854729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b3de7b-cbf8bae6-a74a51b2-97e0b16a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:43.857217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0] Write session: try to update token
2025-10-02T08:15:43.857234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:43.870313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId: src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:43.871490Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:43.871507Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:43.871510Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:43.871517Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535152397561102:7105]
2025-10-02T08:15:43.871521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535152397561102:7105]
2025-10-02T08:15:43.871564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:43.871575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:43.871574Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:43.871577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:43.871580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:43.871707Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:43.872855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:43.922003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535152397561146:14175]
2025-10-02T08:15:43.922144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2464, pipe: [1:7556535152397561146:14175]
2025-10-02T08:15:44.009042Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:44.009470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.009480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.009513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535152397561146:14175], now have 1 active actors on pipe
2025-10-02T08:15:44.009658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535152397561146:14175]
2025-10-02T08:15:44.009690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:44.009697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:44.009714Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:44.009765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2465 reason: error at write: Disconnected sessionId: src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0
2025-10-02T08:15:44.009791Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:44.009940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2465 sessionId: src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0 is DEAD
2025-10-02T08:15:44.010150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:44.010160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0] Write session will restart in 0.007626s
2025-10-02T08:15:44.010187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0] Write session: Do CDS request
2025-10-02T08:15:44.010194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:44.019269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.019354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:44.019372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2466
2025-10-02T08:15:44.019496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.019525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:44.019536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:44.019539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:44.020006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2466 sessionId:  describe result for acl check
2025-10-02T08:15:44.020041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:44.020047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:44.020049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:44.020054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535156692528832:7091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:44.020558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535156692528832:7091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:44.023480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535156692528832:7091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:44.026209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535156692528832:7091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:44.026226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535156692528832:7091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:44.026229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535156692528832:7091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:44.026236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:44.031489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:44.031883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:44.032143Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:44.032151Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:44.032160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:44.032206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:44.032238Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535156692529212:7067]
2025-10-02T08:15:44.032671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:44.032824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:44.032853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:44.033039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:44.033081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.033086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.033086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.033087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.033087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.033091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.033097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.033099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.033101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.033103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.033106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.033110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.033115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.033117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.033120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.033123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.033126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.033128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.033132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.033135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.033145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:44.040702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:44.042597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:44.042612Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:44.042615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:44.042618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:44.042625Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2465 [1:7556535156692529212:7067]
2025-10-02T08:15:44.042638Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:44.042658Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:44.042666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.042669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.042672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.042688Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:44.042697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:44.042708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:44.042780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.042787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.042791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:44.042794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:44.042864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:44.042871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.042886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.042902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:44.042926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2465
2025-10-02T08:15:44.042928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692529110:7091], now have 1 active actors on pipe
2025-10-02T08:15:44.042932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535157151910681:2378], now have 1 active actors on pipe
2025-10-02T08:15:44.042938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535156692529206:7067]
2025-10-02T08:15:44.042940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535156692529206:7067]
2025-10-02T08:15:44.042954Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:44.042965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.042969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.042972Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:44.042976Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:44.042989Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:44.043003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:44.043011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:44.042999Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2465
2025-10-02T08:15:44.043063Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ccdaae-5f531466-288154b9-e825bbb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:44.043075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.043079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.043081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:44.043091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.043099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:44.043115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535156692529206:7067]
2025-10-02T08:15:44.043127Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:44.043144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:44.043162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.043206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.043213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.043227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.043264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2466 partition: 0 MaxSeqNo: 17 sessionId: src_id|7ccdaae-5f531466-288154b9-e825bbb6_0
2025-10-02T08:15:44.043561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|460c0860-ad01c6fb-ee40eeb4-2c361910_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7ccdaae-5f531466-288154b9-e825bbb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:44.046549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccdaae-5f531466-288154b9-e825bbb6_0] Write session: try to update token
2025-10-02T08:15:44.046561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccdaae-5f531466-288154b9-e825bbb6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:44.059977Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:44.059999Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:44.060002Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:44.060022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535156692529206:7067]
2025-10-02T08:15:44.060023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId: src_id|7ccdaae-5f531466-288154b9-e825bbb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:44.060027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535156692529206:7067]
2025-10-02T08:15:44.060069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:44.060070Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:44.060076Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:44.060081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.060083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:44.060285Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:44.062626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:44.109916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535156692529239:14175]
2025-10-02T08:15:44.110052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2465, pipe: [1:7556535156692529239:14175]
2025-10-02T08:15:44.190994Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:44.191406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.191417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.191448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692529239:14175], now have 1 active actors on pipe
2025-10-02T08:15:44.191556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535156692529239:14175]
2025-10-02T08:15:44.191581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:44.191586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:44.191605Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:44.191628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2466 reason: error at write: Disconnected sessionId: src_id|7ccdaae-5f531466-288154b9-e825bbb6_0
2025-10-02T08:15:44.191665Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:44.191759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2466 sessionId: src_id|7ccdaae-5f531466-288154b9-e825bbb6_0 is DEAD
2025-10-02T08:15:44.191898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccdaae-5f531466-288154b9-e825bbb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:44.191907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccdaae-5f531466-288154b9-e825bbb6_0] Write session will restart in 0.009336s
2025-10-02T08:15:44.191926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccdaae-5f531466-288154b9-e825bbb6_0] Write session: Do CDS request
2025-10-02T08:15:44.191931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccdaae-5f531466-288154b9-e825bbb6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:44.202280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccdaae-5f531466-288154b9-e825bbb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.202485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:44.202502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2467
2025-10-02T08:15:44.202616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.202643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:44.202652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:44.202655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:44.203049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2467 sessionId:  describe result for acl check
2025-10-02T08:15:44.203079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:44.203084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:44.203088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:44.203092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535156692529693:7162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:44.203608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535156692529693:7162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:44.205976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535156692529693:7162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:44.209201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535156692529693:7162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:44.209222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535156692529693:7162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:44.209225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535156692529693:7162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:44.209233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:44.214134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:44.215646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:44.215920Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:44.215928Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:44.215936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:44.215978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:44.216020Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535156692530024:7152]
2025-10-02T08:15:44.216515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:44.216675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:44.216703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:44.216960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:44.216997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.217001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.217002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.217002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.217003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.217006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.217012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.217015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.217017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.217018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.217022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.217026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.217031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.217034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.217036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.217038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.217041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.217043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.217046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.217048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.217063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:44.224948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:44.226592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:44.226610Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:44.226613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:44.226617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:44.226623Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2466 [1:7556535156692530024:7152]
2025-10-02T08:15:44.226633Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:44.226648Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:44.226651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.226657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.226659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.226673Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:44.226679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:44.226684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:44.226740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.226748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.226751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:44.226753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:44.226831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:44.226838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.226847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2466
2025-10-02T08:15:44.226851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.226863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:44.226886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692529911:7162], now have 1 active actors on pipe
2025-10-02T08:15:44.226894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535157151910693:2378], now have 1 active actors on pipe
2025-10-02T08:15:44.226899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.226903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.226918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535156692530018:7152]
2025-10-02T08:15:44.226925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535156692530018:7152]
2025-10-02T08:15:44.226931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:44.226946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:44.226925Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2466
2025-10-02T08:15:44.226960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:44.226963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:44.226966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:44.226970Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:44.226979Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:44.226985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.226993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.226995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:44.227003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.227015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:44.227050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535156692530018:7152]
2025-10-02T08:15:44.227062Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:44.227069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:44.227082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.227154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.227166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.227185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.227217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2467 partition: 0 MaxSeqNo: 17 sessionId: src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0
2025-10-02T08:15:44.227550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccdaae-5f531466-288154b9-e825bbb6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:44.230413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0] Write session: try to update token
2025-10-02T08:15:44.230429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:44.244766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId: src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:44.247409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:44.247618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.247640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.247664Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:44.247671Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:44.247673Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:44.247681Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535156692530018:7152]
2025-10-02T08:15:44.247687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535156692530018:7152]
2025-10-02T08:15:44.247720Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:44.247732Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:44.247735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:44.247744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.247745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:44.247924Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:44.291646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535156692530073:14175]
2025-10-02T08:15:44.291770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2466, pipe: [1:7556535156692530073:14175]
2025-10-02T08:15:44.386230Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:44.386537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:44.386595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692530073:14175], now have 1 active actors on pipe
2025-10-02T08:15:44.386599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:44.386696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:44.386706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:44.386725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2467 reason: error at write: Disconnected sessionId: src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0
2025-10-02T08:15:44.386803Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:44.386865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2467 sessionId: src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0 is DEAD
2025-10-02T08:15:44.386995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535156692530073:14175]
2025-10-02T08:15:44.387025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:44.387035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0] Write session will restart in 0.005289s
2025-10-02T08:15:44.387059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0] Write session: Do CDS request
2025-10-02T08:15:44.387068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:44.393203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.393356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:44.393378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2468
2025-10-02T08:15:44.393670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.393705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:44.393714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:44.393718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:44.394481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2468 sessionId:  describe result for acl check
2025-10-02T08:15:44.394527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:44.394533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:44.394535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:44.394546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535156692530371:7214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:44.395079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535156692530371:7214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:44.397619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535156692530371:7214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:44.400598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535156692530371:7214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:44.400620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535156692530371:7214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:44.400623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535156692530371:7214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:44.400631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:44.409683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:44.411421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:44.411599Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:44.411608Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:44.411618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:44.411666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:44.411714Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535156692530849:7213]
2025-10-02T08:15:44.412403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:44.412606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:44.412647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:44.413107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:44.413162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.413168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.413169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.413171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.413172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.413178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.413188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.413192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.413201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.413205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.413210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.413217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.413230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.413235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.413240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.413245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.413249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.413254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.413259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.413269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.413292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:44.421391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:44.423355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:44.423375Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:44.423377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:44.423381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:44.423386Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2467 [1:7556535156692530849:7213]
2025-10-02T08:15:44.423399Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:44.423416Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:44.423419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.423422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.423424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.423440Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:44.423446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:44.423451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:44.423517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.423526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.423529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:44.423532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:44.423591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:44.423603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.423616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.423629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:44.423646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692530585:7214], now have 1 active actors on pipe
2025-10-02T08:15:44.423657Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535156692530843:7213]
2025-10-02T08:15:44.423660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535156692530843:7213]
2025-10-02T08:15:44.423668Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:44.423676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2467
2025-10-02T08:15:44.423679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:44.423680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535157151910719:2378], now have 1 active actors on pipe
2025-10-02T08:15:44.423682Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:44.423689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:44.423703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:44.423710Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:44.423717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.423721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.423762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535156692530843:7213]
2025-10-02T08:15:44.423771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:44.423773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:44.423738Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2467
2025-10-02T08:15:44.423785Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78045d09-c400768-223febc-7a135acc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:44.423795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.423799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.423801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:44.423810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.423818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:44.423865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.423912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.423918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.423930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.423970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2468 partition: 0 MaxSeqNo: 17 sessionId: src_id|78045d09-c400768-223febc-7a135acc_0
2025-10-02T08:15:44.424316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5175cbd4-edfad2f9-1417b51-afef5fec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|78045d09-c400768-223febc-7a135acc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:44.426772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78045d09-c400768-223febc-7a135acc_0] Write session: try to update token
2025-10-02T08:15:44.426786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78045d09-c400768-223febc-7a135acc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:44.440068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId: src_id|78045d09-c400768-223febc-7a135acc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:44.441759Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:44.441784Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:44.441786Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:44.441795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535156692530843:7213]
2025-10-02T08:15:44.441799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535156692530843:7213]
2025-10-02T08:15:44.441844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:44.441855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.441857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:44.441858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:44.441865Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:44.442011Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:44.442712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:44.487237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535156692530873:14175]
2025-10-02T08:15:44.487384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2467, pipe: [1:7556535156692530873:14175]
2025-10-02T08:15:44.573607Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:44.574057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.574073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.574114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692530873:14175], now have 1 active actors on pipe
2025-10-02T08:15:44.574241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:44.574254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:44.574322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2468 reason: error at write: Disconnected sessionId: src_id|78045d09-c400768-223febc-7a135acc_0
2025-10-02T08:15:44.574332Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:44.574369Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:44.574481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2468 sessionId: src_id|78045d09-c400768-223febc-7a135acc_0 is DEAD
2025-10-02T08:15:44.574611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78045d09-c400768-223febc-7a135acc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:44.574619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78045d09-c400768-223febc-7a135acc_0] Write session will restart in 0.005034s
2025-10-02T08:15:44.574638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78045d09-c400768-223febc-7a135acc_0] Write session: Do CDS request
2025-10-02T08:15:44.574643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78045d09-c400768-223febc-7a135acc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:44.574640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535156692530873:14175]
2025-10-02T08:15:44.581250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78045d09-c400768-223febc-7a135acc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.581321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:44.581338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2469
2025-10-02T08:15:44.581439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.581466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:44.581474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:44.581478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:44.581893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2469 sessionId:  describe result for acl check
2025-10-02T08:15:44.581931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:44.581938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:44.581940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:44.581946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535156692531207:7254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:44.582419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535156692531207:7254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:44.585015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535156692531207:7254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:44.587997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535156692531207:7254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:44.588014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535156692531207:7254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:44.588016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535156692531207:7254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:44.588024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:44.594227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:44.596035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:44.596203Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:44.596211Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:44.596219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:44.596284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:44.596322Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535156692531656:7272]
2025-10-02T08:15:44.596766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:44.597014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:44.597052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:44.597282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:44.597326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.597331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.597332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.597334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.597335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.597339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.597349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.597353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.597357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.597360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.597365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.597372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.597377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.597382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.597387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.597391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.597395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.597400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.597405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.597414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.597433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:44.610014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:44.611787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:44.611811Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:44.611814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:44.611817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:44.611823Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2468 [1:7556535156692531656:7272]
2025-10-02T08:15:44.611835Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:44.611852Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:44.611856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.611858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.611860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.611876Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:44.611881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:44.611887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:44.611952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.611961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.611964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:44.611966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:44.612035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:44.612043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.612055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.612070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:44.612086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2468
2025-10-02T08:15:44.612094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692531466:7254], now have 1 active actors on pipe
2025-10-02T08:15:44.612100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535156692531650:7272]
2025-10-02T08:15:44.612102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535156692531650:7272]
2025-10-02T08:15:44.612112Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:44.612135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:44.612138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:44.612140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535157151910726:2378], now have 1 active actors on pipe
2025-10-02T08:15:44.612145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.612148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.612167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:44.612185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:44.612196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:44.612238Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|733174ec-e0393fa7-666061c7-1c226e0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:44.612249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.612252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.612254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:44.612262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.612225Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2468
2025-10-02T08:15:44.612271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:44.612285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535156692531650:7272]
2025-10-02T08:15:44.612295Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:44.612308Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:44.612328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.612422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.612429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.612443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.612483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2469 partition: 0 MaxSeqNo: 17 sessionId: src_id|733174ec-e0393fa7-666061c7-1c226e0c_0
2025-10-02T08:15:44.612840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78045d09-c400768-223febc-7a135acc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|733174ec-e0393fa7-666061c7-1c226e0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:44.615482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733174ec-e0393fa7-666061c7-1c226e0c_0] Write session: try to update token
2025-10-02T08:15:44.615497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733174ec-e0393fa7-666061c7-1c226e0c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:44.623395Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:44.623416Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:44.623426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535156692531650:7272]
2025-10-02T08:15:44.623471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:44.623640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:44.623782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:44.623910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:44.624051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:44.624255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:44.624300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:44.624375Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:44.629856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId: src_id|733174ec-e0393fa7-666061c7-1c226e0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:44.632397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:44.632459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.632472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.632504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:44.632530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:44.632591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.632610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.632789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.632884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.632958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.633036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.633265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.633277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.633354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.633422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.633489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.633567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.633619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.633630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.633703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.633767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.633836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.633899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.633949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.633957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.634023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.634088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.634155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.634224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.634273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.634279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.634349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.634412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.634483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.634552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.634606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.634612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.634681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.634745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.634818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.634886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.634932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.634938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.635012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.635078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.635146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.635216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.635261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.635267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.635335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.635400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.635465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.635534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.635583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.635591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.635657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.635724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.635790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.635858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.635904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.635911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.635983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:44.636052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:44.636128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:44.636198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:44.636243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:44.636250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:44.636290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:44.636361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.636382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.636389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:44.636422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:44.636438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:44.636441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:44.636444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:44.636448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:44.636889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:44.636913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:44.636919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:44.636922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:44.636925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:44.636927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:44.637741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:44.637768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:44.637774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:44.637777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:44.637780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:44.637783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:44.638310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:44.638334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:44.638339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:44.638343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:44.638347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:44.639719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:44.639741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:44.639758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392944639
2025-10-02T08:15:44.639880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:44.639893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:44.639898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:44.639906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:44.639912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:44.639919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:44.640489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:44.640518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:44.640524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:44.640528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:44.640532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:44.640535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:44.641085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:44.641107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:44.641116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:44.641123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:44.641126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:44.641130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:44.641641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:44.641667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:44.641677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:44.642841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:44.642857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:44.642862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:44.642868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:44.642877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392944642
2025-10-02T08:15:44.643197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:44.643218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:44.643226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:44.643230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:44.643233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:44.643236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:44.643731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:44.643750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:44.643756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:44.643761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:44.643775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:44.643780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:44.644288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:44.644310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.644427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392944644
2025-10-02T08:15:44.645302Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:44.645327Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:44.645336Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:44.645351Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:44.646945Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:44.646957Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:44.646959Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:44.646966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535156692531650:7272]
2025-10-02T08:15:44.646970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535156692531650:7272]
2025-10-02T08:15:44.647010Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:44.647018Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:44.647024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:44.647028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.647030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:44.647156Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:44.674629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535156692531688:14175]
2025-10-02T08:15:44.674737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2468, pipe: [1:7556535156692531688:14175]
2025-10-02T08:15:44.782013Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:44.782634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692531688:14175], now have 1 active actors on pipe
2025-10-02T08:15:44.782732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:44.782739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:44.782764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2469 reason: error at write: Disconnected sessionId: src_id|733174ec-e0393fa7-666061c7-1c226e0c_0
2025-10-02T08:15:44.782796Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:44.782865Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:44.782927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2469 sessionId: src_id|733174ec-e0393fa7-666061c7-1c226e0c_0 is DEAD
2025-10-02T08:15:44.783064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733174ec-e0393fa7-666061c7-1c226e0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:44.783072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733174ec-e0393fa7-666061c7-1c226e0c_0] Write session will restart in 0.008628s
2025-10-02T08:15:44.783096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733174ec-e0393fa7-666061c7-1c226e0c_0] Write session: Do CDS request
2025-10-02T08:15:44.783102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733174ec-e0393fa7-666061c7-1c226e0c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:44.783096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535156692531688:14175]
2025-10-02T08:15:44.793313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|733174ec-e0393fa7-666061c7-1c226e0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.793334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:44.793352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2470
2025-10-02T08:15:44.793532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.793565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:44.793575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:44.793578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:44.793909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2470 sessionId:  describe result for acl check
2025-10-02T08:15:44.793936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:44.793940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:44.793941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:44.793945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535156692532187:7299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:44.794476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535156692532187:7299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:44.797010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535156692532187:7299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:44.799600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535156692532187:7299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:44.799614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535156692532187:7299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:44.799616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535156692532187:7299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:44.799622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:44.801409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:44.802753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:44.802922Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:44.802929Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:44.802936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:44.802968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:44.802996Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535156692532471:7290]
2025-10-02T08:15:44.803422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:44.803571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:44.803602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:44.803787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:44.803815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.803819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.803820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.803820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.803821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.803824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.803830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.803832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.803834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.803836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.803840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.803844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.803848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.803851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.803853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.803856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.803859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.803861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.803864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.803867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.803876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:44.811665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:44.813498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:44.813521Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:44.813524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:44.813527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:44.813534Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2469 [1:7556535156692532471:7290]
2025-10-02T08:15:44.813546Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:44.813563Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:44.813567Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.813571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.813573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.813591Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:44.813596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:44.813602Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:44.813677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.813687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.813690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:44.813692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:44.813762Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:44.813769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.813782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.813797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:44.813821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692532446:7299], now have 1 active actors on pipe
2025-10-02T08:15:44.813824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2469
2025-10-02T08:15:44.813828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535157151910733:2378], now have 1 active actors on pipe
2025-10-02T08:15:44.813834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535156692532465:7290]
2025-10-02T08:15:44.813836Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535156692532465:7290]
2025-10-02T08:15:44.813849Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:44.813863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.813884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.813892Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:44.813895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:44.813904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:44.813918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:44.813923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:44.813917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2469
2025-10-02T08:15:44.813968Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:44.813981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:44.813985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:44.813987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:44.813996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:44.814011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:44.814023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535156692532465:7290]
2025-10-02T08:15:44.814030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:44.814044Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:44.814073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.814165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.814172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.814186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:44.814216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2470 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0
2025-10-02T08:15:44.814521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|733174ec-e0393fa7-666061c7-1c226e0c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:44.817206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0] Write session: try to update token
2025-10-02T08:15:44.817223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:44.831598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId: src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:44.831823Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:44.831841Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:44.831843Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:44.831851Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535156692532465:7290]
2025-10-02T08:15:44.831855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535156692532465:7290]
2025-10-02T08:15:44.831894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:44.831899Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:44.831905Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:44.831905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.831907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:44.832048Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:44.834331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:44.883014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535156692532498:14175]
2025-10-02T08:15:44.883103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2469, pipe: [1:7556535156692532498:14175]
2025-10-02T08:15:44.970606Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:44.971227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:44.971244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:44.971294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692532498:14175], now have 1 active actors on pipe
2025-10-02T08:15:44.971394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:44.971402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:44.971449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2470 reason: error at write: Disconnected sessionId: src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0
2025-10-02T08:15:44.971458Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:44.971528Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:44.971607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2470 sessionId: src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0 is DEAD
2025-10-02T08:15:44.971757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:44.971768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0] Write session will restart in 0.008576s
2025-10-02T08:15:44.971764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535156692532498:14175]
2025-10-02T08:15:44.971791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0] Write session: Do CDS request
2025-10-02T08:15:44.971798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:44.981277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.981302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:44.981321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2471
2025-10-02T08:15:44.981496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:44.981517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:44.981525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:44.981528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:44.981866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2471 sessionId:  describe result for acl check
2025-10-02T08:15:44.981887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:44.981891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:44.981892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:44.981895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535156692532972:7317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:44.982240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535156692532972:7317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:44.984562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535156692532972:7317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:44.987263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535156692532972:7317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:44.987284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535156692532972:7317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:44.987287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535156692532972:7317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:44.987296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:44.991530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:44.992155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:44.992432Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:44.992444Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:44.992456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:44.992522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:44.992560Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535156692533291:7307]
2025-10-02T08:15:44.993120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:44.993286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:44.993326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:44.993538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:44.993580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.993586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.993587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.993588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.993590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.993594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.993605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.993615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.993619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.993623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.993628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.993635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:44.993644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.993652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:44.993660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.993667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:44.993670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.993672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:44.993678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.993680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:44.993690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:45.001501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:45.003272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:45.003291Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:45.003293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:45.003296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:45.003301Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2470 [1:7556535156692533291:7307]
2025-10-02T08:15:45.003310Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:45.003324Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:45.003331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.003333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.003334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.003347Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:45.003353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:45.003358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:45.003407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.003413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.003414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:45.003416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:45.003468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:45.003474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.003487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.003498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:45.003512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535156692533235:7317], now have 1 active actors on pipe
2025-10-02T08:15:45.003518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2470
2025-10-02T08:15:45.003520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535156692533285:7307]
2025-10-02T08:15:45.003522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535156692533285:7307]
2025-10-02T08:15:45.003526Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:45.003536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:45.003548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:45.003556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:45.003562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535157151910754:2378], now have 1 active actors on pipe
2025-10-02T08:15:45.003582Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:45.003594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:45.003594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535156692533285:7307]
2025-10-02T08:15:45.003596Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:45.003601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.003601Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:45.003603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.003636Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0678945-48d65091-cf8bf255-d5080aa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:45.003645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.003651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.003653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:45.003659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.003636Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2470
2025-10-02T08:15:45.003669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:45.003689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.003721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.003726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.003734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.003763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2471 partition: 0 MaxSeqNo: 17 sessionId: src_id|f0678945-48d65091-cf8bf255-d5080aa0_0
2025-10-02T08:15:45.004112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4c9852-d31f5a91-98058e4a-f4f38c3a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f0678945-48d65091-cf8bf255-d5080aa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:45.006543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678945-48d65091-cf8bf255-d5080aa0_0] Write session: try to update token
2025-10-02T08:15:45.006561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678945-48d65091-cf8bf255-d5080aa0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:45.020315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId: src_id|f0678945-48d65091-cf8bf255-d5080aa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:45.020998Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:45.021016Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:45.021019Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:45.021033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535156692533285:7307]
2025-10-02T08:15:45.021036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535156692533285:7307]
2025-10-02T08:15:45.021072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:45.021077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:45.021084Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:45.021084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.021086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:45.021219Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:45.022960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:45.071997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535160987500613:14175]
2025-10-02T08:15:45.072150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2470, pipe: [1:7556535160987500613:14175]
2025-10-02T08:15:45.158720Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:45.158963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.158974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.159006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987500613:14175], now have 1 active actors on pipe
2025-10-02T08:15:45.159120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:45.159131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:45.159201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2471 reason: error at write: Disconnected sessionId: src_id|f0678945-48d65091-cf8bf255-d5080aa0_0
2025-10-02T08:15:45.159250Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:45.159301Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:45.159376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2471 sessionId: src_id|f0678945-48d65091-cf8bf255-d5080aa0_0 is DEAD
2025-10-02T08:15:45.159557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678945-48d65091-cf8bf255-d5080aa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:45.159570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678945-48d65091-cf8bf255-d5080aa0_0] Write session will restart in 0.006452s
2025-10-02T08:15:45.159564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535160987500613:14175]
2025-10-02T08:15:45.159595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678945-48d65091-cf8bf255-d5080aa0_0] Write session: Do CDS request
2025-10-02T08:15:45.159602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678945-48d65091-cf8bf255-d5080aa0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:45.167276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678945-48d65091-cf8bf255-d5080aa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.167382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:45.167398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2472
2025-10-02T08:15:45.167496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.167528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:45.167534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:45.167538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:45.167976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2472 sessionId:  describe result for acl check
2025-10-02T08:15:45.168012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:45.168018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:45.168020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:45.168024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535160987500971:7361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:45.168530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535160987500971:7361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:45.171735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535160987500971:7361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:45.175081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535160987500971:7361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:45.175100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535160987500971:7361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:45.175104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535160987500971:7361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:45.175112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:45.186132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:45.186596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:45.186776Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:45.186784Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:45.186794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:45.186847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:45.186892Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535160987501397:7363]
2025-10-02T08:15:45.187566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:45.187794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:45.187838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:45.188161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:45.188209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.188215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.188216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.188218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.188219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.188224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.188235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.188238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.188242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.188246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.188253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.188261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.188272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.188283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.188293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.188304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.188313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.188323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.188332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.188342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.188366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:45.196853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:45.198704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:45.198725Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:45.198727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:45.198731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:45.198739Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2471 [1:7556535160987501397:7363]
2025-10-02T08:15:45.198751Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:45.198770Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:45.198777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.198779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.198781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.198797Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:45.198802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:45.198808Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:45.198878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.198886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.198890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:45.198892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:45.198960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:45.198968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.198980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.198991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:45.199009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987501238:7361], now have 1 active actors on pipe
2025-10-02T08:15:45.199012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2471
2025-10-02T08:15:45.199017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535161446878057:2378], now have 1 active actors on pipe
2025-10-02T08:15:45.199023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535160987501391:7363]
2025-10-02T08:15:45.199025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535160987501391:7363]
2025-10-02T08:15:45.199036Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:45.199045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.199049Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:45.199052Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:45.199054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.199070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:45.199088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:45.199094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:45.199134Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:45.199145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.199149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.199151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:45.199159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.199167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:45.199179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535160987501391:7363]
2025-10-02T08:15:45.199188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:45.199196Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:45.199215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.199384Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2471
2025-10-02T08:15:45.199294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.199302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.199316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.199350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2472 partition: 0 MaxSeqNo: 17 sessionId: src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0
2025-10-02T08:15:45.199688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678945-48d65091-cf8bf255-d5080aa0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:45.202381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0] Write session: try to update token
2025-10-02T08:15:45.202402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:45.218490Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:45.218518Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:45.218522Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:45.218532Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535160987501391:7363]
2025-10-02T08:15:45.218536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535160987501391:7363]
2025-10-02T08:15:45.218581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:45.218593Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:45.218596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.218598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:45.218600Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:45.218748Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:45.220446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId: src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:45.223137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:45.262204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535160987501436:14175]
2025-10-02T08:15:45.264189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2471, pipe: [1:7556535160987501436:14175]
2025-10-02T08:15:45.352681Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:45.353084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.353095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.353126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987501436:14175], now have 1 active actors on pipe
2025-10-02T08:15:45.353217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:45.353224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:45.353273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2472 reason: error at write: Disconnected sessionId: src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0
2025-10-02T08:15:45.353303Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:45.353342Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:45.353429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2472 sessionId: src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0 is DEAD
2025-10-02T08:15:45.353547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:45.353556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0] Write session will restart in 0.005096s
2025-10-02T08:15:45.353579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0] Write session: Do CDS request
2025-10-02T08:15:45.353585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:45.353589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535160987501436:14175]
2025-10-02T08:15:45.360303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.360387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:45.360409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2473
2025-10-02T08:15:45.360492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.360513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:45.360520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:45.360522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:45.360964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2473 sessionId:  describe result for acl check
2025-10-02T08:15:45.361004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:45.361010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:45.361012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:45.361017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535160987501789:7378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:45.361498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535160987501789:7378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:45.363743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535160987501789:7378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:45.366775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535160987501789:7378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:45.366790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535160987501789:7378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:45.366793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535160987501789:7378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:45.366801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:45.377540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:45.377904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:45.378268Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:45.378282Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:45.378295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:45.378367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:45.378407Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535160987502243:7383]
2025-10-02T08:15:45.378866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:45.379017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:45.379050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:45.379252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:45.379283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.379284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.379285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.379285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.379286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.379289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.379296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.379298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.379301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.379302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.379306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.379311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.379314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.379317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.379319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.379323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.379325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.379327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.379329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.379332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.379343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:45.387120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:45.388529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:45.388547Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:45.388549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:45.388552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:45.388558Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2472 [1:7556535160987502243:7383]
2025-10-02T08:15:45.388566Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:45.388580Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:45.388582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.388584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.388586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.388597Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:45.388601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:45.388606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:45.388658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.388659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.388662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:45.388663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:45.388716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:45.388728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.388737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.388743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:45.388755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535160987502237:7383]
2025-10-02T08:15:45.388761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535160987502237:7383]
2025-10-02T08:15:45.388766Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:45.388774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:45.388786Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:45.388787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:45.388789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:45.388796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987502005:7378], now have 1 active actors on pipe
2025-10-02T08:15:45.388798Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:45.388818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2472
2025-10-02T08:15:45.388930Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2472
2025-10-02T08:15:45.389027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535161446878087:2378], now have 1 active actors on pipe
2025-10-02T08:15:45.389036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535160987502237:7383]
2025-10-02T08:15:45.389042Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:45.389048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.389050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.389057Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:45.389084Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:45.389089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.389092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.389094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:45.389100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.389108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:45.389121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.389152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.389156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.389165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.389192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2473 partition: 0 MaxSeqNo: 17 sessionId: src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0
2025-10-02T08:15:45.389505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245137bc-e24a0a05-2e2b15fb-82a316c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:45.391977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0] Write session: try to update token
2025-10-02T08:15:45.391989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:45.405453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId: src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:45.407192Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:45.407214Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:45.407216Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:45.407225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535160987502237:7383]
2025-10-02T08:15:45.407229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535160987502237:7383]
2025-10-02T08:15:45.407271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:45.407278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.407279Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:45.407284Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:45.407285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:45.407433Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:45.407824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:45.453892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535160987502269:14175]
2025-10-02T08:15:45.453995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2472, pipe: [1:7556535160987502269:14175]
2025-10-02T08:15:45.546420Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:45.547064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.547079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.547116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987502269:14175], now have 1 active actors on pipe
2025-10-02T08:15:45.547228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:45.547236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:45.547298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2473 reason: error at write: Disconnected sessionId: src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0
2025-10-02T08:15:45.547368Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:45.547618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:45.547626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0] Write session will restart in 0.008022s
2025-10-02T08:15:45.547647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0] Write session: Do CDS request
2025-10-02T08:15:45.547653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:45.547327Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:45.547460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2473 sessionId: src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0 is DEAD
2025-10-02T08:15:45.547647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535160987502269:14175]
2025-10-02T08:15:45.557236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.557323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:45.557343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2474
2025-10-02T08:15:45.557452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.557484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:45.557496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:45.557499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:45.557943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2474 sessionId:  describe result for acl check
2025-10-02T08:15:45.557983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:45.557989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:45.557991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:45.557996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535160987502698:7416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:45.558509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535160987502698:7416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:45.561555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535160987502698:7416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:45.564609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535160987502698:7416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:45.564624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535160987502698:7416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:45.564627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535160987502698:7416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:45.564634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:45.570992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:45.571396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:45.571571Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:45.571581Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:45.571590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:45.571631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:45.571674Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535160987503059:7417]
2025-10-02T08:15:45.572309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:45.572555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:45.572630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:45.572954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:45.573029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.573035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.573036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.573037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.573039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.573044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.573055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.573059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.573063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.573070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.573077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.573093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.573099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.573105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.573114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.573120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.573124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.573129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.573142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.573146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.573169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:45.581498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:45.583114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:45.583130Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:45.583132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:45.583136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:45.583142Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2473 [1:7556535160987503059:7417]
2025-10-02T08:15:45.583155Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:45.583172Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:45.583174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.583178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.583180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.583210Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:45.583215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:45.583221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:45.583284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.583292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.583295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:45.583297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:45.583362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:45.583371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.583384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.583396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:45.583411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2473
2025-10-02T08:15:45.583415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987502966:7416], now have 1 active actors on pipe
2025-10-02T08:15:45.583421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535160987503053:7417]
2025-10-02T08:15:45.583423Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535160987503053:7417]
2025-10-02T08:15:45.583430Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:45.583438Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:45.583440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.583440Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:45.583444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.583462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:45.583480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:45.583483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:45.583490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535161446878094:2378], now have 1 active actors on pipe
2025-10-02T08:15:45.583534Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:45.583544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.583547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.583549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:45.583557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.583565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:45.583578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535160987503053:7417]
2025-10-02T08:15:45.583588Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:45.583598Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:45.583613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.583667Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2473
2025-10-02T08:15:45.583691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.583698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.583719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.583752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2474 partition: 0 MaxSeqNo: 17 sessionId: src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0
2025-10-02T08:15:45.584090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ae2dd-daffea93-6d1fa721-70bd7761_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:45.586714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0] Write session: try to update token
2025-10-02T08:15:45.586732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:45.595071Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:45.595090Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:45.595097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535160987503053:7417]
2025-10-02T08:15:45.595138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:45.595148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:45.595329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:45.595486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:45.595629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:45.595778Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:45.596049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:45.596089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:45.599943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId: src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:45.602388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:45.602453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.602465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.602496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:45.602522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:45.602585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.602594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.602745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.602806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.602871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.602933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.602977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.602986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.603051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.603113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.603174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.603239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.603284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.603291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.603359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.603420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.603475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.603535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.603574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.603584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.603648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.603709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.603776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.603840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.603883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.603889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.603956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.604019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.604082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.604155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.604200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.604208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.604272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.604334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.604396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.604458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.604501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.604508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.604570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.604627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.604689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.604753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.604796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.604821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.604891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.604949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.605010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.605080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.605202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.605209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.605273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.605336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.605401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.605462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.605505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.605512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.605574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:45.605635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:45.605696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:45.605756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:45.605797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:45.605803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:45.605838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:45.605899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.605922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.605924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:45.605953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:45.605966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:45.605974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:45.605977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:45.605979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:45.606343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:45.606367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:45.606373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:45.606376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:45.606379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:45.606382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:45.606830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:45.606848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:45.606854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:45.606857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:45.606860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:45.606863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:45.607290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:45.607308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:45.607315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:45.607318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:45.607321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:45.609514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:45.609533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:45.609547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392945609
2025-10-02T08:15:45.609877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:45.609894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:45.609900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:45.609907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:45.609911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:45.609921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:45.610510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:45.610533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:45.610538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:45.610541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:45.610544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:45.610547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:45.611009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:45.611031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:45.611037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:45.611040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:45.611044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:45.611049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:45.611545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:45.611566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:45.611571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:45.612675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:45.612693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:45.612698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:45.612702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:45.612711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392945612
2025-10-02T08:15:45.613048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:45.613068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:45.613073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:45.613076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:45.613079Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:45.613083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:45.613502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:45.613521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:45.613526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:45.613533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:45.613536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:45.613539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:45.613979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:45.613998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.614092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392945614
2025-10-02T08:15:45.617869Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:45.617886Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:45.617893Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:45.617900Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:45.619489Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:45.619503Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:45.619506Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:45.619514Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535160987503053:7417]
2025-10-02T08:15:45.619518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535160987503053:7417]
2025-10-02T08:15:45.619568Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:45.619577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:45.619580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:45.619582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.619584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:45.619716Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:45.648014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535160987503091:14175]
2025-10-02T08:15:45.648137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2473, pipe: [1:7556535160987503091:14175]
2025-10-02T08:15:45.758393Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:45.758805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987503091:14175], now have 1 active actors on pipe
2025-10-02T08:15:45.758945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535160987503091:14175]
2025-10-02T08:15:45.758964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:45.758966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:45.758988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2474 reason: error at write: Disconnected sessionId: src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0
2025-10-02T08:15:45.759060Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:45.759068Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:45.759137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2474 sessionId: src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0 is DEAD
2025-10-02T08:15:45.759262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:45.759269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0] Write session will restart in 0.005085s
2025-10-02T08:15:45.759295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0] Write session: Do CDS request
2025-10-02T08:15:45.759300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:45.765269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.765355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:45.765369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2475
2025-10-02T08:15:45.765537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.765575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:45.765585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:45.765589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:45.766205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2475 sessionId:  describe result for acl check
2025-10-02T08:15:45.766244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:45.766246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:45.766247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:45.766253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535160987503404:7432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:45.766761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535160987503404:7432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:45.769079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535160987503404:7432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:45.772313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535160987503404:7432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:45.772327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535160987503404:7432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:45.772331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535160987503404:7432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:45.772339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:45.782256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:45.782717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:45.782905Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:45.782914Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:45.782924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:45.782964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:45.782994Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535160987503888:7447]
2025-10-02T08:15:45.783427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:45.783626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:45.783655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:45.783844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:45.783873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.783877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.783878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.783879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.783879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.783882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.783889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.783892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.783894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.783896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.783900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.783904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.783908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.783911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.783913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.783916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.783919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.783923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.783925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.783928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.783939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:45.792234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:45.793865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:45.793880Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:45.793884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:45.793887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:45.793894Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2474 [1:7556535160987503888:7447]
2025-10-02T08:15:45.793904Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:45.793919Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:45.793921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.793923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.793925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.793937Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:45.793940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:45.793945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:45.793992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.794000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.794002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:45.794004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:45.794056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:45.794061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.794071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.794081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:45.794097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535160987503882:7447]
2025-10-02T08:15:45.794101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535160987503882:7447]
2025-10-02T08:15:45.794107Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:45.794117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:45.794130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:45.794130Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:45.794133Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:45.794135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:45.794139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2474
2025-10-02T08:15:45.794143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987503666:7432], now have 1 active actors on pipe
2025-10-02T08:15:45.794167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535161446878101:2378], now have 1 active actors on pipe
2025-10-02T08:15:45.794172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535160987503882:7447]
2025-10-02T08:15:45.794177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:45.794183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.794188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.794190Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:45.794219Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:45.794226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.794229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.794230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:45.794237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.794244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:45.794262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.794237Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2474
2025-10-02T08:15:45.794300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.794306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.794320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.794347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2475 partition: 0 MaxSeqNo: 17 sessionId: src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0
2025-10-02T08:15:45.794674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec17ae5-8b3c1c6a-de86b06f-f82b4467_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:45.797147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0] Write session: try to update token
2025-10-02T08:15:45.797163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:45.810523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId: src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:45.811807Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:45.811827Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:45.811829Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:45.811839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535160987503882:7447]
2025-10-02T08:15:45.811844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535160987503882:7447]
2025-10-02T08:15:45.811883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:45.811894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.811896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:45.811971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:45.811986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:45.812036Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:45.813083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:45.858902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535160987503914:14175]
2025-10-02T08:15:45.859012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2474, pipe: [1:7556535160987503914:14175]
2025-10-02T08:15:45.953327Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:45.953915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.953930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.953967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987503914:14175], now have 1 active actors on pipe
2025-10-02T08:15:45.954089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:45.954105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:45.954163Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:45.954182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2475 reason: error at write: Disconnected sessionId: src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0
2025-10-02T08:15:45.954187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:45.954346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2475 sessionId: src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0 is DEAD
2025-10-02T08:15:45.954483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:45.954491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0] Write session will restart in 0.005794s
2025-10-02T08:15:45.954515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0] Write session: Do CDS request
2025-10-02T08:15:45.954521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:45.954516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535160987503914:14175]
2025-10-02T08:15:45.961252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.961317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:45.961335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2476
2025-10-02T08:15:45.961467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:45.961503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:45.961512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:45.961516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:45.961997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2476 sessionId:  describe result for acl check
2025-10-02T08:15:45.962028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:45.962034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:45.962036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:45.962041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535160987504244:7475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:45.962529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535160987504244:7475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:45.965184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535160987504244:7475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:45.968411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535160987504244:7475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:45.968428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535160987504244:7475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:45.968433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535160987504244:7475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:45.968442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:45.977768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:45.979461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:45.979636Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:45.979645Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:45.979653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:45.979689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:45.979726Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535160987504719:7465]
2025-10-02T08:15:45.980239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:45.980449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:45.980483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:45.980770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:45.980842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.980849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.980850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.980852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.980853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.980858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.980869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.980873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.980877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.980887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.980893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.980900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:45.980911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.980921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:45.980930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.980940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:45.980950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.980960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.980970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.980980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.981001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:45.989535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:45.991243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:45.991265Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:45.991268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:45.991273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:45.991280Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2475 [1:7556535160987504719:7465]
2025-10-02T08:15:45.991293Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:45.991310Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:45.991314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.991317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.991320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.991335Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:45.991341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:45.991348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:45.991417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.991427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.991430Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:45.991433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:45.991503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:45.991510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:45.991526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:45.991544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:45.991550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2475
2025-10-02T08:15:45.991566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535160987504474:7475], now have 1 active actors on pipe
2025-10-02T08:15:45.991574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535161446878122:2378], now have 1 active actors on pipe
2025-10-02T08:15:45.991580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535160987504713:7465]
2025-10-02T08:15:45.991583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535160987504713:7465]
2025-10-02T08:15:45.991596Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:45.991612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.991621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.991620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:45.991625Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:45.991640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:45.991650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2475
2025-10-02T08:15:45.991660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:45.991672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:45.991717Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:45.991723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:45.991729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:45.991731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:45.991740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:45.991748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:45.991758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535160987504713:7465]
2025-10-02T08:15:45.991767Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:45.991780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:45.991796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.991853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:45.991859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:45.991883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:45.991923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2476 partition: 0 MaxSeqNo: 17 sessionId: src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0
2025-10-02T08:15:45.992306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e99548-7f8c1e8c-6aab4ba2-c28d33a8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:45.994807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0] Write session: try to update token
2025-10-02T08:15:45.994820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:46.008090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId: src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:46.008864Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:46.008877Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:46.008879Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:46.008889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535160987504713:7465]
2025-10-02T08:15:46.008894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535160987504713:7465]
2025-10-02T08:15:46.008933Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:46.008939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:46.008942Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:46.008948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.008951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:46.009084Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:46.010809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:46.054478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535165282472039:14175]
2025-10-02T08:15:46.054604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2475, pipe: [1:7556535165282472039:14175]
2025-10-02T08:15:46.134611Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:46.135359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.135369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.135399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282472039:14175], now have 1 active actors on pipe
2025-10-02T08:15:46.135510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535165282472039:14175]
2025-10-02T08:15:46.135538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:46.135540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:46.135571Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:46.135599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2476 reason: error at write: Disconnected sessionId: src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0
2025-10-02T08:15:46.135591Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:46.135776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2476 sessionId: src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0 is DEAD
2025-10-02T08:15:46.135928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:46.135934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0] Write session will restart in 0.005690s
2025-10-02T08:15:46.135953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0] Write session: Do CDS request
2025-10-02T08:15:46.135957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:46.142343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.142430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:46.142446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2477
2025-10-02T08:15:46.142559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.142596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:46.142605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:46.142609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:46.143079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2477 sessionId:  describe result for acl check
2025-10-02T08:15:46.143132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:46.143141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:46.143143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:46.143150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535165282472394:7460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:46.143662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535165282472394:7460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:46.145896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535165282472394:7460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:46.149154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535165282472394:7460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:46.149167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535165282472394:7460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:46.149181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535165282472394:7460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:46.149188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:46.155007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:46.156496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:46.156657Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:46.156666Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:46.156674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:46.157082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:46.157121Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535165282472841:7470]
2025-10-02T08:15:46.157656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:46.157817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:46.157848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:46.158100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:46.158133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.158138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.158139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.158139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.158140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.158144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.158153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.158156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.158159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.158162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.158167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.158173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.158177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.158185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.158189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.158194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.158200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.158205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.158209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.158218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.158234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:46.165786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:46.167630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:46.167642Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:46.167643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:46.167645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:46.167650Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2476 [1:7556535165282472841:7470]
2025-10-02T08:15:46.167657Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:46.167671Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:46.167672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.167675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.167676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.167688Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:46.167691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:46.167695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:46.167748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.167754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.167756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:46.167757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:46.167806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:46.167810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.167818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.167825Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:46.167843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535165282472829:7470]
2025-10-02T08:15:46.167849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535165282472829:7470]
2025-10-02T08:15:46.167857Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:46.167874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:46.167882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:46.167885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:46.167889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:46.167891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2476
2025-10-02T08:15:46.167896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:46.167905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282472664:7460], now have 1 active actors on pipe
2025-10-02T08:15:46.167930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535165741845425:2378], now have 1 active actors on pipe
2025-10-02T08:15:46.167937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.167940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.167949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535165282472829:7470]
2025-10-02T08:15:46.167959Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:46.167965Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:46.167978Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:46.167986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.167989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.167990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:46.167996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.167981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2476
2025-10-02T08:15:46.168006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:46.168034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.168072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.168079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.168090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.168135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2477 partition: 0 MaxSeqNo: 17 sessionId: src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0
2025-10-02T08:15:46.168403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd6bad-40ae6eb4-a5554182-dbbc9a86_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:46.170815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0] Write session: try to update token
2025-10-02T08:15:46.170831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:46.184156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId: src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:46.184479Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:46.184493Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:46.184495Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:46.184503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535165282472829:7470]
2025-10-02T08:15:46.184508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535165282472829:7470]
2025-10-02T08:15:46.184544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:46.184549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:46.184557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.184557Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:46.184559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:46.184694Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:46.186885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:46.235747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535165282472874:14175]
2025-10-02T08:15:46.235851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2476, pipe: [1:7556535165282472874:14175]
2025-10-02T08:15:46.310683Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:46.311125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.311140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.311175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282472874:14175], now have 1 active actors on pipe
2025-10-02T08:15:46.311265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535165282472874:14175]
2025-10-02T08:15:46.311284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:46.311286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:46.311332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2477 reason: error at write: Disconnected sessionId: src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0
2025-10-02T08:15:46.311322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:46.311656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:46.311665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0] Write session will restart in 0.006856s
2025-10-02T08:15:46.311687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0] Write session: Do CDS request
2025-10-02T08:15:46.311693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:46.311487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2477 sessionId: src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0 is DEAD
2025-10-02T08:15:46.311516Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:46.316176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:46.316902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:46.317022Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:46.317029Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:46.317035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:46.317073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:46.317103Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535165282472970:7564]
2025-10-02T08:15:46.317486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:46.317598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:46.317622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:46.317804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:46.317832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.317836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.317836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.317837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.317838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.317841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.317847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.317849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.317851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.317853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.317856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.317860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.317864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.317866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.317869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.317871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.317874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.317877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.317881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.317884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.317894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:46.319199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.319271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:46.319281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2478
2025-10-02T08:15:46.319377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.319397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:46.319404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:46.319406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:46.319697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2478 sessionId:  describe result for acl check
2025-10-02T08:15:46.319722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:46.319726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:46.319727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:46.319731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535165282472986:7535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:46.320077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535165282472986:7535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:46.321856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535165282472986:7535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:46.324734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535165282472986:7535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:46.324749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535165282472986:7535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:46.324752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535165282472986:7535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:46.324759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:46.325336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:46.326868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:46.326879Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:46.326881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:46.326883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:46.326888Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2477 [1:7556535165282472970:7564]
2025-10-02T08:15:46.326896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:46.326910Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:46.326912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.326915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.326916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.326928Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:46.326935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:46.326940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:46.326989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.326994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.326997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:46.326999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:46.327060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:46.327069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.327079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.327090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:46.327107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282473014:7535], now have 1 active actors on pipe
2025-10-02T08:15:46.327110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2477
2025-10-02T08:15:46.327113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535165282472964:7564]
2025-10-02T08:15:46.327115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535165282472964:7564]
2025-10-02T08:15:46.327124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:46.327132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535165741845456:2378], now have 1 active actors on pipe
2025-10-02T08:15:46.327132Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:46.327135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:46.327138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.327142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.327158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:46.327176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:46.327181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:46.327150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2477
2025-10-02T08:15:46.327220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:46.327232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.327237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.327242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:46.327248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.327259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:46.327269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535165282472964:7564]
2025-10-02T08:15:46.327278Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:46.327295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:46.327303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.327366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.327375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.327396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.327432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2478 partition: 0 MaxSeqNo: 17 sessionId: src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0
2025-10-02T08:15:46.327740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd52756-a71e4bc9-7c3feb92-6e71eee0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:46.330458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0] Write session: try to update token
2025-10-02T08:15:46.330476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:46.343934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId: src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:46.344589Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:46.344603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:46.344605Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:46.344612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535165282472964:7564]
2025-10-02T08:15:46.344616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535165282472964:7564]
2025-10-02T08:15:46.344652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:46.344661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.344663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:46.344664Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:46.344671Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:46.344792Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:46.346354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:46.411342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535165282473030:14175]
2025-10-02T08:15:46.411441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2477, pipe: [1:7556535165282473030:14175]
2025-10-02T08:15:46.475438Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:46.475759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.475769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.475802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282473030:14175], now have 1 active actors on pipe
2025-10-02T08:15:46.475932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535165282473030:14175]
2025-10-02T08:15:46.475954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:46.475959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:46.475978Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:46.476015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2478 reason: error at write: Disconnected sessionId: src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0
2025-10-02T08:15:46.476080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:46.476200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2478 sessionId: src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0 is DEAD
2025-10-02T08:15:46.476325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:46.476333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0] Write session will restart in 0.005648s
2025-10-02T08:15:46.476356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0] Write session: Do CDS request
2025-10-02T08:15:46.476361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:46.480511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:46.481620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:46.481767Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:46.481773Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:46.481781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:46.481813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:46.481844Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535165282473088:7549]
2025-10-02T08:15:46.482272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:46.482446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:46.482472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:46.482653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:46.482679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.482685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.482686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.482688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.482689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.482694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.482703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.482711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.482715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.482717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.482721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.482729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.482733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.482739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.482741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.482744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.482750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.482754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.482760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.482762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.482774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:46.483225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.483293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:46.483305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2479
2025-10-02T08:15:46.483402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.483423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:46.483429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:46.483431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:46.483725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2479 sessionId:  describe result for acl check
2025-10-02T08:15:46.483749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:46.483753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:46.483755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:46.483758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535165282473104:7554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:46.484225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535165282473104:7554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:46.486365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535165282473104:7554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:46.489689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535165282473104:7554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:46.489702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535165282473104:7554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:46.489705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535165282473104:7554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:46.489712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:46.490296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:46.491764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:46.491781Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:46.491786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:46.491789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:46.491794Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2478 [1:7556535165282473088:7549]
2025-10-02T08:15:46.491805Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:46.491819Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:46.491828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.491831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.491832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.491851Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:46.491860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:46.491866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:46.491922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.491928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.491931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:46.491933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:46.491994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:46.492003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.492015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.492031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:46.492050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282473135:7554], now have 1 active actors on pipe
2025-10-02T08:15:46.492057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535165741845462:2378], now have 1 active actors on pipe
2025-10-02T08:15:46.492062Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535165282473082:7549]
2025-10-02T08:15:46.492064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535165282473082:7549]
2025-10-02T08:15:46.492076Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:46.492092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:46.492108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:46.492126Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:46.492156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535165282473082:7549]
2025-10-02T08:15:46.492164Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:46.492164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:46.492166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:46.492171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:46.492197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2478
2025-10-02T08:15:46.492205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.492209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.492229Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:46.492239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.492242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.492244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:46.492252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.492263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:46.492281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.492394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.492408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.492442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.492424Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2478
2025-10-02T08:15:46.492496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2479 partition: 0 MaxSeqNo: 17 sessionId: src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0
2025-10-02T08:15:46.492870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95695ef2-b8f98ab7-8058a0f3-4f926f08_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:46.495436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0] Write session: try to update token
2025-10-02T08:15:46.495455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:46.509955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId: src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:46.510358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:46.510371Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:46.510372Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:46.510379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535165282473082:7549]
2025-10-02T08:15:46.510383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535165282473082:7549]
2025-10-02T08:15:46.510416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:46.510422Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:46.510425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.510426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:46.510428Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:46.510549Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:46.512501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:46.576199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535165282473153:14175]
2025-10-02T08:15:46.576328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2478, pipe: [1:7556535165282473153:14175]
2025-10-02T08:15:46.654474Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:46.654909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.654921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.654956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282473153:14175], now have 1 active actors on pipe
2025-10-02T08:15:46.655096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535165282473153:14175]
2025-10-02T08:15:46.655126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:46.655129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:46.655179Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:46.655186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2479 reason: error at write: Disconnected sessionId: src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0
2025-10-02T08:15:46.655174Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:46.655378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2479 sessionId: src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0 is DEAD
2025-10-02T08:15:46.655511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:46.655518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0] Write session will restart in 0.009599s
2025-10-02T08:15:46.655542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0] Write session: Do CDS request
2025-10-02T08:15:46.655549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:46.660640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:46.661634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:46.661821Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:46.661832Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:46.661842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:46.661896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:46.661938Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535165282473212:7553]
2025-10-02T08:15:46.662572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:46.662749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:46.662796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:46.663090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:46.663146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.663152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.663153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.663154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.663155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.663160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.663169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.663173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.663177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.663181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.663187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.663194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.663199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.663204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.663209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.663214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.663218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.663223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.663227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.663233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.663251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:46.666302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.666401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:46.666413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2480
2025-10-02T08:15:46.666557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.666591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:46.666603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:46.666611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:46.667065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2480 sessionId:  describe result for acl check
2025-10-02T08:15:46.667103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:46.667108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:46.667110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:46.667117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535165282473228:7571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:46.667674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535165282473228:7571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:46.669919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535165282473228:7571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:46.671149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:46.672786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:46.672824Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:46.672828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:46.672832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:46.672838Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2479 [1:7556535165282473212:7553]
2025-10-02T08:15:46.672849Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:46.672864Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:46.672873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.672876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.672880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.672896Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:46.672901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:46.672907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:46.672951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535165282473228:7571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:46.672965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535165282473228:7571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:46.672965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.672967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.672968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535165282473228:7571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:46.672970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:46.672972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:46.672977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:46.673039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:46.673048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.673062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.673075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:46.673097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535165741845468:2378], now have 1 active actors on pipe
2025-10-02T08:15:46.673108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535165282473206:7553]
2025-10-02T08:15:46.673114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535165282473206:7553]
2025-10-02T08:15:46.673121Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:46.673136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:46.673106Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2479
2025-10-02T08:15:46.673155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:46.673154Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:46.673157Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:46.673162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:46.673198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535165282473206:7553]
2025-10-02T08:15:46.673210Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:46.673220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282473260:7571], now have 1 active actors on pipe
2025-10-02T08:15:46.673222Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:46.673255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2479
2025-10-02T08:15:46.673299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.673311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.673335Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:46.673346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.673354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.673356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:46.673366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.673377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:46.673396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.673438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.673445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.673456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.673488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2480 partition: 0 MaxSeqNo: 17 sessionId: src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0
2025-10-02T08:15:46.673806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22c99fb-f5fd4270-af7f8e42-be2935_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:46.676356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0] Write session: try to update token
2025-10-02T08:15:46.676370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:46.690379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId: src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:46.691811Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:46.691829Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:46.691832Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:46.691842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535165282473206:7553]
2025-10-02T08:15:46.691846Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535165282473206:7553]
2025-10-02T08:15:46.691894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:46.691905Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:46.691908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.691910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:46.691911Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:46.692057Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:46.693252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:46.755423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535165282473279:14175]
2025-10-02T08:15:46.755553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2479, pipe: [1:7556535165282473279:14175]
2025-10-02T08:15:46.843297Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:46.843693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.843708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.843746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282473279:14175], now have 1 active actors on pipe
2025-10-02T08:15:46.843865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:46.843876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:46.843935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2480 reason: error at write: Disconnected sessionId: src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0
2025-10-02T08:15:46.843952Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:46.843960Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:46.844172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2480 sessionId: src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0 is DEAD
2025-10-02T08:15:46.844221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535165282473279:14175]
2025-10-02T08:15:46.844285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:46.844294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0] Write session will restart in 0.006052s
2025-10-02T08:15:46.844314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0] Write session: Do CDS request
2025-10-02T08:15:46.844319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:46.849608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:46.850303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:46.850444Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:46.850451Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:46.850458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:46.850492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:46.850521Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535165282473342:7609]
2025-10-02T08:15:46.850973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:46.851178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:46.851236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:46.851307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.851418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:46.851432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2481
2025-10-02T08:15:46.851563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:46.851570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:46.851594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:46.851604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:46.851612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:46.851626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.851636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.851638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.851639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.851640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.851646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.851656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.851665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.851669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.851681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.851687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.851694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:46.851699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.851704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:46.851708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.851713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:46.851717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.851722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.851726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.851731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.851753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:46.851950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2481 sessionId:  describe result for acl check
2025-10-02T08:15:46.851984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:46.851993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:46.851995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:46.852001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535165282473358:7617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:46.852552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535165282473358:7617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:46.854491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535165282473358:7617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:46.859253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535165282473358:7617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:46.859270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535165282473358:7617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:46.859274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535165282473358:7617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:46.859283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:46.859653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:46.861221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:46.861233Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:46.861235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:46.861238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:46.861242Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2480 [1:7556535165282473342:7609]
2025-10-02T08:15:46.861251Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:46.861265Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:46.861268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.861270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.861271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.861285Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:46.861288Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:46.861294Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:46.861352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.861355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.861357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:46.861359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:46.861409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:46.861416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.861428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:46.861442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:46.861463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282473390:7617], now have 1 active actors on pipe
2025-10-02T08:15:46.861473Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535165282473336:7609]
2025-10-02T08:15:46.861475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535165282473336:7609]
2025-10-02T08:15:46.861481Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:46.861487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2480
2025-10-02T08:15:46.861489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535165741845490:2378], now have 1 active actors on pipe
2025-10-02T08:15:46.861489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:46.861491Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:46.861496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:46.861509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:46.861516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:46.861523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.861527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.861566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535165282473336:7609]
2025-10-02T08:15:46.861573Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:46.861586Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:46.861557Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2480
2025-10-02T08:15:46.861593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:46.861603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:46.861607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:46.861613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:46.861616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:46.861624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:46.861662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.861712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:46.861721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:46.861735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:46.861767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2481 partition: 0 MaxSeqNo: 17 sessionId: src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0
2025-10-02T08:15:46.862114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d272ee-e7049d73-8afe342b-ae7bed13_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:46.864731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0] Write session: try to update token
2025-10-02T08:15:46.864745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:46.880442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId: src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:46.880553Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:46.880569Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:46.880572Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:46.880583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535165282473336:7609]
2025-10-02T08:15:46.880587Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535165282473336:7609]
2025-10-02T08:15:46.880633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:46.880639Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:46.880645Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:46.880649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:46.880651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:46.880863Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:46.883136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:46.944353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535165282473419:14175]
2025-10-02T08:15:46.944480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2480, pipe: [1:7556535165282473419:14175]
2025-10-02T08:15:47.014635Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:47.014876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.014889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.014929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535165282473419:14175], now have 1 active actors on pipe
2025-10-02T08:15:47.015053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535165282473419:14175]
2025-10-02T08:15:47.015073Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:47.015079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:47.015081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:47.015093Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:47.015143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2481 reason: error at write: Disconnected sessionId: src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0
2025-10-02T08:15:47.015285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2481 sessionId: src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0 is DEAD
2025-10-02T08:15:47.015440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:47.015464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0] Write session will restart in 0.008180s
2025-10-02T08:15:47.015493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0] Write session: Do CDS request
2025-10-02T08:15:47.015500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:47.020796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:47.021716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:47.021918Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:47.021932Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:47.021944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:47.022009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:47.022053Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535169577440779:7643]
2025-10-02T08:15:47.022704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:47.022915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:47.022962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:47.023262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:47.023322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.023328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.023330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.023331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.023332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.023338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.023348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.023351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.023354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.023358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.023364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.023370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.023376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.023383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.023394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.023400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.023409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.023413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.023419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.023423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.023443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:47.025284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.025367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:47.025379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2482
2025-10-02T08:15:47.025508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.025540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:47.025550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:47.025553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:47.025954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2482 sessionId:  describe result for acl check
2025-10-02T08:15:47.025990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:47.025996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:47.025998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:47.026002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535169577440795:7623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:47.026500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535169577440795:7623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:47.028528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535169577440795:7623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:47.031234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535169577440795:7623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:47.031248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535169577440795:7623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:47.031252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535169577440795:7623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:47.031261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:47.031470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:47.032913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:47.032927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:47.032929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:47.032931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:47.032935Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2481 [1:7556535169577440779:7643]
2025-10-02T08:15:47.032943Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:47.032955Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:47.032957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.032959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.032960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.032971Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:47.032974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:47.032978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:47.033022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.033028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.033030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:47.033031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:47.033077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:47.033084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.033092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.033099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:47.033110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535169577440773:7643]
2025-10-02T08:15:47.033111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535169577440773:7643]
2025-10-02T08:15:47.033116Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:47.033127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:47.033139Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:47.033140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:47.033143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:47.033144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:47.033150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577440827:7623], now have 1 active actors on pipe
2025-10-02T08:15:47.033164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2481
2025-10-02T08:15:47.033173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535170036812793:2378], now have 1 active actors on pipe
2025-10-02T08:15:47.033174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535169577440773:7643]
2025-10-02T08:15:47.033179Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:47.033183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.033185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.033188Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:47.033213Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:47.033224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.033227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.033228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:47.033234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.033240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:47.033252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.033224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2481
2025-10-02T08:15:47.033342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.033350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.033363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.033395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2482 partition: 0 MaxSeqNo: 17 sessionId: src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0
2025-10-02T08:15:47.033701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d536ede-fa00570f-33c1bb48-e0fd6e24_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:47.036094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0] Write session: try to update token
2025-10-02T08:15:47.036107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:47.048543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId: src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:47.050502Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:47.050520Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.050522Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:47.050531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535169577440773:7643]
2025-10-02T08:15:47.050535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535169577440773:7643]
2025-10-02T08:15:47.050575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:47.050586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.050585Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:47.050592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:47.050593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:47.050723Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:47.051057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:47.115336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535169577440845:14175]
2025-10-02T08:15:47.115438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2481, pipe: [1:7556535169577440845:14175]
2025-10-02T08:15:47.193688Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:47.194013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.194025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.194063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577440845:14175], now have 1 active actors on pipe
2025-10-02T08:15:47.194187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535169577440845:14175]
2025-10-02T08:15:47.194206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:47.194212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:47.194260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2482 reason: error at write: Disconnected sessionId: src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0
2025-10-02T08:15:47.194298Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:47.194350Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:47.194446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2482 sessionId: src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0 is DEAD
2025-10-02T08:15:47.194621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:47.194632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0] Write session will restart in 0.007966s
2025-10-02T08:15:47.194654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0] Write session: Do CDS request
2025-10-02T08:15:47.194660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:47.199213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:47.200184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:47.200322Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:47.200329Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:47.200336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:47.200368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:47.200402Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535169577440910:7634]
2025-10-02T08:15:47.200860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:47.201086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:47.201128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:47.201429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:47.201478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.201483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.201484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.201485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.201488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.201493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.201503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.201506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.201510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.201514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.201518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.201525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.201530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.201535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.201539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.201546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.201550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.201555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.201559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.201565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.201586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:47.203288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.203385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:47.203399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2483
2025-10-02T08:15:47.203493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.203516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:47.203520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:47.203523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:47.203928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2483 sessionId:  describe result for acl check
2025-10-02T08:15:47.203956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:47.203957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:47.203958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:47.203961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535169577440926:7638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:47.204379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535169577440926:7638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:47.206244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535169577440926:7638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:47.209040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535169577440926:7638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:47.209050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535169577440926:7638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:47.209053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535169577440926:7638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:47.209059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:47.209293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:47.210855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:47.210869Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:47.210871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:47.210876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:47.210882Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2482 [1:7556535169577440910:7634]
2025-10-02T08:15:47.210893Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:47.210906Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:47.210909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.210912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.210914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.210928Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:47.210937Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:47.210945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:47.211000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.211006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.211008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:47.211010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:47.211066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:47.211072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.211087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.211100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:47.211116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2482
2025-10-02T08:15:47.211120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577440958:7638], now have 1 active actors on pipe
2025-10-02T08:15:47.211123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535170036812800:2378], now have 1 active actors on pipe
2025-10-02T08:15:47.211127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.211131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.211145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535169577440904:7634]
2025-10-02T08:15:47.211151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535169577440904:7634]
2025-10-02T08:15:47.211160Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:47.211173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:47.211175Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:47.211180Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:47.211187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:47.211190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:47.211204Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:47.211213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.211216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.211218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:47.211226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.211195Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2482
2025-10-02T08:15:47.211237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:47.211265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535169577440904:7634]
2025-10-02T08:15:47.211275Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:47.211284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:47.211290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.211328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.211335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.211347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.211379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2483 partition: 0 MaxSeqNo: 17 sessionId: src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0
2025-10-02T08:15:47.211704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ee81db-e5112f39-6fd70f8c-1656309a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:47.214099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0] Write session: try to update token
2025-10-02T08:15:47.214112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:47.221867Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:47.221882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.221888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535169577440904:7634]
2025-10-02T08:15:47.221921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:47.221923Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:47.222067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:47.222189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.222313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.222439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.222609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:47.222640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:47.227127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId: src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:47.229590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:47.229656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.229670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.229704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:47.229727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:47.229770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.229792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.230033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.230173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.230327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.230414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.230574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.230586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.230658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.230726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.230792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.230865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.230909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.230917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.230990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.231055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.231120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.231185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.231248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.231258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.231365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.231462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.231561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.231650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.231695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.231701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.231767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.231826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.231891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.231953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.231996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.232003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.232066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.232137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.232197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.232257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.232299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.232306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.232368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.232436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.232505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.232573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.232617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.232626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.232695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.232760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.232839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.232911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.232959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.232966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.233039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.233099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.233161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.233220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.233261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.233267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.233332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.233395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.233456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.233517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.233560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.233566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.233604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:47.233671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.233702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.233708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:47.233738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:47.233756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:47.233760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:47.233763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:47.233765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:47.234150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:47.234177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:47.234188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:47.234194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:47.234197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:47.234201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:47.234845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:47.234864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:47.234869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:47.234874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:47.234877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:47.234880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:47.235286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:47.235303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:47.235308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:47.235310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:47.235312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:47.237227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:47.237242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:47.237254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392947237
2025-10-02T08:15:47.237403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:47.237413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:47.237417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:47.237419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:47.237421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:47.237423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:47.237839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:47.237862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:47.237867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:47.237872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:47.237875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:47.237879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:47.238275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:47.238293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:47.238300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:47.238301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:47.238303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:47.238305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:47.238701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:47.238716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:47.238719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:47.239648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:47.239662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:47.239666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:47.239669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:47.239675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392947239
2025-10-02T08:15:47.239977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:47.239992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:47.239999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:47.240001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:47.240003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:47.240005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:47.240498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:47.240514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:47.240518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:47.240521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:47.240523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:47.240527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:47.240940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:47.240955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.241023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392947240
2025-10-02T08:15:47.241671Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:47.241686Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:47.241690Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:47.241694Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:47.243138Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:47.243147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.243148Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:47.243158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535169577440904:7634]
2025-10-02T08:15:47.243160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535169577440904:7634]
2025-10-02T08:15:47.243203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:47.243205Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:47.243209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.243210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:47.243210Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:47.243333Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:47.294517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535169577440981:14175]
2025-10-02T08:15:47.294634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2482, pipe: [1:7556535169577440981:14175]
2025-10-02T08:15:47.369663Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:47.369956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577440981:14175], now have 1 active actors on pipe
2025-10-02T08:15:47.370051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:47.370058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:47.370084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2483 reason: error at write: Disconnected sessionId: src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0
2025-10-02T08:15:47.370186Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:47.370205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:47.370268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2483 sessionId: src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0 is DEAD
2025-10-02T08:15:47.370422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:47.370434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0] Write session will restart in 0.008674s
2025-10-02T08:15:47.370429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535169577440981:14175]
2025-10-02T08:15:47.370458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0] Write session: Do CDS request
2025-10-02T08:15:47.370468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:47.375051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:47.375809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:47.375975Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:47.375984Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:47.375993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:47.376041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:47.376077Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535169577441087:7691]
2025-10-02T08:15:47.376648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:47.376854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:47.376896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:47.377179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:47.377241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.377246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.377247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.377248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.377249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.377254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.377262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.377265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.377268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.377271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.377276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.377287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.377292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.377301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.377305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.377308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.377312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.377316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.377320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.377324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.377340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:47.380274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.380375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:47.380387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2484
2025-10-02T08:15:47.380509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.380538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:47.380546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:47.380550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:47.380959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2484 sessionId:  describe result for acl check
2025-10-02T08:15:47.380998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:47.381003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:47.381005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:47.381010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535169577441103:7693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:47.381472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535169577441103:7693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:47.383314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535169577441103:7693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:47.384773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:47.385992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535169577441103:7693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:47.386005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535169577441103:7693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:47.386008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535169577441103:7693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:47.386016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:47.386261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:47.386272Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:47.386274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:47.386276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:47.386280Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2483 [1:7556535169577441087:7691]
2025-10-02T08:15:47.386287Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:47.386300Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:47.386304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.386306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.386307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.386319Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:47.386322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:47.386326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:47.386365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.386370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.386372Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:47.386374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:47.386419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:47.386426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.386433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.386436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2483
2025-10-02T08:15:47.386439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:47.386452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577441131:7693], now have 1 active actors on pipe
2025-10-02T08:15:47.386454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535170036812831:2378], now have 1 active actors on pipe
2025-10-02T08:15:47.386458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.386462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.386477Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535169577441081:7691]
2025-10-02T08:15:47.386483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535169577441081:7691]
2025-10-02T08:15:47.386494Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:47.386500Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2483
2025-10-02T08:15:47.386509Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:47.386525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:47.386528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:47.386530Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:47.386532Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:47.386552Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:47.386559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.386561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.386563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:47.386568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.386575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:47.386603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535169577441081:7691]
2025-10-02T08:15:47.386612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:47.386620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.386621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:47.386677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.386681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.386692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.386717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2484 partition: 0 MaxSeqNo: 17 sessionId: src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0
2025-10-02T08:15:47.386988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff6bf1c4-fac5a25-e3b1e2c4-720ca5a2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:47.389350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0] Write session: try to update token
2025-10-02T08:15:47.389362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:47.400798Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:47.400831Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.400840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535169577441081:7691]
2025-10-02T08:15:47.400888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:47.400892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:47.401059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:47.401199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.401330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.401461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.401659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:47.401695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:47.402402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId: src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:47.404667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:47.404728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.404738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.404766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:47.404790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:47.404833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.404837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.404978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.405034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.405115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.405177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.405218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.405226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.405285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.405345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.405400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.405458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.405498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.405503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.405562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.405623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.405681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.405739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.405780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.405786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.405850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.405906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.405964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.406021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.406062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.406067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.406135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.406200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.406263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.406321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.406364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.406369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.406430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.406485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.406543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.406609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.406650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.406655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.406716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.406772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.406831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.406887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.406928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.406933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.406992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.407048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.407104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.407157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.407197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.407202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.407260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.407318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.407372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.407428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.407470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.407474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.407532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.407586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.407647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.407707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.407747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.407752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.407789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:47.407840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.407856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.407863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:47.407900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:47.407914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:47.407920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:47.407922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:47.407923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:47.408361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:47.408384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:47.408389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:47.408391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:47.408393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:47.408395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:47.408943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:47.408962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:47.408966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:47.408969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:47.408971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:47.408973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:47.409461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:47.409477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:47.409481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:47.409484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:47.409486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:47.410567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:47.410584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:47.410596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392947410
2025-10-02T08:15:47.410748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:47.410759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:47.410762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:47.410764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:47.410767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:47.410769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:47.411189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:47.411206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:47.411209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:47.411212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:47.411214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:47.411217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:47.411652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:47.411670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:47.411678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:47.411681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:47.411683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:47.411685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:47.412102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:47.412132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:47.412137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:47.413114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:47.413129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:47.413133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:47.413135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:47.413140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392947412
2025-10-02T08:15:47.413409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:47.413425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:47.413429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:47.413432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:47.413434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:47.413436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:47.413838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:47.413854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:47.413857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:47.413860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:47.413862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:47.413864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:47.414261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:47.414276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.414375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392947414
2025-10-02T08:15:47.415058Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:47.415077Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:47.415081Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:47.415087Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:47.416671Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:47.416684Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.416685Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:47.416692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535169577441081:7691]
2025-10-02T08:15:47.416694Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535169577441081:7691]
2025-10-02T08:15:47.416736Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:47.416739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:47.416742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.416744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:47.416748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:47.416892Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:47.470671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535169577441159:14175]
2025-10-02T08:15:47.470770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2483, pipe: [1:7556535169577441159:14175]
2025-10-02T08:15:47.545564Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:47.545948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577441159:14175], now have 1 active actors on pipe
2025-10-02T08:15:47.546062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535169577441159:14175]
2025-10-02T08:15:47.546087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:47.546094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:47.546097Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:47.546124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2484 reason: error at write: Disconnected sessionId: src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0
2025-10-02T08:15:47.546111Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:47.546305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2484 sessionId: src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0 is DEAD
2025-10-02T08:15:47.546464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:47.546474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0] Write session will restart in 0.006847s
2025-10-02T08:15:47.546497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0] Write session: Do CDS request
2025-10-02T08:15:47.546505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:47.551308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:47.551819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:47.551977Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:47.551985Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:47.551994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:47.552035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:47.552073Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535169577441241:7687]
2025-10-02T08:15:47.552530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:47.552694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:47.552727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:47.552957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:47.552992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.552996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.552997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.552998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.552999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.553002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.553012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.553015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.553018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.553022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.553027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.553033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.553037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.553039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.553043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.553047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.553049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.553052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.553054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.553057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.553066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:47.554252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.554332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:47.554342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2485
2025-10-02T08:15:47.554456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.554488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:47.554495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:47.554499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:47.554870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2485 sessionId:  describe result for acl check
2025-10-02T08:15:47.554906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:47.554913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:47.554915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:47.554921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535169577441257:7698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:47.555391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535169577441257:7698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:47.557507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535169577441257:7698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:47.560093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535169577441257:7698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:47.560107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535169577441257:7698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:47.560109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535169577441257:7698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:47.560128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:47.560669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:47.562067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:47.562080Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:47.562082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:47.562084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:47.562088Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2484 [1:7556535169577441241:7687]
2025-10-02T08:15:47.562096Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:47.562109Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:47.562113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.562115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.562116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.562129Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:47.562133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:47.562137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:47.562180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.562186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.562188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:47.562189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:47.562242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:47.562252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.562263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.562273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:47.562280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2484
2025-10-02T08:15:47.562289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577441289:7698], now have 1 active actors on pipe
2025-10-02T08:15:47.562293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.562297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.562312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535169577441235:7687]
2025-10-02T08:15:47.562314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535169577441235:7687]
2025-10-02T08:15:47.562326Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:47.562334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535170036812838:2378], now have 1 active actors on pipe
2025-10-02T08:15:47.562336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:47.562338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:47.562341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:47.562353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:47.562355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:47.562368Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:47.562375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.562378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.562381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:47.562388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.562396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:47.562375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2484
2025-10-02T08:15:47.562429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535169577441235:7687]
2025-10-02T08:15:47.562439Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:47.562443Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:47.562451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.562498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.562504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.562530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.562564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2485 partition: 0 MaxSeqNo: 17 sessionId: src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0
2025-10-02T08:15:47.562841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba753d0c-120620bc-98ed5c16-5e5acb31_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:47.565188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0] Write session: try to update token
2025-10-02T08:15:47.565200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:47.573245Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:47.573260Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.573268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535169577441235:7687]
2025-10-02T08:15:47.573303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:47.573309Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:47.573450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:47.573583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.573708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.573831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:47.574010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:47.574044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:47.577693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId: src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:47.579978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:47.580056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.580069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.580099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:47.580140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:47.580234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.580246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.580386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.580444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.580503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.580557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.580600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.580606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.580665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.580715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.580776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.580849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.580888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.580895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.580952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.581003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.581057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.581107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.581146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.581151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.581207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.581269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.581325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.581378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.581420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.581425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.581482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.581532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.581585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.581642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.581688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.581694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.581768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.581832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.581895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.581963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.582011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.582017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.582086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.582150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.582216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.582280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.582327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.582334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.582406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.582467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.582529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.582587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.582629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.582635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.582701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.582759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.582816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.582879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.582923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.582930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.582996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:47.583054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:47.583113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:47.583174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:47.583223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:47.583227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:47.583255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:47.583305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.583321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.583328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:47.583350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:47.583363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:47.583368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:47.583370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:47.583371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:47.583698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:47.583717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:47.583726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:47.583728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:47.583729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:47.583731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:47.584151Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:47.584169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:47.584178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:47.584183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:47.584185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:47.584187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:47.584584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:47.584601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:47.584605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:47.584607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:47.584609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:47.585680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:47.585696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:47.585707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392947585
2025-10-02T08:15:47.585951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:47.585962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:47.585966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:47.585971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:47.585974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:47.585976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:47.586351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:47.586369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:47.586375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:47.586381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:47.586383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:47.586385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:47.586775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:47.586791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:47.586794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:47.586800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:47.586802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:47.586804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:47.587189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:47.587207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:47.587213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:47.588153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:47.588166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:47.588170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:47.588174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:47.588179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392947587
2025-10-02T08:15:47.588433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:47.588449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:47.588453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:47.588455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:47.588458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:47.588461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:47.588855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:47.588870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:47.588873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:47.588875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:47.588877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:47.588879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:47.589284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:47.589300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.589371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392947588
2025-10-02T08:15:47.591557Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:47.591570Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:47.591573Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:47.591577Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:47.593009Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:47.593019Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.593021Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:47.593032Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535169577441235:7687]
2025-10-02T08:15:47.593035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535169577441235:7687]
2025-10-02T08:15:47.593072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:47.593081Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:47.593087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:47.593091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.593093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:47.593214Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:47.646305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535169577441312:14175]
2025-10-02T08:15:47.646429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2484, pipe: [1:7556535169577441312:14175]
2025-10-02T08:15:47.717173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:47.717494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577441312:14175], now have 1 active actors on pipe
2025-10-02T08:15:47.717566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:47.717572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:47.717591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2485 reason: error at write: Disconnected sessionId: src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0
2025-10-02T08:15:47.717655Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:47.717741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2485 sessionId: src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0 is DEAD
2025-10-02T08:15:47.717742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:47.717880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535169577441312:14175]
2025-10-02T08:15:47.717920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:47.717931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0] Write session will restart in 0.005541s
2025-10-02T08:15:47.717955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0] Write session: Do CDS request
2025-10-02T08:15:47.717962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:47.722606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:47.722973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:47.723100Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:47.723107Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:47.723113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:47.723142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:47.723169Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535169577441393:7707]
2025-10-02T08:15:47.723558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:47.723683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:47.723708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:47.723889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:47.723915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.723920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.723921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.723922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.723923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.723926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.723932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.723935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.723937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.723939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.723943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.723947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.723951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.723954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.723960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.723962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.723964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.723967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.723969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.723972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.723982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:47.724226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.724320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:47.724330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2486
2025-10-02T08:15:47.724433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.724454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:47.724461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:47.724463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:47.724719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2486 sessionId:  describe result for acl check
2025-10-02T08:15:47.724741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:47.724744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:47.724746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:47.724749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535169577441410:7718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:47.725144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535169577441410:7718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:47.726846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535169577441410:7718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:47.731614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535169577441410:7718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:47.731627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535169577441410:7718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:47.731629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535169577441410:7718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:47.731635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:47.732261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:47.733774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:47.733791Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:47.733793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:47.733796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:47.733804Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2485 [1:7556535169577441393:7707]
2025-10-02T08:15:47.733815Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:47.733832Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:47.733839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.733842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.733844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.733859Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:47.733868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:47.733874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:47.733943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.733956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.733960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:47.733963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:47.734027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:47.734035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.734046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.734061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:47.734068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2485
2025-10-02T08:15:47.734084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577441443:7718], now have 1 active actors on pipe
2025-10-02T08:15:47.734091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535170036812845:2378], now have 1 active actors on pipe
2025-10-02T08:15:47.734096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.734104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.734118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535169577441387:7707]
2025-10-02T08:15:47.734124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535169577441387:7707]
2025-10-02T08:15:47.734134Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:47.734147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:47.734152Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:47.734156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:47.734158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:47.734161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:47.734149Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2485
2025-10-02T08:15:47.734172Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:47.734180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.734183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.734184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:47.734191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.734197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:47.734234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535169577441387:7707]
2025-10-02T08:15:47.734246Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:47.734258Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:47.734263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.734328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.734336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.734353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.734386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2486 partition: 0 MaxSeqNo: 17 sessionId: src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0
2025-10-02T08:15:47.734697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2115b05-559894f3-fbe5f59a-95762d1e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:47.737206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0] Write session: try to update token
2025-10-02T08:15:47.737221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:47.750600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId: src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:47.750852Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:47.750867Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.750870Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:47.750878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535169577441387:7707]
2025-10-02T08:15:47.750882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535169577441387:7707]
2025-10-02T08:15:47.750921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:47.750930Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:47.750935Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:47.750936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.750939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:47.751067Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:47.753064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:47.817792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535169577441458:14175]
2025-10-02T08:15:47.817883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2485, pipe: [1:7556535169577441458:14175]
2025-10-02T08:15:47.877096Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:47.877378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.877387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.877416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577441458:14175], now have 1 active actors on pipe
2025-10-02T08:15:47.877533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:47.877542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:47.877595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2486 reason: error at write: Disconnected sessionId: src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0
2025-10-02T08:15:47.877641Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:47.877729Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:47.877764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2486 sessionId: src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0 is DEAD
2025-10-02T08:15:47.877941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:47.877928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535169577441458:14175]
2025-10-02T08:15:47.877951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0] Write session will restart in 0.006177s
2025-10-02T08:15:47.877973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0] Write session: Do CDS request
2025-10-02T08:15:47.877979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:47.882550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:47.883034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:47.883145Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:47.883152Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:47.883159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:47.883185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:47.883210Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535169577441540:7727]
2025-10-02T08:15:47.883609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:47.883749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:47.883782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:47.883973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:47.883999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.884000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.884000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.884001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.884002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.884005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.884013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.884015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.884017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.884018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.884022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.884026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:47.884029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.884033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:47.884035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.884038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:47.884040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.884042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.884045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.884048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.884059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:47.885228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.885299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:47.885312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2487
2025-10-02T08:15:47.885451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:47.885483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:47.885487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:47.885491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:47.885783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2487 sessionId:  describe result for acl check
2025-10-02T08:15:47.885806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:47.885807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:47.885808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:47.885811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535169577441557:7734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:47.886164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535169577441557:7734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:47.887961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535169577441557:7734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:47.891108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535169577441557:7734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:47.891118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535169577441557:7734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:47.891121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535169577441557:7734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:47.891126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:47.891591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:47.892977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:47.892987Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:47.892988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:47.892990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:47.892994Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2486 [1:7556535169577441540:7727]
2025-10-02T08:15:47.893000Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:47.893012Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:47.893015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.893018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.893020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.893035Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:47.893045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:47.893055Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:47.893099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.893104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.893107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:47.893108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:47.893153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:47.893158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.893164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:47.893175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:47.893188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535169577441534:7727]
2025-10-02T08:15:47.893192Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535169577441534:7727]
2025-10-02T08:15:47.893197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:47.893201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2486
2025-10-02T08:15:47.893206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577441589:7734], now have 1 active actors on pipe
2025-10-02T08:15:47.893211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:47.893214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:47.893216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:47.893223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:47.893225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:47.893228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535170036812866:2378], now have 1 active actors on pipe
2025-10-02T08:15:47.893232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.893234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.893260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535169577441534:7727]
2025-10-02T08:15:47.893265Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:47.893275Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81f81eb0-6d428234-dce19a42-af8bf126_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:47.893284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:47.893286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:47.893288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:47.893292Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:47.893293Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:47.893268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2486
2025-10-02T08:15:47.893299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:47.893323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.893445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:47.893453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:47.893462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:47.893487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2487 partition: 0 MaxSeqNo: 17 sessionId: src_id|81f81eb0-6d428234-dce19a42-af8bf126_0
2025-10-02T08:15:47.893759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d89a90-eaebcc9b-b9b42237-477052c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|81f81eb0-6d428234-dce19a42-af8bf126_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:47.896267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f81eb0-6d428234-dce19a42-af8bf126_0] Write session: try to update token
2025-10-02T08:15:47.896278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f81eb0-6d428234-dce19a42-af8bf126_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:47.909563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId: src_id|81f81eb0-6d428234-dce19a42-af8bf126_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:47.910130Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:47.910143Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:47.910145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:47.910151Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535169577441534:7727]
2025-10-02T08:15:47.910155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535169577441534:7727]
2025-10-02T08:15:47.910193Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:47.910196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:47.910197Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:47.910201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:47.910202Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:47.910330Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:47.911937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:47.978052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535169577441626:14175]
2025-10-02T08:15:47.978215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2486, pipe: [1:7556535169577441626:14175]
2025-10-02T08:15:48.040623Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:48.040881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.040891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.040920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535169577441626:14175], now have 1 active actors on pipe
2025-10-02T08:15:48.041036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:48.041049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:48.041113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2487 reason: error at write: Disconnected sessionId: src_id|81f81eb0-6d428234-dce19a42-af8bf126_0
2025-10-02T08:15:48.041113Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:48.041264Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:48.041284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2487 sessionId: src_id|81f81eb0-6d428234-dce19a42-af8bf126_0 is DEAD
2025-10-02T08:15:48.041442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f81eb0-6d428234-dce19a42-af8bf126_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:48.041452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f81eb0-6d428234-dce19a42-af8bf126_0] Write session will restart in 0.009943s
2025-10-02T08:15:48.041474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f81eb0-6d428234-dce19a42-af8bf126_0] Write session: Do CDS request
2025-10-02T08:15:48.041480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f81eb0-6d428234-dce19a42-af8bf126_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:48.041467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535169577441626:14175]
2025-10-02T08:15:48.046688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:48.047257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:48.047433Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:48.047447Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:48.047459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:48.047513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:48.047549Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535173872409004:7770]
2025-10-02T08:15:48.048145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:48.048361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:48.048409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:48.048711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:48.048776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.048782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.048783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.048788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.048789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.048795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.048820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.048828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.048832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.048835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.048841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.048852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.048862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.048868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.048877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.048882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.048890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.048895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.048899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.048908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.048926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:48.052249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f81eb0-6d428234-dce19a42-af8bf126_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.052346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:48.052357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2488
2025-10-02T08:15:48.052475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.052506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:48.052515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:48.052519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:48.052913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2488 sessionId:  describe result for acl check
2025-10-02T08:15:48.052948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:48.052949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:48.052951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:48.052956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535173872409020:7768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:48.053432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535173872409020:7768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:48.055193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535173872409020:7768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:48.056498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:48.057642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535173872409020:7768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:48.057655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535173872409020:7768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:48.057657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535173872409020:7768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:48.057664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:48.057954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:48.057966Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:48.057969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:48.057972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:48.057975Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2487 [1:7556535173872409004:7770]
2025-10-02T08:15:48.057983Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:48.057995Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:48.057996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.057998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.057999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.058009Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:48.058016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:48.058019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:48.058063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.058067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.058069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:48.058071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:48.058114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:48.058119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.058127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.058133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:48.058144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409053:7768], now have 1 active actors on pipe
2025-10-02T08:15:48.058147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2487
2025-10-02T08:15:48.058149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535173872408998:7770]
2025-10-02T08:15:48.058150Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535173872408998:7770]
2025-10-02T08:15:48.058154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:48.058159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535174331780169:2378], now have 1 active actors on pipe
2025-10-02T08:15:48.058164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:48.058166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:48.058169Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:48.058172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:48.058173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:48.058178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.058181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.058212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535173872408998:7770]
2025-10-02T08:15:48.058218Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:48.058226Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:48.058228Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:48.058208Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2487
2025-10-02T08:15:48.058232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.058235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.058236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:48.058242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.058247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:48.058274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.058334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.058338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.058347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.058380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2488 partition: 0 MaxSeqNo: 17 sessionId: src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0
2025-10-02T08:15:48.058621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f81eb0-6d428234-dce19a42-af8bf126_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:48.061017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0] Write session: try to update token
2025-10-02T08:15:48.061031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:48.068610Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:48.068627Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:48.068636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535173872408998:7770]
2025-10-02T08:15:48.068676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:48.068681Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:48.068857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:48.068996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:48.069141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:48.069286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:48.069532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:48.069573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:48.074296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId: src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:48.076853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:48.076929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.076941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.076970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:48.076991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:48.077036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.077049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.077225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.077281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.077338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.077402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.077445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.077451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.077510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.077571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.077635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.077716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.077764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.077772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.077838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.077894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.077945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.077996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.078033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.078039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.078097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.078155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.078234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.078313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.078357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.078362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.078421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.078473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.078528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.078583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.078621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.078627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.078693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.078766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.078845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.078903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.078941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.078946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.079005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.079060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.079117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.079171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.079215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.079223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.079303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.079380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.079439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.079492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.079529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.079534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.079592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.079645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.079697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.079767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.079816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.079824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.079902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.079961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.080014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.080066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.080105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.080124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.080163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:48.080211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.080226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.080231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:48.080258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:48.080274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:48.080282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:48.080285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:48.080288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:48.080648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:48.080668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:48.080672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:48.080674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:48.080675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:48.080677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:48.081307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:48.081332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:48.081340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:48.081344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:48.081348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:48.081354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:48.081764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:48.081785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:48.081791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:48.081798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:48.081802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:48.082978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:48.082998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:48.083010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392948082
2025-10-02T08:15:48.083206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:48.083217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:48.083222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:48.083224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:48.083226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:48.083229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:48.083603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:48.083618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:48.083622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:48.083643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:48.083651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:48.083653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:48.084039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:48.084053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:48.084057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:48.084059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:48.084061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:48.084063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:48.084493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:48.084508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:48.084511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:48.085451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:48.085464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:48.085468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:48.085470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:48.085476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392948085
2025-10-02T08:15:48.085734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:48.085748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:48.085751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:48.085754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:48.085757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:48.085760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:48.086135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:48.086152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:48.086156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:48.086158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:48.086160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:48.086164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:48.086541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:48.086556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.086630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392948086
2025-10-02T08:15:48.087262Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:48.087274Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:48.087278Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:48.087282Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:48.088664Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:48.088675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:48.088676Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:48.088683Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535173872408998:7770]
2025-10-02T08:15:48.088686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535173872408998:7770]
2025-10-02T08:15:48.088726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:48.088732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.088733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:48.088734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:48.088742Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:48.088865Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:48.131141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:15:48.131177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-02T08:15:48.141387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535173872409079:14175]
2025-10-02T08:15:48.141476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2487, pipe: [1:7556535173872409079:14175]
2025-10-02T08:15:48.215322Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:48.215665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409079:14175], now have 1 active actors on pipe
2025-10-02T08:15:48.215765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535173872409079:14175]
2025-10-02T08:15:48.215788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:48.215794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:48.215833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2488 reason: error at write: Disconnected sessionId: src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0
2025-10-02T08:15:48.215834Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:48.215883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:48.215906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-02T08:15:48.216001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2488 sessionId: src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0 is DEAD
2025-10-02T08:15:48.216152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:48.216162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0] Write session will restart in 0.005705s
2025-10-02T08:15:48.216185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0] Write session: Do CDS request
2025-10-02T08:15:48.216191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:48.220980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:48.221495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:48.221640Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:48.221648Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:48.221657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:48.221691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:48.221723Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535173872409166:7785]
2025-10-02T08:15:48.222241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:48.222421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:48.222465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:48.222749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:48.222794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.222800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.222801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.222804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.222805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.222810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.222820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.222824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.222827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.222831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.222836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.222842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.222847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.222852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.222856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.222861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.222864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.222869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.222874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.222879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.222897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:48.223223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.223313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:48.223321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2489
2025-10-02T08:15:48.223448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.223475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:48.223484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:48.223487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:48.223839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2489 sessionId:  describe result for acl check
2025-10-02T08:15:48.223872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:48.223878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:48.223879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:48.223884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535173872409182:7804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:48.224360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535173872409182:7804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:48.226288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535173872409182:7804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:48.229909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535173872409182:7804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:48.229922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535173872409182:7804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:48.229926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535173872409182:7804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:48.229934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:48.230531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:48.232068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:48.232087Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:48.232090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:48.232094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:48.232100Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2488 [1:7556535173872409166:7785]
2025-10-02T08:15:48.232123Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:48.232145Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:48.232151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.232156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.232158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.232175Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:48.232184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:48.232195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:48.232256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.232267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.232270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:48.232273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:48.232343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:48.232355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.232370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.232375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2488
2025-10-02T08:15:48.232383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:48.232401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409213:7804], now have 1 active actors on pipe
2025-10-02T08:15:48.232409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535174331780177:2378], now have 1 active actors on pipe
2025-10-02T08:15:48.232416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.232424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.232441Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535173872409159:7785]
2025-10-02T08:15:48.232447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535173872409159:7785]
2025-10-02T08:15:48.232455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:48.232471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:48.232473Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:48.232475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:48.232446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2488
2025-10-02T08:15:48.232489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:48.232492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:48.232507Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:48.232517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.232524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.232527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:48.232535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.232548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:48.232597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535173872409159:7785]
2025-10-02T08:15:48.232605Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:48.232614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:48.232618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.232681Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:15:48.232714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.232721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.232738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.232778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2489 partition: 0 MaxSeqNo: 17 sessionId: src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0
2025-10-02T08:15:48.232877Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 22 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:15:48.232907Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:15:48.233163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c51b93b-b596b32-7a3037b2-68e2f0ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:48.235697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0] Write session: try to update token
2025-10-02T08:15:48.235712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:48.248317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId: src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:48.249773Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:48.249795Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:48.249797Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:48.249805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535173872409159:7785]
2025-10-02T08:15:48.249809Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535173872409159:7785]
2025-10-02T08:15:48.249845Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:48.249851Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:48.249854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:48.249866Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.249874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:48.250024Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:48.251125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:48.315981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535173872409231:14175]
2025-10-02T08:15:48.316089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2488, pipe: [1:7556535173872409231:14175]
2025-10-02T08:15:48.386654Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:48.386993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.387008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.387048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409231:14175], now have 1 active actors on pipe
2025-10-02T08:15:48.387165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:48.387176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:48.387232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2489 reason: error at write: Disconnected sessionId: src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0
2025-10-02T08:15:48.387286Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:48.387324Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:48.387423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2489 sessionId: src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0 is DEAD
2025-10-02T08:15:48.387560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:48.387571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0] Write session will restart in 0.008886s
2025-10-02T08:15:48.387592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0] Write session: Do CDS request
2025-10-02T08:15:48.387598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:48.387583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535173872409231:14175]
2025-10-02T08:15:48.392642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:48.393118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:48.393239Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:48.393246Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:48.393252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:48.393280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:48.393307Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535173872409359:7911]
2025-10-02T08:15:48.393688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:48.393849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:48.393879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:48.394072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:48.394098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.394103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.394103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.394104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.394105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.394108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.394114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.394116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.394119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.394120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.394124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.394128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.394133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.394136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.394138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.394141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.394143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.394148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.394151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.394153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.394163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:48.397181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.397274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:48.397287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2490
2025-10-02T08:15:48.397417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.397442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:48.397445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:48.397448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:48.397827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2490 sessionId:  describe result for acl check
2025-10-02T08:15:48.397864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:48.397870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:48.397872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:48.397878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535173872409375:7934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:48.398357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535173872409375:7934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:48.400379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535173872409375:7934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:48.401759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:48.403051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535173872409375:7934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:48.403067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535173872409375:7934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:48.403070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535173872409375:7934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:48.403078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:48.403464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:48.403480Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:48.403483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:48.403486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:48.403492Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2489 [1:7556535173872409359:7911]
2025-10-02T08:15:48.403502Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:48.403516Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:48.403525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.403527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.403529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.403546Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:48.403550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:48.403556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:48.403899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.403908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.403911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:48.403914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:48.403982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:48.403992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.404005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.404015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:48.404025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2489
2025-10-02T08:15:48.404032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409406:7934], now have 1 active actors on pipe
2025-10-02T08:15:48.404036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535174331780200:2378], now have 1 active actors on pipe
2025-10-02T08:15:48.404042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535173872409353:7911]
2025-10-02T08:15:48.404044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535173872409353:7911]
2025-10-02T08:15:48.404055Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:48.404067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.404070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:48.404073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:48.404075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.404092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:48.404074Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2489
2025-10-02T08:15:48.404107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:48.404124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:48.404158Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:48.404166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.404169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.404172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:48.404181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.404193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:48.404208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535173872409353:7911]
2025-10-02T08:15:48.404221Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:48.404243Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:48.404250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.404348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.404396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.404427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.404470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2490 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0
2025-10-02T08:15:48.404874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60797c0-2127a85e-af6ccf8f-7aa69f2b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:48.407424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0] Write session: try to update token
2025-10-02T08:15:48.407444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:48.415034Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:48.415054Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:48.415064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535173872409353:7911]
2025-10-02T08:15:48.415106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:48.415106Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:48.415269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:48.415403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:48.415527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:48.415657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:48.415992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:48.416032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:48.420853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId: src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:48.423440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:48.423504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.423518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.423555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:48.423583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:48.423641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.423654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.423804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.423866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.423925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.424006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.424052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.424059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.424131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.424185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.424244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.424306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.424354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.424359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.424418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.424474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.424536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.424598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.424638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.424643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.424703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.424762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.424840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.424898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.424938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.424943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.425000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.425053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.425109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.425174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.425218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.425223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.425280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.425332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.425391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.425447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.425489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.425491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.425550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.425606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.425662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.425721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.425769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.425777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.425844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.425904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.425963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.426018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.426056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.426061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.426118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.426169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.426223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.426277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.426323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.426331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.426391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:48.426444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:48.426498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:48.426553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:48.426600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:48.426605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:48.426636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:48.426685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.426700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.426705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:48.426728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:48.426742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:48.426746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:48.426748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:48.426750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:48.427112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:48.427133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:48.427137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:48.427140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:48.427141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:48.427143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:48.427696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:48.427717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:48.427721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:48.427723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:48.427726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:48.427728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:48.428255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:48.428273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:48.428278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:48.428284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:48.428286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:48.429382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:48.429398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:48.429407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392948429
2025-10-02T08:15:48.429575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:48.429590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:48.429602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:48.429607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:48.429610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:48.429612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:48.430018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:48.430034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:48.430041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:48.430064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:48.430072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:48.430073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:48.430468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:48.430485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:48.430492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:48.430498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:48.430500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:48.430502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:48.430937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:48.430952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:48.430955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:48.431939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:48.431958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:48.431964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:48.431967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:48.431974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392948431
2025-10-02T08:15:48.432256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:48.432272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:48.432278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:48.432280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:48.432285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:48.432289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:48.432672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:48.432690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:48.432693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:48.432695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:48.432697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:48.432700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:48.433105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:48.433120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.433214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392948433
2025-10-02T08:15:48.433880Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:48.433896Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:48.433900Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:48.433906Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:48.435358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:48.435369Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:48.435370Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:48.435377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535173872409353:7911]
2025-10-02T08:15:48.435379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535173872409353:7911]
2025-10-02T08:15:48.435422Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:48.435434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:48.435435Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:48.435438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.435440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:48.435574Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:48.487518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535173872409427:14175]
2025-10-02T08:15:48.487654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2489, pipe: [1:7556535173872409427:14175]
2025-10-02T08:15:48.565671Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:48.565956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409427:14175], now have 1 active actors on pipe
2025-10-02T08:15:48.566050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535173872409427:14175]
2025-10-02T08:15:48.566069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:48.566071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:48.566092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2490 reason: error at write: Disconnected sessionId: src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0
2025-10-02T08:15:48.566132Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:48.566180Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:48.566252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2490 sessionId: src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0 is DEAD
2025-10-02T08:15:48.566391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:48.566399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0] Write session will restart in 0.008646s
2025-10-02T08:15:48.566416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0] Write session: Do CDS request
2025-10-02T08:15:48.566421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:48.571037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:48.571540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:48.571730Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:48.571741Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:48.571753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:48.571812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:48.571854Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535173872409521:7966]
2025-10-02T08:15:48.572453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:48.572617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:48.572658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:48.572905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:48.572939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.572943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.572944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.572944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.572945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.572949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.572956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.572958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.572960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.572962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.572966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.572970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.572974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.572977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.572979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.572984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.572986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.572989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.572991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.572993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.573004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:48.576301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.576371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:48.576383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2491
2025-10-02T08:15:48.576501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.576530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:48.576540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:48.576542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:48.576920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2491 sessionId:  describe result for acl check
2025-10-02T08:15:48.576951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:48.576956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:48.576958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:48.576963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535173872409537:7959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:48.577466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535173872409537:7959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:48.579465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535173872409537:7959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:48.580565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:48.581947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535173872409537:7959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:48.581959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535173872409537:7959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:48.581962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535173872409537:7959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:48.581969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:48.582047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:48.582067Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:48.582069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:48.582072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:48.582078Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2490 [1:7556535173872409521:7966]
2025-10-02T08:15:48.582088Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:48.582104Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:48.582112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.582115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.582117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.582132Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:48.582141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:48.582151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:48.582207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.582216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.582218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:48.582221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:48.582280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:48.582285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2490
2025-10-02T08:15:48.582288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.582300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.582318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:48.582334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409568:7959], now have 1 active actors on pipe
2025-10-02T08:15:48.582343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.582347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.582358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535174331780216:2378], now have 1 active actors on pipe
2025-10-02T08:15:48.582368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535173872409515:7966]
2025-10-02T08:15:48.582370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535173872409515:7966]
2025-10-02T08:15:48.582343Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2490
2025-10-02T08:15:48.582376Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:48.582381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:48.582382Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:48.582391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:48.582404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:48.582410Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:48.582423Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|708811dc-2557695f-5accd150-3b514c0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:48.582432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.582440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.582442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:48.582450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.582462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:48.582500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535173872409515:7966]
2025-10-02T08:15:48.582513Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:48.582516Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:48.582527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.582575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.582584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.582605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.582638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2491 partition: 0 MaxSeqNo: 17 sessionId: src_id|708811dc-2557695f-5accd150-3b514c0b_0
2025-10-02T08:15:48.582916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1c6309-76997ff0-b241a6be-bc9bec39_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|708811dc-2557695f-5accd150-3b514c0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:48.585304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708811dc-2557695f-5accd150-3b514c0b_0] Write session: try to update token
2025-10-02T08:15:48.585317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708811dc-2557695f-5accd150-3b514c0b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:48.598527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId: src_id|708811dc-2557695f-5accd150-3b514c0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:48.598912Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:48.598929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:48.598932Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:48.598940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535173872409515:7966]
2025-10-02T08:15:48.598944Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535173872409515:7966]
2025-10-02T08:15:48.598986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:48.598986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:48.598992Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:48.598996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.598999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:48.599130Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:48.600969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:48.666173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535173872409582:14175]
2025-10-02T08:15:48.666293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2490, pipe: [1:7556535173872409582:14175]
2025-10-02T08:15:48.724909Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:48.725278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.725289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.725325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409582:14175], now have 1 active actors on pipe
2025-10-02T08:15:48.725435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535173872409582:14175]
2025-10-02T08:15:48.725461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:48.725469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:48.725530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2491 reason: error at write: Disconnected sessionId: src_id|708811dc-2557695f-5accd150-3b514c0b_0
2025-10-02T08:15:48.725546Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:48.725706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2491 sessionId: src_id|708811dc-2557695f-5accd150-3b514c0b_0 is DEAD
2025-10-02T08:15:48.725747Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:48.725839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708811dc-2557695f-5accd150-3b514c0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:48.725848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708811dc-2557695f-5accd150-3b514c0b_0] Write session will restart in 0.006142s
2025-10-02T08:15:48.725866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708811dc-2557695f-5accd150-3b514c0b_0] Write session: Do CDS request
2025-10-02T08:15:48.725870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708811dc-2557695f-5accd150-3b514c0b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:48.731019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:48.731489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:48.731666Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:48.731678Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:48.731690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:48.731756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:48.731796Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535173872409675:7991]
2025-10-02T08:15:48.732331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:48.732485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:48.732515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:48.732706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:48.732735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.732739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.732740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.732741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.732741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.732744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.732751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.732753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.732755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.732757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.732760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.732765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.732769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.732772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.732774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.732777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.732779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.732782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.732785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.732788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.732798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:48.733256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708811dc-2557695f-5accd150-3b514c0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.733343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:48.733351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2492
2025-10-02T08:15:48.733468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.733492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:48.733500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:48.733504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:48.733888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2492 sessionId:  describe result for acl check
2025-10-02T08:15:48.733925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:48.733932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:48.733934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:48.733940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535173872409693:7987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:48.734429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535173872409693:7987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:48.736306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535173872409693:7987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:48.739790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535173872409693:7987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:48.739802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535173872409693:7987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:48.739805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535173872409693:7987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:48.739812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:48.740345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:48.741710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:48.741724Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:48.741726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:48.741728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:48.741732Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2491 [1:7556535173872409675:7991]
2025-10-02T08:15:48.741741Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:48.741755Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:48.741756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.741759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.741760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.741771Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:48.741775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:48.741779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:48.741824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.741832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.741834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:48.741836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:48.741885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:48.741891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.741899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.741910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:48.741926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409725:7987], now have 1 active actors on pipe
2025-10-02T08:15:48.741938Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535173872409669:7991]
2025-10-02T08:15:48.741940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535173872409669:7991]
2025-10-02T08:15:48.741945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:48.741950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535174331780222:2378], now have 1 active actors on pipe
2025-10-02T08:15:48.741956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:48.741959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:48.741961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:48.741964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:48.741966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:48.741989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535173872409669:7991]
2025-10-02T08:15:48.741992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2491
2025-10-02T08:15:48.741995Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:48.741998Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:48.742000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.742003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.742029Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:48.742036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.742008Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2491
2025-10-02T08:15:48.742039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.742040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:48.742045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.742051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:48.742069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.742097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.742102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.742111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.742134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2492 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0
2025-10-02T08:15:48.742443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708811dc-2557695f-5accd150-3b514c0b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:48.744864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0] Write session: try to update token
2025-10-02T08:15:48.744876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:48.758047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId: src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:48.759371Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:48.759384Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:48.759385Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:48.759391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535173872409669:7991]
2025-10-02T08:15:48.759394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535173872409669:7991]
2025-10-02T08:15:48.759423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:48.759428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.759429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:48.759430Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:48.759436Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:48.759549Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:48.760764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:48.825432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535173872409739:14175]
2025-10-02T08:15:48.825511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2491, pipe: [1:7556535173872409739:14175]
2025-10-02T08:15:48.887136Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:48.887424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.887435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.887472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409739:14175], now have 1 active actors on pipe
2025-10-02T08:15:48.887604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535173872409739:14175]
2025-10-02T08:15:48.887631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:48.887634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:48.887640Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:48.887694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2492 reason: error at write: Disconnected sessionId: src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0
2025-10-02T08:15:48.887724Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:48.887894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2492 sessionId: src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0 is DEAD
2025-10-02T08:15:48.888023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:48.888032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0] Write session will restart in 0.008933s
2025-10-02T08:15:48.888057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0] Write session: Do CDS request
2025-10-02T08:15:48.888064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:48.893016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:48.893791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:48.893970Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:48.893984Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:48.893993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:48.894039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:48.894082Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535173872409835:7083]
2025-10-02T08:15:48.894688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:48.894871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:48.894912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:48.895202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:48.895245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.895251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.895252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.895253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.895254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.895259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.895271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.895279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.895283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.895291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.895296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.895307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:48.895314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.895323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:48.895327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.895336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:48.895340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.895346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.895355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.895363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.895385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:48.898221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.898274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:48.898286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2493
2025-10-02T08:15:48.898431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:48.898467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:48.898475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:48.898478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:48.898825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2493 sessionId:  describe result for acl check
2025-10-02T08:15:48.898866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:48.898872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:48.898873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:48.898880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535173872409851:8016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:48.899352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535173872409851:8016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:48.901758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535173872409851:8016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:48.903151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:48.904543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535173872409851:8016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:48.904552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535173872409851:8016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:48.904555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535173872409851:8016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:48.904559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:48.904704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:48.904722Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:48.904725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:48.904729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:48.904735Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2492 [1:7556535173872409835:7083]
2025-10-02T08:15:48.904750Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:48.904771Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:48.904777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.904780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.904782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.904796Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:48.904855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:48.904866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:48.904929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.904935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.904942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:48.904944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:48.905010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:48.905016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.905023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2492
2025-10-02T08:15:48.905028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:48.905039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:48.905060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409896:8016], now have 1 active actors on pipe
2025-10-02T08:15:48.905075Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2492
2025-10-02T08:15:48.905073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535174331780243:2378], now have 1 active actors on pipe
2025-10-02T08:15:48.905078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.905081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.905096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535173872409829:7083]
2025-10-02T08:15:48.905098Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535173872409829:7083]
2025-10-02T08:15:48.905104Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:48.905113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:48.905115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:48.905116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:48.905129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:48.905132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:48.905145Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:48.905151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:48.905153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:48.905155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:48.905162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:48.905169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:48.905202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535173872409829:7083]
2025-10-02T08:15:48.905212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:48.905218Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:48.905224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.905306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:48.905316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:48.905340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:48.905374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2493 partition: 0 MaxSeqNo: 17 sessionId: src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0
2025-10-02T08:15:48.905670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2e55b-8edd0c4a-52c3a3c1-52609720_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:48.908005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0] Write session: try to update token
2025-10-02T08:15:48.908017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:48.922734Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:48.922756Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:48.922759Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:48.922767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535173872409829:7083]
2025-10-02T08:15:48.922770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535173872409829:7083]
2025-10-02T08:15:48.922807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:48.922815Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:48.922818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:48.922820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:48.922831Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:48.922940Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:48.926175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId: src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:48.928643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:48.987702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535173872409910:14175]
2025-10-02T08:15:48.987825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2492, pipe: [1:7556535173872409910:14175]
2025-10-02T08:15:49.050651Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:49.051036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.051048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.051079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535173872409910:14175], now have 1 active actors on pipe
2025-10-02T08:15:49.051195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:49.051205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:49.051254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2493 reason: error at write: Disconnected sessionId: src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0
2025-10-02T08:15:49.051335Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:49.051361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:49.051401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2493 sessionId: src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0 is DEAD
2025-10-02T08:15:49.051556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:49.051550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535173872409910:14175]
2025-10-02T08:15:49.051566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0] Write session will restart in 0.005673s
2025-10-02T08:15:49.051587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0] Write session: Do CDS request
2025-10-02T08:15:49.051591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:49.058331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.058433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:49.058455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:49.058461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2494
2025-10-02T08:15:49.058589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.058622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:49.058628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:49.058631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:49.059021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2494 sessionId:  describe result for acl check
2025-10-02T08:15:49.059055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:49.059060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:49.059061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:49.059066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535178167377301:8054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:49.059207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:49.059376Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:49.059386Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:49.059396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:49.059469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:49.059504Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535178167377303:8041]
2025-10-02T08:15:49.059509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535178167377301:8054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:49.060030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:49.060233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:49.060266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:49.060534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:49.060581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.060586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.060587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.060588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.060589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.060593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.060601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.060604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.060607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.060611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.060615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.060621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.060626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.060631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.060635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.060639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.060643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.060648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.060652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.060656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.060673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:49.061280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535178167377301:8054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:49.067135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535178167377301:8054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:49.067148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535178167377301:8054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:49.067151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535178167377301:8054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:49.067158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:49.069656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:49.071211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:49.071226Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:49.071228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:49.071232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:49.071238Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2493 [1:7556535178167377303:8041]
2025-10-02T08:15:49.071248Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:49.071264Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:49.071267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.071270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.071272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.071289Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:49.071295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:49.071301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:49.071363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.071370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.071374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:49.071377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:49.071441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:49.071447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.071460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.071473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:49.071495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167377350:8054], now have 1 active actors on pipe
2025-10-02T08:15:49.071501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535178167377294:8041]
2025-10-02T08:15:49.071503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535178167377294:8041]
2025-10-02T08:15:49.071509Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:49.071516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535178626747545:2378], now have 1 active actors on pipe
2025-10-02T08:15:49.071520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2493
2025-10-02T08:15:49.071521Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:49.071523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:49.071524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:49.071536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:49.071539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:49.071544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.071548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.071585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535178167377294:8041]
2025-10-02T08:15:49.071588Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:49.071589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2493
2025-10-02T08:15:49.071601Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2262d2b9-2078c234-c3650caf-e306e87c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:49.071616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:49.071619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.071622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.071625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:49.071632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.071641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:49.071676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.071745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.071747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.071758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.071791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2494 partition: 0 MaxSeqNo: 17 sessionId: src_id|2262d2b9-2078c234-c3650caf-e306e87c_0
2025-10-02T08:15:49.072141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f7a40c-7cd859d3-74326ed6-2092d135_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2262d2b9-2078c234-c3650caf-e306e87c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:49.074633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2262d2b9-2078c234-c3650caf-e306e87c_0] Write session: try to update token
2025-10-02T08:15:49.074647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2262d2b9-2078c234-c3650caf-e306e87c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:49.088082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId: src_id|2262d2b9-2078c234-c3650caf-e306e87c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:49.090442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:49.090504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.090519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.090552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:49.090576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:49.090620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.090635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.090804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.090865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.090929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.091003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.091296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.091308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.091382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.091438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.091498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.091567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.091612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.091620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.091685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.091744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.091800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.091860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.091914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.091922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.091983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.092043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.092107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.092181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.092240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.092247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.092308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.092367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.092423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.092486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.092531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.092539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.092602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.092657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.092715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.092777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.092838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.092846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.092909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.092969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.093035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.093096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.093138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.093145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.093208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.093272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.093332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.093393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.093437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.093443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.093506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.093566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.093631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.093694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.093740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.093747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.093810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:49.093870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:49.093930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:49.093994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:49.094046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:49.094053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:49.094091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:49.094163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.094188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.094191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:49.094223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:49.094241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:49.094249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:49.094253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:49.094256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:49.094620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:49.094649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:49.094655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:49.094657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:49.094660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:49.094663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:49.095404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:49.095426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:49.095432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:49.095435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:49.095439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:49.095442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:49.095880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:49.095901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:49.095907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:49.095910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:49.095914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:49.101780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:49.101803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:49.101816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392949101
2025-10-02T08:15:49.101925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:49.101940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:49.101946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:49.101949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:49.101954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:49.101957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:49.102425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:49.102444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:49.102448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:49.102450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:49.102452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:49.102457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:49.102855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:49.102871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:49.102878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:49.102882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:49.102884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:49.102890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:49.103295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:49.103313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:49.103317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:49.104322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:49.104337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:49.104343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:49.104346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:49.104352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392949103
2025-10-02T08:15:49.104600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:49.104619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:49.104623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:49.104626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:49.104628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:49.104631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:49.105090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:49.105111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:49.105116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:49.105124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:49.105127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:49.105133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:49.105573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:49.105590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.105678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392949105
2025-10-02T08:15:49.106403Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:49.106422Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:49.106429Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:49.106435Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:49.108652Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:49.108665Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:49.108666Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:49.108676Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535178167377294:8041]
2025-10-02T08:15:49.108679Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535178167377294:8041]
2025-10-02T08:15:49.108707Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:49.108715Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:49.108717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535178167377294:8041]
2025-10-02T08:15:49.108735Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:49.108740Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:49.108745Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:49.108756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:49.108759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.108760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:49.108899Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:49.151561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535178167377373:14175]
2025-10-02T08:15:49.151671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2493, pipe: [1:7556535178167377373:14175]
2025-10-02T08:15:49.241558Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:49.241899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167377373:14175], now have 1 active actors on pipe
2025-10-02T08:15:49.242025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535178167377373:14175]
2025-10-02T08:15:49.242050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:49.242057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:49.242086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2494 reason: error at write: Disconnected sessionId: src_id|2262d2b9-2078c234-c3650caf-e306e87c_0
2025-10-02T08:15:49.242103Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:49.242172Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:49.242260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2494 sessionId: src_id|2262d2b9-2078c234-c3650caf-e306e87c_0 is DEAD
2025-10-02T08:15:49.242590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262d2b9-2078c234-c3650caf-e306e87c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:49.242599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262d2b9-2078c234-c3650caf-e306e87c_0] Write session will restart in 0.009660s
2025-10-02T08:15:49.242614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262d2b9-2078c234-c3650caf-e306e87c_0] Write session: Do CDS request
2025-10-02T08:15:49.242619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262d2b9-2078c234-c3650caf-e306e87c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:49.248662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:49.249350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:49.249587Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:49.249594Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:49.249603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:49.249649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:49.249678Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535178167377472:8051]
2025-10-02T08:15:49.250092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:49.250263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:49.250303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:49.250543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:49.250580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.250584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.250584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.250585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.250587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.250590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.250596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.250598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.250600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.250601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.250605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.250609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.250612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.250615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.250617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.250620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.250622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.250625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.250628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.250631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.250641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:49.253210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2262d2b9-2078c234-c3650caf-e306e87c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.253277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:49.253286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2495
2025-10-02T08:15:49.253408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.253436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:49.253444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:49.253448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:49.253808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2495 sessionId:  describe result for acl check
2025-10-02T08:15:49.253840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:49.253845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:49.253847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:49.253852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535178167377488:8061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:49.254393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535178167377488:8061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:49.256360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535178167377488:8061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:49.258859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535178167377488:8061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:49.258869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535178167377488:8061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:49.258871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535178167377488:8061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:49.258877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:49.259187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:49.260570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:49.260585Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:49.260586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:49.260588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:49.260592Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2494 [1:7556535178167377472:8051]
2025-10-02T08:15:49.260600Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:49.260610Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:49.260612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.260614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.260616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.260627Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:49.260630Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:49.260634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:49.260680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.260685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.260687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:49.260688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:49.260730Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:49.260735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.260742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.260753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:49.260775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167377520:8061], now have 1 active actors on pipe
2025-10-02T08:15:49.260784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535178167377466:8051]
2025-10-02T08:15:49.260784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2494
2025-10-02T08:15:49.260790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535178167377466:8051]
2025-10-02T08:15:49.260797Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:49.260813Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:49.260817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:49.260819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535178626747554:2378], now have 1 active actors on pipe
2025-10-02T08:15:49.260826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:49.260841Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:49.260847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:49.260853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.260857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.260895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535178167377466:8051]
2025-10-02T08:15:49.260908Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:49.260912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:49.260923Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:49.260904Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2494
2025-10-02T08:15:49.260927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.260930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.260931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:49.260936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.260943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:49.260970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.261016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.261020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.261029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.261050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2495 partition: 0 MaxSeqNo: 17 sessionId: src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0
2025-10-02T08:15:49.261332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2262d2b9-2078c234-c3650caf-e306e87c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:49.263696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0] Write session: try to update token
2025-10-02T08:15:49.263710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:49.276518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId: src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:49.278823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:49.280231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.280251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.280277Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:49.280280Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:49.280282Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:49.280289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535178167377466:8051]
2025-10-02T08:15:49.280297Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535178167377466:8051]
2025-10-02T08:15:49.280338Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:49.280345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:49.280351Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:49.280352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.280354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:49.280480Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:49.342020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535178167377534:14175]
2025-10-02T08:15:49.342111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2494, pipe: [1:7556535178167377534:14175]
2025-10-02T08:15:49.405759Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:49.406102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:49.406137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167377534:14175], now have 1 active actors on pipe
2025-10-02T08:15:49.406162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:49.406204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:49.406210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:49.406246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2495 reason: error at write: Disconnected sessionId: src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0
2025-10-02T08:15:49.406301Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:49.406327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2495 sessionId: src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0 is DEAD
2025-10-02T08:15:49.406432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:49.406457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0] Write session will restart in 0.007616s
2025-10-02T08:15:49.406478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0] Write session: Do CDS request
2025-10-02T08:15:49.406483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:49.406723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535178167377534:14175]
2025-10-02T08:15:49.411800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:49.412535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:49.412682Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:49.412689Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:49.412697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:49.412736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:49.412773Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535178167377646:8090]
2025-10-02T08:15:49.413354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:49.413568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:49.413603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:49.413814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:49.413850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.413855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.413856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.413857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.413858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.413862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.413871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.413874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.413880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.413882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.413886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.413890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.413897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.413900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.413906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.413909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.413911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.413914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.413916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.413918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.413933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:49.415210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.415281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:49.415293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2496
2025-10-02T08:15:49.415366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.415386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:49.415393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:49.415396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:49.415695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2496 sessionId:  describe result for acl check
2025-10-02T08:15:49.415718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:49.415724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:49.415725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:49.415729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535178167377662:8101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:49.416060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535178167377662:8101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:49.418326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535178167377662:8101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:49.421112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535178167377662:8101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:49.421124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535178167377662:8101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:49.421127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535178167377662:8101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:49.421134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:49.421889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:49.423218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:49.423231Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:49.423232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:49.423234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:49.423238Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2495 [1:7556535178167377646:8090]
2025-10-02T08:15:49.423245Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:49.423256Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:49.423257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.423259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.423261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.423272Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:49.423275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:49.423279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:49.423318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.423324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.423326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:49.423328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:49.423377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:49.423384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.423395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.423406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:49.423405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2495
2025-10-02T08:15:49.423426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167377710:8101], now have 1 active actors on pipe
2025-10-02T08:15:49.423432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535178626747574:2378], now have 1 active actors on pipe
2025-10-02T08:15:49.423436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.423439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.423452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535178167377640:8090]
2025-10-02T08:15:49.423456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535178167377640:8090]
2025-10-02T08:15:49.423461Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:49.423472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:49.423487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:49.423466Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2495
2025-10-02T08:15:49.423493Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:49.423493Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:49.423496Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:49.423506Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4398f497-4696f3-71d2432-3aa35d93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:49.423512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.423514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.423515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:49.423522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.423530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:49.423594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535178167377640:8090]
2025-10-02T08:15:49.423603Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:49.423611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.423614Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:49.423664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.423679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.423700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.423740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2496 partition: 0 MaxSeqNo: 17 sessionId: src_id|4398f497-4696f3-71d2432-3aa35d93_0
2025-10-02T08:15:49.424060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3729993-9431e9c7-ffd042f9-c18c9154_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4398f497-4696f3-71d2432-3aa35d93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:49.426696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4398f497-4696f3-71d2432-3aa35d93_0] Write session: try to update token
2025-10-02T08:15:49.426711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4398f497-4696f3-71d2432-3aa35d93_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:49.438506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId: src_id|4398f497-4696f3-71d2432-3aa35d93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:49.440369Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:49.440387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:49.440389Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:49.440397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535178167377640:8090]
2025-10-02T08:15:49.440401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535178167377640:8090]
2025-10-02T08:15:49.440443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:49.440445Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:49.440450Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:49.440456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.440459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:49.440633Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:49.440989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:49.506892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535178167377733:14175]
2025-10-02T08:15:49.507024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2495, pipe: [1:7556535178167377733:14175]
2025-10-02T08:15:49.582643Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:49.583051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.583062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.583093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167377733:14175], now have 1 active actors on pipe
2025-10-02T08:15:49.583205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:49.583217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:49.583280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2496 reason: error at write: Disconnected sessionId: src_id|4398f497-4696f3-71d2432-3aa35d93_0
2025-10-02T08:15:49.583437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2496 sessionId: src_id|4398f497-4696f3-71d2432-3aa35d93_0 is DEAD
2025-10-02T08:15:49.583440Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:49.583557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4398f497-4696f3-71d2432-3aa35d93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:49.583568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4398f497-4696f3-71d2432-3aa35d93_0] Write session will restart in 0.008463s
2025-10-02T08:15:49.583609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4398f497-4696f3-71d2432-3aa35d93_0] Write session: Do CDS request
2025-10-02T08:15:49.583615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4398f497-4696f3-71d2432-3aa35d93_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:49.583621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535178167377733:14175]
2025-10-02T08:15:49.583665Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:49.588810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:49.589427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:49.589579Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:49.589588Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:49.589597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:49.589637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:49.589709Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535178167377839:8171]
2025-10-02T08:15:49.590218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:49.590374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:49.590411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:49.590604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:49.590631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.590635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.590636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.590636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.590637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.590640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.590646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.590647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.590651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.590652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.590656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.590660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.590663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.590667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.590669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.590671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.590673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.590675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.590677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.590680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.590689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:49.593163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4398f497-4696f3-71d2432-3aa35d93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.593219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:49.593229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2497
2025-10-02T08:15:49.593394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.593423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:49.593431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:49.593433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:49.593820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2497 sessionId:  describe result for acl check
2025-10-02T08:15:49.593853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:49.593860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:49.593861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:49.593865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535178167377855:8194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:49.594337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535178167377855:8194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:49.596188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535178167377855:8194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:49.598428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:49.598646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535178167377855:8194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:49.598656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535178167377855:8194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:49.598658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535178167377855:8194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:49.598663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:49.599823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:49.599836Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:49.599838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:49.599842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:49.599847Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2496 [1:7556535178167377839:8171]
2025-10-02T08:15:49.599856Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:49.599868Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:49.599871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.599874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.599876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.599889Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:49.599893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:49.599899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:49.599940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.599947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.599949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:49.599950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:49.600005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:49.600011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.600022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.600033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:49.600040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2496
2025-10-02T08:15:49.600055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167377886:8194], now have 1 active actors on pipe
2025-10-02T08:15:49.600065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535178167377833:8171]
2025-10-02T08:15:49.600067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535178167377833:8171]
2025-10-02T08:15:49.600074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:49.600088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:49.600088Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:49.600091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:49.600099Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:49.600101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:49.600105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535178626747590:2378], now have 1 active actors on pipe
2025-10-02T08:15:49.600118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.600120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.600145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535178167377833:8171]
2025-10-02T08:15:49.600154Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:49.600164Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:49.600164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:49.600171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.600174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.600175Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:49.600181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.600187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:49.600175Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2496
2025-10-02T08:15:49.600212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.600249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.600257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.600269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.600292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2497 partition: 0 MaxSeqNo: 17 sessionId: src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0
2025-10-02T08:15:49.600536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4398f497-4696f3-71d2432-3aa35d93_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:49.602911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0] Write session: try to update token
2025-10-02T08:15:49.602923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:49.615417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId: src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:49.617711Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:49.617728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:49.617730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:49.617738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535178167377833:8171]
2025-10-02T08:15:49.617742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535178167377833:8171]
2025-10-02T08:15:49.617771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:49.617775Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:49.617782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:49.617784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:49.617787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.617789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:49.617916Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:49.683509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535178167377900:14175]
2025-10-02T08:15:49.683655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2496, pipe: [1:7556535178167377900:14175]
2025-10-02T08:15:49.746837Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:49.747105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.747115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.747145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167377900:14175], now have 1 active actors on pipe
2025-10-02T08:15:49.747243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:49.747248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:49.747288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2497 reason: error at write: Disconnected sessionId: src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0
2025-10-02T08:15:49.747379Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:49.747454Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:49.747444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2497 sessionId: src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0 is DEAD
2025-10-02T08:15:49.747577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535178167377900:14175]
2025-10-02T08:15:49.747614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:49.747623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0] Write session will restart in 0.008721s
2025-10-02T08:15:49.747642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0] Write session: Do CDS request
2025-10-02T08:15:49.747646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:49.752614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:49.753408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:49.753604Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:49.753613Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:49.753621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:49.753670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:49.753705Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535178167378007:8209]
2025-10-02T08:15:49.754311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:49.754502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:49.754560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:49.754869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:49.754938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.754946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.754948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.754951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.754952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.754956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.754965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.754968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.754971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.754973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.754979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.754998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.755007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.755011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.755015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.755020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.755024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.755028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.755037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.755042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.755058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:49.757212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.757277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:49.757287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2498
2025-10-02T08:15:49.757386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.757407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:49.757414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:49.757417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:49.757715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2498 sessionId:  describe result for acl check
2025-10-02T08:15:49.757737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:49.757738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:49.757739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:49.757742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535178167378023:8213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:49.758101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535178167378023:8213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:49.760173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535178167378023:8213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:49.763641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535178167378023:8213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:49.763654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535178167378023:8213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:49.763657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535178167378023:8213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:49.763665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:49.764043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:49.765494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:49.765507Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:49.765508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:49.765512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:49.765516Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2497 [1:7556535178167378007:8209]
2025-10-02T08:15:49.765525Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:49.765537Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:49.765539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.765541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.765542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.765553Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:49.765558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:49.765562Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:49.765603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.765608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.765610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:49.765611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:49.765661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:49.765668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.765678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.765693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:49.765712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167378054:8213], now have 1 active actors on pipe
2025-10-02T08:15:49.765718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535178626747596:2378], now have 1 active actors on pipe
2025-10-02T08:15:49.765724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535178167378001:8209]
2025-10-02T08:15:49.765724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2497
2025-10-02T08:15:49.765726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535178167378001:8209]
2025-10-02T08:15:49.765733Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:49.765743Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:49.765743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.765747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.765750Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:49.765760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:49.765772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:49.765780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:49.765791Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2497
2025-10-02T08:15:49.765812Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:49.765820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.765823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.765825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:49.765833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.765843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:49.765852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535178167378001:8209]
2025-10-02T08:15:49.765858Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:49.765888Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:49.765890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.765918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.765924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.765934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.765968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2498 partition: 0 MaxSeqNo: 17 sessionId: src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0
2025-10-02T08:15:49.766278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffca546-ef7c8787-a6981ce0-2f17082c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:49.768785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0] Write session: try to update token
2025-10-02T08:15:49.768798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:49.782174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId: src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:49.785155Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:49.785175Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:49.785177Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:49.785185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535178167378001:8209]
2025-10-02T08:15:49.785189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535178167378001:8209]
2025-10-02T08:15:49.785242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:49.785243Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:49.785249Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:49.785255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.785257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:49.785440Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:49.785494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:49.847873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535178167378070:14175]
2025-10-02T08:15:49.847967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2497, pipe: [1:7556535178167378070:14175]
2025-10-02T08:15:49.907455Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:49.907693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.907707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.907741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167378070:14175], now have 1 active actors on pipe
2025-10-02T08:15:49.907829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535178167378070:14175]
2025-10-02T08:15:49.907849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:49.907855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:49.907900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2498 reason: error at write: Disconnected sessionId: src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0
2025-10-02T08:15:49.907934Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:49.907956Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:49.908077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2498 sessionId: src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0 is DEAD
2025-10-02T08:15:49.908203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:49.908223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0] Write session will restart in 0.009072s
2025-10-02T08:15:49.908246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0] Write session: Do CDS request
2025-10-02T08:15:49.908252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:49.913918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:49.914734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:49.914914Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:49.914923Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:49.914932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:49.914985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:49.915023Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535178167378188:8256]
2025-10-02T08:15:49.915599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:49.915809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:49.915850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:49.916083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:49.916132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.916137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.916138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.916139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.916139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.916143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.916149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.916151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.916153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.916155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.916160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.916165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:49.916168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.916171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:49.916174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.916176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:49.916178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.916181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.916183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.916186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.916198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:49.918238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.918308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:49.918320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2499
2025-10-02T08:15:49.918432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:49.918459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:49.918468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:49.918477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:49.918822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2499 sessionId:  describe result for acl check
2025-10-02T08:15:49.918856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:49.918861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:49.918863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:49.918868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535178167378204:8275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:49.919341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535178167378204:8275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:49.921480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535178167378204:8275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:49.923929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535178167378204:8275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:49.923938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535178167378204:8275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:49.923941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535178167378204:8275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:49.923947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:49.923983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:49.925496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:49.925512Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:49.925514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:49.925517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:49.925522Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2498 [1:7556535178167378188:8256]
2025-10-02T08:15:49.925535Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:49.925550Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:49.925552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.925554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.925557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.925567Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:49.925569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:49.925574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:49.925618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.925625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.925629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:49.925631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:49.925693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:49.925700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.925711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:49.925721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:49.925727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2498
2025-10-02T08:15:49.925737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535178167378236:8275], now have 1 active actors on pipe
2025-10-02T08:15:49.925740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535178626747616:2378], now have 1 active actors on pipe
2025-10-02T08:15:49.925744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.925747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.925763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535178167378182:8256]
2025-10-02T08:15:49.925765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535178167378182:8256]
2025-10-02T08:15:49.925776Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:49.925787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:49.925790Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:49.925795Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:49.925801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:49.925803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:49.925816Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:49.925821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:49.925824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:49.925826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:49.925832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:49.925838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:49.925818Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2498
2025-10-02T08:15:49.925867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535178167378182:8256]
2025-10-02T08:15:49.925879Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:49.925891Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:49.925894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.925932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.925934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.925944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:49.925972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2499 partition: 0 MaxSeqNo: 17 sessionId: src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0
2025-10-02T08:15:49.926244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa64cdcf-2803b6ba-1f9b616f-91799eb8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:49.928608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0] Write session: try to update token
2025-10-02T08:15:49.928620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:49.940304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId: src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:49.942997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:49.943851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:49.943869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:49.943885Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:49.943887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:49.943888Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:49.943894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535178167378182:8256]
2025-10-02T08:15:49.943897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535178167378182:8256]
2025-10-02T08:15:49.943946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:49.943946Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:49.943952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:49.943955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:49.943957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:49.944072Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:50.008141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535182462345546:14175]
2025-10-02T08:15:50.008276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2498, pipe: [1:7556535182462345546:14175]
2025-10-02T08:15:50.072073Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:50.072519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:50.072557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:50.072559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462345546:14175], now have 1 active actors on pipe
2025-10-02T08:15:50.072668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:50.072677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:50.072696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2499 reason: error at write: Disconnected sessionId: src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0
2025-10-02T08:15:50.072780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:50.072903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2499 sessionId: src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0 is DEAD
2025-10-02T08:15:50.073031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:50.073042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0] Write session will restart in 0.006543s
2025-10-02T08:15:50.073032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535182462345546:14175]
2025-10-02T08:15:50.073065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0] Write session: Do CDS request
2025-10-02T08:15:50.073073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:50.079089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:50.079688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:50.079862Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:50.079874Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:50.079886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:50.079945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:50.080009Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535182462345653:8314]
2025-10-02T08:15:50.080212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.080317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:50.080327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2500
2025-10-02T08:15:50.080413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.080431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:50.080437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:50.080440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:50.080569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:50.080688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2500 sessionId:  describe result for acl check
2025-10-02T08:15:50.080709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:50.080713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:50.080715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:50.080718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535182462345662:8332] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:50.080739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:50.080774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:50.081036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:50.081068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535182462345662:8332] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:50.081070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.081071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.081072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.081073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.081074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.081077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.081085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.081088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.081091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.081093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.081098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.081103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.081108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.081113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.081116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.081119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.081123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.081127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.081131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.081134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.081149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:50.083083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535182462345662:8332] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:50.088418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535182462345662:8332] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:50.088432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535182462345662:8332] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:50.088436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535182462345662:8332] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:50.088444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:50.088874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:50.090275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:50.090287Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:50.090288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:50.090291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:50.090295Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2499 [1:7556535182462345653:8314]
2025-10-02T08:15:50.090302Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:50.090314Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:50.090316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.090319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.090320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.090331Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:50.090334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:50.090339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:50.090378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.090384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.090387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:50.090389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:50.090434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:50.090440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.090446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.090453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:50.090464Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535182462345647:8314]
2025-10-02T08:15:50.090469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535182462345647:8314]
2025-10-02T08:15:50.090474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:50.090482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462345701:8332], now have 1 active actors on pipe
2025-10-02T08:15:50.090485Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:50.090489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:50.090492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:50.090493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2499
2025-10-02T08:15:50.090500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:50.090502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:50.090505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535182921714919:2378], now have 1 active actors on pipe
2025-10-02T08:15:50.090525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.090531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.090541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535182462345647:8314]
2025-10-02T08:15:50.090547Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:50.090564Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9295776c-e18c62de-5f053d6d-98136ec7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:50.090570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:50.090571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.090574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.090575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:50.090582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.090546Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2499
2025-10-02T08:15:50.090588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:50.090604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.090639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.090651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.090673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.090713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2500 partition: 0 MaxSeqNo: 17 sessionId: src_id|9295776c-e18c62de-5f053d6d-98136ec7_0
2025-10-02T08:15:50.091014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fe604d-548566a3-eded2c4f-c40d96b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9295776c-e18c62de-5f053d6d-98136ec7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:50.093593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9295776c-e18c62de-5f053d6d-98136ec7_0] Write session: try to update token
2025-10-02T08:15:50.093608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9295776c-e18c62de-5f053d6d-98136ec7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:50.107150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId: src_id|9295776c-e18c62de-5f053d6d-98136ec7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:50.108900Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:50.108913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:50.108915Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:50.108923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535182462345647:8314]
2025-10-02T08:15:50.108926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535182462345647:8314]
2025-10-02T08:15:50.108957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:50.108961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.108963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:50.108990Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:50.109004Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:50.109096Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:50.109407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:50.172995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535182462345717:14175]
2025-10-02T08:15:50.173093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2499, pipe: [1:7556535182462345717:14175]
2025-10-02T08:15:50.236459Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:50.236697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.236708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.236745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462345717:14175], now have 1 active actors on pipe
2025-10-02T08:15:50.236891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535182462345717:14175]
2025-10-02T08:15:50.236920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:50.236923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:50.236951Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:50.236996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2500 reason: error at write: Disconnected sessionId: src_id|9295776c-e18c62de-5f053d6d-98136ec7_0
2025-10-02T08:15:50.236991Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:50.237174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2500 sessionId: src_id|9295776c-e18c62de-5f053d6d-98136ec7_0 is DEAD
2025-10-02T08:15:50.237313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9295776c-e18c62de-5f053d6d-98136ec7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:50.237325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9295776c-e18c62de-5f053d6d-98136ec7_0] Write session will restart in 0.006350s
2025-10-02T08:15:50.237346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9295776c-e18c62de-5f053d6d-98136ec7_0] Write session: Do CDS request
2025-10-02T08:15:50.237351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9295776c-e18c62de-5f053d6d-98136ec7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:50.243641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:50.244141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:50.244293Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:50.244302Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:50.244312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:50.244362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:50.244402Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535182462345826:8339]
2025-10-02T08:15:50.245001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:50.245235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9295776c-e18c62de-5f053d6d-98136ec7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.245228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:50.245282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:50.245325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:50.245337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2501
2025-10-02T08:15:50.245417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.245436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:50.245443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:50.245446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:50.245519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:50.245549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.245553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.245554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.245554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.245555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.245558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.245564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.245566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.245567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.245569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.245573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.245577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.245581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.245584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.245586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.245589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.245591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.245595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.245601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.245603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.245629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:50.245706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2501 sessionId:  describe result for acl check
2025-10-02T08:15:50.245726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:50.245730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:50.245732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:50.245736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535182462345840:8346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:50.246094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535182462345840:8346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:50.247875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535182462345840:8346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:50.252764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535182462345840:8346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:50.252786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535182462345840:8346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:50.252789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535182462345840:8346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:50.252794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:50.253325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:50.254691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:50.254702Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:50.254704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:50.254707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:50.254710Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2500 [1:7556535182462345826:8339]
2025-10-02T08:15:50.254717Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:50.254729Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:50.254731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.254733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.254734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.254745Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:50.254748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:50.254753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:50.254793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.254802Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.254804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:50.254806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:50.254851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:50.254853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.254861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.254867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:50.254879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535182462345820:8339]
2025-10-02T08:15:50.254880Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535182462345820:8339]
2025-10-02T08:15:50.254885Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:50.254896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:50.254909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:50.254910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:50.254922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:50.254928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2500
2025-10-02T08:15:50.254932Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:50.254935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462345874:8346], now have 1 active actors on pipe
2025-10-02T08:15:50.254937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535182462345820:8339]
2025-10-02T08:15:50.254939Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:50.254942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535182921714928:2378], now have 1 active actors on pipe
2025-10-02T08:15:50.254943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:50.254944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.254947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.254973Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:50.254980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.254983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.254985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:50.254990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.254996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:50.255009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.254999Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2500
2025-10-02T08:15:50.255059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.255068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.255094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.255125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2501 partition: 0 MaxSeqNo: 17 sessionId: src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0
2025-10-02T08:15:50.255394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9295776c-e18c62de-5f053d6d-98136ec7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:50.257693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0] Write session: try to update token
2025-10-02T08:15:50.257705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:50.270018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId: src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:50.272289Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:50.272304Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:50.272306Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:50.272312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535182462345820:8339]
2025-10-02T08:15:50.272316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535182462345820:8339]
2025-10-02T08:15:50.272334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:50.272348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:50.272355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.272357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:50.272357Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:50.272363Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:50.272502Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:50.336878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535182462345888:14175]
2025-10-02T08:15:50.336982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2500, pipe: [1:7556535182462345888:14175]
2025-10-02T08:15:50.396351Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:50.396603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.396614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.396644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462345888:14175], now have 1 active actors on pipe
2025-10-02T08:15:50.396744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:50.396750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535182462345888:14175]
2025-10-02T08:15:50.396753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:50.396823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2501 reason: error at write: Disconnected sessionId: src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0
2025-10-02T08:15:50.396898Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:50.396883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:50.396979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2501 sessionId: src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0 is DEAD
2025-10-02T08:15:50.397120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:50.397128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0] Write session will restart in 0.006337s
2025-10-02T08:15:50.397153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0] Write session: Do CDS request
2025-10-02T08:15:50.397158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:50.402699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:50.403493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:50.403652Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:50.403659Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:50.403667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:50.403707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:50.403744Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535182462345998:8351]
2025-10-02T08:15:50.404292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:50.404341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.404434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:50.404443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2502
2025-10-02T08:15:50.404503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:50.404547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:50.404561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.404581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:50.404587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:50.404590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:50.404766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:50.404796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.404818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.404819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.404820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.404822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.404827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.404833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.404835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.404837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.404839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.404843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.404848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.404851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.404854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.404857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.404860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.404864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.404867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.404870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.404873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.404885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:50.404905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2502 sessionId:  describe result for acl check
2025-10-02T08:15:50.404934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:50.404939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:50.404941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:50.404945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535182462346011:8371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:50.405374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535182462346011:8371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:50.407358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535182462346011:8371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:50.412039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535182462346011:8371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:50.412049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535182462346011:8371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:50.412051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535182462346011:8371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:50.412057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:50.412562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:50.413987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:50.413999Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:50.414001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:50.414004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:50.414008Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2501 [1:7556535182462345998:8351]
2025-10-02T08:15:50.414014Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:50.414027Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:50.414029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.414031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.414032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.414044Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:50.414046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:50.414050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:50.414089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.414096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.414098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:50.414099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:50.414153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:50.414159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.414166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.414172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:50.414183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535182462345992:8351]
2025-10-02T08:15:50.414184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535182462345992:8351]
2025-10-02T08:15:50.414189Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:50.414197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462346047:8371], now have 1 active actors on pipe
2025-10-02T08:15:50.414198Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:50.414201Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:50.414208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:50.414220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:50.414223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2501
2025-10-02T08:15:50.414226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:50.414231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535182921714935:2378], now have 1 active actors on pipe
2025-10-02T08:15:50.414257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.414264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.414273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535182462345992:8351]
2025-10-02T08:15:50.414278Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:50.414282Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:50.414262Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2501
2025-10-02T08:15:50.414293Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:50.414301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.414304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.414305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:50.414310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.414317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:50.414342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.414447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.414457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.414475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.414504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2502 partition: 0 MaxSeqNo: 17 sessionId: src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0
2025-10-02T08:15:50.414839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e59b33-3e40cbae-ee16c919-e0f81df2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:50.417365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0] Write session: try to update token
2025-10-02T08:15:50.417378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:50.432102Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:50.432130Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:50.432131Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:50.432137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535182462345992:8351]
2025-10-02T08:15:50.432141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535182462345992:8351]
2025-10-02T08:15:50.432169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:50.432172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:50.432174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.432175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:50.432177Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:50.432310Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:50.448260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId: src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:50.450682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:50.497097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535182462346098:14175]
2025-10-02T08:15:50.497201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2501, pipe: [1:7556535182462346098:14175]
2025-10-02T08:15:50.567995Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:50.568388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.568402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.568422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462346098:14175], now have 1 active actors on pipe
2025-10-02T08:15:50.568515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535182462346098:14175]
2025-10-02T08:15:50.568530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:50.568536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:50.568586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2502 reason: error at write: Disconnected sessionId: src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0
2025-10-02T08:15:50.568589Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:50.568633Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:50.568774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2502 sessionId: src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0 is DEAD
2025-10-02T08:15:50.568782Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:15:50.568923Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 25 consumer shared/user session shared/user_1_25_13456385256805587762_v1 is DEAD
2025-10-02T08:15:50.568951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:50.568959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0] Write session will restart in 0.006424s
2025-10-02T08:15:50.568977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0] Write session: Do CDS request
2025-10-02T08:15:50.568982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:50.568996Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:15:50.569022Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:15:50.569025Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:15:50.569032Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.009912s
2025-10-02T08:15:50.569103Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535100857909004:14172] disconnected; active server actors: 1
2025-10-02T08:15:50.569118Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535100857909004:14172] client user disconnected session shared/user_1_25_13456385256805587762_v1
2025-10-02T08:15:50.574304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:50.575054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:50.575180Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:50.575188Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:50.575194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:50.575224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:50.575300Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535182462346215:8423]
2025-10-02T08:15:50.575710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:50.575945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:50.575998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:50.576337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.576334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:50.576381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.576387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.576388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.576389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.576390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.576396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.576406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.576409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.576413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.576417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.576422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.576429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.576433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.576438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.576447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.576452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.576456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.576461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.576465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.576470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.576489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:50.576490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:50.576495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2503
2025-10-02T08:15:50.576589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.576630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:50.576638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:50.576641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:50.576990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2503 sessionId:  describe result for acl check
2025-10-02T08:15:50.577026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:50.577031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:50.577033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:50.577038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535182462346231:8425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:50.577463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535182462346231:8425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:50.579380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535182462346231:8425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:50.580069Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:15:50.580222Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:15:50.580230Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 26
2025-10-02T08:15:50.580353Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 26 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:15:50.580391Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:15:50.580454Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 auth for : user
2025-10-02T08:15:50.580568Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 Handle describe topics response
2025-10-02T08:15:50.580589Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 auth is DEAD
2025-10-02T08:15:50.580593Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:15:50.580786Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:15:50.580882Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_26_14464304724296252518_v1
2025-10-02T08:15:50.580892Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:15:50.580960Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:15:50.580943Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535182462346263:8439] connected; active server actors: 1
2025-10-02T08:15:50.581046Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:15:50.581060Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556535182462346263:8439] session shared/user_1_26_14464304724296252518_v1
2025-10-02T08:15:50.581076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:15:50.581083Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:15:50.581087Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_26_14464304724296252518_v1" (Sender=[1:7556535182462346260:8439], Pipe=[1:7556535182462346263:8439], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:15:50.581089Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:15:50.581099Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:15:50.581098Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 got read request: guid# 1ed760d5-5311bda4-1681cdc-e90021ca
2025-10-02T08:15:50.581107Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_26_14464304724296252518_v1" (Sender=[1:7556535182462346260:8439], Pipe=[1:7556535182462346263:8439], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:15:50.581120Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_26_14464304724296252518_v1" sender [1:7556535182462346260:8439] lock partition 0 for ReadingSession "shared/user_1_26_14464304724296252518_v1" (Sender=[1:7556535182462346260:8439], Pipe=[1:7556535182462346263:8439], Partitions=[], ActiveFamilyCount=1) generation 1 step 26
2025-10-02T08:15:50.581136Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:15:50.581144Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-10-02T08:15:50.581359Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 26 Session: "shared/user_1_26_14464304724296252518_v1" ClientId: "user" PipeClient { RawX1: 7556535182462346263 RawX2: 4503603922346231 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:15:50.581379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:15:50.583702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535182462346231:8425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:50.583714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535182462346231:8425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:50.583717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535182462346231:8425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:50.583724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:50.584286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:50.585997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:50.586013Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:50.586015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:50.586018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:50.586024Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2502 [1:7556535182462346215:8423]
2025-10-02T08:15:50.586036Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:50.586050Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:50.586051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.586054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.586055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.586066Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:50.586069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:50.586074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:50.586129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.586138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.586140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:50.586142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:50.586190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:50.586197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.586209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.586222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:50.586242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462346270:8425], now have 1 active actors on pipe
2025-10-02T08:15:50.586251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535182462346208:8423]
2025-10-02T08:15:50.586252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535182462346208:8423]
2025-10-02T08:15:50.586257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:50.586262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2502
2025-10-02T08:15:50.586263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462346265:8443], now have 1 active actors on pipe
2025-10-02T08:15:50.586267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535182921714964:2378], now have 1 active actors on pipe
2025-10-02T08:15:50.586267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:50.586270Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:50.586271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:50.586277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:50.586280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:50.586284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.586286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.586286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2502, pipe: [1:7556535182462346265:8443]
2025-10-02T08:15:50.586320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.586324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.586328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_26_14464304724296252518_v1 on pipe: [1:7556535182462346265:8443]
2025-10-02T08:15:50.586342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535182462346208:8423]
2025-10-02T08:15:50.586350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:50.586354Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_26_14464304724296252518_v1:1 with generation 2502
2025-10-02T08:15:50.586342Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2502
2025-10-02T08:15:50.586361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:50.586363Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:50.586367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.586369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.586371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:50.586376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.586382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:50.586397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.586399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.586400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:50.586408Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_26_14464304724296252518_v1
2025-10-02T08:15:50.586410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.586436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.586452Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:50.586526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.586531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.586540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.586570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2503 partition: 0 MaxSeqNo: 17 sessionId: src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0
2025-10-02T08:15:50.586877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b3951a0-1f3db51f-44b7b787-145b7db5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:50.588101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:15:50.588138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:15:50.588146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.588149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.588151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.588158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:15:50.588170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:15:50.588231Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392950586 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:15:50.588246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:15:50.588277Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 sending to client partition status
2025-10-02T08:15:50.589492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0] Write session: try to update token
2025-10-02T08:15:50.589507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:50.602856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId: src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:50.603534Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:50.603551Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:50.603554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:50.603562Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535182462346208:8423]
2025-10-02T08:15:50.603566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535182462346208:8423]
2025-10-02T08:15:50.603603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:50.603610Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:50.603613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.603616Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:50.603616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:50.603748Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:50.605472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:50.737496Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:50.737900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.737912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.738042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535182462346265:8443]
2025-10-02T08:15:50.738059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:50.738060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:50.738106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2503 reason: error at write: Disconnected sessionId: src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0
2025-10-02T08:15:50.738117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_26_14464304724296252518_v1
2025-10-02T08:15:50.738133Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:50.738173Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:50.738259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2503 sessionId: src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0 is DEAD
2025-10-02T08:15:50.738372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:50.738381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0] Write session will restart in 0.008970s
2025-10-02T08:15:50.738399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0] Write session: Do CDS request
2025-10-02T08:15:50.738404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:50.738403Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_26_14464304724296252518_v1
2025-10-02T08:15:50.744355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:50.744862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:50.745052Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:50.745061Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:50.745070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:50.745135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:50.745177Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535182462346404:8444]
2025-10-02T08:15:50.745785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:50.745934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:50.745964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:50.746200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:50.746234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.746238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.746239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.746239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.746240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.746243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.746251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.746255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.746258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.746261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.746266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.746273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.746278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.746283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.746287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.746291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.746298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.746302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.746311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.746316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.746332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:50.748275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.748366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:50.748377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2504
2025-10-02T08:15:50.748464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.748485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:50.748491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:50.748494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:50.748846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2504 sessionId:  describe result for acl check
2025-10-02T08:15:50.748879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:50.748885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:50.748887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:50.748892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535182462346421:8432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:50.749260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535182462346421:8432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:50.751377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535182462346421:8432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:50.753747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:50.753768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535182462346421:8432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:50.753773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535182462346421:8432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:50.753776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535182462346421:8432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:50.753781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:50.755171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:50.755187Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:50.755189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:50.755192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:50.755196Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2503 [1:7556535182462346404:8444]
2025-10-02T08:15:50.755203Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:50.755214Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:50.755216Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.755218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.755220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.755231Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:50.755235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:50.755240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:50.755285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.755292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.755294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:50.755296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:50.755514Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2503
2025-10-02T08:15:50.755355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:50.755366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.755377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.755388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:50.755397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2503
2025-10-02T08:15:50.755405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462346453:8432], now have 1 active actors on pipe
2025-10-02T08:15:50.755407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535182921714971:2378], now have 1 active actors on pipe
2025-10-02T08:15:50.755413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535182462346398:8444]
2025-10-02T08:15:50.755415Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535182462346398:8444]
2025-10-02T08:15:50.755420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:50.755434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:50.755446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:50.755448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:50.755469Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:50.755473Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:50.755475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.755478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.755488Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535182462346398:8444]
2025-10-02T08:15:50.755491Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:50.755503Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:50.755520Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:50.755526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.755529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.755530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:50.755538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.755547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:50.755568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.755610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.755612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.755623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.755651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2504 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0
2025-10-02T08:15:50.755946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a625170b-8b34d6d7-1b1dfb2a-25dbcee_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:50.758753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0] Write session: try to update token
2025-10-02T08:15:50.758768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:50.772382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId: src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:50.773768Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:50.773782Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:50.773785Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:50.773793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535182462346398:8444]
2025-10-02T08:15:50.773797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535182462346398:8444]
2025-10-02T08:15:50.773834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:50.773837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:50.773839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:50.773847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.773849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:50.774015Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:50.774729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:50.838077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535182462346470:8443]
2025-10-02T08:15:50.838174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2503, pipe: [1:7556535182462346470:8443]
2025-10-02T08:15:50.897720Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:50.897975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.897985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.898020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462346470:8443], now have 1 active actors on pipe
2025-10-02T08:15:50.898138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535182462346470:8443]
2025-10-02T08:15:50.898167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:50.898173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:50.898189Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:50.898250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2504 reason: error at write: Disconnected sessionId: src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0
2025-10-02T08:15:50.898237Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:50.898457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2504 sessionId: src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0 is DEAD
2025-10-02T08:15:50.898549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:50.898558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0] Write session will restart in 0.008530s
2025-10-02T08:15:50.898578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0] Write session: Do CDS request
2025-10-02T08:15:50.898583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:50.903621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:50.904349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:50.904545Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:50.904558Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:50.904570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:50.904631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:50.904677Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535182462346587:8487]
2025-10-02T08:15:50.905277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:50.905477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:50.905522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:50.905807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:50.905872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.905878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.905880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.905881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.905882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.905886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.905896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.905900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.905903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.905906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.905912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.905920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:50.905925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.905930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:50.905936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.905941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:50.905945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.905949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.905953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.905958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.905977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:50.908249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.908320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:50.908331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2505
2025-10-02T08:15:50.908443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:50.908470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:50.908474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:50.908477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:50.908787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2505 sessionId:  describe result for acl check
2025-10-02T08:15:50.908828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:50.908834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:50.908835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:50.908838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535182462346616:8510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:50.909143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535182462346616:8510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:50.910901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535182462346616:8510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:50.913195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535182462346616:8510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:50.913207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535182462346616:8510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:50.913210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535182462346616:8510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:50.913216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:50.913748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:50.915199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:50.915211Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:50.915214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:50.915218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:50.915222Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2504 [1:7556535182462346587:8487]
2025-10-02T08:15:50.915229Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:50.915240Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:50.915242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.915243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.915244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.915255Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:50.915257Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:50.915261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:50.915303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.915311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.915312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:50.915315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:50.915360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:50.915365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.915373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:50.915379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:50.915392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462346648:8510], now have 1 active actors on pipe
2025-10-02T08:15:50.915399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535182462346581:8487]
2025-10-02T08:15:50.915400Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535182462346581:8487]
2025-10-02T08:15:50.915406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:50.915412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535182921714992:2378], now have 1 active actors on pipe
2025-10-02T08:15:50.915415Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:50.915418Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:50.915418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:50.915426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:50.915428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:50.915448Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535182462346581:8487]
2025-10-02T08:15:50.915456Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:50.915464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:50.915481Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2504
2025-10-02T08:15:50.915494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2504
2025-10-02T08:15:50.915543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.915548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.915568Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:50.915577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:50.915579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:50.915580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:50.915585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:50.915591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:50.915604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.915631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:50.915640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:50.915659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:50.915689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2505 partition: 0 MaxSeqNo: 17 sessionId: src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0
2025-10-02T08:15:50.915949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d3ef11e-c7b761e4-637cf127-6b60122_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:50.918219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0] Write session: try to update token
2025-10-02T08:15:50.918231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:50.929927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId: src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:50.931590Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:50.931603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:50.931605Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:50.931611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535182462346581:8487]
2025-10-02T08:15:50.931614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535182462346581:8487]
2025-10-02T08:15:50.931647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:50.931655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:50.931654Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:50.931656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:50.931659Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:50.931775Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:50.932549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:50.998319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535182462346663:8443]
2025-10-02T08:15:50.998446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2504, pipe: [1:7556535182462346663:8443]
2025-10-02T08:15:51.059462Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:51.059754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.059764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.059796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535182462346663:8443], now have 1 active actors on pipe
2025-10-02T08:15:51.059883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535182462346663:8443]
2025-10-02T08:15:51.059901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:51.059906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:51.059945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2505 reason: error at write: Disconnected sessionId: src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0
2025-10-02T08:15:51.060025Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:51.060091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2505 sessionId: src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0 is DEAD
2025-10-02T08:15:51.060118Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:51.060285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:51.060300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0] Write session will restart in 0.008189s
2025-10-02T08:15:51.060335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0] Write session: Do CDS request
2025-10-02T08:15:51.060344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:51.066114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:51.066638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:51.066763Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:51.066771Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:51.066777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:51.066808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:51.066838Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535186757314078:8530]
2025-10-02T08:15:51.067291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:51.067479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:51.067538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:51.067859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:51.067907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.067913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.067914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.067915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.067916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.067921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.067932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.067936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.067940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.067946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.067951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.067962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.067968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.067978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.067983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.067988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.067997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.068002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.068011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.068017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.068038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:51.069207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.069240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:51.069253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2506
2025-10-02T08:15:51.069402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.069430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:51.069439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:51.069443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:51.069881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2506 sessionId:  describe result for acl check
2025-10-02T08:15:51.069926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:51.069934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:51.069936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:51.069952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535186757314094:8543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:51.070484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535186757314094:8543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:51.072309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535186757314094:8543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:51.075207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535186757314094:8543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:51.075219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535186757314094:8543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:51.075222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535186757314094:8543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:51.075230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:51.075894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:51.077460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:51.077478Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:51.077480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:51.077484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:51.077491Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2505 [1:7556535186757314078:8530]
2025-10-02T08:15:51.077502Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:51.077519Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:51.077526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.077529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.077531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.077546Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:51.077554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:51.077560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:51.077623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.077629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.077632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:51.077635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:51.077698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:51.077705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.077717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.077731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2505
2025-10-02T08:15:51.077732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:51.077753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314125:8543], now have 1 active actors on pipe
2025-10-02T08:15:51.077760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535187216682295:2378], now have 1 active actors on pipe
2025-10-02T08:15:51.077764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.077768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.077793Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535186757314072:8530]
2025-10-02T08:15:51.077799Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535186757314072:8530]
2025-10-02T08:15:51.077797Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2505
2025-10-02T08:15:51.077807Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:51.077816Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:51.077818Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:51.077822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:51.077836Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:51.077838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:51.077851Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27499516-e049ee95-6a26991b-b908a45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:51.077861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.077868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.077869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:51.077877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.077890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:51.077930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535186757314072:8530]
2025-10-02T08:15:51.077945Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:51.077957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.077960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:51.078009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.078021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.078042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.078079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2506 partition: 0 MaxSeqNo: 17 sessionId: src_id|27499516-e049ee95-6a26991b-b908a45_0
2025-10-02T08:15:51.078366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|635e4e7c-cd68ddd2-292057a4-aea135de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|27499516-e049ee95-6a26991b-b908a45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:51.080745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27499516-e049ee95-6a26991b-b908a45_0] Write session: try to update token
2025-10-02T08:15:51.080755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27499516-e049ee95-6a26991b-b908a45_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:51.088085Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:51.088102Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.088121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535186757314072:8530]
2025-10-02T08:15:51.088158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:51.088162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:51.088977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:51.089113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.089253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.089383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.089821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:51.089868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:51.094192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId: src_id|27499516-e049ee95-6a26991b-b908a45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:51.096363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:51.096425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.096436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.096460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:51.096477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:51.096525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.096539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.096699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.096760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.096833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.096888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.096928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.096937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.097018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.097080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.097141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.097198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.097239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.097244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.097302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.097358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.097412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.097485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.097532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.097540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.097605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.097670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.097729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.097796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.097835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.097841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.097899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.097951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.098009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.098070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.098120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.098126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.098190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.098252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.098315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.098370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.098415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.098422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.098484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.098551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.098617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.098683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.098731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.098738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.098800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.098852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.098918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.098982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.099031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.099036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.099093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.099153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.099215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.099276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.099320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.099327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.099386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.099453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.099524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.099581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.099627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.099636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.099672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:51.099738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.099762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.099769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:51.099799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:51.099814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:51.099822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:51.099825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:51.099831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:51.100218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:51.100240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:51.100250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:51.100257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:51.100261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:51.100264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:51.100848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:51.100874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:51.100881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:51.100883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:51.100886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:51.100889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:51.101353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:51.101374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:51.101379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:51.101386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:51.101389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:51.103489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:51.103506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:51.103518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392951103
2025-10-02T08:15:51.103627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:51.103639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:51.103646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:51.103649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:51.103659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:51.103662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:51.104142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:51.104161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:51.104170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:51.104173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:51.104177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:51.104180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:51.104614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:51.104635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:51.104648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:51.104651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:51.104654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:51.104659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:51.105124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:51.105147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:51.105152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:51.106152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:51.106169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:51.106175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:51.106179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:51.106186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392951105
2025-10-02T08:15:51.106464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:51.106481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:51.106489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:51.106492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:51.106495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:51.106498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:51.106917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:51.106938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:51.106946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:51.106949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:51.106952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:51.106955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:51.107382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:51.107400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.107491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392951107
2025-10-02T08:15:51.110689Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:51.110708Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:51.110714Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:51.110722Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:51.112148Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:51.112162Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.112164Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:51.112175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535186757314072:8530]
2025-10-02T08:15:51.112179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535186757314072:8530]
2025-10-02T08:15:51.112220Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:51.112228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:51.112231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:51.112232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.112234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:51.112354Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:51.160130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535186757314150:8443]
2025-10-02T08:15:51.160233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2505, pipe: [1:7556535186757314150:8443]
2025-10-02T08:15:51.246037Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:51.246351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314150:8443], now have 1 active actors on pipe
2025-10-02T08:15:51.246464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:51.246469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:51.246493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2506 reason: error at write: Disconnected sessionId: src_id|27499516-e049ee95-6a26991b-b908a45_0
2025-10-02T08:15:51.246577Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:51.246638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2506 sessionId: src_id|27499516-e049ee95-6a26991b-b908a45_0 is DEAD
2025-10-02T08:15:51.246710Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:51.246780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27499516-e049ee95-6a26991b-b908a45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:51.246789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27499516-e049ee95-6a26991b-b908a45_0] Write session will restart in 0.008498s
2025-10-02T08:15:51.246806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27499516-e049ee95-6a26991b-b908a45_0] Write session: Do CDS request
2025-10-02T08:15:51.246811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27499516-e049ee95-6a26991b-b908a45_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:51.246822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535186757314150:8443]
2025-10-02T08:15:51.253201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:51.254141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:51.254279Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:51.254288Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:51.254297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:51.254338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:51.254369Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535186757314272:8556]
2025-10-02T08:15:51.254800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:51.254990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:51.255034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:51.255310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:51.255357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.255361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.255362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.255362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.255363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.255366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.255372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.255374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.255376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.255378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.255382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.255386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.255390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.255393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.255396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.255398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.255401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.255403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.255406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.255409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.255420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:51.256289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27499516-e049ee95-6a26991b-b908a45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.256314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:51.256323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2507
2025-10-02T08:15:51.256514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.256538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:51.256546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:51.256549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:51.256947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2507 sessionId:  describe result for acl check
2025-10-02T08:15:51.256981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:51.256987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:51.256988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:51.256993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535186757314288:8560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:51.257438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535186757314288:8560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:51.259218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535186757314288:8560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:51.262265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535186757314288:8560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:51.262275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535186757314288:8560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:51.262278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535186757314288:8560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:51.262284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:51.262919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:51.264379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:51.264392Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:51.264395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:51.264398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:51.264402Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2506 [1:7556535186757314272:8556]
2025-10-02T08:15:51.264413Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:51.264425Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:51.264427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.264429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.264430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.264442Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:51.264445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:51.264449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:51.264491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.264497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.264499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:51.264501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:51.264569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2506
2025-10-02T08:15:51.264585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:51.264589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.264597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.264608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:51.264621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314320:8560], now have 1 active actors on pipe
2025-10-02T08:15:51.264628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.264631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.264641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535187216682304:2378], now have 1 active actors on pipe
2025-10-02T08:15:51.264648Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535186757314266:8556]
2025-10-02T08:15:51.264649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535186757314266:8556]
2025-10-02T08:15:51.264654Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:51.264624Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2506
2025-10-02T08:15:51.264662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:51.264662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:51.264664Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:51.264672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:51.264676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:51.264686Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:51.264694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.264696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.264697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:51.264703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.264712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:51.264741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535186757314266:8556]
2025-10-02T08:15:51.264749Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:51.264757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.264760Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:51.264792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.264813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.264831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.264862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2507 partition: 0 MaxSeqNo: 17 sessionId: src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0
2025-10-02T08:15:51.265141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27499516-e049ee95-6a26991b-b908a45_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:51.267442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0] Write session: try to update token
2025-10-02T08:15:51.267453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:51.274846Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:51.274862Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.274870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535186757314266:8556]
2025-10-02T08:15:51.274909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:51.274917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:51.275074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:51.275223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.275351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.275488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.275788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:51.275830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:51.279653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId: src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:51.282206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:51.282306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.282321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.282352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:51.282378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:51.282440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.282468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.282638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.282722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.282788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.282851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.282906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.282915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.282985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.283045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.283106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.283165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.283210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.283216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.283275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.283327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.283378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.283429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.283507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.283514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.283583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.283648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.283712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.283779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.283820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.283825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.283883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.283945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.284008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.284069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.284119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.284124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.284183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.284245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.284302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.284369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.284412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.284418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.284477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.284530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.284585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.284639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.284679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.284686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.284751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.284823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.284887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.284952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.284999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.285006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.285073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.285135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.285196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.285260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.285309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.285317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.285377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.285435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.285500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.285563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.285609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.285618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.285655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:51.285718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.285737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.285741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:51.285769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:51.285786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:51.285793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:51.285796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:51.285799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:51.286208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:51.286235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:51.286241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:51.286244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:51.286247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:51.286250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:51.286673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:51.286693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:51.286697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:51.286699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:51.286701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:51.286703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:51.287108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:51.287129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:51.287134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:51.287137Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:51.287139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:51.288357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:51.288378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:51.288389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392951288
2025-10-02T08:15:51.288508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:51.288521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:51.288530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:51.288536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:51.288540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:51.288548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:51.289086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:51.289111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:51.289116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:51.289119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:51.289122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:51.289125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:51.289577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:51.289602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:51.289608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:51.289613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:51.289616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:51.289619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:51.290069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:51.290090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:51.290094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:51.291175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:51.291193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:51.291198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:51.291201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:51.291209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392951291
2025-10-02T08:15:51.291510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:51.291531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:51.291537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:51.291540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:51.291543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:51.291546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:51.291995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:51.292017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:51.292022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:51.292025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:51.292028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:51.292031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:51.292502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:51.292523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.292604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392951292
2025-10-02T08:15:51.293320Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:51.293348Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:51.293354Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:51.293359Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:51.294931Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:51.294945Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.294947Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:51.294955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535186757314266:8556]
2025-10-02T08:15:51.294959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535186757314266:8556]
2025-10-02T08:15:51.295013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:51.295028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.295029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:51.295039Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:51.295047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:51.295162Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:51.347014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535186757314342:8443]
2025-10-02T08:15:51.347101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2506, pipe: [1:7556535186757314342:8443]
2025-10-02T08:15:51.425836Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:51.426187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314342:8443], now have 1 active actors on pipe
2025-10-02T08:15:51.426261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535186757314342:8443]
2025-10-02T08:15:51.426281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:51.426283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:51.426306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2507 reason: error at write: Disconnected sessionId: src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0
2025-10-02T08:15:51.426402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:51.426422Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:51.426503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2507 sessionId: src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0 is DEAD
2025-10-02T08:15:51.426628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:51.426638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0] Write session will restart in 0.005091s
2025-10-02T08:15:51.426663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0] Write session: Do CDS request
2025-10-02T08:15:51.426669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:51.432411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:51.433160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.433217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:51.433228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2508
2025-10-02T08:15:51.433261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:51.433378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.433390Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:51.433398Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:51.433404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:51.433404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:51.433408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:51.433411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:51.433435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:51.433467Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535186757314467:8592]
2025-10-02T08:15:51.433733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2508 sessionId:  describe result for acl check
2025-10-02T08:15:51.433760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:51.433765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:51.433766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:51.433771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535186757314471:8608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:51.433879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:51.434049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:51.434081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:51.434180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535186757314471:8608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:51.434270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:51.434297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.434301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.434301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.434302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.434302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.434305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.434313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.434317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.434320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.434323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.434328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.434334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.434344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.434349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.434353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.434360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.434364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.434369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.434373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.434377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.434392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:51.435759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535186757314471:8608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:51.440437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535186757314471:8608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:51.440449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535186757314471:8608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:51.440454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535186757314471:8608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:51.440461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:51.442449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:51.444014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:51.444035Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:51.444038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:51.444043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:51.444048Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2507 [1:7556535186757314467:8592]
2025-10-02T08:15:51.444058Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:51.444078Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:51.444084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.444087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.444089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.444115Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:51.444124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:51.444131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:51.444197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.444204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.444207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:51.444210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:51.444275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:51.444281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.444294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.444315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:51.444335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2507
2025-10-02T08:15:51.444341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314515:8608], now have 1 active actors on pipe
2025-10-02T08:15:51.444348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535186757314460:8592]
2025-10-02T08:15:51.444349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535186757314460:8592]
2025-10-02T08:15:51.444359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:51.444372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:51.444375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:51.444376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:51.444390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:51.444393Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:51.444407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535187216682311:2378], now have 1 active actors on pipe
2025-10-02T08:15:51.444418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.444428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.444431Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2507
2025-10-02T08:15:51.444475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535186757314460:8592]
2025-10-02T08:15:51.444490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:51.444500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:51.444512Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:51.444523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.444532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.444537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:51.444545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.444559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:51.444601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.444637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.444643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.444655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.444688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2508 partition: 0 MaxSeqNo: 17 sessionId: src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0
2025-10-02T08:15:51.445037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb950a07-3ad75a87-854aa23b-3ccb89eb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:51.447425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0] Write session: try to update token
2025-10-02T08:15:51.447438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:51.461238Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:51.461256Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.461258Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:51.461264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535186757314460:8592]
2025-10-02T08:15:51.461268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535186757314460:8592]
2025-10-02T08:15:51.461298Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:51.461302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:51.461306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:51.461312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.461313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:51.461427Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:51.483624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId: src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:51.485841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:51.526216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535186757314567:8443]
2025-10-02T08:15:51.526325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2507, pipe: [1:7556535186757314567:8443]
2025-10-02T08:15:51.589486Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:51.589965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.589976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.589995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314567:8443], now have 1 active actors on pipe
2025-10-02T08:15:51.590144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:51.590155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:51.590239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2508 reason: error at write: Disconnected sessionId: src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0
2025-10-02T08:15:51.590311Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:51.590318Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:51.590419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2508 sessionId: src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0 is DEAD
2025-10-02T08:15:51.590535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:51.590547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0] Write session will restart in 0.009893s
2025-10-02T08:15:51.590571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0] Write session: Do CDS request
2025-10-02T08:15:51.590578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:51.590599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535186757314567:8443]
2025-10-02T08:15:51.599191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:51.600037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:51.600206Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:51.600216Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:51.600226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:51.600277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:51.600316Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535186757314692:8658]
2025-10-02T08:15:51.600863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:51.601079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:51.601121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:51.601277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.601332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:51.601342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:51.601346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2509
2025-10-02T08:15:51.601362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.601366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.601367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.601367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.601370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.601373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.601379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.601381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.601383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.601385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.601388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.601393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.601397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.601402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.601406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.601410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.601414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.601418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.601422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.601426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.601442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:51.601481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.601508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:51.601513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:51.601516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:51.601892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2509 sessionId:  describe result for acl check
2025-10-02T08:15:51.601933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:51.601939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:51.601940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:51.601945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535186757314709:8661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:51.602349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535186757314709:8661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:51.604320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535186757314709:8661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:51.608702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535186757314709:8661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:51.608715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535186757314709:8661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:51.608719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535186757314709:8661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:51.608728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:51.609257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:51.610930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:51.610946Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:51.610948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:51.610952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:51.610958Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2508 [1:7556535186757314692:8658]
2025-10-02T08:15:51.610969Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:51.610984Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:51.610993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.610996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.611002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.611018Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:51.611028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:51.611034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:51.611099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.611107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.611110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:51.611113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:51.611178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:51.611187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.611201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.611214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:51.611219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2508
2025-10-02T08:15:51.611232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314741:8661], now have 1 active actors on pipe
2025-10-02T08:15:51.611248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535187216682340:2378], now have 1 active actors on pipe
2025-10-02T08:15:51.611253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.611257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.611274Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535186757314686:8658]
2025-10-02T08:15:51.611277Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535186757314686:8658]
2025-10-02T08:15:51.611284Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:51.611296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:51.611272Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2508
2025-10-02T08:15:51.611300Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:51.611309Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:51.611309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:51.611312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:51.611326Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c580af4-9745e9b7-9404f178-c50fc286_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:51.611338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.611341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.611343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:51.611352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.611365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:51.611407Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535186757314686:8658]
2025-10-02T08:15:51.611420Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:51.611434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:51.611435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.611525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.611536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.611554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.611590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2509 partition: 0 MaxSeqNo: 17 sessionId: src_id|3c580af4-9745e9b7-9404f178-c50fc286_0
2025-10-02T08:15:51.611893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe3bb7-a04402ff-652f3b58-47d095d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3c580af4-9745e9b7-9404f178-c50fc286_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:51.614445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c580af4-9745e9b7-9404f178-c50fc286_0] Write session: try to update token
2025-10-02T08:15:51.614459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c580af4-9745e9b7-9404f178-c50fc286_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:51.621698Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:51.621720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.621731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535186757314686:8658]
2025-10-02T08:15:51.621779Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:51.621797Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:51.622050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:51.622248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.622446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.622626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.622873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:51.622932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:51.627814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId: src_id|3c580af4-9745e9b7-9404f178-c50fc286_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:51.630362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:51.630417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.630430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.630472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:51.630498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:51.630755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.630768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.630937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.631092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.631240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.631394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.631441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.631450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.631515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.631577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.631638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.631708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.631754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.631764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.631827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.631886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.631945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.632007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.632048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.632055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.632131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.632192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.632253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.632319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.632362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.632371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.632438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.632498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.632562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.632629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.632676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.632683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.632746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.632824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.632889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.632953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.632999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.633005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.633072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.633136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.633203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.633267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.633313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.633321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.633387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.633451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.633517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.633582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.633627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.633635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.633704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.633767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.633830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.633894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.633939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.633948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.634012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.634074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.634137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.634201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.634246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.634253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.634291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:51.634355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.634380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.634386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:51.634416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:51.634432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:51.634439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:51.634442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:51.634444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:51.634832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:51.634855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:51.634865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:51.634867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:51.634870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:51.634873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:51.635409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:51.635428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:51.635432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:51.635434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:51.635435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:51.635437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:51.635874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:51.635889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:51.635893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:51.635897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:51.635899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:51.637009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:51.637033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:51.637046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392951636
2025-10-02T08:15:51.637165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:51.637175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:51.637182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:51.637185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:51.637187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:51.637192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:51.637595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:51.637614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:51.637618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:51.637620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:51.637622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:51.637624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:51.638001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:51.638016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:51.638021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:51.638024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:51.638027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:51.638028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:51.638451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:51.638466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:51.638470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:51.639414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:51.639426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:51.639430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:51.639435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:51.639440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392951639
2025-10-02T08:15:51.639703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:51.639723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:51.639732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:51.639735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:51.639738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:51.639741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:51.640138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:51.640154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:51.640158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:51.640161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:51.640163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:51.640166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:51.640549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:51.640566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.640635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392951640
2025-10-02T08:15:51.641300Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:51.641315Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:51.641319Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:51.641322Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:51.642784Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:51.642796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.642798Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:51.642804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535186757314686:8658]
2025-10-02T08:15:51.642807Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535186757314686:8658]
2025-10-02T08:15:51.642845Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:51.642850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:51.642853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.642854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:51.642864Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:51.642972Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:51.688549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535186757314767:8443]
2025-10-02T08:15:51.688684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2508, pipe: [1:7556535186757314767:8443]
2025-10-02T08:15:51.771796Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:51.772083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314767:8443], now have 1 active actors on pipe
2025-10-02T08:15:51.772226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535186757314767:8443]
2025-10-02T08:15:51.772245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:51.772247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:51.772271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2509 reason: error at write: Disconnected sessionId: src_id|3c580af4-9745e9b7-9404f178-c50fc286_0
2025-10-02T08:15:51.772348Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:51.772375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:51.772438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2509 sessionId: src_id|3c580af4-9745e9b7-9404f178-c50fc286_0 is DEAD
2025-10-02T08:15:51.772565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c580af4-9745e9b7-9404f178-c50fc286_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:51.772576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c580af4-9745e9b7-9404f178-c50fc286_0] Write session will restart in 0.008061s
2025-10-02T08:15:51.772600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c580af4-9745e9b7-9404f178-c50fc286_0] Write session: Do CDS request
2025-10-02T08:15:51.772606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c580af4-9745e9b7-9404f178-c50fc286_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:51.779146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:51.780173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:51.780360Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:51.780371Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:51.780381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:51.780431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:51.780470Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535186757314899:8717]
2025-10-02T08:15:51.781085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:51.781268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:51.781312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:51.781602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:51.781653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.781659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.781660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.781662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.781663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.781668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.781679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.781682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.781687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.781690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.781695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.781702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.781708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.781714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.781718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.781722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.781727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.781730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.781734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.781739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.781761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:51.782276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c580af4-9745e9b7-9404f178-c50fc286_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.782359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:51.782369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2510
2025-10-02T08:15:51.782476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.782505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:51.782513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:51.782515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:51.782868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2510 sessionId:  describe result for acl check
2025-10-02T08:15:51.782898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:51.782903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:51.782904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:51.782907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535186757314915:8650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:51.783277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535186757314915:8650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:51.785198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535186757314915:8650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:51.789592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:51.790873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535186757314915:8650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:51.790886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535186757314915:8650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:51.790889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535186757314915:8650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:51.790898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:51.790977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:51.790990Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:51.790993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:51.790996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:51.791002Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2509 [1:7556535186757314899:8717]
2025-10-02T08:15:51.791013Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:51.791033Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:51.791040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.791045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.791047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.791062Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:51.791071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:51.791076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:51.791131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.791138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.791141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:51.791143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:51.791205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:51.791213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.791224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.791236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:51.791243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2509
2025-10-02T08:15:51.791251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314947:8650], now have 1 active actors on pipe
2025-10-02T08:15:51.791258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535187216682348:2378], now have 1 active actors on pipe
2025-10-02T08:15:51.791264Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535186757314893:8717]
2025-10-02T08:15:51.791266Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535186757314893:8717]
2025-10-02T08:15:51.791274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:51.791288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.791292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.791274Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2509
2025-10-02T08:15:51.791308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:51.791317Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:51.791320Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:51.791325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:51.791332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:51.791365Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:51.791374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.791382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.791383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:51.791389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.791395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:51.791428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535186757314893:8717]
2025-10-02T08:15:51.791437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:51.791444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:51.791458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.791513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.791519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.791528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.791551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2510 partition: 0 MaxSeqNo: 17 sessionId: src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0
2025-10-02T08:15:51.791838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c580af4-9745e9b7-9404f178-c50fc286_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:51.794327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0] Write session: try to update token
2025-10-02T08:15:51.794342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:51.802456Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:51.802475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.802483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535186757314893:8717]
2025-10-02T08:15:51.802523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:51.802526Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:51.802692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:51.802835Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.802973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.803119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:51.803319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:51.803356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:51.807598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId: src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:51.810115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:51.810184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.810197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.810226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:51.810248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:51.810301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.810317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.810487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.810557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.810629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.810703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.810763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.810772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.810839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.810907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.810979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.811049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.811106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.811113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.811178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.811238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.811304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.811370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.811414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.811420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.811486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.811544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.811608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.811673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.811716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.811722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.811792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.811851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.811916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.811977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.812020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.812026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.812088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.812165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.812224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.812289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.812339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.812347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.812412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.812483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.812559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.812630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.812682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.812688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.812764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.812849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.812920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.812992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.813048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.813055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.813128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.813191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.813261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.813332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.813507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.813517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.813580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:51.813646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:51.813712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:51.813780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:51.813825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:51.813833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:51.813883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:51.813952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.813976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.813986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:51.814015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:51.814032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:51.814034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:51.814037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:51.814043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:51.814462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:51.814489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:51.814499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:51.814503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:51.814505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:51.814509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:51.815083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:51.815103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:51.815107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:51.815113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:51.815116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:51.815118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:51.815588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:51.815613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:51.815618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:51.815621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:51.815628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:51.816838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:51.816851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:51.816861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392951816
2025-10-02T08:15:51.817024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:51.817029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:51.817032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:51.817034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:51.817036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:51.817039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:51.817490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:51.817500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:51.817504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:51.817507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:51.817510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:51.817514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:51.817935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:51.817944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:51.817951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:51.817953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:51.817956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:51.817957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:51.818362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:51.818369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:51.818372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:51.819366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:51.819371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:51.819374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:51.819377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:51.819383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392951819
2025-10-02T08:15:51.819646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:51.819654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:51.819657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:51.819661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:51.819663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:51.819667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:51.820098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:51.820121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:51.820125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:51.820127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:51.820130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:51.820132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:51.820577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:51.820586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.820680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392951820
2025-10-02T08:15:51.821592Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:51.821609Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:51.821613Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:51.821617Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:51.823161Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:51.823170Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.823172Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:51.823179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535186757314893:8717]
2025-10-02T08:15:51.823182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535186757314893:8717]
2025-10-02T08:15:51.823226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:51.823233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.823234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:51.823270Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:51.823284Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:51.823366Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:51.872324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535186757314970:8443]
2025-10-02T08:15:51.872458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2509, pipe: [1:7556535186757314970:8443]
2025-10-02T08:15:51.957584Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:51.957962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757314970:8443], now have 1 active actors on pipe
2025-10-02T08:15:51.958074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535186757314970:8443]
2025-10-02T08:15:51.958095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:51.958096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:51.958118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2510 reason: error at write: Disconnected sessionId: src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0
2025-10-02T08:15:51.958134Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:51.958173Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:51.958300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2510 sessionId: src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0 is DEAD
2025-10-02T08:15:51.958571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:51.958581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0] Write session will restart in 0.007428s
2025-10-02T08:15:51.958605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0] Write session: Do CDS request
2025-10-02T08:15:51.958611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:51.965337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:51.966264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:51.966429Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:51.966437Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:51.966444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:51.966477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:51.966506Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535186757315117:8692]
2025-10-02T08:15:51.966892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:51.967039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:51.967080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:51.967262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.967283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:51.967292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2511
2025-10-02T08:15:51.967351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:51.967415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.967422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.967423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.967424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.967426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.967431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.967438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:51.967440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.967444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.967448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.967452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.967458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.967467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:51.967470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:51.967471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:51.967473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:51.967475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.967482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:51.967487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.967491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:51.967496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.967500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.967504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.967514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.967531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:51.967785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2511 sessionId:  describe result for acl check
2025-10-02T08:15:51.967824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:51.967829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:51.967831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:51.967835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535186757315133:8675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:51.968301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535186757315133:8675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:51.970523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535186757315133:8675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:51.974863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535186757315133:8675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:51.974876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535186757315133:8675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:51.974878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535186757315133:8675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:51.974885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:51.975426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:51.976914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:51.976925Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:51.976928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:51.976931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:51.976937Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2510 [1:7556535186757315117:8692]
2025-10-02T08:15:51.976949Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:51.976963Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:51.976967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.976971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.976973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.976988Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:51.976999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:51.977008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:51.977064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.977070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.977072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:51.977075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:51.977137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:51.977143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.977155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:51.977168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:51.977183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2510
2025-10-02T08:15:51.977191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535186757315162:8675], now have 1 active actors on pipe
2025-10-02T08:15:51.977194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535187216682368:2378], now have 1 active actors on pipe
2025-10-02T08:15:51.977199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535186757315111:8692]
2025-10-02T08:15:51.977202Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535186757315111:8692]
2025-10-02T08:15:51.977212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:51.977224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.977230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.977236Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:51.977238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:51.977248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:51.977261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:51.977265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:51.977250Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2510
2025-10-02T08:15:51.977304Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:51.977313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:51.977316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:51.977318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:51.977327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:51.977338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:51.977354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535186757315111:8692]
2025-10-02T08:15:51.977364Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:51.977376Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:51.977394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.977445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:51.977449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:51.977461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:51.977493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2511 partition: 0 MaxSeqNo: 17 sessionId: src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0
2025-10-02T08:15:51.977827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc86d7-bbfc40b7-876df69d-a3f43e8c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:51.980402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0] Write session: try to update token
2025-10-02T08:15:51.980418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:51.993066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId: src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:51.995004Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:51.995026Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:51.995028Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:51.995036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535186757315111:8692]
2025-10-02T08:15:51.995043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535186757315111:8692]
2025-10-02T08:15:51.995088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:51.995100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:51.995107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:51.995107Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:51.995112Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:51.995252Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:51.995660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:52.058186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535191052282472:8443]
2025-10-02T08:15:52.058331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2510, pipe: [1:7556535191052282472:8443]
2025-10-02T08:15:52.131339Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:52.131708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.131723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.131765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052282472:8443], now have 1 active actors on pipe
2025-10-02T08:15:52.131866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:52.131873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:52.131930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2511 reason: error at write: Disconnected sessionId: src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0
2025-10-02T08:15:52.132002Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:52.131995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:52.132096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2511 sessionId: src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0 is DEAD
2025-10-02T08:15:52.132259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:52.132270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0] Write session will restart in 0.007827s
2025-10-02T08:15:52.132294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0] Write session: Do CDS request
2025-10-02T08:15:52.132300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:52.132286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535191052282472:8443]
2025-10-02T08:15:52.139194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:52.140015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:52.140199Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:52.140207Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:52.140215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:52.140253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:52.140302Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535191052282607:8701]
2025-10-02T08:15:52.140768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:52.140989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:52.141048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:52.141270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.141345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:52.141355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2512
2025-10-02T08:15:52.141392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:52.141457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.141459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.141460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.141461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.141462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.141468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.141477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.141481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.141484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.141489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.141495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.141502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.141508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.141513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.141517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.141522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.141522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.141525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.141530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.141536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.141549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:52.141551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.141554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:52.141560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:52.141568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:52.141963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2512 sessionId:  describe result for acl check
2025-10-02T08:15:52.141995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:52.142000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:52.142001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:52.142006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535191052282623:8729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:52.142473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535191052282623:8729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:52.144655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535191052282623:8729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:52.148947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535191052282623:8729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:52.148960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535191052282623:8729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:52.148964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535191052282623:8729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:52.148970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:52.152555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:52.154053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:52.154070Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:52.154072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:52.154074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:52.154078Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2511 [1:7556535191052282607:8701]
2025-10-02T08:15:52.154086Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:52.154099Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:52.154100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.154103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.154104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.154116Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:52.154119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:52.154123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:52.154174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.154180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.154182Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:52.154183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:52.154248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:52.154255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.154269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.154279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:52.154296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052282655:8729], now have 1 active actors on pipe
2025-10-02T08:15:52.154299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2511
2025-10-02T08:15:52.154304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535191052282601:8701]
2025-10-02T08:15:52.154305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535191052282601:8701]
2025-10-02T08:15:52.154310Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:52.154316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535191511649670:2378], now have 1 active actors on pipe
2025-10-02T08:15:52.154321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.154321Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:52.154324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:52.154325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.154337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:52.154345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:52.154350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:52.154387Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:52.154395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.154397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.154398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:52.154404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.154413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:52.154423Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535191052282601:8701]
2025-10-02T08:15:52.154426Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:52.154385Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2511
2025-10-02T08:15:52.154433Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:52.154458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.154522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.154528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.154539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.154573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2512 partition: 0 MaxSeqNo: 17 sessionId: src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0
2025-10-02T08:15:52.154840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae116324-8e9a9c4-e154bc71-5b8313db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:52.157450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0] Write session: try to update token
2025-10-02T08:15:52.157467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:52.172068Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:52.172091Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:52.172093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:52.172101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535191052282601:8701]
2025-10-02T08:15:52.172118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535191052282601:8701]
2025-10-02T08:15:52.172158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:52.172157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:52.172162Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:52.172165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.172167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:52.172310Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:52.173023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId: src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:52.175666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:52.232241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535191052282669:8443]
2025-10-02T08:15:52.232349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2511, pipe: [1:7556535191052282669:8443]
2025-10-02T08:15:52.304093Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:52.304387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.304399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.304435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052282669:8443], now have 1 active actors on pipe
2025-10-02T08:15:52.304536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535191052282669:8443]
2025-10-02T08:15:52.304559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:52.304566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:52.304655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:52.304945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:52.304955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0] Write session will restart in 0.008940s
2025-10-02T08:15:52.304617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2512 reason: error at write: Disconnected sessionId: src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0
2025-10-02T08:15:52.304646Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:52.304977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0] Write session: Do CDS request
2025-10-02T08:15:52.304789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2512 sessionId: src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0 is DEAD
2025-10-02T08:15:52.304984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:52.312144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:52.312963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:52.313148Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:52.313162Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:52.313173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:52.313235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:52.313271Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535191052282805:8749]
2025-10-02T08:15:52.313884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:52.314052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:52.314092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:52.314388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:52.314447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.314453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.314454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.314455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.314456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.314462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.314472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.314476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.314480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.314484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.314489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.314496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.314502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.314507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.314514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.314520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.314524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.314530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.314534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.314539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.314557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:52.315252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.315280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:52.315289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2513
2025-10-02T08:15:52.315451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.315478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:52.315486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:52.315489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:52.315848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2513 sessionId:  describe result for acl check
2025-10-02T08:15:52.315879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:52.315884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:52.315886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:52.315891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535191052282821:8750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:52.316355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535191052282821:8750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:52.318269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535191052282821:8750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:52.321741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535191052282821:8750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:52.321757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535191052282821:8750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:52.321763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535191052282821:8750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:52.321771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:52.322332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:52.323891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:52.323906Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:52.323909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:52.323912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:52.323918Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2512 [1:7556535191052282805:8749]
2025-10-02T08:15:52.323928Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:52.323945Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:52.323948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.323950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.323951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.323966Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:52.323970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:52.323976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:52.324043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.324050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.324053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:52.324055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:52.324132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:52.324139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.324151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.324164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:52.324170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2512
2025-10-02T08:15:52.324186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052282853:8750], now have 1 active actors on pipe
2025-10-02T08:15:52.324193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535191511649680:2378], now have 1 active actors on pipe
2025-10-02T08:15:52.324199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.324201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.324217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535191052282799:8749]
2025-10-02T08:15:52.324223Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535191052282799:8749]
2025-10-02T08:15:52.324233Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:52.324248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:52.324251Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:52.324254Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:52.324262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:52.324266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:52.324280Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:52.324289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.324292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.324294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:52.324302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.324313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:52.324271Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2512
2025-10-02T08:15:52.324349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535191052282799:8749]
2025-10-02T08:15:52.324359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:52.324372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:52.324375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.324470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.324483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.324506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.324544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2513 partition: 0 MaxSeqNo: 17 sessionId: src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0
2025-10-02T08:15:52.324880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a501ca-72358eee-e8a8fbbd-142bb750_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:52.327384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0] Write session: try to update token
2025-10-02T08:15:52.327400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:52.341512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId: src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:52.342123Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:52.342127Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:52.342135Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535191052282799:8749]
2025-10-02T08:15:52.342183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:52.342183Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:52.342348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:52.342481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:52.342618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:52.342748Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:52.343173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:52.343220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:52.344201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:52.344283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.344297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.344324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:52.344350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:52.344405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.344417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.344588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.344655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.344729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.344815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.344865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.344874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.344954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.345022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.345168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.345258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.345307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.345315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.345429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.345494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.345556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.345622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.345668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.345675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.345742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.345803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.345861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.345935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.345980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.345986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.346052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.346112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.346172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.346238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.346283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.346289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.346357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.346419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.346480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.346547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.346590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.346596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.346661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.346719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.346786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.346851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.346894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.346900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.346959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.347014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.347068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.347123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.347165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.347174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.347244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.347304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.347368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.347434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.347480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.347485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.347555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:52.347616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:52.347678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:52.347738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:52.347786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:52.347793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:52.347831Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:52.347896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.347915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.347918Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:52.347942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:52.347957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:52.347959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:52.347962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:52.347963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:52.348334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:52.348358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:52.348365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:52.348368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:52.348370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:52.348373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:52.348821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:52.348842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:52.348849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:52.348852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:52.348855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:52.348858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:52.349368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:52.349390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:52.349396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:52.349400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:52.349403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:52.350669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:52.350692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:52.350706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392952350
2025-10-02T08:15:52.350850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:52.350865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:52.350879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:52.350882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:52.350886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:52.350889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:52.351389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:52.351414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:52.351424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:52.351430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:52.351433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:52.351437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:52.351947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:52.351973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:52.351980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:52.351986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:52.351990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:52.351994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:52.352502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:52.352529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:52.352536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:52.353712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:52.353732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:52.353737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:52.353741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:52.353749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392952353
2025-10-02T08:15:52.354052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:52.354073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:52.354078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:52.354082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:52.354085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:52.354088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:52.354561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:52.354585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:52.354591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:52.354594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:52.354600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:52.354603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:52.355118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:52.355140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.355240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392952355
2025-10-02T08:15:52.356016Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:52.356048Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:52.356056Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:52.356063Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:52.357717Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:52.357731Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:52.357732Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:52.357740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535191052282799:8749]
2025-10-02T08:15:52.357743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535191052282799:8749]
2025-10-02T08:15:52.357793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:52.357797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:52.357801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.357803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:52.357810Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:52.357938Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:52.404857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535191052282878:8443]
2025-10-02T08:15:52.404990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2512, pipe: [1:7556535191052282878:8443]
2025-10-02T08:15:52.492115Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:52.492439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052282878:8443], now have 1 active actors on pipe
2025-10-02T08:15:52.492618Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:52.492622Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:52.492908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535191052282878:8443]
2025-10-02T08:15:52.492925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:52.492945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2513 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0
2025-10-02T08:15:52.493077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2513 sessionId: src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0 is DEAD
2025-10-02T08:15:52.493210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:52.493220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0] Write session will restart in 0.006847s
2025-10-02T08:15:52.493244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0] Write session: Do CDS request
2025-10-02T08:15:52.493249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:52.499588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:52.500524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:52.500731Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:52.500743Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:52.500755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:52.500834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:52.500884Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535191052283032:8794]
2025-10-02T08:15:52.501210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.501466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:52.501530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:52.501538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2514
2025-10-02T08:15:52.501644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.501669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:52.501677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:52.501679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:52.501717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:52.501755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:52.501971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:52.502000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.502005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.502006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.502006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.502007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.502010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.502018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.502020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.502021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.502023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.502027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.502031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.502035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.502038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.502040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.502043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.502045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.502047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.502049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.502052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.502063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:52.502308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2514 sessionId:  describe result for acl check
2025-10-02T08:15:52.502336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:52.502337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:52.502338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:52.502343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535191052283048:8800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:52.502817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535191052283048:8800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:52.505304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535191052283048:8800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:52.509179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535191052283048:8800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:52.509194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535191052283048:8800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:52.509196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535191052283048:8800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:52.509202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:52.510089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:52.511595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:52.511608Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:52.511609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:52.511612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:52.511616Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2513 [1:7556535191052283032:8794]
2025-10-02T08:15:52.511624Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:52.511638Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:52.511700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.511706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.511707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.511719Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:52.511722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:52.511727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:52.511770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.511775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.511777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:52.511779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:52.511826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:52.511831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.511839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.511853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:52.511863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535191052283024:8794]
2025-10-02T08:15:52.511864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535191052283024:8794]
2025-10-02T08:15:52.511869Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:52.511877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:52.511896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:52.511895Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:52.511899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:52.511903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:52.511940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535191511649691:2378], now have 1 active actors on pipe
2025-10-02T08:15:52.511946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535191052283024:8794]
2025-10-02T08:15:52.511951Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:52.511959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:52.511996Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2513
2025-10-02T08:15:52.512133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2513
2025-10-02T08:15:52.512142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052283079:8800], now have 1 active actors on pipe
2025-10-02T08:15:52.512149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.512152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.512171Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:52.512176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.512179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.512181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:52.512187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.512193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:52.512202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.512226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.512227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.512235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.512255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2514 partition: 0 MaxSeqNo: 17 sessionId: src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0
2025-10-02T08:15:52.512581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8625681-ecdc7378-ce9c4741-b10a6d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:52.515115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0] Write session: try to update token
2025-10-02T08:15:52.515128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:52.529045Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:52.529062Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:52.529064Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:52.529071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535191052283024:8794]
2025-10-02T08:15:52.529075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535191052283024:8794]
2025-10-02T08:15:52.529094Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:52.529097Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:52.529107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:52.529111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.529113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:52.529255Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:52.529307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId: src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:52.531926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:52.593245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535191052283117:8443]
2025-10-02T08:15:52.593365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2513, pipe: [1:7556535191052283117:8443]
2025-10-02T08:15:52.660774Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:52.661287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.661298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.661330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052283117:8443], now have 1 active actors on pipe
2025-10-02T08:15:52.661502Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:52.661522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:52.661531Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:52.661537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:52.661595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2514 reason: error at write: Disconnected sessionId: src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0
2025-10-02T08:15:52.661768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535191052283117:8443]
2025-10-02T08:15:52.661772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2514 sessionId: src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0 is DEAD
2025-10-02T08:15:52.661894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:52.661902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0] Write session will restart in 0.007392s
2025-10-02T08:15:52.661927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0] Write session: Do CDS request
2025-10-02T08:15:52.661932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:52.668987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:52.670075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:52.670262Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:52.670274Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:52.670284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:52.670299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.670332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:52.670333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:52.670345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2515
2025-10-02T08:15:52.670367Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535191052283254:8827]
2025-10-02T08:15:52.670487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.670521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:52.670531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:52.670534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:52.670862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2515 sessionId:  describe result for acl check
2025-10-02T08:15:52.670898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:52.670905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:52.670906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:52.670911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535191052283259:8830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:52.670958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:52.671147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:52.671190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:52.671351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535191052283259:8830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:52.671464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:52.671518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.671524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.671526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.671526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.671527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.671532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.671540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.671543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.671547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.671550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.671558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.671564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.671570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.671575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.671579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.671583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.671592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.671596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.671602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.671611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.671631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:52.673510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535191052283259:8830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:52.678707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535191052283259:8830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:52.678719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535191052283259:8830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:52.678721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535191052283259:8830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:52.678727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:52.679206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:52.680689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:52.680707Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:52.680710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:52.680714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:52.680719Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2514 [1:7556535191052283254:8827]
2025-10-02T08:15:52.680730Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:52.680747Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:52.680750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.680753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.680755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.680769Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:52.680775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:52.680780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:52.680849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.680856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.680859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:52.680861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:52.680919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:52.680927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.680938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.680962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:52.680969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2514
2025-10-02T08:15:52.680980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052283303:8830], now have 1 active actors on pipe
2025-10-02T08:15:52.680983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535191511649715:2378], now have 1 active actors on pipe
2025-10-02T08:15:52.680988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.680992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.681008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535191052283248:8827]
2025-10-02T08:15:52.681014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535191052283248:8827]
2025-10-02T08:15:52.681024Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:52.681036Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:52.681037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:52.681040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:52.681051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:52.681053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:52.681043Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2514
2025-10-02T08:15:52.681068Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:52.681078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.681082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.681083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:52.681093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.681102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:52.681129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535191052283248:8827]
2025-10-02T08:15:52.681140Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:52.681151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:52.681153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.681205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.681211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.681225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.681254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2515 partition: 0 MaxSeqNo: 17 sessionId: src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0
2025-10-02T08:15:52.681520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6b7b52-5bc99abb-2d3194d1-bf16a1f7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:52.683957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0] Write session: try to update token
2025-10-02T08:15:52.683973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:52.696690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId: src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:52.698515Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:52.698532Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:52.698536Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:52.698544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535191052283248:8827]
2025-10-02T08:15:52.698548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535191052283248:8827]
2025-10-02T08:15:52.698590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:52.698592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:52.698598Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:52.698600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.698603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:52.698733Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:52.699203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:52.761668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535191052283321:8443]
2025-10-02T08:15:52.761750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2514, pipe: [1:7556535191052283321:8443]
2025-10-02T08:15:52.824351Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:52.824678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.824688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.824723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052283321:8443], now have 1 active actors on pipe
2025-10-02T08:15:52.824838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:52.824850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:52.824914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2515 reason: error at write: Disconnected sessionId: src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0
2025-10-02T08:15:52.824965Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:52.824963Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:52.825079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2515 sessionId: src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0 is DEAD
2025-10-02T08:15:52.825230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535191052283321:8443]
2025-10-02T08:15:52.825246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:52.825257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0] Write session will restart in 0.009376s
2025-10-02T08:15:52.825280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0] Write session: Do CDS request
2025-10-02T08:15:52.825286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:52.831438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:52.832277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:52.832459Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:52.832474Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:52.832486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:52.832539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:52.832583Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535191052283463:8860]
2025-10-02T08:15:52.833192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:52.833394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:52.833435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:52.833718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:52.833786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.833794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.833796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.833797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.833798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.833803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.833812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.833815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.833819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.833822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.833828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.833835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:52.833840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.833845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:52.833849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.833854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:52.833858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.833863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.833867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.833872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.833888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:52.835265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.835367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:52.835379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2516
2025-10-02T08:15:52.835474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:52.835498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:52.835506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:52.835509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:52.835833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2516 sessionId:  describe result for acl check
2025-10-02T08:15:52.835877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:52.835884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:52.835885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:52.835889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535191052283479:8876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:52.836253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535191052283479:8876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:52.838084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535191052283479:8876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:52.840910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535191052283479:8876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:52.840920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535191052283479:8876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:52.840922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535191052283479:8876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:52.840928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:52.841435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:52.842763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:52.842775Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:52.842777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:52.842779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:52.842783Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2515 [1:7556535191052283463:8860]
2025-10-02T08:15:52.842791Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:52.842802Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:52.842803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.842805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.842806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.842817Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:52.842820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:52.842826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:52.842896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.842905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.842908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:52.842911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:52.842976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:52.842983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.842993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:52.843004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:52.843022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052283510:8876], now have 1 active actors on pipe
2025-10-02T08:15:52.843030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2515
2025-10-02T08:15:52.843033Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535191052283455:8860]
2025-10-02T08:15:52.843035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535191052283455:8860]
2025-10-02T08:15:52.843042Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:52.843051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:52.843053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535191511649724:2378], now have 1 active actors on pipe
2025-10-02T08:15:52.843059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:52.843060Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:52.843071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:52.843074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:52.843080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.843087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.843118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535191052283455:8860]
2025-10-02T08:15:52.843124Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:52.843127Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:52.843135Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd826f58-84b133af-3912fefd-cde0181f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:52.843091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2515
2025-10-02T08:15:52.843141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:52.843143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:52.843145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:52.843151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:52.843158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:52.843185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.843259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:52.843270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:52.843292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:52.843330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2516 partition: 0 MaxSeqNo: 17 sessionId: src_id|bd826f58-84b133af-3912fefd-cde0181f_0
2025-10-02T08:15:52.843626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16bb8a6-a64e95fe-ffead57b-84c09667_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bd826f58-84b133af-3912fefd-cde0181f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:52.846032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd826f58-84b133af-3912fefd-cde0181f_0] Write session: try to update token
2025-10-02T08:15:52.846045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd826f58-84b133af-3912fefd-cde0181f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:52.858501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId: src_id|bd826f58-84b133af-3912fefd-cde0181f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:52.860327Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:52.860341Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:52.860343Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:52.860352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535191052283455:8860]
2025-10-02T08:15:52.860355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535191052283455:8860]
2025-10-02T08:15:52.860389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:52.860395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:52.860397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:52.860430Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:52.860446Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:52.860535Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:52.861063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:52.925506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535191052283538:8443]
2025-10-02T08:15:52.925606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2515, pipe: [1:7556535191052283538:8443]
2025-10-02T08:15:53.003463Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:53.003761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.003771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.003803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535191052283538:8443], now have 1 active actors on pipe
2025-10-02T08:15:53.003969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535191052283538:8443]
2025-10-02T08:15:53.003989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:53.003994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:53.004017Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:53.004052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2516 reason: error at write: Disconnected sessionId: src_id|bd826f58-84b133af-3912fefd-cde0181f_0
2025-10-02T08:15:53.004052Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:53.004205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2516 sessionId: src_id|bd826f58-84b133af-3912fefd-cde0181f_0 is DEAD
2025-10-02T08:15:53.004363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd826f58-84b133af-3912fefd-cde0181f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:53.004372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd826f58-84b133af-3912fefd-cde0181f_0] Write session will restart in 0.007115s
2025-10-02T08:15:53.004396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd826f58-84b133af-3912fefd-cde0181f_0] Write session: Do CDS request
2025-10-02T08:15:53.004402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd826f58-84b133af-3912fefd-cde0181f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:53.011457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:53.012263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd826f58-84b133af-3912fefd-cde0181f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.012326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:53.012338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2517
2025-10-02T08:15:53.012452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.012483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:53.012491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:53.012494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:53.012612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:53.012798Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:53.012825Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:53.012836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:53.012882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:53.012918Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535195347250979:8872]
2025-10-02T08:15:53.013012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2517 sessionId:  describe result for acl check
2025-10-02T08:15:53.013045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:53.013050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:53.013052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:53.013057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535195347250982:8870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:53.013504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:53.013530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535195347250982:8870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:53.013677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:53.013711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:53.013985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:53.014030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.014037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.014038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.014039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.014040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.014044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.014052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.014055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.014059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.014062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.014067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.014075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.014080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.014084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.014088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.014092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.014096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.014100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.014103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.014107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.014123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:53.015552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535195347250982:8870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:53.021786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535195347250982:8870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:53.021807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535195347250982:8870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:53.021814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535195347250982:8870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:53.021878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:53.022449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:53.024232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:53.024249Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:53.024251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:53.024254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:53.024260Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2516 [1:7556535195347250979:8872]
2025-10-02T08:15:53.024273Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:53.024289Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:53.024292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.024294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.024297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.024312Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:53.024316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:53.024322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:53.024386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.024394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.024397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:53.024400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:53.024535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:53.024536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2516
2025-10-02T08:15:53.024544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.024558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.024571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:53.024589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251024:8870], now have 1 active actors on pipe
2025-10-02T08:15:53.024592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535195806617038:2378], now have 1 active actors on pipe
2025-10-02T08:15:53.024597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.024602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.024622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535195347250971:8872]
2025-10-02T08:15:53.024629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535195347250971:8872]
2025-10-02T08:15:53.024596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2516
2025-10-02T08:15:53.024636Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:53.024647Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:53.024648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:53.024650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:53.024656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:53.024659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:53.024671Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:53.024679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.024681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.024682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:53.024688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.024695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:53.024728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535195347250971:8872]
2025-10-02T08:15:53.024737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:53.024742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:53.024745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.024793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.024798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.024828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.024856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2517 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0
2025-10-02T08:15:53.025165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd826f58-84b133af-3912fefd-cde0181f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:53.027550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0] Write session: try to update token
2025-10-02T08:15:53.027581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:53.037427Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:53.037445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.037451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535195347250971:8872]
2025-10-02T08:15:53.037489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:53.037501Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:53.037654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:53.037803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.037944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.038087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.038282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:53.038317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:53.040790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId: src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:53.043329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:53.043409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.043422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.043450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:53.043477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:53.043537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.043554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.043735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.043808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.043873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.043938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.044050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.044060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.044139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.044200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.044265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.044334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.044376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.044385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.044452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.044511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.044568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.044626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.044677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.044684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.044747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.044823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.044885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.044955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.044996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.045003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.045067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.045128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.045189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.045253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.045295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.045302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.045367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.045426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.045487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.045553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.045598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.045605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.045671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.045732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.045795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.045859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.045903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.045910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.045980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.046047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.046134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.046196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.046240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.046247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.046314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.046378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.046438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.046500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.046543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.046552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.046615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.046674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.046732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.046792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.046835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.046841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.046879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:53.046944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.046964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.046970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:53.046998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:53.047015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:53.047021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:53.047024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:53.047027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:53.047412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:53.047441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:53.047451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:53.047460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:53.047463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:53.047467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:53.048040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:53.048065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:53.048074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:53.048081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:53.048085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:53.048090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:53.048564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:53.048590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:53.048600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:53.048602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:53.048605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:53.049803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:53.049822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:53.049830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392953049
2025-10-02T08:15:53.049924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:53.049935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:53.049938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:53.049940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:53.049943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:53.049945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:53.050375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:53.050393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:53.050397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:53.050398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:53.050401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:53.050404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:53.050794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:53.050813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:53.050821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:53.050823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:53.050826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:53.050828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:53.051239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:53.051261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:53.051271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:53.052321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:53.052339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:53.052344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:53.052349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:53.052357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392953051
2025-10-02T08:15:53.052652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:53.052672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:53.052677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:53.052680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:53.052683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:53.052688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:53.053161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:53.053184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:53.053188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:53.053196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:53.053199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:53.053203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:53.053636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:53.053656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.053742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392953053
2025-10-02T08:15:53.054461Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:53.054480Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:53.054486Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:53.054492Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:53.056019Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:53.056031Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.056033Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:53.056042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535195347250971:8872]
2025-10-02T08:15:53.056045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535195347250971:8872]
2025-10-02T08:15:53.056090Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:53.056097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:53.056100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.056111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:53.056113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:53.056239Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:53.104210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535195347251048:8443]
2025-10-02T08:15:53.104308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2516, pipe: [1:7556535195347251048:8443]
2025-10-02T08:15:53.194139Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:53.194523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251048:8443], now have 1 active actors on pipe
2025-10-02T08:15:53.194642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:53.194649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:53.194676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2517 reason: error at write: Disconnected sessionId: src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0
2025-10-02T08:15:53.194719Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:53.194763Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:53.194839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2517 sessionId: src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0 is DEAD
2025-10-02T08:15:53.194974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:53.194984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0] Write session will restart in 0.008369s
2025-10-02T08:15:53.195007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0] Write session: Do CDS request
2025-10-02T08:15:53.195014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:53.194999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535195347251048:8443]
2025-10-02T08:15:53.201339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:53.202126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:53.202313Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:53.202322Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:53.202331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:53.202371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:53.202402Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535195347251192:8899]
2025-10-02T08:15:53.202844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:53.202981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:53.203007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:53.203220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:53.203255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.203261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.203261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.203262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.203262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.203266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.203272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.203274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.203276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.203278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.203281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.203285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.203291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.203293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.203296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.203298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.203300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.203303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.203305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.203307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.203317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:53.204238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.204292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:53.204302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2518
2025-10-02T08:15:53.204402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.204430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:53.204438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:53.204441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:53.204761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2518 sessionId:  describe result for acl check
2025-10-02T08:15:53.204785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:53.204789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:53.204790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:53.204794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535195347251208:8902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:53.205181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535195347251208:8902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:53.206940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535195347251208:8902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:53.210685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535195347251208:8902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:53.210702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535195347251208:8902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:53.210705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535195347251208:8902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:53.210714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:53.211339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:53.212831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:53.212846Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:53.212848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:53.212851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:53.212856Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2517 [1:7556535195347251192:8899]
2025-10-02T08:15:53.212864Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:53.212878Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:53.212887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.212889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.212893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.212905Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:53.212907Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:53.212913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:53.212956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.212961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.212963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:53.212965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:53.213010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:53.213015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.213023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.213030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:53.213041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535195347251186:8899]
2025-10-02T08:15:53.213045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535195347251186:8899]
2025-10-02T08:15:53.213050Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:53.213060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:53.213068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2517
2025-10-02T08:15:53.213072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:53.213071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:53.213074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:53.213075Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:53.213081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251240:8902], now have 1 active actors on pipe
2025-10-02T08:15:53.213083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535195806617044:2378], now have 1 active actors on pipe
2025-10-02T08:15:53.213107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535195347251186:8899]
2025-10-02T08:15:53.213115Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:53.213119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.213121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.213123Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:53.213151Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:53.213155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.213157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.213158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:53.213137Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2517
2025-10-02T08:15:53.213164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.213169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:53.213183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.213281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.213294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.213319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.213362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2518 partition: 0 MaxSeqNo: 17 sessionId: src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0
2025-10-02T08:15:53.213667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c3eb0-91c0d387-83c69b5f-aa54e252_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:53.216157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0] Write session: try to update token
2025-10-02T08:15:53.216172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:53.228988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId: src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:53.230070Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:53.230086Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.230089Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:53.230097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535195347251186:8899]
2025-10-02T08:15:53.230100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535195347251186:8899]
2025-10-02T08:15:53.230150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:53.230148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:53.230155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:53.230161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.230163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:53.230300Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:53.231388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:53.295143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535195347251256:8443]
2025-10-02T08:15:53.295275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2517, pipe: [1:7556535195347251256:8443]
2025-10-02T08:15:53.363201Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:53.363616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.363629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.363662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251256:8443], now have 1 active actors on pipe
2025-10-02T08:15:53.363782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535195347251256:8443]
2025-10-02T08:15:53.363813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:53.363816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:53.363906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:53.363880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2518 reason: error at write: Disconnected sessionId: src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0
2025-10-02T08:15:53.363894Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:53.364094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2518 sessionId: src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0 is DEAD
2025-10-02T08:15:53.364262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:53.364326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0] Write session will restart in 0.009688s
2025-10-02T08:15:53.364354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0] Write session: Do CDS request
2025-10-02T08:15:53.364362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:53.372367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:53.373725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:53.373907Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:53.373910Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:53.373932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:53.373978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:53.374015Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535195347251402:8920]
2025-10-02T08:15:53.374651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:53.374976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:53.375028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:53.375351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.375358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:53.375409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.375415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.375416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.375417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.375418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.375423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.375433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.375432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:53.375436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.375438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2519
2025-10-02T08:15:53.375440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.375444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.375450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.375456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.375462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.375472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.375477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.375482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.375491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.375496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.375506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.375511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.375535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:53.375554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.375585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:53.375596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:53.375600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:53.375937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2519 sessionId:  describe result for acl check
2025-10-02T08:15:53.375968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:53.375985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:53.375989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:53.375995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535195347251418:8891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:53.376473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535195347251418:8891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:53.379057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535195347251418:8891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:53.383609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535195347251418:8891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:53.383623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535195347251418:8891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:53.383627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535195347251418:8891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:53.383638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:53.383752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:53.385360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:53.385380Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:53.385382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:53.385386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:53.385391Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2518 [1:7556535195347251402:8920]
2025-10-02T08:15:53.385403Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:53.385417Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:53.385419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.385422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.385424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.385441Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:53.385447Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:53.385453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:53.385510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.385512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.385515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:53.385518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:53.385635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:53.385637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.385651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.385664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:53.385673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2518
2025-10-02T08:15:53.385683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251449:8891], now have 1 active actors on pipe
2025-10-02T08:15:53.385689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535195347251395:8920]
2025-10-02T08:15:53.385690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535195347251395:8920]
2025-10-02T08:15:53.385697Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:53.385709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:53.385724Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:53.385726Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:53.385754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535195347251395:8920]
2025-10-02T08:15:53.385756Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:53.385765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535195806617053:2378], now have 1 active actors on pipe
2025-10-02T08:15:53.385779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.385780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:53.385782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.385783Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:53.385789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:53.385816Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3566b09-f599e100-535006ab-f2274267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:53.385821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.385825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.385829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:53.385837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.385845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:53.385863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.385869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2518
2025-10-02T08:15:53.385961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.385974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.385999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.386037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2519 partition: 0 MaxSeqNo: 17 sessionId: src_id|3566b09-f599e100-535006ab-f2274267_0
2025-10-02T08:15:53.386477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13154568-7c02fb1c-b83f7ada-4f2d44f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3566b09-f599e100-535006ab-f2274267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:53.396256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3566b09-f599e100-535006ab-f2274267_0] Write session: try to update token
2025-10-02T08:15:53.396275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3566b09-f599e100-535006ab-f2274267_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:53.408378Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:53.408396Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.408398Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:53.408405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535195347251395:8920]
2025-10-02T08:15:53.408408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535195347251395:8920]
2025-10-02T08:15:53.408445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:53.408450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.408451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:53.408460Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:53.408467Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:53.408592Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:53.410824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId: src_id|3566b09-f599e100-535006ab-f2274267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:53.415986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:53.464134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535195347251465:8443]
2025-10-02T08:15:53.464231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2518, pipe: [1:7556535195347251465:8443]
2025-10-02T08:15:53.537744Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:53.538009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.538024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.538043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251465:8443], now have 1 active actors on pipe
2025-10-02T08:15:53.538182Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:53.538237Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:53.538420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535195347251465:8443]
2025-10-02T08:15:53.538437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:53.538477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2519 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3566b09-f599e100-535006ab-f2274267_0
2025-10-02T08:15:53.538627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2519 sessionId: src_id|3566b09-f599e100-535006ab-f2274267_0 is DEAD
2025-10-02T08:15:53.538755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3566b09-f599e100-535006ab-f2274267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:53.538765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3566b09-f599e100-535006ab-f2274267_0] Write session will restart in 0.008441s
2025-10-02T08:15:53.538786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3566b09-f599e100-535006ab-f2274267_0] Write session: Do CDS request
2025-10-02T08:15:53.538792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3566b09-f599e100-535006ab-f2274267_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:53.546746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:53.547089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:53.547255Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:53.547264Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:53.547273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:53.547313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:53.547348Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535195347251628:8950]
2025-10-02T08:15:53.547940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:53.548305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3566b09-f599e100-535006ab-f2274267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.548949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:53.549009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:53.549331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:53.549389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.549400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.549401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.549402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.549403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.549409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.549417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.549421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.549424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.549427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.549433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.549440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.549446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.549450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.549455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.549459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.549463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.549468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.549473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.549477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.549496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:53.549557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:53.549568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2520
2025-10-02T08:15:53.549679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.549707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:53.549716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:53.549719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:53.550043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2520 sessionId:  describe result for acl check
2025-10-02T08:15:53.550075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:53.550081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:53.550083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:53.550088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535195347251644:8960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:53.550471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535195347251644:8960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:53.552504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535195347251644:8960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:53.557294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535195347251644:8960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:53.557313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535195347251644:8960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:53.557316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535195347251644:8960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:53.557325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:53.557399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:53.559052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:53.559066Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:53.559068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:53.559072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:53.559076Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2519 [1:7556535195347251628:8950]
2025-10-02T08:15:53.559088Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:53.559108Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:53.559111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.559113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.559115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.559128Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:53.559132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:53.559142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:53.559197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.559203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.559206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:53.559208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:53.559266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:53.559273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.559283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.559298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:53.559317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535195347251622:8950]
2025-10-02T08:15:53.559322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535195347251622:8950]
2025-10-02T08:15:53.559328Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:53.559338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:53.559345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535195806617072:2378], now have 1 active actors on pipe
2025-10-02T08:15:53.559347Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:53.559350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:53.559361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:53.559368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:53.559395Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535195347251622:8950]
2025-10-02T08:15:53.559406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:53.559413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:53.559577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2519
2025-10-02T08:15:53.559590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251675:8960], now have 1 active actors on pipe
2025-10-02T08:15:53.559594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.559598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.559618Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74702f38-8265663e-5bc043f1-3ff74395_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:53.559628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.559636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.559637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:53.559676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2519
2025-10-02T08:15:53.559646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.559657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:53.559671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.559691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.559694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.559712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.559735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2520 partition: 0 MaxSeqNo: 17 sessionId: src_id|74702f38-8265663e-5bc043f1-3ff74395_0
2025-10-02T08:15:53.560034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3566b09-f599e100-535006ab-f2274267_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74702f38-8265663e-5bc043f1-3ff74395_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:53.562726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74702f38-8265663e-5bc043f1-3ff74395_0] Write session: try to update token
2025-10-02T08:15:53.562742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74702f38-8265663e-5bc043f1-3ff74395_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:53.570388Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:53.570403Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.570409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535195347251622:8950]
2025-10-02T08:15:53.570448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:53.570456Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:53.570601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:53.570736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.570873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.571007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.571297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:53.571330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:53.575280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId: src_id|74702f38-8265663e-5bc043f1-3ff74395_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:53.577850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:53.577904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.577917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.577952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:53.577973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:53.578030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.578047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.578211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.578301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.578372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.578444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.578504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.578512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.578583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.578682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.578749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.578825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.578877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.578884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.578950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.579012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.579074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.579138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.579183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.579190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.579262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.579339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.579408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.579474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.579516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.579523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.579587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.579642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.579697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.579754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.579799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.579808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.579893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.579972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.580035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.580094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.580146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.580153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.580216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.580273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.580348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.580427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.580475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.580486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.580574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.580635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.580694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.580754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.580794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.580816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.580883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.580940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.580998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.581054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.581094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.581099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.581161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.581216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.581272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.581329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.581799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.581810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.581846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:53.581904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.581921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.581927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:53.581952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:53.581965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:53.581970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:53.581972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:53.581974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:53.582348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:53.582374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:53.582383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:53.582386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:53.582389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:53.582392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:53.583038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:53.583063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:53.583072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:53.583075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:53.583078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:53.583081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:53.583545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:53.583567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:53.583573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:53.583577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:53.583580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:53.584742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:53.584760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:53.584772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392953584
2025-10-02T08:15:53.585025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:53.585040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:53.585045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:53.585047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:53.585051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:53.585055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:53.585471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:53.585497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:53.585501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:53.585504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:53.585506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:53.585509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:53.585997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:53.586016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:53.586021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:53.586024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:53.586026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:53.586028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:53.586457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:53.586477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:53.586481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:53.587450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:53.587464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:53.587467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:53.587469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:53.587474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392953587
2025-10-02T08:15:53.587729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:53.587748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:53.587753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:53.587756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:53.587759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:53.587762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:53.588193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:53.588211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:53.588215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:53.588217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:53.588220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:53.588222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:53.588627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:53.588642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.588735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392953588
2025-10-02T08:15:53.589416Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:53.589431Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:53.589437Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:53.589440Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:53.591736Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:53.591744Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.591745Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:53.591751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535195347251622:8950]
2025-10-02T08:15:53.591754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535195347251622:8950]
2025-10-02T08:15:53.591798Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:53.591803Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:53.591806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:53.591810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.591812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:53.591946Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:53.638726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535195347251722:8443]
2025-10-02T08:15:53.638820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2519, pipe: [1:7556535195347251722:8443]
2025-10-02T08:15:53.717236Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:53.717624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251722:8443], now have 1 active actors on pipe
2025-10-02T08:15:53.717756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:53.717767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:53.717792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2520 reason: error at write: Disconnected sessionId: src_id|74702f38-8265663e-5bc043f1-3ff74395_0
2025-10-02T08:15:53.717812Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:53.717862Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:53.717956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2520 sessionId: src_id|74702f38-8265663e-5bc043f1-3ff74395_0 is DEAD
2025-10-02T08:15:53.718086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535195347251722:8443]
2025-10-02T08:15:53.718107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74702f38-8265663e-5bc043f1-3ff74395_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:53.718128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74702f38-8265663e-5bc043f1-3ff74395_0] Write session will restart in 0.007256s
2025-10-02T08:15:53.718151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74702f38-8265663e-5bc043f1-3ff74395_0] Write session: Do CDS request
2025-10-02T08:15:53.718157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74702f38-8265663e-5bc043f1-3ff74395_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:53.725327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:53.726291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74702f38-8265663e-5bc043f1-3ff74395_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.726348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:53.726357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2521
2025-10-02T08:15:53.726440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:53.726503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.726543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:53.726554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:53.726557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:53.726597Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:53.726606Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:53.726614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:53.726658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:53.726710Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535195347251876:9002]
2025-10-02T08:15:53.726941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2521 sessionId:  describe result for acl check
2025-10-02T08:15:53.726993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:53.727001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:53.727002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:53.727008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535195347251880:9038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:53.727295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:53.727485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535195347251880:9038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:53.727522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:53.727568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:53.727822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:53.727863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.727867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.727868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.727868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.727869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.727872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.727878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.727880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.727882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.727884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.727888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.727892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.727896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.727899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.727901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.727904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.727906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.727909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.727911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.727913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.727924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:53.729372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535195347251880:9038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:53.734977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535195347251880:9038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:53.734995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535195347251880:9038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:53.734999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535195347251880:9038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:53.735007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:53.735331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:53.736854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:53.736872Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:53.736874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:53.736879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:53.736887Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2520 [1:7556535195347251876:9002]
2025-10-02T08:15:53.736897Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:53.736912Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:53.736919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.736922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.736923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.736940Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:53.736949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:53.736956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:53.737014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.737021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.737024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:53.737027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:53.737090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:53.737101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.737113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.737116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2520
2025-10-02T08:15:53.737125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:53.737141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251922:9038], now have 1 active actors on pipe
2025-10-02T08:15:53.737149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535195806617087:2378], now have 1 active actors on pipe
2025-10-02T08:15:53.737155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.737162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.737177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535195347251869:9002]
2025-10-02T08:15:53.737183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535195347251869:9002]
2025-10-02T08:15:53.737197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:53.737208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:53.737221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:53.737229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:53.737231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:53.737234Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:53.737209Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2520
2025-10-02T08:15:53.737243Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:53.737249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.737252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.737254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:53.737263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.737271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:53.737305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535195347251869:9002]
2025-10-02T08:15:53.737316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:53.737322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:53.737331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.737368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.737376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.737390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.737422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2521 partition: 0 MaxSeqNo: 17 sessionId: src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0
2025-10-02T08:15:53.737733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74702f38-8265663e-5bc043f1-3ff74395_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:53.740189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0] Write session: try to update token
2025-10-02T08:15:53.740203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:53.751754Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:53.751775Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.751784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535195347251869:9002]
2025-10-02T08:15:53.751821Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:53.751824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:53.751993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:53.752165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.752305Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.752439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.752627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:53.752665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:53.752876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId: src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:53.755070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:53.755155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.755164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.755186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:53.755204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:53.755259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.755272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.755409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.755461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.755514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.755570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.755613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.755621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.755681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.755732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.755785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.755842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.755883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.755889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.755943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.755995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.756072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.756146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.756179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.756181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.756236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.756297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.756361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.756418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.756456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.756462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.756516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.756569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.756629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.756684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.756722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.756727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.756785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.756856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.756916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.756977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.757015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.757021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.757074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.757129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.757195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.757253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.757294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.757299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.757358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.757408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.757461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.757513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.757551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.757555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.757608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.757658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.757712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.757763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.757800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.757805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.757861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.757911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.757964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.758015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.758053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.758058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.758082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:53.758127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.758144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.758148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:53.758169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:53.758182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:53.758187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:53.758189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:53.758190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:53.758511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:53.758531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:53.758540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:53.758542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:53.758544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:53.758546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:53.758991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:53.759013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:53.759017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:53.759019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:53.759022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:53.759024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:53.759439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:53.759455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:53.759459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:53.759461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:53.759463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:53.761260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:53.761278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:53.761286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392953761
2025-10-02T08:15:53.761392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:53.761403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:53.761407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:53.761410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:53.761412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:53.761414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:53.761822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:53.761840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:53.761849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:53.761853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:53.761855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:53.761858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:53.762232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:53.762247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:53.762251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:53.762253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:53.762258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:53.762261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:53.762645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:53.762660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:53.762664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:53.763560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:53.763576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:53.763579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:53.763581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:53.763586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392953763
2025-10-02T08:15:53.763832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:53.763847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:53.763850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:53.763853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:53.763855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:53.763857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:53.764280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:53.764297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:53.764301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:53.764303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:53.764305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:53.764309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:53.764720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:53.764738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.764839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392953764
2025-10-02T08:15:53.767771Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:53.767788Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:53.767793Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:53.767798Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:53.769246Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:53.769257Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.769258Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:53.769263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535195347251869:9002]
2025-10-02T08:15:53.769265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535195347251869:9002]
2025-10-02T08:15:53.769309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:53.769315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.769316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:53.769320Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:53.769326Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:53.769427Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:53.818432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535195347251950:8443]
2025-10-02T08:15:53.818530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2520, pipe: [1:7556535195347251950:8443]
2025-10-02T08:15:53.892638Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:53.892935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347251950:8443], now have 1 active actors on pipe
2025-10-02T08:15:53.893056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:53.893070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:53.893108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2521 reason: error at write: Disconnected sessionId: src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0
2025-10-02T08:15:53.893122Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:53.893161Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:53.893282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2521 sessionId: src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0 is DEAD
2025-10-02T08:15:53.893457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535195347251950:8443]
2025-10-02T08:15:53.893664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:53.893674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0] Write session will restart in 0.007157s
2025-10-02T08:15:53.893698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0] Write session: Do CDS request
2025-10-02T08:15:53.893704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:53.900657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:53.901095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:53.901232Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:53.901239Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:53.901247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:53.901278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:53.901315Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535195347252144:9080]
2025-10-02T08:15:53.901744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:53.901885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:53.901921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:53.902177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:53.902226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.902230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.902231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.902231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.902232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.902235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.902241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.902243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.902245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.902247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.902251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.902256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:53.902259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.902261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:53.902264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.902273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.902266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:53.902268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.902271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.902273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.902275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.902286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:53.902335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:53.902344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2522
2025-10-02T08:15:53.902490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:53.902509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:53.902515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:53.902518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:53.902893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2522 sessionId:  describe result for acl check
2025-10-02T08:15:53.902928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:53.902929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:53.902931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:53.902935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535195347252160:9078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:53.903377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535195347252160:9078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:53.905417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535195347252160:9078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:53.909428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535195347252160:9078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:53.909442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535195347252160:9078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:53.909445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535195347252160:9078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:53.909453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:53.909830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:53.911221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:53.911240Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:53.911243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:53.911246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:53.911251Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2521 [1:7556535195347252144:9080]
2025-10-02T08:15:53.911262Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:53.911276Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:53.911279Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.911282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.911284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.911299Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:53.911308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:53.911314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:53.911370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.911377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.911380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:53.911382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:53.911484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2521
2025-10-02T08:15:53.911522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:53.911524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.911536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:53.911555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:53.911578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347252192:9078], now have 1 active actors on pipe
2025-10-02T08:15:53.911585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535195806617107:2378], now have 1 active actors on pipe
2025-10-02T08:15:53.911589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.911594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.911564Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2521
2025-10-02T08:15:53.911608Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535195347252138:9080]
2025-10-02T08:15:53.911615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535195347252138:9080]
2025-10-02T08:15:53.911621Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:53.911631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:53.911634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:53.911641Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:53.911647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:53.911650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:53.911664Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:53.911669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.911678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.911680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:53.911687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.911696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:53.911732Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535195347252138:9080]
2025-10-02T08:15:53.911743Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:53.911755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:53.911758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.911802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.911809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.911822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:53.911857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2522 partition: 0 MaxSeqNo: 17 sessionId: src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0
2025-10-02T08:15:53.912173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07e696a-66d8a9b1-57d5f0bc-9384ef95_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:53.914635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0] Write session: try to update token
2025-10-02T08:15:53.914652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:53.922282Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:53.922304Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.922312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535195347252138:9080]
2025-10-02T08:15:53.922353Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:53.922357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:53.922530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:53.922676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.922813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.922952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:53.923155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:53.923199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:53.928518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId: src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:53.931212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:53.931278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.931290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.931321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:53.931346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:53.931395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:53.931409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:53.931546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.931605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.931665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.931728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.931877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.931884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.931943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.931994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.932047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.932115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.932155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.932160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.932219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.932275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.932325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.932379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.932426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.932431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.932486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.932535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.932587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.932642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.932680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.932686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.932752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.932836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.932896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.932949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.932988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.932993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.933066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.933120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.933183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.933243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.933281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.933286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.933345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.933401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.933464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.933525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.933572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.933579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.933636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.933688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.933742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.933799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.933836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.933841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.933900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.933952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.934006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.934072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.934114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.934121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.934181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:53.934257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:53.934310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:53.934360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:53.934401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:53.934406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:53.934439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:53.934491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:53.934512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:53.934518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:53.934544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:53.934559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:53.934566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:53.934570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:53.934577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:53.934914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:53.934935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:53.934939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:53.934942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:53.934943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:53.934946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:53.935469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:53.935488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:53.935492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:53.935495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:53.935497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:53.935499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:53.935952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:53.935972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:53.935976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:53.935979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:53.935981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:53.937117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:53.937131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:53.937139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392953936
2025-10-02T08:15:53.937233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:53.937246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:53.937253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:53.937260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:53.937264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:53.937267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:53.937672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:53.937690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:53.937693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:53.937701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:53.937703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:53.937705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:53.938106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:53.938125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:53.938135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:53.938138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:53.938144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:53.938149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:53.938537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:53.938553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:53.938557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:53.939493Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:53.939508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:53.939512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:53.939514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:53.939519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392953939
2025-10-02T08:15:53.939768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:53.939783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:53.939787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:53.939792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:53.939794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:53.939796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:53.940203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:53.940219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:53.940223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:53.940225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:53.940227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:53.940238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:53.940673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:53.940690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:53.940762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392953940
2025-10-02T08:15:53.945016Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:53.945050Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:53.945057Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:53.945064Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:53.946580Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:53.946593Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:53.946595Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:53.946607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535195347252138:9080]
2025-10-02T08:15:53.946611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535195347252138:9080]
2025-10-02T08:15:53.946662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:53.946663Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:53.946669Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:53.946672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:53.946674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:53.946799Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:53.993534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535195347252227:8443]
2025-10-02T08:15:53.993629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2521, pipe: [1:7556535195347252227:8443]
2025-10-02T08:15:54.077736Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:54.078091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535195347252227:8443], now have 1 active actors on pipe
2025-10-02T08:15:54.078190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535195347252227:8443]
2025-10-02T08:15:54.078209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:54.078215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:54.078238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2522 reason: error at write: Disconnected sessionId: src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0
2025-10-02T08:15:54.078339Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:54.078357Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:54.078437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2522 sessionId: src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0 is DEAD
2025-10-02T08:15:54.078560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:54.078571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0] Write session will restart in 0.005056s
2025-10-02T08:15:54.078595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0] Write session: Do CDS request
2025-10-02T08:15:54.078601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:54.084300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.084351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:54.084367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2523
2025-10-02T08:15:54.084506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.084534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:54.084543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:54.084547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:54.085054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2523 sessionId:  describe result for acl check
2025-10-02T08:15:54.085092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:54.085098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:54.085099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:54.085104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535199642219697:9141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:54.085558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535199642219697:9141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:54.087067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:54.087526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:54.087578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535199642219697:9141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:54.087724Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:54.087735Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:54.087746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:54.087816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:54.087850Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535199642219737:9126]
2025-10-02T08:15:54.088461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:54.088655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:54.088708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:54.089037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:54.089088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.089093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.089094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.089095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.089096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.089101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.089110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.089113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.089116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.089119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.089123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.089130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.089135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.089139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.089143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.089152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.089156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.089161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.089169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.089174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.089186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:54.093858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535199642219697:9141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:54.093886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535199642219697:9141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:54.093889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535199642219697:9141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:54.093897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:54.096971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:54.098692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:54.098713Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:54.098715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:54.098719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:54.098727Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2522 [1:7556535199642219737:9126]
2025-10-02T08:15:54.098739Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:54.098754Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:54.098758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.098761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.098762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.098779Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:54.098789Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:54.098796Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:54.098861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.098871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.098874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:54.098877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:54.098939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:54.098947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.098961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.098980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:54.098996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2522
2025-10-02T08:15:54.098999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642219765:9141], now have 1 active actors on pipe
2025-10-02T08:15:54.099006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535199642219730:9126]
2025-10-02T08:15:54.099008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535199642219730:9126]
2025-10-02T08:15:54.099015Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:54.099025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.099026Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:54.099029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:54.099034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.099049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535200101584410:2378], now have 1 active actors on pipe
2025-10-02T08:15:54.099062Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:54.099079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:54.099086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:54.099127Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:54.099139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.099146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.099148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:54.099156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.099170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:54.099181Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535199642219730:9126]
2025-10-02T08:15:54.099196Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:54.099207Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:54.099224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.099301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.099311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.099327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.099362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2523 partition: 0 MaxSeqNo: 17 sessionId: src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0
2025-10-02T08:15:54.099680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|517cd2df-bc7526d3-71e284d5-1a4f93f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:54.099141Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2522
2025-10-02T08:15:54.102359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0] Write session: try to update token
2025-10-02T08:15:54.102376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:54.110266Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:54.110283Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:54.110290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535199642219730:9126]
2025-10-02T08:15:54.110327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:54.110481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:54.110605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.110725Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.110860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.111048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:54.111087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:54.112863Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:54.116442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId: src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:54.118711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:54.118768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.118777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.118805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:54.118827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:54.118903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.118920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.119096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.119158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.119231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.119293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.119339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.119347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.119411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.119470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.119540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.119606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.119651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.119658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.119722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.119780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.119839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.119899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.119940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.119947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.120011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.120077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.120155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.120217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.120261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.120268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.120331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.120390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.120451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.120516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.120566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.120573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.120636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.120696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.120757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.120848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.120894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.120900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.120963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.121022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.121088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.121150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.121193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.121200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.121265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.121324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.121386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.121450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.121494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.121503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.121572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.121634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.121697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.121762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.121805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.121811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.121873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.121934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.121996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.122056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.122100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.122107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.122147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:54.122214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.122235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.122241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:54.122271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:54.122287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:54.122294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:54.122297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:54.122299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:54.122685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:54.122714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:54.122725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:54.122732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:54.122735Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:54.122738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:54.123265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:54.123288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:54.123293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:54.123296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:54.123299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:54.123303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:54.123827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:54.123851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:54.123857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:54.123865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:54.123867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:54.126318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:54.126336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:54.126347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392954126
2025-10-02T08:15:54.126502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:54.126515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:54.126521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:54.126524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:54.126528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:54.126531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:54.127002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:54.127023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:54.127028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:54.127032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:54.127039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:54.127045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:54.127490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:54.127513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:54.127519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:54.127527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:54.127533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:54.127537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:54.127986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:54.128008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:54.128014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:54.129130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:54.129148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:54.129152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:54.129157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:54.129164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392954128
2025-10-02T08:15:54.129448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:54.129468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:54.129475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:54.129482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:54.129486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:54.129489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:54.129959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:54.129986Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:54.129990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:54.129994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:54.129996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:54.130001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:54.130464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:54.130487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.130580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392954130
2025-10-02T08:15:54.131326Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:54.131363Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:54.131374Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:54.131385Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:54.133061Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:54.133078Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:54.133080Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:54.133091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535199642219730:9126]
2025-10-02T08:15:54.133094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535199642219730:9126]
2025-10-02T08:15:54.133143Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:54.133153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:54.133155Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:54.133157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.133159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:54.133294Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:54.178388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535199642219786:8443]
2025-10-02T08:15:54.178502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2522, pipe: [1:7556535199642219786:8443]
2025-10-02T08:15:54.266789Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:54.267081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642219786:8443], now have 1 active actors on pipe
2025-10-02T08:15:54.267216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535199642219786:8443]
2025-10-02T08:15:54.267243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:54.267246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:54.267274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2523 reason: error at write: Disconnected sessionId: src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0
2025-10-02T08:15:54.267330Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:54.267336Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:54.267463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2523 sessionId: src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0 is DEAD
2025-10-02T08:15:54.267624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:54.267634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0] Write session will restart in 0.008957s
2025-10-02T08:15:54.267656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0] Write session: Do CDS request
2025-10-02T08:15:54.267661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:54.274658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:54.275336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:54.275493Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:54.275500Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:54.275507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:54.275539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:54.275568Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535199642219980:9116]
2025-10-02T08:15:54.276016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:54.276200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:54.276242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:54.276455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:54.276484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.276488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.276489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.276490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.276490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.276493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.276500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.276502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.276504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.276506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.276510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.276514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.276518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.276520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.276523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.276525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.276528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.276531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.276533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.276536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.276546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:54.277289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.277335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:54.277345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2524
2025-10-02T08:15:54.277498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.277522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:54.277526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:54.277529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:54.277849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2524 sessionId:  describe result for acl check
2025-10-02T08:15:54.277872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:54.277874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:54.277875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:54.277879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535199642219996:9107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:54.278345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535199642219996:9107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:54.279899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535199642219996:9107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:54.283768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535199642219996:9107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:54.283782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535199642219996:9107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:54.283785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535199642219996:9107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:54.283799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:54.284277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:54.285703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:54.285717Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:54.285718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:54.285721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:54.285725Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2523 [1:7556535199642219980:9116]
2025-10-02T08:15:54.285733Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:54.285744Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:54.285746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.285747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.285749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.285761Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:54.285764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:54.285769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:54.285815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.285823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.285826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:54.285828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:54.285889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:54.285899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.285901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2523
2025-10-02T08:15:54.285907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.285914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:54.285929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642220027:9107], now have 1 active actors on pipe
2025-10-02T08:15:54.285932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535200101584418:2378], now have 1 active actors on pipe
2025-10-02T08:15:54.285937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.285945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.285960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535199642219974:9116]
2025-10-02T08:15:54.285966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535199642219974:9116]
2025-10-02T08:15:54.285976Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:54.285981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:54.285983Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:54.285990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:54.285997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:54.285999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:54.286009Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:54.286019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.286024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.286025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:54.286031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.286040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:54.285987Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2523
2025-10-02T08:15:54.286074Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535199642219974:9116]
2025-10-02T08:15:54.286086Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:54.286105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.286112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:54.286155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.286160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.286170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.286194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2524 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0
2025-10-02T08:15:54.286567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8cfba-7d1aabf9-e5499c83-ec7ff46d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:54.289050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0] Write session: try to update token
2025-10-02T08:15:54.289063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:54.296672Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:54.296695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:54.296704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535199642219974:9116]
2025-10-02T08:15:54.296745Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:54.296753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:54.296977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:54.297149Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.297303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.297471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.297707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:54.297756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:54.302889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId: src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:54.305271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:54.305358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.305373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.305405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:54.305428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:54.305483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.305500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.305653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.305723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.305804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.305867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.306098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.306107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.306177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.306231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.306293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.306359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.306402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.306408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.306467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.306524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.306577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.306628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.306667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.306672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.306732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.306793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.306853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.306912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.306953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.306959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.307017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.307077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.307132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.307187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.307233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.307240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.307302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.307359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.307428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.307487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.307531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.307539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.307603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.307660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.307717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.307780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.307820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.307826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.307888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.307943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.308001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.308059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.308109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.308115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.308171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.308226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.308284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.308349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.308393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.308400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.308460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.308519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.308580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.308640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.308685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.308691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.308725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:54.308776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.308793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.308798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:54.308841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:54.308854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:54.308859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:54.308861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:54.308862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:54.309204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:54.309225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:54.309229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:54.309231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:54.309233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:54.309235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:54.309729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:54.309751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:54.309755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:54.309757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:54.309759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:54.309760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:54.310172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:54.310189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:54.310194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:54.310196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:54.310199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:54.311291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:54.311307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:54.311316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392954310
2025-10-02T08:15:54.311547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:54.311559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:54.311562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:54.311565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:54.311568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:54.311570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:54.311989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:54.312009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:54.312016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:54.312019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:54.312024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:54.312027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:54.312474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:54.312495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:54.312509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:54.312511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:54.312513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:54.312514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:54.312937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:54.312954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:54.312957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:54.313936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:54.313952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:54.313955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:54.313958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:54.313963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392954313
2025-10-02T08:15:54.314234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:54.314251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:54.314256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:54.314261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:54.314269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:54.314273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:54.314671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:54.314688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:54.314694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:54.314698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:54.314701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:54.314704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:54.315149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:54.315166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.315260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392954315
2025-10-02T08:15:54.315954Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:54.315972Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:54.315978Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:54.315984Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:54.317486Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:54.317507Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:54.317508Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:54.317519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535199642219974:9116]
2025-10-02T08:15:54.317523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535199642219974:9116]
2025-10-02T08:15:54.317566Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:54.317570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:54.317573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.317574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:54.317580Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:54.317700Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:54.367337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535199642220049:8443]
2025-10-02T08:15:54.367484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2523, pipe: [1:7556535199642220049:8443]
2025-10-02T08:15:54.450295Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:54.450704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642220049:8443], now have 1 active actors on pipe
2025-10-02T08:15:54.450845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535199642220049:8443]
2025-10-02T08:15:54.450881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:54.450890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:54.450915Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:54.450917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2524 reason: error at write: Disconnected sessionId: src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0
2025-10-02T08:15:54.450921Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:54.451079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2524 sessionId: src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0 is DEAD
2025-10-02T08:15:54.451202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:54.451212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0] Write session will restart in 0.006069s
2025-10-02T08:15:54.451254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0] Write session: Do CDS request
2025-10-02T08:15:54.451259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:54.458224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.458288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:54.458302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2525
2025-10-02T08:15:54.458417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.458446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:54.458451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:54.458454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:54.458795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2525 sessionId:  describe result for acl check
2025-10-02T08:15:54.458813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:54.458814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:54.458815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:54.458818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535199642220238:9154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:54.459134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:54.459221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535199642220238:9154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:54.459634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:54.459784Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:54.459787Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:54.459797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:54.459847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:54.459875Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535199642220252:9149]
2025-10-02T08:15:54.460465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:54.460666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:54.460710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:54.461006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:54.461047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.461048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.461049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.461053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.461055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.461060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.461068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.461072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.461077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.461081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.461085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.461092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.461096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.461101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.461105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.461109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.461113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.461117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.461122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.461125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.461143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:54.462147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535199642220238:9154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:54.467642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535199642220238:9154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:54.467662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535199642220238:9154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:54.467665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535199642220238:9154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:54.467673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:54.468601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:54.470438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:54.470459Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:54.470461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:54.470465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:54.470471Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2524 [1:7556535199642220252:9149]
2025-10-02T08:15:54.470482Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:54.470499Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:54.470507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.470511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.470514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.470528Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:54.470537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:54.470544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:54.470608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.470616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.470618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:54.470621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:54.470688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:54.470700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.470713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.470726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:54.470726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2524
2025-10-02T08:15:54.470742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642220294:9154], now have 1 active actors on pipe
2025-10-02T08:15:54.470746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535200101584425:2378], now have 1 active actors on pipe
2025-10-02T08:15:54.470750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.470753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.470769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535199642220241:9149]
2025-10-02T08:15:54.470771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535199642220241:9149]
2025-10-02T08:15:54.470782Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:54.470798Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:54.470811Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:54.470814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:54.470817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:54.470824Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:54.470789Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2524
2025-10-02T08:15:54.470830Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:54.470836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.470840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.470841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:54.470851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.470859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:54.470888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535199642220241:9149]
2025-10-02T08:15:54.470895Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:54.470908Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:54.470916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.470991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.470998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.471013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.471052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2525 partition: 0 MaxSeqNo: 17 sessionId: src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0
2025-10-02T08:15:54.471398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf68253d-40e85020-88e333fe-13c4ff9c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:54.473925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0] Write session: try to update token
2025-10-02T08:15:54.473938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:54.486286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId: src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:54.487129Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:54.487144Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:54.487146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:54.487152Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535199642220241:9149]
2025-10-02T08:15:54.487155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535199642220241:9149]
2025-10-02T08:15:54.487189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:54.487190Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:54.487194Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:54.487197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.487199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:54.487321Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:54.488580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:54.551110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535199642220309:8443]
2025-10-02T08:15:54.551223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2524, pipe: [1:7556535199642220309:8443]
2025-10-02T08:15:54.621337Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:54.621670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.621682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.621722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642220309:8443], now have 1 active actors on pipe
2025-10-02T08:15:54.621876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:54.621890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:54.621955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2525 reason: error at write: Disconnected sessionId: src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0
2025-10-02T08:15:54.621937Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:54.622112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2525 sessionId: src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0 is DEAD
2025-10-02T08:15:54.622229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:54.622237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0] Write session will restart in 0.005877s
2025-10-02T08:15:54.622262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0] Write session: Do CDS request
2025-10-02T08:15:54.622269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:54.622282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535199642220309:8443]
2025-10-02T08:15:54.622651Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:54.629222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.629265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:54.629278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2526
2025-10-02T08:15:54.629405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.629407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:54.629426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:54.629435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:54.629437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:54.629764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2526 sessionId:  describe result for acl check
2025-10-02T08:15:54.629802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:54.629808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:54.629809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:54.629814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535199642220549:9297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:54.629975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:54.630099Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:54.630106Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:54.630112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:54.630155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:54.630182Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535199642220551:9246]
2025-10-02T08:15:54.630310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535199642220549:9297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:54.630597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:54.630756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:54.630782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:54.631015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:54.631055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.631059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.631059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.631060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.631060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.631064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.631072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.631076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.631079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.631082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.631087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.631093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.631102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.631110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.631118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.631122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.631130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.631134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.631139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.631147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.631159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:54.632375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535199642220549:9297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:54.637902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535199642220549:9297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:54.637920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535199642220549:9297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:54.637923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535199642220549:9297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:54.637931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:54.638816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:54.640165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:54.640178Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:54.640180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:54.640184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:54.640189Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2525 [1:7556535199642220551:9246]
2025-10-02T08:15:54.640200Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:54.640215Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:54.640221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.640224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.640226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.640241Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:54.640251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:54.640258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:54.640303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.640309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.640312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:54.640314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:54.640369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:54.640375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.640386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.640402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:54.640402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2525
2025-10-02T08:15:54.640423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642220593:9297], now have 1 active actors on pipe
2025-10-02T08:15:54.640430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535200101584454:2378], now have 1 active actors on pipe
2025-10-02T08:15:54.640434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.640441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.640455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535199642220543:9246]
2025-10-02T08:15:54.640461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535199642220543:9246]
2025-10-02T08:15:54.640472Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:54.640486Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:54.640492Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:54.640494Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:54.640503Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:54.640506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:54.640520Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:54.640491Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2525
2025-10-02T08:15:54.640528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.640535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.640536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:54.640544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.640555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:54.640593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535199642220543:9246]
2025-10-02T08:15:54.640602Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:54.640615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.640616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:54.640717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.640724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.640738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.640775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2526 partition: 0 MaxSeqNo: 17 sessionId: src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0
2025-10-02T08:15:54.641087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbe45de2-ba782562-32b23c84-d6b29f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:54.643492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0] Write session: try to update token
2025-10-02T08:15:54.643505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:54.656454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId: src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:54.657693Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:54.657708Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:54.657710Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:54.657718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535199642220543:9246]
2025-10-02T08:15:54.657722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535199642220543:9246]
2025-10-02T08:15:54.657759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:54.657765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.657771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:54.657771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:54.657778Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:54.657897Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:54.659118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:54.722651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535199642220610:8443]
2025-10-02T08:15:54.722787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2525, pipe: [1:7556535199642220610:8443]
2025-10-02T08:15:54.792421Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:54.792854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.792871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.792905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642220610:8443], now have 1 active actors on pipe
2025-10-02T08:15:54.793002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:54.793013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:54.793064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2526 reason: error at write: Disconnected sessionId: src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0
2025-10-02T08:15:54.793098Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:54.793176Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:54.793235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2526 sessionId: src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0 is DEAD
2025-10-02T08:15:54.793387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535199642220610:8443]
2025-10-02T08:15:54.793400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:54.793410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0] Write session will restart in 0.008917s
2025-10-02T08:15:54.793439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0] Write session: Do CDS request
2025-10-02T08:15:54.793445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:54.799743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:54.800245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:54.800393Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:54.800403Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:54.800411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:54.800451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:54.800485Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535199642220811:9282]
2025-10-02T08:15:54.801118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:54.801255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:54.801289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:54.801569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:54.801608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.801614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.801615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.801616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.801617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.801621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.801631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.801634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.801638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.801641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.801646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.801653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.801658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.801668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.801672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.801676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.801681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.801689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.801694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.801699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.801718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:54.803243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.803305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:54.803320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2527
2025-10-02T08:15:54.803422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.803448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:54.803457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:54.803460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:54.803829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2527 sessionId:  describe result for acl check
2025-10-02T08:15:54.803860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:54.803866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:54.803867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:54.803872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535199642220827:9283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:54.804361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535199642220827:9283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:54.806505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535199642220827:9283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:54.808850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:54.808972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535199642220827:9283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:54.808985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535199642220827:9283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:54.808987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535199642220827:9283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:54.808993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:54.810329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:54.810345Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:54.810347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:54.810349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:54.810355Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2526 [1:7556535199642220811:9282]
2025-10-02T08:15:54.810364Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:54.810378Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:54.810386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.810389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.810391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.810405Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:54.810413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:54.810418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:54.810470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.810477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.810480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:54.810482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:54.810539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:54.810545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.810555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.810566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:54.810568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2526
2025-10-02T08:15:54.810585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642220858:9283], now have 1 active actors on pipe
2025-10-02T08:15:54.810592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535200101584461:2378], now have 1 active actors on pipe
2025-10-02T08:15:54.810596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.810604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.810619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535199642220805:9282]
2025-10-02T08:15:54.810626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535199642220805:9282]
2025-10-02T08:15:54.810635Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:54.810645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:54.810647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:54.810648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:54.810658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:54.810661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:54.810674Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf2c742-3542a20f-efff5032-d606c617_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:54.810682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.810689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.810691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:54.810699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.810660Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2526
2025-10-02T08:15:54.810707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:54.810739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535199642220805:9282]
2025-10-02T08:15:54.810748Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:54.810754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:54.810762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.810807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.810814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.810827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.810858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2527 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf2c742-3542a20f-efff5032-d606c617_0
2025-10-02T08:15:54.811121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc8560-4dfc9f21-d1bbe835-2671b90f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf2c742-3542a20f-efff5032-d606c617_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:54.813428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c742-3542a20f-efff5032-d606c617_0] Write session: try to update token
2025-10-02T08:15:54.813439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c742-3542a20f-efff5032-d606c617_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:54.821273Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:54.821291Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:54.821299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535199642220805:9282]
2025-10-02T08:15:54.821333Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:54.821337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:54.822083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:54.822539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.822692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.822839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:54.823028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:54.823065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:54.827414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId: src_id|bf2c742-3542a20f-efff5032-d606c617_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:54.829975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:54.830044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.830056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.830087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:54.830118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:54.830154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.830169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.830325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.830386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.830449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.830512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.830556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.830565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.830650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.830712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.830774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.830838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.830879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.830886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.830951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.831003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.831054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.831104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.831148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.831155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.831215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.831266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.831327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.831383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.831425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.831430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.831487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.831538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.831593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.831654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.831694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.831699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.831764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.831823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.831883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.831936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.831977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.831982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.832038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.832088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.832163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.832225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.832270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.832276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.832340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.832395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.832449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.832502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.832539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.832545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.832612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.832669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.832727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.832784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.832850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.832856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.832918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:54.832990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:54.833048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:54.833105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:54.833146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:54.833152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:54.833189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:54.833252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.833274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.833280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:54.833308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:54.833324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:54.833331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:54.833334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:54.833337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:54.833775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:54.833801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:54.833811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:54.833814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:54.833817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:54.833820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:54.834393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:54.834413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:54.834419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:54.834424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:54.834427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:54.834430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:54.834928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:54.834946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:54.834949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:54.834952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:54.834954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:54.835971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:54.835987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:54.835997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392954835
2025-10-02T08:15:54.836090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:54.836135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:54.836142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:54.836145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:54.836147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:54.836149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:54.836591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:54.836608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:54.836611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:54.836613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:54.836615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:54.836617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:54.837051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:54.837066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:54.837070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:54.837072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:54.837076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:54.837078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:54.837465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:54.837482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:54.837486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:54.838428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:54.838442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:54.838445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:54.838447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:54.838453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392954838
2025-10-02T08:15:54.838723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:54.838738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:54.838742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:54.838744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:54.838746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:54.838749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:54.839144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:54.839161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:54.839165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:54.839167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:54.839169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:54.839171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:54.839563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:54.839580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.839650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392954839
2025-10-02T08:15:54.840300Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:54.840321Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:54.840328Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:54.840335Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:54.841731Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:54.841742Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:54.841743Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:54.841750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535199642220805:9282]
2025-10-02T08:15:54.841752Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535199642220805:9282]
2025-10-02T08:15:54.841793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:54.841796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:54.841800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.841801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:54.841802Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:54.841917Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:54.893643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535199642220882:8443]
2025-10-02T08:15:54.893747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2526, pipe: [1:7556535199642220882:8443]
2025-10-02T08:15:54.975880Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:54.976279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642220882:8443], now have 1 active actors on pipe
2025-10-02T08:15:54.976399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535199642220882:8443]
2025-10-02T08:15:54.976426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:54.976429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:54.976440Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:54.976457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2527 reason: error at write: Disconnected sessionId: src_id|bf2c742-3542a20f-efff5032-d606c617_0
2025-10-02T08:15:54.976472Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:54.976619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2527 sessionId: src_id|bf2c742-3542a20f-efff5032-d606c617_0 is DEAD
2025-10-02T08:15:54.976753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c742-3542a20f-efff5032-d606c617_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:54.976764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c742-3542a20f-efff5032-d606c617_0] Write session will restart in 0.007025s
2025-10-02T08:15:54.976785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c742-3542a20f-efff5032-d606c617_0] Write session: Do CDS request
2025-10-02T08:15:54.976792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c742-3542a20f-efff5032-d606c617_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:54.982883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:54.983547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:54.983693Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:54.983701Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:54.983709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:54.983747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:54.983778Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535199642221099:9291]
2025-10-02T08:15:54.984224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:54.984375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:54.984403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:54.984599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:54.984638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.984643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.984644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.984645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.984646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.984650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.984657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.984659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.984661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.984662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.984666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.984670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:54.984673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.984676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:54.984680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.984683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:54.984685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.984688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.984690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.984693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.984702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:54.985208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c742-3542a20f-efff5032-d606c617_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.985247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:54.985257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2528
2025-10-02T08:15:54.985384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:54.985403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:54.985409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:54.985412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:54.985760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2528 sessionId:  describe result for acl check
2025-10-02T08:15:54.985803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:54.985812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:54.985813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:54.985818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535199642221115:9320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:54.986318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535199642221115:9320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:54.988049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535199642221115:9320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:54.991678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535199642221115:9320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:54.991690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535199642221115:9320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:54.991694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535199642221115:9320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:54.991700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:54.995684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:54.997223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:54.997239Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:54.997242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:54.997245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:54.997250Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2527 [1:7556535199642221099:9291]
2025-10-02T08:15:54.997261Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:54.997279Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:54.997286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.997291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.997294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.997307Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:54.997314Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:54.997319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:54.997376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.997384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.997386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:54.997389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:54.997453Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:54.997461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:54.997473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:54.997488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:54.997489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2527
2025-10-02T08:15:54.997509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535199642221143:9320], now have 1 active actors on pipe
2025-10-02T08:15:54.997519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535199642221093:9291]
2025-10-02T08:15:54.997521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535199642221093:9291]
2025-10-02T08:15:54.997534Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:54.997546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535200101584481:2378], now have 1 active actors on pipe
2025-10-02T08:15:54.997551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:54.997554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:54.997555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.997559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.997578Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:54.997596Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:54.997606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:54.997581Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2527
2025-10-02T08:15:54.997646Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:54.997656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:54.997659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:54.997660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:54.997671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:54.997684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:54.997700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535199642221093:9291]
2025-10-02T08:15:54.997712Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:54.997728Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:54.997740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.997804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:54.997812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:54.997826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:54.997864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2528 partition: 0 MaxSeqNo: 17 sessionId: src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0
2025-10-02T08:15:54.998189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf2c742-3542a20f-efff5032-d606c617_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:55.000640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0] Write session: try to update token
2025-10-02T08:15:55.000657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:55.014446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId: src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:55.014659Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:55.014677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:55.014679Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:55.014687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535199642221093:9291]
2025-10-02T08:15:55.014691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535199642221093:9291]
2025-10-02T08:15:55.014730Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:55.014733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:55.014735Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:55.014738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.014740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:55.014882Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:55.017048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:55.076432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535203937188453:8443]
2025-10-02T08:15:55.076554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2527, pipe: [1:7556535203937188453:8443]
2025-10-02T08:15:55.148161Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:15:55.148534Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:55.148851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.148866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.148901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937188453:8443], now have 1 active actors on pipe
2025-10-02T08:15:55.148998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535203937188453:8443]
2025-10-02T08:15:55.149016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:55.149022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:55.149068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2528 reason: error at write: Disconnected sessionId: src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0
2025-10-02T08:15:55.149124Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:55.149155Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:55.149199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2528 sessionId: src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0 is DEAD
2025-10-02T08:15:55.149332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:55.149336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0] Write session will restart in 0.009741s
2025-10-02T08:15:55.149354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0] Write session: Do CDS request
2025-10-02T08:15:55.149358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:55.157668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:55.158212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:55.158361Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:55.158369Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:55.158376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:55.158410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:55.158439Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535203937188659:9331]
2025-10-02T08:15:55.158841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:55.159009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:55.159038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:55.159222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:55.159249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.159253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.159254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.159254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.159255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.159258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.159264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.159266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.159268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.159270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.159274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.159278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.159281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.159283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.159288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.159291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.159293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.159296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.159298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.159300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.159311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:55.160340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.160412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:55.160428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2529
2025-10-02T08:15:55.160556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.160583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:55.160591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:55.160594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:55.160975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2529 sessionId:  describe result for acl check
2025-10-02T08:15:55.161017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:55.161030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:55.161031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:55.161036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535203937188675:9337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:55.161499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535203937188675:9337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:55.163350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535203937188675:9337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:55.166367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535203937188675:9337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:55.166379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535203937188675:9337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:55.166383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535203937188675:9337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:55.166390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:55.166976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:55.168330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:55.168343Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:55.168345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:55.168347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:55.168352Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2528 [1:7556535203937188659:9331]
2025-10-02T08:15:55.168360Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:55.168372Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:55.168374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.168376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.168377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.168388Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:55.168391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:55.168395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:55.168433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.168439Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.168442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:55.168443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:55.168490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:55.168495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.168502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.168509Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:55.168520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535203937188653:9331]
2025-10-02T08:15:55.168525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535203937188653:9331]
2025-10-02T08:15:55.168530Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:55.168539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937188707:9337], now have 1 active actors on pipe
2025-10-02T08:15:55.168540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:55.168542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2528
2025-10-02T08:15:55.168543Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:55.168544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535204396551783:2378], now have 1 active actors on pipe
2025-10-02T08:15:55.168547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:55.168555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:55.168557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:55.168585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.168593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.168605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535203937188653:9331]
2025-10-02T08:15:55.168612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:55.168609Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2528
2025-10-02T08:15:55.168634Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f22b03ba-508fbda-36c00abd-daf107ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:55.168635Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:55.168644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.168647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.168648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:55.168654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.168665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:55.168686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.168732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.168744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.168765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.168817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2529 partition: 0 MaxSeqNo: 17 sessionId: src_id|f22b03ba-508fbda-36c00abd-daf107ec_0
2025-10-02T08:15:55.169114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1123fb1c-f8e482b1-4e58ec3b-dbfab7da_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f22b03ba-508fbda-36c00abd-daf107ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:55.171542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22b03ba-508fbda-36c00abd-daf107ec_0] Write session: try to update token
2025-10-02T08:15:55.171555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22b03ba-508fbda-36c00abd-daf107ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:55.185576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId: src_id|f22b03ba-508fbda-36c00abd-daf107ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:55.185764Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:55.185780Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:55.185783Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:55.185792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535203937188653:9331]
2025-10-02T08:15:55.185797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535203937188653:9331]
2025-10-02T08:15:55.185841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:55.185841Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:55.185846Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:55.185851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.185853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:55.186003Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:55.188061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:55.248981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535203937188721:8443]
2025-10-02T08:15:55.249113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2528, pipe: [1:7556535203937188721:8443]
2025-10-02T08:15:55.320868Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:55.321279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.321295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.321332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937188721:8443], now have 1 active actors on pipe
2025-10-02T08:15:55.321519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:55.321556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:55.321563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:55.321564Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:55.321617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2529 reason: error at write: Disconnected sessionId: src_id|f22b03ba-508fbda-36c00abd-daf107ec_0
2025-10-02T08:15:55.321897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22b03ba-508fbda-36c00abd-daf107ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:55.321907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22b03ba-508fbda-36c00abd-daf107ec_0] Write session will restart in 0.007378s
2025-10-02T08:15:55.321928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22b03ba-508fbda-36c00abd-daf107ec_0] Write session: Do CDS request
2025-10-02T08:15:55.321934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22b03ba-508fbda-36c00abd-daf107ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:55.321773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2529 sessionId: src_id|f22b03ba-508fbda-36c00abd-daf107ec_0 is DEAD
2025-10-02T08:15:55.321835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535203937188721:8443]
2025-10-02T08:15:55.329307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:55.330083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:55.330260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f22b03ba-508fbda-36c00abd-daf107ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.330279Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:55.330291Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:55.330303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:55.330304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:55.330310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2530
2025-10-02T08:15:55.330365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:55.330403Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535203937188928:9369]
2025-10-02T08:15:55.330471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.330503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:55.330508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:55.330511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:55.330872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2530 sessionId:  describe result for acl check
2025-10-02T08:15:55.330902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:55.330908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:55.330910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:55.330915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535203937188933:9425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:55.331045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:55.331215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:55.331259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:55.331400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535203937188933:9425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:55.331549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:55.331617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.331623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.331624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.331626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.331627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.331631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.331640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.331644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.331647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.331649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.331654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.331661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.331666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.331670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.331674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.331678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.331682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.331687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.331691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.331695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.331711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:55.333341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535203937188933:9425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:55.338920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535203937188933:9425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:55.338940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535203937188933:9425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:55.338943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535203937188933:9425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:55.338952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:55.339379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:55.341073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:55.341091Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:55.341094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:55.341098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:55.341104Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2529 [1:7556535203937188928:9369]
2025-10-02T08:15:55.341116Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:55.341131Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:55.341134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.341137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.341141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.341156Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:55.341166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:55.341171Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:55.341232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.341239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.341241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:55.341244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:55.341309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:55.341316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.341330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.341347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:55.341363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2529
2025-10-02T08:15:55.341369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535204396551792:2378], now have 1 active actors on pipe
2025-10-02T08:15:55.341372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937188975:9425], now have 1 active actors on pipe
2025-10-02T08:15:55.341377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535203937188922:9369]
2025-10-02T08:15:55.341379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535203937188922:9369]
2025-10-02T08:15:55.341392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:55.341406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.341414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.341416Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:55.341420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:55.341402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2529
2025-10-02T08:15:55.341431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:55.341448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:55.341454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:55.341497Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:55.341507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.341510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.341512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:55.341521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.341533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:55.341549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535203937188922:9369]
2025-10-02T08:15:55.341560Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:55.341571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:55.341583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.341643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.341651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.341665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.341706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2530 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0
2025-10-02T08:15:55.342022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f22b03ba-508fbda-36c00abd-daf107ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:55.344566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0] Write session: try to update token
2025-10-02T08:15:55.344586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:55.357605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId: src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:55.359116Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:55.359142Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:55.359145Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:55.359155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535203937188922:9369]
2025-10-02T08:15:55.359159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535203937188922:9369]
2025-10-02T08:15:55.359207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:55.359221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.359224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:55.359296Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:55.359310Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:55.359402Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:55.360597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:55.424965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535203937188989:8443]
2025-10-02T08:15:55.425182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2529, pipe: [1:7556535203937188989:8443]
2025-10-02T08:15:55.494069Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:55.494359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.494372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.494410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937188989:8443], now have 1 active actors on pipe
2025-10-02T08:15:55.494517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535203937188989:8443]
2025-10-02T08:15:55.494537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:55.494543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:55.494593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2530 reason: error at write: Disconnected sessionId: src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0
2025-10-02T08:15:55.494654Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:55.494742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2530 sessionId: src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0 is DEAD
2025-10-02T08:15:55.495067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:55.495077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0] Write session will restart in 0.007273s
2025-10-02T08:15:55.495100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0] Write session: Do CDS request
2025-10-02T08:15:55.495108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:55.496853Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:55.503291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.503322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:55.503338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2531
2025-10-02T08:15:55.503507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.503568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:55.503574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:55.503578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:55.503582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:55.503955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2531 sessionId:  describe result for acl check
2025-10-02T08:15:55.503986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:55.503987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:55.503988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:55.503991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535203937189200:9443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:55.504358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:55.504390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535203937189200:9443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:55.504590Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:55.504602Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:55.504613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:55.504671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:55.504707Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535203937189206:9442]
2025-10-02T08:15:55.505335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:55.505492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:55.505554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:55.505842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:55.505904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.505910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.505911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.505912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.505913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.505919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.505927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.505935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.505939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.505942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.505948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.505955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.505965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.505970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.505974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.505981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.505985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.505989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.505994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.505999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.506016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:55.506222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535203937189200:9443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:55.511482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535203937189200:9443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:55.511498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535203937189200:9443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:55.511501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535203937189200:9443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:55.511507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:55.513564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:55.514981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:55.515002Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:55.515004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:55.515008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:55.515014Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2530 [1:7556535203937189206:9442]
2025-10-02T08:15:55.515024Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:55.515039Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:55.515046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.515048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.515050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.515067Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:55.515077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:55.515083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:55.515165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.515173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.515176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:55.515179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:55.515237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:55.515244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.515255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.515271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:55.515285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2530
2025-10-02T08:15:55.515292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937189248:9443], now have 1 active actors on pipe
2025-10-02T08:15:55.515295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535204396551798:2378], now have 1 active actors on pipe
2025-10-02T08:15:55.515301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535203937189195:9442]
2025-10-02T08:15:55.515303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535203937189195:9442]
2025-10-02T08:15:55.515314Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:55.515327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:55.515327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.515331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.515337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:55.515347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:55.515359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:55.515365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:55.515404Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|492d784-c7b68879-f53bd792-17a1a13c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:55.515414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.515417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.515420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:55.515429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.515440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:55.515453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535203937189195:9442]
2025-10-02T08:15:55.515464Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:55.515471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:55.515485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.515551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.515557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.515568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.515598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2531 partition: 0 MaxSeqNo: 17 sessionId: src_id|492d784-c7b68879-f53bd792-17a1a13c_0
2025-10-02T08:15:55.515925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf739f5c-ceb3507d-74aeb01b-6a067aa7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|492d784-c7b68879-f53bd792-17a1a13c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:55.516321Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2530
2025-10-02T08:15:55.518508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492d784-c7b68879-f53bd792-17a1a13c_0] Write session: try to update token
2025-10-02T08:15:55.518527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492d784-c7b68879-f53bd792-17a1a13c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:55.532267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId: src_id|492d784-c7b68879-f53bd792-17a1a13c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:55.533270Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:55.533288Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:55.533290Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:55.533298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535203937189195:9442]
2025-10-02T08:15:55.533302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535203937189195:9442]
2025-10-02T08:15:55.533347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:55.533358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.533360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:55.533359Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:55.533364Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:55.533504Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:55.534899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:55.594579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535203937189261:8443]
2025-10-02T08:15:55.594679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2530, pipe: [1:7556535203937189261:8443]
2025-10-02T08:15:55.666146Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:55.666411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.666425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.666458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937189261:8443], now have 1 active actors on pipe
2025-10-02T08:15:55.666573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:55.666586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:55.666648Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:55.666653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2531 reason: error at write: Disconnected sessionId: src_id|492d784-c7b68879-f53bd792-17a1a13c_0
2025-10-02T08:15:55.666679Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:55.666827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2531 sessionId: src_id|492d784-c7b68879-f53bd792-17a1a13c_0 is DEAD
2025-10-02T08:15:55.666967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492d784-c7b68879-f53bd792-17a1a13c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:55.666977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492d784-c7b68879-f53bd792-17a1a13c_0] Write session will restart in 0.006053s
2025-10-02T08:15:55.666963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535203937189261:8443]
2025-10-02T08:15:55.667000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492d784-c7b68879-f53bd792-17a1a13c_0] Write session: Do CDS request
2025-10-02T08:15:55.667006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492d784-c7b68879-f53bd792-17a1a13c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:55.674263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492d784-c7b68879-f53bd792-17a1a13c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.674328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:55.674344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2532
2025-10-02T08:15:55.674505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.674548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:55.674556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:55.674561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:55.675007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2532 sessionId:  describe result for acl check
2025-10-02T08:15:55.675042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:55.675048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:55.675050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:55.675055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535203937189411:9511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:55.675531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535203937189411:9511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:55.677861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535203937189411:9511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:55.678255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:55.678974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:55.679303Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:55.679322Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:55.679350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:55.679448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:55.679502Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535203937189537:9528]
2025-10-02T08:15:55.680167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535203937189411:9511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:55.680180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535203937189411:9511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:55.680183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535203937189411:9511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:55.680190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:55.680226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:55.680394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:55.680462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:55.680907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:55.681003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.681014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.681017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.681018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.681023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.681033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.681045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.681056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.681060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.681071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.681079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.681097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.681105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.681110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.681123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.681136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.681150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.681161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.681167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.681180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.681199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:55.688717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:55.690067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:55.690081Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:55.690083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:55.690085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:55.690090Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2531 [1:7556535203937189537:9528]
2025-10-02T08:15:55.690098Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:55.690111Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:55.690113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.690115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.690117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.690132Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:55.690138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:55.690142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:55.690186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.690193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.690195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:55.690196Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:55.690246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:55.690253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.690263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.690280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:55.690294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535203937189524:9528]
2025-10-02T08:15:55.690299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535203937189524:9528]
2025-10-02T08:15:55.690307Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:55.690316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:55.690327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:55.690328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:55.690329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:55.690336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937189542:9511], now have 1 active actors on pipe
2025-10-02T08:15:55.690338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:55.690340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2531
2025-10-02T08:15:55.690358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535204396551825:2378], now have 1 active actors on pipe
2025-10-02T08:15:55.690360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535203937189524:9528]
2025-10-02T08:15:55.690362Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:55.690364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:55.690366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.690369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.690398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:55.690405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.690408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.690410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:55.690416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.690422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:55.690437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.690415Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2531
2025-10-02T08:15:55.690477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.690483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.690495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.690524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2532 partition: 0 MaxSeqNo: 17 sessionId: src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0
2025-10-02T08:15:55.690843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492d784-c7b68879-f53bd792-17a1a13c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:55.693389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0] Write session: try to update token
2025-10-02T08:15:55.693406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:55.707115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId: src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:55.707936Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:55.707960Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:55.707963Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:55.707974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535203937189524:9528]
2025-10-02T08:15:55.707980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535203937189524:9528]
2025-10-02T08:15:55.708037Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:55.708039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:55.708049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.708052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:55.708052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:55.708236Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:55.709500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:55.767106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535203937189570:8443]
2025-10-02T08:15:55.767227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2531, pipe: [1:7556535203937189570:8443]
2025-10-02T08:15:55.846060Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:55.846385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.846401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.846438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937189570:8443], now have 1 active actors on pipe
2025-10-02T08:15:55.846549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535203937189570:8443]
2025-10-02T08:15:55.846681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:55.846572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:55.846580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:55.846650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2532 reason: error at write: Disconnected sessionId: src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0
2025-10-02T08:15:55.846661Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:55.846819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2532 sessionId: src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0 is DEAD
2025-10-02T08:15:55.848890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:55.848901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0] Write session will restart in 0.008738s
2025-10-02T08:15:55.848926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0] Write session: Do CDS request
2025-10-02T08:15:55.848932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:55.855558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:55.856233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:55.856476Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:55.856488Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:55.856502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:55.856562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:55.856597Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535203937189783:9534]
2025-10-02T08:15:55.857135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:55.857327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:55.857373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:55.857600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:55.857638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.857644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.857644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.857645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.857647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.857652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.857661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.857665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.857668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.857671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.857677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.857684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:55.857689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.857694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:55.857697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.857702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:55.857711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.857716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.857718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.857721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.857733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:55.859353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.863175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:55.863191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2533
2025-10-02T08:15:55.864446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:55.864480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:55.864488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:55.864491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:55.865005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2533 sessionId:  describe result for acl check
2025-10-02T08:15:55.865044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:55.865052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:55.865054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:55.865060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535203937189800:9535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:55.865556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:55.865574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535203937189800:9535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:55.867273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:55.867293Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:55.867295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:55.867298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:55.867304Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2532 [1:7556535203937189783:9534]
2025-10-02T08:15:55.867315Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:55.867329Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:55.867332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.867336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.867338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.867354Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:55.867364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:55.867370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:55.867437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.867444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.867446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:55.867449Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:55.867505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:55.867513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.867527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:55.867548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:55.867564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535204396551834:2378], now have 1 active actors on pipe
2025-10-02T08:15:55.867570Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535203937189777:9534]
2025-10-02T08:15:55.867578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535203937189777:9534]
2025-10-02T08:15:55.867589Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:55.867603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:55.867604Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:55.867608Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:55.867611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:55.867613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:55.867638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535203937189777:9534]
2025-10-02T08:15:55.867644Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:55.867648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:55.867648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535203937189800:9535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:55.867788Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2532
2025-10-02T08:15:55.872585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535203937189800:9535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:55.872604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535203937189800:9535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:55.872608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535203937189800:9535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:55.872616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:55.872826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2532
2025-10-02T08:15:55.872840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937189840:9535], now have 1 active actors on pipe
2025-10-02T08:15:55.872847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.872852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.872877Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:55.872894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.872903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.872905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:55.872915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.872933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:55.872950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.872991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.872997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.873019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:55.873050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2533 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0
2025-10-02T08:15:55.873382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b253ad92-3e423c24-64c52fe9-77a79a71_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:55.875903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0] Write session: try to update token
2025-10-02T08:15:55.875921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:55.878372Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:55.878391Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:55.878399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535203937189777:9534]
2025-10-02T08:15:55.878441Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:55.878510Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:55.878608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:55.878755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:55.878904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:55.879049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:55.879313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:55.879356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:55.894495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId: src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:55.897361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:55.897460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.897475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.897509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:55.897536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:55.897662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:55.897679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:55.897851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.897925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.897992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.898058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.898242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.898254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.898329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.898396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.898458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.898522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.898570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.898580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.898654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.898717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.898780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.898842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.898883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.898894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.898960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.899025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.899091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.899158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.899211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.899217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.899277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.899331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.899400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.899464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.899504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.899509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.899571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.899641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.899703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.899768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.899816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.899818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.899878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.899928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.900063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.900194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.900236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.900239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.900370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.900425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.900487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.900553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.900593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.900596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.900661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.900719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.900776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.900866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.900909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.900925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.900995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:55.901060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:55.901126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:55.901181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:55.901231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:55.901234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:55.901299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:55.901365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:55.901385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:55.901387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:55.901417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:55.901431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:55.901433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:55.901436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:55.901439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:55.901847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:55.901868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:55.901874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:55.901877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:55.901880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:55.901886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:55.902443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:55.902456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:55.902460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:55.902462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:55.902465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:55.902467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:55.902928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:55.902942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:55.902948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:55.902951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:55.902956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:55.904182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:55.904193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:55.904204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392955903
2025-10-02T08:15:55.904340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:55.904347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:55.904355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:55.904358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:55.904362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:55.904365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:55.905031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:55.905056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:55.905062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:55.905065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:55.905069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:55.905073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:55.905522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:55.905544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:55.905549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:55.905552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:55.905554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:55.905557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:55.906006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:55.906031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:55.906038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:55.907022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:55.907042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:55.907046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:55.907048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:55.907055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392955906
2025-10-02T08:15:55.907315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:55.907337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:55.907342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:55.907344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:55.907348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:55.907351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:55.907806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:55.907820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:55.907825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:55.907829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:55.907832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:55.907835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:55.908306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:55.908319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:55.908409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392955908
2025-10-02T08:15:55.910726Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:55.910758Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:55.910768Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:55.910775Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:55.910787Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:55.910795Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:55.910797Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:55.910806Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535203937189777:9534]
2025-10-02T08:15:55.910810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535203937189777:9534]
2025-10-02T08:15:55.910855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:55.910869Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:55.910886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:55.910894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:55.910897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:55.911034Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:55.946813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535203937189860:8443]
2025-10-02T08:15:55.946939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2532, pipe: [1:7556535203937189860:8443]
2025-10-02T08:15:56.047075Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:56.047429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535203937189860:8443], now have 1 active actors on pipe
2025-10-02T08:15:56.047570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535203937189860:8443]
2025-10-02T08:15:56.047598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:56.047601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:56.047624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2533 reason: error at write: Disconnected sessionId: src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0
2025-10-02T08:15:56.047659Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:56.047790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2533 sessionId: src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0 is DEAD
2025-10-02T08:15:56.047905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:56.047914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0] Write session will restart in 0.006604s
2025-10-02T08:15:56.047932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0] Write session: Do CDS request
2025-10-02T08:15:56.047937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:56.049093Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:56.052194Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2092fd0b22eb91cf] Result# TEvPutResult {Id# [72075186224037892:2532:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:15:56.052231Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2532:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:56.052351Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2532:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:56.055225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.055257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:56.055269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2534
2025-10-02T08:15:56.055403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.055442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:56.055449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:56.055452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:56.055749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2534 sessionId:  describe result for acl check
2025-10-02T08:15:56.055772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:56.055777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:56.055778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:56.055782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535208232157278:9539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:56.056279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535208232157278:9539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:56.059062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535208232157278:9539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:56.060015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:56.060649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:56.060798Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:56.060820Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:56.060829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:56.060868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:56.060906Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535208232157404:9549]
2025-10-02T08:15:56.061528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:56.061695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:56.061723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535208232157278:9539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:56.061733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535208232157278:9539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:56.061734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:56.061736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535208232157278:9539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:56.061742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:56.062008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:56.062053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.062059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.062060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.062061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.062062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.062066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.062075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.062079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.062083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.062086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.062091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.062098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.062103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.062107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.062111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.062116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.062120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.062125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.062129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.062134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.062152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:56.070219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:56.071995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:56.072017Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:56.072020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:56.072023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:56.072031Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2533 [1:7556535208232157404:9549]
2025-10-02T08:15:56.072042Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:56.072061Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:56.072068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.072070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.072072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.072087Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:56.072092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:56.072117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:56.072179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.072186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.072189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:56.072191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:56.072257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:56.072267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.072278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.072287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:56.072300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2533
2025-10-02T08:15:56.072305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232157415:9539], now have 1 active actors on pipe
2025-10-02T08:15:56.072311Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535208232157398:9549]
2025-10-02T08:15:56.072313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535208232157398:9549]
2025-10-02T08:15:56.072319Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:56.072329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:56.072341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:56.072343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:56.072346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:56.072348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:56.072354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.072358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.072369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535208691519149:2378], now have 1 active actors on pipe
2025-10-02T08:15:56.072401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535208232157398:9549]
2025-10-02T08:15:56.072408Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:56.072420Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9159231a-e2d24b53-707216a5-c4d22a46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:56.072426Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:56.072429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.072433Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.072434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:56.072407Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2533
2025-10-02T08:15:56.072441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.072449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:56.072484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.072526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.072531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.072541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.072575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2534 partition: 0 MaxSeqNo: 17 sessionId: src_id|9159231a-e2d24b53-707216a5-c4d22a46_0
2025-10-02T08:15:56.072921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f9f41f1-5788b75d-3163db3f-60eba00e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9159231a-e2d24b53-707216a5-c4d22a46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:56.075509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9159231a-e2d24b53-707216a5-c4d22a46_0] Write session: try to update token
2025-10-02T08:15:56.075525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9159231a-e2d24b53-707216a5-c4d22a46_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:56.089000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId: src_id|9159231a-e2d24b53-707216a5-c4d22a46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:56.089521Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:56.089541Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.089543Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:56.089550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535208232157398:9549]
2025-10-02T08:15:56.089568Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535208232157398:9549]
2025-10-02T08:15:56.089608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:56.089611Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:56.089617Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:56.089623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.089626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:56.089761Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:56.091398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:56.147651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535208232157437:8443]
2025-10-02T08:15:56.147756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2533, pipe: [1:7556535208232157437:8443]
2025-10-02T08:15:56.227200Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:56.227493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.227509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.227548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232157437:8443], now have 1 active actors on pipe
2025-10-02T08:15:56.227688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:56.227699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:56.227748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2534 reason: error at write: Disconnected sessionId: src_id|9159231a-e2d24b53-707216a5-c4d22a46_0
2025-10-02T08:15:56.227782Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:56.227787Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:56.227997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9159231a-e2d24b53-707216a5-c4d22a46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:56.228005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9159231a-e2d24b53-707216a5-c4d22a46_0] Write session will restart in 0.006174s
2025-10-02T08:15:56.228024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9159231a-e2d24b53-707216a5-c4d22a46_0] Write session: Do CDS request
2025-10-02T08:15:56.228028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9159231a-e2d24b53-707216a5-c4d22a46_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:56.227894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2534 sessionId: src_id|9159231a-e2d24b53-707216a5-c4d22a46_0 is DEAD
2025-10-02T08:15:56.228082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535208232157437:8443]
2025-10-02T08:15:56.235259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9159231a-e2d24b53-707216a5-c4d22a46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.235318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:56.235333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2535
2025-10-02T08:15:56.235509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.235537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:56.235541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:56.235545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:56.235856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:56.235909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2535 sessionId:  describe result for acl check
2025-10-02T08:15:56.235938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:56.235944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:56.235946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:56.235951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535208232157652:9596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:56.236433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535208232157652:9596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:56.236511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:56.236671Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:56.236679Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:56.236688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:56.236739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:56.236884Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535208232157658:9588]
2025-10-02T08:15:56.237484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:56.237664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:56.237707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:56.237917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:56.237946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.237950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.237951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.237953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.237954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.237957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.237963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.237965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.237967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.237968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.237972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.237979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.237983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.237986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.237992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.237995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.237999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.238003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.238011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.238020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.238036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:56.238519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535208232157652:9596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:56.244003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535208232157652:9596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:56.244020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535208232157652:9596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:56.244023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535208232157652:9596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:56.244031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:56.245545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:56.247082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:56.247104Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:56.247106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:56.247109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:56.247115Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2534 [1:7556535208232157658:9588]
2025-10-02T08:15:56.247125Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:56.247143Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:56.247150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.247153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.247155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.247170Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:56.247178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:56.247184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:56.247317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.247324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.247327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:56.247330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:56.247395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:56.247402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.247416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.247419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2534
2025-10-02T08:15:56.247435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:56.247451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232157700:9596], now have 1 active actors on pipe
2025-10-02T08:15:56.247459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535208691519157:2378], now have 1 active actors on pipe
2025-10-02T08:15:56.247463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.247467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.247482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535208232157648:9588]
2025-10-02T08:15:56.247489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535208232157648:9588]
2025-10-02T08:15:56.247498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:56.247514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:56.247517Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:56.247520Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:56.247530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:56.247532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:56.247545Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:56.247518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2534
2025-10-02T08:15:56.247553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.247563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.247565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:56.247572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.247585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:56.247623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535208232157648:9588]
2025-10-02T08:15:56.247634Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:56.247645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:56.247654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.247711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.247720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.247732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.247762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2535 partition: 0 MaxSeqNo: 17 sessionId: src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0
2025-10-02T08:15:56.248093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9159231a-e2d24b53-707216a5-c4d22a46_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:56.250619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0] Write session: try to update token
2025-10-02T08:15:56.250633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:56.258425Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:56.258447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.258455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535208232157648:9588]
2025-10-02T08:15:56.258500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:56.258690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:56.258849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.258998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.259140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.259338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:56.259384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:56.260164Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:56.263824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId: src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:56.266463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:56.266534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.266546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.266579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:56.266602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:56.266654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.266670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.266853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.266920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.266985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.267048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.267351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.267364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.267428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.267488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.267551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.267623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.267668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.267676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.267739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.267801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.267862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.267926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.267967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.267974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.268029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.268091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.268161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.268220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.268262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.268267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.268324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.268379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.268438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.268491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.268531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.268536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.268592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.268651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.268707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.268763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.268822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.268829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.268893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.268949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.269012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.269068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.269108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.269113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.269170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.269225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.269282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.269339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.269389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.269395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.269452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.269504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.269558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.269616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.269669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.269676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.269738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.269796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.269856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.269922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.269961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.269966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.269997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:56.270055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.270077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.270080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:56.270108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:56.270125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:56.270130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:56.270132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:56.270133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:56.270490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:56.270511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:56.270520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:56.270522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:56.270524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:56.270526Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:56.270964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:56.270985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:56.270990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:56.270996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:56.270998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:56.271000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:56.271485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:56.271507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:56.271511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:56.271513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:56.271515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:56.272716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:56.272733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:56.272744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392956272
2025-10-02T08:15:56.272913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:56.272926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:56.272932Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:56.272934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:56.272938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:56.272941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:56.273417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:56.273449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:56.273457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:56.273461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:56.273463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:56.273468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:56.273921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:56.273949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:56.273960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:56.273970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:56.273973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:56.273977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:56.274460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:56.274486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:56.274492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:56.275592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:56.275615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:56.275621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:56.275624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:56.275635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392956275
2025-10-02T08:15:56.275938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:56.275966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:56.275980Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:56.275987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:56.275990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:56.275997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:56.276490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:56.276518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:56.276525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:56.276529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:56.276532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:56.276535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:56.277026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:56.277049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.277149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392956277
2025-10-02T08:15:56.277912Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:56.277933Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:56.277939Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:56.277945Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:56.279570Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:56.279590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.279592Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:56.279602Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535208232157648:9588]
2025-10-02T08:15:56.279606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535208232157648:9588]
2025-10-02T08:15:56.279662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:56.279671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.279674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:56.279768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:56.279799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:56.279802Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:56.328279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535208232157721:8443]
2025-10-02T08:15:56.328458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2534, pipe: [1:7556535208232157721:8443]
2025-10-02T08:15:56.410335Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:56.410650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232157721:8443], now have 1 active actors on pipe
2025-10-02T08:15:56.410768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535208232157721:8443]
2025-10-02T08:15:56.410786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:56.410788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:56.410807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2535 reason: error at write: Disconnected sessionId: src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0
2025-10-02T08:15:56.410854Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:56.410861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:56.410949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2535 sessionId: src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0 is DEAD
2025-10-02T08:15:56.411070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:56.411080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0] Write session will restart in 0.008471s
2025-10-02T08:15:56.411102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0] Write session: Do CDS request
2025-10-02T08:15:56.411108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:56.418656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:56.419285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:56.419495Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:56.419504Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:56.419513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:56.419557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:56.419589Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535208232157937:9635]
2025-10-02T08:15:56.420011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:56.420224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:56.420269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:56.420324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.420363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:56.420376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2536
2025-10-02T08:15:56.420523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:56.420543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.420571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:56.420579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:56.420583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:56.420583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.420584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.420585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.420587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.420588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.420592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.420601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.420617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.420626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.420628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.420634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.420640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.420650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.420654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.420658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.420663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.420671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.420676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.420680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.420684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.420704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:56.420923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2536 sessionId:  describe result for acl check
2025-10-02T08:15:56.421003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:56.421010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:56.421012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:56.421016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535208232157953:9673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:56.421448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535208232157953:9673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:56.423229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535208232157953:9673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:56.428116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535208232157953:9673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:56.428135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535208232157953:9673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:56.428138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535208232157953:9673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:56.428147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:56.428658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:56.430214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:56.430231Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:56.430233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:56.430237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:56.430243Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2535 [1:7556535208232157937:9635]
2025-10-02T08:15:56.430258Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:56.430275Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:56.430278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.430281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.430284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.430298Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:56.430307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:56.430313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:56.430368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.430374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.430377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:56.430380Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:56.430443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:56.430450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.430461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.430475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:56.430483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2535
2025-10-02T08:15:56.430492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232157985:9673], now have 1 active actors on pipe
2025-10-02T08:15:56.430497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535208691519163:2378], now have 1 active actors on pipe
2025-10-02T08:15:56.430501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.430503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.430515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535208232157931:9635]
2025-10-02T08:15:56.430519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535208232157931:9635]
2025-10-02T08:15:56.430526Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:56.430538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:56.430541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:56.430544Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:56.430550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:56.430554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:56.430568Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7d4854c-bb50e726-d316dc87-34789e34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:56.430577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.430582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.430544Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2535
2025-10-02T08:15:56.430583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:56.430589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.430596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:56.430631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535208232157931:9635]
2025-10-02T08:15:56.430643Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:56.430651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:56.430661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.430706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.430710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.430720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.430747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2536 partition: 0 MaxSeqNo: 17 sessionId: src_id|b7d4854c-bb50e726-d316dc87-34789e34_0
2025-10-02T08:15:56.431053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8213d279-6b3684c6-3f4f0c14-fa92f916_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b7d4854c-bb50e726-d316dc87-34789e34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:56.433612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d4854c-bb50e726-d316dc87-34789e34_0] Write session: try to update token
2025-10-02T08:15:56.433626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d4854c-bb50e726-d316dc87-34789e34_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:56.442426Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:56.442449Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.442457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535208232157931:9635]
2025-10-02T08:15:56.442495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:56.442550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:56.442660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:56.442802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.442940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.443090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.443317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:56.443369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:56.449114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId: src_id|b7d4854c-bb50e726-d316dc87-34789e34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:56.451870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:56.451941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.451953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.451987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:56.452022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:56.452081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.452109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.452267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.452353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.452425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.452488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.452529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.452538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.452615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.452679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.452739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.452821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.452867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.452875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.452947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.453016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.453082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.453151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.453199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.453207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.453280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.453345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.453408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.453474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.453519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.453526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.453592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.453662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.453732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.453805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.453855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.453863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.453927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.454009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.454095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.454167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.454218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.454226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.454296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.454362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.454437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.454511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.454559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.454567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.454636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.454698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.454758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.454825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.454874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.454882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.454949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.455010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.455070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.455133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.455174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.455180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.455248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.455308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.455365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.455434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.455482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.455492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.455540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:56.455596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.455612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.455617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:56.455641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:56.455653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:56.455655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:56.455657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:56.455659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:56.456068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:56.456105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:56.456112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:56.456114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:56.456116Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:56.456118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:56.456718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:56.456747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:56.456755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:56.456758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:56.456762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:56.456765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:56.457223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:56.457247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:56.457254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:56.457258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:56.457260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:56.458475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:56.458497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:56.458509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392956458
2025-10-02T08:15:56.458704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:56.458718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:56.458722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:56.458724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:56.458726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:56.458728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:56.459189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:56.459211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:56.459215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:56.459218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:56.459222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:56.459224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:56.459650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:56.459669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:56.459676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:56.459678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:56.459680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:56.459682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:56.460133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:56.460152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:56.460157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:56.461210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:56.461226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:56.461231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:56.461234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:56.461242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392956460
2025-10-02T08:15:56.461530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:56.461549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:56.461553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:56.461555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:56.461558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:56.461560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:56.462022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:56.462048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:56.462058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:56.462064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:56.462066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:56.462070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:56.462507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:56.462524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.462608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392956462
2025-10-02T08:15:56.463369Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:56.463390Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:56.463396Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:56.463402Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:56.464963Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:56.464966Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.464967Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:56.464977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535208232157931:9635]
2025-10-02T08:15:56.464980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535208232157931:9635]
2025-10-02T08:15:56.465031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:56.465032Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:56.465036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.465037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:56.465038Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:56.465167Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:56.511012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535208232158009:8443]
2025-10-02T08:15:56.511127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2535, pipe: [1:7556535208232158009:8443]
2025-10-02T08:15:56.602062Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:56.602361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232158009:8443], now have 1 active actors on pipe
2025-10-02T08:15:56.602479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:56.602484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:56.602509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2536 reason: error at write: Disconnected sessionId: src_id|b7d4854c-bb50e726-d316dc87-34789e34_0
2025-10-02T08:15:56.602582Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:56.602616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:56.602670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2536 sessionId: src_id|b7d4854c-bb50e726-d316dc87-34789e34_0 is DEAD
2025-10-02T08:15:56.602799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d4854c-bb50e726-d316dc87-34789e34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:56.602808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d4854c-bb50e726-d316dc87-34789e34_0] Write session will restart in 0.009882s
2025-10-02T08:15:56.602829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d4854c-bb50e726-d316dc87-34789e34_0] Write session: Do CDS request
2025-10-02T08:15:56.602835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d4854c-bb50e726-d316dc87-34789e34_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:56.602839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535208232158009:8443]
2025-10-02T08:15:56.611729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:56.612656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:56.612828Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:56.612837Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:56.612846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:56.612893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:56.612928Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535208232158228:9659]
2025-10-02T08:15:56.613506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:56.613712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:56.613777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:56.614116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:56.614192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.614200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.614201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.614202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.614204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.614209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.614219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.614223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.614227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.614230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.614237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.614244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.614249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.614254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.614278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d4854c-bb50e726-d316dc87-34789e34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.614259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.614264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.614269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.614274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.614279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.614285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.614303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:56.614366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:56.614377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2537
2025-10-02T08:15:56.614512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.614542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:56.614553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:56.614560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:56.614897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2537 sessionId:  describe result for acl check
2025-10-02T08:15:56.614931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:56.614937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:56.614938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:56.614943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535208232158245:9670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:56.615433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535208232158245:9670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:56.617546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535208232158245:9670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:56.624198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535208232158245:9670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:56.624227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535208232158245:9670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:56.624231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535208232158245:9670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:56.624241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:56.624716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:56.626313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:56.626332Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:56.626335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:56.626338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:56.626345Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2536 [1:7556535208232158228:9659]
2025-10-02T08:15:56.626357Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:56.626373Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:56.626378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.626386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.626388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.626404Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:56.626415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:56.626426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:56.626492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.626499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.626503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:56.626505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:56.626574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:56.626581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.626594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.626612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:56.626627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2536
2025-10-02T08:15:56.626630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232158276:9670], now have 1 active actors on pipe
2025-10-02T08:15:56.626633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535208691519170:2378], now have 1 active actors on pipe
2025-10-02T08:15:56.626639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535208232158222:9659]
2025-10-02T08:15:56.626641Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535208232158222:9659]
2025-10-02T08:15:56.626652Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:56.626662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.626668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.626681Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:56.626689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:56.626693Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:56.626703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:56.626707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:56.626748Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f893552-dea1dc3d-6052d402-671f14ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:56.626759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.626763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.626765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:56.626772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.626733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2536
2025-10-02T08:15:56.626785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:56.626795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535208232158222:9659]
2025-10-02T08:15:56.626811Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:56.626822Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:56.626847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.626897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.626901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.626914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.626950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2537 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f893552-dea1dc3d-6052d402-671f14ff_0
2025-10-02T08:15:56.627279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d4854c-bb50e726-d316dc87-34789e34_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f893552-dea1dc3d-6052d402-671f14ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:56.629870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f893552-dea1dc3d-6052d402-671f14ff_0] Write session: try to update token
2025-10-02T08:15:56.629887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f893552-dea1dc3d-6052d402-671f14ff_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:56.642579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId: src_id|1f893552-dea1dc3d-6052d402-671f14ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:56.645256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:56.645320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.645332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.645363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:56.645388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:56.645498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.645515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.645691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.645754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.645820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.645883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.645927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.645935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.646002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.646062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.646123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.646188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.646234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.646242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.646305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.646367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.646426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.646486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.646529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.646537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.646600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.646666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.646729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.646793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.646837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.646844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.646915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.646979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.647046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.647114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.647165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.647172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.647237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.647303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.647367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.647429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.647474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.647482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.647544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.647606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.647673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.647728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.647767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.647773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.647830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.647884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.647940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.647998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.648039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.648048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.648123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.648183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.648243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.648308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.648351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.648357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.648416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.648470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.648525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.648582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.648704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.648712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.648773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:56.648865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.648887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.648894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:56.648921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:56.648935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:56.648937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:56.648939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:56.648941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:56.649297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:56.649321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:56.649326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:56.649328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:56.649330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:56.649332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:56.649874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:56.649895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:56.649900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:56.649901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:56.649903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:56.649905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:56.650469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:56.650490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:56.650494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:56.650496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:56.650498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:56.651606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:56.651622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:56.651632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392956651
2025-10-02T08:15:56.651768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:56.651779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:56.651784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:56.651786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:56.651789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:56.651791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:56.652211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:56.652228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:56.652232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:56.652236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:56.652239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:56.652243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:56.652673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:56.652693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:56.652698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:56.652700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:56.652703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:56.652705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:56.653128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:56.653148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:56.653152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:56.654168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:56.654186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:56.654191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:56.654193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:56.654201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392956653
2025-10-02T08:15:56.654476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:56.654494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:56.654498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:56.654501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:56.654503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:56.654505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:56.654938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:56.654956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:56.654960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:56.654962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:56.654965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:56.654969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:56.655408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:56.655425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.655495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392956655
2025-10-02T08:15:56.657717Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:56.657744Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:56.657751Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:56.657758Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:56.657781Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:56.657788Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.657789Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:56.657794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535208232158222:9659]
2025-10-02T08:15:56.657798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535208232158222:9659]
2025-10-02T08:15:56.657827Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:56.657838Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:56.658691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:56.658705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.658707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:56.658828Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:56.703033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535208232158328:8443]
2025-10-02T08:15:56.703127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2536, pipe: [1:7556535208232158328:8443]
2025-10-02T08:15:56.794560Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:56.795264Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:56.795273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.795279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535208232158222:9659]
2025-10-02T08:15:56.795309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232158328:8443], now have 1 active actors on pipe
2025-10-02T08:15:56.795315Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:56.795366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535208232158328:8443]
2025-10-02T08:15:56.795387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:56.795394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:56.795419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2537 reason: error at write: Disconnected sessionId: src_id|1f893552-dea1dc3d-6052d402-671f14ff_0
2025-10-02T08:15:56.795502Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:56.795568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2537 sessionId: src_id|1f893552-dea1dc3d-6052d402-671f14ff_0 is DEAD
2025-10-02T08:15:56.795589Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:56.795706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f893552-dea1dc3d-6052d402-671f14ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:56.795713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f893552-dea1dc3d-6052d402-671f14ff_0] Write session will restart in 0.006423s
2025-10-02T08:15:56.795734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f893552-dea1dc3d-6052d402-671f14ff_0] Write session: Do CDS request
2025-10-02T08:15:56.795740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f893552-dea1dc3d-6052d402-671f14ff_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:56.799404Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [fb2b7f99c96a57e6] Result# TEvPutResult {Id# [72075186224037892:2536:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:15:56.799428Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2536:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:56.799712Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2536:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:15:56.803307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f893552-dea1dc3d-6052d402-671f14ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.803367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:56.803382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2538
2025-10-02T08:15:56.803522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.803544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:56.803551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:56.803553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:56.804026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2538 sessionId:  describe result for acl check
2025-10-02T08:15:56.804054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:56.804059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:56.804059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:56.804063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535208232158472:9737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:56.804511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535208232158472:9737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:56.807645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535208232158472:9737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:56.808213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:56.808898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:56.809058Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:56.809066Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:56.809075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:56.809116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:56.809150Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535208232158589:9742]
2025-10-02T08:15:56.809558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:56.809711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:56.809743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:56.810006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:56.810057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.810063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.810064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.810065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.810066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.810070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.810079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.810083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.810086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.810090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.810094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.810101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.810106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.810111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.810114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.810119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.810123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.810128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.810130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.810133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.810143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:56.810550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535208232158472:9737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:56.810565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535208232158472:9737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:56.810568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535208232158472:9737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:56.810576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:56.818110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:56.819700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:56.819720Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:56.819723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:56.819727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:56.819733Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2537 [1:7556535208232158589:9742]
2025-10-02T08:15:56.819746Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:56.819763Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:56.819765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.819769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.819771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.819789Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:56.819799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:56.819805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:56.819850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.819856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.819859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:56.819860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:56.819999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2537
2025-10-02T08:15:56.820045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:56.820057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.820070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.820083Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:56.820065Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2537
2025-10-02T08:15:56.820110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232158606:9737], now have 1 active actors on pipe
2025-10-02T08:15:56.820118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535208691519200:2378], now have 1 active actors on pipe
2025-10-02T08:15:56.820124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.820128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.820148Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535208232158582:9742]
2025-10-02T08:15:56.820155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535208232158582:9742]
2025-10-02T08:15:56.820167Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:56.820183Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:56.820186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:56.820189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:56.820201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:56.820204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:56.820223Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:56.820229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.820233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.820235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:56.820244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.820255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:56.820294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535208232158582:9742]
2025-10-02T08:15:56.820306Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:56.820312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:56.820318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.820379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.820387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.820401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.820438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2538 partition: 0 MaxSeqNo: 17 sessionId: src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0
2025-10-02T08:15:56.820756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f893552-dea1dc3d-6052d402-671f14ff_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:56.823444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0] Write session: try to update token
2025-10-02T08:15:56.823463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:56.831134Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:56.831154Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.831163Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535208232158582:9742]
2025-10-02T08:15:56.831202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:56.831203Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:56.831359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:56.831501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.831640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.831773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:56.831962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:56.831999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:56.837299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId: src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:56.839850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:56.839913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.839923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.839949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:56.839971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:56.840020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.840029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.840199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.840261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.840327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.840391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.840679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.840689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.840758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.840836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.840896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.840958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.841000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.841006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.841074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.841130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.841191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.841254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.841298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.841305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.841366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.841427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.841489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.841554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.841613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.841620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.841682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.841741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.841799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.841866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.841913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.841920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.841981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.842041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.842104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.842164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.842209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.842215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.842277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.842334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.842397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.842461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.842501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.842506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.842562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.842622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.842677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.842731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.842771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.842776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.842838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.842894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.842947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.843002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.843041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.843046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.843108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:56.843162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:56.843220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:56.843282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:56.843322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:56.843330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:56.843367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:56.843419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.843435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.843440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:56.843464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:56.843476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:56.843478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:56.843479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:56.843481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:56.843822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:56.843848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:56.843857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:56.843860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:56.843867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:56.843870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:56.844350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:56.844369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:56.844372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:56.844374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:56.844376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:56.844378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:56.844878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:56.844899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:56.844904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:56.844907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:56.844912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:56.845969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:56.845984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:56.845992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392956845
2025-10-02T08:15:56.846114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:56.846124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:56.846127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:56.846130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:56.846132Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:56.846134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:56.846545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:56.846566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:56.846571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:56.846574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:56.846577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:56.846582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:56.847016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:56.847031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:56.847038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:56.847039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:56.847042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:56.847044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:56.847454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:56.847472Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:56.847476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:56.848447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:56.848461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:56.848464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:56.848467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:56.848471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392956848
2025-10-02T08:15:56.848725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:56.848739Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:56.848742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:56.848744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:56.848748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:56.848751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:56.849159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:56.849177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:56.849181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:56.849183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:56.849187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:56.849189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:56.849574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:56.849591Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.849663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392956849
2025-10-02T08:15:56.850310Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:56.850328Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:56.850337Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:56.850344Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:56.851714Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:56.851726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:56.851727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:56.851736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535208232158582:9742]
2025-10-02T08:15:56.851739Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535208232158582:9742]
2025-10-02T08:15:56.851777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:56.851777Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:56.851781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:56.851783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.851785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:56.851899Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:56.895573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535208232158630:8443]
2025-10-02T08:15:56.895688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2537, pipe: [1:7556535208232158630:8443]
2025-10-02T08:15:56.978152Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:56.978440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232158630:8443], now have 1 active actors on pipe
2025-10-02T08:15:56.978562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:56.978570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:56.978594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2538 reason: error at write: Disconnected sessionId: src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0
2025-10-02T08:15:56.978690Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:56.978692Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:56.978802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2538 sessionId: src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0 is DEAD
2025-10-02T08:15:56.978893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:56.978901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0] Write session will restart in 0.008668s
2025-10-02T08:15:56.978925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0] Write session: Do CDS request
2025-10-02T08:15:56.978931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:56.978977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535208232158630:8443]
2025-10-02T08:15:56.987346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:56.988144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:56.988277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.988305Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:56.988317Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:56.988327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:56.988332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:56.988337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2539
2025-10-02T08:15:56.988371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:56.988411Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535208232158867:9780]
2025-10-02T08:15:56.988526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:56.988576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:56.988593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:56.988601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:56.988981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2539 sessionId:  describe result for acl check
2025-10-02T08:15:56.989021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:56.989022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:56.989027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:56.989029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:56.989033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535208232158872:9825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:56.989208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:56.989251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:56.989495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535208232158872:9825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:56.989549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:56.989596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.989603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.989604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.989605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.989606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.989611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.989621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.989625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.989633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.989637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.989646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.989657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:56.989667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.989676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:56.989685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.989693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:56.989701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.989710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.989715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.989720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.989739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:56.991704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535208232158872:9825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:56.996830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535208232158872:9825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:56.996844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535208232158872:9825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:56.996847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535208232158872:9825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:56.996854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:56.997317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:56.998696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:56.998707Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:56.998709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:56.998712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:56.998716Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2538 [1:7556535208232158867:9780]
2025-10-02T08:15:56.998724Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:56.998735Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:56.998739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.998741Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.998743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.998754Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:56.998760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:56.998764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:56.998800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.998807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.998812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:56.998814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:56.998871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:56.998880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:56.998890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:56.998894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2538
2025-10-02T08:15:56.998897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:56.998909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535208232158912:9825], now have 1 active actors on pipe
2025-10-02T08:15:56.998912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535208691519222:2378], now have 1 active actors on pipe
2025-10-02T08:15:56.998916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.998918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.998933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535208232158861:9780]
2025-10-02T08:15:56.998935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535208232158861:9780]
2025-10-02T08:15:56.998941Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:56.998952Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:56.998955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:56.998958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:56.998969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:56.998973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:56.998954Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2538
2025-10-02T08:15:56.998985Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:56.998996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:56.998999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:56.999005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:56.999012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:56.999019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:56.999048Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535208232158861:9780]
2025-10-02T08:15:56.999058Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:56.999071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.999072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:56.999116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:56.999121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:56.999131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:56.999156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2539 partition: 0 MaxSeqNo: 17 sessionId: src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0
2025-10-02T08:15:56.999440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d9b17d-84840998-e16c25c8-aebe61a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:57.001790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0] Write session: try to update token
2025-10-02T08:15:57.001804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:57.009567Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:57.009590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:57.009598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535208232158861:9780]
2025-10-02T08:15:57.009628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:57.009628Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:57.009781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:57.009897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:57.010020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:57.010148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:57.010322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:57.010358Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:57.014412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId: src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:57.016794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:57.016870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.016879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.016901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:57.016924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:57.016960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.016978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.017161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.017229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.017292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.017353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.017404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.017409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.017474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.017533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.017595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.017658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.017703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.017711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.017775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.017839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.017897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.017955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.018001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.018008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.018078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.018135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.018206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.018257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.018391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.018403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.018469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.018533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.018593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.018651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.018691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.018698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.018758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.018809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.018873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.018941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.018981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.018986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.019043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.019098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.019156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.019209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.019248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.019253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.019310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.019382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.019461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.019529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.019567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.019572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.019628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.019679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.019735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.019787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.019824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.019828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.019892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:57.019965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:57.020043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:57.020115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:57.020157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:57.020164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:57.020196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:57.020247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.020264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.020269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:57.020293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:57.020305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:57.020308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:57.020310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:57.020311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:57.020698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:57.020724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:57.020734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:57.020737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:57.020740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:57.020744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:57.021245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:57.021282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:57.021293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:57.021300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:57.021305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:57.021312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:57.021938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:57.021965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:57.021971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:57.021974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:57.021977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:57.023122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:57.023142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:57.023152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392957022
2025-10-02T08:15:57.023343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:57.023362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:57.023368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:57.023370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:57.023374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:57.023378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:57.023814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:57.023839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:57.023844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:57.023847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:57.023852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:57.023858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:57.024347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:57.024371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:57.024380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:57.024387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:57.024390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:57.024393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:57.024902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:57.024924Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:57.024930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:57.025937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:57.025955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:57.025959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:57.025963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:57.025969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392957025
2025-10-02T08:15:57.026220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:57.026236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:57.026241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:57.026245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:57.026247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:57.026249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:57.026670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:57.026689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:57.026693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:57.026695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:57.026697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:57.026699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:57.027074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:57.027090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.027166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392957027
2025-10-02T08:15:57.027823Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:57.027846Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:57.027854Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:57.027858Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:57.029314Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:57.029328Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:57.029329Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:57.029335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535208232158861:9780]
2025-10-02T08:15:57.029338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535208232158861:9780]
2025-10-02T08:15:57.029370Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:57.029378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:57.029381Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:57.029382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.029383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:57.029493Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:57.079349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535212527126230:8443]
2025-10-02T08:15:57.079478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2538, pipe: [1:7556535212527126230:8443]
2025-10-02T08:15:57.162701Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:57.163081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527126230:8443], now have 1 active actors on pipe
2025-10-02T08:15:57.163220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:57.163227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:57.163249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2539 reason: error at write: Disconnected sessionId: src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0
2025-10-02T08:15:57.163322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:57.163349Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:57.163416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2539 sessionId: src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0 is DEAD
2025-10-02T08:15:57.163571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535212527126230:8443]
2025-10-02T08:15:57.163755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:57.163765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0] Write session will restart in 0.007761s
2025-10-02T08:15:57.163792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0] Write session: Do CDS request
2025-10-02T08:15:57.163798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:57.172311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.172366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:57.172384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2540
2025-10-02T08:15:57.172540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.172571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:57.172581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:57.172584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:57.172964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2540 sessionId:  describe result for acl check
2025-10-02T08:15:57.172993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:57.173011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:57.173012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:57.173017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535212527126445:9835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:57.173517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535212527126445:9835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:57.173681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:57.174636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:57.174811Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:57.174821Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:57.174831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:57.174874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:57.174910Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535212527126478:9845]
2025-10-02T08:15:57.175484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:57.175623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535212527126445:9835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:57.175675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:57.175727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:57.176056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:57.176138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.176145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.176146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.176147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.176148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.176154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.176162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.176166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.176169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.176173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.176179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.176185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.176190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.176195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.176199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.176203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.176210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.176220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.176224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.176228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.176249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:57.182006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535212527126445:9835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:57.182024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535212527126445:9835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:57.182027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535212527126445:9835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:57.182036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:57.184324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:57.185771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:57.185788Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:57.185792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:57.185799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:57.185804Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2539 [1:7556535212527126478:9845]
2025-10-02T08:15:57.185818Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:57.185834Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:57.185837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.185840Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.185842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.185858Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:57.185862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:57.185867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:57.185923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.185931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.185933Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:57.185936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:57.186000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:57.186007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.186018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.186034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:57.186040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2539
2025-10-02T08:15:57.186053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527126506:9835], now have 1 active actors on pipe
2025-10-02T08:15:57.186061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.186064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.186077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535212986486525:2378], now have 1 active actors on pipe
2025-10-02T08:15:57.186086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535212527126455:9845]
2025-10-02T08:15:57.186088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535212527126455:9845]
2025-10-02T08:15:57.186098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:57.186106Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:57.186109Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:57.186115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:57.186128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:57.186135Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:57.186149Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|789a88bd-a72c4121-c42012e7-ec100892_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:57.186157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.186161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.186163Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:57.186170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.186183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:57.186216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535212527126455:9845]
2025-10-02T08:15:57.186226Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:57.186236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.186217Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2539
2025-10-02T08:15:57.186253Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:57.186277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.186279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.186292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.186345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2540 partition: 0 MaxSeqNo: 17 sessionId: src_id|789a88bd-a72c4121-c42012e7-ec100892_0
2025-10-02T08:15:57.186739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a495138-d2809997-3bdc49a5-3aebf00f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|789a88bd-a72c4121-c42012e7-ec100892_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:57.189204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789a88bd-a72c4121-c42012e7-ec100892_0] Write session: try to update token
2025-10-02T08:15:57.189218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789a88bd-a72c4121-c42012e7-ec100892_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:57.202047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId: src_id|789a88bd-a72c4121-c42012e7-ec100892_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:57.205711Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:57.205732Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:57.205734Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:57.205742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535212527126455:9845]
2025-10-02T08:15:57.205747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535212527126455:9845]
2025-10-02T08:15:57.205789Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:57.205794Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:57.205797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:57.205803Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.205805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:57.205953Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:57.206199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:57.263676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535212527126520:8443]
2025-10-02T08:15:57.263783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2539, pipe: [1:7556535212527126520:8443]
2025-10-02T08:15:57.336374Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:57.336703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.336721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.336762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527126520:8443], now have 1 active actors on pipe
2025-10-02T08:15:57.336882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:57.336889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535212527126520:8443]
2025-10-02T08:15:57.336895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:57.336960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2540 reason: error at write: Disconnected sessionId: src_id|789a88bd-a72c4121-c42012e7-ec100892_0
2025-10-02T08:15:57.337013Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:57.336982Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:57.337121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2540 sessionId: src_id|789a88bd-a72c4121-c42012e7-ec100892_0 is DEAD
2025-10-02T08:15:57.337251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789a88bd-a72c4121-c42012e7-ec100892_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:57.337262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789a88bd-a72c4121-c42012e7-ec100892_0] Write session will restart in 0.006385s
2025-10-02T08:15:57.337287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789a88bd-a72c4121-c42012e7-ec100892_0] Write session: Do CDS request
2025-10-02T08:15:57.337294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789a88bd-a72c4121-c42012e7-ec100892_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:57.345264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|789a88bd-a72c4121-c42012e7-ec100892_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.345350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:57.345367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2541
2025-10-02T08:15:57.345470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.345499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:57.345507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:57.345511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:57.345871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2541 sessionId:  describe result for acl check
2025-10-02T08:15:57.345911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:57.345920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:57.345922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:57.345928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535212527126732:9849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:57.346426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535212527126732:9849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:57.346985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:57.347736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:57.347904Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:57.347912Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:57.347919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:57.347953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:57.347977Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535212527126768:9840]
2025-10-02T08:15:57.348391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:57.348469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535212527126732:9849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:57.348558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:57.348615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:57.348937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:57.348999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.349006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.349007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.349008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.349009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.349015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.349024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.349032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.349036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.349039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.349044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.349056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.349064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.349073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.349081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.349090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.349099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.349112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.349121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.349126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.349147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:57.353935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535212527126732:9849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:57.353954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535212527126732:9849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:57.353957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535212527126732:9849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:57.353965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:57.357093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:57.358657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:57.358681Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:57.358683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:57.358687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:57.358694Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2540 [1:7556535212527126768:9840]
2025-10-02T08:15:57.358701Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:57.358715Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:57.358717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.358720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.358721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.358737Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:57.358746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:57.358753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:57.358817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.358823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.358826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:57.358829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:57.358880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:57.358887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.358896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.358902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:57.358914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535212527126749:9840]
2025-10-02T08:15:57.358915Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535212527126749:9840]
2025-10-02T08:15:57.358920Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:57.358930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:57.358944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:57.358944Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:57.358947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:57.358953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:57.358976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2540
2025-10-02T08:15:57.358987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527126796:9849], now have 1 active actors on pipe
2025-10-02T08:15:57.358991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535212986486534:2378], now have 1 active actors on pipe
2025-10-02T08:15:57.358993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535212527126749:9840]
2025-10-02T08:15:57.359000Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:57.359005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:57.359005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.359008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.359052Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:57.359063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.359067Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.359068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:57.359036Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2540
2025-10-02T08:15:57.359077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.359089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:57.359116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.359154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.359158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.359168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.359200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2541 partition: 0 MaxSeqNo: 17 sessionId: src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0
2025-10-02T08:15:57.359481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|789a88bd-a72c4121-c42012e7-ec100892_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:57.361901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0] Write session: try to update token
2025-10-02T08:15:57.361914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:57.374255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId: src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:57.375794Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:57.375810Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:57.375812Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:57.375819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535212527126749:9840]
2025-10-02T08:15:57.375822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535212527126749:9840]
2025-10-02T08:15:57.375855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:57.375860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.375865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:57.375872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:57.375888Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:57.375991Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:57.376749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:57.437256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535212527126810:8443]
2025-10-02T08:15:57.437403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2540, pipe: [1:7556535212527126810:8443]
2025-10-02T08:15:57.510794Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:57.511092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.511107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.511146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527126810:8443], now have 1 active actors on pipe
2025-10-02T08:15:57.511304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:57.511315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:57.511373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2541 reason: error at write: Disconnected sessionId: src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0
2025-10-02T08:15:57.511396Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:57.511541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2541 sessionId: src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0 is DEAD
2025-10-02T08:15:57.511596Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:57.511710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535212527126810:8443]
2025-10-02T08:15:57.511894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:57.511903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0] Write session will restart in 0.009248s
2025-10-02T08:15:57.511923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0] Write session: Do CDS request
2025-10-02T08:15:57.511928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:57.521182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:57.521920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:57.522193Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:57.522210Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:57.522223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:57.522239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.522287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:57.522289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:57.522295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2542
2025-10-02T08:15:57.522334Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535212527127044:9885]
2025-10-02T08:15:57.522460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.522500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:57.522510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:57.522515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:57.522895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2542 sessionId:  describe result for acl check
2025-10-02T08:15:57.522935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:57.522943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:57.522945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:57.522950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535212527127049:9884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:57.523026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:57.523199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:57.523245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:57.523471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535212527127049:9884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:57.523540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:57.523594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.523600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.523602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.523603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.523604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.523608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.523618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.523622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.523630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.523633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.523638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.523646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.523655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.523659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.523663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.523672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.523676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.523685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.523694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.523700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.523726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:57.525967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535212527127049:9884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:57.531278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535212527127049:9884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:57.531299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535212527127049:9884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:57.531303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535212527127049:9884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:57.531312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:57.531758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:57.533330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:57.533349Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:57.533351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:57.533356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:57.533362Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2541 [1:7556535212527127044:9885]
2025-10-02T08:15:57.533375Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:57.533392Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:57.533398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.533402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.533404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.533421Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:57.533430Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:57.533437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:57.533495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.533501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.533505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:57.533507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:57.533566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:57.533572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.533585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.533597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:57.533615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2541
2025-10-02T08:15:57.533620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527127092:9884], now have 1 active actors on pipe
2025-10-02T08:15:57.533623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535212986486541:2378], now have 1 active actors on pipe
2025-10-02T08:15:57.533630Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535212527127038:9885]
2025-10-02T08:15:57.533632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535212527127038:9885]
2025-10-02T08:15:57.533639Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:57.533650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:57.533653Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:57.533656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:57.533670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:57.533676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:57.533684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.533690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.533701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2541
2025-10-02T08:15:57.533731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535212527127038:9885]
2025-10-02T08:15:57.533740Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:57.533753Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:57.533755Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:57.533760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.533764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.533767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:57.533774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.533782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:57.533822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.533889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.533895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.533908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.533944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2542 partition: 0 MaxSeqNo: 17 sessionId: src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0
2025-10-02T08:15:57.534280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74d4b921-5767d3d4-cd3e3397-385404f9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:57.537000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0] Write session: try to update token
2025-10-02T08:15:57.537014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:57.551097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId: src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:57.552280Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:57.552285Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:57.552287Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:57.552293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535212527127038:9885]
2025-10-02T08:15:57.552298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535212527127038:9885]
2025-10-02T08:15:57.552339Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:57.552344Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:57.552355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:57.552363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.552365Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:57.552495Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:57.553505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:57.611845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535212527127107:8443]
2025-10-02T08:15:57.611948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2541, pipe: [1:7556535212527127107:8443]
2025-10-02T08:15:57.688453Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:57.688775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.688788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.688840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527127107:8443], now have 1 active actors on pipe
2025-10-02T08:15:57.688941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535212527127107:8443]
2025-10-02T08:15:57.688965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:57.688970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:57.689030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2542 reason: error at write: Disconnected sessionId: src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0
2025-10-02T08:15:57.689045Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:57.689080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:57.689207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2542 sessionId: src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0 is DEAD
2025-10-02T08:15:57.689327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:57.689335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0] Write session will restart in 0.007066s
2025-10-02T08:15:57.689360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0] Write session: Do CDS request
2025-10-02T08:15:57.689366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:57.697875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.697964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:57.697982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2543
2025-10-02T08:15:57.698093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.698115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:57.698119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:57.698122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:57.698253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:57.698669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2543 sessionId:  describe result for acl check
2025-10-02T08:15:57.698692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:57.698694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:57.698695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:57.698702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535212527127356:9982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:57.699146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:57.699366Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:57.699369Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:57.699378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:57.699424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:57.699450Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535212527127360:9951]
2025-10-02T08:15:57.700004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:57.700042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535212527127356:9982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:57.700197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:57.700229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:57.700508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:57.700556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.700557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.700559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.700560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.700561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.700565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.700575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.700579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.700583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.700587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.700592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.700599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.700606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.700611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.700615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.700620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.700623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.700628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.700633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.700638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.700655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:57.704988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535212527127356:9982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:57.709055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:57.710473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:57.710490Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:57.710492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:57.710495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:57.710500Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2542 [1:7556535212527127360:9951]
2025-10-02T08:15:57.710510Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:57.710525Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:57.710535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.710538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.710540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.710553Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:57.710558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:57.710564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:57.710623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.710630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.710633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:57.710635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:57.710687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:57.710694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.710707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.710721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:57.710741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535212527127342:9951]
2025-10-02T08:15:57.710747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535212527127342:9951]
2025-10-02T08:15:57.710753Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:57.710763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:57.710781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:57.710788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:57.710797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535212986486547:2378], now have 1 active actors on pipe
2025-10-02T08:15:57.710823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535212527127342:9951]
2025-10-02T08:15:57.710831Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:57.710886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:57.710896Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:57.710902Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:57.710929Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2542
2025-10-02T08:15:57.711094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535212527127356:9982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:57.711107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535212527127356:9982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:57.711112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535212527127356:9982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:57.711119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:57.711457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2542
2025-10-02T08:15:57.711467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527127410:9982], now have 1 active actors on pipe
2025-10-02T08:15:57.711472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.711476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.711495Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79197745-789f1027-3f193e9e-15b5131_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:57.711506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.711509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.711512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:57.711519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.711528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:57.711543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.711583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.711588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.711599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.711626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2543 partition: 0 MaxSeqNo: 17 sessionId: src_id|79197745-789f1027-3f193e9e-15b5131_0
2025-10-02T08:15:57.711911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b5c9b-227f1c83-36391f8d-81168eb5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79197745-789f1027-3f193e9e-15b5131_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:57.714435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79197745-789f1027-3f193e9e-15b5131_0] Write session: try to update token
2025-10-02T08:15:57.714451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79197745-789f1027-3f193e9e-15b5131_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:57.728656Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:57.728681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:57.728684Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:57.728693Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535212527127342:9951]
2025-10-02T08:15:57.728697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535212527127342:9951]
2025-10-02T08:15:57.728741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:57.728743Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:57.728748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:57.728752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.728754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:57.729068Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:57.733195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId: src_id|79197745-789f1027-3f193e9e-15b5131_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:57.735520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:57.788994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535212527127444:8443]
2025-10-02T08:15:57.789126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2542, pipe: [1:7556535212527127444:8443]
2025-10-02T08:15:57.862436Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:57.862629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.862640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.862672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527127444:8443], now have 1 active actors on pipe
2025-10-02T08:15:57.862747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535212527127444:8443]
2025-10-02T08:15:57.862771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:57.862773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:57.862821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2543 reason: error at write: Disconnected sessionId: src_id|79197745-789f1027-3f193e9e-15b5131_0
2025-10-02T08:15:57.862840Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:57.862841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:57.863014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2543 sessionId: src_id|79197745-789f1027-3f193e9e-15b5131_0 is DEAD
2025-10-02T08:15:57.863163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79197745-789f1027-3f193e9e-15b5131_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:57.863171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79197745-789f1027-3f193e9e-15b5131_0] Write session will restart in 0.008170s
2025-10-02T08:15:57.863195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79197745-789f1027-3f193e9e-15b5131_0] Write session: Do CDS request
2025-10-02T08:15:57.863201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79197745-789f1027-3f193e9e-15b5131_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:57.871355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:57.872277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79197745-789f1027-3f193e9e-15b5131_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.872273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:57.872329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:57.872341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2544
2025-10-02T08:15:57.872431Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:57.872439Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:57.872447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:57.872481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:57.872515Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535212527127680:10012]
2025-10-02T08:15:57.872517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:57.872537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:57.872546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:57.872549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:57.872883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2544 sessionId:  describe result for acl check
2025-10-02T08:15:57.872916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:57.872923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:57.872924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:57.872930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535212527127684:10024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:57.873140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:57.873344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535212527127684:10024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:57.873345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:57.873377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:57.873660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:57.873691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.873696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.873697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.873698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.873699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.873703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.873711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.873714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.873717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.873720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.873724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.873730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:57.873735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.873743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:57.873747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.873751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:57.873758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.873763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.873766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.873771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.873790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:57.875390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535212527127684:10024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:57.879866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535212527127684:10024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:57.879880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535212527127684:10024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:57.879883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535212527127684:10024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:57.879891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:57.882836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:57.884709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:57.884726Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:57.884731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:57.884734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:57.884742Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2543 [1:7556535212527127680:10012]
2025-10-02T08:15:57.884753Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:57.884768Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:57.884770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.884773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.884774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.884788Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:57.884792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:57.884814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:57.884874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.884884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.884887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:57.884889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:57.884956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:57.884962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.884973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:57.884988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:57.885008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527127728:10024], now have 1 active actors on pipe
2025-10-02T08:15:57.885011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2543
2025-10-02T08:15:57.885019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535212527127673:10012]
2025-10-02T08:15:57.885021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535212527127673:10012]
2025-10-02T08:15:57.885030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:57.885044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535212986486588:2378], now have 1 active actors on pipe
2025-10-02T08:15:57.885045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:57.885049Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:57.885053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.885057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.885071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:57.885088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:57.885095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:57.885081Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2543
2025-10-02T08:15:57.885135Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e1364a3-592a21ca-85980105-b96b6f27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:57.885144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:57.885147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:57.885149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:57.885155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:57.885167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:57.885182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535212527127673:10012]
2025-10-02T08:15:57.885192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:57.885200Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:57.885217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.885319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:57.885325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:57.885337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:57.885373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2544 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e1364a3-592a21ca-85980105-b96b6f27_0
2025-10-02T08:15:57.885704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79197745-789f1027-3f193e9e-15b5131_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e1364a3-592a21ca-85980105-b96b6f27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:57.888317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1364a3-592a21ca-85980105-b96b6f27_0] Write session: try to update token
2025-10-02T08:15:57.888335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1364a3-592a21ca-85980105-b96b6f27_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:57.902244Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:57.902265Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:57.902268Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:57.902276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535212527127673:10012]
2025-10-02T08:15:57.902281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535212527127673:10012]
2025-10-02T08:15:57.902316Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:57.902322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:57.902328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:57.902330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:57.902331Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:57.902462Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:57.910617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId: src_id|3e1364a3-592a21ca-85980105-b96b6f27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:57.913324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:57.963105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535212527127755:8443]
2025-10-02T08:15:57.963256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2543, pipe: [1:7556535212527127755:8443]
2025-10-02T08:15:58.041313Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:58.041664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.041681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.041700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535212527127755:8443], now have 1 active actors on pipe
2025-10-02T08:15:58.041789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535212527127755:8443]
2025-10-02T08:15:58.041809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:58.041815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:58.041864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2544 reason: error at write: Disconnected sessionId: src_id|3e1364a3-592a21ca-85980105-b96b6f27_0
2025-10-02T08:15:58.041895Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:58.041943Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:58.042036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2544 sessionId: src_id|3e1364a3-592a21ca-85980105-b96b6f27_0 is DEAD
2025-10-02T08:15:58.042199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1364a3-592a21ca-85980105-b96b6f27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:58.042209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1364a3-592a21ca-85980105-b96b6f27_0] Write session will restart in 0.007754s
2025-10-02T08:15:58.042234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1364a3-592a21ca-85980105-b96b6f27_0] Write session: Do CDS request
2025-10-02T08:15:58.042240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1364a3-592a21ca-85980105-b96b6f27_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:58.050471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:58.051181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:58.051243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1364a3-592a21ca-85980105-b96b6f27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.051331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:58.051341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2545
2025-10-02T08:15:58.051355Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:58.051359Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:58.051369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:58.051417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:58.051456Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535216822095287:10061]
2025-10-02T08:15:58.051465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.051488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:58.051497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:58.051500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:58.051818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2545 sessionId:  describe result for acl check
2025-10-02T08:15:58.051845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:58.051850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:58.051852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:58.051856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535216822095292:10060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:58.052026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:58.052211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:58.052249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:58.052295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535216822095292:10060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:58.052505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:58.052557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.052562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.052563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.052564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.052565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.052569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.052577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.052580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.052583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.052587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.052591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.052598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.052607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.052612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.052616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.052621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.052625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.052629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.052633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.052636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.052655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:58.053995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535216822095292:10060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:58.059356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535216822095292:10060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:58.059371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535216822095292:10060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:58.059373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535216822095292:10060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:58.059382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:58.060480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:58.062070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:58.062088Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:58.062091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:58.062095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:58.062101Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2544 [1:7556535216822095287:10061]
2025-10-02T08:15:58.062115Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:58.062132Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:58.062137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.062140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.062142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.062158Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:58.062162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:58.062168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:58.062229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.062239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.062241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:58.062244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:58.062313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:58.062322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.062334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.062353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:58.062353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2544
2025-10-02T08:15:58.062371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822095335:10060], now have 1 active actors on pipe
2025-10-02T08:15:58.062377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.062381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.062396Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535216822095281:10061]
2025-10-02T08:15:58.062402Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535216822095281:10061]
2025-10-02T08:15:58.062413Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:58.062425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535217281453892:2378], now have 1 active actors on pipe
2025-10-02T08:15:58.062428Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:58.062431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:58.062436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:58.062448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:58.062452Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:58.062426Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2544
2025-10-02T08:15:58.062465Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97575025-f26edf96-eea96517-bb2b8bc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:58.062475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.062479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.062481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:58.062489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.062500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:58.062536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535216822095281:10061]
2025-10-02T08:15:58.062548Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:58.062566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.062569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:58.062642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.062650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.062666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.062707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2545 partition: 0 MaxSeqNo: 17 sessionId: src_id|97575025-f26edf96-eea96517-bb2b8bc1_0
2025-10-02T08:15:58.063032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1364a3-592a21ca-85980105-b96b6f27_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|97575025-f26edf96-eea96517-bb2b8bc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:58.065712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97575025-f26edf96-eea96517-bb2b8bc1_0] Write session: try to update token
2025-10-02T08:15:58.065731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97575025-f26edf96-eea96517-bb2b8bc1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:58.080210Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:58.080226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:58.080228Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:58.080237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535216822095281:10061]
2025-10-02T08:15:58.080240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535216822095281:10061]
2025-10-02T08:15:58.080284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:58.080286Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:58.080290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.080292Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:58.080292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:58.080427Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:58.081531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId: src_id|97575025-f26edf96-eea96517-bb2b8bc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:58.084119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:58.141785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535216822095351:8443]
2025-10-02T08:15:58.141883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2544, pipe: [1:7556535216822095351:8443]
2025-10-02T08:15:58.218265Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:58.218513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.218529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.218589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822095351:8443], now have 1 active actors on pipe
2025-10-02T08:15:58.218733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535216822095351:8443]
2025-10-02T08:15:58.218754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:58.218756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:58.218785Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:58.218817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2545 reason: error at write: Disconnected sessionId: src_id|97575025-f26edf96-eea96517-bb2b8bc1_0
2025-10-02T08:15:58.218833Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:58.218980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2545 sessionId: src_id|97575025-f26edf96-eea96517-bb2b8bc1_0 is DEAD
2025-10-02T08:15:58.219107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97575025-f26edf96-eea96517-bb2b8bc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:58.219116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97575025-f26edf96-eea96517-bb2b8bc1_0] Write session will restart in 0.008083s
2025-10-02T08:15:58.219139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97575025-f26edf96-eea96517-bb2b8bc1_0] Write session: Do CDS request
2025-10-02T08:15:58.219146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97575025-f26edf96-eea96517-bb2b8bc1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:58.228030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:58.228342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97575025-f26edf96-eea96517-bb2b8bc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.228445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:58.228454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2546
2025-10-02T08:15:58.228569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.228601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:58.228605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:58.228608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:58.228702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:58.228897Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:58.228906Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:58.228917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:58.228973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:58.228989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2546 sessionId:  describe result for acl check
2025-10-02T08:15:58.229015Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535216822095591:10083]
2025-10-02T08:15:58.229021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:58.229022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:58.229024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:58.229029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535216822095594:10110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:58.229549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535216822095594:10110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:58.229614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:58.229831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:58.229881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:58.230295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:58.230347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.230354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.230355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.230356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.230357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.230363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.230372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.230376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.230379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.230383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.230387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.230395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.230400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.230405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.230410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.230415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.230419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.230424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.230428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.230433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.230452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:58.231558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535216822095594:10110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:58.237234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535216822095594:10110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:58.237248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535216822095594:10110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:58.237251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535216822095594:10110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:58.237259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:58.238284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:58.239991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:58.240008Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:58.240010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:58.240014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:58.240022Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2545 [1:7556535216822095591:10083]
2025-10-02T08:15:58.240031Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:58.240043Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:58.240045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.240047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.240048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.240061Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:58.240065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:58.240069Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:58.240128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.240134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.240138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:58.240139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:58.240194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:58.240201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.240214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.240224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:58.240249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822095637:10110], now have 1 active actors on pipe
2025-10-02T08:15:58.240259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535216822095583:10083]
2025-10-02T08:15:58.240261Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535216822095583:10083]
2025-10-02T08:15:58.240264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2545
2025-10-02T08:15:58.240268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:58.240279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535217281453898:2378], now have 1 active actors on pipe
2025-10-02T08:15:58.240280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:58.240283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:58.240284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:58.240295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:58.240297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:58.240328Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2545
2025-10-02T08:15:58.240304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.240315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.240351Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535216822095583:10083]
2025-10-02T08:15:58.240353Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:58.240364Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:58.240364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:58.240368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.240370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.240372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:58.240378Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.240384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:58.240504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.240598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.240607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.240629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.240669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2546 partition: 0 MaxSeqNo: 17 sessionId: src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0
2025-10-02T08:15:58.240997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97575025-f26edf96-eea96517-bb2b8bc1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:58.243731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0] Write session: try to update token
2025-10-02T08:15:58.243748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:58.257764Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:58.257783Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:58.257785Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:58.257792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535216822095583:10083]
2025-10-02T08:15:58.257796Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535216822095583:10083]
2025-10-02T08:15:58.257840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:58.257839Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:58.257845Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:58.257848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.257850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:58.258001Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:58.259509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId: src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:58.262273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:58.318939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535216822095651:8443]
2025-10-02T08:15:58.319080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2545, pipe: [1:7556535216822095651:8443]
2025-10-02T08:15:58.391412Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:58.391737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.391751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.391791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822095651:8443], now have 1 active actors on pipe
2025-10-02T08:15:58.391900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535216822095651:8443]
2025-10-02T08:15:58.391919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:58.391925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:58.391976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2546 reason: error at write: Disconnected sessionId: src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0
2025-10-02T08:15:58.391985Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:58.392030Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:58.392145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2546 sessionId: src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0 is DEAD
2025-10-02T08:15:58.392324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:58.392333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0] Write session will restart in 0.008779s
2025-10-02T08:15:58.392352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0] Write session: Do CDS request
2025-10-02T08:15:58.392356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:58.401017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:58.401887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:58.402065Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:58.402074Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:58.402084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:58.402129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:58.402175Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535216822095891:10108]
2025-10-02T08:15:58.402232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.402321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:58.402332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2547
2025-10-02T08:15:58.402431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.402456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:58.402464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:58.402468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:58.402763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:58.402819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2547 sessionId:  describe result for acl check
2025-10-02T08:15:58.402855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:58.402861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:58.402863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:58.402868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535216822095898:10116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:58.402950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:58.402996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:58.403271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:58.403325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.403331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.403332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.403333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.403334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.403339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.403346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.403349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.403353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.403356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.403361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.403367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.403367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535216822095898:10116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:58.403372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.403376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.403383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.403387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.403412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.403422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.403427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.403432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.403450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:58.405388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535216822095898:10116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:58.410556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535216822095898:10116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:58.410568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535216822095898:10116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:58.410571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535216822095898:10116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:58.410580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:58.411063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:58.412636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:58.412648Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:58.412649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:58.412652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:58.412656Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2546 [1:7556535216822095891:10108]
2025-10-02T08:15:58.412663Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:58.412676Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:58.412677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.412679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.412680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.412693Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:58.412696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:58.412701Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:58.412740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.412746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.412748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:58.412750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:58.412791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:58.412796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.412821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.412832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:58.412842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535216822095885:10108]
2025-10-02T08:15:58.412847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535216822095885:10108]
2025-10-02T08:15:58.412852Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:58.412860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:58.412868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:58.412874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:58.412873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:58.412876Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:58.412890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2546
2025-10-02T08:15:58.412899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822095938:10116], now have 1 active actors on pipe
2025-10-02T08:15:58.412901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535217281453906:2378], now have 1 active actors on pipe
2025-10-02T08:15:58.412903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535216822095885:10108]
2025-10-02T08:15:58.412908Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:58.412912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.412914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.412917Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:58.412944Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:58.412951Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.412954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.412932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2546
2025-10-02T08:15:58.412955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:58.412961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.412967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:58.412982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.413019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.413031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.413055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.413092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2547 partition: 0 MaxSeqNo: 17 sessionId: src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0
2025-10-02T08:15:58.413414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e6ea6ae-3d028db6-294e4f4d-22138604_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:58.416004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0] Write session: try to update token
2025-10-02T08:15:58.416019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:58.429294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId: src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:58.430323Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:58.430340Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:58.430343Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:58.430352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535216822095885:10108]
2025-10-02T08:15:58.430356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535216822095885:10108]
2025-10-02T08:15:58.430395Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:58.430402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:58.430407Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:58.430408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.430411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:58.430591Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:58.432027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:58.491974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535216822095953:8443]
2025-10-02T08:15:58.492052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2546, pipe: [1:7556535216822095953:8443]
2025-10-02T08:15:58.574748Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:58.575202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.575215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.575252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822095953:8443], now have 1 active actors on pipe
2025-10-02T08:15:58.575354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:58.575362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:58.575462Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:58.575411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2547 reason: error at write: Disconnected sessionId: src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0
2025-10-02T08:15:58.575423Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:58.575603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2547 sessionId: src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0 is DEAD
2025-10-02T08:15:58.575743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:58.575751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0] Write session will restart in 0.007699s
2025-10-02T08:15:58.575773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0] Write session: Do CDS request
2025-10-02T08:15:58.575779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:58.575774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535216822095953:8443]
2025-10-02T08:15:58.584375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.584441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:58.584454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2548
2025-10-02T08:15:58.584585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.584616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:58.584621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:58.584624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:58.585074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2548 sessionId:  describe result for acl check
2025-10-02T08:15:58.585105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:58.585106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:58.585108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:58.585113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535216822096192:10133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:58.585314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:58.585592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535216822096192:10133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:58.586172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:58.586333Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:58.586343Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:58.586352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:58.586399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:58.586433Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535216822096209:10144]
2025-10-02T08:15:58.586890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:58.587101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:58.587152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:58.587471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535216822096192:10133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:58.587492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:58.587540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.587547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.587549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.587550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.587551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.587556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.587566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.587569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.587573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.587576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.587581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.587588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.587594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.587598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.587602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.587607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.587611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.587615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.587621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.587625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.587655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:58.593499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535216822096192:10133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:58.593518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535216822096192:10133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:58.593521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535216822096192:10133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:58.593531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:58.595233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:58.596593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:58.596604Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:58.596606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:58.596609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:58.596613Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2547 [1:7556535216822096209:10144]
2025-10-02T08:15:58.596621Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:58.596634Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:58.596636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.596638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.596639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.596651Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:58.596654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:58.596659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:58.596703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.596710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.596712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:58.596714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:58.596758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:58.596763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.596771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.596777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:58.596794Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535216822096193:10144]
2025-10-02T08:15:58.596839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2547
2025-10-02T08:15:58.596849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535216822096193:10144]
2025-10-02T08:15:58.596856Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:58.596866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:58.596875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:58.596875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822096245:10133], now have 1 active actors on pipe
2025-10-02T08:15:58.596881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:58.596891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:58.596897Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:58.596901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535217281453912:2378], now have 1 active actors on pipe
2025-10-02T08:15:58.596904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.596907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.596935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535216822096193:10144]
2025-10-02T08:15:58.596943Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:58.596934Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2547
2025-10-02T08:15:58.596953Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:58.596958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:58.596960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.596963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.596964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:58.596970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.596978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:58.597003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.597063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.597070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.597079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.597107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2548 partition: 0 MaxSeqNo: 17 sessionId: src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0
2025-10-02T08:15:58.597410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76be1fcd-6af808eb-e0d44140-c5c09c98_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:58.599857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0] Write session: try to update token
2025-10-02T08:15:58.599870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:58.612598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId: src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:58.614426Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:58.614440Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:58.614443Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:58.614451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535216822096193:10144]
2025-10-02T08:15:58.614455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535216822096193:10144]
2025-10-02T08:15:58.614492Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:58.614499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:58.614503Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:58.614506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.614508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:58.614667Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:58.615244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:58.675776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535216822096259:8443]
2025-10-02T08:15:58.675892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2547, pipe: [1:7556535216822096259:8443]
2025-10-02T08:15:58.747474Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:58.747754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.747767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.747796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822096259:8443], now have 1 active actors on pipe
2025-10-02T08:15:58.747875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535216822096259:8443]
2025-10-02T08:15:58.747975Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:58.748021Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:58.748240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:58.748285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0
2025-10-02T08:15:58.748467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2548 sessionId: src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0 is DEAD
2025-10-02T08:15:58.748615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:58.748621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0] Write session will restart in 0.009916s
2025-10-02T08:15:58.748654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0] Write session: Do CDS request
2025-10-02T08:15:58.748661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:58.757460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:58.758375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:58.758526Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:58.758533Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:58.758540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:58.758574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:58.758671Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535216822096518:10205]
2025-10-02T08:15:58.759170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:58.759297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.759417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:58.759475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:58.759827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:58.759880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.759887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.759888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.759889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.759890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.759895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.759905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.759909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.759912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.759916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.759921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.759928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.759933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.759937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.759941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.759945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.759949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.759953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.759957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.759961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.759978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:58.759997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:58.760007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2549
2025-10-02T08:15:58.760121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.760148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:58.760158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:58.760164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:58.760498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2549 sessionId:  describe result for acl check
2025-10-02T08:15:58.760527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:58.760532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:58.760533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:58.760538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535216822096535:10192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:58.761018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535216822096535:10192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:58.763257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535216822096535:10192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:58.767868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:58.769529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:58.769545Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:58.769547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:58.769552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:58.769557Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2548 [1:7556535216822096518:10205]
2025-10-02T08:15:58.769567Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:58.769582Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:58.769585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.769587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.769589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.769604Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:58.769613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:58.769619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:58.769687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.769696Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.769699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:58.769701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:58.769764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:58.769770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.769782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.769799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:58.769821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535217281453932:2378], now have 1 active actors on pipe
2025-10-02T08:15:58.769831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535216822096512:10205]
2025-10-02T08:15:58.769840Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535216822096512:10205]
2025-10-02T08:15:58.769853Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:58.769866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:58.769869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:58.769875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:58.769881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:58.769884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:58.769914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535216822096512:10205]
2025-10-02T08:15:58.769930Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:58.769921Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2548
2025-10-02T08:15:58.769966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:58.770192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535216822096535:10192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:58.770204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535216822096535:10192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:58.770207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535216822096535:10192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:58.770214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:58.770439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2548
2025-10-02T08:15:58.770557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822096572:10192], now have 1 active actors on pipe
2025-10-02T08:15:58.770570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.770573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.770595Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|968c2183-59d54327-25496a84-50dea02a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:58.770602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.770609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.770611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:58.770619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.770632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:58.770650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.770688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.770695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.770705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.770732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2549 partition: 0 MaxSeqNo: 17 sessionId: src_id|968c2183-59d54327-25496a84-50dea02a_0
2025-10-02T08:15:58.771080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd16d74-7e6b4a70-38dd1c45-a38fad17_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|968c2183-59d54327-25496a84-50dea02a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:58.773709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968c2183-59d54327-25496a84-50dea02a_0] Write session: try to update token
2025-10-02T08:15:58.773725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968c2183-59d54327-25496a84-50dea02a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:58.786997Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:58.787011Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:58.787012Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:58.787018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535216822096512:10205]
2025-10-02T08:15:58.787021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535216822096512:10205]
2025-10-02T08:15:58.787058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:58.787066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.787066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:58.787068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:58.787073Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:58.787218Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:58.790418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId: src_id|968c2183-59d54327-25496a84-50dea02a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:58.792838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:58.847830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535216822096606:8443]
2025-10-02T08:15:58.847942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2548, pipe: [1:7556535216822096606:8443]
2025-10-02T08:15:58.919430Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:58.920082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.920104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.920143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822096606:8443], now have 1 active actors on pipe
2025-10-02T08:15:58.920239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535216822096606:8443]
2025-10-02T08:15:58.920259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:58.920261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:58.920306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2549 reason: error at write: Disconnected sessionId: src_id|968c2183-59d54327-25496a84-50dea02a_0
2025-10-02T08:15:58.920343Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:58.920384Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:58.920483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2549 sessionId: src_id|968c2183-59d54327-25496a84-50dea02a_0 is DEAD
2025-10-02T08:15:58.920650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968c2183-59d54327-25496a84-50dea02a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:58.920661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968c2183-59d54327-25496a84-50dea02a_0] Write session will restart in 0.005254s
2025-10-02T08:15:58.920683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968c2183-59d54327-25496a84-50dea02a_0] Write session: Do CDS request
2025-10-02T08:15:58.920689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968c2183-59d54327-25496a84-50dea02a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:58.927245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968c2183-59d54327-25496a84-50dea02a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.927281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:58.927294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2550
2025-10-02T08:15:58.927413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:58.927441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:58.927445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:58.927448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:58.927840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2550 sessionId:  describe result for acl check
2025-10-02T08:15:58.927871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:58.927872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:58.927873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:58.927878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535216822096820:10246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:58.928279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535216822096820:10246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:58.930278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535216822096820:10246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:58.930316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:58.931138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:58.931293Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:58.931301Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:58.931309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:58.931351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:58.931386Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535216822096895:10232]
2025-10-02T08:15:58.931936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:58.932089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:58.932139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:58.932403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:58.932445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.932450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.932451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.932452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.932453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.932457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.932465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.932469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.932473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.932476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.932481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.932492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:58.932497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.932502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:58.932506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.932511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:58.932515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.932521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.932529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.932533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.932551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:58.932590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535216822096820:10246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:58.932603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535216822096820:10246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:58.932606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535216822096820:10246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:58.932614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:58.940256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:58.941639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:58.941654Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:58.941657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:58.941660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:58.941666Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2549 [1:7556535216822096895:10232]
2025-10-02T08:15:58.941677Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:58.941692Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:58.941702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.941705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.941707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.941723Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:58.941736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:58.941743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:58.941799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.941807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.941810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:58.941813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:58.941876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:58.941883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.941895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:58.941907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:58.941913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2549
2025-10-02T08:15:58.941928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535216822096910:10246], now have 1 active actors on pipe
2025-10-02T08:15:58.941931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535217281453962:2378], now have 1 active actors on pipe
2025-10-02T08:15:58.941935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.941940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.941955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535216822096879:10232]
2025-10-02T08:15:58.941962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535216822096879:10232]
2025-10-02T08:15:58.941973Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:58.941987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:58.942004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:58.942007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:58.942020Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:58.942030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.942007Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2549
2025-10-02T08:15:58.942034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.942037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:58.942040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:58.942041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:58.942049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.942058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:58.942091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535216822096879:10232]
2025-10-02T08:15:58.942103Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:58.942122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.942122Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:58.942180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.942186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.942199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:58.942234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2550 partition: 0 MaxSeqNo: 17 sessionId: src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0
2025-10-02T08:15:58.942568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968c2183-59d54327-25496a84-50dea02a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:58.944958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0] Write session: try to update token
2025-10-02T08:15:58.944972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:58.955958Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:58.955978Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:58.955988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535216822096879:10232]
2025-10-02T08:15:58.956028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:58.956039Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:58.956203Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:58.956341Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:58.956473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:58.956613Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:58.956824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:58.956867Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:58.959160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId: src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:58.961613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:58.961675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.961687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.961718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:58.961745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:58.961799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:58.961811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:58.961993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.962053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.962115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.962174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.962347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.962356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.962421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.962482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.962579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.962640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.962682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.962689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.962752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.962807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.962868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.962926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.962972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.962978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.963042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.963104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.963164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.963226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.963270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.963276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.963339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.963403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.963463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.963525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.963569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.963576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.963640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.963700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.963759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.963816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.963862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.963869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.963935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.963995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.964056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.964137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.964258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.964265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.964326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.964385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.964448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.964508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.964553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.964559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.964623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.964682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.964742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.964829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.964871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.964878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.964946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:58.965006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:58.965068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:58.965175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:58.965217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:58.965224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:58.965260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:58.965324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:58.965348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:58.965350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:58.965378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:58.965396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:58.965399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:58.965403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:58.965405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:58.965775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:58.965800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:58.965809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:58.965816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:58.965818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:58.965821Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:58.966264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:58.966284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:58.966293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:58.966299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:58.966302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:58.966304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:58.966825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:58.966844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:58.966853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:58.966856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:58.966862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:58.968971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:58.968989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:58.969000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392958968
2025-10-02T08:15:58.969126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:58.969139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:58.969148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:58.969155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:58.969158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:58.969165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:58.969589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:58.969609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:58.969614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:58.969617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:58.969620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:58.969623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:58.970053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:58.970073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:58.970083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:58.970087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:58.970090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:58.970094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:58.970530Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:58.970548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:58.970557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:58.971569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:58.971585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:58.971589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:58.971592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:58.971600Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392958971
2025-10-02T08:15:58.971874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:58.971891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:58.971900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:58.971904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:58.971911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:58.971916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:58.972371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:58.972393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:58.972398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:58.972402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:58.972404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:58.972408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:58.972858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:58.972877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:58.972969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392958972
2025-10-02T08:15:58.973701Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:58.973721Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:58.973727Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:58.973734Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:58.975220Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:58.975234Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:58.975236Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:58.975246Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535216822096879:10232]
2025-10-02T08:15:58.975249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535216822096879:10232]
2025-10-02T08:15:58.975298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:58.975301Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:58.975306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:58.975307Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:58.975308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:58.975445Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:59.020355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535221117064229:8443]
2025-10-02T08:15:59.020477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2549, pipe: [1:7556535221117064229:8443]
2025-10-02T08:15:59.102677Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:59.102980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117064229:8443], now have 1 active actors on pipe
2025-10-02T08:15:59.103120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535221117064229:8443]
2025-10-02T08:15:59.103136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:59.103137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:59.103155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2550 reason: error at write: Disconnected sessionId: src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0
2025-10-02T08:15:59.103166Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:59.103293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2550 sessionId: src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0 is DEAD
2025-10-02T08:15:59.103533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:59.103548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0] Write session will restart in 0.006040s
2025-10-02T08:15:59.103570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0] Write session: Do CDS request
2025-10-02T08:15:59.103577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:59.103420Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:59.110297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.110669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:59.110682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2551
2025-10-02T08:15:59.110779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.110807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:59.110816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:59.110819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:59.111264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2551 sessionId:  describe result for acl check
2025-10-02T08:15:59.111292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:59.111293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:59.111294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:59.111300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535221117064438:10293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:59.111829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535221117064438:10293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:59.113500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:59.114239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535221117064438:10293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:59.114354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:59.114495Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:59.114504Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:59.114512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:59.114552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:59.114585Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535221117064503:10276]
2025-10-02T08:15:59.115118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:59.115329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:59.115388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:59.115716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:59.115775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.115781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.115782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.115783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.115784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.115789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.115798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.115802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.115806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.115809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.115815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.115823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.115834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.115839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.115846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.115851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.115855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.115860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.115865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.115874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.115891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:59.120442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535221117064438:10293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:59.120455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535221117064438:10293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:59.120459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535221117064438:10293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:59.120467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:59.126006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:59.127519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:59.127534Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:59.127537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:59.127541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:59.127546Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2550 [1:7556535221117064503:10276]
2025-10-02T08:15:59.127557Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:59.127572Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:59.127576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.127581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.127583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.127598Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:59.127603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:59.127609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:59.127716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.127725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.127728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:59.127731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:59.127799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:59.127807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.127820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.127835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:59.127858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117064528:10293], now have 1 active actors on pipe
2025-10-02T08:15:59.127869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2550
2025-10-02T08:15:59.127870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535221117064495:10276]
2025-10-02T08:15:59.127872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535221117064495:10276]
2025-10-02T08:15:59.127878Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:59.127891Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:59.127892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:59.127894Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:59.127906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:59.127908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:59.127913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535221576421264:2378], now have 1 active actors on pipe
2025-10-02T08:15:59.127918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.127921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.127962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535221117064495:10276]
2025-10-02T08:15:59.127974Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:59.127985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:59.127990Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4797b65-2f4edf10-fd908ba-4b565549_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:59.127997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.128001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.128002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:59.127981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2550
2025-10-02T08:15:59.128012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.128024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:59.128065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.128115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.128121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.128133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.128169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2551 partition: 0 MaxSeqNo: 17 sessionId: src_id|d4797b65-2f4edf10-fd908ba-4b565549_0
2025-10-02T08:15:59.128498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf9f799-d593b99d-b38c5b5e-409b8bb9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d4797b65-2f4edf10-fd908ba-4b565549_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:59.131166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4797b65-2f4edf10-fd908ba-4b565549_0] Write session: try to update token
2025-10-02T08:15:59.131184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4797b65-2f4edf10-fd908ba-4b565549_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:59.140946Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:15:59.140967Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:59.140974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535221117064495:10276]
2025-10-02T08:15:59.141007Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:15:59.141014Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:15:59.141160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:15:59.141285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:59.141407Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:59.141533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:15:59.141704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:15:59.141733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:15:59.146000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId: src_id|d4797b65-2f4edf10-fd908ba-4b565549_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:59.148216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:59.148281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.148308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.148335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:15:59.148372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:59.148417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.148434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.148591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.148679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.148735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.148794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.148853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.148861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.148923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.148981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.149038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.149122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.149165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.149174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.149239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.149290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.149338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.149389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.149433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.149440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.149497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.149548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.149601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.149653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.149714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.149721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.149785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.149835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.149922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.150002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.150043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.150050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.150114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.150166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.150216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.150270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.150321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.150326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.150391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.150444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.150498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.150552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.150591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.150596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.150651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.150703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.150757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.150810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.150850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.150854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.150919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.150980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.151032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.151084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.151121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.151126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.151180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:15:59.151230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:15:59.151282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:15:59.151343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:15:59.151393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:15:59.151400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:15:59.151429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:15:59.151478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.151493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.151498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:15:59.151521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:15:59.151535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:15:59.151540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:15:59.151542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:15:59.151544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:15:59.151896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:15:59.151916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:15:59.151923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:15:59.151927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:15:59.151930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:15:59.151934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:15:59.152607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:15:59.152628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:15:59.152633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:15:59.152636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:15:59.152639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:15:59.152641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:15:59.153150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:15:59.153167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:15:59.153171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:15:59.153173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:15:59.153176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:15:59.154408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:15:59.154424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:15:59.154433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392959153
2025-10-02T08:15:59.154533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:15:59.154543Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:15:59.154547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:15:59.154549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:15:59.154552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:15:59.154556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:15:59.155035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:15:59.155054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:15:59.155059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:15:59.155064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:15:59.155068Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:15:59.155071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:15:59.155559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:15:59.155579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:15:59.155586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:15:59.155591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:15:59.155594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:15:59.155597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:15:59.156021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:15:59.156040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:15:59.156045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:15:59.157058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:15:59.157075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:15:59.157080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:15:59.157083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:15:59.157091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392959157
2025-10-02T08:15:59.157350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:15:59.157366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:15:59.157372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:15:59.157374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:15:59.157376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:15:59.157377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:15:59.157791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:15:59.157811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:15:59.157816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:15:59.157819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:15:59.157822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:15:59.157827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:15:59.158226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:15:59.158242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.158329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392959158
2025-10-02T08:15:59.158984Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:15:59.158997Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:15:59.159002Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:15:59.159006Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:15:59.160556Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:59.160568Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:59.160570Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:59.160580Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535221117064495:10276]
2025-10-02T08:15:59.160585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535221117064495:10276]
2025-10-02T08:15:59.160637Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:59.160639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:59.160643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.160645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:59.160649Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:59.160772Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:59.203157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535221117064549:8443]
2025-10-02T08:15:59.203269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2550, pipe: [1:7556535221117064549:8443]
2025-10-02T08:15:59.288191Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:59.288534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117064549:8443], now have 1 active actors on pipe
2025-10-02T08:15:59.288662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535221117064549:8443]
2025-10-02T08:15:59.288683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:59.288685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:59.288706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2551 reason: error at write: Disconnected sessionId: src_id|d4797b65-2f4edf10-fd908ba-4b565549_0
2025-10-02T08:15:59.288812Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:59.289158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4797b65-2f4edf10-fd908ba-4b565549_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:59.289171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4797b65-2f4edf10-fd908ba-4b565549_0] Write session will restart in 0.005255s
2025-10-02T08:15:59.288792Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:59.288893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2551 sessionId: src_id|d4797b65-2f4edf10-fd908ba-4b565549_0 is DEAD
2025-10-02T08:15:59.289192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4797b65-2f4edf10-fd908ba-4b565549_0] Write session: Do CDS request
2025-10-02T08:15:59.289198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4797b65-2f4edf10-fd908ba-4b565549_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:59.295215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4797b65-2f4edf10-fd908ba-4b565549_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.295296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:59.295305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2552
2025-10-02T08:15:59.295403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.295432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:59.295441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:59.295443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:59.295780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2552 sessionId:  describe result for acl check
2025-10-02T08:15:59.295801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:59.295805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:59.295806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:59.295809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535221117064761:10316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:59.296202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535221117064761:10316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:59.297775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:59.298105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535221117064761:10316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:59.298556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:59.298713Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:59.298719Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:59.298728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:59.298776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:59.298806Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535221117064829:10283]
2025-10-02T08:15:59.299388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:59.299574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:59.299630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:59.299932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:59.299998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.300003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.300004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.300005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.300006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.300011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.300020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.300023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.300026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.300029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.300034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.300040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.300049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.300053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.300056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.300061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.300064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.300068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.300072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.300076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.300101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:59.300525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535221117064761:10316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:59.300537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535221117064761:10316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:59.300540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535221117064761:10316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:59.300548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:59.307683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:59.309358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:59.309368Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:59.309370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:59.309373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:59.309377Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2551 [1:7556535221117064829:10283]
2025-10-02T08:15:59.309386Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:59.309400Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:59.309402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.309404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.309406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.309416Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:59.309419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:59.309424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:59.309480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.309488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.309490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:59.309492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:59.309540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:59.309545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.309554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.309564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:59.309576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535221117064813:10283]
2025-10-02T08:15:59.309577Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535221117064813:10283]
2025-10-02T08:15:59.309582Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:59.309593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117064847:10316], now have 1 active actors on pipe
2025-10-02T08:15:59.309596Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:59.309600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:59.309601Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:59.309608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2551
2025-10-02T08:15:59.309609Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:59.309610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:59.309615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535221576421273:2378], now have 1 active actors on pipe
2025-10-02T08:15:59.309644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.309652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.309664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535221117064813:10283]
2025-10-02T08:15:59.309676Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:59.309684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:59.309703Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2551
2025-10-02T08:15:59.309705Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96c221a5-fa906d8-3c489950-6409d606_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:59.309711Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.309715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.309716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:59.309726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.309734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:59.309756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.309797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.309802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.309811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.309839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2552 partition: 0 MaxSeqNo: 17 sessionId: src_id|96c221a5-fa906d8-3c489950-6409d606_0
2025-10-02T08:15:59.310110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4797b65-2f4edf10-fd908ba-4b565549_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|96c221a5-fa906d8-3c489950-6409d606_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:59.312636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c221a5-fa906d8-3c489950-6409d606_0] Write session: try to update token
2025-10-02T08:15:59.312651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c221a5-fa906d8-3c489950-6409d606_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:59.326021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId: src_id|96c221a5-fa906d8-3c489950-6409d606_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:59.326613Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:59.326626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:59.326628Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:59.326636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535221117064813:10283]
2025-10-02T08:15:59.326642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535221117064813:10283]
2025-10-02T08:15:59.326683Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:59.326686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:59.326693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.326695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:59.326705Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:59.326890Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:59.328301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:59.389010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535221117064861:8443]
2025-10-02T08:15:59.389133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2551, pipe: [1:7556535221117064861:8443]
2025-10-02T08:15:59.462267Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:59.462520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.462529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.462561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117064861:8443], now have 1 active actors on pipe
2025-10-02T08:15:59.462669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535221117064861:8443]
2025-10-02T08:15:59.462689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:59.462691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:59.462744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2552 reason: error at write: Disconnected sessionId: src_id|96c221a5-fa906d8-3c489950-6409d606_0
2025-10-02T08:15:59.462779Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:59.462810Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:59.462906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2552 sessionId: src_id|96c221a5-fa906d8-3c489950-6409d606_0 is DEAD
2025-10-02T08:15:59.463030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c221a5-fa906d8-3c489950-6409d606_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:59.463041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c221a5-fa906d8-3c489950-6409d606_0] Write session will restart in 0.006884s
2025-10-02T08:15:59.463065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c221a5-fa906d8-3c489950-6409d606_0] Write session: Do CDS request
2025-10-02T08:15:59.463072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c221a5-fa906d8-3c489950-6409d606_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:59.471320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c221a5-fa906d8-3c489950-6409d606_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.471648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:59.471665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2553
2025-10-02T08:15:59.471763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.471794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:59.471801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:59.471804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:59.472187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2553 sessionId:  describe result for acl check
2025-10-02T08:15:59.472216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:59.472224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:59.472226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:59.472231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535221117065108:10344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:59.472315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:59.472696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535221117065108:10344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:59.473553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:59.473695Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:59.473702Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:59.473709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:59.473741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:59.473768Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535221117065124:10369]
2025-10-02T08:15:59.474171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:59.474458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:59.474515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:59.474835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535221117065108:10344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:59.474851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:59.474897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.474908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.474910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.474911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.474912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.474916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.474925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.474929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.474933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.474936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.474941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.474948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.474953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.474958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.474964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.474969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.474973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.474978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.474982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.474986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.475004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:59.480756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535221117065108:10344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:59.480772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535221117065108:10344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:59.480776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535221117065108:10344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:59.480783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:59.482608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:59.484119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:59.484132Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:59.484135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:59.484138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:59.484144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2552 [1:7556535221117065124:10369]
2025-10-02T08:15:59.484156Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:59.484169Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:59.484171Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.484173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.484174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.484186Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:59.484189Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:59.484193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:59.484250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.484256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.484259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:59.484261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:59.484307Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:59.484314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.484323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.484329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:59.484345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535221117065109:10369]
2025-10-02T08:15:59.484350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535221117065109:10369]
2025-10-02T08:15:59.484355Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:59.484365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117065161:10344], now have 1 active actors on pipe
2025-10-02T08:15:59.484371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:59.484372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:59.484375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:59.484377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2552
2025-10-02T08:15:59.484382Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:59.484383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:59.484387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535221576421280:2378], now have 1 active actors on pipe
2025-10-02T08:15:59.484411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.484418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.484431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535221117065109:10369]
2025-10-02T08:15:59.484443Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:59.484451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:59.484469Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:59.484476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.484479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.484483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:59.484489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.484496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:59.484458Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2552
2025-10-02T08:15:59.484521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.484593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.484598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.484609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.484638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2553 partition: 0 MaxSeqNo: 17 sessionId: src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0
2025-10-02T08:15:59.485009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c221a5-fa906d8-3c489950-6409d606_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:59.487691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0] Write session: try to update token
2025-10-02T08:15:59.487710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:59.501088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId: src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:59.501466Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:59.501482Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:59.501485Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:59.501496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535221117065109:10369]
2025-10-02T08:15:59.501501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535221117065109:10369]
2025-10-02T08:15:59.501541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:59.501544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:59.501550Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:59.501553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.501555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:59.501697Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:59.503574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:59.562587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535221117065180:8443]
2025-10-02T08:15:59.562685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2552, pipe: [1:7556535221117065180:8443]
2025-10-02T08:15:59.629497Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:59.629773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.629784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.629815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117065180:8443], now have 1 active actors on pipe
2025-10-02T08:15:59.629944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535221117065180:8443]
2025-10-02T08:15:59.629970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:59.629977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:59.629984Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:59.630053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2553 reason: error at write: Disconnected sessionId: src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0
2025-10-02T08:15:59.630037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:59.630209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2553 sessionId: src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0 is DEAD
2025-10-02T08:15:59.630359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:59.630367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0] Write session will restart in 0.006775s
2025-10-02T08:15:59.630384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0] Write session: Do CDS request
2025-10-02T08:15:59.630388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:59.638297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.638333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:59.638348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2554
2025-10-02T08:15:59.638507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.638548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:59.638556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:59.638559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:59.638921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2554 sessionId:  describe result for acl check
2025-10-02T08:15:59.638955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:59.638961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:59.638963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:59.638969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535221117065421:10368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:59.639433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535221117065421:10368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:59.639732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:59.640790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:59.640968Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:59.640978Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:59.640986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:59.641030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:59.641084Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535221117065454:10367]
2025-10-02T08:15:59.641252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535221117065421:10368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:59.641668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:59.641855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:59.641903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:59.642201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:59.642270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.642278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.642280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.642281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.642282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.642287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.642297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.642301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.642305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.642308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.642314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.642320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.642331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.642336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.642341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.642350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.642355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.642360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.642364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.642370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.642395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:59.647224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535221117065421:10368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:59.647247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535221117065421:10368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:59.647251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535221117065421:10368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:59.647259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:59.650424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:59.652046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:59.652061Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:59.652063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:59.652066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:59.652071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2553 [1:7556535221117065454:10367]
2025-10-02T08:15:59.652081Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:59.652106Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:59.652109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.652112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.652114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.652129Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:59.652134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:59.652142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:59.652204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.652212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.652214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:59.652217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:59.652279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:59.652286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.652299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.652309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:59.652330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117065481:10368], now have 1 active actors on pipe
2025-10-02T08:15:59.652332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2553
2025-10-02T08:15:59.652339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535221117065433:10367]
2025-10-02T08:15:59.652342Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535221117065433:10367]
2025-10-02T08:15:59.652355Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:59.652367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535221576421287:2378], now have 1 active actors on pipe
2025-10-02T08:15:59.652373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.652382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.652398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:59.652415Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:59.652416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:59.652417Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:59.652418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:59.652444Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2553
2025-10-02T08:15:59.652460Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:59.652473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.652476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.652478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:59.652487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.652495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:59.652502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535221117065433:10367]
2025-10-02T08:15:59.652506Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:59.652511Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:59.652529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.652615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.652621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.652648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.652694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2554 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0
2025-10-02T08:15:59.653039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63ea183-6e9b7a7-c17fed1f-f96880a4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:59.655678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0] Write session: try to update token
2025-10-02T08:15:59.655698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:59.669927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId: src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:59.670261Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:59.670275Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:59.670277Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:59.670284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535221117065433:10367]
2025-10-02T08:15:59.670289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535221117065433:10367]
2025-10-02T08:15:59.670328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:59.670341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.670343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:59.670451Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:59.670461Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:59.670488Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:59.672547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:59.729997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535221117065502:8443]
2025-10-02T08:15:59.730102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2553, pipe: [1:7556535221117065502:8443]
2025-10-02T08:15:59.803292Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:59.803774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.803794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.803836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117065502:8443], now have 1 active actors on pipe
2025-10-02T08:15:59.804046Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:59.804077Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:59.804374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535221117065502:8443]
2025-10-02T08:15:59.804399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:15:59.804445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0
2025-10-02T08:15:59.804591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2554 sessionId: src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0 is DEAD
2025-10-02T08:15:59.804718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:15:59.804726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0] Write session will restart in 0.008691s
2025-10-02T08:15:59.804750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0] Write session: Do CDS request
2025-10-02T08:15:59.804756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:59.813828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:59.814295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.814379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:59.814388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2555
2025-10-02T08:15:59.814476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.814500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:59.814506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:59.814509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:59.814788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2555 sessionId:  describe result for acl check
2025-10-02T08:15:59.814811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:59.814817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:59.814818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:59.814822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535221117065783:10467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:59.815285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:59.815422Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:59.815430Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:59.815439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:59.815482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:59.815515Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535221117065786:10459]
2025-10-02T08:15:59.815914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:59.815950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535221117065783:10467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:59.816076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:59.816114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:59.816299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:59.816331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.816336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.816337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.816338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.816339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.816344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.816350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.816358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.816361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.816363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.816368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.816372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.816375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.816378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.816380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.816383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.816385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.816388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.816390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.816393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.816403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:59.818087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535221117065783:10467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:59.823469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535221117065783:10467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:59.823483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535221117065783:10467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:59.823486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535221117065783:10467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:59.823493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:59.824068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:15:59.825651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:15:59.825666Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:15:59.825668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:15:59.825671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:15:59.825677Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2554 [1:7556535221117065786:10459]
2025-10-02T08:15:59.825687Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:15:59.825701Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:15:59.825704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.825706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.825709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.825724Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:15:59.825729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:15:59.825734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:15:59.825786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.825794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.825797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:15:59.825799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:15:59.825858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:15:59.825865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.825878Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.825895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:15:59.825916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117065842:10467], now have 1 active actors on pipe
2025-10-02T08:15:59.825925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535221576421306:2378], now have 1 active actors on pipe
2025-10-02T08:15:59.825930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535221117065776:10459]
2025-10-02T08:15:59.825934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535221117065776:10459]
2025-10-02T08:15:59.825935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2554
2025-10-02T08:15:59.825939Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:15:59.825949Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:15:59.825950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:15:59.825952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:15:59.825963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:15:59.825966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:15:59.825972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.825975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.825982Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2554
2025-10-02T08:15:59.826009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535221117065776:10459]
2025-10-02T08:15:59.826016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:15:59.826018Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:15:59.826030Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:15:59.826037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:15:59.826040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:15:59.826041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:15:59.826049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:15:59.826057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:15:59.826096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.826134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.826140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.826152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:15:59.826183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2555 partition: 0 MaxSeqNo: 17 sessionId: src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0
2025-10-02T08:15:59.826496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4a689a0-3cb5ebb1-53d81dba-e9158574_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:15:59.829082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0] Write session: try to update token
2025-10-02T08:15:59.829101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:15:59.843511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId: src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:15:59.843712Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:15:59.843726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:15:59.843728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:15:59.843736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535221117065776:10459]
2025-10-02T08:15:59.843740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535221117065776:10459]
2025-10-02T08:15:59.843779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:15:59.843788Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.843791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:15:59.843793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:15:59.843799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:15:59.843932Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:15:59.846093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:15:59.904587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535221117065860:8443]
2025-10-02T08:15:59.904684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2554, pipe: [1:7556535221117065860:8443]
2025-10-02T08:15:59.978554Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:15:59.978869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:15:59.978885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:15:59.978925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117065860:8443], now have 1 active actors on pipe
2025-10-02T08:15:59.979045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535221117065860:8443]
2025-10-02T08:15:59.979178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:15:59.979184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:15:59.979188Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:15:59.979242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2555 reason: error at write: Disconnected sessionId: src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0
2025-10-02T08:15:59.979419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2555 sessionId: src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0 is DEAD
2025-10-02T08:15:59.979548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:15:59.979559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0] Write session will restart in 0.008631s
2025-10-02T08:15:59.979582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0] Write session: Do CDS request
2025-10-02T08:15:59.979592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:15:59.979564Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:15:59.988847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:15:59.989248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.989353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:15:59.989367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2556
2025-10-02T08:15:59.989494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:15:59.989541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:15:59.989550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:15:59.989553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:15:59.989928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2556 sessionId:  describe result for acl check
2025-10-02T08:15:59.989961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:15:59.989963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:15:59.989965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:15:59.989970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535221117066133:10506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:15:59.990003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:15:59.990154Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:15:59.990161Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:15:59.990169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:15:59.990206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:15:59.990239Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535221117066135:10499]
2025-10-02T08:15:59.990430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535221117066133:10506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:15:59.990800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:15:59.990951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:15:59.990982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:15:59.991231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:15:59.991267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.991273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.991274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.991275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.991276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.991280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.991289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.991292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.991295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.991297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.991302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.991308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:15:59.991312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.991317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:15:59.991320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.991325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:15:59.991329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.991332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:15:59.991335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.991339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:15:59.991353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:15:59.992396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535221117066133:10506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:15:59.999060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535221117066133:10506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:15:59.999075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535221117066133:10506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:15:59.999078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535221117066133:10506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:15:59.999087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:15:59.999252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:00.000843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:00.000855Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:00.000858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:00.000862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:00.000867Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2555 [1:7556535221117066135:10499]
2025-10-02T08:16:00.000880Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:00.000896Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:00.000903Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.000907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.000909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.000924Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:00.000933Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:00.000945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:00.001013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.001019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.001022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:00.001024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:00.001091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:00.001102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.001114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.001124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:00.001150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535221576421335:2378], now have 1 active actors on pipe
2025-10-02T08:16:00.001152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2555
2025-10-02T08:16:00.001153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535221117066176:10506], now have 1 active actors on pipe
2025-10-02T08:16:00.001160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535221117066126:10499]
2025-10-02T08:16:00.001162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535221117066126:10499]
2025-10-02T08:16:00.001168Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:00.001179Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:00.001180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:00.001187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:00.001192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:00.001194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:00.001201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.001205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.001207Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2555
2025-10-02T08:16:00.001243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535221117066126:10499]
2025-10-02T08:16:00.001250Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:00.001260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:00.001264Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:00.001270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.001274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.001276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:00.001285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.001298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:00.001344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.001388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.001394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.001406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.001444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2556 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0
2025-10-02T08:16:00.001778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b026daea-d82d1f56-cd4ecb48-5d6f6882_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:00.004431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0] Write session: try to update token
2025-10-02T08:16:00.004449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:00.019022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId: src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:00.019225Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:00.019238Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:00.019242Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:00.019250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535221117066126:10499]
2025-10-02T08:16:00.019254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535221117066126:10499]
2025-10-02T08:16:00.019295Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:00.019297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:00.019302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.019304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:00.019305Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:00.019438Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:00.021993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:00.079193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535225412033487:8443]
2025-10-02T08:16:00.079303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2555, pipe: [1:7556535225412033487:8443]
2025-10-02T08:16:00.158119Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:00.158558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.158585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.158625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412033487:8443], now have 1 active actors on pipe
2025-10-02T08:16:00.158740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:00.158752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:00.158810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2556 reason: error at write: Disconnected sessionId: src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0
2025-10-02T08:16:00.158863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:00.158980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2556 sessionId: src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0 is DEAD
2025-10-02T08:16:00.159011Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:00.159120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:00.159131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0] Write session will restart in 0.006437s
2025-10-02T08:16:00.159155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0] Write session: Do CDS request
2025-10-02T08:16:00.159162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:00.159157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535225412033487:8443]
2025-10-02T08:16:00.166239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.166347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:00.166358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2557
2025-10-02T08:16:00.166488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.166519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:00.166526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:00.166529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:00.166817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2557 sessionId:  describe result for acl check
2025-10-02T08:16:00.166841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:00.166842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:00.166843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:00.166847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535225412033737:10526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:00.167212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535225412033737:10526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:00.168441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:00.168748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:00.168880Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:00.168886Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:00.168893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:00.168924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:00.168952Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535225412033770:10522]
2025-10-02T08:16:00.169116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535225412033737:10526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:00.169339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:00.169495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:00.169545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:00.169854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:00.169892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.169897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.169898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.169899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.169901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.169906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.169915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.169919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.169922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.169926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.169931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.169938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.169947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.169953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.169957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.169966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.169969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.169974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.169978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.169987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.170004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:00.174759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535225412033737:10526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:00.174771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535225412033737:10526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:00.174773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535225412033737:10526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:00.174780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:00.177923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:00.179370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:00.179386Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:00.179388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:00.179391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:00.179396Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2556 [1:7556535225412033770:10522]
2025-10-02T08:16:00.179405Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:00.179417Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:00.179420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.179422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.179423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.179434Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:00.179439Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:00.179448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:00.179495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.179500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.179504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:00.179506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:00.179561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:00.179569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.179577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.179584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:00.179596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412033797:10526], now have 1 active actors on pipe
2025-10-02T08:16:00.179601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535225412033764:10522]
2025-10-02T08:16:00.179603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535225412033764:10522]
2025-10-02T08:16:00.179608Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:00.179611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2556
2025-10-02T08:16:00.179617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535225871388637:2378], now have 1 active actors on pipe
2025-10-02T08:16:00.179619Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:00.179622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:00.179621Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:00.179634Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:00.179637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:00.179643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.179647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.179682Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2556
2025-10-02T08:16:00.179687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535225412033764:10522]
2025-10-02T08:16:00.179698Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:00.179704Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:00.179714Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:00.179721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.179725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.179727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:00.179736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.179743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:00.179777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.179835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.179841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.179850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.179880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2557 partition: 0 MaxSeqNo: 17 sessionId: src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0
2025-10-02T08:16:00.180194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74abd7-3eef7841-cbf2762d-de54c7d4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:00.182757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0] Write session: try to update token
2025-10-02T08:16:00.182773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:00.196122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId: src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:00.197362Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:00.197374Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:00.197376Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:00.197383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535225412033764:10522]
2025-10-02T08:16:00.197387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535225412033764:10522]
2025-10-02T08:16:00.197428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:00.197436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.197438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:00.197530Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:00.197560Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:00.197585Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:00.198597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:00.259392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535225412033811:8443]
2025-10-02T08:16:00.259514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2556, pipe: [1:7556535225412033811:8443]
2025-10-02T08:16:00.331440Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:00.331738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.331750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.331784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412033811:8443], now have 1 active actors on pipe
2025-10-02T08:16:00.331909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535225412033811:8443]
2025-10-02T08:16:00.331924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:00.331926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:00.331966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2557 reason: error at write: Disconnected sessionId: src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0
2025-10-02T08:16:00.332032Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:00.332038Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:00.332133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2557 sessionId: src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0 is DEAD
2025-10-02T08:16:00.332295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:00.332305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0] Write session will restart in 0.006692s
2025-10-02T08:16:00.332345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0] Write session: Do CDS request
2025-10-02T08:16:00.332352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:00.340284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.340382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:00.340396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2558
2025-10-02T08:16:00.340525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.340557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:00.340563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:00.340566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:00.340929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2558 sessionId:  describe result for acl check
2025-10-02T08:16:00.340956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:00.340957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:00.340958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:00.340961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535225412034057:10534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:00.341347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535225412034057:10534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:00.342165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:00.343275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:00.343439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535225412034057:10534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:00.343460Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:00.343469Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:00.343480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:00.343533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:00.343583Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535225412034093:10571]
2025-10-02T08:16:00.344165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:00.344357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:00.344407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:00.344697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:00.344750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.344755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.344756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.344757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.344758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.344762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.344771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.344774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.344777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.344780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.344785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.344791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.344796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.344816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.344820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.344825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.344829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.344833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.344837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.344846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.344863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:00.349650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535225412034057:10534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:00.349663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535225412034057:10534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:00.349667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535225412034057:10534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:00.349675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:00.352886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:00.354548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:00.354560Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:00.354562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:00.354566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:00.354570Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2557 [1:7556535225412034093:10571]
2025-10-02T08:16:00.354579Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:00.354592Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:00.354594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.354595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.354596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.354608Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:00.354612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:00.354617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:00.354658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.354664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.354666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:00.354668Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:00.354718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:00.354723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.354731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.354739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:00.354753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535225412034076:10571]
2025-10-02T08:16:00.354758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535225412034076:10571]
2025-10-02T08:16:00.354765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:00.354777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412034121:10534], now have 1 active actors on pipe
2025-10-02T08:16:00.354782Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:00.354782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2557
2025-10-02T08:16:00.354785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:00.354788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:00.354799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:00.354802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:00.354807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535225871388645:2378], now have 1 active actors on pipe
2025-10-02T08:16:00.354835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.354845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.354855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535225412034076:10571]
2025-10-02T08:16:00.354863Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:00.354873Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:00.354889Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|103c4b08-eac28b20-150ac31a-af2946d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:00.354898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.354905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.354907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:00.354914Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.354889Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2557
2025-10-02T08:16:00.354925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:00.354951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.354993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.354998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.355007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.355033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2558 partition: 0 MaxSeqNo: 17 sessionId: src_id|103c4b08-eac28b20-150ac31a-af2946d1_0
2025-10-02T08:16:00.355311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33cb1922-fa5f4b15-ed7d4a5a-ee6bd211_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|103c4b08-eac28b20-150ac31a-af2946d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:00.357870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103c4b08-eac28b20-150ac31a-af2946d1_0] Write session: try to update token
2025-10-02T08:16:00.357885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103c4b08-eac28b20-150ac31a-af2946d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:00.372956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId: src_id|103c4b08-eac28b20-150ac31a-af2946d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:00.373026Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:00.373039Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:00.373042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:00.373051Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535225412034076:10571]
2025-10-02T08:16:00.373055Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535225412034076:10571]
2025-10-02T08:16:00.373091Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:00.373092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:00.373098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.373100Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:00.373100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:00.373240Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:00.375256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:00.431953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535225412034135:8443]
2025-10-02T08:16:00.432075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2557, pipe: [1:7556535225412034135:8443]
2025-10-02T08:16:00.509440Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:00.509648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.509658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.509690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412034135:8443], now have 1 active actors on pipe
2025-10-02T08:16:00.509799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:00.509809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:00.509879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2558 reason: error at write: Disconnected sessionId: src_id|103c4b08-eac28b20-150ac31a-af2946d1_0
2025-10-02T08:16:00.509906Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:00.510067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2558 sessionId: src_id|103c4b08-eac28b20-150ac31a-af2946d1_0 is DEAD
2025-10-02T08:16:00.510233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103c4b08-eac28b20-150ac31a-af2946d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:00.510244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103c4b08-eac28b20-150ac31a-af2946d1_0] Write session will restart in 0.008388s
2025-10-02T08:16:00.510231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535225412034135:8443]
2025-10-02T08:16:00.510269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103c4b08-eac28b20-150ac31a-af2946d1_0] Write session: Do CDS request
2025-10-02T08:16:00.510279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103c4b08-eac28b20-150ac31a-af2946d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:00.511130Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:00.520308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103c4b08-eac28b20-150ac31a-af2946d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.520418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:00.520432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2559
2025-10-02T08:16:00.520566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.520598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:00.520607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:00.520611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:00.520918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:00.521026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2559 sessionId:  describe result for acl check
2025-10-02T08:16:00.521067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:00.521073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:00.521075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:00.521081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535225412034400:10556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:00.521725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535225412034400:10556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:00.522180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:00.522386Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:00.522401Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:00.522414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:00.522479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:00.522524Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535225412034409:10547]
2025-10-02T08:16:00.523122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:00.523327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:00.523377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:00.523613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:00.523648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.523653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.523654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.523655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.523657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.523661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.523671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.523675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.523679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.523683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.523688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.523695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.523702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.523706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.523708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.523712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.523714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.523717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.523720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.523723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.523734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:00.523770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535225412034400:10556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:00.529975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535225412034400:10556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:00.529989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535225412034400:10556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:00.529993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535225412034400:10556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:00.530001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:00.531963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:00.533395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:00.533408Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:00.533410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:00.533413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:00.533418Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2558 [1:7556535225412034409:10547]
2025-10-02T08:16:00.533425Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:00.533437Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:00.533439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.533441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.533442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.533454Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:00.533458Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:00.533463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:00.533502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.533508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.533511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:00.533513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:00.533645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2558
2025-10-02T08:16:00.533718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:00.533726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.533699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2558
2025-10-02T08:16:00.533739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.533756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:00.533771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412034449:10556], now have 1 active actors on pipe
2025-10-02T08:16:00.533777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535225871388652:2378], now have 1 active actors on pipe
2025-10-02T08:16:00.533781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.533783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.533798Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535225412034396:10547]
2025-10-02T08:16:00.533803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535225412034396:10547]
2025-10-02T08:16:00.533811Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:00.533821Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:00.533828Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:00.533832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:00.533832Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:00.533834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:00.533846Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71e90603-58768f8b-2868be60-1142c452_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:00.533850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.533853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.533854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:00.533860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.533868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:00.533899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535225412034396:10547]
2025-10-02T08:16:00.533911Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:00.533921Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:00.533922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.533978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.533985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.533995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.534021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2559 partition: 0 MaxSeqNo: 17 sessionId: src_id|71e90603-58768f8b-2868be60-1142c452_0
2025-10-02T08:16:00.534321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103c4b08-eac28b20-150ac31a-af2946d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|71e90603-58768f8b-2868be60-1142c452_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:00.537040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e90603-58768f8b-2868be60-1142c452_0] Write session: try to update token
2025-10-02T08:16:00.537057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e90603-58768f8b-2868be60-1142c452_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:00.550046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId: src_id|71e90603-58768f8b-2868be60-1142c452_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:00.551702Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:00.551718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:00.551720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:00.551729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535225412034396:10547]
2025-10-02T08:16:00.551733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535225412034396:10547]
2025-10-02T08:16:00.551772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:00.551777Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:00.551780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.551782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:00.551784Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:00.551906Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:00.552659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:00.610625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535225412034463:8443]
2025-10-02T08:16:00.610770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2558, pipe: [1:7556535225412034463:8443]
2025-10-02T08:16:00.687093Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:00.687507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.687522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.687564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412034463:8443], now have 1 active actors on pipe
2025-10-02T08:16:00.687683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:00.687692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:00.687746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2559 reason: error at write: Disconnected sessionId: src_id|71e90603-58768f8b-2868be60-1142c452_0
2025-10-02T08:16:00.687772Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:00.687863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:00.687925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2559 sessionId: src_id|71e90603-58768f8b-2868be60-1142c452_0 is DEAD
2025-10-02T08:16:00.688108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e90603-58768f8b-2868be60-1142c452_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:00.688120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e90603-58768f8b-2868be60-1142c452_0] Write session will restart in 0.006650s
2025-10-02T08:16:00.688079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535225412034463:8443]
2025-10-02T08:16:00.688142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e90603-58768f8b-2868be60-1142c452_0] Write session: Do CDS request
2025-10-02T08:16:00.688149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e90603-58768f8b-2868be60-1142c452_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:00.696283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71e90603-58768f8b-2868be60-1142c452_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.696273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:00.696286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2560
2025-10-02T08:16:00.696488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.696538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:00.696550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:00.696554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:00.696896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2560 sessionId:  describe result for acl check
2025-10-02T08:16:00.696925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:00.696943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:00.696948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:00.696955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535225412034715:10568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:00.697452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535225412034715:10568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:00.697686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:00.698830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:00.699006Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:00.699015Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:00.699023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:00.699071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:00.699106Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535225412034750:10563]
2025-10-02T08:16:00.699466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535225412034715:10568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:00.699584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:00.699780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:00.699822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:00.700028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:00.700059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.700064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.700065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.700066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.700067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.700072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.700081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.700097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.700100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.700108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.700113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.700123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.700132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.700140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.700147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.700156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.700160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.700164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.700167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.700170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.700179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:00.704687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535225412034715:10568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:00.704701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535225412034715:10568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:00.704705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535225412034715:10568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:00.704712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:00.707792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:00.709327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:00.709339Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:00.709342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:00.709345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:00.709350Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2559 [1:7556535225412034750:10563]
2025-10-02T08:16:00.709362Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:00.709378Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:00.709381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.709384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.709386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.709402Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:00.709406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:00.709414Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:00.709482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.709490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.709493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:00.709496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:00.709557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:00.709565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.709577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.709589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:00.709605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412034778:10568], now have 1 active actors on pipe
2025-10-02T08:16:00.709610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535225871388659:2378], now have 1 active actors on pipe
2025-10-02T08:16:00.709612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2559
2025-10-02T08:16:00.709616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535225412034728:10563]
2025-10-02T08:16:00.709619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535225412034728:10563]
2025-10-02T08:16:00.709630Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:00.709638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.709641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.709642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:00.709656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:00.709658Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:00.709665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:00.709667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:00.709653Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2559
2025-10-02T08:16:00.709701Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a32e430-9d769932-c153641e-b7477221_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:00.709709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.709712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.709713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:00.709719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.709726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:00.709731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535225412034728:10563]
2025-10-02T08:16:00.709737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:00.709744Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:00.709758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.709864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.709870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.709882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.709919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2560 partition: 0 MaxSeqNo: 17 sessionId: src_id|3a32e430-9d769932-c153641e-b7477221_0
2025-10-02T08:16:00.710175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71e90603-58768f8b-2868be60-1142c452_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3a32e430-9d769932-c153641e-b7477221_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:00.712494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a32e430-9d769932-c153641e-b7477221_0] Write session: try to update token
2025-10-02T08:16:00.712505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a32e430-9d769932-c153641e-b7477221_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:00.725718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId: src_id|3a32e430-9d769932-c153641e-b7477221_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:00.726922Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:00.726939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:00.726941Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:00.726953Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535225412034728:10563]
2025-10-02T08:16:00.726957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535225412034728:10563]
2025-10-02T08:16:00.726999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:00.727011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.727013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:00.727122Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:00.727137Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:00.727149Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:00.728166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:00.788260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535225412034795:8443]
2025-10-02T08:16:00.788345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2559, pipe: [1:7556535225412034795:8443]
2025-10-02T08:16:00.863553Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:00.863840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.863854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.863889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412034795:8443], now have 1 active actors on pipe
2025-10-02T08:16:00.863961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:00.863970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:00.864017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2560 reason: error at write: Disconnected sessionId: src_id|3a32e430-9d769932-c153641e-b7477221_0
2025-10-02T08:16:00.864080Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:00.864086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:00.864174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2560 sessionId: src_id|3a32e430-9d769932-c153641e-b7477221_0 is DEAD
2025-10-02T08:16:00.864320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535225412034795:8443]
2025-10-02T08:16:00.864333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a32e430-9d769932-c153641e-b7477221_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:00.864343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a32e430-9d769932-c153641e-b7477221_0] Write session will restart in 0.009270s
2025-10-02T08:16:00.864369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a32e430-9d769932-c153641e-b7477221_0] Write session: Do CDS request
2025-10-02T08:16:00.864375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a32e430-9d769932-c153641e-b7477221_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:00.874698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:00.875301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a32e430-9d769932-c153641e-b7477221_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.875420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:00.875435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2561
2025-10-02T08:16:00.875573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:00.875604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:00.875609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:00.875612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:00.876037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2561 sessionId:  describe result for acl check
2025-10-02T08:16:00.876049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:00.876071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:00.876073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:00.876075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:00.876080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535225412035103:2308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:00.876215Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:00.876224Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:00.876231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:00.876265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:00.876303Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535225412035106:10658]
2025-10-02T08:16:00.876605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535225412035103:2308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:00.876892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:00.877313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:00.877352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:00.877679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:00.877719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.877725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.877726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.877726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.877727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.877731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.877736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.877738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.877740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.877742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.877746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.877750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:00.877753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.877756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:00.877758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.877762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:00.877764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.877767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.877769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.877772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.877781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:00.878630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535225412035103:2308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:00.884908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535225412035103:2308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:00.884918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535225412035103:2308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:00.884920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535225412035103:2308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:00.884927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:00.889054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:00.891212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:00.891225Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:00.891227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:00.891230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:00.891234Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2560 [1:7556535225412035106:10658]
2025-10-02T08:16:00.891245Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:00.891256Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:00.891258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.891259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.891261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.891272Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:00.891275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:00.891279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:00.891323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.891328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.891332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:00.891333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:00.891378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:00.891382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.891391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:00.891401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:00.891417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412035148:2308], now have 1 active actors on pipe
2025-10-02T08:16:00.891425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535225412035096:10658]
2025-10-02T08:16:00.891427Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535225412035096:10658]
2025-10-02T08:16:00.891432Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:00.891437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535225871388688:2378], now have 1 active actors on pipe
2025-10-02T08:16:00.891442Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:00.891444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:00.891446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:00.891448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2560
2025-10-02T08:16:00.891454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:00.891500Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2560
2025-10-02T08:16:00.891459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:00.891482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.891484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.891496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535225412035096:10658]
2025-10-02T08:16:00.891498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:00.891514Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:00.891518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:00.891520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:00.891521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:00.891525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:00.891528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:00.891533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:00.891547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.891588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:00.891593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:00.891601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:00.891631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2561 partition: 0 MaxSeqNo: 17 sessionId: src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0
2025-10-02T08:16:00.891947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a32e430-9d769932-c153641e-b7477221_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:00.894352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0] Write session: try to update token
2025-10-02T08:16:00.894364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:00.908499Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:00.908516Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:00.908519Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:00.908528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535225412035096:10658]
2025-10-02T08:16:00.908533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535225412035096:10658]
2025-10-02T08:16:00.908572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:00.908588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:00.908590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:00.908612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:00.908619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:00.908922Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:00.912063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId: src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:00.914398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:00.964420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535225412035175:8443]
2025-10-02T08:16:00.964560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2560, pipe: [1:7556535225412035175:8443]
2025-10-02T08:16:01.039958Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:01.040184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.040196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.040227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535225412035175:8443], now have 1 active actors on pipe
2025-10-02T08:16:01.040332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535225412035175:8443]
2025-10-02T08:16:01.040358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:01.040379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:01.040439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2561 reason: error at write: Disconnected sessionId: src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0
2025-10-02T08:16:01.040461Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:01.040577Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:01.040599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2561 sessionId: src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0 is DEAD
2025-10-02T08:16:01.040736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:01.040745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0] Write session will restart in 0.007589s
2025-10-02T08:16:01.040771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0] Write session: Do CDS request
2025-10-02T08:16:01.040776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:01.049197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.049419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:01.049431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2562
2025-10-02T08:16:01.049510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.049531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:01.049538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:01.049541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:01.049808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2562 sessionId:  describe result for acl check
2025-10-02T08:16:01.049830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:01.049831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:01.049832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:01.049836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535229707002728:2324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:01.050189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535229707002728:2324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:01.050544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:01.051737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:01.051852Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:01.051859Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:01.051866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:01.051903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:01.051948Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535229707002762:2328]
2025-10-02T08:16:01.052189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535229707002728:2324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:01.052410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:01.052580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:01.052620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:01.053017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:01.053078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.053083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.053084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.053086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.053087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.053092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.053103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.053106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.053110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.053114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.053119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.053126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.053131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.053136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.053140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.053144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.053148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.053153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.053157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.053162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.053178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:01.058262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535229707002728:2324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:01.058277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535229707002728:2324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:01.058280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535229707002728:2324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:01.058289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:01.061498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:01.063106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:01.063120Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:01.063122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:01.063125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:01.063129Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2561 [1:7556535229707002762:2328]
2025-10-02T08:16:01.063142Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:01.063155Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:01.063157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.063160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.063161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.063174Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:01.063177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:01.063183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:01.063234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.063240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.063242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:01.063244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:01.063289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:01.063295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.063304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.063311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:01.063326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535229707002743:2328]
2025-10-02T08:16:01.063331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535229707002743:2328]
2025-10-02T08:16:01.063338Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:01.063345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2561
2025-10-02T08:16:01.063350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707002789:2324], now have 1 active actors on pipe
2025-10-02T08:16:01.063349Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:01.063353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:01.063356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:01.063364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:01.063366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:01.063369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535230166356004:2378], now have 1 active actors on pipe
2025-10-02T08:16:01.063373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.063375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.063405Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535229707002743:2328]
2025-10-02T08:16:01.063417Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:01.063427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:01.063428Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:01.063434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.063436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.063437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:01.063442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.063449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:01.063433Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2561
2025-10-02T08:16:01.063479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.063547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.063554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.063565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.063594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2562 partition: 0 MaxSeqNo: 17 sessionId: src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0
2025-10-02T08:16:01.063918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c4a5864-873cea70-e418130c-fa2a8bd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:01.066344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0] Write session: try to update token
2025-10-02T08:16:01.066362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:01.079720Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:01.079740Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:01.079750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535229707002743:2328]
2025-10-02T08:16:01.079795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:01.079803Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:01.079962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:01.080176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.080330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.080439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId: src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:01.080476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.080678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:01.080728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:01.082992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:01.083080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.083098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.083128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:01.083152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:01.083204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.083216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.083373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.083443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.083507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.083568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.083793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.083804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.083873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.083970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.084055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.084129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.084169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.084176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.084282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.084346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.084453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.084526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.084600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.084607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.084674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.084737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.084794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.084872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.084912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.084917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.084976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.085027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.085085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.085156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.085197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.085202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.085262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.085316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.085377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.085432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.085473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.085479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.085538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.085590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.085656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.085727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.085774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.085782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.085855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.085920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.085985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.086052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.086118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.086127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.086190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.086269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.086329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.086393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.086453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.086460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.086544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.086601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.086656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.086738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.086789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.086794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.086828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:01.086878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.086892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.086897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:01.086921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:01.086933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:01.086935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:01.086938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:01.086940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:01.087301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:01.087325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:01.087331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:01.087335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:01.087338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:01.087341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:01.088317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:01.088344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:01.088352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:01.088359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:01.088361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:01.088364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:01.088904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:01.088922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:01.088926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:01.088928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:01.088930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:01.090054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:01.090071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:01.090080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392961089
2025-10-02T08:16:01.090203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:01.090213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:01.090217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:01.090219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:01.090221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:01.090223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:01.090634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:01.090651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:01.090655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:01.090661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:01.090663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:01.090665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:01.091057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:01.091074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:01.091084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:01.091086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:01.091089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:01.091091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:01.091481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:01.091495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:01.091498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:01.092464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:01.092478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:01.092482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:01.092486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:01.092492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392961092
2025-10-02T08:16:01.092766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:01.092782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:01.092786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:01.092788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:01.092790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:01.092793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:01.093245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:01.093264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:01.093267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:01.093270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:01.093272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:01.093274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:01.093696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:01.093710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.093783Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392961093
2025-10-02T08:16:01.094463Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:01.094487Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:01.094493Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:01.094498Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:01.096147Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:01.096158Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:01.096160Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:01.096169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535229707002743:2328]
2025-10-02T08:16:01.096172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535229707002743:2328]
2025-10-02T08:16:01.096212Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:01.096225Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:01.096227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:01.096231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.096233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:01.096368Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:01.140574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535229707002813:8443]
2025-10-02T08:16:01.140690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2561, pipe: [1:7556535229707002813:8443]
2025-10-02T08:16:01.233276Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:01.233702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707002813:8443], now have 1 active actors on pipe
2025-10-02T08:16:01.233836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535229707002813:8443]
2025-10-02T08:16:01.233860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:01.233866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:01.233893Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:01.233893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2562 reason: error at write: Disconnected sessionId: src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0
2025-10-02T08:16:01.233939Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:01.234057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2562 sessionId: src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0 is DEAD
2025-10-02T08:16:01.234181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:01.234188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0] Write session will restart in 0.008428s
2025-10-02T08:16:01.234211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0] Write session: Do CDS request
2025-10-02T08:16:01.234218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:01.243320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.243425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:01.243440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2563
2025-10-02T08:16:01.243533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.243565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:01.243575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:01.243579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:01.243883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2563 sessionId:  describe result for acl check
2025-10-02T08:16:01.243910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:01.243911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:01.243912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:01.243915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535229707003076:2386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:01.244319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535229707003076:2386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:01.244348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:01.245868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:01.246042Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:01.246052Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:01.246063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:01.246113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:01.246166Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535229707003106:2352]
2025-10-02T08:16:01.246673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535229707003076:2386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:01.246721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:01.246953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:01.247004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:01.247363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:01.247441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.247448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.247449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.247450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.247451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.247459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.247469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.247473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.247476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.247480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.247486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.247494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.247505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.247509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.247518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.247527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.247535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.247540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.247545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.247550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.247576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:01.252151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535229707003076:2386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:01.252164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535229707003076:2386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:01.252168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535229707003076:2386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:01.252176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:01.255183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:01.256952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:01.256967Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:01.256970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:01.256974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:01.256979Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2562 [1:7556535229707003106:2352]
2025-10-02T08:16:01.256993Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:01.257010Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:01.257017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.257020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.257022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.257037Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:01.257046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:01.257054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:01.257113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.257121Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.257123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:01.257126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:01.257195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:01.257203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.257215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.257231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:01.257224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2562
2025-10-02T08:16:01.257253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707003133:2386], now have 1 active actors on pipe
2025-10-02T08:16:01.257260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535230166356012:2378], now have 1 active actors on pipe
2025-10-02T08:16:01.257265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.257268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.257284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535229707003081:2352]
2025-10-02T08:16:01.257290Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535229707003081:2352]
2025-10-02T08:16:01.257300Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:01.257306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2562
2025-10-02T08:16:01.257315Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:01.257317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:01.257324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:01.257331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:01.257335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:01.257348Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:01.257354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.257358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.257360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:01.257369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.257377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:01.257416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535229707003081:2352]
2025-10-02T08:16:01.257428Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:01.257432Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:01.257449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.257509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.257516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.257559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.257600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2563 partition: 0 MaxSeqNo: 17 sessionId: src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0
2025-10-02T08:16:01.257917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2fa9779-5da62d2e-1a49fcca-978e5cba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:01.260521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0] Write session: try to update token
2025-10-02T08:16:01.260537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:01.267811Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:01.267825Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:01.267835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535229707003081:2352]
2025-10-02T08:16:01.267877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:01.267878Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:01.268049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:01.268198Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.268337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.268469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.268641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:01.268675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:01.274398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId: src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:01.276748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:01.276909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.276921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.276954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:01.276975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:01.277021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.277030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.277214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.277269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.277341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.277394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.277435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.277441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.277503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.277558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.277632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.277706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.277752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.277759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.277827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.277889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.277953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.278035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.278083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.278090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.278158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.278219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.278283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.278349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.278393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.278400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.278464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.278523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.278586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.278649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.278695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.278702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.278767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.278831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.278891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.278955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.279014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.279022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.279094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.279154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.279220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.279284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.279359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.279366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.279431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.279494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.279557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.279619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.279761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.279769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.279839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.279899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.279962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.280024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.280068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.280074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.280153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.280212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.280273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.280342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.280388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.280395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.280432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:01.280506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.280527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.280533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:01.280564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:01.280582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:01.280589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:01.280593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:01.280595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:01.281002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:01.281027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:01.281037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:01.281041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:01.281048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:01.281057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:01.281586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:01.281609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:01.281616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:01.281624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:01.281627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:01.281630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:01.282189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:01.282210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:01.282215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:01.282218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:01.282221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:01.284403Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:01.284424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:01.284436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392961284
2025-10-02T08:16:01.284545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:01.284559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:01.284563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:01.284567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:01.284571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:01.284577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:01.285110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:01.285131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:01.285140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:01.285143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:01.285147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:01.285152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:01.285704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:01.285730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:01.285741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:01.285744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:01.285749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:01.285756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:01.286232Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:01.286257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:01.286267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:01.287368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:01.287386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:01.287391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:01.287404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:01.287415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392961286
2025-10-02T08:16:01.287725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:01.287750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:01.287761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:01.287764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:01.287768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:01.287776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:01.288235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:01.288258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:01.288263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:01.288269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:01.288272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:01.288275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:01.288731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:01.288752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.288861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392961288
2025-10-02T08:16:01.289605Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:01.289627Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:01.289637Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:01.289648Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:01.291235Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:01.291246Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:01.291248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:01.291256Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535229707003081:2352]
2025-10-02T08:16:01.291259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535229707003081:2352]
2025-10-02T08:16:01.291320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:01.291319Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:01.291326Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:01.291328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.291330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:01.291470Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:01.334078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535229707003157:8443]
2025-10-02T08:16:01.334204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2562, pipe: [1:7556535229707003157:8443]
2025-10-02T08:16:01.419782Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:01.420209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707003157:8443], now have 1 active actors on pipe
2025-10-02T08:16:01.420336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535229707003157:8443]
2025-10-02T08:16:01.420359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:01.420365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:01.420394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2563 reason: error at write: Disconnected sessionId: src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0
2025-10-02T08:16:01.420460Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:01.420487Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:01.420615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2563 sessionId: src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0 is DEAD
2025-10-02T08:16:01.420755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:01.420767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0] Write session will restart in 0.006979s
2025-10-02T08:16:01.420792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0] Write session: Do CDS request
2025-10-02T08:16:01.420816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:01.429288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.429316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:01.429329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2564
2025-10-02T08:16:01.429501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.429542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:01.429552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:01.429557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:01.429965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2564 sessionId:  describe result for acl check
2025-10-02T08:16:01.429994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:01.430003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:01.430004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:01.430008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535229707003422:2406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:01.430556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535229707003422:2406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:01.432635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:01.433043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535229707003422:2406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:01.433149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:01.433310Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:01.433322Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:01.433331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:01.433376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:01.433413Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535229707003499:2413]
2025-10-02T08:16:01.434111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:01.434289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:01.434329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:01.434655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:01.434701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.434707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.434708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.434709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.434710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.434715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.434727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.434732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.434736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.434741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.434746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.434753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.434759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.434767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.434777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.434784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.434795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.434801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.434811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.434817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.434835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:01.439576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535229707003422:2406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:01.439592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535229707003422:2406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:01.439596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535229707003422:2406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:01.439603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:01.446933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:01.448730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:01.448745Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:01.448747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:01.448751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:01.448756Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2563 [1:7556535229707003499:2413]
2025-10-02T08:16:01.448767Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:01.448786Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:01.448789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.448792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.448793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.448824Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:01.448833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:01.448839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:01.448901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.448907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.448910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:01.448913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:01.449116Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2563
2025-10-02T08:16:01.448973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:01.448983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.448996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.449011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:01.449028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707003524:2406], now have 1 active actors on pipe
2025-10-02T08:16:01.449032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535230166356020:2378], now have 1 active actors on pipe
2025-10-02T08:16:01.449042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535229707003491:2413]
2025-10-02T08:16:01.449044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535229707003491:2413]
2025-10-02T08:16:01.449049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2563
2025-10-02T08:16:01.449052Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:01.449063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:01.449064Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:01.449068Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:01.449077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:01.449080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:01.449088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.449092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.449129Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535229707003491:2413]
2025-10-02T08:16:01.449133Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:01.449137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:01.449147Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:01.449153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.449156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.449158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:01.449165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.449173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:01.449213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.449298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.449305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.449331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.449373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2564 partition: 0 MaxSeqNo: 17 sessionId: src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0
2025-10-02T08:16:01.449698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adb0ab0-b20f4c13-41f7dfdb-cff3f925_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:01.452205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0] Write session: try to update token
2025-10-02T08:16:01.452222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:01.462461Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:01.462477Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:01.462486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535229707003491:2413]
2025-10-02T08:16:01.462528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:01.462547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:01.462688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:01.462826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.462966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.463103Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:01.463292Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:01.463328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:01.466216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId: src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:01.468614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:01.468674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.468688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.468720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:01.468742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:01.468787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.468810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.468984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.469042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.469103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.469174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.469282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.469291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.469354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.469410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.469472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.469541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.469583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.469590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.469661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.469722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.469794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.469855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.469897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.469904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.469963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.470026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.470089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.470150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.470196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.470203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.470271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.470375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.470437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.470495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.470688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.470695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.470759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.470818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.470901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.470959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.471004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.471009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.471068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.471128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.471197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.471260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.471307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.471310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.471368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.471422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.471479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.471538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.471584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.471590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.471649Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.471699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.471752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.471808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.471854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.471860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.471924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:01.471977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:01.472030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:01.472084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:01.472150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:01.472156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:01.472188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:01.472240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.472255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.472261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:01.472286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:01.472299Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:01.472304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:01.472306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:01.472308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:01.472641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:01.472663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:01.472668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:01.472675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:01.472677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:01.472679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:01.473254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:01.473278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:01.473285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:01.473289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:01.473294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:01.473297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:01.473795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:01.473815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:01.473820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:01.473823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:01.473826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:01.475840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:01.475857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:01.475868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392961475
2025-10-02T08:16:01.475975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:01.475987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:01.475991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:01.475994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:01.475998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:01.476001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:01.476496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:01.476516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:01.476520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:01.476524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:01.476527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:01.476531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:01.476998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:01.477018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:01.477023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:01.477030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:01.477034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:01.477041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:01.477511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:01.477528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:01.477532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:01.478483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:01.478498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:01.478504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:01.478506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:01.478512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392961478
2025-10-02T08:16:01.478780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:01.478796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:01.478800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:01.478802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:01.478804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:01.478806Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:01.479204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:01.479222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:01.479225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:01.479234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:01.479236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:01.479238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:01.479633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:01.479649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.479722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392961479
2025-10-02T08:16:01.480373Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:01.480387Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:01.480390Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:01.480394Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:01.481823Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:01.481833Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:01.481834Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:01.481841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535229707003491:2413]
2025-10-02T08:16:01.481844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535229707003491:2413]
2025-10-02T08:16:01.481888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:01.481888Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:01.481893Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:01.481894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.481896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:01.482018Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:01.520481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535229707003547:8443]
2025-10-02T08:16:01.520598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2563, pipe: [1:7556535229707003547:8443]
2025-10-02T08:16:01.614464Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:01.614779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707003547:8443], now have 1 active actors on pipe
2025-10-02T08:16:01.614875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535229707003547:8443]
2025-10-02T08:16:01.614903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:01.614921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:01.614953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2564 reason: error at write: Disconnected sessionId: src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0
2025-10-02T08:16:01.614947Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:01.614995Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:01.615139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2564 sessionId: src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0 is DEAD
2025-10-02T08:16:01.615309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:01.615320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0] Write session will restart in 0.007548s
2025-10-02T08:16:01.615344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0] Write session: Do CDS request
2025-10-02T08:16:01.615351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:01.624253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.624279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:01.624345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:01.624356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2565
2025-10-02T08:16:01.624449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.624480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:01.624489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:01.624492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:01.624844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2565 sessionId:  describe result for acl check
2025-10-02T08:16:01.624878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:01.624883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:01.624885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:01.624890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535229707003868:2483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:01.624953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:01.625139Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:01.625146Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:01.625154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:01.625188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:01.625213Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535229707003870:2437]
2025-10-02T08:16:01.625357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535229707003868:2483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:01.625597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:01.625727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:01.625752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:01.625945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:01.625975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.625979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.625981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.625981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.625982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.625985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.625991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.625993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.625995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.625997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.626000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.626004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.626008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.626011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.626014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.626017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.626019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.626022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.626024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.626026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.626036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:01.627270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535229707003868:2483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:01.632815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535229707003868:2483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:01.632831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535229707003868:2483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:01.632836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535229707003868:2483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:01.632844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:01.633698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:01.635313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:01.635330Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:01.635333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:01.635337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:01.635343Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2564 [1:7556535229707003870:2437]
2025-10-02T08:16:01.635354Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:01.635370Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:01.635373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.635376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.635379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.635393Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:01.635398Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:01.635405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:01.635459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.635466Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.635469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:01.635472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:01.635534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:01.635540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.635553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.635571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:01.635587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707003915:2483], now have 1 active actors on pipe
2025-10-02T08:16:01.635589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2564
2025-10-02T08:16:01.635595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535230166356027:2378], now have 1 active actors on pipe
2025-10-02T08:16:01.635603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535229707003861:2437]
2025-10-02T08:16:01.635607Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535229707003861:2437]
2025-10-02T08:16:01.635618Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:01.635632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.635634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:01.635636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.635637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:01.635651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:01.635677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:01.635679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:01.635684Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2564
2025-10-02T08:16:01.635718Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaa188-6653a9a7-51261105-2da65bcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:01.635730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.635734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.635736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:01.635744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.635751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:01.635762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535229707003861:2437]
2025-10-02T08:16:01.635772Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:01.635789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:01.635808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.635892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.635899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.635912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.635948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2565 partition: 0 MaxSeqNo: 17 sessionId: src_id|aaa188-6653a9a7-51261105-2da65bcb_0
2025-10-02T08:16:01.636268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7641d0-5db41d77-2fb5a889-312ecb8e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aaa188-6653a9a7-51261105-2da65bcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:01.638782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa188-6653a9a7-51261105-2da65bcb_0] Write session: try to update token
2025-10-02T08:16:01.638795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa188-6653a9a7-51261105-2da65bcb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:01.651540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId: src_id|aaa188-6653a9a7-51261105-2da65bcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:01.652896Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:01.652910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:01.652912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:01.652921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535229707003861:2437]
2025-10-02T08:16:01.652925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535229707003861:2437]
2025-10-02T08:16:01.652969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:01.652968Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:01.652973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:01.652982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.652984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:01.653110Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:01.653962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:01.715017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535229707003932:8443]
2025-10-02T08:16:01.715086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2564, pipe: [1:7556535229707003932:8443]
2025-10-02T08:16:01.795769Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:01.796074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.796099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.796141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707003932:8443], now have 1 active actors on pipe
2025-10-02T08:16:01.796241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535229707003932:8443]
2025-10-02T08:16:01.796261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:01.796263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:01.796311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2565 reason: error at write: Disconnected sessionId: src_id|aaa188-6653a9a7-51261105-2da65bcb_0
2025-10-02T08:16:01.796367Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:01.796341Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:01.796499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2565 sessionId: src_id|aaa188-6653a9a7-51261105-2da65bcb_0 is DEAD
2025-10-02T08:16:01.796678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa188-6653a9a7-51261105-2da65bcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:01.796689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa188-6653a9a7-51261105-2da65bcb_0] Write session will restart in 0.007122s
2025-10-02T08:16:01.796718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa188-6653a9a7-51261105-2da65bcb_0] Write session: Do CDS request
2025-10-02T08:16:01.796724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa188-6653a9a7-51261105-2da65bcb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:01.805269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa188-6653a9a7-51261105-2da65bcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.805368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:01.805387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2566
2025-10-02T08:16:01.805506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.805536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:01.805545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:01.805549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:01.805916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2566 sessionId:  describe result for acl check
2025-10-02T08:16:01.805945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:01.805951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:01.805953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:01.805959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535229707004238:2493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:01.806439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535229707004238:2493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:01.806857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:01.807583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:01.807748Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:01.807756Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:01.807772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:01.807811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:01.807838Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535229707004270:2487]
2025-10-02T08:16:01.808306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:01.808452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:01.808487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:01.808693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535229707004238:2493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:01.808761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:01.808818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.808823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.808824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.808825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.808826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.808831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.808840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.808844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.808848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.808852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.808857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.808864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.808874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.808879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.808888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.808893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.808902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.808907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.808911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.808917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.808940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:01.814719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535229707004238:2493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:01.814734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535229707004238:2493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:01.814738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535229707004238:2493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:01.814746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:01.816735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:01.818287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:01.818300Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:01.818302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:01.818304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:01.818311Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2565 [1:7556535229707004270:2487]
2025-10-02T08:16:01.818318Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:01.818330Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:01.818332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.818334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.818335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.818348Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:01.818352Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:01.818356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:01.818402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.818408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.818410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:01.818412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:01.818525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2565
2025-10-02T08:16:01.818548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:01.818552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.818564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.818579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:01.818600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707004300:2493], now have 1 active actors on pipe
2025-10-02T08:16:01.818607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535230166356033:2378], now have 1 active actors on pipe
2025-10-02T08:16:01.818611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.818615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.818594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2565
2025-10-02T08:16:01.818629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535229707004253:2487]
2025-10-02T08:16:01.818635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535229707004253:2487]
2025-10-02T08:16:01.818642Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:01.818652Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:01.818656Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:01.818656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:01.818669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:01.818671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:01.818685Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:01.818696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:01.818699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:01.818701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:01.818708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:01.818720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:01.818753Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535229707004253:2487]
2025-10-02T08:16:01.818762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:01.818771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.818780Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:01.818856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.818861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.818871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:01.818897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2566 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0
2025-10-02T08:16:01.819247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa188-6653a9a7-51261105-2da65bcb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:01.822066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0] Write session: try to update token
2025-10-02T08:16:01.822086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:01.836395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId: src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:01.836463Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:01.836478Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:01.836480Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:01.836489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535229707004253:2487]
2025-10-02T08:16:01.836495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535229707004253:2487]
2025-10-02T08:16:01.836544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:01.836546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:01.836555Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:01.836557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.836559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:01.836743Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:01.838994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:01.907795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535229707004329:8443]
2025-10-02T08:16:01.910151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2565, pipe: [1:7556535229707004329:8443]
2025-10-02T08:16:01.978782Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:01.979098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:01.979111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:01.979148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707004329:8443], now have 1 active actors on pipe
2025-10-02T08:16:01.979263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535229707004329:8443]
2025-10-02T08:16:01.979286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:01.979292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:01.979361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2566 reason: error at write: Disconnected sessionId: src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0
2025-10-02T08:16:01.979363Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:01.979380Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:01.979503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2566 sessionId: src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0 is DEAD
2025-10-02T08:16:01.979629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:01.979638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0] Write session will restart in 0.008960s
2025-10-02T08:16:01.979655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0] Write session: Do CDS request
2025-10-02T08:16:01.979660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:01.989257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.989292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:01.989305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2567
2025-10-02T08:16:01.989452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:01.989483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:01.989492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:01.989495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:01.989874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2567 sessionId:  describe result for acl check
2025-10-02T08:16:01.989909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:01.989914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:01.989916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:01.989920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535229707004672:2548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:01.990420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535229707004672:2548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:01.991030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:01.991875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:01.992059Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:01.992068Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:01.992100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:01.992160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:01.992194Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535229707004706:2556]
2025-10-02T08:16:01.992212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535229707004672:2548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:01.992783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:01.992984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:01.993032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:01.993327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:01.993390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.993396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.993397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.993398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.993399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.993404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.993413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.993417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.993420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.993423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.993427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.993433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:01.993438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.993442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:01.993446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.993450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:01.993453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.993457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:01.993461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.993464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:01.993481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:01.998266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535229707004672:2548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:01.998281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535229707004672:2548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:01.998284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535229707004672:2548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:01.998292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:02.002860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:02.004537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:02.004556Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:02.004559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:02.004562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:02.004568Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2566 [1:7556535229707004706:2556]
2025-10-02T08:16:02.004580Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:02.004597Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:02.004600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.004603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.004605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.004621Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:02.004626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:02.004639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:02.004704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.004714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.004718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:02.004720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:02.004783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:02.004790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.004820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.004834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:02.004850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535229707004689:2556]
2025-10-02T08:16:02.004860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535229707004689:2556]
2025-10-02T08:16:02.004868Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:02.004869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2566
2025-10-02T08:16:02.004883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535229707004733:2548], now have 1 active actors on pipe
2025-10-02T08:16:02.004882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:02.004886Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:02.004891Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:02.004906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:02.004909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:02.004915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535230166356076:2378], now have 1 active actors on pipe
2025-10-02T08:16:02.004925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.004929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.004969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535229707004689:2556]
2025-10-02T08:16:02.004979Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:02.004999Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6f4314b-276b130c-ed83be01-72605b84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:02.005007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.005012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.005014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:02.005020Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:02.005023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.005031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:02.005071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.005090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2566
2025-10-02T08:16:02.005163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.005173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.005187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.005220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2567 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6f4314b-276b130c-ed83be01-72605b84_0
2025-10-02T08:16:02.005555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d05146-20ca04aa-f93e4cb7-41d9cba1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6f4314b-276b130c-ed83be01-72605b84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:02.007959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f4314b-276b130c-ed83be01-72605b84_0] Write session: try to update token
2025-10-02T08:16:02.007973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f4314b-276b130c-ed83be01-72605b84_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:02.020553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId: src_id|c6f4314b-276b130c-ed83be01-72605b84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:02.023325Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:02.023343Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.023345Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:02.023354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535229707004689:2556]
2025-10-02T08:16:02.023358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535229707004689:2556]
2025-10-02T08:16:02.023402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:02.023410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.023419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:02.023567Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:02.023915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:02.023977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:02.023993Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:02.079570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535234001972042:8443]
2025-10-02T08:16:02.079706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2566, pipe: [1:7556535234001972042:8443]
2025-10-02T08:16:02.175382Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:02.175881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.175908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.175954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001972042:8443], now have 1 active actors on pipe
2025-10-02T08:16:02.176078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535234001972042:8443]
2025-10-02T08:16:02.176112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:02.176114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:02.176168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2567 reason: error at write: Disconnected sessionId: src_id|c6f4314b-276b130c-ed83be01-72605b84_0
2025-10-02T08:16:02.176173Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:02.176200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:02.176349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2567 sessionId: src_id|c6f4314b-276b130c-ed83be01-72605b84_0 is DEAD
2025-10-02T08:16:02.176500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f4314b-276b130c-ed83be01-72605b84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:02.176510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f4314b-276b130c-ed83be01-72605b84_0] Write session will restart in 0.008940s
2025-10-02T08:16:02.176534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f4314b-276b130c-ed83be01-72605b84_0] Write session: Do CDS request
2025-10-02T08:16:02.176541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f4314b-276b130c-ed83be01-72605b84_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:02.186252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f4314b-276b130c-ed83be01-72605b84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.186341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:02.186353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2568
2025-10-02T08:16:02.186453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.186483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:02.186492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:02.186496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:02.186855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2568 sessionId:  describe result for acl check
2025-10-02T08:16:02.186888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:02.186894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:02.186895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:02.186900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535234001972356:2577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:02.187374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535234001972356:2577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:02.187807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:02.188208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:02.188455Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:02.188464Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:02.188474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:02.188524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:02.188560Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535234001972385:2576]
2025-10-02T08:16:02.188984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:02.189182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:02.189240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:02.189418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535234001972356:2577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:02.189560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:02.189603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.189609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.189610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.189611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.189613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.189618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.189627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.189631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.189635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.189639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.189644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.189651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.189661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.189668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.189676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.189682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.189687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.189692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.189696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.189702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.189724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:02.195978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535234001972356:2577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:02.195992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535234001972356:2577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:02.195996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535234001972356:2577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:02.196004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:02.198263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:02.199792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:02.199810Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:02.199813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:02.199816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:02.199822Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2567 [1:7556535234001972385:2576]
2025-10-02T08:16:02.199834Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:02.199848Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:02.199851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.199854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.199856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.199870Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:02.199875Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:02.199880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:02.199944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.199953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.199956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:02.199958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:02.200017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:02.200024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.200036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.200049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:02.200064Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535234001972368:2576]
2025-10-02T08:16:02.200070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535234001972368:2576]
2025-10-02T08:16:02.200077Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:02.200101Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:02.200104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:02.200105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2567
2025-10-02T08:16:02.200111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:02.200117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:02.200119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:02.200129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001972416:2577], now have 1 active actors on pipe
2025-10-02T08:16:02.200133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535234461323379:2378], now have 1 active actors on pipe
2025-10-02T08:16:02.200161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.200172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.200184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535234001972368:2576]
2025-10-02T08:16:02.200192Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:02.200209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:02.200215Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61e14178-e000ad04-45c7b550-196bf9c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:02.200221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.200225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.200227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:02.200236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.200200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2567
2025-10-02T08:16:02.200246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:02.200352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.200398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.200406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.200420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.200452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2568 partition: 0 MaxSeqNo: 17 sessionId: src_id|61e14178-e000ad04-45c7b550-196bf9c1_0
2025-10-02T08:16:02.200782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6f4314b-276b130c-ed83be01-72605b84_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|61e14178-e000ad04-45c7b550-196bf9c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:02.203519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61e14178-e000ad04-45c7b550-196bf9c1_0] Write session: try to update token
2025-10-02T08:16:02.203537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61e14178-e000ad04-45c7b550-196bf9c1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:02.217082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId: src_id|61e14178-e000ad04-45c7b550-196bf9c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:02.219669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:02.219747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.219759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.219792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:02.219820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:02.219879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.219895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.220077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.220151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.220216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.220279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.220328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.220337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.220407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.220464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.220530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.220596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.220643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.220651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.220716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.220776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.220852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.220913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.220956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.220963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.221028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.221091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.221152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.221219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.221274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.221281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.221350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.221413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.221479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.221545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.221588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.221598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.221663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.221720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.221783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.221849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.221893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.221902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.221964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.222021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.222093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.222158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.222221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.222229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.222293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.222354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.222417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.222476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.222517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.222524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.222589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.222648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.222706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.222767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.222824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.222831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.222897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.222957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.223019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.223080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.223126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.223133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.223198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:02.223264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.223287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.223294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:02.223325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:02.223342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:02.223349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:02.223352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:02.223357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:02.223755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:02.223781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:02.223793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:02.223796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:02.223801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:02.223808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:02.224302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:02.224321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:02.224327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:02.224330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:02.224334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:02.224341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:02.224995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:02.225015Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:02.225021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:02.225028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:02.225031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:02.232375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:02.232402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:02.232419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392962232
2025-10-02T08:16:02.232531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:02.232547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:02.232554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:02.232562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:02.232570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:02.232574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:02.233017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:02.233040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:02.233050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:02.233054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:02.233057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:02.233061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:02.233536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:02.233556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:02.233568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:02.233575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:02.233580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:02.233584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:02.234012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:02.234034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:02.234043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:02.235033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:02.235051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:02.235055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:02.235059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:02.235076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392962234
2025-10-02T08:16:02.235357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:02.235374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:02.235380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:02.235383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:02.235387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:02.235391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:02.235848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:02.235870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:02.235880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:02.235886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:02.235890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:02.235894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:02.236350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:02.236369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.236465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392962236
2025-10-02T08:16:02.238637Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:02.238673Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:02.238684Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:02.238700Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:02.238717Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:02.238720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.238724Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:02.238730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535234001972368:2576]
2025-10-02T08:16:02.238736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535234001972368:2576]
2025-10-02T08:16:02.238787Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:02.238798Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:02.244937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:02.244955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.244958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:02.245108Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:02.276152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535234001972430:8443]
2025-10-02T08:16:02.276231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2567, pipe: [1:7556535234001972430:8443]
2025-10-02T08:16:02.373004Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:02.373269Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:02.373277Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.373284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535234001972368:2576]
2025-10-02T08:16:02.373322Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:02.373338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001972430:8443], now have 1 active actors on pipe
2025-10-02T08:16:02.373536Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:02.373567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:02.373592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2568 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61e14178-e000ad04-45c7b550-196bf9c1_0
2025-10-02T08:16:02.373741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2568 sessionId: src_id|61e14178-e000ad04-45c7b550-196bf9c1_0 is DEAD
2025-10-02T08:16:02.373905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e14178-e000ad04-45c7b550-196bf9c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:02.373869Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:02.373904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535234001972430:8443]
2025-10-02T08:16:02.373916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e14178-e000ad04-45c7b550-196bf9c1_0] Write session will restart in 0.005380s
2025-10-02T08:16:02.373985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e14178-e000ad04-45c7b550-196bf9c1_0] Write session: Do CDS request
2025-10-02T08:16:02.373994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e14178-e000ad04-45c7b550-196bf9c1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:02.377461Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [01a234555c56adcf] Result# TEvPutResult {Id# [72075186224037892:2567:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:16:02.377511Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2567:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:16:02.377543Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2567:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:16:02.380309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61e14178-e000ad04-45c7b550-196bf9c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.380412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:02.380424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2569
2025-10-02T08:16:02.380538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.380583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:02.380591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:02.380594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:02.381058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2569 sessionId:  describe result for acl check
2025-10-02T08:16:02.381091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:02.381097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:02.381098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:02.381103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535234001972594:2607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:02.381595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535234001972594:2607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:02.384134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535234001972594:2607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:02.386885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:02.386938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535234001972594:2607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:02.386950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535234001972594:2607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:02.386953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535234001972594:2607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:02.386960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:02.387587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:02.387828Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:02.387839Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:02.387850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:02.387909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:02.387949Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535234001972801:2609]
2025-10-02T08:16:02.388551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:02.388752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:02.388825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:02.389148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:02.389192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.389200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.389201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.389202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.389203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.389208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.389217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.389223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.389227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.389230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.389235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.389241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.389247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.389252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.389256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.389261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.389268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.389276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.389280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.389284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.389306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:02.397077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:02.398489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:02.398506Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:02.398509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:02.398513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:02.398519Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2568 [1:7556535234001972801:2609]
2025-10-02T08:16:02.398533Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:02.398549Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:02.398552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.398555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.398558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.398574Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:02.398586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:02.398597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:02.398660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.398666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.398669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:02.398672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:02.398787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2568
2025-10-02T08:16:02.398864Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2568
2025-10-02T08:16:02.398901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:02.398911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.398924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.398938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:02.398961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001972796:2607], now have 1 active actors on pipe
2025-10-02T08:16:02.398969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535234461323388:2378], now have 1 active actors on pipe
2025-10-02T08:16:02.398973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.398977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.398997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535234001972789:2609]
2025-10-02T08:16:02.399004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535234001972789:2609]
2025-10-02T08:16:02.399015Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:02.399033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:02.399034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:02.399039Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:02.399047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:02.399051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:02.399074Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:02.399084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.399087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.399089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:02.399098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.399110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:02.399145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535234001972789:2609]
2025-10-02T08:16:02.399155Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:02.399166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:02.399167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.399210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.399217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.399230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.399269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2569 partition: 0 MaxSeqNo: 17 sessionId: src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0
2025-10-02T08:16:02.399577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e14178-e000ad04-45c7b550-196bf9c1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:02.402265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0] Write session: try to update token
2025-10-02T08:16:02.402285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:02.409585Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:02.409599Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.409606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535234001972789:2609]
2025-10-02T08:16:02.409641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:02.409643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:02.409807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:02.409944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:02.410070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:02.410208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:02.410388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:02.410421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:02.416278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId: src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:02.418683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:02.418746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.418758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.418794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:02.418819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:02.418977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.419000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.419153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.419207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.419276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.419337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.419378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.419385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.419447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.419510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.419572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.419634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.419674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.419680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.419740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.419798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.419851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.419906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.419945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.419948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.420004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.420073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.420148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.420210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.420246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.420249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.420308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.420368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.420424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.420482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.420528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.420533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.420604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.420658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.420714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.420770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.420839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.420842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.420906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.420967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.421035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.421103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.421150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.421157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.421226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.421294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.421357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.421417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.421460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.421467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.421534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.421595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.421665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.421734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.421779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.421789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.421862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.421924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.421989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.422059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.422106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.422112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.422154Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:02.422228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.422250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.422257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:02.422289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:02.422307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:02.422315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:02.422318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:02.422321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:02.422721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:02.422755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:02.422761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:02.422765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:02.422768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:02.422771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:02.423251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:02.423277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:02.423283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:02.423286Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:02.423290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:02.423293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:02.423872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:02.423905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:02.423911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:02.423917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:02.423920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:02.425261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:02.425282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:02.425294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392962425
2025-10-02T08:16:02.425464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:02.425484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:02.425491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:02.425494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:02.425500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:02.425509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:02.426010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:02.426037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:02.426043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:02.426049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:02.426052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:02.426055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:02.426537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:02.426564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:02.426576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:02.426584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:02.426589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:02.426593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:02.427074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:02.427101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:02.427110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:02.428247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:02.428272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:02.428277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:02.428283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:02.428293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392962428
2025-10-02T08:16:02.428603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:02.428626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:02.428636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:02.428640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:02.428643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:02.428652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:02.429139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:02.429164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:02.429172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:02.429175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:02.429178Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:02.429181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:02.429648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:02.429670Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.429781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392962429
2025-10-02T08:16:02.430557Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:02.430587Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:02.430600Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:02.430612Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:02.432321Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:02.432337Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.432339Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:02.432348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535234001972789:2609]
2025-10-02T08:16:02.432352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535234001972789:2609]
2025-10-02T08:16:02.432407Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:02.432413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:02.432417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.432419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:02.432422Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:02.432554Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:02.474309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535234001972834:8443]
2025-10-02T08:16:02.474413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2568, pipe: [1:7556535234001972834:8443]
2025-10-02T08:16:02.567788Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:02.568106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001972834:8443], now have 1 active actors on pipe
2025-10-02T08:16:02.568218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:02.568228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:02.568253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2569 reason: error at write: Disconnected sessionId: src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0
2025-10-02T08:16:02.568316Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:02.568362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:02.568402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2569 sessionId: src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0 is DEAD
2025-10-02T08:16:02.568538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:02.568548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0] Write session will restart in 0.007335s
2025-10-02T08:16:02.568571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0] Write session: Do CDS request
2025-10-02T08:16:02.568577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:02.568572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535234001972834:8443]
2025-10-02T08:16:02.577214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.577290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:02.577304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2570
2025-10-02T08:16:02.577452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.577477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:02.577484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:02.577487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:02.577776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2570 sessionId:  describe result for acl check
2025-10-02T08:16:02.577802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:02.577804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:02.577806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:02.577811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535234001973148:2723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:02.578262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535234001973148:2723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:02.579032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:02.579658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:02.579904Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:02.579910Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:02.579917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:02.579954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:02.579978Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535234001973184:2729]
2025-10-02T08:16:02.580254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535234001973148:2723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:02.580377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:02.580538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:02.580574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:02.580907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:02.580947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.580950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.580951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.580952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.580953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.580956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.580962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.580964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.580966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.580970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.580973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.580977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.580981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.580984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.580986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.580989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.580991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.580993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.580996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.580998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.581012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:02.586083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535234001973148:2723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:02.586100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535234001973148:2723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:02.586103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535234001973148:2723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:02.586111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:02.588598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:02.590101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:02.590115Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:02.590117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:02.590119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:02.590124Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2569 [1:7556535234001973184:2729]
2025-10-02T08:16:02.590132Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:02.590144Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:02.590147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.590149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.590150Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.590162Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:02.590165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:02.590169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:02.590215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.590220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.590222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:02.590224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:02.590272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:02.590277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.590285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.590293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:02.590305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535234001973169:2729]
2025-10-02T08:16:02.590309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535234001973169:2729]
2025-10-02T08:16:02.590315Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:02.590316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2569
2025-10-02T08:16:02.590329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001973211:2723], now have 1 active actors on pipe
2025-10-02T08:16:02.590330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:02.590333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:02.590338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:02.590346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:02.590350Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:02.590354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535234461323395:2378], now have 1 active actors on pipe
2025-10-02T08:16:02.590357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.590360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.590393Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535234001973169:2729]
2025-10-02T08:16:02.590402Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:02.590413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:02.590413Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:02.590416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.590422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.590424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:02.590430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.590435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:02.590457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.590535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.590542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.590553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.590584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2570 partition: 0 MaxSeqNo: 17 sessionId: src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0
2025-10-02T08:16:02.590859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb5e290-3573b53c-c2926fd6-8f50bccf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:02.593375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0] Write session: try to update token
2025-10-02T08:16:02.593391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:02.590416Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2569
2025-10-02T08:16:02.605585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId: src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:02.607098Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:02.607110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.607112Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:02.607118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535234001973169:2729]
2025-10-02T08:16:02.607121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535234001973169:2729]
2025-10-02T08:16:02.607153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:02.607153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:02.607158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:02.607159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.607160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:02.607277Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:02.607706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:02.668880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535234001973225:8443]
2025-10-02T08:16:02.668967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2569, pipe: [1:7556535234001973225:8443]
2025-10-02T08:16:02.736977Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:02.737207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.737220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.737255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001973225:8443], now have 1 active actors on pipe
2025-10-02T08:16:02.737364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535234001973225:8443]
2025-10-02T08:16:02.737378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:02.737379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:02.737423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2570 reason: error at write: Disconnected sessionId: src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0
2025-10-02T08:16:02.737479Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:02.737464Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:02.737574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2570 sessionId: src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0 is DEAD
2025-10-02T08:16:02.737729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:02.737737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0] Write session will restart in 0.007558s
2025-10-02T08:16:02.737760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0] Write session: Do CDS request
2025-10-02T08:16:02.737766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:02.746272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.746343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:02.746359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2571
2025-10-02T08:16:02.746469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.746495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:02.746505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:02.746508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:02.746865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2571 sessionId:  describe result for acl check
2025-10-02T08:16:02.746897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:02.746903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:02.746905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:02.746909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535234001973541:2770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:02.747365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535234001973541:2770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:02.748663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:02.749153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:02.749297Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:02.749306Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:02.749315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:02.749356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:02.749392Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535234001973577:2754]
2025-10-02T08:16:02.749557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535234001973541:2770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:02.749961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:02.750124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:02.750164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:02.750452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:02.750493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.750498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.750499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.750500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.750501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.750506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.750515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.750519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.750527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.750531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.750536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.750546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.750557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.750568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.750575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.750581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.750590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.750596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.750600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.750605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.750628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:02.755331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535234001973541:2770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:02.755359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535234001973541:2770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:02.755362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535234001973541:2770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:02.755370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:02.758470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:02.759883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:02.759895Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:02.759897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:02.759900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:02.759905Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2570 [1:7556535234001973577:2754]
2025-10-02T08:16:02.759912Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:02.759925Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:02.759929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.759931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.759933Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.759944Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:02.759950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:02.759956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:02.760008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.760015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.760016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:02.760018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:02.760060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:02.760065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.760073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.760079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:02.760108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535234001973569:2754]
2025-10-02T08:16:02.760109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535234001973569:2754]
2025-10-02T08:16:02.760114Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:02.760124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:02.760138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:02.760141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:02.760142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:02.760144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:02.760148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2570
2025-10-02T08:16:02.760153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001973605:2770], now have 1 active actors on pipe
2025-10-02T08:16:02.760182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535234461323401:2378], now have 1 active actors on pipe
2025-10-02T08:16:02.760188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535234001973569:2754]
2025-10-02T08:16:02.760197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:02.760206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.760215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.760211Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2570
2025-10-02T08:16:02.760225Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:02.760249Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|804813ac-877ebae8-df70beb6-e8a2555d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:02.760256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.760259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.760260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:02.760266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.760276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:02.760311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.760344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.760349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.760360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.760389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2571 partition: 0 MaxSeqNo: 17 sessionId: src_id|804813ac-877ebae8-df70beb6-e8a2555d_0
2025-10-02T08:16:02.760717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8486baa-ca1d71c6-4b4b433e-115f25bf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|804813ac-877ebae8-df70beb6-e8a2555d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:02.763252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|804813ac-877ebae8-df70beb6-e8a2555d_0] Write session: try to update token
2025-10-02T08:16:02.763271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|804813ac-877ebae8-df70beb6-e8a2555d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:02.776628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId: src_id|804813ac-877ebae8-df70beb6-e8a2555d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:02.777447Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:02.777459Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.777461Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:02.777466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535234001973569:2754]
2025-10-02T08:16:02.777469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535234001973569:2754]
2025-10-02T08:16:02.777501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:02.777507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:02.777510Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.777511Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:02.777512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:02.777634Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:02.778985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:02.837341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535234001973619:8443]
2025-10-02T08:16:02.837463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2570, pipe: [1:7556535234001973619:8443]
2025-10-02T08:16:02.906757Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:02.907025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.907039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.907070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001973619:8443], now have 1 active actors on pipe
2025-10-02T08:16:02.907162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:02.907168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:02.907217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2571 reason: error at write: Disconnected sessionId: src_id|804813ac-877ebae8-df70beb6-e8a2555d_0
2025-10-02T08:16:02.907285Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:02.907308Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:02.907566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804813ac-877ebae8-df70beb6-e8a2555d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:02.907578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804813ac-877ebae8-df70beb6-e8a2555d_0] Write session will restart in 0.008487s
2025-10-02T08:16:02.907603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804813ac-877ebae8-df70beb6-e8a2555d_0] Write session: Do CDS request
2025-10-02T08:16:02.907610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804813ac-877ebae8-df70beb6-e8a2555d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:02.907384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2571 sessionId: src_id|804813ac-877ebae8-df70beb6-e8a2555d_0 is DEAD
2025-10-02T08:16:02.907534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535234001973619:8443]
2025-10-02T08:16:02.917244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|804813ac-877ebae8-df70beb6-e8a2555d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.917309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:02.917322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2572
2025-10-02T08:16:02.917432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:02.917469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:02.917477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:02.917481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:02.917782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2572 sessionId:  describe result for acl check
2025-10-02T08:16:02.917810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:02.917816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:02.917817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:02.917823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535234001973962:2810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:02.917938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:02.918454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:02.918570Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:02.918577Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:02.918583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:02.918611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:02.918639Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535234001973970:2786]
2025-10-02T08:16:02.919003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:02.919032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535234001973962:2810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:02.919192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:02.919230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:02.919419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:02.919446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.919450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.919451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.919452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.919452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.919455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.919461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.919463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.919465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.919467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.919470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.919473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:02.919477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.919479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:02.919481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.919484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:02.919486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.919488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.919490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.919492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.919503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:02.921108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535234001973962:2810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:02.927131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:02.928671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:02.928688Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:02.928691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:02.928694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:02.928700Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2571 [1:7556535234001973970:2786]
2025-10-02T08:16:02.928712Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:02.928723Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:02.928725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.928727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.928731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.928742Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:02.928749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:02.928754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:02.928819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.928826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.928829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:02.928831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:02.928892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:02.928899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.928912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:02.928927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:02.928947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535234461323410:2378], now have 1 active actors on pipe
2025-10-02T08:16:02.928954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535234001973963:2786]
2025-10-02T08:16:02.928955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535234001973963:2786]
2025-10-02T08:16:02.928964Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:02.928977Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:02.928979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:02.928985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:02.928992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:02.928994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:02.929024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535234001973963:2786]
2025-10-02T08:16:02.929030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:02.929032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:02.928997Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2571
2025-10-02T08:16:02.929302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535234001973962:2810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:02.929313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535234001973962:2810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:02.929316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535234001973962:2810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:02.929324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:02.929648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2571
2025-10-02T08:16:02.929658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535234001974019:2810], now have 1 active actors on pipe
2025-10-02T08:16:02.929662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.929666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.929687Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:02.929697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.929700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.929702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:02.929710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.929721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:02.929735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.929761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.929768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.929778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:02.929804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2572 partition: 0 MaxSeqNo: 17 sessionId: src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0
2025-10-02T08:16:02.930114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|804813ac-877ebae8-df70beb6-e8a2555d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:02.932621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0] Write session: try to update token
2025-10-02T08:16:02.932633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:02.939617Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:02.939633Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.939640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535234001973963:2786]
2025-10-02T08:16:02.939685Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:02.939700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:02.939858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:02.940000Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:02.940154Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:02.940293Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:02.940506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:02.940539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:02.945997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId: src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:02.948563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:02.948650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.948661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.948693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:02.948711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:02.948758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:02.948765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:02.948937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.949007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.949072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.949134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.949183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.949191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.949256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.949320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.949388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.949457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.949496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.949504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.949570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.949633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.949695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.949759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.949801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.949807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.949874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.949937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.950005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.950069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.950113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.950119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.950186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.950253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.950321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.950381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.950442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.950446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.950517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.950586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.950655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.950724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.950774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.950783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.950848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.950914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.950982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.951049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.951103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.951112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.951177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.951239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.951307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.951372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.951415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.951422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.951488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.951552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.951617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.951679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.951724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.951731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.951797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:02.951859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:02.951926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:02.951992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:02.952039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:02.952048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:02.952091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:02.952149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:02.952172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:02.952178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:02.952204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:02.952219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:02.952226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:02.952229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:02.952231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:02.952628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:02.952654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:02.952660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:02.952669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:02.952672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:02.952675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:02.953217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:02.953238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:02.953243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:02.953250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:02.953253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:02.953256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:02.953760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:02.953782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:02.953786Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:02.953791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:02.953794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:02.954990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:02.955005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:02.955013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392962954
2025-10-02T08:16:02.955122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:02.955134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:02.955139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:02.955141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:02.955143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:02.955147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:02.955545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:02.955562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:02.955565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:02.955567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:02.955569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:02.955572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:02.955959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:02.955977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:02.955982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:02.955984Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:02.955988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:02.955990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:02.956523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:02.956549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:02.956560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:02.957782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:02.957800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:02.957805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:02.957809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:02.957818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392962957
2025-10-02T08:16:02.958120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:02.958145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:02.958155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:02.958162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:02.958165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:02.958172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:02.958655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:02.958679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:02.958688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:02.958695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:02.958698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:02.958705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:02.959235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:02.959263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:02.959365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392962959
2025-10-02T08:16:02.960043Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:02.960056Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:02.960060Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:02.960064Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:02.961542Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:02.961554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:02.961554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:02.961563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535234001973963:2786]
2025-10-02T08:16:02.961564Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535234001973963:2786]
2025-10-02T08:16:02.961605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:02.961608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:02.961610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:02.961611Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:02.961616Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:02.961731Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:03.007806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535238296941367:8443]
2025-10-02T08:16:03.007938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2571, pipe: [1:7556535238296941367:8443]
2025-10-02T08:16:03.091550Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:03.091868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296941367:8443], now have 1 active actors on pipe
2025-10-02T08:16:03.091973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535238296941367:8443]
2025-10-02T08:16:03.091999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:03.092006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:03.092031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2572 reason: error at write: Disconnected sessionId: src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0
2025-10-02T08:16:03.092039Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:03.092100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:03.092234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2572 sessionId: src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0 is DEAD
2025-10-02T08:16:03.092883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:03.092893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0] Write session will restart in 0.007069s
2025-10-02T08:16:03.092915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0] Write session: Do CDS request
2025-10-02T08:16:03.092921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:03.101234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.101284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:03.101297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2573
2025-10-02T08:16:03.101412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.101439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:03.101450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:03.101454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:03.101835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2573 sessionId:  describe result for acl check
2025-10-02T08:16:03.101863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:03.101868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:03.101869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:03.101874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535238296941688:2869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:03.102302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535238296941688:2869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:03.103459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:03.104009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:03.104169Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:03.104179Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:03.104188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:03.104237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:03.104271Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535238296941724:2856]
2025-10-02T08:16:03.104376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535238296941688:2869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:03.104671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:03.104822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:03.104851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:03.105034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:03.105065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.105066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.105067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.105068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.105069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.105073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.105084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.105087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.105090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.105093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.105097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.105103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.105108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.105112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.105129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.105136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.105139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.105141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.105144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.105146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.105156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:03.109844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535238296941688:2869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:03.109860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535238296941688:2869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:03.109863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535238296941688:2869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:03.109871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:03.112991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:03.114545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:03.114560Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:03.114562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:03.114564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:03.114569Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2572 [1:7556535238296941724:2856]
2025-10-02T08:16:03.114577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:03.114590Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:03.114593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.114595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.114597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.114613Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:03.114619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:03.114625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:03.114674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.114680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.114682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:03.114684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:03.114729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:03.114734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.114743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.114751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:03.114771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535238296941713:2856]
2025-10-02T08:16:03.114777Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535238296941713:2856]
2025-10-02T08:16:03.114784Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:03.114797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:03.114797Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:03.114800Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:03.114810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2572
2025-10-02T08:16:03.114817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:03.114820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:03.114829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296941751:2869], now have 1 active actors on pipe
2025-10-02T08:16:03.114864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535238756290746:2378], now have 1 active actors on pipe
2025-10-02T08:16:03.114870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.114873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.114883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535238296941713:2856]
2025-10-02T08:16:03.114891Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:03.114899Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:03.114911Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec554111-43f42686-82f01d93-18940054_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:03.114923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.114930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.114932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:03.114940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.114952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:03.114977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.115024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.115032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.115041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.115071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2573 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec554111-43f42686-82f01d93-18940054_0
2025-10-02T08:16:03.115048Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2572
2025-10-02T08:16:03.115412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e53b5c9a-c6832239-62fbd7fc-922a2e26_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec554111-43f42686-82f01d93-18940054_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:03.118015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec554111-43f42686-82f01d93-18940054_0] Write session: try to update token
2025-10-02T08:16:03.118033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec554111-43f42686-82f01d93-18940054_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:03.132073Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:03.132105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:03.132108Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:03.132116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535238296941713:2856]
2025-10-02T08:16:03.132123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535238296941713:2856]
2025-10-02T08:16:03.132161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:03.132169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:03.132172Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:03.132177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.132180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:03.132317Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:03.132699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId: src_id|ec554111-43f42686-82f01d93-18940054_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:03.135403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:03.192167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535238296941766:8443]
2025-10-02T08:16:03.192284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2572, pipe: [1:7556535238296941766:8443]
2025-10-02T08:16:03.269776Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:03.270106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.270119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.270155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296941766:8443], now have 1 active actors on pipe
2025-10-02T08:16:03.270211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535238296941766:8443]
2025-10-02T08:16:03.270227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:03.270231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:03.270287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2573 reason: error at write: Disconnected sessionId: src_id|ec554111-43f42686-82f01d93-18940054_0
2025-10-02T08:16:03.270345Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:03.270350Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:03.270422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2573 sessionId: src_id|ec554111-43f42686-82f01d93-18940054_0 is DEAD
2025-10-02T08:16:03.270580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec554111-43f42686-82f01d93-18940054_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:03.270587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec554111-43f42686-82f01d93-18940054_0] Write session will restart in 0.009359s
2025-10-02T08:16:03.270607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec554111-43f42686-82f01d93-18940054_0] Write session: Do CDS request
2025-10-02T08:16:03.270611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec554111-43f42686-82f01d93-18940054_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:03.280634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:03.281180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec554111-43f42686-82f01d93-18940054_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.281232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:03.281244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2574
2025-10-02T08:16:03.281365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:03.281407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.281443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:03.281451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:03.281454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:03.281526Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:03.281535Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:03.281544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:03.281594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:03.281631Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535238296942102:2895]
2025-10-02T08:16:03.281790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2574 sessionId:  describe result for acl check
2025-10-02T08:16:03.281829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:03.281835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:03.281837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:03.281841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535238296942106:2896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:03.282198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:03.282304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535238296942106:2896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:03.282368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:03.282410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:03.282698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:03.282747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.282753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.282754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.282755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.282757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.282762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.282771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.282774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.282778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.282782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.282787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.282793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.282805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.282810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.282814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.282819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.282823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.282827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.282831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.282836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.282853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:03.284515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535238296942106:2896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:03.290592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535238296942106:2896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:03.290607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535238296942106:2896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:03.290609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535238296942106:2896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:03.290616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:03.291042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:03.292581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:03.292595Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:03.292597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:03.292600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:03.292606Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2573 [1:7556535238296942102:2895]
2025-10-02T08:16:03.292616Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:03.292631Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:03.292634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.292637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.292639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.292653Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:03.292657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:03.292663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:03.292707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.292713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.292716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:03.292718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:03.292763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:03.292768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.292777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.292786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:03.292821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296942150:2896], now have 1 active actors on pipe
2025-10-02T08:16:03.292833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535238296942095:2895]
2025-10-02T08:16:03.292835Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535238296942095:2895]
2025-10-02T08:16:03.292843Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:03.292849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535238756290756:2378], now have 1 active actors on pipe
2025-10-02T08:16:03.292854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2573
2025-10-02T08:16:03.292855Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:03.292865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:03.292864Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:03.292866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:03.292867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:03.292892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.292895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.292906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535238296942095:2895]
2025-10-02T08:16:03.292909Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:03.292927Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:03.292933Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:03.292942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.292909Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2573
2025-10-02T08:16:03.292945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.292947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:03.292956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.292965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:03.292993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.293034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.293039Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.293049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.293080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2574 partition: 0 MaxSeqNo: 17 sessionId: src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0
2025-10-02T08:16:03.293390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec554111-43f42686-82f01d93-18940054_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:03.295810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0] Write session: try to update token
2025-10-02T08:16:03.295828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:03.308340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId: src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:03.309726Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:03.309746Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:03.309749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:03.309758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535238296942095:2895]
2025-10-02T08:16:03.309763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535238296942095:2895]
2025-10-02T08:16:03.309799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:03.309806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:03.309808Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:03.309813Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.309815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:03.309952Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:03.310709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:03.370329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535238296942164:8443]
2025-10-02T08:16:03.370461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2573, pipe: [1:7556535238296942164:8443]
2025-10-02T08:16:03.450963Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:03.451283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.451296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.451333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296942164:8443], now have 1 active actors on pipe
2025-10-02T08:16:03.451423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:03.451432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:03.451499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2574 reason: error at write: Disconnected sessionId: src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0
2025-10-02T08:16:03.451514Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:03.451551Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:03.451679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2574 sessionId: src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0 is DEAD
2025-10-02T08:16:03.451811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:03.451819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0] Write session will restart in 0.007479s
2025-10-02T08:16:03.451826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535238296942164:8443]
2025-10-02T08:16:03.451854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0] Write session: Do CDS request
2025-10-02T08:16:03.451861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:03.460389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.460941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:03.460956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2575
2025-10-02T08:16:03.461093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.461134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:03.461139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:03.461143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:03.461528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2575 sessionId:  describe result for acl check
2025-10-02T08:16:03.461558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:03.461565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:03.461566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:03.461571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535238296942488:2903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:03.462109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535238296942488:2903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:03.462915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:03.463653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:03.463795Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:03.463802Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:03.463809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:03.463842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:03.463869Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535238296942524:2929]
2025-10-02T08:16:03.464061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535238296942488:2903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:03.464345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:03.464527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:03.464578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:03.464920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:03.464970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.464980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.464982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.464983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.464986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.464991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.465001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.465005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.465008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.465012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.465017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.465025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.465030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.465035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.465039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.465044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.465047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.465053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.465063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.465068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.465086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:03.470491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535238296942488:2903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:03.470509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535238296942488:2903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:03.470513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535238296942488:2903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:03.470522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:03.473423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:03.474813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:03.474829Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:03.474833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:03.474836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:03.474842Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2574 [1:7556535238296942524:2929]
2025-10-02T08:16:03.474854Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:03.474872Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:03.474875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.474878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.474880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.474894Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:03.474899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:03.474905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:03.474967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.474975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.474978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:03.474980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:03.475041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:03.475049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.475061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.475079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:03.475099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535238296942512:2929]
2025-10-02T08:16:03.475105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535238296942512:2929]
2025-10-02T08:16:03.475113Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:03.475127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:03.475135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:03.475138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:03.475147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:03.475153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2574
2025-10-02T08:16:03.475156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:03.475168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296942551:2903], now have 1 active actors on pipe
2025-10-02T08:16:03.475202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535238756290762:2378], now have 1 active actors on pipe
2025-10-02T08:16:03.475212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.475216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.475230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535238296942512:2929]
2025-10-02T08:16:03.475239Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:03.475262Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:03.475264Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:03.475271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.475276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.475243Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2574
2025-10-02T08:16:03.475278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:03.475294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.475305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:03.475330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.475377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.475387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.475401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.475449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2575 partition: 0 MaxSeqNo: 17 sessionId: src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0
2025-10-02T08:16:03.475851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63fd552-8f0d18b6-cf3d9f37-79094214_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:03.478570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0] Write session: try to update token
2025-10-02T08:16:03.478586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:03.492044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId: src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:03.493265Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:03.493279Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:03.493281Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:03.493288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535238296942512:2929]
2025-10-02T08:16:03.493292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535238296942512:2929]
2025-10-02T08:16:03.493327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:03.493331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.493330Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:03.493333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:03.493334Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:03.493451Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:03.494690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:03.552102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535238296942566:8443]
2025-10-02T08:16:03.552216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2574, pipe: [1:7556535238296942566:8443]
2025-10-02T08:16:03.626429Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:03.626663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.626675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.626707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296942566:8443], now have 1 active actors on pipe
2025-10-02T08:16:03.626876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535238296942566:8443]
2025-10-02T08:16:03.626895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:03.626900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:03.626902Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:03.626964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2575 reason: error at write: Disconnected sessionId: src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0
2025-10-02T08:16:03.626966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:03.627136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2575 sessionId: src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0 is DEAD
2025-10-02T08:16:03.627304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:03.627315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0] Write session will restart in 0.006323s
2025-10-02T08:16:03.627337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0] Write session: Do CDS request
2025-10-02T08:16:03.627344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:03.635300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.635362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:03.635377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2576
2025-10-02T08:16:03.635522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.635551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:03.635560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:03.635563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:03.635938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2576 sessionId:  describe result for acl check
2025-10-02T08:16:03.635974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:03.635976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:03.635977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:03.635982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535238296942853:2956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:03.636495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535238296942853:2956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:03.638452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535238296942853:2956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:03.638869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:03.639580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:03.639735Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:03.639745Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:03.639754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:03.639795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:03.639831Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535238296942938:2958]
2025-10-02T08:16:03.640477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:03.640631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:03.640669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:03.640979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:03.640992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535238296942853:2956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:03.640997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535238296942853:2956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:03.640999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535238296942853:2956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:03.641005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:03.641024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.641029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.641030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.641032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.641033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.641038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.641048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.641056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.641060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.641064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.641069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.641076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.641082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.641087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.641092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.641101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.641109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.641117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.641125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.641129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.641146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:03.648882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:03.650340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:03.650357Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:03.650359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:03.650363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:03.650369Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2575 [1:7556535238296942938:2958]
2025-10-02T08:16:03.650382Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:03.650397Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:03.650400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.650403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.650405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.650420Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:03.650426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:03.650437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:03.650493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.650500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.650503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:03.650507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:03.650566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:03.650573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.650586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.650598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:03.650622Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535238296942923:2958]
2025-10-02T08:16:03.650629Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535238296942923:2958]
2025-10-02T08:16:03.650632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2575
2025-10-02T08:16:03.650637Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:03.650647Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:03.650650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296942950:2956], now have 1 active actors on pipe
2025-10-02T08:16:03.650655Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:03.650658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:03.650671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:03.650673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:03.650679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535238756290768:2378], now have 1 active actors on pipe
2025-10-02T08:16:03.650688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.650692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.650731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535238296942923:2958]
2025-10-02T08:16:03.650739Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:03.650749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:03.650753Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:03.650759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.650762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.650764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:03.650734Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2575
2025-10-02T08:16:03.650773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.650784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:03.650827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.650900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.650906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.650918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.650954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2576 partition: 0 MaxSeqNo: 17 sessionId: src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0
2025-10-02T08:16:03.651271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0c1cfa-5c47e350-bdac372e-ed582042_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:03.653793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0] Write session: try to update token
2025-10-02T08:16:03.653808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:03.666926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId: src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:03.667407Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:03.667423Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:03.667426Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:03.667435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535238296942923:2958]
2025-10-02T08:16:03.667439Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535238296942923:2958]
2025-10-02T08:16:03.667477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:03.667489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.667495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:03.667635Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:03.667934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:03.667945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:03.669692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:03.727177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535238296942975:8443]
2025-10-02T08:16:03.727303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2575, pipe: [1:7556535238296942975:8443]
2025-10-02T08:16:03.802345Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:03.802629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.802640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.802674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296942975:8443], now have 1 active actors on pipe
2025-10-02T08:16:03.802780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535238296942975:8443]
2025-10-02T08:16:03.802802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:03.802809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:03.802860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2576 reason: error at write: Disconnected sessionId: src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0
2025-10-02T08:16:03.802855Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:03.803020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2576 sessionId: src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0 is DEAD
2025-10-02T08:16:03.803179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:03.803187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0] Write session will restart in 0.005253s
2025-10-02T08:16:03.803210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0] Write session: Do CDS request
2025-10-02T08:16:03.803220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:03.803215Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:03.809238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.809313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:03.809329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2577
2025-10-02T08:16:03.809426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.809454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:03.809462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:03.809466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:03.809826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2577 sessionId:  describe result for acl check
2025-10-02T08:16:03.809861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:03.809867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:03.809868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:03.809873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535238296943206:2988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:03.810329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535238296943206:2988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:03.812763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535238296943206:2988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:03.814608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:03.815006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:03.815172Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:03.815181Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:03.815190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:03.815232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:03.815286Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535238296943349:2971]
2025-10-02T08:16:03.815365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535238296943206:2988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:03.815375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535238296943206:2988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:03.815379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535238296943206:2988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:03.815479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:03.815911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:03.816123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:03.816179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:03.816495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:03.816543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.816548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.816549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.816551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.816552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.816556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.816566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.816575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.816578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.816582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.816587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.816594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.816599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.816604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.816609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.816618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.816623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.816628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.816632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.816641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.816659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:03.824531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:03.826014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:03.826029Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:03.826032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:03.826035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:03.826040Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2576 [1:7556535238296943349:2971]
2025-10-02T08:16:03.826048Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:03.826059Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:03.826062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.826063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.826065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.826077Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:03.826081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:03.826086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:03.826131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.826138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.826140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:03.826142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:03.826197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:03.826206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.826214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.826221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:03.826233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535238296943342:2971]
2025-10-02T08:16:03.826239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535238296943342:2971]
2025-10-02T08:16:03.826246Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:03.826258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:03.826263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:03.826265Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:03.826271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:03.826273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:03.826281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296943354:2988], now have 1 active actors on pipe
2025-10-02T08:16:03.826283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535238756290775:2378], now have 1 active actors on pipe
2025-10-02T08:16:03.826305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535238296943342:2971]
2025-10-02T08:16:03.826311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:03.826315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2576
2025-10-02T08:16:03.826327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.826335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.826340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:03.826355Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90963272-72b990dd-989c5295-925509b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:03.826362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.826365Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.826367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:03.826374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.826323Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2576
2025-10-02T08:16:03.826381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:03.826389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.826426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.826434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.826445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.826483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2577 partition: 0 MaxSeqNo: 17 sessionId: src_id|90963272-72b990dd-989c5295-925509b4_0
2025-10-02T08:16:03.826769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5defcf6d-5f19f891-11943559-6d7ff2fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|90963272-72b990dd-989c5295-925509b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:03.829210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90963272-72b990dd-989c5295-925509b4_0] Write session: try to update token
2025-10-02T08:16:03.829222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90963272-72b990dd-989c5295-925509b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:03.842370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId: src_id|90963272-72b990dd-989c5295-925509b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:03.843836Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:03.843852Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:03.843854Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:03.843862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535238296943342:2971]
2025-10-02T08:16:03.843865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535238296943342:2971]
2025-10-02T08:16:03.843899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:03.843910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.843912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:03.844010Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:03.844025Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:03.844039Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:03.845109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:03.902787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535238296943382:8443]
2025-10-02T08:16:03.902892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2576, pipe: [1:7556535238296943382:8443]
2025-10-02T08:16:03.976624Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:03.977189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.977204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.977240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296943382:8443], now have 1 active actors on pipe
2025-10-02T08:16:03.977418Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:03.977444Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:03.977651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:03.977700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2577 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90963272-72b990dd-989c5295-925509b4_0
2025-10-02T08:16:03.977852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2577 sessionId: src_id|90963272-72b990dd-989c5295-925509b4_0 is DEAD
2025-10-02T08:16:03.977994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535238296943382:8443]
2025-10-02T08:16:03.978023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90963272-72b990dd-989c5295-925509b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:03.978038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90963272-72b990dd-989c5295-925509b4_0] Write session will restart in 0.009983s
2025-10-02T08:16:03.978063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90963272-72b990dd-989c5295-925509b4_0] Write session: Do CDS request
2025-10-02T08:16:03.978069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90963272-72b990dd-989c5295-925509b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:03.988119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:03.988973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:03.989133Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:03.989142Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:03.989151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:03.989198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:03.989216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90963272-72b990dd-989c5295-925509b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.989229Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535238296943767:3081]
2025-10-02T08:16:03.989754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:03.989769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2578
2025-10-02T08:16:03.989850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:03.989908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:03.989937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:03.989945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:03.989949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:03.990085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:03.990126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:03.990419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:03.990460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.990466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.990467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.990467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.990468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.990473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.990480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.990484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.990487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.990491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.990495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.990505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:03.990516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.990524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:03.990532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.990539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:03.990543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.990547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.990551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.990555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.990573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:03.990872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2578 sessionId:  describe result for acl check
2025-10-02T08:16:03.990899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:03.990904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:03.990905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:03.990909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535238296943786:3130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:03.991320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535238296943786:3130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:03.992976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535238296943786:3130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:03.997753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535238296943786:3130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:03.997764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535238296943786:3130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:03.997767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535238296943786:3130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:03.997774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:03.998219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:03.999570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:03.999585Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:03.999587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:03.999590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:03.999596Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2577 [1:7556535238296943767:3081]
2025-10-02T08:16:03.999605Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:03.999619Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:03.999622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.999624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.999626Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.999640Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:03.999650Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:03.999660Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:03.999715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.999725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.999728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:03.999735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:03.999779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:03.999784Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:03.999791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:03.999798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:03.999810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535238296943821:3130], now have 1 active actors on pipe
2025-10-02T08:16:03.999815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2577
2025-10-02T08:16:03.999816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535238296943752:3081]
2025-10-02T08:16:03.999817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535238296943752:3081]
2025-10-02T08:16:03.999821Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:03.999826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535238756290809:2378], now have 1 active actors on pipe
2025-10-02T08:16:03.999831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:03.999831Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:03.999835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:03.999838Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:03.999839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:03.999844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:03.999846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:03.999871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535238296943752:3081]
2025-10-02T08:16:03.999880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:03.999889Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:03.999890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:03.999896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:03.999901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:03.999902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:03.999909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:03.999915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:03.999938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:03.999904Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2577
2025-10-02T08:16:03.999995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.000006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.000026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.000057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2578 partition: 0 MaxSeqNo: 17 sessionId: src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0
2025-10-02T08:16:04.000355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90963272-72b990dd-989c5295-925509b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:04.002691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0] Write session: try to update token
2025-10-02T08:16:04.002702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:04.010397Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:04.010414Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:04.010422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535238296943752:3081]
2025-10-02T08:16:04.010458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:04.010468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:04.010727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:04.010942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:04.011159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:04.011375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:04.011711Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:04.011747Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:04.016203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId: src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:04.018736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:04.018802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.018814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.018852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:04.018876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:04.018919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.018935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.019092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.019155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.019224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.019284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.019327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.019335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.019404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.019463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.019525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.019585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.019631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.019638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.019703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.019762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.019817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.019877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.019924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.019931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.020006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.020070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.020146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.020209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.020255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.020263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.020334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.020393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.020456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.020521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.020564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.020571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.020636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.020697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.020760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.020841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.020882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.020889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.020951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.021008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.021072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.021133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.021174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.021181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.021244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.021302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.021358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.021413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.021455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.021463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.021536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.021591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.021653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.021715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.021758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.021764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.021828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:04.021881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:04.021951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:04.022010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:04.022055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:04.022062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:04.022098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:04.022160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.022182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.022190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:04.022218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:04.022234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:04.022241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:04.022244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:04.022247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:04.022622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:04.022643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:04.022647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:04.022650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:04.022652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:04.022655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:04.023454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:04.023477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:04.023482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:04.023484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:04.023486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:04.023488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:04.023918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:04.023939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:04.023950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:04.023954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:04.023962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:04.025136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:04.025152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:04.025163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392964025
2025-10-02T08:16:04.025388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:04.025402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:04.025405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:04.025407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:04.025409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:04.025411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:04.025818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:04.025837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:04.025844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:04.025847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:04.025849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:04.025851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:04.026313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:04.026332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:04.026339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:04.026345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:04.026347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:04.026349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:04.026816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:04.026838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:04.026843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:04.027918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:04.027930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:04.027934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:04.027936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:04.027942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392964027
2025-10-02T08:16:04.028240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:04.028261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:04.028267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:04.028270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:04.028274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:04.028277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:04.028700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:04.028721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:04.028729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:04.028738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:04.028741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:04.028747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:04.029181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:04.029198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.029288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392964029
2025-10-02T08:16:04.029977Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:04.030004Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:04.030012Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:04.030018Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:04.031535Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:04.031546Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:04.031547Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:04.031554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535238296943752:3081]
2025-10-02T08:16:04.031556Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535238296943752:3081]
2025-10-02T08:16:04.031598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:04.031606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.031608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:04.031612Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:04.031620Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:04.031726Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:04.077912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535242591911138:8443]
2025-10-02T08:16:04.078008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2577, pipe: [1:7556535242591911138:8443]
2025-10-02T08:16:04.159563Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:04.159894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591911138:8443], now have 1 active actors on pipe
2025-10-02T08:16:04.159983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:04.159989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:04.160010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2578 reason: error at write: Disconnected sessionId: src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0
2025-10-02T08:16:04.160112Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:04.160100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:04.160188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2578 sessionId: src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0 is DEAD
2025-10-02T08:16:04.160331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:04.160341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0] Write session will restart in 0.006534s
2025-10-02T08:16:04.160348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535242591911138:8443]
2025-10-02T08:16:04.160369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0] Write session: Do CDS request
2025-10-02T08:16:04.160375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:04.168266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.168293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:04.168307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2579
2025-10-02T08:16:04.168441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.168470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:04.168479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:04.168482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:04.168953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2579 sessionId:  describe result for acl check
2025-10-02T08:16:04.168989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:04.168994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:04.168996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:04.169001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535242591911472:3164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:04.169369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535242591911472:3164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:04.170001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:04.170631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:04.170837Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:04.170846Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:04.170853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:04.170900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:04.170926Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535242591911508:3137]
2025-10-02T08:16:04.171182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535242591911472:3164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:04.171310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:04.171442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:04.171465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:04.171642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:04.171667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.171671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.171671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.171672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.171673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.171676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.171682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.171684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.171686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.171688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.171691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.171695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.171698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.171701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.171703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.171706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.171709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.171711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.171713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.171717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.171726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:04.177265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535242591911472:3164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:04.177278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535242591911472:3164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:04.177282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535242591911472:3164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:04.177291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:04.179209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:04.180884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:04.180895Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:04.180897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:04.180900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:04.180904Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2578 [1:7556535242591911508:3137]
2025-10-02T08:16:04.180912Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:04.180924Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:04.180925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.180928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.180929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.180940Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:04.180945Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:04.180950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:04.180991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.180997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.180999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:04.181002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:04.181045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:04.181050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.181059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.181069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:04.181085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535242591911489:3137]
2025-10-02T08:16:04.181089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535242591911489:3137]
2025-10-02T08:16:04.181094Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:04.181104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591911535:3164], now have 1 active actors on pipe
2025-10-02T08:16:04.181105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2578
2025-10-02T08:16:04.181113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:04.181113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:04.181116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:04.181121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:04.181123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:04.181126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535243051258120:2378], now have 1 active actors on pipe
2025-10-02T08:16:04.181148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.181154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.181164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535242591911489:3137]
2025-10-02T08:16:04.181169Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:04.181186Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d2a2576-c361ec54-409c89fd-8f761282_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:04.181193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.181194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:04.181195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.181171Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2578
2025-10-02T08:16:04.181196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:04.181202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.181208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:04.181224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.181265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.181270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.181278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.181305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2579 partition: 0 MaxSeqNo: 17 sessionId: src_id|5d2a2576-c361ec54-409c89fd-8f761282_0
2025-10-02T08:16:04.181621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3a4c30-b491023e-d1661f66-d5f8bd41_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5d2a2576-c361ec54-409c89fd-8f761282_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:04.184074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2a2576-c361ec54-409c89fd-8f761282_0] Write session: try to update token
2025-10-02T08:16:04.184101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2a2576-c361ec54-409c89fd-8f761282_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:04.196605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId: src_id|5d2a2576-c361ec54-409c89fd-8f761282_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:04.198270Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:04.198284Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:04.198286Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:04.198292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535242591911489:3137]
2025-10-02T08:16:04.198296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535242591911489:3137]
2025-10-02T08:16:04.198332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:04.198338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.198340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:04.198340Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:04.198345Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:04.198471Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:04.199184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:04.260690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535242591911548:8443]
2025-10-02T08:16:04.260798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2578, pipe: [1:7556535242591911548:8443]
2025-10-02T08:16:04.344749Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:04.345079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.345091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.345128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591911548:8443], now have 1 active actors on pipe
2025-10-02T08:16:04.345234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:04.345241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:04.345292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2579 reason: error at write: Disconnected sessionId: src_id|5d2a2576-c361ec54-409c89fd-8f761282_0
2025-10-02T08:16:04.345346Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:04.345352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:04.345478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2579 sessionId: src_id|5d2a2576-c361ec54-409c89fd-8f761282_0 is DEAD
2025-10-02T08:16:04.345598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2a2576-c361ec54-409c89fd-8f761282_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:04.345608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2a2576-c361ec54-409c89fd-8f761282_0] Write session will restart in 0.008745s
2025-10-02T08:16:04.345625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2a2576-c361ec54-409c89fd-8f761282_0] Write session: Do CDS request
2025-10-02T08:16:04.345631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2a2576-c361ec54-409c89fd-8f761282_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:04.345639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535242591911548:8443]
2025-10-02T08:16:04.355204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2a2576-c361ec54-409c89fd-8f761282_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.355302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:04.355317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2580
2025-10-02T08:16:04.355414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.355442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:04.355452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:04.355455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:04.355799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2580 sessionId:  describe result for acl check
2025-10-02T08:16:04.355830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:04.355836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:04.355838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:04.355843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535242591911889:3202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:04.356316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535242591911889:3202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:04.356318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:04.357391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:04.357552Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:04.357562Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:04.357571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:04.357619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:04.357664Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535242591911915:3183]
2025-10-02T08:16:04.358234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:04.358395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:04.358401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535242591911889:3202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:04.358431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:04.358715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:04.358754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.358759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.358761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.358762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.358763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.358769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.358778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.358782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.358785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.358789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.358794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.358801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.358810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.358815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.358824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.358829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.358838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.358843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.358853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.358858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.358877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:04.363562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535242591911889:3202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:04.363579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535242591911889:3202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:04.363583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535242591911889:3202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:04.363591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:04.366452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:04.367960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:04.367976Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:04.367978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:04.367980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:04.367985Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2579 [1:7556535242591911915:3183]
2025-10-02T08:16:04.367993Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:04.368005Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:04.368007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.368008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.368010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.368024Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:04.368034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:04.368040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:04.368116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.368123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.368126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:04.368129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:04.368187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:04.368194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.368205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.368219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:04.368241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591911945:3202], now have 1 active actors on pipe
2025-10-02T08:16:04.368252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535242591911894:3183]
2025-10-02T08:16:04.368254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535242591911894:3183]
2025-10-02T08:16:04.368255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2579
2025-10-02T08:16:04.368261Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:04.368272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535243051258128:2378], now have 1 active actors on pipe
2025-10-02T08:16:04.368271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:04.368274Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:04.368283Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:04.368296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:04.368303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:04.368310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.368319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.368322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2579
2025-10-02T08:16:04.368358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535242591911894:3183]
2025-10-02T08:16:04.368366Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:04.368372Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:04.368380Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:04.368387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.368397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.368399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:04.368409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.368417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:04.368457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.368510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.368519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.368532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.368566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2580 partition: 0 MaxSeqNo: 17 sessionId: src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0
2025-10-02T08:16:04.368883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2a2576-c361ec54-409c89fd-8f761282_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:04.371205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0] Write session: try to update token
2025-10-02T08:16:04.371218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:04.383125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId: src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:04.385357Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:04.385371Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:04.385373Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:04.385380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535242591911894:3183]
2025-10-02T08:16:04.385383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535242591911894:3183]
2025-10-02T08:16:04.385415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:04.385421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.385423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:04.385428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:04.385429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:04.385572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:04.385584Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:04.446020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535242591911958:8443]
2025-10-02T08:16:04.446129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2579, pipe: [1:7556535242591911958:8443]
2025-10-02T08:16:04.516377Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:04.516691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.516702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.516742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591911958:8443], now have 1 active actors on pipe
2025-10-02T08:16:04.516867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:04.516876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:04.516928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2580 reason: error at write: Disconnected sessionId: src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0
2025-10-02T08:16:04.516965Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:04.516963Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:04.517089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2580 sessionId: src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0 is DEAD
2025-10-02T08:16:04.517225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535242591911958:8443]
2025-10-02T08:16:04.517245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:04.517254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0] Write session will restart in 0.008591s
2025-10-02T08:16:04.517279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0] Write session: Do CDS request
2025-10-02T08:16:04.517284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:04.527344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.527402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:04.527420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2581
2025-10-02T08:16:04.527567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.527605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:04.527615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:04.527619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:04.527968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2581 sessionId:  describe result for acl check
2025-10-02T08:16:04.528001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:04.528007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:04.528008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:04.528014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535242591912295:3228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:04.528492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535242591912295:3228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:04.529261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:04.529764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:04.529923Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:04.529930Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:04.529938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:04.529973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:04.529998Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535242591912332:3219]
2025-10-02T08:16:04.530374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535242591912295:3228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:04.530424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:04.530603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:04.530650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:04.530961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:04.531001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.531007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.531008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.531010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.531011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.531016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.531026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.531033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.531038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.531045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.531050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.531057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.531066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.531071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.531077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.531086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.531091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.531095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.531100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.531105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.531126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:04.537120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535242591912295:3228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:04.537139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535242591912295:3228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:04.537142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535242591912295:3228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:04.537151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:04.539160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:04.540661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:04.540666Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:04.540668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:04.540670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:04.540675Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2580 [1:7556535242591912332:3219]
2025-10-02T08:16:04.540682Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:04.540697Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:04.540699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.540702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.540703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.540715Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:04.540717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:04.540722Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:04.540764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.540765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.540769Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:04.540770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:04.540854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:04.540856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.540864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.540871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:04.540884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591912359:3228], now have 1 active actors on pipe
2025-10-02T08:16:04.540888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535242591912317:3219]
2025-10-02T08:16:04.540889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535242591912317:3219]
2025-10-02T08:16:04.540894Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:04.540900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535243051258134:2378], now have 1 active actors on pipe
2025-10-02T08:16:04.540900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2580
2025-10-02T08:16:04.540905Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:04.540906Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:04.540909Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:04.540913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:04.540915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:04.540920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.540922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.540955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535242591912317:3219]
2025-10-02T08:16:04.540961Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:04.540975Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:04.540980Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:04.540981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.540985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.540987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:04.540964Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2580
2025-10-02T08:16:04.540996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.541013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:04.541055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.541118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.541123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.541133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.541158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2581 partition: 0 MaxSeqNo: 17 sessionId: src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0
2025-10-02T08:16:04.541457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ce6513b-fbc0ff32-dcf2cf19-92ce7560_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:04.543866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0] Write session: try to update token
2025-10-02T08:16:04.543881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:04.557301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId: src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:04.557840Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:04.557852Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:04.557853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:04.557859Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535242591912317:3219]
2025-10-02T08:16:04.557863Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535242591912317:3219]
2025-10-02T08:16:04.557896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:04.557897Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:04.557902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:04.557903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.557905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:04.558024Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:04.559939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:04.617559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535242591912375:8443]
2025-10-02T08:16:04.617660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2580, pipe: [1:7556535242591912375:8443]
2025-10-02T08:16:04.688714Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:04.689092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.689105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.689140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591912375:8443], now have 1 active actors on pipe
2025-10-02T08:16:04.689257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535242591912375:8443]
2025-10-02T08:16:04.689284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:04.689292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:04.689339Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:04.689346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2581 reason: error at write: Disconnected sessionId: src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0
2025-10-02T08:16:04.689390Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:04.689499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2581 sessionId: src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0 is DEAD
2025-10-02T08:16:04.689631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:04.689639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0] Write session will restart in 0.007589s
2025-10-02T08:16:04.689674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0] Write session: Do CDS request
2025-10-02T08:16:04.689679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:04.698235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.698272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:04.698296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2582
2025-10-02T08:16:04.698447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.698475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:04.698484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:04.698487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:04.698904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2582 sessionId:  describe result for acl check
2025-10-02T08:16:04.698942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:04.698951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:04.698953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:04.698958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535242591912686:3248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:04.699502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535242591912686:3248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:04.701500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:04.701984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535242591912686:3248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:04.702562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:04.702714Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:04.702723Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:04.702732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:04.702774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:04.702808Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535242591912759:3260]
2025-10-02T08:16:04.703253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:04.703419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:04.703466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:04.703875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:04.703931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.703936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.703937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.703939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.703940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.703945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.703955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.703963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.703971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.703977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.703982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.703992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.704004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.704008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.704012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.704017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.704021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.704027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.704032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.704037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.704055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:04.704795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535242591912686:3248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:04.704821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535242591912686:3248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:04.704825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535242591912686:3248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:04.704833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:04.711747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:04.713265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:04.713282Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:04.713284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:04.713287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:04.713293Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2581 [1:7556535242591912759:3260]
2025-10-02T08:16:04.713304Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:04.713320Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:04.713322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.713329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.713331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.713343Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:04.713346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:04.713351Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:04.713404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.713410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.713412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:04.713414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:04.713462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:04.713469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.713477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.713484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:04.713500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535242591912743:3260]
2025-10-02T08:16:04.713501Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535242591912743:3260]
2025-10-02T08:16:04.713507Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:04.713519Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:04.713522Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:04.713525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:04.713534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2581
2025-10-02T08:16:04.713538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:04.713540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:04.713550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591912776:3248], now have 1 active actors on pipe
2025-10-02T08:16:04.713553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535243051258141:2378], now have 1 active actors on pipe
2025-10-02T08:16:04.713584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.713593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.713606Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535242591912743:3260]
2025-10-02T08:16:04.713608Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:04.713606Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2581
2025-10-02T08:16:04.713628Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:04.713632Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:04.713637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.713640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.713641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:04.713651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.713659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:04.713684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.713726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.713731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.713740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.713774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2582 partition: 0 MaxSeqNo: 17 sessionId: src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0
2025-10-02T08:16:04.714073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46925d94-9b87e0c1-719b7b16-ee9edad3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:04.716444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0] Write session: try to update token
2025-10-02T08:16:04.716456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:04.730273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId: src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:04.731415Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:04.731428Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:04.731430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:04.731437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535242591912743:3260]
2025-10-02T08:16:04.731440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535242591912743:3260]
2025-10-02T08:16:04.731475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:04.731485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.731487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:04.731568Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:04.731585Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:04.731610Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:04.732935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:04.789557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535242591912793:8443]
2025-10-02T08:16:04.789653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2581, pipe: [1:7556535242591912793:8443]
2025-10-02T08:16:04.863234Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:04.863466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.863475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.863506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591912793:8443], now have 1 active actors on pipe
2025-10-02T08:16:04.863591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535242591912793:8443]
2025-10-02T08:16:04.863610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:04.863616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:04.863655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2582 reason: error at write: Disconnected sessionId: src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0
2025-10-02T08:16:04.863698Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:04.863750Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:04.863814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2582 sessionId: src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0 is DEAD
2025-10-02T08:16:04.863956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:04.863966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0] Write session will restart in 0.006205s
2025-10-02T08:16:04.863991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0] Write session: Do CDS request
2025-10-02T08:16:04.863997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:04.871261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.871316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:04.871328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2583
2025-10-02T08:16:04.871474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:04.871514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:04.871523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:04.871527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:04.871976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2583 sessionId:  describe result for acl check
2025-10-02T08:16:04.872015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:04.872022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:04.872024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:04.872030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535242591913059:3253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:04.872560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535242591913059:3253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:04.874968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535242591913059:3253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:04.876242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:04.876478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:04.876601Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:04.876608Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:04.876615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:04.876644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:04.876678Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535242591913180:3251]
2025-10-02T08:16:04.877072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:04.877241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:04.877302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535242591913059:3253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:04.877305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:04.877311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535242591913059:3253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:04.877313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535242591913059:3253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:04.877318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:04.877617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:04.877686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.877693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.877694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.877695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.877696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.877702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.877711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.877715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.877719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.877722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.877727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.877735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:04.877744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.877749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:04.877753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.877758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:04.877766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.877771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.877779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.877784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.877806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:04.885412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:04.886852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:04.886869Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:04.886870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:04.886873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:04.886877Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2582 [1:7556535242591913180:3251]
2025-10-02T08:16:04.886885Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:04.886898Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:04.886900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.886902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.886904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.886915Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:04.886918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:04.886923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:04.886968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.886973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.886975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:04.886977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:04.887031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:04.887037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.887045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:04.887052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:04.887063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535242591913174:3251]
2025-10-02T08:16:04.887068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535242591913174:3251]
2025-10-02T08:16:04.887073Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:04.887082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591913191:3253], now have 1 active actors on pipe
2025-10-02T08:16:04.887087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:04.887091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:04.887092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:04.887100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:04.887102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:04.887102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2582
2025-10-02T08:16:04.887106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535243051258150:2378], now have 1 active actors on pipe
2025-10-02T08:16:04.887129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.887134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.887144Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535242591913174:3251]
2025-10-02T08:16:04.887153Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:04.887168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:04.887170Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:04.887174Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:04.887176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:04.887177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:04.887183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:04.887188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:04.887202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.887180Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2582
2025-10-02T08:16:04.887262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:04.887267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:04.887277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:04.887306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2583 partition: 0 MaxSeqNo: 17 sessionId: src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0
2025-10-02T08:16:04.887597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ded18492-e19a59ef-ab3c9b69-58e3a6ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:04.890127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0] Write session: try to update token
2025-10-02T08:16:04.890143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:04.902766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId: src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:04.903700Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:04.903714Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:04.903716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:04.903722Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535242591913174:3251]
2025-10-02T08:16:04.903726Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535242591913174:3251]
2025-10-02T08:16:04.903758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:04.903766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:04.903767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:04.903784Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:04.903790Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:04.903882Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:04.905136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:04.963679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535242591913225:8443]
2025-10-02T08:16:04.963793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2582, pipe: [1:7556535242591913225:8443]
2025-10-02T08:16:05.039295Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:05.039601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.039617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.039656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535242591913225:8443], now have 1 active actors on pipe
2025-10-02T08:16:05.039781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535242591913225:8443]
2025-10-02T08:16:05.039809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:05.039818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:05.039865Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:05.039872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2583 reason: error at write: Disconnected sessionId: src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0
2025-10-02T08:16:05.039876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:05.040053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2583 sessionId: src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0 is DEAD
2025-10-02T08:16:05.040216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:05.040224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0] Write session will restart in 0.009261s
2025-10-02T08:16:05.040258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0] Write session: Do CDS request
2025-10-02T08:16:05.040264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:05.050297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.050370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:05.050386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2584
2025-10-02T08:16:05.050542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.050579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:05.050587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:05.050591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:05.050937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2584 sessionId:  describe result for acl check
2025-10-02T08:16:05.050973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:05.050979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:05.050981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:05.050986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535246886880898:3366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:05.051471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535246886880898:3366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:05.052048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:05.053047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:05.053267Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:05.053279Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:05.053291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:05.053353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:05.053391Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535246886880932:3357]
2025-10-02T08:16:05.053632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535246886880898:3366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:05.054011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:05.054183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:05.054226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:05.054531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:05.054584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.054591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.054592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.054593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.054594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.054599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.054609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.054613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.054621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.054625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.054630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.054638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.054648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.054653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.054658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.054667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.054676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.054681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.054690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.054695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.054717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:05.059928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535246886880898:3366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:05.059944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535246886880898:3366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:05.059949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535246886880898:3366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:05.059958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:05.063032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:05.064769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:05.064788Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:05.064790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:05.064794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:05.064820Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2583 [1:7556535246886880932:3357]
2025-10-02T08:16:05.064832Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:05.064847Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:05.064855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.064857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.064859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.064874Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:05.064879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:05.064884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:05.064938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.064945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.064948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:05.064950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:05.065011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:05.065018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.065030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.065046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:05.065048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2583
2025-10-02T08:16:05.065067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886880959:3366], now have 1 active actors on pipe
2025-10-02T08:16:05.065076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.065080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.065094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535247346225486:2378], now have 1 active actors on pipe
2025-10-02T08:16:05.065104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535246886880915:3357]
2025-10-02T08:16:05.065105Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535246886880915:3357]
2025-10-02T08:16:05.065115Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:05.065129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:05.065133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:05.065137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:05.065173Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:05.065147Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2583
2025-10-02T08:16:05.065181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:05.065195Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:05.065207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.065212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.065214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:05.065221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.065229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:05.065266Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535246886880915:3357]
2025-10-02T08:16:05.065279Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:05.065289Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:05.065292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.065352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.065359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.065373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.065408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2584 partition: 0 MaxSeqNo: 17 sessionId: src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0
2025-10-02T08:16:05.065770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ff3b21-95ba7a4-ee182d50-d150ec8b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:05.068338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0] Write session: try to update token
2025-10-02T08:16:05.068351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:05.081586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId: src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:05.084151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:05.084215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.084227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.084263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:05.084289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:05.084338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.084350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.084504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.084573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.084641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.084720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.084765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.084775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.084865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.084932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.084994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.085063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.085109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.085116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.085180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.085236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.085297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.085355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.085397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.085403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.085473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.085538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.085602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.085667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.085714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.085721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.085792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.085855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.085923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.085987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.086033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.086041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.086111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.086175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.086244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.086311Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.086355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.086361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.086429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.086495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.086563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.086629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.086675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.086682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.086753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.086815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.086878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.086946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.086990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.086999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.087064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.087129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.087197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.087265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.087310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.087317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.087385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:05.087449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:05.087514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:05.087582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:05.087629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:05.087636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:05.087698Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:05.087769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.087793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.087803Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:05.087837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:05.087855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:05.087862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:05.087864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:05.087867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:05.088288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:05.088321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:05.088332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:05.088335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:05.088344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:05.088347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:05.088892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:05.088921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:05.088928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:05.088931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:05.088934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:05.088936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:05.089451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:05.089476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:05.089481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:05.089484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:05.089487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:05.091682Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:05.091708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:05.091719Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392965091
2025-10-02T08:16:05.091864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:05.091879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:05.091886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:05.091893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:05.091898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:05.091900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:05.092397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:05.092422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:05.092428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:05.092433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:05.092436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:05.092439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:05.092919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:05.092938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:05.092945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:05.092949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:05.092953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:05.092956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:05.093416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:05.093440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:05.093449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:05.094510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:05.094529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:05.094534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:05.094538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:05.094546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392965094
2025-10-02T08:16:05.094843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:05.094864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:05.094873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:05.094876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:05.094881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:05.094884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:05.095353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:05.095376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:05.095381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:05.095389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:05.095392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:05.095396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:05.095858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:05.095884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.095978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392965095
2025-10-02T08:16:05.101054Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:05.101090Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:05.101097Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:05.101105Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:05.101115Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:05.101122Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:05.101124Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:05.101134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535246886880915:3357]
2025-10-02T08:16:05.101145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535246886880915:3357]
2025-10-02T08:16:05.101192Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:05.101207Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:05.107506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:05.107532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.107534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:05.107686Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:05.139792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535246886880977:8443]
2025-10-02T08:16:05.139901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2583, pipe: [1:7556535246886880977:8443]
2025-10-02T08:16:05.246646Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:05.246998Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:05.247007Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:05.247017Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535246886880915:3357]
2025-10-02T08:16:05.247052Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:05.247088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886880977:8443], now have 1 active actors on pipe
2025-10-02T08:16:05.247162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535246886880977:8443]
2025-10-02T08:16:05.247183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:05.247190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:05.247213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2584 reason: error at write: Disconnected sessionId: src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0
2025-10-02T08:16:05.247241Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:05.247314Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:05.247375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2584 sessionId: src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0 is DEAD
2025-10-02T08:16:05.247499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:05.247508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0] Write session will restart in 0.006005s
2025-10-02T08:16:05.247532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0] Write session: Do CDS request
2025-10-02T08:16:05.247538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:05.250629Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [4f9d70b649fa8fe5] Result# TEvPutResult {Id# [72075186224037892:2583:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:16:05.250632Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2583:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:16:05.250694Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2583:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:16:05.254244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.254349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:05.254365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2585
2025-10-02T08:16:05.254499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.254535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:05.254544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:05.254547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:05.254915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2585 sessionId:  describe result for acl check
2025-10-02T08:16:05.254952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:05.254953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:05.254955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:05.254960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535246886881177:3401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:05.255468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535246886881177:3401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:05.257661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535246886881177:3401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:05.260303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535246886881177:3401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:05.260322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535246886881177:3401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:05.260326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535246886881177:3401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:05.260332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:05.262306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:05.263162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:05.263323Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:05.263335Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:05.263343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:05.263379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:05.263413Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535246886881375:3404]
2025-10-02T08:16:05.264041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:05.264211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:05.264252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:05.264561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:05.264616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.264622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.264623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.264624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.264625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.264629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.264638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.264642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.264645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.264649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.264655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.264662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.264667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.264676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.264687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.264697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.264707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.264712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.264716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.264721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.264738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:05.272108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:05.274086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:05.274102Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:05.274104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:05.274109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:05.274116Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2584 [1:7556535246886881375:3404]
2025-10-02T08:16:05.274125Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:05.274138Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:05.274140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.274142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.274143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.274156Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:05.274162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:05.274166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:05.274205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.274212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.274214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:05.274215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:05.274262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:05.274267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.274274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.274281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:05.274295Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535246886881369:3404]
2025-10-02T08:16:05.274299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535246886881369:3404]
2025-10-02T08:16:05.274305Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:05.274316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886881343:3401], now have 1 active actors on pipe
2025-10-02T08:16:05.274322Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:05.274324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2584
2025-10-02T08:16:05.274325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:05.274326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:05.274332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:05.274334Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:05.274359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.274365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.274376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535246886881369:3404]
2025-10-02T08:16:05.274384Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:05.274387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535247346225495:2378], now have 1 active actors on pipe
2025-10-02T08:16:05.274407Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eae0b635-497b500a-60662750-9adda25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:05.274416Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.274423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.274425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:05.274430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.274440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:05.274458Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:05.274461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.274434Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2584
2025-10-02T08:16:05.274500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.274505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.274520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.274547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2585 partition: 0 MaxSeqNo: 17 sessionId: src_id|eae0b635-497b500a-60662750-9adda25_0
2025-10-02T08:16:05.274848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c2db18-8c931d3a-593f3a59-a66d6e8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eae0b635-497b500a-60662750-9adda25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:05.277197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae0b635-497b500a-60662750-9adda25_0] Write session: try to update token
2025-10-02T08:16:05.277209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae0b635-497b500a-60662750-9adda25_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:05.290810Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:05.290828Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:05.290830Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:05.290837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535246886881369:3404]
2025-10-02T08:16:05.290841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535246886881369:3404]
2025-10-02T08:16:05.290874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:05.290883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.290887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:05.290896Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:05.290902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:05.291015Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:05.291154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId: src_id|eae0b635-497b500a-60662750-9adda25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:05.293805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:05.347166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535246886881401:8443]
2025-10-02T08:16:05.347275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2584, pipe: [1:7556535246886881401:8443]
2025-10-02T08:16:05.424653Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:05.425293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.425309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.425346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886881401:8443], now have 1 active actors on pipe
2025-10-02T08:16:05.425455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:05.425468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:05.425536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2585 reason: error at write: Disconnected sessionId: src_id|eae0b635-497b500a-60662750-9adda25_0
2025-10-02T08:16:05.425597Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:05.425739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2585 sessionId: src_id|eae0b635-497b500a-60662750-9adda25_0 is DEAD
2025-10-02T08:16:05.425905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae0b635-497b500a-60662750-9adda25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:05.425914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae0b635-497b500a-60662750-9adda25_0] Write session will restart in 0.008676s
2025-10-02T08:16:05.425952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae0b635-497b500a-60662750-9adda25_0] Write session: Do CDS request
2025-10-02T08:16:05.425942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535246886881401:8443]
2025-10-02T08:16:05.425960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae0b635-497b500a-60662750-9adda25_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:05.426838Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:05.435217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae0b635-497b500a-60662750-9adda25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.435275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:05.435292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2586
2025-10-02T08:16:05.435408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.435438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:05.435446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:05.435450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:05.435882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2586 sessionId:  describe result for acl check
2025-10-02T08:16:05.435915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:05.435922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:05.435924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:05.435929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535246886881717:3413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:05.436481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535246886881717:3413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:05.438929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535246886881717:3413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:05.439685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:05.440128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:05.440314Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:05.440322Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:05.440331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:05.440377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:05.440409Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535246886881791:3417]
2025-10-02T08:16:05.441041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:05.441210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:05.441254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:05.441569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:05.441629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.441634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.441635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.441636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.441638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.441642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.441652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.441656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.441659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.441663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.441667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535246886881717:3413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:05.441668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.441674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535246886881717:3413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:05.441675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.441677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535246886881717:3413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:05.441680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.441684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.441685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:05.441689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.441693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.441699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.441704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.441709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.441714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.441733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:05.449584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:05.451401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:05.451418Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:05.451420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:05.451423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:05.451427Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2585 [1:7556535246886881791:3417]
2025-10-02T08:16:05.451435Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:05.451450Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:05.451452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.451454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.451455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.451467Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:05.451471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:05.451476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:05.451533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.451541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.451544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:05.451546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:05.451594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:05.451600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.451608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.451615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:05.451633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535246886881785:3417]
2025-10-02T08:16:05.451638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535246886881785:3417]
2025-10-02T08:16:05.451643Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:05.451653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:05.451669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:05.451670Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:05.451674Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:05.451677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:05.451679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2585
2025-10-02T08:16:05.451686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886881804:3413], now have 1 active actors on pipe
2025-10-02T08:16:05.451718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535247346225502:2378], now have 1 active actors on pipe
2025-10-02T08:16:05.451727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.451731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.451744Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535246886881785:3417]
2025-10-02T08:16:05.451755Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:05.451773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:05.451779Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ba6e289-ddda165b-2603cfab-6380042a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:05.451785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.451791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.451758Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2585
2025-10-02T08:16:05.451798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:05.451805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.451813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:05.451842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.451910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.451918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.451930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.451964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2586 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ba6e289-ddda165b-2603cfab-6380042a_0
2025-10-02T08:16:05.452293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae0b635-497b500a-60662750-9adda25_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ba6e289-ddda165b-2603cfab-6380042a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:05.455087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba6e289-ddda165b-2603cfab-6380042a_0] Write session: try to update token
2025-10-02T08:16:05.455107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba6e289-ddda165b-2603cfab-6380042a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:05.469606Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:05.469626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:05.469629Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:05.469638Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535246886881785:3417]
2025-10-02T08:16:05.469642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535246886881785:3417]
2025-10-02T08:16:05.469686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:05.469699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.469700Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:05.469706Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:05.469706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:05.469845Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:05.473261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId: src_id|9ba6e289-ddda165b-2603cfab-6380042a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:05.475663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:05.526387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535246886881825:8443]
2025-10-02T08:16:05.526550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2585, pipe: [1:7556535246886881825:8443]
2025-10-02T08:16:05.616183Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:05.616443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.616459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.616512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886881825:8443], now have 1 active actors on pipe
2025-10-02T08:16:05.616635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535246886881825:8443]
2025-10-02T08:16:05.616656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:05.616658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:05.616707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2586 reason: error at write: Disconnected sessionId: src_id|9ba6e289-ddda165b-2603cfab-6380042a_0
2025-10-02T08:16:05.616738Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:05.616893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2586 sessionId: src_id|9ba6e289-ddda165b-2603cfab-6380042a_0 is DEAD
2025-10-02T08:16:05.616994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba6e289-ddda165b-2603cfab-6380042a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:05.617003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba6e289-ddda165b-2603cfab-6380042a_0] Write session will restart in 0.007911s
2025-10-02T08:16:05.617030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba6e289-ddda165b-2603cfab-6380042a_0] Write session: Do CDS request
2025-10-02T08:16:05.617039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba6e289-ddda165b-2603cfab-6380042a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:05.617671Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:05.626294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba6e289-ddda165b-2603cfab-6380042a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.626362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:05.626382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2587
2025-10-02T08:16:05.626512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.626543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:05.626554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:05.626557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:05.626925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2587 sessionId:  describe result for acl check
2025-10-02T08:16:05.626953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:05.626968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:05.626974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:05.626979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535246886882171:3433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:05.627436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535246886882171:3433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:05.628647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:05.629684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:05.629768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535246886882171:3433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:05.629875Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:05.629886Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:05.629901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:05.629954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:05.629992Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535246886882209:3435]
2025-10-02T08:16:05.630639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:05.630847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:05.630898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:05.631226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:05.631266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.631272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.631273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.631274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.631275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.631281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.631291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.631296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.631300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.631309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.631318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.631330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.631340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.631350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.631359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.631368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.631373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.631378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.631383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.631397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.631419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:05.636119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535246886882171:3433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:05.636133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535246886882171:3433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:05.636136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535246886882171:3433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:05.636145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:05.639424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:05.641049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:05.641069Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:05.641072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:05.641076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:05.641082Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2586 [1:7556535246886882209:3435]
2025-10-02T08:16:05.641093Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:05.641109Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:05.641118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.641120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.641122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.641136Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:05.641141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:05.641147Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:05.641205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.641212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.641215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:05.641217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:05.641284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:05.641291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.641304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.641321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:05.641323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2586
2025-10-02T08:16:05.641344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886882236:3433], now have 1 active actors on pipe
2025-10-02T08:16:05.641352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535247346225510:2378], now have 1 active actors on pipe
2025-10-02T08:16:05.641356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.641360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.641380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535246886882191:3435]
2025-10-02T08:16:05.641387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535246886882191:3435]
2025-10-02T08:16:05.641399Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:05.641405Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2586
2025-10-02T08:16:05.641415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:05.641419Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:05.641422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:05.641433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:05.641437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:05.641452Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4666c80c-2727932e-fb3a427b-7a989e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:05.641458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.641461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.641468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:05.641476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.641487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:05.641515Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535246886882191:3435]
2025-10-02T08:16:05.641527Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:05.641545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:05.641547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.641592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.641598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.641611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.641647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2587 partition: 0 MaxSeqNo: 17 sessionId: src_id|4666c80c-2727932e-fb3a427b-7a989e_0
2025-10-02T08:16:05.642019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ba6e289-ddda165b-2603cfab-6380042a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4666c80c-2727932e-fb3a427b-7a989e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:05.644780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4666c80c-2727932e-fb3a427b-7a989e_0] Write session: try to update token
2025-10-02T08:16:05.644799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4666c80c-2727932e-fb3a427b-7a989e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:05.658920Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:05.658937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:05.658939Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:05.658948Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535246886882191:3435]
2025-10-02T08:16:05.658952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535246886882191:3435]
2025-10-02T08:16:05.658985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:05.658989Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:05.658996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:05.659007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.659009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:05.659155Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:05.659870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId: src_id|4666c80c-2727932e-fb3a427b-7a989e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:05.662336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:05.716831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535246886882252:8443]
2025-10-02T08:16:05.716962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2586, pipe: [1:7556535246886882252:8443]
2025-10-02T08:16:05.792292Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:05.792564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.792574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.792603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886882252:8443], now have 1 active actors on pipe
2025-10-02T08:16:05.792691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535246886882252:8443]
2025-10-02T08:16:05.792706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:05.792712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:05.792751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2587 reason: error at write: Disconnected sessionId: src_id|4666c80c-2727932e-fb3a427b-7a989e_0
2025-10-02T08:16:05.792835Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:05.792841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:05.792908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2587 sessionId: src_id|4666c80c-2727932e-fb3a427b-7a989e_0 is DEAD
2025-10-02T08:16:05.793090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4666c80c-2727932e-fb3a427b-7a989e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:05.793099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4666c80c-2727932e-fb3a427b-7a989e_0] Write session will restart in 0.009792s
2025-10-02T08:16:05.793118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4666c80c-2727932e-fb3a427b-7a989e_0] Write session: Do CDS request
2025-10-02T08:16:05.793123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4666c80c-2727932e-fb3a427b-7a989e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:05.803882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:05.804274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4666c80c-2727932e-fb3a427b-7a989e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.804322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:05.804336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2588
2025-10-02T08:16:05.804461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.804490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:05.804498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:05.804506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:05.804926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2588 sessionId:  describe result for acl check
2025-10-02T08:16:05.804959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:05.804965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:05.804967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:05.804972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535246886882618:3451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:05.805071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:05.805235Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:05.805246Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:05.805257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:05.805314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:05.805351Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535246886882620:3459]
2025-10-02T08:16:05.805448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535246886882618:3451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:05.805908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:05.806167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:05.806217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:05.806502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:05.806581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.806587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.806589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.806590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.806591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.806596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.806604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.806608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.806612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.806615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.806620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.806627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.806636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.806641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.806646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.806651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.806655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.806661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.806666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.806672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.806690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:05.807428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535246886882618:3451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:05.812533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535246886882618:3451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:05.812549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535246886882618:3451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:05.812552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535246886882618:3451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:05.812561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:05.814793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:05.816506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:05.816526Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:05.816528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:05.816532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:05.816541Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2587 [1:7556535246886882620:3459]
2025-10-02T08:16:05.816551Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:05.816568Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:05.816571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.816574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.816576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.816592Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:05.816597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:05.816604Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:05.816665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.816674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.816677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:05.816679Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:05.816753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:05.816761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.816774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.816785Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:05.816826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886882667:3451], now have 1 active actors on pipe
2025-10-02T08:16:05.816839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535247346225517:2378], now have 1 active actors on pipe
2025-10-02T08:16:05.816845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535246886882611:3459]
2025-10-02T08:16:05.816844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2587
2025-10-02T08:16:05.816847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535246886882611:3459]
2025-10-02T08:16:05.816855Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:05.816864Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:05.816867Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:05.816869Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:05.816882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:05.816885Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:05.816892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.816897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.816884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2587
2025-10-02T08:16:05.816936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535246886882611:3459]
2025-10-02T08:16:05.816946Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:05.816954Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:05.816961Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:05.816973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.816981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.816984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:05.816994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.817007Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:05.817051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.817139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.817146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.817162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.817198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2588 partition: 0 MaxSeqNo: 17 sessionId: src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0
2025-10-02T08:16:05.817503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4666c80c-2727932e-fb3a427b-7a989e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:05.820108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0] Write session: try to update token
2025-10-02T08:16:05.820123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:05.833824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId: src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:05.834520Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:05.834540Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:05.834543Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:05.834552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535246886882611:3459]
2025-10-02T08:16:05.834558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535246886882611:3459]
2025-10-02T08:16:05.834594Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:05.834598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:05.834604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.834606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:05.834607Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:05.834795Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:05.836400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:05.892934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535246886882684:8443]
2025-10-02T08:16:05.893086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2587, pipe: [1:7556535246886882684:8443]
2025-10-02T08:16:05.964583Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:05.964920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.964932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.964962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886882684:8443], now have 1 active actors on pipe
2025-10-02T08:16:05.965089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535246886882684:8443]
2025-10-02T08:16:05.965116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:05.965125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:05.965143Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:05.965185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2588 reason: error at write: Disconnected sessionId: src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0
2025-10-02T08:16:05.965166Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:05.965354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2588 sessionId: src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0 is DEAD
2025-10-02T08:16:05.965498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:05.965504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0] Write session will restart in 0.009220s
2025-10-02T08:16:05.965521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0] Write session: Do CDS request
2025-10-02T08:16:05.965526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:05.975923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:05.976237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.976283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:05.976291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2589
2025-10-02T08:16:05.976415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:05.976443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:05.976452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:05.976454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:05.976779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2589 sessionId:  describe result for acl check
2025-10-02T08:16:05.976818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:05.976824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:05.976826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:05.976830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535246886883065:3487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:05.976920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:05.977073Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:05.977082Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:05.977090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:05.977148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:05.977184Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535246886883067:3474]
2025-10-02T08:16:05.977244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535246886883065:3487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:05.977773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:05.977912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:05.977947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:05.978225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:05.978340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.978347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.978348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.978350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.978351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.978355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.978363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.978372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.978379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.978383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.978392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.978402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:05.978411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.978420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:05.978428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.978436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:05.978443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.978448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.978456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.978461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.978482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:05.979158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535246886883065:3487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:05.985188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535246886883065:3487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:05.985203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535246886883065:3487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:05.985205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535246886883065:3487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:05.985212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:05.987134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:05.988865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:05.988880Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:05.988882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:05.988886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:05.988891Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2588 [1:7556535246886883067:3474]
2025-10-02T08:16:05.988903Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:05.988918Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:05.988921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.988924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.988926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.988939Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:05.988943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:05.988949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:05.989006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.989008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.989011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:05.989013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:05.989072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:05.989080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:05.989092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:05.989107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:05.989121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2588
2025-10-02T08:16:05.989129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535246886883109:3487], now have 1 active actors on pipe
2025-10-02T08:16:05.989139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535246886883058:3474]
2025-10-02T08:16:05.989141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535246886883058:3474]
2025-10-02T08:16:05.989152Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:05.989167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535247346225542:2378], now have 1 active actors on pipe
2025-10-02T08:16:05.989166Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:05.989170Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:05.989178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.989182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.989199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:05.989215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:05.989222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:05.989207Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2588
2025-10-02T08:16:05.989260Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68856aed-e7792279-2d09d047-cb67052_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:05.989271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:05.989275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:05.989276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:05.989285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:05.989294Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:05.989305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535246886883058:3474]
2025-10-02T08:16:05.989317Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:05.989334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:05.989354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.989389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:05.989399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:05.989414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:05.989450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2589 partition: 0 MaxSeqNo: 17 sessionId: src_id|68856aed-e7792279-2d09d047-cb67052_0
2025-10-02T08:16:05.989801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632acaa-cb9f159e-bb140c44-14c7ba57_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|68856aed-e7792279-2d09d047-cb67052_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:05.992219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68856aed-e7792279-2d09d047-cb67052_0] Write session: try to update token
2025-10-02T08:16:05.992233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68856aed-e7792279-2d09d047-cb67052_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:06.004465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId: src_id|68856aed-e7792279-2d09d047-cb67052_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:06.006677Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:06.006692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:06.006693Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:06.006700Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535246886883058:3474]
2025-10-02T08:16:06.006704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535246886883058:3474]
2025-10-02T08:16:06.006734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:06.006738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.006740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:06.006743Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:06.006748Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:06.006828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:06.006853Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:06.074442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535251181850434:8443]
2025-10-02T08:16:06.077636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2588, pipe: [1:7556535251181850434:8443]
2025-10-02T08:16:06.136952Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:06.137445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.137460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.137499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181850434:8443], now have 1 active actors on pipe
2025-10-02T08:16:06.137631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535251181850434:8443]
2025-10-02T08:16:06.137662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:06.137669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:06.137713Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:06.137727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2589 reason: error at write: Disconnected sessionId: src_id|68856aed-e7792279-2d09d047-cb67052_0
2025-10-02T08:16:06.137771Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:06.137933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2589 sessionId: src_id|68856aed-e7792279-2d09d047-cb67052_0 is DEAD
2025-10-02T08:16:06.138119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68856aed-e7792279-2d09d047-cb67052_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:06.138130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68856aed-e7792279-2d09d047-cb67052_0] Write session will restart in 0.005597s
2025-10-02T08:16:06.138152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68856aed-e7792279-2d09d047-cb67052_0] Write session: Do CDS request
2025-10-02T08:16:06.138158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68856aed-e7792279-2d09d047-cb67052_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:06.145207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68856aed-e7792279-2d09d047-cb67052_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.145292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:06.145309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2590
2025-10-02T08:16:06.145444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.145486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:06.145498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:06.145502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:06.145945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2590 sessionId:  describe result for acl check
2025-10-02T08:16:06.145979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:06.145985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:06.145987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:06.145992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535251181850709:3576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:06.146477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535251181850709:3576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:06.149005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535251181850709:3576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:06.150943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:06.152273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:06.152433Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:06.152443Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:06.152452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:06.152499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:06.152536Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535251181850857:3600]
2025-10-02T08:16:06.152707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535251181850709:3576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:06.152720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535251181850709:3576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:06.152724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535251181850709:3576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:06.152731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:06.153144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:06.153338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:06.153378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:06.153658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:06.153712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.153718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.153719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.153720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.153721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.153726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.153735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.153739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.153743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.153746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.153751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.153758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.153763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.153768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.153777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.153781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.153785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.153790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.153794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.153799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.153816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:06.161423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:06.162921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:06.162936Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:06.162939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:06.162942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:06.162949Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2589 [1:7556535251181850857:3600]
2025-10-02T08:16:06.162961Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:06.162977Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:06.162986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.162989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.162991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.163005Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:06.163015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:06.163021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:06.163084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.163090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.163093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:06.163095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:06.163157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:06.163164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.163177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.163193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:06.163207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535251181850851:3600]
2025-10-02T08:16:06.163213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535251181850851:3600]
2025-10-02T08:16:06.163220Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:06.163232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:06.163235Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:06.163238Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:06.163245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:06.163248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:06.163254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2589
2025-10-02T08:16:06.163256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181850862:3576], now have 1 active actors on pipe
2025-10-02T08:16:06.163260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535251641192867:2378], now have 1 active actors on pipe
2025-10-02T08:16:06.163289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.163297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.163308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535251181850851:3600]
2025-10-02T08:16:06.163316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:06.163338Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:06.163311Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2589
2025-10-02T08:16:06.163348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.163351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.163353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:06.163357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:06.163361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.163369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:06.163391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.163439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.163446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.163457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.163492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2590 partition: 0 MaxSeqNo: 17 sessionId: src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0
2025-10-02T08:16:06.163839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68856aed-e7792279-2d09d047-cb67052_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:06.166441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0] Write session: try to update token
2025-10-02T08:16:06.166460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:06.180471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId: src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:06.180911Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:06.180925Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:06.180927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:06.180933Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535251181850851:3600]
2025-10-02T08:16:06.180936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535251181850851:3600]
2025-10-02T08:16:06.180968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:06.180977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.180979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:06.180989Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:06.181000Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:06.181173Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:06.182888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:06.238042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535251181850887:8443]
2025-10-02T08:16:06.238173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2589, pipe: [1:7556535251181850887:8443]
2025-10-02T08:16:06.308035Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:06.308449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.308463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.308493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181850887:8443], now have 1 active actors on pipe
2025-10-02T08:16:06.308621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:06.308634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:06.308676Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:06.308696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2590 reason: error at write: Disconnected sessionId: src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0
2025-10-02T08:16:06.308701Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:06.308885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2590 sessionId: src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0 is DEAD
2025-10-02T08:16:06.308963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535251181850887:8443]
2025-10-02T08:16:06.309034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:06.309044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0] Write session will restart in 0.008561s
2025-10-02T08:16:06.309079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0] Write session: Do CDS request
2025-10-02T08:16:06.309086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:06.318284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.318411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:06.318440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2591
2025-10-02T08:16:06.318570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.318612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:06.318622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:06.318626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:06.319165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2591 sessionId:  describe result for acl check
2025-10-02T08:16:06.319205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:06.319213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:06.319215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:06.319220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535251181851242:3580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:06.319724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535251181851242:3580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:06.320489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:06.321744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:06.321912Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:06.321922Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:06.321931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:06.321975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:06.322011Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535251181851279:3579]
2025-10-02T08:16:06.322461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535251181851242:3580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:06.322643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:06.322886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:06.322961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:06.323293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:06.323348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.323354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.323357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.323358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.323359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.323364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.323374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.323378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.323382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.323385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.323391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.323399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.323409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.323414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.323419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.323424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.323429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.323434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.323441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.323451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.323470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:06.328436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535251181851242:3580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:06.328452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535251181851242:3580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:06.328456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535251181851242:3580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:06.328464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:06.336068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:06.337874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:06.337892Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:06.337894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:06.337898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:06.337904Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2590 [1:7556535251181851279:3579]
2025-10-02T08:16:06.337916Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:06.337932Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:06.337935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.337938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.337940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.337955Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:06.337960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:06.337966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:06.338029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.338037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.338040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:06.338042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:06.338106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:06.338114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.338126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.338137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:06.338157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535251181851259:3579]
2025-10-02T08:16:06.338163Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535251181851259:3579]
2025-10-02T08:16:06.338170Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:06.338184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181851306:3580], now have 1 active actors on pipe
2025-10-02T08:16:06.338185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:06.338189Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:06.338196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:06.338207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2590
2025-10-02T08:16:06.338209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:06.338211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:06.338217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535251641192876:2378], now have 1 active actors on pipe
2025-10-02T08:16:06.338247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.338255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.338267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535251181851259:3579]
2025-10-02T08:16:06.338279Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:06.338289Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:06.338307Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:06.338312Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.338320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.338322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:06.338332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.338344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:06.338322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2590
2025-10-02T08:16:06.338368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.338565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.338574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.338587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.338634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2591 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0
2025-10-02T08:16:06.339026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c82478e-63fbba9f-e76abcc5-403f4317_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:06.343048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0] Write session: try to update token
2025-10-02T08:16:06.343066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:06.355977Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:06.356004Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:06.356007Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:06.356015Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535251181851259:3579]
2025-10-02T08:16:06.356020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535251181851259:3579]
2025-10-02T08:16:06.356060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:06.356068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:06.356071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.356073Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:06.356073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:06.356216Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:06.356769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId: src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:06.359248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:06.409035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535251181851319:8443]
2025-10-02T08:16:06.409159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2590, pipe: [1:7556535251181851319:8443]
2025-10-02T08:16:06.486775Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:06.487109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.487120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.487150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181851319:8443], now have 1 active actors on pipe
2025-10-02T08:16:06.487253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:06.487266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:06.487287Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:06.487327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2591 reason: error at write: Disconnected sessionId: src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0
2025-10-02T08:16:06.487346Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:06.487509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535251181851319:8443]
2025-10-02T08:16:06.487532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2591 sessionId: src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0 is DEAD
2025-10-02T08:16:06.487652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:06.487659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0] Write session will restart in 0.008870s
2025-10-02T08:16:06.487679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0] Write session: Do CDS request
2025-10-02T08:16:06.487684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:06.497187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.497236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:06.497251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2592
2025-10-02T08:16:06.497376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.497407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:06.497416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:06.497419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:06.497794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2592 sessionId:  describe result for acl check
2025-10-02T08:16:06.497827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:06.497834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:06.497838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:06.497844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535251181851675:3601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:06.498206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535251181851675:3601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:06.499702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:06.500195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535251181851675:3601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:06.500772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:06.500962Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:06.500975Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:06.500986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:06.501041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:06.501078Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535251181851723:3588]
2025-10-02T08:16:06.501620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:06.501844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:06.501900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:06.502207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:06.502251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.502255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.502256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.502257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.502257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.502261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.502266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.502268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.502270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.502273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.502276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.502280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.502283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.502286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.502288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.502291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.502293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.502296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.502299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.502301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.502311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:06.502832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535251181851675:3601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:06.502842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535251181851675:3601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:06.502845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535251181851675:3601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:06.502851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:06.509754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:06.511298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:06.511311Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:06.511312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:06.511314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:06.511318Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2591 [1:7556535251181851723:3588]
2025-10-02T08:16:06.511327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:06.511340Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:06.511342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.511344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.511345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.511359Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:06.511363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:06.511369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:06.511417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.511423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.511426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:06.511427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:06.511483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:06.511489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.511498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.511504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:06.511516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535251181851707:3588]
2025-10-02T08:16:06.511518Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535251181851707:3588]
2025-10-02T08:16:06.511523Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:06.511535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:06.511540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:06.511545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:06.511547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:06.511550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:06.511581Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535251181851707:3588]
2025-10-02T08:16:06.511584Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:06.511587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:06.511592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535251641192885:2378], now have 1 active actors on pipe
2025-10-02T08:16:06.511595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181851740:3601], now have 1 active actors on pipe
2025-10-02T08:16:06.511613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2591
2025-10-02T08:16:06.511615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.511618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.511644Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dc3d24e-a452694d-19744653-dce3bd38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:06.511656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.511659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.511661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:06.511672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.511685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:06.511701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.511669Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2591
2025-10-02T08:16:06.511735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.511740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.511749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.511775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2592 partition: 0 MaxSeqNo: 17 sessionId: src_id|5dc3d24e-a452694d-19744653-dce3bd38_0
2025-10-02T08:16:06.512070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d93cef0-d1258690-2c767919-7c18d8f8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5dc3d24e-a452694d-19744653-dce3bd38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:06.514589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3d24e-a452694d-19744653-dce3bd38_0] Write session: try to update token
2025-10-02T08:16:06.514605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3d24e-a452694d-19744653-dce3bd38_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:06.527326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId: src_id|5dc3d24e-a452694d-19744653-dce3bd38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:06.528530Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:06.528552Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:06.528555Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:06.528567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535251181851707:3588]
2025-10-02T08:16:06.528571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535251181851707:3588]
2025-10-02T08:16:06.528609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:06.528611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:06.528617Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.528619Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:06.528620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:06.528749Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:06.529710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:06.587717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535251181851755:8443]
2025-10-02T08:16:06.587836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2591, pipe: [1:7556535251181851755:8443]
2025-10-02T08:16:06.655605Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:06.655937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.655949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.655983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181851755:8443], now have 1 active actors on pipe
2025-10-02T08:16:06.656065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535251181851755:8443]
2025-10-02T08:16:06.656092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:06.656097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:06.656141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2592 reason: error at write: Disconnected sessionId: src_id|5dc3d24e-a452694d-19744653-dce3bd38_0
2025-10-02T08:16:06.656194Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:06.656205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:06.656307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2592 sessionId: src_id|5dc3d24e-a452694d-19744653-dce3bd38_0 is DEAD
2025-10-02T08:16:06.656433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3d24e-a452694d-19744653-dce3bd38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:06.656439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3d24e-a452694d-19744653-dce3bd38_0] Write session will restart in 0.006934s
2025-10-02T08:16:06.656461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3d24e-a452694d-19744653-dce3bd38_0] Write session: Do CDS request
2025-10-02T08:16:06.656466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3d24e-a452694d-19744653-dce3bd38_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:06.664208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3d24e-a452694d-19744653-dce3bd38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.664251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:06.664266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2593
2025-10-02T08:16:06.664416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.664443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:06.664452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:06.664456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:06.664877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2593 sessionId:  describe result for acl check
2025-10-02T08:16:06.664914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:06.664921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:06.664922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:06.664927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535251181852076:3623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:06.665430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535251181852076:3623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:06.667440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535251181852076:3623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:06.668159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:06.668525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:06.668690Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:06.668700Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:06.668709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:06.668754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:06.668789Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535251181852161:3618]
2025-10-02T08:16:06.669445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:06.669581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:06.669625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:06.669905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:06.669948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.669953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.669954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.669956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.669957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.669961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.669971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.669974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.669978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.669981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.669985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.669992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.669997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.670002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.670002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535251181852076:3623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:06.670008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.670010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535251181852076:3623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:06.670013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535251181852076:3623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:06.670013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.670018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.670021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:06.670023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.670027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.670031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.670049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:06.677537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:06.679018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:06.679034Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:06.679035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:06.679038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:06.679042Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2592 [1:7556535251181852161:3618]
2025-10-02T08:16:06.679050Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:06.679061Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:06.679063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.679065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.679069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.679081Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:06.679085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:06.679091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:06.679145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.679155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.679158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:06.679160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:06.679210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:06.679218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.679229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.679239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:06.679259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535251181852155:3618]
2025-10-02T08:16:06.679266Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535251181852155:3618]
2025-10-02T08:16:06.679273Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:06.679281Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:06.679290Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:06.679290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181852175:3623], now have 1 active actors on pipe
2025-10-02T08:16:06.679293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2592
2025-10-02T08:16:06.679295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:06.679306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:06.679308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:06.679313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535251641192892:2378], now have 1 active actors on pipe
2025-10-02T08:16:06.679341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.679349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.679360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535251181852155:3618]
2025-10-02T08:16:06.679369Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:06.679376Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:06.679390Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:06.679396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.679399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.679401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:06.679394Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2592
2025-10-02T08:16:06.679412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.679427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:06.679451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.679492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.679499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.679510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.679544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2593 partition: 0 MaxSeqNo: 17 sessionId: src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0
2025-10-02T08:16:06.679886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3d24e-a452694d-19744653-dce3bd38_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:06.682289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0] Write session: try to update token
2025-10-02T08:16:06.682302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:06.694783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId: src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:06.695839Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:06.695853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:06.695855Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:06.695861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535251181852155:3618]
2025-10-02T08:16:06.695864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535251181852155:3618]
2025-10-02T08:16:06.695897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:06.695897Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:06.695902Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:06.695906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.695908Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:06.696035Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:06.697422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:06.756156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535251181852194:8443]
2025-10-02T08:16:06.756276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2592, pipe: [1:7556535251181852194:8443]
2025-10-02T08:16:06.826871Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:06.827208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.827222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.827253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181852194:8443], now have 1 active actors on pipe
2025-10-02T08:16:06.827395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:06.827405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:06.827462Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:06.827468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2593 reason: error at write: Disconnected sessionId: src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0
2025-10-02T08:16:06.827482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:06.827635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2593 sessionId: src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0 is DEAD
2025-10-02T08:16:06.827785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:06.827795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0] Write session will restart in 0.009314s
2025-10-02T08:16:06.827798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535251181852194:8443]
2025-10-02T08:16:06.827818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0] Write session: Do CDS request
2025-10-02T08:16:06.827825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:06.838256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.838274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:06.838289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2594
2025-10-02T08:16:06.838430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:06.838457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:06.838465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:06.838468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:06.838668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:06.838792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2594 sessionId:  describe result for acl check
2025-10-02T08:16:06.838819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:06.838824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:06.838826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:06.838830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535251181852572:3704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:06.839088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:06.839204Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:06.839211Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:06.839220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:06.839258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535251181852572:3704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:06.839258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:06.839305Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535251181852574:3642]
2025-10-02T08:16:06.839720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:06.840117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:06.840151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:06.840351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:06.840381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.840386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.840387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.840387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.840388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.840391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.840396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.840399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.840401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.840403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.840407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.840411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:06.840414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.840419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:06.840421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.840424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:06.840428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.840431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.840433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.840435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.840445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:06.840763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535251181852572:3704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:06.846277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535251181852572:3704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:06.846292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535251181852572:3704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:06.846296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535251181852572:3704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:06.846304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:06.848333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:06.849683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:06.849697Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:06.849699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:06.849702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:06.849707Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2593 [1:7556535251181852574:3642]
2025-10-02T08:16:06.849716Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:06.849728Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:06.849730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.849732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.849734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.849746Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:06.849749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:06.849754Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:06.849796Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.849804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.849806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:06.849807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:06.849856Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:06.849864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.849872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:06.849879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:06.849891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535251181852567:3642]
2025-10-02T08:16:06.849892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535251181852567:3642]
2025-10-02T08:16:06.849898Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:06.849908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181852621:3704], now have 1 active actors on pipe
2025-10-02T08:16:06.849914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:06.849915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:06.849918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:06.849922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:06.849925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:06.849927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2593
2025-10-02T08:16:06.849930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535251641192900:2378], now have 1 active actors on pipe
2025-10-02T08:16:06.849961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.849970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.849983Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535251181852567:3642]
2025-10-02T08:16:06.849986Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:06.849994Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:06.850008Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:06.850018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:06.850022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:06.850024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:06.850033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:06.849984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2593
2025-10-02T08:16:06.850045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:06.850071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.850117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.850130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.850157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:06.850204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2594 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0
2025-10-02T08:16:06.850561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c880d2-2a1f4307-d924913f-b88dae0b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:06.853366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0] Write session: try to update token
2025-10-02T08:16:06.853385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:06.866901Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:06.866920Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:06.866923Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:06.866931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535251181852567:3642]
2025-10-02T08:16:06.866936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535251181852567:3642]
2025-10-02T08:16:06.866975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:06.866976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:06.866981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:06.866983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:06.866985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:06.867141Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:06.867421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId: src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:06.870108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:06.928208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535251181852635:8443]
2025-10-02T08:16:06.928350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2593, pipe: [1:7556535251181852635:8443]
2025-10-02T08:16:06.997091Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:06.997500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:06.997520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:06.997563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535251181852635:8443], now have 1 active actors on pipe
2025-10-02T08:16:06.997705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535251181852635:8443]
2025-10-02T08:16:06.997730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:06.997736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:06.997766Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:06.997796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2594 reason: error at write: Disconnected sessionId: src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0
2025-10-02T08:16:06.997837Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:06.997969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2594 sessionId: src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0 is DEAD
2025-10-02T08:16:06.998120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:06.998131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0] Write session will restart in 0.005175s
2025-10-02T08:16:06.998157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0] Write session: Do CDS request
2025-10-02T08:16:06.998163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:07.004287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.004372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:07.004386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2595
2025-10-02T08:16:07.004506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.004538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:07.004548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:07.004551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:07.004890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2595 sessionId:  describe result for acl check
2025-10-02T08:16:07.004917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:07.004919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:07.004919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:07.004923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535255476820136:3725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:07.005406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535255476820136:3725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:07.009958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535255476820136:3725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:07.013341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535255476820136:3725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:07.013356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535255476820136:3725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:07.013359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535255476820136:3725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:07.013367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:07.014405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:07.015489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:07.015630Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:07.015637Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:07.015644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:07.015676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:07.015701Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535255476820359:3722]
2025-10-02T08:16:07.016111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:07.016285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:07.016318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:07.016567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:07.016600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.016604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.016605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.016606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.016607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.016610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.016616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.016618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.016620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.016622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.016626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.016631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.016634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.016637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.016640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.016643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.016645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.016648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.016650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.016653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.016663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:07.024637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:07.026409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:07.026424Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:07.026426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:07.026429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:07.026434Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2594 [1:7556535255476820359:3722]
2025-10-02T08:16:07.026442Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:07.026456Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:07.026458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.026460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.026461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.026473Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:07.026476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:07.026480Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:07.026539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.026549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.026553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:07.026555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:07.026609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:07.026615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.026624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.026630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:07.026647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535255476820353:3722]
2025-10-02T08:16:07.026653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535255476820353:3722]
2025-10-02T08:16:07.026658Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:07.026668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476820339:3725], now have 1 active actors on pipe
2025-10-02T08:16:07.026668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2594
2025-10-02T08:16:07.026675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:07.026678Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:07.026678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:07.026686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:07.026688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:07.026691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535251641192918:2378], now have 1 active actors on pipe
2025-10-02T08:16:07.026695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.026697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.026729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535255476820353:3722]
2025-10-02T08:16:07.026740Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:07.026755Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:07.026765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.026767Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:07.026769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.026771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:07.026778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.026787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:07.026781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2594
2025-10-02T08:16:07.026820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.026889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.026897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.026912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.026950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2595 partition: 0 MaxSeqNo: 17 sessionId: src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0
2025-10-02T08:16:07.027291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc557c42-8bac16ee-979d3147-f60bfaa4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:07.029917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0] Write session: try to update token
2025-10-02T08:16:07.029934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:07.044391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId: src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:07.044756Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:07.044770Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:07.044773Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:07.044781Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535255476820353:3722]
2025-10-02T08:16:07.044790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535255476820353:3722]
2025-10-02T08:16:07.044850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:07.044849Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:07.044855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:07.044860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.044862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:07.045012Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:07.047137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:07.112486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535255476820397:8443]
2025-10-02T08:16:07.114256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2594, pipe: [1:7556535255476820397:8443]
2025-10-02T08:16:07.178593Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:07.178903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.178923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.178977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476820397:8443], now have 1 active actors on pipe
2025-10-02T08:16:07.179076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:07.179083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:07.179148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2595 reason: error at write: Disconnected sessionId: src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0
2025-10-02T08:16:07.179194Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:07.179246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:07.179313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2595 sessionId: src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0 is DEAD
2025-10-02T08:16:07.179458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:07.179465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0] Write session will restart in 0.007735s
2025-10-02T08:16:07.179461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535255476820397:8443]
2025-10-02T08:16:07.179490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0] Write session: Do CDS request
2025-10-02T08:16:07.179497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:07.188351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.188398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:07.188420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2596
2025-10-02T08:16:07.188598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.188630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:07.188640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:07.188644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:07.189092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2596 sessionId:  describe result for acl check
2025-10-02T08:16:07.189127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:07.189135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:07.189136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:07.189141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535255476820745:3803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:07.189678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535255476820745:3803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:07.192292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535255476820745:3803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:07.192585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:07.193887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:07.194136Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:07.194149Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:07.194161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:07.194219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:07.194256Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535255476820833:3802]
2025-10-02T08:16:07.194921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:07.195158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:07.195221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:07.195234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535255476820745:3803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:07.195246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535255476820745:3803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:07.195250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535255476820745:3803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:07.195258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:07.195524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:07.195591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.195596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.195596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.195597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.195598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.195602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.195608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.195611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.195613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.195615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.195619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.195623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.195629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.195634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.195641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.195646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.195649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.195654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.195659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.195663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.195682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:07.203759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:07.205409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:07.205431Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:07.205433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:07.205437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:07.205445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2595 [1:7556535255476820833:3802]
2025-10-02T08:16:07.205455Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:07.205470Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:07.205473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.205475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.205476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.205491Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:07.205494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:07.205501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:07.205558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.205564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.205566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:07.205568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:07.205635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:07.205648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.205661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.205672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:07.205689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476820844:3803], now have 1 active actors on pipe
2025-10-02T08:16:07.205696Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535255476820817:3802]
2025-10-02T08:16:07.205697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535255476820817:3802]
2025-10-02T08:16:07.205833Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2595
2025-10-02T08:16:07.205704Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:07.205720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535255936160243:2378], now have 1 active actors on pipe
2025-10-02T08:16:07.205722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:07.205725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:07.205727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:07.205728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2595
2025-10-02T08:16:07.205739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:07.205743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:07.205781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.205785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.205797Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535255476820817:3802]
2025-10-02T08:16:07.205806Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:07.205813Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:07.205834Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:07.205839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.205843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.205848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:07.205857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.205865Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:07.205892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.205955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.205957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.205971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.206017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2596 partition: 0 MaxSeqNo: 17 sessionId: src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0
2025-10-02T08:16:07.206338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2939f7b6-9deab5d4-f99cce62-12e0d74b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:07.209246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0] Write session: try to update token
2025-10-02T08:16:07.209266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:07.223124Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:07.223146Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:07.223148Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:07.223157Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535255476820817:3802]
2025-10-02T08:16:07.223161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535255476820817:3802]
2025-10-02T08:16:07.223205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:07.223204Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:07.223210Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:07.223218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.223221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:07.223363Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:07.224858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId: src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:07.227749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:07.279440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535255476820863:8443]
2025-10-02T08:16:07.279563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2595, pipe: [1:7556535255476820863:8443]
2025-10-02T08:16:07.356354Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:07.356630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.356640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.356673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476820863:8443], now have 1 active actors on pipe
2025-10-02T08:16:07.356792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535255476820863:8443]
2025-10-02T08:16:07.356834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:07.356841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:07.356862Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:07.356875Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:07.356900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2596 reason: error at write: Disconnected sessionId: src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0
2025-10-02T08:16:07.357060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2596 sessionId: src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0 is DEAD
2025-10-02T08:16:07.357196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:07.357204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0] Write session will restart in 0.006447s
2025-10-02T08:16:07.357224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0] Write session: Do CDS request
2025-10-02T08:16:07.357229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:07.364289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.364354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:07.364370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2597
2025-10-02T08:16:07.364514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.364546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:07.364556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:07.364559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:07.365082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2597 sessionId:  describe result for acl check
2025-10-02T08:16:07.365116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:07.365117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:07.365118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:07.365123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535255476821130:3826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:07.365629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535255476821130:3826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:07.369276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535255476821130:3826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:07.370507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:07.371669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:07.371849Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:07.371859Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:07.371868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:07.371914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:07.371961Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535255476821277:3818]
2025-10-02T08:16:07.372112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535255476821130:3826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:07.372139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535255476821130:3826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:07.372143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535255476821130:3826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:07.372152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:07.372627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:07.372797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:07.372855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:07.373151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:07.373196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.373201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.373203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.373204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.373205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.373210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.373220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.373228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.373232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.373239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.373245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.373256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.373266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.373271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.373280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.373284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.373293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.373299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.373308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.373313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.373331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:07.381445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:07.383029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:07.383046Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:07.383048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:07.383052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:07.383058Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2596 [1:7556535255476821277:3818]
2025-10-02T08:16:07.383070Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:07.383086Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:07.383089Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.383092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.383094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.383111Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:07.383116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:07.383122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:07.383181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.383189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.383191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:07.383193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:07.383243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:07.383248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.383262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.383278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:07.383299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476821282:3826], now have 1 active actors on pipe
2025-10-02T08:16:07.383310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535255476821271:3818]
2025-10-02T08:16:07.383312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535255476821271:3818]
2025-10-02T08:16:07.383318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2596
2025-10-02T08:16:07.383319Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:07.383331Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:07.383332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:07.383343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:07.383346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:07.383349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:07.383355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535255936160251:2378], now have 1 active actors on pipe
2025-10-02T08:16:07.383359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.383362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.383394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535255476821271:3818]
2025-10-02T08:16:07.383407Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:07.383421Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e98ceba-ffefa477-359f502a-20a30ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:07.383427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.383430Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:07.383432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.383434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:07.383443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.383451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:07.383441Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2596
2025-10-02T08:16:07.383481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.383558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.383564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.383576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.383614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2597 partition: 0 MaxSeqNo: 17 sessionId: src_id|7e98ceba-ffefa477-359f502a-20a30ca_0
2025-10-02T08:16:07.383944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d205a1-8fa6fffb-98c4107-d2a2f7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7e98ceba-ffefa477-359f502a-20a30ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:07.386603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e98ceba-ffefa477-359f502a-20a30ca_0] Write session: try to update token
2025-10-02T08:16:07.386622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e98ceba-ffefa477-359f502a-20a30ca_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:07.401095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId: src_id|7e98ceba-ffefa477-359f502a-20a30ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:07.401479Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:07.401494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:07.401497Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:07.401505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535255476821271:3818]
2025-10-02T08:16:07.401510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535255476821271:3818]
2025-10-02T08:16:07.401554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:07.401559Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:07.401565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:07.401566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.401568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:07.401710Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:07.403675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:07.457113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535255476821307:8443]
2025-10-02T08:16:07.457238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2596, pipe: [1:7556535255476821307:8443]
2025-10-02T08:16:07.541063Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:07.541485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.541500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.541540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476821307:8443], now have 1 active actors on pipe
2025-10-02T08:16:07.541787Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:07.541712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:07.541727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:07.541800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2597 reason: error at write: Disconnected sessionId: src_id|7e98ceba-ffefa477-359f502a-20a30ca_0
2025-10-02T08:16:07.541995Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:07.542002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2597 sessionId: src_id|7e98ceba-ffefa477-359f502a-20a30ca_0 is DEAD
2025-10-02T08:16:07.542134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e98ceba-ffefa477-359f502a-20a30ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:07.542146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e98ceba-ffefa477-359f502a-20a30ca_0] Write session will restart in 0.006138s
2025-10-02T08:16:07.542170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e98ceba-ffefa477-359f502a-20a30ca_0] Write session: Do CDS request
2025-10-02T08:16:07.542177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e98ceba-ffefa477-359f502a-20a30ca_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:07.542181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535255476821307:8443]
2025-10-02T08:16:07.549281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e98ceba-ffefa477-359f502a-20a30ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.549311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:07.549328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2598
2025-10-02T08:16:07.549467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.549498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:07.549508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:07.549511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:07.549946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2598 sessionId:  describe result for acl check
2025-10-02T08:16:07.549982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:07.549988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:07.549990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:07.549995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535255476821578:3840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:07.550530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535255476821578:3840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:07.554117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535255476821578:3840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:07.554738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:07.555679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:07.555842Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:07.555852Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:07.555862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:07.555906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:07.555943Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535255476821725:3843]
2025-10-02T08:16:07.556425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:07.556576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:07.556605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:07.556849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:07.556892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.556898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.556899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.556900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.556902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.556906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.556915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.556919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.556923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.556926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.556931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.556942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.556952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.556956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.556965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.556970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.556974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.556979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.556983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.556992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.557012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:07.557255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535255476821578:3840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:07.557268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535255476821578:3840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:07.557270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535255476821578:3840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:07.557276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:07.564914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:07.566545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:07.566560Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:07.566562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:07.566564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:07.566568Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2597 [1:7556535255476821725:3843]
2025-10-02T08:16:07.566577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:07.566590Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:07.566592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.566594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.566595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.566607Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:07.566610Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:07.566615Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:07.566666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.566672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.566675Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:07.566676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:07.566725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:07.566731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.566740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.566750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:07.566762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535255476821715:3843]
2025-10-02T08:16:07.566766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535255476821715:3843]
2025-10-02T08:16:07.566776Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:07.566788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:07.566800Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:07.566805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:07.566825Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:07.566831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535255476821715:3843]
2025-10-02T08:16:07.566833Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:07.566839Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:07.566843Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:07.566888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2597
2025-10-02T08:16:07.566899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476821742:3840], now have 1 active actors on pipe
2025-10-02T08:16:07.566939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.566945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.566964Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a001794-54159af0-28aff147-be4f08e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:07.566971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.566974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.566975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:07.566982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.566989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:07.567002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535255936160258:2378], now have 1 active actors on pipe
2025-10-02T08:16:07.567013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.567109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.567115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.567123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.567151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2598 partition: 0 MaxSeqNo: 17 sessionId: src_id|a001794-54159af0-28aff147-be4f08e9_0
2025-10-02T08:16:07.567160Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2597
2025-10-02T08:16:07.567447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e98ceba-ffefa477-359f502a-20a30ca_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a001794-54159af0-28aff147-be4f08e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:07.570066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a001794-54159af0-28aff147-be4f08e9_0] Write session: try to update token
2025-10-02T08:16:07.570080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a001794-54159af0-28aff147-be4f08e9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:07.584993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId: src_id|a001794-54159af0-28aff147-be4f08e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:07.585634Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:07.585651Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:07.585653Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:07.585661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535255476821715:3843]
2025-10-02T08:16:07.585666Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535255476821715:3843]
2025-10-02T08:16:07.585705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:07.585709Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:07.585715Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:07.585717Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.585719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:07.585856Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:07.587623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:07.642427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535255476821757:8443]
2025-10-02T08:16:07.642572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2597, pipe: [1:7556535255476821757:8443]
2025-10-02T08:16:07.724480Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:07.724766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.724776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.724828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476821757:8443], now have 1 active actors on pipe
2025-10-02T08:16:07.724950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:07.724962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:07.725032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2598 reason: error at write: Disconnected sessionId: src_id|a001794-54159af0-28aff147-be4f08e9_0
2025-10-02T08:16:07.725084Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:07.725171Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:07.725192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2598 sessionId: src_id|a001794-54159af0-28aff147-be4f08e9_0 is DEAD
2025-10-02T08:16:07.725317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a001794-54159af0-28aff147-be4f08e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:07.725326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a001794-54159af0-28aff147-be4f08e9_0] Write session will restart in 0.005814s
2025-10-02T08:16:07.725343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a001794-54159af0-28aff147-be4f08e9_0] Write session: Do CDS request
2025-10-02T08:16:07.725348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a001794-54159af0-28aff147-be4f08e9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:07.725369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535255476821757:8443]
2025-10-02T08:16:07.732326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a001794-54159af0-28aff147-be4f08e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.732357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:07.732374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2599
2025-10-02T08:16:07.732533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.732573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:07.732593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:07.732597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:07.732985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2599 sessionId:  describe result for acl check
2025-10-02T08:16:07.733024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:07.733032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:07.733034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:07.733042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535255476821998:3874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:07.733563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535255476821998:3874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:07.736332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535255476821998:3874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:07.739444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:07.740602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:07.740789Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:07.740817Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:07.740828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:07.740887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:07.740933Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535255476822176:3870]
2025-10-02T08:16:07.741079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535255476821998:3874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:07.741093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535255476821998:3874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:07.741098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535255476821998:3874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:07.741111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:07.741584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:07.741797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:07.741850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:07.742157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:07.742214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.742220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.742222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.742223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.742224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.742229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.742241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.742245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.742248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.742252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.742259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.742272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.742278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.742283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.742287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.742291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.742295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.742300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.742305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.742311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.742328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:07.750592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:07.752283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:07.752301Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:07.752303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:07.752308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:07.752315Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2598 [1:7556535255476822176:3870]
2025-10-02T08:16:07.752327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:07.752344Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:07.752347Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.752351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.752353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.752367Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:07.752372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:07.752378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:07.752448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.752456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.752459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:07.752461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:07.752526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:07.752534Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.752548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.752564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:07.752588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476822181:3874], now have 1 active actors on pipe
2025-10-02T08:16:07.752596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535255936160265:2378], now have 1 active actors on pipe
2025-10-02T08:16:07.752598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2598
2025-10-02T08:16:07.752603Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535255476822170:3870]
2025-10-02T08:16:07.752605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535255476822170:3870]
2025-10-02T08:16:07.752617Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:07.752635Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:07.752648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:07.752653Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:07.752656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:07.752657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:07.752664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.752668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.752709Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535255476822170:3870]
2025-10-02T08:16:07.752717Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:07.752726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:07.752696Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2598
2025-10-02T08:16:07.752734Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:07.752740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.752744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.752748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:07.752757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.752765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:07.752832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.752923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.752939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.752962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.753009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2599 partition: 0 MaxSeqNo: 17 sessionId: src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0
2025-10-02T08:16:07.753338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a001794-54159af0-28aff147-be4f08e9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:07.755868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0] Write session: try to update token
2025-10-02T08:16:07.755885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:07.763830Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:07.763853Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:07.763862Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535255476822170:3870]
2025-10-02T08:16:07.763901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:07.763904Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:07.764094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:07.764238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:07.764376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:07.764517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:07.764705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:07.764743Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:07.768938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId: src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:07.771499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:07.771572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.771585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.771618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:07.771641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:07.771699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.771719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.771891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.771960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.772036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.772120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.772339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.772352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.772426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.772488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.772556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.772630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.772675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.772685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.772755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.772863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.772931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.772999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.773045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.773053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.773121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.773190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.773260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.773331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.773381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.773389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.773462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.773532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.773601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.773668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.773809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.773818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.773887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.773950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.774020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.774090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.774136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.774146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.774216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.774282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.774353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.774422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.774470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.774477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.774545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.774610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.774679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.774747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.774795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.774803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.774874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.774940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.775009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.775078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.775142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.775151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.775222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.775288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.775357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.775421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.775470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.775478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.775528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:07.775597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.775621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.775628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:07.775663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:07.775681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:07.775691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:07.775695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:07.775699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:07.776142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:07.776173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:07.776180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:07.776184Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:07.776187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:07.776190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:07.776950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:07.776978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:07.776985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:07.776988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:07.776992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:07.776995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:07.777529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:07.777556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:07.777562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:07.777566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:07.777570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:07.778931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:07.778957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:07.778969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392967778
2025-10-02T08:16:07.779185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:07.779207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:07.779214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:07.779217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:07.779221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:07.779224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:07.779754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:07.779769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:07.779775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:07.779779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:07.779782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:07.779789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:07.780289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:07.780301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:07.780310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:07.780313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:07.780317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:07.780320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:07.780922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:07.780946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:07.780951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:07.782121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:07.782147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:07.782155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:07.782161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:07.782169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392967781
2025-10-02T08:16:07.782485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:07.782510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:07.782523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:07.782533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:07.782536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:07.782539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:07.783014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:07.783037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:07.783043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:07.783046Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:07.783050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:07.783054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:07.783516Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:07.783539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.783647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392967783
2025-10-02T08:16:07.784447Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:07.784469Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:07.784482Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:07.784495Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:07.786230Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:07.786248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:07.786250Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:07.786262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535255476822170:3870]
2025-10-02T08:16:07.786276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535255476822170:3870]
2025-10-02T08:16:07.786325Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:07.786329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:07.786334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.786336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:07.786337Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:07.786468Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:07.825736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535255476822215:8443]
2025-10-02T08:16:07.825872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2598, pipe: [1:7556535255476822215:8443]
2025-10-02T08:16:07.937002Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:07.937387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476822215:8443], now have 1 active actors on pipe
2025-10-02T08:16:07.937532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535255476822215:8443]
2025-10-02T08:16:07.937552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:07.937554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:07.937578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2599 reason: error at write: Disconnected sessionId: src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0
2025-10-02T08:16:07.937637Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:07.937666Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:07.937793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2599 sessionId: src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0 is DEAD
2025-10-02T08:16:07.937937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:07.937948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0] Write session will restart in 0.009646s
2025-10-02T08:16:07.937970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0] Write session: Do CDS request
2025-10-02T08:16:07.937976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:07.948310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.948364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:07.948379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2600
2025-10-02T08:16:07.948531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:07.948559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:07.948568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:07.948572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:07.948916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2600 sessionId:  describe result for acl check
2025-10-02T08:16:07.948947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:07.948952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:07.948954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:07.948959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535255476822602:3981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:07.949326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535255476822602:3981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:07.950466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:07.951242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535255476822602:3981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:07.951378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:07.951700Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:07.951712Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:07.951722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:07.951776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:07.951813Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535255476822646:3916]
2025-10-02T08:16:07.952461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:07.952666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:07.952709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:07.953019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:07.953066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.953072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.953073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.953075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.953076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.953081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.953091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.953095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.953105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.953109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.953114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.953121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:07.953126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.953135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:07.953139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.953150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:07.953154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.953163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.953168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.953173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.953192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:07.954023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535255476822602:3981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:07.954035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535255476822602:3981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:07.954038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535255476822602:3981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:07.954045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:07.961141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:07.962727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:07.962744Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:07.962746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:07.962748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:07.962753Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2599 [1:7556535255476822646:3916]
2025-10-02T08:16:07.962760Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:07.962775Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:07.962777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.962779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.962780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.962792Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:07.962795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:07.962803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:07.962865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.962873Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.962876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:07.962880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:07.962955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:07.962962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.962971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:07.962982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:07.963004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535255476822665:3981], now have 1 active actors on pipe
2025-10-02T08:16:07.963005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2599
2025-10-02T08:16:07.963014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535255476822630:3916]
2025-10-02T08:16:07.963016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535255476822630:3916]
2025-10-02T08:16:07.963028Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:07.963036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535255936160286:2378], now have 1 active actors on pipe
2025-10-02T08:16:07.963042Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:07.963045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:07.963048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.963051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.963066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:07.963084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:07.963091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:07.963096Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2599
2025-10-02T08:16:07.963130Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cddb967-643670b8-76f8aeea-bf23081_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:07.963139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.963143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.963145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:07.963153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.963161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:07.963168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535255476822630:3916]
2025-10-02T08:16:07.963181Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:07.963201Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:07.963212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.963285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.963291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.963303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:07.963341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2600 partition: 0 MaxSeqNo: 17 sessionId: src_id|5cddb967-643670b8-76f8aeea-bf23081_0
2025-10-02T08:16:07.963671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dd5a881-2a61dd82-2701cf2d-681085cf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5cddb967-643670b8-76f8aeea-bf23081_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:07.966094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cddb967-643670b8-76f8aeea-bf23081_0] Write session: try to update token
2025-10-02T08:16:07.966109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cddb967-643670b8-76f8aeea-bf23081_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:07.973952Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:07.973975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:07.973984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535255476822630:3916]
2025-10-02T08:16:07.974027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:07.974032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:07.974325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:07.974557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:07.974787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:07.974996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:07.975205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:07.975254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:07.980141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId: src_id|5cddb967-643670b8-76f8aeea-bf23081_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:07.982872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:07.982945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.982958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.982995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:07.983017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:07.983081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:07.983099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:07.983285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.983350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.983418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.983499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.983664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.983678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.983749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.983809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.983874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.983945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.983993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.984001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.984070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.984188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.984255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.984317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.984366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.984374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.984447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.984510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.984580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.984650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.984699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.984707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.984777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.984861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.984925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.984991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.985061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.985069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.985136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.985201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.985269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.985349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.985403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.985418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.985490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.985556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.985624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.985692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.985748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.985757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.985828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.985892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.985958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.986025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.986073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.986080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.986149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.986214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.986281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.986345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.986392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.986401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.986469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:07.986536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:07.986601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:07.986663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:07.986710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:07.986718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:07.986757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:07.986823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:07.986846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:07.986866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:07.986901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:07.986918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:07.986926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:07.986930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:07.986933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:07.987340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:07.987373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:07.987386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:07.987390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:07.987397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:07.987401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:07.987992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:07.988023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:07.988037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:07.988044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:07.988049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:07.988052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:07.988659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:07.988686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:07.988696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:07.988704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:07.988709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:07.989997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:07.990020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:07.990032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392967989
2025-10-02T08:16:07.990188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:07.990209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:07.990216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:07.990219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:07.990223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:07.990227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:07.990697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:07.990727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:07.990733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:07.990742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:07.990747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:07.990755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:07.991290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:07.991318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:07.991333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:07.991339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:07.991343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:07.991351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:07.991834Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:07.991862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:07.991872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:07.993064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:07.993087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:07.993094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:07.993098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:07.993107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392967993
2025-10-02T08:16:07.993404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:07.993432Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:07.993443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:07.993449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:07.993453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:07.993456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:07.993925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:07.993954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:07.993965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:07.993969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:07.993972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:07.993975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:07.994437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:07.994464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:07.994559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392967994
2025-10-02T08:16:07.995315Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:07.995335Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:07.995342Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:07.995349Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:07.996973Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:07.996988Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:07.996989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:07.997001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535255476822630:3916]
2025-10-02T08:16:07.997008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535255476822630:3916]
2025-10-02T08:16:07.997055Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:07.997064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:07.997067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:07.997068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:07.997070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:07.997201Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:08.037725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535259771789983:8443]
2025-10-02T08:16:08.037848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2599, pipe: [1:7556535259771789983:8443]
2025-10-02T08:16:08.139353Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:08.139774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771789983:8443], now have 1 active actors on pipe
2025-10-02T08:16:08.139985Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:08.140054Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:08.140704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cddb967-643670b8-76f8aeea-bf23081_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:08.140713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cddb967-643670b8-76f8aeea-bf23081_0] Write session will restart in 0.007283s
2025-10-02T08:16:08.140736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cddb967-643670b8-76f8aeea-bf23081_0] Write session: Do CDS request
2025-10-02T08:16:08.140742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cddb967-643670b8-76f8aeea-bf23081_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:08.140325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535259771789983:8443]
2025-10-02T08:16:08.140350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:08.140372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2600 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5cddb967-643670b8-76f8aeea-bf23081_0
2025-10-02T08:16:08.140544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2600 sessionId: src_id|5cddb967-643670b8-76f8aeea-bf23081_0 is DEAD
2025-10-02T08:16:08.149211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cddb967-643670b8-76f8aeea-bf23081_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.149336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:08.149365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2601
2025-10-02T08:16:08.149478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.149509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:08.149518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:08.149523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:08.149948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2601 sessionId:  describe result for acl check
2025-10-02T08:16:08.149986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:08.149990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:08.149992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:08.149996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535259771790183:4001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:08.150700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535259771790183:4001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:08.153091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535259771790183:4001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:08.156341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535259771790183:4001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:08.156356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535259771790183:4001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:08.156358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535259771790183:4001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:08.156363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:08.156821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:08.158219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:08.158352Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:08.158359Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:08.158365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:08.158394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:08.158419Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535259771790441:3983]
2025-10-02T08:16:08.158819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:08.158966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:08.158998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:08.159184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:08.159210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.159211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.159211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.159212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.159213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.159216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.159221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.159223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.159225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.159227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.159230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.159234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.159238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.159240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.159242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.159245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.159247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.159250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.159252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.159255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.159264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:08.166682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:08.168367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:08.168383Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:08.168385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:08.168389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:08.168394Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2600 [1:7556535259771790441:3983]
2025-10-02T08:16:08.168403Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:08.168417Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:08.168425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.168428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.168430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.168444Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:08.168449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:08.168455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:08.168516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.168526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.168529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:08.168531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:08.168591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:08.168599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.168611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.168624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2600
2025-10-02T08:16:08.168627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:08.168646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771790427:4001], now have 1 active actors on pipe
2025-10-02T08:16:08.168654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535260231127602:2378], now have 1 active actors on pipe
2025-10-02T08:16:08.168658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.168662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.168678Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535259771790435:3983]
2025-10-02T08:16:08.168685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535259771790435:3983]
2025-10-02T08:16:08.168696Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:08.168714Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:08.168714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:08.168717Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:08.168731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:08.168739Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:08.168728Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2600
2025-10-02T08:16:08.168753Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:08.168765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.168773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.168775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:08.168783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.168796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:08.168849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535259771790435:3983]
2025-10-02T08:16:08.168862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:08.168875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:08.168883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.168922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.168930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.168945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.168978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2601 partition: 0 MaxSeqNo: 17 sessionId: src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0
2025-10-02T08:16:08.169222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cddb967-643670b8-76f8aeea-bf23081_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:08.171504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0] Write session: try to update token
2025-10-02T08:16:08.171516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:08.178832Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:08.178850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:08.178860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535259771790435:3983]
2025-10-02T08:16:08.178892Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:08.178900Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:08.179073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:08.179231Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:08.179378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:08.179505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:08.179700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:08.179749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:08.184415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId: src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:08.186845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:08.186908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.186920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.186954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:08.186980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:08.187030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.187043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.187186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.187240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.187294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.187352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.187392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.187400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.187460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.187521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.187577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.187636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.187679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.187687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.187747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.187799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.187852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.187908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.187948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.187953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.188018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.188072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.188139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.188204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.188247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.188257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.188318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.188372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.188438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.188511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.188621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.188629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.188697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.188758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.188846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.188914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.188957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.188965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.189034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.189095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.189157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.189218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.189265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.189273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.189338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.189402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.189467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.189529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.189576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.189583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.189648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.189711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.189772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.189837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.189889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.189897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.189963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.190023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.190085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.190148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.190194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.190201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.190237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:08.190305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.190328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.190334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:08.190364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:08.190381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:08.190386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:08.190389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:08.190392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:08.190767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:08.190796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:08.190807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:08.190811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:08.190815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:08.190819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:08.191440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:08.191464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:08.191474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:08.191483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:08.191486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:08.191489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:08.192128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:08.192149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:08.192155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:08.192164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:08.192167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:08.193393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:08.193411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:08.193422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392968193
2025-10-02T08:16:08.193625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:08.193640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:08.193654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:08.193662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:08.193665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:08.193669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:08.194181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:08.194200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:08.194204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:08.194210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:08.194212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:08.194214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:08.194625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:08.194640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:08.194644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:08.194646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:08.194650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:08.194652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:08.195058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:08.195074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:08.195078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:08.196090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:08.196105Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:08.196108Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:08.196111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:08.196117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392968195
2025-10-02T08:16:08.196399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:08.196416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:08.196420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:08.196423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:08.196427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:08.196429Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:08.196887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:08.196907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:08.196914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:08.196917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:08.196920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:08.196926Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:08.197381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:08.197403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.197487Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392968197
2025-10-02T08:16:08.198230Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:08.198267Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:08.198278Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:08.198288Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:08.199816Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:08.199828Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:08.199829Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:08.199836Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535259771790435:3983]
2025-10-02T08:16:08.199839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535259771790435:3983]
2025-10-02T08:16:08.199885Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:08.199896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:08.199899Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:08.199900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.199904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:08.200029Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:08.240460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535259771790479:8443]
2025-10-02T08:16:08.240617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2600, pipe: [1:7556535259771790479:8443]
2025-10-02T08:16:08.333837Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:08.334490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:08.334867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:08.334877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0] Write session will restart in 0.007663s
2025-10-02T08:16:08.334907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0] Write session: Do CDS request
2025-10-02T08:16:08.334914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:08.334187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771790479:8443], now have 1 active actors on pipe
2025-10-02T08:16:08.334324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:08.334327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:08.334354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2601 reason: error at write: Disconnected sessionId: src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0
2025-10-02T08:16:08.334435Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:08.334512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2601 sessionId: src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0 is DEAD
2025-10-02T08:16:08.334637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535259771790479:8443]
2025-10-02T08:16:08.343296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.343370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:08.343386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2602
2025-10-02T08:16:08.343997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.344030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:08.344037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:08.344041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:08.344459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2602 sessionId:  describe result for acl check
2025-10-02T08:16:08.344504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:08.344512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:08.344514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:08.344521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535259771790518:4029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:08.345021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535259771790518:4029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:08.348734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535259771790518:4029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:08.357556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535259771790518:4029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:08.357576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535259771790518:4029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:08.357580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535259771790518:4029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:08.357588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:08.363629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:08.365423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:08.365597Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:08.365600Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:08.365607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:08.365645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:08.365676Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535259771790908:4022]
2025-10-02T08:16:08.366327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:08.366596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:08.366635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:08.366927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:08.366957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.366958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.366959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.366960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.366961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.366966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.366977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.366981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.366984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.366987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.366993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.366999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.367004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.367009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.367013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.367017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.367023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.367027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.367032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.367037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.367054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:08.376168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:08.377916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:08.377939Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:08.377941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:08.377945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:08.377951Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2601 [1:7556535259771790908:4022]
2025-10-02T08:16:08.377964Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:08.377981Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:08.377984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.377987Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.377989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.378005Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:08.378010Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:08.378016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:08.378082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.378091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.378095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:08.378097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:08.378164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:08.378167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.378180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.378191Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:08.378208Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535259771790902:4022]
2025-10-02T08:16:08.378210Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535259771790902:4022]
2025-10-02T08:16:08.378217Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:08.378229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:08.378242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:08.378245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:08.378248Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:08.378252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:08.378282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771790800:4029], now have 1 active actors on pipe
2025-10-02T08:16:08.378285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535259771790902:4022]
2025-10-02T08:16:08.378307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:08.378310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2601
2025-10-02T08:16:08.378375Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:08.378383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535260231127621:2378], now have 1 active actors on pipe
2025-10-02T08:16:08.378400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.378404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.378439Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:08.378451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.378455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.378457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:08.378466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.378475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:08.378493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.378574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.378583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.378609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.378652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2602 partition: 0 MaxSeqNo: 17 sessionId: src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0
2025-10-02T08:16:08.379649Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2601
2025-10-02T08:16:08.381037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2add5581-d42f3dc7-a3d1eca8-c924046c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:08.383595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0] Write session: try to update token
2025-10-02T08:16:08.383613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:08.398446Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:08.398465Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:08.398468Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:08.398476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535259771790902:4022]
2025-10-02T08:16:08.398481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535259771790902:4022]
2025-10-02T08:16:08.398525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:08.398532Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.398536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:08.398547Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:08.398564Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:08.398678Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:08.408837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId: src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:08.411471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:08.430946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535259771790932:8443]
2025-10-02T08:16:08.431102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2601, pipe: [1:7556535259771790932:8443]
2025-10-02T08:16:08.546709Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:08.547302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.547318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.547341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771790932:8443], now have 1 active actors on pipe
2025-10-02T08:16:08.547444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:08.547450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:08.547503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2602 reason: error at write: Disconnected sessionId: src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0
2025-10-02T08:16:08.547672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2602 sessionId: src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0 is DEAD
2025-10-02T08:16:08.547662Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:08.547880Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:08.548201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535259771790932:8443]
2025-10-02T08:16:08.548224Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:16:08.548318Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 26 consumer shared/user session shared/user_1_26_14464304724296252518_v1 is DEAD
2025-10-02T08:16:08.548476Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535182462346263:8439] disconnected; active server actors: 1
2025-10-02T08:16:08.548489Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535182462346263:8439] client user disconnected session shared/user_1_26_14464304724296252518_v1
2025-10-02T08:16:08.548638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:08.548647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0] Write session will restart in 0.008594s
2025-10-02T08:16:08.548671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0] Write session: Do CDS request
2025-10-02T08:16:08.548668Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:16:08.548679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:08.548745Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:16:08.548750Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:16:08.548763Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.008837s
2025-10-02T08:16:08.558240Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:16:08.558319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.558376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:08.558393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2603
2025-10-02T08:16:08.558467Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:16:08.558475Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 27
2025-10-02T08:16:08.558549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.558579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:08.558589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:08.558592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:08.558616Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 27 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:16:08.558651Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:16:08.558778Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 auth for : user
2025-10-02T08:16:08.559048Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 Handle describe topics response
2025-10-02T08:16:08.559077Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 auth is DEAD
2025-10-02T08:16:08.559137Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:16:08.559232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2603 sessionId:  describe result for acl check
2025-10-02T08:16:08.559261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:08.559267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:08.559268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:08.559273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535259771791212:4051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:08.559402Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:16:08.559486Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_27_10828998273474951301_v1
2025-10-02T08:16:08.559496Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:16:08.559564Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:16:08.559633Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:16:08.559703Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 got read request: guid# e9ce39b-1ca762a1-f81c568f-b55bc66f
2025-10-02T08:16:08.559787Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535259771791220:4050] connected; active server actors: 1
2025-10-02T08:16:08.559888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535259771791212:4051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:08.560540Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556535259771791220:4050] session shared/user_1_27_10828998273474951301_v1
2025-10-02T08:16:08.560554Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:16:08.560562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:16:08.560568Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_27_10828998273474951301_v1" (Sender=[1:7556535259771791207:4050], Pipe=[1:7556535259771791220:4050], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:16:08.560571Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:16:08.560582Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:16:08.560595Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_27_10828998273474951301_v1" (Sender=[1:7556535259771791207:4050], Pipe=[1:7556535259771791220:4050], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:16:08.560609Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_27_10828998273474951301_v1" sender [1:7556535259771791207:4050] lock partition 0 for ReadingSession "shared/user_1_27_10828998273474951301_v1" (Sender=[1:7556535259771791207:4050], Pipe=[1:7556535259771791220:4050], Partitions=[], ActiveFamilyCount=1) generation 1 step 27
2025-10-02T08:16:08.560627Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:16:08.560631Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-10-02T08:16:08.561102Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 27 Session: "shared/user_1_27_10828998273474951301_v1" ClientId: "user" PipeClient { RawX1: 7556535259771791220 RawX2: 4503603922341842 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:16:08.561126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:16:08.563900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535259771791212:4051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:08.568060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:08.568530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535259771791212:4051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:08.568543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535259771791212:4051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:08.568547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535259771791212:4051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:08.568555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:08.569816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:08.569989Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:08.569997Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:08.570005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:08.570042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:08.570084Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535259771791372:4053]
2025-10-02T08:16:08.570666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:08.570881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:08.570925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:08.571225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:08.571262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.571269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.571270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.571272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.571273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.571277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.571287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.571290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.571293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.571295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.571298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.571303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.571306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.571309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.571311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.571314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.571317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.571320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.571322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.571325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.571339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:08.579583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:08.581529Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2602
2025-10-02T08:16:08.581095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:08.581115Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:08.581118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:08.581122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:08.581129Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2602 [1:7556535259771791372:4053]
2025-10-02T08:16:08.581138Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:08.581152Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:08.581154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.581156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.581157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.581176Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:08.581181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:08.581188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:08.581245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.581247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.581250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:08.581253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:08.581310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:08.581313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.581327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.581340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:08.581356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535259771791361:4053]
2025-10-02T08:16:08.581357Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535259771791361:4053]
2025-10-02T08:16:08.581363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:08.581378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771791262:4064], now have 1 active actors on pipe
2025-10-02T08:16:08.581384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:08.581389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:08.581393Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:08.581393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2602
2025-10-02T08:16:08.581399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:08.581401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:08.581407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771791369:4051], now have 1 active actors on pipe
2025-10-02T08:16:08.581409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2602, pipe: [1:7556535259771791262:4064]
2025-10-02T08:16:08.581438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535260231127628:2378], now have 1 active actors on pipe
2025-10-02T08:16:08.581442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.581447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.581457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535259771791361:4053]
2025-10-02T08:16:08.581464Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:08.581468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.581470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.581475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_27_10828998273474951301_v1 on pipe: [1:7556535259771791262:4064]
2025-10-02T08:16:08.581475Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:08.581494Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_27_10828998273474951301_v1:1 with generation 2602
2025-10-02T08:16:08.581500Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:08.581504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.581506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.581508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:08.581515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.581521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:08.581718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.581721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.581722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:08.581731Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_27_10828998273474951301_v1
2025-10-02T08:16:08.581733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.581754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.581778Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:08.581796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.581798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.581886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.581923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2603 partition: 0 MaxSeqNo: 17 sessionId: src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0
2025-10-02T08:16:08.582996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|848828bf-ab79fc58-552cb07c-8e9568d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:08.585697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0] Write session: try to update token
2025-10-02T08:16:08.585713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:08.586668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:16:08.586706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:16:08.586716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.586719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.586722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.586732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:16:08.586746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:16:08.586806Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392968580 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:16:08.586816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:16:08.586846Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 sending to client partition status
2025-10-02T08:16:08.598683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId: src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:08.598756Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:08.598776Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:08.598778Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:08.598786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535259771791361:4053]
2025-10-02T08:16:08.598795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535259771791361:4053]
2025-10-02T08:16:08.598834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:08.598851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.598853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:08.598926Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:08.598940Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:08.598991Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:08.601276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:08.745520Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:08.745815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.745828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.745989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:08.746002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:08.746060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2603 reason: error at write: Disconnected sessionId: src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0
2025-10-02T08:16:08.746066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_27_10828998273474951301_v1
2025-10-02T08:16:08.746072Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:08.746150Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:08.746234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2603 sessionId: src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0 is DEAD
2025-10-02T08:16:08.746344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535259771791262:4064]
2025-10-02T08:16:08.746367Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_27_10828998273474951301_v1
2025-10-02T08:16:08.746433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:08.746452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0] Write session will restart in 0.008468s
2025-10-02T08:16:08.746481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0] Write session: Do CDS request
2025-10-02T08:16:08.746488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:08.756251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.756310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:08.756334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2604
2025-10-02T08:16:08.756456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.756491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:08.756500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:08.756505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:08.756928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2604 sessionId:  describe result for acl check
2025-10-02T08:16:08.756962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:08.756968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:08.756970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:08.756974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535259771791609:4065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:08.757469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535259771791609:4065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:08.760302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535259771791609:4065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:08.763473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535259771791609:4065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:08.763486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535259771791609:4065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:08.763490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535259771791609:4065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:08.763498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:08.766131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:08.766486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:08.766664Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:08.766678Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:08.766689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:08.766756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:08.766791Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535259771791834:4058]
2025-10-02T08:16:08.767379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:08.767554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:08.767596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:08.767884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:08.767953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.767959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.767960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.767961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.767962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.767967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.767976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.767980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.767984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.767987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.767993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.768000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.768010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.768015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.768020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.768024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.768029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.768033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.768038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.768042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.768060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:08.775938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:08.777608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:08.777626Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:08.777628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:08.777631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:08.777638Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2603 [1:7556535259771791834:4058]
2025-10-02T08:16:08.777650Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:08.777665Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:08.777668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.777671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.777673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.777689Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:08.777694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:08.777700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:08.777761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.777770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.777773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:08.777775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:08.777850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:08.777858Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.777872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.777886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2603
2025-10-02T08:16:08.777888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:08.777907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771791813:4065], now have 1 active actors on pipe
2025-10-02T08:16:08.777915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535260231127635:2378], now have 1 active actors on pipe
2025-10-02T08:16:08.777920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.777923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.777939Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535259771791828:4058]
2025-10-02T08:16:08.777947Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535259771791828:4058]
2025-10-02T08:16:08.777961Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:08.777978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:08.777995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:08.778002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:08.778005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:08.778008Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:08.777988Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2603
2025-10-02T08:16:08.778017Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f200360b-730a7648-23d73b51-e85d6838_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:08.778027Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.778032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.778033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:08.778045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.778054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:08.778091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535259771791828:4058]
2025-10-02T08:16:08.778104Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:08.778117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:08.778125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.778288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.778299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.778314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.778348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2604 partition: 0 MaxSeqNo: 17 sessionId: src_id|f200360b-730a7648-23d73b51-e85d6838_0
2025-10-02T08:16:08.778687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d45d870-9ebd96ad-e1f857bf-c6b8a626_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f200360b-730a7648-23d73b51-e85d6838_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:08.780968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f200360b-730a7648-23d73b51-e85d6838_0] Write session: try to update token
2025-10-02T08:16:08.780978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f200360b-730a7648-23d73b51-e85d6838_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:08.793313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId: src_id|f200360b-730a7648-23d73b51-e85d6838_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:08.795613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:08.795710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.795728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.795768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:08.795809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:08.795869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.795878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.796035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.796110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.796178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.796256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.796310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.796320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.796386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.796444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.796499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.796562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.796601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.796608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.796668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.796728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.796780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.796854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.796893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.796898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.796963Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.797023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.797085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.797143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.797188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.797196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.797262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.797336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.797413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.797484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.797526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.797533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.797599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.797656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.797720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.797782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.797828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.797835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.797915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.797992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.798055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.798117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.798159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.798165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.798228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.798289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.798349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.798410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.798451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.798458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.798519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.798574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.798639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.798699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.798809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.798816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.798881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:08.798937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:08.798995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:08.799058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:08.799162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:08.799168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:08.799205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:08.799268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.799290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.799296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:08.799325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:08.799340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:08.799347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:08.799350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:08.799353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:08.799721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:08.799746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:08.799752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:08.799757Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:08.799759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:08.799762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:08.800322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:08.800351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:08.800356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:08.800359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:08.800363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:08.800365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:08.800934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:08.800957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:08.800962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:08.800970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:08.800973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:08.808194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:08.808225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:08.808242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392968808
2025-10-02T08:16:08.808450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:08.808469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:08.808480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:08.808488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:08.808492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:08.808500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:08.809008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:08.809030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:08.809041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:08.809049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:08.809052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:08.809056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:08.809590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:08.809610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:08.809621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:08.809625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:08.809629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:08.809632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:08.810054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:08.810080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:08.810085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:08.811035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:08.811050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:08.811054Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:08.811056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:08.811062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392968810
2025-10-02T08:16:08.811327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:08.811345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:08.811349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:08.811353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:08.811355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:08.811357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:08.811775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:08.811792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:08.811796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:08.811798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:08.811802Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:08.811804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:08.812207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:08.812223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.812295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392968811
2025-10-02T08:16:08.812973Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:08.812988Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:08.812991Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:08.812996Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:08.818777Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:08.818794Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:08.818795Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:08.818801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535259771791828:4058]
2025-10-02T08:16:08.818805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535259771791828:4058]
2025-10-02T08:16:08.818842Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:08.818844Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:08.818848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535259771791828:4058]
2025-10-02T08:16:08.818848Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:08.818852Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:08.818858Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:08.818882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:08.818890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.818892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:08.819028Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:08.846677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535259771791868:4064]
2025-10-02T08:16:08.846775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2603, pipe: [1:7556535259771791868:4064]
2025-10-02T08:16:08.955749Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:08.956135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771791868:4064], now have 1 active actors on pipe
2025-10-02T08:16:08.956257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535259771791868:4064]
2025-10-02T08:16:08.956284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:08.956291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:08.956315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2604 reason: error at write: Disconnected sessionId: src_id|f200360b-730a7648-23d73b51-e85d6838_0
2025-10-02T08:16:08.956343Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:08.956327Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:08.956490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2604 sessionId: src_id|f200360b-730a7648-23d73b51-e85d6838_0 is DEAD
2025-10-02T08:16:08.956612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f200360b-730a7648-23d73b51-e85d6838_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:08.956621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f200360b-730a7648-23d73b51-e85d6838_0] Write session will restart in 0.007213s
2025-10-02T08:16:08.956642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f200360b-730a7648-23d73b51-e85d6838_0] Write session: Do CDS request
2025-10-02T08:16:08.956648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f200360b-730a7648-23d73b51-e85d6838_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:08.965194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f200360b-730a7648-23d73b51-e85d6838_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.965227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:08.965241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2605
2025-10-02T08:16:08.965382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:08.965413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:08.965420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:08.965423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:08.965830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2605 sessionId:  describe result for acl check
2025-10-02T08:16:08.965854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:08.965856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:08.965857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:08.965860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535259771792227:4122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:08.966218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535259771792227:4122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:08.968334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535259771792227:4122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:08.968374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:08.969406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:08.969587Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:08.969599Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:08.969611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:08.969675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:08.969701Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535259771792309:4113]
2025-10-02T08:16:08.970257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:08.970444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:08.970492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:08.970737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:08.970765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.970769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.970769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.970770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.970771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.970773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.970779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.970781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.970783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.970785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.970789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.970793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:08.970796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.970802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:08.970805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.970807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:08.970810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.970810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535259771792227:4122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:08.970815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535259771792227:4122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:08.970816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.970818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535259771792227:4122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:08.970820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.970822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.970824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:08.970832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:08.978473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:08.980176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:08.980193Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:08.980195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:08.980198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:08.980203Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2604 [1:7556535259771792309:4113]
2025-10-02T08:16:08.980213Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:08.980229Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:08.980231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.980233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.980235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.980250Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:08.980255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:08.980260Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:08.980314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.980322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.980325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:08.980328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:08.980383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:08.980390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.980401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:08.980414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:08.980433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535259771792293:4113]
2025-10-02T08:16:08.980438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535259771792293:4113]
2025-10-02T08:16:08.980445Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:08.980448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2604
2025-10-02T08:16:08.980457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535259771792323:4122], now have 1 active actors on pipe
2025-10-02T08:16:08.980468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:08.980471Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:08.980474Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:08.980483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:08.980490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:08.980495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535260231127656:2378], now have 1 active actors on pipe
2025-10-02T08:16:08.980521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.980532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.980545Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535259771792293:4113]
2025-10-02T08:16:08.980551Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:08.980553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2604
2025-10-02T08:16:08.980566Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:08.980573Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98463cd9-61f99132-6b266086-f6f4fa26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:08.980578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:08.980582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:08.980584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:08.980592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:08.980601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:08.980625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.980665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:08.980671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:08.980682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:08.980716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2605 partition: 0 MaxSeqNo: 17 sessionId: src_id|98463cd9-61f99132-6b266086-f6f4fa26_0
2025-10-02T08:16:08.981029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f200360b-730a7648-23d73b51-e85d6838_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|98463cd9-61f99132-6b266086-f6f4fa26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:08.983437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98463cd9-61f99132-6b266086-f6f4fa26_0] Write session: try to update token
2025-10-02T08:16:08.983451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98463cd9-61f99132-6b266086-f6f4fa26_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:08.997530Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:08.997552Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:08.997554Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:08.997563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535259771792293:4113]
2025-10-02T08:16:08.997567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535259771792293:4113]
2025-10-02T08:16:08.997609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:08.997610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:08.997614Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:08.997616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:08.997618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:08.997751Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:08.999043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId: src_id|98463cd9-61f99132-6b266086-f6f4fa26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:09.001793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:09.056600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535264066759636:4064]
2025-10-02T08:16:09.056686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2604, pipe: [1:7556535264066759636:4064]
2025-10-02T08:16:09.129899Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:09.130395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.130409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.130445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066759636:4064], now have 1 active actors on pipe
2025-10-02T08:16:09.130613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:09.130627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:09.130669Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:09.130689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2605 reason: error at write: Disconnected sessionId: src_id|98463cd9-61f99132-6b266086-f6f4fa26_0
2025-10-02T08:16:09.130740Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:09.130850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2605 sessionId: src_id|98463cd9-61f99132-6b266086-f6f4fa26_0 is DEAD
2025-10-02T08:16:09.130981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98463cd9-61f99132-6b266086-f6f4fa26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:09.130990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98463cd9-61f99132-6b266086-f6f4fa26_0] Write session will restart in 0.008668s
2025-10-02T08:16:09.131012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98463cd9-61f99132-6b266086-f6f4fa26_0] Write session: Do CDS request
2025-10-02T08:16:09.131019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98463cd9-61f99132-6b266086-f6f4fa26_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:09.130954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535264066759636:4064]
2025-10-02T08:16:09.141253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98463cd9-61f99132-6b266086-f6f4fa26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.141355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:09.141369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2606
2025-10-02T08:16:09.141493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.141541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:09.141551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:09.141554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:09.142029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2606 sessionId:  describe result for acl check
2025-10-02T08:16:09.142064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:09.142066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:09.142067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:09.142072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535264066760022:4153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:09.142541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535264066760022:4153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:09.143619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:09.144659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535264066760022:4153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:09.145345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:09.145511Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:09.145521Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:09.145530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:09.145578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:09.145612Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535264066760069:4131]
2025-10-02T08:16:09.146211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:09.146414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:09.146467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:09.146776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:09.146819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.146825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.146826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.146827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.146829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.146834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.146843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.146847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.146850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.146854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.146860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.146867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.146873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.146878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.146883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.146888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.146897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.146902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.146908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.146913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.146933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:09.149123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535264066760022:4153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:09.149137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535264066760022:4153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:09.149140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535264066760022:4153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:09.149148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:09.154800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:09.156288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:09.156309Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:09.156313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:09.156317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:09.156324Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2605 [1:7556535264066760069:4131]
2025-10-02T08:16:09.156335Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:09.156350Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:09.156353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.156356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.156358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.156373Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:09.156378Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:09.156385Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:09.156445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.156457Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.156460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:09.156463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:09.156523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:09.156531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.156545Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.156557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:09.156578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2605
2025-10-02T08:16:09.156581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066760086:4153], now have 1 active actors on pipe
2025-10-02T08:16:09.156584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535264526094959:2378], now have 1 active actors on pipe
2025-10-02T08:16:09.156591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535264066760047:4131]
2025-10-02T08:16:09.156594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535264066760047:4131]
2025-10-02T08:16:09.156608Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:09.156617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.156620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:09.156622Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:09.156627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.156646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:09.156666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:09.156674Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:09.156672Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2605
2025-10-02T08:16:09.156713Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:09.156724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.156728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.156730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:09.156738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.156747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:09.156754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535264066760047:4131]
2025-10-02T08:16:09.156762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:09.156768Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:09.156791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.156862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.156869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.156884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.156926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2606 partition: 0 MaxSeqNo: 17 sessionId: src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0
2025-10-02T08:16:09.157276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98463cd9-61f99132-6b266086-f6f4fa26_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:09.159896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0] Write session: try to update token
2025-10-02T08:16:09.159911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:09.173420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId: src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:09.176203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:09.178031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.178058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.178079Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:09.178082Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:09.178085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:09.178092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535264066760047:4131]
2025-10-02T08:16:09.178097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535264066760047:4131]
2025-10-02T08:16:09.178153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:09.178158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.178160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:09.178309Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:09.180932Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:09.180946Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:09.231199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535264066760136:4064]
2025-10-02T08:16:09.231296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2605, pipe: [1:7556535264066760136:4064]
2025-10-02T08:16:09.312291Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:09.312683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:09.312725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066760136:4064], now have 1 active actors on pipe
2025-10-02T08:16:09.312725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:09.312839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:09.312851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:09.312872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2606 reason: error at write: Disconnected sessionId: src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0
2025-10-02T08:16:09.313000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2606 sessionId: src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0 is DEAD
2025-10-02T08:16:09.313132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:09.313144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0] Write session will restart in 0.005973s
2025-10-02T08:16:09.313168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0] Write session: Do CDS request
2025-10-02T08:16:09.313175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:09.313194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535264066760136:4064]
2025-10-02T08:16:09.312973Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:09.320254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.320329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:09.320342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2607
2025-10-02T08:16:09.320458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.320491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:09.320501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:09.320504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:09.320911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2607 sessionId:  describe result for acl check
2025-10-02T08:16:09.320946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:09.320952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:09.320953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:09.320958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535264066760365:4259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:09.321439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535264066760365:4259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:09.323664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535264066760365:4259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:09.327160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535264066760365:4259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:09.327172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:09.327176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535264066760365:4259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:09.327177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535264066760365:4259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:09.327183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:09.328582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:09.328744Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:09.328751Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:09.328758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:09.328791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:09.328840Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535264066760575:4219]
2025-10-02T08:16:09.329389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:09.329556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:09.329585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:09.329772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:09.329797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.329803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.329804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.329805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.329806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.329810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.329820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.329824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.329827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.329830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.329834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.329840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.329845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.329851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.329859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.329863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.329866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.329875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.329878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.329883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.329902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:09.337997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:09.339548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:09.339566Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:09.339569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:09.339573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:09.339580Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2606 [1:7556535264066760575:4219]
2025-10-02T08:16:09.339592Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:09.339614Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:09.339625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.339628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.339630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.339649Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:09.339658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:09.339669Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:09.339736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.339746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.339749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:09.339752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:09.339880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2606
2025-10-02T08:16:09.339985Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2606
2025-10-02T08:16:09.340031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:09.340043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.340057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.340090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:09.340115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066760569:4259], now have 1 active actors on pipe
2025-10-02T08:16:09.340123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535264526094989:2378], now have 1 active actors on pipe
2025-10-02T08:16:09.340128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.340132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.340160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535264066760563:4219]
2025-10-02T08:16:09.340167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535264066760563:4219]
2025-10-02T08:16:09.340181Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:09.340191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:09.340194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:09.340200Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:09.340220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:09.340228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:09.340244Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25e63aa8-241109da-eb452c91-e4e578ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:09.340256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.340260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.340263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:09.340272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.340281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:09.340323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535264066760563:4219]
2025-10-02T08:16:09.340335Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:09.340339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:09.340354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.340400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.340407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.340422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.340463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2607 partition: 0 MaxSeqNo: 17 sessionId: src_id|25e63aa8-241109da-eb452c91-e4e578ce_0
2025-10-02T08:16:09.340764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1687b8cd-366dbf4d-4a0ae344-e285252b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|25e63aa8-241109da-eb452c91-e4e578ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:09.343225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e63aa8-241109da-eb452c91-e4e578ce_0] Write session: try to update token
2025-10-02T08:16:09.343239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e63aa8-241109da-eb452c91-e4e578ce_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:09.356434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId: src_id|25e63aa8-241109da-eb452c91-e4e578ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:09.357923Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:09.357946Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:09.357948Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:09.357958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535264066760563:4219]
2025-10-02T08:16:09.357963Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535264066760563:4219]
2025-10-02T08:16:09.358004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:09.358016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.358017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:09.358018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:09.358023Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:09.358151Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:09.358878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:09.413450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535264066760600:4064]
2025-10-02T08:16:09.413565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2606, pipe: [1:7556535264066760600:4064]
2025-10-02T08:16:09.496261Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:09.496580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.496590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.496631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066760600:4064], now have 1 active actors on pipe
2025-10-02T08:16:09.496745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535264066760600:4064]
2025-10-02T08:16:09.496768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:09.496773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:09.496839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2607 reason: error at write: Disconnected sessionId: src_id|25e63aa8-241109da-eb452c91-e4e578ce_0
2025-10-02T08:16:09.496855Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:09.496837Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:09.496967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2607 sessionId: src_id|25e63aa8-241109da-eb452c91-e4e578ce_0 is DEAD
2025-10-02T08:16:09.497108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e63aa8-241109da-eb452c91-e4e578ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:09.497115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e63aa8-241109da-eb452c91-e4e578ce_0] Write session will restart in 0.006748s
2025-10-02T08:16:09.497135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e63aa8-241109da-eb452c91-e4e578ce_0] Write session: Do CDS request
2025-10-02T08:16:09.497140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e63aa8-241109da-eb452c91-e4e578ce_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:09.505225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25e63aa8-241109da-eb452c91-e4e578ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.505273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:09.505290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2608
2025-10-02T08:16:09.505448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.505487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:09.505496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:09.505499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:09.505875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2608 sessionId:  describe result for acl check
2025-10-02T08:16:09.505900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:09.505905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:09.505906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:09.505911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535264066760915:4267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:09.506318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535264066760915:4267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:09.509439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535264066760915:4267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:09.509969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:09.511199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:09.511363Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:09.511372Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:09.511381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:09.511423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:09.511456Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535264066761037:4265]
2025-10-02T08:16:09.511928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535264066760915:4267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:09.511941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535264066760915:4267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:09.511943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535264066760915:4267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:09.511950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:09.512097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:09.512246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:09.512283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:09.512561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:09.512600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.512605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.512606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.512607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.512608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.512613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.512623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.512627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.512631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.512635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.512640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.512646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.512658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.512664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.512668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.512673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.512680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.512685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.512689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.512698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.512717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:09.520582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:09.522021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:09.522036Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:09.522039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:09.522043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:09.522049Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2607 [1:7556535264066761037:4265]
2025-10-02T08:16:09.522060Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:09.522078Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:09.522081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.522083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.522085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.522100Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:09.522111Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:09.522118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:09.522176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.522184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.522187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:09.522189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:09.522253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:09.522260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.522271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.522283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:09.522305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535264526094997:2378], now have 1 active actors on pipe
2025-10-02T08:16:09.522315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535264066761030:4265]
2025-10-02T08:16:09.522317Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535264066761030:4265]
2025-10-02T08:16:09.522325Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:09.522324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2607
2025-10-02T08:16:09.522334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:09.522336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066761042:4267], now have 1 active actors on pipe
2025-10-02T08:16:09.522337Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:09.522342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:09.522356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:09.522368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:09.522374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.522378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.522396Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2607
2025-10-02T08:16:09.522416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535264066761030:4265]
2025-10-02T08:16:09.522424Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:09.522426Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:09.522438Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65f677cc-6b628c08-aed99594-4b68391d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:09.522443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.522447Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.522449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:09.522457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.522470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:09.522513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.522574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.522590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.522603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.522638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2608 partition: 0 MaxSeqNo: 17 sessionId: src_id|65f677cc-6b628c08-aed99594-4b68391d_0
2025-10-02T08:16:09.522953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25e63aa8-241109da-eb452c91-e4e578ce_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|65f677cc-6b628c08-aed99594-4b68391d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:09.525373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f677cc-6b628c08-aed99594-4b68391d_0] Write session: try to update token
2025-10-02T08:16:09.525385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f677cc-6b628c08-aed99594-4b68391d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:09.538340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId: src_id|65f677cc-6b628c08-aed99594-4b68391d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:09.539438Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:09.539454Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:09.539457Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:09.539465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535264066761030:4265]
2025-10-02T08:16:09.539469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535264066761030:4265]
2025-10-02T08:16:09.539506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:09.539514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.539516Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:09.539551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:09.539565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:09.539636Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:09.540828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:09.596783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535264066761071:4064]
2025-10-02T08:16:09.596891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2607, pipe: [1:7556535264066761071:4064]
2025-10-02T08:16:09.670607Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:09.671084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.671097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.671129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066761071:4064], now have 1 active actors on pipe
2025-10-02T08:16:09.671211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:09.671221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:09.671272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2608 reason: error at write: Disconnected sessionId: src_id|65f677cc-6b628c08-aed99594-4b68391d_0
2025-10-02T08:16:09.671289Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:09.671359Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:09.671443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2608 sessionId: src_id|65f677cc-6b628c08-aed99594-4b68391d_0 is DEAD
2025-10-02T08:16:09.671560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f677cc-6b628c08-aed99594-4b68391d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:09.671570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f677cc-6b628c08-aed99594-4b68391d_0] Write session will restart in 0.008487s
2025-10-02T08:16:09.671554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535264066761071:4064]
2025-10-02T08:16:09.671591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f677cc-6b628c08-aed99594-4b68391d_0] Write session: Do CDS request
2025-10-02T08:16:09.671597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f677cc-6b628c08-aed99594-4b68391d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:09.681326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65f677cc-6b628c08-aed99594-4b68391d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.681634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:09.681652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2609
2025-10-02T08:16:09.681819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.681850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:09.681860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:09.681863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:09.682377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2609 sessionId:  describe result for acl check
2025-10-02T08:16:09.682407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:09.682409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:09.682411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:09.682416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535264066761434:4335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:09.682902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535264066761434:4335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:09.685402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:09.685458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535264066761434:4335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:09.686827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:09.687031Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:09.687040Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:09.687049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:09.687097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:09.687130Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535264066761510:4349]
2025-10-02T08:16:09.687766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:09.687930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:09.687968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:09.688118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535264066761434:4335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:09.688131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535264066761434:4335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:09.688135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535264066761434:4335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:09.688142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:09.688276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:09.688321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.688327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.688329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.688330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.688331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.688335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.688346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.688350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.688354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.688358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.688364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.688371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.688376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.688382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.688390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.688396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.688404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.688410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.688416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.688421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.688439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:09.696367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:09.698095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:09.698113Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:09.698116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:09.698120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:09.698125Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2608 [1:7556535264066761510:4349]
2025-10-02T08:16:09.698137Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:09.698151Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:09.698154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.698157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.698158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.698173Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:09.698177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:09.698183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:09.698241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.698249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.698252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:09.698255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:09.698645Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2608
2025-10-02T08:16:09.699107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65f677cc-6b628c08-aed99594-4b68391d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:09.698322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:09.698332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.698346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.698360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:09.698376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535264066761494:4349]
2025-10-02T08:16:09.698378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535264066761494:4349]
2025-10-02T08:16:09.698384Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:09.698397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2608
2025-10-02T08:16:09.698399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066761523:4335], now have 1 active actors on pipe
2025-10-02T08:16:09.698401Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:09.698404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:09.698406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:09.698420Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:09.698422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:09.698427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535264526095004:2378], now have 1 active actors on pipe
2025-10-02T08:16:09.698432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.698438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.698472Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535264066761494:4349]
2025-10-02T08:16:09.698475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:09.698489Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:09.698495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.698499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.698503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:09.698511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.698519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:09.698549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.698557Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:09.698703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.698706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.698723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.698755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2609 partition: 0 MaxSeqNo: 17 sessionId: src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0
2025-10-02T08:16:09.701607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0] Write session: try to update token
2025-10-02T08:16:09.701623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:09.716618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId: src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:09.719850Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:09.719878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:09.719881Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:09.719891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535264066761494:4349]
2025-10-02T08:16:09.719896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535264066761494:4349]
2025-10-02T08:16:09.719944Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:09.719948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:09.719957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.719958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:09.719959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:09.720175Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:09.720254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:09.771797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535264066761546:4064]
2025-10-02T08:16:09.771939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2608, pipe: [1:7556535264066761546:4064]
2025-10-02T08:16:09.855719Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:09.856063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.856086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.856121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066761546:4064], now have 1 active actors on pipe
2025-10-02T08:16:09.856334Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:09.856250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535264066761546:4064]
2025-10-02T08:16:09.856289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:09.856291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:09.856342Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:09.856349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2609 reason: error at write: Disconnected sessionId: src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0
2025-10-02T08:16:09.856515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2609 sessionId: src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0 is DEAD
2025-10-02T08:16:09.856981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:09.856989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0] Write session will restart in 0.005200s
2025-10-02T08:16:09.857009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0] Write session: Do CDS request
2025-10-02T08:16:09.857014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:09.865239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.865301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:09.865321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2610
2025-10-02T08:16:09.865427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:09.865459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:09.865465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:09.865468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:09.865900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2610 sessionId:  describe result for acl check
2025-10-02T08:16:09.865932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:09.865940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:09.865941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:09.865946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535264066761844:4388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:09.866434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535264066761844:4388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:09.869574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535264066761844:4388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:09.871835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:09.872103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535264066761844:4388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:09.872111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535264066761844:4388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:09.872114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535264066761844:4388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:09.872121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:09.873234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:09.873445Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:09.873456Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:09.873480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:09.873539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:09.873579Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535264066761993:4392]
2025-10-02T08:16:09.874228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:09.874446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:09.874489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:09.874794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:09.874840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.874846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.874847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.874848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.874849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.874855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.874865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.874869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.874873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.874875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.874880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.874891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:09.874898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.874902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:09.874906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.874910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:09.874914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.874917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.874921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.874926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.874946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:09.882769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:09.884499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:09.884518Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:09.884520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:09.884524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:09.884529Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2609 [1:7556535264066761993:4392]
2025-10-02T08:16:09.884541Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:09.884556Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:09.884560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.884563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.884565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.884580Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:09.884584Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:09.884591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:09.884652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.884662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.884666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:09.884669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:09.884733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:09.884741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.884755Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:09.884765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:09.884778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2609
2025-10-02T08:16:09.884784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066761987:4388], now have 1 active actors on pipe
2025-10-02T08:16:09.884787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535264526095012:2378], now have 1 active actors on pipe
2025-10-02T08:16:09.884792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535264066761981:4392]
2025-10-02T08:16:09.884795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535264066761981:4392]
2025-10-02T08:16:09.884826Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:09.884842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.884850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.884849Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:09.884853Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:09.884868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:09.884888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:09.884896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:09.884876Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2609
2025-10-02T08:16:09.884937Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:09.884947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:09.884955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:09.884957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:09.884965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:09.884979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:09.884987Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535264066761981:4392]
2025-10-02T08:16:09.885003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:09.885020Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:09.885037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.885108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.885116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.885133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:09.885192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2610 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0
2025-10-02T08:16:09.885494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f7c99-627881e0-19c382d1-6e56a6b6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:09.887984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0] Write session: try to update token
2025-10-02T08:16:09.887999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:09.903459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId: src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:09.906215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:09.907178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:09.907202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:09.907221Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:09.907224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:09.907226Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:09.907234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535264066761981:4392]
2025-10-02T08:16:09.907243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535264066761981:4392]
2025-10-02T08:16:09.907283Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:09.907292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:09.907296Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:09.907299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:09.907301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:09.907424Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:09.956161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535264066762031:4064]
2025-10-02T08:16:09.956281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2609, pipe: [1:7556535264066762031:4064]
2025-10-02T08:16:10.056404Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:10.056747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:10.056815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:10.056831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535264066762031:4064], now have 1 active actors on pipe
2025-10-02T08:16:10.056910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:10.056917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:10.056935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2610 reason: error at write: Disconnected sessionId: src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0
2025-10-02T08:16:10.057022Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:10.057060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2610 sessionId: src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0 is DEAD
2025-10-02T08:16:10.057217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:10.057226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0] Write session will restart in 0.008417s
2025-10-02T08:16:10.057214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535264066762031:4064]
2025-10-02T08:16:10.057256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0] Write session: Do CDS request
2025-10-02T08:16:10.057265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:10.067391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.067371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:10.067389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2611
2025-10-02T08:16:10.067584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.067620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:10.067632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:10.067636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:10.068139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2611 sessionId:  describe result for acl check
2025-10-02T08:16:10.068176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:10.068183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:10.068185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:10.068191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535268361729645:4429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:10.068728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535268361729645:4429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:10.071850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535268361729645:4429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:10.072818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:10.074251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:10.074528Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:10.074538Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:10.074549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:10.074606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:10.074643Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535268361729769:4425]
2025-10-02T08:16:10.074797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535268361729645:4429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:10.074809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535268361729645:4429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:10.074812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535268361729645:4429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:10.074820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:10.075092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:10.075294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:10.075349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:10.075642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:10.075693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.075699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.075700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.075700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.075702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.075706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.075715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.075719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.075722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.075726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.075732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.075741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.075747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.075752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.075755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.075760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.075769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.075774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.075782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.075786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.075807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:10.083858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:10.085544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:10.085565Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:10.085568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:10.085572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:10.085578Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2610 [1:7556535268361729769:4425]
2025-10-02T08:16:10.085593Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:10.085611Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:10.085614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.085617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.085619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.085636Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:10.085647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:10.085657Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:10.085724Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.085731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.085734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:10.085738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:10.085859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2610
2025-10-02T08:16:10.085899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:10.085907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.085917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.085927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:10.085944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361729774:4429], now have 1 active actors on pipe
2025-10-02T08:16:10.085950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535268821062327:2378], now have 1 active actors on pipe
2025-10-02T08:16:10.085954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.085956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.085970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535268361729762:4425]
2025-10-02T08:16:10.085976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535268361729762:4425]
2025-10-02T08:16:10.085980Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:10.085959Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2610
2025-10-02T08:16:10.085990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:10.085997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:10.086001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:10.086002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:10.086004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:10.086016Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:10.086023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.086028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.086030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:10.086036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.086043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:10.086074Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535268361729762:4425]
2025-10-02T08:16:10.086083Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:10.086093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.086093Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:10.086135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.086142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.086154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.086191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2611 partition: 0 MaxSeqNo: 17 sessionId: src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0
2025-10-02T08:16:10.086518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a901cf2-ac45102d-2c9e0383-d283df42_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:10.089250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0] Write session: try to update token
2025-10-02T08:16:10.089269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:10.097159Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:10.097179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:10.097188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535268361729762:4425]
2025-10-02T08:16:10.097232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:10.097236Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:10.097419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:10.097576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:10.097736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:10.097880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:10.098084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:10.098130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:10.103166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId: src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:10.105703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:10.105832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.105852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.105895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:10.105926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:10.106092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.106107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.106282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.106348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.106414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.106490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.106536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.106544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.106616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.106678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.106741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.106806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.106850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.106856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.106921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.106981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.107042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.107102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.107147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.107154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.107215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.107278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.107341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.107411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.107466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.107473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.107541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.107601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.107661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.107730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.107773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.107780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.107852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.107912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.107980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.108046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.108108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.108118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.108183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.108246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.108314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.108375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.108422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.108429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.108496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.108559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.108622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.108687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.108730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.108737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.108827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.108890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.108951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.109014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.109063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.109069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.109138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:10.109198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:10.109261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:10.109325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:10.109431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:10.109438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:10.109479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:10.109542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.109562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.109568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:10.109599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:10.109615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:10.109624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:10.109626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:10.109629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:10.110016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:10.110048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:10.110055Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:10.110058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:10.110061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:10.110063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:10.110580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:10.110603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:10.110612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:10.110618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:10.110621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:10.110623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:10.111141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:10.111166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:10.111171Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:10.111175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:10.111177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:10.112425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:10.112444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:10.112457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392970112
2025-10-02T08:16:10.112593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:10.112609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:10.112614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:10.112617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:10.112621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:10.112624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:10.113231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:10.113255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:10.113261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:10.113264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:10.113269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:10.113273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:10.113733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:10.113753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:10.113763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:10.113770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:10.113773Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:10.113777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:10.114239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:10.114262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:10.114267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:10.115375Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:10.115396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:10.115401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:10.115405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:10.115414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392970115
2025-10-02T08:16:10.115704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:10.115726Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:10.115732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:10.115738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:10.115742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:10.115744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:10.116244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:10.116267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:10.116273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:10.116277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:10.116279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:10.116283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:10.116731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:10.116752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.116897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392970116
2025-10-02T08:16:10.117667Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:10.117688Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:10.117695Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:10.117701Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:10.119360Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:10.119373Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:10.119375Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:10.119382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535268361729762:4425]
2025-10-02T08:16:10.119387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535268361729762:4425]
2025-10-02T08:16:10.119429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:10.119438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:10.119442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.119444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:10.119447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:10.119578Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:10.157382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535268361729809:4064]
2025-10-02T08:16:10.157499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2610, pipe: [1:7556535268361729809:4064]
2025-10-02T08:16:10.257186Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:10.257516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361729809:4064], now have 1 active actors on pipe
2025-10-02T08:16:10.257627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:10.257634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535268361729809:4064]
2025-10-02T08:16:10.257643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:10.257673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2611 reason: error at write: Disconnected sessionId: src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0
2025-10-02T08:16:10.257732Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:10.257995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:10.258004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0] Write session will restart in 0.006055s
2025-10-02T08:16:10.258028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0] Write session: Do CDS request
2025-10-02T08:16:10.258034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:10.257853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2611 sessionId: src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0 is DEAD
2025-10-02T08:16:10.257912Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:10.265266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.265318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:10.265334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2612
2025-10-02T08:16:10.265510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.265542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:10.265548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:10.265551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:10.265975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2612 sessionId:  describe result for acl check
2025-10-02T08:16:10.266011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:10.266012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:10.266014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:10.266019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535268361730121:4540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:10.266427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535268361730121:4540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:10.268399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535268361730121:4540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:10.271315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535268361730121:4540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:10.271329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535268361730121:4540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:10.271332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535268361730121:4540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:10.271340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:10.272157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:10.273419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:10.273600Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:10.273610Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:10.273622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:10.273688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:10.273724Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535268361730294:4526]
2025-10-02T08:16:10.274314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:10.274498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:10.274547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:10.274821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:10.274879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.274886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.274887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.274888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.274888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.274893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.274902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.274905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.274908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.274911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.274916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.274923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.274929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.274939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.274943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.274948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.274951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.274956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.274967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.274976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.274993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:10.282833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:10.284852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:10.284874Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:10.284877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:10.284881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:10.284888Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2611 [1:7556535268361730294:4526]
2025-10-02T08:16:10.284899Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:10.284918Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:10.284921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.284924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.284926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.284943Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:10.284948Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:10.284955Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:10.285026Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.285036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.285039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:10.285042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:10.285110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:10.285122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.285137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.285148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:10.285168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535268821062358:2378], now have 1 active actors on pipe
2025-10-02T08:16:10.285175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535268361730288:4526]
2025-10-02T08:16:10.285177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535268361730288:4526]
2025-10-02T08:16:10.285185Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:10.285193Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:10.285196Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:10.285199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:10.285215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:10.285218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:10.285224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361730277:4540], now have 1 active actors on pipe
2025-10-02T08:16:10.285256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.285259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.285272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535268361730288:4526]
2025-10-02T08:16:10.285276Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:10.285300Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddef3405-69871ef6-78220223-53c32d47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:10.285306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.285311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.285312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:10.285313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:10.285324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.285289Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2611
2025-10-02T08:16:10.285333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:10.285370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2611
2025-10-02T08:16:10.285371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.285410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.285420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.285441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.285486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2612 partition: 0 MaxSeqNo: 17 sessionId: src_id|ddef3405-69871ef6-78220223-53c32d47_0
2025-10-02T08:16:10.285850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bdecf1-54e93e50-2faef2f7-e44ed9bd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ddef3405-69871ef6-78220223-53c32d47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:10.288660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddef3405-69871ef6-78220223-53c32d47_0] Write session: try to update token
2025-10-02T08:16:10.288678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddef3405-69871ef6-78220223-53c32d47_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:10.303184Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:10.303204Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:10.303206Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:10.303215Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535268361730288:4526]
2025-10-02T08:16:10.303219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535268361730288:4526]
2025-10-02T08:16:10.303264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:10.303267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:10.303271Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.303273Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:10.303273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:10.303413Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:10.303783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId: src_id|ddef3405-69871ef6-78220223-53c32d47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:10.306482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:10.357612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535268361730319:4064]
2025-10-02T08:16:10.357778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2611, pipe: [1:7556535268361730319:4064]
2025-10-02T08:16:10.439108Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:10.439365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.439375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.439407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361730319:4064], now have 1 active actors on pipe
2025-10-02T08:16:10.439508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:10.439518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:10.439578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2612 reason: error at write: Disconnected sessionId: src_id|ddef3405-69871ef6-78220223-53c32d47_0
2025-10-02T08:16:10.439650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:10.439761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2612 sessionId: src_id|ddef3405-69871ef6-78220223-53c32d47_0 is DEAD
2025-10-02T08:16:10.439770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:10.439863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddef3405-69871ef6-78220223-53c32d47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:10.439874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddef3405-69871ef6-78220223-53c32d47_0] Write session will restart in 0.005474s
2025-10-02T08:16:10.439897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddef3405-69871ef6-78220223-53c32d47_0] Write session: Do CDS request
2025-10-02T08:16:10.439905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddef3405-69871ef6-78220223-53c32d47_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:10.439906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535268361730319:4064]
2025-10-02T08:16:10.446277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddef3405-69871ef6-78220223-53c32d47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.446347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:10.446364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2613
2025-10-02T08:16:10.446502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.446532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:10.446541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:10.446545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:10.446972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2613 sessionId:  describe result for acl check
2025-10-02T08:16:10.447009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:10.447011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:10.447012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:10.447018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535268361730512:4575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:10.447525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535268361730512:4575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:10.449731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535268361730512:4575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:10.452975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535268361730512:4575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:10.452995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535268361730512:4575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:10.452999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535268361730512:4575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:10.453007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:10.458110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:10.459620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:10.459857Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:10.459872Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:10.459883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:10.459936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:10.459975Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535268361730770:4574]
2025-10-02T08:16:10.460593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:10.460818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:10.460865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:10.461207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:10.461260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.461266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.461267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.461269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.461270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.461275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.461287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.461297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.461305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.461314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.461325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.461337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.461352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.461359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.461368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.461375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.461385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.461395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.461405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.461415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.461442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:10.469532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:10.470935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:10.470955Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:10.470957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:10.470960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:10.470965Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2612 [1:7556535268361730770:4574]
2025-10-02T08:16:10.470978Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:10.470995Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:10.470997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.470999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.471001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.471014Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:10.471018Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:10.471023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:10.471073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.471079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.471081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:10.471084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:10.471137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:10.471145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.471154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.471161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:10.471173Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535268361730764:4574]
2025-10-02T08:16:10.471178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535268361730764:4574]
2025-10-02T08:16:10.471185Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:10.471194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:10.471202Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:10.471208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:10.471220Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:10.471231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:10.471231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2612
2025-10-02T08:16:10.471240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361730664:4575], now have 1 active actors on pipe
2025-10-02T08:16:10.471242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535268361730764:4574]
2025-10-02T08:16:10.471244Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:10.471247Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:10.471248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535268821062365:2378], now have 1 active actors on pipe
2025-10-02T08:16:10.471260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.471266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.471306Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2612
2025-10-02T08:16:10.471513Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a07756fd-aac9b6a0-4a670021-20b0755_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:10.471524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.471529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.471530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:10.471537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.471544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:10.471572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.471612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.471617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.471628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.471655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2613 partition: 0 MaxSeqNo: 17 sessionId: src_id|a07756fd-aac9b6a0-4a670021-20b0755_0
2025-10-02T08:16:10.471977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddef3405-69871ef6-78220223-53c32d47_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a07756fd-aac9b6a0-4a670021-20b0755_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:10.474397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07756fd-aac9b6a0-4a670021-20b0755_0] Write session: try to update token
2025-10-02T08:16:10.474411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07756fd-aac9b6a0-4a670021-20b0755_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:10.487861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId: src_id|a07756fd-aac9b6a0-4a670021-20b0755_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:10.488982Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:10.489001Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:10.489003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:10.489011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535268361730764:4574]
2025-10-02T08:16:10.489016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535268361730764:4574]
2025-10-02T08:16:10.489058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:10.489062Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:10.489068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:10.489070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.489072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:10.489210Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:10.490496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:10.539846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535268361730797:4064]
2025-10-02T08:16:10.539985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2612, pipe: [1:7556535268361730797:4064]
2025-10-02T08:16:10.632396Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:10.632874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.632896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.632936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361730797:4064], now have 1 active actors on pipe
2025-10-02T08:16:10.633057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:10.633068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:10.633128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2613 reason: error at write: Disconnected sessionId: src_id|a07756fd-aac9b6a0-4a670021-20b0755_0
2025-10-02T08:16:10.633158Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:10.633165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:10.633286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2613 sessionId: src_id|a07756fd-aac9b6a0-4a670021-20b0755_0 is DEAD
2025-10-02T08:16:10.633429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07756fd-aac9b6a0-4a670021-20b0755_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:10.633440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07756fd-aac9b6a0-4a670021-20b0755_0] Write session will restart in 0.006910s
2025-10-02T08:16:10.633465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07756fd-aac9b6a0-4a670021-20b0755_0] Write session: Do CDS request
2025-10-02T08:16:10.633470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07756fd-aac9b6a0-4a670021-20b0755_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:10.633460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535268361730797:4064]
2025-10-02T08:16:10.641317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07756fd-aac9b6a0-4a670021-20b0755_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.641358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:10.641380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2614
2025-10-02T08:16:10.641534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.641574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:10.641584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:10.641587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:10.641980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2614 sessionId:  describe result for acl check
2025-10-02T08:16:10.642025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:10.642031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:10.642033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:10.642038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535268361731084:4618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:10.642551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535268361731084:4618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:10.645887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535268361731084:4618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:10.647464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:10.648925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:10.649079Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:10.649086Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:10.649092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:10.649126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:10.649168Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535268361731245:4604]
2025-10-02T08:16:10.649546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535268361731084:4618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:10.649559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535268361731084:4618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:10.649561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535268361731084:4618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:10.649568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:10.649585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:10.649793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:10.649823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:10.650011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:10.650036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.650040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.650041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.650042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.650042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.650046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.650053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.650055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.650057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.650059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.650062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.650067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.650070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.650073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.650075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.650077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.650079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.650082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.650084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.650086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.650096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:10.658238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:10.660243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:10.660258Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:10.660261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:10.660264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:10.660269Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2613 [1:7556535268361731245:4604]
2025-10-02T08:16:10.660280Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:10.660295Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:10.660298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.660300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.660302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.660316Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:10.660326Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:10.660331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:10.660400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.660407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.660410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:10.660412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:10.660472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:10.660479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.660491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.660505Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:10.660507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2613
2025-10-02T08:16:10.660527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361731252:4618], now have 1 active actors on pipe
2025-10-02T08:16:10.660537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535268361731239:4604]
2025-10-02T08:16:10.660539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535268361731239:4604]
2025-10-02T08:16:10.660546Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:10.660559Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:10.660561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.660565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.660571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:10.660581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535268821062372:2378], now have 1 active actors on pipe
2025-10-02T08:16:10.660586Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:10.660599Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:10.660608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:10.660593Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2613
2025-10-02T08:16:10.660648Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:10.660659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.660662Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.660664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:10.660672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.660680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:10.660695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535268361731239:4604]
2025-10-02T08:16:10.660706Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:10.660722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:10.660745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.660783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.660790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.660821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.660857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2614 partition: 0 MaxSeqNo: 17 sessionId: src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0
2025-10-02T08:16:10.661193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07756fd-aac9b6a0-4a670021-20b0755_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:10.663819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0] Write session: try to update token
2025-10-02T08:16:10.663835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:10.677983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId: src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:10.678224Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:10.678240Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:10.678242Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:10.678251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535268361731239:4604]
2025-10-02T08:16:10.678254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535268361731239:4604]
2025-10-02T08:16:10.678293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:10.678292Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:10.678297Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:10.678303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.678305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:10.678431Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:10.680457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:10.733405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535268361731279:4064]
2025-10-02T08:16:10.733510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2613, pipe: [1:7556535268361731279:4064]
2025-10-02T08:16:10.808745Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:10.809095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.809111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.809148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361731279:4064], now have 1 active actors on pipe
2025-10-02T08:16:10.809290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535268361731279:4064]
2025-10-02T08:16:10.809319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:10.809322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:10.809367Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:10.809384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2614 reason: error at write: Disconnected sessionId: src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0
2025-10-02T08:16:10.809422Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:10.809557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2614 sessionId: src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0 is DEAD
2025-10-02T08:16:10.809702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:10.809714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0] Write session will restart in 0.005403s
2025-10-02T08:16:10.809741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0] Write session: Do CDS request
2025-10-02T08:16:10.809747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:10.816288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.816370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:10.816395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2615
2025-10-02T08:16:10.816500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.816541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:10.816551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:10.816554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:10.816985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2615 sessionId:  describe result for acl check
2025-10-02T08:16:10.817023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:10.817027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:10.817029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:10.817033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535268361731552:4631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:10.817418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535268361731552:4631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:10.819977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535268361731552:4631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:10.822603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:10.823576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:10.823789Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:10.823798Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:10.823806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:10.823845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:10.823875Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535268361731728:4629]
2025-10-02T08:16:10.823989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535268361731552:4631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:10.824005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535268361731552:4631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:10.824008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535268361731552:4631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:10.824016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:10.824346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:10.824518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:10.824546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:10.824750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:10.824791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.824796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.824797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.824797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.824798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.824833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.824848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.824855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.824857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.824859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.824863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.824867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:10.824870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.824873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:10.824878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.824881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:10.824883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.824886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.824888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.824890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.824901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:10.832824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:10.834447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:10.834466Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:10.834469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:10.834472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:10.834477Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2614 [1:7556535268361731728:4629]
2025-10-02T08:16:10.834489Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:10.834507Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:10.834514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.834519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.834521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.834536Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:10.834540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:10.834546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:10.834616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.834623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.834625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:10.834627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:10.834684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:10.834691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.834702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:10.834712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:10.834729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535268361731722:4629]
2025-10-02T08:16:10.834731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535268361731722:4629]
2025-10-02T08:16:10.834737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:10.834748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361731733:4631], now have 1 active actors on pipe
2025-10-02T08:16:10.834748Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:10.834751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:10.834759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:10.834770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:10.834772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2614
2025-10-02T08:16:10.834777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:10.834782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535268821062379:2378], now have 1 active actors on pipe
2025-10-02T08:16:10.834810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.834817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.834829Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535268361731722:4629]
2025-10-02T08:16:10.834840Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:10.834856Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:10.834865Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:10.834870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:10.834873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:10.834874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:10.834883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:10.834890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:10.834863Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2614
2025-10-02T08:16:10.834920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.834965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.834971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.834982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:10.835017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2615 partition: 0 MaxSeqNo: 17 sessionId: src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0
2025-10-02T08:16:10.835369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef91de3f-471dda2e-96f97cd8-4c1e7601_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:10.838040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0] Write session: try to update token
2025-10-02T08:16:10.838057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:10.851434Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:10.851452Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:10.851453Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:10.851460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535268361731722:4629]
2025-10-02T08:16:10.851463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535268361731722:4629]
2025-10-02T08:16:10.851492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId: src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:10.851495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:10.851500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:10.851501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:10.851502Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:10.851507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:10.851627Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:10.854269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:10.909515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535268361731762:4064]
2025-10-02T08:16:10.909654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2614, pipe: [1:7556535268361731762:4064]
2025-10-02T08:16:10.985152Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:10.985405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:10.985419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:10.985458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535268361731762:4064], now have 1 active actors on pipe
2025-10-02T08:16:10.985587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535268361731762:4064]
2025-10-02T08:16:10.985630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:10.985637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:10.985699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:10.985699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2615 reason: error at write: Disconnected sessionId: src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0
2025-10-02T08:16:10.985727Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:10.985902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2615 sessionId: src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0 is DEAD
2025-10-02T08:16:10.986060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:10.986071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0] Write session will restart in 0.008635s
2025-10-02T08:16:10.986095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0] Write session: Do CDS request
2025-10-02T08:16:10.986100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:10.996318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.996371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:10.996389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2616
2025-10-02T08:16:10.996707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:10.996739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:10.996746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:10.996755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:10.997159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2616 sessionId:  describe result for acl check
2025-10-02T08:16:10.997199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:10.997205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:10.997206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:10.997211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535268361732181:4670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:10.997725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535268361732181:4670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:10.998600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:11.000081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535268361732181:4670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:11.000122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:11.000300Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:11.000310Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:11.000320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:11.000373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:11.000412Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535272656699511:4677]
2025-10-02T08:16:11.001020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:11.001234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:11.001292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:11.001594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:11.001661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.001669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.001669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.001671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.001672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.001677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.001688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.001692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.001697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.001705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.001714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.001721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.001732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.001737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.001742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.001747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.001752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.001757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.001762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.001767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.001787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:11.006952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535268361732181:4670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:11.006971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535268361732181:4670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:11.006975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535268361732181:4670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:11.006985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:11.010151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:11.011946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:11.011967Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:11.011970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:11.011974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:11.011979Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2615 [1:7556535272656699511:4677]
2025-10-02T08:16:11.011991Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:11.012012Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:11.012015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.012018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.012020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.012037Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:11.012047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:11.012053Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:11.012137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.012145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.012148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:11.012150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:11.012213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:11.012220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.012235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.012249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2615
2025-10-02T08:16:11.012252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:11.012271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656699537:4670], now have 1 active actors on pipe
2025-10-02T08:16:11.012279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535268821062399:2378], now have 1 active actors on pipe
2025-10-02T08:16:11.012284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.012288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.012306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535268361732203:4677]
2025-10-02T08:16:11.012308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535268361732203:4677]
2025-10-02T08:16:11.012319Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:11.012336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:11.012356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:11.012363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:11.012377Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:11.012381Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:11.012383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:11.012387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.012391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.012393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:11.012401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.012375Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2615
2025-10-02T08:16:11.012410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:11.012454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535268361732203:4677]
2025-10-02T08:16:11.012468Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:11.012473Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:11.012490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.012549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.012556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.012571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.012608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2616 partition: 0 MaxSeqNo: 17 sessionId: src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0
2025-10-02T08:16:11.012936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6243b8-9cc92d6d-de1bf3e2-66a7a7b4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:11.015654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0] Write session: try to update token
2025-10-02T08:16:11.015670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:11.030425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId: src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:11.030851Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:11.030873Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:11.030875Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:11.030883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535268361732203:4677]
2025-10-02T08:16:11.030889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535268361732203:4677]
2025-10-02T08:16:11.030935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:11.030946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.030948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:11.030995Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:11.031008Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:11.031095Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:11.033250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:11.085632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535272656699551:4064]
2025-10-02T08:16:11.085733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2615, pipe: [1:7556535272656699551:4064]
2025-10-02T08:16:11.178826Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:11.179250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.179271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.179327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656699551:4064], now have 1 active actors on pipe
2025-10-02T08:16:11.179439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535272656699551:4064]
2025-10-02T08:16:11.179462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:11.179465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:11.179516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2616 reason: error at write: Disconnected sessionId: src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0
2025-10-02T08:16:11.179559Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:11.179548Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:11.179700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2616 sessionId: src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0 is DEAD
2025-10-02T08:16:11.179834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:11.179845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0] Write session will restart in 0.007355s
2025-10-02T08:16:11.179872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0] Write session: Do CDS request
2025-10-02T08:16:11.179878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:11.188272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.188375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:11.188395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2617
2025-10-02T08:16:11.188616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.188654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:11.188663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:11.188667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:11.189078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2617 sessionId:  describe result for acl check
2025-10-02T08:16:11.189109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:11.189113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:11.189114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:11.189118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535272656699824:4704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:11.189544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535272656699824:4704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:11.192849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535272656699824:4704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:11.196542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:11.196650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535272656699824:4704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:11.196665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535272656699824:4704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:11.196669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535272656699824:4704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:11.196676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:11.196887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:11.197047Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:11.197056Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:11.197065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:11.197113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:11.197150Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535272656700012:4711]
2025-10-02T08:16:11.197790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:11.198011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:11.198071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:11.198325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:11.198355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.198360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.198360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.198361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.198361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.198365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.198371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.198373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.198375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.198376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.198380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.198385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.198388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.198391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.198393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.198396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.198398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.198401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.198403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.198405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.198415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:11.206606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:11.208294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:11.208310Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:11.208311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:11.208313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:11.208318Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2616 [1:7556535272656700012:4711]
2025-10-02T08:16:11.208327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:11.208341Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:11.208343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.208345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.208346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.208359Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:11.208364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:11.208371Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:11.208429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.208436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.208440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:11.208442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:11.208517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:11.208526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.208535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.208542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:11.208555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2616
2025-10-02T08:16:11.208557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656700008:4704], now have 1 active actors on pipe
2025-10-02T08:16:11.208563Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535272656700000:4711]
2025-10-02T08:16:11.208565Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535272656700000:4711]
2025-10-02T08:16:11.208571Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:11.208584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.208584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:11.208587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.208587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:11.208600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535273116029702:2378], now have 1 active actors on pipe
2025-10-02T08:16:11.208605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:11.208619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:11.208628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:11.208672Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:11.208682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.208686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.208688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:11.208696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.208669Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2616
2025-10-02T08:16:11.208708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:11.208718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535272656700000:4711]
2025-10-02T08:16:11.208725Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:11.208732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:11.208755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.208832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.208839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.208854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.208892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2617 partition: 0 MaxSeqNo: 17 sessionId: src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0
2025-10-02T08:16:11.209264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8907da8-cb3e8083-1928bdf0-5586ea64_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:11.211937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0] Write session: try to update token
2025-10-02T08:16:11.211952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:11.226165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId: src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:11.226803Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:11.226821Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:11.226823Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:11.226830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535272656700000:4711]
2025-10-02T08:16:11.226834Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535272656700000:4711]
2025-10-02T08:16:11.226876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:11.226876Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:11.226880Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:11.226889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.226891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:11.227020Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:11.228685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:11.279926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535272656700066:4064]
2025-10-02T08:16:11.279993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2616, pipe: [1:7556535272656700066:4064]
2025-10-02T08:16:11.352306Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:11.352690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.352699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.352730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656700066:4064], now have 1 active actors on pipe
2025-10-02T08:16:11.352876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535272656700066:4064]
2025-10-02T08:16:11.352907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:11.352913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:11.352951Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:11.352969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2617 reason: error at write: Disconnected sessionId: src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0
2025-10-02T08:16:11.353013Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:11.353129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2617 sessionId: src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0 is DEAD
2025-10-02T08:16:11.353280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:11.353290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0] Write session will restart in 0.006718s
2025-10-02T08:16:11.353311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0] Write session: Do CDS request
2025-10-02T08:16:11.353318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:11.361179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.361196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:11.361210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2618
2025-10-02T08:16:11.361359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.361386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:11.361395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:11.361398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:11.361809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2618 sessionId:  describe result for acl check
2025-10-02T08:16:11.361837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:11.361838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:11.361839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:11.361842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535272656700403:4783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:11.362212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535272656700403:4783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:11.364372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535272656700403:4783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:11.366931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:11.367151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535272656700403:4783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:11.367163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535272656700403:4783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:11.367166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535272656700403:4783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:11.367173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:11.367236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:11.367375Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:11.367383Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:11.367392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:11.367430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:11.367466Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535272656700533:4759]
2025-10-02T08:16:11.367911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:11.368061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:11.368101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:11.368332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:11.368364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.368369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.368370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.368370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.368371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.368374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.368380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.368381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.368383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.368385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.368388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.368393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.368396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.368402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.368406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.368408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.368411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.368413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.368416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.368420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.368429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:11.375965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:11.377462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:11.377478Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:11.377480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:11.377484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:11.377490Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2617 [1:7556535272656700533:4759]
2025-10-02T08:16:11.377501Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:11.377517Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:11.377524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.377527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.377529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.377542Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:11.377553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:11.377559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:11.377613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.377620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.377624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:11.377626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:11.377683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:11.377689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.377701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.377716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:11.377733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2617
2025-10-02T08:16:11.377737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656700529:4783], now have 1 active actors on pipe
2025-10-02T08:16:11.377740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535273116029733:2378], now have 1 active actors on pipe
2025-10-02T08:16:11.377746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535272656700522:4759]
2025-10-02T08:16:11.377748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535272656700522:4759]
2025-10-02T08:16:11.377762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:11.377778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.377784Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:11.377787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.377789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:11.377803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:11.377820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:11.377827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:11.377817Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2617
2025-10-02T08:16:11.377864Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69eb5dd-29580c10-17942393-b82b17cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:11.377874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.377878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.377879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:11.377887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.377895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:11.377903Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535272656700522:4759]
2025-10-02T08:16:11.377909Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:11.377915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:11.377938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.378006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.378012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.378025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.378062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2618 partition: 0 MaxSeqNo: 17 sessionId: src_id|69eb5dd-29580c10-17942393-b82b17cc_0
2025-10-02T08:16:11.378533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ed1ec9-eb3a023c-83b325a0-d565b3d3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|69eb5dd-29580c10-17942393-b82b17cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:11.380994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69eb5dd-29580c10-17942393-b82b17cc_0] Write session: try to update token
2025-10-02T08:16:11.381008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69eb5dd-29580c10-17942393-b82b17cc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:11.393354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId: src_id|69eb5dd-29580c10-17942393-b82b17cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:11.394515Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:11.394531Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:11.394533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:11.394541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535272656700522:4759]
2025-10-02T08:16:11.394546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535272656700522:4759]
2025-10-02T08:16:11.394583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:11.394588Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:11.394592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:11.394594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.394596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:11.394726Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:11.395824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:11.453291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535272656700559:4064]
2025-10-02T08:16:11.453396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2617, pipe: [1:7556535272656700559:4064]
2025-10-02T08:16:11.520556Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:11.520933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.520947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.520985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656700559:4064], now have 1 active actors on pipe
2025-10-02T08:16:11.521104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:11.521116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:11.521210Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:11.521176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2618 reason: error at write: Disconnected sessionId: src_id|69eb5dd-29580c10-17942393-b82b17cc_0
2025-10-02T08:16:11.521193Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:11.521366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2618 sessionId: src_id|69eb5dd-29580c10-17942393-b82b17cc_0 is DEAD
2025-10-02T08:16:11.521496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535272656700559:4064]
2025-10-02T08:16:11.521520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69eb5dd-29580c10-17942393-b82b17cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:11.521530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69eb5dd-29580c10-17942393-b82b17cc_0] Write session will restart in 0.005258s
2025-10-02T08:16:11.521554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69eb5dd-29580c10-17942393-b82b17cc_0] Write session: Do CDS request
2025-10-02T08:16:11.521560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69eb5dd-29580c10-17942393-b82b17cc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:11.528294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69eb5dd-29580c10-17942393-b82b17cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.528401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:11.528415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2619
2025-10-02T08:16:11.528538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.528575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:11.528584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:11.528587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:11.529014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2619 sessionId:  describe result for acl check
2025-10-02T08:16:11.529044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:11.529046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:11.529047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:11.529052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535272656700836:4800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:11.529534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535272656700836:4800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:11.532018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535272656700836:4800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:11.535524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535272656700836:4800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:11.535537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535272656700836:4800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:11.535541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535272656700836:4800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:11.535549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:11.535727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:11.536700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:11.536974Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:11.536984Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:11.536992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:11.537037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:11.537069Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535272656701024:4779]
2025-10-02T08:16:11.537628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:11.537792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:11.537826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:11.538081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:11.538113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.538120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.538121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.538121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.538122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.538126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.538133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.538136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.538139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.538142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.538147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.538152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.538157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.538165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.538168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.538173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.538176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.538180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.538183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.538187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.538208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:11.546412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:11.549247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:11.549273Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:11.549276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:11.549280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:11.549288Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2618 [1:7556535272656701024:4779]
2025-10-02T08:16:11.549301Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:11.549322Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:11.549325Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.549329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.549331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.549350Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:11.549356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:11.549363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:11.549450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.549467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.549470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:11.549472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:11.549560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:11.549570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.549585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.549604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:11.549677Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2618
2025-10-02T08:16:11.549616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2618
2025-10-02T08:16:11.549625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656701015:4800], now have 1 active actors on pipe
2025-10-02T08:16:11.549628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535273116029740:2378], now have 1 active actors on pipe
2025-10-02T08:16:11.549634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.549638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.549654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535272656701012:4779]
2025-10-02T08:16:11.549656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535272656701012:4779]
2025-10-02T08:16:11.549667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:11.549679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:11.549680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:11.549684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:11.549692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:11.549695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:11.549710Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:11.549715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.549719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.549720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:11.549730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.549740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:11.549772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535272656701012:4779]
2025-10-02T08:16:11.549779Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:11.549792Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:11.549796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.549904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.549913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.549925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.549959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2619 partition: 0 MaxSeqNo: 17 sessionId: src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0
2025-10-02T08:16:11.550265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69eb5dd-29580c10-17942393-b82b17cc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:11.552945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0] Write session: try to update token
2025-10-02T08:16:11.552963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:11.560687Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:11.560705Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:11.560713Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535272656701012:4779]
2025-10-02T08:16:11.560756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:11.560758Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:11.560936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:11.561082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:11.561222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:11.561360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:11.561589Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:11.561623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:11.566207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId: src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:11.568744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:11.568822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.568834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.568865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:11.568888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:11.568930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.568948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.569128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.569194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.569263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.569331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.569381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.569390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.569457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.569521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.569586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.569660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.569706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.569716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.569785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.569849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.569921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.570011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.570066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.570075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.570153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.570222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.570291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.570360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.570405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.570413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.570489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.570548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.570605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.570668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.570717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.570727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.570797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.570868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.570927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.570988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.571032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.571038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.571100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.571157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.571226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.571297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.571340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.571346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.571408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.571466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.571527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.571588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.571631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.571637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.571698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.571754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.571824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.571883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.571925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.571932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.571991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:11.572048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:11.572120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:11.572181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:11.572224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:11.572231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:11.572276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:11.572339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.572356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.572361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:11.572386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:11.572399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:11.572404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:11.572407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:11.572409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:11.572758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:11.572780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:11.572785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:11.572787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:11.572789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:11.572794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:11.573664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:11.573690Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:11.573697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:11.573699Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:11.573702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:11.573704Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:11.574147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:11.574168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:11.574173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:11.574177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:11.574180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:11.575323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:11.575340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:11.575349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392971575
2025-10-02T08:16:11.575557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:11.575573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:11.575579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:11.575582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:11.575588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:11.575591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:11.576041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:11.576064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:11.576081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:11.576088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:11.576091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:11.576096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:11.576503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:11.576521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:11.576528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:11.576534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:11.576537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:11.576539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:11.577017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:11.577036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:11.577042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:11.578244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:11.578266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:11.578273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:11.578277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:11.578285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392971578
2025-10-02T08:16:11.578611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:11.578637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:11.578643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:11.578652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:11.578656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:11.578663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:11.579165Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:11.579192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:11.579198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:11.579201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:11.579203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:11.579208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:11.579687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:11.579712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.579801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392971579
2025-10-02T08:16:11.580552Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:11.580578Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:11.580587Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:11.580600Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:11.582132Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:11.582147Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:11.582148Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:11.582158Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535272656701012:4779]
2025-10-02T08:16:11.582161Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535272656701012:4779]
2025-10-02T08:16:11.582206Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:11.582217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:11.582222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.582224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:11.582229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:11.582346Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:11.621699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535272656701068:4064]
2025-10-02T08:16:11.621841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2618, pipe: [1:7556535272656701068:4064]
2025-10-02T08:16:11.718781Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:11.719259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656701068:4064], now have 1 active actors on pipe
2025-10-02T08:16:11.719378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:11.719388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:11.719415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2619 reason: error at write: Disconnected sessionId: src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0
2025-10-02T08:16:11.719502Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:11.719587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2619 sessionId: src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0 is DEAD
2025-10-02T08:16:11.719545Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:11.719721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535272656701068:4064]
2025-10-02T08:16:11.719765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:11.719772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0] Write session will restart in 0.008239s
2025-10-02T08:16:11.719795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0] Write session: Do CDS request
2025-10-02T08:16:11.719801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:11.729217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.729261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:11.729277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2620
2025-10-02T08:16:11.729414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.729456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:11.729475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:11.729479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:11.729856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2620 sessionId:  describe result for acl check
2025-10-02T08:16:11.729891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:11.729897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:11.729898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:11.729903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535272656701496:4871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:11.730389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535272656701496:4871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:11.732354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535272656701496:4871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:11.733671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:11.734000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:11.734197Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:11.734216Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:11.734226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:11.734277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:11.734304Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535272656701598:4863]
2025-10-02T08:16:11.734779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:11.734964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:11.735008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:11.735055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535272656701496:4871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:11.735067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535272656701496:4871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:11.735070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535272656701496:4871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:11.735077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:11.735303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:11.735356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.735361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.735362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.735363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.735364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.735369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.735378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.735382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.735385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.735389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.735394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.735401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.735410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.735415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.735418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.735421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.735424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.735427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.735429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.735432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.735443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:11.743086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:11.744762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:11.744782Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:11.744784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:11.744788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:11.744795Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2619 [1:7556535272656701598:4863]
2025-10-02T08:16:11.744821Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:11.744837Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:11.744844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.744847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.744849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.744863Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:11.744871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:11.744878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:11.744941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.744951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.744954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:11.744956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:11.745022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:11.745030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.745044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.745059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:11.745082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656701609:4871], now have 1 active actors on pipe
2025-10-02T08:16:11.745091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535272656701592:4863]
2025-10-02T08:16:11.745093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535272656701592:4863]
2025-10-02T08:16:11.745100Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:11.745108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535273116029746:2378], now have 1 active actors on pipe
2025-10-02T08:16:11.745113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2619
2025-10-02T08:16:11.745115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:11.745128Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:11.745130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:11.745136Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:11.745149Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:11.745164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.745173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.745185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535272656701592:4863]
2025-10-02T08:16:11.745196Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:11.745203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:11.745225Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:11.745236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.745239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.745245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:11.745254Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.745265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:11.745290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.745330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.745336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.745347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.745385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2620 partition: 0 MaxSeqNo: 17 sessionId: src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0
2025-10-02T08:16:11.745911Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2619
2025-10-02T08:16:11.748905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebbacba-3f6ba24f-4ae4cc1c-87bdb47a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:11.751488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0] Write session: try to update token
2025-10-02T08:16:11.751502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:11.763296Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:11.763320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:11.763322Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:11.763330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535272656701592:4863]
2025-10-02T08:16:11.763333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535272656701592:4863]
2025-10-02T08:16:11.763377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:11.763383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.763382Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:11.763385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:11.763388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:11.763512Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:11.766828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId: src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:11.769450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:11.819841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535272656701629:4064]
2025-10-02T08:16:11.819966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2619, pipe: [1:7556535272656701629:4064]
2025-10-02T08:16:11.899046Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:11.899401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.899410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.899448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656701629:4064], now have 1 active actors on pipe
2025-10-02T08:16:11.899648Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:11.899952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:11.899963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0] Write session will restart in 0.007536s
2025-10-02T08:16:11.899984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0] Write session: Do CDS request
2025-10-02T08:16:11.899580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535272656701629:4064]
2025-10-02T08:16:11.899991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:11.899603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:11.899609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:11.899662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2620 reason: error at write: Disconnected sessionId: src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0
2025-10-02T08:16:11.899675Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:11.899808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2620 sessionId: src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0 is DEAD
2025-10-02T08:16:11.908290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.908562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:11.908580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2621
2025-10-02T08:16:11.908689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:11.908722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:11.908734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:11.908737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:11.909127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2621 sessionId:  describe result for acl check
2025-10-02T08:16:11.909152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:11.909154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:11.909155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:11.909159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535272656701994:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:11.909742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535272656701994:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:11.912186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535272656701994:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:11.914886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:11.914972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535272656701994:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:11.914989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535272656701994:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:11.914993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535272656701994:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:11.914999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:11.915454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:11.915624Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:11.915633Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:11.915642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:11.915705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:11.915740Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535272656702155:4888]
2025-10-02T08:16:11.916515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:11.916784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:11.916840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:11.917108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:11.917161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.917167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.917168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.917169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.917170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.917174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.917184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.917187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.917194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.917198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.917207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.917217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:11.917222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.917226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:11.917233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.917241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:11.917245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.917254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.917258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.917267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.917287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:11.924928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:11.926441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:11.926457Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:11.926460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:11.926463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:11.926469Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2620 [1:7556535272656702155:4888]
2025-10-02T08:16:11.926480Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:11.926495Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:11.926501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.926504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.926505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.926521Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:11.926529Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:11.926540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:11.926594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.926602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.926606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:11.926609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:11.926664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:11.926671Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.926682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:11.926697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:11.926719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656702150:4891], now have 1 active actors on pipe
2025-10-02T08:16:11.926720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2620
2025-10-02T08:16:11.926733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535272656702143:4888]
2025-10-02T08:16:11.926736Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535272656702143:4888]
2025-10-02T08:16:11.926748Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:11.926756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535273116029754:2378], now have 1 active actors on pipe
2025-10-02T08:16:11.926762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.926763Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:11.926765Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:11.926766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.926780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:11.926791Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:11.926795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:11.926826Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:11.926837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:11.926805Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2620
2025-10-02T08:16:11.926841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:11.926842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:11.926850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:11.926857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:11.926870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535272656702143:4888]
2025-10-02T08:16:11.926876Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:11.926884Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:11.926892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.926923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:11.926929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:11.926941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:11.926981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2621 partition: 0 MaxSeqNo: 17 sessionId: src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0
2025-10-02T08:16:11.927289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9cd8fbc-2b58280a-a93541e2-a65972dc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:11.929913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0] Write session: try to update token
2025-10-02T08:16:11.929932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:11.943905Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:11.943927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:11.943932Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:11.943941Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535272656702143:4888]
2025-10-02T08:16:11.943946Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535272656702143:4888]
2025-10-02T08:16:11.943987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:11.943988Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:11.943993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:11.943996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:11.943997Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:11.944147Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:11.945502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId: src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:11.947907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:11.999573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535272656702192:4064]
2025-10-02T08:16:11.999704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2620, pipe: [1:7556535272656702192:4064]
2025-10-02T08:16:12.087207Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:12.087530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.087544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.087580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535272656702192:4064], now have 1 active actors on pipe
2025-10-02T08:16:12.087709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535272656702192:4064]
2025-10-02T08:16:12.087741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:12.087743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:12.087777Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:12.087805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2621 reason: error at write: Disconnected sessionId: src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0
2025-10-02T08:16:12.087806Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:12.087987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2621 sessionId: src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0 is DEAD
2025-10-02T08:16:12.088174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:12.088201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0] Write session will restart in 0.008392s
2025-10-02T08:16:12.088234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0] Write session: Do CDS request
2025-10-02T08:16:12.088241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:12.097255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.097288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:12.097304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2622
2025-10-02T08:16:12.097517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.097556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:12.097561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:12.097566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:12.097937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2622 sessionId:  describe result for acl check
2025-10-02T08:16:12.097969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:12.097975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:12.097977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:12.097981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535276951669960:4943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:12.098428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535276951669960:4943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:12.099802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:12.100303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535276951669960:4943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:12.100318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:12.100528Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:12.100545Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:12.100558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:12.100639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:12.100677Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535276951669999:4950]
2025-10-02T08:16:12.101400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:12.101579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:12.101618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:12.101888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:12.101948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.101953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.101954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.101955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.101956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.101961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.101970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.101974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.101978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.101982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.101986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.101993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.101999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.102004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.102007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.102012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.102021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.102026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.102030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.102035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.102056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:12.102785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535276951669960:4943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:12.102796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535276951669960:4943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:12.102799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535276951669960:4943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:12.102806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:12.109798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:12.111457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:12.111476Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:12.111478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:12.111482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:12.111488Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2621 [1:7556535276951669999:4950]
2025-10-02T08:16:12.111502Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:12.111518Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:12.111525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.111528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.111530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.111544Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:12.111554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:12.111560Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:12.111624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.111632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.111635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:12.111638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:12.111698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:12.111710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.111723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.111734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:12.111751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535276951669991:4950]
2025-10-02T08:16:12.111756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535276951669991:4950]
2025-10-02T08:16:12.111764Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:12.111773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2621
2025-10-02T08:16:12.111773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:12.111776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:12.111777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951670024:4943], now have 1 active actors on pipe
2025-10-02T08:16:12.111783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535277410997068:2378], now have 1 active actors on pipe
2025-10-02T08:16:12.111790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:12.111803Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:12.111806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:12.111812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.111816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.111852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535276951669991:4950]
2025-10-02T08:16:12.111860Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:12.111870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:12.111876Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:12.111881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.111885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.111888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:12.111860Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2621
2025-10-02T08:16:12.111898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.111910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:12.111952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.111993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.111998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.112010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.112045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2622 partition: 0 MaxSeqNo: 17 sessionId: src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0
2025-10-02T08:16:12.112382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394c4e61-a5e3ab08-8d0c8f26-2827902b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:12.115044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0] Write session: try to update token
2025-10-02T08:16:12.115062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:12.128291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId: src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:12.129109Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:12.129125Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:12.129126Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:12.129133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535276951669991:4950]
2025-10-02T08:16:12.129136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535276951669991:4950]
2025-10-02T08:16:12.129170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:12.129178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.129180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:12.129267Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:12.129291Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:12.129302Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:12.130821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:12.187985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535276951670040:4064]
2025-10-02T08:16:12.188109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2621, pipe: [1:7556535276951670040:4064]
2025-10-02T08:16:12.266266Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:12.266627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.266645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.266679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951670040:4064], now have 1 active actors on pipe
2025-10-02T08:16:12.266774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535276951670040:4064]
2025-10-02T08:16:12.266795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:12.266801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:12.266848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2622 reason: error at write: Disconnected sessionId: src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0
2025-10-02T08:16:12.266858Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:12.266993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2622 sessionId: src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0 is DEAD
2025-10-02T08:16:12.267148Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:12.267159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:12.267171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0] Write session will restart in 0.005470s
2025-10-02T08:16:12.267192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0] Write session: Do CDS request
2025-10-02T08:16:12.267197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:12.273292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.273322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:12.273340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2623
2025-10-02T08:16:12.273499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.273552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:12.273561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:12.273565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:12.273939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2623 sessionId:  describe result for acl check
2025-10-02T08:16:12.273971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:12.273977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:12.273979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:12.273983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535276951670297:4954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:12.274484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535276951670297:4954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:12.276523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535276951670297:4954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:12.278757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535276951670297:4954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:12.278774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535276951670297:4954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:12.278777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535276951670297:4954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:12.278784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:12.280413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:12.280752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:12.281010Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:12.281024Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:12.281037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:12.281099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:12.281137Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535276951670573:4959]
2025-10-02T08:16:12.281750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:12.281968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:12.282020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:12.282313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:12.282368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.282375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.282376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.282377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.282378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.282383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.282392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.282396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.282400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.282403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.282408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.282416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.282421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.282427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.282432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.282437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.282442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.282447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.282452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.282462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.282483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:12.290279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:12.291926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:12.291948Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:12.291951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:12.291956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:12.291962Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2622 [1:7556535276951670573:4959]
2025-10-02T08:16:12.291975Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:12.291989Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:12.291992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.291995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.291996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.292010Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:12.292020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:12.292033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:12.292116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.292124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.292126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:12.292129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:12.292188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:12.292199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.292212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.292224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:12.292242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951670548:4954], now have 1 active actors on pipe
2025-10-02T08:16:12.292250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535277410997077:2378], now have 1 active actors on pipe
2025-10-02T08:16:12.292255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535276951670567:4959]
2025-10-02T08:16:12.292257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535276951670567:4959]
2025-10-02T08:16:12.292270Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:12.292286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:12.292291Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:12.292295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:12.292301Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:12.292303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:12.292303Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2622
2025-10-02T08:16:12.292333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535276951670567:4959]
2025-10-02T08:16:12.292345Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:12.292362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:12.292387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2622
2025-10-02T08:16:12.292428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.292437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.292458Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|266996e2-35bb56f-a1b724e2-55e7df40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:12.292469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.292480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.292482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:12.292495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.292507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:12.292526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.292592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.292600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.292612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.292645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2623 partition: 0 MaxSeqNo: 17 sessionId: src_id|266996e2-35bb56f-a1b724e2-55e7df40_0
2025-10-02T08:16:12.292992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643e34b9-892c97bd-a06395cd-87cd25f4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|266996e2-35bb56f-a1b724e2-55e7df40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:12.295365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|266996e2-35bb56f-a1b724e2-55e7df40_0] Write session: try to update token
2025-10-02T08:16:12.295381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|266996e2-35bb56f-a1b724e2-55e7df40_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:12.308924Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:12.308947Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:12.308949Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:12.308957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535276951670567:4959]
2025-10-02T08:16:12.308961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535276951670567:4959]
2025-10-02T08:16:12.308994Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:12.309001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:12.309007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.309009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:12.309009Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:12.309140Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:12.312825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId: src_id|266996e2-35bb56f-a1b724e2-55e7df40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:12.315057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:12.367187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535276951670632:4064]
2025-10-02T08:16:12.367299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2622, pipe: [1:7556535276951670632:4064]
2025-10-02T08:16:12.454048Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:12.454385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.454401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.454440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951670632:4064], now have 1 active actors on pipe
2025-10-02T08:16:12.454567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535276951670632:4064]
2025-10-02T08:16:12.454588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:12.454595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:12.454648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2623 reason: error at write: Disconnected sessionId: src_id|266996e2-35bb56f-a1b724e2-55e7df40_0
2025-10-02T08:16:12.454709Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:12.454704Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:12.454815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2623 sessionId: src_id|266996e2-35bb56f-a1b724e2-55e7df40_0 is DEAD
2025-10-02T08:16:12.454994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266996e2-35bb56f-a1b724e2-55e7df40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:12.455006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266996e2-35bb56f-a1b724e2-55e7df40_0] Write session will restart in 0.008043s
2025-10-02T08:16:12.455031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266996e2-35bb56f-a1b724e2-55e7df40_0] Write session: Do CDS request
2025-10-02T08:16:12.455038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266996e2-35bb56f-a1b724e2-55e7df40_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:12.464231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|266996e2-35bb56f-a1b724e2-55e7df40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.464305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:12.464323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2624
2025-10-02T08:16:12.464447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.464486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:12.464495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:12.464499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:12.464885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2624 sessionId:  describe result for acl check
2025-10-02T08:16:12.464921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:12.464926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:12.464928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:12.464932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535276951671052:5048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:12.465397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535276951671052:5048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:12.467324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535276951671052:5048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:12.468597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:12.468901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:12.469042Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:12.469049Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:12.469057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:12.469093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:12.469121Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535276951671158:5036]
2025-10-02T08:16:12.469505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:12.469688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535276951671052:5048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:12.469696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535276951671052:5048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:12.469699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535276951671052:5048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:12.469703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:12.469723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:12.469787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:12.470093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:12.470152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.470158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.470161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.470162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.470163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.470168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.470177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.470181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.470189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.470192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.470198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.470209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.470218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.470223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.470228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.470236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.470240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.470244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.470249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.470253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.470276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:12.479323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:12.481052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:12.481067Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:12.481068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:12.481071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:12.481075Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2623 [1:7556535276951671158:5036]
2025-10-02T08:16:12.481083Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:12.481096Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:12.481098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.481099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.481100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.481112Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:12.481115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:12.481119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:12.481163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.481168Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.481170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:12.481171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:12.481215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:12.481220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.481228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.481238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:12.481252Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535276951671152:5036]
2025-10-02T08:16:12.481257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535276951671152:5036]
2025-10-02T08:16:12.481263Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:12.481273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:12.481277Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:12.481280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:12.481289Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:12.481295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2623
2025-10-02T08:16:12.481296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:12.481306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951671167:5048], now have 1 active actors on pipe
2025-10-02T08:16:12.481313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535277410997110:2378], now have 1 active actors on pipe
2025-10-02T08:16:12.481337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.481343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.481354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535276951671152:5036]
2025-10-02T08:16:12.481364Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:12.481375Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:12.481384Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:12.481388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.481391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.481392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:12.481398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.481407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:12.481374Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2623
2025-10-02T08:16:12.481425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.481483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.481488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.481497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.481525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2624 partition: 0 MaxSeqNo: 17 sessionId: src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0
2025-10-02T08:16:12.481831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266996e2-35bb56f-a1b724e2-55e7df40_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:12.484366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0] Write session: try to update token
2025-10-02T08:16:12.484382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:12.497716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId: src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:12.498205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:12.498222Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:12.498225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:12.498234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535276951671152:5036]
2025-10-02T08:16:12.498238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535276951671152:5036]
2025-10-02T08:16:12.498275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:12.498286Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:12.498288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.498290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:12.498300Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:12.498430Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:12.499983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:12.554572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535276951671193:4064]
2025-10-02T08:16:12.554696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2623, pipe: [1:7556535276951671193:4064]
2025-10-02T08:16:12.625398Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:12.625646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.625656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.625687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951671193:4064], now have 1 active actors on pipe
2025-10-02T08:16:12.625807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:12.625818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:12.625850Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:12.625886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2624 reason: error at write: Disconnected sessionId: src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0
2025-10-02T08:16:12.625938Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:12.626027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2624 sessionId: src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0 is DEAD
2025-10-02T08:16:12.626086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535276951671193:4064]
2025-10-02T08:16:12.626166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:12.626176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0] Write session will restart in 0.008319s
2025-10-02T08:16:12.626202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0] Write session: Do CDS request
2025-10-02T08:16:12.626208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:12.635250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.635348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:12.635364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2625
2025-10-02T08:16:12.635463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.635495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:12.635504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:12.635507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:12.635732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:12.635844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2625 sessionId:  describe result for acl check
2025-10-02T08:16:12.635870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:12.635874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:12.635876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:12.635879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535276951671685:5108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:12.636137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:12.636292Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:12.636306Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:12.636317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:12.636355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535276951671685:5108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:12.636369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:12.636549Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535276951671688:5051]
2025-10-02T08:16:12.637142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:12.637332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:12.637384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:12.637658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:12.637700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.637705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.637706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.637707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.637707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.637711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.637717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.637719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.637721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.637723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.637728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.637733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.637737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.637739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.637745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.637748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.637750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.637753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.637755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.637758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.637769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:12.638315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535276951671685:5108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:12.644372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535276951671685:5108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:12.644386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535276951671685:5108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:12.644388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535276951671685:5108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:12.644394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:12.645377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:12.646903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:12.646915Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:12.646916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:12.646919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:12.646923Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2624 [1:7556535276951671688:5051]
2025-10-02T08:16:12.646930Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:12.646943Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:12.646944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.646946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.646947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.646959Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:12.646963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:12.646967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:12.647009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.647014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.647017Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:12.647018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:12.647063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:12.647068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.647077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.647087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:12.647101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535276951671680:5051]
2025-10-02T08:16:12.647106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535276951671680:5051]
2025-10-02T08:16:12.647111Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:12.647120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951671734:5108], now have 1 active actors on pipe
2025-10-02T08:16:12.647122Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:12.647126Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:12.647128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535277410997118:2378], now have 1 active actors on pipe
2025-10-02T08:16:12.647132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:12.647141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:12.647143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:12.647148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2624
2025-10-02T08:16:12.647167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.647174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.647183Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535276951671680:5051]
2025-10-02T08:16:12.647188Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:12.647199Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:12.647207Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:12.647211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.647213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.647215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:12.647220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.647226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:12.647242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.647212Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2624
2025-10-02T08:16:12.647290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.647296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.647306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.647332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2625 partition: 0 MaxSeqNo: 17 sessionId: src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0
2025-10-02T08:16:12.647635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60500d1e-321b1ce3-559ff180-5e0c9265_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:12.650251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0] Write session: try to update token
2025-10-02T08:16:12.650269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:12.663824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId: src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:12.664159Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:12.664176Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:12.664179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:12.664186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535276951671680:5051]
2025-10-02T08:16:12.664190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535276951671680:5051]
2025-10-02T08:16:12.664229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:12.664229Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:12.664235Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:12.664239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.664241Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:12.664371Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:12.666443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:12.726083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535276951671752:4064]
2025-10-02T08:16:12.726178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2624, pipe: [1:7556535276951671752:4064]
2025-10-02T08:16:12.792912Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:12.793131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.793143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.793174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951671752:4064], now have 1 active actors on pipe
2025-10-02T08:16:12.793294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535276951671752:4064]
2025-10-02T08:16:12.793312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:12.793319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:12.793359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2625 reason: error at write: Disconnected sessionId: src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0
2025-10-02T08:16:12.793365Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:12.793440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:12.793482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2625 sessionId: src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0 is DEAD
2025-10-02T08:16:12.793598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:12.793609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0] Write session will restart in 0.009266s
2025-10-02T08:16:12.793635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0] Write session: Do CDS request
2025-10-02T08:16:12.793641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:12.804296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.804304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:12.804320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2626
2025-10-02T08:16:12.804562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:12.804675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:12.804721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:12.804731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:12.804739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:12.805152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2626 sessionId:  describe result for acl check
2025-10-02T08:16:12.805190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:12.805196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:12.805198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:12.805204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535276951672251:5165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:12.805305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:12.805455Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:12.805464Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:12.805472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:12.805518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:12.805550Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535276951672253:5133]
2025-10-02T08:16:12.805697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535276951672251:5165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:12.806120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:12.806277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:12.806311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:12.806551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:12.806591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.806595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.806596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.806596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.806597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.806600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.806606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.806608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.806610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.806612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.806616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.806620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:12.806623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.806626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:12.806628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.806631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:12.806634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.806636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.806640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.806643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.806653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:12.808154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535276951672251:5165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:12.814000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535276951672251:5165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:12.814016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535276951672251:5165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:12.814019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535276951672251:5165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:12.814028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:12.814482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:12.815893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:12.815907Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:12.815908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:12.815911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:12.815915Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2625 [1:7556535276951672253:5133]
2025-10-02T08:16:12.815922Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:12.815935Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:12.815936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.815938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.815939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.815950Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:12.815957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:12.815961Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:12.815998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.816003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.816005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:12.816007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:12.816049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:12.816056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.816076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:12.816086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:12.816102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951672297:5165], now have 1 active actors on pipe
2025-10-02T08:16:12.816106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2625
2025-10-02T08:16:12.816114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535276951672245:5133]
2025-10-02T08:16:12.816116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535276951672245:5133]
2025-10-02T08:16:12.816129Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:12.816136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535277410997125:2378], now have 1 active actors on pipe
2025-10-02T08:16:12.816148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.816148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:12.816151Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:12.816151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.816164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:12.816177Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:12.816184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:12.816188Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2625
2025-10-02T08:16:12.816222Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:12.816233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.816237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.816239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:12.816249Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.816261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:12.816270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535276951672245:5133]
2025-10-02T08:16:12.816279Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:12.816291Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:12.816307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.816375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.816389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.816410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:12.816446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2626 partition: 0 MaxSeqNo: 17 sessionId: src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0
2025-10-02T08:16:12.816731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab8133db-81adbf98-ace57e0-8a6a5b12_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:12.819325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0] Write session: try to update token
2025-10-02T08:16:12.819342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:12.828605Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:12.828626Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:12.828636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535276951672245:5133]
2025-10-02T08:16:12.828675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:12.828671Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:12.828865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:12.829024Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:12.829180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:12.829331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:12.829826Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:12.829866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:12.832463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId: src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:12.834945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:12.835006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.835020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.835050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:12.835073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:12.835122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:12.835142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:12.835315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.835385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.835456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.835528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.835596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.835605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.835678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.835745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.835814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.835883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.835929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.835937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.836033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.836112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.836181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.836245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.836291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.836297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.836365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.836432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.836495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.836560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.836605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.836613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.836681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.836746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.836854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.836925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.836973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.836980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.837055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.837116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.837183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.837251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.837295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.837304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.837371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.837436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.837515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.837576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.837634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.837641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.837715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.837779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.837848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.837914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.837962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.837969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.838041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.838107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.838176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.838248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.838293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.838296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.838364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:12.838423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:12.838481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:12.838539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:12.838582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:12.838584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:12.838623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:12.838695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:12.838713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:12.838716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:12.838751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:12.838764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:12.838767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:12.838770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:12.838772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:12.839173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:12.839204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:12.839212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:12.839220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:12.839224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:12.839227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:12.839751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:12.839776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:12.839787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:12.839793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:12.839796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:12.839799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:12.840453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:12.840482Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:12.840488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:12.840491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:12.840494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:12.842720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:12.842743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:12.842761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392972842
2025-10-02T08:16:12.842883Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:12.842901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:12.842907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:12.842911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:12.842915Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:12.842918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:12.843396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:12.843424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:12.843430Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:12.843435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:12.843443Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:12.843447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:12.843909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:12.843933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:12.843949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:12.843957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:12.843961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:12.843964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:12.844433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:12.844460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:12.844471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:12.845569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:12.845605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:12.845615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:12.845619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:12.845630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392972845
2025-10-02T08:16:12.845936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:12.845960Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:12.845966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:12.845974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:12.845978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:12.845983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:12.846463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:12.846488Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:12.846499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:12.846502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:12.846509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:12.846512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:12.846975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:12.846998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:12.847100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392972846
2025-10-02T08:16:12.850808Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:12.850829Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:12.850835Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:12.850841Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:12.852392Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:12.852407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:12.852408Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:12.852416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535276951672245:5133]
2025-10-02T08:16:12.852420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535276951672245:5133]
2025-10-02T08:16:12.852465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:12.852473Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:12.852475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:12.852477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:12.852479Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:12.852599Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:12.893530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535276951672322:4064]
2025-10-02T08:16:12.893706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2625, pipe: [1:7556535276951672322:4064]
2025-10-02T08:16:12.989186Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:12.989527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535276951672322:4064], now have 1 active actors on pipe
2025-10-02T08:16:12.989645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535276951672322:4064]
2025-10-02T08:16:12.989667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:12.989669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:12.989688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2626 reason: error at write: Disconnected sessionId: src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0
2025-10-02T08:16:12.989770Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:12.989843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2626 sessionId: src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0 is DEAD
2025-10-02T08:16:12.989970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:12.989981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0] Write session will restart in 0.009105s
2025-10-02T08:16:12.990003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0] Write session: Do CDS request
2025-10-02T08:16:12.990009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:12.990024Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:13.000280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.000319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:13.000330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2627
2025-10-02T08:16:13.000493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.000529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:13.000538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:13.000542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:13.000921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2627 sessionId:  describe result for acl check
2025-10-02T08:16:13.000950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:13.000956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:13.000958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:13.000963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535281246640117:5203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:13.001448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535281246640117:5203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:13.001690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:13.002525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:13.002702Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:13.002711Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:13.002720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:13.002769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:13.002802Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535281246640149:5192]
2025-10-02T08:16:13.003268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535281246640117:5203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:13.003402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:13.003574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:13.003612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:13.003899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:13.003940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.003945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.003947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.003947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.003948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.003952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.003962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.003966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.003970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.003973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.003978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.003985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.003991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.003999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.004004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.004009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.004017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.004022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.004027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.004032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.004050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:13.008505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535281246640117:5203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:13.008519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535281246640117:5203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:13.008522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535281246640117:5203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:13.008530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:13.011675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:13.013238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:13.013252Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:13.013253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:13.013256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:13.013260Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2626 [1:7556535281246640149:5192]
2025-10-02T08:16:13.013268Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:13.013281Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:13.013282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.013285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.013286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.013297Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:13.013302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:13.013307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:13.013349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.013355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.013357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:13.013359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:13.013510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2626
2025-10-02T08:16:13.013541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:13.013549Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.013562Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.013574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:13.013559Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2626
2025-10-02T08:16:13.013601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535277410997145:2378], now have 1 active actors on pipe
2025-10-02T08:16:13.013608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246640176:5203], now have 1 active actors on pipe
2025-10-02T08:16:13.013613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.013617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.013634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535281246640129:5192]
2025-10-02T08:16:13.013640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535281246640129:5192]
2025-10-02T08:16:13.013650Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:13.013671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:13.013675Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:13.013679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:13.013690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:13.013693Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:13.013708Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:13.013713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.013716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.013718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:13.013727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.013736Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:13.013762Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535281246640129:5192]
2025-10-02T08:16:13.013771Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:13.013779Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:13.013779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.013826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.013830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.013840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.013870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2627 partition: 0 MaxSeqNo: 17 sessionId: src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0
2025-10-02T08:16:13.014151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e977762-3eabdb73-e285d8d-75d1ffb0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:13.016635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0] Write session: try to update token
2025-10-02T08:16:13.016651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:13.024142Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:13.024157Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:13.024166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535281246640129:5192]
2025-10-02T08:16:13.024204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:13.024213Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:13.024379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:13.024527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:13.024670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:13.024824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:13.025019Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:13.025060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:13.029955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId: src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:13.032161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:13.032236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.032248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.032277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:13.032297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:13.032348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.032364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.032534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.032602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.032677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.032750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.032990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.033001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.033071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.033138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.033206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.033277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.033320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.033328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.033402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.033481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.033547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.033644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.033696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.033703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.033778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.033858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.033942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.034014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.034059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.034066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.034142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.034223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.034318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.034396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.034446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.034455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.034535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.034606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.034681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.034754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.034798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.034807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.034878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.034951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.035029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.035106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.035160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.035168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.035241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.035307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.035393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.035482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.035546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.035554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.035650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.035721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.035795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.035896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.035961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.035970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.036084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.036187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.036291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.036398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.036462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.036471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.036520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:13.036599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.036625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.036632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:13.036668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:13.036687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:13.036697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:13.036701Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:13.036710Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:13.037368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:13.037398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:13.037407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:13.037416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:13.037420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:13.037423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:13.038292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:13.038314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:13.038321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:13.038324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:13.038327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:13.038331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:13.038869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:13.038894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:13.038900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:13.038905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:13.038908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:13.041213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:13.041228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:13.041238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392973040
2025-10-02T08:16:13.041369Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:13.041379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:13.041383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:13.041387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:13.041389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:13.041392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:13.041827Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:13.041842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:13.041846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:13.041849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:13.041851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:13.041855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:13.042253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:13.042268Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:13.042275Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:13.042277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:13.042279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:13.042281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:13.042684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:13.042700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:13.042705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:13.043653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:13.043667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:13.043671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:13.043673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:13.043679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392973043
2025-10-02T08:16:13.043943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:13.043957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:13.043961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:13.043963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:13.043966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:13.043968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:13.044382Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:13.044398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:13.044401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:13.044407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:13.044409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:13.044412Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:13.044845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:13.044859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.044934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392973044
2025-10-02T08:16:13.045606Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:13.045620Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:13.045623Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:13.045627Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:13.047082Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:13.047093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:13.047096Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:13.047102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535281246640129:5192]
2025-10-02T08:16:13.047106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535281246640129:5192]
2025-10-02T08:16:13.047148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:13.047155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.047157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:13.047158Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:13.047164Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:13.047276Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:13.089628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535281246640197:4064]
2025-10-02T08:16:13.089763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2626, pipe: [1:7556535281246640197:4064]
2025-10-02T08:16:13.175302Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:13.175689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246640197:4064], now have 1 active actors on pipe
2025-10-02T08:16:13.175797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535281246640197:4064]
2025-10-02T08:16:13.175818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:13.175820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:13.175844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2627 reason: error at write: Disconnected sessionId: src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0
2025-10-02T08:16:13.175922Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:13.175931Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:13.176023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2627 sessionId: src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0 is DEAD
2025-10-02T08:16:13.176166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:13.176176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0] Write session will restart in 0.007648s
2025-10-02T08:16:13.176197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0] Write session: Do CDS request
2025-10-02T08:16:13.176203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:13.185206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.185252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:13.185263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2628
2025-10-02T08:16:13.185374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.185396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:13.185402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:13.185405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:13.185712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2628 sessionId:  describe result for acl check
2025-10-02T08:16:13.185739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:13.185743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:13.185744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:13.185747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535281246640684:5249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:13.186194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535281246640684:5249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:13.186957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:13.187968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:13.188174Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:13.188184Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:13.188194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:13.188251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:13.188280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535281246640684:5249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:13.188290Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535281246640720:5214]
2025-10-02T08:16:13.188926Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:13.189115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:13.189149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:13.189354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:13.189380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.189384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.189384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.189385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.189386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.189389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.189395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.189397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.189399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.189401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.189404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.189408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.189412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.189415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.189417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.189420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.189422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.189425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.189427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.189429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.189438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:13.193851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535281246640684:5249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:13.193860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535281246640684:5249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:13.193862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535281246640684:5249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:13.193868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:13.196660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:13.198101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:13.198112Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:13.198113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:13.198115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:13.198120Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2627 [1:7556535281246640720:5214]
2025-10-02T08:16:13.198127Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:13.198138Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:13.198141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.198143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.198144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.198154Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:13.198161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:13.198165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:13.198224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.198230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.198232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:13.198233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:13.198274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:13.198280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.198287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.198294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:13.198306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246640746:5249], now have 1 active actors on pipe
2025-10-02T08:16:13.198313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535281246640703:5214]
2025-10-02T08:16:13.198315Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535281246640703:5214]
2025-10-02T08:16:13.198320Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:13.198329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:13.198329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2627
2025-10-02T08:16:13.198330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:13.198333Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:13.198340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:13.198342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:13.198346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535281705964448:2378], now have 1 active actors on pipe
2025-10-02T08:16:13.198349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.198351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.198378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535281246640703:5214]
2025-10-02T08:16:13.198383Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:13.198394Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:13.198400Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:13.198401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.198403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.198405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:13.198410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.198417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:13.198385Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2627
2025-10-02T08:16:13.198440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.198477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.198482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.198491Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.198518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2628 partition: 0 MaxSeqNo: 17 sessionId: src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0
2025-10-02T08:16:13.198784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af13f96c-e0c2d70f-89ba46de-ad2533dd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:13.201460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0] Write session: try to update token
2025-10-02T08:16:13.201478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:13.214117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId: src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:13.214487Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:13.214498Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:13.214499Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:13.214506Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535281246640703:5214]
2025-10-02T08:16:13.214510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535281246640703:5214]
2025-10-02T08:16:13.214544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:13.214551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:13.214552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.214554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:13.214556Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:13.214691Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:13.216586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:13.276003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535281246640761:4064]
2025-10-02T08:16:13.276132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2627, pipe: [1:7556535281246640761:4064]
2025-10-02T08:16:13.340831Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:13.341107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.341121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.341159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246640761:4064], now have 1 active actors on pipe
2025-10-02T08:16:13.341343Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:13.341367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:13.341683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535281246640761:4064]
2025-10-02T08:16:13.341704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:13.341753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2628 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0
2025-10-02T08:16:13.341922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2628 sessionId: src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0 is DEAD
2025-10-02T08:16:13.342061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:13.342078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0] Write session will restart in 0.008110s
2025-10-02T08:16:13.342102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0] Write session: Do CDS request
2025-10-02T08:16:13.342108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:13.351268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.351331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:13.351343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2629
2025-10-02T08:16:13.351812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.351835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:13.351841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:13.351843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:13.352600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2629 sessionId:  describe result for acl check
2025-10-02T08:16:13.352630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:13.352632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:13.352633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:13.352636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535281246641248:5264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:13.353021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535281246641248:5264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:13.354877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535281246641248:5264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:13.355019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:13.356147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:13.356321Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:13.356333Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:13.356343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:13.356389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:13.356423Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535281246641322:5267]
2025-10-02T08:16:13.356992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:13.357171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:13.357210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:13.357497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:13.357557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.357563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.357564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.357565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.357566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.357571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.357580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.357584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.357587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.357591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.357596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.357603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.357612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.357617Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.357621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.357627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.357635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.357640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.357645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.357654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.357673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:13.358097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535281246641248:5264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:13.358108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535281246641248:5264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:13.358111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535281246641248:5264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:13.358118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:13.365461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:13.367040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:13.367055Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:13.367058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:13.367062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:13.367069Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2628 [1:7556535281246641322:5267]
2025-10-02T08:16:13.367081Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:13.367096Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:13.367104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.367108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.367111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.367127Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:13.367137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:13.367148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:13.367211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.367219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.367222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:13.367224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:13.367285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:13.367292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.367304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.367320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:13.367342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246641345:5264], now have 1 active actors on pipe
2025-10-02T08:16:13.367348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2628
2025-10-02T08:16:13.367350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535281705964469:2378], now have 1 active actors on pipe
2025-10-02T08:16:13.367356Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535281246641307:5267]
2025-10-02T08:16:13.367363Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535281246641307:5267]
2025-10-02T08:16:13.367375Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:13.367389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:13.367391Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:13.367397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:13.367404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:13.367412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:13.367419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.367427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.367469Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535281246641307:5267]
2025-10-02T08:16:13.367476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:13.367486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:13.367490Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54390ca6-5718baad-6a517a05-97b3fb12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:13.367449Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2628
2025-10-02T08:16:13.367495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.367500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.367502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:13.367511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.367519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:13.367562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.367605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.367608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.367620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.367658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2629 partition: 0 MaxSeqNo: 17 sessionId: src_id|54390ca6-5718baad-6a517a05-97b3fb12_0
2025-10-02T08:16:13.367932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c19bf7e-1019e5ba-64938d22-9a94bf4b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|54390ca6-5718baad-6a517a05-97b3fb12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:13.370481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54390ca6-5718baad-6a517a05-97b3fb12_0] Write session: try to update token
2025-10-02T08:16:13.370494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54390ca6-5718baad-6a517a05-97b3fb12_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:13.383030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId: src_id|54390ca6-5718baad-6a517a05-97b3fb12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:13.384078Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:13.384091Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:13.384093Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:13.384102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535281246641307:5267]
2025-10-02T08:16:13.384106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535281246641307:5267]
2025-10-02T08:16:13.384147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:13.384154Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:13.384158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.384160Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:13.384160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:13.384304Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:13.385660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:13.441878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535281246641360:4064]
2025-10-02T08:16:13.441995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2628, pipe: [1:7556535281246641360:4064]
2025-10-02T08:16:13.520033Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:13.520294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.520304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.520341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246641360:4064], now have 1 active actors on pipe
2025-10-02T08:16:13.520424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535281246641360:4064]
2025-10-02T08:16:13.520441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:13.520443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:13.520488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2629 reason: error at write: Disconnected sessionId: src_id|54390ca6-5718baad-6a517a05-97b3fb12_0
2025-10-02T08:16:13.520536Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:13.520556Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:13.520620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2629 sessionId: src_id|54390ca6-5718baad-6a517a05-97b3fb12_0 is DEAD
2025-10-02T08:16:13.520744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54390ca6-5718baad-6a517a05-97b3fb12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:13.520753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54390ca6-5718baad-6a517a05-97b3fb12_0] Write session will restart in 0.008260s
2025-10-02T08:16:13.520778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54390ca6-5718baad-6a517a05-97b3fb12_0] Write session: Do CDS request
2025-10-02T08:16:13.520784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54390ca6-5718baad-6a517a05-97b3fb12_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:13.530289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54390ca6-5718baad-6a517a05-97b3fb12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.530392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:13.530405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2630
2025-10-02T08:16:13.530550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.530581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:13.530589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:13.530594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:13.531004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2630 sessionId:  describe result for acl check
2025-10-02T08:16:13.531034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:13.531040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:13.531041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:13.531046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535281246641805:5335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:13.531560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535281246641805:5335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:13.533425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535281246641805:5335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:13.534666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:13.534990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:13.535147Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:13.535158Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:13.535169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:13.535220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:13.535259Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535281246641897:5358]
2025-10-02T08:16:13.535833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:13.535993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:13.536034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:13.536191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535281246641805:5335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:13.536202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535281246641805:5335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:13.536205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535281246641805:5335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:13.536212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:13.536330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:13.536386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.536394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.536395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.536396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.536397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.536402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.536412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.536416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.536419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.536423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.536428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.536439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.536444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.536449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.536458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.536463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.536467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.536472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.536479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.536484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.536506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:13.544371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:13.546004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:13.546023Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:13.546025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:13.546028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:13.546035Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2629 [1:7556535281246641897:5358]
2025-10-02T08:16:13.546046Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:13.546063Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:13.546066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.546069Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.546071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.546087Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:13.546090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:13.546095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:13.546152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.546158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.546160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:13.546161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:13.546297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2629
2025-10-02T08:16:13.546317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:13.546319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.546328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.546336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:13.546351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246641908:5335], now have 1 active actors on pipe
2025-10-02T08:16:13.546354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535281705964485:2378], now have 1 active actors on pipe
2025-10-02T08:16:13.546358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.546362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.546378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535281246641891:5358]
2025-10-02T08:16:13.546386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535281246641891:5358]
2025-10-02T08:16:13.546392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:13.546377Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2629
2025-10-02T08:16:13.546408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:13.546426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:13.546428Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:13.546431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:13.546434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:13.546450Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd058471-69437714-23b0bc6f-27454785_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:13.546461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.546468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.546472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:13.546479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.546486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:13.546525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535281246641891:5358]
2025-10-02T08:16:13.546539Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:13.546555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.546571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:13.546610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.546612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.546625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.546665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2630 partition: 0 MaxSeqNo: 17 sessionId: src_id|fd058471-69437714-23b0bc6f-27454785_0
2025-10-02T08:16:13.546983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54390ca6-5718baad-6a517a05-97b3fb12_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fd058471-69437714-23b0bc6f-27454785_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:13.549737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd058471-69437714-23b0bc6f-27454785_0] Write session: try to update token
2025-10-02T08:16:13.549753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd058471-69437714-23b0bc6f-27454785_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:13.558426Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:13.558441Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:13.558451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535281246641891:5358]
2025-10-02T08:16:13.558495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:13.558513Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:13.558668Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:13.558813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:13.558963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:13.559098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:13.559291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:13.559333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:13.563520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId: src_id|fd058471-69437714-23b0bc6f-27454785_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:13.565952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:13.566022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.566035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.566068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:13.566090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:13.566150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.566166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.566342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.566435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.566518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.566595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.567185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.567200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.567277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.567337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.567409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.567481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.567528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.567537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.567611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.567672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.567734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.567799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.567847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.567856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.567926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.567992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.568060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.568142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.568189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.568197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.568264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.568326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.568392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.568454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.568497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.568504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.568567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.568622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.568678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.568737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.568779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.568784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.568873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.568939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.568998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.569058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.569099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.569105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.569165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.569220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.569278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.569341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.569382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.569387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.569447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.569511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.569575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.569631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.569671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.569676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.569736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:13.569795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:13.569881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:13.569941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:13.569981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:13.569986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:13.570019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:13.570073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.570090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.570098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:13.570127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:13.570145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:13.570152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:13.570155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:13.570158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:13.570563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:13.570585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:13.570589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:13.570592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:13.570593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:13.570595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:13.571053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:13.571071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:13.571075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:13.571078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:13.571081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:13.571083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:13.571654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:13.571679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:13.571685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:13.571688Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:13.571691Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:13.573024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:13.573044Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:13.573060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392973572
2025-10-02T08:16:13.573183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:13.573203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:13.573208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:13.573211Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:13.573215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:13.573218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:13.573697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:13.573720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:13.573725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:13.573728Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:13.573733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:13.573737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:13.574160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:13.574176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:13.574180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:13.574183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:13.574187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:13.574189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:13.574607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:13.574623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:13.574627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:13.575632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:13.575647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:13.575651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:13.575653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:13.575660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392973575
2025-10-02T08:16:13.575913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:13.575929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:13.575936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:13.575938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:13.575940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:13.575942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:13.576481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:13.576499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:13.576503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:13.576506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:13.576509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:13.576511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:13.576974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:13.576990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.577091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392973576
2025-10-02T08:16:13.577800Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:13.577819Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:13.577826Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:13.577836Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:13.579390Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:13.579398Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:13.579400Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:13.579408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535281246641891:5358]
2025-10-02T08:16:13.579411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535281246641891:5358]
2025-10-02T08:16:13.579456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:13.579462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.579463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:13.579511Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:13.579535Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:13.579585Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:13.620539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535281246641935:4064]
2025-10-02T08:16:13.620650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2629, pipe: [1:7556535281246641935:4064]
2025-10-02T08:16:13.715539Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:13.715957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246641935:4064], now have 1 active actors on pipe
2025-10-02T08:16:13.716097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:13.716106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:13.716131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2630 reason: error at write: Disconnected sessionId: src_id|fd058471-69437714-23b0bc6f-27454785_0
2025-10-02T08:16:13.716214Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:13.716224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:13.716287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2630 sessionId: src_id|fd058471-69437714-23b0bc6f-27454785_0 is DEAD
2025-10-02T08:16:13.716412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd058471-69437714-23b0bc6f-27454785_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:13.716422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd058471-69437714-23b0bc6f-27454785_0] Write session will restart in 0.005655s
2025-10-02T08:16:13.716424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535281246641935:4064]
2025-10-02T08:16:13.716446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd058471-69437714-23b0bc6f-27454785_0] Write session: Do CDS request
2025-10-02T08:16:13.716454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd058471-69437714-23b0bc6f-27454785_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:13.723281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd058471-69437714-23b0bc6f-27454785_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.723343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:13.723356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2631
2025-10-02T08:16:13.723528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.723559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:13.723568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:13.723572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:13.723964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2631 sessionId:  describe result for acl check
2025-10-02T08:16:13.723993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:13.724000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:13.724002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:13.724007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535281246642218:5382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:13.724539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535281246642218:5382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:13.727023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535281246642218:5382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:13.729867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535281246642218:5382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:13.729887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535281246642218:5382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:13.729890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535281246642218:5382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:13.729899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:13.730722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:13.731599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:13.731783Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:13.731795Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:13.731807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:13.731869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:13.731927Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535281246642482:5377]
2025-10-02T08:16:13.732566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:13.732773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:13.732837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:13.733111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:13.733173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.733180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.733181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.733182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.733183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.733188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.733197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.733201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.733204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.733208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.733213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.733220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.733225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.733230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.733236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.733241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.733245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.733250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.733255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.733260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.733278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:13.741723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:13.743745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:13.743760Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:13.743762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:13.743765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:13.743777Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2630 [1:7556535281246642482:5377]
2025-10-02T08:16:13.743789Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:13.743803Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:13.743806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.743808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.743810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.743823Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:13.743827Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:13.743832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:13.743907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.743914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.743916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:13.743918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:13.743979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:13.743987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.743997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.744009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:13.744021Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535281246642476:5377]
2025-10-02T08:16:13.744025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535281246642476:5377]
2025-10-02T08:16:13.744031Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:13.744039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2630
2025-10-02T08:16:13.744041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246642464:5382], now have 1 active actors on pipe
2025-10-02T08:16:13.744046Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:13.744049Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:13.744050Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:13.744060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:13.744080Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:13.744086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535281705964491:2378], now have 1 active actors on pipe
2025-10-02T08:16:13.744091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.744094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.744131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535281246642476:5377]
2025-10-02T08:16:13.744137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:13.744152Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:13.744159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:13.744127Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2630
2025-10-02T08:16:13.744161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.744164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.744168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:13.744182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.744190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:13.744235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.744334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.744340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.744350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.744378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2631 partition: 0 MaxSeqNo: 17 sessionId: src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0
2025-10-02T08:16:13.744768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd058471-69437714-23b0bc6f-27454785_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:13.747526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0] Write session: try to update token
2025-10-02T08:16:13.747546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:13.762522Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:13.762543Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:13.762546Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:13.762554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535281246642476:5377]
2025-10-02T08:16:13.762558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535281246642476:5377]
2025-10-02T08:16:13.762604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:13.762606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:13.762610Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.762613Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:13.762614Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:13.762753Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:13.764510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId: src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:13.767083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:13.816638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535281246642506:4064]
2025-10-02T08:16:13.816744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2630, pipe: [1:7556535281246642506:4064]
2025-10-02T08:16:13.897194Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:13.897511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.897520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.897552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246642506:4064], now have 1 active actors on pipe
2025-10-02T08:16:13.897684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:13.897694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:13.897725Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:13.897762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2631 reason: error at write: Disconnected sessionId: src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0
2025-10-02T08:16:13.897781Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:13.897935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2631 sessionId: src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0 is DEAD
2025-10-02T08:16:13.898000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535281246642506:4064]
2025-10-02T08:16:13.898075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:13.898087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0] Write session will restart in 0.008307s
2025-10-02T08:16:13.898111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0] Write session: Do CDS request
2025-10-02T08:16:13.898118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:13.907303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.907323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:13.907338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2632
2025-10-02T08:16:13.907518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:13.907546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:13.907553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:13.907556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:13.907827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2632 sessionId:  describe result for acl check
2025-10-02T08:16:13.907850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:13.907854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:13.907855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:13.907859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535281246642955:5457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:13.908257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535281246642955:5457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:13.910037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535281246642955:5457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:13.910420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:13.911191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:13.911327Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:13.911334Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:13.911340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:13.911372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:13.911395Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535281246643049:5436]
2025-10-02T08:16:13.911775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:13.911924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:13.911949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:13.912151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:13.912185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.912190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.912191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.912191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.912192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.912195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.912203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.912206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.912210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.912213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.912218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.912224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:13.912229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.912233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:13.912237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.912241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:13.912245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.912249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.912253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.912258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.912274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:13.912568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535281246642955:5457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:13.912579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535281246642955:5457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:13.912582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535281246642955:5457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:13.912589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:13.919923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:13.921359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:13.921375Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:13.921376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:13.921379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:13.921384Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2631 [1:7556535281246643049:5436]
2025-10-02T08:16:13.921392Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:13.921406Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:13.921408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.921411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.921412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.921424Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:13.921427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:13.921436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:13.921485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.921493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.921496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:13.921498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:13.921560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:13.921567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.921580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:13.921591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:13.921604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246643066:5457], now have 1 active actors on pipe
2025-10-02T08:16:13.921613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535281246643035:5436]
2025-10-02T08:16:13.921614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535281246643035:5436]
2025-10-02T08:16:13.921620Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:13.921625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2631
2025-10-02T08:16:13.921629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:13.921631Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:13.921636Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:13.921642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:13.921645Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:13.921652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535281705964499:2378], now have 1 active actors on pipe
2025-10-02T08:16:13.921656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.921660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.921691Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535281246643035:5436]
2025-10-02T08:16:13.921704Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:13.921719Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:13.921725Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:13.921729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:13.921732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:13.921734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:13.921721Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2631
2025-10-02T08:16:13.921743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:13.921758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:13.921803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.921849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:13.921854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:13.921866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:13.921904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2632 partition: 0 MaxSeqNo: 17 sessionId: src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0
2025-10-02T08:16:13.922243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|806587e4-c7b561bc-88ac18d7-a02bce4c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:13.924774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0] Write session: try to update token
2025-10-02T08:16:13.924788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:13.938247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId: src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:13.939208Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:13.939223Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:13.939225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:13.939234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535281246643035:5436]
2025-10-02T08:16:13.939238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535281246643035:5436]
2025-10-02T08:16:13.939280Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:13.939290Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:13.939299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:13.939305Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:13.939309Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:13.939439Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:13.940714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:13.997907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535281246643092:4064]
2025-10-02T08:16:13.998027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2631, pipe: [1:7556535281246643092:4064]
2025-10-02T08:16:14.070161Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:14.070517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.070530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.070561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535281246643092:4064], now have 1 active actors on pipe
2025-10-02T08:16:14.070691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535281246643092:4064]
2025-10-02T08:16:14.070711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:14.070713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:14.070743Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:14.070765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2632 reason: error at write: Disconnected sessionId: src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0
2025-10-02T08:16:14.070804Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:14.070919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2632 sessionId: src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0 is DEAD
2025-10-02T08:16:14.071082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:14.071092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0] Write session will restart in 0.008944s
2025-10-02T08:16:14.071112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0] Write session: Do CDS request
2025-10-02T08:16:14.071117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:14.081241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.081284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:14.081298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2633
2025-10-02T08:16:14.081472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.081508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:14.081514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:14.081517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:14.081971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2633 sessionId:  describe result for acl check
2025-10-02T08:16:14.082006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:14.082008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:14.082010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:14.082015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535285541610836:5463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:14.082510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535285541610836:5463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:14.084789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535285541610836:5463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:14.086115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:14.086475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:14.086709Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:14.086723Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:14.086736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:14.086799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:14.086835Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535285541610929:5475]
2025-10-02T08:16:14.087413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:14.087658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:14.087709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:14.087769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535285541610836:5463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:14.087780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535285541610836:5463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:14.087783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535285541610836:5463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:14.087790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:14.088078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:14.088140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.088146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.088147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.088148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.088149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.088155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.088164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.088168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.088172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.088175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.088181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.088189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.088198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.088203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.088208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.088213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.088217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.088225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.088233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.088239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.088261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:14.096257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:14.097791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:14.097806Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:14.097808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:14.097812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:14.097818Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2632 [1:7556535285541610929:5475]
2025-10-02T08:16:14.097828Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:14.097843Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:14.097847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.097850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.097854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.097869Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:14.097873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:14.097878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:14.097942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.097948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.097950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:14.097952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:14.098007Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:14.098012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.098019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.098029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:14.098045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535285541610923:5475]
2025-10-02T08:16:14.098046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535285541610923:5475]
2025-10-02T08:16:14.098051Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:14.098061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541610940:5463], now have 1 active actors on pipe
2025-10-02T08:16:14.098066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:14.098066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:14.098070Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:14.098074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:14.098076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2632
2025-10-02T08:16:14.098076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:14.098080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535286000931814:2378], now have 1 active actors on pipe
2025-10-02T08:16:14.098104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.098107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.098117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535285541610923:5475]
2025-10-02T08:16:14.098125Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:14.098137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:14.098144Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49b4f054-2d386fa4-646e7121-51c887d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:14.098148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.098153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.098154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:14.098160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.098167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:14.098152Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2632
2025-10-02T08:16:14.098181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.098245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.098250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.098259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.098289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2633 partition: 0 MaxSeqNo: 17 sessionId: src_id|49b4f054-2d386fa4-646e7121-51c887d7_0
2025-10-02T08:16:14.098600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bc8fed-65935147-dbb43eb9-ad135f3c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|49b4f054-2d386fa4-646e7121-51c887d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:14.100965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b4f054-2d386fa4-646e7121-51c887d7_0] Write session: try to update token
2025-10-02T08:16:14.100977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b4f054-2d386fa4-646e7121-51c887d7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:14.114184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId: src_id|49b4f054-2d386fa4-646e7121-51c887d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:14.115294Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:14.115309Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:14.115312Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:14.115319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535285541610923:5475]
2025-10-02T08:16:14.115324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535285541610923:5475]
2025-10-02T08:16:14.115363Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:14.115366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:14.115368Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:14.115373Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.115375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:14.115534Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:14.116983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:14.170946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535285541610962:4064]
2025-10-02T08:16:14.171064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2632, pipe: [1:7556535285541610962:4064]
2025-10-02T08:16:14.250631Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:14.250915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.250925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.250959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541610962:4064], now have 1 active actors on pipe
2025-10-02T08:16:14.251007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535285541610962:4064]
2025-10-02T08:16:14.251021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:14.251023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:14.251069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2633 reason: error at write: Disconnected sessionId: src_id|49b4f054-2d386fa4-646e7121-51c887d7_0
2025-10-02T08:16:14.251149Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:14.251196Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:14.251365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b4f054-2d386fa4-646e7121-51c887d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:14.251376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b4f054-2d386fa4-646e7121-51c887d7_0] Write session will restart in 0.007577s
2025-10-02T08:16:14.251402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b4f054-2d386fa4-646e7121-51c887d7_0] Write session: Do CDS request
2025-10-02T08:16:14.251411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b4f054-2d386fa4-646e7121-51c887d7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:14.251238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2633 sessionId: src_id|49b4f054-2d386fa4-646e7121-51c887d7_0 is DEAD
2025-10-02T08:16:14.260314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b4f054-2d386fa4-646e7121-51c887d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.260416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:14.260432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2634
2025-10-02T08:16:14.260538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.260569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:14.260578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:14.260581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:14.261030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2634 sessionId:  describe result for acl check
2025-10-02T08:16:14.261060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:14.261065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:14.261066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:14.261071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535285541611395:5508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:14.261490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535285541611395:5508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:14.263555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535285541611395:5508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:14.264796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:14.265100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:14.265245Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:14.265253Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:14.265262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:14.265298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:14.265329Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535285541611505:5501]
2025-10-02T08:16:14.265806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535285541611395:5508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:14.265818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535285541611395:5508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:14.265822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535285541611395:5508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:14.265830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:14.265958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:14.266109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:14.266145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:14.266428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:14.266464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.266469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.266470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.266471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.266472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.266477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.266487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.266491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.266499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.266502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.266511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.266521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.266526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.266532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.266540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.266545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.266553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.266562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.266571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.266579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.266600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:14.274073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:14.275798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:14.275817Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:14.275820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:14.275824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:14.275830Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2633 [1:7556535285541611505:5501]
2025-10-02T08:16:14.275842Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:14.275863Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:14.275870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.275873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.275875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.275889Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:14.275893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:14.275899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:14.275969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.275977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.275981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:14.275984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:14.276050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:14.276058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.276087Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.276103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:14.276119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2633
2025-10-02T08:16:14.276125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541611510:5508], now have 1 active actors on pipe
2025-10-02T08:16:14.276132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535285541611499:5501]
2025-10-02T08:16:14.276134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535285541611499:5501]
2025-10-02T08:16:14.276148Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:14.276158Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:14.276162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535286000931823:2378], now have 1 active actors on pipe
2025-10-02T08:16:14.276165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:14.276166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.276171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.276188Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:14.276206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:14.276213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:14.276222Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2633
2025-10-02T08:16:14.276256Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:14.276268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.276271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.276273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:14.276282Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.276291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:14.276304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535285541611499:5501]
2025-10-02T08:16:14.276320Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:14.276341Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:14.276356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.276440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.276448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.276467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.276509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2634 partition: 0 MaxSeqNo: 17 sessionId: src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0
2025-10-02T08:16:14.276843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b4f054-2d386fa4-646e7121-51c887d7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:14.279243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0] Write session: try to update token
2025-10-02T08:16:14.279259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:14.293958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId: src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:14.294384Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:14.294396Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:14.294397Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:14.294403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535285541611499:5501]
2025-10-02T08:16:14.294406Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535285541611499:5501]
2025-10-02T08:16:14.294440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:14.294448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.294450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:14.294460Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:14.294473Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:14.294574Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:14.296593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:14.351164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535285541611536:4064]
2025-10-02T08:16:14.351282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2633, pipe: [1:7556535285541611536:4064]
2025-10-02T08:16:14.423845Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:14.424084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.424098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.424129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541611536:4064], now have 1 active actors on pipe
2025-10-02T08:16:14.424240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535285541611536:4064]
2025-10-02T08:16:14.424268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:14.424274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:14.424333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2634 reason: error at write: Disconnected sessionId: src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0
2025-10-02T08:16:14.424372Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:14.424378Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:14.424476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2634 sessionId: src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0 is DEAD
2025-10-02T08:16:14.424565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:14.424573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0] Write session will restart in 0.009901s
2025-10-02T08:16:14.424598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0] Write session: Do CDS request
2025-10-02T08:16:14.424604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:14.435275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.435319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:14.435329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2635
2025-10-02T08:16:14.435469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.435489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:14.435496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:14.435498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:14.435940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2635 sessionId:  describe result for acl check
2025-10-02T08:16:14.435973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:14.435979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:14.435980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:14.435985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535285541612082:5608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:14.436225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:14.436334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535285541612082:5608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:14.436539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:14.436661Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:14.436668Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:14.436676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:14.436708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:14.436733Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535285541612095:5600]
2025-10-02T08:16:14.437137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:14.437276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:14.437312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:14.437530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:14.437560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.437564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.437565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.437565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.437566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.437569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.437575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.437577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.437579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.437581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.437584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.437588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.437591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.437594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.437596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.437599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.437601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.437606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.437610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.437612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.437622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:14.437672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535285541612082:5608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:14.443108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535285541612082:5608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:14.443121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535285541612082:5608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:14.443124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535285541612082:5608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:14.443131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:14.445007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:14.446396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:14.446410Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:14.446413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:14.446415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:14.446419Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2634 [1:7556535285541612095:5600]
2025-10-02T08:16:14.446426Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:14.446438Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:14.446439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.446441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.446442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.446453Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:14.446457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:14.446462Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:14.446500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.446502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.446504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:14.446506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:14.446552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:14.446558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.446565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.446572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:14.446583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541612131:5608], now have 1 active actors on pipe
2025-10-02T08:16:14.446591Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535285541612083:5600]
2025-10-02T08:16:14.446592Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535285541612083:5600]
2025-10-02T08:16:14.446597Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:14.446598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2634
2025-10-02T08:16:14.446604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535286000931851:2378], now have 1 active actors on pipe
2025-10-02T08:16:14.446611Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:14.446613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:14.446615Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:14.446623Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:14.446625Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:14.446630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.446634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.446664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535285541612083:5600]
2025-10-02T08:16:14.446671Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:14.446681Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:14.446687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.446689Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:14.446694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.446670Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2634
2025-10-02T08:16:14.446695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:14.446704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.446711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:14.446745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.446777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.446782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.446791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.446815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2635 partition: 0 MaxSeqNo: 17 sessionId: src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0
2025-10-02T08:16:14.447109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3309dd17-60a435b4-49c0bf2f-1fd0bbfb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:14.449332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0] Write session: try to update token
2025-10-02T08:16:14.449341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:14.461332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId: src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:14.462791Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:14.462809Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:14.462812Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:14.462819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535285541612083:5600]
2025-10-02T08:16:14.462823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535285541612083:5600]
2025-10-02T08:16:14.462862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:14.462865Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:14.462871Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:14.462872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.462876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:14.463013Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:14.464042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:14.524245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535285541612148:4064]
2025-10-02T08:16:14.524359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2634, pipe: [1:7556535285541612148:4064]
2025-10-02T08:16:14.590147Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:14.590530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.590543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.590580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541612148:4064], now have 1 active actors on pipe
2025-10-02T08:16:14.590692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535285541612148:4064]
2025-10-02T08:16:14.590711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:14.590718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:14.590770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2635 reason: error at write: Disconnected sessionId: src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0
2025-10-02T08:16:14.590798Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:14.590824Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:14.590925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2635 sessionId: src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0 is DEAD
2025-10-02T08:16:14.591109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:14.591120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0] Write session will restart in 0.005752s
2025-10-02T08:16:14.591143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0] Write session: Do CDS request
2025-10-02T08:16:14.591150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:14.598291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.598321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:14.598336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2636
2025-10-02T08:16:14.598507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.598545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:14.598554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:14.598557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:14.599085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2636 sessionId:  describe result for acl check
2025-10-02T08:16:14.599140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:14.599154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:14.599157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:14.599164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535285541612473:5625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:14.599751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535285541612473:5625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:14.602326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535285541612473:5625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:14.605502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535285541612473:5625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:14.605517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535285541612473:5625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:14.605520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535285541612473:5625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:14.605528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:14.606767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:14.607162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:14.607322Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:14.607331Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:14.607340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:14.607384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:14.607415Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535285541612703:5629]
2025-10-02T08:16:14.607866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:14.608023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:14.608048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:14.608242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:14.608267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.608270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.608271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.608272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.608272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.608275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.608281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.608283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.608285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.608287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.608290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.608294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.608297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.608300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.608302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.608305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.608309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.608311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.608313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.608316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.608325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:14.616107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:14.617912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:14.617927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:14.617930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:14.617933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:14.617938Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2635 [1:7556535285541612703:5629]
2025-10-02T08:16:14.617948Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:14.617963Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:14.617966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.617969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.617971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.617986Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:14.617992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:14.617998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:14.618056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.618063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.618066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:14.618069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:14.618132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:14.618140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.618153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.618165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:14.618182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541612693:5625], now have 1 active actors on pipe
2025-10-02T08:16:14.618190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535286000931858:2378], now have 1 active actors on pipe
2025-10-02T08:16:14.618189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2635
2025-10-02T08:16:14.618195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535285541612697:5629]
2025-10-02T08:16:14.618197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535285541612697:5629]
2025-10-02T08:16:14.618208Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:14.618221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:14.618222Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:14.618226Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:14.618238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:14.618245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:14.618251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.618255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.618294Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535285541612697:5629]
2025-10-02T08:16:14.618301Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:14.618280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2635
2025-10-02T08:16:14.618311Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:14.618315Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76ef4563-d96c123f-87d06307-3463e2cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:14.618320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.618326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.618328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:14.618337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.618344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:14.618385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.618448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.618456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.618467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.618503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2636 partition: 0 MaxSeqNo: 17 sessionId: src_id|76ef4563-d96c123f-87d06307-3463e2cb_0
2025-10-02T08:16:14.618878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6fb334-90833f65-2f2ecfa7-63f029c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|76ef4563-d96c123f-87d06307-3463e2cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:14.621371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ef4563-d96c123f-87d06307-3463e2cb_0] Write session: try to update token
2025-10-02T08:16:14.621385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ef4563-d96c123f-87d06307-3463e2cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:14.634950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId: src_id|76ef4563-d96c123f-87d06307-3463e2cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:14.635214Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:14.635225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:14.635228Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:14.635236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535285541612697:5629]
2025-10-02T08:16:14.635241Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535285541612697:5629]
2025-10-02T08:16:14.635283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:14.635296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.635300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:14.635328Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:14.635338Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:14.635442Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:14.637828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:14.690624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535285541612728:4064]
2025-10-02T08:16:14.690699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2635, pipe: [1:7556535285541612728:4064]
2025-10-02T08:16:14.766528Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:14.766939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.766952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.766988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541612728:4064], now have 1 active actors on pipe
2025-10-02T08:16:14.767082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:14.767092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:14.767149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2636 reason: error at write: Disconnected sessionId: src_id|76ef4563-d96c123f-87d06307-3463e2cb_0
2025-10-02T08:16:14.767193Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:14.767205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:14.767306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2636 sessionId: src_id|76ef4563-d96c123f-87d06307-3463e2cb_0 is DEAD
2025-10-02T08:16:14.767473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ef4563-d96c123f-87d06307-3463e2cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:14.767480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ef4563-d96c123f-87d06307-3463e2cb_0] Write session will restart in 0.009800s
2025-10-02T08:16:14.767471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535285541612728:4064]
2025-10-02T08:16:14.767502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ef4563-d96c123f-87d06307-3463e2cb_0] Write session: Do CDS request
2025-10-02T08:16:14.767508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ef4563-d96c123f-87d06307-3463e2cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:14.778230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ef4563-d96c123f-87d06307-3463e2cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.778279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:14.778292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2637
2025-10-02T08:16:14.778406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.778435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:14.778443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:14.778446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:14.778792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2637 sessionId:  describe result for acl check
2025-10-02T08:16:14.778818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:14.778824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:14.778825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:14.778830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535285541613233:5661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:14.779274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535285541613233:5661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:14.780967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:14.781134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535285541613233:5661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:14.781337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:14.781479Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:14.781490Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:14.781498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:14.781542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:14.781574Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535285541613271:5671]
2025-10-02T08:16:14.782181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:14.782365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:14.782404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:14.782701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:14.782736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.782741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.782742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.782743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.782744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.782748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.782756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.782764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.782767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.782771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.782775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.782781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.782786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.782790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.782798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.782804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.782808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.782817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.782821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.782826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.782845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:14.783374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535285541613233:5661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:14.783385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535285541613233:5661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:14.783388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535285541613233:5661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:14.783394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:14.790304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:14.791687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:14.791701Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:14.791705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:14.791708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:14.791714Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2636 [1:7556535285541613271:5671]
2025-10-02T08:16:14.791723Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:14.791739Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:14.791746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.791749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.791750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.791764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:14.791772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:14.791777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:14.791831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.791843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.791846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:14.791848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:14.791903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:14.791910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.791922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.791939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:14.791959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541613296:5661], now have 1 active actors on pipe
2025-10-02T08:16:14.791966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535286000931865:2378], now have 1 active actors on pipe
2025-10-02T08:16:14.791971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.791979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.791998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535285541613263:5671]
2025-10-02T08:16:14.792004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535285541613263:5671]
2025-10-02T08:16:14.792016Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:14.792029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:14.792030Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:14.792033Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:14.792019Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2636
2025-10-02T08:16:14.792047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:14.792051Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:14.792077Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|291f4479-e49622c9-8942d009-811652c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:14.792087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.792093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.792094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:14.792102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.792113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:14.792147Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535285541613263:5671]
2025-10-02T08:16:14.792158Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:14.792170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.792177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2636
2025-10-02T08:16:14.792181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:14.792207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.792213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.792226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.792256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2637 partition: 0 MaxSeqNo: 17 sessionId: src_id|291f4479-e49622c9-8942d009-811652c5_0
2025-10-02T08:16:14.792544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ef4563-d96c123f-87d06307-3463e2cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|291f4479-e49622c9-8942d009-811652c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:14.794851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|291f4479-e49622c9-8942d009-811652c5_0] Write session: try to update token
2025-10-02T08:16:14.794862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|291f4479-e49622c9-8942d009-811652c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:14.808495Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:14.808509Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:14.808510Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:14.808517Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535285541613263:5671]
2025-10-02T08:16:14.808520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535285541613263:5671]
2025-10-02T08:16:14.808551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:14.808559Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.808558Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:14.808560Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:14.808563Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:14.808683Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:14.808744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId: src_id|291f4479-e49622c9-8942d009-811652c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:14.811188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:14.867774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535285541613312:4064]
2025-10-02T08:16:14.867848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2636, pipe: [1:7556535285541613312:4064]
2025-10-02T08:16:14.943852Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:14.944193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.944208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.944248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541613312:4064], now have 1 active actors on pipe
2025-10-02T08:16:14.944468Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:14.944492Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:14.944889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:14.944959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|291f4479-e49622c9-8942d009-811652c5_0
2025-10-02T08:16:14.945002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535285541613312:4064]
2025-10-02T08:16:14.945117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2637 sessionId: src_id|291f4479-e49622c9-8942d009-811652c5_0 is DEAD
2025-10-02T08:16:14.945262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291f4479-e49622c9-8942d009-811652c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:14.945272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291f4479-e49622c9-8942d009-811652c5_0] Write session will restart in 0.009562s
2025-10-02T08:16:14.945295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291f4479-e49622c9-8942d009-811652c5_0] Write session: Do CDS request
2025-10-02T08:16:14.945301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291f4479-e49622c9-8942d009-811652c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:14.956360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|291f4479-e49622c9-8942d009-811652c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.956420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:14.956438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2638
2025-10-02T08:16:14.956622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:14.956656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:14.956661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:14.956665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:14.957106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2638 sessionId:  describe result for acl check
2025-10-02T08:16:14.957132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:14.957133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:14.957135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:14.957141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535285541613598:5684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:14.957572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535285541613598:5684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:14.960529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535285541613598:5684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:14.963553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535285541613598:5684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:14.963569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535285541613598:5684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:14.963573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535285541613598:5684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:14.963581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:14.964771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:14.965793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:14.965956Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:14.965969Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:14.965990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:14.966031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:14.966069Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535285541613881:5683]
2025-10-02T08:16:14.966461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:14.966675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:14.966731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:14.967057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:14.967118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.967124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.967126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.967127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.967129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.967134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.967144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.967154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.967158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.967162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.967167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.967175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:14.967180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.967186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:14.967191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.967196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:14.967200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.967204Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.967209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.967214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.967235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:14.975122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:14.976824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:14.976845Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:14.976847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:14.976850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:14.976856Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2637 [1:7556535285541613881:5683]
2025-10-02T08:16:14.976867Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:14.976885Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:14.976888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.976891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.976893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.976909Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:14.976918Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:14.976925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:14.976989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.976996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.976999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:14.977001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:14.977073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:14.977081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.977093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:14.977105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:14.977124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535285541613860:5684], now have 1 active actors on pipe
2025-10-02T08:16:14.977133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535286000931885:2378], now have 1 active actors on pipe
2025-10-02T08:16:14.977140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535285541613875:5683]
2025-10-02T08:16:14.977142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535285541613875:5683]
2025-10-02T08:16:14.977153Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:14.977166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:14.977168Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:14.977171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:14.977183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:14.977187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:14.977219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535285541613875:5683]
2025-10-02T08:16:14.977224Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2637
2025-10-02T08:16:14.977227Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:14.977261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:14.977263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2637
2025-10-02T08:16:14.977350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.977359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.977382Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:14.977393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:14.977402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:14.977403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:14.977412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:14.977425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:14.977443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.977467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:14.977473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:14.977486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:14.977521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2638 partition: 0 MaxSeqNo: 17 sessionId: src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0
2025-10-02T08:16:14.977819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|291f4479-e49622c9-8942d009-811652c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:14.980330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0] Write session: try to update token
2025-10-02T08:16:14.980344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:14.994712Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:14.994727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:14.994730Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:14.994742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535285541613875:5683]
2025-10-02T08:16:14.994747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535285541613875:5683]
2025-10-02T08:16:14.994764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId: src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:14.994786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:14.994793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:14.994795Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:14.994805Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:14.994811Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:14.994947Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:14.997096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:15.044955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535289836581202:4064]
2025-10-02T08:16:15.045441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2637, pipe: [1:7556535289836581202:4064]
2025-10-02T08:16:15.138169Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:15.138718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.138734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.139119Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:15.138774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836581202:4064], now have 1 active actors on pipe
2025-10-02T08:16:15.139058Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:15.139334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:15.139386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2638 reason: status is not ok: tablet will be restarted right now sessionId: src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0
2025-10-02T08:16:15.139522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2638 sessionId: src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0 is DEAD
2025-10-02T08:16:15.139552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535289836581202:4064]
2025-10-02T08:16:15.139702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:15.139713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0] Write session will restart in 0.009906s
2025-10-02T08:16:15.139745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0] Write session: Do CDS request
2025-10-02T08:16:15.139752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:15.151318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.151360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:15.151374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2639
2025-10-02T08:16:15.151545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.151575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:15.151584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:15.151587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:15.151991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2639 sessionId:  describe result for acl check
2025-10-02T08:16:15.152021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:15.152027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:15.152028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:15.152033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535289836581682:5700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:15.152760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535289836581682:5700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:15.154860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:15.155157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535289836581682:5700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:15.156079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:15.156425Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:15.156437Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:15.156449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:15.156506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:15.156545Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535289836581757:5704]
2025-10-02T08:16:15.157250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:15.157458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:15.157500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:15.157827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:15.157876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.157882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.157883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.157885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.157886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.157891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.157902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.157907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.157912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.157916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.157924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.157932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.157939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.157949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.157968Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.157978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.157983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.157988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.157993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.157999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.158020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:15.158889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535289836581682:5700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:15.158904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535289836581682:5700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:15.158907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535289836581682:5700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:15.158916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:15.166659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:15.168237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:15.168257Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:15.168260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:15.168263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:15.168270Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2638 [1:7556535289836581757:5704]
2025-10-02T08:16:15.168281Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:15.168293Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:15.168296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.168298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.168299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.168311Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:15.168315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:15.168320Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:15.168368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.168375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.168377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:15.168379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:15.168440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:15.168448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.168460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.168479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:15.168498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836581774:5700], now have 1 active actors on pipe
2025-10-02T08:16:15.168503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2638
2025-10-02T08:16:15.168504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535290295899188:2378], now have 1 active actors on pipe
2025-10-02T08:16:15.168509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535289836581741:5704]
2025-10-02T08:16:15.168510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535289836581741:5704]
2025-10-02T08:16:15.168521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:15.168535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.168539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.168539Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:15.168543Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:15.168554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:15.168573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:15.168580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:15.168622Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:15.168633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.168636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.168638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:15.168648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.168660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:15.168667Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535289836581741:5704]
2025-10-02T08:16:15.168670Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:15.168622Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2638
2025-10-02T08:16:15.168680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:15.168698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.168792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.168799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.168825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.168855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2639 partition: 0 MaxSeqNo: 17 sessionId: src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0
2025-10-02T08:16:15.169720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feb49a2f-22ad05fb-94c1b666-225a9c06_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:15.172266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0] Write session: try to update token
2025-10-02T08:16:15.172282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:15.180217Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:15.180235Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:15.180243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535289836581741:5704]
2025-10-02T08:16:15.180284Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:15.180289Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:15.180459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:15.180605Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:15.180752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:15.180912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:15.181100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:15.181151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:15.186691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId: src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:15.189314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:15.189389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.189402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.189435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:15.189455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:15.189510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.189524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.189699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.189764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.189851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.189916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.190349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.190362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.190432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.190494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.190559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.190627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.190672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.190680Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.190753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.190812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.190875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.190939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.190994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.191001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.191068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.191134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.191198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.191267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.191313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.191316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.191380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.191441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.191506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.191574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.191619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.191626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.191692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.191752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.191817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.191880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.191924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.191931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.191995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.192057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.192135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.192200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.192261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.192268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.192334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.192395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.192458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.192521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.192570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.192582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.192646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.192707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.192769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.192850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.192894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.192901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.192965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:15.193025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:15.193086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:15.193147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:15.193194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:15.193200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:15.193239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:15.193318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.193340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.193342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:15.193371Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:15.193387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:15.193395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:15.193398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:15.193401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:15.193784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:15.193809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:15.193819Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:15.193822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:15.193825Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:15.193833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:15.194423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:15.194444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:15.194456Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:15.194463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:15.194466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:15.194468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:15.194923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:15.194944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:15.194954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:15.194957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:15.194962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:15.196185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:15.196201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:15.196215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392975195
2025-10-02T08:16:15.196365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:15.196378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:15.196383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:15.196386Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:15.196394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:15.196397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:15.196877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:15.196896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:15.196902Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:15.196908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:15.196911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:15.196914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:15.197356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:15.197376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:15.197384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:15.197388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:15.197391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:15.197393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:15.197838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:15.197859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:15.197864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:15.198937Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:15.198956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:15.198961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:15.198964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:15.198972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392975198
2025-10-02T08:16:15.199271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:15.199291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:15.199298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:15.199301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:15.199304Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:15.199308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:15.199748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:15.199771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:15.199779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:15.199782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:15.199784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:15.199787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:15.200263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:15.200283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.200376Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392975200
2025-10-02T08:16:15.201145Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:15.201165Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:15.201176Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:15.201181Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:15.202754Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:15.202769Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:15.202771Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:15.202780Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535289836581741:5704]
2025-10-02T08:16:15.202784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535289836581741:5704]
2025-10-02T08:16:15.202837Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:15.202841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:15.202845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.202847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:15.202855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:15.202975Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:15.239850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535289836581794:4064]
2025-10-02T08:16:15.240088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2638, pipe: [1:7556535289836581794:4064]
2025-10-02T08:16:15.348873Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:15.349272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836581794:4064], now have 1 active actors on pipe
2025-10-02T08:16:15.349442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:15.349453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:15.349482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2639 reason: error at write: Disconnected sessionId: src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0
2025-10-02T08:16:15.349570Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:15.349562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:15.349666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2639 sessionId: src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0 is DEAD
2025-10-02T08:16:15.349779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:15.349786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0] Write session will restart in 0.008953s
2025-10-02T08:16:15.349808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0] Write session: Do CDS request
2025-10-02T08:16:15.349828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:15.349858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535289836581794:4064]
2025-10-02T08:16:15.360314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.360348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:15.360364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2640
2025-10-02T08:16:15.360558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.360604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:15.360615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:15.360619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:15.361093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2640 sessionId:  describe result for acl check
2025-10-02T08:16:15.361139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:15.361146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:15.361148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:15.361153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535289836582191:5729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:15.361705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535289836582191:5729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:15.364125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535289836582191:5729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:15.367386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:15.367625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535289836582191:5729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:15.367640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535289836582191:5729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:15.367643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535289836582191:5729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:15.367653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:15.369040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:15.369259Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:15.369278Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:15.369288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:15.369339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:15.369386Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535289836582355:5720]
2025-10-02T08:16:15.370049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:15.370237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:15.370281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:15.370513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:15.370540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.370544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.370545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.370545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.370546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.370549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.370556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.370558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.370560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.370562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.370565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.370569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.370573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.370576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.370578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.370580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.370583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.370585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.370588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.370590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.370601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:15.381267Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2639
2025-10-02T08:16:15.378951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:15.380771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:15.380779Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:15.380781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:15.380785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:15.380791Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2639 [1:7556535289836582355:5720]
2025-10-02T08:16:15.380847Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:15.380868Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:15.380871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.380874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.380876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.380891Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:15.380896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:15.380903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:15.380966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.380968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.380970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:15.380973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:15.381038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:15.381041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.381055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.381066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:15.381082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535289836582343:5720]
2025-10-02T08:16:15.381084Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535289836582343:5720]
2025-10-02T08:16:15.381093Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:15.381106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:15.381108Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:15.381112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:15.381120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:15.381123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:15.381133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836582351:5729], now have 1 active actors on pipe
2025-10-02T08:16:15.381136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2639
2025-10-02T08:16:15.381137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535290295899197:2378], now have 1 active actors on pipe
2025-10-02T08:16:15.381170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.381174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.381186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535289836582343:5720]
2025-10-02T08:16:15.381200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:15.381223Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:15.381228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.381235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.381237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:15.381245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.381254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:15.381272Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:15.381273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.381397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.381401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.381415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.381462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2640 partition: 0 MaxSeqNo: 17 sessionId: src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0
2025-10-02T08:16:15.381767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd3632-2ea4da86-a0828e7b-12e33a9e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:15.384431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0] Write session: try to update token
2025-10-02T08:16:15.384449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:15.398838Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:15.398857Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:15.398860Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:15.398869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535289836582343:5720]
2025-10-02T08:16:15.398873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535289836582343:5720]
2025-10-02T08:16:15.398912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:15.398918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.398920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:15.399022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:15.399035Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:15.399066Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:15.435804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId: src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:15.438401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:15.449945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535289836582416:4064]
2025-10-02T08:16:15.450049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2639, pipe: [1:7556535289836582416:4064]
2025-10-02T08:16:15.535089Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:15.535487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.535501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.535521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836582416:4064], now have 1 active actors on pipe
2025-10-02T08:16:15.535704Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:15.535780Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:15.535834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:15.535845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:15.535903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2640 reason: error at write: Disconnected sessionId: src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0
2025-10-02T08:16:15.536082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2640 sessionId: src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0 is DEAD
2025-10-02T08:16:15.536091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535289836582416:4064]
2025-10-02T08:16:15.536227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:15.536238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0] Write session will restart in 0.005721s
2025-10-02T08:16:15.536262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0] Write session: Do CDS request
2025-10-02T08:16:15.536268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:15.543219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.543317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:15.543332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2641
2025-10-02T08:16:15.543451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.543480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:15.543490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:15.543494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:15.543908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2641 sessionId:  describe result for acl check
2025-10-02T08:16:15.543942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:15.543948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:15.543949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:15.543955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535289836582736:5778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:15.544466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535289836582736:5778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:15.546803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535289836582736:5778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:15.549724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535289836582736:5778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:15.549739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535289836582736:5778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:15.549742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535289836582736:5778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:15.549752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:15.550093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:15.551101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:15.551257Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:15.551268Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:15.551277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:15.551318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:15.551357Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535289836582981:5801]
2025-10-02T08:16:15.551985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:15.552189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:15.552232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:15.552528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:15.552567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.552575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.552576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.552577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.552578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.552582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.552592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.552596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.552599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.552602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.552607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.552614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.552619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.552624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.552628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.552632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.552637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.552642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.552646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.552650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.552666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:15.560331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:15.561832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:15.561846Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:15.561848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:15.561851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:15.561859Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2640 [1:7556535289836582981:5801]
2025-10-02T08:16:15.561867Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:15.561881Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:15.561884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.561887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.561888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.561905Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:15.561910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:15.561916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:15.561963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.561969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.561972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:15.561973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:15.562022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:15.562028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.562037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.562044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:15.562061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535289836582975:5801]
2025-10-02T08:16:15.562071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535289836582975:5801]
2025-10-02T08:16:15.562078Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:15.562087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2640
2025-10-02T08:16:15.562087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:15.562090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836582972:5778], now have 1 active actors on pipe
2025-10-02T08:16:15.562090Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:15.562098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:15.562107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:15.562109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:15.562114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535290295899226:2378], now have 1 active actors on pipe
2025-10-02T08:16:15.562118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.562121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.562160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535289836582975:5801]
2025-10-02T08:16:15.562170Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:15.562185Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:15.562190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.562170Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2640
2025-10-02T08:16:15.562192Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:15.562194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.562195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:15.562203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.562210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:15.562237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.562298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.562308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.562321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.562356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2641 partition: 0 MaxSeqNo: 17 sessionId: src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0
2025-10-02T08:16:15.562631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b63eb4-320ad161-8b40e5a3-e365fdec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:15.565071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0] Write session: try to update token
2025-10-02T08:16:15.565084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:15.577652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId: src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:15.580175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:15.580677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.580695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.580710Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:15.580716Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:15.580718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:15.580723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535289836582975:5801]
2025-10-02T08:16:15.580727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535289836582975:5801]
2025-10-02T08:16:15.580759Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:15.580766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:15.580771Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:15.580771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.580773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:15.580909Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:15.636275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535289836583006:4064]
2025-10-02T08:16:15.636436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2640, pipe: [1:7556535289836583006:4064]
2025-10-02T08:16:15.713240Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:15.713730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:15.713768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:15.713771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836583006:4064], now have 1 active actors on pipe
2025-10-02T08:16:15.713877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:15.713886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:15.713905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2641 reason: error at write: Disconnected sessionId: src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0
2025-10-02T08:16:15.713993Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:15.714022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2641 sessionId: src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0 is DEAD
2025-10-02T08:16:15.714170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535289836583006:4064]
2025-10-02T08:16:15.714185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:15.714206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0] Write session will restart in 0.005649s
2025-10-02T08:16:15.714230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0] Write session: Do CDS request
2025-10-02T08:16:15.714235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:15.721261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.721296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:15.721309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2642
2025-10-02T08:16:15.721493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.721535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:15.721545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:15.721548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:15.721967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2642 sessionId:  describe result for acl check
2025-10-02T08:16:15.722000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:15.722008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:15.722010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:15.722015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535289836583292:5841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:15.722507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535289836583292:5841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:15.725150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535289836583292:5841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:15.728097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535289836583292:5841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:15.728109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535289836583292:5841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:15.728112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535289836583292:5841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:15.728121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:15.729618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:15.730785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:15.730952Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:15.730963Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:15.730973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:15.731021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:15.731059Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535289836583578:5834]
2025-10-02T08:16:15.731652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:15.731864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:15.731907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:15.732222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:15.732270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.732276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.732277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.732278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.732279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.732284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.732294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.732299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.732302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.732306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.732312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.732320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.732327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.732338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.732342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.732350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.732355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.732364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.732368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.732372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.732389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:15.740560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:15.742160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:15.742176Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:15.742180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:15.742184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:15.742190Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2641 [1:7556535289836583578:5834]
2025-10-02T08:16:15.742203Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:15.742219Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:15.742222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.742225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.742227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.742242Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:15.742248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:15.742254Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:15.742311Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.742317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.742321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:15.742323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:15.742388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:15.742394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.742407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.742423Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:15.742445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836583557:5841], now have 1 active actors on pipe
2025-10-02T08:16:15.742448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2641
2025-10-02T08:16:15.742458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535289836583572:5834]
2025-10-02T08:16:15.742460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535289836583572:5834]
2025-10-02T08:16:15.742466Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:15.742478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:15.742478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:15.742481Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:15.742490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:15.742494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:15.742500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535290295899232:2378], now have 1 active actors on pipe
2025-10-02T08:16:15.742504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.742508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.742546Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535289836583572:5834]
2025-10-02T08:16:15.742558Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:15.742564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:15.742572Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:15.742577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.742581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.742584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:15.742592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.742560Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2641
2025-10-02T08:16:15.742605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:15.742643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.742701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.742708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.742720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.742761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2642 partition: 0 MaxSeqNo: 17 sessionId: src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0
2025-10-02T08:16:15.743071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11c69b62-c8ea7697-76ef9717-68e01f39_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:15.745614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0] Write session: try to update token
2025-10-02T08:16:15.745630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:15.759225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId: src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:15.760868Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:15.760880Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:15.760882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:15.760889Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535289836583572:5834]
2025-10-02T08:16:15.760893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535289836583572:5834]
2025-10-02T08:16:15.760928Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:15.760934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.760936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:15.760952Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:15.760958Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:15.761078Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:15.761893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:15.814494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535289836583603:4064]
2025-10-02T08:16:15.814625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2641, pipe: [1:7556535289836583603:4064]
2025-10-02T08:16:15.899562Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:15.900204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.900220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.900259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836583603:4064], now have 1 active actors on pipe
2025-10-02T08:16:15.900374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:15.900381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:15.900435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2642 reason: error at write: Disconnected sessionId: src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0
2025-10-02T08:16:15.900517Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:15.900475Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:15.900606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2642 sessionId: src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0 is DEAD
2025-10-02T08:16:15.900772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535289836583603:4064]
2025-10-02T08:16:15.900851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:15.900860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0] Write session will restart in 0.005598s
2025-10-02T08:16:15.900888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0] Write session: Do CDS request
2025-10-02T08:16:15.900895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:15.907419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.907652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:15.907667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2643
2025-10-02T08:16:15.907787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:15.907833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:15.907857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:15.907865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:15.908249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2643 sessionId:  describe result for acl check
2025-10-02T08:16:15.908292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:15.908299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:15.908301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:15.908306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535289836583887:5878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:15.908950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535289836583887:5878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:15.911903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535289836583887:5878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:15.915572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535289836583887:5878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:15.915586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535289836583887:5878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:15.915589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535289836583887:5878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:15.915597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:15.923128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:15.924550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:15.924731Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:15.924741Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:15.924750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:15.924826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:15.924867Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535289836584173:5869]
2025-10-02T08:16:15.925544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:15.925752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:15.925794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:15.926087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:15.926143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.926149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.926150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.926151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.926153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.926157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.926167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.926172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.926175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.926179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.926184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.926192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:15.926197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.926202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:15.926206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.926210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:15.926214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.926219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.926223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.926227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.926244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:15.934441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:15.936219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:15.936235Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:15.936238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:15.936242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:15.936249Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2642 [1:7556535289836584173:5869]
2025-10-02T08:16:15.936261Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:15.936281Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:15.936284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.936287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.936290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.936307Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:15.936317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:15.936324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:15.936404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.936413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.936416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:15.936419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:15.936483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:15.936491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.936506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:15.936524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:15.936541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2642
2025-10-02T08:16:15.936546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535289836584135:5878], now have 1 active actors on pipe
2025-10-02T08:16:15.936549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535290295899240:2378], now have 1 active actors on pipe
2025-10-02T08:16:15.936555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535289836584167:5869]
2025-10-02T08:16:15.936558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535289836584167:5869]
2025-10-02T08:16:15.936569Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:15.936581Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:15.936584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.936584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:15.936588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.936606Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:15.936624Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:15.936631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:15.936644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2642
2025-10-02T08:16:15.936673Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7018bd7d-93711299-3d8c699c-35fa8720_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:15.936686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:15.936689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:15.936691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:15.936713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:15.936721Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:15.936729Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535289836584167:5869]
2025-10-02T08:16:15.936742Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:15.936756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:15.936774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.937043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:15.937057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:15.937074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:15.937114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2643 partition: 0 MaxSeqNo: 17 sessionId: src_id|7018bd7d-93711299-3d8c699c-35fa8720_0
2025-10-02T08:16:15.937468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1cee4a-38ce11b-332f4042-64bb68df_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7018bd7d-93711299-3d8c699c-35fa8720_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:15.940240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7018bd7d-93711299-3d8c699c-35fa8720_0] Write session: try to update token
2025-10-02T08:16:15.940259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7018bd7d-93711299-3d8c699c-35fa8720_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:15.955888Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:15.955904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:15.955907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:15.955914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535289836584167:5869]
2025-10-02T08:16:15.955918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535289836584167:5869]
2025-10-02T08:16:15.955951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:15.955957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:15.955959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:15.955971Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:15.955977Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:15.956093Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:15.961322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId: src_id|7018bd7d-93711299-3d8c699c-35fa8720_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:15.963967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:16.000919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535294131551507:4064]
2025-10-02T08:16:16.001062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2642, pipe: [1:7556535294131551507:4064]
2025-10-02T08:16:16.095101Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:16.095429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.095445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.095484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131551507:4064], now have 1 active actors on pipe
2025-10-02T08:16:16.095600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:16.095609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:16.095668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2643 reason: error at write: Disconnected sessionId: src_id|7018bd7d-93711299-3d8c699c-35fa8720_0
2025-10-02T08:16:16.095742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:16.095947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7018bd7d-93711299-3d8c699c-35fa8720_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:16.095956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7018bd7d-93711299-3d8c699c-35fa8720_0] Write session will restart in 0.005698s
2025-10-02T08:16:16.095976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7018bd7d-93711299-3d8c699c-35fa8720_0] Write session: Do CDS request
2025-10-02T08:16:16.095981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7018bd7d-93711299-3d8c699c-35fa8720_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:16.095706Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:16.095838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2643 sessionId: src_id|7018bd7d-93711299-3d8c699c-35fa8720_0 is DEAD
2025-10-02T08:16:16.095988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535294131551507:4064]
2025-10-02T08:16:16.103351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7018bd7d-93711299-3d8c699c-35fa8720_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.103416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:16.103433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2644
2025-10-02T08:16:16.103724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.103773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:16.103783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:16.103787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:16.104263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2644 sessionId:  describe result for acl check
2025-10-02T08:16:16.104294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:16.104300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:16.104302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:16.104306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535294131551824:5951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:16.104840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535294131551824:5951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:16.107374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535294131551824:5951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:16.110378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535294131551824:5951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:16.110394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535294131551824:5951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:16.110407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535294131551824:5951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:16.110416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:16.112735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:16.113132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:16.113310Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:16.113321Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:16.113334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:16.113399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:16.113440Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535294131552076:5920]
2025-10-02T08:16:16.114070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:16.114267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:16.114316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:16.114612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:16.114677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.114683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.114684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.114685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.114687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.114692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.114702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.114706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.114709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.114713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.114719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.114726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.114734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.114744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.114753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.114763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.114767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.114772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.114780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.114784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.114803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:16.122940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:16.124439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:16.124458Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:16.124461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:16.124466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:16.124473Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2643 [1:7556535294131552076:5920]
2025-10-02T08:16:16.124486Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:16.124504Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:16.124506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.124513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.124521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.124537Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:16.124546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:16.124552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:16.124612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.124620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.124623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:16.124625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:16.124751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2643
2025-10-02T08:16:16.124884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:16.124893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.124907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.124883Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2643
2025-10-02T08:16:16.124924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:16.124947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131552055:5951], now have 1 active actors on pipe
2025-10-02T08:16:16.124958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535294590866555:2378], now have 1 active actors on pipe
2025-10-02T08:16:16.124965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.124973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.124996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535294131552070:5920]
2025-10-02T08:16:16.125001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535294131552070:5920]
2025-10-02T08:16:16.125012Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:16.125025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:16.125044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:16.125045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:16.125049Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:16.125052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:16.125066Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:16.125076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.125079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.125081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:16.125090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.125102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:16.125141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535294131552070:5920]
2025-10-02T08:16:16.125151Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:16.125160Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:16.125166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.125213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.125220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.125234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.125272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2644 partition: 0 MaxSeqNo: 17 sessionId: src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0
2025-10-02T08:16:16.125591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7018bd7d-93711299-3d8c699c-35fa8720_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:16.127921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0] Write session: try to update token
2025-10-02T08:16:16.127933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:16.136671Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:16.136687Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:16.136695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535294131552070:5920]
2025-10-02T08:16:16.136735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:16.136752Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:16.136925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:16.137068Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:16.137238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:16.137387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:16.137579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:16.137617Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:16.140688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId: src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:16.143191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:16.143277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.143290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.143323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:16.143349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:16.143667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.143681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.143841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.143905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.143972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.144037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.144317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.144330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.144412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.144481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.144543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.144609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.144653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.144660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.144728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.144789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.144917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.144986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.145046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.145053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.145123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.145193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.145260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.145330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.145376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.145385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.145454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.145516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.145581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.145648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.145695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.145702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.145773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.145837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.145903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.145969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.146019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.146026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.146099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.146170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.146239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.146302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.146340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.146349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.146417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.146480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.146548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.146609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.146652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.146657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.146719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.146776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.146834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.146894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.146936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.146943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.147005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:16.147071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:16.147130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:16.147189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:16.147233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:16.147238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:16.147278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:16.147333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.147351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.147359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:16.147387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:16.147400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:16.147405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:16.147407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:16.147409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:16.147780Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:16.147805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:16.147810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:16.147812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:16.147814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:16.147816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:16.148332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:16.148352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:16.148357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:16.148363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:16.148365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:16.148367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:16.148875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:16.148891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:16.148897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:16.148899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:16.148901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:16.150056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:16.150072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:16.150089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392976149
2025-10-02T08:16:16.150215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:16.150227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:16.150231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:16.150233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:16.150236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:16.150238Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:16.150694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:16.150711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:16.150716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:16.150718Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:16.150720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:16.150724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:16.151172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:16.151188Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:16.151197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:16.151199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:16.151204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:16.151206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:16.151612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:16.151632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:16.151638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:16.152734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:16.152747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:16.152750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:16.152755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:16.152761Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392976152
2025-10-02T08:16:16.153059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:16.153084Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:16.153090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:16.153093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:16.153096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:16.153099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:16.153509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:16.153529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:16.153535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:16.153539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:16.153541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:16.153545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:16.153954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:16.153973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.154057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392976153
2025-10-02T08:16:16.154756Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:16.154783Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:16.154790Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:16.154797Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:16.156471Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:16.156487Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:16.156488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:16.156496Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535294131552070:5920]
2025-10-02T08:16:16.156499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535294131552070:5920]
2025-10-02T08:16:16.156532Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:16.156541Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:16.156550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:16.156554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.156555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:16.156685Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:16.195909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535294131552111:4064]
2025-10-02T08:16:16.196002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2643, pipe: [1:7556535294131552111:4064]
2025-10-02T08:16:16.302405Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:16.303067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131552111:4064], now have 1 active actors on pipe
2025-10-02T08:16:16.303212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535294131552111:4064]
2025-10-02T08:16:16.303241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:16.303247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:16.303277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2644 reason: error at write: Disconnected sessionId: src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0
2025-10-02T08:16:16.303281Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:16.303313Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:16.303584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:16.303593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0] Write session will restart in 0.007800s
2025-10-02T08:16:16.303616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0] Write session: Do CDS request
2025-10-02T08:16:16.303622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:16.303452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2644 sessionId: src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0 is DEAD
2025-10-02T08:16:16.312313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.312425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:16.312441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2645
2025-10-02T08:16:16.312586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.312621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:16.312626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:16.312630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:16.313051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2645 sessionId:  describe result for acl check
2025-10-02T08:16:16.313085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:16.313092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:16.313094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:16.313100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535294131552462:5958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:16.313634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535294131552462:5958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:16.315721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535294131552462:5958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:16.318886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535294131552462:5958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:16.318905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535294131552462:5958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:16.318908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535294131552462:5958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:16.318920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:16.323533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:16.324676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:16.324896Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:16.324908Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:16.324919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:16.324981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:16.325024Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535294131552684:5959]
2025-10-02T08:16:16.325651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:16.325868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:16.325923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:16.326274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:16.326346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.326352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.326354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.326355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.326357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.326363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.326373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.326377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.326380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.326384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.326390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.326397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.326408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.326413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.326418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.326428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.326433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.326438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.326448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.326453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.326479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:16.337805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:16.339769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:16.339792Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:16.339795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:16.339800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:16.339807Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2644 [1:7556535294131552684:5959]
2025-10-02T08:16:16.339819Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:16.339839Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:16.339843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.339846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.339847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.339862Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:16.339872Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:16.339882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:16.339938Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.339939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.339942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:16.339943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:16.340008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:16.340015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.340029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.340044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:16.340076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131552571:5958], now have 1 active actors on pipe
2025-10-02T08:16:16.340086Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535294131552678:5959]
2025-10-02T08:16:16.340088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535294131552678:5959]
2025-10-02T08:16:16.340094Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:16.340099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2644
2025-10-02T08:16:16.340106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535294590866565:2378], now have 1 active actors on pipe
2025-10-02T08:16:16.340108Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:16.340113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:16.340113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:16.340124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:16.340131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:16.340137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.340141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.340182Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535294131552678:5959]
2025-10-02T08:16:16.340200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:16.340211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:16.340215Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2ace97f-c5a5f203-957c7166-380a8487_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:16.340221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.340228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.340234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:16.340244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.340257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:16.340298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.340391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.340398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.340412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.340454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2645 partition: 0 MaxSeqNo: 17 sessionId: src_id|a2ace97f-c5a5f203-957c7166-380a8487_0
2025-10-02T08:16:16.340278Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2644
2025-10-02T08:16:16.340782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776a09bf-33623fae-64ecc7e8-a616b43d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a2ace97f-c5a5f203-957c7166-380a8487_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:16.343436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ace97f-c5a5f203-957c7166-380a8487_0] Write session: try to update token
2025-10-02T08:16:16.343452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ace97f-c5a5f203-957c7166-380a8487_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:16.361347Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:16.361367Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:16.361370Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:16.361380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535294131552678:5959]
2025-10-02T08:16:16.361385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535294131552678:5959]
2025-10-02T08:16:16.361431Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:16.361434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:16.361441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.361443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:16.361444Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:16.361614Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:16.362601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId: src_id|a2ace97f-c5a5f203-957c7166-380a8487_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:16.365356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:16.403290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535294131552708:4064]
2025-10-02T08:16:16.403452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2644, pipe: [1:7556535294131552708:4064]
2025-10-02T08:16:16.502858Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:16.503116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.503132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.503172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131552708:4064], now have 1 active actors on pipe
2025-10-02T08:16:16.503275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:16.503280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:16.503324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2645 reason: error at write: Disconnected sessionId: src_id|a2ace97f-c5a5f203-957c7166-380a8487_0
2025-10-02T08:16:16.503413Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:16.503479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2645 sessionId: src_id|a2ace97f-c5a5f203-957c7166-380a8487_0 is DEAD
2025-10-02T08:16:16.503456Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:16.503634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ace97f-c5a5f203-957c7166-380a8487_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:16.503643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ace97f-c5a5f203-957c7166-380a8487_0] Write session will restart in 0.007229s
2025-10-02T08:16:16.503669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ace97f-c5a5f203-957c7166-380a8487_0] Write session: Do CDS request
2025-10-02T08:16:16.503642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535294131552708:4064]
2025-10-02T08:16:16.503675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ace97f-c5a5f203-957c7166-380a8487_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:16.512308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ace97f-c5a5f203-957c7166-380a8487_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.512333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:16.512350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2646
2025-10-02T08:16:16.512527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.512570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:16.512575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:16.512578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:16.513026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2646 sessionId:  describe result for acl check
2025-10-02T08:16:16.513059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:16.513063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:16.513065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:16.513069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535294131553115:6077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:16.513560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535294131553115:6077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:16.516049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535294131553115:6077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:16.519116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:16.519530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535294131553115:6077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:16.519544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535294131553115:6077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:16.519548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535294131553115:6077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:16.519557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:16.520530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:16.520718Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:16.520727Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:16.520736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:16.520781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:16.520842Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535294131553320:6058]
2025-10-02T08:16:16.521523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:16.521721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:16.521764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:16.522052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:16.522100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.522106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.522107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.522108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.522109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.522114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.522125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.522129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.522133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.522137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.522143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.522151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.522157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.522162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.522167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.522173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.522178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.522188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.522193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.522199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.522219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:16.531016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:16.532649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:16.532670Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:16.532672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:16.532676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:16.532681Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2645 [1:7556535294131553320:6058]
2025-10-02T08:16:16.532694Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:16.532709Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:16.532710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.532712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.532713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.532725Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:16.532728Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:16.532733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:16.532790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.532817Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.532820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:16.532822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:16.532896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:16.532904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.532918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.532929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:16.532948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131553316:6077], now have 1 active actors on pipe
2025-10-02T08:16:16.532960Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535294131553308:6058]
2025-10-02T08:16:16.532962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535294131553308:6058]
2025-10-02T08:16:16.532966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2645
2025-10-02T08:16:16.532970Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:16.532979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535294590866593:2378], now have 1 active actors on pipe
2025-10-02T08:16:16.532981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:16.532984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:16.532993Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:16.533006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:16.533013Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:16.533020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.533023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.533066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535294131553308:6058]
2025-10-02T08:16:16.533074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:16.533070Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2645
2025-10-02T08:16:16.533089Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:16.533102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.533103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:16.533106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.533108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:16.533116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.533125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:16.533166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.533270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.533279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.533297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.533343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2646 partition: 0 MaxSeqNo: 17 sessionId: src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0
2025-10-02T08:16:16.533674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2ace97f-c5a5f203-957c7166-380a8487_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:16.536368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0] Write session: try to update token
2025-10-02T08:16:16.536382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:16.551327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId: src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:16.552722Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:16.552736Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:16.552738Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:16.552746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535294131553308:6058]
2025-10-02T08:16:16.552751Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535294131553308:6058]
2025-10-02T08:16:16.552796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:16.552814Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:16.552822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.552824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:16.552826Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:16.552960Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:16.553927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:16.604011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535294131553344:4064]
2025-10-02T08:16:16.604199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2645, pipe: [1:7556535294131553344:4064]
2025-10-02T08:16:16.686733Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:16.687001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.687012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.687048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131553344:4064], now have 1 active actors on pipe
2025-10-02T08:16:16.687158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535294131553344:4064]
2025-10-02T08:16:16.687192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:16.687195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:16.687265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2646 reason: error at write: Disconnected sessionId: src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0
2025-10-02T08:16:16.687268Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:16.687456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2646 sessionId: src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0 is DEAD
2025-10-02T08:16:16.687581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:16.687589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0] Write session will restart in 0.008228s
2025-10-02T08:16:16.687607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0] Write session: Do CDS request
2025-10-02T08:16:16.687615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:16.687900Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:16.697325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.697383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:16.697401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2647
2025-10-02T08:16:16.697555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.697597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:16.697602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:16.697605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:16.698028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2647 sessionId:  describe result for acl check
2025-10-02T08:16:16.698061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:16.698067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:16.698069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:16.698074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535294131553831:6130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:16.698622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535294131553831:6130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:16.700780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535294131553831:6130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:16.701719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:16.702062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:16.702246Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:16.702260Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:16.702273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:16.702336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:16.702380Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535294131553914:6123]
2025-10-02T08:16:16.702974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:16.703145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:16.703195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:16.703496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:16.703566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.703576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.703577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.703578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.703579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.703586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.703595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.703600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.703604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.703608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.703614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.703621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.703632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.703641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.703651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.703656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.703658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535294131553831:6130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:16.703664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535294131553831:6130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:16.703665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.703668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535294131553831:6130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:16.703670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.703675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.703677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:16.703680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.703698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:16.711504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:16.713268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:16.713282Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:16.713283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:16.713286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:16.713290Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2646 [1:7556535294131553914:6123]
2025-10-02T08:16:16.713299Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:16.713313Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:16.713315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.713317Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.713318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.713330Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:16.713333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:16.713338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:16.713399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.713406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.713408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:16.713409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:16.713456Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:16.713462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.713470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.713477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:16.713489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535294131553907:6123]
2025-10-02T08:16:16.713493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535294131553907:6123]
2025-10-02T08:16:16.713500Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:16.713510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:16.713518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:16.713523Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:16.713526Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:16.713528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2646
2025-10-02T08:16:16.713529Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:16.713530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131553927:6130], now have 1 active actors on pipe
2025-10-02T08:16:16.713554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535294590866600:2378], now have 1 active actors on pipe
2025-10-02T08:16:16.713559Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535294131553907:6123]
2025-10-02T08:16:16.713564Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:16.713569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.713569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:16.713572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.713610Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:16.713620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.713622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.713623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:16.713629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.713635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:16.713648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.713635Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2646
2025-10-02T08:16:16.713695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.713700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.713711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.713748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2647 partition: 0 MaxSeqNo: 17 sessionId: src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0
2025-10-02T08:16:16.714060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d85bdb-f792c76e-10806e0d-5558fcf9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:16.716673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0] Write session: try to update token
2025-10-02T08:16:16.716688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:16.730750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId: src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:16.731394Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:16.731417Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:16.731419Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:16.731429Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535294131553907:6123]
2025-10-02T08:16:16.731434Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535294131553907:6123]
2025-10-02T08:16:16.731487Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:16.731489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:16.731496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.731498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:16.731500Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:16.731697Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:16.733658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:16.787270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535294131553948:4064]
2025-10-02T08:16:16.787392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2646, pipe: [1:7556535294131553948:4064]
2025-10-02T08:16:16.868331Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:16.868560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.868571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.868600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131553948:4064], now have 1 active actors on pipe
2025-10-02T08:16:16.868695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:16.868701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:16.868711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535294131553948:4064]
2025-10-02T08:16:16.868747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2647 reason: error at write: Disconnected sessionId: src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0
2025-10-02T08:16:16.868838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:16.868909Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:16.868927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2647 sessionId: src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0 is DEAD
2025-10-02T08:16:16.869074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:16.869084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0] Write session will restart in 0.009855s
2025-10-02T08:16:16.869109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0] Write session: Do CDS request
2025-10-02T08:16:16.869116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:16.880242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.880249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:16.880264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2648
2025-10-02T08:16:16.880455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:16.880488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:16.880493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:16.880497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:16.880885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2648 sessionId:  describe result for acl check
2025-10-02T08:16:16.880915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:16.880921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:16.880923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:16.880928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535294131554405:6165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:16.881434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535294131554405:6165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:16.883865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535294131554405:6165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:16.884390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:16.885371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:16.885570Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:16.885579Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:16.885587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:16.885637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:16.885676Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535294131554521:6167]
2025-10-02T08:16:16.886248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:16.886441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:16.886460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535294131554405:6165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:16.886466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535294131554405:6165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:16.886474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535294131554405:6165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:16.886484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:16.886486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:16.886761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:16.886814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.886819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.886820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.886821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.886822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.886827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.886836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.886840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.886843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.886847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.886852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.886859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:16.886864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.886869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:16.886873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.886883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:16.886887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.886896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.886901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.886906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.886925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:16.894840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:16.896367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:16.896382Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:16.896384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:16.896386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:16.896391Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2647 [1:7556535294131554521:6167]
2025-10-02T08:16:16.896399Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:16.896415Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:16.896417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.896420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.896423Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.896438Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:16.896443Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:16.896451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:16.896515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.896522Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.896524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:16.896526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:16.896572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:16.896577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.896589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:16.896604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:16.896625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535294131554511:6167]
2025-10-02T08:16:16.896632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535294131554511:6167]
2025-10-02T08:16:16.896642Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:16.896654Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:16.896658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131554532:6165], now have 1 active actors on pipe
2025-10-02T08:16:16.896662Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:16.896663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2647
2025-10-02T08:16:16.896666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:16.896679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:16.896682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:16.896687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535294590866608:2378], now have 1 active actors on pipe
2025-10-02T08:16:16.896719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.896728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.896742Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535294131554511:6167]
2025-10-02T08:16:16.896756Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:16.896776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:16.896784Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d851857-5520fe1c-726e982a-33a26df8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:16.896790Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:16.896794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:16.896796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:16.896820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:16.896829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:16.896792Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2647
2025-10-02T08:16:16.896863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.896908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:16.896915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:16.896927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:16.896966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2648 partition: 0 MaxSeqNo: 17 sessionId: src_id|3d851857-5520fe1c-726e982a-33a26df8_0
2025-10-02T08:16:16.897316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd40e2b-4d89f54b-be3e8fe7-aa9a64ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3d851857-5520fe1c-726e982a-33a26df8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:16.899924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d851857-5520fe1c-726e982a-33a26df8_0] Write session: try to update token
2025-10-02T08:16:16.899940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d851857-5520fe1c-726e982a-33a26df8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:16.914087Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:16.914103Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:16.914106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:16.914112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535294131554511:6167]
2025-10-02T08:16:16.914116Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535294131554511:6167]
2025-10-02T08:16:16.914148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:16.914148Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:16.914153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:16.914154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:16.914155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:16.914284Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:16.921640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId: src_id|3d851857-5520fe1c-726e982a-33a26df8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:16.924382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:16.969040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535294131554565:4064]
2025-10-02T08:16:16.969187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2647, pipe: [1:7556535294131554565:4064]
2025-10-02T08:16:17.052215Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:17.052603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.052611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.052630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535294131554565:4064], now have 1 active actors on pipe
2025-10-02T08:16:17.052746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535294131554565:4064]
2025-10-02T08:16:17.052761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:17.052763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:17.052823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2648 reason: error at write: Disconnected sessionId: src_id|3d851857-5520fe1c-726e982a-33a26df8_0
2025-10-02T08:16:17.052876Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:17.053151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d851857-5520fe1c-726e982a-33a26df8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:17.053160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d851857-5520fe1c-726e982a-33a26df8_0] Write session will restart in 0.007554s
2025-10-02T08:16:17.053184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d851857-5520fe1c-726e982a-33a26df8_0] Write session: Do CDS request
2025-10-02T08:16:17.053192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d851857-5520fe1c-726e982a-33a26df8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:17.055077Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:17.052994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2648 sessionId: src_id|3d851857-5520fe1c-726e982a-33a26df8_0 is DEAD
2025-10-02T08:16:17.062328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d851857-5520fe1c-726e982a-33a26df8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.062426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:17.062441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2649
2025-10-02T08:16:17.062556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.062595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:17.062604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:17.062607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:17.063083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2649 sessionId:  describe result for acl check
2025-10-02T08:16:17.063115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:17.063120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:17.063121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:17.063126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535298426522215:6231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:17.063588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535298426522215:6231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:17.065935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535298426522215:6231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:17.069277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535298426522215:6231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:17.069291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535298426522215:6231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:17.069293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535298426522215:6231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:17.069303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:17.069764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:17.071077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:17.071224Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:17.071232Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:17.071239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:17.071273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:17.071307Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535298426522440:6239]
2025-10-02T08:16:17.071772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:17.071943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:17.071971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:17.072175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:17.072207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.072208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.072208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.072209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.072210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.072213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.072219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.072222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.072224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.072226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.072229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.072233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.072236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.072239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.072242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.072244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.072247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.072249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.072252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.072255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.072264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:17.080501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:17.081967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:17.081983Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:17.081985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:17.081987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:17.081993Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2648 [1:7556535298426522440:6239]
2025-10-02T08:16:17.082002Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:17.082016Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:17.082018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.082020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.082022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.082035Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:17.082039Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:17.082044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:17.082093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.082099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.082102Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:17.082103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:17.082222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2648
2025-10-02T08:16:17.082350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:17.082358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.082370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.082352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2648
2025-10-02T08:16:17.082387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:17.082406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426522431:6231], now have 1 active actors on pipe
2025-10-02T08:16:17.082412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535298885833923:2378], now have 1 active actors on pipe
2025-10-02T08:16:17.082416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.082419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.082433Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535298426522434:6239]
2025-10-02T08:16:17.082437Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535298426522434:6239]
2025-10-02T08:16:17.082445Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:17.082460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:17.082465Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:17.082468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:17.082471Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:17.082472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:17.082482Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:17.082486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.082489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.082490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:17.082496Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.082506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:17.082536Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535298426522434:6239]
2025-10-02T08:16:17.082546Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:17.082558Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:17.082559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.082616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.082622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.082634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.082671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2649 partition: 0 MaxSeqNo: 17 sessionId: src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0
2025-10-02T08:16:17.082981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d851857-5520fe1c-726e982a-33a26df8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:17.085427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0] Write session: try to update token
2025-10-02T08:16:17.085440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:17.093714Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:17.093731Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:17.093740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535298426522434:6239]
2025-10-02T08:16:17.093781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:17.093786Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:17.093962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:17.094102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:17.094248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:17.094389Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:17.094582Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:17.094626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:17.099132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId: src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:17.101863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:17.101929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.101943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.101978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:17.102001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:17.102050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.102069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.102234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.102297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.102364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.102432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.102479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.102488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.102556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.102624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.102690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.102758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.102803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.102810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.102879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.102942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.103002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.103065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.103111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.103118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.103184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.103249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.103318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.103384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.103429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.103436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.103504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.103566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.103630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.103702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.103748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.103756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.103826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.103889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.103950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.104016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.104077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.104086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.104152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.104212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.104282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.104351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.104396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.104403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.104468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.104526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.104592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.104655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.104701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.104709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.104772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.104856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.104926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.104987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.105036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.105044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.105111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.105174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.105238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.105303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.105352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.105360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.105404Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:17.105475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.105499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.105507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:17.105539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:17.105558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:17.105567Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:17.105571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:17.105574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:17.105985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:17.106016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:17.106023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:17.106027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:17.106030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:17.106033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:17.106766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:17.106782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:17.106789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:17.106792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:17.106796Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:17.106799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:17.107438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:17.107452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:17.107458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:17.107462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:17.107465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:17.108712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:17.108724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:17.108738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392977108
2025-10-02T08:16:17.108941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:17.108953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:17.108959Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:17.108963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:17.108967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:17.108971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:17.109479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:17.109509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:17.109515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:17.109519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:17.109522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:17.109532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:17.110030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:17.110061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:17.110070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:17.110075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:17.110085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:17.110089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:17.110594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:17.110620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:17.110632Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:17.111765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:17.111784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:17.111790Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:17.111794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:17.111803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392977111
2025-10-02T08:16:17.112139Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:17.112164Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:17.112170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:17.112176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:17.112181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:17.112187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:17.112651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:17.112675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:17.112681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:17.112685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:17.112689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:17.112693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:17.113215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:17.113237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.113343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392977112
2025-10-02T08:16:17.114121Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:17.114142Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:17.114149Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:17.114157Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:17.115741Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:17.115756Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:17.115758Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:17.115769Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535298426522434:6239]
2025-10-02T08:16:17.115773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535298426522434:6239]
2025-10-02T08:16:17.115833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:17.115835Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:17.115841Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:17.115843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.115849Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:17.115979Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:17.149266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535298426522476:4064]
2025-10-02T08:16:17.149383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2648, pipe: [1:7556535298426522476:4064]
2025-10-02T08:16:17.252340Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:17.252669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426522476:4064], now have 1 active actors on pipe
2025-10-02T08:16:17.252817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535298426522476:4064]
2025-10-02T08:16:17.252840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:17.252843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:17.252864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2649 reason: error at write: Disconnected sessionId: src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0
2025-10-02T08:16:17.252944Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:17.252924Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:17.253048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2649 sessionId: src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0 is DEAD
2025-10-02T08:16:17.253195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:17.253206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0] Write session will restart in 0.006248s
2025-10-02T08:16:17.253231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0] Write session: Do CDS request
2025-10-02T08:16:17.253237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:17.260254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.260310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:17.260324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2650
2025-10-02T08:16:17.260443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.260468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:17.260477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:17.260480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:17.260848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2650 sessionId:  describe result for acl check
2025-10-02T08:16:17.260881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:17.260882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:17.260883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:17.260888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535298426522850:6283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:17.261349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535298426522850:6283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:17.263716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535298426522850:6283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:17.266645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:17.266848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535298426522850:6283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:17.266861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535298426522850:6283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:17.266865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535298426522850:6283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:17.266871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:17.267844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:17.268023Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:17.268037Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:17.268048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:17.268118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:17.268158Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535298426523057:6277]
2025-10-02T08:16:17.268817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:17.269019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:17.269064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:17.269348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:17.269410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.269415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.269416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.269417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.269419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.269423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.269432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.269436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.269440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.269443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.269448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.269455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.269464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.269469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.269473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.269478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.269482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.269486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.269490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.269497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.269521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:17.277363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:17.278837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:17.278854Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:17.278857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:17.278861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:17.278867Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2649 [1:7556535298426523057:6277]
2025-10-02T08:16:17.278879Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:17.278895Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:17.278898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.278900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.278902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.278918Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:17.278923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:17.278930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:17.279002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.279011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.279014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:17.279016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:17.279077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:17.279085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.279098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.279109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:17.279114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2649
2025-10-02T08:16:17.279127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426523052:6283], now have 1 active actors on pipe
2025-10-02T08:16:17.279130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535298885833930:2378], now have 1 active actors on pipe
2025-10-02T08:16:17.279137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.279143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.279160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535298426523045:6277]
2025-10-02T08:16:17.279162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535298426523045:6277]
2025-10-02T08:16:17.279172Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:17.279185Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:17.279187Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:17.279193Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:17.279199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:17.279201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:17.279215Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:17.279225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.279228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.279230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:17.279238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.279249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:17.279227Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2649
2025-10-02T08:16:17.279283Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535298426523045:6277]
2025-10-02T08:16:17.279290Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:17.279301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.279300Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:17.279400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.279408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.279422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.279459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2650 partition: 0 MaxSeqNo: 17 sessionId: src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0
2025-10-02T08:16:17.279817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eafcb414-2aacd49c-9abdb9a6-1acd73c0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:17.282662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0] Write session: try to update token
2025-10-02T08:16:17.282682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:17.290505Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:17.290530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:17.290540Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535298426523045:6277]
2025-10-02T08:16:17.290587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:17.290756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:17.290908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:17.291054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:17.291197Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:17.291392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:17.291434Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:17.291512Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:17.297669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId: src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:17.300265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:17.300340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.300353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.300385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:17.300409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:17.300460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.300477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.300652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.300723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.300786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.300874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.300923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.300933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.301012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.301080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.301149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.301223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.301267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.301275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.301350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.301417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.301483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.301549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.301595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.301603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.301670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.301738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.301817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.301896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.301948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.301958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.302030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.302091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.302162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.302230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.302278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.302285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.302354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.302415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.302479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.302550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.302614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.302622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.302691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.302757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.302827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.302898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.302946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.302953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.303022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.303093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.303160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.303245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.303295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.303302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.303373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.303436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.303504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.303574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.303621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.303628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.303699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:17.303765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:17.303833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:17.303899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:17.303948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:17.303955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:17.303996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:17.304083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.304105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.304111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:17.304143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:17.304160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:17.304169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:17.304173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:17.304176Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:17.304596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:17.304627Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:17.304641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:17.304646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:17.304649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:17.304652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:17.305373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:17.305405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:17.305414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:17.305417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:17.305421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:17.305424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:17.305931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:17.305961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:17.305971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:17.305975Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:17.305983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:17.308309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:17.308339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:17.308352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392977307
2025-10-02T08:16:17.308541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:17.308563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:17.308570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:17.308574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:17.308582Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:17.308586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:17.309147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:17.309175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:17.309187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:17.309191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:17.309201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:17.309204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:17.309725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:17.309755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:17.309768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:17.309779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:17.309782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:17.309785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:17.310291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:17.310319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:17.310325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:17.311519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:17.311544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:17.311549Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:17.311553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:17.311562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392977311
2025-10-02T08:16:17.311882Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:17.311906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:17.311913Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:17.311916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:17.311919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:17.311923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:17.312471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:17.312500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:17.312507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:17.312511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:17.312514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:17.312518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:17.313050Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:17.313076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.313274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392977313
2025-10-02T08:16:17.317266Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:17.317295Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:17.317304Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:17.317313Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:17.318976Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:17.318991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:17.318993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:17.319000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535298426523045:6277]
2025-10-02T08:16:17.319005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535298426523045:6277]
2025-10-02T08:16:17.319058Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:17.319069Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:17.319073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:17.319078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.319080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:17.319217Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:17.353029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535298426523090:4064]
2025-10-02T08:16:17.353156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2649, pipe: [1:7556535298426523090:4064]
2025-10-02T08:16:17.454065Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:17.454587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426523090:4064], now have 1 active actors on pipe
2025-10-02T08:16:17.454707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535298426523090:4064]
2025-10-02T08:16:17.454736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:17.454746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:17.454778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2650 reason: error at write: Disconnected sessionId: src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0
2025-10-02T08:16:17.454797Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:17.454839Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:17.454998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2650 sessionId: src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0 is DEAD
2025-10-02T08:16:17.455089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:17.455099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0] Write session will restart in 0.009823s
2025-10-02T08:16:17.455122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0] Write session: Do CDS request
2025-10-02T08:16:17.455128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:17.466241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.466284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:17.466296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2651
2025-10-02T08:16:17.466420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.466451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:17.466457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:17.466461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:17.466867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2651 sessionId:  describe result for acl check
2025-10-02T08:16:17.466904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:17.466909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:17.466911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:17.466917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535298426523621:6338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:17.467463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535298426523621:6338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:17.469301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:17.469988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535298426523621:6338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:17.470582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:17.470777Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:17.470788Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:17.470797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:17.470847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:17.470890Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535298426523667:6392]
2025-10-02T08:16:17.471495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:17.471705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:17.471751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:17.471973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:17.472002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.472007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.472008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.472008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.472009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.472013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.472019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.472022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.472024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.472026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.472030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.472034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.472039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.472043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.472047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.472051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.472068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.472074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.472083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.472088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.472104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:17.472565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535298426523621:6338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:17.472579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535298426523621:6338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:17.472582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535298426523621:6338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:17.472590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:17.480416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:17.482049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:17.482065Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:17.482068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:17.482071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:17.482078Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2650 [1:7556535298426523667:6392]
2025-10-02T08:16:17.482089Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:17.482106Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:17.482109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.482112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.482114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.482130Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:17.482134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:17.482141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:17.482205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.482213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.482215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:17.482218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:17.482278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:17.482284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.482293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.482300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:17.482316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426523684:6338], now have 1 active actors on pipe
2025-10-02T08:16:17.482324Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535298426523651:6392]
2025-10-02T08:16:17.482325Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535298426523651:6392]
2025-10-02T08:16:17.482331Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:17.482344Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:17.482344Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:17.482348Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:17.482361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:17.482360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2650
2025-10-02T08:16:17.482363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:17.482369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535298885833936:2378], now have 1 active actors on pipe
2025-10-02T08:16:17.482403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.482412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.482425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535298426523651:6392]
2025-10-02T08:16:17.482441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:17.482469Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:17.482478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.482477Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:17.482449Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2650
2025-10-02T08:16:17.482481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.482483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:17.482490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.482499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:17.482521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.482746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.482761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.482789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.482839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2651 partition: 0 MaxSeqNo: 17 sessionId: src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0
2025-10-02T08:16:17.483156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeebd7e-cfd547c3-cf6b2be0-83d450be_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:17.485562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0] Write session: try to update token
2025-10-02T08:16:17.485576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:17.500603Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:17.500623Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:17.500625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:17.500632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535298426523651:6392]
2025-10-02T08:16:17.500637Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535298426523651:6392]
2025-10-02T08:16:17.500677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:17.500684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.500688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:17.500764Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:17.500781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:17.500837Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:17.529094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId: src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:17.531440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:17.554752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535298426523736:4064]
2025-10-02T08:16:17.554852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2650, pipe: [1:7556535298426523736:4064]
2025-10-02T08:16:17.654596Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:17.654902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.654918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.654940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426523736:4064], now have 1 active actors on pipe
2025-10-02T08:16:17.655035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535298426523736:4064]
2025-10-02T08:16:17.655055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:17.655057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:17.655109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2651 reason: error at write: Disconnected sessionId: src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0
2025-10-02T08:16:17.655161Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:17.655197Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:17.655290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2651 sessionId: src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0 is DEAD
2025-10-02T08:16:17.655423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:17.655432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0] Write session will restart in 0.005630s
2025-10-02T08:16:17.655452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0] Write session: Do CDS request
2025-10-02T08:16:17.655464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:17.662266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.662332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:17.662344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2652
2025-10-02T08:16:17.662509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.662536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:17.662545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:17.662548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:17.662878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2652 sessionId:  describe result for acl check
2025-10-02T08:16:17.662911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:17.662912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:17.662914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:17.662918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535298426524047:6437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:17.663315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535298426524047:6437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:17.665609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535298426524047:6437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:17.668780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535298426524047:6437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:17.668796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535298426524047:6437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:17.668833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535298426524047:6437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:17.668842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:17.670875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:17.671197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:17.671490Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:17.671504Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:17.671517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:17.671579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:17.671619Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535298426524322:6412]
2025-10-02T08:16:17.672073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:17.672235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:17.672263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:17.672447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:17.672475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.672479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.672480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.672480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.672481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.672484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.672490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.672492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.672494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.672496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.672499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.672504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.672507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.672510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.672512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.672515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.672517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.672520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.672523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.672525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.672535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:17.680266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:17.681849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:17.681870Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:17.681873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:17.681877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:17.681884Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2651 [1:7556535298426524322:6412]
2025-10-02T08:16:17.681896Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:17.681915Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:17.681919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.681922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.681924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.681941Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:17.681953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:17.681965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:17.682045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.682054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.682057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:17.682060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:17.682133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:17.682145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.682159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.682173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:17.682197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426524303:6437], now have 1 active actors on pipe
2025-10-02T08:16:17.682209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535298426524316:6412]
2025-10-02T08:16:17.682216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535298426524316:6412]
2025-10-02T08:16:17.682217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2651
2025-10-02T08:16:17.682224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:17.682236Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:17.682238Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:17.682249Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:17.682253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:17.682256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:17.682263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.682268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.682282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535298885833965:2378], now have 1 active actors on pipe
2025-10-02T08:16:17.682319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535298426524316:6412]
2025-10-02T08:16:17.682328Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:17.682344Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|739f6d34-4d4d8c89-28437032-466262f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:17.682354Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:17.682355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.682324Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2651
2025-10-02T08:16:17.682360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.682362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:17.682372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.682381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:17.682429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.682512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.682519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.682536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.682579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2652 partition: 0 MaxSeqNo: 17 sessionId: src_id|739f6d34-4d4d8c89-28437032-466262f3_0
2025-10-02T08:16:17.682894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a837aa-d7289eb2-23fb573e-fe1d3da0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|739f6d34-4d4d8c89-28437032-466262f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:17.685496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|739f6d34-4d4d8c89-28437032-466262f3_0] Write session: try to update token
2025-10-02T08:16:17.685513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|739f6d34-4d4d8c89-28437032-466262f3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:17.699329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId: src_id|739f6d34-4d4d8c89-28437032-466262f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:17.701015Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:17.701032Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:17.701034Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:17.701042Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535298426524316:6412]
2025-10-02T08:16:17.701047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535298426524316:6412]
2025-10-02T08:16:17.701097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:17.701103Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:17.701108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.701111Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:17.701111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:17.701264Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:17.702032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:17.754946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535298426524349:4064]
2025-10-02T08:16:17.755073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2651, pipe: [1:7556535298426524349:4064]
2025-10-02T08:16:17.833081Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:17.833669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.833684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.833723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426524349:4064], now have 1 active actors on pipe
2025-10-02T08:16:17.833826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535298426524349:4064]
2025-10-02T08:16:17.833842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:17.833843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:17.833891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2652 reason: error at write: Disconnected sessionId: src_id|739f6d34-4d4d8c89-28437032-466262f3_0
2025-10-02T08:16:17.833943Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:17.833967Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:17.834042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2652 sessionId: src_id|739f6d34-4d4d8c89-28437032-466262f3_0 is DEAD
2025-10-02T08:16:17.834198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739f6d34-4d4d8c89-28437032-466262f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:17.834208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739f6d34-4d4d8c89-28437032-466262f3_0] Write session will restart in 0.005091s
2025-10-02T08:16:17.834231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739f6d34-4d4d8c89-28437032-466262f3_0] Write session: Do CDS request
2025-10-02T08:16:17.834238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739f6d34-4d4d8c89-28437032-466262f3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:17.840298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|739f6d34-4d4d8c89-28437032-466262f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.840368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:17.840381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2653
2025-10-02T08:16:17.840496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:17.840527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:17.840538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:17.840542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:17.840928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2653 sessionId:  describe result for acl check
2025-10-02T08:16:17.840964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:17.840969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:17.840971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:17.840976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535298426524622:7995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:17.841374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535298426524622:7995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:17.843813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535298426524622:7995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:17.846679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535298426524622:7995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:17.846692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535298426524622:7995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:17.846695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535298426524622:7995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:17.846706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:17.848734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:17.849866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:17.850025Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:17.850033Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:17.850042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:17.850085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:17.850122Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535298426524939:6479]
2025-10-02T08:16:17.850703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:17.850870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:17.850905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:17.851177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:17.851217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.851223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.851224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.851225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.851226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.851230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.851239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.851243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.851246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.851248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.851253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.851259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:17.851265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.851269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:17.851273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.851277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:17.851281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.851286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.851295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.851299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.851321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:17.858590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:17.859983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:17.859997Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:17.859999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:17.860002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:17.860008Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2652 [1:7556535298426524939:6479]
2025-10-02T08:16:17.860019Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:17.860036Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:17.860038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.860041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.860043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.860067Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:17.860071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:17.860075Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:17.860122Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.860130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.860133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:17.860134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:17.860189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:17.860198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.860208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:17.860220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:17.860234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535298426524933:6479]
2025-10-02T08:16:17.860235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535298426524933:6479]
2025-10-02T08:16:17.860243Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:17.860256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426524911:7995], now have 1 active actors on pipe
2025-10-02T08:16:17.860256Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:17.860259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:17.860262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2652
2025-10-02T08:16:17.860266Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:17.860273Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:17.860275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:17.860279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535298885833974:2378], now have 1 active actors on pipe
2025-10-02T08:16:17.860301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.860309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.860322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535298426524933:6479]
2025-10-02T08:16:17.860332Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:17.860357Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:17.860367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:17.860371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:17.860339Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2652
2025-10-02T08:16:17.860372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:17.860379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:17.860384Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:17.860387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:17.860408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.860460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:17.860467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:17.860478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:17.860510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2653 partition: 0 MaxSeqNo: 17 sessionId: src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0
2025-10-02T08:16:17.860815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739f6d34-4d4d8c89-28437032-466262f3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:17.863228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0] Write session: try to update token
2025-10-02T08:16:17.863243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:17.875949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId: src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:17.877066Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:17.877081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:17.877083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:17.877091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535298426524933:6479]
2025-10-02T08:16:17.877095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535298426524933:6479]
2025-10-02T08:16:17.877129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:17.877129Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:17.877134Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:17.877139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:17.877140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:17.877270Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:17.878275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:17.934149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535298426524973:4064]
2025-10-02T08:16:17.934233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2652, pipe: [1:7556535298426524973:4064]
2025-10-02T08:16:18.002445Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:18.002870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.002885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.002917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535298426524973:4064], now have 1 active actors on pipe
2025-10-02T08:16:18.003027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:18.003039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:18.003086Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:18.003096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2653 reason: error at write: Disconnected sessionId: src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0
2025-10-02T08:16:18.003159Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:18.003246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2653 sessionId: src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0 is DEAD
2025-10-02T08:16:18.003394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:18.003404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0] Write session will restart in 0.005012s
2025-10-02T08:16:18.003400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535298426524973:4064]
2025-10-02T08:16:18.003426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0] Write session: Do CDS request
2025-10-02T08:16:18.003432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:18.009206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.009266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:18.009279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2654
2025-10-02T08:16:18.009373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.009400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:18.009408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:18.009412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:18.009715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2654 sessionId:  describe result for acl check
2025-10-02T08:16:18.009740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:18.009745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:18.009746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:18.009748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535302721492560:7983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:18.010120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535302721492560:7983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:18.011869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535302721492560:7983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:18.014272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535302721492560:7983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:18.014284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535302721492560:7983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:18.014286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535302721492560:7983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:18.014293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:18.017117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:18.018437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:18.018574Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:18.018582Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:18.018589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:18.018620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:18.018648Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535302721492871:7963]
2025-10-02T08:16:18.019074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:18.019214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:18.019244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:18.019432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:18.019459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.019463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.019464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.019464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.019465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.019468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.019474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.019476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.019478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.019480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.019483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.019487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.019491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.019494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.019496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.019499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.019501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.019504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.019506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.019509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.019518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:18.027347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:18.028941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:18.028956Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:18.028958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:18.028961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:18.028966Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2653 [1:7556535302721492871:7963]
2025-10-02T08:16:18.028978Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:18.028995Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:18.028998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.029001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.029003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.029015Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:18.029022Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:18.029029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:18.029082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.029089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.029093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:18.029095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:18.029150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:18.029155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.029164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.029170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:18.029185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535302721492865:7963]
2025-10-02T08:16:18.029189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535302721492865:7963]
2025-10-02T08:16:18.029196Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:18.029206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:18.029209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:18.029213Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:18.029217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:18.029219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:18.029227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721492798:7983], now have 1 active actors on pipe
2025-10-02T08:16:18.029228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2653
2025-10-02T08:16:18.029233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535303180801289:2378], now have 1 active actors on pipe
2025-10-02T08:16:18.029256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.029263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.029272Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535302721492865:7963]
2025-10-02T08:16:18.029280Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:18.029291Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:18.029299Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:18.029303Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.029305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.029307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:18.029314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.029321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:18.029312Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2653
2025-10-02T08:16:18.029346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.029404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.029409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.029417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.029447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2654 partition: 0 MaxSeqNo: 17 sessionId: src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0
2025-10-02T08:16:18.029767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112fe84a-75dc0755-b3190c1-53b63f7f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:18.032454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0] Write session: try to update token
2025-10-02T08:16:18.032472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:18.046023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId: src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:18.046881Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:18.046897Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:18.046900Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:18.046912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535302721492865:7963]
2025-10-02T08:16:18.046921Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535302721492865:7963]
2025-10-02T08:16:18.046950Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:18.046957Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:18.046963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:18.046969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.046971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:18.047105Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:18.048514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:18.103617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535302721492896:4064]
2025-10-02T08:16:18.103694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2653, pipe: [1:7556535302721492896:4064]
2025-10-02T08:16:18.131237Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:16:18.131256Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-02T08:16:18.193173Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:18.193563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.193577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.193617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721492896:4064], now have 1 active actors on pipe
2025-10-02T08:16:18.193775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535302721492896:4064]
2025-10-02T08:16:18.193881Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:18.193903Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-02T08:16:18.193813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:18.193816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:18.193875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2654 reason: error at write: Disconnected sessionId: src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0
2025-10-02T08:16:18.194034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2654 sessionId: src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0 is DEAD
2025-10-02T08:16:18.194181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:18.194190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0] Write session will restart in 0.005800s
2025-10-02T08:16:18.194215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0] Write session: Do CDS request
2025-10-02T08:16:18.194222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:18.194259Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:18.201228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.201369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:18.201382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2655
2025-10-02T08:16:18.201478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.201514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:18.201523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:18.201526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:18.201993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2655 sessionId:  describe result for acl check
2025-10-02T08:16:18.202025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:18.202028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:18.202030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:18.202035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535302721493219:8042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:18.202545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535302721493219:8042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:18.204913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535302721493219:8042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:18.207492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535302721493219:8042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:18.207506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535302721493219:8042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:18.207509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535302721493219:8042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:18.207516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:18.209591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:18.210870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:18.211037Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:18.211047Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:18.211056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:18.211098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:18.211132Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535302721493491:8025]
2025-10-02T08:16:18.211715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:18.211898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:18.211933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:18.212203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:18.212246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.212251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.212253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.212254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.212254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.212258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.212267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.212270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.212273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.212275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.212280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.212286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.212291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.212295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.212299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.212303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.212307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.212311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.212315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.212319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.212338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:18.220345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:18.221787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:18.221805Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:18.221808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:18.221811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:18.221818Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2654 [1:7556535302721493491:8025]
2025-10-02T08:16:18.221830Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:18.221848Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:18.221851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.221854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.221856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.221872Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:18.221877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:18.221884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:18.221952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.221964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.221967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:18.221970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:18.222100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2654
2025-10-02T08:16:18.222191Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2654
2025-10-02T08:16:18.222264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:18.222274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.222287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.222299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:18.222318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721493463:8042], now have 1 active actors on pipe
2025-10-02T08:16:18.222327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535303180801297:2378], now have 1 active actors on pipe
2025-10-02T08:16:18.222332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.222336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.222377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535302721493485:8025]
2025-10-02T08:16:18.222384Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535302721493485:8025]
2025-10-02T08:16:18.222396Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:18.222406Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:18.222409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:18.222412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:18.222426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:18.222433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:18.222447Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:18.222457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.222460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.222461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:18.222470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.222478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:18.222534Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:16:18.222583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535302721493485:8025]
2025-10-02T08:16:18.222591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:18.222593Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:18.222602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.222723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.222732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.222746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.222717Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 23 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:16:18.222750Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:16:18.222781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2655 partition: 0 MaxSeqNo: 17 sessionId: src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0
2025-10-02T08:16:18.223119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63922e2c-1da0dc3c-1618c719-6ca4364b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:18.225722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0] Write session: try to update token
2025-10-02T08:16:18.225746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:18.233434Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:18.233451Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:18.233459Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535302721493485:8025]
2025-10-02T08:16:18.233497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:18.233503Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:18.233699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:18.233830Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:18.233958Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:18.234094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:18.234277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:18.234315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:18.238755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId: src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:18.240950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:18.241015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.241025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.241050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:18.241068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:18.241111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.241128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.241288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.241354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.241419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.241481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.241761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.241773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.241837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.241899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.241964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.242029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.242072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.242079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.242145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.242206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.242266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.242328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.242372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.242379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.242442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.242506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.242568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.242629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.242672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.242679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.242742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.242797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.242857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.242917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.242961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.242969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.243030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.243090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.243152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.243219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.243262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.243269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.243335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.243401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.243473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.243537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.243580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.243587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.243647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.243703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.243763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.243822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.243864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.243871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.243934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.243995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.244070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.244134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.244178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.244186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.244251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:18.244309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:18.244369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:18.244430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:18.244471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:18.244478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:18.244522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:18.244588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.244609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.244616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:18.244648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:18.244663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:18.244670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:18.244673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:18.244680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:18.245075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:18.245102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:18.245114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:18.245118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:18.245126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:18.245130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:18.245738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:18.245764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:18.245774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:18.245778Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:18.245781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:18.245788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:18.246214Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:18.246234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:18.246241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:18.246248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:18.246252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:18.248409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:18.248433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:18.248445Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392978247
2025-10-02T08:16:18.248596Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:18.248616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:18.248626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:18.248629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:18.248638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:18.248641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:18.249117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:18.249144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:18.249149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:18.249152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:18.249157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:18.249160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:18.249612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:18.249635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:18.249649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:18.249656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:18.249659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:18.249662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:18.250115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:18.250140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:18.250146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:18.251195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:18.251212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:18.251219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:18.251222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:18.251230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392978251
2025-10-02T08:16:18.251524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:18.251548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:18.251555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:18.251558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:18.251560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:18.251564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:18.252022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:18.252049Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:18.252066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:18.252070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:18.252077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:18.252083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:18.252491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:18.252508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.252622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392978252
2025-10-02T08:16:18.253391Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:18.253409Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:18.253413Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:18.253417Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:18.254793Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:18.254806Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:18.254808Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:18.254818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535302721493485:8025]
2025-10-02T08:16:18.254821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535302721493485:8025]
2025-10-02T08:16:18.254872Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:18.254873Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:18.254879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:18.254881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.254883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:18.254998Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:18.294099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535302721493526:4064]
2025-10-02T08:16:18.294217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2654, pipe: [1:7556535302721493526:4064]
2025-10-02T08:16:18.397147Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:18.397541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721493526:4064], now have 1 active actors on pipe
2025-10-02T08:16:18.397667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:18.397676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:18.397705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2655 reason: error at write: Disconnected sessionId: src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0
2025-10-02T08:16:18.397759Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:18.397771Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:18.397886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2655 sessionId: src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0 is DEAD
2025-10-02T08:16:18.398032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:18.398041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0] Write session will restart in 0.006672s
2025-10-02T08:16:18.398065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0] Write session: Do CDS request
2025-10-02T08:16:18.398068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535302721493526:4064]
2025-10-02T08:16:18.398083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:18.406260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.406338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:18.406354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2656
2025-10-02T08:16:18.406470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.406499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:18.406507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:18.406510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:18.406890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2656 sessionId:  describe result for acl check
2025-10-02T08:16:18.406938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:18.406944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:18.406946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:18.406951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535302721493922:8088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:18.407476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535302721493922:8088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:18.410287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535302721493922:8088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:18.413093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535302721493922:8088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:18.413109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535302721493922:8088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:18.413112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535302721493922:8088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:18.413119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:18.414288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:18.414639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:18.414778Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:18.414786Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:18.414794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:18.414831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:18.414867Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535302721494122:8092]
2025-10-02T08:16:18.415497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:18.415664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:18.415701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:18.415987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:18.416023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.416028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.416029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.416030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.416031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.416036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.416046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.416050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.416064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.416068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.416072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.416083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.416089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.416094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.416098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.416103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.416108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.416113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.416117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.416123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.416142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:18.424015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:18.425691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:18.425705Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:18.425707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:18.425711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:18.425716Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2655 [1:7556535302721494122:8092]
2025-10-02T08:16:18.425728Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:18.425743Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:18.425746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.425749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.425751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.425764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:18.425770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:18.425776Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:18.425836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.425844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.425848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:18.425850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:18.425916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:18.425923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.425936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.425954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:18.425962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2655
2025-10-02T08:16:18.425976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721494113:8088], now have 1 active actors on pipe
2025-10-02T08:16:18.425979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535303180801308:2378], now have 1 active actors on pipe
2025-10-02T08:16:18.425984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.425988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.426005Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535302721494116:8092]
2025-10-02T08:16:18.426011Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535302721494116:8092]
2025-10-02T08:16:18.426026Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:18.426042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:18.426038Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2655
2025-10-02T08:16:18.426060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:18.426067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:18.426082Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:18.426087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.426091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.426092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:18.426100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.426107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:18.426136Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535302721494116:8092]
2025-10-02T08:16:18.426141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:18.426143Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:18.426143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:18.426148Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:18.426155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.426202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.426208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.426220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.426255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2656 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0
2025-10-02T08:16:18.426590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d59e4-2c811dce-76ad6a69-42dfbec5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:18.429077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0] Write session: try to update token
2025-10-02T08:16:18.429095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:18.442266Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:18.442285Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:18.442288Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:18.442296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535302721494116:8092]
2025-10-02T08:16:18.442301Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535302721494116:8092]
2025-10-02T08:16:18.442341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:18.442350Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:18.442353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.442355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:18.442356Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:18.442470Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:18.442676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId: src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:18.445065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:18.498354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535302721494148:4064]
2025-10-02T08:16:18.498459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2655, pipe: [1:7556535302721494148:4064]
2025-10-02T08:16:18.576379Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:18.577252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.577267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.577303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721494148:4064], now have 1 active actors on pipe
2025-10-02T08:16:18.577476Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:18.577757Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:18.578315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:18.578368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2656 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0
2025-10-02T08:16:18.578551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2656 sessionId: src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0 is DEAD
2025-10-02T08:16:18.578696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:18.578706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0] Write session will restart in 0.009156s
2025-10-02T08:16:18.578693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535302721494148:4064]
2025-10-02T08:16:18.578741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0] Write session: Do CDS request
2025-10-02T08:16:18.578748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:18.589288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.589319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:18.589334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2657
2025-10-02T08:16:18.589498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.589528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:18.589537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:18.589539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:18.589968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2657 sessionId:  describe result for acl check
2025-10-02T08:16:18.590005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:18.590007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:18.590008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:18.590013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535302721494706:8174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:18.590374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535302721494706:8174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:18.592608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535302721494706:8174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:18.592681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:18.594215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:18.594367Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:18.594373Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:18.594380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:18.594412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:18.594440Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535302721494773:8143]
2025-10-02T08:16:18.594851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:18.595038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:18.595070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:18.595272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:18.595303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.595307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.595308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.595308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.595309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.595312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.595318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.595320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.595322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.595323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.595327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.595331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.595335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.595338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.595340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.595343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.595345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.595347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.595350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.595352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.595357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535302721494706:8174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:18.595361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:18.595364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535302721494706:8174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:18.595367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535302721494706:8174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:18.595374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:18.603291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:18.605083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:18.605098Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:18.605101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:18.605104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:18.605110Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2656 [1:7556535302721494773:8143]
2025-10-02T08:16:18.605120Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:18.605137Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:18.605140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.605143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.605145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.605160Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:18.605165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:18.605170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:18.605236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.605246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.605248Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:18.605251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:18.605317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:18.605325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.605337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.605352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:18.605368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2656
2025-10-02T08:16:18.605372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721494787:8174], now have 1 active actors on pipe
2025-10-02T08:16:18.605378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535302721494757:8143]
2025-10-02T08:16:18.605380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535302721494757:8143]
2025-10-02T08:16:18.605388Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:18.605396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.605400Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:18.605404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:18.605404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.605423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:18.605438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:18.605444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:18.605449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535303180801335:2378], now have 1 active actors on pipe
2025-10-02T08:16:18.605490Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a21a8975-331571c4-3b01f911-e49963ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:18.605500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.605504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.605506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:18.605514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.605525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:18.605537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535302721494757:8143]
2025-10-02T08:16:18.605482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2656
2025-10-02T08:16:18.605543Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:18.605554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:18.605574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.605648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.605655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.605670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.605708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2657 partition: 0 MaxSeqNo: 17 sessionId: src_id|a21a8975-331571c4-3b01f911-e49963ae_0
2025-10-02T08:16:18.606087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d32fe0a-cdd109f6-18e5c4b7-74222995_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a21a8975-331571c4-3b01f911-e49963ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:18.608708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a21a8975-331571c4-3b01f911-e49963ae_0] Write session: try to update token
2025-10-02T08:16:18.608725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a21a8975-331571c4-3b01f911-e49963ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:18.622723Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:18.622740Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:18.622742Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:18.622750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535302721494757:8143]
2025-10-02T08:16:18.622751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId: src_id|a21a8975-331571c4-3b01f911-e49963ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:18.622754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535302721494757:8143]
2025-10-02T08:16:18.622793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:18.622799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.622801Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:18.622888Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:18.622904Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:18.622936Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:18.625523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:18.678597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535302721494805:4064]
2025-10-02T08:16:18.678688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2656, pipe: [1:7556535302721494805:4064]
2025-10-02T08:16:18.755231Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:18.755641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.755654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.755691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721494805:4064], now have 1 active actors on pipe
2025-10-02T08:16:18.755822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535302721494805:4064]
2025-10-02T08:16:18.755848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:18.755853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:18.755878Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:18.755920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2657 reason: error at write: Disconnected sessionId: src_id|a21a8975-331571c4-3b01f911-e49963ae_0
2025-10-02T08:16:18.755949Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:18.756122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2657 sessionId: src_id|a21a8975-331571c4-3b01f911-e49963ae_0 is DEAD
2025-10-02T08:16:18.756290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a21a8975-331571c4-3b01f911-e49963ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:18.756297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a21a8975-331571c4-3b01f911-e49963ae_0] Write session will restart in 0.008580s
2025-10-02T08:16:18.756324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a21a8975-331571c4-3b01f911-e49963ae_0] Write session: Do CDS request
2025-10-02T08:16:18.756331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a21a8975-331571c4-3b01f911-e49963ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:18.766293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a21a8975-331571c4-3b01f911-e49963ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.766397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:18.766412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2658
2025-10-02T08:16:18.766543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.766575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:18.766580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:18.766583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:18.767024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2658 sessionId:  describe result for acl check
2025-10-02T08:16:18.767055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:18.767059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:18.767061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:18.767067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535302721495237:8184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:18.767624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535302721495237:8184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:18.770593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535302721495237:8184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:18.773675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:18.773941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535302721495237:8184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:18.773954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535302721495237:8184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:18.773958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535302721495237:8184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:18.773966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:18.775130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:18.775322Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:18.775333Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:18.775344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:18.775402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:18.775446Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535302721495404:8180]
2025-10-02T08:16:18.776038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:18.776262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:18.776319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:18.776619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:18.776682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.776689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.776690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.776691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.776692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.776698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.776708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.776711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.776715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.776719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.776725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.776732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.776741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.776746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.776755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.776764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.776772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.776781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.776789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.776797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.776837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:18.785304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:18.787016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:18.787031Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:18.787034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:18.787038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:18.787044Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2657 [1:7556535302721495404:8180]
2025-10-02T08:16:18.787056Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:18.787074Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:18.787077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.787079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.787081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.787097Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:18.787101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:18.787108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:18.787188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.787198Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.787201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:18.787204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:18.787273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:18.787281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.787297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.787308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:18.787331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721495400:8184], now have 1 active actors on pipe
2025-10-02T08:16:18.787337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2657
2025-10-02T08:16:18.787341Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535302721495392:8180]
2025-10-02T08:16:18.787343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535302721495392:8180]
2025-10-02T08:16:18.787356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:18.787369Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:18.787370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535303180801343:2378], now have 1 active actors on pipe
2025-10-02T08:16:18.787377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.787379Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:18.787381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.787396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:18.787415Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:18.787422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:18.787465Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:18.787478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.787482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.787484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:18.787492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.787501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:18.787511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535302721495392:8180]
2025-10-02T08:16:18.787522Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:18.787554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.787553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:18.787558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2657
2025-10-02T08:16:18.787609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.787618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.787638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.787676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2658 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0
2025-10-02T08:16:18.788024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a21a8975-331571c4-3b01f911-e49963ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:18.790528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0] Write session: try to update token
2025-10-02T08:16:18.790545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:18.803276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId: src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:18.804751Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:18.804766Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:18.804768Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:18.804775Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535302721495392:8180]
2025-10-02T08:16:18.804779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535302721495392:8180]
2025-10-02T08:16:18.804826Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:18.804834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:18.804836Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:18.804840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.804842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:18.804977Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:18.805606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:18.855753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535302721495432:4064]
2025-10-02T08:16:18.855859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2657, pipe: [1:7556535302721495432:4064]
2025-10-02T08:16:18.934638Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:18.934847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.934858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.934887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721495432:4064], now have 1 active actors on pipe
2025-10-02T08:16:18.934969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535302721495432:4064]
2025-10-02T08:16:18.934995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:18.935007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:18.935068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2658 reason: error at write: Disconnected sessionId: src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0
2025-10-02T08:16:18.935081Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:18.935090Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:18.935235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2658 sessionId: src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0 is DEAD
2025-10-02T08:16:18.935342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:18.935352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0] Write session will restart in 0.005055s
2025-10-02T08:16:18.935377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0] Write session: Do CDS request
2025-10-02T08:16:18.935384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:18.941143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.941224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:18.941236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2659
2025-10-02T08:16:18.941315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:18.941345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:18.941351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:18.941354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:18.941653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2659 sessionId:  describe result for acl check
2025-10-02T08:16:18.941674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:18.941678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:18.941679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:18.941683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535302721495717:8210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:18.942073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535302721495717:8210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:18.944360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535302721495717:8210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:18.946545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535302721495717:8210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:18.946555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535302721495717:8210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:18.946557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535302721495717:8210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:18.946562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:18.948966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:18.950103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:18.950361Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:18.950379Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:18.950390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:18.950447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:18.950489Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535302721496032:8201]
2025-10-02T08:16:18.951067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:18.951241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:18.951287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:18.951564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:18.951616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.951623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.951624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.951625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.951625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.951630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.951639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.951655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.951659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.951662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.951668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.951675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:18.951680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.951685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:18.951688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.951691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:18.951693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.951696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.951698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.951701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.951713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:18.959581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:18.961361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:18.961377Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:18.961378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:18.961381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:18.961386Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2658 [1:7556535302721496032:8201]
2025-10-02T08:16:18.961394Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:18.961407Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:18.961408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.961410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.961411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.961423Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:18.961428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:18.961432Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:18.961490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.961497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.961500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:18.961503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:18.961570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:18.961578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.961589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:18.961599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:18.961614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2658
2025-10-02T08:16:18.961617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535302721495976:8210], now have 1 active actors on pipe
2025-10-02T08:16:18.961619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535303180801353:2378], now have 1 active actors on pipe
2025-10-02T08:16:18.961625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535302721496026:8201]
2025-10-02T08:16:18.961627Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535302721496026:8201]
2025-10-02T08:16:18.961638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:18.961647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.961655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.961657Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:18.961660Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:18.961673Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:18.961689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:18.961696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:18.961690Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2658
2025-10-02T08:16:18.961741Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:18.961753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:18.961756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:18.961757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:18.961766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:18.961779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:18.961790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535302721496026:8201]
2025-10-02T08:16:18.961799Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:18.961810Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:18.961830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.961869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:18.961875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:18.961889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:18.961922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2659 partition: 0 MaxSeqNo: 17 sessionId: src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0
2025-10-02T08:16:18.962234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ba30074-4e268b7d-f38430e0-e42393ec_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:18.964628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0] Write session: try to update token
2025-10-02T08:16:18.964641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:18.977399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId: src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:18.979120Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:18.979134Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:18.979136Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:18.979142Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535302721496026:8201]
2025-10-02T08:16:18.979146Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535302721496026:8201]
2025-10-02T08:16:18.979181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:18.979186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:18.979188Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:18.979190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:18.979191Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:18.979308Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:18.979576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:19.034942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535307016463365:4064]
2025-10-02T08:16:19.035015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2658, pipe: [1:7556535307016463365:4064]
2025-10-02T08:16:19.112345Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:19.112887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.112898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.112928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016463365:4064], now have 1 active actors on pipe
2025-10-02T08:16:19.113009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535307016463365:4064]
2025-10-02T08:16:19.113023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:19.113028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:19.113065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2659 reason: error at write: Disconnected sessionId: src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0
2025-10-02T08:16:19.113117Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:19.113149Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:19.113224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2659 sessionId: src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0 is DEAD
2025-10-02T08:16:19.113377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:19.113386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0] Write session will restart in 0.006098s
2025-10-02T08:16:19.113406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0] Write session: Do CDS request
2025-10-02T08:16:19.113410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:19.120202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.120265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:19.120278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2660
2025-10-02T08:16:19.120415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.120444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:19.120448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:19.120451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:19.120763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2660 sessionId:  describe result for acl check
2025-10-02T08:16:19.120791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:19.120796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:19.120810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:19.120816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535307016463715:8277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:19.121186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535307016463715:8277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:19.123595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535307016463715:8277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:19.126322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535307016463715:8277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:19.126338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535307016463715:8277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:19.126342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535307016463715:8277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:19.126350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:19.128106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:19.128502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:19.128645Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:19.128652Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:19.128660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:19.128698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:19.128733Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535307016463968:8249]
2025-10-02T08:16:19.129400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:19.129579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:19.129614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:19.129905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:19.129938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.129943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.129944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.129945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.129946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.129951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.129960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.129963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.129967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.129970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.129976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.129982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.129988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.129992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.129996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.130001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.130005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.130010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.130014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.130019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.130036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:19.137981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:19.139782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:19.139799Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:19.139801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:19.139805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:19.139811Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2659 [1:7556535307016463968:8249]
2025-10-02T08:16:19.139823Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:19.139839Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:19.139842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.139845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.139847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.139861Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:19.139865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:19.139871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:19.139937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.139945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.139947Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:19.139949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:19.140016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:19.140023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.140036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.140065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:19.140086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016463956:8277], now have 1 active actors on pipe
2025-10-02T08:16:19.140096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535307016463962:8249]
2025-10-02T08:16:19.140098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2659
2025-10-02T08:16:19.140099Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535307016463962:8249]
2025-10-02T08:16:19.140106Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:19.140114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535307475768668:2378], now have 1 active actors on pipe
2025-10-02T08:16:19.140115Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:19.140119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:19.140122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:19.140134Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:19.140143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:19.140150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.140157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.140193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535307016463962:8249]
2025-10-02T08:16:19.140200Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:19.140209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:19.140214Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9b6970a-357bb72b-6923159b-6b241e81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:19.140221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.140225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.140227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:19.140234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.140208Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2659
2025-10-02T08:16:19.140247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:19.140287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.140376Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.140383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.140395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.140434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2660 partition: 0 MaxSeqNo: 17 sessionId: src_id|e9b6970a-357bb72b-6923159b-6b241e81_0
2025-10-02T08:16:19.140787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de5e4b5-1daea304-5a93d582-d13c9d1f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e9b6970a-357bb72b-6923159b-6b241e81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:19.143502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b6970a-357bb72b-6923159b-6b241e81_0] Write session: try to update token
2025-10-02T08:16:19.143518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b6970a-357bb72b-6923159b-6b241e81_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:19.156041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId: src_id|e9b6970a-357bb72b-6923159b-6b241e81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:19.157342Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:19.157358Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:19.157361Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:19.157370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535307016463962:8249]
2025-10-02T08:16:19.157374Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535307016463962:8249]
2025-10-02T08:16:19.157415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:19.157420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:19.157426Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:19.157426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.157428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:19.157548Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:19.158484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:19.213115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535307016463993:4064]
2025-10-02T08:16:19.213228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2659, pipe: [1:7556535307016463993:4064]
2025-10-02T08:16:19.288858Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:19.289309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.289320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.289358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016463993:4064], now have 1 active actors on pipe
2025-10-02T08:16:19.289461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:19.289470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:19.289518Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:19.289531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2660 reason: error at write: Disconnected sessionId: src_id|e9b6970a-357bb72b-6923159b-6b241e81_0
2025-10-02T08:16:19.289608Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:19.289693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2660 sessionId: src_id|e9b6970a-357bb72b-6923159b-6b241e81_0 is DEAD
2025-10-02T08:16:19.289816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535307016463993:4064]
2025-10-02T08:16:19.289837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b6970a-357bb72b-6923159b-6b241e81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:19.289844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b6970a-357bb72b-6923159b-6b241e81_0] Write session will restart in 0.007774s
2025-10-02T08:16:19.289865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b6970a-357bb72b-6923159b-6b241e81_0] Write session: Do CDS request
2025-10-02T08:16:19.289869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b6970a-357bb72b-6923159b-6b241e81_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:19.298242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b6970a-357bb72b-6923159b-6b241e81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.298253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:19.298266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2661
2025-10-02T08:16:19.298458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.298484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:19.298493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:19.298496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:19.298837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2661 sessionId:  describe result for acl check
2025-10-02T08:16:19.298864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:19.298869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:19.298870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:19.298874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535307016464409:8299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:19.299232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535307016464409:8299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:19.301199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535307016464409:8299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:19.303766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:19.305319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:19.305482Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:19.305491Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:19.305499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:19.305543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:19.305577Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535307016464590:8302]
2025-10-02T08:16:19.305603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535307016464409:8299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:19.305617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535307016464409:8299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:19.305621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535307016464409:8299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:19.305628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:19.306130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:19.306298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:19.306331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:19.306598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:19.306634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.306639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.306640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.306641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.306642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.306646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.306653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.306661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.306664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.306670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.306675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.306685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.306689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.306693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.306702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.306709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.306712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.306716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.306723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.306726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.306745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:19.314245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:19.315994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:19.316007Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:19.316009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:19.316012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:19.316018Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2660 [1:7556535307016464590:8302]
2025-10-02T08:16:19.316028Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:19.316042Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:19.316050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.316065Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.316068Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.316081Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:19.316090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:19.316096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:19.316160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.316166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.316169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:19.316171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:19.316239Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:19.316246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.316255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2660
2025-10-02T08:16:19.316259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.316272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:19.316292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016464595:8299], now have 1 active actors on pipe
2025-10-02T08:16:19.316299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535307475768676:2378], now have 1 active actors on pipe
2025-10-02T08:16:19.316303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.316307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.316322Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535307016464584:8302]
2025-10-02T08:16:19.316328Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535307016464584:8302]
2025-10-02T08:16:19.316339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:19.316351Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:19.316354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:19.316358Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:19.316367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:19.316369Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:19.316343Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2660
2025-10-02T08:16:19.316384Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:19.316393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.316396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.316398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:19.316407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.316419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:19.316451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535307016464584:8302]
2025-10-02T08:16:19.316461Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:19.316468Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:19.316471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.316506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.316513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.316525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.316558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2661 partition: 0 MaxSeqNo: 17 sessionId: src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0
2025-10-02T08:16:19.316866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9b6970a-357bb72b-6923159b-6b241e81_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:19.319111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0] Write session: try to update token
2025-10-02T08:16:19.319123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:19.326306Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:19.326323Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:19.326330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535307016464584:8302]
2025-10-02T08:16:19.326363Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:19.326374Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:19.326863Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:19.327006Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:19.327145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:19.327287Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:19.327490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:19.327530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:19.331696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId: src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:19.334382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:19.334448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.334463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.334496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:19.334516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:19.334570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.334584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.334727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.334798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.334858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.334917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.334961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.334969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.335024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.335075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.335129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.335207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.335248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.335253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.335316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.335374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.335429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.335486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.335528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.335534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.335595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.335651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.335714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.335771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.335816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.335823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.335886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.335945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.336003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.336076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.336122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.336128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.336189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.336243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.336295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.336357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.336396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.336401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.336461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.336516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.336571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.336625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.336663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.336668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.336729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.336779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.336854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.336913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.336953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.336960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.337022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.337072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.337126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.337179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.337223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.337234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.337291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:19.337340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:19.337399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:19.337451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:19.337496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:19.337505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:19.337538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:19.337590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.337605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.337610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:19.337634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:19.337646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:19.337651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:19.337653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:19.337654Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:19.338004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:19.338028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:19.338037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:19.338039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:19.338041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:19.338043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:19.338584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:19.338603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:19.338607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:19.338609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:19.338611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:19.338615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:19.339064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:19.339081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:19.339085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:19.339087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:19.339088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:19.341019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:19.341034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:19.341045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392979340
2025-10-02T08:16:19.341158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:19.341172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:19.341179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:19.341182Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:19.341187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:19.341189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:19.341621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:19.341641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:19.341646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:19.341653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:19.341656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:19.341658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:19.342062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:19.342078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:19.342085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:19.342086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:19.342089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:19.342091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:19.342499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:19.342517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:19.342521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:19.343496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:19.343514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:19.343519Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:19.343523Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:19.343531Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392979343
2025-10-02T08:16:19.343785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:19.343799Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:19.343805Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:19.343810Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:19.343813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:19.343814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:19.344244Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:19.344267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:19.344273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:19.344276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:19.344279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:19.344282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:19.344700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:19.344718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.344814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392979344
2025-10-02T08:16:19.347994Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:19.348013Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:19.348017Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:19.348021Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:19.349555Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:19.349570Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:19.349572Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:19.349582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535307016464584:8302]
2025-10-02T08:16:19.349585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535307016464584:8302]
2025-10-02T08:16:19.349644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:19.349654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.349657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:19.349688Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:19.349699Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:19.349793Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:19.389761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535307016464629:4064]
2025-10-02T08:16:19.389863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2660, pipe: [1:7556535307016464629:4064]
2025-10-02T08:16:19.476012Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:19.476314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016464629:4064], now have 1 active actors on pipe
2025-10-02T08:16:19.476423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535307016464629:4064]
2025-10-02T08:16:19.476454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:19.476456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:19.476495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2661 reason: error at write: Disconnected sessionId: src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0
2025-10-02T08:16:19.476507Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:19.476531Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:19.476631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2661 sessionId: src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0 is DEAD
2025-10-02T08:16:19.476767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:19.476775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0] Write session will restart in 0.009229s
2025-10-02T08:16:19.476796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0] Write session: Do CDS request
2025-10-02T08:16:19.476826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:19.487278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.487323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:19.487335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2662
2025-10-02T08:16:19.487451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.487471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:19.487478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:19.487480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:19.487839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2662 sessionId:  describe result for acl check
2025-10-02T08:16:19.487866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:19.487871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:19.487872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:19.487875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535307016465156:8378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:19.488254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535307016465156:8378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:19.490319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535307016465156:8378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:19.490457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:19.491785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:19.491961Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:19.491969Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:19.491978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:19.492020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:19.492060Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535307016465231:8344]
2025-10-02T08:16:19.492292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535307016465156:8378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:19.492303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535307016465156:8378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:19.492306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535307016465156:8378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:19.492317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:19.492631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:19.492825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:19.492867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:19.493158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:19.493334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.493342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.493343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.493344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.493345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.493350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.493359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.493362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.493366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.493369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.493374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.493388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.493397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.493406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.493413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.493422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.493430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.493435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.493444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.493452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.493469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:19.501423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:19.502814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:19.502828Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:19.502830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:19.502832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:19.502837Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2661 [1:7556535307016465231:8344]
2025-10-02T08:16:19.502846Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:19.502862Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:19.502864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.502867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.502869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.502883Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:19.502887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:19.502892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:19.502943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.502950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.502954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:19.502956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:19.503019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:19.503027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.503040Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.503051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:19.503071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535307016465216:8344]
2025-10-02T08:16:19.503077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535307016465216:8344]
2025-10-02T08:16:19.503085Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:19.503098Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:19.503098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2661
2025-10-02T08:16:19.503102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016465236:8378], now have 1 active actors on pipe
2025-10-02T08:16:19.503108Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:19.503109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:19.503118Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:19.503120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:19.503124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535307475768682:2378], now have 1 active actors on pipe
2025-10-02T08:16:19.503127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.503132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.503163Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535307016465216:8344]
2025-10-02T08:16:19.503169Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:19.503182Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:19.503184Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:19.503191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.503163Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2661
2025-10-02T08:16:19.503196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.503198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:19.503208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.503217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:19.503256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.503302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.503308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.503321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.503356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2662 partition: 0 MaxSeqNo: 17 sessionId: src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0
2025-10-02T08:16:19.503652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0534d95-ba1abb4a-c76b003e-b5fe3a2d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:19.506242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0] Write session: try to update token
2025-10-02T08:16:19.506260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:19.520260Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:19.520275Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:19.520278Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:19.520288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535307016465216:8344]
2025-10-02T08:16:19.520292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535307016465216:8344]
2025-10-02T08:16:19.520331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:19.520342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.520344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:19.520348Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:19.520360Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:19.520476Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:19.525975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId: src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:19.528372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:19.576873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535307016465267:4064]
2025-10-02T08:16:19.577010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2661, pipe: [1:7556535307016465267:4064]
2025-10-02T08:16:19.655261Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:19.655573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.655584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.655599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016465267:4064], now have 1 active actors on pipe
2025-10-02T08:16:19.655696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535307016465267:4064]
2025-10-02T08:16:19.655717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:19.655719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:19.655769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2662 reason: error at write: Disconnected sessionId: src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0
2025-10-02T08:16:19.655838Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:19.655932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2662 sessionId: src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0 is DEAD
2025-10-02T08:16:19.656095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:19.656105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0] Write session will restart in 0.009982s
2025-10-02T08:16:19.656128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0] Write session: Do CDS request
2025-10-02T08:16:19.656137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:19.656465Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:19.667296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.667330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:19.667344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2663
2025-10-02T08:16:19.667486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.667517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:19.667526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:19.667529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:19.667907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2663 sessionId:  describe result for acl check
2025-10-02T08:16:19.667939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:19.667944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:19.667945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:19.667948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535307016465859:8475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:19.668308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535307016465859:8475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:19.670412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535307016465859:8475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:19.670949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:19.671363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:19.671662Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:19.671679Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:19.671699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:19.671772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:19.671813Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535307016465903:8482]
2025-10-02T08:16:19.672376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:19.672519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535307016465859:8475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:19.672522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:19.672531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535307016465859:8475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:19.672534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535307016465859:8475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:19.672541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:19.672552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:19.672831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:19.672873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.672879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.672880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.672881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.672881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.672886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.672894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.672897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.672900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.672903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.672907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.672913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.672918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.672922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.672927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.672931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.672935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.672938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.672942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.672946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.672961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:19.681063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:19.682706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:19.682722Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:19.682724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:19.682727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:19.682731Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2662 [1:7556535307016465903:8482]
2025-10-02T08:16:19.682739Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:19.682752Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:19.682757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.682760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.682761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.682772Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:19.682775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:19.682780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:19.682828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.682836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.682838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:19.682840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:19.682893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:19.682899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.682907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.682914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:19.682924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535307016465891:8482]
2025-10-02T08:16:19.682925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535307016465891:8482]
2025-10-02T08:16:19.682930Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:19.682940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:19.682947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:19.682953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:19.682958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:19.682960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016465914:8475], now have 1 active actors on pipe
2025-10-02T08:16:19.682961Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:19.682979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2662
2025-10-02T08:16:19.682982Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535307016465891:8482]
2025-10-02T08:16:19.682984Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:19.682986Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:19.682989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535307475768710:2378], now have 1 active actors on pipe
2025-10-02T08:16:19.682992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.682994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.683026Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:19.683034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.683036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.683037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:19.683042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.683047Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:19.683060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.683084Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2662
2025-10-02T08:16:19.683154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.683169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.683205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.683265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2663 partition: 0 MaxSeqNo: 17 sessionId: src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0
2025-10-02T08:16:19.683582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c38887-b5e25902-b04d02b1-b7b18ba2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:19.686168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0] Write session: try to update token
2025-10-02T08:16:19.686184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:19.699712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId: src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:19.700869Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:19.700887Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:19.700890Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:19.700899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535307016465891:8482]
2025-10-02T08:16:19.700904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535307016465891:8482]
2025-10-02T08:16:19.700938Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:19.700943Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:19.700952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:19.700961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.700963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:19.701148Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:19.702687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:19.755857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535307016465936:4064]
2025-10-02T08:16:19.755967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2662, pipe: [1:7556535307016465936:4064]
2025-10-02T08:16:19.833489Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:19.833737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.833747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.833781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016465936:4064], now have 1 active actors on pipe
2025-10-02T08:16:19.833887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:19.833899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:19.833945Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:19.833958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2663 reason: error at write: Disconnected sessionId: src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0
2025-10-02T08:16:19.834003Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:19.834118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2663 sessionId: src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0 is DEAD
2025-10-02T08:16:19.834207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535307016465936:4064]
2025-10-02T08:16:19.834256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:19.834266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0] Write session will restart in 0.008628s
2025-10-02T08:16:19.834289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0] Write session: Do CDS request
2025-10-02T08:16:19.834295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:19.844308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.844373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:19.844389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2664
2025-10-02T08:16:19.844501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:19.844531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:19.844540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:19.844543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:19.844912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2664 sessionId:  describe result for acl check
2025-10-02T08:16:19.844943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:19.844949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:19.844951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:19.844957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535307016466411:8516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:19.845333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535307016466411:8516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:19.848338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535307016466411:8516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:19.850606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:19.850809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535307016466411:8516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:19.850821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535307016466411:8516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:19.850824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535307016466411:8516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:19.850831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:19.850906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:19.851074Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:19.851087Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:19.851098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:19.851155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:19.851198Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535307016466547:8522]
2025-10-02T08:16:19.851836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:19.852067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:19.852115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:19.852401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:19.852457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.852463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.852464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.852465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.852467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.852471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.852480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.852489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.852492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.852500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.852505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.852517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:19.852528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.852533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:19.852538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.852543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:19.852546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.852552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.852556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.852560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.852579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:19.860837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:19.862716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:19.862733Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:19.862735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:19.862739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:19.862746Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2663 [1:7556535307016466547:8522]
2025-10-02T08:16:19.862757Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:19.862779Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:19.862788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.862791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.862793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.862808Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:19.862813Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:19.862822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:19.862891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.862899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.862902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:19.862904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:19.862977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:19.862985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.862998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:19.863010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:19.863032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2663
2025-10-02T08:16:19.863034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016466542:8516], now have 1 active actors on pipe
2025-10-02T08:16:19.863041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535307016466535:8522]
2025-10-02T08:16:19.863043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535307016466535:8522]
2025-10-02T08:16:19.863056Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:19.863069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535307475768719:2378], now have 1 active actors on pipe
2025-10-02T08:16:19.863071Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:19.863074Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:19.863080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.863084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.863100Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:19.863114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:19.863117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:19.863159Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:19.863170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:19.863145Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2663
2025-10-02T08:16:19.863179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:19.863186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:19.863195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:19.863208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:19.863220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535307016466535:8522]
2025-10-02T08:16:19.863228Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:19.863236Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:19.863260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.863316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:19.863324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:19.863337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:19.863373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2664 partition: 0 MaxSeqNo: 17 sessionId: src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0
2025-10-02T08:16:19.863663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac519c0-b4bb8cbf-6f8c5d6-7ed6ed73_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:19.866069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0] Write session: try to update token
2025-10-02T08:16:19.866081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:19.878639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId: src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:19.880590Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:19.880608Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:19.880610Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:19.880619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535307016466535:8522]
2025-10-02T08:16:19.880631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535307016466535:8522]
2025-10-02T08:16:19.880674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:19.880677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:19.880685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:19.880686Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:19.880687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:19.880866Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:19.881259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:19.934520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535307016466572:4064]
2025-10-02T08:16:19.934597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2663, pipe: [1:7556535307016466572:4064]
2025-10-02T08:16:20.013058Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:20.013478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.013489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.013519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535307016466572:4064], now have 1 active actors on pipe
2025-10-02T08:16:20.013663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535307016466572:4064]
2025-10-02T08:16:20.013643Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:20.013683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:20.013686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:20.013712Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:20.013749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2664 reason: error at write: Disconnected sessionId: src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0
2025-10-02T08:16:20.013907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2664 sessionId: src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0 is DEAD
2025-10-02T08:16:20.014082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:20.014090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0] Write session will restart in 0.007794s
2025-10-02T08:16:20.014116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0] Write session: Do CDS request
2025-10-02T08:16:20.014122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:20.023284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.023488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:20.023503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2665
2025-10-02T08:16:20.023607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.023637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:20.023645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:20.023649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:20.024129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2665 sessionId:  describe result for acl check
2025-10-02T08:16:20.024161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:20.024167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:20.024168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:20.024173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535311311434296:8527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:20.024838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535311311434296:8527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:20.028004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535311311434296:8527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:20.031301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:20.031597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535311311434296:8527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:20.031597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:20.031610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535311311434296:8527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:20.031613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535311311434296:8527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:20.031626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:20.031751Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:20.031769Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:20.031779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:20.031826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:20.031966Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535311311434488:8526]
2025-10-02T08:16:20.032551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:20.032743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:20.032791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:20.033098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:20.033145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.033151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.033153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.033154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.033155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.033160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.033169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.033173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.033177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.033180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.033185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.033197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.033207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.033212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.033221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.033230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.033238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.033248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.033256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.033262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.033282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:20.041429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:20.042899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:20.042918Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:20.042921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:20.042924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:20.042932Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2664 [1:7556535311311434488:8526]
2025-10-02T08:16:20.042945Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:20.042963Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:20.042976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.042979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.042981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.042997Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:20.043002Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:20.043009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:20.043077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.043086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.043092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:20.043095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:20.043173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:20.043181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.043195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.043205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:20.043229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311434487:8527], now have 1 active actors on pipe
2025-10-02T08:16:20.043230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2664
2025-10-02T08:16:20.043239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535311770736033:2378], now have 1 active actors on pipe
2025-10-02T08:16:20.043245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535311311434479:8526]
2025-10-02T08:16:20.043247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535311311434479:8526]
2025-10-02T08:16:20.043258Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:20.043267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.043273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.043275Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:20.043279Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:20.043291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:20.043309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:20.043316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:20.043309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2664
2025-10-02T08:16:20.043355Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|162cae2f-590f137e-2dc959d-c4532bfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:20.043364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.043368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.043371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:20.043379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.043387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:20.043398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535311311434479:8526]
2025-10-02T08:16:20.043406Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:20.043417Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:20.043438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.043507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.043514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.043530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.043570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2665 partition: 0 MaxSeqNo: 17 sessionId: src_id|162cae2f-590f137e-2dc959d-c4532bfa_0
2025-10-02T08:16:20.043881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc3bcdc-5ce14b6b-d0853adc-3fb393d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|162cae2f-590f137e-2dc959d-c4532bfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:20.046466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Write session: try to update token
2025-10-02T08:16:20.046485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:20.060236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId: src_id|162cae2f-590f137e-2dc959d-c4532bfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:20.061134Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:20.061149Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:20.061152Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:20.061160Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535311311434479:8526]
2025-10-02T08:16:20.061164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535311311434479:8526]
2025-10-02T08:16:20.061206Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:20.061208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:20.061215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.061217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:20.061219Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:20.061355Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:20.062933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:20.113743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535311311434515:4064]
2025-10-02T08:16:20.113841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2664, pipe: [1:7556535311311434515:4064]
2025-10-02T08:16:20.198811Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:20.199148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.199161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.199200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311434515:4064], now have 1 active actors on pipe
2025-10-02T08:16:20.199310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:20.199317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:20.199371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2665 reason: error at write: Disconnected sessionId: src_id|162cae2f-590f137e-2dc959d-c4532bfa_0
2025-10-02T08:16:20.199463Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:20.199469Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:20.199547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2665 sessionId: src_id|162cae2f-590f137e-2dc959d-c4532bfa_0 is DEAD
2025-10-02T08:16:20.199680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535311311434515:4064]
2025-10-02T08:16:20.199705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 155 BytesWritten: 38297624 MessagesWritten: 17 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 9011208 MessagesInflight: 10 }
2025-10-02T08:16:20.199732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:20.199737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Write session will restart in 0.008526s
2025-10-02T08:16:20.199762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Write session: Do CDS request
2025-10-02T08:16:20.199769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:20.209268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.209329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:20.209343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2666
2025-10-02T08:16:20.209480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.209509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:20.209518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:20.209522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:20.209918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2666 sessionId:  describe result for acl check
2025-10-02T08:16:20.209957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:20.209959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:20.209961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:20.209966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535311311434918:8558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:20.210470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535311311434918:8558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:20.213011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535311311434918:8558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:20.216000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535311311434918:8558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:20.216016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535311311434918:8558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:20.216019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535311311434918:8558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:20.216028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:20.217773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:20.218078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:20.218359Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:20.218372Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:20.218384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:20.218442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:20.218479Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535311311435130:8562]
2025-10-02T08:16:20.219113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:20.219284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:20.219325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:20.219625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:20.219673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.219679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.219680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.219681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.219683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.219688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.219699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.219703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.219707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.219711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.219717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.219724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.219735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.219740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.219746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.219752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.219757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.219766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.219771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.219777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.219795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:20.227421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:20.228907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:20.228927Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:20.228930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:20.228934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:20.228940Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2665 [1:7556535311311435130:8562]
2025-10-02T08:16:20.228951Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:20.228968Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:20.228971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.228974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.228975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.228990Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:20.228994Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:20.229001Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:20.229074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.229085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.229088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:20.229090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:20.229159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:20.229165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.229179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.229195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:20.229216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535311311435124:8562]
2025-10-02T08:16:20.229222Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535311311435124:8562]
2025-10-02T08:16:20.229232Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:20.229235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2665
2025-10-02T08:16:20.229249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311435118:8558], now have 1 active actors on pipe
2025-10-02T08:16:20.229252Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:20.229255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:20.229256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535311770736039:2378], now have 1 active actors on pipe
2025-10-02T08:16:20.229264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:20.229278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:20.229285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:20.229292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.229300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.229337Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535311311435124:8562]
2025-10-02T08:16:20.229345Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:20.229325Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2665
2025-10-02T08:16:20.229357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:20.229361Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:20.229367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.229371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.229373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:20.229382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.229394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:20.229434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.229478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.229484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.229496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.229533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2666 partition: 0 MaxSeqNo: 17 sessionId: src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0
2025-10-02T08:16:20.229861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162cae2f-590f137e-2dc959d-c4532bfa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:20.232398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0] Write session: try to update token
2025-10-02T08:16:20.232415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:20.246539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId: src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:20.246614Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:20.246631Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:20.246634Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:20.246642Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535311311435124:8562]
2025-10-02T08:16:20.246646Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535311311435124:8562]
2025-10-02T08:16:20.246690Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:20.246691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:20.246699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.246701Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:20.246701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:20.246841Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:20.249377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:20.299626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535311311435154:4064]
2025-10-02T08:16:20.299785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2665, pipe: [1:7556535311311435154:4064]
2025-10-02T08:16:20.393061Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:20.393443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.393456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.393493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311435154:4064], now have 1 active actors on pipe
2025-10-02T08:16:20.393614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535311311435154:4064]
2025-10-02T08:16:20.393635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:20.393640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:20.393702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2666 reason: error at write: Disconnected sessionId: src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0
2025-10-02T08:16:20.393705Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:20.393893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2666 sessionId: src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0 is DEAD
2025-10-02T08:16:20.394034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:20.394040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0] Write session will restart in 0.009658s
2025-10-02T08:16:20.394059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0] Write session: Do CDS request
2025-10-02T08:16:20.394065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:20.394246Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:20.405257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.405343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:20.405359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2667
2025-10-02T08:16:20.405459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.405489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:20.405499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:20.405507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:20.406014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2667 sessionId:  describe result for acl check
2025-10-02T08:16:20.406049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:20.406058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:20.406060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:20.406064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535311311435711:8616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:20.406536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535311311435711:8616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:20.407974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:20.408694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535311311435711:8616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:20.409303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:20.409584Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:20.409594Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:20.409604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:20.409650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:20.409684Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535311311435763:8570]
2025-10-02T08:16:20.410124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:20.410308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:20.410357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:20.410665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:20.410709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.410710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.410712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.410713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.410714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.410719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.410729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.410733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.410738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.410741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.410746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.410753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.410759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.410765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.410775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.410781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.410784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.410790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.410798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.410803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.410827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:20.411474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535311311435711:8616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:20.411486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535311311435711:8616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:20.411488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535311311435711:8616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:20.411497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:20.418732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:20.420224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:20.420237Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:20.420240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:20.420244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:20.420249Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2666 [1:7556535311311435763:8570]
2025-10-02T08:16:20.420257Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:20.420271Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:20.420272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.420275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.420276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.420287Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:20.420291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:20.420296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:20.420348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.420355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.420357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:20.420359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:20.420411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:20.420416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.420427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.420438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:20.420461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535311311435747:8570]
2025-10-02T08:16:20.420467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535311311435747:8570]
2025-10-02T08:16:20.420475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:20.420484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311435780:8616], now have 1 active actors on pipe
2025-10-02T08:16:20.420486Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:20.420489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535311770736047:2378], now have 1 active actors on pipe
2025-10-02T08:16:20.420489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:20.420490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2666
2025-10-02T08:16:20.420492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:20.420501Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:20.420506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:20.420534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.420541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.420551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535311311435747:8570]
2025-10-02T08:16:20.420562Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:20.420575Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2666
2025-10-02T08:16:20.420583Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aec46430-f894879-19413593-9b76e065_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:20.420583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:20.420592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.420595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.420596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:20.420604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.420611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:20.420630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.420670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.420676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.420685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.420716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2667 partition: 0 MaxSeqNo: 17 sessionId: src_id|aec46430-f894879-19413593-9b76e065_0
2025-10-02T08:16:20.421050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb7b225-b14a0785-b649eb01-4867c9ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aec46430-f894879-19413593-9b76e065_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:20.423544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec46430-f894879-19413593-9b76e065_0] Write session: try to update token
2025-10-02T08:16:20.423566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec46430-f894879-19413593-9b76e065_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:20.437127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId: src_id|aec46430-f894879-19413593-9b76e065_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:20.438349Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:20.438363Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:20.438365Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:20.438372Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535311311435747:8570]
2025-10-02T08:16:20.438376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535311311435747:8570]
2025-10-02T08:16:20.438411Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:20.438415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:20.438421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.438424Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:20.438425Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:20.438560Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:20.439691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:20.493630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535311311435793:4064]
2025-10-02T08:16:20.493716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2666, pipe: [1:7556535311311435793:4064]
2025-10-02T08:16:20.565292Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:20.565563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.565576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.565617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311435793:4064], now have 1 active actors on pipe
2025-10-02T08:16:20.565746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535311311435793:4064]
2025-10-02T08:16:20.565773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:20.565780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:20.565843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2667 reason: error at write: Disconnected sessionId: src_id|aec46430-f894879-19413593-9b76e065_0
2025-10-02T08:16:20.565849Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:20.566024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2667 sessionId: src_id|aec46430-f894879-19413593-9b76e065_0 is DEAD
2025-10-02T08:16:20.566046Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:20.566177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec46430-f894879-19413593-9b76e065_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:20.566185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec46430-f894879-19413593-9b76e065_0] Write session will restart in 0.007580s
2025-10-02T08:16:20.566210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec46430-f894879-19413593-9b76e065_0] Write session: Do CDS request
2025-10-02T08:16:20.566218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec46430-f894879-19413593-9b76e065_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:20.575325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec46430-f894879-19413593-9b76e065_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.575365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:20.575379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2668
2025-10-02T08:16:20.575590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.575618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:20.575627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:20.575630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:20.576160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2668 sessionId:  describe result for acl check
2025-10-02T08:16:20.576196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:20.576202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:20.576204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:20.576209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535311311436211:8594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:20.576711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535311311436211:8594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:20.580175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535311311436211:8594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:20.582534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:20.583920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:20.584070Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:20.584078Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:20.584084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:20.584114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:20.584149Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535311311436406:8585]
2025-10-02T08:16:20.584178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535311311436211:8594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:20.584191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535311311436211:8594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:20.584194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535311311436211:8594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:20.584202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:20.584653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:20.584829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:20.584864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:20.585129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:20.585168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.585173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.585174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.585176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.585177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.585181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.585191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.585194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.585198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.585202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.585207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.585213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.585218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.585223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.585226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.585229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.585231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.585233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.585236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.585238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.585248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:20.593154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:20.594835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:20.594850Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:20.594853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:20.594856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:20.594862Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2667 [1:7556535311311436406:8585]
2025-10-02T08:16:20.594870Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:20.594883Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:20.594889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.594891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.594892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.594904Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:20.594908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:20.594913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:20.594967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.594972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.594975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:20.594978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:20.595030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:20.595037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.595045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.595055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:20.595075Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535311311436400:8585]
2025-10-02T08:16:20.595082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535311311436400:8585]
2025-10-02T08:16:20.595089Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:20.595104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:20.595117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:20.595119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:20.595121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:20.595122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:20.595132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311436411:8594], now have 1 active actors on pipe
2025-10-02T08:16:20.595141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2667
2025-10-02T08:16:20.595165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535311770736054:2378], now have 1 active actors on pipe
2025-10-02T08:16:20.595174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535311311436400:8585]
2025-10-02T08:16:20.595182Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:20.595193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.595201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.595205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:20.595244Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|721f281f-55da69bc-74584ff2-664f9c17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:20.595256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.595260Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.595261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:20.595253Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2667
2025-10-02T08:16:20.595270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.595277Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:20.595298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.595326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.595332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.595344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.595381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2668 partition: 0 MaxSeqNo: 17 sessionId: src_id|721f281f-55da69bc-74584ff2-664f9c17_0
2025-10-02T08:16:20.595697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec46430-f894879-19413593-9b76e065_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|721f281f-55da69bc-74584ff2-664f9c17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:20.598247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721f281f-55da69bc-74584ff2-664f9c17_0] Write session: try to update token
2025-10-02T08:16:20.598266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721f281f-55da69bc-74584ff2-664f9c17_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:20.611968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId: src_id|721f281f-55da69bc-74584ff2-664f9c17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:20.612873Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:20.612884Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:20.612885Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:20.612894Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535311311436400:8585]
2025-10-02T08:16:20.612898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535311311436400:8585]
2025-10-02T08:16:20.612942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:20.612954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.612960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:20.612959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:20.612967Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:20.613101Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:20.614438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:20.666286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535311311436460:4064]
2025-10-02T08:16:20.667110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2667, pipe: [1:7556535311311436460:4064]
2025-10-02T08:16:20.750886Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:20.751234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.751245Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.751276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311436460:4064], now have 1 active actors on pipe
2025-10-02T08:16:20.751385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:20.751396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:20.751460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2668 reason: error at write: Disconnected sessionId: src_id|721f281f-55da69bc-74584ff2-664f9c17_0
2025-10-02T08:16:20.751498Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:20.751588Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:20.751666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2668 sessionId: src_id|721f281f-55da69bc-74584ff2-664f9c17_0 is DEAD
2025-10-02T08:16:20.751808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f281f-55da69bc-74584ff2-664f9c17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:20.751819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f281f-55da69bc-74584ff2-664f9c17_0] Write session will restart in 0.006722s
2025-10-02T08:16:20.751817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535311311436460:4064]
2025-10-02T08:16:20.751843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f281f-55da69bc-74584ff2-664f9c17_0] Write session: Do CDS request
2025-10-02T08:16:20.751849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f281f-55da69bc-74584ff2-664f9c17_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:20.759271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721f281f-55da69bc-74584ff2-664f9c17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.759370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:20.759384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2669
2025-10-02T08:16:20.759488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.759518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:20.759527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:20.759531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:20.760129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2669 sessionId:  describe result for acl check
2025-10-02T08:16:20.760177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:20.760178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:20.760180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:20.760185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535311311436798:8771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:20.760667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535311311436798:8771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:20.763048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535311311436798:8771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:20.765863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535311311436798:8771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:20.765876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535311311436798:8771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:20.765878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535311311436798:8771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:20.765885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:20.768115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:20.769435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:20.769558Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:20.769565Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:20.769571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:20.769608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:20.769635Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535311311437095:8752]
2025-10-02T08:16:20.770047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:20.770212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:20.770238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:20.770438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:20.770470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.770474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.770475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.770475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.770476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.770479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.770486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.770488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.770490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.770492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.770496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.770500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.770503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.770506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.770509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.770515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.770517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.770520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.770522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.770525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.770536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:20.778512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:20.780135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:20.780151Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:20.780153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:20.780157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:20.780164Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2668 [1:7556535311311437095:8752]
2025-10-02T08:16:20.780176Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:20.780191Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:20.780196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.780198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.780199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.780212Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:20.780219Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:20.780224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:20.780272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.780278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.780281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:20.780282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:20.780336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:20.780343Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.780355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.780366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:20.780380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535311311437089:8752]
2025-10-02T08:16:20.780385Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535311311437089:8752]
2025-10-02T08:16:20.780392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:20.780403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:20.780419Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:20.780424Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:20.780428Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:20.780431Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:20.780451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535311311437089:8752]
2025-10-02T08:16:20.780458Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:20.780461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:20.780466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311437055:8771], now have 1 active actors on pipe
2025-10-02T08:16:20.780484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535311770736083:2378], now have 1 active actors on pipe
2025-10-02T08:16:20.780488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2668
2025-10-02T08:16:20.780501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.780510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.780535Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:20.780545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.780548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.780550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:20.780560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.780571Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:20.780585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.780583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2668
2025-10-02T08:16:20.780627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.780631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.780641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.780667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2669 partition: 0 MaxSeqNo: 17 sessionId: src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0
2025-10-02T08:16:20.781021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f281f-55da69bc-74584ff2-664f9c17_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:20.783476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0] Write session: try to update token
2025-10-02T08:16:20.783493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:20.795893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId: src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:20.798205Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:20.798222Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:20.798224Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:20.798230Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535311311437089:8752]
2025-10-02T08:16:20.798234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535311311437089:8752]
2025-10-02T08:16:20.798265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:20.798266Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:20.798271Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:20.798270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.798272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:20.798368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:20.798391Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:20.852085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535311311437123:4064]
2025-10-02T08:16:20.852209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2668, pipe: [1:7556535311311437123:4064]
2025-10-02T08:16:20.931484Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:20.931887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.931904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.931939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311437123:4064], now have 1 active actors on pipe
2025-10-02T08:16:20.932122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535311311437123:4064]
2025-10-02T08:16:20.932150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:20.932156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:20.932202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2669 reason: error at write: Disconnected sessionId: src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0
2025-10-02T08:16:20.932210Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:20.932232Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:20.932362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2669 sessionId: src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0 is DEAD
2025-10-02T08:16:20.932521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:20.932529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0] Write session will restart in 0.006828s
2025-10-02T08:16:20.932556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0] Write session: Do CDS request
2025-10-02T08:16:20.932563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:20.940256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.940352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:20.940367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2670
2025-10-02T08:16:20.940465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:20.940486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:20.940493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:20.940495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:20.940897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2670 sessionId:  describe result for acl check
2025-10-02T08:16:20.940933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:20.940942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:20.940944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:20.940949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535311311437467:8780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:20.941418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535311311437467:8780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:20.943905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535311311437467:8780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:20.947596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535311311437467:8780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:20.947616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535311311437467:8780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:20.947623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535311311437467:8780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:20.947634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:20.949070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:20.950678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:20.950886Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:20.950897Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:20.950907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:20.950961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:20.951006Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535311311437744:8782]
2025-10-02T08:16:20.951508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:20.951754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:20.951810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:20.952184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:20.952239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.952245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.952247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.952248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.952249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.952255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.952264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.952268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.952272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.952276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.952282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.952290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:20.952297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.952302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:20.952307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.952312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:20.952316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.952321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.952325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.952331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.952350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:20.960692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:20.962330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:20.962348Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:20.962351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:20.962354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:20.962360Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2669 [1:7556535311311437744:8782]
2025-10-02T08:16:20.962372Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:20.962388Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:20.962391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.962393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.962395Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.962410Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:20.962416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:20.962423Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:20.962485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.962493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.962496Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:20.962499Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:20.962563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:20.962570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.962583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:20.962594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:20.962616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535311311437723:8780], now have 1 active actors on pipe
2025-10-02T08:16:20.962626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535311311437738:8782]
2025-10-02T08:16:20.962628Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535311311437738:8782]
2025-10-02T08:16:20.962629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2669
2025-10-02T08:16:20.962635Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:20.962642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:20.962644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535311770736091:2378], now have 1 active actors on pipe
2025-10-02T08:16:20.962645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:20.962651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:20.962663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:20.962666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:20.962672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.962676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.962714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535311311437738:8782]
2025-10-02T08:16:20.962721Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:20.962736Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:20.962742Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:20.962749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:20.962715Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2669
2025-10-02T08:16:20.962753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:20.962755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:20.962763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:20.962771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:20.962815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.962866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:20.962872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:20.962883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:20.962920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2670 partition: 0 MaxSeqNo: 17 sessionId: src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0
2025-10-02T08:16:20.963244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85be07c-16fffe6c-9bc539bc-661f5ee2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:20.965747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0] Write session: try to update token
2025-10-02T08:16:20.965761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:20.978851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId: src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:20.979892Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:20.979909Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:20.979911Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:20.979919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535311311437738:8782]
2025-10-02T08:16:20.979922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535311311437738:8782]
2025-10-02T08:16:20.979964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:20.979968Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:20.979974Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:20.979977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:20.979979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:20.980118Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:20.981298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:21.032287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535315606405079:4064]
2025-10-02T08:16:21.032373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2669, pipe: [1:7556535315606405079:4064]
2025-10-02T08:16:21.117222Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:21.117597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.117607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.117639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606405079:4064], now have 1 active actors on pipe
2025-10-02T08:16:21.117749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535315606405079:4064]
2025-10-02T08:16:21.117764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:21.117766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:21.117803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2670 reason: error at write: Disconnected sessionId: src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0
2025-10-02T08:16:21.117891Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:21.117894Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:21.117972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2670 sessionId: src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0 is DEAD
2025-10-02T08:16:21.118134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:21.118145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0] Write session will restart in 0.009638s
2025-10-02T08:16:21.118171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0] Write session: Do CDS request
2025-10-02T08:16:21.118178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:21.129219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.129282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:21.129298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2671
2025-10-02T08:16:21.129405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.129436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:21.129445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:21.129448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:21.129835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2671 sessionId:  describe result for acl check
2025-10-02T08:16:21.129865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:21.129866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:21.129868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:21.129873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535315606405641:2520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:21.130330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535315606405641:2520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:21.131721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:21.132522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535315606405641:2520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:21.133146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:21.133292Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:21.133300Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:21.133308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:21.133341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:21.133368Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535315606405697:8812]
2025-10-02T08:16:21.133773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:21.133944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:21.133988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:21.134245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:21.134281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.134285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.134286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.134287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.134287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.134291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.134297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.134299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.134302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.134304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.134308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.134315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.134321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.134326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.134330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.134335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.134339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.134344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.134348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.134351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.134362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:21.134892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535315606405641:2520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:21.134904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535315606405641:2520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:21.134906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535315606405641:2520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:21.134912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:21.142027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:21.143452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:21.143466Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:21.143467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:21.143470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:21.143476Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2670 [1:7556535315606405697:8812]
2025-10-02T08:16:21.143483Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:21.143496Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:21.143497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.143499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.143501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.143512Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:21.143516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:21.143520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:21.143569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.143575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.143577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:21.143578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:21.143624Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:21.143630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.143638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.143645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:21.143659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535315606405678:8812]
2025-10-02T08:16:21.143664Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535315606405678:8812]
2025-10-02T08:16:21.143669Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:21.143678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606405714:2520], now have 1 active actors on pipe
2025-10-02T08:16:21.143684Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:21.143684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2670
2025-10-02T08:16:21.143686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535316065703406:2378], now have 1 active actors on pipe
2025-10-02T08:16:21.143688Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:21.143689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:21.143697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:21.143699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:21.143724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.143730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.143741Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535315606405678:8812]
2025-10-02T08:16:21.143750Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:21.143758Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:21.143772Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|396545e9-4076e86b-9952669-82548091_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:21.143779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.143782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.143783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:21.143789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.143757Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2670
2025-10-02T08:16:21.143794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:21.143817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.143858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.143863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.143872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.143899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2671 partition: 0 MaxSeqNo: 17 sessionId: src_id|396545e9-4076e86b-9952669-82548091_0
2025-10-02T08:16:21.144208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64e35a3-a8c984cf-24d89d0e-1cd73c0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|396545e9-4076e86b-9952669-82548091_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:21.146548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396545e9-4076e86b-9952669-82548091_0] Write session: try to update token
2025-10-02T08:16:21.146562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396545e9-4076e86b-9952669-82548091_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:21.147954Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] Counters: { Errors: 26 CurrentSessionLifetimeMs: 541842 BytesRead: 22528010 MessagesRead: 10 BytesReadCompressed: 22528010 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-02T08:16:21.159520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId: src_id|396545e9-4076e86b-9952669-82548091_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:21.160188Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:21.160199Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:21.160200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:21.160213Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535315606405678:8812]
2025-10-02T08:16:21.160216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535315606405678:8812]
2025-10-02T08:16:21.160247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:21.160255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.160254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:21.160256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:21.160260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:21.160386Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:21.161793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:21.218123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535315606405729:4064]
2025-10-02T08:16:21.218232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2670, pipe: [1:7556535315606405729:4064]
2025-10-02T08:16:21.284721Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:21.284969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.284979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.285009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606405729:4064], now have 1 active actors on pipe
2025-10-02T08:16:21.285129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:21.285141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:21.285176Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:21.285200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2671 reason: error at write: Disconnected sessionId: src_id|396545e9-4076e86b-9952669-82548091_0
2025-10-02T08:16:21.285208Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:21.285373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2671 sessionId: src_id|396545e9-4076e86b-9952669-82548091_0 is DEAD
2025-10-02T08:16:21.285440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535315606405729:4064]
2025-10-02T08:16:21.285504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396545e9-4076e86b-9952669-82548091_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:21.285512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396545e9-4076e86b-9952669-82548091_0] Write session will restart in 0.005699s
2025-10-02T08:16:21.285530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396545e9-4076e86b-9952669-82548091_0] Write session: Do CDS request
2025-10-02T08:16:21.285534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396545e9-4076e86b-9952669-82548091_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:21.292257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396545e9-4076e86b-9952669-82548091_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.292314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:21.292326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2672
2025-10-02T08:16:21.292434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.292454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:21.292458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:21.292461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:21.292829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2672 sessionId:  describe result for acl check
2025-10-02T08:16:21.292856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:21.292861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:21.292863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:21.292867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535315606406098:8882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:21.293372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535315606406098:8882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:21.295592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535315606406098:8882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:21.298349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:21.298757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535315606406098:8882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:21.298769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535315606406098:8882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:21.298772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535315606406098:8882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:21.298778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:21.299761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:21.299888Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:21.299895Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:21.299902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:21.299932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:21.299959Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535315606406352:8878]
2025-10-02T08:16:21.300379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:21.300642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:21.300675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:21.300928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:21.300963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.300971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.300972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.300972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.300973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.300977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.300983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.300985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.300987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.300989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.300993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.300997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.301000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.301003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.301006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.301009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.301011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.301013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.301016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.301019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.301031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:21.312088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:21.313611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:21.313625Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:21.313626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:21.313629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:21.313633Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2671 [1:7556535315606406352:8878]
2025-10-02T08:16:21.313640Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:21.313654Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:21.313657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.313659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.313661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.313676Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:21.313683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:21.313688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:21.313742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.313748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.313750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:21.313751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:21.313812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:21.313820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.313831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.313841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:21.313859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606406348:8882], now have 1 active actors on pipe
2025-10-02T08:16:21.313869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535315606406340:8878]
2025-10-02T08:16:21.313871Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535315606406340:8878]
2025-10-02T08:16:21.313879Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:21.313881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2671
2025-10-02T08:16:21.313884Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:21.313887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:21.313896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535316065703415:2378], now have 1 active actors on pipe
2025-10-02T08:16:21.313901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:21.313966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2671
2025-10-02T08:16:21.313916Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:21.313925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:21.313931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.313936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.313970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535315606406340:8878]
2025-10-02T08:16:21.313973Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:21.313986Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:21.313992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.313995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.313997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:21.313997Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:21.314005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.314012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:21.314043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.314100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.314107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.314118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.314151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2672 partition: 0 MaxSeqNo: 17 sessionId: src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0
2025-10-02T08:16:21.314456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396545e9-4076e86b-9952669-82548091_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:21.316991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0] Write session: try to update token
2025-10-02T08:16:21.317009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:21.331068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId: src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:21.332134Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:21.332150Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:21.332152Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:21.332159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535315606406340:8878]
2025-10-02T08:16:21.332164Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535315606406340:8878]
2025-10-02T08:16:21.332204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:21.332203Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:21.332209Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:21.332215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.332217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:21.332360Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:21.333413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:21.385557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535315606406378:4064]
2025-10-02T08:16:21.385683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2671, pipe: [1:7556535315606406378:4064]
2025-10-02T08:16:21.462991Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:21.463405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.463416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.463449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606406378:4064], now have 1 active actors on pipe
2025-10-02T08:16:21.463541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535315606406378:4064]
2025-10-02T08:16:21.463568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:21.463574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:21.463599Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:21.463639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2672 reason: error at write: Disconnected sessionId: src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0
2025-10-02T08:16:21.463643Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:21.463808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2672 sessionId: src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0 is DEAD
2025-10-02T08:16:21.463961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:21.463968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0] Write session will restart in 0.009056s
2025-10-02T08:16:21.463994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0] Write session: Do CDS request
2025-10-02T08:16:21.464001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:21.477210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.477275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:21.477290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2673
2025-10-02T08:16:21.477414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.477442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:21.477451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:21.477454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:21.477801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2673 sessionId:  describe result for acl check
2025-10-02T08:16:21.477830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:21.477835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:21.477837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:21.477841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535315606406952:8903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:21.478350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535315606406952:8903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:21.480497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535315606406952:8903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:21.481001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:21.481390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:21.481562Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:21.481570Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:21.481579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:21.481625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:21.481660Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535315606406998:8898]
2025-10-02T08:16:21.482147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:21.482352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:21.482394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:21.482674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:21.482721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.482726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.482727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.482728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.482729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.482734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.482743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.482750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.482754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.482759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.482764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.482770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.482775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.482780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.482784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.482789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.482797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.482802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.482811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.482820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.482843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:21.483161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535315606406952:8903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:21.483173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535315606406952:8903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:21.483177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535315606406952:8903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:21.483185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:21.491167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:21.492834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:21.492849Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:21.492852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:21.492855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:21.492863Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2672 [1:7556535315606406998:8898]
2025-10-02T08:16:21.492875Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:21.492892Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:21.492895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.492898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.492900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.492914Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:21.492924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:21.492935Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:21.493001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.493015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.493018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:21.493021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:21.493093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:21.493101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.493115Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.493128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:21.493140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2672
2025-10-02T08:16:21.493153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606407015:8903], now have 1 active actors on pipe
2025-10-02T08:16:21.493157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535316065703421:2378], now have 1 active actors on pipe
2025-10-02T08:16:21.493162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535315606406986:8898]
2025-10-02T08:16:21.493165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535315606406986:8898]
2025-10-02T08:16:21.493177Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:21.493187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.493191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:21.493195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:21.493196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.493214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:21.493233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:21.493240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:21.493236Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2672
2025-10-02T08:16:21.493281Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d5b2138-b4af3ed2-1462768c-3f546_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:21.493291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.493295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.493297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:21.493306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.493319Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:21.493332Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535315606406986:8898]
2025-10-02T08:16:21.493344Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:21.493361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:21.493378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.493440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.493448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.493461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.493500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2673 partition: 0 MaxSeqNo: 17 sessionId: src_id|6d5b2138-b4af3ed2-1462768c-3f546_0
2025-10-02T08:16:21.493854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1888e1cb-8beb5d88-3c24e2a0-37083c82_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6d5b2138-b4af3ed2-1462768c-3f546_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:21.496465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d5b2138-b4af3ed2-1462768c-3f546_0] Write session: try to update token
2025-10-02T08:16:21.496480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d5b2138-b4af3ed2-1462768c-3f546_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:21.510440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId: src_id|6d5b2138-b4af3ed2-1462768c-3f546_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:21.512063Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:21.512079Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:21.512081Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:21.512090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535315606406986:8898]
2025-10-02T08:16:21.512095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535315606406986:8898]
2025-10-02T08:16:21.512128Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:21.512135Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:21.512139Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:21.512142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.512144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:21.512280Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:21.513048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:21.563766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535315606407032:4064]
2025-10-02T08:16:21.563913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2672, pipe: [1:7556535315606407032:4064]
2025-10-02T08:16:21.643691Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:21.643967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.643979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.644010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606407032:4064], now have 1 active actors on pipe
2025-10-02T08:16:21.644088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:21.644096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:21.644136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2673 reason: error at write: Disconnected sessionId: src_id|6d5b2138-b4af3ed2-1462768c-3f546_0
2025-10-02T08:16:21.644195Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:21.644205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:21.644292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2673 sessionId: src_id|6d5b2138-b4af3ed2-1462768c-3f546_0 is DEAD
2025-10-02T08:16:21.644404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535315606407032:4064]
2025-10-02T08:16:21.644449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d5b2138-b4af3ed2-1462768c-3f546_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:21.644456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d5b2138-b4af3ed2-1462768c-3f546_0] Write session will restart in 0.008054s
2025-10-02T08:16:21.644480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d5b2138-b4af3ed2-1462768c-3f546_0] Write session: Do CDS request
2025-10-02T08:16:21.644487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d5b2138-b4af3ed2-1462768c-3f546_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:21.653273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d5b2138-b4af3ed2-1462768c-3f546_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.653352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:21.653369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2674
2025-10-02T08:16:21.653485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.653528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:21.653541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:21.653545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:21.653986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2674 sessionId:  describe result for acl check
2025-10-02T08:16:21.654022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:21.654029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:21.654031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:21.654035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535315606407441:8959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:21.654514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535315606407441:8959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:21.656610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535315606407441:8959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:21.659830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535315606407441:8959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:21.659844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535315606407441:8959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:21.659848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535315606407441:8959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:21.659855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:21.660414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:21.661624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:21.661791Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:21.661801Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:21.661810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:21.661856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:21.661900Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535315606407660:8017]
2025-10-02T08:16:21.662442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:21.662600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:21.662636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:21.662901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:21.662947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.662953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.662953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.662955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.662956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.662960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.662969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.662972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.662976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.662979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.662984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.662990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.662996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.663000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.663004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.663008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.663012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.663016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.663020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.663024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.663040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:21.670865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:21.672422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:21.672435Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:21.672437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:21.672439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:21.672444Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2673 [1:7556535315606407660:8017]
2025-10-02T08:16:21.672451Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:21.672463Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:21.672468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.672470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.672472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.672482Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:21.672485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:21.672489Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:21.672535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.672539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.672542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:21.672543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:21.672591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:21.672597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.672605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.672615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:21.672629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2673
2025-10-02T08:16:21.672632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606407648:8959], now have 1 active actors on pipe
2025-10-02T08:16:21.672634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535316065703427:2378], now have 1 active actors on pipe
2025-10-02T08:16:21.672639Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535315606407654:8017]
2025-10-02T08:16:21.672640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535315606407654:8017]
2025-10-02T08:16:21.672647Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:21.672654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.672657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.672661Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:21.672663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:21.672672Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:21.672683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:21.672686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:21.672718Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|921bb91c-da592279-f4195b14-bbebd7d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:21.672727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.672730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.672735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:21.672740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.672750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:21.672759Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535315606407654:8017]
2025-10-02T08:16:21.672765Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:21.672766Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:21.672743Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2673
2025-10-02T08:16:21.672782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.672847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.672853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.672862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.672884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2674 partition: 0 MaxSeqNo: 17 sessionId: src_id|921bb91c-da592279-f4195b14-bbebd7d5_0
2025-10-02T08:16:21.673169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d5b2138-b4af3ed2-1462768c-3f546_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|921bb91c-da592279-f4195b14-bbebd7d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:21.675569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921bb91c-da592279-f4195b14-bbebd7d5_0] Write session: try to update token
2025-10-02T08:16:21.675583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921bb91c-da592279-f4195b14-bbebd7d5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:21.688580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId: src_id|921bb91c-da592279-f4195b14-bbebd7d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:21.691138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:21.691212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.691224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.692782Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:21.692799Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:21.692816Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:21.692824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535315606407654:8017]
2025-10-02T08:16:21.692828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535315606407654:8017]
2025-10-02T08:16:21.692847Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:21.692852Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:21.692862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:21.692871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:21.692877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.692879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:21.693010Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:21.710080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:21.744427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535315606407729:4064]
2025-10-02T08:16:21.744505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2673, pipe: [1:7556535315606407729:4064]
2025-10-02T08:16:21.821876Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:21.822269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.822281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.822434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.822494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.822557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.822619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.822664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.822671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.822744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.822813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.822876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.822940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.822982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.822987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.823056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.823113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.823171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.823230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.823274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.823290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.823364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.823433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.823499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.823564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.823611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.823617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.823681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.823745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.823823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.823887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.823954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.823960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.824027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.824108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.824177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.824253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.824299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.824307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.824377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.824442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.824517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.824584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.824631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.824637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.824704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.824766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.824853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.824923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.824971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.824979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.825051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.825115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.825173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.825239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.825278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.825284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.825355Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:21.825418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:21.825479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:21.825548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:21.825588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:21.825593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:21.825633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606407729:4064], now have 1 active actors on pipe
2025-10-02T08:16:21.825750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535315606407729:4064]
2025-10-02T08:16:21.825778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:21.825783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:21.825810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2674 reason: error at write: Disconnected sessionId: src_id|921bb91c-da592279-f4195b14-bbebd7d5_0
2025-10-02T08:16:21.825851Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:21.825973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2674 sessionId: src_id|921bb91c-da592279-f4195b14-bbebd7d5_0 is DEAD
2025-10-02T08:16:21.826031Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:21.826104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bb91c-da592279-f4195b14-bbebd7d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:21.826115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bb91c-da592279-f4195b14-bbebd7d5_0] Write session will restart in 0.007862s
2025-10-02T08:16:21.826137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bb91c-da592279-f4195b14-bbebd7d5_0] Write session: Do CDS request
2025-10-02T08:16:21.826143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bb91c-da592279-f4195b14-bbebd7d5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:21.835297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|921bb91c-da592279-f4195b14-bbebd7d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.835357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:21.835373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2675
2025-10-02T08:16:21.835559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:21.835600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:21.835610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:21.835614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:21.836090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2675 sessionId:  describe result for acl check
2025-10-02T08:16:21.836122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:21.836128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:21.836130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:21.836134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535315606408192:9023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:21.836617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535315606408192:9023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:21.838986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535315606408192:9023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:21.841429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:21.842916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:21.843091Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:21.843101Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:21.843111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:21.843157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:21.843174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535315606408192:9023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:21.843180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535315606408192:9023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:21.843189Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535315606408355:9017]
2025-10-02T08:16:21.843189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535315606408192:9023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:21.843197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:21.843688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:21.843851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:21.843881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:21.844085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:21.844112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.844116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.844117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.844117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.844118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.844122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.844128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.844130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.844132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.844134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.844138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.844142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:21.844146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.844149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:21.844152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.844155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:21.844157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.844160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.844162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.844165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.844174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:21.851801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:21.853480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:21.853498Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:21.853501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:21.853506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:21.853513Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2674 [1:7556535315606408355:9017]
2025-10-02T08:16:21.853526Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:21.853545Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:21.853553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.853557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.853559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.853575Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:21.853585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:21.853591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:21.853664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.853672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.853677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:21.853680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:21.853820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2674
2025-10-02T08:16:21.853932Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2674
2025-10-02T08:16:21.854077Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:21.854086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.854101Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:21.854119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:21.854143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606408360:9023], now have 1 active actors on pipe
2025-10-02T08:16:21.854151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535316065703457:2378], now have 1 active actors on pipe
2025-10-02T08:16:21.854155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.854164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.854188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535315606408349:9017]
2025-10-02T08:16:21.854194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535315606408349:9017]
2025-10-02T08:16:21.854210Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:21.854223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:21.854226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:21.854231Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:21.854241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:21.854249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:21.854265Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:21.854277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:21.854285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:21.854286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:21.854295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:21.854309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:21.854345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535315606408349:9017]
2025-10-02T08:16:21.854358Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:21.854364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:21.854375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.854436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:21.854444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:21.854458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:21.854496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2675 partition: 0 MaxSeqNo: 17 sessionId: src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0
2025-10-02T08:16:21.854845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|921bb91c-da592279-f4195b14-bbebd7d5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:21.857217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0] Write session: try to update token
2025-10-02T08:16:21.857232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:21.870079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId: src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:21.870896Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:21.870913Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:21.870916Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:21.870924Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535315606408349:9017]
2025-10-02T08:16:21.870928Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535315606408349:9017]
2025-10-02T08:16:21.870972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:21.870973Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:21.870979Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:21.870984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:21.870986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:21.871133Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:21.872496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:21.925724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535315606408388:4064]
2025-10-02T08:16:21.925837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2674, pipe: [1:7556535315606408388:4064]
2025-10-02T08:16:22.022748Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:22.023208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.023225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.023266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535315606408388:4064], now have 1 active actors on pipe
2025-10-02T08:16:22.023375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:22.023386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:22.023441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2675 reason: error at write: Disconnected sessionId: src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0
2025-10-02T08:16:22.023521Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:22.023560Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:22.023626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2675 sessionId: src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0 is DEAD
2025-10-02T08:16:22.023786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535315606408388:4064]
2025-10-02T08:16:22.023997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:22.024005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0] Write session will restart in 0.008819s
2025-10-02T08:16:22.024031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0] Write session: Do CDS request
2025-10-02T08:16:22.024037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:22.034298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.034383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:22.034398Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2676
2025-10-02T08:16:22.034511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.034541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:22.034551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:22.034555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:22.035000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2676 sessionId:  describe result for acl check
2025-10-02T08:16:22.035056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:22.035062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:22.035064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:22.035070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535319901376112:9059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:22.035574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535319901376112:9059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:22.038148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535319901376112:9059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:22.041599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535319901376112:9059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:22.041625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535319901376112:9059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:22.041628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535319901376112:9059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:22.041636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:22.042416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:22.044104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:22.044298Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:22.044309Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:22.044319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:22.044364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:22.044403Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535319901376330:9042]
2025-10-02T08:16:22.045063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:22.045294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:22.045338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:22.045643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:22.045686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.045692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.045693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.045695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.045696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.045701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.045712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.045716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.045721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.045725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.045730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.045737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.045744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.045754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.045759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.045764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.045770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.045775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.045785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.045790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.045815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:22.054253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:22.056464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:22.056486Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:22.056488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:22.056492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:22.056499Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2675 [1:7556535319901376330:9042]
2025-10-02T08:16:22.056511Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:22.056529Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:22.056531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.056534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.056536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.056552Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:22.056558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:22.056564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:22.056640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.056651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.056653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:22.056656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:22.056726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:22.056736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.056750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.056761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:22.056776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535319901376324:9042]
2025-10-02T08:16:22.056779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535319901376324:9042]
2025-10-02T08:16:22.056786Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:22.056818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:22.056817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:22.056822Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:22.056831Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:22.056839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:22.056850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901376312:9059], now have 1 active actors on pipe
2025-10-02T08:16:22.056851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2675
2025-10-02T08:16:22.056887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535320360670774:2378], now have 1 active actors on pipe
2025-10-02T08:16:22.056896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.056901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.056914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535319901376324:9042]
2025-10-02T08:16:22.056928Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:22.056947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:22.056955Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:22.056961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.056965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.056967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:22.056978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.056949Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2675
2025-10-02T08:16:22.056987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:22.057027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.057084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.057091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.057104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.057139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2676 partition: 0 MaxSeqNo: 17 sessionId: src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0
2025-10-02T08:16:22.057602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1b2b3a-6e1e9af7-c57a5b5-5f509901_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:22.060271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0] Write session: try to update token
2025-10-02T08:16:22.060290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:22.074556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId: src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:22.074695Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:22.074711Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:22.074713Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:22.074719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535319901376324:9042]
2025-10-02T08:16:22.074723Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535319901376324:9042]
2025-10-02T08:16:22.074756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:22.074761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.074763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:22.074838Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:22.074856Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:22.074906Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:22.077156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:22.123845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535319901376356:4064]
2025-10-02T08:16:22.123938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2675, pipe: [1:7556535319901376356:4064]
2025-10-02T08:16:22.206784Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:22.206997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.207009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.207043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901376356:4064], now have 1 active actors on pipe
2025-10-02T08:16:22.207105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535319901376356:4064]
2025-10-02T08:16:22.207124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:22.207126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:22.207172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2676 reason: error at write: Disconnected sessionId: src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0
2025-10-02T08:16:22.207243Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:22.207255Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:22.207342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2676 sessionId: src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0 is DEAD
2025-10-02T08:16:22.207468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:22.207478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0] Write session will restart in 0.008760s
2025-10-02T08:16:22.207504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0] Write session: Do CDS request
2025-10-02T08:16:22.207510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:22.217206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.217265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:22.217280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2677
2025-10-02T08:16:22.217414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.217452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:22.217473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:22.217481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:22.217901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2677 sessionId:  describe result for acl check
2025-10-02T08:16:22.217929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:22.217934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:22.217935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:22.217940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535319901376844:9095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:22.218383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535319901376844:9095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:22.221312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535319901376844:9095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:22.224391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:22.224728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:22.224828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535319901376844:9095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:22.224839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535319901376844:9095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:22.224841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535319901376844:9095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:22.224848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:22.225119Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:22.225133Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:22.225147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:22.225212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:22.225253Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535319901376991:9093]
2025-10-02T08:16:22.225833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:22.226015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:22.226055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:22.226334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:22.226367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.226372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.226373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.226374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.226375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.226379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.226388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.226391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.226394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.226397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.226402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.226408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.226414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.226418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.226426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.226430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.226434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.226438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.226442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.226446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.226462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:22.234987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:22.237232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:22.237250Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:22.237253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:22.237256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:22.237262Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2676 [1:7556535319901376991:9093]
2025-10-02T08:16:22.237273Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:22.237289Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:22.237292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.237297Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.237299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.237314Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:22.237319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:22.237325Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:22.237386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.237393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.237396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:22.237398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:22.237482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:22.237492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.237507Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.237517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:22.237534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535319901376980:9093]
2025-10-02T08:16:22.237538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535319901376980:9093]
2025-10-02T08:16:22.237545Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:22.237559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:22.237561Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:22.237564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:22.237583Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:22.237585Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:22.237590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2676
2025-10-02T08:16:22.237595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901376988:9095], now have 1 active actors on pipe
2025-10-02T08:16:22.237599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535320360670781:2378], now have 1 active actors on pipe
2025-10-02T08:16:22.237630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.237640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.237653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535319901376980:9093]
2025-10-02T08:16:22.237667Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:22.237682Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:22.237698Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad869318-54dce81c-7d296815-f5e231c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:22.237708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.237715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.237717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:22.237728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.237743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:22.237709Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2676
2025-10-02T08:16:22.237776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.237823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.237830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.237843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.237882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2677 partition: 0 MaxSeqNo: 17 sessionId: src_id|ad869318-54dce81c-7d296815-f5e231c6_0
2025-10-02T08:16:22.238196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f3b54-e608fb82-e0abb83f-bca877c8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ad869318-54dce81c-7d296815-f5e231c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:22.240791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad869318-54dce81c-7d296815-f5e231c6_0] Write session: try to update token
2025-10-02T08:16:22.240830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad869318-54dce81c-7d296815-f5e231c6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:22.255084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId: src_id|ad869318-54dce81c-7d296815-f5e231c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:22.255233Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:22.255248Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:22.255251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:22.255262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535319901376980:9093]
2025-10-02T08:16:22.255267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535319901376980:9093]
2025-10-02T08:16:22.255315Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:22.255319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:22.255326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.255328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:22.255330Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:22.255508Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:22.257718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:22.307154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535319901377017:4064]
2025-10-02T08:16:22.307280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2676, pipe: [1:7556535319901377017:4064]
2025-10-02T08:16:22.384887Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:22.385264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.385274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.385302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901377017:4064], now have 1 active actors on pipe
2025-10-02T08:16:22.385442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:22.385453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:22.385518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2677 reason: error at write: Disconnected sessionId: src_id|ad869318-54dce81c-7d296815-f5e231c6_0
2025-10-02T08:16:22.385522Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:22.385693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2677 sessionId: src_id|ad869318-54dce81c-7d296815-f5e231c6_0 is DEAD
2025-10-02T08:16:22.385743Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:22.385839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad869318-54dce81c-7d296815-f5e231c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:22.385850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad869318-54dce81c-7d296815-f5e231c6_0] Write session will restart in 0.009116s
2025-10-02T08:16:22.385845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535319901377017:4064]
2025-10-02T08:16:22.385872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad869318-54dce81c-7d296815-f5e231c6_0] Write session: Do CDS request
2025-10-02T08:16:22.385879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad869318-54dce81c-7d296815-f5e231c6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:22.396351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad869318-54dce81c-7d296815-f5e231c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.396416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:22.396433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2678
2025-10-02T08:16:22.396615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.396650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:22.396660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:22.396663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:22.397091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2678 sessionId:  describe result for acl check
2025-10-02T08:16:22.397127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:22.397133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:22.397134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:22.397139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535319901377498:9132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:22.397605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535319901377498:9132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:22.400397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535319901377498:9132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:22.403435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:22.403717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:22.403722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535319901377498:9132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:22.403727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535319901377498:9132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:22.403731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535319901377498:9132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:22.403738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:22.403982Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:22.403991Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:22.404002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:22.404068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:22.404102Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535319901377657:9135]
2025-10-02T08:16:22.404589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:22.404770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:22.404847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:22.405168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:22.405203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.405209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.405210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.405211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.405212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.405218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.405229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.405236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.405241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.405245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.405254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.405265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.405274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.405283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.405291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.405300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.405308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.405317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.405325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.405334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.405353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:22.413075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:22.414393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:22.414409Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:22.414411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:22.414415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:22.414421Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2677 [1:7556535319901377657:9135]
2025-10-02T08:16:22.414432Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:22.414451Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:22.414458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.414461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.414463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.414478Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:22.414487Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:22.414497Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:22.414557Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.414564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.414567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:22.414570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:22.414639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:22.414646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.414659Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.414676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:22.414695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901377654:9132], now have 1 active actors on pipe
2025-10-02T08:16:22.414705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535319901377646:9135]
2025-10-02T08:16:22.414709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2677
2025-10-02T08:16:22.414712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535319901377646:9135]
2025-10-02T08:16:22.414719Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:22.414729Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:22.414731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535320360670791:2378], now have 1 active actors on pipe
2025-10-02T08:16:22.414733Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:22.414736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:22.414749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:22.414752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:22.414759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.414766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.414801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535319901377646:9135]
2025-10-02T08:16:22.414809Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:22.414817Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:22.414821Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:22.414827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.414831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.414803Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2677
2025-10-02T08:16:22.414833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:22.414841Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.414849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:22.414890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.414968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.414975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.414987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.415025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2678 partition: 0 MaxSeqNo: 17 sessionId: src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0
2025-10-02T08:16:22.415383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad869318-54dce81c-7d296815-f5e231c6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:22.417990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0] Write session: try to update token
2025-10-02T08:16:22.418002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:22.431003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId: src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:22.432081Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:22.432097Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:22.432100Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:22.432108Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535319901377646:9135]
2025-10-02T08:16:22.432112Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535319901377646:9135]
2025-10-02T08:16:22.432152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:22.432151Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:22.432157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:22.432158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.432161Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:22.432293Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:22.433530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:22.485811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535319901377683:4064]
2025-10-02T08:16:22.485928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2677, pipe: [1:7556535319901377683:4064]
2025-10-02T08:16:22.559094Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:22.559620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.559638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.559678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901377683:4064], now have 1 active actors on pipe
2025-10-02T08:16:22.559793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535319901377683:4064]
2025-10-02T08:16:22.559820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:22.559824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:22.559878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2678 reason: error at write: Disconnected sessionId: src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0
2025-10-02T08:16:22.559884Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:22.559881Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:22.560072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2678 sessionId: src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0 is DEAD
2025-10-02T08:16:22.560219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:22.560227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0] Write session will restart in 0.006154s
2025-10-02T08:16:22.560254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0] Write session: Do CDS request
2025-10-02T08:16:22.560260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:22.567267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.567340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:22.567358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2679
2025-10-02T08:16:22.567486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.567523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:22.567527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:22.567530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:22.567876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2679 sessionId:  describe result for acl check
2025-10-02T08:16:22.567907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:22.567914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:22.567915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:22.567920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535319901378026:9148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:22.568403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535319901378026:9148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:22.570702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535319901378026:9148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:22.574007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535319901378026:9148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:22.574021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535319901378026:9148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:22.574024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535319901378026:9148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:22.574030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:22.577446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:22.577797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:22.577921Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:22.577929Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:22.577938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:22.577982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:22.578025Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535319901378325:9144]
2025-10-02T08:16:22.578461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:22.578703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:22.578752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:22.578997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:22.579030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.579035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.579036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.579036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.579037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.579041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.579047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.579049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.579051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.579053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.579057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.579062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.579065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.579069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.579071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.579074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.579076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.579079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.579081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.579083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.579093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:22.586741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:22.588143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:22.588160Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:22.588162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:22.588165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:22.588169Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2678 [1:7556535319901378325:9144]
2025-10-02T08:16:22.588178Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:22.588191Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:22.588192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.588195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.588196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.588209Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:22.588214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:22.588221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:22.588286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.588297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.588299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:22.588302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:22.588376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:22.588385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.588397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.588408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:22.588418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2678
2025-10-02T08:16:22.588426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901378304:9148], now have 1 active actors on pipe
2025-10-02T08:16:22.588432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535320360670798:2378], now have 1 active actors on pipe
2025-10-02T08:16:22.588437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.588440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.588456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535319901378319:9144]
2025-10-02T08:16:22.588463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535319901378319:9144]
2025-10-02T08:16:22.588474Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:22.588488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:22.588496Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:22.588502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:22.588505Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:22.588509Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:22.588513Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:22.588519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.588522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.588524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:22.588531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.588538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:22.588519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2678
2025-10-02T08:16:22.588567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535319901378319:9144]
2025-10-02T08:16:22.588577Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:22.588588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.588612Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:22.588638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.588644Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.588656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.588690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2679 partition: 0 MaxSeqNo: 17 sessionId: src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0
2025-10-02T08:16:22.589032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee243ae3-fc47dbd0-cb7087c4-e4757878_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:22.591497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0] Write session: try to update token
2025-10-02T08:16:22.591512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:22.604647Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:22.604665Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:22.604671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535319901378319:9144]
2025-10-02T08:16:22.604706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:22.604724Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:22.604879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:22.604936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId: src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:22.605021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:22.605155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:22.605299Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:22.605502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:22.605538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:22.607578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:22.607675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.607689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.607713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:22.607735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:22.607788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.607800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.607954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.608015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.608086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.608151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.608538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.608554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.608616Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.608675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.608737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.608825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.608873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.608880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.608944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.609004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.609062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.609122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.609161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.609168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.609231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.609296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.609362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.609427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.609472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.609478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.609544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.609607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.609670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.609734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.609774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.609783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.609851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.609913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.609974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.610041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.610088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.610095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.610165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.610234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.610306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.610381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.610429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.610436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.610505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.610567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.610632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.610698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.610746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.610753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.610826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.610891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.610956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.611019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.611061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.611068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.611138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:22.611202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:22.611272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:22.611335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:22.611381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:22.611389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:22.611422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:22.611484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.611504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.611510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:22.611540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:22.611555Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:22.611558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:22.611561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:22.611564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:22.611961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:22.611990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:22.611996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:22.611999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:22.612004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:22.612008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:22.612588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:22.612612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:22.612619Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:22.612626Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:22.612629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:22.612634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:22.613100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:22.613122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:22.613126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:22.613129Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:22.613131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:22.615331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:22.615352Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:22.615366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392982615
2025-10-02T08:16:22.615481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:22.615500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:22.615505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:22.615510Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:22.615514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:22.615517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:22.616085Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:22.616109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:22.616119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:22.616122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:22.616125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:22.616130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:22.616607Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:22.616636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:22.616650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:22.616653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:22.616658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:22.616661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:22.617159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:22.617186Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:22.617192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:22.618287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:22.618308Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:22.618314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:22.618317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:22.618327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392982617
2025-10-02T08:16:22.618631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:22.618655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:22.618661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:22.618669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:22.618673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:22.618676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:22.619174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:22.619203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:22.619208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:22.619216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:22.619220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:22.619223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:22.619715Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:22.619739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.619840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392982619
2025-10-02T08:16:22.623704Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:22.623746Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:22.623757Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:22.623769Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:22.625442Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:22.625456Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:22.625458Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:22.625467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535319901378319:9144]
2025-10-02T08:16:22.625471Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535319901378319:9144]
2025-10-02T08:16:22.625529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:22.625539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.625538Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:22.625541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:22.625544Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:22.625684Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:22.659920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535319901378357:4064]
2025-10-02T08:16:22.660100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2678, pipe: [1:7556535319901378357:4064]
2025-10-02T08:16:22.761597Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:22.761951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901378357:4064], now have 1 active actors on pipe
2025-10-02T08:16:22.762054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:22.762063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:22.762087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2679 reason: error at write: Disconnected sessionId: src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0
2025-10-02T08:16:22.762171Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:22.762174Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:22.762266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2679 sessionId: src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0 is DEAD
2025-10-02T08:16:22.762390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:22.762399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0] Write session will restart in 0.006269s
2025-10-02T08:16:22.762421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0] Write session: Do CDS request
2025-10-02T08:16:22.762427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:22.762431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535319901378357:4064]
2025-10-02T08:16:22.770277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.770363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:22.770382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2680
2025-10-02T08:16:22.770484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.770513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:22.770521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:22.770525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:22.770907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2680 sessionId:  describe result for acl check
2025-10-02T08:16:22.770941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:22.770942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:22.770944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:22.770949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535319901378850:9235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:22.771441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535319901378850:9235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:22.773754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535319901378850:9235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:22.775440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:22.776866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:22.777037Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:22.777051Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:22.777062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:22.777118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:22.777161Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535319901379032:9231]
2025-10-02T08:16:22.777283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535319901378850:9235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:22.777297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535319901378850:9235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:22.777300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535319901378850:9235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:22.777307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:22.777732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:22.777906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:22.777953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:22.778239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:22.778299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.778306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.778307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.778307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.778308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.778313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.778322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.778325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.778329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.778333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.778337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.778345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.778350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.778355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.778359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.778369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.778373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.778383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.778387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.778392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.778412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:22.786029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:22.787596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:22.787614Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:22.787616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:22.787620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:22.787626Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2679 [1:7556535319901379032:9231]
2025-10-02T08:16:22.787635Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:22.787651Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:22.787654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.787657Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.787659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.787673Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:22.787678Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:22.787683Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:22.787741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.787751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.787754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:22.787756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:22.787821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:22.787828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.787840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.787852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:22.787871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2679
2025-10-02T08:16:22.787873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901379037:9235], now have 1 active actors on pipe
2025-10-02T08:16:22.787877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535320360670826:2378], now have 1 active actors on pipe
2025-10-02T08:16:22.787883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535319901379026:9231]
2025-10-02T08:16:22.787885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535319901379026:9231]
2025-10-02T08:16:22.787896Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:22.787906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.787906Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:22.787908Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:22.787914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.787930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:22.787946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:22.787954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:22.787988Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e216b15-22f25ead-2548bc4f-8de4a333_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:22.787999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.788003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.788004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:22.787976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2679
2025-10-02T08:16:22.788012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.788025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:22.788038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535319901379026:9231]
2025-10-02T08:16:22.788061Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:22.788088Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:22.788092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.788128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.788135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.788149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.788186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2680 partition: 0 MaxSeqNo: 17 sessionId: src_id|e216b15-22f25ead-2548bc4f-8de4a333_0
2025-10-02T08:16:22.788501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2789b98b-c395f8a6-cf68f404-12cd7d97_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e216b15-22f25ead-2548bc4f-8de4a333_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:22.790828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e216b15-22f25ead-2548bc4f-8de4a333_0] Write session: try to update token
2025-10-02T08:16:22.790841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e216b15-22f25ead-2548bc4f-8de4a333_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:22.803245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId: src_id|e216b15-22f25ead-2548bc4f-8de4a333_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:22.805263Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:22.805281Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:22.805283Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:22.805291Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535319901379026:9231]
2025-10-02T08:16:22.805296Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535319901379026:9231]
2025-10-02T08:16:22.805337Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:22.805341Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:22.805346Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:22.805347Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.805349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:22.805476Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:22.805661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:22.862652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535319901379066:4064]
2025-10-02T08:16:22.862772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2679, pipe: [1:7556535319901379066:4064]
2025-10-02T08:16:22.936019Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:22.936401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.936417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.936454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901379066:4064], now have 1 active actors on pipe
2025-10-02T08:16:22.936568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535319901379066:4064]
2025-10-02T08:16:22.936589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:22.936591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:22.936645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2680 reason: error at write: Disconnected sessionId: src_id|e216b15-22f25ead-2548bc4f-8de4a333_0
2025-10-02T08:16:22.936652Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:22.936644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:22.936819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2680 sessionId: src_id|e216b15-22f25ead-2548bc4f-8de4a333_0 is DEAD
2025-10-02T08:16:22.936949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e216b15-22f25ead-2548bc4f-8de4a333_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:22.936959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e216b15-22f25ead-2548bc4f-8de4a333_0] Write session will restart in 0.009317s
2025-10-02T08:16:22.936979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e216b15-22f25ead-2548bc4f-8de4a333_0] Write session: Do CDS request
2025-10-02T08:16:22.936986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e216b15-22f25ead-2548bc4f-8de4a333_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:22.947282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e216b15-22f25ead-2548bc4f-8de4a333_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.947322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:22.947340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2681
2025-10-02T08:16:22.947488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:22.947517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:22.947525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:22.947529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:22.948008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2681 sessionId:  describe result for acl check
2025-10-02T08:16:22.948032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:22.948033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:22.948034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:22.948037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535319901379633:9250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:22.948531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535319901379633:9250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:22.950730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:22.950759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535319901379633:9250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:22.952067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:22.952226Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:22.952234Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:22.952243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:22.952286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:22.952316Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535319901379703:9241]
2025-10-02T08:16:22.952895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:22.953079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:22.953120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:22.953395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:22.953434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.953439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.953440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.953441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.953442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.953446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.953455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.953459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.953463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.953466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.953471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.953482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:22.953491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.953497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:22.953500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535319901379633:9250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:22.953504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.953505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535319901379633:9250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:22.953508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:22.953508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535319901379633:9250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:22.953511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.953514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:22.953515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.953519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.953524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.953546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:22.961023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:22.962431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:22.962454Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:22.962456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:22.962460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:22.962465Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2680 [1:7556535319901379703:9241]
2025-10-02T08:16:22.962475Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:22.962491Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:22.962498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.962501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.962503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.962517Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:22.962526Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:22.962531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:22.962592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.962600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.962602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:22.962605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:22.962672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:22.962683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.962694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:22.962704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:22.962722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535319901379716:9250], now have 1 active actors on pipe
2025-10-02T08:16:22.962726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535320360670835:2378], now have 1 active actors on pipe
2025-10-02T08:16:22.962731Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535319901379687:9241]
2025-10-02T08:16:22.962733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535319901379687:9241]
2025-10-02T08:16:22.962740Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:22.962741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2680
2025-10-02T08:16:22.962750Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:22.962753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:22.962754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:22.962766Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:22.962768Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:22.962776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.962785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.962822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535319901379687:9241]
2025-10-02T08:16:22.962834Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:22.962820Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2680
2025-10-02T08:16:22.962848Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:22.962849Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e716767-2a05a671-4a093323-86f3f926_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:22.962855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:22.962858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:22.962860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:22.962869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:22.962879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:22.962920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.962990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:22.962998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:22.963013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:22.963053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2681 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e716767-2a05a671-4a093323-86f3f926_0
2025-10-02T08:16:22.963390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e216b15-22f25ead-2548bc4f-8de4a333_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e716767-2a05a671-4a093323-86f3f926_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:22.965775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e716767-2a05a671-4a093323-86f3f926_0] Write session: try to update token
2025-10-02T08:16:22.965788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e716767-2a05a671-4a093323-86f3f926_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:22.978418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId: src_id|8e716767-2a05a671-4a093323-86f3f926_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:22.979576Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:22.979591Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:22.979592Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:22.979597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535319901379687:9241]
2025-10-02T08:16:22.979600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535319901379687:9241]
2025-10-02T08:16:22.979629Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:22.979631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:22.979633Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:22.979635Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:22.979637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:22.979757Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:22.980654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:23.036738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535324196347043:4064]
2025-10-02T08:16:23.036855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2680, pipe: [1:7556535324196347043:4064]
2025-10-02T08:16:23.104220Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:23.104656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.104668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.104697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196347043:4064], now have 1 active actors on pipe
2025-10-02T08:16:23.104819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535324196347043:4064]
2025-10-02T08:16:23.104839Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:23.104847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:23.104849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:23.104906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2681 reason: error at write: Disconnected sessionId: src_id|8e716767-2a05a671-4a093323-86f3f926_0
2025-10-02T08:16:23.104941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:23.105071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2681 sessionId: src_id|8e716767-2a05a671-4a093323-86f3f926_0 is DEAD
2025-10-02T08:16:23.105213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e716767-2a05a671-4a093323-86f3f926_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:23.105218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e716767-2a05a671-4a093323-86f3f926_0] Write session will restart in 0.006884s
2025-10-02T08:16:23.105237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e716767-2a05a671-4a093323-86f3f926_0] Write session: Do CDS request
2025-10-02T08:16:23.105241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e716767-2a05a671-4a093323-86f3f926_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:23.113181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e716767-2a05a671-4a093323-86f3f926_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.113180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:23.113192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2682
2025-10-02T08:16:23.113340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.113364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:23.113373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:23.113376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:23.113672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2682 sessionId:  describe result for acl check
2025-10-02T08:16:23.113692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:23.113697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:23.113698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:23.113701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535324196347481:9274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:23.114174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535324196347481:9274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:23.116025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535324196347481:9274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:23.118796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535324196347481:9274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:23.118808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535324196347481:9274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:23.118810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535324196347481:9274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:23.118815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:23.118944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:23.120323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:23.120443Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:23.120450Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:23.120456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:23.120485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:23.120510Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535324196347686:9277]
2025-10-02T08:16:23.120899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:23.121051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:23.121077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:23.121264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:23.121295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.121298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.121299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.121300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.121300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.121303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.121309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.121311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.121312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.121314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.121318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.121322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.121325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.121328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.121330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.121332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.121338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.121340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.121343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.121345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.121356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:23.128713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:23.130301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:23.130313Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:23.130314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:23.130316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:23.130321Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2681 [1:7556535324196347686:9277]
2025-10-02T08:16:23.130327Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:23.130338Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:23.130340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.130342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.130343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.130354Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:23.130362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:23.130366Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:23.130409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.130414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.130417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:23.130418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:23.130458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:23.130464Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.130470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.130477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:23.130487Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535324196347675:9277]
2025-10-02T08:16:23.130491Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535324196347675:9277]
2025-10-02T08:16:23.130497Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:23.130507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:23.130511Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:23.130515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:23.130518Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:23.130520Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:23.130526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196347677:9274], now have 1 active actors on pipe
2025-10-02T08:16:23.130528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2681
2025-10-02T08:16:23.130544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535324655638149:2378], now have 1 active actors on pipe
2025-10-02T08:16:23.130549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535324196347675:9277]
2025-10-02T08:16:23.130554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:23.130559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.130564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:23.130565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.130593Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:23.130600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.130604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.130608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:23.130613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.130622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:23.130636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.130655Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2681
2025-10-02T08:16:23.130670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.130678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.130692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.130715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2682 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0
2025-10-02T08:16:23.130981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e716767-2a05a671-4a093323-86f3f926_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:23.133350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0] Write session: try to update token
2025-10-02T08:16:23.133365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:23.145247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId: src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:23.146973Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:23.146999Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:23.147001Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:23.147009Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535324196347675:9277]
2025-10-02T08:16:23.147013Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535324196347675:9277]
2025-10-02T08:16:23.147053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:23.147064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.147063Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:23.147066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:23.147068Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:23.147195Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:23.147691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:23.205176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535324196347714:4064]
2025-10-02T08:16:23.205297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2681, pipe: [1:7556535324196347714:4064]
2025-10-02T08:16:23.272302Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:23.272737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.272750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.272782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196347714:4064], now have 1 active actors on pipe
2025-10-02T08:16:23.272905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535324196347714:4064]
2025-10-02T08:16:23.272925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:23.272927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:23.272976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2682 reason: error at write: Disconnected sessionId: src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0
2025-10-02T08:16:23.272980Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:23.273051Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:23.273167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2682 sessionId: src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0 is DEAD
2025-10-02T08:16:23.273343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:23.273352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0] Write session will restart in 0.008441s
2025-10-02T08:16:23.273371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0] Write session: Do CDS request
2025-10-02T08:16:23.273376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:23.283251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.283311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:23.283328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2683
2025-10-02T08:16:23.283430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.283452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:23.283458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:23.283461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:23.283846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2683 sessionId:  describe result for acl check
2025-10-02T08:16:23.283889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:23.283895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:23.283897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:23.283902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535324196348187:9318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:23.284261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535324196348187:9318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:23.286782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535324196348187:9318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:23.289009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:23.290407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:23.290532Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:23.290539Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:23.290546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:23.290575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:23.290598Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535324196348354:9325]
2025-10-02T08:16:23.290637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535324196348187:9318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:23.290650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535324196348187:9318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:23.290653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535324196348187:9318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:23.290659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:23.291119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:23.291300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:23.291342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:23.291624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:23.291670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.291675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.291676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.291677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.291678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.291683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.291692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.291695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.291699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.291702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.291712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.291719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.291728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.291733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.291744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.291748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.291753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.291757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.291761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.291766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.291786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:23.299210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:23.300706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:23.300726Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:23.300728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:23.300731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:23.300738Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2682 [1:7556535324196348354:9325]
2025-10-02T08:16:23.300749Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:23.300771Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:23.300777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.300780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.300782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.300796Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:23.300824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:23.300834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:23.300895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.300902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.300907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:23.300910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:23.300972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:23.300980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.300992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.301004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:23.301018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2682
2025-10-02T08:16:23.301026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196348359:9318], now have 1 active actors on pipe
2025-10-02T08:16:23.301029Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535324655638158:2378], now have 1 active actors on pipe
2025-10-02T08:16:23.301034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535324196348348:9325]
2025-10-02T08:16:23.301037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535324196348348:9325]
2025-10-02T08:16:23.301049Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:23.301061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.301065Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:23.301069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:23.301069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.301085Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:23.301101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:23.301108Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:23.301145Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:23.301154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.301157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.301159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:23.301123Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2682
2025-10-02T08:16:23.301167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.301179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:23.301188Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535324196348348:9325]
2025-10-02T08:16:23.301195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:23.301202Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:23.301222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.301306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.301313Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.301326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.301360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2683 partition: 0 MaxSeqNo: 17 sessionId: src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0
2025-10-02T08:16:23.301647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed56a4-5ab1a906-5fc61617-e14237a5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:23.304114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0] Write session: try to update token
2025-10-02T08:16:23.304126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:23.316467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId: src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:23.317229Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:23.317243Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:23.317245Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:23.317253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535324196348348:9325]
2025-10-02T08:16:23.317257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535324196348348:9325]
2025-10-02T08:16:23.317295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:23.317302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:23.317306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.317308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:23.317310Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:23.317424Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:23.318946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:23.373116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535324196348386:4064]
2025-10-02T08:16:23.373218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2682, pipe: [1:7556535324196348386:4064]
2025-10-02T08:16:23.439371Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:23.439846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.439859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.439890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196348386:4064], now have 1 active actors on pipe
2025-10-02T08:16:23.439965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:23.439971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:23.440007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2683 reason: error at write: Disconnected sessionId: src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0
2025-10-02T08:16:23.440072Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:23.440085Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:23.440142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2683 sessionId: src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0 is DEAD
2025-10-02T08:16:23.440257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:23.440262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0] Write session will restart in 0.008894s
2025-10-02T08:16:23.440280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0] Write session: Do CDS request
2025-10-02T08:16:23.440260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535324196348386:4064]
2025-10-02T08:16:23.440285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:23.450195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.450248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:23.450267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2684
2025-10-02T08:16:23.450368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.450410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:23.450420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:23.450423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:23.450781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2684 sessionId:  describe result for acl check
2025-10-02T08:16:23.450815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:23.450822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:23.450823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:23.450827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535324196348892:9345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:23.451314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535324196348892:9345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:23.454036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535324196348892:9345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:23.456586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:23.456890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:23.456906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535324196348892:9345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:23.456912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535324196348892:9345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:23.456916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535324196348892:9345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:23.456922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:23.457103Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:23.457114Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:23.457123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:23.457168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:23.457196Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535324196349033:9334]
2025-10-02T08:16:23.457626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:23.457809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:23.457866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:23.458165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:23.458225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.458231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.458232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.458234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.458235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.458240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.458249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.458258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.458262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.458270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.458275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.458288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.458298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.458304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.458312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.458316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.458320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.458325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.458329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.458334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.458353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:23.465868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:23.467294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:23.467318Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:23.467320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:23.467324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:23.467329Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2683 [1:7556535324196349033:9334]
2025-10-02T08:16:23.467340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:23.467361Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:23.467364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.467367Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.467369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.467385Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:23.467396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:23.467403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:23.467467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.467475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.467478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:23.467481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:23.467625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2683
2025-10-02T08:16:23.467692Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2683
2025-10-02T08:16:23.467932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:23.467944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.467959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.467977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:23.468001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196349030:9345], now have 1 active actors on pipe
2025-10-02T08:16:23.468009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535324655638164:2378], now have 1 active actors on pipe
2025-10-02T08:16:23.468014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.468021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.468053Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535324196349022:9334]
2025-10-02T08:16:23.468061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535324196349022:9334]
2025-10-02T08:16:23.468074Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:23.468094Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:23.468096Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:23.468100Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:23.468113Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:23.468116Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:23.468133Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:23.468144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.468151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.468154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:23.468165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.468180Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:23.468214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535324196349022:9334]
2025-10-02T08:16:23.468225Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:23.468237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:23.468239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.468293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.468300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.468314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.468351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2684 partition: 0 MaxSeqNo: 17 sessionId: src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0
2025-10-02T08:16:23.468665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51d1f71-9fda0a0e-433eee12-a798ce74_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:23.471271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0] Write session: try to update token
2025-10-02T08:16:23.471287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:23.484414Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:23.484442Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:23.484444Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:23.484453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535324196349022:9334]
2025-10-02T08:16:23.484457Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535324196349022:9334]
2025-10-02T08:16:23.484500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:23.484499Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:23.484504Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:23.484511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.484513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:23.484564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId: src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:23.484646Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:23.486689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:23.540527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535324196349062:4064]
2025-10-02T08:16:23.540624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2683, pipe: [1:7556535324196349062:4064]
2025-10-02T08:16:23.614675Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:23.614903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.614915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.614946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196349062:4064], now have 1 active actors on pipe
2025-10-02T08:16:23.615031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535324196349062:4064]
2025-10-02T08:16:23.615046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:23.615048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:23.615088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2684 reason: error at write: Disconnected sessionId: src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0
2025-10-02T08:16:23.615168Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:23.615183Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:23.615227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2684 sessionId: src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0 is DEAD
2025-10-02T08:16:23.615412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:23.615424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0] Write session will restart in 0.005508s
2025-10-02T08:16:23.615451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0] Write session: Do CDS request
2025-10-02T08:16:23.615457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:23.622255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.622314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:23.622328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2685
2025-10-02T08:16:23.622463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.622490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:23.622499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:23.622501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:23.622854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2685 sessionId:  describe result for acl check
2025-10-02T08:16:23.622894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:23.622899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:23.622901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:23.622906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535324196349449:9393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:23.623401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535324196349449:9393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:23.625543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535324196349449:9393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:23.628473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535324196349449:9393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:23.628488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535324196349449:9393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:23.628491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535324196349449:9393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:23.628497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:23.629140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:23.630706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:23.630847Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:23.630855Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:23.630862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:23.630897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:23.630929Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535324196349712:9360]
2025-10-02T08:16:23.631305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:23.631457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:23.631487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:23.631672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:23.631706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.631710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.631711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.631711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.631712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.631714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.631720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.631722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.631724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.631726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.631730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.631734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.631738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.631740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.631742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.631745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.631747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.631749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.631751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.631758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.631769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:23.639331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:23.640839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:23.640855Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:23.640857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:23.640860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:23.640867Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2684 [1:7556535324196349712:9360]
2025-10-02T08:16:23.640877Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:23.640892Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:23.640894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.640897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.640899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.640913Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:23.640920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:23.640926Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:23.640983Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.640991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.640994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:23.640997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:23.641060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:23.641067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.641078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.641092Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:23.641113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196349694:9393], now have 1 active actors on pipe
2025-10-02T08:16:23.641122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535324196349706:9360]
2025-10-02T08:16:23.641124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535324196349706:9360]
2025-10-02T08:16:23.641131Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:23.641132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2684
2025-10-02T08:16:23.641140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:23.641142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535324655638170:2378], now have 1 active actors on pipe
2025-10-02T08:16:23.641143Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:23.641151Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:23.641163Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:23.641170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:23.641176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.641184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.641187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2684
2025-10-02T08:16:23.641217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535324196349706:9360]
2025-10-02T08:16:23.641225Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:23.641229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:23.641238Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:23.641244Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.641247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.641248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:23.641256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.641263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:23.641298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.641340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.641346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.641357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.641392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2685 partition: 0 MaxSeqNo: 17 sessionId: src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0
2025-10-02T08:16:23.641675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99f4e30-b94b168b-d52a7c99-40aa3960_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:23.644039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0] Write session: try to update token
2025-10-02T08:16:23.644065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:23.656503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId: src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:23.657836Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:23.657859Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:23.657861Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:23.657869Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535324196349706:9360]
2025-10-02T08:16:23.657873Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535324196349706:9360]
2025-10-02T08:16:23.657912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:23.657912Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:23.657917Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:23.657923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.657925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:23.658058Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:23.659134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:23.715133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535324196349738:4064]
2025-10-02T08:16:23.715234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2684, pipe: [1:7556535324196349738:4064]
2025-10-02T08:16:23.789980Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:23.790133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.790141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.790168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196349738:4064], now have 1 active actors on pipe
2025-10-02T08:16:23.790249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535324196349738:4064]
2025-10-02T08:16:23.790263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:23.790267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:23.790298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2685 reason: error at write: Disconnected sessionId: src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0
2025-10-02T08:16:23.790316Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:23.790341Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:23.790435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2685 sessionId: src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0 is DEAD
2025-10-02T08:16:23.790592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:23.790600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0] Write session will restart in 0.005710s
2025-10-02T08:16:23.790625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0] Write session: Do CDS request
2025-10-02T08:16:23.790630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:23.797174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.797230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:23.797247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2686
2025-10-02T08:16:23.797351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.797386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:23.797394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:23.797398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:23.797828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2686 sessionId:  describe result for acl check
2025-10-02T08:16:23.797857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:23.797863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:23.797865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:23.797869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535324196350106:9457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:23.798337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535324196350106:9457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:23.800948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535324196350106:9457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:23.804394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535324196350106:9457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:23.804408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535324196350106:9457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:23.804410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535324196350106:9457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:23.804415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:23.807303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:23.808999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:23.809154Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:23.809165Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:23.809175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:23.809224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:23.809256Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535324196350428:9454]
2025-10-02T08:16:23.809851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:23.810056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:23.810103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:23.810400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:23.810455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.810461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.810462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.810463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.810464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.810469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.810478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.810482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.810485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.810488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.810495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.810501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.810506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.810511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.810515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.810519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.810523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.810527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.810531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.810535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.810555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:23.818084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:23.819781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:23.819796Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:23.819797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:23.819800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:23.819804Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2685 [1:7556535324196350428:9454]
2025-10-02T08:16:23.819811Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:23.819823Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:23.819825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.819827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.819828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.819839Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:23.819842Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:23.819847Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:23.819888Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.819894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.819896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:23.819897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:23.819960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:23.819968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.819979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.819989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:23.820001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2685
2025-10-02T08:16:23.820008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196350373:9457], now have 1 active actors on pipe
2025-10-02T08:16:23.820014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535324196350422:9454]
2025-10-02T08:16:23.820016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535324196350422:9454]
2025-10-02T08:16:23.820027Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:23.820034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535324655638198:2378], now have 1 active actors on pipe
2025-10-02T08:16:23.820040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:23.820051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.820051Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:23.820055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.820072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:23.820086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:23.820092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:23.820088Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2685
2025-10-02T08:16:23.820128Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:23.820139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.820143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.820145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:23.820153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.820160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:23.820170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535324196350422:9454]
2025-10-02T08:16:23.820180Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:23.820186Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:23.820204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.820235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.820241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.820250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.820281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2686 partition: 0 MaxSeqNo: 17 sessionId: src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0
2025-10-02T08:16:23.820598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|497bc8eb-dc3cc5bb-171cb605-fdad58c9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:23.822913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0] Write session: try to update token
2025-10-02T08:16:23.822929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:23.835172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId: src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:23.836506Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:23.836523Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:23.836525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:23.836533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535324196350422:9454]
2025-10-02T08:16:23.836537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535324196350422:9454]
2025-10-02T08:16:23.836577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:23.836586Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.836587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:23.836587Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:23.836592Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:23.836710Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:23.837638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:23.890236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535324196350456:4064]
2025-10-02T08:16:23.890337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2685, pipe: [1:7556535324196350456:4064]
2025-10-02T08:16:23.966255Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:23.966620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.966637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.966670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196350456:4064], now have 1 active actors on pipe
2025-10-02T08:16:23.966750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:23.966758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:23.966801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2686 reason: error at write: Disconnected sessionId: src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0
2025-10-02T08:16:23.966808Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:23.966867Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:23.966928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2686 sessionId: src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0 is DEAD
2025-10-02T08:16:23.967044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535324196350456:4064]
2025-10-02T08:16:23.967075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:23.967083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0] Write session will restart in 0.005981s
2025-10-02T08:16:23.967103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0] Write session: Do CDS request
2025-10-02T08:16:23.967107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:23.974194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.974249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:23.974264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2687
2025-10-02T08:16:23.974397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:23.974429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:23.974438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:23.974441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:23.974786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2687 sessionId:  describe result for acl check
2025-10-02T08:16:23.974813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:23.974818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:23.974819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:23.974823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535324196350846:9477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:23.975281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535324196350846:9477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:23.977189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535324196350846:9477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:23.979572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535324196350846:9477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:23.979582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535324196350846:9477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:23.979584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535324196350846:9477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:23.979589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:23.981904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:23.982164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:23.982289Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:23.982297Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:23.982305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:23.982341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:23.982372Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535324196351122:9468]
2025-10-02T08:16:23.982994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:23.983110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:23.983142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:23.983420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:23.983453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.983459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.983460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.983461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.983462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.983467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.983476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.983480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.983484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.983488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.983493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.983503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:23.983508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.983517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:23.983525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.983530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:23.983538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.983543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.983549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.983558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.983578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:23.990954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:23.992552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:23.992568Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:23.992570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:23.992574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:23.992578Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2686 [1:7556535324196351122:9468]
2025-10-02T08:16:23.992589Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:23.992602Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:23.992604Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.992607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.992609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.992623Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:23.992632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:23.992642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:23.992695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.992705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.992708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:23.992710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:23.992771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:23.992779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:23.992790Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:23.992816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:23.992831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535324196351101:9477], now have 1 active actors on pipe
2025-10-02T08:16:23.992839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535324655638219:2378], now have 1 active actors on pipe
2025-10-02T08:16:23.992844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535324196351116:9468]
2025-10-02T08:16:23.992847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535324196351116:9468]
2025-10-02T08:16:23.992853Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:23.992857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2686
2025-10-02T08:16:23.992868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:23.992877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:23.992886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:23.992887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:23.992889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:23.992911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.992916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.992927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535324196351116:9468]
2025-10-02T08:16:23.992936Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:23.992893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2686
2025-10-02T08:16:23.992945Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:23.992967Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf538ff7-9367f404-fcec0e9f-91792149_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:23.992977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:23.992980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:23.992982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:23.992990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:23.992997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:23.993019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.993075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:23.993081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:23.993093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:23.993123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2687 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf538ff7-9367f404-fcec0e9f-91792149_0
2025-10-02T08:16:23.993429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1655bf56-614c40bd-5dcd516-cc0875ba_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf538ff7-9367f404-fcec0e9f-91792149_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:23.995908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf538ff7-9367f404-fcec0e9f-91792149_0] Write session: try to update token
2025-10-02T08:16:23.995924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf538ff7-9367f404-fcec0e9f-91792149_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:24.009148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId: src_id|cf538ff7-9367f404-fcec0e9f-91792149_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:24.009817Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:24.009831Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:24.009833Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:24.009841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535324196351116:9468]
2025-10-02T08:16:24.009844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535324196351116:9468]
2025-10-02T08:16:24.009878Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:24.009884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:24.009889Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:24.009891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.009894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:24.010016Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:24.011329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:24.067400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535328491318444:4064]
2025-10-02T08:16:24.067497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2686, pipe: [1:7556535328491318444:4064]
2025-10-02T08:16:24.140114Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:24.140501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.140510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.140540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491318444:4064], now have 1 active actors on pipe
2025-10-02T08:16:24.140635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535328491318444:4064]
2025-10-02T08:16:24.140653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:24.140658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:24.140700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2687 reason: error at write: Disconnected sessionId: src_id|cf538ff7-9367f404-fcec0e9f-91792149_0
2025-10-02T08:16:24.140736Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:24.140766Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:24.140880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2687 sessionId: src_id|cf538ff7-9367f404-fcec0e9f-91792149_0 is DEAD
2025-10-02T08:16:24.141008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf538ff7-9367f404-fcec0e9f-91792149_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:24.141014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf538ff7-9367f404-fcec0e9f-91792149_0] Write session will restart in 0.006137s
2025-10-02T08:16:24.141031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf538ff7-9367f404-fcec0e9f-91792149_0] Write session: Do CDS request
2025-10-02T08:16:24.141036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf538ff7-9367f404-fcec0e9f-91792149_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:24.148165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf538ff7-9367f404-fcec0e9f-91792149_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.148222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:24.148237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2688
2025-10-02T08:16:24.148327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.148366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:24.148373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:24.148376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:24.148674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2688 sessionId:  describe result for acl check
2025-10-02T08:16:24.148699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:24.148704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:24.148705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:24.148708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535328491318809:9552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:24.149075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535328491318809:9552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:24.151381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535328491318809:9552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:24.154291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535328491318809:9552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:24.154305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535328491318809:9552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:24.154307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535328491318809:9552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:24.154314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:24.155512Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:24.156872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:24.157006Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:24.157013Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:24.157021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:24.157051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:24.157075Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535328491319102:9506]
2025-10-02T08:16:24.157468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:24.157582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:24.157607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:24.157808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:24.157838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.157843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.157843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.157844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.157844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.157847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.157853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.157855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.157857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.157859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.157862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.157870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.157873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.157880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.157882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.157884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.157887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.157889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.157892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.157895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.157909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:24.165391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:24.166976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:24.167000Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:24.167002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:24.167005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:24.167010Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2687 [1:7556535328491319102:9506]
2025-10-02T08:16:24.167019Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:24.167035Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:24.167043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.167045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.167048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.167062Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:24.167071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:24.167078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:24.167140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.167150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.167153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:24.167155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:24.167218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:24.167226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.167238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.167242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2687
2025-10-02T08:16:24.167249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:24.167267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491319082:9552], now have 1 active actors on pipe
2025-10-02T08:16:24.167275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535328950605521:2378], now have 1 active actors on pipe
2025-10-02T08:16:24.167280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.167283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.167304Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535328491319096:9506]
2025-10-02T08:16:24.167314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535328491319096:9506]
2025-10-02T08:16:24.167329Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:24.167338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:24.167340Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:24.167346Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:24.167364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:24.167370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:24.167346Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2687
2025-10-02T08:16:24.167385Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:24.167396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.167404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.167406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:24.167415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.167427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:24.167462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535328491319096:9506]
2025-10-02T08:16:24.167475Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:24.167489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.167500Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:24.167537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.167544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.167557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.167593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2688 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0
2025-10-02T08:16:24.167904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf538ff7-9367f404-fcec0e9f-91792149_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:24.170230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0] Write session: try to update token
2025-10-02T08:16:24.170245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:24.178491Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:24.178528Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:24.178539Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535328491319096:9506]
2025-10-02T08:16:24.178583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:24.178597Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:24.178908Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:24.179054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:24.179199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:24.179340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:24.179537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:24.179577Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:24.183367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId: src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:24.185754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:24.185838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.185848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.185876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:24.185896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:24.185947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.185960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.186095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.186157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.186215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.186284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.186692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.186701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.186761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.186814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.186874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.186935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.186975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.186980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.187038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.187091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.187151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.187212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.187251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.187256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.187310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.187369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.187427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.187482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.187576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.187582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.187637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.187702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.187758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.187814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.187852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.187857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.187914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.187978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.188034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.188103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.188144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.188149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.188213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.188267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.188326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.188396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.188438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.188444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.188510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.188571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.188635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.188701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.188822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.188829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.188892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.188951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.189011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.189073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.189112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.189119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.189182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.189244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.189302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.189362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.189407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.189414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.189447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:24.189508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.189529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.189534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:24.189563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:24.189578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:24.189585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:24.189588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:24.189591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:24.189991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:24.190013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:24.190020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:24.190023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:24.190027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:24.190035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:24.190461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:24.190484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:24.190492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:24.190495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:24.190498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:24.190501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:24.190935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:24.190955Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:24.190961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:24.190964Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:24.190967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:24.192058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:24.192075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:24.192088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392984191
2025-10-02T08:16:24.192336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:24.192351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:24.192356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:24.192359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:24.192363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:24.192366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:24.192771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:24.192794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:24.192823Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:24.192828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:24.192835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:24.192838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:24.193271Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:24.193290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:24.193296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:24.193298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:24.193302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:24.193305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:24.193716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:24.193737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:24.193742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:24.194729Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:24.194749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:24.194755Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:24.194758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:24.194765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392984194
2025-10-02T08:16:24.195039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:24.195059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:24.195065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:24.195069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:24.195073Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:24.195076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:24.195501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:24.195522Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:24.195528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:24.195533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:24.195536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:24.195540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:24.195951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:24.195969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.196058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392984195
2025-10-02T08:16:24.196739Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:24.196761Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:24.196766Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:24.196773Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:24.198292Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:24.198307Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:24.198308Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:24.198316Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535328491319096:9506]
2025-10-02T08:16:24.198319Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535328491319096:9506]
2025-10-02T08:16:24.198374Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:24.198381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.198381Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:24.198383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:24.198388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:24.198508Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:24.240966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535328491319136:4064]
2025-10-02T08:16:24.241072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2687, pipe: [1:7556535328491319136:4064]
2025-10-02T08:16:24.325323Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:24.325633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491319136:4064], now have 1 active actors on pipe
2025-10-02T08:16:24.325750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535328491319136:4064]
2025-10-02T08:16:24.325769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:24.325771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:24.325793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2688 reason: error at write: Disconnected sessionId: src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0
2025-10-02T08:16:24.325851Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:24.325858Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:24.325948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2688 sessionId: src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0 is DEAD
2025-10-02T08:16:24.326082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:24.326092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0] Write session will restart in 0.008898s
2025-10-02T08:16:24.326115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0] Write session: Do CDS request
2025-10-02T08:16:24.326121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:24.336216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.336269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:24.336286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2689
2025-10-02T08:16:24.336388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.336415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:24.336424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:24.336427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:24.336749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2689 sessionId:  describe result for acl check
2025-10-02T08:16:24.336781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:24.336787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:24.336788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:24.336794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535328491319705:11572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:24.337213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535328491319705:11572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:24.339121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535328491319705:11572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:24.340851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:24.341157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:24.341294Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:24.341303Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:24.341311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:24.341343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:24.341353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535328491319705:11572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:24.341364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535328491319705:11572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:24.341366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535328491319705:11572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:24.341372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:24.341376Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535328491319790:9578]
2025-10-02T08:16:24.342011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:24.342146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:24.342178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:24.342459Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:24.342491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.342496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.342497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.342498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.342499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.342504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.342514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.342523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.342530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.342538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.342548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.342558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.342567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.342576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.342584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.342593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.342601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.342610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.342618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.342627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.342649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:24.349799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:24.351233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:24.351250Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:24.351252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:24.351255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:24.351260Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2688 [1:7556535328491319790:9578]
2025-10-02T08:16:24.351270Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:24.351285Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:24.351288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.351290Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.351292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.351305Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:24.351310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:24.351316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:24.351370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.351378Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.351381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:24.351383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:24.351483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2688
2025-10-02T08:16:24.351585Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2688
2025-10-02T08:16:24.351706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:24.351714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.351726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.351744Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:24.351765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491319795:11572], now have 1 active actors on pipe
2025-10-02T08:16:24.351772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535328950605530:2378], now have 1 active actors on pipe
2025-10-02T08:16:24.351777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.351784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.351804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535328491319784:9578]
2025-10-02T08:16:24.351810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535328491319784:9578]
2025-10-02T08:16:24.351820Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:24.351831Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:24.351834Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:24.351839Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:24.351848Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:24.351850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:24.351864Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de492c72-82475e66-114a29a6-bf7d0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:24.351875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.351882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.351884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:24.351892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.351903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:24.351930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535328491319784:9578]
2025-10-02T08:16:24.351940Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:24.351946Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:24.351950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.351990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.351995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.352009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.352039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2689 partition: 0 MaxSeqNo: 17 sessionId: src_id|de492c72-82475e66-114a29a6-bf7d0a_0
2025-10-02T08:16:24.352357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0d574f-d6e179c5-a008a5c4-5f3c9712_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|de492c72-82475e66-114a29a6-bf7d0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:24.354731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de492c72-82475e66-114a29a6-bf7d0a_0] Write session: try to update token
2025-10-02T08:16:24.354746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de492c72-82475e66-114a29a6-bf7d0a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:24.361696Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:24.361713Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:24.361721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535328491319784:9578]
2025-10-02T08:16:24.361759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:24.361777Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:24.361910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:24.362038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:24.362159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:24.362286Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:24.362472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:24.362506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:24.367496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId: src_id|de492c72-82475e66-114a29a6-bf7d0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:24.369771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:24.369829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.369838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.369861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:24.369883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:24.369914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.369925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.370061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.370115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.370173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.370230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.370301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.370310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.370369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.370423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.370476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.370532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.370573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.370580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.370639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.370691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.370740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.370803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.370844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.370852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.370908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.370961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.371025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.371085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.371124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.371129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.371185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.371237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.371290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.371343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.371382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.371387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.371442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.371494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.371549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.371602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.371640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.371645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.371700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.371751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.371806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.371860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.371898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.371903Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.371959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.372010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.372077Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.372131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.372170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.372176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.372231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.372284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.372335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.372388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.372426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.372431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.372486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:24.372539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:24.372592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:24.372646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:24.372683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:24.372688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:24.372720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:24.372769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.372786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.372791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:24.372833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:24.372846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:24.372851Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:24.372853Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:24.372854Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:24.373179Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:24.373199Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:24.373204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:24.373206Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:24.373208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:24.373210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:24.373734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:24.373762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:24.373769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:24.373776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:24.373779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:24.373781Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:24.374282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:24.374306Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:24.374311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:24.374314Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:24.374317Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:24.375377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:24.375394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:24.375405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392984375
2025-10-02T08:16:24.375536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:24.375548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:24.375552Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:24.375553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:24.375556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:24.375557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:24.375928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:24.375945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:24.375948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:24.375951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:24.375954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:24.375958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:24.376379Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:24.376401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:24.376411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:24.376414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:24.376417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:24.376420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:24.376916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:24.376934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:24.376938Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:24.377893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:24.377912Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:24.377917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:24.377922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:24.377929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392984377
2025-10-02T08:16:24.378200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:24.378219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:24.378224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:24.378228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:24.378230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:24.378233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:24.378612Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:24.378628Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:24.378631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:24.378633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:24.378636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:24.378639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:24.379053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:24.379073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.379147Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392984378
2025-10-02T08:16:24.379777Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:24.379796Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:24.379800Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:24.379804Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:24.381267Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:24.381275Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:24.381276Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:24.381286Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535328491319784:9578]
2025-10-02T08:16:24.381289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535328491319784:9578]
2025-10-02T08:16:24.381324Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:24.381328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:24.381329Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:24.381331Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.381332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:24.381450Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:24.425789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535328491319832:4064]
2025-10-02T08:16:24.425912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2688, pipe: [1:7556535328491319832:4064]
2025-10-02T08:16:24.504680Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:24.504976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491319832:4064], now have 1 active actors on pipe
2025-10-02T08:16:24.505094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535328491319832:4064]
2025-10-02T08:16:24.505115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:24.505117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:24.505140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2689 reason: error at write: Disconnected sessionId: src_id|de492c72-82475e66-114a29a6-bf7d0a_0
2025-10-02T08:16:24.505179Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:24.505188Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:24.505296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2689 sessionId: src_id|de492c72-82475e66-114a29a6-bf7d0a_0 is DEAD
2025-10-02T08:16:24.505406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de492c72-82475e66-114a29a6-bf7d0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:24.505412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de492c72-82475e66-114a29a6-bf7d0a_0] Write session will restart in 0.006478s
2025-10-02T08:16:24.505429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de492c72-82475e66-114a29a6-bf7d0a_0] Write session: Do CDS request
2025-10-02T08:16:24.505434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de492c72-82475e66-114a29a6-bf7d0a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:24.513159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de492c72-82475e66-114a29a6-bf7d0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.513228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:24.513245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2690
2025-10-02T08:16:24.513343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.513379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:24.513387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:24.513391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:24.513696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2690 sessionId:  describe result for acl check
2025-10-02T08:16:24.513734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:24.513740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:24.513742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:24.513746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535328491320284:9669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:24.514095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535328491320284:9669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:24.516469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535328491320284:9669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:24.518515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535328491320284:9669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:24.518529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535328491320284:9669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:24.518532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535328491320284:9669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:24.518539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:24.519201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:24.519489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:24.519641Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:24.519651Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:24.519660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:24.519709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:24.519743Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535328491320573:9681]
2025-10-02T08:16:24.520299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:24.520462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:24.520503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:24.520787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:24.520852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.520858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.520859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.520860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.520861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.520866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.520873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.520877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.520880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.520883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.520888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.520894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.520899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.520903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.520906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.520911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.520914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.520918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.520922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.520931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.520948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:24.528478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:24.530308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:24.530325Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:24.530327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:24.530330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:24.530336Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2689 [1:7556535328491320573:9681]
2025-10-02T08:16:24.530346Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:24.530363Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:24.530366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.530368Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.530370Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.530385Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:24.530395Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:24.530402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:24.530459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.530467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.530470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:24.530472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:24.530536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:24.530543Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.530554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.530564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:24.530583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491320563:9669], now have 1 active actors on pipe
2025-10-02T08:16:24.530591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535328950605536:2378], now have 1 active actors on pipe
2025-10-02T08:16:24.530597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535328491320567:9681]
2025-10-02T08:16:24.530599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535328491320567:9681]
2025-10-02T08:16:24.530606Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:24.530612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2689
2025-10-02T08:16:24.530617Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:24.530620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:24.530622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:24.530636Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:24.530640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:24.530647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.530650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.530686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535328491320567:9681]
2025-10-02T08:16:24.530694Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:24.530710Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a8a2436-f52d2671-bd347873-10811a45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:24.530710Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:24.530660Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2689
2025-10-02T08:16:24.530720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.530723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.530725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:24.530735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.530743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:24.530780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.530817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.530823Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.530834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.530862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2690 partition: 0 MaxSeqNo: 17 sessionId: src_id|5a8a2436-f52d2671-bd347873-10811a45_0
2025-10-02T08:16:24.531178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de492c72-82475e66-114a29a6-bf7d0a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5a8a2436-f52d2671-bd347873-10811a45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:24.533708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8a2436-f52d2671-bd347873-10811a45_0] Write session: try to update token
2025-10-02T08:16:24.533721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8a2436-f52d2671-bd347873-10811a45_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:24.546648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId: src_id|5a8a2436-f52d2671-bd347873-10811a45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:24.547398Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:24.547412Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:24.547414Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:24.547420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535328491320567:9681]
2025-10-02T08:16:24.547423Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535328491320567:9681]
2025-10-02T08:16:24.547454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:24.547458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.547460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:24.547526Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:24.547538Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:24.547577Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:24.548896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:24.605513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535328491320602:4064]
2025-10-02T08:16:24.605590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2689, pipe: [1:7556535328491320602:4064]
2025-10-02T08:16:24.671111Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:24.671422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.671432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.671462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491320602:4064], now have 1 active actors on pipe
2025-10-02T08:16:24.671577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535328491320602:4064]
2025-10-02T08:16:24.671755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:24.671765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:24.671786Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:24.671826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2690 reason: error at write: Disconnected sessionId: src_id|5a8a2436-f52d2671-bd347873-10811a45_0
2025-10-02T08:16:24.672019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2690 sessionId: src_id|5a8a2436-f52d2671-bd347873-10811a45_0 is DEAD
2025-10-02T08:16:24.672180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8a2436-f52d2671-bd347873-10811a45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:24.672189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8a2436-f52d2671-bd347873-10811a45_0] Write session will restart in 0.007245s
2025-10-02T08:16:24.672208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8a2436-f52d2671-bd347873-10811a45_0] Write session: Do CDS request
2025-10-02T08:16:24.672217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8a2436-f52d2671-bd347873-10811a45_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:24.672243Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:24.680207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8a2436-f52d2671-bd347873-10811a45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.680262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:24.680276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2691
2025-10-02T08:16:24.680380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.680410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:24.680415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:24.680418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:24.680819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2691 sessionId:  describe result for acl check
2025-10-02T08:16:24.680848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:24.680853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:24.680854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:24.680857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535328491321090:9746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:24.681218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535328491321090:9746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:24.683111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535328491321090:9746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:24.685453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535328491321090:9746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:24.685467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535328491321090:9746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:24.685470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535328491321090:9746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:24.685476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:24.686190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:24.686454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:24.686576Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:24.686583Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:24.686590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:24.686626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:24.686660Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535328491321335:9770]
2025-10-02T08:16:24.687057Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:24.687224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:24.687250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:24.687442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:24.687472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.687476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.687477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.687477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.687478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.687482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.687487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.687489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.687491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.687493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.687496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.687501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.687505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.687507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.687510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.687512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.687514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.687517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.687519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.687521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.687532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:24.694946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:24.696792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:24.696826Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:24.696828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:24.696831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:24.696836Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2690 [1:7556535328491321335:9770]
2025-10-02T08:16:24.696845Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:24.696861Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:24.696868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.696871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.696873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.696887Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:24.696896Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:24.696902Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:24.696950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.696955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.696957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:24.696959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:24.697002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:24.697009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.697016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.697022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:24.697032Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535328491321329:9770]
2025-10-02T08:16:24.697037Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535328491321329:9770]
2025-10-02T08:16:24.697042Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:24.697052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:24.697059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:24.697062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:24.697063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:24.697065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:24.697071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491321326:9746], now have 1 active actors on pipe
2025-10-02T08:16:24.697073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535328950605543:2378], now have 1 active actors on pipe
2025-10-02T08:16:24.697089Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535328491321329:9770]
2025-10-02T08:16:24.697089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2690
2025-10-02T08:16:24.697096Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:24.697099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:24.697100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.697102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.697131Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:24.697138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.697141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.697142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:24.697147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.697153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:24.697164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.697149Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2690
2025-10-02T08:16:24.697201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.697215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.697240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.697280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2691 partition: 0 MaxSeqNo: 17 sessionId: src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0
2025-10-02T08:16:24.697530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a8a2436-f52d2671-bd347873-10811a45_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:24.699727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0] Write session: try to update token
2025-10-02T08:16:24.699737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:24.713062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId: src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:24.713334Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:24.713351Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:24.713354Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:24.713362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535328491321329:9770]
2025-10-02T08:16:24.713366Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535328491321329:9770]
2025-10-02T08:16:24.713406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:24.713413Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:24.713416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.713418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:24.713419Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:24.713547Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:24.715454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:24.771894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535328491321362:4064]
2025-10-02T08:16:24.771967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2690, pipe: [1:7556535328491321362:4064]
2025-10-02T08:16:24.837792Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:24.838066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.838076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.838104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491321362:4064], now have 1 active actors on pipe
2025-10-02T08:16:24.838210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:24.838219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:24.838244Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:24.838267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2691 reason: error at write: Disconnected sessionId: src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0
2025-10-02T08:16:24.838336Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:24.838408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2691 sessionId: src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0 is DEAD
2025-10-02T08:16:24.838452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535328491321362:4064]
2025-10-02T08:16:24.838563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:24.838574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0] Write session will restart in 0.008540s
2025-10-02T08:16:24.838595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0] Write session: Do CDS request
2025-10-02T08:16:24.838601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:24.848281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.848353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:24.848372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2692
2025-10-02T08:16:24.848498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:24.848523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:24.848531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:24.848534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:24.848900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2692 sessionId:  describe result for acl check
2025-10-02T08:16:24.848931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:24.848936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:24.848938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:24.848942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535328491322030:9812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:24.849388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535328491322030:9812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:24.851031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535328491322030:9812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:24.851218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:24.851846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:24.852030Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:24.852053Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:24.852062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:24.852116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:24.852151Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535328491322129:9799]
2025-10-02T08:16:24.852724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:24.852893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:24.852928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:24.853192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:24.853226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.853231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.853232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.853233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.853234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.853238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.853246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.853250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.853253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.853256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.853262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.853267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:24.853276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.853280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:24.853288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.853292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:24.853299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.853303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.853311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.853316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.853335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:24.853386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535328491322030:9812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:24.853399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535328491322030:9812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:24.853402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535328491322030:9812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:24.853408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:24.860413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:24.862156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:24.862172Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:24.862174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:24.862177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:24.862182Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2691 [1:7556535328491322129:9799]
2025-10-02T08:16:24.862191Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:24.862204Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:24.862207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.862209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.862211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.862222Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:24.862226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:24.862235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:24.862289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.862296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.862298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:24.862300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:24.862354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:24.862360Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.862369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:24.862383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:24.862393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2691
2025-10-02T08:16:24.862402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491322146:9812], now have 1 active actors on pipe
2025-10-02T08:16:24.862405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535328950605574:2378], now have 1 active actors on pipe
2025-10-02T08:16:24.862410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535328491322114:9799]
2025-10-02T08:16:24.862412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535328491322114:9799]
2025-10-02T08:16:24.862422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:24.862435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.862439Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:24.862441Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:24.862442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.862457Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:24.862473Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:24.862479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:24.862467Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2691
2025-10-02T08:16:24.862508Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:24.862517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:24.862521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:24.862523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:24.862532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:24.862538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:24.862548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535328491322114:9799]
2025-10-02T08:16:24.862556Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:24.862568Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:24.862580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.862618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:24.862624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:24.862636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:24.862666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2692 partition: 0 MaxSeqNo: 17 sessionId: src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0
2025-10-02T08:16:24.862986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d4f266-d241e897-ddb7b69b-bac3348b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:24.865389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0] Write session: try to update token
2025-10-02T08:16:24.865403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:24.877858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId: src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:24.878703Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:24.878720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:24.878722Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:24.878730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535328491322114:9799]
2025-10-02T08:16:24.878733Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535328491322114:9799]
2025-10-02T08:16:24.878765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:24.878773Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:24.878775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:24.878777Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:24.878782Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:24.878902Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:24.880315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:24.938825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535328491322160:4064]
2025-10-02T08:16:24.938907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2691, pipe: [1:7556535328491322160:4064]
2025-10-02T08:16:25.005779Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:25.006076Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.006093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.006133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535328491322160:4064], now have 1 active actors on pipe
2025-10-02T08:16:25.006360Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:25.006399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:25.006462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535328491322160:4064]
2025-10-02T08:16:25.006492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:25.006548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2692 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0
2025-10-02T08:16:25.006708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2692 sessionId: src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0 is DEAD
2025-10-02T08:16:25.006835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:25.006843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0] Write session will restart in 0.005969s
2025-10-02T08:16:25.006867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0] Write session: Do CDS request
2025-10-02T08:16:25.006873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:25.014265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.014321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:25.014336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2693
2025-10-02T08:16:25.014447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.014477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:25.014486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:25.014489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:25.014860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2693 sessionId:  describe result for acl check
2025-10-02T08:16:25.014892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:25.014897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:25.014898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:25.014903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535332786289918:9823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:25.015343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535332786289918:9823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:25.017606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535332786289918:9823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:25.020005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535332786289918:9823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:25.020020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535332786289918:9823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:25.020023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535332786289918:9823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:25.020030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:25.020156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:25.020583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:25.020717Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:25.020724Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:25.020730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:25.020764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:25.020789Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535332786290205:9814]
2025-10-02T08:16:25.021186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:25.021316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:25.021346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:25.021529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:25.021558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.021562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.021563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.021563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.021564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.021567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.021574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.021576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.021578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.021580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.021583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.021587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.021590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.021593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.021599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.021601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.021603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.021606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.021608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.021611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.021623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:25.030200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:25.031718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:25.031732Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:25.031734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:25.031737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:25.031741Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2692 [1:7556535332786290205:9814]
2025-10-02T08:16:25.031748Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:25.031762Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:25.031770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.031773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.031775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.031789Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:25.031793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:25.031797Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:25.031845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.031850Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.031852Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:25.031853Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:25.031912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:25.031918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.031929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.031942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:25.031956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535332786290194:9814]
2025-10-02T08:16:25.031962Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535332786290194:9814]
2025-10-02T08:16:25.031969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:25.031980Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:25.031984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:25.031987Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:25.031987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2692
2025-10-02T08:16:25.031996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:25.031998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:25.032009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786290196:9823], now have 1 active actors on pipe
2025-10-02T08:16:25.032051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535333245572888:2378], now have 1 active actors on pipe
2025-10-02T08:16:25.032060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.032063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.032077Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535332786290194:9814]
2025-10-02T08:16:25.032079Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:25.032108Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f732ee23-2678386d-2264c8dc-39940ebf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:25.032118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.032076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2692
2025-10-02T08:16:25.032117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:25.032122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.032123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:25.032132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.032141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:25.032167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.032210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.032217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.032229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.032266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2693 partition: 0 MaxSeqNo: 17 sessionId: src_id|f732ee23-2678386d-2264c8dc-39940ebf_0
2025-10-02T08:16:25.032544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0b4dbfe-d203a0-f3bf36aa-402e82de_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f732ee23-2678386d-2264c8dc-39940ebf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:25.034799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f732ee23-2678386d-2264c8dc-39940ebf_0] Write session: try to update token
2025-10-02T08:16:25.034809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f732ee23-2678386d-2264c8dc-39940ebf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:25.046468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId: src_id|f732ee23-2678386d-2264c8dc-39940ebf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:25.048584Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:25.048603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:25.048605Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:25.048611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535332786290194:9814]
2025-10-02T08:16:25.048615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535332786290194:9814]
2025-10-02T08:16:25.048647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:25.048648Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:25.048652Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:25.048656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.048657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:25.048782Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:25.048933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:25.106743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535332786290229:4064]
2025-10-02T08:16:25.106845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2692, pipe: [1:7556535332786290229:4064]
2025-10-02T08:16:25.169860Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:25.170073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.170092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.170127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786290229:4064], now have 1 active actors on pipe
2025-10-02T08:16:25.170201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535332786290229:4064]
2025-10-02T08:16:25.170223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:25.170230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:25.170247Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:25.170282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2693 reason: error at write: Disconnected sessionId: src_id|f732ee23-2678386d-2264c8dc-39940ebf_0
2025-10-02T08:16:25.170303Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:25.170430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2693 sessionId: src_id|f732ee23-2678386d-2264c8dc-39940ebf_0 is DEAD
2025-10-02T08:16:25.170558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f732ee23-2678386d-2264c8dc-39940ebf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:25.170567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f732ee23-2678386d-2264c8dc-39940ebf_0] Write session will restart in 0.006323s
2025-10-02T08:16:25.170588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f732ee23-2678386d-2264c8dc-39940ebf_0] Write session: Do CDS request
2025-10-02T08:16:25.170593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f732ee23-2678386d-2264c8dc-39940ebf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:25.178258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f732ee23-2678386d-2264c8dc-39940ebf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.178321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:25.178342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2694
2025-10-02T08:16:25.178470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.178501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:25.178508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:25.178510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:25.178804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2694 sessionId:  describe result for acl check
2025-10-02T08:16:25.178832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:25.178837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:25.178838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:25.178841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535332786290690:9857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:25.179248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535332786290690:9857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:25.181979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535332786290690:9857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:25.184911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535332786290690:9857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:25.184932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535332786290690:9857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:25.184935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535332786290690:9857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:25.184940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:25.185851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:25.186109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:25.186217Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:25.186225Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:25.186231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:25.186256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:25.186282Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535332786290971:9859]
2025-10-02T08:16:25.186687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:25.186837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:25.186867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:25.187052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:25.187080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.187084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.187084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.187085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.187086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.187089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.187097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.187099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.187101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.187103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.187106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.187110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.187114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.187117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.187120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.187122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.187125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.187127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.187129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.187132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.187141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:25.197778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:25.199286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:25.199300Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:25.199303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:25.199305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:25.199311Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2693 [1:7556535332786290971:9859]
2025-10-02T08:16:25.199319Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:25.199331Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:25.199334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.199336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.199337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.199348Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:25.199355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:25.199360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:25.199408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.199414Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.199416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:25.199417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:25.199471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:25.199477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.199485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.199492Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:25.199503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535332786290965:9859]
2025-10-02T08:16:25.199508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535332786290965:9859]
2025-10-02T08:16:25.199513Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:25.199524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786290961:9857], now have 1 active actors on pipe
2025-10-02T08:16:25.199526Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:25.199529Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:25.199532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:25.199540Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:25.199540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2693
2025-10-02T08:16:25.199546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:25.199550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535333245572895:2378], now have 1 active actors on pipe
2025-10-02T08:16:25.199577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.199584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.199594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535332786290965:9859]
2025-10-02T08:16:25.199603Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:25.199610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:25.199622Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:25.199630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.199633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.199634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:25.199643Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.199653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:25.199640Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2693
2025-10-02T08:16:25.199674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.199711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.199715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.199723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.199753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2694 partition: 0 MaxSeqNo: 17 sessionId: src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0
2025-10-02T08:16:25.200018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f732ee23-2678386d-2264c8dc-39940ebf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:25.202332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0] Write session: try to update token
2025-10-02T08:16:25.202345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:25.213767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId: src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:25.215991Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:25.216010Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:25.216012Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:25.216020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535332786290965:9859]
2025-10-02T08:16:25.216024Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535332786290965:9859]
2025-10-02T08:16:25.216072Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:25.216076Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:25.216082Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.216084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:25.216087Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:25.216166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:25.216216Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:25.270646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535332786290995:4064]
2025-10-02T08:16:25.270763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2693, pipe: [1:7556535332786290995:4064]
2025-10-02T08:16:25.339356Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:25.339575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.339588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.339620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786290995:4064], now have 1 active actors on pipe
2025-10-02T08:16:25.339685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535332786290995:4064]
2025-10-02T08:16:25.339705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:25.339707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:25.339760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2694 reason: error at write: Disconnected sessionId: src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0
2025-10-02T08:16:25.339832Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:25.339927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2694 sessionId: src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0 is DEAD
2025-10-02T08:16:25.340093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:25.340099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0] Write session will restart in 0.005813s
2025-10-02T08:16:25.340115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0] Write session: Do CDS request
2025-10-02T08:16:25.340122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:25.340130Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:25.347165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.347262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:25.347277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2695
2025-10-02T08:16:25.347388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.347415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:25.347425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:25.347427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:25.347717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2695 sessionId:  describe result for acl check
2025-10-02T08:16:25.347744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:25.347749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:25.347750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:25.347753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535332786291413:9894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:25.348113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535332786291413:9894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:25.350996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535332786291413:9894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:25.353782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535332786291413:9894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:25.353795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535332786291413:9894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:25.353797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535332786291413:9894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:25.353803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:25.354463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:25.355165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:25.355299Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:25.355308Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:25.355314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:25.355348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:25.355377Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535332786291737:9891]
2025-10-02T08:16:25.355803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:25.355954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:25.355992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:25.356279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:25.356316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.356321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.356322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.356322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.356323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.356327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.356333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.356336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.356338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.356340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.356344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.356349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.356352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.356355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.356358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.356361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.356363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.356366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.356368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.356371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.356382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:25.364793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:25.366442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:25.366458Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:25.366461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:25.366464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:25.366471Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2694 [1:7556535332786291737:9891]
2025-10-02T08:16:25.366483Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:25.366497Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:25.366505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.366508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.366510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.366527Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:25.366532Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:25.366538Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:25.366583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.366591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.366592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:25.366594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:25.366641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:25.366646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.366654Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.366660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:25.366671Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535332786291731:9891]
2025-10-02T08:16:25.366672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535332786291731:9891]
2025-10-02T08:16:25.366677Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:25.366691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786291719:9894], now have 1 active actors on pipe
2025-10-02T08:16:25.366693Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:25.366696Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:25.366699Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:25.366702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2694
2025-10-02T08:16:25.366706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:25.366707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:25.366710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535333245572904:2378], now have 1 active actors on pipe
2025-10-02T08:16:25.366734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.366736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.366746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535332786291731:9891]
2025-10-02T08:16:25.366755Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:25.366775Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67a747f5-59c90100-792795-cbf7ed4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:25.366776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:25.366783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.366785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.366786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:25.366792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.366798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:25.366816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.366794Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2694
2025-10-02T08:16:25.366853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.366858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.366866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.366897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2695 partition: 0 MaxSeqNo: 17 sessionId: src_id|67a747f5-59c90100-792795-cbf7ed4_0
2025-10-02T08:16:25.367230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6468bb6f-725526ad-e9dc1676-a9cc5398_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|67a747f5-59c90100-792795-cbf7ed4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:25.369605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a747f5-59c90100-792795-cbf7ed4_0] Write session: try to update token
2025-10-02T08:16:25.369620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a747f5-59c90100-792795-cbf7ed4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:25.381141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId: src_id|67a747f5-59c90100-792795-cbf7ed4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:25.382887Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:25.382904Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:25.382906Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:25.382913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535332786291731:9891]
2025-10-02T08:16:25.382916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535332786291731:9891]
2025-10-02T08:16:25.382948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:25.382957Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.382958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:25.382959Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:25.382963Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:25.383074Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:25.383458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:25.440068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535332786291761:4064]
2025-10-02T08:16:25.440146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2694, pipe: [1:7556535332786291761:4064]
2025-10-02T08:16:25.503742Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:25.503957Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.503967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.503997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786291761:4064], now have 1 active actors on pipe
2025-10-02T08:16:25.504093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:25.504099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:25.504149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2695 reason: error at write: Disconnected sessionId: src_id|67a747f5-59c90100-792795-cbf7ed4_0
2025-10-02T08:16:25.504225Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:25.504292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2695 sessionId: src_id|67a747f5-59c90100-792795-cbf7ed4_0 is DEAD
2025-10-02T08:16:25.504255Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:25.504424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535332786291761:4064]
2025-10-02T08:16:25.504454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a747f5-59c90100-792795-cbf7ed4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:25.504464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a747f5-59c90100-792795-cbf7ed4_0] Write session will restart in 0.008883s
2025-10-02T08:16:25.504485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a747f5-59c90100-792795-cbf7ed4_0] Write session: Do CDS request
2025-10-02T08:16:25.504489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a747f5-59c90100-792795-cbf7ed4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:25.514235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a747f5-59c90100-792795-cbf7ed4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.514269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:25.514288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2696
2025-10-02T08:16:25.514430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.514462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:25.514469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:25.514471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:25.514835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2696 sessionId:  describe result for acl check
2025-10-02T08:16:25.514873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:25.514879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:25.514880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:25.514885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535332786292362:9910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:25.515355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535332786292362:9910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:25.517416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535332786292362:9910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:25.518816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:25.519104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:25.519245Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:25.519253Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:25.519261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:25.519299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:25.519332Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535332786292498:9956]
2025-10-02T08:16:25.519842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:25.519929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535332786292362:9910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:25.519941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535332786292362:9910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:25.519943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535332786292362:9910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:25.519948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:25.519989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:25.520022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:25.520292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:25.520330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.520335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.520336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.520337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.520337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.520341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.520349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.520352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.520355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.520358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.520362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.520367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.520372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.520376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.520380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.520383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.520387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.520391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.520394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.520398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.520413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:25.527558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:25.529217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:25.529230Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:25.529231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:25.529234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:25.529239Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2695 [1:7556535332786292498:9956]
2025-10-02T08:16:25.529246Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:25.529257Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:25.529259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.529261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.529261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.529273Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:25.529276Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:25.529280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:25.529322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.529328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.529330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:25.529332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:25.529386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:25.529394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.529405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.529415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:25.529427Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535332786292492:9956]
2025-10-02T08:16:25.529432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535332786292492:9956]
2025-10-02T08:16:25.529439Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:25.529450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:25.529461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:25.529464Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:25.529467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:25.529470Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:25.529479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786292507:9910], now have 1 active actors on pipe
2025-10-02T08:16:25.529485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535333245572911:2378], now have 1 active actors on pipe
2025-10-02T08:16:25.529507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.529513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.529523Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535332786292492:9956]
2025-10-02T08:16:25.529533Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:25.529542Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:25.529559Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2026648a-6230c5df-c87cb236-328a5c5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:25.529565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2695
2025-10-02T08:16:25.529569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.529573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.529574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:25.529582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.529565Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2695
2025-10-02T08:16:25.529594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:25.529621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.529657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.529664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.529674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.529701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2696 partition: 0 MaxSeqNo: 17 sessionId: src_id|2026648a-6230c5df-c87cb236-328a5c5d_0
2025-10-02T08:16:25.529979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a747f5-59c90100-792795-cbf7ed4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2026648a-6230c5df-c87cb236-328a5c5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:25.532203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2026648a-6230c5df-c87cb236-328a5c5d_0] Write session: try to update token
2025-10-02T08:16:25.532216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2026648a-6230c5df-c87cb236-328a5c5d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:25.544691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId: src_id|2026648a-6230c5df-c87cb236-328a5c5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:25.546927Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:25.546943Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:25.546944Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:25.546952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535332786292492:9956]
2025-10-02T08:16:25.546955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535332786292492:9956]
2025-10-02T08:16:25.546986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:25.546990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.546992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:25.546996Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:25.547000Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:25.547124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:25.547145Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:25.604405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535332786292530:4064]
2025-10-02T08:16:25.604522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2695, pipe: [1:7556535332786292530:4064]
2025-10-02T08:16:25.672103Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:25.672435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.672446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.672476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786292530:4064], now have 1 active actors on pipe
2025-10-02T08:16:25.672592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:25.672603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:25.672656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2696 reason: error at write: Disconnected sessionId: src_id|2026648a-6230c5df-c87cb236-328a5c5d_0
2025-10-02T08:16:25.672696Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:25.672676Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:25.672850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2696 sessionId: src_id|2026648a-6230c5df-c87cb236-328a5c5d_0 is DEAD
2025-10-02T08:16:25.672958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2026648a-6230c5df-c87cb236-328a5c5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:25.672967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2026648a-6230c5df-c87cb236-328a5c5d_0] Write session will restart in 0.008773s
2025-10-02T08:16:25.672992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2026648a-6230c5df-c87cb236-328a5c5d_0] Write session: Do CDS request
2025-10-02T08:16:25.672999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2026648a-6230c5df-c87cb236-328a5c5d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:25.673012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535332786292530:4064]
2025-10-02T08:16:25.683201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2026648a-6230c5df-c87cb236-328a5c5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.683264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:25.683284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2697
2025-10-02T08:16:25.683404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.683436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:25.683445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:25.683448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:25.683815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2697 sessionId:  describe result for acl check
2025-10-02T08:16:25.683849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:25.683855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:25.683856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:25.683861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535332786293148:9944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:25.684281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535332786293148:9944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:25.686331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535332786293148:9944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:25.688348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:25.688835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:25.688996Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:25.689008Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:25.689019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:25.689073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:25.689114Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535332786293271:9931]
2025-10-02T08:16:25.689121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535332786293148:9944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:25.689127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535332786293148:9944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:25.689129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535332786293148:9944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:25.689135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:25.689673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:25.695386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:25.695436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:25.695669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:25.695703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.695707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.695708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.695709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.695710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.695714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.695720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.695723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.695725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.695726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.695731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.695736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.695739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.695742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.695745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.695747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.695750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.695752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.695755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.695758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.695768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:25.717936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:25.719399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:25.719414Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:25.719416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:25.719419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:25.719423Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2696 [1:7556535332786293271:9931]
2025-10-02T08:16:25.719432Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:25.719445Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:25.719446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.719449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.719450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.719460Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:25.719464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:25.719469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:25.719518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.719524Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.719527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:25.719529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:25.719578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:25.719583Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.719592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.719599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:25.719610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535332786293265:9931]
2025-10-02T08:16:25.719615Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535332786293265:9931]
2025-10-02T08:16:25.719620Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:25.719632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786293276:9944], now have 1 active actors on pipe
2025-10-02T08:16:25.719637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2696
2025-10-02T08:16:25.719642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:25.719642Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:25.719645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:25.719649Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:25.719651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:25.719655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535333245572918:2378], now have 1 active actors on pipe
2025-10-02T08:16:25.719683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.719689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.719699Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535332786293265:9931]
2025-10-02T08:16:25.719710Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:25.719723Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:25.719728Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|854a1611-58f0e217-be8321b9-d5521e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:25.719732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.719735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.719736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:25.719743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.719749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:25.719767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.719754Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2696
2025-10-02T08:16:25.719800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.719805Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.719814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.719839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2697 partition: 0 MaxSeqNo: 17 sessionId: src_id|854a1611-58f0e217-be8321b9-d5521e9_0
2025-10-02T08:16:25.720160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2026648a-6230c5df-c87cb236-328a5c5d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|854a1611-58f0e217-be8321b9-d5521e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:25.722522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|854a1611-58f0e217-be8321b9-d5521e9_0] Write session: try to update token
2025-10-02T08:16:25.722538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|854a1611-58f0e217-be8321b9-d5521e9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:25.734428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId: src_id|854a1611-58f0e217-be8321b9-d5521e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:25.736163Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:25.736179Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:25.736182Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:25.736190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535332786293265:9931]
2025-10-02T08:16:25.736196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535332786293265:9931]
2025-10-02T08:16:25.736244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:25.736249Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:25.736251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.736255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:25.736255Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:25.736398Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:25.736970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:25.773371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535332786293305:4064]
2025-10-02T08:16:25.773432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2696, pipe: [1:7556535332786293305:4064]
2025-10-02T08:16:25.860670Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:25.860982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.860992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.861020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786293305:4064], now have 1 active actors on pipe
2025-10-02T08:16:25.861082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:25.861091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:25.861126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2697 reason: error at write: Disconnected sessionId: src_id|854a1611-58f0e217-be8321b9-d5521e9_0
2025-10-02T08:16:25.861135Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:25.861226Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:25.861267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2697 sessionId: src_id|854a1611-58f0e217-be8321b9-d5521e9_0 is DEAD
2025-10-02T08:16:25.861334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535332786293305:4064]
2025-10-02T08:16:25.861402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854a1611-58f0e217-be8321b9-d5521e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:25.861412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854a1611-58f0e217-be8321b9-d5521e9_0] Write session will restart in 0.009346s
2025-10-02T08:16:25.861435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854a1611-58f0e217-be8321b9-d5521e9_0] Write session: Do CDS request
2025-10-02T08:16:25.861442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854a1611-58f0e217-be8321b9-d5521e9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:25.872253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|854a1611-58f0e217-be8321b9-d5521e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.872250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:25.872342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:25.872349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2698
2025-10-02T08:16:25.872437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:25.872459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:25.872465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:25.872467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:25.872746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2698 sessionId:  describe result for acl check
2025-10-02T08:16:25.872773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:25.872778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:25.872779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:25.872783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535332786294057:10055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:25.872796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:25.872929Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:25.872938Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:25.872945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:25.872979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:25.873001Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535332786294059:9971]
2025-10-02T08:16:25.873140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535332786294057:10055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:25.873407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:25.873524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:25.873547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:25.873732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:25.873759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.873762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.873763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.873763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.873764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.873767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.873773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.873775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.873776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.873778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.873781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.873785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:25.873788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.873791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:25.873797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.873800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:25.873802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.873805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.873807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.873810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.873819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:25.875226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535332786294057:10055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:25.880153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535332786294057:10055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:25.880168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535332786294057:10055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:25.880171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535332786294057:10055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:25.880178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:25.881127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:25.882541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:25.882557Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:25.882559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:25.882562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:25.882568Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2697 [1:7556535332786294059:9971]
2025-10-02T08:16:25.882577Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:25.882590Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:25.882592Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.882595Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.882601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.882613Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:25.882622Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:25.882628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:25.882676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.882683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.882686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:25.882688Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:25.882742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:25.882748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.882760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:25.882775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:25.882785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2697
2025-10-02T08:16:25.882796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786294101:10055], now have 1 active actors on pipe
2025-10-02T08:16:25.882803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535333245572940:2378], now have 1 active actors on pipe
2025-10-02T08:16:25.882809Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535332786294050:9971]
2025-10-02T08:16:25.882811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535332786294050:9971]
2025-10-02T08:16:25.882821Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:25.882834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.882835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:25.882837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:25.882842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.882857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:25.882868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:25.882871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:25.882860Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2697
2025-10-02T08:16:25.882899Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1625d58-58db4ed2-3d272460-2340542a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:25.882907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:25.882909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:25.882910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:25.882916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:25.882921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:25.882926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535332786294050:9971]
2025-10-02T08:16:25.882931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:25.882935Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:25.882947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.882981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:25.882988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:25.882999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:25.883027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2698 partition: 0 MaxSeqNo: 17 sessionId: src_id|f1625d58-58db4ed2-3d272460-2340542a_0
2025-10-02T08:16:25.883316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854a1611-58f0e217-be8321b9-d5521e9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f1625d58-58db4ed2-3d272460-2340542a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:25.885824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1625d58-58db4ed2-3d272460-2340542a_0] Write session: try to update token
2025-10-02T08:16:25.885842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1625d58-58db4ed2-3d272460-2340542a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:25.899207Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:25.899227Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:25.899228Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:25.899235Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535332786294050:9971]
2025-10-02T08:16:25.899301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId: src_id|f1625d58-58db4ed2-3d272460-2340542a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:25.899426Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535332786294050:9971]
2025-10-02T08:16:25.899463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:25.899465Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:25.899470Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:25.899471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:25.899472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:25.899599Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:25.901661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:25.961268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535332786294115:4064]
2025-10-02T08:16:25.961346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2697, pipe: [1:7556535332786294115:4064]
2025-10-02T08:16:26.025388Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:26.025687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.025697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.025726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535332786294115:4064], now have 1 active actors on pipe
2025-10-02T08:16:26.025808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535332786294115:4064]
2025-10-02T08:16:26.025831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:26.025832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:26.025867Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:26.025880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2698 reason: error at write: Disconnected sessionId: src_id|f1625d58-58db4ed2-3d272460-2340542a_0
2025-10-02T08:16:26.025958Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:26.026055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2698 sessionId: src_id|f1625d58-58db4ed2-3d272460-2340542a_0 is DEAD
2025-10-02T08:16:26.026208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1625d58-58db4ed2-3d272460-2340542a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:26.026220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1625d58-58db4ed2-3d272460-2340542a_0] Write session will restart in 0.008894s
2025-10-02T08:16:26.026246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1625d58-58db4ed2-3d272460-2340542a_0] Write session: Do CDS request
2025-10-02T08:16:26.026252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1625d58-58db4ed2-3d272460-2340542a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:26.036201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1625d58-58db4ed2-3d272460-2340542a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.036250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:26.036265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2699
2025-10-02T08:16:26.036372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.036408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:26.036417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:26.036420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:26.036770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2699 sessionId:  describe result for acl check
2025-10-02T08:16:26.036797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:26.036814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:26.036815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:26.036820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535337081262044:10159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:26.037190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535337081262044:10159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:26.038900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535337081262044:10159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:26.040266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:26.040508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:26.040618Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:26.040627Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:26.040633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:26.040664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:26.040692Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535337081262166:10099]
2025-10-02T08:16:26.041109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:26.041259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:26.041283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535337081262044:10159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:26.041287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:26.041294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535337081262044:10159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:26.041297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535337081262044:10159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:26.041301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:26.041478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:26.041514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.041516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.041517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.041518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.041518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.041521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.041527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.041529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.041531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.041533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.041536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.041540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.041544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.041547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.041549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.041552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.041554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.041557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.041560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.041562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.041574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:26.048700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:26.050124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:26.050137Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:26.050138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:26.050140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:26.050144Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2698 [1:7556535337081262166:10099]
2025-10-02T08:16:26.050151Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:26.050162Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:26.050164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.050166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.050167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.050176Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:26.050180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:26.050185Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:26.050240Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.050249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.050251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:26.050253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:26.050297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:26.050303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.050310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.050316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:26.050331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535337081262160:10099]
2025-10-02T08:16:26.050335Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535337081262160:10099]
2025-10-02T08:16:26.050340Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:26.050348Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:26.050357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2698
2025-10-02T08:16:26.050359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:26.050359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:26.050360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:26.050361Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:26.050367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081262177:10159], now have 1 active actors on pipe
2025-10-02T08:16:26.050383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535337540540263:2378], now have 1 active actors on pipe
2025-10-02T08:16:26.050388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535337081262160:10099]
2025-10-02T08:16:26.050392Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:26.050396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.050398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:26.050402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.050427Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61a71441-75bb988b-8fb049-f3506ba1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:26.050434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.050437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.050438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:26.050444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.050453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:26.050468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.050457Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2698
2025-10-02T08:16:26.050581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.050587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.050598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.050624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2699 partition: 0 MaxSeqNo: 17 sessionId: src_id|61a71441-75bb988b-8fb049-f3506ba1_0
2025-10-02T08:16:26.050933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1625d58-58db4ed2-3d272460-2340542a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|61a71441-75bb988b-8fb049-f3506ba1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:26.053249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a71441-75bb988b-8fb049-f3506ba1_0] Write session: try to update token
2025-10-02T08:16:26.053261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a71441-75bb988b-8fb049-f3506ba1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:26.065515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId: src_id|61a71441-75bb988b-8fb049-f3506ba1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:26.067140Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:26.067155Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:26.067156Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:26.067162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535337081262160:10099]
2025-10-02T08:16:26.067167Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535337081262160:10099]
2025-10-02T08:16:26.067197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:26.067205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.067207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:26.067202Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:26.067217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:26.067340Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:26.067962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:26.126173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535337081262202:4064]
2025-10-02T08:16:26.126266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2698, pipe: [1:7556535337081262202:4064]
2025-10-02T08:16:26.192791Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:26.193184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.193194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.193229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081262202:4064], now have 1 active actors on pipe
2025-10-02T08:16:26.193290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:26.193296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:26.193334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2699 reason: error at write: Disconnected sessionId: src_id|61a71441-75bb988b-8fb049-f3506ba1_0
2025-10-02T08:16:26.193445Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:26.193466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2699 sessionId: src_id|61a71441-75bb988b-8fb049-f3506ba1_0 is DEAD
2025-10-02T08:16:26.193442Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:26.193605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a71441-75bb988b-8fb049-f3506ba1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:26.193600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535337081262202:4064]
2025-10-02T08:16:26.193621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a71441-75bb988b-8fb049-f3506ba1_0] Write session will restart in 0.008742s
2025-10-02T08:16:26.193647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a71441-75bb988b-8fb049-f3506ba1_0] Write session: Do CDS request
2025-10-02T08:16:26.193653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a71441-75bb988b-8fb049-f3506ba1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:26.203167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a71441-75bb988b-8fb049-f3506ba1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.203267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:26.203282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2700
2025-10-02T08:16:26.203368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.203394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:26.203403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:26.203406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:26.203700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2700 sessionId:  describe result for acl check
2025-10-02T08:16:26.203726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:26.203731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:26.203733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:26.203737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535337081262810:10169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:26.204095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535337081262810:10169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:26.206028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535337081262810:10169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:26.207656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:26.207929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:26.208083Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:26.208092Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:26.208101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:26.208149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:26.208180Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535337081262947:10170]
2025-10-02T08:16:26.208760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535337081262810:10169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:26.208773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535337081262810:10169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:26.208776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535337081262810:10169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:26.208783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:26.208798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:26.208970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:26.209015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:26.209305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:26.209347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.209352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.209353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.209354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.209355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.209360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.209369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.209377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.209385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.209393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.209402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.209412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.209421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.209426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.209434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.209439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.209446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.209453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.209462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.209466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.209489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:26.217155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:26.218806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:26.218825Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:26.218828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:26.218831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:26.218836Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2699 [1:7556535337081262947:10170]
2025-10-02T08:16:26.218848Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:26.218865Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:26.218873Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.218876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.218878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.218893Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:26.218903Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:26.218913Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:26.218971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.218978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.218982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:26.218984Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:26.219049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:26.219057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.219072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.219085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:26.219107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081262954:10169], now have 1 active actors on pipe
2025-10-02T08:16:26.219115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535337540540270:2378], now have 1 active actors on pipe
2025-10-02T08:16:26.219120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2699
2025-10-02T08:16:26.219121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535337081262941:10170]
2025-10-02T08:16:26.219123Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535337081262941:10170]
2025-10-02T08:16:26.219130Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:26.219138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:26.219141Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:26.219142Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:26.219158Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:26.219166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:26.219173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.219177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.219182Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2699
2025-10-02T08:16:26.219214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535337081262941:10170]
2025-10-02T08:16:26.219222Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:26.219224Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:26.219238Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:26.219247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.219255Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.219257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:26.219267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.219281Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:26.219325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.219387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.219394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.219408Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.219444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2700 partition: 0 MaxSeqNo: 17 sessionId: src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0
2025-10-02T08:16:26.219804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a71441-75bb988b-8fb049-f3506ba1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:26.222213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0] Write session: try to update token
2025-10-02T08:16:26.222226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:26.235343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId: src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:26.236118Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:26.236138Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:26.236140Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:26.236149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535337081262941:10170]
2025-10-02T08:16:26.236153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535337081262941:10170]
2025-10-02T08:16:26.236186Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:26.236193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:26.236197Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:26.236201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.236203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:26.236332Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:26.237854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:26.293554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535337081262977:4064]
2025-10-02T08:16:26.293663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2699, pipe: [1:7556535337081262977:4064]
2025-10-02T08:16:26.375442Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:26.375931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.375945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.375975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081262977:4064], now have 1 active actors on pipe
2025-10-02T08:16:26.376035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:26.376051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:26.376058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535337081262977:4064]
2025-10-02T08:16:26.376089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2700 reason: error at write: Disconnected sessionId: src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0
2025-10-02T08:16:26.376164Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:26.376186Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:26.376239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2700 sessionId: src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0 is DEAD
2025-10-02T08:16:26.376372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:26.376377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0] Write session will restart in 0.005784s
2025-10-02T08:16:26.376395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0] Write session: Do CDS request
2025-10-02T08:16:26.376399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:26.383209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.383308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:26.383320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2701
2025-10-02T08:16:26.383401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.383421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:26.383427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:26.383430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:26.383749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2701 sessionId:  describe result for acl check
2025-10-02T08:16:26.383776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:26.383780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:26.383781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:26.383784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535337081263428:10196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:26.384137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535337081263428:10196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:26.386355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535337081263428:10196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:26.388940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535337081263428:10196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:26.388952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535337081263428:10196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:26.388954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535337081263428:10196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:26.388966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:26.389860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:26.390137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:26.390247Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:26.390255Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:26.390261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:26.390286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:26.390308Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535337081263730:10188]
2025-10-02T08:16:26.390693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:26.390809Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:26.390835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:26.391021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:26.391050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.391054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.391055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.391056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.391056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.391059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.391065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.391067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.391069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.391071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.391075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.391078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.391082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.391085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.391087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.391090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.391092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.391095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.391097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.391100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.391110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:26.398788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:26.400288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:26.400303Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:26.400305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:26.400307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:26.400312Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2700 [1:7556535337081263730:10188]
2025-10-02T08:16:26.400320Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:26.400334Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:26.400340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.400342Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.400343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.400356Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:26.400359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:26.400364Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:26.400411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.400416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.400418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:26.400420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:26.400467Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:26.400472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.400480Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.400486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:26.400498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081263720:10196], now have 1 active actors on pipe
2025-10-02T08:16:26.400504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535337540540279:2378], now have 1 active actors on pipe
2025-10-02T08:16:26.400504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2700
2025-10-02T08:16:26.400509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535337081263724:10188]
2025-10-02T08:16:26.400510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535337081263724:10188]
2025-10-02T08:16:26.400519Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:26.400529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.400534Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:26.400535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.400537Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:26.400549Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:26.400558Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:26.400563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:26.400595Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:26.400603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.400606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.400610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:26.400615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.400624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:26.400632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535337081263724:10188]
2025-10-02T08:16:26.400638Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:26.400645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:26.400652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.400611Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2700
2025-10-02T08:16:26.400688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.400693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.400702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.400731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2701 partition: 0 MaxSeqNo: 17 sessionId: src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0
2025-10-02T08:16:26.401061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89feedd-a6d2d40d-8c720304-29ea279a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:26.403419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0] Write session: try to update token
2025-10-02T08:16:26.403430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:26.415825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId: src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:26.416875Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:26.416888Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:26.416889Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:26.416896Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535337081263724:10188]
2025-10-02T08:16:26.416899Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535337081263724:10188]
2025-10-02T08:16:26.416934Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:26.416935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:26.416941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.416943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:26.416945Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:26.417069Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:26.418168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:26.476360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535337081263754:4064]
2025-10-02T08:16:26.476504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2700, pipe: [1:7556535337081263754:4064]
2025-10-02T08:16:26.541243Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:26.541706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.541716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.541747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081263754:4064], now have 1 active actors on pipe
2025-10-02T08:16:26.541864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:26.541879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:26.541907Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:26.541941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2701 reason: error at write: Disconnected sessionId: src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0
2025-10-02T08:16:26.542056Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:26.542141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2701 sessionId: src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0 is DEAD
2025-10-02T08:16:26.542217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535337081263754:4064]
2025-10-02T08:16:26.542273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:26.542279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0] Write session will restart in 0.008680s
2025-10-02T08:16:26.542305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0] Write session: Do CDS request
2025-10-02T08:16:26.542311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:26.552211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.552350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:26.552365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2702
2025-10-02T08:16:26.552460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.552488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:26.552495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:26.552498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:26.552900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2702 sessionId:  describe result for acl check
2025-10-02T08:16:26.552939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:26.552946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:26.552948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:26.552952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535337081264303:10222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:26.553413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535337081264303:10222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:26.555841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535337081264303:10222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:26.557849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:26.558674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:26.558812Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:26.558819Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:26.558827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:26.558879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:26.558905Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535337081264506:10224]
2025-10-02T08:16:26.559080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535337081264303:10222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:26.559094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535337081264303:10222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:26.559097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535337081264303:10222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:26.559105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:26.559295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:26.559408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:26.559432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:26.559613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:26.559641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.559645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.559645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.559646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.559647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.559650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.559656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.559658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.559660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.559662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.559665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.559670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.559674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.559676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.559679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.559682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.559686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.559688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.559691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.559693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.559702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:26.567270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:26.569082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:26.569096Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:26.569097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:26.569100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:26.569104Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2701 [1:7556535337081264506:10224]
2025-10-02T08:16:26.569113Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:26.569128Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:26.569130Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.569133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.569135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.569150Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:26.569159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:26.569165Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:26.569216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.569222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.569224Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:26.569226Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:26.569276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:26.569285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.569294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.569300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:26.569314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081264511:10222], now have 1 active actors on pipe
2025-10-02T08:16:26.569318Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535337081264500:10224]
2025-10-02T08:16:26.569321Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535337081264500:10224]
2025-10-02T08:16:26.569326Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:26.569332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535337540540287:2378], now have 1 active actors on pipe
2025-10-02T08:16:26.569334Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:26.569336Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:26.569336Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:26.569345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:26.569347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:26.569346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2701
2025-10-02T08:16:26.569374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.569377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.569386Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535337081264500:10224]
2025-10-02T08:16:26.569397Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:26.569413Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:26.569418Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f95b25b8-94718c23-6c2c5faa-536372d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:26.569424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.569428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.569430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:26.569438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.569447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:26.569446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2701
2025-10-02T08:16:26.569468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.569514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.569519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.569527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.569556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2702 partition: 0 MaxSeqNo: 17 sessionId: src_id|f95b25b8-94718c23-6c2c5faa-536372d_0
2025-10-02T08:16:26.569862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82e557b-f53c9c9e-dddb075c-5ee3f30f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f95b25b8-94718c23-6c2c5faa-536372d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:26.572189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b25b8-94718c23-6c2c5faa-536372d_0] Write session: try to update token
2025-10-02T08:16:26.572204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b25b8-94718c23-6c2c5faa-536372d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:26.584072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId: src_id|f95b25b8-94718c23-6c2c5faa-536372d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:26.586647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:26.586827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.586847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.586872Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:26.586879Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:26.586882Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:26.586891Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535337081264500:10224]
2025-10-02T08:16:26.586895Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535337081264500:10224]
2025-10-02T08:16:26.586931Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:26.586944Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:26.586946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:26.586952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.586954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:26.587093Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:26.642272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535337081264536:4064]
2025-10-02T08:16:26.642370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2701, pipe: [1:7556535337081264536:4064]
2025-10-02T08:16:26.718801Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:26.719102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:26.719135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:26.719139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081264536:4064], now have 1 active actors on pipe
2025-10-02T08:16:26.719250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:26.719259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:26.719277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2702 reason: error at write: Disconnected sessionId: src_id|f95b25b8-94718c23-6c2c5faa-536372d_0
2025-10-02T08:16:26.719353Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:26.719436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2702 sessionId: src_id|f95b25b8-94718c23-6c2c5faa-536372d_0 is DEAD
2025-10-02T08:16:26.719528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535337081264536:4064]
2025-10-02T08:16:26.719551Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:16:26.719577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b25b8-94718c23-6c2c5faa-536372d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:26.719587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b25b8-94718c23-6c2c5faa-536372d_0] Write session will restart in 0.009081s
2025-10-02T08:16:26.719622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b25b8-94718c23-6c2c5faa-536372d_0] Write session: Do CDS request
2025-10-02T08:16:26.719629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b25b8-94718c23-6c2c5faa-536372d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:26.719646Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 27 consumer shared/user session shared/user_1_27_10828998273474951301_v1 is DEAD
2025-10-02T08:16:26.719765Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:16:26.719802Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535259771791220:4050] disconnected; active server actors: 1
2025-10-02T08:16:26.719817Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535259771791220:4050] client user disconnected session shared/user_1_27_10828998273474951301_v1
2025-10-02T08:16:26.719847Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:16:26.719851Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:16:26.719857Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.006016s
2025-10-02T08:16:26.727168Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:16:26.727313Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:16:26.727328Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 28
2025-10-02T08:16:26.727453Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 28 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:16:26.727499Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:16:26.727564Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 auth for : user
2025-10-02T08:16:26.727754Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 Handle describe topics response
2025-10-02T08:16:26.727772Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 auth is DEAD
2025-10-02T08:16:26.727776Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:16:26.727993Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:16:26.728074Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_28_13775350760927023979_v1
2025-10-02T08:16:26.728084Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:16:26.728161Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:16:26.728232Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535337081264994:10241] connected; active server actors: 1
2025-10-02T08:16:26.728234Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:16:26.728336Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 got read request: guid# 9b121456-a9a57d9f-542ec8c4-cce7e2fd
2025-10-02T08:16:26.728349Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556535337081264994:10241] session shared/user_1_28_13775350760927023979_v1
2025-10-02T08:16:26.728365Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:16:26.728373Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:16:26.728380Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_28_13775350760927023979_v1" (Sender=[1:7556535337081264952:10241], Pipe=[1:7556535337081264994:10241], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:16:26.728387Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:16:26.728399Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:16:26.728411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_28_13775350760927023979_v1" (Sender=[1:7556535337081264952:10241], Pipe=[1:7556535337081264994:10241], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:16:26.728433Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_28_13775350760927023979_v1" sender [1:7556535337081264952:10241] lock partition 0 for ReadingSession "shared/user_1_28_13775350760927023979_v1" (Sender=[1:7556535337081264952:10241], Pipe=[1:7556535337081264994:10241], Partitions=[], ActiveFamilyCount=1) generation 1 step 28
2025-10-02T08:16:26.728446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:16:26.728452Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000046s
2025-10-02T08:16:26.728717Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 28 Session: "shared/user_1_28_13775350760927023979_v1" ClientId: "user" PipeClient { RawX1: 7556535337081264994 RawX2: 4503603922348033 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:16:26.728741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:16:26.729137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b25b8-94718c23-6c2c5faa-536372d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.729130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:26.729138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2703
2025-10-02T08:16:26.729278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.729309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:26.729319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:26.729322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:26.729589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2703 sessionId:  describe result for acl check
2025-10-02T08:16:26.729612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:26.729618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:26.729619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:26.729623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535337081265089:10268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:26.730060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535337081265089:10268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:26.732486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535337081265089:10268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:26.734595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:26.735445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:26.735634Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:26.735642Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:26.735649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:26.735683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:26.735702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535337081265089:10268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:26.735709Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535337081265298:10231]
2025-10-02T08:16:26.735713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535337081265089:10268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:26.735715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535337081265089:10268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:26.735720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:26.736176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:26.736341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:26.736367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:26.736595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:26.736643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.736649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.736650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.736651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.736651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.736654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.736661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.736663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.736665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.736666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.736670Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.736674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.736677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.736680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.736682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.736685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.736687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.736690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.736692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.736694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.736704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:26.744011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:26.745724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:26.745738Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:26.745739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:26.745742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:26.745746Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2702 [1:7556535337081265298:10231]
2025-10-02T08:16:26.745754Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:26.745766Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:26.745768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.745769Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.745771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.745781Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:26.745784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:26.745790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:26.745830Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.745837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.745840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:26.745842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:26.746038Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2702
2025-10-02T08:16:26.745902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:26.745910Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.745920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.745931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:26.745947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081265034:10248], now have 1 active actors on pipe
2025-10-02T08:16:26.745949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081265303:10268], now have 1 active actors on pipe
2025-10-02T08:16:26.745951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535337540540294:2378], now have 1 active actors on pipe
2025-10-02T08:16:26.745953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2702, pipe: [1:7556535337081265034:10248]
2025-10-02T08:16:26.745955Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535337081265292:10231]
2025-10-02T08:16:26.745957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535337081265292:10231]
2025-10-02T08:16:26.745967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2702
2025-10-02T08:16:26.745968Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:26.745975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.745978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.745983Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:26.745985Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:26.745985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_28_13775350760927023979_v1 on pipe: [1:7556535337081265034:10248]
2025-10-02T08:16:26.745996Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_28_13775350760927023979_v1:1 with generation 2702
2025-10-02T08:16:26.745996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:26.746004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:26.746005Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:26.746026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.746030Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.746031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:26.746040Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_28_13775350760927023979_v1
2025-10-02T08:16:26.746041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.746055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.746057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.746061Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535337081265292:10231]
2025-10-02T08:16:26.746063Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:26.746072Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:26.746073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:26.746083Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:26.746087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:16:26.748105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:16:26.748126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:16:26.748131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.748134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.748136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:26.748143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.748152Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:26.748160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:16:26.748169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:16:26.748188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.748215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.748221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.748228Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759392986745 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:16:26.748234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.748237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:16:26.748257Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 sending to client partition status
2025-10-02T08:16:26.748266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2703 partition: 0 MaxSeqNo: 17 sessionId: src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0
2025-10-02T08:16:26.748588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b25b8-94718c23-6c2c5faa-536372d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:26.751071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0] Write session: try to update token
2025-10-02T08:16:26.751087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:26.763138Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:26.763159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:26.763161Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:26.763169Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535337081265292:10231]
2025-10-02T08:16:26.763174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535337081265292:10231]
2025-10-02T08:16:26.763205Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:26.763207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:26.763208Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:26.763211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.763212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:26.763338Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:26.764483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId: src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:26.767137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:26.887711Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:26.888027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.888046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.888180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_28_13775350760927023979_v1
2025-10-02T08:16:26.888193Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:26.888264Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:26.888399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535337081265034:10248]
2025-10-02T08:16:26.888415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:26.888449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2703 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0
2025-10-02T08:16:26.888591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2703 sessionId: src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0 is DEAD
2025-10-02T08:16:26.888698Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_28_13775350760927023979_v1
2025-10-02T08:16:26.888726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:26.888734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0] Write session will restart in 0.007990s
2025-10-02T08:16:26.888750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0] Write session: Do CDS request
2025-10-02T08:16:26.888754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:26.898237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.898307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:26.898323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2704
2025-10-02T08:16:26.898458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:26.898489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:26.898495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:26.898497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:26.898767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2704 sessionId:  describe result for acl check
2025-10-02T08:16:26.898788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:26.898793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:26.898794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:26.898797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535337081266023:10336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:26.899114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535337081266023:10336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:26.901015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:26.901328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535337081266023:10336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:26.901970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:26.902103Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:26.902111Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:26.902117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:26.902149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:26.902175Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535337081266113:10298]
2025-10-02T08:16:26.902576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:26.902709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:26.902735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:26.903053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:26.903084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.903088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.903089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.903090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.903090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.903093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.903098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.903100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.903102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.903105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.903109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.903116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:26.903120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.903124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:26.903128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.903133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:26.903136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.903139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.903141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.903144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.903153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:26.903424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535337081266023:10336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:26.903438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535337081266023:10336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:26.903441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535337081266023:10336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:26.903446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:26.910452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:26.911884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:26.911897Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:26.911898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:26.911900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:26.911904Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2703 [1:7556535337081266113:10298]
2025-10-02T08:16:26.911911Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:26.911922Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:26.911923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.911925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.911927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.911936Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:26.911938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:26.911942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:26.911979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.911985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.911987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:26.911989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:26.912050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:26.912056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.912063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:26.912073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:26.912088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535337540540316:2378], now have 1 active actors on pipe
2025-10-02T08:16:26.912096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535337081266097:10298]
2025-10-02T08:16:26.912100Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535337081266097:10298]
2025-10-02T08:16:26.912106Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:26.912107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2703
2025-10-02T08:16:26.912115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081266136:10336], now have 1 active actors on pipe
2025-10-02T08:16:26.912117Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:26.912120Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:26.912120Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:26.912127Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:26.912132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:26.912137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.912139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.912137Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2703
2025-10-02T08:16:26.912170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535337081266097:10298]
2025-10-02T08:16:26.912179Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:26.912190Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:26.912191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:26.912197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:26.912199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:26.912201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:26.912207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:26.912212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:26.912239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.912275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:26.912280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:26.912289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:26.912317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2704 partition: 0 MaxSeqNo: 17 sessionId: src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0
2025-10-02T08:16:26.912582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4c1b78-8b65d778-bbc82556-2c1793c3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:26.914997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0] Write session: try to update token
2025-10-02T08:16:26.915010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:26.926868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId: src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:26.928946Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:26.928963Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:26.928964Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:26.928971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535337081266097:10298]
2025-10-02T08:16:26.928974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535337081266097:10298]
2025-10-02T08:16:26.929004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:26.929009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:26.929014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:26.929013Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:26.929018Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:26.929130Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:26.929143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:26.988345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535337081266163:10248]
2025-10-02T08:16:26.988465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2703, pipe: [1:7556535337081266163:10248]
2025-10-02T08:16:27.050867Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:27.051369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.051380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.051412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535337081266163:10248], now have 1 active actors on pipe
2025-10-02T08:16:27.051532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535337081266163:10248]
2025-10-02T08:16:27.051548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:27.051549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:27.051589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2704 reason: error at write: Disconnected sessionId: src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0
2025-10-02T08:16:27.051658Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:27.051693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:27.051725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2704 sessionId: src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0 is DEAD
2025-10-02T08:16:27.051906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:27.051916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0] Write session will restart in 0.009484s
2025-10-02T08:16:27.051941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0] Write session: Do CDS request
2025-10-02T08:16:27.051948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:27.062256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.062275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:27.062292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2705
2025-10-02T08:16:27.062478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.062508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:27.062513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:27.062516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:27.062823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2705 sessionId:  describe result for acl check
2025-10-02T08:16:27.062852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:27.062856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:27.062857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:27.062861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535341376234044:10419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:27.063201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535341376234044:10419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:27.065378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535341376234044:10419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:27.068209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:27.068393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535341376234044:10419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:27.068407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535341376234044:10419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:27.068410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535341376234044:10419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:27.068418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:27.068547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:27.068678Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:27.068685Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:27.068691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:27.068735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:27.068763Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535341376234221:5082]
2025-10-02T08:16:27.069185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:27.069353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:27.069391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:27.069671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:27.069701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.069705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.069705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.069706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.069706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.069710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.069716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.069718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.069719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.069721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.069724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.069729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.069732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.069735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.069737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.069739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.069742Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.069744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.069746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.069749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.069759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:27.077142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:27.078688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:27.078704Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:27.078707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:27.078711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:27.078717Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2704 [1:7556535341376234221:5082]
2025-10-02T08:16:27.078727Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:27.078742Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:27.078743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.078745Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.078747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.078758Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:27.078762Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:27.078767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:27.078810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.078816Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.078818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:27.078820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:27.078871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:27.078880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.078892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.078901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:27.078912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535341376234209:5082]
2025-10-02T08:16:27.078913Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535341376234209:5082]
2025-10-02T08:16:27.078919Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:27.078929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376234217:10419], now have 1 active actors on pipe
2025-10-02T08:16:27.078936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:27.078938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:27.078941Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:27.078943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2704
2025-10-02T08:16:27.078949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:27.078951Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:27.078977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535341835507639:2378], now have 1 active actors on pipe
2025-10-02T08:16:27.078985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.078988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.078998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535341376234209:5082]
2025-10-02T08:16:27.079006Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:27.079012Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:27.079025Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:27.079033Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.079036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.079038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:27.079044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.079022Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2704
2025-10-02T08:16:27.079051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:27.079068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.079107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.079114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.079125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.079158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2705 partition: 0 MaxSeqNo: 17 sessionId: src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0
2025-10-02T08:16:27.079476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1414efd-bf7cc4d3-bf814231-c8af3626_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:27.081982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0] Write session: try to update token
2025-10-02T08:16:27.081999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:27.094971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId: src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:27.096597Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:27.096615Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:27.096616Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:27.096623Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535341376234209:5082]
2025-10-02T08:16:27.096626Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535341376234209:5082]
2025-10-02T08:16:27.096657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:27.096658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:27.096661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.096663Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:27.096663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:27.096785Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:27.097501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:27.151695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535341376234247:10248]
2025-10-02T08:16:27.151850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2704, pipe: [1:7556535341376234247:10248]
2025-10-02T08:16:27.218783Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:27.219147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.219158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.219189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376234247:10248], now have 1 active actors on pipe
2025-10-02T08:16:27.219301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:27.219307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:27.219346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2705 reason: error at write: Disconnected sessionId: src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0
2025-10-02T08:16:27.219414Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:27.219454Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:27.219481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2705 sessionId: src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0 is DEAD
2025-10-02T08:16:27.219592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535341376234247:10248]
2025-10-02T08:16:27.219614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:27.219621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0] Write session will restart in 0.009666s
2025-10-02T08:16:27.219644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0] Write session: Do CDS request
2025-10-02T08:16:27.219651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:27.230216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.230254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:27.230274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2706
2025-10-02T08:16:27.230382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.230407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:27.230414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:27.230416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:27.230752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2706 sessionId:  describe result for acl check
2025-10-02T08:16:27.230780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:27.230781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:27.230783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:27.230786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535341376234915:10432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:27.231133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535341376234915:10432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:27.232678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535341376234915:10432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:27.233687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:27.233970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:27.234191Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:27.234200Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:27.234209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:27.234247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:27.234273Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535341376235005:10420]
2025-10-02T08:16:27.234656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535341376234915:10432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:27.234667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535341376234915:10432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:27.234668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:27.234670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535341376234915:10432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:27.234675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:27.234818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:27.234854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:27.235038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:27.235062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.235065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.235065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.235066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.235066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.235070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.235076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.235078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.235080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.235082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.235085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.235090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.235095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.235097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.235099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.235102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.235104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.235106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.235108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.235111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.235121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:27.242585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:27.243976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:27.243994Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:27.243997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:27.244001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:27.244007Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2705 [1:7556535341376235005:10420]
2025-10-02T08:16:27.244020Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:27.244049Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:27.244058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.244061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.244063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.244077Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:27.244082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:27.244087Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:27.244137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.244139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.244142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:27.244143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:27.244199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:27.244205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.244214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.244225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:27.244245Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535341376234999:10420]
2025-10-02T08:16:27.244250Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535341376234999:10420]
2025-10-02T08:16:27.244257Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:27.244274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376235012:10432], now have 1 active actors on pipe
2025-10-02T08:16:27.244280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:27.244282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2705
2025-10-02T08:16:27.244284Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:27.244285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:27.244297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:27.244300Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:27.244325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535341835507645:2378], now have 1 active actors on pipe
2025-10-02T08:16:27.244333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.244336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.244346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535341376234999:10420]
2025-10-02T08:16:27.244352Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:27.244364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:27.244369Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:27.244373Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.244379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.244381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:27.244386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.244393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:27.244358Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2705
2025-10-02T08:16:27.244410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.244444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.244450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.244461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.244489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2706 partition: 0 MaxSeqNo: 17 sessionId: src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0
2025-10-02T08:16:27.244764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c956d-a4e60203-f8c37c1e-4cba13ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:27.247046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0] Write session: try to update token
2025-10-02T08:16:27.247058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:27.259095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId: src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:27.261174Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:27.261189Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:27.261190Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:27.261196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535341376234999:10420]
2025-10-02T08:16:27.261199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535341376234999:10420]
2025-10-02T08:16:27.261230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:27.261235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.261236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:27.261250Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:27.261255Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:27.261358Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:27.261745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:27.319612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535341376235035:10248]
2025-10-02T08:16:27.319717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2705, pipe: [1:7556535341376235035:10248]
2025-10-02T08:16:27.381814Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:27.382091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.382103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.382131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376235035:10248], now have 1 active actors on pipe
2025-10-02T08:16:27.382245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535341376235035:10248]
2025-10-02T08:16:27.382260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:27.382265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:27.382303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2706 reason: error at write: Disconnected sessionId: src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0
2025-10-02T08:16:27.382332Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:27.382362Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:27.382450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2706 sessionId: src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0 is DEAD
2025-10-02T08:16:27.382611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:27.382622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0] Write session will restart in 0.008246s
2025-10-02T08:16:27.382644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0] Write session: Do CDS request
2025-10-02T08:16:27.382649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:27.392254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.392337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:27.392353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2707
2025-10-02T08:16:27.392450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.392476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:27.392483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:27.392485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:27.392793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2707 sessionId:  describe result for acl check
2025-10-02T08:16:27.392831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:27.392836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:27.392837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:27.392841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535341376235669:10437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:27.393360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535341376235669:10437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:27.395528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535341376235669:10437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:27.397073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:27.397364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:27.397517Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:27.397530Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:27.397539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:27.397584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:27.397616Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535341376235794:10438]
2025-10-02T08:16:27.398089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535341376235669:10437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:27.398101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535341376235669:10437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:27.398104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535341376235669:10437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:27.398110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:27.398174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:27.398310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:27.398347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:27.398658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:27.398712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.398718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.398719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.398719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.398720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.398725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.398733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.398737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.398741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.398745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.398750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.398757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.398762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.398767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.398771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.398778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.398786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.398790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.398799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.398804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.398825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:27.406061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:27.407580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:27.407597Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:27.407600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:27.407603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:27.407609Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2706 [1:7556535341376235794:10438]
2025-10-02T08:16:27.407620Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:27.407636Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:27.407644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.407647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.407649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.407663Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:27.407670Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:27.407677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:27.407739Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.407747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.407750Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:27.407753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:27.407811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:27.407819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.407832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.407845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:27.407848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2706
2025-10-02T08:16:27.407861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376235799:10437], now have 1 active actors on pipe
2025-10-02T08:16:27.407865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535341835507654:2378], now have 1 active actors on pipe
2025-10-02T08:16:27.407870Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535341376235788:10438]
2025-10-02T08:16:27.407872Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535341376235788:10438]
2025-10-02T08:16:27.407883Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:27.407892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.407898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.407900Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:27.407902Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:27.407915Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:27.407932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:27.407939Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:27.407972Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:27.407982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.407989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.407990Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:27.407951Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2706
2025-10-02T08:16:27.407998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.408010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:27.408016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535341376235788:10438]
2025-10-02T08:16:27.408025Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:27.408032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:27.408065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.408113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.408121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.408133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.408169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2707 partition: 0 MaxSeqNo: 17 sessionId: src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0
2025-10-02T08:16:27.408482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5e59b6d-1bd40a50-54b2be46-d332bfd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:27.410800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0] Write session: try to update token
2025-10-02T08:16:27.410813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:27.422511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId: src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:27.424521Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:27.424539Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:27.424540Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:27.424547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535341376235788:10438]
2025-10-02T08:16:27.424550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535341376235788:10438]
2025-10-02T08:16:27.424589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:27.424594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.424596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:27.424609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:27.424627Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:27.424706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:27.424722Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:27.482435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535341376235826:10248]
2025-10-02T08:16:27.482579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2706, pipe: [1:7556535341376235826:10248]
2025-10-02T08:16:27.545490Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:27.545863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.545874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.545904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376235826:10248], now have 1 active actors on pipe
2025-10-02T08:16:27.546005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535341376235826:10248]
2025-10-02T08:16:27.546022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:27.546023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:27.546071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2707 reason: error at write: Disconnected sessionId: src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0
2025-10-02T08:16:27.546080Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:27.546147Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:27.546251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2707 sessionId: src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0 is DEAD
2025-10-02T08:16:27.546389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:27.546395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0] Write session will restart in 0.009782s
2025-10-02T08:16:27.546419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0] Write session: Do CDS request
2025-10-02T08:16:27.546425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:27.557271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.557314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:27.557332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2708
2025-10-02T08:16:27.557464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.557509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:27.557518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:27.557522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:27.557919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2708 sessionId:  describe result for acl check
2025-10-02T08:16:27.557951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:27.557953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:27.557955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:27.557960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535341376236489:10447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:27.558426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535341376236489:10447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:27.560318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535341376236489:10447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:27.561775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:27.562066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:27.562216Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:27.562228Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:27.562239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:27.562293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:27.562327Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535341376236589:10449]
2025-10-02T08:16:27.562890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:27.562970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535341376236489:10447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:27.562984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535341376236489:10447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:27.562987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535341376236489:10447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:27.562993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:27.563056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:27.563100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:27.563375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:27.563439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.563446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.563447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.563448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.563449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.563454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.563462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.563465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.563468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.563472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.563477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.563483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.563488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.563493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.563497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.563501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.563505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.563509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.563513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.563518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.563538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:27.574336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:27.575946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:27.575969Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:27.575971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:27.575974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:27.575983Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2707 [1:7556535341376236589:10449]
2025-10-02T08:16:27.575995Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:27.576011Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:27.576015Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.576017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.576019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.576046Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:27.576057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:27.576063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:27.576139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.576148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.576150Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:27.576153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:27.576218Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:27.576225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.576238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.576249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:27.576270Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535341376236582:10449]
2025-10-02T08:16:27.576276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535341376236582:10449]
2025-10-02T08:16:27.576283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2707
2025-10-02T08:16:27.576287Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:27.576294Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:27.576298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376236598:10447], now have 1 active actors on pipe
2025-10-02T08:16:27.576303Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:27.576305Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535341835507661:2378], now have 1 active actors on pipe
2025-10-02T08:16:27.576310Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:27.576322Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:27.576327Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:27.576335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.576339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.576378Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535341376236582:10449]
2025-10-02T08:16:27.576384Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:27.576376Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2707
2025-10-02T08:16:27.576394Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:27.576398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:27.576404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.576408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.576409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:27.576418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.576426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:27.576466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.576539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.576550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.576564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.576606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2708 partition: 0 MaxSeqNo: 17 sessionId: src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0
2025-10-02T08:16:27.576936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42237bbf-aef40f53-bb408da0-7b7a5690_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:27.579342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0] Write session: try to update token
2025-10-02T08:16:27.579359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:27.592535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId: src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:27.593248Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:27.593271Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:27.593273Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:27.593281Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535341376236582:10449]
2025-10-02T08:16:27.593285Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535341376236582:10449]
2025-10-02T08:16:27.593325Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:27.593331Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:27.593336Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:27.593336Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.593338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:27.593471Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:27.594783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:27.646373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535341376236619:10248]
2025-10-02T08:16:27.646476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2707, pipe: [1:7556535341376236619:10248]
2025-10-02T08:16:27.715483Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:27.715807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.715817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.715848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376236619:10248], now have 1 active actors on pipe
2025-10-02T08:16:27.715939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535341376236619:10248]
2025-10-02T08:16:27.715969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:27.715971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:27.715996Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:27.716024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2708 reason: error at write: Disconnected sessionId: src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0
2025-10-02T08:16:27.716044Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:27.716200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2708 sessionId: src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0 is DEAD
2025-10-02T08:16:27.716315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:27.716324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0] Write session will restart in 0.009620s
2025-10-02T08:16:27.716344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0] Write session: Do CDS request
2025-10-02T08:16:27.716349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:27.727257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.727304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:27.727318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2709
2025-10-02T08:16:27.727464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.727487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:27.727492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:27.727495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:27.727789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2709 sessionId:  describe result for acl check
2025-10-02T08:16:27.727812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:27.727813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:27.727814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:27.727818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535341376237311:10472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:27.728185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535341376237311:10472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:27.729799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535341376237311:10472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:27.730324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:27.730597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:27.730715Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:27.730722Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:27.730728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:27.730761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:27.730787Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535341376237390:10463]
2025-10-02T08:16:27.731163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:27.731289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:27.731314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:27.731503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:27.731534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.731537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.731538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.731539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.731539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.731542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.731548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.731550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.731552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.731554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.731557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.731561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.731564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.731570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.731572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.731575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.731580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.731583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.731586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.731588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.731601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:27.731796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535341376237311:10472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:27.731805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535341376237311:10472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:27.731808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535341376237311:10472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:27.731812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:27.739000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:27.740481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:27.740495Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:27.740497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:27.740500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:27.740504Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2708 [1:7556535341376237390:10463]
2025-10-02T08:16:27.740513Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:27.740526Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:27.740532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.740534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.740537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.740548Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:27.740551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:27.740556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:27.740600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.740605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.740606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:27.740608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:27.740702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:27.740707Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.740715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.740715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2708
2025-10-02T08:16:27.740723Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:27.740736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376237407:10472], now have 1 active actors on pipe
2025-10-02T08:16:27.740746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535341835507668:2378], now have 1 active actors on pipe
2025-10-02T08:16:27.740751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.740756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.740771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535341376237384:10463]
2025-10-02T08:16:27.740773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535341376237384:10463]
2025-10-02T08:16:27.740779Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:27.740785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:27.740794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:27.740795Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:27.740820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:27.740823Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:27.740787Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2708
2025-10-02T08:16:27.740836Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|803abbb2-48f07f3-711ed895-5a450565_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:27.740848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.740855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.740856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:27.740864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.740874Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:27.740901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535341376237384:10463]
2025-10-02T08:16:27.740911Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:27.740922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.740924Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:27.741000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.741006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.741017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.741047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2709 partition: 0 MaxSeqNo: 17 sessionId: src_id|803abbb2-48f07f3-711ed895-5a450565_0
2025-10-02T08:16:27.741327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf70a6e7-9067f6c5-9b8fab37-529e74d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|803abbb2-48f07f3-711ed895-5a450565_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:27.743547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803abbb2-48f07f3-711ed895-5a450565_0] Write session: try to update token
2025-10-02T08:16:27.743558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803abbb2-48f07f3-711ed895-5a450565_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:27.755127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId: src_id|803abbb2-48f07f3-711ed895-5a450565_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:27.757305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:27.757438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.757459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.757480Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:27.757488Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:27.757490Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:27.757498Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535341376237384:10463]
2025-10-02T08:16:27.757502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535341376237384:10463]
2025-10-02T08:16:27.757536Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:27.757542Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:27.757546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.757548Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:27.757548Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:27.757678Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:27.816257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535341376237420:10248]
2025-10-02T08:16:27.816351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2708, pipe: [1:7556535341376237420:10248]
2025-10-02T08:16:27.890922Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:27.891238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:27.891272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:27.891274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376237420:10248], now have 1 active actors on pipe
2025-10-02T08:16:27.891399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:27.891407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:27.891420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2709 reason: error at write: Disconnected sessionId: src_id|803abbb2-48f07f3-711ed895-5a450565_0
2025-10-02T08:16:27.891458Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:27.891572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2709 sessionId: src_id|803abbb2-48f07f3-711ed895-5a450565_0 is DEAD
2025-10-02T08:16:27.891672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535341376237420:10248]
2025-10-02T08:16:27.891702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803abbb2-48f07f3-711ed895-5a450565_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:27.891710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803abbb2-48f07f3-711ed895-5a450565_0] Write session will restart in 0.006231s
2025-10-02T08:16:27.891736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803abbb2-48f07f3-711ed895-5a450565_0] Write session: Do CDS request
2025-10-02T08:16:27.891741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803abbb2-48f07f3-711ed895-5a450565_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:27.899164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803abbb2-48f07f3-711ed895-5a450565_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.899230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:27.899244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2710
2025-10-02T08:16:27.899337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:27.899362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:27.899369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:27.899372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:27.899631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2710 sessionId:  describe result for acl check
2025-10-02T08:16:27.899651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:27.899658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:27.899660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:27.899663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535341376237897:10480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:27.900005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535341376237897:10480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:27.902493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535341376237897:10480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:27.905369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535341376237897:10480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:27.905385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535341376237897:10480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:27.905386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535341376237897:10480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:27.905392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:27.905848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:27.906373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:27.906475Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:27.906481Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:27.906487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:27.906514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:27.906537Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535341376238208:10473]
2025-10-02T08:16:27.906919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:27.907069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:27.907096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:27.907272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:27.907296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.907300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.907301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.907301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.907302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.907305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.907310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.907312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.907314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.907318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.907321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.907325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:27.907328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.907330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:27.907332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.907335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:27.907336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.907339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.907342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.907344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.907353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:27.914424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:27.915906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:27.915921Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:27.915922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:27.915924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:27.915928Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2709 [1:7556535341376238208:10473]
2025-10-02T08:16:27.915934Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:27.915944Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:27.915945Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.915947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.915948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.915958Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:27.915960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:27.915964Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:27.916003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.916009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.916010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:27.916012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:27.916066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:27.916073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.916084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:27.916097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:27.916111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535341376238202:10473]
2025-10-02T08:16:27.916117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535341376238202:10473]
2025-10-02T08:16:27.916122Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:27.916130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376238198:10480], now have 1 active actors on pipe
2025-10-02T08:16:27.916132Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:27.916135Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:27.916136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:27.916143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:27.916144Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:27.916148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535341835507677:2378], now have 1 active actors on pipe
2025-10-02T08:16:27.916165Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535341376238202:10473]
2025-10-02T08:16:27.916174Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:27.916187Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:27.916202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2709
2025-10-02T08:16:27.916207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.916209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.916218Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2709
2025-10-02T08:16:27.916227Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:27.916236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.916239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.916240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:27.916245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.916251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:27.916264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.916287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.916292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.916301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:27.916323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2710 partition: 0 MaxSeqNo: 17 sessionId: src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0
2025-10-02T08:16:27.916591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803abbb2-48f07f3-711ed895-5a450565_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:27.918881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0] Write session: try to update token
2025-10-02T08:16:27.918893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:27.926378Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:27.926401Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:27.926409Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535341376238202:10473]
2025-10-02T08:16:27.926452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:27.926454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:27.926652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:27.926818Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:27.926972Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:27.927119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:27.927298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:27.927330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:27.931463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId: src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:27.933768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:27.933815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.933830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.933860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:27.933881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:27.933915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:27.933923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:27.934042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.934095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.934147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.934261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.934302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.934308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.934406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.934500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.934562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.934623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.934666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.934673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.934744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.934809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.934868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.934924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.934960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.934966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.935021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.935075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.935135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.935189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.935228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.935233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.935291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.935342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.935396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.935448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.935487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.935492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.935546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.935598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.935651Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.935708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.935748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.935753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.935808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.935858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.935918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.935971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.936009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.936014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.936082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.936133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.936188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.936240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.936281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.936286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.936341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.936392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.936454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.936507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.936545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.936552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.936609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:27.936662Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:27.936715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:27.936771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:27.936831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:27.936838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:27.936864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:27.936909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:27.936925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:27.936929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:27.936950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:27.936961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:27.936965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:27.936967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:27.936969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:27.937307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:27.937332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:27.937340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:27.937345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:27.937347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:27.937349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:27.937784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:27.937804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:27.937811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:27.937813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:27.937815Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:27.937817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:27.938289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:27.938309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:27.938318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:27.938323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:27.938325Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:27.940060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:27.940074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:27.940082Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392987939
2025-10-02T08:16:27.940192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:27.940201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:27.940205Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:27.940210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:27.940213Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:27.940215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:27.940604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:27.940625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:27.940635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:27.940638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:27.940644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:27.940647Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:27.941042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:27.941059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:27.941067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:27.941069Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:27.941071Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:27.941074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:27.941452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:27.941467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:27.941470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:27.942351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:27.942367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:27.942373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:27.942378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:27.942384Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392987942
2025-10-02T08:16:27.942636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:27.942651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:27.942655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:27.942661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:27.942663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:27.942665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:27.943080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:27.943098Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:27.943106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:27.943109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:27.943112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:27.943113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:27.943503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:27.943517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:27.943588Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392987943
2025-10-02T08:16:27.944214Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:27.944239Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:27.944243Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:27.944248Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:27.945652Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:27.945664Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:27.945665Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:27.945672Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535341376238202:10473]
2025-10-02T08:16:27.945674Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535341376238202:10473]
2025-10-02T08:16:27.945707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:27.945711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:27.945714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:27.945715Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:27.945718Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:27.945831Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:27.991901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535341376238274:10248]
2025-10-02T08:16:27.991992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2709, pipe: [1:7556535341376238274:10248]
2025-10-02T08:16:28.069736Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:28.070023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535341376238274:10248], now have 1 active actors on pipe
2025-10-02T08:16:28.070113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535341376238274:10248]
2025-10-02T08:16:28.070139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:28.070145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:28.070150Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:28.070173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2710 reason: error at write: Disconnected sessionId: src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0
2025-10-02T08:16:28.070343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2710 sessionId: src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0 is DEAD
2025-10-02T08:16:28.070332Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:28.070476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:28.070483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0] Write session will restart in 0.005618s
2025-10-02T08:16:28.070500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0] Write session: Do CDS request
2025-10-02T08:16:28.070507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:28.077147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.077197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:28.077212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2711
2025-10-02T08:16:28.077334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.077356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:28.077363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:28.077365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:28.077713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2711 sessionId:  describe result for acl check
2025-10-02T08:16:28.077737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:28.077742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:28.077743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:28.077747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535345671205983:10540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:28.078104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535345671205983:10540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:28.080198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535345671205983:10540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:28.082654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535345671205983:10540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:28.082667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535345671205983:10540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:28.082670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535345671205983:10540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:28.082675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:28.084420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:28.085323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:28.085432Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:28.085440Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:28.085447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:28.085473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:28.085498Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535345671206344:10544]
2025-10-02T08:16:28.085865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:28.085986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:28.086010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:28.086184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:28.086211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.086216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.086217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.086217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.086218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.086222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.086232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.086235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.086242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.086245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.086253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.086264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.086271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.086274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.086277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.086280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.086282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.086285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.086287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.086290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.086300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:28.093982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:28.095345Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:28.095356Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:28.095357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:28.095360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:28.095364Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2710 [1:7556535345671206344:10544]
2025-10-02T08:16:28.095371Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:28.095383Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:28.095384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.095387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.095388Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.095398Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:28.095401Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:28.095405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:28.095450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.095455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.095458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:28.095459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:28.095546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2710
2025-10-02T08:16:28.095616Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2710
2025-10-02T08:16:28.095645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:28.095651Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.095658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.095665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:28.095677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671206311:10540], now have 1 active actors on pipe
2025-10-02T08:16:28.095683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535346130475013:2378], now have 1 active actors on pipe
2025-10-02T08:16:28.095687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.095689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.095707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535345671206338:10544]
2025-10-02T08:16:28.095711Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535345671206338:10544]
2025-10-02T08:16:28.095719Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:28.095727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:28.095731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:28.095733Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:28.095736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:28.095738Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:28.095748Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6143020-1456734b-f98f7563-1d9a8d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:28.095752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.095755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.095757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:28.095762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.095768Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:28.095792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535345671206338:10544]
2025-10-02T08:16:28.095801Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:28.095809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.095810Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:28.095844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.095849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.095858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.095884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2711 partition: 0 MaxSeqNo: 17 sessionId: src_id|c6143020-1456734b-f98f7563-1d9a8d1_0
2025-10-02T08:16:28.096170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e9ab3f-5beec6dd-ca2ffb6f-cf101b9c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c6143020-1456734b-f98f7563-1d9a8d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:28.098407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6143020-1456734b-f98f7563-1d9a8d1_0] Write session: try to update token
2025-10-02T08:16:28.098419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6143020-1456734b-f98f7563-1d9a8d1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:28.109098Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:28.109124Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:28.109134Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535345671206338:10544]
2025-10-02T08:16:28.109182Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:28.109362Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:28.109524Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:28.109786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:28.109965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:28.110098Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:28.110282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:28.110323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:28.110530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId: src_id|c6143020-1456734b-f98f7563-1d9a8d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:28.112784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:28.112873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.112887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.112909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:28.112926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:28.112969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.112979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.113120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.113176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.113235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.113292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.113331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.113338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.113398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.113457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.113519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.113583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.113625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.113631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.113714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.113772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.113843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.113913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.113958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.113965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.114030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.114089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.114150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.114211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.114332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.114339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.114402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.114460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.114526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.114586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.114626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.114631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.114686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.114744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.114806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.114869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.114915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.114922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.114983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.115041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.115107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.115165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.115206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.115213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.115274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.115336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.115399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.115455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.115496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.115504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.115568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.115626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.115687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.115748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.115795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.115801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.115864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.115922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.115980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.116049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.116094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.116103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.116136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:28.116196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.116218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.116225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:28.116257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:28.116272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:28.116280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:28.116283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:28.116290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:28.116656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:28.116684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:28.116694Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:28.116702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:28.116705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:28.116708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:28.117471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:28.117495Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:28.117505Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:28.117508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:28.117511Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:28.117513Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:28.118115Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:28.118142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:28.118148Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:28.118153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:28.118156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:28.119280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:28.119302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:28.119313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392988119
2025-10-02T08:16:28.119518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:28.119534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:28.119544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:28.119551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:28.119554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:28.119557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:28.119968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:28.119991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:28.120001Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:28.120008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:28.120011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:28.120019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:28.120496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:28.120521Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:28.120535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:28.120542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:28.120546Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:28.120548Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:28.121000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:28.121024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:28.121034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:28.122052Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:28.122076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:28.122087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:28.122096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:28.122109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392988121
2025-10-02T08:16:28.122411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:28.122431Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:28.122440Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:28.122448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:28.122452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:28.122455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:28.122872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:28.122889Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:28.122896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:28.122903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:28.122906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:28.122909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:28.123315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:28.123330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.123416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392988123
2025-10-02T08:16:28.124061Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:28.124079Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:28.124092Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:28.124102Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:28.125588Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:28.125602Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:28.125604Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:28.125614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535345671206338:10544]
2025-10-02T08:16:28.125617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535345671206338:10544]
2025-10-02T08:16:28.125650Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:28.125658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:28.125669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:28.125676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.125678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:28.125790Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:28.170014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535345671206377:10248]
2025-10-02T08:16:28.170094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2710, pipe: [1:7556535345671206377:10248]
2025-10-02T08:16:28.247777Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:28.248090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671206377:10248], now have 1 active actors on pipe
2025-10-02T08:16:28.248270Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:28.248312Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:28.248524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:28.248556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2711 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c6143020-1456734b-f98f7563-1d9a8d1_0
2025-10-02T08:16:28.248699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535345671206377:10248]
2025-10-02T08:16:28.248712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2711 sessionId: src_id|c6143020-1456734b-f98f7563-1d9a8d1_0 is DEAD
2025-10-02T08:16:28.248850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6143020-1456734b-f98f7563-1d9a8d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:28.248860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6143020-1456734b-f98f7563-1d9a8d1_0] Write session will restart in 0.009732s
2025-10-02T08:16:28.248881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6143020-1456734b-f98f7563-1d9a8d1_0] Write session: Do CDS request
2025-10-02T08:16:28.248888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6143020-1456734b-f98f7563-1d9a8d1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:28.259289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6143020-1456734b-f98f7563-1d9a8d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.259327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:28.259340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2712
2025-10-02T08:16:28.259474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.259498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:28.259504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:28.259507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:28.259820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2712 sessionId:  describe result for acl check
2025-10-02T08:16:28.259848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:28.259850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:28.259851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:28.259856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535345671207023:10580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:28.260229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535345671207023:10580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:28.262378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535345671207023:10580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:28.264249Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:28.264668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:28.264828Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:28.264837Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:28.264846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:28.264871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535345671207023:10580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:28.264882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535345671207023:10580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:28.264885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535345671207023:10580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:28.264888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:28.264892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:28.264913Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535345671207147:10578]
2025-10-02T08:16:28.265504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:28.265658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:28.265693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:28.265951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:28.265979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.265984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.265985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.265986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.265986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.265990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.265996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.265998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.266000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.266002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.266005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.266009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.266013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.266017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.266020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.266022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.266024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.266026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.266029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.266031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.266041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:28.273328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:28.275002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:28.275016Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:28.275017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:28.275019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:28.275025Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2711 [1:7556535345671207147:10578]
2025-10-02T08:16:28.275035Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:28.275051Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:28.275054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.275056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.275059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.275071Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:28.275076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:28.275082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:28.275141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.275148Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.275151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:28.275153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:28.275214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:28.275222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.275234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.275246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:28.275257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2711
2025-10-02T08:16:28.275268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671207152:10580], now have 1 active actors on pipe
2025-10-02T08:16:28.275271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535346130475022:2378], now have 1 active actors on pipe
2025-10-02T08:16:28.275276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535345671207141:10578]
2025-10-02T08:16:28.275279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535345671207141:10578]
2025-10-02T08:16:28.275290Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:28.275303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.275309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.275319Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:28.275323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:28.275331Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:28.275333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:28.275343Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:28.275365Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:28.275372Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.275336Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2711
2025-10-02T08:16:28.275375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.275376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:28.275382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.275387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:28.275392Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535345671207141:10578]
2025-10-02T08:16:28.275394Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:28.275397Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:28.275410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.275465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.275470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.275480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.275509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2712 partition: 0 MaxSeqNo: 17 sessionId: src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0
2025-10-02T08:16:28.275833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6143020-1456734b-f98f7563-1d9a8d1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:28.278140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0] Write session: try to update token
2025-10-02T08:16:28.278154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:28.290137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId: src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:28.291513Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:28.291528Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:28.291530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:28.291538Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535345671207141:10578]
2025-10-02T08:16:28.291543Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535345671207141:10578]
2025-10-02T08:16:28.291582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:28.291593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.291595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:28.291596Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:28.291601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:28.291733Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:28.292462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:28.348734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535345671207177:10248]
2025-10-02T08:16:28.348850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2711, pipe: [1:7556535345671207177:10248]
2025-10-02T08:16:28.414792Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:28.414995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.415004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.415035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671207177:10248], now have 1 active actors on pipe
2025-10-02T08:16:28.415141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535345671207177:10248]
2025-10-02T08:16:28.415161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:28.415162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:28.415175Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:28.415214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2712 reason: error at write: Disconnected sessionId: src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0
2025-10-02T08:16:28.415230Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:28.415369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2712 sessionId: src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0 is DEAD
2025-10-02T08:16:28.415483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:28.415491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0] Write session will restart in 0.005649s
2025-10-02T08:16:28.415515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0] Write session: Do CDS request
2025-10-02T08:16:28.415521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:28.422169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.422597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:28.422608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2713
2025-10-02T08:16:28.422687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.422711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:28.422714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:28.422716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:28.423067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2713 sessionId:  describe result for acl check
2025-10-02T08:16:28.423097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:28.423099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:28.423100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:28.423104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535345671207608:10613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:28.423450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535345671207608:10613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:28.425540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535345671207608:10613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:28.428535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535345671207608:10613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:28.428546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535345671207608:10613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:28.428548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535345671207608:10613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:28.428554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:28.431020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:28.432304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:28.432499Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:28.432507Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:28.432513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:28.432546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:28.432580Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535345671207954:10606]
2025-10-02T08:16:28.433051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:28.433215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:28.433242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:28.433469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:28.433519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.433524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.433525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.433525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.433526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.433530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.433536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.433538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.433540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.433542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.433545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.433549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.433553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.433557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.433560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.433562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.433565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.433567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.433570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.433574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.433583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:28.440849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:28.442353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:28.442364Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:28.442365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:28.442368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:28.442372Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2712 [1:7556535345671207954:10606]
2025-10-02T08:16:28.442379Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:28.442391Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:28.442393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.442397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.442398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.442409Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:28.442412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:28.442416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:28.442460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.442465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.442468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:28.442470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:28.442515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:28.442520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.442527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.442533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:28.442544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535345671207948:10606]
2025-10-02T08:16:28.442548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535345671207948:10606]
2025-10-02T08:16:28.442554Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:28.442563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671207905:10613], now have 1 active actors on pipe
2025-10-02T08:16:28.442562Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:28.442565Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:28.442570Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:28.442581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:28.442582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2712
2025-10-02T08:16:28.442587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:28.442593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535346130475028:2378], now have 1 active actors on pipe
2025-10-02T08:16:28.442615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.442623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.442635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535345671207948:10606]
2025-10-02T08:16:28.442640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:28.442651Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:28.442657Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27da0202-2d018303-3bd35cc6-ba69253f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:28.442661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.442663Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.442665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:28.442671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.442676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:28.442636Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2712
2025-10-02T08:16:28.442694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.442730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.442735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.442744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.442768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2713 partition: 0 MaxSeqNo: 17 sessionId: src_id|27da0202-2d018303-3bd35cc6-ba69253f_0
2025-10-02T08:16:28.443060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f74-ee1edb0c-1e2ec59e-51bee4ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|27da0202-2d018303-3bd35cc6-ba69253f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:28.445670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27da0202-2d018303-3bd35cc6-ba69253f_0] Write session: try to update token
2025-10-02T08:16:28.445685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27da0202-2d018303-3bd35cc6-ba69253f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:28.458273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId: src_id|27da0202-2d018303-3bd35cc6-ba69253f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:28.459190Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:28.459207Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:28.459209Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:28.459216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535345671207948:10606]
2025-10-02T08:16:28.459220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535345671207948:10606]
2025-10-02T08:16:28.459254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:28.459259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:28.459262Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:28.459264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.459266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:28.459401Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:28.460630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:28.515157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535345671207978:10248]
2025-10-02T08:16:28.515242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2712, pipe: [1:7556535345671207978:10248]
2025-10-02T08:16:28.582934Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:28.583234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.583251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.583292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671207978:10248], now have 1 active actors on pipe
2025-10-02T08:16:28.583407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:28.583414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:28.583464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2713 reason: error at write: Disconnected sessionId: src_id|27da0202-2d018303-3bd35cc6-ba69253f_0
2025-10-02T08:16:28.583517Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:28.583528Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:28.583623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2713 sessionId: src_id|27da0202-2d018303-3bd35cc6-ba69253f_0 is DEAD
2025-10-02T08:16:28.583768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27da0202-2d018303-3bd35cc6-ba69253f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:28.583776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27da0202-2d018303-3bd35cc6-ba69253f_0] Write session will restart in 0.008314s
2025-10-02T08:16:28.583780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535345671207978:10248]
2025-10-02T08:16:28.583798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27da0202-2d018303-3bd35cc6-ba69253f_0] Write session: Do CDS request
2025-10-02T08:16:28.583804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27da0202-2d018303-3bd35cc6-ba69253f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:28.593219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27da0202-2d018303-3bd35cc6-ba69253f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.593302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:28.593314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2714
2025-10-02T08:16:28.593424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.593452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:28.593460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:28.593464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:28.593824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2714 sessionId:  describe result for acl check
2025-10-02T08:16:28.593857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:28.593863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:28.593865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:28.593869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535345671208515:10626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:28.594299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535345671208515:10626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:28.596669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535345671208515:10626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:28.599196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:28.599350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535345671208515:10626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:28.599363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535345671208515:10626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:28.599367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535345671208515:10626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:28.599375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:28.600266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:28.600464Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:28.600471Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:28.600477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:28.600508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:28.600531Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535345671208760:10627]
2025-10-02T08:16:28.600939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:28.601070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:28.601094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:28.601272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:28.601296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.601299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.601300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.601301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.601301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.601304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.601309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.601311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.601313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.601315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.601319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.601322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.601325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.601328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.601330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.601332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.601334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.601336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.601338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.601341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.601350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:28.608654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:28.610274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:28.610285Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:28.610287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:28.610289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:28.610294Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2713 [1:7556535345671208760:10627]
2025-10-02T08:16:28.610300Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:28.610311Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:28.610313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.610314Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.610316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.610326Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:28.610329Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:28.610337Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:28.610376Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.610383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.610385Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:28.610389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:28.610435Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:28.610440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.610447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.610454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:28.610467Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535345671208748:10627]
2025-10-02T08:16:28.610472Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535345671208748:10627]
2025-10-02T08:16:28.610476Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:28.610484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:28.610495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:28.610500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:28.610502Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:28.610506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:28.610508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671208756:10626], now have 1 active actors on pipe
2025-10-02T08:16:28.610520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2713
2025-10-02T08:16:28.610526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535345671208748:10627]
2025-10-02T08:16:28.610527Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:28.610537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535346130475035:2378], now have 1 active actors on pipe
2025-10-02T08:16:28.610541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:28.610548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.610550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.610573Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:28.610580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.610582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.610583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:28.610589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.610597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:28.610609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.610601Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2713
2025-10-02T08:16:28.610637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.610641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.610650Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.610686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2714 partition: 0 MaxSeqNo: 17 sessionId: src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0
2025-10-02T08:16:28.610974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27da0202-2d018303-3bd35cc6-ba69253f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:28.613366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0] Write session: try to update token
2025-10-02T08:16:28.613378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:28.625225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId: src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:28.626667Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:28.626681Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:28.626683Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:28.626689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535345671208748:10627]
2025-10-02T08:16:28.626695Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535345671208748:10627]
2025-10-02T08:16:28.626727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:28.626736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.626737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:28.626743Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:28.626757Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:28.626862Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:28.627449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:28.684114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535345671208784:10248]
2025-10-02T08:16:28.684199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2713, pipe: [1:7556535345671208784:10248]
2025-10-02T08:16:28.749065Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:28.749358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.749367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.749398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671208784:10248], now have 1 active actors on pipe
2025-10-02T08:16:28.749521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:28.749530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:28.749571Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:28.749595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2714 reason: error at write: Disconnected sessionId: src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0
2025-10-02T08:16:28.749613Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:28.749780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2714 sessionId: src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0 is DEAD
2025-10-02T08:16:28.749788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535345671208784:10248]
2025-10-02T08:16:28.749916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:28.749925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0] Write session will restart in 0.007528s
2025-10-02T08:16:28.749946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0] Write session: Do CDS request
2025-10-02T08:16:28.749950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:28.758213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.758230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:28.758245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2715
2025-10-02T08:16:28.758424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.758463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:28.758471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:28.758474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:28.758833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2715 sessionId:  describe result for acl check
2025-10-02T08:16:28.758862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:28.758868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:28.758870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:28.758874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535345671209260:10656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:28.759320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535345671209260:10656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:28.761705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535345671209260:10656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:28.764230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535345671209260:10656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:28.764240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535345671209260:10656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:28.764243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535345671209260:10656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:28.764249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:28.766319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:28.766587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:28.766718Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:28.766726Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:28.766733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:28.766769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:28.766800Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535345671209568:10634]
2025-10-02T08:16:28.767398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:28.767528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:28.767563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:28.767841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:28.767876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.767881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.767883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.767884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.767885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.767889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.767898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.767906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.767910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.767917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.767922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.767932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.767941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.767950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.767958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.767964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.767972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.767977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.767987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.767995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.768016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:28.775348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:28.776996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:28.777011Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:28.777013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:28.777017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:28.777022Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2714 [1:7556535345671209568:10634]
2025-10-02T08:16:28.777032Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:28.777046Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:28.777053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.777056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.777058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.777072Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:28.777081Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:28.777091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:28.777146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.777153Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.777157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:28.777159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:28.777216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:28.777221Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.777233Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.777245Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:28.777262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671209547:10656], now have 1 active actors on pipe
2025-10-02T08:16:28.777271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2714
2025-10-02T08:16:28.777272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535346130475042:2378], now have 1 active actors on pipe
2025-10-02T08:16:28.777278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535345671209562:10634]
2025-10-02T08:16:28.777280Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535345671209562:10634]
2025-10-02T08:16:28.777309Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2714
2025-10-02T08:16:28.777291Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:28.777299Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:28.777302Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:28.777303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:28.777315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:28.777318Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:28.777323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.777327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.777358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535345671209562:10634]
2025-10-02T08:16:28.777368Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:28.777371Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:28.777389Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|525d138c-72794c1-57a79b4d-40666bf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:28.777398Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.777406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.777407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:28.777415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.777428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:28.777463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.777499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.777505Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.777517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.777551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2715 partition: 0 MaxSeqNo: 17 sessionId: src_id|525d138c-72794c1-57a79b4d-40666bf8_0
2025-10-02T08:16:28.777839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3a8e5d-97fc0d16-3b55510a-a7cdcecd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|525d138c-72794c1-57a79b4d-40666bf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:28.780099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|525d138c-72794c1-57a79b4d-40666bf8_0] Write session: try to update token
2025-10-02T08:16:28.780110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|525d138c-72794c1-57a79b4d-40666bf8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:28.792127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId: src_id|525d138c-72794c1-57a79b4d-40666bf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:28.794279Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:28.794291Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:28.794293Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:28.794299Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535345671209562:10634]
2025-10-02T08:16:28.794302Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535345671209562:10634]
2025-10-02T08:16:28.794333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:28.794336Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:28.794338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.794339Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:28.794340Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:28.794464Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:28.794605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:28.849998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535345671209592:10248]
2025-10-02T08:16:28.850098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2714, pipe: [1:7556535345671209592:10248]
2025-10-02T08:16:28.919683Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:28.920081Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.920096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.920129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671209592:10248], now have 1 active actors on pipe
2025-10-02T08:16:28.920213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535345671209592:10248]
2025-10-02T08:16:28.920230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:28.920232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:28.920271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2715 reason: error at write: Disconnected sessionId: src_id|525d138c-72794c1-57a79b4d-40666bf8_0
2025-10-02T08:16:28.920296Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:28.920331Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:28.920408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2715 sessionId: src_id|525d138c-72794c1-57a79b4d-40666bf8_0 is DEAD
2025-10-02T08:16:28.920554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525d138c-72794c1-57a79b4d-40666bf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:28.920562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525d138c-72794c1-57a79b4d-40666bf8_0] Write session will restart in 0.008972s
2025-10-02T08:16:28.920582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525d138c-72794c1-57a79b4d-40666bf8_0] Write session: Do CDS request
2025-10-02T08:16:28.920587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525d138c-72794c1-57a79b4d-40666bf8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:28.930268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|525d138c-72794c1-57a79b4d-40666bf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.930363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:28.930374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2716
2025-10-02T08:16:28.930476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:28.930504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:28.930509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:28.930512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:28.930835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2716 sessionId:  describe result for acl check
2025-10-02T08:16:28.930863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:28.930864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:28.930865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:28.930869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535345671210181:2321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:28.931329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535345671210181:2321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:28.933679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535345671210181:2321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:28.935406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:28.936731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:28.936903Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:28.936914Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:28.936923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:28.936974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:28.937007Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535345671210373:10666]
2025-10-02T08:16:28.937016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535345671210181:2321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:28.937027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535345671210181:2321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:28.937030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535345671210181:2321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:28.937041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:28.937608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:28.937813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:28.937856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:28.938143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:28.938192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.938198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.938200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.938201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.938202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.938207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.938216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.938219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.938223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.938226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.938231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.938237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:28.938242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.938247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:28.938251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.938261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:28.938266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.938271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.938279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.938284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.938305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:28.945738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:28.947452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:28.947468Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:28.947470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:28.947473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:28.947478Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2715 [1:7556535345671210373:10666]
2025-10-02T08:16:28.947488Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:28.947500Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:28.947502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.947505Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.947507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.947518Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:28.947522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:28.947528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:28.947575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.947584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.947587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:28.947590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:28.947640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:28.947649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.947660Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:28.947673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:28.947686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535345671210367:10666]
2025-10-02T08:16:28.947692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535345671210367:10666]
2025-10-02T08:16:28.947698Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:28.947707Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:28.947709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535345671210378:2321], now have 1 active actors on pipe
2025-10-02T08:16:28.947715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:28.947716Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:28.947727Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:28.947729Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:28.947734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535346130475051:2378], now have 1 active actors on pipe
2025-10-02T08:16:28.947754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535345671210367:10666]
2025-10-02T08:16:28.947762Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:28.947766Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:28.947750Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2715
2025-10-02T08:16:28.947797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2715
2025-10-02T08:16:28.947815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.947818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.947839Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7160b08f-8cd037c7-3095582a-87fcd560_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:28.947844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.947847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.947849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:28.947857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.947870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:28.947886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.947907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.947915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.947927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:28.947954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2716 partition: 0 MaxSeqNo: 17 sessionId: src_id|7160b08f-8cd037c7-3095582a-87fcd560_0
2025-10-02T08:16:28.948253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525d138c-72794c1-57a79b4d-40666bf8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7160b08f-8cd037c7-3095582a-87fcd560_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:28.950664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7160b08f-8cd037c7-3095582a-87fcd560_0] Write session: try to update token
2025-10-02T08:16:28.950680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7160b08f-8cd037c7-3095582a-87fcd560_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:28.957944Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:28.957962Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:28.957970Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535345671210367:10666]
2025-10-02T08:16:28.958008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:28.958019Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:28.958164Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:28.958297Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:28.958427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:28.958559Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:28.958731Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:28.958769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:28.963119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId: src_id|7160b08f-8cd037c7-3095582a-87fcd560_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:28.965346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:28.965398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.965406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.965428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:28.965440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:28.965470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:28.965480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:28.965598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.965652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.965710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.965765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.965993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.966000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.966053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.966100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.966157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.966218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.966255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.966260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.966312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.966369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.966430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.966484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.966522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.966526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.966580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.966630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.966695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.966748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.966785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.966792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.966848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.966905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.966962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.967014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.967053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.967058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.967112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.967162Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.967220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.967279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.967320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.967326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.967385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.967444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.967501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.967556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.967660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.967666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.967728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.967785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.967844Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.967904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.967946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.967953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.968013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.968078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.968134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.968191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.968234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.968239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.968301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:28.968353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:28.968415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:28.968477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:28.968522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:28.968528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:28.968557Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:28.968602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:28.968615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:28.968620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:28.968641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:28.968653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:28.968658Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:28.968660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:28.968662Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:28.969009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:28.969027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:28.969034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:28.969037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:28.969039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:28.969041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:28.969533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:28.969550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:28.969553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:28.969558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:28.969560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:28.969562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:28.970004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:28.970021Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:28.970029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:28.970034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:28.970036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:28.971034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:28.971048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:28.971056Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392988970
2025-10-02T08:16:28.971155Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:28.971163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:28.971166Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:28.971168Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:28.971170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:28.971172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:28.971576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:28.971590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:28.971594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:28.971599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:28.971602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:28.971603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:28.971979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:28.971993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:28.972000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:28.972002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:28.972004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:28.972006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:28.972420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:28.972437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:28.972442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:28.973334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:28.973348Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:28.973351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:28.973353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:28.973358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392988973
2025-10-02T08:16:28.973591Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:28.973605Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:28.973609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:28.973611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:28.973613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:28.973615Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:28.973990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:28.974005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:28.974008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:28.974012Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:28.974014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:28.974016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:28.974388Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:28.974401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:28.974466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392988974
2025-10-02T08:16:28.975115Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:28.975130Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:28.975134Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:28.975139Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:28.976583Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:28.976590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:28.976591Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:28.976597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535345671210367:10666]
2025-10-02T08:16:28.976600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535345671210367:10666]
2025-10-02T08:16:28.976638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:28.976643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:28.976645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:28.976646Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:28.976652Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:28.976753Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:29.020492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535349966177754:10248]
2025-10-02T08:16:29.020606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2715, pipe: [1:7556535349966177754:10248]
2025-10-02T08:16:29.098490Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:29.098749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966177754:10248], now have 1 active actors on pipe
2025-10-02T08:16:29.098840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:29.098845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:29.098863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2716 reason: error at write: Disconnected sessionId: src_id|7160b08f-8cd037c7-3095582a-87fcd560_0
2025-10-02T08:16:29.098927Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:29.098981Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:29.099012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2716 sessionId: src_id|7160b08f-8cd037c7-3095582a-87fcd560_0 is DEAD
2025-10-02T08:16:29.099143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7160b08f-8cd037c7-3095582a-87fcd560_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:29.099149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7160b08f-8cd037c7-3095582a-87fcd560_0] Write session will restart in 0.009088s
2025-10-02T08:16:29.099165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7160b08f-8cd037c7-3095582a-87fcd560_0] Write session: Do CDS request
2025-10-02T08:16:29.099150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535349966177754:10248]
2025-10-02T08:16:29.099170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7160b08f-8cd037c7-3095582a-87fcd560_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:29.109256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7160b08f-8cd037c7-3095582a-87fcd560_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.109291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:29.109303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2717
2025-10-02T08:16:29.109447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.109483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:29.109492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:29.109495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:29.109822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2717 sessionId:  describe result for acl check
2025-10-02T08:16:29.109851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:29.109857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:29.109858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:29.109863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535349966178323:2383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:29.110247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535349966178323:2383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:29.112935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535349966178323:2383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:29.115042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:29.116057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:29.116177Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:29.116184Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:29.116190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:29.116218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:29.116337Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535349966178534:2404]
2025-10-02T08:16:29.116375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535349966178323:2383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:29.116383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535349966178323:2383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:29.116386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535349966178323:2383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:29.116390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:29.116763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:29.116944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:29.116976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:29.117163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:29.117190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.117194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.117195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.117196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.117196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.117199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.117205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.117207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.117209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.117211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.117215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.117219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.117222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.117225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.117227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.117230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.117232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.117235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.117237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.117240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.117250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:29.124445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:29.125962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:29.125974Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:29.125976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:29.125978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:29.125983Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2716 [1:7556535349966178534:2404]
2025-10-02T08:16:29.125991Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:29.126002Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:29.126003Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.126005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.126007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.126018Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:29.126021Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:29.126025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:29.126065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.126066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.126068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:29.126070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:29.126120Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:29.126127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.126139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.126149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:29.126156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2716
2025-10-02T08:16:29.126166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966178539:2383], now have 1 active actors on pipe
2025-10-02T08:16:29.126170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535350425442388:2378], now have 1 active actors on pipe
2025-10-02T08:16:29.126175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535349966178528:2404]
2025-10-02T08:16:29.126177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535349966178528:2404]
2025-10-02T08:16:29.126183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:29.126191Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:29.126192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.126193Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:29.126195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.126211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:29.126226Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:29.126233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:29.126267Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:29.126277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.126280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.126254Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2716
2025-10-02T08:16:29.126281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:29.126289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.126296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:29.126303Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535349966178528:2404]
2025-10-02T08:16:29.126314Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:29.126328Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:29.126340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.126407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.126414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.126426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.126458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2717 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0
2025-10-02T08:16:29.126772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7160b08f-8cd037c7-3095582a-87fcd560_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:29.129172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0] Write session: try to update token
2025-10-02T08:16:29.129186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:29.141895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId: src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:29.142213Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:29.142225Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:29.142227Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:29.142234Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535349966178528:2404]
2025-10-02T08:16:29.142237Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535349966178528:2404]
2025-10-02T08:16:29.142269Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:29.142272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:29.142272Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:29.142277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.142278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:29.142393Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:29.144277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:29.199184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535349966178567:10248]
2025-10-02T08:16:29.199293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2716, pipe: [1:7556535349966178567:10248]
2025-10-02T08:16:29.268011Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:29.268309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.268320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.268357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966178567:10248], now have 1 active actors on pipe
2025-10-02T08:16:29.268484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535349966178567:10248]
2025-10-02T08:16:29.268505Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:29.268507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:29.268509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:29.268558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2717 reason: error at write: Disconnected sessionId: src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0
2025-10-02T08:16:29.268564Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:29.268703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2717 sessionId: src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0 is DEAD
2025-10-02T08:16:29.268895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:29.268907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0] Write session will restart in 0.009286s
2025-10-02T08:16:29.268931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0] Write session: Do CDS request
2025-10-02T08:16:29.268937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:29.279252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.279289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:29.279301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2718
2025-10-02T08:16:29.279435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.279463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:29.279470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:29.279473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:29.279816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2718 sessionId:  describe result for acl check
2025-10-02T08:16:29.279840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:29.279841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:29.279841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:29.279845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535349966179182:2418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:29.280188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535349966179182:2418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:29.282143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535349966179182:2418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:29.283758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:29.284715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:29.284852Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:29.284861Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:29.284870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:29.284953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:29.284980Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535349966179348:2424]
2025-10-02T08:16:29.285013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535349966179182:2418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:29.285021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535349966179182:2418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:29.285023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535349966179182:2418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:29.285029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:29.285480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:29.285635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:29.285674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:29.285895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:29.285929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.285933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.285934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.285935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.285935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.285938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.285943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.285945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.285947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.285949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.285953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.285959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.285964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.285973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.285977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.285986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.285992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.285994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.285997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.285999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.286010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:29.293155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:29.294462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:29.294476Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:29.294478Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:29.294482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:29.294487Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2717 [1:7556535349966179348:2424]
2025-10-02T08:16:29.294496Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:29.294509Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:29.294510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.294512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.294513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.294523Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:29.294530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:29.294534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:29.294571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.294576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.294578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:29.294580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:29.294626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:29.294633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.294644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.294657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:29.294673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966179353:2418], now have 1 active actors on pipe
2025-10-02T08:16:29.294680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535349966179342:2424]
2025-10-02T08:16:29.294682Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535349966179342:2424]
2025-10-02T08:16:29.294686Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:29.294691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535350425442396:2378], now have 1 active actors on pipe
2025-10-02T08:16:29.294698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:29.294699Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:29.294702Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:29.294705Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:29.294707Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:29.294706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2717
2025-10-02T08:16:29.294724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535349966179342:2424]
2025-10-02T08:16:29.294730Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:29.294732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:29.294735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.294737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.294764Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e8c3104-26955312-3cf2716a-72310033_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:29.294771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.294774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.294775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:29.294781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.294787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:29.294802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.294831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.294777Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2717
2025-10-02T08:16:29.294836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.294847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.294878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2718 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e8c3104-26955312-3cf2716a-72310033_0
2025-10-02T08:16:29.295215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0e31aa7-d8355307-a36eea07-f2528b9b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e8c3104-26955312-3cf2716a-72310033_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:29.297783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e8c3104-26955312-3cf2716a-72310033_0] Write session: try to update token
2025-10-02T08:16:29.297802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e8c3104-26955312-3cf2716a-72310033_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:29.309801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2718 sessionId: src_id|8e8c3104-26955312-3cf2716a-72310033_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:29.310807Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:29.310819Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:29.310821Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:29.310828Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535349966179342:2424]
2025-10-02T08:16:29.310831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535349966179342:2424]
2025-10-02T08:16:29.310862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:29.310870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.310871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:29.310872Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:29.310877Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:29.310991Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:29.311916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:29.368652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535349966179379:10248]
2025-10-02T08:16:29.368781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2717, pipe: [1:7556535349966179379:10248]
2025-10-02T08:16:29.435352Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:29.435929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.435942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.435979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966179379:10248], now have 1 active actors on pipe
2025-10-02T08:16:29.436079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:29.436086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:29.436136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2718 reason: error at write: Disconnected sessionId: src_id|8e8c3104-26955312-3cf2716a-72310033_0
2025-10-02T08:16:29.436177Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:29.436205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:29.436292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2718 sessionId: src_id|8e8c3104-26955312-3cf2716a-72310033_0 is DEAD
2025-10-02T08:16:29.436406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e8c3104-26955312-3cf2716a-72310033_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:29.436414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e8c3104-26955312-3cf2716a-72310033_0] Write session will restart in 0.009216s
2025-10-02T08:16:29.436431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e8c3104-26955312-3cf2716a-72310033_0] Write session: Do CDS request
2025-10-02T08:16:29.436436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e8c3104-26955312-3cf2716a-72310033_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:29.436438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535349966179379:10248]
2025-10-02T08:16:29.446174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e8c3104-26955312-3cf2716a-72310033_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.446276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:29.446289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2719
2025-10-02T08:16:29.446392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.446420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:29.446431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:29.446434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:29.446801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2719 sessionId:  describe result for acl check
2025-10-02T08:16:29.446828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:29.446832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:29.446833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:29.446836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535349966179951:2443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:29.447273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535349966179951:2443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:29.449565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535349966179951:2443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:29.451799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:29.452712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:29.452857Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:29.452865Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:29.452874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:29.452907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:29.452941Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535349966180162:2446]
2025-10-02T08:16:29.453043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535349966179951:2443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:29.453053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535349966179951:2443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:29.453056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535349966179951:2443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:29.453061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:29.453466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:29.453616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:29.453653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:29.453936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:29.453977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.453982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.453983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.453984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.453985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.453989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.454000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.454004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.454008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.454011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.454021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.454028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.454037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.454043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.454050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.454055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.454062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.454065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.454072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.454075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.454084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:29.461692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:29.463167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:29.463181Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:29.463184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:29.463187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:29.463192Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2718 [1:7556535349966180162:2446]
2025-10-02T08:16:29.463200Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:29.463212Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:29.463218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.463220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.463222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.463233Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:29.463236Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:29.463246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:29.463292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.463297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.463299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:29.463301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:29.463346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:29.463351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.463358Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.463369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:29.463383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535349966180156:2446]
2025-10-02T08:16:29.463390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535349966180156:2446]
2025-10-02T08:16:29.463394Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:29.463403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:29.463407Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:29.463410Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:29.463411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2718
2025-10-02T08:16:29.463411Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:29.463413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:29.463420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966180167:2443], now have 1 active actors on pipe
2025-10-02T08:16:29.463423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535350425442403:2378], now have 1 active actors on pipe
2025-10-02T08:16:29.463444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535349966180156:2446]
2025-10-02T08:16:29.463447Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:29.463453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.463455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:29.463457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.463537Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2718
2025-10-02T08:16:29.463762Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:29.463774Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.463777Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.463778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:29.463785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.463791Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:29.463813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.463840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.463846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.463855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.463882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2719 partition: 0 MaxSeqNo: 17 sessionId: src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0
2025-10-02T08:16:29.464156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e8c3104-26955312-3cf2716a-72310033_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:29.466525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0] Write session: try to update token
2025-10-02T08:16:29.466537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:29.478085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2719 sessionId: src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:29.480351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:29.480998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.481015Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.481030Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:29.481036Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:29.481037Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:29.481043Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535349966180156:2446]
2025-10-02T08:16:29.481045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535349966180156:2446]
2025-10-02T08:16:29.481077Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:29.481080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:29.481085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.481085Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:29.481086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:29.481201Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:29.536748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535349966180193:10248]
2025-10-02T08:16:29.536858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2718, pipe: [1:7556535349966180193:10248]
2025-10-02T08:16:29.613992Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:29.614354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:29.614381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:29.614395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966180193:10248], now have 1 active actors on pipe
2025-10-02T08:16:29.614466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:29.614475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:29.614493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2719 reason: error at write: Disconnected sessionId: src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0
2025-10-02T08:16:29.614573Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:29.614619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2719 sessionId: src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0 is DEAD
2025-10-02T08:16:29.614748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:29.614758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0] Write session will restart in 0.009145s
2025-10-02T08:16:29.614760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535349966180193:10248]
2025-10-02T08:16:29.614779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0] Write session: Do CDS request
2025-10-02T08:16:29.614783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:29.625213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.625242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:29.625254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2720
2025-10-02T08:16:29.625406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.625436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:29.625444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:29.625448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:29.625751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2720 sessionId:  describe result for acl check
2025-10-02T08:16:29.625780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:29.625781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:29.625782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:29.625786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535349966180836:2478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:29.626222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535349966180836:2478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:29.628416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535349966180836:2478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:29.630036Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:29.630286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:29.630451Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:29.630459Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:29.630465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:29.630495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:29.630519Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535349966180983:2457]
2025-10-02T08:16:29.630868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535349966180836:2478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:29.630880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535349966180836:2478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:29.630883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535349966180836:2478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:29.630889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:29.631039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:29.631190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:29.631217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:29.631407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:29.631433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.631437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.631438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.631438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.631439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.631442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.631448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.631450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.631452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.631454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.631457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.631461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.631464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.631467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.631469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.631472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.631474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.631477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.631479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.631482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.631493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:29.638989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:29.640487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:29.640499Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:29.640501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:29.640504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:29.640508Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2719 [1:7556535349966180983:2457]
2025-10-02T08:16:29.640515Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:29.640525Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:29.640527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.640528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.640529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.640539Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:29.640542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:29.640547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:29.640579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.640585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.640587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:29.640589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:29.640630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:29.640636Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.640642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.640648Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:29.640663Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535349966180977:2457]
2025-10-02T08:16:29.640669Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535349966180977:2457]
2025-10-02T08:16:29.640675Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:29.640687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966180988:2478], now have 1 active actors on pipe
2025-10-02T08:16:29.640691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2719
2025-10-02T08:16:29.640697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:29.640698Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:29.640700Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:29.640708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:29.640715Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:29.640720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535350425442411:2378], now have 1 active actors on pipe
2025-10-02T08:16:29.640739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.640745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.640755Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535349966180977:2457]
2025-10-02T08:16:29.640764Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:29.640772Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:29.640792Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7249741a-2adfb82-e6fd5297-396ac78b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:29.640764Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2719
2025-10-02T08:16:29.640827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.640834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.640836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:29.640844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.640856Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:29.640879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.640921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.640927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.640937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.640968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2720 partition: 0 MaxSeqNo: 17 sessionId: src_id|7249741a-2adfb82-e6fd5297-396ac78b_0
2025-10-02T08:16:29.641394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73783ff-f8761e04-ac74a3cb-c7bc42db_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7249741a-2adfb82-e6fd5297-396ac78b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:29.643646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7249741a-2adfb82-e6fd5297-396ac78b_0] Write session: try to update token
2025-10-02T08:16:29.643656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7249741a-2adfb82-e6fd5297-396ac78b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:29.655706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2720 sessionId: src_id|7249741a-2adfb82-e6fd5297-396ac78b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:29.657474Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:29.657494Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:29.657497Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:29.657507Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535349966180977:2457]
2025-10-02T08:16:29.657511Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535349966180977:2457]
2025-10-02T08:16:29.657555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:29.657568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.657570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:29.657569Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:29.657576Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:29.657747Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:29.658792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:29.714780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535349966181014:10248]
2025-10-02T08:16:29.714864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2719, pipe: [1:7556535349966181014:10248]
2025-10-02T08:16:29.789206Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:29.789533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.789542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.789571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966181014:10248], now have 1 active actors on pipe
2025-10-02T08:16:29.789665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:29.789673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:29.789730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2720 reason: error at write: Disconnected sessionId: src_id|7249741a-2adfb82-e6fd5297-396ac78b_0
2025-10-02T08:16:29.789736Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:29.789793Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:29.789870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2720 sessionId: src_id|7249741a-2adfb82-e6fd5297-396ac78b_0 is DEAD
2025-10-02T08:16:29.790032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7249741a-2adfb82-e6fd5297-396ac78b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:29.790042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7249741a-2adfb82-e6fd5297-396ac78b_0] Write session will restart in 0.007757s
2025-10-02T08:16:29.790028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535349966181014:10248]
2025-10-02T08:16:29.790063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7249741a-2adfb82-e6fd5297-396ac78b_0] Write session: Do CDS request
2025-10-02T08:16:29.790069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7249741a-2adfb82-e6fd5297-396ac78b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:29.799153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7249741a-2adfb82-e6fd5297-396ac78b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.799246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:29.799259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2721
2025-10-02T08:16:29.799361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.799391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:29.799395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:29.799397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:29.799698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2721 sessionId:  describe result for acl check
2025-10-02T08:16:29.799721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:29.799726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:29.799727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:29.799730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535349966181489:2482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:29.800135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535349966181489:2482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:29.802489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535349966181489:2482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:29.805120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535349966181489:2482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:29.805133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535349966181489:2482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:29.805136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535349966181489:2482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:29.805142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:29.807637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:29.809047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:29.809166Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:29.809178Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:29.809186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:29.809224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:29.809256Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535349966181810:2468]
2025-10-02T08:16:29.809825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:29.810003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:29.810032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:29.810321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:29.810366Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.810370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.810372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.810372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.810373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.810378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.810386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.810390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.810394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.810397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.810401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.810405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.810408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.810410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.810412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.810415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.810417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.810419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.810422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.810425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.810435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:29.817662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:29.818884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:29.818896Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:29.818897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:29.818900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:29.818904Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2720 [1:7556535349966181810:2468]
2025-10-02T08:16:29.818911Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:29.818923Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:29.818924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.818926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.818927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.818938Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:29.818941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:29.818947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:29.818988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.818993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.818995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:29.818997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:29.819039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:29.819045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.819053Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.819063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:29.819079Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535349966181804:2468]
2025-10-02T08:16:29.819085Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535349966181804:2468]
2025-10-02T08:16:29.819091Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:29.819107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:29.819112Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:29.819114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:29.819121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2720
2025-10-02T08:16:29.819121Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:29.819124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:29.819132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966181763:2482], now have 1 active actors on pipe
2025-10-02T08:16:29.819157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535350425442418:2378], now have 1 active actors on pipe
2025-10-02T08:16:29.819164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.819168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.819180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535349966181804:2468]
2025-10-02T08:16:29.819190Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:29.819209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:29.819213Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd8e4585-98b39061-9cec8111-82209212_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:29.819220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.819222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.819224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:29.819205Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2720
2025-10-02T08:16:29.819231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.819243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:29.819260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.819323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.819330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.819343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.819377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2721 partition: 0 MaxSeqNo: 17 sessionId: src_id|cd8e4585-98b39061-9cec8111-82209212_0
2025-10-02T08:16:29.819649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7249741a-2adfb82-e6fd5297-396ac78b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cd8e4585-98b39061-9cec8111-82209212_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:29.821856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8e4585-98b39061-9cec8111-82209212_0] Write session: try to update token
2025-10-02T08:16:29.821868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8e4585-98b39061-9cec8111-82209212_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:29.832983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2721 sessionId: src_id|cd8e4585-98b39061-9cec8111-82209212_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:29.835319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:29.835516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.835531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.835546Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:29.835548Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:29.835550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:29.835555Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535349966181804:2468]
2025-10-02T08:16:29.835558Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535349966181804:2468]
2025-10-02T08:16:29.835593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:29.835601Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.835601Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:29.835602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:29.835606Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:29.835712Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:29.890355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535349966181837:10248]
2025-10-02T08:16:29.890456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2720, pipe: [1:7556535349966181837:10248]
2025-10-02T08:16:29.957598Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:29.957876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:29.957907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:29.957911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966181837:10248], now have 1 active actors on pipe
2025-10-02T08:16:29.957993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:29.958000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:29.958018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2721 reason: error at write: Disconnected sessionId: src_id|cd8e4585-98b39061-9cec8111-82209212_0
2025-10-02T08:16:29.958113Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:29.958195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2721 sessionId: src_id|cd8e4585-98b39061-9cec8111-82209212_0 is DEAD
2025-10-02T08:16:29.958293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8e4585-98b39061-9cec8111-82209212_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:29.958299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8e4585-98b39061-9cec8111-82209212_0] Write session will restart in 0.007950s
2025-10-02T08:16:29.958316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8e4585-98b39061-9cec8111-82209212_0] Write session: Do CDS request
2025-10-02T08:16:29.958320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8e4585-98b39061-9cec8111-82209212_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:29.958337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535349966181837:10248]
2025-10-02T08:16:29.967206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8e4585-98b39061-9cec8111-82209212_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.967317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:29.967333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2722
2025-10-02T08:16:29.967451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:29.967481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:29.967490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:29.967493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:29.967953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2722 sessionId:  describe result for acl check
2025-10-02T08:16:29.967997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:29.968003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:29.968005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:29.968009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535349966182345:2511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:29.968604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535349966182345:2511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:29.970689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535349966182345:2511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:29.973678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535349966182345:2511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:29.973690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535349966182345:2511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:29.973692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535349966182345:2511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:29.973697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:29.974848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:29.975139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:29.975324Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:29.975331Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:29.975338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:29.975374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:29.975399Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535349966182645:2517]
2025-10-02T08:16:29.975793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:29.975917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:29.975943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:29.976157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:29.976187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.976192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.976192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.976193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.976194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.976197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.976203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.976205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.976207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.976209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.976212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.976218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:29.976226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.976229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:29.976241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.976248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:29.976250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.976252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.976255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.976257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.976267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:29.983853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:29.985506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:29.985519Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:29.985521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:29.985523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:29.985527Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2721 [1:7556535349966182645:2517]
2025-10-02T08:16:29.985535Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:29.985547Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:29.985549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.985551Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.985552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.985564Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:29.985572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:29.985576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:29.985614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.985620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.985622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:29.985623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:29.985667Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:29.985673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:29.985681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:29.985692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:29.985709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535349966182634:2511], now have 1 active actors on pipe
2025-10-02T08:16:29.985717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535349966182639:2517]
2025-10-02T08:16:29.985718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535349966182639:2517]
2025-10-02T08:16:29.985723Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:29.985729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535350425442427:2378], now have 1 active actors on pipe
2025-10-02T08:16:29.985731Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:29.985733Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:29.985737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:29.985744Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:29.985749Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:29.985772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535349966182639:2517]
2025-10-02T08:16:29.985784Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:29.985820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2721
2025-10-02T08:16:29.985836Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:29.985828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2721
2025-10-02T08:16:29.985862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.985868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.985886Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bf6321b-ae3213e0-260905ff-61222a75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:29.985893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:29.985895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:29.985896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:29.985902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:29.985908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:29.985928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.985955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:29.985959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:29.985967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:29.985992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2722 partition: 0 MaxSeqNo: 17 sessionId: src_id|8bf6321b-ae3213e0-260905ff-61222a75_0
2025-10-02T08:16:29.986291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8e4585-98b39061-9cec8111-82209212_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8bf6321b-ae3213e0-260905ff-61222a75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:29.988712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf6321b-ae3213e0-260905ff-61222a75_0] Write session: try to update token
2025-10-02T08:16:29.988726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf6321b-ae3213e0-260905ff-61222a75_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:30.000679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2722 sessionId: src_id|8bf6321b-ae3213e0-260905ff-61222a75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:30.002951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:30.003436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.003457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.003472Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:30.003474Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:30.003476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:30.003480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535349966182639:2517]
2025-10-02T08:16:30.003483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535349966182639:2517]
2025-10-02T08:16:30.003519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:30.003520Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:30.003525Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:30.003527Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.003528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:30.003643Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:30.058311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535354261150001:10248]
2025-10-02T08:16:30.058413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2721, pipe: [1:7556535354261150001:10248]
2025-10-02T08:16:30.130316Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:30.131002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:30.131038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261150001:10248], now have 1 active actors on pipe
2025-10-02T08:16:30.131044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:30.131168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:30.131177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:30.131195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2722 reason: error at write: Disconnected sessionId: src_id|8bf6321b-ae3213e0-260905ff-61222a75_0
2025-10-02T08:16:30.131303Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:30.131332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2722 sessionId: src_id|8bf6321b-ae3213e0-260905ff-61222a75_0 is DEAD
2025-10-02T08:16:30.131458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf6321b-ae3213e0-260905ff-61222a75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:30.131466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf6321b-ae3213e0-260905ff-61222a75_0] Write session will restart in 0.008608s
2025-10-02T08:16:30.131482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf6321b-ae3213e0-260905ff-61222a75_0] Write session: Do CDS request
2025-10-02T08:16:30.131476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535354261150001:10248]
2025-10-02T08:16:30.131487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf6321b-ae3213e0-260905ff-61222a75_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:30.141212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf6321b-ae3213e0-260905ff-61222a75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.141295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:30.141308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2723
2025-10-02T08:16:30.141405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.141430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:30.141439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:30.141442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:30.141807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2723 sessionId:  describe result for acl check
2025-10-02T08:16:30.141836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:30.141842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:30.141843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:30.141847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535354261150603:2627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:30.142302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535354261150603:2627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:30.144149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535354261150603:2627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:30.146816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535354261150603:2627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:30.146827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535354261150603:2627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:30.146831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535354261150603:2627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:30.146837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:30.147569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:30.147886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:30.148080Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:30.148087Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:30.148096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:30.148143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:30.148173Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535354261150800:2608]
2025-10-02T08:16:30.148706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:30.148875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:30.148909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:30.149165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:30.149205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.149211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.149211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.149212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.149212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.149216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.149222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.149225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.149227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.149229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.149232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.149236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.149240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.149243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.149245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.149248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.149250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.149253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.149256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.149259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.149270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:30.157038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:30.158387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:30.158403Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:30.158406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:30.158409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:30.158416Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2722 [1:7556535354261150800:2608]
2025-10-02T08:16:30.158427Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:30.158442Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:30.158449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.158452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.158454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.158468Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:30.158477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:30.158483Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:30.158530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.158535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.158538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:30.158539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:30.158658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2722
2025-10-02T08:16:30.158693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2722
2025-10-02T08:16:30.158708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:30.158718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.158729Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.158741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:30.158761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261150791:2627], now have 1 active actors on pipe
2025-10-02T08:16:30.158768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535354720409764:2378], now have 1 active actors on pipe
2025-10-02T08:16:30.158773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.158781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.158801Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535354261150794:2608]
2025-10-02T08:16:30.158809Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535354261150794:2608]
2025-10-02T08:16:30.158822Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:30.158833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:30.158835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:30.158838Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:30.158849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:30.158856Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:30.158870Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:30.158879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.158884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.158886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:30.158893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.158905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:30.158940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535354261150794:2608]
2025-10-02T08:16:30.158950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:30.158957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:30.158961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.159034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.159041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.159053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.159088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2723 partition: 0 MaxSeqNo: 17 sessionId: src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0
2025-10-02T08:16:30.159338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf6321b-ae3213e0-260905ff-61222a75_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:30.161872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0] Write session: try to update token
2025-10-02T08:16:30.161885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:30.174703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2723 sessionId: src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:30.175525Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:30.175537Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:30.175539Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:30.175547Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535354261150794:2608]
2025-10-02T08:16:30.175551Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535354261150794:2608]
2025-10-02T08:16:30.175589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:30.175597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.175599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:30.175600Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:30.175605Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:30.175723Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:30.176964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:30.231857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535354261150825:10248]
2025-10-02T08:16:30.231950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2722, pipe: [1:7556535354261150825:10248]
2025-10-02T08:16:30.302568Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:30.302827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.302837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.302867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261150825:10248], now have 1 active actors on pipe
2025-10-02T08:16:30.303024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535354261150825:10248]
2025-10-02T08:16:30.303052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:30.303058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:30.303079Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:30.303068Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:30.303119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2723 reason: error at write: Disconnected sessionId: src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0
2025-10-02T08:16:30.303295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2723 sessionId: src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0 is DEAD
2025-10-02T08:16:30.303411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:30.303419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0] Write session will restart in 0.006056s
2025-10-02T08:16:30.303440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0] Write session: Do CDS request
2025-10-02T08:16:30.303444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:30.310256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.310292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:30.310303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2724
2025-10-02T08:16:30.310435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.310464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:30.310472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:30.310475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:30.310777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2724 sessionId:  describe result for acl check
2025-10-02T08:16:30.310806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:30.310810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:30.310811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:30.310814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535354261151223:2675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:30.311167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535354261151223:2675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:30.313630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535354261151223:2675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:30.316002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535354261151223:2675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:30.316013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535354261151223:2675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:30.316015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535354261151223:2675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:30.316021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:30.319056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:30.320196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:30.320370Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:30.320377Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:30.320383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:30.320415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:30.320440Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535354261151624:2684]
2025-10-02T08:16:30.320859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:30.320994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:30.321026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:30.321231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:30.321258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.321263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.321263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.321264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.321265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.321268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.321275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.321277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.321279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.321281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.321284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.321288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.321293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.321295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.321298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.321301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.321303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.321305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.321308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.321314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.321326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:30.329513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:30.330966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:30.330985Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:30.330987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:30.330992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:30.330998Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2723 [1:7556535354261151624:2684]
2025-10-02T08:16:30.331009Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:30.331025Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:30.331028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.331038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.331040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.331055Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:30.331066Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:30.331072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:30.331133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.331140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.331143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:30.331145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:30.331213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:30.331220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.331232Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.331244Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:30.331262Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535354261151618:2684]
2025-10-02T08:16:30.331267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535354261151618:2684]
2025-10-02T08:16:30.331273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2723
2025-10-02T08:16:30.331274Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:30.331287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:30.331288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261151527:2675], now have 1 active actors on pipe
2025-10-02T08:16:30.331295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:30.331297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:30.331308Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:30.331312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:30.331317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535354720409773:2378], now have 1 active actors on pipe
2025-10-02T08:16:30.331322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.331325Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.331362Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535354261151618:2684]
2025-10-02T08:16:30.331370Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:30.331358Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2723
2025-10-02T08:16:30.331386Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:30.331388Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:30.331397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.331400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.331402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:30.331411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.331423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:30.331463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.331558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.331566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.331581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.331623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2724 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0
2025-10-02T08:16:30.331967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceebed3-46d0c89b-29519365-7ceffd1e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:30.334305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0] Write session: try to update token
2025-10-02T08:16:30.334317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:30.346451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2724 sessionId: src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:30.348737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:30.348915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.348929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.348944Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:30.348950Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:30.348952Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:30.348957Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535354261151618:2684]
2025-10-02T08:16:30.348959Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535354261151618:2684]
2025-10-02T08:16:30.348996Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:30.348995Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:30.348999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:30.349004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.349005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:30.349113Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:30.403399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535354261151650:10248]
2025-10-02T08:16:30.403540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2723, pipe: [1:7556535354261151650:10248]
2025-10-02T08:16:30.475215Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:30.475859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:30.475895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:30.475907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261151650:10248], now have 1 active actors on pipe
2025-10-02T08:16:30.476087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:30.476094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:30.476117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2724 reason: error at write: Disconnected sessionId: src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0
2025-10-02T08:16:30.476154Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:30.476261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2724 sessionId: src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0 is DEAD
2025-10-02T08:16:30.476328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535354261151650:10248]
2025-10-02T08:16:30.476436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:30.476441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0] Write session will restart in 0.006705s
2025-10-02T08:16:30.476458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0] Write session: Do CDS request
2025-10-02T08:16:30.476465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:30.484186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.484257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:30.484270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2725
2025-10-02T08:16:30.484416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.484444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:30.484449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:30.484454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:30.484831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2725 sessionId:  describe result for acl check
2025-10-02T08:16:30.484857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:30.484858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:30.484859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:30.484863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535354261152089:2690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:30.485244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535354261152089:2690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:30.487420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535354261152089:2690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:30.489639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535354261152089:2690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:30.489652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535354261152089:2690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:30.489654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535354261152089:2690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:30.489662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:30.492392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:30.493536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:30.493645Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:30.493654Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:30.493663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:30.493694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:30.493720Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535354261152450:2687]
2025-10-02T08:16:30.494115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:30.494241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:30.494271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:30.494470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:30.494499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.494503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.494503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.494504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.494504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.494507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.494513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.494515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.494517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.494519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.494522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.494527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.494532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.494535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.494537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.494542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.494546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.494553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.494556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.494561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.494575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:30.501840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:30.503616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:30.503630Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:30.503633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:30.503637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:30.503646Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2724 [1:7556535354261152450:2687]
2025-10-02T08:16:30.503656Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:30.503671Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:30.503675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.503679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.503680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.503694Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:30.503698Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:30.503706Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:30.503761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.503770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.503775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:30.503778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:30.503836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:30.503843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.503854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.503868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:30.503888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261152375:2690], now have 1 active actors on pipe
2025-10-02T08:16:30.503891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2724
2025-10-02T08:16:30.503898Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535354261152444:2687]
2025-10-02T08:16:30.503900Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535354261152444:2687]
2025-10-02T08:16:30.503906Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:30.503913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535354720409780:2378], now have 1 active actors on pipe
2025-10-02T08:16:30.503916Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:30.503919Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:30.503924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:30.503936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:30.503943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:30.503951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.503956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.503991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535354261152444:2687]
2025-10-02T08:16:30.503999Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:30.504005Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:30.504012Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:30.503988Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2724
2025-10-02T08:16:30.504017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.504039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.504043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:30.504051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.504063Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:30.504101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.504138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.504145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.504157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.504191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2725 partition: 0 MaxSeqNo: 17 sessionId: src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0
2025-10-02T08:16:30.504479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e1a6c64-77a6d0b6-be310fc3-3e29db23_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:30.506889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0] Write session: try to update token
2025-10-02T08:16:30.506902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:30.519024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2725 sessionId: src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:30.521133Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:30.521150Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:30.521152Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:30.521159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535354261152444:2687]
2025-10-02T08:16:30.521162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535354261152444:2687]
2025-10-02T08:16:30.521194Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:30.521205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.521206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:30.521217Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:30.521223Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:30.521321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:30.521332Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:30.576465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535354261152478:10248]
2025-10-02T08:16:30.576566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2724, pipe: [1:7556535354261152478:10248]
2025-10-02T08:16:30.646944Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:30.647368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.647378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.647409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261152478:10248], now have 1 active actors on pipe
2025-10-02T08:16:30.647524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:30.647529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:30.647567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2725 reason: error at write: Disconnected sessionId: src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0
2025-10-02T08:16:30.647604Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:30.647644Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:30.647713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2725 sessionId: src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0 is DEAD
2025-10-02T08:16:30.647836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535354261152478:10248]
2025-10-02T08:16:30.647887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:30.647897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0] Write session will restart in 0.007576s
2025-10-02T08:16:30.647918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0] Write session: Do CDS request
2025-10-02T08:16:30.647923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:30.656180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.656313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:30.656324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2726
2025-10-02T08:16:30.656433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.656461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:30.656468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:30.656471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:30.656789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2726 sessionId:  describe result for acl check
2025-10-02T08:16:30.656823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:30.656824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:30.656826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:30.656829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535354261152931:2718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:30.657317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535354261152931:2718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:30.659524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535354261152931:2718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:30.662045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535354261152931:2718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:30.662056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535354261152931:2718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:30.662058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535354261152931:2718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:30.662063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:30.664369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:30.665734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:30.665918Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:30.665925Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:30.665932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:30.665987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:30.666011Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535354261153292:2715]
2025-10-02T08:16:30.666419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:30.666531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:30.666557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:30.666746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:30.666773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.666777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.666778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.666779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.666779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.666783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.666789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.666791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.666793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.666795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.666798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.666803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.666808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.666810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.666812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.666815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.666817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.666820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.666822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.666824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.666834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:30.674226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:30.675565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:30.675581Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:30.675583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:30.675585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:30.675590Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2725 [1:7556535354261153292:2715]
2025-10-02T08:16:30.675597Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:30.675609Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:30.675615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.675617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.675618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.675630Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:30.675633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:30.675637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:30.675681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.675687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.675689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:30.675690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:30.675737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:30.675742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.675753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.675763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:30.675776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261153229:2718], now have 1 active actors on pipe
2025-10-02T08:16:30.675784Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535354261153280:2715]
2025-10-02T08:16:30.675789Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535354261153280:2715]
2025-10-02T08:16:30.675790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2725
2025-10-02T08:16:30.675796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:30.675802Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535354720409787:2378], now have 1 active actors on pipe
2025-10-02T08:16:30.675806Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:30.675807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:30.675808Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:30.675815Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:30.675816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:30.675820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.675826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.675852Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535354261153280:2715]
2025-10-02T08:16:30.675862Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:30.675874Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1820153e-f93bc91c-bf06cb2-965425f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:30.675876Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:30.675881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.675884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.675885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:30.675892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.675901Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:30.675957Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2725
2025-10-02T08:16:30.676169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.676219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.676224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.676233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.676262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2726 partition: 0 MaxSeqNo: 17 sessionId: src_id|1820153e-f93bc91c-bf06cb2-965425f2_0
2025-10-02T08:16:30.676535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843fe2a2-ef9aa433-34fa0b43-7dd5ab6b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1820153e-f93bc91c-bf06cb2-965425f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:30.678862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1820153e-f93bc91c-bf06cb2-965425f2_0] Write session: try to update token
2025-10-02T08:16:30.678875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1820153e-f93bc91c-bf06cb2-965425f2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:30.690128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2726 sessionId: src_id|1820153e-f93bc91c-bf06cb2-965425f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:30.692325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:30.693149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.693168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.693183Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:30.693185Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:30.693186Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:30.693191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535354261153280:2715]
2025-10-02T08:16:30.693195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535354261153280:2715]
2025-10-02T08:16:30.693229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:30.693237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.693238Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:30.693243Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:30.693247Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:30.693348Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:30.747981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535354261153322:10248]
2025-10-02T08:16:30.748148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2725, pipe: [1:7556535354261153322:10248]
2025-10-02T08:16:30.818834Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:30.819279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:30.819315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261153322:10248], now have 1 active actors on pipe
2025-10-02T08:16:30.819348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:30.819449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:30.819461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:30.819484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2726 reason: error at write: Disconnected sessionId: src_id|1820153e-f93bc91c-bf06cb2-965425f2_0
2025-10-02T08:16:30.819562Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:30.819609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2726 sessionId: src_id|1820153e-f93bc91c-bf06cb2-965425f2_0 is DEAD
2025-10-02T08:16:30.819690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535354261153322:10248]
2025-10-02T08:16:30.819740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1820153e-f93bc91c-bf06cb2-965425f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:30.819747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1820153e-f93bc91c-bf06cb2-965425f2_0] Write session will restart in 0.007162s
2025-10-02T08:16:30.819763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1820153e-f93bc91c-bf06cb2-965425f2_0] Write session: Do CDS request
2025-10-02T08:16:30.819767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1820153e-f93bc91c-bf06cb2-965425f2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:30.824088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:30.824854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:30.825023Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:30.825032Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:30.825042Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:30.825090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:30.825178Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535354261153379:2736]
2025-10-02T08:16:30.825773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:30.825973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:30.826018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:30.826306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:30.826369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.826376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.826377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.826378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.826380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.826385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.826394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.826402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.826406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.826413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.826419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.826429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.826439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.826448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.826456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.826461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.826472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.826477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.826482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.826491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.826509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:30.828292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1820153e-f93bc91c-bf06cb2-965425f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.828387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:30.828401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2727
2025-10-02T08:16:30.828522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.828554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:30.828564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:30.828567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:30.828923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2727 sessionId:  describe result for acl check
2025-10-02T08:16:30.828956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:30.828961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:30.828962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:30.828966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535354261153396:2750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:30.829323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535354261153396:2750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:30.831288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535354261153396:2750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:30.833727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535354261153396:2750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:30.833737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535354261153396:2750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:30.833739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535354261153396:2750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:30.833744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:30.834302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:30.835858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:30.835870Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:30.835872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:30.835874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:30.835878Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2726 [1:7556535354261153379:2736]
2025-10-02T08:16:30.835885Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:30.835896Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:30.835902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.835905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.835906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.835918Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:30.835924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:30.835929Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:30.835969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.835973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.835976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:30.835977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:30.836020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:30.836025Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.836047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.836058Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:30.836073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535354261153373:2736]
2025-10-02T08:16:30.836080Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535354261153373:2736]
2025-10-02T08:16:30.836085Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:30.836093Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:30.836097Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:30.836099Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:30.836104Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:30.836104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2726
2025-10-02T08:16:30.836106Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:30.836112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261153427:2750], now have 1 active actors on pipe
2025-10-02T08:16:30.836135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535354720409794:2378], now have 1 active actors on pipe
2025-10-02T08:16:30.836141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.836143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.836154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535354261153373:2736]
2025-10-02T08:16:30.836159Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:30.836174Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:30.836183Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:30.836183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.836185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.836186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:30.836192Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.836161Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2726
2025-10-02T08:16:30.836198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:30.836213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.836243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.836252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.836270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.836299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2727 partition: 0 MaxSeqNo: 17 sessionId: src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0
2025-10-02T08:16:30.836611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1820153e-f93bc91c-bf06cb2-965425f2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:30.838891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0] Write session: try to update token
2025-10-02T08:16:30.838901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:30.850655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2727 sessionId: src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:30.853220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:30.853441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.853461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.853481Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:30.853489Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:30.853490Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:30.853495Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535354261153373:2736]
2025-10-02T08:16:30.853503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535354261153373:2736]
2025-10-02T08:16:30.853541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:30.853551Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.853551Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:30.853556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:30.853556Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:30.853672Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:30.920020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535354261153446:10248]
2025-10-02T08:16:30.920152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2726, pipe: [1:7556535354261153446:10248]
2025-10-02T08:16:30.979840Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:30.980069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:30.980108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261153446:10248], now have 1 active actors on pipe
2025-10-02T08:16:30.980129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:30.980211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:30.980218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:30.980236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2727 reason: error at write: Disconnected sessionId: src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0
2025-10-02T08:16:30.980324Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:30.980368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2727 sessionId: src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0 is DEAD
2025-10-02T08:16:30.980480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:30.980486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0] Write session will restart in 0.008159s
2025-10-02T08:16:30.980503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0] Write session: Do CDS request
2025-10-02T08:16:30.980507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:30.980520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535354261153446:10248]
2025-10-02T08:16:30.984725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:30.985399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:30.985525Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:30.985531Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:30.985538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:30.985570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:30.985596Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535354261153506:2768]
2025-10-02T08:16:30.985990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:30.986152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:30.986182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:30.986368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:30.986395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.986399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.986399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.986400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.986401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.986404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.986410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.986412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.986414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.986415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.986419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.986424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:30.986427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.986430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:30.986432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.986436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:30.986438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.986441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.986443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.986445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.986455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:30.989179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.989322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:30.989330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2728
2025-10-02T08:16:30.989449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:30.989475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:30.989482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:30.989485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:30.989747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2728 sessionId:  describe result for acl check
2025-10-02T08:16:30.989772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:30.989778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:30.989780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:30.989784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535354261153534:2783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:30.990007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535354261153534:2783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:30.991709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535354261153534:2783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:30.994068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535354261153534:2783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:30.994078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535354261153534:2783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:30.994080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535354261153534:2783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:30.994085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:30.994191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:30.995511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:30.995524Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:30.995525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:30.995527Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:30.995532Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2727 [1:7556535354261153506:2768]
2025-10-02T08:16:30.995539Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:30.995550Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:30.995552Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.995554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.995555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.995566Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:30.995569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:30.995574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:30.995614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.995620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.995622Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:30.995623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:30.995666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:30.995673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:30.995685Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:30.995695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:30.995714Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535354261153500:2768]
2025-10-02T08:16:30.995719Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535354261153500:2768]
2025-10-02T08:16:30.995725Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:30.995736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:30.995740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2727
2025-10-02T08:16:30.995750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:30.995754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:30.995756Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:30.995757Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:30.995765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535354261153562:2783], now have 1 active actors on pipe
2025-10-02T08:16:30.995787Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535354261153500:2768]
2025-10-02T08:16:30.995801Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:30.995809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535354720409814:2378], now have 1 active actors on pipe
2025-10-02T08:16:30.995813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.995815Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:30.995816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.995820Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2727
2025-10-02T08:16:30.995848Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:30.995858Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:30.995861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:30.995863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:30.995871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:30.995878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:30.995899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.995931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:30.995937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:30.995952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:30.995979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2728 partition: 0 MaxSeqNo: 17 sessionId: src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0
2025-10-02T08:16:30.996246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ca65d0-46f47d76-3376b9e5-f5a49197_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:30.998679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0] Write session: try to update token
2025-10-02T08:16:30.998690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:31.010999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2728 sessionId: src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:31.013378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:31.013464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.013477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.014968Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:31.014982Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:31.014984Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:31.014988Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535354261153500:2768]
2025-10-02T08:16:31.014991Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535354261153500:2768]
2025-10-02T08:16:31.015023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:31.015031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:31.015039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.015041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:31.015041Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:31.015047Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:31.015155Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:31.031872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:31.080756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535358556120910:10248]
2025-10-02T08:16:31.080899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2727, pipe: [1:7556535358556120910:10248]
2025-10-02T08:16:31.141522Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:31.141839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.141849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.141981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.142033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.142086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.142149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.142189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.142195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.142258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.142314Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.142370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.142427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.142465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.142469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.142526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.142576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.142627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.142679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.142716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.142722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.142787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.142841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.142894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.142949Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.143060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.143067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.143124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.143174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.143227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.143290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.143332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.143337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.143394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.143445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.143499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.143553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.143593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.143599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.143658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.143709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.143769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.143832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.143934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.143941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.144000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.144062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.144114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.144166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.144207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.144212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.144268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.144328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.144383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.144438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.144481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.144486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.144545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:31.144605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:31.144658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:31.144713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:31.144750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:31.144755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:31.144794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556120910:10248], now have 1 active actors on pipe
2025-10-02T08:16:31.144965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:31.144973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:31.144995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2728 reason: error at write: Disconnected sessionId: src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0
2025-10-02T08:16:31.145032Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:31.145131Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:31.145144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2728 sessionId: src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0 is DEAD
2025-10-02T08:16:31.145257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:31.145266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0] Write session will restart in 0.009461s
2025-10-02T08:16:31.145283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0] Write session: Do CDS request
2025-10-02T08:16:31.145287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:31.145351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535358556120910:10248]
2025-10-02T08:16:31.149211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:31.150152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:31.150270Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:31.150277Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:31.150283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:31.150312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:31.150337Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535358556120972:2830]
2025-10-02T08:16:31.150733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:31.150876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:31.150900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:31.151088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:31.151116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.151117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.151118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.151119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.151119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.151122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.151129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.151131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.151134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.151136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.151140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.151144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.151148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.151151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.151153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.151156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.151159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.151161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.151163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.151166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.151176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:31.156258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.156341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:31.156356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2729
2025-10-02T08:16:31.156488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.156518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:31.156525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:31.156535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:31.156982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2729 sessionId:  describe result for acl check
2025-10-02T08:16:31.157015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:31.157021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:31.157023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:31.157028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535358556120988:2849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:31.157600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535358556120988:2849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:31.158863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:31.159128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535358556120988:2849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:31.160419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:31.160433Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:31.160435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:31.160439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:31.160445Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2728 [1:7556535358556120972:2830]
2025-10-02T08:16:31.160455Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:31.160468Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:31.160473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.160476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.160478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.160491Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:31.160499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:31.160505Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:31.160564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.160570Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.160573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:31.160575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:31.160633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:31.160643Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.160653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.160664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:31.160679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535359015377139:2378], now have 1 active actors on pipe
2025-10-02T08:16:31.160687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535358556120966:2830]
2025-10-02T08:16:31.160689Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535358556120966:2830]
2025-10-02T08:16:31.160693Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:31.160702Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:31.160713Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:31.160718Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:31.160719Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:31.160721Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:31.160691Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2728
2025-10-02T08:16:31.160740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535358556120966:2830]
2025-10-02T08:16:31.160744Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:31.160754Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:31.161441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535358556120988:2849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:31.161452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535358556120988:2849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:31.161454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535358556120988:2849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:31.161459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:31.161596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2728
2025-10-02T08:16:31.161601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121026:2849], now have 1 active actors on pipe
2025-10-02T08:16:31.161606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.161611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.161632Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45d79e9-62bd2675-aed35601-838a1087_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:31.161645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.161652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.161653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:31.161660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.161673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:31.161690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.161726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.161736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.161760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.161808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2729 partition: 0 MaxSeqNo: 17 sessionId: src_id|45d79e9-62bd2675-aed35601-838a1087_0
2025-10-02T08:16:31.162040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00a14b7-cd3f5123-962af84-34c35c3f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|45d79e9-62bd2675-aed35601-838a1087_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:31.164301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d79e9-62bd2675-aed35601-838a1087_0] Write session: try to update token
2025-10-02T08:16:31.164313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d79e9-62bd2675-aed35601-838a1087_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:31.176373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2729 sessionId: src_id|45d79e9-62bd2675-aed35601-838a1087_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:31.177570Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:31.177585Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:31.177587Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:31.177594Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535358556120966:2830]
2025-10-02T08:16:31.177597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535358556120966:2830]
2025-10-02T08:16:31.177630Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:31.177637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.177638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:31.177664Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:31.177671Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:31.177764Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:31.179108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:31.245627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535358556121035:10248]
2025-10-02T08:16:31.245756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2728, pipe: [1:7556535358556121035:10248]
2025-10-02T08:16:31.302923Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:31.303170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.303182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.303213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121035:10248], now have 1 active actors on pipe
2025-10-02T08:16:31.303383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535358556121035:10248]
2025-10-02T08:16:31.303401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:31.303416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:31.303417Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:31.303467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2729 reason: error at write: Disconnected sessionId: src_id|45d79e9-62bd2675-aed35601-838a1087_0
2025-10-02T08:16:31.303503Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:31.303625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2729 sessionId: src_id|45d79e9-62bd2675-aed35601-838a1087_0 is DEAD
2025-10-02T08:16:31.303781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d79e9-62bd2675-aed35601-838a1087_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:31.303788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d79e9-62bd2675-aed35601-838a1087_0] Write session will restart in 0.005592s
2025-10-02T08:16:31.303809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d79e9-62bd2675-aed35601-838a1087_0] Write session: Do CDS request
2025-10-02T08:16:31.303813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d79e9-62bd2675-aed35601-838a1087_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:31.308004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:31.308975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:31.309084Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:31.309093Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:31.309101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:31.309133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:31.309163Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535358556121095:2876]
2025-10-02T08:16:31.309552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:31.309728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:31.309754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:31.309946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:31.309973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.309977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.309978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.309978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.309979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.309982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.309991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.309993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.309995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.309997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.310000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.310004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.310009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.310011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.310014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.310016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.310018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.310020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.310023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.310025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.310035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:31.310199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d79e9-62bd2675-aed35601-838a1087_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.310268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:31.310277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2730
2025-10-02T08:16:31.310386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.310404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:31.310410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:31.310413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:31.310678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2730 sessionId:  describe result for acl check
2025-10-02T08:16:31.310701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:31.310706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:31.310707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:31.310710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535358556121111:2866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:31.311058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535358556121111:2866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:31.312795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535358556121111:2866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:31.317064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535358556121111:2866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:31.317075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535358556121111:2866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:31.317077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535358556121111:2866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:31.317082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:31.317503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:31.318916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:31.318930Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:31.318932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:31.318935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:31.318939Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2729 [1:7556535358556121095:2876]
2025-10-02T08:16:31.318946Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:31.318958Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:31.318959Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.318962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.318964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.318975Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:31.318978Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:31.318983Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:31.319027Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.319033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.319035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:31.319036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:31.319078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:31.319086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.319094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.319100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:31.319111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535358556121089:2876]
2025-10-02T08:16:31.319115Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535358556121089:2876]
2025-10-02T08:16:31.319120Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:31.319129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:31.319140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:31.319145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:31.319147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2729
2025-10-02T08:16:31.319147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:31.319150Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:31.319168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121143:2866], now have 1 active actors on pipe
2025-10-02T08:16:31.319174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535359015377147:2378], now have 1 active actors on pipe
2025-10-02T08:16:31.319178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.319180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.319189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535358556121089:2876]
2025-10-02T08:16:31.319197Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:31.319213Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|956c50b9-99fd0d1c-89737912-cc973a54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:31.319222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.319229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.319230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:31.319237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.319245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:31.319264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.319265Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:31.319235Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2729
2025-10-02T08:16:31.319299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.319304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.319312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.319339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2730 partition: 0 MaxSeqNo: 17 sessionId: src_id|956c50b9-99fd0d1c-89737912-cc973a54_0
2025-10-02T08:16:31.319671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d79e9-62bd2675-aed35601-838a1087_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|956c50b9-99fd0d1c-89737912-cc973a54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:31.322289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956c50b9-99fd0d1c-89737912-cc973a54_0] Write session: try to update token
2025-10-02T08:16:31.322308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956c50b9-99fd0d1c-89737912-cc973a54_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:31.335535Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:31.335549Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:31.335550Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:31.335557Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535358556121089:2876]
2025-10-02T08:16:31.335560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535358556121089:2876]
2025-10-02T08:16:31.335590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:31.335591Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:31.335595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.335595Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:31.335597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:31.335710Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:31.336494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2730 sessionId: src_id|956c50b9-99fd0d1c-89737912-cc973a54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:31.338604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:31.403328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535358556121159:10248]
2025-10-02T08:16:31.403474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2729, pipe: [1:7556535358556121159:10248]
2025-10-02T08:16:31.461479Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:31.461777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.461791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.461828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121159:10248], now have 1 active actors on pipe
2025-10-02T08:16:31.461928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535358556121159:10248]
2025-10-02T08:16:31.461950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:31.461956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:31.462006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2730 reason: error at write: Disconnected sessionId: src_id|956c50b9-99fd0d1c-89737912-cc973a54_0
2025-10-02T08:16:31.462062Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:31.462099Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:31.462167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2730 sessionId: src_id|956c50b9-99fd0d1c-89737912-cc973a54_0 is DEAD
2025-10-02T08:16:31.462321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956c50b9-99fd0d1c-89737912-cc973a54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:31.462330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956c50b9-99fd0d1c-89737912-cc973a54_0] Write session will restart in 0.007159s
2025-10-02T08:16:31.462357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956c50b9-99fd0d1c-89737912-cc973a54_0] Write session: Do CDS request
2025-10-02T08:16:31.462364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956c50b9-99fd0d1c-89737912-cc973a54_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:31.466185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:31.466936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:31.467041Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:31.467048Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:31.467054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:31.467081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:31.467111Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535358556121222:2951]
2025-10-02T08:16:31.467585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:31.467725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:31.467750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:31.467937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:31.467972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.467977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.467977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.467978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.467979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.467982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.467989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.467991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.467993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.467995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.467998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.468002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.468006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.468009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.468011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.468013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.468015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.468018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.468021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.468024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.468044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:31.470220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956c50b9-99fd0d1c-89737912-cc973a54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.470270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:31.470278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2731
2025-10-02T08:16:31.470398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.470421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:31.470426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:31.470428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:31.470695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2731 sessionId:  describe result for acl check
2025-10-02T08:16:31.470714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:31.470715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:31.470716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:31.470719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535358556121238:2968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:31.471050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535358556121238:2968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:31.472519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535358556121238:2968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:31.474828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535358556121238:2968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:31.474841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535358556121238:2968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:31.474845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535358556121238:2968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:31.474852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:31.475315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:31.476630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:31.476641Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:31.476643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:31.476645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:31.476650Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2730 [1:7556535358556121222:2951]
2025-10-02T08:16:31.476657Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:31.476670Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:31.476671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.476674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.476675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.476685Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:31.476688Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:31.476692Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:31.476732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.476734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.476736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:31.476738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:31.476783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:31.476789Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.476797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.476819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:31.476830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535358556121216:2951]
2025-10-02T08:16:31.476831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535358556121216:2951]
2025-10-02T08:16:31.476836Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:31.476845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121269:2968], now have 1 active actors on pipe
2025-10-02T08:16:31.476846Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:31.476848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535359015377154:2378], now have 1 active actors on pipe
2025-10-02T08:16:31.476849Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:31.476853Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:31.476854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2730
2025-10-02T08:16:31.476861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:31.476862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:31.476885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.476892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.476901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535358556121216:2951]
2025-10-02T08:16:31.476903Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:31.476906Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:31.476919Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75e024b6-7738e805-768693a0-f38fb27f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:31.476927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.476929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.476896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2730
2025-10-02T08:16:31.476930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:31.476935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.476941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:31.476959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.476990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.476995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.477004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.477026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2731 partition: 0 MaxSeqNo: 17 sessionId: src_id|75e024b6-7738e805-768693a0-f38fb27f_0
2025-10-02T08:16:31.477303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956c50b9-99fd0d1c-89737912-cc973a54_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|75e024b6-7738e805-768693a0-f38fb27f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:31.479621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e024b6-7738e805-768693a0-f38fb27f_0] Write session: try to update token
2025-10-02T08:16:31.479634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e024b6-7738e805-768693a0-f38fb27f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:31.492412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2731 sessionId: src_id|75e024b6-7738e805-768693a0-f38fb27f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:31.493501Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:31.493517Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:31.493518Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:31.493525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535358556121216:2951]
2025-10-02T08:16:31.493528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535358556121216:2951]
2025-10-02T08:16:31.493563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:31.493570Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:31.493572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.493574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:31.493576Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:31.493705Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:31.494981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:31.562022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535358556121286:10248]
2025-10-02T08:16:31.562109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2730, pipe: [1:7556535358556121286:10248]
2025-10-02T08:16:31.620494Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:31.620738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.620748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.620779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121286:10248], now have 1 active actors on pipe
2025-10-02T08:16:31.620885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:31.620890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:31.620933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2731 reason: error at write: Disconnected sessionId: src_id|75e024b6-7738e805-768693a0-f38fb27f_0
2025-10-02T08:16:31.621037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:31.621060Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:31.621093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2731 sessionId: src_id|75e024b6-7738e805-768693a0-f38fb27f_0 is DEAD
2025-10-02T08:16:31.621258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e024b6-7738e805-768693a0-f38fb27f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:31.621269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e024b6-7738e805-768693a0-f38fb27f_0] Write session will restart in 0.007410s
2025-10-02T08:16:31.621259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535358556121286:10248]
2025-10-02T08:16:31.621291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e024b6-7738e805-768693a0-f38fb27f_0] Write session: Do CDS request
2025-10-02T08:16:31.621297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e024b6-7738e805-768693a0-f38fb27f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:31.625494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:31.626212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:31.626374Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:31.626384Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:31.626392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:31.626430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:31.626456Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535358556121352:2979]
2025-10-02T08:16:31.626850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:31.626990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:31.627018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:31.627220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:31.627250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.627254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.627255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.627255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.627256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.627259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.627265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.627267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.627269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.627271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.627275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.627280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.627285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.627289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.627293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.627297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.627301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.627306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.627310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.627314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.627332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:31.630290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e024b6-7738e805-768693a0-f38fb27f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.630407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:31.630422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2732
2025-10-02T08:16:31.630543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.630576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:31.630584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:31.630588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:31.630985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2732 sessionId:  describe result for acl check
2025-10-02T08:16:31.631023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:31.631029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:31.631031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:31.631037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535358556121368:2997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:31.631556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535358556121368:2997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:31.633432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535358556121368:2997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:31.635022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:31.636035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535358556121368:2997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:31.636047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535358556121368:2997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:31.636050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535358556121368:2997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:31.636058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:31.636572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:31.636587Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:31.636589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:31.636592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:31.636598Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2731 [1:7556535358556121352:2979]
2025-10-02T08:16:31.636610Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:31.636625Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:31.636627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.636630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.636633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.636648Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:31.636652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:31.636663Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:31.636720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.636728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.636731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:31.636733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:31.636787Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:31.636792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.636819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.636830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2731
2025-10-02T08:16:31.636832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:31.636849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121400:2997], now have 1 active actors on pipe
2025-10-02T08:16:31.636856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535359015377160:2378], now have 1 active actors on pipe
2025-10-02T08:16:31.636861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.636864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.636879Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535358556121346:2979]
2025-10-02T08:16:31.636885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535358556121346:2979]
2025-10-02T08:16:31.636895Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:31.636911Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:31.636912Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:31.636914Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:31.636923Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:31.636925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:31.636897Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2731
2025-10-02T08:16:31.636935Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:31.636944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.636947Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.636948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:31.636954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.636961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:31.636984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535358556121346:2979]
2025-10-02T08:16:31.636992Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:31.637001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:31.637004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.637050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.637055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.637065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.637087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2732 partition: 0 MaxSeqNo: 17 sessionId: src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0
2025-10-02T08:16:31.637363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e024b6-7738e805-768693a0-f38fb27f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:31.639582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0] Write session: try to update token
2025-10-02T08:16:31.639592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:31.652281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2732 sessionId: src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:31.654807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:31.655318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.655335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.655358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:31.655360Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:31.655362Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:31.655367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535358556121346:2979]
2025-10-02T08:16:31.655370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535358556121346:2979]
2025-10-02T08:16:31.655407Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:31.655415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:31.655420Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:31.655422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.655424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:31.655554Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:31.721306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535358556121415:10248]
2025-10-02T08:16:31.721443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2731, pipe: [1:7556535358556121415:10248]
2025-10-02T08:16:31.783953Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:31.784321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:31.784354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:31.784357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121415:10248], now have 1 active actors on pipe
2025-10-02T08:16:31.784431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:31.784437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:31.784453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2732 reason: error at write: Disconnected sessionId: src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0
2025-10-02T08:16:31.784511Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:31.784581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2732 sessionId: src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0 is DEAD
2025-10-02T08:16:31.784708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535358556121415:10248]
2025-10-02T08:16:31.784722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:31.784731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0] Write session will restart in 0.007204s
2025-10-02T08:16:31.784753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0] Write session: Do CDS request
2025-10-02T08:16:31.784762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:31.788764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:31.789570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:31.789691Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:31.789698Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:31.789704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:31.789733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:31.789771Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535358556121485:3025]
2025-10-02T08:16:31.790160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:31.790302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:31.790328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:31.790524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:31.790551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.790555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.790556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.790557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.790557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.790560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.790567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.790569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.790571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.790573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.790576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.790581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.790584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.790588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.790590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.790593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.790595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.790598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.790601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.790604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.790614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:31.793245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.793298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:31.793308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2733
2025-10-02T08:16:31.793434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.793470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:31.793479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:31.793482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:31.793832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2733 sessionId:  describe result for acl check
2025-10-02T08:16:31.793862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:31.793867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:31.793868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:31.793871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535358556121501:2999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:31.794281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535358556121501:2999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:31.796296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535358556121501:2999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:31.798060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:31.798851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535358556121501:2999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:31.798861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535358556121501:2999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:31.798864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535358556121501:2999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:31.798869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:31.799474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:31.799488Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:31.799490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:31.799493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:31.799497Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2732 [1:7556535358556121485:3025]
2025-10-02T08:16:31.799506Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:31.799518Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:31.799519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.799523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.799524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.799536Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:31.799539Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:31.799544Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:31.799587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.799594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.799596Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:31.799597Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:31.799659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2732
2025-10-02T08:16:31.799686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:31.799695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.799705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.799720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:31.799741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121533:2999], now have 1 active actors on pipe
2025-10-02T08:16:31.799747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535359015377167:2378], now have 1 active actors on pipe
2025-10-02T08:16:31.799751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.799729Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2732
2025-10-02T08:16:31.799754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.799766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535358556121479:3025]
2025-10-02T08:16:31.799767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535358556121479:3025]
2025-10-02T08:16:31.799776Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:31.799785Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:31.799793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:31.799794Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:31.799795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:31.799796Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:31.799811Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:31.799818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.799820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.799821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:31.799828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.799836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:31.799860Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535358556121479:3025]
2025-10-02T08:16:31.799868Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:31.799877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.799877Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:31.799954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.799959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.799971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.799994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2733 partition: 0 MaxSeqNo: 17 sessionId: src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0
2025-10-02T08:16:31.800342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea86932-cfeb4eec-7caaa95-9a93746a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:31.802842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0] Write session: try to update token
2025-10-02T08:16:31.802861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:31.816398Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:31.816414Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:31.816415Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:31.816422Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535358556121479:3025]
2025-10-02T08:16:31.816425Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535358556121479:3025]
2025-10-02T08:16:31.816458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:31.816462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.816463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:31.816467Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:31.816472Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:31.816492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2733 sessionId: src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:31.816578Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:31.818801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:31.884597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535358556121550:10248]
2025-10-02T08:16:31.884731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2732, pipe: [1:7556535358556121550:10248]
2025-10-02T08:16:31.941933Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:31.942164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.942174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.942205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121550:10248], now have 1 active actors on pipe
2025-10-02T08:16:31.942315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535358556121550:10248]
2025-10-02T08:16:31.942350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:31.942358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:31.942401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2733 reason: error at write: Disconnected sessionId: src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0
2025-10-02T08:16:31.942418Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:31.942490Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:31.942528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2733 sessionId: src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0 is DEAD
2025-10-02T08:16:31.942655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:31.942665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0] Write session will restart in 0.009067s
2025-10-02T08:16:31.942682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0] Write session: Do CDS request
2025-10-02T08:16:31.942687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:31.947495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:31.948393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:31.948504Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:31.948511Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:31.948518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:31.948545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:31.948569Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535358556121620:3002]
2025-10-02T08:16:31.949170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:31.949338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:31.949380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:31.949669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:31.949710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.949718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.949719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.949720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.949721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.949726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.949735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.949743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.949747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.949751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.949756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.949764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:31.949775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.949784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:31.949792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.949803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:31.949812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.949821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.949830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.949839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.949862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:31.953203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.953273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:31.953283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2734
2025-10-02T08:16:31.953408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:31.953429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:31.953435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:31.953437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:31.953763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2734 sessionId:  describe result for acl check
2025-10-02T08:16:31.953792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:31.953797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:31.953798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:31.953802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535358556121639:3004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:31.954169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535358556121639:3004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:31.956020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535358556121639:3004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:31.957350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:31.958669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:31.958682Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:31.958684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:31.958686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:31.958691Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2733 [1:7556535358556121620:3002]
2025-10-02T08:16:31.958698Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:31.958708Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:31.958710Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.958712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.958713Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.958723Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:31.958730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:31.958736Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:31.958745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535358556121639:3004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:31.958757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535358556121639:3004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:31.958764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535358556121639:3004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:31.958772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:31.958779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.958780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.958782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:31.958783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:31.958828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:31.958834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.958841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:31.958847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:31.958859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535359015377175:2378], now have 1 active actors on pipe
2025-10-02T08:16:31.958867Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535358556121614:3002]
2025-10-02T08:16:31.958868Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535358556121614:3002]
2025-10-02T08:16:31.958873Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:31.958880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:31.958888Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:31.958889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:31.958889Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:31.958892Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:31.958909Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535358556121614:3002]
2025-10-02T08:16:31.958914Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:31.958918Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:31.958949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2733
2025-10-02T08:16:31.958968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535358556121668:3004], now have 1 active actors on pipe
2025-10-02T08:16:31.958977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.958981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.958944Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2733
2025-10-02T08:16:31.959006Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9535a3a7-bbbadf11-1157089f-5e84770_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:31.959020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:31.959024Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:31.959025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:31.959034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:31.959043Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:31.959056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.959085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:31.959092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:31.959106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:31.959139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2734 partition: 0 MaxSeqNo: 17 sessionId: src_id|9535a3a7-bbbadf11-1157089f-5e84770_0
2025-10-02T08:16:31.959382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c2eaed-1b743b4d-d0b682b-38665c99_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9535a3a7-bbbadf11-1157089f-5e84770_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:31.961593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9535a3a7-bbbadf11-1157089f-5e84770_0] Write session: try to update token
2025-10-02T08:16:31.961605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9535a3a7-bbbadf11-1157089f-5e84770_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:31.973678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2734 sessionId: src_id|9535a3a7-bbbadf11-1157089f-5e84770_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:31.975434Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:31.975449Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:31.975451Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:31.975458Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535358556121614:3002]
2025-10-02T08:16:31.975462Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535358556121614:3002]
2025-10-02T08:16:31.975500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:31.975503Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:31.975507Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:31.975511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:31.975513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:31.975633Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:31.975884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:32.066979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535362851089004:10248]
2025-10-02T08:16:32.068830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2733, pipe: [1:7556535362851089004:10248]
2025-10-02T08:16:32.118435Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:32.118690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.118699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.118731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089004:10248], now have 1 active actors on pipe
2025-10-02T08:16:32.118916Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:32.118995Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:32.119177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535362851089004:10248]
2025-10-02T08:16:32.119203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:32.119259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2734 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9535a3a7-bbbadf11-1157089f-5e84770_0
2025-10-02T08:16:32.119404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2734 sessionId: src_id|9535a3a7-bbbadf11-1157089f-5e84770_0 is DEAD
2025-10-02T08:16:32.119563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9535a3a7-bbbadf11-1157089f-5e84770_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:32.119574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9535a3a7-bbbadf11-1157089f-5e84770_0] Write session will restart in 0.009256s
2025-10-02T08:16:32.119596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9535a3a7-bbbadf11-1157089f-5e84770_0] Write session: Do CDS request
2025-10-02T08:16:32.119602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9535a3a7-bbbadf11-1157089f-5e84770_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:32.123798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:32.124670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:32.124850Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:32.124861Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:32.124872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:32.124928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:32.124968Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535362851089099:3126]
2025-10-02T08:16:32.125528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:32.125706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:32.125750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:32.126018Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:32.126082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.126089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.126090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.126091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.126092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.126096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.126105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.126109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.126112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.126115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.126120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.126126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.126136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.126139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.126147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.126154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.126161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.126167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.126174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.126178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.126197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:32.130282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9535a3a7-bbbadf11-1157089f-5e84770_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.130431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:32.130442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2735
2025-10-02T08:16:32.130545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.130567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:32.130574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:32.130577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:32.130931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2735 sessionId:  describe result for acl check
2025-10-02T08:16:32.130962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:32.130963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:32.130964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:32.130967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535362851089117:3156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:32.131338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535362851089117:3156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:32.133186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535362851089117:3156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:32.133874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:32.135295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:32.135306Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:32.135308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:32.135311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:32.135314Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2734 [1:7556535362851089099:3126]
2025-10-02T08:16:32.135324Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:32.135336Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:32.135337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.135339Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.135340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.135352Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:32.135356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:32.135360Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:32.135398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.135403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.135405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:32.135406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:32.135447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:32.135454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.135465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.135477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:32.135498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535363310344513:2378], now have 1 active actors on pipe
2025-10-02T08:16:32.135508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535362851089093:3126]
2025-10-02T08:16:32.135510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535362851089093:3126]
2025-10-02T08:16:32.135521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:32.135536Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:32.135545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:32.135548Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:32.135552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:32.135554Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:32.135575Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535362851089093:3126]
2025-10-02T08:16:32.135581Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:32.135594Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:32.135573Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2734
2025-10-02T08:16:32.135798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535362851089117:3156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:32.135809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535362851089117:3156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:32.135812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535362851089117:3156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:32.135817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:32.135997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2734
2025-10-02T08:16:32.136009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089155:3156], now have 1 active actors on pipe
2025-10-02T08:16:32.136014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.136018Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.136050Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:32.136061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.136064Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.136066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:32.136074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.136083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:32.136099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.136158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.136164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.136175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.136201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2735 partition: 0 MaxSeqNo: 17 sessionId: src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0
2025-10-02T08:16:32.136499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9535a3a7-bbbadf11-1157089f-5e84770_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:32.138904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0] Write session: try to update token
2025-10-02T08:16:32.138918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:32.150918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2735 sessionId: src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:32.151774Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:32.151793Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:32.151795Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:32.151804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535362851089093:3126]
2025-10-02T08:16:32.151808Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535362851089093:3126]
2025-10-02T08:16:32.151847Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:32.151854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.151859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:32.151861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:32.151863Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:32.151996Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:32.153395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:32.219449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535362851089163:10248]
2025-10-02T08:16:32.219596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2734, pipe: [1:7556535362851089163:10248]
2025-10-02T08:16:32.278497Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:32.278704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.278714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.278744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089163:10248], now have 1 active actors on pipe
2025-10-02T08:16:32.278808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535362851089163:10248]
2025-10-02T08:16:32.278823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:32.278828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:32.278866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2735 reason: error at write: Disconnected sessionId: src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0
2025-10-02T08:16:32.278948Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:32.278945Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:32.278999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2735 sessionId: src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0 is DEAD
2025-10-02T08:16:32.279147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:32.279157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0] Write session will restart in 0.009050s
2025-10-02T08:16:32.279184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0] Write session: Do CDS request
2025-10-02T08:16:32.279190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:32.283240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:32.284019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:32.284138Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:32.284146Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:32.284152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:32.284178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:32.284205Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535362851089236:3153]
2025-10-02T08:16:32.284714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:32.284878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:32.284903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:32.285083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:32.285108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.285112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.285113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.285113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.285114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.285117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.285123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.285125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.285127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.285128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.285131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.285135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.285138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.285141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.285145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.285148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.285150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.285152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.285154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.285157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.285166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:32.289204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.289265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:32.289275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2736
2025-10-02T08:16:32.289380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.289405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:32.289413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:32.289416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:32.289755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2736 sessionId:  describe result for acl check
2025-10-02T08:16:32.289791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:32.289798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:32.289800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:32.289804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535362851089252:3160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:32.290274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535362851089252:3160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:32.291684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535362851089252:3160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:32.292381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:32.293770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535362851089252:3160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:32.293779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535362851089252:3160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:32.293780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535362851089252:3160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:32.293785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:32.293914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:32.293928Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:32.293930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:32.293933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:32.293938Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2735 [1:7556535362851089236:3153]
2025-10-02T08:16:32.293947Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:32.293964Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:32.293969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.293972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.293974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.293990Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:32.293995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:32.294003Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:32.294055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.294062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.294065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:32.294067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:32.294124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:32.294132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2735
2025-10-02T08:16:32.294134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.294145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.294156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:32.294173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089284:3160], now have 1 active actors on pipe
2025-10-02T08:16:32.294183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.294186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.294203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535363310344520:2378], now have 1 active actors on pipe
2025-10-02T08:16:32.294185Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2735
2025-10-02T08:16:32.294212Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535362851089230:3153]
2025-10-02T08:16:32.294214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535362851089230:3153]
2025-10-02T08:16:32.294221Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:32.294230Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:32.294232Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:32.294233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:32.294246Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:32.294249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:32.294264Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:32.294275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.294283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.294285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:32.294327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.294340Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:32.294381Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535362851089230:3153]
2025-10-02T08:16:32.294393Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:32.294398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:32.294407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.294457Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.294465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.294479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.294505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2736 partition: 0 MaxSeqNo: 17 sessionId: src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0
2025-10-02T08:16:32.294746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55141b7e-7b256f3d-8c94ddd8-7db511b7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:32.296970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0] Write session: try to update token
2025-10-02T08:16:32.296980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:32.304741Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:32.304759Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:32.304765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535362851089230:3153]
2025-10-02T08:16:32.304796Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:32.304812Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:32.304957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:32.305079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:32.305192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:32.305307Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:32.305700Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:32.305730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:32.308962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2736 sessionId: src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:32.311206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:32.311258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.311265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.311300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:32.311322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:32.311358Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.311375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.311542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.311599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.311667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.311729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.311771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.311782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.311847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.311909Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.311969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.312049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.312092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.312101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.312163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.312221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.312280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.312340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.312380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.312387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.312450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.312509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.312568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.312629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.312756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.312764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.312848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.312904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.312960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.313022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.313065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.313072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.313133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.313190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.313259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.313320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.313363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.313369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.313430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.313492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.313559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.313623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.313670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.313677Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.313739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.313795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.313852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.313907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.314046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.314054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.314117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.314173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.314230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.314289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.314410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.314417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.314482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:32.314539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:32.314603Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:32.314660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:32.314700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:32.314707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:32.314747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:32.314808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.314830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.314836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:32.314866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:32.314881Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:32.314888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:32.314892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:32.314898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:32.315252Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:32.315279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:32.315290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:32.315293Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:32.315297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:32.315301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:32.315928Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:32.315951Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:32.315957Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:32.315966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:32.315969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:32.315973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:32.316442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:32.316462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:32.316469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:32.316477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:32.316480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:32.318621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:32.318640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:32.318652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392992318
2025-10-02T08:16:32.318782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:32.318794Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:32.318800Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:32.318804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:32.318808Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:32.318812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:32.319216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:32.319237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:32.319242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:32.319246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:32.319251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:32.319254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:32.319733Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:32.319754Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:32.319760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:32.319763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:32.319767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:32.319770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:32.320219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:32.320237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:32.320242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:32.321313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:32.321328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:32.321334Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:32.321338Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:32.321347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392992321
2025-10-02T08:16:32.321613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:32.321631Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:32.321641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:32.321646Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:32.321650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:32.321653Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:32.322076Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:32.322094Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:32.322099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:32.322103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:32.322106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:32.322109Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:32.322518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:32.322536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.322638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392992322
2025-10-02T08:16:32.323330Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:32.323353Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:32.323364Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:32.323371Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:32.324963Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:32.324973Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:32.324975Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:32.324985Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535362851089230:3153]
2025-10-02T08:16:32.324989Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535362851089230:3153]
2025-10-02T08:16:32.325033Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:32.325043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:32.325046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:32.325050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.325059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:32.325186Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:32.379216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535362851089308:10248]
2025-10-02T08:16:32.379303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2735, pipe: [1:7556535362851089308:10248]
2025-10-02T08:16:32.455605Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:32.455889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089308:10248], now have 1 active actors on pipe
2025-10-02T08:16:32.455994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535362851089308:10248]
2025-10-02T08:16:32.456008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:32.456013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:32.456039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2736 reason: error at write: Disconnected sessionId: src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0
2025-10-02T08:16:32.456113Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:32.456122Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:32.456191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2736 sessionId: src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0 is DEAD
2025-10-02T08:16:32.456315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:32.456323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0] Write session will restart in 0.006800s
2025-10-02T08:16:32.456340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0] Write session: Do CDS request
2025-10-02T08:16:32.456345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:32.460531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:32.461252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:32.461380Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:32.461389Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:32.461398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:32.461444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:32.461476Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535362851089384:3199]
2025-10-02T08:16:32.461855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:32.461998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:32.462024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:32.462219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:32.462249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.462253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.462254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.462254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.462255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.462257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.462263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.462265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.462267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.462269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.462272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.462276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.462280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.462282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.462285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.462287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.462290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.462292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.462296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.462299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.462309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:32.464244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.464349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:32.464358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2737
2025-10-02T08:16:32.464448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.464468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:32.464474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:32.464476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:32.464758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2737 sessionId:  describe result for acl check
2025-10-02T08:16:32.464791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:32.464797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:32.464810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:32.464814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535362851089400:3208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:32.465172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535362851089400:3208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:32.466794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535362851089400:3208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:32.468995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535362851089400:3208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:32.469007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535362851089400:3208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:32.469010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535362851089400:3208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:32.469017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:32.471958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:32.473475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:32.473495Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:32.473497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:32.473500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:32.473505Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2736 [1:7556535362851089384:3199]
2025-10-02T08:16:32.473514Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:32.473527Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:32.473530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.473534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.473536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.473551Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:32.473556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:32.473561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:32.473615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.473623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.473627Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:32.473629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:32.473686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:32.473693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.473704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.473716Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:32.473735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2736
2025-10-02T08:16:32.473737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089432:3208], now have 1 active actors on pipe
2025-10-02T08:16:32.473740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535363310344529:2378], now have 1 active actors on pipe
2025-10-02T08:16:32.473746Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535362851089378:3199]
2025-10-02T08:16:32.473748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535362851089378:3199]
2025-10-02T08:16:32.473758Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:32.473768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.473769Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:32.473771Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:32.473778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.473793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:32.473811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:32.473817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:32.473853Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:32.473863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.473831Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2736
2025-10-02T08:16:32.473866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.473867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:32.473876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.473885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:32.473892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535362851089378:3199]
2025-10-02T08:16:32.473902Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:32.473910Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:32.473928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.473973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.473979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.473992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.474027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2737 partition: 0 MaxSeqNo: 17 sessionId: src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0
2025-10-02T08:16:32.474333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8f53e56-1bee6df1-a80733a7-cfb33cd4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:32.476608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0] Write session: try to update token
2025-10-02T08:16:32.476617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:32.488110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2737 sessionId: src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:32.490409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:32.490684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.490703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.490718Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:32.490720Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:32.490722Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:32.490727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535362851089378:3199]
2025-10-02T08:16:32.490730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535362851089378:3199]
2025-10-02T08:16:32.490768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:32.490774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:32.490774Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:32.490780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.490782Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:32.490896Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:32.556386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535362851089450:10248]
2025-10-02T08:16:32.556523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2736, pipe: [1:7556535362851089450:10248]
2025-10-02T08:16:32.613509Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:32.613725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:32.613757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:32.613762Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089450:10248], now have 1 active actors on pipe
2025-10-02T08:16:32.613871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:32.613878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:32.613897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2737 reason: error at write: Disconnected sessionId: src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0
2025-10-02T08:16:32.613990Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:32.614048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2737 sessionId: src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0 is DEAD
2025-10-02T08:16:32.614170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:32.614176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0] Write session will restart in 0.007136s
2025-10-02T08:16:32.614193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0] Write session: Do CDS request
2025-10-02T08:16:32.614198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:32.614183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535362851089450:10248]
2025-10-02T08:16:32.618751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:32.619488Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:32.619650Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:32.619663Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:32.619672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:32.619726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:32.619762Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535362851089527:3270]
2025-10-02T08:16:32.620350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:32.620524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:32.620567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:32.620868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:32.620927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.620934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.620935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.620935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.620936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.620941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.620949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.620952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.620955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.620958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.620963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.620969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.620977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.620981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.620989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.620993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.620996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.620999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.621003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.621012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.621026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:32.622193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.622442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:32.622452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2738
2025-10-02T08:16:32.622536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.622558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:32.622565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:32.622568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:32.622852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2738 sessionId:  describe result for acl check
2025-10-02T08:16:32.622880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:32.622881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:32.622882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:32.622886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535362851089543:3278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:32.623231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535362851089543:3278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:32.625000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535362851089543:3278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:32.627956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535362851089543:3278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:32.627968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535362851089543:3278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:32.627970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535362851089543:3278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:32.627976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:32.628631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:32.629931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:32.629944Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:32.629945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:32.629948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:32.629952Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2737 [1:7556535362851089527:3270]
2025-10-02T08:16:32.629959Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:32.629970Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:32.629975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.629977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.629978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.629988Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:32.629991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:32.629995Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:32.630037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.630044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.630047Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:32.630050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:32.630094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:32.630099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.630108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.630114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:32.630126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2737
2025-10-02T08:16:32.630127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089575:3278], now have 1 active actors on pipe
2025-10-02T08:16:32.630131Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535362851089521:3270]
2025-10-02T08:16:32.630132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535362851089521:3270]
2025-10-02T08:16:32.630137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:32.630142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535363310344535:2378], now have 1 active actors on pipe
2025-10-02T08:16:32.630145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.630145Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:32.630147Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:32.630148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.630160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:32.630168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:32.630169Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:32.630194Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|856a8918-86b94ec5-a2108326-6f04acb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:32.630203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.630206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.630207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:32.630212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.630186Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2737
2025-10-02T08:16:32.630217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:32.630221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535362851089521:3270]
2025-10-02T08:16:32.630223Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:32.630229Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:32.630239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.630279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.630285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.630296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.630321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2738 partition: 0 MaxSeqNo: 17 sessionId: src_id|856a8918-86b94ec5-a2108326-6f04acb6_0
2025-10-02T08:16:32.630581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|493a969c-48ca5105-af86bd55-c0f0b97a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|856a8918-86b94ec5-a2108326-6f04acb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:32.632760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856a8918-86b94ec5-a2108326-6f04acb6_0] Write session: try to update token
2025-10-02T08:16:32.632770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856a8918-86b94ec5-a2108326-6f04acb6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:32.644616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2738 sessionId: src_id|856a8918-86b94ec5-a2108326-6f04acb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:32.646117Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:32.646132Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:32.646134Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:32.646140Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535362851089521:3270]
2025-10-02T08:16:32.646143Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535362851089521:3270]
2025-10-02T08:16:32.646177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:32.646187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.646189Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:32.646200Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:32.646214Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:32.646302Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:32.646713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:32.714051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535362851089589:10248]
2025-10-02T08:16:32.714174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2737, pipe: [1:7556535362851089589:10248]
2025-10-02T08:16:32.766579Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:32.766919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.766929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.766958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089589:10248], now have 1 active actors on pipe
2025-10-02T08:16:32.767093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:32.767102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:32.767126Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:32.767150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2738 reason: error at write: Disconnected sessionId: src_id|856a8918-86b94ec5-a2108326-6f04acb6_0
2025-10-02T08:16:32.767170Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:32.767273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2738 sessionId: src_id|856a8918-86b94ec5-a2108326-6f04acb6_0 is DEAD
2025-10-02T08:16:32.767371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535362851089589:10248]
2025-10-02T08:16:32.767385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856a8918-86b94ec5-a2108326-6f04acb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:32.767393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856a8918-86b94ec5-a2108326-6f04acb6_0] Write session will restart in 0.005705s
2025-10-02T08:16:32.767409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856a8918-86b94ec5-a2108326-6f04acb6_0] Write session: Do CDS request
2025-10-02T08:16:32.767413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856a8918-86b94ec5-a2108326-6f04acb6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:32.771225Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:32.771927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:32.772051Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:32.772059Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:32.772066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:32.772101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:32.772133Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535362851089671:3310]
2025-10-02T08:16:32.772548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:32.772668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:32.772694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:32.772929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:32.772965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.772969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.772970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.772970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.772971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.772974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.772980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.772981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.772983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.772985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.772989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.772993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.772996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.773000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.773002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.773005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.773007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.773009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.773011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.773014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.773025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:32.774153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856a8918-86b94ec5-a2108326-6f04acb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.774236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:32.774246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2739
2025-10-02T08:16:32.774337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.774354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:32.774361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:32.774363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:32.774788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2739 sessionId:  describe result for acl check
2025-10-02T08:16:32.774816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:32.774823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:32.774824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:32.774829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535362851089687:3302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:32.775226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535362851089687:3302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:32.777070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535362851089687:3302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:32.779798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535362851089687:3302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:32.779810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535362851089687:3302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:32.779812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535362851089687:3302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:32.779819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:32.780331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:32.781595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:32.781610Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:32.781611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:32.781613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:32.781618Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2738 [1:7556535362851089671:3310]
2025-10-02T08:16:32.781626Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:32.781640Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:32.781642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.781645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.781647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.781657Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:32.781662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:32.781666Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:32.781702Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.781708Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.781710Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:32.781712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:32.781752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:32.781757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.781764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.781771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:32.781773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2738
2025-10-02T08:16:32.781782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089718:3302], now have 1 active actors on pipe
2025-10-02T08:16:32.781788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535363310344541:2378], now have 1 active actors on pipe
2025-10-02T08:16:32.781791Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.781794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.781806Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535362851089665:3310]
2025-10-02T08:16:32.781811Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535362851089665:3310]
2025-10-02T08:16:32.781819Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:32.781833Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:32.781844Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:32.781849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:32.781850Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:32.781852Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:32.781864Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:32.781872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.781874Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.781852Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2738
2025-10-02T08:16:32.781875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:32.781881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.781887Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:32.781906Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535362851089665:3310]
2025-10-02T08:16:32.781915Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:32.781926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.781930Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:32.781969Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.781977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.781994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.782025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2739 partition: 0 MaxSeqNo: 17 sessionId: src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0
2025-10-02T08:16:32.782261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856a8918-86b94ec5-a2108326-6f04acb6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:32.784482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0] Write session: try to update token
2025-10-02T08:16:32.784492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:32.796074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2739 sessionId: src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:32.798253Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:32.798269Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:32.798271Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:32.798276Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535362851089665:3310]
2025-10-02T08:16:32.798279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535362851089665:3310]
2025-10-02T08:16:32.798308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:32.798317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.798318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:32.798320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:32.798326Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:32.798332Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:32.798430Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:32.867650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535362851089734:10248]
2025-10-02T08:16:32.867754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2738, pipe: [1:7556535362851089734:10248]
2025-10-02T08:16:32.921343Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:32.921600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.921619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.921661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089734:10248], now have 1 active actors on pipe
2025-10-02T08:16:32.921861Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:32.921872Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:32.922009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535362851089734:10248]
2025-10-02T08:16:32.922034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:32.922089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2739 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0
2025-10-02T08:16:32.922243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2739 sessionId: src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0 is DEAD
2025-10-02T08:16:32.922394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:32.922405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0] Write session will restart in 0.008961s
2025-10-02T08:16:32.922425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0] Write session: Do CDS request
2025-10-02T08:16:32.922430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:32.927778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:32.928642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:32.928837Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:32.928849Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:32.928861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:32.928918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:32.928955Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535362851089816:3344]
2025-10-02T08:16:32.929524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:32.929726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:32.929778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:32.930060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:32.930122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.930129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.930130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.930131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.930131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.930136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.930145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.930148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.930152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.930155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.930163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.930174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:32.930185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.930190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:32.930196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.930201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:32.930207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.930212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.930220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.930226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.930243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:32.932205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.932259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:32.932271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2740
2025-10-02T08:16:32.932572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:32.932610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:32.932620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:32.932624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:32.932921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2740 sessionId:  describe result for acl check
2025-10-02T08:16:32.932945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:32.932949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:32.932950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:32.932954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535362851089832:3359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:32.933291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535362851089832:3359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:32.934970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535362851089832:3359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:32.937410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:32.937536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535362851089832:3359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:32.937548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535362851089832:3359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:32.937551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535362851089832:3359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:32.937557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:32.938715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:32.938728Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:32.938729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:32.938732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:32.938735Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2739 [1:7556535362851089816:3344]
2025-10-02T08:16:32.938745Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:32.938759Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:32.938768Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.938770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.938773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.938787Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:32.938794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:32.938799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:32.938837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.938842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.938844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:32.938845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:32.938886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:32.938891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.938898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:32.938904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:32.938918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535362851089868:3359], now have 1 active actors on pipe
2025-10-02T08:16:32.938925Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535362851089810:3344]
2025-10-02T08:16:32.938927Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535362851089810:3344]
2025-10-02T08:16:32.938931Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:32.938939Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535363310344549:2378], now have 1 active actors on pipe
2025-10-02T08:16:32.938944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:32.938946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2739
2025-10-02T08:16:32.938948Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:32.938950Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:32.938954Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:32.938956Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:32.938978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.938984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.938994Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535362851089810:3344]
2025-10-02T08:16:32.939003Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:32.939014Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:32.939027Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:32.939034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:32.939036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:32.939038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:32.939004Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2739
2025-10-02T08:16:32.939044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:32.939053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:32.939071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.939107Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:32.939118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:32.939142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:32.939178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2740 partition: 0 MaxSeqNo: 17 sessionId: src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0
2025-10-02T08:16:32.939425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43f6750f-5d660dc7-e8706785-ecbe9e6f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:32.941787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0] Write session: try to update token
2025-10-02T08:16:32.941799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:32.953737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2740 sessionId: src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:32.955576Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:32.955590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:32.955591Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:32.955597Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535362851089810:3344]
2025-10-02T08:16:32.955600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535362851089810:3344]
2025-10-02T08:16:32.955631Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:32.955634Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:32.955638Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:32.955639Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:32.955641Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:32.955758Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:32.956069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:33.022291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535367146057190:10248]
2025-10-02T08:16:33.022432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2739, pipe: [1:7556535367146057190:10248]
2025-10-02T08:16:33.077580Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:33.077804Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.077818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.077851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057190:10248], now have 1 active actors on pipe
2025-10-02T08:16:33.078025Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:33.078087Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:33.078256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:33.078300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2740 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0
2025-10-02T08:16:33.078456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2740 sessionId: src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0 is DEAD
2025-10-02T08:16:33.078597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:33.078605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0] Write session will restart in 0.009036s
2025-10-02T08:16:33.078621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0] Write session: Do CDS request
2025-10-02T08:16:33.078626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:33.078615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535367146057190:10248]
2025-10-02T08:16:33.083673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:33.084788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:33.084960Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:33.084972Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:33.084983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:33.085029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:33.085068Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535367146057286:3464]
2025-10-02T08:16:33.085657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:33.086325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:33.086375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:33.086660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:33.086705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.086711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.086712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.086713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.086714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.086719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.086727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.086734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.086738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.086746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.086750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.086762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.086771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.086776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.086784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.086789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.086796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.086806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.086814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.086823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.086844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:33.088193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.088263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:33.088276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2741
2025-10-02T08:16:33.088366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.088394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:33.088402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:33.088405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:33.088717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2741 sessionId:  describe result for acl check
2025-10-02T08:16:33.088744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:33.088750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:33.088752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:33.088756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535367146057302:3472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:33.089207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535367146057302:3472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:33.091077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535367146057302:3472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:33.093689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535367146057302:3472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:33.093702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535367146057302:3472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:33.093705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535367146057302:3472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:33.093712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:33.094434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:33.095843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:33.095859Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:33.095861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:33.095864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:33.095871Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2740 [1:7556535367146057286:3464]
2025-10-02T08:16:33.095881Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:33.095893Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:33.095900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.095902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.095904Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.095917Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:33.095920Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:33.095927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:33.095979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.095985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.095987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:33.095989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:33.096054Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:33.096062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.096074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.096091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:33.096109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535367605311878:2378], now have 1 active actors on pipe
2025-10-02T08:16:33.096119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535367146057280:3464]
2025-10-02T08:16:33.096121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535367146057280:3464]
2025-10-02T08:16:33.096127Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:33.096107Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2740
2025-10-02T08:16:33.096137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:33.096138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:33.096140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:33.096150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:33.096153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:33.096179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535367146057280:3464]
2025-10-02T08:16:33.096191Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:33.096205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:33.096397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2740
2025-10-02T08:16:33.096407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057335:3472], now have 1 active actors on pipe
2025-10-02T08:16:33.096411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.096414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.096433Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:33.096443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.096446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.096448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:33.096455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.096463Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:33.096478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.096515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.096521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.096531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.096552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2741 partition: 0 MaxSeqNo: 17 sessionId: src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0
2025-10-02T08:16:33.096797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b6ab58-6a772182-97f9bce3-7a1e3dc4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:33.099018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0] Write session: try to update token
2025-10-02T08:16:33.099030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:33.110501Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:33.110519Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:33.110526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535367146057280:3464]
2025-10-02T08:16:33.110548Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:33.110551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:33.110690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:33.110871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:33.110979Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:33.111089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:33.111094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2741 sessionId: src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:33.111248Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:33.111275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:33.113314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:33.113364Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.113375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.113404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:33.113422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:33.113470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.113476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.113613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.113668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.113724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.113781Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.114105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.114116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.114175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.114230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.114286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.114348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.114387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.114394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.114454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.114513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.114566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.114623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.114664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.114670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.114731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.114786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.114843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.114901Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.114941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.114947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.115008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.115062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.115120Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.115178Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.115220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.115227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.115285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.115339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.115395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.115456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.115497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.115504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.115561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.115614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.115673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.115731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.115773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.115779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.115838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.115893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.115951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.116011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.116064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.116071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.116133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.116187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.116244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.116302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.116342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.116349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.116416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:33.116475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:33.116536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:33.116597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:33.116639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:33.116645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:33.116678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:33.116738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.116759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.116765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:33.116793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:33.116826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:33.116833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:33.116837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:33.116840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:33.117210Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:33.117235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:33.117245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:33.117249Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:33.117256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:33.117259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:33.117868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:33.117891Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:33.117903Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:33.117911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:33.117914Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:33.117917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:33.118470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:33.118496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:33.118503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:33.118509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:33.118512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:33.120566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:33.120592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:33.120603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392993120
2025-10-02T08:16:33.120772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:33.120792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:33.120797Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:33.120814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:33.120818Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:33.120822Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:33.121298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:33.121327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:33.121339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:33.121346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:33.121349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:33.121353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:33.121789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:33.121817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:33.121830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:33.121837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:33.121840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:33.121847Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:33.122322Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:33.122345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:33.122355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:33.123374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:33.123395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:33.123405Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:33.123408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:33.123420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392993123
2025-10-02T08:16:33.123717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:33.123743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:33.123753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:33.123760Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:33.123763Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:33.123771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:33.124237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:33.124264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:33.124273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:33.124283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:33.124287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:33.124290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:33.124714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:33.124734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.124837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392993124
2025-10-02T08:16:33.125529Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:33.125546Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:33.125557Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:33.125563Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:33.127089Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:33.127104Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:33.127106Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:33.127114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535367146057280:3464]
2025-10-02T08:16:33.127117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535367146057280:3464]
2025-10-02T08:16:33.127161Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:33.127167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:33.127171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.127171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:33.127173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:33.127290Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:33.178961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535367146057383:10248]
2025-10-02T08:16:33.179060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2740, pipe: [1:7556535367146057383:10248]
2025-10-02T08:16:33.254852Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:33.255128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057383:10248], now have 1 active actors on pipe
2025-10-02T08:16:33.255274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535367146057383:10248]
2025-10-02T08:16:33.255285Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:33.255325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:33.255356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2741 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0
2025-10-02T08:16:33.255361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:33.255509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2741 sessionId: src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0 is DEAD
2025-10-02T08:16:33.255647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:33.255660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0] Write session will restart in 0.009290s
2025-10-02T08:16:33.255683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0] Write session: Do CDS request
2025-10-02T08:16:33.255689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:33.260069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:33.260911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:33.261017Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:33.261024Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:33.261030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:33.261058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:33.261085Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535367146057469:3511]
2025-10-02T08:16:33.261471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:33.261599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:33.261623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:33.261822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:33.261853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.261857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.261858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.261859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.261859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.261862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.261868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.261870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.261872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.261874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.261878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.261882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.261885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.261887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.261890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.261892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.261894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.261897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.261901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.261904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.261913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:33.266247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.266342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:33.266353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2742
2025-10-02T08:16:33.266483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.266512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:33.266521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:33.266524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:33.266823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2742 sessionId:  describe result for acl check
2025-10-02T08:16:33.266848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:33.266853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:33.266854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:33.266858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535367146057485:3524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:33.267205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535367146057485:3524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:33.268643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535367146057485:3524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:33.269414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:33.270810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:33.270822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535367146057485:3524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:33.270824Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:33.270827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535367146057485:3524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:33.270827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:33.270829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535367146057485:3524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:33.270830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:33.270834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:33.270835Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2741 [1:7556535367146057469:3511]
2025-10-02T08:16:33.270843Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:33.270856Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:33.270859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.270863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.270865Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.270880Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:33.270884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:33.270889Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:33.270939Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.270945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.270948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:33.270950Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:33.271000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:33.271006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.271016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.271028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:33.271041Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2741
2025-10-02T08:16:33.271047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535367605311897:2378], now have 1 active actors on pipe
2025-10-02T08:16:33.271058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535367146057463:3511]
2025-10-02T08:16:33.271060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535367146057463:3511]
2025-10-02T08:16:33.271065Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:33.271074Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:33.271076Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:33.271076Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:33.271088Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:33.271090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:33.271093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2741
2025-10-02T08:16:33.271118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057517:3524], now have 1 active actors on pipe
2025-10-02T08:16:33.271127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.271130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.271145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535367146057463:3511]
2025-10-02T08:16:33.271156Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:33.271173Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:33.271180Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:33.271187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.271195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.271198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:33.271205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.271215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:33.271235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.271301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.271312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.271330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.271364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2742 partition: 0 MaxSeqNo: 17 sessionId: src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0
2025-10-02T08:16:33.271622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6a89d-23627727-96e73e35-1b6ac7f3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:33.274030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0] Write session: try to update token
2025-10-02T08:16:33.274043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:33.286526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2742 sessionId: src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:33.287377Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:33.287392Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:33.287394Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:33.287401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535367146057463:3511]
2025-10-02T08:16:33.287404Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535367146057463:3511]
2025-10-02T08:16:33.287436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:33.287445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.287447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:33.287450Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:33.287455Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:33.287578Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:33.288900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:33.355591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535367146057532:10248]
2025-10-02T08:16:33.355713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2741, pipe: [1:7556535367146057532:10248]
2025-10-02T08:16:33.410940Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:33.411224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.411234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.411264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057532:10248], now have 1 active actors on pipe
2025-10-02T08:16:33.411405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535367146057532:10248]
2025-10-02T08:16:33.411435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:33.411439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:33.411497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2742 reason: error at write: Disconnected sessionId: src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0
2025-10-02T08:16:33.411521Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:33.411661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2742 sessionId: src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0 is DEAD
2025-10-02T08:16:33.411734Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:33.411825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:33.411837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0] Write session will restart in 0.009658s
2025-10-02T08:16:33.411861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0] Write session: Do CDS request
2025-10-02T08:16:33.411867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:33.416553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:33.417417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:33.417554Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:33.417561Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:33.417569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:33.417601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:33.417638Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535367146057619:3548]
2025-10-02T08:16:33.418085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:33.418278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:33.418309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:33.418503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:33.418531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.418535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.418535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.418536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.418537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.418540Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.418546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.418548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.418550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.418552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.418555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.418559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.418562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.418567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.418569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.418572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.418574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.418576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.418579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.418581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.418591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:33.422202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.422352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:33.422364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2743
2025-10-02T08:16:33.422460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.422480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:33.422488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:33.422491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:33.422887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2743 sessionId:  describe result for acl check
2025-10-02T08:16:33.422921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:33.422924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:33.422925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:33.422931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535367146057635:3551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:33.423411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535367146057635:3551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:33.425357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535367146057635:3551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:33.427990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535367146057635:3551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:33.428002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535367146057635:3551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:33.428005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535367146057635:3551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:33.428012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:33.428513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:33.429872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:33.429885Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:33.429887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:33.429889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:33.429893Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2742 [1:7556535367146057619:3548]
2025-10-02T08:16:33.429903Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:33.429914Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:33.429920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.429922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.429924Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.429936Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:33.429938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:33.429942Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:33.429982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.429987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.429989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:33.429991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:33.430032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:33.430037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.430044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.430050Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:33.430065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535367146057613:3548]
2025-10-02T08:16:33.430071Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535367146057613:3548]
2025-10-02T08:16:33.430077Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:33.430083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2742
2025-10-02T08:16:33.430088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535367605311904:2378], now have 1 active actors on pipe
2025-10-02T08:16:33.430088Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:33.430091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:33.430096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:33.430107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:33.430109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:33.430113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057667:3551], now have 1 active actors on pipe
2025-10-02T08:16:33.430117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.430123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.430108Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2742
2025-10-02T08:16:33.430156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535367146057613:3548]
2025-10-02T08:16:33.430165Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:33.430172Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:33.430177Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:33.430182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.430184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.430185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:33.430191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.430197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:33.430227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.430271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.430280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.430301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.430334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2743 partition: 0 MaxSeqNo: 17 sessionId: src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0
2025-10-02T08:16:33.430635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5113879-7617abc5-b7f97d81-c7a58fc4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:33.432953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0] Write session: try to update token
2025-10-02T08:16:33.432966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:33.445064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2743 sessionId: src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:33.446702Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:33.446717Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:33.446718Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:33.446724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535367146057613:3548]
2025-10-02T08:16:33.446728Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535367146057613:3548]
2025-10-02T08:16:33.446761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:33.446766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.446768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:33.446779Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:33.446785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:33.446893Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:33.447443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:33.511763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535367146057682:10248]
2025-10-02T08:16:33.511937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2742, pipe: [1:7556535367146057682:10248]
2025-10-02T08:16:33.569875Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:33.570115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.570124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.570154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057682:10248], now have 1 active actors on pipe
2025-10-02T08:16:33.570280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535367146057682:10248]
2025-10-02T08:16:33.570284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:33.570300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:33.570358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2743 reason: error at write: Disconnected sessionId: src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0
2025-10-02T08:16:33.570371Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:33.570423Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:33.570503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2743 sessionId: src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0 is DEAD
2025-10-02T08:16:33.570699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:33.570709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0] Write session will restart in 0.006083s
2025-10-02T08:16:33.570730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0] Write session: Do CDS request
2025-10-02T08:16:33.570736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:33.575155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:33.576050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:33.576157Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:33.576163Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:33.576170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:33.576198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:33.576224Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535367146057774:3558]
2025-10-02T08:16:33.576660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:33.576836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:33.576860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:33.577061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:33.577095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.577099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.577100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.577100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.577101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.577104Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.577110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.577112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.577114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.577116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.577120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.577124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.577127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.577130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.577132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.577135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.577137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.577140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.577142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.577145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.577154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:33.578205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.578242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:33.578251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2744
2025-10-02T08:16:33.578363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.578382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:33.578389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:33.578391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:33.578684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2744 sessionId:  describe result for acl check
2025-10-02T08:16:33.578704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:33.578709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:33.578710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:33.578713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535367146057790:3593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:33.579069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535367146057790:3593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:33.580933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535367146057790:3593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:33.584065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535367146057790:3593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:33.584074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535367146057790:3593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:33.584076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535367146057790:3593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:33.584081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:33.584682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:33.586184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:33.586203Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:33.586206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:33.586209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:33.586214Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2743 [1:7556535367146057774:3558]
2025-10-02T08:16:33.586231Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:33.586249Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:33.586257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.586261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.586268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.586281Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:33.586291Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:33.586302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:33.586357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.586364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.586366Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:33.586369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:33.586424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:33.586431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.586444Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.586461Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:33.586478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2743
2025-10-02T08:16:33.586480Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535367146057768:3558]
2025-10-02T08:16:33.586482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535367146057768:3558]
2025-10-02T08:16:33.586489Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:33.586497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:33.586502Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057821:3593], now have 1 active actors on pipe
2025-10-02T08:16:33.586504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:33.586506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535367605311911:2378], now have 1 active actors on pipe
2025-10-02T08:16:33.586513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:33.586527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:33.586535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:33.586542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.586549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.586546Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2743
2025-10-02T08:16:33.586583Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535367146057768:3558]
2025-10-02T08:16:33.586591Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:33.586600Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:33.586607Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:33.586613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.586617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.586620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:33.586634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.586645Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:33.586691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.586749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.586756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.586771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.586796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2744 partition: 0 MaxSeqNo: 17 sessionId: src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0
2025-10-02T08:16:33.587031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c39dfe2-d1257de8-48b1e6af-1c159e4e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:33.589349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0] Write session: try to update token
2025-10-02T08:16:33.589360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:33.602252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2744 sessionId: src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:33.604084Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:33.604102Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:33.604105Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:33.604114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535367146057768:3558]
2025-10-02T08:16:33.604121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535367146057768:3558]
2025-10-02T08:16:33.604163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:33.604171Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:33.604174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.604176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:33.604187Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:33.604302Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:33.604506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:33.670446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535367146057836:10248]
2025-10-02T08:16:33.670556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2743, pipe: [1:7556535367146057836:10248]
2025-10-02T08:16:33.730894Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:33.731112Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.731121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.731152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057836:10248], now have 1 active actors on pipe
2025-10-02T08:16:33.731233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535367146057836:10248]
2025-10-02T08:16:33.731248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:33.731250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:33.731292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2744 reason: error at write: Disconnected sessionId: src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0
2025-10-02T08:16:33.731336Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:33.731371Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:33.731437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2744 sessionId: src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0 is DEAD
2025-10-02T08:16:33.731572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:33.731582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0] Write session will restart in 0.007682s
2025-10-02T08:16:33.731607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0] Write session: Do CDS request
2025-10-02T08:16:33.731613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:33.735831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:33.736924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:33.737117Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:33.737123Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:33.737131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:33.737165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:33.737199Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535367146057935:3632]
2025-10-02T08:16:33.737627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:33.737827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:33.737873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:33.738101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:33.738135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.738140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.738140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.738141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.738141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.738145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.738152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.738154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.738156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.738158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.738162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.738166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.738169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.738172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.738178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.738180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.738182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.738185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.738187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.738189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.738200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:33.740277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.740356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:33.740368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2745
2025-10-02T08:16:33.740475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.740497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:33.740504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:33.740507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:33.740827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2745 sessionId:  describe result for acl check
2025-10-02T08:16:33.740857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:33.740860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:33.740861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:33.740864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535367146057951:3621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:33.741251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535367146057951:3621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:33.742894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535367146057951:3621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:33.745620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535367146057951:3621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:33.745637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535367146057951:3621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:33.745641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535367146057951:3621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:33.745650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:33.745981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:33.747302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:33.747315Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:33.747318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:33.747320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:33.747325Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2744 [1:7556535367146057935:3632]
2025-10-02T08:16:33.747333Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:33.747348Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:33.747353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.747355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.747356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.747367Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:33.747373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:33.747377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:33.747421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.747427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.747429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:33.747431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:33.747472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:33.747474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.747484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.747495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:33.747510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057982:3621], now have 1 active actors on pipe
2025-10-02T08:16:33.747520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535367146057929:3632]
2025-10-02T08:16:33.747522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535367146057929:3632]
2025-10-02T08:16:33.747526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2744
2025-10-02T08:16:33.747528Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:33.747536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535367605311917:2378], now have 1 active actors on pipe
2025-10-02T08:16:33.747538Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:33.747540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:33.747542Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:33.747555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:33.747561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:33.747569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.747573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.747586Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2744
2025-10-02T08:16:33.747605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535367146057929:3632]
2025-10-02T08:16:33.747612Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:33.747615Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:33.747623Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:33.747627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.747630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.747631Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:33.747637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.747643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:33.747669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.747705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.747712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.747722Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.747747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2745 partition: 0 MaxSeqNo: 17 sessionId: src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0
2025-10-02T08:16:33.748052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda7eccd-1406a744-711a8f8-2b087b3f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:33.750642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0] Write session: try to update token
2025-10-02T08:16:33.750657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:33.763989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2745 sessionId: src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:33.765702Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:33.765724Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:33.765727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:33.765735Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535367146057929:3632]
2025-10-02T08:16:33.765740Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535367146057929:3632]
2025-10-02T08:16:33.765779Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:33.765791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.765797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:33.765800Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:33.765806Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:33.765925Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:33.766371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:33.831203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535367146057997:10248]
2025-10-02T08:16:33.831306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2744, pipe: [1:7556535367146057997:10248]
2025-10-02T08:16:33.898717Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:33.899021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.899031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.899059Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146057997:10248], now have 1 active actors on pipe
2025-10-02T08:16:33.899138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:33.899144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:33.899180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2745 reason: error at write: Disconnected sessionId: src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0
2025-10-02T08:16:33.899235Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:33.899286Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:33.899322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2745 sessionId: src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0 is DEAD
2025-10-02T08:16:33.899460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:33.899468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0] Write session will restart in 0.007777s
2025-10-02T08:16:33.899484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0] Write session: Do CDS request
2025-10-02T08:16:33.899488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:33.899474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535367146057997:10248]
2025-10-02T08:16:33.904847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:33.905875Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:33.905990Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:33.905997Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:33.906003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:33.906031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:33.906062Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535367146058092:3659]
2025-10-02T08:16:33.906472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:33.906658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:33.906685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:33.906856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:33.906883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.906884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.906884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.906885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.906886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.906888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.906895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.906897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.906899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.906901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.906904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.906909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:33.906912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.906914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:33.906917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.906919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:33.906922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.906924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.906927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.906929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.906939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:33.908193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.908290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:33.908303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2746
2025-10-02T08:16:33.908387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:33.908412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:33.908421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:33.908424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:33.908728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2746 sessionId:  describe result for acl check
2025-10-02T08:16:33.908752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:33.908759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:33.908761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:33.908765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535367146058110:3683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:33.909191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535367146058110:3683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:33.910738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535367146058110:3683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:33.913766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535367146058110:3683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:33.913780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535367146058110:3683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:33.913783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535367146058110:3683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:33.913792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:33.914395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:33.915836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:33.915853Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:33.915856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:33.915861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:33.915868Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2745 [1:7556535367146058092:3659]
2025-10-02T08:16:33.915879Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:33.915894Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:33.915897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.915900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.915902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.915917Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:33.915922Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:33.915928Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:33.915990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.916000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.916003Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:33.916006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:33.916078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:33.916086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.916097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:33.916110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:33.916127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146058142:3683], now have 1 active actors on pipe
2025-10-02T08:16:33.916137Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535367146058086:3659]
2025-10-02T08:16:33.916139Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535367146058086:3659]
2025-10-02T08:16:33.916147Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:33.916148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2745
2025-10-02T08:16:33.916154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535367605311925:2378], now have 1 active actors on pipe
2025-10-02T08:16:33.916156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:33.916159Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:33.916166Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:33.916178Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:33.916183Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:33.916188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.916192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.916228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535367146058086:3659]
2025-10-02T08:16:33.916219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2745
2025-10-02T08:16:33.916241Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:33.916254Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:33.916255Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:33.916262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:33.916265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:33.916267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:33.916276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:33.916285Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:33.916324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.916365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:33.916378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:33.916399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:33.916449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2746 partition: 0 MaxSeqNo: 17 sessionId: src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0
2025-10-02T08:16:33.916778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38357756-6a6c9c1b-2f29ab06-4a48aee6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:33.919457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0] Write session: try to update token
2025-10-02T08:16:33.919474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:33.932598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2746 sessionId: src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:33.932641Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:33.932643Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:33.932645Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:33.932650Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535367146058086:3659]
2025-10-02T08:16:33.932653Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535367146058086:3659]
2025-10-02T08:16:33.932689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:33.932701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:33.932703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:33.932837Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:33.932849Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:33.932854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:33.935054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:33.999687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535367146058169:10248]
2025-10-02T08:16:33.999758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2745, pipe: [1:7556535367146058169:10248]
2025-10-02T08:16:34.055033Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:34.055336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.055345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.055372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535367146058169:10248], now have 1 active actors on pipe
2025-10-02T08:16:34.055556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535367146058169:10248]
2025-10-02T08:16:34.055591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:34.055594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:34.055644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2746 reason: error at write: Disconnected sessionId: src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0
2025-10-02T08:16:34.055623Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:34.055679Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:34.055811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2746 sessionId: src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0 is DEAD
2025-10-02T08:16:34.055919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:34.055928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0] Write session will restart in 0.009179s
2025-10-02T08:16:34.055945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0] Write session: Do CDS request
2025-10-02T08:16:34.055950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:34.059994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:34.060916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:34.061034Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:34.061041Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:34.061047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:34.061073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:34.061103Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535371441025560:3687]
2025-10-02T08:16:34.061489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:34.061653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:34.061678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:34.061861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:34.061888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.061892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.061895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.061896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.061896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.061899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.061905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.061910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.061912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.061915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.061918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.061922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.061925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.061928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.061930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.061932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.061938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.061941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.061943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.061945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.061955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:34.066183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.066318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:34.066330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2747
2025-10-02T08:16:34.066430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.066453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:34.066459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:34.066461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:34.066799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2747 sessionId:  describe result for acl check
2025-10-02T08:16:34.066830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:34.066832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:34.066834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:34.066838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535371441025576:3697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:34.067290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535371441025576:3697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:34.068875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535371441025576:3697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:34.069146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:34.070500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:34.070512Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:34.070514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:34.070516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:34.070520Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2746 [1:7556535371441025560:3687]
2025-10-02T08:16:34.070528Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:34.070539Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:34.070540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.070542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.070543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.070554Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:34.070557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:34.070564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:34.070883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.070889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.070891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:34.070892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:34.070936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:34.070941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.070948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.070955Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:34.070970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535371900279240:2378], now have 1 active actors on pipe
2025-10-02T08:16:34.070978Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535371441025554:3687]
2025-10-02T08:16:34.070979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535371441025554:3687]
2025-10-02T08:16:34.070987Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:34.070997Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:34.071001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:34.071003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:34.071008Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:34.071009Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:34.071017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535371441025576:3697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:34.071022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535371441025576:3697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:34.071027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535371441025576:3697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:34.071027Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535371441025554:3687]
2025-10-02T08:16:34.071029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:34.071032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:34.071039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:34.071015Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2746
2025-10-02T08:16:34.071188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2746
2025-10-02T08:16:34.071200Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441025612:3697], now have 1 active actors on pipe
2025-10-02T08:16:34.071205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.071211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.071231Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9062fd-f297899c-e072363f-f2b3118b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:34.071242Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.071250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.071251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:34.071259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.071269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:34.071288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.071324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.071331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.071347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.071374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2747 partition: 0 MaxSeqNo: 17 sessionId: src_id|a9062fd-f297899c-e072363f-f2b3118b_0
2025-10-02T08:16:34.071667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bdbe092-eee7cc71-87349f43-1e49a518_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a9062fd-f297899c-e072363f-f2b3118b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:34.074124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9062fd-f297899c-e072363f-f2b3118b_0] Write session: try to update token
2025-10-02T08:16:34.074138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9062fd-f297899c-e072363f-f2b3118b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:34.086055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2747 sessionId: src_id|a9062fd-f297899c-e072363f-f2b3118b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:34.087052Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:34.087071Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:34.087073Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:34.087082Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535371441025554:3687]
2025-10-02T08:16:34.087087Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535371441025554:3687]
2025-10-02T08:16:34.087120Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:34.087131Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:34.087134Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:34.087144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.087147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:34.087320Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:34.088790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:34.161010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535371441025639:10248]
2025-10-02T08:16:34.164280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2746, pipe: [1:7556535371441025639:10248]
2025-10-02T08:16:34.214638Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:34.214921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.214934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.214970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441025639:10248], now have 1 active actors on pipe
2025-10-02T08:16:34.215131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:34.215143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:34.215194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2747 reason: error at write: Disconnected sessionId: src_id|a9062fd-f297899c-e072363f-f2b3118b_0
2025-10-02T08:16:34.215236Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:34.215296Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:34.215388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2747 sessionId: src_id|a9062fd-f297899c-e072363f-f2b3118b_0 is DEAD
2025-10-02T08:16:34.215506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9062fd-f297899c-e072363f-f2b3118b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:34.215517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9062fd-f297899c-e072363f-f2b3118b_0] Write session will restart in 0.008079s
2025-10-02T08:16:34.215540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9062fd-f297899c-e072363f-f2b3118b_0] Write session: Do CDS request
2025-10-02T08:16:34.215527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535371441025639:10248]
2025-10-02T08:16:34.215548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9062fd-f297899c-e072363f-f2b3118b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:34.220411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:34.221373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:34.221494Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:34.221502Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:34.221508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:34.221538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:34.221564Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535371441025758:3780]
2025-10-02T08:16:34.221954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:34.222087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:34.222111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:34.222289Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:34.222316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.222320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.222321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.222321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.222321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.222324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.222330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.222332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.222334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.222336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.222339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.222343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.222346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.222349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.222351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.222354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.222356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.222358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.222361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.222363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.222373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:34.224266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9062fd-f297899c-e072363f-f2b3118b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.224305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:34.224317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2748
2025-10-02T08:16:34.224479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.224522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:34.224531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:34.224539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:34.224983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2748 sessionId:  describe result for acl check
2025-10-02T08:16:34.225016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:34.225023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:34.225024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:34.225030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535371441025774:3774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:34.225490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535371441025774:3774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:34.227335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535371441025774:3774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:34.229812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:34.230042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535371441025774:3774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:34.230053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535371441025774:3774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:34.230055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535371441025774:3774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:34.230062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:34.231175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:34.231188Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:34.231189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:34.231192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:34.231197Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2747 [1:7556535371441025758:3780]
2025-10-02T08:16:34.231204Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:34.231217Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:34.231222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.231224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.231225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.231237Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:34.231240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:34.231244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:34.231296Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.231302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.231304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:34.231306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:34.231348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:34.231354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.231362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.231369Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:34.231373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2747
2025-10-02T08:16:34.231381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441025806:3774], now have 1 active actors on pipe
2025-10-02T08:16:34.231387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535371900279269:2378], now have 1 active actors on pipe
2025-10-02T08:16:34.231390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.231392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.231403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535371441025752:3780]
2025-10-02T08:16:34.231408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535371441025752:3780]
2025-10-02T08:16:34.231415Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:34.231427Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:34.231428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:34.231434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:34.231437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:34.231438Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:34.231448Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a067f284-3df68395-8173dba-522d597d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:34.231453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.231459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.231460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:34.231466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.231476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:34.231458Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2747
2025-10-02T08:16:34.231502Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535371441025752:3780]
2025-10-02T08:16:34.231510Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:34.231521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.231525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:34.231564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.231576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.231594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.231622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2748 partition: 0 MaxSeqNo: 17 sessionId: src_id|a067f284-3df68395-8173dba-522d597d_0
2025-10-02T08:16:34.231881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9062fd-f297899c-e072363f-f2b3118b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a067f284-3df68395-8173dba-522d597d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:34.234170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a067f284-3df68395-8173dba-522d597d_0] Write session: try to update token
2025-10-02T08:16:34.234183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a067f284-3df68395-8173dba-522d597d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:34.241358Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:34.241375Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:34.241382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535371441025752:3780]
2025-10-02T08:16:34.241412Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:34.241421Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:34.241557Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:34.241677Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:34.241793Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:34.241906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:34.242064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:34.242091Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:34.245533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2748 sessionId: src_id|a067f284-3df68395-8173dba-522d597d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:34.247903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:34.247987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.247999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.248041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:34.248067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:34.248125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.248140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.248274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.248328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.248383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.248434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.248641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.248648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.248714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.248764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.248831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.248890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.248928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.248933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.248990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.249041Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.249093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.249147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.249186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.249191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.249247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.249298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.249351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.249405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.249460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.249465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.249523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.249574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.249627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.249679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.249717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.249723Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.249777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.249831Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.249884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.249937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.249979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.249986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.250040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.250091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.250148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.250203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.250242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.250247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.250302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.250353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.250406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.250461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.250499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.250504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.250558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.250609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.250660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.250710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.250749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.250753Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.250806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:34.250857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:34.250910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:34.250964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:34.251005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:34.251010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:34.251036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:34.251082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.251095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.251100Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:34.251123Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:34.251135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:34.251140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:34.251141Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:34.251143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:34.251458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:34.251476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:34.251483Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:34.251486Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:34.251489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:34.251491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:34.251971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:34.251989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:34.251996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:34.251998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:34.251999Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:34.252005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:34.252444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:34.252461Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:34.252465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:34.252470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:34.252471Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:34.253484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:34.253499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:34.253507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392994253
2025-10-02T08:16:34.253625Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:34.253633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:34.253638Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:34.253640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:34.253642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:34.253644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:34.254008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:34.254024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:34.254031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:34.254033Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:34.254035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:34.254037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:34.254427Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:34.254442Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:34.254450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:34.254455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:34.254457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:34.254459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:34.254829Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:34.254845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:34.254848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:34.255723Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:34.255738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:34.255741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:34.255743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:34.255747Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392994255
2025-10-02T08:16:34.255997Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:34.256011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:34.256014Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:34.256026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:34.256028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:34.256030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:34.256401Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:34.256416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:34.256421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:34.256423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:34.256426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:34.256428Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:34.256820Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:34.256835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.256905Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392994256
2025-10-02T08:16:34.257528Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:34.257545Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:34.257551Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:34.257554Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:34.258901Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:34.258908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:34.258909Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:34.258917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535371441025752:3780]
2025-10-02T08:16:34.258923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535371441025752:3780]
2025-10-02T08:16:34.258962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:34.258968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.258969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:34.258985Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:34.258999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:34.259078Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:34.315571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535371441025828:10248]
2025-10-02T08:16:34.315674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2747, pipe: [1:7556535371441025828:10248]
2025-10-02T08:16:34.387963Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:34.388405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441025828:10248], now have 1 active actors on pipe
2025-10-02T08:16:34.388479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535371441025828:10248]
2025-10-02T08:16:34.388498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:34.388505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:34.388527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2748 reason: error at write: Disconnected sessionId: src_id|a067f284-3df68395-8173dba-522d597d_0
2025-10-02T08:16:34.388601Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:34.388600Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:34.388743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2748 sessionId: src_id|a067f284-3df68395-8173dba-522d597d_0 is DEAD
2025-10-02T08:16:34.388909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a067f284-3df68395-8173dba-522d597d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:34.388919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a067f284-3df68395-8173dba-522d597d_0] Write session will restart in 0.007264s
2025-10-02T08:16:34.388940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a067f284-3df68395-8173dba-522d597d_0] Write session: Do CDS request
2025-10-02T08:16:34.388947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a067f284-3df68395-8173dba-522d597d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:34.393808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:34.394784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:34.394917Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:34.394925Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:34.394932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:34.394962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:34.394991Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535371441025929:3842]
2025-10-02T08:16:34.395415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:34.395571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:34.395605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:34.395820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:34.395848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.395852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.395853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.395854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.395854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.395858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.395865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.395867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.395869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.395871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.395875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.395879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.395882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.395886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.395888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.395891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.395893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.395896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.395901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.395904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.395914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:34.397274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a067f284-3df68395-8173dba-522d597d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.397384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:34.397394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2749
2025-10-02T08:16:34.397523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.397547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:34.397555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:34.397557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:34.397900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2749 sessionId:  describe result for acl check
2025-10-02T08:16:34.397930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:34.397935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:34.397936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:34.397942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535371441025945:3849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:34.398320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535371441025945:3849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:34.400461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535371441025945:3849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:34.403384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535371441025945:3849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:34.403400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535371441025945:3849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:34.403404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535371441025945:3849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:34.403411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:34.403975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:34.405394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:34.405409Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:34.405411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:34.405417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:34.405422Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2748 [1:7556535371441025929:3842]
2025-10-02T08:16:34.405431Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:34.405444Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:34.405446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.405448Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.405449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.405462Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:34.405467Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:34.405479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:34.405529Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.405535Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.405538Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:34.405539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:34.405587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:34.405593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.405602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.405609Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:34.405620Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535371441025923:3842]
2025-10-02T08:16:34.405625Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535371441025923:3842]
2025-10-02T08:16:34.405634Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:34.405642Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:34.405655Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:34.405658Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:34.405673Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:34.405683Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:34.405686Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535371441025923:3842]
2025-10-02T08:16:34.405688Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:34.405730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2748
2025-10-02T08:16:34.405736Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:34.405737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441025976:3849], now have 1 active actors on pipe
2025-10-02T08:16:34.405765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.405776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.405788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535371900279278:2378], now have 1 active actors on pipe
2025-10-02T08:16:34.405803Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|105078b6-2cba1d32-5727c6a1-216c17e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:34.405815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.405819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.405826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:34.405835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.405852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:34.405835Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2748
2025-10-02T08:16:34.405880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.405906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.405912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.405922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.405952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2749 partition: 0 MaxSeqNo: 17 sessionId: src_id|105078b6-2cba1d32-5727c6a1-216c17e_0
2025-10-02T08:16:34.406285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a067f284-3df68395-8173dba-522d597d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|105078b6-2cba1d32-5727c6a1-216c17e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:34.408761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105078b6-2cba1d32-5727c6a1-216c17e_0] Write session: try to update token
2025-10-02T08:16:34.408778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105078b6-2cba1d32-5727c6a1-216c17e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:34.421678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2749 sessionId: src_id|105078b6-2cba1d32-5727c6a1-216c17e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:34.422633Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:34.422647Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:34.422649Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:34.422656Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535371441025923:3842]
2025-10-02T08:16:34.422660Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535371441025923:3842]
2025-10-02T08:16:34.422699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:34.422704Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:34.422707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:34.422712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.422714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:34.422841Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:34.424504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:34.488628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535371441025991:10248]
2025-10-02T08:16:34.488743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2748, pipe: [1:7556535371441025991:10248]
2025-10-02T08:16:34.544081Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:34.544406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.544416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.544445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441025991:10248], now have 1 active actors on pipe
2025-10-02T08:16:34.544542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535371441025991:10248]
2025-10-02T08:16:34.544564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:34.544566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:34.544626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2749 reason: error at write: Disconnected sessionId: src_id|105078b6-2cba1d32-5727c6a1-216c17e_0
2025-10-02T08:16:34.544651Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:34.544702Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:34.544780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2749 sessionId: src_id|105078b6-2cba1d32-5727c6a1-216c17e_0 is DEAD
2025-10-02T08:16:34.544942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105078b6-2cba1d32-5727c6a1-216c17e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:34.544952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105078b6-2cba1d32-5727c6a1-216c17e_0] Write session will restart in 0.008651s
2025-10-02T08:16:34.544976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105078b6-2cba1d32-5727c6a1-216c17e_0] Write session: Do CDS request
2025-10-02T08:16:34.544983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105078b6-2cba1d32-5727c6a1-216c17e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:34.550270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:34.551106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:34.551233Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:34.551240Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:34.551246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:34.551273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:34.551309Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535371441026094:3852]
2025-10-02T08:16:34.551752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:34.551885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:34.551909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:34.552110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:34.552141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.552145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.552146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.552147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.552147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.552150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.552156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.552158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.552160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.552162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.552166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.552170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.552175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.552177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.552180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.552182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.552184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.552186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.552189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.552191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.552201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:34.554234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105078b6-2cba1d32-5727c6a1-216c17e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.554363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:34.554370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2750
2025-10-02T08:16:34.554478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.554499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:34.554503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:34.554505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:34.554774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2750 sessionId:  describe result for acl check
2025-10-02T08:16:34.554797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:34.554801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:34.554802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:34.554806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535371441026110:3864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:34.555180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535371441026110:3864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:34.556821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535371441026110:3864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:34.559468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535371441026110:3864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:34.559481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535371441026110:3864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:34.559483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535371441026110:3864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:34.559489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:34.560246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:34.561704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:34.561719Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:34.561721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:34.561723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:34.561728Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2749 [1:7556535371441026094:3852]
2025-10-02T08:16:34.561735Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:34.561747Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:34.561749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.561751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.561752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.561766Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:34.561769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:34.561773Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:34.561822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.561828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.561831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:34.561832Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:34.561887Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:34.561892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.561900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.561907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:34.561916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2749
2025-10-02T08:16:34.561924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441026145:3864], now have 1 active actors on pipe
2025-10-02T08:16:34.561930Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535371900279284:2378], now have 1 active actors on pipe
2025-10-02T08:16:34.561934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535371441026088:3852]
2025-10-02T08:16:34.561935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535371441026088:3852]
2025-10-02T08:16:34.561944Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:34.561951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.561955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:34.561956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.561958Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:34.561969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:34.561977Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:34.561982Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:34.561969Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2749
2025-10-02T08:16:34.562010Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e65396dd-784ed341-ccdc566f-104c32e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:34.562020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.562022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.562023Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:34.562029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.562039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:34.562047Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535371441026088:3852]
2025-10-02T08:16:34.562055Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:34.562071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.562072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:34.562117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.562128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.562147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.562182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2750 partition: 0 MaxSeqNo: 17 sessionId: src_id|e65396dd-784ed341-ccdc566f-104c32e_0
2025-10-02T08:16:34.562425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105078b6-2cba1d32-5727c6a1-216c17e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e65396dd-784ed341-ccdc566f-104c32e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:34.564709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65396dd-784ed341-ccdc566f-104c32e_0] Write session: try to update token
2025-10-02T08:16:34.564724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65396dd-784ed341-ccdc566f-104c32e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:34.578573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2750 sessionId: src_id|e65396dd-784ed341-ccdc566f-104c32e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:34.579338Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:34.579355Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:34.579357Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:34.579365Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535371441026088:3852]
2025-10-02T08:16:34.579370Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535371441026088:3852]
2025-10-02T08:16:34.579409Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:34.579409Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:34.579413Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:34.579418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.579422Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:34.579542Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:34.580948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:34.644831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535371441026160:10248]
2025-10-02T08:16:34.644963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2749, pipe: [1:7556535371441026160:10248]
2025-10-02T08:16:34.701398Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:34.701676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.701686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.701716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441026160:10248], now have 1 active actors on pipe
2025-10-02T08:16:34.701840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535371441026160:10248]
2025-10-02T08:16:34.701869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:34.701877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:34.701901Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:34.701901Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:34.701936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2750 reason: error at write: Disconnected sessionId: src_id|e65396dd-784ed341-ccdc566f-104c32e_0
2025-10-02T08:16:34.702109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2750 sessionId: src_id|e65396dd-784ed341-ccdc566f-104c32e_0 is DEAD
2025-10-02T08:16:34.702256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65396dd-784ed341-ccdc566f-104c32e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:34.702263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65396dd-784ed341-ccdc566f-104c32e_0] Write session will restart in 0.008615s
2025-10-02T08:16:34.702284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65396dd-784ed341-ccdc566f-104c32e_0] Write session: Do CDS request
2025-10-02T08:16:34.702288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65396dd-784ed341-ccdc566f-104c32e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:34.707050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:34.708288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:34.708406Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:34.708415Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:34.708421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:34.708450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:34.708478Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535371441026264:3902]
2025-10-02T08:16:34.708882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:34.709046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:34.709078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:34.709271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:34.709301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.709303Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.709304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.709305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.709305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.709309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.709315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.709318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.709320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.709321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.709325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.709330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.709333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.709337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.709340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.709342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.709344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.709347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.709350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.709352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.709369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:34.712223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65396dd-784ed341-ccdc566f-104c32e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.712350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:34.712361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2751
2025-10-02T08:16:34.712505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.712527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:34.712534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:34.712537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:34.712937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2751 sessionId:  describe result for acl check
2025-10-02T08:16:34.712981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:34.712987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:34.712990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:34.712995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535371441026280:3925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:34.713532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535371441026280:3925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:34.715219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535371441026280:3925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:34.717332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:34.717847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535371441026280:3925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:34.717861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535371441026280:3925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:34.717863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535371441026280:3925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:34.717869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:34.718777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:34.718793Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:34.718795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:34.718798Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:34.718802Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2750 [1:7556535371441026264:3902]
2025-10-02T08:16:34.718810Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:34.718825Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:34.718827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.718830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.718832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.718846Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:34.718851Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:34.718860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:34.718907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.718913Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.718915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:34.718917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:34.718959Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:34.718966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.718977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.718992Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:34.719007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535371441026258:3902]
2025-10-02T08:16:34.719012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535371441026258:3902]
2025-10-02T08:16:34.719019Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:34.719028Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:34.719034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441026311:3925], now have 1 active actors on pipe
2025-10-02T08:16:34.719037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:34.719041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:34.719052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:34.719054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2750
2025-10-02T08:16:34.719058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:34.719062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535371900279291:2378], now have 1 active actors on pipe
2025-10-02T08:16:34.719065Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2750
2025-10-02T08:16:34.719092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.719102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.719113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535371441026258:3902]
2025-10-02T08:16:34.719122Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:34.719142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:34.719155Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9eebba24-130284c3-7453da5b-e0a81239_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:34.719165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.719172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.719173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:34.719181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.719191Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:34.719220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.719258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.719263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.719276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.719306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2751 partition: 0 MaxSeqNo: 17 sessionId: src_id|9eebba24-130284c3-7453da5b-e0a81239_0
2025-10-02T08:16:34.719607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65396dd-784ed341-ccdc566f-104c32e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9eebba24-130284c3-7453da5b-e0a81239_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:34.721864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eebba24-130284c3-7453da5b-e0a81239_0] Write session: try to update token
2025-10-02T08:16:34.721877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eebba24-130284c3-7453da5b-e0a81239_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:34.733903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2751 sessionId: src_id|9eebba24-130284c3-7453da5b-e0a81239_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:34.736196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:34.736597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.736619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.736639Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:34.736646Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:34.736648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:34.736655Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535371441026258:3902]
2025-10-02T08:16:34.736659Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535371441026258:3902]
2025-10-02T08:16:34.736703Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:34.736706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:34.736712Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.736714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:34.736716Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:34.736870Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:34.801990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535371441026329:10248]
2025-10-02T08:16:34.802110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2750, pipe: [1:7556535371441026329:10248]
2025-10-02T08:16:34.859852Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:34.860217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:34.860253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:34.860255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441026329:10248], now have 1 active actors on pipe
2025-10-02T08:16:34.860346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535371441026329:10248]
2025-10-02T08:16:34.860359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:34.860361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:34.860382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2751 reason: error at write: Disconnected sessionId: src_id|9eebba24-130284c3-7453da5b-e0a81239_0
2025-10-02T08:16:34.860465Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:34.860549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2751 sessionId: src_id|9eebba24-130284c3-7453da5b-e0a81239_0 is DEAD
2025-10-02T08:16:34.860684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eebba24-130284c3-7453da5b-e0a81239_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:34.860694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eebba24-130284c3-7453da5b-e0a81239_0] Write session will restart in 0.005889s
2025-10-02T08:16:34.860715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eebba24-130284c3-7453da5b-e0a81239_0] Write session: Do CDS request
2025-10-02T08:16:34.860721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eebba24-130284c3-7453da5b-e0a81239_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:34.866334Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:34.867226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eebba24-130284c3-7453da5b-e0a81239_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.867295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:34.867356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:34.867367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2752
2025-10-02T08:16:34.867442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:34.867442Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:34.867445Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:34.867454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:34.867461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:34.867464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:34.867467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:34.867492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:34.867525Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535371441026436:3991]
2025-10-02T08:16:34.867728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2752 sessionId:  describe result for acl check
2025-10-02T08:16:34.867749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:34.867751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:34.867752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:34.867755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535371441026440:3992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:34.868113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535371441026440:3992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:34.868187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:34.868394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:34.868434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:34.868758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:34.868838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.868845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.868846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.868847Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.868848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.868853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.868862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.868866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.868869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.868873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.868878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.868890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:34.868899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.868907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:34.868909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.868912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:34.868915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.868919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.868922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.868927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.868938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:34.869791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535371441026440:3992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:34.875624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535371441026440:3992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:34.875639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535371441026440:3992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:34.875642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535371441026440:3992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:34.875649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:34.876502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:34.877983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:34.877997Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:34.878000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:34.878003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:34.878011Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2751 [1:7556535371441026436:3991]
2025-10-02T08:16:34.878021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:34.878040Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:34.878042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.878045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.878047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.878060Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:34.878064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:34.878070Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:34.878117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.878124Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.878126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:34.878129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:34.878185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:34.878193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.878204Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:34.878217Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:34.878238Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535371441026429:3991]
2025-10-02T08:16:34.878240Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535371441026429:3991]
2025-10-02T08:16:34.878246Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:34.878253Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:34.878255Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:34.878256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441026485:3992], now have 1 active actors on pipe
2025-10-02T08:16:34.878263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:34.878276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2751
2025-10-02T08:16:34.878277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:34.878279Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:34.878285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535371900279299:2378], now have 1 active actors on pipe
2025-10-02T08:16:34.878307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.878315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.878326Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535371441026429:3991]
2025-10-02T08:16:34.878336Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:34.878339Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:34.878335Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2751
2025-10-02T08:16:34.878362Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:34.878371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:34.878374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:34.878376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:34.878382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:34.878393Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:34.878418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.878454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.878459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.878469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:34.878499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2752 partition: 0 MaxSeqNo: 17 sessionId: src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0
2025-10-02T08:16:34.878786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eebba24-130284c3-7453da5b-e0a81239_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:34.881247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0] Write session: try to update token
2025-10-02T08:16:34.881262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:34.892945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2752 sessionId: src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:34.895102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:34.895272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:34.895296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:34.895318Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:34.895328Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:34.895338Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:34.895347Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535371441026429:3991]
2025-10-02T08:16:34.895350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535371441026429:3991]
2025-10-02T08:16:34.895391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:34.895395Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:34.895400Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:34.895400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:34.895401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:34.895519Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:34.960717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535371441026500:10248]
2025-10-02T08:16:34.960871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2751, pipe: [1:7556535371441026500:10248]
2025-10-02T08:16:35.021093Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:35.021445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:35.021477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:35.021480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535371441026500:10248], now have 1 active actors on pipe
2025-10-02T08:16:35.021562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:35.021568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:35.021592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2752 reason: error at write: Disconnected sessionId: src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0
2025-10-02T08:16:35.021709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2752 sessionId: src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0 is DEAD
2025-10-02T08:16:35.021743Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:35.021833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535371441026500:10248]
2025-10-02T08:16:35.021854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:35.021864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0] Write session will restart in 0.008346s
2025-10-02T08:16:35.021886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0] Write session: Do CDS request
2025-10-02T08:16:35.021896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:35.026611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:35.027368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:35.027476Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:35.027482Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:35.027488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:35.027514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:35.027541Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535375735993914:4047]
2025-10-02T08:16:35.027996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:35.028140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:35.028171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:35.028361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:35.028389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.028393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.028394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.028395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.028395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.028400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.028407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.028409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.028411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.028412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.028416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.028422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.028426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.028428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.028434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.028437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.028439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.028441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.028443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.028446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.028456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:35.031195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.031559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:35.031572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2753
2025-10-02T08:16:35.031671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.031699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:35.031708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:35.031711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:35.032010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2753 sessionId:  describe result for acl check
2025-10-02T08:16:35.032051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:35.032056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:35.032058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:35.032061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535375735993930:4055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:35.032398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535375735993930:4055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:35.033918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535375735993930:4055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:35.036008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:35.036013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535375735993930:4055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:35.036028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535375735993930:4055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:35.036031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535375735993930:4055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:35.036036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:35.037292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:35.037304Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:35.037305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:35.037307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:35.037311Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2752 [1:7556535375735993914:4047]
2025-10-02T08:16:35.037317Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:35.037328Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:35.037330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.037331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.037333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.037342Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:35.037345Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:35.037349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:35.037388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.037394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.037396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:35.037397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:35.037436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:35.037441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.037448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.037455Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:35.037465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535375735993908:4047]
2025-10-02T08:16:35.037466Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535375735993908:4047]
2025-10-02T08:16:35.037471Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:35.037478Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:35.037480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:35.037483Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:35.037485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2752
2025-10-02T08:16:35.037490Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:35.037491Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:35.037499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735993962:4055], now have 1 active actors on pipe
2025-10-02T08:16:35.037501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535376195246614:2378], now have 1 active actors on pipe
2025-10-02T08:16:35.037519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.037524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.037533Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535375735993908:4047]
2025-10-02T08:16:35.037538Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:35.037540Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:35.037529Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2752
2025-10-02T08:16:35.037553Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:35.037560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.037562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.037563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:35.037568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.037573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:35.037589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.037621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.037625Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.037635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.037656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2753 partition: 0 MaxSeqNo: 17 sessionId: src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0
2025-10-02T08:16:35.037902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88fda1b-8c4cac85-ef7011d0-ce5bf7d4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:35.040482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0] Write session: try to update token
2025-10-02T08:16:35.040496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:35.051845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2753 sessionId: src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:35.054010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:35.054986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.055011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.055032Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:35.055040Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:35.055042Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:35.055050Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535375735993908:4047]
2025-10-02T08:16:35.055058Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535375735993908:4047]
2025-10-02T08:16:35.055089Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:35.055098Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:35.055103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:35.055109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.055112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:35.055231Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:35.098086Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:25313 } ]
2025-10-02T08:16:35.121991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535375735993978:10248]
2025-10-02T08:16:35.122095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2752, pipe: [1:7556535375735993978:10248]
2025-10-02T08:16:35.195327Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:35.195739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:35.195768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735993978:10248], now have 1 active actors on pipe
2025-10-02T08:16:35.195914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:35.196266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:35.196322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:35.196330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:35.196381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2753 reason: error at write: Disconnected sessionId: src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0
2025-10-02T08:16:35.196533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2753 sessionId: src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0 is DEAD
2025-10-02T08:16:35.196601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535375735993978:10248]
2025-10-02T08:16:35.196685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:35.196694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0] Write session will restart in 0.008248s
2025-10-02T08:16:35.196714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0] Write session: Do CDS request
2025-10-02T08:16:35.196720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:35.200509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:35.201381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:35.201493Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:35.201500Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:35.201506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:35.201535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:35.201570Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535375735994128:4158]
2025-10-02T08:16:35.201997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:35.202127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:35.202151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:35.202339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:35.202368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.202372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.202372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.202373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.202374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.202376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.202381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.202383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.202385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.202387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.202390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.202394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.202399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.202407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.202411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.202415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.202422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.202426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.202431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.202435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.202455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:35.206230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.206283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:35.206291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2754
2025-10-02T08:16:35.206419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.206439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:35.206446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:35.206448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:35.206716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2754 sessionId:  describe result for acl check
2025-10-02T08:16:35.206742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:35.206748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:35.206750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:35.206753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535375735994145:4218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:35.207340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535375735994145:4218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:35.209044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535375735994145:4218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:35.210077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:35.211395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:35.211410Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:35.211412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:35.211415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:35.211420Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2753 [1:7556535375735994128:4158]
2025-10-02T08:16:35.211430Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:35.211440Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:35.211443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.211445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.211446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.211456Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:35.211459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:35.211463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:35.211508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.211515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.211518Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:35.211520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:35.211634Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:35.211640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.211652Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.211663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:35.211640Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2753
2025-10-02T08:16:35.211678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535376195246642:2378], now have 1 active actors on pipe
2025-10-02T08:16:35.211688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535375735994122:4158]
2025-10-02T08:16:35.211690Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535375735994122:4158]
2025-10-02T08:16:35.211696Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:35.211709Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:35.211719Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:35.211721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:35.211722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:35.211723Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:35.211747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535375735994122:4158]
2025-10-02T08:16:35.211754Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:35.211764Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:35.212040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535375735994145:4218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:35.212052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535375735994145:4218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:35.212055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535375735994145:4218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:35.212062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:35.212252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2753
2025-10-02T08:16:35.212262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994180:4218], now have 1 active actors on pipe
2025-10-02T08:16:35.212266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.212269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.212289Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96f355fd-37870243-30233f4e-ed597c4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:35.212301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.212308Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.212311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:35.212319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.212331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:35.212344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.212398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.212405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.212422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.212454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2754 partition: 0 MaxSeqNo: 17 sessionId: src_id|96f355fd-37870243-30233f4e-ed597c4f_0
2025-10-02T08:16:35.212746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135c0a25-82a2723d-73f0a9c9-766dfb80_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|96f355fd-37870243-30233f4e-ed597c4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:35.215293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f355fd-37870243-30233f4e-ed597c4f_0] Write session: try to update token
2025-10-02T08:16:35.215309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f355fd-37870243-30233f4e-ed597c4f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:35.222510Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:35.222526Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:35.222535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535375735994122:4158]
2025-10-02T08:16:35.222579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:35.222604Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:35.222746Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:35.222871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:35.222996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:35.223159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:35.223338Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:35.223368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:35.228618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2754 sessionId: src_id|96f355fd-37870243-30233f4e-ed597c4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:35.230809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:35.230891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.230900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.230924Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:35.230943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:35.230995Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.231001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.231146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.231204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.231263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.231320Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.231365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.231372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.231427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.231476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.231534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.231594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.231631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.231639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.231693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.231744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.231792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.231842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.231880Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.231887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.231940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.231999Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.232072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.232130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.232168Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.232173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.232227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.232279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.232336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.232388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.232425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.232430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.232483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.232539Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.232590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.232640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.232678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.232683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.232736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.232785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.232850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.232900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.232941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.232948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.233011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.233070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.233125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.233177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.233214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.233220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.233274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.233330Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.233384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.233444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.233485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.233490Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.233544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.233593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.233641Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.233691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.233727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.233734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.233762Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:35.233810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.233825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.233829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:35.233852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:35.233864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:35.233869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:35.233871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:35.233873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:35.234200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:35.234218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:35.234225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:35.234229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:35.234231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:35.234234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:35.234630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:35.234650Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:35.234657Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:35.234659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:35.234661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:35.234664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:35.235169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:35.235190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:35.235197Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:35.235200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:35.235201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:35.236228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:35.236241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:35.236250Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392995236
2025-10-02T08:16:35.236426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:35.236439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:35.236447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:35.236449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:35.236453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:35.236454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:35.236852Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:35.236867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:35.236871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:35.236877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:35.236878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:35.236880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:35.237234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:35.237247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:35.237253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:35.237255Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:35.237257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:35.237260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:35.237648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:35.237664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:35.237667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:35.238561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:35.238576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:35.238579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:35.238581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:35.238586Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392995238
2025-10-02T08:16:35.238849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:35.238864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:35.238871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:35.238873Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:35.238876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:35.238879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:35.239270Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:35.239288Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:35.239295Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:35.239297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:35.239300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:35.239302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:35.239641Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:35.239654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.239724Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392995239
2025-10-02T08:16:35.240355Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:35.240372Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:35.240382Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:35.240385Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:35.241741Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:35.241750Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:35.241751Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:35.241756Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535375735994122:4158]
2025-10-02T08:16:35.241758Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535375735994122:4158]
2025-10-02T08:16:35.241798Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:35.241804Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.241803Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:35.241805Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:35.241808Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:35.241909Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:35.296574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535375735994196:10248]
2025-10-02T08:16:35.296714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2753, pipe: [1:7556535375735994196:10248]
2025-10-02T08:16:35.365335Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:35.365610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994196:10248], now have 1 active actors on pipe
2025-10-02T08:16:35.365730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:35.365739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:35.365760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2754 reason: error at write: Disconnected sessionId: src_id|96f355fd-37870243-30233f4e-ed597c4f_0
2025-10-02T08:16:35.365778Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:35.365850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:35.365895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2754 sessionId: src_id|96f355fd-37870243-30233f4e-ed597c4f_0 is DEAD
2025-10-02T08:16:35.366021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535375735994196:10248]
2025-10-02T08:16:35.366059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f355fd-37870243-30233f4e-ed597c4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:35.366064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f355fd-37870243-30233f4e-ed597c4f_0] Write session will restart in 0.007012s
2025-10-02T08:16:35.366080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f355fd-37870243-30233f4e-ed597c4f_0] Write session: Do CDS request
2025-10-02T08:16:35.366085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f355fd-37870243-30233f4e-ed597c4f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:35.370830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:35.371671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:35.371784Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:35.371790Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:35.371796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:35.371827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:35.371849Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535375735994307:4225]
2025-10-02T08:16:35.372231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:35.372375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:35.372402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:35.372576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:35.372603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.372607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.372608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.372608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.372609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.372611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.372618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.372620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.372621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.372623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.372627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.372631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.372634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.372636Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.372638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.372641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.372643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.372645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.372648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.372650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.372659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:35.374170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f355fd-37870243-30233f4e-ed597c4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.374255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:35.374265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2755
2025-10-02T08:16:35.374374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.374395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:35.374399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:35.374402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:35.374738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2755 sessionId:  describe result for acl check
2025-10-02T08:16:35.374775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:35.374782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:35.374783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:35.374788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535375735994324:4237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:35.375249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535375735994324:4237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:35.377112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535375735994324:4237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:35.379325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535375735994324:4237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:35.379341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535375735994324:4237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:35.379347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535375735994324:4237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:35.379355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:35.379899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:35.381208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:35.381221Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:35.381222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:35.381225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:35.381229Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2754 [1:7556535375735994307:4225]
2025-10-02T08:16:35.381236Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:35.381246Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:35.381248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.381250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.381251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.381262Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:35.381264Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:35.381269Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:35.381319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.381327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.381329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:35.381333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:35.381395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:35.381401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.381412Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.381414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2754
2025-10-02T08:16:35.381428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:35.381448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994356:4237], now have 1 active actors on pipe
2025-10-02T08:16:35.381459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535376195246651:2378], now have 1 active actors on pipe
2025-10-02T08:16:35.381464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.381467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.381482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535375735994301:4225]
2025-10-02T08:16:35.381489Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535375735994301:4225]
2025-10-02T08:16:35.381473Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2754
2025-10-02T08:16:35.381499Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:35.381513Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:35.381519Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:35.381525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:35.381527Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:35.381528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:35.381540Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d048be1c-8854ae26-323b8212-2c26d940_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:35.381546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.381554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.381556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:35.381563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.381574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:35.381609Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535375735994301:4225]
2025-10-02T08:16:35.381622Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:35.381638Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.381639Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:35.381726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.381737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.381757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.381792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2755 partition: 0 MaxSeqNo: 17 sessionId: src_id|d048be1c-8854ae26-323b8212-2c26d940_0
2025-10-02T08:16:35.382043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f355fd-37870243-30233f4e-ed597c4f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d048be1c-8854ae26-323b8212-2c26d940_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:35.384350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d048be1c-8854ae26-323b8212-2c26d940_0] Write session: try to update token
2025-10-02T08:16:35.384361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d048be1c-8854ae26-323b8212-2c26d940_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:35.391747Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:35.391767Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:35.391776Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535375735994301:4225]
2025-10-02T08:16:35.391814Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:35.391815Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:35.391970Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:35.392132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:35.392268Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:35.392408Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:35.392679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:35.392716Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:35.396562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2755 sessionId: src_id|d048be1c-8854ae26-323b8212-2c26d940_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:35.398954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:35.399014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.399031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.399061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:35.399083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:35.399119Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.399130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.399261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.399312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.399368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.399420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.399462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.399471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.399533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.399585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.399637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.399700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.399757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.399763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.399816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.399864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.399914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.399964Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.400000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.400005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.400078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.400131Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.400187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.400240Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.400278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.400283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.400341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.400392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.400446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.400504Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.400547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.400556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.400611Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.400661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.400715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.400770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.400833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.400838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.400894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.400950Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.401007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.401060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.401098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.401104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.401166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.401218Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.401272Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.401324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.401363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.401367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.401423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.401475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.401526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.401579Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.401626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.401633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.401690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:35.401741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:35.401792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:35.401852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:35.401893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:35.401900Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:35.401929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:35.401981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.401996Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.402000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:35.402025Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:35.402040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:35.402045Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:35.402048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:35.402051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:35.402446Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:35.402469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:35.402474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:35.402476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:35.402478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:35.402480Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:35.403022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:35.403051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:35.403057Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:35.403061Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:35.403064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:35.403067Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:35.403517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:35.403545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:35.403550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:35.403556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:35.403564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:35.404752Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:35.404774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:35.404788Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392995404
2025-10-02T08:16:35.404921Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:35.404940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:35.404945Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:35.404949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:35.404953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:35.404956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:35.405476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:35.405503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:35.405509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:35.405512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:35.405515Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:35.405520Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:35.405967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:35.405993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:35.406010Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:35.406020Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:35.406023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:35.406026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:35.406457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:35.406481Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:35.406485Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:35.407558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:35.407583Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:35.407590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:35.407599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:35.407608Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392995407
2025-10-02T08:16:35.407907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:35.407936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:35.407947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:35.407950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:35.407953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:35.407956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:35.408433Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:35.408459Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:35.408465Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:35.408469Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:35.408473Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:35.408477Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:35.408949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:35.408978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.409075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392995408
2025-10-02T08:16:35.409810Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:35.409831Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:35.409837Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:35.409850Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:35.411350Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:35.411365Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:35.411367Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:35.411379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535375735994301:4225]
2025-10-02T08:16:35.411387Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535375735994301:4225]
2025-10-02T08:16:35.411427Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:35.411438Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:35.411441Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:35.411445Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.411447Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:35.411569Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:35.466046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535375735994379:10248]
2025-10-02T08:16:35.466182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2754, pipe: [1:7556535375735994379:10248]
2025-10-02T08:16:35.537549Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:35.537863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994379:10248], now have 1 active actors on pipe
2025-10-02T08:16:35.538004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535375735994379:10248]
2025-10-02T08:16:35.538030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:35.538032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:35.538042Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:35.538058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2755 reason: error at write: Disconnected sessionId: src_id|d048be1c-8854ae26-323b8212-2c26d940_0
2025-10-02T08:16:35.538041Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:35.538216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2755 sessionId: src_id|d048be1c-8854ae26-323b8212-2c26d940_0 is DEAD
2025-10-02T08:16:35.538328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d048be1c-8854ae26-323b8212-2c26d940_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:35.538336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d048be1c-8854ae26-323b8212-2c26d940_0] Write session will restart in 0.006975s
2025-10-02T08:16:35.538353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d048be1c-8854ae26-323b8212-2c26d940_0] Write session: Do CDS request
2025-10-02T08:16:35.538358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d048be1c-8854ae26-323b8212-2c26d940_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:35.543054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:35.543884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:35.544035Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:35.544044Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:35.544052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:35.544102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:35.544137Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535375735994496:4241]
2025-10-02T08:16:35.544694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:35.544845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:35.544884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:35.545150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:35.545190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.545196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.545197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.545197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.545199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.545202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.545211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.545219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.545222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.545230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.545235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.545245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.545255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.545263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.545271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.545276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.545280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.545284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.545292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.545299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.545321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:35.546125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d048be1c-8854ae26-323b8212-2c26d940_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.546220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:35.546229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2756
2025-10-02T08:16:35.546323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.546347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:35.546355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:35.546359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:35.546633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2756 sessionId:  describe result for acl check
2025-10-02T08:16:35.546659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:35.546663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:35.546665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:35.546668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535375735994512:4263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:35.546998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535375735994512:4263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:35.548620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535375735994512:4263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:35.552062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535375735994512:4263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:35.552079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535375735994512:4263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:35.552083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535375735994512:4263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:35.552091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:35.552580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:35.553959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:35.553974Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:35.553976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:35.553979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:35.553984Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2755 [1:7556535375735994496:4241]
2025-10-02T08:16:35.553992Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:35.554005Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:35.554012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.554014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.554016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.554029Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:35.554033Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:35.554038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:35.554089Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.554096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.554098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:35.554100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:35.554151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:35.554157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.554171Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.554185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:35.554206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994543:4263], now have 1 active actors on pipe
2025-10-02T08:16:35.554215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535376195246658:2378], now have 1 active actors on pipe
2025-10-02T08:16:35.554217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2755
2025-10-02T08:16:35.554220Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535375735994490:4241]
2025-10-02T08:16:35.554221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535375735994490:4241]
2025-10-02T08:16:35.554230Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:35.554237Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:35.554239Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:35.554240Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:35.554253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:35.554261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:35.554266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.554269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.554259Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2755
2025-10-02T08:16:35.554298Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535375735994490:4241]
2025-10-02T08:16:35.554305Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:35.554312Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:35.554318Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:35.554323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.554326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.554327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:35.554334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.554345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:35.554383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.554418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.554428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.554443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.554471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2756 partition: 0 MaxSeqNo: 17 sessionId: src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0
2025-10-02T08:16:35.554767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d048be1c-8854ae26-323b8212-2c26d940_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:35.557096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0] Write session: try to update token
2025-10-02T08:16:35.557109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:35.568668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2756 sessionId: src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:35.570976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:35.572299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.572338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.572369Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:35.572381Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:35.572384Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:35.572394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535375735994490:4241]
2025-10-02T08:16:35.572399Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535375735994490:4241]
2025-10-02T08:16:35.572452Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:35.572463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:35.572465Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:35.572471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.572473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:35.572712Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:35.638065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535375735994558:10248]
2025-10-02T08:16:35.638158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2755, pipe: [1:7556535375735994558:10248]
2025-10-02T08:16:35.702683Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:35.702922Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:35.702947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:35.702959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994558:10248], now have 1 active actors on pipe
2025-10-02T08:16:35.703017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:35.703024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:35.703037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2756 reason: error at write: Disconnected sessionId: src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0
2025-10-02T08:16:35.703116Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:35.703178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2756 sessionId: src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0 is DEAD
2025-10-02T08:16:35.703277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535375735994558:10248]
2025-10-02T08:16:35.703355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:35.703363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0] Write session will restart in 0.007610s
2025-10-02T08:16:35.703379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0] Write session: Do CDS request
2025-10-02T08:16:35.703384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:35.708161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:35.709238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:35.709357Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:35.709364Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:35.709371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:35.709398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:35.709423Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535375735994674:4275]
2025-10-02T08:16:35.709816Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:35.709960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:35.709985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:35.710171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:35.710197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.710201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.710202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.710203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.710203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.710206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.710212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.710215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.710217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.710219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.710222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.710226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.710230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.710233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.710237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.710240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.710242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.710244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.710246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.710250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.710260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:35.712269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.712305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:35.712315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2757
2025-10-02T08:16:35.712447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.712502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:35.712513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:35.712516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:35.712833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2757 sessionId:  describe result for acl check
2025-10-02T08:16:35.712861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:35.712865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:35.712867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:35.712871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535375735994690:4304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:35.713218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535375735994690:4304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:35.715003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535375735994690:4304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:35.717560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535375735994690:4304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:35.717572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535375735994690:4304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:35.717576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535375735994690:4304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:35.717584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:35.718146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:35.719668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:35.719686Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:35.719689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:35.719692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:35.719698Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2756 [1:7556535375735994674:4275]
2025-10-02T08:16:35.719709Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:35.719728Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:35.719736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.719740Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.719742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.719759Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:35.719767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:35.719775Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:35.719834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.719842Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.719846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:35.719848Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:35.719909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:35.719919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.719931Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.719941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2756
2025-10-02T08:16:35.719942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:35.719960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994721:4304], now have 1 active actors on pipe
2025-10-02T08:16:35.719968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535376195246664:2378], now have 1 active actors on pipe
2025-10-02T08:16:35.719972Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.719976Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.719993Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535375735994668:4275]
2025-10-02T08:16:35.720000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535375735994668:4275]
2025-10-02T08:16:35.720011Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:35.720034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:35.720043Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:35.720046Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:35.720057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:35.720060Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:35.720073Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0f911e8-bf2958e3-de647534-672f9048_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:35.720079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.720083Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.720085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:35.720093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.720101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:35.720088Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2756
2025-10-02T08:16:35.720133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535375735994668:4275]
2025-10-02T08:16:35.720144Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:35.720154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.720156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:35.720205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.720215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.720233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.720265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2757 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0f911e8-bf2958e3-de647534-672f9048_0
2025-10-02T08:16:35.720539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f87bee4d-bf0b4ba9-1360942d-85a843b8_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0f911e8-bf2958e3-de647534-672f9048_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:35.723065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f911e8-bf2958e3-de647534-672f9048_0] Write session: try to update token
2025-10-02T08:16:35.723080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f911e8-bf2958e3-de647534-672f9048_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:35.735662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2757 sessionId: src_id|a0f911e8-bf2958e3-de647534-672f9048_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:35.737591Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:35.737608Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:35.737609Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:35.737616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535375735994668:4275]
2025-10-02T08:16:35.737619Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535375735994668:4275]
2025-10-02T08:16:35.737650Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:35.737655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.737657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:35.737658Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:35.737663Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:35.737774Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:35.737950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:35.803472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535375735994739:10248]
2025-10-02T08:16:35.803575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2756, pipe: [1:7556535375735994739:10248]
2025-10-02T08:16:35.859599Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:35.859851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.859863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.859894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994739:10248], now have 1 active actors on pipe
2025-10-02T08:16:35.860001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535375735994739:10248]
2025-10-02T08:16:35.860037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:35.860044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:35.860102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2757 reason: error at write: Disconnected sessionId: src_id|a0f911e8-bf2958e3-de647534-672f9048_0
2025-10-02T08:16:35.860124Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:35.860137Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:35.860281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2757 sessionId: src_id|a0f911e8-bf2958e3-de647534-672f9048_0 is DEAD
2025-10-02T08:16:35.860402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f911e8-bf2958e3-de647534-672f9048_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:35.860410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f911e8-bf2958e3-de647534-672f9048_0] Write session will restart in 0.005411s
2025-10-02T08:16:35.860433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f911e8-bf2958e3-de647534-672f9048_0] Write session: Do CDS request
2025-10-02T08:16:35.860437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f911e8-bf2958e3-de647534-672f9048_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:35.866144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:35.866878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:35.867025Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:35.867033Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:35.867039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:35.867070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:35.867101Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535375735994858:4280]
2025-10-02T08:16:35.867200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f911e8-bf2958e3-de647534-672f9048_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.867331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:35.867345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2758
2025-10-02T08:16:35.867449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:35.867477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:35.867488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:35.867491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:35.867538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:35.867663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:35.867689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:35.867813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2758 sessionId:  describe result for acl check
2025-10-02T08:16:35.867843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:35.867849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:35.867850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:35.867856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535375735994869:4284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:35.867907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:35.867935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.867941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.867943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.867944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.867944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.867947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.867953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.867954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.867956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.867958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.867961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.867965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:35.867969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.867971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:35.867973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.867976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:35.867978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.867981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.867983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.867985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.867995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:35.868323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535375735994869:4284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:35.869987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535375735994869:4284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:35.874893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535375735994869:4284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:35.874904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535375735994869:4284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:35.874906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535375735994869:4284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:35.874912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:35.875371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:35.876698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:35.876715Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:35.876718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:35.876721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:35.876725Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2757 [1:7556535375735994858:4280]
2025-10-02T08:16:35.876733Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:35.876746Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:35.876748Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.876750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.876751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.876762Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:35.876765Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:35.876770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:35.876828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.876834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.876838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:35.876840Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:35.876885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:35.876894Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.876901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:35.876907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:35.876918Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535375735994852:4280]
2025-10-02T08:16:35.876919Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535375735994852:4280]
2025-10-02T08:16:35.876925Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:35.876936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:35.876941Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:35.876943Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:35.876947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:35.876950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:35.876959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994906:4284], now have 1 active actors on pipe
2025-10-02T08:16:35.876962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535376195246672:2378], now have 1 active actors on pipe
2025-10-02T08:16:35.876986Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535375735994852:4280]
2025-10-02T08:16:35.876997Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:35.877003Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:35.877010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2757
2025-10-02T08:16:35.877016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.877019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.877047Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:35.877024Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2757
2025-10-02T08:16:35.877057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:35.877061Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:35.877063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:35.877070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:35.877077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:35.877090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.877125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:35.877132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:35.877147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:35.877179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2758 partition: 0 MaxSeqNo: 17 sessionId: src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0
2025-10-02T08:16:35.877471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0f911e8-bf2958e3-de647534-672f9048_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:35.879776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0] Write session: try to update token
2025-10-02T08:16:35.879789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:35.891480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2758 sessionId: src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:35.894411Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:35.894434Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:35.894436Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:35.894444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535375735994852:4280]
2025-10-02T08:16:35.894449Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535375735994852:4280]
2025-10-02T08:16:35.894484Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:35.894493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:35.894497Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:35.894501Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:35.894503Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:35.894687Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:35.894778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:35.960136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535375735994922:10248]
2025-10-02T08:16:35.960265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2757, pipe: [1:7556535375735994922:10248]
2025-10-02T08:16:36.021852Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:36.022181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.022198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.022244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535375735994922:10248], now have 1 active actors on pipe
2025-10-02T08:16:36.022378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535375735994922:10248]
2025-10-02T08:16:36.022405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:36.022411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:36.022426Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:36.022474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2758 reason: error at write: Disconnected sessionId: src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0
2025-10-02T08:16:36.022526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:36.022658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2758 sessionId: src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0 is DEAD
2025-10-02T08:16:36.022785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:36.022794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0] Write session will restart in 0.007717s
2025-10-02T08:16:36.022813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0] Write session: Do CDS request
2025-10-02T08:16:36.022818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:36.027377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:36.028287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:36.028402Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:36.028407Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:36.028413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:36.028441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:36.028466Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535380030962349:4295]
2025-10-02T08:16:36.028862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:36.028997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:36.029023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:36.029205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:36.029231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.029235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.029236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.029237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.029237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.029240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.029246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.029249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.029250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.029252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.029256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.029260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.029264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.029267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.029269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.029271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.029273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.029276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.029278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.029280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.029292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:36.031220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.031266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:36.031276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2759
2025-10-02T08:16:36.031390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.031409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:36.031415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:36.031418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:36.031752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2759 sessionId:  describe result for acl check
2025-10-02T08:16:36.031786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:36.031792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:36.031794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:36.031799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535380030962365:4309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:36.032290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535380030962365:4309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:36.033837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535380030962365:4309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:36.036473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535380030962365:4309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:36.036486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535380030962365:4309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:36.036489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535380030962365:4309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:36.036496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:36.036889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:36.038236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:36.038248Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:36.038250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:36.038252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:36.038257Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2758 [1:7556535380030962349:4295]
2025-10-02T08:16:36.038264Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:36.038275Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:36.038278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.038280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.038281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.038292Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:36.038298Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:36.038303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:36.038341Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.038346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.038348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:36.038350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:36.038391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:36.038396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.038403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.038410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:36.038422Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030962396:4309], now have 1 active actors on pipe
2025-10-02T08:16:36.038430Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535380030962343:4295]
2025-10-02T08:16:36.038431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535380030962343:4295]
2025-10-02T08:16:36.038437Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:36.038444Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:36.038445Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:36.038452Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:36.038453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:36.038454Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:36.038454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2758
2025-10-02T08:16:36.038458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535380490213986:2378], now have 1 active actors on pipe
2025-10-02T08:16:36.038481Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535380030962343:4295]
2025-10-02T08:16:36.038490Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:36.038494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.038496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.038497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:36.038521Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:36.038528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.038531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.038532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:36.038536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.038542Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:36.038508Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2758
2025-10-02T08:16:36.038559Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.038588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.038593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.038600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.038626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2759 partition: 0 MaxSeqNo: 17 sessionId: src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0
2025-10-02T08:16:36.038868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19bca0e9-1ce193fd-35a62f4c-a9cd3956_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:36.041267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0] Write session: try to update token
2025-10-02T08:16:36.041279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:36.053516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2759 sessionId: src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:36.055770Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:36.055790Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:36.055792Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:36.055800Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535380030962343:4295]
2025-10-02T08:16:36.055804Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535380030962343:4295]
2025-10-02T08:16:36.055844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:36.055848Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:36.055854Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:36.055855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.055860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:36.055955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:36.055989Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:36.122465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535380030962412:10248]
2025-10-02T08:16:36.122640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2758, pipe: [1:7556535380030962412:10248]
2025-10-02T08:16:36.201004Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:36.201223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.201237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.201264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030962412:10248], now have 1 active actors on pipe
2025-10-02T08:16:36.201357Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:36.201371Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:36.201528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535380030962412:10248]
2025-10-02T08:16:36.201542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:36.201576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2759 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0
2025-10-02T08:16:36.201712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2759 sessionId: src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0 is DEAD
2025-10-02T08:16:36.201870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:36.201877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0] Write session will restart in 0.008006s
2025-10-02T08:16:36.201892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0] Write session: Do CDS request
2025-10-02T08:16:36.201896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:36.207009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:36.207918Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:36.208038Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:36.208045Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:36.208051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:36.208079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:36.208131Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535380030962550:4389]
2025-10-02T08:16:36.208521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:36.208668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:36.208696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:36.208887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:36.208914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.208918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.208918Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.208919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.208919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.208924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.208930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.208932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.208934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.208936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.208939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.208942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.208946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.208949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.208951Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.208953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.208955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.208958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.208960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.208962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.208971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:36.211226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.211321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:36.211332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2760
2025-10-02T08:16:36.211437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.211457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:36.211463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:36.211465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:36.211779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2760 sessionId:  describe result for acl check
2025-10-02T08:16:36.211805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:36.211811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:36.211813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:36.211817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535380030962566:4398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:36.212231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535380030962566:4398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:36.214579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535380030962566:4398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:36.216243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:36.217632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:36.217646Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:36.217647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:36.217651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:36.217655Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2759 [1:7556535380030962550:4389]
2025-10-02T08:16:36.217661Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:36.217672Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:36.217675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.217677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.217678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.217688Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:36.217691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:36.217696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:36.217735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.217741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.217743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:36.217745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:36.217793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:36.217800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.217810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.217820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:36.217840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535380490214005:2378], now have 1 active actors on pipe
2025-10-02T08:16:36.217849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535380030962544:4389]
2025-10-02T08:16:36.217850Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535380030962544:4389]
2025-10-02T08:16:36.217860Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:36.217868Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:36.217870Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:36.217874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:36.217886Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:36.217893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:36.217884Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2759
2025-10-02T08:16:36.217923Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535380030962544:4389]
2025-10-02T08:16:36.217932Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:36.217947Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:36.218142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535380030962566:4398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:36.218155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535380030962566:4398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:36.218157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535380030962566:4398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:36.218164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:36.218423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2759
2025-10-02T08:16:36.218432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030962603:4398], now have 1 active actors on pipe
2025-10-02T08:16:36.218436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.218438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.218453Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e077263-7f404c90-a83fa3d9-85484d65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:36.218462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.218465Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.218466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:36.218472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.218479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:36.218489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.218517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.218521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.218529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.218544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2760 partition: 0 MaxSeqNo: 17 sessionId: src_id|5e077263-7f404c90-a83fa3d9-85484d65_0
2025-10-02T08:16:36.218828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb08fc8-881608e-cd1352b8-717bb1a7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|5e077263-7f404c90-a83fa3d9-85484d65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:36.221124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e077263-7f404c90-a83fa3d9-85484d65_0] Write session: try to update token
2025-10-02T08:16:36.221138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e077263-7f404c90-a83fa3d9-85484d65_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:36.233629Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:36.233648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:36.233651Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:36.233658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535380030962544:4389]
2025-10-02T08:16:36.233662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535380030962544:4389]
2025-10-02T08:16:36.233695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:36.233699Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:36.233704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.233705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:36.233711Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:36.233816Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:36.237082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2760 sessionId: src_id|5e077263-7f404c90-a83fa3d9-85484d65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:36.239418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:36.301632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535380030962635:10248]
2025-10-02T08:16:36.301710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2759, pipe: [1:7556535380030962635:10248]
2025-10-02T08:16:36.369224Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:36.369621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.369637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.369671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030962635:10248], now have 1 active actors on pipe
2025-10-02T08:16:36.369761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:36.369772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:36.369844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2760 reason: error at write: Disconnected sessionId: src_id|5e077263-7f404c90-a83fa3d9-85484d65_0
2025-10-02T08:16:36.369868Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:36.369893Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:36.370017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2760 sessionId: src_id|5e077263-7f404c90-a83fa3d9-85484d65_0 is DEAD
2025-10-02T08:16:36.370116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535380030962635:10248]
2025-10-02T08:16:36.370136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e077263-7f404c90-a83fa3d9-85484d65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:36.370142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e077263-7f404c90-a83fa3d9-85484d65_0] Write session will restart in 0.006925s
2025-10-02T08:16:36.370161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e077263-7f404c90-a83fa3d9-85484d65_0] Write session: Do CDS request
2025-10-02T08:16:36.370167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e077263-7f404c90-a83fa3d9-85484d65_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:36.375195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:36.376147Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:36.376277Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:36.376285Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:36.376291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:36.376322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:36.376358Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535380030962758:4533]
2025-10-02T08:16:36.376773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:36.376934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:36.376963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:36.377159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:36.377190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.377196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.377197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.377198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.377199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.377203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.377211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.377215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.377222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.377226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.377231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.377241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.377251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.377257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.377265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.377273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.377275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.377281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.377284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.377287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.377296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:36.378194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e077263-7f404c90-a83fa3d9-85484d65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.378282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:36.378291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2761
2025-10-02T08:16:36.378407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.378427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:36.378434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:36.378436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:36.378791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2761 sessionId:  describe result for acl check
2025-10-02T08:16:36.378827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:36.378833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:36.378835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:36.378840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535380030962774:4536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:36.379324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535380030962774:4536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:36.381075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535380030962774:4536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:36.384294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535380030962774:4536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:36.384308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535380030962774:4536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:36.384310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535380030962774:4536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:36.384316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:36.384768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:36.386126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:36.386140Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:36.386142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:36.386144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:36.386148Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2760 [1:7556535380030962758:4533]
2025-10-02T08:16:36.386156Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:36.386169Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:36.386176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.386178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.386180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.386191Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:36.386194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:36.386199Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:36.386246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.386253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.386255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:36.386258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:36.386313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:36.386320Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.386333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.386350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:36.386356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2760
2025-10-02T08:16:36.386373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030962806:4536], now have 1 active actors on pipe
2025-10-02T08:16:36.386380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535380490214022:2378], now have 1 active actors on pipe
2025-10-02T08:16:36.386384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.386388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.386403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535380030962752:4533]
2025-10-02T08:16:36.386411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535380030962752:4533]
2025-10-02T08:16:36.386416Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:36.386425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:36.386433Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:36.386433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:36.386397Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2760
2025-10-02T08:16:36.386435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:36.386435Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:36.386449Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:36.386455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.386458Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.386459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:36.386467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.386475Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:36.386500Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535380030962752:4533]
2025-10-02T08:16:36.386513Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:36.386526Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:36.386530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.386612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.386623Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.386643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.386690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2761 partition: 0 MaxSeqNo: 17 sessionId: src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0
2025-10-02T08:16:36.386989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e077263-7f404c90-a83fa3d9-85484d65_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:36.389266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0] Write session: try to update token
2025-10-02T08:16:36.389279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:36.401729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2761 sessionId: src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:36.401753Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:36.401757Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:36.401765Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535380030962752:4533]
2025-10-02T08:16:36.401807Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:36.401817Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:36.401975Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:36.402112Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:36.402242Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:36.402374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:36.402568Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:36.402608Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:36.403885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:36.403959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.403973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.404011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:36.404045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:36.404082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.404100Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.404235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.404286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.404341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.404394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.404432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.404438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.404493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.404548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.404601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.404657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.404696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.404702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.404759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.404829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.404888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.404938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.404974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.404979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.405031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.405084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.405137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.405195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.405234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.405239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.405298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.405352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.405404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.405455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.405493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.405498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.405553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.405602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.405653Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.405703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.405741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.405747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.405801Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.405850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.405905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.405960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.405997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.406002Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.406064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.406123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.406180Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.406235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.406273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.406278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.406332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.406389Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.406441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.406493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.406530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.406535Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.406590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:36.406640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:36.406690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:36.406741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:36.406780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:36.406785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:36.406811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:36.406861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.406875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.406878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:36.406898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:36.406910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:36.406917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:36.406918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:36.406920Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:36.407264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:36.407289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:36.407296Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:36.407298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:36.407301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:36.407303Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:36.407751Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:36.407770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:36.407776Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:36.407804Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:36.407809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:36.407811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:36.408239Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:36.408256Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:36.408259Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:36.408262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:36.408264Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:36.410103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:36.410119Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:36.410127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392996410
2025-10-02T08:16:36.410243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:36.410253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:36.410257Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:36.410260Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:36.410263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:36.410266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:36.410651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:36.410672Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:36.410676Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:36.410678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:36.410681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:36.410683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:36.411074Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:36.411089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:36.411095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:36.411097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:36.411099Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:36.411101Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:36.411565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:36.411589Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:36.411593Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:36.412517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:36.412534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:36.412538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:36.412540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:36.412545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392996412
2025-10-02T08:16:36.412816Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:36.412833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:36.412839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:36.412840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:36.412843Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:36.412845Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:36.413221Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:36.413237Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:36.413240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:36.413243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:36.413245Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:36.413248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:36.413616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:36.413632Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.413697Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392996413
2025-10-02T08:16:36.414321Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:36.414344Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:36.414347Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:36.414354Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:36.415728Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:36.415740Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:36.415741Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:36.415748Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535380030962752:4533]
2025-10-02T08:16:36.415750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535380030962752:4533]
2025-10-02T08:16:36.415788Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:36.415792Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:36.415797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.415799Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:36.415799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:36.415905Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:36.470090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535380030962829:10248]
2025-10-02T08:16:36.470234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2760, pipe: [1:7556535380030962829:10248]
2025-10-02T08:16:36.538361Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:36.538667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030962829:10248], now have 1 active actors on pipe
2025-10-02T08:16:36.538783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:36.538794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:36.538817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2761 reason: error at write: Disconnected sessionId: src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0
2025-10-02T08:16:36.538847Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:36.538900Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:36.538954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2761 sessionId: src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0 is DEAD
2025-10-02T08:16:36.539082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535380030962829:10248]
2025-10-02T08:16:36.539136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:36.539145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0] Write session will restart in 0.008135s
2025-10-02T08:16:36.539164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0] Write session: Do CDS request
2025-10-02T08:16:36.539170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:36.544394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:36.545278Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:36.545416Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:36.545424Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:36.545430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:36.545460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:36.545483Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535380030962957:4580]
2025-10-02T08:16:36.545855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:36.545985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:36.546008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:36.546189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:36.546213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.546214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.546215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.546215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.546216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.546218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.546224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.546226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.546228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.546230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.546234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.546237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.546240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.546243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.546245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.546248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.546250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.546253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.546255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.546257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.546266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:36.548192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.548284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:36.548292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2762
2025-10-02T08:16:36.548397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.548415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:36.548427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:36.548431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:36.548693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2762 sessionId:  describe result for acl check
2025-10-02T08:16:36.548720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:36.548721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:36.548722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:36.548725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535380030962974:4585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:36.549162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535380030962974:4585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:36.550748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535380030962974:4585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:36.553163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535380030962974:4585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:36.553173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535380030962974:4585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:36.553175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535380030962974:4585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:36.553180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:36.553407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:36.554812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:36.554826Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:36.554827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:36.554830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:36.554833Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2761 [1:7556535380030962957:4580]
2025-10-02T08:16:36.554840Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:36.554853Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:36.554854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.554856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.554857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.554867Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:36.554873Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:36.554878Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:36.554926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.554932Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.554935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:36.554937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:36.554980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:36.554987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.554994Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.555001Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:36.555014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030963006:4585], now have 1 active actors on pipe
2025-10-02T08:16:36.555015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2761
2025-10-02T08:16:36.555018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535380030962951:4580]
2025-10-02T08:16:36.555020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535380030962951:4580]
2025-10-02T08:16:36.555024Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:36.555030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535380490214029:2378], now have 1 active actors on pipe
2025-10-02T08:16:36.555032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:36.555035Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:36.555037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:36.555044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:36.555046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:36.555051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.555053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.555076Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535380030962951:4580]
2025-10-02T08:16:36.555081Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:36.555080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2761
2025-10-02T08:16:36.555091Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:36.555091Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:36.555095Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.555098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.555099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:36.555105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.555111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:36.555132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.555171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.555176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.555186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.555209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2762 partition: 0 MaxSeqNo: 17 sessionId: src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0
2025-10-02T08:16:36.555430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007379d-c7f5b1d4-51adfe54-e77fab37_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:36.557654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0] Write session: try to update token
2025-10-02T08:16:36.557665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:36.569566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2762 sessionId: src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:36.571145Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:36.571161Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:36.571162Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:36.571168Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535380030962951:4580]
2025-10-02T08:16:36.571171Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535380030962951:4580]
2025-10-02T08:16:36.571199Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:36.571201Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:36.571203Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:36.571206Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.571208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:36.571326Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:36.571817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:36.639025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535380030963021:10248]
2025-10-02T08:16:36.639133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2761, pipe: [1:7556535380030963021:10248]
2025-10-02T08:16:36.697648Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:36.697934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.697944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.697977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030963021:10248], now have 1 active actors on pipe
2025-10-02T08:16:36.698075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535380030963021:10248]
2025-10-02T08:16:36.698089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:36.698091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:36.698127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2762 reason: error at write: Disconnected sessionId: src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0
2025-10-02T08:16:36.698180Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:36.698173Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:36.698261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2762 sessionId: src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0 is DEAD
2025-10-02T08:16:36.698427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:36.698437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0] Write session will restart in 0.008366s
2025-10-02T08:16:36.698467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0] Write session: Do CDS request
2025-10-02T08:16:36.698473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:36.703576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:36.704666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:36.704792Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:36.704816Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:36.704828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:36.704872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:36.704900Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535380030963148:4626]
2025-10-02T08:16:36.705296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:36.705427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:36.705452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:36.705652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:36.705681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.705685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.705686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.705686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.705687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.705690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.705696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.705698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.705700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.705702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.705705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.705709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.705713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.705715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.705717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.705720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.705722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.705724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.705727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.705729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.705740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:36.708194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.708241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:36.708251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2763
2025-10-02T08:16:36.708386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.708419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:36.708426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:36.708429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:36.708712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2763 sessionId:  describe result for acl check
2025-10-02T08:16:36.708742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:36.708748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:36.708750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:36.708754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535380030963165:4700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:36.709126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535380030963165:4700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:36.710911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535380030963165:4700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:36.712697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:36.712970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535380030963165:4700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:36.712981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535380030963165:4700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:36.712983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535380030963165:4700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:36.712989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:36.713948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:36.713963Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:36.713965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:36.713967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:36.713972Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2762 [1:7556535380030963148:4626]
2025-10-02T08:16:36.713981Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:36.713992Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:36.713995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.713997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.713998Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.714009Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:36.714011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:36.714016Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:36.714051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.714057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.714059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:36.714060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:36.714111Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:36.714116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.714124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2762
2025-10-02T08:16:36.714125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.714132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:36.714146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030963196:4700], now have 1 active actors on pipe
2025-10-02T08:16:36.714153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535380490214037:2378], now have 1 active actors on pipe
2025-10-02T08:16:36.714157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.714160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.714175Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535380030963142:4626]
2025-10-02T08:16:36.714180Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535380030963142:4626]
2025-10-02T08:16:36.714186Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:36.714196Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:36.714206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:36.714187Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2762
2025-10-02T08:16:36.714211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:36.714213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:36.714216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:36.714225Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:36.714231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.714233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.714237Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:36.714243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.714251Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:36.714274Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535380030963142:4626]
2025-10-02T08:16:36.714280Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:36.714286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.714287Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:36.714361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.714367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.714377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.714397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2763 partition: 0 MaxSeqNo: 17 sessionId: src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0
2025-10-02T08:16:36.714613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd84483-70e39022-44ae65a3-cf1dd3f9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:36.716789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0] Write session: try to update token
2025-10-02T08:16:36.716814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:36.728834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2763 sessionId: src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:36.729795Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:36.729808Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:36.729810Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:36.729818Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535380030963142:4626]
2025-10-02T08:16:36.729822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535380030963142:4626]
2025-10-02T08:16:36.729855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:36.729861Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:36.729868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.729870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:36.729874Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:36.729990Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:36.731003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:36.798247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535380030963214:10248]
2025-10-02T08:16:36.798333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2762, pipe: [1:7556535380030963214:10248]
2025-10-02T08:16:36.850490Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:36.850775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.850786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.850824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030963214:10248], now have 1 active actors on pipe
2025-10-02T08:16:36.850932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535380030963214:10248]
2025-10-02T08:16:36.850961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:36.850961Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:36.850963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:36.851014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2763 reason: error at write: Disconnected sessionId: src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0
2025-10-02T08:16:36.851174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2763 sessionId: src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0 is DEAD
2025-10-02T08:16:36.851217Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:36.851332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:36.851341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0] Write session will restart in 0.006610s
2025-10-02T08:16:36.851358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0] Write session: Do CDS request
2025-10-02T08:16:36.851363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:36.857596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:36.858618Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:36.858779Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:36.858791Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:36.858800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:36.858852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:36.858889Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535380030963344:4719]
2025-10-02T08:16:36.859253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.859305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:36.859320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2764
2025-10-02T08:16:36.859428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:36.859455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:36.859463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:36.859467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:36.859477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:36.859664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:36.859706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:36.859820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2764 sessionId:  describe result for acl check
2025-10-02T08:16:36.859851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:36.859857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:36.859859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:36.859863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535380030963355:4712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:36.859927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:36.859959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.859965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.859966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.859966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.859967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.859970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.859977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.859979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.859981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.859983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.859986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.859994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:36.859997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.860000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:36.860003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.860005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:36.860008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.860010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.860012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.860026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.860039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:36.860351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535380030963355:4712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:36.862007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535380030963355:4712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:36.867167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535380030963355:4712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:36.867183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535380030963355:4712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:36.867186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535380030963355:4712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:36.867194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:36.867450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:36.868752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:36.868768Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:36.868770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:36.868773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:36.868779Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2763 [1:7556535380030963344:4719]
2025-10-02T08:16:36.868790Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:36.868821Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:36.868827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.868830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.868833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.868847Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:36.868857Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:36.868861Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:36.868917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.868924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.868927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:36.868929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:36.869047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2763
2025-10-02T08:16:36.869086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:36.869094Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.869105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:36.869086Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2763
2025-10-02T08:16:36.869123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:36.869142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030963392:4712], now have 1 active actors on pipe
2025-10-02T08:16:36.869150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535380490214045:2378], now have 1 active actors on pipe
2025-10-02T08:16:36.869154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.869159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.869179Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535380030963338:4719]
2025-10-02T08:16:36.869185Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535380030963338:4719]
2025-10-02T08:16:36.869196Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:36.869209Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:36.869212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:36.869218Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:36.869227Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:36.869229Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:36.869247Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:36.869256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:36.869259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:36.869262Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:36.869272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:36.869283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:36.869312Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535380030963338:4719]
2025-10-02T08:16:36.869322Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:36.869326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:36.869335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.869387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:36.869394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:36.869406Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:36.869439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2764 partition: 0 MaxSeqNo: 17 sessionId: src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0
2025-10-02T08:16:36.869756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6624e4ba-ad2b8686-8f707905-4a2d4813_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:36.872069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0] Write session: try to update token
2025-10-02T08:16:36.872085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:36.884859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2764 sessionId: src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:36.885457Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:36.885472Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:36.885475Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:36.885482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535380030963338:4719]
2025-10-02T08:16:36.885486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535380030963338:4719]
2025-10-02T08:16:36.885528Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:36.885537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:36.885540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:36.885660Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:36.885674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:36.885681Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:36.887078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:36.950831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535380030963409:10248]
2025-10-02T08:16:36.950918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2763, pipe: [1:7556535380030963409:10248]
2025-10-02T08:16:37.019928Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:37.020220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.020232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.020271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535380030963409:10248], now have 1 active actors on pipe
2025-10-02T08:16:37.020365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:37.020372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:37.020420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2764 reason: error at write: Disconnected sessionId: src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0
2025-10-02T08:16:37.020472Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:37.020528Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:37.020603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2764 sessionId: src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0 is DEAD
2025-10-02T08:16:37.020713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535380030963409:10248]
2025-10-02T08:16:37.020735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:37.020759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0] Write session will restart in 0.006018s
2025-10-02T08:16:37.020781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0] Write session: Do CDS request
2025-10-02T08:16:37.020787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:37.027001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:37.028090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:37.028247Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:37.028257Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:37.028265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:37.028301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:37.028332Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535384325930848:4770]
2025-10-02T08:16:37.028368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.028382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:37.028390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2765
2025-10-02T08:16:37.028557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.028606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:37.028615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:37.028618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:37.028905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2765 sessionId:  describe result for acl check
2025-10-02T08:16:37.028933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:37.028940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:37.028941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:37.028945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535384325930853:4786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:37.028980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:37.029147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:37.029183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:37.029278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535384325930853:4786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:37.029471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:37.029503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.029508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.029510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.029511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.029512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.029516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.029525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.029533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.029537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.029541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.029549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.029560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.029565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.029570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.029575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.029584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.029589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.029597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.029604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.029612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.029634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:37.030860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535384325930853:4786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:37.035558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535384325930853:4786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:37.035572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535384325930853:4786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:37.035575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535384325930853:4786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:37.035583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:37.036947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:37.038373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:37.038387Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:37.038389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:37.038392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:37.038397Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2764 [1:7556535384325930848:4770]
2025-10-02T08:16:37.038407Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:37.038421Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:37.038430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.038432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.038434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.038446Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:37.038456Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:37.038461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:37.038508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.038514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.038517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:37.038520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:37.038572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:37.038578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.038589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.038604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:37.038619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2764
2025-10-02T08:16:37.038624Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325930897:4786], now have 1 active actors on pipe
2025-10-02T08:16:37.038628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535384785181360:2378], now have 1 active actors on pipe
2025-10-02T08:16:37.038633Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535384325930841:4770]
2025-10-02T08:16:37.038635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535384325930841:4770]
2025-10-02T08:16:37.038645Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:37.038657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.038664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.038663Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:37.038667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:37.038679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:37.038694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:37.038703Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:37.038693Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2764
2025-10-02T08:16:37.038737Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:37.038746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.038749Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.038752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:37.038759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.038770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:37.038779Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535384325930841:4770]
2025-10-02T08:16:37.038789Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:37.038804Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:37.038818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.038870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.038876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.038887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.038911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2765 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0
2025-10-02T08:16:37.039222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe92d104-285cfc88-7b11c494-bf99a71f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:37.041776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0] Write session: try to update token
2025-10-02T08:16:37.041791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:37.054409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2765 sessionId: src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:37.055043Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:37.055058Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:37.055059Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:37.055065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535384325930841:4770]
2025-10-02T08:16:37.055068Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535384325930841:4770]
2025-10-02T08:16:37.055099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:37.055107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.055108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:37.055222Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:37.055227Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:37.055231Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:37.056596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:37.120831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535384325930912:10248]
2025-10-02T08:16:37.120919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2764, pipe: [1:7556535384325930912:10248]
2025-10-02T08:16:37.188225Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:37.188545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.188564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.188599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325930912:10248], now have 1 active actors on pipe
2025-10-02T08:16:37.188708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:37.188724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:37.188784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2765 reason: error at write: Disconnected sessionId: src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0
2025-10-02T08:16:37.188828Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:37.188982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2765 sessionId: src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0 is DEAD
2025-10-02T08:16:37.189077Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:37.189110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:37.189119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0] Write session will restart in 0.006919s
2025-10-02T08:16:37.189145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0] Write session: Do CDS request
2025-10-02T08:16:37.189152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:37.189159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535384325930912:10248]
2025-10-02T08:16:37.194856Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:37.195945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:37.196119Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:37.196134Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:37.196145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:37.196201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:37.196243Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535384325931047:4802]
2025-10-02T08:16:37.196796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:37.196958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:37.196993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:37.197247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.197277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:37.197294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:37.197299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2766
2025-10-02T08:16:37.197334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.197341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.197342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.197342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.197343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.197348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.197356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.197358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.197361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.197364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.197369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.197375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.197379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.197383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.197390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.197394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.197402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.197406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.197413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.197414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.197418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.197434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:37.197434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:37.197447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:37.197451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:37.197794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2766 sessionId:  describe result for acl check
2025-10-02T08:16:37.197821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:37.197827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:37.197828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:37.197833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535384325931064:4799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:37.198299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535384325931064:4799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:37.199913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535384325931064:4799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:37.204571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535384325931064:4799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:37.204586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535384325931064:4799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:37.204589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535384325931064:4799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:37.204598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:37.205089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:37.206575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:37.206593Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:37.206596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:37.206600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:37.206605Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2765 [1:7556535384325931047:4802]
2025-10-02T08:16:37.206618Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:37.206636Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:37.206642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.206645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.206647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.206662Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:37.206671Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:37.206684Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:37.206742Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.206749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.206751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:37.206753Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:37.206811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:37.206818Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.206831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.206845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:37.206853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2765
2025-10-02T08:16:37.206865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931095:4799], now have 1 active actors on pipe
2025-10-02T08:16:37.206872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535384785181367:2378], now have 1 active actors on pipe
2025-10-02T08:16:37.206877Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535384325931041:4802]
2025-10-02T08:16:37.206883Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535384325931041:4802]
2025-10-02T08:16:37.206894Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:37.206905Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:37.206906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.206907Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:37.206910Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.206927Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:37.206943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:37.206950Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:37.206927Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2765
2025-10-02T08:16:37.206988Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:37.206999Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.207008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.207010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:37.207018Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.207026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:37.207044Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535384325931041:4802]
2025-10-02T08:16:37.207057Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:37.207067Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:37.207085Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.207134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.207142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.207155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.207189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2766 partition: 0 MaxSeqNo: 17 sessionId: src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0
2025-10-02T08:16:37.207497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8a6417-274d08d7-3a223d72-658f68f0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:37.209871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0] Write session: try to update token
2025-10-02T08:16:37.209885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:37.222928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2766 sessionId: src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:37.223214Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:37.223228Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:37.223230Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:37.223236Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535384325931041:4802]
2025-10-02T08:16:37.223239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535384325931041:4802]
2025-10-02T08:16:37.223277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:37.223283Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:37.223286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.223288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:37.223289Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:37.223407Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:37.225276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:37.289264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535384325931146:10248]
2025-10-02T08:16:37.289332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2765, pipe: [1:7556535384325931146:10248]
2025-10-02T08:16:37.345312Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:37.345565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.345577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.345609Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931146:10248], now have 1 active actors on pipe
2025-10-02T08:16:37.345749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535384325931146:10248]
2025-10-02T08:16:37.345773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:37.345775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:37.345778Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:37.345825Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:37.345840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2766 reason: error at write: Disconnected sessionId: src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0
2025-10-02T08:16:37.345967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2766 sessionId: src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0 is DEAD
2025-10-02T08:16:37.346124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:37.346133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0] Write session will restart in 0.006370s
2025-10-02T08:16:37.346158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0] Write session: Do CDS request
2025-10-02T08:16:37.346165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:37.352044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:37.353115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:37.353199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.353270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:37.353281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2767
2025-10-02T08:16:37.353281Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:37.353285Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:37.353296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:37.353360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:37.353388Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535384325931280:4853]
2025-10-02T08:16:37.353400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.353440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:37.353448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:37.353451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:37.353769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2767 sessionId:  describe result for acl check
2025-10-02T08:16:37.353776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:37.353803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:37.353810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:37.353811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:37.353816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535384325931285:4856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:37.353973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:37.354030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:37.354202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535384325931285:4856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:37.354324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:37.354398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.354404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.354405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.354406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.354407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.354412Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.354421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.354424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.354428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.354431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.354437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.354447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.354457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.354462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.354471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.354480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.354484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.354489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.354493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.354501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.354518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:37.356205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535384325931285:4856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:37.361733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535384325931285:4856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:37.361750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535384325931285:4856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:37.361754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535384325931285:4856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:37.361763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:37.361987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:37.363357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:37.363371Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:37.363372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:37.363376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:37.363380Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2766 [1:7556535384325931280:4853]
2025-10-02T08:16:37.363388Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:37.363400Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:37.363402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.363404Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.363405Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.363415Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:37.363418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:37.363422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:37.363462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.363470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.363473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:37.363474Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:37.363520Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:37.363526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.363533Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.363539Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:37.363556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931328:4856], now have 1 active actors on pipe
2025-10-02T08:16:37.363561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535384785181397:2378], now have 1 active actors on pipe
2025-10-02T08:16:37.363566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535384325931274:4853]
2025-10-02T08:16:37.363567Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535384325931274:4853]
2025-10-02T08:16:37.363572Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:37.363572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2766
2025-10-02T08:16:37.363581Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:37.363583Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:37.363586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:37.363588Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:37.363590Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:37.363594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.363598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.363624Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535384325931274:4853]
2025-10-02T08:16:37.363631Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:37.363634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:37.363642Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:37.363646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.363648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.363618Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2766
2025-10-02T08:16:37.363649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:37.363655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.363661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:37.363688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.363716Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.363720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.363728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.363754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2767 partition: 0 MaxSeqNo: 17 sessionId: src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0
2025-10-02T08:16:37.364048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4524fd9d-1e2053f1-e6ff2629-9e55f38_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:37.366560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0] Write session: try to update token
2025-10-02T08:16:37.366575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:37.373574Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:37.373590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:37.373598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535384325931274:4853]
2025-10-02T08:16:37.373628Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:37.373639Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:37.373811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:37.373959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:37.374102Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:37.374256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:37.374455Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:37.374492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:37.378979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2767 sessionId: src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:37.381617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:37.381673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.381685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.381714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:37.381735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:37.381771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.381786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.381925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.381981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.382038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.382103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.382285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.382292Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.382353Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.382407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.382460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.382516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.382556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.382562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.382620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.382674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.382734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.382795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.382834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.382840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.382893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.382944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.382996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.383046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.383086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.383091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.383148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.383201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.383255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.383310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.383349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.383354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.383411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.383462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.383521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.383577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.383617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.383622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.383679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.383730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.383787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.383841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.383884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.383891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.383958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.384009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.384079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.384136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.384176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.384181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.384239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.384289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.384342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.384394Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.384433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.384439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.384494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:37.384545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:37.384598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:37.384652Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:37.384690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:37.384695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:37.384725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:37.384778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.384793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.384795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:37.384840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:37.384855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:37.384860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:37.384862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:37.384864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:37.385203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:37.385223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:37.385228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:37.385231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:37.385233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:37.385235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:37.385717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:37.385734Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:37.385738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:37.385740Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:37.385741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:37.385743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:37.386208Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:37.386227Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:37.386231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:37.386233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:37.386235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:37.387992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:37.388008Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:37.388027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392997387
2025-10-02T08:16:37.388145Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:37.388153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:37.388156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:37.388158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:37.388161Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:37.388163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:37.388538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:37.388553Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:37.388556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:37.388560Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:37.388562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:37.388564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:37.389009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:37.389027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:37.389035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:37.389037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:37.389039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:37.389041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:37.389447Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:37.389464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:37.389470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:37.390346Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:37.390361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:37.390364Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:37.390366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:37.390372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392997390
2025-10-02T08:16:37.390613Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:37.390630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:37.390634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:37.390636Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:37.390639Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:37.390643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:37.391016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:37.391032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:37.391036Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:37.391038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:37.391040Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:37.391042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:37.391409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:37.391424Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.391494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392997391
2025-10-02T08:16:37.394248Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:37.394264Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:37.394268Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:37.394271Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:37.395679Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:37.395692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:37.395693Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:37.395702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535384325931274:4853]
2025-10-02T08:16:37.395704Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535384325931274:4853]
2025-10-02T08:16:37.395749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:37.395756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.395758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:37.395758Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:37.395763Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:37.395869Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:37.445964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535384325931351:10248]
2025-10-02T08:16:37.446064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2766, pipe: [1:7556535384325931351:10248]
2025-10-02T08:16:37.527123Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:37.527417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931351:10248], now have 1 active actors on pipe
2025-10-02T08:16:37.527517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535384325931351:10248]
2025-10-02T08:16:37.527532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:37.527534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:37.527552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2767 reason: error at write: Disconnected sessionId: src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0
2025-10-02T08:16:37.527588Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:37.527632Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:37.527718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2767 sessionId: src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0 is DEAD
2025-10-02T08:16:37.527828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:37.527839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0] Write session will restart in 0.008133s
2025-10-02T08:16:37.527860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0] Write session: Do CDS request
2025-10-02T08:16:37.527866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:37.533356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:37.534299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:37.534402Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:37.534409Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:37.534415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:37.534442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:37.534467Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535384325931489:4872]
2025-10-02T08:16:37.534934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:37.535087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:37.535118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:37.535308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:37.535341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.535347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.535348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.535348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.535349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.535352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.535358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.535360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.535362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.535364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.535367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.535371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.535374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.535377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.535379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.535382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.535384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.535386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.535389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.535391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.535402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:37.537209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.537324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:37.537335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2768
2025-10-02T08:16:37.537434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.537458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:37.537468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:37.537471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:37.537790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2768 sessionId:  describe result for acl check
2025-10-02T08:16:37.537816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:37.537820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:37.537822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:37.537826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535384325931505:4889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:37.538277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535384325931505:4889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:37.539882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535384325931505:4889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:37.542278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535384325931505:4889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:37.542289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535384325931505:4889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:37.542291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535384325931505:4889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:37.542297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:37.542567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:37.543867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:37.543880Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:37.543882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:37.543886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:37.543890Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2767 [1:7556535384325931489:4872]
2025-10-02T08:16:37.543898Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:37.543908Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:37.543910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.543911Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.543912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.543925Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:37.543932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:37.543936Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:37.544227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.544234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.544236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:37.544237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:37.544278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:37.544283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.544291Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.544297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:37.544308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535384325931483:4872]
2025-10-02T08:16:37.544313Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535384325931483:4872]
2025-10-02T08:16:37.544318Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:37.544323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2767
2025-10-02T08:16:37.544328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931537:4889], now have 1 active actors on pipe
2025-10-02T08:16:37.544327Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:37.544330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:37.544333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:37.544340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:37.544347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:37.544351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535384785181404:2378], now have 1 active actors on pipe
2025-10-02T08:16:37.544354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.544356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.544382Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535384325931483:4872]
2025-10-02T08:16:37.544387Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:37.544389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:37.544396Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:37.544367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2767
2025-10-02T08:16:37.544399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.544402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.544403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:37.544409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.544414Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:37.544439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.544469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.544473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.544481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.544503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2768 partition: 0 MaxSeqNo: 17 sessionId: src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0
2025-10-02T08:16:37.544747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d72b2e55-6b01b1c8-fc4a4b63-40f5b150_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:37.546902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0] Write session: try to update token
2025-10-02T08:16:37.546912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:37.559823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2768 sessionId: src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:37.561553Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:37.561572Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:37.561573Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:37.561579Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535384325931483:4872]
2025-10-02T08:16:37.561582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535384325931483:4872]
2025-10-02T08:16:37.561612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:37.561619Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.561621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:37.561630Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:37.561643Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:37.561740Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:37.562490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:37.627731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535384325931553:10248]
2025-10-02T08:16:37.627868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2767, pipe: [1:7556535384325931553:10248]
2025-10-02T08:16:37.687093Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:37.687388Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.687400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.687433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931553:10248], now have 1 active actors on pipe
2025-10-02T08:16:37.687545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535384325931553:10248]
2025-10-02T08:16:37.687564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:37.687570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:37.687621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2768 reason: error at write: Disconnected sessionId: src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0
2025-10-02T08:16:37.687649Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:37.687647Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:37.687789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2768 sessionId: src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0 is DEAD
2025-10-02T08:16:37.687915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:37.687924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0] Write session will restart in 0.009381s
2025-10-02T08:16:37.687943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0] Write session: Do CDS request
2025-10-02T08:16:37.687947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:37.693418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:37.694528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:37.694695Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:37.694703Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:37.694712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:37.694748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:37.694868Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535384325931691:4876]
2025-10-02T08:16:37.695481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:37.695622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:37.695655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:37.695944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:37.695978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.695983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.695984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.695986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.695987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.695991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.696000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.696008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.696021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.696025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.696029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.696040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.696052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.696062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.696071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.696075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.696080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.696089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.696093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.696098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.696121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:37.698245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.698329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:37.698342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2769
2025-10-02T08:16:37.698449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.698469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:37.698477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:37.698480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:37.698820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2769 sessionId:  describe result for acl check
2025-10-02T08:16:37.698863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:37.698869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:37.698870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:37.698875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535384325931707:4911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:37.699315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535384325931707:4911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:37.701017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535384325931707:4911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:37.703146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535384325931707:4911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:37.703159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535384325931707:4911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:37.703162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535384325931707:4911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:37.703168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:37.703398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:37.704720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:37.704734Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:37.704735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:37.704737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:37.704741Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2768 [1:7556535384325931691:4876]
2025-10-02T08:16:37.704749Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:37.704760Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:37.704763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.704765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.704766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.704777Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:37.704783Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:37.704788Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:37.704851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.704857Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.704859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:37.704860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:37.704900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:37.704907Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.704915Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.704921Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:37.704934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931739:4911], now have 1 active actors on pipe
2025-10-02T08:16:37.704936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535384785181410:2378], now have 1 active actors on pipe
2025-10-02T08:16:37.704940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535384325931685:4876]
2025-10-02T08:16:37.704943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2768
2025-10-02T08:16:37.704945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535384325931685:4876]
2025-10-02T08:16:37.704949Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:37.704957Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:37.704957Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:37.704959Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:37.704965Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:37.704967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:37.704974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.704982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.704985Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2768
2025-10-02T08:16:37.705012Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535384325931685:4876]
2025-10-02T08:16:37.705021Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:37.705026Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:37.705032Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:37.705039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.705042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.705043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:37.705050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.705062Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:37.705096Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.705125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.705130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.705138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.705161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2769 partition: 0 MaxSeqNo: 17 sessionId: src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0
2025-10-02T08:16:37.705419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c5b7ff-49e1472e-e21e177e-9e26b6c7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:37.707733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0] Write session: try to update token
2025-10-02T08:16:37.707746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:37.719450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2769 sessionId: src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:37.721199Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:37.721219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:37.721221Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:37.721229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535384325931685:4876]
2025-10-02T08:16:37.721233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535384325931685:4876]
2025-10-02T08:16:37.721274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:37.721273Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:37.721278Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:37.721285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.721287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:37.721411Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:37.721644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:37.787447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535384325931757:10248]
2025-10-02T08:16:37.787534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2768, pipe: [1:7556535384325931757:10248]
2025-10-02T08:16:37.847892Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:37.848190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.848203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.848235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931757:10248], now have 1 active actors on pipe
2025-10-02T08:16:37.848327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:37.848337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:37.848380Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:37.848385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2769 reason: error at write: Disconnected sessionId: src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0
2025-10-02T08:16:37.848435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:37.848522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2769 sessionId: src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0 is DEAD
2025-10-02T08:16:37.848604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535384325931757:10248]
2025-10-02T08:16:37.848664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:37.848675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0] Write session will restart in 0.009427s
2025-10-02T08:16:37.848700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0] Write session: Do CDS request
2025-10-02T08:16:37.848706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:37.853960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:37.854943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:37.855077Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:37.855088Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:37.855094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:37.855125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:37.855150Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535384325931899:4924]
2025-10-02T08:16:37.855545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:37.855699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:37.855737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:37.855948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:37.855977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.855981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.855982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.855982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.855983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.855986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.855992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.855994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.855995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.855997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.856001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.856005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:37.856008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.856019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:37.856025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.856027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:37.856029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.856032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.856034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.856036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.856046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:37.859193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.859282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:37.859293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2770
2025-10-02T08:16:37.859375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:37.859395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:37.859401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:37.859404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:37.859761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2770 sessionId:  describe result for acl check
2025-10-02T08:16:37.859792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:37.859796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:37.859797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:37.859800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535384325931915:4927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:37.860220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535384325931915:4927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:37.861711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535384325931915:4927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:37.863484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:37.864343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535384325931915:4927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:37.864353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535384325931915:4927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:37.864356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535384325931915:4927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:37.864361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:37.864848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:37.864860Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:37.864861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:37.864864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:37.864868Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2769 [1:7556535384325931899:4924]
2025-10-02T08:16:37.864876Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:37.864887Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:37.864889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.864891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.864893Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.864904Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:37.864910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:37.864914Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:37.864953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.864958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.864961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:37.864962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:37.865006Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:37.865010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.865018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:37.865024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:37.865037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931947:4927], now have 1 active actors on pipe
2025-10-02T08:16:37.865045Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535384325931891:4924]
2025-10-02T08:16:37.865046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535384325931891:4924]
2025-10-02T08:16:37.865048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2769
2025-10-02T08:16:37.865051Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:37.865060Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:37.865063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:37.865069Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:37.865074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:37.865077Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:37.865082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535384785181419:2378], now have 1 active actors on pipe
2025-10-02T08:16:37.865086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.865090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.865082Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2769
2025-10-02T08:16:37.865122Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535384325931891:4924]
2025-10-02T08:16:37.865131Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:37.865138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:37.865144Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:37.865148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:37.865151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:37.865152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:37.865158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:37.865167Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:37.865188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.865247Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:37.865252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:37.865261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:37.865282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2770 partition: 0 MaxSeqNo: 17 sessionId: src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0
2025-10-02T08:16:37.865567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29959c10-6e6402fd-5b6a2b9c-9e20c19a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:37.867886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0] Write session: try to update token
2025-10-02T08:16:37.867897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:37.879629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2770 sessionId: src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:37.881405Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:37.881421Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:37.881422Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:37.881428Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535384325931891:4924]
2025-10-02T08:16:37.881431Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535384325931891:4924]
2025-10-02T08:16:37.881460Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:37.881462Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:37.881466Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:37.881468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:37.881469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:37.881578Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:37.882312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:37.948724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535384325931963:10248]
2025-10-02T08:16:37.948868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2769, pipe: [1:7556535384325931963:10248]
2025-10-02T08:16:38.006006Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:38.006284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.006294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.006321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535384325931963:10248], now have 1 active actors on pipe
2025-10-02T08:16:38.006388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:38.006394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:38.006431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2770 reason: error at write: Disconnected sessionId: src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0
2025-10-02T08:16:38.006497Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:38.006504Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:38.006563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2770 sessionId: src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0 is DEAD
2025-10-02T08:16:38.006677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535384325931963:10248]
2025-10-02T08:16:38.006711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:38.006727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0] Write session will restart in 0.008065s
2025-10-02T08:16:38.006744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0] Write session: Do CDS request
2025-10-02T08:16:38.006748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:38.011945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:38.012984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:38.013166Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:38.013174Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:38.013182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:38.013233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:38.013265Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535388620899414:4980]
2025-10-02T08:16:38.013896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:38.014029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:38.014059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:38.014338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:38.014370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.014376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.014377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.014378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.014378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.014383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.014392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.014399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.014403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.014406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.014415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.014421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.014431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.014436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.014444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.014448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.014452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.014461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.014465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.014470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.014490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:38.016199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.016260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:38.016270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2771
2025-10-02T08:16:38.016377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.016402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:38.016410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:38.016413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:38.016743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2771 sessionId:  describe result for acl check
2025-10-02T08:16:38.016768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:38.016773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:38.016775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:38.016779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535388620899430:4986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:38.017218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535388620899430:4986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:38.018957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535388620899430:4986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:38.021233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535388620899430:4986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:38.021244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535388620899430:4986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:38.021247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535388620899430:4986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:38.021252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:38.021568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:38.022862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:38.022877Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:38.022879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:38.022881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:38.022884Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2770 [1:7556535388620899414:4980]
2025-10-02T08:16:38.022892Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:38.022903Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:38.022905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.022907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.022908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.022920Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:38.022925Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:38.022930Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:38.022981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.022986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.022989Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:38.022991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:38.023031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:38.023036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.023042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.023052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:38.023066Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535388620899408:4980]
2025-10-02T08:16:38.023070Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535388620899408:4980]
2025-10-02T08:16:38.023075Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:38.023081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2770
2025-10-02T08:16:38.023082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:38.023085Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:38.023087Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:38.023090Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:38.023092Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:38.023101Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620899461:4986], now have 1 active actors on pipe
2025-10-02T08:16:38.023108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535389080148734:2378], now have 1 active actors on pipe
2025-10-02T08:16:38.023133Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.023143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.023154Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535388620899408:4980]
2025-10-02T08:16:38.023160Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:38.023171Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:38.023175Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:38.023178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.023181Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.023182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:38.023188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.023194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:38.023165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2770
2025-10-02T08:16:38.023207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.023234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.023238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.023246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.023269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2771 partition: 0 MaxSeqNo: 17 sessionId: src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0
2025-10-02T08:16:38.023504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c6f5c6-6076de15-a86d6480-cf0200c2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:38.025828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0] Write session: try to update token
2025-10-02T08:16:38.025840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:38.037136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2771 sessionId: src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:38.039012Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:38.039028Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:38.039029Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:38.039035Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535388620899408:4980]
2025-10-02T08:16:38.039038Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535388620899408:4980]
2025-10-02T08:16:38.039067Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:38.039075Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.039079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:38.039096Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:38.039112Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:38.039194Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:38.039318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:38.106938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535388620899476:10248]
2025-10-02T08:16:38.107029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2770, pipe: [1:7556535388620899476:10248]
2025-10-02T08:16:38.159902Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:38.160126Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.160135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.160164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620899476:10248], now have 1 active actors on pipe
2025-10-02T08:16:38.160272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:38.160283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:38.160331Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:38.160334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2771 reason: error at write: Disconnected sessionId: src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0
2025-10-02T08:16:38.160379Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:38.160495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2771 sessionId: src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0 is DEAD
2025-10-02T08:16:38.160526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535388620899476:10248]
2025-10-02T08:16:38.160608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:38.160613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0] Write session will restart in 0.006899s
2025-10-02T08:16:38.160631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0] Write session: Do CDS request
2025-10-02T08:16:38.160635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:38.166124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:38.167051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:38.167188Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:38.167194Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:38.167200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:38.167232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:38.167256Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535388620899623:5010]
2025-10-02T08:16:38.167650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:38.167807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:38.167833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:38.168028Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:38.168065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.168070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.168071Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.168072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.168073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.168077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.168086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.168089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.168092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.168094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.168101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.168111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.168121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.168125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.168128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.168132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.168135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.168143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.168147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.168155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.168158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.168171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:38.168257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:38.168263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2772
2025-10-02T08:16:38.168371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.168393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:38.168402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:38.168408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:38.168666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2772 sessionId:  describe result for acl check
2025-10-02T08:16:38.168690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:38.168694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:38.168695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:38.168698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535388620899639:5035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:38.169057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535388620899639:5035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:38.170415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535388620899639:5035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:38.174585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535388620899639:5035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:38.174598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535388620899639:5035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:38.174600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535388620899639:5035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:38.174606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:38.175513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:38.176886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:38.176897Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:38.176899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:38.176900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:38.176904Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2771 [1:7556535388620899623:5010]
2025-10-02T08:16:38.176911Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:38.176921Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:38.176926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.176928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.176930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.176940Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:38.176949Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:38.176953Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:38.176988Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.176993Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.176995Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:38.176997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:38.177046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:38.177052Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.177059Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.177066Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:38.177088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535388620899617:5010]
2025-10-02T08:16:38.177091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2771
2025-10-02T08:16:38.177093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535388620899617:5010]
2025-10-02T08:16:38.177098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:38.177106Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620899671:5035], now have 1 active actors on pipe
2025-10-02T08:16:38.177108Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:38.177111Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:38.177114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535389080148740:2378], now have 1 active actors on pipe
2025-10-02T08:16:38.177117Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:38.177124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:38.177129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:38.177134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.177137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.177162Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535388620899617:5010]
2025-10-02T08:16:38.177168Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:38.177166Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2771
2025-10-02T08:16:38.177174Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:38.177177Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:38.177182Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.177185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.177187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:38.177195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.177203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:38.177229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.177271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.177275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.177283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.177306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2772 partition: 0 MaxSeqNo: 17 sessionId: src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0
2025-10-02T08:16:38.177586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40bfdd4d-8d6addd2-4cc1c3b5-5dce76ae_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:38.180095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0] Write session: try to update token
2025-10-02T08:16:38.180109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:38.192612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2772 sessionId: src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:38.193495Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:38.193513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:38.193515Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:38.193522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535388620899617:5010]
2025-10-02T08:16:38.193525Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535388620899617:5010]
2025-10-02T08:16:38.193555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:38.193563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.193565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:38.193583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:38.193600Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:38.193681Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:38.194905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:38.260503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535388620899685:10248]
2025-10-02T08:16:38.260620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2771, pipe: [1:7556535388620899685:10248]
2025-10-02T08:16:38.312909Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:38.313134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.313144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.313170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620899685:10248], now have 1 active actors on pipe
2025-10-02T08:16:38.313315Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:38.313444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:38.313455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:38.313499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2772 reason: error at write: Disconnected sessionId: src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0
2025-10-02T08:16:38.313674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2772 sessionId: src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0 is DEAD
2025-10-02T08:16:38.313742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:38.313753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0] Write session will restart in 0.005072s
2025-10-02T08:16:38.313769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0] Write session: Do CDS request
2025-10-02T08:16:38.313773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:38.313856Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:38.314041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535388620899685:10248]
2025-10-02T08:16:38.319661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:38.320196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.320260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:38.320269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2773
2025-10-02T08:16:38.320350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.320369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:38.320374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:38.320377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:38.320670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2773 sessionId:  describe result for acl check
2025-10-02T08:16:38.320695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:38.320699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:38.320700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:38.320703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535388620899873:5166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:38.320728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:38.320852Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:38.320858Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:38.320865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:38.320897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:38.320921Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535388620899875:5094]
2025-10-02T08:16:38.321008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535388620899873:5166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:38.321314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:38.321457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:38.321492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:38.321737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:38.321774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.321779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.321780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.321781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.321781Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.321786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.321794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.321800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.321804Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.321810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.321815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.321824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.321832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.321837Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.321840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.321844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.321852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.321860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.321868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.321876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.321896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:38.322412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535388620899873:5166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:38.327064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535388620899873:5166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:38.327077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535388620899873:5166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:38.327079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535388620899873:5166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:38.327096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:38.329075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:38.330482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:38.330497Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:38.330499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:38.330502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:38.330507Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2772 [1:7556535388620899875:5094]
2025-10-02T08:16:38.330517Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:38.330532Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:38.330534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.330537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.330538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.330552Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:38.330555Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:38.330561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:38.330608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.330611Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.330612Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:38.330616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:38.330665Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:38.330673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.330683Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.330694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2772
2025-10-02T08:16:38.330697Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:38.330713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620899917:5166], now have 1 active actors on pipe
2025-10-02T08:16:38.330719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535389080148769:2378], now have 1 active actors on pipe
2025-10-02T08:16:38.330724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.330727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.330745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535388620899866:5094]
2025-10-02T08:16:38.330750Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535388620899866:5094]
2025-10-02T08:16:38.330758Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:38.330769Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:38.330774Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:38.330776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:38.330786Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:38.330792Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:38.330773Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2772
2025-10-02T08:16:38.330805Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:38.330813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.330817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.330822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:38.330829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.330839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:38.330864Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535388620899866:5094]
2025-10-02T08:16:38.330872Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:38.330884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.330887Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:38.330955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.330961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.330975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.331006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2773 partition: 0 MaxSeqNo: 17 sessionId: src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0
2025-10-02T08:16:38.331251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f174be2-f249ec15-d67e7673-89d6c6e9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:38.333541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0] Write session: try to update token
2025-10-02T08:16:38.333554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:38.340833Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:38.340850Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:38.340856Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535388620899866:5094]
2025-10-02T08:16:38.340887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:38.340897Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:38.341029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:38.341155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:38.341272Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:38.341390Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:38.341552Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:38.341580Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:38.345118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2773 sessionId: src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:38.347251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:38.347331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.347340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.347366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:38.347385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:38.347510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.347529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.347685Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.347747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.347808Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.347868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.348080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.348094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.348155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.348227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.348289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.348351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.348393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.348402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.348468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.348521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.348576Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.348631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.348671Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.348678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.348736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.348795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.348878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.348935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.348978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.348984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.349045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.349105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.349165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.349226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.349275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.349286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.349350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.349405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.349465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.349525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.349564Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.349572Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.349631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.349686Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.349749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.349809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.349850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.349859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.349920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.349977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.350037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.350095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.350137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.350144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.350203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.350259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.350317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.350378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.350418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.350425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.350487Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.350541Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.350597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.350654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.350694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.350701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.350732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:38.350791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.350814Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.350820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:38.350846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:38.350861Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:38.350869Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:38.350871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:38.350878Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:38.351230Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:38.351261Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:38.351272Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:38.351276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:38.351278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:38.351283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:38.351811Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:38.351838Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:38.351849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:38.351855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:38.351859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:38.351862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:38.352328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:38.352353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:38.352362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:38.352366Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:38.352374Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:38.353541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:38.353566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:38.353578Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392998353
2025-10-02T08:16:38.353696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:38.353712Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:38.353722Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:38.353725Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:38.353730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:38.353737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:38.354169Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:38.354193Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:38.354198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:38.354201Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:38.354204Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:38.354207Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:38.354656Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:38.354695Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:38.354702Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:38.354705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:38.354708Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:38.354713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:38.355124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:38.355153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:38.355162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:38.356172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:38.356194Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:38.356200Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:38.356203Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:38.356216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392998355
2025-10-02T08:16:38.356492Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:38.356518Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:38.356528Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:38.356535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:38.356538Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:38.356541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:38.356994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:38.357019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:38.357029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:38.357032Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:38.357035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:38.357039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:38.357476Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:38.357500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.357601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392998357
2025-10-02T08:16:38.358257Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:38.358287Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:38.358295Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:38.358300Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:38.359636Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:38.359648Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:38.359649Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:38.359654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535388620899866:5094]
2025-10-02T08:16:38.359658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535388620899866:5094]
2025-10-02T08:16:38.359699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:38.359705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.359706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:38.359721Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:38.359734Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:38.359832Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:38.414139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535388620899939:10248]
2025-10-02T08:16:38.414256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2772, pipe: [1:7556535388620899939:10248]
2025-10-02T08:16:38.479154Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:38.479433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620899939:10248], now have 1 active actors on pipe
2025-10-02T08:16:38.479482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:38.479486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:38.479504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2773 reason: error at write: Disconnected sessionId: src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0
2025-10-02T08:16:38.479520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535388620899939:10248]
2025-10-02T08:16:38.479646Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:38.479662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2773 sessionId: src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0 is DEAD
2025-10-02T08:16:38.479708Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:38.479779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:38.479789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0] Write session will restart in 0.007440s
2025-10-02T08:16:38.479806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0] Write session: Do CDS request
2025-10-02T08:16:38.479810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:38.484817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:38.485731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:38.485850Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:38.485857Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:38.485863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:38.485889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:38.485912Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535388620900090:5206]
2025-10-02T08:16:38.486308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:38.486422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:38.486445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:38.486621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:38.486646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.486650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.486650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.486651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.486651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.486654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.486660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.486662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.486664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.486666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.486669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.486673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.486676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.486679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.486682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.486685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.486687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.486690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.486692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.486694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.486707Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:38.488187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.488242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:38.488249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2774
2025-10-02T08:16:38.488356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.488374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:38.488382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:38.488384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:38.488764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2774 sessionId:  describe result for acl check
2025-10-02T08:16:38.488819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:38.488825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:38.488827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:38.488831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535388620900106:5205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:38.489305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535388620900106:5205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:38.490951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535388620900106:5205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:38.493365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535388620900106:5205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:38.493376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535388620900106:5205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:38.493379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535388620900106:5205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:38.493385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:38.493710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:38.495007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:38.495016Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:38.495020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:38.495022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:38.495026Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2773 [1:7556535388620900090:5206]
2025-10-02T08:16:38.495034Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:38.495044Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:38.495049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.495050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.495052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.495061Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:38.495067Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:38.495072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:38.495112Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.495116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.495118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:38.495119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:38.495158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:38.495163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.495169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.495179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:38.495186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2773
2025-10-02T08:16:38.495192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620900137:5205], now have 1 active actors on pipe
2025-10-02T08:16:38.495194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535389080148776:2378], now have 1 active actors on pipe
2025-10-02T08:16:38.495198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535388620900084:5206]
2025-10-02T08:16:38.495199Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535388620900084:5206]
2025-10-02T08:16:38.495206Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:38.495217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:38.495220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.495223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:38.495223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.495239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:38.495255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:38.495261Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:38.495261Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2773
2025-10-02T08:16:38.495290Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23505fed-a96bd255-33da6962-df57ab5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:38.495299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.495305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.495306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:38.495313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.495321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:38.495331Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535388620900084:5206]
2025-10-02T08:16:38.495339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:38.495358Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:38.495359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.495391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.495395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.495403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.495426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2774 partition: 0 MaxSeqNo: 17 sessionId: src_id|23505fed-a96bd255-33da6962-df57ab5a_0
2025-10-02T08:16:38.495647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c14f987f-8abe5d40-5b723fe8-9c4ebabc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|23505fed-a96bd255-33da6962-df57ab5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:38.497856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23505fed-a96bd255-33da6962-df57ab5a_0] Write session: try to update token
2025-10-02T08:16:38.497869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23505fed-a96bd255-33da6962-df57ab5a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:38.508984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2774 sessionId: src_id|23505fed-a96bd255-33da6962-df57ab5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:38.511223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:38.511775Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.511793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.511811Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:38.511818Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:38.511820Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:38.511827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535388620900084:5206]
2025-10-02T08:16:38.511831Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535388620900084:5206]
2025-10-02T08:16:38.511868Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:38.511876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:38.511877Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:38.511881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.511884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:38.512001Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:38.579487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535388620900154:10248]
2025-10-02T08:16:38.579567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2773, pipe: [1:7556535388620900154:10248]
2025-10-02T08:16:38.638451Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:38.638658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:38.638687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:38.638702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620900154:10248], now have 1 active actors on pipe
2025-10-02T08:16:38.638757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:38.638762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:38.638773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2774 reason: error at write: Disconnected sessionId: src_id|23505fed-a96bd255-33da6962-df57ab5a_0
2025-10-02T08:16:38.638889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2774 sessionId: src_id|23505fed-a96bd255-33da6962-df57ab5a_0 is DEAD
2025-10-02T08:16:38.638888Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:38.639013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535388620900154:10248]
2025-10-02T08:16:38.639047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23505fed-a96bd255-33da6962-df57ab5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:38.639056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23505fed-a96bd255-33da6962-df57ab5a_0] Write session will restart in 0.009449s
2025-10-02T08:16:38.639073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23505fed-a96bd255-33da6962-df57ab5a_0] Write session: Do CDS request
2025-10-02T08:16:38.639078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23505fed-a96bd255-33da6962-df57ab5a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:38.644602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:38.645484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:38.645593Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:38.645602Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:38.645611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:38.645654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:38.645687Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535388620900305:5229]
2025-10-02T08:16:38.646149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:38.646310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:38.646369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:38.646645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:38.646695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.646700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.646700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.646701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.646701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.646705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.646711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.646713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.646715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.646716Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.646722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.646726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.646729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.646732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.646734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.646736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.646739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.646741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.646743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.646746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.646759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:38.649180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23505fed-a96bd255-33da6962-df57ab5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.649251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:38.649261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2775
2025-10-02T08:16:38.649362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.649382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:38.649388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:38.649391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:38.649703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2775 sessionId:  describe result for acl check
2025-10-02T08:16:38.649730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:38.649738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:38.649740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:38.649744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535388620900322:5257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:38.650174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535388620900322:5257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:38.651843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535388620900322:5257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:38.653839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:38.654516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535388620900322:5257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:38.654527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535388620900322:5257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:38.654531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535388620900322:5257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:38.654537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:38.655220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:38.655230Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:38.655231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:38.655235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:38.655239Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2774 [1:7556535388620900305:5229]
2025-10-02T08:16:38.655245Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:38.655256Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:38.655261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.655263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.655265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.655275Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:38.655277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:38.655282Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:38.655321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.655326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.655328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:38.655329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:38.655370Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:38.655375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.655382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.655388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:38.655401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620900353:5257], now have 1 active actors on pipe
2025-10-02T08:16:38.655408Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535388620900299:5229]
2025-10-02T08:16:38.655410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535388620900299:5229]
2025-10-02T08:16:38.655414Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:38.655419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535389080148782:2378], now have 1 active actors on pipe
2025-10-02T08:16:38.655421Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:38.655423Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:38.655427Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:38.655429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2774
2025-10-02T08:16:38.655435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:38.655437Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:38.655462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.655466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.655475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535388620900299:5229]
2025-10-02T08:16:38.655481Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:38.655451Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2774
2025-10-02T08:16:38.655489Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:38.655505Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40114840-2494f275-4996f48e-f2f87caf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:38.655513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.655516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.655518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:38.655524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.655532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:38.655547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.655574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.655578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.655587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.655610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2775 partition: 0 MaxSeqNo: 17 sessionId: src_id|40114840-2494f275-4996f48e-f2f87caf_0
2025-10-02T08:16:38.655832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23505fed-a96bd255-33da6962-df57ab5a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|40114840-2494f275-4996f48e-f2f87caf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:38.658119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40114840-2494f275-4996f48e-f2f87caf_0] Write session: try to update token
2025-10-02T08:16:38.658131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40114840-2494f275-4996f48e-f2f87caf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:38.669710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2775 sessionId: src_id|40114840-2494f275-4996f48e-f2f87caf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:38.671169Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:38.671183Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:38.671184Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:38.671191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535388620900299:5229]
2025-10-02T08:16:38.671194Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535388620900299:5229]
2025-10-02T08:16:38.671225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:38.671230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.671231Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:38.671241Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:38.671254Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:38.671350Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:38.672078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:38.739269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535388620900371:10248]
2025-10-02T08:16:38.739345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2774, pipe: [1:7556535388620900371:10248]
2025-10-02T08:16:38.794605Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:38.794838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.794850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.794886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620900371:10248], now have 1 active actors on pipe
2025-10-02T08:16:38.794995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:38.795001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:38.795045Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:38.795051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2775 reason: error at write: Disconnected sessionId: src_id|40114840-2494f275-4996f48e-f2f87caf_0
2025-10-02T08:16:38.795118Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:38.795196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2775 sessionId: src_id|40114840-2494f275-4996f48e-f2f87caf_0 is DEAD
2025-10-02T08:16:38.795280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535388620900371:10248]
2025-10-02T08:16:38.795360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40114840-2494f275-4996f48e-f2f87caf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:38.795370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40114840-2494f275-4996f48e-f2f87caf_0] Write session will restart in 0.008842s
2025-10-02T08:16:38.795390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40114840-2494f275-4996f48e-f2f87caf_0] Write session: Do CDS request
2025-10-02T08:16:38.795395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40114840-2494f275-4996f48e-f2f87caf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:38.801629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:38.802594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:38.802749Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:38.802758Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:38.802765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:38.802801Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:38.802825Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535388620900523:5255]
2025-10-02T08:16:38.803209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:38.803374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:38.803426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:38.803712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:38.803757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.803762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.803763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.803763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.803764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.803768Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.803777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.803780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.803783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.803786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.803800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.803810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.803820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.803827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.803831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.803835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.803842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.803846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.803854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.803862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.803881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:38.805214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40114840-2494f275-4996f48e-f2f87caf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.805332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:38.805342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2776
2025-10-02T08:16:38.805460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.805486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:38.805491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:38.805493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:38.805802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2776 sessionId:  describe result for acl check
2025-10-02T08:16:38.805832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:38.805838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:38.805840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:38.805844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535388620900539:5282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:38.806194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535388620900539:5282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:38.808158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535388620900539:5282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:38.810709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535388620900539:5282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:38.810721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535388620900539:5282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:38.810723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535388620900539:5282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:38.810728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:38.811135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:38.812494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:38.812507Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:38.812510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:38.812513Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:38.812517Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2775 [1:7556535388620900523:5255]
2025-10-02T08:16:38.812527Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:38.812542Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:38.812544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.812547Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.812548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.812562Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:38.812569Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:38.812575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:38.812620Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.812626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.812629Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:38.812632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:38.812686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:38.812694Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.812704Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.812714Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:38.812719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2775
2025-10-02T08:16:38.812733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620900571:5282], now have 1 active actors on pipe
2025-10-02T08:16:38.812740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535389080148788:2378], now have 1 active actors on pipe
2025-10-02T08:16:38.812744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.812747Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.812761Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535388620900517:5255]
2025-10-02T08:16:38.812766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535388620900517:5255]
2025-10-02T08:16:38.812775Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:38.812787Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:38.812788Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:38.812789Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:38.812816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:38.812822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:38.812836Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:38.812844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.812851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.812853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:38.812860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.812871Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:38.812901Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535388620900517:5255]
2025-10-02T08:16:38.812910Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:38.812915Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:38.812921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.812920Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2775
2025-10-02T08:16:38.812956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.812962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.812977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.813007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2776 partition: 0 MaxSeqNo: 17 sessionId: src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0
2025-10-02T08:16:38.813236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40114840-2494f275-4996f48e-f2f87caf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:38.815407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0] Write session: try to update token
2025-10-02T08:16:38.815416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:38.822552Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:38.822563Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:38.822571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535388620900517:5255]
2025-10-02T08:16:38.822609Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:38.822612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:38.822771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:38.822893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:38.823028Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:38.823157Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:38.823333Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:38.823365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:38.827335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2776 sessionId: src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:38.829692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:38.829741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.829751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.829779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:38.829796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:38.829837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.829852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.830011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.830069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.830129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.830185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.830233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.830241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.830307Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.830365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.830421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.830485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.830533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.830542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.830604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.830665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.830720Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.830777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.830815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.830826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.830892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.830948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.831006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.831068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.831114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.831123Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.831185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.831241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.831303Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.831362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.831407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.831414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.831477Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.831545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.831600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.831659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.831702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.831708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.831769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.831827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.831885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.831947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.831988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.831994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.832066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.832124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.832181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.832243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.832285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.832291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.832351Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.832409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.832469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.832527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.832570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.832577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.832636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:38.832692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:38.832750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:38.832824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:38.832869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:38.832876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:38.832910Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:38.832970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.832994Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.833000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:38.833028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:38.833042Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:38.833048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:38.833051Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:38.833058Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:38.833407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:38.833439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:38.833449Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:38.833452Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:38.833455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:38.833457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:38.833897Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:38.833918Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:38.833927Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:38.833934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:38.833936Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:38.833941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:38.834361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:38.834385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:38.834390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:38.834397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:38.834400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:38.835479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:38.835497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:38.835507Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392998835
2025-10-02T08:16:38.835685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:38.835700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:38.835705Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:38.835707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:38.835711Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:38.835714Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:38.836187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:38.836209Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:38.836218Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:38.836228Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:38.836235Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:38.836240Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:38.836684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:38.836707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:38.836720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:38.836727Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:38.836731Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:38.836738Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:38.837159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:38.837183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:38.837192Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:38.838196Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:38.838217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:38.838222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:38.838226Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:38.838234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392998838
2025-10-02T08:16:38.838514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:38.838535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:38.838541Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:38.838544Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:38.838547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:38.838550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:38.838990Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:38.839017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:38.839023Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:38.839027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:38.839030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:38.839035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:38.839466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:38.839487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.839581Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392998839
2025-10-02T08:16:38.840263Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:38.840282Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:38.840289Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:38.840296Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:38.841811Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:38.841826Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:38.841828Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:38.841839Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535388620900517:5255]
2025-10-02T08:16:38.841842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535388620900517:5255]
2025-10-02T08:16:38.841891Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:38.841896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:38.841900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.841901Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:38.841902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:38.842019Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:38.895425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535388620900600:10248]
2025-10-02T08:16:38.895512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2775, pipe: [1:7556535388620900600:10248]
2025-10-02T08:16:38.973830Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:38.974150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620900600:10248], now have 1 active actors on pipe
2025-10-02T08:16:38.974270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:38.974277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:38.974296Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:38.974301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2776 reason: error at write: Disconnected sessionId: src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0
2025-10-02T08:16:38.974360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:38.974439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2776 sessionId: src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0 is DEAD
2025-10-02T08:16:38.974550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:38.974560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0] Write session will restart in 0.007018s
2025-10-02T08:16:38.974582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0] Write session: Do CDS request
2025-10-02T08:16:38.974588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:38.974629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535388620900600:10248]
2025-10-02T08:16:38.981495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:38.981800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:38.981937Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:38.981947Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:38.981955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:38.981990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:38.982022Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535388620900812:5331]
2025-10-02T08:16:38.982210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.982315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:38.982324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2777
2025-10-02T08:16:38.982412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:38.982436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:38.982445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:38.982451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:38.982489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:38.982623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:38.982659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:38.982771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2777 sessionId:  describe result for acl check
2025-10-02T08:16:38.982796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:38.982802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:38.982803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:38.982809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535388620900824:5378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:38.982933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:38.982980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.982986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.982987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.982988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.982989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.982994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.983002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.983005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.983009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.983016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.983020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.983031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:38.983039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.983044Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:38.983050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.983055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:38.983062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.983066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.983074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.983080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.983096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:38.983251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535388620900824:5378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:38.985154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535388620900824:5378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:38.989902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535388620900824:5378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:38.989910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535388620900824:5378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:38.989914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535388620900824:5378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:38.989920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:38.994101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:38.995468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:38.995484Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:38.995486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:38.995489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:38.995495Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2776 [1:7556535388620900812:5331]
2025-10-02T08:16:38.995505Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:38.995519Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:38.995525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.995528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.995530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.995543Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:38.995548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:38.995556Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:38.995607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.995615Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.995618Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:38.995621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:38.995673Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:38.995678Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:38.995686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:38.995692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:38.995705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535388620900806:5331]
2025-10-02T08:16:38.995707Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535388620900806:5331]
2025-10-02T08:16:38.995711Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:38.995721Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:38.995726Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:38.995729Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:38.995732Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:38.995733Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:38.995740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535388620900859:5378], now have 1 active actors on pipe
2025-10-02T08:16:38.995765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535389080148797:2378], now have 1 active actors on pipe
2025-10-02T08:16:38.995768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2776
2025-10-02T08:16:38.995772Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535388620900806:5331]
2025-10-02T08:16:38.995774Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:38.995776Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:38.995780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.995783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.995814Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:38.995822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:38.995824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:38.995825Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:38.995804Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2776
2025-10-02T08:16:38.995833Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:38.995842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:38.995857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.995890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:38.995899Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:38.995920Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:38.995957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2777 partition: 0 MaxSeqNo: 17 sessionId: src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0
2025-10-02T08:16:38.996275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21d18c1-6c93068d-6808af9c-ce9cd84d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:38.998513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0] Write session: try to update token
2025-10-02T08:16:38.998525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:39.010393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2777 sessionId: src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:39.011883Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:39.011897Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:39.011899Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:39.011907Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535388620900806:5331]
2025-10-02T08:16:39.011912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535388620900806:5331]
2025-10-02T08:16:39.011945Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:39.011952Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.011951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:39.011954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:39.011956Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:39.012079Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:39.012871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:39.074615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535392915868181:10248]
2025-10-02T08:16:39.074742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2776, pipe: [1:7556535392915868181:10248]
2025-10-02T08:16:39.138008Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:39.138259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.138271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.138309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915868181:10248], now have 1 active actors on pipe
2025-10-02T08:16:39.138442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535392915868181:10248]
2025-10-02T08:16:39.138459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:39.138461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:39.138504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2777 reason: error at write: Disconnected sessionId: src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0
2025-10-02T08:16:39.138548Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:39.138542Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:39.138692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2777 sessionId: src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0 is DEAD
2025-10-02T08:16:39.138761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:39.138768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0] Write session will restart in 0.008156s
2025-10-02T08:16:39.138791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0] Write session: Do CDS request
2025-10-02T08:16:39.138795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:39.145398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:39.145832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:39.145941Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:39.145948Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:39.145953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:39.145979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:39.146004Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535392915868389:5376]
2025-10-02T08:16:39.146382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:39.146511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:39.146535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:39.146727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:39.146754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.146758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.146759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.146759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.146760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.146763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.146769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.146771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.146773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.146774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.146778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.146782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.146785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.146788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.146790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.146792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.146795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.146797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.146799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.146803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.146814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:39.148258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.148321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:39.148334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2778
2025-10-02T08:16:39.148444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.148480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:39.148501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:39.148510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:39.148871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2778 sessionId:  describe result for acl check
2025-10-02T08:16:39.148911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:39.148918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:39.148920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:39.148924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535392915868406:5373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:39.149265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535392915868406:5373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:39.150829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535392915868406:5373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:39.153524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535392915868406:5373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:39.153538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535392915868406:5373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:39.153541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535392915868406:5373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:39.153549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:39.154984Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:39.156315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:39.156326Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:39.156328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:39.156330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:39.156333Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2777 [1:7556535392915868389:5376]
2025-10-02T08:16:39.156340Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:39.156350Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:39.156352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.156354Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.156355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.156365Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:39.156368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:39.156372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:39.156410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.156416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.156418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:39.156420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:39.156463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:39.156468Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.156475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.156483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:39.156498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915868438:5373], now have 1 active actors on pipe
2025-10-02T08:16:39.156508Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535392915868383:5376]
2025-10-02T08:16:39.156510Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535392915868383:5376]
2025-10-02T08:16:39.156517Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:39.156523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2777
2025-10-02T08:16:39.156525Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:39.156528Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:39.156529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535393375116112:2378], now have 1 active actors on pipe
2025-10-02T08:16:39.156534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:39.156545Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:39.156551Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:39.156557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.156560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.156589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535392915868383:5376]
2025-10-02T08:16:39.156599Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:39.156557Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2777
2025-10-02T08:16:39.156608Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:39.156615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.156616Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:39.156618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.156619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:39.156624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.156629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:39.156655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.156693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.156699Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.156710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.156738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2778 partition: 0 MaxSeqNo: 17 sessionId: src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0
2025-10-02T08:16:39.156983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7dfb4ba-3974207b-2fc55b8b-e19535e2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:39.159166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0] Write session: try to update token
2025-10-02T08:16:39.159178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:39.171237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2778 sessionId: src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:39.172325Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:39.172339Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:39.172342Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:39.172350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535392915868383:5376]
2025-10-02T08:16:39.172354Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535392915868383:5376]
2025-10-02T08:16:39.172388Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:39.172392Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:39.172398Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:39.172399Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.172401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:39.172525Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:39.173796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:39.238475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535392915868455:10248]
2025-10-02T08:16:39.238605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2777, pipe: [1:7556535392915868455:10248]
2025-10-02T08:16:39.293682Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:39.293919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.293931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.293966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915868455:10248], now have 1 active actors on pipe
2025-10-02T08:16:39.294108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:39.294118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:39.294172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2778 reason: error at write: Disconnected sessionId: src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0
2025-10-02T08:16:39.294198Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:39.294212Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:39.294364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2778 sessionId: src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0 is DEAD
2025-10-02T08:16:39.294478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:39.294486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0] Write session will restart in 0.005080s
2025-10-02T08:16:39.294487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535392915868455:10248]
2025-10-02T08:16:39.294504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0] Write session: Do CDS request
2025-10-02T08:16:39.294509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:39.300151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.300252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:39.300264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2779
2025-10-02T08:16:39.300357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.300384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:39.300391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:39.300395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:39.300704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2779 sessionId:  describe result for acl check
2025-10-02T08:16:39.300727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:39.300733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:39.300734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:39.300738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535392915868660:5391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:39.300825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:39.301168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535392915868660:5391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:39.301431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:39.301535Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:39.301541Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:39.301548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:39.301579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:39.301602Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535392915868672:5409]
2025-10-02T08:16:39.301980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:39.302200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:39.302242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:39.302497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:39.302545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.302551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.302552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.302553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.302554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.302559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.302567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.302572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.302577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.302581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.302585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.302595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.302602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.302606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.302610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.302615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.302620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.302625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.302630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.302635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.302653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:39.303097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535392915868660:5391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:39.307677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535392915868660:5391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:39.307687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535392915868660:5391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:39.307690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535392915868660:5391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:39.307696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:39.309668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:39.310986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:39.310996Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:39.310997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:39.311001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:39.311005Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2778 [1:7556535392915868672:5409]
2025-10-02T08:16:39.311011Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:39.311021Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:39.311026Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.311028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.311029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.311038Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:39.311041Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:39.311046Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:39.311081Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.311086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.311088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:39.311090Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:39.311126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:39.311132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.311139Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.311145Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:39.311159Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535392915868661:5409]
2025-10-02T08:16:39.311163Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535392915868661:5409]
2025-10-02T08:16:39.311167Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:39.311176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:39.311188Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:39.311190Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:39.311193Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:39.311195Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:39.311216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915868713:5391], now have 1 active actors on pipe
2025-10-02T08:16:39.311216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2778
2025-10-02T08:16:39.311223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535393375116121:2378], now have 1 active actors on pipe
2025-10-02T08:16:39.311225Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535392915868661:5409]
2025-10-02T08:16:39.311227Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:39.311228Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:39.311233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.311236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.311271Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:39.311278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.311280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.311285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:39.311262Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2778
2025-10-02T08:16:39.311291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.311300Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:39.311316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.311342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.311347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.311356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.311381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2779 partition: 0 MaxSeqNo: 17 sessionId: src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0
2025-10-02T08:16:39.311618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63523c32-501a8b99-70aab78c-d8de4c3e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:39.313975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0] Write session: try to update token
2025-10-02T08:16:39.313988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:39.327275Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:39.327295Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:39.327298Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:39.327305Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535392915868661:5409]
2025-10-02T08:16:39.327308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535392915868661:5409]
2025-10-02T08:16:39.327343Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:39.327345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:39.327349Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:39.327350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.327352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:39.327472Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:39.355711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2779 sessionId: src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:39.358324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:39.394625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535392915868764:10248]
2025-10-02T08:16:39.394757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2778, pipe: [1:7556535392915868764:10248]
2025-10-02T08:16:39.454206Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:39.454455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.454464Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.454478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915868764:10248], now have 1 active actors on pipe
2025-10-02T08:16:39.454555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535392915868764:10248]
2025-10-02T08:16:39.454574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:39.454578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:39.454615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2779 reason: error at write: Disconnected sessionId: src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0
2025-10-02T08:16:39.454682Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:39.454683Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:39.454775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2779 sessionId: src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0 is DEAD
2025-10-02T08:16:39.454919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:39.454925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0] Write session will restart in 0.009537s
2025-10-02T08:16:39.454953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0] Write session: Do CDS request
2025-10-02T08:16:39.454957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:39.460761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:39.461433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:39.461532Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:39.461538Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:39.461543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:39.461567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:39.461592Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535392915868975:5525]
2025-10-02T08:16:39.461954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:39.462067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:39.462089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:39.462259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:39.462283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.462285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.462286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.462286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.462287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.462290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.462295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.462297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.462299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.462301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.462304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.462308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.462311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.462314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.462316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.462318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.462320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.462323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.462325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.462328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.462337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:39.465117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.465217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:39.465225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2780
2025-10-02T08:16:39.465313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.465333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:39.465339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:39.465341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:39.465601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2780 sessionId:  describe result for acl check
2025-10-02T08:16:39.465624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:39.465628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:39.465629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:39.465635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535392915868991:5529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:39.465967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535392915868991:5529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:39.467340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535392915868991:5529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:39.469482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535392915868991:5529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:39.469482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:39.469492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535392915868991:5529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:39.469494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535392915868991:5529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:39.469499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:39.470806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:39.470820Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:39.470821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:39.470824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:39.470827Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2779 [1:7556535392915868975:5525]
2025-10-02T08:16:39.470834Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:39.470843Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:39.470845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.470847Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.470848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.470859Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:39.470862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:39.470866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:39.470903Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.470909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.470911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:39.470912Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:39.470964Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:39.470972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.470979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.470986Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:39.470998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915869023:5529], now have 1 active actors on pipe
2025-10-02T08:16:39.471003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535392915868969:5525]
2025-10-02T08:16:39.471004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535392915868969:5525]
2025-10-02T08:16:39.471009Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:39.471012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2779
2025-10-02T08:16:39.471016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535393375116150:2378], now have 1 active actors on pipe
2025-10-02T08:16:39.471020Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:39.471020Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:39.471023Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:39.471029Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:39.471030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:39.471035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.471037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.471044Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2779
2025-10-02T08:16:39.471063Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535392915868969:5525]
2025-10-02T08:16:39.471069Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:39.471072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:39.471078Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:39.471082Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.471085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.471086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:39.471091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.471097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:39.471129Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.471169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.471175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.471183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.471206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2780 partition: 0 MaxSeqNo: 17 sessionId: src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0
2025-10-02T08:16:39.471473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b757d64d-f2c7eea7-6a1e5484-62bd585b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:39.473791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0] Write session: try to update token
2025-10-02T08:16:39.473804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:39.485592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2780 sessionId: src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:39.486794Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:39.486807Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:39.486808Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:39.486817Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535392915868969:5525]
2025-10-02T08:16:39.486820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535392915868969:5525]
2025-10-02T08:16:39.486851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:39.486855Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:39.486859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.486860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:39.486860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:39.486989Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:39.487765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:39.554863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535392915869041:10248]
2025-10-02T08:16:39.554955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2779, pipe: [1:7556535392915869041:10248]
2025-10-02T08:16:39.607126Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:39.607400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.607411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.607442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915869041:10248], now have 1 active actors on pipe
2025-10-02T08:16:39.607519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535392915869041:10248]
2025-10-02T08:16:39.607543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:39.607545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:39.607590Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:39.607603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2780 reason: error at write: Disconnected sessionId: src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0
2025-10-02T08:16:39.607565Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:39.607775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2780 sessionId: src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0 is DEAD
2025-10-02T08:16:39.607880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:39.607885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0] Write session will restart in 0.008585s
2025-10-02T08:16:39.607903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0] Write session: Do CDS request
2025-10-02T08:16:39.607907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:39.614167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:39.614526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:39.614646Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:39.614653Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:39.614660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:39.614687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:39.614712Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535392915869257:5583]
2025-10-02T08:16:39.615127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:39.615253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:39.615277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:39.615457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:39.615486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.615492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.615492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.615493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.615494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.615499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.615508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.615514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.615517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.615518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.615522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.615526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.615533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.615535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.615539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.615542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.615544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.615550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.615552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.615554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.615565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:39.617207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.617342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:39.617352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2781
2025-10-02T08:16:39.617458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.617483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:39.617491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:39.617493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:39.617844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2781 sessionId:  describe result for acl check
2025-10-02T08:16:39.617874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:39.617878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:39.617880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:39.617884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535392915869273:5599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:39.618325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535392915869273:5599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:39.619977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535392915869273:5599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:39.622352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535392915869273:5599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:39.622363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535392915869273:5599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:39.622365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535392915869273:5599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:39.622370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:39.622882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:39.624430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:39.624443Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:39.624446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:39.624450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:39.624455Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2780 [1:7556535392915869257:5583]
2025-10-02T08:16:39.624464Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:39.624482Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:39.624489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.624492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.624494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.624508Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:39.624517Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:39.624527Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:39.624578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.624584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.624587Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:39.624589Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:39.624669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2780
2025-10-02T08:16:39.624682Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:39.624684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.624695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.624711Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:39.624734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915869305:5599], now have 1 active actors on pipe
2025-10-02T08:16:39.624737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535393375116156:2378], now have 1 active actors on pipe
2025-10-02T08:16:39.624742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.624745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.624760Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535392915869251:5583]
2025-10-02T08:16:39.624766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535392915869251:5583]
2025-10-02T08:16:39.624778Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:39.624785Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:39.624787Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:39.624752Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2780
2025-10-02T08:16:39.624794Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:39.624822Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:39.624825Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:39.624839Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:39.624848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.624852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.624853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:39.624863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.624875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:39.624911Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535392915869251:5583]
2025-10-02T08:16:39.624925Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:39.624934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.624960Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:39.624974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.624978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.624994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.625022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2781 partition: 0 MaxSeqNo: 17 sessionId: src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0
2025-10-02T08:16:39.625270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f29bdd28-5aa2abcc-d84e6638-5150dc78_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:39.627529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0] Write session: try to update token
2025-10-02T08:16:39.627540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:39.639552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2781 sessionId: src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:39.640712Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:39.640726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:39.640728Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:39.640734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535392915869251:5583]
2025-10-02T08:16:39.640737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535392915869251:5583]
2025-10-02T08:16:39.640768Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:39.640772Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:39.640775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.640777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:39.640781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:39.640902Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:39.641975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:39.707447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535392915869324:10248]
2025-10-02T08:16:39.707517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2780, pipe: [1:7556535392915869324:10248]
2025-10-02T08:16:39.770601Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:39.770852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.770861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.770892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915869324:10248], now have 1 active actors on pipe
2025-10-02T08:16:39.771005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:39.771016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:39.771044Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:39.771080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2781 reason: error at write: Disconnected sessionId: src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0
2025-10-02T08:16:39.771132Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:39.771236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535392915869324:10248]
2025-10-02T08:16:39.771278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2781 sessionId: src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0 is DEAD
2025-10-02T08:16:39.771401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:39.771410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0] Write session will restart in 0.005407s
2025-10-02T08:16:39.771429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0] Write session: Do CDS request
2025-10-02T08:16:39.771433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:39.777158Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:39.777787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:39.777904Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:39.777910Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:39.777916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:39.777945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:39.777977Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535392915869543:5640]
2025-10-02T08:16:39.778191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.778234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:39.778243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2782
2025-10-02T08:16:39.778369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.778388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:39.778394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:39.778398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:39.778405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:39.778567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:39.778609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:39.778635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2782 sessionId:  describe result for acl check
2025-10-02T08:16:39.778655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:39.778659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:39.778660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:39.778663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535392915869554:5667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:39.778825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:39.778866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.778871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.778872Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.778873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.778874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.778879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.778887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.778895Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.778899Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.778902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.778909Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.778919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.778929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.778937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.778939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.778945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.778948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.778950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.778952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.778955Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.778964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:39.778965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535392915869554:5667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:39.780606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535392915869554:5667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:39.785696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535392915869554:5667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:39.785708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535392915869554:5667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:39.785712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535392915869554:5667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:39.785718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:39.786129Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:39.787591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:39.787609Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:39.787611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:39.787614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:39.787619Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2781 [1:7556535392915869543:5640]
2025-10-02T08:16:39.787629Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:39.787643Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:39.787651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.787653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.787655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.787668Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:39.787675Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:39.787681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:39.787740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.787746Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.787748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:39.787751Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:39.787807Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:39.787815Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.787821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2781
2025-10-02T08:16:39.787827Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.787837Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:39.787854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915869591:5667], now have 1 active actors on pipe
2025-10-02T08:16:39.787862Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535393375116162:2378], now have 1 active actors on pipe
2025-10-02T08:16:39.787866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.787873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.787888Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535392915869537:5640]
2025-10-02T08:16:39.787893Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535392915869537:5640]
2025-10-02T08:16:39.787904Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:39.787919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:39.787919Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:39.787922Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:39.787934Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:39.787914Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2781
2025-10-02T08:16:39.787941Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:39.787955Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:39.787965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.787972Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.787974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:39.787981Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.787989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:39.788034Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535392915869537:5640]
2025-10-02T08:16:39.788046Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:39.788055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.788062Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:39.788098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.788121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.788134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.788164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2782 partition: 0 MaxSeqNo: 17 sessionId: src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0
2025-10-02T08:16:39.788437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|663b7a28-dbe556e5-d5230e79-2293f1bc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:39.790792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0] Write session: try to update token
2025-10-02T08:16:39.790804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:39.797677Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:39.797690Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:39.797698Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535392915869537:5640]
2025-10-02T08:16:39.797734Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:39.797737Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:39.797910Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:39.798050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:39.798181Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:39.798312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:39.798616Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:39.798676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:39.802669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2782 sessionId: src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:39.804868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:39.804917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.804927Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.804956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:39.804974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:39.805016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.805020Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.805145Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.805199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.805251Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.805310Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.805349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.805356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.805415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.805466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.805521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.805593Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.805631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.805636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.805690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.805742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.805795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.805846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.805885Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.805890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.805944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.805997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.806051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.806104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.806143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.806149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.806204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.806254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.806308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.806416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.806455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.806459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.806561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.806612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.806668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.806721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.806769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.806774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.806827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.806879Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.806931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.806981Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.807019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.807025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.807080Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.807130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.807188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.807242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.807282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.807287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.807341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.807402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.807471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.807533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.807575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.807581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.807634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:39.807684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:39.807740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:39.807789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:39.807828Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:39.807834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:39.807859Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:39.807907Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.807922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.807927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:39.807949Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:39.807961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:39.807966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:39.807968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:39.807969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:39.808320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:39.808339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:39.808347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:39.808349Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:39.808354Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:39.808356Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:39.808785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:39.808817Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:39.808826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:39.808830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:39.808832Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:39.808836Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:39.809301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:39.809320Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:39.809324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:39.809326Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:39.809329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:39.810355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:39.810368Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:39.810377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759392999810
2025-10-02T08:16:39.810489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:39.810497Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:39.810500Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:39.810502Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:39.810504Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:39.810506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:39.810899Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:39.810916Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:39.810919Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:39.810923Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:39.810925Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:39.810929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:39.811309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:39.811324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:39.811328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:39.811329Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:39.811332Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:39.811335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:39.811732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:39.811746Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:39.811749Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:39.812648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:39.812661Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:39.812664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:39.812666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:39.812671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759392999812
2025-10-02T08:16:39.812947Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:39.812962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:39.812966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:39.812968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:39.812970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:39.812972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:39.813353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:39.813370Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:39.813377Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:39.813380Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:39.813383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:39.813385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:39.813765Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:39.813779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.813849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759392999813
2025-10-02T08:16:39.814466Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:39.814483Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:39.814487Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:39.814494Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:39.815899Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:39.815907Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:39.815908Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:39.815914Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535392915869537:5640]
2025-10-02T08:16:39.815916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535392915869537:5640]
2025-10-02T08:16:39.815956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:39.815962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.815963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:39.816071Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:39.816080Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:39.816081Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:39.871285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535392915869615:10248]
2025-10-02T08:16:39.871380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2781, pipe: [1:7556535392915869615:10248]
2025-10-02T08:16:39.936468Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:39.936745Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915869615:10248], now have 1 active actors on pipe
2025-10-02T08:16:39.936878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535392915869615:10248]
2025-10-02T08:16:39.936903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:39.936910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:39.936943Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:39.936947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2782 reason: error at write: Disconnected sessionId: src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0
2025-10-02T08:16:39.937000Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:39.937120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2782 sessionId: src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0 is DEAD
2025-10-02T08:16:39.937247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:39.937258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0] Write session will restart in 0.005211s
2025-10-02T08:16:39.937281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0] Write session: Do CDS request
2025-10-02T08:16:39.937287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:39.943196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.943265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:39.943278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2783
2025-10-02T08:16:39.943299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:39.943392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:39.943420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:39.943425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:39.943428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:39.943705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2783 sessionId:  describe result for acl check
2025-10-02T08:16:39.943726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:39.943727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:39.943728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:39.943731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535392915869835:5708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:39.943785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:39.943895Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:39.943903Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:39.943910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:39.943940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:39.943961Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535392915869837:5691]
2025-10-02T08:16:39.944059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535392915869835:5708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:39.944330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:39.944456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:39.944490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:39.944754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:39.944823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.944829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.944830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.944830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.944831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.944836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.944844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.944848Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.944851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.944855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.944860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.944866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:39.944870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.944874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:39.944878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.944882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:39.944885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.944890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.944893Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.944896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.944912Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:39.945489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535392915869835:5708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:39.951069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535392915869835:5708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:39.951081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535392915869835:5708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:39.951085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535392915869835:5708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:39.951092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:39.952843Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:39.954180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:39.954192Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:39.954194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:39.954196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:39.954201Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2782 [1:7556535392915869837:5691]
2025-10-02T08:16:39.954208Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:39.954220Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:39.954221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.954223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.954225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.954237Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:39.954239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:39.954243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:39.954281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.954282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.954284Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:39.954286Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:39.954338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:39.954344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.954352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:39.954359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:39.954371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535392915869883:5708], now have 1 active actors on pipe
2025-10-02T08:16:39.954379Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535392915869828:5691]
2025-10-02T08:16:39.954380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535392915869828:5691]
2025-10-02T08:16:39.954385Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:39.954390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535393375116171:2378], now have 1 active actors on pipe
2025-10-02T08:16:39.954394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2782
2025-10-02T08:16:39.954396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:39.954403Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:39.954404Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:39.954406Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:39.954406Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:39.954429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.954435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.954445Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535392915869828:5691]
2025-10-02T08:16:39.954451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:39.954469Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:39.954470Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:39.954476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:39.954478Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:39.954480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:39.954484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:39.954460Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2782
2025-10-02T08:16:39.954490Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:39.954507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.954538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:39.954542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:39.954551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:39.954576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2783 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0
2025-10-02T08:16:39.954827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0363d9-7b4b6d22-3e2f1059-4f9218e3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:39.957278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0] Write session: try to update token
2025-10-02T08:16:39.957292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:39.970110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2783 sessionId: src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:39.972086Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:39.972100Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:39.972101Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:39.972107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535392915869828:5691]
2025-10-02T08:16:39.972111Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535392915869828:5691]
2025-10-02T08:16:39.972144Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:39.972147Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:39.972149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:39.972152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:39.972154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:39.972275Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:39.972521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:40.037170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535397210837205:10248]
2025-10-02T08:16:40.037271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2782, pipe: [1:7556535397210837205:10248]
2025-10-02T08:16:40.107153Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:40.107483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.107492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.107521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210837205:10248], now have 1 active actors on pipe
2025-10-02T08:16:40.107639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535397210837205:10248]
2025-10-02T08:16:40.107655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:40.107660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:40.107685Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:40.107704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2783 reason: error at write: Disconnected sessionId: src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0
2025-10-02T08:16:40.107702Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:40.107852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2783 sessionId: src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0 is DEAD
2025-10-02T08:16:40.108000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:40.108021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0] Write session will restart in 0.006514s
2025-10-02T08:16:40.108046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0] Write session: Do CDS request
2025-10-02T08:16:40.108054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:40.113530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:40.113811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:40.113939Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:40.113947Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:40.113953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:40.113981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:40.114005Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535397210837427:5753]
2025-10-02T08:16:40.114650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:40.114832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:40.114881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:40.115167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.115182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:40.115227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.115232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.115233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.115234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.115235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.115240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.115249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.115253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.115255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.115256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.115260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.115264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.115267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:40.115267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.115270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.115272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2784
2025-10-02T08:16:40.115273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.115276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.115278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.115281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.115283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.115285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.115297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:40.115382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.115405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:40.115411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:40.115413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:40.115662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2784 sessionId:  describe result for acl check
2025-10-02T08:16:40.115681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:40.115685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:40.115686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:40.115689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535397210837443:5728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:40.116041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535397210837443:5728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:40.117634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535397210837443:5728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:40.122204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535397210837443:5728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:40.122214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535397210837443:5728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:40.122216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535397210837443:5728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:40.122222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:40.122590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:40.123855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:40.123866Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:40.123868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:40.123870Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:40.123875Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2783 [1:7556535397210837427:5753]
2025-10-02T08:16:40.123882Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:40.123893Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:40.123898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.123900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.123902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.123913Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:40.123919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:40.123924Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:40.123962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.123970Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.123972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:40.123974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:40.124028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:40.124035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.124044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.124056Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:40.124067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2783
2025-10-02T08:16:40.124075Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210837474:5728], now have 1 active actors on pipe
2025-10-02T08:16:40.124078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535397670083487:2378], now have 1 active actors on pipe
2025-10-02T08:16:40.124083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.124086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.124104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535397210837421:5753]
2025-10-02T08:16:40.124109Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535397210837421:5753]
2025-10-02T08:16:40.124122Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:40.124129Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:40.124131Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:40.124137Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:40.124137Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2783
2025-10-02T08:16:40.124153Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:40.124161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:40.124174Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9550b471-d2e944cd-d395cf84-84afe15e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:40.124180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.124183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.124184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:40.124191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.124202Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:40.124242Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535397210837421:5753]
2025-10-02T08:16:40.124253Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:40.124265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.124267Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:40.124312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.124318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.124332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.124365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2784 partition: 0 MaxSeqNo: 17 sessionId: src_id|9550b471-d2e944cd-d395cf84-84afe15e_0
2025-10-02T08:16:40.124632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ad64ea-bd595cf2-19b20d60-2576f98a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9550b471-d2e944cd-d395cf84-84afe15e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:40.126815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9550b471-d2e944cd-d395cf84-84afe15e_0] Write session: try to update token
2025-10-02T08:16:40.126825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9550b471-d2e944cd-d395cf84-84afe15e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:40.139196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2784 sessionId: src_id|9550b471-d2e944cd-d395cf84-84afe15e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:40.140606Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:40.140620Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:40.140622Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:40.140631Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535397210837421:5753]
2025-10-02T08:16:40.140634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535397210837421:5753]
2025-10-02T08:16:40.140664Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:40.140666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:40.140668Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:40.140670Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.140672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:40.140795Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:40.141623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:40.207693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535397210837491:10248]
2025-10-02T08:16:40.207796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2783, pipe: [1:7556535397210837491:10248]
2025-10-02T08:16:40.266606Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:40.266889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.266898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.266928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210837491:10248], now have 1 active actors on pipe
2025-10-02T08:16:40.267058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535397210837491:10248]
2025-10-02T08:16:40.267085Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:40.267088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:40.267091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:40.267125Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:40.267155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2784 reason: error at write: Disconnected sessionId: src_id|9550b471-d2e944cd-d395cf84-84afe15e_0
2025-10-02T08:16:40.267322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2784 sessionId: src_id|9550b471-d2e944cd-d395cf84-84afe15e_0 is DEAD
2025-10-02T08:16:40.267466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9550b471-d2e944cd-d395cf84-84afe15e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:40.267475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9550b471-d2e944cd-d395cf84-84afe15e_0] Write session will restart in 0.009990s
2025-10-02T08:16:40.267492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9550b471-d2e944cd-d395cf84-84afe15e_0] Write session: Do CDS request
2025-10-02T08:16:40.267497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9550b471-d2e944cd-d395cf84-84afe15e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:40.273359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:40.274086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:40.274193Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:40.274200Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:40.274206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:40.274233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:40.274257Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535397210837713:5765]
2025-10-02T08:16:40.274627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:40.274749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:40.274772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:40.274940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:40.274965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.274969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.274970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.274970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.274971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.274974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.274979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.274981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.274983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.274985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.274988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.274993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.274996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.274998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.275000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.275004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.275006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.275008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.275010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.275012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.275022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:40.278230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9550b471-d2e944cd-d395cf84-84afe15e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.278301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:40.278310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2785
2025-10-02T08:16:40.278416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.278442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:40.278451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:40.278454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:40.278792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2785 sessionId:  describe result for acl check
2025-10-02T08:16:40.278822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:40.278828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:40.278829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:40.278834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535397210837729:5783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:40.279282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535397210837729:5783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:40.280932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535397210837729:5783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:40.282152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:40.283073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535397210837729:5783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:40.283084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535397210837729:5783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:40.283087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535397210837729:5783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:40.283094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:40.283537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:40.283549Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:40.283551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:40.283553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:40.283557Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2784 [1:7556535397210837713:5765]
2025-10-02T08:16:40.283565Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:40.283575Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:40.283576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.283578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.283580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.283591Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:40.283593Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:40.283598Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:40.283632Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.283638Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.283640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:40.283642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:40.283681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:40.283686Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.283693Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.283699Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:40.283706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2784
2025-10-02T08:16:40.283711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210837761:5783], now have 1 active actors on pipe
2025-10-02T08:16:40.283713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535397670083494:2378], now have 1 active actors on pipe
2025-10-02T08:16:40.283717Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535397210837707:5765]
2025-10-02T08:16:40.283718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535397210837707:5765]
2025-10-02T08:16:40.283722Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:40.283729Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.283730Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:40.283731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.283732Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:40.283745Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:40.283755Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:40.283759Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:40.283786Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:40.283797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.283804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.283805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:40.283787Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2784
2025-10-02T08:16:40.283813Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.283824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:40.283833Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535397210837707:5765]
2025-10-02T08:16:40.283841Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:40.283845Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:40.283861Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.283891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.283895Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.283904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.283927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2785 partition: 0 MaxSeqNo: 17 sessionId: src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0
2025-10-02T08:16:40.284167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9550b471-d2e944cd-d395cf84-84afe15e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:40.286609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0] Write session: try to update token
2025-10-02T08:16:40.286624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:40.299674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2785 sessionId: src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:40.299952Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:40.299962Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:40.299964Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:40.299969Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535397210837707:5765]
2025-10-02T08:16:40.299972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535397210837707:5765]
2025-10-02T08:16:40.299999Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:40.300000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:40.300004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.300014Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:40.300014Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:40.300130Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:40.302084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:40.367444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535397210837786:10248]
2025-10-02T08:16:40.367506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2784, pipe: [1:7556535397210837786:10248]
2025-10-02T08:16:40.420242Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:40.420470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.420479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.420509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210837786:10248], now have 1 active actors on pipe
2025-10-02T08:16:40.420637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535397210837786:10248]
2025-10-02T08:16:40.420652Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:40.420657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:40.420660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:40.420712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2785 reason: error at write: Disconnected sessionId: src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0
2025-10-02T08:16:40.420699Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:40.420879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2785 sessionId: src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0 is DEAD
2025-10-02T08:16:40.421023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:40.421028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0] Write session will restart in 0.006564s
2025-10-02T08:16:40.421047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0] Write session: Do CDS request
2025-10-02T08:16:40.421052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:40.427196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:40.427728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:40.427837Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:40.427843Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:40.427849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:40.427876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:40.427899Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535397210838039:5838]
2025-10-02T08:16:40.428172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.428291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:40.428342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:40.428347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2786
2025-10-02T08:16:40.428417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:40.428430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.428443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:40.428452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:40.428459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:40.428462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:40.428638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:40.428669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.428673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.428674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.428674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.428675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.428678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.428684Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.428686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.428688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.428689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.428693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.428697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.428701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.428703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.428705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.428708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.428710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.428712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.428715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.428715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2786 sessionId:  describe result for acl check
2025-10-02T08:16:40.428717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.428727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:40.428737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:40.428743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:40.428745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:40.428748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535397210838051:5865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:40.429093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535397210838051:5865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:40.430860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535397210838051:5865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:40.435830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535397210838051:5865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:40.435840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535397210838051:5865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:40.435842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535397210838051:5865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:40.435848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:40.435969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:40.437320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:40.437331Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:40.437333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:40.437335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:40.437339Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2785 [1:7556535397210838039:5838]
2025-10-02T08:16:40.437347Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:40.437358Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:40.437360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.437363Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.437364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.437375Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:40.437379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:40.437383Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:40.437424Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.437429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.437431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:40.437432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:40.437476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:40.437482Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.437489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.437495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:40.437505Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535397210838033:5838]
2025-10-02T08:16:40.437509Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535397210838033:5838]
2025-10-02T08:16:40.437514Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:40.437522Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:40.437531Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:40.437532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2785
2025-10-02T08:16:40.437533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:40.437534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:40.437535Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:40.437543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210838084:5865], now have 1 active actors on pipe
2025-10-02T08:16:40.437561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535397670083523:2378], now have 1 active actors on pipe
2025-10-02T08:16:40.437566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535397210838033:5838]
2025-10-02T08:16:40.437568Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:40.437570Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:40.437571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.437574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.437601Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:40.437609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.437583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2785
2025-10-02T08:16:40.437612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.437613Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:40.437617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.437622Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:40.437635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.437683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.437689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.437697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.437717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2786 partition: 0 MaxSeqNo: 17 sessionId: src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0
2025-10-02T08:16:40.437977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79f87f7d-7fb77a20-ce052ca9-570b104f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:40.440438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0] Write session: try to update token
2025-10-02T08:16:40.440450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:40.453535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2786 sessionId: src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:40.454976Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:40.454991Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:40.454993Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:40.455000Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535397210838033:5838]
2025-10-02T08:16:40.455003Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535397210838033:5838]
2025-10-02T08:16:40.455032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:40.455036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.455038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:40.455053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:40.455066Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:40.455156Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:40.455799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:40.521016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535397210838099:10248]
2025-10-02T08:16:40.521131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2785, pipe: [1:7556535397210838099:10248]
2025-10-02T08:16:40.574406Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:40.574727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.574738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.574771Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210838099:10248], now have 1 active actors on pipe
2025-10-02T08:16:40.574879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535397210838099:10248]
2025-10-02T08:16:40.574901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:40.574908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:40.574920Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:40.574964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2786 reason: error at write: Disconnected sessionId: src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0
2025-10-02T08:16:40.574963Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:40.575138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2786 sessionId: src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0 is DEAD
2025-10-02T08:16:40.575232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:40.575241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0] Write session will restart in 0.009954s
2025-10-02T08:16:40.575258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0] Write session: Do CDS request
2025-10-02T08:16:40.575263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:40.581850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:40.582136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:40.582263Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:40.582271Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:40.582279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:40.582311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:40.582343Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535397210838328:5918]
2025-10-02T08:16:40.582952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:40.583111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:40.583153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:40.583360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:40.583389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.583392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.583393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.583393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.583394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.583397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.583403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.583405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.583407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.583409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.583413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.583417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.583420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.583422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.583425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.583427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.583429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.583432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.583436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.583439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.583449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:40.586219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.586290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:40.586298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2787
2025-10-02T08:16:40.586401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.586426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:40.586434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:40.586437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:40.586980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2787 sessionId:  describe result for acl check
2025-10-02T08:16:40.587005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:40.587011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:40.587012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:40.587017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535397210838345:5917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:40.587497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535397210838345:5917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:40.589211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535397210838345:5917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:40.590785Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:40.591358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535397210838345:5917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:40.591371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535397210838345:5917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:40.591375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535397210838345:5917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:40.591382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:40.592183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:40.592196Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:40.592198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:40.592201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:40.592206Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2786 [1:7556535397210838328:5918]
2025-10-02T08:16:40.592216Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:40.592228Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:40.592230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.592233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.592235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.592249Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:40.592253Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:40.592258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:40.592301Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.592308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.592310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:40.592313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:40.592364Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:40.592371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.592382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.592393Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:40.592409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2786
2025-10-02T08:16:40.592411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210838376:5917], now have 1 active actors on pipe
2025-10-02T08:16:40.592415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535397670083530:2378], now have 1 active actors on pipe
2025-10-02T08:16:40.592420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535397210838322:5918]
2025-10-02T08:16:40.592421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535397210838322:5918]
2025-10-02T08:16:40.592426Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:40.592434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.592434Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:40.592437Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:40.592437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.592451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:40.592466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:40.592474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:40.592450Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2786
2025-10-02T08:16:40.592521Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:40.592530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.592533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.592535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:40.592544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.592550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:40.592566Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535397210838322:5918]
2025-10-02T08:16:40.592576Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:40.592588Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:40.592599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.592640Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.592646Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.592656Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.592684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2787 partition: 0 MaxSeqNo: 17 sessionId: src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0
2025-10-02T08:16:40.592939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bda967b-9b85fa50-377d929a-2a31aa24_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:40.595289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0] Write session: try to update token
2025-10-02T08:16:40.595300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:40.606825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2787 sessionId: src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:40.608820Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:40.608833Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:40.608836Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:40.608844Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535397210838322:5918]
2025-10-02T08:16:40.608848Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535397210838322:5918]
2025-10-02T08:16:40.608880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:40.608882Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:40.608887Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:40.608889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.608891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:40.609021Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:40.609244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:40.675134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535397210838391:10248]
2025-10-02T08:16:40.675226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2786, pipe: [1:7556535397210838391:10248]
2025-10-02T08:16:40.729326Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:40.729514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.729526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.729558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210838391:10248], now have 1 active actors on pipe
2025-10-02T08:16:40.729675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:40.729682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:40.729739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2787 reason: error at write: Disconnected sessionId: src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0
2025-10-02T08:16:40.729754Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:40.729722Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:40.729931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2787 sessionId: src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0 is DEAD
2025-10-02T08:16:40.729997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535397210838391:10248]
2025-10-02T08:16:40.730097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:40.730106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0] Write session will restart in 0.007291s
2025-10-02T08:16:40.730125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0] Write session: Do CDS request
2025-10-02T08:16:40.730129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:40.736754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:40.737291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:40.737396Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:40.737403Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:40.737408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:40.737433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:40.737459Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535397210838623:5956]
2025-10-02T08:16:40.737824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:40.737952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:40.737985Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:40.738159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:40.738184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.738188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.738189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.738190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.738190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.738193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.738200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.738202Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.738203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.738205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.738208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.738213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.738219Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.738222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.738224Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.738226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.738227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.738229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.738231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.738233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.738236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.738245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:40.738278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:40.738285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2788
2025-10-02T08:16:40.738435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.738453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:40.738460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:40.738462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:40.738730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2788 sessionId:  describe result for acl check
2025-10-02T08:16:40.738753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:40.738757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:40.738758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:40.738761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535397210838639:5983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:40.739115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535397210838639:5983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:40.740875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535397210838639:5983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:40.744857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535397210838639:5983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:40.744869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535397210838639:5983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:40.744872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535397210838639:5983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:40.744879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:40.745428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:40.746878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:40.746890Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:40.746892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:40.746894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:40.746899Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2787 [1:7556535397210838623:5956]
2025-10-02T08:16:40.746905Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:40.746916Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:40.746921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.746923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.746925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.746936Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:40.746938Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:40.746943Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:40.746982Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.746987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.746990Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:40.746991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:40.747032Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:40.747037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.747045Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.747051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:40.747067Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535397210838617:5956]
2025-10-02T08:16:40.747069Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535397210838617:5956]
2025-10-02T08:16:40.747074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2787
2025-10-02T08:16:40.747075Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:40.747084Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:40.747086Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210838670:5983], now have 1 active actors on pipe
2025-10-02T08:16:40.747091Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535397670083537:2378], now have 1 active actors on pipe
2025-10-02T08:16:40.747093Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:40.747095Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:40.747107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:40.747109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:40.747115Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.747118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.747149Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535397210838617:5956]
2025-10-02T08:16:40.747157Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:40.747164Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:40.747138Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2787
2025-10-02T08:16:40.747168Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9881e6-d024837a-c7cceddd-28143bd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:40.747173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.747177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.747178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:40.747183Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.747189Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:40.747216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.747255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.747264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.747286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.747322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2788 partition: 0 MaxSeqNo: 17 sessionId: src_id|9881e6-d024837a-c7cceddd-28143bd0_0
2025-10-02T08:16:40.747592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1736f0f5-2d385791-d80e00ea-9083f56d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9881e6-d024837a-c7cceddd-28143bd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:40.750164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9881e6-d024837a-c7cceddd-28143bd0_0] Write session: try to update token
2025-10-02T08:16:40.750180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9881e6-d024837a-c7cceddd-28143bd0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:40.762229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2788 sessionId: src_id|9881e6-d024837a-c7cceddd-28143bd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:40.762864Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:40.762876Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:40.762878Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:40.762884Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535397210838617:5956]
2025-10-02T08:16:40.762887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535397210838617:5956]
2025-10-02T08:16:40.762916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:40.762918Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:40.762922Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:40.762923Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.762924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:40.763039Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:40.764325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:40.830276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535397210838685:10248]
2025-10-02T08:16:40.830394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2787, pipe: [1:7556535397210838685:10248]
2025-10-02T08:16:40.886140Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:40.886452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.886469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.886510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210838685:10248], now have 1 active actors on pipe
2025-10-02T08:16:40.886649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535397210838685:10248]
2025-10-02T08:16:40.886668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:40.886670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:40.886682Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:40.886721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2788 reason: error at write: Disconnected sessionId: src_id|9881e6-d024837a-c7cceddd-28143bd0_0
2025-10-02T08:16:40.886733Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:40.886911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2788 sessionId: src_id|9881e6-d024837a-c7cceddd-28143bd0_0 is DEAD
2025-10-02T08:16:40.887040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9881e6-d024837a-c7cceddd-28143bd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:40.887048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9881e6-d024837a-c7cceddd-28143bd0_0] Write session will restart in 0.006278s
2025-10-02T08:16:40.887068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9881e6-d024837a-c7cceddd-28143bd0_0] Write session: Do CDS request
2025-10-02T08:16:40.887073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9881e6-d024837a-c7cceddd-28143bd0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:40.893907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:40.894211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9881e6-d024837a-c7cceddd-28143bd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.894281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:40.894292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2789
2025-10-02T08:16:40.894410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:40.894435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:40.894442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:40.894444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:40.894655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:40.894764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2789 sessionId:  describe result for acl check
2025-10-02T08:16:40.894793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:40.894795Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:40.894798Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:40.894798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:40.894800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:40.894805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535397210838919:5994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:40.894806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:40.894849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:40.894882Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535397210838920:5996]
2025-10-02T08:16:40.895223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535397210838919:5994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:40.895422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:40.895568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:40.895594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:40.895773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:40.895806Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.895811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.895812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.895813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.895814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.895818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.895826Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.895829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.895832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.895835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.895839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.895846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:40.895851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.895856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:40.895859Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.895863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:40.895867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.895871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.895875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.895879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.895896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:40.896963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535397210838919:5994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:40.902333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535397210838919:5994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:40.902347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535397210838919:5994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:40.902350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535397210838919:5994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:40.902357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:40.903210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:40.904592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:40.904604Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:40.904605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:40.904608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:40.904612Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2788 [1:7556535397210838920:5996]
2025-10-02T08:16:40.904620Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:40.904632Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:40.904634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.904636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.904637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.904648Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:40.904652Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:40.904656Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:40.904695Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.904701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.904703Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:40.904705Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:40.904758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:40.904764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.904775Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:40.904786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:40.904800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2788
2025-10-02T08:16:40.904814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210838966:5994], now have 1 active actors on pipe
2025-10-02T08:16:40.904817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535397670083545:2378], now have 1 active actors on pipe
2025-10-02T08:16:40.904822Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535397210838911:5996]
2025-10-02T08:16:40.904824Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535397210838911:5996]
2025-10-02T08:16:40.904837Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:40.904845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.904853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.904870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:40.904884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:40.904845Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2788
2025-10-02T08:16:40.904887Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:40.904893Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:40.904896Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:40.904921Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:40.904927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:40.904929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:40.904931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:40.904938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:40.904944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:40.904954Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535397210838911:5996]
2025-10-02T08:16:40.904959Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:40.904964Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:40.904977Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.905023Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:40.905031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:40.905042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:40.905070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2789 partition: 0 MaxSeqNo: 17 sessionId: src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0
2025-10-02T08:16:40.905326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9881e6-d024837a-c7cceddd-28143bd0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:40.907595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0] Write session: try to update token
2025-10-02T08:16:40.907605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:40.919135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2789 sessionId: src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:40.920987Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:40.921003Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:40.921005Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:40.921014Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535397210838911:5996]
2025-10-02T08:16:40.921019Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535397210838911:5996]
2025-10-02T08:16:40.921053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:40.921055Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:40.921061Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:40.921063Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:40.921063Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:40.921185Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:40.921663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:40.986929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535397210838981:10248]
2025-10-02T08:16:40.986995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2788, pipe: [1:7556535397210838981:10248]
2025-10-02T08:16:41.046913Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:41.047289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.047301Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.047335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535397210838981:10248], now have 1 active actors on pipe
2025-10-02T08:16:41.047455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535397210838981:10248]
2025-10-02T08:16:41.047475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:41.047480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:41.047516Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:41.047519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2789 reason: error at write: Disconnected sessionId: src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0
2025-10-02T08:16:41.047531Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:41.047628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2789 sessionId: src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0 is DEAD
2025-10-02T08:16:41.047758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:41.047767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0] Write session will restart in 0.009577s
2025-10-02T08:16:41.047788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0] Write session: Do CDS request
2025-10-02T08:16:41.047793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:41.055661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:41.056546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:41.056652Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:41.056659Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:41.056665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:41.056690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:41.056713Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535401505806520:6032]
2025-10-02T08:16:41.057149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:41.057324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:41.057347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:41.057523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:41.057548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.057554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.057555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.057555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.057556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.057559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.057565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.057567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.057569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.057571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.057574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.057578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.057581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.057584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.057587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.057589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.057591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.057594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.057596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.057599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.057607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:41.058172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.058273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:41.058283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2790
2025-10-02T08:16:41.058372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.058392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:41.058399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:41.058401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:41.058677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2790 sessionId:  describe result for acl check
2025-10-02T08:16:41.058696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:41.058700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:41.058701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:41.058705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535401505806536:6031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:41.059054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535401505806536:6031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:41.060712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535401505806536:6031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:41.064506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535401505806536:6031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:41.064517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535401505806536:6031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:41.064521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535401505806536:6031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:41.064528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:41.064828Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:41.066146Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:41.066156Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:41.066158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:41.066160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:41.066164Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2789 [1:7556535401505806520:6032]
2025-10-02T08:16:41.066171Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:41.066182Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:41.066187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.066189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.066191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.066200Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:41.066204Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:41.066208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:41.066242Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.066247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.066249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:41.066251Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:41.066288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:41.066292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.066300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.066310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:41.066323Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535401505806514:6032]
2025-10-02T08:16:41.066327Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535401505806514:6032]
2025-10-02T08:16:41.066332Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:41.066339Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:41.066349Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:41.066351Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:41.066353Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:41.066354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:41.066360Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505806569:6031], now have 1 active actors on pipe
2025-10-02T08:16:41.066376Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535401505806514:6032]
2025-10-02T08:16:41.066381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2789
2025-10-02T08:16:41.066382Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:41.066383Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:41.066385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535401965050860:2378], now have 1 active actors on pipe
2025-10-02T08:16:41.066392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.066397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.066418Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:41.066425Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.066426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.066427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:41.066432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.066405Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2789
2025-10-02T08:16:41.066438Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:41.066456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.066510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.066516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.066524Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.066546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2790 partition: 0 MaxSeqNo: 17 sessionId: src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0
2025-10-02T08:16:41.066787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ef9b9c-9b2733c0-3712dde4-4c2e873b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:41.069050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0] Write session: try to update token
2025-10-02T08:16:41.069061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:41.080967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2790 sessionId: src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:41.083153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:41.083190Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:41.083206Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:41.083208Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:41.083216Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535401505806514:6032]
2025-10-02T08:16:41.083221Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535401505806514:6032]
2025-10-02T08:16:41.083245Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:41.083253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.083258Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:41.083260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.083277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:41.083288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.083289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:41.083410Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:41.147695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535401505806583:10248]
2025-10-02T08:16:41.147797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2789, pipe: [1:7556535401505806583:10248]
2025-10-02T08:16:41.208406Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:41.208767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505806583:10248], now have 1 active actors on pipe
2025-10-02T08:16:41.209027Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:41.208976Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:41.209131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535401505806583:10248]
2025-10-02T08:16:41.209155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:41.209223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2790 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0
2025-10-02T08:16:41.209367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2790 sessionId: src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0 is DEAD
2025-10-02T08:16:41.209519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:41.209527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0] Write session will restart in 0.007614s
2025-10-02T08:16:41.209545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0] Write session: Do CDS request
2025-10-02T08:16:41.209550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:41.216658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:41.217359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:41.217501Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:41.217508Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:41.217514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:41.217542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:41.217567Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535401505806820:6127]
2025-10-02T08:16:41.217953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:41.218109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:41.218136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:41.218171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.218206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:41.218215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2791
2025-10-02T08:16:41.218321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:41.218350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.218354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.218355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.218355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.218356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.218359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.218365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.218367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.218369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.218371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.218374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.218378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.218381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.218384Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.218386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.218389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.218391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.218394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.218396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.218399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.218408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:41.218561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.218590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:41.218598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:41.218605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:41.218872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2791 sessionId:  describe result for acl check
2025-10-02T08:16:41.218894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:41.218898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:41.218899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:41.218903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535401505806836:6081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:41.219227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535401505806836:6081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:41.220993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535401505806836:6081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:41.225383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535401505806836:6081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:41.225395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535401505806836:6081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:41.225398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535401505806836:6081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:41.225405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:41.230554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:41.231980Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:41.231996Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:41.231998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:41.232001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:41.232015Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2790 [1:7556535401505806820:6127]
2025-10-02T08:16:41.232027Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:41.232049Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:41.232056Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.232058Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.232060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.232071Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:41.232074Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:41.232079Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:41.232118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.232123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.232125Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:41.232127Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:41.232170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:41.232175Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.232183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.232193Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:41.232209Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535401965050867:2378], now have 1 active actors on pipe
2025-10-02T08:16:41.232217Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535401505806814:6127]
2025-10-02T08:16:41.232219Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535401505806814:6127]
2025-10-02T08:16:41.232224Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:41.232231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2790
2025-10-02T08:16:41.232234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505806867:6081], now have 1 active actors on pipe
2025-10-02T08:16:41.232239Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:41.232239Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:41.232242Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:41.232247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:41.232249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:41.232253Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.232255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.232284Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535401505806814:6127]
2025-10-02T08:16:41.232290Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:41.232293Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:41.232300Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:41.232307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.232309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.232310Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:41.232258Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2790
2025-10-02T08:16:41.232315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.232324Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:41.232354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.232403Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.232413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.232442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.232478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2791 partition: 0 MaxSeqNo: 17 sessionId: src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0
2025-10-02T08:16:41.232731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a5cb5a1-569637bd-8667136a-21a5e261_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:41.235022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0] Write session: try to update token
2025-10-02T08:16:41.235035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:41.246422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2791 sessionId: src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:41.248570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:41.248674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.248691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.248707Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:41.248712Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:41.248714Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:41.248721Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535401505806814:6127]
2025-10-02T08:16:41.248724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535401505806814:6127]
2025-10-02T08:16:41.248760Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:41.248763Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:41.248768Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:41.248770Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.248772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:41.248907Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:41.309506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535401505806882:10248]
2025-10-02T08:16:41.309605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2790, pipe: [1:7556535401505806882:10248]
2025-10-02T08:16:41.374983Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:41.375279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:41.375309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:41.375316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505806882:10248], now have 1 active actors on pipe
2025-10-02T08:16:41.375413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:41.375419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:41.375431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2791 reason: error at write: Disconnected sessionId: src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0
2025-10-02T08:16:41.375538Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:41.375557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2791 sessionId: src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0 is DEAD
2025-10-02T08:16:41.375694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:41.375688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535401505806882:10248]
2025-10-02T08:16:41.375714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0] Write session will restart in 0.005764s
2025-10-02T08:16:41.375734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0] Write session: Do CDS request
2025-10-02T08:16:41.375738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:41.382258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.382346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:41.382356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2792
2025-10-02T08:16:41.382468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.382509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:41.382519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:41.382523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:41.382862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2792 sessionId:  describe result for acl check
2025-10-02T08:16:41.382892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:41.382893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:41.382895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:41.382899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535401505807106:6102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:41.383343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535401505807106:6102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:41.383463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:41.384194Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:41.384349Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:41.384358Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:41.384367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:41.384407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:41.384445Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535401505807139:6097]
2025-10-02T08:16:41.384938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535401505807106:6102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:41.385026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:41.385180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:41.385214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:41.385415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:41.385447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.385451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.385452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.385453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.385453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.385456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.385462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.385464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.385467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.385468Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.385472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.385479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.385484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.385488Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.385493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.385497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.385501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.385505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.385509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.385515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.385535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:41.389827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535401505807106:6102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:41.389840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535401505807106:6102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:41.389842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535401505807106:6102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:41.389847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:41.392779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:41.394405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:41.394415Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:41.394417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:41.394418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:41.394422Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2791 [1:7556535401505807139:6097]
2025-10-02T08:16:41.394430Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:41.394441Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:41.394443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.394445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.394446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.394457Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:41.394461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:41.394465Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:41.394502Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.394508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.394511Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:41.394512Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:41.394555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:41.394561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.394569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.394576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:41.394588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505807167:6102], now have 1 active actors on pipe
2025-10-02T08:16:41.394594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535401965050876:2378], now have 1 active actors on pipe
2025-10-02T08:16:41.394598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535401505807116:6097]
2025-10-02T08:16:41.394599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535401505807116:6097]
2025-10-02T08:16:41.394604Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:41.394612Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:41.394613Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:41.394615Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:41.394619Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:41.394620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:41.394640Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535401505807116:6097]
2025-10-02T08:16:41.394646Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:41.394666Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:41.394675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2791
2025-10-02T08:16:41.394646Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2791
2025-10-02T08:16:41.394724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.394732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.394749Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:41.394756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.394758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.394760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:41.394765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.394771Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:41.394786Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.394812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.394817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.394825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.394844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2792 partition: 0 MaxSeqNo: 17 sessionId: src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0
2025-10-02T08:16:41.395145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce13a0c-d86b22ae-cf3ca689-87672821_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:41.397463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0] Write session: try to update token
2025-10-02T08:16:41.397476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:41.404648Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:41.404668Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:41.404677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535401505807116:6097]
2025-10-02T08:16:41.404717Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:41.404720Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:41.404892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:41.405015Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:41.405133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:41.405258Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:41.405550Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:41.405595Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:41.409417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2792 sessionId: src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:41.411698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:41.411748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.411754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.411777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:41.411790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:41.411832Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.411838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.411970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.412037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.412094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.412157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.412204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.412211Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.412270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.412326Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.412377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.412434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.412471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.412476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.412532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.412590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.412642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.412702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.412743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.412748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.412824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.412884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.412940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.412992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.413035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.413042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.413114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.413182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.413254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.413321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.413368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.413375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.413446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.413507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.413566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.413630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.413675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.413682Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.413742Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.413799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.413859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.413926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.413966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.413971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.414031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.414089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.414142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.414196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.414235Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.414239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.414295Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.414347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.414400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.414454Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.414493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.414497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.414552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:41.414606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:41.414657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:41.414710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:41.414756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:41.414763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:41.414792Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:41.414837Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.414850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.414854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:41.414876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:41.414888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:41.414893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:41.414895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:41.414896Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:41.415236Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:41.415258Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:41.415263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:41.415265Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:41.415266Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:41.415267Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:41.415644Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:41.415659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:41.415663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:41.415665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:41.415666Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:41.415668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:41.416110Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:41.416130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:41.416135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:41.416138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:41.416140Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:41.418039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:41.418060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:41.418070Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393001417
2025-10-02T08:16:41.418198Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:41.418215Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:41.418223Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:41.418225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:41.418229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:41.418233Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:41.418649Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:41.418667Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:41.418671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:41.418673Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:41.418675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:41.418678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:41.419102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:41.419120Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:41.419125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:41.419128Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:41.419134Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:41.419136Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:41.419545Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:41.419561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:41.419568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:41.420537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:41.420554Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:41.420558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:41.420561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:41.420566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393001420
2025-10-02T08:16:41.420866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:41.420884Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:41.420888Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:41.420890Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:41.420893Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:41.420894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:41.421312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:41.421330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:41.421341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:41.421344Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:41.421347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:41.421351Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:41.421774Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:41.421792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.421860Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393001421
2025-10-02T08:16:41.422600Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:41.422619Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:41.422630Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:41.422639Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:41.424073Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:41.424083Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:41.424085Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:41.424090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535401505807116:6097]
2025-10-02T08:16:41.424092Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535401505807116:6097]
2025-10-02T08:16:41.424114Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:41.424123Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:41.424126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:41.424129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.424131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:41.424238Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:41.475912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535401505807224:10248]
2025-10-02T08:16:41.476067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2791, pipe: [1:7556535401505807224:10248]
2025-10-02T08:16:41.554360Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:41.554659Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505807224:10248], now have 1 active actors on pipe
2025-10-02T08:16:41.554771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535401505807224:10248]
2025-10-02T08:16:41.554797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:41.554804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:41.554814Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:41.554829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2792 reason: error at write: Disconnected sessionId: src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0
2025-10-02T08:16:41.554919Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:41.555014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2792 sessionId: src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0 is DEAD
2025-10-02T08:16:41.555149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:41.555157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0] Write session will restart in 0.005657s
2025-10-02T08:16:41.555174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0] Write session: Do CDS request
2025-10-02T08:16:41.555179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:41.562181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.562270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:41.562283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2793
2025-10-02T08:16:41.562398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.562431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:41.562438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:41.562441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:41.562496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:41.562766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2793 sessionId:  describe result for acl check
2025-10-02T08:16:41.562792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:41.562798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:41.562799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:41.562804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535401505807467:6196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:41.563142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:41.563189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535401505807467:6196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:41.563279Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:41.563288Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:41.563296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:41.563340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:41.563368Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535401505807471:6185]
2025-10-02T08:16:41.563888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:41.564095Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:41.564130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:41.564387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:41.564426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.564431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.564431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.564432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.564433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.564437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.564445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.564448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.564451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.564454Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.564458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.564466Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.564474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.564482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.564485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.564489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.564493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.564497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.564501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.564504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.564521Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:41.565276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535401505807467:6196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:41.570722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535401505807467:6196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:41.570734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535401505807467:6196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:41.570737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535401505807467:6196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:41.570745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:41.571573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:41.572986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:41.573001Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:41.573003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:41.573007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:41.573011Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2792 [1:7556535401505807471:6185]
2025-10-02T08:16:41.573021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:41.573035Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:41.573042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.573045Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.573048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.573065Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:41.573073Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:41.573083Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:41.573131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.573138Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.573141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:41.573143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:41.573200Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:41.573207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.573219Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.573236Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:41.573253Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535401505807461:6185]
2025-10-02T08:16:41.573259Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535401505807461:6185]
2025-10-02T08:16:41.573268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:41.573275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2792
2025-10-02T08:16:41.573277Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:41.573280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:41.573283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505807515:6196], now have 1 active actors on pipe
2025-10-02T08:16:41.573289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535401965050905:2378], now have 1 active actors on pipe
2025-10-02T08:16:41.573322Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2792
2025-10-02T08:16:41.573296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:41.573309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:41.573312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:41.573319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.573322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.573353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535401505807461:6185]
2025-10-02T08:16:41.573356Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:41.573358Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:41.573370Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:41.573375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.573379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.573380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:41.573389Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.573396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:41.573430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.573473Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.573486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.573508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.573543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2793 partition: 0 MaxSeqNo: 17 sessionId: src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0
2025-10-02T08:16:41.573829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|256fb851-afd72037-fc4dd5a2-9c7d8ceb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:41.576105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0] Write session: try to update token
2025-10-02T08:16:41.576116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:41.588299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2793 sessionId: src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:41.590097Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:41.590110Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:41.590111Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:41.590118Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535401505807461:6185]
2025-10-02T08:16:41.590120Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535401505807461:6185]
2025-10-02T08:16:41.590152Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:41.590157Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:41.590158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.590159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:41.590170Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:41.590271Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:41.590712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:41.655124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535401505807530:10248]
2025-10-02T08:16:41.655238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2792, pipe: [1:7556535401505807530:10248]
2025-10-02T08:16:41.711106Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:41.711331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.711341Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.711369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505807530:10248], now have 1 active actors on pipe
2025-10-02T08:16:41.711526Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:41.711496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:41.711503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:41.711543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2793 reason: error at write: Disconnected sessionId: src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0
2025-10-02T08:16:41.711589Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:41.711663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2793 sessionId: src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0 is DEAD
2025-10-02T08:16:41.711804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:41.711814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0] Write session will restart in 0.009051s
2025-10-02T08:16:41.711808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535401505807530:10248]
2025-10-02T08:16:41.711836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0] Write session: Do CDS request
2025-10-02T08:16:41.711843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:41.719536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:41.720220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:41.720372Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:41.720381Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:41.720390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:41.720434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:41.720464Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535401505807769:6221]
2025-10-02T08:16:41.721108Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:41.721257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:41.721297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:41.721587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:41.721625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.721631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.721632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.721633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.721634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.721639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.721649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.721653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.721657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.721660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.721665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.721672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.721677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.721682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.721687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.721692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.721700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.721706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.721712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.721717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.721741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:41.722177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.722276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:41.722286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2794
2025-10-02T08:16:41.722394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.722420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:41.722427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:41.722430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:41.722748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2794 sessionId:  describe result for acl check
2025-10-02T08:16:41.722777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:41.722780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:41.722782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:41.722788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535401505807785:6248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:41.723212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535401505807785:6248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:41.724954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535401505807785:6248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:41.728492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535401505807785:6248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:41.728504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535401505807785:6248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:41.728507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535401505807785:6248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:41.728514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:41.729112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:41.730447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:41.730458Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:41.730460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:41.730462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:41.730466Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2793 [1:7556535401505807769:6221]
2025-10-02T08:16:41.730476Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:41.730488Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:41.730489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.730491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.730493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.730504Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:41.730506Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:41.730510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:41.730546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.730552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.730554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:41.730556Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:41.730595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:41.730600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.730607Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.730614Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:41.730626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505807818:6248], now have 1 active actors on pipe
2025-10-02T08:16:41.730632Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535401505807763:6221]
2025-10-02T08:16:41.730634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535401505807763:6221]
2025-10-02T08:16:41.730639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2793
2025-10-02T08:16:41.730640Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:41.730645Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:41.730647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535401965050912:2378], now have 1 active actors on pipe
2025-10-02T08:16:41.730648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:41.730654Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:41.730665Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:41.730667Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:41.730672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.730678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.730708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535401505807763:6221]
2025-10-02T08:16:41.730714Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:41.730683Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2793
2025-10-02T08:16:41.730715Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:41.730723Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:41.730728Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.730730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.730731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:41.730737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.730742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:41.730767Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.730826Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.730838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.730859Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.730893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2794 partition: 0 MaxSeqNo: 17 sessionId: src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0
2025-10-02T08:16:41.731206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|924c1b6e-23b25a9d-4242a237-bb3b66e7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:41.733671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0] Write session: try to update token
2025-10-02T08:16:41.733686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:41.746560Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:41.746579Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:41.746581Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:41.746589Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535401505807763:6221]
2025-10-02T08:16:41.746593Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535401505807763:6221]
2025-10-02T08:16:41.746637Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:41.746644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.746646Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:41.746651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:41.746657Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:41.746769Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:41.746876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2794 sessionId: src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:41.749619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:41.811769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535401505807835:10248]
2025-10-02T08:16:41.811858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2793, pipe: [1:7556535401505807835:10248]
2025-10-02T08:16:41.894411Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:41.894816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.894829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.894863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505807835:10248], now have 1 active actors on pipe
2025-10-02T08:16:41.894931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:41.894937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:41.894989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2794 reason: error at write: Disconnected sessionId: src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0
2025-10-02T08:16:41.895022Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:41.895069Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:41.895147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2794 sessionId: src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0 is DEAD
2025-10-02T08:16:41.895277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:41.895285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0] Write session will restart in 0.009899s
2025-10-02T08:16:41.895294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535401505807835:10248]
2025-10-02T08:16:41.895307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0] Write session: Do CDS request
2025-10-02T08:16:41.895314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:41.902153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:41.902821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:41.902961Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:41.902970Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:41.902979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:41.903017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:41.903054Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535401505808082:6257]
2025-10-02T08:16:41.903695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:41.903839Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:41.903876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:41.904173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:41.904214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.904220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.904221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.904222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.904223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.904229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.904239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.904247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.904251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.904254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.904263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.904274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:41.904283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.904292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:41.904301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.904309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:41.904313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.904322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.904330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.904339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.904362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:41.906261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.906309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:41.906321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2795
2025-10-02T08:16:41.906451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:41.906477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:41.906486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:41.906489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:41.906816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2795 sessionId:  describe result for acl check
2025-10-02T08:16:41.906844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:41.906850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:41.906851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:41.906856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535401505808098:6259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:41.907266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535401505808098:6259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:41.909410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535401505808098:6259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:41.911658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:41.911863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535401505808098:6259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:41.911877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535401505808098:6259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:41.911884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535401505808098:6259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:41.911890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:41.913105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:41.913119Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:41.913121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:41.913124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:41.913130Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2794 [1:7556535401505808082:6257]
2025-10-02T08:16:41.913139Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:41.913154Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:41.913161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.913164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.913166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.913182Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:41.913191Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:41.913201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:41.913246Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.913252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.913255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:41.913257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:41.913312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:41.913319Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.913330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:41.913345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:41.913356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2794
2025-10-02T08:16:41.913365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505808130:6259], now have 1 active actors on pipe
2025-10-02T08:16:41.913368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535401965050921:2378], now have 1 active actors on pipe
2025-10-02T08:16:41.913377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535401505808076:6257]
2025-10-02T08:16:41.913380Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535401505808076:6257]
2025-10-02T08:16:41.913391Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:41.913402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.913406Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:41.913409Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:41.913410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.913426Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:41.913442Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:41.913449Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:41.913425Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2794
2025-10-02T08:16:41.913481Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aad6cd88-42c30724-8c343a2f-2438009a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:41.913490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:41.913497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:41.913500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:41.913507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:41.913517Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:41.913531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535401505808076:6257]
2025-10-02T08:16:41.913541Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:41.913551Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:41.913566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.913608Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:41.913614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:41.913626Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:41.913662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2795 partition: 0 MaxSeqNo: 17 sessionId: src_id|aad6cd88-42c30724-8c343a2f-2438009a_0
2025-10-02T08:16:41.913962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|856dc665-797cfaf6-33cab211-f90cdf3d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|aad6cd88-42c30724-8c343a2f-2438009a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:41.916462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad6cd88-42c30724-8c343a2f-2438009a_0] Write session: try to update token
2025-10-02T08:16:41.916476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad6cd88-42c30724-8c343a2f-2438009a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:41.929468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2795 sessionId: src_id|aad6cd88-42c30724-8c343a2f-2438009a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:41.930741Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:41.930754Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:41.930756Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:41.930763Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535401505808076:6257]
2025-10-02T08:16:41.930766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535401505808076:6257]
2025-10-02T08:16:41.930799Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:41.930804Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:41.930808Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:41.930810Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:41.930810Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:41.930942Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:41.932143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:41.995582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535401505808145:10248]
2025-10-02T08:16:41.995679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2794, pipe: [1:7556535401505808145:10248]
2025-10-02T08:16:42.069999Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:42.070244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.070255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.070286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535401505808145:10248], now have 1 active actors on pipe
2025-10-02T08:16:42.070394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535401505808145:10248]
2025-10-02T08:16:42.070419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:42.070430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:42.070484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2795 reason: error at write: Disconnected sessionId: src_id|aad6cd88-42c30724-8c343a2f-2438009a_0
2025-10-02T08:16:42.070490Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:42.070518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:42.070661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2795 sessionId: src_id|aad6cd88-42c30724-8c343a2f-2438009a_0 is DEAD
2025-10-02T08:16:42.070808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad6cd88-42c30724-8c343a2f-2438009a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:42.070817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad6cd88-42c30724-8c343a2f-2438009a_0] Write session will restart in 0.006104s
2025-10-02T08:16:42.070842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad6cd88-42c30724-8c343a2f-2438009a_0] Write session: Do CDS request
2025-10-02T08:16:42.070848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad6cd88-42c30724-8c343a2f-2438009a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:42.078144Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:42.078195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad6cd88-42c30724-8c343a2f-2438009a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.078312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:42.078321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2796
2025-10-02T08:16:42.078439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.078468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:42.078478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:42.078481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:42.078824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:42.078837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2796 sessionId:  describe result for acl check
2025-10-02T08:16:42.078862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:42.078869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:42.078870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:42.078874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535405800775700:6300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:42.078956Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:42.078963Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:42.078970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:42.079004Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:42.079026Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535405800775701:6296]
2025-10-02T08:16:42.079234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535405800775700:6300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:42.079394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:42.079492Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:42.079514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:42.079686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:42.079713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.079717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.079717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.079718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.079718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.079721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.079727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.079729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.079731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.079733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.079736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.079740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.079743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.079746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.079748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.079751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.079753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.079756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.079758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.079760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.079770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:42.080620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535405800775700:6300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:42.085928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535405800775700:6300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:42.085939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535405800775700:6300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:42.085942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535405800775700:6300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:42.085949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:42.086810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:42.088233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:42.088245Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:42.088247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:42.088249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:42.088253Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2795 [1:7556535405800775701:6296]
2025-10-02T08:16:42.088259Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:42.088270Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:42.088273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.088276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.088278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.088292Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:42.088296Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:42.088302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:42.088338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.088344Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.088346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:42.088348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:42.088384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:42.088390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.088397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.088403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:42.088413Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535405800775692:6296]
2025-10-02T08:16:42.088417Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535405800775692:6296]
2025-10-02T08:16:42.088422Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:42.088429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2795
2025-10-02T08:16:42.088430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800775747:6300], now have 1 active actors on pipe
2025-10-02T08:16:42.088433Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:42.088435Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:42.088436Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:42.088444Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:42.088446Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:42.088449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535406260018235:2378], now have 1 active actors on pipe
2025-10-02T08:16:42.088452Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.088455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.088482Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535405800775692:6296]
2025-10-02T08:16:42.088493Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:42.088504Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:42.088504Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:42.088511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.088513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.088514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:42.088520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.088525Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:42.088486Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2795
2025-10-02T08:16:42.088548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.088582Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.088587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.088595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.088616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2796 partition: 0 MaxSeqNo: 17 sessionId: src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0
2025-10-02T08:16:42.089097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad6cd88-42c30724-8c343a2f-2438009a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:42.091677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0] Write session: try to update token
2025-10-02T08:16:42.091691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:42.104659Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:42.104677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:42.104680Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:42.104687Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535405800775692:6296]
2025-10-02T08:16:42.104692Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535405800775692:6296]
2025-10-02T08:16:42.104734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:42.104733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:42.104738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:42.104740Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.104743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:42.104891Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:42.104998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2796 sessionId: src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:42.107493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:42.170688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535405800775763:10248]
2025-10-02T08:16:42.170790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2795, pipe: [1:7556535405800775763:10248]
2025-10-02T08:16:42.233268Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:42.233498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.233509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.233549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800775763:10248], now have 1 active actors on pipe
2025-10-02T08:16:42.233665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:42.233677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:42.233723Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:42.233746Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:42.233736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2796 reason: error at write: Disconnected sessionId: src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0
2025-10-02T08:16:42.233919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2796 sessionId: src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0 is DEAD
2025-10-02T08:16:42.233988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535405800775763:10248]
2025-10-02T08:16:42.234074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:42.234083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0] Write session will restart in 0.008242s
2025-10-02T08:16:42.234103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0] Write session: Do CDS request
2025-10-02T08:16:42.234107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:42.241615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:42.242044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:42.242149Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:42.242156Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:42.242165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:42.242199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:42.242222Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535405800776009:6329]
2025-10-02T08:16:42.242605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:42.242790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:42.242864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:42.243178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:42.243220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.243235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.243226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.243227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.243228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.243229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.243233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.243243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.243247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.243251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.243255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.243260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.243269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.243274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.243279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.243283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.243284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:42.243288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.243289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2797
2025-10-02T08:16:42.243292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.243297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.243301Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.243305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.243323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:42.243456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.243488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:42.243499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:42.243503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:42.243836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2797 sessionId:  describe result for acl check
2025-10-02T08:16:42.243866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:42.243868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:42.243869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:42.243874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535405800776025:6335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:42.244343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535405800776025:6335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:42.246140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535405800776025:6335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:42.250204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535405800776025:6335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:42.250216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535405800776025:6335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:42.250233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535405800776025:6335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:42.250242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:42.250631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:42.252110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:42.252122Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:42.252124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:42.252126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:42.252131Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2796 [1:7556535405800776009:6329]
2025-10-02T08:16:42.252138Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:42.252151Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:42.252152Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.252154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.252155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.252165Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:42.252168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:42.252172Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:42.252210Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.252212Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.252214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:42.252216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:42.252259Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:42.252264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.252275Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.252285Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:42.252300Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535405800776003:6329]
2025-10-02T08:16:42.252306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535405800776003:6329]
2025-10-02T08:16:42.252311Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:42.252319Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:42.252324Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:42.252326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:42.252328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:42.252330Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:42.252337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800776057:6335], now have 1 active actors on pipe
2025-10-02T08:16:42.252345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2796
2025-10-02T08:16:42.252357Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535405800776003:6329]
2025-10-02T08:16:42.252359Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:42.252360Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:42.252363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535406260018242:2378], now have 1 active actors on pipe
2025-10-02T08:16:42.252367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.252369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.252398Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2736160f-3c8c5da-f7f422e7-755b0615_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:42.252407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.252410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.252411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:42.252417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.252422Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:42.252435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.252435Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2796
2025-10-02T08:16:42.252467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.252478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.252508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.252548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2797 partition: 0 MaxSeqNo: 17 sessionId: src_id|2736160f-3c8c5da-f7f422e7-755b0615_0
2025-10-02T08:16:42.252835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2328ec7e-dde5741b-aa63a133-802aeadb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2736160f-3c8c5da-f7f422e7-755b0615_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:42.255099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2736160f-3c8c5da-f7f422e7-755b0615_0] Write session: try to update token
2025-10-02T08:16:42.255110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2736160f-3c8c5da-f7f422e7-755b0615_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:42.268152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2797 sessionId: src_id|2736160f-3c8c5da-f7f422e7-755b0615_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:42.269387Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:42.269404Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:42.269407Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:42.269415Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535405800776003:6329]
2025-10-02T08:16:42.269419Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535405800776003:6329]
2025-10-02T08:16:42.269458Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:42.269458Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:42.269462Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:42.269471Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.269473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:42.269608Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:42.270398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:42.334017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535405800776073:10248]
2025-10-02T08:16:42.334197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2796, pipe: [1:7556535405800776073:10248]
2025-10-02T08:16:42.400835Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:42.401105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.401116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.401148Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800776073:10248], now have 1 active actors on pipe
2025-10-02T08:16:42.401228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:42.401233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:42.401273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2797 reason: error at write: Disconnected sessionId: src_id|2736160f-3c8c5da-f7f422e7-755b0615_0
2025-10-02T08:16:42.401358Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:42.401384Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:42.401435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2797 sessionId: src_id|2736160f-3c8c5da-f7f422e7-755b0615_0 is DEAD
2025-10-02T08:16:42.401553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535405800776073:10248]
2025-10-02T08:16:42.401588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2736160f-3c8c5da-f7f422e7-755b0615_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:42.401595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2736160f-3c8c5da-f7f422e7-755b0615_0] Write session will restart in 0.005681s
2025-10-02T08:16:42.401630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2736160f-3c8c5da-f7f422e7-755b0615_0] Write session: Do CDS request
2025-10-02T08:16:42.401636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2736160f-3c8c5da-f7f422e7-755b0615_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:42.408279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2736160f-3c8c5da-f7f422e7-755b0615_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.408365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:42.408378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2798
2025-10-02T08:16:42.408480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.408501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:42.408504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:42.408507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:42.408648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:42.408773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2798 sessionId:  describe result for acl check
2025-10-02T08:16:42.408795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:42.408796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:42.408797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:42.408814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535405800776324:6439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:42.409153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535405800776324:6439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:42.409634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:42.409764Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:42.409771Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:42.409778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:42.409808Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:42.409844Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535405800776332:6400]
2025-10-02T08:16:42.410217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:42.410340Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:42.410365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:42.410546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:42.410574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.410578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.410579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.410579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.410580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.410583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.410589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.410591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.410593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.410595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.410598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.410602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.410605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.410607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.410610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.410613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.410615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.410618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.410620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.410623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.410634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:42.411023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535405800776324:6439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:42.416334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535405800776324:6439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:42.416348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535405800776324:6439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:42.416350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535405800776324:6439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:42.416356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:42.418339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:42.419857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:42.419875Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:42.419878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:42.419881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:42.419887Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2797 [1:7556535405800776332:6400]
2025-10-02T08:16:42.419898Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:42.419913Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:42.419916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.419919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.419921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.419935Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:42.419940Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:42.419946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:42.420009Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.420018Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.420021Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:42.420022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:42.420064Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:42.420070Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.420078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.420084Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:42.420095Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535405800776319:6400]
2025-10-02T08:16:42.420096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535405800776319:6400]
2025-10-02T08:16:42.420101Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:42.420109Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:42.420122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:42.420122Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:42.420123Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:42.420125Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:42.420130Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800776373:6439], now have 1 active actors on pipe
2025-10-02T08:16:42.420133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2797
2025-10-02T08:16:42.420151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535406260018252:2378], now have 1 active actors on pipe
2025-10-02T08:16:42.420156Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535405800776319:6400]
2025-10-02T08:16:42.420161Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:42.420165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.420165Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:42.420167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.420197Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|674053d8-f02fe34a-bea45416-e070a136_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:42.420204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.420207Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.420208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:42.420213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.420220Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:42.420236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.420219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2797
2025-10-02T08:16:42.420289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.420293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.420302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.420330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2798 partition: 0 MaxSeqNo: 17 sessionId: src_id|674053d8-f02fe34a-bea45416-e070a136_0
2025-10-02T08:16:42.420659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2736160f-3c8c5da-f7f422e7-755b0615_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|674053d8-f02fe34a-bea45416-e070a136_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:42.423185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674053d8-f02fe34a-bea45416-e070a136_0] Write session: try to update token
2025-10-02T08:16:42.423201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674053d8-f02fe34a-bea45416-e070a136_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:42.436907Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:42.436921Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:42.436923Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:42.436929Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535405800776319:6400]
2025-10-02T08:16:42.436931Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535405800776319:6400]
2025-10-02T08:16:42.436961Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:42.436965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.436967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:42.436972Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:42.436976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:42.437074Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:42.452287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2798 sessionId: src_id|674053d8-f02fe34a-bea45416-e070a136_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:42.454603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:42.501957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535405800776426:10248]
2025-10-02T08:16:42.502080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2797, pipe: [1:7556535405800776426:10248]
2025-10-02T08:16:42.568386Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:42.568728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.568738Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.568754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800776426:10248], now have 1 active actors on pipe
2025-10-02T08:16:42.568845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:42.568855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:42.568903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2798 reason: error at write: Disconnected sessionId: src_id|674053d8-f02fe34a-bea45416-e070a136_0
2025-10-02T08:16:42.568941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:42.569036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2798 sessionId: src_id|674053d8-f02fe34a-bea45416-e070a136_0 is DEAD
2025-10-02T08:16:42.569155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674053d8-f02fe34a-bea45416-e070a136_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:42.569163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674053d8-f02fe34a-bea45416-e070a136_0] Write session will restart in 0.007362s
2025-10-02T08:16:42.569180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674053d8-f02fe34a-bea45416-e070a136_0] Write session: Do CDS request
2025-10-02T08:16:42.569165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535405800776426:10248]
2025-10-02T08:16:42.569185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674053d8-f02fe34a-bea45416-e070a136_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:42.569166Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:42.575850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:42.576865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:42.577030Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:42.577037Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:42.577043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:42.577074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:42.577101Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535405800776680:6594]
2025-10-02T08:16:42.577211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674053d8-f02fe34a-bea45416-e070a136_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.577266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:42.577275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2799
2025-10-02T08:16:42.577397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.577420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:42.577426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:42.577429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:42.577623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:42.577739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2799 sessionId:  describe result for acl check
2025-10-02T08:16:42.577763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:42.577765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:42.577766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:42.577768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:42.577772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535405800776689:6597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:42.577797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:42.578072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:42.578113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.578118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.578119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.578120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.578121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.578125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.578132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.578135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.578138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.578141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.578145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.578150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.578155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.578159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.578163Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.578167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.578170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.578174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.578177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.578181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.578187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535405800776689:6597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:42.578199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:42.579783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535405800776689:6597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:42.584255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535405800776689:6597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:42.584266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535405800776689:6597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:42.584268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535405800776689:6597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:42.584274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:42.585767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:42.587254Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:42.587267Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:42.587268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:42.587271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:42.587275Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2798 [1:7556535405800776680:6594]
2025-10-02T08:16:42.587282Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:42.587293Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:42.587294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.587296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.587298Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.587308Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:42.587313Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:42.587317Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:42.587354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.587359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.587362Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:42.587363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:42.587405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:42.587410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.587418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.587426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:42.587438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800776728:6597], now have 1 active actors on pipe
2025-10-02T08:16:42.587443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2798
2025-10-02T08:16:42.587446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535405800776673:6594]
2025-10-02T08:16:42.587447Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535405800776673:6594]
2025-10-02T08:16:42.587452Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:42.587460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:42.587461Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:42.587463Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:42.587468Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:42.587469Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:42.587472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535406260018281:2378], now have 1 active actors on pipe
2025-10-02T08:16:42.587476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.587478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.587503Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535405800776673:6594]
2025-10-02T08:16:42.587512Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:42.587518Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:42.587523Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf595d4-ce47f066-c0f03274-8527961c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:42.587530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.587535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.587537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:42.587543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.587551Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:42.587542Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2798
2025-10-02T08:16:42.587578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.587734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.587739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.587748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.587775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2799 partition: 0 MaxSeqNo: 17 sessionId: src_id|cf595d4-ce47f066-c0f03274-8527961c_0
2025-10-02T08:16:42.588109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674053d8-f02fe34a-bea45416-e070a136_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|cf595d4-ce47f066-c0f03274-8527961c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:42.590627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf595d4-ce47f066-c0f03274-8527961c_0] Write session: try to update token
2025-10-02T08:16:42.590645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf595d4-ce47f066-c0f03274-8527961c_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:42.603977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2799 sessionId: src_id|cf595d4-ce47f066-c0f03274-8527961c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:42.605142Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:42.605159Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:42.605162Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:42.605172Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535405800776673:6594]
2025-10-02T08:16:42.605177Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535405800776673:6594]
2025-10-02T08:16:42.605222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:42.605223Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:42.605228Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:42.605235Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.605237Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:42.605417Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:42.606821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:42.669411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535405800776742:10248]
2025-10-02T08:16:42.669492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2798, pipe: [1:7556535405800776742:10248]
2025-10-02T08:16:42.731251Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:42.731434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.731444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.731472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800776742:10248], now have 1 active actors on pipe
2025-10-02T08:16:42.731525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535405800776742:10248]
2025-10-02T08:16:42.731538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:42.731539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:42.731575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2799 reason: error at write: Disconnected sessionId: src_id|cf595d4-ce47f066-c0f03274-8527961c_0
2025-10-02T08:16:42.731609Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:42.731681Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:42.731721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2799 sessionId: src_id|cf595d4-ce47f066-c0f03274-8527961c_0 is DEAD
2025-10-02T08:16:42.731888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf595d4-ce47f066-c0f03274-8527961c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:42.731898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf595d4-ce47f066-c0f03274-8527961c_0] Write session will restart in 0.009551s
2025-10-02T08:16:42.731936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf595d4-ce47f066-c0f03274-8527961c_0] Write session: Do CDS request
2025-10-02T08:16:42.731942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf595d4-ce47f066-c0f03274-8527961c_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:42.738825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:42.739423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:42.739531Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:42.739538Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:42.739544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:42.739571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:42.739593Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535405800776998:6670]
2025-10-02T08:16:42.740013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:42.740166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:42.740192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:42.740394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:42.740425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.740429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.740430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.740430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.740431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.740433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.740439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.740441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.740443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.740445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.740448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.740452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.740455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.740458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.740460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.740463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.740465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.740467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.740473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.740476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.740486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:42.742206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf595d4-ce47f066-c0f03274-8527961c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.742279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:42.742288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2800
2025-10-02T08:16:42.742364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.742383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:42.742390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:42.742392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:42.742678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2800 sessionId:  describe result for acl check
2025-10-02T08:16:42.742703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:42.742707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:42.742708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:42.742712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535405800777014:6715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:42.743070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535405800777014:6715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:42.744745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535405800777014:6715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:42.747197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535405800777014:6715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:42.747207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535405800777014:6715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:42.747210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535405800777014:6715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:42.747215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:42.747697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:42.749152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:42.749164Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:42.749165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:42.749167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:42.749171Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2799 [1:7556535405800776998:6670]
2025-10-02T08:16:42.749178Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:42.749189Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:42.749191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.749193Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.749194Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.749204Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:42.749207Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:42.749211Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:42.749247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.749253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.749256Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:42.749258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:42.749300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:42.749304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.749312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.749318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:42.749329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535405800776992:6670]
2025-10-02T08:16:42.749334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535405800776992:6670]
2025-10-02T08:16:42.749339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:42.749347Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:42.749357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:42.749359Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:42.749361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:42.749362Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:42.749375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2799
2025-10-02T08:16:42.749386Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800777045:6715], now have 1 active actors on pipe
2025-10-02T08:16:42.749391Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535405800776992:6670]
2025-10-02T08:16:42.749393Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:42.749396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535406260018287:2378], now have 1 active actors on pipe
2025-10-02T08:16:42.749396Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:42.749398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.749401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.749427Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:42.749435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.749437Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.749438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:42.749445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.749451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:42.749433Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2799
2025-10-02T08:16:42.749466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.749493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.749501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.749518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.749545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2800 partition: 0 MaxSeqNo: 17 sessionId: src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0
2025-10-02T08:16:42.749788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf595d4-ce47f066-c0f03274-8527961c_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:42.752176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0] Write session: try to update token
2025-10-02T08:16:42.752188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:42.764611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2800 sessionId: src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:42.765559Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:42.765575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:42.765576Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:42.765582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535405800776992:6670]
2025-10-02T08:16:42.765585Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535405800776992:6670]
2025-10-02T08:16:42.765616Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:42.765625Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.765626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:42.765707Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:42.765718Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:42.765754Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:42.767385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:42.831678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535405800777060:10248]
2025-10-02T08:16:42.831769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2799, pipe: [1:7556535405800777060:10248]
2025-10-02T08:16:42.888516Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:42.888797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.888819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.888851Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800777060:10248], now have 1 active actors on pipe
2025-10-02T08:16:42.888986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:42.888995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:42.889047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2800 reason: error at write: Disconnected sessionId: src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0
2025-10-02T08:16:42.889060Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:42.889199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2800 sessionId: src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0 is DEAD
2025-10-02T08:16:42.889177Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:42.889308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535405800777060:10248]
2025-10-02T08:16:42.889381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:42.889390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0] Write session will restart in 0.009410s
2025-10-02T08:16:42.889411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0] Write session: Do CDS request
2025-10-02T08:16:42.889417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:42.896620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:42.897590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:42.897730Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:42.897740Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:42.897748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:42.897793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:42.897819Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535405800777316:6718]
2025-10-02T08:16:42.898207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:42.898373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:42.898404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:42.898615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:42.898645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.898650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.898651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.898652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.898653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.898657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.898667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.898671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.898674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.898678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.898682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.898692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:42.898696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.898699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:42.898702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.898704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:42.898706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.898709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.898712Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.898715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.898725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:42.900260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.900332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:42.900340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2801
2025-10-02T08:16:42.900478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:42.900510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:42.900519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:42.900522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:42.900897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2801 sessionId:  describe result for acl check
2025-10-02T08:16:42.900930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:42.900935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:42.900937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:42.900941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535405800777332:6721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:42.901381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535405800777332:6721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:42.902910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535405800777332:6721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:42.905466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535405800777332:6721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:42.905477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535405800777332:6721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:42.905479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535405800777332:6721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:42.905484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:42.906032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:42.907344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:42.907357Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:42.907359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:42.907363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:42.907368Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2800 [1:7556535405800777316:6718]
2025-10-02T08:16:42.907379Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:42.907394Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:42.907397Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.907400Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.907402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.907417Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:42.907422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:42.907428Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:42.907478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.907485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.907487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:42.907490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:42.907546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:42.907552Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.907563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:42.907579Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:42.907599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800777364:6721], now have 1 active actors on pipe
2025-10-02T08:16:42.907606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535406260018298:2378], now have 1 active actors on pipe
2025-10-02T08:16:42.907609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2800
2025-10-02T08:16:42.907612Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535405800777310:6718]
2025-10-02T08:16:42.907614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535405800777310:6718]
2025-10-02T08:16:42.907620Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:42.907631Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:42.907634Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:42.907637Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:42.907647Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:42.907651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:42.907658Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.907664Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.907640Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2800
2025-10-02T08:16:42.907697Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535405800777310:6718]
2025-10-02T08:16:42.907706Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:42.907722Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:42.907724Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae509b56-6cbe4181-daf7d666-82392abd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:42.907729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:42.907733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:42.907735Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:42.907742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:42.907750Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:42.907785Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.907835Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:42.907848Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:42.907871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:42.907909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2801 partition: 0 MaxSeqNo: 17 sessionId: src_id|ae509b56-6cbe4181-daf7d666-82392abd_0
2025-10-02T08:16:42.908235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a4a954-50e22e4a-217b1a6e-62cd7394_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ae509b56-6cbe4181-daf7d666-82392abd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:42.910668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae509b56-6cbe4181-daf7d666-82392abd_0] Write session: try to update token
2025-10-02T08:16:42.910684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae509b56-6cbe4181-daf7d666-82392abd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:42.923071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2801 sessionId: src_id|ae509b56-6cbe4181-daf7d666-82392abd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:42.924796Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:42.924825Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:42.924828Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:42.924838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535405800777310:6718]
2025-10-02T08:16:42.924842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535405800777310:6718]
2025-10-02T08:16:42.924876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:42.924880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:42.924886Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:42.924886Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:42.924890Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:42.925005Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:42.925520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:42.989403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535405800777380:10248]
2025-10-02T08:16:42.989503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2800, pipe: [1:7556535405800777380:10248]
2025-10-02T08:16:43.048693Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:43.049016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.049027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.049068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535405800777380:10248], now have 1 active actors on pipe
2025-10-02T08:16:43.049172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535405800777380:10248]
2025-10-02T08:16:43.049189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:43.049191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:43.049235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2801 reason: error at write: Disconnected sessionId: src_id|ae509b56-6cbe4181-daf7d666-82392abd_0
2025-10-02T08:16:43.049253Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:43.049303Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:43.049375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2801 sessionId: src_id|ae509b56-6cbe4181-daf7d666-82392abd_0 is DEAD
2025-10-02T08:16:43.049538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae509b56-6cbe4181-daf7d666-82392abd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:43.049550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae509b56-6cbe4181-daf7d666-82392abd_0] Write session will restart in 0.006363s
2025-10-02T08:16:43.049578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae509b56-6cbe4181-daf7d666-82392abd_0] Write session: Do CDS request
2025-10-02T08:16:43.049584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae509b56-6cbe4181-daf7d666-82392abd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:43.057187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae509b56-6cbe4181-daf7d666-82392abd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.057234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:43.057246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2802
2025-10-02T08:16:43.057366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.057402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:43.057411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:43.057414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:43.057753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2802 sessionId:  describe result for acl check
2025-10-02T08:16:43.057787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:43.057790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:43.057791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:43.057796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535410095744939:6837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:43.058273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535410095744939:6837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:43.058476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:43.058749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:43.058882Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:43.058893Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:43.058902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:43.058953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:43.058986Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535410095744951:6829]
2025-10-02T08:16:43.059534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:43.059793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:43.059840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:43.060009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535410095744939:6837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:43.060143Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:43.060200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.060206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.060208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.060209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.060210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.060216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.060225Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.060229Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.060232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.060236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.060241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.060248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.060258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.060263Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.060273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.060278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.060282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.060288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.060292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.060298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.060315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:43.065821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535410095744939:6837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:43.065834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535410095744939:6837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:43.065837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535410095744939:6837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:43.065843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:43.067846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:43.069361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:43.069371Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:43.069373Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:43.069375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:43.069380Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2801 [1:7556535410095744951:6829]
2025-10-02T08:16:43.069387Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:43.069398Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:43.069399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.069401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.069402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.069413Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:43.069416Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:43.069421Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:43.069470Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.069475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.069477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:43.069479Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:43.069517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:43.069523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.069530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.069537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:43.069548Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535410095744942:6829]
2025-10-02T08:16:43.069549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535410095744942:6829]
2025-10-02T08:16:43.069553Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:43.069563Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:43.069567Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:43.069569Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:43.069574Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:43.069575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:43.069581Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095744993:6837], now have 1 active actors on pipe
2025-10-02T08:16:43.069584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535410554985613:2378], now have 1 active actors on pipe
2025-10-02T08:16:43.069601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2801
2025-10-02T08:16:43.069604Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.069607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.069616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535410095744942:6829]
2025-10-02T08:16:43.069625Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:43.069638Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:43.069641Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:43.069645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.069648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.069650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:43.069658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.069664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:43.069635Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2801
2025-10-02T08:16:43.069684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.069721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.069726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.069736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.069759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2802 partition: 0 MaxSeqNo: 17 sessionId: src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0
2025-10-02T08:16:43.070092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae509b56-6cbe4181-daf7d666-82392abd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:43.072573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0] Write session: try to update token
2025-10-02T08:16:43.072589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:43.085593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2802 sessionId: src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:43.086689Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:43.086702Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:43.086704Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:43.086715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535410095744942:6829]
2025-10-02T08:16:43.086718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535410095744942:6829]
2025-10-02T08:16:43.086748Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:43.086757Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.086758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:43.086766Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:43.086778Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:43.086875Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:43.087819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:43.149104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535410095745006:10248]
2025-10-02T08:16:43.149203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2801, pipe: [1:7556535410095745006:10248]
2025-10-02T08:16:43.206970Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:43.207165Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.207175Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.207204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095745006:10248], now have 1 active actors on pipe
2025-10-02T08:16:43.207328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535410095745006:10248]
2025-10-02T08:16:43.207349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:43.207352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:43.207357Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:43.207405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2802 reason: error at write: Disconnected sessionId: src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0
2025-10-02T08:16:43.207428Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:43.207550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2802 sessionId: src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0 is DEAD
2025-10-02T08:16:43.207551Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 closed with error: reason# too much attempts to restart pipe
2025-10-02T08:16:43.207648Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 28 consumer shared/user session shared/user_1_28_13775350760927023979_v1 is DEAD
2025-10-02T08:16:43.207687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:43.207694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0] Write session will restart in 0.006666s
2025-10-02T08:16:43.207714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0] Write session: Do CDS request
2025-10-02T08:16:43.207720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:43.207748Z :ERROR: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-02T08:16:43.207776Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535337081264994:10241] disconnected; active server actors: 1
2025-10-02T08:16:43.207789Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535337081264994:10241] client user disconnected session shared/user_1_28_13775350760927023979_v1
2025-10-02T08:16:43.207833Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:16:43.207837Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:16:43.207841Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Reconnecting session to cluster  in 0.009703s
2025-10-02T08:16:43.215061Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:43.215183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.215177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:43.215185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2803
2025-10-02T08:16:43.215343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.215365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:43.215368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:43.215370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:43.215663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2803 sessionId:  describe result for acl check
2025-10-02T08:16:43.215690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:43.215695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:43.215696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:43.215699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535410095745267:6921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:43.215886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:43.215989Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:43.215996Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:43.216011Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:43.216033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535410095745267:6921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:43.216040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:43.216059Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535410095745269:6856]
2025-10-02T08:16:43.216440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:43.216599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:43.216621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:43.216820Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:43.216851Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.216855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.216856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.216856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.216857Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.216860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.216866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.216867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.216869Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.216871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.216874Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.216878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.216882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.216884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.216886Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.216889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.216891Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.216894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.216896Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.216898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.216907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:43.217886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535410095745267:6921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:43.218031Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Successfully connected. Initializing session
2025-10-02T08:16:43.218077Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-02T08:16:43.218083Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 29
2025-10-02T08:16:43.218221Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 29 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:16:43.218261Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 read init: from# ipv6:[::1]:56310, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-02T08:16:43.218328Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 auth for : user
2025-10-02T08:16:43.218452Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 Handle describe topics response
2025-10-02T08:16:43.218474Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 auth is DEAD
2025-10-02T08:16:43.218490Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 auth ok: topics# 1, initDone# 0
2025-10-02T08:16:43.218710Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 register session: topic# rt3.dc1--test-topic
2025-10-02T08:16:43.218768Z :INFO: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] Got InitResponse. ReadSessionId: shared/user_1_29_6684798439354710115_v1
2025-10-02T08:16:43.218777Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-02T08:16:43.218828Z :DEBUG: [/Root] [/Root] [715b5417-4d15a063-ab28b9e8-3436b0e1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-02T08:16:43.218828Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556535410095745314:6956] connected; active server actors: 1
2025-10-02T08:16:43.218880Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-02T08:16:43.218895Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556535410095745314:6956] session shared/user_1_29_6684798439354710115_v1
2025-10-02T08:16:43.218911Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-02T08:16:43.218918Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-02T08:16:43.218924Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_29_6684798439354710115_v1" (Sender=[1:7556535410095745303:6956], Pipe=[1:7556535410095745314:6956], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:16:43.218931Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-02T08:16:43.218941Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-02T08:16:43.218935Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 got read request: guid# 6ac2a9c7-c28f27ca-82776df2-c1846e70
2025-10-02T08:16:43.218952Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_29_6684798439354710115_v1" (Sender=[1:7556535410095745303:6956], Pipe=[1:7556535410095745314:6956], Partitions=[], ActiveFamilyCount=0)
2025-10-02T08:16:43.218961Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_29_6684798439354710115_v1" sender [1:7556535410095745303:6956] lock partition 0 for ReadingSession "shared/user_1_29_6684798439354710115_v1" (Sender=[1:7556535410095745303:6956], Pipe=[1:7556535410095745314:6956], Partitions=[], ActiveFamilyCount=1) generation 1 step 29
2025-10-02T08:16:43.218976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-02T08:16:43.218984Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000035s
2025-10-02T08:16:43.219127Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 29 Session: "shared/user_1_29_6684798439354710115_v1" ClientId: "user" PipeClient { RawX1: 7556535410095745314 RawX2: 4503603922344748 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-02T08:16:43.219141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-02T08:16:43.223068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535410095745267:6921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:43.223081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535410095745267:6921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:43.223084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535410095745267:6921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:43.223091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:43.224097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:43.225467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:43.225479Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:43.225481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:43.225485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:43.225492Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2802 [1:7556535410095745269:6856]
2025-10-02T08:16:43.225500Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:43.225515Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:43.225518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.225521Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.225523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.225536Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:43.225543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:43.225548Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:43.225594Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.225600Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.225602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:43.225604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:43.225656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:43.225661Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.225672Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.225684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:43.225720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2802, pipe: [1:7556535410095745316:6916]
2025-10-02T08:16:43.225740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2802
2025-10-02T08:16:43.225766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095745316:6916], now have 1 active actors on pipe
2025-10-02T08:16:43.225773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095745323:6921], now have 1 active actors on pipe
2025-10-02T08:16:43.225776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535410554985620:2378], now have 1 active actors on pipe
2025-10-02T08:16:43.225780Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.225784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.225768Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2802
2025-10-02T08:16:43.225794Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_29_6684798439354710115_v1 on pipe: [1:7556535410095745316:6916]
2025-10-02T08:16:43.225813Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_29_6684798439354710115_v1:1 with generation 2802
2025-10-02T08:16:43.225814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535410095745260:6856]
2025-10-02T08:16:43.225816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535410095745260:6856]
2025-10-02T08:16:43.225825Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:43.225834Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:43.225836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.225836Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:43.225837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.225845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:43.225858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:43.225862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:43.225875Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.225882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.225884Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:43.225896Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_29_6684798439354710115_v1
2025-10-02T08:16:43.225902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.225953Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4ed831e-c5759188-1b20301c-bd920e45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:43.225963Z node 1 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-02T08:16:43.225966Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535410095745260:6856]
2025-10-02T08:16:43.225971Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:43.225977Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:43.225984Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:43.227472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-02T08:16:43.227494Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-02T08:16:43.227501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.227507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.227509Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:43.227519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.227532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:43.227537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-02T08:16:43.227550Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-02T08:16:43.227567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.227599Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.227606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.227619Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.227623Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 17 WriteTimestampMS: 1759392439000 SizeLag: 14953458 WriteTimestampEstimateMS: 1759393003225 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-02T08:16:43.227633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 readOffset 0 committedOffset 0
2025-10-02T08:16:43.227647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2803 partition: 0 MaxSeqNo: 17 sessionId: src_id|b4ed831e-c5759188-1b20301c-bd920e45_0
2025-10-02T08:16:43.227670Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 sending to client partition status
2025-10-02T08:16:43.227932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c947728-be3a0de1-67eb89f5-bd8e189f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b4ed831e-c5759188-1b20301c-bd920e45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:43.230331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed831e-c5759188-1b20301c-bd920e45_0] Write session: try to update token
2025-10-02T08:16:43.230345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed831e-c5759188-1b20301c-bd920e45_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:43.241910Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:43.241926Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:43.241928Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:43.241934Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535410095745260:6856]
2025-10-02T08:16:43.241937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535410095745260:6856]
2025-10-02T08:16:43.241967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:43.241974Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.241975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:43.241981Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:43.241986Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:43.242093Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:43.242813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2803 sessionId: src_id|b4ed831e-c5759188-1b20301c-bd920e45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:43.245284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:43.365967Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:43.366173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.366185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.366395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535410095745316:6916]
2025-10-02T08:16:43.366420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:43.366427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:43.366467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_29_6684798439354710115_v1
2025-10-02T08:16:43.366442Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:43.366481Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:43.366482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2803 reason: error at write: Disconnected sessionId: src_id|b4ed831e-c5759188-1b20301c-bd920e45_0
2025-10-02T08:16:43.366631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2803 sessionId: src_id|b4ed831e-c5759188-1b20301c-bd920e45_0 is DEAD
2025-10-02T08:16:43.366724Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_29_6684798439354710115_v1
2025-10-02T08:16:43.366767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed831e-c5759188-1b20301c-bd920e45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:43.366778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed831e-c5759188-1b20301c-bd920e45_0] Write session will restart in 0.007919s
2025-10-02T08:16:43.366794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed831e-c5759188-1b20301c-bd920e45_0] Write session: Do CDS request
2025-10-02T08:16:43.366798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed831e-c5759188-1b20301c-bd920e45_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:43.375121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:43.375931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:43.376071Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:43.376079Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:43.376085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:43.376115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:43.376146Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535410095745598:6950]
2025-10-02T08:16:43.376259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed831e-c5759188-1b20301c-bd920e45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.376322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:43.376332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2804
2025-10-02T08:16:43.376422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.376442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:43.376448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:43.376451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:43.376689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:43.376724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2804 sessionId:  describe result for acl check
2025-10-02T08:16:43.376746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:43.376750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:43.376752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:43.376756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535410095745605:6952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:43.376842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:43.376871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:43.377088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:43.377118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.377122Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.377123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.377124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.377124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.377127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.377132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.377134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.377136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.377138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.377141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.377145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.377149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.377152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.377154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535410095745605:6952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:43.377154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.377157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.377159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.377162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.377164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.377167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.377178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:43.378490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535410095745605:6952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:43.383099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535410095745605:6952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:43.383112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535410095745605:6952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:43.383115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535410095745605:6952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:43.383122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:43.384783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:43.386425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:43.386441Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:43.386443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:43.386446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:43.386452Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2803 [1:7556535410095745598:6950]
2025-10-02T08:16:43.386462Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:43.386477Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:43.386480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.386482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.386484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.386498Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:43.386507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:43.386515Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:43.386571Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.386578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.386580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:43.386582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:43.386700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2803
2025-10-02T08:16:43.386735Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:43.386737Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.386745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.386752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:43.386764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095745647:6952], now have 1 active actors on pipe
2025-10-02T08:16:43.386772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535410554985630:2378], now have 1 active actors on pipe
2025-10-02T08:16:43.386776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.386778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.386759Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2803
2025-10-02T08:16:43.386790Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535410095745592:6950]
2025-10-02T08:16:43.386792Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535410095745592:6950]
2025-10-02T08:16:43.386796Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:43.386805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:43.386805Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:43.386808Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:43.386817Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:43.386819Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:43.386831Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d36b743-186ceb28-989175c5-98066f87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:43.386838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.386842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.386843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:43.386848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.386855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:43.386885Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535410095745592:6950]
2025-10-02T08:16:43.386894Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:43.386901Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:43.386904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.386975Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.386980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.386990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.387018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2804 partition: 0 MaxSeqNo: 17 sessionId: src_id|d36b743-186ceb28-989175c5-98066f87_0
2025-10-02T08:16:43.387281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4ed831e-c5759188-1b20301c-bd920e45_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d36b743-186ceb28-989175c5-98066f87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:43.389584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36b743-186ceb28-989175c5-98066f87_0] Write session: try to update token
2025-10-02T08:16:43.389597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36b743-186ceb28-989175c5-98066f87_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:43.401565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2804 sessionId: src_id|d36b743-186ceb28-989175c5-98066f87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:43.403923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:43.404183Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.404198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.404215Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:43.404217Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:43.404219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:43.404224Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535410095745592:6950]
2025-10-02T08:16:43.404228Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535410095745592:6950]
2025-10-02T08:16:43.404253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:43.404264Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:43.404267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:43.404272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.404273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:43.404396Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:43.494584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535410095745681:6916]
2025-10-02T08:16:43.495147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2803, pipe: [1:7556535410095745681:6916]
2025-10-02T08:16:43.527327Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:43.527698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:43.527732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:43.527743Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095745681:6916], now have 1 active actors on pipe
2025-10-02T08:16:43.527828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:43.527836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:43.527848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2804 reason: error at write: Disconnected sessionId: src_id|d36b743-186ceb28-989175c5-98066f87_0
2025-10-02T08:16:43.527953Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:43.527983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2804 sessionId: src_id|d36b743-186ceb28-989175c5-98066f87_0 is DEAD
2025-10-02T08:16:43.528115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535410095745681:6916]
2025-10-02T08:16:43.528164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36b743-186ceb28-989175c5-98066f87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:43.528172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36b743-186ceb28-989175c5-98066f87_0] Write session will restart in 0.006272s
2025-10-02T08:16:43.528190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36b743-186ceb28-989175c5-98066f87_0] Write session: Do CDS request
2025-10-02T08:16:43.528197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36b743-186ceb28-989175c5-98066f87_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:43.535221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36b743-186ceb28-989175c5-98066f87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.535327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:43.535341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2805
2025-10-02T08:16:43.535447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.535468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:43.535475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:43.535478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:43.535753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2805 sessionId:  describe result for acl check
2025-10-02T08:16:43.535776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:43.535781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:43.535782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:43.535786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535410095745951:7059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:43.536222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535410095745951:7059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:43.536843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:43.537121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:43.537243Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:43.537250Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:43.537257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:43.537295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:43.537323Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535410095745978:7063]
2025-10-02T08:16:43.537702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:43.537822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:43.537849Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:43.537958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535410095745951:7059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:43.538027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:43.538054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.538058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.538059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.538059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.538060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.538063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.538068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.538070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.538073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.538075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.538078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.538082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.538085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.538088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.538090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.538094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.538096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.538098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.538101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.538103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.538113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:43.543430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535410095745951:7059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:43.543445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535410095745951:7059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:43.543448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535410095745951:7059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:43.543455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:43.545408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:43.546950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:43.546965Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:43.546967Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:43.546970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:43.546979Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2804 [1:7556535410095745978:7063]
2025-10-02T08:16:43.546989Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:43.547002Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:43.547009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.547012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.547014Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.547027Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:43.547031Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:43.547037Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:43.547086Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.547093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.547095Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:43.547098Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:43.547151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:43.547158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.547169Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.547185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:43.547203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535410095745962:7063]
2025-10-02T08:16:43.547205Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535410095745962:7063]
2025-10-02T08:16:43.547212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:43.547222Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095746007:7059], now have 1 active actors on pipe
2025-10-02T08:16:43.547223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2804
2025-10-02T08:16:43.547223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:43.547226Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:43.547227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535410554985659:2378], now have 1 active actors on pipe
2025-10-02T08:16:43.547232Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:43.547244Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:43.547247Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:43.547273Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.547281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.547292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535410095745962:7063]
2025-10-02T08:16:43.547298Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:43.547307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:43.547318Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:43.547286Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2804
2025-10-02T08:16:43.547323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.547326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.547328Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:43.547334Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.547341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:43.547363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.547407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.547413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.547423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.547456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2805 partition: 0 MaxSeqNo: 17 sessionId: src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0
2025-10-02T08:16:43.547765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36b743-186ceb28-989175c5-98066f87_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:43.550373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0] Write session: try to update token
2025-10-02T08:16:43.550390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:43.563081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2805 sessionId: src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:43.563673Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:43.563692Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:43.563695Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:43.563702Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535410095745962:7063]
2025-10-02T08:16:43.563706Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535410095745962:7063]
2025-10-02T08:16:43.563743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:43.563754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.563756Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:43.563765Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:43.563770Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:43.563875Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:43.565437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:43.628356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535410095746023:6916]
2025-10-02T08:16:43.628456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2804, pipe: [1:7556535410095746023:6916]
2025-10-02T08:16:43.700220Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:43.700513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.700525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.700553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095746023:6916], now have 1 active actors on pipe
2025-10-02T08:16:43.700656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:43.700665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:43.700694Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:43.700735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2805 reason: error at write: Disconnected sessionId: src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0
2025-10-02T08:16:43.700726Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:43.700926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2805 sessionId: src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0 is DEAD
2025-10-02T08:16:43.700931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535410095746023:6916]
2025-10-02T08:16:43.701068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:43.701077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0] Write session will restart in 0.008659s
2025-10-02T08:16:43.701099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0] Write session: Do CDS request
2025-10-02T08:16:43.701104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:43.708258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:43.709013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:43.709125Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:43.709131Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:43.709137Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:43.709167Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:43.709192Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535410095746287:7108]
2025-10-02T08:16:43.709757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:43.709949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:43.709993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:43.710265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:43.710327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.710333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.710334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.710335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.710336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.710341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.710351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.710355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.710358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.710362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.710371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.710381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.710389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.710397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.710405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.710410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.710418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.710422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.710427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.710431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.710449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:43.711216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.711341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:43.711352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2806
2025-10-02T08:16:43.711447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.711480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:43.711489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:43.711492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:43.711863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2806 sessionId:  describe result for acl check
2025-10-02T08:16:43.711900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:43.711906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:43.711907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:43.711912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535410095746303:7117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:43.712381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535410095746303:7117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:43.714088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535410095746303:7117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:43.717437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535410095746303:7117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:43.717453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535410095746303:7117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:43.717457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535410095746303:7117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:43.717464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:43.718046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:43.719455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:43.719469Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:43.719471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:43.719475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:43.719480Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2805 [1:7556535410095746287:7108]
2025-10-02T08:16:43.719490Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:43.719505Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:43.719510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.719512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.719513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.719525Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:43.719531Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:43.719535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:43.719573Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.719578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.719580Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:43.719582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:43.719684Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:43.719689Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.719689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2805
2025-10-02T08:16:43.719698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.719706Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:43.719721Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095746335:7117], now have 1 active actors on pipe
2025-10-02T08:16:43.719726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535410554985666:2378], now have 1 active actors on pipe
2025-10-02T08:16:43.719730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.719733Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.719745Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535410095746281:7108]
2025-10-02T08:16:43.719749Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535410095746281:7108]
2025-10-02T08:16:43.719754Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:43.719763Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:43.719772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:43.719742Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2805
2025-10-02T08:16:43.719773Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:43.719774Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:43.719775Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:43.719784Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe013064-3b505704-aff645c1-435d048f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:43.719789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.719792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.719793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:43.719798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.719809Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:43.719837Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535410095746281:7108]
2025-10-02T08:16:43.719844Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:43.719849Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:43.719852Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.719902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.719915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.719935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.719971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2806 partition: 0 MaxSeqNo: 17 sessionId: src_id|fe013064-3b505704-aff645c1-435d048f_0
2025-10-02T08:16:43.720303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a899f08a-209e0d20-af4449a3-1dc8e502_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|fe013064-3b505704-aff645c1-435d048f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:43.722764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe013064-3b505704-aff645c1-435d048f_0] Write session: try to update token
2025-10-02T08:16:43.722777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe013064-3b505704-aff645c1-435d048f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:43.734760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2806 sessionId: src_id|fe013064-3b505704-aff645c1-435d048f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:43.736156Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:43.736169Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:43.736176Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535410095746281:7108]
2025-10-02T08:16:43.736212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:43.736317Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:43.736425Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:43.736561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:43.736694Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:43.736862Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:43.737065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:43.737065Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:43.737096Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:43.737274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.737290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.737317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:43.737347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:43.737401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.737411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.737558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.737612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.737667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.737718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.737757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.737763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.737830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.737892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.737952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.738017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.738058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.738064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.738127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.738182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.738234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.738290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.738329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.738335Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.738400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.738456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.738529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.738588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.738628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.738635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.738704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.738761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.738820Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.738894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.738938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.738944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.739008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.739065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.739122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.739184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.739223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.739230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.739290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.739345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.739404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.739468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.739514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.739521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.739586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.739645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.739700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.739757Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.739807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.739814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.739870Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.739931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.739992Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.740060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.740110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.740117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.740185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:43.740252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:43.740317Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:43.740377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:43.740417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:43.740424Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:43.740457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:43.740516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.740539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.740546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:43.740572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:43.740587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:43.740594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:43.740597Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:43.740599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:43.740958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:43.740978Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:43.740988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:43.740991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:43.740993Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:43.740996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:43.741436Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:43.741453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:43.741458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:43.741460Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:43.741462Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:43.741464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:43.741929Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:43.741943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:43.741948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:43.741950Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:43.741952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:43.743013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:43.743026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:43.743034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393003742
2025-10-02T08:16:43.743158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:43.743170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:43.743174Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:43.743177Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:43.743181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:43.743183Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:43.743594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:43.743610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:43.743614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:43.743616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:43.743618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:43.743621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:43.743995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:43.744022Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:43.744028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:43.744031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:43.744034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:43.744037Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:43.744418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:43.744434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:43.744437Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:43.745397Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:43.745410Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:43.745413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:43.745415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:43.745420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393003745
2025-10-02T08:16:43.745669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:43.745683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:43.745687Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:43.745689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:43.745692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:43.745693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:43.746066Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:43.746083Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:43.746086Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:43.746088Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:43.746090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:43.746092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:43.746479Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:43.746495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.746563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393003746
2025-10-02T08:16:43.747180Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:43.747197Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:43.747201Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:43.747205Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:43.748612Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:43.748624Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:43.748625Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:43.748634Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535410095746281:7108]
2025-10-02T08:16:43.748636Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535410095746281:7108]
2025-10-02T08:16:43.748674Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:43.748677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:43.748680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.748681Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:43.748684Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:43.748790Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:43.800862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535410095746360:6916]
2025-10-02T08:16:43.800966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2805, pipe: [1:7556535410095746360:6916]
2025-10-02T08:16:43.875536Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:43.875833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095746360:6916], now have 1 active actors on pipe
2025-10-02T08:16:43.875965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535410095746360:6916]
2025-10-02T08:16:43.875990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:43.875996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:43.876030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2806 reason: error at write: Disconnected sessionId: src_id|fe013064-3b505704-aff645c1-435d048f_0
2025-10-02T08:16:43.876035Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:43.876068Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:43.876204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2806 sessionId: src_id|fe013064-3b505704-aff645c1-435d048f_0 is DEAD
2025-10-02T08:16:43.876307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe013064-3b505704-aff645c1-435d048f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:43.876316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe013064-3b505704-aff645c1-435d048f_0] Write session will restart in 0.009289s
2025-10-02T08:16:43.876339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe013064-3b505704-aff645c1-435d048f_0] Write session: Do CDS request
2025-10-02T08:16:43.876345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe013064-3b505704-aff645c1-435d048f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:43.883945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:43.884951Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:43.885083Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:43.885090Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:43.885096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:43.885127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:43.885151Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535410095746629:7136]
2025-10-02T08:16:43.885591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:43.885766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:43.885794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:43.885992Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:43.886023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.886024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.886025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.886025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.886026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.886029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.886034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.886037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.886039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.886040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.886043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.886048Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:43.886051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.886053Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:43.886055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.886058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:43.886060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.886062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.886065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.886067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.886077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:43.886271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe013064-3b505704-aff645c1-435d048f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.886343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:43.886356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2807
2025-10-02T08:16:43.886455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:43.886478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:43.886483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:43.886486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:43.886841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2807 sessionId:  describe result for acl check
2025-10-02T08:16:43.886875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:43.886881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:43.886882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:43.886887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535410095746645:7180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:43.887393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535410095746645:7180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:43.889171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535410095746645:7180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:43.893096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535410095746645:7180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:43.893109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535410095746645:7180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:43.893111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535410095746645:7180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:43.893117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:43.893575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:43.895181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:43.895195Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:43.895197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:43.895200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:43.895206Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2806 [1:7556535410095746629:7136]
2025-10-02T08:16:43.895215Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:43.895229Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:43.895231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.895234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.895236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.895250Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:43.895256Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:43.895263Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:43.895314Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.895322Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.895324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:43.895327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:43.895381Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:43.895388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.895398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:43.895408Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:43.895427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095746676:7180], now have 1 active actors on pipe
2025-10-02T08:16:43.895429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2806
2025-10-02T08:16:43.895433Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535410554985675:2378], now have 1 active actors on pipe
2025-10-02T08:16:43.895438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535410095746623:7136]
2025-10-02T08:16:43.895440Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535410095746623:7136]
2025-10-02T08:16:43.895449Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:43.895458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.895465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.895474Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:43.895476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:43.895481Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:43.895492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:43.895499Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:43.895488Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2806
2025-10-02T08:16:43.895533Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:43.895543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:43.895546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:43.895548Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:43.895555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:43.895565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:43.895575Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535410095746623:7136]
2025-10-02T08:16:43.895581Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:43.895586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:43.895607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.895676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:43.895683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:43.895696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:43.895729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2807 partition: 0 MaxSeqNo: 17 sessionId: src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0
2025-10-02T08:16:43.896026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe013064-3b505704-aff645c1-435d048f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:43.898374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0] Write session: try to update token
2025-10-02T08:16:43.898387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:43.911147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2807 sessionId: src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:43.912661Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:43.912675Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:43.912677Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:43.912685Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535410095746623:7136]
2025-10-02T08:16:43.912688Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535410095746623:7136]
2025-10-02T08:16:43.912720Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:43.912726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:43.912726Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:43.912731Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:43.912733Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:43.912868Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:43.913582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:43.975994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535410095746692:6916]
2025-10-02T08:16:43.976122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2806, pipe: [1:7556535410095746692:6916]
2025-10-02T08:16:44.039048Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:44.039361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.039375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.039411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535410095746692:6916], now have 1 active actors on pipe
2025-10-02T08:16:44.039511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:44.039518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:44.039559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2807 reason: error at write: Disconnected sessionId: src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0
2025-10-02T08:16:44.039576Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:44.039686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2807 sessionId: src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0 is DEAD
2025-10-02T08:16:44.039803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535410095746692:6916]
2025-10-02T08:16:44.039825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:44.039830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0] Write session will restart in 0.008339s
2025-10-02T08:16:44.039847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0] Write session: Do CDS request
2025-10-02T08:16:44.039855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:44.039896Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:44.047005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:44.047810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:44.047924Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:44.047930Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:44.047936Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:44.047963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:44.047987Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535414390714277:7249]
2025-10-02T08:16:44.048361Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:44.048532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:44.048558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:44.048740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:44.048767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.048771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.048772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.048772Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.048773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.048776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.048782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.048784Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.048786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.048787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.048791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.048795Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.048813Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.048818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.048822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.048825Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.048827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.048830Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.048832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.048834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.048845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:44.049180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.049252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:44.049259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2808
2025-10-02T08:16:44.049332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.049349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:44.049355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:44.049358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:44.049633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2808 sessionId:  describe result for acl check
2025-10-02T08:16:44.049660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:44.049661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:44.049662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:44.049665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535414390714293:7259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:44.050001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535414390714293:7259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:44.051796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535414390714293:7259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:44.055557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535414390714293:7259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:44.055567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535414390714293:7259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:44.055569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535414390714293:7259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:44.055574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:44.056014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:44.057339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:44.057351Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:44.057353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:44.057355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:44.057360Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2807 [1:7556535414390714277:7249]
2025-10-02T08:16:44.057367Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:44.057378Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:44.057380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.057382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.057383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.057393Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:44.057396Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:44.057400Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:44.057440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.057446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.057448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:44.057450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:44.057488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:44.057493Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.057500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.057506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:44.057517Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535414390714271:7249]
2025-10-02T08:16:44.057521Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535414390714271:7249]
2025-10-02T08:16:44.057525Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:44.057533Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:44.057541Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:44.057546Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:44.057553Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:44.057556Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:44.057557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2807
2025-10-02T08:16:44.057570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390714324:7259], now have 1 active actors on pipe
2025-10-02T08:16:44.057576Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535414390714271:7249]
2025-10-02T08:16:44.057577Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:44.057579Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:44.057580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535414849952989:2378], now have 1 active actors on pipe
2025-10-02T08:16:44.057583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.057585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.057611Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:44.057619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.057621Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.057622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:44.057628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.057634Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:44.057622Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2807
2025-10-02T08:16:44.057648Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.057740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.057751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.057770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.057800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2808 partition: 0 MaxSeqNo: 17 sessionId: src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0
2025-10-02T08:16:44.058074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d229bc0-45ea7e62-bad4a253-cc355e6b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:44.060558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0] Write session: try to update token
2025-10-02T08:16:44.060572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:44.073549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2808 sessionId: src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:44.074312Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:44.074326Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:44.074329Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:44.074336Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535414390714271:7249]
2025-10-02T08:16:44.074339Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535414390714271:7249]
2025-10-02T08:16:44.074377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:44.074386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.074387Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:44.074408Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:44.074423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:44.074510Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:44.075870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:44.139858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535414390714339:6916]
2025-10-02T08:16:44.139987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2807, pipe: [1:7556535414390714339:6916]
2025-10-02T08:16:44.208183Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:44.208451Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.208462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.208493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390714339:6916], now have 1 active actors on pipe
2025-10-02T08:16:44.208598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535414390714339:6916]
2025-10-02T08:16:44.208692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:44.208702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:44.208722Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:44.208708Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:44.208756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2808 reason: error at write: Disconnected sessionId: src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0
2025-10-02T08:16:44.208897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2808 sessionId: src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0 is DEAD
2025-10-02T08:16:44.209054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:44.209063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0] Write session will restart in 0.005849s
2025-10-02T08:16:44.209080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0] Write session: Do CDS request
2025-10-02T08:16:44.209085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:44.216223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.216298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:44.216309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2809
2025-10-02T08:16:44.216410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.216434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:44.216437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:44.216440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:44.216862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2809 sessionId:  describe result for acl check
2025-10-02T08:16:44.216883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:44.216884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:44.216885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:44.216888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535414390714595:7323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:44.217277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535414390714595:7323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:44.218322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:44.219164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:44.219208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535414390714595:7323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:44.219385Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:44.219393Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:44.219404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:44.219451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:44.219486Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535414390714633:7324]
2025-10-02T08:16:44.220013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:44.220218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:44.220255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:44.220471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:44.220505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.220509Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.220510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.220511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.220512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.220515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.220520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.220522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.220524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.220526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.220530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.220534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.220538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.220541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.220543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.220546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.220548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.220551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.220553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.220556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.220566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:44.224859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535414390714595:7323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:44.224870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535414390714595:7323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:44.224872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535414390714595:7323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:44.224877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:44.227764Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:44.229151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:44.229164Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:44.229166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:44.229168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:44.229173Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2808 [1:7556535414390714633:7324]
2025-10-02T08:16:44.229183Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:44.229197Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:44.229200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.229202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.229204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.229217Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:44.229224Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:44.229228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:44.229269Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.229274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.229276Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:44.229278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:44.229318Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:44.229324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.229330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.229340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:44.229353Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535414390714621:7324]
2025-10-02T08:16:44.229358Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535414390714621:7324]
2025-10-02T08:16:44.229363Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:44.229374Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:44.229382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2808
2025-10-02T08:16:44.229387Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:44.229388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:44.229389Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:44.229392Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:44.229395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390714660:7323], now have 1 active actors on pipe
2025-10-02T08:16:44.229413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535414849952995:2378], now have 1 active actors on pipe
2025-10-02T08:16:44.229418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535414390714621:7324]
2025-10-02T08:16:44.229419Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:44.229423Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.229424Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:44.229426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.229452Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:44.229459Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.229462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.229464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:44.229469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.229478Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:44.229493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.229471Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2808
2025-10-02T08:16:44.229531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.229538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.229546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.229582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2809 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0
2025-10-02T08:16:44.229874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cdfb4d5-230ec8f7-296a5801-fbc2454a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:44.232472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0] Write session: try to update token
2025-10-02T08:16:44.232488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:44.245509Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:44.245527Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:44.245530Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:44.245537Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535414390714621:7324]
2025-10-02T08:16:44.245541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535414390714621:7324]
2025-10-02T08:16:44.245581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2809 sessionId: src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:44.245585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:44.245591Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.245593Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:44.245677Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:44.245691Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:44.245710Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:44.248059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:44.308949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535414390714674:6916]
2025-10-02T08:16:44.309050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2808, pipe: [1:7556535414390714674:6916]
2025-10-02T08:16:44.373335Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:44.373548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.373558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.373587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390714674:6916], now have 1 active actors on pipe
2025-10-02T08:16:44.373654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:44.373664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:44.373712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2809 reason: error at write: Disconnected sessionId: src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0
2025-10-02T08:16:44.373788Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:44.373815Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:44.373888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2809 sessionId: src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0 is DEAD
2025-10-02T08:16:44.374035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535414390714674:6916]
2025-10-02T08:16:44.374063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:44.374073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0] Write session will restart in 0.006976s
2025-10-02T08:16:44.374111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0] Write session: Do CDS request
2025-10-02T08:16:44.374117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:44.382258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.382394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:44.382417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2810
2025-10-02T08:16:44.382518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.382552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:44.382560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:44.382564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:44.382939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2810 sessionId:  describe result for acl check
2025-10-02T08:16:44.382967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:44.382981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:44.382986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:44.382991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535414390714942:7381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:44.383007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:44.383440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535414390714942:7381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:44.383814Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:44.383963Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:44.383983Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:44.383994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:44.384059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:44.384093Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535414390714953:7351]
2025-10-02T08:16:44.384674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:44.384854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:44.384898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:44.385173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:44.385235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.385243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.385244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.385246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.385247Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.385252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.385262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.385266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.385270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.385273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.385278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.385285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.385290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.385296Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.385299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.385304Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.385309Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.385314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.385319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.385323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.385341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:44.385480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535414390714942:7381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:44.390807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535414390714942:7381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:44.390822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535414390714942:7381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:44.390825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535414390714942:7381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:44.390833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:44.392762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:44.394242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:44.394261Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:44.394264Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:44.394267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:44.394273Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2809 [1:7556535414390714953:7351]
2025-10-02T08:16:44.394284Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:44.394299Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:44.394301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.394304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.394305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.394320Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:44.394324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:44.394332Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:44.394383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.394391Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.394394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:44.394397Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:44.394454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:44.394463Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.394476Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.394490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:44.394506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390714994:7381], now have 1 active actors on pipe
2025-10-02T08:16:44.394508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2809
2025-10-02T08:16:44.394514Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535414849953004:2378], now have 1 active actors on pipe
2025-10-02T08:16:44.394520Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535414390714941:7351]
2025-10-02T08:16:44.394522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535414390714941:7351]
2025-10-02T08:16:44.394534Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:44.394542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.394545Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.394554Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:44.394561Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:44.394564Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:44.394576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:44.394579Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:44.394565Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2809
2025-10-02T08:16:44.394613Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:44.394623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.394627Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.394629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:44.394636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.394643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:44.394654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535414390714941:7351]
2025-10-02T08:16:44.394663Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:44.394671Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:44.394691Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.394788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.394797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.394810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.394841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2810 partition: 0 MaxSeqNo: 17 sessionId: src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0
2025-10-02T08:16:44.395160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccef14e-8565896f-7c127ee5-d8a60279_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:44.397510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0] Write session: try to update token
2025-10-02T08:16:44.397521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:44.410712Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:44.410726Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:44.410727Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:44.410734Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535414390714941:7351]
2025-10-02T08:16:44.410737Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535414390714941:7351]
2025-10-02T08:16:44.410767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:44.410771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.410772Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:44.410855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2810 sessionId: src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:44.410885Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:44.410928Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:44.410940Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:44.413439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:44.474184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535414390715008:6916]
2025-10-02T08:16:44.474276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2809, pipe: [1:7556535414390715008:6916]
2025-10-02T08:16:44.533691Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:44.533873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.533882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.533908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390715008:6916], now have 1 active actors on pipe
2025-10-02T08:16:44.534020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535414390715008:6916]
2025-10-02T08:16:44.534045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:44.534051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:44.534105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2810 reason: error at write: Disconnected sessionId: src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0
2025-10-02T08:16:44.534096Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:44.534209Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:44.534238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2810 sessionId: src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0 is DEAD
2025-10-02T08:16:44.534372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:44.534381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0] Write session will restart in 0.006778s
2025-10-02T08:16:44.534397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0] Write session: Do CDS request
2025-10-02T08:16:44.534401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:44.541761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:44.542206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.542286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:44.542295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2811
2025-10-02T08:16:44.542393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.542417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:44.542425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:44.542428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:44.542678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:44.542775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2811 sessionId:  describe result for acl check
2025-10-02T08:16:44.542799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:44.542805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:44.542806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:44.542810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535414390715323:2356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:44.542847Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:44.542856Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:44.542865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:44.542917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:44.542949Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535414390715324:2365]
2025-10-02T08:16:44.543214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535414390715323:2356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:44.543531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:44.543693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:44.543734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:44.544068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:44.544105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.544110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.544111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.544112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.544113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.544117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.544126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.544133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.544136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.544144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.544149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.544159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.544168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.544176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.544183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.544187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.544194Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.544198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.544206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.544210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.544231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:44.545017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535414390715323:2356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:44.550552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535414390715323:2356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:44.550569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535414390715323:2356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:44.550572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535414390715323:2356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:44.550579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:44.551512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:44.553046Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:44.553060Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:44.553063Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:44.553066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:44.553071Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2810 [1:7556535414390715324:2365]
2025-10-02T08:16:44.553082Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:44.553095Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:44.553098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.553101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.553102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.553116Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:44.553124Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:44.553129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:44.553186Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.553192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.553195Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:44.553197Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:44.553249Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:44.553255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.553267Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.553278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:44.553297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390715368:2356], now have 1 active actors on pipe
2025-10-02T08:16:44.553306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535414390715315:2365]
2025-10-02T08:16:44.553308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535414390715315:2365]
2025-10-02T08:16:44.553313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2810
2025-10-02T08:16:44.553315Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:44.553322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535414849953033:2378], now have 1 active actors on pipe
2025-10-02T08:16:44.553323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:44.553326Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:44.553328Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:44.553340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:44.553343Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:44.553349Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.553357Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.553389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535414390715315:2365]
2025-10-02T08:16:44.553396Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:44.553398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:44.553385Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2810
2025-10-02T08:16:44.553408Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df266068-3ada3c62-e37d0451-5a9d6278_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:44.553417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.553420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.553422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:44.553430Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.553441Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:44.553475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.553523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.553529Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.553540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.553571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2811 partition: 0 MaxSeqNo: 17 sessionId: src_id|df266068-3ada3c62-e37d0451-5a9d6278_0
2025-10-02T08:16:44.553848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff40b24-79397982-6911f4b4-512d7fc6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df266068-3ada3c62-e37d0451-5a9d6278_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:44.556533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df266068-3ada3c62-e37d0451-5a9d6278_0] Write session: try to update token
2025-10-02T08:16:44.556550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df266068-3ada3c62-e37d0451-5a9d6278_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:44.569032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2811 sessionId: src_id|df266068-3ada3c62-e37d0451-5a9d6278_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:44.569859Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:44.569871Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:44.569874Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:44.569882Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535414390715315:2365]
2025-10-02T08:16:44.569886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535414390715315:2365]
2025-10-02T08:16:44.569920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:44.569923Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:44.569924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.569926Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:44.569928Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:44.570038Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:44.571337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:44.634613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535414390715386:6916]
2025-10-02T08:16:44.634748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2810, pipe: [1:7556535414390715386:6916]
2025-10-02T08:16:44.693236Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:44.693522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.693533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.693566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390715386:6916], now have 1 active actors on pipe
2025-10-02T08:16:44.693669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535414390715386:6916]
2025-10-02T08:16:44.693686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:44.693691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:44.693756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2811 reason: error at write: Disconnected sessionId: src_id|df266068-3ada3c62-e37d0451-5a9d6278_0
2025-10-02T08:16:44.693845Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:44.693822Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:44.694092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df266068-3ada3c62-e37d0451-5a9d6278_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:44.694100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df266068-3ada3c62-e37d0451-5a9d6278_0] Write session will restart in 0.005017s
2025-10-02T08:16:44.693893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2811 sessionId: src_id|df266068-3ada3c62-e37d0451-5a9d6278_0 is DEAD
2025-10-02T08:16:44.694121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df266068-3ada3c62-e37d0451-5a9d6278_0] Write session: Do CDS request
2025-10-02T08:16:44.694128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df266068-3ada3c62-e37d0451-5a9d6278_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:44.700212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df266068-3ada3c62-e37d0451-5a9d6278_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.700275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:44.700285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2812
2025-10-02T08:16:44.700390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.700410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:44.700416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:44.700418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:44.700737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2812 sessionId:  describe result for acl check
2025-10-02T08:16:44.700764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:44.700769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:44.700770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:44.700773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535414390715614:2399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:44.701161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535414390715614:2399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:44.702688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:44.703055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535414390715614:2399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:44.703669Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:44.703798Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:44.703805Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:44.703811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:44.703841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:44.703866Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535414390715694:2429]
2025-10-02T08:16:44.704298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:44.704449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:44.704473Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:44.704680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:44.704709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.704713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.704714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.704714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.704715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.704717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.704724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.704726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.704728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.704729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.704733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.704736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.704740Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.704743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.704745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.704747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.704749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.704752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.704754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.704757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.704766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:44.705262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535414390715614:2399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:44.705272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535414390715614:2399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:44.705273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535414390715614:2399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:44.705278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:44.711900Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:44.713906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:44.713922Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:44.713923Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:44.713925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:44.713930Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2811 [1:7556535414390715694:2429]
2025-10-02T08:16:44.713937Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:44.713948Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:44.713949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.713952Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.713955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.713966Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:44.713969Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:44.713973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:44.714097Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.714104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.714106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:44.714108Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:44.714151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:44.714156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.714163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.714170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:44.714181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390715711:2399], now have 1 active actors on pipe
2025-10-02T08:16:44.714189Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535414390715678:2429]
2025-10-02T08:16:44.714191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535414390715678:2429]
2025-10-02T08:16:44.714195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:44.714200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2811
2025-10-02T08:16:44.714202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535414849953040:2378], now have 1 active actors on pipe
2025-10-02T08:16:44.714202Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:44.714204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:44.714206Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:44.714213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:44.714214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:44.714221Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.714224Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.714251Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535414390715678:2429]
2025-10-02T08:16:44.714259Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:44.714270Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acef44db-540e579e-231a033a-219925c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:44.714271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:44.714274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.714276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.714277Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:44.714284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.714290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:44.714253Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2811
2025-10-02T08:16:44.714315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.714370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.714375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.714385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.714409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2812 partition: 0 MaxSeqNo: 17 sessionId: src_id|acef44db-540e579e-231a033a-219925c4_0
2025-10-02T08:16:44.714725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df266068-3ada3c62-e37d0451-5a9d6278_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|acef44db-540e579e-231a033a-219925c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:44.721878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acef44db-540e579e-231a033a-219925c4_0] Write session: try to update token
2025-10-02T08:16:44.721894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acef44db-540e579e-231a033a-219925c4_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:44.730243Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:44.730261Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:44.730263Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:44.730269Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535414390715678:2429]
2025-10-02T08:16:44.730273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535414390715678:2429]
2025-10-02T08:16:44.730304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:44.730308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.730310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:44.730313Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:44.730317Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:44.730459Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:44.735676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2812 sessionId: src_id|acef44db-540e579e-231a033a-219925c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:44.738316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:44.793657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535414390715729:6916]
2025-10-02T08:16:44.793759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2811, pipe: [1:7556535414390715729:6916]
2025-10-02T08:16:44.852691Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:44.852962Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.852973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.852988Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390715729:6916], now have 1 active actors on pipe
2025-10-02T08:16:44.853094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535414390715729:6916]
2025-10-02T08:16:44.853119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:44.853121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:44.853137Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:44.853180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2812 reason: error at write: Disconnected sessionId: src_id|acef44db-540e579e-231a033a-219925c4_0
2025-10-02T08:16:44.853201Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:44.853305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2812 sessionId: src_id|acef44db-540e579e-231a033a-219925c4_0 is DEAD
2025-10-02T08:16:44.853502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acef44db-540e579e-231a033a-219925c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:44.853514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acef44db-540e579e-231a033a-219925c4_0] Write session will restart in 0.007886s
2025-10-02T08:16:44.853549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acef44db-540e579e-231a033a-219925c4_0] Write session: Do CDS request
2025-10-02T08:16:44.853557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acef44db-540e579e-231a033a-219925c4_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:44.862025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:44.862189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acef44db-540e579e-231a033a-219925c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.862289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:44.862299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2813
2025-10-02T08:16:44.862417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:44.862442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:44.862450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:44.862453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:44.862781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2813 sessionId:  describe result for acl check
2025-10-02T08:16:44.862814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:44.862820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:44.862822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:44.862826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535414390716009:2415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:44.862891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:44.863018Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:44.863025Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:44.863031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:44.863064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:44.863089Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535414390716011:2398]
2025-10-02T08:16:44.863211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535414390716009:2415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:44.863494Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:44.863623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:44.863652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:44.863846Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:44.863884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.863901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.863906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.863906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.863907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.863913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.863922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.863929Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.863932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.863939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.863944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.863953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:44.863958Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.863962Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:44.863966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.863974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:44.863978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.863986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.863989Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.864007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.864026Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:44.865040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535414390716009:2415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:44.870491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535414390716009:2415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:44.870505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535414390716009:2415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:44.870509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535414390716009:2415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:44.870516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:44.871355Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:44.872838Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:44.872848Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:44.872850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:44.872853Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:44.872858Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2812 [1:7556535414390716011:2398]
2025-10-02T08:16:44.872865Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:44.872877Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:44.872879Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.872881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.872882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.872892Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:44.872895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:44.872899Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:44.872936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.872942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.872944Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:44.872946Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:44.872991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:44.872998Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.873008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:44.873023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:44.873041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535414390716002:2398]
2025-10-02T08:16:44.873046Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535414390716002:2398]
2025-10-02T08:16:44.873048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2812
2025-10-02T08:16:44.873053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:44.873100Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2812
2025-10-02T08:16:44.873059Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:44.873064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390716058:2415], now have 1 active actors on pipe
2025-10-02T08:16:44.873066Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:44.873071Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:44.873082Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:44.873084Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:44.873089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535414849953049:2378], now have 1 active actors on pipe
2025-10-02T08:16:44.873093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.873097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.873132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535414390716002:2398]
2025-10-02T08:16:44.873136Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:44.873139Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:44.873148Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca293031-3ba23619-9c598d35-9ac888b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:44.873153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:44.873155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:44.873157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:44.873164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:44.873172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:44.873215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.873252Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:44.873258Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:44.873270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:44.873300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2813 partition: 0 MaxSeqNo: 17 sessionId: src_id|ca293031-3ba23619-9c598d35-9ac888b_0
2025-10-02T08:16:44.873575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acef44db-540e579e-231a033a-219925c4_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ca293031-3ba23619-9c598d35-9ac888b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:44.875941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca293031-3ba23619-9c598d35-9ac888b_0] Write session: try to update token
2025-10-02T08:16:44.875953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca293031-3ba23619-9c598d35-9ac888b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:44.888281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2813 sessionId: src_id|ca293031-3ba23619-9c598d35-9ac888b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:44.889647Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:44.889667Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:44.889669Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:44.889680Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535414390716002:2398]
2025-10-02T08:16:44.889684Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535414390716002:2398]
2025-10-02T08:16:44.889726Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:44.889733Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:44.889738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:44.889738Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:44.889743Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:44.889925Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:44.891002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:44.953422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535414390716073:6916]
2025-10-02T08:16:44.953528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2812, pipe: [1:7556535414390716073:6916]
2025-10-02T08:16:45.012798Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:45.013040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.013050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.013083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535414390716073:6916], now have 1 active actors on pipe
2025-10-02T08:16:45.013313Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:45.013466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535414390716073:6916]
2025-10-02T08:16:45.013467Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:45.013491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:45.013546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2813 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca293031-3ba23619-9c598d35-9ac888b_0
2025-10-02T08:16:45.013719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2813 sessionId: src_id|ca293031-3ba23619-9c598d35-9ac888b_0 is DEAD
2025-10-02T08:16:45.013854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca293031-3ba23619-9c598d35-9ac888b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:45.013865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca293031-3ba23619-9c598d35-9ac888b_0] Write session will restart in 0.007980s
2025-10-02T08:16:45.013887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca293031-3ba23619-9c598d35-9ac888b_0] Write session: Do CDS request
2025-10-02T08:16:45.013895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca293031-3ba23619-9c598d35-9ac888b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:45.022453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:45.023201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca293031-3ba23619-9c598d35-9ac888b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.023281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:45.023291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2814
2025-10-02T08:16:45.023401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.023440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:45.023446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:45.023449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:45.023453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:45.023603Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:45.023614Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:45.023622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:45.023665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:45.023704Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535418685683662:2412]
2025-10-02T08:16:45.023795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2814 sessionId:  describe result for acl check
2025-10-02T08:16:45.023821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:45.023827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:45.023829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:45.023834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535418685683665:2455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:45.024121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:45.024251Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:45.024277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:45.024281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535418685683665:2455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:45.024484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:45.024524Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.024529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.024530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.024531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.024532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.024536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.024541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.024547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.024549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.024551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.024554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.024559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.024562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.024565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.024567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.024570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.024576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.024578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.024581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.024583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.024593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:45.025891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535418685683665:2455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:45.031200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535418685683665:2455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:45.031215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535418685683665:2455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:45.031218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535418685683665:2455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:45.031226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:45.032240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:45.033736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:45.033753Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:45.033754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:45.033757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:45.033762Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2813 [1:7556535418685683662:2412]
2025-10-02T08:16:45.033769Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:45.033782Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:45.033783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.033786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.033787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.033798Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:45.033801Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:45.033806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:45.033845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.033851Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.033854Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:45.033855Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:45.033901Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:45.033906Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.033914Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.033924Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:45.033940Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535418685683654:2412]
2025-10-02T08:16:45.033945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535418685683654:2412]
2025-10-02T08:16:45.033950Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:45.033962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:45.033963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:45.033966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:45.033974Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:45.033974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2813
2025-10-02T08:16:45.033976Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:45.033983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685683710:2455], now have 1 active actors on pipe
2025-10-02T08:16:45.033985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535419144920364:2378], now have 1 active actors on pipe
2025-10-02T08:16:45.034006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.034012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.034022Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535418685683654:2412]
2025-10-02T08:16:45.034030Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:45.034023Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2813
2025-10-02T08:16:45.034046Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91254be3-5bf8d235-30684314-7baa552a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:45.034050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.034052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.034053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:45.034055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:45.034059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.034065Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:45.034087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.034128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.034134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.034143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.034171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2814 partition: 0 MaxSeqNo: 17 sessionId: src_id|91254be3-5bf8d235-30684314-7baa552a_0
2025-10-02T08:16:45.034463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca293031-3ba23619-9c598d35-9ac888b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|91254be3-5bf8d235-30684314-7baa552a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:45.036758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91254be3-5bf8d235-30684314-7baa552a_0] Write session: try to update token
2025-10-02T08:16:45.036770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91254be3-5bf8d235-30684314-7baa552a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:45.048869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2814 sessionId: src_id|91254be3-5bf8d235-30684314-7baa552a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:45.051218Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:45.051239Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:45.051241Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:45.051249Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535418685683654:2412]
2025-10-02T08:16:45.051254Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535418685683654:2412]
2025-10-02T08:16:45.051279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:45.051294Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:45.051299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.051302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:45.051302Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:45.051307Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:45.051446Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:45.113674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535418685683724:6916]
2025-10-02T08:16:45.113785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2813, pipe: [1:7556535418685683724:6916]
2025-10-02T08:16:45.183592Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:45.183989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.184013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.184054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685683724:6916], now have 1 active actors on pipe
2025-10-02T08:16:45.184201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:45.184213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:45.184270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2814 reason: error at write: Disconnected sessionId: src_id|91254be3-5bf8d235-30684314-7baa552a_0
2025-10-02T08:16:45.184277Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:45.184280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:45.184432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2814 sessionId: src_id|91254be3-5bf8d235-30684314-7baa552a_0 is DEAD
2025-10-02T08:16:45.184580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91254be3-5bf8d235-30684314-7baa552a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:45.184588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91254be3-5bf8d235-30684314-7baa552a_0] Write session will restart in 0.008780s
2025-10-02T08:16:45.184572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535418685683724:6916]
2025-10-02T08:16:45.184607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91254be3-5bf8d235-30684314-7baa552a_0] Write session: Do CDS request
2025-10-02T08:16:45.184613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91254be3-5bf8d235-30684314-7baa552a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:45.193606Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:45.194253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91254be3-5bf8d235-30684314-7baa552a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.194330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:45.194337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2815
2025-10-02T08:16:45.194472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.194496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:45.194506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:45.194513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:45.194517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:45.194650Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:45.194658Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:45.194665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:45.194698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:45.194723Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535418685684009:2451]
2025-10-02T08:16:45.194881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2815 sessionId:  describe result for acl check
2025-10-02T08:16:45.194909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:45.194916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:45.194918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:45.194923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535418685684013:2474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:45.195133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:45.195290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:45.195315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:45.195327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535418685684013:2474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:45.195499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:45.195531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.195536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.195537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.195538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.195539Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.195544Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.195553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.195557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.195560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.195563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.195566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.195571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.195574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.195578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.195580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.195583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.195585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.195588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.195591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.195593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.195604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:45.197439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535418685684013:2474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:45.203010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535418685684013:2474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:45.203026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535418685684013:2474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:45.203030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535418685684013:2474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:45.203038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:45.203409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:45.204887Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:45.204900Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:45.204903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:45.204907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:45.204912Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2814 [1:7556535418685684009:2451]
2025-10-02T08:16:45.204925Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:45.204940Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:45.204941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.204943Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.204944Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.204956Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:45.204960Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:45.204966Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:45.205011Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.205019Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.205022Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:45.205023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:45.205065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:45.205071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.205080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.205091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:45.205102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535418685684002:2451]
2025-10-02T08:16:45.205107Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535418685684002:2451]
2025-10-02T08:16:45.205113Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:45.205120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2814
2025-10-02T08:16:45.205124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685684057:2474], now have 1 active actors on pipe
2025-10-02T08:16:45.205129Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:45.205136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:45.205137Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:45.205138Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:45.205140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:45.205174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535419144920371:2378], now have 1 active actors on pipe
2025-10-02T08:16:45.205186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.205189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.205203Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535418685684002:2451]
2025-10-02T08:16:45.205212Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:45.205219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:45.205232Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:45.205236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.205238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.205239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:45.205245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.205253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:45.205279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.205262Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2814
2025-10-02T08:16:45.205323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.205328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.205338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.205361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2815 partition: 0 MaxSeqNo: 17 sessionId: src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0
2025-10-02T08:16:45.205639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91254be3-5bf8d235-30684314-7baa552a_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:45.208200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0] Write session: try to update token
2025-10-02T08:16:45.208215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:45.221699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2815 sessionId: src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:45.223040Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:45.223061Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:45.223064Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:45.223073Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535418685684002:2451]
2025-10-02T08:16:45.223078Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535418685684002:2451]
2025-10-02T08:16:45.223119Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:45.223130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.223130Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:45.223132Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:45.223135Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:45.223259Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:45.224236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:45.284693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535418685684072:6916]
2025-10-02T08:16:45.284796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2814, pipe: [1:7556535418685684072:6916]
2025-10-02T08:16:45.369956Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:45.370237Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.370250Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.370289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685684072:6916], now have 1 active actors on pipe
2025-10-02T08:16:45.370396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:45.370408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:45.370460Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:45.370468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2815 reason: error at write: Disconnected sessionId: src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0
2025-10-02T08:16:45.370545Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:45.370620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2815 sessionId: src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0 is DEAD
2025-10-02T08:16:45.370735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:45.370745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0] Write session will restart in 0.009808s
2025-10-02T08:16:45.370767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0] Write session: Do CDS request
2025-10-02T08:16:45.370773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:45.370784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535418685684072:6916]
2025-10-02T08:16:45.379414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:45.380363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:45.380508Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:45.380515Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:45.380522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:45.380552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:45.380572Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535418685684358:2515]
2025-10-02T08:16:45.381022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:45.381200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:45.381244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:45.381277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.381339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:45.381351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2816
2025-10-02T08:16:45.381480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.381487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:45.381512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:45.381516Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.381517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.381518Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.381519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.381519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.381520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:45.381523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.381524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:45.381528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.381530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.381532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.381534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.381538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.381542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.381546Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.381548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.381551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.381553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.381555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.381558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.381565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.381568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.381577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:45.381784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2816 sessionId:  describe result for acl check
2025-10-02T08:16:45.381811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:45.381816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:45.381818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:45.381822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535418685684374:2527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:45.382248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535418685684374:2527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:45.384209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535418685684374:2527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:45.388575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535418685684374:2527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:45.388586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535418685684374:2527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:45.388589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535418685684374:2527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:45.388595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:45.392659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:45.394172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:45.394187Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:45.394188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:45.394191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:45.394195Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2815 [1:7556535418685684358:2515]
2025-10-02T08:16:45.394206Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:45.394220Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:45.394223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.394225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.394227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.394245Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:45.394250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:45.394255Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:45.394313Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.394323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.394326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:45.394328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:45.394386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:45.394395Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.394407Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.394418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:45.394440Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685684405:2527], now have 1 active actors on pipe
2025-10-02T08:16:45.394451Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535418685684352:2515]
2025-10-02T08:16:45.394453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535418685684352:2515]
2025-10-02T08:16:45.394465Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:45.394479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535419144920380:2378], now have 1 active actors on pipe
2025-10-02T08:16:45.394483Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:45.394487Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:45.394490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2815
2025-10-02T08:16:45.394492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.394496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.394511Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:45.394525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:45.394530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:45.394518Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2815
2025-10-02T08:16:45.394563Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:45.394570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.394573Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.394574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:45.394581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.394590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:45.394601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535418685684352:2515]
2025-10-02T08:16:45.394610Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:45.394630Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:45.394645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.394681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.394692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.394710Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.394745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2816 partition: 0 MaxSeqNo: 17 sessionId: src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0
2025-10-02T08:16:45.395005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da11610-3474631c-9f94ed5a-5aad57cb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:45.397297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0] Write session: try to update token
2025-10-02T08:16:45.397309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:45.409259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2816 sessionId: src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:45.411241Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:45.411263Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:45.411265Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:45.411273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535418685684352:2515]
2025-10-02T08:16:45.411278Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535418685684352:2515]
2025-10-02T08:16:45.411317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:45.411320Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:45.411326Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:45.411328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.411330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:45.411463Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:45.411522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:45.471045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535418685684420:6916]
2025-10-02T08:16:45.471177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2815, pipe: [1:7556535418685684420:6916]
2025-10-02T08:16:45.542050Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:45.542481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.542492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.542522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685684420:6916], now have 1 active actors on pipe
2025-10-02T08:16:45.542709Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:45.542758Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:45.542948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535418685684420:6916]
2025-10-02T08:16:45.542963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:45.543002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2816 reason: status is not ok: tablet will be restarted right now sessionId: src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0
2025-10-02T08:16:45.543145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2816 sessionId: src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0 is DEAD
2025-10-02T08:16:45.543303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:45.543316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0] Write session will restart in 0.008102s
2025-10-02T08:16:45.543339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0] Write session: Do CDS request
2025-10-02T08:16:45.543344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:45.552282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.552383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:45.552399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2817
2025-10-02T08:16:45.552574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:45.552687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.552715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:45.552717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:45.552720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:45.553242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2817 sessionId:  describe result for acl check
2025-10-02T08:16:45.553274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:45.553281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:45.553283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:45.553287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535418685684723:2600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:45.553784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:45.553986Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:45.553994Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:45.554000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:45.554033Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:45.554067Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535418685684726:2579]
2025-10-02T08:16:45.554631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:45.554687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535418685684723:2600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:45.554888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:45.554932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:45.555249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:45.555312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.555318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.555319Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.555320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.555321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.555326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.555339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.555346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.555350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.555358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.555364Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.555371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.555382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.555390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.555398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.555407Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.555416Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.555425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.555433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.555437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.555457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:45.557475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535418685684723:2600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:45.563613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535418685684723:2600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:45.563627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535418685684723:2600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:45.563630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535418685684723:2600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:45.563636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:45.564232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:45.565725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:45.565741Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:45.565743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:45.565747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:45.565752Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2816 [1:7556535418685684726:2579]
2025-10-02T08:16:45.565762Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:45.565781Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:45.565784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.565786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.565788Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.565801Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:45.565806Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:45.565816Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:45.565868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.565877Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.565879Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:45.565882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:45.565936Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:45.565943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.565956Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.565971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:45.565993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685684786:2600], now have 1 active actors on pipe
2025-10-02T08:16:45.565993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2816
2025-10-02T08:16:45.566001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535419144920399:2378], now have 1 active actors on pipe
2025-10-02T08:16:45.566008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535418685684717:2579]
2025-10-02T08:16:45.566010Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535418685684717:2579]
2025-10-02T08:16:45.566022Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:45.566033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.566040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.566045Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:45.566055Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:45.566058Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:45.566072Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:45.566078Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:45.566048Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2816
2025-10-02T08:16:45.566116Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:45.566126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.566129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.566131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:45.566138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.566150Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:45.566166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535418685684717:2579]
2025-10-02T08:16:45.566178Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:45.566190Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:45.566204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.566257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.566270Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.566290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.566324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2817 partition: 0 MaxSeqNo: 17 sessionId: src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0
2025-10-02T08:16:45.566659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc0d5d2-c03c13ff-85e3c4-b6400357_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:45.571364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0] Write session: try to update token
2025-10-02T08:16:45.571379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:45.585734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2817 sessionId: src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:45.586368Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:45.586382Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:45.586384Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:45.586390Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535418685684717:2579]
2025-10-02T08:16:45.586394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535418685684717:2579]
2025-10-02T08:16:45.586434Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:45.586435Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:45.586440Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.586440Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:45.586442Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:45.586578Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:45.588033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:45.643063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535418685684808:6916]
2025-10-02T08:16:45.643153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2816, pipe: [1:7556535418685684808:6916]
2025-10-02T08:16:45.729067Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:45.729588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.729601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.729637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685684808:6916], now have 1 active actors on pipe
2025-10-02T08:16:45.729766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535418685684808:6916]
2025-10-02T08:16:45.729794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:45.729798Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:45.729803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:45.729843Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:45.729863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2817 reason: error at write: Disconnected sessionId: src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0
2025-10-02T08:16:45.730049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2817 sessionId: src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0 is DEAD
2025-10-02T08:16:45.730179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:45.730185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0] Write session will restart in 0.006745s
2025-10-02T08:16:45.730205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0] Write session: Do CDS request
2025-10-02T08:16:45.730210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:45.738209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.738298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:45.738315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2818
2025-10-02T08:16:45.738433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.738465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:45.738475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:45.738478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:45.738870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2818 sessionId:  describe result for acl check
2025-10-02T08:16:45.738903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:45.738909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:45.738911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:45.738917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535418685685101:2659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:45.739007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:45.739413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535418685685101:2659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:45.740181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:45.740326Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:45.740334Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:45.740342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:45.740378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:45.740411Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535418685685122:2663]
2025-10-02T08:16:45.741056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:45.741203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:45.741236Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:45.741320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535418685685101:2659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:45.741533Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:45.741566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.741572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.741573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.741574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.741575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.741579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.741588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.741596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.741599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.741607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.741612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.741623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.741632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.741641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.741649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.741654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.741660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.741666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.741674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.741683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.741704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:45.747447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535418685685101:2659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:45.747461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535418685685101:2659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:45.747466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535418685685101:2659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:45.747473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:45.750404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:45.751706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:45.751723Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:45.751726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:45.751730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:45.751736Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2817 [1:7556535418685685122:2663]
2025-10-02T08:16:45.751748Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:45.751762Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:45.751770Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.751773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.751775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.751789Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:45.751799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:45.751805Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:45.751864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.751871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.751874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:45.751876Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:45.751930Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:45.751937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.751949Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.751969Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:45.751985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685685154:2659], now have 1 active actors on pipe
2025-10-02T08:16:45.751989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535419144920415:2378], now have 1 active actors on pipe
2025-10-02T08:16:45.752006Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535418685685102:2663]
2025-10-02T08:16:45.752008Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535418685685102:2663]
2025-10-02T08:16:45.752013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2817
2025-10-02T08:16:45.752019Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:45.752035Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:45.752036Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:45.752040Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:45.752054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:45.752056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:45.752062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.752066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.752096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535418685685102:2663]
2025-10-02T08:16:45.752105Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:45.752080Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2817
2025-10-02T08:16:45.752113Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:45.752118Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df1abdf-8a55031-f6a72438-92b988b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:45.752123Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.752127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.752129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:45.752138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.752146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:45.752185Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.752226Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.752232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.752243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.752277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2818 partition: 0 MaxSeqNo: 17 sessionId: src_id|df1abdf-8a55031-f6a72438-92b988b3_0
2025-10-02T08:16:45.752685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e9d261f-e450d1b6-b352402f-1e257a8e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|df1abdf-8a55031-f6a72438-92b988b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:45.755306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df1abdf-8a55031-f6a72438-92b988b3_0] Write session: try to update token
2025-10-02T08:16:45.755323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df1abdf-8a55031-f6a72438-92b988b3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:45.768985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2818 sessionId: src_id|df1abdf-8a55031-f6a72438-92b988b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:45.771321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:45.771383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.771392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.771418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:45.771435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:45.771475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.771494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.771657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.771725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.771789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.771853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.772092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.772105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.772169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.772228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.772294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.772362Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.772411Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.772420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.772485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.772547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.772605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.772665Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.772706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.772714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.772776Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.772869Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.772933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.773004Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.773142Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.773153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.773219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.773279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.773340Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.773405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.773450Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.773459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.773526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.773584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.773643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.773706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.773748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.773755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.773821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.773883Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.773947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.774011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.774054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.774064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.774134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.774198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.774267Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.774329Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.774458Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.774466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.774530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.774594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.774660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.774724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.774770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.774777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.774843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.774907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.774971Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.775048Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.775095Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.775102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.775160Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:45.775221Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.775243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.775251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:45.775282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:45.775297Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:45.775305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:45.775309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:45.775316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:45.775730Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:45.775759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:45.775767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:45.775772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:45.775775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:45.775779Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:45.776302Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:45.776330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:45.776342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:45.776347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:45.776350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:45.776353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:45.776833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:45.776858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:45.776868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:45.776876Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:45.776880Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:45.784602Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:45.784629Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:45.784642Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393005784
2025-10-02T08:16:45.784828Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:45.784850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:45.784866Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:45.784870Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:45.784875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:45.784879Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:45.785361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:45.785395Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:45.785409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:45.785413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:45.785415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:45.785419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:45.785904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:45.785933Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:45.785946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:45.785952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:45.785962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:45.785968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:45.786418Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:45.786448Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:45.786458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:45.787527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:45.787550Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:45.787556Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:45.787561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:45.787575Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393005787
2025-10-02T08:16:45.787885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:45.787911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:45.787922Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:45.787931Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:45.787935Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:45.787939Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:45.788417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:45.788444Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:45.788455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:45.788464Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:45.788467Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:45.788470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:45.788946Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:45.788967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.789075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393005788
2025-10-02T08:16:45.794474Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:45.794506Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:45.794514Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:45.794522Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:45.794534Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:45.794537Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:45.794540Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:45.794550Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535418685685102:2663]
2025-10-02T08:16:45.794560Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535418685685102:2663]
2025-10-02T08:16:45.794614Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:45.794628Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:45.800958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:45.800977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.800979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:45.801117Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:45.829998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535418685685168:6916]
2025-10-02T08:16:45.830074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2817, pipe: [1:7556535418685685168:6916]
2025-10-02T08:16:45.937441Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:45.937725Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:45.937731Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:45.937738Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535418685685102:2663]
2025-10-02T08:16:45.937781Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:45.937797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685685168:6916], now have 1 active actors on pipe
2025-10-02T08:16:45.937920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535418685685168:6916]
2025-10-02T08:16:45.937936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:45.937939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:45.937958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2818 reason: error at write: Disconnected sessionId: src_id|df1abdf-8a55031-f6a72438-92b988b3_0
2025-10-02T08:16:45.937977Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:45.938037Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:45.938112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2818 sessionId: src_id|df1abdf-8a55031-f6a72438-92b988b3_0 is DEAD
2025-10-02T08:16:45.938249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1abdf-8a55031-f6a72438-92b988b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:45.938257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1abdf-8a55031-f6a72438-92b988b3_0] Write session will restart in 0.008142s
2025-10-02T08:16:45.938274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1abdf-8a55031-f6a72438-92b988b3_0] Write session: Do CDS request
2025-10-02T08:16:45.938279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1abdf-8a55031-f6a72438-92b988b3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:45.942040Z node 1 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [ee09eb79e940f3f2] Result# TEvPutResult {Id# [72075186224037892:2817:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-02T08:16:45.942040Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2817:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:16:45.942084Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2817:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-02T08:16:45.947207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df1abdf-8a55031-f6a72438-92b988b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.947318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:45.947334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2819
2025-10-02T08:16:45.947454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:45.947487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:45.947496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:45.947499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:45.947905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2819 sessionId:  describe result for acl check
2025-10-02T08:16:45.947951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:45.947960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:45.947962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:45.947968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535418685685452:2672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:45.948553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535418685685452:2672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:45.948891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:45.950012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:45.950212Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:45.950222Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:45.950233Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:45.950290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:45.950319Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535418685685489:2676]
2025-10-02T08:16:45.950618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535418685685452:2672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:45.950906Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:45.951083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:45.951136Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:45.951421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:45.951465Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.951470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.951470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.951471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.951472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.951475Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.951481Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.951483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.951485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.951487Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.951490Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.951495Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:45.951498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.951501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:45.951504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.951506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:45.951508Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.951511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.951514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.951517Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.951534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:45.956363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535418685685452:2672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:45.956380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535418685685452:2672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:45.956383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535418685685452:2672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:45.956391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:45.959711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:45.961210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:45.961225Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:45.961228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:45.961232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:45.961237Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2818 [1:7556535418685685489:2676]
2025-10-02T08:16:45.961248Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:45.961264Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:45.961266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.961270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.961272Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.961285Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:45.961290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:45.961295Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:45.961342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.961349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.961352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:45.961354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:45.961410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:45.961417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.961429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:45.961443Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:45.961464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2818
2025-10-02T08:16:45.961468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535418685685516:2672], now have 1 active actors on pipe
2025-10-02T08:16:45.961474Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535418685685469:2676]
2025-10-02T08:16:45.961476Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535418685685469:2676]
2025-10-02T08:16:45.961486Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:45.961497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:45.961501Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535419144920424:2378], now have 1 active actors on pipe
2025-10-02T08:16:45.961505Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:45.961506Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.961510Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.961528Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:45.961547Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:45.961553Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:45.961539Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2818
2025-10-02T08:16:45.961588Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2738399-a8f2f443-3804b99a-5a9e6772_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:45.961597Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.961603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.961608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:45.961615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.961623Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:45.961635Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535418685685469:2676]
2025-10-02T08:16:45.961646Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:45.961667Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:45.961673Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.961734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.961741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.961754Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:45.961790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2819 partition: 0 MaxSeqNo: 17 sessionId: src_id|2738399-a8f2f443-3804b99a-5a9e6772_0
2025-10-02T08:16:45.962093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df1abdf-8a55031-f6a72438-92b988b3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|2738399-a8f2f443-3804b99a-5a9e6772_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:45.964462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2738399-a8f2f443-3804b99a-5a9e6772_0] Write session: try to update token
2025-10-02T08:16:45.964474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2738399-a8f2f443-3804b99a-5a9e6772_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:45.972176Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:45.972198Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:45.972207Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535418685685469:2676]
2025-10-02T08:16:45.972249Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:45.972253Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:45.972418Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:45.972564Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:45.972704Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:45.972860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:45.973042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:45.973086Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:45.977429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2819 sessionId: src_id|2738399-a8f2f443-3804b99a-5a9e6772_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:45.979508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:45.979562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.979571Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.979595Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:45.979612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:45.979661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:45.979678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:45.979838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.979905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.979970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.980058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.980220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.980233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.980298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.980356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.980412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.980470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.980511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.980518Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.980578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.980637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.980697Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.980759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.980830Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.980838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.980905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.980968Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.981032Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.981098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.981138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.981149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.981208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.981265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.981319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.981382Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.981429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.981437Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.981499Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.981558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.981621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.981683Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.981731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.981739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.981809Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.981872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.981946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.982014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.982053Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.982060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.982118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.982177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.982241Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.982309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.982356Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.982363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.982431Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.982484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.982546Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.982610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.982655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.982661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.982731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:45.982792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:45.982854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:45.982914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:45.982959Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:45.982967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:45.983003Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:45.983070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:45.983092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:45.983098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:45.983127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:45.983143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:45.983156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:45.983159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:45.983162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:45.983539Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:45.983564Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:45.983570Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:45.983573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:45.983576Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:45.983580Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:45.984053Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:45.984078Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:45.984090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:45.984097Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:45.984100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:45.984103Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:45.984674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:45.984703Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:45.984713Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:45.984717Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:45.984720Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:45.985917Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:45.985943Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:45.985956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393005985
2025-10-02T08:16:45.986077Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:45.986096Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:45.986107Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:45.986113Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:45.986121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:45.986126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:45.986573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:45.986601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:45.986611Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:45.986618Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:45.986621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:45.986624Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:45.987090Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:45.987117Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:45.987124Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:45.987127Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:45.987131Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:45.987133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:45.987606Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:45.987633Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:45.987643Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:45.988743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:45.988766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:45.988772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:45.988777Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:45.988785Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393005988
2025-10-02T08:16:45.989080Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:45.989104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:45.989114Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:45.989122Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:45.989125Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:45.989135Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:45.989577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:45.989604Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:45.989610Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:45.989614Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:45.989617Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:45.989620Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:45.990092Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:45.990116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:45.990224Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393005990
2025-10-02T08:16:45.990936Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:45.990955Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:45.990962Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:45.990974Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:45.992572Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:45.992586Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:45.992587Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:45.992598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535418685685469:2676]
2025-10-02T08:16:45.992601Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535418685685469:2676]
2025-10-02T08:16:45.992635Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:45.992645Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:45.992653Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:45.992657Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:45.992663Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:45.992786Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:46.037812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535422980652845:6916]
2025-10-02T08:16:46.037917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2818, pipe: [1:7556535422980652845:6916]
2025-10-02T08:16:46.124401Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:46.124667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980652845:6916], now have 1 active actors on pipe
2025-10-02T08:16:46.124820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:46.124830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:46.124853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2819 reason: error at write: Disconnected sessionId: src_id|2738399-a8f2f443-3804b99a-5a9e6772_0
2025-10-02T08:16:46.124880Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:46.124922Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:46.125012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2819 sessionId: src_id|2738399-a8f2f443-3804b99a-5a9e6772_0 is DEAD
2025-10-02T08:16:46.125124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2738399-a8f2f443-3804b99a-5a9e6772_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:46.125132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2738399-a8f2f443-3804b99a-5a9e6772_0] Write session will restart in 0.007426s
2025-10-02T08:16:46.125133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535422980652845:6916]
2025-10-02T08:16:46.125149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2738399-a8f2f443-3804b99a-5a9e6772_0] Write session: Do CDS request
2025-10-02T08:16:46.125154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2738399-a8f2f443-3804b99a-5a9e6772_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:46.133195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2738399-a8f2f443-3804b99a-5a9e6772_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.133266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:46.133282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2820
2025-10-02T08:16:46.133381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.133409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:46.133415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:46.133418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:46.133804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2820 sessionId:  describe result for acl check
2025-10-02T08:16:46.133843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:46.133848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:46.133850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:46.133854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535422980653144:2748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:46.134122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:46.134327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535422980653144:2748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:46.135111Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:46.135273Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:46.135281Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:46.135290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:46.135334Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:46.135365Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535422980653161:2747]
2025-10-02T08:16:46.136020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:46.136209Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:46.136258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:46.136332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535422980653144:2748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:46.136502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:46.136548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.136552Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.136553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.136554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.136554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.136558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.136564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.136566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.136568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.136570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.136573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.136578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.136581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.136588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.136590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.136593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.136596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.136598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.136601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.136603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.136614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:46.143356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535422980653144:2748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:46.143371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535422980653144:2748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:46.143374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535422980653144:2748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:46.143383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:46.145157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:46.146651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:46.146669Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:46.146672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:46.146676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:46.146681Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2819 [1:7556535422980653161:2747]
2025-10-02T08:16:46.146693Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:46.146711Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:46.146719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.146723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.146727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.146741Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:46.146750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:46.146756Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:46.146811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.146819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.146822Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:46.146824Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:46.146883Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:46.146892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.146904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.146917Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:46.146936Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535422980653145:2747]
2025-10-02T08:16:46.146942Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535422980653145:2747]
2025-10-02T08:16:46.146949Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:46.146960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980653196:2748], now have 1 active actors on pipe
2025-10-02T08:16:46.146960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2819
2025-10-02T08:16:46.146963Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:46.146966Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:46.146973Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:46.146987Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:46.146990Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:46.146994Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535423439887740:2378], now have 1 active actors on pipe
2025-10-02T08:16:46.147022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.147030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.147041Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535422980653145:2747]
2025-10-02T08:16:46.147053Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:46.147043Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2819
2025-10-02T08:16:46.147075Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:46.147085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.147088Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:46.147088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.147090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:46.147099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.147112Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:46.147134Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.147181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.147189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.147201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.147236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2820 partition: 0 MaxSeqNo: 17 sessionId: src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0
2025-10-02T08:16:46.147549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2738399-a8f2f443-3804b99a-5a9e6772_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:46.149731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0] Write session: try to update token
2025-10-02T08:16:46.149743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:46.161451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2820 sessionId: src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:46.163748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:46.164528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.164547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.164566Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:46.164573Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:46.164575Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:46.164582Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535422980653145:2747]
2025-10-02T08:16:46.164586Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535422980653145:2747]
2025-10-02T08:16:46.164633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:46.164644Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.164647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:46.164646Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:46.164653Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:46.164779Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:46.225252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535422980653212:6916]
2025-10-02T08:16:46.225333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2819, pipe: [1:7556535422980653212:6916]
2025-10-02T08:16:46.299525Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:46.299789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:46.299827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980653212:6916], now have 1 active actors on pipe
2025-10-02T08:16:46.299827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:46.299927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:46.299938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:46.299958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2820 reason: error at write: Disconnected sessionId: src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0
2025-10-02T08:16:46.300076Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:46.300133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2820 sessionId: src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0 is DEAD
2025-10-02T08:16:46.300261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:46.300267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0] Write session will restart in 0.005729s
2025-10-02T08:16:46.300256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535422980653212:6916]
2025-10-02T08:16:46.300285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0] Write session: Do CDS request
2025-10-02T08:16:46.300293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:46.307270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.307349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:46.307365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2821
2025-10-02T08:16:46.307467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.307498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:46.307506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:46.307510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:46.307859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2821 sessionId:  describe result for acl check
2025-10-02T08:16:46.307888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:46.307893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:46.307894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:46.307898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535422980653473:2773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:46.308359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535422980653473:2773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:46.309667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535422980653473:2773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:46.310725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:46.311033Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:46.311243Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:46.311257Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:46.311269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:46.311344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:46.311378Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535422980653538:2777]
2025-10-02T08:16:46.311967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535422980653473:2773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:46.311978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535422980653473:2773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:46.311981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535422980653473:2773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:46.311988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:46.312036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:46.312234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:46.312287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:46.312602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:46.312669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.312676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.312678Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.312679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.312680Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.312686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.312696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.312705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.312713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.312717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.312723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.312730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.312741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.312746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.312751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.312756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.312761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.312766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.312771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.312776Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.312792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:46.320924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:46.322403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:46.322423Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:46.322426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:46.322430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:46.322435Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2820 [1:7556535422980653538:2777]
2025-10-02T08:16:46.322446Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:46.322461Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:46.322464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.322467Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.322469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.322484Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:46.322495Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:46.322500Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:46.322555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.322563Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.322566Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:46.322568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:46.322623Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:46.322633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.322645Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.322658Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:46.322675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980653545:2773], now have 1 active actors on pipe
2025-10-02T08:16:46.322684Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535423439887748:2378], now have 1 active actors on pipe
2025-10-02T08:16:46.322688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.322692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.322708Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535422980653532:2777]
2025-10-02T08:16:46.322715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535422980653532:2777]
2025-10-02T08:16:46.322726Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:46.322742Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:46.322746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2820
2025-10-02T08:16:46.322752Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:46.322755Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:46.322760Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:46.322764Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:46.322780Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:46.322753Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2820
2025-10-02T08:16:46.322791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.322795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.322796Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:46.322805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.322813Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:46.322841Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535422980653532:2777]
2025-10-02T08:16:46.322853Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:46.322866Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:46.322873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.322923Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.322929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.322942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.322974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2821 partition: 0 MaxSeqNo: 17 sessionId: src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0
2025-10-02T08:16:46.323294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fec671-1d9fe388-8ceebbec-a84aad05_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:46.325823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0] Write session: try to update token
2025-10-02T08:16:46.325841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:46.332971Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:46.332990Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:46.332998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535422980653532:2777]
2025-10-02T08:16:46.333037Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:46.333038Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:46.333195Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:46.333335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:46.333466Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:46.333603Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:46.333782Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:46.333824Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:46.338747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2821 sessionId: src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:46.341368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:46.341428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.341439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.341468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:46.341493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:46.341554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.341568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.341717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.341773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.341827Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.341882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.342003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.342013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.342068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.342121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.342203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.342255Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.342293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.342299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.342354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.342405Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.342465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.342519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.342560Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.342568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.342635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.342696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.342749Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.342803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.342842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.342847Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.342905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.342955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.343013Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.343078Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.343125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.343132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.343187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.343242Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.343294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.343348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.343387Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.343393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.343449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.343500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.343570Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.343629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.343668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.343674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.343728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.343779Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.343836Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.343892Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.343933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.343938Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.344011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.344066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.344122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.344173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.344281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.344290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.344354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.344407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.344460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.344513Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.344555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.344561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.344592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:46.344645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.344659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.344664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:46.344686Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:46.344700Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:46.344706Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:46.344707Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:46.344709Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:46.345072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:46.345095Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:46.345100Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:46.345102Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:46.345104Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:46.345106Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:46.345536Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:46.345558Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:46.345563Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:46.345566Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:46.345569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:46.345577Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:46.345970Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:46.345988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:46.345991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:46.345994Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:46.345996Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:46.347016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:46.347031Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:46.347039Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393006347
2025-10-02T08:16:46.347143Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:46.347153Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:46.347157Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:46.347159Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:46.347162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:46.347163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:46.347609Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:46.347630Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:46.347640Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:46.347648Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:46.347655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:46.347659Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:46.348060Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:46.348075Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:46.348081Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:46.348087Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:46.348089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:46.348091Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:46.348484Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:46.348501Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:46.348509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:46.349514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:46.349529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:46.349533Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:46.349535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:46.349540Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393006349
2025-10-02T08:16:46.349814Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:46.349830Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:46.349835Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:46.349837Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:46.349839Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:46.349841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:46.350246Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:46.350269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:46.350279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:46.350282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:46.350287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:46.350291Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:46.350696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:46.350714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.350782Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393006350
2025-10-02T08:16:46.351415Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:46.351442Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:46.351450Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:46.351457Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:46.352952Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:46.352962Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:46.352964Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:46.352972Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535422980653532:2777]
2025-10-02T08:16:46.352976Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535422980653532:2777]
2025-10-02T08:16:46.353017Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:46.353027Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:46.353031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:46.353034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.353037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:46.353149Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:46.400299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535422980653577:6916]
2025-10-02T08:16:46.400408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2820, pipe: [1:7556535422980653577:6916]
2025-10-02T08:16:46.481477Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:46.481784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980653577:6916], now have 1 active actors on pipe
2025-10-02T08:16:46.481891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535422980653577:6916]
2025-10-02T08:16:46.481913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:46.481915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:46.481939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2821 reason: error at write: Disconnected sessionId: src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0
2025-10-02T08:16:46.481968Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:46.481992Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:46.482088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2821 sessionId: src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0 is DEAD
2025-10-02T08:16:46.482244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:46.482254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0] Write session will restart in 0.006401s
2025-10-02T08:16:46.482277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0] Write session: Do CDS request
2025-10-02T08:16:46.482283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:46.490251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.490338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:46.490355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2822
2025-10-02T08:16:46.490444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:46.490456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.490478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:46.490483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:46.490486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:46.490828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2822 sessionId:  describe result for acl check
2025-10-02T08:16:46.490865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:46.490871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:46.490873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:46.490877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535422980653875:2839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:46.491332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535422980653875:2839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:46.491447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:46.491663Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:46.491677Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:46.491689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:46.491746Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:46.491780Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535422980653883:2840]
2025-10-02T08:16:46.492396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:46.492553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:46.492600Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:46.492917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:46.492978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.492986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.492987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.492990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.492991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.492996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.493005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.493009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.493012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.493016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.493022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.493029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.493035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.493040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.493045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.493050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.493054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.493060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.493072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.493081Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.493097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:46.493114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535422980653875:2839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:46.498717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535422980653875:2839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:46.498733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535422980653875:2839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:46.498736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535422980653875:2839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:46.498743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:46.500602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:46.502133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:46.502153Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:46.502156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:46.502160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:46.502166Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2821 [1:7556535422980653883:2840]
2025-10-02T08:16:46.502176Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:46.502190Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:46.502198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.502201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.502203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.502219Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:46.502228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:46.502235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:46.502289Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.502297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.502302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:46.502304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:46.502363Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:46.502371Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.502383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.502401Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:46.502421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535422980653869:2840]
2025-10-02T08:16:46.502432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535422980653869:2840]
2025-10-02T08:16:46.502438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2821
2025-10-02T08:16:46.502441Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:46.502451Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:46.502453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980653923:2839], now have 1 active actors on pipe
2025-10-02T08:16:46.502455Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:46.502459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535423439887755:2378], now have 1 active actors on pipe
2025-10-02T08:16:46.502464Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:46.502477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:46.502479Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:46.502485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.502493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.502526Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535422980653869:2840]
2025-10-02T08:16:46.502535Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:46.502541Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:46.502549Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:46.502513Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2821
2025-10-02T08:16:46.502554Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.502562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.502564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:46.502571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.502584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:46.502630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.502672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.502679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.502692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.502727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2822 partition: 0 MaxSeqNo: 17 sessionId: src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0
2025-10-02T08:16:46.503028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bec8ca1-d8cc043c-b599252c-9184bbdf_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:46.505378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0] Write session: try to update token
2025-10-02T08:16:46.505390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:46.517452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2822 sessionId: src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:46.519815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:46.520657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.520678Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.520695Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:46.520697Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:46.520699Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:46.520705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535422980653869:2840]
2025-10-02T08:16:46.520712Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535422980653869:2840]
2025-10-02T08:16:46.520750Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:46.520754Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:46.520758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.520761Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:46.520762Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:46.520904Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:46.606071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535422980653952:6916]
2025-10-02T08:16:46.609784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2821, pipe: [1:7556535422980653952:6916]
2025-10-02T08:16:46.648157Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:46.648426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:46.648470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980653952:6916], now have 1 active actors on pipe
2025-10-02T08:16:46.648504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:46.648576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:46.648584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:46.648598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2822 reason: error at write: Disconnected sessionId: src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0
2025-10-02T08:16:46.648688Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:46.648732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2822 sessionId: src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0 is DEAD
2025-10-02T08:16:46.648876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:46.648888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0] Write session will restart in 0.008874s
2025-10-02T08:16:46.648895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535422980653952:6916]
2025-10-02T08:16:46.648911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0] Write session: Do CDS request
2025-10-02T08:16:46.648918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:46.658070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:46.658841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:46.658982Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:46.658991Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:46.658999Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:46.659035Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:46.659070Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535422980654274:2920]
2025-10-02T08:16:46.659238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.659292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:46.659305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2823
2025-10-02T08:16:46.659411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.659445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:46.659454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:46.659458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:46.659750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2823 sessionId:  describe result for acl check
2025-10-02T08:16:46.659752Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:46.659772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:46.659776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:46.659777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:46.659781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535422980654279:2907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:46.659920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:46.659961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:46.660234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:46.660254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535422980654279:2907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:46.660290Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.660297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.660298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.660299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.660300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.660305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.660314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.660318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.660321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.660324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.660330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.660337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.660350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.660359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.660363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.660368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.660378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.660382Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.660386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.660389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.660400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:46.662031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535422980654279:2907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:46.667309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535422980654279:2907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:46.667325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535422980654279:2907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:46.667329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535422980654279:2907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:46.667336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:46.669010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:46.670315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:46.670331Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:46.670333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:46.670337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:46.670343Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2822 [1:7556535422980654274:2920]
2025-10-02T08:16:46.670354Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:46.670373Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:46.670380Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.670383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.670385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.670403Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:46.670413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:46.670422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:46.670475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.670481Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.670484Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:46.670487Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:46.670546Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:46.670553Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.670565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.670582Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:46.670599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2822
2025-10-02T08:16:46.670602Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535423439887783:2378], now have 1 active actors on pipe
2025-10-02T08:16:46.670605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980654323:2907], now have 1 active actors on pipe
2025-10-02T08:16:46.670611Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535422980654267:2920]
2025-10-02T08:16:46.670613Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535422980654267:2920]
2025-10-02T08:16:46.670624Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:46.670635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.670640Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:46.670643Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:46.670645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.670631Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2822
2025-10-02T08:16:46.670662Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:46.670679Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:46.670682Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:46.670721Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|498d7da-197b4804-3bf7408d-354d1d4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:46.670730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.670737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.670739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:46.670746Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.670758Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:46.670773Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535422980654267:2920]
2025-10-02T08:16:46.670783Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:46.670799Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:46.670807Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.670860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.670867Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.670878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.670906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2823 partition: 0 MaxSeqNo: 17 sessionId: src_id|498d7da-197b4804-3bf7408d-354d1d4d_0
2025-10-02T08:16:46.671218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb9e3b3-c8fbf89-1830bcbf-ecb95dc5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|498d7da-197b4804-3bf7408d-354d1d4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:46.673670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498d7da-197b4804-3bf7408d-354d1d4d_0] Write session: try to update token
2025-10-02T08:16:46.673683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498d7da-197b4804-3bf7408d-354d1d4d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:46.682197Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:46.682219Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:46.682226Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535422980654267:2920]
2025-10-02T08:16:46.682260Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:46.682262Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:46.682431Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:46.682565Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:46.682691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:46.682828Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:46.683017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:46.683061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:46.685785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2823 sessionId: src_id|498d7da-197b4804-3bf7408d-354d1d4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:46.688042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:46.688092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.688104Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.688128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:46.688147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:46.688199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.688215Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.688361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.688427Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.688530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.688598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.688752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.688763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.688850Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.688913Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.689071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.689188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.689239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.689246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.689319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.689385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.689447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.689508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.689552Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.689561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.689629Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.689695Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.689761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.689825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.689871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.689881Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.689948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.690010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.690070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.690137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.690184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.690195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.690263Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.690328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.690393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.690460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.690511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.690519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.690586Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.690645Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.690707Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.690774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.690818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.690825Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.690894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.690956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.691025Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.691093Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.691143Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.691150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.691219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.691285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.691354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.691425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.691475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.691483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.691561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:46.691630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:46.691698Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:46.691763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:46.691810Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:46.691817Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:46.691863Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:46.691935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.691958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.691965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:46.692011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:46.692029Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:46.692035Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:46.692038Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:46.692041Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:46.692455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:46.692489Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:46.692499Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:46.692503Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:46.692506Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:46.692509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:46.693185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:46.693212Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:46.693219Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:46.693222Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:46.693225Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:46.693229Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:46.693756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:46.693789Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:46.693795Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:46.693798Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:46.693801Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:46.695089Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:46.695111Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:46.695126Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393006694
2025-10-02T08:16:46.695312Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:46.695327Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:46.695333Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:46.695336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:46.695341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:46.695345Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:46.695934Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:46.695962Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:46.695968Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:46.695974Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:46.695977Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:46.695979Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:46.696389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:46.696407Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:46.696413Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:46.696417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:46.696419Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:46.696421Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:46.696848Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:46.696864Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:46.696868Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:46.697826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:46.697849Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:46.697855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:46.697858Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:46.697867Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393006697
2025-10-02T08:16:46.698162Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:46.698181Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:46.698185Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:46.698187Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:46.698190Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:46.698195Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:46.698637Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:46.698660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:46.698665Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:46.698669Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:46.698671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:46.698675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:46.699163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:46.699184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.699254Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393006698
2025-10-02T08:16:46.699915Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:46.699934Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:46.699939Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:46.699943Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:46.701424Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:46.701437Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:46.701438Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:46.701446Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535422980654267:2920]
2025-10-02T08:16:46.701450Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535422980654267:2920]
2025-10-02T08:16:46.701491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:46.701498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.701500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:46.701519Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:46.701525Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:46.701617Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:46.749007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535422980654347:6916]
2025-10-02T08:16:46.749135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2822, pipe: [1:7556535422980654347:6916]
2025-10-02T08:16:46.830174Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:46.830479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980654347:6916], now have 1 active actors on pipe
2025-10-02T08:16:46.830591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:46.830596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:46.830615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2823 reason: error at write: Disconnected sessionId: src_id|498d7da-197b4804-3bf7408d-354d1d4d_0
2025-10-02T08:16:46.830667Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:46.830771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2823 sessionId: src_id|498d7da-197b4804-3bf7408d-354d1d4d_0 is DEAD
2025-10-02T08:16:46.830767Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:46.830890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d7da-197b4804-3bf7408d-354d1d4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:46.830896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d7da-197b4804-3bf7408d-354d1d4d_0] Write session will restart in 0.008634s
2025-10-02T08:16:46.830914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d7da-197b4804-3bf7408d-354d1d4d_0] Write session: Do CDS request
2025-10-02T08:16:46.830895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535422980654347:6916]
2025-10-02T08:16:46.830919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d7da-197b4804-3bf7408d-354d1d4d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:46.840287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|498d7da-197b4804-3bf7408d-354d1d4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.840343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:46.840358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2824
2025-10-02T08:16:46.840485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:46.840498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:46.840515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:46.840523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:46.840526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:46.840878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2824 sessionId:  describe result for acl check
2025-10-02T08:16:46.840915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:46.840919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:46.840920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:46.840925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535422980654650:2927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:46.841429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535422980654650:2927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:46.841521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:46.841679Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:46.841692Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:46.841702Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:46.841756Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:46.841795Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535422980654656:2928]
2025-10-02T08:16:46.842378Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:46.842523Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:46.842565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:46.842854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:46.842907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.842913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.842914Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.842915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.842916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.842921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.842931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.842935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.842939Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.842943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.842948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.842959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:46.842965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.842974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:46.842978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.842983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:46.842987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.842993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.843012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.843021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.843039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:46.843345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535422980654650:2927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:46.849054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535422980654650:2927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:46.849068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535422980654650:2927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:46.849072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535422980654650:2927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:46.849079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:46.851161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:46.852701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:46.852717Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:46.852720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:46.852723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:46.852730Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2823 [1:7556535422980654656:2928]
2025-10-02T08:16:46.852740Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:46.852757Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:46.852759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.852762Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.852764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.852779Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:46.852784Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:46.852790Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:46.852860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.852868Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.852871Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:46.852874Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:46.852934Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:46.852940Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.852954Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:46.852967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:46.852986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535423439887790:2378], now have 1 active actors on pipe
2025-10-02T08:16:46.852996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535422980654644:2928]
2025-10-02T08:16:46.852998Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535422980654644:2928]
2025-10-02T08:16:46.853005Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:46.853016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2823
2025-10-02T08:16:46.853017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980654697:2927], now have 1 active actors on pipe
2025-10-02T08:16:46.853021Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:46.853024Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:46.853025Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:46.853042Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:46.853048Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:46.853054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.853058Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.853061Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2823
2025-10-02T08:16:46.853094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535422980654644:2928]
2025-10-02T08:16:46.853102Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:46.853103Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:46.853116Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:46.853122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:46.853125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:46.853127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:46.853135Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:46.853156Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:46.853290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.853419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.853425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.853438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:46.853471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2824 partition: 0 MaxSeqNo: 17 sessionId: src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0
2025-10-02T08:16:46.853759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|498d7da-197b4804-3bf7408d-354d1d4d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:46.856069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0] Write session: try to update token
2025-10-02T08:16:46.856083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:46.868349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2824 sessionId: src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:46.870616Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:46.870639Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:46.870640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:46.870641Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:46.870649Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535422980654644:2928]
2025-10-02T08:16:46.870654Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535422980654644:2928]
2025-10-02T08:16:46.870692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:46.870693Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:46.870697Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:46.870702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:46.870720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:46.870727Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:46.870732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:46.870860Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:46.931267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535422980654714:6916]
2025-10-02T08:16:46.931398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2823, pipe: [1:7556535422980654714:6916]
2025-10-02T08:16:47.004843Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:47.005154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535422980654714:6916], now have 1 active actors on pipe
2025-10-02T08:16:47.005291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:47.005302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:47.005350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2824 reason: error at write: Disconnected sessionId: src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0
2025-10-02T08:16:47.005361Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:47.005389Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:47.005505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2824 sessionId: src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0 is DEAD
2025-10-02T08:16:47.005654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:47.005666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0] Write session will restart in 0.008273s
2025-10-02T08:16:47.005642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535422980654714:6916]
2025-10-02T08:16:47.005691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0] Write session: Do CDS request
2025-10-02T08:16:47.005696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:47.013588Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:47.014393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:47.014541Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:47.014551Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:47.014561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:47.014607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:47.014641Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535427275622315:2949]
2025-10-02T08:16:47.015185Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:47.015303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.015358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:47.015370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:47.015374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2825
2025-10-02T08:16:47.015399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:47.015473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.015498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:47.015501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:47.015504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:47.015657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:47.015701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.015706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.015708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.015709Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.015710Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.015714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.015721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.015724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.015728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.015731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.015736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.015748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.015758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.015760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2825 sessionId:  describe result for acl check
2025-10-02T08:16:47.015766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.015770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.015775Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.015777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:47.015779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:47.015780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:47.015783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.015785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535427275622327:2946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:47.015787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.015792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.015796Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.015812Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:47.016158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535427275622327:2946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:47.017702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535427275622327:2946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:47.022549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535427275622327:2946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:47.022560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535427275622327:2946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:47.022562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535427275622327:2946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:47.022568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:47.026358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:47.027908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:47.027926Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:47.027928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:47.027931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:47.027936Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2824 [1:7556535427275622315:2949]
2025-10-02T08:16:47.027947Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:47.027962Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:47.027964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.027967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.027969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.027985Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:47.027998Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:47.028004Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:47.028060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.028069Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.028072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:47.028074Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:47.028123Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:47.028129Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.028137Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.028144Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:47.028155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275622374:2946], now have 1 active actors on pipe
2025-10-02T08:16:47.028161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2824
2025-10-02T08:16:47.028163Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535427275622309:2949]
2025-10-02T08:16:47.028166Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535427275622309:2949]
2025-10-02T08:16:47.028171Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:47.028179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535427734855095:2378], now have 1 active actors on pipe
2025-10-02T08:16:47.028181Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:47.028183Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:47.028184Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:47.028192Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:47.028194Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:47.028199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.028201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.028229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535427275622309:2949]
2025-10-02T08:16:47.028239Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:47.028250Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:47.028258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.028261Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.028260Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:47.028263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:47.028270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.028276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:47.028238Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2824
2025-10-02T08:16:47.028306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.028370Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.028377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.028390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.028418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2825 partition: 0 MaxSeqNo: 17 sessionId: src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0
2025-10-02T08:16:47.028703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceec2ca8-180b710e-d6c1a5cd-db99d14f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:47.030884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0] Write session: try to update token
2025-10-02T08:16:47.030895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:47.042162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2825 sessionId: src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:47.044217Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:47.044232Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:47.044234Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:47.044239Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535427275622309:2949]
2025-10-02T08:16:47.044243Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535427275622309:2949]
2025-10-02T08:16:47.044274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:47.044277Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:47.044279Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.044281Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:47.044282Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:47.044305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:47.044399Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:47.105856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535427275622389:6916]
2025-10-02T08:16:47.105970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2824, pipe: [1:7556535427275622389:6916]
2025-10-02T08:16:47.165917Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:47.166193Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.166204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.166233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275622389:6916], now have 1 active actors on pipe
2025-10-02T08:16:47.166323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:47.166328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:47.166366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2825 reason: error at write: Disconnected sessionId: src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0
2025-10-02T08:16:47.166395Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:47.166446Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:47.166519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2825 sessionId: src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0 is DEAD
2025-10-02T08:16:47.166652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535427275622389:6916]
2025-10-02T08:16:47.166671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:47.166688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0] Write session will restart in 0.008617s
2025-10-02T08:16:47.166710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0] Write session: Do CDS request
2025-10-02T08:16:47.166717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:47.176304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.176344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:47.176357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2826
2025-10-02T08:16:47.176523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.176540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:47.176564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:47.176573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:47.176577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:47.176929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2826 sessionId:  describe result for acl check
2025-10-02T08:16:47.176959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:47.176976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:47.176982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:47.176986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535427275622696:3055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:47.177428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535427275622696:3055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:47.177703Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:47.177823Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:47.177830Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:47.177836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:47.177867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:47.177892Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535427275622703:3042]
2025-10-02T08:16:47.178266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:47.178376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:47.178403Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:47.178578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:47.178605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.178609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.178610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.178610Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.178611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.178613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.178619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.178621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.178623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.178625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.178628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.178632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.178635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.178639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.178641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.178644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.178646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.178648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.178650Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.178653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.178692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:47.179137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535427275622696:3055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:47.184624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535427275622696:3055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:47.184640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535427275622696:3055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:47.184655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535427275622696:3055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:47.184662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:47.185982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:47.187427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:47.187440Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:47.187442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:47.187444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:47.187448Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2825 [1:7556535427275622703:3042]
2025-10-02T08:16:47.187455Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:47.187467Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:47.187468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.187470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.187472Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.187484Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:47.187488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:47.187492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:47.187536Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.187537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.187540Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:47.187541Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:47.187584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:47.187590Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.187598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.187605Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:47.187616Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535427275622690:3042]
2025-10-02T08:16:47.187617Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535427275622690:3042]
2025-10-02T08:16:47.187623Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:47.187634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275622744:3055], now have 1 active actors on pipe
2025-10-02T08:16:47.187646Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:47.187647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2825
2025-10-02T08:16:47.187648Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:47.187650Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:47.187659Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:47.187661Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:47.187666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535427734855113:2378], now have 1 active actors on pipe
2025-10-02T08:16:47.187689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.187696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.187705Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535427275622690:3042]
2025-10-02T08:16:47.187707Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:47.187714Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:47.187722Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:47.187726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.187729Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.187730Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:47.187736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.187742Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:47.187712Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2825
2025-10-02T08:16:47.187761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.187793Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.187798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.187806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.187829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2826 partition: 0 MaxSeqNo: 17 sessionId: src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0
2025-10-02T08:16:47.188109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a66e9d-af14f94a-b7702376-97c05a8d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:47.190498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0] Write session: try to update token
2025-10-02T08:16:47.190512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:47.202912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2826 sessionId: src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:47.204927Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:47.204942Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:47.204944Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:47.204952Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535427275622690:3042]
2025-10-02T08:16:47.204956Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535427275622690:3042]
2025-10-02T08:16:47.205000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:47.205001Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:47.205006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:47.205013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.205015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:47.205150Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:47.205367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:47.266644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535427275622758:6916]
2025-10-02T08:16:47.266769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2825, pipe: [1:7556535427275622758:6916]
2025-10-02T08:16:47.334203Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:47.334562Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.334578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.334612Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275622758:6916], now have 1 active actors on pipe
2025-10-02T08:16:47.334698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535427275622758:6916]
2025-10-02T08:16:47.334714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:47.334716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:47.334755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2826 reason: error at write: Disconnected sessionId: src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0
2025-10-02T08:16:47.334825Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:47.334841Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:47.334893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2826 sessionId: src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0 is DEAD
2025-10-02T08:16:47.335035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:47.335047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0] Write session will restart in 0.006531s
2025-10-02T08:16:47.335072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0] Write session: Do CDS request
2025-10-02T08:16:47.335079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:47.342272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.342316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:47.342332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2827
2025-10-02T08:16:47.342471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.342506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:47.342515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:47.342519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:47.342887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2827 sessionId:  describe result for acl check
2025-10-02T08:16:47.342920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:47.342926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:47.342928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:47.342932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535427275623046:3088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:47.343384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535427275623046:3088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:47.344248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:47.345163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535427275623046:3088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:47.345264Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:47.345383Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:47.345390Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:47.345397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:47.345428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:47.345451Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535427275623091:3090]
2025-10-02T08:16:47.345858Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:47.346008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:47.346032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:47.346214Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:47.346239Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.346243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.346244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.346244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.346245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.346248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.346253Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.346255Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.346257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.346259Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.346262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.346266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.346269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.346272Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.346274Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.346277Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.346279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.346282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.346285Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.346288Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.346297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:47.350746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535427275623046:3088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:47.350758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535427275623046:3088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:47.350761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535427275623046:3088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:47.350767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:47.353532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:47.354807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:47.354819Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:47.354821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:47.354823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:47.354828Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2826 [1:7556535427275623091:3090]
2025-10-02T08:16:47.354836Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:47.354847Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:47.354848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.354850Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.354851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.354863Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:47.354866Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:47.354871Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:47.354911Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.354918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.354920Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:47.354922Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:47.354966Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:47.354971Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.354978Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.354985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:47.354996Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535427275623073:3090]
2025-10-02T08:16:47.355001Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535427275623073:3090]
2025-10-02T08:16:47.355008Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:47.355017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:47.355027Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:47.355029Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:47.355030Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:47.355032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:47.355037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275623113:3088], now have 1 active actors on pipe
2025-10-02T08:16:47.355044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2826
2025-10-02T08:16:47.355055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535427734855122:2378], now have 1 active actors on pipe
2025-10-02T08:16:47.355060Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535427275623073:3090]
2025-10-02T08:16:47.355063Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:47.355067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.355070Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.355073Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:47.355097Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:47.355105Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.355108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.355110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:47.355115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.355121Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:47.355089Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2826
2025-10-02T08:16:47.355136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.355181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.355186Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.355196Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.355220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2827 partition: 0 MaxSeqNo: 17 sessionId: src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0
2025-10-02T08:16:47.355487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc4b1b8a-ad623fdb-6b65b181-2d57bf1b_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:47.358097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0] Write session: try to update token
2025-10-02T08:16:47.358110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:47.371329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2827 sessionId: src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:47.371492Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:47.371506Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:47.371508Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:47.371516Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535427275623073:3090]
2025-10-02T08:16:47.371519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535427275623073:3090]
2025-10-02T08:16:47.371558Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:47.371568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.371572Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:47.371646Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:47.371662Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:47.371714Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:47.373554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:47.435079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535427275623127:6916]
2025-10-02T08:16:47.435187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2826, pipe: [1:7556535427275623127:6916]
2025-10-02T08:16:47.493031Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:47.493269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.493279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.493309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275623127:6916], now have 1 active actors on pipe
2025-10-02T08:16:47.493425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:47.493436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:47.493485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2827 reason: error at write: Disconnected sessionId: src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0
2025-10-02T08:16:47.493511Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:47.493553Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:47.493623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2827 sessionId: src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0 is DEAD
2025-10-02T08:16:47.493743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:47.493751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0] Write session will restart in 0.007630s
2025-10-02T08:16:47.493773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0] Write session: Do CDS request
2025-10-02T08:16:47.493779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:47.493785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535427275623127:6916]
2025-10-02T08:16:47.502176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.502309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:47.502322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2828
2025-10-02T08:16:47.502424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.502454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:47.502457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:47.502460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:47.502750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2828 sessionId:  describe result for acl check
2025-10-02T08:16:47.502773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:47.502774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:47.502775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:47.502778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535427275623432:3096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:47.502819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:47.503159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535427275623432:3096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:47.504099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:47.504239Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:47.504246Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:47.504252Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:47.504286Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:47.504309Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535427275623454:3105]
2025-10-02T08:16:47.504688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:47.504880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:47.504928Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:47.505139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535427275623432:3096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:47.505280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:47.505341Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.505346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.505347Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.505348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.505349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.505354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.505363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.505367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.505370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.505376Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.505381Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.505389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.505396Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.505402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.505406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.505415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.505419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.505423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.505427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.505431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.505453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:47.511258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535427275623432:3096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:47.511274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535427275623432:3096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:47.511278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535427275623432:3096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:47.511285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:47.513130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:47.514607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:47.514620Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:47.514621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:47.514623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:47.514627Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2827 [1:7556535427275623454:3105]
2025-10-02T08:16:47.514640Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:47.514655Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:47.514661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.514664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.514666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.514682Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:47.514690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:47.514697Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:47.514741Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.514745Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.514747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:47.514749Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:47.514811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:47.514819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.514831Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.514843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:47.514863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2827
2025-10-02T08:16:47.514864Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275623484:3096], now have 1 active actors on pipe
2025-10-02T08:16:47.514868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535427734855129:2378], now have 1 active actors on pipe
2025-10-02T08:16:47.514871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.514874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.514886Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535427275623431:3105]
2025-10-02T08:16:47.514887Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535427275623431:3105]
2025-10-02T08:16:47.514895Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:47.514909Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:47.514914Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:47.514917Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:47.514919Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:47.514921Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:47.514930Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:47.514898Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2827
2025-10-02T08:16:47.514938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.514940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.514941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:47.514946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.514952Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:47.514981Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535427275623431:3105]
2025-10-02T08:16:47.514994Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:47.515001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:47.515011Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.515066Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.515072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.515084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.515118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2828 partition: 0 MaxSeqNo: 17 sessionId: src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0
2025-10-02T08:16:47.515453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e42abd-4f99b26-bc48a300-6b9a2ceb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:47.517969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0] Write session: try to update token
2025-10-02T08:16:47.517984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:47.531218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2828 sessionId: src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:47.531387Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:47.531404Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:47.531411Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535427275623431:3105]
2025-10-02T08:16:47.531450Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:47.531456Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:47.531618Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:47.531751Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:47.531882Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:47.532023Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:47.532212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:47.532251Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:47.533346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:47.533434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.533449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.533480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:47.533506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:47.533558Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.533567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.533694Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.533746Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.533799Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.533855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.533896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.533902Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.533958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.534010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.534064Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.534121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.534159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.534164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.534219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.534268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.534321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.534375Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.534415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.534421Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.534486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.534537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.534587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.534637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.534675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.534679Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.534734Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.534784Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.534837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.534891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.534929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.534934Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.534987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.535038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.535089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.535141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.535179Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.535184Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.535238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.535288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.535343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.535398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.535436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.535441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.535493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.535542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.535592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.535643Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.535681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.535687Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.535741Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.535792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.535842Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.535891Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.535928Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.535932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.535985Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:47.536050Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:47.536114Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:47.536163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:47.536201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:47.536206Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:47.536231Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:47.536280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.536296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.536301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:47.536323Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:47.536335Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:47.536339Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:47.536341Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:47.536343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:47.536652Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:47.536670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:47.536677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:47.536679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:47.536681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:47.536684Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:47.537144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:47.537163Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:47.537170Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:47.537172Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:47.537175Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:47.537217Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:47.537635Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:47.537655Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:47.537663Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:47.537668Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:47.537670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:47.539409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:47.539425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:47.539434Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393007538
2025-10-02T08:16:47.539559Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:47.539579Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:47.539585Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:47.539587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:47.539590Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:47.539592Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:47.539966Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:47.539982Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:47.539985Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:47.539987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:47.540000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:47.540004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:47.540372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:47.540391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:47.540396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:47.540398Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:47.540400Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:47.540402Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:47.540769Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:47.540784Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:47.540787Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:47.541670Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:47.541683Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:47.541689Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:47.541692Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:47.541696Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393007541
2025-10-02T08:16:47.541930Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:47.541944Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:47.541948Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:47.541953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:47.541956Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:47.541958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:47.542330Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:47.542347Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:47.542350Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:47.542353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:47.542355Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:47.542359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:47.542744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:47.542758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.542824Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393007542
2025-10-02T08:16:47.543410Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:47.543427Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:47.543432Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:47.543440Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:47.544792Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:47.544812Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:47.544813Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:47.544819Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535427275623431:3105]
2025-10-02T08:16:47.544821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535427275623431:3105]
2025-10-02T08:16:47.544859Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:47.544860Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:47.544862Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.544864Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:47.544870Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:47.544971Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:47.593807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535427275623508:6916]
2025-10-02T08:16:47.593938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2827, pipe: [1:7556535427275623508:6916]
2025-10-02T08:16:47.678897Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:47.679192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275623508:6916], now have 1 active actors on pipe
2025-10-02T08:16:47.679399Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:47.679416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:47.679419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:47.679448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2828 reason: error at write: Disconnected sessionId: src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0
2025-10-02T08:16:47.679453Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:47.679591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2828 sessionId: src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0 is DEAD
2025-10-02T08:16:47.679719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535427275623508:6916]
2025-10-02T08:16:47.679754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:47.679765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0] Write session will restart in 0.008376s
2025-10-02T08:16:47.679787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0] Write session: Do CDS request
2025-10-02T08:16:47.679793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:47.689155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:47.689216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.689263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:47.689275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2829
2025-10-02T08:16:47.689400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.689431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:47.689441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:47.689447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:47.689797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2829 sessionId:  describe result for acl check
2025-10-02T08:16:47.689830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:47.689835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:47.689836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:47.689840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535427275623858:3207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:47.690079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:47.690181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535427275623858:3207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:47.690188Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:47.690190Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:47.690195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:47.690222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:47.690248Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535427275623861:3190]
2025-10-02T08:16:47.690631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:47.690777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:47.690815Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:47.691005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:47.691032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.691036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.691037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.691037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.691038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.691041Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.691047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.691049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.691051Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.691052Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.691055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.691060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.691067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.691069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.691072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.691074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.691080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.691082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.691084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.691087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.691100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:47.691549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535427275623858:3207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:47.696866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535427275623858:3207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:47.696878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535427275623858:3207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:47.696880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535427275623858:3207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:47.696886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:47.698279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:47.699737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:47.699752Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:47.699753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:47.699755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:47.699759Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2828 [1:7556535427275623861:3190]
2025-10-02T08:16:47.699767Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:47.699777Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:47.699779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.699781Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.699782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.699792Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:47.699795Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:47.699799Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:47.699834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.699841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.699844Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:47.699846Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:47.699885Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:47.699890Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.699898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.699905Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:47.699916Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535427275623851:3190]
2025-10-02T08:16:47.699922Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535427275623851:3190]
2025-10-02T08:16:47.699928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2828
2025-10-02T08:16:47.699929Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:47.699937Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:47.699940Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:47.699940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275623903:3207], now have 1 active actors on pipe
2025-10-02T08:16:47.699947Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:47.699962Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:47.699968Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:47.699973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535427734855158:2378], now have 1 active actors on pipe
2025-10-02T08:16:47.699978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.699983Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.699980Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2828
2025-10-02T08:16:47.700023Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535427275623851:3190]
2025-10-02T08:16:47.700029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:47.700032Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:47.700040Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:47.700043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.700046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.700047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:47.700054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.700059Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:47.700084Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.700149Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.700154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.700163Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.700186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2829 partition: 0 MaxSeqNo: 17 sessionId: src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0
2025-10-02T08:16:47.700454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1af1623-da6a7be4-f75e8aa4-2d774f13_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:47.702637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0] Write session: try to update token
2025-10-02T08:16:47.702648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:47.714195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2829 sessionId: src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:47.716377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:47.716708Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.716726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.716742Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:47.716747Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:47.716749Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:47.716754Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535427275623851:3190]
2025-10-02T08:16:47.716757Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535427275623851:3190]
2025-10-02T08:16:47.716785Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:47.716794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:47.716795Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:47.716797Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.716812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:47.716922Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:47.779627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535427275623921:6916]
2025-10-02T08:16:47.779719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2828, pipe: [1:7556535427275623921:6916]
2025-10-02T08:16:47.840449Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:47.840714Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:47.840753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:47.840759Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275623921:6916], now have 1 active actors on pipe
2025-10-02T08:16:47.840856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:47.840863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:47.840881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2829 reason: error at write: Disconnected sessionId: src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0
2025-10-02T08:16:47.840962Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:47.841012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2829 sessionId: src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0 is DEAD
2025-10-02T08:16:47.841152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:47.841159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0] Write session will restart in 0.008931s
2025-10-02T08:16:47.841181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0] Write session: Do CDS request
2025-10-02T08:16:47.841166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535427275623921:6916]
2025-10-02T08:16:47.841188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:47.849974Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:47.850998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:47.851156Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:47.851163Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:47.851173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:47.851222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.851221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:47.851251Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535427275624233:3237]
2025-10-02T08:16:47.851325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:47.851335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2830
2025-10-02T08:16:47.851440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:47.851460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:47.851467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:47.851469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:47.851703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2830 sessionId:  describe result for acl check
2025-10-02T08:16:47.851723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:47.851727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:47.851728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:47.851731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535427275624238:3234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:47.851778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:47.851935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:47.851972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:47.852067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535427275624238:3234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:47.852248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:47.852287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.852292Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.852293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.852294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.852295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.852299Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.852307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.852310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.852313Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.852316Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.852320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.852327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:47.852332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.852336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:47.852344Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.852348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:47.852352Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.852356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.852360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.852368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.852385Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:47.853770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535427275624238:3234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:47.859236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535427275624238:3234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:47.859249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535427275624238:3234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:47.859251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535427275624238:3234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:47.859257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:47.859789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:47.861246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:47.861258Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:47.861260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:47.861262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:47.861266Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2829 [1:7556535427275624233:3237]
2025-10-02T08:16:47.861273Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:47.861284Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:47.861285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.861288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.861289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.861301Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:47.861304Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:47.861309Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:47.861345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.861352Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.861354Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:47.861356Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:47.861402Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:47.861410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.861421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:47.861431Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:47.861447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275624281:3234], now have 1 active actors on pipe
2025-10-02T08:16:47.861448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2829
2025-10-02T08:16:47.861453Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535427275624227:3237]
2025-10-02T08:16:47.861454Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535427275624227:3237]
2025-10-02T08:16:47.861460Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:47.861467Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:47.861469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535427734855165:2378], now have 1 active actors on pipe
2025-10-02T08:16:47.861474Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:47.861476Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:47.861485Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:47.861488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:47.861493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.861497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.861534Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535427275624227:3237]
2025-10-02T08:16:47.861543Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:47.861547Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:47.861527Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2829
2025-10-02T08:16:47.861556Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fccaddc-d019266f-357a662e-895ae7f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:47.861565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:47.861569Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:47.861570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:47.861579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:47.861587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:47.861620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.861663Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:47.861676Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:47.861696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:47.861732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2830 partition: 0 MaxSeqNo: 17 sessionId: src_id|4fccaddc-d019266f-357a662e-895ae7f7_0
2025-10-02T08:16:47.862030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359ef3a-6e4625bd-a570fa7-e68225ef_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|4fccaddc-d019266f-357a662e-895ae7f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:47.864422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fccaddc-d019266f-357a662e-895ae7f7_0] Write session: try to update token
2025-10-02T08:16:47.864439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fccaddc-d019266f-357a662e-895ae7f7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:47.877776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2830 sessionId: src_id|4fccaddc-d019266f-357a662e-895ae7f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:47.877951Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:47.877969Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:47.877972Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:47.877980Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535427275624227:3237]
2025-10-02T08:16:47.877984Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535427275624227:3237]
2025-10-02T08:16:47.878024Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:47.878034Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:47.878036Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:47.878080Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:47.878094Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:47.878172Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:47.880069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:47.941455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535427275624299:6916]
2025-10-02T08:16:47.941525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2829, pipe: [1:7556535427275624299:6916]
2025-10-02T08:16:48.004255Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:48.004534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.004547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.004577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535427275624299:6916], now have 1 active actors on pipe
2025-10-02T08:16:48.004674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:48.004687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:48.004735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2830 reason: error at write: Disconnected sessionId: src_id|4fccaddc-d019266f-357a662e-895ae7f7_0
2025-10-02T08:16:48.004741Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:48.004855Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:48.004900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2830 sessionId: src_id|4fccaddc-d019266f-357a662e-895ae7f7_0 is DEAD
2025-10-02T08:16:48.004958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535427275624299:6916]
2025-10-02T08:16:48.005036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fccaddc-d019266f-357a662e-895ae7f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:48.005044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fccaddc-d019266f-357a662e-895ae7f7_0] Write session will restart in 0.007617s
2025-10-02T08:16:48.005063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fccaddc-d019266f-357a662e-895ae7f7_0] Write session: Do CDS request
2025-10-02T08:16:48.005067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fccaddc-d019266f-357a662e-895ae7f7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:48.013139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fccaddc-d019266f-357a662e-895ae7f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.013227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:48.013242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2831
2025-10-02T08:16:48.013354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:48.013369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.013385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:48.013391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:48.013394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:48.013665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2831 sessionId:  describe result for acl check
2025-10-02T08:16:48.013693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:48.013699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:48.013701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:48.013705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535431570591911:3291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:48.014086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535431570591911:3291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:48.014412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:48.014524Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:48.014530Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:48.014536Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:48.014565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:48.014589Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535431570591918:3285]
2025-10-02T08:16:48.014960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:48.015100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:48.015125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:48.015349Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:48.015399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.015404Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.015405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.015406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.015406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.015409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.015415Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.015417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.015419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.015421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.015424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.015428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.015431Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.015434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.015436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.015439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.015441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.015443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.015446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.015448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.015458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:48.015776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535431570591911:3291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:48.020669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535431570591911:3291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:48.020685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535431570591911:3291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:48.020687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535431570591911:3291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:48.020694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:48.022637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:48.024170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:48.024182Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:48.024184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:48.024186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:48.024190Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2830 [1:7556535431570591918:3285]
2025-10-02T08:16:48.024199Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:48.024210Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:48.024215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.024218Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.024219Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.024231Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:48.024235Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:48.024241Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:48.024292Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.024300Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.024303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:48.024305Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:48.024355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:48.024361Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.024368Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.024375Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:48.024390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570591970:3291], now have 1 active actors on pipe
2025-10-02T08:16:48.024401Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535431570591904:3285]
2025-10-02T08:16:48.024403Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535431570591904:3285]
2025-10-02T08:16:48.024409Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:48.024408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2830
2025-10-02T08:16:48.024418Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535432029822470:2378], now have 1 active actors on pipe
2025-10-02T08:16:48.024419Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:48.024422Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:48.024422Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:48.024433Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:48.024435Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:48.024441Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.024444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.024475Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535431570591904:3285]
2025-10-02T08:16:48.024487Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:48.024497Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:48.024504Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:48.024483Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2830
2025-10-02T08:16:48.024513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.024518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.024520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:48.024528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.024535Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:48.024566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.024610Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.024617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.024628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.024660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2831 partition: 0 MaxSeqNo: 17 sessionId: src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0
2025-10-02T08:16:48.024985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fccaddc-d019266f-357a662e-895ae7f7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:48.027272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0] Write session: try to update token
2025-10-02T08:16:48.027285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:48.040259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2831 sessionId: src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:48.041097Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:48.041111Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:48.041114Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:48.041121Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535431570591904:3285]
2025-10-02T08:16:48.041125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535431570591904:3285]
2025-10-02T08:16:48.041164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:48.041172Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.041174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:48.041255Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:48.041268Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:48.041292Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:48.042565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:48.105282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535431570591992:6916]
2025-10-02T08:16:48.105374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2830, pipe: [1:7556535431570591992:6916]
2025-10-02T08:16:48.131402Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-02T08:16:48.131429Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-02T08:16:48.170090Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:48.170321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.170333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.170363Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570591992:6916], now have 1 active actors on pipe
2025-10-02T08:16:48.170437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:48.170448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:48.170491Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:48.170503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2831 reason: error at write: Disconnected sessionId: src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0
2025-10-02T08:16:48.170564Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:48.170583Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-02T08:16:48.170670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2831 sessionId: src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0 is DEAD
2025-10-02T08:16:48.170724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535431570591992:6916]
2025-10-02T08:16:48.170808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:48.170816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0] Write session will restart in 0.006899s
2025-10-02T08:16:48.170835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0] Write session: Do CDS request
2025-10-02T08:16:48.170839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:48.179186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.179296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:48.179312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2832
2025-10-02T08:16:48.179400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.179427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:48.179436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:48.179439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:48.179796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2832 sessionId:  describe result for acl check
2025-10-02T08:16:48.179822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:48.179824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:48.179827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:48.179831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535431570592299:3314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:48.180308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535431570592299:3314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:48.180472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:48.181636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:48.181812Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:48.181822Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:48.181831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:48.181882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:48.181918Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535431570592332:3325]
2025-10-02T08:16:48.182297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535431570592299:3314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:48.182522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:48.182689Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:48.182730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:48.183032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:48.183073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.183078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.183079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.183080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.183082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.183087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.183096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.183103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.183107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.183116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.183120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.183126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.183131Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.183140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.183144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.183148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.183157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.183161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.183169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.183173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.183193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:48.187686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535431570592299:3314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:48.187701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535431570592299:3314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:48.187704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535431570592299:3314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:48.187711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:48.190864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:48.192441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:48.192456Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:48.192458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:48.192461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:48.192466Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2831 [1:7556535431570592332:3325]
2025-10-02T08:16:48.192477Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:48.192491Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:48.192498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.192501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.192502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.192516Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:48.192525Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:48.192535Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:48.192592Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.192599Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.192602Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:48.192604Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:48.192656Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:48.192664Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.192676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.192692Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:48.192711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570592360:3314], now have 1 active actors on pipe
2025-10-02T08:16:48.192719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535432029822510:2378], now have 1 active actors on pipe
2025-10-02T08:16:48.192724Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535431570592310:3325]
2025-10-02T08:16:48.192729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2831
2025-10-02T08:16:48.192730Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535431570592310:3325]
2025-10-02T08:16:48.192737Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:48.192744Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:48.192747Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:48.192753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:48.192770Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:48.192777Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:48.192783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.192795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.192783Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2831
2025-10-02T08:16:48.192847Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535431570592310:3325]
2025-10-02T08:16:48.192855Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:48.192878Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:48.192887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.192890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.192892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:48.192900Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.192909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:48.192952Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:48.192953Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.193008Z node 1 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 28472705 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-02T08:16:48.193034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.193040Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.193051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.193077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2832 partition: 0 MaxSeqNo: 17 sessionId: src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0
2025-10-02T08:16:48.193190Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 24 DataSize: 28472705 UsedReserveSize: 0
2025-10-02T08:16:48.193239Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-02T08:16:48.193336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71079d3c-f29b97f4-7b90933d-c71dfb1d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:48.195520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0] Write session: try to update token
2025-10-02T08:16:48.195531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:48.207300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2832 sessionId: src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:48.209479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:48.209908Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.209931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.209950Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:48.209958Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:48.209960Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:48.209968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535431570592310:3325]
2025-10-02T08:16:48.209971Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535431570592310:3325]
2025-10-02T08:16:48.210010Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:48.210016Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:48.210020Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.210022Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:48.210023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:48.210141Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:48.270684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535431570592376:6916]
2025-10-02T08:16:48.270820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2831, pipe: [1:7556535431570592376:6916]
2025-10-02T08:16:48.332059Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:48.332419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:48.332453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:48.332459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570592376:6916], now have 1 active actors on pipe
2025-10-02T08:16:48.332550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:48.332558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:48.332577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2832 reason: error at write: Disconnected sessionId: src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0
2025-10-02T08:16:48.332648Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:48.332730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2832 sessionId: src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0 is DEAD
2025-10-02T08:16:48.332876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:48.332887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0] Write session will restart in 0.005616s
2025-10-02T08:16:48.332912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0] Write session: Do CDS request
2025-10-02T08:16:48.332918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:48.332923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535431570592376:6916]
2025-10-02T08:16:48.339242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.339269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:48.339282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2833
2025-10-02T08:16:48.339430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.339467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:48.339476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:48.339479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:48.339784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2833 sessionId:  describe result for acl check
2025-10-02T08:16:48.339805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:48.339807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:48.339807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:48.339810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535431570592631:3372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:48.340153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535431570592631:3372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:48.342466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535431570592631:3372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:48.342718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:48.343863Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:48.344016Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:48.344024Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:48.344032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:48.344064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:48.344094Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535431570592728:3353]
2025-10-02T08:16:48.344646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:48.344827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:48.344865Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:48.345124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535431570592631:3372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:48.345135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:48.345138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535431570592631:3372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:48.345141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535431570592631:3372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:48.345149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:48.345164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.345171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.345172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.345173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.345174Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.345179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.345187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.345195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.345199Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.345206Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.345211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.345221Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.345230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.345234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.345240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.345248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.345256Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.345260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.345268Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.345273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.345295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:48.352930Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:48.354456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:48.354474Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:48.354476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:48.354479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:48.354485Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2832 [1:7556535431570592728:3353]
2025-10-02T08:16:48.354495Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:48.354510Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:48.354513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.354516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.354517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.354531Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:48.354537Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:48.354543Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:48.354595Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.354603Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.354606Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:48.354608Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:48.354662Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:48.354669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.354680Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.354691Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:48.354706Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570592741:3372], now have 1 active actors on pipe
2025-10-02T08:16:48.354718Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535431570592713:3353]
2025-10-02T08:16:48.354720Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535431570592713:3353]
2025-10-02T08:16:48.354727Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:48.354737Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:48.354738Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:48.354738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2832
2025-10-02T08:16:48.354741Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:48.354750Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:48.354753Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:48.354758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535432029822521:2378], now have 1 active actors on pipe
2025-10-02T08:16:48.354763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.354766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.354795Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535431570592713:3353]
2025-10-02T08:16:48.354802Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:48.354815Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|565a9a4-af071cdd-fc378f77-41b110f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:48.354818Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:48.354826Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.354834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.354835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:48.354843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.354807Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2832
2025-10-02T08:16:48.354850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:48.354886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.354929Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.354935Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.354946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.354979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2833 partition: 0 MaxSeqNo: 17 sessionId: src_id|565a9a4-af071cdd-fc378f77-41b110f1_0
2025-10-02T08:16:48.355283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cd2339-da699e77-fc33f2cc-d62269f2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|565a9a4-af071cdd-fc378f77-41b110f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:48.357819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565a9a4-af071cdd-fc378f77-41b110f1_0] Write session: try to update token
2025-10-02T08:16:48.357837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565a9a4-af071cdd-fc378f77-41b110f1_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:48.370621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2833 sessionId: src_id|565a9a4-af071cdd-fc378f77-41b110f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:48.371814Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:48.371830Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:48.371832Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:48.371838Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535431570592713:3353]
2025-10-02T08:16:48.371842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535431570592713:3353]
2025-10-02T08:16:48.371881Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:48.371884Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:48.371888Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:48.371893Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.371898Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:48.372029Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:48.372978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:48.432961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535431570592760:6916]
2025-10-02T08:16:48.433054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2832, pipe: [1:7556535431570592760:6916]
2025-10-02T08:16:48.494432Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:48.494803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.494819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.494853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570592760:6916], now have 1 active actors on pipe
2025-10-02T08:16:48.494948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:48.494955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:48.494992Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:48.494996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2833 reason: error at write: Disconnected sessionId: src_id|565a9a4-af071cdd-fc378f77-41b110f1_0
2025-10-02T08:16:48.495048Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:48.495175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2833 sessionId: src_id|565a9a4-af071cdd-fc378f77-41b110f1_0 is DEAD
2025-10-02T08:16:48.495203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535431570592760:6916]
2025-10-02T08:16:48.495318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565a9a4-af071cdd-fc378f77-41b110f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:48.495328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565a9a4-af071cdd-fc378f77-41b110f1_0] Write session will restart in 0.007782s
2025-10-02T08:16:48.495345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565a9a4-af071cdd-fc378f77-41b110f1_0] Write session: Do CDS request
2025-10-02T08:16:48.495350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565a9a4-af071cdd-fc378f77-41b110f1_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:48.504295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565a9a4-af071cdd-fc378f77-41b110f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.504370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:48.504388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2834
2025-10-02T08:16:48.504469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.504490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:48.504497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:48.504500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:48.504851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2834 sessionId:  describe result for acl check
2025-10-02T08:16:48.504878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:48.504884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:48.504885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:48.504890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535431570593076:3378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:48.505055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:48.505280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535431570593076:3378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:48.506138Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:48.506300Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:48.506310Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:48.506320Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:48.506358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:48.506381Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535431570593101:3363]
2025-10-02T08:16:48.506838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535431570593076:3378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:48.506961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:48.507116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:48.507150Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:48.507418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:48.507455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.507460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.507461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.507462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.507463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.507469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.507477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.507485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.507489Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.507496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.507501Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.507510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.507520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.507528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.507535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.507542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.507550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.507555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.507559Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.507567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.507585Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:48.512293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535431570593076:3378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:48.512310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535431570593076:3378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:48.512313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535431570593076:3378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:48.512321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:48.515370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:48.517481Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2833
2025-10-02T08:16:48.517149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:48.517166Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:48.517169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:48.517172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:48.517178Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2833 [1:7556535431570593101:3363]
2025-10-02T08:16:48.517190Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:48.517203Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:48.517206Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.517208Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.517210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.517224Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:48.517228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:48.517233Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:48.517277Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.517278Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.517282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:48.517283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:48.517333Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:48.517335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.517346Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.517357Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:48.517371Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535431570593077:3363]
2025-10-02T08:16:48.517373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535431570593077:3363]
2025-10-02T08:16:48.517379Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:48.517392Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:48.517398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:48.517401Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:48.517402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2833
2025-10-02T08:16:48.517403Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:48.517405Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:48.517413Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570593129:3378], now have 1 active actors on pipe
2025-10-02T08:16:48.517417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535432029822528:2378], now have 1 active actors on pipe
2025-10-02T08:16:48.517444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535431570593077:3363]
2025-10-02T08:16:48.517451Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:48.517457Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:48.517459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.517463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.517506Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:48.517512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.517515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.517517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:48.517525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.517532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:48.517553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.517583Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.517584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.517592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.517620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2834 partition: 0 MaxSeqNo: 17 sessionId: src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0
2025-10-02T08:16:48.517915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565a9a4-af071cdd-fc378f77-41b110f1_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:48.520499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0] Write session: try to update token
2025-10-02T08:16:48.520514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:48.533410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2834 sessionId: src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:48.533739Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:48.533753Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:48.533755Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:48.533767Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535431570593077:3363]
2025-10-02T08:16:48.533771Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535431570593077:3363]
2025-10-02T08:16:48.533806Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:48.533812Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:48.533818Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:48.533819Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.533820Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:48.533945Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:48.535961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:48.595272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535431570593145:6916]
2025-10-02T08:16:48.595373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2833, pipe: [1:7556535431570593145:6916]
2025-10-02T08:16:48.656443Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:48.656654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.656666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.656701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570593145:6916], now have 1 active actors on pipe
2025-10-02T08:16:48.656861Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:48.656985Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:48.657088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535431570593145:6916]
2025-10-02T08:16:48.657108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:48.657153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2834 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0
2025-10-02T08:16:48.657305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2834 sessionId: src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0 is DEAD
2025-10-02T08:16:48.657434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:48.657443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0] Write session will restart in 0.006937s
2025-10-02T08:16:48.657466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0] Write session: Do CDS request
2025-10-02T08:16:48.657471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:48.665235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.665342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:48.665360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2835
2025-10-02T08:16:48.665478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.665504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:48.665512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:48.665515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:48.665732Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:48.666069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2835 sessionId:  describe result for acl check
2025-10-02T08:16:48.666097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:48.666102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:48.666103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:48.666108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535431570593482:3446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:48.666530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535431570593482:3446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:48.666984Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:48.667105Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:48.667111Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:48.667118Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:48.667147Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:48.667171Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535431570593489:3456]
2025-10-02T08:16:48.667581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:48.667731Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:48.667766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:48.668025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:48.668068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.668072Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.668073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.668073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.668074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.668077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.668083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.668085Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.668087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.668088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.668092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.668096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.668100Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.668102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.668105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.668107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.668109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.668112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.668114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.668116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.668126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:48.669400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535431570593482:3446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:48.674673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535431570593482:3446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:48.674691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535431570593482:3446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:48.674694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535431570593482:3446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:48.674702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:48.675691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:48.677346Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:48.677362Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:48.677363Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:48.677365Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:48.677370Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2834 [1:7556535431570593489:3456]
2025-10-02T08:16:48.677377Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:48.677389Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:48.677390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.677392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.677393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.677405Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:48.677409Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:48.677413Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:48.677462Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.677469Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.677473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:48.677475Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:48.677530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:48.677537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.677550Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.677564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:48.677585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570593528:3446], now have 1 active actors on pipe
2025-10-02T08:16:48.677592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535432029822548:2378], now have 1 active actors on pipe
2025-10-02T08:16:48.677599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535431570593476:3456]
2025-10-02T08:16:48.677604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535431570593476:3456]
2025-10-02T08:16:48.677613Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:48.677623Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:48.677629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:48.677632Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:48.677641Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:48.677648Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:48.677677Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535431570593476:3456]
2025-10-02T08:16:48.677684Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:48.677656Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2834
2025-10-02T08:16:48.677701Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:48.677786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2834
2025-10-02T08:16:48.677811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.677819Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.677839Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:48.677848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.677854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.677856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:48.677863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.677875Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:48.677894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.678008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.678017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.678035Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.678067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2835 partition: 0 MaxSeqNo: 17 sessionId: src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0
2025-10-02T08:16:48.678349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8effd22-3b24bdca-9a5e3fcf-64f118fb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:48.680973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0] Write session: try to update token
2025-10-02T08:16:48.680989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:48.693541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2835 sessionId: src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:48.694320Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:48.694341Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:48.694343Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:48.694355Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535431570593476:3456]
2025-10-02T08:16:48.694360Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535431570593476:3456]
2025-10-02T08:16:48.694406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:48.694408Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:48.694412Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:48.694417Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.694420Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:48.694572Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:48.695885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:48.757078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535431570593569:6916]
2025-10-02T08:16:48.757208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2834, pipe: [1:7556535431570593569:6916]
2025-10-02T08:16:48.824699Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:48.824956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.824966Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.824997Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570593569:6916], now have 1 active actors on pipe
2025-10-02T08:16:48.825080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:48.825085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:48.825134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2835 reason: error at write: Disconnected sessionId: src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0
2025-10-02T08:16:48.825165Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:48.825219Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:48.825288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2835 sessionId: src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0 is DEAD
2025-10-02T08:16:48.825409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535431570593569:6916]
2025-10-02T08:16:48.825452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:48.825462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0] Write session will restart in 0.007005s
2025-10-02T08:16:48.825486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0] Write session: Do CDS request
2025-10-02T08:16:48.825493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:48.833102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.833171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:48.833184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2836
2025-10-02T08:16:48.833263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:48.833282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:48.833289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:48.833291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:48.833545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2836 sessionId:  describe result for acl check
2025-10-02T08:16:48.833564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:48.833569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:48.833570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:48.833573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535431570593878:3504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:48.833914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535431570593878:3504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:48.834480Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:48.835461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:48.835577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535431570593878:3504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:48.835641Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:48.835649Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:48.835656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:48.835695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:48.835721Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535431570593914:3502]
2025-10-02T08:16:48.836109Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:48.836261Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:48.836297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:48.836515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:48.836557Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.836561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.836562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.836563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.836563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.836567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.836572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.836574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.836577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.836578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.836581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.836586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:48.836590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.836593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:48.836595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.836597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:48.836599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.836602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.836604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.836606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.836615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:48.840897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535431570593878:3504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:48.840910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535431570593878:3504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:48.840913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535431570593878:3504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:48.840921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:48.843786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:48.845178Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:48.845194Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:48.845198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:48.845200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:48.845204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2835 [1:7556535431570593914:3502]
2025-10-02T08:16:48.845212Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:48.845223Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:48.845224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.845226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.845228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.845237Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:48.845245Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:48.845250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:48.845287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.845293Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.845295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:48.845298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:48.845338Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:48.845342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.845350Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:48.845359Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:48.845373Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535431570593897:3502]
2025-10-02T08:16:48.845377Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535431570593897:3502]
2025-10-02T08:16:48.845381Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:48.845388Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:48.845396Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:48.845399Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:48.845402Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:48.845405Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:48.845407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570593942:3504], now have 1 active actors on pipe
2025-10-02T08:16:48.845411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2835
2025-10-02T08:16:48.845426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535432029822563:2378], now have 1 active actors on pipe
2025-10-02T08:16:48.845432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535431570593897:3502]
2025-10-02T08:16:48.845439Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:48.845448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.845449Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:48.845456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.845483Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:48.845490Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:48.845493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:48.845494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:48.845499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:48.845508Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:48.845499Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2835
2025-10-02T08:16:48.845522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.845553Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.845557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.845569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:48.845594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2836 partition: 0 MaxSeqNo: 17 sessionId: src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0
2025-10-02T08:16:48.845895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a01ee91-bb8cd56-792a1370-ccdb8cfc_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:48.848449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0] Write session: try to update token
2025-10-02T08:16:48.848462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:48.862002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2836 sessionId: src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:48.862938Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:48.862953Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:48.862955Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:48.862961Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535431570593897:3502]
2025-10-02T08:16:48.862965Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535431570593897:3502]
2025-10-02T08:16:48.862997Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:48.863002Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:48.863004Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:48.863024Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:48.863040Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:48.863130Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:48.864246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:48.925526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535431570593959:6916]
2025-10-02T08:16:48.925647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2835, pipe: [1:7556535431570593959:6916]
2025-10-02T08:16:48.992751Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:48.993005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:48.993017Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:48.993049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535431570593959:6916], now have 1 active actors on pipe
2025-10-02T08:16:48.993148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535431570593959:6916]
2025-10-02T08:16:48.993170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:48.993175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:48.993177Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:48.993229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2836 reason: error at write: Disconnected sessionId: src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0
2025-10-02T08:16:48.993199Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:48.993385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2836 sessionId: src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0 is DEAD
2025-10-02T08:16:48.993527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:48.993534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0] Write session will restart in 0.007349s
2025-10-02T08:16:48.993552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0] Write session: Do CDS request
2025-10-02T08:16:48.993557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:49.001987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:49.002227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.002321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:49.002330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2837
2025-10-02T08:16:49.002421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.002443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:49.002449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:49.002452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:49.002779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2837 sessionId:  describe result for acl check
2025-10-02T08:16:49.002807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:49.002811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:49.002812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:49.002816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535435865561583:3546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:49.002979Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:49.003135Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:49.003142Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:49.003149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:49.003160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535435865561583:3546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:49.003186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:49.003211Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535435865561585:3538]
2025-10-02T08:16:49.003607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:49.003729Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:49.003754Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:49.003940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:49.003971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.003972Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.003973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.003973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.003974Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.003977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.003982Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.003994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.003997Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.003998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.004002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.004006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.004010Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.004012Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.004014Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.004017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.004019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.004022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.004024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.004027Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.004036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:49.005108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535435865561583:3546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:49.010344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535435865561583:3546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:49.010358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535435865561583:3546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:49.010361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535435865561583:3546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:49.010369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:49.011318Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:49.012818Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:49.012831Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:49.012833Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:49.012836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:49.012841Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2836 [1:7556535435865561585:3538]
2025-10-02T08:16:49.012852Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:49.012865Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:49.012867Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.012869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.012871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.012885Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:49.012893Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:49.012898Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:49.012942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.012948Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.012951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:49.012953Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:49.013005Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:49.013012Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.013023Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.013039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:49.013043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2836
2025-10-02T08:16:49.013056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865561630:3546], now have 1 active actors on pipe
2025-10-02T08:16:49.013063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535432029822572:2378], now have 1 active actors on pipe
2025-10-02T08:16:49.013068Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.013071Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.013090Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535435865561576:3538]
2025-10-02T08:16:49.013096Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535435865561576:3538]
2025-10-02T08:16:49.013102Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:49.013093Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2836
2025-10-02T08:16:49.013114Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:49.013114Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:49.013116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:49.013132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:49.013136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:49.013148Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b42be147-4eafdea1-6544fa1c-688109f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:49.013153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.013157Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.013158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:49.013165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.013173Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:49.013204Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535435865561576:3538]
2025-10-02T08:16:49.013215Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:49.013221Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:49.013223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.013298Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.013306Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.013319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.013354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2837 partition: 0 MaxSeqNo: 17 sessionId: src_id|b42be147-4eafdea1-6544fa1c-688109f5_0
2025-10-02T08:16:49.013628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a909f0f3-a573899a-27a072d9-4a0cafd2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b42be147-4eafdea1-6544fa1c-688109f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:49.015941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b42be147-4eafdea1-6544fa1c-688109f5_0] Write session: try to update token
2025-10-02T08:16:49.015954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b42be147-4eafdea1-6544fa1c-688109f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:49.023372Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:49.023392Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:49.023398Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535435865561576:3538]
2025-10-02T08:16:49.023429Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:49.023429Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:49.023572Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:49.023696Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:49.023832Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:49.023959Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:49.024140Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:49.024168Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:49.027860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2837 sessionId: src_id|b42be147-4eafdea1-6544fa1c-688109f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:49.030112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:49.030169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.030181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.030212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:49.030234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:49.030283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.030297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.030443Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.030509Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.030565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.030621Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.030737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.030744Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.030803Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.030855Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.030911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.030970Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.031009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.031014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.031083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.031135Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.031191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.031244Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.031284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.031289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.031345Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.031401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.031466Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.031530Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.031569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.031574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.031635Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.031700Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.031755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.031811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.031860Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.031868Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.031925Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.031978Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.032049Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.032117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.032213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.032219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.032277Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.032332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.032391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.032449Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.032489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.032494Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.032556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.032614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.032670Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.032724Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.032764Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.032769Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.032838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.032893Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.032948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.033003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.033042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.033046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.033103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.033157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.033216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.033271Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.033309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.033316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.033343Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:49.033394Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.033409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.033414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:49.033439Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:49.033450Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:49.033455Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:49.033457Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:49.033458Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:49.033812Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:49.033833Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:49.033840Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:49.033842Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:49.033844Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:49.033846Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:49.034292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:49.034309Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:49.034313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:49.034315Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:49.034316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:49.034321Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:49.034744Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:49.034759Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:49.034764Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:49.034766Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:49.034767Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:49.035841Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:49.035855Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:49.035862Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393009035
2025-10-02T08:16:49.035961Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:49.035969Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:49.035983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:49.036002Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:49.036004Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:49.036006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:49.036399Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:49.036416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:49.036420Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:49.036423Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:49.036425Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:49.036426Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:49.036857Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:49.036877Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:49.036892Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:49.036895Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:49.036898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:49.036900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:49.037290Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:49.037307Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:49.037310Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:49.038263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:49.038279Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:49.038283Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:49.038287Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:49.038292Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393009038
2025-10-02T08:16:49.038547Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:49.038561Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:49.038565Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:49.038568Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:49.038572Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:49.038574Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:49.038991Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:49.039011Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:49.039016Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:49.039019Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:49.039027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:49.039030Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:49.039424Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:49.039442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.039509Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393009039
2025-10-02T08:16:49.040185Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:49.040209Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:49.040213Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:49.040216Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:49.041792Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:49.041804Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:49.041806Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:49.041814Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535435865561576:3538]
2025-10-02T08:16:49.041816Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535435865561576:3538]
2025-10-02T08:16:49.041860Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:49.041863Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:49.041867Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.041869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:49.041879Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:49.041981Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:49.093433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535435865561664:6916]
2025-10-02T08:16:49.093531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2836, pipe: [1:7556535435865561664:6916]
2025-10-02T08:16:49.162774Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:49.163073Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865561664:6916], now have 1 active actors on pipe
2025-10-02T08:16:49.163175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:49.163187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:49.163210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2837 reason: error at write: Disconnected sessionId: src_id|b42be147-4eafdea1-6544fa1c-688109f5_0
2025-10-02T08:16:49.163247Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:49.163280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:49.163384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2837 sessionId: src_id|b42be147-4eafdea1-6544fa1c-688109f5_0 is DEAD
2025-10-02T08:16:49.163490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535435865561664:6916]
2025-10-02T08:16:49.163518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42be147-4eafdea1-6544fa1c-688109f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:49.163528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42be147-4eafdea1-6544fa1c-688109f5_0] Write session will restart in 0.007293s
2025-10-02T08:16:49.163545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42be147-4eafdea1-6544fa1c-688109f5_0] Write session: Do CDS request
2025-10-02T08:16:49.163549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42be147-4eafdea1-6544fa1c-688109f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:49.171790Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:49.172179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b42be147-4eafdea1-6544fa1c-688109f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.172287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:49.172300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2838
2025-10-02T08:16:49.172389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.172413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:49.172420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:49.172422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:49.172694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2838 sessionId:  describe result for acl check
2025-10-02T08:16:49.172717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:49.172722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:49.172723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:49.172726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535435865561996:3617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:49.172846Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:49.172958Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:49.172965Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:49.172971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:49.173000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:49.173035Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535435865561998:3552]
2025-10-02T08:16:49.173096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535435865561996:3617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:49.173428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:49.173542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:49.173569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:49.173750Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:49.173783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.173787Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.173788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.173788Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.173789Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.173792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.173797Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.173800Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.173802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.173803Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.173807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.173811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.173814Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.173817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.173819Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.173822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.173824Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.173827Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.173829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.173832Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.173842Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:49.174868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535435865561996:3617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:49.180079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535435865561996:3617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:49.180091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535435865561996:3617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:49.180093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535435865561996:3617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:49.180099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:49.181005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:49.182317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:49.182331Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:49.182332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:49.182335Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:49.182338Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2837 [1:7556535435865561998:3552]
2025-10-02T08:16:49.182346Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:49.182357Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:49.182359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.182361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.182362Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.182374Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:49.182381Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:49.182384Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:49.182421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.182426Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.182428Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:49.182429Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:49.182495Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:49.182500Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.182506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2837
2025-10-02T08:16:49.182508Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.182515Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:49.182527Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865562044:3617], now have 1 active actors on pipe
2025-10-02T08:16:49.182531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535436324789887:2378], now have 1 active actors on pipe
2025-10-02T08:16:49.182536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.182538Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.182549Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535435865561989:3552]
2025-10-02T08:16:49.182554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535435865561989:3552]
2025-10-02T08:16:49.182565Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:49.182576Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:49.182587Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:49.182586Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:49.182589Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:49.182591Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:49.182600Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:49.182567Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2837
2025-10-02T08:16:49.182605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.182608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.182609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:49.182615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.182621Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:49.182647Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535435865561989:3552]
2025-10-02T08:16:49.182655Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:49.182666Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.182669Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:49.182704Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.182709Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.182718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.182742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2838 partition: 0 MaxSeqNo: 17 sessionId: src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0
2025-10-02T08:16:49.183025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42be147-4eafdea1-6544fa1c-688109f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:49.185341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0] Write session: try to update token
2025-10-02T08:16:49.185355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:49.193034Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:49.193051Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:49.193059Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535435865561989:3552]
2025-10-02T08:16:49.193089Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:49.193090Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:49.193243Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:49.193376Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:49.193508Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:49.193651Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:49.193820Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:49.193860Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:49.197474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2838 sessionId: src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:49.199709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:49.199755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.199765Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.199789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:49.199805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:49.199843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.199857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.200000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.200054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.200113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.200177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.200216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.200223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.200283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.200337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.200395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.200462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.200503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.200508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.200565Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.200627Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.200688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.200740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.200777Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.200782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.200853Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.200911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.200973Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.201028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.201067Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.201072Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.201128Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.201181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.201238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.201293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.201396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.201402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.201467Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.201521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.201574Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.201628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.201667Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.201672Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.201728Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.201783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.201841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.201897Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.201940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.201947Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.202010Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.202062Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.202118Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.202173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.202212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.202217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.202274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.202328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.202383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.202439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.202485Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.202492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.202549Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:49.202600Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:49.202655Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:49.202711Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:49.202750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:49.202755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:49.202793Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:49.202844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.202859Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.202863Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:49.202886Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:49.202898Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:49.202904Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:49.202906Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:49.202907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:49.203247Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:49.203269Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:49.203273Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:49.203276Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:49.203278Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:49.203280Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:49.203872Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:49.203894Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:49.203900Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:49.203907Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:49.203909Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:49.203911Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:49.204359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:49.204378Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:49.204385Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:49.204390Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:49.204396Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:49.205474Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:49.205491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:49.205498Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393009205
2025-10-02T08:16:49.205660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:49.205671Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:49.205675Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:49.205677Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:49.205679Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:49.205681Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:49.206118Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:49.206133Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:49.206138Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:49.206144Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:49.206146Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:49.206149Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:49.206569Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:49.206587Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:49.206595Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:49.206599Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:49.206601Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:49.206603Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:49.206989Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:49.207005Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:49.207009Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:49.207971Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:49.207995Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:49.208000Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:49.208006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:49.208013Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393009207
2025-10-02T08:16:49.208284Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:49.208301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:49.208305Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:49.208311Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:49.208313Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:49.208316Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:49.208716Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:49.208732Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:49.208737Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:49.208743Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:49.208745Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:49.208748Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:49.209158Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:49.209173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.209241Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393009209
2025-10-02T08:16:49.209910Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:49.209922Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:49.209926Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:49.209930Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:49.211375Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:49.211387Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:49.211388Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:49.211394Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535435865561989:3552]
2025-10-02T08:16:49.211397Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535435865561989:3552]
2025-10-02T08:16:49.211423Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:49.211431Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:49.211433Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:49.211436Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.211437Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:49.211549Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:49.263443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535435865562066:6916]
2025-10-02T08:16:49.263548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2837, pipe: [1:7556535435865562066:6916]
2025-10-02T08:16:49.333243Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:49.333534Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865562066:6916], now have 1 active actors on pipe
2025-10-02T08:16:49.333645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535435865562066:6916]
2025-10-02T08:16:49.333662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:49.333669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:49.333690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2838 reason: error at write: Disconnected sessionId: src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0
2025-10-02T08:16:49.333734Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:49.333730Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:49.333843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2838 sessionId: src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0 is DEAD
2025-10-02T08:16:49.333972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:49.333982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0] Write session will restart in 0.005007s
2025-10-02T08:16:49.334005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0] Write session: Do CDS request
2025-10-02T08:16:49.334012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:49.340188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.340242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:49.340253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2839
2025-10-02T08:16:49.340361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.340388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:49.340395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:49.340398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:49.340686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2839 sessionId:  describe result for acl check
2025-10-02T08:16:49.340705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:49.340710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:49.340711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:49.340714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535435865562316:3598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:49.341094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535435865562316:3598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:49.343315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535435865562316:3598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:49.343563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:49.344630Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:49.344837Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:49.344846Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:49.344855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:49.344904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:49.344938Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535435865562428:3591]
2025-10-02T08:16:49.345409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535435865562316:3598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:49.345418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535435865562316:3598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:49.345420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535435865562316:3598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:49.345425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:49.345480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:49.345618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:49.345655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:49.345907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:49.345943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.345948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.345948Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.345949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.345950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.345954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.345963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.345966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.345969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.345976Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.345981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.345991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.346001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.346008Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.346013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.346020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.346024Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.346031Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.346038Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.346043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.346062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:49.353472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:49.355002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:49.355017Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:49.355019Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:49.355023Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:49.355030Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2838 [1:7556535435865562428:3591]
2025-10-02T08:16:49.355042Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:49.355064Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:49.355072Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.355075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.355077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.355091Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:49.355101Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:49.355107Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:49.355166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.355174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.355177Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:49.355180Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:49.355243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:49.355250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.355262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.355274Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:49.355290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2838
2025-10-02T08:16:49.355297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535436324789896:2378], now have 1 active actors on pipe
2025-10-02T08:16:49.355300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865562433:3598], now have 1 active actors on pipe
2025-10-02T08:16:49.355306Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535435865562414:3591]
2025-10-02T08:16:49.355308Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535435865562414:3591]
2025-10-02T08:16:49.355320Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:49.355330Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:49.355333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.355337Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.355338Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:49.355355Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:49.355372Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:49.355379Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:49.355378Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2838
2025-10-02T08:16:49.355416Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:49.355427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.355431Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.355434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:49.355443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.355454Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:49.355468Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535435865562414:3591]
2025-10-02T08:16:49.355480Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:49.355496Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:49.355511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.355554Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.355561Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.355573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.355611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2839 partition: 0 MaxSeqNo: 17 sessionId: src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0
2025-10-02T08:16:49.355951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69aa4cd3-7279f606-560fb96-adfae7fa_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:49.358334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0] Write session: try to update token
2025-10-02T08:16:49.358349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:49.370896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2839 sessionId: src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:49.372464Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:49.372474Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:49.372476Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:49.372483Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535435865562414:3591]
2025-10-02T08:16:49.372486Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535435865562414:3591]
2025-10-02T08:16:49.372517Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:49.372525Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.372526Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:49.372531Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:49.372536Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:49.372648Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:49.373357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:49.433918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535435865562460:6916]
2025-10-02T08:16:49.434029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2838, pipe: [1:7556535435865562460:6916]
2025-10-02T08:16:49.499101Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:49.499444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.499459Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.499523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865562460:6916], now have 1 active actors on pipe
2025-10-02T08:16:49.499635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:49.499641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:49.499693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2839 reason: error at write: Disconnected sessionId: src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0
2025-10-02T08:16:49.499706Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:49.499770Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:49.499869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2839 sessionId: src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0 is DEAD
2025-10-02T08:16:49.500003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535435865562460:6916]
2025-10-02T08:16:49.500121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:49.500133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0] Write session will restart in 0.009360s
2025-10-02T08:16:49.500156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0] Write session: Do CDS request
2025-10-02T08:16:49.500163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:49.509438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:49.510171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.510241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:49.510249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2840
2025-10-02T08:16:49.510348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.510374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:49.510383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:49.510386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:49.510614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:49.510744Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:49.510751Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:49.510758Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:49.510782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2840 sessionId:  describe result for acl check
2025-10-02T08:16:49.510790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:49.510806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:49.510810Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535435865562796:3637]
2025-10-02T08:16:49.510812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:49.510813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:49.510818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535435865562798:3644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:49.511213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:49.511261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535435865562798:3644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:49.511350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:49.511375Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:49.511571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:49.511602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.511602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.511603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.511604Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.511605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.511608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.511614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.511616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.511618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.511620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.511623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.511628Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.511632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.511635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.511637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.511640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.511642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.511645Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.511648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.511651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.511661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:49.512942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535435865562798:3644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:49.517883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535435865562798:3644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:49.517899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535435865562798:3644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:49.517902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535435865562798:3644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:49.517910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:49.519315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:49.520705Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:49.520717Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:49.520719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:49.520721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:49.520726Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2839 [1:7556535435865562796:3637]
2025-10-02T08:16:49.520734Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:49.520748Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:49.520750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.520751Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.520752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.520764Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:49.520767Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:49.520771Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:49.520829Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.520834Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.520836Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:49.520838Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:49.520880Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:49.520884Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.520892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.520899Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:49.520912Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535435865562788:3637]
2025-10-02T08:16:49.520917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535435865562788:3637]
2025-10-02T08:16:49.520924Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:49.520932Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:49.520936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2839
2025-10-02T08:16:49.520936Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:49.520938Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:49.520944Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:49.520946Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:49.520954Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865562842:3644], now have 1 active actors on pipe
2025-10-02T08:16:49.520956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535436324789903:2378], now have 1 active actors on pipe
2025-10-02T08:16:49.520977Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535435865562788:3637]
2025-10-02T08:16:49.520986Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:49.520989Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:49.520991Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.520993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.521023Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:49.521032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.521035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.521036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:49.521042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.521048Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:49.521018Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2839
2025-10-02T08:16:49.521063Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.521090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.521094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.521102Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.521125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2840 partition: 0 MaxSeqNo: 17 sessionId: src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0
2025-10-02T08:16:49.521389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1afb1ae8-55000b19-20b6f86c-cebbf7a7_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:49.523726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0] Write session: try to update token
2025-10-02T08:16:49.523738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:49.535730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2840 sessionId: src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:49.537335Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:49.537352Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:49.537356Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:49.537364Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535435865562788:3637]
2025-10-02T08:16:49.537368Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535435865562788:3637]
2025-10-02T08:16:49.537410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:49.537412Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:49.537416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.537418Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:49.537421Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:49.537553Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:49.537995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:49.600335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535435865562861:6916]
2025-10-02T08:16:49.600466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2839, pipe: [1:7556535435865562861:6916]
2025-10-02T08:16:49.665469Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:49.665696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.665705Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.665736Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865562861:6916], now have 1 active actors on pipe
2025-10-02T08:16:49.665837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535435865562861:6916]
2025-10-02T08:16:49.665856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:49.665861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:49.665880Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:49.665911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2840 reason: error at write: Disconnected sessionId: src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0
2025-10-02T08:16:49.665928Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:49.666072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2840 sessionId: src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0 is DEAD
2025-10-02T08:16:49.666263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:49.666272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0] Write session will restart in 0.007805s
2025-10-02T08:16:49.666297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0] Write session: Do CDS request
2025-10-02T08:16:49.666303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:49.674089Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:49.675108Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:49.675220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.675317Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:49.675324Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:49.675332Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:49.675370Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:49.675395Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535435865563195:3671]
2025-10-02T08:16:49.675410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:49.675419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2841
2025-10-02T08:16:49.675520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.675540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:49.675547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:49.675549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:49.675786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:49.675814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2841 sessionId:  describe result for acl check
2025-10-02T08:16:49.675832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:49.675838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:49.675839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:49.675843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535435865563201:3662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:49.675927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:49.675949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:49.676166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:49.676191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535435865563201:3662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:49.676195Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.676196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.676197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.676197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.676198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.676201Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.676207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.676208Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.676210Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.676212Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.676216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.676220Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.676223Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.676226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.676228Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.676230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.676232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.676235Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.676237Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.676240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.676249Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:49.677841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535435865563201:3662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:49.682030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535435865563201:3662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:49.682040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535435865563201:3662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:49.682042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535435865563201:3662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:49.682048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:49.683550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:49.684889Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:49.684900Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:49.684902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:49.684904Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:49.684909Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2840 [1:7556535435865563195:3671]
2025-10-02T08:16:49.684917Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:49.684928Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:49.684934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.684938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.684941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.684954Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:49.684963Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:49.684967Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:49.685008Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.685013Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.685015Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:49.685016Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:49.685060Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:49.685065Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.685072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.685079Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:49.685091Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535435865563189:3671]
2025-10-02T08:16:49.685093Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535435865563189:3671]
2025-10-02T08:16:49.685098Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:49.685113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865563256:3662], now have 1 active actors on pipe
2025-10-02T08:16:49.685116Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:49.685119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:49.685122Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:49.685130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:49.685133Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:49.685137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535436324789909:2378], now have 1 active actors on pipe
2025-10-02T08:16:49.685155Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535435865563189:3671]
2025-10-02T08:16:49.685163Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:49.685182Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:49.685187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2840
2025-10-02T08:16:49.685198Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.685204Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.685193Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2840
2025-10-02T08:16:49.685220Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|627a4990-78d759fa-a7f94f32-696e26d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:49.685230Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.685235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.685236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:49.685243Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.685248Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:49.685261Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.685275Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.685280Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.685288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.685310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2841 partition: 0 MaxSeqNo: 17 sessionId: src_id|627a4990-78d759fa-a7f94f32-696e26d5_0
2025-10-02T08:16:49.685571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56b6b42c-a1cda509-1f18eae6-ab773bdb_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|627a4990-78d759fa-a7f94f32-696e26d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:49.688089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627a4990-78d759fa-a7f94f32-696e26d5_0] Write session: try to update token
2025-10-02T08:16:49.688105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627a4990-78d759fa-a7f94f32-696e26d5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:49.701431Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:49.701445Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:49.701447Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:49.701452Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535435865563189:3671]
2025-10-02T08:16:49.701456Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535435865563189:3671]
2025-10-02T08:16:49.701483Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:49.701488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.701489Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:49.701540Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:49.701554Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:49.701600Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:49.716938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2841 sessionId: src_id|627a4990-78d759fa-a7f94f32-696e26d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:49.719105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:49.766202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535435865563296:6916]
2025-10-02T08:16:49.766276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2840, pipe: [1:7556535435865563296:6916]
2025-10-02T08:16:49.823610Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:49.823905Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.823915Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.823931Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865563296:6916], now have 1 active actors on pipe
2025-10-02T08:16:49.824043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535435865563296:6916]
2025-10-02T08:16:49.824057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:49.824058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:49.824097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2841 reason: error at write: Disconnected sessionId: src_id|627a4990-78d759fa-a7f94f32-696e26d5_0
2025-10-02T08:16:49.824161Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:49.824240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2841 sessionId: src_id|627a4990-78d759fa-a7f94f32-696e26d5_0 is DEAD
2025-10-02T08:16:49.824378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a4990-78d759fa-a7f94f32-696e26d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:49.824387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a4990-78d759fa-a7f94f32-696e26d5_0] Write session will restart in 0.005216s
2025-10-02T08:16:49.824405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a4990-78d759fa-a7f94f32-696e26d5_0] Write session: Do CDS request
2025-10-02T08:16:49.824413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a4990-78d759fa-a7f94f32-696e26d5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:49.824675Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:49.830210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627a4990-78d759fa-a7f94f32-696e26d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.830276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:49.830287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2842
2025-10-02T08:16:49.830386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.830412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:49.830421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:49.830425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:49.830783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2842 sessionId:  describe result for acl check
2025-10-02T08:16:49.830808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:49.830813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:49.830814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:49.830818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535435865563569:3772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:49.831245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535435865563569:3772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:49.832963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535435865563569:3772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:49.833116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:49.834116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:49.834236Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:49.834243Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:49.834250Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:49.834280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:49.834365Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535435865563664:3786]
2025-10-02T08:16:49.834773Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:49.834806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535435865563569:3772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:49.834814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535435865563569:3772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:49.834816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535435865563569:3772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:49.834820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:49.834882Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:49.834907Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:49.835087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:49.835110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.835114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.835114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.835115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.835116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.835119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.835125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.835127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.835128Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.835130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.835133Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.835138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:49.835144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.835148Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:49.835152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.835160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:49.835165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.835173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.835180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.835182Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.835193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:49.845656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:49.846988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:49.847002Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:49.847003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:49.847007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:49.847012Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2841 [1:7556535435865563664:3786]
2025-10-02T08:16:49.847020Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:49.847034Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:49.847038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.847040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.847041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.847053Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:49.847057Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:49.847063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:49.847105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.847113Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.847116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:49.847117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:49.847164Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:49.847170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.847178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:49.847184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:49.847195Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535435865563649:3786]
2025-10-02T08:16:49.847196Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535435865563649:3786]
2025-10-02T08:16:49.847201Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:49.847209Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:49.847217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:49.847220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:49.847222Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:49.847223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2841
2025-10-02T08:16:49.847223Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:49.847231Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865563673:3772], now have 1 active actors on pipe
2025-10-02T08:16:49.847254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535436324789938:2378], now have 1 active actors on pipe
2025-10-02T08:16:49.847260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535435865563649:3786]
2025-10-02T08:16:49.847262Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:49.847263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:49.847266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.847269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.847307Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10827630-3085d857-49a031bc-1cbfd5c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:49.847316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:49.847318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:49.847320Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:49.847326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:49.847331Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:49.847347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.847317Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2841
2025-10-02T08:16:49.847379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.847384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.847393Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:49.847420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2842 partition: 0 MaxSeqNo: 17 sessionId: src_id|10827630-3085d857-49a031bc-1cbfd5c5_0
2025-10-02T08:16:49.847677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627a4990-78d759fa-a7f94f32-696e26d5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|10827630-3085d857-49a031bc-1cbfd5c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:49.849957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10827630-3085d857-49a031bc-1cbfd5c5_0] Write session: try to update token
2025-10-02T08:16:49.849971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10827630-3085d857-49a031bc-1cbfd5c5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:49.862313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2842 sessionId: src_id|10827630-3085d857-49a031bc-1cbfd5c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:49.863286Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:49.863298Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:49.863300Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:49.863307Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535435865563649:3786]
2025-10-02T08:16:49.863309Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535435865563649:3786]
2025-10-02T08:16:49.863340Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:49.863341Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:49.863345Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:49.863348Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:49.863349Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:49.863461Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:49.864597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:49.924415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535435865563697:6916]
2025-10-02T08:16:49.924521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2841, pipe: [1:7556535435865563697:6916]
2025-10-02T08:16:49.986138Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:49.986474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:49.986484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:49.986515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535435865563697:6916], now have 1 active actors on pipe
2025-10-02T08:16:49.986675Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:49.986744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:49.986754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:49.986769Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:49.986814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2842 reason: error at write: Disconnected sessionId: src_id|10827630-3085d857-49a031bc-1cbfd5c5_0
2025-10-02T08:16:49.986875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535435865563697:6916]
2025-10-02T08:16:49.987002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2842 sessionId: src_id|10827630-3085d857-49a031bc-1cbfd5c5_0 is DEAD
2025-10-02T08:16:49.987153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10827630-3085d857-49a031bc-1cbfd5c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:49.987161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10827630-3085d857-49a031bc-1cbfd5c5_0] Write session will restart in 0.006532s
2025-10-02T08:16:49.987182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10827630-3085d857-49a031bc-1cbfd5c5_0] Write session: Do CDS request
2025-10-02T08:16:49.987187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10827630-3085d857-49a031bc-1cbfd5c5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:49.995281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10827630-3085d857-49a031bc-1cbfd5c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.995381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:49.995399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2843
2025-10-02T08:16:49.995515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:49.995539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:49.995546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:49.995548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:49.995954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2843 sessionId:  describe result for acl check
2025-10-02T08:16:49.995991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:49.995997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:49.995999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:49.996004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535435865564021:3804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:49.996492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535435865564021:3804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:49.997097Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:49.998294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535435865564021:3804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:49.998607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:49.998766Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:49.998775Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:49.998783Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:49.998823Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:49.998856Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535435865564065:3800]
2025-10-02T08:16:49.999496Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:49.999668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:49.999704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:50.000036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:50.000069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.000073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.000074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.000074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.000075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.000078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.000084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.000086Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.000088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.000090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.000093Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.000099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.000102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.000105Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.000107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.000110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.000112Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.000114Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.000116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.000119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.000134Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:50.002413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535435865564021:3804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:50.002423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535435865564021:3804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:50.002425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535435865564021:3804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:50.002430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:50.007498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:50.008995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:50.009005Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:50.009007Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:50.009009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:50.009013Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2842 [1:7556535435865564065:3800]
2025-10-02T08:16:50.009020Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:50.009032Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:50.009037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.009039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.009041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.009052Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:50.009056Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:50.009064Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:50.009109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.009114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.009117Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:50.009118Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:50.009160Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:50.009165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.009173Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.009184Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:50.009197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535435865564038:3800]
2025-10-02T08:16:50.009201Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535435865564038:3800]
2025-10-02T08:16:50.009207Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:50.009213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2842
2025-10-02T08:16:50.009214Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:50.009216Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160531380:3804], now have 1 active actors on pipe
2025-10-02T08:16:50.009217Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:50.009221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:50.009228Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:50.009230Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:50.009233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535436324789946:2378], now have 1 active actors on pipe
2025-10-02T08:16:50.009236Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.009238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.009267Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535435865564038:3800]
2025-10-02T08:16:50.009271Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:50.009278Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2842
2025-10-02T08:16:50.009277Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:50.009281Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:50.009285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.009287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.009289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:50.009295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.009301Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:50.009323Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.009361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.009366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.009374Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.009407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2843 partition: 0 MaxSeqNo: 17 sessionId: src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0
2025-10-02T08:16:50.009693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10827630-3085d857-49a031bc-1cbfd5c5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:50.011885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0] Write session: try to update token
2025-10-02T08:16:50.011897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:50.023600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2843 sessionId: src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:50.025431Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:50.025446Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:50.025448Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:50.025455Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535435865564038:3800]
2025-10-02T08:16:50.025460Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535435865564038:3800]
2025-10-02T08:16:50.025494Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:50.025497Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:50.025504Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:50.025504Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.025506Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:50.025631Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:50.025844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:50.087230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535440160531409:6916]
2025-10-02T08:16:50.087325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2842, pipe: [1:7556535440160531409:6916]
2025-10-02T08:16:50.161213Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:50.161591Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.161605Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.161647Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160531409:6916], now have 1 active actors on pipe
2025-10-02T08:16:50.161725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:50.161731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:50.161770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2843 reason: error at write: Disconnected sessionId: src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0
2025-10-02T08:16:50.161858Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:50.161896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2843 sessionId: src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0 is DEAD
2025-10-02T08:16:50.161889Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:50.162047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:50.162025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535440160531409:6916]
2025-10-02T08:16:50.162059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0] Write session will restart in 0.009914s
2025-10-02T08:16:50.162087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0] Write session: Do CDS request
2025-10-02T08:16:50.162091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:50.170568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:50.171578Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:50.171753Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:50.171760Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:50.171767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:50.171805Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:50.171832Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535440160531754:3838]
2025-10-02T08:16:50.172245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:50.172374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:50.172401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:50.172595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:50.172625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.172629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.172629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.172631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.172631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.172634Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.172640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.172642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.172644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.172646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.172649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.172654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.172657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.172660Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.172662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.172665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.172667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.172669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.172671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.172681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.172700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:50.173148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.173192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:50.173204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2844
2025-10-02T08:16:50.173320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.173338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:50.173344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:50.173347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:50.173666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2844 sessionId:  describe result for acl check
2025-10-02T08:16:50.173700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:50.173705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:50.173706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:50.173710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535440160531770:3863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:50.174128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535440160531770:3863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:50.176014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535440160531770:3863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:50.179430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535440160531770:3863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:50.179438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535440160531770:3863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:50.179441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535440160531770:3863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:50.179446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:50.179932Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:50.181471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:50.181481Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:50.181483Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:50.181485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:50.181490Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2843 [1:7556535440160531754:3838]
2025-10-02T08:16:50.181497Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:50.181509Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:50.181511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.181514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.181515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.181527Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:50.181530Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:50.181534Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:50.181569Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.181574Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.181576Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:50.181578Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:50.181621Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:50.181626Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.181633Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.181640Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:50.181654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160531801:3863], now have 1 active actors on pipe
2025-10-02T08:16:50.181661Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535440160531746:3838]
2025-10-02T08:16:50.181662Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535440160531746:3838]
2025-10-02T08:16:50.181666Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:50.181674Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535440619757260:2378], now have 1 active actors on pipe
2025-10-02T08:16:50.181676Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:50.181679Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:50.181681Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:50.181688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2843
2025-10-02T08:16:50.181689Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:50.181690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:50.181712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.181717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.181727Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535440160531746:3838]
2025-10-02T08:16:50.181732Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:50.181751Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:50.181751Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17eacc35-72820701-e59b9eaf-be985e91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:50.181757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.181759Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.181760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:50.181765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.181735Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2843
2025-10-02T08:16:50.181770Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:50.181792Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.181834Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.181845Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.181872Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.181913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2844 partition: 0 MaxSeqNo: 17 sessionId: src_id|17eacc35-72820701-e59b9eaf-be985e91_0
2025-10-02T08:16:50.182193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b42638c4-f7270172-a3e31e95-f74b58ac_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|17eacc35-72820701-e59b9eaf-be985e91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:50.184592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eacc35-72820701-e59b9eaf-be985e91_0] Write session: try to update token
2025-10-02T08:16:50.184608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eacc35-72820701-e59b9eaf-be985e91_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:50.196412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2844 sessionId: src_id|17eacc35-72820701-e59b9eaf-be985e91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:50.198207Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:50.198220Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:50.198222Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:50.198229Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535440160531746:3838]
2025-10-02T08:16:50.198233Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535440160531746:3838]
2025-10-02T08:16:50.198263Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:50.198272Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.198273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:50.198274Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:50.198279Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:50.198387Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:50.198868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:50.262334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535440160531815:6916]
2025-10-02T08:16:50.262416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2843, pipe: [1:7556535440160531815:6916]
2025-10-02T08:16:50.318906Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:50.319113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.319122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.319152Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160531815:6916], now have 1 active actors on pipe
2025-10-02T08:16:50.319266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:50.319281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:50.319343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2844 reason: error at write: Disconnected sessionId: src_id|17eacc35-72820701-e59b9eaf-be985e91_0
2025-10-02T08:16:50.319376Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:50.319499Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:50.319518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2844 sessionId: src_id|17eacc35-72820701-e59b9eaf-be985e91_0 is DEAD
2025-10-02T08:16:50.319656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eacc35-72820701-e59b9eaf-be985e91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:50.319667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eacc35-72820701-e59b9eaf-be985e91_0] Write session will restart in 0.009340s
2025-10-02T08:16:50.319689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eacc35-72820701-e59b9eaf-be985e91_0] Write session: Do CDS request
2025-10-02T08:16:50.319695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eacc35-72820701-e59b9eaf-be985e91_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:50.319688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535440160531815:6916]
2025-10-02T08:16:50.329402Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:50.330302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eacc35-72820701-e59b9eaf-be985e91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.330329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:50.330340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2845
2025-10-02T08:16:50.330366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:50.330492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.330506Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:50.330508Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:50.330515Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:50.330520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:50.330525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:50.330528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:50.330547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:50.330578Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535440160532158:3895]
2025-10-02T08:16:50.330853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2845 sessionId:  describe result for acl check
2025-10-02T08:16:50.330889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:50.330895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:50.330896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:50.330900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535440160532162:3898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:50.330990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:50.331135Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:50.331170Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:50.331361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535440160532162:3898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:50.331371Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:50.331393Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.331398Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.331399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.331399Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.331400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.331411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.331418Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.331420Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.331422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.331424Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.331427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.331432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.331435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.331437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.331440Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.331443Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.331445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.331448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.331450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.331453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.331464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:50.333459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535440160532162:3898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:50.338221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535440160532162:3898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:50.338233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535440160532162:3898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:50.338235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535440160532162:3898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:50.338242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:50.338721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:50.340157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:50.340167Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:50.340169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:50.340171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:50.340176Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2844 [1:7556535440160532158:3895]
2025-10-02T08:16:50.340183Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:50.340196Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:50.340198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.340200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.340202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.340213Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:50.340216Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:50.340220Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:50.340260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.340265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.340266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:50.340268Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:50.340310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:50.340315Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.340323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.340329Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:50.340342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160532205:3898], now have 1 active actors on pipe
2025-10-02T08:16:50.340349Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535440160532151:3895]
2025-10-02T08:16:50.340350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2844
2025-10-02T08:16:50.340350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535440160532151:3895]
2025-10-02T08:16:50.340355Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:50.340361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535440619757268:2378], now have 1 active actors on pipe
2025-10-02T08:16:50.340363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:50.340365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:50.340366Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:50.340373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:50.340375Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:50.340379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.340381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.340410Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535440160532151:3895]
2025-10-02T08:16:50.340416Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:50.340420Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:50.340428Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:50.340432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.340434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.340435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:50.340410Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2844
2025-10-02T08:16:50.340441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.340451Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:50.340482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.340515Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.340519Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.340528Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.340553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2845 partition: 0 MaxSeqNo: 17 sessionId: src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0
2025-10-02T08:16:50.340895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eacc35-72820701-e59b9eaf-be985e91_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:50.343359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0] Write session: try to update token
2025-10-02T08:16:50.343376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:50.356298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2845 sessionId: src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:50.356584Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:50.356600Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:50.356603Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:50.356610Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535440160532151:3895]
2025-10-02T08:16:50.356614Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535440160532151:3895]
2025-10-02T08:16:50.356655Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:50.356666Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.356669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:50.356777Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:50.356793Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:50.356834Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:50.358650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:50.420050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535440160532219:6916]
2025-10-02T08:16:50.420160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2844, pipe: [1:7556535440160532219:6916]
2025-10-02T08:16:50.487224Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:50.487508Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.487523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.487563Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160532219:6916], now have 1 active actors on pipe
2025-10-02T08:16:50.487687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535440160532219:6916]
2025-10-02T08:16:50.487715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:50.487721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:50.487779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2845 reason: error at write: Disconnected sessionId: src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0
2025-10-02T08:16:50.487779Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:50.487796Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:50.487966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2845 sessionId: src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0 is DEAD
2025-10-02T08:16:50.488099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:50.488109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0] Write session will restart in 0.009430s
2025-10-02T08:16:50.488134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0] Write session: Do CDS request
2025-10-02T08:16:50.488141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:50.497373Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:50.498175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.498262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:50.498271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2846
2025-10-02T08:16:50.498375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.498395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:50.498401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:50.498403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:50.498819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2846 sessionId:  describe result for acl check
2025-10-02T08:16:50.498861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:50.498863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:50.498864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:50.498871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535440160532564:3923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:50.498894Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:50.499055Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:50.499064Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:50.499074Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:50.499126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:50.499165Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535440160532567:3938]
2025-10-02T08:16:50.499774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:50.499863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535440160532564:3923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:50.499916Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:50.499964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:50.500308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:50.500379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.500388Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.500389Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.500390Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.500391Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.500397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.500406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.500414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.500421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.500425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.500430Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.500436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.500446Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.500455Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.500463Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.500471Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.500479Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.500486Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.500493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.500498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.500520Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:50.501916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535440160532564:3923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:50.506701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535440160532564:3923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:50.506715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535440160532564:3923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:50.506718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535440160532564:3923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:50.506726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:50.507687Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:50.509257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:50.509275Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:50.509278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:50.509281Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:50.509287Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2845 [1:7556535440160532567:3938]
2025-10-02T08:16:50.509299Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:50.509315Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:50.509318Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.509321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.509322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.509337Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:50.509342Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:50.509354Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:50.509406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.509413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.509416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:50.509419Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:50.509478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:50.509486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.509498Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.509514Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:50.509524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2845
2025-10-02T08:16:50.509536Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160532613:3923], now have 1 active actors on pipe
2025-10-02T08:16:50.509544Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535440619757275:2378], now have 1 active actors on pipe
2025-10-02T08:16:50.509548Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.509556Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.509571Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535440160532557:3938]
2025-10-02T08:16:50.509578Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535440160532557:3938]
2025-10-02T08:16:50.509590Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:50.509607Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:50.509609Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:50.509612Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:50.509626Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:50.509599Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2845
2025-10-02T08:16:50.509633Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:50.509647Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58e9b75-ece98388-66db2fae-89fa6817_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:50.509654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.509658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.509660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:50.509671Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.509685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:50.509725Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535440160532557:3938]
2025-10-02T08:16:50.509738Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:50.509749Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:50.509752Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.509798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.509806Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.509821Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.509857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2846 partition: 0 MaxSeqNo: 17 sessionId: src_id|58e9b75-ece98388-66db2fae-89fa6817_0
2025-10-02T08:16:50.510168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bf4ec5-cb5088e5-d0d35063-cf9d63d6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|58e9b75-ece98388-66db2fae-89fa6817_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:50.512906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e9b75-ece98388-66db2fae-89fa6817_0] Write session: try to update token
2025-10-02T08:16:50.512918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e9b75-ece98388-66db2fae-89fa6817_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:50.525860Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:50.525879Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:50.525881Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:50.525892Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535440160532557:3938]
2025-10-02T08:16:50.525897Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535440160532557:3938]
2025-10-02T08:16:50.525926Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:50.525935Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:50.525936Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:50.525941Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.525943Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:50.526011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2846 sessionId: src_id|58e9b75-ece98388-66db2fae-89fa6817_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:50.526071Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:50.528526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:50.587997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535440160532628:6916]
2025-10-02T08:16:50.588100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2845, pipe: [1:7556535440160532628:6916]
2025-10-02T08:16:50.654869Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:50.655161Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.655170Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.655201Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160532628:6916], now have 1 active actors on pipe
2025-10-02T08:16:50.655320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:50.655331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:50.655385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2846 reason: error at write: Disconnected sessionId: src_id|58e9b75-ece98388-66db2fae-89fa6817_0
2025-10-02T08:16:50.655441Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:50.655518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2846 sessionId: src_id|58e9b75-ece98388-66db2fae-89fa6817_0 is DEAD
2025-10-02T08:16:50.655613Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:50.655647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e9b75-ece98388-66db2fae-89fa6817_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:50.655655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e9b75-ece98388-66db2fae-89fa6817_0] Write session will restart in 0.006581s
2025-10-02T08:16:50.655678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e9b75-ece98388-66db2fae-89fa6817_0] Write session: Do CDS request
2025-10-02T08:16:50.655683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e9b75-ece98388-66db2fae-89fa6817_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:50.655721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535440160532628:6916]
2025-10-02T08:16:50.663192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e9b75-ece98388-66db2fae-89fa6817_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.663245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:50.663254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2847
2025-10-02T08:16:50.663395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.663415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:50.663421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:50.663424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:50.663692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2847 sessionId:  describe result for acl check
2025-10-02T08:16:50.663714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:50.663718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:50.663719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:50.663722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535440160532960:3950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:50.664066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535440160532960:3950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:50.664772Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:50.665907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535440160532960:3950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:50.666028Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:50.666223Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:50.666231Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:50.666238Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:50.666278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:50.666300Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535440160533003:3949]
2025-10-02T08:16:50.666725Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:50.666867Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:50.666892Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:50.667080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:50.667115Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.667120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.667121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.667121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.667123Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.667127Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.667132Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.667138Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.667140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.667141Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.667145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.667149Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.667154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.667156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.667158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.667161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.667166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.667169Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.667171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.667173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.667184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:50.671229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535440160532960:3950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:50.671238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535440160532960:3950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:50.671241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535440160532960:3950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:50.671249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:50.674230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:50.675555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:50.675567Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:50.675568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:50.675571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:50.675574Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2846 [1:7556535440160533003:3949]
2025-10-02T08:16:50.675583Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:50.675599Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:50.675606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.675609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.675610Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.675621Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:50.675628Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:50.675632Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:50.675669Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.675674Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.675676Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:50.675677Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:50.675713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:50.675718Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.675725Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.675732Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:50.675743Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535440160532977:3949]
2025-10-02T08:16:50.675747Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535440160532977:3949]
2025-10-02T08:16:50.675753Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:50.675761Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535440619757282:2378], now have 1 active actors on pipe
2025-10-02T08:16:50.675761Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:50.675763Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:50.675762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2846
2025-10-02T08:16:50.675768Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160533023:3950], now have 1 active actors on pipe
2025-10-02T08:16:50.675772Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:50.675780Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:50.675781Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:50.675795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.675800Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.675800Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2846
2025-10-02T08:16:50.675810Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535440160532977:3949]
2025-10-02T08:16:50.675819Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:50.675820Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:50.675832Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c003847a-6f44a025-dce2a34a-57520dea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:50.675836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.675838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.675839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:50.675844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.675850Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:50.675866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.675906Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.675911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.675919Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.675940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2847 partition: 0 MaxSeqNo: 17 sessionId: src_id|c003847a-6f44a025-dce2a34a-57520dea_0
2025-10-02T08:16:50.676197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e9b75-ece98388-66db2fae-89fa6817_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c003847a-6f44a025-dce2a34a-57520dea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:50.678446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c003847a-6f44a025-dce2a34a-57520dea_0] Write session: try to update token
2025-10-02T08:16:50.678460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c003847a-6f44a025-dce2a34a-57520dea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:50.689923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2847 sessionId: src_id|c003847a-6f44a025-dce2a34a-57520dea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:50.691499Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:50.691513Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:50.691515Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:50.691522Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535440160532977:3949]
2025-10-02T08:16:50.691524Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535440160532977:3949]
2025-10-02T08:16:50.691554Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:50.691564Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.691565Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:50.691565Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:50.691570Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:50.691681Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:50.692093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:50.755894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535440160533069:6916]
2025-10-02T08:16:50.755966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2846, pipe: [1:7556535440160533069:6916]
2025-10-02T08:16:50.811945Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:50.812246Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.812256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.812287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160533069:6916], now have 1 active actors on pipe
2025-10-02T08:16:50.812402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535440160533069:6916]
2025-10-02T08:16:50.812418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:50.812422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:50.812467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2847 reason: error at write: Disconnected sessionId: src_id|c003847a-6f44a025-dce2a34a-57520dea_0
2025-10-02T08:16:50.812468Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:50.812529Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:50.812595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2847 sessionId: src_id|c003847a-6f44a025-dce2a34a-57520dea_0 is DEAD
2025-10-02T08:16:50.812738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003847a-6f44a025-dce2a34a-57520dea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:50.812747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003847a-6f44a025-dce2a34a-57520dea_0] Write session will restart in 0.006351s
2025-10-02T08:16:50.812764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003847a-6f44a025-dce2a34a-57520dea_0] Write session: Do CDS request
2025-10-02T08:16:50.812768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003847a-6f44a025-dce2a34a-57520dea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:50.820167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c003847a-6f44a025-dce2a34a-57520dea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.820268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:50.820279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2848
2025-10-02T08:16:50.820366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.820385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:50.820391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:50.820394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:50.820754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2848 sessionId:  describe result for acl check
2025-10-02T08:16:50.820779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:50.820780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:50.820781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:50.820784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535440160533394:4060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:50.821133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535440160533394:4060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:50.822074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:50.822417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:50.822471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535440160533394:4060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:50.822549Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:50.822557Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:50.822563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:50.822597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:50.822623Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535440160533446:4062]
2025-10-02T08:16:50.823015Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:50.823571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:50.823606Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:50.823810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:50.823836Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.823840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.823840Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.823841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.823841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.823845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.823850Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.823852Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.823855Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.823856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.823860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.823864Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.823871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.823873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.823876Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.823878Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.823881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.823883Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.823885Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.823888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.823898Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:50.828123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535440160533394:4060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:50.828135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535440160533394:4060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:50.828138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535440160533394:4060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:50.828144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:50.831047Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:50.832643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:50.832655Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:50.832656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:50.832658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:50.832662Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2847 [1:7556535440160533446:4062]
2025-10-02T08:16:50.832670Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:50.832681Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:50.832687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.832689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.832690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.832702Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:50.832708Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:50.832712Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:50.832759Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.832763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.832766Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:50.832767Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:50.832823Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:50.832828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.832835Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.832841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:50.832857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160533472:4060], now have 1 active actors on pipe
2025-10-02T08:16:50.832865Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535440160533440:4062]
2025-10-02T08:16:50.832866Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535440160533440:4062]
2025-10-02T08:16:50.832871Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:50.832876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535440619757310:2378], now have 1 active actors on pipe
2025-10-02T08:16:50.832876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2847
2025-10-02T08:16:50.832882Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:50.832884Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:50.832885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:50.832890Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:50.832892Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:50.832898Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.832904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.832930Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535440160533440:4062]
2025-10-02T08:16:50.832935Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:50.832946Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d465f8ed-a2855a9-a31945d8-73515e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:50.832953Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.832955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.832930Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2847
2025-10-02T08:16:50.832955Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:50.832956Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:50.832961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.832967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:50.832989Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.833037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.833042Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.833051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.833077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2848 partition: 0 MaxSeqNo: 17 sessionId: src_id|d465f8ed-a2855a9-a31945d8-73515e0_0
2025-10-02T08:16:50.833360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003847a-6f44a025-dce2a34a-57520dea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d465f8ed-a2855a9-a31945d8-73515e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:50.835546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465f8ed-a2855a9-a31945d8-73515e0_0] Write session: try to update token
2025-10-02T08:16:50.835556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465f8ed-a2855a9-a31945d8-73515e0_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:50.847594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2848 sessionId: src_id|d465f8ed-a2855a9-a31945d8-73515e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:50.848740Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:50.848756Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:50.848758Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:50.848766Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535440160533440:4062]
2025-10-02T08:16:50.848770Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535440160533440:4062]
2025-10-02T08:16:50.848828Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:50.848829Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:50.848834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:50.848839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.848841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:50.848973Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:50.849889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:50.912562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535440160533488:6916]
2025-10-02T08:16:50.912661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2847, pipe: [1:7556535440160533488:6916]
2025-10-02T08:16:50.968964Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:50.969282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.969293Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.969322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160533488:6916], now have 1 active actors on pipe
2025-10-02T08:16:50.969384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535440160533488:6916]
2025-10-02T08:16:50.969401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:50.969402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:50.969439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2848 reason: error at write: Disconnected sessionId: src_id|d465f8ed-a2855a9-a31945d8-73515e0_0
2025-10-02T08:16:50.969511Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:50.969519Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:50.969589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2848 sessionId: src_id|d465f8ed-a2855a9-a31945d8-73515e0_0 is DEAD
2025-10-02T08:16:50.969734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465f8ed-a2855a9-a31945d8-73515e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:50.969745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465f8ed-a2855a9-a31945d8-73515e0_0] Write session will restart in 0.005985s
2025-10-02T08:16:50.969770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465f8ed-a2855a9-a31945d8-73515e0_0] Write session: Do CDS request
2025-10-02T08:16:50.969776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465f8ed-a2855a9-a31945d8-73515e0_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:50.977153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465f8ed-a2855a9-a31945d8-73515e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.977200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:50.977211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2849
2025-10-02T08:16:50.977316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:50.977336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:50.977343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:50.977345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:50.977592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2849 sessionId:  describe result for acl check
2025-10-02T08:16:50.977624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:50.977628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:50.977629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:50.977633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535440160533829:4106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:50.977989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535440160533829:4106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:50.978399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:50.979447Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:50.979543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535440160533829:4106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:50.979557Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:50.979559Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:50.979566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:50.979603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:50.979631Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535440160533862:4092]
2025-10-02T08:16:50.980088Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:50.980262Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:50.980297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:50.980512Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:50.980543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.980549Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.980550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.980550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.980551Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.980555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.980560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.980562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.980564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.980566Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.980570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.980575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:50.980579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.980581Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:50.980584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.980587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:50.980589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.980591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.980593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.980596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.980607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:50.984689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535440160533829:4106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:50.984698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535440160533829:4106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:50.984701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535440160533829:4106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:50.984706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:50.987770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:50.989276Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:50.989289Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:50.989291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:50.989293Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:50.989297Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2848 [1:7556535440160533862:4092]
2025-10-02T08:16:50.989306Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:50.989317Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:50.989319Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.989321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.989322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.989332Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:50.989335Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:50.989340Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:50.989379Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.989384Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.989386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:50.989388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:50.989427Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:50.989432Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:50.989438Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:50.989448Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:50.989461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535440160533846:4092]
2025-10-02T08:16:50.989465Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535440160533846:4092]
2025-10-02T08:16:50.989470Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:50.989474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2848
2025-10-02T08:16:50.989479Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535440160533889:4106], now have 1 active actors on pipe
2025-10-02T08:16:50.989478Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:50.989480Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:50.989484Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:50.989492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:50.989494Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:50.989497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535440619757318:2378], now have 1 active actors on pipe
2025-10-02T08:16:50.989500Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.989503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.989528Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535440160533846:4092]
2025-10-02T08:16:50.989537Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:50.989545Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:50.989552Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:50.989557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:50.989564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:50.989566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:50.989574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:50.989560Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2848
2025-10-02T08:16:50.989584Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:50.989693Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.989726Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:50.989730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:50.989740Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:50.989768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2849 partition: 0 MaxSeqNo: 17 sessionId: src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0
2025-10-02T08:16:50.990027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465f8ed-a2855a9-a31945d8-73515e0_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:50.992367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0] Write session: try to update token
2025-10-02T08:16:50.992379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:51.003709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2849 sessionId: src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:51.005925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:51.006392Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.006407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.006423Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:51.006428Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:51.006430Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:51.006435Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535440160533846:4092]
2025-10-02T08:16:51.006438Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535440160533846:4092]
2025-10-02T08:16:51.006465Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:51.006473Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:51.006476Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:51.006477Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.006478Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:51.006610Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:51.069762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535444455501210:6916]
2025-10-02T08:16:51.069874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2848, pipe: [1:7556535444455501210:6916]
2025-10-02T08:16:51.128637Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:51.128944Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:51.128978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:51.128986Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455501210:6916], now have 1 active actors on pipe
2025-10-02T08:16:51.129070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:51.129080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:51.129099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2849 reason: error at write: Disconnected sessionId: src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0
2025-10-02T08:16:51.129200Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:51.129228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2849 sessionId: src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0 is DEAD
2025-10-02T08:16:51.129358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:51.129368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0] Write session will restart in 0.006079s
2025-10-02T08:16:51.129386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0] Write session: Do CDS request
2025-10-02T08:16:51.129390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:51.129406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535444455501210:6916]
2025-10-02T08:16:51.136182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.136248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:51.136259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2850
2025-10-02T08:16:51.136349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.136371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:51.136374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:51.136377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:51.136659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2850 sessionId:  describe result for acl check
2025-10-02T08:16:51.136684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:51.136689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:51.136690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:51.136693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535444455501484:4152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:51.137047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535444455501484:4152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:51.139633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535444455501484:4152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:51.139760Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:51.141005Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:51.141185Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:51.141194Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:51.141203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:51.141245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:51.141276Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535444455501596:4136]
2025-10-02T08:16:51.141786Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:51.141934Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:51.141978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:51.142072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535444455501484:4152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:51.142081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535444455501484:4152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:51.142083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535444455501484:4152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:51.142088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:51.142271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:51.142331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.142336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.142337Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.142338Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.142339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.142343Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.142350Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.142357Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.142360Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.142367Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.142372Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.142377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.142386Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.142395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.142402Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.142406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.142413Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.142417Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.142425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.142429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.142447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:51.149644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:51.151054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:51.151066Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:51.151067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:51.151070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:51.151074Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2849 [1:7556535444455501596:4136]
2025-10-02T08:16:51.151081Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:51.151092Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:51.151094Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.151096Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.151097Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.151108Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:51.151115Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:51.151119Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:51.151158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.151163Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.151165Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:51.151167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:51.151209Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:51.151214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.151222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.151229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:51.151244Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535444455501580:4136]
2025-10-02T08:16:51.151248Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535444455501580:4136]
2025-10-02T08:16:51.151254Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:51.151260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2849
2025-10-02T08:16:51.151261Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:51.151262Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455501607:4152], now have 1 active actors on pipe
2025-10-02T08:16:51.151263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:51.151267Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:51.151275Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:51.151277Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:51.151281Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535444914724633:2378], now have 1 active actors on pipe
2025-10-02T08:16:51.151284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.151286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.151314Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535444455501580:4136]
2025-10-02T08:16:51.151322Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:51.151332Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:51.151335Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:51.151341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.151343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.151344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:51.151350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.151359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:51.151367Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2849
2025-10-02T08:16:51.151379Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.151425Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.151430Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.151438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.151467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2850 partition: 0 MaxSeqNo: 17 sessionId: src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0
2025-10-02T08:16:51.151750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e0f251c-4ccb59e3-19f02031-3e5fec3d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:51.154187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0] Write session: try to update token
2025-10-02T08:16:51.154205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:51.166860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2850 sessionId: src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:51.167164Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:51.167177Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:51.167178Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:51.167184Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535444455501580:4136]
2025-10-02T08:16:51.167187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535444455501580:4136]
2025-10-02T08:16:51.167220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:51.167229Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.167230Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:51.167296Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:51.167305Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:51.167345Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:51.169042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:51.229489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535444455501628:6916]
2025-10-02T08:16:51.229609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2849, pipe: [1:7556535444455501628:6916]
2025-10-02T08:16:51.290315Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:51.290573Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.290584Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.290613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455501628:6916], now have 1 active actors on pipe
2025-10-02T08:16:51.290718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535444455501628:6916]
2025-10-02T08:16:51.290741Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:51.290745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:51.290747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:51.290807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2850 reason: error at write: Disconnected sessionId: src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0
2025-10-02T08:16:51.290803Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:51.290978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2850 sessionId: src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0 is DEAD
2025-10-02T08:16:51.291115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:51.291124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0] Write session will restart in 0.007092s
2025-10-02T08:16:51.291142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0] Write session: Do CDS request
2025-10-02T08:16:51.291146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:51.299226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.299308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:51.299319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2851
2025-10-02T08:16:51.299427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.299453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:51.299459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:51.299462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:51.299758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:51.299805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2851 sessionId:  describe result for acl check
2025-10-02T08:16:51.299837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:51.299839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:51.299840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:51.299845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535444455501984:4204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:51.300329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535444455501984:4204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:51.300996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:51.301141Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:51.301150Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:51.301158Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:51.301198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:51.301230Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535444455502005:4176]
2025-10-02T08:16:51.301652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535444455501984:4204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:51.301817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:51.301957Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:51.301996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:51.302279Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:51.302321Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.302323Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.302324Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.302325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.302326Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.302330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.302339Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.302348Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.302353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.302358Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.302362Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.302369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.302374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.302383Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.302387Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.302392Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.302397Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.302401Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.302406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.302411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.302429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:51.306544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535444455501984:4204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:51.306555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535444455501984:4204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:51.306557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535444455501984:4204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:51.306562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:51.309514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:51.310935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:51.310945Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:51.310947Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:51.310949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:51.310953Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2850 [1:7556535444455502005:4176]
2025-10-02T08:16:51.310960Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:51.310971Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:51.310973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.310975Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.310977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.310988Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:51.310991Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:51.310996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:51.311029Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.311035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.311037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:51.311039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:51.311080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:51.311085Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.311093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.311099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:51.311113Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535444455501980:4176]
2025-10-02T08:16:51.311114Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535444455501980:4176]
2025-10-02T08:16:51.311119Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:51.311130Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:51.311136Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:51.311139Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:51.311141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:51.311143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:51.311143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2850
2025-10-02T08:16:51.311151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455502031:4204], now have 1 active actors on pipe
2025-10-02T08:16:51.311157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535444914724642:2378], now have 1 active actors on pipe
2025-10-02T08:16:51.311174Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535444455501980:4176]
2025-10-02T08:16:51.311183Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:51.311190Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.311192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.311193Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:51.311218Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a93055ba-fe920120-5041207f-632e8b9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:51.311225Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.311227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.311229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:51.311234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.311243Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:51.311233Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2850
2025-10-02T08:16:51.311257Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.311290Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.311294Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.311302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.311327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2851 partition: 0 MaxSeqNo: 17 sessionId: src_id|a93055ba-fe920120-5041207f-632e8b9d_0
2025-10-02T08:16:51.311588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dfac7-d68bd4f8-bae7d921-81980128_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a93055ba-fe920120-5041207f-632e8b9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:51.313895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a93055ba-fe920120-5041207f-632e8b9d_0] Write session: try to update token
2025-10-02T08:16:51.313905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a93055ba-fe920120-5041207f-632e8b9d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:51.325457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2851 sessionId: src_id|a93055ba-fe920120-5041207f-632e8b9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:51.327583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:51.328208Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.328227Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.328244Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:51.328251Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:51.328252Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:51.328257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535444455501980:4176]
2025-10-02T08:16:51.328260Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535444455501980:4176]
2025-10-02T08:16:51.328292Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:51.328297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:51.328301Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:51.328302Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.328303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:51.328420Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:51.390814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535444455502046:6916]
2025-10-02T08:16:51.390929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2850, pipe: [1:7556535444455502046:6916]
2025-10-02T08:16:51.451261Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:51.451657Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:51.451692Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455502046:6916], now have 1 active actors on pipe
2025-10-02T08:16:51.451831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535444455502046:6916]
2025-10-02T08:16:51.451893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:51.451959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:51.451966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:51.451966Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:51.452036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2851 reason: error at write: Disconnected sessionId: src_id|a93055ba-fe920120-5041207f-632e8b9d_0
2025-10-02T08:16:51.452210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2851 sessionId: src_id|a93055ba-fe920120-5041207f-632e8b9d_0 is DEAD
2025-10-02T08:16:51.452294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93055ba-fe920120-5041207f-632e8b9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:51.452303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93055ba-fe920120-5041207f-632e8b9d_0] Write session will restart in 0.005091s
2025-10-02T08:16:51.452318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93055ba-fe920120-5041207f-632e8b9d_0] Write session: Do CDS request
2025-10-02T08:16:51.452326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93055ba-fe920120-5041207f-632e8b9d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:51.458198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a93055ba-fe920120-5041207f-632e8b9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.458218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:51.458230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2852
2025-10-02T08:16:51.458337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.458365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:51.458373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:51.458376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:51.458739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2852 sessionId:  describe result for acl check
2025-10-02T08:16:51.458765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:51.458770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:51.458771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:51.458774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535444455502327:4193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:51.459123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535444455502327:4193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:51.461139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535444455502327:4193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:51.462322Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:51.462569Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:51.462703Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:51.462713Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:51.462721Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:51.462761Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:51.462790Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535444455502434:4215]
2025-10-02T08:16:51.463336Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:51.463469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535444455502327:4193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:51.463474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:51.463479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535444455502327:4193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:51.463481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535444455502327:4193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:51.463485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:51.463507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:51.463790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:51.463970Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.463977Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.463978Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.463990Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.463991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.463996Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.464005Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.464009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.464013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.464017Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.464022Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.464030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.464040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.464045Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.464049Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.464058Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.464062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.464067Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.464075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.464079Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.464096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:51.471342Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:51.472822Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:51.472838Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:51.472841Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:51.472844Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:51.472850Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2851 [1:7556535444455502434:4215]
2025-10-02T08:16:51.472861Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:51.472875Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:51.472883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.472886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.472888Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.472901Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:51.472906Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:51.472912Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:51.472965Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.472973Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.472976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:51.472979Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:51.473039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:51.473046Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.473057Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.473071Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:51.473092Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455502445:4193], now have 1 active actors on pipe
2025-10-02T08:16:51.473102Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535444455502428:4215]
2025-10-02T08:16:51.473104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535444455502428:4215]
2025-10-02T08:16:51.473111Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:51.473113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2851
2025-10-02T08:16:51.473119Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:51.473121Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:51.473124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535444914724648:2378], now have 1 active actors on pipe
2025-10-02T08:16:51.473131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:51.473143Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:51.473150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:51.473156Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.473160Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.473163Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2851
2025-10-02T08:16:51.473193Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535444455502428:4215]
2025-10-02T08:16:51.473203Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:51.473212Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:51.473221Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4588712-488958a6-5a48686e-506b29e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:51.473227Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.473235Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.473241Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:51.473250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.473262Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:51.473300Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.473342Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.473348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.473359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.473392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2852 partition: 0 MaxSeqNo: 17 sessionId: src_id|c4588712-488958a6-5a48686e-506b29e9_0
2025-10-02T08:16:51.473644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93055ba-fe920120-5041207f-632e8b9d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c4588712-488958a6-5a48686e-506b29e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:51.475785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4588712-488958a6-5a48686e-506b29e9_0] Write session: try to update token
2025-10-02T08:16:51.475796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4588712-488958a6-5a48686e-506b29e9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:51.487232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2852 sessionId: src_id|c4588712-488958a6-5a48686e-506b29e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:51.489078Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:51.489096Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:51.489098Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:51.489106Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535444455502428:4215]
2025-10-02T08:16:51.489110Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535444455502428:4215]
2025-10-02T08:16:51.489143Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:51.489149Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:51.489153Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:51.489155Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.489156Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:51.489279Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:51.489461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:51.552061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535444455502467:6916]
2025-10-02T08:16:51.552142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2851, pipe: [1:7556535444455502467:6916]
2025-10-02T08:16:51.614864Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:51.615113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.615122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.615151Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455502467:6916], now have 1 active actors on pipe
2025-10-02T08:16:51.615230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535444455502467:6916]
2025-10-02T08:16:51.615244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:51.615247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:51.615286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2852 reason: error at write: Disconnected sessionId: src_id|c4588712-488958a6-5a48686e-506b29e9_0
2025-10-02T08:16:51.615295Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:51.615321Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:51.615433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2852 sessionId: src_id|c4588712-488958a6-5a48686e-506b29e9_0 is DEAD
2025-10-02T08:16:51.615583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4588712-488958a6-5a48686e-506b29e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:51.615591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4588712-488958a6-5a48686e-506b29e9_0] Write session will restart in 0.009964s
2025-10-02T08:16:51.615607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4588712-488958a6-5a48686e-506b29e9_0] Write session: Do CDS request
2025-10-02T08:16:51.615612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4588712-488958a6-5a48686e-506b29e9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:51.624824Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:51.626022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:51.626137Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:51.626144Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:51.626151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:51.626179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:51.626203Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535444455502827:4232]
2025-10-02T08:16:51.626216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4588712-488958a6-5a48686e-506b29e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.626315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:51.626324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2853
2025-10-02T08:16:51.626411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.626429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:51.626436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:51.626438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:51.626658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:51.626685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2853 sessionId:  describe result for acl check
2025-10-02T08:16:51.626712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:51.626716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:51.626717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:51.626720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535444455502833:4251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:51.626790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:51.626817Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:51.627016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:51.627050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.627050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535444455502833:4251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:51.627055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.627055Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.627056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.627056Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.627059Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.627064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.627066Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.627068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.627070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.627073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.627077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.627080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.627083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.627089Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.627091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.627094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.627096Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.627098Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.627101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.627110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:51.628397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535444455502833:4251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:51.632675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535444455502833:4251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:51.632687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535444455502833:4251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:51.632690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535444455502833:4251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:51.632697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:51.634205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:51.635622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:51.635634Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:51.635635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:51.635637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:51.635641Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2852 [1:7556535444455502827:4232]
2025-10-02T08:16:51.635649Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:51.635660Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:51.635665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.635667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.635668Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.635679Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:51.635686Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:51.635690Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:51.635728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.635734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.635736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:51.635738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:51.635777Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:51.635783Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.635791Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.635804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2852
2025-10-02T08:16:51.635806Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:51.635822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455502876:4251], now have 1 active actors on pipe
2025-10-02T08:16:51.635829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535444914724655:2378], now have 1 active actors on pipe
2025-10-02T08:16:51.635833Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.635837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.635855Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535444455502821:4232]
2025-10-02T08:16:51.635861Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535444455502821:4232]
2025-10-02T08:16:51.635870Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:51.635880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:51.635883Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:51.635885Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:51.635895Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:51.635901Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:51.635914Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:51.635923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.635891Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2852
2025-10-02T08:16:51.635925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.635929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:51.635935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.635941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:51.635968Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535444455502821:4232]
2025-10-02T08:16:51.635975Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:51.635991Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:51.635996Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.636027Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.636034Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.636047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.636077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2853 partition: 0 MaxSeqNo: 17 sessionId: src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0
2025-10-02T08:16:51.636375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4588712-488958a6-5a48686e-506b29e9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:51.638713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0] Write session: try to update token
2025-10-02T08:16:51.638725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:51.650233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2853 sessionId: src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:51.652360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:51.652778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.652795Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.652829Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:51.652835Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:51.652837Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:51.652842Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535444455502821:4232]
2025-10-02T08:16:51.652845Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535444455502821:4232]
2025-10-02T08:16:51.652888Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:51.652891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:51.652896Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.652897Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:51.652900Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:51.653007Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:51.715412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535444455502893:6916]
2025-10-02T08:16:51.715480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2852, pipe: [1:7556535444455502893:6916]
2025-10-02T08:16:51.774239Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:51.774854Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:51.774889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455502893:6916], now have 1 active actors on pipe
2025-10-02T08:16:51.774916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:51.774997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:51.775002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:51.775012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2853 reason: error at write: Disconnected sessionId: src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0
2025-10-02T08:16:51.775025Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:51.775126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2853 sessionId: src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0 is DEAD
2025-10-02T08:16:51.775253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:51.775263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0] Write session will restart in 0.006491s
2025-10-02T08:16:51.775285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0] Write session: Do CDS request
2025-10-02T08:16:51.775290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:51.775322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535444455502893:6916]
2025-10-02T08:16:51.783201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.783275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:51.783288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2854
2025-10-02T08:16:51.783384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.783405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:51.783408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:51.783410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:51.783717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2854 sessionId:  describe result for acl check
2025-10-02T08:16:51.783740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:51.783741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:51.783741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:51.783744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535444455503256:4330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:51.784998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:51.785073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535444455503256:4330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:51.786488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535444455503256:4330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:51.786642Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:51.786777Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:51.786784Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:51.786790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:51.786821Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:51.786846Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535444455503292:4337]
2025-10-02T08:16:51.787213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:51.787328Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:51.787353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:51.787534Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:51.787558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.787562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.787563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.787564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.787564Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.787567Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.787572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.787574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.787576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.787577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.787580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.787584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.787587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.787590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.787592Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.787594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.787596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.787599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.787601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.787603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.787613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:51.793140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535444455503256:4330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:51.793153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535444455503256:4330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:51.793157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535444455503256:4330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:51.793164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:51.794793Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:51.796175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:51.796194Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:51.796196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:51.796200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:51.796204Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2853 [1:7556535444455503292:4337]
2025-10-02T08:16:51.796214Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:51.796229Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:51.796232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.796234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.796236Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.796250Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:51.796259Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:51.796265Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:51.796317Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.796324Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.796327Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:51.796330Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:51.796383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:51.796394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.796405Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.796405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2853
2025-10-02T08:16:51.796418Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:51.796435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455503342:4330], now have 1 active actors on pipe
2025-10-02T08:16:51.796439Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535444914724674:2378], now have 1 active actors on pipe
2025-10-02T08:16:51.796442Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.796446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.796440Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2853
2025-10-02T08:16:51.796463Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535444455503269:4337]
2025-10-02T08:16:51.796470Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535444455503269:4337]
2025-10-02T08:16:51.796477Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:51.796482Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:51.796484Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:51.796488Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:51.796502Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:51.796510Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:51.796523Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:51.796533Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.796537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.796540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:51.796549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.796562Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:51.796599Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535444455503269:4337]
2025-10-02T08:16:51.796614Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:51.796626Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:51.796628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.796668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.796675Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.796688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.796717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2854 partition: 0 MaxSeqNo: 17 sessionId: src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0
2025-10-02T08:16:51.797041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21e7283-feb23ad2-e8e5d593-ed82b524_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:51.799791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0] Write session: try to update token
2025-10-02T08:16:51.799806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:51.812840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2854 sessionId: src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:51.812985Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:51.812996Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:51.812997Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:51.813004Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535444455503269:4337]
2025-10-02T08:16:51.813007Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535444455503269:4337]
2025-10-02T08:16:51.813037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:51.813039Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:51.813042Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.813043Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:51.813044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:51.813172Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:51.815063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:51.875607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535444455503357:6916]
2025-10-02T08:16:51.875705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2853, pipe: [1:7556535444455503357:6916]
2025-10-02T08:16:51.936374Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:51.936843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.936858Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.936896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455503357:6916], now have 1 active actors on pipe
2025-10-02T08:16:51.937048Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:51.937103Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:51.937239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535444455503357:6916]
2025-10-02T08:16:51.937251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:51.937286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2854 reason: status is not ok: tablet will be restarted right now sessionId: src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0
2025-10-02T08:16:51.937403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2854 sessionId: src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0 is DEAD
2025-10-02T08:16:51.937570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:51.937582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0] Write session will restart in 0.007179s
2025-10-02T08:16:51.937603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0] Write session: Do CDS request
2025-10-02T08:16:51.937609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:51.946183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.946166Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:51.946228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:51.946240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2855
2025-10-02T08:16:51.946405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:51.946428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:51.946435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:51.946437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:51.946698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2855 sessionId:  describe result for acl check
2025-10-02T08:16:51.946721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:51.946725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:51.946727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:51.946730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535444455503721:4342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:51.947068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535444455503721:4342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:51.947195Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:51.947310Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:51.947316Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:51.947322Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:51.947351Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:51.947374Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535444455503728:4326]
2025-10-02T08:16:51.947728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:51.947845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:51.947879Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:51.948124Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:51.948156Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.948160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.948161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.948161Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.948162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.948165Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.948171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.948173Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.948175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.948176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.948180Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.948184Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:51.948187Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.948190Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:51.948192Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.948198Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:51.948200Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.948203Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.948205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.948207Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.948217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:51.948701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535444455503721:4342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:51.953567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535444455503721:4342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:51.953575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535444455503721:4342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:51.953577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535444455503721:4342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:51.953583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:51.955597Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:51.957002Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:51.957011Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:51.957013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:51.957016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:51.957019Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2854 [1:7556535444455503728:4326]
2025-10-02T08:16:51.957027Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:51.957038Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:51.957039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.957041Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.957043Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.957052Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:51.957059Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:51.957063Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:51.957099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.957104Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.957105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:51.957107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:51.957146Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:51.957151Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.957157Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:51.957167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:51.957182Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535444455503770:4342], now have 1 active actors on pipe
2025-10-02T08:16:51.957190Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535444455503714:4326]
2025-10-02T08:16:51.957191Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535444455503714:4326]
2025-10-02T08:16:51.957193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2854
2025-10-02T08:16:51.957195Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:51.957202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535444914724690:2378], now have 1 active actors on pipe
2025-10-02T08:16:51.957203Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:51.957205Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:51.957206Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:51.957212Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:51.957215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:51.957220Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.957223Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.957247Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535444455503714:4326]
2025-10-02T08:16:51.957253Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:51.957259Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:51.957266Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35a65556-a98672a6-3289d449-bc1a40c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:51.957271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:51.957278Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:51.957280Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:51.957287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:51.957260Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2854
2025-10-02T08:16:51.957298Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:51.957332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.957366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.957372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.957383Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:51.957414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2855 partition: 0 MaxSeqNo: 17 sessionId: src_id|35a65556-a98672a6-3289d449-bc1a40c9_0
2025-10-02T08:16:51.957656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a682c8-68f3f37d-ebb8dfca-9d00e2ea_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|35a65556-a98672a6-3289d449-bc1a40c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:51.959842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a65556-a98672a6-3289d449-bc1a40c9_0] Write session: try to update token
2025-10-02T08:16:51.959852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a65556-a98672a6-3289d449-bc1a40c9_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:51.971296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2855 sessionId: src_id|35a65556-a98672a6-3289d449-bc1a40c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:51.973401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:51.974022Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:51.974037Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:51.974052Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:51.974058Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:51.974060Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:51.974065Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535444455503714:4326]
2025-10-02T08:16:51.974069Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535444455503714:4326]
2025-10-02T08:16:51.974106Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:51.974109Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:51.974114Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:51.974114Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:51.974116Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:51.974228Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:52.037426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535448750471091:6916]
2025-10-02T08:16:52.037510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2854, pipe: [1:7556535448750471091:6916]
2025-10-02T08:16:52.096337Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:52.096727Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:52.096756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:52.096763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750471091:6916], now have 1 active actors on pipe
2025-10-02T08:16:52.096852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:52.096855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535448750471091:6916]
2025-10-02T08:16:52.096860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:52.096878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2855 reason: error at write: Disconnected sessionId: src_id|35a65556-a98672a6-3289d449-bc1a40c9_0
2025-10-02T08:16:52.096940Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:52.096994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2855 sessionId: src_id|35a65556-a98672a6-3289d449-bc1a40c9_0 is DEAD
2025-10-02T08:16:52.097131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a65556-a98672a6-3289d449-bc1a40c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:52.097139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a65556-a98672a6-3289d449-bc1a40c9_0] Write session will restart in 0.006566s
2025-10-02T08:16:52.097156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a65556-a98672a6-3289d449-bc1a40c9_0] Write session: Do CDS request
2025-10-02T08:16:52.097164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a65556-a98672a6-3289d449-bc1a40c9_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:52.105165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a65556-a98672a6-3289d449-bc1a40c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.105266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:52.105278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2856
2025-10-02T08:16:52.105378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.105405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:52.105414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:52.105417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:52.105715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2856 sessionId:  describe result for acl check
2025-10-02T08:16:52.105747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:52.105751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:52.105752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:52.105755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535448750471440:4365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:52.106093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535448750471440:4365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:52.106620Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:52.107532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535448750471440:4365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:52.107937Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:52.108058Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:52.108064Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:52.108070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:52.108099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:52.108122Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535448750471486:4361]
2025-10-02T08:16:52.108497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:52.108618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:52.108647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:52.108863Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:52.108897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.108901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.108901Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.108902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.108902Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.108905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.108911Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.108913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.108915Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.108917Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.108920Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.108924Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.108927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.108931Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.108933Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.108935Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.108937Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.108940Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.108942Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.108944Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.108953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:52.113138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535448750471440:4365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:52.113150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535448750471440:4365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:52.113153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535448750471440:4365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:52.113160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:52.116032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:52.117414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:52.117426Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:52.117427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:52.117429Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:52.117433Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2855 [1:7556535448750471486:4361]
2025-10-02T08:16:52.117440Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:52.117451Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:52.117452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.117454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.117455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.117466Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:52.117472Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:52.117477Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:52.117513Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.117519Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.117521Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:52.117523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:52.117561Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:52.117568Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.117575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.117581Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:52.117597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750471504:4365], now have 1 active actors on pipe
2025-10-02T08:16:52.117604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535448750471459:4361]
2025-10-02T08:16:52.117605Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535448750471459:4361]
2025-10-02T08:16:52.117607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2855
2025-10-02T08:16:52.117609Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:52.117615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535449209692005:2378], now have 1 active actors on pipe
2025-10-02T08:16:52.117620Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:52.117620Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:52.117623Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:52.117627Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:52.117629Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:52.117633Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.117636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.117658Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535448750471459:4361]
2025-10-02T08:16:52.117663Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:52.117672Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:52.117679Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.117680Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:52.117681Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.117665Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2855
2025-10-02T08:16:52.117682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:52.117688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.117693Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:52.117715Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.117750Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.117755Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.117763Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.117790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2856 partition: 0 MaxSeqNo: 17 sessionId: src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0
2025-10-02T08:16:52.118056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a65556-a98672a6-3289d449-bc1a40c9_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:52.120283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0] Write session: try to update token
2025-10-02T08:16:52.120293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:52.131562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2856 sessionId: src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:52.133754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:52.133887Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.133904Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.133922Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:52.133927Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:52.133929Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:52.133935Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535448750471459:4361]
2025-10-02T08:16:52.133937Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535448750471459:4361]
2025-10-02T08:16:52.133966Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:52.133975Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:52.133976Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:52.133980Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.133981Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:52.134101Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:52.197197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535448750471520:6916]
2025-10-02T08:16:52.197302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2855, pipe: [1:7556535448750471520:6916]
2025-10-02T08:16:52.254047Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:52.254368Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:52.254393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:52.254400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750471520:6916], now have 1 active actors on pipe
2025-10-02T08:16:52.254467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:52.254475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:52.254494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2856 reason: error at write: Disconnected sessionId: src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0
2025-10-02T08:16:52.254497Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:52.254604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2856 sessionId: src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0 is DEAD
2025-10-02T08:16:52.254726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:52.254735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0] Write session will restart in 0.006746s
2025-10-02T08:16:52.254751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0] Write session: Do CDS request
2025-10-02T08:16:52.254756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:52.254742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535448750471520:6916]
2025-10-02T08:16:52.262127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.262314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:52.262324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2857
2025-10-02T08:16:52.262404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.262424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:52.262431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:52.262433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:52.262748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2857 sessionId:  describe result for acl check
2025-10-02T08:16:52.262772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:52.262773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:52.262774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:52.262777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535448750471871:4421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:52.263096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535448750471871:4421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:52.263701Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:52.264787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:52.264908Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:52.264915Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:52.264917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535448750471871:4421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:52.264921Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:52.264949Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:52.264970Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535448750471907:4417]
2025-10-02T08:16:52.265333Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:52.265435Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:52.265458Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:52.265632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:52.265658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.265662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.265662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.265664Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.265665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.265668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.265673Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.265675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.265677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.265679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.265681Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.265685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.265688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.265691Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.265694Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.265697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.265699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.265701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.265703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.265706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.265714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:52.269765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535448750471871:4421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:52.269775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535448750471871:4421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:52.269778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535448750471871:4421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:52.269784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:52.272723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:52.274126Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:52.274138Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:52.274140Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:52.274142Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:52.274145Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2856 [1:7556535448750471907:4417]
2025-10-02T08:16:52.274151Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:52.274161Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:52.274162Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.274164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.274165Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.274174Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:52.274176Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:52.274180Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:52.274211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.274213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.274215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:52.274216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:52.274265Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:52.274273Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.274283Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.274293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2856
2025-10-02T08:16:52.274295Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:52.274308Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750471935:4421], now have 1 active actors on pipe
2025-10-02T08:16:52.274312Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535449209692014:2378], now have 1 active actors on pipe
2025-10-02T08:16:52.274315Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.274318Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.274333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535448750471888:4417]
2025-10-02T08:16:52.274340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535448750471888:4417]
2025-10-02T08:16:52.274346Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:52.274356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:52.274363Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:52.274365Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:52.274344Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2856
2025-10-02T08:16:52.274373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:52.274377Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:52.274389Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:52.274396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.274399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.274401Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:52.274407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.274415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:52.274444Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535448750471888:4417]
2025-10-02T08:16:52.274455Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:52.274463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.274466Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:52.274526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.274531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.274543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.274569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2857 partition: 0 MaxSeqNo: 17 sessionId: src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0
2025-10-02T08:16:52.274823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e9513e-f2f7b47e-c9061929-23c27d55_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:52.277049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0] Write session: try to update token
2025-10-02T08:16:52.277059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:52.288070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2857 sessionId: src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:52.290121Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:52.290135Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:52.290136Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:52.290141Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535448750471888:4417]
2025-10-02T08:16:52.290145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535448750471888:4417]
2025-10-02T08:16:52.290174Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:52.290179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.290181Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:52.290180Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:52.290184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:52.290294Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:52.290334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:52.354870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535448750471952:6916]
2025-10-02T08:16:52.354933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2856, pipe: [1:7556535448750471952:6916]
2025-10-02T08:16:52.414120Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:52.414493Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.414507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.414540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750471952:6916], now have 1 active actors on pipe
2025-10-02T08:16:52.414640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535448750471952:6916]
2025-10-02T08:16:52.414658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:52.414663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:52.414701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2857 reason: error at write: Disconnected sessionId: src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0
2025-10-02T08:16:52.414737Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:52.414756Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:52.414835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2857 sessionId: src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0 is DEAD
2025-10-02T08:16:52.414977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:52.414986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0] Write session will restart in 0.008949s
2025-10-02T08:16:52.415002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0] Write session: Do CDS request
2025-10-02T08:16:52.415006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:52.424486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:52.425185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.425232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:52.425239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2858
2025-10-02T08:16:52.425351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.425372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:52.425379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:52.425381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:52.425634Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:52.425737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2858 sessionId:  describe result for acl check
2025-10-02T08:16:52.425765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:52.425769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:52.425770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:52.425774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535448750472323:4440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:52.425780Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:52.425782Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:52.425790Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:52.425835Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:52.425861Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535448750472324:4442]
2025-10-02T08:16:52.426140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535448750472323:4440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:52.426266Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:52.426374Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:52.426400Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:52.426588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:52.426615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.426619Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.426620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.426621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.426621Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.426624Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.426630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.426633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.426635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.426637Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.426640Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.426644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.426648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.426651Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.426653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.426656Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.426658Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.426661Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.426663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.426668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.426679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:52.427661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535448750472323:4440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:52.433063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535448750472323:4440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:52.433072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535448750472323:4440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:52.433074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535448750472323:4440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:52.433079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:52.433811Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:52.435159Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:52.435171Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:52.435172Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:52.435175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:52.435178Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2857 [1:7556535448750472324:4442]
2025-10-02T08:16:52.435185Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:52.435195Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:52.435197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.435199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.435200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.435210Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:52.435214Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:52.435218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:52.435252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.435258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.435260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:52.435261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:52.435299Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:52.435304Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.435310Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.435316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:52.435329Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535448750472315:4442]
2025-10-02T08:16:52.435333Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535448750472315:4442]
2025-10-02T08:16:52.435339Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:52.435344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2857
2025-10-02T08:16:52.435346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750472370:4440], now have 1 active actors on pipe
2025-10-02T08:16:52.435346Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:52.435348Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:52.435348Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535449209692022:2378], now have 1 active actors on pipe
2025-10-02T08:16:52.435353Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:52.435361Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:52.435362Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:52.435367Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.435369Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.435363Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2857
2025-10-02T08:16:52.435389Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535448750472315:4442]
2025-10-02T08:16:52.435397Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:52.435404Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:52.435410Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:52.435419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.435421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.435422Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:52.435427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.435435Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:52.435460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.435497Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.435503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.435511Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.435533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2858 partition: 0 MaxSeqNo: 17 sessionId: src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0
2025-10-02T08:16:52.435777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b40140-198a161f-98e29dfa-5b8dfab3_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:52.438037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0] Write session: try to update token
2025-10-02T08:16:52.438049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:52.450082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2858 sessionId: src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:52.451304Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:52.451320Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:52.451323Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:52.451330Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535448750472315:4442]
2025-10-02T08:16:52.451334Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535448750472315:4442]
2025-10-02T08:16:52.451377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:52.451380Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:52.451385Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:52.451388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.451390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:52.451525Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:52.452332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:52.514622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535448750472385:6916]
2025-10-02T08:16:52.514724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2857, pipe: [1:7556535448750472385:6916]
2025-10-02T08:16:52.572473Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:52.572725Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.572735Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.572766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750472385:6916], now have 1 active actors on pipe
2025-10-02T08:16:52.572906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:52.572914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:52.572953Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:52.572958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2858 reason: error at write: Disconnected sessionId: src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0
2025-10-02T08:16:52.573016Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:52.573105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2858 sessionId: src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0 is DEAD
2025-10-02T08:16:52.573214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535448750472385:6916]
2025-10-02T08:16:52.573254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:52.573260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0] Write session will restart in 0.009988s
2025-10-02T08:16:52.573279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0] Write session: Do CDS request
2025-10-02T08:16:52.573284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:52.583841Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:52.584198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.584268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:52.584274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2859
2025-10-02T08:16:52.584362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.584382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:52.584389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:52.584391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:52.584657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2859 sessionId:  describe result for acl check
2025-10-02T08:16:52.584681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:52.584686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:52.584687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:52.584690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535448750472757:4476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:52.585037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535448750472757:4476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:52.585121Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:52.585219Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:52.585226Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:52.585232Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:52.585258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:52.585282Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535448750472763:4462]
2025-10-02T08:16:52.585641Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:52.585807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:52.585845Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:52.586037Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:52.586064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.586068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.586068Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.586069Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.586070Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.586073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.586078Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.586080Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.586082Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.586084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.586087Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.586091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.586094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.586097Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.586099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.586101Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.586103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.586106Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.586110Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.586113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.586121Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:52.586675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535448750472757:4476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:52.592062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535448750472757:4476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:52.592071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535448750472757:4476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:52.592073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535448750472757:4476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:52.592078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:52.593062Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:52.594394Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:52.594407Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:52.594408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:52.594411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:52.594414Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2858 [1:7556535448750472763:4462]
2025-10-02T08:16:52.594421Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:52.594431Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:52.594432Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.594434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.594435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.594446Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:52.594448Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:52.594453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:52.594486Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.594488Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.594490Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:52.594491Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:52.594530Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:52.594531Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.594537Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.594544Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:52.594553Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535448750472750:4462]
2025-10-02T08:16:52.594554Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535448750472750:4462]
2025-10-02T08:16:52.594559Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:52.594567Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:52.594573Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:52.594575Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:52.594583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2858
2025-10-02T08:16:52.594584Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:52.594587Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:52.594596Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750472806:4476], now have 1 active actors on pipe
2025-10-02T08:16:52.594598Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535448750472750:4462]
2025-10-02T08:16:52.594600Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:52.594607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535449209692029:2378], now have 1 active actors on pipe
2025-10-02T08:16:52.594610Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:52.594613Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.594615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.594633Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a357d0c4-4764831f-b864aa6-f2a04905_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:52.594637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.594639Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.594640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:52.594646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.594651Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:52.594661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.594687Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2858
2025-10-02T08:16:52.594712Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.594717Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.594730Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.594751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2859 partition: 0 MaxSeqNo: 17 sessionId: src_id|a357d0c4-4764831f-b864aa6-f2a04905_0
2025-10-02T08:16:52.594998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc7e951-4e41f527-c6307cc5-ddd9c238_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a357d0c4-4764831f-b864aa6-f2a04905_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:52.597259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a357d0c4-4764831f-b864aa6-f2a04905_0] Write session: try to update token
2025-10-02T08:16:52.597271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a357d0c4-4764831f-b864aa6-f2a04905_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:52.608698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2859 sessionId: src_id|a357d0c4-4764831f-b864aa6-f2a04905_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:52.610684Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:52.610701Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:52.610703Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:52.610710Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535448750472750:4462]
2025-10-02T08:16:52.610715Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535448750472750:4462]
2025-10-02T08:16:52.610726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:52.610752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:52.610762Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:52.610763Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.610765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:52.610774Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:52.610895Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:52.673333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535448750472820:6916]
2025-10-02T08:16:52.673462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2858, pipe: [1:7556535448750472820:6916]
2025-10-02T08:16:52.741308Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:52.741748Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.741758Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.741788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750472820:6916], now have 1 active actors on pipe
2025-10-02T08:16:52.741923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535448750472820:6916]
2025-10-02T08:16:52.741942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:52.741947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:52.741951Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:52.741992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2859 reason: error at write: Disconnected sessionId: src_id|a357d0c4-4764831f-b864aa6-f2a04905_0
2025-10-02T08:16:52.741976Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:52.742136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2859 sessionId: src_id|a357d0c4-4764831f-b864aa6-f2a04905_0 is DEAD
2025-10-02T08:16:52.742313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357d0c4-4764831f-b864aa6-f2a04905_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:52.742324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357d0c4-4764831f-b864aa6-f2a04905_0] Write session will restart in 0.005958s
2025-10-02T08:16:52.742345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357d0c4-4764831f-b864aa6-f2a04905_0] Write session: Do CDS request
2025-10-02T08:16:52.742351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357d0c4-4764831f-b864aa6-f2a04905_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:52.749137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a357d0c4-4764831f-b864aa6-f2a04905_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.749216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:52.749227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2860
2025-10-02T08:16:52.749319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.749341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:52.749344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:52.749346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:52.749606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2860 sessionId:  describe result for acl check
2025-10-02T08:16:52.749626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:52.749631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:52.749632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:52.749635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535448750473124:4512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:52.749988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535448750473124:4512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:52.752009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535448750473124:4512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:52.752438Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:52.753654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:52.753760Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:52.753768Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:52.753774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:52.753799Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:52.753824Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535448750473226:4499]
2025-10-02T08:16:52.754205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:52.754329Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:52.754354Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:52.754382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535448750473124:4512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:52.754395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535448750473124:4512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:52.754401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535448750473124:4512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:52.754407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:52.754532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:52.754560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.754560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.754561Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.754562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.754562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.754565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.754570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.754572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.754574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.754576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.754579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.754583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.754586Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.754588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.754591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.754593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.754596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.754598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.754601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.754603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.754613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:52.761706Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:52.762991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:52.763004Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:52.763006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:52.763009Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:52.763013Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2859 [1:7556535448750473226:4499]
2025-10-02T08:16:52.763021Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:52.763033Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:52.763034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.763036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.763037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.763047Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:52.763054Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:52.763061Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:52.763099Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.763105Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.763107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:52.763109Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:52.763154Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:52.763159Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.763166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.763176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:52.763189Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750473238:4512], now have 1 active actors on pipe
2025-10-02T08:16:52.763197Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535448750473215:4499]
2025-10-02T08:16:52.763198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535448750473215:4499]
2025-10-02T08:16:52.763203Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:52.763209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2859
2025-10-02T08:16:52.763215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:52.763216Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:52.763219Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:52.763223Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:52.763225Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:52.763229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535449209692036:2378], now have 1 active actors on pipe
2025-10-02T08:16:52.763232Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.763238Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.763263Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535448750473215:4499]
2025-10-02T08:16:52.763268Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:52.763278Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:52.763280Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:52.763285Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.763288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.763289Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:52.763257Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2859
2025-10-02T08:16:52.763309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.763318Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:52.763346Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.763390Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.763395Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.763404Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.763430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2860 partition: 0 MaxSeqNo: 17 sessionId: src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0
2025-10-02T08:16:52.763694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357d0c4-4764831f-b864aa6-f2a04905_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:52.765894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0] Write session: try to update token
2025-10-02T08:16:52.765906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:52.776891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2860 sessionId: src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:52.779067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:52.779118Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:52.779134Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:52.779136Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:52.779145Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535448750473215:4499]
2025-10-02T08:16:52.779153Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535448750473215:4499]
2025-10-02T08:16:52.779184Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:52.779192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.779194Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:52.779199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.779214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:52.779220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.779222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:52.779349Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:52.842286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535448750473294:6916]
2025-10-02T08:16:52.842382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2859, pipe: [1:7556535448750473294:6916]
2025-10-02T08:16:52.902418Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:52.902756Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750473294:6916], now have 1 active actors on pipe
2025-10-02T08:16:52.902907Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:52.902979Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:52.903251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:52.903283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535448750473294:6916]
2025-10-02T08:16:52.903309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2860 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0
2025-10-02T08:16:52.903444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2860 sessionId: src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0 is DEAD
2025-10-02T08:16:52.903607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:52.903615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0] Write session will restart in 0.006551s
2025-10-02T08:16:52.903631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0] Write session: Do CDS request
2025-10-02T08:16:52.903635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:52.911187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.911274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:52.911288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2861
2025-10-02T08:16:52.911387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:52.911416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:52.911424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:52.911427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:52.911780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2861 sessionId:  describe result for acl check
2025-10-02T08:16:52.911810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:52.911815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:52.911817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:52.911821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535448750473639:4612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:52.912184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535448750473639:4612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:52.913448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:52.914270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535448750473639:4612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:52.914731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:52.914841Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:52.914848Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:52.914854Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:52.914881Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:52.914904Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535448750473701:4593]
2025-10-02T08:16:52.915298Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:52.915445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:52.915480Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:52.915686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:52.915714Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.915717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.915718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.915719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.915719Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.915723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.915728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.915730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.915732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.915734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.915737Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.915744Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:52.915748Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.915755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:52.915757Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.915760Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:52.915762Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.915765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.915767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.915770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.915779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:52.920195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535448750473639:4612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:52.920211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535448750473639:4612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:52.920214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535448750473639:4612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:52.920222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:52.923271Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:52.924751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:52.924764Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:52.924765Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:52.924767Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:52.924771Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2860 [1:7556535448750473701:4593]
2025-10-02T08:16:52.924780Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:52.924792Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:52.924797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.924816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.924820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.924832Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:52.924839Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:52.924843Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:52.924882Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.924889Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.924891Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:52.924892Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:52.924937Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:52.924942Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.924951Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:52.924960Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:52.924974Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535448750473681:4593]
2025-10-02T08:16:52.924979Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535448750473681:4593]
2025-10-02T08:16:52.924985Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:52.924992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2860
2025-10-02T08:16:52.924993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535448750473720:4612], now have 1 active actors on pipe
2025-10-02T08:16:52.924999Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:52.925001Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:52.925004Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:52.925011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:52.925017Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:52.925021Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535449209692067:2378], now have 1 active actors on pipe
2025-10-02T08:16:52.925024Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.925026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.925044Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2860
2025-10-02T08:16:52.925056Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535448750473681:4593]
2025-10-02T08:16:52.925064Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:52.925072Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:52.925073Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d890297c-583d90de-4e2d72e3-f58e6088_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:52.925077Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:52.925079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:52.925080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:52.925086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:52.925093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:52.925116Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.925155Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:52.925159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:52.925167Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:52.925189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2861 partition: 0 MaxSeqNo: 17 sessionId: src_id|d890297c-583d90de-4e2d72e3-f58e6088_0
2025-10-02T08:16:52.925471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7bc3ef3-aa2d1953-c522b798-b4ae23c2_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|d890297c-583d90de-4e2d72e3-f58e6088_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:52.927899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d890297c-583d90de-4e2d72e3-f58e6088_0] Write session: try to update token
2025-10-02T08:16:52.927916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d890297c-583d90de-4e2d72e3-f58e6088_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:52.941172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2861 sessionId: src_id|d890297c-583d90de-4e2d72e3-f58e6088_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:52.941973Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:52.941988Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:52.941989Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:52.941995Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535448750473681:4593]
2025-10-02T08:16:52.941997Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535448750473681:4593]
2025-10-02T08:16:52.942030Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:52.942038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:52.942039Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:52.942039Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:52.942044Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:52.942156Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:52.943550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:53.003619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535453045441030:6916]
2025-10-02T08:16:53.003718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2860, pipe: [1:7556535453045441030:6916]
2025-10-02T08:16:53.062156Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:53.062417Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.062426Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.062455Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045441030:6916], now have 1 active actors on pipe
2025-10-02T08:16:53.062576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535453045441030:6916]
2025-10-02T08:16:53.062598Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:53.062599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:53.062601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:53.062651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2861 reason: error at write: Disconnected sessionId: src_id|d890297c-583d90de-4e2d72e3-f58e6088_0
2025-10-02T08:16:53.062658Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:53.062812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2861 sessionId: src_id|d890297c-583d90de-4e2d72e3-f58e6088_0 is DEAD
2025-10-02T08:16:53.062936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d890297c-583d90de-4e2d72e3-f58e6088_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:53.062941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d890297c-583d90de-4e2d72e3-f58e6088_0] Write session will restart in 0.008513s
2025-10-02T08:16:53.062960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d890297c-583d90de-4e2d72e3-f58e6088_0] Write session: Do CDS request
2025-10-02T08:16:53.062964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d890297c-583d90de-4e2d72e3-f58e6088_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:53.072196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d890297c-583d90de-4e2d72e3-f58e6088_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.072254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:53.072265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2862
2025-10-02T08:16:53.072285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:53.072378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.072404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:53.072411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:53.072414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:53.072667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2862 sessionId:  describe result for acl check
2025-10-02T08:16:53.072687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:53.072691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:53.072692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:53.072695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535453045441419:4641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:53.073032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535453045441419:4641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:53.073475Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:53.073599Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:53.073606Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:53.073613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:53.073646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:53.073671Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535453045441426:4637]
2025-10-02T08:16:53.074060Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:53.074189Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:53.074213Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:53.074395Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:53.074421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.074422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.074422Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.074423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.074423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.074426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.074432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.074434Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.074436Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.074438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.074441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.074445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.074448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.074451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.074453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.074457Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.074460Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.074462Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.074464Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.074467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.074476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:53.074648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535453045441419:4641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:53.079626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535453045441419:4641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:53.079638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535453045441419:4641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:53.079642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535453045441419:4641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:53.079649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:53.081626Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:53.083227Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:53.083241Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:53.083243Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:53.083245Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:53.083248Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2861 [1:7556535453045441426:4637]
2025-10-02T08:16:53.083255Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:53.083266Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:53.083268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.083270Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.083271Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.083282Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:53.083285Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:53.083290Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:53.083326Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.083332Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.083334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:53.083335Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:53.083377Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:53.083383Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.083390Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.083404Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:53.083415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045441466:4641], now have 1 active actors on pipe
2025-10-02T08:16:53.083415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2861
2025-10-02T08:16:53.083420Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535453045441412:4637]
2025-10-02T08:16:53.083421Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535453045441412:4637]
2025-10-02T08:16:53.083426Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:53.083432Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.083434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.083446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535453504659381:2378], now have 1 active actors on pipe
2025-10-02T08:16:53.083449Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:53.083452Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:53.083453Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:53.083460Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:53.083463Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:53.083488Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c22e4279-4872aab2-bb9775b9-a0464894_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:53.083497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.083499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.083500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:53.083506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.083512Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:53.083519Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535453045441412:4637]
2025-10-02T08:16:53.083521Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:53.083524Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:53.083494Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2861
2025-10-02T08:16:53.083540Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.083580Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.083585Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.083597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.083623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2862 partition: 0 MaxSeqNo: 17 sessionId: src_id|c22e4279-4872aab2-bb9775b9-a0464894_0
2025-10-02T08:16:53.083863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d890297c-583d90de-4e2d72e3-f58e6088_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|c22e4279-4872aab2-bb9775b9-a0464894_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:53.086119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22e4279-4872aab2-bb9775b9-a0464894_0] Write session: try to update token
2025-10-02T08:16:53.086131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22e4279-4872aab2-bb9775b9-a0464894_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:53.097884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2862 sessionId: src_id|c22e4279-4872aab2-bb9775b9-a0464894_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:53.099327Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:53.099341Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:53.099342Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:53.099348Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535453045441412:4637]
2025-10-02T08:16:53.099352Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535453045441412:4637]
2025-10-02T08:16:53.099382Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:53.099386Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.099388Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:53.099396Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:53.099400Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:53.099502Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:53.100022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:53.162820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535453045441481:6916]
2025-10-02T08:16:53.162953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2861, pipe: [1:7556535453045441481:6916]
2025-10-02T08:16:53.218240Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:53.218622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.218631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.218661Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045441481:6916], now have 1 active actors on pipe
2025-10-02T08:16:53.218744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:53.218749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:53.218795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2862 reason: error at write: Disconnected sessionId: src_id|c22e4279-4872aab2-bb9775b9-a0464894_0
2025-10-02T08:16:53.218859Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:53.218878Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:53.218940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2862 sessionId: src_id|c22e4279-4872aab2-bb9775b9-a0464894_0 is DEAD
2025-10-02T08:16:53.219098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535453045441481:6916]
2025-10-02T08:16:53.219110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22e4279-4872aab2-bb9775b9-a0464894_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:53.219118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22e4279-4872aab2-bb9775b9-a0464894_0] Write session will restart in 0.008077s
2025-10-02T08:16:53.219135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22e4279-4872aab2-bb9775b9-a0464894_0] Write session: Do CDS request
2025-10-02T08:16:53.219140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22e4279-4872aab2-bb9775b9-a0464894_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:53.228196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c22e4279-4872aab2-bb9775b9-a0464894_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.228239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:53.228254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2863
2025-10-02T08:16:53.228392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.228417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:53.228420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:53.228423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:53.228737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2863 sessionId:  describe result for acl check
2025-10-02T08:16:53.228771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:53.228777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:53.228779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:53.228785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535453045441855:4691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:53.229199Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:53.229287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535453045441855:4691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:53.230476Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:53.230625Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:53.230638Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:53.230647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:53.230693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:53.230723Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535453045441882:4685]
2025-10-02T08:16:53.231111Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:53.231165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535453045441855:4691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:53.231265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:53.231300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:53.231554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:53.231584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.231589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.231589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.231590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.231590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.231594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.231599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.231601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.231603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.231605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.231608Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.231612Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.231616Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.231620Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.231622Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.231625Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.231627Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.231630Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.231632Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.231635Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.231646Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:53.237052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535453045441855:4691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:53.237063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535453045441855:4691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:53.237065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535453045441855:4691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:53.237071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:53.238718Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:53.240102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:53.240112Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:53.240113Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:53.240116Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:53.240121Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2862 [1:7556535453045441882:4685]
2025-10-02T08:16:53.240127Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:53.240138Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:53.240140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.240141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.240143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.240153Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:53.240156Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:53.240160Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:53.240199Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.240205Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.240207Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:53.240208Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:53.240247Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:53.240253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.240260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.240266Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:53.240279Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535453045441857:4685]
2025-10-02T08:16:53.240282Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535453045441857:4685]
2025-10-02T08:16:53.240287Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:53.240292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2862
2025-10-02T08:16:53.240295Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:53.240297Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045441909:4691], now have 1 active actors on pipe
2025-10-02T08:16:53.240297Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:53.240299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535453504659387:2378], now have 1 active actors on pipe
2025-10-02T08:16:53.240303Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:53.240311Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:53.240312Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:53.240316Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.240319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.240343Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535453045441857:4685]
2025-10-02T08:16:53.240348Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:53.240351Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:53.240357Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:53.240361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.240338Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2862
2025-10-02T08:16:53.240374Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.240379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:53.240384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.240389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:53.240416Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.240481Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.240486Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.240495Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.240519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2863 partition: 0 MaxSeqNo: 17 sessionId: src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0
2025-10-02T08:16:53.240827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c22e4279-4872aab2-bb9775b9-a0464894_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:53.243081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0] Write session: try to update token
2025-10-02T08:16:53.243094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:53.254692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2863 sessionId: src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:53.256103Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:53.256117Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:53.256119Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:53.256125Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535453045441857:4685]
2025-10-02T08:16:53.256127Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535453045441857:4685]
2025-10-02T08:16:53.256158Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:53.256167Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.256170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:53.256169Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:53.256175Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:53.256286Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:53.257066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:53.318930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535453045441924:6916]
2025-10-02T08:16:53.319024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2862, pipe: [1:7556535453045441924:6916]
2025-10-02T08:16:53.375510Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:53.375773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.375783Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.375811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045441924:6916], now have 1 active actors on pipe
2025-10-02T08:16:53.375942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:53.375952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:53.375962Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:53.376030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2863 reason: error at write: Disconnected sessionId: src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0
2025-10-02T08:16:53.376091Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:53.376180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2863 sessionId: src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0 is DEAD
2025-10-02T08:16:53.376224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535453045441924:6916]
2025-10-02T08:16:53.376293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:53.376300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0] Write session will restart in 0.008013s
2025-10-02T08:16:53.376319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0] Write session: Do CDS request
2025-10-02T08:16:53.376323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:53.385128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.385265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:53.385277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2864
2025-10-02T08:16:53.385388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.385425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:53.385433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:53.385437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:53.385790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2864 sessionId:  describe result for acl check
2025-10-02T08:16:53.385814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:53.385816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:53.385816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:53.385819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535453045442299:4699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:53.386052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:53.386141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535453045442299:4699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:53.387398Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:53.387513Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:53.387520Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:53.387526Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:53.387555Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:53.387579Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535453045442325:4703]
2025-10-02T08:16:53.387814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535453045442299:4699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:53.387945Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:53.388090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:53.388139Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:53.388441Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:53.388491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.388497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.388498Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.388499Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.388500Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.388505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.388514Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.388522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.388530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.388538Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.388542Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.388553Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.388562Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.388571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.388579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.388587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.388595Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.388599Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.388603Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.388611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.388631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:53.392938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535453045442299:4699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:53.392951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535453045442299:4699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:53.392953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535453045442299:4699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:53.392959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:53.395727Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:53.397242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:53.397256Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:53.397257Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:53.397260Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:53.397264Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2863 [1:7556535453045442325:4703]
2025-10-02T08:16:53.397271Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:53.397283Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:53.397284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.397286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.397288Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.397299Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:53.397302Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:53.397306Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:53.397345Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.397351Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.397353Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:53.397355Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:53.397398Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:53.397403Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.397410Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.397416Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:53.397427Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535453045442301:4703]
2025-10-02T08:16:53.397432Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535453045442301:4703]
2025-10-02T08:16:53.397438Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:53.397443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2863
2025-10-02T08:16:53.397445Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:53.397446Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045442352:4699], now have 1 active actors on pipe
2025-10-02T08:16:53.397447Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:53.397451Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:53.397459Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:53.397461Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:53.397465Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535453504659396:2378], now have 1 active actors on pipe
2025-10-02T08:16:53.397469Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.397471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.397499Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535453045442301:4703]
2025-10-02T08:16:53.397508Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:53.397515Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:53.397530Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2863
2025-10-02T08:16:53.397518Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20d25173-bd37acc1-f66c0069-414bbd41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:53.397522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.397524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.397525Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:53.397531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.397537Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:53.397555Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.397589Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.397590Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.397598Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.397625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2864 partition: 0 MaxSeqNo: 17 sessionId: src_id|20d25173-bd37acc1-f66c0069-414bbd41_0
2025-10-02T08:16:53.397968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6bc4d02-e9135d46-6277e80f-b0932287_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|20d25173-bd37acc1-f66c0069-414bbd41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:53.400188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20d25173-bd37acc1-f66c0069-414bbd41_0] Write session: try to update token
2025-10-02T08:16:53.400200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20d25173-bd37acc1-f66c0069-414bbd41_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:53.412472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2864 sessionId: src_id|20d25173-bd37acc1-f66c0069-414bbd41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:53.413511Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:53.413524Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:53.413525Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:53.413531Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535453045442301:4703]
2025-10-02T08:16:53.413535Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535453045442301:4703]
2025-10-02T08:16:53.413567Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:53.413575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.413577Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:53.413583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:53.413589Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:53.413697Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:53.414921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:53.476136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535453045442367:6916]
2025-10-02T08:16:53.476289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2863, pipe: [1:7556535453045442367:6916]
2025-10-02T08:16:53.536772Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:53.537139Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.537150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.537181Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045442367:6916], now have 1 active actors on pipe
2025-10-02T08:16:53.537331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535453045442367:6916]
2025-10-02T08:16:53.537356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:53.537362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:53.537383Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:53.537397Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:53.537423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2864 reason: error at write: Disconnected sessionId: src_id|20d25173-bd37acc1-f66c0069-414bbd41_0
2025-10-02T08:16:53.537594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2864 sessionId: src_id|20d25173-bd37acc1-f66c0069-414bbd41_0 is DEAD
2025-10-02T08:16:53.537744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d25173-bd37acc1-f66c0069-414bbd41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:53.537754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d25173-bd37acc1-f66c0069-414bbd41_0] Write session will restart in 0.005750s
2025-10-02T08:16:53.537777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d25173-bd37acc1-f66c0069-414bbd41_0] Write session: Do CDS request
2025-10-02T08:16:53.537783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d25173-bd37acc1-f66c0069-414bbd41_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:53.544177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20d25173-bd37acc1-f66c0069-414bbd41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.544228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:53.544238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2865
2025-10-02T08:16:53.544336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.544355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:53.544361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:53.544364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:53.544697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2865 sessionId:  describe result for acl check
2025-10-02T08:16:53.544717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:53.544718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:53.544718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:53.544721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535453045442663:4771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:53.545197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535453045442663:4771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:53.547683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535453045442663:4771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:53.549690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:53.549961Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:53.550058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535453045442663:4771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:53.550069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535453045442663:4771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:53.550071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535453045442663:4771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:53.550075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:53.550105Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:53.550113Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:53.550120Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:53.550155Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:53.550192Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535453045442783:4734]
2025-10-02T08:16:53.550570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:53.550736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:53.550770Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:53.550987Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:53.551016Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.551020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.551020Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.551021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.551021Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.551025Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.551030Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.551032Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.551034Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.551036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.551039Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.551043Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.551050Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.551054Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.551061Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.551065Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.551073Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.551077Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.551084Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.551091Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.551107Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:53.558191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:53.559633Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:53.559648Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:53.559649Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:53.559652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:53.559655Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2864 [1:7556535453045442783:4734]
2025-10-02T08:16:53.559662Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:53.559673Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:53.559675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.559676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.559678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.559688Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:53.559691Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:53.559695Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:53.559728Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.559734Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.559736Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:53.559738Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:53.559781Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:53.559786Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.559793Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.559800Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:53.559815Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535453045442774:4734]
2025-10-02T08:16:53.559820Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535453045442774:4734]
2025-10-02T08:16:53.559825Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:53.559835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:53.559837Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:53.559837Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:53.559845Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:53.559850Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:53.559857Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535453504659402:2378], now have 1 active actors on pipe
2025-10-02T08:16:53.559870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2864
2025-10-02T08:16:53.559877Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045442785:4771], now have 1 active actors on pipe
2025-10-02T08:16:53.559878Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535453045442774:4734]
2025-10-02T08:16:53.559880Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:53.559884Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.559886Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.559890Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:53.559911Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:53.559919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.559925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.559926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:53.559932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.559942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:53.559917Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2864
2025-10-02T08:16:53.559955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.559998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.560003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.560012Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.560037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2865 partition: 0 MaxSeqNo: 17 sessionId: src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0
2025-10-02T08:16:53.560312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20d25173-bd37acc1-f66c0069-414bbd41_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:53.562598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0] Write session: try to update token
2025-10-02T08:16:53.562611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:53.575095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2865 sessionId: src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:53.576180Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:53.576198Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:53.576200Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:53.576209Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535453045442774:4734]
2025-10-02T08:16:53.576214Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535453045442774:4734]
2025-10-02T08:16:53.576251Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:53.576253Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:53.576260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.576261Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:53.576263Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:53.576386Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:53.577565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:53.637436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535453045442814:6916]
2025-10-02T08:16:53.637563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2864, pipe: [1:7556535453045442814:6916]
2025-10-02T08:16:53.698650Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:53.698942Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.698952Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.698982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045442814:6916], now have 1 active actors on pipe
2025-10-02T08:16:53.699140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535453045442814:6916]
2025-10-02T08:16:53.699172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:53.699181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:53.699234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2865 reason: error at write: Disconnected sessionId: src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0
2025-10-02T08:16:53.699236Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:53.699424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2865 sessionId: src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0 is DEAD
2025-10-02T08:16:53.699456Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:53.699560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:53.699569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0] Write session will restart in 0.008494s
2025-10-02T08:16:53.699587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0] Write session: Do CDS request
2025-10-02T08:16:53.699592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:53.708654Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:53.709131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.709221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:53.709231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2866
2025-10-02T08:16:53.709315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.709334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:53.709340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:53.709343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:53.709642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2866 sessionId:  describe result for acl check
2025-10-02T08:16:53.709668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:53.709673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:53.709674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:53.709677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535453045443199:4807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:53.709766Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:53.709876Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:53.709883Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:53.709890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:53.709919Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:53.709943Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535453045443201:4780]
2025-10-02T08:16:53.710002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535453045443199:4807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:53.710306Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:53.710427Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:53.710451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:53.710623Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:53.710648Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.710652Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.710653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.710653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.710654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.710657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.710663Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.710665Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.710667Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.710668Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.710671Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.710676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.710682Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.710685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.710690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.710693Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.710695Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.710697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.710708Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.710713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.710722Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:53.711649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535453045443199:4807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:53.716687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535453045443199:4807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:53.716697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535453045443199:4807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:53.716699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535453045443199:4807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:53.716704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:53.717639Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:53.718943Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:53.718952Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:53.718954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:53.718956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:53.718959Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2865 [1:7556535453045443201:4780]
2025-10-02T08:16:53.718965Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:53.718975Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:53.718977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.718978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.718980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.718989Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:53.718992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:53.718996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:53.719028Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.719033Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.719035Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:53.719037Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:53.719102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2865
2025-10-02T08:16:53.719128Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:53.719133Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.719140Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.719149Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:53.719164Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045443246:4807], now have 1 active actors on pipe
2025-10-02T08:16:53.719143Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2865
2025-10-02T08:16:53.719169Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535453504659408:2378], now have 1 active actors on pipe
2025-10-02T08:16:53.719173Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.719176Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.719186Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535453045443192:4780]
2025-10-02T08:16:53.719187Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535453045443192:4780]
2025-10-02T08:16:53.719194Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:53.719204Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:53.719208Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:53.719211Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:53.719215Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:53.719217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:53.719226Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52940a33-50eaac2d-5253007d-d8a41109_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:53.719234Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.719239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.719240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:53.719245Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.719253Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:53.719273Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535453045443192:4780]
2025-10-02T08:16:53.719280Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:53.719288Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:53.719289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.719319Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.719324Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.719333Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.719357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2866 partition: 0 MaxSeqNo: 17 sessionId: src_id|52940a33-50eaac2d-5253007d-d8a41109_0
2025-10-02T08:16:53.719583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5934b53-a7ec4e9d-62ac6fa5-ced09931_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|52940a33-50eaac2d-5253007d-d8a41109_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:53.721760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52940a33-50eaac2d-5253007d-d8a41109_0] Write session: try to update token
2025-10-02T08:16:53.721773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52940a33-50eaac2d-5253007d-d8a41109_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:53.733093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2866 sessionId: src_id|52940a33-50eaac2d-5253007d-d8a41109_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:53.735012Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:53.735029Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:53.735030Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:53.735036Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535453045443192:4780]
2025-10-02T08:16:53.735039Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535453045443192:4780]
2025-10-02T08:16:53.735067Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:53.735073Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:53.735076Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:53.735078Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.735080Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:53.735123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:53.735194Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:53.799230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535453045443264:6916]
2025-10-02T08:16:53.799310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2865, pipe: [1:7556535453045443264:6916]
2025-10-02T08:16:53.854056Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:53.854435Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.854444Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.854472Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045443264:6916], now have 1 active actors on pipe
2025-10-02T08:16:53.854559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535453045443264:6916]
2025-10-02T08:16:53.854577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:53.854583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:53.854614Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:53.854625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2866 reason: error at write: Disconnected sessionId: src_id|52940a33-50eaac2d-5253007d-d8a41109_0
2025-10-02T08:16:53.854614Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:53.854795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2866 sessionId: src_id|52940a33-50eaac2d-5253007d-d8a41109_0 is DEAD
2025-10-02T08:16:53.854929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52940a33-50eaac2d-5253007d-d8a41109_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:53.854934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52940a33-50eaac2d-5253007d-d8a41109_0] Write session will restart in 0.007680s
2025-10-02T08:16:53.854951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52940a33-50eaac2d-5253007d-d8a41109_0] Write session: Do CDS request
2025-10-02T08:16:53.854956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52940a33-50eaac2d-5253007d-d8a41109_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:53.863158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52940a33-50eaac2d-5253007d-d8a41109_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.863257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:53.863268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2867
2025-10-02T08:16:53.863354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:53.863374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:53.863380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:53.863382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:53.863698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2867 sessionId:  describe result for acl check
2025-10-02T08:16:53.863728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:53.863734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:53.863736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:53.863740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535453045443680:4937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:53.864070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535453045443680:4937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:53.864154Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:53.865631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:53.865695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535453045443680:4937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:53.865757Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:53.865764Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:53.865771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:53.865802Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:53.865825Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535453045443709:4933]
2025-10-02T08:16:53.866242Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:53.866379Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:53.866414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:53.866614Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:53.866638Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.866642Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.866643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.866643Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.866644Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.866647Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.866653Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.866655Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.866657Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.866659Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.866662Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.866666Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:53.866669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.866672Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:53.866675Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.866677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:53.866679Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.866685Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.866688Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.866690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.866703Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:53.870870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535453045443680:4937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:53.870880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535453045443680:4937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:53.870883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535453045443680:4937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:53.870888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:53.873683Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:53.875145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:53.875156Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:53.875157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:53.875160Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:53.875163Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2866 [1:7556535453045443709:4933]
2025-10-02T08:16:53.875171Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:53.875184Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:53.875187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.875190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.875191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.875204Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:53.875213Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:53.875218Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:53.875255Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.875260Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.875262Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:53.875264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:53.875303Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:53.875308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.875316Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:53.875328Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:53.875339Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045443736:4937], now have 1 active actors on pipe
2025-10-02T08:16:53.875344Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535453045443689:4933]
2025-10-02T08:16:53.875345Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535453045443689:4933]
2025-10-02T08:16:53.875350Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:53.875357Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:53.875363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2866
2025-10-02T08:16:53.875364Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:53.875365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:53.875367Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:53.875367Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:53.875371Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535453504659438:2378], now have 1 active actors on pipe
2025-10-02T08:16:53.875388Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535453045443689:4933]
2025-10-02T08:16:53.875395Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:53.875398Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:53.875399Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.875401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.875428Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28372dbc-21f0d530-5a98929-4b2318dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:53.875435Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:53.875438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:53.875439Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:53.875420Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2866
2025-10-02T08:16:53.875444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:53.875453Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:53.875468Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.875521Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:53.875525Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:53.875533Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:53.875559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2867 partition: 0 MaxSeqNo: 17 sessionId: src_id|28372dbc-21f0d530-5a98929-4b2318dd_0
2025-10-02T08:16:53.875828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52940a33-50eaac2d-5253007d-d8a41109_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|28372dbc-21f0d530-5a98929-4b2318dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:53.878145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28372dbc-21f0d530-5a98929-4b2318dd_0] Write session: try to update token
2025-10-02T08:16:53.878157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28372dbc-21f0d530-5a98929-4b2318dd_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:53.889741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2867 sessionId: src_id|28372dbc-21f0d530-5a98929-4b2318dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:53.891321Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:53.891336Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:53.891338Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:53.891346Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535453045443689:4933]
2025-10-02T08:16:53.891350Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535453045443689:4933]
2025-10-02T08:16:53.891386Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:53.891389Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:53.891394Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:53.891396Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:53.891397Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:53.891525Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:53.891852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:53.954859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535453045443752:6916]
2025-10-02T08:16:53.954923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2866, pipe: [1:7556535453045443752:6916]
2025-10-02T08:16:54.014583Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:54.014773Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.014782Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.014811Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535453045443752:6916], now have 1 active actors on pipe
2025-10-02T08:16:54.014896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:54.014907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:54.014961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2867 reason: error at write: Disconnected sessionId: src_id|28372dbc-21f0d530-5a98929-4b2318dd_0
2025-10-02T08:16:54.014988Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:54.015125Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:54.015155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2867 sessionId: src_id|28372dbc-21f0d530-5a98929-4b2318dd_0 is DEAD
2025-10-02T08:16:54.015251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28372dbc-21f0d530-5a98929-4b2318dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:54.015256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28372dbc-21f0d530-5a98929-4b2318dd_0] Write session will restart in 0.009405s
2025-10-02T08:16:54.015273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28372dbc-21f0d530-5a98929-4b2318dd_0] Write session: Do CDS request
2025-10-02T08:16:54.015279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28372dbc-21f0d530-5a98929-4b2318dd_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:54.015343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535453045443752:6916]
2025-10-02T08:16:54.024575Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:54.025179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:54.025186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28372dbc-21f0d530-5a98929-4b2318dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.025185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2868
2025-10-02T08:16:54.025367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.025395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:54.025401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:54.025404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:54.025677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2868 sessionId:  describe result for acl check
2025-10-02T08:16:54.025699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:54.025700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:54.025701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:54.025704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535457340411438:5002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:54.025829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:54.025952Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:54.025959Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:54.025965Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:54.025998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535457340411438:5002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:54.026000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:54.026021Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535457340411440:4996]
2025-10-02T08:16:54.026510Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:54.026686Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:54.026724Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:54.026927Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:54.026953Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.026959Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.026960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.026960Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.026961Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.026964Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.026969Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.026971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.026973Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.026975Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.026979Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.026983Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.026986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.026988Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.026991Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.026993Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.026995Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.026998Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.027000Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.027003Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.027013Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:54.027515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535457340411438:5002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:54.033213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535457340411438:5002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:54.033225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535457340411438:5002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:54.033227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535457340411438:5002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:54.033232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:54.034145Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:54.035573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:54.035585Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:54.035587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:54.035589Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:54.035594Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2867 [1:7556535457340411440:4996]
2025-10-02T08:16:54.035601Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:54.035614Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:54.035619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.035620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.035622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.035633Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:54.035640Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:54.035644Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:54.035690Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.035698Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.035700Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:54.035701Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:54.035747Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:54.035752Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.035758Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.035765Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:54.035778Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340411497:5002], now have 1 active actors on pipe
2025-10-02T08:16:54.035781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2867
2025-10-02T08:16:54.035786Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535457340411431:4996]
2025-10-02T08:16:54.035788Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535457340411431:4996]
2025-10-02T08:16:54.035792Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:54.035798Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535457799626740:2378], now have 1 active actors on pipe
2025-10-02T08:16:54.035800Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:54.035802Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:54.035807Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:54.035810Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:54.035811Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:54.035816Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.035818Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.035843Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535457340411431:4996]
2025-10-02T08:16:54.035849Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:54.035860Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:54.035861Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:54.035868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.035870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.035871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:54.035876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.035885Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:54.035847Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2867
2025-10-02T08:16:54.035912Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.035943Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.035948Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.035956Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.035993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2868 partition: 0 MaxSeqNo: 17 sessionId: src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0
2025-10-02T08:16:54.036280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28372dbc-21f0d530-5a98929-4b2318dd_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:54.038552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0] Write session: try to update token
2025-10-02T08:16:54.038566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:54.050863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2868 sessionId: src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:54.051919Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:54.051934Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:54.051937Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:54.051945Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535457340411431:4996]
2025-10-02T08:16:54.051949Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535457340411431:4996]
2025-10-02T08:16:54.051991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:54.051999Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.052000Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:54.052042Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:54.052053Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:54.052119Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:54.053060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:54.115642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535457340411511:6916]
2025-10-02T08:16:54.115720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2867, pipe: [1:7556535457340411511:6916]
2025-10-02T08:16:54.173816Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:54.174069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.174079Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.174110Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340411511:6916], now have 1 active actors on pipe
2025-10-02T08:16:54.174208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535457340411511:6916]
2025-10-02T08:16:54.174226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:54.174229Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:54.174232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:54.174282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2868 reason: error at write: Disconnected sessionId: src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0
2025-10-02T08:16:54.174280Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:54.174433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2868 sessionId: src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0 is DEAD
2025-10-02T08:16:54.174588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:54.174597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0] Write session will restart in 0.006478s
2025-10-02T08:16:54.174615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0] Write session: Do CDS request
2025-10-02T08:16:54.174620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:54.182137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.182256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:54.182269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2869
2025-10-02T08:16:54.182358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.182380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:54.182387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:54.182390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:54.182661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2869 sessionId:  describe result for acl check
2025-10-02T08:16:54.182689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:54.182693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:54.182694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:54.182698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535457340411875:5026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:54.183088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535457340411875:5026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:54.184352Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:54.185068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535457340411875:5026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:54.185601Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:54.185816Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:54.185824Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:54.185831Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:54.185868Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:54.185898Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535457340411935:5015]
2025-10-02T08:16:54.186295Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:54.186445Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:54.186484Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:54.186701Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:54.186728Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.186733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.186733Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.186734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.186735Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.186738Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.186745Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.186747Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.186749Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.186751Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.186755Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.186759Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.186763Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.186766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.186769Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.186771Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.186774Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.186777Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.186779Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.186782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.186792Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:54.187481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535457340411875:5026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:54.187490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535457340411875:5026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:54.187492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535457340411875:5026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:54.187497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:54.197291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:54.198791Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:54.198805Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:54.198807Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:54.198810Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:54.198815Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2868 [1:7556535457340411935:5015]
2025-10-02T08:16:54.198823Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:54.198836Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:54.198842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.198845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.198846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.198857Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:54.198865Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:54.198870Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:54.198919Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.198925Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.198927Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:54.198929Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:54.198972Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:54.198977Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.198985Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.198991Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:54.199009Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340411952:5026], now have 1 active actors on pipe
2025-10-02T08:16:54.199016Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535457340411914:5015]
2025-10-02T08:16:54.199018Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535457340411914:5015]
2025-10-02T08:16:54.199019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2868
2025-10-02T08:16:54.199024Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:54.199034Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:54.199034Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:54.199037Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:54.199045Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:54.199047Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:54.199051Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535457799626758:2378], now have 1 active actors on pipe
2025-10-02T08:16:54.199054Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.199056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.199088Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535457340411914:5015]
2025-10-02T08:16:54.199097Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:54.199110Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:54.199112Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:54.199117Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.199119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.199120Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:54.199125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.199130Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:54.199153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.199126Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2868
2025-10-02T08:16:54.199192Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.199197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.199205Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.199235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2869 partition: 0 MaxSeqNo: 17 sessionId: src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0
2025-10-02T08:16:54.199522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff09a-7e4eb322-f0cdfb6b-17ae0140_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:54.201774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0] Write session: try to update token
2025-10-02T08:16:54.201787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:54.213321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2869 sessionId: src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:54.215077Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:54.215092Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:54.215094Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:54.215101Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535457340411914:5015]
2025-10-02T08:16:54.215104Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535457340411914:5015]
2025-10-02T08:16:54.215136Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:54.215136Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:54.215141Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:54.215141Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.215142Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:54.215261Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:54.215689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:54.274350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535457340411966:6916]
2025-10-02T08:16:54.274436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2868, pipe: [1:7556535457340411966:6916]
2025-10-02T08:16:54.337135Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:54.337587Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.337597Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.337628Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340411966:6916], now have 1 active actors on pipe
2025-10-02T08:16:54.337733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535457340411966:6916]
2025-10-02T08:16:54.337751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:54.337755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:54.337796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2869 reason: error at write: Disconnected sessionId: src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0
2025-10-02T08:16:54.337815Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:54.337895Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:54.337929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2869 sessionId: src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0 is DEAD
2025-10-02T08:16:54.338068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:54.338076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0] Write session will restart in 0.008386s
2025-10-02T08:16:54.338094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0] Write session: Do CDS request
2025-10-02T08:16:54.338099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:54.347153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.347222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:54.347238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2870
2025-10-02T08:16:54.347332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.347363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:54.347370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:54.347373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:54.347641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2870 sessionId:  describe result for acl check
2025-10-02T08:16:54.347662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:54.347667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:54.347668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:54.347671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535457340412343:5040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:54.348014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535457340412343:5040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:54.348547Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:54.349858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535457340412343:5040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:54.350043Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:54.350216Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:54.350223Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:54.350230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:54.350265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:54.350291Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535457340412388:5028]
2025-10-02T08:16:54.350676Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:54.350834Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:54.350890Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:54.351176Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:54.351211Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.351215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.351216Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.351217Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.351218Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.351222Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.351230Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.351234Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.351241Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.351244Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.351248Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.351258Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.351267Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.351275Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.351283Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.351287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.351294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.351300Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.351307Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.351312Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.351330Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:54.351678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535457340412343:5040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:54.351688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535457340412343:5040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:54.351691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535457340412343:5040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:54.351697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:54.358497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:54.360083Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:54.360096Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:54.360099Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:54.360102Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:54.360106Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2869 [1:7556535457340412388:5028]
2025-10-02T08:16:54.360117Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:54.360131Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:54.360137Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.360139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.360141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.360154Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:54.360161Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:54.360167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:54.360216Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.360222Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.360225Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:54.360227Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:54.360282Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:54.360288Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.360297Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.360309Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:54.360328Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340412407:5040], now have 1 active actors on pipe
2025-10-02T08:16:54.360327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2869
2025-10-02T08:16:54.360338Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535457340412360:5028]
2025-10-02T08:16:54.360340Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535457340412360:5028]
2025-10-02T08:16:54.360346Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:54.360356Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:54.360357Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:54.360360Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:54.360368Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:54.360373Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:54.360378Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535457799626767:2378], now have 1 active actors on pipe
2025-10-02T08:16:54.360381Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.360385Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.360412Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535457340412360:5028]
2025-10-02T08:16:54.360421Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:54.360433Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:54.360435Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:54.360442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.360445Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.360446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:54.360454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.360466Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:54.360455Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2869
2025-10-02T08:16:54.360496Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.360526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.360532Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.360543Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.360574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2870 partition: 0 MaxSeqNo: 17 sessionId: src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0
2025-10-02T08:16:54.360880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc6cca1-3c747d64-31164590-a734b1e6_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:54.363163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0] Write session: try to update token
2025-10-02T08:16:54.363177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:54.374730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2870 sessionId: src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:54.376241Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:54.376257Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:54.376258Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:54.376265Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535457340412360:5028]
2025-10-02T08:16:54.376268Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535457340412360:5028]
2025-10-02T08:16:54.376298Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:54.376306Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.376308Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:54.376317Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:54.376335Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:54.376433Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:54.376932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:54.437689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535457340412421:6916]
2025-10-02T08:16:54.437766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2869, pipe: [1:7556535457340412421:6916]
2025-10-02T08:16:54.500479Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:54.500921Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.500933Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.500967Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340412421:6916], now have 1 active actors on pipe
2025-10-02T08:16:54.501050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535457340412421:6916]
2025-10-02T08:16:54.501068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:54.501074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:54.501116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2870 reason: error at write: Disconnected sessionId: src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0
2025-10-02T08:16:54.501121Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:54.501168Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:54.501286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2870 sessionId: src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0 is DEAD
2025-10-02T08:16:54.501416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:54.501424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0] Write session will restart in 0.005219s
2025-10-02T08:16:54.501442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0] Write session: Do CDS request
2025-10-02T08:16:54.501447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:54.507130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.507179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:54.507190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2871
2025-10-02T08:16:54.507355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.507386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:54.507394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:54.507397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:54.507795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2871 sessionId:  describe result for acl check
2025-10-02T08:16:54.507817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:54.507822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:54.507824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:54.507828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535457340412727:5076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:54.508277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535457340412727:5076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:54.510516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535457340412727:5076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:54.511006Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:54.512188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:54.512343Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:54.512350Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:54.512369Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:54.512406Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:54.512430Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535457340412847:5077]
2025-10-02T08:16:54.512450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535457340412727:5076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:54.512459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535457340412727:5076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:54.512461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535457340412727:5076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:54.512465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:54.512794Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:54.512925Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:54.512950Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:54.513125Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:54.513151Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.513152Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.513153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.513153Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.513154Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.513157Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.513162Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.513164Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.513166Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.513168Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.513171Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.513175Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.513179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.513181Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.513183Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.513186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.513188Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.513191Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.513193Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.513196Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.513205Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:54.520269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:54.521677Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:54.521688Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:54.521690Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:54.521692Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:54.521695Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2870 [1:7556535457340412847:5077]
2025-10-02T08:16:54.521702Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:54.521713Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:54.521714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.521716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.521717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.521727Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:54.521730Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:54.521735Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:54.521771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.521776Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.521778Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:54.521780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:54.521821Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:54.521826Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.521833Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.521839Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:54.521849Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535457340412839:5077]
2025-10-02T08:16:54.521854Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535457340412839:5077]
2025-10-02T08:16:54.521860Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:54.521868Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:54.521872Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:54.521875Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:54.521880Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:54.521881Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:54.521884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2870
2025-10-02T08:16:54.521888Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340412852:5076], now have 1 active actors on pipe
2025-10-02T08:16:54.521907Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535457799626774:2378], now have 1 active actors on pipe
2025-10-02T08:16:54.521914Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.521917Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.521926Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535457340412839:5077]
2025-10-02T08:16:54.521932Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:54.521939Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:54.521950Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:54.521958Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.521961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.521962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:54.521968Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.521973Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:54.521987Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.522001Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2870
2025-10-02T08:16:54.522055Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.522060Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.522069Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.522091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2871 partition: 0 MaxSeqNo: 17 sessionId: src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0
2025-10-02T08:16:54.522345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|317b05ec-9b7510d-e3d4ff3e-a0becb97_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:54.524602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0] Write session: try to update token
2025-10-02T08:16:54.524613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:54.536413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2871 sessionId: src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:54.537520Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:54.537533Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:54.537535Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:54.537541Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535457340412839:5077]
2025-10-02T08:16:54.537544Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535457340412839:5077]
2025-10-02T08:16:54.537575Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:54.537584Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.537583Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:54.537585Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:54.537587Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:54.537695Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:54.538574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:54.601021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535457340412883:6916]
2025-10-02T08:16:54.601124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2870, pipe: [1:7556535457340412883:6916]
2025-10-02T08:16:54.654757Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:54.655046Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.655057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.655087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340412883:6916], now have 1 active actors on pipe
2025-10-02T08:16:54.655184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:54.655194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:54.655208Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:54.655246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2871 reason: error at write: Disconnected sessionId: src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0
2025-10-02T08:16:54.655247Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:54.655398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2871 sessionId: src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0 is DEAD
2025-10-02T08:16:54.655473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535457340412883:6916]
2025-10-02T08:16:54.655542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:54.655549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0] Write session will restart in 0.007571s
2025-10-02T08:16:54.655572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0] Write session: Do CDS request
2025-10-02T08:16:54.655578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:54.664206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.664297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:54.664309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2872
2025-10-02T08:16:54.664406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.664430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:54.664438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:54.664442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:54.664714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2872 sessionId:  describe result for acl check
2025-10-02T08:16:54.664734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:54.664738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:54.664741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:54.664744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535457340413274:5098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:54.665094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535457340413274:5098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:54.665098Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:54.666332Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:54.666460Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:54.666467Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:54.666474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:54.666506Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:54.666543Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535457340413301:5100]
2025-10-02T08:16:54.666617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535457340413274:5098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:54.666922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:54.667040Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:54.667064Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:54.667240Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:54.667265Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.667269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.667269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.667270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.667270Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.667273Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.667278Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.667280Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.667282Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.667284Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.667287Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.667291Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.667294Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.667297Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.667302Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.667305Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.667308Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.667310Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.667314Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.667317Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.667325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:54.671559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535457340413274:5098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:54.671568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535457340413274:5098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:54.671570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535457340413274:5098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:54.671576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:54.674359Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:54.675615Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:54.675627Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:54.675629Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:54.675631Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:54.675635Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2871 [1:7556535457340413301:5100]
2025-10-02T08:16:54.675642Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:54.675652Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:54.675654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.675656Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.675658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.675669Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:54.675676Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:54.675680Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:54.675713Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.675719Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.675721Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:54.675722Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:54.675764Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:54.675771Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.675780Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.675794Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:54.675811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2871
2025-10-02T08:16:54.675813Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535457799626780:2378], now have 1 active actors on pipe
2025-10-02T08:16:54.675815Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340413327:5098], now have 1 active actors on pipe
2025-10-02T08:16:54.675821Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535457340413277:5100]
2025-10-02T08:16:54.675823Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535457340413277:5100]
2025-10-02T08:16:54.675829Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:54.675835Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:54.675840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.675843Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:54.675843Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.675850Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2871
2025-10-02T08:16:54.675858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:54.675877Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:54.675879Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:54.675908Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f4679d1-61a6db62-795338b1-7811bf41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:54.675919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.675922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.675923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:54.675931Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.675942Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:54.675958Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535457340413277:5100]
2025-10-02T08:16:54.675969Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:54.675981Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:54.676000Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.676045Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.676052Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.676065Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.676096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2872 partition: 0 MaxSeqNo: 17 sessionId: src_id|6f4679d1-61a6db62-795338b1-7811bf41_0
2025-10-02T08:16:54.676359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8607-7f76ba3a-ac6406ad-ded1111f_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|6f4679d1-61a6db62-795338b1-7811bf41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:54.678671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4679d1-61a6db62-795338b1-7811bf41_0] Write session: try to update token
2025-10-02T08:16:54.678680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4679d1-61a6db62-795338b1-7811bf41_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:54.689924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2872 sessionId: src_id|6f4679d1-61a6db62-795338b1-7811bf41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:54.691572Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:54.691590Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:54.691593Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:54.691600Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535457340413277:5100]
2025-10-02T08:16:54.691604Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535457340413277:5100]
2025-10-02T08:16:54.691639Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:54.691642Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:54.691647Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.691649Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:54.691651Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:54.691771Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:54.691986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:54.755646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535457340413344:6916]
2025-10-02T08:16:54.755726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2871, pipe: [1:7556535457340413344:6916]
2025-10-02T08:16:54.810872Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:54.811090Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.811099Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.811127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340413344:6916], now have 1 active actors on pipe
2025-10-02T08:16:54.811260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:54.811268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:54.811286Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:54.811313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2872 reason: error at write: Disconnected sessionId: src_id|6f4679d1-61a6db62-795338b1-7811bf41_0
2025-10-02T08:16:54.811353Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:54.811441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2872 sessionId: src_id|6f4679d1-61a6db62-795338b1-7811bf41_0 is DEAD
2025-10-02T08:16:54.811520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535457340413344:6916]
2025-10-02T08:16:54.811559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4679d1-61a6db62-795338b1-7811bf41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:54.811564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4679d1-61a6db62-795338b1-7811bf41_0] Write session will restart in 0.006313s
2025-10-02T08:16:54.811590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4679d1-61a6db62-795338b1-7811bf41_0] Write session: Do CDS request
2025-10-02T08:16:54.811596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4679d1-61a6db62-795338b1-7811bf41_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:54.819156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4679d1-61a6db62-795338b1-7811bf41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.819201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:54.819213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2873
2025-10-02T08:16:54.819291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.819311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:54.819317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:54.819320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:54.819684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2873 sessionId:  describe result for acl check
2025-10-02T08:16:54.819711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:54.819715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:54.819717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:54.819720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535457340413679:5139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:54.820105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535457340413679:5139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:54.822125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535457340413679:5139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:54.822266Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:54.823400Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:54.823532Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:54.823538Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:54.823545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:54.823576Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:54.823604Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535457340413775:5138]
2025-10-02T08:16:54.823981Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:54.824186Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:54.824226Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:54.824291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535457340413679:5139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:54.824301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535457340413679:5139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:54.824302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535457340413679:5139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:54.824307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:54.824476Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:54.824525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.824530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.824530Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.824531Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.824532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.824535Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.824541Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.824543Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.824545Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.824547Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.824550Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.824554Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.824558Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.824560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.824563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.824565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.824569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.824572Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.824574Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.824577Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.824588Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:54.831593Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:54.832952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:54.832962Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:54.832963Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:54.832966Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:54.832969Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2872 [1:7556535457340413775:5138]
2025-10-02T08:16:54.832976Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:54.832986Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:54.832991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.832993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.832995Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.833004Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:54.833007Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:54.833011Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:54.833043Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.833048Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.833049Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:54.833051Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:54.833088Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:54.833093Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.833100Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.833107Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:54.833119Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535457340413760:5138]
2025-10-02T08:16:54.833124Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535457340413760:5138]
2025-10-02T08:16:54.833128Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:54.833133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2872
2025-10-02T08:16:54.833136Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340413786:5139], now have 1 active actors on pipe
2025-10-02T08:16:54.833138Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:54.833140Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:54.833141Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:54.833148Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:54.833150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:54.833153Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535457799626786:2378], now have 1 active actors on pipe
2025-10-02T08:16:54.833157Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.833159Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.833178Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535457340413760:5138]
2025-10-02T08:16:54.833186Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:54.833194Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:54.833199Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:54.833202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.833204Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.833205Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:54.833210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.833216Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:54.833202Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2872
2025-10-02T08:16:54.833239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.833269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.833274Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.833282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.833305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2873 partition: 0 MaxSeqNo: 17 sessionId: src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0
2025-10-02T08:16:54.833562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4679d1-61a6db62-795338b1-7811bf41_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:54.835924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0] Write session: try to update token
2025-10-02T08:16:54.835935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:54.850394Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:54.850409Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:54.850410Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:54.850416Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535457340413760:5138]
2025-10-02T08:16:54.850418Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535457340413760:5138]
2025-10-02T08:16:54.850446Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:54.850450Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.850451Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:54.850453Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:54.850457Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:54.850564Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:54.851332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2873 sessionId: src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:54.853528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:54.911791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535457340413843:6916]
2025-10-02T08:16:54.911864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2872, pipe: [1:7556535457340413843:6916]
2025-10-02T08:16:54.968627Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:54.968916Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.968926Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.968955Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340413843:6916], now have 1 active actors on pipe
2025-10-02T08:16:54.969072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535457340413843:6916]
2025-10-02T08:16:54.969099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:54.969104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:54.969153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2873 reason: error at write: Disconnected sessionId: src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0
2025-10-02T08:16:54.969137Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:54.969303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2873 sessionId: src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0 is DEAD
2025-10-02T08:16:54.969332Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:54.969411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:54.969419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0] Write session will restart in 0.006140s
2025-10-02T08:16:54.969436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0] Write session: Do CDS request
2025-10-02T08:16:54.969441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:54.976157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.976195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:54.976204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2874
2025-10-02T08:16:54.976300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:54.976320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:54.976327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:54.976329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:54.976654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2874 sessionId:  describe result for acl check
2025-10-02T08:16:54.976676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:54.976680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:54.976681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:54.976684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535457340414167:5245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:54.977020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535457340414167:5245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:54.978830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535457340414167:5245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:54.979537Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:54.980796Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:54.980939Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:54.980948Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:54.980954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:54.980986Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:54.981008Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535457340414277:5244]
2025-10-02T08:16:54.981152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535457340414167:5245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:54.981162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535457340414167:5245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:54.981164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535457340414167:5245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:54.981169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:54.981368Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:54.981474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:54.981497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:54.981669Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:54.981696Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.981697Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.981698Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.981699Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.981700Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.981704Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.981711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.981713Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.981715Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.981717Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.981720Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.981723Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:54.981726Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.981730Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:54.981732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.981734Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:54.981736Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.981739Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.981741Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.981743Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.981753Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:54.988732Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:54.990075Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:54.990089Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:54.990090Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:54.990092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:54.990097Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2873 [1:7556535457340414277:5244]
2025-10-02T08:16:54.990103Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:54.990112Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:54.990113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.990115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.990116Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.990126Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:54.990132Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:54.990136Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:54.990170Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.990176Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.990178Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:54.990179Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:54.990215Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:54.990220Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:54.990228Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:54.990234Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:54.990248Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535457340414282:5245], now have 1 active actors on pipe
2025-10-02T08:16:54.990255Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535457340414271:5244]
2025-10-02T08:16:54.990257Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535457340414271:5244]
2025-10-02T08:16:54.990256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2873
2025-10-02T08:16:54.990264Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:54.990270Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:54.990271Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:54.990271Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:54.990278Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:54.990280Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:54.990283Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535457799626816:2378], now have 1 active actors on pipe
2025-10-02T08:16:54.990286Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.990288Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.990310Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535457340414271:5244]
2025-10-02T08:16:54.990316Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:54.990323Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:54.990325Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec1fd719-b315753d-814161ab-7c148563_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:54.990305Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2873
2025-10-02T08:16:54.990329Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:54.990331Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:54.990332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:54.990337Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:54.990342Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:54.990365Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.990397Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:54.990401Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:54.990409Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:54.990434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2874 partition: 0 MaxSeqNo: 17 sessionId: src_id|ec1fd719-b315753d-814161ab-7c148563_0
2025-10-02T08:16:54.990675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168678e-b2194b62-8e1ea5d7-26cdc92e_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|ec1fd719-b315753d-814161ab-7c148563_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:54.993030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1fd719-b315753d-814161ab-7c148563_0] Write session: try to update token
2025-10-02T08:16:54.993042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1fd719-b315753d-814161ab-7c148563_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:55.004038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2874 sessionId: src_id|ec1fd719-b315753d-814161ab-7c148563_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:55.005806Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:55.005821Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:55.005822Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:55.005827Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535457340414271:5244]
2025-10-02T08:16:55.005830Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535457340414271:5244]
2025-10-02T08:16:55.005859Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:55.005862Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:55.005867Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:55.005869Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.005870Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:55.005988Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:55.006090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:55.068977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535461635381615:6916]
2025-10-02T08:16:55.069054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2873, pipe: [1:7556535461635381615:6916]
2025-10-02T08:16:55.122842Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:55.123103Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.123113Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.123141Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635381615:6916], now have 1 active actors on pipe
2025-10-02T08:16:55.123232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:55.123238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:55.123276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2874 reason: error at write: Disconnected sessionId: src_id|ec1fd719-b315753d-814161ab-7c148563_0
2025-10-02T08:16:55.123288Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:55.123317Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:55.123412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2874 sessionId: src_id|ec1fd719-b315753d-814161ab-7c148563_0 is DEAD
2025-10-02T08:16:55.123523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535461635381615:6916]
2025-10-02T08:16:55.123560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1fd719-b315753d-814161ab-7c148563_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:55.123577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1fd719-b315753d-814161ab-7c148563_0] Write session will restart in 0.008358s
2025-10-02T08:16:55.123597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1fd719-b315753d-814161ab-7c148563_0] Write session: Do CDS request
2025-10-02T08:16:55.123602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1fd719-b315753d-814161ab-7c148563_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:55.133142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1fd719-b315753d-814161ab-7c148563_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.133175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:55.133186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2875
2025-10-02T08:16:55.133325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.133347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:55.133354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:55.133357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:55.133607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2875 sessionId:  describe result for acl check
2025-10-02T08:16:55.133628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:55.133632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:55.133633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:55.133636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535461635382006:5307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:55.133954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535461635382006:5307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:55.134338Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:55.135436Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:55.135503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535461635382006:5307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:55.135552Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:55.135559Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:55.135565Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:55.135594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:55.135616Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535461635382041:5304]
2025-10-02T08:16:55.136001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:55.136144Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:55.136179Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:55.136377Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:55.136405Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.136409Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.136410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.136410Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.136411Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.136414Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.136419Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.136421Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.136423Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.136425Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.136428Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.136432Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.136439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.136442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.136444Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.136447Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.136449Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.136451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.136453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.136456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.136469Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:55.140767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535461635382006:5307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:55.140779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535461635382006:5307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:55.140782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535461635382006:5307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:55.140788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:55.143778Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:55.145103Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:55.145116Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:55.145117Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:55.145119Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:55.145123Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2874 [1:7556535461635382041:5304]
2025-10-02T08:16:55.145129Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:55.145139Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:55.145141Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.145142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.145143Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.145152Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:55.145155Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:55.145159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:55.145203Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.145211Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.145213Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:55.145214Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:55.145252Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:55.145257Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.145264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.145270Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:55.145283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2874
2025-10-02T08:16:55.145285Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635382068:5307], now have 1 active actors on pipe
2025-10-02T08:16:55.145287Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535462094594130:2378], now have 1 active actors on pipe
2025-10-02T08:16:55.145292Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535461635382022:5304]
2025-10-02T08:16:55.145293Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535461635382022:5304]
2025-10-02T08:16:55.145297Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:55.145302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.145304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.145305Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:55.145307Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:55.145316Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:55.145323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:55.145324Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:55.145344Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|226946de-b023996b-32f4ee53-e28e60f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:55.145348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.145350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.145351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:55.145356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.145333Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2874
2025-10-02T08:16:55.145362Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:55.145367Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535461635382022:5304]
2025-10-02T08:16:55.145372Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:55.145386Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:55.145391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:55.145415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.145420Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.145428Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:55.145452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2875 partition: 0 MaxSeqNo: 17 sessionId: src_id|226946de-b023996b-32f4ee53-e28e60f5_0
2025-10-02T08:16:55.145661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1fd719-b315753d-814161ab-7c148563_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|226946de-b023996b-32f4ee53-e28e60f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:55.147851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226946de-b023996b-32f4ee53-e28e60f5_0] Write session: try to update token
2025-10-02T08:16:55.147861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226946de-b023996b-32f4ee53-e28e60f5_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:55.158651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2875 sessionId: src_id|226946de-b023996b-32f4ee53-e28e60f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:55.160712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:55.161871Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.161889Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.161905Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:55.161910Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:55.161912Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:55.161917Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535461635382022:5304]
2025-10-02T08:16:55.161920Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535461635382022:5304]
2025-10-02T08:16:55.161951Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:55.161958Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:55.161960Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:55.161962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.161963Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:55.162070Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:55.223596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535461635382083:6916]
2025-10-02T08:16:55.223690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2874, pipe: [1:7556535461635382083:6916]
2025-10-02T08:16:55.277991Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:55.278384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:55.278411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:55.278419Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635382083:6916], now have 1 active actors on pipe
2025-10-02T08:16:55.278493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:55.278498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:55.278513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2875 reason: error at write: Disconnected sessionId: src_id|226946de-b023996b-32f4ee53-e28e60f5_0
2025-10-02T08:16:55.278649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2875 sessionId: src_id|226946de-b023996b-32f4ee53-e28e60f5_0 is DEAD
2025-10-02T08:16:55.278636Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:55.278754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535461635382083:6916]
2025-10-02T08:16:55.278786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226946de-b023996b-32f4ee53-e28e60f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:55.278795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226946de-b023996b-32f4ee53-e28e60f5_0] Write session will restart in 0.008799s
2025-10-02T08:16:55.278813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226946de-b023996b-32f4ee53-e28e60f5_0] Write session: Do CDS request
2025-10-02T08:16:55.278818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226946de-b023996b-32f4ee53-e28e60f5_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:55.288213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|226946de-b023996b-32f4ee53-e28e60f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.288261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:55.288274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2876
2025-10-02T08:16:55.288392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.288413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:55.288419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:55.288422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:55.288794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2876 sessionId:  describe result for acl check
2025-10-02T08:16:55.288829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:55.288835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:55.288837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:55.288841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535461635382464:5324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:55.289199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535461635382464:5324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:55.290366Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:55.291367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535461635382464:5324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:55.291471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:55.291575Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:55.291581Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:55.291587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:55.291613Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:55.291637Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535461635382514:5321]
2025-10-02T08:16:55.292006Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:55.292177Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:55.292215Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:55.292408Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:55.292433Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.292437Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.292438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.292438Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.292439Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.292442Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.292448Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.292450Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.292452Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.292453Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.292456Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.292461Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.292467Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.292470Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.292472Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.292474Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.292477Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.292482Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.292485Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.292491Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.292502Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:55.296650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535461635382464:5324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:55.296659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535461635382464:5324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:55.296662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535461635382464:5324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:55.296666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:55.299493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:55.300766Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:55.300779Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:55.300780Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:55.300782Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:55.300785Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2875 [1:7556535461635382514:5321]
2025-10-02T08:16:55.300791Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:55.300818Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:55.300824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.300827Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.300829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.300841Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:55.300849Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:55.300858Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:55.300895Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.300900Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.300902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:55.300904Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:55.300962Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:55.300968Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.300976Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.300981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2875
2025-10-02T08:16:55.300987Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:55.300998Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635382537:5324], now have 1 active actors on pipe
2025-10-02T08:16:55.301003Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535462094594137:2378], now have 1 active actors on pipe
2025-10-02T08:16:55.301007Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.301008Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.301020Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535461635382499:5321]
2025-10-02T08:16:55.301025Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535461635382499:5321]
2025-10-02T08:16:55.301029Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:55.301040Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:55.301048Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:55.301050Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:55.301052Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:55.301026Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2875
2025-10-02T08:16:55.301056Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:55.301065Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:55.301070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.301073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.301074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:55.301081Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.301093Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:55.301117Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535461635382499:5321]
2025-10-02T08:16:55.301127Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:55.301140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:55.301142Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:55.301212Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.301217Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.301228Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:55.301249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2876 partition: 0 MaxSeqNo: 17 sessionId: src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0
2025-10-02T08:16:55.301479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|226946de-b023996b-32f4ee53-e28e60f5_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:55.303734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0] Write session: try to update token
2025-10-02T08:16:55.303747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:55.310438Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-02T08:16:55.310452Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:55.310461Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [1:7556535461635382499:5321]
2025-10-02T08:16:55.310486Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-02T08:16:55.310492Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-02T08:16:55.310637Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-02T08:16:55.310752Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:55.310874Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:55.310988Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-02T08:16:55.311145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-02T08:16:55.311170Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759392439416 queuesize 0 startOffset 0
2025-10-02T08:16:55.315112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2876 sessionId: src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:55.317162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:55.317203Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.317210Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.317230Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-02T08:16:55.317245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:55.317269Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.317282Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.317410Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.317463Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.317516Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.317567Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.317607Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.317614Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.317668Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.317718Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.317770Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.317822Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.317865Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.317873Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.317932Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.317982Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.318031Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.318082Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.318122Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.318127Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.318177Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.318229Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.318279Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.318331Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.318372Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.318380Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.318434Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.318482Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.318531Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.318592Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.318631Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.318636Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.318690Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.318739Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.318789Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.318840Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.318882Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.318890Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.318945Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.318993Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.319044Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.319094Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.319132Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.319137Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.319188Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.319239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.319291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.319343Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.319384Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.319391Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.319445Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.319492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.319542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.319594Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.319632Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.319637Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.319689Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 1 size: 511959
2025-10-02T08:16:55.319737Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 1 size: 511959
2025-10-02T08:16:55.319787Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 1 size: 511959
2025-10-02T08:16:55.319837Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 1 size: 511959
2025-10-02T08:16:55.319874Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size: 205040
2025-10-02T08:16:55.319878Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-02T08:16:55.319908Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-02T08:16:55.319957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.319979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.319984Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-02T08:16:55.320006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-02T08:16:55.320018Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-02T08:16:55.320024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-02T08:16:55.320026Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-02T08:16:55.320028Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-02T08:16:55.320336Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-02T08:16:55.320353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-02T08:16:55.320360Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-02T08:16:55.320363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-02T08:16:55.320365Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-02T08:16:55.320367Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-02T08:16:55.320983Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-02T08:16:55.321006Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-02T08:16:55.321017Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-02T08:16:55.321024Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-02T08:16:55.321027Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-02T08:16:55.321034Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-02T08:16:55.321392Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-02T08:16:55.321408Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-02T08:16:55.321411Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-02T08:16:55.321415Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-02T08:16:55.321417Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-02T08:16:55.322394Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-02T08:16:55.322409Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-02T08:16:55.322416Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1759393015322
2025-10-02T08:16:55.322514Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-02T08:16:55.322524Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-02T08:16:55.322527Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-02T08:16:55.322529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-02T08:16:55.322532Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-02T08:16:55.322534Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-02T08:16:55.322953Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-02T08:16:55.322972Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-02T08:16:55.322981Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-02T08:16:55.322988Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-02T08:16:55.322992Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-02T08:16:55.322998Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-02T08:16:55.323358Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 5223541 count 3 nextOffset 23 batches 10
2025-10-02T08:16:55.323373Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-02T08:16:55.323381Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-02T08:16:55.323387Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-02T08:16:55.323389Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-02T08:16:55.323391Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-02T08:16:55.323756Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 7476739 count 4 nextOffset 24 batches 14
2025-10-02T08:16:55.323772Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-02T08:16:55.323775Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-02T08:16:55.324660Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 1 result is x0000000000_00000000000000000020_00003_0000000004_00014? size 7988760
2025-10-02T08:16:55.324674Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-02T08:16:55.324678Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-02T08:16:55.324680Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-02T08:16:55.324685Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00003_0000000004_00014? new key d0000000000_00000000000000000020_00003_0000000004_00014? size 7988760 WTime 1759393015324
2025-10-02T08:16:55.324940Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 1 PackedSize 1741199 count 1 nextOffset 25 batches 4
2025-10-02T08:16:55.324954Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-02T08:16:55.324958Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-02T08:16:55.324963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-02T08:16:55.324965Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-02T08:16:55.324967Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-02T08:16:55.325337Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 3994397 count 2 nextOffset 26 batches 8
2025-10-02T08:16:55.325353Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-02T08:16:55.325357Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-02T08:16:55.325359Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-02T08:16:55.325361Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-02T08:16:55.325363Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-02T08:16:55.325741Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 1 PackedSize 6247595 count 3 nextOffset 27 batches 12
2025-10-02T08:16:55.325757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.325826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 17 endOffset 17 curOffset 27 d0000000000_00000000000000000024_00001_0000000003_00011? size 6247585 WTime 1759393015325
2025-10-02T08:16:55.326434Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-02T08:16:55.326451Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-02T08:16:55.326454Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 4 size 7988760
2025-10-02T08:16:55.326458Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 1 count 3 size 6247585
2025-10-02T08:16:55.327788Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:55.327795Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:55.327796Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:55.327803Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535461635382499:5321]
2025-10-02T08:16:55.327805Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535461635382499:5321]
2025-10-02T08:16:55.327834Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:55.327841Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:55.327843Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:55.327843Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.327845Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:55.327951Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:55.378776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535461635382558:6916]
2025-10-02T08:16:55.378882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2875, pipe: [1:7556535461635382558:6916]
2025-10-02T08:16:55.447794Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:55.448105Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635382558:6916], now have 1 active actors on pipe
2025-10-02T08:16:55.448191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535461635382558:6916]
2025-10-02T08:16:55.448215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:55.448221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:55.448229Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:55.448245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2876 reason: error at write: Disconnected sessionId: src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0
2025-10-02T08:16:55.448246Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:55.448377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2876 sessionId: src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0 is DEAD
2025-10-02T08:16:55.448526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:55.448535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0] Write session will restart in 0.005938s
2025-10-02T08:16:55.448556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0] Write session: Do CDS request
2025-10-02T08:16:55.448562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:55.455170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.455248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:55.455259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2877
2025-10-02T08:16:55.455350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.455371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:55.455378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:55.455380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:55.455670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2877 sessionId:  describe result for acl check
2025-10-02T08:16:55.455692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:55.455693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:55.455694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:55.455696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535461635382894:5355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:55.456109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535461635382894:5355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:55.457926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535461635382894:5355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:55.458254Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:55.459448Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:55.459566Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:55.459573Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:55.459580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:55.459611Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:55.459633Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535461635382997:5342]
2025-10-02T08:16:55.460036Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:55.460086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535461635382894:5355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:55.460097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535461635382894:5355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:55.460099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535461635382894:5355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:55.460104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:55.460197Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:55.460231Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:55.460451Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:55.460497Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.460503Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.460504Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.460505Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.460507Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.460511Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.460519Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.460522Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.460525Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.460528Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.460537Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.460548Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.460556Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.460560Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.460563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.460571Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.460579Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.460583Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.460590Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.460594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.460609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:55.467575Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:55.468938Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:55.468951Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:55.468952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:55.468954Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:55.468958Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2876 [1:7556535461635382997:5342]
2025-10-02T08:16:55.468964Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:55.468975Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:55.468977Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.468979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.468980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.468989Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:55.468992Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:55.468996Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:55.469031Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.469038Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.469041Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:55.469044Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:55.469091Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:55.469096Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.469103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.469110Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:55.469124Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635383006:5355], now have 1 active actors on pipe
2025-10-02T08:16:55.469132Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535461635382987:5342]
2025-10-02T08:16:55.469133Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535461635382987:5342]
2025-10-02T08:16:55.469137Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:55.469138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2876
2025-10-02T08:16:55.469144Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:55.469146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535462094594145:2378], now have 1 active actors on pipe
2025-10-02T08:16:55.469152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:55.469156Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:55.469162Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:55.469167Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:55.469172Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.469174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.469198Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535461635382987:5342]
2025-10-02T08:16:55.469203Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:55.469205Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:55.469180Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2876
2025-10-02T08:16:55.469212Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58672f4a-658f7693-98284967-84752ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:55.469220Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.469222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.469223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:55.469228Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.469234Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:55.469260Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:55.469291Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.469296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.469304Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:55.469330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2877 partition: 0 MaxSeqNo: 17 sessionId: src_id|58672f4a-658f7693-98284967-84752ab_0
2025-10-02T08:16:55.469571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ca58c6-f6a2fd80-14636776-c2b27c2d_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|58672f4a-658f7693-98284967-84752ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:55.471786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58672f4a-658f7693-98284967-84752ab_0] Write session: try to update token
2025-10-02T08:16:55.471796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58672f4a-658f7693-98284967-84752ab_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:55.483440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2877 sessionId: src_id|58672f4a-658f7693-98284967-84752ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:55.484855Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:55.484868Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:55.484870Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:55.484876Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535461635382987:5342]
2025-10-02T08:16:55.484881Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535461635382987:5342]
2025-10-02T08:16:55.484909Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:55.484916Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.484918Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:55.484996Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:55.485006Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:55.485027Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:55.485514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:55.548334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535461635383027:6916]
2025-10-02T08:16:55.548421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2876, pipe: [1:7556535461635383027:6916]
2025-10-02T08:16:55.604770Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:55.605016Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.605026Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.605056Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635383027:6916], now have 1 active actors on pipe
2025-10-02T08:16:55.605161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-02T08:16:55.605171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-02T08:16:55.605196Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:55.605228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2877 reason: error at write: Disconnected sessionId: src_id|58672f4a-658f7693-98284967-84752ab_0
2025-10-02T08:16:55.605255Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:55.605376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2877 sessionId: src_id|58672f4a-658f7693-98284967-84752ab_0 is DEAD
2025-10-02T08:16:55.605434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535461635383027:6916]
2025-10-02T08:16:55.605511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58672f4a-658f7693-98284967-84752ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-02T08:16:55.605520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58672f4a-658f7693-98284967-84752ab_0] Write session will restart in 0.008739s
2025-10-02T08:16:55.605535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58672f4a-658f7693-98284967-84752ab_0] Write session: Do CDS request
2025-10-02T08:16:55.605540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58672f4a-658f7693-98284967-84752ab_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:55.615192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58672f4a-658f7693-98284967-84752ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.615275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:55.615289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2878
2025-10-02T08:16:55.615354Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:55.615359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.615375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:55.615381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:55.615383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:55.615654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2878 sessionId:  describe result for acl check
2025-10-02T08:16:55.615675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:55.615680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:55.615681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:55.615684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535461635383438:5399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:55.616016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535461635383438:5399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:55.616526Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:55.616658Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:55.616667Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:55.616674Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:55.616711Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:55.616737Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535461635383457:5389]
2025-10-02T08:16:55.617130Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:55.617221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535461635383438:5399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:55.617246Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:55.617269Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:55.617532Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:55.617563Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.617568Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.617569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.617569Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.617570Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.617573Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.617578Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.617580Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.617582Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.617584Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.617587Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.617591Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.617594Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.617596Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.617598Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.617601Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.617602Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.617605Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.617607Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.617609Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.617618Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:55.622788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535461635383438:5399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:55.622799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535461635383438:5399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:55.622801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535461635383438:5399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:55.622807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:55.624654Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:55.626076Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:55.626090Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:55.626092Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:55.626094Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:55.626098Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2877 [1:7556535461635383457:5389]
2025-10-02T08:16:55.626105Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:55.626118Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:55.626121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.626124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.626125Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.626137Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:55.626145Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:55.626150Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:55.626183Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.626187Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.626190Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:55.626192Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:55.626243Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:55.626250Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.626258Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.626264Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:55.626276Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635383487:5399], now have 1 active actors on pipe
2025-10-02T08:16:55.626279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2877
2025-10-02T08:16:55.626284Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535462094594150:2378], now have 1 active actors on pipe
2025-10-02T08:16:55.626288Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535461635383432:5389]
2025-10-02T08:16:55.626289Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535461635383432:5389]
2025-10-02T08:16:55.626294Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:55.626299Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.626301Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:55.626302Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.626303Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:55.626315Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:55.626321Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:55.626323Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:55.626321Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2877
2025-10-02T08:16:55.626344Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:55.626352Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.626355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.626357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:55.626364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.626372Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-02T08:16:55.626383Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535461635383432:5389]
2025-10-02T08:16:55.626394Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:55.626400Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:55.626414Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:55.626456Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.626461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.626470Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-02T08:16:55.626494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2878 partition: 0 MaxSeqNo: 17 sessionId: src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0
2025-10-02T08:16:55.626753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58672f4a-658f7693-98284967-84752ab_0] Write session established. Init response: last_sequence_number: 17 session_id: "src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-02T08:16:55.629296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0] Write session: try to update token
2025-10-02T08:16:55.629310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0] Send 10 message(s) (0 left), first sequence number is 18
2025-10-02T08:16:55.642066Z node 1 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-02T08:16:55.642087Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-02T08:16:55.642088Z node 1 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-02T08:16:55.642094Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7476729 actorID [1:7556535461635383432:5389]
2025-10-02T08:16:55.642097Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [1:7556535461635383432:5389]
2025-10-02T08:16:55.642123Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-02T08:16:55.642126Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-02T08:16:55.642126Z node 1 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-02T08:16:55.642130Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.642131Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-02T08:16:55.642242Z node 1 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-02T08:16:55.642336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2878 sessionId: src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-02T08:16:55.644547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-02T08:16:55.705401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 17 InitDone 1 WaitForData 0, pipe: [1:7556535461635383500:6916]
2025-10-02T08:16:55.705481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2877, pipe: [1:7556535461635383500:6916]
2025-10-02T08:16:55.762761Z node 1 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=10;Head.PackedSize=6247582;NewHead.Offset=10;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1474C09F)
??+0 (0x1474C047)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x154B1E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240F6BA2)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240F0DBE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241E5ADA)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241E708D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24096039)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x1545D988)
??+0 (0x1474C09F)
??+0 (0x1474C274)
std::rethrow_exception(std::exception_ptr)+12 (0x1475D5EC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x17258B91)
2025-10-02T08:16:55.762990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.763001Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.763030Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635383500:6916], now have 1 active actors on pipe
2025-10-02T08:16:55.763158Z node 1 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-02T08:16:55.763233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_6684798439354710115_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556535461635383500:6916]
2025-10-02T08:16:55.763263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-10-02T08:16:55.763244Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-02T08:16:55.763324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2878 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0
2025-10-02T08:16:55.763490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2878 sessionId: src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0 is DEAD
2025-10-02T08:16:55.763593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-02T08:16:55.763602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0] Write session will restart in 0.006318s
2025-10-02T08:16:55.763621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0] Write session: Do CDS request
2025-10-02T08:16:55.763626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0] Start write session. Will connect to endpoint: localhost:18220
2025-10-02T08:16:55.771183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77559005-588e8efd-57f1f4e0-9cc0cd2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.771275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-02T08:16:55.771288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2879
2025-10-02T08:16:55.771372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-02T08:16:55.771393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56310
2025-10-02T08:16:55.771400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56310 proto=v1  topic=test-topic durationSec=0
2025-10-02T08:16:55.771402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-02T08:16:55.771727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2879 sessionId:  describe result for acl check
2025-10-02T08:16:55.771748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-02T08:16:55.771752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-02T08:16:55.771753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-02T08:16:55.771757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556535461635383867:5411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-02T08:16:55.772112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556535461635383867:5411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-02T08:16:55.773568Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-02T08:16:55.774287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556535461635383867:5411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-02T08:16:55.774797Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-02T08:16:55.774928Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-02T08:16:55.774935Z node 1 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-02T08:16:55.774941Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-02T08:16:55.774971Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-02T08:16:55.774994Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556535461635383945:5402]
2025-10-02T08:16:55.775356Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-02T08:16:55.775493Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-02T08:16:55.775529Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-02T08:16:55.775829Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-02T08:16:55.775856Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.775860Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.775861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.775861Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.775862Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.775866Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.775871Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.775873Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.775875Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.775877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.775880Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.775884Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-02T08:16:55.775888Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.775894Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-02T08:16:55.775897Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.775903Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 6247582 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00011|
2025-10-02T08:16:55.775905Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.775908Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7476729 so 0 eo 14 d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.775910Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.775913Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 3 size 6759616 so 0 eo 17 d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.775922Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-02T08:16:55.776121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556535461635383867:5411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-02T08:16:55.776129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556535461635383867:5411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-02T08:16:55.776130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556535461635383867:5411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-02T08:16:55.776135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-02T08:16:55.782956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 7 endOffset 17 key 7,3 valuesize 6247582 expected 6247582
2025-10-02T08:16:55.784311Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-02T08:16:55.784323Z node 1 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-02T08:16:55.784325Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-02T08:16:55.784327Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-02T08:16:55.784331Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2878 [1:7556535461635383945:5402]
2025-10-02T08:16:55.784338Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 17 Head Offset 17 PartNo 0 PackedSize 0 count 0 nextOffset 17 batches 0
SYNC INIT sourceId  src_id seqNo 17 offset 16
SYNC INIT DATA KEY: d0000000000_00000000000000000010_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616
2025-10-02T08:16:55.784348Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-02T08:16:55.784349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.784351Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.784353Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-02T08:16:55.784362Z node 1 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 17 offset: 16 MaxOffset: 17
2025-10-02T08:16:55.784365Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-02T08:16:55.784370Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-02T08:16:55.784406Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.784411Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.784413Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes (14236345)
2025-10-02T08:16:55.784415Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-02T08:16:55.784454Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-02T08:16:55.784459Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000004_00013?
2025-10-02T08:16:55.784465Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-02T08:16:55.784472Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-02T08:16:55.784483Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556535461635383961:5411], now have 1 active actors on pipe
2025-10-02T08:16:55.784489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 2878
2025-10-02T08:16:55.784490Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 3 count 4 parts_count 13 actorID [1:7556535461635383928:5402]
2025-10-02T08:16:55.784493Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 0 count 3 parts_count 12 actorID [1:7556535461635383928:5402]
2025-10-02T08:16:55.784498Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-02T08:16:55.784503Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556535462094594156:2378], now have 1 active actors on pipe
2025-10-02T08:16:55.784506Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 3 count 4 parts_count 13
2025-10-02T08:16:55.784507Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-02T08:16:55.784508Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 0 count 3 parts_count 12
2025-10-02T08:16:55.784514Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 17
2025-10-02T08:16:55.784516Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-02T08:16:55.784520Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-02T08:16:55.784523Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-02T08:16:55.784552Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [1:7556535461635383928:5402]
2025-10-02T08:16:55.784560Z node 1 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-02T08:16:55.784571Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-02T08:16:55.784574Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39561352-795f5745-c02d3e39-7b9c8125_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-02T08:16:55.784579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-02T08:16:55.784558Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 2878
2025-10-02T08:16:55.784586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-02T08:16:55.784587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-02T08:16:55.784595Z node 1 :PERSQUEUE DEBUG